2023-09-30T16:49:51.854 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-30T16:49:51.854 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yuriw@teuthology --name yuriw-2023-09-29_19:49:08-powercycle-main-distro-default-smithi --archive /home/teuthworker/archive/yuriw-2023-09-29_19:49:08-powercycle-main-distro-default-smithi/7407742 --verbose --description powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-stupid powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_suites_fsync thrashosds-health} -- /home/teuthworker/archive/yuriw-2023-09-29_19:49:08-powercycle-main-distro-default-smithi/7407742/orig.config.yaml 2023-09-30T16:49:51.888 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T16:49:51.959 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-09-29_19:49:08-powercycle-main-distro-default-smithi/7407742 branch: main description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-stupid powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_suites_fsync thrashosds-health} email: yweinste@redhat.com first_in_suite: false job_id: '7407742' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: yuriw-2023-09-29_19:49:08-powercycle-main-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: rhel os_version: '8.6' overrides: admin_socket: branch: main ceph: conf: global: osd_pg_log_dups_tracked: 10000 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: stupid bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(MDS_TRIM\) - \(MDS_SLOW_REQUEST\) - MDS_SLOW_METADATA_IO - Behind on trimming - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from sha1: 1d10b71792f3be8887a7631e69851ac2df3585af ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 1d10b71792f3be8887a7631e69851ac2df3585af selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: main sha1: 1d10b71792f3be8887a7631e69851ac2df3585af owner: scheduled_yuriw@teuthology priority: 76 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - client.0 - - osd.0 - - osd.1 - - osd.2 seed: 6636 sha1: 1d10b71792f3be8887a7631e69851ac2df3585af sleep_before_teardown: 0 subset: 111/12000 suite: powercycle suite_branch: main suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_1d10b71792f3be8887a7631e69851ac2df3585af/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 1d10b71792f3be8887a7631e69851ac2df3585af targets: smithi007.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi031.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi072.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= smithi134.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs= tasks: - install: extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: null - thrashosds: chance_down: 1.0 powercycle: true timeout: 600 - ceph-fuse: null - workunit: clients: all: - suites/fsync-tester.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-09-29_19:49:08 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-09-30T16:49:51.960 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_1d10b71792f3be8887a7631e69851ac2df3585af/qa; will attempt to use it 2023-09-30T16:49:51.960 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_1d10b71792f3be8887a7631e69851ac2df3585af/qa/tasks 2023-09-30T16:49:51.960 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-09-30T16:49:51.962 INFO:teuthology.task.internal:Checking packages... 2023-09-30T16:49:51.982 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '1d10b71792f3be8887a7631e69851ac2df3585af' 2023-09-30T16:49:51.983 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-09-30T16:49:51.983 INFO:teuthology.packaging:ref: None 2023-09-30T16:49:51.983 INFO:teuthology.packaging:tag: None 2023-09-30T16:49:51.983 INFO:teuthology.packaging:branch: main 2023-09-30T16:49:51.983 INFO:teuthology.packaging:sha1: 1d10b71792f3be8887a7631e69851ac2df3585af 2023-09-30T16:49:51.983 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=main 2023-09-30T16:49:52.202 INFO:teuthology.task.internal:Found packages for ceph version 18.0.0-6451.g8f071794 2023-09-30T16:49:52.202 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-09-30T16:49:52.208 INFO:teuthology.task.internal:no buildpackages task found 2023-09-30T16:49:52.208 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-09-30T16:49:52.230 INFO:teuthology.task.internal:Saving configuration 2023-09-30T16:49:52.242 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-09-30T16:49:52.248 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-30T16:49:52.274 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi007.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-29_19:49:08-powercycle-main-distro-default-smithi/7407742', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-30 16:44:13.481632', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-30T16:49:52.298 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi031.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-29_19:49:08-powercycle-main-distro-default-smithi/7407742', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-30 16:44:13.479661', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-30T16:49:52.316 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-29_19:49:08-powercycle-main-distro-default-smithi/7407742', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-30 16:44:13.483372', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-30T16:49:52.337 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-29_19:49:08-powercycle-main-distro-default-smithi/7407742', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-30 16:44:13.484932', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-30T16:49:52.337 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-09-30T16:49:52.344 INFO:teuthology.task.internal:roles: ubuntu@smithi007.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'] 2023-09-30T16:49:52.344 INFO:teuthology.task.internal:roles: ubuntu@smithi031.front.sepia.ceph.com - ['osd.0'] 2023-09-30T16:49:52.344 INFO:teuthology.task.internal:roles: ubuntu@smithi072.front.sepia.ceph.com - ['osd.1'] 2023-09-30T16:49:52.344 INFO:teuthology.task.internal:roles: ubuntu@smithi134.front.sepia.ceph.com - ['osd.2'] 2023-09-30T16:49:52.344 INFO:teuthology.run_tasks:Running task console_log... 2023-09-30T16:49:52.478 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7ff15ac52af0>, signals=[15]) 2023-09-30T16:49:52.478 INFO:teuthology.run_tasks:Running task internal.connect... 2023-09-30T16:49:52.484 INFO:teuthology.task.internal:Opening connections... 2023-09-30T16:49:52.485 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi007.front.sepia.ceph.com 2023-09-30T16:49:52.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T16:49:52.554 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi031.front.sepia.ceph.com 2023-09-30T16:49:52.555 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T16:49:52.622 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi072.front.sepia.ceph.com 2023-09-30T16:49:52.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T16:49:52.689 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi134.front.sepia.ceph.com 2023-09-30T16:49:52.689 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T16:49:52.756 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-09-30T16:49:52.763 DEBUG:teuthology.orchestra.run.smithi007:> uname -m 2023-09-30T16:49:52.784 INFO:teuthology.orchestra.run.smithi007.stdout:x86_64 2023-09-30T16:49:52.785 DEBUG:teuthology.orchestra.run.smithi007:> cat /etc/os-release 2023-09-30T16:49:52.845 INFO:teuthology.orchestra.run.smithi007.stdout:NAME="Red Hat Enterprise Linux" 2023-09-30T16:49:52.845 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION="8.6 (Ootpa)" 2023-09-30T16:49:52.845 INFO:teuthology.orchestra.run.smithi007.stdout:ID="rhel" 2023-09-30T16:49:52.845 INFO:teuthology.orchestra.run.smithi007.stdout:ID_LIKE="fedora" 2023-09-30T16:49:52.845 INFO:teuthology.orchestra.run.smithi007.stdout:VERSION_ID="8.6" 2023-09-30T16:49:52.845 INFO:teuthology.orchestra.run.smithi007.stdout:PLATFORM_ID="platform:el8" 2023-09-30T16:49:52.845 INFO:teuthology.orchestra.run.smithi007.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-30T16:49:52.846 INFO:teuthology.orchestra.run.smithi007.stdout:ANSI_COLOR="0;31" 2023-09-30T16:49:52.846 INFO:teuthology.orchestra.run.smithi007.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-30T16:49:52.846 INFO:teuthology.orchestra.run.smithi007.stdout:HOME_URL="https://www.redhat.com/" 2023-09-30T16:49:52.846 INFO:teuthology.orchestra.run.smithi007.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-30T16:49:52.846 INFO:teuthology.orchestra.run.smithi007.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-30T16:49:52.846 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T16:49:52.846 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-30T16:49:52.846 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-30T16:49:52.846 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-30T16:49:52.846 INFO:teuthology.orchestra.run.smithi007.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-30T16:49:52.847 INFO:teuthology.lock.ops:Updating smithi007.front.sepia.ceph.com on lock server 2023-09-30T16:49:52.872 DEBUG:teuthology.orchestra.run.smithi031:> uname -m 2023-09-30T16:49:52.893 INFO:teuthology.orchestra.run.smithi031.stdout:x86_64 2023-09-30T16:49:52.893 DEBUG:teuthology.orchestra.run.smithi031:> cat /etc/os-release 2023-09-30T16:49:52.953 INFO:teuthology.orchestra.run.smithi031.stdout:NAME="Red Hat Enterprise Linux" 2023-09-30T16:49:52.953 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION="8.6 (Ootpa)" 2023-09-30T16:49:52.953 INFO:teuthology.orchestra.run.smithi031.stdout:ID="rhel" 2023-09-30T16:49:52.954 INFO:teuthology.orchestra.run.smithi031.stdout:ID_LIKE="fedora" 2023-09-30T16:49:52.954 INFO:teuthology.orchestra.run.smithi031.stdout:VERSION_ID="8.6" 2023-09-30T16:49:52.954 INFO:teuthology.orchestra.run.smithi031.stdout:PLATFORM_ID="platform:el8" 2023-09-30T16:49:52.954 INFO:teuthology.orchestra.run.smithi031.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-30T16:49:52.954 INFO:teuthology.orchestra.run.smithi031.stdout:ANSI_COLOR="0;31" 2023-09-30T16:49:52.954 INFO:teuthology.orchestra.run.smithi031.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-30T16:49:52.954 INFO:teuthology.orchestra.run.smithi031.stdout:HOME_URL="https://www.redhat.com/" 2023-09-30T16:49:52.954 INFO:teuthology.orchestra.run.smithi031.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-30T16:49:52.954 INFO:teuthology.orchestra.run.smithi031.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-30T16:49:52.954 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-09-30T16:49:52.954 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-30T16:49:52.954 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-30T16:49:52.955 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-30T16:49:52.955 INFO:teuthology.orchestra.run.smithi031.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-30T16:49:52.955 INFO:teuthology.lock.ops:Updating smithi031.front.sepia.ceph.com on lock server 2023-09-30T16:49:52.980 DEBUG:teuthology.orchestra.run.smithi072:> uname -m 2023-09-30T16:49:53.000 INFO:teuthology.orchestra.run.smithi072.stdout:x86_64 2023-09-30T16:49:53.000 DEBUG:teuthology.orchestra.run.smithi072:> cat /etc/os-release 2023-09-30T16:49:53.059 INFO:teuthology.orchestra.run.smithi072.stdout:NAME="Red Hat Enterprise Linux" 2023-09-30T16:49:53.059 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION="8.6 (Ootpa)" 2023-09-30T16:49:53.059 INFO:teuthology.orchestra.run.smithi072.stdout:ID="rhel" 2023-09-30T16:49:53.060 INFO:teuthology.orchestra.run.smithi072.stdout:ID_LIKE="fedora" 2023-09-30T16:49:53.060 INFO:teuthology.orchestra.run.smithi072.stdout:VERSION_ID="8.6" 2023-09-30T16:49:53.060 INFO:teuthology.orchestra.run.smithi072.stdout:PLATFORM_ID="platform:el8" 2023-09-30T16:49:53.060 INFO:teuthology.orchestra.run.smithi072.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-30T16:49:53.060 INFO:teuthology.orchestra.run.smithi072.stdout:ANSI_COLOR="0;31" 2023-09-30T16:49:53.060 INFO:teuthology.orchestra.run.smithi072.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-30T16:49:53.060 INFO:teuthology.orchestra.run.smithi072.stdout:HOME_URL="https://www.redhat.com/" 2023-09-30T16:49:53.060 INFO:teuthology.orchestra.run.smithi072.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-30T16:49:53.060 INFO:teuthology.orchestra.run.smithi072.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-30T16:49:53.060 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-09-30T16:49:53.061 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-30T16:49:53.061 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-30T16:49:53.061 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-30T16:49:53.061 INFO:teuthology.orchestra.run.smithi072.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-30T16:49:53.061 INFO:teuthology.lock.ops:Updating smithi072.front.sepia.ceph.com on lock server 2023-09-30T16:49:53.089 DEBUG:teuthology.orchestra.run.smithi134:> uname -m 2023-09-30T16:49:53.108 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2023-09-30T16:49:53.108 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2023-09-30T16:49:53.167 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="Red Hat Enterprise Linux" 2023-09-30T16:49:53.167 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="8.6 (Ootpa)" 2023-09-30T16:49:53.167 INFO:teuthology.orchestra.run.smithi134.stdout:ID="rhel" 2023-09-30T16:49:53.167 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="fedora" 2023-09-30T16:49:53.167 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="8.6" 2023-09-30T16:49:53.167 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el8" 2023-09-30T16:49:53.167 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.6 (Ootpa)" 2023-09-30T16:49:53.168 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31" 2023-09-30T16:49:53.168 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8::baseos" 2023-09-30T16:49:53.168 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://www.redhat.com/" 2023-09-30T16:49:53.168 INFO:teuthology.orchestra.run.smithi134.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-09-30T16:49:53.168 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-09-30T16:49:53.168 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-09-30T16:49:53.168 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-09-30T16:49:53.168 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.6 2023-09-30T16:49:53.168 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-09-30T16:49:53.168 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.6" 2023-09-30T16:49:53.169 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2023-09-30T16:49:53.189 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-09-30T16:49:53.197 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-09-30T16:49:53.203 INFO:teuthology.task.internal:Checking for old test directory... 2023-09-30T16:49:53.203 DEBUG:teuthology.orchestra.run.smithi007:> test '!' -e /home/ubuntu/cephtest 2023-09-30T16:49:53.205 DEBUG:teuthology.orchestra.run.smithi031:> test '!' -e /home/ubuntu/cephtest 2023-09-30T16:49:53.208 DEBUG:teuthology.orchestra.run.smithi072:> test '!' -e /home/ubuntu/cephtest 2023-09-30T16:49:53.210 DEBUG:teuthology.orchestra.run.smithi134:> test '!' -e /home/ubuntu/cephtest 2023-09-30T16:49:53.228 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-09-30T16:49:53.234 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-09-30T16:49:53.234 DEBUG:teuthology.orchestra.run.smithi007:> test -z $(ls -A /var/lib/ceph) 2023-09-30T16:49:53.265 DEBUG:teuthology.orchestra.run.smithi031:> test -z $(ls -A /var/lib/ceph) 2023-09-30T16:49:53.268 DEBUG:teuthology.orchestra.run.smithi072:> test -z $(ls -A /var/lib/ceph) 2023-09-30T16:49:53.270 DEBUG:teuthology.orchestra.run.smithi134:> test -z $(ls -A /var/lib/ceph) 2023-09-30T16:49:53.305 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-09-30T16:49:53.401 INFO:teuthology.run_tasks:Running task kernel... 2023-09-30T16:49:53.416 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-09-30T16:49:53.417 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'osd.0': {'kdb': True, 'sha1': 'distro'}, 'osd.1': {'kdb': True, 'sha1': 'distro'}, 'osd.2': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-09-30T16:49:53.417 DEBUG:teuthology.orchestra.run.smithi007:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-30T16:49:53.418 DEBUG:teuthology.orchestra.run.smithi031:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-30T16:49:53.418 DEBUG:teuthology.orchestra.run.smithi072:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-30T16:49:53.418 DEBUG:teuthology.orchestra.run.smithi134:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-30T16:49:53.436 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T16:49:53.437 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2023-09-30T16:49:53.438 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T16:49:53.438 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T16:49:53.438 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T16:49:53.439 DEBUG:teuthology.orchestra.run.smithi007:> uname -r 2023-09-30T16:49:53.440 DEBUG:teuthology.orchestra.run.smithi031:> uname -r 2023-09-30T16:49:53.440 DEBUG:teuthology.orchestra.run.smithi072:> uname -r 2023-09-30T16:49:53.496 INFO:teuthology.orchestra.run.smithi134.stdout:4.18.0-372.9.1.el8.x86_64 2023-09-30T16:49:53.497 INFO:teuthology.task.kernel:Running kernel on smithi134: 4.18.0-372.9.1.el8.x86_64 2023-09-30T16:49:53.497 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum install -y kernel 2023-09-30T16:49:53.498 INFO:teuthology.orchestra.run.smithi072.stdout:4.18.0-372.9.1.el8.x86_64 2023-09-30T16:49:53.498 INFO:teuthology.task.kernel:Running kernel on smithi072: 4.18.0-372.9.1.el8.x86_64 2023-09-30T16:49:53.498 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum install -y kernel 2023-09-30T16:49:53.499 INFO:teuthology.orchestra.run.smithi007.stdout:4.18.0-372.9.1.el8.x86_64 2023-09-30T16:49:53.500 INFO:teuthology.task.kernel:Running kernel on smithi007: 4.18.0-372.9.1.el8.x86_64 2023-09-30T16:49:53.500 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum install -y kernel 2023-09-30T16:49:53.501 INFO:teuthology.orchestra.run.smithi031.stdout:4.18.0-372.9.1.el8.x86_64 2023-09-30T16:49:53.501 INFO:teuthology.task.kernel:Running kernel on smithi031: 4.18.0-372.9.1.el8.x86_64 2023-09-30T16:49:53.501 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum install -y kernel 2023-09-30T16:49:54.686 INFO:teuthology.orchestra.run.smithi134.stdout:Updating Subscription Management repositories. 2023-09-30T16:49:54.686 INFO:teuthology.orchestra.run.smithi134.stdout:Unable to read consumer identity 2023-09-30T16:49:54.724 INFO:teuthology.orchestra.run.smithi031.stdout:Updating Subscription Management repositories. 2023-09-30T16:49:54.724 INFO:teuthology.orchestra.run.smithi031.stdout:Unable to read consumer identity 2023-09-30T16:49:54.751 INFO:teuthology.orchestra.run.smithi007.stdout:Updating Subscription Management repositories. 2023-09-30T16:49:54.751 INFO:teuthology.orchestra.run.smithi007.stdout:Unable to read consumer identity 2023-09-30T16:49:55.766 INFO:teuthology.orchestra.run.smithi072.stdout:Updating Subscription Management repositories. 2023-09-30T16:49:55.767 INFO:teuthology.orchestra.run.smithi072.stdout:Unable to read consumer identity 2023-09-30T16:49:56.089 INFO:teuthology.orchestra.run.smithi134.stdout:Copr repo for python3-asyncssh owned by ceph 21 kB/s | 3.5 kB 00:00 2023-09-30T16:49:56.162 INFO:teuthology.orchestra.run.smithi007.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2023-09-30T16:49:56.223 INFO:teuthology.orchestra.run.smithi031.stdout:Copr repo for python3-asyncssh owned by ceph 19 kB/s | 3.5 kB 00:00 2023-09-30T16:49:56.815 INFO:teuthology.orchestra.run.smithi134.stdout:Extra Packages for Enterprise Linux 22 MB/s | 16 MB 00:00 2023-09-30T16:49:57.005 INFO:teuthology.orchestra.run.smithi007.stdout:Extra Packages for Enterprise Linux 19 MB/s | 16 MB 00:00 2023-09-30T16:49:57.415 INFO:teuthology.orchestra.run.smithi031.stdout:Extra Packages for Enterprise Linux 14 MB/s | 16 MB 00:01 2023-09-30T16:49:58.423 INFO:teuthology.orchestra.run.smithi072.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2023-09-30T16:49:59.158 INFO:teuthology.orchestra.run.smithi072.stdout:Extra Packages for Enterprise Linux 22 MB/s | 16 MB 00:00 2023-09-30T16:50:00.340 INFO:teuthology.orchestra.run.smithi134.stdout:lab-extras 347 kB/s | 24 kB 00:00 2023-09-30T16:50:00.671 INFO:teuthology.orchestra.run.smithi007.stdout:lab-extras 459 kB/s | 24 kB 00:00 2023-09-30T16:50:01.051 INFO:teuthology.orchestra.run.smithi134.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-09-30T16:50:01.102 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-09-30T16:50:01.104 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2023-09-30T16:50:01.104 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-09-30T16:50:01.140 INFO:teuthology.orchestra.run.smithi031.stdout:lab-extras 430 kB/s | 24 kB 00:00 2023-09-30T16:50:01.228 DEBUG:teuthology.orchestra.run.smithi134:> echo no | sudo yum reinstall kernel || true 2023-09-30T16:50:01.415 INFO:teuthology.orchestra.run.smithi007.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-09-30T16:50:01.465 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-09-30T16:50:01.466 INFO:teuthology.orchestra.run.smithi007.stdout:Nothing to do. 2023-09-30T16:50:01.467 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-09-30T16:50:01.560 INFO:teuthology.orchestra.run.smithi134.stdout:Updating Subscription Management repositories. 2023-09-30T16:50:01.560 INFO:teuthology.orchestra.run.smithi134.stdout:Unable to read consumer identity 2023-09-30T16:50:01.587 DEBUG:teuthology.orchestra.run.smithi007:> echo no | sudo yum reinstall kernel || true 2023-09-30T16:50:01.825 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:00:01 ago on Sat 30 Sep 2023 04:50:00 PM UTC. 2023-09-30T16:50:01.867 INFO:teuthology.orchestra.run.smithi134.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-09-30T16:50:01.948 INFO:teuthology.orchestra.run.smithi134.stderr:Error: No packages marked for reinstall. 2023-09-30T16:50:01.984 INFO:teuthology.orchestra.run.smithi007.stdout:Updating Subscription Management repositories. 2023-09-30T16:50:01.984 INFO:teuthology.orchestra.run.smithi007.stdout:Unable to read consumer identity 2023-09-30T16:50:01.994 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum reinstall -y kernel || true 2023-09-30T16:50:02.026 INFO:teuthology.orchestra.run.smithi031.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-09-30T16:50:02.074 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2023-09-30T16:50:02.076 INFO:teuthology.orchestra.run.smithi031.stdout:Nothing to do. 2023-09-30T16:50:02.076 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2023-09-30T16:50:02.261 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:00:02 ago on Sat 30 Sep 2023 04:50:00 PM UTC. 2023-09-30T16:50:02.306 INFO:teuthology.orchestra.run.smithi007.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-09-30T16:50:02.321 INFO:teuthology.orchestra.run.smithi134.stdout:Updating Subscription Management repositories. 2023-09-30T16:50:02.321 INFO:teuthology.orchestra.run.smithi134.stdout:Unable to read consumer identity 2023-09-30T16:50:02.341 INFO:teuthology.orchestra.run.smithi007.stderr:Error: No packages marked for reinstall. 2023-09-30T16:50:02.354 DEBUG:teuthology.orchestra.run.smithi031:> echo no | sudo yum reinstall kernel || true 2023-09-30T16:50:02.388 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum reinstall -y kernel || true 2023-09-30T16:50:02.580 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:00:02 ago on Sat 30 Sep 2023 04:50:00 PM UTC. 2023-09-30T16:50:02.593 INFO:teuthology.orchestra.run.smithi072.stdout:lab-extras 449 kB/s | 24 kB 00:00 2023-09-30T16:50:02.619 INFO:teuthology.orchestra.run.smithi134.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-09-30T16:50:02.660 INFO:teuthology.orchestra.run.smithi134.stderr:Error: No packages marked for reinstall. 2023-09-30T16:50:02.707 INFO:teuthology.orchestra.run.smithi031.stdout:Updating Subscription Management repositories. 2023-09-30T16:50:02.707 INFO:teuthology.orchestra.run.smithi031.stdout:Unable to read consumer identity 2023-09-30T16:50:02.711 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q kernel | sort -rV | head -n 1 2023-09-30T16:50:02.739 INFO:teuthology.orchestra.run.smithi007.stdout:Updating Subscription Management repositories. 2023-09-30T16:50:02.739 INFO:teuthology.orchestra.run.smithi007.stdout:Unable to read consumer identity 2023-09-30T16:50:02.790 INFO:teuthology.orchestra.run.smithi134.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-09-30T16:50:02.791 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-09-30T16:50:02.791 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-09-30T16:50:02.791 INFO:teuthology.task.kernel:Enabling kdb on osd.2... 2023-09-30T16:50:02.791 DEBUG:teuthology.orchestra.run.smithi134:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-09-30T16:50:02.843 INFO:teuthology.orchestra.run.smithi134.stdout:ttyS1 2023-09-30T16:50:02.856 DEBUG:teuthology.parallel:result is None 2023-09-30T16:50:02.981 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:00:01 ago on Sat 30 Sep 2023 04:50:01 PM UTC. 2023-09-30T16:50:03.006 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:00:03 ago on Sat 30 Sep 2023 04:50:00 PM UTC. 2023-09-30T16:50:03.024 INFO:teuthology.orchestra.run.smithi031.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-09-30T16:50:03.050 INFO:teuthology.orchestra.run.smithi007.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-09-30T16:50:03.067 INFO:teuthology.orchestra.run.smithi031.stderr:Error: No packages marked for reinstall. 2023-09-30T16:50:03.083 INFO:teuthology.orchestra.run.smithi007.stderr:Error: No packages marked for reinstall. 2023-09-30T16:50:03.114 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum reinstall -y kernel || true 2023-09-30T16:50:03.130 DEBUG:teuthology.orchestra.run.smithi007:> rpm -q kernel | sort -rV | head -n 1 2023-09-30T16:50:03.211 INFO:teuthology.orchestra.run.smithi007.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-09-30T16:50:03.212 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-09-30T16:50:03.213 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-09-30T16:50:03.213 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-09-30T16:50:03.213 DEBUG:teuthology.orchestra.run.smithi007:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-09-30T16:50:03.247 INFO:teuthology.orchestra.run.smithi007.stdout:ttyS1 2023-09-30T16:50:03.259 DEBUG:teuthology.parallel:result is None 2023-09-30T16:50:03.348 INFO:teuthology.orchestra.run.smithi072.stdout:Package kernel-4.18.0-372.9.1.el8.x86_64 is already installed. 2023-09-30T16:50:03.457 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2023-09-30T16:50:03.458 INFO:teuthology.orchestra.run.smithi072.stdout:Nothing to do. 2023-09-30T16:50:03.458 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2023-09-30T16:50:03.464 INFO:teuthology.orchestra.run.smithi031.stdout:Updating Subscription Management repositories. 2023-09-30T16:50:03.464 INFO:teuthology.orchestra.run.smithi031.stdout:Unable to read consumer identity 2023-09-30T16:50:03.571 DEBUG:teuthology.orchestra.run.smithi072:> echo no | sudo yum reinstall kernel || true 2023-09-30T16:50:03.737 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:00:02 ago on Sat 30 Sep 2023 04:50:01 PM UTC. 2023-09-30T16:50:03.779 INFO:teuthology.orchestra.run.smithi031.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-09-30T16:50:03.813 INFO:teuthology.orchestra.run.smithi031.stderr:Error: No packages marked for reinstall. 2023-09-30T16:50:03.865 DEBUG:teuthology.orchestra.run.smithi031:> rpm -q kernel | sort -rV | head -n 1 2023-09-30T16:50:03.903 INFO:teuthology.orchestra.run.smithi072.stdout:Updating Subscription Management repositories. 2023-09-30T16:50:03.904 INFO:teuthology.orchestra.run.smithi072.stdout:Unable to read consumer identity 2023-09-30T16:50:03.948 INFO:teuthology.orchestra.run.smithi031.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-09-30T16:50:03.948 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-09-30T16:50:03.949 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-09-30T16:50:03.949 INFO:teuthology.task.kernel:Enabling kdb on osd.0... 2023-09-30T16:50:03.949 DEBUG:teuthology.orchestra.run.smithi031:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-09-30T16:50:03.987 INFO:teuthology.orchestra.run.smithi031.stdout:ttyS1 2023-09-30T16:50:04.012 DEBUG:teuthology.parallel:result is None 2023-09-30T16:50:04.167 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:00:02 ago on Sat 30 Sep 2023 04:50:02 PM UTC. 2023-09-30T16:50:04.214 INFO:teuthology.orchestra.run.smithi072.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-09-30T16:50:04.253 INFO:teuthology.orchestra.run.smithi072.stderr:Error: No packages marked for reinstall. 2023-09-30T16:50:04.299 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum reinstall -y kernel || true 2023-09-30T16:50:04.626 INFO:teuthology.orchestra.run.smithi072.stdout:Updating Subscription Management repositories. 2023-09-30T16:50:04.626 INFO:teuthology.orchestra.run.smithi072.stdout:Unable to read consumer identity 2023-09-30T16:50:04.884 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:00:02 ago on Sat 30 Sep 2023 04:50:02 PM UTC. 2023-09-30T16:50:04.923 INFO:teuthology.orchestra.run.smithi072.stdout:Installed package kernel-4.18.0-372.9.1.el8.x86_64 (from anaconda) not available. 2023-09-30T16:50:04.958 INFO:teuthology.orchestra.run.smithi072.stderr:Error: No packages marked for reinstall. 2023-09-30T16:50:05.004 DEBUG:teuthology.orchestra.run.smithi072:> rpm -q kernel | sort -rV | head -n 1 2023-09-30T16:50:05.085 INFO:teuthology.orchestra.run.smithi072.stdout:kernel-4.18.0-372.9.1.el8.x86_64 2023-09-30T16:50:05.086 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-372.9.1.el8.x86_64 2023-09-30T16:50:05.086 INFO:teuthology.task.kernel:Newest distro kernel installed and running 2023-09-30T16:50:05.086 INFO:teuthology.task.kernel:Enabling kdb on osd.1... 2023-09-30T16:50:05.086 DEBUG:teuthology.orchestra.run.smithi072:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-09-30T16:50:05.119 INFO:teuthology.orchestra.run.smithi072.stdout:ttyS1 2023-09-30T16:50:05.132 DEBUG:teuthology.parallel:result is None 2023-09-30T16:50:05.132 INFO:teuthology.run_tasks:Running task internal.base... 2023-09-30T16:50:05.140 INFO:teuthology.task.internal:Creating test directory... 2023-09-30T16:50:05.140 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-30T16:50:05.142 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-30T16:50:05.145 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-30T16:50:05.175 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-30T16:50:05.196 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-09-30T16:50:05.202 INFO:teuthology.run_tasks:Running task internal.archive... 2023-09-30T16:50:05.209 INFO:teuthology.task.internal:Creating archive directory... 2023-09-30T16:50:05.210 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-30T16:50:05.212 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-30T16:50:05.214 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-30T16:50:05.231 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-30T16:50:05.261 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-09-30T16:50:05.267 INFO:teuthology.task.internal:Enabling coredump saving... 2023-09-30T16:50:05.268 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-30T16:50:05.273 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-30T16:50:05.275 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-30T16:50:05.288 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-30T16:50:05.313 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-30T16:50:05.315 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-30T16:50:05.322 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-30T16:50:05.325 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-30T16:50:05.328 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-30T16:50:05.332 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-30T16:50:05.365 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-30T16:50:05.378 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-30T16:50:05.379 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-09-30T16:50:05.386 INFO:teuthology.task.internal:Configuring sudo... 2023-09-30T16:50:05.386 DEBUG:teuthology.orchestra.run.smithi007:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-30T16:50:05.389 DEBUG:teuthology.orchestra.run.smithi031:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-30T16:50:05.391 DEBUG:teuthology.orchestra.run.smithi072:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-30T16:50:05.393 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-30T16:50:05.423 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-09-30T16:50:05.431 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-09-30T16:50:05.432 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-30T16:50:05.459 DEBUG:teuthology.orchestra.run.smithi031:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-30T16:50:05.463 DEBUG:teuthology.orchestra.run.smithi072:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-30T16:50:05.466 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-30T16:50:05.484 DEBUG:teuthology.orchestra.run.smithi007:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-30T16:50:05.558 DEBUG:teuthology.orchestra.run.smithi007:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-30T16:50:05.615 DEBUG:teuthology.orchestra.run.smithi007:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-30T16:50:05.700 DEBUG:teuthology.orchestra.run.smithi007:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-30T16:50:05.744 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-09-30T16:50:05.744 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-30T16:50:05.818 DEBUG:teuthology.orchestra.run.smithi031:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-30T16:50:05.867 DEBUG:teuthology.orchestra.run.smithi031:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-30T16:50:05.921 DEBUG:teuthology.orchestra.run.smithi031:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-30T16:50:06.007 DEBUG:teuthology.orchestra.run.smithi031:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-30T16:50:06.056 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-09-30T16:50:06.056 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-30T16:50:06.129 DEBUG:teuthology.orchestra.run.smithi072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-30T16:50:06.173 DEBUG:teuthology.orchestra.run.smithi072:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-30T16:50:06.229 DEBUG:teuthology.orchestra.run.smithi072:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-30T16:50:06.315 DEBUG:teuthology.orchestra.run.smithi072:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-30T16:50:06.357 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-09-30T16:50:06.357 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-30T16:50:06.425 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-30T16:50:06.471 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-30T16:50:06.525 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-30T16:50:06.611 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-30T16:50:06.654 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-09-30T16:50:06.654 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-30T16:50:06.724 DEBUG:teuthology.orchestra.run.smithi007:> sudo service rsyslog restart 2023-09-30T16:50:06.726 DEBUG:teuthology.orchestra.run.smithi031:> sudo service rsyslog restart 2023-09-30T16:50:06.728 DEBUG:teuthology.orchestra.run.smithi072:> sudo service rsyslog restart 2023-09-30T16:50:06.731 DEBUG:teuthology.orchestra.run.smithi134:> sudo service rsyslog restart 2023-09-30T16:50:06.786 INFO:teuthology.orchestra.run.smithi072.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-30T16:50:06.788 INFO:teuthology.orchestra.run.smithi007.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-30T16:50:06.793 INFO:teuthology.orchestra.run.smithi031.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-30T16:50:06.824 INFO:teuthology.orchestra.run.smithi134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-30T16:50:07.255 INFO:teuthology.run_tasks:Running task internal.timer... 2023-09-30T16:50:07.263 INFO:teuthology.task.internal:Starting timer... 2023-09-30T16:50:07.263 INFO:teuthology.run_tasks:Running task pcp... 2023-09-30T16:50:07.273 INFO:teuthology.run_tasks:Running task selinux... 2023-09-30T16:50:07.282 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2023-09-30T16:50:07.283 DEBUG:teuthology.orchestra.run.smithi007:> sudo service auditd rotate 2023-09-30T16:50:07.351 INFO:teuthology.orchestra.run.smithi007.stdout:Rotating logs: 2023-09-30T16:50:07.353 DEBUG:teuthology.orchestra.run.smithi031:> sudo service auditd rotate 2023-09-30T16:50:07.410 INFO:teuthology.orchestra.run.smithi031.stdout:Rotating logs: 2023-09-30T16:50:07.411 DEBUG:teuthology.orchestra.run.smithi072:> sudo service auditd rotate 2023-09-30T16:50:07.475 INFO:teuthology.orchestra.run.smithi072.stdout:Rotating logs: 2023-09-30T16:50:07.477 DEBUG:teuthology.orchestra.run.smithi134:> sudo service auditd rotate 2023-09-30T16:50:07.551 INFO:teuthology.orchestra.run.smithi134.stdout:Rotating logs: 2023-09-30T16:50:07.553 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-09-30T16:50:07.553 DEBUG:teuthology.orchestra.run.smithi007:> /usr/sbin/getenforce 2023-09-30T16:50:07.577 INFO:teuthology.orchestra.run.smithi007.stdout:Permissive 2023-09-30T16:50:07.577 DEBUG:teuthology.orchestra.run.smithi031:> /usr/sbin/getenforce 2023-09-30T16:50:07.606 INFO:teuthology.orchestra.run.smithi031.stdout:Permissive 2023-09-30T16:50:07.607 DEBUG:teuthology.orchestra.run.smithi072:> /usr/sbin/getenforce 2023-09-30T16:50:07.628 INFO:teuthology.orchestra.run.smithi072.stdout:Permissive 2023-09-30T16:50:07.628 DEBUG:teuthology.orchestra.run.smithi134:> /usr/sbin/getenforce 2023-09-30T16:50:07.652 INFO:teuthology.orchestra.run.smithi134.stdout:Permissive 2023-09-30T16:50:07.653 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi007.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi031.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi072.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi134.front.sepia.ceph.com': 'permissive'} 2023-09-30T16:50:07.653 DEBUG:teuthology.orchestra.run.smithi007:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-30T16:50:07.681 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T16:50:07.682 DEBUG:teuthology.orchestra.run.smithi031:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-30T16:50:07.710 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T16:50:07.710 DEBUG:teuthology.orchestra.run.smithi072:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-30T16:50:07.738 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T16:50:07.739 DEBUG:teuthology.orchestra.run.smithi134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-30T16:50:07.765 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T16:50:07.766 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-09-30T16:50:07.766 DEBUG:teuthology.orchestra.run.smithi007:> sudo /usr/sbin/setenforce permissive 2023-09-30T16:50:07.794 DEBUG:teuthology.orchestra.run.smithi031:> sudo /usr/sbin/setenforce permissive 2023-09-30T16:50:07.821 DEBUG:teuthology.orchestra.run.smithi072:> sudo /usr/sbin/setenforce permissive 2023-09-30T16:50:07.848 DEBUG:teuthology.orchestra.run.smithi134:> sudo /usr/sbin/setenforce permissive 2023-09-30T16:50:07.874 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-09-30T16:50:07.884 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-09-30T16:50:07.889 INFO:teuthology.repo_utils:Fetching main from origin 2023-09-30T16:50:08.003 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-09-30T16:50:08.018 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-09-30T16:50:08.019 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi007.front.sepia.ceph.com,smithi031.front.sepia.ceph.com,smithi072.front.sepia.ceph.com,smithi134.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-09-30T16:59:06.001 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi007.front.sepia.ceph.com'), Remote(name='ubuntu@smithi031.front.sepia.ceph.com'), Remote(name='ubuntu@smithi072.front.sepia.ceph.com'), Remote(name='ubuntu@smithi134.front.sepia.ceph.com')] 2023-09-30T16:59:06.003 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi007.front.sepia.ceph.com' 2023-09-30T16:59:06.004 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi007.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T16:59:06.073 DEBUG:teuthology.orchestra.run.smithi007:> true 2023-09-30T16:59:06.140 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi007.front.sepia.ceph.com' 2023-09-30T16:59:06.141 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-09-30T16:59:06.141 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi031.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T16:59:06.211 DEBUG:teuthology.orchestra.run.smithi031:> true 2023-09-30T16:59:06.239 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi031.front.sepia.ceph.com' 2023-09-30T16:59:06.239 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-09-30T16:59:06.240 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi072.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T16:59:06.308 DEBUG:teuthology.orchestra.run.smithi072:> true 2023-09-30T16:59:06.376 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi072.front.sepia.ceph.com' 2023-09-30T16:59:06.377 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2023-09-30T16:59:06.377 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T16:59:06.446 DEBUG:teuthology.orchestra.run.smithi134:> true 2023-09-30T16:59:06.484 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2023-09-30T16:59:06.485 INFO:teuthology.run_tasks:Running task clock... 2023-09-30T16:59:06.496 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-09-30T16:59:06.496 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-30T16:59:06.496 DEBUG:teuthology.orchestra.run.smithi007:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-30T16:59:06.499 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-30T16:59:06.499 DEBUG:teuthology.orchestra.run.smithi031:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-30T16:59:06.501 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-30T16:59:06.501 DEBUG:teuthology.orchestra.run.smithi072:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-30T16:59:06.503 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-30T16:59:06.503 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-30T16:59:06.530 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-09-30T16:59:06.532 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-09-30T16:59:06.537 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-09-30T16:59:06.546 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-09-30T16:59:06.547 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-09-30T16:59:06.554 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-09-30T16:59:06.559 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-09-30T16:59:06.574 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-09-30T16:59:06.619 INFO:teuthology.orchestra.run.smithi007.stderr:sudo: ntpd: command not found 2023-09-30T16:59:06.629 INFO:teuthology.orchestra.run.smithi031.stderr:sudo: ntpd: command not found 2023-09-30T16:59:06.631 INFO:teuthology.orchestra.run.smithi072.stderr:sudo: ntpd: command not found 2023-09-30T16:59:06.631 INFO:teuthology.orchestra.run.smithi007.stdout:506 Cannot talk to daemon 2023-09-30T16:59:06.643 INFO:teuthology.orchestra.run.smithi072.stdout:506 Cannot talk to daemon 2023-09-30T16:59:06.643 INFO:teuthology.orchestra.run.smithi031.stdout:506 Cannot talk to daemon 2023-09-30T16:59:06.646 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-09-30T16:59:06.647 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: ntpd: command not found 2023-09-30T16:59:06.657 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-09-30T16:59:06.659 INFO:teuthology.orchestra.run.smithi134.stdout:506 Cannot talk to daemon 2023-09-30T16:59:06.659 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-09-30T16:59:06.660 INFO:teuthology.orchestra.run.smithi007.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-09-30T16:59:06.671 INFO:teuthology.orchestra.run.smithi072.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-09-30T16:59:06.674 INFO:teuthology.orchestra.run.smithi031.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-09-30T16:59:06.674 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-09-30T16:59:06.689 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-09-30T16:59:06.732 INFO:teuthology.orchestra.run.smithi007.stderr:bash: ntpq: command not found 2023-09-30T16:59:06.735 INFO:teuthology.orchestra.run.smithi007.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-30T16:59:06.776 INFO:teuthology.orchestra.run.smithi007.stdout:=============================================================================== 2023-09-30T16:59:06.776 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T16:59:06.777 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T16:59:06.777 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T16:59:06.777 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T16:59:06.778 INFO:teuthology.orchestra.run.smithi134.stderr:bash: ntpq: command not found 2023-09-30T16:59:06.778 INFO:teuthology.orchestra.run.smithi031.stderr:bash: ntpq: command not found 2023-09-30T16:59:06.779 INFO:teuthology.orchestra.run.smithi072.stderr:bash: ntpq: command not found 2023-09-30T16:59:06.780 INFO:teuthology.orchestra.run.smithi134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-30T16:59:06.781 INFO:teuthology.orchestra.run.smithi134.stdout:=============================================================================== 2023-09-30T16:59:06.781 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T16:59:06.781 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T16:59:06.781 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T16:59:06.781 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T16:59:06.781 INFO:teuthology.orchestra.run.smithi031.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-30T16:59:06.781 INFO:teuthology.orchestra.run.smithi031.stdout:=============================================================================== 2023-09-30T16:59:06.781 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T16:59:06.781 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T16:59:06.782 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T16:59:06.782 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T16:59:06.782 INFO:teuthology.orchestra.run.smithi072.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-30T16:59:06.782 INFO:teuthology.orchestra.run.smithi072.stdout:=============================================================================== 2023-09-30T16:59:06.782 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T16:59:06.782 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T16:59:06.782 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T16:59:06.782 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T16:59:06.783 INFO:teuthology.run_tasks:Running task install... 2023-09-30T16:59:06.790 DEBUG:teuthology.task.install:project ceph 2023-09-30T16:59:06.791 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '1d10b71792f3be8887a7631e69851ac2df3585af'}} 2023-09-30T16:59:06.791 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '1d10b71792f3be8887a7631e69851ac2df3585af'} 2023-09-30T16:59:06.791 INFO:teuthology.task.install:Using flavor: default 2023-09-30T16:59:06.797 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-09-30T16:59:06.797 INFO:teuthology.task.install:extra packages: [] 2023-09-30T16:59:06.797 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1d10b71792f3be8887a7631e69851ac2df3585af', 'tag': None, 'wait_for_package': False} 2023-09-30T16:59:06.797 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=1d10b71792f3be8887a7631e69851ac2df3585af 2023-09-30T16:59:06.799 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1d10b71792f3be8887a7631e69851ac2df3585af', 'tag': None, 'wait_for_package': False} 2023-09-30T16:59:06.800 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=1d10b71792f3be8887a7631e69851ac2df3585af 2023-09-30T16:59:06.800 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1d10b71792f3be8887a7631e69851ac2df3585af', 'tag': None, 'wait_for_package': False} 2023-09-30T16:59:06.801 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=1d10b71792f3be8887a7631e69851ac2df3585af 2023-09-30T16:59:06.802 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '1d10b71792f3be8887a7631e69851ac2df3585af', 'tag': None, 'wait_for_package': False} 2023-09-30T16:59:06.802 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=1d10b71792f3be8887a7631e69851ac2df3585af 2023-09-30T16:59:06.960 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/centos/8/flavors/default/ 2023-09-30T16:59:07.096 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6447.g1d10b717 2023-09-30T16:59:07.114 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/centos/8/flavors/default/ 2023-09-30T16:59:07.123 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6447.g1d10b717 2023-09-30T16:59:07.125 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/centos/8/flavors/default/ 2023-09-30T16:59:07.125 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6447.g1d10b717 2023-09-30T16:59:07.126 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/centos/8/flavors/default/ 2023-09-30T16:59:07.126 INFO:teuthology.task.install.rpm:Package version is 18.0.0-6447.g1d10b717 2023-09-30T16:59:07.222 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-09-30T16:59:07.243 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-09-30T16:59:07.243 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-09-30T16:59:07.246 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-09-30T16:59:07.246 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-09-30T16:59:07.246 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-09-30T16:59:07.250 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-09-30T16:59:07.250 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-09-30T16:59:07.250 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-09-30T16:59:07.276 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-09-30T16:59:07.277 DEBUG:teuthology.orchestra.run.smithi072:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1d10b71792f3be8887a7631e69851ac2df3585af/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-09-30T16:59:07.280 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-09-30T16:59:07.280 DEBUG:teuthology.orchestra.run.smithi007:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1d10b71792f3be8887a7631e69851ac2df3585af/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-09-30T16:59:07.284 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-09-30T16:59:07.284 DEBUG:teuthology.orchestra.run.smithi031:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1d10b71792f3be8887a7631e69851ac2df3585af/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-09-30T16:59:07.293 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/main/1d10b71792f3be8887a7631e69851ac2df3585af/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-09-30T16:59:07.294 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-09-30T16:59:07.294 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-09-30T16:59:07.325 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-09-30T16:59:07.325 DEBUG:teuthology.orchestra.run.smithi134:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1d10b71792f3be8887a7631e69851ac2df3585af/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-09-30T16:59:07.344 DEBUG:teuthology.orchestra.run.smithi072:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-09-30T16:59:07.396 DEBUG:teuthology.orchestra.run.smithi031:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-09-30T16:59:07.397 DEBUG:teuthology.orchestra.run.smithi007:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-09-30T16:59:07.425 DEBUG:teuthology.orchestra.run.smithi134:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-09-30T16:59:07.435 DEBUG:teuthology.orchestra.run.smithi072:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-09-30T16:59:07.480 DEBUG:teuthology.orchestra.run.smithi007:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-09-30T16:59:07.551 DEBUG:teuthology.orchestra.run.smithi134:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-09-30T16:59:07.552 INFO:teuthology.orchestra.run.smithi072.stdout:check_obsoletes = 1 2023-09-30T16:59:07.552 DEBUG:teuthology.orchestra.run.smithi031:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-09-30T16:59:07.553 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum clean all 2023-09-30T16:59:07.584 INFO:teuthology.orchestra.run.smithi007.stdout:check_obsoletes = 1 2023-09-30T16:59:07.585 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum clean all 2023-09-30T16:59:07.619 INFO:teuthology.orchestra.run.smithi134.stdout:check_obsoletes = 1 2023-09-30T16:59:07.705 INFO:teuthology.orchestra.run.smithi031.stdout:check_obsoletes = 1 2023-09-30T16:59:07.706 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum clean all 2023-09-30T16:59:07.706 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum clean all 2023-09-30T16:59:07.921 INFO:teuthology.orchestra.run.smithi072.stdout:Updating Subscription Management repositories. 2023-09-30T16:59:08.067 INFO:teuthology.orchestra.run.smithi007.stdout:Updating Subscription Management repositories. 2023-09-30T16:59:08.079 INFO:teuthology.orchestra.run.smithi134.stdout:Updating Subscription Management repositories. 2023-09-30T16:59:08.107 INFO:teuthology.orchestra.run.smithi031.stdout:Updating Subscription Management repositories. 2023-09-30T16:59:08.191 INFO:teuthology.orchestra.run.smithi072.stdout:44 files removed 2023-09-30T16:59:08.237 DEBUG:teuthology.orchestra.run.smithi072:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-09-30T16:59:08.319 INFO:teuthology.orchestra.run.smithi007.stdout:44 files removed 2023-09-30T16:59:08.324 INFO:teuthology.orchestra.run.smithi134.stdout:44 files removed 2023-09-30T16:59:08.366 DEBUG:teuthology.orchestra.run.smithi007:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-09-30T16:59:08.368 INFO:teuthology.orchestra.run.smithi031.stdout:44 files removed 2023-09-30T16:59:08.371 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-09-30T16:59:08.415 DEBUG:teuthology.orchestra.run.smithi031:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-09-30T16:59:08.566 INFO:teuthology.orchestra.run.smithi072.stdout:Updating Subscription Management repositories. 2023-09-30T16:59:08.702 INFO:teuthology.orchestra.run.smithi134.stdout:Updating Subscription Management repositories. 2023-09-30T16:59:08.727 INFO:teuthology.orchestra.run.smithi007.stdout:Updating Subscription Management repositories. 2023-09-30T16:59:08.764 INFO:teuthology.orchestra.run.smithi031.stdout:Updating Subscription Management repositories. 2023-09-30T16:59:09.326 INFO:teuthology.orchestra.run.smithi007.stdout:ceph packages for x86_64 326 kB/s | 81 kB 00:00 2023-09-30T16:59:09.328 INFO:teuthology.orchestra.run.smithi072.stdout:ceph packages for x86_64 189 kB/s | 81 kB 00:00 2023-09-30T16:59:09.383 INFO:teuthology.orchestra.run.smithi031.stdout:ceph packages for x86_64 317 kB/s | 81 kB 00:00 2023-09-30T16:59:09.413 INFO:teuthology.orchestra.run.smithi134.stdout:ceph packages for x86_64 223 kB/s | 81 kB 00:00 2023-09-30T16:59:09.630 INFO:teuthology.orchestra.run.smithi072.stdout:ceph noarch packages 35 kB/s | 9.4 kB 00:00 2023-09-30T16:59:09.700 INFO:teuthology.orchestra.run.smithi031.stdout:ceph noarch packages 33 kB/s | 9.4 kB 00:00 2023-09-30T16:59:09.709 INFO:teuthology.orchestra.run.smithi007.stdout:ceph noarch packages 27 kB/s | 9.4 kB 00:00 2023-09-30T16:59:09.805 INFO:teuthology.orchestra.run.smithi134.stdout:ceph noarch packages 26 kB/s | 9.4 kB 00:00 2023-09-30T16:59:09.915 INFO:teuthology.orchestra.run.smithi072.stdout:ceph source packages 5.7 kB/s | 1.5 kB 00:00 2023-09-30T16:59:10.002 INFO:teuthology.orchestra.run.smithi007.stdout:ceph source packages 5.6 kB/s | 1.5 kB 00:00 2023-09-30T16:59:10.031 INFO:teuthology.orchestra.run.smithi031.stdout:ceph source packages 4.9 kB/s | 1.5 kB 00:00 2023-09-30T16:59:10.058 INFO:teuthology.orchestra.run.smithi072.stdout:Copr repo for python3-asyncssh owned by ceph 28 kB/s | 3.5 kB 00:00 2023-09-30T16:59:10.153 INFO:teuthology.orchestra.run.smithi007.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-09-30T16:59:10.168 INFO:teuthology.orchestra.run.smithi031.stdout:Copr repo for python3-asyncssh owned by ceph 30 kB/s | 3.5 kB 00:00 2023-09-30T16:59:10.180 INFO:teuthology.orchestra.run.smithi134.stdout:ceph source packages 4.2 kB/s | 1.5 kB 00:00 2023-09-30T16:59:10.323 INFO:teuthology.orchestra.run.smithi134.stdout:Copr repo for python3-asyncssh owned by ceph 28 kB/s | 3.5 kB 00:00 2023-09-30T16:59:10.762 INFO:teuthology.orchestra.run.smithi007.stdout:Extra Packages for Enterprise Linux 27 MB/s | 16 MB 00:00 2023-09-30T16:59:11.235 INFO:teuthology.orchestra.run.smithi031.stdout:Extra Packages for Enterprise Linux 15 MB/s | 16 MB 00:01 2023-09-30T16:59:14.545 INFO:teuthology.orchestra.run.smithi007.stdout:lab-extras 353 kB/s | 24 kB 00:00 2023-09-30T16:59:14.944 INFO:teuthology.orchestra.run.smithi031.stdout:lab-extras 436 kB/s | 24 kB 00:00 2023-09-30T16:59:14.995 INFO:teuthology.orchestra.run.smithi072.stdout:Extra Packages for Enterprise Linux 3.2 MB/s | 16 MB 00:04 2023-09-30T16:59:15.480 INFO:teuthology.orchestra.run.smithi007.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 62 MB/s | 53 MB 00:00 2023-09-30T16:59:15.920 INFO:teuthology.orchestra.run.smithi031.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 59 MB/s | 53 MB 00:00 2023-09-30T16:59:18.488 INFO:teuthology.orchestra.run.smithi072.stdout:lab-extras 451 kB/s | 24 kB 00:00 2023-09-30T16:59:19.700 INFO:teuthology.orchestra.run.smithi072.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 42 MB/s | 47 MB 00:01 2023-09-30T16:59:24.076 INFO:teuthology.orchestra.run.smithi007.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 56 MB/s | 47 MB 00:00 2023-09-30T16:59:24.521 INFO:teuthology.orchestra.run.smithi031.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 54 MB/s | 47 MB 00:00 2023-09-30T16:59:27.870 INFO:teuthology.orchestra.run.smithi072.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 44 MB/s | 53 MB 00:01 2023-09-30T16:59:27.882 INFO:teuthology.orchestra.run.smithi134.stdout:Extra Packages for Enterprise Linux 927 kB/s | 16 MB 00:17 2023-09-30T16:59:31.372 INFO:teuthology.orchestra.run.smithi134.stdout:lab-extras 383 kB/s | 24 kB 00:00 2023-09-30T16:59:32.265 INFO:teuthology.orchestra.run.smithi134.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 64 MB/s | 53 MB 00:00 2023-09-30T16:59:35.646 INFO:teuthology.orchestra.run.smithi007.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-30T16:59:35.647 INFO:teuthology.orchestra.run.smithi007.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-30T16:59:35.801 INFO:teuthology.orchestra.run.smithi007.stdout:Dependencies resolved. 2023-09-30T16:59:35.813 INFO:teuthology.orchestra.run.smithi007.stdout:======================================================================================================================= 2023-09-30T16:59:35.813 INFO:teuthology.orchestra.run.smithi007.stdout: Package Arch Version Repository Size 2023-09-30T16:59:35.813 INFO:teuthology.orchestra.run.smithi007.stdout:======================================================================================================================= 2023-09-30T16:59:35.813 INFO:teuthology.orchestra.run.smithi007.stdout:Installing: 2023-09-30T16:59:35.813 INFO:teuthology.orchestra.run.smithi007.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-09-30T16:59:35.813 INFO:teuthology.orchestra.run.smithi007.stdout: ceph x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 6.4 k 2023-09-30T16:59:35.814 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-base x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 5.4 M 2023-09-30T16:59:35.814 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-fuse x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 918 k 2023-09-30T16:59:35.814 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 167 k 2023-09-30T16:59:35.814 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 1.6 M 2023-09-30T16:59:35.814 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6447.g1d10b717.el8 ceph-noarch 132 k 2023-09-30T16:59:35.814 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6447.g1d10b717.el8 ceph-noarch 1.8 M 2023-09-30T16:59:35.814 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6447.g1d10b717.el8 ceph-noarch 7.4 M 2023-09-30T16:59:35.814 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-rook noarch 2:18.0.0-6447.g1d10b717.el8 ceph-noarch 47 k 2023-09-30T16:59:35.814 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-radosgw x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 14 M 2023-09-30T16:59:35.815 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-test x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 49 M 2023-09-30T16:59:35.815 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-volume noarch 2:18.0.0-6447.g1d10b717.el8 ceph-noarch 261 k 2023-09-30T16:59:35.815 INFO:teuthology.orchestra.run.smithi007.stdout: cephadm noarch 2:18.0.0-6447.g1d10b717.el8 ceph-noarch 185 k 2023-09-30T16:59:35.815 INFO:teuthology.orchestra.run.smithi007.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-09-30T16:59:35.815 INFO:teuthology.orchestra.run.smithi007.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-09-30T16:59:35.815 INFO:teuthology.orchestra.run.smithi007.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-09-30T16:59:35.815 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs-devel x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 31 k 2023-09-30T16:59:35.815 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs2 x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 839 k 2023-09-30T16:59:35.815 INFO:teuthology.orchestra.run.smithi007.stdout: librados-devel x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 139 k 2023-09-30T16:59:35.816 INFO:teuthology.orchestra.run.smithi007.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-09-30T16:59:35.816 INFO:teuthology.orchestra.run.smithi007.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-09-30T16:59:35.816 INFO:teuthology.orchestra.run.smithi007.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-09-30T16:59:35.816 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cephfs x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 197 k 2023-09-30T16:59:35.816 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rados x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 371 k 2023-09-30T16:59:35.816 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rbd x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 365 k 2023-09-30T16:59:35.816 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rgw x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 106 k 2023-09-30T16:59:35.816 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-fuse x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 94 k 2023-09-30T16:59:35.816 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-mirror x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 3.6 M 2023-09-30T16:59:35.816 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-nbd x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 180 k 2023-09-30T16:59:35.817 INFO:teuthology.orchestra.run.smithi007.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-09-30T16:59:35.817 INFO:teuthology.orchestra.run.smithi007.stdout:Upgrading: 2023-09-30T16:59:35.817 INFO:teuthology.orchestra.run.smithi007.stdout: librados2 x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 3.7 M 2023-09-30T16:59:35.817 INFO:teuthology.orchestra.run.smithi007.stdout: librbd1 x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 3.7 M 2023-09-30T16:59:35.817 INFO:teuthology.orchestra.run.smithi007.stdout:Installing dependencies: 2023-09-30T16:59:35.817 INFO:teuthology.orchestra.run.smithi007.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-09-30T16:59:35.817 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-common x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 23 M 2023-09-30T16:59:35.817 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6447.g1d10b717.el8 ceph-noarch 23 k 2023-09-30T16:59:35.817 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mds x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 2.3 M 2023-09-30T16:59:35.818 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6447.g1d10b717.el8 ceph-noarch 242 k 2023-09-30T16:59:35.818 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mon x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 4.6 M 2023-09-30T16:59:35.818 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-osd x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 18 M 2023-09-30T16:59:35.818 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6447.g1d10b717.el8 ceph-noarch 15 k 2023-09-30T16:59:35.818 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-selinux x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 24 k 2023-09-30T16:59:35.818 INFO:teuthology.orchestra.run.smithi007.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-09-30T16:59:35.818 INFO:teuthology.orchestra.run.smithi007.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-09-30T16:59:35.818 INFO:teuthology.orchestra.run.smithi007.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-09-30T16:59:35.818 INFO:teuthology.orchestra.run.smithi007.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-09-30T16:59:35.819 INFO:teuthology.orchestra.run.smithi007.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-09-30T16:59:35.819 INFO:teuthology.orchestra.run.smithi007.stdout: libcephsqlite x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 184 k 2023-09-30T16:59:35.819 INFO:teuthology.orchestra.run.smithi007.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-09-30T16:59:35.819 INFO:teuthology.orchestra.run.smithi007.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-09-30T16:59:35.819 INFO:teuthology.orchestra.run.smithi007.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-09-30T16:59:35.819 INFO:teuthology.orchestra.run.smithi007.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-09-30T16:59:35.819 INFO:teuthology.orchestra.run.smithi007.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-09-30T16:59:35.819 INFO:teuthology.orchestra.run.smithi007.stdout: libradosstriper1 x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 519 k 2023-09-30T16:59:35.819 INFO:teuthology.orchestra.run.smithi007.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-09-30T16:59:35.819 INFO:teuthology.orchestra.run.smithi007.stdout: librgw2 x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 6.9 M 2023-09-30T16:59:35.820 INFO:teuthology.orchestra.run.smithi007.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-09-30T16:59:35.820 INFO:teuthology.orchestra.run.smithi007.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-09-30T16:59:35.820 INFO:teuthology.orchestra.run.smithi007.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-09-30T16:59:35.820 INFO:teuthology.orchestra.run.smithi007.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-09-30T16:59:35.820 INFO:teuthology.orchestra.run.smithi007.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-09-30T16:59:35.820 INFO:teuthology.orchestra.run.smithi007.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-09-30T16:59:35.820 INFO:teuthology.orchestra.run.smithi007.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-09-30T16:59:35.820 INFO:teuthology.orchestra.run.smithi007.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-09-30T16:59:35.820 INFO:teuthology.orchestra.run.smithi007.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-09-30T16:59:35.821 INFO:teuthology.orchestra.run.smithi007.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-09-30T16:59:35.821 INFO:teuthology.orchestra.run.smithi007.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-09-30T16:59:35.821 INFO:teuthology.orchestra.run.smithi007.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-09-30T16:59:35.821 INFO:teuthology.orchestra.run.smithi007.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-09-30T16:59:35.821 INFO:teuthology.orchestra.run.smithi007.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-09-30T16:59:35.821 INFO:teuthology.orchestra.run.smithi007.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-09-30T16:59:35.821 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-09-30T16:59:35.821 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-argparse x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 45 k 2023-09-30T16:59:35.821 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-common x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 125 k 2023-09-30T16:59:35.821 INFO:teuthology.orchestra.run.smithi007.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-09-30T16:59:35.822 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-09-30T16:59:35.822 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-09-30T16:59:35.822 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-09-30T16:59:35.822 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-09-30T16:59:35.822 INFO:teuthology.orchestra.run.smithi007.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-09-30T16:59:35.822 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-09-30T16:59:35.822 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-09-30T16:59:35.823 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-09-30T16:59:35.823 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-09-30T16:59:35.823 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-09-30T16:59:35.823 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-09-30T16:59:35.823 INFO:teuthology.orchestra.run.smithi007.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-09-30T16:59:35.823 INFO:teuthology.orchestra.run.smithi007.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-09-30T16:59:35.823 INFO:teuthology.orchestra.run.smithi007.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-09-30T16:59:35.823 INFO:teuthology.orchestra.run.smithi007.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-09-30T16:59:35.824 INFO:teuthology.orchestra.run.smithi007.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-09-30T16:59:35.824 INFO:teuthology.orchestra.run.smithi007.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-09-30T16:59:35.824 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-09-30T16:59:35.824 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-09-30T16:59:35.824 INFO:teuthology.orchestra.run.smithi007.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-09-30T16:59:35.824 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-09-30T16:59:35.824 INFO:teuthology.orchestra.run.smithi007.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-09-30T16:59:35.824 INFO:teuthology.orchestra.run.smithi007.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-09-30T16:59:35.825 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-09-30T16:59:35.825 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-09-30T16:59:35.825 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-09-30T16:59:35.825 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-09-30T16:59:35.825 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-09-30T16:59:35.825 INFO:teuthology.orchestra.run.smithi007.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-09-30T16:59:35.825 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-09-30T16:59:35.825 INFO:teuthology.orchestra.run.smithi007.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-09-30T16:59:35.825 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-09-30T16:59:35.826 INFO:teuthology.orchestra.run.smithi007.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-09-30T16:59:35.826 INFO:teuthology.orchestra.run.smithi007.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-09-30T16:59:35.826 INFO:teuthology.orchestra.run.smithi007.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-09-30T16:59:35.826 INFO:teuthology.orchestra.run.smithi007.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-09-30T16:59:35.826 INFO:teuthology.orchestra.run.smithi007.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-09-30T16:59:35.826 INFO:teuthology.orchestra.run.smithi007.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-09-30T16:59:35.826 INFO:teuthology.orchestra.run.smithi007.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-09-30T16:59:35.826 INFO:teuthology.orchestra.run.smithi007.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-09-30T16:59:35.827 INFO:teuthology.orchestra.run.smithi007.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-09-30T16:59:35.827 INFO:teuthology.orchestra.run.smithi007.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-09-30T16:59:35.827 INFO:teuthology.orchestra.run.smithi007.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-09-30T16:59:35.827 INFO:teuthology.orchestra.run.smithi007.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-09-30T16:59:35.827 INFO:teuthology.orchestra.run.smithi007.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-09-30T16:59:35.827 INFO:teuthology.orchestra.run.smithi007.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-09-30T16:59:35.827 INFO:teuthology.orchestra.run.smithi007.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-09-30T16:59:35.827 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T16:59:35.828 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction Summary 2023-09-30T16:59:35.828 INFO:teuthology.orchestra.run.smithi007.stdout:======================================================================================================================= 2023-09-30T16:59:35.828 INFO:teuthology.orchestra.run.smithi007.stdout:Install 120 Packages 2023-09-30T16:59:35.828 INFO:teuthology.orchestra.run.smithi007.stdout:Upgrade 2 Packages 2023-09-30T16:59:35.828 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T16:59:35.829 INFO:teuthology.orchestra.run.smithi007.stdout:Total download size: 200 M 2023-09-30T16:59:35.829 INFO:teuthology.orchestra.run.smithi007.stdout:Downloading Packages: 2023-09-30T16:59:36.006 INFO:teuthology.orchestra.run.smithi007.stdout:(1/122): ceph-18.0.0-6447.g1d10b717.el8.x86_64. 48 kB/s | 6.4 kB 00:00 2023-09-30T16:59:36.232 INFO:teuthology.orchestra.run.smithi007.stdout:(2/122): ceph-fuse-18.0.0-6447.g1d10b717.el8.x8 4.0 MB/s | 918 kB 00:00 2023-09-30T16:59:36.240 INFO:teuthology.orchestra.run.smithi031.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-30T16:59:36.241 INFO:teuthology.orchestra.run.smithi031.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-30T16:59:36.290 INFO:teuthology.orchestra.run.smithi007.stdout:(3/122): ceph-immutable-object-cache-18.0.0-644 2.8 MB/s | 167 kB 00:00 2023-09-30T16:59:36.399 INFO:teuthology.orchestra.run.smithi031.stdout:Dependencies resolved. 2023-09-30T16:59:36.412 INFO:teuthology.orchestra.run.smithi031.stdout:======================================================================================================================= 2023-09-30T16:59:36.412 INFO:teuthology.orchestra.run.smithi031.stdout: Package Arch Version Repository Size 2023-09-30T16:59:36.412 INFO:teuthology.orchestra.run.smithi031.stdout:======================================================================================================================= 2023-09-30T16:59:36.412 INFO:teuthology.orchestra.run.smithi031.stdout:Installing: 2023-09-30T16:59:36.412 INFO:teuthology.orchestra.run.smithi031.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-09-30T16:59:36.412 INFO:teuthology.orchestra.run.smithi031.stdout: ceph x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 6.4 k 2023-09-30T16:59:36.412 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-base x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 5.4 M 2023-09-30T16:59:36.412 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-fuse x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 918 k 2023-09-30T16:59:36.412 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 167 k 2023-09-30T16:59:36.413 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 1.6 M 2023-09-30T16:59:36.413 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6447.g1d10b717.el8 ceph-noarch 132 k 2023-09-30T16:59:36.413 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6447.g1d10b717.el8 ceph-noarch 1.8 M 2023-09-30T16:59:36.413 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6447.g1d10b717.el8 ceph-noarch 7.4 M 2023-09-30T16:59:36.413 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-rook noarch 2:18.0.0-6447.g1d10b717.el8 ceph-noarch 47 k 2023-09-30T16:59:36.413 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-radosgw x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 14 M 2023-09-30T16:59:36.413 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-test x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 49 M 2023-09-30T16:59:36.413 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-volume noarch 2:18.0.0-6447.g1d10b717.el8 ceph-noarch 261 k 2023-09-30T16:59:36.413 INFO:teuthology.orchestra.run.smithi031.stdout: cephadm noarch 2:18.0.0-6447.g1d10b717.el8 ceph-noarch 185 k 2023-09-30T16:59:36.413 INFO:teuthology.orchestra.run.smithi031.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-09-30T16:59:36.413 INFO:teuthology.orchestra.run.smithi031.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-09-30T16:59:36.414 INFO:teuthology.orchestra.run.smithi031.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-09-30T16:59:36.414 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs-devel x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 31 k 2023-09-30T16:59:36.414 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs2 x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 839 k 2023-09-30T16:59:36.414 INFO:teuthology.orchestra.run.smithi031.stdout: librados-devel x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 139 k 2023-09-30T16:59:36.414 INFO:teuthology.orchestra.run.smithi031.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-09-30T16:59:36.414 INFO:teuthology.orchestra.run.smithi031.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-09-30T16:59:36.414 INFO:teuthology.orchestra.run.smithi031.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-09-30T16:59:36.414 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cephfs x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 197 k 2023-09-30T16:59:36.414 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rados x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 371 k 2023-09-30T16:59:36.414 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rbd x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 365 k 2023-09-30T16:59:36.415 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rgw x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 106 k 2023-09-30T16:59:36.415 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-fuse x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 94 k 2023-09-30T16:59:36.415 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-mirror x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 3.6 M 2023-09-30T16:59:36.415 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-nbd x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 180 k 2023-09-30T16:59:36.415 INFO:teuthology.orchestra.run.smithi031.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-09-30T16:59:36.415 INFO:teuthology.orchestra.run.smithi031.stdout:Upgrading: 2023-09-30T16:59:36.415 INFO:teuthology.orchestra.run.smithi031.stdout: librados2 x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 3.7 M 2023-09-30T16:59:36.415 INFO:teuthology.orchestra.run.smithi031.stdout: librbd1 x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 3.7 M 2023-09-30T16:59:36.415 INFO:teuthology.orchestra.run.smithi031.stdout:Installing dependencies: 2023-09-30T16:59:36.415 INFO:teuthology.orchestra.run.smithi031.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-09-30T16:59:36.415 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-common x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 23 M 2023-09-30T16:59:36.416 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6447.g1d10b717.el8 ceph-noarch 23 k 2023-09-30T16:59:36.416 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mds x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 2.3 M 2023-09-30T16:59:36.416 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6447.g1d10b717.el8 ceph-noarch 242 k 2023-09-30T16:59:36.416 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mon x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 4.6 M 2023-09-30T16:59:36.416 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-osd x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 18 M 2023-09-30T16:59:36.416 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6447.g1d10b717.el8 ceph-noarch 15 k 2023-09-30T16:59:36.416 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-selinux x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 24 k 2023-09-30T16:59:36.416 INFO:teuthology.orchestra.run.smithi031.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-09-30T16:59:36.416 INFO:teuthology.orchestra.run.smithi031.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-09-30T16:59:36.416 INFO:teuthology.orchestra.run.smithi031.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-09-30T16:59:36.416 INFO:teuthology.orchestra.run.smithi031.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-09-30T16:59:36.417 INFO:teuthology.orchestra.run.smithi031.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-09-30T16:59:36.417 INFO:teuthology.orchestra.run.smithi031.stdout: libcephsqlite x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 184 k 2023-09-30T16:59:36.417 INFO:teuthology.orchestra.run.smithi031.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-09-30T16:59:36.417 INFO:teuthology.orchestra.run.smithi031.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-09-30T16:59:36.417 INFO:teuthology.orchestra.run.smithi031.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-09-30T16:59:36.417 INFO:teuthology.orchestra.run.smithi031.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-09-30T16:59:36.417 INFO:teuthology.orchestra.run.smithi031.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-09-30T16:59:36.417 INFO:teuthology.orchestra.run.smithi031.stdout: libradosstriper1 x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 519 k 2023-09-30T16:59:36.417 INFO:teuthology.orchestra.run.smithi031.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-09-30T16:59:36.417 INFO:teuthology.orchestra.run.smithi031.stdout: librgw2 x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 6.9 M 2023-09-30T16:59:36.418 INFO:teuthology.orchestra.run.smithi031.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-09-30T16:59:36.418 INFO:teuthology.orchestra.run.smithi031.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-09-30T16:59:36.418 INFO:teuthology.orchestra.run.smithi031.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-09-30T16:59:36.418 INFO:teuthology.orchestra.run.smithi031.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-09-30T16:59:36.418 INFO:teuthology.orchestra.run.smithi031.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-09-30T16:59:36.418 INFO:teuthology.orchestra.run.smithi031.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-09-30T16:59:36.418 INFO:teuthology.orchestra.run.smithi031.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-09-30T16:59:36.418 INFO:teuthology.orchestra.run.smithi031.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-09-30T16:59:36.418 INFO:teuthology.orchestra.run.smithi031.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-09-30T16:59:36.418 INFO:teuthology.orchestra.run.smithi031.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-09-30T16:59:36.419 INFO:teuthology.orchestra.run.smithi031.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-09-30T16:59:36.419 INFO:teuthology.orchestra.run.smithi031.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-09-30T16:59:36.419 INFO:teuthology.orchestra.run.smithi031.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-09-30T16:59:36.419 INFO:teuthology.orchestra.run.smithi031.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-09-30T16:59:36.419 INFO:teuthology.orchestra.run.smithi031.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-09-30T16:59:36.419 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-09-30T16:59:36.419 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-argparse x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 45 k 2023-09-30T16:59:36.419 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-common x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 125 k 2023-09-30T16:59:36.419 INFO:teuthology.orchestra.run.smithi031.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-09-30T16:59:36.419 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-09-30T16:59:36.420 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-09-30T16:59:36.420 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-09-30T16:59:36.420 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-09-30T16:59:36.420 INFO:teuthology.orchestra.run.smithi031.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-09-30T16:59:36.420 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-09-30T16:59:36.420 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-09-30T16:59:36.420 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-09-30T16:59:36.420 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-09-30T16:59:36.420 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-09-30T16:59:36.420 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-09-30T16:59:36.421 INFO:teuthology.orchestra.run.smithi031.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-09-30T16:59:36.421 INFO:teuthology.orchestra.run.smithi031.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-09-30T16:59:36.421 INFO:teuthology.orchestra.run.smithi031.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-09-30T16:59:36.421 INFO:teuthology.orchestra.run.smithi031.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-09-30T16:59:36.421 INFO:teuthology.orchestra.run.smithi031.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-09-30T16:59:36.421 INFO:teuthology.orchestra.run.smithi031.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-09-30T16:59:36.421 INFO:teuthology.orchestra.run.smithi031.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-09-30T16:59:36.421 INFO:teuthology.orchestra.run.smithi031.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-09-30T16:59:36.421 INFO:teuthology.orchestra.run.smithi031.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-09-30T16:59:36.421 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-09-30T16:59:36.421 INFO:teuthology.orchestra.run.smithi031.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-09-30T16:59:36.422 INFO:teuthology.orchestra.run.smithi031.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-09-30T16:59:36.422 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-09-30T16:59:36.422 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-09-30T16:59:36.422 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-09-30T16:59:36.422 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-09-30T16:59:36.422 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-09-30T16:59:36.422 INFO:teuthology.orchestra.run.smithi031.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-09-30T16:59:36.422 INFO:teuthology.orchestra.run.smithi031.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-09-30T16:59:36.422 INFO:teuthology.orchestra.run.smithi031.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-09-30T16:59:36.422 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-09-30T16:59:36.422 INFO:teuthology.orchestra.run.smithi031.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-09-30T16:59:36.423 INFO:teuthology.orchestra.run.smithi031.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-09-30T16:59:36.423 INFO:teuthology.orchestra.run.smithi031.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-09-30T16:59:36.423 INFO:teuthology.orchestra.run.smithi031.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-09-30T16:59:36.423 INFO:teuthology.orchestra.run.smithi031.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-09-30T16:59:36.423 INFO:teuthology.orchestra.run.smithi031.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-09-30T16:59:36.423 INFO:teuthology.orchestra.run.smithi031.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-09-30T16:59:36.423 INFO:teuthology.orchestra.run.smithi031.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-09-30T16:59:36.423 INFO:teuthology.orchestra.run.smithi031.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-09-30T16:59:36.423 INFO:teuthology.orchestra.run.smithi031.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-09-30T16:59:36.423 INFO:teuthology.orchestra.run.smithi031.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-09-30T16:59:36.423 INFO:teuthology.orchestra.run.smithi031.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-09-30T16:59:36.424 INFO:teuthology.orchestra.run.smithi031.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-09-30T16:59:36.424 INFO:teuthology.orchestra.run.smithi031.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-09-30T16:59:36.424 INFO:teuthology.orchestra.run.smithi031.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-09-30T16:59:36.424 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-09-30T16:59:36.424 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction Summary 2023-09-30T16:59:36.424 INFO:teuthology.orchestra.run.smithi031.stdout:======================================================================================================================= 2023-09-30T16:59:36.424 INFO:teuthology.orchestra.run.smithi031.stdout:Install 120 Packages 2023-09-30T16:59:36.424 INFO:teuthology.orchestra.run.smithi031.stdout:Upgrade 2 Packages 2023-09-30T16:59:36.424 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-09-30T16:59:36.425 INFO:teuthology.orchestra.run.smithi031.stdout:Total download size: 200 M 2023-09-30T16:59:36.425 INFO:teuthology.orchestra.run.smithi031.stdout:Downloading Packages: 2023-09-30T16:59:36.674 INFO:teuthology.orchestra.run.smithi007.stdout:(4/122): ceph-base-18.0.0-6447.g1d10b717.el8.x8 6.7 MB/s | 5.4 MB 00:00 2023-09-30T16:59:36.716 INFO:teuthology.orchestra.run.smithi007.stdout:(5/122): ceph-mds-18.0.0-6447.g1d10b717.el8.x86 5.4 MB/s | 2.3 MB 00:00 2023-09-30T16:59:36.924 INFO:teuthology.orchestra.run.smithi007.stdout:(6/122): ceph-mgr-18.0.0-6447.g1d10b717.el8.x86 6.5 MB/s | 1.6 MB 00:00 2023-09-30T16:59:37.064 INFO:teuthology.orchestra.run.smithi031.stdout:(1/122): ceph-18.0.0-6447.g1d10b717.el8.x86_64. 22 kB/s | 6.4 kB 00:00 2023-09-30T16:59:37.350 INFO:teuthology.orchestra.run.smithi007.stdout:(7/122): ceph-mon-18.0.0-6447.g1d10b717.el8.x86 7.3 MB/s | 4.6 MB 00:00 2023-09-30T16:59:38.342 INFO:teuthology.orchestra.run.smithi007.stdout:(8/122): ceph-common-18.0.0-6447.g1d10b717.el8. 9.1 MB/s | 23 MB 00:02 2023-09-30T16:59:38.409 INFO:teuthology.orchestra.run.smithi007.stdout:(9/122): ceph-selinux-18.0.0-6447.g1d10b717.el8 365 kB/s | 24 kB 00:00 2023-09-30T16:59:38.881 INFO:teuthology.orchestra.run.smithi031.stdout:(2/122): ceph-fuse-18.0.0-6447.g1d10b717.el8.x8 506 kB/s | 918 kB 00:01 2023-09-30T16:59:39.062 INFO:teuthology.orchestra.run.smithi072.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-30T16:59:39.062 INFO:teuthology.orchestra.run.smithi072.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-30T16:59:39.167 INFO:teuthology.orchestra.run.smithi007.stdout:(10/122): ceph-radosgw-18.0.0-6447.g1d10b717.el 7.6 MB/s | 14 MB 00:01 2023-09-30T16:59:39.169 INFO:teuthology.orchestra.run.smithi072.stdout:Dependencies resolved. 2023-09-30T16:59:39.179 INFO:teuthology.orchestra.run.smithi072.stdout:======================================================================================================================= 2023-09-30T16:59:39.179 INFO:teuthology.orchestra.run.smithi072.stdout: Package Arch Version Repository Size 2023-09-30T16:59:39.179 INFO:teuthology.orchestra.run.smithi072.stdout:======================================================================================================================= 2023-09-30T16:59:39.180 INFO:teuthology.orchestra.run.smithi072.stdout:Installing: 2023-09-30T16:59:39.180 INFO:teuthology.orchestra.run.smithi072.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-09-30T16:59:39.192 INFO:teuthology.orchestra.run.smithi072.stdout: ceph x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 6.4 k 2023-09-30T16:59:39.192 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-base x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 5.4 M 2023-09-30T16:59:39.192 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-fuse x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 918 k 2023-09-30T16:59:39.192 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 167 k 2023-09-30T16:59:39.192 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 1.6 M 2023-09-30T16:59:39.192 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6447.g1d10b717.el8 ceph-noarch 132 k 2023-09-30T16:59:39.193 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6447.g1d10b717.el8 ceph-noarch 1.8 M 2023-09-30T16:59:39.193 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6447.g1d10b717.el8 ceph-noarch 7.4 M 2023-09-30T16:59:39.193 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-rook noarch 2:18.0.0-6447.g1d10b717.el8 ceph-noarch 47 k 2023-09-30T16:59:39.193 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-radosgw x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 14 M 2023-09-30T16:59:39.193 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-test x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 49 M 2023-09-30T16:59:39.193 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-volume noarch 2:18.0.0-6447.g1d10b717.el8 ceph-noarch 261 k 2023-09-30T16:59:39.193 INFO:teuthology.orchestra.run.smithi072.stdout: cephadm noarch 2:18.0.0-6447.g1d10b717.el8 ceph-noarch 185 k 2023-09-30T16:59:39.193 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-09-30T16:59:39.193 INFO:teuthology.orchestra.run.smithi072.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-09-30T16:59:39.193 INFO:teuthology.orchestra.run.smithi072.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-09-30T16:59:39.193 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs-devel x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 31 k 2023-09-30T16:59:39.194 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs2 x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 839 k 2023-09-30T16:59:39.194 INFO:teuthology.orchestra.run.smithi072.stdout: librados-devel x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 139 k 2023-09-30T16:59:39.194 INFO:teuthology.orchestra.run.smithi072.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-09-30T16:59:39.194 INFO:teuthology.orchestra.run.smithi072.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-09-30T16:59:39.194 INFO:teuthology.orchestra.run.smithi072.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-09-30T16:59:39.194 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cephfs x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 197 k 2023-09-30T16:59:39.194 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rados x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 371 k 2023-09-30T16:59:39.194 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rbd x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 365 k 2023-09-30T16:59:39.194 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rgw x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 106 k 2023-09-30T16:59:39.195 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-fuse x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 94 k 2023-09-30T16:59:39.195 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-mirror x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 3.6 M 2023-09-30T16:59:39.195 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-nbd x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 180 k 2023-09-30T16:59:39.195 INFO:teuthology.orchestra.run.smithi072.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-09-30T16:59:39.195 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrading: 2023-09-30T16:59:39.195 INFO:teuthology.orchestra.run.smithi072.stdout: librados2 x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 3.7 M 2023-09-30T16:59:39.195 INFO:teuthology.orchestra.run.smithi072.stdout: librbd1 x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 3.7 M 2023-09-30T16:59:39.195 INFO:teuthology.orchestra.run.smithi072.stdout:Installing dependencies: 2023-09-30T16:59:39.195 INFO:teuthology.orchestra.run.smithi072.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-09-30T16:59:39.195 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-common x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 23 M 2023-09-30T16:59:39.195 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6447.g1d10b717.el8 ceph-noarch 23 k 2023-09-30T16:59:39.195 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mds x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 2.3 M 2023-09-30T16:59:39.196 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6447.g1d10b717.el8 ceph-noarch 242 k 2023-09-30T16:59:39.196 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mon x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 4.6 M 2023-09-30T16:59:39.196 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-osd x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 18 M 2023-09-30T16:59:39.196 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6447.g1d10b717.el8 ceph-noarch 15 k 2023-09-30T16:59:39.196 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-selinux x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 24 k 2023-09-30T16:59:39.196 INFO:teuthology.orchestra.run.smithi072.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-09-30T16:59:39.196 INFO:teuthology.orchestra.run.smithi072.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-09-30T16:59:39.196 INFO:teuthology.orchestra.run.smithi072.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-09-30T16:59:39.196 INFO:teuthology.orchestra.run.smithi072.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-09-30T16:59:39.196 INFO:teuthology.orchestra.run.smithi072.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-09-30T16:59:39.196 INFO:teuthology.orchestra.run.smithi072.stdout: libcephsqlite x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 184 k 2023-09-30T16:59:39.197 INFO:teuthology.orchestra.run.smithi072.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-09-30T16:59:39.197 INFO:teuthology.orchestra.run.smithi072.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-09-30T16:59:39.197 INFO:teuthology.orchestra.run.smithi072.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-09-30T16:59:39.197 INFO:teuthology.orchestra.run.smithi072.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-09-30T16:59:39.197 INFO:teuthology.orchestra.run.smithi072.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-09-30T16:59:39.197 INFO:teuthology.orchestra.run.smithi072.stdout: libradosstriper1 x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 519 k 2023-09-30T16:59:39.197 INFO:teuthology.orchestra.run.smithi072.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-09-30T16:59:39.197 INFO:teuthology.orchestra.run.smithi072.stdout: librgw2 x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 6.9 M 2023-09-30T16:59:39.197 INFO:teuthology.orchestra.run.smithi072.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-09-30T16:59:39.197 INFO:teuthology.orchestra.run.smithi072.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-09-30T16:59:39.197 INFO:teuthology.orchestra.run.smithi072.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-09-30T16:59:39.197 INFO:teuthology.orchestra.run.smithi072.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-09-30T16:59:39.198 INFO:teuthology.orchestra.run.smithi072.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-09-30T16:59:39.198 INFO:teuthology.orchestra.run.smithi072.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-09-30T16:59:39.198 INFO:teuthology.orchestra.run.smithi072.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-09-30T16:59:39.198 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-09-30T16:59:39.198 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-09-30T16:59:39.198 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-09-30T16:59:39.198 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-09-30T16:59:39.198 INFO:teuthology.orchestra.run.smithi072.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-09-30T16:59:39.198 INFO:teuthology.orchestra.run.smithi072.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-09-30T16:59:39.198 INFO:teuthology.orchestra.run.smithi072.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-09-30T16:59:39.198 INFO:teuthology.orchestra.run.smithi072.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-09-30T16:59:39.199 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-09-30T16:59:39.199 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-argparse x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 45 k 2023-09-30T16:59:39.199 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-common x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 125 k 2023-09-30T16:59:39.199 INFO:teuthology.orchestra.run.smithi072.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-09-30T16:59:39.199 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-09-30T16:59:39.199 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-09-30T16:59:39.199 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-09-30T16:59:39.199 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-09-30T16:59:39.199 INFO:teuthology.orchestra.run.smithi072.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-09-30T16:59:39.227 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-09-30T16:59:39.227 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-09-30T16:59:39.227 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-09-30T16:59:39.227 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-09-30T16:59:39.227 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-09-30T16:59:39.227 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-09-30T16:59:39.227 INFO:teuthology.orchestra.run.smithi072.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-09-30T16:59:39.228 INFO:teuthology.orchestra.run.smithi072.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-09-30T16:59:39.228 INFO:teuthology.orchestra.run.smithi072.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-09-30T16:59:39.228 INFO:teuthology.orchestra.run.smithi072.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-09-30T16:59:39.228 INFO:teuthology.orchestra.run.smithi072.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-09-30T16:59:39.228 INFO:teuthology.orchestra.run.smithi072.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-09-30T16:59:39.228 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-09-30T16:59:39.228 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-09-30T16:59:39.228 INFO:teuthology.orchestra.run.smithi072.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-09-30T16:59:39.228 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-09-30T16:59:39.228 INFO:teuthology.orchestra.run.smithi072.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-09-30T16:59:39.228 INFO:teuthology.orchestra.run.smithi072.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-09-30T16:59:39.228 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-09-30T16:59:39.229 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-09-30T16:59:39.229 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-09-30T16:59:39.229 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-09-30T16:59:39.229 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-09-30T16:59:39.229 INFO:teuthology.orchestra.run.smithi072.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-09-30T16:59:39.229 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-09-30T16:59:39.229 INFO:teuthology.orchestra.run.smithi072.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-09-30T16:59:39.229 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-09-30T16:59:39.229 INFO:teuthology.orchestra.run.smithi072.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-09-30T16:59:39.229 INFO:teuthology.orchestra.run.smithi072.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-09-30T16:59:39.230 INFO:teuthology.orchestra.run.smithi072.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-09-30T16:59:39.230 INFO:teuthology.orchestra.run.smithi072.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-09-30T16:59:39.230 INFO:teuthology.orchestra.run.smithi072.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-09-30T16:59:39.230 INFO:teuthology.orchestra.run.smithi072.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-09-30T16:59:39.230 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-09-30T16:59:39.230 INFO:teuthology.orchestra.run.smithi072.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-09-30T16:59:39.230 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-09-30T16:59:39.230 INFO:teuthology.orchestra.run.smithi072.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-09-30T16:59:39.230 INFO:teuthology.orchestra.run.smithi072.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-09-30T16:59:39.231 INFO:teuthology.orchestra.run.smithi072.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-09-30T16:59:39.231 INFO:teuthology.orchestra.run.smithi072.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-09-30T16:59:39.231 INFO:teuthology.orchestra.run.smithi072.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-09-30T16:59:39.231 INFO:teuthology.orchestra.run.smithi072.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-09-30T16:59:39.231 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-09-30T16:59:39.232 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction Summary 2023-09-30T16:59:39.232 INFO:teuthology.orchestra.run.smithi072.stdout:======================================================================================================================= 2023-09-30T16:59:39.232 INFO:teuthology.orchestra.run.smithi072.stdout:Install 120 Packages 2023-09-30T16:59:39.232 INFO:teuthology.orchestra.run.smithi072.stdout:Upgrade 2 Packages 2023-09-30T16:59:39.232 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-09-30T16:59:39.233 INFO:teuthology.orchestra.run.smithi072.stdout:Total download size: 200 M 2023-09-30T16:59:39.233 INFO:teuthology.orchestra.run.smithi072.stdout:Downloading Packages: 2023-09-30T16:59:39.239 INFO:teuthology.orchestra.run.smithi031.stdout:(3/122): ceph-immutable-object-cache-18.0.0-644 466 kB/s | 167 kB 00:00 2023-09-30T16:59:39.382 INFO:teuthology.orchestra.run.smithi031.stdout:(4/122): ceph-base-18.0.0-6447.g1d10b717.el8.x8 2.1 MB/s | 5.4 MB 00:02 2023-09-30T16:59:39.401 INFO:teuthology.orchestra.run.smithi007.stdout:(11/122): ceph-osd-18.0.0-6447.g1d10b717.el8.x8 7.2 MB/s | 18 MB 00:02 2023-09-30T16:59:39.656 INFO:teuthology.orchestra.run.smithi072.stdout:(1/122): ceph-18.0.0-6447.g1d10b717.el8.x86_64. 33 kB/s | 6.4 kB 00:00 2023-09-30T16:59:39.657 INFO:teuthology.orchestra.run.smithi007.stdout:(12/122): libcephfs-devel-18.0.0-6447.g1d10b717 120 kB/s | 31 kB 00:00 2023-09-30T16:59:39.657 INFO:teuthology.orchestra.run.smithi007.stdout:(13/122): libcephfs2-18.0.0-6447.g1d10b717.el8. 7.0 MB/s | 839 kB 00:00 2023-09-30T16:59:39.657 INFO:teuthology.orchestra.run.smithi007.stdout:(14/122): libcephsqlite-18.0.0-6447.g1d10b717.e 1.5 MB/s | 184 kB 00:00 2023-09-30T16:59:39.657 INFO:teuthology.orchestra.run.smithi007.stdout:(15/122): librados-devel-18.0.0-6447.g1d10b717. 2.0 MB/s | 139 kB 00:00 2023-09-30T16:59:39.660 INFO:teuthology.orchestra.run.smithi007.stdout:(16/122): libradosstriper1-18.0.0-6447.g1d10b71 4.3 MB/s | 519 kB 00:00 2023-09-30T16:59:39.828 INFO:teuthology.orchestra.run.smithi031.stdout:(5/122): ceph-mgr-18.0.0-6447.g1d10b717.el8.x86 3.8 MB/s | 1.6 MB 00:00 2023-09-30T16:59:39.828 INFO:teuthology.orchestra.run.smithi007.stdout:(17/122): python3-ceph-argparse-18.0.0-6447.g1d 596 kB/s | 45 kB 00:00 2023-09-30T16:59:39.828 INFO:teuthology.orchestra.run.smithi007.stdout:(18/122): python3-ceph-common-18.0.0-6447.g1d10 1.6 MB/s | 125 kB 00:00 2023-09-30T16:59:39.903 INFO:teuthology.orchestra.run.smithi007.stdout:(19/122): python3-cephfs-18.0.0-6447.g1d10b717. 2.1 MB/s | 197 kB 00:00 2023-09-30T16:59:40.004 INFO:teuthology.orchestra.run.smithi007.stdout:(20/122): python3-rados-18.0.0-6447.g1d10b717.e 3.6 MB/s | 371 kB 00:00 2023-09-30T16:59:40.096 INFO:teuthology.orchestra.run.smithi007.stdout:(21/122): python3-rbd-18.0.0-6447.g1d10b717.el8 3.9 MB/s | 365 kB 00:00 2023-09-30T16:59:40.179 INFO:teuthology.orchestra.run.smithi007.stdout:(22/122): python3-rgw-18.0.0-6447.g1d10b717.el8 1.2 MB/s | 106 kB 00:00 2023-09-30T16:59:40.336 INFO:teuthology.orchestra.run.smithi007.stdout:(23/122): rbd-fuse-18.0.0-6447.g1d10b717.el8.x8 865 kB/s | 94 kB 00:00 2023-09-30T16:59:40.457 INFO:teuthology.orchestra.run.smithi134.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 59 MB/s | 47 MB 00:00 2023-09-30T16:59:40.525 INFO:teuthology.orchestra.run.smithi072.stdout:(2/122): ceph-fuse-18.0.0-6447.g1d10b717.el8.x8 854 kB/s | 918 kB 00:01 2023-09-30T16:59:40.809 INFO:teuthology.orchestra.run.smithi072.stdout:(3/122): ceph-immutable-object-cache-18.0.0-644 588 kB/s | 167 kB 00:00 2023-09-30T16:59:40.922 INFO:teuthology.orchestra.run.smithi007.stdout:(24/122): rbd-mirror-18.0.0-6447.g1d10b717.el8. 5.7 MB/s | 3.6 MB 00:00 2023-09-30T16:59:41.001 INFO:teuthology.orchestra.run.smithi072.stdout:(4/122): ceph-base-18.0.0-6447.g1d10b717.el8.x8 3.1 MB/s | 5.4 MB 00:01 2023-09-30T16:59:41.072 INFO:teuthology.orchestra.run.smithi007.stdout:(25/122): librgw2-18.0.0-6447.g1d10b717.el8.x86 4.6 MB/s | 6.9 MB 00:01 2023-09-30T16:59:41.097 INFO:teuthology.orchestra.run.smithi007.stdout:(26/122): rbd-nbd-18.0.0-6447.g1d10b717.el8.x86 1.0 MB/s | 180 kB 00:00 2023-09-30T16:59:41.123 INFO:teuthology.orchestra.run.smithi007.stdout:(27/122): ceph-grafana-dashboards-18.0.0-6447.g 462 kB/s | 23 kB 00:00 2023-09-30T16:59:41.201 INFO:teuthology.orchestra.run.smithi031.stdout:(6/122): ceph-mon-18.0.0-6447.g1d10b717.el8.x86 3.4 MB/s | 4.6 MB 00:01 2023-09-30T16:59:41.202 INFO:teuthology.orchestra.run.smithi007.stdout:(28/122): ceph-mgr-cephadm-18.0.0-6447.g1d10b71 1.9 MB/s | 132 kB 00:00 2023-09-30T16:59:41.303 INFO:teuthology.orchestra.run.smithi072.stdout:(5/122): ceph-mgr-18.0.0-6447.g1d10b717.el8.x86 5.4 MB/s | 1.6 MB 00:00 2023-09-30T16:59:41.548 INFO:teuthology.orchestra.run.smithi007.stdout:(29/122): ceph-mgr-dashboard-18.0.0-6447.g1d10b 4.1 MB/s | 1.8 MB 00:00 2023-09-30T16:59:41.648 INFO:teuthology.orchestra.run.smithi007.stdout:(30/122): ceph-mgr-modules-core-18.0.0-6447.g1d 2.4 MB/s | 242 kB 00:00 2023-09-30T16:59:41.725 INFO:teuthology.orchestra.run.smithi007.stdout:(31/122): ceph-mgr-rook-18.0.0-6447.g1d10b717.e 632 kB/s | 47 kB 00:00 2023-09-30T16:59:41.824 INFO:teuthology.orchestra.run.smithi007.stdout:(32/122): ceph-prometheus-alerts-18.0.0-6447.g1 145 kB/s | 15 kB 00:00 2023-09-30T16:59:41.916 INFO:teuthology.orchestra.run.smithi007.stdout:(33/122): ceph-volume-18.0.0-6447.g1d10b717.el8 2.8 MB/s | 261 kB 00:00 2023-09-30T16:59:42.008 INFO:teuthology.orchestra.run.smithi007.stdout:(34/122): cephadm-18.0.0-6447.g1d10b717.el8.noa 2.0 MB/s | 185 kB 00:00 2023-09-30T16:59:42.074 INFO:teuthology.orchestra.run.smithi031.stdout:(7/122): ceph-mds-18.0.0-6447.g1d10b717.el8.x86 834 kB/s | 2.3 MB 00:02 2023-09-30T16:59:42.200 INFO:teuthology.orchestra.run.smithi007.stdout:(35/122): gperftools-libs-2.7-9.el8.x86_64.rpm 1.6 MB/s | 306 kB 00:00 2023-09-30T16:59:42.250 INFO:teuthology.orchestra.run.smithi007.stdout:(36/122): liboath-2.6.2-3.el8.x86_64.rpm 1.2 MB/s | 59 kB 00:00 2023-09-30T16:59:42.351 INFO:teuthology.orchestra.run.smithi007.stdout:(37/122): ceph-mgr-diskprediction-local-18.0.0- 6.2 MB/s | 7.4 MB 00:01 2023-09-30T16:59:42.368 INFO:teuthology.orchestra.run.smithi007.stdout:(38/122): libunwind-1.3.1-3.el8.x86_64.rpm 642 kB/s | 75 kB 00:00 2023-09-30T16:59:42.418 INFO:teuthology.orchestra.run.smithi007.stdout:(39/122): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 871 kB/s | 44 kB 00:00 2023-09-30T16:59:42.420 INFO:teuthology.orchestra.run.smithi072.stdout:(6/122): ceph-mon-18.0.0-6447.g1d10b717.el8.x86 4.1 MB/s | 4.6 MB 00:01 2023-09-30T16:59:42.468 INFO:teuthology.orchestra.run.smithi007.stdout:(40/122): python3-beautifulsoup4-4.6.3-2.el8.1. 3.7 MB/s | 185 kB 00:00 2023-09-30T16:59:42.519 INFO:teuthology.orchestra.run.smithi007.stdout:(41/122): python3-cachetools-3.1.1-4.el8.noarch 655 kB/s | 33 kB 00:00 2023-09-30T16:59:42.586 INFO:teuthology.orchestra.run.smithi007.stdout:(42/122): python3-certifi-2018.10.15-7.el8.noar 245 kB/s | 16 kB 00:00 2023-09-30T16:59:42.611 INFO:teuthology.orchestra.run.smithi007.stdout:(43/122): python3-asyncssh-2.7.0-2.el8.noarch.r 1.8 MB/s | 476 kB 00:00 2023-09-30T16:59:42.731 INFO:teuthology.orchestra.run.smithi072.stdout:(7/122): ceph-mds-18.0.0-6447.g1d10b717.el8.x86 1.3 MB/s | 2.3 MB 00:01 2023-09-30T16:59:42.731 INFO:teuthology.orchestra.run.smithi007.stdout:(44/122): python3-cheroot-8.5.2-1.el8.noarch.rp 3.4 MB/s | 173 kB 00:00 2023-09-30T16:59:42.732 INFO:teuthology.orchestra.run.smithi007.stdout:(45/122): python3-cherrypy-18.4.0-1.el8.noarch. 6.4 MB/s | 384 kB 00:00 2023-09-30T16:59:42.732 INFO:teuthology.orchestra.run.smithi007.stdout:(46/122): python3-google-auth-1.1.1-10.el8.noar 1.4 MB/s | 81 kB 00:00 2023-09-30T16:59:42.732 INFO:teuthology.orchestra.run.smithi007.stdout:(47/122): python3-jaraco-6.2-6.el8.noarch.rpm 265 kB/s | 11 kB 00:00 2023-09-30T16:59:42.737 INFO:teuthology.orchestra.run.smithi007.stdout:(48/122): python3-jaraco-functools-2.0-4.el8.no 421 kB/s | 18 kB 00:00 2023-09-30T16:59:42.788 INFO:teuthology.orchestra.run.smithi007.stdout:(49/122): python3-logutils-0.3.5-11.el8.noarch. 972 kB/s | 49 kB 00:00 2023-09-30T16:59:42.822 INFO:teuthology.orchestra.run.smithi007.stdout:(50/122): python3-kubernetes-11.0.0-6.el8.noarc 11 MB/s | 1.2 MB 00:00 2023-09-30T16:59:42.847 INFO:teuthology.orchestra.run.smithi007.stdout:(51/122): python3-more-itertools-7.2.0-3.el8.no 1.0 MB/s | 59 kB 00:00 2023-09-30T16:59:42.872 INFO:teuthology.orchestra.run.smithi007.stdout:(52/122): python3-natsort-7.1.1-2.el8.noarch.rp 1.2 MB/s | 60 kB 00:00 2023-09-30T16:59:42.906 INFO:teuthology.orchestra.run.smithi007.stdout:(53/122): python3-pecan-1.3.2-9.el8.noarch.rpm 4.7 MB/s | 283 kB 00:00 2023-09-30T16:59:42.931 INFO:teuthology.orchestra.run.smithi007.stdout:(54/122): python3-portend-2.6-1.el8.noarch.rpm 267 kB/s | 16 kB 00:00 2023-09-30T16:59:42.956 INFO:teuthology.orchestra.run.smithi007.stdout:(55/122): python3-repoze-lru-0.7-6.el8.noarch.r 671 kB/s | 34 kB 00:00 2023-09-30T16:59:42.982 INFO:teuthology.orchestra.run.smithi007.stdout:(56/122): python3-routes-2.4.1-12.el8.noarch.rp 3.8 MB/s | 196 kB 00:00 2023-09-30T16:59:43.007 INFO:teuthology.orchestra.run.smithi007.stdout:(57/122): python3-rsa-4.9-2.el8.noarch.rpm 1.2 MB/s | 64 kB 00:00 2023-09-30T16:59:43.033 INFO:teuthology.orchestra.run.smithi007.stdout:(58/122): python3-simplegeneric-0.8.1-17.el8.no 372 kB/s | 19 kB 00:00 2023-09-30T16:59:43.058 INFO:teuthology.orchestra.run.smithi007.stdout:(59/122): python3-singledispatch-3.4.0.3-18.el8 475 kB/s | 24 kB 00:00 2023-09-30T16:59:43.083 INFO:teuthology.orchestra.run.smithi007.stdout:(60/122): python3-tempora-1.14.1-5.el8.noarch.r 584 kB/s | 29 kB 00:00 2023-09-30T16:59:43.108 INFO:teuthology.orchestra.run.smithi007.stdout:(61/122): python3-trustme-0.6.0-4.el8.noarch.rp 550 kB/s | 27 kB 00:00 2023-09-30T16:59:43.134 INFO:teuthology.orchestra.run.smithi007.stdout:(62/122): python3-waitress-1.4.3-1.el8.noarch.r 5.0 MB/s | 255 kB 00:00 2023-09-30T16:59:43.159 INFO:teuthology.orchestra.run.smithi007.stdout:(63/122): python3-webob-1.8.5-1.el8.1.noarch.rp 4.9 MB/s | 251 kB 00:00 2023-09-30T16:59:43.184 INFO:teuthology.orchestra.run.smithi007.stdout:(64/122): python3-websocket-client-0.56.0-5.el8 1.2 MB/s | 61 kB 00:00 2023-09-30T16:59:43.209 INFO:teuthology.orchestra.run.smithi007.stdout:(65/122): python3-webtest-2.0.33-1.el8.noarch.r 1.7 MB/s | 85 kB 00:00 2023-09-30T16:59:43.235 INFO:teuthology.orchestra.run.smithi007.stdout:(66/122): python3-zc-lockfile-2.0-2.el8.noarch. 456 kB/s | 23 kB 00:00 2023-09-30T16:59:43.260 INFO:teuthology.orchestra.run.smithi007.stdout:(67/122): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-09-30T16:59:43.352 INFO:teuthology.orchestra.run.smithi007.stdout:(68/122): thrift-0.13.0-2.el8.x86_64.rpm 12 MB/s | 1.7 MB 00:00 2023-09-30T16:59:43.386 INFO:teuthology.orchestra.run.smithi007.stdout:(69/122): librabbitmq-0.9.0-3.el8.x86_64.rpm 373 kB/s | 47 kB 00:00 2023-09-30T16:59:43.461 INFO:teuthology.orchestra.run.smithi007.stdout:(70/122): python3-jwt-1.6.1-2.el8.noarch.rpm 641 kB/s | 43 kB 00:00 2023-09-30T16:59:43.487 INFO:teuthology.orchestra.run.smithi007.stdout:(71/122): libselinux-devel-2.9-5.el8.x86_64.rpm 1.5 MB/s | 200 kB 00:00 2023-09-30T16:59:43.520 INFO:teuthology.orchestra.run.smithi007.stdout:(72/122): pcre2-utf32-10.32-2.el8.x86_64.rpm 3.7 MB/s | 220 kB 00:00 2023-09-30T16:59:43.546 INFO:teuthology.orchestra.run.smithi007.stdout:(73/122): keyutils-libs-devel-1.5.10-9.el8.x86_ 823 kB/s | 48 kB 00:00 2023-09-30T16:59:43.562 INFO:teuthology.orchestra.run.smithi007.stdout:(74/122): libsepol-devel-2.9-3.el8.x86_64.rpm 2.0 MB/s | 87 kB 00:00 2023-09-30T16:59:43.596 INFO:teuthology.orchestra.run.smithi007.stdout:(75/122): python3-requests-oauthlib-1.0.0-1.el8 851 kB/s | 43 kB 00:00 2023-09-30T16:59:43.621 INFO:teuthology.orchestra.run.smithi007.stdout:(76/122): python3-pycparser-2.14-14.el8.noarch. 1.8 MB/s | 109 kB 00:00 2023-09-30T16:59:43.647 INFO:teuthology.orchestra.run.smithi007.stdout:(77/122): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2023-09-30T16:59:44.114 INFO:teuthology.orchestra.run.smithi007.stdout:(78/122): ceph-test-18.0.0-6447.g1d10b717.el8.x 8.6 MB/s | 49 MB 00:05 2023-09-30T16:59:44.145 INFO:teuthology.orchestra.run.smithi007.stdout:(79/122): libaio-devel-0.3.112-1.el8.x86_64.rpm 38 kB/s | 19 kB 00:00 2023-09-30T16:59:44.181 INFO:teuthology.orchestra.run.smithi007.stdout:(80/122): krb5-devel-1.18.2-14.el8.x86_64.rpm 1.0 MB/s | 560 kB 00:00 2023-09-30T16:59:44.206 INFO:teuthology.orchestra.run.smithi007.stdout:(81/122): python3-oauthlib-2.1.0-1.el8.noarch.r 1.6 MB/s | 155 kB 00:00 2023-09-30T16:59:44.231 INFO:teuthology.orchestra.run.smithi007.stdout:(82/122): libverto-devel-0.3.0-5.el8.x86_64.rpm 358 kB/s | 18 kB 00:00 2023-09-30T16:59:44.265 INFO:teuthology.orchestra.run.smithi007.stdout:(83/122): python3-cryptography-3.2.1-5.el8.x86_ 4.7 MB/s | 559 kB 00:00 2023-09-30T16:59:44.327 INFO:teuthology.orchestra.run.smithi007.stdout:(84/122): pcre2-devel-10.32-2.el8.x86_64.rpm 6.4 MB/s | 605 kB 00:00 2023-09-30T16:59:44.327 INFO:teuthology.orchestra.run.smithi007.stdout:(85/122): python3-cffi-1.11.5-5.el8.x86_64.rpm 2.5 MB/s | 238 kB 00:00 2023-09-30T16:59:44.349 INFO:teuthology.orchestra.run.smithi007.stdout:(86/122): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.4 MB/s | 72 kB 00:00 2023-09-30T16:59:44.493 INFO:teuthology.orchestra.run.smithi007.stdout:(87/122): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-09-30T16:59:44.493 INFO:teuthology.orchestra.run.smithi007.stdout:(88/122): elfutils-libelf-devel-0.186-1.el8.x86 1.2 MB/s | 60 kB 00:00 2023-09-30T16:59:44.493 INFO:teuthology.orchestra.run.smithi007.stdout:(89/122): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.9 MB/s | 98 kB 00:00 2023-09-30T16:59:44.494 INFO:teuthology.orchestra.run.smithi007.stdout:(90/122): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2023-09-30T16:59:44.494 INFO:teuthology.orchestra.run.smithi007.stdout:(91/122): libcom_err-devel-1.45.6-4.el8.x86_64. 770 kB/s | 39 kB 00:00 2023-09-30T16:59:44.518 INFO:teuthology.orchestra.run.smithi007.stdout:(92/122): libgfortran-8.5.0-10.1.el8_6.x86_64.r 9.4 MB/s | 644 kB 00:00 2023-09-30T16:59:44.559 INFO:teuthology.orchestra.run.smithi007.stdout:(93/122): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.5 MB/s | 171 kB 00:00 2023-09-30T16:59:44.610 INFO:teuthology.orchestra.run.smithi007.stdout:(94/122): openssl-devel-1.1.1k-7.el8_6.x86_64.r 6.7 MB/s | 2.3 MB 00:00 2023-09-30T16:59:44.640 INFO:teuthology.orchestra.run.smithi007.stdout:(95/122): python3-pyasn1-modules-0.3.7-6.el8.no 1.2 MB/s | 110 kB 00:00 2023-09-30T16:59:44.661 INFO:teuthology.orchestra.run.smithi007.stdout:(96/122): python3-pytz-2017.2-9.el8.noarch.rpm 1.0 MB/s | 54 kB 00:00 2023-09-30T16:59:44.695 INFO:teuthology.orchestra.run.smithi007.stdout:(97/122): lttng-ust-2.8.1-11.el8.x86_64.rpm 4.3 MB/s | 259 kB 00:00 2023-09-30T16:59:44.728 INFO:teuthology.orchestra.run.smithi007.stdout:(98/122): socat-1.7.4.1-1.el8.x86_64.rpm 4.7 MB/s | 323 kB 00:00 2023-09-30T16:59:44.754 INFO:teuthology.orchestra.run.smithi007.stdout:(99/122): python3-markupsafe-0.23-19.el8.x86_64 662 kB/s | 39 kB 00:00 2023-09-30T16:59:44.828 INFO:teuthology.orchestra.run.smithi007.stdout:(100/122): bison-3.0.4-10.el8.x86_64.rpm 10 MB/s | 688 kB 00:00 2023-09-30T16:59:44.837 INFO:teuthology.orchestra.run.smithi007.stdout:(101/122): python3-jinja2-2.10.1-3.el8.noarch.r 6.3 MB/s | 538 kB 00:00 2023-09-30T16:59:44.896 INFO:teuthology.orchestra.run.smithi007.stdout:(102/122): python3-mako-1.0.6-13.el8.noarch.rpm 1.5 MB/s | 157 kB 00:00 2023-09-30T16:59:44.905 INFO:teuthology.orchestra.run.smithi072.stdout:(8/122): ceph-osd-18.0.0-6447.g1d10b717.el8.x86 7.2 MB/s | 18 MB 00:02 2023-09-30T16:59:44.921 INFO:teuthology.orchestra.run.smithi007.stdout:(103/122): oniguruma-6.8.2-2.el8.x86_64.rpm 2.2 MB/s | 187 kB 00:00 2023-09-30T16:59:44.991 INFO:teuthology.orchestra.run.smithi072.stdout:(9/122): ceph-selinux-18.0.0-6447.g1d10b717.el8 587 kB/s | 24 kB 00:00 2023-09-30T16:59:44.991 INFO:teuthology.orchestra.run.smithi007.stdout:(104/122): automake-1.16.1-7.el8.noarch.rpm 9.3 MB/s | 713 kB 00:00 2023-09-30T16:59:45.022 INFO:teuthology.orchestra.run.smithi007.stdout:(105/122): python3-jsonpatch-1.21-2.el8.noarch. 532 kB/s | 27 kB 00:00 2023-09-30T16:59:45.081 INFO:teuthology.orchestra.run.smithi007.stdout:(106/122): flex-2.6.1-9.el8.x86_64.rpm 5.4 MB/s | 320 kB 00:00 2023-09-30T16:59:45.220 INFO:teuthology.orchestra.run.smithi031.stdout:(8/122): ceph-osd-18.0.0-6447.g1d10b717.el8.x86 4.6 MB/s | 18 MB 00:03 2023-09-30T16:59:45.220 INFO:teuthology.orchestra.run.smithi031.stdout:(9/122): ceph-selinux-18.0.0-6447.g1d10b717.el8 367 kB/s | 24 kB 00:00 2023-09-30T16:59:45.220 INFO:teuthology.orchestra.run.smithi007.stdout:(107/122): python3-babel-2.5.1-7.el8.noarch.rpm 20 MB/s | 4.8 MB 00:00 2023-09-30T16:59:45.220 INFO:teuthology.orchestra.run.smithi007.stdout:(108/122): python3-prettytable-0.7.2-14.el8.noa 439 kB/s | 44 kB 00:00 2023-09-30T16:59:45.239 INFO:teuthology.orchestra.run.smithi007.stdout:(109/122): python3-werkzeug-0.12.2-4.el8.noarch 7.7 MB/s | 457 kB 00:00 2023-09-30T16:59:45.350 INFO:teuthology.orchestra.run.smithi007.stdout:(110/122): python3-numpy-f2py-1.14.3-10.el8.x86 5.3 MB/s | 225 kB 00:00 2023-09-30T16:59:45.350 INFO:teuthology.orchestra.run.smithi007.stdout:(111/122): python3-numpy-1.14.3-10.el8.x86_64.r 21 MB/s | 3.7 MB 00:00 2023-09-30T16:59:45.357 INFO:teuthology.orchestra.run.smithi007.stdout:(112/122): python3-pyasn1-0.3.7-6.el8.noarch.rp 1.6 MB/s | 126 kB 00:00 2023-09-30T16:59:45.508 INFO:teuthology.orchestra.run.smithi007.stdout:(113/122): python3-scipy-1.0.0-21.module+el8.5. 14 MB/s | 14 MB 00:00 2023-09-30T16:59:45.524 INFO:teuthology.orchestra.run.smithi007.stdout:(114/122): python3-jsonpointer-1.10-11.el8.noar 109 kB/s | 20 kB 00:00 2023-09-30T16:59:45.575 INFO:teuthology.orchestra.run.smithi007.stdout:(115/122): python3-pyOpenSSL-19.0.0-1.el8.noarc 477 kB/s | 103 kB 00:00 2023-09-30T16:59:45.645 INFO:teuthology.orchestra.run.smithi007.stdout:(116/122): libtool-2.4.6-25.el8.x86_64.rpm 5.1 MB/s | 709 kB 00:00 2023-09-30T16:59:45.709 INFO:teuthology.orchestra.run.smithi007.stdout:(117/122): jq-1.6-3.el8.x86_64.rpm 3.6 MB/s | 202 kB 00:00 2023-09-30T16:59:45.784 INFO:teuthology.orchestra.run.smithi007.stdout:(118/122): openblas-threads-0.3.15-3.el8.x86_64 19 MB/s | 4.9 MB 00:00 2023-09-30T16:59:45.837 INFO:teuthology.orchestra.run.smithi007.stdout:(119/122): librdkafka-0.11.4-3.el8.x86_64.rpm 3.0 MB/s | 354 kB 00:00 2023-09-30T16:59:45.901 INFO:teuthology.orchestra.run.smithi007.stdout:(120/122): openblas-0.3.15-3.el8.x86_64.rpm 15 MB/s | 4.7 MB 00:00 2023-09-30T16:59:46.330 INFO:teuthology.orchestra.run.smithi072.stdout:(10/122): ceph-common-18.0.0-6447.g1d10b717.el8 3.2 MB/s | 23 MB 00:07 2023-09-30T16:59:46.459 INFO:teuthology.orchestra.run.smithi072.stdout:(11/122): libcephfs-devel-18.0.0-6447.g1d10b717 242 kB/s | 31 kB 00:00 2023-09-30T16:59:46.518 INFO:teuthology.orchestra.run.smithi007.stdout:(121/122): librbd1-18.0.0-6447.g1d10b717.el8.x8 5.3 MB/s | 3.7 MB 00:00 2023-09-30T16:59:46.585 INFO:teuthology.orchestra.run.smithi007.stdout:(122/122): librados2-18.0.0-6447.g1d10b717.el8. 4.7 MB/s | 3.7 MB 00:00 2023-09-30T16:59:46.588 INFO:teuthology.orchestra.run.smithi007.stdout:-------------------------------------------------------------------------------- 2023-09-30T16:59:46.589 INFO:teuthology.orchestra.run.smithi007.stdout:Total 19 MB/s | 200 MB 00:10 2023-09-30T16:59:46.706 INFO:teuthology.orchestra.run.smithi072.stdout:(12/122): libcephfs2-18.0.0-6447.g1d10b717.el8. 3.3 MB/s | 839 kB 00:00 2023-09-30T16:59:46.774 INFO:teuthology.orchestra.run.smithi072.stdout:(13/122): libcephsqlite-18.0.0-6447.g1d10b717.e 2.7 MB/s | 184 kB 00:00 2023-09-30T16:59:46.832 INFO:teuthology.orchestra.run.smithi072.stdout:(14/122): librados-devel-18.0.0-6447.g1d10b717. 2.3 MB/s | 139 kB 00:00 2023-09-30T16:59:46.975 INFO:teuthology.orchestra.run.smithi072.stdout:(15/122): libradosstriper1-18.0.0-6447.g1d10b71 3.6 MB/s | 519 kB 00:00 2023-09-30T16:59:47.322 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction check 2023-09-30T16:59:47.445 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction check succeeded. 2023-09-30T16:59:47.445 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction test 2023-09-30T16:59:47.932 INFO:teuthology.orchestra.run.smithi031.stdout:(10/122): ceph-common-18.0.0-6447.g1d10b717.el8 2.0 MB/s | 23 MB 00:11 2023-09-30T16:59:48.016 INFO:teuthology.orchestra.run.smithi031.stdout:(11/122): libcephfs-devel-18.0.0-6447.g1d10b717 373 kB/s | 31 kB 00:00 2023-09-30T16:59:48.300 INFO:teuthology.orchestra.run.smithi072.stdout:(16/122): librgw2-18.0.0-6447.g1d10b717.el8.x86 5.2 MB/s | 6.9 MB 00:01 2023-09-30T16:59:48.308 INFO:teuthology.orchestra.run.smithi031.stdout:(12/122): ceph-radosgw-18.0.0-6447.g1d10b717.el 2.2 MB/s | 14 MB 00:06 2023-09-30T16:59:48.350 INFO:teuthology.orchestra.run.smithi031.stdout:(13/122): libcephfs2-18.0.0-6447.g1d10b717.el8. 2.5 MB/s | 839 kB 00:00 2023-09-30T16:59:48.350 INFO:teuthology.orchestra.run.smithi072.stdout:(17/122): python3-ceph-argparse-18.0.0-6447.g1d 897 kB/s | 45 kB 00:00 2023-09-30T16:59:48.383 INFO:teuthology.orchestra.run.smithi031.stdout:(14/122): libcephsqlite-18.0.0-6447.g1d10b717.e 2.4 MB/s | 184 kB 00:00 2023-09-30T16:59:48.457 INFO:teuthology.orchestra.run.smithi031.stdout:(15/122): librados-devel-18.0.0-6447.g1d10b717. 1.3 MB/s | 139 kB 00:00 2023-09-30T16:59:48.559 INFO:teuthology.orchestra.run.smithi031.stdout:(16/122): libradosstriper1-18.0.0-6447.g1d10b71 2.9 MB/s | 519 kB 00:00 2023-09-30T16:59:48.559 INFO:teuthology.orchestra.run.smithi007.stdout:Transaction test succeeded. 2023-09-30T16:59:48.563 INFO:teuthology.orchestra.run.smithi007.stdout:Running transaction 2023-09-30T16:59:48.617 INFO:teuthology.orchestra.run.smithi031.stdout:(17/122): python3-ceph-argparse-18.0.0-6447.g1d 768 kB/s | 45 kB 00:00 2023-09-30T16:59:48.685 INFO:teuthology.orchestra.run.smithi031.stdout:(18/122): python3-ceph-common-18.0.0-6447.g1d10 1.8 MB/s | 125 kB 00:00 2023-09-30T16:59:48.743 INFO:teuthology.orchestra.run.smithi072.stdout:(18/122): ceph-radosgw-18.0.0-6447.g1d10b717.el 2.3 MB/s | 14 MB 00:06 2023-09-30T16:59:48.751 INFO:teuthology.orchestra.run.smithi031.stdout:(19/122): python3-cephfs-18.0.0-6447.g1d10b717. 2.9 MB/s | 197 kB 00:00 2023-09-30T16:59:48.868 INFO:teuthology.orchestra.run.smithi031.stdout:(20/122): python3-rados-18.0.0-6447.g1d10b717.e 3.1 MB/s | 371 kB 00:00 2023-09-30T16:59:48.985 INFO:teuthology.orchestra.run.smithi031.stdout:(21/122): python3-rbd-18.0.0-6447.g1d10b717.el8 3.1 MB/s | 365 kB 00:00 2023-09-30T16:59:49.044 INFO:teuthology.orchestra.run.smithi031.stdout:(22/122): python3-rgw-18.0.0-6447.g1d10b717.el8 1.8 MB/s | 106 kB 00:00 2023-09-30T16:59:49.045 INFO:teuthology.orchestra.run.smithi072.stdout:(19/122): python3-ceph-common-18.0.0-6447.g1d10 181 kB/s | 125 kB 00:00 2023-09-30T16:59:49.071 INFO:teuthology.orchestra.run.smithi072.stdout:(20/122): python3-cephfs-18.0.0-6447.g1d10b717. 600 kB/s | 197 kB 00:00 2023-09-30T16:59:49.103 INFO:teuthology.orchestra.run.smithi031.stdout:(23/122): rbd-fuse-18.0.0-6447.g1d10b717.el8.x8 1.6 MB/s | 94 kB 00:00 2023-09-30T16:59:49.188 INFO:teuthology.orchestra.run.smithi072.stdout:(21/122): python3-rados-18.0.0-6447.g1d10b717.e 2.5 MB/s | 371 kB 00:00 2023-09-30T16:59:49.255 INFO:teuthology.orchestra.run.smithi072.stdout:(22/122): python3-rgw-18.0.0-6447.g1d10b717.el8 1.6 MB/s | 106 kB 00:00 2023-09-30T16:59:49.281 INFO:teuthology.orchestra.run.smithi072.stdout:(23/122): python3-rbd-18.0.0-6447.g1d10b717.el8 1.7 MB/s | 365 kB 00:00 2023-09-30T16:59:49.323 INFO:teuthology.orchestra.run.smithi072.stdout:(24/122): rbd-fuse-18.0.0-6447.g1d10b717.el8.x8 1.4 MB/s | 94 kB 00:00 2023-09-30T16:59:49.407 INFO:teuthology.orchestra.run.smithi072.stdout:(25/122): rbd-nbd-18.0.0-6447.g1d10b717.el8.x86 2.1 MB/s | 180 kB 00:00 2023-09-30T16:59:49.466 INFO:teuthology.orchestra.run.smithi072.stdout:(26/122): ceph-grafana-dashboards-18.0.0-6447.g 395 kB/s | 23 kB 00:00 2023-09-30T16:59:49.541 INFO:teuthology.orchestra.run.smithi072.stdout:(27/122): ceph-mgr-cephadm-18.0.0-6447.g1d10b71 1.7 MB/s | 132 kB 00:00 2023-09-30T16:59:49.945 INFO:teuthology.orchestra.run.smithi031.stdout:(24/122): librgw2-18.0.0-6447.g1d10b717.el8.x86 4.6 MB/s | 6.9 MB 00:01 2023-09-30T16:59:49.959 INFO:teuthology.orchestra.run.smithi072.stdout:(28/122): ceph-mgr-dashboard-18.0.0-6447.g1d10b 4.2 MB/s | 1.8 MB 00:00 2023-09-30T16:59:50.003 INFO:teuthology.orchestra.run.smithi031.stdout:(25/122): rbd-mirror-18.0.0-6447.g1d10b717.el8. 4.0 MB/s | 3.6 MB 00:00 2023-09-30T16:59:50.028 INFO:teuthology.orchestra.run.smithi031.stdout:(26/122): rbd-nbd-18.0.0-6447.g1d10b717.el8.x86 2.1 MB/s | 180 kB 00:00 2023-09-30T16:59:50.079 INFO:teuthology.orchestra.run.smithi031.stdout:(27/122): ceph-grafana-dashboards-18.0.0-6447.g 307 kB/s | 23 kB 00:00 2023-09-30T16:59:50.104 INFO:teuthology.orchestra.run.smithi031.stdout:(28/122): ceph-mgr-cephadm-18.0.0-6447.g1d10b71 1.7 MB/s | 132 kB 00:00 2023-09-30T16:59:50.562 INFO:teuthology.orchestra.run.smithi031.stdout:(29/122): ceph-mgr-dashboard-18.0.0-6447.g1d10b 3.6 MB/s | 1.8 MB 00:00 2023-09-30T16:59:50.618 INFO:teuthology.orchestra.run.smithi072.stdout:(29/122): rbd-mirror-18.0.0-6447.g1d10b717.el8. 2.7 MB/s | 3.6 MB 00:01 2023-09-30T16:59:50.646 INFO:teuthology.orchestra.run.smithi031.stdout:(30/122): ceph-mgr-modules-core-18.0.0-6447.g1d 2.8 MB/s | 242 kB 00:00 2023-09-30T16:59:50.763 INFO:teuthology.orchestra.run.smithi031.stdout:(31/122): ceph-mgr-rook-18.0.0-6447.g1d10b717.e 407 kB/s | 47 kB 00:00 2023-09-30T16:59:50.799 INFO:teuthology.orchestra.run.smithi072.stdout:(30/122): ceph-mgr-modules-core-18.0.0-6447.g1d 1.3 MB/s | 242 kB 00:00 2023-09-30T16:59:50.830 INFO:teuthology.orchestra.run.smithi031.stdout:(32/122): ceph-prometheus-alerts-18.0.0-6447.g1 218 kB/s | 15 kB 00:00 2023-09-30T16:59:50.914 INFO:teuthology.orchestra.run.smithi031.stdout:(33/122): ceph-volume-18.0.0-6447.g1d10b717.el8 3.1 MB/s | 261 kB 00:00 2023-09-30T16:59:50.988 INFO:teuthology.orchestra.run.smithi031.stdout:(34/122): cephadm-18.0.0-6447.g1d10b717.el8.noa 2.4 MB/s | 185 kB 00:00 2023-09-30T16:59:51.064 INFO:teuthology.orchestra.run.smithi031.stdout:(35/122): gperftools-libs-2.7-9.el8.x86_64.rpm 4.0 MB/s | 306 kB 00:00 2023-09-30T16:59:51.098 INFO:teuthology.orchestra.run.smithi031.stdout:(36/122): liboath-2.6.2-3.el8.x86_64.rpm 1.7 MB/s | 59 kB 00:00 2023-09-30T16:59:51.148 INFO:teuthology.orchestra.run.smithi031.stdout:(37/122): libunwind-1.3.1-3.el8.x86_64.rpm 1.5 MB/s | 75 kB 00:00 2023-09-30T16:59:51.190 INFO:teuthology.orchestra.run.smithi031.stdout:(38/122): python3-asyncssh-2.7.0-2.el8.noarch.r 11 MB/s | 476 kB 00:00 2023-09-30T16:59:51.215 INFO:teuthology.orchestra.run.smithi031.stdout:(39/122): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 1.7 MB/s | 44 kB 00:00 2023-09-30T16:59:51.241 INFO:teuthology.orchestra.run.smithi031.stdout:(40/122): python3-beautifulsoup4-4.6.3-2.el8.1. 7.3 MB/s | 185 kB 00:00 2023-09-30T16:59:51.266 INFO:teuthology.orchestra.run.smithi031.stdout:(41/122): python3-cachetools-3.1.1-4.el8.noarch 1.3 MB/s | 33 kB 00:00 2023-09-30T16:59:51.291 INFO:teuthology.orchestra.run.smithi031.stdout:(42/122): python3-certifi-2018.10.15-7.el8.noar 656 kB/s | 16 kB 00:00 2023-09-30T16:59:51.392 INFO:teuthology.orchestra.run.smithi031.stdout:(43/122): ceph-mgr-diskprediction-local-18.0.0- 5.7 MB/s | 7.4 MB 00:01 2023-09-30T16:59:51.417 INFO:teuthology.orchestra.run.smithi031.stdout:(44/122): python3-cheroot-8.5.2-1.el8.noarch.rp 1.3 MB/s | 173 kB 00:00 2023-09-30T16:59:51.450 INFO:teuthology.orchestra.run.smithi031.stdout:(45/122): python3-google-auth-1.1.1-10.el8.noar 2.4 MB/s | 81 kB 00:00 2023-09-30T16:59:51.475 INFO:teuthology.orchestra.run.smithi031.stdout:(46/122): python3-jaraco-6.2-6.el8.noarch.rpm 444 kB/s | 11 kB 00:00 2023-09-30T16:59:51.509 INFO:teuthology.orchestra.run.smithi031.stdout:(47/122): python3-cherrypy-18.4.0-1.el8.noarch. 3.2 MB/s | 384 kB 00:00 2023-09-30T16:59:51.526 INFO:teuthology.orchestra.run.smithi031.stdout:(48/122): python3-jaraco-functools-2.0-4.el8.no 350 kB/s | 18 kB 00:00 2023-09-30T16:59:51.560 INFO:teuthology.orchestra.run.smithi031.stdout:(49/122): python3-logutils-0.3.5-11.el8.noarch. 1.4 MB/s | 49 kB 00:00 2023-09-30T16:59:51.572 INFO:teuthology.orchestra.run.smithi134.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-30T16:59:51.573 INFO:teuthology.orchestra.run.smithi134.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-09-30T16:59:51.618 INFO:teuthology.orchestra.run.smithi031.stdout:(50/122): python3-kubernetes-11.0.0-6.el8.noarc 11 MB/s | 1.2 MB 00:00 2023-09-30T16:59:51.635 INFO:teuthology.orchestra.run.smithi072.stdout:(31/122): ceph-test-18.0.0-6447.g1d10b717.el8.x 7.3 MB/s | 49 MB 00:06 2023-09-30T16:59:51.644 INFO:teuthology.orchestra.run.smithi031.stdout:(51/122): python3-more-itertools-7.2.0-3.el8.no 701 kB/s | 59 kB 00:00 2023-09-30T16:59:51.662 INFO:teuthology.orchestra.run.smithi072.stdout:(32/122): ceph-mgr-rook-18.0.0-6447.g1d10b717.e 55 kB/s | 47 kB 00:00 2023-09-30T16:59:51.669 INFO:teuthology.orchestra.run.smithi031.stdout:(52/122): python3-natsort-7.1.1-2.el8.noarch.rp 1.2 MB/s | 60 kB 00:00 2023-09-30T16:59:51.680 INFO:teuthology.orchestra.run.smithi072.stdout:(33/122): ceph-prometheus-alerts-18.0.0-6447.g1 333 kB/s | 15 kB 00:00 2023-09-30T16:59:51.694 INFO:teuthology.orchestra.run.smithi031.stdout:(53/122): python3-pecan-1.3.2-9.el8.noarch.rpm 5.5 MB/s | 283 kB 00:00 2023-09-30T16:59:51.713 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2023-09-30T16:59:51.720 INFO:teuthology.orchestra.run.smithi031.stdout:(54/122): python3-portend-2.6-1.el8.noarch.rpm 310 kB/s | 16 kB 00:00 2023-09-30T16:59:51.724 INFO:teuthology.orchestra.run.smithi134.stdout:======================================================================================================================= 2023-09-30T16:59:51.724 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2023-09-30T16:59:51.725 INFO:teuthology.orchestra.run.smithi134.stdout:======================================================================================================================= 2023-09-30T16:59:51.725 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2023-09-30T16:59:51.725 INFO:teuthology.orchestra.run.smithi134.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-09-30T16:59:51.725 INFO:teuthology.orchestra.run.smithi134.stdout: ceph x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 6.4 k 2023-09-30T16:59:51.725 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 5.4 M 2023-09-30T16:59:51.725 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 918 k 2023-09-30T16:59:51.725 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 167 k 2023-09-30T16:59:51.725 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 1.6 M 2023-09-30T16:59:51.725 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm noarch 2:18.0.0-6447.g1d10b717.el8 ceph-noarch 132 k 2023-09-30T16:59:51.725 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard noarch 2:18.0.0-6447.g1d10b717.el8 ceph-noarch 1.8 M 2023-09-30T16:59:51.725 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local noarch 2:18.0.0-6447.g1d10b717.el8 ceph-noarch 7.4 M 2023-09-30T16:59:51.726 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook noarch 2:18.0.0-6447.g1d10b717.el8 ceph-noarch 47 k 2023-09-30T16:59:51.726 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 14 M 2023-09-30T16:59:51.726 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 49 M 2023-09-30T16:59:51.726 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-volume noarch 2:18.0.0-6447.g1d10b717.el8 ceph-noarch 261 k 2023-09-30T16:59:51.726 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm noarch 2:18.0.0-6447.g1d10b717.el8 ceph-noarch 185 k 2023-09-30T16:59:51.726 INFO:teuthology.orchestra.run.smithi134.stdout: elfutils-libelf-devel x86_64 0.186-1.el8 rhel-8-for-x86_64-baseos-rpms 60 k 2023-09-30T16:59:51.726 INFO:teuthology.orchestra.run.smithi134.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-09-30T16:59:51.726 INFO:teuthology.orchestra.run.smithi134.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-09-30T16:59:51.726 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 31 k 2023-09-30T16:59:51.726 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2 x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 839 k 2023-09-30T16:59:51.726 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 139 k 2023-09-30T16:59:51.727 INFO:teuthology.orchestra.run.smithi134.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-09-30T16:59:51.727 INFO:teuthology.orchestra.run.smithi134.stdout: libuuid-devel x86_64 2.32.1-35.el8 rhel-8-for-x86_64-baseos-rpms 98 k 2023-09-30T16:59:51.727 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-devel x86_64 1:1.1.1k-7.el8_6 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-09-30T16:59:51.727 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 197 k 2023-09-30T16:59:51.727 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 371 k 2023-09-30T16:59:51.727 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 365 k 2023-09-30T16:59:51.727 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 106 k 2023-09-30T16:59:51.727 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 94 k 2023-09-30T16:59:51.727 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 3.6 M 2023-09-30T16:59:51.727 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 180 k 2023-09-30T16:59:51.727 INFO:teuthology.orchestra.run.smithi134.stdout: xfsprogs-devel x86_64 5.0.0-10.el8 rhel-8-for-x86_64-baseos-rpms 72 k 2023-09-30T16:59:51.728 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrading: 2023-09-30T16:59:51.728 INFO:teuthology.orchestra.run.smithi134.stdout: librados2 x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 3.7 M 2023-09-30T16:59:51.728 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1 x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 3.7 M 2023-09-30T16:59:51.728 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2023-09-30T16:59:51.728 INFO:teuthology.orchestra.run.smithi134.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-09-30T16:59:51.728 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 23 M 2023-09-30T16:59:51.728 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards noarch 2:18.0.0-6447.g1d10b717.el8 ceph-noarch 23 k 2023-09-30T16:59:51.728 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 2.3 M 2023-09-30T16:59:51.728 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core noarch 2:18.0.0-6447.g1d10b717.el8 ceph-noarch 242 k 2023-09-30T16:59:51.728 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 4.6 M 2023-09-30T16:59:51.728 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 18 M 2023-09-30T16:59:51.728 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts noarch 2:18.0.0-6447.g1d10b717.el8 ceph-noarch 15 k 2023-09-30T16:59:51.729 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 24 k 2023-09-30T16:59:51.729 INFO:teuthology.orchestra.run.smithi134.stdout: fuse x86_64 2.9.7-15.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-09-30T16:59:51.729 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-09-30T16:59:51.729 INFO:teuthology.orchestra.run.smithi134.stdout: jq x86_64 1.6-3.el8 rhel-8-for-x86_64-appstream-rpms 202 k 2023-09-30T16:59:51.729 INFO:teuthology.orchestra.run.smithi134.stdout: keyutils-libs-devel x86_64 1.5.10-9.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-09-30T16:59:51.729 INFO:teuthology.orchestra.run.smithi134.stdout: krb5-devel x86_64 1.18.2-14.el8 rhel-8-for-x86_64-baseos-rpms 560 k 2023-09-30T16:59:51.729 INFO:teuthology.orchestra.run.smithi134.stdout: libcephsqlite x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 184 k 2023-09-30T16:59:51.729 INFO:teuthology.orchestra.run.smithi134.stdout: libcom_err-devel x86_64 1.45.6-4.el8 rhel-8-for-x86_64-baseos-rpms 39 k 2023-09-30T16:59:51.729 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 644 k 2023-09-30T16:59:51.729 INFO:teuthology.orchestra.run.smithi134.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-09-30T16:59:51.729 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath x86_64 8.5.0-10.1.el8_6 rhel-8-for-x86_64-baseos-rpms 171 k 2023-09-30T16:59:51.730 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-09-30T16:59:51.730 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1 x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 519 k 2023-09-30T16:59:51.730 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka x86_64 0.11.4-3.el8 rhel-8-for-x86_64-appstream-rpms 354 k 2023-09-30T16:59:51.730 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2 x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 6.9 M 2023-09-30T16:59:51.730 INFO:teuthology.orchestra.run.smithi134.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-09-30T16:59:51.730 INFO:teuthology.orchestra.run.smithi134.stdout: libsepol-devel x86_64 2.9-3.el8 rhel-8-for-x86_64-baseos-rpms 87 k 2023-09-30T16:59:51.730 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-09-30T16:59:51.730 INFO:teuthology.orchestra.run.smithi134.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-09-30T16:59:51.730 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-09-30T16:59:51.730 INFO:teuthology.orchestra.run.smithi134.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-09-30T16:59:51.730 INFO:teuthology.orchestra.run.smithi134.stdout: openblas x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-09-30T16:59:51.730 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-threads x86_64 0.3.15-3.el8 rhel-8-for-x86_64-appstream-rpms 4.9 M 2023-09-30T16:59:51.731 INFO:teuthology.orchestra.run.smithi134.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-09-30T16:59:51.731 INFO:teuthology.orchestra.run.smithi134.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-09-30T16:59:51.731 INFO:teuthology.orchestra.run.smithi134.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-09-30T16:59:51.731 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-09-30T16:59:51.731 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel noarch 2.5.1-7.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-09-30T16:59:51.731 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-09-30T16:59:51.731 INFO:teuthology.orchestra.run.smithi134.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-09-30T16:59:51.731 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-09-30T16:59:51.731 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 45 k 2023-09-30T16:59:51.731 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common x86_64 2:18.0.0-6447.g1d10b717.el8 ceph 125 k 2023-09-30T16:59:51.732 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-09-30T16:59:51.732 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cffi x86_64 1.11.5-5.el8 rhel-8-for-x86_64-baseos-rpms 238 k 2023-09-30T16:59:51.732 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-09-30T16:59:51.732 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-09-30T16:59:51.732 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cryptography x86_64 3.2.1-5.el8 rhel-8-for-x86_64-baseos-rpms 559 k 2023-09-30T16:59:51.732 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-09-30T16:59:51.732 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-09-30T16:59:51.732 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-09-30T16:59:51.732 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2 noarch 2.10.1-3.el8 rhel-8-for-x86_64-appstream-rpms 538 k 2023-09-30T16:59:51.732 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-09-30T16:59:51.732 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-09-30T16:59:51.733 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-09-30T16:59:51.733 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-09-30T16:59:51.733 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-09-30T16:59:51.733 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-09-30T16:59:51.733 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-09-30T16:59:51.733 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-09-30T16:59:51.733 INFO:teuthology.orchestra.run.smithi134.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-09-30T16:59:51.733 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-09-30T16:59:51.733 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-09-30T16:59:51.733 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-09-30T16:59:51.733 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-09-30T16:59:51.734 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-09-30T16:59:51.734 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-09-30T16:59:51.734 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 rhel-8-for-x86_64-appstream-rpms 103 k 2023-09-30T16:59:51.734 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-09-30T16:59:51.734 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-09-30T16:59:51.734 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pycparser noarch 2.14-14.el8 rhel-8-for-x86_64-baseos-rpms 109 k 2023-09-30T16:59:51.734 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-09-30T16:59:51.734 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-09-30T16:59:51.734 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-09-30T16:59:51.735 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-09-30T16:59:51.735 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-09-30T16:59:51.735 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy x86_64 1.0.0-21.module+el8.5.0+10916+41bd434d rhel-8-for-x86_64-appstream-rpms 14 M 2023-09-30T16:59:51.735 INFO:teuthology.orchestra.run.smithi134.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-09-30T16:59:51.735 INFO:teuthology.orchestra.run.smithi134.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-09-30T16:59:51.735 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-09-30T16:59:51.735 INFO:teuthology.orchestra.run.smithi134.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-09-30T16:59:51.735 INFO:teuthology.orchestra.run.smithi134.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-09-30T16:59:51.735 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-09-30T16:59:51.735 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-09-30T16:59:51.735 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-09-30T16:59:51.736 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-09-30T16:59:51.736 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-09-30T16:59:51.736 INFO:teuthology.orchestra.run.smithi134.stdout: socat x86_64 1.7.4.1-1.el8 rhel-8-for-x86_64-appstream-rpms 323 k 2023-09-30T16:59:51.736 INFO:teuthology.orchestra.run.smithi134.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-09-30T16:59:51.736 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-09-30T16:59:51.736 INFO:teuthology.orchestra.run.smithi134.stdout: zlib-devel x86_64 1.2.11-18.el8_5 rhel-8-for-x86_64-baseos-rpms 58 k 2023-09-30T16:59:51.736 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-09-30T16:59:51.736 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2023-09-30T16:59:51.736 INFO:teuthology.orchestra.run.smithi134.stdout:======================================================================================================================= 2023-09-30T16:59:51.736 INFO:teuthology.orchestra.run.smithi134.stdout:Install 120 Packages 2023-09-30T16:59:51.736 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrade 2 Packages 2023-09-30T16:59:51.736 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-09-30T16:59:51.737 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 200 M 2023-09-30T16:59:51.737 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2023-09-30T16:59:51.745 INFO:teuthology.orchestra.run.smithi031.stdout:(55/122): python3-repoze-lru-0.7-6.el8.noarch.r 670 kB/s | 34 kB 00:00 2023-09-30T16:59:51.770 INFO:teuthology.orchestra.run.smithi031.stdout:(56/122): python3-routes-2.4.1-12.el8.noarch.rp 3.8 MB/s | 196 kB 00:00 2023-09-30T16:59:51.796 INFO:teuthology.orchestra.run.smithi031.stdout:(57/122): python3-rsa-4.9-2.el8.noarch.rpm 1.3 MB/s | 64 kB 00:00 2023-09-30T16:59:51.821 INFO:teuthology.orchestra.run.smithi031.stdout:(58/122): python3-simplegeneric-0.8.1-17.el8.no 374 kB/s | 19 kB 00:00 2023-09-30T16:59:51.830 INFO:teuthology.orchestra.run.smithi072.stdout:(34/122): ceph-mgr-diskprediction-local-18.0.0- 3.9 MB/s | 7.4 MB 00:01 2023-09-30T16:59:51.846 INFO:teuthology.orchestra.run.smithi031.stdout:(59/122): python3-singledispatch-3.4.0.3-18.el8 478 kB/s | 24 kB 00:00 2023-09-30T16:59:51.856 INFO:teuthology.orchestra.run.smithi072.stdout:(35/122): cephadm-18.0.0-6447.g1d10b717.el8.noa 1.0 MB/s | 185 kB 00:00 2023-09-30T16:59:51.871 INFO:teuthology.orchestra.run.smithi031.stdout:(60/122): python3-tempora-1.14.1-5.el8.noarch.r 582 kB/s | 29 kB 00:00 2023-09-30T16:59:51.890 INFO:teuthology.orchestra.run.smithi072.stdout:(36/122): ceph-volume-18.0.0-6447.g1d10b717.el8 1.1 MB/s | 261 kB 00:00 2023-09-30T16:59:51.896 INFO:teuthology.orchestra.run.smithi031.stdout:(61/122): python3-trustme-0.6.0-4.el8.noarch.rp 550 kB/s | 27 kB 00:00 2023-09-30T16:59:51.899 INFO:teuthology.orchestra.run.smithi134.stdout:(1/122): ceph-18.0.0-6447.g1d10b717.el8.x86_64. 49 kB/s | 6.4 kB 00:00 2023-09-30T16:59:51.922 INFO:teuthology.orchestra.run.smithi031.stdout:(62/122): python3-waitress-1.4.3-1.el8.noarch.r 5.0 MB/s | 255 kB 00:00 2023-09-30T16:59:51.947 INFO:teuthology.orchestra.run.smithi031.stdout:(63/122): python3-webob-1.8.5-1.el8.1.noarch.rp 4.9 MB/s | 251 kB 00:00 2023-09-30T16:59:51.972 INFO:teuthology.orchestra.run.smithi031.stdout:(64/122): python3-websocket-client-0.56.0-5.el8 1.2 MB/s | 61 kB 00:00 2023-09-30T16:59:51.998 INFO:teuthology.orchestra.run.smithi031.stdout:(65/122): python3-webtest-2.0.33-1.el8.noarch.r 1.7 MB/s | 85 kB 00:00 2023-09-30T16:59:52.055 INFO:teuthology.orchestra.run.smithi031.stdout:(66/122): python3-zc-lockfile-2.0-2.el8.noarch. 280 kB/s | 23 kB 00:00 2023-09-30T16:59:52.090 INFO:teuthology.orchestra.run.smithi031.stdout:(67/122): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.0 MB/s | 70 kB 00:00 2023-09-30T16:59:52.116 INFO:teuthology.orchestra.run.smithi134.stdout:(2/122): ceph-fuse-18.0.0-6447.g1d10b717.el8.x8 4.1 MB/s | 918 kB 00:00 2023-09-30T16:59:52.175 INFO:teuthology.orchestra.run.smithi134.stdout:(3/122): ceph-immutable-object-cache-18.0.0-644 2.8 MB/s | 167 kB 00:00 2023-09-30T16:59:52.199 INFO:teuthology.orchestra.run.smithi031.stdout:(68/122): thrift-0.13.0-2.el8.x86_64.rpm 8.7 MB/s | 1.7 MB 00:00 2023-09-30T16:59:52.224 INFO:teuthology.orchestra.run.smithi031.stdout:(69/122): librabbitmq-0.9.0-3.el8.x86_64.rpm 351 kB/s | 47 kB 00:00 2023-09-30T16:59:52.274 INFO:teuthology.orchestra.run.smithi031.stdout:(70/122): python3-jwt-1.6.1-2.el8.noarch.rpm 1.0 MB/s | 43 kB 00:00 2023-09-30T16:59:52.298 INFO:teuthology.orchestra.run.smithi072.stdout:(37/122): liboath-2.6.2-3.el8.x86_64.rpm 133 kB/s | 59 kB 00:00 2023-09-30T16:59:52.299 INFO:teuthology.orchestra.run.smithi031.stdout:(71/122): libselinux-devel-2.9-5.el8.x86_64.rpm 1.9 MB/s | 200 kB 00:00 2023-09-30T16:59:52.324 INFO:teuthology.orchestra.run.smithi072.stdout:(38/122): libunwind-1.3.1-3.el8.x86_64.rpm 173 kB/s | 75 kB 00:00 2023-09-30T16:59:52.324 INFO:teuthology.orchestra.run.smithi031.stdout:(72/122): pcre2-utf32-10.32-2.el8.x86_64.rpm 4.3 MB/s | 220 kB 00:00 2023-09-30T16:59:52.350 INFO:teuthology.orchestra.run.smithi031.stdout:(73/122): keyutils-libs-devel-1.5.10-9.el8.x86_ 959 kB/s | 48 kB 00:00 2023-09-30T16:59:52.367 INFO:teuthology.orchestra.run.smithi031.stdout:(74/122): libsepol-devel-2.9-3.el8.x86_64.rpm 2.0 MB/s | 87 kB 00:00 2023-09-30T16:59:52.392 INFO:teuthology.orchestra.run.smithi031.stdout:(75/122): python3-requests-oauthlib-1.0.0-1.el8 1.0 MB/s | 43 kB 00:00 2023-09-30T16:59:52.416 INFO:teuthology.orchestra.run.smithi072.stdout:(39/122): gperftools-libs-2.7-9.el8.x86_64.rpm 523 kB/s | 306 kB 00:00 2023-09-30T16:59:52.417 INFO:teuthology.orchestra.run.smithi031.stdout:(76/122): python3-pycparser-2.14-14.el8.noarch. 2.1 MB/s | 109 kB 00:00 2023-09-30T16:59:52.442 INFO:teuthology.orchestra.run.smithi031.stdout:(77/122): pcre2-utf16-10.32-2.el8.x86_64.rpm 4.5 MB/s | 229 kB 00:00 2023-09-30T16:59:52.500 INFO:teuthology.orchestra.run.smithi072.stdout:(40/122): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 248 kB/s | 44 kB 00:00 2023-09-30T16:59:52.507 INFO:teuthology.orchestra.run.smithi031.stdout:(78/122): krb5-devel-1.18.2-14.el8.x86_64.rpm 6.1 MB/s | 560 kB 00:00 2023-09-30T16:59:52.533 INFO:teuthology.orchestra.run.smithi134.stdout:(4/122): ceph-mds-18.0.0-6447.g1d10b717.el8.x86 6.4 MB/s | 2.3 MB 00:00 2023-09-30T16:59:52.535 INFO:teuthology.orchestra.run.smithi031.stdout:(79/122): libaio-devel-0.3.112-1.el8.x86_64.rpm 203 kB/s | 19 kB 00:00 2023-09-30T16:59:52.560 INFO:teuthology.orchestra.run.smithi031.stdout:(80/122): python3-oauthlib-2.1.0-1.el8.noarch.r 2.9 MB/s | 155 kB 00:00 2023-09-30T16:59:52.594 INFO:teuthology.orchestra.run.smithi031.stdout:(81/122): python3-cryptography-3.2.1-5.el8.x86_ 9.3 MB/s | 559 kB 00:00 2023-09-30T16:59:52.611 INFO:teuthology.orchestra.run.smithi031.stdout:(82/122): libverto-devel-0.3.0-5.el8.x86_64.rpm 355 kB/s | 18 kB 00:00 2023-09-30T16:59:52.644 INFO:teuthology.orchestra.run.smithi031.stdout:(83/122): pcre2-devel-10.32-2.el8.x86_64.rpm 12 MB/s | 605 kB 00:00 2023-09-30T16:59:52.650 INFO:teuthology.orchestra.run.smithi072.stdout:(41/122): python3-beautifulsoup4-4.6.3-2.el8.1. 791 kB/s | 185 kB 00:00 2023-09-30T16:59:52.670 INFO:teuthology.orchestra.run.smithi031.stdout:(84/122): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.0 MB/s | 238 kB 00:00 2023-09-30T16:59:52.712 INFO:teuthology.orchestra.run.smithi031.stdout:(85/122): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.7 MB/s | 72 kB 00:00 2023-09-30T16:59:52.737 INFO:teuthology.orchestra.run.smithi031.stdout:(86/122): fuse-2.9.7-15.el8.x86_64.rpm 3.3 MB/s | 83 kB 00:00 2023-09-30T16:59:52.742 INFO:teuthology.orchestra.run.smithi072.stdout:(42/122): python3-cachetools-3.1.1-4.el8.noarch 136 kB/s | 33 kB 00:00 2023-09-30T16:59:52.787 INFO:teuthology.orchestra.run.smithi031.stdout:(87/122): openssl-devel-1.1.1k-7.el8_6.x86_64.r 16 MB/s | 2.3 MB 00:00 2023-09-30T16:59:52.793 INFO:teuthology.orchestra.run.smithi072.stdout:(43/122): python3-certifi-2018.10.15-7.el8.noar 114 kB/s | 16 kB 00:00 2023-09-30T16:59:52.804 INFO:teuthology.orchestra.run.smithi031.stdout:(88/122): elfutils-libelf-devel-0.186-1.el8.x86 894 kB/s | 60 kB 00:00 2023-09-30T16:59:52.819 INFO:teuthology.orchestra.run.smithi072.stdout:(44/122): python3-asyncssh-2.7.0-2.el8.noarch.r 915 kB/s | 476 kB 00:00 2023-09-30T16:59:52.829 INFO:teuthology.orchestra.run.smithi031.stdout:(89/122): libuuid-devel-2.32.1-35.el8.x86_64.rp 2.3 MB/s | 98 kB 00:00 2023-09-30T16:59:52.834 INFO:teuthology.orchestra.run.smithi134.stdout:(5/122): ceph-mgr-18.0.0-6447.g1d10b717.el8.x86 5.4 MB/s | 1.6 MB 00:00 2023-09-30T16:59:52.854 INFO:teuthology.orchestra.run.smithi031.stdout:(90/122): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2023-09-30T16:59:52.880 INFO:teuthology.orchestra.run.smithi031.stdout:(91/122): libcom_err-devel-1.45.6-4.el8.x86_64. 770 kB/s | 39 kB 00:00 2023-09-30T16:59:52.913 INFO:teuthology.orchestra.run.smithi031.stdout:(92/122): libgfortran-8.5.0-10.1.el8_6.x86_64.r 11 MB/s | 644 kB 00:00 2023-09-30T16:59:52.960 INFO:teuthology.orchestra.run.smithi031.stdout:(93/122): libquadmath-8.5.0-10.1.el8_6.x86_64.r 2.1 MB/s | 171 kB 00:00 2023-09-30T16:59:52.998 INFO:teuthology.orchestra.run.smithi031.stdout:(94/122): python3-pyasn1-modules-0.3.7-6.el8.no 2.9 MB/s | 110 kB 00:00 2023-09-30T16:59:53.011 INFO:teuthology.orchestra.run.smithi072.stdout:(45/122): python3-google-auth-1.1.1-10.el8.noar 423 kB/s | 81 kB 00:00 2023-09-30T16:59:53.031 INFO:teuthology.orchestra.run.smithi031.stdout:(95/122): python3-pytz-2017.2-9.el8.noarch.rpm 1.6 MB/s | 54 kB 00:00 2023-09-30T16:59:53.042 INFO:teuthology.orchestra.run.smithi134.stdout:(6/122): ceph-base-18.0.0-6447.g1d10b717.el8.x8 4.2 MB/s | 5.4 MB 00:01 2023-09-30T16:59:53.136 INFO:teuthology.orchestra.run.smithi072.stdout:(46/122): python3-jaraco-6.2-6.el8.noarch.rpm 89 kB/s | 11 kB 00:00 2023-09-30T16:59:53.220 INFO:teuthology.orchestra.run.smithi072.stdout:(47/122): python3-cheroot-8.5.2-1.el8.noarch.rp 362 kB/s | 173 kB 00:00 2023-09-30T16:59:53.308 INFO:teuthology.orchestra.run.smithi007.stdout: Preparing : 1/1 2023-09-30T16:59:53.356 INFO:teuthology.orchestra.run.smithi072.stdout:(48/122): python3-jaraco-functools-2.0-4.el8.no 80 kB/s | 18 kB 00:00 2023-09-30T16:59:53.459 INFO:teuthology.orchestra.run.smithi134.stdout:(7/122): ceph-mon-18.0.0-6447.g1d10b717.el8.x86 7.4 MB/s | 4.6 MB 00:00 2023-09-30T16:59:53.482 INFO:teuthology.orchestra.run.smithi031.stdout:(96/122): ceph-test-18.0.0-6447.g1d10b717.el8.x 5.9 MB/s | 49 MB 00:08 2023-09-30T16:59:53.552 INFO:teuthology.orchestra.run.smithi072.stdout:(49/122): python3-logutils-0.3.5-11.el8.noarch. 254 kB/s | 49 kB 00:00 2023-09-30T16:59:53.553 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/124 2023-09-30T16:59:53.553 INFO:teuthology.orchestra.run.smithi031.stdout:(97/122): lttng-ust-2.8.1-11.el8.x86_64.rpm 536 kB/s | 259 kB 00:00 2023-09-30T16:59:53.565 INFO:teuthology.orchestra.run.smithi031.stdout:(98/122): python3-markupsafe-0.23-19.el8.x86_64 933 kB/s | 39 kB 00:00 2023-09-30T16:59:53.599 INFO:teuthology.orchestra.run.smithi031.stdout:(99/122): socat-1.7.4.1-1.el8.x86_64.rpm 2.7 MB/s | 323 kB 00:00 2023-09-30T16:59:53.649 INFO:teuthology.orchestra.run.smithi031.stdout:(100/122): bison-3.0.4-10.el8.x86_64.rpm 8.1 MB/s | 688 kB 00:00 2023-09-30T16:59:53.673 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/124 2023-09-30T16:59:53.682 INFO:teuthology.orchestra.run.smithi031.stdout:(101/122): python3-jinja2-2.10.1-3.el8.noarch.r 6.3 MB/s | 538 kB 00:00 2023-09-30T16:59:53.708 INFO:teuthology.orchestra.run.smithi031.stdout:(102/122): python3-mako-1.0.6-13.el8.noarch.rpm 2.6 MB/s | 157 kB 00:00 2023-09-30T16:59:53.715 INFO:teuthology.orchestra.run.smithi072.stdout:(50/122): python3-kubernetes-11.0.0-6.el8.noarc 2.4 MB/s | 1.2 MB 00:00 2023-09-30T16:59:53.733 INFO:teuthology.orchestra.run.smithi031.stdout:(103/122): oniguruma-6.8.2-2.el8.x86_64.rpm 3.7 MB/s | 187 kB 00:00 2023-09-30T16:59:53.749 INFO:teuthology.orchestra.run.smithi072.stdout:(51/122): python3-more-itertools-7.2.0-3.el8.no 292 kB/s | 59 kB 00:00 2023-09-30T16:59:53.775 INFO:teuthology.orchestra.run.smithi031.stdout:(104/122): automake-1.16.1-7.el8.noarch.rpm 10 MB/s | 713 kB 00:00 2023-09-30T16:59:53.815 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/124 2023-09-30T16:59:53.817 INFO:teuthology.orchestra.run.smithi031.stdout:(105/122): python3-jsonpatch-1.21-2.el8.noarch. 639 kB/s | 27 kB 00:00 2023-09-30T16:59:53.859 INFO:teuthology.orchestra.run.smithi031.stdout:(106/122): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-09-30T16:59:53.910 INFO:teuthology.orchestra.run.smithi134.stdout:(8/122): ceph-common-18.0.0-6447.g1d10b717.el8. 11 MB/s | 23 MB 00:02 2023-09-30T16:59:53.916 INFO:teuthology.orchestra.run.smithi072.stdout:(52/122): python3-natsort-7.1.1-2.el8.noarch.rp 300 kB/s | 60 kB 00:00 2023-09-30T16:59:53.923 INFO:teuthology.orchestra.run.smithi031.stdout:(107/122): python3-prettytable-0.7.2-14.el8.noa 682 kB/s | 44 kB 00:00 2023-09-30T16:59:53.961 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/124 2023-09-30T16:59:53.968 INFO:teuthology.orchestra.run.smithi134.stdout:(9/122): ceph-selinux-18.0.0-6447.g1d10b717.el8 419 kB/s | 24 kB 00:00 2023-09-30T16:59:54.025 INFO:teuthology.orchestra.run.smithi072.stdout:(53/122): python3-pecan-1.3.2-9.el8.noarch.rpm 1.0 MB/s | 283 kB 00:00 2023-09-30T16:59:54.034 INFO:teuthology.orchestra.run.smithi031.stdout:(108/122): python3-babel-2.5.1-7.el8.noarch.rpm 16 MB/s | 4.8 MB 00:00 2023-09-30T16:59:54.076 INFO:teuthology.orchestra.run.smithi072.stdout:(54/122): python3-portend-2.6-1.el8.noarch.rpm 98 kB/s | 16 kB 00:00 2023-09-30T16:59:54.084 INFO:teuthology.orchestra.run.smithi031.stdout:(109/122): python3-werkzeug-0.12.2-4.el8.noarch 9.0 MB/s | 457 kB 00:00 2023-09-30T16:59:54.168 INFO:teuthology.orchestra.run.smithi031.stdout:(110/122): python3-numpy-1.14.3-10.el8.x86_64.r 15 MB/s | 3.7 MB 00:00 2023-09-30T16:59:54.173 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/124 2023-09-30T16:59:54.193 INFO:teuthology.orchestra.run.smithi031.stdout:(111/122): python3-numpy-f2py-1.14.3-10.el8.x86 2.0 MB/s | 225 kB 00:00 2023-09-30T16:59:54.293 INFO:teuthology.orchestra.run.smithi072.stdout:(55/122): python3-repoze-lru-0.7-6.el8.noarch.r 126 kB/s | 34 kB 00:00 2023-09-30T16:59:54.336 INFO:teuthology.orchestra.run.smithi031.stdout:(112/122): python3-scipy-1.0.0-21.module+el8.5. 9.6 MB/s | 14 MB 00:01 2023-09-30T16:59:54.385 INFO:teuthology.orchestra.run.smithi031.stdout:(113/122): python3-pyasn1-0.3.7-6.el8.noarch.rp 585 kB/s | 126 kB 00:00 2023-09-30T16:59:54.416 INFO:teuthology.orchestra.run.smithi072.stdout:(56/122): python3-routes-2.4.1-12.el8.noarch.rp 619 kB/s | 196 kB 00:00 2023-09-30T16:59:54.416 INFO:teuthology.orchestra.run.smithi031.stdout:(114/122): python3-jsonpointer-1.10-11.el8.noar 92 kB/s | 20 kB 00:00 2023-09-30T16:59:54.436 INFO:teuthology.orchestra.run.smithi031.stdout:(115/122): python3-pyOpenSSL-19.0.0-1.el8.noarc 1.0 MB/s | 103 kB 00:00 2023-09-30T16:59:54.478 INFO:teuthology.orchestra.run.smithi031.stdout:(116/122): libtool-2.4.6-25.el8.x86_64.rpm 7.4 MB/s | 709 kB 00:00 2023-09-30T16:59:54.520 INFO:teuthology.orchestra.run.smithi031.stdout:(117/122): jq-1.6-3.el8.x86_64.rpm 4.7 MB/s | 202 kB 00:00 2023-09-30T16:59:54.536 INFO:teuthology.orchestra.run.smithi072.stdout:(57/122): python3-cherrypy-18.4.0-1.el8.noarch. 221 kB/s | 384 kB 00:01 2023-09-30T16:59:54.553 INFO:teuthology.orchestra.run.smithi072.stdout:(58/122): python3-simplegeneric-0.8.1-17.el8.no 118 kB/s | 19 kB 00:00 2023-09-30T16:59:54.562 INFO:teuthology.orchestra.run.smithi031.stdout:(118/122): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-09-30T16:59:54.604 INFO:teuthology.orchestra.run.smithi072.stdout:(59/122): python3-rsa-4.9-2.el8.noarch.rpm 207 kB/s | 64 kB 00:00 2023-09-30T16:59:54.606 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/124 2023-09-30T16:59:54.663 INFO:teuthology.orchestra.run.smithi031.stdout:(119/122): openblas-threads-0.3.15-3.el8.x86_64 19 MB/s | 4.9 MB 00:00 2023-09-30T16:59:54.713 INFO:teuthology.orchestra.run.smithi072.stdout:(60/122): python3-tempora-1.14.1-5.el8.noarch.r 184 kB/s | 29 kB 00:00 2023-09-30T16:59:54.729 INFO:teuthology.orchestra.run.smithi031.stdout:(120/122): openblas-0.3.15-3.el8.x86_64.rpm 16 MB/s | 4.7 MB 00:00 2023-09-30T16:59:54.738 INFO:teuthology.orchestra.run.smithi072.stdout:(61/122): python3-singledispatch-3.4.0.3-18.el8 118 kB/s | 24 kB 00:00 2023-09-30T16:59:54.763 INFO:teuthology.orchestra.run.smithi072.stdout:(62/122): python3-trustme-0.6.0-4.el8.noarch.rp 173 kB/s | 27 kB 00:00 2023-09-30T16:59:54.832 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : librados2-2:18.0.0-6447.g1d10b717.el8.x86_64 5/124 2023-09-30T16:59:55.032 INFO:teuthology.orchestra.run.smithi072.stdout:(63/122): python3-waitress-1.4.3-1.el8.noarch.r 800 kB/s | 255 kB 00:00 2023-09-30T16:59:55.099 INFO:teuthology.orchestra.run.smithi072.stdout:(64/122): python3-websocket-client-0.56.0-5.el8 182 kB/s | 61 kB 00:00 2023-09-30T16:59:55.110 INFO:teuthology.orchestra.run.smithi134.stdout:(10/122): ceph-radosgw-18.0.0-6447.g1d10b717.el 8.4 MB/s | 14 MB 00:01 2023-09-30T16:59:55.202 INFO:teuthology.orchestra.run.smithi134.stdout:(11/122): libcephfs-devel-18.0.0-6447.g1d10b717 340 kB/s | 31 kB 00:00 2023-09-30T16:59:55.305 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librados2-2:18.0.0-6447.g1d10b717.el8.x86_64 5/124 2023-09-30T16:59:55.305 INFO:teuthology.orchestra.run.smithi072.stdout:(65/122): python3-zc-lockfile-2.0-2.el8.noarch. 162 kB/s | 23 kB 00:00 2023-09-30T16:59:55.459 INFO:teuthology.orchestra.run.smithi072.stdout:(66/122): python3-webtest-2.0.33-1.el8.noarch.r 200 kB/s | 85 kB 00:00 2023-09-30T16:59:55.473 INFO:teuthology.orchestra.run.smithi007.stdout: Upgrading : librbd1-2:18.0.0-6447.g1d10b717.el8.x86_64 6/124 2023-09-30T16:59:55.484 INFO:teuthology.orchestra.run.smithi072.stdout:(67/122): xmlstarlet-1.6.1-20.el8.x86_64.rpm 2.7 MB/s | 70 kB 00:00 2023-09-30T16:59:55.511 INFO:teuthology.orchestra.run.smithi134.stdout:(12/122): libcephfs2-18.0.0-6447.g1d10b717.el8. 2.7 MB/s | 839 kB 00:00 2023-09-30T16:59:55.601 INFO:teuthology.orchestra.run.smithi072.stdout:(68/122): python3-webob-1.8.5-1.el8.1.noarch.rp 291 kB/s | 251 kB 00:00 2023-09-30T16:59:55.611 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librbd1-2:18.0.0-6447.g1d10b717.el8.x86_64 6/124 2023-09-30T16:59:55.621 INFO:teuthology.orchestra.run.smithi031.stdout:(121/122): librbd1-18.0.0-6447.g1d10b717.el8.x8 3.9 MB/s | 3.7 MB 00:00 2023-09-30T16:59:55.660 INFO:teuthology.orchestra.run.smithi072.stdout:(69/122): python3-pyasn1-modules-0.3.7-6.el8.no 1.8 MB/s | 110 kB 00:00 2023-09-30T16:59:55.702 INFO:teuthology.orchestra.run.smithi072.stdout:(70/122): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2023-09-30T16:59:55.733 INFO:teuthology.orchestra.run.smithi031.stdout:(122/122): librados2-18.0.0-6447.g1d10b717.el8. 3.2 MB/s | 3.7 MB 00:01 2023-09-30T16:59:55.736 INFO:teuthology.orchestra.run.smithi031.stdout:-------------------------------------------------------------------------------- 2023-09-30T16:59:55.736 INFO:teuthology.orchestra.run.smithi031.stdout:Total 10 MB/s | 200 MB 00:19 2023-09-30T16:59:55.744 INFO:teuthology.orchestra.run.smithi134.stdout:(13/122): ceph-osd-18.0.0-6447.g1d10b717.el8.x8 6.6 MB/s | 18 MB 00:02 2023-09-30T16:59:55.745 INFO:teuthology.orchestra.run.smithi072.stdout:(71/122): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.1 MB/s | 259 kB 00:00 2023-09-30T16:59:55.769 INFO:teuthology.orchestra.run.smithi134.stdout:(14/122): libcephsqlite-18.0.0-6447.g1d10b717.e 711 kB/s | 184 kB 00:00 2023-09-30T16:59:55.798 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libcephfs2-2:18.0.0-6447.g1d10b717.el8.x86_64 7/124 2023-09-30T16:59:55.820 INFO:teuthology.orchestra.run.smithi134.stdout:(15/122): librados-devel-18.0.0-6447.g1d10b717. 1.8 MB/s | 139 kB 00:00 2023-09-30T16:59:55.878 INFO:teuthology.orchestra.run.smithi134.stdout:(16/122): libradosstriper1-18.0.0-6447.g1d10b71 4.7 MB/s | 519 kB 00:00 2023-09-30T16:59:55.883 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libcephfs2-2:18.0.0-6447.g1d10b717.el8.x86_64 7/124 2023-09-30T16:59:55.937 INFO:teuthology.orchestra.run.smithi134.stdout:(17/122): python3-ceph-argparse-18.0.0-6447.g1d 766 kB/s | 45 kB 00:00 2023-09-30T16:59:55.987 INFO:teuthology.orchestra.run.smithi072.stdout:(72/122): python3-scipy-1.0.0-21.module+el8.5.0 27 MB/s | 14 MB 00:00 2023-09-30T16:59:56.012 INFO:teuthology.orchestra.run.smithi134.stdout:(18/122): python3-ceph-common-18.0.0-6447.g1d10 1.6 MB/s | 125 kB 00:00 2023-09-30T16:59:56.021 INFO:teuthology.orchestra.run.smithi072.stdout:(73/122): socat-1.7.4.1-1.el8.x86_64.rpm 1.1 MB/s | 323 kB 00:00 2023-09-30T16:59:56.037 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rados-2:18.0.0-6447.g1d10b717.el8.x86_64 8/124 2023-09-30T16:59:56.038 INFO:teuthology.orchestra.run.smithi072.stdout:(74/122): python3-markupsafe-0.23-19.el8.x86_64 770 kB/s | 39 kB 00:00 2023-09-30T16:59:56.073 INFO:teuthology.orchestra.run.smithi134.stdout:(19/122): python3-cephfs-18.0.0-6447.g1d10b717. 3.3 MB/s | 197 kB 00:00 2023-09-30T16:59:56.080 INFO:teuthology.orchestra.run.smithi072.stdout:(75/122): bison-3.0.4-10.el8.x86_64.rpm 11 MB/s | 688 kB 00:00 2023-09-30T16:59:56.122 INFO:teuthology.orchestra.run.smithi072.stdout:(76/122): python3-jinja2-2.10.1-3.el8.noarch.rp 6.3 MB/s | 538 kB 00:00 2023-09-30T16:59:56.148 INFO:teuthology.orchestra.run.smithi072.stdout:(77/122): python3-mako-1.0.6-13.el8.noarch.rpm 2.3 MB/s | 157 kB 00:00 2023-09-30T16:59:56.171 INFO:teuthology.orchestra.run.smithi134.stdout:(20/122): python3-rados-18.0.0-6447.g1d10b717.e 3.6 MB/s | 371 kB 00:00 2023-09-30T16:59:56.175 INFO:teuthology.orchestra.run.smithi072.stdout:(78/122): oniguruma-6.8.2-2.el8.x86_64.rpm 3.5 MB/s | 187 kB 00:00 2023-09-30T16:59:56.217 INFO:teuthology.orchestra.run.smithi072.stdout:(79/122): automake-1.16.1-7.el8.noarch.rpm 10 MB/s | 713 kB 00:00 2023-09-30T16:59:56.232 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/124 2023-09-30T16:59:56.259 INFO:teuthology.orchestra.run.smithi072.stdout:(80/122): python3-jsonpatch-1.21-2.el8.noarch.r 634 kB/s | 27 kB 00:00 2023-09-30T16:59:56.271 INFO:teuthology.orchestra.run.smithi134.stdout:(21/122): python3-rbd-18.0.0-6447.g1d10b717.el8 3.6 MB/s | 365 kB 00:00 2023-09-30T16:59:56.302 INFO:teuthology.orchestra.run.smithi072.stdout:(81/122): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-09-30T16:59:56.321 INFO:teuthology.orchestra.run.smithi134.stdout:(22/122): python3-rgw-18.0.0-6447.g1d10b717.el8 2.1 MB/s | 106 kB 00:00 2023-09-30T16:59:56.344 INFO:teuthology.orchestra.run.smithi072.stdout:(82/122): python3-prettytable-0.7.2-14.el8.noar 1.0 MB/s | 44 kB 00:00 2023-09-30T16:59:56.380 INFO:teuthology.orchestra.run.smithi134.stdout:(23/122): rbd-fuse-18.0.0-6447.g1d10b717.el8.x8 1.6 MB/s | 94 kB 00:00 2023-09-30T16:59:56.452 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 10/124 2023-09-30T16:59:56.480 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction check 2023-09-30T16:59:56.482 INFO:teuthology.orchestra.run.smithi072.stdout:(83/122): python3-babel-2.5.1-7.el8.noarch.rpm 16 MB/s | 4.8 MB 00:00 2023-09-30T16:59:56.537 INFO:teuthology.orchestra.run.smithi072.stdout:(84/122): python3-werkzeug-0.12.2-4.el8.noarch. 8.3 MB/s | 457 kB 00:00 2023-09-30T16:59:56.579 INFO:teuthology.orchestra.run.smithi072.stdout:(85/122): python3-numpy-f2py-1.14.3-10.el8.x86_ 5.3 MB/s | 225 kB 00:00 2023-09-30T16:59:56.603 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction check succeeded. 2023-09-30T16:59:56.603 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction test 2023-09-30T16:59:56.640 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 11/124 2023-09-30T16:59:56.654 INFO:teuthology.orchestra.run.smithi072.stdout:(86/122): python3-numpy-1.14.3-10.el8.x86_64.rp 12 MB/s | 3.7 MB 00:00 2023-09-30T16:59:56.680 INFO:teuthology.orchestra.run.smithi072.stdout:(87/122): python3-pyasn1-0.3.7-6.el8.noarch.rpm 1.2 MB/s | 126 kB 00:00 2023-09-30T16:59:56.697 INFO:teuthology.orchestra.run.smithi072.stdout:(88/122): python3-jsonpointer-1.10-11.el8.noarc 470 kB/s | 20 kB 00:00 2023-09-30T16:59:56.731 INFO:teuthology.orchestra.run.smithi072.stdout:(89/122): python3-pyOpenSSL-19.0.0-1.el8.noarch 2.0 MB/s | 103 kB 00:00 2023-09-30T16:59:56.773 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libcephsqlite-2:18.0.0-6447.g1d10b717.el8.x86_64 12/124 2023-09-30T16:59:56.780 INFO:teuthology.orchestra.run.smithi134.stdout:(24/122): librgw2-18.0.0-6447.g1d10b717.el8.x86 7.2 MB/s | 6.9 MB 00:00 2023-09-30T16:59:56.782 INFO:teuthology.orchestra.run.smithi072.stdout:(90/122): libtool-2.4.6-25.el8.x86_64.rpm 8.2 MB/s | 709 kB 00:00 2023-09-30T16:59:56.864 INFO:teuthology.orchestra.run.smithi134.stdout:(25/122): rbd-nbd-18.0.0-6447.g1d10b717.el8.x86 2.1 MB/s | 180 kB 00:00 2023-09-30T16:59:56.941 INFO:teuthology.orchestra.run.smithi072.stdout:(91/122): openblas-threads-0.3.15-3.el8.x86_64. 23 MB/s | 4.9 MB 00:00 2023-09-30T16:59:56.944 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6447.g1d10b717.el8.x86_64 12/124 2023-09-30T16:59:56.947 INFO:teuthology.orchestra.run.smithi134.stdout:(26/122): rbd-mirror-18.0.0-6447.g1d10b717.el8. 6.3 MB/s | 3.6 MB 00:00 2023-09-30T16:59:56.973 INFO:teuthology.orchestra.run.smithi134.stdout:(27/122): ceph-grafana-dashboards-18.0.0-6447.g 212 kB/s | 23 kB 00:00 2023-09-30T16:59:56.998 INFO:teuthology.orchestra.run.smithi134.stdout:(28/122): ceph-mgr-cephadm-18.0.0-6447.g1d10b71 2.6 MB/s | 132 kB 00:00 2023-09-30T16:59:57.050 INFO:teuthology.orchestra.run.smithi072.stdout:(92/122): openblas-0.3.15-3.el8.x86_64.rpm 18 MB/s | 4.7 MB 00:00 2023-09-30T16:59:57.085 INFO:teuthology.orchestra.run.smithi072.stdout:(93/122): jq-1.6-3.el8.x86_64.rpm 1.4 MB/s | 202 kB 00:00 2023-09-30T16:59:57.119 INFO:teuthology.orchestra.run.smithi072.stdout:(94/122): librdkafka-0.11.4-3.el8.x86_64.rpm 5.0 MB/s | 354 kB 00:00 2023-09-30T16:59:57.144 INFO:teuthology.orchestra.run.smithi072.stdout:(95/122): librabbitmq-0.9.0-3.el8.x86_64.rpm 792 kB/s | 47 kB 00:00 2023-09-30T16:59:57.211 INFO:teuthology.orchestra.run.smithi072.stdout:(96/122): libselinux-devel-2.9-5.el8.x86_64.rpm 2.1 MB/s | 200 kB 00:00 2023-09-30T16:59:57.237 INFO:teuthology.orchestra.run.smithi072.stdout:(97/122): python3-jwt-1.6.1-2.el8.noarch.rpm 461 kB/s | 43 kB 00:00 2023-09-30T16:59:57.257 INFO:teuthology.orchestra.run.smithi134.stdout:(29/122): ceph-mgr-dashboard-18.0.0-6447.g1d10b 6.2 MB/s | 1.8 MB 00:00 2023-09-30T16:59:57.271 INFO:teuthology.orchestra.run.smithi072.stdout:(98/122): pcre2-utf32-10.32-2.el8.x86_64.rpm 3.6 MB/s | 220 kB 00:00 2023-09-30T16:59:57.281 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libradosstriper1-2:18.0.0-6447.g1d10b717.el8.x86 13/124 2023-09-30T16:59:57.298 INFO:teuthology.orchestra.run.smithi072.stdout:(99/122): keyutils-libs-devel-1.5.10-9.el8.x86_ 817 kB/s | 48 kB 00:00 2023-09-30T16:59:57.322 INFO:teuthology.orchestra.run.smithi072.stdout:(100/122): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-09-30T16:59:57.348 INFO:teuthology.orchestra.run.smithi072.stdout:(101/122): python3-requests-oauthlib-1.0.0-1.el 839 kB/s | 43 kB 00:00 2023-09-30T16:59:57.349 INFO:teuthology.orchestra.run.smithi134.stdout:(30/122): ceph-mgr-modules-core-18.0.0-6447.g1d 2.6 MB/s | 242 kB 00:00 2023-09-30T16:59:57.381 INFO:teuthology.orchestra.run.smithi072.stdout:(102/122): python3-pycparser-2.14-14.el8.noarch 1.8 MB/s | 109 kB 00:00 2023-09-30T16:59:57.407 INFO:teuthology.orchestra.run.smithi072.stdout:(103/122): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.8 MB/s | 229 kB 00:00 2023-09-30T16:59:57.424 INFO:teuthology.orchestra.run.smithi134.stdout:(31/122): ceph-mgr-rook-18.0.0-6447.g1d10b717.e 633 kB/s | 47 kB 00:00 2023-09-30T16:59:57.442 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6447.g1d10b717.el8.x86 13/124 2023-09-30T16:59:57.449 INFO:teuthology.orchestra.run.smithi072.stdout:(104/122): krb5-devel-1.18.2-14.el8.x86_64.rpm 8.1 MB/s | 560 kB 00:00 2023-09-30T16:59:57.475 INFO:teuthology.orchestra.run.smithi072.stdout:(105/122): libaio-devel-0.3.112-1.el8.x86_64.rp 277 kB/s | 19 kB 00:00 2023-09-30T16:59:57.491 INFO:teuthology.orchestra.run.smithi134.stdout:(32/122): ceph-prometheus-alerts-18.0.0-6447.g1 218 kB/s | 15 kB 00:00 2023-09-30T16:59:57.509 INFO:teuthology.orchestra.run.smithi072.stdout:(106/122): python3-oauthlib-2.1.0-1.el8.noarch. 2.6 MB/s | 155 kB 00:00 2023-09-30T16:59:57.551 INFO:teuthology.orchestra.run.smithi072.stdout:(107/122): python3-cryptography-3.2.1-5.el8.x86 7.2 MB/s | 559 kB 00:00 2023-09-30T16:59:57.578 INFO:teuthology.orchestra.run.smithi072.stdout:(108/122): libverto-devel-0.3.0-5.el8.x86_64.rp 259 kB/s | 18 kB 00:00 2023-09-30T16:59:57.620 INFO:teuthology.orchestra.run.smithi072.stdout:(109/122): pcre2-devel-10.32-2.el8.x86_64.rpm 8.6 MB/s | 605 kB 00:00 2023-09-30T16:59:57.629 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 14/124 2023-09-30T16:59:57.646 INFO:teuthology.orchestra.run.smithi072.stdout:(110/122): python3-cffi-1.11.5-5.el8.x86_64.rpm 3.4 MB/s | 238 kB 00:00 2023-09-30T16:59:57.680 INFO:teuthology.orchestra.run.smithi072.stdout:(111/122): xfsprogs-devel-5.0.0-10.el8.x86_64.r 2.1 MB/s | 72 kB 00:00 2023-09-30T16:59:57.717 INFO:teuthology.orchestra.run.smithi031.stdout:Transaction test succeeded. 2023-09-30T16:59:57.721 INFO:teuthology.orchestra.run.smithi031.stdout:Running transaction 2023-09-30T16:59:57.755 INFO:teuthology.orchestra.run.smithi072.stdout:(112/122): openssl-devel-1.1.1k-7.el8_6.x86_64. 17 MB/s | 2.3 MB 00:00 2023-09-30T16:59:57.781 INFO:teuthology.orchestra.run.smithi072.stdout:(113/122): fuse-2.9.7-15.el8.x86_64.rpm 822 kB/s | 83 kB 00:00 2023-09-30T16:59:57.806 INFO:teuthology.orchestra.run.smithi072.stdout:(114/122): elfutils-libelf-devel-0.186-1.el8.x8 1.2 MB/s | 60 kB 00:00 2023-09-30T16:59:57.816 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 15/124 2023-09-30T16:59:57.840 INFO:teuthology.orchestra.run.smithi072.stdout:(115/122): libuuid-devel-2.32.1-35.el8.x86_64.r 1.6 MB/s | 98 kB 00:00 2023-09-30T16:59:57.898 INFO:teuthology.orchestra.run.smithi072.stdout:(116/122): zlib-devel-1.2.11-18.el8_5.x86_64.rp 635 kB/s | 58 kB 00:00 2023-09-30T16:59:57.900 INFO:teuthology.orchestra.run.smithi134.stdout:(33/122): ceph-test-18.0.0-6447.g1d10b717.el8.x 12 MB/s | 49 MB 00:03 2023-09-30T16:59:57.917 INFO:teuthology.orchestra.run.smithi134.stdout:(34/122): ceph-volume-18.0.0-6447.g1d10b717.el8 614 kB/s | 261 kB 00:00 2023-09-30T16:59:57.925 INFO:teuthology.orchestra.run.smithi072.stdout:(117/122): libcom_err-devel-1.45.6-4.el8.x86_64 459 kB/s | 39 kB 00:00 2023-09-30T16:59:57.950 INFO:teuthology.orchestra.run.smithi134.stdout:(35/122): cephadm-18.0.0-6447.g1d10b717.el8.noa 3.6 MB/s | 185 kB 00:00 2023-09-30T16:59:57.967 INFO:teuthology.orchestra.run.smithi072.stdout:(118/122): libgfortran-8.5.0-10.1.el8_6.x86_64. 9.1 MB/s | 644 kB 00:00 2023-09-30T16:59:57.992 INFO:teuthology.orchestra.run.smithi072.stdout:(119/122): libquadmath-8.5.0-10.1.el8_6.x86_64. 2.5 MB/s | 171 kB 00:00 2023-09-30T16:59:57.993 INFO:teuthology.orchestra.run.smithi134.stdout:(36/122): gperftools-libs-2.7-9.el8.x86_64.rpm 4.0 MB/s | 306 kB 00:00 2023-09-30T16:59:58.009 INFO:teuthology.orchestra.run.smithi134.stdout:(37/122): liboath-2.6.2-3.el8.x86_64.rpm 1.0 MB/s | 59 kB 00:00 2023-09-30T16:59:58.021 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 16/124 2023-09-30T16:59:58.035 INFO:teuthology.orchestra.run.smithi134.stdout:(38/122): libunwind-1.3.1-3.el8.x86_64.rpm 1.8 MB/s | 75 kB 00:00 2023-09-30T16:59:58.118 INFO:teuthology.orchestra.run.smithi134.stdout:(39/122): ceph-mgr-diskprediction-local-18.0.0- 6.6 MB/s | 7.4 MB 00:01 2023-09-30T16:59:58.135 INFO:teuthology.orchestra.run.smithi134.stdout:(40/122): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 436 kB/s | 44 kB 00:00 2023-09-30T16:59:58.147 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 17/124 2023-09-30T16:59:58.193 INFO:teuthology.orchestra.run.smithi134.stdout:(41/122): python3-asyncssh-2.7.0-2.el8.noarch.r 2.5 MB/s | 476 kB 00:00 2023-09-30T16:59:58.219 INFO:teuthology.orchestra.run.smithi134.stdout:(42/122): python3-cachetools-3.1.1-4.el8.noarch 395 kB/s | 33 kB 00:00 2023-09-30T16:59:58.244 INFO:teuthology.orchestra.run.smithi134.stdout:(43/122): python3-certifi-2018.10.15-7.el8.noar 316 kB/s | 16 kB 00:00 2023-09-30T16:59:58.269 INFO:teuthology.orchestra.run.smithi134.stdout:(44/122): python3-beautifulsoup4-4.6.3-2.el8.1. 1.2 MB/s | 185 kB 00:00 2023-09-30T16:59:58.289 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 17/124 2023-09-30T16:59:58.295 INFO:teuthology.orchestra.run.smithi134.stdout:(45/122): python3-cheroot-8.5.2-1.el8.noarch.rp 2.2 MB/s | 173 kB 00:00 2023-09-30T16:59:58.321 INFO:teuthology.orchestra.run.smithi134.stdout:(46/122): python3-google-auth-1.1.1-10.el8.noar 1.6 MB/s | 81 kB 00:00 2023-09-30T16:59:58.345 INFO:teuthology.orchestra.run.smithi134.stdout:(47/122): python3-jaraco-6.2-6.el8.noarch.rpm 221 kB/s | 11 kB 00:00 2023-09-30T16:59:58.368 INFO:teuthology.orchestra.run.smithi072.stdout:(120/122): librbd1-18.0.0-6447.g1d10b717.el8.x8 9.9 MB/s | 3.7 MB 00:00 2023-09-30T16:59:58.370 INFO:teuthology.orchestra.run.smithi134.stdout:(48/122): python3-jaraco-functools-2.0-4.el8.no 351 kB/s | 18 kB 00:00 2023-09-30T16:59:58.396 INFO:teuthology.orchestra.run.smithi134.stdout:(49/122): python3-cherrypy-18.4.0-1.el8.noarch. 2.5 MB/s | 384 kB 00:00 2023-09-30T16:59:58.414 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 18/124 2023-09-30T16:59:58.421 INFO:teuthology.orchestra.run.smithi134.stdout:(50/122): python3-logutils-0.3.5-11.el8.noarch. 971 kB/s | 49 kB 00:00 2023-09-30T16:59:58.443 INFO:teuthology.orchestra.run.smithi072.stdout:(121/122): thrift-0.13.0-2.el8.x86_64.rpm 555 kB/s | 1.7 MB 00:03 2023-09-30T16:59:58.446 INFO:teuthology.orchestra.run.smithi134.stdout:(51/122): python3-more-itertools-7.2.0-3.el8.no 1.1 MB/s | 59 kB 00:00 2023-09-30T16:59:58.472 INFO:teuthology.orchestra.run.smithi134.stdout:(52/122): python3-natsort-7.1.1-2.el8.noarch.rp 1.2 MB/s | 60 kB 00:00 2023-09-30T16:59:58.497 INFO:teuthology.orchestra.run.smithi134.stdout:(53/122): python3-pecan-1.3.2-9.el8.noarch.rpm 5.5 MB/s | 283 kB 00:00 2023-09-30T16:59:58.522 INFO:teuthology.orchestra.run.smithi134.stdout:(54/122): python3-portend-2.6-1.el8.noarch.rpm 310 kB/s | 16 kB 00:00 2023-09-30T16:59:58.547 INFO:teuthology.orchestra.run.smithi134.stdout:(55/122): python3-repoze-lru-0.7-6.el8.noarch.r 673 kB/s | 34 kB 00:00 2023-09-30T16:59:58.573 INFO:teuthology.orchestra.run.smithi134.stdout:(56/122): python3-routes-2.4.1-12.el8.noarch.rp 3.8 MB/s | 196 kB 00:00 2023-09-30T16:59:58.598 INFO:teuthology.orchestra.run.smithi134.stdout:(57/122): python3-rsa-4.9-2.el8.noarch.rpm 1.2 MB/s | 64 kB 00:00 2023-09-30T16:59:58.623 INFO:teuthology.orchestra.run.smithi134.stdout:(58/122): python3-simplegeneric-0.8.1-17.el8.no 372 kB/s | 19 kB 00:00 2023-09-30T16:59:58.649 INFO:teuthology.orchestra.run.smithi134.stdout:(59/122): python3-singledispatch-3.4.0.3-18.el8 477 kB/s | 24 kB 00:00 2023-09-30T16:59:58.674 INFO:teuthology.orchestra.run.smithi134.stdout:(60/122): python3-tempora-1.14.1-5.el8.noarch.r 583 kB/s | 29 kB 00:00 2023-09-30T16:59:58.699 INFO:teuthology.orchestra.run.smithi134.stdout:(61/122): python3-trustme-0.6.0-4.el8.noarch.rp 548 kB/s | 27 kB 00:00 2023-09-30T16:59:58.733 INFO:teuthology.orchestra.run.smithi134.stdout:(62/122): python3-kubernetes-11.0.0-6.el8.noarc 3.0 MB/s | 1.2 MB 00:00 2023-09-30T16:59:58.758 INFO:teuthology.orchestra.run.smithi134.stdout:(63/122): python3-waitress-1.4.3-1.el8.noarch.r 3.0 MB/s | 255 kB 00:00 2023-09-30T16:59:58.783 INFO:teuthology.orchestra.run.smithi134.stdout:(64/122): python3-webob-1.8.5-1.el8.1.noarch.rp 2.9 MB/s | 251 kB 00:00 2023-09-30T16:59:58.809 INFO:teuthology.orchestra.run.smithi134.stdout:(65/122): python3-websocket-client-0.56.0-5.el8 812 kB/s | 61 kB 00:00 2023-09-30T16:59:58.834 INFO:teuthology.orchestra.run.smithi134.stdout:(66/122): python3-zc-lockfile-2.0-2.el8.noarch. 455 kB/s | 23 kB 00:00 2023-09-30T16:59:58.860 INFO:teuthology.orchestra.run.smithi134.stdout:(67/122): python3-webtest-2.0.33-1.el8.noarch.r 845 kB/s | 85 kB 00:00 2023-09-30T16:59:58.885 INFO:teuthology.orchestra.run.smithi134.stdout:(68/122): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.4 MB/s | 70 kB 00:00 2023-09-30T16:59:58.927 INFO:teuthology.orchestra.run.smithi134.stdout:(69/122): thrift-0.13.0-2.el8.x86_64.rpm 15 MB/s | 1.7 MB 00:00 2023-09-30T16:59:58.944 INFO:teuthology.orchestra.run.smithi072.stdout:(122/122): librados2-18.0.0-6447.g1d10b717.el8. 3.8 MB/s | 3.7 MB 00:00 2023-09-30T16:59:58.946 INFO:teuthology.orchestra.run.smithi072.stdout:-------------------------------------------------------------------------------- 2023-09-30T16:59:58.946 INFO:teuthology.orchestra.run.smithi072.stdout:Total 10 MB/s | 200 MB 00:19 2023-09-30T16:59:58.960 INFO:teuthology.orchestra.run.smithi134.stdout:(70/122): librabbitmq-0.9.0-3.el8.x86_64.rpm 467 kB/s | 47 kB 00:00 2023-09-30T16:59:58.994 INFO:teuthology.orchestra.run.smithi134.stdout:(71/122): libselinux-devel-2.9-5.el8.x86_64.rpm 1.9 MB/s | 200 kB 00:00 2023-09-30T16:59:59.019 INFO:teuthology.orchestra.run.smithi134.stdout:(72/122): python3-jwt-1.6.1-2.el8.noarch.rpm 492 kB/s | 43 kB 00:00 2023-09-30T16:59:59.044 INFO:teuthology.orchestra.run.smithi134.stdout:(73/122): keyutils-libs-devel-1.5.10-9.el8.x86_ 960 kB/s | 48 kB 00:00 2023-09-30T16:59:59.070 INFO:teuthology.orchestra.run.smithi134.stdout:(74/122): libsepol-devel-2.9-3.el8.x86_64.rpm 1.7 MB/s | 87 kB 00:00 2023-09-30T16:59:59.077 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 18/124 2023-09-30T16:59:59.095 INFO:teuthology.orchestra.run.smithi134.stdout:(75/122): pcre2-utf32-10.32-2.el8.x86_64.rpm 1.7 MB/s | 220 kB 00:00 2023-09-30T16:59:59.120 INFO:teuthology.orchestra.run.smithi134.stdout:(76/122): python3-requests-oauthlib-1.0.0-1.el8 565 kB/s | 43 kB 00:00 2023-09-30T16:59:59.137 INFO:teuthology.orchestra.run.smithi134.stdout:(77/122): python3-pycparser-2.14-14.el8.noarch. 1.6 MB/s | 109 kB 00:00 2023-09-30T16:59:59.171 INFO:teuthology.orchestra.run.smithi134.stdout:(78/122): pcre2-utf16-10.32-2.el8.x86_64.rpm 3.0 MB/s | 229 kB 00:00 2023-09-30T16:59:59.196 INFO:teuthology.orchestra.run.smithi134.stdout:(79/122): libaio-devel-0.3.112-1.el8.x86_64.rpm 318 kB/s | 19 kB 00:00 2023-09-30T16:59:59.213 INFO:teuthology.orchestra.run.smithi134.stdout:(80/122): python3-oauthlib-2.1.0-1.el8.noarch.r 3.6 MB/s | 155 kB 00:00 2023-09-30T16:59:59.222 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 19/124 2023-09-30T16:59:59.247 INFO:teuthology.orchestra.run.smithi134.stdout:(81/122): krb5-devel-1.18.2-14.el8.x86_64.rpm 4.3 MB/s | 560 kB 00:00 2023-09-30T16:59:59.272 INFO:teuthology.orchestra.run.smithi134.stdout:(82/122): libverto-devel-0.3.0-5.el8.x86_64.rpm 306 kB/s | 18 kB 00:00 2023-09-30T16:59:59.306 INFO:teuthology.orchestra.run.smithi134.stdout:(83/122): python3-cryptography-3.2.1-5.el8.x86_ 5.0 MB/s | 559 kB 00:00 2023-09-30T16:59:59.323 INFO:teuthology.orchestra.run.smithi134.stdout:(84/122): python3-cffi-1.11.5-5.el8.x86_64.rpm 4.6 MB/s | 238 kB 00:00 2023-09-30T16:59:59.356 INFO:teuthology.orchestra.run.smithi134.stdout:(85/122): pcre2-devel-10.32-2.el8.x86_64.rpm 5.4 MB/s | 605 kB 00:00 2023-09-30T16:59:59.381 INFO:teuthology.orchestra.run.smithi134.stdout:(86/122): xfsprogs-devel-5.0.0-10.el8.x86_64.rp 1.2 MB/s | 72 kB 00:00 2023-09-30T16:59:59.406 INFO:teuthology.orchestra.run.smithi134.stdout:(87/122): fuse-2.9.7-15.el8.x86_64.rpm 1.6 MB/s | 83 kB 00:00 2023-09-30T16:59:59.432 INFO:teuthology.orchestra.run.smithi134.stdout:(88/122): elfutils-libelf-devel-0.186-1.el8.x86 1.2 MB/s | 60 kB 00:00 2023-09-30T16:59:59.457 INFO:teuthology.orchestra.run.smithi134.stdout:(89/122): libuuid-devel-2.32.1-35.el8.x86_64.rp 1.9 MB/s | 98 kB 00:00 2023-09-30T16:59:59.482 INFO:teuthology.orchestra.run.smithi134.stdout:(90/122): zlib-devel-1.2.11-18.el8_5.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2023-09-30T16:59:59.528 INFO:teuthology.orchestra.run.smithi134.stdout:(91/122): libcom_err-devel-1.45.6-4.el8.x86_64. 547 kB/s | 39 kB 00:00 2023-09-30T16:59:59.566 INFO:teuthology.orchestra.run.smithi134.stdout:(92/122): libgfortran-8.5.0-10.1.el8_6.x86_64.r 7.5 MB/s | 644 kB 00:00 2023-09-30T16:59:59.625 INFO:teuthology.orchestra.run.smithi134.stdout:(93/122): openssl-devel-1.1.1k-7.el8_6.x86_64.r 7.3 MB/s | 2.3 MB 00:00 2023-09-30T16:59:59.650 INFO:teuthology.orchestra.run.smithi134.stdout:(94/122): libquadmath-8.5.0-10.1.el8_6.x86_64.r 1.4 MB/s | 171 kB 00:00 2023-09-30T16:59:59.668 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction check 2023-09-30T16:59:59.678 INFO:teuthology.orchestra.run.smithi134.stdout:(95/122): python3-pyasn1-modules-0.3.7-6.el8.no 2.1 MB/s | 110 kB 00:00 2023-09-30T16:59:59.692 INFO:teuthology.orchestra.run.smithi134.stdout:(96/122): python3-pytz-2017.2-9.el8.noarch.rpm 1.3 MB/s | 54 kB 00:00 2023-09-30T16:59:59.718 INFO:teuthology.orchestra.run.smithi134.stdout:(97/122): lttng-ust-2.8.1-11.el8.x86_64.rpm 6.0 MB/s | 259 kB 00:00 2023-09-30T16:59:59.752 INFO:teuthology.orchestra.run.smithi134.stdout:(98/122): socat-1.7.4.1-1.el8.x86_64.rpm 5.4 MB/s | 323 kB 00:00 2023-09-30T16:59:59.769 INFO:teuthology.orchestra.run.smithi134.stdout:(99/122): python3-markupsafe-0.23-19.el8.x86_64 774 kB/s | 39 kB 00:00 2023-09-30T16:59:59.778 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction check succeeded. 2023-09-30T16:59:59.778 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction test 2023-09-30T16:59:59.802 INFO:teuthology.orchestra.run.smithi134.stdout:(100/122): bison-3.0.4-10.el8.x86_64.rpm 13 MB/s | 688 kB 00:00 2023-09-30T16:59:59.844 INFO:teuthology.orchestra.run.smithi134.stdout:(101/122): python3-jinja2-2.10.1-3.el8.noarch.r 7.0 MB/s | 538 kB 00:00 2023-09-30T16:59:59.856 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 19/124 2023-09-30T16:59:59.869 INFO:teuthology.orchestra.run.smithi134.stdout:(102/122): python3-mako-1.0.6-13.el8.noarch.rpm 2.3 MB/s | 157 kB 00:00 2023-09-30T17:00:00.003 INFO:teuthology.orchestra.run.smithi134.stdout:(103/122): oniguruma-6.8.2-2.el8.x86_64.rpm 1.2 MB/s | 187 kB 00:00 2023-09-30T17:00:00.022 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : openblas-0.3.15-3.el8.x86_64 20/124 2023-09-30T17:00:00.062 INFO:teuthology.orchestra.run.smithi134.stdout:(104/122): automake-1.16.1-7.el8.noarch.rpm 3.6 MB/s | 713 kB 00:00 2023-09-30T17:00:00.095 INFO:teuthology.orchestra.run.smithi134.stdout:(105/122): python3-jsonpatch-1.21-2.el8.noarch. 799 kB/s | 27 kB 00:00 2023-09-30T17:00:00.137 INFO:teuthology.orchestra.run.smithi134.stdout:(106/122): flex-2.6.1-9.el8.x86_64.rpm 7.5 MB/s | 320 kB 00:00 2023-09-30T17:00:00.171 INFO:teuthology.orchestra.run.smithi134.stdout:(107/122): python3-prettytable-0.7.2-14.el8.noa 1.3 MB/s | 44 kB 00:00 2023-09-30T17:00:00.263 INFO:teuthology.orchestra.run.smithi134.stdout:(108/122): python3-babel-2.5.1-7.el8.noarch.rpm 18 MB/s | 4.8 MB 00:00 2023-09-30T17:00:00.304 INFO:teuthology.orchestra.run.smithi134.stdout:(109/122): python3-werkzeug-0.12.2-4.el8.noarch 11 MB/s | 457 kB 00:00 2023-09-30T17:00:00.346 INFO:teuthology.orchestra.run.smithi134.stdout:(110/122): python3-numpy-f2py-1.14.3-10.el8.x86 5.3 MB/s | 225 kB 00:00 2023-09-30T17:00:00.413 INFO:teuthology.orchestra.run.smithi134.stdout:(111/122): python3-numpy-1.14.3-10.el8.x86_64.r 15 MB/s | 3.7 MB 00:00 2023-09-30T17:00:00.430 INFO:teuthology.orchestra.run.smithi134.stdout:(112/122): python3-pyasn1-0.3.7-6.el8.noarch.rp 1.5 MB/s | 126 kB 00:00 2023-09-30T17:00:00.456 INFO:teuthology.orchestra.run.smithi134.stdout:(113/122): python3-jsonpointer-1.10-11.el8.noar 477 kB/s | 20 kB 00:00 2023-09-30T17:00:00.481 INFO:teuthology.orchestra.run.smithi134.stdout:(114/122): python3-pyOpenSSL-19.0.0-1.el8.noarc 2.0 MB/s | 103 kB 00:00 2023-09-30T17:00:00.514 INFO:teuthology.orchestra.run.smithi134.stdout:(115/122): libtool-2.4.6-25.el8.x86_64.rpm 12 MB/s | 709 kB 00:00 2023-09-30T17:00:00.673 INFO:teuthology.orchestra.run.smithi134.stdout:(116/122): python3-scipy-1.0.0-21.module+el8.5. 12 MB/s | 14 MB 00:01 2023-09-30T17:00:00.715 INFO:teuthology.orchestra.run.smithi134.stdout:(117/122): jq-1.6-3.el8.x86_64.rpm 4.8 MB/s | 202 kB 00:00 2023-09-30T17:00:00.757 INFO:teuthology.orchestra.run.smithi134.stdout:(118/122): librdkafka-0.11.4-3.el8.x86_64.rpm 8.3 MB/s | 354 kB 00:00 2023-09-30T17:00:00.760 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 20/124 2023-09-30T17:00:00.817 INFO:teuthology.orchestra.run.smithi072.stdout:Transaction test succeeded. 2023-09-30T17:00:00.821 INFO:teuthology.orchestra.run.smithi072.stdout:Running transaction 2023-09-30T17:00:00.824 INFO:teuthology.orchestra.run.smithi134.stdout:(119/122): openblas-threads-0.3.15-3.el8.x86_64 14 MB/s | 4.9 MB 00:00 2023-09-30T17:00:00.924 INFO:teuthology.orchestra.run.smithi134.stdout:(120/122): openblas-0.3.15-3.el8.x86_64.rpm 12 MB/s | 4.7 MB 00:00 2023-09-30T17:00:01.044 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 21/124 2023-09-30T17:00:01.183 INFO:teuthology.orchestra.run.smithi134.stdout:(121/122): librados2-18.0.0-6447.g1d10b717.el8. 8.8 MB/s | 3.7 MB 00:00 2023-09-30T17:00:01.228 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 22/124 2023-09-30T17:00:01.366 INFO:teuthology.orchestra.run.smithi134.stdout:(122/122): librbd1-18.0.0-6447.g1d10b717.el8.x8 6.8 MB/s | 3.7 MB 00:00 2023-09-30T17:00:01.368 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2023-09-30T17:00:01.368 INFO:teuthology.orchestra.run.smithi134.stdout:Total 21 MB/s | 200 MB 00:09 2023-09-30T17:00:01.437 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 23/124 2023-09-30T17:00:01.596 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-ceph-common-2:18.0.0-6447.g1d10b717.el8. 24/124 2023-09-30T17:00:01.727 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-ceph-argparse-2:18.0.0-6447.g1d10b717.el 25/124 2023-09-30T17:00:01.968 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cephfs-2:18.0.0-6447.g1d10b717.el8.x86_6 26/124 2023-09-30T17:00:02.089 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2023-09-30T17:00:02.147 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 27/124 2023-09-30T17:00:02.201 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2023-09-30T17:00:02.202 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2023-09-30T17:00:02.482 INFO:teuthology.orchestra.run.smithi031.stdout: Preparing : 1/1 2023-09-30T17:00:02.681 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/124 2023-09-30T17:00:02.858 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/124 2023-09-30T17:00:03.253 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2023-09-30T17:00:03.257 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2023-09-30T17:00:03.292 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/124 2023-09-30T17:00:03.410 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/124 2023-09-30T17:00:03.617 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/124 2023-09-30T17:00:04.036 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 27/124 2023-09-30T17:00:04.054 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/124 2023-09-30T17:00:04.258 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : librados2-2:18.0.0-6447.g1d10b717.el8.x86_64 5/124 2023-09-30T17:00:04.674 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librados2-2:18.0.0-6447.g1d10b717.el8.x86_64 5/124 2023-09-30T17:00:04.900 INFO:teuthology.orchestra.run.smithi031.stdout: Upgrading : librbd1-2:18.0.0-6447.g1d10b717.el8.x86_64 6/124 2023-09-30T17:00:05.021 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librbd1-2:18.0.0-6447.g1d10b717.el8.x86_64 6/124 2023-09-30T17:00:05.119 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 28/124 2023-09-30T17:00:05.191 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libcephfs2-2:18.0.0-6447.g1d10b717.el8.x86_64 7/124 2023-09-30T17:00:05.289 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libcephfs2-2:18.0.0-6447.g1d10b717.el8.x86_64 7/124 2023-09-30T17:00:05.421 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/124 2023-09-30T17:00:05.439 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-rados-2:18.0.0-6447.g1d10b717.el8.x86_64 8/124 2023-09-30T17:00:05.616 INFO:teuthology.orchestra.run.smithi072.stdout: Preparing : 1/1 2023-09-30T17:00:05.633 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/124 2023-09-30T17:00:05.720 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/124 2023-09-30T17:00:05.832 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/124 2023-09-30T17:00:05.871 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 10/124 2023-09-30T17:00:05.943 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/124 2023-09-30T17:00:06.006 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/124 2023-09-30T17:00:06.075 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 11/124 2023-09-30T17:00:06.153 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rsa-4.9-2.el8.noarch 32/124 2023-09-30T17:00:06.213 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 3/124 2023-09-30T17:00:06.258 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libcephsqlite-2:18.0.0-6447.g1d10b717.el8.x86_64 12/124 2023-09-30T17:00:06.357 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 33/124 2023-09-30T17:00:06.369 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6447.g1d10b717.el8.x86_64 12/124 2023-09-30T17:00:06.440 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 4/124 2023-09-30T17:00:06.541 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libradosstriper1-2:18.0.0-6447.g1d10b717.el8.x86 13/124 2023-09-30T17:00:06.561 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rbd-2:18.0.0-6447.g1d10b717.el8.x86_64 34/124 2023-09-30T17:00:06.578 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 4/124 2023-09-30T17:00:06.701 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6447.g1d10b717.el8.x86 13/124 2023-09-30T17:00:06.737 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librados-devel-2:18.0.0-6447.g1d10b717.el8.x86_6 35/124 2023-09-30T17:00:06.789 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 5/124 2023-09-30T17:00:06.880 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 14/124 2023-09-30T17:00:06.880 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 36/124 2023-09-30T17:00:07.014 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 37/124 2023-09-30T17:00:07.041 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 15/124 2023-09-30T17:00:07.190 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 5/124 2023-09-30T17:00:07.229 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 16/124 2023-09-30T17:00:07.274 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 38/124 2023-09-30T17:00:07.357 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 17/124 2023-09-30T17:00:07.440 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : librados2-2:18.0.0-6447.g1d10b717.el8.x86_64 6/124 2023-09-30T17:00:07.498 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : automake-1.16.1-7.el8.noarch 39/124 2023-09-30T17:00:07.498 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 17/124 2023-09-30T17:00:07.663 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 40/124 2023-09-30T17:00:07.666 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 18/124 2023-09-30T17:00:07.750 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 40/124 2023-09-30T17:00:07.843 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librados2-2:18.0.0-6447.g1d10b717.el8.x86_64 6/124 2023-09-30T17:00:07.890 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2023-09-30T17:00:07.999 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : jq-1.6-3.el8.x86_64 41/124 2023-09-30T17:00:08.031 INFO:teuthology.orchestra.run.smithi072.stdout: Upgrading : librbd1-2:18.0.0-6447.g1d10b717.el8.x86_64 7/124 2023-09-30T17:00:08.067 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : thrift-0.13.0-2.el8.x86_64 1/124 2023-09-30T17:00:08.162 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librbd1-2:18.0.0-6447.g1d10b717.el8.x86_64 7/124 2023-09-30T17:00:08.242 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/124 2023-09-30T17:00:08.326 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 18/124 2023-09-30T17:00:08.364 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephfs2-2:18.0.0-6447.g1d10b717.el8.x86_64 8/124 2023-09-30T17:00:08.385 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librdkafka-0.11.4-3.el8.x86_64 3/124 2023-09-30T17:00:08.482 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 19/124 2023-09-30T17:00:08.484 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 42/124 2023-09-30T17:00:08.508 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libcephfs2-2:18.0.0-6447.g1d10b717.el8.x86_64 8/124 2023-09-30T17:00:08.515 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librdkafka-0.11.4-3.el8.x86_64 3/124 2023-09-30T17:00:08.656 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 43/124 2023-09-30T17:00:08.711 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/124 2023-09-30T17:00:08.734 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rados-2:18.0.0-6447.g1d10b717.el8.x86_64 9/124 2023-09-30T17:00:08.866 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 44/124 2023-09-30T17:00:08.942 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 10/124 2023-09-30T17:00:09.032 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : fuse-2.9.7-15.el8.x86_64 45/124 2023-09-30T17:00:09.118 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/124 2023-09-30T17:00:09.168 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 46/124 2023-09-30T17:00:09.191 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 11/124 2023-09-30T17:00:09.283 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 19/124 2023-09-30T17:00:09.352 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librados2-2:18.0.0-6447.g1d10b717.el8.x86_64 5/124 2023-09-30T17:00:09.364 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephsqlite-2:18.0.0-6447.g1d10b717.el8.x86_64 12/124 2023-09-30T17:00:09.374 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 47/124 2023-09-30T17:00:09.474 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : openblas-0.3.15-3.el8.x86_64 20/124 2023-09-30T17:00:09.475 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6447.g1d10b717.el8.x86_64 12/124 2023-09-30T17:00:09.615 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 48/124 2023-09-30T17:00:09.664 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libradosstriper1-2:18.0.0-6447.g1d10b717.el8.x86 13/124 2023-09-30T17:00:09.732 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6447.g1d10b717.el8.x86 13/124 2023-09-30T17:00:09.766 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-2:18.0.0-6447.g1d10b717.el8.x86_64 5/124 2023-09-30T17:00:09.897 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 14/124 2023-09-30T17:00:09.961 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librbd1-2:18.0.0-6447.g1d10b717.el8.x86_64 6/124 2023-09-30T17:00:09.969 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 49/124 2023-09-30T17:00:10.037 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 14/124 2023-09-30T17:00:10.088 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-2:18.0.0-6447.g1d10b717.el8.x86_64 6/124 2023-09-30T17:00:10.172 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 15/124 2023-09-30T17:00:10.227 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 20/124 2023-09-30T17:00:10.266 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 50/124 2023-09-30T17:00:10.493 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 51/124 2023-09-30T17:00:10.516 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 21/124 2023-09-30T17:00:10.552 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs2-2:18.0.0-6447.g1d10b717.el8.x86_64 7/124 2023-09-30T17:00:10.651 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephfs2-2:18.0.0-6447.g1d10b717.el8.x86_64 7/124 2023-09-30T17:00:10.710 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 22/124 2023-09-30T17:00:10.732 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 52/124 2023-09-30T17:00:10.789 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 15/124 2023-09-30T17:00:10.824 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rados-2:18.0.0-6447.g1d10b717.el8.x86_64 8/124 2023-09-30T17:00:10.946 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 23/124 2023-09-30T17:00:10.969 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 53/124 2023-09-30T17:00:10.972 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 16/124 2023-09-30T17:00:11.047 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 9/124 2023-09-30T17:00:11.105 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-ceph-common-2:18.0.0-6447.g1d10b717.el8. 24/124 2023-09-30T17:00:11.272 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 10/124 2023-09-30T17:00:11.273 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 54/124 2023-09-30T17:00:11.277 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-ceph-argparse-2:18.0.0-6447.g1d10b717.el 25/124 2023-09-30T17:00:11.460 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 11/124 2023-09-30T17:00:11.475 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cephfs-2:18.0.0-6447.g1d10b717.el8.x86_6 26/124 2023-09-30T17:00:11.479 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 55/124 2023-09-30T17:00:11.574 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 16/124 2023-09-30T17:00:11.636 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephsqlite-2:18.0.0-6447.g1d10b717.el8.x86_64 12/124 2023-09-30T17:00:11.650 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 56/124 2023-09-30T17:00:11.665 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 27/124 2023-09-30T17:00:11.755 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephsqlite-2:18.0.0-6447.g1d10b717.el8.x86_64 12/124 2023-09-30T17:00:11.780 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openblas-0.3.15-3.el8.x86_64 17/124 2023-09-30T17:00:11.861 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 57/124 2023-09-30T17:00:11.952 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libradosstriper1-2:18.0.0-6447.g1d10b717.el8.x86 13/124 2023-09-30T17:00:12.031 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 58/124 2023-09-30T17:00:12.109 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libradosstriper1-2:18.0.0-6447.g1d10b717.el8.x86 13/124 2023-09-30T17:00:12.217 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 59/124 2023-09-30T17:00:12.307 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 14/124 2023-09-30T17:00:12.502 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 15/124 2023-09-30T17:00:12.505 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 60/124 2023-09-30T17:00:12.510 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 17/124 2023-09-30T17:00:12.673 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 16/124 2023-09-30T17:00:12.795 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 61/124 2023-09-30T17:00:12.801 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libquadmath-8.5.0-10.1.el8_6.x86_64 17/124 2023-09-30T17:00:12.841 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 18/124 2023-09-30T17:00:12.953 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libquadmath-8.5.0-10.1.el8_6.x86_64 17/124 2023-09-30T17:00:13.030 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 62/124 2023-09-30T17:00:13.072 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 19/124 2023-09-30T17:00:13.118 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libgfortran-8.5.0-10.1.el8_6.x86_64 18/124 2023-09-30T17:00:13.247 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 63/124 2023-09-30T17:00:13.293 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 20/124 2023-09-30T17:00:13.404 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 64/124 2023-09-30T17:00:13.520 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 21/124 2023-09-30T17:00:13.543 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 27/124 2023-09-30T17:00:13.568 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 65/124 2023-09-30T17:00:13.717 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libgfortran-8.5.0-10.1.el8_6.x86_64 18/124 2023-09-30T17:00:13.737 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 22/124 2023-09-30T17:00:13.835 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 66/124 2023-09-30T17:00:13.885 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-threads-0.3.15-3.el8.x86_64 19/124 2023-09-30T17:00:13.941 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 23/124 2023-09-30T17:00:14.028 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 67/124 2023-09-30T17:00:14.095 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-ceph-common-2:18.0.0-6447.g1d10b717.el8. 24/124 2023-09-30T17:00:14.209 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 68/124 2023-09-30T17:00:14.276 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-ceph-argparse-2:18.0.0-6447.g1d10b717.el 25/124 2023-09-30T17:00:14.341 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 69/124 2023-09-30T17:00:14.484 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: openblas-threads-0.3.15-3.el8.x86_64 19/124 2023-09-30T17:00:14.534 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 70/124 2023-09-30T17:00:14.632 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 28/124 2023-09-30T17:00:14.684 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-0.3.15-3.el8.x86_64 20/124 2023-09-30T17:00:14.710 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 71/124 2023-09-30T17:00:14.918 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 72/124 2023-09-30T17:00:14.930 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/124 2023-09-30T17:00:15.049 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 73/124 2023-09-30T17:00:15.163 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cephfs-2:18.0.0-6447.g1d10b717.el8.x86_6 26/124 2023-09-30T17:00:15.168 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 74/124 2023-09-30T17:00:15.179 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/124 2023-09-30T17:00:15.381 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 75/124 2023-09-30T17:00:15.384 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: openblas-0.3.15-3.el8.x86_64 20/124 2023-09-30T17:00:15.420 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/124 2023-09-30T17:00:15.493 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 27/124 2023-09-30T17:00:15.629 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-rsa-4.9-2.el8.noarch 32/124 2023-09-30T17:00:15.634 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 76/124 2023-09-30T17:00:15.658 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 21/124 2023-09-30T17:00:15.797 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 28/124 2023-09-30T17:00:15.810 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 77/124 2023-09-30T17:00:15.839 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 33/124 2023-09-30T17:00:15.950 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : zlib-devel-1.2.11-18.el8_5.x86_64 22/124 2023-09-30T17:00:16.013 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-rbd-2:18.0.0-6447.g1d10b717.el8.x86_64 34/124 2023-09-30T17:00:16.029 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/124 2023-09-30T17:00:16.075 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-portend-2.6-1.el8.noarch 78/124 2023-09-30T17:00:16.146 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 23/124 2023-09-30T17:00:16.171 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librados-devel-2:18.0.0-6447.g1d10b717.el8.x86_6 35/124 2023-09-30T17:00:16.213 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 30/124 2023-09-30T17:00:16.278 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 79/124 2023-09-30T17:00:16.299 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-common-2:18.0.0-6447.g1d10b717.el8. 24/124 2023-09-30T17:00:16.365 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 36/124 2023-09-30T17:00:16.454 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-argparse-2:18.0.0-6447.g1d10b717.el 25/124 2023-09-30T17:00:16.471 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 80/124 2023-09-30T17:00:16.516 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 37/124 2023-09-30T17:00:16.665 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 81/124 2023-09-30T17:00:16.666 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cephfs-2:18.0.0-6447.g1d10b717.el8.x86_6 26/124 2023-09-30T17:00:16.748 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 38/124 2023-09-30T17:00:16.884 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 27/124 2023-09-30T17:00:16.961 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : automake-1.16.1-7.el8.noarch 39/124 2023-09-30T17:00:17.173 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 40/124 2023-09-30T17:00:17.238 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 40/124 2023-09-30T17:00:17.459 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : jq-1.6-3.el8.x86_64 41/124 2023-09-30T17:00:17.653 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 42/124 2023-09-30T17:00:17.813 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 82/124 2023-09-30T17:00:17.822 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 43/124 2023-09-30T17:00:17.993 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 44/124 2023-09-30T17:00:18.039 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 30/124 2023-09-30T17:00:18.118 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 83/124 2023-09-30T17:00:18.192 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : fuse-2.9.7-15.el8.x86_64 45/124 2023-09-30T17:00:18.344 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 46/124 2023-09-30T17:00:18.364 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 84/124 2023-09-30T17:00:18.389 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 31/124 2023-09-30T17:00:18.575 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 47/124 2023-09-30T17:00:18.648 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 27/124 2023-09-30T17:00:18.649 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 85/124 2023-09-30T17:00:18.650 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rsa-4.9-2.el8.noarch 32/124 2023-09-30T17:00:18.783 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 48/124 2023-09-30T17:00:18.851 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 33/124 2023-09-30T17:00:18.986 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 86/124 2023-09-30T17:00:19.035 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rbd-2:18.0.0-6447.g1d10b717.el8.x86_64 34/124 2023-09-30T17:00:19.167 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 87/124 2023-09-30T17:00:19.186 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 49/124 2023-09-30T17:00:19.258 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librados-devel-2:18.0.0-6447.g1d10b717.el8.x86_6 35/124 2023-09-30T17:00:19.448 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 36/124 2023-09-30T17:00:19.501 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 50/124 2023-09-30T17:00:19.644 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 37/124 2023-09-30T17:00:19.673 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 28/124 2023-09-30T17:00:19.702 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 51/124 2023-09-30T17:00:19.816 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : fuse-2.9.7-15.el8.x86_64 38/124 2023-09-30T17:00:19.984 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 52/124 2023-09-30T17:00:20.008 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 88/124 2023-09-30T17:00:20.008 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 39/124 2023-09-30T17:00:20.025 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 29/124 2023-09-30T17:00:20.161 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : librgw2-2:18.0.0-6447.g1d10b717.el8.x86_64 89/124 2023-09-30T17:00:20.222 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 53/124 2023-09-30T17:00:20.228 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 40/124 2023-09-30T17:00:20.241 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librgw2-2:18.0.0-6447.g1d10b717.el8.x86_64 89/124 2023-09-30T17:00:20.295 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jinja2-2.10.1-3.el8.noarch 30/124 2023-09-30T17:00:20.444 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : python3-rgw-2:18.0.0-6447.g1d10b717.el8.x86_64 90/124 2023-09-30T17:00:20.452 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 41/124 2023-09-30T17:00:20.505 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 31/124 2023-09-30T17:00:20.555 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 54/124 2023-09-30T17:00:20.729 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rsa-4.9-2.el8.noarch 32/124 2023-09-30T17:00:20.756 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 55/124 2023-09-30T17:00:20.861 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 42/124 2023-09-30T17:00:21.022 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 56/124 2023-09-30T17:00:21.182 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 43/124 2023-09-30T17:00:21.198 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 57/124 2023-09-30T17:00:21.226 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 33/124 2023-09-30T17:00:21.382 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 58/124 2023-09-30T17:00:21.431 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rbd-2:18.0.0-6447.g1d10b717.el8.x86_64 34/124 2023-09-30T17:00:21.448 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 44/124 2023-09-30T17:00:21.535 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 59/124 2023-09-30T17:00:21.624 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librados-devel-2:18.0.0-6447.g1d10b717.el8.x86_6 35/124 2023-09-30T17:00:21.667 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 45/124 2023-09-30T17:00:21.815 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 60/124 2023-09-30T17:00:21.825 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 36/124 2023-09-30T17:00:21.918 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 46/124 2023-09-30T17:00:22.001 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 37/124 2023-09-30T17:00:22.060 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 61/124 2023-09-30T17:00:22.238 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 38/124 2023-09-30T17:00:22.282 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 47/124 2023-09-30T17:00:22.314 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 62/124 2023-09-30T17:00:22.462 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : automake-1.16.1-7.el8.noarch 39/124 2023-09-30T17:00:22.540 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 63/124 2023-09-30T17:00:22.545 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 48/124 2023-09-30T17:00:22.658 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 40/124 2023-09-30T17:00:22.713 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 64/124 2023-09-30T17:00:22.737 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 40/124 2023-09-30T17:00:22.743 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 49/124 2023-09-30T17:00:22.876 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 65/124 2023-09-30T17:00:22.956 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : jq-1.6-3.el8.x86_64 41/124 2023-09-30T17:00:23.006 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 50/124 2023-09-30T17:00:23.139 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 66/124 2023-09-30T17:00:23.146 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 42/124 2023-09-30T17:00:23.212 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 51/124 2023-09-30T17:00:23.338 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcom_err-devel-1.45.6-4.el8.x86_64 43/124 2023-09-30T17:00:23.362 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 67/124 2023-09-30T17:00:23.390 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 52/124 2023-09-30T17:00:23.501 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 68/124 2023-09-30T17:00:23.537 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libuuid-devel-2.32.1-35.el8.x86_64 44/124 2023-09-30T17:00:23.658 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 69/124 2023-09-30T17:00:23.724 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 53/124 2023-09-30T17:00:23.752 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : fuse-2.9.7-15.el8.x86_64 45/124 2023-09-30T17:00:23.859 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 70/124 2023-09-30T17:00:23.945 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 46/124 2023-09-30T17:00:23.994 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 54/124 2023-09-30T17:00:24.070 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 71/124 2023-09-30T17:00:24.175 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 47/124 2023-09-30T17:00:24.261 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 72/124 2023-09-30T17:00:24.283 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 55/124 2023-09-30T17:00:24.377 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-common-2:18.0.0-6447.g1d10b717.el8.x86_64 91/124 2023-09-30T17:00:24.407 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 48/124 2023-09-30T17:00:24.408 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 73/124 2023-09-30T17:00:24.527 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 56/124 2023-09-30T17:00:24.570 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 74/124 2023-09-30T17:00:24.577 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-common-2:18.0.0-6447.g1d10b717.el8.x86_64 91/124 2023-09-30T17:00:24.719 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 57/124 2023-09-30T17:00:24.773 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 75/124 2023-09-30T17:00:24.784 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cffi-1.11.5-5.el8.x86_64 49/124 2023-09-30T17:00:24.887 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 58/124 2023-09-30T17:00:25.027 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 76/124 2023-09-30T17:00:25.093 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cryptography-3.2.1-5.el8.x86_64 50/124 2023-09-30T17:00:25.167 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 59/124 2023-09-30T17:00:25.206 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-common-2:18.0.0-6447.g1d10b717.el8.x86_64 91/124 2023-09-30T17:00:25.211 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 77/124 2023-09-30T17:00:25.327 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 51/124 2023-09-30T17:00:25.392 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : automake-1.16.1-7.el8.noarch 60/124 2023-09-30T17:00:25.496 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-base-2:18.0.0-6447.g1d10b717.el8.x86_64 92/124 2023-09-30T17:00:25.508 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-portend-2.6-1.el8.noarch 78/124 2023-09-30T17:00:25.571 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 61/124 2023-09-30T17:00:25.578 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 52/124 2023-09-30T17:00:25.585 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-base-2:18.0.0-6447.g1d10b717.el8.x86_64 92/124 2023-09-30T17:00:25.650 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 61/124 2023-09-30T17:00:25.705 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 79/124 2023-09-30T17:00:25.726 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-selinux-2:18.0.0-6447.g1d10b717.el8.x86_64 93/124 2023-09-30T17:00:25.804 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 53/124 2023-09-30T17:00:25.880 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 80/124 2023-09-30T17:00:25.909 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : jq-1.6-3.el8.x86_64 62/124 2023-09-30T17:00:26.063 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 81/124 2023-09-30T17:00:26.104 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 63/124 2023-09-30T17:00:26.108 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 54/124 2023-09-30T17:00:26.262 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 64/124 2023-09-30T17:00:26.349 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 55/124 2023-09-30T17:00:26.484 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 65/124 2023-09-30T17:00:26.777 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 66/124 2023-09-30T17:00:26.922 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 56/124 2023-09-30T17:00:27.011 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 67/124 2023-09-30T17:00:27.149 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 57/124 2023-09-30T17:00:27.183 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 82/124 2023-09-30T17:00:27.225 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 68/124 2023-09-30T17:00:27.332 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libsepol-devel-2.9-3.el8.x86_64 58/124 2023-09-30T17:00:27.390 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 69/124 2023-09-30T17:00:27.462 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 83/124 2023-09-30T17:00:27.494 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : keyutils-libs-devel-1.5.10-9.el8.x86_64 59/124 2023-09-30T17:00:27.597 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 70/124 2023-09-30T17:00:27.748 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 84/124 2023-09-30T17:00:27.802 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 60/124 2023-09-30T17:00:27.841 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 71/124 2023-09-30T17:00:28.031 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 85/124 2023-09-30T17:00:28.040 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 72/124 2023-09-30T17:00:28.111 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 61/124 2023-09-30T17:00:28.207 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 73/124 2023-09-30T17:00:28.306 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 86/124 2023-09-30T17:00:28.345 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 62/124 2023-09-30T17:00:28.359 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 74/124 2023-09-30T17:00:28.476 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 87/124 2023-09-30T17:00:28.584 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : krb5-devel-1.18.2-14.el8.x86_64 63/124 2023-09-30T17:00:28.633 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 75/124 2023-09-30T17:00:28.749 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 64/124 2023-09-30T17:00:28.866 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 76/124 2023-09-30T17:00:28.934 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 65/124 2023-09-30T17:00:29.067 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 77/124 2023-09-30T17:00:29.208 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 66/124 2023-09-30T17:00:29.336 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 88/124 2023-09-30T17:00:29.391 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-portend-2.6-1.el8.noarch 78/124 2023-09-30T17:00:29.397 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 67/124 2023-09-30T17:00:29.553 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 68/124 2023-09-30T17:00:29.570 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : librgw2-2:18.0.0-6447.g1d10b717.el8.x86_64 89/124 2023-09-30T17:00:29.611 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 79/124 2023-09-30T17:00:29.631 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librgw2-2:18.0.0-6447.g1d10b717.el8.x86_64 89/124 2023-09-30T17:00:29.717 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 69/124 2023-09-30T17:00:29.779 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : python3-rgw-2:18.0.0-6447.g1d10b717.el8.x86_64 90/124 2023-09-30T17:00:29.793 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 80/124 2023-09-30T17:00:29.932 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 70/124 2023-09-30T17:00:30.054 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 81/124 2023-09-30T17:00:30.151 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 71/124 2023-09-30T17:00:30.350 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 72/124 2023-09-30T17:00:30.510 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 73/124 2023-09-30T17:00:30.680 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 74/124 2023-09-30T17:00:30.928 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 75/124 2023-09-30T17:00:31.132 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 82/124 2023-09-30T17:00:31.211 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 76/124 2023-09-30T17:00:31.413 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 77/124 2023-09-30T17:00:31.457 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 83/124 2023-09-30T17:00:31.662 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-portend-2.6-1.el8.noarch 78/124 2023-09-30T17:00:31.777 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 84/124 2023-09-30T17:00:31.856 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 79/124 2023-09-30T17:00:32.056 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 80/124 2023-09-30T17:00:32.076 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 85/124 2023-09-30T17:00:32.308 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 81/124 2023-09-30T17:00:32.385 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 86/124 2023-09-30T17:00:32.611 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 87/124 2023-09-30T17:00:33.399 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 82/124 2023-09-30T17:00:33.480 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 88/124 2023-09-30T17:00:33.636 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : librgw2-2:18.0.0-6447.g1d10b717.el8.x86_64 89/124 2023-09-30T17:00:33.677 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 83/124 2023-09-30T17:00:33.708 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librgw2-2:18.0.0-6447.g1d10b717.el8.x86_64 89/124 2023-09-30T17:00:33.764 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-common-2:18.0.0-6447.g1d10b717.el8.x86_64 91/124 2023-09-30T17:00:33.886 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : python3-rgw-2:18.0.0-6447.g1d10b717.el8.x86_64 90/124 2023-09-30T17:00:33.945 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-common-2:18.0.0-6447.g1d10b717.el8.x86_64 91/124 2023-09-30T17:00:33.949 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 84/124 2023-09-30T17:00:34.242 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 85/124 2023-09-30T17:00:34.541 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 86/124 2023-09-30T17:00:34.572 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-common-2:18.0.0-6447.g1d10b717.el8.x86_64 91/124 2023-09-30T17:00:34.781 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 87/124 2023-09-30T17:00:35.289 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-base-2:18.0.0-6447.g1d10b717.el8.x86_64 92/124 2023-09-30T17:00:35.379 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-base-2:18.0.0-6447.g1d10b717.el8.x86_64 92/124 2023-09-30T17:00:35.553 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-selinux-2:18.0.0-6447.g1d10b717.el8.x86_64 93/124 2023-09-30T17:00:35.634 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 88/124 2023-09-30T17:00:35.798 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librgw2-2:18.0.0-6447.g1d10b717.el8.x86_64 89/124 2023-09-30T17:00:35.858 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librgw2-2:18.0.0-6447.g1d10b717.el8.x86_64 89/124 2023-09-30T17:00:36.073 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rgw-2:18.0.0-6447.g1d10b717.el8.x86_64 90/124 2023-09-30T17:00:37.854 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-common-2:18.0.0-6447.g1d10b717.el8.x86_64 91/124 2023-09-30T17:00:38.061 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-common-2:18.0.0-6447.g1d10b717.el8.x86_64 91/124 2023-09-30T17:00:38.679 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-common-2:18.0.0-6447.g1d10b717.el8.x86_64 91/124 2023-09-30T17:00:38.974 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-base-2:18.0.0-6447.g1d10b717.el8.x86_64 92/124 2023-09-30T17:00:39.055 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-base-2:18.0.0-6447.g1d10b717.el8.x86_64 92/124 2023-09-30T17:00:39.269 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-selinux-2:18.0.0-6447.g1d10b717.el8.x86_64 93/124 2023-09-30T17:00:39.769 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:18.0.0-6447.g1d10b717.el8.x86_64 91/124 2023-09-30T17:00:39.981 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-common-2:18.0.0-6447.g1d10b717.el8.x86_64 91/124 2023-09-30T17:00:40.579 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:18.0.0-6447.g1d10b717.el8.x86_64 91/124 2023-09-30T17:00:40.894 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-base-2:18.0.0-6447.g1d10b717.el8.x86_64 92/124 2023-09-30T17:00:40.959 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-base-2:18.0.0-6447.g1d10b717.el8.x86_64 92/124 2023-09-30T17:00:41.114 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-selinux-2:18.0.0-6447.g1d10b717.el8.x86_64 93/124 2023-09-30T17:00:45.138 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6447.g1d10b717.el8.x86_64 93/124 2023-09-30T17:00:45.139 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /sys 2023-09-30T17:00:45.139 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /proc 2023-09-30T17:00:45.139 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /dev 2023-09-30T17:00:45.139 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /run 2023-09-30T17:00:45.139 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /mnt 2023-09-30T17:00:45.139 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /var/tmp 2023-09-30T17:00:45.139 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /home 2023-09-30T17:00:45.139 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /tmp 2023-09-30T17:00:45.139 INFO:teuthology.orchestra.run.smithi007.stdout:skipping the directory /dev 2023-09-30T17:00:45.139 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:00:45.482 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-volume-2:18.0.0-6447.g1d10b717.el8.noarch 94/124 2023-09-30T17:00:47.193 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-volume-2:18.0.0-6447.g1d10b717.el8.noarch 94/124 2023-09-30T17:00:47.367 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-osd-2:18.0.0-6447.g1d10b717.el8.x86_64 95/124 2023-09-30T17:00:47.600 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-osd-2:18.0.0-6447.g1d10b717.el8.x86_64 95/124 2023-09-30T17:00:47.748 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mds-2:18.0.0-6447.g1d10b717.el8.x86_64 96/124 2023-09-30T17:00:48.240 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mds-2:18.0.0-6447.g1d10b717.el8.x86_64 96/124 2023-09-30T17:00:48.415 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mon-2:18.0.0-6447.g1d10b717.el8.x86_64 97/124 2023-09-30T17:00:48.432 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mon-2:18.0.0-6447.g1d10b717.el8.x86_64 97/124 2023-09-30T17:00:50.234 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: cephadm-2:18.0.0-6447.g1d10b717.el8.noarch 98/124 2023-09-30T17:00:50.428 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : cephadm-2:18.0.0-6447.g1d10b717.el8.noarch 98/124 2023-09-30T17:00:50.596 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6447.g1d10b717.e 99/124 2023-09-30T17:00:50.789 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6447.g1d10b717. 100/124 2023-09-30T17:00:50.972 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6447.g1d10b717.el8.noa 101/124 2023-09-30T17:00:51.202 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6447.g1d10b717.el8.noa 101/124 2023-09-30T17:00:51.549 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6447.g1d10b717.el8.n 102/124 2023-09-30T17:00:52.574 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6447.g1d10b717.el8.n 102/124 2023-09-30T17:00:52.713 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6447.g1d1 103/124 2023-09-30T17:00:52.812 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6447.g1d1 103/124 2023-09-30T17:00:53.209 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6447.g1d10b717.el 104/124 2023-09-30T17:00:53.408 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-2:18.0.0-6447.g1d10b717.el8.x86_64 105/124 2023-09-30T17:00:53.445 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6447.g1d10b717.el8.x86_64 105/124 2023-09-30T17:00:53.639 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-mgr-rook-2:18.0.0-6447.g1d10b717.el8.noarch 106/124 2023-09-30T17:00:53.650 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6447.g1d10b717.el8.noarch 106/124 2023-09-30T17:00:54.921 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6447.g1d10b717.el8.x86_64 93/124 2023-09-30T17:00:54.921 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /sys 2023-09-30T17:00:54.921 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /proc 2023-09-30T17:00:54.921 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /dev 2023-09-30T17:00:54.921 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /run 2023-09-30T17:00:54.921 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /mnt 2023-09-30T17:00:54.921 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /var/tmp 2023-09-30T17:00:54.921 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /home 2023-09-30T17:00:54.921 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /tmp 2023-09-30T17:00:54.922 INFO:teuthology.orchestra.run.smithi031.stdout:skipping the directory /dev 2023-09-30T17:00:54.922 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-09-30T17:00:55.057 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-2:18.0.0-6447.g1d10b717.el8.x86_64 107/124 2023-09-30T17:00:55.283 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-volume-2:18.0.0-6447.g1d10b717.el8.noarch 94/124 2023-09-30T17:00:55.298 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-radosgw-2:18.0.0-6447.g1d10b717.el8.x86_64 108/124 2023-09-30T17:00:55.334 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6447.g1d10b717.el8.x86_64 108/124 2023-09-30T17:00:55.480 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6447.g1d10b 109/124 2023-09-30T17:00:55.862 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6447.g1d10b 109/124 2023-09-30T17:00:56.039 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : rbd-mirror-2:18.0.0-6447.g1d10b717.el8.x86_64 110/124 2023-09-30T17:00:56.983 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-volume-2:18.0.0-6447.g1d10b717.el8.noarch 94/124 2023-09-30T17:00:57.177 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-osd-2:18.0.0-6447.g1d10b717.el8.x86_64 95/124 2023-09-30T17:00:57.409 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-osd-2:18.0.0-6447.g1d10b717.el8.x86_64 95/124 2023-09-30T17:00:57.600 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mds-2:18.0.0-6447.g1d10b717.el8.x86_64 96/124 2023-09-30T17:00:58.084 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mds-2:18.0.0-6447.g1d10b717.el8.x86_64 96/124 2023-09-30T17:00:58.250 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mon-2:18.0.0-6447.g1d10b717.el8.x86_64 97/124 2023-09-30T17:00:58.267 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mon-2:18.0.0-6447.g1d10b717.el8.x86_64 97/124 2023-09-30T17:01:00.033 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6447.g1d10b717.el8.x86_64 93/124 2023-09-30T17:01:00.034 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /sys 2023-09-30T17:01:00.034 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /proc 2023-09-30T17:01:00.034 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /dev 2023-09-30T17:01:00.034 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /run 2023-09-30T17:01:00.034 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /mnt 2023-09-30T17:01:00.034 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /var/tmp 2023-09-30T17:01:00.034 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /home 2023-09-30T17:01:00.034 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /tmp 2023-09-30T17:01:00.034 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /dev 2023-09-30T17:01:00.035 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-09-30T17:01:00.096 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: cephadm-2:18.0.0-6447.g1d10b717.el8.noarch 98/124 2023-09-30T17:01:00.110 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-selinux-2:18.0.0-6447.g1d10b717.el8.x86_64 93/124 2023-09-30T17:01:00.111 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /sys 2023-09-30T17:01:00.111 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /proc 2023-09-30T17:01:00.111 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /dev 2023-09-30T17:01:00.111 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /run 2023-09-30T17:01:00.111 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /mnt 2023-09-30T17:01:00.111 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /var/tmp 2023-09-30T17:01:00.111 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /home 2023-09-30T17:01:00.111 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /tmp 2023-09-30T17:01:00.111 INFO:teuthology.orchestra.run.smithi072.stdout:skipping the directory /dev 2023-09-30T17:01:00.111 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-09-30T17:01:00.304 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : cephadm-2:18.0.0-6447.g1d10b717.el8.noarch 98/124 2023-09-30T17:01:00.403 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-volume-2:18.0.0-6447.g1d10b717.el8.noarch 94/124 2023-09-30T17:01:00.422 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6447.g1d10b717.e 99/124 2023-09-30T17:01:00.467 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-volume-2:18.0.0-6447.g1d10b717.el8.noarch 94/124 2023-09-30T17:01:00.611 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6447.g1d10b717. 100/124 2023-09-30T17:01:00.807 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6447.g1d10b717.el8.noa 101/124 2023-09-30T17:01:00.978 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6447.g1d10b717.el8.x86_64 110/124 2023-09-30T17:01:01.036 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6447.g1d10b717.el8.noa 101/124 2023-09-30T17:01:01.350 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6447.g1d10b717.el8.n 102/124 2023-09-30T17:01:01.912 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-test-2:18.0.0-6447.g1d10b717.el8.x86_64 111/124 2023-09-30T17:01:02.007 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-volume-2:18.0.0-6447.g1d10b717.el8.noarch 94/124 2023-09-30T17:01:02.060 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-volume-2:18.0.0-6447.g1d10b717.el8.noarch 94/124 2023-09-30T17:01:02.190 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-osd-2:18.0.0-6447.g1d10b717.el8.x86_64 95/124 2023-09-30T17:01:02.238 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-osd-2:18.0.0-6447.g1d10b717.el8.x86_64 95/124 2023-09-30T17:01:02.254 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 112/124 2023-09-30T17:01:02.375 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6447.g1d10b717.el8.n 102/124 2023-09-30T17:01:02.410 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-osd-2:18.0.0-6447.g1d10b717.el8.x86_64 95/124 2023-09-30T17:01:02.412 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : ceph-fuse-2:18.0.0-6447.g1d10b717.el8.x86_64 113/124 2023-09-30T17:01:02.458 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-osd-2:18.0.0-6447.g1d10b717.el8.x86_64 95/124 2023-09-30T17:01:02.515 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6447.g1d1 103/124 2023-09-30T17:01:02.586 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mds-2:18.0.0-6447.g1d10b717.el8.x86_64 96/124 2023-09-30T17:01:02.612 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6447.g1d1 103/124 2023-09-30T17:01:02.645 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 114/124 2023-09-30T17:01:02.666 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mds-2:18.0.0-6447.g1d10b717.el8.x86_64 96/124 2023-09-30T17:01:02.803 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libtool-2.4.6-25.el8.x86_64 115/124 2023-09-30T17:01:02.816 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 115/124 2023-09-30T17:01:02.994 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6447.g1d10b717.el 104/124 2023-09-30T17:01:03.034 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libcephfs-devel-2:18.0.0-6447.g1d10b717.el8.x86_ 116/124 2023-09-30T17:01:03.041 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mds-2:18.0.0-6447.g1d10b717.el8.x86_64 96/124 2023-09-30T17:01:03.120 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mds-2:18.0.0-6447.g1d10b717.el8.x86_64 96/124 2023-09-30T17:01:03.171 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 117/124 2023-09-30T17:01:03.184 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-2:18.0.0-6447.g1d10b717.el8.x86_64 105/124 2023-09-30T17:01:03.221 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6447.g1d10b717.el8.x86_64 105/124 2023-09-30T17:01:03.235 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mon-2:18.0.0-6447.g1d10b717.el8.x86_64 97/124 2023-09-30T17:01:03.253 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mon-2:18.0.0-6447.g1d10b717.el8.x86_64 97/124 2023-09-30T17:01:03.363 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : rbd-fuse-2:18.0.0-6447.g1d10b717.el8.x86_64 118/124 2023-09-30T17:01:03.366 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mon-2:18.0.0-6447.g1d10b717.el8.x86_64 97/124 2023-09-30T17:01:03.383 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mon-2:18.0.0-6447.g1d10b717.el8.x86_64 97/124 2023-09-30T17:01:03.390 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-mgr-rook-2:18.0.0-6447.g1d10b717.el8.noarch 106/124 2023-09-30T17:01:03.402 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6447.g1d10b717.el8.noarch 106/124 2023-09-30T17:01:03.577 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : rbd-nbd-2:18.0.0-6447.g1d10b717.el8.x86_64 119/124 2023-09-30T17:01:03.753 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : flex-2.6.1-9.el8.x86_64 120/124 2023-09-30T17:01:03.837 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 120/124 2023-09-30T17:01:04.012 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : bison-3.0.4-10.el8.x86_64 121/124 2023-09-30T17:01:04.024 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 121/124 2023-09-30T17:01:04.156 INFO:teuthology.orchestra.run.smithi007.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 122/124 2023-09-30T17:01:04.156 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 123/124 2023-09-30T17:01:04.340 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 123/124 2023-09-30T17:01:04.340 INFO:teuthology.orchestra.run.smithi007.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 124/124 2023-09-30T17:01:04.802 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-2:18.0.0-6447.g1d10b717.el8.x86_64 107/124 2023-09-30T17:01:05.040 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-radosgw-2:18.0.0-6447.g1d10b717.el8.x86_64 108/124 2023-09-30T17:01:05.065 INFO:teuthology.orchestra.run.smithi007.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 124/124 2023-09-30T17:01:05.065 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-2:18.0.0-6447.g1d10b717.el8.x86_64 1/124 2023-09-30T17:01:05.066 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-base-2:18.0.0-6447.g1d10b717.el8.x86_64 2/124 2023-09-30T17:01:05.066 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-common-2:18.0.0-6447.g1d10b717.el8.x86_64 3/124 2023-09-30T17:01:05.066 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-fuse-2:18.0.0-6447.g1d10b717.el8.x86_64 4/124 2023-09-30T17:01:05.066 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6447.g1d10b 5/124 2023-09-30T17:01:05.066 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mds-2:18.0.0-6447.g1d10b717.el8.x86_64 6/124 2023-09-30T17:01:05.066 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-2:18.0.0-6447.g1d10b717.el8.x86_64 7/124 2023-09-30T17:01:05.066 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mon-2:18.0.0-6447.g1d10b717.el8.x86_64 8/124 2023-09-30T17:01:05.066 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-osd-2:18.0.0-6447.g1d10b717.el8.x86_64 9/124 2023-09-30T17:01:05.066 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-radosgw-2:18.0.0-6447.g1d10b717.el8.x86_64 10/124 2023-09-30T17:01:05.066 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-selinux-2:18.0.0-6447.g1d10b717.el8.x86_64 11/124 2023-09-30T17:01:05.067 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-test-2:18.0.0-6447.g1d10b717.el8.x86_64 12/124 2023-09-30T17:01:05.067 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libcephfs-devel-2:18.0.0-6447.g1d10b717.el8.x86_ 13/124 2023-09-30T17:01:05.067 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libcephfs2-2:18.0.0-6447.g1d10b717.el8.x86_64 14/124 2023-09-30T17:01:05.067 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libcephsqlite-2:18.0.0-6447.g1d10b717.el8.x86_64 15/124 2023-09-30T17:01:05.067 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librados-devel-2:18.0.0-6447.g1d10b717.el8.x86_6 16/124 2023-09-30T17:01:05.067 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libradosstriper1-2:18.0.0-6447.g1d10b717.el8.x86 17/124 2023-09-30T17:01:05.067 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librgw2-2:18.0.0-6447.g1d10b717.el8.x86_64 18/124 2023-09-30T17:01:05.067 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6447.g1d10b717.el 19/124 2023-09-30T17:01:05.067 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-ceph-common-2:18.0.0-6447.g1d10b717.el8. 20/124 2023-09-30T17:01:05.067 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cephfs-2:18.0.0-6447.g1d10b717.el8.x86_6 21/124 2023-09-30T17:01:05.068 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rados-2:18.0.0-6447.g1d10b717.el8.x86_64 22/124 2023-09-30T17:01:05.068 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rbd-2:18.0.0-6447.g1d10b717.el8.x86_64 23/124 2023-09-30T17:01:05.068 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rgw-2:18.0.0-6447.g1d10b717.el8.x86_64 24/124 2023-09-30T17:01:05.068 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : rbd-fuse-2:18.0.0-6447.g1d10b717.el8.x86_64 25/124 2023-09-30T17:01:05.068 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : rbd-mirror-2:18.0.0-6447.g1d10b717.el8.x86_64 26/124 2023-09-30T17:01:05.068 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : rbd-nbd-2:18.0.0-6447.g1d10b717.el8.x86_64 27/124 2023-09-30T17:01:05.068 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6447.g1d10b717. 28/124 2023-09-30T17:01:05.068 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6447.g1d10b717.el8.noa 29/124 2023-09-30T17:01:05.069 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cephadm-2:18.0.0-6447.g1d10b717.el8.noarch 98/124 2023-09-30T17:01:05.077 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6447.g1d10b717.el8.n 30/124 2023-09-30T17:01:05.077 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6447.g1d1 31/124 2023-09-30T17:01:05.077 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6447.g1d10b717.el 32/124 2023-09-30T17:01:05.077 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6447.g1d10b717.el8.noarch 33/124 2023-09-30T17:01:05.077 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6447.g1d10b717.e 34/124 2023-09-30T17:01:05.077 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : ceph-volume-2:18.0.0-6447.g1d10b717.el8.noarch 35/124 2023-09-30T17:01:05.078 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : cephadm-2:18.0.0-6447.g1d10b717.el8.noarch 36/124 2023-09-30T17:01:05.078 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 37/124 2023-09-30T17:01:05.078 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 38/124 2023-09-30T17:01:05.078 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 39/124 2023-09-30T17:01:05.078 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 40/124 2023-09-30T17:01:05.078 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 41/124 2023-09-30T17:01:05.078 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 42/124 2023-09-30T17:01:05.078 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 43/124 2023-09-30T17:01:05.078 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 44/124 2023-09-30T17:01:05.078 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 45/124 2023-09-30T17:01:05.079 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 46/124 2023-09-30T17:01:05.079 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 47/124 2023-09-30T17:01:05.079 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 48/124 2023-09-30T17:01:05.079 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 49/124 2023-09-30T17:01:05.079 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 50/124 2023-09-30T17:01:05.079 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 51/124 2023-09-30T17:01:05.079 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 52/124 2023-09-30T17:01:05.079 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 53/124 2023-09-30T17:01:05.079 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 54/124 2023-09-30T17:01:05.079 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-portend-2.6-1.el8.noarch 55/124 2023-09-30T17:01:05.080 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 56/124 2023-09-30T17:01:05.080 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 57/124 2023-09-30T17:01:05.080 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 58/124 2023-09-30T17:01:05.080 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 59/124 2023-09-30T17:01:05.080 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 60/124 2023-09-30T17:01:05.080 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 61/124 2023-09-30T17:01:05.080 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 62/124 2023-09-30T17:01:05.080 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 63/124 2023-09-30T17:01:05.080 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 64/124 2023-09-30T17:01:05.080 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 65/124 2023-09-30T17:01:05.080 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 66/124 2023-09-30T17:01:05.081 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 67/124 2023-09-30T17:01:05.081 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 68/124 2023-09-30T17:01:05.081 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 69/124 2023-09-30T17:01:05.081 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 70/124 2023-09-30T17:01:05.081 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 71/124 2023-09-30T17:01:05.081 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 72/124 2023-09-30T17:01:05.081 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 73/124 2023-09-30T17:01:05.081 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 74/124 2023-09-30T17:01:05.081 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 75/124 2023-09-30T17:01:05.081 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 76/124 2023-09-30T17:01:05.082 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 77/124 2023-09-30T17:01:05.082 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 78/124 2023-09-30T17:01:05.082 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 79/124 2023-09-30T17:01:05.082 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 80/124 2023-09-30T17:01:05.082 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 81/124 2023-09-30T17:01:05.082 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 82/124 2023-09-30T17:01:05.082 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 83/124 2023-09-30T17:01:05.082 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 84/124 2023-09-30T17:01:05.082 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 85/124 2023-09-30T17:01:05.082 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 86/124 2023-09-30T17:01:05.083 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 87/124 2023-09-30T17:01:05.083 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 88/124 2023-09-30T17:01:05.083 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 89/124 2023-09-30T17:01:05.083 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 90/124 2023-09-30T17:01:05.083 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 91/124 2023-09-30T17:01:05.083 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 92/124 2023-09-30T17:01:05.083 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 93/124 2023-09-30T17:01:05.083 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 94/124 2023-09-30T17:01:05.083 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 95/124 2023-09-30T17:01:05.083 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 96/124 2023-09-30T17:01:05.083 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 97/124 2023-09-30T17:01:05.084 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 98/124 2023-09-30T17:01:05.084 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 99/124 2023-09-30T17:01:05.084 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 100/124 2023-09-30T17:01:05.084 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : bison-3.0.4-10.el8.x86_64 101/124 2023-09-30T17:01:05.084 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 102/124 2023-09-30T17:01:05.084 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 103/124 2023-09-30T17:01:05.084 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 104/124 2023-09-30T17:01:05.084 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : automake-1.16.1-7.el8.noarch 105/124 2023-09-30T17:01:05.084 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 106/124 2023-09-30T17:01:05.084 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 107/124 2023-09-30T17:01:05.084 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : flex-2.6.1-9.el8.x86_64 108/124 2023-09-30T17:01:05.085 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 109/124 2023-09-30T17:01:05.085 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 110/124 2023-09-30T17:01:05.085 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 111/124 2023-09-30T17:01:05.085 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 112/124 2023-09-30T17:01:05.085 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 113/124 2023-09-30T17:01:05.085 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 114/124 2023-09-30T17:01:05.085 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 115/124 2023-09-30T17:01:05.085 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 116/124 2023-09-30T17:01:05.085 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 117/124 2023-09-30T17:01:05.085 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 118/124 2023-09-30T17:01:05.085 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : jq-1.6-3.el8.x86_64 119/124 2023-09-30T17:01:05.086 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 120/124 2023-09-30T17:01:05.086 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librados2-2:18.0.0-6447.g1d10b717.el8.x86_64 121/124 2023-09-30T17:01:05.086 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 122/124 2023-09-30T17:01:05.086 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librbd1-2:18.0.0-6447.g1d10b717.el8.x86_64 123/124 2023-09-30T17:01:05.086 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6447.g1d10b717.el8.x86_64 108/124 2023-09-30T17:01:05.106 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: cephadm-2:18.0.0-6447.g1d10b717.el8.noarch 98/124 2023-09-30T17:01:05.224 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6447.g1d10b 109/124 2023-09-30T17:01:05.276 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephadm-2:18.0.0-6447.g1d10b717.el8.noarch 98/124 2023-09-30T17:01:05.325 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : cephadm-2:18.0.0-6447.g1d10b717.el8.noarch 98/124 2023-09-30T17:01:05.399 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6447.g1d10b717.e 99/124 2023-09-30T17:01:05.429 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-prometheus-alerts-2:18.0.0-6447.g1d10b717.e 99/124 2023-09-30T17:01:05.577 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6447.g1d10b717. 100/124 2023-09-30T17:01:05.606 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6447.g1d10b 109/124 2023-09-30T17:01:05.648 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-grafana-dashboards-2:18.0.0-6447.g1d10b717. 100/124 2023-09-30T17:01:05.790 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : rbd-mirror-2:18.0.0-6447.g1d10b717.el8.x86_64 110/124 2023-09-30T17:01:05.809 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6447.g1d10b717.el8.noa 101/124 2023-09-30T17:01:05.840 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-cephadm-2:18.0.0-6447.g1d10b717.el8.noa 101/124 2023-09-30T17:01:06.032 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6447.g1d10b717.el8.noa 101/124 2023-09-30T17:01:06.060 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.0.0-6447.g1d10b717.el8.noa 101/124 2023-09-30T17:01:06.331 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6447.g1d10b717.el8.n 102/124 2023-09-30T17:01:06.345 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-dashboard-2:18.0.0-6447.g1d10b717.el8.n 102/124 2023-09-30T17:01:07.292 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6447.g1d10b717.el8.n 102/124 2023-09-30T17:01:07.304 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.0.0-6447.g1d10b717.el8.n 102/124 2023-09-30T17:01:07.457 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6447.g1d1 103/124 2023-09-30T17:01:07.467 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-diskprediction-local-2:18.0.0-6447.g1d1 103/124 2023-09-30T17:01:07.548 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6447.g1d1 103/124 2023-09-30T17:01:07.562 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.0.0-6447.g1d1 103/124 2023-09-30T17:01:07.699 INFO:teuthology.orchestra.run.smithi007.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 124/124 2023-09-30T17:01:07.699 INFO:teuthology.orchestra.run.smithi007.stdout:Last metadata expiration check: 0:01:44 ago on Sat 30 Sep 2023 04:59:23 PM UTC. 2023-09-30T17:01:07.946 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6447.g1d10b717.el 104/124 2023-09-30T17:01:07.947 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-modules-core-2:18.0.0-6447.g1d10b717.el 104/124 2023-09-30T17:01:08.129 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-2:18.0.0-6447.g1d10b717.el8.x86_64 105/124 2023-09-30T17:01:08.131 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-2:18.0.0-6447.g1d10b717.el8.x86_64 105/124 2023-09-30T17:01:08.163 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6447.g1d10b717.el8.x86_64 105/124 2023-09-30T17:01:08.168 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-2:18.0.0-6447.g1d10b717.el8.x86_64 105/124 2023-09-30T17:01:08.351 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-rook-2:18.0.0-6447.g1d10b717.el8.noarch 106/124 2023-09-30T17:01:08.363 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6447.g1d10b717.el8.noarch 106/124 2023-09-30T17:01:08.374 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-mgr-rook-2:18.0.0-6447.g1d10b717.el8.noarch 106/124 2023-09-30T17:01:08.385 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-mgr-rook-2:18.0.0-6447.g1d10b717.el8.noarch 106/124 2023-09-30T17:01:09.719 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-2:18.0.0-6447.g1d10b717.el8.x86_64 107/124 2023-09-30T17:01:09.727 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-2:18.0.0-6447.g1d10b717.el8.x86_64 107/124 2023-09-30T17:01:09.949 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-radosgw-2:18.0.0-6447.g1d10b717.el8.x86_64 108/124 2023-09-30T17:01:09.969 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-radosgw-2:18.0.0-6447.g1d10b717.el8.x86_64 108/124 2023-09-30T17:01:09.983 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6447.g1d10b717.el8.x86_64 108/124 2023-09-30T17:01:10.005 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-radosgw-2:18.0.0-6447.g1d10b717.el8.x86_64 108/124 2023-09-30T17:01:10.132 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6447.g1d10b 109/124 2023-09-30T17:01:10.168 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-immutable-object-cache-2:18.0.0-6447.g1d10b 109/124 2023-09-30T17:01:10.218 INFO:teuthology.orchestra.run.smithi007.stdout:Installed products updated. 2023-09-30T17:01:10.458 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:01:10.458 INFO:teuthology.orchestra.run.smithi007.stdout:Upgraded: 2023-09-30T17:01:10.458 INFO:teuthology.orchestra.run.smithi007.stdout: librados2-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:10.458 INFO:teuthology.orchestra.run.smithi007.stdout: librbd1-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:10.458 INFO:teuthology.orchestra.run.smithi007.stdout:Installed: 2023-09-30T17:01:10.458 INFO:teuthology.orchestra.run.smithi007.stdout: automake-1.16.1-7.el8.noarch 2023-09-30T17:01:10.458 INFO:teuthology.orchestra.run.smithi007.stdout: bison-3.0.4-10.el8.x86_64 2023-09-30T17:01:10.458 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:10.459 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-base-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:10.459 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-common-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:10.459 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-fuse-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:10.459 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-grafana-dashboards-2:18.0.0-6447.g1d10b717.el8.noarch 2023-09-30T17:01:10.459 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-immutable-object-cache-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:10.459 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mds-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:10.459 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:10.459 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-cephadm-2:18.0.0-6447.g1d10b717.el8.noarch 2023-09-30T17:01:10.459 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-dashboard-2:18.0.0-6447.g1d10b717.el8.noarch 2023-09-30T17:01:10.459 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6447.g1d10b717.el8.noarch 2023-09-30T17:01:10.459 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-modules-core-2:18.0.0-6447.g1d10b717.el8.noarch 2023-09-30T17:01:10.459 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mgr-rook-2:18.0.0-6447.g1d10b717.el8.noarch 2023-09-30T17:01:10.460 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-mon-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:10.460 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-osd-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:10.460 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-prometheus-alerts-2:18.0.0-6447.g1d10b717.el8.noarch 2023-09-30T17:01:10.460 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-radosgw-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:10.460 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-selinux-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:10.460 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-test-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:10.460 INFO:teuthology.orchestra.run.smithi007.stdout: ceph-volume-2:18.0.0-6447.g1d10b717.el8.noarch 2023-09-30T17:01:10.460 INFO:teuthology.orchestra.run.smithi007.stdout: cephadm-2:18.0.0-6447.g1d10b717.el8.noarch 2023-09-30T17:01:10.460 INFO:teuthology.orchestra.run.smithi007.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-09-30T17:01:10.460 INFO:teuthology.orchestra.run.smithi007.stdout: flex-2.6.1-9.el8.x86_64 2023-09-30T17:01:10.460 INFO:teuthology.orchestra.run.smithi007.stdout: fuse-2.9.7-15.el8.x86_64 2023-09-30T17:01:10.461 INFO:teuthology.orchestra.run.smithi007.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-09-30T17:01:10.461 INFO:teuthology.orchestra.run.smithi007.stdout: jq-1.6-3.el8.x86_64 2023-09-30T17:01:10.461 INFO:teuthology.orchestra.run.smithi007.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-09-30T17:01:10.461 INFO:teuthology.orchestra.run.smithi007.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-09-30T17:01:10.461 INFO:teuthology.orchestra.run.smithi007.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-09-30T17:01:10.461 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs-devel-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:10.461 INFO:teuthology.orchestra.run.smithi007.stdout: libcephfs2-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:10.461 INFO:teuthology.orchestra.run.smithi007.stdout: libcephsqlite-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:10.461 INFO:teuthology.orchestra.run.smithi007.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-09-30T17:01:10.461 INFO:teuthology.orchestra.run.smithi007.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-09-30T17:01:10.461 INFO:teuthology.orchestra.run.smithi007.stdout: liboath-2.6.2-3.el8.x86_64 2023-09-30T17:01:10.461 INFO:teuthology.orchestra.run.smithi007.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-09-30T17:01:10.462 INFO:teuthology.orchestra.run.smithi007.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-09-30T17:01:10.462 INFO:teuthology.orchestra.run.smithi007.stdout: librados-devel-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:10.462 INFO:teuthology.orchestra.run.smithi007.stdout: libradosstriper1-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:10.462 INFO:teuthology.orchestra.run.smithi007.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-09-30T17:01:10.462 INFO:teuthology.orchestra.run.smithi007.stdout: librgw2-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:10.462 INFO:teuthology.orchestra.run.smithi007.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-09-30T17:01:10.462 INFO:teuthology.orchestra.run.smithi007.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-09-30T17:01:10.462 INFO:teuthology.orchestra.run.smithi007.stdout: libtool-2.4.6-25.el8.x86_64 2023-09-30T17:01:10.462 INFO:teuthology.orchestra.run.smithi007.stdout: libunwind-1.3.1-3.el8.x86_64 2023-09-30T17:01:10.462 INFO:teuthology.orchestra.run.smithi007.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-09-30T17:01:10.462 INFO:teuthology.orchestra.run.smithi007.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-09-30T17:01:10.463 INFO:teuthology.orchestra.run.smithi007.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-09-30T17:01:10.463 INFO:teuthology.orchestra.run.smithi007.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-09-30T17:01:10.463 INFO:teuthology.orchestra.run.smithi007.stdout: openblas-0.3.15-3.el8.x86_64 2023-09-30T17:01:10.463 INFO:teuthology.orchestra.run.smithi007.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-09-30T17:01:10.463 INFO:teuthology.orchestra.run.smithi007.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-09-30T17:01:10.463 INFO:teuthology.orchestra.run.smithi007.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-09-30T17:01:10.463 INFO:teuthology.orchestra.run.smithi007.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-09-30T17:01:10.463 INFO:teuthology.orchestra.run.smithi007.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-09-30T17:01:10.463 INFO:teuthology.orchestra.run.smithi007.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-09-30T17:01:10.463 INFO:teuthology.orchestra.run.smithi007.stdout: python3-babel-2.5.1-7.el8.noarch 2023-09-30T17:01:10.463 INFO:teuthology.orchestra.run.smithi007.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-09-30T17:01:10.463 INFO:teuthology.orchestra.run.smithi007.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-09-30T17:01:10.464 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-09-30T17:01:10.464 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-argparse-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:10.464 INFO:teuthology.orchestra.run.smithi007.stdout: python3-ceph-common-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:10.464 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cephfs-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:10.464 INFO:teuthology.orchestra.run.smithi007.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-09-30T17:01:10.464 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-09-30T17:01:10.464 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-09-30T17:01:10.464 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-09-30T17:01:10.464 INFO:teuthology.orchestra.run.smithi007.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-09-30T17:01:10.464 INFO:teuthology.orchestra.run.smithi007.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-09-30T17:01:10.464 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-6.2-6.el8.noarch 2023-09-30T17:01:10.464 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-09-30T17:01:10.465 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-09-30T17:01:10.465 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-09-30T17:01:10.465 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-09-30T17:01:10.465 INFO:teuthology.orchestra.run.smithi007.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-09-30T17:01:10.465 INFO:teuthology.orchestra.run.smithi007.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-09-30T17:01:10.465 INFO:teuthology.orchestra.run.smithi007.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-09-30T17:01:10.465 INFO:teuthology.orchestra.run.smithi007.stdout: python3-mako-1.0.6-13.el8.noarch 2023-09-30T17:01:10.465 INFO:teuthology.orchestra.run.smithi007.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-09-30T17:01:10.465 INFO:teuthology.orchestra.run.smithi007.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-09-30T17:01:10.465 INFO:teuthology.orchestra.run.smithi007.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-09-30T17:01:10.465 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-09-30T17:01:10.465 INFO:teuthology.orchestra.run.smithi007.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-09-30T17:01:10.466 INFO:teuthology.orchestra.run.smithi007.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-09-30T17:01:10.466 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-09-30T17:01:10.466 INFO:teuthology.orchestra.run.smithi007.stdout: python3-portend-2.6-1.el8.noarch 2023-09-30T17:01:10.466 INFO:teuthology.orchestra.run.smithi007.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-09-30T17:01:10.466 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-09-30T17:01:10.466 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-09-30T17:01:10.466 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-09-30T17:01:10.466 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pycparser-2.14-14.el8.noarch 2023-09-30T17:01:10.466 INFO:teuthology.orchestra.run.smithi007.stdout: python3-pytz-2017.2-9.el8.noarch 2023-09-30T17:01:10.466 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rados-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:10.466 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rbd-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:10.467 INFO:teuthology.orchestra.run.smithi007.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-09-30T17:01:10.467 INFO:teuthology.orchestra.run.smithi007.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-09-30T17:01:10.467 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rgw-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:10.467 INFO:teuthology.orchestra.run.smithi007.stdout: python3-routes-2.4.1-12.el8.noarch 2023-09-30T17:01:10.467 INFO:teuthology.orchestra.run.smithi007.stdout: python3-rsa-4.9-2.el8.noarch 2023-09-30T17:01:10.467 INFO:teuthology.orchestra.run.smithi007.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-09-30T17:01:10.467 INFO:teuthology.orchestra.run.smithi007.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-09-30T17:01:10.467 INFO:teuthology.orchestra.run.smithi007.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-09-30T17:01:10.467 INFO:teuthology.orchestra.run.smithi007.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-09-30T17:01:10.467 INFO:teuthology.orchestra.run.smithi007.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-09-30T17:01:10.467 INFO:teuthology.orchestra.run.smithi007.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-09-30T17:01:10.467 INFO:teuthology.orchestra.run.smithi007.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-09-30T17:01:10.468 INFO:teuthology.orchestra.run.smithi007.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-09-30T17:01:10.468 INFO:teuthology.orchestra.run.smithi007.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-09-30T17:01:10.468 INFO:teuthology.orchestra.run.smithi007.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-09-30T17:01:10.468 INFO:teuthology.orchestra.run.smithi007.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-09-30T17:01:10.468 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-fuse-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:10.468 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-mirror-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:10.468 INFO:teuthology.orchestra.run.smithi007.stdout: rbd-nbd-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:10.468 INFO:teuthology.orchestra.run.smithi007.stdout: socat-1.7.4.1-1.el8.x86_64 2023-09-30T17:01:10.468 INFO:teuthology.orchestra.run.smithi007.stdout: thrift-0.13.0-2.el8.x86_64 2023-09-30T17:01:10.468 INFO:teuthology.orchestra.run.smithi007.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-09-30T17:01:10.468 INFO:teuthology.orchestra.run.smithi007.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-09-30T17:01:10.469 INFO:teuthology.orchestra.run.smithi007.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-09-30T17:01:10.469 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:01:10.469 INFO:teuthology.orchestra.run.smithi007.stdout:Complete! 2023-09-30T17:01:10.493 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6447.g1d10b 109/124 2023-09-30T17:01:10.527 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.0.0-6447.g1d10b 109/124 2023-09-30T17:01:10.657 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-mirror-2:18.0.0-6447.g1d10b717.el8.x86_64 110/124 2023-09-30T17:01:10.684 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-mirror-2:18.0.0-6447.g1d10b717.el8.x86_64 110/124 2023-09-30T17:01:10.707 DEBUG:teuthology.parallel:result is None 2023-09-30T17:01:10.735 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6447.g1d10b717.el8.x86_64 110/124 2023-09-30T17:01:11.651 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-test-2:18.0.0-6447.g1d10b717.el8.x86_64 111/124 2023-09-30T17:01:11.972 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 112/124 2023-09-30T17:01:12.159 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : ceph-fuse-2:18.0.0-6447.g1d10b717.el8.x86_64 113/124 2023-09-30T17:01:12.402 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 114/124 2023-09-30T17:01:12.588 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libtool-2.4.6-25.el8.x86_64 115/124 2023-09-30T17:01:12.601 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 115/124 2023-09-30T17:01:12.802 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libcephfs-devel-2:18.0.0-6447.g1d10b717.el8.x86_ 116/124 2023-09-30T17:01:12.939 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 117/124 2023-09-30T17:01:13.131 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : rbd-fuse-2:18.0.0-6447.g1d10b717.el8.x86_64 118/124 2023-09-30T17:01:13.335 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : rbd-nbd-2:18.0.0-6447.g1d10b717.el8.x86_64 119/124 2023-09-30T17:01:13.505 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : flex-2.6.1-9.el8.x86_64 120/124 2023-09-30T17:01:13.595 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 120/124 2023-09-30T17:01:13.755 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : bison-3.0.4-10.el8.x86_64 121/124 2023-09-30T17:01:13.768 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 121/124 2023-09-30T17:01:13.891 INFO:teuthology.orchestra.run.smithi031.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 122/124 2023-09-30T17:01:13.891 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 123/124 2023-09-30T17:01:14.100 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 123/124 2023-09-30T17:01:14.100 INFO:teuthology.orchestra.run.smithi031.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 124/124 2023-09-30T17:01:14.857 INFO:teuthology.orchestra.run.smithi031.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 124/124 2023-09-30T17:01:14.857 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-2:18.0.0-6447.g1d10b717.el8.x86_64 1/124 2023-09-30T17:01:14.857 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-base-2:18.0.0-6447.g1d10b717.el8.x86_64 2/124 2023-09-30T17:01:14.857 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-common-2:18.0.0-6447.g1d10b717.el8.x86_64 3/124 2023-09-30T17:01:14.857 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-fuse-2:18.0.0-6447.g1d10b717.el8.x86_64 4/124 2023-09-30T17:01:14.858 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6447.g1d10b 5/124 2023-09-30T17:01:14.858 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mds-2:18.0.0-6447.g1d10b717.el8.x86_64 6/124 2023-09-30T17:01:14.858 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-2:18.0.0-6447.g1d10b717.el8.x86_64 7/124 2023-09-30T17:01:14.858 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mon-2:18.0.0-6447.g1d10b717.el8.x86_64 8/124 2023-09-30T17:01:14.858 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-osd-2:18.0.0-6447.g1d10b717.el8.x86_64 9/124 2023-09-30T17:01:14.858 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-radosgw-2:18.0.0-6447.g1d10b717.el8.x86_64 10/124 2023-09-30T17:01:14.858 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-selinux-2:18.0.0-6447.g1d10b717.el8.x86_64 11/124 2023-09-30T17:01:14.858 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-test-2:18.0.0-6447.g1d10b717.el8.x86_64 12/124 2023-09-30T17:01:14.867 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libcephfs-devel-2:18.0.0-6447.g1d10b717.el8.x86_ 13/124 2023-09-30T17:01:14.868 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libcephfs2-2:18.0.0-6447.g1d10b717.el8.x86_64 14/124 2023-09-30T17:01:14.868 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libcephsqlite-2:18.0.0-6447.g1d10b717.el8.x86_64 15/124 2023-09-30T17:01:14.868 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librados-devel-2:18.0.0-6447.g1d10b717.el8.x86_6 16/124 2023-09-30T17:01:14.868 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libradosstriper1-2:18.0.0-6447.g1d10b717.el8.x86 17/124 2023-09-30T17:01:14.868 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librgw2-2:18.0.0-6447.g1d10b717.el8.x86_64 18/124 2023-09-30T17:01:14.868 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6447.g1d10b717.el 19/124 2023-09-30T17:01:14.868 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-ceph-common-2:18.0.0-6447.g1d10b717.el8. 20/124 2023-09-30T17:01:14.868 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cephfs-2:18.0.0-6447.g1d10b717.el8.x86_6 21/124 2023-09-30T17:01:14.868 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rados-2:18.0.0-6447.g1d10b717.el8.x86_64 22/124 2023-09-30T17:01:14.868 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rbd-2:18.0.0-6447.g1d10b717.el8.x86_64 23/124 2023-09-30T17:01:14.868 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rgw-2:18.0.0-6447.g1d10b717.el8.x86_64 24/124 2023-09-30T17:01:14.869 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : rbd-fuse-2:18.0.0-6447.g1d10b717.el8.x86_64 25/124 2023-09-30T17:01:14.869 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : rbd-mirror-2:18.0.0-6447.g1d10b717.el8.x86_64 26/124 2023-09-30T17:01:14.869 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : rbd-nbd-2:18.0.0-6447.g1d10b717.el8.x86_64 27/124 2023-09-30T17:01:14.869 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6447.g1d10b717. 28/124 2023-09-30T17:01:14.869 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6447.g1d10b717.el8.noa 29/124 2023-09-30T17:01:14.869 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6447.g1d10b717.el8.n 30/124 2023-09-30T17:01:14.869 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6447.g1d1 31/124 2023-09-30T17:01:14.869 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6447.g1d10b717.el 32/124 2023-09-30T17:01:14.869 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6447.g1d10b717.el8.noarch 33/124 2023-09-30T17:01:14.869 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6447.g1d10b717.e 34/124 2023-09-30T17:01:14.869 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : ceph-volume-2:18.0.0-6447.g1d10b717.el8.noarch 35/124 2023-09-30T17:01:14.870 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : cephadm-2:18.0.0-6447.g1d10b717.el8.noarch 36/124 2023-09-30T17:01:14.870 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 37/124 2023-09-30T17:01:14.870 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 38/124 2023-09-30T17:01:14.870 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 39/124 2023-09-30T17:01:14.870 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 40/124 2023-09-30T17:01:14.870 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 41/124 2023-09-30T17:01:14.870 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 42/124 2023-09-30T17:01:14.870 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 43/124 2023-09-30T17:01:14.870 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 44/124 2023-09-30T17:01:14.870 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 45/124 2023-09-30T17:01:14.870 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 46/124 2023-09-30T17:01:14.870 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 47/124 2023-09-30T17:01:14.871 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 48/124 2023-09-30T17:01:14.871 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 49/124 2023-09-30T17:01:14.871 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 50/124 2023-09-30T17:01:14.871 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 51/124 2023-09-30T17:01:14.871 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 52/124 2023-09-30T17:01:14.871 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 53/124 2023-09-30T17:01:14.871 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 54/124 2023-09-30T17:01:14.871 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-portend-2.6-1.el8.noarch 55/124 2023-09-30T17:01:14.871 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 56/124 2023-09-30T17:01:14.871 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 57/124 2023-09-30T17:01:14.871 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 58/124 2023-09-30T17:01:14.872 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 59/124 2023-09-30T17:01:14.872 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 60/124 2023-09-30T17:01:14.872 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 61/124 2023-09-30T17:01:14.872 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 62/124 2023-09-30T17:01:14.872 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 63/124 2023-09-30T17:01:14.872 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 64/124 2023-09-30T17:01:14.872 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 65/124 2023-09-30T17:01:14.872 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 66/124 2023-09-30T17:01:14.872 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 67/124 2023-09-30T17:01:14.872 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 68/124 2023-09-30T17:01:14.872 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 69/124 2023-09-30T17:01:14.872 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 70/124 2023-09-30T17:01:14.873 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 71/124 2023-09-30T17:01:14.873 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 72/124 2023-09-30T17:01:14.873 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 73/124 2023-09-30T17:01:14.873 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 74/124 2023-09-30T17:01:14.873 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 75/124 2023-09-30T17:01:14.873 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 76/124 2023-09-30T17:01:14.873 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 77/124 2023-09-30T17:01:14.873 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 78/124 2023-09-30T17:01:14.873 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 79/124 2023-09-30T17:01:14.873 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 80/124 2023-09-30T17:01:14.873 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 81/124 2023-09-30T17:01:14.874 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 82/124 2023-09-30T17:01:14.874 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 83/124 2023-09-30T17:01:14.874 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 84/124 2023-09-30T17:01:14.874 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 85/124 2023-09-30T17:01:14.874 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 86/124 2023-09-30T17:01:14.874 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 87/124 2023-09-30T17:01:14.874 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 88/124 2023-09-30T17:01:14.874 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 89/124 2023-09-30T17:01:14.874 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 90/124 2023-09-30T17:01:14.874 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 91/124 2023-09-30T17:01:14.875 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 92/124 2023-09-30T17:01:14.875 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 93/124 2023-09-30T17:01:14.875 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 94/124 2023-09-30T17:01:14.875 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 95/124 2023-09-30T17:01:14.875 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 96/124 2023-09-30T17:01:14.875 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 97/124 2023-09-30T17:01:14.875 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 98/124 2023-09-30T17:01:14.875 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 99/124 2023-09-30T17:01:14.875 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 100/124 2023-09-30T17:01:14.875 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : bison-3.0.4-10.el8.x86_64 101/124 2023-09-30T17:01:14.875 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 102/124 2023-09-30T17:01:14.876 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 103/124 2023-09-30T17:01:14.876 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 104/124 2023-09-30T17:01:14.876 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : automake-1.16.1-7.el8.noarch 105/124 2023-09-30T17:01:14.876 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 106/124 2023-09-30T17:01:14.876 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 107/124 2023-09-30T17:01:14.876 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : flex-2.6.1-9.el8.x86_64 108/124 2023-09-30T17:01:14.876 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 109/124 2023-09-30T17:01:14.876 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 110/124 2023-09-30T17:01:14.876 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 111/124 2023-09-30T17:01:14.876 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 112/124 2023-09-30T17:01:14.876 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 113/124 2023-09-30T17:01:14.876 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 114/124 2023-09-30T17:01:14.877 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 115/124 2023-09-30T17:01:14.877 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 116/124 2023-09-30T17:01:14.877 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 117/124 2023-09-30T17:01:14.877 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 118/124 2023-09-30T17:01:14.877 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : jq-1.6-3.el8.x86_64 119/124 2023-09-30T17:01:14.877 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 120/124 2023-09-30T17:01:14.877 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librados2-2:18.0.0-6447.g1d10b717.el8.x86_64 121/124 2023-09-30T17:01:14.877 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 122/124 2023-09-30T17:01:14.877 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librbd1-2:18.0.0-6447.g1d10b717.el8.x86_64 123/124 2023-09-30T17:01:15.319 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6447.g1d10b717.el8.x86_64 110/124 2023-09-30T17:01:15.343 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: rbd-mirror-2:18.0.0-6447.g1d10b717.el8.x86_64 110/124 2023-09-30T17:01:15.638 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-test-2:18.0.0-6447.g1d10b717.el8.x86_64 111/124 2023-09-30T17:01:15.814 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libtool-2.4.6-25.el8.x86_64 112/124 2023-09-30T17:01:16.186 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-test-2:18.0.0-6447.g1d10b717.el8.x86_64 111/124 2023-09-30T17:01:16.461 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 112/124 2023-09-30T17:01:16.528 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 112/124 2023-09-30T17:01:16.685 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-fuse-2:18.0.0-6447.g1d10b717.el8.x86_64 113/124 2023-09-30T17:01:16.826 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : openssl-devel-1:1.1.1k-7.el8_6.x86_64 113/124 2023-09-30T17:01:16.934 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 114/124 2023-09-30T17:01:16.993 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : ceph-fuse-2:18.0.0-6447.g1d10b717.el8.x86_64 114/124 2023-09-30T17:01:17.091 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libtool-2.4.6-25.el8.x86_64 115/124 2023-09-30T17:01:17.103 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 115/124 2023-09-30T17:01:17.193 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : xfsprogs-devel-5.0.0-10.el8.x86_64 115/124 2023-09-30T17:01:17.320 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs-devel-2:18.0.0-6447.g1d10b717.el8.x86_ 116/124 2023-09-30T17:01:17.385 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libcephfs-devel-2:18.0.0-6447.g1d10b717.el8.x86_ 116/124 2023-09-30T17:01:17.491 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 117/124 2023-09-30T17:01:17.598 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : elfutils-libelf-devel-0.186-1.el8.x86_64 117/124 2023-09-30T17:01:17.618 INFO:teuthology.orchestra.run.smithi031.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 124/124 2023-09-30T17:01:17.618 INFO:teuthology.orchestra.run.smithi031.stdout:Last metadata expiration check: 0:01:54 ago on Sat 30 Sep 2023 04:59:23 PM UTC. 2023-09-30T17:01:17.691 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-fuse-2:18.0.0-6447.g1d10b717.el8.x86_64 118/124 2023-09-30T17:01:17.798 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-fuse-2:18.0.0-6447.g1d10b717.el8.x86_64 118/124 2023-09-30T17:01:17.948 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : rbd-nbd-2:18.0.0-6447.g1d10b717.el8.x86_64 119/124 2023-09-30T17:01:17.950 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-nbd-2:18.0.0-6447.g1d10b717.el8.x86_64 119/124 2023-09-30T17:01:18.120 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 120/124 2023-09-30T17:01:18.141 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flex-2.6.1-9.el8.x86_64 120/124 2023-09-30T17:01:18.227 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 120/124 2023-09-30T17:01:18.330 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : flex-2.6.1-9.el8.x86_64 121/124 2023-09-30T17:01:18.416 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : bison-3.0.4-10.el8.x86_64 121/124 2023-09-30T17:01:18.420 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 121/124 2023-09-30T17:01:18.428 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 121/124 2023-09-30T17:01:18.543 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 122/124 2023-09-30T17:01:18.543 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 123/124 2023-09-30T17:01:18.614 INFO:teuthology.orchestra.run.smithi072.stdout: Installing : bison-3.0.4-10.el8.x86_64 122/124 2023-09-30T17:01:18.628 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 122/124 2023-09-30T17:01:18.628 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 123/124 2023-09-30T17:01:18.727 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 123/124 2023-09-30T17:01:18.728 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 124/124 2023-09-30T17:01:18.834 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 123/124 2023-09-30T17:01:18.834 INFO:teuthology.orchestra.run.smithi072.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 124/124 2023-09-30T17:01:19.396 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 124/124 2023-09-30T17:01:19.397 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-2:18.0.0-6447.g1d10b717.el8.x86_64 1/124 2023-09-30T17:01:19.397 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-base-2:18.0.0-6447.g1d10b717.el8.x86_64 2/124 2023-09-30T17:01:19.397 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-common-2:18.0.0-6447.g1d10b717.el8.x86_64 3/124 2023-09-30T17:01:19.397 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-fuse-2:18.0.0-6447.g1d10b717.el8.x86_64 4/124 2023-09-30T17:01:19.397 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6447.g1d10b 5/124 2023-09-30T17:01:19.397 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mds-2:18.0.0-6447.g1d10b717.el8.x86_64 6/124 2023-09-30T17:01:19.397 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-2:18.0.0-6447.g1d10b717.el8.x86_64 7/124 2023-09-30T17:01:19.397 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mon-2:18.0.0-6447.g1d10b717.el8.x86_64 8/124 2023-09-30T17:01:19.397 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-osd-2:18.0.0-6447.g1d10b717.el8.x86_64 9/124 2023-09-30T17:01:19.397 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-radosgw-2:18.0.0-6447.g1d10b717.el8.x86_64 10/124 2023-09-30T17:01:19.397 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-selinux-2:18.0.0-6447.g1d10b717.el8.x86_64 11/124 2023-09-30T17:01:19.397 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-test-2:18.0.0-6447.g1d10b717.el8.x86_64 12/124 2023-09-30T17:01:19.398 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs-devel-2:18.0.0-6447.g1d10b717.el8.x86_ 13/124 2023-09-30T17:01:19.398 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs2-2:18.0.0-6447.g1d10b717.el8.x86_64 14/124 2023-09-30T17:01:19.398 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephsqlite-2:18.0.0-6447.g1d10b717.el8.x86_64 15/124 2023-09-30T17:01:19.398 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados-devel-2:18.0.0-6447.g1d10b717.el8.x86_6 16/124 2023-09-30T17:01:19.398 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libradosstriper1-2:18.0.0-6447.g1d10b717.el8.x86 17/124 2023-09-30T17:01:19.398 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librgw2-2:18.0.0-6447.g1d10b717.el8.x86_64 18/124 2023-09-30T17:01:19.398 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6447.g1d10b717.el 19/124 2023-09-30T17:01:19.398 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-common-2:18.0.0-6447.g1d10b717.el8. 20/124 2023-09-30T17:01:19.398 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cephfs-2:18.0.0-6447.g1d10b717.el8.x86_6 21/124 2023-09-30T17:01:19.398 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rados-2:18.0.0-6447.g1d10b717.el8.x86_64 22/124 2023-09-30T17:01:19.399 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rbd-2:18.0.0-6447.g1d10b717.el8.x86_64 23/124 2023-09-30T17:01:19.399 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rgw-2:18.0.0-6447.g1d10b717.el8.x86_64 24/124 2023-09-30T17:01:19.399 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-fuse-2:18.0.0-6447.g1d10b717.el8.x86_64 25/124 2023-09-30T17:01:19.399 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-mirror-2:18.0.0-6447.g1d10b717.el8.x86_64 26/124 2023-09-30T17:01:19.399 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-nbd-2:18.0.0-6447.g1d10b717.el8.x86_64 27/124 2023-09-30T17:01:19.399 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6447.g1d10b717. 28/124 2023-09-30T17:01:19.399 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6447.g1d10b717.el8.noa 29/124 2023-09-30T17:01:19.399 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6447.g1d10b717.el8.n 30/124 2023-09-30T17:01:19.407 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6447.g1d1 31/124 2023-09-30T17:01:19.407 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6447.g1d10b717.el 32/124 2023-09-30T17:01:19.407 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6447.g1d10b717.el8.noarch 33/124 2023-09-30T17:01:19.407 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6447.g1d10b717.e 34/124 2023-09-30T17:01:19.407 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-volume-2:18.0.0-6447.g1d10b717.el8.noarch 35/124 2023-09-30T17:01:19.407 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephadm-2:18.0.0-6447.g1d10b717.el8.noarch 36/124 2023-09-30T17:01:19.407 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 37/124 2023-09-30T17:01:19.408 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 38/124 2023-09-30T17:01:19.408 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 39/124 2023-09-30T17:01:19.408 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 40/124 2023-09-30T17:01:19.408 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 41/124 2023-09-30T17:01:19.408 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 42/124 2023-09-30T17:01:19.408 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 43/124 2023-09-30T17:01:19.408 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 44/124 2023-09-30T17:01:19.408 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 45/124 2023-09-30T17:01:19.408 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 46/124 2023-09-30T17:01:19.408 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 47/124 2023-09-30T17:01:19.408 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 48/124 2023-09-30T17:01:19.408 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 49/124 2023-09-30T17:01:19.409 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 50/124 2023-09-30T17:01:19.409 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 51/124 2023-09-30T17:01:19.409 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 52/124 2023-09-30T17:01:19.409 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 53/124 2023-09-30T17:01:19.409 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 54/124 2023-09-30T17:01:19.409 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-portend-2.6-1.el8.noarch 55/124 2023-09-30T17:01:19.409 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 56/124 2023-09-30T17:01:19.409 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 57/124 2023-09-30T17:01:19.409 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 58/124 2023-09-30T17:01:19.409 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 59/124 2023-09-30T17:01:19.409 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 60/124 2023-09-30T17:01:19.409 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 61/124 2023-09-30T17:01:19.410 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 62/124 2023-09-30T17:01:19.410 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 63/124 2023-09-30T17:01:19.410 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 64/124 2023-09-30T17:01:19.410 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 65/124 2023-09-30T17:01:19.411 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 66/124 2023-09-30T17:01:19.411 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 67/124 2023-09-30T17:01:19.411 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 68/124 2023-09-30T17:01:19.411 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 69/124 2023-09-30T17:01:19.411 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 70/124 2023-09-30T17:01:19.411 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 71/124 2023-09-30T17:01:19.411 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 72/124 2023-09-30T17:01:19.411 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 73/124 2023-09-30T17:01:19.411 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 74/124 2023-09-30T17:01:19.412 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 75/124 2023-09-30T17:01:19.412 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 76/124 2023-09-30T17:01:19.412 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 77/124 2023-09-30T17:01:19.412 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 78/124 2023-09-30T17:01:19.412 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 79/124 2023-09-30T17:01:19.412 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 80/124 2023-09-30T17:01:19.412 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 81/124 2023-09-30T17:01:19.412 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 82/124 2023-09-30T17:01:19.412 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 83/124 2023-09-30T17:01:19.412 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 84/124 2023-09-30T17:01:19.413 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 85/124 2023-09-30T17:01:19.413 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 86/124 2023-09-30T17:01:19.413 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 87/124 2023-09-30T17:01:19.413 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 88/124 2023-09-30T17:01:19.413 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 89/124 2023-09-30T17:01:19.413 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 90/124 2023-09-30T17:01:19.413 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 91/124 2023-09-30T17:01:19.413 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 92/124 2023-09-30T17:01:19.413 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 93/124 2023-09-30T17:01:19.413 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 94/124 2023-09-30T17:01:19.413 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 95/124 2023-09-30T17:01:19.414 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 96/124 2023-09-30T17:01:19.414 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 97/124 2023-09-30T17:01:19.414 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 98/124 2023-09-30T17:01:19.414 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 99/124 2023-09-30T17:01:19.414 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 100/124 2023-09-30T17:01:19.414 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : bison-3.0.4-10.el8.x86_64 101/124 2023-09-30T17:01:19.414 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 102/124 2023-09-30T17:01:19.414 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 103/124 2023-09-30T17:01:19.414 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 104/124 2023-09-30T17:01:19.414 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : automake-1.16.1-7.el8.noarch 105/124 2023-09-30T17:01:19.414 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 106/124 2023-09-30T17:01:19.415 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 107/124 2023-09-30T17:01:19.415 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flex-2.6.1-9.el8.x86_64 108/124 2023-09-30T17:01:19.415 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 109/124 2023-09-30T17:01:19.415 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 110/124 2023-09-30T17:01:19.415 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 111/124 2023-09-30T17:01:19.415 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 112/124 2023-09-30T17:01:19.415 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 113/124 2023-09-30T17:01:19.415 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 114/124 2023-09-30T17:01:19.415 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 115/124 2023-09-30T17:01:19.415 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 116/124 2023-09-30T17:01:19.415 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 117/124 2023-09-30T17:01:19.416 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 118/124 2023-09-30T17:01:19.416 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : jq-1.6-3.el8.x86_64 119/124 2023-09-30T17:01:19.416 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 120/124 2023-09-30T17:01:19.416 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-2:18.0.0-6447.g1d10b717.el8.x86_64 121/124 2023-09-30T17:01:19.416 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 122/124 2023-09-30T17:01:19.416 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-2:18.0.0-6447.g1d10b717.el8.x86_64 123/124 2023-09-30T17:01:19.606 INFO:teuthology.orchestra.run.smithi072.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 124/124 2023-09-30T17:01:19.606 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-2:18.0.0-6447.g1d10b717.el8.x86_64 1/124 2023-09-30T17:01:19.606 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-base-2:18.0.0-6447.g1d10b717.el8.x86_64 2/124 2023-09-30T17:01:19.607 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-common-2:18.0.0-6447.g1d10b717.el8.x86_64 3/124 2023-09-30T17:01:19.607 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-fuse-2:18.0.0-6447.g1d10b717.el8.x86_64 4/124 2023-09-30T17:01:19.607 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-immutable-object-cache-2:18.0.0-6447.g1d10b 5/124 2023-09-30T17:01:19.607 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mds-2:18.0.0-6447.g1d10b717.el8.x86_64 6/124 2023-09-30T17:01:19.607 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-2:18.0.0-6447.g1d10b717.el8.x86_64 7/124 2023-09-30T17:01:19.607 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mon-2:18.0.0-6447.g1d10b717.el8.x86_64 8/124 2023-09-30T17:01:19.607 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-osd-2:18.0.0-6447.g1d10b717.el8.x86_64 9/124 2023-09-30T17:01:19.607 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-radosgw-2:18.0.0-6447.g1d10b717.el8.x86_64 10/124 2023-09-30T17:01:19.607 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-selinux-2:18.0.0-6447.g1d10b717.el8.x86_64 11/124 2023-09-30T17:01:19.607 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-test-2:18.0.0-6447.g1d10b717.el8.x86_64 12/124 2023-09-30T17:01:19.607 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephfs-devel-2:18.0.0-6447.g1d10b717.el8.x86_ 13/124 2023-09-30T17:01:19.607 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephfs2-2:18.0.0-6447.g1d10b717.el8.x86_64 14/124 2023-09-30T17:01:19.607 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcephsqlite-2:18.0.0-6447.g1d10b717.el8.x86_64 15/124 2023-09-30T17:01:19.608 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados-devel-2:18.0.0-6447.g1d10b717.el8.x86_6 16/124 2023-09-30T17:01:19.608 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libradosstriper1-2:18.0.0-6447.g1d10b717.el8.x86 17/124 2023-09-30T17:01:19.608 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librgw2-2:18.0.0-6447.g1d10b717.el8.x86_64 18/124 2023-09-30T17:01:19.608 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-ceph-argparse-2:18.0.0-6447.g1d10b717.el 19/124 2023-09-30T17:01:19.608 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-ceph-common-2:18.0.0-6447.g1d10b717.el8. 20/124 2023-09-30T17:01:19.608 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cephfs-2:18.0.0-6447.g1d10b717.el8.x86_6 21/124 2023-09-30T17:01:19.608 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rados-2:18.0.0-6447.g1d10b717.el8.x86_64 22/124 2023-09-30T17:01:19.608 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rbd-2:18.0.0-6447.g1d10b717.el8.x86_64 23/124 2023-09-30T17:01:19.608 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rgw-2:18.0.0-6447.g1d10b717.el8.x86_64 24/124 2023-09-30T17:01:19.608 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-fuse-2:18.0.0-6447.g1d10b717.el8.x86_64 25/124 2023-09-30T17:01:19.608 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-mirror-2:18.0.0-6447.g1d10b717.el8.x86_64 26/124 2023-09-30T17:01:19.608 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : rbd-nbd-2:18.0.0-6447.g1d10b717.el8.x86_64 27/124 2023-09-30T17:01:19.616 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-grafana-dashboards-2:18.0.0-6447.g1d10b717. 28/124 2023-09-30T17:01:19.616 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-cephadm-2:18.0.0-6447.g1d10b717.el8.noa 29/124 2023-09-30T17:01:19.616 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-dashboard-2:18.0.0-6447.g1d10b717.el8.n 30/124 2023-09-30T17:01:19.616 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.0.0-6447.g1d1 31/124 2023-09-30T17:01:19.616 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-modules-core-2:18.0.0-6447.g1d10b717.el 32/124 2023-09-30T17:01:19.617 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-mgr-rook-2:18.0.0-6447.g1d10b717.el8.noarch 33/124 2023-09-30T17:01:19.617 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-prometheus-alerts-2:18.0.0-6447.g1d10b717.e 34/124 2023-09-30T17:01:19.617 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : ceph-volume-2:18.0.0-6447.g1d10b717.el8.noarch 35/124 2023-09-30T17:01:19.617 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : cephadm-2:18.0.0-6447.g1d10b717.el8.noarch 36/124 2023-09-30T17:01:19.617 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 37/124 2023-09-30T17:01:19.617 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 38/124 2023-09-30T17:01:19.617 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 39/124 2023-09-30T17:01:19.617 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 40/124 2023-09-30T17:01:19.617 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 41/124 2023-09-30T17:01:19.617 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 42/124 2023-09-30T17:01:19.617 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 43/124 2023-09-30T17:01:19.617 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 44/124 2023-09-30T17:01:19.617 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 45/124 2023-09-30T17:01:19.618 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 46/124 2023-09-30T17:01:19.618 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 47/124 2023-09-30T17:01:19.618 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 48/124 2023-09-30T17:01:19.618 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 49/124 2023-09-30T17:01:19.618 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 50/124 2023-09-30T17:01:19.618 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 51/124 2023-09-30T17:01:19.618 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 52/124 2023-09-30T17:01:19.618 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 53/124 2023-09-30T17:01:19.618 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 54/124 2023-09-30T17:01:19.618 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-portend-2.6-1.el8.noarch 55/124 2023-09-30T17:01:19.618 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 56/124 2023-09-30T17:01:19.618 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 57/124 2023-09-30T17:01:19.619 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 58/124 2023-09-30T17:01:19.619 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 59/124 2023-09-30T17:01:19.619 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 60/124 2023-09-30T17:01:19.619 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 61/124 2023-09-30T17:01:19.619 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 62/124 2023-09-30T17:01:19.619 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 63/124 2023-09-30T17:01:19.619 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 64/124 2023-09-30T17:01:19.619 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 65/124 2023-09-30T17:01:19.619 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 66/124 2023-09-30T17:01:19.619 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 67/124 2023-09-30T17:01:19.619 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 68/124 2023-09-30T17:01:19.619 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 69/124 2023-09-30T17:01:19.619 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd 70/124 2023-09-30T17:01:19.620 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 71/124 2023-09-30T17:01:19.620 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 72/124 2023-09-30T17:01:19.620 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 73/124 2023-09-30T17:01:19.620 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 74/124 2023-09-30T17:01:19.620 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 75/124 2023-09-30T17:01:19.620 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : bison-3.0.4-10.el8.x86_64 76/124 2023-09-30T17:01:19.620 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jinja2-2.10.1-3.el8.noarch 77/124 2023-09-30T17:01:19.620 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 78/124 2023-09-30T17:01:19.620 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 79/124 2023-09-30T17:01:19.620 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : automake-1.16.1-7.el8.noarch 80/124 2023-09-30T17:01:19.620 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 81/124 2023-09-30T17:01:19.620 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 82/124 2023-09-30T17:01:19.621 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : flex-2.6.1-9.el8.x86_64 83/124 2023-09-30T17:01:19.621 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 84/124 2023-09-30T17:01:19.621 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 85/124 2023-09-30T17:01:19.621 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 86/124 2023-09-30T17:01:19.621 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 87/124 2023-09-30T17:01:19.621 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 88/124 2023-09-30T17:01:19.621 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 89/124 2023-09-30T17:01:19.621 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 90/124 2023-09-30T17:01:19.621 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 91/124 2023-09-30T17:01:19.621 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openblas-threads-0.3.15-3.el8.x86_64 92/124 2023-09-30T17:01:19.621 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openblas-0.3.15-3.el8.x86_64 93/124 2023-09-30T17:01:19.621 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : jq-1.6-3.el8.x86_64 94/124 2023-09-30T17:01:19.621 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librdkafka-0.11.4-3.el8.x86_64 95/124 2023-09-30T17:01:19.622 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 96/124 2023-09-30T17:01:19.622 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 97/124 2023-09-30T17:01:19.622 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 98/124 2023-09-30T17:01:19.622 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 99/124 2023-09-30T17:01:19.622 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : keyutils-libs-devel-1.5.10-9.el8.x86_64 100/124 2023-09-30T17:01:19.622 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libsepol-devel-2.9-3.el8.x86_64 101/124 2023-09-30T17:01:19.622 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 102/124 2023-09-30T17:01:19.622 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 103/124 2023-09-30T17:01:19.622 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 104/124 2023-09-30T17:01:19.622 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : krb5-devel-1.18.2-14.el8.x86_64 105/124 2023-09-30T17:01:19.622 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 106/124 2023-09-30T17:01:19.623 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 107/124 2023-09-30T17:01:19.623 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cryptography-3.2.1-5.el8.x86_64 108/124 2023-09-30T17:01:19.623 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 109/124 2023-09-30T17:01:19.623 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 110/124 2023-09-30T17:01:19.623 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : python3-cffi-1.11.5-5.el8.x86_64 111/124 2023-09-30T17:01:19.623 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : openssl-devel-1:1.1.1k-7.el8_6.x86_64 112/124 2023-09-30T17:01:19.623 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : xfsprogs-devel-5.0.0-10.el8.x86_64 113/124 2023-09-30T17:01:19.623 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : fuse-2.9.7-15.el8.x86_64 114/124 2023-09-30T17:01:19.623 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : elfutils-libelf-devel-0.186-1.el8.x86_64 115/124 2023-09-30T17:01:19.623 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libuuid-devel-2.32.1-35.el8.x86_64 116/124 2023-09-30T17:01:19.623 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : zlib-devel-1.2.11-18.el8_5.x86_64 117/124 2023-09-30T17:01:19.623 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libcom_err-devel-1.45.6-4.el8.x86_64 118/124 2023-09-30T17:01:19.623 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libgfortran-8.5.0-10.1.el8_6.x86_64 119/124 2023-09-30T17:01:19.624 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : libquadmath-8.5.0-10.1.el8_6.x86_64 120/124 2023-09-30T17:01:19.624 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados2-2:18.0.0-6447.g1d10b717.el8.x86_64 121/124 2023-09-30T17:01:19.624 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 122/124 2023-09-30T17:01:19.624 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librbd1-2:18.0.0-6447.g1d10b717.el8.x86_64 123/124 2023-09-30T17:01:20.214 INFO:teuthology.orchestra.run.smithi031.stdout:Installed products updated. 2023-09-30T17:01:20.463 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-09-30T17:01:20.464 INFO:teuthology.orchestra.run.smithi031.stdout:Upgraded: 2023-09-30T17:01:20.464 INFO:teuthology.orchestra.run.smithi031.stdout: librados2-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:20.464 INFO:teuthology.orchestra.run.smithi031.stdout: librbd1-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:20.464 INFO:teuthology.orchestra.run.smithi031.stdout:Installed: 2023-09-30T17:01:20.464 INFO:teuthology.orchestra.run.smithi031.stdout: automake-1.16.1-7.el8.noarch 2023-09-30T17:01:20.464 INFO:teuthology.orchestra.run.smithi031.stdout: bison-3.0.4-10.el8.x86_64 2023-09-30T17:01:20.464 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:20.464 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-base-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:20.464 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-common-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:20.465 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-fuse-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:20.465 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-grafana-dashboards-2:18.0.0-6447.g1d10b717.el8.noarch 2023-09-30T17:01:20.465 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-immutable-object-cache-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:20.465 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mds-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:20.465 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:20.465 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-cephadm-2:18.0.0-6447.g1d10b717.el8.noarch 2023-09-30T17:01:20.465 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-dashboard-2:18.0.0-6447.g1d10b717.el8.noarch 2023-09-30T17:01:20.465 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6447.g1d10b717.el8.noarch 2023-09-30T17:01:20.465 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-modules-core-2:18.0.0-6447.g1d10b717.el8.noarch 2023-09-30T17:01:20.465 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mgr-rook-2:18.0.0-6447.g1d10b717.el8.noarch 2023-09-30T17:01:20.466 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-mon-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:20.466 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-osd-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:20.466 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-prometheus-alerts-2:18.0.0-6447.g1d10b717.el8.noarch 2023-09-30T17:01:20.466 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-radosgw-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:20.466 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-selinux-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:20.466 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-test-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:20.466 INFO:teuthology.orchestra.run.smithi031.stdout: ceph-volume-2:18.0.0-6447.g1d10b717.el8.noarch 2023-09-30T17:01:20.466 INFO:teuthology.orchestra.run.smithi031.stdout: cephadm-2:18.0.0-6447.g1d10b717.el8.noarch 2023-09-30T17:01:20.466 INFO:teuthology.orchestra.run.smithi031.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-09-30T17:01:20.466 INFO:teuthology.orchestra.run.smithi031.stdout: flex-2.6.1-9.el8.x86_64 2023-09-30T17:01:20.467 INFO:teuthology.orchestra.run.smithi031.stdout: fuse-2.9.7-15.el8.x86_64 2023-09-30T17:01:20.467 INFO:teuthology.orchestra.run.smithi031.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-09-30T17:01:20.467 INFO:teuthology.orchestra.run.smithi031.stdout: jq-1.6-3.el8.x86_64 2023-09-30T17:01:20.467 INFO:teuthology.orchestra.run.smithi031.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-09-30T17:01:20.467 INFO:teuthology.orchestra.run.smithi031.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-09-30T17:01:20.467 INFO:teuthology.orchestra.run.smithi031.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-09-30T17:01:20.467 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs-devel-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:20.467 INFO:teuthology.orchestra.run.smithi031.stdout: libcephfs2-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:20.467 INFO:teuthology.orchestra.run.smithi031.stdout: libcephsqlite-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:20.468 INFO:teuthology.orchestra.run.smithi031.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-09-30T17:01:20.468 INFO:teuthology.orchestra.run.smithi031.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-09-30T17:01:20.468 INFO:teuthology.orchestra.run.smithi031.stdout: liboath-2.6.2-3.el8.x86_64 2023-09-30T17:01:20.468 INFO:teuthology.orchestra.run.smithi031.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-09-30T17:01:20.468 INFO:teuthology.orchestra.run.smithi031.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-09-30T17:01:20.468 INFO:teuthology.orchestra.run.smithi031.stdout: librados-devel-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:20.468 INFO:teuthology.orchestra.run.smithi031.stdout: libradosstriper1-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:20.468 INFO:teuthology.orchestra.run.smithi031.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-09-30T17:01:20.468 INFO:teuthology.orchestra.run.smithi031.stdout: librgw2-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:20.468 INFO:teuthology.orchestra.run.smithi031.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-09-30T17:01:20.468 INFO:teuthology.orchestra.run.smithi031.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-09-30T17:01:20.469 INFO:teuthology.orchestra.run.smithi031.stdout: libtool-2.4.6-25.el8.x86_64 2023-09-30T17:01:20.469 INFO:teuthology.orchestra.run.smithi031.stdout: libunwind-1.3.1-3.el8.x86_64 2023-09-30T17:01:20.469 INFO:teuthology.orchestra.run.smithi031.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-09-30T17:01:20.469 INFO:teuthology.orchestra.run.smithi031.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-09-30T17:01:20.469 INFO:teuthology.orchestra.run.smithi031.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-09-30T17:01:20.469 INFO:teuthology.orchestra.run.smithi031.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-09-30T17:01:20.469 INFO:teuthology.orchestra.run.smithi031.stdout: openblas-0.3.15-3.el8.x86_64 2023-09-30T17:01:20.469 INFO:teuthology.orchestra.run.smithi031.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-09-30T17:01:20.469 INFO:teuthology.orchestra.run.smithi031.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-09-30T17:01:20.470 INFO:teuthology.orchestra.run.smithi031.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-09-30T17:01:20.470 INFO:teuthology.orchestra.run.smithi031.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-09-30T17:01:20.470 INFO:teuthology.orchestra.run.smithi031.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-09-30T17:01:20.470 INFO:teuthology.orchestra.run.smithi031.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-09-30T17:01:20.470 INFO:teuthology.orchestra.run.smithi031.stdout: python3-babel-2.5.1-7.el8.noarch 2023-09-30T17:01:20.470 INFO:teuthology.orchestra.run.smithi031.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-09-30T17:01:20.470 INFO:teuthology.orchestra.run.smithi031.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-09-30T17:01:20.470 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-09-30T17:01:20.470 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-argparse-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:20.470 INFO:teuthology.orchestra.run.smithi031.stdout: python3-ceph-common-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:20.471 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cephfs-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:20.471 INFO:teuthology.orchestra.run.smithi031.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-09-30T17:01:20.471 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-09-30T17:01:20.471 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-09-30T17:01:20.471 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-09-30T17:01:20.471 INFO:teuthology.orchestra.run.smithi031.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-09-30T17:01:20.471 INFO:teuthology.orchestra.run.smithi031.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-09-30T17:01:20.471 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-6.2-6.el8.noarch 2023-09-30T17:01:20.471 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-09-30T17:01:20.471 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-09-30T17:01:20.472 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-09-30T17:01:20.472 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-09-30T17:01:20.472 INFO:teuthology.orchestra.run.smithi031.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-09-30T17:01:20.472 INFO:teuthology.orchestra.run.smithi031.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-09-30T17:01:20.472 INFO:teuthology.orchestra.run.smithi031.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-09-30T17:01:20.472 INFO:teuthology.orchestra.run.smithi031.stdout: python3-mako-1.0.6-13.el8.noarch 2023-09-30T17:01:20.472 INFO:teuthology.orchestra.run.smithi031.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-09-30T17:01:20.472 INFO:teuthology.orchestra.run.smithi031.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-09-30T17:01:20.472 INFO:teuthology.orchestra.run.smithi031.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-09-30T17:01:20.472 INFO:teuthology.orchestra.run.smithi031.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-09-30T17:01:20.473 INFO:teuthology.orchestra.run.smithi031.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-09-30T17:01:20.473 INFO:teuthology.orchestra.run.smithi031.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-09-30T17:01:20.473 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-09-30T17:01:20.473 INFO:teuthology.orchestra.run.smithi031.stdout: python3-portend-2.6-1.el8.noarch 2023-09-30T17:01:20.473 INFO:teuthology.orchestra.run.smithi031.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-09-30T17:01:20.473 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-09-30T17:01:20.473 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-09-30T17:01:20.473 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-09-30T17:01:20.473 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pycparser-2.14-14.el8.noarch 2023-09-30T17:01:20.473 INFO:teuthology.orchestra.run.smithi031.stdout: python3-pytz-2017.2-9.el8.noarch 2023-09-30T17:01:20.474 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rados-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:20.474 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rbd-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:20.474 INFO:teuthology.orchestra.run.smithi031.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-09-30T17:01:20.474 INFO:teuthology.orchestra.run.smithi031.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-09-30T17:01:20.474 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rgw-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:20.474 INFO:teuthology.orchestra.run.smithi031.stdout: python3-routes-2.4.1-12.el8.noarch 2023-09-30T17:01:20.474 INFO:teuthology.orchestra.run.smithi031.stdout: python3-rsa-4.9-2.el8.noarch 2023-09-30T17:01:20.474 INFO:teuthology.orchestra.run.smithi031.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-09-30T17:01:20.474 INFO:teuthology.orchestra.run.smithi031.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-09-30T17:01:20.474 INFO:teuthology.orchestra.run.smithi031.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-09-30T17:01:20.475 INFO:teuthology.orchestra.run.smithi031.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-09-30T17:01:20.475 INFO:teuthology.orchestra.run.smithi031.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-09-30T17:01:20.475 INFO:teuthology.orchestra.run.smithi031.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-09-30T17:01:20.475 INFO:teuthology.orchestra.run.smithi031.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-09-30T17:01:20.475 INFO:teuthology.orchestra.run.smithi031.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-09-30T17:01:20.475 INFO:teuthology.orchestra.run.smithi031.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-09-30T17:01:20.475 INFO:teuthology.orchestra.run.smithi031.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-09-30T17:01:20.475 INFO:teuthology.orchestra.run.smithi031.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-09-30T17:01:20.475 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-fuse-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:20.475 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-mirror-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:20.476 INFO:teuthology.orchestra.run.smithi031.stdout: rbd-nbd-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:20.476 INFO:teuthology.orchestra.run.smithi031.stdout: socat-1.7.4.1-1.el8.x86_64 2023-09-30T17:01:20.476 INFO:teuthology.orchestra.run.smithi031.stdout: thrift-0.13.0-2.el8.x86_64 2023-09-30T17:01:20.476 INFO:teuthology.orchestra.run.smithi031.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-09-30T17:01:20.476 INFO:teuthology.orchestra.run.smithi031.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-09-30T17:01:20.476 INFO:teuthology.orchestra.run.smithi031.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-09-30T17:01:20.477 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-09-30T17:01:20.477 INFO:teuthology.orchestra.run.smithi031.stdout:Complete! 2023-09-30T17:01:20.667 DEBUG:teuthology.parallel:result is None 2023-09-30T17:01:22.040 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 124/124 2023-09-30T17:01:22.040 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:43 ago on Sat 30 Sep 2023 04:59:39 PM UTC. 2023-09-30T17:01:22.241 INFO:teuthology.orchestra.run.smithi072.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 124/124 2023-09-30T17:01:22.241 INFO:teuthology.orchestra.run.smithi072.stdout:Last metadata expiration check: 0:01:55 ago on Sat 30 Sep 2023 04:59:27 PM UTC. 2023-09-30T17:01:24.753 INFO:teuthology.orchestra.run.smithi134.stdout:Installed products updated. 2023-09-30T17:01:24.947 INFO:teuthology.orchestra.run.smithi072.stdout:Installed products updated. 2023-09-30T17:01:24.979 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-09-30T17:01:24.979 INFO:teuthology.orchestra.run.smithi134.stdout:Upgraded: 2023-09-30T17:01:24.979 INFO:teuthology.orchestra.run.smithi134.stdout: librados2-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:24.979 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:24.979 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2023-09-30T17:01:24.979 INFO:teuthology.orchestra.run.smithi134.stdout: automake-1.16.1-7.el8.noarch 2023-09-30T17:01:24.980 INFO:teuthology.orchestra.run.smithi134.stdout: bison-3.0.4-10.el8.x86_64 2023-09-30T17:01:24.980 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:24.980 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:24.980 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:24.980 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:24.980 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards-2:18.0.0-6447.g1d10b717.el8.noarch 2023-09-30T17:01:24.980 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:24.980 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:24.980 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:24.980 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm-2:18.0.0-6447.g1d10b717.el8.noarch 2023-09-30T17:01:24.980 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard-2:18.0.0-6447.g1d10b717.el8.noarch 2023-09-30T17:01:24.980 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6447.g1d10b717.el8.noarch 2023-09-30T17:01:24.981 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core-2:18.0.0-6447.g1d10b717.el8.noarch 2023-09-30T17:01:24.981 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook-2:18.0.0-6447.g1d10b717.el8.noarch 2023-09-30T17:01:24.981 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:24.981 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:24.981 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts-2:18.0.0-6447.g1d10b717.el8.noarch 2023-09-30T17:01:24.981 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:24.981 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:24.981 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:24.981 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-volume-2:18.0.0-6447.g1d10b717.el8.noarch 2023-09-30T17:01:24.981 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm-2:18.0.0-6447.g1d10b717.el8.noarch 2023-09-30T17:01:24.981 INFO:teuthology.orchestra.run.smithi134.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-09-30T17:01:24.982 INFO:teuthology.orchestra.run.smithi134.stdout: flex-2.6.1-9.el8.x86_64 2023-09-30T17:01:24.982 INFO:teuthology.orchestra.run.smithi134.stdout: fuse-2.9.7-15.el8.x86_64 2023-09-30T17:01:24.982 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-09-30T17:01:24.982 INFO:teuthology.orchestra.run.smithi134.stdout: jq-1.6-3.el8.x86_64 2023-09-30T17:01:24.982 INFO:teuthology.orchestra.run.smithi134.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-09-30T17:01:24.982 INFO:teuthology.orchestra.run.smithi134.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-09-30T17:01:24.982 INFO:teuthology.orchestra.run.smithi134.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-09-30T17:01:24.982 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:24.982 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:24.982 INFO:teuthology.orchestra.run.smithi134.stdout: libcephsqlite-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:24.982 INFO:teuthology.orchestra.run.smithi134.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-09-30T17:01:24.983 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-09-30T17:01:24.983 INFO:teuthology.orchestra.run.smithi134.stdout: liboath-2.6.2-3.el8.x86_64 2023-09-30T17:01:24.983 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-09-30T17:01:24.983 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-09-30T17:01:24.983 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:24.983 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:24.983 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-09-30T17:01:24.983 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:24.983 INFO:teuthology.orchestra.run.smithi134.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-09-30T17:01:24.983 INFO:teuthology.orchestra.run.smithi134.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-09-30T17:01:24.983 INFO:teuthology.orchestra.run.smithi134.stdout: libtool-2.4.6-25.el8.x86_64 2023-09-30T17:01:24.984 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind-1.3.1-3.el8.x86_64 2023-09-30T17:01:24.984 INFO:teuthology.orchestra.run.smithi134.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-09-30T17:01:24.984 INFO:teuthology.orchestra.run.smithi134.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-09-30T17:01:24.984 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-09-30T17:01:24.984 INFO:teuthology.orchestra.run.smithi134.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-09-30T17:01:24.984 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-0.3.15-3.el8.x86_64 2023-09-30T17:01:24.984 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-09-30T17:01:24.984 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-09-30T17:01:24.984 INFO:teuthology.orchestra.run.smithi134.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-09-30T17:01:24.984 INFO:teuthology.orchestra.run.smithi134.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-09-30T17:01:24.984 INFO:teuthology.orchestra.run.smithi134.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-09-30T17:01:24.984 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-09-30T17:01:24.985 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel-2.5.1-7.el8.noarch 2023-09-30T17:01:24.985 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-09-30T17:01:24.985 INFO:teuthology.orchestra.run.smithi134.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-09-30T17:01:24.985 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-09-30T17:01:24.985 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:24.985 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:24.985 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:24.985 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-09-30T17:01:24.985 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-09-30T17:01:24.985 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-09-30T17:01:24.985 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-09-30T17:01:24.986 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-09-30T17:01:24.986 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-09-30T17:01:24.986 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-6.2-6.el8.noarch 2023-09-30T17:01:24.986 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-09-30T17:01:24.986 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-09-30T17:01:24.986 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-09-30T17:01:24.986 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-09-30T17:01:24.986 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-09-30T17:01:24.986 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-09-30T17:01:24.986 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-09-30T17:01:24.986 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako-1.0.6-13.el8.noarch 2023-09-30T17:01:24.987 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-09-30T17:01:24.987 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-09-30T17:01:24.987 INFO:teuthology.orchestra.run.smithi134.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-09-30T17:01:24.987 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-09-30T17:01:24.987 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-09-30T17:01:24.987 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-09-30T17:01:24.987 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-09-30T17:01:24.987 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend-2.6-1.el8.noarch 2023-09-30T17:01:24.987 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-09-30T17:01:24.987 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-09-30T17:01:24.987 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-09-30T17:01:24.987 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-09-30T17:01:24.988 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pycparser-2.14-14.el8.noarch 2023-09-30T17:01:24.988 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz-2017.2-9.el8.noarch 2023-09-30T17:01:24.988 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:24.988 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:24.988 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-09-30T17:01:24.988 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-09-30T17:01:24.988 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:24.988 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes-2.4.1-12.el8.noarch 2023-09-30T17:01:24.988 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa-4.9-2.el8.noarch 2023-09-30T17:01:24.988 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-09-30T17:01:24.988 INFO:teuthology.orchestra.run.smithi134.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-09-30T17:01:24.989 INFO:teuthology.orchestra.run.smithi134.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-09-30T17:01:24.989 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-09-30T17:01:24.989 INFO:teuthology.orchestra.run.smithi134.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-09-30T17:01:24.989 INFO:teuthology.orchestra.run.smithi134.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-09-30T17:01:24.989 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-09-30T17:01:24.989 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-09-30T17:01:24.989 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-09-30T17:01:24.989 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-09-30T17:01:24.989 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-09-30T17:01:24.989 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:24.989 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:24.989 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:24.989 INFO:teuthology.orchestra.run.smithi134.stdout: socat-1.7.4.1-1.el8.x86_64 2023-09-30T17:01:24.990 INFO:teuthology.orchestra.run.smithi134.stdout: thrift-0.13.0-2.el8.x86_64 2023-09-30T17:01:24.990 INFO:teuthology.orchestra.run.smithi134.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-09-30T17:01:24.990 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-09-30T17:01:24.990 INFO:teuthology.orchestra.run.smithi134.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-09-30T17:01:24.990 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-09-30T17:01:24.990 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2023-09-30T17:01:25.164 DEBUG:teuthology.parallel:result is None 2023-09-30T17:01:25.175 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-09-30T17:01:25.175 INFO:teuthology.orchestra.run.smithi072.stdout:Upgraded: 2023-09-30T17:01:25.175 INFO:teuthology.orchestra.run.smithi072.stdout: librados2-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:25.175 INFO:teuthology.orchestra.run.smithi072.stdout: librbd1-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:25.175 INFO:teuthology.orchestra.run.smithi072.stdout:Installed: 2023-09-30T17:01:25.176 INFO:teuthology.orchestra.run.smithi072.stdout: automake-1.16.1-7.el8.noarch 2023-09-30T17:01:25.176 INFO:teuthology.orchestra.run.smithi072.stdout: bison-3.0.4-10.el8.x86_64 2023-09-30T17:01:25.176 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:25.176 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-base-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:25.176 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-common-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:25.176 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-fuse-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:25.176 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-grafana-dashboards-2:18.0.0-6447.g1d10b717.el8.noarch 2023-09-30T17:01:25.176 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-immutable-object-cache-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:25.176 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mds-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:25.176 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:25.176 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-cephadm-2:18.0.0-6447.g1d10b717.el8.noarch 2023-09-30T17:01:25.177 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-dashboard-2:18.0.0-6447.g1d10b717.el8.noarch 2023-09-30T17:01:25.177 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-diskprediction-local-2:18.0.0-6447.g1d10b717.el8.noarch 2023-09-30T17:01:25.177 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-modules-core-2:18.0.0-6447.g1d10b717.el8.noarch 2023-09-30T17:01:25.177 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mgr-rook-2:18.0.0-6447.g1d10b717.el8.noarch 2023-09-30T17:01:25.177 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-mon-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:25.177 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-osd-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:25.177 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-prometheus-alerts-2:18.0.0-6447.g1d10b717.el8.noarch 2023-09-30T17:01:25.177 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-radosgw-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:25.177 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-selinux-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:25.177 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-test-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:25.177 INFO:teuthology.orchestra.run.smithi072.stdout: ceph-volume-2:18.0.0-6447.g1d10b717.el8.noarch 2023-09-30T17:01:25.177 INFO:teuthology.orchestra.run.smithi072.stdout: cephadm-2:18.0.0-6447.g1d10b717.el8.noarch 2023-09-30T17:01:25.177 INFO:teuthology.orchestra.run.smithi072.stdout: elfutils-libelf-devel-0.186-1.el8.x86_64 2023-09-30T17:01:25.178 INFO:teuthology.orchestra.run.smithi072.stdout: flex-2.6.1-9.el8.x86_64 2023-09-30T17:01:25.178 INFO:teuthology.orchestra.run.smithi072.stdout: fuse-2.9.7-15.el8.x86_64 2023-09-30T17:01:25.178 INFO:teuthology.orchestra.run.smithi072.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-09-30T17:01:25.178 INFO:teuthology.orchestra.run.smithi072.stdout: jq-1.6-3.el8.x86_64 2023-09-30T17:01:25.178 INFO:teuthology.orchestra.run.smithi072.stdout: keyutils-libs-devel-1.5.10-9.el8.x86_64 2023-09-30T17:01:25.178 INFO:teuthology.orchestra.run.smithi072.stdout: krb5-devel-1.18.2-14.el8.x86_64 2023-09-30T17:01:25.178 INFO:teuthology.orchestra.run.smithi072.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-09-30T17:01:25.178 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs-devel-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:25.178 INFO:teuthology.orchestra.run.smithi072.stdout: libcephfs2-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:25.178 INFO:teuthology.orchestra.run.smithi072.stdout: libcephsqlite-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:25.179 INFO:teuthology.orchestra.run.smithi072.stdout: libcom_err-devel-1.45.6-4.el8.x86_64 2023-09-30T17:01:25.179 INFO:teuthology.orchestra.run.smithi072.stdout: libgfortran-8.5.0-10.1.el8_6.x86_64 2023-09-30T17:01:25.179 INFO:teuthology.orchestra.run.smithi072.stdout: liboath-2.6.2-3.el8.x86_64 2023-09-30T17:01:25.179 INFO:teuthology.orchestra.run.smithi072.stdout: libquadmath-8.5.0-10.1.el8_6.x86_64 2023-09-30T17:01:25.179 INFO:teuthology.orchestra.run.smithi072.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-09-30T17:01:25.179 INFO:teuthology.orchestra.run.smithi072.stdout: librados-devel-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:25.179 INFO:teuthology.orchestra.run.smithi072.stdout: libradosstriper1-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:25.179 INFO:teuthology.orchestra.run.smithi072.stdout: librdkafka-0.11.4-3.el8.x86_64 2023-09-30T17:01:25.179 INFO:teuthology.orchestra.run.smithi072.stdout: librgw2-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:25.179 INFO:teuthology.orchestra.run.smithi072.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-09-30T17:01:25.179 INFO:teuthology.orchestra.run.smithi072.stdout: libsepol-devel-2.9-3.el8.x86_64 2023-09-30T17:01:25.179 INFO:teuthology.orchestra.run.smithi072.stdout: libtool-2.4.6-25.el8.x86_64 2023-09-30T17:01:25.180 INFO:teuthology.orchestra.run.smithi072.stdout: libunwind-1.3.1-3.el8.x86_64 2023-09-30T17:01:25.180 INFO:teuthology.orchestra.run.smithi072.stdout: libuuid-devel-2.32.1-35.el8.x86_64 2023-09-30T17:01:25.180 INFO:teuthology.orchestra.run.smithi072.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-09-30T17:01:25.180 INFO:teuthology.orchestra.run.smithi072.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-09-30T17:01:25.180 INFO:teuthology.orchestra.run.smithi072.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-09-30T17:01:25.180 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-0.3.15-3.el8.x86_64 2023-09-30T17:01:25.180 INFO:teuthology.orchestra.run.smithi072.stdout: openblas-threads-0.3.15-3.el8.x86_64 2023-09-30T17:01:25.180 INFO:teuthology.orchestra.run.smithi072.stdout: openssl-devel-1:1.1.1k-7.el8_6.x86_64 2023-09-30T17:01:25.180 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-09-30T17:01:25.180 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-09-30T17:01:25.180 INFO:teuthology.orchestra.run.smithi072.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-09-30T17:01:25.180 INFO:teuthology.orchestra.run.smithi072.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-09-30T17:01:25.181 INFO:teuthology.orchestra.run.smithi072.stdout: python3-babel-2.5.1-7.el8.noarch 2023-09-30T17:01:25.181 INFO:teuthology.orchestra.run.smithi072.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-09-30T17:01:25.181 INFO:teuthology.orchestra.run.smithi072.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-09-30T17:01:25.181 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-09-30T17:01:25.181 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-argparse-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:25.181 INFO:teuthology.orchestra.run.smithi072.stdout: python3-ceph-common-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:25.181 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cephfs-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:25.181 INFO:teuthology.orchestra.run.smithi072.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-09-30T17:01:25.181 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cffi-1.11.5-5.el8.x86_64 2023-09-30T17:01:25.181 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-09-30T17:01:25.181 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-09-30T17:01:25.182 INFO:teuthology.orchestra.run.smithi072.stdout: python3-cryptography-3.2.1-5.el8.x86_64 2023-09-30T17:01:25.182 INFO:teuthology.orchestra.run.smithi072.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-09-30T17:01:25.182 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-6.2-6.el8.noarch 2023-09-30T17:01:25.182 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-09-30T17:01:25.182 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jinja2-2.10.1-3.el8.noarch 2023-09-30T17:01:25.182 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-09-30T17:01:25.182 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-09-30T17:01:25.182 INFO:teuthology.orchestra.run.smithi072.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-09-30T17:01:25.182 INFO:teuthology.orchestra.run.smithi072.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-09-30T17:01:25.182 INFO:teuthology.orchestra.run.smithi072.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-09-30T17:01:25.182 INFO:teuthology.orchestra.run.smithi072.stdout: python3-mako-1.0.6-13.el8.noarch 2023-09-30T17:01:25.183 INFO:teuthology.orchestra.run.smithi072.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-09-30T17:01:25.183 INFO:teuthology.orchestra.run.smithi072.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-09-30T17:01:25.183 INFO:teuthology.orchestra.run.smithi072.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-09-30T17:01:25.183 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2023-09-30T17:01:25.183 INFO:teuthology.orchestra.run.smithi072.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2023-09-30T17:01:25.183 INFO:teuthology.orchestra.run.smithi072.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-09-30T17:01:25.183 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-09-30T17:01:25.183 INFO:teuthology.orchestra.run.smithi072.stdout: python3-portend-2.6-1.el8.noarch 2023-09-30T17:01:25.183 INFO:teuthology.orchestra.run.smithi072.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-09-30T17:01:25.183 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2023-09-30T17:01:25.183 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-09-30T17:01:25.183 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-09-30T17:01:25.184 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pycparser-2.14-14.el8.noarch 2023-09-30T17:01:25.184 INFO:teuthology.orchestra.run.smithi072.stdout: python3-pytz-2017.2-9.el8.noarch 2023-09-30T17:01:25.184 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rados-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:25.184 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rbd-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:25.184 INFO:teuthology.orchestra.run.smithi072.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-09-30T17:01:25.184 INFO:teuthology.orchestra.run.smithi072.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-09-30T17:01:25.184 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rgw-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:25.184 INFO:teuthology.orchestra.run.smithi072.stdout: python3-routes-2.4.1-12.el8.noarch 2023-09-30T17:01:25.184 INFO:teuthology.orchestra.run.smithi072.stdout: python3-rsa-4.9-2.el8.noarch 2023-09-30T17:01:25.184 INFO:teuthology.orchestra.run.smithi072.stdout: python3-scipy-1.0.0-21.module+el8.5.0+10916+41bd434d.x86_64 2023-09-30T17:01:25.184 INFO:teuthology.orchestra.run.smithi072.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-09-30T17:01:25.184 INFO:teuthology.orchestra.run.smithi072.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-09-30T17:01:25.185 INFO:teuthology.orchestra.run.smithi072.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-09-30T17:01:25.185 INFO:teuthology.orchestra.run.smithi072.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-09-30T17:01:25.185 INFO:teuthology.orchestra.run.smithi072.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-09-30T17:01:25.185 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-09-30T17:01:25.185 INFO:teuthology.orchestra.run.smithi072.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-09-30T17:01:25.185 INFO:teuthology.orchestra.run.smithi072.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-09-30T17:01:25.185 INFO:teuthology.orchestra.run.smithi072.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-09-30T17:01:25.185 INFO:teuthology.orchestra.run.smithi072.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-09-30T17:01:25.185 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-fuse-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:25.185 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-mirror-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:25.185 INFO:teuthology.orchestra.run.smithi072.stdout: rbd-nbd-2:18.0.0-6447.g1d10b717.el8.x86_64 2023-09-30T17:01:25.186 INFO:teuthology.orchestra.run.smithi072.stdout: socat-1.7.4.1-1.el8.x86_64 2023-09-30T17:01:25.186 INFO:teuthology.orchestra.run.smithi072.stdout: thrift-0.13.0-2.el8.x86_64 2023-09-30T17:01:25.186 INFO:teuthology.orchestra.run.smithi072.stdout: xfsprogs-devel-5.0.0-10.el8.x86_64 2023-09-30T17:01:25.186 INFO:teuthology.orchestra.run.smithi072.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-09-30T17:01:25.186 INFO:teuthology.orchestra.run.smithi072.stdout: zlib-devel-1.2.11-18.el8_5.x86_64 2023-09-30T17:01:25.186 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-09-30T17:01:25.186 INFO:teuthology.orchestra.run.smithi072.stdout:Complete! 2023-09-30T17:01:25.401 DEBUG:teuthology.parallel:result is None 2023-09-30T17:01:25.401 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=1d10b71792f3be8887a7631e69851ac2df3585af 2023-09-30T17:01:25.637 DEBUG:teuthology.orchestra.run.smithi007:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-09-30T17:01:25.666 INFO:teuthology.orchestra.run.smithi007.stdout:18.0.0-6447.g1d10b717.el8 2023-09-30T17:01:25.666 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6447.g1d10b717.el8 2023-09-30T17:01:25.667 INFO:teuthology.task.install:The correct ceph version 18.0.0-6447.g1d10b717 is installed. 2023-09-30T17:01:25.667 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=1d10b71792f3be8887a7631e69851ac2df3585af 2023-09-30T17:01:25.883 DEBUG:teuthology.orchestra.run.smithi031:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-09-30T17:01:25.912 INFO:teuthology.orchestra.run.smithi031.stdout:18.0.0-6447.g1d10b717.el8 2023-09-30T17:01:25.912 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6447.g1d10b717.el8 2023-09-30T17:01:25.912 INFO:teuthology.task.install:The correct ceph version 18.0.0-6447.g1d10b717 is installed. 2023-09-30T17:01:25.912 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=1d10b71792f3be8887a7631e69851ac2df3585af 2023-09-30T17:01:26.056 DEBUG:teuthology.orchestra.run.smithi072:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-09-30T17:01:26.081 INFO:teuthology.orchestra.run.smithi072.stdout:18.0.0-6447.g1d10b717.el8 2023-09-30T17:01:26.081 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6447.g1d10b717.el8 2023-09-30T17:01:26.082 INFO:teuthology.task.install:The correct ceph version 18.0.0-6447.g1d10b717 is installed. 2023-09-30T17:01:26.082 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=1d10b71792f3be8887a7631e69851ac2df3585af 2023-09-30T17:01:26.222 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-09-30T17:01:26.251 INFO:teuthology.orchestra.run.smithi134.stdout:18.0.0-6447.g1d10b717.el8 2023-09-30T17:01:26.251 INFO:teuthology.packaging:The installed version of ceph is 18.0.0-6447.g1d10b717.el8 2023-09-30T17:01:26.251 INFO:teuthology.task.install:The correct ceph version 18.0.0-6447.g1d10b717 is installed. 2023-09-30T17:01:26.252 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-09-30T17:01:26.252 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-09-30T17:01:26.252 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-30T17:01:26.303 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-09-30T17:01:26.304 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-30T17:01:26.353 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-09-30T17:01:26.353 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-30T17:01:26.397 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-09-30T17:01:26.397 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-30T17:01:26.445 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-09-30T17:01:26.445 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-09-30T17:01:26.445 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/daemon-helper 2023-09-30T17:01:26.479 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-30T17:01:26.551 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-09-30T17:01:26.551 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/daemon-helper 2023-09-30T17:01:26.584 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-30T17:01:26.657 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-09-30T17:01:26.657 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/daemon-helper 2023-09-30T17:01:26.686 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-30T17:01:26.753 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-09-30T17:01:26.754 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/daemon-helper 2023-09-30T17:01:26.785 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-30T17:01:26.856 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-09-30T17:01:26.856 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-09-30T17:01:26.856 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-30T17:01:26.889 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-30T17:01:26.960 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-09-30T17:01:26.961 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-30T17:01:26.994 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-30T17:01:27.065 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-09-30T17:01:27.065 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-30T17:01:27.094 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-30T17:01:27.163 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-09-30T17:01:27.163 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-30T17:01:27.195 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-30T17:01:27.265 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-09-30T17:01:27.265 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-09-30T17:01:27.265 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/usr/bin/stdin-killer 2023-09-30T17:01:27.298 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-30T17:01:27.370 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-09-30T17:01:27.370 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/usr/bin/stdin-killer 2023-09-30T17:01:27.402 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-30T17:01:27.473 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-09-30T17:01:27.474 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/usr/bin/stdin-killer 2023-09-30T17:01:27.504 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-30T17:01:27.574 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-09-30T17:01:27.574 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/stdin-killer 2023-09-30T17:01:27.606 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-30T17:01:27.676 INFO:teuthology.run_tasks:Running task ceph... 2023-09-30T17:01:27.740 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-09-30T17:01:27.741 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 777 /var/log/ceph 2023-09-30T17:01:27.743 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 777 /var/log/ceph 2023-09-30T17:01:27.746 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 777 /var/log/ceph 2023-09-30T17:01:27.748 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 777 /var/log/ceph 2023-09-30T17:01:27.779 INFO:tasks.ceph:Disabling ceph logrotate... 2023-09-30T17:01:27.779 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f -- /etc/logrotate.d/ceph 2023-09-30T17:01:27.817 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /etc/logrotate.d/ceph 2023-09-30T17:01:27.820 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /etc/logrotate.d/ceph 2023-09-30T17:01:27.822 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/logrotate.d/ceph 2023-09-30T17:01:27.851 INFO:tasks.ceph:Creating extra log directories... 2023-09-30T17:01:27.851 DEBUG:teuthology.orchestra.run.smithi007:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-09-30T17:01:27.888 DEBUG:teuthology.orchestra.run.smithi031:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-09-30T17:01:27.893 DEBUG:teuthology.orchestra.run.smithi072:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-09-30T17:01:27.895 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-09-30T17:01:27.933 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-09-30T17:01:27.933 INFO:tasks.ceph:config {'conf': {'global': {'osd_pg_log_dups_tracked': 10000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-09-30T17:01:27.934 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-09-29_19:49:08-powercycle-main-distro-default-smithi/7407742', 'branch': 'main', 'description': 'powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-stupid powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_suites_fsync thrashosds-health}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7407742', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuriw-2023-09-29_19:49:08-powercycle-main-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'os_type': 'rhel', 'os_version': '8.6', 'overrides': {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'global': {'osd_pg_log_dups_tracked': 10000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': '1d10b71792f3be8887a7631e69851ac2df3585af'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '1d10b71792f3be8887a7631e69851ac2df3585af'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '1d10b71792f3be8887a7631e69851ac2df3585af'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 76, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'client.0'], ['osd.0'], ['osd.1'], ['osd.2']], 'seed': 6636, 'sha1': '1d10b71792f3be8887a7631e69851ac2df3585af', 'sleep_before_teardown': 0, 'subset': '111/12000', 'suite': 'powercycle', 'suite_branch': 'main', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_1d10b71792f3be8887a7631e69851ac2df3585af/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '1d10b71792f3be8887a7631e69851ac2df3585af', 'targets': {'smithi007.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', 'smithi031.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', 'smithi072.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs=', 'smithi134.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '1d10b71792f3be8887a7631e69851ac2df3585af'}}, {'ceph': None}, {'thrashosds': {'chance_down': 1.0, 'powercycle': True, 'timeout': 600}}, {'ceph-fuse': None}, {'workunit': {'clients': {'all': ['suites/fsync-tester.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-09-29_19:49:08', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-09-30T17:01:27.934 DEBUG:teuthology.orchestra.run.smithi007:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-09-30T17:01:27.957 DEBUG:teuthology.orchestra.run.smithi031:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-09-30T17:01:27.965 DEBUG:teuthology.orchestra.run.smithi072:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-09-30T17:01:27.967 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-09-30T17:01:27.984 DEBUG:teuthology.orchestra.run.smithi007:> sudo install -d -m0777 -- /var/run/ceph 2023-09-30T17:01:28.016 DEBUG:teuthology.orchestra.run.smithi031:> sudo install -d -m0777 -- /var/run/ceph 2023-09-30T17:01:28.024 DEBUG:teuthology.orchestra.run.smithi072:> sudo install -d -m0777 -- /var/run/ceph 2023-09-30T17:01:28.026 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m0777 -- /var/run/ceph 2023-09-30T17:01:28.053 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-09-30T17:01:28.053 DEBUG:teuthology.orchestra.run.smithi031:> dd if=/scratch_devs of=/dev/stdout 2023-09-30T17:01:28.113 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-09-30T17:01:28.113 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_1 2023-09-30T17:01:28.172 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-09-30T17:01:28.172 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T17:01:28.172 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 6h/6d Inode: 390183 Links: 1 2023-09-30T17:01:28.172 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T17:01:28.172 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2023-09-30T17:01:28.172 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2023-09-30 17:01:14.567390071 +0000 2023-09-30T17:01:28.172 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2023-09-30 16:58:37.024619155 +0000 2023-09-30T17:01:28.172 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2023-09-30 16:58:37.024619155 +0000 2023-09-30T17:01:28.173 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: - 2023-09-30T17:01:28.173 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-09-30T17:01:28.241 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2023-09-30T17:01:28.241 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2023-09-30T17:01:28.241 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000229735 s, 2.2 MB/s 2023-09-30T17:01:28.242 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-09-30T17:01:28.303 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_2 2023-09-30T17:01:28.362 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-09-30T17:01:28.363 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T17:01:28.363 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 6h/6d Inode: 389910 Links: 1 2023-09-30T17:01:28.363 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T17:01:28.363 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2023-09-30T17:01:28.363 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2023-09-30 17:01:14.567390071 +0000 2023-09-30T17:01:28.363 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2023-09-30 16:58:37.515611462 +0000 2023-09-30T17:01:28.363 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2023-09-30 16:58:37.515611462 +0000 2023-09-30T17:01:28.363 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: - 2023-09-30T17:01:28.363 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-09-30T17:01:28.431 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2023-09-30T17:01:28.432 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2023-09-30T17:01:28.432 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000219217 s, 2.3 MB/s 2023-09-30T17:01:28.433 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-09-30T17:01:28.492 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_3 2023-09-30T17:01:28.552 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-09-30T17:01:28.552 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T17:01:28.552 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 6h/6d Inode: 388585 Links: 1 2023-09-30T17:01:28.552 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T17:01:28.552 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2023-09-30T17:01:28.552 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2023-09-30 17:01:14.567390071 +0000 2023-09-30T17:01:28.552 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2023-09-30 16:58:38.037603284 +0000 2023-09-30T17:01:28.552 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2023-09-30 16:58:38.037603284 +0000 2023-09-30T17:01:28.552 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: - 2023-09-30T17:01:28.553 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-09-30T17:01:28.620 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2023-09-30T17:01:28.620 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2023-09-30T17:01:28.620 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000202765 s, 2.5 MB/s 2023-09-30T17:01:28.621 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-09-30T17:01:28.681 DEBUG:teuthology.orchestra.run.smithi031:> stat /dev/vg_nvme/lv_4 2023-09-30T17:01:28.740 INFO:teuthology.orchestra.run.smithi031.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-09-30T17:01:28.740 INFO:teuthology.orchestra.run.smithi031.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T17:01:28.740 INFO:teuthology.orchestra.run.smithi031.stdout:Device: 6h/6d Inode: 390097 Links: 1 2023-09-30T17:01:28.740 INFO:teuthology.orchestra.run.smithi031.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T17:01:28.740 INFO:teuthology.orchestra.run.smithi031.stdout:Context: system_u:object_r:device_t:s0 2023-09-30T17:01:28.741 INFO:teuthology.orchestra.run.smithi031.stdout:Access: 2023-09-30 17:01:14.568390055 +0000 2023-09-30T17:01:28.741 INFO:teuthology.orchestra.run.smithi031.stdout:Modify: 2023-09-30 16:58:38.564595027 +0000 2023-09-30T17:01:28.741 INFO:teuthology.orchestra.run.smithi031.stdout:Change: 2023-09-30 16:58:38.564595027 +0000 2023-09-30T17:01:28.741 INFO:teuthology.orchestra.run.smithi031.stdout: Birth: - 2023-09-30T17:01:28.741 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-09-30T17:01:28.807 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records in 2023-09-30T17:01:28.807 INFO:teuthology.orchestra.run.smithi031.stderr:1+0 records out 2023-09-30T17:01:28.807 INFO:teuthology.orchestra.run.smithi031.stderr:512 bytes copied, 0.000223882 s, 2.3 MB/s 2023-09-30T17:01:28.808 DEBUG:teuthology.orchestra.run.smithi031:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-09-30T17:01:28.867 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2023-09-30T17:01:28.867 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-09-30T17:01:28.867 DEBUG:teuthology.orchestra.run.smithi072:> dd if=/scratch_devs of=/dev/stdout 2023-09-30T17:01:28.887 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-09-30T17:01:28.888 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_1 2023-09-30T17:01:28.948 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-09-30T17:01:28.948 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T17:01:28.949 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 6h/6d Inode: 387330 Links: 1 2023-09-30T17:01:28.949 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T17:01:28.949 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2023-09-30T17:01:28.949 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2023-09-30 17:01:19.334753906 +0000 2023-09-30T17:01:28.949 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2023-09-30 16:58:18.216851638 +0000 2023-09-30T17:01:28.949 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2023-09-30 16:58:18.216851638 +0000 2023-09-30T17:01:28.949 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2023-09-30T17:01:28.949 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-09-30T17:01:29.018 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2023-09-30T17:01:29.019 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2023-09-30T17:01:29.019 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000320374 s, 1.6 MB/s 2023-09-30T17:01:29.020 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-09-30T17:01:29.080 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_2 2023-09-30T17:01:29.138 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-09-30T17:01:29.139 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T17:01:29.139 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 6h/6d Inode: 389294 Links: 1 2023-09-30T17:01:29.139 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T17:01:29.139 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2023-09-30T17:01:29.139 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2023-09-30 17:01:19.334753906 +0000 2023-09-30T17:01:29.139 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2023-09-30 16:58:18.748840859 +0000 2023-09-30T17:01:29.139 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2023-09-30 16:58:18.748840859 +0000 2023-09-30T17:01:29.139 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2023-09-30T17:01:29.140 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-09-30T17:01:29.206 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2023-09-30T17:01:29.206 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2023-09-30T17:01:29.206 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000210366 s, 2.4 MB/s 2023-09-30T17:01:29.207 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-09-30T17:01:29.266 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_3 2023-09-30T17:01:29.324 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-09-30T17:01:29.324 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T17:01:29.325 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 6h/6d Inode: 384501 Links: 1 2023-09-30T17:01:29.325 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T17:01:29.325 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2023-09-30T17:01:29.325 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2023-09-30 17:01:19.334753906 +0000 2023-09-30T17:01:29.325 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2023-09-30 16:58:19.284830000 +0000 2023-09-30T17:01:29.325 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2023-09-30 16:58:19.284830000 +0000 2023-09-30T17:01:29.325 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2023-09-30T17:01:29.325 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-09-30T17:01:29.392 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2023-09-30T17:01:29.393 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2023-09-30T17:01:29.393 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000232567 s, 2.2 MB/s 2023-09-30T17:01:29.394 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-09-30T17:01:29.453 DEBUG:teuthology.orchestra.run.smithi072:> stat /dev/vg_nvme/lv_4 2023-09-30T17:01:29.511 INFO:teuthology.orchestra.run.smithi072.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-09-30T17:01:29.511 INFO:teuthology.orchestra.run.smithi072.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T17:01:29.511 INFO:teuthology.orchestra.run.smithi072.stdout:Device: 6h/6d Inode: 393371 Links: 1 2023-09-30T17:01:29.511 INFO:teuthology.orchestra.run.smithi072.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T17:01:29.511 INFO:teuthology.orchestra.run.smithi072.stdout:Context: system_u:object_r:device_t:s0 2023-09-30T17:01:29.511 INFO:teuthology.orchestra.run.smithi072.stdout:Access: 2023-09-30 17:01:19.334753906 +0000 2023-09-30T17:01:29.512 INFO:teuthology.orchestra.run.smithi072.stdout:Modify: 2023-09-30 16:58:19.794819666 +0000 2023-09-30T17:01:29.512 INFO:teuthology.orchestra.run.smithi072.stdout:Change: 2023-09-30 16:58:19.794819666 +0000 2023-09-30T17:01:29.512 INFO:teuthology.orchestra.run.smithi072.stdout: Birth: - 2023-09-30T17:01:29.512 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-09-30T17:01:29.577 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records in 2023-09-30T17:01:29.578 INFO:teuthology.orchestra.run.smithi072.stderr:1+0 records out 2023-09-30T17:01:29.578 INFO:teuthology.orchestra.run.smithi072.stderr:512 bytes copied, 0.000321637 s, 1.6 MB/s 2023-09-30T17:01:29.579 DEBUG:teuthology.orchestra.run.smithi072:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-09-30T17:01:29.637 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1'} 2023-09-30T17:01:29.638 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-09-30T17:01:29.638 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/scratch_devs of=/dev/stdout 2023-09-30T17:01:29.658 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-09-30T17:01:29.658 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_1 2023-09-30T17:01:29.720 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-09-30T17:01:29.721 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T17:01:29.721 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 6h/6d Inode: 388628 Links: 1 2023-09-30T17:01:29.721 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T17:01:29.721 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2023-09-30T17:01:29.721 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2023-09-30 17:01:19.124441105 +0000 2023-09-30T17:01:29.721 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2023-09-30 16:58:15.505488632 +0000 2023-09-30T17:01:29.721 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2023-09-30 16:58:15.505488632 +0000 2023-09-30T17:01:29.721 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2023-09-30T17:01:29.722 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-09-30T17:01:29.791 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2023-09-30T17:01:29.791 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2023-09-30T17:01:29.791 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.00028022 s, 1.8 MB/s 2023-09-30T17:01:29.792 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-09-30T17:01:29.853 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_2 2023-09-30T17:01:29.912 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-09-30T17:01:29.913 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T17:01:29.913 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 6h/6d Inode: 388805 Links: 1 2023-09-30T17:01:29.913 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T17:01:29.913 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2023-09-30T17:01:29.913 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2023-09-30 17:01:19.124441105 +0000 2023-09-30T17:01:29.913 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2023-09-30 16:58:16.079475750 +0000 2023-09-30T17:01:29.913 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2023-09-30 16:58:16.079475750 +0000 2023-09-30T17:01:29.913 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2023-09-30T17:01:29.914 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-09-30T17:01:29.980 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2023-09-30T17:01:29.981 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2023-09-30T17:01:29.981 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000212375 s, 2.4 MB/s 2023-09-30T17:01:29.982 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-09-30T17:01:30.040 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_3 2023-09-30T17:01:30.098 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-09-30T17:01:30.098 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T17:01:30.098 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 6h/6d Inode: 390531 Links: 1 2023-09-30T17:01:30.098 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T17:01:30.098 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2023-09-30T17:01:30.099 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2023-09-30 17:01:19.124441105 +0000 2023-09-30T17:01:30.099 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2023-09-30 16:58:16.613463765 +0000 2023-09-30T17:01:30.099 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2023-09-30 16:58:16.613463765 +0000 2023-09-30T17:01:30.099 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2023-09-30T17:01:30.099 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-09-30T17:01:30.164 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2023-09-30T17:01:30.165 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2023-09-30T17:01:30.165 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.00024743 s, 2.1 MB/s 2023-09-30T17:01:30.166 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-09-30T17:01:30.225 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_4 2023-09-30T17:01:30.281 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-09-30T17:01:30.281 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T17:01:30.282 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 6h/6d Inode: 391358 Links: 1 2023-09-30T17:01:30.282 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T17:01:30.282 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2023-09-30T17:01:30.282 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2023-09-30 17:01:19.124441105 +0000 2023-09-30T17:01:30.282 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2023-09-30 16:58:17.117452454 +0000 2023-09-30T17:01:30.282 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2023-09-30 16:58:17.117452454 +0000 2023-09-30T17:01:30.282 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2023-09-30T17:01:30.282 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-09-30T17:01:30.347 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2023-09-30T17:01:30.347 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2023-09-30T17:01:30.347 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000223869 s, 2.3 MB/s 2023-09-30T17:01:30.348 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-09-30T17:01:30.406 INFO:tasks.ceph:osd dev map: {'osd.2': '/dev/vg_nvme/lv_1'} 2023-09-30T17:01:30.407 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi031.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi072.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi134.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2023-09-30T17:01:30.407 INFO:tasks.ceph:Generating config... 2023-09-30T17:01:30.408 INFO:tasks.ceph:[global] osd_pg_log_dups_tracked = 10000 2023-09-30T17:01:30.408 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-09-30T17:01:30.408 INFO:tasks.ceph:[mgr] debug ms = 1 2023-09-30T17:01:30.408 INFO:tasks.ceph:[mon] debug mon = 20 2023-09-30T17:01:30.408 INFO:tasks.ceph:[mon] debug ms = 1 2023-09-30T17:01:30.408 INFO:tasks.ceph:[mon] debug paxos = 20 2023-09-30T17:01:30.409 INFO:tasks.ceph:[osd] bdev async discard = True 2023-09-30T17:01:30.409 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-09-30T17:01:30.409 INFO:tasks.ceph:[osd] bluestore allocator = stupid 2023-09-30T17:01:30.409 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-09-30T17:01:30.409 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-09-30T17:01:30.409 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-09-30T17:01:30.409 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-09-30T17:01:30.409 INFO:tasks.ceph:[osd] debug ms = 1 2023-09-30T17:01:30.409 INFO:tasks.ceph:[osd] debug osd = 20 2023-09-30T17:01:30.409 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-09-30T17:01:30.410 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-09-30T17:01:30.410 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-09-30T17:01:30.410 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-09-30T17:01:30.410 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2023-09-30T17:01:30.410 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-09-30T17:01:30.410 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2023-09-30T17:01:30.410 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-09-30T17:01:30.410 INFO:tasks.ceph:Setting up mon.a... 2023-09-30T17:01:30.411 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-09-30T17:01:30.475 INFO:teuthology.orchestra.run.smithi007.stdout:creating /etc/ceph/ceph.keyring 2023-09-30T17:01:30.478 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-09-30T17:01:30.528 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-30T17:01:30.556 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.7'), ('mon.b', '[v2:172.21.15.7:3301,v1:172.21.15.7:6790]'), ('mon.c', '[v2:172.21.15.7:3302,v1:172.21.15.7:6791]')] 2023-09-30T17:01:30.557 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.7,[v2:172.21.15.7:3301,v1:172.21.15.7:6790],[v2:172.21.15.7:3302,v1:172.21.15.7:6791]', 'osd_pg_log_dups_tracked': 10000}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok'}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}} 2023-09-30T17:01:30.557 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-09-30T17:01:30.557 DEBUG:teuthology.orchestra.run.smithi007:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-09-30T17:01:30.614 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.7 --addv b '[v2:172.21.15.7:3301,v1:172.21.15.7:6790]' --addv c '[v2:172.21.15.7:3302,v1:172.21.15.7:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2023-09-30T17:01:30.705 INFO:teuthology.orchestra.run.smithi007.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-09-30T17:01:30.705 INFO:teuthology.orchestra.run.smithi007.stdout:monmaptool: generated fsid 68daccc3-6ea9-4db7-9771-3803ff202df8 2023-09-30T17:01:30.705 INFO:teuthology.orchestra.run.smithi007.stdout:setting min_mon_release = pacific 2023-09-30T17:01:30.705 INFO:teuthology.orchestra.run.smithi007.stdout:epoch 0 2023-09-30T17:01:30.705 INFO:teuthology.orchestra.run.smithi007.stdout:fsid 68daccc3-6ea9-4db7-9771-3803ff202df8 2023-09-30T17:01:30.705 INFO:teuthology.orchestra.run.smithi007.stdout:last_changed 2023-09-30T17:01:30.705438+0000 2023-09-30T17:01:30.705 INFO:teuthology.orchestra.run.smithi007.stdout:created 2023-09-30T17:01:30.705438+0000 2023-09-30T17:01:30.705 INFO:teuthology.orchestra.run.smithi007.stdout:min_mon_release 16 (pacific) 2023-09-30T17:01:30.705 INFO:teuthology.orchestra.run.smithi007.stdout:election_strategy: 1 2023-09-30T17:01:30.706 INFO:teuthology.orchestra.run.smithi007.stdout:0: [v2:172.21.15.7:3300/0,v1:172.21.15.7:6789/0] mon.a 2023-09-30T17:01:30.706 INFO:teuthology.orchestra.run.smithi007.stdout:1: [v2:172.21.15.7:3301/0,v1:172.21.15.7:6790/0] mon.b 2023-09-30T17:01:30.706 INFO:teuthology.orchestra.run.smithi007.stdout:2: [v2:172.21.15.7:3302/0,v1:172.21.15.7:6791/0] mon.c 2023-09-30T17:01:30.706 INFO:teuthology.orchestra.run.smithi007.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-09-30T17:01:30.707 DEBUG:teuthology.orchestra.run.smithi007:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-09-30T17:01:30.724 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 68daccc3-6ea9-4db7-9771-3803ff202df8... 2023-09-30T17:01:30.725 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-09-30T17:01:30.766 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-09-30T17:01:30.769 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-09-30T17:01:30.771 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-09-30T17:01:30.812 INFO:teuthology.orchestra.run.smithi007.stdout:[global] 2023-09-30T17:01:30.812 INFO:teuthology.orchestra.run.smithi007.stdout: chdir = "" 2023-09-30T17:01:30.812 INFO:teuthology.orchestra.run.smithi007.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-09-30T17:01:30.812 INFO:teuthology.orchestra.run.smithi007.stdout: auth supported = cephx 2023-09-30T17:01:30.812 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:01:30.812 INFO:teuthology.orchestra.run.smithi007.stdout: filestore xattr use omap = true 2023-09-30T17:01:30.812 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:01:30.813 INFO:teuthology.orchestra.run.smithi007.stdout: mon clock drift allowed = 1.000 2023-09-30T17:01:30.813 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:01:30.813 INFO:teuthology.orchestra.run.smithi007.stdout: osd crush chooseleaf type = 0 2023-09-30T17:01:30.813 INFO:teuthology.orchestra.run.smithi007.stdout: auth debug = true 2023-09-30T17:01:30.813 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:01:30.813 INFO:teuthology.orchestra.run.smithi007.stdout: ms die on old message = true 2023-09-30T17:01:30.813 INFO:teuthology.orchestra.run.smithi007.stdout: ms die on bug = true 2023-09-30T17:01:30.813 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:01:30.813 INFO:teuthology.orchestra.run.smithi007.stdout: mon max pg per osd = 10000 # >= luminous 2023-09-30T17:01:30.813 INFO:teuthology.orchestra.run.smithi007.stdout: mon pg warn max object skew = 0 2023-09-30T17:01:30.813 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:01:30.814 INFO:teuthology.orchestra.run.smithi007.stdout: # disable pg_autoscaler by default for new pools 2023-09-30T17:01:30.814 INFO:teuthology.orchestra.run.smithi007.stdout: osd_pool_default_pg_autoscale_mode = off 2023-09-30T17:01:30.814 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:01:30.814 INFO:teuthology.orchestra.run.smithi007.stdout: osd pool default size = 2 2023-09-30T17:01:30.814 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:01:30.814 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd allow primary affinity = true 2023-09-30T17:01:30.814 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd allow pg remap = true 2023-09-30T17:01:30.814 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on legacy crush tunables = false 2023-09-30T17:01:30.814 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on crush straw calc version zero = false 2023-09-30T17:01:30.814 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on no sortbitwise = false 2023-09-30T17:01:30.814 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on osd down out interval zero = false 2023-09-30T17:01:30.814 INFO:teuthology.orchestra.run.smithi007.stdout: mon warn on too few osds = false 2023-09-30T17:01:30.815 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-09-30T17:01:30.815 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_pool_no_redundancy = false 2023-09-30T17:01:30.815 INFO:teuthology.orchestra.run.smithi007.stdout: mon_allow_pool_size_one = true 2023-09-30T17:01:30.815 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:01:30.815 INFO:teuthology.orchestra.run.smithi007.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-09-30T17:01:30.815 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:01:30.815 INFO:teuthology.orchestra.run.smithi007.stdout: osd default data pool replay window = 5 2023-09-30T17:01:30.815 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:01:30.815 INFO:teuthology.orchestra.run.smithi007.stdout: mon allow pool delete = true 2023-09-30T17:01:30.815 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:01:30.816 INFO:teuthology.orchestra.run.smithi007.stdout: mon cluster log file level = debug 2023-09-30T17:01:30.816 INFO:teuthology.orchestra.run.smithi007.stdout: debug asserts on shutdown = true 2023-09-30T17:01:30.816 INFO:teuthology.orchestra.run.smithi007.stdout: mon health detail to clog = false 2023-09-30T17:01:30.816 INFO:teuthology.orchestra.run.smithi007.stdout: mon host = "172.21.15.7,[v2:172.21.15.7:3301,v1:172.21.15.7:6790],[v2:172.21.15.7:3302,v1:172.21.15.7:6791]" 2023-09-30T17:01:30.816 INFO:teuthology.orchestra.run.smithi007.stdout: osd_pg_log_dups_tracked = 10000 2023-09-30T17:01:30.816 INFO:teuthology.orchestra.run.smithi007.stdout: fsid = 68daccc3-6ea9-4db7-9771-3803ff202df8 2023-09-30T17:01:30.816 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:01:30.816 INFO:teuthology.orchestra.run.smithi007.stdout:[osd] 2023-09-30T17:01:30.817 INFO:teuthology.orchestra.run.smithi007.stdout: osd journal size = 100 2023-09-30T17:01:30.817 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:01:30.817 INFO:teuthology.orchestra.run.smithi007.stdout: osd scrub load threshold = 5.0 2023-09-30T17:01:30.817 INFO:teuthology.orchestra.run.smithi007.stdout: osd scrub max interval = 600 2023-09-30T17:01:30.817 INFO:teuthology.orchestra.run.smithi007.stdout: osd mclock profile = high_recovery_ops 2023-09-30T17:01:30.817 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:01:30.817 INFO:teuthology.orchestra.run.smithi007.stdout: osd recover clone overlap = true 2023-09-30T17:01:30.817 INFO:teuthology.orchestra.run.smithi007.stdout: osd recovery max chunk = 1048576 2023-09-30T17:01:30.817 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:01:30.818 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug shutdown = true 2023-09-30T17:01:30.818 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug op order = true 2023-09-30T17:01:30.818 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug verify stray on activate = true 2023-09-30T17:01:30.818 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:01:30.818 INFO:teuthology.orchestra.run.smithi007.stdout: osd open classes on start = true 2023-09-30T17:01:30.818 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug pg log writeout = true 2023-09-30T17:01:30.818 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:01:30.818 INFO:teuthology.orchestra.run.smithi007.stdout: osd deep scrub update digest min age = 30 2023-09-30T17:01:30.818 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:01:30.818 INFO:teuthology.orchestra.run.smithi007.stdout: osd map max advance = 10 2023-09-30T17:01:30.818 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:01:30.819 INFO:teuthology.orchestra.run.smithi007.stdout: journal zero on create = true 2023-09-30T17:01:30.819 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:01:30.819 INFO:teuthology.orchestra.run.smithi007.stdout: filestore ondisk finisher threads = 3 2023-09-30T17:01:30.819 INFO:teuthology.orchestra.run.smithi007.stdout: filestore apply finisher threads = 3 2023-09-30T17:01:30.819 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:01:30.819 INFO:teuthology.orchestra.run.smithi007.stdout: bdev debug aio = true 2023-09-30T17:01:30.819 INFO:teuthology.orchestra.run.smithi007.stdout: osd debug misdirected ops = true 2023-09-30T17:01:30.819 INFO:teuthology.orchestra.run.smithi007.stdout: bdev async discard = True 2023-09-30T17:01:30.819 INFO:teuthology.orchestra.run.smithi007.stdout: bdev enable discard = True 2023-09-30T17:01:30.819 INFO:teuthology.orchestra.run.smithi007.stdout: bluestore allocator = stupid 2023-09-30T17:01:30.819 INFO:teuthology.orchestra.run.smithi007.stdout: bluestore block size = 96636764160 2023-09-30T17:01:30.819 INFO:teuthology.orchestra.run.smithi007.stdout: bluestore fsck on mount = True 2023-09-30T17:01:30.820 INFO:teuthology.orchestra.run.smithi007.stdout: debug bluefs = 1/20 2023-09-30T17:01:30.820 INFO:teuthology.orchestra.run.smithi007.stdout: debug bluestore = 1/20 2023-09-30T17:01:30.820 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2023-09-30T17:01:30.820 INFO:teuthology.orchestra.run.smithi007.stdout: debug osd = 20 2023-09-30T17:01:30.820 INFO:teuthology.orchestra.run.smithi007.stdout: debug rocksdb = 4/10 2023-09-30T17:01:30.820 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd backfillfull_ratio = 0.85 2023-09-30T17:01:30.820 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd full ratio = 0.9 2023-09-30T17:01:30.820 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd nearfull ratio = 0.8 2023-09-30T17:01:30.820 INFO:teuthology.orchestra.run.smithi007.stdout: osd blocked scrub grace period = 3600 2023-09-30T17:01:30.820 INFO:teuthology.orchestra.run.smithi007.stdout: osd failsafe full ratio = 0.95 2023-09-30T17:01:30.820 INFO:teuthology.orchestra.run.smithi007.stdout: osd max markdown count = 1000 2023-09-30T17:01:30.820 INFO:teuthology.orchestra.run.smithi007.stdout: osd objectstore = bluestore 2023-09-30T17:01:30.821 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:01:30.821 INFO:teuthology.orchestra.run.smithi007.stdout:[mgr] 2023-09-30T17:01:30.821 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2023-09-30T17:01:30.821 INFO:teuthology.orchestra.run.smithi007.stdout: debug mgr = 20 2023-09-30T17:01:30.821 INFO:teuthology.orchestra.run.smithi007.stdout: debug mon = 20 2023-09-30T17:01:30.821 INFO:teuthology.orchestra.run.smithi007.stdout: debug auth = 20 2023-09-30T17:01:30.821 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min pgs per osd = 4 2023-09-30T17:01:30.821 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min bytes per osd = 10 2023-09-30T17:01:30.821 INFO:teuthology.orchestra.run.smithi007.stdout: mgr/telemetry/nag = false 2023-09-30T17:01:30.821 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:01:30.821 INFO:teuthology.orchestra.run.smithi007.stdout:[mon] 2023-09-30T17:01:30.821 INFO:teuthology.orchestra.run.smithi007.stdout: debug ms = 1 2023-09-30T17:01:30.822 INFO:teuthology.orchestra.run.smithi007.stdout: debug mon = 20 2023-09-30T17:01:30.822 INFO:teuthology.orchestra.run.smithi007.stdout: debug paxos = 20 2023-09-30T17:01:30.822 INFO:teuthology.orchestra.run.smithi007.stdout: debug auth = 20 2023-09-30T17:01:30.822 INFO:teuthology.orchestra.run.smithi007.stdout: mon data avail warn = 5 2023-09-30T17:01:30.822 INFO:teuthology.orchestra.run.smithi007.stdout: mon mgr mkfs grace = 240 2023-09-30T17:01:30.822 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min pgs per osd = 4 2023-09-30T17:01:30.822 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd reporter subtree level = osd 2023-09-30T17:01:30.822 INFO:teuthology.orchestra.run.smithi007.stdout: mon osd prime pg temp = true 2023-09-30T17:01:30.822 INFO:teuthology.orchestra.run.smithi007.stdout: mon reweight min bytes per osd = 10 2023-09-30T17:01:30.822 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:01:30.822 INFO:teuthology.orchestra.run.smithi007.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-09-30T17:01:30.823 INFO:teuthology.orchestra.run.smithi007.stdout: auth mon ticket ttl = 660 # 11m 2023-09-30T17:01:30.823 INFO:teuthology.orchestra.run.smithi007.stdout: auth service ticket ttl = 240 # 4m 2023-09-30T17:01:30.823 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:01:30.823 INFO:teuthology.orchestra.run.smithi007.stdout: # don't complain about insecure global_id in the test suite 2023-09-30T17:01:30.823 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-09-30T17:01:30.823 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-09-30T17:01:30.823 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:01:30.823 INFO:teuthology.orchestra.run.smithi007.stdout: # 1m isn't quite enough 2023-09-30T17:01:30.823 INFO:teuthology.orchestra.run.smithi007.stdout: mon_down_mkfs_grace = 2m 2023-09-30T17:01:30.823 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:01:30.823 INFO:teuthology.orchestra.run.smithi007.stdout: mon_warn_on_filestore_osds = false 2023-09-30T17:01:30.823 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:01:30.824 INFO:teuthology.orchestra.run.smithi007.stdout:[client] 2023-09-30T17:01:30.824 INFO:teuthology.orchestra.run.smithi007.stdout: rgw cache enabled = true 2023-09-30T17:01:30.824 INFO:teuthology.orchestra.run.smithi007.stdout: rgw enable ops log = true 2023-09-30T17:01:30.824 INFO:teuthology.orchestra.run.smithi007.stdout: rgw enable usage log = true 2023-09-30T17:01:30.824 INFO:teuthology.orchestra.run.smithi007.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-09-30T17:01:30.824 INFO:teuthology.orchestra.run.smithi007.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-09-30T17:01:30.824 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.a] 2023-09-30T17:01:30.824 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.b] 2023-09-30T17:01:30.824 INFO:teuthology.orchestra.run.smithi007.stdout:[mon.c] 2023-09-30T17:01:30.824 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.a] 2023-09-30T17:01:30.825 INFO:teuthology.orchestra.run.smithi031.stdout:[global] 2023-09-30T17:01:30.825 INFO:teuthology.orchestra.run.smithi031.stdout: chdir = "" 2023-09-30T17:01:30.825 INFO:teuthology.orchestra.run.smithi031.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-09-30T17:01:30.825 INFO:teuthology.orchestra.run.smithi031.stdout: auth supported = cephx 2023-09-30T17:01:30.826 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-09-30T17:01:30.826 INFO:teuthology.orchestra.run.smithi031.stdout: filestore xattr use omap = true 2023-09-30T17:01:30.826 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-09-30T17:01:30.826 INFO:teuthology.orchestra.run.smithi031.stdout: mon clock drift allowed = 1.000 2023-09-30T17:01:30.826 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-09-30T17:01:30.826 INFO:teuthology.orchestra.run.smithi031.stdout: osd crush chooseleaf type = 0 2023-09-30T17:01:30.826 INFO:teuthology.orchestra.run.smithi031.stdout: auth debug = true 2023-09-30T17:01:30.826 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-09-30T17:01:30.826 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on old message = true 2023-09-30T17:01:30.826 INFO:teuthology.orchestra.run.smithi031.stdout: ms die on bug = true 2023-09-30T17:01:30.826 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-09-30T17:01:30.827 INFO:teuthology.orchestra.run.smithi031.stdout: mon max pg per osd = 10000 # >= luminous 2023-09-30T17:01:30.827 INFO:teuthology.orchestra.run.smithi031.stdout: mon pg warn max object skew = 0 2023-09-30T17:01:30.827 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-09-30T17:01:30.827 INFO:teuthology.orchestra.run.smithi031.stdout: # disable pg_autoscaler by default for new pools 2023-09-30T17:01:30.827 INFO:teuthology.orchestra.run.smithi031.stdout: osd_pool_default_pg_autoscale_mode = off 2023-09-30T17:01:30.827 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-09-30T17:01:30.827 INFO:teuthology.orchestra.run.smithi031.stdout: osd pool default size = 2 2023-09-30T17:01:30.827 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-09-30T17:01:30.827 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd allow primary affinity = true 2023-09-30T17:01:30.827 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd allow pg remap = true 2023-09-30T17:01:30.827 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on legacy crush tunables = false 2023-09-30T17:01:30.827 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on crush straw calc version zero = false 2023-09-30T17:01:30.828 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on no sortbitwise = false 2023-09-30T17:01:30.828 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on osd down out interval zero = false 2023-09-30T17:01:30.828 INFO:teuthology.orchestra.run.smithi031.stdout: mon warn on too few osds = false 2023-09-30T17:01:30.828 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-09-30T17:01:30.828 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_pool_no_redundancy = false 2023-09-30T17:01:30.828 INFO:teuthology.orchestra.run.smithi031.stdout: mon_allow_pool_size_one = true 2023-09-30T17:01:30.828 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-09-30T17:01:30.828 INFO:teuthology.orchestra.run.smithi031.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-09-30T17:01:30.828 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-09-30T17:01:30.829 INFO:teuthology.orchestra.run.smithi031.stdout: osd default data pool replay window = 5 2023-09-30T17:01:30.829 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-09-30T17:01:30.829 INFO:teuthology.orchestra.run.smithi031.stdout: mon allow pool delete = true 2023-09-30T17:01:30.829 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-09-30T17:01:30.829 INFO:teuthology.orchestra.run.smithi031.stdout: mon cluster log file level = debug 2023-09-30T17:01:30.829 INFO:teuthology.orchestra.run.smithi031.stdout: debug asserts on shutdown = true 2023-09-30T17:01:30.829 INFO:teuthology.orchestra.run.smithi031.stdout: mon health detail to clog = false 2023-09-30T17:01:30.829 INFO:teuthology.orchestra.run.smithi031.stdout: mon host = "172.21.15.7,[v2:172.21.15.7:3301,v1:172.21.15.7:6790],[v2:172.21.15.7:3302,v1:172.21.15.7:6791]" 2023-09-30T17:01:30.829 INFO:teuthology.orchestra.run.smithi031.stdout: osd_pg_log_dups_tracked = 10000 2023-09-30T17:01:30.829 INFO:teuthology.orchestra.run.smithi031.stdout: fsid = 68daccc3-6ea9-4db7-9771-3803ff202df8 2023-09-30T17:01:30.829 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-09-30T17:01:30.829 INFO:teuthology.orchestra.run.smithi031.stdout:[osd] 2023-09-30T17:01:30.830 INFO:teuthology.orchestra.run.smithi031.stdout: osd journal size = 100 2023-09-30T17:01:30.830 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-09-30T17:01:30.830 INFO:teuthology.orchestra.run.smithi031.stdout: osd scrub load threshold = 5.0 2023-09-30T17:01:30.830 INFO:teuthology.orchestra.run.smithi031.stdout: osd scrub max interval = 600 2023-09-30T17:01:30.830 INFO:teuthology.orchestra.run.smithi031.stdout: osd mclock profile = high_recovery_ops 2023-09-30T17:01:30.830 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-09-30T17:01:30.830 INFO:teuthology.orchestra.run.smithi031.stdout: osd recover clone overlap = true 2023-09-30T17:01:30.830 INFO:teuthology.orchestra.run.smithi031.stdout: osd recovery max chunk = 1048576 2023-09-30T17:01:30.830 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-09-30T17:01:30.830 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug shutdown = true 2023-09-30T17:01:30.831 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug op order = true 2023-09-30T17:01:30.831 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug verify stray on activate = true 2023-09-30T17:01:30.831 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-09-30T17:01:30.831 INFO:teuthology.orchestra.run.smithi031.stdout: osd open classes on start = true 2023-09-30T17:01:30.831 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug pg log writeout = true 2023-09-30T17:01:30.831 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-09-30T17:01:30.831 INFO:teuthology.orchestra.run.smithi031.stdout: osd deep scrub update digest min age = 30 2023-09-30T17:01:30.831 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-09-30T17:01:30.831 INFO:teuthology.orchestra.run.smithi031.stdout: osd map max advance = 10 2023-09-30T17:01:30.831 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-09-30T17:01:30.831 INFO:teuthology.orchestra.run.smithi031.stdout: journal zero on create = true 2023-09-30T17:01:30.831 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-09-30T17:01:30.832 INFO:teuthology.orchestra.run.smithi031.stdout: filestore ondisk finisher threads = 3 2023-09-30T17:01:30.832 INFO:teuthology.orchestra.run.smithi031.stdout: filestore apply finisher threads = 3 2023-09-30T17:01:30.832 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-09-30T17:01:30.832 INFO:teuthology.orchestra.run.smithi031.stdout: bdev debug aio = true 2023-09-30T17:01:30.832 INFO:teuthology.orchestra.run.smithi031.stdout: osd debug misdirected ops = true 2023-09-30T17:01:30.832 INFO:teuthology.orchestra.run.smithi031.stdout: bdev async discard = True 2023-09-30T17:01:30.832 INFO:teuthology.orchestra.run.smithi031.stdout: bdev enable discard = True 2023-09-30T17:01:30.832 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore allocator = stupid 2023-09-30T17:01:30.832 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore block size = 96636764160 2023-09-30T17:01:30.832 INFO:teuthology.orchestra.run.smithi031.stdout: bluestore fsck on mount = True 2023-09-30T17:01:30.832 INFO:teuthology.orchestra.run.smithi031.stdout: debug bluefs = 1/20 2023-09-30T17:01:30.833 INFO:teuthology.orchestra.run.smithi031.stdout: debug bluestore = 1/20 2023-09-30T17:01:30.833 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2023-09-30T17:01:30.833 INFO:teuthology.orchestra.run.smithi031.stdout: debug osd = 20 2023-09-30T17:01:30.833 INFO:teuthology.orchestra.run.smithi031.stdout: debug rocksdb = 4/10 2023-09-30T17:01:30.833 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd backfillfull_ratio = 0.85 2023-09-30T17:01:30.833 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd full ratio = 0.9 2023-09-30T17:01:30.833 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd nearfull ratio = 0.8 2023-09-30T17:01:30.833 INFO:teuthology.orchestra.run.smithi031.stdout: osd blocked scrub grace period = 3600 2023-09-30T17:01:30.833 INFO:teuthology.orchestra.run.smithi031.stdout: osd failsafe full ratio = 0.95 2023-09-30T17:01:30.833 INFO:teuthology.orchestra.run.smithi031.stdout: osd max markdown count = 1000 2023-09-30T17:01:30.833 INFO:teuthology.orchestra.run.smithi031.stdout: osd objectstore = bluestore 2023-09-30T17:01:30.833 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-09-30T17:01:30.834 INFO:teuthology.orchestra.run.smithi031.stdout:[mgr] 2023-09-30T17:01:30.834 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2023-09-30T17:01:30.834 INFO:teuthology.orchestra.run.smithi031.stdout: debug mgr = 20 2023-09-30T17:01:30.834 INFO:teuthology.orchestra.run.smithi031.stdout: debug mon = 20 2023-09-30T17:01:30.834 INFO:teuthology.orchestra.run.smithi031.stdout: debug auth = 20 2023-09-30T17:01:30.834 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min pgs per osd = 4 2023-09-30T17:01:30.834 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min bytes per osd = 10 2023-09-30T17:01:30.834 INFO:teuthology.orchestra.run.smithi031.stdout: mgr/telemetry/nag = false 2023-09-30T17:01:30.834 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-09-30T17:01:30.834 INFO:teuthology.orchestra.run.smithi031.stdout:[mon] 2023-09-30T17:01:30.834 INFO:teuthology.orchestra.run.smithi031.stdout: debug ms = 1 2023-09-30T17:01:30.835 INFO:teuthology.orchestra.run.smithi031.stdout: debug mon = 20 2023-09-30T17:01:30.835 INFO:teuthology.orchestra.run.smithi031.stdout: debug paxos = 20 2023-09-30T17:01:30.835 INFO:teuthology.orchestra.run.smithi031.stdout: debug auth = 20 2023-09-30T17:01:30.835 INFO:teuthology.orchestra.run.smithi031.stdout: mon data avail warn = 5 2023-09-30T17:01:30.835 INFO:teuthology.orchestra.run.smithi031.stdout: mon mgr mkfs grace = 240 2023-09-30T17:01:30.835 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min pgs per osd = 4 2023-09-30T17:01:30.835 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd reporter subtree level = osd 2023-09-30T17:01:30.835 INFO:teuthology.orchestra.run.smithi031.stdout: mon osd prime pg temp = true 2023-09-30T17:01:30.835 INFO:teuthology.orchestra.run.smithi031.stdout: mon reweight min bytes per osd = 10 2023-09-30T17:01:30.835 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-09-30T17:01:30.835 INFO:teuthology.orchestra.run.smithi031.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-09-30T17:01:30.835 INFO:teuthology.orchestra.run.smithi031.stdout: auth mon ticket ttl = 660 # 11m 2023-09-30T17:01:30.836 INFO:teuthology.orchestra.run.smithi031.stdout: auth service ticket ttl = 240 # 4m 2023-09-30T17:01:30.836 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-09-30T17:01:30.836 INFO:teuthology.orchestra.run.smithi031.stdout: # don't complain about insecure global_id in the test suite 2023-09-30T17:01:30.836 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-09-30T17:01:30.836 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-09-30T17:01:30.836 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-09-30T17:01:30.836 INFO:teuthology.orchestra.run.smithi031.stdout: # 1m isn't quite enough 2023-09-30T17:01:30.836 INFO:teuthology.orchestra.run.smithi031.stdout: mon_down_mkfs_grace = 2m 2023-09-30T17:01:30.836 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-09-30T17:01:30.836 INFO:teuthology.orchestra.run.smithi031.stdout: mon_warn_on_filestore_osds = false 2023-09-30T17:01:30.836 INFO:teuthology.orchestra.run.smithi031.stdout: 2023-09-30T17:01:30.836 INFO:teuthology.orchestra.run.smithi031.stdout:[client] 2023-09-30T17:01:30.836 INFO:teuthology.orchestra.run.smithi031.stdout: rgw cache enabled = true 2023-09-30T17:01:30.837 INFO:teuthology.orchestra.run.smithi031.stdout: rgw enable ops log = true 2023-09-30T17:01:30.837 INFO:teuthology.orchestra.run.smithi031.stdout: rgw enable usage log = true 2023-09-30T17:01:30.837 INFO:teuthology.orchestra.run.smithi031.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-09-30T17:01:30.837 INFO:teuthology.orchestra.run.smithi031.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-09-30T17:01:30.837 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.a] 2023-09-30T17:01:30.837 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.b] 2023-09-30T17:01:30.837 INFO:teuthology.orchestra.run.smithi031.stdout:[mon.c] 2023-09-30T17:01:30.837 INFO:teuthology.orchestra.run.smithi031.stdout:[mds.a] 2023-09-30T17:01:30.837 INFO:teuthology.orchestra.run.smithi072.stdout:[global] 2023-09-30T17:01:30.837 INFO:teuthology.orchestra.run.smithi072.stdout: chdir = "" 2023-09-30T17:01:30.837 INFO:teuthology.orchestra.run.smithi072.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-09-30T17:01:30.838 INFO:teuthology.orchestra.run.smithi072.stdout: auth supported = cephx 2023-09-30T17:01:30.838 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-09-30T17:01:30.838 INFO:teuthology.orchestra.run.smithi072.stdout: filestore xattr use omap = true 2023-09-30T17:01:30.838 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-09-30T17:01:30.838 INFO:teuthology.orchestra.run.smithi072.stdout: mon clock drift allowed = 1.000 2023-09-30T17:01:30.838 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-09-30T17:01:30.838 INFO:teuthology.orchestra.run.smithi072.stdout: osd crush chooseleaf type = 0 2023-09-30T17:01:30.838 INFO:teuthology.orchestra.run.smithi072.stdout: auth debug = true 2023-09-30T17:01:30.838 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-09-30T17:01:30.838 INFO:teuthology.orchestra.run.smithi072.stdout: ms die on old message = true 2023-09-30T17:01:30.838 INFO:teuthology.orchestra.run.smithi072.stdout: ms die on bug = true 2023-09-30T17:01:30.838 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-09-30T17:01:30.839 INFO:teuthology.orchestra.run.smithi072.stdout: mon max pg per osd = 10000 # >= luminous 2023-09-30T17:01:30.839 INFO:teuthology.orchestra.run.smithi072.stdout: mon pg warn max object skew = 0 2023-09-30T17:01:30.839 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-09-30T17:01:30.839 INFO:teuthology.orchestra.run.smithi072.stdout: # disable pg_autoscaler by default for new pools 2023-09-30T17:01:30.839 INFO:teuthology.orchestra.run.smithi072.stdout: osd_pool_default_pg_autoscale_mode = off 2023-09-30T17:01:30.839 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-09-30T17:01:30.839 INFO:teuthology.orchestra.run.smithi072.stdout: osd pool default size = 2 2023-09-30T17:01:30.839 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-09-30T17:01:30.839 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd allow primary affinity = true 2023-09-30T17:01:30.839 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd allow pg remap = true 2023-09-30T17:01:30.839 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on legacy crush tunables = false 2023-09-30T17:01:30.839 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on crush straw calc version zero = false 2023-09-30T17:01:30.840 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on no sortbitwise = false 2023-09-30T17:01:30.840 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on osd down out interval zero = false 2023-09-30T17:01:30.840 INFO:teuthology.orchestra.run.smithi072.stdout: mon warn on too few osds = false 2023-09-30T17:01:30.840 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-09-30T17:01:30.840 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_pool_no_redundancy = false 2023-09-30T17:01:30.840 INFO:teuthology.orchestra.run.smithi072.stdout: mon_allow_pool_size_one = true 2023-09-30T17:01:30.840 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-09-30T17:01:30.840 INFO:teuthology.orchestra.run.smithi072.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-09-30T17:01:30.840 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-09-30T17:01:30.840 INFO:teuthology.orchestra.run.smithi072.stdout: osd default data pool replay window = 5 2023-09-30T17:01:30.840 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-09-30T17:01:30.841 INFO:teuthology.orchestra.run.smithi072.stdout: mon allow pool delete = true 2023-09-30T17:01:30.841 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-09-30T17:01:30.841 INFO:teuthology.orchestra.run.smithi072.stdout: mon cluster log file level = debug 2023-09-30T17:01:30.841 INFO:teuthology.orchestra.run.smithi072.stdout: debug asserts on shutdown = true 2023-09-30T17:01:30.841 INFO:teuthology.orchestra.run.smithi072.stdout: mon health detail to clog = false 2023-09-30T17:01:30.841 INFO:teuthology.orchestra.run.smithi072.stdout: mon host = "172.21.15.7,[v2:172.21.15.7:3301,v1:172.21.15.7:6790],[v2:172.21.15.7:3302,v1:172.21.15.7:6791]" 2023-09-30T17:01:30.841 INFO:teuthology.orchestra.run.smithi072.stdout: osd_pg_log_dups_tracked = 10000 2023-09-30T17:01:30.841 INFO:teuthology.orchestra.run.smithi072.stdout: fsid = 68daccc3-6ea9-4db7-9771-3803ff202df8 2023-09-30T17:01:30.841 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-09-30T17:01:30.841 INFO:teuthology.orchestra.run.smithi072.stdout:[osd] 2023-09-30T17:01:30.841 INFO:teuthology.orchestra.run.smithi072.stdout: osd journal size = 100 2023-09-30T17:01:30.841 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-09-30T17:01:30.842 INFO:teuthology.orchestra.run.smithi072.stdout: osd scrub load threshold = 5.0 2023-09-30T17:01:30.842 INFO:teuthology.orchestra.run.smithi072.stdout: osd scrub max interval = 600 2023-09-30T17:01:30.842 INFO:teuthology.orchestra.run.smithi072.stdout: osd mclock profile = high_recovery_ops 2023-09-30T17:01:30.842 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-09-30T17:01:30.842 INFO:teuthology.orchestra.run.smithi072.stdout: osd recover clone overlap = true 2023-09-30T17:01:30.842 INFO:teuthology.orchestra.run.smithi072.stdout: osd recovery max chunk = 1048576 2023-09-30T17:01:30.842 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-09-30T17:01:30.842 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug shutdown = true 2023-09-30T17:01:30.842 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug op order = true 2023-09-30T17:01:30.842 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug verify stray on activate = true 2023-09-30T17:01:30.842 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-09-30T17:01:30.843 INFO:teuthology.orchestra.run.smithi072.stdout: osd open classes on start = true 2023-09-30T17:01:30.843 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug pg log writeout = true 2023-09-30T17:01:30.843 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-09-30T17:01:30.843 INFO:teuthology.orchestra.run.smithi072.stdout: osd deep scrub update digest min age = 30 2023-09-30T17:01:30.843 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-09-30T17:01:30.843 INFO:teuthology.orchestra.run.smithi072.stdout: osd map max advance = 10 2023-09-30T17:01:30.843 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-09-30T17:01:30.843 INFO:teuthology.orchestra.run.smithi072.stdout: journal zero on create = true 2023-09-30T17:01:30.843 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-09-30T17:01:30.843 INFO:teuthology.orchestra.run.smithi072.stdout: filestore ondisk finisher threads = 3 2023-09-30T17:01:30.843 INFO:teuthology.orchestra.run.smithi072.stdout: filestore apply finisher threads = 3 2023-09-30T17:01:30.844 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-09-30T17:01:30.844 INFO:teuthology.orchestra.run.smithi072.stdout: bdev debug aio = true 2023-09-30T17:01:30.844 INFO:teuthology.orchestra.run.smithi072.stdout: osd debug misdirected ops = true 2023-09-30T17:01:30.844 INFO:teuthology.orchestra.run.smithi072.stdout: bdev async discard = True 2023-09-30T17:01:30.844 INFO:teuthology.orchestra.run.smithi072.stdout: bdev enable discard = True 2023-09-30T17:01:30.844 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore allocator = stupid 2023-09-30T17:01:30.844 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore block size = 96636764160 2023-09-30T17:01:30.844 INFO:teuthology.orchestra.run.smithi072.stdout: bluestore fsck on mount = True 2023-09-30T17:01:30.844 INFO:teuthology.orchestra.run.smithi072.stdout: debug bluefs = 1/20 2023-09-30T17:01:30.844 INFO:teuthology.orchestra.run.smithi072.stdout: debug bluestore = 1/20 2023-09-30T17:01:30.844 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-09-30T17:01:30.845 INFO:teuthology.orchestra.run.smithi072.stdout: debug osd = 20 2023-09-30T17:01:30.845 INFO:teuthology.orchestra.run.smithi072.stdout: debug rocksdb = 4/10 2023-09-30T17:01:30.845 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd backfillfull_ratio = 0.85 2023-09-30T17:01:30.845 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd full ratio = 0.9 2023-09-30T17:01:30.845 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd nearfull ratio = 0.8 2023-09-30T17:01:30.845 INFO:teuthology.orchestra.run.smithi072.stdout: osd blocked scrub grace period = 3600 2023-09-30T17:01:30.845 INFO:teuthology.orchestra.run.smithi072.stdout: osd failsafe full ratio = 0.95 2023-09-30T17:01:30.845 INFO:teuthology.orchestra.run.smithi072.stdout: osd max markdown count = 1000 2023-09-30T17:01:30.845 INFO:teuthology.orchestra.run.smithi072.stdout: osd objectstore = bluestore 2023-09-30T17:01:30.845 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-09-30T17:01:30.845 INFO:teuthology.orchestra.run.smithi072.stdout:[mgr] 2023-09-30T17:01:30.846 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-09-30T17:01:30.846 INFO:teuthology.orchestra.run.smithi072.stdout: debug mgr = 20 2023-09-30T17:01:30.846 INFO:teuthology.orchestra.run.smithi072.stdout: debug mon = 20 2023-09-30T17:01:30.846 INFO:teuthology.orchestra.run.smithi072.stdout: debug auth = 20 2023-09-30T17:01:30.846 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min pgs per osd = 4 2023-09-30T17:01:30.846 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min bytes per osd = 10 2023-09-30T17:01:30.846 INFO:teuthology.orchestra.run.smithi072.stdout: mgr/telemetry/nag = false 2023-09-30T17:01:30.846 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-09-30T17:01:30.846 INFO:teuthology.orchestra.run.smithi072.stdout:[mon] 2023-09-30T17:01:30.846 INFO:teuthology.orchestra.run.smithi072.stdout: debug ms = 1 2023-09-30T17:01:30.846 INFO:teuthology.orchestra.run.smithi072.stdout: debug mon = 20 2023-09-30T17:01:30.847 INFO:teuthology.orchestra.run.smithi072.stdout: debug paxos = 20 2023-09-30T17:01:30.847 INFO:teuthology.orchestra.run.smithi072.stdout: debug auth = 20 2023-09-30T17:01:30.847 INFO:teuthology.orchestra.run.smithi072.stdout: mon data avail warn = 5 2023-09-30T17:01:30.847 INFO:teuthology.orchestra.run.smithi072.stdout: mon mgr mkfs grace = 240 2023-09-30T17:01:30.847 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min pgs per osd = 4 2023-09-30T17:01:30.847 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd reporter subtree level = osd 2023-09-30T17:01:30.847 INFO:teuthology.orchestra.run.smithi072.stdout: mon osd prime pg temp = true 2023-09-30T17:01:30.847 INFO:teuthology.orchestra.run.smithi072.stdout: mon reweight min bytes per osd = 10 2023-09-30T17:01:30.847 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-09-30T17:01:30.847 INFO:teuthology.orchestra.run.smithi072.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-09-30T17:01:30.847 INFO:teuthology.orchestra.run.smithi072.stdout: auth mon ticket ttl = 660 # 11m 2023-09-30T17:01:30.847 INFO:teuthology.orchestra.run.smithi072.stdout: auth service ticket ttl = 240 # 4m 2023-09-30T17:01:30.848 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-09-30T17:01:30.848 INFO:teuthology.orchestra.run.smithi072.stdout: # don't complain about insecure global_id in the test suite 2023-09-30T17:01:30.848 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-09-30T17:01:30.848 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-09-30T17:01:30.848 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-09-30T17:01:30.848 INFO:teuthology.orchestra.run.smithi072.stdout: # 1m isn't quite enough 2023-09-30T17:01:30.848 INFO:teuthology.orchestra.run.smithi072.stdout: mon_down_mkfs_grace = 2m 2023-09-30T17:01:30.848 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-09-30T17:01:30.848 INFO:teuthology.orchestra.run.smithi072.stdout: mon_warn_on_filestore_osds = false 2023-09-30T17:01:30.848 INFO:teuthology.orchestra.run.smithi072.stdout: 2023-09-30T17:01:30.849 INFO:teuthology.orchestra.run.smithi072.stdout:[client] 2023-09-30T17:01:30.849 INFO:teuthology.orchestra.run.smithi072.stdout: rgw cache enabled = true 2023-09-30T17:01:30.849 INFO:teuthology.orchestra.run.smithi072.stdout: rgw enable ops log = true 2023-09-30T17:01:30.849 INFO:teuthology.orchestra.run.smithi072.stdout: rgw enable usage log = true 2023-09-30T17:01:30.849 INFO:teuthology.orchestra.run.smithi072.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-09-30T17:01:30.849 INFO:teuthology.orchestra.run.smithi072.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-09-30T17:01:30.849 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.a] 2023-09-30T17:01:30.849 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.b] 2023-09-30T17:01:30.849 INFO:teuthology.orchestra.run.smithi072.stdout:[mon.c] 2023-09-30T17:01:30.849 INFO:teuthology.orchestra.run.smithi072.stdout:[mds.a] 2023-09-30T17:01:30.849 INFO:teuthology.orchestra.run.smithi134.stdout:[global] 2023-09-30T17:01:30.850 INFO:teuthology.orchestra.run.smithi134.stdout: chdir = "" 2023-09-30T17:01:30.850 INFO:teuthology.orchestra.run.smithi134.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-09-30T17:01:30.850 INFO:teuthology.orchestra.run.smithi134.stdout: auth supported = cephx 2023-09-30T17:01:30.850 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-09-30T17:01:30.850 INFO:teuthology.orchestra.run.smithi134.stdout: filestore xattr use omap = true 2023-09-30T17:01:30.850 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-09-30T17:01:30.850 INFO:teuthology.orchestra.run.smithi134.stdout: mon clock drift allowed = 1.000 2023-09-30T17:01:30.850 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-09-30T17:01:30.850 INFO:teuthology.orchestra.run.smithi134.stdout: osd crush chooseleaf type = 0 2023-09-30T17:01:30.851 INFO:teuthology.orchestra.run.smithi134.stdout: auth debug = true 2023-09-30T17:01:30.851 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-09-30T17:01:30.851 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on old message = true 2023-09-30T17:01:30.851 INFO:teuthology.orchestra.run.smithi134.stdout: ms die on bug = true 2023-09-30T17:01:30.851 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-09-30T17:01:30.851 INFO:teuthology.orchestra.run.smithi134.stdout: mon max pg per osd = 10000 # >= luminous 2023-09-30T17:01:30.851 INFO:teuthology.orchestra.run.smithi134.stdout: mon pg warn max object skew = 0 2023-09-30T17:01:30.851 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-09-30T17:01:30.851 INFO:teuthology.orchestra.run.smithi134.stdout: # disable pg_autoscaler by default for new pools 2023-09-30T17:01:30.851 INFO:teuthology.orchestra.run.smithi134.stdout: osd_pool_default_pg_autoscale_mode = off 2023-09-30T17:01:30.851 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-09-30T17:01:30.852 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default size = 2 2023-09-30T17:01:30.852 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-09-30T17:01:30.852 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow primary affinity = true 2023-09-30T17:01:30.852 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd allow pg remap = true 2023-09-30T17:01:30.852 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on legacy crush tunables = false 2023-09-30T17:01:30.852 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on crush straw calc version zero = false 2023-09-30T17:01:30.852 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on no sortbitwise = false 2023-09-30T17:01:30.852 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on osd down out interval zero = false 2023-09-30T17:01:30.852 INFO:teuthology.orchestra.run.smithi134.stdout: mon warn on too few osds = false 2023-09-30T17:01:30.852 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-09-30T17:01:30.852 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_pool_no_redundancy = false 2023-09-30T17:01:30.852 INFO:teuthology.orchestra.run.smithi134.stdout: mon_allow_pool_size_one = true 2023-09-30T17:01:30.853 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-09-30T17:01:30.853 INFO:teuthology.orchestra.run.smithi134.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-09-30T17:01:30.853 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-09-30T17:01:30.853 INFO:teuthology.orchestra.run.smithi134.stdout: osd default data pool replay window = 5 2023-09-30T17:01:30.853 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-09-30T17:01:30.853 INFO:teuthology.orchestra.run.smithi134.stdout: mon allow pool delete = true 2023-09-30T17:01:30.853 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-09-30T17:01:30.853 INFO:teuthology.orchestra.run.smithi134.stdout: mon cluster log file level = debug 2023-09-30T17:01:30.853 INFO:teuthology.orchestra.run.smithi134.stdout: debug asserts on shutdown = true 2023-09-30T17:01:30.853 INFO:teuthology.orchestra.run.smithi134.stdout: mon health detail to clog = false 2023-09-30T17:01:30.853 INFO:teuthology.orchestra.run.smithi134.stdout: mon host = "172.21.15.7,[v2:172.21.15.7:3301,v1:172.21.15.7:6790],[v2:172.21.15.7:3302,v1:172.21.15.7:6791]" 2023-09-30T17:01:30.854 INFO:teuthology.orchestra.run.smithi134.stdout: osd_pg_log_dups_tracked = 10000 2023-09-30T17:01:30.854 INFO:teuthology.orchestra.run.smithi134.stdout: fsid = 68daccc3-6ea9-4db7-9771-3803ff202df8 2023-09-30T17:01:30.854 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-09-30T17:01:30.854 INFO:teuthology.orchestra.run.smithi134.stdout:[osd] 2023-09-30T17:01:30.854 INFO:teuthology.orchestra.run.smithi134.stdout: osd journal size = 100 2023-09-30T17:01:30.854 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-09-30T17:01:30.854 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub load threshold = 5.0 2023-09-30T17:01:30.854 INFO:teuthology.orchestra.run.smithi134.stdout: osd scrub max interval = 600 2023-09-30T17:01:30.854 INFO:teuthology.orchestra.run.smithi134.stdout: osd mclock profile = high_recovery_ops 2023-09-30T17:01:30.854 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-09-30T17:01:30.854 INFO:teuthology.orchestra.run.smithi134.stdout: osd recover clone overlap = true 2023-09-30T17:01:30.855 INFO:teuthology.orchestra.run.smithi134.stdout: osd recovery max chunk = 1048576 2023-09-30T17:01:30.855 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-09-30T17:01:30.855 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug shutdown = true 2023-09-30T17:01:30.855 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug op order = true 2023-09-30T17:01:30.855 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug verify stray on activate = true 2023-09-30T17:01:30.855 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-09-30T17:01:30.855 INFO:teuthology.orchestra.run.smithi134.stdout: osd open classes on start = true 2023-09-30T17:01:30.855 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug pg log writeout = true 2023-09-30T17:01:30.855 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-09-30T17:01:30.855 INFO:teuthology.orchestra.run.smithi134.stdout: osd deep scrub update digest min age = 30 2023-09-30T17:01:30.855 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-09-30T17:01:30.856 INFO:teuthology.orchestra.run.smithi134.stdout: osd map max advance = 10 2023-09-30T17:01:30.856 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-09-30T17:01:30.856 INFO:teuthology.orchestra.run.smithi134.stdout: journal zero on create = true 2023-09-30T17:01:30.856 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-09-30T17:01:30.856 INFO:teuthology.orchestra.run.smithi134.stdout: filestore ondisk finisher threads = 3 2023-09-30T17:01:30.856 INFO:teuthology.orchestra.run.smithi134.stdout: filestore apply finisher threads = 3 2023-09-30T17:01:30.856 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-09-30T17:01:30.856 INFO:teuthology.orchestra.run.smithi134.stdout: bdev debug aio = true 2023-09-30T17:01:30.856 INFO:teuthology.orchestra.run.smithi134.stdout: osd debug misdirected ops = true 2023-09-30T17:01:30.856 INFO:teuthology.orchestra.run.smithi134.stdout: bdev async discard = True 2023-09-30T17:01:30.857 INFO:teuthology.orchestra.run.smithi134.stdout: bdev enable discard = True 2023-09-30T17:01:30.857 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore allocator = stupid 2023-09-30T17:01:30.857 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore block size = 96636764160 2023-09-30T17:01:30.857 INFO:teuthology.orchestra.run.smithi134.stdout: bluestore fsck on mount = True 2023-09-30T17:01:30.857 INFO:teuthology.orchestra.run.smithi134.stdout: debug bluefs = 1/20 2023-09-30T17:01:30.857 INFO:teuthology.orchestra.run.smithi134.stdout: debug bluestore = 1/20 2023-09-30T17:01:30.857 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2023-09-30T17:01:30.857 INFO:teuthology.orchestra.run.smithi134.stdout: debug osd = 20 2023-09-30T17:01:30.857 INFO:teuthology.orchestra.run.smithi134.stdout: debug rocksdb = 4/10 2023-09-30T17:01:30.857 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd backfillfull_ratio = 0.85 2023-09-30T17:01:30.857 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd full ratio = 0.9 2023-09-30T17:01:30.858 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd nearfull ratio = 0.8 2023-09-30T17:01:30.858 INFO:teuthology.orchestra.run.smithi134.stdout: osd blocked scrub grace period = 3600 2023-09-30T17:01:30.858 INFO:teuthology.orchestra.run.smithi134.stdout: osd failsafe full ratio = 0.95 2023-09-30T17:01:30.858 INFO:teuthology.orchestra.run.smithi134.stdout: osd max markdown count = 1000 2023-09-30T17:01:30.858 INFO:teuthology.orchestra.run.smithi134.stdout: osd objectstore = bluestore 2023-09-30T17:01:30.858 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-09-30T17:01:30.858 INFO:teuthology.orchestra.run.smithi134.stdout:[mgr] 2023-09-30T17:01:30.858 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2023-09-30T17:01:30.858 INFO:teuthology.orchestra.run.smithi134.stdout: debug mgr = 20 2023-09-30T17:01:30.858 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2023-09-30T17:01:30.858 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2023-09-30T17:01:30.859 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2023-09-30T17:01:30.859 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2023-09-30T17:01:30.859 INFO:teuthology.orchestra.run.smithi134.stdout: mgr/telemetry/nag = false 2023-09-30T17:01:30.859 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-09-30T17:01:30.859 INFO:teuthology.orchestra.run.smithi134.stdout:[mon] 2023-09-30T17:01:30.859 INFO:teuthology.orchestra.run.smithi134.stdout: debug ms = 1 2023-09-30T17:01:30.859 INFO:teuthology.orchestra.run.smithi134.stdout: debug mon = 20 2023-09-30T17:01:30.859 INFO:teuthology.orchestra.run.smithi134.stdout: debug paxos = 20 2023-09-30T17:01:30.859 INFO:teuthology.orchestra.run.smithi134.stdout: debug auth = 20 2023-09-30T17:01:30.859 INFO:teuthology.orchestra.run.smithi134.stdout: mon data avail warn = 5 2023-09-30T17:01:30.859 INFO:teuthology.orchestra.run.smithi134.stdout: mon mgr mkfs grace = 240 2023-09-30T17:01:30.859 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min pgs per osd = 4 2023-09-30T17:01:30.860 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd reporter subtree level = osd 2023-09-30T17:01:30.860 INFO:teuthology.orchestra.run.smithi134.stdout: mon osd prime pg temp = true 2023-09-30T17:01:30.860 INFO:teuthology.orchestra.run.smithi134.stdout: mon reweight min bytes per osd = 10 2023-09-30T17:01:30.860 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-09-30T17:01:30.860 INFO:teuthology.orchestra.run.smithi134.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-09-30T17:01:30.860 INFO:teuthology.orchestra.run.smithi134.stdout: auth mon ticket ttl = 660 # 11m 2023-09-30T17:01:30.860 INFO:teuthology.orchestra.run.smithi134.stdout: auth service ticket ttl = 240 # 4m 2023-09-30T17:01:30.860 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-09-30T17:01:30.860 INFO:teuthology.orchestra.run.smithi134.stdout: # don't complain about insecure global_id in the test suite 2023-09-30T17:01:30.860 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-09-30T17:01:30.861 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-09-30T17:01:30.861 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-09-30T17:01:30.861 INFO:teuthology.orchestra.run.smithi134.stdout: # 1m isn't quite enough 2023-09-30T17:01:30.861 INFO:teuthology.orchestra.run.smithi134.stdout: mon_down_mkfs_grace = 2m 2023-09-30T17:01:30.861 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-09-30T17:01:30.861 INFO:teuthology.orchestra.run.smithi134.stdout: mon_warn_on_filestore_osds = false 2023-09-30T17:01:30.861 INFO:teuthology.orchestra.run.smithi134.stdout: 2023-09-30T17:01:30.861 INFO:teuthology.orchestra.run.smithi134.stdout:[client] 2023-09-30T17:01:30.861 INFO:teuthology.orchestra.run.smithi134.stdout: rgw cache enabled = true 2023-09-30T17:01:30.862 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable ops log = true 2023-09-30T17:01:30.862 INFO:teuthology.orchestra.run.smithi134.stdout: rgw enable usage log = true 2023-09-30T17:01:30.862 INFO:teuthology.orchestra.run.smithi134.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-09-30T17:01:30.862 INFO:teuthology.orchestra.run.smithi134.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-09-30T17:01:30.862 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.a] 2023-09-30T17:01:30.862 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.b] 2023-09-30T17:01:30.862 INFO:teuthology.orchestra.run.smithi134.stdout:[mon.c] 2023-09-30T17:01:30.862 INFO:teuthology.orchestra.run.smithi134.stdout:[mds.a] 2023-09-30T17:01:30.864 INFO:tasks.ceph:Creating admin key on mon.a... 2023-09-30T17:01:30.865 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-09-30T17:01:30.962 INFO:tasks.ceph:Copying monmap to all nodes... 2023-09-30T17:01:30.962 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-09-30T17:01:30.962 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-09-30T17:01:30.979 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-09-30T17:01:30.979 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-09-30T17:01:31.035 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi007.front.sepia.ceph.com 2023-09-30T17:01:31.036 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-09-30T17:01:31.036 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd of=/etc/ceph/ceph.keyring 2023-09-30T17:01:31.036 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-30T17:01:31.114 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-09-30T17:01:31.114 DEBUG:teuthology.orchestra.run.smithi007:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-09-30T17:01:31.171 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi031.front.sepia.ceph.com 2023-09-30T17:01:31.172 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-09-30T17:01:31.172 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd of=/etc/ceph/ceph.keyring 2023-09-30T17:01:31.172 DEBUG:teuthology.orchestra.run.smithi031:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-30T17:01:31.218 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-09-30T17:01:31.218 DEBUG:teuthology.orchestra.run.smithi031:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-09-30T17:01:31.276 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi072.front.sepia.ceph.com 2023-09-30T17:01:31.277 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-09-30T17:01:31.277 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd of=/etc/ceph/ceph.keyring 2023-09-30T17:01:31.277 DEBUG:teuthology.orchestra.run.smithi072:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-30T17:01:31.320 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-09-30T17:01:31.321 DEBUG:teuthology.orchestra.run.smithi072:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-09-30T17:01:31.380 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi134.front.sepia.ceph.com 2023-09-30T17:01:31.380 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-09-30T17:01:31.380 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.keyring 2023-09-30T17:01:31.380 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-30T17:01:31.422 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-09-30T17:01:31.422 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-09-30T17:01:31.480 INFO:tasks.ceph:Setting up mon nodes... 2023-09-30T17:01:31.480 INFO:tasks.ceph:Setting up mgr nodes... 2023-09-30T17:01:31.480 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-09-30T17:01:31.539 INFO:teuthology.orchestra.run.smithi007.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-09-30T17:01:31.539 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-09-30T17:01:31.594 INFO:teuthology.orchestra.run.smithi007.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-09-30T17:01:31.597 INFO:tasks.ceph:Setting up mds nodes... 2023-09-30T17:01:31.597 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-09-30T17:01:31.652 INFO:teuthology.orchestra.run.smithi007.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-09-30T17:01:31.654 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-09-30T17:01:31.685 INFO:tasks.ceph_client:Setting up client nodes... 2023-09-30T17:01:31.686 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-09-30T17:01:31.769 INFO:teuthology.orchestra.run.smithi007.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-09-30T17:01:31.782 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-09-30T17:01:31.783 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi031.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi072.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi134.front.sepia.ceph.com'): {'osd.2': '/dev/vg_nvme/lv_1'}} 2023-09-30T17:01:31.783 DEBUG:teuthology.orchestra.run.smithi031:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-09-30T17:01:31.817 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2023-09-30T17:01:31.817 INFO:tasks.ceph:role: osd.0 2023-09-30T17:01:31.817 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi031.front.sepia.ceph.com 2023-09-30T17:01:31.817 DEBUG:teuthology.orchestra.run.smithi031:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-09-30T17:01:31.898 INFO:teuthology.orchestra.run.smithi031.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-09-30T17:01:31.898 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-30T17:01:31.898 INFO:teuthology.orchestra.run.smithi031.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-30T17:01:31.898 INFO:teuthology.orchestra.run.smithi031.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-30T17:01:31.898 INFO:teuthology.orchestra.run.smithi031.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-30T17:01:31.898 INFO:teuthology.orchestra.run.smithi031.stdout: = sunit=0 swidth=0 blks 2023-09-30T17:01:31.898 INFO:teuthology.orchestra.run.smithi031.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-30T17:01:31.898 INFO:teuthology.orchestra.run.smithi031.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-30T17:01:31.899 INFO:teuthology.orchestra.run.smithi031.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-30T17:01:31.899 INFO:teuthology.orchestra.run.smithi031.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-30T17:01:32.332 INFO:teuthology.orchestra.run.smithi031.stdout:Discarding blocks...Done. 2023-09-30T17:01:32.334 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi031.front.sepia.ceph.com -o noatime 2023-09-30T17:01:32.334 DEBUG:teuthology.orchestra.run.smithi031:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-09-30T17:01:32.517 DEBUG:teuthology.orchestra.run.smithi031:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-09-30T17:01:32.558 DEBUG:teuthology.orchestra.run.smithi031:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-30T17:01:32.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-09-30T17:01:32.675+0000 7f8d60432640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-09-30T17:01:32.675 INFO:teuthology.orchestra.run.smithi031.stderr:2023-09-30T17:01:32.676+0000 7f8d60432640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-09-30T17:01:32.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-09-30T17:01:32.676+0000 7f8d60432640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-30T17:01:32.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-09-30T17:01:32.676+0000 7f8d60432640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-30T17:01:32.676 INFO:teuthology.orchestra.run.smithi031.stderr:2023-09-30T17:01:32.676+0000 7f8d60432640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-30T17:01:32.680 INFO:teuthology.orchestra.run.smithi031.stderr:2023-09-30T17:01:32.680+0000 7f8d60432640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-09-30T17:01:35.552 DEBUG:teuthology.orchestra.run.smithi031:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-09-30T17:01:35.649 DEBUG:teuthology.orchestra.run.smithi072:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-09-30T17:01:35.682 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1'} 2023-09-30T17:01:35.682 INFO:tasks.ceph:role: osd.1 2023-09-30T17:01:35.682 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi072.front.sepia.ceph.com 2023-09-30T17:01:35.682 DEBUG:teuthology.orchestra.run.smithi072:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-09-30T17:01:35.760 INFO:teuthology.orchestra.run.smithi072.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-09-30T17:01:35.760 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-30T17:01:35.760 INFO:teuthology.orchestra.run.smithi072.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-30T17:01:35.760 INFO:teuthology.orchestra.run.smithi072.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-30T17:01:35.761 INFO:teuthology.orchestra.run.smithi072.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-30T17:01:35.761 INFO:teuthology.orchestra.run.smithi072.stdout: = sunit=0 swidth=0 blks 2023-09-30T17:01:35.761 INFO:teuthology.orchestra.run.smithi072.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-30T17:01:35.761 INFO:teuthology.orchestra.run.smithi072.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-30T17:01:35.761 INFO:teuthology.orchestra.run.smithi072.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-30T17:01:35.761 INFO:teuthology.orchestra.run.smithi072.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-30T17:01:36.186 INFO:teuthology.orchestra.run.smithi072.stdout:Discarding blocks...Done. 2023-09-30T17:01:36.188 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi072.front.sepia.ceph.com -o noatime 2023-09-30T17:01:36.189 DEBUG:teuthology.orchestra.run.smithi072:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2023-09-30T17:01:36.373 DEBUG:teuthology.orchestra.run.smithi072:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-09-30T17:01:36.411 DEBUG:teuthology.orchestra.run.smithi072:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-30T17:01:36.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-09-30T17:01:36.900+0000 7faf9e545640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-09-30T17:01:36.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-09-30T17:01:36.901+0000 7faf9e545640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-09-30T17:01:36.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-09-30T17:01:36.901+0000 7faf9e545640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-30T17:01:36.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-09-30T17:01:36.901+0000 7faf9e545640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-30T17:01:36.901 INFO:teuthology.orchestra.run.smithi072.stderr:2023-09-30T17:01:36.901+0000 7faf9e545640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-30T17:01:36.902 INFO:teuthology.orchestra.run.smithi072.stderr:2023-09-30T17:01:36.901+0000 7faf9e545640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-09-30T17:01:39.784 DEBUG:teuthology.orchestra.run.smithi072:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-09-30T17:01:39.823 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-09-30T17:01:39.855 INFO:tasks.ceph:roles_to_devs: {'osd.2': '/dev/vg_nvme/lv_1'} 2023-09-30T17:01:39.855 INFO:tasks.ceph:role: osd.2 2023-09-30T17:01:39.855 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi134.front.sepia.ceph.com 2023-09-30T17:01:39.855 DEBUG:teuthology.orchestra.run.smithi134:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-09-30T17:01:39.932 INFO:teuthology.orchestra.run.smithi134.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-09-30T17:01:39.932 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-30T17:01:39.932 INFO:teuthology.orchestra.run.smithi134.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-30T17:01:39.932 INFO:teuthology.orchestra.run.smithi134.stdout: = reflink=1 bigtime=0 inobtcount=0 2023-09-30T17:01:39.932 INFO:teuthology.orchestra.run.smithi134.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-30T17:01:39.933 INFO:teuthology.orchestra.run.smithi134.stdout: = sunit=0 swidth=0 blks 2023-09-30T17:01:39.933 INFO:teuthology.orchestra.run.smithi134.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-30T17:01:39.933 INFO:teuthology.orchestra.run.smithi134.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-30T17:01:39.933 INFO:teuthology.orchestra.run.smithi134.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-30T17:01:39.933 INFO:teuthology.orchestra.run.smithi134.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-30T17:01:40.357 INFO:teuthology.orchestra.run.smithi134.stdout:Discarding blocks...Done. 2023-09-30T17:01:40.359 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi134.front.sepia.ceph.com -o noatime 2023-09-30T17:01:40.359 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2023-09-30T17:01:40.513 DEBUG:teuthology.orchestra.run.smithi134:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-09-30T17:01:40.551 DEBUG:teuthology.orchestra.run.smithi134:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-30T17:01:40.665 INFO:teuthology.orchestra.run.smithi134.stderr:2023-09-30T17:01:40.665+0000 7fa8eff67640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-09-30T17:01:40.670 INFO:teuthology.orchestra.run.smithi134.stderr:2023-09-30T17:01:40.669+0000 7fa8eff67640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-09-30T17:01:40.670 INFO:teuthology.orchestra.run.smithi134.stderr:2023-09-30T17:01:40.669+0000 7fa8eff67640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-30T17:01:40.670 INFO:teuthology.orchestra.run.smithi134.stderr:2023-09-30T17:01:40.669+0000 7fa8eff67640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-30T17:01:40.670 INFO:teuthology.orchestra.run.smithi134.stderr:2023-09-30T17:01:40.669+0000 7fa8eff67640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-30T17:01:40.676 INFO:teuthology.orchestra.run.smithi134.stderr:2023-09-30T17:01:40.675+0000 7fa8eff67640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-09-30T17:01:43.550 DEBUG:teuthology.orchestra.run.smithi134:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-09-30T17:01:43.665 INFO:tasks.ceph:Reading keys from all nodes... 2023-09-30T17:01:43.665 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-09-30T17:01:43.665 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-09-30T17:01:43.699 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-09-30T17:01:43.699 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-09-30T17:01:43.772 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-09-30T17:01:43.772 DEBUG:teuthology.orchestra.run.smithi007:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-09-30T17:01:43.844 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-09-30T17:01:43.844 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-09-30T17:01:43.878 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-09-30T17:01:43.878 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-09-30T17:01:43.911 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-09-30T17:01:43.911 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-09-30T17:01:43.943 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-09-30T17:01:43.943 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-09-30T17:01:43.962 INFO:tasks.ceph:Adding keys to all mons... 2023-09-30T17:01:43.963 DEBUG:teuthology.orchestra.run.smithi007:> sudo tee -a /etc/ceph/ceph.keyring 2023-09-30T17:01:44.032 INFO:teuthology.orchestra.run.smithi007.stdout:[mgr.x] 2023-09-30T17:01:44.032 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQBrVBhljGoDIBAAoP88R5172B1/SeQWnOWeTQ== 2023-09-30T17:01:44.033 INFO:teuthology.orchestra.run.smithi007.stdout:[mgr.y] 2023-09-30T17:01:44.033 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQBrVBhlbQF5IxAAEAo10gJLLqIitPBorjNdbg== 2023-09-30T17:01:44.033 INFO:teuthology.orchestra.run.smithi007.stdout:[mds.a] 2023-09-30T17:01:44.033 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQBrVBhlUzTmJhAA7Su6itJRCxftxsQKqJTvrA== 2023-09-30T17:01:44.033 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.0] 2023-09-30T17:01:44.033 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQBsVBhlOPBJKBAA8JpUEmXNRiblbChfoCJW3Q== 2023-09-30T17:01:44.033 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.1] 2023-09-30T17:01:44.033 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQBwVBhlfW+6NRAAtWuGjU0y50I19SUhRW8ndQ== 2023-09-30T17:01:44.033 INFO:teuthology.orchestra.run.smithi007.stdout:[osd.2] 2023-09-30T17:01:44.033 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQB0VBhl9oO5JxAAWgxGhfktj5ej6LsiiqqGLg== 2023-09-30T17:01:44.033 INFO:teuthology.orchestra.run.smithi007.stdout:[client.0] 2023-09-30T17:01:44.034 INFO:teuthology.orchestra.run.smithi007.stdout: key = AQBrVBhlOVjoLRAA0DWo4WfKq9iQ7ua3Qp4Jog== 2023-09-30T17:01:44.034 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-30T17:01:44.135 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-30T17:01:44.191 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-30T17:01:44.248 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T17:01:44.302 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T17:01:44.356 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T17:01:44.410 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-30T17:01:44.467 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-09-30T17:01:44.468 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-09-30T17:01:44.495 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-30T17:01:44.604 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-09-30T17:01:44.631 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-09-30T17:01:44.698 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-30T17:01:44.797 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-09-30T17:01:44.824 DEBUG:teuthology.orchestra.run.smithi007:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-09-30T17:01:44.891 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-30T17:01:44.990 DEBUG:teuthology.orchestra.run.smithi007:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-09-30T17:01:45.016 DEBUG:teuthology.orchestra.run.smithi007:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-09-30T17:01:45.074 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-09-30T17:01:45.075 INFO:tasks.ceph.mon.a:Restarting daemon 2023-09-30T17:01:45.075 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-09-30T17:01:45.116 INFO:tasks.ceph.mon.a:Started 2023-09-30T17:01:45.116 INFO:tasks.ceph.mon.b:Restarting daemon 2023-09-30T17:01:45.116 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-09-30T17:01:45.118 INFO:tasks.ceph.mon.b:Started 2023-09-30T17:01:45.118 INFO:tasks.ceph.mon.c:Restarting daemon 2023-09-30T17:01:45.119 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-09-30T17:01:45.120 INFO:tasks.ceph.mon.c:Started 2023-09-30T17:01:45.121 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-09-30T17:01:45.121 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-09-30T17:01:45.121 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-09-30T17:01:45.123 INFO:tasks.ceph.mgr.x:Started 2023-09-30T17:01:45.123 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-09-30T17:01:45.123 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-09-30T17:01:45.125 INFO:tasks.ceph.mgr.y:Started 2023-09-30T17:01:45.125 INFO:tasks.ceph:Setting crush tunables to default 2023-09-30T17:01:45.126 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --cluster ceph osd crush tunables default 2023-09-30T17:01:55.459 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-09-30T17:01:55.459+0000 7f7f3b057200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-30T17:01:55.460 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-09-30T17:01:55.459+0000 7f343b52d200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-30T17:01:55.529 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-09-30T17:01:55.529+0000 7f343b52d200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-30T17:01:55.530 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-09-30T17:01:55.529+0000 7f7f3b057200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-30T17:01:55.610 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-09-30T17:01:55.610+0000 7f7f3b057200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-30T17:01:55.610 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-09-30T17:01:55.610+0000 7f343b52d200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-30T17:01:55.698 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-09-30T17:01:55.697+0000 7f343b52d200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-30T17:01:55.698 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-09-30T17:01:55.698+0000 7f7f3b057200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-30T17:01:55.762 INFO:teuthology.orchestra.run.smithi007.stderr:adjusted tunables profile to default 2023-09-30T17:01:55.774 INFO:tasks.ceph:check_enable_crimson: False 2023-09-30T17:01:55.774 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-09-30T17:01:55.774 DEBUG:teuthology.orchestra.run.smithi031:> set -ex 2023-09-30T17:01:55.774 DEBUG:teuthology.orchestra.run.smithi031:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-09-30T17:01:55.808 DEBUG:teuthology.orchestra.run.smithi072:> set -ex 2023-09-30T17:01:55.808 DEBUG:teuthology.orchestra.run.smithi072:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-09-30T17:01:55.841 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2023-09-30T17:01:55.841 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-09-30T17:01:55.851 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-09-30T17:01:55.851+0000 7f7f3b057200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-30T17:01:55.852 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-09-30T17:01:55.851+0000 7f343b52d200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-30T17:01:55.873 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new a9d1653a-8830-4fad-911b-8e7221ee8697 0 2023-09-30T17:01:56.131 INFO:teuthology.orchestra.run.smithi134.stdout:0 2023-09-30T17:01:56.144 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new 7123aa56-aa1a-43a4-b154-a40b4c70d169 1 2023-09-30T17:01:56.291 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-09-30T17:01:56.291+0000 7f7f3b057200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-30T17:01:56.291 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-09-30T17:01:56.291+0000 7f343b52d200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-30T17:01:56.351 INFO:teuthology.orchestra.run.smithi134.stdout:1 2023-09-30T17:01:56.363 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --cluster ceph osd new f40ee0d7-7bc3-4a46-bdac-9c134c55c907 2 2023-09-30T17:01:56.419 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-09-30T17:01:56.418+0000 7f343b52d200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-30T17:01:56.419 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-09-30T17:01:56.418+0000 7f7f3b057200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-30T17:01:56.512 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-09-30T17:01:56.512+0000 7f343b52d200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-30T17:01:56.513 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-09-30T17:01:56.512+0000 7f7f3b057200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-30T17:01:56.574 INFO:teuthology.orchestra.run.smithi134.stdout:2 2023-09-30T17:01:56.586 INFO:tasks.ceph.osd.0:Restarting daemon 2023-09-30T17:01:56.586 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-09-30T17:01:56.588 INFO:tasks.ceph.osd.0:Started 2023-09-30T17:01:56.589 INFO:tasks.ceph.osd.1:Restarting daemon 2023-09-30T17:01:56.589 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-09-30T17:01:56.591 INFO:tasks.ceph.osd.1:Started 2023-09-30T17:01:56.591 INFO:tasks.ceph.osd.2:Restarting daemon 2023-09-30T17:01:56.591 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-09-30T17:01:56.593 INFO:tasks.ceph.osd.2:Started 2023-09-30T17:01:56.594 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T17:01:56.598 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-09-30T17:01:56.598+0000 7f343b52d200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-30T17:01:56.599 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-09-30T17:01:56.599+0000 7f7f3b057200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-30T17:01:56.807 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:01:56.808 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":5,"fsid":"68daccc3-6ea9-4db7-9771-3803ff202df8","created":"2023-09-30T17:01:55.306262+0000","modified":"2023-09-30T17:01:56.571968+0000","last_up_change":"0.000000","last_in_change":"2023-09-30T17:01:56.571968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a9d1653a-8830-4fad-911b-8e7221ee8697","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7123aa56-aa1a-43a4-b154-a40b4c70d169","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f40ee0d7-7bc3-4a46-bdac-9c134c55c907","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T17:01:56.821 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-09-30T17:01:56.821 INFO:tasks.ceph:Waiting for OSDs to come up 2023-09-30T17:01:57.081 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-09-30T17:01:57.080+0000 7f343b52d200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-30T17:01:57.081 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-09-30T17:01:57.080+0000 7f7f3b057200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-30T17:01:57.124 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-30T17:01:57.186 INFO:tasks.ceph.osd.2.smithi134.stderr:2023-09-30T17:01:57.185+0000 7efd1bf67640 -1 Falling back to public interface 2023-09-30T17:01:57.193 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:01:57.193+0000 7f81d43e6640 -1 Falling back to public interface 2023-09-30T17:01:57.194 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:01:57.194+0000 7fd7302a1640 -1 Falling back to public interface 2023-09-30T17:01:57.346 INFO:teuthology.misc.health.smithi007.stdout: 2023-09-30T17:01:57.346 INFO:teuthology.misc.health.smithi007.stdout:{"epoch":5,"fsid":"68daccc3-6ea9-4db7-9771-3803ff202df8","created":"2023-09-30T17:01:55.306262+0000","modified":"2023-09-30T17:01:56.571968+0000","last_up_change":"0.000000","last_in_change":"2023-09-30T17:01:56.571968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a9d1653a-8830-4fad-911b-8e7221ee8697","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7123aa56-aa1a-43a4-b154-a40b4c70d169","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f40ee0d7-7bc3-4a46-bdac-9c134c55c907","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T17:01:57.357 DEBUG:teuthology.misc:0 of 3 OSDs are up 2023-09-30T17:01:57.772 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-09-30T17:01:57.772+0000 7f7f3b057200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-30T17:01:57.774 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-09-30T17:01:57.774+0000 7f343b52d200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-09-30T17:01:57.845 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-09-30T17:01:57.845+0000 7f7f3b057200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-30T17:01:57.846 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-09-30T17:01:57.846+0000 7f343b52d200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-30T17:01:58.598 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-09-30T17:01:58.597+0000 7f7f3b057200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-30T17:01:58.598 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-09-30T17:01:58.598+0000 7f343b52d200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-30T17:01:58.681 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-09-30T17:01:58.680+0000 7f7f3b057200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-30T17:01:58.681 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-09-30T17:01:58.681+0000 7f343b52d200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-30T17:01:58.832 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-09-30T17:01:58.831+0000 7f343b52d200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-30T17:01:58.832 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-09-30T17:01:58.831+0000 7f7f3b057200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-30T17:01:59.082 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-09-30T17:01:59.082+0000 7f343b52d200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-09-30T17:01:59.083 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-09-30T17:01:59.082+0000 7f7f3b057200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-09-30T17:01:59.312 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-09-30T17:01:59.311+0000 7f7f3b057200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-30T17:01:59.312 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-09-30T17:01:59.312+0000 7f343b52d200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-30T17:01:59.455 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-09-30T17:01:59.454+0000 7f7f3b057200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-30T17:01:59.455 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-09-30T17:01:59.454+0000 7f343b52d200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-30T17:01:59.688 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-09-30T17:01:59.688+0000 7f343b52d200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-30T17:01:59.689 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-09-30T17:01:59.688+0000 7f7f3b057200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-30T17:01:59.854 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-09-30T17:01:59.853+0000 7f343b52d200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-30T17:01:59.854 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-09-30T17:01:59.854+0000 7f7f3b057200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-30T17:01:59.987 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-09-30T17:01:59.987+0000 7f343b52d200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-30T17:01:59.987 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-09-30T17:01:59.987+0000 7f7f3b057200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-09-30T17:02:00.336 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-09-30T17:02:00.335+0000 7f343b52d200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-30T17:02:00.336 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-09-30T17:02:00.335+0000 7f7f3b057200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-30T17:02:00.441 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-09-30T17:02:00.441+0000 7f343b52d200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-30T17:02:00.442 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-09-30T17:02:00.442+0000 7f7f3b057200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-30T17:02:00.640 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-09-30T17:02:00.640+0000 7f7f3b057200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-30T17:02:00.641 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-09-30T17:02:00.640+0000 7f343b52d200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-30T17:02:00.657 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:00.656+0000 7f81d43e6640 -1 osd.1 0 log_to_monitors true 2023-09-30T17:02:00.657 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:00.657+0000 7fd7302a1640 -1 osd.0 0 log_to_monitors true 2023-09-30T17:02:00.668 INFO:tasks.ceph.osd.2.smithi134.stderr:2023-09-30T17:02:00.667+0000 7efd1bf67640 -1 osd.2 0 log_to_monitors true 2023-09-30T17:02:01.279 INFO:tasks.ceph.mgr.y.smithi007.stderr:2023-09-30T17:02:01.278+0000 7f7f3b057200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-30T17:02:01.279 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-09-30T17:02:01.278+0000 7f343b52d200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-30T17:02:02.295 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-09-30T17:02:02.295+0000 7f33f34bd700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-09-30T17:02:02.295 INFO:tasks.ceph.mgr.x.smithi007.stderr:2023-09-30T17:02:02.295+0000 7f33f34bd700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-09-30T17:02:03.208 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:03.207+0000 7f81c7f9d700 -1 osd.1 0 waiting for initial osdmap 2023-09-30T17:02:03.222 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:03.221+0000 7f81c0378700 -1 osd.1 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T17:02:03.274 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:03.273+0000 7fd723e58700 -1 osd.0 0 waiting for initial osdmap 2023-09-30T17:02:03.277 INFO:tasks.ceph.osd.2.smithi134.stderr:2023-09-30T17:02:03.276+0000 7efd11321700 -1 osd.2 0 waiting for initial osdmap 2023-09-30T17:02:03.292 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:03.292+0000 7fd71c233700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T17:02:03.301 INFO:tasks.ceph.osd.2.smithi134.stderr:2023-09-30T17:02:03.300+0000 7efd07ef9700 -1 osd.2 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T17:02:03.662 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-30T17:02:04.001 INFO:teuthology.misc.health.smithi007.stdout: 2023-09-30T17:02:04.001 INFO:teuthology.misc.health.smithi007.stdout:{"epoch":7,"fsid":"68daccc3-6ea9-4db7-9771-3803ff202df8","created":"2023-09-30T17:01:55.306262+0000","modified":"2023-09-30T17:02:02.249444+0000","last_up_change":"0.000000","last_in_change":"2023-09-30T17:01:56.571968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"a9d1653a-8830-4fad-911b-8e7221ee8697","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"7123aa56-aa1a-43a4-b154-a40b4c70d169","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"f40ee0d7-7bc3-4a46-bdac-9c134c55c907","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T17:02:04.014 DEBUG:teuthology.misc:0 of 3 OSDs are up 2023-09-30T17:02:10.319 DEBUG:teuthology.orchestra.run.smithi007:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-30T17:02:10.657 INFO:teuthology.misc.health.smithi007.stdout: 2023-09-30T17:02:10.657 INFO:teuthology.misc.health.smithi007.stdout:{"epoch":12,"fsid":"68daccc3-6ea9-4db7-9771-3803ff202df8","created":"2023-09-30T17:01:55.306262+0000","modified":"2023-09-30T17:02:08.305026+0000","last_up_change":"2023-09-30T17:02:04.210987+0000","last_in_change":"2023-09-30T17:01:56.571968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T17:02:05.343048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9d1653a-8830-4fad-911b-8e7221ee8697","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6801","nonce":2212861041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6803","nonce":2212861041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6807","nonce":2212861041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6805","nonce":2212861041}]},"public_addr":"172.21.15.31:6801/2212861041","cluster_addr":"172.21.15.31:6803/2212861041","heartbeat_back_addr":"172.21.15.31:6807/2212861041","heartbeat_front_addr":"172.21.15.31:6805/2212861041","state":["exists","up"]},{"osd":1,"uuid":"7123aa56-aa1a-43a4-b154-a40b4c70d169","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6801","nonce":1680420094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6803","nonce":1680420094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6807","nonce":1680420094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6805","nonce":1680420094}]},"public_addr":"172.21.15.72:6801/1680420094","cluster_addr":"172.21.15.72:6803/1680420094","heartbeat_back_addr":"172.21.15.72:6807/1680420094","heartbeat_front_addr":"172.21.15.72:6805/1680420094","state":["exists","up"]},{"osd":2,"uuid":"f40ee0d7-7bc3-4a46-bdac-9c134c55c907","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6801","nonce":1018866543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6803","nonce":1018866543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6807","nonce":1018866543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6805","nonce":1018866543}]},"public_addr":"172.21.15.134:6801/1018866543","cluster_addr":"172.21.15.134:6803/1018866543","heartbeat_back_addr":"172.21.15.134:6807/1018866543","heartbeat_front_addr":"172.21.15.134:6805/1018866543","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T17:02:01.702754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T17:02:01.688791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T17:02:01.667971+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T17:02:10.670 DEBUG:teuthology.misc:3 of 3 OSDs are up 2023-09-30T17:02:10.670 INFO:tasks.ceph:Creating RBD pool 2023-09-30T17:02:10.670 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --cluster ceph osd pool create rbd 8 2023-09-30T17:02:11.326 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'rbd' created 2023-09-30T17:02:11.337 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-09-30T17:02:12.328 INFO:teuthology.orchestra.run.smithi007.stderr:enabled application 'rbd' on pool 'rbd' 2023-09-30T17:02:12.342 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-09-30T17:02:12.343 INFO:tasks.ceph.mds.a:Restarting daemon 2023-09-30T17:02:12.343 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-09-30T17:02:12.345 INFO:tasks.ceph.mds.a:Started 2023-09-30T17:02:12.345 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-09-30T17:02:12.345 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T17:02:12.432 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2023-09-30T17:02:12.691 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:02:12.692 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":14,"fsid":"68daccc3-6ea9-4db7-9771-3803ff202df8","created":"2023-09-30T17:01:55.306262+0000","modified":"2023-09-30T17:02:12.321897+0000","last_up_change":"2023-09-30T17:02:04.210987+0000","last_in_change":"2023-09-30T17:01:56.571968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T17:02:05.343048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T17:02:11.033979+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9d1653a-8830-4fad-911b-8e7221ee8697","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6801","nonce":2212861041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6803","nonce":2212861041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6807","nonce":2212861041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6805","nonce":2212861041}]},"public_addr":"172.21.15.31:6801/2212861041","cluster_addr":"172.21.15.31:6803/2212861041","heartbeat_back_addr":"172.21.15.31:6807/2212861041","heartbeat_front_addr":"172.21.15.31:6805/2212861041","state":["exists","up"]},{"osd":1,"uuid":"7123aa56-aa1a-43a4-b154-a40b4c70d169","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6801","nonce":1680420094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6803","nonce":1680420094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6807","nonce":1680420094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6805","nonce":1680420094}]},"public_addr":"172.21.15.72:6801/1680420094","cluster_addr":"172.21.15.72:6803/1680420094","heartbeat_back_addr":"172.21.15.72:6807/1680420094","heartbeat_front_addr":"172.21.15.72:6805/1680420094","state":["exists","up"]},{"osd":2,"uuid":"f40ee0d7-7bc3-4a46-bdac-9c134c55c907","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6801","nonce":1018866543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6803","nonce":1018866543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6807","nonce":1018866543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6805","nonce":1018866543}]},"public_addr":"172.21.15.134:6801/1018866543","cluster_addr":"172.21.15.134:6803/1018866543","heartbeat_back_addr":"172.21.15.134:6807/1018866543","heartbeat_front_addr":"172.21.15.134:6805/1018866543","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T17:02:01.702754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T17:02:01.688791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T17:02:01.667971+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T17:02:12.705 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T17:02:05.343048+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T17:02:11.033979+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T17:02:12.706 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T17:02:13.043 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2023-09-30T17:02:13.057 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T17:02:13.395 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 8 2023-09-30T17:02:13.409 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T17:02:13.790 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:02:13.791 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4208,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.7:6803/3885497469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":3885497469},{"type":"v1","addr":"172.21.15.7:6803","nonce":3885497469}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-09-30T17:02:13.793 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 2 2023-09-30T17:02:13.804 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T17:02:14.141 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:02:14.142 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":15,"fsid":"68daccc3-6ea9-4db7-9771-3803ff202df8","created":"2023-09-30T17:01:55.306262+0000","modified":"2023-09-30T17:02:13.327359+0000","last_up_change":"2023-09-30T17:02:04.210987+0000","last_in_change":"2023-09-30T17:01:56.571968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T17:02:05.343048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T17:02:11.033979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9d1653a-8830-4fad-911b-8e7221ee8697","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6801","nonce":2212861041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6803","nonce":2212861041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6807","nonce":2212861041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6805","nonce":2212861041}]},"public_addr":"172.21.15.31:6801/2212861041","cluster_addr":"172.21.15.31:6803/2212861041","heartbeat_back_addr":"172.21.15.31:6807/2212861041","heartbeat_front_addr":"172.21.15.31:6805/2212861041","state":["exists","up"]},{"osd":1,"uuid":"7123aa56-aa1a-43a4-b154-a40b4c70d169","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6801","nonce":1680420094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6803","nonce":1680420094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6807","nonce":1680420094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6805","nonce":1680420094}]},"public_addr":"172.21.15.72:6801/1680420094","cluster_addr":"172.21.15.72:6803/1680420094","heartbeat_back_addr":"172.21.15.72:6807/1680420094","heartbeat_front_addr":"172.21.15.72:6805/1680420094","state":["exists","up"]},{"osd":2,"uuid":"f40ee0d7-7bc3-4a46-bdac-9c134c55c907","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6801","nonce":1018866543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6803","nonce":1018866543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6807","nonce":1018866543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6805","nonce":1018866543}]},"public_addr":"172.21.15.134:6801/1018866543","cluster_addr":"172.21.15.134:6803/1018866543","heartbeat_back_addr":"172.21.15.134:6807/1018866543","heartbeat_front_addr":"172.21.15.134:6805/1018866543","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T17:02:01.702754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T17:02:01.688791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T17:02:01.667971+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T17:02:14.154 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T17:02:05.343048+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T17:02:11.033979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T17:02:14.154 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T17:02:14.493 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2023-09-30T17:02:14.507 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T17:02:14.843 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 8 2023-09-30T17:02:14.858 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-09-30T17:02:15.197 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:02:15.197 INFO:teuthology.orchestra.run.smithi007.stdout:[ 2023-09-30T17:02:15.197 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:02:15.197 INFO:teuthology.orchestra.run.smithi007.stdout: "poolnum": 1, 2023-09-30T17:02:15.197 INFO:teuthology.orchestra.run.smithi007.stdout: "poolname": ".mgr" 2023-09-30T17:02:15.197 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:15.197 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:02:15.197 INFO:teuthology.orchestra.run.smithi007.stdout: "poolnum": 2, 2023-09-30T17:02:15.197 INFO:teuthology.orchestra.run.smithi007.stdout: "poolname": "rbd" 2023-09-30T17:02:15.197 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-09-30T17:02:15.198 INFO:teuthology.orchestra.run.smithi007.stdout:] 2023-09-30T17:02:15.211 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-09-30T17:02:15.211 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-09-30T17:02:16.345 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' created 2023-09-30T17:02:16.358 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-09-30T17:02:17.350 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' created 2023-09-30T17:02:17.364 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-09-30T17:02:18.354 INFO:teuthology.orchestra.run.smithi007.stderr:new fs with metadata pool 3 and data pool 4 2023-09-30T17:02:18.368 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T17:02:18.710 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:02:18.711 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":18,"fsid":"68daccc3-6ea9-4db7-9771-3803ff202df8","created":"2023-09-30T17:01:55.306262+0000","modified":"2023-09-30T17:02:17.752487+0000","last_up_change":"2023-09-30T17:02:04.210987+0000","last_in_change":"2023-09-30T17:01:56.571968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T17:02:05.343048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T17:02:11.033979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T17:02:15.583451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T17:02:16.734427+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9d1653a-8830-4fad-911b-8e7221ee8697","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6801","nonce":2212861041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6803","nonce":2212861041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6807","nonce":2212861041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6805","nonce":2212861041}]},"public_addr":"172.21.15.31:6801/2212861041","cluster_addr":"172.21.15.31:6803/2212861041","heartbeat_back_addr":"172.21.15.31:6807/2212861041","heartbeat_front_addr":"172.21.15.31:6805/2212861041","state":["exists","up"]},{"osd":1,"uuid":"7123aa56-aa1a-43a4-b154-a40b4c70d169","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6801","nonce":1680420094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6803","nonce":1680420094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6807","nonce":1680420094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6805","nonce":1680420094}]},"public_addr":"172.21.15.72:6801/1680420094","cluster_addr":"172.21.15.72:6803/1680420094","heartbeat_back_addr":"172.21.15.72:6807/1680420094","heartbeat_front_addr":"172.21.15.72:6805/1680420094","state":["exists","up"]},{"osd":2,"uuid":"f40ee0d7-7bc3-4a46-bdac-9c134c55c907","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6801","nonce":1018866543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6803","nonce":1018866543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6807","nonce":1018866543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6805","nonce":1018866543}]},"public_addr":"172.21.15.134:6801/1018866543","cluster_addr":"172.21.15.134:6803/1018866543","heartbeat_back_addr":"172.21.15.134:6807/1018866543","heartbeat_front_addr":"172.21.15.134:6805/1018866543","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T17:02:01.702754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T17:02:01.688791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T17:02:01.667971+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T17:02:18.724 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T17:02:19.060 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:02:19.060 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":18,"fsid":"68daccc3-6ea9-4db7-9771-3803ff202df8","created":"2023-09-30T17:01:55.306262+0000","modified":"2023-09-30T17:02:17.752487+0000","last_up_change":"2023-09-30T17:02:04.210987+0000","last_in_change":"2023-09-30T17:01:56.571968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T17:02:05.343048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T17:02:11.033979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T17:02:15.583451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T17:02:16.734427+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9d1653a-8830-4fad-911b-8e7221ee8697","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6801","nonce":2212861041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6803","nonce":2212861041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6807","nonce":2212861041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6805","nonce":2212861041}]},"public_addr":"172.21.15.31:6801/2212861041","cluster_addr":"172.21.15.31:6803/2212861041","heartbeat_back_addr":"172.21.15.31:6807/2212861041","heartbeat_front_addr":"172.21.15.31:6805/2212861041","state":["exists","up"]},{"osd":1,"uuid":"7123aa56-aa1a-43a4-b154-a40b4c70d169","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6801","nonce":1680420094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6803","nonce":1680420094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6807","nonce":1680420094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6805","nonce":1680420094}]},"public_addr":"172.21.15.72:6801/1680420094","cluster_addr":"172.21.15.72:6803/1680420094","heartbeat_back_addr":"172.21.15.72:6807/1680420094","heartbeat_front_addr":"172.21.15.72:6805/1680420094","state":["exists","up"]},{"osd":2,"uuid":"f40ee0d7-7bc3-4a46-bdac-9c134c55c907","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6801","nonce":1018866543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6803","nonce":1018866543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6807","nonce":1018866543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6805","nonce":1018866543}]},"public_addr":"172.21.15.134:6801/1018866543","cluster_addr":"172.21.15.134:6803/1018866543","heartbeat_back_addr":"172.21.15.134:6807/1018866543","heartbeat_front_addr":"172.21.15.134:6805/1018866543","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T17:02:01.702754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T17:02:01.688791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T17:02:01.667971+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T17:02:19.074 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-09-30T17:02:20.378 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-09-30T17:02:20.378 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-09-30T17:02:21.383 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-09-30T17:02:21.383 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T17:02:21.766 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:02:21.767 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T17:02:17.752800+0000","modified":"2023-09-30T17:02:20.768438+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4208},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4208":{"gid":4208,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6803/3885497469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":3885497469},{"type":"v1","addr":"172.21.15.7:6803","nonce":3885497469}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-30T17:02:21.769 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 6 2023-09-30T17:02:21.781 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T17:02:22.116 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:02:22.116 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":19,"fsid":"68daccc3-6ea9-4db7-9771-3803ff202df8","created":"2023-09-30T17:01:55.306262+0000","modified":"2023-09-30T17:02:19.350385+0000","last_up_change":"2023-09-30T17:02:04.210987+0000","last_in_change":"2023-09-30T17:01:56.571968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T17:02:05.343048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T17:02:11.033979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T17:02:15.583451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T17:02:16.734427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9d1653a-8830-4fad-911b-8e7221ee8697","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6801","nonce":2212861041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6803","nonce":2212861041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6807","nonce":2212861041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6805","nonce":2212861041}]},"public_addr":"172.21.15.31:6801/2212861041","cluster_addr":"172.21.15.31:6803/2212861041","heartbeat_back_addr":"172.21.15.31:6807/2212861041","heartbeat_front_addr":"172.21.15.31:6805/2212861041","state":["exists","up"]},{"osd":1,"uuid":"7123aa56-aa1a-43a4-b154-a40b4c70d169","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6801","nonce":1680420094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6803","nonce":1680420094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6807","nonce":1680420094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6805","nonce":1680420094}]},"public_addr":"172.21.15.72:6801/1680420094","cluster_addr":"172.21.15.72:6803/1680420094","heartbeat_back_addr":"172.21.15.72:6807/1680420094","heartbeat_front_addr":"172.21.15.72:6805/1680420094","state":["exists","up"]},{"osd":2,"uuid":"f40ee0d7-7bc3-4a46-bdac-9c134c55c907","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6801","nonce":1018866543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6803","nonce":1018866543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6807","nonce":1018866543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6805","nonce":1018866543}]},"public_addr":"172.21.15.134:6801/1018866543","cluster_addr":"172.21.15.134:6803/1018866543","heartbeat_back_addr":"172.21.15.134:6807/1018866543","heartbeat_front_addr":"172.21.15.134:6805/1018866543","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T17:02:01.702754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T17:02:01.688791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T17:02:01.667971+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T17:02:22.130 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-09-30T17:02:22.130 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T17:02:22.453 INFO:tasks.ceph.mds.a.smithi007.stderr:2023-09-30T17:02:22.452+0000 7f2451754700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-30T17:02:22.479 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:02:22.482 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-09-30T17:02:22.488 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-09-30T17:02:21.289499+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":247,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":107,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":86900,"kb_used_data":1680,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":283028620,"statfs":{"total":289910292480,"available":289821306880,"internally_reserved":0,"allocated":1720320,"data_stored":1344838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4781,"internal_metadata":87223635},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.950167"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.364946+0000","last_change":"2023-09-30T17:02:18.360288+0000","last_active":"2023-09-30T17:02:18.364946+0000","last_peered":"2023-09-30T17:02:18.364946+0000","last_clean":"2023-09-30T17:02:18.364946+0000","last_became_active":"2023-09-30T17:02:18.358716+0000","last_became_peered":"2023-09-30T17:02:18.358716+0000","last_unstale":"2023-09-30T17:02:18.364946+0000","last_undegraded":"2023-09-30T17:02:18.364946+0000","last_fullsized":"2023-09-30T17:02:18.364946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:19:21.003353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.365312+0000","last_change":"2023-09-30T17:02:18.362418+0000","last_active":"2023-09-30T17:02:18.365312+0000","last_peered":"2023-09-30T17:02:18.365312+0000","last_clean":"2023-09-30T17:02:18.365312+0000","last_became_active":"2023-09-30T17:02:18.360372+0000","last_became_peered":"2023-09-30T17:02:18.360372+0000","last_unstale":"2023-09-30T17:02:18.365312+0000","last_undegraded":"2023-09-30T17:02:18.365312+0000","last_fullsized":"2023-09-30T17:02:18.365312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:40:32.925542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.377264+0000","last_change":"2023-09-30T17:02:18.373609+0000","last_active":"2023-09-30T17:02:18.377264+0000","last_peered":"2023-09-30T17:02:18.377264+0000","last_clean":"2023-09-30T17:02:18.377264+0000","last_became_active":"2023-09-30T17:02:18.372911+0000","last_became_peered":"2023-09-30T17:02:18.372911+0000","last_unstale":"2023-09-30T17:02:18.377264+0000","last_undegraded":"2023-09-30T17:02:18.377264+0000","last_fullsized":"2023-09-30T17:02:18.377264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:13:30.688369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.379081+0000","last_change":"2023-09-30T17:02:18.377247+0000","last_active":"2023-09-30T17:02:18.379081+0000","last_peered":"2023-09-30T17:02:18.379081+0000","last_clean":"2023-09-30T17:02:18.379081+0000","last_became_active":"2023-09-30T17:02:18.376351+0000","last_became_peered":"2023-09-30T17:02:18.376351+0000","last_unstale":"2023-09-30T17:02:18.379081+0000","last_undegraded":"2023-09-30T17:02:18.379081+0000","last_fullsized":"2023-09-30T17:02:18.379081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:10:00.160011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.365060+0000","last_change":"2023-09-30T17:02:18.360192+0000","last_active":"2023-09-30T17:02:18.365060+0000","last_peered":"2023-09-30T17:02:18.365060+0000","last_clean":"2023-09-30T17:02:18.365060+0000","last_became_active":"2023-09-30T17:02:18.357317+0000","last_became_peered":"2023-09-30T17:02:18.357317+0000","last_unstale":"2023-09-30T17:02:18.365060+0000","last_undegraded":"2023-09-30T17:02:18.365060+0000","last_fullsized":"2023-09-30T17:02:18.365060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:00:17.835972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.377949+0000","last_change":"2023-09-30T17:02:18.376076+0000","last_active":"2023-09-30T17:02:18.377949+0000","last_peered":"2023-09-30T17:02:18.377949+0000","last_clean":"2023-09-30T17:02:18.377949+0000","last_became_active":"2023-09-30T17:02:18.375107+0000","last_became_peered":"2023-09-30T17:02:18.375107+0000","last_unstale":"2023-09-30T17:02:18.377949+0000","last_undegraded":"2023-09-30T17:02:18.377949+0000","last_fullsized":"2023-09-30T17:02:18.377949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:47:00.094303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.363171+0000","last_change":"2023-09-30T17:02:18.360819+0000","last_active":"2023-09-30T17:02:18.363171+0000","last_peered":"2023-09-30T17:02:18.363171+0000","last_clean":"2023-09-30T17:02:18.363171+0000","last_became_active":"2023-09-30T17:02:18.360506+0000","last_became_peered":"2023-09-30T17:02:18.360506+0000","last_unstale":"2023-09-30T17:02:18.363171+0000","last_undegraded":"2023-09-30T17:02:18.363171+0000","last_fullsized":"2023-09-30T17:02:18.363171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:38:58.103941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.373918+0000","last_change":"2023-09-30T17:02:18.362003+0000","last_active":"2023-09-30T17:02:18.373918+0000","last_peered":"2023-09-30T17:02:18.373918+0000","last_clean":"2023-09-30T17:02:18.373918+0000","last_became_active":"2023-09-30T17:02:18.361644+0000","last_became_peered":"2023-09-30T17:02:18.361644+0000","last_unstale":"2023-09-30T17:02:18.373918+0000","last_undegraded":"2023-09-30T17:02:18.373918+0000","last_fullsized":"2023-09-30T17:02:18.373918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:19:21.003353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.368917+0000","last_change":"2023-09-30T17:02:18.364222+0000","last_active":"2023-09-30T17:02:18.368917+0000","last_peered":"2023-09-30T17:02:18.368917+0000","last_clean":"2023-09-30T17:02:18.368917+0000","last_became_active":"2023-09-30T17:02:18.363485+0000","last_became_peered":"2023-09-30T17:02:18.363485+0000","last_unstale":"2023-09-30T17:02:18.368917+0000","last_undegraded":"2023-09-30T17:02:18.368917+0000","last_fullsized":"2023-09-30T17:02:18.368917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:54:54.054186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.364459+0000","last_change":"2023-09-30T17:02:18.360010+0000","last_active":"2023-09-30T17:02:18.364459+0000","last_peered":"2023-09-30T17:02:18.364459+0000","last_clean":"2023-09-30T17:02:18.364459+0000","last_became_active":"2023-09-30T17:02:18.358396+0000","last_became_peered":"2023-09-30T17:02:18.358396+0000","last_unstale":"2023-09-30T17:02:18.364459+0000","last_undegraded":"2023-09-30T17:02:18.364459+0000","last_fullsized":"2023-09-30T17:02:18.364459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:46:17.380869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.377704+0000","last_change":"2023-09-30T17:02:18.375829+0000","last_active":"2023-09-30T17:02:18.377704+0000","last_peered":"2023-09-30T17:02:18.377704+0000","last_clean":"2023-09-30T17:02:18.377704+0000","last_became_active":"2023-09-30T17:02:18.374447+0000","last_became_peered":"2023-09-30T17:02:18.374447+0000","last_unstale":"2023-09-30T17:02:18.377704+0000","last_undegraded":"2023-09-30T17:02:18.377704+0000","last_fullsized":"2023-09-30T17:02:18.377704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:24:05.570017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.374959+0000","last_change":"2023-09-30T17:02:18.373777+0000","last_active":"2023-09-30T17:02:18.374959+0000","last_peered":"2023-09-30T17:02:18.374959+0000","last_clean":"2023-09-30T17:02:18.374959+0000","last_became_active":"2023-09-30T17:02:18.373434+0000","last_became_peered":"2023-09-30T17:02:18.373434+0000","last_unstale":"2023-09-30T17:02:18.374959+0000","last_undegraded":"2023-09-30T17:02:18.374959+0000","last_fullsized":"2023-09-30T17:02:18.374959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:31:21.329390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.364367+0000","last_change":"2023-09-30T17:02:18.359894+0000","last_active":"2023-09-30T17:02:18.364367+0000","last_peered":"2023-09-30T17:02:18.364367+0000","last_clean":"2023-09-30T17:02:18.364367+0000","last_became_active":"2023-09-30T17:02:18.358534+0000","last_became_peered":"2023-09-30T17:02:18.358534+0000","last_unstale":"2023-09-30T17:02:18.364367+0000","last_undegraded":"2023-09-30T17:02:18.364367+0000","last_fullsized":"2023-09-30T17:02:18.364367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:13:42.210782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.377612+0000","last_change":"2023-09-30T17:02:18.374094+0000","last_active":"2023-09-30T17:02:18.377612+0000","last_peered":"2023-09-30T17:02:18.377612+0000","last_clean":"2023-09-30T17:02:18.377612+0000","last_became_active":"2023-09-30T17:02:18.373165+0000","last_became_peered":"2023-09-30T17:02:18.373165+0000","last_unstale":"2023-09-30T17:02:18.377612+0000","last_undegraded":"2023-09-30T17:02:18.377612+0000","last_fullsized":"2023-09-30T17:02:18.377612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:50:19.460817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.373884+0000","last_change":"2023-09-30T17:02:18.372075+0000","last_active":"2023-09-30T17:02:18.373884+0000","last_peered":"2023-09-30T17:02:18.373884+0000","last_clean":"2023-09-30T17:02:18.373884+0000","last_became_active":"2023-09-30T17:02:18.371685+0000","last_became_peered":"2023-09-30T17:02:18.371685+0000","last_unstale":"2023-09-30T17:02:18.373884+0000","last_undegraded":"2023-09-30T17:02:18.373884+0000","last_fullsized":"2023-09-30T17:02:18.373884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:02:28.672156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.377919+0000","last_change":"2023-09-30T17:02:18.376370+0000","last_active":"2023-09-30T17:02:18.377919+0000","last_peered":"2023-09-30T17:02:18.377919+0000","last_clean":"2023-09-30T17:02:18.377919+0000","last_became_active":"2023-09-30T17:02:18.375027+0000","last_became_peered":"2023-09-30T17:02:18.375027+0000","last_unstale":"2023-09-30T17:02:18.377919+0000","last_undegraded":"2023-09-30T17:02:18.377919+0000","last_fullsized":"2023-09-30T17:02:18.377919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:22:13.025181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.368935+0000","last_change":"2023-09-30T17:02:18.364360+0000","last_active":"2023-09-30T17:02:18.368935+0000","last_peered":"2023-09-30T17:02:18.368935+0000","last_clean":"2023-09-30T17:02:18.368935+0000","last_became_active":"2023-09-30T17:02:18.363697+0000","last_became_peered":"2023-09-30T17:02:18.363697+0000","last_unstale":"2023-09-30T17:02:18.368935+0000","last_undegraded":"2023-09-30T17:02:18.368935+0000","last_fullsized":"2023-09-30T17:02:18.368935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:51:14.531522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.364901+0000","last_change":"2023-09-30T17:02:18.360320+0000","last_active":"2023-09-30T17:02:18.364901+0000","last_peered":"2023-09-30T17:02:18.364901+0000","last_clean":"2023-09-30T17:02:18.364901+0000","last_became_active":"2023-09-30T17:02:18.357184+0000","last_became_peered":"2023-09-30T17:02:18.357184+0000","last_unstale":"2023-09-30T17:02:18.364901+0000","last_undegraded":"2023-09-30T17:02:18.364901+0000","last_fullsized":"2023-09-30T17:02:18.364901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:48:20.064093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.368892+0000","last_change":"2023-09-30T17:02:18.363956+0000","last_active":"2023-09-30T17:02:18.368892+0000","last_peered":"2023-09-30T17:02:18.368892+0000","last_clean":"2023-09-30T17:02:18.368892+0000","last_became_active":"2023-09-30T17:02:18.363654+0000","last_became_peered":"2023-09-30T17:02:18.363654+0000","last_unstale":"2023-09-30T17:02:18.368892+0000","last_undegraded":"2023-09-30T17:02:18.368892+0000","last_fullsized":"2023-09-30T17:02:18.368892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:31:21.329390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.379060+0000","last_change":"2023-09-30T17:02:18.377065+0000","last_active":"2023-09-30T17:02:18.379060+0000","last_peered":"2023-09-30T17:02:18.379060+0000","last_clean":"2023-09-30T17:02:18.379060+0000","last_became_active":"2023-09-30T17:02:18.375158+0000","last_became_peered":"2023-09-30T17:02:18.375158+0000","last_unstale":"2023-09-30T17:02:18.379060+0000","last_undegraded":"2023-09-30T17:02:18.379060+0000","last_fullsized":"2023-09-30T17:02:18.379060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:40:32.925542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.377903+0000","last_change":"2023-09-30T17:02:18.376206+0000","last_active":"2023-09-30T17:02:18.377903+0000","last_peered":"2023-09-30T17:02:18.377903+0000","last_clean":"2023-09-30T17:02:18.377903+0000","last_became_active":"2023-09-30T17:02:18.374694+0000","last_became_peered":"2023-09-30T17:02:18.374694+0000","last_unstale":"2023-09-30T17:02:18.377903+0000","last_undegraded":"2023-09-30T17:02:18.377903+0000","last_fullsized":"2023-09-30T17:02:18.377903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:30:43.782165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.365541+0000","last_change":"2023-09-30T17:02:18.362977+0000","last_active":"2023-09-30T17:02:18.365541+0000","last_peered":"2023-09-30T17:02:18.365541+0000","last_clean":"2023-09-30T17:02:18.365541+0000","last_became_active":"2023-09-30T17:02:18.362657+0000","last_became_peered":"2023-09-30T17:02:18.362657+0000","last_unstale":"2023-09-30T17:02:18.365541+0000","last_undegraded":"2023-09-30T17:02:18.365541+0000","last_fullsized":"2023-09-30T17:02:18.365541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:54:54.054186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.368488+0000","last_change":"2023-09-30T17:02:18.361158+0000","last_active":"2023-09-30T17:02:18.368488+0000","last_peered":"2023-09-30T17:02:18.368488+0000","last_clean":"2023-09-30T17:02:18.368488+0000","last_became_active":"2023-09-30T17:02:18.360840+0000","last_became_peered":"2023-09-30T17:02:18.360840+0000","last_unstale":"2023-09-30T17:02:18.368488+0000","last_undegraded":"2023-09-30T17:02:18.368488+0000","last_fullsized":"2023-09-30T17:02:18.368488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:04:23.754186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.358631+0000","last_change":"2023-09-30T17:02:18.353938+0000","last_active":"2023-09-30T17:02:18.358631+0000","last_peered":"2023-09-30T17:02:18.358631+0000","last_clean":"2023-09-30T17:02:18.358631+0000","last_became_active":"2023-09-30T17:02:18.353632+0000","last_became_peered":"2023-09-30T17:02:18.353632+0000","last_unstale":"2023-09-30T17:02:18.358631+0000","last_undegraded":"2023-09-30T17:02:18.358631+0000","last_fullsized":"2023-09-30T17:02:18.358631+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:36:58.193735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.364821+0000","last_change":"2023-09-30T17:02:18.360801+0000","last_active":"2023-09-30T17:02:18.364821+0000","last_peered":"2023-09-30T17:02:18.364821+0000","last_clean":"2023-09-30T17:02:18.364821+0000","last_became_active":"2023-09-30T17:02:18.358862+0000","last_became_peered":"2023-09-30T17:02:18.358862+0000","last_unstale":"2023-09-30T17:02:18.364821+0000","last_undegraded":"2023-09-30T17:02:18.364821+0000","last_fullsized":"2023-09-30T17:02:18.364821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:04:23.754186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.357205+0000","last_change":"2023-09-30T17:02:18.355710+0000","last_active":"2023-09-30T17:02:18.357205+0000","last_peered":"2023-09-30T17:02:18.357205+0000","last_clean":"2023-09-30T17:02:18.357205+0000","last_became_active":"2023-09-30T17:02:18.355423+0000","last_became_peered":"2023-09-30T17:02:18.355423+0000","last_unstale":"2023-09-30T17:02:18.357205+0000","last_undegraded":"2023-09-30T17:02:18.357205+0000","last_fullsized":"2023-09-30T17:02:18.357205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:11:47.254069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.379083+0000","last_change":"2023-09-30T17:02:18.377164+0000","last_active":"2023-09-30T17:02:18.379083+0000","last_peered":"2023-09-30T17:02:18.379083+0000","last_clean":"2023-09-30T17:02:18.379083+0000","last_became_active":"2023-09-30T17:02:18.376425+0000","last_became_peered":"2023-09-30T17:02:18.376425+0000","last_unstale":"2023-09-30T17:02:18.379083+0000","last_undegraded":"2023-09-30T17:02:18.379083+0000","last_fullsized":"2023-09-30T17:02:18.379083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:30:35.150981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.365856+0000","last_change":"2023-09-30T17:02:17.358258+0000","last_active":"2023-09-30T17:02:18.365856+0000","last_peered":"2023-09-30T17:02:18.365856+0000","last_clean":"2023-09-30T17:02:18.365856+0000","last_became_active":"2023-09-30T17:02:17.357890+0000","last_became_peered":"2023-09-30T17:02:17.357890+0000","last_unstale":"2023-09-30T17:02:18.365856+0000","last_undegraded":"2023-09-30T17:02:18.365856+0000","last_fullsized":"2023-09-30T17:02:18.365856+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:52:56.591906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.363992+0000","last_change":"2023-09-30T17:02:18.358843+0000","last_active":"2023-09-30T17:02:18.363992+0000","last_peered":"2023-09-30T17:02:18.363992+0000","last_clean":"2023-09-30T17:02:18.363992+0000","last_became_active":"2023-09-30T17:02:18.357966+0000","last_became_peered":"2023-09-30T17:02:18.357966+0000","last_unstale":"2023-09-30T17:02:18.363992+0000","last_undegraded":"2023-09-30T17:02:18.363992+0000","last_fullsized":"2023-09-30T17:02:18.363992+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:58:41.706963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.349133+0000","last_change":"2023-09-30T17:02:17.363387+0000","last_active":"2023-09-30T17:02:18.349133+0000","last_peered":"2023-09-30T17:02:18.349133+0000","last_clean":"2023-09-30T17:02:18.349133+0000","last_became_active":"2023-09-30T17:02:17.363042+0000","last_became_peered":"2023-09-30T17:02:17.363042+0000","last_unstale":"2023-09-30T17:02:18.349133+0000","last_undegraded":"2023-09-30T17:02:18.349133+0000","last_fullsized":"2023-09-30T17:02:18.349133+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:38:57.098312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.356869+0000","last_change":"2023-09-30T17:02:18.355398+0000","last_active":"2023-09-30T17:02:18.356869+0000","last_peered":"2023-09-30T17:02:18.356869+0000","last_clean":"2023-09-30T17:02:18.356869+0000","last_became_active":"2023-09-30T17:02:18.355006+0000","last_became_peered":"2023-09-30T17:02:18.355006+0000","last_unstale":"2023-09-30T17:02:18.356869+0000","last_undegraded":"2023-09-30T17:02:18.356869+0000","last_fullsized":"2023-09-30T17:02:18.356869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:40:32.925542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.348752+0000","last_change":"2023-09-30T17:02:17.361000+0000","last_active":"2023-09-30T17:02:18.348752+0000","last_peered":"2023-09-30T17:02:18.348752+0000","last_clean":"2023-09-30T17:02:18.348752+0000","last_became_active":"2023-09-30T17:02:17.360601+0000","last_became_peered":"2023-09-30T17:02:17.360601+0000","last_unstale":"2023-09-30T17:02:18.348752+0000","last_undegraded":"2023-09-30T17:02:18.348752+0000","last_fullsized":"2023-09-30T17:02:18.348752+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:02:27.666526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.365811+0000","last_change":"2023-09-30T17:02:18.363570+0000","last_active":"2023-09-30T17:02:18.365811+0000","last_peered":"2023-09-30T17:02:18.365811+0000","last_clean":"2023-09-30T17:02:18.365811+0000","last_became_active":"2023-09-30T17:02:18.362961+0000","last_became_peered":"2023-09-30T17:02:18.362961+0000","last_unstale":"2023-09-30T17:02:18.365811+0000","last_undegraded":"2023-09-30T17:02:18.365811+0000","last_fullsized":"2023-09-30T17:02:18.365811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:11:47.254069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.350540+0000","last_change":"2023-09-30T17:02:17.364672+0000","last_active":"2023-09-30T17:02:18.350540+0000","last_peered":"2023-09-30T17:02:18.350540+0000","last_clean":"2023-09-30T17:02:18.350540+0000","last_became_active":"2023-09-30T17:02:17.364279+0000","last_became_peered":"2023-09-30T17:02:17.364279+0000","last_unstale":"2023-09-30T17:02:18.350540+0000","last_undegraded":"2023-09-30T17:02:18.350540+0000","last_fullsized":"2023-09-30T17:02:18.350540+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:00:56.363835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.364880+0000","last_change":"2023-09-30T17:02:18.358841+0000","last_active":"2023-09-30T17:02:18.364880+0000","last_peered":"2023-09-30T17:02:18.364880+0000","last_clean":"2023-09-30T17:02:18.364880+0000","last_became_active":"2023-09-30T17:02:18.358529+0000","last_became_peered":"2023-09-30T17:02:18.358529+0000","last_unstale":"2023-09-30T17:02:18.364880+0000","last_undegraded":"2023-09-30T17:02:18.364880+0000","last_fullsized":"2023-09-30T17:02:18.364880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:58:41.706963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.356947+0000","last_change":"2023-09-30T17:02:17.357998+0000","last_active":"2023-09-30T17:02:18.356947+0000","last_peered":"2023-09-30T17:02:18.356947+0000","last_clean":"2023-09-30T17:02:18.356947+0000","last_became_active":"2023-09-30T17:02:17.357653+0000","last_became_peered":"2023-09-30T17:02:17.357653+0000","last_unstale":"2023-09-30T17:02:18.356947+0000","last_undegraded":"2023-09-30T17:02:18.356947+0000","last_fullsized":"2023-09-30T17:02:18.356947+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:52:37.518693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.368463+0000","last_change":"2023-09-30T17:02:18.361155+0000","last_active":"2023-09-30T17:02:18.368463+0000","last_peered":"2023-09-30T17:02:18.368463+0000","last_clean":"2023-09-30T17:02:18.368463+0000","last_became_active":"2023-09-30T17:02:18.360825+0000","last_became_peered":"2023-09-30T17:02:18.360825+0000","last_unstale":"2023-09-30T17:02:18.368463+0000","last_undegraded":"2023-09-30T17:02:18.368463+0000","last_fullsized":"2023-09-30T17:02:18.368463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:04:49.300418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.377101+0000","last_change":"2023-09-30T17:02:17.363119+0000","last_active":"2023-09-30T17:02:18.377101+0000","last_peered":"2023-09-30T17:02:18.377101+0000","last_clean":"2023-09-30T17:02:18.377101+0000","last_became_active":"2023-09-30T17:02:17.362754+0000","last_became_peered":"2023-09-30T17:02:17.362754+0000","last_unstale":"2023-09-30T17:02:18.377101+0000","last_undegraded":"2023-09-30T17:02:18.377101+0000","last_fullsized":"2023-09-30T17:02:18.377101+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:00:56.363835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.364930+0000","last_change":"2023-09-30T17:02:18.359118+0000","last_active":"2023-09-30T17:02:18.364930+0000","last_peered":"2023-09-30T17:02:18.364930+0000","last_clean":"2023-09-30T17:02:18.364930+0000","last_became_active":"2023-09-30T17:02:18.358786+0000","last_became_peered":"2023-09-30T17:02:18.358786+0000","last_unstale":"2023-09-30T17:02:18.364930+0000","last_undegraded":"2023-09-30T17:02:18.364930+0000","last_fullsized":"2023-09-30T17:02:18.364930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:01:30.269635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.382246+0000","last_change":"2023-09-30T17:02:17.355936+0000","last_active":"2023-09-30T17:02:18.382246+0000","last_peered":"2023-09-30T17:02:18.382246+0000","last_clean":"2023-09-30T17:02:18.382246+0000","last_became_active":"2023-09-30T17:02:17.355664+0000","last_became_peered":"2023-09-30T17:02:17.355664+0000","last_unstale":"2023-09-30T17:02:18.382246+0000","last_undegraded":"2023-09-30T17:02:18.382246+0000","last_fullsized":"2023-09-30T17:02:18.382246+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:11:46.248439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.377059+0000","last_change":"2023-09-30T17:02:18.373330+0000","last_active":"2023-09-30T17:02:18.377059+0000","last_peered":"2023-09-30T17:02:18.377059+0000","last_clean":"2023-09-30T17:02:18.377059+0000","last_became_active":"2023-09-30T17:02:18.373004+0000","last_became_peered":"2023-09-30T17:02:18.373004+0000","last_unstale":"2023-09-30T17:02:18.377059+0000","last_undegraded":"2023-09-30T17:02:18.377059+0000","last_fullsized":"2023-09-30T17:02:18.377059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:15:54.364571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.375201+0000","last_change":"2023-09-30T17:02:17.359251+0000","last_active":"2023-09-30T17:02:18.375201+0000","last_peered":"2023-09-30T17:02:18.375201+0000","last_clean":"2023-09-30T17:02:18.375201+0000","last_became_active":"2023-09-30T17:02:17.358579+0000","last_became_peered":"2023-09-30T17:02:17.358579+0000","last_unstale":"2023-09-30T17:02:18.375201+0000","last_undegraded":"2023-09-30T17:02:18.375201+0000","last_fullsized":"2023-09-30T17:02:18.375201+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:55:33.944875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.365074+0000","last_change":"2023-09-30T17:02:18.360019+0000","last_active":"2023-09-30T17:02:18.365074+0000","last_peered":"2023-09-30T17:02:18.365074+0000","last_clean":"2023-09-30T17:02:18.365074+0000","last_became_active":"2023-09-30T17:02:18.358364+0000","last_became_peered":"2023-09-30T17:02:18.358364+0000","last_unstale":"2023-09-30T17:02:18.365074+0000","last_undegraded":"2023-09-30T17:02:18.365074+0000","last_fullsized":"2023-09-30T17:02:18.365074+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:38:58.103941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.348535+0000","last_change":"2023-09-30T17:02:17.363694+0000","last_active":"2023-09-30T17:02:18.348535+0000","last_peered":"2023-09-30T17:02:18.348535+0000","last_clean":"2023-09-30T17:02:18.348535+0000","last_became_active":"2023-09-30T17:02:17.363442+0000","last_became_peered":"2023-09-30T17:02:17.363442+0000","last_unstale":"2023-09-30T17:02:18.348535+0000","last_undegraded":"2023-09-30T17:02:18.348535+0000","last_fullsized":"2023-09-30T17:02:18.348535+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:19:19.997724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.365278+0000","last_change":"2023-09-30T17:02:18.362415+0000","last_active":"2023-09-30T17:02:18.365278+0000","last_peered":"2023-09-30T17:02:18.365278+0000","last_clean":"2023-09-30T17:02:18.365278+0000","last_became_active":"2023-09-30T17:02:18.361556+0000","last_became_peered":"2023-09-30T17:02:18.361556+0000","last_unstale":"2023-09-30T17:02:18.365278+0000","last_undegraded":"2023-09-30T17:02:18.365278+0000","last_fullsized":"2023-09-30T17:02:18.365278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:04:49.300418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.354434+0000","last_change":"2023-09-30T17:02:17.363369+0000","last_active":"2023-09-30T17:02:18.354434+0000","last_peered":"2023-09-30T17:02:18.354434+0000","last_clean":"2023-09-30T17:02:18.354434+0000","last_became_active":"2023-09-30T17:02:17.362925+0000","last_became_peered":"2023-09-30T17:02:17.362925+0000","last_unstale":"2023-09-30T17:02:18.354434+0000","last_undegraded":"2023-09-30T17:02:18.354434+0000","last_fullsized":"2023-09-30T17:02:18.354434+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:50:18.455188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.357719+0000","last_change":"2023-09-30T17:02:18.356700+0000","last_active":"2023-09-30T17:02:18.357719+0000","last_peered":"2023-09-30T17:02:18.357719+0000","last_clean":"2023-09-30T17:02:18.357719+0000","last_became_active":"2023-09-30T17:02:18.356108+0000","last_became_peered":"2023-09-30T17:02:18.356108+0000","last_unstale":"2023-09-30T17:02:18.357719+0000","last_undegraded":"2023-09-30T17:02:18.357719+0000","last_fullsized":"2023-09-30T17:02:18.357719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:10:00.160011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.380902+0000","last_change":"2023-09-30T17:02:17.355214+0000","last_active":"2023-09-30T17:02:18.380902+0000","last_peered":"2023-09-30T17:02:18.380902+0000","last_clean":"2023-09-30T17:02:18.380902+0000","last_became_active":"2023-09-30T17:02:17.354876+0000","last_became_peered":"2023-09-30T17:02:17.354876+0000","last_unstale":"2023-09-30T17:02:18.380902+0000","last_undegraded":"2023-09-30T17:02:18.380902+0000","last_fullsized":"2023-09-30T17:02:18.380902+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:13:41.205152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.357735+0000","last_change":"2023-09-30T17:02:18.356814+0000","last_active":"2023-09-30T17:02:18.357735+0000","last_peered":"2023-09-30T17:02:18.357735+0000","last_clean":"2023-09-30T17:02:18.357735+0000","last_became_active":"2023-09-30T17:02:18.356258+0000","last_became_peered":"2023-09-30T17:02:18.356258+0000","last_unstale":"2023-09-30T17:02:18.357735+0000","last_undegraded":"2023-09-30T17:02:18.357735+0000","last_fullsized":"2023-09-30T17:02:18.357735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:55:34.950505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.375937+0000","last_change":"2023-09-30T17:02:17.355972+0000","last_active":"2023-09-30T17:02:18.375937+0000","last_peered":"2023-09-30T17:02:18.375937+0000","last_clean":"2023-09-30T17:02:18.375937+0000","last_became_active":"2023-09-30T17:02:17.355653+0000","last_became_peered":"2023-09-30T17:02:17.355653+0000","last_unstale":"2023-09-30T17:02:18.375937+0000","last_undegraded":"2023-09-30T17:02:18.375937+0000","last_fullsized":"2023-09-30T17:02:18.375937+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:27:37.446407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.360909+0000","last_change":"2023-09-30T17:02:18.355736+0000","last_active":"2023-09-30T17:02:18.360909+0000","last_peered":"2023-09-30T17:02:18.360909+0000","last_clean":"2023-09-30T17:02:18.360909+0000","last_became_active":"2023-09-30T17:02:18.355111+0000","last_became_peered":"2023-09-30T17:02:18.355111+0000","last_unstale":"2023-09-30T17:02:18.360909+0000","last_undegraded":"2023-09-30T17:02:18.360909+0000","last_fullsized":"2023-09-30T17:02:18.360909+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:48:09.575566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.376387+0000","last_change":"2023-09-30T17:02:17.363514+0000","last_active":"2023-09-30T17:02:18.376387+0000","last_peered":"2023-09-30T17:02:18.376387+0000","last_clean":"2023-09-30T17:02:18.376387+0000","last_became_active":"2023-09-30T17:02:17.363124+0000","last_became_peered":"2023-09-30T17:02:17.363124+0000","last_unstale":"2023-09-30T17:02:18.376387+0000","last_undegraded":"2023-09-30T17:02:18.376387+0000","last_fullsized":"2023-09-30T17:02:18.376387+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:55:33.944875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.363105+0000","last_change":"2023-09-30T17:02:18.359767+0000","last_active":"2023-09-30T17:02:18.363105+0000","last_peered":"2023-09-30T17:02:18.363105+0000","last_clean":"2023-09-30T17:02:18.363105+0000","last_became_active":"2023-09-30T17:02:18.356825+0000","last_became_peered":"2023-09-30T17:02:18.356825+0000","last_unstale":"2023-09-30T17:02:18.363105+0000","last_undegraded":"2023-09-30T17:02:18.363105+0000","last_fullsized":"2023-09-30T17:02:18.363105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:47:52.129748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.377855+0000","last_change":"2023-09-30T17:02:17.355878+0000","last_active":"2023-09-30T17:02:18.377855+0000","last_peered":"2023-09-30T17:02:18.377855+0000","last_clean":"2023-09-30T17:02:18.377855+0000","last_became_active":"2023-09-30T17:02:17.355642+0000","last_became_peered":"2023-09-30T17:02:17.355642+0000","last_unstale":"2023-09-30T17:02:18.377855+0000","last_undegraded":"2023-09-30T17:02:18.377855+0000","last_fullsized":"2023-09-30T17:02:18.377855+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:04:48.294789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.377704+0000","last_change":"2023-09-30T17:02:18.375303+0000","last_active":"2023-09-30T17:02:18.377704+0000","last_peered":"2023-09-30T17:02:18.377704+0000","last_clean":"2023-09-30T17:02:18.377704+0000","last_became_active":"2023-09-30T17:02:18.373962+0000","last_became_peered":"2023-09-30T17:02:18.373962+0000","last_unstale":"2023-09-30T17:02:18.377704+0000","last_undegraded":"2023-09-30T17:02:18.377704+0000","last_fullsized":"2023-09-30T17:02:18.377704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:31:21.329390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.355123+0000","last_change":"2023-09-30T17:02:17.358126+0000","last_active":"2023-09-30T17:02:18.355123+0000","last_peered":"2023-09-30T17:02:18.355123+0000","last_clean":"2023-09-30T17:02:18.355123+0000","last_became_active":"2023-09-30T17:02:17.357621+0000","last_became_peered":"2023-09-30T17:02:17.357621+0000","last_unstale":"2023-09-30T17:02:18.355123+0000","last_undegraded":"2023-09-30T17:02:18.355123+0000","last_fullsized":"2023-09-30T17:02:18.355123+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:46:16.375239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.368727+0000","last_change":"2023-09-30T17:02:18.362399+0000","last_active":"2023-09-30T17:02:18.368727+0000","last_peered":"2023-09-30T17:02:18.368727+0000","last_clean":"2023-09-30T17:02:18.368727+0000","last_became_active":"2023-09-30T17:02:18.362173+0000","last_became_peered":"2023-09-30T17:02:18.362173+0000","last_unstale":"2023-09-30T17:02:18.368727+0000","last_undegraded":"2023-09-30T17:02:18.368727+0000","last_fullsized":"2023-09-30T17:02:18.368727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:46:17.380869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.373243+0000","last_change":"2023-09-30T17:02:17.363567+0000","last_active":"2023-09-30T17:02:18.373243+0000","last_peered":"2023-09-30T17:02:18.373243+0000","last_clean":"2023-09-30T17:02:18.373243+0000","last_became_active":"2023-09-30T17:02:17.363254+0000","last_became_peered":"2023-09-30T17:02:17.363254+0000","last_unstale":"2023-09-30T17:02:18.373243+0000","last_undegraded":"2023-09-30T17:02:18.373243+0000","last_fullsized":"2023-09-30T17:02:18.373243+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:08:34.994215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.376912+0000","last_change":"2023-09-30T17:02:18.372346+0000","last_active":"2023-09-30T17:02:18.376912+0000","last_peered":"2023-09-30T17:02:18.376912+0000","last_clean":"2023-09-30T17:02:18.376912+0000","last_became_active":"2023-09-30T17:02:18.371542+0000","last_became_peered":"2023-09-30T17:02:18.371542+0000","last_unstale":"2023-09-30T17:02:18.376912+0000","last_undegraded":"2023-09-30T17:02:18.376912+0000","last_fullsized":"2023-09-30T17:02:18.376912+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:54:54.054186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.354857+0000","last_change":"2023-09-30T17:02:17.358658+0000","last_active":"2023-09-30T17:02:18.354857+0000","last_peered":"2023-09-30T17:02:18.354857+0000","last_clean":"2023-09-30T17:02:18.354857+0000","last_became_active":"2023-09-30T17:02:17.357738+0000","last_became_peered":"2023-09-30T17:02:17.357738+0000","last_unstale":"2023-09-30T17:02:18.354857+0000","last_undegraded":"2023-09-30T17:02:18.354857+0000","last_fullsized":"2023-09-30T17:02:18.354857+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:00:16.830342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.377287+0000","last_change":"2023-09-30T17:02:18.373854+0000","last_active":"2023-09-30T17:02:18.377287+0000","last_peered":"2023-09-30T17:02:18.377287+0000","last_clean":"2023-09-30T17:02:18.377287+0000","last_became_active":"2023-09-30T17:02:18.373315+0000","last_became_peered":"2023-09-30T17:02:18.373315+0000","last_unstale":"2023-09-30T17:02:18.377287+0000","last_undegraded":"2023-09-30T17:02:18.377287+0000","last_fullsized":"2023-09-30T17:02:18.377287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:39:16.689300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.354594+0000","last_change":"2023-09-30T17:02:17.359738+0000","last_active":"2023-09-30T17:02:18.354594+0000","last_peered":"2023-09-30T17:02:18.354594+0000","last_clean":"2023-09-30T17:02:18.354594+0000","last_became_active":"2023-09-30T17:02:17.359424+0000","last_became_peered":"2023-09-30T17:02:17.359424+0000","last_unstale":"2023-09-30T17:02:18.354594+0000","last_undegraded":"2023-09-30T17:02:18.354594+0000","last_fullsized":"2023-09-30T17:02:18.354594+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:01:31.158446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.376045+0000","last_change":"2023-09-30T17:02:18.373068+0000","last_active":"2023-09-30T17:02:18.376045+0000","last_peered":"2023-09-30T17:02:18.376045+0000","last_clean":"2023-09-30T17:02:18.376045+0000","last_became_active":"2023-09-30T17:02:18.372739+0000","last_became_peered":"2023-09-30T17:02:18.372739+0000","last_unstale":"2023-09-30T17:02:18.376045+0000","last_undegraded":"2023-09-30T17:02:18.376045+0000","last_fullsized":"2023-09-30T17:02:18.376045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:52:57.597536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.354340+0000","last_change":"2023-09-30T17:02:17.358811+0000","last_active":"2023-09-30T17:02:18.354340+0000","last_peered":"2023-09-30T17:02:18.354340+0000","last_clean":"2023-09-30T17:02:18.354340+0000","last_became_active":"2023-09-30T17:02:17.358582+0000","last_became_peered":"2023-09-30T17:02:17.358582+0000","last_unstale":"2023-09-30T17:02:18.354340+0000","last_undegraded":"2023-09-30T17:02:18.354340+0000","last_fullsized":"2023-09-30T17:02:18.354340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:52:37.518693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.368954+0000","last_change":"2023-09-30T17:02:18.364478+0000","last_active":"2023-09-30T17:02:18.368954+0000","last_peered":"2023-09-30T17:02:18.368954+0000","last_clean":"2023-09-30T17:02:18.368954+0000","last_became_active":"2023-09-30T17:02:18.364057+0000","last_became_peered":"2023-09-30T17:02:18.364057+0000","last_unstale":"2023-09-30T17:02:18.368954+0000","last_undegraded":"2023-09-30T17:02:18.368954+0000","last_fullsized":"2023-09-30T17:02:18.368954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:52:57.597536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T17:02:17.356696+0000","last_change":"2023-09-30T17:02:12.327704+0000","last_active":"2023-09-30T17:02:17.356696+0000","last_peered":"2023-09-30T17:02:17.356696+0000","last_clean":"2023-09-30T17:02:17.356696+0000","last_became_active":"2023-09-30T17:02:12.327384+0000","last_became_peered":"2023-09-30T17:02:12.327384+0000","last_unstale":"2023-09-30T17:02:17.356696+0000","last_undegraded":"2023-09-30T17:02:17.356696+0000","last_fullsized":"2023-09-30T17:02:17.356696+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:09:34.818252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.358659+0000","last_change":"2023-09-30T17:02:17.357321+0000","last_active":"2023-09-30T17:02:18.358659+0000","last_peered":"2023-09-30T17:02:18.358659+0000","last_clean":"2023-09-30T17:02:18.358659+0000","last_became_active":"2023-09-30T17:02:17.357105+0000","last_became_peered":"2023-09-30T17:02:17.357105+0000","last_unstale":"2023-09-30T17:02:18.358659+0000","last_undegraded":"2023-09-30T17:02:18.358659+0000","last_fullsized":"2023-09-30T17:02:18.358659+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:09:54.050468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.362625+0000","last_change":"2023-09-30T17:02:18.356537+0000","last_active":"2023-09-30T17:02:18.362625+0000","last_peered":"2023-09-30T17:02:18.362625+0000","last_clean":"2023-09-30T17:02:18.362625+0000","last_became_active":"2023-09-30T17:02:18.355641+0000","last_became_peered":"2023-09-30T17:02:18.355641+0000","last_unstale":"2023-09-30T17:02:18.362625+0000","last_undegraded":"2023-09-30T17:02:18.362625+0000","last_fullsized":"2023-09-30T17:02:18.362625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:08:35.999844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T17:02:17.346285+0000","last_change":"2023-09-30T17:02:12.332417+0000","last_active":"2023-09-30T17:02:17.346285+0000","last_peered":"2023-09-30T17:02:17.346285+0000","last_clean":"2023-09-30T17:02:17.346285+0000","last_became_active":"2023-09-30T17:02:12.332124+0000","last_became_peered":"2023-09-30T17:02:12.332124+0000","last_unstale":"2023-09-30T17:02:17.346285+0000","last_undegraded":"2023-09-30T17:02:17.346285+0000","last_fullsized":"2023-09-30T17:02:17.346285+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:21:27.587948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.357136+0000","last_change":"2023-09-30T17:02:17.359029+0000","last_active":"2023-09-30T17:02:18.357136+0000","last_peered":"2023-09-30T17:02:18.357136+0000","last_clean":"2023-09-30T17:02:18.357136+0000","last_became_active":"2023-09-30T17:02:17.357931+0000","last_became_peered":"2023-09-30T17:02:17.357931+0000","last_unstale":"2023-09-30T17:02:18.357136+0000","last_undegraded":"2023-09-30T17:02:18.357136+0000","last_fullsized":"2023-09-30T17:02:18.357136+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:00:56.363835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.368808+0000","last_change":"2023-09-30T17:02:18.363399+0000","last_active":"2023-09-30T17:02:18.368808+0000","last_peered":"2023-09-30T17:02:18.368808+0000","last_clean":"2023-09-30T17:02:18.368808+0000","last_became_active":"2023-09-30T17:02:18.363064+0000","last_became_peered":"2023-09-30T17:02:18.363064+0000","last_unstale":"2023-09-30T17:02:18.368808+0000","last_undegraded":"2023-09-30T17:02:18.368808+0000","last_fullsized":"2023-09-30T17:02:18.368808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:19:51.155815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T17:02:17.356344+0000","last_change":"2023-09-30T17:02:12.327834+0000","last_active":"2023-09-30T17:02:17.356344+0000","last_peered":"2023-09-30T17:02:17.356344+0000","last_clean":"2023-09-30T17:02:17.356344+0000","last_became_active":"2023-09-30T17:02:12.327542+0000","last_became_peered":"2023-09-30T17:02:12.327542+0000","last_unstale":"2023-09-30T17:02:17.356344+0000","last_undegraded":"2023-09-30T17:02:17.356344+0000","last_fullsized":"2023-09-30T17:02:17.356344+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:49:54.890769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.354287+0000","last_change":"2023-09-30T17:02:17.363326+0000","last_active":"2023-09-30T17:02:18.354287+0000","last_peered":"2023-09-30T17:02:18.354287+0000","last_clean":"2023-09-30T17:02:18.354287+0000","last_became_active":"2023-09-30T17:02:17.362934+0000","last_became_peered":"2023-09-30T17:02:17.362934+0000","last_unstale":"2023-09-30T17:02:18.354287+0000","last_undegraded":"2023-09-30T17:02:18.354287+0000","last_fullsized":"2023-09-30T17:02:18.354287+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:24:04.564387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.368944+0000","last_change":"2023-09-30T17:02:18.364406+0000","last_active":"2023-09-30T17:02:18.368944+0000","last_peered":"2023-09-30T17:02:18.368944+0000","last_clean":"2023-09-30T17:02:18.368944+0000","last_became_active":"2023-09-30T17:02:18.363849+0000","last_became_peered":"2023-09-30T17:02:18.363849+0000","last_unstale":"2023-09-30T17:02:18.368944+0000","last_undegraded":"2023-09-30T17:02:18.368944+0000","last_fullsized":"2023-09-30T17:02:18.368944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:27:38.452037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T17:02:17.346366+0000","last_change":"2023-09-30T17:02:12.332542+0000","last_active":"2023-09-30T17:02:17.346366+0000","last_peered":"2023-09-30T17:02:17.346366+0000","last_clean":"2023-09-30T17:02:17.346366+0000","last_became_active":"2023-09-30T17:02:12.332132+0000","last_became_peered":"2023-09-30T17:02:12.332132+0000","last_unstale":"2023-09-30T17:02:17.346366+0000","last_undegraded":"2023-09-30T17:02:17.346366+0000","last_fullsized":"2023-09-30T17:02:17.346366+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:14:16.917130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":213,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T17:02:17.346249+0000","last_change":"2023-09-30T17:02:07.309872+0000","last_active":"2023-09-30T17:02:17.346249+0000","last_peered":"2023-09-30T17:02:17.346249+0000","last_clean":"2023-09-30T17:02:17.346249+0000","last_became_active":"2023-09-30T17:02:07.309630+0000","last_became_peered":"2023-09-30T17:02:07.309630+0000","last_unstale":"2023-09-30T17:02:17.346249+0000","last_undegraded":"2023-09-30T17:02:17.346249+0000","last_fullsized":"2023-09-30T17:02:17.346249+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:06.295501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:06.295501+0000","last_clean_scrub_stamp":"2023-09-30T17:02:06.295501+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:20:12.668818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.348174+0000","last_change":"2023-09-30T17:02:17.357139+0000","last_active":"2023-09-30T17:02:18.348174+0000","last_peered":"2023-09-30T17:02:18.348174+0000","last_clean":"2023-09-30T17:02:18.348174+0000","last_became_active":"2023-09-30T17:02:17.356901+0000","last_became_peered":"2023-09-30T17:02:17.356901+0000","last_unstale":"2023-09-30T17:02:18.348174+0000","last_undegraded":"2023-09-30T17:02:18.348174+0000","last_fullsized":"2023-09-30T17:02:18.348174+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:22:35.747671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.377245+0000","last_change":"2023-09-30T17:02:18.373627+0000","last_active":"2023-09-30T17:02:18.377245+0000","last_peered":"2023-09-30T17:02:18.377245+0000","last_clean":"2023-09-30T17:02:18.377245+0000","last_became_active":"2023-09-30T17:02:18.373275+0000","last_became_peered":"2023-09-30T17:02:18.373275+0000","last_unstale":"2023-09-30T17:02:18.377245+0000","last_undegraded":"2023-09-30T17:02:18.377245+0000","last_fullsized":"2023-09-30T17:02:18.377245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:32:34.654264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T17:02:17.346367+0000","last_change":"2023-09-30T17:02:12.330129+0000","last_active":"2023-09-30T17:02:17.346367+0000","last_peered":"2023-09-30T17:02:17.346367+0000","last_clean":"2023-09-30T17:02:17.346367+0000","last_became_active":"2023-09-30T17:02:12.329863+0000","last_became_peered":"2023-09-30T17:02:12.329863+0000","last_unstale":"2023-09-30T17:02:17.346367+0000","last_undegraded":"2023-09-30T17:02:17.346367+0000","last_fullsized":"2023-09-30T17:02:17.346367+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:21:45.393691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.348060+0000","last_change":"2023-09-30T17:02:17.363398+0000","last_active":"2023-09-30T17:02:18.348060+0000","last_peered":"2023-09-30T17:02:18.348060+0000","last_clean":"2023-09-30T17:02:18.348060+0000","last_became_active":"2023-09-30T17:02:17.363086+0000","last_became_peered":"2023-09-30T17:02:17.363086+0000","last_unstale":"2023-09-30T17:02:18.348060+0000","last_undegraded":"2023-09-30T17:02:18.348060+0000","last_fullsized":"2023-09-30T17:02:18.348060+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:48:08.569937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.364728+0000","last_change":"2023-09-30T17:02:18.360029+0000","last_active":"2023-09-30T17:02:18.364728+0000","last_peered":"2023-09-30T17:02:18.364728+0000","last_clean":"2023-09-30T17:02:18.364728+0000","last_became_active":"2023-09-30T17:02:18.356839+0000","last_became_peered":"2023-09-30T17:02:18.356839+0000","last_unstale":"2023-09-30T17:02:18.364728+0000","last_undegraded":"2023-09-30T17:02:18.364728+0000","last_fullsized":"2023-09-30T17:02:18.364728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:22:36.753301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T17:02:17.353454+0000","last_change":"2023-09-30T17:02:12.330472+0000","last_active":"2023-09-30T17:02:17.353454+0000","last_peered":"2023-09-30T17:02:17.353454+0000","last_clean":"2023-09-30T17:02:17.353454+0000","last_became_active":"2023-09-30T17:02:12.330154+0000","last_became_peered":"2023-09-30T17:02:12.330154+0000","last_unstale":"2023-09-30T17:02:17.353454+0000","last_undegraded":"2023-09-30T17:02:17.353454+0000","last_fullsized":"2023-09-30T17:02:17.353454+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:43:23.161734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.349079+0000","last_change":"2023-09-30T17:02:17.361007+0000","last_active":"2023-09-30T17:02:18.349079+0000","last_peered":"2023-09-30T17:02:18.349079+0000","last_clean":"2023-09-30T17:02:18.349079+0000","last_became_active":"2023-09-30T17:02:17.360721+0000","last_became_peered":"2023-09-30T17:02:17.360721+0000","last_unstale":"2023-09-30T17:02:18.349079+0000","last_undegraded":"2023-09-30T17:02:18.349079+0000","last_fullsized":"2023-09-30T17:02:18.349079+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:13:41.205152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.365969+0000","last_change":"2023-09-30T17:02:18.364148+0000","last_active":"2023-09-30T17:02:18.365969+0000","last_peered":"2023-09-30T17:02:18.365969+0000","last_clean":"2023-09-30T17:02:18.365969+0000","last_became_active":"2023-09-30T17:02:18.363793+0000","last_became_peered":"2023-09-30T17:02:18.363793+0000","last_unstale":"2023-09-30T17:02:18.365969+0000","last_undegraded":"2023-09-30T17:02:18.365969+0000","last_fullsized":"2023-09-30T17:02:18.365969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:23:06.065302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.364279+0000","last_change":"2023-09-30T17:02:17.360831+0000","last_active":"2023-09-30T17:02:18.364279+0000","last_peered":"2023-09-30T17:02:18.364279+0000","last_clean":"2023-09-30T17:02:18.364279+0000","last_became_active":"2023-09-30T17:02:17.360494+0000","last_became_peered":"2023-09-30T17:02:17.360494+0000","last_unstale":"2023-09-30T17:02:18.364279+0000","last_undegraded":"2023-09-30T17:02:18.364279+0000","last_fullsized":"2023-09-30T17:02:18.364279+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:24:04.564387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T17:02:17.356876+0000","last_change":"2023-09-30T17:02:12.328184+0000","last_active":"2023-09-30T17:02:17.356876+0000","last_peered":"2023-09-30T17:02:17.356876+0000","last_clean":"2023-09-30T17:02:17.356876+0000","last_became_active":"2023-09-30T17:02:12.327898+0000","last_became_peered":"2023-09-30T17:02:12.327898+0000","last_unstale":"2023-09-30T17:02:17.356876+0000","last_undegraded":"2023-09-30T17:02:17.356876+0000","last_fullsized":"2023-09-30T17:02:17.356876+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:43:23.161734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.368615+0000","last_change":"2023-09-30T17:02:18.361791+0000","last_active":"2023-09-30T17:02:18.368615+0000","last_peered":"2023-09-30T17:02:18.368615+0000","last_clean":"2023-09-30T17:02:18.368615+0000","last_became_active":"2023-09-30T17:02:18.361226+0000","last_became_peered":"2023-09-30T17:02:18.361226+0000","last_unstale":"2023-09-30T17:02:18.368615+0000","last_undegraded":"2023-09-30T17:02:18.368615+0000","last_fullsized":"2023-09-30T17:02:18.368615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:48:38.968795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T17:02:17.346476+0000","last_change":"2023-09-30T17:02:12.330039+0000","last_active":"2023-09-30T17:02:17.346476+0000","last_peered":"2023-09-30T17:02:17.346476+0000","last_clean":"2023-09-30T17:02:17.346476+0000","last_became_active":"2023-09-30T17:02:12.329827+0000","last_became_peered":"2023-09-30T17:02:12.329827+0000","last_unstale":"2023-09-30T17:02:17.346476+0000","last_undegraded":"2023-09-30T17:02:17.346476+0000","last_fullsized":"2023-09-30T17:02:17.346476+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:21:09.449776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.349758+0000","last_change":"2023-09-30T17:02:17.364615+0000","last_active":"2023-09-30T17:02:18.349758+0000","last_peered":"2023-09-30T17:02:18.349758+0000","last_clean":"2023-09-30T17:02:18.349758+0000","last_became_active":"2023-09-30T17:02:17.364317+0000","last_became_peered":"2023-09-30T17:02:17.364317+0000","last_unstale":"2023-09-30T17:02:18.349758+0000","last_undegraded":"2023-09-30T17:02:18.349758+0000","last_fullsized":"2023-09-30T17:02:18.349758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:52:37.518693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.361047+0000","last_change":"2023-09-30T17:02:18.356454+0000","last_active":"2023-09-30T17:02:18.361047+0000","last_peered":"2023-09-30T17:02:18.361047+0000","last_clean":"2023-09-30T17:02:18.361047+0000","last_became_active":"2023-09-30T17:02:18.355486+0000","last_became_peered":"2023-09-30T17:02:18.355486+0000","last_unstale":"2023-09-30T17:02:18.361047+0000","last_undegraded":"2023-09-30T17:02:18.361047+0000","last_fullsized":"2023-09-30T17:02:18.361047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:19:51.155815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.373380+0000","last_change":"2023-09-30T17:02:17.363396+0000","last_active":"2023-09-30T17:02:18.373380+0000","last_peered":"2023-09-30T17:02:18.373380+0000","last_clean":"2023-09-30T17:02:18.373380+0000","last_became_active":"2023-09-30T17:02:17.363065+0000","last_became_peered":"2023-09-30T17:02:17.363065+0000","last_unstale":"2023-09-30T17:02:18.373380+0000","last_undegraded":"2023-09-30T17:02:18.373380+0000","last_fullsized":"2023-09-30T17:02:18.373380+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:09:59.154381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.362297+0000","last_change":"2023-09-30T17:02:18.358269+0000","last_active":"2023-09-30T17:02:18.362297+0000","last_peered":"2023-09-30T17:02:18.362297+0000","last_clean":"2023-09-30T17:02:18.362297+0000","last_became_active":"2023-09-30T17:02:18.356902+0000","last_became_peered":"2023-09-30T17:02:18.356902+0000","last_unstale":"2023-09-30T17:02:18.362297+0000","last_undegraded":"2023-09-30T17:02:18.362297+0000","last_fullsized":"2023-09-30T17:02:18.362297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:48:38.968795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.382589+0000","last_change":"2023-09-30T17:02:17.358568+0000","last_active":"2023-09-30T17:02:18.382589+0000","last_peered":"2023-09-30T17:02:18.382589+0000","last_clean":"2023-09-30T17:02:18.382589+0000","last_became_active":"2023-09-30T17:02:17.357763+0000","last_became_peered":"2023-09-30T17:02:17.357763+0000","last_unstale":"2023-09-30T17:02:18.382589+0000","last_undegraded":"2023-09-30T17:02:18.382589+0000","last_fullsized":"2023-09-30T17:02:18.382589+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:04:22.748557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.377880+0000","last_change":"2023-09-30T17:02:18.376236+0000","last_active":"2023-09-30T17:02:18.377880+0000","last_peered":"2023-09-30T17:02:18.377880+0000","last_clean":"2023-09-30T17:02:18.377880+0000","last_became_active":"2023-09-30T17:02:18.374853+0000","last_became_peered":"2023-09-30T17:02:18.374853+0000","last_unstale":"2023-09-30T17:02:18.377880+0000","last_undegraded":"2023-09-30T17:02:18.377880+0000","last_fullsized":"2023-09-30T17:02:18.377880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:33:21.723864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.376746+0000","last_change":"2023-09-30T17:02:17.363358+0000","last_active":"2023-09-30T17:02:18.376746+0000","last_peered":"2023-09-30T17:02:18.376746+0000","last_clean":"2023-09-30T17:02:18.376746+0000","last_became_active":"2023-09-30T17:02:17.363003+0000","last_became_peered":"2023-09-30T17:02:17.363003+0000","last_unstale":"2023-09-30T17:02:18.376746+0000","last_undegraded":"2023-09-30T17:02:18.376746+0000","last_fullsized":"2023-09-30T17:02:18.376746+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:27:37.446407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.363619+0000","last_change":"2023-09-30T17:02:18.362117+0000","last_active":"2023-09-30T17:02:18.363619+0000","last_peered":"2023-09-30T17:02:18.363619+0000","last_clean":"2023-09-30T17:02:18.363619+0000","last_became_active":"2023-09-30T17:02:18.361463+0000","last_became_peered":"2023-09-30T17:02:18.361463+0000","last_unstale":"2023-09-30T17:02:18.363619+0000","last_undegraded":"2023-09-30T17:02:18.363619+0000","last_fullsized":"2023-09-30T17:02:18.363619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:51:14.531522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.362710+0000","last_change":"2023-09-30T17:02:17.360802+0000","last_active":"2023-09-30T17:02:18.362710+0000","last_peered":"2023-09-30T17:02:18.362710+0000","last_clean":"2023-09-30T17:02:18.362710+0000","last_became_active":"2023-09-30T17:02:17.360475+0000","last_became_peered":"2023-09-30T17:02:17.360475+0000","last_unstale":"2023-09-30T17:02:18.362710+0000","last_undegraded":"2023-09-30T17:02:18.362710+0000","last_fullsized":"2023-09-30T17:02:18.362710+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:50:18.455188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.363398+0000","last_change":"2023-09-30T17:02:18.359857+0000","last_active":"2023-09-30T17:02:18.363398+0000","last_peered":"2023-09-30T17:02:18.363398+0000","last_clean":"2023-09-30T17:02:18.363398+0000","last_became_active":"2023-09-30T17:02:18.357098+0000","last_became_peered":"2023-09-30T17:02:18.357098+0000","last_unstale":"2023-09-30T17:02:18.363398+0000","last_undegraded":"2023-09-30T17:02:18.363398+0000","last_fullsized":"2023-09-30T17:02:18.363398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:51:14.531522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.373540+0000","last_change":"2023-09-30T17:02:17.364479+0000","last_active":"2023-09-30T17:02:18.373540+0000","last_peered":"2023-09-30T17:02:18.373540+0000","last_clean":"2023-09-30T17:02:18.373540+0000","last_became_active":"2023-09-30T17:02:17.364215+0000","last_became_peered":"2023-09-30T17:02:17.364215+0000","last_unstale":"2023-09-30T17:02:18.373540+0000","last_undegraded":"2023-09-30T17:02:18.373540+0000","last_fullsized":"2023-09-30T17:02:18.373540+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:01:31.158446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.377676+0000","last_change":"2023-09-30T17:02:18.375778+0000","last_active":"2023-09-30T17:02:18.377676+0000","last_peered":"2023-09-30T17:02:18.377676+0000","last_clean":"2023-09-30T17:02:18.377676+0000","last_became_active":"2023-09-30T17:02:18.374620+0000","last_became_peered":"2023-09-30T17:02:18.374620+0000","last_unstale":"2023-09-30T17:02:18.377676+0000","last_undegraded":"2023-09-30T17:02:18.377676+0000","last_fullsized":"2023-09-30T17:02:18.377676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:01:32.164075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.373941+0000","last_change":"2023-09-30T17:02:18.362804+0000","last_active":"2023-09-30T17:02:18.373941+0000","last_peered":"2023-09-30T17:02:18.373941+0000","last_clean":"2023-09-30T17:02:18.373941+0000","last_became_active":"2023-09-30T17:02:18.362392+0000","last_became_peered":"2023-09-30T17:02:18.362392+0000","last_unstale":"2023-09-30T17:02:18.373941+0000","last_undegraded":"2023-09-30T17:02:18.373941+0000","last_fullsized":"2023-09-30T17:02:18.373941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:19:51.155815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.368818+0000","last_change":"2023-09-30T17:02:18.363479+0000","last_active":"2023-09-30T17:02:18.368818+0000","last_peered":"2023-09-30T17:02:18.368818+0000","last_clean":"2023-09-30T17:02:18.368818+0000","last_became_active":"2023-09-30T17:02:18.363222+0000","last_became_peered":"2023-09-30T17:02:18.363222+0000","last_unstale":"2023-09-30T17:02:18.368818+0000","last_undegraded":"2023-09-30T17:02:18.368818+0000","last_fullsized":"2023-09-30T17:02:18.368818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:00:17.835972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.365338+0000","last_change":"2023-09-30T17:02:18.362764+0000","last_active":"2023-09-30T17:02:18.365338+0000","last_peered":"2023-09-30T17:02:18.365338+0000","last_clean":"2023-09-30T17:02:18.365338+0000","last_became_active":"2023-09-30T17:02:18.362369+0000","last_became_peered":"2023-09-30T17:02:18.362369+0000","last_unstale":"2023-09-30T17:02:18.365338+0000","last_undegraded":"2023-09-30T17:02:18.365338+0000","last_fullsized":"2023-09-30T17:02:18.365338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:01:30.269635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.368791+0000","last_change":"2023-09-30T17:02:18.363216+0000","last_active":"2023-09-30T17:02:18.368791+0000","last_peered":"2023-09-30T17:02:18.368791+0000","last_clean":"2023-09-30T17:02:18.368791+0000","last_became_active":"2023-09-30T17:02:18.362894+0000","last_became_peered":"2023-09-30T17:02:18.362894+0000","last_unstale":"2023-09-30T17:02:18.368791+0000","last_undegraded":"2023-09-30T17:02:18.368791+0000","last_fullsized":"2023-09-30T17:02:18.368791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:23:06.065302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.361180+0000","last_change":"2023-09-30T17:02:18.356827+0000","last_active":"2023-09-30T17:02:18.361180+0000","last_peered":"2023-09-30T17:02:18.361180+0000","last_clean":"2023-09-30T17:02:18.361180+0000","last_became_active":"2023-09-30T17:02:18.355965+0000","last_became_peered":"2023-09-30T17:02:18.355965+0000","last_unstale":"2023-09-30T17:02:18.361180+0000","last_undegraded":"2023-09-30T17:02:18.361180+0000","last_fullsized":"2023-09-30T17:02:18.361180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:02:28.672156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":782336,"data_stored":645872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31936,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339904,"statfs":{"total":96636764160,"available":96604061696,"internally_reserved":0,"allocated":774144,"data_stored":645256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":163840,"data_stored":53710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T17:02:22.497 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T17:02:22.867 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:02:22.869 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-09-30T17:02:22.879 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-09-30T17:02:21.289499+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":247,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":195,"ondisk_log_size":195,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":107,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":86900,"kb_used_data":1680,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":283028620,"statfs":{"total":289910292480,"available":289821306880,"internally_reserved":0,"allocated":1720320,"data_stored":1344838,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4781,"internal_metadata":87223635},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.950167"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.364946+0000","last_change":"2023-09-30T17:02:18.360288+0000","last_active":"2023-09-30T17:02:18.364946+0000","last_peered":"2023-09-30T17:02:18.364946+0000","last_clean":"2023-09-30T17:02:18.364946+0000","last_became_active":"2023-09-30T17:02:18.358716+0000","last_became_peered":"2023-09-30T17:02:18.358716+0000","last_unstale":"2023-09-30T17:02:18.364946+0000","last_undegraded":"2023-09-30T17:02:18.364946+0000","last_fullsized":"2023-09-30T17:02:18.364946+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:19:21.003353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.365312+0000","last_change":"2023-09-30T17:02:18.362418+0000","last_active":"2023-09-30T17:02:18.365312+0000","last_peered":"2023-09-30T17:02:18.365312+0000","last_clean":"2023-09-30T17:02:18.365312+0000","last_became_active":"2023-09-30T17:02:18.360372+0000","last_became_peered":"2023-09-30T17:02:18.360372+0000","last_unstale":"2023-09-30T17:02:18.365312+0000","last_undegraded":"2023-09-30T17:02:18.365312+0000","last_fullsized":"2023-09-30T17:02:18.365312+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:40:32.925542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.377264+0000","last_change":"2023-09-30T17:02:18.373609+0000","last_active":"2023-09-30T17:02:18.377264+0000","last_peered":"2023-09-30T17:02:18.377264+0000","last_clean":"2023-09-30T17:02:18.377264+0000","last_became_active":"2023-09-30T17:02:18.372911+0000","last_became_peered":"2023-09-30T17:02:18.372911+0000","last_unstale":"2023-09-30T17:02:18.377264+0000","last_undegraded":"2023-09-30T17:02:18.377264+0000","last_fullsized":"2023-09-30T17:02:18.377264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:13:30.688369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.379081+0000","last_change":"2023-09-30T17:02:18.377247+0000","last_active":"2023-09-30T17:02:18.379081+0000","last_peered":"2023-09-30T17:02:18.379081+0000","last_clean":"2023-09-30T17:02:18.379081+0000","last_became_active":"2023-09-30T17:02:18.376351+0000","last_became_peered":"2023-09-30T17:02:18.376351+0000","last_unstale":"2023-09-30T17:02:18.379081+0000","last_undegraded":"2023-09-30T17:02:18.379081+0000","last_fullsized":"2023-09-30T17:02:18.379081+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:10:00.160011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.365060+0000","last_change":"2023-09-30T17:02:18.360192+0000","last_active":"2023-09-30T17:02:18.365060+0000","last_peered":"2023-09-30T17:02:18.365060+0000","last_clean":"2023-09-30T17:02:18.365060+0000","last_became_active":"2023-09-30T17:02:18.357317+0000","last_became_peered":"2023-09-30T17:02:18.357317+0000","last_unstale":"2023-09-30T17:02:18.365060+0000","last_undegraded":"2023-09-30T17:02:18.365060+0000","last_fullsized":"2023-09-30T17:02:18.365060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:00:17.835972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.377949+0000","last_change":"2023-09-30T17:02:18.376076+0000","last_active":"2023-09-30T17:02:18.377949+0000","last_peered":"2023-09-30T17:02:18.377949+0000","last_clean":"2023-09-30T17:02:18.377949+0000","last_became_active":"2023-09-30T17:02:18.375107+0000","last_became_peered":"2023-09-30T17:02:18.375107+0000","last_unstale":"2023-09-30T17:02:18.377949+0000","last_undegraded":"2023-09-30T17:02:18.377949+0000","last_fullsized":"2023-09-30T17:02:18.377949+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:47:00.094303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.363171+0000","last_change":"2023-09-30T17:02:18.360819+0000","last_active":"2023-09-30T17:02:18.363171+0000","last_peered":"2023-09-30T17:02:18.363171+0000","last_clean":"2023-09-30T17:02:18.363171+0000","last_became_active":"2023-09-30T17:02:18.360506+0000","last_became_peered":"2023-09-30T17:02:18.360506+0000","last_unstale":"2023-09-30T17:02:18.363171+0000","last_undegraded":"2023-09-30T17:02:18.363171+0000","last_fullsized":"2023-09-30T17:02:18.363171+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:38:58.103941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.373918+0000","last_change":"2023-09-30T17:02:18.362003+0000","last_active":"2023-09-30T17:02:18.373918+0000","last_peered":"2023-09-30T17:02:18.373918+0000","last_clean":"2023-09-30T17:02:18.373918+0000","last_became_active":"2023-09-30T17:02:18.361644+0000","last_became_peered":"2023-09-30T17:02:18.361644+0000","last_unstale":"2023-09-30T17:02:18.373918+0000","last_undegraded":"2023-09-30T17:02:18.373918+0000","last_fullsized":"2023-09-30T17:02:18.373918+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:19:21.003353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.368917+0000","last_change":"2023-09-30T17:02:18.364222+0000","last_active":"2023-09-30T17:02:18.368917+0000","last_peered":"2023-09-30T17:02:18.368917+0000","last_clean":"2023-09-30T17:02:18.368917+0000","last_became_active":"2023-09-30T17:02:18.363485+0000","last_became_peered":"2023-09-30T17:02:18.363485+0000","last_unstale":"2023-09-30T17:02:18.368917+0000","last_undegraded":"2023-09-30T17:02:18.368917+0000","last_fullsized":"2023-09-30T17:02:18.368917+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:54:54.054186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.364459+0000","last_change":"2023-09-30T17:02:18.360010+0000","last_active":"2023-09-30T17:02:18.364459+0000","last_peered":"2023-09-30T17:02:18.364459+0000","last_clean":"2023-09-30T17:02:18.364459+0000","last_became_active":"2023-09-30T17:02:18.358396+0000","last_became_peered":"2023-09-30T17:02:18.358396+0000","last_unstale":"2023-09-30T17:02:18.364459+0000","last_undegraded":"2023-09-30T17:02:18.364459+0000","last_fullsized":"2023-09-30T17:02:18.364459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:46:17.380869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.377704+0000","last_change":"2023-09-30T17:02:18.375829+0000","last_active":"2023-09-30T17:02:18.377704+0000","last_peered":"2023-09-30T17:02:18.377704+0000","last_clean":"2023-09-30T17:02:18.377704+0000","last_became_active":"2023-09-30T17:02:18.374447+0000","last_became_peered":"2023-09-30T17:02:18.374447+0000","last_unstale":"2023-09-30T17:02:18.377704+0000","last_undegraded":"2023-09-30T17:02:18.377704+0000","last_fullsized":"2023-09-30T17:02:18.377704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:24:05.570017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.374959+0000","last_change":"2023-09-30T17:02:18.373777+0000","last_active":"2023-09-30T17:02:18.374959+0000","last_peered":"2023-09-30T17:02:18.374959+0000","last_clean":"2023-09-30T17:02:18.374959+0000","last_became_active":"2023-09-30T17:02:18.373434+0000","last_became_peered":"2023-09-30T17:02:18.373434+0000","last_unstale":"2023-09-30T17:02:18.374959+0000","last_undegraded":"2023-09-30T17:02:18.374959+0000","last_fullsized":"2023-09-30T17:02:18.374959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:31:21.329390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.364367+0000","last_change":"2023-09-30T17:02:18.359894+0000","last_active":"2023-09-30T17:02:18.364367+0000","last_peered":"2023-09-30T17:02:18.364367+0000","last_clean":"2023-09-30T17:02:18.364367+0000","last_became_active":"2023-09-30T17:02:18.358534+0000","last_became_peered":"2023-09-30T17:02:18.358534+0000","last_unstale":"2023-09-30T17:02:18.364367+0000","last_undegraded":"2023-09-30T17:02:18.364367+0000","last_fullsized":"2023-09-30T17:02:18.364367+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:13:42.210782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.377612+0000","last_change":"2023-09-30T17:02:18.374094+0000","last_active":"2023-09-30T17:02:18.377612+0000","last_peered":"2023-09-30T17:02:18.377612+0000","last_clean":"2023-09-30T17:02:18.377612+0000","last_became_active":"2023-09-30T17:02:18.373165+0000","last_became_peered":"2023-09-30T17:02:18.373165+0000","last_unstale":"2023-09-30T17:02:18.377612+0000","last_undegraded":"2023-09-30T17:02:18.377612+0000","last_fullsized":"2023-09-30T17:02:18.377612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:50:19.460817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.373884+0000","last_change":"2023-09-30T17:02:18.372075+0000","last_active":"2023-09-30T17:02:18.373884+0000","last_peered":"2023-09-30T17:02:18.373884+0000","last_clean":"2023-09-30T17:02:18.373884+0000","last_became_active":"2023-09-30T17:02:18.371685+0000","last_became_peered":"2023-09-30T17:02:18.371685+0000","last_unstale":"2023-09-30T17:02:18.373884+0000","last_undegraded":"2023-09-30T17:02:18.373884+0000","last_fullsized":"2023-09-30T17:02:18.373884+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:02:28.672156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.377919+0000","last_change":"2023-09-30T17:02:18.376370+0000","last_active":"2023-09-30T17:02:18.377919+0000","last_peered":"2023-09-30T17:02:18.377919+0000","last_clean":"2023-09-30T17:02:18.377919+0000","last_became_active":"2023-09-30T17:02:18.375027+0000","last_became_peered":"2023-09-30T17:02:18.375027+0000","last_unstale":"2023-09-30T17:02:18.377919+0000","last_undegraded":"2023-09-30T17:02:18.377919+0000","last_fullsized":"2023-09-30T17:02:18.377919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:22:13.025181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.368935+0000","last_change":"2023-09-30T17:02:18.364360+0000","last_active":"2023-09-30T17:02:18.368935+0000","last_peered":"2023-09-30T17:02:18.368935+0000","last_clean":"2023-09-30T17:02:18.368935+0000","last_became_active":"2023-09-30T17:02:18.363697+0000","last_became_peered":"2023-09-30T17:02:18.363697+0000","last_unstale":"2023-09-30T17:02:18.368935+0000","last_undegraded":"2023-09-30T17:02:18.368935+0000","last_fullsized":"2023-09-30T17:02:18.368935+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:51:14.531522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.364901+0000","last_change":"2023-09-30T17:02:18.360320+0000","last_active":"2023-09-30T17:02:18.364901+0000","last_peered":"2023-09-30T17:02:18.364901+0000","last_clean":"2023-09-30T17:02:18.364901+0000","last_became_active":"2023-09-30T17:02:18.357184+0000","last_became_peered":"2023-09-30T17:02:18.357184+0000","last_unstale":"2023-09-30T17:02:18.364901+0000","last_undegraded":"2023-09-30T17:02:18.364901+0000","last_fullsized":"2023-09-30T17:02:18.364901+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:48:20.064093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.368892+0000","last_change":"2023-09-30T17:02:18.363956+0000","last_active":"2023-09-30T17:02:18.368892+0000","last_peered":"2023-09-30T17:02:18.368892+0000","last_clean":"2023-09-30T17:02:18.368892+0000","last_became_active":"2023-09-30T17:02:18.363654+0000","last_became_peered":"2023-09-30T17:02:18.363654+0000","last_unstale":"2023-09-30T17:02:18.368892+0000","last_undegraded":"2023-09-30T17:02:18.368892+0000","last_fullsized":"2023-09-30T17:02:18.368892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:31:21.329390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.379060+0000","last_change":"2023-09-30T17:02:18.377065+0000","last_active":"2023-09-30T17:02:18.379060+0000","last_peered":"2023-09-30T17:02:18.379060+0000","last_clean":"2023-09-30T17:02:18.379060+0000","last_became_active":"2023-09-30T17:02:18.375158+0000","last_became_peered":"2023-09-30T17:02:18.375158+0000","last_unstale":"2023-09-30T17:02:18.379060+0000","last_undegraded":"2023-09-30T17:02:18.379060+0000","last_fullsized":"2023-09-30T17:02:18.379060+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:40:32.925542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.377903+0000","last_change":"2023-09-30T17:02:18.376206+0000","last_active":"2023-09-30T17:02:18.377903+0000","last_peered":"2023-09-30T17:02:18.377903+0000","last_clean":"2023-09-30T17:02:18.377903+0000","last_became_active":"2023-09-30T17:02:18.374694+0000","last_became_peered":"2023-09-30T17:02:18.374694+0000","last_unstale":"2023-09-30T17:02:18.377903+0000","last_undegraded":"2023-09-30T17:02:18.377903+0000","last_fullsized":"2023-09-30T17:02:18.377903+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:30:43.782165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.365541+0000","last_change":"2023-09-30T17:02:18.362977+0000","last_active":"2023-09-30T17:02:18.365541+0000","last_peered":"2023-09-30T17:02:18.365541+0000","last_clean":"2023-09-30T17:02:18.365541+0000","last_became_active":"2023-09-30T17:02:18.362657+0000","last_became_peered":"2023-09-30T17:02:18.362657+0000","last_unstale":"2023-09-30T17:02:18.365541+0000","last_undegraded":"2023-09-30T17:02:18.365541+0000","last_fullsized":"2023-09-30T17:02:18.365541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:54:54.054186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.368488+0000","last_change":"2023-09-30T17:02:18.361158+0000","last_active":"2023-09-30T17:02:18.368488+0000","last_peered":"2023-09-30T17:02:18.368488+0000","last_clean":"2023-09-30T17:02:18.368488+0000","last_became_active":"2023-09-30T17:02:18.360840+0000","last_became_peered":"2023-09-30T17:02:18.360840+0000","last_unstale":"2023-09-30T17:02:18.368488+0000","last_undegraded":"2023-09-30T17:02:18.368488+0000","last_fullsized":"2023-09-30T17:02:18.368488+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:04:23.754186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.358631+0000","last_change":"2023-09-30T17:02:18.353938+0000","last_active":"2023-09-30T17:02:18.358631+0000","last_peered":"2023-09-30T17:02:18.358631+0000","last_clean":"2023-09-30T17:02:18.358631+0000","last_became_active":"2023-09-30T17:02:18.353632+0000","last_became_peered":"2023-09-30T17:02:18.353632+0000","last_unstale":"2023-09-30T17:02:18.358631+0000","last_undegraded":"2023-09-30T17:02:18.358631+0000","last_fullsized":"2023-09-30T17:02:18.358631+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:36:58.193735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.364821+0000","last_change":"2023-09-30T17:02:18.360801+0000","last_active":"2023-09-30T17:02:18.364821+0000","last_peered":"2023-09-30T17:02:18.364821+0000","last_clean":"2023-09-30T17:02:18.364821+0000","last_became_active":"2023-09-30T17:02:18.358862+0000","last_became_peered":"2023-09-30T17:02:18.358862+0000","last_unstale":"2023-09-30T17:02:18.364821+0000","last_undegraded":"2023-09-30T17:02:18.364821+0000","last_fullsized":"2023-09-30T17:02:18.364821+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:04:23.754186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.357205+0000","last_change":"2023-09-30T17:02:18.355710+0000","last_active":"2023-09-30T17:02:18.357205+0000","last_peered":"2023-09-30T17:02:18.357205+0000","last_clean":"2023-09-30T17:02:18.357205+0000","last_became_active":"2023-09-30T17:02:18.355423+0000","last_became_peered":"2023-09-30T17:02:18.355423+0000","last_unstale":"2023-09-30T17:02:18.357205+0000","last_undegraded":"2023-09-30T17:02:18.357205+0000","last_fullsized":"2023-09-30T17:02:18.357205+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:11:47.254069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.379083+0000","last_change":"2023-09-30T17:02:18.377164+0000","last_active":"2023-09-30T17:02:18.379083+0000","last_peered":"2023-09-30T17:02:18.379083+0000","last_clean":"2023-09-30T17:02:18.379083+0000","last_became_active":"2023-09-30T17:02:18.376425+0000","last_became_peered":"2023-09-30T17:02:18.376425+0000","last_unstale":"2023-09-30T17:02:18.379083+0000","last_undegraded":"2023-09-30T17:02:18.379083+0000","last_fullsized":"2023-09-30T17:02:18.379083+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:30:35.150981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.365856+0000","last_change":"2023-09-30T17:02:17.358258+0000","last_active":"2023-09-30T17:02:18.365856+0000","last_peered":"2023-09-30T17:02:18.365856+0000","last_clean":"2023-09-30T17:02:18.365856+0000","last_became_active":"2023-09-30T17:02:17.357890+0000","last_became_peered":"2023-09-30T17:02:17.357890+0000","last_unstale":"2023-09-30T17:02:18.365856+0000","last_undegraded":"2023-09-30T17:02:18.365856+0000","last_fullsized":"2023-09-30T17:02:18.365856+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:52:56.591906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.363992+0000","last_change":"2023-09-30T17:02:18.358843+0000","last_active":"2023-09-30T17:02:18.363992+0000","last_peered":"2023-09-30T17:02:18.363992+0000","last_clean":"2023-09-30T17:02:18.363992+0000","last_became_active":"2023-09-30T17:02:18.357966+0000","last_became_peered":"2023-09-30T17:02:18.357966+0000","last_unstale":"2023-09-30T17:02:18.363992+0000","last_undegraded":"2023-09-30T17:02:18.363992+0000","last_fullsized":"2023-09-30T17:02:18.363992+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:58:41.706963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.349133+0000","last_change":"2023-09-30T17:02:17.363387+0000","last_active":"2023-09-30T17:02:18.349133+0000","last_peered":"2023-09-30T17:02:18.349133+0000","last_clean":"2023-09-30T17:02:18.349133+0000","last_became_active":"2023-09-30T17:02:17.363042+0000","last_became_peered":"2023-09-30T17:02:17.363042+0000","last_unstale":"2023-09-30T17:02:18.349133+0000","last_undegraded":"2023-09-30T17:02:18.349133+0000","last_fullsized":"2023-09-30T17:02:18.349133+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:38:57.098312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.356869+0000","last_change":"2023-09-30T17:02:18.355398+0000","last_active":"2023-09-30T17:02:18.356869+0000","last_peered":"2023-09-30T17:02:18.356869+0000","last_clean":"2023-09-30T17:02:18.356869+0000","last_became_active":"2023-09-30T17:02:18.355006+0000","last_became_peered":"2023-09-30T17:02:18.355006+0000","last_unstale":"2023-09-30T17:02:18.356869+0000","last_undegraded":"2023-09-30T17:02:18.356869+0000","last_fullsized":"2023-09-30T17:02:18.356869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:40:32.925542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.348752+0000","last_change":"2023-09-30T17:02:17.361000+0000","last_active":"2023-09-30T17:02:18.348752+0000","last_peered":"2023-09-30T17:02:18.348752+0000","last_clean":"2023-09-30T17:02:18.348752+0000","last_became_active":"2023-09-30T17:02:17.360601+0000","last_became_peered":"2023-09-30T17:02:17.360601+0000","last_unstale":"2023-09-30T17:02:18.348752+0000","last_undegraded":"2023-09-30T17:02:18.348752+0000","last_fullsized":"2023-09-30T17:02:18.348752+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:02:27.666526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.365811+0000","last_change":"2023-09-30T17:02:18.363570+0000","last_active":"2023-09-30T17:02:18.365811+0000","last_peered":"2023-09-30T17:02:18.365811+0000","last_clean":"2023-09-30T17:02:18.365811+0000","last_became_active":"2023-09-30T17:02:18.362961+0000","last_became_peered":"2023-09-30T17:02:18.362961+0000","last_unstale":"2023-09-30T17:02:18.365811+0000","last_undegraded":"2023-09-30T17:02:18.365811+0000","last_fullsized":"2023-09-30T17:02:18.365811+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:11:47.254069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.350540+0000","last_change":"2023-09-30T17:02:17.364672+0000","last_active":"2023-09-30T17:02:18.350540+0000","last_peered":"2023-09-30T17:02:18.350540+0000","last_clean":"2023-09-30T17:02:18.350540+0000","last_became_active":"2023-09-30T17:02:17.364279+0000","last_became_peered":"2023-09-30T17:02:17.364279+0000","last_unstale":"2023-09-30T17:02:18.350540+0000","last_undegraded":"2023-09-30T17:02:18.350540+0000","last_fullsized":"2023-09-30T17:02:18.350540+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:00:56.363835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.364880+0000","last_change":"2023-09-30T17:02:18.358841+0000","last_active":"2023-09-30T17:02:18.364880+0000","last_peered":"2023-09-30T17:02:18.364880+0000","last_clean":"2023-09-30T17:02:18.364880+0000","last_became_active":"2023-09-30T17:02:18.358529+0000","last_became_peered":"2023-09-30T17:02:18.358529+0000","last_unstale":"2023-09-30T17:02:18.364880+0000","last_undegraded":"2023-09-30T17:02:18.364880+0000","last_fullsized":"2023-09-30T17:02:18.364880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:58:41.706963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.356947+0000","last_change":"2023-09-30T17:02:17.357998+0000","last_active":"2023-09-30T17:02:18.356947+0000","last_peered":"2023-09-30T17:02:18.356947+0000","last_clean":"2023-09-30T17:02:18.356947+0000","last_became_active":"2023-09-30T17:02:17.357653+0000","last_became_peered":"2023-09-30T17:02:17.357653+0000","last_unstale":"2023-09-30T17:02:18.356947+0000","last_undegraded":"2023-09-30T17:02:18.356947+0000","last_fullsized":"2023-09-30T17:02:18.356947+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:52:37.518693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.368463+0000","last_change":"2023-09-30T17:02:18.361155+0000","last_active":"2023-09-30T17:02:18.368463+0000","last_peered":"2023-09-30T17:02:18.368463+0000","last_clean":"2023-09-30T17:02:18.368463+0000","last_became_active":"2023-09-30T17:02:18.360825+0000","last_became_peered":"2023-09-30T17:02:18.360825+0000","last_unstale":"2023-09-30T17:02:18.368463+0000","last_undegraded":"2023-09-30T17:02:18.368463+0000","last_fullsized":"2023-09-30T17:02:18.368463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:04:49.300418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.377101+0000","last_change":"2023-09-30T17:02:17.363119+0000","last_active":"2023-09-30T17:02:18.377101+0000","last_peered":"2023-09-30T17:02:18.377101+0000","last_clean":"2023-09-30T17:02:18.377101+0000","last_became_active":"2023-09-30T17:02:17.362754+0000","last_became_peered":"2023-09-30T17:02:17.362754+0000","last_unstale":"2023-09-30T17:02:18.377101+0000","last_undegraded":"2023-09-30T17:02:18.377101+0000","last_fullsized":"2023-09-30T17:02:18.377101+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:00:56.363835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.364930+0000","last_change":"2023-09-30T17:02:18.359118+0000","last_active":"2023-09-30T17:02:18.364930+0000","last_peered":"2023-09-30T17:02:18.364930+0000","last_clean":"2023-09-30T17:02:18.364930+0000","last_became_active":"2023-09-30T17:02:18.358786+0000","last_became_peered":"2023-09-30T17:02:18.358786+0000","last_unstale":"2023-09-30T17:02:18.364930+0000","last_undegraded":"2023-09-30T17:02:18.364930+0000","last_fullsized":"2023-09-30T17:02:18.364930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:01:30.269635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":17,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.382246+0000","last_change":"2023-09-30T17:02:17.355936+0000","last_active":"2023-09-30T17:02:18.382246+0000","last_peered":"2023-09-30T17:02:18.382246+0000","last_clean":"2023-09-30T17:02:18.382246+0000","last_became_active":"2023-09-30T17:02:17.355664+0000","last_became_peered":"2023-09-30T17:02:17.355664+0000","last_unstale":"2023-09-30T17:02:18.382246+0000","last_undegraded":"2023-09-30T17:02:18.382246+0000","last_fullsized":"2023-09-30T17:02:18.382246+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:11:46.248439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.377059+0000","last_change":"2023-09-30T17:02:18.373330+0000","last_active":"2023-09-30T17:02:18.377059+0000","last_peered":"2023-09-30T17:02:18.377059+0000","last_clean":"2023-09-30T17:02:18.377059+0000","last_became_active":"2023-09-30T17:02:18.373004+0000","last_became_peered":"2023-09-30T17:02:18.373004+0000","last_unstale":"2023-09-30T17:02:18.377059+0000","last_undegraded":"2023-09-30T17:02:18.377059+0000","last_fullsized":"2023-09-30T17:02:18.377059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:15:54.364571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.375201+0000","last_change":"2023-09-30T17:02:17.359251+0000","last_active":"2023-09-30T17:02:18.375201+0000","last_peered":"2023-09-30T17:02:18.375201+0000","last_clean":"2023-09-30T17:02:18.375201+0000","last_became_active":"2023-09-30T17:02:17.358579+0000","last_became_peered":"2023-09-30T17:02:17.358579+0000","last_unstale":"2023-09-30T17:02:18.375201+0000","last_undegraded":"2023-09-30T17:02:18.375201+0000","last_fullsized":"2023-09-30T17:02:18.375201+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:55:33.944875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.365074+0000","last_change":"2023-09-30T17:02:18.360019+0000","last_active":"2023-09-30T17:02:18.365074+0000","last_peered":"2023-09-30T17:02:18.365074+0000","last_clean":"2023-09-30T17:02:18.365074+0000","last_became_active":"2023-09-30T17:02:18.358364+0000","last_became_peered":"2023-09-30T17:02:18.358364+0000","last_unstale":"2023-09-30T17:02:18.365074+0000","last_undegraded":"2023-09-30T17:02:18.365074+0000","last_fullsized":"2023-09-30T17:02:18.365074+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:38:58.103941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.348535+0000","last_change":"2023-09-30T17:02:17.363694+0000","last_active":"2023-09-30T17:02:18.348535+0000","last_peered":"2023-09-30T17:02:18.348535+0000","last_clean":"2023-09-30T17:02:18.348535+0000","last_became_active":"2023-09-30T17:02:17.363442+0000","last_became_peered":"2023-09-30T17:02:17.363442+0000","last_unstale":"2023-09-30T17:02:18.348535+0000","last_undegraded":"2023-09-30T17:02:18.348535+0000","last_fullsized":"2023-09-30T17:02:18.348535+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:19:19.997724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.365278+0000","last_change":"2023-09-30T17:02:18.362415+0000","last_active":"2023-09-30T17:02:18.365278+0000","last_peered":"2023-09-30T17:02:18.365278+0000","last_clean":"2023-09-30T17:02:18.365278+0000","last_became_active":"2023-09-30T17:02:18.361556+0000","last_became_peered":"2023-09-30T17:02:18.361556+0000","last_unstale":"2023-09-30T17:02:18.365278+0000","last_undegraded":"2023-09-30T17:02:18.365278+0000","last_fullsized":"2023-09-30T17:02:18.365278+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:04:49.300418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.354434+0000","last_change":"2023-09-30T17:02:17.363369+0000","last_active":"2023-09-30T17:02:18.354434+0000","last_peered":"2023-09-30T17:02:18.354434+0000","last_clean":"2023-09-30T17:02:18.354434+0000","last_became_active":"2023-09-30T17:02:17.362925+0000","last_became_peered":"2023-09-30T17:02:17.362925+0000","last_unstale":"2023-09-30T17:02:18.354434+0000","last_undegraded":"2023-09-30T17:02:18.354434+0000","last_fullsized":"2023-09-30T17:02:18.354434+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:50:18.455188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.357719+0000","last_change":"2023-09-30T17:02:18.356700+0000","last_active":"2023-09-30T17:02:18.357719+0000","last_peered":"2023-09-30T17:02:18.357719+0000","last_clean":"2023-09-30T17:02:18.357719+0000","last_became_active":"2023-09-30T17:02:18.356108+0000","last_became_peered":"2023-09-30T17:02:18.356108+0000","last_unstale":"2023-09-30T17:02:18.357719+0000","last_undegraded":"2023-09-30T17:02:18.357719+0000","last_fullsized":"2023-09-30T17:02:18.357719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:10:00.160011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":19,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.380902+0000","last_change":"2023-09-30T17:02:17.355214+0000","last_active":"2023-09-30T17:02:18.380902+0000","last_peered":"2023-09-30T17:02:18.380902+0000","last_clean":"2023-09-30T17:02:18.380902+0000","last_became_active":"2023-09-30T17:02:17.354876+0000","last_became_peered":"2023-09-30T17:02:17.354876+0000","last_unstale":"2023-09-30T17:02:18.380902+0000","last_undegraded":"2023-09-30T17:02:18.380902+0000","last_fullsized":"2023-09-30T17:02:18.380902+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:13:41.205152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.357735+0000","last_change":"2023-09-30T17:02:18.356814+0000","last_active":"2023-09-30T17:02:18.357735+0000","last_peered":"2023-09-30T17:02:18.357735+0000","last_clean":"2023-09-30T17:02:18.357735+0000","last_became_active":"2023-09-30T17:02:18.356258+0000","last_became_peered":"2023-09-30T17:02:18.356258+0000","last_unstale":"2023-09-30T17:02:18.357735+0000","last_undegraded":"2023-09-30T17:02:18.357735+0000","last_fullsized":"2023-09-30T17:02:18.357735+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:55:34.950505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.375937+0000","last_change":"2023-09-30T17:02:17.355972+0000","last_active":"2023-09-30T17:02:18.375937+0000","last_peered":"2023-09-30T17:02:18.375937+0000","last_clean":"2023-09-30T17:02:18.375937+0000","last_became_active":"2023-09-30T17:02:17.355653+0000","last_became_peered":"2023-09-30T17:02:17.355653+0000","last_unstale":"2023-09-30T17:02:18.375937+0000","last_undegraded":"2023-09-30T17:02:18.375937+0000","last_fullsized":"2023-09-30T17:02:18.375937+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:27:37.446407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.360909+0000","last_change":"2023-09-30T17:02:18.355736+0000","last_active":"2023-09-30T17:02:18.360909+0000","last_peered":"2023-09-30T17:02:18.360909+0000","last_clean":"2023-09-30T17:02:18.360909+0000","last_became_active":"2023-09-30T17:02:18.355111+0000","last_became_peered":"2023-09-30T17:02:18.355111+0000","last_unstale":"2023-09-30T17:02:18.360909+0000","last_undegraded":"2023-09-30T17:02:18.360909+0000","last_fullsized":"2023-09-30T17:02:18.360909+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:48:09.575566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.376387+0000","last_change":"2023-09-30T17:02:17.363514+0000","last_active":"2023-09-30T17:02:18.376387+0000","last_peered":"2023-09-30T17:02:18.376387+0000","last_clean":"2023-09-30T17:02:18.376387+0000","last_became_active":"2023-09-30T17:02:17.363124+0000","last_became_peered":"2023-09-30T17:02:17.363124+0000","last_unstale":"2023-09-30T17:02:18.376387+0000","last_undegraded":"2023-09-30T17:02:18.376387+0000","last_fullsized":"2023-09-30T17:02:18.376387+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:55:33.944875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.363105+0000","last_change":"2023-09-30T17:02:18.359767+0000","last_active":"2023-09-30T17:02:18.363105+0000","last_peered":"2023-09-30T17:02:18.363105+0000","last_clean":"2023-09-30T17:02:18.363105+0000","last_became_active":"2023-09-30T17:02:18.356825+0000","last_became_peered":"2023-09-30T17:02:18.356825+0000","last_unstale":"2023-09-30T17:02:18.363105+0000","last_undegraded":"2023-09-30T17:02:18.363105+0000","last_fullsized":"2023-09-30T17:02:18.363105+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:47:52.129748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.377855+0000","last_change":"2023-09-30T17:02:17.355878+0000","last_active":"2023-09-30T17:02:18.377855+0000","last_peered":"2023-09-30T17:02:18.377855+0000","last_clean":"2023-09-30T17:02:18.377855+0000","last_became_active":"2023-09-30T17:02:17.355642+0000","last_became_peered":"2023-09-30T17:02:17.355642+0000","last_unstale":"2023-09-30T17:02:18.377855+0000","last_undegraded":"2023-09-30T17:02:18.377855+0000","last_fullsized":"2023-09-30T17:02:18.377855+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:04:48.294789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.377704+0000","last_change":"2023-09-30T17:02:18.375303+0000","last_active":"2023-09-30T17:02:18.377704+0000","last_peered":"2023-09-30T17:02:18.377704+0000","last_clean":"2023-09-30T17:02:18.377704+0000","last_became_active":"2023-09-30T17:02:18.373962+0000","last_became_peered":"2023-09-30T17:02:18.373962+0000","last_unstale":"2023-09-30T17:02:18.377704+0000","last_undegraded":"2023-09-30T17:02:18.377704+0000","last_fullsized":"2023-09-30T17:02:18.377704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:31:21.329390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.355123+0000","last_change":"2023-09-30T17:02:17.358126+0000","last_active":"2023-09-30T17:02:18.355123+0000","last_peered":"2023-09-30T17:02:18.355123+0000","last_clean":"2023-09-30T17:02:18.355123+0000","last_became_active":"2023-09-30T17:02:17.357621+0000","last_became_peered":"2023-09-30T17:02:17.357621+0000","last_unstale":"2023-09-30T17:02:18.355123+0000","last_undegraded":"2023-09-30T17:02:18.355123+0000","last_fullsized":"2023-09-30T17:02:18.355123+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:46:16.375239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.368727+0000","last_change":"2023-09-30T17:02:18.362399+0000","last_active":"2023-09-30T17:02:18.368727+0000","last_peered":"2023-09-30T17:02:18.368727+0000","last_clean":"2023-09-30T17:02:18.368727+0000","last_became_active":"2023-09-30T17:02:18.362173+0000","last_became_peered":"2023-09-30T17:02:18.362173+0000","last_unstale":"2023-09-30T17:02:18.368727+0000","last_undegraded":"2023-09-30T17:02:18.368727+0000","last_fullsized":"2023-09-30T17:02:18.368727+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:46:17.380869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.373243+0000","last_change":"2023-09-30T17:02:17.363567+0000","last_active":"2023-09-30T17:02:18.373243+0000","last_peered":"2023-09-30T17:02:18.373243+0000","last_clean":"2023-09-30T17:02:18.373243+0000","last_became_active":"2023-09-30T17:02:17.363254+0000","last_became_peered":"2023-09-30T17:02:17.363254+0000","last_unstale":"2023-09-30T17:02:18.373243+0000","last_undegraded":"2023-09-30T17:02:18.373243+0000","last_fullsized":"2023-09-30T17:02:18.373243+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:08:34.994215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.376912+0000","last_change":"2023-09-30T17:02:18.372346+0000","last_active":"2023-09-30T17:02:18.376912+0000","last_peered":"2023-09-30T17:02:18.376912+0000","last_clean":"2023-09-30T17:02:18.376912+0000","last_became_active":"2023-09-30T17:02:18.371542+0000","last_became_peered":"2023-09-30T17:02:18.371542+0000","last_unstale":"2023-09-30T17:02:18.376912+0000","last_undegraded":"2023-09-30T17:02:18.376912+0000","last_fullsized":"2023-09-30T17:02:18.376912+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:54:54.054186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.354857+0000","last_change":"2023-09-30T17:02:17.358658+0000","last_active":"2023-09-30T17:02:18.354857+0000","last_peered":"2023-09-30T17:02:18.354857+0000","last_clean":"2023-09-30T17:02:18.354857+0000","last_became_active":"2023-09-30T17:02:17.357738+0000","last_became_peered":"2023-09-30T17:02:17.357738+0000","last_unstale":"2023-09-30T17:02:18.354857+0000","last_undegraded":"2023-09-30T17:02:18.354857+0000","last_fullsized":"2023-09-30T17:02:18.354857+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:00:16.830342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.377287+0000","last_change":"2023-09-30T17:02:18.373854+0000","last_active":"2023-09-30T17:02:18.377287+0000","last_peered":"2023-09-30T17:02:18.377287+0000","last_clean":"2023-09-30T17:02:18.377287+0000","last_became_active":"2023-09-30T17:02:18.373315+0000","last_became_peered":"2023-09-30T17:02:18.373315+0000","last_unstale":"2023-09-30T17:02:18.377287+0000","last_undegraded":"2023-09-30T17:02:18.377287+0000","last_fullsized":"2023-09-30T17:02:18.377287+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:39:16.689300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.354594+0000","last_change":"2023-09-30T17:02:17.359738+0000","last_active":"2023-09-30T17:02:18.354594+0000","last_peered":"2023-09-30T17:02:18.354594+0000","last_clean":"2023-09-30T17:02:18.354594+0000","last_became_active":"2023-09-30T17:02:17.359424+0000","last_became_peered":"2023-09-30T17:02:17.359424+0000","last_unstale":"2023-09-30T17:02:18.354594+0000","last_undegraded":"2023-09-30T17:02:18.354594+0000","last_fullsized":"2023-09-30T17:02:18.354594+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:01:31.158446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.376045+0000","last_change":"2023-09-30T17:02:18.373068+0000","last_active":"2023-09-30T17:02:18.376045+0000","last_peered":"2023-09-30T17:02:18.376045+0000","last_clean":"2023-09-30T17:02:18.376045+0000","last_became_active":"2023-09-30T17:02:18.372739+0000","last_became_peered":"2023-09-30T17:02:18.372739+0000","last_unstale":"2023-09-30T17:02:18.376045+0000","last_undegraded":"2023-09-30T17:02:18.376045+0000","last_fullsized":"2023-09-30T17:02:18.376045+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:52:57.597536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.354340+0000","last_change":"2023-09-30T17:02:17.358811+0000","last_active":"2023-09-30T17:02:18.354340+0000","last_peered":"2023-09-30T17:02:18.354340+0000","last_clean":"2023-09-30T17:02:18.354340+0000","last_became_active":"2023-09-30T17:02:17.358582+0000","last_became_peered":"2023-09-30T17:02:17.358582+0000","last_unstale":"2023-09-30T17:02:18.354340+0000","last_undegraded":"2023-09-30T17:02:18.354340+0000","last_fullsized":"2023-09-30T17:02:18.354340+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:52:37.518693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.368954+0000","last_change":"2023-09-30T17:02:18.364478+0000","last_active":"2023-09-30T17:02:18.368954+0000","last_peered":"2023-09-30T17:02:18.368954+0000","last_clean":"2023-09-30T17:02:18.368954+0000","last_became_active":"2023-09-30T17:02:18.364057+0000","last_became_peered":"2023-09-30T17:02:18.364057+0000","last_unstale":"2023-09-30T17:02:18.368954+0000","last_undegraded":"2023-09-30T17:02:18.368954+0000","last_fullsized":"2023-09-30T17:02:18.368954+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:52:57.597536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T17:02:17.356696+0000","last_change":"2023-09-30T17:02:12.327704+0000","last_active":"2023-09-30T17:02:17.356696+0000","last_peered":"2023-09-30T17:02:17.356696+0000","last_clean":"2023-09-30T17:02:17.356696+0000","last_became_active":"2023-09-30T17:02:12.327384+0000","last_became_peered":"2023-09-30T17:02:12.327384+0000","last_unstale":"2023-09-30T17:02:17.356696+0000","last_undegraded":"2023-09-30T17:02:17.356696+0000","last_fullsized":"2023-09-30T17:02:17.356696+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:09:34.818252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.358659+0000","last_change":"2023-09-30T17:02:17.357321+0000","last_active":"2023-09-30T17:02:18.358659+0000","last_peered":"2023-09-30T17:02:18.358659+0000","last_clean":"2023-09-30T17:02:18.358659+0000","last_became_active":"2023-09-30T17:02:17.357105+0000","last_became_peered":"2023-09-30T17:02:17.357105+0000","last_unstale":"2023-09-30T17:02:18.358659+0000","last_undegraded":"2023-09-30T17:02:18.358659+0000","last_fullsized":"2023-09-30T17:02:18.358659+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:09:54.050468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.362625+0000","last_change":"2023-09-30T17:02:18.356537+0000","last_active":"2023-09-30T17:02:18.362625+0000","last_peered":"2023-09-30T17:02:18.362625+0000","last_clean":"2023-09-30T17:02:18.362625+0000","last_became_active":"2023-09-30T17:02:18.355641+0000","last_became_peered":"2023-09-30T17:02:18.355641+0000","last_unstale":"2023-09-30T17:02:18.362625+0000","last_undegraded":"2023-09-30T17:02:18.362625+0000","last_fullsized":"2023-09-30T17:02:18.362625+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:08:35.999844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T17:02:17.346285+0000","last_change":"2023-09-30T17:02:12.332417+0000","last_active":"2023-09-30T17:02:17.346285+0000","last_peered":"2023-09-30T17:02:17.346285+0000","last_clean":"2023-09-30T17:02:17.346285+0000","last_became_active":"2023-09-30T17:02:12.332124+0000","last_became_peered":"2023-09-30T17:02:12.332124+0000","last_unstale":"2023-09-30T17:02:17.346285+0000","last_undegraded":"2023-09-30T17:02:17.346285+0000","last_fullsized":"2023-09-30T17:02:17.346285+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:21:27.587948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.357136+0000","last_change":"2023-09-30T17:02:17.359029+0000","last_active":"2023-09-30T17:02:18.357136+0000","last_peered":"2023-09-30T17:02:18.357136+0000","last_clean":"2023-09-30T17:02:18.357136+0000","last_became_active":"2023-09-30T17:02:17.357931+0000","last_became_peered":"2023-09-30T17:02:17.357931+0000","last_unstale":"2023-09-30T17:02:18.357136+0000","last_undegraded":"2023-09-30T17:02:18.357136+0000","last_fullsized":"2023-09-30T17:02:18.357136+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:00:56.363835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.368808+0000","last_change":"2023-09-30T17:02:18.363399+0000","last_active":"2023-09-30T17:02:18.368808+0000","last_peered":"2023-09-30T17:02:18.368808+0000","last_clean":"2023-09-30T17:02:18.368808+0000","last_became_active":"2023-09-30T17:02:18.363064+0000","last_became_peered":"2023-09-30T17:02:18.363064+0000","last_unstale":"2023-09-30T17:02:18.368808+0000","last_undegraded":"2023-09-30T17:02:18.368808+0000","last_fullsized":"2023-09-30T17:02:18.368808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:19:51.155815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T17:02:17.356344+0000","last_change":"2023-09-30T17:02:12.327834+0000","last_active":"2023-09-30T17:02:17.356344+0000","last_peered":"2023-09-30T17:02:17.356344+0000","last_clean":"2023-09-30T17:02:17.356344+0000","last_became_active":"2023-09-30T17:02:12.327542+0000","last_became_peered":"2023-09-30T17:02:12.327542+0000","last_unstale":"2023-09-30T17:02:17.356344+0000","last_undegraded":"2023-09-30T17:02:17.356344+0000","last_fullsized":"2023-09-30T17:02:17.356344+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:49:54.890769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.354287+0000","last_change":"2023-09-30T17:02:17.363326+0000","last_active":"2023-09-30T17:02:18.354287+0000","last_peered":"2023-09-30T17:02:18.354287+0000","last_clean":"2023-09-30T17:02:18.354287+0000","last_became_active":"2023-09-30T17:02:17.362934+0000","last_became_peered":"2023-09-30T17:02:17.362934+0000","last_unstale":"2023-09-30T17:02:18.354287+0000","last_undegraded":"2023-09-30T17:02:18.354287+0000","last_fullsized":"2023-09-30T17:02:18.354287+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:24:04.564387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.368944+0000","last_change":"2023-09-30T17:02:18.364406+0000","last_active":"2023-09-30T17:02:18.368944+0000","last_peered":"2023-09-30T17:02:18.368944+0000","last_clean":"2023-09-30T17:02:18.368944+0000","last_became_active":"2023-09-30T17:02:18.363849+0000","last_became_peered":"2023-09-30T17:02:18.363849+0000","last_unstale":"2023-09-30T17:02:18.368944+0000","last_undegraded":"2023-09-30T17:02:18.368944+0000","last_fullsized":"2023-09-30T17:02:18.368944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:27:38.452037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T17:02:17.346366+0000","last_change":"2023-09-30T17:02:12.332542+0000","last_active":"2023-09-30T17:02:17.346366+0000","last_peered":"2023-09-30T17:02:17.346366+0000","last_clean":"2023-09-30T17:02:17.346366+0000","last_became_active":"2023-09-30T17:02:12.332132+0000","last_became_peered":"2023-09-30T17:02:12.332132+0000","last_unstale":"2023-09-30T17:02:17.346366+0000","last_undegraded":"2023-09-30T17:02:17.346366+0000","last_fullsized":"2023-09-30T17:02:17.346366+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:14:16.917130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":213,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T17:02:17.346249+0000","last_change":"2023-09-30T17:02:07.309872+0000","last_active":"2023-09-30T17:02:17.346249+0000","last_peered":"2023-09-30T17:02:17.346249+0000","last_clean":"2023-09-30T17:02:17.346249+0000","last_became_active":"2023-09-30T17:02:07.309630+0000","last_became_peered":"2023-09-30T17:02:07.309630+0000","last_unstale":"2023-09-30T17:02:17.346249+0000","last_undegraded":"2023-09-30T17:02:17.346249+0000","last_fullsized":"2023-09-30T17:02:17.346249+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:06.295501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:06.295501+0000","last_clean_scrub_stamp":"2023-09-30T17:02:06.295501+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:20:12.668818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.348174+0000","last_change":"2023-09-30T17:02:17.357139+0000","last_active":"2023-09-30T17:02:18.348174+0000","last_peered":"2023-09-30T17:02:18.348174+0000","last_clean":"2023-09-30T17:02:18.348174+0000","last_became_active":"2023-09-30T17:02:17.356901+0000","last_became_peered":"2023-09-30T17:02:17.356901+0000","last_unstale":"2023-09-30T17:02:18.348174+0000","last_undegraded":"2023-09-30T17:02:18.348174+0000","last_fullsized":"2023-09-30T17:02:18.348174+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:22:35.747671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.377245+0000","last_change":"2023-09-30T17:02:18.373627+0000","last_active":"2023-09-30T17:02:18.377245+0000","last_peered":"2023-09-30T17:02:18.377245+0000","last_clean":"2023-09-30T17:02:18.377245+0000","last_became_active":"2023-09-30T17:02:18.373275+0000","last_became_peered":"2023-09-30T17:02:18.373275+0000","last_unstale":"2023-09-30T17:02:18.377245+0000","last_undegraded":"2023-09-30T17:02:18.377245+0000","last_fullsized":"2023-09-30T17:02:18.377245+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:32:34.654264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T17:02:17.346367+0000","last_change":"2023-09-30T17:02:12.330129+0000","last_active":"2023-09-30T17:02:17.346367+0000","last_peered":"2023-09-30T17:02:17.346367+0000","last_clean":"2023-09-30T17:02:17.346367+0000","last_became_active":"2023-09-30T17:02:12.329863+0000","last_became_peered":"2023-09-30T17:02:12.329863+0000","last_unstale":"2023-09-30T17:02:17.346367+0000","last_undegraded":"2023-09-30T17:02:17.346367+0000","last_fullsized":"2023-09-30T17:02:17.346367+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:21:45.393691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.348060+0000","last_change":"2023-09-30T17:02:17.363398+0000","last_active":"2023-09-30T17:02:18.348060+0000","last_peered":"2023-09-30T17:02:18.348060+0000","last_clean":"2023-09-30T17:02:18.348060+0000","last_became_active":"2023-09-30T17:02:17.363086+0000","last_became_peered":"2023-09-30T17:02:17.363086+0000","last_unstale":"2023-09-30T17:02:18.348060+0000","last_undegraded":"2023-09-30T17:02:18.348060+0000","last_fullsized":"2023-09-30T17:02:18.348060+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:48:08.569937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.364728+0000","last_change":"2023-09-30T17:02:18.360029+0000","last_active":"2023-09-30T17:02:18.364728+0000","last_peered":"2023-09-30T17:02:18.364728+0000","last_clean":"2023-09-30T17:02:18.364728+0000","last_became_active":"2023-09-30T17:02:18.356839+0000","last_became_peered":"2023-09-30T17:02:18.356839+0000","last_unstale":"2023-09-30T17:02:18.364728+0000","last_undegraded":"2023-09-30T17:02:18.364728+0000","last_fullsized":"2023-09-30T17:02:18.364728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:22:36.753301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T17:02:17.353454+0000","last_change":"2023-09-30T17:02:12.330472+0000","last_active":"2023-09-30T17:02:17.353454+0000","last_peered":"2023-09-30T17:02:17.353454+0000","last_clean":"2023-09-30T17:02:17.353454+0000","last_became_active":"2023-09-30T17:02:12.330154+0000","last_became_peered":"2023-09-30T17:02:12.330154+0000","last_unstale":"2023-09-30T17:02:17.353454+0000","last_undegraded":"2023-09-30T17:02:17.353454+0000","last_fullsized":"2023-09-30T17:02:17.353454+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:43:23.161734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.349079+0000","last_change":"2023-09-30T17:02:17.361007+0000","last_active":"2023-09-30T17:02:18.349079+0000","last_peered":"2023-09-30T17:02:18.349079+0000","last_clean":"2023-09-30T17:02:18.349079+0000","last_became_active":"2023-09-30T17:02:17.360721+0000","last_became_peered":"2023-09-30T17:02:17.360721+0000","last_unstale":"2023-09-30T17:02:18.349079+0000","last_undegraded":"2023-09-30T17:02:18.349079+0000","last_fullsized":"2023-09-30T17:02:18.349079+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:13:41.205152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.365969+0000","last_change":"2023-09-30T17:02:18.364148+0000","last_active":"2023-09-30T17:02:18.365969+0000","last_peered":"2023-09-30T17:02:18.365969+0000","last_clean":"2023-09-30T17:02:18.365969+0000","last_became_active":"2023-09-30T17:02:18.363793+0000","last_became_peered":"2023-09-30T17:02:18.363793+0000","last_unstale":"2023-09-30T17:02:18.365969+0000","last_undegraded":"2023-09-30T17:02:18.365969+0000","last_fullsized":"2023-09-30T17:02:18.365969+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:23:06.065302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.364279+0000","last_change":"2023-09-30T17:02:17.360831+0000","last_active":"2023-09-30T17:02:18.364279+0000","last_peered":"2023-09-30T17:02:18.364279+0000","last_clean":"2023-09-30T17:02:18.364279+0000","last_became_active":"2023-09-30T17:02:17.360494+0000","last_became_peered":"2023-09-30T17:02:17.360494+0000","last_unstale":"2023-09-30T17:02:18.364279+0000","last_undegraded":"2023-09-30T17:02:18.364279+0000","last_fullsized":"2023-09-30T17:02:18.364279+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:24:04.564387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T17:02:17.356876+0000","last_change":"2023-09-30T17:02:12.328184+0000","last_active":"2023-09-30T17:02:17.356876+0000","last_peered":"2023-09-30T17:02:17.356876+0000","last_clean":"2023-09-30T17:02:17.356876+0000","last_became_active":"2023-09-30T17:02:12.327898+0000","last_became_peered":"2023-09-30T17:02:12.327898+0000","last_unstale":"2023-09-30T17:02:17.356876+0000","last_undegraded":"2023-09-30T17:02:17.356876+0000","last_fullsized":"2023-09-30T17:02:17.356876+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:43:23.161734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.368615+0000","last_change":"2023-09-30T17:02:18.361791+0000","last_active":"2023-09-30T17:02:18.368615+0000","last_peered":"2023-09-30T17:02:18.368615+0000","last_clean":"2023-09-30T17:02:18.368615+0000","last_became_active":"2023-09-30T17:02:18.361226+0000","last_became_peered":"2023-09-30T17:02:18.361226+0000","last_unstale":"2023-09-30T17:02:18.368615+0000","last_undegraded":"2023-09-30T17:02:18.368615+0000","last_fullsized":"2023-09-30T17:02:18.368615+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:48:38.968795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2023-09-30T17:02:17.346476+0000","last_change":"2023-09-30T17:02:12.330039+0000","last_active":"2023-09-30T17:02:17.346476+0000","last_peered":"2023-09-30T17:02:17.346476+0000","last_clean":"2023-09-30T17:02:17.346476+0000","last_became_active":"2023-09-30T17:02:12.329827+0000","last_became_peered":"2023-09-30T17:02:12.329827+0000","last_unstale":"2023-09-30T17:02:17.346476+0000","last_undegraded":"2023-09-30T17:02:17.346476+0000","last_fullsized":"2023-09-30T17:02:17.346476+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:21:09.449776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.349758+0000","last_change":"2023-09-30T17:02:17.364615+0000","last_active":"2023-09-30T17:02:18.349758+0000","last_peered":"2023-09-30T17:02:18.349758+0000","last_clean":"2023-09-30T17:02:18.349758+0000","last_became_active":"2023-09-30T17:02:17.364317+0000","last_became_peered":"2023-09-30T17:02:17.364317+0000","last_unstale":"2023-09-30T17:02:18.349758+0000","last_undegraded":"2023-09-30T17:02:18.349758+0000","last_fullsized":"2023-09-30T17:02:18.349758+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:52:37.518693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.361047+0000","last_change":"2023-09-30T17:02:18.356454+0000","last_active":"2023-09-30T17:02:18.361047+0000","last_peered":"2023-09-30T17:02:18.361047+0000","last_clean":"2023-09-30T17:02:18.361047+0000","last_became_active":"2023-09-30T17:02:18.355486+0000","last_became_peered":"2023-09-30T17:02:18.355486+0000","last_unstale":"2023-09-30T17:02:18.361047+0000","last_undegraded":"2023-09-30T17:02:18.361047+0000","last_fullsized":"2023-09-30T17:02:18.361047+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:19:51.155815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.373380+0000","last_change":"2023-09-30T17:02:17.363396+0000","last_active":"2023-09-30T17:02:18.373380+0000","last_peered":"2023-09-30T17:02:18.373380+0000","last_clean":"2023-09-30T17:02:18.373380+0000","last_became_active":"2023-09-30T17:02:17.363065+0000","last_became_peered":"2023-09-30T17:02:17.363065+0000","last_unstale":"2023-09-30T17:02:18.373380+0000","last_undegraded":"2023-09-30T17:02:18.373380+0000","last_fullsized":"2023-09-30T17:02:18.373380+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:09:59.154381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.362297+0000","last_change":"2023-09-30T17:02:18.358269+0000","last_active":"2023-09-30T17:02:18.362297+0000","last_peered":"2023-09-30T17:02:18.362297+0000","last_clean":"2023-09-30T17:02:18.362297+0000","last_became_active":"2023-09-30T17:02:18.356902+0000","last_became_peered":"2023-09-30T17:02:18.356902+0000","last_unstale":"2023-09-30T17:02:18.362297+0000","last_undegraded":"2023-09-30T17:02:18.362297+0000","last_fullsized":"2023-09-30T17:02:18.362297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:48:38.968795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.382589+0000","last_change":"2023-09-30T17:02:17.358568+0000","last_active":"2023-09-30T17:02:18.382589+0000","last_peered":"2023-09-30T17:02:18.382589+0000","last_clean":"2023-09-30T17:02:18.382589+0000","last_became_active":"2023-09-30T17:02:17.357763+0000","last_became_peered":"2023-09-30T17:02:17.357763+0000","last_unstale":"2023-09-30T17:02:18.382589+0000","last_undegraded":"2023-09-30T17:02:18.382589+0000","last_fullsized":"2023-09-30T17:02:18.382589+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:04:22.748557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.377880+0000","last_change":"2023-09-30T17:02:18.376236+0000","last_active":"2023-09-30T17:02:18.377880+0000","last_peered":"2023-09-30T17:02:18.377880+0000","last_clean":"2023-09-30T17:02:18.377880+0000","last_became_active":"2023-09-30T17:02:18.374853+0000","last_became_peered":"2023-09-30T17:02:18.374853+0000","last_unstale":"2023-09-30T17:02:18.377880+0000","last_undegraded":"2023-09-30T17:02:18.377880+0000","last_fullsized":"2023-09-30T17:02:18.377880+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:33:21.723864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.376746+0000","last_change":"2023-09-30T17:02:17.363358+0000","last_active":"2023-09-30T17:02:18.376746+0000","last_peered":"2023-09-30T17:02:18.376746+0000","last_clean":"2023-09-30T17:02:18.376746+0000","last_became_active":"2023-09-30T17:02:17.363003+0000","last_became_peered":"2023-09-30T17:02:17.363003+0000","last_unstale":"2023-09-30T17:02:18.376746+0000","last_undegraded":"2023-09-30T17:02:18.376746+0000","last_fullsized":"2023-09-30T17:02:18.376746+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:27:37.446407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.363619+0000","last_change":"2023-09-30T17:02:18.362117+0000","last_active":"2023-09-30T17:02:18.363619+0000","last_peered":"2023-09-30T17:02:18.363619+0000","last_clean":"2023-09-30T17:02:18.363619+0000","last_became_active":"2023-09-30T17:02:18.361463+0000","last_became_peered":"2023-09-30T17:02:18.361463+0000","last_unstale":"2023-09-30T17:02:18.363619+0000","last_undegraded":"2023-09-30T17:02:18.363619+0000","last_fullsized":"2023-09-30T17:02:18.363619+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:51:14.531522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.362710+0000","last_change":"2023-09-30T17:02:17.360802+0000","last_active":"2023-09-30T17:02:18.362710+0000","last_peered":"2023-09-30T17:02:18.362710+0000","last_clean":"2023-09-30T17:02:18.362710+0000","last_became_active":"2023-09-30T17:02:17.360475+0000","last_became_peered":"2023-09-30T17:02:17.360475+0000","last_unstale":"2023-09-30T17:02:18.362710+0000","last_undegraded":"2023-09-30T17:02:18.362710+0000","last_fullsized":"2023-09-30T17:02:18.362710+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:50:18.455188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.363398+0000","last_change":"2023-09-30T17:02:18.359857+0000","last_active":"2023-09-30T17:02:18.363398+0000","last_peered":"2023-09-30T17:02:18.363398+0000","last_clean":"2023-09-30T17:02:18.363398+0000","last_became_active":"2023-09-30T17:02:18.357098+0000","last_became_peered":"2023-09-30T17:02:18.357098+0000","last_unstale":"2023-09-30T17:02:18.363398+0000","last_undegraded":"2023-09-30T17:02:18.363398+0000","last_fullsized":"2023-09-30T17:02:18.363398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:51:14.531522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.373540+0000","last_change":"2023-09-30T17:02:17.364479+0000","last_active":"2023-09-30T17:02:18.373540+0000","last_peered":"2023-09-30T17:02:18.373540+0000","last_clean":"2023-09-30T17:02:18.373540+0000","last_became_active":"2023-09-30T17:02:17.364215+0000","last_became_peered":"2023-09-30T17:02:17.364215+0000","last_unstale":"2023-09-30T17:02:18.373540+0000","last_undegraded":"2023-09-30T17:02:18.373540+0000","last_fullsized":"2023-09-30T17:02:18.373540+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:01:31.158446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.377676+0000","last_change":"2023-09-30T17:02:18.375778+0000","last_active":"2023-09-30T17:02:18.377676+0000","last_peered":"2023-09-30T17:02:18.377676+0000","last_clean":"2023-09-30T17:02:18.377676+0000","last_became_active":"2023-09-30T17:02:18.374620+0000","last_became_peered":"2023-09-30T17:02:18.374620+0000","last_unstale":"2023-09-30T17:02:18.377676+0000","last_undegraded":"2023-09-30T17:02:18.377676+0000","last_fullsized":"2023-09-30T17:02:18.377676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:01:32.164075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.373941+0000","last_change":"2023-09-30T17:02:18.362804+0000","last_active":"2023-09-30T17:02:18.373941+0000","last_peered":"2023-09-30T17:02:18.373941+0000","last_clean":"2023-09-30T17:02:18.373941+0000","last_became_active":"2023-09-30T17:02:18.362392+0000","last_became_peered":"2023-09-30T17:02:18.362392+0000","last_unstale":"2023-09-30T17:02:18.373941+0000","last_undegraded":"2023-09-30T17:02:18.373941+0000","last_fullsized":"2023-09-30T17:02:18.373941+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:19:51.155815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.368818+0000","last_change":"2023-09-30T17:02:18.363479+0000","last_active":"2023-09-30T17:02:18.368818+0000","last_peered":"2023-09-30T17:02:18.368818+0000","last_clean":"2023-09-30T17:02:18.368818+0000","last_became_active":"2023-09-30T17:02:18.363222+0000","last_became_peered":"2023-09-30T17:02:18.363222+0000","last_unstale":"2023-09-30T17:02:18.368818+0000","last_undegraded":"2023-09-30T17:02:18.368818+0000","last_fullsized":"2023-09-30T17:02:18.368818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:00:17.835972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.365338+0000","last_change":"2023-09-30T17:02:18.362764+0000","last_active":"2023-09-30T17:02:18.365338+0000","last_peered":"2023-09-30T17:02:18.365338+0000","last_clean":"2023-09-30T17:02:18.365338+0000","last_became_active":"2023-09-30T17:02:18.362369+0000","last_became_peered":"2023-09-30T17:02:18.362369+0000","last_unstale":"2023-09-30T17:02:18.365338+0000","last_undegraded":"2023-09-30T17:02:18.365338+0000","last_fullsized":"2023-09-30T17:02:18.365338+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:01:30.269635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.368791+0000","last_change":"2023-09-30T17:02:18.363216+0000","last_active":"2023-09-30T17:02:18.368791+0000","last_peered":"2023-09-30T17:02:18.368791+0000","last_clean":"2023-09-30T17:02:18.368791+0000","last_became_active":"2023-09-30T17:02:18.362894+0000","last_became_peered":"2023-09-30T17:02:18.362894+0000","last_unstale":"2023-09-30T17:02:18.368791+0000","last_undegraded":"2023-09-30T17:02:18.368791+0000","last_fullsized":"2023-09-30T17:02:18.368791+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:23:06.065302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.361180+0000","last_change":"2023-09-30T17:02:18.356827+0000","last_active":"2023-09-30T17:02:18.361180+0000","last_peered":"2023-09-30T17:02:18.361180+0000","last_clean":"2023-09-30T17:02:18.361180+0000","last_became_active":"2023-09-30T17:02:18.355965+0000","last_became_peered":"2023-09-30T17:02:18.355965+0000","last_unstale":"2023-09-30T17:02:18.361180+0000","last_undegraded":"2023-09-30T17:02:18.361180+0000","last_fullsized":"2023-09-30T17:02:18.361180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:02:28.672156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738373,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27784,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344056,"statfs":{"total":96636764160,"available":96608313344,"internally_reserved":0,"allocated":782336,"data_stored":645872,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738373,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31936,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339904,"statfs":{"total":96636764160,"available":96604061696,"internally_reserved":0,"allocated":774144,"data_stored":645256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738373,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27180,"kb_used_data":160,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344660,"statfs":{"total":96636764160,"available":96608931840,"internally_reserved":0,"allocated":163840,"data_stored":53710,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56599999999999995}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T17:02:22.885 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-09-30T17:02:22.886 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-09-30T17:02:22.886 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-09-30T17:02:22.886 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-09-30T17:02:22.887 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-09-30T17:02:23.317 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:02:23.330 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":5,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6800","nonce":3566043304},{"type":"v1","addr":"172.21.15.7:6801","nonce":3566043304}]},"active_addr":"172.21.15.7:6801/3566043304","active_change":"2023-09-30T17:02:01.281530+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4099,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.3","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":2833663428}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":3760733398}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":623285781}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.7:0","nonce":2723087559}]}]} 2023-09-30T17:02:23.335 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-09-30T17:02:23.335 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-09-30T17:02:23.335 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T17:02:23.673 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:02:23.673 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":19,"fsid":"68daccc3-6ea9-4db7-9771-3803ff202df8","created":"2023-09-30T17:01:55.306262+0000","modified":"2023-09-30T17:02:19.350385+0000","last_up_change":"2023-09-30T17:02:04.210987+0000","last_in_change":"2023-09-30T17:01:56.571968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T17:02:05.343048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T17:02:11.033979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T17:02:15.583451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T17:02:16.734427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9d1653a-8830-4fad-911b-8e7221ee8697","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6801","nonce":2212861041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6803","nonce":2212861041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6807","nonce":2212861041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6805","nonce":2212861041}]},"public_addr":"172.21.15.31:6801/2212861041","cluster_addr":"172.21.15.31:6803/2212861041","heartbeat_back_addr":"172.21.15.31:6807/2212861041","heartbeat_front_addr":"172.21.15.31:6805/2212861041","state":["exists","up"]},{"osd":1,"uuid":"7123aa56-aa1a-43a4-b154-a40b4c70d169","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6801","nonce":1680420094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6803","nonce":1680420094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6807","nonce":1680420094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6805","nonce":1680420094}]},"public_addr":"172.21.15.72:6801/1680420094","cluster_addr":"172.21.15.72:6803/1680420094","heartbeat_back_addr":"172.21.15.72:6807/1680420094","heartbeat_front_addr":"172.21.15.72:6805/1680420094","state":["exists","up"]},{"osd":2,"uuid":"f40ee0d7-7bc3-4a46-bdac-9c134c55c907","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6801","nonce":1018866543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6803","nonce":1018866543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6807","nonce":1018866543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6805","nonce":1018866543}]},"public_addr":"172.21.15.134:6801/1018866543","cluster_addr":"172.21.15.134:6803/1018866543","heartbeat_back_addr":"172.21.15.134:6807/1018866543","heartbeat_front_addr":"172.21.15.134:6805/1018866543","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T17:02:01.702754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T17:02:01.688791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T17:02:01.667971+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T17:02:23.687 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-09-30T17:02:23.687 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T17:02:24.023 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:02:24.023 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":19,"fsid":"68daccc3-6ea9-4db7-9771-3803ff202df8","created":"2023-09-30T17:01:55.306262+0000","modified":"2023-09-30T17:02:19.350385+0000","last_up_change":"2023-09-30T17:02:04.210987+0000","last_in_change":"2023-09-30T17:01:56.571968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T17:02:05.343048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T17:02:11.033979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T17:02:15.583451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T17:02:16.734427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9d1653a-8830-4fad-911b-8e7221ee8697","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6801","nonce":2212861041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6803","nonce":2212861041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6807","nonce":2212861041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6805","nonce":2212861041}]},"public_addr":"172.21.15.31:6801/2212861041","cluster_addr":"172.21.15.31:6803/2212861041","heartbeat_back_addr":"172.21.15.31:6807/2212861041","heartbeat_front_addr":"172.21.15.31:6805/2212861041","state":["exists","up"]},{"osd":1,"uuid":"7123aa56-aa1a-43a4-b154-a40b4c70d169","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6801","nonce":1680420094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6803","nonce":1680420094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6807","nonce":1680420094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6805","nonce":1680420094}]},"public_addr":"172.21.15.72:6801/1680420094","cluster_addr":"172.21.15.72:6803/1680420094","heartbeat_back_addr":"172.21.15.72:6807/1680420094","heartbeat_front_addr":"172.21.15.72:6805/1680420094","state":["exists","up"]},{"osd":2,"uuid":"f40ee0d7-7bc3-4a46-bdac-9c134c55c907","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6801","nonce":1018866543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6803","nonce":1018866543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6807","nonce":1018866543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6805","nonce":1018866543}]},"public_addr":"172.21.15.134:6801/1018866543","cluster_addr":"172.21.15.134:6803/1018866543","heartbeat_back_addr":"172.21.15.134:6807/1018866543","heartbeat_front_addr":"172.21.15.134:6805/1018866543","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T17:02:01.702754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T17:02:01.688791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T17:02:01.667971+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T17:02:24.037 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-09-30T17:02:24.038 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-09-30T17:02:24.038 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-09-30T17:02:24.218 INFO:teuthology.orchestra.run.smithi007.stdout:34359738374 2023-09-30T17:02:24.219 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T17:02:24.222 INFO:teuthology.orchestra.run.smithi007.stdout:34359738374 2023-09-30T17:02:24.223 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T17:02:24.235 INFO:teuthology.orchestra.run.smithi007.stdout:34359738374 2023-09-30T17:02:24.236 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T17:02:24.573 INFO:teuthology.orchestra.run.smithi007.stdout:34359738373 2023-09-30T17:02:24.591 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738373 for osd.2 2023-09-30T17:02:24.635 INFO:teuthology.orchestra.run.smithi007.stdout:34359738373 2023-09-30T17:02:24.638 INFO:teuthology.orchestra.run.smithi007.stdout:34359738373 2023-09-30T17:02:24.651 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738373 for osd.1 2023-09-30T17:02:24.653 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738373 for osd.0 2023-09-30T17:02:25.592 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T17:02:25.652 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T17:02:25.653 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T17:02:25.961 INFO:teuthology.orchestra.run.smithi007.stdout:34359738373 2023-09-30T17:02:25.980 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738373 for osd.2 2023-09-30T17:02:26.017 INFO:teuthology.orchestra.run.smithi007.stdout:34359738373 2023-09-30T17:02:26.022 INFO:teuthology.orchestra.run.smithi007.stdout:34359738373 2023-09-30T17:02:26.033 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738373 for osd.1 2023-09-30T17:02:26.036 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738373 for osd.0 2023-09-30T17:02:26.981 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T17:02:27.034 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T17:02:27.038 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T17:02:27.347 INFO:teuthology.orchestra.run.smithi007.stdout:34359738375 2023-09-30T17:02:27.362 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738375 for osd.2 2023-09-30T17:02:27.362 DEBUG:teuthology.parallel:result is None 2023-09-30T17:02:27.395 INFO:teuthology.orchestra.run.smithi007.stdout:34359738375 2023-09-30T17:02:27.409 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738375 for osd.1 2023-09-30T17:02:27.409 DEBUG:teuthology.parallel:result is None 2023-09-30T17:02:27.435 INFO:teuthology.orchestra.run.smithi007.stdout:34359738375 2023-09-30T17:02:27.450 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738374 got 34359738375 for osd.0 2023-09-30T17:02:27.450 DEBUG:teuthology.parallel:result is None 2023-09-30T17:02:27.450 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-09-30T17:02:27.450 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T17:02:27.830 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:02:27.832 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-09-30T17:02:27.842 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-09-30T17:02:27.290688+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":86936,"kb_used_data":1704,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":283028584,"statfs":{"total":289910292480,"available":289821270016,"internally_reserved":0,"allocated":1744896,"data_stored":1358647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4781,"internal_metadata":87223635},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.944048"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.358721+0000","last_change":"2023-09-30T17:02:18.360288+0000","last_active":"2023-09-30T17:02:19.358721+0000","last_peered":"2023-09-30T17:02:19.358721+0000","last_clean":"2023-09-30T17:02:19.358721+0000","last_became_active":"2023-09-30T17:02:18.358716+0000","last_became_peered":"2023-09-30T17:02:18.358716+0000","last_unstale":"2023-09-30T17:02:19.358721+0000","last_undegraded":"2023-09-30T17:02:19.358721+0000","last_fullsized":"2023-09-30T17:02:19.358721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:12:06.380095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.358288+0000","last_change":"2023-09-30T17:02:18.362418+0000","last_active":"2023-09-30T17:02:19.358288+0000","last_peered":"2023-09-30T17:02:19.358288+0000","last_clean":"2023-09-30T17:02:19.358288+0000","last_became_active":"2023-09-30T17:02:18.360372+0000","last_became_peered":"2023-09-30T17:02:18.360372+0000","last_unstale":"2023-09-30T17:02:19.358288+0000","last_undegraded":"2023-09-30T17:02:19.358288+0000","last_fullsized":"2023-09-30T17:02:19.358288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:43:29.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357605+0000","last_change":"2023-09-30T17:02:18.373609+0000","last_active":"2023-09-30T17:02:19.357605+0000","last_peered":"2023-09-30T17:02:19.357605+0000","last_clean":"2023-09-30T17:02:19.357605+0000","last_became_active":"2023-09-30T17:02:18.372911+0000","last_became_peered":"2023-09-30T17:02:18.372911+0000","last_unstale":"2023-09-30T17:02:19.357605+0000","last_undegraded":"2023-09-30T17:02:19.357605+0000","last_fullsized":"2023-09-30T17:02:19.357605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:36:10.602697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357569+0000","last_change":"2023-09-30T17:02:18.377247+0000","last_active":"2023-09-30T17:02:19.357569+0000","last_peered":"2023-09-30T17:02:19.357569+0000","last_clean":"2023-09-30T17:02:19.357569+0000","last_became_active":"2023-09-30T17:02:18.376351+0000","last_became_peered":"2023-09-30T17:02:18.376351+0000","last_unstale":"2023-09-30T17:02:19.357569+0000","last_undegraded":"2023-09-30T17:02:19.357569+0000","last_fullsized":"2023-09-30T17:02:19.357569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:51:00.454897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357833+0000","last_change":"2023-09-30T17:02:18.360192+0000","last_active":"2023-09-30T17:02:19.357833+0000","last_peered":"2023-09-30T17:02:19.357833+0000","last_clean":"2023-09-30T17:02:19.357833+0000","last_became_active":"2023-09-30T17:02:18.357317+0000","last_became_peered":"2023-09-30T17:02:18.357317+0000","last_unstale":"2023-09-30T17:02:19.357833+0000","last_undegraded":"2023-09-30T17:02:19.357833+0000","last_fullsized":"2023-09-30T17:02:19.357833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:37:14.790993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.356993+0000","last_change":"2023-09-30T17:02:18.376076+0000","last_active":"2023-09-30T17:02:19.356993+0000","last_peered":"2023-09-30T17:02:19.356993+0000","last_clean":"2023-09-30T17:02:19.356993+0000","last_became_active":"2023-09-30T17:02:18.375107+0000","last_became_peered":"2023-09-30T17:02:18.375107+0000","last_unstale":"2023-09-30T17:02:19.356993+0000","last_undegraded":"2023-09-30T17:02:19.356993+0000","last_fullsized":"2023-09-30T17:02:19.356993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:21:45.195007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.356990+0000","last_change":"2023-09-30T17:02:18.360819+0000","last_active":"2023-09-30T17:02:19.356990+0000","last_peered":"2023-09-30T17:02:19.356990+0000","last_clean":"2023-09-30T17:02:19.356990+0000","last_became_active":"2023-09-30T17:02:18.360506+0000","last_became_peered":"2023-09-30T17:02:18.360506+0000","last_unstale":"2023-09-30T17:02:19.356990+0000","last_undegraded":"2023-09-30T17:02:19.356990+0000","last_fullsized":"2023-09-30T17:02:19.356990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:26:11.522402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.356352+0000","last_change":"2023-09-30T17:02:18.362003+0000","last_active":"2023-09-30T17:02:19.356352+0000","last_peered":"2023-09-30T17:02:19.356352+0000","last_clean":"2023-09-30T17:02:19.356352+0000","last_became_active":"2023-09-30T17:02:18.361644+0000","last_became_peered":"2023-09-30T17:02:18.361644+0000","last_unstale":"2023-09-30T17:02:19.356352+0000","last_undegraded":"2023-09-30T17:02:19.356352+0000","last_fullsized":"2023-09-30T17:02:19.356352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:48:17.598726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.364354+0000","last_change":"2023-09-30T17:02:18.364222+0000","last_active":"2023-09-30T17:02:19.364354+0000","last_peered":"2023-09-30T17:02:19.364354+0000","last_clean":"2023-09-30T17:02:19.364354+0000","last_became_active":"2023-09-30T17:02:18.363485+0000","last_became_peered":"2023-09-30T17:02:18.363485+0000","last_unstale":"2023-09-30T17:02:19.364354+0000","last_undegraded":"2023-09-30T17:02:19.364354+0000","last_fullsized":"2023-09-30T17:02:19.364354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:14:35.192615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.358415+0000","last_change":"2023-09-30T17:02:18.360010+0000","last_active":"2023-09-30T17:02:19.358415+0000","last_peered":"2023-09-30T17:02:19.358415+0000","last_clean":"2023-09-30T17:02:19.358415+0000","last_became_active":"2023-09-30T17:02:18.358396+0000","last_became_peered":"2023-09-30T17:02:18.358396+0000","last_unstale":"2023-09-30T17:02:19.358415+0000","last_undegraded":"2023-09-30T17:02:19.358415+0000","last_fullsized":"2023-09-30T17:02:19.358415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:26:11.522402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357494+0000","last_change":"2023-09-30T17:02:18.375829+0000","last_active":"2023-09-30T17:02:19.357494+0000","last_peered":"2023-09-30T17:02:19.357494+0000","last_clean":"2023-09-30T17:02:19.357494+0000","last_became_active":"2023-09-30T17:02:18.374447+0000","last_became_peered":"2023-09-30T17:02:18.374447+0000","last_unstale":"2023-09-30T17:02:19.357494+0000","last_undegraded":"2023-09-30T17:02:19.357494+0000","last_fullsized":"2023-09-30T17:02:19.357494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:02:46.638397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357284+0000","last_change":"2023-09-30T17:02:18.373777+0000","last_active":"2023-09-30T17:02:19.357284+0000","last_peered":"2023-09-30T17:02:19.357284+0000","last_clean":"2023-09-30T17:02:19.357284+0000","last_became_active":"2023-09-30T17:02:18.373434+0000","last_became_peered":"2023-09-30T17:02:18.373434+0000","last_unstale":"2023-09-30T17:02:19.357284+0000","last_undegraded":"2023-09-30T17:02:19.357284+0000","last_fullsized":"2023-09-30T17:02:19.357284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:13:30.688369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357496+0000","last_change":"2023-09-30T17:02:18.359894+0000","last_active":"2023-09-30T17:02:19.357496+0000","last_peered":"2023-09-30T17:02:19.357496+0000","last_clean":"2023-09-30T17:02:19.357496+0000","last_became_active":"2023-09-30T17:02:18.358534+0000","last_became_peered":"2023-09-30T17:02:18.358534+0000","last_unstale":"2023-09-30T17:02:19.357496+0000","last_undegraded":"2023-09-30T17:02:19.357496+0000","last_fullsized":"2023-09-30T17:02:19.357496+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:22:13.025181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.356892+0000","last_change":"2023-09-30T17:02:18.374094+0000","last_active":"2023-09-30T17:02:19.356892+0000","last_peered":"2023-09-30T17:02:19.356892+0000","last_clean":"2023-09-30T17:02:19.356892+0000","last_became_active":"2023-09-30T17:02:18.373165+0000","last_became_peered":"2023-09-30T17:02:18.373165+0000","last_unstale":"2023-09-30T17:02:19.356892+0000","last_undegraded":"2023-09-30T17:02:19.356892+0000","last_fullsized":"2023-09-30T17:02:19.356892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:13:55.555700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.356482+0000","last_change":"2023-09-30T17:02:18.372075+0000","last_active":"2023-09-30T17:02:19.356482+0000","last_peered":"2023-09-30T17:02:19.356482+0000","last_clean":"2023-09-30T17:02:19.356482+0000","last_became_active":"2023-09-30T17:02:18.371685+0000","last_became_peered":"2023-09-30T17:02:18.371685+0000","last_unstale":"2023-09-30T17:02:19.356482+0000","last_undegraded":"2023-09-30T17:02:19.356482+0000","last_fullsized":"2023-09-30T17:02:19.356482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:14:35.192615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.356801+0000","last_change":"2023-09-30T17:02:18.376370+0000","last_active":"2023-09-30T17:02:19.356801+0000","last_peered":"2023-09-30T17:02:19.356801+0000","last_clean":"2023-09-30T17:02:19.356801+0000","last_became_active":"2023-09-30T17:02:18.375027+0000","last_became_peered":"2023-09-30T17:02:18.375027+0000","last_unstale":"2023-09-30T17:02:19.356801+0000","last_undegraded":"2023-09-30T17:02:19.356801+0000","last_fullsized":"2023-09-30T17:02:19.356801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:43:29.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.364415+0000","last_change":"2023-09-30T17:02:18.364360+0000","last_active":"2023-09-30T17:02:19.364415+0000","last_peered":"2023-09-30T17:02:19.364415+0000","last_clean":"2023-09-30T17:02:19.364415+0000","last_became_active":"2023-09-30T17:02:18.363697+0000","last_became_peered":"2023-09-30T17:02:18.363697+0000","last_unstale":"2023-09-30T17:02:19.364415+0000","last_undegraded":"2023-09-30T17:02:19.364415+0000","last_fullsized":"2023-09-30T17:02:19.364415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:50:52.893768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.358560+0000","last_change":"2023-09-30T17:02:18.360320+0000","last_active":"2023-09-30T17:02:19.358560+0000","last_peered":"2023-09-30T17:02:19.358560+0000","last_clean":"2023-09-30T17:02:19.358560+0000","last_became_active":"2023-09-30T17:02:18.357184+0000","last_became_peered":"2023-09-30T17:02:18.357184+0000","last_unstale":"2023-09-30T17:02:19.358560+0000","last_undegraded":"2023-09-30T17:02:19.358560+0000","last_fullsized":"2023-09-30T17:02:19.358560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:21:45.195007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.364138+0000","last_change":"2023-09-30T17:02:18.363956+0000","last_active":"2023-09-30T17:02:19.364138+0000","last_peered":"2023-09-30T17:02:19.364138+0000","last_clean":"2023-09-30T17:02:19.364138+0000","last_became_active":"2023-09-30T17:02:18.363654+0000","last_became_peered":"2023-09-30T17:02:18.363654+0000","last_unstale":"2023-09-30T17:02:19.364138+0000","last_undegraded":"2023-09-30T17:02:19.364138+0000","last_fullsized":"2023-09-30T17:02:19.364138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:48:17.598726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357324+0000","last_change":"2023-09-30T17:02:18.377065+0000","last_active":"2023-09-30T17:02:19.357324+0000","last_peered":"2023-09-30T17:02:19.357324+0000","last_clean":"2023-09-30T17:02:19.357324+0000","last_became_active":"2023-09-30T17:02:18.375158+0000","last_became_peered":"2023-09-30T17:02:18.375158+0000","last_unstale":"2023-09-30T17:02:19.357324+0000","last_undegraded":"2023-09-30T17:02:19.357324+0000","last_fullsized":"2023-09-30T17:02:19.357324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:12:06.380095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357361+0000","last_change":"2023-09-30T17:02:18.376206+0000","last_active":"2023-09-30T17:02:19.357361+0000","last_peered":"2023-09-30T17:02:19.357361+0000","last_clean":"2023-09-30T17:02:19.357361+0000","last_became_active":"2023-09-30T17:02:18.374694+0000","last_became_peered":"2023-09-30T17:02:18.374694+0000","last_unstale":"2023-09-30T17:02:19.357361+0000","last_undegraded":"2023-09-30T17:02:19.357361+0000","last_fullsized":"2023-09-30T17:02:19.357361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:43:17.634140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357322+0000","last_change":"2023-09-30T17:02:18.362977+0000","last_active":"2023-09-30T17:02:19.357322+0000","last_peered":"2023-09-30T17:02:19.357322+0000","last_clean":"2023-09-30T17:02:19.357322+0000","last_became_active":"2023-09-30T17:02:18.362657+0000","last_became_peered":"2023-09-30T17:02:18.362657+0000","last_unstale":"2023-09-30T17:02:19.357322+0000","last_undegraded":"2023-09-30T17:02:19.357322+0000","last_fullsized":"2023-09-30T17:02:19.357322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:15:54.364571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.363751+0000","last_change":"2023-09-30T17:02:18.361158+0000","last_active":"2023-09-30T17:02:19.363751+0000","last_peered":"2023-09-30T17:02:19.363751+0000","last_clean":"2023-09-30T17:02:19.363751+0000","last_became_active":"2023-09-30T17:02:18.360840+0000","last_became_peered":"2023-09-30T17:02:18.360840+0000","last_unstale":"2023-09-30T17:02:19.363751+0000","last_undegraded":"2023-09-30T17:02:19.363751+0000","last_fullsized":"2023-09-30T17:02:19.363751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:22:13.025181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357297+0000","last_change":"2023-09-30T17:02:18.353938+0000","last_active":"2023-09-30T17:02:19.357297+0000","last_peered":"2023-09-30T17:02:19.357297+0000","last_clean":"2023-09-30T17:02:19.357297+0000","last_became_active":"2023-09-30T17:02:18.353632+0000","last_became_peered":"2023-09-30T17:02:18.353632+0000","last_unstale":"2023-09-30T17:02:19.357297+0000","last_undegraded":"2023-09-30T17:02:19.357297+0000","last_fullsized":"2023-09-30T17:02:19.357297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:09:55.056098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.358593+0000","last_change":"2023-09-30T17:02:18.360801+0000","last_active":"2023-09-30T17:02:19.358593+0000","last_peered":"2023-09-30T17:02:19.358593+0000","last_clean":"2023-09-30T17:02:19.358593+0000","last_became_active":"2023-09-30T17:02:18.358862+0000","last_became_peered":"2023-09-30T17:02:18.358862+0000","last_unstale":"2023-09-30T17:02:19.358593+0000","last_undegraded":"2023-09-30T17:02:19.358593+0000","last_fullsized":"2023-09-30T17:02:19.358593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:55:15.512558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.364354+0000","last_change":"2023-09-30T17:02:18.355710+0000","last_active":"2023-09-30T17:02:19.364354+0000","last_peered":"2023-09-30T17:02:19.364354+0000","last_clean":"2023-09-30T17:02:19.364354+0000","last_became_active":"2023-09-30T17:02:18.355423+0000","last_became_peered":"2023-09-30T17:02:18.355423+0000","last_unstale":"2023-09-30T17:02:19.364354+0000","last_undegraded":"2023-09-30T17:02:19.364354+0000","last_fullsized":"2023-09-30T17:02:19.364354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:39:28.022201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357840+0000","last_change":"2023-09-30T17:02:18.377164+0000","last_active":"2023-09-30T17:02:19.357840+0000","last_peered":"2023-09-30T17:02:19.357840+0000","last_clean":"2023-09-30T17:02:19.357840+0000","last_became_active":"2023-09-30T17:02:18.376425+0000","last_became_peered":"2023-09-30T17:02:18.376425+0000","last_unstale":"2023-09-30T17:02:19.357840+0000","last_undegraded":"2023-09-30T17:02:19.357840+0000","last_fullsized":"2023-09-30T17:02:19.357840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:20:53.357746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.294200+0000","last_change":"2023-09-30T17:02:17.358258+0000","last_active":"2023-09-30T17:02:19.294200+0000","last_peered":"2023-09-30T17:02:19.294200+0000","last_clean":"2023-09-30T17:02:19.294200+0000","last_became_active":"2023-09-30T17:02:17.357890+0000","last_became_peered":"2023-09-30T17:02:17.357890+0000","last_unstale":"2023-09-30T17:02:19.294200+0000","last_undegraded":"2023-09-30T17:02:19.294200+0000","last_fullsized":"2023-09-30T17:02:19.294200+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:52:56.591906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.358102+0000","last_change":"2023-09-30T17:02:18.358843+0000","last_active":"2023-09-30T17:02:19.358102+0000","last_peered":"2023-09-30T17:02:19.358102+0000","last_clean":"2023-09-30T17:02:19.358102+0000","last_became_active":"2023-09-30T17:02:18.357966+0000","last_became_peered":"2023-09-30T17:02:18.357966+0000","last_unstale":"2023-09-30T17:02:19.358102+0000","last_undegraded":"2023-09-30T17:02:19.358102+0000","last_fullsized":"2023-09-30T17:02:19.358102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:13:55.555700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293653+0000","last_change":"2023-09-30T17:02:17.363387+0000","last_active":"2023-09-30T17:02:19.293653+0000","last_peered":"2023-09-30T17:02:19.293653+0000","last_clean":"2023-09-30T17:02:19.293653+0000","last_became_active":"2023-09-30T17:02:17.363042+0000","last_became_peered":"2023-09-30T17:02:17.363042+0000","last_unstale":"2023-09-30T17:02:19.293653+0000","last_undegraded":"2023-09-30T17:02:19.293653+0000","last_fullsized":"2023-09-30T17:02:19.293653+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:38:57.098312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.364401+0000","last_change":"2023-09-30T17:02:18.355398+0000","last_active":"2023-09-30T17:02:19.364401+0000","last_peered":"2023-09-30T17:02:19.364401+0000","last_clean":"2023-09-30T17:02:19.364401+0000","last_became_active":"2023-09-30T17:02:18.355006+0000","last_became_peered":"2023-09-30T17:02:18.355006+0000","last_unstale":"2023-09-30T17:02:19.364401+0000","last_undegraded":"2023-09-30T17:02:19.364401+0000","last_fullsized":"2023-09-30T17:02:19.364401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:37:14.790993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293603+0000","last_change":"2023-09-30T17:02:17.361000+0000","last_active":"2023-09-30T17:02:19.293603+0000","last_peered":"2023-09-30T17:02:19.293603+0000","last_clean":"2023-09-30T17:02:19.293603+0000","last_became_active":"2023-09-30T17:02:17.360601+0000","last_became_peered":"2023-09-30T17:02:17.360601+0000","last_unstale":"2023-09-30T17:02:19.293603+0000","last_undegraded":"2023-09-30T17:02:19.293603+0000","last_fullsized":"2023-09-30T17:02:19.293603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:02:27.666526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.358593+0000","last_change":"2023-09-30T17:02:18.363570+0000","last_active":"2023-09-30T17:02:19.358593+0000","last_peered":"2023-09-30T17:02:19.358593+0000","last_clean":"2023-09-30T17:02:19.358593+0000","last_became_active":"2023-09-30T17:02:18.362961+0000","last_became_peered":"2023-09-30T17:02:18.362961+0000","last_unstale":"2023-09-30T17:02:19.358593+0000","last_undegraded":"2023-09-30T17:02:19.358593+0000","last_fullsized":"2023-09-30T17:02:19.358593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:38:15.747647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293949+0000","last_change":"2023-09-30T17:02:17.364672+0000","last_active":"2023-09-30T17:02:19.293949+0000","last_peered":"2023-09-30T17:02:19.293949+0000","last_clean":"2023-09-30T17:02:19.293949+0000","last_became_active":"2023-09-30T17:02:17.364279+0000","last_became_peered":"2023-09-30T17:02:17.364279+0000","last_unstale":"2023-09-30T17:02:19.293949+0000","last_undegraded":"2023-09-30T17:02:19.293949+0000","last_fullsized":"2023-09-30T17:02:19.293949+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:00:56.363835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.363255+0000","last_change":"2023-09-30T17:02:18.358841+0000","last_active":"2023-09-30T17:02:19.363255+0000","last_peered":"2023-09-30T17:02:19.363255+0000","last_clean":"2023-09-30T17:02:19.363255+0000","last_became_active":"2023-09-30T17:02:18.358529+0000","last_became_peered":"2023-09-30T17:02:18.358529+0000","last_unstale":"2023-09-30T17:02:19.363255+0000","last_undegraded":"2023-09-30T17:02:19.363255+0000","last_fullsized":"2023-09-30T17:02:19.363255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:15:54.364571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293818+0000","last_change":"2023-09-30T17:02:17.357998+0000","last_active":"2023-09-30T17:02:19.293818+0000","last_peered":"2023-09-30T17:02:19.293818+0000","last_clean":"2023-09-30T17:02:19.293818+0000","last_became_active":"2023-09-30T17:02:17.357653+0000","last_became_peered":"2023-09-30T17:02:17.357653+0000","last_unstale":"2023-09-30T17:02:19.293818+0000","last_undegraded":"2023-09-30T17:02:19.293818+0000","last_fullsized":"2023-09-30T17:02:19.293818+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:52:37.518693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.363934+0000","last_change":"2023-09-30T17:02:18.361155+0000","last_active":"2023-09-30T17:02:19.363934+0000","last_peered":"2023-09-30T17:02:19.363934+0000","last_clean":"2023-09-30T17:02:19.363934+0000","last_became_active":"2023-09-30T17:02:18.360825+0000","last_became_peered":"2023-09-30T17:02:18.360825+0000","last_unstale":"2023-09-30T17:02:19.363934+0000","last_undegraded":"2023-09-30T17:02:19.363934+0000","last_fullsized":"2023-09-30T17:02:19.363934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:39:16.689300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.294335+0000","last_change":"2023-09-30T17:02:17.363119+0000","last_active":"2023-09-30T17:02:19.294335+0000","last_peered":"2023-09-30T17:02:19.294335+0000","last_clean":"2023-09-30T17:02:19.294335+0000","last_became_active":"2023-09-30T17:02:17.362754+0000","last_became_peered":"2023-09-30T17:02:17.362754+0000","last_unstale":"2023-09-30T17:02:19.294335+0000","last_undegraded":"2023-09-30T17:02:19.294335+0000","last_fullsized":"2023-09-30T17:02:19.294335+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:00:56.363835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.363589+0000","last_change":"2023-09-30T17:02:18.359118+0000","last_active":"2023-09-30T17:02:19.363589+0000","last_peered":"2023-09-30T17:02:19.363589+0000","last_clean":"2023-09-30T17:02:19.363589+0000","last_became_active":"2023-09-30T17:02:18.358786+0000","last_became_peered":"2023-09-30T17:02:18.358786+0000","last_unstale":"2023-09-30T17:02:19.363589+0000","last_undegraded":"2023-09-30T17:02:19.363589+0000","last_fullsized":"2023-09-30T17:02:19.363589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:33:21.723864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293706+0000","last_change":"2023-09-30T17:02:17.355936+0000","last_active":"2023-09-30T17:02:19.293706+0000","last_peered":"2023-09-30T17:02:19.293706+0000","last_clean":"2023-09-30T17:02:19.293706+0000","last_became_active":"2023-09-30T17:02:17.355664+0000","last_became_peered":"2023-09-30T17:02:17.355664+0000","last_unstale":"2023-09-30T17:02:19.293706+0000","last_undegraded":"2023-09-30T17:02:19.293706+0000","last_fullsized":"2023-09-30T17:02:19.293706+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:11:46.248439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357021+0000","last_change":"2023-09-30T17:02:18.373330+0000","last_active":"2023-09-30T17:02:19.357021+0000","last_peered":"2023-09-30T17:02:19.357021+0000","last_clean":"2023-09-30T17:02:19.357021+0000","last_became_active":"2023-09-30T17:02:18.373004+0000","last_became_peered":"2023-09-30T17:02:18.373004+0000","last_unstale":"2023-09-30T17:02:19.357021+0000","last_undegraded":"2023-09-30T17:02:19.357021+0000","last_fullsized":"2023-09-30T17:02:19.357021+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:16:27.516884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293603+0000","last_change":"2023-09-30T17:02:17.359251+0000","last_active":"2023-09-30T17:02:19.293603+0000","last_peered":"2023-09-30T17:02:19.293603+0000","last_clean":"2023-09-30T17:02:19.293603+0000","last_became_active":"2023-09-30T17:02:17.358579+0000","last_became_peered":"2023-09-30T17:02:17.358579+0000","last_unstale":"2023-09-30T17:02:19.293603+0000","last_undegraded":"2023-09-30T17:02:19.293603+0000","last_fullsized":"2023-09-30T17:02:19.293603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:55:33.944875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357627+0000","last_change":"2023-09-30T17:02:18.360019+0000","last_active":"2023-09-30T17:02:19.357627+0000","last_peered":"2023-09-30T17:02:19.357627+0000","last_clean":"2023-09-30T17:02:19.357627+0000","last_became_active":"2023-09-30T17:02:18.358364+0000","last_became_peered":"2023-09-30T17:02:18.358364+0000","last_unstale":"2023-09-30T17:02:19.357627+0000","last_undegraded":"2023-09-30T17:02:19.357627+0000","last_fullsized":"2023-09-30T17:02:19.357627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:30:43.782165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293708+0000","last_change":"2023-09-30T17:02:17.363694+0000","last_active":"2023-09-30T17:02:19.293708+0000","last_peered":"2023-09-30T17:02:19.293708+0000","last_clean":"2023-09-30T17:02:19.293708+0000","last_became_active":"2023-09-30T17:02:17.363442+0000","last_became_peered":"2023-09-30T17:02:17.363442+0000","last_unstale":"2023-09-30T17:02:19.293708+0000","last_undegraded":"2023-09-30T17:02:19.293708+0000","last_fullsized":"2023-09-30T17:02:19.293708+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:19:19.997724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.358063+0000","last_change":"2023-09-30T17:02:18.362415+0000","last_active":"2023-09-30T17:02:19.358063+0000","last_peered":"2023-09-30T17:02:19.358063+0000","last_clean":"2023-09-30T17:02:19.358063+0000","last_became_active":"2023-09-30T17:02:18.361556+0000","last_became_peered":"2023-09-30T17:02:18.361556+0000","last_unstale":"2023-09-30T17:02:19.358063+0000","last_undegraded":"2023-09-30T17:02:19.358063+0000","last_fullsized":"2023-09-30T17:02:19.358063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:16:41.607547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.294127+0000","last_change":"2023-09-30T17:02:17.363369+0000","last_active":"2023-09-30T17:02:19.294127+0000","last_peered":"2023-09-30T17:02:19.294127+0000","last_clean":"2023-09-30T17:02:19.294127+0000","last_became_active":"2023-09-30T17:02:17.362925+0000","last_became_peered":"2023-09-30T17:02:17.362925+0000","last_unstale":"2023-09-30T17:02:19.294127+0000","last_undegraded":"2023-09-30T17:02:19.294127+0000","last_fullsized":"2023-09-30T17:02:19.294127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:50:18.455188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.364537+0000","last_change":"2023-09-30T17:02:18.356700+0000","last_active":"2023-09-30T17:02:19.364537+0000","last_peered":"2023-09-30T17:02:19.364537+0000","last_clean":"2023-09-30T17:02:19.364537+0000","last_became_active":"2023-09-30T17:02:18.356108+0000","last_became_peered":"2023-09-30T17:02:18.356108+0000","last_unstale":"2023-09-30T17:02:19.364537+0000","last_undegraded":"2023-09-30T17:02:19.364537+0000","last_fullsized":"2023-09-30T17:02:19.364537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:16:41.607547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293424+0000","last_change":"2023-09-30T17:02:17.355214+0000","last_active":"2023-09-30T17:02:19.293424+0000","last_peered":"2023-09-30T17:02:19.293424+0000","last_clean":"2023-09-30T17:02:19.293424+0000","last_became_active":"2023-09-30T17:02:17.354876+0000","last_became_peered":"2023-09-30T17:02:17.354876+0000","last_unstale":"2023-09-30T17:02:19.293424+0000","last_undegraded":"2023-09-30T17:02:19.293424+0000","last_fullsized":"2023-09-30T17:02:19.293424+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:13:41.205152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.364747+0000","last_change":"2023-09-30T17:02:18.356814+0000","last_active":"2023-09-30T17:02:19.364747+0000","last_peered":"2023-09-30T17:02:19.364747+0000","last_clean":"2023-09-30T17:02:19.364747+0000","last_became_active":"2023-09-30T17:02:18.356258+0000","last_became_peered":"2023-09-30T17:02:18.356258+0000","last_unstale":"2023-09-30T17:02:19.364747+0000","last_undegraded":"2023-09-30T17:02:19.364747+0000","last_fullsized":"2023-09-30T17:02:19.364747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:26:11.522402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293840+0000","last_change":"2023-09-30T17:02:17.355972+0000","last_active":"2023-09-30T17:02:19.293840+0000","last_peered":"2023-09-30T17:02:19.293840+0000","last_clean":"2023-09-30T17:02:19.293840+0000","last_became_active":"2023-09-30T17:02:17.355653+0000","last_became_peered":"2023-09-30T17:02:17.355653+0000","last_unstale":"2023-09-30T17:02:19.293840+0000","last_undegraded":"2023-09-30T17:02:19.293840+0000","last_fullsized":"2023-09-30T17:02:19.293840+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:27:37.446407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.356869+0000","last_change":"2023-09-30T17:02:18.355736+0000","last_active":"2023-09-30T17:02:19.356869+0000","last_peered":"2023-09-30T17:02:19.356869+0000","last_clean":"2023-09-30T17:02:19.356869+0000","last_became_active":"2023-09-30T17:02:18.355111+0000","last_became_peered":"2023-09-30T17:02:18.355111+0000","last_unstale":"2023-09-30T17:02:19.356869+0000","last_undegraded":"2023-09-30T17:02:19.356869+0000","last_fullsized":"2023-09-30T17:02:19.356869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:47:00.094303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.294406+0000","last_change":"2023-09-30T17:02:17.363514+0000","last_active":"2023-09-30T17:02:19.294406+0000","last_peered":"2023-09-30T17:02:19.294406+0000","last_clean":"2023-09-30T17:02:19.294406+0000","last_became_active":"2023-09-30T17:02:17.363124+0000","last_became_peered":"2023-09-30T17:02:17.363124+0000","last_unstale":"2023-09-30T17:02:19.294406+0000","last_undegraded":"2023-09-30T17:02:19.294406+0000","last_fullsized":"2023-09-30T17:02:19.294406+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:55:33.944875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357665+0000","last_change":"2023-09-30T17:02:18.359767+0000","last_active":"2023-09-30T17:02:19.357665+0000","last_peered":"2023-09-30T17:02:19.357665+0000","last_clean":"2023-09-30T17:02:19.357665+0000","last_became_active":"2023-09-30T17:02:18.356825+0000","last_became_peered":"2023-09-30T17:02:18.356825+0000","last_unstale":"2023-09-30T17:02:19.357665+0000","last_undegraded":"2023-09-30T17:02:19.357665+0000","last_fullsized":"2023-09-30T17:02:19.357665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:39:16.689300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293738+0000","last_change":"2023-09-30T17:02:17.355878+0000","last_active":"2023-09-30T17:02:19.293738+0000","last_peered":"2023-09-30T17:02:19.293738+0000","last_clean":"2023-09-30T17:02:19.293738+0000","last_became_active":"2023-09-30T17:02:17.355642+0000","last_became_peered":"2023-09-30T17:02:17.355642+0000","last_unstale":"2023-09-30T17:02:19.293738+0000","last_undegraded":"2023-09-30T17:02:19.293738+0000","last_fullsized":"2023-09-30T17:02:19.293738+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:04:48.294789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.356816+0000","last_change":"2023-09-30T17:02:18.375303+0000","last_active":"2023-09-30T17:02:19.356816+0000","last_peered":"2023-09-30T17:02:19.356816+0000","last_clean":"2023-09-30T17:02:19.356816+0000","last_became_active":"2023-09-30T17:02:18.373962+0000","last_became_peered":"2023-09-30T17:02:18.373962+0000","last_unstale":"2023-09-30T17:02:19.356816+0000","last_undegraded":"2023-09-30T17:02:19.356816+0000","last_fullsized":"2023-09-30T17:02:19.356816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:16:41.607547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293666+0000","last_change":"2023-09-30T17:02:17.358126+0000","last_active":"2023-09-30T17:02:19.293666+0000","last_peered":"2023-09-30T17:02:19.293666+0000","last_clean":"2023-09-30T17:02:19.293666+0000","last_became_active":"2023-09-30T17:02:17.357621+0000","last_became_peered":"2023-09-30T17:02:17.357621+0000","last_unstale":"2023-09-30T17:02:19.293666+0000","last_undegraded":"2023-09-30T17:02:19.293666+0000","last_fullsized":"2023-09-30T17:02:19.293666+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:46:16.375239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.364059+0000","last_change":"2023-09-30T17:02:18.362399+0000","last_active":"2023-09-30T17:02:19.364059+0000","last_peered":"2023-09-30T17:02:19.364059+0000","last_clean":"2023-09-30T17:02:19.364059+0000","last_became_active":"2023-09-30T17:02:18.362173+0000","last_became_peered":"2023-09-30T17:02:18.362173+0000","last_unstale":"2023-09-30T17:02:19.364059+0000","last_undegraded":"2023-09-30T17:02:19.364059+0000","last_fullsized":"2023-09-30T17:02:19.364059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:30:35.150981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293733+0000","last_change":"2023-09-30T17:02:17.363567+0000","last_active":"2023-09-30T17:02:19.293733+0000","last_peered":"2023-09-30T17:02:19.293733+0000","last_clean":"2023-09-30T17:02:19.293733+0000","last_became_active":"2023-09-30T17:02:17.363254+0000","last_became_peered":"2023-09-30T17:02:17.363254+0000","last_unstale":"2023-09-30T17:02:19.293733+0000","last_undegraded":"2023-09-30T17:02:19.293733+0000","last_fullsized":"2023-09-30T17:02:19.293733+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:08:34.994215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357037+0000","last_change":"2023-09-30T17:02:18.372346+0000","last_active":"2023-09-30T17:02:19.357037+0000","last_peered":"2023-09-30T17:02:19.357037+0000","last_clean":"2023-09-30T17:02:19.357037+0000","last_became_active":"2023-09-30T17:02:18.371542+0000","last_became_peered":"2023-09-30T17:02:18.371542+0000","last_unstale":"2023-09-30T17:02:19.357037+0000","last_undegraded":"2023-09-30T17:02:19.357037+0000","last_fullsized":"2023-09-30T17:02:19.357037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:55:15.512558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293510+0000","last_change":"2023-09-30T17:02:17.358658+0000","last_active":"2023-09-30T17:02:19.293510+0000","last_peered":"2023-09-30T17:02:19.293510+0000","last_clean":"2023-09-30T17:02:19.293510+0000","last_became_active":"2023-09-30T17:02:17.357738+0000","last_became_peered":"2023-09-30T17:02:17.357738+0000","last_unstale":"2023-09-30T17:02:19.293510+0000","last_undegraded":"2023-09-30T17:02:19.293510+0000","last_fullsized":"2023-09-30T17:02:19.293510+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:00:16.830342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357758+0000","last_change":"2023-09-30T17:02:18.373854+0000","last_active":"2023-09-30T17:02:19.357758+0000","last_peered":"2023-09-30T17:02:19.357758+0000","last_clean":"2023-09-30T17:02:19.357758+0000","last_became_active":"2023-09-30T17:02:18.373315+0000","last_became_peered":"2023-09-30T17:02:18.373315+0000","last_unstale":"2023-09-30T17:02:19.357758+0000","last_undegraded":"2023-09-30T17:02:19.357758+0000","last_fullsized":"2023-09-30T17:02:19.357758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:28:07.751219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.294114+0000","last_change":"2023-09-30T17:02:17.359738+0000","last_active":"2023-09-30T17:02:19.294114+0000","last_peered":"2023-09-30T17:02:19.294114+0000","last_clean":"2023-09-30T17:02:19.294114+0000","last_became_active":"2023-09-30T17:02:17.359424+0000","last_became_peered":"2023-09-30T17:02:17.359424+0000","last_unstale":"2023-09-30T17:02:19.294114+0000","last_undegraded":"2023-09-30T17:02:19.294114+0000","last_fullsized":"2023-09-30T17:02:19.294114+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:01:31.158446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357403+0000","last_change":"2023-09-30T17:02:18.373068+0000","last_active":"2023-09-30T17:02:19.357403+0000","last_peered":"2023-09-30T17:02:19.357403+0000","last_clean":"2023-09-30T17:02:19.357403+0000","last_became_active":"2023-09-30T17:02:18.372739+0000","last_became_peered":"2023-09-30T17:02:18.372739+0000","last_unstale":"2023-09-30T17:02:19.357403+0000","last_undegraded":"2023-09-30T17:02:19.357403+0000","last_fullsized":"2023-09-30T17:02:19.357403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:37:30.572488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.294090+0000","last_change":"2023-09-30T17:02:17.358811+0000","last_active":"2023-09-30T17:02:19.294090+0000","last_peered":"2023-09-30T17:02:19.294090+0000","last_clean":"2023-09-30T17:02:19.294090+0000","last_became_active":"2023-09-30T17:02:17.358582+0000","last_became_peered":"2023-09-30T17:02:17.358582+0000","last_unstale":"2023-09-30T17:02:19.294090+0000","last_undegraded":"2023-09-30T17:02:19.294090+0000","last_fullsized":"2023-09-30T17:02:19.294090+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:52:37.518693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.364541+0000","last_change":"2023-09-30T17:02:18.364478+0000","last_active":"2023-09-30T17:02:19.364541+0000","last_peered":"2023-09-30T17:02:19.364541+0000","last_clean":"2023-09-30T17:02:19.364541+0000","last_became_active":"2023-09-30T17:02:18.364057+0000","last_became_peered":"2023-09-30T17:02:18.364057+0000","last_unstale":"2023-09-30T17:02:19.364541+0000","last_undegraded":"2023-09-30T17:02:19.364541+0000","last_fullsized":"2023-09-30T17:02:19.364541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:13:55.555700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.348448+0000","last_change":"2023-09-30T17:02:12.327704+0000","last_active":"2023-09-30T17:02:18.348448+0000","last_peered":"2023-09-30T17:02:18.348448+0000","last_clean":"2023-09-30T17:02:18.348448+0000","last_became_active":"2023-09-30T17:02:12.327384+0000","last_became_peered":"2023-09-30T17:02:12.327384+0000","last_unstale":"2023-09-30T17:02:18.348448+0000","last_undegraded":"2023-09-30T17:02:18.348448+0000","last_fullsized":"2023-09-30T17:02:18.348448+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:09:34.818252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293774+0000","last_change":"2023-09-30T17:02:17.357321+0000","last_active":"2023-09-30T17:02:19.293774+0000","last_peered":"2023-09-30T17:02:19.293774+0000","last_clean":"2023-09-30T17:02:19.293774+0000","last_became_active":"2023-09-30T17:02:17.357105+0000","last_became_peered":"2023-09-30T17:02:17.357105+0000","last_unstale":"2023-09-30T17:02:19.293774+0000","last_undegraded":"2023-09-30T17:02:19.293774+0000","last_fullsized":"2023-09-30T17:02:19.293774+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:09:54.050468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357396+0000","last_change":"2023-09-30T17:02:18.356537+0000","last_active":"2023-09-30T17:02:19.357396+0000","last_peered":"2023-09-30T17:02:19.357396+0000","last_clean":"2023-09-30T17:02:19.357396+0000","last_became_active":"2023-09-30T17:02:18.355641+0000","last_became_peered":"2023-09-30T17:02:18.355641+0000","last_unstale":"2023-09-30T17:02:19.357396+0000","last_undegraded":"2023-09-30T17:02:19.357396+0000","last_fullsized":"2023-09-30T17:02:19.357396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:33:21.723864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.355403+0000","last_change":"2023-09-30T17:02:12.332417+0000","last_active":"2023-09-30T17:02:18.355403+0000","last_peered":"2023-09-30T17:02:18.355403+0000","last_clean":"2023-09-30T17:02:18.355403+0000","last_became_active":"2023-09-30T17:02:12.332124+0000","last_became_peered":"2023-09-30T17:02:12.332124+0000","last_unstale":"2023-09-30T17:02:18.355403+0000","last_undegraded":"2023-09-30T17:02:18.355403+0000","last_fullsized":"2023-09-30T17:02:18.355403+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:21:27.587948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293583+0000","last_change":"2023-09-30T17:02:17.359029+0000","last_active":"2023-09-30T17:02:19.293583+0000","last_peered":"2023-09-30T17:02:19.293583+0000","last_clean":"2023-09-30T17:02:19.293583+0000","last_became_active":"2023-09-30T17:02:17.357931+0000","last_became_peered":"2023-09-30T17:02:17.357931+0000","last_unstale":"2023-09-30T17:02:19.293583+0000","last_undegraded":"2023-09-30T17:02:19.293583+0000","last_fullsized":"2023-09-30T17:02:19.293583+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:00:56.363835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.363856+0000","last_change":"2023-09-30T17:02:18.363399+0000","last_active":"2023-09-30T17:02:19.363856+0000","last_peered":"2023-09-30T17:02:19.363856+0000","last_clean":"2023-09-30T17:02:19.363856+0000","last_became_active":"2023-09-30T17:02:18.363064+0000","last_became_peered":"2023-09-30T17:02:18.363064+0000","last_unstale":"2023-09-30T17:02:19.363856+0000","last_undegraded":"2023-09-30T17:02:19.363856+0000","last_fullsized":"2023-09-30T17:02:19.363856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:32:34.654264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.348157+0000","last_change":"2023-09-30T17:02:12.327834+0000","last_active":"2023-09-30T17:02:18.348157+0000","last_peered":"2023-09-30T17:02:18.348157+0000","last_clean":"2023-09-30T17:02:18.348157+0000","last_became_active":"2023-09-30T17:02:12.327542+0000","last_became_peered":"2023-09-30T17:02:12.327542+0000","last_unstale":"2023-09-30T17:02:18.348157+0000","last_undegraded":"2023-09-30T17:02:18.348157+0000","last_fullsized":"2023-09-30T17:02:18.348157+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:49:54.890769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.294077+0000","last_change":"2023-09-30T17:02:17.363326+0000","last_active":"2023-09-30T17:02:19.294077+0000","last_peered":"2023-09-30T17:02:19.294077+0000","last_clean":"2023-09-30T17:02:19.294077+0000","last_became_active":"2023-09-30T17:02:17.362934+0000","last_became_peered":"2023-09-30T17:02:17.362934+0000","last_unstale":"2023-09-30T17:02:19.294077+0000","last_undegraded":"2023-09-30T17:02:19.294077+0000","last_fullsized":"2023-09-30T17:02:19.294077+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:24:04.564387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.364712+0000","last_change":"2023-09-30T17:02:18.364406+0000","last_active":"2023-09-30T17:02:19.364712+0000","last_peered":"2023-09-30T17:02:19.364712+0000","last_clean":"2023-09-30T17:02:19.364712+0000","last_became_active":"2023-09-30T17:02:18.363849+0000","last_became_peered":"2023-09-30T17:02:18.363849+0000","last_unstale":"2023-09-30T17:02:19.364712+0000","last_undegraded":"2023-09-30T17:02:19.364712+0000","last_fullsized":"2023-09-30T17:02:19.364712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:43:29.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.357252+0000","last_change":"2023-09-30T17:02:12.332542+0000","last_active":"2023-09-30T17:02:18.357252+0000","last_peered":"2023-09-30T17:02:18.357252+0000","last_clean":"2023-09-30T17:02:18.357252+0000","last_became_active":"2023-09-30T17:02:12.332132+0000","last_became_peered":"2023-09-30T17:02:12.332132+0000","last_unstale":"2023-09-30T17:02:18.357252+0000","last_undegraded":"2023-09-30T17:02:18.357252+0000","last_fullsized":"2023-09-30T17:02:18.357252+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:14:16.917130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":214,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.355641+0000","last_change":"2023-09-30T17:02:07.309872+0000","last_active":"2023-09-30T17:02:18.355641+0000","last_peered":"2023-09-30T17:02:18.355641+0000","last_clean":"2023-09-30T17:02:18.355641+0000","last_became_active":"2023-09-30T17:02:07.309630+0000","last_became_peered":"2023-09-30T17:02:07.309630+0000","last_unstale":"2023-09-30T17:02:18.355641+0000","last_undegraded":"2023-09-30T17:02:18.355641+0000","last_fullsized":"2023-09-30T17:02:18.355641+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:06.295501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:06.295501+0000","last_clean_scrub_stamp":"2023-09-30T17:02:06.295501+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:20:12.668818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293686+0000","last_change":"2023-09-30T17:02:17.357139+0000","last_active":"2023-09-30T17:02:19.293686+0000","last_peered":"2023-09-30T17:02:19.293686+0000","last_clean":"2023-09-30T17:02:19.293686+0000","last_became_active":"2023-09-30T17:02:17.356901+0000","last_became_peered":"2023-09-30T17:02:17.356901+0000","last_unstale":"2023-09-30T17:02:19.293686+0000","last_undegraded":"2023-09-30T17:02:19.293686+0000","last_fullsized":"2023-09-30T17:02:19.293686+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:22:35.747671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357783+0000","last_change":"2023-09-30T17:02:18.373627+0000","last_active":"2023-09-30T17:02:19.357783+0000","last_peered":"2023-09-30T17:02:19.357783+0000","last_clean":"2023-09-30T17:02:19.357783+0000","last_became_active":"2023-09-30T17:02:18.373275+0000","last_became_peered":"2023-09-30T17:02:18.373275+0000","last_unstale":"2023-09-30T17:02:19.357783+0000","last_undegraded":"2023-09-30T17:02:19.357783+0000","last_fullsized":"2023-09-30T17:02:19.357783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:44:18.066167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.354175+0000","last_change":"2023-09-30T17:02:12.330129+0000","last_active":"2023-09-30T17:02:18.354175+0000","last_peered":"2023-09-30T17:02:18.354175+0000","last_clean":"2023-09-30T17:02:18.354175+0000","last_became_active":"2023-09-30T17:02:12.329863+0000","last_became_peered":"2023-09-30T17:02:12.329863+0000","last_unstale":"2023-09-30T17:02:18.354175+0000","last_undegraded":"2023-09-30T17:02:18.354175+0000","last_fullsized":"2023-09-30T17:02:18.354175+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:21:45.393691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293615+0000","last_change":"2023-09-30T17:02:17.363398+0000","last_active":"2023-09-30T17:02:19.293615+0000","last_peered":"2023-09-30T17:02:19.293615+0000","last_clean":"2023-09-30T17:02:19.293615+0000","last_became_active":"2023-09-30T17:02:17.363086+0000","last_became_peered":"2023-09-30T17:02:17.363086+0000","last_unstale":"2023-09-30T17:02:19.293615+0000","last_undegraded":"2023-09-30T17:02:19.293615+0000","last_fullsized":"2023-09-30T17:02:19.293615+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:48:08.569937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.358480+0000","last_change":"2023-09-30T17:02:18.360029+0000","last_active":"2023-09-30T17:02:19.358480+0000","last_peered":"2023-09-30T17:02:19.358480+0000","last_clean":"2023-09-30T17:02:19.358480+0000","last_became_active":"2023-09-30T17:02:18.356839+0000","last_became_peered":"2023-09-30T17:02:18.356839+0000","last_unstale":"2023-09-30T17:02:19.358480+0000","last_undegraded":"2023-09-30T17:02:19.358480+0000","last_fullsized":"2023-09-30T17:02:19.358480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:16:27.516884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.356756+0000","last_change":"2023-09-30T17:02:12.330472+0000","last_active":"2023-09-30T17:02:18.356756+0000","last_peered":"2023-09-30T17:02:18.356756+0000","last_clean":"2023-09-30T17:02:18.356756+0000","last_became_active":"2023-09-30T17:02:12.330154+0000","last_became_peered":"2023-09-30T17:02:12.330154+0000","last_unstale":"2023-09-30T17:02:18.356756+0000","last_undegraded":"2023-09-30T17:02:18.356756+0000","last_fullsized":"2023-09-30T17:02:18.356756+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:43:23.161734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293780+0000","last_change":"2023-09-30T17:02:17.361007+0000","last_active":"2023-09-30T17:02:19.293780+0000","last_peered":"2023-09-30T17:02:19.293780+0000","last_clean":"2023-09-30T17:02:19.293780+0000","last_became_active":"2023-09-30T17:02:17.360721+0000","last_became_peered":"2023-09-30T17:02:17.360721+0000","last_unstale":"2023-09-30T17:02:19.293780+0000","last_undegraded":"2023-09-30T17:02:19.293780+0000","last_fullsized":"2023-09-30T17:02:19.293780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:13:41.205152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357723+0000","last_change":"2023-09-30T17:02:18.364148+0000","last_active":"2023-09-30T17:02:19.357723+0000","last_peered":"2023-09-30T17:02:19.357723+0000","last_clean":"2023-09-30T17:02:19.357723+0000","last_became_active":"2023-09-30T17:02:18.363793+0000","last_became_peered":"2023-09-30T17:02:18.363793+0000","last_unstale":"2023-09-30T17:02:19.357723+0000","last_undegraded":"2023-09-30T17:02:19.357723+0000","last_fullsized":"2023-09-30T17:02:19.357723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:30:35.150981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293916+0000","last_change":"2023-09-30T17:02:17.360831+0000","last_active":"2023-09-30T17:02:19.293916+0000","last_peered":"2023-09-30T17:02:19.293916+0000","last_clean":"2023-09-30T17:02:19.293916+0000","last_became_active":"2023-09-30T17:02:17.360494+0000","last_became_peered":"2023-09-30T17:02:17.360494+0000","last_unstale":"2023-09-30T17:02:19.293916+0000","last_undegraded":"2023-09-30T17:02:19.293916+0000","last_fullsized":"2023-09-30T17:02:19.293916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:24:04.564387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.350218+0000","last_change":"2023-09-30T17:02:12.328184+0000","last_active":"2023-09-30T17:02:18.350218+0000","last_peered":"2023-09-30T17:02:18.350218+0000","last_clean":"2023-09-30T17:02:18.350218+0000","last_became_active":"2023-09-30T17:02:12.327898+0000","last_became_peered":"2023-09-30T17:02:12.327898+0000","last_unstale":"2023-09-30T17:02:18.350218+0000","last_undegraded":"2023-09-30T17:02:18.350218+0000","last_fullsized":"2023-09-30T17:02:18.350218+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:43:23.161734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.363242+0000","last_change":"2023-09-30T17:02:18.361791+0000","last_active":"2023-09-30T17:02:19.363242+0000","last_peered":"2023-09-30T17:02:19.363242+0000","last_clean":"2023-09-30T17:02:19.363242+0000","last_became_active":"2023-09-30T17:02:18.361226+0000","last_became_peered":"2023-09-30T17:02:18.361226+0000","last_unstale":"2023-09-30T17:02:19.363242+0000","last_undegraded":"2023-09-30T17:02:19.363242+0000","last_fullsized":"2023-09-30T17:02:19.363242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:13:30.688369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.356790+0000","last_change":"2023-09-30T17:02:12.330039+0000","last_active":"2023-09-30T17:02:18.356790+0000","last_peered":"2023-09-30T17:02:18.356790+0000","last_clean":"2023-09-30T17:02:18.356790+0000","last_became_active":"2023-09-30T17:02:12.329827+0000","last_became_peered":"2023-09-30T17:02:12.329827+0000","last_unstale":"2023-09-30T17:02:18.356790+0000","last_undegraded":"2023-09-30T17:02:18.356790+0000","last_fullsized":"2023-09-30T17:02:18.356790+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:21:09.449776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.364463+0000","last_change":"2023-09-30T17:02:17.364615+0000","last_active":"2023-09-30T17:02:19.364463+0000","last_peered":"2023-09-30T17:02:19.364463+0000","last_clean":"2023-09-30T17:02:19.364463+0000","last_became_active":"2023-09-30T17:02:17.364317+0000","last_became_peered":"2023-09-30T17:02:17.364317+0000","last_unstale":"2023-09-30T17:02:19.364463+0000","last_undegraded":"2023-09-30T17:02:19.364463+0000","last_fullsized":"2023-09-30T17:02:19.364463+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:52:37.518693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357528+0000","last_change":"2023-09-30T17:02:18.356454+0000","last_active":"2023-09-30T17:02:19.357528+0000","last_peered":"2023-09-30T17:02:19.357528+0000","last_clean":"2023-09-30T17:02:19.357528+0000","last_became_active":"2023-09-30T17:02:18.355486+0000","last_became_peered":"2023-09-30T17:02:18.355486+0000","last_unstale":"2023-09-30T17:02:19.357528+0000","last_undegraded":"2023-09-30T17:02:19.357528+0000","last_fullsized":"2023-09-30T17:02:19.357528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:32:34.654264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.294253+0000","last_change":"2023-09-30T17:02:17.363396+0000","last_active":"2023-09-30T17:02:19.294253+0000","last_peered":"2023-09-30T17:02:19.294253+0000","last_clean":"2023-09-30T17:02:19.294253+0000","last_became_active":"2023-09-30T17:02:17.363065+0000","last_became_peered":"2023-09-30T17:02:17.363065+0000","last_unstale":"2023-09-30T17:02:19.294253+0000","last_undegraded":"2023-09-30T17:02:19.294253+0000","last_fullsized":"2023-09-30T17:02:19.294253+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:09:59.154381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357795+0000","last_change":"2023-09-30T17:02:18.358269+0000","last_active":"2023-09-30T17:02:19.357795+0000","last_peered":"2023-09-30T17:02:19.357795+0000","last_clean":"2023-09-30T17:02:19.357795+0000","last_became_active":"2023-09-30T17:02:18.356902+0000","last_became_peered":"2023-09-30T17:02:18.356902+0000","last_unstale":"2023-09-30T17:02:19.357795+0000","last_undegraded":"2023-09-30T17:02:19.357795+0000","last_fullsized":"2023-09-30T17:02:19.357795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:39:28.022201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293693+0000","last_change":"2023-09-30T17:02:17.358568+0000","last_active":"2023-09-30T17:02:19.293693+0000","last_peered":"2023-09-30T17:02:19.293693+0000","last_clean":"2023-09-30T17:02:19.293693+0000","last_became_active":"2023-09-30T17:02:17.357763+0000","last_became_peered":"2023-09-30T17:02:17.357763+0000","last_unstale":"2023-09-30T17:02:19.293693+0000","last_undegraded":"2023-09-30T17:02:19.293693+0000","last_fullsized":"2023-09-30T17:02:19.293693+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:04:22.748557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357224+0000","last_change":"2023-09-30T17:02:18.376236+0000","last_active":"2023-09-30T17:02:19.357224+0000","last_peered":"2023-09-30T17:02:19.357224+0000","last_clean":"2023-09-30T17:02:19.357224+0000","last_became_active":"2023-09-30T17:02:18.374853+0000","last_became_peered":"2023-09-30T17:02:18.374853+0000","last_unstale":"2023-09-30T17:02:19.357224+0000","last_undegraded":"2023-09-30T17:02:19.357224+0000","last_fullsized":"2023-09-30T17:02:19.357224+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:38:15.747647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.294354+0000","last_change":"2023-09-30T17:02:17.363358+0000","last_active":"2023-09-30T17:02:19.294354+0000","last_peered":"2023-09-30T17:02:19.294354+0000","last_clean":"2023-09-30T17:02:19.294354+0000","last_became_active":"2023-09-30T17:02:17.363003+0000","last_became_peered":"2023-09-30T17:02:17.363003+0000","last_unstale":"2023-09-30T17:02:19.294354+0000","last_undegraded":"2023-09-30T17:02:19.294354+0000","last_fullsized":"2023-09-30T17:02:19.294354+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:27:37.446407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.356604+0000","last_change":"2023-09-30T17:02:18.362117+0000","last_active":"2023-09-30T17:02:19.356604+0000","last_peered":"2023-09-30T17:02:19.356604+0000","last_clean":"2023-09-30T17:02:19.356604+0000","last_became_active":"2023-09-30T17:02:18.361463+0000","last_became_peered":"2023-09-30T17:02:18.361463+0000","last_unstale":"2023-09-30T17:02:19.356604+0000","last_undegraded":"2023-09-30T17:02:19.356604+0000","last_fullsized":"2023-09-30T17:02:19.356604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:37:14.790993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293869+0000","last_change":"2023-09-30T17:02:17.360802+0000","last_active":"2023-09-30T17:02:19.293869+0000","last_peered":"2023-09-30T17:02:19.293869+0000","last_clean":"2023-09-30T17:02:19.293869+0000","last_became_active":"2023-09-30T17:02:17.360475+0000","last_became_peered":"2023-09-30T17:02:17.360475+0000","last_unstale":"2023-09-30T17:02:19.293869+0000","last_undegraded":"2023-09-30T17:02:19.293869+0000","last_fullsized":"2023-09-30T17:02:19.293869+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:50:18.455188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357745+0000","last_change":"2023-09-30T17:02:18.359857+0000","last_active":"2023-09-30T17:02:19.357745+0000","last_peered":"2023-09-30T17:02:19.357745+0000","last_clean":"2023-09-30T17:02:19.357745+0000","last_became_active":"2023-09-30T17:02:18.357098+0000","last_became_peered":"2023-09-30T17:02:18.357098+0000","last_unstale":"2023-09-30T17:02:19.357745+0000","last_undegraded":"2023-09-30T17:02:19.357745+0000","last_fullsized":"2023-09-30T17:02:19.357745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:48:17.598726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293936+0000","last_change":"2023-09-30T17:02:17.364479+0000","last_active":"2023-09-30T17:02:19.293936+0000","last_peered":"2023-09-30T17:02:19.293936+0000","last_clean":"2023-09-30T17:02:19.293936+0000","last_became_active":"2023-09-30T17:02:17.364215+0000","last_became_peered":"2023-09-30T17:02:17.364215+0000","last_unstale":"2023-09-30T17:02:19.293936+0000","last_undegraded":"2023-09-30T17:02:19.293936+0000","last_fullsized":"2023-09-30T17:02:19.293936+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:01:31.158446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.356645+0000","last_change":"2023-09-30T17:02:18.375778+0000","last_active":"2023-09-30T17:02:19.356645+0000","last_peered":"2023-09-30T17:02:19.356645+0000","last_clean":"2023-09-30T17:02:19.356645+0000","last_became_active":"2023-09-30T17:02:18.374620+0000","last_became_peered":"2023-09-30T17:02:18.374620+0000","last_unstale":"2023-09-30T17:02:19.356645+0000","last_undegraded":"2023-09-30T17:02:19.356645+0000","last_fullsized":"2023-09-30T17:02:19.356645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:50:52.893768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.356459+0000","last_change":"2023-09-30T17:02:18.362804+0000","last_active":"2023-09-30T17:02:19.356459+0000","last_peered":"2023-09-30T17:02:19.356459+0000","last_clean":"2023-09-30T17:02:19.356459+0000","last_became_active":"2023-09-30T17:02:18.362392+0000","last_became_peered":"2023-09-30T17:02:18.362392+0000","last_unstale":"2023-09-30T17:02:19.356459+0000","last_undegraded":"2023-09-30T17:02:19.356459+0000","last_fullsized":"2023-09-30T17:02:19.356459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:39:28.022201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.363559+0000","last_change":"2023-09-30T17:02:18.363479+0000","last_active":"2023-09-30T17:02:19.363559+0000","last_peered":"2023-09-30T17:02:19.363559+0000","last_clean":"2023-09-30T17:02:19.363559+0000","last_became_active":"2023-09-30T17:02:18.363222+0000","last_became_peered":"2023-09-30T17:02:18.363222+0000","last_unstale":"2023-09-30T17:02:19.363559+0000","last_undegraded":"2023-09-30T17:02:19.363559+0000","last_fullsized":"2023-09-30T17:02:19.363559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:09:55.056098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357778+0000","last_change":"2023-09-30T17:02:18.362764+0000","last_active":"2023-09-30T17:02:19.357778+0000","last_peered":"2023-09-30T17:02:19.357778+0000","last_clean":"2023-09-30T17:02:19.357778+0000","last_became_active":"2023-09-30T17:02:18.362369+0000","last_became_peered":"2023-09-30T17:02:18.362369+0000","last_unstale":"2023-09-30T17:02:19.357778+0000","last_undegraded":"2023-09-30T17:02:19.357778+0000","last_fullsized":"2023-09-30T17:02:19.357778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:14:35.192615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.363865+0000","last_change":"2023-09-30T17:02:18.363216+0000","last_active":"2023-09-30T17:02:19.363865+0000","last_peered":"2023-09-30T17:02:19.363865+0000","last_clean":"2023-09-30T17:02:19.363865+0000","last_became_active":"2023-09-30T17:02:18.362894+0000","last_became_peered":"2023-09-30T17:02:18.362894+0000","last_unstale":"2023-09-30T17:02:19.363865+0000","last_undegraded":"2023-09-30T17:02:19.363865+0000","last_fullsized":"2023-09-30T17:02:19.363865+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:30:43.782165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357920+0000","last_change":"2023-09-30T17:02:18.356827+0000","last_active":"2023-09-30T17:02:19.357920+0000","last_peered":"2023-09-30T17:02:19.357920+0000","last_clean":"2023-09-30T17:02:19.357920+0000","last_became_active":"2023-09-30T17:02:18.355965+0000","last_became_peered":"2023-09-30T17:02:18.355965+0000","last_unstale":"2023-09-30T17:02:19.357920+0000","last_undegraded":"2023-09-30T17:02:19.357920+0000","last_fullsized":"2023-09-30T17:02:19.357920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:50:52.893768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738375,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":790528,"data_stored":650475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":782336,"data_stored":649859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":172032,"data_stored":58313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T17:02:27.848 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T17:02:28.223 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:02:28.224 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-09-30T17:02:28.234 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2023-09-30T17:02:27.290688+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":86936,"kb_used_data":1704,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":283028584,"statfs":{"total":289910292480,"available":289821270016,"internally_reserved":0,"allocated":1744896,"data_stored":1358647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4781,"internal_metadata":87223635},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.944048"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.358721+0000","last_change":"2023-09-30T17:02:18.360288+0000","last_active":"2023-09-30T17:02:19.358721+0000","last_peered":"2023-09-30T17:02:19.358721+0000","last_clean":"2023-09-30T17:02:19.358721+0000","last_became_active":"2023-09-30T17:02:18.358716+0000","last_became_peered":"2023-09-30T17:02:18.358716+0000","last_unstale":"2023-09-30T17:02:19.358721+0000","last_undegraded":"2023-09-30T17:02:19.358721+0000","last_fullsized":"2023-09-30T17:02:19.358721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:12:06.380095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.358288+0000","last_change":"2023-09-30T17:02:18.362418+0000","last_active":"2023-09-30T17:02:19.358288+0000","last_peered":"2023-09-30T17:02:19.358288+0000","last_clean":"2023-09-30T17:02:19.358288+0000","last_became_active":"2023-09-30T17:02:18.360372+0000","last_became_peered":"2023-09-30T17:02:18.360372+0000","last_unstale":"2023-09-30T17:02:19.358288+0000","last_undegraded":"2023-09-30T17:02:19.358288+0000","last_fullsized":"2023-09-30T17:02:19.358288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:43:29.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357605+0000","last_change":"2023-09-30T17:02:18.373609+0000","last_active":"2023-09-30T17:02:19.357605+0000","last_peered":"2023-09-30T17:02:19.357605+0000","last_clean":"2023-09-30T17:02:19.357605+0000","last_became_active":"2023-09-30T17:02:18.372911+0000","last_became_peered":"2023-09-30T17:02:18.372911+0000","last_unstale":"2023-09-30T17:02:19.357605+0000","last_undegraded":"2023-09-30T17:02:19.357605+0000","last_fullsized":"2023-09-30T17:02:19.357605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:36:10.602697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357569+0000","last_change":"2023-09-30T17:02:18.377247+0000","last_active":"2023-09-30T17:02:19.357569+0000","last_peered":"2023-09-30T17:02:19.357569+0000","last_clean":"2023-09-30T17:02:19.357569+0000","last_became_active":"2023-09-30T17:02:18.376351+0000","last_became_peered":"2023-09-30T17:02:18.376351+0000","last_unstale":"2023-09-30T17:02:19.357569+0000","last_undegraded":"2023-09-30T17:02:19.357569+0000","last_fullsized":"2023-09-30T17:02:19.357569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:51:00.454897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357833+0000","last_change":"2023-09-30T17:02:18.360192+0000","last_active":"2023-09-30T17:02:19.357833+0000","last_peered":"2023-09-30T17:02:19.357833+0000","last_clean":"2023-09-30T17:02:19.357833+0000","last_became_active":"2023-09-30T17:02:18.357317+0000","last_became_peered":"2023-09-30T17:02:18.357317+0000","last_unstale":"2023-09-30T17:02:19.357833+0000","last_undegraded":"2023-09-30T17:02:19.357833+0000","last_fullsized":"2023-09-30T17:02:19.357833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:37:14.790993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.356993+0000","last_change":"2023-09-30T17:02:18.376076+0000","last_active":"2023-09-30T17:02:19.356993+0000","last_peered":"2023-09-30T17:02:19.356993+0000","last_clean":"2023-09-30T17:02:19.356993+0000","last_became_active":"2023-09-30T17:02:18.375107+0000","last_became_peered":"2023-09-30T17:02:18.375107+0000","last_unstale":"2023-09-30T17:02:19.356993+0000","last_undegraded":"2023-09-30T17:02:19.356993+0000","last_fullsized":"2023-09-30T17:02:19.356993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:21:45.195007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.356990+0000","last_change":"2023-09-30T17:02:18.360819+0000","last_active":"2023-09-30T17:02:19.356990+0000","last_peered":"2023-09-30T17:02:19.356990+0000","last_clean":"2023-09-30T17:02:19.356990+0000","last_became_active":"2023-09-30T17:02:18.360506+0000","last_became_peered":"2023-09-30T17:02:18.360506+0000","last_unstale":"2023-09-30T17:02:19.356990+0000","last_undegraded":"2023-09-30T17:02:19.356990+0000","last_fullsized":"2023-09-30T17:02:19.356990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:26:11.522402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.356352+0000","last_change":"2023-09-30T17:02:18.362003+0000","last_active":"2023-09-30T17:02:19.356352+0000","last_peered":"2023-09-30T17:02:19.356352+0000","last_clean":"2023-09-30T17:02:19.356352+0000","last_became_active":"2023-09-30T17:02:18.361644+0000","last_became_peered":"2023-09-30T17:02:18.361644+0000","last_unstale":"2023-09-30T17:02:19.356352+0000","last_undegraded":"2023-09-30T17:02:19.356352+0000","last_fullsized":"2023-09-30T17:02:19.356352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:48:17.598726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.364354+0000","last_change":"2023-09-30T17:02:18.364222+0000","last_active":"2023-09-30T17:02:19.364354+0000","last_peered":"2023-09-30T17:02:19.364354+0000","last_clean":"2023-09-30T17:02:19.364354+0000","last_became_active":"2023-09-30T17:02:18.363485+0000","last_became_peered":"2023-09-30T17:02:18.363485+0000","last_unstale":"2023-09-30T17:02:19.364354+0000","last_undegraded":"2023-09-30T17:02:19.364354+0000","last_fullsized":"2023-09-30T17:02:19.364354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:14:35.192615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.358415+0000","last_change":"2023-09-30T17:02:18.360010+0000","last_active":"2023-09-30T17:02:19.358415+0000","last_peered":"2023-09-30T17:02:19.358415+0000","last_clean":"2023-09-30T17:02:19.358415+0000","last_became_active":"2023-09-30T17:02:18.358396+0000","last_became_peered":"2023-09-30T17:02:18.358396+0000","last_unstale":"2023-09-30T17:02:19.358415+0000","last_undegraded":"2023-09-30T17:02:19.358415+0000","last_fullsized":"2023-09-30T17:02:19.358415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:26:11.522402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357494+0000","last_change":"2023-09-30T17:02:18.375829+0000","last_active":"2023-09-30T17:02:19.357494+0000","last_peered":"2023-09-30T17:02:19.357494+0000","last_clean":"2023-09-30T17:02:19.357494+0000","last_became_active":"2023-09-30T17:02:18.374447+0000","last_became_peered":"2023-09-30T17:02:18.374447+0000","last_unstale":"2023-09-30T17:02:19.357494+0000","last_undegraded":"2023-09-30T17:02:19.357494+0000","last_fullsized":"2023-09-30T17:02:19.357494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:02:46.638397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357284+0000","last_change":"2023-09-30T17:02:18.373777+0000","last_active":"2023-09-30T17:02:19.357284+0000","last_peered":"2023-09-30T17:02:19.357284+0000","last_clean":"2023-09-30T17:02:19.357284+0000","last_became_active":"2023-09-30T17:02:18.373434+0000","last_became_peered":"2023-09-30T17:02:18.373434+0000","last_unstale":"2023-09-30T17:02:19.357284+0000","last_undegraded":"2023-09-30T17:02:19.357284+0000","last_fullsized":"2023-09-30T17:02:19.357284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:13:30.688369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357496+0000","last_change":"2023-09-30T17:02:18.359894+0000","last_active":"2023-09-30T17:02:19.357496+0000","last_peered":"2023-09-30T17:02:19.357496+0000","last_clean":"2023-09-30T17:02:19.357496+0000","last_became_active":"2023-09-30T17:02:18.358534+0000","last_became_peered":"2023-09-30T17:02:18.358534+0000","last_unstale":"2023-09-30T17:02:19.357496+0000","last_undegraded":"2023-09-30T17:02:19.357496+0000","last_fullsized":"2023-09-30T17:02:19.357496+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:22:13.025181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.356892+0000","last_change":"2023-09-30T17:02:18.374094+0000","last_active":"2023-09-30T17:02:19.356892+0000","last_peered":"2023-09-30T17:02:19.356892+0000","last_clean":"2023-09-30T17:02:19.356892+0000","last_became_active":"2023-09-30T17:02:18.373165+0000","last_became_peered":"2023-09-30T17:02:18.373165+0000","last_unstale":"2023-09-30T17:02:19.356892+0000","last_undegraded":"2023-09-30T17:02:19.356892+0000","last_fullsized":"2023-09-30T17:02:19.356892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:13:55.555700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.356482+0000","last_change":"2023-09-30T17:02:18.372075+0000","last_active":"2023-09-30T17:02:19.356482+0000","last_peered":"2023-09-30T17:02:19.356482+0000","last_clean":"2023-09-30T17:02:19.356482+0000","last_became_active":"2023-09-30T17:02:18.371685+0000","last_became_peered":"2023-09-30T17:02:18.371685+0000","last_unstale":"2023-09-30T17:02:19.356482+0000","last_undegraded":"2023-09-30T17:02:19.356482+0000","last_fullsized":"2023-09-30T17:02:19.356482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:14:35.192615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.356801+0000","last_change":"2023-09-30T17:02:18.376370+0000","last_active":"2023-09-30T17:02:19.356801+0000","last_peered":"2023-09-30T17:02:19.356801+0000","last_clean":"2023-09-30T17:02:19.356801+0000","last_became_active":"2023-09-30T17:02:18.375027+0000","last_became_peered":"2023-09-30T17:02:18.375027+0000","last_unstale":"2023-09-30T17:02:19.356801+0000","last_undegraded":"2023-09-30T17:02:19.356801+0000","last_fullsized":"2023-09-30T17:02:19.356801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:43:29.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.364415+0000","last_change":"2023-09-30T17:02:18.364360+0000","last_active":"2023-09-30T17:02:19.364415+0000","last_peered":"2023-09-30T17:02:19.364415+0000","last_clean":"2023-09-30T17:02:19.364415+0000","last_became_active":"2023-09-30T17:02:18.363697+0000","last_became_peered":"2023-09-30T17:02:18.363697+0000","last_unstale":"2023-09-30T17:02:19.364415+0000","last_undegraded":"2023-09-30T17:02:19.364415+0000","last_fullsized":"2023-09-30T17:02:19.364415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:50:52.893768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.358560+0000","last_change":"2023-09-30T17:02:18.360320+0000","last_active":"2023-09-30T17:02:19.358560+0000","last_peered":"2023-09-30T17:02:19.358560+0000","last_clean":"2023-09-30T17:02:19.358560+0000","last_became_active":"2023-09-30T17:02:18.357184+0000","last_became_peered":"2023-09-30T17:02:18.357184+0000","last_unstale":"2023-09-30T17:02:19.358560+0000","last_undegraded":"2023-09-30T17:02:19.358560+0000","last_fullsized":"2023-09-30T17:02:19.358560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:21:45.195007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.364138+0000","last_change":"2023-09-30T17:02:18.363956+0000","last_active":"2023-09-30T17:02:19.364138+0000","last_peered":"2023-09-30T17:02:19.364138+0000","last_clean":"2023-09-30T17:02:19.364138+0000","last_became_active":"2023-09-30T17:02:18.363654+0000","last_became_peered":"2023-09-30T17:02:18.363654+0000","last_unstale":"2023-09-30T17:02:19.364138+0000","last_undegraded":"2023-09-30T17:02:19.364138+0000","last_fullsized":"2023-09-30T17:02:19.364138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:48:17.598726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357324+0000","last_change":"2023-09-30T17:02:18.377065+0000","last_active":"2023-09-30T17:02:19.357324+0000","last_peered":"2023-09-30T17:02:19.357324+0000","last_clean":"2023-09-30T17:02:19.357324+0000","last_became_active":"2023-09-30T17:02:18.375158+0000","last_became_peered":"2023-09-30T17:02:18.375158+0000","last_unstale":"2023-09-30T17:02:19.357324+0000","last_undegraded":"2023-09-30T17:02:19.357324+0000","last_fullsized":"2023-09-30T17:02:19.357324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:12:06.380095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357361+0000","last_change":"2023-09-30T17:02:18.376206+0000","last_active":"2023-09-30T17:02:19.357361+0000","last_peered":"2023-09-30T17:02:19.357361+0000","last_clean":"2023-09-30T17:02:19.357361+0000","last_became_active":"2023-09-30T17:02:18.374694+0000","last_became_peered":"2023-09-30T17:02:18.374694+0000","last_unstale":"2023-09-30T17:02:19.357361+0000","last_undegraded":"2023-09-30T17:02:19.357361+0000","last_fullsized":"2023-09-30T17:02:19.357361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:43:17.634140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357322+0000","last_change":"2023-09-30T17:02:18.362977+0000","last_active":"2023-09-30T17:02:19.357322+0000","last_peered":"2023-09-30T17:02:19.357322+0000","last_clean":"2023-09-30T17:02:19.357322+0000","last_became_active":"2023-09-30T17:02:18.362657+0000","last_became_peered":"2023-09-30T17:02:18.362657+0000","last_unstale":"2023-09-30T17:02:19.357322+0000","last_undegraded":"2023-09-30T17:02:19.357322+0000","last_fullsized":"2023-09-30T17:02:19.357322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:15:54.364571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.363751+0000","last_change":"2023-09-30T17:02:18.361158+0000","last_active":"2023-09-30T17:02:19.363751+0000","last_peered":"2023-09-30T17:02:19.363751+0000","last_clean":"2023-09-30T17:02:19.363751+0000","last_became_active":"2023-09-30T17:02:18.360840+0000","last_became_peered":"2023-09-30T17:02:18.360840+0000","last_unstale":"2023-09-30T17:02:19.363751+0000","last_undegraded":"2023-09-30T17:02:19.363751+0000","last_fullsized":"2023-09-30T17:02:19.363751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:22:13.025181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357297+0000","last_change":"2023-09-30T17:02:18.353938+0000","last_active":"2023-09-30T17:02:19.357297+0000","last_peered":"2023-09-30T17:02:19.357297+0000","last_clean":"2023-09-30T17:02:19.357297+0000","last_became_active":"2023-09-30T17:02:18.353632+0000","last_became_peered":"2023-09-30T17:02:18.353632+0000","last_unstale":"2023-09-30T17:02:19.357297+0000","last_undegraded":"2023-09-30T17:02:19.357297+0000","last_fullsized":"2023-09-30T17:02:19.357297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:09:55.056098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.358593+0000","last_change":"2023-09-30T17:02:18.360801+0000","last_active":"2023-09-30T17:02:19.358593+0000","last_peered":"2023-09-30T17:02:19.358593+0000","last_clean":"2023-09-30T17:02:19.358593+0000","last_became_active":"2023-09-30T17:02:18.358862+0000","last_became_peered":"2023-09-30T17:02:18.358862+0000","last_unstale":"2023-09-30T17:02:19.358593+0000","last_undegraded":"2023-09-30T17:02:19.358593+0000","last_fullsized":"2023-09-30T17:02:19.358593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:55:15.512558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.364354+0000","last_change":"2023-09-30T17:02:18.355710+0000","last_active":"2023-09-30T17:02:19.364354+0000","last_peered":"2023-09-30T17:02:19.364354+0000","last_clean":"2023-09-30T17:02:19.364354+0000","last_became_active":"2023-09-30T17:02:18.355423+0000","last_became_peered":"2023-09-30T17:02:18.355423+0000","last_unstale":"2023-09-30T17:02:19.364354+0000","last_undegraded":"2023-09-30T17:02:19.364354+0000","last_fullsized":"2023-09-30T17:02:19.364354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:39:28.022201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357840+0000","last_change":"2023-09-30T17:02:18.377164+0000","last_active":"2023-09-30T17:02:19.357840+0000","last_peered":"2023-09-30T17:02:19.357840+0000","last_clean":"2023-09-30T17:02:19.357840+0000","last_became_active":"2023-09-30T17:02:18.376425+0000","last_became_peered":"2023-09-30T17:02:18.376425+0000","last_unstale":"2023-09-30T17:02:19.357840+0000","last_undegraded":"2023-09-30T17:02:19.357840+0000","last_fullsized":"2023-09-30T17:02:19.357840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:20:53.357746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.294200+0000","last_change":"2023-09-30T17:02:17.358258+0000","last_active":"2023-09-30T17:02:19.294200+0000","last_peered":"2023-09-30T17:02:19.294200+0000","last_clean":"2023-09-30T17:02:19.294200+0000","last_became_active":"2023-09-30T17:02:17.357890+0000","last_became_peered":"2023-09-30T17:02:17.357890+0000","last_unstale":"2023-09-30T17:02:19.294200+0000","last_undegraded":"2023-09-30T17:02:19.294200+0000","last_fullsized":"2023-09-30T17:02:19.294200+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:52:56.591906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.358102+0000","last_change":"2023-09-30T17:02:18.358843+0000","last_active":"2023-09-30T17:02:19.358102+0000","last_peered":"2023-09-30T17:02:19.358102+0000","last_clean":"2023-09-30T17:02:19.358102+0000","last_became_active":"2023-09-30T17:02:18.357966+0000","last_became_peered":"2023-09-30T17:02:18.357966+0000","last_unstale":"2023-09-30T17:02:19.358102+0000","last_undegraded":"2023-09-30T17:02:19.358102+0000","last_fullsized":"2023-09-30T17:02:19.358102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:13:55.555700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293653+0000","last_change":"2023-09-30T17:02:17.363387+0000","last_active":"2023-09-30T17:02:19.293653+0000","last_peered":"2023-09-30T17:02:19.293653+0000","last_clean":"2023-09-30T17:02:19.293653+0000","last_became_active":"2023-09-30T17:02:17.363042+0000","last_became_peered":"2023-09-30T17:02:17.363042+0000","last_unstale":"2023-09-30T17:02:19.293653+0000","last_undegraded":"2023-09-30T17:02:19.293653+0000","last_fullsized":"2023-09-30T17:02:19.293653+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:38:57.098312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.364401+0000","last_change":"2023-09-30T17:02:18.355398+0000","last_active":"2023-09-30T17:02:19.364401+0000","last_peered":"2023-09-30T17:02:19.364401+0000","last_clean":"2023-09-30T17:02:19.364401+0000","last_became_active":"2023-09-30T17:02:18.355006+0000","last_became_peered":"2023-09-30T17:02:18.355006+0000","last_unstale":"2023-09-30T17:02:19.364401+0000","last_undegraded":"2023-09-30T17:02:19.364401+0000","last_fullsized":"2023-09-30T17:02:19.364401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:37:14.790993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293603+0000","last_change":"2023-09-30T17:02:17.361000+0000","last_active":"2023-09-30T17:02:19.293603+0000","last_peered":"2023-09-30T17:02:19.293603+0000","last_clean":"2023-09-30T17:02:19.293603+0000","last_became_active":"2023-09-30T17:02:17.360601+0000","last_became_peered":"2023-09-30T17:02:17.360601+0000","last_unstale":"2023-09-30T17:02:19.293603+0000","last_undegraded":"2023-09-30T17:02:19.293603+0000","last_fullsized":"2023-09-30T17:02:19.293603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:02:27.666526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.358593+0000","last_change":"2023-09-30T17:02:18.363570+0000","last_active":"2023-09-30T17:02:19.358593+0000","last_peered":"2023-09-30T17:02:19.358593+0000","last_clean":"2023-09-30T17:02:19.358593+0000","last_became_active":"2023-09-30T17:02:18.362961+0000","last_became_peered":"2023-09-30T17:02:18.362961+0000","last_unstale":"2023-09-30T17:02:19.358593+0000","last_undegraded":"2023-09-30T17:02:19.358593+0000","last_fullsized":"2023-09-30T17:02:19.358593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:38:15.747647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293949+0000","last_change":"2023-09-30T17:02:17.364672+0000","last_active":"2023-09-30T17:02:19.293949+0000","last_peered":"2023-09-30T17:02:19.293949+0000","last_clean":"2023-09-30T17:02:19.293949+0000","last_became_active":"2023-09-30T17:02:17.364279+0000","last_became_peered":"2023-09-30T17:02:17.364279+0000","last_unstale":"2023-09-30T17:02:19.293949+0000","last_undegraded":"2023-09-30T17:02:19.293949+0000","last_fullsized":"2023-09-30T17:02:19.293949+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:00:56.363835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.363255+0000","last_change":"2023-09-30T17:02:18.358841+0000","last_active":"2023-09-30T17:02:19.363255+0000","last_peered":"2023-09-30T17:02:19.363255+0000","last_clean":"2023-09-30T17:02:19.363255+0000","last_became_active":"2023-09-30T17:02:18.358529+0000","last_became_peered":"2023-09-30T17:02:18.358529+0000","last_unstale":"2023-09-30T17:02:19.363255+0000","last_undegraded":"2023-09-30T17:02:19.363255+0000","last_fullsized":"2023-09-30T17:02:19.363255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:15:54.364571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293818+0000","last_change":"2023-09-30T17:02:17.357998+0000","last_active":"2023-09-30T17:02:19.293818+0000","last_peered":"2023-09-30T17:02:19.293818+0000","last_clean":"2023-09-30T17:02:19.293818+0000","last_became_active":"2023-09-30T17:02:17.357653+0000","last_became_peered":"2023-09-30T17:02:17.357653+0000","last_unstale":"2023-09-30T17:02:19.293818+0000","last_undegraded":"2023-09-30T17:02:19.293818+0000","last_fullsized":"2023-09-30T17:02:19.293818+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:52:37.518693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.363934+0000","last_change":"2023-09-30T17:02:18.361155+0000","last_active":"2023-09-30T17:02:19.363934+0000","last_peered":"2023-09-30T17:02:19.363934+0000","last_clean":"2023-09-30T17:02:19.363934+0000","last_became_active":"2023-09-30T17:02:18.360825+0000","last_became_peered":"2023-09-30T17:02:18.360825+0000","last_unstale":"2023-09-30T17:02:19.363934+0000","last_undegraded":"2023-09-30T17:02:19.363934+0000","last_fullsized":"2023-09-30T17:02:19.363934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:39:16.689300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.294335+0000","last_change":"2023-09-30T17:02:17.363119+0000","last_active":"2023-09-30T17:02:19.294335+0000","last_peered":"2023-09-30T17:02:19.294335+0000","last_clean":"2023-09-30T17:02:19.294335+0000","last_became_active":"2023-09-30T17:02:17.362754+0000","last_became_peered":"2023-09-30T17:02:17.362754+0000","last_unstale":"2023-09-30T17:02:19.294335+0000","last_undegraded":"2023-09-30T17:02:19.294335+0000","last_fullsized":"2023-09-30T17:02:19.294335+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:00:56.363835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.363589+0000","last_change":"2023-09-30T17:02:18.359118+0000","last_active":"2023-09-30T17:02:19.363589+0000","last_peered":"2023-09-30T17:02:19.363589+0000","last_clean":"2023-09-30T17:02:19.363589+0000","last_became_active":"2023-09-30T17:02:18.358786+0000","last_became_peered":"2023-09-30T17:02:18.358786+0000","last_unstale":"2023-09-30T17:02:19.363589+0000","last_undegraded":"2023-09-30T17:02:19.363589+0000","last_fullsized":"2023-09-30T17:02:19.363589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:33:21.723864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293706+0000","last_change":"2023-09-30T17:02:17.355936+0000","last_active":"2023-09-30T17:02:19.293706+0000","last_peered":"2023-09-30T17:02:19.293706+0000","last_clean":"2023-09-30T17:02:19.293706+0000","last_became_active":"2023-09-30T17:02:17.355664+0000","last_became_peered":"2023-09-30T17:02:17.355664+0000","last_unstale":"2023-09-30T17:02:19.293706+0000","last_undegraded":"2023-09-30T17:02:19.293706+0000","last_fullsized":"2023-09-30T17:02:19.293706+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:11:46.248439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357021+0000","last_change":"2023-09-30T17:02:18.373330+0000","last_active":"2023-09-30T17:02:19.357021+0000","last_peered":"2023-09-30T17:02:19.357021+0000","last_clean":"2023-09-30T17:02:19.357021+0000","last_became_active":"2023-09-30T17:02:18.373004+0000","last_became_peered":"2023-09-30T17:02:18.373004+0000","last_unstale":"2023-09-30T17:02:19.357021+0000","last_undegraded":"2023-09-30T17:02:19.357021+0000","last_fullsized":"2023-09-30T17:02:19.357021+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:16:27.516884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293603+0000","last_change":"2023-09-30T17:02:17.359251+0000","last_active":"2023-09-30T17:02:19.293603+0000","last_peered":"2023-09-30T17:02:19.293603+0000","last_clean":"2023-09-30T17:02:19.293603+0000","last_became_active":"2023-09-30T17:02:17.358579+0000","last_became_peered":"2023-09-30T17:02:17.358579+0000","last_unstale":"2023-09-30T17:02:19.293603+0000","last_undegraded":"2023-09-30T17:02:19.293603+0000","last_fullsized":"2023-09-30T17:02:19.293603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:55:33.944875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357627+0000","last_change":"2023-09-30T17:02:18.360019+0000","last_active":"2023-09-30T17:02:19.357627+0000","last_peered":"2023-09-30T17:02:19.357627+0000","last_clean":"2023-09-30T17:02:19.357627+0000","last_became_active":"2023-09-30T17:02:18.358364+0000","last_became_peered":"2023-09-30T17:02:18.358364+0000","last_unstale":"2023-09-30T17:02:19.357627+0000","last_undegraded":"2023-09-30T17:02:19.357627+0000","last_fullsized":"2023-09-30T17:02:19.357627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:30:43.782165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293708+0000","last_change":"2023-09-30T17:02:17.363694+0000","last_active":"2023-09-30T17:02:19.293708+0000","last_peered":"2023-09-30T17:02:19.293708+0000","last_clean":"2023-09-30T17:02:19.293708+0000","last_became_active":"2023-09-30T17:02:17.363442+0000","last_became_peered":"2023-09-30T17:02:17.363442+0000","last_unstale":"2023-09-30T17:02:19.293708+0000","last_undegraded":"2023-09-30T17:02:19.293708+0000","last_fullsized":"2023-09-30T17:02:19.293708+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:19:19.997724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.358063+0000","last_change":"2023-09-30T17:02:18.362415+0000","last_active":"2023-09-30T17:02:19.358063+0000","last_peered":"2023-09-30T17:02:19.358063+0000","last_clean":"2023-09-30T17:02:19.358063+0000","last_became_active":"2023-09-30T17:02:18.361556+0000","last_became_peered":"2023-09-30T17:02:18.361556+0000","last_unstale":"2023-09-30T17:02:19.358063+0000","last_undegraded":"2023-09-30T17:02:19.358063+0000","last_fullsized":"2023-09-30T17:02:19.358063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:16:41.607547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.294127+0000","last_change":"2023-09-30T17:02:17.363369+0000","last_active":"2023-09-30T17:02:19.294127+0000","last_peered":"2023-09-30T17:02:19.294127+0000","last_clean":"2023-09-30T17:02:19.294127+0000","last_became_active":"2023-09-30T17:02:17.362925+0000","last_became_peered":"2023-09-30T17:02:17.362925+0000","last_unstale":"2023-09-30T17:02:19.294127+0000","last_undegraded":"2023-09-30T17:02:19.294127+0000","last_fullsized":"2023-09-30T17:02:19.294127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:50:18.455188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.364537+0000","last_change":"2023-09-30T17:02:18.356700+0000","last_active":"2023-09-30T17:02:19.364537+0000","last_peered":"2023-09-30T17:02:19.364537+0000","last_clean":"2023-09-30T17:02:19.364537+0000","last_became_active":"2023-09-30T17:02:18.356108+0000","last_became_peered":"2023-09-30T17:02:18.356108+0000","last_unstale":"2023-09-30T17:02:19.364537+0000","last_undegraded":"2023-09-30T17:02:19.364537+0000","last_fullsized":"2023-09-30T17:02:19.364537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:16:41.607547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293424+0000","last_change":"2023-09-30T17:02:17.355214+0000","last_active":"2023-09-30T17:02:19.293424+0000","last_peered":"2023-09-30T17:02:19.293424+0000","last_clean":"2023-09-30T17:02:19.293424+0000","last_became_active":"2023-09-30T17:02:17.354876+0000","last_became_peered":"2023-09-30T17:02:17.354876+0000","last_unstale":"2023-09-30T17:02:19.293424+0000","last_undegraded":"2023-09-30T17:02:19.293424+0000","last_fullsized":"2023-09-30T17:02:19.293424+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:13:41.205152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.364747+0000","last_change":"2023-09-30T17:02:18.356814+0000","last_active":"2023-09-30T17:02:19.364747+0000","last_peered":"2023-09-30T17:02:19.364747+0000","last_clean":"2023-09-30T17:02:19.364747+0000","last_became_active":"2023-09-30T17:02:18.356258+0000","last_became_peered":"2023-09-30T17:02:18.356258+0000","last_unstale":"2023-09-30T17:02:19.364747+0000","last_undegraded":"2023-09-30T17:02:19.364747+0000","last_fullsized":"2023-09-30T17:02:19.364747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:26:11.522402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293840+0000","last_change":"2023-09-30T17:02:17.355972+0000","last_active":"2023-09-30T17:02:19.293840+0000","last_peered":"2023-09-30T17:02:19.293840+0000","last_clean":"2023-09-30T17:02:19.293840+0000","last_became_active":"2023-09-30T17:02:17.355653+0000","last_became_peered":"2023-09-30T17:02:17.355653+0000","last_unstale":"2023-09-30T17:02:19.293840+0000","last_undegraded":"2023-09-30T17:02:19.293840+0000","last_fullsized":"2023-09-30T17:02:19.293840+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:27:37.446407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.356869+0000","last_change":"2023-09-30T17:02:18.355736+0000","last_active":"2023-09-30T17:02:19.356869+0000","last_peered":"2023-09-30T17:02:19.356869+0000","last_clean":"2023-09-30T17:02:19.356869+0000","last_became_active":"2023-09-30T17:02:18.355111+0000","last_became_peered":"2023-09-30T17:02:18.355111+0000","last_unstale":"2023-09-30T17:02:19.356869+0000","last_undegraded":"2023-09-30T17:02:19.356869+0000","last_fullsized":"2023-09-30T17:02:19.356869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:47:00.094303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.294406+0000","last_change":"2023-09-30T17:02:17.363514+0000","last_active":"2023-09-30T17:02:19.294406+0000","last_peered":"2023-09-30T17:02:19.294406+0000","last_clean":"2023-09-30T17:02:19.294406+0000","last_became_active":"2023-09-30T17:02:17.363124+0000","last_became_peered":"2023-09-30T17:02:17.363124+0000","last_unstale":"2023-09-30T17:02:19.294406+0000","last_undegraded":"2023-09-30T17:02:19.294406+0000","last_fullsized":"2023-09-30T17:02:19.294406+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:55:33.944875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357665+0000","last_change":"2023-09-30T17:02:18.359767+0000","last_active":"2023-09-30T17:02:19.357665+0000","last_peered":"2023-09-30T17:02:19.357665+0000","last_clean":"2023-09-30T17:02:19.357665+0000","last_became_active":"2023-09-30T17:02:18.356825+0000","last_became_peered":"2023-09-30T17:02:18.356825+0000","last_unstale":"2023-09-30T17:02:19.357665+0000","last_undegraded":"2023-09-30T17:02:19.357665+0000","last_fullsized":"2023-09-30T17:02:19.357665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:39:16.689300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293738+0000","last_change":"2023-09-30T17:02:17.355878+0000","last_active":"2023-09-30T17:02:19.293738+0000","last_peered":"2023-09-30T17:02:19.293738+0000","last_clean":"2023-09-30T17:02:19.293738+0000","last_became_active":"2023-09-30T17:02:17.355642+0000","last_became_peered":"2023-09-30T17:02:17.355642+0000","last_unstale":"2023-09-30T17:02:19.293738+0000","last_undegraded":"2023-09-30T17:02:19.293738+0000","last_fullsized":"2023-09-30T17:02:19.293738+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:04:48.294789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.356816+0000","last_change":"2023-09-30T17:02:18.375303+0000","last_active":"2023-09-30T17:02:19.356816+0000","last_peered":"2023-09-30T17:02:19.356816+0000","last_clean":"2023-09-30T17:02:19.356816+0000","last_became_active":"2023-09-30T17:02:18.373962+0000","last_became_peered":"2023-09-30T17:02:18.373962+0000","last_unstale":"2023-09-30T17:02:19.356816+0000","last_undegraded":"2023-09-30T17:02:19.356816+0000","last_fullsized":"2023-09-30T17:02:19.356816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:16:41.607547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293666+0000","last_change":"2023-09-30T17:02:17.358126+0000","last_active":"2023-09-30T17:02:19.293666+0000","last_peered":"2023-09-30T17:02:19.293666+0000","last_clean":"2023-09-30T17:02:19.293666+0000","last_became_active":"2023-09-30T17:02:17.357621+0000","last_became_peered":"2023-09-30T17:02:17.357621+0000","last_unstale":"2023-09-30T17:02:19.293666+0000","last_undegraded":"2023-09-30T17:02:19.293666+0000","last_fullsized":"2023-09-30T17:02:19.293666+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:46:16.375239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.364059+0000","last_change":"2023-09-30T17:02:18.362399+0000","last_active":"2023-09-30T17:02:19.364059+0000","last_peered":"2023-09-30T17:02:19.364059+0000","last_clean":"2023-09-30T17:02:19.364059+0000","last_became_active":"2023-09-30T17:02:18.362173+0000","last_became_peered":"2023-09-30T17:02:18.362173+0000","last_unstale":"2023-09-30T17:02:19.364059+0000","last_undegraded":"2023-09-30T17:02:19.364059+0000","last_fullsized":"2023-09-30T17:02:19.364059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:30:35.150981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293733+0000","last_change":"2023-09-30T17:02:17.363567+0000","last_active":"2023-09-30T17:02:19.293733+0000","last_peered":"2023-09-30T17:02:19.293733+0000","last_clean":"2023-09-30T17:02:19.293733+0000","last_became_active":"2023-09-30T17:02:17.363254+0000","last_became_peered":"2023-09-30T17:02:17.363254+0000","last_unstale":"2023-09-30T17:02:19.293733+0000","last_undegraded":"2023-09-30T17:02:19.293733+0000","last_fullsized":"2023-09-30T17:02:19.293733+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:08:34.994215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357037+0000","last_change":"2023-09-30T17:02:18.372346+0000","last_active":"2023-09-30T17:02:19.357037+0000","last_peered":"2023-09-30T17:02:19.357037+0000","last_clean":"2023-09-30T17:02:19.357037+0000","last_became_active":"2023-09-30T17:02:18.371542+0000","last_became_peered":"2023-09-30T17:02:18.371542+0000","last_unstale":"2023-09-30T17:02:19.357037+0000","last_undegraded":"2023-09-30T17:02:19.357037+0000","last_fullsized":"2023-09-30T17:02:19.357037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:55:15.512558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293510+0000","last_change":"2023-09-30T17:02:17.358658+0000","last_active":"2023-09-30T17:02:19.293510+0000","last_peered":"2023-09-30T17:02:19.293510+0000","last_clean":"2023-09-30T17:02:19.293510+0000","last_became_active":"2023-09-30T17:02:17.357738+0000","last_became_peered":"2023-09-30T17:02:17.357738+0000","last_unstale":"2023-09-30T17:02:19.293510+0000","last_undegraded":"2023-09-30T17:02:19.293510+0000","last_fullsized":"2023-09-30T17:02:19.293510+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:00:16.830342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357758+0000","last_change":"2023-09-30T17:02:18.373854+0000","last_active":"2023-09-30T17:02:19.357758+0000","last_peered":"2023-09-30T17:02:19.357758+0000","last_clean":"2023-09-30T17:02:19.357758+0000","last_became_active":"2023-09-30T17:02:18.373315+0000","last_became_peered":"2023-09-30T17:02:18.373315+0000","last_unstale":"2023-09-30T17:02:19.357758+0000","last_undegraded":"2023-09-30T17:02:19.357758+0000","last_fullsized":"2023-09-30T17:02:19.357758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:28:07.751219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.294114+0000","last_change":"2023-09-30T17:02:17.359738+0000","last_active":"2023-09-30T17:02:19.294114+0000","last_peered":"2023-09-30T17:02:19.294114+0000","last_clean":"2023-09-30T17:02:19.294114+0000","last_became_active":"2023-09-30T17:02:17.359424+0000","last_became_peered":"2023-09-30T17:02:17.359424+0000","last_unstale":"2023-09-30T17:02:19.294114+0000","last_undegraded":"2023-09-30T17:02:19.294114+0000","last_fullsized":"2023-09-30T17:02:19.294114+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:01:31.158446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357403+0000","last_change":"2023-09-30T17:02:18.373068+0000","last_active":"2023-09-30T17:02:19.357403+0000","last_peered":"2023-09-30T17:02:19.357403+0000","last_clean":"2023-09-30T17:02:19.357403+0000","last_became_active":"2023-09-30T17:02:18.372739+0000","last_became_peered":"2023-09-30T17:02:18.372739+0000","last_unstale":"2023-09-30T17:02:19.357403+0000","last_undegraded":"2023-09-30T17:02:19.357403+0000","last_fullsized":"2023-09-30T17:02:19.357403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:37:30.572488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.294090+0000","last_change":"2023-09-30T17:02:17.358811+0000","last_active":"2023-09-30T17:02:19.294090+0000","last_peered":"2023-09-30T17:02:19.294090+0000","last_clean":"2023-09-30T17:02:19.294090+0000","last_became_active":"2023-09-30T17:02:17.358582+0000","last_became_peered":"2023-09-30T17:02:17.358582+0000","last_unstale":"2023-09-30T17:02:19.294090+0000","last_undegraded":"2023-09-30T17:02:19.294090+0000","last_fullsized":"2023-09-30T17:02:19.294090+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:52:37.518693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.364541+0000","last_change":"2023-09-30T17:02:18.364478+0000","last_active":"2023-09-30T17:02:19.364541+0000","last_peered":"2023-09-30T17:02:19.364541+0000","last_clean":"2023-09-30T17:02:19.364541+0000","last_became_active":"2023-09-30T17:02:18.364057+0000","last_became_peered":"2023-09-30T17:02:18.364057+0000","last_unstale":"2023-09-30T17:02:19.364541+0000","last_undegraded":"2023-09-30T17:02:19.364541+0000","last_fullsized":"2023-09-30T17:02:19.364541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:13:55.555700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.348448+0000","last_change":"2023-09-30T17:02:12.327704+0000","last_active":"2023-09-30T17:02:18.348448+0000","last_peered":"2023-09-30T17:02:18.348448+0000","last_clean":"2023-09-30T17:02:18.348448+0000","last_became_active":"2023-09-30T17:02:12.327384+0000","last_became_peered":"2023-09-30T17:02:12.327384+0000","last_unstale":"2023-09-30T17:02:18.348448+0000","last_undegraded":"2023-09-30T17:02:18.348448+0000","last_fullsized":"2023-09-30T17:02:18.348448+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:09:34.818252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293774+0000","last_change":"2023-09-30T17:02:17.357321+0000","last_active":"2023-09-30T17:02:19.293774+0000","last_peered":"2023-09-30T17:02:19.293774+0000","last_clean":"2023-09-30T17:02:19.293774+0000","last_became_active":"2023-09-30T17:02:17.357105+0000","last_became_peered":"2023-09-30T17:02:17.357105+0000","last_unstale":"2023-09-30T17:02:19.293774+0000","last_undegraded":"2023-09-30T17:02:19.293774+0000","last_fullsized":"2023-09-30T17:02:19.293774+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:09:54.050468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357396+0000","last_change":"2023-09-30T17:02:18.356537+0000","last_active":"2023-09-30T17:02:19.357396+0000","last_peered":"2023-09-30T17:02:19.357396+0000","last_clean":"2023-09-30T17:02:19.357396+0000","last_became_active":"2023-09-30T17:02:18.355641+0000","last_became_peered":"2023-09-30T17:02:18.355641+0000","last_unstale":"2023-09-30T17:02:19.357396+0000","last_undegraded":"2023-09-30T17:02:19.357396+0000","last_fullsized":"2023-09-30T17:02:19.357396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:33:21.723864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.355403+0000","last_change":"2023-09-30T17:02:12.332417+0000","last_active":"2023-09-30T17:02:18.355403+0000","last_peered":"2023-09-30T17:02:18.355403+0000","last_clean":"2023-09-30T17:02:18.355403+0000","last_became_active":"2023-09-30T17:02:12.332124+0000","last_became_peered":"2023-09-30T17:02:12.332124+0000","last_unstale":"2023-09-30T17:02:18.355403+0000","last_undegraded":"2023-09-30T17:02:18.355403+0000","last_fullsized":"2023-09-30T17:02:18.355403+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:21:27.587948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293583+0000","last_change":"2023-09-30T17:02:17.359029+0000","last_active":"2023-09-30T17:02:19.293583+0000","last_peered":"2023-09-30T17:02:19.293583+0000","last_clean":"2023-09-30T17:02:19.293583+0000","last_became_active":"2023-09-30T17:02:17.357931+0000","last_became_peered":"2023-09-30T17:02:17.357931+0000","last_unstale":"2023-09-30T17:02:19.293583+0000","last_undegraded":"2023-09-30T17:02:19.293583+0000","last_fullsized":"2023-09-30T17:02:19.293583+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:00:56.363835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.363856+0000","last_change":"2023-09-30T17:02:18.363399+0000","last_active":"2023-09-30T17:02:19.363856+0000","last_peered":"2023-09-30T17:02:19.363856+0000","last_clean":"2023-09-30T17:02:19.363856+0000","last_became_active":"2023-09-30T17:02:18.363064+0000","last_became_peered":"2023-09-30T17:02:18.363064+0000","last_unstale":"2023-09-30T17:02:19.363856+0000","last_undegraded":"2023-09-30T17:02:19.363856+0000","last_fullsized":"2023-09-30T17:02:19.363856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:32:34.654264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.348157+0000","last_change":"2023-09-30T17:02:12.327834+0000","last_active":"2023-09-30T17:02:18.348157+0000","last_peered":"2023-09-30T17:02:18.348157+0000","last_clean":"2023-09-30T17:02:18.348157+0000","last_became_active":"2023-09-30T17:02:12.327542+0000","last_became_peered":"2023-09-30T17:02:12.327542+0000","last_unstale":"2023-09-30T17:02:18.348157+0000","last_undegraded":"2023-09-30T17:02:18.348157+0000","last_fullsized":"2023-09-30T17:02:18.348157+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:49:54.890769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.294077+0000","last_change":"2023-09-30T17:02:17.363326+0000","last_active":"2023-09-30T17:02:19.294077+0000","last_peered":"2023-09-30T17:02:19.294077+0000","last_clean":"2023-09-30T17:02:19.294077+0000","last_became_active":"2023-09-30T17:02:17.362934+0000","last_became_peered":"2023-09-30T17:02:17.362934+0000","last_unstale":"2023-09-30T17:02:19.294077+0000","last_undegraded":"2023-09-30T17:02:19.294077+0000","last_fullsized":"2023-09-30T17:02:19.294077+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:24:04.564387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.364712+0000","last_change":"2023-09-30T17:02:18.364406+0000","last_active":"2023-09-30T17:02:19.364712+0000","last_peered":"2023-09-30T17:02:19.364712+0000","last_clean":"2023-09-30T17:02:19.364712+0000","last_became_active":"2023-09-30T17:02:18.363849+0000","last_became_peered":"2023-09-30T17:02:18.363849+0000","last_unstale":"2023-09-30T17:02:19.364712+0000","last_undegraded":"2023-09-30T17:02:19.364712+0000","last_fullsized":"2023-09-30T17:02:19.364712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:43:29.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.357252+0000","last_change":"2023-09-30T17:02:12.332542+0000","last_active":"2023-09-30T17:02:18.357252+0000","last_peered":"2023-09-30T17:02:18.357252+0000","last_clean":"2023-09-30T17:02:18.357252+0000","last_became_active":"2023-09-30T17:02:12.332132+0000","last_became_peered":"2023-09-30T17:02:12.332132+0000","last_unstale":"2023-09-30T17:02:18.357252+0000","last_undegraded":"2023-09-30T17:02:18.357252+0000","last_fullsized":"2023-09-30T17:02:18.357252+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:14:16.917130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":214,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.355641+0000","last_change":"2023-09-30T17:02:07.309872+0000","last_active":"2023-09-30T17:02:18.355641+0000","last_peered":"2023-09-30T17:02:18.355641+0000","last_clean":"2023-09-30T17:02:18.355641+0000","last_became_active":"2023-09-30T17:02:07.309630+0000","last_became_peered":"2023-09-30T17:02:07.309630+0000","last_unstale":"2023-09-30T17:02:18.355641+0000","last_undegraded":"2023-09-30T17:02:18.355641+0000","last_fullsized":"2023-09-30T17:02:18.355641+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:06.295501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:06.295501+0000","last_clean_scrub_stamp":"2023-09-30T17:02:06.295501+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:20:12.668818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293686+0000","last_change":"2023-09-30T17:02:17.357139+0000","last_active":"2023-09-30T17:02:19.293686+0000","last_peered":"2023-09-30T17:02:19.293686+0000","last_clean":"2023-09-30T17:02:19.293686+0000","last_became_active":"2023-09-30T17:02:17.356901+0000","last_became_peered":"2023-09-30T17:02:17.356901+0000","last_unstale":"2023-09-30T17:02:19.293686+0000","last_undegraded":"2023-09-30T17:02:19.293686+0000","last_fullsized":"2023-09-30T17:02:19.293686+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:22:35.747671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357783+0000","last_change":"2023-09-30T17:02:18.373627+0000","last_active":"2023-09-30T17:02:19.357783+0000","last_peered":"2023-09-30T17:02:19.357783+0000","last_clean":"2023-09-30T17:02:19.357783+0000","last_became_active":"2023-09-30T17:02:18.373275+0000","last_became_peered":"2023-09-30T17:02:18.373275+0000","last_unstale":"2023-09-30T17:02:19.357783+0000","last_undegraded":"2023-09-30T17:02:19.357783+0000","last_fullsized":"2023-09-30T17:02:19.357783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:44:18.066167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.354175+0000","last_change":"2023-09-30T17:02:12.330129+0000","last_active":"2023-09-30T17:02:18.354175+0000","last_peered":"2023-09-30T17:02:18.354175+0000","last_clean":"2023-09-30T17:02:18.354175+0000","last_became_active":"2023-09-30T17:02:12.329863+0000","last_became_peered":"2023-09-30T17:02:12.329863+0000","last_unstale":"2023-09-30T17:02:18.354175+0000","last_undegraded":"2023-09-30T17:02:18.354175+0000","last_fullsized":"2023-09-30T17:02:18.354175+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:21:45.393691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293615+0000","last_change":"2023-09-30T17:02:17.363398+0000","last_active":"2023-09-30T17:02:19.293615+0000","last_peered":"2023-09-30T17:02:19.293615+0000","last_clean":"2023-09-30T17:02:19.293615+0000","last_became_active":"2023-09-30T17:02:17.363086+0000","last_became_peered":"2023-09-30T17:02:17.363086+0000","last_unstale":"2023-09-30T17:02:19.293615+0000","last_undegraded":"2023-09-30T17:02:19.293615+0000","last_fullsized":"2023-09-30T17:02:19.293615+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:48:08.569937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.358480+0000","last_change":"2023-09-30T17:02:18.360029+0000","last_active":"2023-09-30T17:02:19.358480+0000","last_peered":"2023-09-30T17:02:19.358480+0000","last_clean":"2023-09-30T17:02:19.358480+0000","last_became_active":"2023-09-30T17:02:18.356839+0000","last_became_peered":"2023-09-30T17:02:18.356839+0000","last_unstale":"2023-09-30T17:02:19.358480+0000","last_undegraded":"2023-09-30T17:02:19.358480+0000","last_fullsized":"2023-09-30T17:02:19.358480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:16:27.516884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.356756+0000","last_change":"2023-09-30T17:02:12.330472+0000","last_active":"2023-09-30T17:02:18.356756+0000","last_peered":"2023-09-30T17:02:18.356756+0000","last_clean":"2023-09-30T17:02:18.356756+0000","last_became_active":"2023-09-30T17:02:12.330154+0000","last_became_peered":"2023-09-30T17:02:12.330154+0000","last_unstale":"2023-09-30T17:02:18.356756+0000","last_undegraded":"2023-09-30T17:02:18.356756+0000","last_fullsized":"2023-09-30T17:02:18.356756+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:43:23.161734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293780+0000","last_change":"2023-09-30T17:02:17.361007+0000","last_active":"2023-09-30T17:02:19.293780+0000","last_peered":"2023-09-30T17:02:19.293780+0000","last_clean":"2023-09-30T17:02:19.293780+0000","last_became_active":"2023-09-30T17:02:17.360721+0000","last_became_peered":"2023-09-30T17:02:17.360721+0000","last_unstale":"2023-09-30T17:02:19.293780+0000","last_undegraded":"2023-09-30T17:02:19.293780+0000","last_fullsized":"2023-09-30T17:02:19.293780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:13:41.205152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357723+0000","last_change":"2023-09-30T17:02:18.364148+0000","last_active":"2023-09-30T17:02:19.357723+0000","last_peered":"2023-09-30T17:02:19.357723+0000","last_clean":"2023-09-30T17:02:19.357723+0000","last_became_active":"2023-09-30T17:02:18.363793+0000","last_became_peered":"2023-09-30T17:02:18.363793+0000","last_unstale":"2023-09-30T17:02:19.357723+0000","last_undegraded":"2023-09-30T17:02:19.357723+0000","last_fullsized":"2023-09-30T17:02:19.357723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:30:35.150981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293916+0000","last_change":"2023-09-30T17:02:17.360831+0000","last_active":"2023-09-30T17:02:19.293916+0000","last_peered":"2023-09-30T17:02:19.293916+0000","last_clean":"2023-09-30T17:02:19.293916+0000","last_became_active":"2023-09-30T17:02:17.360494+0000","last_became_peered":"2023-09-30T17:02:17.360494+0000","last_unstale":"2023-09-30T17:02:19.293916+0000","last_undegraded":"2023-09-30T17:02:19.293916+0000","last_fullsized":"2023-09-30T17:02:19.293916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:24:04.564387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.350218+0000","last_change":"2023-09-30T17:02:12.328184+0000","last_active":"2023-09-30T17:02:18.350218+0000","last_peered":"2023-09-30T17:02:18.350218+0000","last_clean":"2023-09-30T17:02:18.350218+0000","last_became_active":"2023-09-30T17:02:12.327898+0000","last_became_peered":"2023-09-30T17:02:12.327898+0000","last_unstale":"2023-09-30T17:02:18.350218+0000","last_undegraded":"2023-09-30T17:02:18.350218+0000","last_fullsized":"2023-09-30T17:02:18.350218+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:43:23.161734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.363242+0000","last_change":"2023-09-30T17:02:18.361791+0000","last_active":"2023-09-30T17:02:19.363242+0000","last_peered":"2023-09-30T17:02:19.363242+0000","last_clean":"2023-09-30T17:02:19.363242+0000","last_became_active":"2023-09-30T17:02:18.361226+0000","last_became_peered":"2023-09-30T17:02:18.361226+0000","last_unstale":"2023-09-30T17:02:19.363242+0000","last_undegraded":"2023-09-30T17:02:19.363242+0000","last_fullsized":"2023-09-30T17:02:19.363242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:13:30.688369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.356790+0000","last_change":"2023-09-30T17:02:12.330039+0000","last_active":"2023-09-30T17:02:18.356790+0000","last_peered":"2023-09-30T17:02:18.356790+0000","last_clean":"2023-09-30T17:02:18.356790+0000","last_became_active":"2023-09-30T17:02:12.329827+0000","last_became_peered":"2023-09-30T17:02:12.329827+0000","last_unstale":"2023-09-30T17:02:18.356790+0000","last_undegraded":"2023-09-30T17:02:18.356790+0000","last_fullsized":"2023-09-30T17:02:18.356790+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:21:09.449776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.364463+0000","last_change":"2023-09-30T17:02:17.364615+0000","last_active":"2023-09-30T17:02:19.364463+0000","last_peered":"2023-09-30T17:02:19.364463+0000","last_clean":"2023-09-30T17:02:19.364463+0000","last_became_active":"2023-09-30T17:02:17.364317+0000","last_became_peered":"2023-09-30T17:02:17.364317+0000","last_unstale":"2023-09-30T17:02:19.364463+0000","last_undegraded":"2023-09-30T17:02:19.364463+0000","last_fullsized":"2023-09-30T17:02:19.364463+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:52:37.518693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357528+0000","last_change":"2023-09-30T17:02:18.356454+0000","last_active":"2023-09-30T17:02:19.357528+0000","last_peered":"2023-09-30T17:02:19.357528+0000","last_clean":"2023-09-30T17:02:19.357528+0000","last_became_active":"2023-09-30T17:02:18.355486+0000","last_became_peered":"2023-09-30T17:02:18.355486+0000","last_unstale":"2023-09-30T17:02:19.357528+0000","last_undegraded":"2023-09-30T17:02:19.357528+0000","last_fullsized":"2023-09-30T17:02:19.357528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:32:34.654264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.294253+0000","last_change":"2023-09-30T17:02:17.363396+0000","last_active":"2023-09-30T17:02:19.294253+0000","last_peered":"2023-09-30T17:02:19.294253+0000","last_clean":"2023-09-30T17:02:19.294253+0000","last_became_active":"2023-09-30T17:02:17.363065+0000","last_became_peered":"2023-09-30T17:02:17.363065+0000","last_unstale":"2023-09-30T17:02:19.294253+0000","last_undegraded":"2023-09-30T17:02:19.294253+0000","last_fullsized":"2023-09-30T17:02:19.294253+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:09:59.154381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357795+0000","last_change":"2023-09-30T17:02:18.358269+0000","last_active":"2023-09-30T17:02:19.357795+0000","last_peered":"2023-09-30T17:02:19.357795+0000","last_clean":"2023-09-30T17:02:19.357795+0000","last_became_active":"2023-09-30T17:02:18.356902+0000","last_became_peered":"2023-09-30T17:02:18.356902+0000","last_unstale":"2023-09-30T17:02:19.357795+0000","last_undegraded":"2023-09-30T17:02:19.357795+0000","last_fullsized":"2023-09-30T17:02:19.357795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:39:28.022201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293693+0000","last_change":"2023-09-30T17:02:17.358568+0000","last_active":"2023-09-30T17:02:19.293693+0000","last_peered":"2023-09-30T17:02:19.293693+0000","last_clean":"2023-09-30T17:02:19.293693+0000","last_became_active":"2023-09-30T17:02:17.357763+0000","last_became_peered":"2023-09-30T17:02:17.357763+0000","last_unstale":"2023-09-30T17:02:19.293693+0000","last_undegraded":"2023-09-30T17:02:19.293693+0000","last_fullsized":"2023-09-30T17:02:19.293693+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:04:22.748557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357224+0000","last_change":"2023-09-30T17:02:18.376236+0000","last_active":"2023-09-30T17:02:19.357224+0000","last_peered":"2023-09-30T17:02:19.357224+0000","last_clean":"2023-09-30T17:02:19.357224+0000","last_became_active":"2023-09-30T17:02:18.374853+0000","last_became_peered":"2023-09-30T17:02:18.374853+0000","last_unstale":"2023-09-30T17:02:19.357224+0000","last_undegraded":"2023-09-30T17:02:19.357224+0000","last_fullsized":"2023-09-30T17:02:19.357224+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:38:15.747647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.294354+0000","last_change":"2023-09-30T17:02:17.363358+0000","last_active":"2023-09-30T17:02:19.294354+0000","last_peered":"2023-09-30T17:02:19.294354+0000","last_clean":"2023-09-30T17:02:19.294354+0000","last_became_active":"2023-09-30T17:02:17.363003+0000","last_became_peered":"2023-09-30T17:02:17.363003+0000","last_unstale":"2023-09-30T17:02:19.294354+0000","last_undegraded":"2023-09-30T17:02:19.294354+0000","last_fullsized":"2023-09-30T17:02:19.294354+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:27:37.446407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.356604+0000","last_change":"2023-09-30T17:02:18.362117+0000","last_active":"2023-09-30T17:02:19.356604+0000","last_peered":"2023-09-30T17:02:19.356604+0000","last_clean":"2023-09-30T17:02:19.356604+0000","last_became_active":"2023-09-30T17:02:18.361463+0000","last_became_peered":"2023-09-30T17:02:18.361463+0000","last_unstale":"2023-09-30T17:02:19.356604+0000","last_undegraded":"2023-09-30T17:02:19.356604+0000","last_fullsized":"2023-09-30T17:02:19.356604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:37:14.790993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293869+0000","last_change":"2023-09-30T17:02:17.360802+0000","last_active":"2023-09-30T17:02:19.293869+0000","last_peered":"2023-09-30T17:02:19.293869+0000","last_clean":"2023-09-30T17:02:19.293869+0000","last_became_active":"2023-09-30T17:02:17.360475+0000","last_became_peered":"2023-09-30T17:02:17.360475+0000","last_unstale":"2023-09-30T17:02:19.293869+0000","last_undegraded":"2023-09-30T17:02:19.293869+0000","last_fullsized":"2023-09-30T17:02:19.293869+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:50:18.455188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357745+0000","last_change":"2023-09-30T17:02:18.359857+0000","last_active":"2023-09-30T17:02:19.357745+0000","last_peered":"2023-09-30T17:02:19.357745+0000","last_clean":"2023-09-30T17:02:19.357745+0000","last_became_active":"2023-09-30T17:02:18.357098+0000","last_became_peered":"2023-09-30T17:02:18.357098+0000","last_unstale":"2023-09-30T17:02:19.357745+0000","last_undegraded":"2023-09-30T17:02:19.357745+0000","last_fullsized":"2023-09-30T17:02:19.357745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:48:17.598726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293936+0000","last_change":"2023-09-30T17:02:17.364479+0000","last_active":"2023-09-30T17:02:19.293936+0000","last_peered":"2023-09-30T17:02:19.293936+0000","last_clean":"2023-09-30T17:02:19.293936+0000","last_became_active":"2023-09-30T17:02:17.364215+0000","last_became_peered":"2023-09-30T17:02:17.364215+0000","last_unstale":"2023-09-30T17:02:19.293936+0000","last_undegraded":"2023-09-30T17:02:19.293936+0000","last_fullsized":"2023-09-30T17:02:19.293936+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:01:31.158446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.356645+0000","last_change":"2023-09-30T17:02:18.375778+0000","last_active":"2023-09-30T17:02:19.356645+0000","last_peered":"2023-09-30T17:02:19.356645+0000","last_clean":"2023-09-30T17:02:19.356645+0000","last_became_active":"2023-09-30T17:02:18.374620+0000","last_became_peered":"2023-09-30T17:02:18.374620+0000","last_unstale":"2023-09-30T17:02:19.356645+0000","last_undegraded":"2023-09-30T17:02:19.356645+0000","last_fullsized":"2023-09-30T17:02:19.356645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:50:52.893768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.356459+0000","last_change":"2023-09-30T17:02:18.362804+0000","last_active":"2023-09-30T17:02:19.356459+0000","last_peered":"2023-09-30T17:02:19.356459+0000","last_clean":"2023-09-30T17:02:19.356459+0000","last_became_active":"2023-09-30T17:02:18.362392+0000","last_became_peered":"2023-09-30T17:02:18.362392+0000","last_unstale":"2023-09-30T17:02:19.356459+0000","last_undegraded":"2023-09-30T17:02:19.356459+0000","last_fullsized":"2023-09-30T17:02:19.356459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:39:28.022201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.363559+0000","last_change":"2023-09-30T17:02:18.363479+0000","last_active":"2023-09-30T17:02:19.363559+0000","last_peered":"2023-09-30T17:02:19.363559+0000","last_clean":"2023-09-30T17:02:19.363559+0000","last_became_active":"2023-09-30T17:02:18.363222+0000","last_became_peered":"2023-09-30T17:02:18.363222+0000","last_unstale":"2023-09-30T17:02:19.363559+0000","last_undegraded":"2023-09-30T17:02:19.363559+0000","last_fullsized":"2023-09-30T17:02:19.363559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:09:55.056098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357778+0000","last_change":"2023-09-30T17:02:18.362764+0000","last_active":"2023-09-30T17:02:19.357778+0000","last_peered":"2023-09-30T17:02:19.357778+0000","last_clean":"2023-09-30T17:02:19.357778+0000","last_became_active":"2023-09-30T17:02:18.362369+0000","last_became_peered":"2023-09-30T17:02:18.362369+0000","last_unstale":"2023-09-30T17:02:19.357778+0000","last_undegraded":"2023-09-30T17:02:19.357778+0000","last_fullsized":"2023-09-30T17:02:19.357778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:14:35.192615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.363865+0000","last_change":"2023-09-30T17:02:18.363216+0000","last_active":"2023-09-30T17:02:19.363865+0000","last_peered":"2023-09-30T17:02:19.363865+0000","last_clean":"2023-09-30T17:02:19.363865+0000","last_became_active":"2023-09-30T17:02:18.362894+0000","last_became_peered":"2023-09-30T17:02:18.362894+0000","last_unstale":"2023-09-30T17:02:19.363865+0000","last_undegraded":"2023-09-30T17:02:19.363865+0000","last_fullsized":"2023-09-30T17:02:19.363865+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:30:43.782165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357920+0000","last_change":"2023-09-30T17:02:18.356827+0000","last_active":"2023-09-30T17:02:19.357920+0000","last_peered":"2023-09-30T17:02:19.357920+0000","last_clean":"2023-09-30T17:02:19.357920+0000","last_became_active":"2023-09-30T17:02:18.355965+0000","last_became_peered":"2023-09-30T17:02:18.355965+0000","last_unstale":"2023-09-30T17:02:19.357920+0000","last_undegraded":"2023-09-30T17:02:19.357920+0000","last_fullsized":"2023-09-30T17:02:19.357920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:50:52.893768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738375,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":790528,"data_stored":650475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51700000000000002}]}]},{"osd":0,"up_from":8,"seq":34359738375,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":782336,"data_stored":649859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40300000000000002}]}]},{"osd":1,"up_from":8,"seq":34359738375,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":172032,"data_stored":58313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T17:02:28.239 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-09-30T17:02:28.239 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-09-30T17:02:28.240 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-09-30T17:02:28.240 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T17:02:28.655 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:02:28.655 INFO:teuthology.orchestra.run.smithi007.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-09-30T17:02:28.669 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-09-30T17:02:28.669 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T17:02:29.006 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:02:29.006 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":19,"fsid":"68daccc3-6ea9-4db7-9771-3803ff202df8","created":"2023-09-30T17:01:55.306262+0000","modified":"2023-09-30T17:02:19.350385+0000","last_up_change":"2023-09-30T17:02:04.210987+0000","last_in_change":"2023-09-30T17:01:56.571968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T17:02:05.343048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T17:02:11.033979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T17:02:15.583451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T17:02:16.734427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9d1653a-8830-4fad-911b-8e7221ee8697","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6801","nonce":2212861041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6803","nonce":2212861041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6807","nonce":2212861041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6805","nonce":2212861041}]},"public_addr":"172.21.15.31:6801/2212861041","cluster_addr":"172.21.15.31:6803/2212861041","heartbeat_back_addr":"172.21.15.31:6807/2212861041","heartbeat_front_addr":"172.21.15.31:6805/2212861041","state":["exists","up"]},{"osd":1,"uuid":"7123aa56-aa1a-43a4-b154-a40b4c70d169","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6801","nonce":1680420094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6803","nonce":1680420094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6807","nonce":1680420094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6805","nonce":1680420094}]},"public_addr":"172.21.15.72:6801/1680420094","cluster_addr":"172.21.15.72:6803/1680420094","heartbeat_back_addr":"172.21.15.72:6807/1680420094","heartbeat_front_addr":"172.21.15.72:6805/1680420094","state":["exists","up"]},{"osd":2,"uuid":"f40ee0d7-7bc3-4a46-bdac-9c134c55c907","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6801","nonce":1018866543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6803","nonce":1018866543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6807","nonce":1018866543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6805","nonce":1018866543}]},"public_addr":"172.21.15.134:6801/1018866543","cluster_addr":"172.21.15.134:6803/1018866543","heartbeat_back_addr":"172.21.15.134:6807/1018866543","heartbeat_front_addr":"172.21.15.134:6805/1018866543","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T17:02:01.702754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T17:02:01.688791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T17:02:01.667971+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T17:02:29.020 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T17:02:05.343048+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T17:02:11.033979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T17:02:15.583451+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T17:02:16.734427+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T17:02:29.021 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T17:02:29.358 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2023-09-30T17:02:29.372 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T17:02:29.709 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 8 2023-09-30T17:02:29.722 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T17:02:30.059 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2023-09-30T17:02:30.073 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T17:02:30.415 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2023-09-30T17:02:30.429 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T17:02:30.809 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:02:30.809 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T17:02:17.752800+0000","modified":"2023-09-30T17:02:20.768438+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4208},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4208":{"gid":4208,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6803/3885497469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":3885497469},{"type":"v1","addr":"172.21.15.7:6803","nonce":3885497469}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-30T17:02:30.812 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 6 2023-09-30T17:02:30.824 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T17:02:31.162 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:02:31.162 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":19,"fsid":"68daccc3-6ea9-4db7-9771-3803ff202df8","created":"2023-09-30T17:01:55.306262+0000","modified":"2023-09-30T17:02:19.350385+0000","last_up_change":"2023-09-30T17:02:04.210987+0000","last_in_change":"2023-09-30T17:01:56.571968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T17:02:05.343048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T17:02:11.033979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T17:02:15.583451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T17:02:16.734427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9d1653a-8830-4fad-911b-8e7221ee8697","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6801","nonce":2212861041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6803","nonce":2212861041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6807","nonce":2212861041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6805","nonce":2212861041}]},"public_addr":"172.21.15.31:6801/2212861041","cluster_addr":"172.21.15.31:6803/2212861041","heartbeat_back_addr":"172.21.15.31:6807/2212861041","heartbeat_front_addr":"172.21.15.31:6805/2212861041","state":["exists","up"]},{"osd":1,"uuid":"7123aa56-aa1a-43a4-b154-a40b4c70d169","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6801","nonce":1680420094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6803","nonce":1680420094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6807","nonce":1680420094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6805","nonce":1680420094}]},"public_addr":"172.21.15.72:6801/1680420094","cluster_addr":"172.21.15.72:6803/1680420094","heartbeat_back_addr":"172.21.15.72:6807/1680420094","heartbeat_front_addr":"172.21.15.72:6805/1680420094","state":["exists","up"]},{"osd":2,"uuid":"f40ee0d7-7bc3-4a46-bdac-9c134c55c907","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6801","nonce":1018866543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6803","nonce":1018866543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6807","nonce":1018866543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6805","nonce":1018866543}]},"public_addr":"172.21.15.134:6801/1018866543","cluster_addr":"172.21.15.134:6803/1018866543","heartbeat_back_addr":"172.21.15.134:6807/1018866543","heartbeat_front_addr":"172.21.15.134:6805/1018866543","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T17:02:01.702754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T17:02:01.688791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T17:02:01.667971+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T17:02:31.176 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T17:02:05.343048+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T17:02:11.033979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T17:02:15.583451+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T17:02:16.734427+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T17:02:31.176 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T17:02:31.515 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2023-09-30T17:02:31.529 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T17:02:31.864 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 8 2023-09-30T17:02:31.878 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T17:02:32.216 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2023-09-30T17:02:32.231 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T17:02:32.571 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2023-09-30T17:02:32.585 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T17:02:32.962 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:02:32.963 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T17:02:17.752800+0000","modified":"2023-09-30T17:02:20.768438+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4208},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4208":{"gid":4208,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6803/3885497469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":3885497469},{"type":"v1","addr":"172.21.15.7:6803","nonce":3885497469}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-30T17:02:32.965 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 6 2023-09-30T17:02:32.978 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T17:02:33.317 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:02:33.317 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":19,"fsid":"68daccc3-6ea9-4db7-9771-3803ff202df8","created":"2023-09-30T17:01:55.306262+0000","modified":"2023-09-30T17:02:19.350385+0000","last_up_change":"2023-09-30T17:02:04.210987+0000","last_in_change":"2023-09-30T17:01:56.571968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T17:02:05.343048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T17:02:11.033979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T17:02:15.583451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T17:02:16.734427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9d1653a-8830-4fad-911b-8e7221ee8697","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6801","nonce":2212861041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6803","nonce":2212861041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6807","nonce":2212861041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6805","nonce":2212861041}]},"public_addr":"172.21.15.31:6801/2212861041","cluster_addr":"172.21.15.31:6803/2212861041","heartbeat_back_addr":"172.21.15.31:6807/2212861041","heartbeat_front_addr":"172.21.15.31:6805/2212861041","state":["exists","up"]},{"osd":1,"uuid":"7123aa56-aa1a-43a4-b154-a40b4c70d169","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6801","nonce":1680420094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6803","nonce":1680420094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6807","nonce":1680420094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6805","nonce":1680420094}]},"public_addr":"172.21.15.72:6801/1680420094","cluster_addr":"172.21.15.72:6803/1680420094","heartbeat_back_addr":"172.21.15.72:6807/1680420094","heartbeat_front_addr":"172.21.15.72:6805/1680420094","state":["exists","up"]},{"osd":2,"uuid":"f40ee0d7-7bc3-4a46-bdac-9c134c55c907","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6801","nonce":1018866543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6803","nonce":1018866543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6807","nonce":1018866543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6805","nonce":1018866543}]},"public_addr":"172.21.15.134:6801/1018866543","cluster_addr":"172.21.15.134:6803/1018866543","heartbeat_back_addr":"172.21.15.134:6807/1018866543","heartbeat_front_addr":"172.21.15.134:6805/1018866543","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T17:02:01.702754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T17:02:01.688791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T17:02:01.667971+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T17:02:33.331 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T17:02:33.711 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:02:33.711 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T17:02:17.752800+0000","modified":"2023-09-30T17:02:20.768438+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4208},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4208":{"gid":4208,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6803/3885497469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":3885497469},{"type":"v1","addr":"172.21.15.7:6803","nonce":3885497469}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-30T17:02:33.714 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 6 2023-09-30T17:02:33.827 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-09-30T17:02:17.752800+0000', 'modified': '2023-09-30T17:02:20.768438+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4208}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4208': {'gid': 4208, 'name': 'a', 'rank': 0, 'incarnation': 3, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.7:6803/3885497469', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.7:6802', 'nonce': 3885497469}, {'type': 'v1', 'addr': '172.21.15.7:6803', 'nonce': 3885497469}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-09-30T17:02:33.827 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-09-30T17:02:33.827 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-09-30T17:02:33.967 INFO:teuthology.orchestra.run.smithi007.stderr:2023-09-30T17:02:33.966+0000 7f8dfeffd700 0 client.4611 ms_handle_reset on v2:172.21.15.7:6802/3885497469 2023-09-30T17:02:33.990 INFO:teuthology.orchestra.run.smithi007.stderr:2023-09-30T17:02:33.989+0000 7f8dfeffd700 0 client.4499 ms_handle_reset on v2:172.21.15.7:6802/3885497469 2023-09-30T17:02:33.990 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-09-30T17:02:33.991 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_fsid": "68daccc3-6ea9-4db7-9771-3803ff202df8", 2023-09-30T17:02:33.991 INFO:teuthology.orchestra.run.smithi007.stdout: "whoami": 0, 2023-09-30T17:02:33.991 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 4208, 2023-09-30T17:02:33.991 INFO:teuthology.orchestra.run.smithi007.stdout: "want_state": "up:active", 2023-09-30T17:02:33.991 INFO:teuthology.orchestra.run.smithi007.stdout: "state": "up:active", 2023-09-30T17:02:33.991 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs", 2023-09-30T17:02:33.991 INFO:teuthology.orchestra.run.smithi007.stdout: "rank_uptime": 15.644081036999999, 2023-09-30T17:02:33.991 INFO:teuthology.orchestra.run.smithi007.stdout: "mdsmap_epoch": 6, 2023-09-30T17:02:33.991 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch": 19, 2023-09-30T17:02:33.991 INFO:teuthology.orchestra.run.smithi007.stdout: "osdmap_epoch_barrier": 19, 2023-09-30T17:02:33.991 INFO:teuthology.orchestra.run.smithi007.stdout: "uptime": 21.557028714000001 2023-09-30T17:02:33.991 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-09-30T17:02:34.003 INFO:teuthology.run_tasks:Running task thrashosds... 2023-09-30T17:02:34.013 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2023-09-30T17:02:34.013 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'main'}, 'ceph': {'conf': {'global': {'osd_pg_log_dups_tracked': 10000}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(MDS_TRIM\\)', '\\(MDS_SLOW_REQUEST\\)', 'MDS_SLOW_METADATA_IO', 'Behind on trimming', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from'], 'sha1': '1d10b71792f3be8887a7631e69851ac2df3585af'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '1d10b71792f3be8887a7631e69851ac2df3585af'}}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'main', 'sha1': '1d10b71792f3be8887a7631e69851ac2df3585af'}} 2023-09-30T17:02:34.014 INFO:tasks.thrashosds:config is {'chance_down': 1.0, 'powercycle': True, 'timeout': 600, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2023-09-30T17:02:34.014 INFO:tasks.thrashosds:Doing preliminary sync to avoid collateral damage... 2023-09-30T17:02:34.014 DEBUG:teuthology.orchestra.run.smithi007:> sync 2023-09-30T17:02:34.163 DEBUG:teuthology.orchestra.run.smithi031:> sync 2023-09-30T17:02:34.251 DEBUG:teuthology.orchestra.run.smithi072:> sync 2023-09-30T17:02:34.399 DEBUG:teuthology.orchestra.run.smithi134:> sync 2023-09-30T17:02:34.587 DEBUG:tasks.thrashosds:checking console status of smithi007 2023-09-30T17:02:34.587 DEBUG:teuthology.orchestra.console.smithi007:Waiting for login prompt 2023-09-30T17:02:34.587 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi007 2023-09-30T17:02:34.763 DEBUG:teuthology.orchestra.console.smithi007:expect before: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-372.9.1.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2023-09-30T17:02:34.763 DEBUG:teuthology.orchestra.console.smithi007:expect after: smithi007 login: 2023-09-30T17:02:34.815 DEBUG:teuthology.orchestra.console.smithi007:console disconnect output: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-372.9.1.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi007 login: [disconnect] 2023-09-30T17:02:34.917 DEBUG:tasks.thrashosds:checking console status of smithi031 2023-09-30T17:02:34.917 DEBUG:teuthology.orchestra.console.smithi031:Waiting for login prompt 2023-09-30T17:02:34.917 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi031 2023-09-30T17:02:35.090 DEBUG:teuthology.orchestra.console.smithi031:expect before: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-372.9.1.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2023-09-30T17:02:35.090 DEBUG:teuthology.orchestra.console.smithi031:expect after: smithi031 login: 2023-09-30T17:02:35.142 DEBUG:teuthology.orchestra.console.smithi031:console disconnect output: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-372.9.1.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi031 login: [disconnect] 2023-09-30T17:02:35.244 DEBUG:tasks.thrashosds:checking console status of smithi072 2023-09-30T17:02:35.244 DEBUG:teuthology.orchestra.console.smithi072:Waiting for login prompt 2023-09-30T17:02:35.244 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi072 2023-09-30T17:02:35.347 DEBUG:teuthology.orchestra.console.smithi072:expect before: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-372.9.1.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2023-09-30T17:02:35.347 DEBUG:teuthology.orchestra.console.smithi072:expect after: smithi072 login: 2023-09-30T17:02:35.399 DEBUG:teuthology.orchestra.console.smithi072:console disconnect output: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-372.9.1.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi072 login: [disconnect] 2023-09-30T17:02:35.501 DEBUG:tasks.thrashosds:checking console status of smithi134 2023-09-30T17:02:35.501 DEBUG:teuthology.orchestra.console.smithi134:Waiting for login prompt 2023-09-30T17:02:35.501 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi134 2023-09-30T17:02:35.683 DEBUG:teuthology.orchestra.console.smithi134:expect before: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-372.9.1.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2023-09-30T17:02:35.683 DEBUG:teuthology.orchestra.console.smithi134:expect after: smithi134 login: 2023-09-30T17:02:35.735 DEBUG:teuthology.orchestra.console.smithi134:console disconnect output: [Enter `^Ec?' for help] Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-372.9.1.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi134 login: [disconnect] 2023-09-30T17:02:35.837 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2023-09-30T17:02:36.211 INFO:tasks.thrashosds:Beginning thrashosds... 2023-09-30T17:02:36.211 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-09-30T17:02:36.211 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T17:02:36.554 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:02:36.556 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-09-30T17:02:36.566 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2023-09-30T17:02:35.292292+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":86936,"kb_used_data":1704,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":283028584,"statfs":{"total":289910292480,"available":289821270016,"internally_reserved":0,"allocated":1744896,"data_stored":1358647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4781,"internal_metadata":87223635},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002431"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.358721+0000","last_change":"2023-09-30T17:02:18.360288+0000","last_active":"2023-09-30T17:02:19.358721+0000","last_peered":"2023-09-30T17:02:19.358721+0000","last_clean":"2023-09-30T17:02:19.358721+0000","last_became_active":"2023-09-30T17:02:18.358716+0000","last_became_peered":"2023-09-30T17:02:18.358716+0000","last_unstale":"2023-09-30T17:02:19.358721+0000","last_undegraded":"2023-09-30T17:02:19.358721+0000","last_fullsized":"2023-09-30T17:02:19.358721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:12:06.380095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.358288+0000","last_change":"2023-09-30T17:02:18.362418+0000","last_active":"2023-09-30T17:02:19.358288+0000","last_peered":"2023-09-30T17:02:19.358288+0000","last_clean":"2023-09-30T17:02:19.358288+0000","last_became_active":"2023-09-30T17:02:18.360372+0000","last_became_peered":"2023-09-30T17:02:18.360372+0000","last_unstale":"2023-09-30T17:02:19.358288+0000","last_undegraded":"2023-09-30T17:02:19.358288+0000","last_fullsized":"2023-09-30T17:02:19.358288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:43:29.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357605+0000","last_change":"2023-09-30T17:02:18.373609+0000","last_active":"2023-09-30T17:02:19.357605+0000","last_peered":"2023-09-30T17:02:19.357605+0000","last_clean":"2023-09-30T17:02:19.357605+0000","last_became_active":"2023-09-30T17:02:18.372911+0000","last_became_peered":"2023-09-30T17:02:18.372911+0000","last_unstale":"2023-09-30T17:02:19.357605+0000","last_undegraded":"2023-09-30T17:02:19.357605+0000","last_fullsized":"2023-09-30T17:02:19.357605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:36:10.602697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357569+0000","last_change":"2023-09-30T17:02:18.377247+0000","last_active":"2023-09-30T17:02:19.357569+0000","last_peered":"2023-09-30T17:02:19.357569+0000","last_clean":"2023-09-30T17:02:19.357569+0000","last_became_active":"2023-09-30T17:02:18.376351+0000","last_became_peered":"2023-09-30T17:02:18.376351+0000","last_unstale":"2023-09-30T17:02:19.357569+0000","last_undegraded":"2023-09-30T17:02:19.357569+0000","last_fullsized":"2023-09-30T17:02:19.357569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:51:00.454897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357833+0000","last_change":"2023-09-30T17:02:18.360192+0000","last_active":"2023-09-30T17:02:19.357833+0000","last_peered":"2023-09-30T17:02:19.357833+0000","last_clean":"2023-09-30T17:02:19.357833+0000","last_became_active":"2023-09-30T17:02:18.357317+0000","last_became_peered":"2023-09-30T17:02:18.357317+0000","last_unstale":"2023-09-30T17:02:19.357833+0000","last_undegraded":"2023-09-30T17:02:19.357833+0000","last_fullsized":"2023-09-30T17:02:19.357833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:37:14.790993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.356993+0000","last_change":"2023-09-30T17:02:18.376076+0000","last_active":"2023-09-30T17:02:19.356993+0000","last_peered":"2023-09-30T17:02:19.356993+0000","last_clean":"2023-09-30T17:02:19.356993+0000","last_became_active":"2023-09-30T17:02:18.375107+0000","last_became_peered":"2023-09-30T17:02:18.375107+0000","last_unstale":"2023-09-30T17:02:19.356993+0000","last_undegraded":"2023-09-30T17:02:19.356993+0000","last_fullsized":"2023-09-30T17:02:19.356993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:21:45.195007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.356990+0000","last_change":"2023-09-30T17:02:18.360819+0000","last_active":"2023-09-30T17:02:19.356990+0000","last_peered":"2023-09-30T17:02:19.356990+0000","last_clean":"2023-09-30T17:02:19.356990+0000","last_became_active":"2023-09-30T17:02:18.360506+0000","last_became_peered":"2023-09-30T17:02:18.360506+0000","last_unstale":"2023-09-30T17:02:19.356990+0000","last_undegraded":"2023-09-30T17:02:19.356990+0000","last_fullsized":"2023-09-30T17:02:19.356990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:26:11.522402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.356352+0000","last_change":"2023-09-30T17:02:18.362003+0000","last_active":"2023-09-30T17:02:19.356352+0000","last_peered":"2023-09-30T17:02:19.356352+0000","last_clean":"2023-09-30T17:02:19.356352+0000","last_became_active":"2023-09-30T17:02:18.361644+0000","last_became_peered":"2023-09-30T17:02:18.361644+0000","last_unstale":"2023-09-30T17:02:19.356352+0000","last_undegraded":"2023-09-30T17:02:19.356352+0000","last_fullsized":"2023-09-30T17:02:19.356352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:48:17.598726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.364354+0000","last_change":"2023-09-30T17:02:18.364222+0000","last_active":"2023-09-30T17:02:19.364354+0000","last_peered":"2023-09-30T17:02:19.364354+0000","last_clean":"2023-09-30T17:02:19.364354+0000","last_became_active":"2023-09-30T17:02:18.363485+0000","last_became_peered":"2023-09-30T17:02:18.363485+0000","last_unstale":"2023-09-30T17:02:19.364354+0000","last_undegraded":"2023-09-30T17:02:19.364354+0000","last_fullsized":"2023-09-30T17:02:19.364354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:14:35.192615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.358415+0000","last_change":"2023-09-30T17:02:18.360010+0000","last_active":"2023-09-30T17:02:19.358415+0000","last_peered":"2023-09-30T17:02:19.358415+0000","last_clean":"2023-09-30T17:02:19.358415+0000","last_became_active":"2023-09-30T17:02:18.358396+0000","last_became_peered":"2023-09-30T17:02:18.358396+0000","last_unstale":"2023-09-30T17:02:19.358415+0000","last_undegraded":"2023-09-30T17:02:19.358415+0000","last_fullsized":"2023-09-30T17:02:19.358415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:26:11.522402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357494+0000","last_change":"2023-09-30T17:02:18.375829+0000","last_active":"2023-09-30T17:02:19.357494+0000","last_peered":"2023-09-30T17:02:19.357494+0000","last_clean":"2023-09-30T17:02:19.357494+0000","last_became_active":"2023-09-30T17:02:18.374447+0000","last_became_peered":"2023-09-30T17:02:18.374447+0000","last_unstale":"2023-09-30T17:02:19.357494+0000","last_undegraded":"2023-09-30T17:02:19.357494+0000","last_fullsized":"2023-09-30T17:02:19.357494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:02:46.638397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357284+0000","last_change":"2023-09-30T17:02:18.373777+0000","last_active":"2023-09-30T17:02:19.357284+0000","last_peered":"2023-09-30T17:02:19.357284+0000","last_clean":"2023-09-30T17:02:19.357284+0000","last_became_active":"2023-09-30T17:02:18.373434+0000","last_became_peered":"2023-09-30T17:02:18.373434+0000","last_unstale":"2023-09-30T17:02:19.357284+0000","last_undegraded":"2023-09-30T17:02:19.357284+0000","last_fullsized":"2023-09-30T17:02:19.357284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:13:30.688369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357496+0000","last_change":"2023-09-30T17:02:18.359894+0000","last_active":"2023-09-30T17:02:19.357496+0000","last_peered":"2023-09-30T17:02:19.357496+0000","last_clean":"2023-09-30T17:02:19.357496+0000","last_became_active":"2023-09-30T17:02:18.358534+0000","last_became_peered":"2023-09-30T17:02:18.358534+0000","last_unstale":"2023-09-30T17:02:19.357496+0000","last_undegraded":"2023-09-30T17:02:19.357496+0000","last_fullsized":"2023-09-30T17:02:19.357496+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:22:13.025181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.356892+0000","last_change":"2023-09-30T17:02:18.374094+0000","last_active":"2023-09-30T17:02:19.356892+0000","last_peered":"2023-09-30T17:02:19.356892+0000","last_clean":"2023-09-30T17:02:19.356892+0000","last_became_active":"2023-09-30T17:02:18.373165+0000","last_became_peered":"2023-09-30T17:02:18.373165+0000","last_unstale":"2023-09-30T17:02:19.356892+0000","last_undegraded":"2023-09-30T17:02:19.356892+0000","last_fullsized":"2023-09-30T17:02:19.356892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:13:55.555700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.356482+0000","last_change":"2023-09-30T17:02:18.372075+0000","last_active":"2023-09-30T17:02:19.356482+0000","last_peered":"2023-09-30T17:02:19.356482+0000","last_clean":"2023-09-30T17:02:19.356482+0000","last_became_active":"2023-09-30T17:02:18.371685+0000","last_became_peered":"2023-09-30T17:02:18.371685+0000","last_unstale":"2023-09-30T17:02:19.356482+0000","last_undegraded":"2023-09-30T17:02:19.356482+0000","last_fullsized":"2023-09-30T17:02:19.356482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:14:35.192615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.356801+0000","last_change":"2023-09-30T17:02:18.376370+0000","last_active":"2023-09-30T17:02:19.356801+0000","last_peered":"2023-09-30T17:02:19.356801+0000","last_clean":"2023-09-30T17:02:19.356801+0000","last_became_active":"2023-09-30T17:02:18.375027+0000","last_became_peered":"2023-09-30T17:02:18.375027+0000","last_unstale":"2023-09-30T17:02:19.356801+0000","last_undegraded":"2023-09-30T17:02:19.356801+0000","last_fullsized":"2023-09-30T17:02:19.356801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:43:29.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.364415+0000","last_change":"2023-09-30T17:02:18.364360+0000","last_active":"2023-09-30T17:02:19.364415+0000","last_peered":"2023-09-30T17:02:19.364415+0000","last_clean":"2023-09-30T17:02:19.364415+0000","last_became_active":"2023-09-30T17:02:18.363697+0000","last_became_peered":"2023-09-30T17:02:18.363697+0000","last_unstale":"2023-09-30T17:02:19.364415+0000","last_undegraded":"2023-09-30T17:02:19.364415+0000","last_fullsized":"2023-09-30T17:02:19.364415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:50:52.893768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.358560+0000","last_change":"2023-09-30T17:02:18.360320+0000","last_active":"2023-09-30T17:02:19.358560+0000","last_peered":"2023-09-30T17:02:19.358560+0000","last_clean":"2023-09-30T17:02:19.358560+0000","last_became_active":"2023-09-30T17:02:18.357184+0000","last_became_peered":"2023-09-30T17:02:18.357184+0000","last_unstale":"2023-09-30T17:02:19.358560+0000","last_undegraded":"2023-09-30T17:02:19.358560+0000","last_fullsized":"2023-09-30T17:02:19.358560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:21:45.195007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.364138+0000","last_change":"2023-09-30T17:02:18.363956+0000","last_active":"2023-09-30T17:02:19.364138+0000","last_peered":"2023-09-30T17:02:19.364138+0000","last_clean":"2023-09-30T17:02:19.364138+0000","last_became_active":"2023-09-30T17:02:18.363654+0000","last_became_peered":"2023-09-30T17:02:18.363654+0000","last_unstale":"2023-09-30T17:02:19.364138+0000","last_undegraded":"2023-09-30T17:02:19.364138+0000","last_fullsized":"2023-09-30T17:02:19.364138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:48:17.598726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357324+0000","last_change":"2023-09-30T17:02:18.377065+0000","last_active":"2023-09-30T17:02:19.357324+0000","last_peered":"2023-09-30T17:02:19.357324+0000","last_clean":"2023-09-30T17:02:19.357324+0000","last_became_active":"2023-09-30T17:02:18.375158+0000","last_became_peered":"2023-09-30T17:02:18.375158+0000","last_unstale":"2023-09-30T17:02:19.357324+0000","last_undegraded":"2023-09-30T17:02:19.357324+0000","last_fullsized":"2023-09-30T17:02:19.357324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:12:06.380095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357361+0000","last_change":"2023-09-30T17:02:18.376206+0000","last_active":"2023-09-30T17:02:19.357361+0000","last_peered":"2023-09-30T17:02:19.357361+0000","last_clean":"2023-09-30T17:02:19.357361+0000","last_became_active":"2023-09-30T17:02:18.374694+0000","last_became_peered":"2023-09-30T17:02:18.374694+0000","last_unstale":"2023-09-30T17:02:19.357361+0000","last_undegraded":"2023-09-30T17:02:19.357361+0000","last_fullsized":"2023-09-30T17:02:19.357361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:43:17.634140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357322+0000","last_change":"2023-09-30T17:02:18.362977+0000","last_active":"2023-09-30T17:02:19.357322+0000","last_peered":"2023-09-30T17:02:19.357322+0000","last_clean":"2023-09-30T17:02:19.357322+0000","last_became_active":"2023-09-30T17:02:18.362657+0000","last_became_peered":"2023-09-30T17:02:18.362657+0000","last_unstale":"2023-09-30T17:02:19.357322+0000","last_undegraded":"2023-09-30T17:02:19.357322+0000","last_fullsized":"2023-09-30T17:02:19.357322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:15:54.364571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.363751+0000","last_change":"2023-09-30T17:02:18.361158+0000","last_active":"2023-09-30T17:02:19.363751+0000","last_peered":"2023-09-30T17:02:19.363751+0000","last_clean":"2023-09-30T17:02:19.363751+0000","last_became_active":"2023-09-30T17:02:18.360840+0000","last_became_peered":"2023-09-30T17:02:18.360840+0000","last_unstale":"2023-09-30T17:02:19.363751+0000","last_undegraded":"2023-09-30T17:02:19.363751+0000","last_fullsized":"2023-09-30T17:02:19.363751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:22:13.025181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357297+0000","last_change":"2023-09-30T17:02:18.353938+0000","last_active":"2023-09-30T17:02:19.357297+0000","last_peered":"2023-09-30T17:02:19.357297+0000","last_clean":"2023-09-30T17:02:19.357297+0000","last_became_active":"2023-09-30T17:02:18.353632+0000","last_became_peered":"2023-09-30T17:02:18.353632+0000","last_unstale":"2023-09-30T17:02:19.357297+0000","last_undegraded":"2023-09-30T17:02:19.357297+0000","last_fullsized":"2023-09-30T17:02:19.357297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:09:55.056098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.358593+0000","last_change":"2023-09-30T17:02:18.360801+0000","last_active":"2023-09-30T17:02:19.358593+0000","last_peered":"2023-09-30T17:02:19.358593+0000","last_clean":"2023-09-30T17:02:19.358593+0000","last_became_active":"2023-09-30T17:02:18.358862+0000","last_became_peered":"2023-09-30T17:02:18.358862+0000","last_unstale":"2023-09-30T17:02:19.358593+0000","last_undegraded":"2023-09-30T17:02:19.358593+0000","last_fullsized":"2023-09-30T17:02:19.358593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:55:15.512558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.364354+0000","last_change":"2023-09-30T17:02:18.355710+0000","last_active":"2023-09-30T17:02:19.364354+0000","last_peered":"2023-09-30T17:02:19.364354+0000","last_clean":"2023-09-30T17:02:19.364354+0000","last_became_active":"2023-09-30T17:02:18.355423+0000","last_became_peered":"2023-09-30T17:02:18.355423+0000","last_unstale":"2023-09-30T17:02:19.364354+0000","last_undegraded":"2023-09-30T17:02:19.364354+0000","last_fullsized":"2023-09-30T17:02:19.364354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:39:28.022201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357840+0000","last_change":"2023-09-30T17:02:18.377164+0000","last_active":"2023-09-30T17:02:19.357840+0000","last_peered":"2023-09-30T17:02:19.357840+0000","last_clean":"2023-09-30T17:02:19.357840+0000","last_became_active":"2023-09-30T17:02:18.376425+0000","last_became_peered":"2023-09-30T17:02:18.376425+0000","last_unstale":"2023-09-30T17:02:19.357840+0000","last_undegraded":"2023-09-30T17:02:19.357840+0000","last_fullsized":"2023-09-30T17:02:19.357840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:20:53.357746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.294200+0000","last_change":"2023-09-30T17:02:17.358258+0000","last_active":"2023-09-30T17:02:19.294200+0000","last_peered":"2023-09-30T17:02:19.294200+0000","last_clean":"2023-09-30T17:02:19.294200+0000","last_became_active":"2023-09-30T17:02:17.357890+0000","last_became_peered":"2023-09-30T17:02:17.357890+0000","last_unstale":"2023-09-30T17:02:19.294200+0000","last_undegraded":"2023-09-30T17:02:19.294200+0000","last_fullsized":"2023-09-30T17:02:19.294200+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:52:56.591906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.358102+0000","last_change":"2023-09-30T17:02:18.358843+0000","last_active":"2023-09-30T17:02:19.358102+0000","last_peered":"2023-09-30T17:02:19.358102+0000","last_clean":"2023-09-30T17:02:19.358102+0000","last_became_active":"2023-09-30T17:02:18.357966+0000","last_became_peered":"2023-09-30T17:02:18.357966+0000","last_unstale":"2023-09-30T17:02:19.358102+0000","last_undegraded":"2023-09-30T17:02:19.358102+0000","last_fullsized":"2023-09-30T17:02:19.358102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:13:55.555700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293653+0000","last_change":"2023-09-30T17:02:17.363387+0000","last_active":"2023-09-30T17:02:19.293653+0000","last_peered":"2023-09-30T17:02:19.293653+0000","last_clean":"2023-09-30T17:02:19.293653+0000","last_became_active":"2023-09-30T17:02:17.363042+0000","last_became_peered":"2023-09-30T17:02:17.363042+0000","last_unstale":"2023-09-30T17:02:19.293653+0000","last_undegraded":"2023-09-30T17:02:19.293653+0000","last_fullsized":"2023-09-30T17:02:19.293653+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:38:57.098312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.364401+0000","last_change":"2023-09-30T17:02:18.355398+0000","last_active":"2023-09-30T17:02:19.364401+0000","last_peered":"2023-09-30T17:02:19.364401+0000","last_clean":"2023-09-30T17:02:19.364401+0000","last_became_active":"2023-09-30T17:02:18.355006+0000","last_became_peered":"2023-09-30T17:02:18.355006+0000","last_unstale":"2023-09-30T17:02:19.364401+0000","last_undegraded":"2023-09-30T17:02:19.364401+0000","last_fullsized":"2023-09-30T17:02:19.364401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:37:14.790993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293603+0000","last_change":"2023-09-30T17:02:17.361000+0000","last_active":"2023-09-30T17:02:19.293603+0000","last_peered":"2023-09-30T17:02:19.293603+0000","last_clean":"2023-09-30T17:02:19.293603+0000","last_became_active":"2023-09-30T17:02:17.360601+0000","last_became_peered":"2023-09-30T17:02:17.360601+0000","last_unstale":"2023-09-30T17:02:19.293603+0000","last_undegraded":"2023-09-30T17:02:19.293603+0000","last_fullsized":"2023-09-30T17:02:19.293603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:02:27.666526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.358593+0000","last_change":"2023-09-30T17:02:18.363570+0000","last_active":"2023-09-30T17:02:19.358593+0000","last_peered":"2023-09-30T17:02:19.358593+0000","last_clean":"2023-09-30T17:02:19.358593+0000","last_became_active":"2023-09-30T17:02:18.362961+0000","last_became_peered":"2023-09-30T17:02:18.362961+0000","last_unstale":"2023-09-30T17:02:19.358593+0000","last_undegraded":"2023-09-30T17:02:19.358593+0000","last_fullsized":"2023-09-30T17:02:19.358593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:38:15.747647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293949+0000","last_change":"2023-09-30T17:02:17.364672+0000","last_active":"2023-09-30T17:02:19.293949+0000","last_peered":"2023-09-30T17:02:19.293949+0000","last_clean":"2023-09-30T17:02:19.293949+0000","last_became_active":"2023-09-30T17:02:17.364279+0000","last_became_peered":"2023-09-30T17:02:17.364279+0000","last_unstale":"2023-09-30T17:02:19.293949+0000","last_undegraded":"2023-09-30T17:02:19.293949+0000","last_fullsized":"2023-09-30T17:02:19.293949+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:00:56.363835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.363255+0000","last_change":"2023-09-30T17:02:18.358841+0000","last_active":"2023-09-30T17:02:19.363255+0000","last_peered":"2023-09-30T17:02:19.363255+0000","last_clean":"2023-09-30T17:02:19.363255+0000","last_became_active":"2023-09-30T17:02:18.358529+0000","last_became_peered":"2023-09-30T17:02:18.358529+0000","last_unstale":"2023-09-30T17:02:19.363255+0000","last_undegraded":"2023-09-30T17:02:19.363255+0000","last_fullsized":"2023-09-30T17:02:19.363255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:15:54.364571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293818+0000","last_change":"2023-09-30T17:02:17.357998+0000","last_active":"2023-09-30T17:02:19.293818+0000","last_peered":"2023-09-30T17:02:19.293818+0000","last_clean":"2023-09-30T17:02:19.293818+0000","last_became_active":"2023-09-30T17:02:17.357653+0000","last_became_peered":"2023-09-30T17:02:17.357653+0000","last_unstale":"2023-09-30T17:02:19.293818+0000","last_undegraded":"2023-09-30T17:02:19.293818+0000","last_fullsized":"2023-09-30T17:02:19.293818+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:52:37.518693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.363934+0000","last_change":"2023-09-30T17:02:18.361155+0000","last_active":"2023-09-30T17:02:19.363934+0000","last_peered":"2023-09-30T17:02:19.363934+0000","last_clean":"2023-09-30T17:02:19.363934+0000","last_became_active":"2023-09-30T17:02:18.360825+0000","last_became_peered":"2023-09-30T17:02:18.360825+0000","last_unstale":"2023-09-30T17:02:19.363934+0000","last_undegraded":"2023-09-30T17:02:19.363934+0000","last_fullsized":"2023-09-30T17:02:19.363934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:39:16.689300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.294335+0000","last_change":"2023-09-30T17:02:17.363119+0000","last_active":"2023-09-30T17:02:19.294335+0000","last_peered":"2023-09-30T17:02:19.294335+0000","last_clean":"2023-09-30T17:02:19.294335+0000","last_became_active":"2023-09-30T17:02:17.362754+0000","last_became_peered":"2023-09-30T17:02:17.362754+0000","last_unstale":"2023-09-30T17:02:19.294335+0000","last_undegraded":"2023-09-30T17:02:19.294335+0000","last_fullsized":"2023-09-30T17:02:19.294335+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:00:56.363835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.363589+0000","last_change":"2023-09-30T17:02:18.359118+0000","last_active":"2023-09-30T17:02:19.363589+0000","last_peered":"2023-09-30T17:02:19.363589+0000","last_clean":"2023-09-30T17:02:19.363589+0000","last_became_active":"2023-09-30T17:02:18.358786+0000","last_became_peered":"2023-09-30T17:02:18.358786+0000","last_unstale":"2023-09-30T17:02:19.363589+0000","last_undegraded":"2023-09-30T17:02:19.363589+0000","last_fullsized":"2023-09-30T17:02:19.363589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:33:21.723864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293706+0000","last_change":"2023-09-30T17:02:17.355936+0000","last_active":"2023-09-30T17:02:19.293706+0000","last_peered":"2023-09-30T17:02:19.293706+0000","last_clean":"2023-09-30T17:02:19.293706+0000","last_became_active":"2023-09-30T17:02:17.355664+0000","last_became_peered":"2023-09-30T17:02:17.355664+0000","last_unstale":"2023-09-30T17:02:19.293706+0000","last_undegraded":"2023-09-30T17:02:19.293706+0000","last_fullsized":"2023-09-30T17:02:19.293706+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:11:46.248439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357021+0000","last_change":"2023-09-30T17:02:18.373330+0000","last_active":"2023-09-30T17:02:19.357021+0000","last_peered":"2023-09-30T17:02:19.357021+0000","last_clean":"2023-09-30T17:02:19.357021+0000","last_became_active":"2023-09-30T17:02:18.373004+0000","last_became_peered":"2023-09-30T17:02:18.373004+0000","last_unstale":"2023-09-30T17:02:19.357021+0000","last_undegraded":"2023-09-30T17:02:19.357021+0000","last_fullsized":"2023-09-30T17:02:19.357021+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:16:27.516884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293603+0000","last_change":"2023-09-30T17:02:17.359251+0000","last_active":"2023-09-30T17:02:19.293603+0000","last_peered":"2023-09-30T17:02:19.293603+0000","last_clean":"2023-09-30T17:02:19.293603+0000","last_became_active":"2023-09-30T17:02:17.358579+0000","last_became_peered":"2023-09-30T17:02:17.358579+0000","last_unstale":"2023-09-30T17:02:19.293603+0000","last_undegraded":"2023-09-30T17:02:19.293603+0000","last_fullsized":"2023-09-30T17:02:19.293603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:55:33.944875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357627+0000","last_change":"2023-09-30T17:02:18.360019+0000","last_active":"2023-09-30T17:02:19.357627+0000","last_peered":"2023-09-30T17:02:19.357627+0000","last_clean":"2023-09-30T17:02:19.357627+0000","last_became_active":"2023-09-30T17:02:18.358364+0000","last_became_peered":"2023-09-30T17:02:18.358364+0000","last_unstale":"2023-09-30T17:02:19.357627+0000","last_undegraded":"2023-09-30T17:02:19.357627+0000","last_fullsized":"2023-09-30T17:02:19.357627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:30:43.782165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293708+0000","last_change":"2023-09-30T17:02:17.363694+0000","last_active":"2023-09-30T17:02:19.293708+0000","last_peered":"2023-09-30T17:02:19.293708+0000","last_clean":"2023-09-30T17:02:19.293708+0000","last_became_active":"2023-09-30T17:02:17.363442+0000","last_became_peered":"2023-09-30T17:02:17.363442+0000","last_unstale":"2023-09-30T17:02:19.293708+0000","last_undegraded":"2023-09-30T17:02:19.293708+0000","last_fullsized":"2023-09-30T17:02:19.293708+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:19:19.997724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.358063+0000","last_change":"2023-09-30T17:02:18.362415+0000","last_active":"2023-09-30T17:02:19.358063+0000","last_peered":"2023-09-30T17:02:19.358063+0000","last_clean":"2023-09-30T17:02:19.358063+0000","last_became_active":"2023-09-30T17:02:18.361556+0000","last_became_peered":"2023-09-30T17:02:18.361556+0000","last_unstale":"2023-09-30T17:02:19.358063+0000","last_undegraded":"2023-09-30T17:02:19.358063+0000","last_fullsized":"2023-09-30T17:02:19.358063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:16:41.607547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.294127+0000","last_change":"2023-09-30T17:02:17.363369+0000","last_active":"2023-09-30T17:02:19.294127+0000","last_peered":"2023-09-30T17:02:19.294127+0000","last_clean":"2023-09-30T17:02:19.294127+0000","last_became_active":"2023-09-30T17:02:17.362925+0000","last_became_peered":"2023-09-30T17:02:17.362925+0000","last_unstale":"2023-09-30T17:02:19.294127+0000","last_undegraded":"2023-09-30T17:02:19.294127+0000","last_fullsized":"2023-09-30T17:02:19.294127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:50:18.455188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.364537+0000","last_change":"2023-09-30T17:02:18.356700+0000","last_active":"2023-09-30T17:02:19.364537+0000","last_peered":"2023-09-30T17:02:19.364537+0000","last_clean":"2023-09-30T17:02:19.364537+0000","last_became_active":"2023-09-30T17:02:18.356108+0000","last_became_peered":"2023-09-30T17:02:18.356108+0000","last_unstale":"2023-09-30T17:02:19.364537+0000","last_undegraded":"2023-09-30T17:02:19.364537+0000","last_fullsized":"2023-09-30T17:02:19.364537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:16:41.607547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293424+0000","last_change":"2023-09-30T17:02:17.355214+0000","last_active":"2023-09-30T17:02:19.293424+0000","last_peered":"2023-09-30T17:02:19.293424+0000","last_clean":"2023-09-30T17:02:19.293424+0000","last_became_active":"2023-09-30T17:02:17.354876+0000","last_became_peered":"2023-09-30T17:02:17.354876+0000","last_unstale":"2023-09-30T17:02:19.293424+0000","last_undegraded":"2023-09-30T17:02:19.293424+0000","last_fullsized":"2023-09-30T17:02:19.293424+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:13:41.205152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.364747+0000","last_change":"2023-09-30T17:02:18.356814+0000","last_active":"2023-09-30T17:02:19.364747+0000","last_peered":"2023-09-30T17:02:19.364747+0000","last_clean":"2023-09-30T17:02:19.364747+0000","last_became_active":"2023-09-30T17:02:18.356258+0000","last_became_peered":"2023-09-30T17:02:18.356258+0000","last_unstale":"2023-09-30T17:02:19.364747+0000","last_undegraded":"2023-09-30T17:02:19.364747+0000","last_fullsized":"2023-09-30T17:02:19.364747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:26:11.522402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293840+0000","last_change":"2023-09-30T17:02:17.355972+0000","last_active":"2023-09-30T17:02:19.293840+0000","last_peered":"2023-09-30T17:02:19.293840+0000","last_clean":"2023-09-30T17:02:19.293840+0000","last_became_active":"2023-09-30T17:02:17.355653+0000","last_became_peered":"2023-09-30T17:02:17.355653+0000","last_unstale":"2023-09-30T17:02:19.293840+0000","last_undegraded":"2023-09-30T17:02:19.293840+0000","last_fullsized":"2023-09-30T17:02:19.293840+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:27:37.446407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.356869+0000","last_change":"2023-09-30T17:02:18.355736+0000","last_active":"2023-09-30T17:02:19.356869+0000","last_peered":"2023-09-30T17:02:19.356869+0000","last_clean":"2023-09-30T17:02:19.356869+0000","last_became_active":"2023-09-30T17:02:18.355111+0000","last_became_peered":"2023-09-30T17:02:18.355111+0000","last_unstale":"2023-09-30T17:02:19.356869+0000","last_undegraded":"2023-09-30T17:02:19.356869+0000","last_fullsized":"2023-09-30T17:02:19.356869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:47:00.094303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.294406+0000","last_change":"2023-09-30T17:02:17.363514+0000","last_active":"2023-09-30T17:02:19.294406+0000","last_peered":"2023-09-30T17:02:19.294406+0000","last_clean":"2023-09-30T17:02:19.294406+0000","last_became_active":"2023-09-30T17:02:17.363124+0000","last_became_peered":"2023-09-30T17:02:17.363124+0000","last_unstale":"2023-09-30T17:02:19.294406+0000","last_undegraded":"2023-09-30T17:02:19.294406+0000","last_fullsized":"2023-09-30T17:02:19.294406+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:55:33.944875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357665+0000","last_change":"2023-09-30T17:02:18.359767+0000","last_active":"2023-09-30T17:02:19.357665+0000","last_peered":"2023-09-30T17:02:19.357665+0000","last_clean":"2023-09-30T17:02:19.357665+0000","last_became_active":"2023-09-30T17:02:18.356825+0000","last_became_peered":"2023-09-30T17:02:18.356825+0000","last_unstale":"2023-09-30T17:02:19.357665+0000","last_undegraded":"2023-09-30T17:02:19.357665+0000","last_fullsized":"2023-09-30T17:02:19.357665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:39:16.689300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293738+0000","last_change":"2023-09-30T17:02:17.355878+0000","last_active":"2023-09-30T17:02:19.293738+0000","last_peered":"2023-09-30T17:02:19.293738+0000","last_clean":"2023-09-30T17:02:19.293738+0000","last_became_active":"2023-09-30T17:02:17.355642+0000","last_became_peered":"2023-09-30T17:02:17.355642+0000","last_unstale":"2023-09-30T17:02:19.293738+0000","last_undegraded":"2023-09-30T17:02:19.293738+0000","last_fullsized":"2023-09-30T17:02:19.293738+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:04:48.294789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.356816+0000","last_change":"2023-09-30T17:02:18.375303+0000","last_active":"2023-09-30T17:02:19.356816+0000","last_peered":"2023-09-30T17:02:19.356816+0000","last_clean":"2023-09-30T17:02:19.356816+0000","last_became_active":"2023-09-30T17:02:18.373962+0000","last_became_peered":"2023-09-30T17:02:18.373962+0000","last_unstale":"2023-09-30T17:02:19.356816+0000","last_undegraded":"2023-09-30T17:02:19.356816+0000","last_fullsized":"2023-09-30T17:02:19.356816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:16:41.607547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293666+0000","last_change":"2023-09-30T17:02:17.358126+0000","last_active":"2023-09-30T17:02:19.293666+0000","last_peered":"2023-09-30T17:02:19.293666+0000","last_clean":"2023-09-30T17:02:19.293666+0000","last_became_active":"2023-09-30T17:02:17.357621+0000","last_became_peered":"2023-09-30T17:02:17.357621+0000","last_unstale":"2023-09-30T17:02:19.293666+0000","last_undegraded":"2023-09-30T17:02:19.293666+0000","last_fullsized":"2023-09-30T17:02:19.293666+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:46:16.375239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.364059+0000","last_change":"2023-09-30T17:02:18.362399+0000","last_active":"2023-09-30T17:02:19.364059+0000","last_peered":"2023-09-30T17:02:19.364059+0000","last_clean":"2023-09-30T17:02:19.364059+0000","last_became_active":"2023-09-30T17:02:18.362173+0000","last_became_peered":"2023-09-30T17:02:18.362173+0000","last_unstale":"2023-09-30T17:02:19.364059+0000","last_undegraded":"2023-09-30T17:02:19.364059+0000","last_fullsized":"2023-09-30T17:02:19.364059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:30:35.150981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293733+0000","last_change":"2023-09-30T17:02:17.363567+0000","last_active":"2023-09-30T17:02:19.293733+0000","last_peered":"2023-09-30T17:02:19.293733+0000","last_clean":"2023-09-30T17:02:19.293733+0000","last_became_active":"2023-09-30T17:02:17.363254+0000","last_became_peered":"2023-09-30T17:02:17.363254+0000","last_unstale":"2023-09-30T17:02:19.293733+0000","last_undegraded":"2023-09-30T17:02:19.293733+0000","last_fullsized":"2023-09-30T17:02:19.293733+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:08:34.994215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357037+0000","last_change":"2023-09-30T17:02:18.372346+0000","last_active":"2023-09-30T17:02:19.357037+0000","last_peered":"2023-09-30T17:02:19.357037+0000","last_clean":"2023-09-30T17:02:19.357037+0000","last_became_active":"2023-09-30T17:02:18.371542+0000","last_became_peered":"2023-09-30T17:02:18.371542+0000","last_unstale":"2023-09-30T17:02:19.357037+0000","last_undegraded":"2023-09-30T17:02:19.357037+0000","last_fullsized":"2023-09-30T17:02:19.357037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:55:15.512558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293510+0000","last_change":"2023-09-30T17:02:17.358658+0000","last_active":"2023-09-30T17:02:19.293510+0000","last_peered":"2023-09-30T17:02:19.293510+0000","last_clean":"2023-09-30T17:02:19.293510+0000","last_became_active":"2023-09-30T17:02:17.357738+0000","last_became_peered":"2023-09-30T17:02:17.357738+0000","last_unstale":"2023-09-30T17:02:19.293510+0000","last_undegraded":"2023-09-30T17:02:19.293510+0000","last_fullsized":"2023-09-30T17:02:19.293510+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:00:16.830342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357758+0000","last_change":"2023-09-30T17:02:18.373854+0000","last_active":"2023-09-30T17:02:19.357758+0000","last_peered":"2023-09-30T17:02:19.357758+0000","last_clean":"2023-09-30T17:02:19.357758+0000","last_became_active":"2023-09-30T17:02:18.373315+0000","last_became_peered":"2023-09-30T17:02:18.373315+0000","last_unstale":"2023-09-30T17:02:19.357758+0000","last_undegraded":"2023-09-30T17:02:19.357758+0000","last_fullsized":"2023-09-30T17:02:19.357758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:28:07.751219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.294114+0000","last_change":"2023-09-30T17:02:17.359738+0000","last_active":"2023-09-30T17:02:19.294114+0000","last_peered":"2023-09-30T17:02:19.294114+0000","last_clean":"2023-09-30T17:02:19.294114+0000","last_became_active":"2023-09-30T17:02:17.359424+0000","last_became_peered":"2023-09-30T17:02:17.359424+0000","last_unstale":"2023-09-30T17:02:19.294114+0000","last_undegraded":"2023-09-30T17:02:19.294114+0000","last_fullsized":"2023-09-30T17:02:19.294114+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:01:31.158446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357403+0000","last_change":"2023-09-30T17:02:18.373068+0000","last_active":"2023-09-30T17:02:19.357403+0000","last_peered":"2023-09-30T17:02:19.357403+0000","last_clean":"2023-09-30T17:02:19.357403+0000","last_became_active":"2023-09-30T17:02:18.372739+0000","last_became_peered":"2023-09-30T17:02:18.372739+0000","last_unstale":"2023-09-30T17:02:19.357403+0000","last_undegraded":"2023-09-30T17:02:19.357403+0000","last_fullsized":"2023-09-30T17:02:19.357403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:37:30.572488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.294090+0000","last_change":"2023-09-30T17:02:17.358811+0000","last_active":"2023-09-30T17:02:19.294090+0000","last_peered":"2023-09-30T17:02:19.294090+0000","last_clean":"2023-09-30T17:02:19.294090+0000","last_became_active":"2023-09-30T17:02:17.358582+0000","last_became_peered":"2023-09-30T17:02:17.358582+0000","last_unstale":"2023-09-30T17:02:19.294090+0000","last_undegraded":"2023-09-30T17:02:19.294090+0000","last_fullsized":"2023-09-30T17:02:19.294090+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:52:37.518693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.364541+0000","last_change":"2023-09-30T17:02:18.364478+0000","last_active":"2023-09-30T17:02:19.364541+0000","last_peered":"2023-09-30T17:02:19.364541+0000","last_clean":"2023-09-30T17:02:19.364541+0000","last_became_active":"2023-09-30T17:02:18.364057+0000","last_became_peered":"2023-09-30T17:02:18.364057+0000","last_unstale":"2023-09-30T17:02:19.364541+0000","last_undegraded":"2023-09-30T17:02:19.364541+0000","last_fullsized":"2023-09-30T17:02:19.364541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:13:55.555700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.348448+0000","last_change":"2023-09-30T17:02:12.327704+0000","last_active":"2023-09-30T17:02:18.348448+0000","last_peered":"2023-09-30T17:02:18.348448+0000","last_clean":"2023-09-30T17:02:18.348448+0000","last_became_active":"2023-09-30T17:02:12.327384+0000","last_became_peered":"2023-09-30T17:02:12.327384+0000","last_unstale":"2023-09-30T17:02:18.348448+0000","last_undegraded":"2023-09-30T17:02:18.348448+0000","last_fullsized":"2023-09-30T17:02:18.348448+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:09:34.818252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293774+0000","last_change":"2023-09-30T17:02:17.357321+0000","last_active":"2023-09-30T17:02:19.293774+0000","last_peered":"2023-09-30T17:02:19.293774+0000","last_clean":"2023-09-30T17:02:19.293774+0000","last_became_active":"2023-09-30T17:02:17.357105+0000","last_became_peered":"2023-09-30T17:02:17.357105+0000","last_unstale":"2023-09-30T17:02:19.293774+0000","last_undegraded":"2023-09-30T17:02:19.293774+0000","last_fullsized":"2023-09-30T17:02:19.293774+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:09:54.050468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357396+0000","last_change":"2023-09-30T17:02:18.356537+0000","last_active":"2023-09-30T17:02:19.357396+0000","last_peered":"2023-09-30T17:02:19.357396+0000","last_clean":"2023-09-30T17:02:19.357396+0000","last_became_active":"2023-09-30T17:02:18.355641+0000","last_became_peered":"2023-09-30T17:02:18.355641+0000","last_unstale":"2023-09-30T17:02:19.357396+0000","last_undegraded":"2023-09-30T17:02:19.357396+0000","last_fullsized":"2023-09-30T17:02:19.357396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:33:21.723864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.355403+0000","last_change":"2023-09-30T17:02:12.332417+0000","last_active":"2023-09-30T17:02:18.355403+0000","last_peered":"2023-09-30T17:02:18.355403+0000","last_clean":"2023-09-30T17:02:18.355403+0000","last_became_active":"2023-09-30T17:02:12.332124+0000","last_became_peered":"2023-09-30T17:02:12.332124+0000","last_unstale":"2023-09-30T17:02:18.355403+0000","last_undegraded":"2023-09-30T17:02:18.355403+0000","last_fullsized":"2023-09-30T17:02:18.355403+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:21:27.587948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293583+0000","last_change":"2023-09-30T17:02:17.359029+0000","last_active":"2023-09-30T17:02:19.293583+0000","last_peered":"2023-09-30T17:02:19.293583+0000","last_clean":"2023-09-30T17:02:19.293583+0000","last_became_active":"2023-09-30T17:02:17.357931+0000","last_became_peered":"2023-09-30T17:02:17.357931+0000","last_unstale":"2023-09-30T17:02:19.293583+0000","last_undegraded":"2023-09-30T17:02:19.293583+0000","last_fullsized":"2023-09-30T17:02:19.293583+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:00:56.363835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.363856+0000","last_change":"2023-09-30T17:02:18.363399+0000","last_active":"2023-09-30T17:02:19.363856+0000","last_peered":"2023-09-30T17:02:19.363856+0000","last_clean":"2023-09-30T17:02:19.363856+0000","last_became_active":"2023-09-30T17:02:18.363064+0000","last_became_peered":"2023-09-30T17:02:18.363064+0000","last_unstale":"2023-09-30T17:02:19.363856+0000","last_undegraded":"2023-09-30T17:02:19.363856+0000","last_fullsized":"2023-09-30T17:02:19.363856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:32:34.654264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.348157+0000","last_change":"2023-09-30T17:02:12.327834+0000","last_active":"2023-09-30T17:02:18.348157+0000","last_peered":"2023-09-30T17:02:18.348157+0000","last_clean":"2023-09-30T17:02:18.348157+0000","last_became_active":"2023-09-30T17:02:12.327542+0000","last_became_peered":"2023-09-30T17:02:12.327542+0000","last_unstale":"2023-09-30T17:02:18.348157+0000","last_undegraded":"2023-09-30T17:02:18.348157+0000","last_fullsized":"2023-09-30T17:02:18.348157+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:49:54.890769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.294077+0000","last_change":"2023-09-30T17:02:17.363326+0000","last_active":"2023-09-30T17:02:19.294077+0000","last_peered":"2023-09-30T17:02:19.294077+0000","last_clean":"2023-09-30T17:02:19.294077+0000","last_became_active":"2023-09-30T17:02:17.362934+0000","last_became_peered":"2023-09-30T17:02:17.362934+0000","last_unstale":"2023-09-30T17:02:19.294077+0000","last_undegraded":"2023-09-30T17:02:19.294077+0000","last_fullsized":"2023-09-30T17:02:19.294077+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:24:04.564387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.364712+0000","last_change":"2023-09-30T17:02:18.364406+0000","last_active":"2023-09-30T17:02:19.364712+0000","last_peered":"2023-09-30T17:02:19.364712+0000","last_clean":"2023-09-30T17:02:19.364712+0000","last_became_active":"2023-09-30T17:02:18.363849+0000","last_became_peered":"2023-09-30T17:02:18.363849+0000","last_unstale":"2023-09-30T17:02:19.364712+0000","last_undegraded":"2023-09-30T17:02:19.364712+0000","last_fullsized":"2023-09-30T17:02:19.364712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:43:29.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.357252+0000","last_change":"2023-09-30T17:02:12.332542+0000","last_active":"2023-09-30T17:02:18.357252+0000","last_peered":"2023-09-30T17:02:18.357252+0000","last_clean":"2023-09-30T17:02:18.357252+0000","last_became_active":"2023-09-30T17:02:12.332132+0000","last_became_peered":"2023-09-30T17:02:12.332132+0000","last_unstale":"2023-09-30T17:02:18.357252+0000","last_undegraded":"2023-09-30T17:02:18.357252+0000","last_fullsized":"2023-09-30T17:02:18.357252+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:14:16.917130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":214,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.355641+0000","last_change":"2023-09-30T17:02:07.309872+0000","last_active":"2023-09-30T17:02:18.355641+0000","last_peered":"2023-09-30T17:02:18.355641+0000","last_clean":"2023-09-30T17:02:18.355641+0000","last_became_active":"2023-09-30T17:02:07.309630+0000","last_became_peered":"2023-09-30T17:02:07.309630+0000","last_unstale":"2023-09-30T17:02:18.355641+0000","last_undegraded":"2023-09-30T17:02:18.355641+0000","last_fullsized":"2023-09-30T17:02:18.355641+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:06.295501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:06.295501+0000","last_clean_scrub_stamp":"2023-09-30T17:02:06.295501+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:20:12.668818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293686+0000","last_change":"2023-09-30T17:02:17.357139+0000","last_active":"2023-09-30T17:02:19.293686+0000","last_peered":"2023-09-30T17:02:19.293686+0000","last_clean":"2023-09-30T17:02:19.293686+0000","last_became_active":"2023-09-30T17:02:17.356901+0000","last_became_peered":"2023-09-30T17:02:17.356901+0000","last_unstale":"2023-09-30T17:02:19.293686+0000","last_undegraded":"2023-09-30T17:02:19.293686+0000","last_fullsized":"2023-09-30T17:02:19.293686+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:22:35.747671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357783+0000","last_change":"2023-09-30T17:02:18.373627+0000","last_active":"2023-09-30T17:02:19.357783+0000","last_peered":"2023-09-30T17:02:19.357783+0000","last_clean":"2023-09-30T17:02:19.357783+0000","last_became_active":"2023-09-30T17:02:18.373275+0000","last_became_peered":"2023-09-30T17:02:18.373275+0000","last_unstale":"2023-09-30T17:02:19.357783+0000","last_undegraded":"2023-09-30T17:02:19.357783+0000","last_fullsized":"2023-09-30T17:02:19.357783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:44:18.066167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.354175+0000","last_change":"2023-09-30T17:02:12.330129+0000","last_active":"2023-09-30T17:02:18.354175+0000","last_peered":"2023-09-30T17:02:18.354175+0000","last_clean":"2023-09-30T17:02:18.354175+0000","last_became_active":"2023-09-30T17:02:12.329863+0000","last_became_peered":"2023-09-30T17:02:12.329863+0000","last_unstale":"2023-09-30T17:02:18.354175+0000","last_undegraded":"2023-09-30T17:02:18.354175+0000","last_fullsized":"2023-09-30T17:02:18.354175+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:21:45.393691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293615+0000","last_change":"2023-09-30T17:02:17.363398+0000","last_active":"2023-09-30T17:02:19.293615+0000","last_peered":"2023-09-30T17:02:19.293615+0000","last_clean":"2023-09-30T17:02:19.293615+0000","last_became_active":"2023-09-30T17:02:17.363086+0000","last_became_peered":"2023-09-30T17:02:17.363086+0000","last_unstale":"2023-09-30T17:02:19.293615+0000","last_undegraded":"2023-09-30T17:02:19.293615+0000","last_fullsized":"2023-09-30T17:02:19.293615+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:48:08.569937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.358480+0000","last_change":"2023-09-30T17:02:18.360029+0000","last_active":"2023-09-30T17:02:19.358480+0000","last_peered":"2023-09-30T17:02:19.358480+0000","last_clean":"2023-09-30T17:02:19.358480+0000","last_became_active":"2023-09-30T17:02:18.356839+0000","last_became_peered":"2023-09-30T17:02:18.356839+0000","last_unstale":"2023-09-30T17:02:19.358480+0000","last_undegraded":"2023-09-30T17:02:19.358480+0000","last_fullsized":"2023-09-30T17:02:19.358480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:16:27.516884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.356756+0000","last_change":"2023-09-30T17:02:12.330472+0000","last_active":"2023-09-30T17:02:18.356756+0000","last_peered":"2023-09-30T17:02:18.356756+0000","last_clean":"2023-09-30T17:02:18.356756+0000","last_became_active":"2023-09-30T17:02:12.330154+0000","last_became_peered":"2023-09-30T17:02:12.330154+0000","last_unstale":"2023-09-30T17:02:18.356756+0000","last_undegraded":"2023-09-30T17:02:18.356756+0000","last_fullsized":"2023-09-30T17:02:18.356756+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:43:23.161734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293780+0000","last_change":"2023-09-30T17:02:17.361007+0000","last_active":"2023-09-30T17:02:19.293780+0000","last_peered":"2023-09-30T17:02:19.293780+0000","last_clean":"2023-09-30T17:02:19.293780+0000","last_became_active":"2023-09-30T17:02:17.360721+0000","last_became_peered":"2023-09-30T17:02:17.360721+0000","last_unstale":"2023-09-30T17:02:19.293780+0000","last_undegraded":"2023-09-30T17:02:19.293780+0000","last_fullsized":"2023-09-30T17:02:19.293780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:13:41.205152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357723+0000","last_change":"2023-09-30T17:02:18.364148+0000","last_active":"2023-09-30T17:02:19.357723+0000","last_peered":"2023-09-30T17:02:19.357723+0000","last_clean":"2023-09-30T17:02:19.357723+0000","last_became_active":"2023-09-30T17:02:18.363793+0000","last_became_peered":"2023-09-30T17:02:18.363793+0000","last_unstale":"2023-09-30T17:02:19.357723+0000","last_undegraded":"2023-09-30T17:02:19.357723+0000","last_fullsized":"2023-09-30T17:02:19.357723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:30:35.150981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293916+0000","last_change":"2023-09-30T17:02:17.360831+0000","last_active":"2023-09-30T17:02:19.293916+0000","last_peered":"2023-09-30T17:02:19.293916+0000","last_clean":"2023-09-30T17:02:19.293916+0000","last_became_active":"2023-09-30T17:02:17.360494+0000","last_became_peered":"2023-09-30T17:02:17.360494+0000","last_unstale":"2023-09-30T17:02:19.293916+0000","last_undegraded":"2023-09-30T17:02:19.293916+0000","last_fullsized":"2023-09-30T17:02:19.293916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:24:04.564387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.350218+0000","last_change":"2023-09-30T17:02:12.328184+0000","last_active":"2023-09-30T17:02:18.350218+0000","last_peered":"2023-09-30T17:02:18.350218+0000","last_clean":"2023-09-30T17:02:18.350218+0000","last_became_active":"2023-09-30T17:02:12.327898+0000","last_became_peered":"2023-09-30T17:02:12.327898+0000","last_unstale":"2023-09-30T17:02:18.350218+0000","last_undegraded":"2023-09-30T17:02:18.350218+0000","last_fullsized":"2023-09-30T17:02:18.350218+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:43:23.161734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.363242+0000","last_change":"2023-09-30T17:02:18.361791+0000","last_active":"2023-09-30T17:02:19.363242+0000","last_peered":"2023-09-30T17:02:19.363242+0000","last_clean":"2023-09-30T17:02:19.363242+0000","last_became_active":"2023-09-30T17:02:18.361226+0000","last_became_peered":"2023-09-30T17:02:18.361226+0000","last_unstale":"2023-09-30T17:02:19.363242+0000","last_undegraded":"2023-09-30T17:02:19.363242+0000","last_fullsized":"2023-09-30T17:02:19.363242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:13:30.688369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.356790+0000","last_change":"2023-09-30T17:02:12.330039+0000","last_active":"2023-09-30T17:02:18.356790+0000","last_peered":"2023-09-30T17:02:18.356790+0000","last_clean":"2023-09-30T17:02:18.356790+0000","last_became_active":"2023-09-30T17:02:12.329827+0000","last_became_peered":"2023-09-30T17:02:12.329827+0000","last_unstale":"2023-09-30T17:02:18.356790+0000","last_undegraded":"2023-09-30T17:02:18.356790+0000","last_fullsized":"2023-09-30T17:02:18.356790+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:21:09.449776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.364463+0000","last_change":"2023-09-30T17:02:17.364615+0000","last_active":"2023-09-30T17:02:19.364463+0000","last_peered":"2023-09-30T17:02:19.364463+0000","last_clean":"2023-09-30T17:02:19.364463+0000","last_became_active":"2023-09-30T17:02:17.364317+0000","last_became_peered":"2023-09-30T17:02:17.364317+0000","last_unstale":"2023-09-30T17:02:19.364463+0000","last_undegraded":"2023-09-30T17:02:19.364463+0000","last_fullsized":"2023-09-30T17:02:19.364463+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:52:37.518693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357528+0000","last_change":"2023-09-30T17:02:18.356454+0000","last_active":"2023-09-30T17:02:19.357528+0000","last_peered":"2023-09-30T17:02:19.357528+0000","last_clean":"2023-09-30T17:02:19.357528+0000","last_became_active":"2023-09-30T17:02:18.355486+0000","last_became_peered":"2023-09-30T17:02:18.355486+0000","last_unstale":"2023-09-30T17:02:19.357528+0000","last_undegraded":"2023-09-30T17:02:19.357528+0000","last_fullsized":"2023-09-30T17:02:19.357528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:32:34.654264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.294253+0000","last_change":"2023-09-30T17:02:17.363396+0000","last_active":"2023-09-30T17:02:19.294253+0000","last_peered":"2023-09-30T17:02:19.294253+0000","last_clean":"2023-09-30T17:02:19.294253+0000","last_became_active":"2023-09-30T17:02:17.363065+0000","last_became_peered":"2023-09-30T17:02:17.363065+0000","last_unstale":"2023-09-30T17:02:19.294253+0000","last_undegraded":"2023-09-30T17:02:19.294253+0000","last_fullsized":"2023-09-30T17:02:19.294253+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:09:59.154381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357795+0000","last_change":"2023-09-30T17:02:18.358269+0000","last_active":"2023-09-30T17:02:19.357795+0000","last_peered":"2023-09-30T17:02:19.357795+0000","last_clean":"2023-09-30T17:02:19.357795+0000","last_became_active":"2023-09-30T17:02:18.356902+0000","last_became_peered":"2023-09-30T17:02:18.356902+0000","last_unstale":"2023-09-30T17:02:19.357795+0000","last_undegraded":"2023-09-30T17:02:19.357795+0000","last_fullsized":"2023-09-30T17:02:19.357795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:39:28.022201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293693+0000","last_change":"2023-09-30T17:02:17.358568+0000","last_active":"2023-09-30T17:02:19.293693+0000","last_peered":"2023-09-30T17:02:19.293693+0000","last_clean":"2023-09-30T17:02:19.293693+0000","last_became_active":"2023-09-30T17:02:17.357763+0000","last_became_peered":"2023-09-30T17:02:17.357763+0000","last_unstale":"2023-09-30T17:02:19.293693+0000","last_undegraded":"2023-09-30T17:02:19.293693+0000","last_fullsized":"2023-09-30T17:02:19.293693+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:04:22.748557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357224+0000","last_change":"2023-09-30T17:02:18.376236+0000","last_active":"2023-09-30T17:02:19.357224+0000","last_peered":"2023-09-30T17:02:19.357224+0000","last_clean":"2023-09-30T17:02:19.357224+0000","last_became_active":"2023-09-30T17:02:18.374853+0000","last_became_peered":"2023-09-30T17:02:18.374853+0000","last_unstale":"2023-09-30T17:02:19.357224+0000","last_undegraded":"2023-09-30T17:02:19.357224+0000","last_fullsized":"2023-09-30T17:02:19.357224+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:38:15.747647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.294354+0000","last_change":"2023-09-30T17:02:17.363358+0000","last_active":"2023-09-30T17:02:19.294354+0000","last_peered":"2023-09-30T17:02:19.294354+0000","last_clean":"2023-09-30T17:02:19.294354+0000","last_became_active":"2023-09-30T17:02:17.363003+0000","last_became_peered":"2023-09-30T17:02:17.363003+0000","last_unstale":"2023-09-30T17:02:19.294354+0000","last_undegraded":"2023-09-30T17:02:19.294354+0000","last_fullsized":"2023-09-30T17:02:19.294354+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:27:37.446407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.356604+0000","last_change":"2023-09-30T17:02:18.362117+0000","last_active":"2023-09-30T17:02:19.356604+0000","last_peered":"2023-09-30T17:02:19.356604+0000","last_clean":"2023-09-30T17:02:19.356604+0000","last_became_active":"2023-09-30T17:02:18.361463+0000","last_became_peered":"2023-09-30T17:02:18.361463+0000","last_unstale":"2023-09-30T17:02:19.356604+0000","last_undegraded":"2023-09-30T17:02:19.356604+0000","last_fullsized":"2023-09-30T17:02:19.356604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:37:14.790993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293869+0000","last_change":"2023-09-30T17:02:17.360802+0000","last_active":"2023-09-30T17:02:19.293869+0000","last_peered":"2023-09-30T17:02:19.293869+0000","last_clean":"2023-09-30T17:02:19.293869+0000","last_became_active":"2023-09-30T17:02:17.360475+0000","last_became_peered":"2023-09-30T17:02:17.360475+0000","last_unstale":"2023-09-30T17:02:19.293869+0000","last_undegraded":"2023-09-30T17:02:19.293869+0000","last_fullsized":"2023-09-30T17:02:19.293869+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:50:18.455188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357745+0000","last_change":"2023-09-30T17:02:18.359857+0000","last_active":"2023-09-30T17:02:19.357745+0000","last_peered":"2023-09-30T17:02:19.357745+0000","last_clean":"2023-09-30T17:02:19.357745+0000","last_became_active":"2023-09-30T17:02:18.357098+0000","last_became_peered":"2023-09-30T17:02:18.357098+0000","last_unstale":"2023-09-30T17:02:19.357745+0000","last_undegraded":"2023-09-30T17:02:19.357745+0000","last_fullsized":"2023-09-30T17:02:19.357745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:48:17.598726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293936+0000","last_change":"2023-09-30T17:02:17.364479+0000","last_active":"2023-09-30T17:02:19.293936+0000","last_peered":"2023-09-30T17:02:19.293936+0000","last_clean":"2023-09-30T17:02:19.293936+0000","last_became_active":"2023-09-30T17:02:17.364215+0000","last_became_peered":"2023-09-30T17:02:17.364215+0000","last_unstale":"2023-09-30T17:02:19.293936+0000","last_undegraded":"2023-09-30T17:02:19.293936+0000","last_fullsized":"2023-09-30T17:02:19.293936+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:01:31.158446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.356645+0000","last_change":"2023-09-30T17:02:18.375778+0000","last_active":"2023-09-30T17:02:19.356645+0000","last_peered":"2023-09-30T17:02:19.356645+0000","last_clean":"2023-09-30T17:02:19.356645+0000","last_became_active":"2023-09-30T17:02:18.374620+0000","last_became_peered":"2023-09-30T17:02:18.374620+0000","last_unstale":"2023-09-30T17:02:19.356645+0000","last_undegraded":"2023-09-30T17:02:19.356645+0000","last_fullsized":"2023-09-30T17:02:19.356645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:50:52.893768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.356459+0000","last_change":"2023-09-30T17:02:18.362804+0000","last_active":"2023-09-30T17:02:19.356459+0000","last_peered":"2023-09-30T17:02:19.356459+0000","last_clean":"2023-09-30T17:02:19.356459+0000","last_became_active":"2023-09-30T17:02:18.362392+0000","last_became_peered":"2023-09-30T17:02:18.362392+0000","last_unstale":"2023-09-30T17:02:19.356459+0000","last_undegraded":"2023-09-30T17:02:19.356459+0000","last_fullsized":"2023-09-30T17:02:19.356459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:39:28.022201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.363559+0000","last_change":"2023-09-30T17:02:18.363479+0000","last_active":"2023-09-30T17:02:19.363559+0000","last_peered":"2023-09-30T17:02:19.363559+0000","last_clean":"2023-09-30T17:02:19.363559+0000","last_became_active":"2023-09-30T17:02:18.363222+0000","last_became_peered":"2023-09-30T17:02:18.363222+0000","last_unstale":"2023-09-30T17:02:19.363559+0000","last_undegraded":"2023-09-30T17:02:19.363559+0000","last_fullsized":"2023-09-30T17:02:19.363559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:09:55.056098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357778+0000","last_change":"2023-09-30T17:02:18.362764+0000","last_active":"2023-09-30T17:02:19.357778+0000","last_peered":"2023-09-30T17:02:19.357778+0000","last_clean":"2023-09-30T17:02:19.357778+0000","last_became_active":"2023-09-30T17:02:18.362369+0000","last_became_peered":"2023-09-30T17:02:18.362369+0000","last_unstale":"2023-09-30T17:02:19.357778+0000","last_undegraded":"2023-09-30T17:02:19.357778+0000","last_fullsized":"2023-09-30T17:02:19.357778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:14:35.192615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.363865+0000","last_change":"2023-09-30T17:02:18.363216+0000","last_active":"2023-09-30T17:02:19.363865+0000","last_peered":"2023-09-30T17:02:19.363865+0000","last_clean":"2023-09-30T17:02:19.363865+0000","last_became_active":"2023-09-30T17:02:18.362894+0000","last_became_peered":"2023-09-30T17:02:18.362894+0000","last_unstale":"2023-09-30T17:02:19.363865+0000","last_undegraded":"2023-09-30T17:02:19.363865+0000","last_fullsized":"2023-09-30T17:02:19.363865+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:30:43.782165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357920+0000","last_change":"2023-09-30T17:02:18.356827+0000","last_active":"2023-09-30T17:02:19.357920+0000","last_peered":"2023-09-30T17:02:19.357920+0000","last_clean":"2023-09-30T17:02:19.357920+0000","last_became_active":"2023-09-30T17:02:18.355965+0000","last_became_peered":"2023-09-30T17:02:18.355965+0000","last_unstale":"2023-09-30T17:02:19.357920+0000","last_undegraded":"2023-09-30T17:02:19.357920+0000","last_fullsized":"2023-09-30T17:02:19.357920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:50:52.893768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738377,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":790528,"data_stored":650475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738377,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":782336,"data_stored":649859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738377,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":172032,"data_stored":58313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T17:02:36.572 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T17:02:36.945 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:02:36.947 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-09-30T17:02:36.956 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":32,"stamp":"2023-09-30T17:02:35.292292+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":248,"num_write_kb":3474,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":196,"ondisk_log_size":196,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":86936,"kb_used_data":1704,"kb_used_omap":4,"kb_used_meta":85179,"kb_avail":283028584,"statfs":{"total":289910292480,"available":289821270016,"internally_reserved":0,"allocated":1744896,"data_stored":1358647,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4781,"internal_metadata":87223635},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002431"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.358721+0000","last_change":"2023-09-30T17:02:18.360288+0000","last_active":"2023-09-30T17:02:19.358721+0000","last_peered":"2023-09-30T17:02:19.358721+0000","last_clean":"2023-09-30T17:02:19.358721+0000","last_became_active":"2023-09-30T17:02:18.358716+0000","last_became_peered":"2023-09-30T17:02:18.358716+0000","last_unstale":"2023-09-30T17:02:19.358721+0000","last_undegraded":"2023-09-30T17:02:19.358721+0000","last_fullsized":"2023-09-30T17:02:19.358721+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:12:06.380095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.358288+0000","last_change":"2023-09-30T17:02:18.362418+0000","last_active":"2023-09-30T17:02:19.358288+0000","last_peered":"2023-09-30T17:02:19.358288+0000","last_clean":"2023-09-30T17:02:19.358288+0000","last_became_active":"2023-09-30T17:02:18.360372+0000","last_became_peered":"2023-09-30T17:02:18.360372+0000","last_unstale":"2023-09-30T17:02:19.358288+0000","last_undegraded":"2023-09-30T17:02:19.358288+0000","last_fullsized":"2023-09-30T17:02:19.358288+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:43:29.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357605+0000","last_change":"2023-09-30T17:02:18.373609+0000","last_active":"2023-09-30T17:02:19.357605+0000","last_peered":"2023-09-30T17:02:19.357605+0000","last_clean":"2023-09-30T17:02:19.357605+0000","last_became_active":"2023-09-30T17:02:18.372911+0000","last_became_peered":"2023-09-30T17:02:18.372911+0000","last_unstale":"2023-09-30T17:02:19.357605+0000","last_undegraded":"2023-09-30T17:02:19.357605+0000","last_fullsized":"2023-09-30T17:02:19.357605+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:36:10.602697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357569+0000","last_change":"2023-09-30T17:02:18.377247+0000","last_active":"2023-09-30T17:02:19.357569+0000","last_peered":"2023-09-30T17:02:19.357569+0000","last_clean":"2023-09-30T17:02:19.357569+0000","last_became_active":"2023-09-30T17:02:18.376351+0000","last_became_peered":"2023-09-30T17:02:18.376351+0000","last_unstale":"2023-09-30T17:02:19.357569+0000","last_undegraded":"2023-09-30T17:02:19.357569+0000","last_fullsized":"2023-09-30T17:02:19.357569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:51:00.454897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357833+0000","last_change":"2023-09-30T17:02:18.360192+0000","last_active":"2023-09-30T17:02:19.357833+0000","last_peered":"2023-09-30T17:02:19.357833+0000","last_clean":"2023-09-30T17:02:19.357833+0000","last_became_active":"2023-09-30T17:02:18.357317+0000","last_became_peered":"2023-09-30T17:02:18.357317+0000","last_unstale":"2023-09-30T17:02:19.357833+0000","last_undegraded":"2023-09-30T17:02:19.357833+0000","last_fullsized":"2023-09-30T17:02:19.357833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:37:14.790993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.356993+0000","last_change":"2023-09-30T17:02:18.376076+0000","last_active":"2023-09-30T17:02:19.356993+0000","last_peered":"2023-09-30T17:02:19.356993+0000","last_clean":"2023-09-30T17:02:19.356993+0000","last_became_active":"2023-09-30T17:02:18.375107+0000","last_became_peered":"2023-09-30T17:02:18.375107+0000","last_unstale":"2023-09-30T17:02:19.356993+0000","last_undegraded":"2023-09-30T17:02:19.356993+0000","last_fullsized":"2023-09-30T17:02:19.356993+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:21:45.195007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.356990+0000","last_change":"2023-09-30T17:02:18.360819+0000","last_active":"2023-09-30T17:02:19.356990+0000","last_peered":"2023-09-30T17:02:19.356990+0000","last_clean":"2023-09-30T17:02:19.356990+0000","last_became_active":"2023-09-30T17:02:18.360506+0000","last_became_peered":"2023-09-30T17:02:18.360506+0000","last_unstale":"2023-09-30T17:02:19.356990+0000","last_undegraded":"2023-09-30T17:02:19.356990+0000","last_fullsized":"2023-09-30T17:02:19.356990+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:26:11.522402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.356352+0000","last_change":"2023-09-30T17:02:18.362003+0000","last_active":"2023-09-30T17:02:19.356352+0000","last_peered":"2023-09-30T17:02:19.356352+0000","last_clean":"2023-09-30T17:02:19.356352+0000","last_became_active":"2023-09-30T17:02:18.361644+0000","last_became_peered":"2023-09-30T17:02:18.361644+0000","last_unstale":"2023-09-30T17:02:19.356352+0000","last_undegraded":"2023-09-30T17:02:19.356352+0000","last_fullsized":"2023-09-30T17:02:19.356352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:48:17.598726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.364354+0000","last_change":"2023-09-30T17:02:18.364222+0000","last_active":"2023-09-30T17:02:19.364354+0000","last_peered":"2023-09-30T17:02:19.364354+0000","last_clean":"2023-09-30T17:02:19.364354+0000","last_became_active":"2023-09-30T17:02:18.363485+0000","last_became_peered":"2023-09-30T17:02:18.363485+0000","last_unstale":"2023-09-30T17:02:19.364354+0000","last_undegraded":"2023-09-30T17:02:19.364354+0000","last_fullsized":"2023-09-30T17:02:19.364354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:14:35.192615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.358415+0000","last_change":"2023-09-30T17:02:18.360010+0000","last_active":"2023-09-30T17:02:19.358415+0000","last_peered":"2023-09-30T17:02:19.358415+0000","last_clean":"2023-09-30T17:02:19.358415+0000","last_became_active":"2023-09-30T17:02:18.358396+0000","last_became_peered":"2023-09-30T17:02:18.358396+0000","last_unstale":"2023-09-30T17:02:19.358415+0000","last_undegraded":"2023-09-30T17:02:19.358415+0000","last_fullsized":"2023-09-30T17:02:19.358415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:26:11.522402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357494+0000","last_change":"2023-09-30T17:02:18.375829+0000","last_active":"2023-09-30T17:02:19.357494+0000","last_peered":"2023-09-30T17:02:19.357494+0000","last_clean":"2023-09-30T17:02:19.357494+0000","last_became_active":"2023-09-30T17:02:18.374447+0000","last_became_peered":"2023-09-30T17:02:18.374447+0000","last_unstale":"2023-09-30T17:02:19.357494+0000","last_undegraded":"2023-09-30T17:02:19.357494+0000","last_fullsized":"2023-09-30T17:02:19.357494+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:02:46.638397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357284+0000","last_change":"2023-09-30T17:02:18.373777+0000","last_active":"2023-09-30T17:02:19.357284+0000","last_peered":"2023-09-30T17:02:19.357284+0000","last_clean":"2023-09-30T17:02:19.357284+0000","last_became_active":"2023-09-30T17:02:18.373434+0000","last_became_peered":"2023-09-30T17:02:18.373434+0000","last_unstale":"2023-09-30T17:02:19.357284+0000","last_undegraded":"2023-09-30T17:02:19.357284+0000","last_fullsized":"2023-09-30T17:02:19.357284+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:13:30.688369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357496+0000","last_change":"2023-09-30T17:02:18.359894+0000","last_active":"2023-09-30T17:02:19.357496+0000","last_peered":"2023-09-30T17:02:19.357496+0000","last_clean":"2023-09-30T17:02:19.357496+0000","last_became_active":"2023-09-30T17:02:18.358534+0000","last_became_peered":"2023-09-30T17:02:18.358534+0000","last_unstale":"2023-09-30T17:02:19.357496+0000","last_undegraded":"2023-09-30T17:02:19.357496+0000","last_fullsized":"2023-09-30T17:02:19.357496+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:22:13.025181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.356892+0000","last_change":"2023-09-30T17:02:18.374094+0000","last_active":"2023-09-30T17:02:19.356892+0000","last_peered":"2023-09-30T17:02:19.356892+0000","last_clean":"2023-09-30T17:02:19.356892+0000","last_became_active":"2023-09-30T17:02:18.373165+0000","last_became_peered":"2023-09-30T17:02:18.373165+0000","last_unstale":"2023-09-30T17:02:19.356892+0000","last_undegraded":"2023-09-30T17:02:19.356892+0000","last_fullsized":"2023-09-30T17:02:19.356892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:13:55.555700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.356482+0000","last_change":"2023-09-30T17:02:18.372075+0000","last_active":"2023-09-30T17:02:19.356482+0000","last_peered":"2023-09-30T17:02:19.356482+0000","last_clean":"2023-09-30T17:02:19.356482+0000","last_became_active":"2023-09-30T17:02:18.371685+0000","last_became_peered":"2023-09-30T17:02:18.371685+0000","last_unstale":"2023-09-30T17:02:19.356482+0000","last_undegraded":"2023-09-30T17:02:19.356482+0000","last_fullsized":"2023-09-30T17:02:19.356482+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:14:35.192615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.356801+0000","last_change":"2023-09-30T17:02:18.376370+0000","last_active":"2023-09-30T17:02:19.356801+0000","last_peered":"2023-09-30T17:02:19.356801+0000","last_clean":"2023-09-30T17:02:19.356801+0000","last_became_active":"2023-09-30T17:02:18.375027+0000","last_became_peered":"2023-09-30T17:02:18.375027+0000","last_unstale":"2023-09-30T17:02:19.356801+0000","last_undegraded":"2023-09-30T17:02:19.356801+0000","last_fullsized":"2023-09-30T17:02:19.356801+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:43:29.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.364415+0000","last_change":"2023-09-30T17:02:18.364360+0000","last_active":"2023-09-30T17:02:19.364415+0000","last_peered":"2023-09-30T17:02:19.364415+0000","last_clean":"2023-09-30T17:02:19.364415+0000","last_became_active":"2023-09-30T17:02:18.363697+0000","last_became_peered":"2023-09-30T17:02:18.363697+0000","last_unstale":"2023-09-30T17:02:19.364415+0000","last_undegraded":"2023-09-30T17:02:19.364415+0000","last_fullsized":"2023-09-30T17:02:19.364415+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:50:52.893768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.358560+0000","last_change":"2023-09-30T17:02:18.360320+0000","last_active":"2023-09-30T17:02:19.358560+0000","last_peered":"2023-09-30T17:02:19.358560+0000","last_clean":"2023-09-30T17:02:19.358560+0000","last_became_active":"2023-09-30T17:02:18.357184+0000","last_became_peered":"2023-09-30T17:02:18.357184+0000","last_unstale":"2023-09-30T17:02:19.358560+0000","last_undegraded":"2023-09-30T17:02:19.358560+0000","last_fullsized":"2023-09-30T17:02:19.358560+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:21:45.195007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.364138+0000","last_change":"2023-09-30T17:02:18.363956+0000","last_active":"2023-09-30T17:02:19.364138+0000","last_peered":"2023-09-30T17:02:19.364138+0000","last_clean":"2023-09-30T17:02:19.364138+0000","last_became_active":"2023-09-30T17:02:18.363654+0000","last_became_peered":"2023-09-30T17:02:18.363654+0000","last_unstale":"2023-09-30T17:02:19.364138+0000","last_undegraded":"2023-09-30T17:02:19.364138+0000","last_fullsized":"2023-09-30T17:02:19.364138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:48:17.598726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357324+0000","last_change":"2023-09-30T17:02:18.377065+0000","last_active":"2023-09-30T17:02:19.357324+0000","last_peered":"2023-09-30T17:02:19.357324+0000","last_clean":"2023-09-30T17:02:19.357324+0000","last_became_active":"2023-09-30T17:02:18.375158+0000","last_became_peered":"2023-09-30T17:02:18.375158+0000","last_unstale":"2023-09-30T17:02:19.357324+0000","last_undegraded":"2023-09-30T17:02:19.357324+0000","last_fullsized":"2023-09-30T17:02:19.357324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:12:06.380095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357361+0000","last_change":"2023-09-30T17:02:18.376206+0000","last_active":"2023-09-30T17:02:19.357361+0000","last_peered":"2023-09-30T17:02:19.357361+0000","last_clean":"2023-09-30T17:02:19.357361+0000","last_became_active":"2023-09-30T17:02:18.374694+0000","last_became_peered":"2023-09-30T17:02:18.374694+0000","last_unstale":"2023-09-30T17:02:19.357361+0000","last_undegraded":"2023-09-30T17:02:19.357361+0000","last_fullsized":"2023-09-30T17:02:19.357361+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:43:17.634140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357322+0000","last_change":"2023-09-30T17:02:18.362977+0000","last_active":"2023-09-30T17:02:19.357322+0000","last_peered":"2023-09-30T17:02:19.357322+0000","last_clean":"2023-09-30T17:02:19.357322+0000","last_became_active":"2023-09-30T17:02:18.362657+0000","last_became_peered":"2023-09-30T17:02:18.362657+0000","last_unstale":"2023-09-30T17:02:19.357322+0000","last_undegraded":"2023-09-30T17:02:19.357322+0000","last_fullsized":"2023-09-30T17:02:19.357322+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:15:54.364571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.363751+0000","last_change":"2023-09-30T17:02:18.361158+0000","last_active":"2023-09-30T17:02:19.363751+0000","last_peered":"2023-09-30T17:02:19.363751+0000","last_clean":"2023-09-30T17:02:19.363751+0000","last_became_active":"2023-09-30T17:02:18.360840+0000","last_became_peered":"2023-09-30T17:02:18.360840+0000","last_unstale":"2023-09-30T17:02:19.363751+0000","last_undegraded":"2023-09-30T17:02:19.363751+0000","last_fullsized":"2023-09-30T17:02:19.363751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:22:13.025181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357297+0000","last_change":"2023-09-30T17:02:18.353938+0000","last_active":"2023-09-30T17:02:19.357297+0000","last_peered":"2023-09-30T17:02:19.357297+0000","last_clean":"2023-09-30T17:02:19.357297+0000","last_became_active":"2023-09-30T17:02:18.353632+0000","last_became_peered":"2023-09-30T17:02:18.353632+0000","last_unstale":"2023-09-30T17:02:19.357297+0000","last_undegraded":"2023-09-30T17:02:19.357297+0000","last_fullsized":"2023-09-30T17:02:19.357297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:09:55.056098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.358593+0000","last_change":"2023-09-30T17:02:18.360801+0000","last_active":"2023-09-30T17:02:19.358593+0000","last_peered":"2023-09-30T17:02:19.358593+0000","last_clean":"2023-09-30T17:02:19.358593+0000","last_became_active":"2023-09-30T17:02:18.358862+0000","last_became_peered":"2023-09-30T17:02:18.358862+0000","last_unstale":"2023-09-30T17:02:19.358593+0000","last_undegraded":"2023-09-30T17:02:19.358593+0000","last_fullsized":"2023-09-30T17:02:19.358593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:55:15.512558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.364354+0000","last_change":"2023-09-30T17:02:18.355710+0000","last_active":"2023-09-30T17:02:19.364354+0000","last_peered":"2023-09-30T17:02:19.364354+0000","last_clean":"2023-09-30T17:02:19.364354+0000","last_became_active":"2023-09-30T17:02:18.355423+0000","last_became_peered":"2023-09-30T17:02:18.355423+0000","last_unstale":"2023-09-30T17:02:19.364354+0000","last_undegraded":"2023-09-30T17:02:19.364354+0000","last_fullsized":"2023-09-30T17:02:19.364354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:39:28.022201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357840+0000","last_change":"2023-09-30T17:02:18.377164+0000","last_active":"2023-09-30T17:02:19.357840+0000","last_peered":"2023-09-30T17:02:19.357840+0000","last_clean":"2023-09-30T17:02:19.357840+0000","last_became_active":"2023-09-30T17:02:18.376425+0000","last_became_peered":"2023-09-30T17:02:18.376425+0000","last_unstale":"2023-09-30T17:02:19.357840+0000","last_undegraded":"2023-09-30T17:02:19.357840+0000","last_fullsized":"2023-09-30T17:02:19.357840+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:20:53.357746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.294200+0000","last_change":"2023-09-30T17:02:17.358258+0000","last_active":"2023-09-30T17:02:19.294200+0000","last_peered":"2023-09-30T17:02:19.294200+0000","last_clean":"2023-09-30T17:02:19.294200+0000","last_became_active":"2023-09-30T17:02:17.357890+0000","last_became_peered":"2023-09-30T17:02:17.357890+0000","last_unstale":"2023-09-30T17:02:19.294200+0000","last_undegraded":"2023-09-30T17:02:19.294200+0000","last_fullsized":"2023-09-30T17:02:19.294200+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:52:56.591906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.358102+0000","last_change":"2023-09-30T17:02:18.358843+0000","last_active":"2023-09-30T17:02:19.358102+0000","last_peered":"2023-09-30T17:02:19.358102+0000","last_clean":"2023-09-30T17:02:19.358102+0000","last_became_active":"2023-09-30T17:02:18.357966+0000","last_became_peered":"2023-09-30T17:02:18.357966+0000","last_unstale":"2023-09-30T17:02:19.358102+0000","last_undegraded":"2023-09-30T17:02:19.358102+0000","last_fullsized":"2023-09-30T17:02:19.358102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:13:55.555700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293653+0000","last_change":"2023-09-30T17:02:17.363387+0000","last_active":"2023-09-30T17:02:19.293653+0000","last_peered":"2023-09-30T17:02:19.293653+0000","last_clean":"2023-09-30T17:02:19.293653+0000","last_became_active":"2023-09-30T17:02:17.363042+0000","last_became_peered":"2023-09-30T17:02:17.363042+0000","last_unstale":"2023-09-30T17:02:19.293653+0000","last_undegraded":"2023-09-30T17:02:19.293653+0000","last_fullsized":"2023-09-30T17:02:19.293653+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:38:57.098312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.364401+0000","last_change":"2023-09-30T17:02:18.355398+0000","last_active":"2023-09-30T17:02:19.364401+0000","last_peered":"2023-09-30T17:02:19.364401+0000","last_clean":"2023-09-30T17:02:19.364401+0000","last_became_active":"2023-09-30T17:02:18.355006+0000","last_became_peered":"2023-09-30T17:02:18.355006+0000","last_unstale":"2023-09-30T17:02:19.364401+0000","last_undegraded":"2023-09-30T17:02:19.364401+0000","last_fullsized":"2023-09-30T17:02:19.364401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:37:14.790993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293603+0000","last_change":"2023-09-30T17:02:17.361000+0000","last_active":"2023-09-30T17:02:19.293603+0000","last_peered":"2023-09-30T17:02:19.293603+0000","last_clean":"2023-09-30T17:02:19.293603+0000","last_became_active":"2023-09-30T17:02:17.360601+0000","last_became_peered":"2023-09-30T17:02:17.360601+0000","last_unstale":"2023-09-30T17:02:19.293603+0000","last_undegraded":"2023-09-30T17:02:19.293603+0000","last_fullsized":"2023-09-30T17:02:19.293603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:02:27.666526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.358593+0000","last_change":"2023-09-30T17:02:18.363570+0000","last_active":"2023-09-30T17:02:19.358593+0000","last_peered":"2023-09-30T17:02:19.358593+0000","last_clean":"2023-09-30T17:02:19.358593+0000","last_became_active":"2023-09-30T17:02:18.362961+0000","last_became_peered":"2023-09-30T17:02:18.362961+0000","last_unstale":"2023-09-30T17:02:19.358593+0000","last_undegraded":"2023-09-30T17:02:19.358593+0000","last_fullsized":"2023-09-30T17:02:19.358593+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:38:15.747647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293949+0000","last_change":"2023-09-30T17:02:17.364672+0000","last_active":"2023-09-30T17:02:19.293949+0000","last_peered":"2023-09-30T17:02:19.293949+0000","last_clean":"2023-09-30T17:02:19.293949+0000","last_became_active":"2023-09-30T17:02:17.364279+0000","last_became_peered":"2023-09-30T17:02:17.364279+0000","last_unstale":"2023-09-30T17:02:19.293949+0000","last_undegraded":"2023-09-30T17:02:19.293949+0000","last_fullsized":"2023-09-30T17:02:19.293949+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:00:56.363835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.363255+0000","last_change":"2023-09-30T17:02:18.358841+0000","last_active":"2023-09-30T17:02:19.363255+0000","last_peered":"2023-09-30T17:02:19.363255+0000","last_clean":"2023-09-30T17:02:19.363255+0000","last_became_active":"2023-09-30T17:02:18.358529+0000","last_became_peered":"2023-09-30T17:02:18.358529+0000","last_unstale":"2023-09-30T17:02:19.363255+0000","last_undegraded":"2023-09-30T17:02:19.363255+0000","last_fullsized":"2023-09-30T17:02:19.363255+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:15:54.364571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293818+0000","last_change":"2023-09-30T17:02:17.357998+0000","last_active":"2023-09-30T17:02:19.293818+0000","last_peered":"2023-09-30T17:02:19.293818+0000","last_clean":"2023-09-30T17:02:19.293818+0000","last_became_active":"2023-09-30T17:02:17.357653+0000","last_became_peered":"2023-09-30T17:02:17.357653+0000","last_unstale":"2023-09-30T17:02:19.293818+0000","last_undegraded":"2023-09-30T17:02:19.293818+0000","last_fullsized":"2023-09-30T17:02:19.293818+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:52:37.518693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.363934+0000","last_change":"2023-09-30T17:02:18.361155+0000","last_active":"2023-09-30T17:02:19.363934+0000","last_peered":"2023-09-30T17:02:19.363934+0000","last_clean":"2023-09-30T17:02:19.363934+0000","last_became_active":"2023-09-30T17:02:18.360825+0000","last_became_peered":"2023-09-30T17:02:18.360825+0000","last_unstale":"2023-09-30T17:02:19.363934+0000","last_undegraded":"2023-09-30T17:02:19.363934+0000","last_fullsized":"2023-09-30T17:02:19.363934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:39:16.689300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.294335+0000","last_change":"2023-09-30T17:02:17.363119+0000","last_active":"2023-09-30T17:02:19.294335+0000","last_peered":"2023-09-30T17:02:19.294335+0000","last_clean":"2023-09-30T17:02:19.294335+0000","last_became_active":"2023-09-30T17:02:17.362754+0000","last_became_peered":"2023-09-30T17:02:17.362754+0000","last_unstale":"2023-09-30T17:02:19.294335+0000","last_undegraded":"2023-09-30T17:02:19.294335+0000","last_fullsized":"2023-09-30T17:02:19.294335+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:00:56.363835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.363589+0000","last_change":"2023-09-30T17:02:18.359118+0000","last_active":"2023-09-30T17:02:19.363589+0000","last_peered":"2023-09-30T17:02:19.363589+0000","last_clean":"2023-09-30T17:02:19.363589+0000","last_became_active":"2023-09-30T17:02:18.358786+0000","last_became_peered":"2023-09-30T17:02:18.358786+0000","last_unstale":"2023-09-30T17:02:19.363589+0000","last_undegraded":"2023-09-30T17:02:19.363589+0000","last_fullsized":"2023-09-30T17:02:19.363589+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:33:21.723864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293706+0000","last_change":"2023-09-30T17:02:17.355936+0000","last_active":"2023-09-30T17:02:19.293706+0000","last_peered":"2023-09-30T17:02:19.293706+0000","last_clean":"2023-09-30T17:02:19.293706+0000","last_became_active":"2023-09-30T17:02:17.355664+0000","last_became_peered":"2023-09-30T17:02:17.355664+0000","last_unstale":"2023-09-30T17:02:19.293706+0000","last_undegraded":"2023-09-30T17:02:19.293706+0000","last_fullsized":"2023-09-30T17:02:19.293706+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:11:46.248439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357021+0000","last_change":"2023-09-30T17:02:18.373330+0000","last_active":"2023-09-30T17:02:19.357021+0000","last_peered":"2023-09-30T17:02:19.357021+0000","last_clean":"2023-09-30T17:02:19.357021+0000","last_became_active":"2023-09-30T17:02:18.373004+0000","last_became_peered":"2023-09-30T17:02:18.373004+0000","last_unstale":"2023-09-30T17:02:19.357021+0000","last_undegraded":"2023-09-30T17:02:19.357021+0000","last_fullsized":"2023-09-30T17:02:19.357021+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:16:27.516884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293603+0000","last_change":"2023-09-30T17:02:17.359251+0000","last_active":"2023-09-30T17:02:19.293603+0000","last_peered":"2023-09-30T17:02:19.293603+0000","last_clean":"2023-09-30T17:02:19.293603+0000","last_became_active":"2023-09-30T17:02:17.358579+0000","last_became_peered":"2023-09-30T17:02:17.358579+0000","last_unstale":"2023-09-30T17:02:19.293603+0000","last_undegraded":"2023-09-30T17:02:19.293603+0000","last_fullsized":"2023-09-30T17:02:19.293603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:55:33.944875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357627+0000","last_change":"2023-09-30T17:02:18.360019+0000","last_active":"2023-09-30T17:02:19.357627+0000","last_peered":"2023-09-30T17:02:19.357627+0000","last_clean":"2023-09-30T17:02:19.357627+0000","last_became_active":"2023-09-30T17:02:18.358364+0000","last_became_peered":"2023-09-30T17:02:18.358364+0000","last_unstale":"2023-09-30T17:02:19.357627+0000","last_undegraded":"2023-09-30T17:02:19.357627+0000","last_fullsized":"2023-09-30T17:02:19.357627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:30:43.782165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293708+0000","last_change":"2023-09-30T17:02:17.363694+0000","last_active":"2023-09-30T17:02:19.293708+0000","last_peered":"2023-09-30T17:02:19.293708+0000","last_clean":"2023-09-30T17:02:19.293708+0000","last_became_active":"2023-09-30T17:02:17.363442+0000","last_became_peered":"2023-09-30T17:02:17.363442+0000","last_unstale":"2023-09-30T17:02:19.293708+0000","last_undegraded":"2023-09-30T17:02:19.293708+0000","last_fullsized":"2023-09-30T17:02:19.293708+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:19:19.997724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.358063+0000","last_change":"2023-09-30T17:02:18.362415+0000","last_active":"2023-09-30T17:02:19.358063+0000","last_peered":"2023-09-30T17:02:19.358063+0000","last_clean":"2023-09-30T17:02:19.358063+0000","last_became_active":"2023-09-30T17:02:18.361556+0000","last_became_peered":"2023-09-30T17:02:18.361556+0000","last_unstale":"2023-09-30T17:02:19.358063+0000","last_undegraded":"2023-09-30T17:02:19.358063+0000","last_fullsized":"2023-09-30T17:02:19.358063+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:16:41.607547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.294127+0000","last_change":"2023-09-30T17:02:17.363369+0000","last_active":"2023-09-30T17:02:19.294127+0000","last_peered":"2023-09-30T17:02:19.294127+0000","last_clean":"2023-09-30T17:02:19.294127+0000","last_became_active":"2023-09-30T17:02:17.362925+0000","last_became_peered":"2023-09-30T17:02:17.362925+0000","last_unstale":"2023-09-30T17:02:19.294127+0000","last_undegraded":"2023-09-30T17:02:19.294127+0000","last_fullsized":"2023-09-30T17:02:19.294127+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:50:18.455188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.364537+0000","last_change":"2023-09-30T17:02:18.356700+0000","last_active":"2023-09-30T17:02:19.364537+0000","last_peered":"2023-09-30T17:02:19.364537+0000","last_clean":"2023-09-30T17:02:19.364537+0000","last_became_active":"2023-09-30T17:02:18.356108+0000","last_became_peered":"2023-09-30T17:02:18.356108+0000","last_unstale":"2023-09-30T17:02:19.364537+0000","last_undegraded":"2023-09-30T17:02:19.364537+0000","last_fullsized":"2023-09-30T17:02:19.364537+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:16:41.607547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293424+0000","last_change":"2023-09-30T17:02:17.355214+0000","last_active":"2023-09-30T17:02:19.293424+0000","last_peered":"2023-09-30T17:02:19.293424+0000","last_clean":"2023-09-30T17:02:19.293424+0000","last_became_active":"2023-09-30T17:02:17.354876+0000","last_became_peered":"2023-09-30T17:02:17.354876+0000","last_unstale":"2023-09-30T17:02:19.293424+0000","last_undegraded":"2023-09-30T17:02:19.293424+0000","last_fullsized":"2023-09-30T17:02:19.293424+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:13:41.205152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.364747+0000","last_change":"2023-09-30T17:02:18.356814+0000","last_active":"2023-09-30T17:02:19.364747+0000","last_peered":"2023-09-30T17:02:19.364747+0000","last_clean":"2023-09-30T17:02:19.364747+0000","last_became_active":"2023-09-30T17:02:18.356258+0000","last_became_peered":"2023-09-30T17:02:18.356258+0000","last_unstale":"2023-09-30T17:02:19.364747+0000","last_undegraded":"2023-09-30T17:02:19.364747+0000","last_fullsized":"2023-09-30T17:02:19.364747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:26:11.522402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293840+0000","last_change":"2023-09-30T17:02:17.355972+0000","last_active":"2023-09-30T17:02:19.293840+0000","last_peered":"2023-09-30T17:02:19.293840+0000","last_clean":"2023-09-30T17:02:19.293840+0000","last_became_active":"2023-09-30T17:02:17.355653+0000","last_became_peered":"2023-09-30T17:02:17.355653+0000","last_unstale":"2023-09-30T17:02:19.293840+0000","last_undegraded":"2023-09-30T17:02:19.293840+0000","last_fullsized":"2023-09-30T17:02:19.293840+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:27:37.446407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.356869+0000","last_change":"2023-09-30T17:02:18.355736+0000","last_active":"2023-09-30T17:02:19.356869+0000","last_peered":"2023-09-30T17:02:19.356869+0000","last_clean":"2023-09-30T17:02:19.356869+0000","last_became_active":"2023-09-30T17:02:18.355111+0000","last_became_peered":"2023-09-30T17:02:18.355111+0000","last_unstale":"2023-09-30T17:02:19.356869+0000","last_undegraded":"2023-09-30T17:02:19.356869+0000","last_fullsized":"2023-09-30T17:02:19.356869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:47:00.094303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.294406+0000","last_change":"2023-09-30T17:02:17.363514+0000","last_active":"2023-09-30T17:02:19.294406+0000","last_peered":"2023-09-30T17:02:19.294406+0000","last_clean":"2023-09-30T17:02:19.294406+0000","last_became_active":"2023-09-30T17:02:17.363124+0000","last_became_peered":"2023-09-30T17:02:17.363124+0000","last_unstale":"2023-09-30T17:02:19.294406+0000","last_undegraded":"2023-09-30T17:02:19.294406+0000","last_fullsized":"2023-09-30T17:02:19.294406+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:55:33.944875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357665+0000","last_change":"2023-09-30T17:02:18.359767+0000","last_active":"2023-09-30T17:02:19.357665+0000","last_peered":"2023-09-30T17:02:19.357665+0000","last_clean":"2023-09-30T17:02:19.357665+0000","last_became_active":"2023-09-30T17:02:18.356825+0000","last_became_peered":"2023-09-30T17:02:18.356825+0000","last_unstale":"2023-09-30T17:02:19.357665+0000","last_undegraded":"2023-09-30T17:02:19.357665+0000","last_fullsized":"2023-09-30T17:02:19.357665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:39:16.689300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293738+0000","last_change":"2023-09-30T17:02:17.355878+0000","last_active":"2023-09-30T17:02:19.293738+0000","last_peered":"2023-09-30T17:02:19.293738+0000","last_clean":"2023-09-30T17:02:19.293738+0000","last_became_active":"2023-09-30T17:02:17.355642+0000","last_became_peered":"2023-09-30T17:02:17.355642+0000","last_unstale":"2023-09-30T17:02:19.293738+0000","last_undegraded":"2023-09-30T17:02:19.293738+0000","last_fullsized":"2023-09-30T17:02:19.293738+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:04:48.294789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.356816+0000","last_change":"2023-09-30T17:02:18.375303+0000","last_active":"2023-09-30T17:02:19.356816+0000","last_peered":"2023-09-30T17:02:19.356816+0000","last_clean":"2023-09-30T17:02:19.356816+0000","last_became_active":"2023-09-30T17:02:18.373962+0000","last_became_peered":"2023-09-30T17:02:18.373962+0000","last_unstale":"2023-09-30T17:02:19.356816+0000","last_undegraded":"2023-09-30T17:02:19.356816+0000","last_fullsized":"2023-09-30T17:02:19.356816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:16:41.607547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293666+0000","last_change":"2023-09-30T17:02:17.358126+0000","last_active":"2023-09-30T17:02:19.293666+0000","last_peered":"2023-09-30T17:02:19.293666+0000","last_clean":"2023-09-30T17:02:19.293666+0000","last_became_active":"2023-09-30T17:02:17.357621+0000","last_became_peered":"2023-09-30T17:02:17.357621+0000","last_unstale":"2023-09-30T17:02:19.293666+0000","last_undegraded":"2023-09-30T17:02:19.293666+0000","last_fullsized":"2023-09-30T17:02:19.293666+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:46:16.375239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.364059+0000","last_change":"2023-09-30T17:02:18.362399+0000","last_active":"2023-09-30T17:02:19.364059+0000","last_peered":"2023-09-30T17:02:19.364059+0000","last_clean":"2023-09-30T17:02:19.364059+0000","last_became_active":"2023-09-30T17:02:18.362173+0000","last_became_peered":"2023-09-30T17:02:18.362173+0000","last_unstale":"2023-09-30T17:02:19.364059+0000","last_undegraded":"2023-09-30T17:02:19.364059+0000","last_fullsized":"2023-09-30T17:02:19.364059+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:30:35.150981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293733+0000","last_change":"2023-09-30T17:02:17.363567+0000","last_active":"2023-09-30T17:02:19.293733+0000","last_peered":"2023-09-30T17:02:19.293733+0000","last_clean":"2023-09-30T17:02:19.293733+0000","last_became_active":"2023-09-30T17:02:17.363254+0000","last_became_peered":"2023-09-30T17:02:17.363254+0000","last_unstale":"2023-09-30T17:02:19.293733+0000","last_undegraded":"2023-09-30T17:02:19.293733+0000","last_fullsized":"2023-09-30T17:02:19.293733+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:08:34.994215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357037+0000","last_change":"2023-09-30T17:02:18.372346+0000","last_active":"2023-09-30T17:02:19.357037+0000","last_peered":"2023-09-30T17:02:19.357037+0000","last_clean":"2023-09-30T17:02:19.357037+0000","last_became_active":"2023-09-30T17:02:18.371542+0000","last_became_peered":"2023-09-30T17:02:18.371542+0000","last_unstale":"2023-09-30T17:02:19.357037+0000","last_undegraded":"2023-09-30T17:02:19.357037+0000","last_fullsized":"2023-09-30T17:02:19.357037+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:55:15.512558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293510+0000","last_change":"2023-09-30T17:02:17.358658+0000","last_active":"2023-09-30T17:02:19.293510+0000","last_peered":"2023-09-30T17:02:19.293510+0000","last_clean":"2023-09-30T17:02:19.293510+0000","last_became_active":"2023-09-30T17:02:17.357738+0000","last_became_peered":"2023-09-30T17:02:17.357738+0000","last_unstale":"2023-09-30T17:02:19.293510+0000","last_undegraded":"2023-09-30T17:02:19.293510+0000","last_fullsized":"2023-09-30T17:02:19.293510+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:00:16.830342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357758+0000","last_change":"2023-09-30T17:02:18.373854+0000","last_active":"2023-09-30T17:02:19.357758+0000","last_peered":"2023-09-30T17:02:19.357758+0000","last_clean":"2023-09-30T17:02:19.357758+0000","last_became_active":"2023-09-30T17:02:18.373315+0000","last_became_peered":"2023-09-30T17:02:18.373315+0000","last_unstale":"2023-09-30T17:02:19.357758+0000","last_undegraded":"2023-09-30T17:02:19.357758+0000","last_fullsized":"2023-09-30T17:02:19.357758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:28:07.751219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.294114+0000","last_change":"2023-09-30T17:02:17.359738+0000","last_active":"2023-09-30T17:02:19.294114+0000","last_peered":"2023-09-30T17:02:19.294114+0000","last_clean":"2023-09-30T17:02:19.294114+0000","last_became_active":"2023-09-30T17:02:17.359424+0000","last_became_peered":"2023-09-30T17:02:17.359424+0000","last_unstale":"2023-09-30T17:02:19.294114+0000","last_undegraded":"2023-09-30T17:02:19.294114+0000","last_fullsized":"2023-09-30T17:02:19.294114+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:01:31.158446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357403+0000","last_change":"2023-09-30T17:02:18.373068+0000","last_active":"2023-09-30T17:02:19.357403+0000","last_peered":"2023-09-30T17:02:19.357403+0000","last_clean":"2023-09-30T17:02:19.357403+0000","last_became_active":"2023-09-30T17:02:18.372739+0000","last_became_peered":"2023-09-30T17:02:18.372739+0000","last_unstale":"2023-09-30T17:02:19.357403+0000","last_undegraded":"2023-09-30T17:02:19.357403+0000","last_fullsized":"2023-09-30T17:02:19.357403+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:37:30.572488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.294090+0000","last_change":"2023-09-30T17:02:17.358811+0000","last_active":"2023-09-30T17:02:19.294090+0000","last_peered":"2023-09-30T17:02:19.294090+0000","last_clean":"2023-09-30T17:02:19.294090+0000","last_became_active":"2023-09-30T17:02:17.358582+0000","last_became_peered":"2023-09-30T17:02:17.358582+0000","last_unstale":"2023-09-30T17:02:19.294090+0000","last_undegraded":"2023-09-30T17:02:19.294090+0000","last_fullsized":"2023-09-30T17:02:19.294090+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:52:37.518693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.364541+0000","last_change":"2023-09-30T17:02:18.364478+0000","last_active":"2023-09-30T17:02:19.364541+0000","last_peered":"2023-09-30T17:02:19.364541+0000","last_clean":"2023-09-30T17:02:19.364541+0000","last_became_active":"2023-09-30T17:02:18.364057+0000","last_became_peered":"2023-09-30T17:02:18.364057+0000","last_unstale":"2023-09-30T17:02:19.364541+0000","last_undegraded":"2023-09-30T17:02:19.364541+0000","last_fullsized":"2023-09-30T17:02:19.364541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:13:55.555700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.348448+0000","last_change":"2023-09-30T17:02:12.327704+0000","last_active":"2023-09-30T17:02:18.348448+0000","last_peered":"2023-09-30T17:02:18.348448+0000","last_clean":"2023-09-30T17:02:18.348448+0000","last_became_active":"2023-09-30T17:02:12.327384+0000","last_became_peered":"2023-09-30T17:02:12.327384+0000","last_unstale":"2023-09-30T17:02:18.348448+0000","last_undegraded":"2023-09-30T17:02:18.348448+0000","last_fullsized":"2023-09-30T17:02:18.348448+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:09:34.818252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293774+0000","last_change":"2023-09-30T17:02:17.357321+0000","last_active":"2023-09-30T17:02:19.293774+0000","last_peered":"2023-09-30T17:02:19.293774+0000","last_clean":"2023-09-30T17:02:19.293774+0000","last_became_active":"2023-09-30T17:02:17.357105+0000","last_became_peered":"2023-09-30T17:02:17.357105+0000","last_unstale":"2023-09-30T17:02:19.293774+0000","last_undegraded":"2023-09-30T17:02:19.293774+0000","last_fullsized":"2023-09-30T17:02:19.293774+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:09:54.050468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357396+0000","last_change":"2023-09-30T17:02:18.356537+0000","last_active":"2023-09-30T17:02:19.357396+0000","last_peered":"2023-09-30T17:02:19.357396+0000","last_clean":"2023-09-30T17:02:19.357396+0000","last_became_active":"2023-09-30T17:02:18.355641+0000","last_became_peered":"2023-09-30T17:02:18.355641+0000","last_unstale":"2023-09-30T17:02:19.357396+0000","last_undegraded":"2023-09-30T17:02:19.357396+0000","last_fullsized":"2023-09-30T17:02:19.357396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:33:21.723864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.355403+0000","last_change":"2023-09-30T17:02:12.332417+0000","last_active":"2023-09-30T17:02:18.355403+0000","last_peered":"2023-09-30T17:02:18.355403+0000","last_clean":"2023-09-30T17:02:18.355403+0000","last_became_active":"2023-09-30T17:02:12.332124+0000","last_became_peered":"2023-09-30T17:02:12.332124+0000","last_unstale":"2023-09-30T17:02:18.355403+0000","last_undegraded":"2023-09-30T17:02:18.355403+0000","last_fullsized":"2023-09-30T17:02:18.355403+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:21:27.587948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293583+0000","last_change":"2023-09-30T17:02:17.359029+0000","last_active":"2023-09-30T17:02:19.293583+0000","last_peered":"2023-09-30T17:02:19.293583+0000","last_clean":"2023-09-30T17:02:19.293583+0000","last_became_active":"2023-09-30T17:02:17.357931+0000","last_became_peered":"2023-09-30T17:02:17.357931+0000","last_unstale":"2023-09-30T17:02:19.293583+0000","last_undegraded":"2023-09-30T17:02:19.293583+0000","last_fullsized":"2023-09-30T17:02:19.293583+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:00:56.363835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.363856+0000","last_change":"2023-09-30T17:02:18.363399+0000","last_active":"2023-09-30T17:02:19.363856+0000","last_peered":"2023-09-30T17:02:19.363856+0000","last_clean":"2023-09-30T17:02:19.363856+0000","last_became_active":"2023-09-30T17:02:18.363064+0000","last_became_peered":"2023-09-30T17:02:18.363064+0000","last_unstale":"2023-09-30T17:02:19.363856+0000","last_undegraded":"2023-09-30T17:02:19.363856+0000","last_fullsized":"2023-09-30T17:02:19.363856+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:32:34.654264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.348157+0000","last_change":"2023-09-30T17:02:12.327834+0000","last_active":"2023-09-30T17:02:18.348157+0000","last_peered":"2023-09-30T17:02:18.348157+0000","last_clean":"2023-09-30T17:02:18.348157+0000","last_became_active":"2023-09-30T17:02:12.327542+0000","last_became_peered":"2023-09-30T17:02:12.327542+0000","last_unstale":"2023-09-30T17:02:18.348157+0000","last_undegraded":"2023-09-30T17:02:18.348157+0000","last_fullsized":"2023-09-30T17:02:18.348157+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:49:54.890769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.294077+0000","last_change":"2023-09-30T17:02:17.363326+0000","last_active":"2023-09-30T17:02:19.294077+0000","last_peered":"2023-09-30T17:02:19.294077+0000","last_clean":"2023-09-30T17:02:19.294077+0000","last_became_active":"2023-09-30T17:02:17.362934+0000","last_became_peered":"2023-09-30T17:02:17.362934+0000","last_unstale":"2023-09-30T17:02:19.294077+0000","last_undegraded":"2023-09-30T17:02:19.294077+0000","last_fullsized":"2023-09-30T17:02:19.294077+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:24:04.564387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.364712+0000","last_change":"2023-09-30T17:02:18.364406+0000","last_active":"2023-09-30T17:02:19.364712+0000","last_peered":"2023-09-30T17:02:19.364712+0000","last_clean":"2023-09-30T17:02:19.364712+0000","last_became_active":"2023-09-30T17:02:18.363849+0000","last_became_peered":"2023-09-30T17:02:18.363849+0000","last_unstale":"2023-09-30T17:02:19.364712+0000","last_undegraded":"2023-09-30T17:02:19.364712+0000","last_fullsized":"2023-09-30T17:02:19.364712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:43:29.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.357252+0000","last_change":"2023-09-30T17:02:12.332542+0000","last_active":"2023-09-30T17:02:18.357252+0000","last_peered":"2023-09-30T17:02:18.357252+0000","last_clean":"2023-09-30T17:02:18.357252+0000","last_became_active":"2023-09-30T17:02:12.332132+0000","last_became_peered":"2023-09-30T17:02:12.332132+0000","last_unstale":"2023-09-30T17:02:18.357252+0000","last_undegraded":"2023-09-30T17:02:18.357252+0000","last_fullsized":"2023-09-30T17:02:18.357252+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:14:16.917130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":214,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.355641+0000","last_change":"2023-09-30T17:02:07.309872+0000","last_active":"2023-09-30T17:02:18.355641+0000","last_peered":"2023-09-30T17:02:18.355641+0000","last_clean":"2023-09-30T17:02:18.355641+0000","last_became_active":"2023-09-30T17:02:07.309630+0000","last_became_peered":"2023-09-30T17:02:07.309630+0000","last_unstale":"2023-09-30T17:02:18.355641+0000","last_undegraded":"2023-09-30T17:02:18.355641+0000","last_fullsized":"2023-09-30T17:02:18.355641+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:06.295501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:06.295501+0000","last_clean_scrub_stamp":"2023-09-30T17:02:06.295501+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:20:12.668818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293686+0000","last_change":"2023-09-30T17:02:17.357139+0000","last_active":"2023-09-30T17:02:19.293686+0000","last_peered":"2023-09-30T17:02:19.293686+0000","last_clean":"2023-09-30T17:02:19.293686+0000","last_became_active":"2023-09-30T17:02:17.356901+0000","last_became_peered":"2023-09-30T17:02:17.356901+0000","last_unstale":"2023-09-30T17:02:19.293686+0000","last_undegraded":"2023-09-30T17:02:19.293686+0000","last_fullsized":"2023-09-30T17:02:19.293686+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:22:35.747671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357783+0000","last_change":"2023-09-30T17:02:18.373627+0000","last_active":"2023-09-30T17:02:19.357783+0000","last_peered":"2023-09-30T17:02:19.357783+0000","last_clean":"2023-09-30T17:02:19.357783+0000","last_became_active":"2023-09-30T17:02:18.373275+0000","last_became_peered":"2023-09-30T17:02:18.373275+0000","last_unstale":"2023-09-30T17:02:19.357783+0000","last_undegraded":"2023-09-30T17:02:19.357783+0000","last_fullsized":"2023-09-30T17:02:19.357783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:44:18.066167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.354175+0000","last_change":"2023-09-30T17:02:12.330129+0000","last_active":"2023-09-30T17:02:18.354175+0000","last_peered":"2023-09-30T17:02:18.354175+0000","last_clean":"2023-09-30T17:02:18.354175+0000","last_became_active":"2023-09-30T17:02:12.329863+0000","last_became_peered":"2023-09-30T17:02:12.329863+0000","last_unstale":"2023-09-30T17:02:18.354175+0000","last_undegraded":"2023-09-30T17:02:18.354175+0000","last_fullsized":"2023-09-30T17:02:18.354175+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:21:45.393691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293615+0000","last_change":"2023-09-30T17:02:17.363398+0000","last_active":"2023-09-30T17:02:19.293615+0000","last_peered":"2023-09-30T17:02:19.293615+0000","last_clean":"2023-09-30T17:02:19.293615+0000","last_became_active":"2023-09-30T17:02:17.363086+0000","last_became_peered":"2023-09-30T17:02:17.363086+0000","last_unstale":"2023-09-30T17:02:19.293615+0000","last_undegraded":"2023-09-30T17:02:19.293615+0000","last_fullsized":"2023-09-30T17:02:19.293615+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:48:08.569937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.358480+0000","last_change":"2023-09-30T17:02:18.360029+0000","last_active":"2023-09-30T17:02:19.358480+0000","last_peered":"2023-09-30T17:02:19.358480+0000","last_clean":"2023-09-30T17:02:19.358480+0000","last_became_active":"2023-09-30T17:02:18.356839+0000","last_became_peered":"2023-09-30T17:02:18.356839+0000","last_unstale":"2023-09-30T17:02:19.358480+0000","last_undegraded":"2023-09-30T17:02:19.358480+0000","last_fullsized":"2023-09-30T17:02:19.358480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:16:27.516884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.356756+0000","last_change":"2023-09-30T17:02:12.330472+0000","last_active":"2023-09-30T17:02:18.356756+0000","last_peered":"2023-09-30T17:02:18.356756+0000","last_clean":"2023-09-30T17:02:18.356756+0000","last_became_active":"2023-09-30T17:02:12.330154+0000","last_became_peered":"2023-09-30T17:02:12.330154+0000","last_unstale":"2023-09-30T17:02:18.356756+0000","last_undegraded":"2023-09-30T17:02:18.356756+0000","last_fullsized":"2023-09-30T17:02:18.356756+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:43:23.161734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293780+0000","last_change":"2023-09-30T17:02:17.361007+0000","last_active":"2023-09-30T17:02:19.293780+0000","last_peered":"2023-09-30T17:02:19.293780+0000","last_clean":"2023-09-30T17:02:19.293780+0000","last_became_active":"2023-09-30T17:02:17.360721+0000","last_became_peered":"2023-09-30T17:02:17.360721+0000","last_unstale":"2023-09-30T17:02:19.293780+0000","last_undegraded":"2023-09-30T17:02:19.293780+0000","last_fullsized":"2023-09-30T17:02:19.293780+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:13:41.205152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357723+0000","last_change":"2023-09-30T17:02:18.364148+0000","last_active":"2023-09-30T17:02:19.357723+0000","last_peered":"2023-09-30T17:02:19.357723+0000","last_clean":"2023-09-30T17:02:19.357723+0000","last_became_active":"2023-09-30T17:02:18.363793+0000","last_became_peered":"2023-09-30T17:02:18.363793+0000","last_unstale":"2023-09-30T17:02:19.357723+0000","last_undegraded":"2023-09-30T17:02:19.357723+0000","last_fullsized":"2023-09-30T17:02:19.357723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:30:35.150981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293916+0000","last_change":"2023-09-30T17:02:17.360831+0000","last_active":"2023-09-30T17:02:19.293916+0000","last_peered":"2023-09-30T17:02:19.293916+0000","last_clean":"2023-09-30T17:02:19.293916+0000","last_became_active":"2023-09-30T17:02:17.360494+0000","last_became_peered":"2023-09-30T17:02:17.360494+0000","last_unstale":"2023-09-30T17:02:19.293916+0000","last_undegraded":"2023-09-30T17:02:19.293916+0000","last_fullsized":"2023-09-30T17:02:19.293916+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:24:04.564387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.350218+0000","last_change":"2023-09-30T17:02:12.328184+0000","last_active":"2023-09-30T17:02:18.350218+0000","last_peered":"2023-09-30T17:02:18.350218+0000","last_clean":"2023-09-30T17:02:18.350218+0000","last_became_active":"2023-09-30T17:02:12.327898+0000","last_became_peered":"2023-09-30T17:02:12.327898+0000","last_unstale":"2023-09-30T17:02:18.350218+0000","last_undegraded":"2023-09-30T17:02:18.350218+0000","last_fullsized":"2023-09-30T17:02:18.350218+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:43:23.161734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.363242+0000","last_change":"2023-09-30T17:02:18.361791+0000","last_active":"2023-09-30T17:02:19.363242+0000","last_peered":"2023-09-30T17:02:19.363242+0000","last_clean":"2023-09-30T17:02:19.363242+0000","last_became_active":"2023-09-30T17:02:18.361226+0000","last_became_peered":"2023-09-30T17:02:18.361226+0000","last_unstale":"2023-09-30T17:02:19.363242+0000","last_undegraded":"2023-09-30T17:02:19.363242+0000","last_fullsized":"2023-09-30T17:02:19.363242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:13:30.688369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:18.356790+0000","last_change":"2023-09-30T17:02:12.330039+0000","last_active":"2023-09-30T17:02:18.356790+0000","last_peered":"2023-09-30T17:02:18.356790+0000","last_clean":"2023-09-30T17:02:18.356790+0000","last_became_active":"2023-09-30T17:02:12.329827+0000","last_became_peered":"2023-09-30T17:02:12.329827+0000","last_unstale":"2023-09-30T17:02:18.356790+0000","last_undegraded":"2023-09-30T17:02:18.356790+0000","last_fullsized":"2023-09-30T17:02:18.356790+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:21:09.449776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.364463+0000","last_change":"2023-09-30T17:02:17.364615+0000","last_active":"2023-09-30T17:02:19.364463+0000","last_peered":"2023-09-30T17:02:19.364463+0000","last_clean":"2023-09-30T17:02:19.364463+0000","last_became_active":"2023-09-30T17:02:17.364317+0000","last_became_peered":"2023-09-30T17:02:17.364317+0000","last_unstale":"2023-09-30T17:02:19.364463+0000","last_undegraded":"2023-09-30T17:02:19.364463+0000","last_fullsized":"2023-09-30T17:02:19.364463+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:52:37.518693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357528+0000","last_change":"2023-09-30T17:02:18.356454+0000","last_active":"2023-09-30T17:02:19.357528+0000","last_peered":"2023-09-30T17:02:19.357528+0000","last_clean":"2023-09-30T17:02:19.357528+0000","last_became_active":"2023-09-30T17:02:18.355486+0000","last_became_peered":"2023-09-30T17:02:18.355486+0000","last_unstale":"2023-09-30T17:02:19.357528+0000","last_undegraded":"2023-09-30T17:02:19.357528+0000","last_fullsized":"2023-09-30T17:02:19.357528+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:32:34.654264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.294253+0000","last_change":"2023-09-30T17:02:17.363396+0000","last_active":"2023-09-30T17:02:19.294253+0000","last_peered":"2023-09-30T17:02:19.294253+0000","last_clean":"2023-09-30T17:02:19.294253+0000","last_became_active":"2023-09-30T17:02:17.363065+0000","last_became_peered":"2023-09-30T17:02:17.363065+0000","last_unstale":"2023-09-30T17:02:19.294253+0000","last_undegraded":"2023-09-30T17:02:19.294253+0000","last_fullsized":"2023-09-30T17:02:19.294253+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:09:59.154381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357795+0000","last_change":"2023-09-30T17:02:18.358269+0000","last_active":"2023-09-30T17:02:19.357795+0000","last_peered":"2023-09-30T17:02:19.357795+0000","last_clean":"2023-09-30T17:02:19.357795+0000","last_became_active":"2023-09-30T17:02:18.356902+0000","last_became_peered":"2023-09-30T17:02:18.356902+0000","last_unstale":"2023-09-30T17:02:19.357795+0000","last_undegraded":"2023-09-30T17:02:19.357795+0000","last_fullsized":"2023-09-30T17:02:19.357795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:39:28.022201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293693+0000","last_change":"2023-09-30T17:02:17.358568+0000","last_active":"2023-09-30T17:02:19.293693+0000","last_peered":"2023-09-30T17:02:19.293693+0000","last_clean":"2023-09-30T17:02:19.293693+0000","last_became_active":"2023-09-30T17:02:17.357763+0000","last_became_peered":"2023-09-30T17:02:17.357763+0000","last_unstale":"2023-09-30T17:02:19.293693+0000","last_undegraded":"2023-09-30T17:02:19.293693+0000","last_fullsized":"2023-09-30T17:02:19.293693+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:04:22.748557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357224+0000","last_change":"2023-09-30T17:02:18.376236+0000","last_active":"2023-09-30T17:02:19.357224+0000","last_peered":"2023-09-30T17:02:19.357224+0000","last_clean":"2023-09-30T17:02:19.357224+0000","last_became_active":"2023-09-30T17:02:18.374853+0000","last_became_peered":"2023-09-30T17:02:18.374853+0000","last_unstale":"2023-09-30T17:02:19.357224+0000","last_undegraded":"2023-09-30T17:02:19.357224+0000","last_fullsized":"2023-09-30T17:02:19.357224+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:38:15.747647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.294354+0000","last_change":"2023-09-30T17:02:17.363358+0000","last_active":"2023-09-30T17:02:19.294354+0000","last_peered":"2023-09-30T17:02:19.294354+0000","last_clean":"2023-09-30T17:02:19.294354+0000","last_became_active":"2023-09-30T17:02:17.363003+0000","last_became_peered":"2023-09-30T17:02:17.363003+0000","last_unstale":"2023-09-30T17:02:19.294354+0000","last_undegraded":"2023-09-30T17:02:19.294354+0000","last_fullsized":"2023-09-30T17:02:19.294354+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:27:37.446407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.356604+0000","last_change":"2023-09-30T17:02:18.362117+0000","last_active":"2023-09-30T17:02:19.356604+0000","last_peered":"2023-09-30T17:02:19.356604+0000","last_clean":"2023-09-30T17:02:19.356604+0000","last_became_active":"2023-09-30T17:02:18.361463+0000","last_became_peered":"2023-09-30T17:02:18.361463+0000","last_unstale":"2023-09-30T17:02:19.356604+0000","last_undegraded":"2023-09-30T17:02:19.356604+0000","last_fullsized":"2023-09-30T17:02:19.356604+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:37:14.790993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293869+0000","last_change":"2023-09-30T17:02:17.360802+0000","last_active":"2023-09-30T17:02:19.293869+0000","last_peered":"2023-09-30T17:02:19.293869+0000","last_clean":"2023-09-30T17:02:19.293869+0000","last_became_active":"2023-09-30T17:02:17.360475+0000","last_became_peered":"2023-09-30T17:02:17.360475+0000","last_unstale":"2023-09-30T17:02:19.293869+0000","last_undegraded":"2023-09-30T17:02:19.293869+0000","last_fullsized":"2023-09-30T17:02:19.293869+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:50:18.455188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357745+0000","last_change":"2023-09-30T17:02:18.359857+0000","last_active":"2023-09-30T17:02:19.357745+0000","last_peered":"2023-09-30T17:02:19.357745+0000","last_clean":"2023-09-30T17:02:19.357745+0000","last_became_active":"2023-09-30T17:02:18.357098+0000","last_became_peered":"2023-09-30T17:02:18.357098+0000","last_unstale":"2023-09-30T17:02:19.357745+0000","last_undegraded":"2023-09-30T17:02:19.357745+0000","last_fullsized":"2023-09-30T17:02:19.357745+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:48:17.598726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.293936+0000","last_change":"2023-09-30T17:02:17.364479+0000","last_active":"2023-09-30T17:02:19.293936+0000","last_peered":"2023-09-30T17:02:19.293936+0000","last_clean":"2023-09-30T17:02:19.293936+0000","last_became_active":"2023-09-30T17:02:17.364215+0000","last_became_peered":"2023-09-30T17:02:17.364215+0000","last_unstale":"2023-09-30T17:02:19.293936+0000","last_undegraded":"2023-09-30T17:02:19.293936+0000","last_fullsized":"2023-09-30T17:02:19.293936+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:01:31.158446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.356645+0000","last_change":"2023-09-30T17:02:18.375778+0000","last_active":"2023-09-30T17:02:19.356645+0000","last_peered":"2023-09-30T17:02:19.356645+0000","last_clean":"2023-09-30T17:02:19.356645+0000","last_became_active":"2023-09-30T17:02:18.374620+0000","last_became_peered":"2023-09-30T17:02:18.374620+0000","last_unstale":"2023-09-30T17:02:19.356645+0000","last_undegraded":"2023-09-30T17:02:19.356645+0000","last_fullsized":"2023-09-30T17:02:19.356645+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:50:52.893768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.356459+0000","last_change":"2023-09-30T17:02:18.362804+0000","last_active":"2023-09-30T17:02:19.356459+0000","last_peered":"2023-09-30T17:02:19.356459+0000","last_clean":"2023-09-30T17:02:19.356459+0000","last_became_active":"2023-09-30T17:02:18.362392+0000","last_became_peered":"2023-09-30T17:02:18.362392+0000","last_unstale":"2023-09-30T17:02:19.356459+0000","last_undegraded":"2023-09-30T17:02:19.356459+0000","last_fullsized":"2023-09-30T17:02:19.356459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:39:28.022201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.363559+0000","last_change":"2023-09-30T17:02:18.363479+0000","last_active":"2023-09-30T17:02:19.363559+0000","last_peered":"2023-09-30T17:02:19.363559+0000","last_clean":"2023-09-30T17:02:19.363559+0000","last_became_active":"2023-09-30T17:02:18.363222+0000","last_became_peered":"2023-09-30T17:02:18.363222+0000","last_unstale":"2023-09-30T17:02:19.363559+0000","last_undegraded":"2023-09-30T17:02:19.363559+0000","last_fullsized":"2023-09-30T17:02:19.363559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:09:55.056098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357778+0000","last_change":"2023-09-30T17:02:18.362764+0000","last_active":"2023-09-30T17:02:19.357778+0000","last_peered":"2023-09-30T17:02:19.357778+0000","last_clean":"2023-09-30T17:02:19.357778+0000","last_became_active":"2023-09-30T17:02:18.362369+0000","last_became_peered":"2023-09-30T17:02:18.362369+0000","last_unstale":"2023-09-30T17:02:19.357778+0000","last_undegraded":"2023-09-30T17:02:19.357778+0000","last_fullsized":"2023-09-30T17:02:19.357778+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:14:35.192615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.363865+0000","last_change":"2023-09-30T17:02:18.363216+0000","last_active":"2023-09-30T17:02:19.363865+0000","last_peered":"2023-09-30T17:02:19.363865+0000","last_clean":"2023-09-30T17:02:19.363865+0000","last_became_active":"2023-09-30T17:02:18.362894+0000","last_became_peered":"2023-09-30T17:02:18.362894+0000","last_unstale":"2023-09-30T17:02:19.363865+0000","last_undegraded":"2023-09-30T17:02:19.363865+0000","last_fullsized":"2023-09-30T17:02:19.363865+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:30:43.782165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T17:02:19.357920+0000","last_change":"2023-09-30T17:02:18.356827+0000","last_active":"2023-09-30T17:02:19.357920+0000","last_peered":"2023-09-30T17:02:19.357920+0000","last_clean":"2023-09-30T17:02:19.357920+0000","last_became_active":"2023-09-30T17:02:18.355965+0000","last_became_peered":"2023-09-30T17:02:18.355965+0000","last_unstale":"2023-09-30T17:02:19.357920+0000","last_undegraded":"2023-09-30T17:02:19.357920+0000","last_fullsized":"2023-09-30T17:02:19.357920+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:50:52.893768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":8,"seq":34359738377,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":790528,"data_stored":650475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.496}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28799999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738377,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31948,"kb_used_data":764,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339892,"statfs":{"total":96636764160,"available":96604049408,"internally_reserved":0,"allocated":782336,"data_stored":649859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56799999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738377,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":168,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":172032,"data_stored":58313,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T17:02:36.961 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-09-30T17:02:36.961 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2023-09-30T17:02:37.335 INFO:teuthology.orchestra.run.smithi007.stdout:epoch 19 2023-09-30T17:02:37.335 INFO:teuthology.orchestra.run.smithi007.stdout:fsid 68daccc3-6ea9-4db7-9771-3803ff202df8 2023-09-30T17:02:37.335 INFO:teuthology.orchestra.run.smithi007.stdout:created 2023-09-30T17:01:55.306262+0000 2023-09-30T17:02:37.335 INFO:teuthology.orchestra.run.smithi007.stdout:modified 2023-09-30T17:02:19.350385+0000 2023-09-30T17:02:37.335 INFO:teuthology.orchestra.run.smithi007.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2023-09-30T17:02:37.335 INFO:teuthology.orchestra.run.smithi007.stdout:crush_version 4 2023-09-30T17:02:37.335 INFO:teuthology.orchestra.run.smithi007.stdout:full_ratio 0.95 2023-09-30T17:02:37.335 INFO:teuthology.orchestra.run.smithi007.stdout:backfillfull_ratio 0.9 2023-09-30T17:02:37.335 INFO:teuthology.orchestra.run.smithi007.stdout:nearfull_ratio 0.85 2023-09-30T17:02:37.336 INFO:teuthology.orchestra.run.smithi007.stdout:require_min_compat_client luminous 2023-09-30T17:02:37.336 INFO:teuthology.orchestra.run.smithi007.stdout:min_compat_client jewel 2023-09-30T17:02:37.336 INFO:teuthology.orchestra.run.smithi007.stdout:require_osd_release reef 2023-09-30T17:02:37.336 INFO:teuthology.orchestra.run.smithi007.stdout:stretch_mode_enabled false 2023-09-30T17:02:37.336 INFO:teuthology.orchestra.run.smithi007.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 12 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 2.99 2023-09-30T17:02:37.336 INFO:teuthology.orchestra.run.smithi007.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 15 flags hashpspool stripe_width 0 application rbd read_balance_score 1.50 2023-09-30T17:02:37.336 INFO:teuthology.orchestra.run.smithi007.stdout:pool 3 'cephfs_metadata' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 18 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.13 2023-09-30T17:02:37.336 INFO:teuthology.orchestra.run.smithi007.stdout:pool 4 'cephfs_data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 19 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.13 2023-09-30T17:02:37.336 INFO:teuthology.orchestra.run.smithi007.stdout:max_osd 3 2023-09-30T17:02:37.337 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.31:6800/2212861041,v1:172.21.15.31:6801/2212861041] [v2:172.21.15.31:6802/2212861041,v1:172.21.15.31:6803/2212861041] exists,up a9d1653a-8830-4fad-911b-8e7221ee8697 2023-09-30T17:02:37.337 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.72:6800/1680420094,v1:172.21.15.72:6801/1680420094] [v2:172.21.15.72:6802/1680420094,v1:172.21.15.72:6803/1680420094] exists,up 7123aa56-aa1a-43a4-b154-a40b4c70d169 2023-09-30T17:02:37.337 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6800/1018866543,v1:172.21.15.134:6801/1018866543] [v2:172.21.15.134:6802/1018866543,v1:172.21.15.134:6803/1018866543] exists,up f40ee0d7-7bc3-4a46-bdac-9c134c55c907 2023-09-30T17:02:37.350 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.31:6800/2212861041,v1:172.21.15.31:6801/2212861041] [v2:172.21.15.31:6802/2212861041,v1:172.21.15.31:6803/2212861041] exists,up a9d1653a-8830-4fad-911b-8e7221ee8697', 'osd.1 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.72:6800/1680420094,v1:172.21.15.72:6801/1680420094] [v2:172.21.15.72:6802/1680420094,v1:172.21.15.72:6803/1680420094] exists,up 7123aa56-aa1a-43a4-b154-a40b4c70d169', 'osd.2 up in weight 1 up_from 8 up_thru 17 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6800/1018866543,v1:172.21.15.134:6801/1018866543] [v2:172.21.15.134:6802/1018866543,v1:172.21.15.134:6803/1018866543] exists,up f40ee0d7-7bc3-4a46-bdac-9c134c55c907'] 2023-09-30T17:02:37.350 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2023-09-30T17:02:37.478 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-09-30T17:02:37.478 INFO:teuthology.orchestra.run.smithi007.stdout: "name": "mon.a", 2023-09-30T17:02:37.478 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster": "ceph", 2023-09-30T17:02:37.478 INFO:teuthology.orchestra.run.smithi007.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2023-09-30T17:02:37.478 INFO:teuthology.orchestra.run.smithi007.stdout: "admin_socket_mode": "", 2023-09-30T17:02:37.478 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2023-09-30T17:02:37.478 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_client_required": "cephx, none", 2023-09-30T17:02:37.479 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_cluster_required": "cephx", 2023-09-30T17:02:37.479 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_debug": "true", 2023-09-30T17:02:37.479 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2023-09-30T17:02:37.479 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_mon_ticket_ttl": "660.000000", 2023-09-30T17:02:37.479 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_service_required": "cephx", 2023-09-30T17:02:37.479 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_service_ticket_ttl": "240.000000", 2023-09-30T17:02:37.479 INFO:teuthology.orchestra.run.smithi007.stdout: "auth_supported": "cephx", 2023-09-30T17:02:37.479 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_aio": "true", 2023-09-30T17:02:37.479 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_aio_max_queue_depth": "1024", 2023-09-30T17:02:37.479 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_aio_poll_ms": "250", 2023-09-30T17:02:37.479 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_aio_reap_max": "16", 2023-09-30T17:02:37.480 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_async_discard": "false", 2023-09-30T17:02:37.480 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_block_size": "4096", 2023-09-30T17:02:37.480 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_debug_aio": "false", 2023-09-30T17:02:37.480 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_debug_aio_log_age": "5.000000", 2023-09-30T17:02:37.480 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2023-09-30T17:02:37.480 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_debug_inflight_ios": "false", 2023-09-30T17:02:37.480 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_enable_discard": "false", 2023-09-30T17:02:37.480 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_flock_retry": "3", 2023-09-30T17:02:37.480 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_flock_retry_interval": "0.100000", 2023-09-30T17:02:37.480 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_inject_crash": "0", 2023-09-30T17:02:37.480 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_inject_crash_flush_delay": "2", 2023-09-30T17:02:37.481 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_ioring": "false", 2023-09-30T17:02:37.481 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_ioring_hipri": "false", 2023-09-30T17:02:37.481 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_ioring_sqthread_poll": "false", 2023-09-30T17:02:37.481 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_nvme_unbind_from_kernel": "false", 2023-09-30T17:02:37.481 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_read_buffer_alignment": "4096", 2023-09-30T17:02:37.481 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_read_preallocated_huge_buffers": "", 2023-09-30T17:02:37.481 INFO:teuthology.orchestra.run.smithi007.stdout: "bdev_type": "", 2023-09-30T17:02:37.481 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_alloc_size": "1048576", 2023-09-30T17:02:37.481 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_allocator": "hybrid", 2023-09-30T17:02:37.481 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_buffered_io": "true", 2023-09-30T17:02:37.481 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_check_for_zeros": "false", 2023-09-30T17:02:37.482 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_check_volume_selector_often": "false", 2023-09-30T17:02:37.482 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_check_volume_selector_on_umount": "false", 2023-09-30T17:02:37.482 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_compact_log_sync": "false", 2023-09-30T17:02:37.482 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2023-09-30T17:02:37.482 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2023-09-30T17:02:37.482 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_log_compact_min_size": "16777216", 2023-09-30T17:02:37.482 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_log_replay_check_allocations": "true", 2023-09-30T17:02:37.482 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_max_log_runway": "4194304", 2023-09-30T17:02:37.482 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_max_prefetch": "1048576", 2023-09-30T17:02:37.482 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_min_flush_size": "524288", 2023-09-30T17:02:37.483 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_min_log_runway": "1048576", 2023-09-30T17:02:37.483 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_replay_recovery": "false", 2023-09-30T17:02:37.483 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_replay_recovery_disable_compact": "false", 2023-09-30T17:02:37.483 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_shared_alloc_size": "65536", 2023-09-30T17:02:37.483 INFO:teuthology.orchestra.run.smithi007.stdout: "bluefs_sync_write": "false", 2023-09-30T17:02:37.483 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2023-09-30T17:02:37.483 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2023-09-30T17:02:37.483 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2023-09-30T17:02:37.483 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_allocation_from_file": "true", 2023-09-30T17:02:37.484 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_allocator": "hybrid", 2023-09-30T17:02:37.484 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2023-09-30T17:02:37.484 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2023-09-30T17:02:37.484 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2023-09-30T17:02:37.484 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2023-09-30T17:02:37.484 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2023-09-30T17:02:37.484 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_bitmapallocator_span_size": "1024", 2023-09-30T17:02:37.484 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_blobid_prealloc": "10240", 2023-09-30T17:02:37.484 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_block_create": "true", 2023-09-30T17:02:37.484 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_block_db_create": "false", 2023-09-30T17:02:37.484 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_block_db_path": "", 2023-09-30T17:02:37.485 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_block_db_size": "0", 2023-09-30T17:02:37.485 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_block_path": "", 2023-09-30T17:02:37.485 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_block_preallocate_file": "false", 2023-09-30T17:02:37.485 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_block_size": "107374182400", 2023-09-30T17:02:37.485 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_block_wal_create": "false", 2023-09-30T17:02:37.485 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_block_wal_path": "", 2023-09-30T17:02:37.485 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_block_wal_size": "100663296", 2023-09-30T17:02:37.485 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_bluefs": "true", 2023-09-30T17:02:37.485 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2023-09-30T17:02:37.485 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_bluefs_env_mirror": "false", 2023-09-30T17:02:37.486 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_bluefs_max_free": "10737418240", 2023-09-30T17:02:37.486 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2023-09-30T17:02:37.486 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2023-09-30T17:02:37.486 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2023-09-30T17:02:37.486 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2023-09-30T17:02:37.486 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2023-09-30T17:02:37.486 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_autotune": "true", 2023-09-30T17:02:37.486 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_autotune_interval": "5.000000", 2023-09-30T17:02:37.486 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2023-09-30T17:02:37.486 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_kv_ratio": "0.450000", 2023-09-30T17:02:37.486 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_meta_ratio": "0.450000", 2023-09-30T17:02:37.487 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_size": "0", 2023-09-30T17:02:37.487 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_size_hdd": "1073741824", 2023-09-30T17:02:37.487 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_size_ssd": "3221225472", 2023-09-30T17:02:37.487 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_trim_interval": "0.050000", 2023-09-30T17:02:37.487 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2023-09-30T17:02:37.487 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cache_type": "2q", 2023-09-30T17:02:37.487 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2023-09-30T17:02:37.487 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_clone_cow": "true", 2023-09-30T17:02:37.487 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_compression_algorithm": "snappy", 2023-09-30T17:02:37.487 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_compression_max_blob_size": "0", 2023-09-30T17:02:37.487 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2023-09-30T17:02:37.488 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2023-09-30T17:02:37.488 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_compression_min_blob_size": "0", 2023-09-30T17:02:37.488 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2023-09-30T17:02:37.488 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2023-09-30T17:02:37.488 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_compression_mode": "none", 2023-09-30T17:02:37.488 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_compression_required_ratio": "0.875000", 2023-09-30T17:02:37.488 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_csum_type": "crc32c", 2023-09-30T17:02:37.488 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_enforce_settings": "default", 2023-09-30T17:02:37.488 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_freelist": "false", 2023-09-30T17:02:37.488 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_fsck_abort": "false", 2023-09-30T17:02:37.488 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2023-09-30T17:02:37.488 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2023-09-30T17:02:37.489 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_inject_read_err": "false", 2023-09-30T17:02:37.489 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_legacy_omap": "false", 2023-09-30T17:02:37.489 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_no_reuse_blocks": "false", 2023-09-30T17:02:37.489 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_omit_block_device_write": "false", 2023-09-30T17:02:37.489 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_omit_kv_commit": "false", 2023-09-30T17:02:37.489 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2023-09-30T17:02:37.489 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_prefill": "0.000000", 2023-09-30T17:02:37.489 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_prefragment_max": "1048576", 2023-09-30T17:02:37.489 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_random_read_err": "0.000000", 2023-09-30T17:02:37.489 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2023-09-30T17:02:37.490 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_small_allocations": "0", 2023-09-30T17:02:37.490 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2023-09-30T17:02:37.490 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_default_buffered_read": "true", 2023-09-30T17:02:37.490 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_default_buffered_write": "false", 2023-09-30T17:02:37.490 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_deferred_batch_ops": "0", 2023-09-30T17:02:37.490 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2023-09-30T17:02:37.490 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2023-09-30T17:02:37.490 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_elastic_shared_blobs": "true", 2023-09-30T17:02:37.490 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2023-09-30T17:02:37.490 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_map_shard_max_size": "1200", 2023-09-30T17:02:37.490 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_map_shard_min_size": "150", 2023-09-30T17:02:37.490 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_map_shard_target_size": "500", 2023-09-30T17:02:37.491 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2023-09-30T17:02:37.491 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fail_eio": "false", 2023-09-30T17:02:37.491 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_freelist_blocks_per_key": "128", 2023-09-30T17:02:37.491 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2023-09-30T17:02:37.491 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2023-09-30T17:02:37.491 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2023-09-30T17:02:37.491 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_on_mkfs": "true", 2023-09-30T17:02:37.491 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2023-09-30T17:02:37.491 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_on_mount": "false", 2023-09-30T17:02:37.491 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_on_mount_deep": "false", 2023-09-30T17:02:37.491 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_on_umount": "false", 2023-09-30T17:02:37.492 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_on_umount_deep": "false", 2023-09-30T17:02:37.492 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2023-09-30T17:02:37.492 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_quick_fix_threads": "2", 2023-09-30T17:02:37.492 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2023-09-30T17:02:37.492 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2023-09-30T17:02:37.492 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_gc_enable_blob_threshold": "0", 2023-09-30T17:02:37.492 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_gc_enable_total_threshold": "0", 2023-09-30T17:02:37.492 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2023-09-30T17:02:37.492 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_ignore_data_csum": "false", 2023-09-30T17:02:37.492 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2023-09-30T17:02:37.492 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_kvbackend": "rocksdb", 2023-09-30T17:02:37.492 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_log_collection_list_age": "60.000000", 2023-09-30T17:02:37.493 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2023-09-30T17:02:37.493 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_log_op_age": "5.000000", 2023-09-30T17:02:37.493 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_max_alloc_size": "0", 2023-09-30T17:02:37.493 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_max_blob_size": "0", 2023-09-30T17:02:37.493 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_max_blob_size_hdd": "65536", 2023-09-30T17:02:37.493 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_max_blob_size_ssd": "65536", 2023-09-30T17:02:37.493 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_max_defer_interval": "3.000000", 2023-09-30T17:02:37.493 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_max_deferred_txc": "32", 2023-09-30T17:02:37.493 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_min_alloc_size": "0", 2023-09-30T17:02:37.493 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_min_alloc_size_hdd": "4096", 2023-09-30T17:02:37.493 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_min_alloc_size_ssd": "4096", 2023-09-30T17:02:37.494 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_nid_prealloc": "1024", 2023-09-30T17:02:37.494 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_prefer_deferred_size": "0", 2023-09-30T17:02:37.494 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2023-09-30T17:02:37.494 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2023-09-30T17:02:37.494 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_qfsck_on_mount": "true", 2023-09-30T17:02:37.494 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_retry_disk_reads": "3", 2023-09-30T17:02:37.494 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_rocksdb_cf": "true", 2023-09-30T17:02:37.494 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2023-09-30T17:02:37.494 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2023-09-30T17:02:37.494 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_rocksdb_options_annex": "", 2023-09-30T17:02:37.495 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_spdk_coremask": "0x1", 2023-09-30T17:02:37.495 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_spdk_io_sleep": "5", 2023-09-30T17:02:37.495 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_spdk_max_io_completion": "0", 2023-09-30T17:02:37.495 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_spdk_mem": "512", 2023-09-30T17:02:37.495 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_sync_submit_transaction": "false", 2023-09-30T17:02:37.495 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_throttle_bytes": "67108864", 2023-09-30T17:02:37.495 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_throttle_cost_per_io": "0", 2023-09-30T17:02:37.495 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2023-09-30T17:02:37.495 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2023-09-30T17:02:37.495 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2023-09-30T17:02:37.495 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_throttle_trace_rate": "0.000000", 2023-09-30T17:02:37.495 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_tracing": "false", 2023-09-30T17:02:37.496 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2023-09-30T17:02:37.496 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2023-09-30T17:02:37.496 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_volume_selection_reserved": "0", 2023-09-30T17:02:37.496 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2023-09-30T17:02:37.496 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2023-09-30T17:02:37.496 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_warn_on_legacy_statfs": "true", 2023-09-30T17:02:37.496 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2023-09-30T17:02:37.496 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2023-09-30T17:02:37.496 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2023-09-30T17:02:37.496 INFO:teuthology.orchestra.run.smithi007.stdout: "bluestore_zero_block_detection": "false", 2023-09-30T17:02:37.496 INFO:teuthology.orchestra.run.smithi007.stdout: "cephadm_path": "/usr/sbin/cephadm", 2023-09-30T17:02:37.496 INFO:teuthology.orchestra.run.smithi007.stdout: "cephfs_mirror_action_update_interval": "2", 2023-09-30T17:02:37.497 INFO:teuthology.orchestra.run.smithi007.stdout: "cephfs_mirror_directory_scan_interval": "10", 2023-09-30T17:02:37.497 INFO:teuthology.orchestra.run.smithi007.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2023-09-30T17:02:37.497 INFO:teuthology.orchestra.run.smithi007.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2023-09-30T17:02:37.497 INFO:teuthology.orchestra.run.smithi007.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2023-09-30T17:02:37.497 INFO:teuthology.orchestra.run.smithi007.stdout: "cephfs_mirror_mount_timeout": "10", 2023-09-30T17:02:37.497 INFO:teuthology.orchestra.run.smithi007.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2023-09-30T17:02:37.497 INFO:teuthology.orchestra.run.smithi007.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2023-09-30T17:02:37.497 INFO:teuthology.orchestra.run.smithi007.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2023-09-30T17:02:37.497 INFO:teuthology.orchestra.run.smithi007.stdout: "cephsqlite_blocklist_dead_locker": "true", 2023-09-30T17:02:37.497 INFO:teuthology.orchestra.run.smithi007.stdout: "cephsqlite_lock_renewal_interval": "2000", 2023-09-30T17:02:37.497 INFO:teuthology.orchestra.run.smithi007.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2023-09-30T17:02:37.498 INFO:teuthology.orchestra.run.smithi007.stdout: "cephx_cluster_require_signatures": "false", 2023-09-30T17:02:37.498 INFO:teuthology.orchestra.run.smithi007.stdout: "cephx_cluster_require_version": "2", 2023-09-30T17:02:37.498 INFO:teuthology.orchestra.run.smithi007.stdout: "cephx_require_signatures": "false", 2023-09-30T17:02:37.498 INFO:teuthology.orchestra.run.smithi007.stdout: "cephx_require_version": "2", 2023-09-30T17:02:37.498 INFO:teuthology.orchestra.run.smithi007.stdout: "cephx_service_require_signatures": "false", 2023-09-30T17:02:37.498 INFO:teuthology.orchestra.run.smithi007.stdout: "cephx_service_require_version": "2", 2023-09-30T17:02:37.498 INFO:teuthology.orchestra.run.smithi007.stdout: "cephx_sign_messages": "true", 2023-09-30T17:02:37.498 INFO:teuthology.orchestra.run.smithi007.stdout: "chdir": "", 2023-09-30T17:02:37.498 INFO:teuthology.orchestra.run.smithi007.stdout: "client_acl_type": "", 2023-09-30T17:02:37.498 INFO:teuthology.orchestra.run.smithi007.stdout: "client_asio_thread_count": "2", 2023-09-30T17:02:37.498 INFO:teuthology.orchestra.run.smithi007.stdout: "client_cache_mid": "0.750000", 2023-09-30T17:02:37.499 INFO:teuthology.orchestra.run.smithi007.stdout: "client_cache_size": "16384", 2023-09-30T17:02:37.499 INFO:teuthology.orchestra.run.smithi007.stdout: "client_caps_release_delay": "5", 2023-09-30T17:02:37.499 INFO:teuthology.orchestra.run.smithi007.stdout: "client_check_pool_perm": "true", 2023-09-30T17:02:37.499 INFO:teuthology.orchestra.run.smithi007.stdout: "client_collect_and_send_global_metrics": "false", 2023-09-30T17:02:37.499 INFO:teuthology.orchestra.run.smithi007.stdout: "client_debug_force_sync_read": "false", 2023-09-30T17:02:37.499 INFO:teuthology.orchestra.run.smithi007.stdout: "client_debug_getattr_caps": "false", 2023-09-30T17:02:37.499 INFO:teuthology.orchestra.run.smithi007.stdout: "client_debug_inject_tick_delay": "0", 2023-09-30T17:02:37.499 INFO:teuthology.orchestra.run.smithi007.stdout: "client_die_on_failed_dentry_invalidate": "true", 2023-09-30T17:02:37.499 INFO:teuthology.orchestra.run.smithi007.stdout: "client_die_on_failed_remount": "false", 2023-09-30T17:02:37.501 INFO:teuthology.orchestra.run.smithi007.stdout: "client_dirsize_rbytes": "true", 2023-09-30T17:02:37.501 INFO:teuthology.orchestra.run.smithi007.stdout: "client_force_lazyio": "false", 2023-09-30T17:02:37.501 INFO:teuthology.orchestra.run.smithi007.stdout: "client_fs": "", 2023-09-30T17:02:37.501 INFO:teuthology.orchestra.run.smithi007.stdout: "client_inject_fixed_oldest_tid": "false", 2023-09-30T17:02:37.501 INFO:teuthology.orchestra.run.smithi007.stdout: "client_inject_release_failure": "false", 2023-09-30T17:02:37.501 INFO:teuthology.orchestra.run.smithi007.stdout: "client_max_inline_size": "4096", 2023-09-30T17:02:37.501 INFO:teuthology.orchestra.run.smithi007.stdout: "client_max_retries_on_remount_failure": "5", 2023-09-30T17:02:37.502 INFO:teuthology.orchestra.run.smithi007.stdout: "client_mds_namespace": "", 2023-09-30T17:02:37.502 INFO:teuthology.orchestra.run.smithi007.stdout: "client_metadata": "", 2023-09-30T17:02:37.502 INFO:teuthology.orchestra.run.smithi007.stdout: "client_mount_gid": "-1", 2023-09-30T17:02:37.502 INFO:teuthology.orchestra.run.smithi007.stdout: "client_mount_timeout": "300", 2023-09-30T17:02:37.502 INFO:teuthology.orchestra.run.smithi007.stdout: "client_mount_uid": "-1", 2023-09-30T17:02:37.502 INFO:teuthology.orchestra.run.smithi007.stdout: "client_mountpoint": "/", 2023-09-30T17:02:37.502 INFO:teuthology.orchestra.run.smithi007.stdout: "client_notify_timeout": "10", 2023-09-30T17:02:37.502 INFO:teuthology.orchestra.run.smithi007.stdout: "client_oc": "true", 2023-09-30T17:02:37.502 INFO:teuthology.orchestra.run.smithi007.stdout: "client_oc_max_dirty": "104857600", 2023-09-30T17:02:37.502 INFO:teuthology.orchestra.run.smithi007.stdout: "client_oc_max_dirty_age": "5.000000", 2023-09-30T17:02:37.503 INFO:teuthology.orchestra.run.smithi007.stdout: "client_oc_max_objects": "1000", 2023-09-30T17:02:37.503 INFO:teuthology.orchestra.run.smithi007.stdout: "client_oc_size": "209715200", 2023-09-30T17:02:37.503 INFO:teuthology.orchestra.run.smithi007.stdout: "client_oc_target_dirty": "8388608", 2023-09-30T17:02:37.503 INFO:teuthology.orchestra.run.smithi007.stdout: "client_permissions": "true", 2023-09-30T17:02:37.503 INFO:teuthology.orchestra.run.smithi007.stdout: "client_quota": "true", 2023-09-30T17:02:37.503 INFO:teuthology.orchestra.run.smithi007.stdout: "client_quota_df": "true", 2023-09-30T17:02:37.503 INFO:teuthology.orchestra.run.smithi007.stdout: "client_readahead_max_bytes": "0", 2023-09-30T17:02:37.503 INFO:teuthology.orchestra.run.smithi007.stdout: "client_readahead_max_periods": "4", 2023-09-30T17:02:37.503 INFO:teuthology.orchestra.run.smithi007.stdout: "client_readahead_min": "131072", 2023-09-30T17:02:37.503 INFO:teuthology.orchestra.run.smithi007.stdout: "client_reconnect_stale": "false", 2023-09-30T17:02:37.503 INFO:teuthology.orchestra.run.smithi007.stdout: "client_shutdown_timeout": "30", 2023-09-30T17:02:37.504 INFO:teuthology.orchestra.run.smithi007.stdout: "client_snapdir": ".snap", 2023-09-30T17:02:37.504 INFO:teuthology.orchestra.run.smithi007.stdout: "client_tick_interval": "1", 2023-09-30T17:02:37.504 INFO:teuthology.orchestra.run.smithi007.stdout: "client_trace": "", 2023-09-30T17:02:37.504 INFO:teuthology.orchestra.run.smithi007.stdout: "client_try_dentry_invalidate": "false", 2023-09-30T17:02:37.504 INFO:teuthology.orchestra.run.smithi007.stdout: "client_use_faked_inos": "false", 2023-09-30T17:02:37.504 INFO:teuthology.orchestra.run.smithi007.stdout: "client_use_random_mds": "false", 2023-09-30T17:02:37.504 INFO:teuthology.orchestra.run.smithi007.stdout: "clog_to_graylog": "false", 2023-09-30T17:02:37.504 INFO:teuthology.orchestra.run.smithi007.stdout: "clog_to_graylog_host": "127.0.0.1", 2023-09-30T17:02:37.504 INFO:teuthology.orchestra.run.smithi007.stdout: "clog_to_graylog_port": "12201", 2023-09-30T17:02:37.504 INFO:teuthology.orchestra.run.smithi007.stdout: "clog_to_monitors": "default=true", 2023-09-30T17:02:37.505 INFO:teuthology.orchestra.run.smithi007.stdout: "clog_to_syslog": "false", 2023-09-30T17:02:37.505 INFO:teuthology.orchestra.run.smithi007.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2023-09-30T17:02:37.505 INFO:teuthology.orchestra.run.smithi007.stdout: "clog_to_syslog_level": "info", 2023-09-30T17:02:37.505 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "-", 2023-09-30T17:02:37.505 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_network": "", 2023-09-30T17:02:37.505 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_network_interface": "", 2023-09-30T17:02:37.505 INFO:teuthology.orchestra.run.smithi007.stdout: "compressor_zlib_isal": "false", 2023-09-30T17:02:37.505 INFO:teuthology.orchestra.run.smithi007.stdout: "compressor_zlib_level": "5", 2023-09-30T17:02:37.505 INFO:teuthology.orchestra.run.smithi007.stdout: "compressor_zlib_winsize": "-15", 2023-09-30T17:02:37.505 INFO:teuthology.orchestra.run.smithi007.stdout: "compressor_zstd_level": "1", 2023-09-30T17:02:37.506 INFO:teuthology.orchestra.run.smithi007.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2023-09-30T17:02:37.506 INFO:teuthology.orchestra.run.smithi007.stdout: "crash_dir": "/var/lib/ceph/crash", 2023-09-30T17:02:37.506 INFO:teuthology.orchestra.run.smithi007.stdout: "crimson_alien_op_num_threads": "6", 2023-09-30T17:02:37.506 INFO:teuthology.orchestra.run.smithi007.stdout: "crimson_alien_thread_cpu_cores": "", 2023-09-30T17:02:37.506 INFO:teuthology.orchestra.run.smithi007.stdout: "crimson_osd_obc_lru_size": "10", 2023-09-30T17:02:37.506 INFO:teuthology.orchestra.run.smithi007.stdout: "crimson_osd_scheduler_concurrency": "0", 2023-09-30T17:02:37.506 INFO:teuthology.orchestra.run.smithi007.stdout: "crimson_seastar_smp": "1", 2023-09-30T17:02:37.506 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_location": "", 2023-09-30T17:02:37.506 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_location_hook": "", 2023-09-30T17:02:37.506 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_location_hook_timeout": "10", 2023-09-30T17:02:37.506 INFO:teuthology.orchestra.run.smithi007.stdout: "daemonize": "false", 2023-09-30T17:02:37.507 INFO:teuthology.orchestra.run.smithi007.stdout: "daos_pool": "tank", 2023-09-30T17:02:37.507 INFO:teuthology.orchestra.run.smithi007.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2023-09-30T17:02:37.507 INFO:teuthology.orchestra.run.smithi007.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2023-09-30T17:02:37.507 INFO:teuthology.orchestra.run.smithi007.stdout: "dbstore_db_name_prefix": "dbstore", 2023-09-30T17:02:37.507 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_alienstore": "0/5", 2023-09-30T17:02:37.507 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_allow_any_pool_priority": "false", 2023-09-30T17:02:37.507 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_asok": "1/5", 2023-09-30T17:02:37.507 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_asok_assert_abort": "false", 2023-09-30T17:02:37.507 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_asserts_on_shutdown": "true", 2023-09-30T17:02:37.507 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_auth": "20/20", 2023-09-30T17:02:37.507 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_bdev": "1/3", 2023-09-30T17:02:37.508 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_bluefs": "1/5", 2023-09-30T17:02:37.508 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_bluestore": "1/5", 2023-09-30T17:02:37.508 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_buffer": "0/1", 2023-09-30T17:02:37.508 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_ceph_exporter": "1/5", 2023-09-30T17:02:37.508 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_cephfs_mirror": "0/5", 2023-09-30T17:02:37.508 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_cephsqlite": "0/5", 2023-09-30T17:02:37.508 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_client": "0/5", 2023-09-30T17:02:37.508 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_compressor": "1/5", 2023-09-30T17:02:37.508 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_context": "0/1", 2023-09-30T17:02:37.508 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_crush": "1/1", 2023-09-30T17:02:37.508 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_crypto": "1/5", 2023-09-30T17:02:37.508 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_cyanstore": "0/5", 2023-09-30T17:02:37.509 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_deliberately_leak_memory": "false", 2023-09-30T17:02:37.509 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_disable_randomized_ping": "false", 2023-09-30T17:02:37.509 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_dpdk": "1/5", 2023-09-30T17:02:37.509 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_eventtrace": "1/5", 2023-09-30T17:02:37.509 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_filer": "0/1", 2023-09-30T17:02:37.509 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_filestore": "1/3", 2023-09-30T17:02:37.509 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_finisher": "1/1", 2023-09-30T17:02:37.509 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_fuse": "1/5", 2023-09-30T17:02:37.509 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_heartbeat_testing_span": "0", 2023-09-30T17:02:37.509 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_heartbeatmap": "1/5", 2023-09-30T17:02:37.509 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_immutable_obj_cache": "0/5", 2023-09-30T17:02:37.509 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_javaclient": "1/5", 2023-09-30T17:02:37.510 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_journal": "1/3", 2023-09-30T17:02:37.510 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_journaler": "0/5", 2023-09-30T17:02:37.510 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_kstore": "1/5", 2023-09-30T17:02:37.510 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_lockdep": "0/1", 2023-09-30T17:02:37.510 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_mclock": "1/5", 2023-09-30T17:02:37.510 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_mds": "1/5", 2023-09-30T17:02:37.510 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_mds_balancer": "1/5", 2023-09-30T17:02:37.510 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_mds_locker": "1/5", 2023-09-30T17:02:37.510 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_mds_log": "1/5", 2023-09-30T17:02:37.510 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_mds_log_expire": "1/5", 2023-09-30T17:02:37.510 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_mds_migrator": "1/5", 2023-09-30T17:02:37.511 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_memstore": "1/5", 2023-09-30T17:02:37.511 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_mgr": "2/5", 2023-09-30T17:02:37.511 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_mgrc": "1/5", 2023-09-30T17:02:37.511 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_mon": "20/20", 2023-09-30T17:02:37.511 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_monc": "0/10", 2023-09-30T17:02:37.511 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_ms": "1/1", 2023-09-30T17:02:37.511 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_none": "0/5", 2023-09-30T17:02:37.511 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_objclass": "0/5", 2023-09-30T17:02:37.511 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_objectcacher": "0/5", 2023-09-30T17:02:37.511 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_objecter": "0/1", 2023-09-30T17:02:37.511 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_optracker": "0/5", 2023-09-30T17:02:37.512 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_osd": "1/5", 2023-09-30T17:02:37.512 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_paxos": "20/20", 2023-09-30T17:02:37.512 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_perfcounter": "1/5", 2023-09-30T17:02:37.512 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_prioritycache": "1/5", 2023-09-30T17:02:37.512 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_rados": "0/5", 2023-09-30T17:02:37.512 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_rbd": "0/5", 2023-09-30T17:02:37.512 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_rbd_mirror": "0/5", 2023-09-30T17:02:37.512 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_rbd_pwl": "0/5", 2023-09-30T17:02:37.512 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_rbd_replay": "0/5", 2023-09-30T17:02:37.512 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_refs": "0/0", 2023-09-30T17:02:37.512 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_reserver": "1/1", 2023-09-30T17:02:37.512 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_rgw": "1/5", 2023-09-30T17:02:37.513 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_rgw_access": "1/5", 2023-09-30T17:02:37.513 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_rgw_datacache": "1/5", 2023-09-30T17:02:37.513 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_rgw_dbstore": "1/5", 2023-09-30T17:02:37.513 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_rgw_flight": "1/5", 2023-09-30T17:02:37.513 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_rgw_sync": "1/5", 2023-09-30T17:02:37.513 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_rocksdb": "4/5", 2023-09-30T17:02:37.513 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_seastore": "0/5", 2023-09-30T17:02:37.513 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_seastore_backref": "0/5", 2023-09-30T17:02:37.513 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_seastore_cache": "0/5", 2023-09-30T17:02:37.513 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_seastore_cleaner": "0/5", 2023-09-30T17:02:37.514 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_seastore_device": "0/5", 2023-09-30T17:02:37.514 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_seastore_epm": "0/5", 2023-09-30T17:02:37.514 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_seastore_fixedkv_tree": "0/5", 2023-09-30T17:02:37.514 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_seastore_journal": "0/5", 2023-09-30T17:02:37.514 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_seastore_lba": "0/5", 2023-09-30T17:02:37.514 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_seastore_odata": "0/5", 2023-09-30T17:02:37.514 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_seastore_omap": "0/5", 2023-09-30T17:02:37.514 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_seastore_onode": "0/5", 2023-09-30T17:02:37.514 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_seastore_t": "0/5", 2023-09-30T17:02:37.514 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_seastore_tm": "0/5", 2023-09-30T17:02:37.515 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_striper": "0/1", 2023-09-30T17:02:37.515 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_test": "0/5", 2023-09-30T17:02:37.515 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_throttle": "1/1", 2023-09-30T17:02:37.515 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_timer": "0/1", 2023-09-30T17:02:37.515 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_tp": "0/5", 2023-09-30T17:02:37.515 INFO:teuthology.orchestra.run.smithi007.stdout: "debug_trace": "1/5", 2023-09-30T17:02:37.515 INFO:teuthology.orchestra.run.smithi007.stdout: "defer_client_eviction_on_laggy_osds": "true", 2023-09-30T17:02:37.515 INFO:teuthology.orchestra.run.smithi007.stdout: "device_failure_prediction_mode": "none", 2023-09-30T17:02:37.515 INFO:teuthology.orchestra.run.smithi007.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2023-09-30T17:02:37.515 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_dir": "/usr/lib64/ceph/erasure-code", 2023-09-30T17:02:37.516 INFO:teuthology.orchestra.run.smithi007.stdout: "err_to_graylog": "false", 2023-09-30T17:02:37.516 INFO:teuthology.orchestra.run.smithi007.stdout: "err_to_journald": "false", 2023-09-30T17:02:37.516 INFO:teuthology.orchestra.run.smithi007.stdout: "err_to_stderr": "true", 2023-09-30T17:02:37.516 INFO:teuthology.orchestra.run.smithi007.stdout: "err_to_syslog": "false", 2023-09-30T17:02:37.516 INFO:teuthology.orchestra.run.smithi007.stdout: "event_tracing": "false", 2023-09-30T17:02:37.516 INFO:teuthology.orchestra.run.smithi007.stdout: "exporter_addr": "0.0.0.0", 2023-09-30T17:02:37.516 INFO:teuthology.orchestra.run.smithi007.stdout: "exporter_http_port": "9926", 2023-09-30T17:02:37.516 INFO:teuthology.orchestra.run.smithi007.stdout: "exporter_prio_limit": "5", 2023-09-30T17:02:37.516 INFO:teuthology.orchestra.run.smithi007.stdout: "exporter_sock_dir": "/var/run/ceph/", 2023-09-30T17:02:37.516 INFO:teuthology.orchestra.run.smithi007.stdout: "exporter_sort_metrics": "true", 2023-09-30T17:02:37.516 INFO:teuthology.orchestra.run.smithi007.stdout: "exporter_stats_period": "5", 2023-09-30T17:02:37.516 INFO:teuthology.orchestra.run.smithi007.stdout: "fake_statfs_for_testing": "0", 2023-09-30T17:02:37.517 INFO:teuthology.orchestra.run.smithi007.stdout: "fatal_signal_handlers": "true", 2023-09-30T17:02:37.517 INFO:teuthology.orchestra.run.smithi007.stdout: "filer_max_purge_ops": "10", 2023-09-30T17:02:37.517 INFO:teuthology.orchestra.run.smithi007.stdout: "filer_max_truncate_ops": "128", 2023-09-30T17:02:37.517 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_apply_finisher_threads": "1", 2023-09-30T17:02:37.517 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_blackhole": "false", 2023-09-30T17:02:37.517 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_btrfs_clone_range": "true", 2023-09-30T17:02:37.517 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_btrfs_snap": "true", 2023-09-30T17:02:37.517 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_caller_concurrency": "10", 2023-09-30T17:02:37.517 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_collect_device_partition_information": "true", 2023-09-30T17:02:37.517 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_commit_timeout": "600.000000", 2023-09-30T17:02:37.518 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_debug_inject_read_err": "false", 2023-09-30T17:02:37.518 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_debug_omap_check": "false", 2023-09-30T17:02:37.518 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_debug_random_read_err": "0.000000", 2023-09-30T17:02:37.518 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_debug_verify_split": "false", 2023-09-30T17:02:37.518 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_dump_file": "", 2023-09-30T17:02:37.518 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2023-09-30T17:02:37.518 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_expected_throughput_ops": "200.000000", 2023-09-30T17:02:37.518 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_fadvise": "true", 2023-09-30T17:02:37.518 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_fail_eio": "true", 2023-09-30T17:02:37.518 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_fd_cache_shards": "16", 2023-09-30T17:02:37.518 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_fd_cache_size": "128", 2023-09-30T17:02:37.519 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_fiemap": "false", 2023-09-30T17:02:37.519 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_fiemap_threshold": "4096", 2023-09-30T17:02:37.519 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_fsync_flushes_journal_data": "false", 2023-09-30T17:02:37.519 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_index_retry_probability": "0.000000", 2023-09-30T17:02:37.519 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_inject_stall": "0", 2023-09-30T17:02:37.519 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_journal_parallel": "false", 2023-09-30T17:02:37.519 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_journal_trailing": "false", 2023-09-30T17:02:37.519 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_journal_writeahead": "false", 2023-09-30T17:02:37.519 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_kill_at": "0", 2023-09-30T17:02:37.519 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_alloc_hint_size": "1048576", 2023-09-30T17:02:37.519 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_inline_xattr_size": "0", 2023-09-30T17:02:37.519 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2023-09-30T17:02:37.520 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_inline_xattr_size_other": "512", 2023-09-30T17:02:37.520 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2023-09-30T17:02:37.520 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_inline_xattrs": "0", 2023-09-30T17:02:37.520 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2023-09-30T17:02:37.520 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_inline_xattrs_other": "2", 2023-09-30T17:02:37.520 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_inline_xattrs_xfs": "10", 2023-09-30T17:02:37.520 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_sync_interval": "5.000000", 2023-09-30T17:02:37.520 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_xattr_value_size": "0", 2023-09-30T17:02:37.520 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2023-09-30T17:02:37.520 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_xattr_value_size_other": "1024", 2023-09-30T17:02:37.520 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2023-09-30T17:02:37.521 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_merge_threshold": "-10", 2023-09-30T17:02:37.521 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_min_sync_interval": "0.010000", 2023-09-30T17:02:37.521 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_odsync_write": "false", 2023-09-30T17:02:37.521 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_omap_backend": "rocksdb", 2023-09-30T17:02:37.521 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_omap_backend_path": "", 2023-09-30T17:02:37.521 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_omap_header_cache_size": "1024", 2023-09-30T17:02:37.521 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_ondisk_finisher_threads": "1", 2023-09-30T17:02:37.521 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_op_thread_suicide_timeout": "180", 2023-09-30T17:02:37.521 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_op_thread_timeout": "60", 2023-09-30T17:02:37.521 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_op_threads": "2", 2023-09-30T17:02:37.522 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_punch_hole": "false", 2023-09-30T17:02:37.522 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2023-09-30T17:02:37.522 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2023-09-30T17:02:37.522 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2023-09-30T17:02:37.522 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_queue_high_threshhold": "0.900000", 2023-09-30T17:02:37.522 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_queue_low_threshhold": "0.300000", 2023-09-30T17:02:37.522 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_queue_max_bytes": "104857600", 2023-09-30T17:02:37.522 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2023-09-30T17:02:37.522 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2023-09-30T17:02:37.523 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2023-09-30T17:02:37.523 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_queue_max_ops": "50", 2023-09-30T17:02:37.523 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2023-09-30T17:02:37.523 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_seek_data_hole": "false", 2023-09-30T17:02:37.523 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_sloppy_crc": "false", 2023-09-30T17:02:37.523 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_sloppy_crc_block_size": "65536", 2023-09-30T17:02:37.523 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_splice": "false", 2023-09-30T17:02:37.523 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_split_multiple": "2", 2023-09-30T17:02:37.523 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_split_rand_factor": "20", 2023-09-30T17:02:37.523 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_update_to": "1000", 2023-09-30T17:02:37.523 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2023-09-30T17:02:37.523 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2023-09-30T17:02:37.524 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2023-09-30T17:02:37.524 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2023-09-30T17:02:37.524 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2023-09-30T17:02:37.524 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2023-09-30T17:02:37.524 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_enable": "true", 2023-09-30T17:02:37.524 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2023-09-30T17:02:37.524 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2023-09-30T17:02:37.524 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2023-09-30T17:02:37.524 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2023-09-30T17:02:37.524 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2023-09-30T17:02:37.524 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2023-09-30T17:02:37.525 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_xfs_extsize": "false", 2023-09-30T17:02:37.525 INFO:teuthology.orchestra.run.smithi007.stdout: "filestore_zfs_snap": "false", 2023-09-30T17:02:37.525 INFO:teuthology.orchestra.run.smithi007.stdout: "fio_dir": "/tmp/fio", 2023-09-30T17:02:37.525 INFO:teuthology.orchestra.run.smithi007.stdout: "fsid": "68daccc3-6ea9-4db7-9771-3803ff202df8", 2023-09-30T17:02:37.525 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_allow_other": "true", 2023-09-30T17:02:37.525 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_atomic_o_trunc": "true", 2023-09-30T17:02:37.525 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_big_writes": "true", 2023-09-30T17:02:37.525 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_debug": "false", 2023-09-30T17:02:37.525 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_default_permissions": "false", 2023-09-30T17:02:37.525 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_disable_pagecache": "false", 2023-09-30T17:02:37.525 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_max_write": "0", 2023-09-30T17:02:37.526 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_multithreaded": "true", 2023-09-30T17:02:37.526 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_require_active_mds": "true", 2023-09-30T17:02:37.526 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_set_user_groups": "true", 2023-09-30T17:02:37.526 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_splice_move": "true", 2023-09-30T17:02:37.526 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_splice_read": "true", 2023-09-30T17:02:37.526 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_splice_write": "true", 2023-09-30T17:02:37.526 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_syncfs_on_mksnap": "true", 2023-09-30T17:02:37.526 INFO:teuthology.orchestra.run.smithi007.stdout: "fuse_use_invalidate_cb": "true", 2023-09-30T17:02:37.526 INFO:teuthology.orchestra.run.smithi007.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2023-09-30T17:02:37.526 INFO:teuthology.orchestra.run.smithi007.stdout: "gss_target_name": "ceph", 2023-09-30T17:02:37.526 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_file": "", 2023-09-30T17:02:37.527 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_inject_failure": "0", 2023-09-30T17:02:37.527 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_interval": "5", 2023-09-30T17:02:37.527 INFO:teuthology.orchestra.run.smithi007.stdout: "host": "smithi007", 2023-09-30T17:02:37.527 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2023-09-30T17:02:37.527 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_max_inflight_ops": "128", 2023-09-30T17:02:37.527 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_max_size": "1073741824", 2023-09-30T17:02:37.527 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2023-09-30T17:02:37.527 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_qos_bps_burst": "0", 2023-09-30T17:02:37.527 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2023-09-30T17:02:37.527 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_qos_bps_limit": "0", 2023-09-30T17:02:37.527 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_qos_iops_burst": "0", 2023-09-30T17:02:37.528 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2023-09-30T17:02:37.528 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_qos_iops_limit": "0", 2023-09-30T17:02:37.528 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2023-09-30T17:02:37.528 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2023-09-30T17:02:37.528 INFO:teuthology.orchestra.run.smithi007.stdout: "immutable_object_cache_watermark": "0.900000", 2023-09-30T17:02:37.528 INFO:teuthology.orchestra.run.smithi007.stdout: "inject_early_sigterm": "false", 2023-09-30T17:02:37.528 INFO:teuthology.orchestra.run.smithi007.stdout: "jaeger_agent_port": "6799", 2023-09-30T17:02:37.528 INFO:teuthology.orchestra.run.smithi007.stdout: "jaeger_tracing_enable": "false", 2023-09-30T17:02:37.528 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_aio": "true", 2023-09-30T17:02:37.528 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_align_min_size": "65536", 2023-09-30T17:02:37.528 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_block_align": "true", 2023-09-30T17:02:37.529 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_block_size": "4096", 2023-09-30T17:02:37.529 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_dio": "true", 2023-09-30T17:02:37.529 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_discard": "false", 2023-09-30T17:02:37.529 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_force_aio": "false", 2023-09-30T17:02:37.529 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_ignore_corruption": "false", 2023-09-30T17:02:37.529 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_max_write_bytes": "10485760", 2023-09-30T17:02:37.529 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_max_write_entries": "100", 2023-09-30T17:02:37.529 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_replay_from": "0", 2023-09-30T17:02:37.529 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_throttle_high_multiple": "0.000000", 2023-09-30T17:02:37.529 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_throttle_high_threshhold": "0.900000", 2023-09-30T17:02:37.529 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_throttle_low_threshhold": "0.600000", 2023-09-30T17:02:37.530 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_throttle_max_multiple": "0.000000", 2023-09-30T17:02:37.530 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_write_header_frequency": "0", 2023-09-30T17:02:37.530 INFO:teuthology.orchestra.run.smithi007.stdout: "journal_zero_on_create": "false", 2023-09-30T17:02:37.530 INFO:teuthology.orchestra.run.smithi007.stdout: "journaler_prefetch_periods": "10", 2023-09-30T17:02:37.530 INFO:teuthology.orchestra.run.smithi007.stdout: "journaler_prezero_periods": "5", 2023-09-30T17:02:37.530 INFO:teuthology.orchestra.run.smithi007.stdout: "journaler_write_head_interval": "15", 2023-09-30T17:02:37.530 INFO:teuthology.orchestra.run.smithi007.stdout: "key": "", 2023-09-30T17:02:37.530 INFO:teuthology.orchestra.run.smithi007.stdout: "keyfile": "", 2023-09-30T17:02:37.530 INFO:teuthology.orchestra.run.smithi007.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2023-09-30T17:02:37.530 INFO:teuthology.orchestra.run.smithi007.stdout: "kstore_backend": "rocksdb", 2023-09-30T17:02:37.530 INFO:teuthology.orchestra.run.smithi007.stdout: "kstore_default_stripe_size": "65536", 2023-09-30T17:02:37.531 INFO:teuthology.orchestra.run.smithi007.stdout: "kstore_fsck_on_mount": "false", 2023-09-30T17:02:37.531 INFO:teuthology.orchestra.run.smithi007.stdout: "kstore_fsck_on_mount_deep": "true", 2023-09-30T17:02:37.531 INFO:teuthology.orchestra.run.smithi007.stdout: "kstore_max_bytes": "67108864", 2023-09-30T17:02:37.531 INFO:teuthology.orchestra.run.smithi007.stdout: "kstore_max_ops": "512", 2023-09-30T17:02:37.531 INFO:teuthology.orchestra.run.smithi007.stdout: "kstore_nid_prealloc": "1024", 2023-09-30T17:02:37.531 INFO:teuthology.orchestra.run.smithi007.stdout: "kstore_onode_map_size": "1024", 2023-09-30T17:02:37.531 INFO:teuthology.orchestra.run.smithi007.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2023-09-30T17:02:37.531 INFO:teuthology.orchestra.run.smithi007.stdout: "kstore_sync_submit_transaction": "false", 2023-09-30T17:02:37.531 INFO:teuthology.orchestra.run.smithi007.stdout: "kstore_sync_transaction": "false", 2023-09-30T17:02:37.531 INFO:teuthology.orchestra.run.smithi007.stdout: "librados_thread_count": "2", 2023-09-30T17:02:37.531 INFO:teuthology.orchestra.run.smithi007.stdout: "lockdep": "false", 2023-09-30T17:02:37.532 INFO:teuthology.orchestra.run.smithi007.stdout: "lockdep_force_backtrace": "false", 2023-09-30T17:02:37.532 INFO:teuthology.orchestra.run.smithi007.stdout: "log_coarse_timestamps": "true", 2023-09-30T17:02:37.532 INFO:teuthology.orchestra.run.smithi007.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2023-09-30T17:02:37.532 INFO:teuthology.orchestra.run.smithi007.stdout: "log_flush_on_exit": "false", 2023-09-30T17:02:37.532 INFO:teuthology.orchestra.run.smithi007.stdout: "log_graylog_host": "127.0.0.1", 2023-09-30T17:02:37.532 INFO:teuthology.orchestra.run.smithi007.stdout: "log_graylog_port": "12201", 2023-09-30T17:02:37.532 INFO:teuthology.orchestra.run.smithi007.stdout: "log_max_new": "1000", 2023-09-30T17:02:37.532 INFO:teuthology.orchestra.run.smithi007.stdout: "log_max_recent": "10000", 2023-09-30T17:02:37.532 INFO:teuthology.orchestra.run.smithi007.stdout: "log_stderr_prefix": "", 2023-09-30T17:02:37.532 INFO:teuthology.orchestra.run.smithi007.stdout: "log_stop_at_utilization": "0.970000", 2023-09-30T17:02:37.532 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_file": "true", 2023-09-30T17:02:37.532 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_graylog": "false", 2023-09-30T17:02:37.533 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_journald": "false", 2023-09-30T17:02:37.533 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_stderr": "false", 2023-09-30T17:02:37.533 INFO:teuthology.orchestra.run.smithi007.stdout: "log_to_syslog": "false", 2023-09-30T17:02:37.533 INFO:teuthology.orchestra.run.smithi007.stdout: "max_rotating_auth_attempts": "10", 2023-09-30T17:02:37.533 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2023-09-30T17:02:37.533 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_action_on_write_error": "1", 2023-09-30T17:02:37.533 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_alternate_name_max": "8192", 2023-09-30T17:02:37.533 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_asio_thread_count": "2", 2023-09-30T17:02:37.533 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_export_pin": "true", 2023-09-30T17:02:37.533 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_fragment_dirs": "true", 2023-09-30T17:02:37.533 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2023-09-30T17:02:37.534 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_fragment_interval": "5", 2023-09-30T17:02:37.534 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_fragment_size_max": "100000", 2023-09-30T17:02:37.534 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_idle_threshold": "0.000000", 2023-09-30T17:02:37.534 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_interval": "10", 2023-09-30T17:02:37.534 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_max": "-1", 2023-09-30T17:02:37.534 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_max_until": "-1", 2023-09-30T17:02:37.534 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_merge_size": "50", 2023-09-30T17:02:37.534 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_midchunk": "0.300000", 2023-09-30T17:02:37.534 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_min_rebalance": "0.100000", 2023-09-30T17:02:37.534 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_min_start": "0.200000", 2023-09-30T17:02:37.534 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_minchunk": "0.001000", 2023-09-30T17:02:37.535 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_mode": "0", 2023-09-30T17:02:37.535 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_need_max": "1.200000", 2023-09-30T17:02:37.535 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_need_min": "0.800000", 2023-09-30T17:02:37.535 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_replicate_threshold": "8000.000000", 2023-09-30T17:02:37.535 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_sample_interval": "3.000000", 2023-09-30T17:02:37.535 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_split_bits": "3", 2023-09-30T17:02:37.535 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_split_rd": "25000.000000", 2023-09-30T17:02:37.535 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_split_size": "10000", 2023-09-30T17:02:37.535 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_split_wr": "10000.000000", 2023-09-30T17:02:37.535 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_target_decay": "10.000000", 2023-09-30T17:02:37.535 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2023-09-30T17:02:37.536 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_beacon_grace": "15.000000", 2023-09-30T17:02:37.536 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_beacon_interval": "4.000000", 2023-09-30T17:02:37.536 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_beacon_mon_down_grace": "60", 2023-09-30T17:02:37.536 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_cache_memory_limit": "4294967296", 2023-09-30T17:02:37.536 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_cache_mid": "0.700000", 2023-09-30T17:02:37.536 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_cache_release_free_interval": "10", 2023-09-30T17:02:37.536 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_cache_reservation": "0.050000", 2023-09-30T17:02:37.536 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_cache_trim_decay_rate": "1.000000", 2023-09-30T17:02:37.536 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_cache_trim_interval": "1", 2023-09-30T17:02:37.536 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_cache_trim_threshold": "262144", 2023-09-30T17:02:37.536 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2023-09-30T17:02:37.536 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2023-09-30T17:02:37.537 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_client_delegate_inos_pct": "50", 2023-09-30T17:02:37.537 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_client_prealloc_inos": "1000", 2023-09-30T17:02:37.537 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2023-09-30T17:02:37.537 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_connect_bootstrapping": "false", 2023-09-30T17:02:37.537 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_damage_table_max_entries": "10000", 2023-09-30T17:02:37.537 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2023-09-30T17:02:37.537 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_debug_auth_pins": "false", 2023-09-30T17:02:37.537 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_debug_frag": "false", 2023-09-30T17:02:37.537 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_debug_scatterstat": "false", 2023-09-30T17:02:37.537 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_debug_subtrees": "false", 2023-09-30T17:02:37.537 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_decay_halflife": "5.000000", 2023-09-30T17:02:37.538 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_default_dir_hash": "2", 2023-09-30T17:02:37.538 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_defer_session_stale": "true", 2023-09-30T17:02:37.538 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_deny_all_reconnect": "false", 2023-09-30T17:02:37.538 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_dir_keys_per_op": "16384", 2023-09-30T17:02:37.538 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_dir_max_commit_size": "10", 2023-09-30T17:02:37.538 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_dir_max_entries": "0", 2023-09-30T17:02:37.538 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_dir_prefetch": "true", 2023-09-30T17:02:37.538 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_dirstat_min_interval": "1.000000", 2023-09-30T17:02:37.538 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_dump_cache_after_rejoin": "false", 2023-09-30T17:02:37.538 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_dump_cache_on_map": "false", 2023-09-30T17:02:37.538 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_dump_cache_threshold_file": "0", 2023-09-30T17:02:37.538 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2023-09-30T17:02:37.539 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_early_reply": "true", 2023-09-30T17:02:37.539 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_enable_op_tracker": "true", 2023-09-30T17:02:37.539 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_enforce_unique_name": "true", 2023-09-30T17:02:37.539 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_export_ephemeral_distributed": "true", 2023-09-30T17:02:37.539 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2023-09-30T17:02:37.539 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_export_ephemeral_random": "true", 2023-09-30T17:02:37.539 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_export_ephemeral_random_max": "0.010000", 2023-09-30T17:02:37.539 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_extraordinary_events_dump_interval": "0", 2023-09-30T17:02:37.539 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_forward_all_requests_to_auth": "false", 2023-09-30T17:02:37.539 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_freeze_tree_timeout": "30.000000", 2023-09-30T17:02:37.539 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_fscrypt_last_block_max_size": "4096", 2023-09-30T17:02:37.540 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_go_bad_corrupt_dentry": "true", 2023-09-30T17:02:37.540 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2023-09-30T17:02:37.540 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_health_cache_threshold": "1.500000", 2023-09-30T17:02:37.540 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_health_summarize_threshold": "10", 2023-09-30T17:02:37.540 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_heartbeat_grace": "15.000000", 2023-09-30T17:02:37.540 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_heartbeat_reset_grace": "1000", 2023-09-30T17:02:37.540 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_inject_health_dummy": "false", 2023-09-30T17:02:37.540 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2023-09-30T17:02:37.540 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_inject_migrator_session_race": "false", 2023-09-30T17:02:37.540 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2023-09-30T17:02:37.540 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_inject_skip_replaying_inotable": "false", 2023-09-30T17:02:37.540 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2023-09-30T17:02:37.541 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_join_fs": "", 2023-09-30T17:02:37.541 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_journal_format": "1", 2023-09-30T17:02:37.541 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_kill_create_at": "0", 2023-09-30T17:02:37.541 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_kill_export_at": "0", 2023-09-30T17:02:37.541 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_kill_import_at": "0", 2023-09-30T17:02:37.541 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_kill_journal_at": "0", 2023-09-30T17:02:37.541 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_kill_journal_expire_at": "0", 2023-09-30T17:02:37.541 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_kill_journal_replay_at": "0", 2023-09-30T17:02:37.541 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_kill_link_at": "0", 2023-09-30T17:02:37.541 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_kill_mdstable_at": "0", 2023-09-30T17:02:37.541 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_kill_openc_at": "0", 2023-09-30T17:02:37.541 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_kill_rename_at": "0", 2023-09-30T17:02:37.542 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_kill_shutdown_at": "0", 2023-09-30T17:02:37.542 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_kill_skip_replaying_inotable": "false", 2023-09-30T17:02:37.542 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_log_event_large_threshold": "524288", 2023-09-30T17:02:37.542 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_log_events_per_segment": "1024", 2023-09-30T17:02:37.542 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_log_major_segment_event_ratio": "12", 2023-09-30T17:02:37.542 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_log_max_events": "-1", 2023-09-30T17:02:37.542 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_log_max_segments": "128", 2023-09-30T17:02:37.542 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_log_pause": "false", 2023-09-30T17:02:37.542 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_log_segment_size": "0", 2023-09-30T17:02:37.542 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_log_skip_corrupt_events": "false", 2023-09-30T17:02:37.542 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_log_skip_unbounded_events": "false", 2023-09-30T17:02:37.543 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_log_warn_factor": "2.000000", 2023-09-30T17:02:37.543 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_max_caps_per_client": "1048576", 2023-09-30T17:02:37.543 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_max_completed_flushes": "100000", 2023-09-30T17:02:37.543 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_max_completed_requests": "100000", 2023-09-30T17:02:37.543 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_max_export_size": "20971520", 2023-09-30T17:02:37.543 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_max_file_recover": "32", 2023-09-30T17:02:37.543 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_max_purge_files": "64", 2023-09-30T17:02:37.543 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_max_purge_ops": "8192", 2023-09-30T17:02:37.543 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2023-09-30T17:02:37.543 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_max_scrub_ops_in_progress": "5", 2023-09-30T17:02:37.543 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_max_snaps_per_dir": "100", 2023-09-30T17:02:37.544 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_metrics_update_interval": "2", 2023-09-30T17:02:37.544 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_min_caps_per_client": "100", 2023-09-30T17:02:37.544 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_min_caps_working_set": "10000", 2023-09-30T17:02:37.544 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_mon_shutdown_timeout": "5.000000", 2023-09-30T17:02:37.544 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_numa_node": "-1", 2023-09-30T17:02:37.544 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_oft_prefetch_dirfrags": "false", 2023-09-30T17:02:37.544 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_op_complaint_time": "30.000000", 2023-09-30T17:02:37.544 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_op_history_duration": "600", 2023-09-30T17:02:37.544 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_op_history_size": "20", 2023-09-30T17:02:37.544 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_op_history_slow_op_size": "20", 2023-09-30T17:02:37.544 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_op_history_slow_op_threshold": "10", 2023-09-30T17:02:37.544 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_op_log_threshold": "5", 2023-09-30T17:02:37.545 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_ping_grace": "15", 2023-09-30T17:02:37.545 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_ping_interval": "5", 2023-09-30T17:02:37.545 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2023-09-30T17:02:37.545 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_recall_global_max_decay_threshold": "131072", 2023-09-30T17:02:37.545 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_recall_max_caps": "30000", 2023-09-30T17:02:37.545 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_recall_max_decay_rate": "1.500000", 2023-09-30T17:02:37.545 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_recall_max_decay_threshold": "131072", 2023-09-30T17:02:37.545 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_recall_warning_decay_rate": "60.000000", 2023-09-30T17:02:37.545 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_recall_warning_threshold": "262144", 2023-09-30T17:02:37.545 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_reconnect_timeout": "45.000000", 2023-09-30T17:02:37.545 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_replay_interval": "1.000000", 2023-09-30T17:02:37.546 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_replay_unsafe_with_closed_session": "false", 2023-09-30T17:02:37.546 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_request_load_average_decay_rate": "60.000000", 2023-09-30T17:02:37.546 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_root_ino_gid": "0", 2023-09-30T17:02:37.546 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_root_ino_uid": "0", 2023-09-30T17:02:37.546 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_scatter_nudge_interval": "5.000000", 2023-09-30T17:02:37.546 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_session_blocklist_on_evict": "true", 2023-09-30T17:02:37.546 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_session_blocklist_on_timeout": "true", 2023-09-30T17:02:37.546 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2023-09-30T17:02:37.546 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_session_cache_liveness_magnitude": "10", 2023-09-30T17:02:37.546 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2023-09-30T17:02:37.546 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_session_cap_acquisition_throttle": "100000", 2023-09-30T17:02:37.547 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2023-09-30T17:02:37.547 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_session_metadata_threshold": "16777216", 2023-09-30T17:02:37.547 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_sessionmap_keys_per_op": "1024", 2023-09-30T17:02:37.547 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_shutdown_check": "0", 2023-09-30T17:02:37.547 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_skip_ino": "0", 2023-09-30T17:02:37.547 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_sleep_rank_change": "0.000000", 2023-09-30T17:02:37.547 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_snap_max_uid": "4294967294", 2023-09-30T17:02:37.547 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_snap_min_uid": "0", 2023-09-30T17:02:37.547 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_snap_rstat": "false", 2023-09-30T17:02:37.547 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_standby_replay_damaged": "false", 2023-09-30T17:02:37.547 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_symlink_recovery": "true", 2023-09-30T17:02:37.548 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_task_status_update_interval": "2.000000", 2023-09-30T17:02:37.548 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_thrash_exports": "0", 2023-09-30T17:02:37.548 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_thrash_fragments": "0", 2023-09-30T17:02:37.548 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_tick_interval": "5.000000", 2023-09-30T17:02:37.548 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_valgrind_exit": "false", 2023-09-30T17:02:37.548 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_verify_backtrace": "1", 2023-09-30T17:02:37.548 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_verify_scatter": "false", 2023-09-30T17:02:37.548 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_wipe_ino_prealloc": "false", 2023-09-30T17:02:37.548 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_wipe_sessions": "false", 2023-09-30T17:02:37.548 INFO:teuthology.orchestra.run.smithi007.stdout: "mempool_debug": "false", 2023-09-30T17:02:37.548 INFO:teuthology.orchestra.run.smithi007.stdout: "memstore_debug_omit_block_device_write": "false", 2023-09-30T17:02:37.549 INFO:teuthology.orchestra.run.smithi007.stdout: "memstore_device_bytes": "1073741824", 2023-09-30T17:02:37.549 INFO:teuthology.orchestra.run.smithi007.stdout: "memstore_page_set": "false", 2023-09-30T17:02:37.549 INFO:teuthology.orchestra.run.smithi007.stdout: "memstore_page_size": "65536", 2023-09-30T17:02:37.549 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_client_bytes": "134217728", 2023-09-30T17:02:37.549 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_client_messages": "512", 2023-09-30T17:02:37.549 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2023-09-30T17:02:37.549 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_connect_retry_interval": "1.000000", 2023-09-30T17:02:37.549 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2023-09-30T17:02:37.549 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2023-09-30T17:02:37.549 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_disabled_modules": "", 2023-09-30T17:02:37.549 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_initial_modules": "restful iostat nfs", 2023-09-30T17:02:37.550 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_max_pg_num_change": "128", 2023-09-30T17:02:37.550 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_mds_bytes": "134217728", 2023-09-30T17:02:37.550 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_mds_messages": "128", 2023-09-30T17:02:37.550 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2023-09-30T17:02:37.550 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_mon_bytes": "134217728", 2023-09-30T17:02:37.550 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_mon_messages": "128", 2023-09-30T17:02:37.550 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_osd_bytes": "536870912", 2023-09-30T17:02:37.550 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_osd_messages": "8192", 2023-09-30T17:02:37.550 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_pool": "true", 2023-09-30T17:02:37.550 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_service_beacon_grace": "60.000000", 2023-09-30T17:02:37.550 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_standby_modules": "true", 2023-09-30T17:02:37.551 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_stats_period": "5", 2023-09-30T17:02:37.551 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_stats_threshold": "5", 2023-09-30T17:02:37.551 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_tick_period": "2", 2023-09-30T17:02:37.551 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr_ttl_cache_expire_seconds": "0", 2023-09-30T17:02:37.551 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_accept_timeout_factor": "2.000000", 2023-09-30T17:02:37.551 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_allow_pool_delete": "true", 2023-09-30T17:02:37.551 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_allow_pool_size_one": "true", 2023-09-30T17:02:37.551 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_auth_validate_all_caps": "true", 2023-09-30T17:02:37.551 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2023-09-30T17:02:37.551 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2023-09-30T17:02:37.551 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_client_bytes": "104857600", 2023-09-30T17:02:37.552 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_client_directed_command_retry": "2", 2023-09-30T17:02:37.552 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_client_hunt_interval": "3.000000", 2023-09-30T17:02:37.552 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2023-09-30T17:02:37.552 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2023-09-30T17:02:37.552 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2023-09-30T17:02:37.552 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_client_hunt_parallel": "3", 2023-09-30T17:02:37.552 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_client_log_interval": "1.000000", 2023-09-30T17:02:37.552 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_client_max_log_entries_per_message": "1000", 2023-09-30T17:02:37.552 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_client_ping_interval": "10.000000", 2023-09-30T17:02:37.552 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_client_ping_timeout": "30.000000", 2023-09-30T17:02:37.552 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_client_target_rank": "-1", 2023-09-30T17:02:37.552 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_clock_drift_allowed": "1.000000", 2023-09-30T17:02:37.553 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2023-09-30T17:02:37.553 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2023-09-30T17:02:37.553 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_cluster_log_file_level": "debug", 2023-09-30T17:02:37.553 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_cluster_log_to_file": "true", 2023-09-30T17:02:37.553 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_cluster_log_to_graylog": "false", 2023-09-30T17:02:37.553 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2023-09-30T17:02:37.553 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_cluster_log_to_graylog_port": "12201", 2023-09-30T17:02:37.553 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_cluster_log_to_journald": "false", 2023-09-30T17:02:37.553 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_cluster_log_to_stderr": "false", 2023-09-30T17:02:37.553 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_cluster_log_to_syslog": "default=false", 2023-09-30T17:02:37.553 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2023-09-30T17:02:37.554 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_cluster_log_to_syslog_level": "info", 2023-09-30T17:02:37.554 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_compact_on_bootstrap": "false", 2023-09-30T17:02:37.554 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_compact_on_start": "false", 2023-09-30T17:02:37.554 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_compact_on_trim": "true", 2023-09-30T17:02:37.554 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_con_tracker_persist_interval": "10", 2023-09-30T17:02:37.554 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_con_tracker_score_halflife": "43200", 2023-09-30T17:02:37.554 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_config_key_max_entry_size": "65536", 2023-09-30T17:02:37.554 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_cpu_threads": "4", 2023-09-30T17:02:37.554 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_crush_min_required_version": "hammer", 2023-09-30T17:02:37.554 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_daemon_bytes": "419430400", 2023-09-30T17:02:37.554 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2023-09-30T17:02:37.555 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_data_avail_crit": "5", 2023-09-30T17:02:37.555 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_data_avail_warn": "5", 2023-09-30T17:02:37.555 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_data_size_warn": "16106127360", 2023-09-30T17:02:37.555 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_debug_block_osdmap_trim": "false", 2023-09-30T17:02:37.555 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_debug_deprecated_as_obsolete": "false", 2023-09-30T17:02:37.555 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_debug_dump_json": "false", 2023-09-30T17:02:37.555 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2023-09-30T17:02:37.555 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_debug_dump_transactions": "false", 2023-09-30T17:02:37.555 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_debug_extra_checks": "false", 2023-09-30T17:02:37.555 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_debug_no_initial_persistent_features": "false", 2023-09-30T17:02:37.555 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2023-09-30T17:02:37.555 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_debug_no_require_quincy": "false", 2023-09-30T17:02:37.556 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_debug_no_require_reef": "false", 2023-09-30T17:02:37.556 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2023-09-30T17:02:37.556 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_delta_reset_interval": "10.000000", 2023-09-30T17:02:37.556 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_dns_srv_name": "ceph-mon", 2023-09-30T17:02:37.556 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_down_mkfs_grace": "120", 2023-09-30T17:02:37.556 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_election_default_strategy": "1", 2023-09-30T17:02:37.556 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_election_timeout": "5.000000", 2023-09-30T17:02:37.556 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2023-09-30T17:02:37.556 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_elector_ping_divisor": "2", 2023-09-30T17:02:37.556 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_elector_ping_timeout": "2.000000", 2023-09-30T17:02:37.556 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_enable_op_tracker": "true", 2023-09-30T17:02:37.557 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_fake_pool_delete": "false", 2023-09-30T17:02:37.557 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_force_quorum_join": "false", 2023-09-30T17:02:37.557 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_globalid_prealloc": "10000", 2023-09-30T17:02:37.557 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_health_detail_to_clog": "false", 2023-09-30T17:02:37.557 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_health_log_update_period": "5", 2023-09-30T17:02:37.557 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_health_max_detail": "50", 2023-09-30T17:02:37.557 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_health_to_clog": "true", 2023-09-30T17:02:37.557 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_health_to_clog_interval": "600", 2023-09-30T17:02:37.557 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2023-09-30T17:02:37.557 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_host": "172.21.15.7,[v2:172.21.15.7:3301,v1:172.21.15.7:6790],[v2:172.21.15.7:3302,v1:172.21.15.7:6791]", 2023-09-30T17:02:37.557 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_host_override": "", 2023-09-30T17:02:37.558 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_initial_members": "", 2023-09-30T17:02:37.558 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2023-09-30T17:02:37.558 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2023-09-30T17:02:37.558 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_inject_transaction_delay_max": "10.000000", 2023-09-30T17:02:37.558 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2023-09-30T17:02:37.558 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_keyvaluedb": "rocksdb", 2023-09-30T17:02:37.558 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_lease": "5.000000", 2023-09-30T17:02:37.558 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2023-09-30T17:02:37.558 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_lease_renew_interval_factor": "0.600000", 2023-09-30T17:02:37.558 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_log_full_interval": "50", 2023-09-30T17:02:37.558 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_log_max": "10000", 2023-09-30T17:02:37.558 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_log_max_summary": "50", 2023-09-30T17:02:37.559 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_max_log_entries_per_event": "4096", 2023-09-30T17:02:37.559 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_max_log_epochs": "500", 2023-09-30T17:02:37.559 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_max_mdsmap_epochs": "500", 2023-09-30T17:02:37.559 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_max_mgrmap_epochs": "500", 2023-09-30T17:02:37.559 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_max_osd": "10000", 2023-09-30T17:02:37.559 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_max_pg_per_osd": "10000", 2023-09-30T17:02:37.559 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_max_pool_pg_num": "65536", 2023-09-30T17:02:37.559 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_max_snap_prune_per_epoch": "100", 2023-09-30T17:02:37.559 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_mds_blocklist_interval": "86400.000000", 2023-09-30T17:02:37.559 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_mds_force_trim_to": "0", 2023-09-30T17:02:37.559 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_mds_skip_sanity": "false", 2023-09-30T17:02:37.560 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_memory_autotune": "true", 2023-09-30T17:02:37.560 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_memory_target": "2147483648", 2023-09-30T17:02:37.560 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_mgr_beacon_grace": "30", 2023-09-30T17:02:37.560 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2023-09-30T17:02:37.560 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_mgr_digest_period": "5", 2023-09-30T17:02:37.560 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_mgr_inactive_grace": "60", 2023-09-30T17:02:37.560 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_mgr_mkfs_grace": "240", 2023-09-30T17:02:37.560 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2023-09-30T17:02:37.560 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_min_osdmap_epochs": "500", 2023-09-30T17:02:37.560 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_op_complaint_time": "30", 2023-09-30T17:02:37.561 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_op_history_duration": "600", 2023-09-30T17:02:37.561 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_op_history_size": "20", 2023-09-30T17:02:37.561 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_op_history_slow_op_size": "20", 2023-09-30T17:02:37.561 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_op_history_slow_op_threshold": "10", 2023-09-30T17:02:37.561 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_op_log_threshold": "5", 2023-09-30T17:02:37.561 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_adjust_down_out_interval": "true", 2023-09-30T17:02:37.561 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2023-09-30T17:02:37.561 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2023-09-30T17:02:37.561 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_auto_mark_in": "false", 2023-09-30T17:02:37.561 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_auto_mark_new_in": "true", 2023-09-30T17:02:37.561 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2023-09-30T17:02:37.561 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2023-09-30T17:02:37.562 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_cache_size": "500", 2023-09-30T17:02:37.562 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_cache_size_min": "134217728", 2023-09-30T17:02:37.562 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_crush_smoke_test": "true", 2023-09-30T17:02:37.562 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_destroyed_out_interval": "600", 2023-09-30T17:02:37.562 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_down_out_interval": "600", 2023-09-30T17:02:37.562 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_down_out_subtree_limit": "rack", 2023-09-30T17:02:37.562 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2023-09-30T17:02:37.562 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_force_trim_to": "0", 2023-09-30T17:02:37.562 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_full_ratio": "0.950000", 2023-09-30T17:02:37.562 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2023-09-30T17:02:37.562 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_laggy_halflife": "3600", 2023-09-30T17:02:37.563 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_laggy_max_interval": "300", 2023-09-30T17:02:37.563 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_laggy_weight": "0.300000", 2023-09-30T17:02:37.563 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2023-09-30T17:02:37.563 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_max_creating_pgs": "1024", 2023-09-30T17:02:37.563 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_max_initial_pgs": "1024", 2023-09-30T17:02:37.563 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_min_down_reporters": "2", 2023-09-30T17:02:37.563 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_min_in_ratio": "0.750000", 2023-09-30T17:02:37.563 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_min_up_ratio": "0.300000", 2023-09-30T17:02:37.563 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_nearfull_ratio": "0.850000", 2023-09-30T17:02:37.563 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_prime_pg_temp": "true", 2023-09-30T17:02:37.563 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2023-09-30T17:02:37.563 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2023-09-30T17:02:37.564 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_report_timeout": "900", 2023-09-30T17:02:37.564 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_reporter_subtree_level": "osd", 2023-09-30T17:02:37.564 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2023-09-30T17:02:37.564 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_warn_num_repaired": "10", 2023-09-30T17:02:37.564 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osd_warn_op_age": "32.000000", 2023-09-30T17:02:37.564 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osdmap_full_prune_enabled": "true", 2023-09-30T17:02:37.564 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osdmap_full_prune_interval": "10", 2023-09-30T17:02:37.564 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osdmap_full_prune_min": "10000", 2023-09-30T17:02:37.564 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_osdmap_full_prune_txsize": "100", 2023-09-30T17:02:37.564 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2023-09-30T17:02:37.564 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_pg_stuck_threshold": "60", 2023-09-30T17:02:37.565 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2023-09-30T17:02:37.565 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_pg_warn_min_objects": "10000", 2023-09-30T17:02:37.565 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_pg_warn_min_per_osd": "0", 2023-09-30T17:02:37.565 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_pg_warn_min_pool_objects": "1000", 2023-09-30T17:02:37.565 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_pool_quota_crit_threshold": "0", 2023-09-30T17:02:37.565 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_pool_quota_warn_threshold": "0", 2023-09-30T17:02:37.565 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_probe_timeout": "2.000000", 2023-09-30T17:02:37.565 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_reweight_max_change": "0.050000", 2023-09-30T17:02:37.565 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_reweight_max_osds": "4", 2023-09-30T17:02:37.565 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_reweight_min_bytes_per_osd": "10", 2023-09-30T17:02:37.565 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_reweight_min_pgs_per_osd": "4", 2023-09-30T17:02:37.566 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2023-09-30T17:02:37.566 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2023-09-30T17:02:37.566 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2023-09-30T17:02:37.566 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_scrub_interval": "86400", 2023-09-30T17:02:37.566 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_scrub_max_keys": "100", 2023-09-30T17:02:37.566 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_scrub_timeout": "300", 2023-09-30T17:02:37.566 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_session_timeout": "300", 2023-09-30T17:02:37.566 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_smart_report_timeout": "5", 2023-09-30T17:02:37.566 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_stat_smooth_intervals": "6", 2023-09-30T17:02:37.566 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2023-09-30T17:02:37.566 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_stretch_pool_min_size": "2", 2023-09-30T17:02:37.567 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_stretch_pool_size": "4", 2023-09-30T17:02:37.567 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2023-09-30T17:02:37.567 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_subscribe_interval": "86400.000000", 2023-09-30T17:02:37.567 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_sync_debug": "false", 2023-09-30T17:02:37.567 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_sync_max_payload_keys": "2000", 2023-09-30T17:02:37.567 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_sync_max_payload_size": "1048576", 2023-09-30T17:02:37.567 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_sync_provider_kill_at": "0", 2023-09-30T17:02:37.567 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_sync_requester_kill_at": "0", 2023-09-30T17:02:37.567 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_sync_timeout": "60.000000", 2023-09-30T17:02:37.567 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_target_pg_per_osd": "100", 2023-09-30T17:02:37.567 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_tick_interval": "5", 2023-09-30T17:02:37.567 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_timecheck_interval": "300.000000", 2023-09-30T17:02:37.568 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_timecheck_skew_interval": "30.000000", 2023-09-30T17:02:37.568 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_use_min_delay_socket": "false", 2023-09-30T17:02:37.568 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_older_version_delay": "604800", 2023-09-30T17:02:37.568 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2023-09-30T17:02:37.568 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2023-09-30T17:02:37.568 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2023-09-30T17:02:37.568 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_filestore_osds": "false", 2023-09-30T17:02:37.568 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2023-09-30T17:02:37.568 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2023-09-30T17:02:37.568 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2023-09-30T17:02:37.568 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_misplaced": "false", 2023-09-30T17:02:37.569 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2023-09-30T17:02:37.569 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_older_version": "true", 2023-09-30T17:02:37.569 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2023-09-30T17:02:37.569 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_pool_no_app": "true", 2023-09-30T17:02:37.569 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_pool_no_redundancy": "false", 2023-09-30T17:02:37.569 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2023-09-30T17:02:37.569 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2023-09-30T17:02:37.569 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2023-09-30T17:02:37.569 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_on_too_few_osds": "false", 2023-09-30T17:02:37.569 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2023-09-30T17:02:37.569 INFO:teuthology.orchestra.run.smithi007.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2023-09-30T17:02:37.570 INFO:teuthology.orchestra.run.smithi007.stdout: "monmap": "", 2023-09-30T17:02:37.570 INFO:teuthology.orchestra.run.smithi007.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2023-09-30T17:02:37.570 INFO:teuthology.orchestra.run.smithi007.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2023-09-30T17:02:37.570 INFO:teuthology.orchestra.run.smithi007.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2023-09-30T17:02:37.570 INFO:teuthology.orchestra.run.smithi007.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2023-09-30T17:02:37.570 INFO:teuthology.orchestra.run.smithi007.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2023-09-30T17:02:37.570 INFO:teuthology.orchestra.run.smithi007.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2023-09-30T17:02:37.570 INFO:teuthology.orchestra.run.smithi007.stdout: "motr_tracing_enabled": "false", 2023-09-30T17:02:37.570 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_op_threads": "3", 2023-09-30T17:02:37.570 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_buffer_size": "131072", 2023-09-30T17:02:37.570 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_cm": "false", 2023-09-30T17:02:37.571 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_device_name": "", 2023-09-30T17:02:37.571 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_dscp": "96", 2023-09-30T17:02:37.571 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_enable_hugepage": "false", 2023-09-30T17:02:37.571 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_gid_idx": "0", 2023-09-30T17:02:37.571 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_local_gid": "", 2023-09-30T17:02:37.571 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_polling_us": "1000", 2023-09-30T17:02:37.571 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_port_num": "1", 2023-09-30T17:02:37.571 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_receive_buffers": "32768", 2023-09-30T17:02:37.571 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_receive_queue_len": "4096", 2023-09-30T17:02:37.571 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_roce_ver": "1", 2023-09-30T17:02:37.571 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_send_buffers": "1024", 2023-09-30T17:02:37.571 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_sl": "3", 2023-09-30T17:02:37.572 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_support_srq": "true", 2023-09-30T17:02:37.572 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_rdma_type": "ib", 2023-09-30T17:02:37.572 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_async_reap_threshold": "5", 2023-09-30T17:02:37.572 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_bind_before_connect": "false", 2023-09-30T17:02:37.572 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_bind_ipv4": "true", 2023-09-30T17:02:37.572 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_bind_ipv6": "false", 2023-09-30T17:02:37.572 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_bind_msgr1": "true", 2023-09-30T17:02:37.572 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_bind_msgr2": "true", 2023-09-30T17:02:37.572 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_bind_port_max": "7568", 2023-09-30T17:02:37.572 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_bind_port_min": "6800", 2023-09-30T17:02:37.572 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_bind_prefer_ipv4": "false", 2023-09-30T17:02:37.573 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_bind_retry_count": "3", 2023-09-30T17:02:37.573 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_bind_retry_delay": "5", 2023-09-30T17:02:37.573 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_blackhole_client": "false", 2023-09-30T17:02:37.573 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_blackhole_mds": "false", 2023-09-30T17:02:37.573 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_blackhole_mgr": "false", 2023-09-30T17:02:37.573 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_blackhole_mon": "false", 2023-09-30T17:02:37.573 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_blackhole_osd": "false", 2023-09-30T17:02:37.573 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_client_mode": "crc secure", 2023-09-30T17:02:37.573 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_cluster_mode": "crc secure", 2023-09-30T17:02:37.573 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_cluster_type": "", 2023-09-30T17:02:37.573 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_compress_secure": "false", 2023-09-30T17:02:37.573 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_connection_idle_timeout": "900", 2023-09-30T17:02:37.574 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_connection_ready_timeout": "10", 2023-09-30T17:02:37.574 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_crc_data": "true", 2023-09-30T17:02:37.574 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_crc_header": "true", 2023-09-30T17:02:37.574 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_die_on_bad_msg": "false", 2023-09-30T17:02:37.574 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_die_on_bug": "true", 2023-09-30T17:02:37.574 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_die_on_old_message": "true", 2023-09-30T17:02:37.574 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_die_on_skipped_message": "false", 2023-09-30T17:02:37.574 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_die_on_unhandled_msg": "false", 2023-09-30T17:02:37.574 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dispatch_throttle_bytes": "104857600", 2023-09-30T17:02:37.574 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_coremask": "0xF", 2023-09-30T17:02:37.574 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_debug_allow_loopback": "false", 2023-09-30T17:02:37.575 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_devs_allowlist": "", 2023-09-30T17:02:37.575 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_enable_tso": "true", 2023-09-30T17:02:37.575 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2023-09-30T17:02:37.575 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_host_ipv4_addr": "", 2023-09-30T17:02:37.575 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_hugepages": "", 2023-09-30T17:02:37.575 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_hw_flow_control": "true", 2023-09-30T17:02:37.575 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2023-09-30T17:02:37.575 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_lro": "true", 2023-09-30T17:02:37.575 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_memory_channel": "4", 2023-09-30T17:02:37.575 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2023-09-30T17:02:37.575 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_pmd": "", 2023-09-30T17:02:37.575 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_port_id": "0", 2023-09-30T17:02:37.576 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2023-09-30T17:02:37.576 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dump_corrupt_message_level": "1", 2023-09-30T17:02:37.576 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_dump_on_send": "false", 2023-09-30T17:02:37.576 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_initial_backoff": "0.200000", 2023-09-30T17:02:37.576 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_inject_delay_max": "1.000000", 2023-09-30T17:02:37.576 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_inject_delay_probability": "0.000000", 2023-09-30T17:02:37.576 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_inject_delay_type": "", 2023-09-30T17:02:37.576 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_inject_internal_delays": "0.000000", 2023-09-30T17:02:37.576 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_inject_network_congestion": "0", 2023-09-30T17:02:37.576 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_inject_socket_failures": "0", 2023-09-30T17:02:37.576 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_learn_addr_from_peer": "true", 2023-09-30T17:02:37.576 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_max_accept_failures": "4", 2023-09-30T17:02:37.577 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_max_backoff": "15.000000", 2023-09-30T17:02:37.577 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_mon_client_mode": "secure crc", 2023-09-30T17:02:37.577 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_mon_cluster_mode": "secure crc", 2023-09-30T17:02:37.577 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_mon_service_mode": "secure crc", 2023-09-30T17:02:37.577 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_osd_compress_min_size": "1024", 2023-09-30T17:02:37.577 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_osd_compress_mode": "none", 2023-09-30T17:02:37.577 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_osd_compression_algorithm": "snappy", 2023-09-30T17:02:37.577 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2023-09-30T17:02:37.577 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_pq_min_cost": "65536", 2023-09-30T17:02:37.577 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_public_type": "", 2023-09-30T17:02:37.577 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_service_mode": "crc secure", 2023-09-30T17:02:37.578 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_tcp_listen_backlog": "512", 2023-09-30T17:02:37.578 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_tcp_nodelay": "true", 2023-09-30T17:02:37.578 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_tcp_prefetch_max_size": "4096", 2023-09-30T17:02:37.578 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_tcp_rcvbuf": "0", 2023-09-30T17:02:37.578 INFO:teuthology.orchestra.run.smithi007.stdout: "ms_type": "async+posix", 2023-09-30T17:02:37.578 INFO:teuthology.orchestra.run.smithi007.stdout: "no_config_file": "false", 2023-09-30T17:02:37.578 INFO:teuthology.orchestra.run.smithi007.stdout: "objecter_completion_locks_per_session": "32", 2023-09-30T17:02:37.578 INFO:teuthology.orchestra.run.smithi007.stdout: "objecter_debug_inject_relock_delay": "false", 2023-09-30T17:02:37.578 INFO:teuthology.orchestra.run.smithi007.stdout: "objecter_inflight_op_bytes": "104857600", 2023-09-30T17:02:37.578 INFO:teuthology.orchestra.run.smithi007.stdout: "objecter_inflight_ops": "1024", 2023-09-30T17:02:37.578 INFO:teuthology.orchestra.run.smithi007.stdout: "objecter_inject_no_watch_ping": "false", 2023-09-30T17:02:37.578 INFO:teuthology.orchestra.run.smithi007.stdout: "objecter_retry_writes_after_first_reply": "false", 2023-09-30T17:02:37.579 INFO:teuthology.orchestra.run.smithi007.stdout: "objecter_tick_interval": "5.000000", 2023-09-30T17:02:37.579 INFO:teuthology.orchestra.run.smithi007.stdout: "objecter_timeout": "10.000000", 2023-09-30T17:02:37.579 INFO:teuthology.orchestra.run.smithi007.stdout: "objectstore_blackhole": "false", 2023-09-30T17:02:37.579 INFO:teuthology.orchestra.run.smithi007.stdout: "openssl_engine_opts": "", 2023-09-30T17:02:37.579 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_agent_delay_time": "5.000000", 2023-09-30T17:02:37.579 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_agent_hist_halflife": "1000", 2023-09-30T17:02:37.579 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_agent_max_low_ops": "2", 2023-09-30T17:02:37.579 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_agent_max_ops": "4", 2023-09-30T17:02:37.579 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_agent_min_evict_effort": "0.100000", 2023-09-30T17:02:37.579 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_agent_quantize_effort": "0.100000", 2023-09-30T17:02:37.579 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_agent_slop": "0.020000", 2023-09-30T17:02:37.579 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_aggregated_slow_ops_logging": "true", 2023-09-30T17:02:37.580 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_allow_recovery_below_min_size": "true", 2023-09-30T17:02:37.580 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_asio_thread_count": "2", 2023-09-30T17:02:37.580 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_async_recovery_min_cost": "100", 2023-09-30T17:02:37.580 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_auto_mark_unfound_lost": "false", 2023-09-30T17:02:37.580 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_backfill_retry_interval": "30.000000", 2023-09-30T17:02:37.580 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_backfill_scan_max": "512", 2023-09-30T17:02:37.580 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_backfill_scan_min": "64", 2023-09-30T17:02:37.580 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_backoff_on_degraded": "false", 2023-09-30T17:02:37.580 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_backoff_on_peering": "false", 2023-09-30T17:02:37.580 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_backoff_on_unfound": "true", 2023-09-30T17:02:37.581 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_beacon_report_interval": "300", 2023-09-30T17:02:37.581 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_bench_duration": "30", 2023-09-30T17:02:37.581 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_bench_large_size_max_throughput": "104857600", 2023-09-30T17:02:37.581 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_bench_max_block_size": "67108864", 2023-09-30T17:02:37.581 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_bench_small_size_max_iops": "100", 2023-09-30T17:02:37.581 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_blkin_trace_all": "false", 2023-09-30T17:02:37.581 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_blocked_scrub_grace_period": "120", 2023-09-30T17:02:37.581 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2023-09-30T17:02:37.581 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2023-09-30T17:02:37.581 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2023-09-30T17:02:37.581 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_check_for_log_corruption": "false", 2023-09-30T17:02:37.581 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_check_max_object_name_len_on_startup": "true", 2023-09-30T17:02:37.582 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2023-09-30T17:02:37.582 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_class_dir": "/usr/lib64/rados-classes", 2023-09-30T17:02:37.582 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2023-09-30T17:02:37.582 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_class_update_on_start": "true", 2023-09-30T17:02:37.582 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_client_message_cap": "256", 2023-09-30T17:02:37.582 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_client_message_size_cap": "524288000", 2023-09-30T17:02:37.582 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_client_op_priority": "63", 2023-09-30T17:02:37.582 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_client_watch_timeout": "30", 2023-09-30T17:02:37.582 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_command_max_records": "256", 2023-09-30T17:02:37.582 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_compact_on_start": "false", 2023-09-30T17:02:37.582 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_copyfrom_max_chunk": "8388608", 2023-09-30T17:02:37.582 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_crush_chooseleaf_type": "0", 2023-09-30T17:02:37.583 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_crush_initial_weight": "-1.000000", 2023-09-30T17:02:37.583 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_crush_update_on_start": "true", 2023-09-30T17:02:37.583 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_crush_update_weight_set": "true", 2023-09-30T17:02:37.583 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2023-09-30T17:02:37.583 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2023-09-30T17:02:37.583 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2023-09-30T17:02:37.583 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_drop_ping_duration": "0", 2023-09-30T17:02:37.583 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_drop_ping_probability": "0.000000", 2023-09-30T17:02:37.583 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_feed_pullee": "-1", 2023-09-30T17:02:37.583 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_inject_copyfrom_error": "false", 2023-09-30T17:02:37.583 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2023-09-30T17:02:37.583 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2023-09-30T17:02:37.584 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_misdirected_ops": "false", 2023-09-30T17:02:37.584 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_no_acting_change": "false", 2023-09-30T17:02:37.584 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_no_purge_strays": "false", 2023-09-30T17:02:37.584 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_op_order": "false", 2023-09-30T17:02:37.584 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_pg_log_writeout": "false", 2023-09-30T17:02:37.584 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_pretend_recovery_active": "false", 2023-09-30T17:02:37.584 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_random_push_read_error": "0.000000", 2023-09-30T17:02:37.584 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2023-09-30T17:02:37.584 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_shutdown": "false", 2023-09-30T17:02:37.584 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2023-09-30T17:02:37.584 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2023-09-30T17:02:37.585 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_verify_cached_snaps": "false", 2023-09-30T17:02:37.585 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_verify_missing_on_start": "false", 2023-09-30T17:02:37.585 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_verify_snaps": "false", 2023-09-30T17:02:37.585 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_debug_verify_stray_on_activate": "false", 2023-09-30T17:02:37.585 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_deep_scrub_interval": "604800.000000", 2023-09-30T17:02:37.585 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_deep_scrub_keys": "1024", 2023-09-30T17:02:37.585 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2023-09-30T17:02:37.585 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2023-09-30T17:02:37.585 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2023-09-30T17:02:37.585 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_deep_scrub_stride": "524288", 2023-09-30T17:02:37.585 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2023-09-30T17:02:37.585 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_default_data_pool_replay_window": "5", 2023-09-30T17:02:37.586 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_default_notify_timeout": "30", 2023-09-30T17:02:37.586 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_delete_sleep": "0.000000", 2023-09-30T17:02:37.586 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_delete_sleep_hdd": "5.000000", 2023-09-30T17:02:37.586 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_delete_sleep_hybrid": "1.000000", 2023-09-30T17:02:37.586 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_delete_sleep_ssd": "1.000000", 2023-09-30T17:02:37.586 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_discard_disconnected_ops": "true", 2023-09-30T17:02:37.586 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_enable_op_tracker": "true", 2023-09-30T17:02:37.586 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2023-09-30T17:02:37.586 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_extblkdev_plugins": "vdo", 2023-09-30T17:02:37.586 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_failsafe_full_ratio": "0.970000", 2023-09-30T17:02:37.586 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_fast_fail_on_connection_refused": "true", 2023-09-30T17:02:37.587 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_fast_info": "true", 2023-09-30T17:02:37.587 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_fast_shutdown": "true", 2023-09-30T17:02:37.587 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_fast_shutdown_notify_mon": "true", 2023-09-30T17:02:37.587 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_fast_shutdown_timeout": "15", 2023-09-30T17:02:37.587 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_find_best_info_ignore_history_les": "false", 2023-09-30T17:02:37.587 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_force_auth_primary_missing_objects": "100", 2023-09-30T17:02:37.587 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2023-09-30T17:02:37.587 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_function_tracing": "false", 2023-09-30T17:02:37.587 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_heartbeat_grace": "20", 2023-09-30T17:02:37.587 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_heartbeat_interval": "6", 2023-09-30T17:02:37.587 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2023-09-30T17:02:37.588 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_heartbeat_min_peers": "10", 2023-09-30T17:02:37.588 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_heartbeat_min_size": "2000", 2023-09-30T17:02:37.588 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_heartbeat_stale": "600", 2023-09-30T17:02:37.588 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2023-09-30T17:02:37.588 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_hit_set_max_size": "100000", 2023-09-30T17:02:37.588 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_hit_set_min_size": "1000", 2023-09-30T17:02:37.588 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_hit_set_namespace": ".ceph-internal", 2023-09-30T17:02:37.588 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_ignore_stale_divergent_priors": "false", 2023-09-30T17:02:37.588 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2023-09-30T17:02:37.588 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_inject_failure_on_pg_removal": "false", 2023-09-30T17:02:37.588 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2023-09-30T17:02:37.588 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_journal_flush_on_shutdown": "true", 2023-09-30T17:02:37.588 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_journal_size": "5120", 2023-09-30T17:02:37.589 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_kill_backfill_at": "0", 2023-09-30T17:02:37.589 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_loop_before_reset_tphandle": "64", 2023-09-30T17:02:37.589 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_map_cache_size": "50", 2023-09-30T17:02:37.589 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_map_dedup": "true", 2023-09-30T17:02:37.589 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_map_message_max": "40", 2023-09-30T17:02:37.589 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_map_message_max_bytes": "10485760", 2023-09-30T17:02:37.589 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_map_share_max_epochs": "40", 2023-09-30T17:02:37.589 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_attr_name_len": "100", 2023-09-30T17:02:37.589 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_attr_size": "0", 2023-09-30T17:02:37.589 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_backfills": "1", 2023-09-30T17:02:37.589 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_markdown_count": "5", 2023-09-30T17:02:37.589 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_markdown_period": "600", 2023-09-30T17:02:37.590 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_object_name_len": "2048", 2023-09-30T17:02:37.590 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_object_namespace_len": "256", 2023-09-30T17:02:37.590 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_object_size": "134217728", 2023-09-30T17:02:37.590 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2023-09-30T17:02:37.590 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_omap_entries_per_request": "1024", 2023-09-30T17:02:37.590 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_pg_blocked_by": "16", 2023-09-30T17:02:37.590 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_pg_log_entries": "10000", 2023-09-30T17:02:37.590 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2023-09-30T17:02:37.590 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_pgls": "1024", 2023-09-30T17:02:37.590 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_push_cost": "8388608", 2023-09-30T17:02:37.590 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_push_objects": "10", 2023-09-30T17:02:37.591 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_scrubs": "3", 2023-09-30T17:02:37.591 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2023-09-30T17:02:37.591 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_trimming_pgs": "2", 2023-09-30T17:02:37.591 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_write_op_reply_len": "64", 2023-09-30T17:02:37.591 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_max_write_size": "90", 2023-09-30T17:02:37.591 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2023-09-30T17:02:37.591 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2023-09-30T17:02:37.591 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2023-09-30T17:02:37.591 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2023-09-30T17:02:37.591 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2023-09-30T17:02:37.591 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2023-09-30T17:02:37.591 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2023-09-30T17:02:37.592 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_override_recovery_settings": "false", 2023-09-30T17:02:37.592 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_profile": "balanced", 2023-09-30T17:02:37.592 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2023-09-30T17:02:37.592 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2023-09-30T17:02:37.592 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2023-09-30T17:02:37.592 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2023-09-30T17:02:37.592 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2023-09-30T17:02:37.592 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2023-09-30T17:02:37.592 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2023-09-30T17:02:37.592 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2023-09-30T17:02:37.592 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2023-09-30T17:02:37.592 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_scheduler_client_wgt": "1", 2023-09-30T17:02:37.593 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mclock_skip_benchmark": "false", 2023-09-30T17:02:37.593 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_memory_base": "805306368", 2023-09-30T17:02:37.593 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_memory_cache_min": "134217728", 2023-09-30T17:02:37.593 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_memory_cache_resize_interval": "1.000000", 2023-09-30T17:02:37.593 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_memory_expected_fragmentation": "0.150000", 2023-09-30T17:02:37.593 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_memory_target": "4294967296", 2023-09-30T17:02:37.593 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_memory_target_autotune": "false", 2023-09-30T17:02:37.593 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2023-09-30T17:02:37.593 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_min_pg_log_entries": "250", 2023-09-30T17:02:37.593 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_min_recovery_priority": "0", 2023-09-30T17:02:37.593 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mon_heartbeat_interval": "30", 2023-09-30T17:02:37.594 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2023-09-30T17:02:37.594 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mon_report_interval": "5", 2023-09-30T17:02:37.594 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mon_report_max_in_flight": "2", 2023-09-30T17:02:37.594 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_mon_shutdown_timeout": "5.000000", 2023-09-30T17:02:37.594 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_num_cache_shards": "32", 2023-09-30T17:02:37.594 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_num_op_tracker_shard": "32", 2023-09-30T17:02:37.594 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_numa_auto_affinity": "true", 2023-09-30T17:02:37.594 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_numa_node": "-1", 2023-09-30T17:02:37.594 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_numa_prefer_iface": "true", 2023-09-30T17:02:37.594 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_object_clean_region_max_num_intervals": "10", 2023-09-30T17:02:37.594 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_objecter_finishers": "1", 2023-09-30T17:02:37.595 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_objectstore": "bluestore", 2023-09-30T17:02:37.595 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_objectstore_fuse": "false", 2023-09-30T17:02:37.595 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_objectstore_tracing": "false", 2023-09-30T17:02:37.595 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_complaint_time": "30.000000", 2023-09-30T17:02:37.595 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_history_duration": "600", 2023-09-30T17:02:37.595 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_history_size": "20", 2023-09-30T17:02:37.595 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_history_slow_op_size": "20", 2023-09-30T17:02:37.595 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2023-09-30T17:02:37.595 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_log_threshold": "5", 2023-09-30T17:02:37.595 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_num_shards": "0", 2023-09-30T17:02:37.595 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_num_shards_hdd": "5", 2023-09-30T17:02:37.596 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_num_shards_ssd": "8", 2023-09-30T17:02:37.596 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_num_threads_per_shard": "0", 2023-09-30T17:02:37.596 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2023-09-30T17:02:37.596 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2023-09-30T17:02:37.596 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2023-09-30T17:02:37.596 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_pq_min_cost": "65536", 2023-09-30T17:02:37.596 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_queue": "mclock_scheduler", 2023-09-30T17:02:37.596 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_queue_cut_off": "high", 2023-09-30T17:02:37.596 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_thread_suicide_timeout": "150", 2023-09-30T17:02:37.596 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_op_thread_timeout": "15", 2023-09-30T17:02:37.596 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_open_classes_on_start": "true", 2023-09-30T17:02:37.597 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_os_flags": "0", 2023-09-30T17:02:37.597 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_peering_op_priority": "255", 2023-09-30T17:02:37.597 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pg_delete_cost": "1048576", 2023-09-30T17:02:37.597 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pg_delete_priority": "5", 2023-09-30T17:02:37.597 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2023-09-30T17:02:37.597 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2023-09-30T17:02:37.597 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pg_log_dups_tracked": "10000", 2023-09-30T17:02:37.597 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pg_log_trim_max": "10000", 2023-09-30T17:02:37.597 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pg_log_trim_min": "100", 2023-09-30T17:02:37.597 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2023-09-30T17:02:37.597 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pg_object_context_cache_count": "64", 2023-09-30T17:02:37.597 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pg_stat_report_interval_max": "500", 2023-09-30T17:02:37.598 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2023-09-30T17:02:37.598 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_cache_min_evict_age": "0", 2023-09-30T17:02:37.598 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_cache_min_flush_age": "0", 2023-09-30T17:02:37.598 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2023-09-30T17:02:37.598 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2023-09-30T17:02:37.598 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2023-09-30T17:02:37.598 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_crimson": "false", 2023-09-30T17:02:37.598 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_crush_rule": "-1", 2023-09-30T17:02:37.598 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_ec_fast_read": "false", 2023-09-30T17:02:37.598 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2023-09-30T17:02:37.598 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_flag_bulk": "false", 2023-09-30T17:02:37.598 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_flag_hashpspool": "true", 2023-09-30T17:02:37.599 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_flag_nodelete": "false", 2023-09-30T17:02:37.599 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_flag_nopgchange": "false", 2023-09-30T17:02:37.599 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_flag_nosizechange": "false", 2023-09-30T17:02:37.599 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_flags": "0", 2023-09-30T17:02:37.599 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2023-09-30T17:02:37.599 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_min_size": "0", 2023-09-30T17:02:37.599 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2023-09-30T17:02:37.599 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_pg_num": "32", 2023-09-30T17:02:37.599 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_pgp_num": "0", 2023-09-30T17:02:37.599 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2023-09-30T17:02:37.599 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_size": "2", 2023-09-30T17:02:37.599 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_default_type": "replicated", 2023-09-30T17:02:37.600 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2023-09-30T17:02:37.600 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_pool_use_gmt_hitset": "true", 2023-09-30T17:02:37.600 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_push_per_object_cost": "1000", 2023-09-30T17:02:37.600 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_read_ec_check_for_errors": "false", 2023-09-30T17:02:37.600 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recover_clone_overlap": "true", 2023-09-30T17:02:37.600 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recover_clone_overlap_limit": "10", 2023-09-30T17:02:37.600 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_cost": "20971520", 2023-09-30T17:02:37.600 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_delay_start": "0.000000", 2023-09-30T17:02:37.600 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_max_active": "0", 2023-09-30T17:02:37.600 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_max_active_hdd": "3", 2023-09-30T17:02:37.600 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_max_active_ssd": "10", 2023-09-30T17:02:37.600 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_max_chunk": "8388608", 2023-09-30T17:02:37.601 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2023-09-30T17:02:37.601 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_max_single_start": "1", 2023-09-30T17:02:37.601 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_op_priority": "3", 2023-09-30T17:02:37.601 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_op_warn_multiple": "16", 2023-09-30T17:02:37.601 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_priority": "5", 2023-09-30T17:02:37.601 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_retry_interval": "30.000000", 2023-09-30T17:02:37.601 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_sleep": "0.000000", 2023-09-30T17:02:37.601 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_sleep_hdd": "0.100000", 2023-09-30T17:02:37.601 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2023-09-30T17:02:37.601 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_recovery_sleep_ssd": "0.000000", 2023-09-30T17:02:37.601 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_repair_during_recovery": "false", 2023-09-30T17:02:37.602 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_requested_scrub_priority": "120", 2023-09-30T17:02:37.602 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2023-09-30T17:02:37.602 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_rollback_to_cluster_snap": "", 2023-09-30T17:02:37.602 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_auto_repair": "false", 2023-09-30T17:02:37.602 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_auto_repair_num_errors": "5", 2023-09-30T17:02:37.602 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_backoff_ratio": "0.660000", 2023-09-30T17:02:37.602 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_begin_hour": "0", 2023-09-30T17:02:37.602 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_begin_week_day": "0", 2023-09-30T17:02:37.602 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_chunk_max": "25", 2023-09-30T17:02:37.602 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_chunk_min": "5", 2023-09-30T17:02:37.602 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_cost": "52428800", 2023-09-30T17:02:37.602 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_during_recovery": "false", 2023-09-30T17:02:37.603 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_end_hour": "0", 2023-09-30T17:02:37.603 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_end_week_day": "0", 2023-09-30T17:02:37.603 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_event_cost": "4096", 2023-09-30T17:02:37.603 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_extended_sleep": "0.000000", 2023-09-30T17:02:37.603 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2023-09-30T17:02:37.603 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_invalid_stats": "true", 2023-09-30T17:02:37.603 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_load_threshold": "0.500000", 2023-09-30T17:02:37.603 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_max_interval": "604800.000000", 2023-09-30T17:02:37.603 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_max_preemptions": "5", 2023-09-30T17:02:37.603 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_min_interval": "86400.000000", 2023-09-30T17:02:37.603 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_priority": "5", 2023-09-30T17:02:37.603 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_reservation_timeout": "5000", 2023-09-30T17:02:37.603 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_sleep": "0.000000", 2023-09-30T17:02:37.604 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_scrub_slow_reservation_response": "2200", 2023-09-30T17:02:37.604 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_shallow_scrub_chunk_max": "100", 2023-09-30T17:02:37.604 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_shallow_scrub_chunk_min": "50", 2023-09-30T17:02:37.604 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_shutdown_pgref_assert": "false", 2023-09-30T17:02:37.604 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_skip_data_digest": "false", 2023-09-30T17:02:37.604 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_smart_report_timeout": "5", 2023-09-30T17:02:37.604 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_snap_trim_cost": "1048576", 2023-09-30T17:02:37.604 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_snap_trim_priority": "5", 2023-09-30T17:02:37.604 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_snap_trim_sleep": "0.000000", 2023-09-30T17:02:37.604 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2023-09-30T17:02:37.604 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2023-09-30T17:02:37.604 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2023-09-30T17:02:37.605 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_stats_update_period_not_scrubbing": "120", 2023-09-30T17:02:37.605 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_stats_update_period_scrubbing": "15", 2023-09-30T17:02:37.605 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2023-09-30T17:02:37.605 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_target_transaction_size": "30", 2023-09-30T17:02:37.605 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_tier_default_cache_hit_set_count": "4", 2023-09-30T17:02:37.605 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2023-09-30T17:02:37.605 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2023-09-30T17:02:37.605 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2023-09-30T17:02:37.605 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2023-09-30T17:02:37.605 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2023-09-30T17:02:37.605 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2023-09-30T17:02:37.606 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_tier_default_cache_mode": "writeback", 2023-09-30T17:02:37.606 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2023-09-30T17:02:37.606 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_tier_promote_max_objects_sec": "25", 2023-09-30T17:02:37.606 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_tracing": "false", 2023-09-30T17:02:37.606 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_use_stale_snap": "false", 2023-09-30T17:02:37.606 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2023-09-30T17:02:37.606 INFO:teuthology.orchestra.run.smithi007.stdout: "osdc_blkin_trace_all": "false", 2023-09-30T17:02:37.606 INFO:teuthology.orchestra.run.smithi007.stdout: "paxos_kill_at": "0", 2023-09-30T17:02:37.606 INFO:teuthology.orchestra.run.smithi007.stdout: "paxos_max_join_drift": "10", 2023-09-30T17:02:37.606 INFO:teuthology.orchestra.run.smithi007.stdout: "paxos_min": "500", 2023-09-30T17:02:37.606 INFO:teuthology.orchestra.run.smithi007.stdout: "paxos_min_wait": "0.050000", 2023-09-30T17:02:37.606 INFO:teuthology.orchestra.run.smithi007.stdout: "paxos_propose_interval": "1.000000", 2023-09-30T17:02:37.607 INFO:teuthology.orchestra.run.smithi007.stdout: "paxos_service_trim_max": "500", 2023-09-30T17:02:37.607 INFO:teuthology.orchestra.run.smithi007.stdout: "paxos_service_trim_max_multiplier": "20", 2023-09-30T17:02:37.607 INFO:teuthology.orchestra.run.smithi007.stdout: "paxos_service_trim_min": "250", 2023-09-30T17:02:37.607 INFO:teuthology.orchestra.run.smithi007.stdout: "paxos_stash_full_interval": "25", 2023-09-30T17:02:37.607 INFO:teuthology.orchestra.run.smithi007.stdout: "paxos_trim_max": "500", 2023-09-30T17:02:37.607 INFO:teuthology.orchestra.run.smithi007.stdout: "paxos_trim_min": "250", 2023-09-30T17:02:37.607 INFO:teuthology.orchestra.run.smithi007.stdout: "perf": "true", 2023-09-30T17:02:37.607 INFO:teuthology.orchestra.run.smithi007.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2023-09-30T17:02:37.607 INFO:teuthology.orchestra.run.smithi007.stdout: "plugin_crypto_accelerator": "crypto_isal", 2023-09-30T17:02:37.607 INFO:teuthology.orchestra.run.smithi007.stdout: "plugin_dir": "/usr/lib64/ceph", 2023-09-30T17:02:37.607 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "-", 2023-09-30T17:02:37.608 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrv": "", 2023-09-30T17:02:37.608 INFO:teuthology.orchestra.run.smithi007.stdout: "public_bind_addr": "-", 2023-09-30T17:02:37.608 INFO:teuthology.orchestra.run.smithi007.stdout: "public_network": "", 2023-09-30T17:02:37.608 INFO:teuthology.orchestra.run.smithi007.stdout: "public_network_interface": "", 2023-09-30T17:02:37.608 INFO:teuthology.orchestra.run.smithi007.stdout: "qat_compressor_enabled": "false", 2023-09-30T17:02:37.608 INFO:teuthology.orchestra.run.smithi007.stdout: "qat_compressor_session_max_number": "256", 2023-09-30T17:02:37.608 INFO:teuthology.orchestra.run.smithi007.stdout: "rados_mon_op_timeout": "0", 2023-09-30T17:02:37.608 INFO:teuthology.orchestra.run.smithi007.stdout: "rados_osd_op_timeout": "0", 2023-09-30T17:02:37.608 INFO:teuthology.orchestra.run.smithi007.stdout: "rados_tracing": "false", 2023-09-30T17:02:37.608 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_atime_update_interval": "60", 2023-09-30T17:02:37.608 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2023-09-30T17:02:37.609 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_balance_parent_reads": "false", 2023-09-30T17:02:37.609 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_balance_snap_reads": "false", 2023-09-30T17:02:37.609 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_blkin_trace_all": "false", 2023-09-30T17:02:37.609 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_blocklist_expire_seconds": "0", 2023-09-30T17:02:37.609 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_blocklist_on_break_lock": "true", 2023-09-30T17:02:37.609 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_cache": "true", 2023-09-30T17:02:37.609 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_cache_block_writes_upfront": "false", 2023-09-30T17:02:37.609 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_cache_max_dirty": "25165824", 2023-09-30T17:02:37.609 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_cache_max_dirty_age": "1.000000", 2023-09-30T17:02:37.609 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_cache_max_dirty_object": "0", 2023-09-30T17:02:37.609 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_cache_policy": "writearound", 2023-09-30T17:02:37.609 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_cache_size": "33554432", 2023-09-30T17:02:37.610 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_cache_target_dirty": "16777216", 2023-09-30T17:02:37.610 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_cache_writethrough_until_flush": "true", 2023-09-30T17:02:37.610 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_clone_copy_on_read": "false", 2023-09-30T17:02:37.610 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_compression_hint": "none", 2023-09-30T17:02:37.610 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_concurrent_management_ops": "10", 2023-09-30T17:02:37.610 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_config_pool_override_update_timestamp": "0", 2023-09-30T17:02:37.610 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_default_clone_format": "auto", 2023-09-30T17:02:37.610 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_default_data_pool": "", 2023-09-30T17:02:37.610 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_default_features": "61", 2023-09-30T17:02:37.610 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_default_format": "2", 2023-09-30T17:02:37.610 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_default_map_options": "", 2023-09-30T17:02:37.611 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_default_order": "22", 2023-09-30T17:02:37.611 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_default_pool": "rbd", 2023-09-30T17:02:37.611 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2023-09-30T17:02:37.611 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_default_stripe_count": "0", 2023-09-30T17:02:37.611 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_default_stripe_unit": "0", 2023-09-30T17:02:37.611 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_disable_zero_copy_writes": "true", 2023-09-30T17:02:37.611 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_discard_granularity_bytes": "65536", 2023-09-30T17:02:37.611 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_discard_on_zeroed_write_same": "true", 2023-09-30T17:02:37.611 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_enable_alloc_hint": "true", 2023-09-30T17:02:37.611 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2023-09-30T17:02:37.611 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_io_scheduler": "simple", 2023-09-30T17:02:37.611 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2023-09-30T17:02:37.612 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_journal_commit_age": "5.000000", 2023-09-30T17:02:37.612 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2023-09-30T17:02:37.612 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_journal_max_payload_bytes": "16384", 2023-09-30T17:02:37.612 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_journal_object_flush_age": "0.000000", 2023-09-30T17:02:37.612 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_journal_object_flush_bytes": "1048576", 2023-09-30T17:02:37.612 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_journal_object_flush_interval": "0", 2023-09-30T17:02:37.612 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2023-09-30T17:02:37.612 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2023-09-30T17:02:37.612 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_journal_order": "24", 2023-09-30T17:02:37.612 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_journal_pool": "", 2023-09-30T17:02:37.612 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_journal_splay_width": "4", 2023-09-30T17:02:37.612 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_localize_parent_reads": "false", 2023-09-30T17:02:37.613 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_localize_snap_reads": "false", 2023-09-30T17:02:37.613 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2023-09-30T17:02:37.613 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2023-09-30T17:02:37.613 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2023-09-30T17:02:37.613 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2023-09-30T17:02:37.613 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2023-09-30T17:02:37.613 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2023-09-30T17:02:37.613 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_image_policy_type": "simple", 2023-09-30T17:02:37.613 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2023-09-30T17:02:37.613 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_image_state_check_interval": "30", 2023-09-30T17:02:37.613 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2023-09-30T17:02:37.613 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2023-09-30T17:02:37.614 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2023-09-30T17:02:37.614 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2023-09-30T17:02:37.614 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2023-09-30T17:02:37.614 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_memory_autotune": "true", 2023-09-30T17:02:37.614 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_memory_base": "805306368", 2023-09-30T17:02:37.614 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2023-09-30T17:02:37.614 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_memory_cache_min": "134217728", 2023-09-30T17:02:37.614 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2023-09-30T17:02:37.614 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2023-09-30T17:02:37.614 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_memory_target": "4294967296", 2023-09-30T17:02:37.614 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_perf_stats_prio": "5", 2023-09-30T17:02:37.614 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2023-09-30T17:02:37.615 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2023-09-30T17:02:37.615 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirroring_delete_delay": "0", 2023-09-30T17:02:37.615 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2023-09-30T17:02:37.615 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirroring_replay_delay": "0", 2023-09-30T17:02:37.615 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2023-09-30T17:02:37.615 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2023-09-30T17:02:37.615 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_move_to_trash_on_remove": "false", 2023-09-30T17:02:37.615 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2023-09-30T17:02:37.615 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_mtime_update_interval": "60", 2023-09-30T17:02:37.615 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_non_blocking_aio": "true", 2023-09-30T17:02:37.616 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_op_thread_timeout": "60", 2023-09-30T17:02:37.616 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_op_threads": "1", 2023-09-30T17:02:37.616 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_parent_cache_enabled": "false", 2023-09-30T17:02:37.616 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_persistent_cache_mode": "disabled", 2023-09-30T17:02:37.616 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_persistent_cache_path": "/tmp", 2023-09-30T17:02:37.616 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_persistent_cache_size": "1073741824", 2023-09-30T17:02:37.616 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_plugins": "", 2023-09-30T17:02:37.616 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_bps_burst": "0", 2023-09-30T17:02:37.616 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_bps_burst_seconds": "1", 2023-09-30T17:02:37.616 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_bps_limit": "0", 2023-09-30T17:02:37.616 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_exclude_ops": "0", 2023-09-30T17:02:37.616 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_iops_burst": "0", 2023-09-30T17:02:37.616 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_iops_burst_seconds": "1", 2023-09-30T17:02:37.617 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_iops_limit": "0", 2023-09-30T17:02:37.617 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_read_bps_burst": "0", 2023-09-30T17:02:37.617 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2023-09-30T17:02:37.617 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_read_bps_limit": "0", 2023-09-30T17:02:37.617 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_read_iops_burst": "0", 2023-09-30T17:02:37.617 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2023-09-30T17:02:37.617 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_read_iops_limit": "0", 2023-09-30T17:02:37.617 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_schedule_tick_min": "50", 2023-09-30T17:02:37.617 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_write_bps_burst": "0", 2023-09-30T17:02:37.617 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2023-09-30T17:02:37.617 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_write_bps_limit": "0", 2023-09-30T17:02:37.617 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_write_iops_burst": "0", 2023-09-30T17:02:37.618 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2023-09-30T17:02:37.618 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_qos_write_iops_limit": "0", 2023-09-30T17:02:37.618 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_quiesce_notification_attempts": "10", 2023-09-30T17:02:37.618 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_read_from_replica_policy": "default", 2023-09-30T17:02:37.618 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2023-09-30T17:02:37.618 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_readahead_max_bytes": "524288", 2023-09-30T17:02:37.618 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_readahead_trigger_requests": "10", 2023-09-30T17:02:37.618 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_request_timed_out_seconds": "30", 2023-09-30T17:02:37.618 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_skip_partial_discard": "true", 2023-09-30T17:02:37.618 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2023-09-30T17:02:37.619 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_tracing": "false", 2023-09-30T17:02:37.619 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_validate_names": "true", 2023-09-30T17:02:37.619 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd_validate_pool": "true", 2023-09-30T17:02:37.619 INFO:teuthology.orchestra.run.smithi007.stdout: "restapi_base_url": "", 2023-09-30T17:02:37.619 INFO:teuthology.orchestra.run.smithi007.stdout: "restapi_log_level": "", 2023-09-30T17:02:37.619 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_acl_grants_max_num": "100", 2023-09-30T17:02:37.619 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_admin_entry": "admin", 2023-09-30T17:02:37.619 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2023-09-30T17:02:37.619 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_backend_store": "rados", 2023-09-30T17:02:37.619 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_barbican_url": "", 2023-09-30T17:02:37.619 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_beast_enable_async": "true", 2023-09-30T17:02:37.619 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2023-09-30T17:02:37.620 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_bucket_default_quota_max_size": "-1", 2023-09-30T17:02:37.620 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_bucket_index_max_aio": "128", 2023-09-30T17:02:37.620 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2023-09-30T17:02:37.620 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_bucket_quota_cache_size": "10000", 2023-09-30T17:02:37.620 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_bucket_quota_ttl": "600", 2023-09-30T17:02:37.620 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_bucket_sync_spawn_window": "20", 2023-09-30T17:02:37.620 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_cache_enabled": "true", 2023-09-30T17:02:37.620 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_cache_expiry_interval": "900", 2023-09-30T17:02:37.620 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_cache_lru_size": "10000", 2023-09-30T17:02:37.620 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_config_store": "rados", 2023-09-30T17:02:37.620 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_content_length_compat": "false", 2023-09-30T17:02:37.620 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_copy_obj_progress": "true", 2023-09-30T17:02:37.621 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2023-09-30T17:02:37.621 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_cors_rules_max_num": "100", 2023-09-30T17:02:37.621 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_cross_domain_policy": "", 2023-09-30T17:02:37.621 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_default_encryption_key": "", 2023-09-30T17:02:37.621 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_kmip_addr": "", 2023-09-30T17:02:37.621 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_kmip_ca_path": "", 2023-09-30T17:02:37.621 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_kmip_client_cert": "", 2023-09-30T17:02:37.621 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_kmip_client_key": "", 2023-09-30T17:02:37.621 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_kmip_kms_key_template": "", 2023-09-30T17:02:37.621 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_kmip_password": "", 2023-09-30T17:02:37.621 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2023-09-30T17:02:37.622 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_kmip_username": "", 2023-09-30T17:02:37.622 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_require_ssl": "true", 2023-09-30T17:02:37.622 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2023-09-30T17:02:37.622 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2023-09-30T17:02:37.622 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_sse_s3_backend": "vault", 2023-09-30T17:02:37.622 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2023-09-30T17:02:37.622 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2023-09-30T17:02:37.622 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2023-09-30T17:02:37.622 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2023-09-30T17:02:37.622 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2023-09-30T17:02:37.622 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2023-09-30T17:02:37.623 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2023-09-30T17:02:37.623 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2023-09-30T17:02:37.623 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2023-09-30T17:02:37.623 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2023-09-30T17:02:37.623 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2023-09-30T17:02:37.623 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_suppress_logs": "true", 2023-09-30T17:02:37.623 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_vault_addr": "", 2023-09-30T17:02:37.623 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_vault_auth": "token", 2023-09-30T17:02:37.623 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_vault_namespace": "", 2023-09-30T17:02:37.623 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_vault_prefix": "", 2023-09-30T17:02:37.623 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_vault_secret_engine": "transit", 2023-09-30T17:02:37.623 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_vault_ssl_cacert": "", 2023-09-30T17:02:37.624 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2023-09-30T17:02:37.624 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2023-09-30T17:02:37.624 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_vault_token_file": "", 2023-09-30T17:02:37.624 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_crypt_vault_verify_ssl": "true", 2023-09-30T17:02:37.624 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_curl_buffersize": "524288", 2023-09-30T17:02:37.624 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_curl_low_speed_limit": "1024", 2023-09-30T17:02:37.624 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_curl_low_speed_time": "300", 2023-09-30T17:02:37.624 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_curl_tcp_keepalive": "0", 2023-09-30T17:02:37.624 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_curl_wait_timeout_ms": "1000", 2023-09-30T17:02:37.624 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2023-09-30T17:02:37.624 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2023-09-30T17:02:37.625 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2023-09-30T17:02:37.625 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2023-09-30T17:02:37.625 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_d3n_l1_fadvise": "4", 2023-09-30T17:02:37.625 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2023-09-30T17:02:37.625 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_d3n_libaio_aio_num": "64", 2023-09-30T17:02:37.625 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_d3n_libaio_aio_threads": "20", 2023-09-30T17:02:37.625 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_d4n_host": "127.0.0.1", 2023-09-30T17:02:37.625 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_d4n_port": "6379", 2023-09-30T17:02:37.625 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2023-09-30T17:02:37.625 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_data_log_changes_size": "1000", 2023-09-30T17:02:37.625 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_data_log_num_shards": "128", 2023-09-30T17:02:37.626 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_data_log_obj_prefix": "data_log", 2023-09-30T17:02:37.626 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_data_log_window": "30", 2023-09-30T17:02:37.626 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_data_notify_interval_msec": "0", 2023-09-30T17:02:37.626 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_data_sync_poll_interval": "20", 2023-09-30T17:02:37.626 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_data_sync_spawn_window": "20", 2023-09-30T17:02:37.626 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2023-09-30T17:02:37.626 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_debug_inject_set_olh_err": "0", 2023-09-30T17:02:37.626 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_default_data_log_backing": "fifo", 2023-09-30T17:02:37.626 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_default_realm_info_oid": "default.realm", 2023-09-30T17:02:37.626 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_default_region_info_oid": "default.region", 2023-09-30T17:02:37.626 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_default_zone_info_oid": "default.zone", 2023-09-30T17:02:37.627 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2023-09-30T17:02:37.627 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_defer_to_bucket_acls": "", 2023-09-30T17:02:37.627 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_delete_multi_obj_max_num": "1000", 2023-09-30T17:02:37.627 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dmclock_admin_lim": "0.000000", 2023-09-30T17:02:37.627 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dmclock_admin_res": "100.000000", 2023-09-30T17:02:37.627 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2023-09-30T17:02:37.627 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dmclock_auth_lim": "0.000000", 2023-09-30T17:02:37.627 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dmclock_auth_res": "200.000000", 2023-09-30T17:02:37.627 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2023-09-30T17:02:37.627 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dmclock_data_lim": "0.000000", 2023-09-30T17:02:37.627 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dmclock_data_res": "500.000000", 2023-09-30T17:02:37.627 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dmclock_data_wgt": "500.000000", 2023-09-30T17:02:37.628 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2023-09-30T17:02:37.628 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dmclock_metadata_res": "500.000000", 2023-09-30T17:02:37.628 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2023-09-30T17:02:37.628 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dns_name": "", 2023-09-30T17:02:37.628 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dns_s3website_name": "", 2023-09-30T17:02:37.628 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_dynamic_resharding": "true", 2023-09-30T17:02:37.628 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2023-09-30T17:02:37.628 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_enable_gc_threads": "true", 2023-09-30T17:02:37.628 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_enable_lc_threads": "true", 2023-09-30T17:02:37.628 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_enable_ops_log": "false", 2023-09-30T17:02:37.628 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_enable_quota_threads": "true", 2023-09-30T17:02:37.629 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_enable_static_website": "false", 2023-09-30T17:02:37.629 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_enable_usage_log": "false", 2023-09-30T17:02:37.629 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_enforce_swift_acls": "true", 2023-09-30T17:02:37.629 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_exit_timeout_secs": "120", 2023-09-30T17:02:37.629 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_expose_bucket": "false", 2023-09-30T17:02:37.629 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_extended_http_attrs": "", 2023-09-30T17:02:37.629 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_filter": "none", 2023-09-30T17:02:37.629 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2023-09-30T17:02:37.629 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_frontends": "beast port=7480", 2023-09-30T17:02:37.629 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_gc_max_concurrent_io": "10", 2023-09-30T17:02:37.629 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_gc_max_deferred": "50", 2023-09-30T17:02:37.630 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2023-09-30T17:02:37.630 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_gc_max_objs": "32", 2023-09-30T17:02:37.630 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_gc_max_queue_size": "134213632", 2023-09-30T17:02:37.630 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_gc_max_trim_chunk": "16", 2023-09-30T17:02:37.630 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_gc_obj_min_wait": "7200", 2023-09-30T17:02:37.630 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_gc_processor_max_time": "3600", 2023-09-30T17:02:37.630 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_gc_processor_period": "3600", 2023-09-30T17:02:37.630 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_get_obj_max_req_size": "4194304", 2023-09-30T17:02:37.630 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_get_obj_window_size": "16777216", 2023-09-30T17:02:37.630 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_healthcheck_disabling_path": "", 2023-09-30T17:02:37.630 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_ignore_get_invalid_range": "false", 2023-09-30T17:02:37.631 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_init_timeout": "300", 2023-09-30T17:02:37.631 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2023-09-30T17:02:37.631 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2023-09-30T17:02:37.631 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_accepted_admin_roles": "", 2023-09-30T17:02:37.631 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_accepted_reader_roles": "", 2023-09-30T17:02:37.631 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2023-09-30T17:02:37.631 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_admin_domain": "", 2023-09-30T17:02:37.631 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_admin_password": "", 2023-09-30T17:02:37.631 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_admin_password_path": "", 2023-09-30T17:02:37.631 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_admin_project": "", 2023-09-30T17:02:37.631 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_admin_tenant": "", 2023-09-30T17:02:37.631 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_admin_token": "", 2023-09-30T17:02:37.632 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_admin_token_path": "", 2023-09-30T17:02:37.632 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_admin_user": "", 2023-09-30T17:02:37.632 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_api_version": "2", 2023-09-30T17:02:37.632 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_barbican_domain": "", 2023-09-30T17:02:37.632 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_barbican_password": "", 2023-09-30T17:02:37.632 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_barbican_project": "", 2023-09-30T17:02:37.632 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_barbican_tenant": "", 2023-09-30T17:02:37.632 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_barbican_user": "", 2023-09-30T17:02:37.632 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2023-09-30T17:02:37.632 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_implicit_tenants": "false", 2023-09-30T17:02:37.632 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2023-09-30T17:02:37.633 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_service_token_enabled": "false", 2023-09-30T17:02:37.633 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_token_cache_size": "10000", 2023-09-30T17:02:37.633 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_url": "", 2023-09-30T17:02:37.633 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_keystone_verify_ssl": "true", 2023-09-30T17:02:37.633 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_lc_debug_interval": "-1", 2023-09-30T17:02:37.633 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_lc_lock_max_time": "90", 2023-09-30T17:02:37.633 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_lc_max_objs": "32", 2023-09-30T17:02:37.633 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_lc_max_rules": "1000", 2023-09-30T17:02:37.633 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_lc_max_worker": "3", 2023-09-30T17:02:37.633 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_lc_max_wp_worker": "3", 2023-09-30T17:02:37.633 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_lc_thread_delay": "0", 2023-09-30T17:02:37.634 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2023-09-30T17:02:37.634 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_ldap_dnattr": "uid", 2023-09-30T17:02:37.634 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2023-09-30T17:02:37.634 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_ldap_searchfilter": "", 2023-09-30T17:02:37.634 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2023-09-30T17:02:37.634 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_ldap_uri": "ldaps://", 2023-09-30T17:02:37.634 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2023-09-30T17:02:37.634 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_list_bucket_min_readahead": "1000", 2023-09-30T17:02:37.634 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_list_buckets_max_chunk": "1000", 2023-09-30T17:02:37.634 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_log_http_headers": "", 2023-09-30T17:02:37.634 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_log_nonexistent_bucket": "false", 2023-09-30T17:02:37.634 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2023-09-30T17:02:37.635 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_log_object_name_utc": "false", 2023-09-30T17:02:37.635 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_lua_max_memory_per_state": "128000", 2023-09-30T17:02:37.635 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_luarocks_location": "/tmp/luarocks", 2023-09-30T17:02:37.635 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_max_attr_name_len": "0", 2023-09-30T17:02:37.635 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_max_attr_size": "0", 2023-09-30T17:02:37.635 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_max_attrs_num_in_req": "0", 2023-09-30T17:02:37.635 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_max_chunk_size": "4194304", 2023-09-30T17:02:37.635 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_max_concurrent_requests": "1024", 2023-09-30T17:02:37.635 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2023-09-30T17:02:37.635 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_max_dynamic_shards": "1999", 2023-09-30T17:02:37.635 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_max_listing_results": "1000", 2023-09-30T17:02:37.636 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_max_notify_retries": "10", 2023-09-30T17:02:37.636 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_max_objs_per_shard": "100000", 2023-09-30T17:02:37.636 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_max_put_param_size": "1048576", 2023-09-30T17:02:37.636 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_max_put_size": "5368709120", 2023-09-30T17:02:37.636 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_max_slo_entries": "1000", 2023-09-30T17:02:37.636 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_md_log_max_shards": "64", 2023-09-30T17:02:37.636 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_md_notify_interval_msec": "200", 2023-09-30T17:02:37.636 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_meta_sync_poll_interval": "20", 2023-09-30T17:02:37.636 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_meta_sync_spawn_window": "20", 2023-09-30T17:02:37.636 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_mime_types_file": "/etc/mime.types", 2023-09-30T17:02:37.636 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_mp_lock_max_time": "600", 2023-09-30T17:02:37.636 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_multi_obj_del_max_aio": "16", 2023-09-30T17:02:37.637 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_multipart_min_part_size": "5242880", 2023-09-30T17:02:37.637 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_multipart_part_upload_limit": "10000", 2023-09-30T17:02:37.637 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_nfs_fhcache_partitions": "3", 2023-09-30T17:02:37.637 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_nfs_fhcache_size": "2017", 2023-09-30T17:02:37.637 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_nfs_frontends": "rgw-nfs", 2023-09-30T17:02:37.637 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2023-09-30T17:02:37.637 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_nfs_lru_lanes": "5", 2023-09-30T17:02:37.637 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_nfs_max_gc": "300", 2023-09-30T17:02:37.637 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_nfs_namespace_expire_secs": "300", 2023-09-30T17:02:37.637 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_nfs_run_gc_threads": "false", 2023-09-30T17:02:37.637 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_nfs_run_lc_threads": "false", 2023-09-30T17:02:37.638 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_nfs_run_quota_threads": "false", 2023-09-30T17:02:37.638 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_nfs_run_sync_thread": "false", 2023-09-30T17:02:37.638 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_nfs_s3_fast_attrs": "false", 2023-09-30T17:02:37.638 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_nfs_write_completion_interval_s": "10", 2023-09-30T17:02:37.638 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_num_async_rados_threads": "32", 2023-09-30T17:02:37.638 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_num_control_oids": "8", 2023-09-30T17:02:37.638 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_numa_node": "-1", 2023-09-30T17:02:37.638 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_obj_stripe_size": "4194304", 2023-09-30T17:02:37.638 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_obj_tombstone_cache_size": "1000", 2023-09-30T17:02:37.638 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_objexp_chunk_size": "100", 2023-09-30T17:02:37.638 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_objexp_gc_interval": "600", 2023-09-30T17:02:37.638 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_objexp_hints_num_shards": "127", 2023-09-30T17:02:37.639 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_olh_pending_timeout_sec": "3600", 2023-09-30T17:02:37.639 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_op_thread_suicide_timeout": "0", 2023-09-30T17:02:37.639 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_op_thread_timeout": "600", 2023-09-30T17:02:37.639 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_op_tracing": "false", 2023-09-30T17:02:37.639 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_opa_token": "", 2023-09-30T17:02:37.639 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_opa_url": "", 2023-09-30T17:02:37.639 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_opa_verify_ssl": "true", 2023-09-30T17:02:37.639 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_ops_log_data_backlog": "5242880", 2023-09-30T17:02:37.639 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2023-09-30T17:02:37.639 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_ops_log_rados": "false", 2023-09-30T17:02:37.639 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_ops_log_socket_path": "", 2023-09-30T17:02:37.639 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_override_bucket_index_max_shards": "0", 2023-09-30T17:02:37.640 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2023-09-30T17:02:37.640 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2023-09-30T17:02:37.640 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_period_push_interval": "2.000000", 2023-09-30T17:02:37.640 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_period_push_interval_max": "30.000000", 2023-09-30T17:02:37.640 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_period_root_pool": ".rgw.root", 2023-09-30T17:02:37.640 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_policy_reject_invalid_principals": "true", 2023-09-30T17:02:37.640 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2023-09-30T17:02:37.640 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_posix_cache_lanes": "3", 2023-09-30T17:02:37.640 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_posix_cache_lmdb_count": "3", 2023-09-30T17:02:37.640 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_posix_cache_max_buckets": "100", 2023-09-30T17:02:37.640 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_posix_cache_partitions": "3", 2023-09-30T17:02:37.640 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2023-09-30T17:02:37.641 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_print_continue": "true", 2023-09-30T17:02:37.641 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_print_prohibited_content_length": "false", 2023-09-30T17:02:37.641 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_put_obj_max_window_size": "67108864", 2023-09-30T17:02:37.641 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_put_obj_min_window_size": "16777216", 2023-09-30T17:02:37.641 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2023-09-30T17:02:37.641 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_rados_pool_recovery_priority": "5", 2023-09-30T17:02:37.641 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_rados_tracing": "false", 2023-09-30T17:02:37.641 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_realm": "", 2023-09-30T17:02:37.641 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_realm_id": "", 2023-09-30T17:02:37.641 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_realm_root_pool": ".rgw.root", 2023-09-30T17:02:37.641 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_region": "", 2023-09-30T17:02:37.641 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_region_root_pool": ".rgw.root", 2023-09-30T17:02:37.642 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_relaxed_region_enforcement": "false", 2023-09-30T17:02:37.642 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_relaxed_s3_bucket_names": "false", 2023-09-30T17:02:37.642 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2023-09-30T17:02:37.642 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_request_uri": "", 2023-09-30T17:02:37.642 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_reshard_batch_size": "64", 2023-09-30T17:02:37.642 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_reshard_bucket_lock_duration": "360", 2023-09-30T17:02:37.642 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_reshard_max_aio": "128", 2023-09-30T17:02:37.642 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_reshard_num_logs": "16", 2023-09-30T17:02:37.642 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_reshard_thread_interval": "600", 2023-09-30T17:02:37.642 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_resolve_cname": "false", 2023-09-30T17:02:37.642 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_rest_getusage_op_compat": "false", 2023-09-30T17:02:37.642 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_run_sync_thread": "true", 2023-09-30T17:02:37.643 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_s3_auth_order": "sts, external, local", 2023-09-30T17:02:37.643 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_s3_auth_use_keystone": "false", 2023-09-30T17:02:37.643 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_s3_auth_use_ldap": "false", 2023-09-30T17:02:37.643 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_s3_auth_use_rados": "true", 2023-09-30T17:02:37.643 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_s3_auth_use_sts": "false", 2023-09-30T17:02:37.643 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_s3_client_max_sig_ver": "-1", 2023-09-30T17:02:37.643 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_s3_success_create_obj_status": "0", 2023-09-30T17:02:37.643 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_safe_max_objects_per_shard": "102400", 2023-09-30T17:02:37.643 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_scheduler_type": "throttler", 2023-09-30T17:02:37.643 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_script_uri": "", 2023-09-30T17:02:37.643 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_service_provider_name": "", 2023-09-30T17:02:37.643 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_shard_warning_threshold": "90.000000", 2023-09-30T17:02:37.644 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sts_client_id": "", 2023-09-30T17:02:37.644 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sts_client_secret": "", 2023-09-30T17:02:37.644 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sts_entry": "sts", 2023-09-30T17:02:37.644 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sts_key": "sts", 2023-09-30T17:02:37.644 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sts_max_session_duration": "43200", 2023-09-30T17:02:37.644 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sts_min_session_duration": "900", 2023-09-30T17:02:37.644 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sts_token_introspection_url": "", 2023-09-30T17:02:37.644 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_swift_account_in_url": "false", 2023-09-30T17:02:37.644 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_swift_auth_entry": "auth", 2023-09-30T17:02:37.644 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_swift_auth_url": "", 2023-09-30T17:02:37.644 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_swift_custom_header": "", 2023-09-30T17:02:37.644 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_swift_enforce_content_length": "false", 2023-09-30T17:02:37.645 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_swift_need_stats": "true", 2023-09-30T17:02:37.645 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_swift_tenant_name": "", 2023-09-30T17:02:37.645 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_swift_token_expiration": "86400", 2023-09-30T17:02:37.645 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_swift_url": "", 2023-09-30T17:02:37.645 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_swift_url_prefix": "swift", 2023-09-30T17:02:37.645 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_swift_versioning_enabled": "false", 2023-09-30T17:02:37.645 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2023-09-30T17:02:37.645 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2023-09-30T17:02:37.645 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sync_lease_period": "120", 2023-09-30T17:02:37.645 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2023-09-30T17:02:37.645 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sync_log_trim_interval": "1200", 2023-09-30T17:02:37.646 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sync_log_trim_max_buckets": "16", 2023-09-30T17:02:37.646 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2023-09-30T17:02:37.646 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2023-09-30T17:02:37.646 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sync_obj_etag_verify": "false", 2023-09-30T17:02:37.646 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sync_trace_history_size": "4096", 2023-09-30T17:02:37.646 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sync_trace_per_node_log_size": "32", 2023-09-30T17:02:37.646 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2023-09-30T17:02:37.646 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_thread_pool_size": "512", 2023-09-30T17:02:37.646 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_topic_persistency_max_retries": "0", 2023-09-30T17:02:37.646 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_topic_persistency_sleep_duration": "0", 2023-09-30T17:02:37.646 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_topic_persistency_time_to_live": "0", 2023-09-30T17:02:37.646 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_torrent_comment": "", 2023-09-30T17:02:37.647 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_torrent_createby": "", 2023-09-30T17:02:37.647 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_torrent_encoding": "", 2023-09-30T17:02:37.647 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_torrent_flag": "false", 2023-09-30T17:02:37.647 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_torrent_max_size": "5368709120", 2023-09-30T17:02:37.647 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_torrent_origin": "", 2023-09-30T17:02:37.647 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_torrent_sha_unit": "524288", 2023-09-30T17:02:37.647 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_torrent_tracker": "", 2023-09-30T17:02:37.647 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_trust_forwarded_https": "false", 2023-09-30T17:02:37.647 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_usage_log_flush_threshold": "1024", 2023-09-30T17:02:37.647 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_usage_log_tick_interval": "30", 2023-09-30T17:02:37.647 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_usage_max_shards": "32", 2023-09-30T17:02:37.648 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_usage_max_user_shards": "1", 2023-09-30T17:02:37.648 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_use_opa_authz": "false", 2023-09-30T17:02:37.648 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_user_default_quota_max_objects": "-1", 2023-09-30T17:02:37.648 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_user_default_quota_max_size": "-1", 2023-09-30T17:02:37.648 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_user_max_buckets": "1000", 2023-09-30T17:02:37.648 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_user_policies_max_num": "100", 2023-09-30T17:02:37.648 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2023-09-30T17:02:37.648 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_user_quota_sync_idle_users": "false", 2023-09-30T17:02:37.648 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_user_quota_sync_interval": "86400", 2023-09-30T17:02:37.648 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_user_quota_sync_wait_time": "86400", 2023-09-30T17:02:37.648 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_user_unique_email": "true", 2023-09-30T17:02:37.648 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_verify_ssl": "true", 2023-09-30T17:02:37.649 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_website_routing_rules_max_num": "50", 2023-09-30T17:02:37.649 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_zone": "", 2023-09-30T17:02:37.649 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_zone_id": "", 2023-09-30T17:02:37.649 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_zone_root_pool": ".rgw.root", 2023-09-30T17:02:37.649 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_zonegroup": "", 2023-09-30T17:02:37.649 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_zonegroup_id": "", 2023-09-30T17:02:37.649 INFO:teuthology.orchestra.run.smithi007.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2023-09-30T17:02:37.649 INFO:teuthology.orchestra.run.smithi007.stdout: "rgwlc_auto_session_clear": "true", 2023-09-30T17:02:37.649 INFO:teuthology.orchestra.run.smithi007.stdout: "rgwlc_skip_bucket_step": "false", 2023-09-30T17:02:37.649 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_block_size": "4096", 2023-09-30T17:02:37.649 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_bloom_bits_per_key": "20", 2023-09-30T17:02:37.649 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2023-09-30T17:02:37.650 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2023-09-30T17:02:37.650 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_cache_row_ratio": "0.000000", 2023-09-30T17:02:37.650 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_cache_shard_bits": "4", 2023-09-30T17:02:37.650 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_cache_size": "536870912", 2023-09-30T17:02:37.650 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_cache_type": "binned_lru", 2023-09-30T17:02:37.650 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_cf_compact_on_deletion": "true", 2023-09-30T17:02:37.650 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2023-09-30T17:02:37.650 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2023-09-30T17:02:37.650 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_collect_compaction_stats": "false", 2023-09-30T17:02:37.650 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_collect_extended_stats": "false", 2023-09-30T17:02:37.650 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_collect_memory_stats": "false", 2023-09-30T17:02:37.650 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_delete_range_threshold": "1048576", 2023-09-30T17:02:37.651 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_index_type": "binary_search", 2023-09-30T17:02:37.651 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_log_to_ceph_log": "true", 2023-09-30T17:02:37.651 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_metadata_block_size": "4096", 2023-09-30T17:02:37.651 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_partition_filters": "false", 2023-09-30T17:02:37.651 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_perf": "false", 2023-09-30T17:02:37.651 INFO:teuthology.orchestra.run.smithi007.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2023-09-30T17:02:37.651 INFO:teuthology.orchestra.run.smithi007.stdout: "rotating_keys_bootstrap_timeout": "30", 2023-09-30T17:02:37.651 INFO:teuthology.orchestra.run.smithi007.stdout: "rotating_keys_renewal_timeout": "10", 2023-09-30T17:02:37.651 INFO:teuthology.orchestra.run.smithi007.stdout: "run_dir": "/var/run/ceph", 2023-09-30T17:02:37.651 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_block_create": "true", 2023-09-30T17:02:37.651 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_cache_lru_size": "67108864", 2023-09-30T17:02:37.651 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_cbjournal_size": "5368709120", 2023-09-30T17:02:37.652 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_default_max_object_size": "16777216", 2023-09-30T17:02:37.652 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_default_object_metadata_reservation": "16777216", 2023-09-30T17:02:37.652 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_device_size": "53687091200", 2023-09-30T17:02:37.652 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_journal_batch_capacity": "16", 2023-09-30T17:02:37.652 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_journal_batch_flush_size": "16777216", 2023-09-30T17:02:37.652 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2023-09-30T17:02:37.652 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_journal_iodepth_limit": "5", 2023-09-30T17:02:37.652 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_main_device_type": "SSD", 2023-09-30T17:02:37.652 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_max_concurrent_transactions": "8", 2023-09-30T17:02:37.652 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2023-09-30T17:02:37.652 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2023-09-30T17:02:37.653 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2023-09-30T17:02:37.653 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_obj_data_write_amplification": "1.250000", 2023-09-30T17:02:37.653 INFO:teuthology.orchestra.run.smithi007.stdout: "seastore_segment_size": "67108864", 2023-09-30T17:02:37.653 INFO:teuthology.orchestra.run.smithi007.stdout: "set_keepcaps": "false", 2023-09-30T17:02:37.653 INFO:teuthology.orchestra.run.smithi007.stdout: "setgroup": "", 2023-09-30T17:02:37.653 INFO:teuthology.orchestra.run.smithi007.stdout: "setuser": "", 2023-09-30T17:02:37.653 INFO:teuthology.orchestra.run.smithi007.stdout: "setuser_match_path": "", 2023-09-30T17:02:37.653 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_misplaced_ratio": "0.050000", 2023-09-30T17:02:37.653 INFO:teuthology.orchestra.run.smithi007.stdout: "thp": "false", 2023-09-30T17:02:37.653 INFO:teuthology.orchestra.run.smithi007.stdout: "threadpool_default_timeout": "60", 2023-09-30T17:02:37.653 INFO:teuthology.orchestra.run.smithi007.stdout: "threadpool_empty_queue_max_wait": "2", 2023-09-30T17:02:37.653 INFO:teuthology.orchestra.run.smithi007.stdout: "throttler_perf_counter": "true" 2023-09-30T17:02:37.654 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-09-30T17:02:37.656 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2023-09-30T17:02:37.795 INFO:teuthology.orchestra.run.smithi007.stdout:mon.a: {} 2023-09-30T17:02:37.805 INFO:teuthology.orchestra.run.smithi007.stdout:mon.b: {} 2023-09-30T17:02:37.815 INFO:teuthology.orchestra.run.smithi007.stdout:mon.c: {} 2023-09-30T17:02:37.816 INFO:teuthology.orchestra.run.smithi007.stderr:mon.a: mon_osd_down_out_interval = '0' (not observed, change may require restart) 2023-09-30T17:02:37.816 INFO:teuthology.orchestra.run.smithi007.stderr:mon.b: mon_osd_down_out_interval = '0' (not observed, change may require restart) 2023-09-30T17:02:37.816 INFO:teuthology.orchestra.run.smithi007.stderr:mon.c: mon_osd_down_out_interval = '0' (not observed, change may require restart) 2023-09-30T17:02:37.827 INFO:tasks.thrashosds.thrasher:Unable to test ceph-objectstore-tool, powercycle testing 2023-09-30T17:02:37.827 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-09-30T17:02:37.852 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-09-30T17:02:37.852 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2023-09-30T17:02:37.853 INFO:tasks.ceph_fuse:client.0 config is {} 2023-09-30T17:02:37.853 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-09-30T17:02:37.853 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-30T17:02:37.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T17:02:37.853 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2023-09-30T17:02:37.854 INFO:tasks.thrashosds.thrasher:starting do_thrash 2023-09-30T17:02:37.854 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-09-30T17:02:37.854 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-09-30T17:02:37.854 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2023-09-30T17:02:37.854 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2023-09-30T17:02:37.855 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2023-09-30T17:02:37.855 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2023-09-30T17:02:37.855 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-09-30T17:02:37.855 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2023-09-30T17:02:37.856 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:02:37.856 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2023-09-30T17:02:37.856 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-09-30T17:02:37.858 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:37.857+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:37.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T17:02:37.877 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link delete ceph-brx 2023-09-30T17:02:37.948 INFO:teuthology.orchestra.run.smithi007.stderr:Cannot find device "ceph-brx" 2023-09-30T17:02:37.949 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T17:02:37.950 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-09-30T17:02:37.950 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-09-30T17:02:37.956 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:37.957+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:38.003 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:02:38.003 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:02:38.003 INFO:teuthology.orchestra.run.smithi031.stdout: "num_ops": 0 2023-09-30T17:02:38.003 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:02:38.014 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:02:38.027 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:02:38.048 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:02:38.057 INFO:tasks.ceph.osd.2.smithi134.stderr:2023-09-30T17:02:38.057+0000 7efd10b20700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 96961) UID: 0 2023-09-30T17:02:38.069 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-09-30T17:02:38.070 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-09-30T17:02:38.071 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-09-30T17:02:38.071 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-09-30T17:02:38.146 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:38.146 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:38.156 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:02:38.158 INFO:tasks.ceph.osd.2.smithi134.stderr:2023-09-30T17:02:38.158+0000 7efd10b20700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 96961) UID: 0 2023-09-30T17:02:38.212 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:02:38.212 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-09-30T17:02:38.212 INFO:teuthology.orchestra.run.smithi007.stdout: "epoch": 19, 2023-09-30T17:02:38.212 INFO:teuthology.orchestra.run.smithi007.stdout: "fsid": "68daccc3-6ea9-4db7-9771-3803ff202df8", 2023-09-30T17:02:38.212 INFO:teuthology.orchestra.run.smithi007.stdout: "created": "2023-09-30T17:01:55.306262+0000", 2023-09-30T17:02:38.212 INFO:teuthology.orchestra.run.smithi007.stdout: "modified": "2023-09-30T17:02:19.350385+0000", 2023-09-30T17:02:38.212 INFO:teuthology.orchestra.run.smithi007.stdout: "last_up_change": "2023-09-30T17:02:04.210987+0000", 2023-09-30T17:02:38.212 INFO:teuthology.orchestra.run.smithi007.stdout: "last_in_change": "2023-09-30T17:01:56.571968+0000", 2023-09-30T17:02:38.213 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-30T17:02:38.213 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_num": 5799936, 2023-09-30T17:02:38.213 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_set": [ 2023-09-30T17:02:38.213 INFO:teuthology.orchestra.run.smithi007.stdout: "pglog_hardlimit", 2023-09-30T17:02:38.213 INFO:teuthology.orchestra.run.smithi007.stdout: "purged_snapdirs", 2023-09-30T17:02:38.213 INFO:teuthology.orchestra.run.smithi007.stdout: "recovery_deletes", 2023-09-30T17:02:38.213 INFO:teuthology.orchestra.run.smithi007.stdout: "sortbitwise" 2023-09-30T17:02:38.213 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-09-30T17:02:38.213 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_version": 4, 2023-09-30T17:02:38.213 INFO:teuthology.orchestra.run.smithi007.stdout: "full_ratio": 0.94999998807907104, 2023-09-30T17:02:38.213 INFO:teuthology.orchestra.run.smithi007.stdout: "backfillfull_ratio": 0.89999997615814209, 2023-09-30T17:02:38.214 INFO:teuthology.orchestra.run.smithi007.stdout: "nearfull_ratio": 0.85000002384185791, 2023-09-30T17:02:38.214 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_snapshot": "", 2023-09-30T17:02:38.214 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_max": 4, 2023-09-30T17:02:38.214 INFO:teuthology.orchestra.run.smithi007.stdout: "max_osd": 3, 2023-09-30T17:02:38.214 INFO:teuthology.orchestra.run.smithi007.stdout: "require_min_compat_client": "luminous", 2023-09-30T17:02:38.214 INFO:teuthology.orchestra.run.smithi007.stdout: "min_compat_client": "jewel", 2023-09-30T17:02:38.214 INFO:teuthology.orchestra.run.smithi007.stdout: "require_osd_release": "reef", 2023-09-30T17:02:38.214 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_crimson": false, 2023-09-30T17:02:38.214 INFO:teuthology.orchestra.run.smithi007.stdout: "pools": [ 2023-09-30T17:02:38.214 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:02:38.214 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 1, 2023-09-30T17:02:38.215 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": ".mgr", 2023-09-30T17:02:38.215 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-09-30T17:02:05.343048+0000", 2023-09-30T17:02:38.215 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2023-09-30T17:02:38.215 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool", 2023-09-30T17:02:38.215 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-09-30T17:02:38.215 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-09-30T17:02:38.215 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-09-30T17:02:38.215 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-09-30T17:02:38.215 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-09-30T17:02:38.215 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-09-30T17:02:38.215 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T17:02:38.216 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T17:02:38.216 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-09-30T17:02:38.216 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-09-30T17:02:38.216 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 1, 2023-09-30T17:02:38.216 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 1, 2023-09-30T17:02:38.216 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 1, 2023-09-30T17:02:38.216 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 1, 2023-09-30T17:02:38.216 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 1, 2023-09-30T17:02:38.216 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-09-30T17:02:38.216 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-09-30T17:02:38.216 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-09-30T17:02:38.216 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-09-30T17:02:38.217 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-09-30T17:02:38.217 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-09-30T17:02:38.217 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-09-30T17:02:38.217 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:38.217 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "12", 2023-09-30T17:02:38.217 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-09-30T17:02:38.217 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T17:02:38.217 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T17:02:38.217 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-09-30T17:02:38.217 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-09-30T17:02:38.217 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 0, 2023-09-30T17:02:38.218 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 0, 2023-09-30T17:02:38.218 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-09-30T17:02:38.218 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-09-30T17:02:38.218 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-09-30T17:02:38.218 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-09-30T17:02:38.218 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-09-30T17:02:38.218 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-09-30T17:02:38.218 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-09-30T17:02:38.218 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-09-30T17:02:38.218 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-09-30T17:02:38.218 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-09-30T17:02:38.218 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-09-30T17:02:38.219 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T17:02:38.219 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T17:02:38.219 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T17:02:38.219 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-09-30T17:02:38.219 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-09-30T17:02:38.219 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-09-30T17:02:38.219 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-09-30T17:02:38.219 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-09-30T17:02:38.219 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:38.219 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-09-30T17:02:38.219 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-09-30T17:02:38.220 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-09-30T17:02:38.220 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-09-30T17:02:38.220 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-09-30T17:02:38.220 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T17:02:38.220 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-09-30T17:02:38.220 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-09-30T17:02:38.220 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-09-30T17:02:38.220 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-09-30T17:02:38.220 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-09-30T17:02:38.220 INFO:teuthology.orchestra.run.smithi007.stdout: "options": { 2023-09-30T17:02:38.220 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_max": 32, 2023-09-30T17:02:38.220 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_min": 1 2023-09-30T17:02:38.221 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:38.221 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-09-30T17:02:38.221 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": {} 2023-09-30T17:02:38.221 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:38.221 INFO:teuthology.orchestra.run.smithi007.stdout: "read_balance": { 2023-09-30T17:02:38.221 INFO:teuthology.orchestra.run.smithi007.stdout: "score_acting": 2.9900000095367432, 2023-09-30T17:02:38.221 INFO:teuthology.orchestra.run.smithi007.stdout: "score_stable": 2.9900000095367432, 2023-09-30T17:02:38.221 INFO:teuthology.orchestra.run.smithi007.stdout: "optimal_score": 0.67000001668930054, 2023-09-30T17:02:38.221 INFO:teuthology.orchestra.run.smithi007.stdout: "raw_score_acting": 2, 2023-09-30T17:02:38.221 INFO:teuthology.orchestra.run.smithi007.stdout: "raw_score_stable": 2, 2023-09-30T17:02:38.222 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity_weighted": 1, 2023-09-30T17:02:38.222 INFO:teuthology.orchestra.run.smithi007.stdout: "average_primary_affinity": 1, 2023-09-30T17:02:38.222 INFO:teuthology.orchestra.run.smithi007.stdout: "average_primary_affinity_weighted": 1 2023-09-30T17:02:38.222 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-09-30T17:02:38.222 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:38.222 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:02:38.222 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 2, 2023-09-30T17:02:38.222 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "rbd", 2023-09-30T17:02:38.222 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-09-30T17:02:11.033979+0000", 2023-09-30T17:02:38.223 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2023-09-30T17:02:38.223 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool", 2023-09-30T17:02:38.223 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-09-30T17:02:38.223 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-09-30T17:02:38.223 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-09-30T17:02:38.223 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-09-30T17:02:38.223 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-09-30T17:02:38.223 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-09-30T17:02:38.223 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T17:02:38.223 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T17:02:38.223 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-09-30T17:02:38.223 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-09-30T17:02:38.224 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 8, 2023-09-30T17:02:38.224 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 8, 2023-09-30T17:02:38.224 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 8, 2023-09-30T17:02:38.224 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 8, 2023-09-30T17:02:38.224 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 8, 2023-09-30T17:02:38.224 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-09-30T17:02:38.224 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-09-30T17:02:38.224 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-09-30T17:02:38.224 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-09-30T17:02:38.224 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-09-30T17:02:38.224 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-09-30T17:02:38.224 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-09-30T17:02:38.225 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:38.225 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "15", 2023-09-30T17:02:38.225 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-09-30T17:02:38.225 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T17:02:38.225 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T17:02:38.225 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-09-30T17:02:38.225 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-09-30T17:02:38.225 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 0, 2023-09-30T17:02:38.225 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 0, 2023-09-30T17:02:38.225 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-09-30T17:02:38.225 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-09-30T17:02:38.226 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-09-30T17:02:38.226 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-09-30T17:02:38.226 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-09-30T17:02:38.226 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-09-30T17:02:38.226 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-09-30T17:02:38.226 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-09-30T17:02:38.226 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-09-30T17:02:38.226 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-09-30T17:02:38.226 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-09-30T17:02:38.226 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T17:02:38.226 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T17:02:38.226 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T17:02:38.227 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-09-30T17:02:38.227 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-09-30T17:02:38.227 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-09-30T17:02:38.227 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-09-30T17:02:38.227 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-09-30T17:02:38.227 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:38.227 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-09-30T17:02:38.227 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-09-30T17:02:38.227 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-09-30T17:02:38.227 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-09-30T17:02:38.227 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-09-30T17:02:38.228 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T17:02:38.228 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-09-30T17:02:38.228 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-09-30T17:02:38.228 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-09-30T17:02:38.228 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-09-30T17:02:38.228 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-09-30T17:02:38.228 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-09-30T17:02:38.228 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-09-30T17:02:38.228 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd": {} 2023-09-30T17:02:38.228 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:38.228 INFO:teuthology.orchestra.run.smithi007.stdout: "read_balance": { 2023-09-30T17:02:38.228 INFO:teuthology.orchestra.run.smithi007.stdout: "score_acting": 1.5, 2023-09-30T17:02:38.229 INFO:teuthology.orchestra.run.smithi007.stdout: "score_stable": 1.5, 2023-09-30T17:02:38.229 INFO:teuthology.orchestra.run.smithi007.stdout: "optimal_score": 1, 2023-09-30T17:02:38.229 INFO:teuthology.orchestra.run.smithi007.stdout: "raw_score_acting": 1.5, 2023-09-30T17:02:38.229 INFO:teuthology.orchestra.run.smithi007.stdout: "raw_score_stable": 1.5, 2023-09-30T17:02:38.229 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity_weighted": 1, 2023-09-30T17:02:38.229 INFO:teuthology.orchestra.run.smithi007.stdout: "average_primary_affinity": 1, 2023-09-30T17:02:38.229 INFO:teuthology.orchestra.run.smithi007.stdout: "average_primary_affinity_weighted": 1 2023-09-30T17:02:38.229 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-09-30T17:02:38.229 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:38.229 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:02:38.229 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 3, 2023-09-30T17:02:38.230 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "cephfs_metadata", 2023-09-30T17:02:38.230 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-09-30T17:02:15.583451+0000", 2023-09-30T17:02:38.230 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2023-09-30T17:02:38.230 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool", 2023-09-30T17:02:38.230 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-09-30T17:02:38.230 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-09-30T17:02:38.230 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-09-30T17:02:38.230 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-09-30T17:02:38.230 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-09-30T17:02:38.230 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-09-30T17:02:38.230 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T17:02:38.230 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T17:02:38.231 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-09-30T17:02:38.231 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-09-30T17:02:38.231 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 32, 2023-09-30T17:02:38.231 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 32, 2023-09-30T17:02:38.231 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 32, 2023-09-30T17:02:38.231 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 32, 2023-09-30T17:02:38.231 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 32, 2023-09-30T17:02:38.231 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-09-30T17:02:38.231 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-09-30T17:02:38.231 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-09-30T17:02:38.231 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-09-30T17:02:38.231 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-09-30T17:02:38.232 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-09-30T17:02:38.232 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-09-30T17:02:38.232 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:38.232 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "18", 2023-09-30T17:02:38.232 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-09-30T17:02:38.232 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T17:02:38.232 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T17:02:38.232 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-09-30T17:02:38.232 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-09-30T17:02:38.232 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 0, 2023-09-30T17:02:38.232 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 0, 2023-09-30T17:02:38.233 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-09-30T17:02:38.233 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-09-30T17:02:38.233 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-09-30T17:02:38.233 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-09-30T17:02:38.233 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-09-30T17:02:38.233 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-09-30T17:02:38.233 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-09-30T17:02:38.233 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-09-30T17:02:38.233 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-09-30T17:02:38.233 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-09-30T17:02:38.233 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-09-30T17:02:38.233 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T17:02:38.234 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T17:02:38.234 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T17:02:38.234 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-09-30T17:02:38.234 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-09-30T17:02:38.234 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-09-30T17:02:38.234 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-09-30T17:02:38.234 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-09-30T17:02:38.234 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:38.234 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-09-30T17:02:38.234 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-09-30T17:02:38.234 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-09-30T17:02:38.235 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-09-30T17:02:38.235 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-09-30T17:02:38.235 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T17:02:38.235 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-09-30T17:02:38.235 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-09-30T17:02:38.235 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-09-30T17:02:38.235 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-09-30T17:02:38.235 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-09-30T17:02:38.235 INFO:teuthology.orchestra.run.smithi007.stdout: "options": { 2023-09-30T17:02:38.235 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_bias": 4, 2023-09-30T17:02:38.235 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_min": 16, 2023-09-30T17:02:38.235 INFO:teuthology.orchestra.run.smithi007.stdout: "recovery_priority": 5 2023-09-30T17:02:38.236 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:38.236 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-09-30T17:02:38.236 INFO:teuthology.orchestra.run.smithi007.stdout: "cephfs": { 2023-09-30T17:02:38.236 INFO:teuthology.orchestra.run.smithi007.stdout: "metadata": "cephfs" 2023-09-30T17:02:38.236 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-09-30T17:02:38.236 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:38.236 INFO:teuthology.orchestra.run.smithi007.stdout: "read_balance": { 2023-09-30T17:02:38.236 INFO:teuthology.orchestra.run.smithi007.stdout: "score_acting": 1.1299999952316284, 2023-09-30T17:02:38.236 INFO:teuthology.orchestra.run.smithi007.stdout: "score_stable": 1.1299999952316284, 2023-09-30T17:02:38.236 INFO:teuthology.orchestra.run.smithi007.stdout: "optimal_score": 1, 2023-09-30T17:02:38.236 INFO:teuthology.orchestra.run.smithi007.stdout: "raw_score_acting": 1.1299999952316284, 2023-09-30T17:02:38.237 INFO:teuthology.orchestra.run.smithi007.stdout: "raw_score_stable": 1.1299999952316284, 2023-09-30T17:02:38.237 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity_weighted": 1, 2023-09-30T17:02:38.237 INFO:teuthology.orchestra.run.smithi007.stdout: "average_primary_affinity": 1, 2023-09-30T17:02:38.237 INFO:teuthology.orchestra.run.smithi007.stdout: "average_primary_affinity_weighted": 1 2023-09-30T17:02:38.237 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-09-30T17:02:38.237 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:38.237 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:02:38.237 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 4, 2023-09-30T17:02:38.237 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "cephfs_data", 2023-09-30T17:02:38.237 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-09-30T17:02:16.734427+0000", 2023-09-30T17:02:38.237 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2023-09-30T17:02:38.237 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool", 2023-09-30T17:02:38.238 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-09-30T17:02:38.238 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-09-30T17:02:38.238 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-09-30T17:02:38.238 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-09-30T17:02:38.238 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-09-30T17:02:38.238 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-09-30T17:02:38.238 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T17:02:38.238 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T17:02:38.238 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-09-30T17:02:38.238 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-09-30T17:02:38.238 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 64, 2023-09-30T17:02:38.239 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 64, 2023-09-30T17:02:38.239 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 64, 2023-09-30T17:02:38.239 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 64, 2023-09-30T17:02:38.239 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 64, 2023-09-30T17:02:38.239 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-09-30T17:02:38.239 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-09-30T17:02:38.239 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-09-30T17:02:38.239 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-09-30T17:02:38.239 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-09-30T17:02:38.239 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-09-30T17:02:38.239 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-09-30T17:02:38.239 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:38.240 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "19", 2023-09-30T17:02:38.240 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-09-30T17:02:38.240 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T17:02:38.240 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T17:02:38.240 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-09-30T17:02:38.240 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-09-30T17:02:38.240 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 0, 2023-09-30T17:02:38.240 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 0, 2023-09-30T17:02:38.240 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-09-30T17:02:38.240 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-09-30T17:02:38.240 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-09-30T17:02:38.240 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-09-30T17:02:38.240 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-09-30T17:02:38.241 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-09-30T17:02:38.241 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-09-30T17:02:38.241 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-09-30T17:02:38.241 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-09-30T17:02:38.241 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-09-30T17:02:38.241 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-09-30T17:02:38.241 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T17:02:38.241 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T17:02:38.241 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T17:02:38.241 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-09-30T17:02:38.241 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-09-30T17:02:38.241 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-09-30T17:02:38.242 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-09-30T17:02:38.242 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-09-30T17:02:38.242 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:38.242 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-09-30T17:02:38.242 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-09-30T17:02:38.242 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-09-30T17:02:38.242 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-09-30T17:02:38.242 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-09-30T17:02:38.242 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T17:02:38.242 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-09-30T17:02:38.242 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-09-30T17:02:38.243 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-09-30T17:02:38.243 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-09-30T17:02:38.243 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-09-30T17:02:38.243 INFO:teuthology.orchestra.run.smithi007.stdout: "options": { 2023-09-30T17:02:38.243 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_min": 64, 2023-09-30T17:02:38.243 INFO:teuthology.orchestra.run.smithi007.stdout: "target_size_ratio": 0.89999997615814209 2023-09-30T17:02:38.243 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:38.243 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-09-30T17:02:38.243 INFO:teuthology.orchestra.run.smithi007.stdout: "cephfs": { 2023-09-30T17:02:38.243 INFO:teuthology.orchestra.run.smithi007.stdout: "data": "cephfs" 2023-09-30T17:02:38.243 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-09-30T17:02:38.244 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:38.244 INFO:teuthology.orchestra.run.smithi007.stdout: "read_balance": { 2023-09-30T17:02:38.244 INFO:teuthology.orchestra.run.smithi007.stdout: "score_acting": 1.1299999952316284, 2023-09-30T17:02:38.244 INFO:teuthology.orchestra.run.smithi007.stdout: "score_stable": 1.1299999952316284, 2023-09-30T17:02:38.244 INFO:teuthology.orchestra.run.smithi007.stdout: "optimal_score": 1, 2023-09-30T17:02:38.244 INFO:teuthology.orchestra.run.smithi007.stdout: "raw_score_acting": 1.1299999952316284, 2023-09-30T17:02:38.244 INFO:teuthology.orchestra.run.smithi007.stdout: "raw_score_stable": 1.1299999952316284, 2023-09-30T17:02:38.244 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity_weighted": 1, 2023-09-30T17:02:38.244 INFO:teuthology.orchestra.run.smithi007.stdout: "average_primary_affinity": 1, 2023-09-30T17:02:38.244 INFO:teuthology.orchestra.run.smithi007.stdout: "average_primary_affinity_weighted": 1 2023-09-30T17:02:38.244 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-09-30T17:02:38.245 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-09-30T17:02:38.245 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-09-30T17:02:38.245 INFO:teuthology.orchestra.run.smithi007.stdout: "osds": [ 2023-09-30T17:02:38.245 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:02:38.245 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 0, 2023-09-30T17:02:38.245 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "a9d1653a-8830-4fad-911b-8e7221ee8697", 2023-09-30T17:02:38.245 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-09-30T17:02:38.245 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 1, 2023-09-30T17:02:38.245 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 1, 2023-09-30T17:02:38.245 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 1, 2023-09-30T17:02:38.245 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-09-30T17:02:38.245 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-09-30T17:02:38.246 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 8, 2023-09-30T17:02:38.246 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 17, 2023-09-30T17:02:38.246 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-09-30T17:02:38.246 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-09-30T17:02:38.246 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-09-30T17:02:38.246 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-09-30T17:02:38.246 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:02:38.246 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-09-30T17:02:38.246 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.31:6800", 2023-09-30T17:02:38.246 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 2212861041 2023-09-30T17:02:38.246 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:38.247 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:02:38.247 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-09-30T17:02:38.247 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.31:6801", 2023-09-30T17:02:38.247 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 2212861041 2023-09-30T17:02:38.247 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-09-30T17:02:38.247 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-09-30T17:02:38.247 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:38.247 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-09-30T17:02:38.247 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-09-30T17:02:38.247 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:02:38.247 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-09-30T17:02:38.247 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.31:6802", 2023-09-30T17:02:38.248 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 2212861041 2023-09-30T17:02:38.248 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:38.248 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:02:38.248 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-09-30T17:02:38.248 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.31:6803", 2023-09-30T17:02:38.248 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 2212861041 2023-09-30T17:02:38.248 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-09-30T17:02:38.248 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-09-30T17:02:38.248 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:38.248 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-09-30T17:02:38.248 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-09-30T17:02:38.249 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:02:38.249 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-09-30T17:02:38.249 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.31:6806", 2023-09-30T17:02:38.249 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 2212861041 2023-09-30T17:02:38.249 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:38.249 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:02:38.249 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-09-30T17:02:38.249 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.31:6807", 2023-09-30T17:02:38.249 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 2212861041 2023-09-30T17:02:38.249 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-09-30T17:02:38.249 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-09-30T17:02:38.250 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:38.250 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-09-30T17:02:38.250 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-09-30T17:02:38.250 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:02:38.250 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-09-30T17:02:38.250 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.31:6804", 2023-09-30T17:02:38.250 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 2212861041 2023-09-30T17:02:38.250 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:38.250 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:02:38.250 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-09-30T17:02:38.250 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.31:6805", 2023-09-30T17:02:38.251 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 2212861041 2023-09-30T17:02:38.251 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-09-30T17:02:38.251 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-09-30T17:02:38.251 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:38.251 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.31:6801/2212861041", 2023-09-30T17:02:38.251 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.31:6803/2212861041", 2023-09-30T17:02:38.251 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.31:6807/2212861041", 2023-09-30T17:02:38.251 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.31:6805/2212861041", 2023-09-30T17:02:38.251 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-09-30T17:02:38.251 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-09-30T17:02:38.251 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-09-30T17:02:38.252 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-09-30T17:02:38.252 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:38.252 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:02:38.252 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 1, 2023-09-30T17:02:38.252 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "7123aa56-aa1a-43a4-b154-a40b4c70d169", 2023-09-30T17:02:38.252 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-09-30T17:02:38.252 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 1, 2023-09-30T17:02:38.252 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 1, 2023-09-30T17:02:38.252 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 1, 2023-09-30T17:02:38.252 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-09-30T17:02:38.252 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-09-30T17:02:38.253 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 8, 2023-09-30T17:02:38.253 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 17, 2023-09-30T17:02:38.253 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-09-30T17:02:38.253 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-09-30T17:02:38.253 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-09-30T17:02:38.253 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-09-30T17:02:38.253 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:02:38.253 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-09-30T17:02:38.253 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.72:6800", 2023-09-30T17:02:38.253 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1680420094 2023-09-30T17:02:38.253 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:38.253 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:02:38.254 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-09-30T17:02:38.254 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.72:6801", 2023-09-30T17:02:38.254 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1680420094 2023-09-30T17:02:38.254 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-09-30T17:02:38.254 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-09-30T17:02:38.254 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:38.254 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-09-30T17:02:38.254 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-09-30T17:02:38.254 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:02:38.254 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-09-30T17:02:38.254 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.72:6802", 2023-09-30T17:02:38.255 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1680420094 2023-09-30T17:02:38.255 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:38.255 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:02:38.255 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-09-30T17:02:38.255 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.72:6803", 2023-09-30T17:02:38.255 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1680420094 2023-09-30T17:02:38.255 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-09-30T17:02:38.255 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-09-30T17:02:38.255 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:38.255 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-09-30T17:02:38.255 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-09-30T17:02:38.255 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:02:38.256 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-09-30T17:02:38.256 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.72:6806", 2023-09-30T17:02:38.256 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1680420094 2023-09-30T17:02:38.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:38.256 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:02:38.256 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-09-30T17:02:38.256 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.72:6807", 2023-09-30T17:02:38.256 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1680420094 2023-09-30T17:02:38.256 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-09-30T17:02:38.256 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-09-30T17:02:38.256 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:38.257 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-09-30T17:02:38.257 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-09-30T17:02:38.257 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:02:38.257 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-09-30T17:02:38.257 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.72:6804", 2023-09-30T17:02:38.257 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1680420094 2023-09-30T17:02:38.257 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:38.257 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:02:38.257 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-09-30T17:02:38.257 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.72:6805", 2023-09-30T17:02:38.257 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1680420094 2023-09-30T17:02:38.257 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-09-30T17:02:38.258 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-09-30T17:02:38.258 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:38.258 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.72:6801/1680420094", 2023-09-30T17:02:38.258 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.72:6803/1680420094", 2023-09-30T17:02:38.258 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.72:6807/1680420094", 2023-09-30T17:02:38.258 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.72:6805/1680420094", 2023-09-30T17:02:38.258 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-09-30T17:02:38.258 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-09-30T17:02:38.258 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-09-30T17:02:38.258 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-09-30T17:02:38.258 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:38.258 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:02:38.259 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 2, 2023-09-30T17:02:38.259 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "f40ee0d7-7bc3-4a46-bdac-9c134c55c907", 2023-09-30T17:02:38.259 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-09-30T17:02:38.259 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 1, 2023-09-30T17:02:38.259 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 1, 2023-09-30T17:02:38.259 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 1, 2023-09-30T17:02:38.259 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-09-30T17:02:38.259 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-09-30T17:02:38.259 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 8, 2023-09-30T17:02:38.259 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 17, 2023-09-30T17:02:38.259 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-09-30T17:02:38.260 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-09-30T17:02:38.260 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-09-30T17:02:38.260 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-09-30T17:02:38.260 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:02:38.260 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-09-30T17:02:38.260 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.134:6800", 2023-09-30T17:02:38.260 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1018866543 2023-09-30T17:02:38.260 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:38.260 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:02:38.260 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-09-30T17:02:38.260 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.134:6801", 2023-09-30T17:02:38.260 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1018866543 2023-09-30T17:02:38.261 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-09-30T17:02:38.261 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-09-30T17:02:38.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:38.261 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-09-30T17:02:38.261 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-09-30T17:02:38.261 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:02:38.261 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-09-30T17:02:38.261 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.134:6802", 2023-09-30T17:02:38.261 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1018866543 2023-09-30T17:02:38.261 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:38.261 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:02:38.262 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-09-30T17:02:38.262 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.134:6803", 2023-09-30T17:02:38.262 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1018866543 2023-09-30T17:02:38.262 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-09-30T17:02:38.262 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-09-30T17:02:38.262 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:38.262 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-09-30T17:02:38.262 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-09-30T17:02:38.262 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:02:38.262 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-09-30T17:02:38.262 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.134:6806", 2023-09-30T17:02:38.262 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1018866543 2023-09-30T17:02:38.263 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:38.263 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:02:38.263 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-09-30T17:02:38.263 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.134:6807", 2023-09-30T17:02:38.263 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1018866543 2023-09-30T17:02:38.263 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-09-30T17:02:38.263 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-09-30T17:02:38.263 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:38.263 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-09-30T17:02:38.263 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-09-30T17:02:38.263 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:02:38.263 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-09-30T17:02:38.264 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.134:6804", 2023-09-30T17:02:38.264 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1018866543 2023-09-30T17:02:38.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:38.264 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:02:38.264 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-09-30T17:02:38.264 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.134:6805", 2023-09-30T17:02:38.264 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1018866543 2023-09-30T17:02:38.264 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-09-30T17:02:38.264 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-09-30T17:02:38.264 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:38.264 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.134:6801/1018866543", 2023-09-30T17:02:38.264 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.134:6803/1018866543", 2023-09-30T17:02:38.265 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.134:6807/1018866543", 2023-09-30T17:02:38.265 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.134:6805/1018866543", 2023-09-30T17:02:38.265 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-09-30T17:02:38.265 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-09-30T17:02:38.265 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-09-30T17:02:38.265 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-09-30T17:02:38.265 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-09-30T17:02:38.265 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-09-30T17:02:38.265 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_xinfo": [ 2023-09-30T17:02:38.265 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:02:38.265 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 0, 2023-09-30T17:02:38.265 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-09-30T17:02:38.266 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-09-30T17:02:38.266 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-09-30T17:02:38.266 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138322906710015, 2023-09-30T17:02:38.266 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 0, 2023-09-30T17:02:38.266 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-09-30T17:02:01.702754+0000", 2023-09-30T17:02:38.266 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-09-30T17:02:38.266 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:38.266 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:02:38.266 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 1, 2023-09-30T17:02:38.266 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-09-30T17:02:38.266 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-09-30T17:02:38.267 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-09-30T17:02:38.267 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138322906710015, 2023-09-30T17:02:38.267 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 0, 2023-09-30T17:02:38.267 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-09-30T17:02:01.688791+0000", 2023-09-30T17:02:38.267 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-09-30T17:02:38.267 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:38.267 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:02:38.267 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 2, 2023-09-30T17:02:38.267 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-09-30T17:02:38.267 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-09-30T17:02:38.267 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-09-30T17:02:38.268 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138322906710015, 2023-09-30T17:02:38.268 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 0, 2023-09-30T17:02:38.268 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-09-30T17:02:01.667971+0000", 2023-09-30T17:02:38.268 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-09-30T17:02:38.268 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-09-30T17:02:38.268 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-09-30T17:02:38.268 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_upmap": [], 2023-09-30T17:02:38.268 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_upmap_items": [], 2023-09-30T17:02:38.268 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_upmap_primaries": [], 2023-09-30T17:02:38.268 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_temp": [], 2023-09-30T17:02:38.268 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_temp": [], 2023-09-30T17:02:38.268 INFO:teuthology.orchestra.run.smithi007.stdout: "blocklist": {}, 2023-09-30T17:02:38.269 INFO:teuthology.orchestra.run.smithi007.stdout: "range_blocklist": {}, 2023-09-30T17:02:38.269 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profiles": { 2023-09-30T17:02:38.269 INFO:teuthology.orchestra.run.smithi007.stdout: "default": { 2023-09-30T17:02:38.269 INFO:teuthology.orchestra.run.smithi007.stdout: "crush-failure-domain": "osd", 2023-09-30T17:02:38.269 INFO:teuthology.orchestra.run.smithi007.stdout: "k": "2", 2023-09-30T17:02:38.269 INFO:teuthology.orchestra.run.smithi007.stdout: "m": "1", 2023-09-30T17:02:38.269 INFO:teuthology.orchestra.run.smithi007.stdout: "plugin": "jerasure", 2023-09-30T17:02:38.269 INFO:teuthology.orchestra.run.smithi007.stdout: "technique": "reed_sol_van" 2023-09-30T17:02:38.269 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-09-30T17:02:38.269 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:38.269 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps_queue": [], 2023-09-30T17:02:38.269 INFO:teuthology.orchestra.run.smithi007.stdout: "new_removed_snaps": [], 2023-09-30T17:02:38.270 INFO:teuthology.orchestra.run.smithi007.stdout: "new_purged_snaps": [], 2023-09-30T17:02:38.270 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_node_flags": {}, 2023-09-30T17:02:38.270 INFO:teuthology.orchestra.run.smithi007.stdout: "device_class_flags": {}, 2023-09-30T17:02:38.270 INFO:teuthology.orchestra.run.smithi007.stdout: "stretch_mode": { 2023-09-30T17:02:38.270 INFO:teuthology.orchestra.run.smithi007.stdout: "stretch_mode_enabled": false, 2023-09-30T17:02:38.270 INFO:teuthology.orchestra.run.smithi007.stdout: "stretch_bucket_count": 0, 2023-09-30T17:02:38.270 INFO:teuthology.orchestra.run.smithi007.stdout: "degraded_stretch_mode": 0, 2023-09-30T17:02:38.270 INFO:teuthology.orchestra.run.smithi007.stdout: "recovering_stretch_mode": 0, 2023-09-30T17:02:38.270 INFO:teuthology.orchestra.run.smithi007.stdout: "stretch_mode_bucket": 0 2023-09-30T17:02:38.270 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-09-30T17:02:38.270 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-09-30T17:02:38.272 INFO:tasks.thrashosds.thrasher:j is {'epoch': 19, 'fsid': '68daccc3-6ea9-4db7-9771-3803ff202df8', 'created': '2023-09-30T17:01:55.306262+0000', 'modified': '2023-09-30T17:02:19.350385+0000', 'last_up_change': '2023-09-30T17:02:04.210987+0000', 'last_in_change': '2023-09-30T17:01:56.571968+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T17:02:05.343048+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T17:02:11.033979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T17:02:15.583451+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T17:02:16.734427+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'a9d1653a-8830-4fad-911b-8e7221ee8697', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6800', 'nonce': 2212861041}, {'type': 'v1', 'addr': '172.21.15.31:6801', 'nonce': 2212861041}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6802', 'nonce': 2212861041}, {'type': 'v1', 'addr': '172.21.15.31:6803', 'nonce': 2212861041}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6806', 'nonce': 2212861041}, {'type': 'v1', 'addr': '172.21.15.31:6807', 'nonce': 2212861041}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6804', 'nonce': 2212861041}, {'type': 'v1', 'addr': '172.21.15.31:6805', 'nonce': 2212861041}]}, 'public_addr': '172.21.15.31:6801/2212861041', 'cluster_addr': '172.21.15.31:6803/2212861041', 'heartbeat_back_addr': '172.21.15.31:6807/2212861041', 'heartbeat_front_addr': '172.21.15.31:6805/2212861041', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '7123aa56-aa1a-43a4-b154-a40b4c70d169', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6800', 'nonce': 1680420094}, {'type': 'v1', 'addr': '172.21.15.72:6801', 'nonce': 1680420094}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6802', 'nonce': 1680420094}, {'type': 'v1', 'addr': '172.21.15.72:6803', 'nonce': 1680420094}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6806', 'nonce': 1680420094}, {'type': 'v1', 'addr': '172.21.15.72:6807', 'nonce': 1680420094}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6804', 'nonce': 1680420094}, {'type': 'v1', 'addr': '172.21.15.72:6805', 'nonce': 1680420094}]}, 'public_addr': '172.21.15.72:6801/1680420094', 'cluster_addr': '172.21.15.72:6803/1680420094', 'heartbeat_back_addr': '172.21.15.72:6807/1680420094', 'heartbeat_front_addr': '172.21.15.72:6805/1680420094', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'f40ee0d7-7bc3-4a46-bdac-9c134c55c907', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 17, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6800', 'nonce': 1018866543}, {'type': 'v1', 'addr': '172.21.15.134:6801', 'nonce': 1018866543}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6802', 'nonce': 1018866543}, {'type': 'v1', 'addr': '172.21.15.134:6803', 'nonce': 1018866543}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6806', 'nonce': 1018866543}, {'type': 'v1', 'addr': '172.21.15.134:6807', 'nonce': 1018866543}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6804', 'nonce': 1018866543}, {'type': 'v1', 'addr': '172.21.15.134:6805', 'nonce': 1018866543}]}, 'public_addr': '172.21.15.134:6801/1018866543', 'cluster_addr': '172.21.15.134:6803/1018866543', 'heartbeat_back_addr': '172.21.15.134:6807/1018866543', 'heartbeat_front_addr': '172.21.15.134:6805/1018866543', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-09-30T17:02:01.702754+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-09-30T17:02:01.688791+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-09-30T17:02:01.667971+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2023-09-30T17:02:38.272 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2023-09-30T17:02:38.273 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:38.272+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:38.288 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:38.288 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:38.298 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:02:38.372 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:38.373+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:38.393 INFO:teuthology.orchestra.run.smithi007.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-09-30T17:02:38.394 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is set 2023-09-30T17:02:38.408 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-09-30T17:02:38.408 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-09-30T17:02:38.408 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi007.front.sepia.ceph.com 2023-09-30T17:02:38.408 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-09-30T17:02:38.408 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-09-30T17:02:38.409 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-09-30T17:02:38.409 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-09-30T17:02:38.409 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-09-30T17:02:38.409 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-09-30T17:02:38.409 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T17:02:38.409 DEBUG:teuthology.orchestra.run.smithi007:> ip addr 2023-09-30T17:02:38.439 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:38.440 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:38.450 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:02:38.465 INFO:teuthology.orchestra.run.smithi007.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-09-30T17:02:38.465 INFO:teuthology.orchestra.run.smithi007.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-09-30T17:02:38.465 INFO:teuthology.orchestra.run.smithi007.stdout: inet 127.0.0.1/8 scope host lo 2023-09-30T17:02:38.466 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-09-30T17:02:38.466 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 ::1/128 scope host 2023-09-30T17:02:38.466 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-09-30T17:02:38.466 INFO:teuthology.orchestra.run.smithi007.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T17:02:38.466 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dc brd ff:ff:ff:ff:ff:ff 2023-09-30T17:02:38.466 INFO:teuthology.orchestra.run.smithi007.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T17:02:38.466 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:6b:fd:dd brd ff:ff:ff:ff:ff:ff 2023-09-30T17:02:38.466 INFO:teuthology.orchestra.run.smithi007.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-09-30T17:02:38.466 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:ea brd ff:ff:ff:ff:ff:ff 2023-09-30T17:02:38.467 INFO:teuthology.orchestra.run.smithi007.stdout: inet 172.21.15.7/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-09-30T17:02:38.467 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft 42357sec preferred_lft 42357sec 2023-09-30T17:02:38.467 INFO:teuthology.orchestra.run.smithi007.stdout: inet6 fe80::ec4:7aff:febd:15ea/64 scope link 2023-09-30T17:02:38.467 INFO:teuthology.orchestra.run.smithi007.stdout: valid_lft forever preferred_lft forever 2023-09-30T17:02:38.467 INFO:teuthology.orchestra.run.smithi007.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-09-30T17:02:38.467 INFO:teuthology.orchestra.run.smithi007.stdout: link/ether 0c:c4:7a:bd:15:eb brd ff:ff:ff:ff:ff:ff 2023-09-30T17:02:38.467 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-09-30T17:02:38.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T17:02:38.468 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2023-09-30T17:02:38.468 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2023-09-30T17:02:38.468 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link add name ceph-brx type bridge 2023-09-30T17:02:38.468 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip addr flush dev ceph-brx 2023-09-30T17:02:38.468 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set ceph-brx up 2023-09-30T17:02:38.468 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-09-30T17:02:38.468 DEBUG:teuthology.orchestra.run.smithi007:> ') 2023-09-30T17:02:38.494 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:38.494+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:38.575 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:38.575+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:38.576 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:38.576 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:38.587 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:02:38.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T17:02:38.646 DEBUG:teuthology.orchestra.run.smithi007:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-09-30T17:02:38.675 INFO:teuthology.orchestra.run.smithi007.stdout:1 2023-09-30T17:02:38.675 INFO:tasks.ceph.osd.2.smithi134.stderr:2023-09-30T17:02:38.675+0000 7efd10b20700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 96961) UID: 0 2023-09-30T17:02:38.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T17:02:38.676 DEBUG:teuthology.orchestra.run.smithi007:> route 2023-09-30T17:02:38.747 INFO:teuthology.orchestra.run.smithi007.stdout:Kernel IP routing table 2023-09-30T17:02:38.748 INFO:teuthology.orchestra.run.smithi007.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-09-30T17:02:38.748 INFO:teuthology.orchestra.run.smithi007.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-09-30T17:02:38.748 INFO:teuthology.orchestra.run.smithi007.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-09-30T17:02:38.748 INFO:teuthology.orchestra.run.smithi007.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-09-30T17:02:38.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T17:02:38.749 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2023-09-30T17:02:38.749 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2023-09-30T17:02:38.749 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-09-30T17:02:38.749 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-09-30T17:02:38.749 DEBUG:teuthology.orchestra.run.smithi007:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-09-30T17:02:38.749 DEBUG:teuthology.orchestra.run.smithi007:> ') 2023-09-30T17:02:38.753 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:38.753 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:38.763 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-09-30T17:02:38.807 INFO:tasks.ceph.osd.2.smithi134.stderr:2023-09-30T17:02:38.806+0000 7efd10b20700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 96961) UID: 0 2023-09-30T17:02:38.877 INFO:tasks.ceph.osd.2.smithi134.stderr:2023-09-30T17:02:38.876+0000 7efd10b20700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 96961) UID: 0 2023-09-30T17:02:38.902 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:38.903 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:38.914 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-09-30T17:02:38.978 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:38.979+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:38.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T17:02:38.981 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2023-09-30T17:02:38.998 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T17:02:38.999 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list-id 2023-09-30T17:02:39.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T17:02:39.055 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2023-09-30T17:02:39.055 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2023-09-30T17:02:39.055 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T17:02:39.055 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-09-30T17:02:39.056 DEBUG:teuthology.orchestra.run.smithi007:> ') 2023-09-30T17:02:39.079 INFO:tasks.ceph.osd.2.smithi134.stderr:2023-09-30T17:02:39.078+0000 7efd10b20700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 96961) UID: 0 2023-09-30T17:02:39.080 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:39.081 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:39.091 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-09-30T17:02:39.150 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-09-30T17:02:39.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T17:02:39.151 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2023-09-30T17:02:39.151 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2023-09-30T17:02:39.151 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-09-30T17:02:39.151 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-09-30T17:02:39.151 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-09-30T17:02:39.151 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-09-30T17:02:39.151 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-09-30T17:02:39.151 DEBUG:teuthology.orchestra.run.smithi007:> ') 2023-09-30T17:02:39.180 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:39.180+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:39.257 INFO:teuthology.orchestra.run.smithi134.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:39.257 INFO:teuthology.orchestra.run.smithi134.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:39.267 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:02:39.281 INFO:tasks.ceph.osd.2.smithi134.stderr:2023-09-30T17:02:39.280+0000 7efd10b20700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 96961) UID: 0 2023-09-30T17:02:39.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T17:02:39.362 DEBUG:teuthology.orchestra.run.smithi007:> (cd / && exec bash -c ' 2023-09-30T17:02:39.362 DEBUG:teuthology.orchestra.run.smithi007:> set -e 2023-09-30T17:02:39.362 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set brx.0 up 2023-09-30T17:02:39.362 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link set dev brx.0 master ceph-brx 2023-09-30T17:02:39.362 DEBUG:teuthology.orchestra.run.smithi007:> ') 2023-09-30T17:02:39.382 INFO:tasks.ceph.osd.2.smithi134.stderr:2023-09-30T17:02:39.381+0000 7efd10b20700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 96961) UID: 0 2023-09-30T17:02:39.413 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:39.414 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:39.424 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:02:39.463 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-09-30T17:02:39.463 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T17:02:39.463 DEBUG:teuthology.orchestra.run.smithi007:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-09-30T17:02:39.480 INFO:teuthology.orchestra.run.smithi007.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-09-30T17:02:39.480 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-09-30T17:02:39.480 DEBUG:teuthology.orchestra.run.smithi007:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-09-30T17:02:39.483 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:39.484+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:39.537 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2023-09-30T17:02:39.556 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:39.556 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:39.566 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:02:39.584 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:39.584+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:39.604 DEBUG:teuthology.orchestra.run.smithi007:> cat /proc/self/mounts | awk '{print $2}' 2023-09-30T17:02:39.661 INFO:teuthology.orchestra.run.smithi007.stdout:/sys 2023-09-30T17:02:39.661 INFO:teuthology.orchestra.run.smithi007.stdout:/proc 2023-09-30T17:02:39.661 INFO:teuthology.orchestra.run.smithi007.stdout:/dev 2023-09-30T17:02:39.661 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/kernel/security 2023-09-30T17:02:39.662 INFO:teuthology.orchestra.run.smithi007.stdout:/dev/shm 2023-09-30T17:02:39.662 INFO:teuthology.orchestra.run.smithi007.stdout:/dev/pts 2023-09-30T17:02:39.662 INFO:teuthology.orchestra.run.smithi007.stdout:/run 2023-09-30T17:02:39.662 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/cgroup 2023-09-30T17:02:39.662 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/cgroup/systemd 2023-09-30T17:02:39.662 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/pstore 2023-09-30T17:02:39.662 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/bpf 2023-09-30T17:02:39.662 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-09-30T17:02:39.662 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/cgroup/pids 2023-09-30T17:02:39.662 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/cgroup/rdma 2023-09-30T17:02:39.663 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/cgroup/devices 2023-09-30T17:02:39.663 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-09-30T17:02:39.663 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/cgroup/blkio 2023-09-30T17:02:39.663 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/cgroup/cpuset 2023-09-30T17:02:39.663 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/cgroup/hugetlb 2023-09-30T17:02:39.663 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/cgroup/freezer 2023-09-30T17:02:39.663 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/cgroup/memory 2023-09-30T17:02:39.663 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/cgroup/perf_event 2023-09-30T17:02:39.663 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/kernel/tracing 2023-09-30T17:02:39.663 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/kernel/config 2023-09-30T17:02:39.663 INFO:teuthology.orchestra.run.smithi007.stdout:/ 2023-09-30T17:02:39.664 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/selinux 2023-09-30T17:02:39.664 INFO:teuthology.orchestra.run.smithi007.stdout:/proc/sys/fs/binfmt_misc 2023-09-30T17:02:39.664 INFO:teuthology.orchestra.run.smithi007.stdout:/dev/hugepages 2023-09-30T17:02:39.664 INFO:teuthology.orchestra.run.smithi007.stdout:/dev/mqueue 2023-09-30T17:02:39.664 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/kernel/debug 2023-09-30T17:02:39.664 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/fuse/connections 2023-09-30T17:02:39.664 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/nfs/rpc_pipefs 2023-09-30T17:02:39.664 INFO:teuthology.orchestra.run.smithi007.stdout:/run/user/1000 2023-09-30T17:02:39.664 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/ceph 2023-09-30T17:02:39.664 INFO:teuthology.orchestra.run.smithi007.stdout:/run/netns 2023-09-30T17:02:39.664 INFO:teuthology.orchestra.run.smithi007.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T17:02:39.664 INFO:teuthology.orchestra.run.smithi007.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T17:02:39.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T17:02:39.665 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2023-09-30T17:02:39.685 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:39.685+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:39.697 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:39.697 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:39.707 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:02:39.722 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-09-30T17:02:39.722 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-09-30T17:02:39.765 DEBUG:teuthology.orchestra.run.smithi007:> sudo modprobe fuse 2023-09-30T17:02:39.785 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:39.786+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:39.792 DEBUG:teuthology.orchestra.run.smithi007:> cat /proc/self/mounts | awk '{print $2}' 2023-09-30T17:02:39.848 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:39.848 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:39.849 INFO:teuthology.orchestra.run.smithi007.stdout:/sys 2023-09-30T17:02:39.849 INFO:teuthology.orchestra.run.smithi007.stdout:/proc 2023-09-30T17:02:39.850 INFO:teuthology.orchestra.run.smithi007.stdout:/dev 2023-09-30T17:02:39.850 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/kernel/security 2023-09-30T17:02:39.850 INFO:teuthology.orchestra.run.smithi007.stdout:/dev/shm 2023-09-30T17:02:39.850 INFO:teuthology.orchestra.run.smithi007.stdout:/dev/pts 2023-09-30T17:02:39.850 INFO:teuthology.orchestra.run.smithi007.stdout:/run 2023-09-30T17:02:39.850 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/cgroup 2023-09-30T17:02:39.850 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/cgroup/systemd 2023-09-30T17:02:39.850 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/pstore 2023-09-30T17:02:39.850 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/bpf 2023-09-30T17:02:39.850 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/cgroup/net_cls,net_prio 2023-09-30T17:02:39.850 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/cgroup/pids 2023-09-30T17:02:39.851 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/cgroup/rdma 2023-09-30T17:02:39.851 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/cgroup/devices 2023-09-30T17:02:39.851 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/cgroup/cpu,cpuacct 2023-09-30T17:02:39.851 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/cgroup/blkio 2023-09-30T17:02:39.851 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/cgroup/cpuset 2023-09-30T17:02:39.851 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/cgroup/hugetlb 2023-09-30T17:02:39.851 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/cgroup/freezer 2023-09-30T17:02:39.851 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/cgroup/memory 2023-09-30T17:02:39.851 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/cgroup/perf_event 2023-09-30T17:02:39.851 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/kernel/tracing 2023-09-30T17:02:39.852 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/kernel/config 2023-09-30T17:02:39.852 INFO:teuthology.orchestra.run.smithi007.stdout:/ 2023-09-30T17:02:39.852 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/selinux 2023-09-30T17:02:39.852 INFO:teuthology.orchestra.run.smithi007.stdout:/proc/sys/fs/binfmt_misc 2023-09-30T17:02:39.852 INFO:teuthology.orchestra.run.smithi007.stdout:/dev/hugepages 2023-09-30T17:02:39.852 INFO:teuthology.orchestra.run.smithi007.stdout:/dev/mqueue 2023-09-30T17:02:39.852 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/kernel/debug 2023-09-30T17:02:39.852 INFO:teuthology.orchestra.run.smithi007.stdout:/sys/fs/fuse/connections 2023-09-30T17:02:39.852 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/nfs/rpc_pipefs 2023-09-30T17:02:39.852 INFO:teuthology.orchestra.run.smithi007.stdout:/run/user/1000 2023-09-30T17:02:39.852 INFO:teuthology.orchestra.run.smithi007.stdout:/var/lib/ceph 2023-09-30T17:02:39.853 INFO:teuthology.orchestra.run.smithi007.stdout:/run/netns 2023-09-30T17:02:39.853 INFO:teuthology.orchestra.run.smithi007.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T17:02:39.853 INFO:teuthology.orchestra.run.smithi007.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T17:02:39.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T17:02:39.853 DEBUG:teuthology.orchestra.run.smithi007:> ls /sys/fs/fuse/connections 2023-09-30T17:02:39.858 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:02:39.873 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:2023-09-30T17:02:39.872+0000 7ffa37d145c0 -1 init, newargv = 0x55834a0de9d0 newargc=15 2023-09-30T17:02:39.873 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[100400]: starting ceph client 2023-09-30T17:02:39.878 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[100400]: starting fuse 2023-09-30T17:02:39.886 INFO:tasks.ceph.osd.2.smithi134.stderr:2023-09-30T17:02:39.886+0000 7efd10b20700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 96961) UID: 0 2023-09-30T17:02:39.890 INFO:teuthology.orchestra.run.smithi007.stdout:47 2023-09-30T17:02:39.890 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [47] 2023-09-30T17:02:39.890 DEBUG:teuthology.orchestra.run.smithi007:> sudo stdin-killer -- python3 -c ' 2023-09-30T17:02:39.890 DEBUG:teuthology.orchestra.run.smithi007:> import glob 2023-09-30T17:02:39.890 DEBUG:teuthology.orchestra.run.smithi007:> import re 2023-09-30T17:02:39.891 DEBUG:teuthology.orchestra.run.smithi007:> import os 2023-09-30T17:02:39.891 DEBUG:teuthology.orchestra.run.smithi007:> import subprocess 2023-09-30T17:02:39.891 DEBUG:teuthology.orchestra.run.smithi007:> 2023-09-30T17:02:39.891 DEBUG:teuthology.orchestra.run.smithi007:> def _find_admin_socket(client_name): 2023-09-30T17:02:39.891 DEBUG:teuthology.orchestra.run.smithi007:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-09-30T17:02:39.891 DEBUG:teuthology.orchestra.run.smithi007:> files = glob.glob(asok_path) 2023-09-30T17:02:39.891 DEBUG:teuthology.orchestra.run.smithi007:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-09-30T17:02:39.891 DEBUG:teuthology.orchestra.run.smithi007:> 2023-09-30T17:02:39.891 DEBUG:teuthology.orchestra.run.smithi007:> # Given a non-glob path, it better be there 2023-09-30T17:02:39.891 DEBUG:teuthology.orchestra.run.smithi007:> if "*" not in asok_path: 2023-09-30T17:02:39.891 DEBUG:teuthology.orchestra.run.smithi007:> assert(len(files) == 1) 2023-09-30T17:02:39.891 DEBUG:teuthology.orchestra.run.smithi007:> return files[0] 2023-09-30T17:02:39.892 DEBUG:teuthology.orchestra.run.smithi007:> 2023-09-30T17:02:39.892 DEBUG:teuthology.orchestra.run.smithi007:> for f in files: 2023-09-30T17:02:39.892 DEBUG:teuthology.orchestra.run.smithi007:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-09-30T17:02:39.892 DEBUG:teuthology.orchestra.run.smithi007:> if os.path.exists("/proc/{0}".format(pid)): 2023-09-30T17:02:39.892 DEBUG:teuthology.orchestra.run.smithi007:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-09-30T17:02:39.892 DEBUG:teuthology.orchestra.run.smithi007:> contents = proc_f.read() 2023-09-30T17:02:39.892 DEBUG:teuthology.orchestra.run.smithi007:> if mountpoint in contents: 2023-09-30T17:02:39.892 DEBUG:teuthology.orchestra.run.smithi007:> return f 2023-09-30T17:02:39.892 DEBUG:teuthology.orchestra.run.smithi007:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-09-30T17:02:39.892 DEBUG:teuthology.orchestra.run.smithi007:> 2023-09-30T17:02:39.892 DEBUG:teuthology.orchestra.run.smithi007:> print(_find_admin_socket("client.0")) 2023-09-30T17:02:39.892 DEBUG:teuthology.orchestra.run.smithi007:> ' 2023-09-30T17:02:39.987 INFO:tasks.ceph.osd.2.smithi134.stderr:2023-09-30T17:02:39.987+0000 7efd10b20700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 96961) UID: 0 2023-09-30T17:02:40.016 INFO:teuthology.orchestra.run.smithi007.stdout:/var/run/ceph/ceph-client.0.100400.asok 2023-09-30T17:02:40.019 INFO:teuthology.orchestra.run.smithi007.stderr:2023-09-30T17:02:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-09-30T17:02:40.024 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:40.024 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:40.025 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.100400.asok 2023-09-30T17:02:40.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T17:02:40.025 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.100400.asok status 2023-09-30T17:02:40.034 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:02:40.084 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-09-30T17:02:40.088 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:40.088+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:40.161 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:40.161 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:40.170 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-09-30T17:02:40.187 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-09-30T17:02:40.187 INFO:teuthology.orchestra.run.smithi007.stdout: "metadata": { 2023-09-30T17:02:40.187 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_sha1": "1d10b71792f3be8887a7631e69851ac2df3585af", 2023-09-30T17:02:40.187 INFO:teuthology.orchestra.run.smithi007.stdout: "ceph_version": "ceph version 18.0.0-6447-g1d10b717 (1d10b71792f3be8887a7631e69851ac2df3585af) reef (dev)", 2023-09-30T17:02:40.188 INFO:teuthology.orchestra.run.smithi007.stdout: "entity_id": "0", 2023-09-30T17:02:40.188 INFO:teuthology.orchestra.run.smithi007.stdout: "hostname": "smithi007", 2023-09-30T17:02:40.188 INFO:teuthology.orchestra.run.smithi007.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-09-30T17:02:40.188 INFO:teuthology.orchestra.run.smithi007.stdout: "pid": "100400", 2023-09-30T17:02:40.188 INFO:teuthology.orchestra.run.smithi007.stdout: "root": "/" 2023-09-30T17:02:40.188 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:40.188 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_count": 0, 2023-09-30T17:02:40.188 INFO:teuthology.orchestra.run.smithi007.stdout: "dentry_pinned_count": 0, 2023-09-30T17:02:40.188 INFO:teuthology.orchestra.run.smithi007.stdout: "id": 4547, 2023-09-30T17:02:40.188 INFO:teuthology.orchestra.run.smithi007.stdout: "inst": { 2023-09-30T17:02:40.188 INFO:teuthology.orchestra.run.smithi007.stdout: "name": { 2023-09-30T17:02:40.189 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "client", 2023-09-30T17:02:40.189 INFO:teuthology.orchestra.run.smithi007.stdout: "num": 4547 2023-09-30T17:02:40.189 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:40.189 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2023-09-30T17:02:40.189 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-09-30T17:02:40.189 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "192.168.0.1:0", 2023-09-30T17:02:40.189 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 425808627 2023-09-30T17:02:40.189 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-09-30T17:02:40.189 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:40.189 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": { 2023-09-30T17:02:40.189 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-09-30T17:02:40.189 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "192.168.0.1:0", 2023-09-30T17:02:40.190 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 425808627 2023-09-30T17:02:40.190 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:02:40.190 INFO:teuthology.orchestra.run.smithi007.stdout: "inst_str": "client.4547 192.168.0.1:0/425808627", 2023-09-30T17:02:40.190 INFO:teuthology.orchestra.run.smithi007.stdout: "addr_str": "192.168.0.1:0/425808627", 2023-09-30T17:02:40.190 INFO:teuthology.orchestra.run.smithi007.stdout: "inode_count": 1, 2023-09-30T17:02:40.190 INFO:teuthology.orchestra.run.smithi007.stdout: "mds_epoch": 6, 2023-09-30T17:02:40.190 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch": 20, 2023-09-30T17:02:40.190 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_epoch_barrier": 0, 2023-09-30T17:02:40.190 INFO:teuthology.orchestra.run.smithi007.stdout: "blocklisted": false, 2023-09-30T17:02:40.190 INFO:teuthology.orchestra.run.smithi007.stdout: "fs_name": "cephfs" 2023-09-30T17:02:40.191 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-09-30T17:02:40.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T17:02:40.198 DEBUG:teuthology.orchestra.run.smithi007:> stat --file-system '--printf=%T 2023-09-30T17:02:40.198 DEBUG:teuthology.orchestra.run.smithi007:> ' -- /home/ubuntu/cephtest/mnt.0 2023-09-30T17:02:40.214 INFO:tasks.ceph.osd.2.smithi134.stderr:2023-09-30T17:02:40.213+0000 7efd10b20700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 96961) UID: 0 2023-09-30T17:02:40.215 INFO:teuthology.orchestra.run.smithi007.stdout:fuseblk 2023-09-30T17:02:40.216 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-09-30T17:02:40.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T17:02:40.216 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-09-30T17:02:40.259 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:02:40.282 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:02:40.285 INFO:teuthology.run_tasks:Running task workunit... 2023-09-30T17:02:40.297 INFO:tasks.workunit:Pulling workunits from ref 1d10b71792f3be8887a7631e69851ac2df3585af 2023-09-30T17:02:40.297 INFO:tasks.workunit:Making a separate scratch dir for every client... 2023-09-30T17:02:40.297 INFO:tasks.workunit:timeout=3h 2023-09-30T17:02:40.297 INFO:tasks.workunit:cleanup=True 2023-09-30T17:02:40.298 DEBUG:teuthology.orchestra.run.smithi007:> stat -- /home/ubuntu/cephtest/mnt.0 2023-09-30T17:02:40.299 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:40.299+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:40.302 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-09-30T17:02:40.304 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-09-30T17:02:40.305 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-09-30T17:02:40.305 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-09-30T17:02:40.311 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2023-09-30T17:02:40.311 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2023-09-30T17:02:40.311 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2023-09-30T17:02:40.311 INFO:teuthology.orchestra.run.smithi134.stdout:} 2023-09-30T17:02:40.320 INFO:teuthology.orchestra.run.smithi007.stdout: File: /home/ubuntu/cephtest/mnt.0 2023-09-30T17:02:40.320 INFO:teuthology.orchestra.run.smithi007.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2023-09-30T17:02:40.320 INFO:teuthology.orchestra.run.smithi007.stdout:Device: 2fh/47d Inode: 1 Links: 2 2023-09-30T17:02:40.320 INFO:teuthology.orchestra.run.smithi007.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T17:02:40.320 INFO:teuthology.orchestra.run.smithi007.stdout:Context: system_u:object_r:fusefs_t:s0 2023-09-30T17:02:40.320 INFO:teuthology.orchestra.run.smithi007.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2023-09-30T17:02:40.320 INFO:teuthology.orchestra.run.smithi007.stdout:Modify: 2023-09-30 17:02:18.347510434 +0000 2023-09-30T17:02:40.320 INFO:teuthology.orchestra.run.smithi007.stdout:Change: 2023-09-30 17:02:40.284305638 +0000 2023-09-30T17:02:40.321 INFO:teuthology.orchestra.run.smithi007.stdout: Birth: - 2023-09-30T17:02:40.321 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2023-09-30T17:02:40.321 DEBUG:teuthology.orchestra.run.smithi007:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2023-09-30T17:02:40.322 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-09-30T17:02:40.392 DEBUG:teuthology.orchestra.run.smithi007:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1d10b71792f3be8887a7631e69851ac2df3585af 2023-09-30T17:02:40.400 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:40.400+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:40.406 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-09-30T17:02:40.450 INFO:tasks.workunit.client.0.smithi007.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2023-09-30T17:02:40.489 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2023-09-30T17:02:40.489 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2023-09-30T17:02:40.489 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2023-09-30T17:02:40.489 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2023-09-30T17:02:40.490 INFO:teuthology.orchestra.run.smithi134.stdout:} 2023-09-30T17:02:40.500 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-09-30T17:02:40.501 INFO:tasks.ceph.osd.2.smithi134.stderr:2023-09-30T17:02:40.500+0000 7efd10b20700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 96961) UID: 0 2023-09-30T17:02:40.602 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:40.603+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:40.628 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2023-09-30T17:02:40.628 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2023-09-30T17:02:40.628 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2023-09-30T17:02:40.628 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2023-09-30T17:02:40.629 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.629 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4153.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-09-30T17:02:40.629 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2023-09-30T17:02:07.728242+0000", 2023-09-30T17:02:40.629 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 32.898159921999998, 2023-09-30T17:02:40.629 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013877029000000001, 2023-09-30T17:02:40.629 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2023-09-30T17:02:40.629 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:40.629 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2023-09-30T17:02:40.629 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4153", 2023-09-30T17:02:40.629 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.7:0/3760733398", 2023-09-30T17:02:40.629 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 140 2023-09-30T17:02:40.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.630 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2023-09-30T17:02:40.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2023-09-30T17:02:40.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:07.728242+0000", 2023-09-30T17:02:40.630 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:40.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.630 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.630 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2023-09-30T17:02:40.630 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:07.728242+0000", 2023-09-30T17:02:40.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:40.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2023-09-30T17:02:40.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:07.728242+0000", 2023-09-30T17:02:40.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.79e-07 2023-09-30T17:02:40.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.631 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.631 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2023-09-30T17:02:40.631 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:07.728296+0000", 2023-09-30T17:02:40.631 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3621e-05 2023-09-30T17:02:40.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2023-09-30T17:02:40.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:07.728300+0000", 2023-09-30T17:02:40.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6110000000000004e-06 2023-09-30T17:02:40.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.632 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2023-09-30T17:02:40.632 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:07.728304+0000", 2023-09-30T17:02:40.632 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1180000000000002e-06 2023-09-30T17:02:40.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.632 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:40.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:07.737106+0000", 2023-09-30T17:02:40.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0088017860000000007 2023-09-30T17:02:40.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2023-09-30T17:02:40.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:07.737152+0000", 2023-09-30T17:02:40.633 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5664000000000002e-05 2023-09-30T17:02:40.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.633 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.633 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2023-09-30T17:02:40.633 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:07.737227+0000", 2023-09-30T17:02:40.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4788000000000003e-05 2023-09-30T17:02:40.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:40.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:07.738546+0000", 2023-09-30T17:02:40.634 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0013198369999999999 2023-09-30T17:02:40.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.634 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.634 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2023-09-30T17:02:40.634 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:07.742069+0000", 2023-09-30T17:02:40.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035230529999999999 2023-09-30T17:02:40.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2023-09-30T17:02:40.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:07.742099+0000", 2023-09-30T17:02:40.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9467000000000001e-05 2023-09-30T17:02:40.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.635 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.635 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2023-09-30T17:02:40.635 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:07.742119+0000", 2023-09-30T17:02:40.635 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9805000000000001e-05 2023-09-30T17:02:40.636 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:40.636 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2023-09-30T17:02:40.636 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:40.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.636 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.636 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:40.636 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2023-09-30T17:02:18.351413+0000", 2023-09-30T17:02:40.636 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.274988932999999, 2023-09-30T17:02:40.636 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022436951, 2023-09-30T17:02:40.636 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2023-09-30T17:02:40.636 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:40.637 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2023-09-30T17:02:40.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2023-09-30T17:02:40.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.351413+0000", 2023-09-30T17:02:40.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:40.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.637 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2023-09-30T17:02:40.637 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.351413+0000", 2023-09-30T17:02:40.637 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:40.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.637 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2023-09-30T17:02:40.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.351415+0000", 2023-09-30T17:02:40.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9920000000000002e-06 2023-09-30T17:02:40.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2023-09-30T17:02:40.638 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.351422+0000", 2023-09-30T17:02:40.638 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2300000000000002e-06 2023-09-30T17:02:40.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.638 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.638 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2023-09-30T17:02:40.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.351433+0000", 2023-09-30T17:02:40.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1532000000000001e-05 2023-09-30T17:02:40.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2023-09-30T17:02:40.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.351446+0000", 2023-09-30T17:02:40.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2687000000000001e-05 2023-09-30T17:02:40.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.639 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.639 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:40.639 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352636+0000", 2023-09-30T17:02:40.639 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001190212 2023-09-30T17:02:40.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2023-09-30T17:02:40.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352644+0000", 2023-09-30T17:02:40.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0520000000000002e-06 2023-09-30T17:02:40.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.640 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:40.640 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.358475+0000", 2023-09-30T17:02:40.640 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0058308379999999996 2023-09-30T17:02:40.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.640 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2023-09-30T17:02:40.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.358591+0000", 2023-09-30T17:02:40.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000115746 2023-09-30T17:02:40.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2023-09-30T17:02:40.641 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.358722+0000", 2023-09-30T17:02:40.641 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013111399999999999 2023-09-30T17:02:40.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.641 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.641 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:40.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.373725+0000", 2023-09-30T17:02:40.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015002678 2023-09-30T17:02:40.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2023-09-30T17:02:40.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.373758+0000", 2023-09-30T17:02:40.642 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2855000000000003e-05 2023-09-30T17:02:40.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.642 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.642 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2023-09-30T17:02:40.642 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.373806+0000", 2023-09-30T17:02:40.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8380000000000001e-05 2023-09-30T17:02:40.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.643 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2023-09-30T17:02:40.643 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.373850+0000", 2023-09-30T17:02:40.643 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3634999999999998e-05 2023-09-30T17:02:40.643 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:40.643 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2023-09-30T17:02:40.643 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:40.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.643 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.644 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:40.644 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2023-09-30T17:02:18.352512+0000", 2023-09-30T17:02:40.644 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.273889556, 2023-09-30T17:02:40.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023505666000000001, 2023-09-30T17:02:40.644 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2023-09-30T17:02:40.644 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:40.644 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2023-09-30T17:02:40.644 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.644 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2023-09-30T17:02:40.644 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352512+0000", 2023-09-30T17:02:40.644 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:40.644 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2023-09-30T17:02:40.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352512+0000", 2023-09-30T17:02:40.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:40.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.645 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.645 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2023-09-30T17:02:40.645 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352513+0000", 2023-09-30T17:02:40.645 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0020000000000001e-06 2023-09-30T17:02:40.645 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2023-09-30T17:02:40.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352519+0000", 2023-09-30T17:02:40.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0700000000000003e-06 2023-09-30T17:02:40.646 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.646 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.646 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2023-09-30T17:02:40.646 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352531+0000", 2023-09-30T17:02:40.646 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2024e-05 2023-09-30T17:02:40.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2023-09-30T17:02:40.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352541+0000", 2023-09-30T17:02:40.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5400000000000001e-06 2023-09-30T17:02:40.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.647 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:40.647 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352723+0000", 2023-09-30T17:02:40.647 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018261800000000001 2023-09-30T17:02:40.647 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.647 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:40.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352731+0000", 2023-09-30T17:02:40.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8529999999999992e-06 2023-09-30T17:02:40.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:40.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.359935+0000", 2023-09-30T17:02:40.648 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0072039670000000004 2023-09-30T17:02:40.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.648 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.648 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2023-09-30T17:02:40.648 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.360029+0000", 2023-09-30T17:02:40.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3623999999999997e-05 2023-09-30T17:02:40.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2023-09-30T17:02:40.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.360186+0000", 2023-09-30T17:02:40.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015768600000000001 2023-09-30T17:02:40.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.649 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.649 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2023-09-30T17:02:40.649 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.373903+0000", 2023-09-30T17:02:40.649 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013716081 2023-09-30T17:02:40.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:40.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.375919+0000", 2023-09-30T17:02:40.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020165339999999999 2023-09-30T17:02:40.650 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.650 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.650 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2023-09-30T17:02:40.650 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.375979+0000", 2023-09-30T17:02:40.650 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9648999999999998e-05 2023-09-30T17:02:40.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.651 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2023-09-30T17:02:40.651 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.376018+0000", 2023-09-30T17:02:40.651 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9017999999999998e-05 2023-09-30T17:02:40.651 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:40.651 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2023-09-30T17:02:40.651 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:40.651 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.651 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.651 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:40.652 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2023-09-30T17:02:18.352586+0000", 2023-09-30T17:02:40.652 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.273815620000001, 2023-09-30T17:02:40.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023588990000000001, 2023-09-30T17:02:40.652 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2023-09-30T17:02:40.652 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:40.652 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2023-09-30T17:02:40.652 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.652 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2023-09-30T17:02:40.652 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352586+0000", 2023-09-30T17:02:40.652 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:40.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2023-09-30T17:02:40.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352586+0000", 2023-09-30T17:02:40.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:40.653 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.653 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.653 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2023-09-30T17:02:40.653 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352587+0000", 2023-09-30T17:02:40.653 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3399999999999998e-07 2023-09-30T17:02:40.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2023-09-30T17:02:40.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352593+0000", 2023-09-30T17:02:40.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6510000000000004e-06 2023-09-30T17:02:40.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.654 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.654 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2023-09-30T17:02:40.654 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352602+0000", 2023-09-30T17:02:40.654 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4780000000000008e-06 2023-09-30T17:02:40.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2023-09-30T17:02:40.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352612+0000", 2023-09-30T17:02:40.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8800000000000003e-06 2023-09-30T17:02:40.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.655 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:40.655 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352773+0000", 2023-09-30T17:02:40.655 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016074399999999999 2023-09-30T17:02:40.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.655 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:40.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352777+0000", 2023-09-30T17:02:40.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2230000000000001e-06 2023-09-30T17:02:40.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:40.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.360480+0000", 2023-09-30T17:02:40.656 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.007703082 2023-09-30T17:02:40.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.656 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.656 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2023-09-30T17:02:40.656 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.360613+0000", 2023-09-30T17:02:40.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013267899999999999 2023-09-30T17:02:40.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2023-09-30T17:02:40.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.360741+0000", 2023-09-30T17:02:40.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012807500000000001 2023-09-30T17:02:40.657 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.657 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.657 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2023-09-30T17:02:40.657 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.373986+0000", 2023-09-30T17:02:40.657 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013244923 2023-09-30T17:02:40.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:40.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.376062+0000", 2023-09-30T17:02:40.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020761600000000001 2023-09-30T17:02:40.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.658 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.658 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2023-09-30T17:02:40.658 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.376117+0000", 2023-09-30T17:02:40.658 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5211999999999999e-05 2023-09-30T17:02:40.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.659 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2023-09-30T17:02:40.659 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.376175+0000", 2023-09-30T17:02:40.659 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8048999999999999e-05 2023-09-30T17:02:40.659 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:40.659 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2023-09-30T17:02:40.659 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:40.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.659 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.659 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:40.659 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2023-09-30T17:02:18.352642+0000", 2023-09-30T17:02:40.659 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.273759605999999, 2023-09-30T17:02:40.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025205787, 2023-09-30T17:02:40.660 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2023-09-30T17:02:40.660 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:40.660 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2023-09-30T17:02:40.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2023-09-30T17:02:40.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352642+0000", 2023-09-30T17:02:40.660 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:40.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.660 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.660 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2023-09-30T17:02:40.660 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352642+0000", 2023-09-30T17:02:40.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:40.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2023-09-30T17:02:40.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352643+0000", 2023-09-30T17:02:40.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.274e-06 2023-09-30T17:02:40.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.661 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.661 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2023-09-30T17:02:40.661 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352650+0000", 2023-09-30T17:02:40.661 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4350000000000002e-06 2023-09-30T17:02:40.661 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2023-09-30T17:02:40.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352663+0000", 2023-09-30T17:02:40.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3726999999999999e-05 2023-09-30T17:02:40.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.662 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2023-09-30T17:02:40.662 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352675+0000", 2023-09-30T17:02:40.662 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1114000000000001e-05 2023-09-30T17:02:40.662 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.662 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:40.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352850+0000", 2023-09-30T17:02:40.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000175584 2023-09-30T17:02:40.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:40.663 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352855+0000", 2023-09-30T17:02:40.663 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0100000000000003e-06 2023-09-30T17:02:40.663 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.663 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.663 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:40.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.371933+0000", 2023-09-30T17:02:40.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019078023 2023-09-30T17:02:40.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2023-09-30T17:02:40.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.372003+0000", 2023-09-30T17:02:40.664 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9905000000000002e-05 2023-09-30T17:02:40.664 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.664 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.664 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2023-09-30T17:02:40.664 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.372145+0000", 2023-09-30T17:02:40.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000141939 2023-09-30T17:02:40.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2023-09-30T17:02:40.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.377025+0000", 2023-09-30T17:02:40.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048800930000000003 2023-09-30T17:02:40.665 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.665 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.665 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:40.665 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.377767+0000", 2023-09-30T17:02:40.665 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00074174500000000003 2023-09-30T17:02:40.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2023-09-30T17:02:40.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.377807+0000", 2023-09-30T17:02:40.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0454000000000003e-05 2023-09-30T17:02:40.666 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.666 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.666 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2023-09-30T17:02:40.666 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.377848+0000", 2023-09-30T17:02:40.666 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0484000000000001e-05 2023-09-30T17:02:40.666 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:40.667 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2023-09-30T17:02:40.667 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:40.667 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.667 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:40.667 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2023-09-30T17:02:18.352704+0000", 2023-09-30T17:02:40.667 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.273697883000001, 2023-09-30T17:02:40.667 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027898861, 2023-09-30T17:02:40.667 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2023-09-30T17:02:40.667 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:40.667 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2023-09-30T17:02:40.667 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2023-09-30T17:02:40.668 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352704+0000", 2023-09-30T17:02:40.668 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:40.668 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.668 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.668 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2023-09-30T17:02:40.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352704+0000", 2023-09-30T17:02:40.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:40.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2023-09-30T17:02:40.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352704+0000", 2023-09-30T17:02:40.669 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6700000000000003e-07 2023-09-30T17:02:40.669 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.669 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.669 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2023-09-30T17:02:40.669 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352709+0000", 2023-09-30T17:02:40.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2660000000000003e-06 2023-09-30T17:02:40.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2023-09-30T17:02:40.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352717+0000", 2023-09-30T17:02:40.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2630000000000003e-06 2023-09-30T17:02:40.670 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.670 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.670 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2023-09-30T17:02:40.670 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352723+0000", 2023-09-30T17:02:40.670 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5300000000000002e-06 2023-09-30T17:02:40.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:40.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352901+0000", 2023-09-30T17:02:40.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017788400000000001 2023-09-30T17:02:40.671 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.671 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.671 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:40.671 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352933+0000", 2023-09-30T17:02:40.671 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1550000000000001e-05 2023-09-30T17:02:40.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.672 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:40.672 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.372461+0000", 2023-09-30T17:02:40.672 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019527761000000001 2023-09-30T17:02:40.672 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.672 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2023-09-30T17:02:40.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.372575+0000", 2023-09-30T17:02:40.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011482899999999999 2023-09-30T17:02:40.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2023-09-30T17:02:40.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.372703+0000", 2023-09-30T17:02:40.673 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012711299999999999 2023-09-30T17:02:40.673 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.673 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.673 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2023-09-30T17:02:40.673 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.377032+0000", 2023-09-30T17:02:40.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043295 2023-09-30T17:02:40.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:40.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.380492+0000", 2023-09-30T17:02:40.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034599850000000001 2023-09-30T17:02:40.674 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.674 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.674 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2023-09-30T17:02:40.674 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.380557+0000", 2023-09-30T17:02:40.674 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5110999999999994e-05 2023-09-30T17:02:40.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.675 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2023-09-30T17:02:40.675 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.380603+0000", 2023-09-30T17:02:40.675 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5401999999999997e-05 2023-09-30T17:02:40.675 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:40.675 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2023-09-30T17:02:40.675 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:40.675 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.675 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.675 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:40.676 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2023-09-30T17:02:18.352735+0000", 2023-09-30T17:02:40.676 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.273666939999998, 2023-09-30T17:02:40.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027972103000000002, 2023-09-30T17:02:40.676 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2023-09-30T17:02:40.676 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:40.676 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2023-09-30T17:02:40.676 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.676 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2023-09-30T17:02:40.676 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352735+0000", 2023-09-30T17:02:40.676 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:40.676 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2023-09-30T17:02:40.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352735+0000", 2023-09-30T17:02:40.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:40.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.677 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2023-09-30T17:02:40.677 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352735+0000", 2023-09-30T17:02:40.677 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7e-07 2023-09-30T17:02:40.677 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.677 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2023-09-30T17:02:40.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352749+0000", 2023-09-30T17:02:40.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3380000000000001e-05 2023-09-30T17:02:40.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2023-09-30T17:02:40.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352757+0000", 2023-09-30T17:02:40.678 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2020000000000004e-06 2023-09-30T17:02:40.678 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.678 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.678 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2023-09-30T17:02:40.678 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352765+0000", 2023-09-30T17:02:40.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4030000000000007e-06 2023-09-30T17:02:40.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:40.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353014+0000", 2023-09-30T17:02:40.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024904199999999999 2023-09-30T17:02:40.679 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.679 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.679 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:40.679 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353023+0000", 2023-09-30T17:02:40.679 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1500000000000005e-06 2023-09-30T17:02:40.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:40.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.373009+0000", 2023-09-30T17:02:40.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019985780000000002 2023-09-30T17:02:40.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.680 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2023-09-30T17:02:40.680 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.373089+0000", 2023-09-30T17:02:40.680 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9908999999999997e-05 2023-09-30T17:02:40.680 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.680 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2023-09-30T17:02:40.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.373235+0000", 2023-09-30T17:02:40.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014556700000000001 2023-09-30T17:02:40.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2023-09-30T17:02:40.681 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.377038+0000", 2023-09-30T17:02:40.681 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038030500000000001 2023-09-30T17:02:40.681 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.681 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.681 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:40.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.380648+0000", 2023-09-30T17:02:40.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0036108300000000002 2023-09-30T17:02:40.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2023-09-30T17:02:40.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.380685+0000", 2023-09-30T17:02:40.682 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6992000000000001e-05 2023-09-30T17:02:40.682 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.682 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.682 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2023-09-30T17:02:40.682 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.380707+0000", 2023-09-30T17:02:40.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1328e-05 2023-09-30T17:02:40.683 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:40.683 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2023-09-30T17:02:40.683 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:40.683 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.683 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.683 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:40.683 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2023-09-30T17:02:18.352883+0000", 2023-09-30T17:02:40.683 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.273518414000002, 2023-09-30T17:02:40.683 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027919086999999999, 2023-09-30T17:02:40.683 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2023-09-30T17:02:40.683 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:40.684 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2023-09-30T17:02:40.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2023-09-30T17:02:40.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352883+0000", 2023-09-30T17:02:40.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:40.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.684 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.684 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2023-09-30T17:02:40.684 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352883+0000", 2023-09-30T17:02:40.684 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:40.684 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2023-09-30T17:02:40.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352884+0000", 2023-09-30T17:02:40.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4300000000000002e-07 2023-09-30T17:02:40.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.685 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2023-09-30T17:02:40.685 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352889+0000", 2023-09-30T17:02:40.685 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.276e-06 2023-09-30T17:02:40.685 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.685 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2023-09-30T17:02:40.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352901+0000", 2023-09-30T17:02:40.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1354e-05 2023-09-30T17:02:40.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2023-09-30T17:02:40.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352910+0000", 2023-09-30T17:02:40.686 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2590000000000006e-06 2023-09-30T17:02:40.686 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.686 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.686 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:40.686 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353075+0000", 2023-09-30T17:02:40.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016486199999999999 2023-09-30T17:02:40.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:40.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353080+0000", 2023-09-30T17:02:40.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6699999999999999e-06 2023-09-30T17:02:40.687 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.687 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.687 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:40.687 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.374106+0000", 2023-09-30T17:02:40.687 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021025769999999999 2023-09-30T17:02:40.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.688 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2023-09-30T17:02:40.688 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.374497+0000", 2023-09-30T17:02:40.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00039031599999999998 2023-09-30T17:02:40.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.688 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2023-09-30T17:02:40.688 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.374625+0000", 2023-09-30T17:02:40.688 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000128288 2023-09-30T17:02:40.688 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.688 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2023-09-30T17:02:40.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.377184+0000", 2023-09-30T17:02:40.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025590069999999999 2023-09-30T17:02:40.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:40.689 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.380747+0000", 2023-09-30T17:02:40.689 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00356281 2023-09-30T17:02:40.689 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.689 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.689 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2023-09-30T17:02:40.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.380778+0000", 2023-09-30T17:02:40.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1528e-05 2023-09-30T17:02:40.690 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.690 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.690 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2023-09-30T17:02:40.690 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.380802+0000", 2023-09-30T17:02:40.690 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4104000000000002e-05 2023-09-30T17:02:40.690 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:40.690 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2023-09-30T17:02:40.690 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:40.691 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.691 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:40.691 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2023-09-30T17:02:18.352934+0000", 2023-09-30T17:02:40.691 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.273467965999998, 2023-09-30T17:02:40.691 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.028004846999999999, 2023-09-30T17:02:40.691 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2023-09-30T17:02:40.691 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:40.691 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2023-09-30T17:02:40.691 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.691 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2023-09-30T17:02:40.691 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352934+0000", 2023-09-30T17:02:40.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:40.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2023-09-30T17:02:40.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352934+0000", 2023-09-30T17:02:40.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:40.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.692 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.692 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2023-09-30T17:02:40.692 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352934+0000", 2023-09-30T17:02:40.692 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2399999999999997e-07 2023-09-30T17:02:40.692 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2023-09-30T17:02:40.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352939+0000", 2023-09-30T17:02:40.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6689999999999997e-06 2023-09-30T17:02:40.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.693 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2023-09-30T17:02:40.693 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352958+0000", 2023-09-30T17:02:40.693 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9244000000000001e-05 2023-09-30T17:02:40.693 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.693 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2023-09-30T17:02:40.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352966+0000", 2023-09-30T17:02:40.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.396e-06 2023-09-30T17:02:40.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:40.694 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353104+0000", 2023-09-30T17:02:40.694 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013801500000000001 2023-09-30T17:02:40.694 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.694 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.694 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:40.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353107+0000", 2023-09-30T17:02:40.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7780000000000001e-06 2023-09-30T17:02:40.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:40.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.376217+0000", 2023-09-30T17:02:40.695 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023109797000000001 2023-09-30T17:02:40.695 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.695 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.695 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2023-09-30T17:02:40.695 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.376310+0000", 2023-09-30T17:02:40.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2900999999999997e-05 2023-09-30T17:02:40.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2023-09-30T17:02:40.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.376449+0000", 2023-09-30T17:02:40.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013920499999999999 2023-09-30T17:02:40.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.696 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.696 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2023-09-30T17:02:40.696 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.379037+0000", 2023-09-30T17:02:40.696 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025876570000000002 2023-09-30T17:02:40.696 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.697 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:40.697 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.380838+0000", 2023-09-30T17:02:40.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018010229999999999 2023-09-30T17:02:40.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.697 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2023-09-30T17:02:40.697 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.380901+0000", 2023-09-30T17:02:40.697 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2985999999999996e-05 2023-09-30T17:02:40.697 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.697 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.697 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2023-09-30T17:02:40.698 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.380939+0000", 2023-09-30T17:02:40.698 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7452e-05 2023-09-30T17:02:40.698 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:40.698 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2023-09-30T17:02:40.698 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:40.698 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.698 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.698 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:40.698 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2023-09-30T17:02:18.353000+0000", 2023-09-30T17:02:40.698 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.273401795000002, 2023-09-30T17:02:40.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020772597, 2023-09-30T17:02:40.699 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2023-09-30T17:02:40.699 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:40.699 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2023-09-30T17:02:40.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2023-09-30T17:02:40.699 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353000+0000", 2023-09-30T17:02:40.699 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:40.699 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.699 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.699 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2023-09-30T17:02:40.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353000+0000", 2023-09-30T17:02:40.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:40.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2023-09-30T17:02:40.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353001+0000", 2023-09-30T17:02:40.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3200000000000004e-07 2023-09-30T17:02:40.700 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.700 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.700 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2023-09-30T17:02:40.700 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353005+0000", 2023-09-30T17:02:40.700 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8729999999999998e-06 2023-09-30T17:02:40.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2023-09-30T17:02:40.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353015+0000", 2023-09-30T17:02:40.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8460000000000003e-06 2023-09-30T17:02:40.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.701 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.701 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2023-09-30T17:02:40.701 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353045+0000", 2023-09-30T17:02:40.701 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9658e-05 2023-09-30T17:02:40.701 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:40.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353100+0000", 2023-09-30T17:02:40.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5367e-05 2023-09-30T17:02:40.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.702 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2023-09-30T17:02:40.702 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353106+0000", 2023-09-30T17:02:40.702 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7910000000000001e-06 2023-09-30T17:02:40.702 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.702 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.703 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:40.703 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.357335+0000", 2023-09-30T17:02:40.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042287009999999996 2023-09-30T17:02:40.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.703 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2023-09-30T17:02:40.703 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.357559+0000", 2023-09-30T17:02:40.703 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022433300000000001 2023-09-30T17:02:40.703 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.703 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.703 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2023-09-30T17:02:40.704 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.358628+0000", 2023-09-30T17:02:40.704 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0010683999999999999 2023-09-30T17:02:40.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.704 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2023-09-30T17:02:40.704 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.372097+0000", 2023-09-30T17:02:40.704 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013469907999999999 2023-09-30T17:02:40.704 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.704 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.704 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:40.704 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.373577+0000", 2023-09-30T17:02:40.704 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001479494 2023-09-30T17:02:40.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.705 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2023-09-30T17:02:40.705 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.373724+0000", 2023-09-30T17:02:40.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014686199999999999 2023-09-30T17:02:40.705 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.705 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.705 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2023-09-30T17:02:40.705 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.373772+0000", 2023-09-30T17:02:40.705 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8631999999999998e-05 2023-09-30T17:02:40.705 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:40.706 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2023-09-30T17:02:40.706 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:40.706 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.706 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:40.706 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2023-09-30T17:02:18.353071+0000", 2023-09-30T17:02:40.706 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.273331090999999, 2023-09-30T17:02:40.706 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024860190000000001, 2023-09-30T17:02:40.706 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2023-09-30T17:02:40.706 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:40.706 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2023-09-30T17:02:40.706 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2023-09-30T17:02:40.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353071+0000", 2023-09-30T17:02:40.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:40.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2023-09-30T17:02:40.707 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353071+0000", 2023-09-30T17:02:40.707 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:40.707 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.707 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.707 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2023-09-30T17:02:40.708 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353071+0000", 2023-09-30T17:02:40.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2500000000000005e-07 2023-09-30T17:02:40.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.708 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2023-09-30T17:02:40.708 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353076+0000", 2023-09-30T17:02:40.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0810000000000001e-06 2023-09-30T17:02:40.708 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.708 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.708 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2023-09-30T17:02:40.708 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353084+0000", 2023-09-30T17:02:40.708 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0250000000000002e-06 2023-09-30T17:02:40.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.709 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.709 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2023-09-30T17:02:40.709 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353092+0000", 2023-09-30T17:02:40.709 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4250000000000001e-06 2023-09-30T17:02:40.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.709 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.709 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:40.709 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353145+0000", 2023-09-30T17:02:40.709 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3236999999999999e-05 2023-09-30T17:02:40.709 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.709 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.710 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:40.710 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353150+0000", 2023-09-30T17:02:40.710 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0989999999999998e-06 2023-09-30T17:02:40.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.710 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:40.710 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.360509+0000", 2023-09-30T17:02:40.710 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0073590690000000002 2023-09-30T17:02:40.710 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.710 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.710 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2023-09-30T17:02:40.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.360594+0000", 2023-09-30T17:02:40.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5345000000000004e-05 2023-09-30T17:02:40.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2023-09-30T17:02:40.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.360743+0000", 2023-09-30T17:02:40.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000148932 2023-09-30T17:02:40.711 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.711 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.711 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2023-09-30T17:02:40.711 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.374845+0000", 2023-09-30T17:02:40.711 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014101948 2023-09-30T17:02:40.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:40.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.377844+0000", 2023-09-30T17:02:40.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002998616 2023-09-30T17:02:40.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.712 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2023-09-30T17:02:40.712 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.377903+0000", 2023-09-30T17:02:40.712 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9555000000000002e-05 2023-09-30T17:02:40.712 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.712 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.713 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2023-09-30T17:02:40.713 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.377931+0000", 2023-09-30T17:02:40.713 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7233000000000002e-05 2023-09-30T17:02:40.713 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:40.713 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2023-09-30T17:02:40.713 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:40.713 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.713 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.713 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:40.713 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2023-09-30T17:02:18.353105+0000", 2023-09-30T17:02:40.713 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.273296471999998, 2023-09-30T17:02:40.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.029421313000000001, 2023-09-30T17:02:40.714 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2023-09-30T17:02:40.714 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:40.714 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2023-09-30T17:02:40.714 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.714 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2023-09-30T17:02:40.714 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353105+0000", 2023-09-30T17:02:40.714 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:40.714 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.714 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.714 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2023-09-30T17:02:40.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353105+0000", 2023-09-30T17:02:40.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:40.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2023-09-30T17:02:40.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353106+0000", 2023-09-30T17:02:40.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9500000000000002e-07 2023-09-30T17:02:40.715 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.715 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.715 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2023-09-30T17:02:40.715 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353113+0000", 2023-09-30T17:02:40.715 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3769999999999998e-06 2023-09-30T17:02:40.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2023-09-30T17:02:40.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353121+0000", 2023-09-30T17:02:40.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1850000000000004e-06 2023-09-30T17:02:40.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.716 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2023-09-30T17:02:40.716 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353127+0000", 2023-09-30T17:02:40.716 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9240000000000004e-06 2023-09-30T17:02:40.716 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.716 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:40.717 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353154+0000", 2023-09-30T17:02:40.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6472999999999999e-05 2023-09-30T17:02:40.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2023-09-30T17:02:40.717 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353158+0000", 2023-09-30T17:02:40.717 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.765e-06 2023-09-30T17:02:40.717 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.717 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.717 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:40.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.377385+0000", 2023-09-30T17:02:40.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024227697999999999 2023-09-30T17:02:40.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2023-09-30T17:02:40.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.377482+0000", 2023-09-30T17:02:40.718 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6884000000000003e-05 2023-09-30T17:02:40.718 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.718 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.718 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 1", 2023-09-30T17:02:40.718 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.377562+0000", 2023-09-30T17:02:40.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9373000000000001e-05 2023-09-30T17:02:40.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.719 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2023-09-30T17:02:40.719 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.379336+0000", 2023-09-30T17:02:40.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0017747030000000001 2023-09-30T17:02:40.719 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.719 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.719 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:40.719 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.382435+0000", 2023-09-30T17:02:40.719 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030985980000000002 2023-09-30T17:02:40.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2023-09-30T17:02:40.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.382489+0000", 2023-09-30T17:02:40.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3844000000000002e-05 2023-09-30T17:02:40.720 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.720 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.720 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2023-09-30T17:02:40.720 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.382526+0000", 2023-09-30T17:02:40.720 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7793999999999998e-05 2023-09-30T17:02:40.720 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:40.720 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2023-09-30T17:02:40.721 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:40.721 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.721 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:40.721 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2023-09-30T17:02:18.353138+0000", 2023-09-30T17:02:40.721 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.273263176, 2023-09-30T17:02:40.721 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.029470686999999999, 2023-09-30T17:02:40.721 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2023-09-30T17:02:40.721 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:40.721 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2023-09-30T17:02:40.721 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.721 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2023-09-30T17:02:40.722 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353138+0000", 2023-09-30T17:02:40.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:40.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.722 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2023-09-30T17:02:40.722 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353138+0000", 2023-09-30T17:02:40.722 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:40.722 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.722 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.722 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2023-09-30T17:02:40.722 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353139+0000", 2023-09-30T17:02:40.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5999999999999999e-07 2023-09-30T17:02:40.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2023-09-30T17:02:40.723 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353151+0000", 2023-09-30T17:02:40.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1724e-05 2023-09-30T17:02:40.723 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.723 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.723 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2023-09-30T17:02:40.723 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353158+0000", 2023-09-30T17:02:40.723 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.311e-06 2023-09-30T17:02:40.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2023-09-30T17:02:40.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353165+0000", 2023-09-30T17:02:40.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7710000000000001e-06 2023-09-30T17:02:40.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.724 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:40.724 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353206+0000", 2023-09-30T17:02:40.724 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0927999999999998e-05 2023-09-30T17:02:40.724 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.724 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:40.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353210+0000", 2023-09-30T17:02:40.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4129999999999999e-06 2023-09-30T17:02:40.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:40.725 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.377847+0000", 2023-09-30T17:02:40.725 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024636974999999998 2023-09-30T17:02:40.725 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.725 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.725 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2023-09-30T17:02:40.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.377920+0000", 2023-09-30T17:02:40.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3379000000000003e-05 2023-09-30T17:02:40.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 1", 2023-09-30T17:02:40.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.378019+0000", 2023-09-30T17:02:40.726 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8188000000000002e-05 2023-09-30T17:02:40.726 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.726 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.726 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2023-09-30T17:02:40.726 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.379339+0000", 2023-09-30T17:02:40.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0013208269999999999 2023-09-30T17:02:40.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:40.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.382555+0000", 2023-09-30T17:02:40.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032160719999999999 2023-09-30T17:02:40.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.727 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.727 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2023-09-30T17:02:40.727 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.382588+0000", 2023-09-30T17:02:40.727 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2551000000000001e-05 2023-09-30T17:02:40.727 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.728 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2023-09-30T17:02:40.728 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.382609+0000", 2023-09-30T17:02:40.728 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1087999999999999e-05 2023-09-30T17:02:40.728 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:40.728 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2023-09-30T17:02:40.728 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:40.728 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.728 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.728 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:40.728 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2023-09-30T17:02:18.353177+0000", 2023-09-30T17:02:40.728 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.273224156000001, 2023-09-30T17:02:40.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021468628999999999, 2023-09-30T17:02:40.729 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2023-09-30T17:02:40.729 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:40.729 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2023-09-30T17:02:40.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.729 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2023-09-30T17:02:40.729 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353177+0000", 2023-09-30T17:02:40.729 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:40.729 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.729 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.729 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2023-09-30T17:02:40.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353177+0000", 2023-09-30T17:02:40.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:40.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2023-09-30T17:02:40.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353178+0000", 2023-09-30T17:02:40.730 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6400000000000002e-07 2023-09-30T17:02:40.730 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.730 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.730 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2023-09-30T17:02:40.730 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353194+0000", 2023-09-30T17:02:40.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6368999999999999e-05 2023-09-30T17:02:40.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2023-09-30T17:02:40.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353202+0000", 2023-09-30T17:02:40.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6850000000000001e-06 2023-09-30T17:02:40.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.731 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.731 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2023-09-30T17:02:40.731 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353208+0000", 2023-09-30T17:02:40.731 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1500000000000004e-06 2023-09-30T17:02:40.731 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:40.732 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353264+0000", 2023-09-30T17:02:40.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.592e-05 2023-09-30T17:02:40.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.732 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2023-09-30T17:02:40.732 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353270+0000", 2023-09-30T17:02:40.732 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5729999999999998e-06 2023-09-30T17:02:40.732 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.732 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:40.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.359790+0000", 2023-09-30T17:02:40.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0065198909999999999 2023-09-30T17:02:40.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2023-09-30T17:02:40.733 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.359923+0000", 2023-09-30T17:02:40.733 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000133409 2023-09-30T17:02:40.733 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.733 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.733 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 1", 2023-09-30T17:02:40.734 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.360093+0000", 2023-09-30T17:02:40.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017002799999999999 2023-09-30T17:02:40.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.734 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2023-09-30T17:02:40.734 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.363179+0000", 2023-09-30T17:02:40.734 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003086175 2023-09-30T17:02:40.734 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.734 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.734 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:40.734 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.374547+0000", 2023-09-30T17:02:40.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011367393999999999 2023-09-30T17:02:40.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.735 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2023-09-30T17:02:40.735 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.374604+0000", 2023-09-30T17:02:40.735 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.698e-05 2023-09-30T17:02:40.735 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.735 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.735 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2023-09-30T17:02:40.735 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.374646+0000", 2023-09-30T17:02:40.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2490999999999997e-05 2023-09-30T17:02:40.736 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:40.736 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2023-09-30T17:02:40.736 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:40.736 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.736 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.736 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:40.736 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2023-09-30T17:02:18.353229+0000", 2023-09-30T17:02:40.736 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.273172921, 2023-09-30T17:02:40.736 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027370586999999998, 2023-09-30T17:02:40.736 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2023-09-30T17:02:40.736 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:40.737 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2023-09-30T17:02:40.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2023-09-30T17:02:40.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353229+0000", 2023-09-30T17:02:40.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:40.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.737 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.737 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2023-09-30T17:02:40.737 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353229+0000", 2023-09-30T17:02:40.737 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:40.737 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.738 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2023-09-30T17:02:40.738 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353229+0000", 2023-09-30T17:02:40.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5300000000000003e-07 2023-09-30T17:02:40.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.738 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2023-09-30T17:02:40.738 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353235+0000", 2023-09-30T17:02:40.738 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0159999999999997e-06 2023-09-30T17:02:40.738 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.738 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2023-09-30T17:02:40.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353245+0000", 2023-09-30T17:02:40.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8239999999999995e-06 2023-09-30T17:02:40.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2023-09-30T17:02:40.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353251+0000", 2023-09-30T17:02:40.739 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.105e-06 2023-09-30T17:02:40.739 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.739 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.739 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:40.739 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353303+0000", 2023-09-30T17:02:40.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1118000000000001e-05 2023-09-30T17:02:40.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:40.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353327+0000", 2023-09-30T17:02:40.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4494999999999998e-05 2023-09-30T17:02:40.740 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.740 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.740 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:40.740 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.372517+0000", 2023-09-30T17:02:40.740 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019190005 2023-09-30T17:02:40.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.741 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2023-09-30T17:02:40.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.372655+0000", 2023-09-30T17:02:40.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013773 2023-09-30T17:02:40.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.741 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.741 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2023-09-30T17:02:40.741 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.372793+0000", 2023-09-30T17:02:40.741 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000138417 2023-09-30T17:02:40.741 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2023-09-30T17:02:40.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.376928+0000", 2023-09-30T17:02:40.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041351139999999996 2023-09-30T17:02:40.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:40.742 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.380517+0000", 2023-09-30T17:02:40.742 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035886469999999999 2023-09-30T17:02:40.742 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.742 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.742 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2023-09-30T17:02:40.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.380560+0000", 2023-09-30T17:02:40.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3415999999999999e-05 2023-09-30T17:02:40.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.743 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.743 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2023-09-30T17:02:40.743 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.380599+0000", 2023-09-30T17:02:40.743 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8946999999999998e-05 2023-09-30T17:02:40.743 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:40.743 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2023-09-30T17:02:40.743 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:40.743 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.744 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:40.744 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2023-09-30T17:02:18.353267+0000", 2023-09-30T17:02:40.744 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.273134460000001, 2023-09-30T17:02:40.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022828642999999999, 2023-09-30T17:02:40.744 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2023-09-30T17:02:40.744 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:40.744 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2023-09-30T17:02:40.744 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.744 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2023-09-30T17:02:40.744 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353267+0000", 2023-09-30T17:02:40.744 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:40.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2023-09-30T17:02:40.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353267+0000", 2023-09-30T17:02:40.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:40.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.745 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2023-09-30T17:02:40.745 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353268+0000", 2023-09-30T17:02:40.745 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4600000000000004e-07 2023-09-30T17:02:40.745 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.745 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2023-09-30T17:02:40.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353274+0000", 2023-09-30T17:02:40.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2090000000000002e-06 2023-09-30T17:02:40.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2023-09-30T17:02:40.746 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353292+0000", 2023-09-30T17:02:40.746 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8281999999999999e-05 2023-09-30T17:02:40.746 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.746 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.746 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2023-09-30T17:02:40.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353313+0000", 2023-09-30T17:02:40.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.065e-05 2023-09-30T17:02:40.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:40.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353907+0000", 2023-09-30T17:02:40.747 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000594219 2023-09-30T17:02:40.747 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.747 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.747 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2023-09-30T17:02:40.747 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353913+0000", 2023-09-30T17:02:40.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.117e-06 2023-09-30T17:02:40.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:40.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.363363+0000", 2023-09-30T17:02:40.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0094493890000000007 2023-09-30T17:02:40.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.748 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.748 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2023-09-30T17:02:40.748 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.363470+0000", 2023-09-30T17:02:40.748 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106891 2023-09-30T17:02:40.748 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2023-09-30T17:02:40.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.363571+0000", 2023-09-30T17:02:40.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101745 2023-09-30T17:02:40.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.749 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:40.749 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.375870+0000", 2023-09-30T17:02:40.749 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01229859 2023-09-30T17:02:40.749 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.749 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2023-09-30T17:02:40.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.375885+0000", 2023-09-30T17:02:40.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4849e-05 2023-09-30T17:02:40.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2023-09-30T17:02:40.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.375936+0000", 2023-09-30T17:02:40.750 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1125000000000003e-05 2023-09-30T17:02:40.750 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.750 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.750 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2023-09-30T17:02:40.750 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.376096+0000", 2023-09-30T17:02:40.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015993100000000001 2023-09-30T17:02:40.751 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:40.751 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2023-09-30T17:02:40.751 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:40.751 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.751 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.751 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:40.751 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2023-09-30T17:02:18.353855+0000", 2023-09-30T17:02:40.751 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.272546264999999, 2023-09-30T17:02:40.751 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026925168999999999, 2023-09-30T17:02:40.751 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2023-09-30T17:02:40.751 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:40.752 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2023-09-30T17:02:40.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2023-09-30T17:02:40.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353855+0000", 2023-09-30T17:02:40.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:40.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.752 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.752 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2023-09-30T17:02:40.752 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353855+0000", 2023-09-30T17:02:40.752 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:40.752 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2023-09-30T17:02:40.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353856+0000", 2023-09-30T17:02:40.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3200000000000004e-07 2023-09-30T17:02:40.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2023-09-30T17:02:40.753 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353866+0000", 2023-09-30T17:02:40.753 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.995e-06 2023-09-30T17:02:40.753 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.753 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.753 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2023-09-30T17:02:40.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353888+0000", 2023-09-30T17:02:40.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1501e-05 2023-09-30T17:02:40.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2023-09-30T17:02:40.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353897+0000", 2023-09-30T17:02:40.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2930000000000006e-06 2023-09-30T17:02:40.754 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.754 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.754 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:40.754 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.354214+0000", 2023-09-30T17:02:40.754 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031667899999999999 2023-09-30T17:02:40.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:40.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.354224+0000", 2023-09-30T17:02:40.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0183000000000001e-05 2023-09-30T17:02:40.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.755 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:40.755 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.373813+0000", 2023-09-30T17:02:40.755 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019589123 2023-09-30T17:02:40.755 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.755 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2023-09-30T17:02:40.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.373949+0000", 2023-09-30T17:02:40.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000135716 2023-09-30T17:02:40.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2023-09-30T17:02:40.756 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.374086+0000", 2023-09-30T17:02:40.756 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013770500000000001 2023-09-30T17:02:40.756 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.756 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.756 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2023-09-30T17:02:40.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.377359+0000", 2023-09-30T17:02:40.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00327225 2023-09-30T17:02:40.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:40.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.380664+0000", 2023-09-30T17:02:40.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003305672 2023-09-30T17:02:40.757 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.757 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.757 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2023-09-30T17:02:40.757 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.380727+0000", 2023-09-30T17:02:40.757 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2748000000000003e-05 2023-09-30T17:02:40.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.758 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2023-09-30T17:02:40.758 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.380781+0000", 2023-09-30T17:02:40.758 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3471999999999999e-05 2023-09-30T17:02:40.758 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:40.758 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2023-09-30T17:02:40.758 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:40.758 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.758 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.758 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:26 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:40.758 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2023-09-30T17:02:18.354158+0000", 2023-09-30T17:02:40.759 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.272243402000001, 2023-09-30T17:02:40.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021615973, 2023-09-30T17:02:40.759 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2023-09-30T17:02:40.759 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:40.759 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2023-09-30T17:02:40.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.759 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2023-09-30T17:02:40.759 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.354158+0000", 2023-09-30T17:02:40.759 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:40.759 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.759 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2023-09-30T17:02:40.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.354158+0000", 2023-09-30T17:02:40.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:40.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2023-09-30T17:02:40.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.354159+0000", 2023-09-30T17:02:40.760 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5199999999999995e-07 2023-09-30T17:02:40.760 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.760 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.760 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2023-09-30T17:02:40.760 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.354166+0000", 2023-09-30T17:02:40.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1010000000000003e-06 2023-09-30T17:02:40.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2023-09-30T17:02:40.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.354236+0000", 2023-09-30T17:02:40.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9417000000000003e-05 2023-09-30T17:02:40.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.761 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.761 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2023-09-30T17:02:40.761 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.354243+0000", 2023-09-30T17:02:40.761 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4279999999999999e-06 2023-09-30T17:02:40.761 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:40.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.360488+0000", 2023-09-30T17:02:40.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0062447520000000001 2023-09-30T17:02:40.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.762 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2023-09-30T17:02:40.762 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.360607+0000", 2023-09-30T17:02:40.762 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011969 2023-09-30T17:02:40.762 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.762 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 1", 2023-09-30T17:02:40.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.360753+0000", 2023-09-30T17:02:40.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000145768 2023-09-30T17:02:40.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2023-09-30T17:02:40.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.363914+0000", 2023-09-30T17:02:40.763 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031611069999999998 2023-09-30T17:02:40.763 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.763 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.763 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:40.763 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.375134+0000", 2023-09-30T17:02:40.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011219665 2023-09-30T17:02:40.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2023-09-30T17:02:40.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.375200+0000", 2023-09-30T17:02:40.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6311999999999998e-05 2023-09-30T17:02:40.764 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.764 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.764 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2023-09-30T17:02:40.764 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.375774+0000", 2023-09-30T17:02:40.764 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00057388100000000004 2023-09-30T17:02:40.765 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:40.765 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2023-09-30T17:02:40.765 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:40.765 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.765 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.765 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:29 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:40.765 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2023-09-30T17:02:18.354261+0000", 2023-09-30T17:02:40.765 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.272140290999999, 2023-09-30T17:02:40.765 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023631425000000001, 2023-09-30T17:02:40.765 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2023-09-30T17:02:40.765 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:40.765 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2023-09-30T17:02:40.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2023-09-30T17:02:40.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.354261+0000", 2023-09-30T17:02:40.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:40.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.766 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2023-09-30T17:02:40.766 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.354261+0000", 2023-09-30T17:02:40.766 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:40.766 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.766 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2023-09-30T17:02:40.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.354262+0000", 2023-09-30T17:02:40.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1800000000000005e-07 2023-09-30T17:02:40.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2023-09-30T17:02:40.767 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.354267+0000", 2023-09-30T17:02:40.767 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6890000000000003e-06 2023-09-30T17:02:40.767 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.767 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.767 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2023-09-30T17:02:40.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.354323+0000", 2023-09-30T17:02:40.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6051000000000003e-05 2023-09-30T17:02:40.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2023-09-30T17:02:40.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.354332+0000", 2023-09-30T17:02:40.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2909999999999996e-06 2023-09-30T17:02:40.768 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.768 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.768 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:40.768 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.354389+0000", 2023-09-30T17:02:40.768 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7015000000000002e-05 2023-09-30T17:02:40.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2023-09-30T17:02:40.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.354396+0000", 2023-09-30T17:02:40.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8079999999999999e-06 2023-09-30T17:02:40.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.769 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.769 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:40.769 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.360121+0000", 2023-09-30T17:02:40.769 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0057245320000000001 2023-09-30T17:02:40.769 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2023-09-30T17:02:40.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.360253+0000", 2023-09-30T17:02:40.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000132514 2023-09-30T17:02:40.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.770 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.770 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2023-09-30T17:02:40.770 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.360494+0000", 2023-09-30T17:02:40.770 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000241258 2023-09-30T17:02:40.770 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2023-09-30T17:02:40.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.374022+0000", 2023-09-30T17:02:40.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013527627 2023-09-30T17:02:40.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:40.771 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.377760+0000", 2023-09-30T17:02:40.771 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037381099999999998 2023-09-30T17:02:40.771 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.771 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.771 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2023-09-30T17:02:40.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.377854+0000", 2023-09-30T17:02:40.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3511999999999995e-05 2023-09-30T17:02:40.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.772 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2023-09-30T17:02:40.772 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.377893+0000", 2023-09-30T17:02:40.772 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9199999999999997e-05 2023-09-30T17:02:40.772 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:40.772 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2023-09-30T17:02:40.772 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:40.772 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.772 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.773 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:40.773 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2023-09-30T17:02:18.354348+0000", 2023-09-30T17:02:40.773 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 22.272053473, 2023-09-30T17:02:40.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026568931, 2023-09-30T17:02:40.773 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2023-09-30T17:02:40.773 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2023-09-30T17:02:40.773 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2023-09-30T17:02:40.773 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.773 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2023-09-30T17:02:40.773 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.354348+0000", 2023-09-30T17:02:40.773 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:40.773 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2023-09-30T17:02:40.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.354348+0000", 2023-09-30T17:02:40.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:40.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.774 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2023-09-30T17:02:40.774 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.354349+0000", 2023-09-30T17:02:40.774 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3600000000000002e-07 2023-09-30T17:02:40.774 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.774 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2023-09-30T17:02:40.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.354353+0000", 2023-09-30T17:02:40.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9500000000000003e-06 2023-09-30T17:02:40.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2023-09-30T17:02:40.775 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.354366+0000", 2023-09-30T17:02:40.775 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2632999999999999e-05 2023-09-30T17:02:40.775 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.775 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.775 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2023-09-30T17:02:40.777 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.354373+0000", 2023-09-30T17:02:40.777 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4070000000000004e-06 2023-09-30T17:02:40.777 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:40.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.354487+0000", 2023-09-30T17:02:40.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0001145 2023-09-30T17:02:40.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:40.778 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.354493+0000", 2023-09-30T17:02:40.778 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0869999999999997e-06 2023-09-30T17:02:40.778 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.778 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.778 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:40.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.375266+0000", 2023-09-30T17:02:40.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020773335 2023-09-30T17:02:40.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2023-09-30T17:02:40.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.376029+0000", 2023-09-30T17:02:40.779 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00076351900000000005 2023-09-30T17:02:40.779 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:40.779 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:40.779 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2023-09-30T17:02:40.779 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.380917+0000", 2023-09-30T17:02:40.780 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048876639999999999 2023-09-30T17:02:40.780 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:40.780 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2023-09-30T17:02:40.780 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:40.780 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:40.780 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2023-09-30T17:02:40.780 INFO:teuthology.orchestra.run.smithi134.stdout:} 2023-09-30T17:02:40.782 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:02:40.782 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:40.782+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:40.882 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:40.882+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:40.928 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:02:40.928 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:02:40.928 INFO:teuthology.orchestra.run.smithi031.stdout: "num_ops": 0 2023-09-30T17:02:40.928 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:02:40.939 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:02:40.983 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:40.984+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:41.084 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:41.084+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:41.113 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:02:41.113 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:02:41.113 INFO:teuthology.orchestra.run.smithi031.stdout: "complaint_time": 30, 2023-09-30T17:02:41.113 INFO:teuthology.orchestra.run.smithi031.stdout: "num_blocked_ops": 0 2023-09-30T17:02:41.113 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:02:41.123 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:02:41.186 INFO:tasks.ceph.osd.2.smithi134.stderr:2023-09-30T17:02:41.186+0000 7efd10b20700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 96961) UID: 0 2023-09-30T17:02:41.287 INFO:tasks.ceph.osd.2.smithi134.stderr:2023-09-30T17:02:41.287+0000 7efd10b20700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 96961) UID: 0 2023-09-30T17:02:41.297 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:02:41.298 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 20, 2023-09-30T17:02:41.298 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 600, 2023-09-30T17:02:41.298 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:02:41.298 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.298 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:32 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'18, mlcod=11'14)", 2023-09-30T17:02:41.298 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:02:41.298 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 33.935050310999998, 2023-09-30T17:02:41.298 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051629809999999996, 2023-09-30T17:02:41.298 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:41.298 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:41.298 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:41.299 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.299 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:41.299 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:02:41.299 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:41.299 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.299 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.299 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:41.299 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:02:41.299 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:41.299 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.300 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.300 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:41.300 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:02:41.300 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2099999999999996e-07 2023-09-30T17:02:41.300 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.300 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.300 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:41.300 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361407+0000", 2023-09-30T17:02:41.300 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7499e-05 2023-09-30T17:02:41.300 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.300 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.301 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:41.301 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361418+0000", 2023-09-30T17:02:41.301 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1127999999999999e-05 2023-09-30T17:02:41.301 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.301 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.301 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:41.301 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361423+0000", 2023-09-30T17:02:41.301 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1930000000000001e-06 2023-09-30T17:02:41.302 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.302 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.302 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:41.302 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361476+0000", 2023-09-30T17:02:41.302 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3399000000000002e-05 2023-09-30T17:02:41.302 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.302 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.302 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:41.302 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361496+0000", 2023-09-30T17:02:41.302 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9638000000000001e-05 2023-09-30T17:02:41.302 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.366474+0000", 2023-09-30T17:02:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0049778829999999998 2023-09-30T17:02:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.366512+0000", 2023-09-30T17:02:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7620000000000002e-05 2023-09-30T17:02:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:41.304 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:41.304 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.304 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.304 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:37 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'23, mlcod=11'15)", 2023-09-30T17:02:41.304 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:02:41.304 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 33.932448313999998, 2023-09-30T17:02:41.304 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053985689999999998, 2023-09-30T17:02:41.304 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:41.304 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:41.304 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:41.304 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.305 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:41.305 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:02:41.305 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:41.305 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.305 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.305 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:41.305 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:02:41.305 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:41.305 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.305 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.305 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:41.306 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:02:41.306 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4400000000000001e-07 2023-09-30T17:02:41.306 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.306 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.306 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:41.306 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363956+0000", 2023-09-30T17:02:41.306 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.921e-06 2023-09-30T17:02:41.306 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.306 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.306 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:41.306 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363966+0000", 2023-09-30T17:02:41.307 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0351e-05 2023-09-30T17:02:41.307 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.307 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.307 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:41.307 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363971+0000", 2023-09-30T17:02:41.307 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.023e-06 2023-09-30T17:02:41.307 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.307 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.307 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:41.307 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.364013+0000", 2023-09-30T17:02:41.307 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1575000000000001e-05 2023-09-30T17:02:41.308 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.308 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.308 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:41.308 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.364026+0000", 2023-09-30T17:02:41.308 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3044000000000001e-05 2023-09-30T17:02:41.308 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.308 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.308 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:41.308 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.369308+0000", 2023-09-30T17:02:41.308 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005282152 2023-09-30T17:02:41.308 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.309 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.309 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:41.309 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.369349+0000", 2023-09-30T17:02:41.309 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1059000000000001e-05 2023-09-30T17:02:41.309 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:41.309 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:41.309 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:41.309 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.309 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.309 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:155 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'109, mlcod=11'105)", 2023-09-30T17:02:41.309 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:02:41.309 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 33.450752627999996, 2023-09-30T17:02:41.310 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053867639999999996, 2023-09-30T17:02:41.310 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:41.310 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:41.310 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:41.310 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.310 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:41.310 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:02:41.310 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:41.310 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.310 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.311 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:41.311 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:02:41.311 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:41.311 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.311 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.311 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:41.311 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845647+0000", 2023-09-30T17:02:41.311 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7599999999999997e-07 2023-09-30T17:02:41.311 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.311 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.311 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:41.312 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845699+0000", 2023-09-30T17:02:41.312 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1758000000000001e-05 2023-09-30T17:02:41.312 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.312 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.312 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:41.312 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845708+0000", 2023-09-30T17:02:41.312 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2159999999999995e-06 2023-09-30T17:02:41.312 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.312 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.312 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:41.312 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845712+0000", 2023-09-30T17:02:41.313 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2579999999999997e-06 2023-09-30T17:02:41.313 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.313 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.313 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:41.313 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845756+0000", 2023-09-30T17:02:41.313 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4119999999999998e-05 2023-09-30T17:02:41.313 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.313 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.313 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:41.313 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845779+0000", 2023-09-30T17:02:41.314 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2311e-05 2023-09-30T17:02:41.314 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.314 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.314 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:41.314 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.850982+0000", 2023-09-30T17:02:41.314 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005203053 2023-09-30T17:02:41.314 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.314 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.314 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:41.314 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851033+0000", 2023-09-30T17:02:41.315 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1471999999999998e-05 2023-09-30T17:02:41.315 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:41.315 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:41.315 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:41.315 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.315 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.315 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:156 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'110, mlcod=11'105)", 2023-09-30T17:02:41.315 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:02:41.315 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 33.450219701999998, 2023-09-30T17:02:41.315 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0052834759999999996, 2023-09-30T17:02:41.315 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:41.315 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:41.316 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:41.316 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.316 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:41.316 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:02:41.316 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:41.316 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.316 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.316 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:41.316 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:02:41.316 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:41.316 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.317 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.317 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:41.317 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846180+0000", 2023-09-30T17:02:41.317 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6300000000000005e-07 2023-09-30T17:02:41.317 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.317 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.317 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:41.317 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846184+0000", 2023-09-30T17:02:41.317 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3789999999999999e-06 2023-09-30T17:02:41.317 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.317 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.318 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:41.318 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846195+0000", 2023-09-30T17:02:41.318 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0778000000000001e-05 2023-09-30T17:02:41.318 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.318 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.318 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:41.318 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846200+0000", 2023-09-30T17:02:41.318 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1540000000000001e-06 2023-09-30T17:02:41.318 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.318 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.319 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:41.319 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846274+0000", 2023-09-30T17:02:41.319 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4129999999999997e-05 2023-09-30T17:02:41.319 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.319 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.319 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:41.319 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846286+0000", 2023-09-30T17:02:41.319 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1744e-05 2023-09-30T17:02:41.319 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.319 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.319 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:41.319 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851432+0000", 2023-09-30T17:02:41.320 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051462110000000004 2023-09-30T17:02:41.320 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.320 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.320 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:41.320 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851463+0000", 2023-09-30T17:02:41.320 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0516999999999999e-05 2023-09-30T17:02:41.320 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:41.320 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:41.320 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:41.320 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.320 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.321 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:203 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'149, mlcod=11'145)", 2023-09-30T17:02:41.321 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:02:41.321 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 33.094183792999999, 2023-09-30T17:02:41.321 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051867459999999999, 2023-09-30T17:02:41.321 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:41.321 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:41.321 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:41.321 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.321 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:41.321 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:02:41.321 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:41.322 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.322 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.322 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:41.322 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:02:41.322 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:41.322 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.322 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.322 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:41.322 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202216+0000", 2023-09-30T17:02:41.322 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7e-07 2023-09-30T17:02:41.322 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.323 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.323 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:41.323 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202271+0000", 2023-09-30T17:02:41.323 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5163e-05 2023-09-30T17:02:41.323 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.323 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.323 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:41.323 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202282+0000", 2023-09-30T17:02:41.323 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1319e-05 2023-09-30T17:02:41.323 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.323 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.324 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:41.324 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202288+0000", 2023-09-30T17:02:41.324 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2899999999999999e-06 2023-09-30T17:02:41.324 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.324 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.324 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:41.324 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202331+0000", 2023-09-30T17:02:41.324 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2147999999999997e-05 2023-09-30T17:02:41.324 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.324 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.324 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:41.325 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202348+0000", 2023-09-30T17:02:41.325 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7317e-05 2023-09-30T17:02:41.325 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.325 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.325 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:41.325 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.207357+0000", 2023-09-30T17:02:41.325 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0050095440000000003 2023-09-30T17:02:41.325 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.325 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.325 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:41.325 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.207402+0000", 2023-09-30T17:02:41.326 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4495e-05 2023-09-30T17:02:41.326 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:41.326 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:41.326 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:41.326 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.326 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.326 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:41.326 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:02:41.326 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 22.944853505000001, 2023-09-30T17:02:41.326 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.025313649000000001, 2023-09-30T17:02:41.326 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:41.327 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:41.327 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:41.327 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.327 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:41.327 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:02:41.327 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:41.327 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.327 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.327 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:41.327 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:02:41.327 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:41.328 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.328 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.328 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:41.328 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351551+0000", 2023-09-30T17:02:41.328 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3380000000000004e-06 2023-09-30T17:02:41.328 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.328 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.328 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:41.328 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351559+0000", 2023-09-30T17:02:41.328 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9589999999999995e-06 2023-09-30T17:02:41.328 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.328 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.329 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:41.329 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351571+0000", 2023-09-30T17:02:41.329 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2065999999999999e-05 2023-09-30T17:02:41.329 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.329 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.329 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:41.329 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351706+0000", 2023-09-30T17:02:41.329 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00013553799999999999 2023-09-30T17:02:41.329 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.329 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.329 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:41.330 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353016+0000", 2023-09-30T17:02:41.330 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0013099209999999999 2023-09-30T17:02:41.330 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.330 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.330 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:02:41.330 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353023+0000", 2023-09-30T17:02:41.330 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2479999999999999e-06 2023-09-30T17:02:41.330 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.330 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.330 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:41.330 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360348+0000", 2023-09-30T17:02:41.331 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0073248949999999997 2023-09-30T17:02:41.331 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.331 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.331 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:41.331 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360787+0000", 2023-09-30T17:02:41.331 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00043875199999999999 2023-09-30T17:02:41.331 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.331 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.331 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:41.331 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360892+0000", 2023-09-30T17:02:41.331 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010508199999999999 2023-09-30T17:02:41.331 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.332 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.332 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:02:41.332 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365132+0000", 2023-09-30T17:02:41.332 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0042396480000000004 2023-09-30T17:02:41.332 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.332 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.332 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:41.332 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376746+0000", 2023-09-30T17:02:41.332 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011614157 2023-09-30T17:02:41.332 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.332 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.333 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:41.333 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376811+0000", 2023-09-30T17:02:41.333 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5005999999999994e-05 2023-09-30T17:02:41.333 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.333 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.333 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:41.333 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376859+0000", 2023-09-30T17:02:41.333 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8038999999999999e-05 2023-09-30T17:02:41.333 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:41.333 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:41.333 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:41.334 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.334 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.334 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:41.334 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:02:41.334 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 22.944355706, 2023-09-30T17:02:41.334 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024923989000000001, 2023-09-30T17:02:41.334 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:41.334 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:41.334 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:41.334 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.334 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:41.335 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:02:41.335 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:41.335 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.335 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.335 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:41.335 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:02:41.335 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:41.335 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.335 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.335 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:41.335 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352044+0000", 2023-09-30T17:02:41.336 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9199999999999999e-07 2023-09-30T17:02:41.336 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.336 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.336 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:41.336 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352050+0000", 2023-09-30T17:02:41.336 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8880000000000002e-06 2023-09-30T17:02:41.336 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.336 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.336 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:41.336 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352143+0000", 2023-09-30T17:02:41.336 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2721999999999998e-05 2023-09-30T17:02:41.336 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.337 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.337 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:41.337 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352155+0000", 2023-09-30T17:02:41.337 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2279000000000001e-05 2023-09-30T17:02:41.337 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.337 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.337 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:41.337 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353114+0000", 2023-09-30T17:02:41.337 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00095943700000000005 2023-09-30T17:02:41.337 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.337 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.338 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:41.338 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353121+0000", 2023-09-30T17:02:41.338 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.494e-06 2023-09-30T17:02:41.338 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.338 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.338 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:41.338 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361491+0000", 2023-09-30T17:02:41.338 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0083697359999999991 2023-09-30T17:02:41.338 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.338 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.338 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:41.339 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361573+0000", 2023-09-30T17:02:41.339 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2822000000000001e-05 2023-09-30T17:02:41.339 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.339 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.339 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:41.339 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362166+0000", 2023-09-30T17:02:41.339 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00059223299999999995 2023-09-30T17:02:41.339 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.339 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.339 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:02:41.339 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365209+0000", 2023-09-30T17:02:41.340 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.003043212 2023-09-30T17:02:41.340 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.340 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.340 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:41.340 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376910+0000", 2023-09-30T17:02:41.340 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011700898 2023-09-30T17:02:41.340 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.340 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.340 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:41.340 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376945+0000", 2023-09-30T17:02:41.340 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4795000000000001e-05 2023-09-30T17:02:41.341 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.341 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.341 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:41.341 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376967+0000", 2023-09-30T17:02:41.341 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2580999999999999e-05 2023-09-30T17:02:41.341 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:41.341 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:41.341 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:41.341 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.341 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.341 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:41.341 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:02:41.342 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 22.944185785999998, 2023-09-30T17:02:41.342 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023120405, 2023-09-30T17:02:41.342 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:41.342 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:41.342 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:41.342 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.342 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:41.342 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:02:41.342 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:41.342 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.342 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.343 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:41.343 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:02:41.343 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:41.343 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.343 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.343 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:41.343 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352214+0000", 2023-09-30T17:02:41.343 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8400000000000003e-07 2023-09-30T17:02:41.343 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.343 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.343 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:41.344 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352233+0000", 2023-09-30T17:02:41.344 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8946000000000001e-05 2023-09-30T17:02:41.344 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.344 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.344 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:41.344 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352297+0000", 2023-09-30T17:02:41.344 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3540999999999994e-05 2023-09-30T17:02:41.344 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.344 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.344 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:41.344 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352450+0000", 2023-09-30T17:02:41.344 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015364799999999999 2023-09-30T17:02:41.345 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.345 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.345 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:41.345 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353098+0000", 2023-09-30T17:02:41.345 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00064820299999999997 2023-09-30T17:02:41.345 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.345 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.345 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:02:41.345 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353103+0000", 2023-09-30T17:02:41.345 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0529999999999997e-06 2023-09-30T17:02:41.345 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.345 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.346 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:41.346 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.358558+0000", 2023-09-30T17:02:41.346 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0054550249999999996 2023-09-30T17:02:41.346 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.346 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.346 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:41.346 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.358741+0000", 2023-09-30T17:02:41.346 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00018210200000000001 2023-09-30T17:02:41.346 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.346 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.346 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:41.347 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.359683+0000", 2023-09-30T17:02:41.347 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00094202299999999995 2023-09-30T17:02:41.347 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.347 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.347 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:02:41.347 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365044+0000", 2023-09-30T17:02:41.347 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053616219999999999 2023-09-30T17:02:41.347 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.347 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.347 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:41.347 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375256+0000", 2023-09-30T17:02:41.348 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010212156 2023-09-30T17:02:41.348 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.348 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.348 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:41.348 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375300+0000", 2023-09-30T17:02:41.348 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3961999999999997e-05 2023-09-30T17:02:41.348 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.348 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.348 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:41.348 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375334+0000", 2023-09-30T17:02:41.348 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.324e-05 2023-09-30T17:02:41.348 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:41.349 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:41.349 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:41.349 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.349 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.349 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:41.349 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:02:41.349 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 22.943870768, 2023-09-30T17:02:41.349 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024240660000000001, 2023-09-30T17:02:41.349 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:41.349 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:41.349 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:41.350 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.350 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:41.350 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:02:41.350 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:41.350 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.350 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.350 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:41.350 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:02:41.350 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:41.350 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.350 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.351 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:41.351 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352529+0000", 2023-09-30T17:02:41.351 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1379999999999999e-06 2023-09-30T17:02:41.351 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.351 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.351 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:41.351 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352536+0000", 2023-09-30T17:02:41.351 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3489999999999997e-06 2023-09-30T17:02:41.351 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.351 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.351 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:41.351 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352547+0000", 2023-09-30T17:02:41.352 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1109e-05 2023-09-30T17:02:41.352 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.352 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.352 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:41.352 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352560+0000", 2023-09-30T17:02:41.352 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3046e-05 2023-09-30T17:02:41.352 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.352 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.352 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:41.352 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353142+0000", 2023-09-30T17:02:41.352 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00058174699999999997 2023-09-30T17:02:41.353 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.353 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.353 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:41.353 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353147+0000", 2023-09-30T17:02:41.353 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5840000000000002e-06 2023-09-30T17:02:41.353 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.353 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.353 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:41.353 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360374+0000", 2023-09-30T17:02:41.353 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0072270049999999999 2023-09-30T17:02:41.353 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.353 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.354 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:41.354 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360795+0000", 2023-09-30T17:02:41.354 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00042088999999999999 2023-09-30T17:02:41.354 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.354 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.354 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:41.354 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360967+0000", 2023-09-30T17:02:41.354 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017235699999999999 2023-09-30T17:02:41.354 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.354 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.354 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:02:41.354 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365051+0000", 2023-09-30T17:02:41.355 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0040837429999999999 2023-09-30T17:02:41.355 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.355 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.355 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:41.355 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376708+0000", 2023-09-30T17:02:41.355 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011656866 2023-09-30T17:02:41.355 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.355 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.355 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:41.355 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376745+0000", 2023-09-30T17:02:41.355 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6769e-05 2023-09-30T17:02:41.356 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.356 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.356 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:41.356 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376769+0000", 2023-09-30T17:02:41.356 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4057e-05 2023-09-30T17:02:41.356 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:41.356 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:41.356 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:41.356 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.356 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.356 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:41.356 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:02:41.357 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 22.943611412999999, 2023-09-30T17:02:41.357 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023472704, 2023-09-30T17:02:41.357 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:41.357 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:41.357 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:41.357 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.357 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:41.357 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:02:41.357 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:41.357 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.357 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.357 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:41.358 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:02:41.358 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:41.358 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.358 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.358 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:41.358 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:02:41.358 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8000000000000005e-07 2023-09-30T17:02:41.358 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.358 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.358 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:41.358 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352794+0000", 2023-09-30T17:02:41.358 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.789e-06 2023-09-30T17:02:41.359 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.359 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.359 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:41.359 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352805+0000", 2023-09-30T17:02:41.359 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0848e-05 2023-09-30T17:02:41.359 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.359 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.359 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:41.359 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352812+0000", 2023-09-30T17:02:41.359 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4449999999999999e-06 2023-09-30T17:02:41.359 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.360 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.360 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:41.360 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353063+0000", 2023-09-30T17:02:41.360 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00025046299999999998 2023-09-30T17:02:41.360 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.360 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.360 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:02:41.360 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353071+0000", 2023-09-30T17:02:41.360 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6739999999999997e-06 2023-09-30T17:02:41.360 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.360 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.361 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:41.361 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361696+0000", 2023-09-30T17:02:41.361 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0086251609999999992 2023-09-30T17:02:41.361 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.361 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.361 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:41.361 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362284+0000", 2023-09-30T17:02:41.361 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00058872299999999998 2023-09-30T17:02:41.361 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.361 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.361 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:41.361 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362429+0000", 2023-09-30T17:02:41.362 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014509000000000001 2023-09-30T17:02:41.362 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.362 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.362 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:02:41.362 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365330+0000", 2023-09-30T17:02:41.362 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0029005419999999999 2023-09-30T17:02:41.362 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.362 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.362 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:41.362 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376196+0000", 2023-09-30T17:02:41.362 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.01086615 2023-09-30T17:02:41.363 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.363 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.363 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:41.363 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376230+0000", 2023-09-30T17:02:41.363 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3858e-05 2023-09-30T17:02:41.363 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.363 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.363 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:41.363 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376260+0000", 2023-09-30T17:02:41.363 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0181000000000001e-05 2023-09-30T17:02:41.363 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:41.364 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:41.364 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:41.364 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.364 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.364 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:41.364 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:02:41.364 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 22.943377843, 2023-09-30T17:02:41.364 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023406132999999999, 2023-09-30T17:02:41.365 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:41.365 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:41.365 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:41.365 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.365 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:41.365 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:02:41.365 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:41.365 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.365 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.365 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:41.365 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:02:41.366 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:41.366 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.366 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.366 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:41.366 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353022+0000", 2023-09-30T17:02:41.366 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.78e-07 2023-09-30T17:02:41.366 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.366 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.366 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:41.366 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353027+0000", 2023-09-30T17:02:41.366 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9089999999999999e-06 2023-09-30T17:02:41.367 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.367 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.367 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:41.367 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353035+0000", 2023-09-30T17:02:41.367 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0430000000000008e-06 2023-09-30T17:02:41.367 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.367 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.367 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:41.367 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353047+0000", 2023-09-30T17:02:41.367 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1674e-05 2023-09-30T17:02:41.367 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.368 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.368 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:41.368 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353105+0000", 2023-09-30T17:02:41.368 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8891999999999998e-05 2023-09-30T17:02:41.368 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.368 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.368 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:41.368 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353112+0000", 2023-09-30T17:02:41.368 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7059999999999998e-06 2023-09-30T17:02:41.368 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.369 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.369 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:41.369 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362733+0000", 2023-09-30T17:02:41.369 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0096205869999999999 2023-09-30T17:02:41.369 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.369 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.369 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:41.369 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362833+0000", 2023-09-30T17:02:41.369 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000100227 2023-09-30T17:02:41.369 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.369 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.370 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:41.370 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363000+0000", 2023-09-30T17:02:41.370 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016670899999999999 2023-09-30T17:02:41.370 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.370 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.370 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:02:41.370 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365550+0000", 2023-09-30T17:02:41.370 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0025499199999999998 2023-09-30T17:02:41.370 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.370 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.370 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:41.371 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376315+0000", 2023-09-30T17:02:41.371 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010765011999999999 2023-09-30T17:02:41.371 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.371 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.371 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:41.371 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376386+0000", 2023-09-30T17:02:41.371 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0866999999999998e-05 2023-09-30T17:02:41.371 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.371 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.371 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:41.371 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376427+0000", 2023-09-30T17:02:41.371 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1709000000000003e-05 2023-09-30T17:02:41.372 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:41.372 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:41.372 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:41.372 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.372 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.372 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:41.372 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:02:41.372 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 22.943337206999999, 2023-09-30T17:02:41.372 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024076238, 2023-09-30T17:02:41.372 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:41.372 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:41.373 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:41.373 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.373 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:41.373 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:02:41.373 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:41.373 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.373 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.373 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:41.373 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:02:41.373 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:41.373 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.374 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.374 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:41.374 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:02:41.374 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8699999999999995e-07 2023-09-30T17:02:41.374 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.374 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.374 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:41.374 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353067+0000", 2023-09-30T17:02:41.374 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.605e-06 2023-09-30T17:02:41.374 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.374 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.374 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:41.375 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353073+0000", 2023-09-30T17:02:41.375 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8900000000000004e-06 2023-09-30T17:02:41.375 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.375 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.375 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:41.375 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353083+0000", 2023-09-30T17:02:41.375 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0200000000000001e-05 2023-09-30T17:02:41.375 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.375 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.375 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:41.375 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353186+0000", 2023-09-30T17:02:41.376 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010256599999999999 2023-09-30T17:02:41.376 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.376 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.376 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:41.376 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353190+0000", 2023-09-30T17:02:41.376 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9709999999999998e-06 2023-09-30T17:02:41.376 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.376 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.376 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:41.376 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362946+0000", 2023-09-30T17:02:41.376 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0097563330000000007 2023-09-30T17:02:41.377 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.377 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.377 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:41.377 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363088+0000", 2023-09-30T17:02:41.377 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014259200000000001 2023-09-30T17:02:41.377 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.377 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.377 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:41.377 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363555+0000", 2023-09-30T17:02:41.377 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00046627799999999998 2023-09-30T17:02:41.377 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.377 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.378 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:02:41.378 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365871+0000", 2023-09-30T17:02:41.378 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0023167589999999998 2023-09-30T17:02:41.378 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.378 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.378 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:41.378 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377033+0000", 2023-09-30T17:02:41.378 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011161203999999999 2023-09-30T17:02:41.378 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.378 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.378 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:41.379 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377100+0000", 2023-09-30T17:02:41.379 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7230999999999994e-05 2023-09-30T17:02:41.379 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.379 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.379 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:41.379 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377138+0000", 2023-09-30T17:02:41.379 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8022000000000003e-05 2023-09-30T17:02:41.379 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:41.379 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:41.379 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:41.379 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.380 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.380 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:41.380 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:02:41.380 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 22.943236257999999, 2023-09-30T17:02:41.380 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.020304412000000001, 2023-09-30T17:02:41.380 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:41.380 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:02:41.380 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:41.380 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.380 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:41.380 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:02:41.380 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:41.381 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.381 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.381 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:41.381 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:02:41.381 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:41.381 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.381 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.381 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:41.381 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353164+0000", 2023-09-30T17:02:41.381 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7100000000000011e-07 2023-09-30T17:02:41.381 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.382 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.382 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:41.382 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353168+0000", 2023-09-30T17:02:41.382 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0600000000000001e-06 2023-09-30T17:02:41.382 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.382 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.382 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:41.382 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353177+0000", 2023-09-30T17:02:41.382 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1409999999999994e-06 2023-09-30T17:02:41.382 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.382 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.383 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:41.383 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353185+0000", 2023-09-30T17:02:41.383 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2479999999999996e-06 2023-09-30T17:02:41.383 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.383 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.383 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:41.383 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353246+0000", 2023-09-30T17:02:41.383 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0519000000000001e-05 2023-09-30T17:02:41.383 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.383 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.383 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:02:41.384 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353252+0000", 2023-09-30T17:02:41.384 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7859999999999999e-06 2023-09-30T17:02:41.384 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.384 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.384 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:41.384 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354979+0000", 2023-09-30T17:02:41.384 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0017270090000000001 2023-09-30T17:02:41.384 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.384 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.384 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:41.384 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355097+0000", 2023-09-30T17:02:41.384 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000117472 2023-09-30T17:02:41.385 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.385 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.385 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:41.385 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.373467+0000", 2023-09-30T17:02:41.385 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.018370206 2023-09-30T17:02:41.385 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:41.385 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:41.385 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:41.385 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.385 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.385 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:41.386 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:02:41.386 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 22.94319552, 2023-09-30T17:02:41.386 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.012725089, 2023-09-30T17:02:41.386 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:41.386 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:02:41.386 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:41.386 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.386 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:41.386 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:02:41.386 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:41.386 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.387 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.387 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:41.387 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:02:41.387 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:41.387 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.387 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.387 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:41.387 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353204+0000", 2023-09-30T17:02:41.387 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7100000000000002e-07 2023-09-30T17:02:41.387 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.387 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.388 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:41.388 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353213+0000", 2023-09-30T17:02:41.388 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8580000000000006e-06 2023-09-30T17:02:41.388 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.388 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.388 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:41.388 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353219+0000", 2023-09-30T17:02:41.388 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8939999999999998e-06 2023-09-30T17:02:41.388 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.388 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.388 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:41.388 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353223+0000", 2023-09-30T17:02:41.389 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.357e-06 2023-09-30T17:02:41.389 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.389 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.389 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:41.389 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353278+0000", 2023-09-30T17:02:41.389 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5228e-05 2023-09-30T17:02:41.389 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.389 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.389 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:02:41.389 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353284+0000", 2023-09-30T17:02:41.389 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8209999999999998e-06 2023-09-30T17:02:41.390 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.390 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.390 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:41.390 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355095+0000", 2023-09-30T17:02:41.390 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001811404 2023-09-30T17:02:41.390 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.390 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.390 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:41.390 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355256+0000", 2023-09-30T17:02:41.390 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000160898 2023-09-30T17:02:41.390 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.391 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.391 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:41.391 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365928+0000", 2023-09-30T17:02:41.391 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010672157999999999 2023-09-30T17:02:41.391 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:41.391 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:41.391 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:41.391 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.391 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.391 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-09-30T17:02:41.391 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:02:41.392 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 22.942664313000002, 2023-09-30T17:02:41.392 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0056863460000000001, 2023-09-30T17:02:41.392 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:41.392 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "reached pg", 2023-09-30T17:02:41.392 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:41.392 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.392 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:41.392 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:02:41.392 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:41.392 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.392 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.393 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:41.393 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:02:41.393 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:41.393 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.393 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.393 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:41.393 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:02:41.393 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5700000000000002e-07 2023-09-30T17:02:41.393 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.393 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.393 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:41.394 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353747+0000", 2023-09-30T17:02:41.394 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1899000000000001e-05 2023-09-30T17:02:41.394 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.394 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.394 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:41.394 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353776+0000", 2023-09-30T17:02:41.394 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.8767000000000001e-05 2023-09-30T17:02:41.394 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.394 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.394 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:41.395 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353792+0000", 2023-09-30T17:02:41.395 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5914999999999999e-05 2023-09-30T17:02:41.395 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.395 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.395 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:41.395 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353900+0000", 2023-09-30T17:02:41.395 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010774500000000001 2023-09-30T17:02:41.395 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.395 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.395 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:41.395 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.359421+0000", 2023-09-30T17:02:41.395 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0055213629999999996 2023-09-30T17:02:41.396 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:41.396 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:41.396 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:41.396 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.396 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.396 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:02:41.396 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:02:41.396 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 22.941992713000001, 2023-09-30T17:02:41.396 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0069196370000000002, 2023-09-30T17:02:41.396 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:41.396 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:41.397 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:41.397 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.397 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:41.397 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:02:41.397 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:41.397 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.397 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.397 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:41.397 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:02:41.397 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:41.397 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.398 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.398 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:41.398 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354407+0000", 2023-09-30T17:02:41.398 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7400000000000002e-07 2023-09-30T17:02:41.398 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.398 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.398 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:41.398 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354414+0000", 2023-09-30T17:02:41.398 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1040000000000001e-06 2023-09-30T17:02:41.398 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.398 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.399 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:41.399 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354425+0000", 2023-09-30T17:02:41.399 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1090000000000001e-05 2023-09-30T17:02:41.399 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.399 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.399 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:41.399 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354435+0000", 2023-09-30T17:02:41.399 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8169999999999994e-06 2023-09-30T17:02:41.399 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.399 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.399 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:41.399 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355741+0000", 2023-09-30T17:02:41.400 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0013063160000000001 2023-09-30T17:02:41.400 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.400 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.400 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:41.400 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355763+0000", 2023-09-30T17:02:41.400 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1688e-05 2023-09-30T17:02:41.400 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.400 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.400 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:41.400 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361289+0000", 2023-09-30T17:02:41.400 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0055258269999999996 2023-09-30T17:02:41.401 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.401 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.401 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:41.401 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361326+0000", 2023-09-30T17:02:41.401 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7020999999999997e-05 2023-09-30T17:02:41.401 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:41.401 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:41.401 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:41.401 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.401 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.402 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:30 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2023-09-30T17:02:41.402 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:02:41.402 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 22.940618754999999, 2023-09-30T17:02:41.402 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0069996629999999997, 2023-09-30T17:02:41.402 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:41.402 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:41.402 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:41.402 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.402 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:41.402 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:02:41.402 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:41.403 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.403 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.403 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:41.403 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:02:41.403 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:41.403 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.403 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.403 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:41.403 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355781+0000", 2023-09-30T17:02:41.403 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9599999999999999e-07 2023-09-30T17:02:41.403 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.404 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.404 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:41.404 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355788+0000", 2023-09-30T17:02:41.404 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8129999999999996e-06 2023-09-30T17:02:41.404 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.404 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.404 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:41.404 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355798+0000", 2023-09-30T17:02:41.404 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2909999999999996e-06 2023-09-30T17:02:41.404 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.404 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.405 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:41.405 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355807+0000", 2023-09-30T17:02:41.405 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8619999999999992e-06 2023-09-30T17:02:41.405 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.405 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.405 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:41.405 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.357264+0000", 2023-09-30T17:02:41.405 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0014578289999999999 2023-09-30T17:02:41.405 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.405 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.405 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:41.406 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.357916+0000", 2023-09-30T17:02:41.406 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00065170500000000004 2023-09-30T17:02:41.406 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.406 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.406 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:41.406 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362731+0000", 2023-09-30T17:02:41.406 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0048149849999999999 2023-09-30T17:02:41.406 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.406 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.406 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:41.407 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362780+0000", 2023-09-30T17:02:41.407 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8681999999999999e-05 2023-09-30T17:02:41.407 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:41.407 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:41.407 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:41.407 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.407 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.407 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2023-09-30T17:02:41.407 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:02:41.407 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 22.921967704, 2023-09-30T17:02:41.408 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005905998, 2023-09-30T17:02:41.408 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:41.408 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:41.408 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:41.408 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.408 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:41.408 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:02:41.408 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:41.408 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.408 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.408 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:41.409 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:02:41.409 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:41.409 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.409 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.409 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:41.409 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:02:41.409 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1e-07 2023-09-30T17:02:41.409 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.409 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.409 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:41.409 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374455+0000", 2023-09-30T17:02:41.409 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.3091999999999998e-05 2023-09-30T17:02:41.410 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.410 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.410 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:41.410 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374462+0000", 2023-09-30T17:02:41.410 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5170000000000002e-06 2023-09-30T17:02:41.410 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.410 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.410 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:41.410 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374469+0000", 2023-09-30T17:02:41.410 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8199999999999999e-06 2023-09-30T17:02:41.411 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.411 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.411 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:41.411 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374550+0000", 2023-09-30T17:02:41.411 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0978999999999998e-05 2023-09-30T17:02:41.411 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.411 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.411 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:41.411 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374562+0000", 2023-09-30T17:02:41.411 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2472e-05 2023-09-30T17:02:41.411 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.412 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.412 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:41.412 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380293+0000", 2023-09-30T17:02:41.412 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0057310379999999999 2023-09-30T17:02:41.412 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.412 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.412 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:41.412 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380337+0000", 2023-09-30T17:02:41.412 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3869999999999998e-05 2023-09-30T17:02:41.412 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:41.412 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:41.413 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:41.413 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.413 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.413 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2023-09-30T17:02:41.413 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:02:41.413 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 22.921780954999999, 2023-09-30T17:02:41.413 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0057590560000000002, 2023-09-30T17:02:41.413 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:41.413 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:41.413 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:41.413 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.414 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:41.414 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:02:41.414 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:41.414 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.414 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.414 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:41.414 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:02:41.414 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:41.415 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.415 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.415 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:41.415 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:02:41.415 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4900000000000001e-07 2023-09-30T17:02:41.415 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.415 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.415 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:41.415 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374629+0000", 2023-09-30T17:02:41.415 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1014e-05 2023-09-30T17:02:41.415 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.415 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.416 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:41.416 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374636+0000", 2023-09-30T17:02:41.416 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5889999999999999e-06 2023-09-30T17:02:41.416 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.416 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.416 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:41.416 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374642+0000", 2023-09-30T17:02:41.416 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.48e-06 2023-09-30T17:02:41.416 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.416 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.416 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:41.417 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374681+0000", 2023-09-30T17:02:41.417 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9320000000000003e-05 2023-09-30T17:02:41.417 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.417 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.417 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:41.417 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374694+0000", 2023-09-30T17:02:41.417 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3351e-05 2023-09-30T17:02:41.417 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.417 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.417 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:41.417 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380319+0000", 2023-09-30T17:02:41.417 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0056243880000000001 2023-09-30T17:02:41.418 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.418 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.418 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:41.418 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380377+0000", 2023-09-30T17:02:41.418 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8464999999999997e-05 2023-09-30T17:02:41.418 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:41.418 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:41.418 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:41.418 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.418 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.418 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=0'0)", 2023-09-30T17:02:41.418 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:02:41.419 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 22.921070044, 2023-09-30T17:02:41.419 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051157370000000004, 2023-09-30T17:02:41.419 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:41.419 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:41.419 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:41.419 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.419 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:41.419 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:02:41.419 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:41.419 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.419 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.420 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:41.420 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:02:41.420 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:41.420 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.420 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.420 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:41.420 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:02:41.420 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0199999999999998e-07 2023-09-30T17:02:41.420 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.420 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.420 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:41.421 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375334+0000", 2023-09-30T17:02:41.421 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8799999999999999e-06 2023-09-30T17:02:41.421 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.421 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.421 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:41.421 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375343+0000", 2023-09-30T17:02:41.421 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5490000000000006e-06 2023-09-30T17:02:41.421 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.421 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.421 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:41.421 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375350+0000", 2023-09-30T17:02:41.421 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5700000000000004e-06 2023-09-30T17:02:41.422 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.422 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.422 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:41.422 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375396+0000", 2023-09-30T17:02:41.422 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5550999999999998e-05 2023-09-30T17:02:41.422 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.422 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.422 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:41.422 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375410+0000", 2023-09-30T17:02:41.422 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4518999999999999e-05 2023-09-30T17:02:41.422 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.423 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.423 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:41.423 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380401+0000", 2023-09-30T17:02:41.423 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0049903430000000004 2023-09-30T17:02:41.423 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:41.423 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:41.423 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:41.423 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380445+0000", 2023-09-30T17:02:41.423 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4023000000000002e-05 2023-09-30T17:02:41.423 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:41.423 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:41.423 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:41.424 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:41.424 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:41.424 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:02:41.426 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is set 2023-09-30T17:02:41.426 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:02:41.427 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:41.425+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:41.526 INFO:tasks.ceph.osd.2.smithi134.stderr:2023-09-30T17:02:41.526+0000 7efd10b20700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 96961) UID: 0 2023-09-30T17:02:41.565 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:02:41.565 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:02:41.565 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2023-09-30T17:02:41.565 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:02:41.575 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:02:41.627 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:41.627+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:41.701 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:02:41.701 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:02:41.702 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2023-09-30T17:02:41.702 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2023-09-30T17:02:41.702 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:02:41.711 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:02:41.755 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:41.755+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:41.829 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:41.829+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:41.839 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:02:41.839 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2023-09-30T17:02:41.839 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2023-09-30T17:02:41.839 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2023-09-30T17:02:41.839 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.840 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:41.840 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:02:41.840 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.486120157999999, 2023-09-30T17:02:41.840 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093789779999999996, 2023-09-30T17:02:41.840 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:41.840 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:41.840 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:41.840 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.840 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:41.840 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:02:41.840 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:41.840 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.841 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.841 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:41.841 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:02:41.841 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:41.841 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.841 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.841 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:41.841 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352027+0000", 2023-09-30T17:02:41.841 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0224000000000001e-05 2023-09-30T17:02:41.841 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.841 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.841 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:41.842 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352039+0000", 2023-09-30T17:02:41.842 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1569000000000001e-05 2023-09-30T17:02:41.842 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.842 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.842 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:41.842 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352052+0000", 2023-09-30T17:02:41.842 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2605999999999999e-05 2023-09-30T17:02:41.842 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.842 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.842 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:41.842 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352064+0000", 2023-09-30T17:02:41.843 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2666999999999999e-05 2023-09-30T17:02:41.843 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.843 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.843 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:41.843 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352147+0000", 2023-09-30T17:02:41.843 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3125000000000001e-05 2023-09-30T17:02:41.843 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.843 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.843 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:41.843 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352306+0000", 2023-09-30T17:02:41.843 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015881900000000001 2023-09-30T17:02:41.844 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.844 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.844 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:41.844 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352450+0000", 2023-09-30T17:02:41.844 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014420700000000001 2023-09-30T17:02:41.844 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.844 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.844 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:41.844 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355975+0000", 2023-09-30T17:02:41.844 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003524246 2023-09-30T17:02:41.844 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.845 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.845 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:41.845 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361279+0000", 2023-09-30T17:02:41.845 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005304507 2023-09-30T17:02:41.845 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.845 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.845 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:41.845 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361344+0000", 2023-09-30T17:02:41.845 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4548999999999995e-05 2023-09-30T17:02:41.846 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.846 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.846 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:41.846 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361396+0000", 2023-09-30T17:02:41.846 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2459e-05 2023-09-30T17:02:41.846 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:41.846 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:41.846 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:41.846 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.847 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.847 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:41.847 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:02:41.847 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.486027866000001, 2023-09-30T17:02:41.847 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021233007000000002, 2023-09-30T17:02:41.847 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:41.847 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:41.847 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:41.847 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.847 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:41.847 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:02:41.847 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:41.848 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.848 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.848 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:41.848 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:02:41.848 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:41.848 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.848 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.848 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:41.848 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352110+0000", 2023-09-30T17:02:41.848 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6000000000000002e-07 2023-09-30T17:02:41.848 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.848 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.849 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:41.849 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352117+0000", 2023-09-30T17:02:41.849 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5930000000000002e-06 2023-09-30T17:02:41.849 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.849 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.849 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:41.849 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352126+0000", 2023-09-30T17:02:41.849 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0729999999999994e-06 2023-09-30T17:02:41.849 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.849 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.849 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:41.850 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352136+0000", 2023-09-30T17:02:41.850 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0380000000000001e-05 2023-09-30T17:02:41.850 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.850 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.850 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:41.850 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353279+0000", 2023-09-30T17:02:41.850 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0011424670000000001 2023-09-30T17:02:41.850 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.850 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.850 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:41.850 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353707+0000", 2023-09-30T17:02:41.851 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00042829800000000003 2023-09-30T17:02:41.851 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.851 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.851 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:41.851 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354104+0000", 2023-09-30T17:02:41.851 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00039643399999999998 2023-09-30T17:02:41.851 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.851 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.851 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:41.851 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356925+0000", 2023-09-30T17:02:41.851 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0028210900000000001 2023-09-30T17:02:41.852 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.852 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.852 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:41.852 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373243+0000", 2023-09-30T17:02:41.852 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016318461999999999 2023-09-30T17:02:41.852 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.852 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.852 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:41.852 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373301+0000", 2023-09-30T17:02:41.852 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7435000000000002e-05 2023-09-30T17:02:41.852 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.852 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.853 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:41.853 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373342+0000", 2023-09-30T17:02:41.853 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1915000000000001e-05 2023-09-30T17:02:41.853 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:41.853 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:41.853 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:41.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.853 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.853 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:41.853 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:02:41.853 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.485985254999999, 2023-09-30T17:02:41.853 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011988331, 2023-09-30T17:02:41.854 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:41.854 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:41.854 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:41.854 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.854 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:41.854 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:02:41.854 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:41.854 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.854 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.854 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:41.854 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:02:41.855 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:41.855 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.855 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.855 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:41.855 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352153+0000", 2023-09-30T17:02:41.855 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0500000000000003e-07 2023-09-30T17:02:41.855 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.855 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.855 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:41.855 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352157+0000", 2023-09-30T17:02:41.855 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9790000000000004e-06 2023-09-30T17:02:41.856 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.856 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.856 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:41.856 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352173+0000", 2023-09-30T17:02:41.856 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6535999999999999e-05 2023-09-30T17:02:41.856 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.856 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.856 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:41.856 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352180+0000", 2023-09-30T17:02:41.856 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7700000000000004e-06 2023-09-30T17:02:41.856 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.856 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.857 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:41.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353526+0000", 2023-09-30T17:02:41.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0013458330000000001 2023-09-30T17:02:41.857 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.857 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:41.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353648+0000", 2023-09-30T17:02:41.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012262899999999999 2023-09-30T17:02:41.857 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.857 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:02:41.858 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354141+0000", 2023-09-30T17:02:41.858 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00049222899999999995 2023-09-30T17:02:41.858 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.858 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.858 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:41.858 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356931+0000", 2023-09-30T17:02:41.858 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0027900860000000002 2023-09-30T17:02:41.858 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.858 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.858 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:41.858 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364066+0000", 2023-09-30T17:02:41.859 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071355050000000003 2023-09-30T17:02:41.859 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.859 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.859 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:41.859 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364103+0000", 2023-09-30T17:02:41.859 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6944999999999999e-05 2023-09-30T17:02:41.859 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.859 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.859 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:41.859 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364140+0000", 2023-09-30T17:02:41.859 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7214e-05 2023-09-30T17:02:41.859 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:41.860 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:41.860 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:41.860 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.860 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.860 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:41.860 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:02:41.860 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.485946024, 2023-09-30T17:02:41.860 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012110921, 2023-09-30T17:02:41.860 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:41.861 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:41.861 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:41.861 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.861 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:41.861 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:02:41.861 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:41.861 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.861 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.861 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:41.861 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:02:41.861 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:41.862 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.862 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.862 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:41.862 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352192+0000", 2023-09-30T17:02:41.862 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7300000000000005e-07 2023-09-30T17:02:41.862 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.862 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.862 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:41.862 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352196+0000", 2023-09-30T17:02:41.862 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2370000000000003e-06 2023-09-30T17:02:41.863 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.863 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.863 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:41.863 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352205+0000", 2023-09-30T17:02:41.863 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6659999999999997e-06 2023-09-30T17:02:41.863 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.863 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.863 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:41.863 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352214+0000", 2023-09-30T17:02:41.863 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8259999999999999e-06 2023-09-30T17:02:41.863 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.864 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:41.864 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354470+0000", 2023-09-30T17:02:41.864 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022557340000000001 2023-09-30T17:02:41.864 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.864 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:41.864 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354557+0000", 2023-09-30T17:02:41.864 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6909000000000004e-05 2023-09-30T17:02:41.864 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.865 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:02:41.865 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354694+0000", 2023-09-30T17:02:41.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013774800000000001 2023-09-30T17:02:41.865 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.865 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.865 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:41.865 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356937+0000", 2023-09-30T17:02:41.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022424540000000001 2023-09-30T17:02:41.865 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.865 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.866 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:41.866 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364227+0000", 2023-09-30T17:02:41.866 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072902430000000001 2023-09-30T17:02:41.866 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.866 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.866 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:41.866 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364278+0000", 2023-09-30T17:02:41.866 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1180999999999997e-05 2023-09-30T17:02:41.866 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.867 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.867 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:41.867 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364302+0000", 2023-09-30T17:02:41.867 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4049999999999998e-05 2023-09-30T17:02:41.867 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:41.867 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:41.867 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:41.867 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.867 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.867 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:41.867 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:02:41.867 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.485912684999999, 2023-09-30T17:02:41.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021258651999999999, 2023-09-30T17:02:41.868 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:41.868 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:41.868 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:41.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:41.868 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:02:41.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:41.868 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:41.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:02:41.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:41.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.869 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:41.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:02:41.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6899999999999997e-07 2023-09-30T17:02:41.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.869 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:41.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352236+0000", 2023-09-30T17:02:41.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0251000000000001e-05 2023-09-30T17:02:41.870 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.870 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:41.870 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352244+0000", 2023-09-30T17:02:41.870 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0770000000000008e-06 2023-09-30T17:02:41.870 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.870 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:41.870 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352251+0000", 2023-09-30T17:02:41.870 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4749999999999996e-06 2023-09-30T17:02:41.870 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.871 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.871 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:41.871 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354455+0000", 2023-09-30T17:02:41.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022043660000000001 2023-09-30T17:02:41.871 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.871 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.871 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:41.871 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354577+0000", 2023-09-30T17:02:41.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000121054 2023-09-30T17:02:41.871 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.871 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.871 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:41.872 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354723+0000", 2023-09-30T17:02:41.872 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014693900000000001 2023-09-30T17:02:41.872 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:41.872 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356941+0000", 2023-09-30T17:02:41.872 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002217199 2023-09-30T17:02:41.872 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:41.872 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373392+0000", 2023-09-30T17:02:41.873 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016451774999999998 2023-09-30T17:02:41.873 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.873 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.873 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:41.873 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373445+0000", 2023-09-30T17:02:41.873 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.308e-05 2023-09-30T17:02:41.873 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.873 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.873 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:41.873 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373483+0000", 2023-09-30T17:02:41.873 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7766999999999999e-05 2023-09-30T17:02:41.874 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:41.874 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:41.874 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:41.874 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.874 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.874 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:41.874 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:02:41.874 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.485876594, 2023-09-30T17:02:41.874 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020903497, 2023-09-30T17:02:41.874 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:41.875 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:41.875 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:41.875 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.875 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:41.875 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:02:41.875 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:41.875 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.875 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.875 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:41.876 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:02:41.876 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:41.876 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.876 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.876 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:41.876 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:02:41.876 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0800000000000004e-07 2023-09-30T17:02:41.876 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.876 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.876 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:41.876 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352266+0000", 2023-09-30T17:02:41.876 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1280000000000001e-06 2023-09-30T17:02:41.877 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.877 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.877 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:41.877 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352273+0000", 2023-09-30T17:02:41.877 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3730000000000004e-06 2023-09-30T17:02:41.877 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.877 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.877 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:41.877 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352279+0000", 2023-09-30T17:02:41.877 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7699999999999998e-06 2023-09-30T17:02:41.877 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.878 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.878 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:41.878 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352334+0000", 2023-09-30T17:02:41.878 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5547999999999997e-05 2023-09-30T17:02:41.878 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.878 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.878 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:41.878 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352435+0000", 2023-09-30T17:02:41.878 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100688 2023-09-30T17:02:41.878 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.878 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.878 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:41.879 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352585+0000", 2023-09-30T17:02:41.879 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000150068 2023-09-30T17:02:41.879 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.879 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.879 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:41.879 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354912+0000", 2023-09-30T17:02:41.879 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0023266770000000001 2023-09-30T17:02:41.879 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.879 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.879 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:41.879 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373066+0000", 2023-09-30T17:02:41.879 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018154474 2023-09-30T17:02:41.880 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.880 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.880 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:41.880 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373122+0000", 2023-09-30T17:02:41.880 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6193000000000002e-05 2023-09-30T17:02:41.880 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.880 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.880 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:41.880 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373164+0000", 2023-09-30T17:02:41.880 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1869999999999997e-05 2023-09-30T17:02:41.880 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:41.881 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:41.881 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:41.881 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.881 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.881 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:41.881 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:02:41.881 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.485840918000001, 2023-09-30T17:02:41.881 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021015097999999999, 2023-09-30T17:02:41.881 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:41.881 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:41.881 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:41.881 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.882 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:41.882 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:02:41.882 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:41.882 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.882 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.882 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:41.882 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:02:41.882 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:41.882 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.882 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.882 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:41.882 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352297+0000", 2023-09-30T17:02:41.883 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8299999999999997e-07 2023-09-30T17:02:41.883 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.883 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.883 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:41.883 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352300+0000", 2023-09-30T17:02:41.883 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7460000000000001e-06 2023-09-30T17:02:41.883 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.883 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.883 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:41.883 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352307+0000", 2023-09-30T17:02:41.883 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4959999999999999e-06 2023-09-30T17:02:41.883 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.884 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.884 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:41.884 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352314+0000", 2023-09-30T17:02:41.884 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0190000000000001e-06 2023-09-30T17:02:41.884 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.884 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.884 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:41.884 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354070+0000", 2023-09-30T17:02:41.884 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001755936 2023-09-30T17:02:41.884 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.884 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.885 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:41.885 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354221+0000", 2023-09-30T17:02:41.885 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000150884 2023-09-30T17:02:41.885 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.885 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.885 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:41.885 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373311+0000", 2023-09-30T17:02:41.885 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019090434 2023-09-30T17:02:41.885 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:41.885 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:41.885 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:41.885 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.886 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.886 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:41.886 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:02:41.886 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.485812199000001, 2023-09-30T17:02:41.886 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021255174000000002, 2023-09-30T17:02:41.886 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:41.886 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:41.886 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:41.886 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.886 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:41.886 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:02:41.887 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:41.887 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.887 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.887 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:41.887 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:02:41.887 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:41.887 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.887 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.887 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:41.887 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352326+0000", 2023-09-30T17:02:41.887 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3200000000000005e-07 2023-09-30T17:02:41.887 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.888 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.888 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:41.888 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352349+0000", 2023-09-30T17:02:41.888 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3183000000000001e-05 2023-09-30T17:02:41.888 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.888 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.888 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:41.888 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352358+0000", 2023-09-30T17:02:41.888 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5230000000000001e-06 2023-09-30T17:02:41.888 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.888 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.888 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:41.889 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352365+0000", 2023-09-30T17:02:41.889 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3260000000000001e-06 2023-09-30T17:02:41.889 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.889 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.889 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:41.889 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355450+0000", 2023-09-30T17:02:41.889 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0030854049999999998 2023-09-30T17:02:41.889 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.889 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.889 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:41.889 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355583+0000", 2023-09-30T17:02:41.889 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000133189 2023-09-30T17:02:41.890 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.890 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.890 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:41.890 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373580+0000", 2023-09-30T17:02:41.890 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017997016000000001 2023-09-30T17:02:41.890 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:41.890 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:41.890 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:41.890 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.890 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.890 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:41.891 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:02:41.891 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.485760775999999, 2023-09-30T17:02:41.891 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010380537, 2023-09-30T17:02:41.891 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:41.891 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:41.891 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:41.891 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.891 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:41.891 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:02:41.891 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:41.891 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.892 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.892 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:41.892 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:02:41.892 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:41.892 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.892 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.892 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:41.892 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:02:41.892 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1500000000000003e-07 2023-09-30T17:02:41.892 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.892 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.892 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:41.893 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352381+0000", 2023-09-30T17:02:41.893 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6330000000000002e-06 2023-09-30T17:02:41.893 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.893 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.893 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:41.893 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352388+0000", 2023-09-30T17:02:41.893 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7229999999999998e-06 2023-09-30T17:02:41.893 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.893 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.893 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:41.893 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352394+0000", 2023-09-30T17:02:41.893 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1789999999999996e-06 2023-09-30T17:02:41.894 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.894 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.894 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:41.894 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353259+0000", 2023-09-30T17:02:41.894 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000865221 2023-09-30T17:02:41.894 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.894 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.894 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:41.894 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353391+0000", 2023-09-30T17:02:41.894 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013217700000000001 2023-09-30T17:02:41.894 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.895 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.895 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:41.895 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362757+0000", 2023-09-30T17:02:41.895 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093657889999999994 2023-09-30T17:02:41.895 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:41.895 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:41.895 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:41.895 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.895 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.895 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-09-30T17:02:41.895 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:02:41.895 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.479460484000001, 2023-09-30T17:02:41.896 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0061813579999999996, 2023-09-30T17:02:41.896 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:41.896 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2023-09-30T17:02:41.896 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:41.896 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.896 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:41.896 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:02:41.896 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:41.896 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.896 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.897 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:41.897 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:02:41.897 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:41.897 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.897 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.897 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:41.897 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:02:41.897 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5499999999999999e-07 2023-09-30T17:02:41.897 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.898 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.898 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:41.898 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358686+0000", 2023-09-30T17:02:41.898 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9979999999999992e-06 2023-09-30T17:02:41.898 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.898 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.898 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:41.898 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358700+0000", 2023-09-30T17:02:41.898 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3635000000000001e-05 2023-09-30T17:02:41.898 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.898 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.899 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:41.899 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358714+0000", 2023-09-30T17:02:41.899 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4470999999999999e-05 2023-09-30T17:02:41.899 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.899 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.899 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:41.899 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358767+0000", 2023-09-30T17:02:41.899 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2651999999999997e-05 2023-09-30T17:02:41.899 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.899 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.899 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:41.899 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364858+0000", 2023-09-30T17:02:41.900 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060912470000000002 2023-09-30T17:02:41.900 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:41.900 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:41.900 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:41.900 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.900 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.900 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2023-09-30T17:02:41.900 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:02:41.900 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.477095643999998, 2023-09-30T17:02:41.900 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00036246299999999999, 2023-09-30T17:02:41.900 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:41.900 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:41.901 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:41.901 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.901 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:41.901 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:02:41.901 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:41.901 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.901 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.901 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:41.901 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:02:41.901 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:41.901 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.901 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.902 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:41.902 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:02:41.902 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3099999999999999e-07 2023-09-30T17:02:41.902 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.902 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.902 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:41.902 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361045+0000", 2023-09-30T17:02:41.902 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.49e-06 2023-09-30T17:02:41.902 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.902 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.902 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:41.903 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361056+0000", 2023-09-30T17:02:41.903 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0910000000000001e-05 2023-09-30T17:02:41.903 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.903 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.903 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:41.903 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361067+0000", 2023-09-30T17:02:41.903 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0531e-05 2023-09-30T17:02:41.903 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.903 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.903 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:41.903 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361263+0000", 2023-09-30T17:02:41.903 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000196486 2023-09-30T17:02:41.904 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.904 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.904 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:41.904 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361273+0000", 2023-09-30T17:02:41.904 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3379999999999994e-06 2023-09-30T17:02:41.904 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.904 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.904 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:41.904 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361404+0000", 2023-09-30T17:02:41.904 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013137700000000001 2023-09-30T17:02:41.904 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:41.904 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:41.905 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:41.905 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.905 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.905 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:31 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:02:41.905 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:02:41.905 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.476119615000002, 2023-09-30T17:02:41.905 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006676408, 2023-09-30T17:02:41.905 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:41.905 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:41.905 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:41.905 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.905 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:41.906 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:02:41.906 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:41.906 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.906 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.906 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:41.906 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:02:41.906 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:41.906 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.906 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.906 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:41.906 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:02:41.906 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5600000000000002e-07 2023-09-30T17:02:41.907 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.907 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.907 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:41.907 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362044+0000", 2023-09-30T17:02:41.907 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5987999999999999e-05 2023-09-30T17:02:41.907 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.907 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.907 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:41.907 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362051+0000", 2023-09-30T17:02:41.907 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2599999999999999e-06 2023-09-30T17:02:41.907 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.907 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.908 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:41.908 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362057+0000", 2023-09-30T17:02:41.908 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.19e-06 2023-09-30T17:02:41.908 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.908 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.908 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:41.908 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362096+0000", 2023-09-30T17:02:41.908 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8278000000000002e-05 2023-09-30T17:02:41.908 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.908 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.908 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:41.909 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362114+0000", 2023-09-30T17:02:41.909 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8808e-05 2023-09-30T17:02:41.909 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.909 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.909 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:41.909 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368658+0000", 2023-09-30T17:02:41.909 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065433540000000004 2023-09-30T17:02:41.909 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.909 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.909 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:41.909 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368694+0000", 2023-09-30T17:02:41.909 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6273999999999999e-05 2023-09-30T17:02:41.910 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:41.910 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:41.910 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:41.910 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.910 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.910 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:26 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-09-30T17:02:41.910 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:02:41.910 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.476028843000002, 2023-09-30T17:02:41.910 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0066596119999999996, 2023-09-30T17:02:41.910 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:41.910 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:41.910 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:41.911 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.911 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:41.911 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:02:41.911 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:41.911 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.911 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.911 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:41.911 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:02:41.911 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:41.911 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.911 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.912 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:41.912 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362109+0000", 2023-09-30T17:02:41.912 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5699999999999999e-07 2023-09-30T17:02:41.912 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.912 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.912 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:41.912 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362112+0000", 2023-09-30T17:02:41.912 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8410000000000002e-06 2023-09-30T17:02:41.912 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.912 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.912 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:41.912 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362117+0000", 2023-09-30T17:02:41.912 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.792e-06 2023-09-30T17:02:41.913 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.913 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.913 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:41.913 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362122+0000", 2023-09-30T17:02:41.913 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.763e-06 2023-09-30T17:02:41.913 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.913 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.913 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:41.913 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362344+0000", 2023-09-30T17:02:41.913 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022181600000000001 2023-09-30T17:02:41.913 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.914 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.914 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:41.914 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362357+0000", 2023-09-30T17:02:41.914 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2864000000000001e-05 2023-09-30T17:02:41.914 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.914 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.914 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:41.914 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368738+0000", 2023-09-30T17:02:41.914 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063809499999999998 2023-09-30T17:02:41.914 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.914 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.914 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:41.915 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368768+0000", 2023-09-30T17:02:41.915 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0429e-05 2023-09-30T17:02:41.915 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:41.915 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:41.915 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:41.915 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.915 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.915 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2023-09-30T17:02:41.915 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:02:41.915 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.474812675999999, 2023-09-30T17:02:41.915 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00082185400000000001, 2023-09-30T17:02:41.916 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:41.916 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:41.916 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:41.916 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.916 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:41.916 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:02:41.916 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:41.916 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.916 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.916 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:41.916 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:02:41.916 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:41.917 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.917 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.917 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:41.917 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:02:41.917 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.22e-07 2023-09-30T17:02:41.917 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.917 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.917 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:41.917 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363327+0000", 2023-09-30T17:02:41.917 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4480000000000001e-06 2023-09-30T17:02:41.918 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.918 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.918 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:41.918 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363333+0000", 2023-09-30T17:02:41.918 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9989999999999997e-06 2023-09-30T17:02:41.918 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.918 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.918 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:41.918 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363354+0000", 2023-09-30T17:02:41.918 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0547000000000002e-05 2023-09-30T17:02:41.918 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.919 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.919 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:41.919 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364057+0000", 2023-09-30T17:02:41.919 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00070306600000000002 2023-09-30T17:02:41.919 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.919 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.919 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:41.919 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364063+0000", 2023-09-30T17:02:41.919 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.694e-06 2023-09-30T17:02:41.919 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.919 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.919 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:41.920 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364146+0000", 2023-09-30T17:02:41.920 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3877999999999999e-05 2023-09-30T17:02:41.920 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:41.920 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:41.920 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:41.920 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.920 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.920 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e18/16 ondisk, result = 0)", 2023-09-30T17:02:41.920 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:02:41.920 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.474499143999999, 2023-09-30T17:02:41.920 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00067007199999999996, 2023-09-30T17:02:41.920 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:41.921 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:41.921 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:41.921 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.921 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:41.921 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:02:41.921 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:41.921 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.921 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.921 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:41.921 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:02:41.921 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:41.921 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.922 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.922 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:41.922 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:02:41.922 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.41e-07 2023-09-30T17:02:41.922 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.922 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.922 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:41.922 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363641+0000", 2023-09-30T17:02:41.922 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4830000000000002e-06 2023-09-30T17:02:41.922 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.922 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.923 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:41.923 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363647+0000", 2023-09-30T17:02:41.923 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4869999999999999e-06 2023-09-30T17:02:41.923 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.923 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.923 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:41.923 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363654+0000", 2023-09-30T17:02:41.923 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5889999999999999e-06 2023-09-30T17:02:41.923 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.923 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.923 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:41.923 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364217+0000", 2023-09-30T17:02:41.924 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00056263199999999998 2023-09-30T17:02:41.924 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.924 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.924 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:41.924 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364222+0000", 2023-09-30T17:02:41.924 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.242e-06 2023-09-30T17:02:41.924 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.924 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.924 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:41.924 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364308+0000", 2023-09-30T17:02:41.924 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6397999999999995e-05 2023-09-30T17:02:41.924 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:41.925 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:41.925 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:41.925 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.925 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.925 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:25 3.1f e18/16 ondisk, result = 0)", 2023-09-30T17:02:41.925 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.373200+0000", 2023-09-30T17:02:41.925 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.464937774999999, 2023-09-30T17:02:41.925 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000291212, 2023-09-30T17:02:41.925 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:41.925 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:41.925 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:41.925 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.925 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:41.926 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373200+0000", 2023-09-30T17:02:41.926 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:41.926 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.926 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.926 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:41.926 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373200+0000", 2023-09-30T17:02:41.926 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:41.926 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.926 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.926 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:41.926 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373200+0000", 2023-09-30T17:02:41.926 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7099999999999998e-07 2023-09-30T17:02:41.927 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.927 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.927 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:41.927 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373204+0000", 2023-09-30T17:02:41.927 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.968e-06 2023-09-30T17:02:41.927 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.927 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.927 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:41.927 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373212+0000", 2023-09-30T17:02:41.927 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8019999999999992e-06 2023-09-30T17:02:41.927 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.928 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.928 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:41.928 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373216+0000", 2023-09-30T17:02:41.928 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5279999999999997e-06 2023-09-30T17:02:41.928 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.928 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.928 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:41.928 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373381+0000", 2023-09-30T17:02:41.928 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000164988 2023-09-30T17:02:41.928 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.928 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.928 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:41.928 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373387+0000", 2023-09-30T17:02:41.929 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7729999999999996e-06 2023-09-30T17:02:41.929 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.929 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.929 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:41.929 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373491+0000", 2023-09-30T17:02:41.929 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010388200000000001 2023-09-30T17:02:41.929 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:41.929 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:41.929 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:41.929 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.929 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.929 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2023-09-30T17:02:41.930 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:02:41.930 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.464911233999999, 2023-09-30T17:02:41.930 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000359561, 2023-09-30T17:02:41.930 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:41.930 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2023-09-30T17:02:41.930 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:41.930 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.930 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:41.930 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:02:41.930 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:41.930 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.930 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.931 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:41.931 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:02:41.931 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:41.931 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.931 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.931 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:41.931 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:02:41.931 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1e-07 2023-09-30T17:02:41.931 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.931 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.931 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:41.931 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373228+0000", 2023-09-30T17:02:41.932 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9420000000000002e-06 2023-09-30T17:02:41.932 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.932 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.932 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:41.932 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373235+0000", 2023-09-30T17:02:41.932 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4230000000000002e-06 2023-09-30T17:02:41.932 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.932 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.932 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:41.932 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373239+0000", 2023-09-30T17:02:41.932 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6809999999999997e-06 2023-09-30T17:02:41.932 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.932 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.933 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:41.933 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373518+0000", 2023-09-30T17:02:41.933 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000278311 2023-09-30T17:02:41.933 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.933 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.933 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:41.933 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373586+0000", 2023-09-30T17:02:41.933 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7994e-05 2023-09-30T17:02:41.933 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:41.933 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:41.933 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:41.934 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.934 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.934 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:02:41.934 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:02:41.934 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.460485161000001, 2023-09-30T17:02:41.934 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0046632949999999996, 2023-09-30T17:02:41.934 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:41.934 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:41.934 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:41.934 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.934 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:41.934 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:02:41.935 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:41.935 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.935 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.935 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:41.935 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:02:41.935 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:41.935 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.935 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.935 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:41.935 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377653+0000", 2023-09-30T17:02:41.935 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7800000000000002e-07 2023-09-30T17:02:41.935 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.936 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.936 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:41.936 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377657+0000", 2023-09-30T17:02:41.936 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5859999999999998e-06 2023-09-30T17:02:41.936 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.936 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.936 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:41.936 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377677+0000", 2023-09-30T17:02:41.936 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9508999999999999e-05 2023-09-30T17:02:41.936 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.936 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.936 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:41.937 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377682+0000", 2023-09-30T17:02:41.937 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8300000000000001e-06 2023-09-30T17:02:41.937 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.937 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.937 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:41.937 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377725+0000", 2023-09-30T17:02:41.937 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2425000000000001e-05 2023-09-30T17:02:41.937 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.937 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.937 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:41.937 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377738+0000", 2023-09-30T17:02:41.937 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2899e-05 2023-09-30T17:02:41.938 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.938 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.938 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:41.938 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382268+0000", 2023-09-30T17:02:41.938 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045301289999999999 2023-09-30T17:02:41.938 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.938 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.938 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:41.938 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382315+0000", 2023-09-30T17:02:41.938 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7539e-05 2023-09-30T17:02:41.938 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:41.939 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:41.939 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:41.939 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.939 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.939 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-09-30T17:02:41.939 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:02:41.939 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.46003571, 2023-09-30T17:02:41.939 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042540670000000003, 2023-09-30T17:02:41.939 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:41.939 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:41.939 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:41.939 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.940 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:41.940 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:02:41.940 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:41.940 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.940 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.940 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:41.940 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:02:41.940 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:41.940 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.940 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.940 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:41.940 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:02:41.941 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0299999999999998e-07 2023-09-30T17:02:41.941 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.941 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.941 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:41.941 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378107+0000", 2023-09-30T17:02:41.941 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9250000000000003e-06 2023-09-30T17:02:41.941 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.941 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.941 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:41.941 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378116+0000", 2023-09-30T17:02:41.941 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.037e-06 2023-09-30T17:02:41.941 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.942 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.942 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:41.942 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378123+0000", 2023-09-30T17:02:41.942 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1879999999999996e-06 2023-09-30T17:02:41.942 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.942 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.942 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:41.942 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378174+0000", 2023-09-30T17:02:41.942 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0998000000000002e-05 2023-09-30T17:02:41.942 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.942 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.943 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:41.943 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378197+0000", 2023-09-30T17:02:41.943 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2558e-05 2023-09-30T17:02:41.943 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.943 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.943 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:41.943 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382319+0000", 2023-09-30T17:02:41.943 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041220950000000001 2023-09-30T17:02:41.943 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.943 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.943 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:41.943 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382356+0000", 2023-09-30T17:02:41.943 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6563000000000002e-05 2023-09-30T17:02:41.944 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:41.944 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:41.944 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:41.944 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.944 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.944 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-09-30T17:02:41.944 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:02:41.944 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 19.402271886000001, 2023-09-30T17:02:41.944 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00171641, 2023-09-30T17:02:41.944 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:41.944 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:41.944 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:41.945 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.945 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:41.945 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:02:41.945 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:41.945 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.945 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.945 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:41.945 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:02:41.945 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:41.945 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.945 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.945 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:41.946 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435868+0000", 2023-09-30T17:02:41.946 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5840000000000002e-06 2023-09-30T17:02:41.946 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.946 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.946 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:41.946 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435892+0000", 2023-09-30T17:02:41.946 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3625000000000002e-05 2023-09-30T17:02:41.946 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.946 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.946 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:41.946 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435908+0000", 2023-09-30T17:02:41.946 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6548000000000001e-05 2023-09-30T17:02:41.947 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.947 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.947 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:41.947 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435935+0000", 2023-09-30T17:02:41.947 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6516000000000002e-05 2023-09-30T17:02:41.947 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.947 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.947 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:41.947 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435996+0000", 2023-09-30T17:02:41.947 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1433999999999995e-05 2023-09-30T17:02:41.947 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.947 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.948 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:41.948 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436114+0000", 2023-09-30T17:02:41.948 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000118344 2023-09-30T17:02:41.948 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.948 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.948 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:41.948 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436219+0000", 2023-09-30T17:02:41.948 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010453100000000001 2023-09-30T17:02:41.948 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.948 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.948 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:41.948 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436900+0000", 2023-09-30T17:02:41.949 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00068121299999999996 2023-09-30T17:02:41.949 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.949 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.949 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:41.949 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437508+0000", 2023-09-30T17:02:41.949 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00060817399999999995 2023-09-30T17:02:41.949 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.949 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.949 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:41.949 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437554+0000", 2023-09-30T17:02:41.949 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5609000000000003e-05 2023-09-30T17:02:41.949 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:41.950 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:41.950 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:41.950 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437582+0000", 2023-09-30T17:02:41.950 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7832000000000001e-05 2023-09-30T17:02:41.950 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:41.950 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:41.950 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:41.950 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:41.950 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:41.950 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:02:41.952 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-09-30T17:02:41.952 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:41.952+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:42.053 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:42.053+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:42.091 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2023-09-30T17:02:42.092 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2023-09-30T17:02:42.092 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2023-09-30T17:02:42.092 INFO:teuthology.orchestra.run.smithi134.stdout:} 2023-09-30T17:02:42.102 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2023-09-30T17:02:42.153 INFO:tasks.ceph.osd.2.smithi134.stderr:2023-09-30T17:02:42.153+0000 7efd10b20700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 96961) UID: 0 2023-09-30T17:02:42.228 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2023-09-30T17:02:42.229 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2023-09-30T17:02:42.229 INFO:teuthology.orchestra.run.smithi134.stdout: "complaint_time": 30, 2023-09-30T17:02:42.229 INFO:teuthology.orchestra.run.smithi134.stdout: "num_blocked_ops": 0 2023-09-30T17:02:42.229 INFO:teuthology.orchestra.run.smithi134.stdout:} 2023-09-30T17:02:42.239 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2023-09-30T17:02:42.280 INFO:tasks.ceph.osd.2.smithi134.stderr:2023-09-30T17:02:42.279+0000 7efd10b20700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 96961) UID: 0 2023-09-30T17:02:42.315 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-09-30T17:02:42.355 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:42.356+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:42.410 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2023-09-30T17:02:42.410 INFO:teuthology.orchestra.run.smithi134.stdout: "size": 20, 2023-09-30T17:02:42.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 600, 2023-09-30T17:02:42.410 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [ 2023-09-30T17:02:42.410 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.410 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(client.4153.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e11)", 2023-09-30T17:02:42.410 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2023-09-30T17:02:07.728242+0000", 2023-09-30T17:02:42.410 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 34.680101743000002, 2023-09-30T17:02:42.410 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013877029000000001, 2023-09-30T17:02:42.411 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2023-09-30T17:02:42.411 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:42.411 INFO:teuthology.orchestra.run.smithi134.stdout: "client_info": { 2023-09-30T17:02:42.411 INFO:teuthology.orchestra.run.smithi134.stdout: "client": "client.4153", 2023-09-30T17:02:42.411 INFO:teuthology.orchestra.run.smithi134.stdout: "client_addr": "172.21.15.7:0/3760733398", 2023-09-30T17:02:42.411 INFO:teuthology.orchestra.run.smithi134.stdout: "tid": 140 2023-09-30T17:02:42.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.411 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2023-09-30T17:02:42.411 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.411 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2023-09-30T17:02:42.411 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:07.728242+0000", 2023-09-30T17:02:42.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:42.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2023-09-30T17:02:42.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:07.728242+0000", 2023-09-30T17:02:42.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:42.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.412 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.412 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2023-09-30T17:02:42.412 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:07.728242+0000", 2023-09-30T17:02:42.412 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.79e-07 2023-09-30T17:02:42.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2023-09-30T17:02:42.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:07.728296+0000", 2023-09-30T17:02:42.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3621e-05 2023-09-30T17:02:42.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2023-09-30T17:02:42.413 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:07.728300+0000", 2023-09-30T17:02:42.413 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6110000000000004e-06 2023-09-30T17:02:42.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.413 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.413 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2023-09-30T17:02:42.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:07.728304+0000", 2023-09-30T17:02:42.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.1180000000000002e-06 2023-09-30T17:02:42.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:42.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:07.737106+0000", 2023-09-30T17:02:42.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0088017860000000007 2023-09-30T17:02:42.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.414 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.414 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2023-09-30T17:02:42.414 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:07.737152+0000", 2023-09-30T17:02:42.414 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5664000000000002e-05 2023-09-30T17:02:42.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2023-09-30T17:02:42.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:07.737227+0000", 2023-09-30T17:02:42.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4788000000000003e-05 2023-09-30T17:02:42.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.415 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:42.415 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:07.738546+0000", 2023-09-30T17:02:42.415 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0013198369999999999 2023-09-30T17:02:42.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.415 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2023-09-30T17:02:42.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:07.742069+0000", 2023-09-30T17:02:42.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035230529999999999 2023-09-30T17:02:42.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2023-09-30T17:02:42.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:07.742099+0000", 2023-09-30T17:02:42.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9467000000000001e-05 2023-09-30T17:02:42.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.416 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.416 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2023-09-30T17:02:42.416 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:07.742119+0000", 2023-09-30T17:02:42.416 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9805000000000001e-05 2023-09-30T17:02:42.417 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:42.417 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2023-09-30T17:02:42.417 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:42.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.417 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.417 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:6 3.10 3:0d82a743:::600.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:42.417 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2023-09-30T17:02:18.351413+0000", 2023-09-30T17:02:42.417 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.056930754, 2023-09-30T17:02:42.417 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022436951, 2023-09-30T17:02:42.417 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2023-09-30T17:02:42.417 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:42.417 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2023-09-30T17:02:42.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2023-09-30T17:02:42.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.351413+0000", 2023-09-30T17:02:42.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:42.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.418 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2023-09-30T17:02:42.418 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.351413+0000", 2023-09-30T17:02:42.418 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:42.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.418 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2023-09-30T17:02:42.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.351415+0000", 2023-09-30T17:02:42.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9920000000000002e-06 2023-09-30T17:02:42.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2023-09-30T17:02:42.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.351422+0000", 2023-09-30T17:02:42.419 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2300000000000002e-06 2023-09-30T17:02:42.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.419 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.419 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2023-09-30T17:02:42.419 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.351433+0000", 2023-09-30T17:02:42.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1532000000000001e-05 2023-09-30T17:02:42.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2023-09-30T17:02:42.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.351446+0000", 2023-09-30T17:02:42.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2687000000000001e-05 2023-09-30T17:02:42.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.420 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.420 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:42.420 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352636+0000", 2023-09-30T17:02:42.420 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001190212 2023-09-30T17:02:42.420 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2023-09-30T17:02:42.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352644+0000", 2023-09-30T17:02:42.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0520000000000002e-06 2023-09-30T17:02:42.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.421 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:42.421 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.358475+0000", 2023-09-30T17:02:42.421 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0058308379999999996 2023-09-30T17:02:42.421 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.421 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2023-09-30T17:02:42.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.358591+0000", 2023-09-30T17:02:42.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000115746 2023-09-30T17:02:42.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2023-09-30T17:02:42.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.358722+0000", 2023-09-30T17:02:42.422 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013111399999999999 2023-09-30T17:02:42.422 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.422 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.422 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:42.422 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.373725+0000", 2023-09-30T17:02:42.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.015002678 2023-09-30T17:02:42.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2023-09-30T17:02:42.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.373758+0000", 2023-09-30T17:02:42.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2855000000000003e-05 2023-09-30T17:02:42.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.423 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.423 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2023-09-30T17:02:42.423 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.373806+0000", 2023-09-30T17:02:42.423 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8380000000000001e-05 2023-09-30T17:02:42.423 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.424 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2023-09-30T17:02:42.424 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.373850+0000", 2023-09-30T17:02:42.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3634999999999998e-05 2023-09-30T17:02:42.424 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:42.424 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2023-09-30T17:02:42.424 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:42.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.424 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.424 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:7 3.10 3:0d82a743:::600.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:42.424 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2023-09-30T17:02:18.352512+0000", 2023-09-30T17:02:42.424 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.055831377000001, 2023-09-30T17:02:42.424 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023505666000000001, 2023-09-30T17:02:42.425 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2023-09-30T17:02:42.425 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:42.425 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2023-09-30T17:02:42.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2023-09-30T17:02:42.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352512+0000", 2023-09-30T17:02:42.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:42.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.425 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.425 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2023-09-30T17:02:42.425 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352512+0000", 2023-09-30T17:02:42.425 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:42.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2023-09-30T17:02:42.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352513+0000", 2023-09-30T17:02:42.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0020000000000001e-06 2023-09-30T17:02:42.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.426 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2023-09-30T17:02:42.426 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352519+0000", 2023-09-30T17:02:42.426 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0700000000000003e-06 2023-09-30T17:02:42.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.426 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2023-09-30T17:02:42.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352531+0000", 2023-09-30T17:02:42.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2024e-05 2023-09-30T17:02:42.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2023-09-30T17:02:42.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352541+0000", 2023-09-30T17:02:42.427 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.5400000000000001e-06 2023-09-30T17:02:42.427 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.427 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.427 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:42.427 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352723+0000", 2023-09-30T17:02:42.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00018261800000000001 2023-09-30T17:02:42.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:42.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352731+0000", 2023-09-30T17:02:42.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.8529999999999992e-06 2023-09-30T17:02:42.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.428 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.428 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:42.428 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.359935+0000", 2023-09-30T17:02:42.428 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0072039670000000004 2023-09-30T17:02:42.428 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2023-09-30T17:02:42.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.360029+0000", 2023-09-30T17:02:42.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3623999999999997e-05 2023-09-30T17:02:42.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2023-09-30T17:02:42.429 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.360186+0000", 2023-09-30T17:02:42.429 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015768600000000001 2023-09-30T17:02:42.429 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.429 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.429 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2023-09-30T17:02:42.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.373903+0000", 2023-09-30T17:02:42.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013716081 2023-09-30T17:02:42.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:42.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.375919+0000", 2023-09-30T17:02:42.430 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020165339999999999 2023-09-30T17:02:42.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.430 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.430 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2023-09-30T17:02:42.430 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.375979+0000", 2023-09-30T17:02:42.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9648999999999998e-05 2023-09-30T17:02:42.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.431 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2023-09-30T17:02:42.431 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.376018+0000", 2023-09-30T17:02:42.431 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9017999999999998e-05 2023-09-30T17:02:42.431 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:42.431 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2023-09-30T17:02:42.431 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:42.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.431 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.431 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:8 3.10 3:09401a81:::601.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:42.432 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2023-09-30T17:02:18.352586+0000", 2023-09-30T17:02:42.432 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.055757441000001, 2023-09-30T17:02:42.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023588990000000001, 2023-09-30T17:02:42.432 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2023-09-30T17:02:42.432 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:42.432 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2023-09-30T17:02:42.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.432 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2023-09-30T17:02:42.432 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352586+0000", 2023-09-30T17:02:42.432 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:42.432 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.432 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2023-09-30T17:02:42.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352586+0000", 2023-09-30T17:02:42.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:42.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2023-09-30T17:02:42.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352587+0000", 2023-09-30T17:02:42.433 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3399999999999998e-07 2023-09-30T17:02:42.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.433 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.433 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2023-09-30T17:02:42.433 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352593+0000", 2023-09-30T17:02:42.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6510000000000004e-06 2023-09-30T17:02:42.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2023-09-30T17:02:42.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352602+0000", 2023-09-30T17:02:42.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4780000000000008e-06 2023-09-30T17:02:42.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.434 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.434 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2023-09-30T17:02:42.434 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352612+0000", 2023-09-30T17:02:42.434 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8800000000000003e-06 2023-09-30T17:02:42.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:42.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352773+0000", 2023-09-30T17:02:42.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016074399999999999 2023-09-30T17:02:42.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:42.435 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352777+0000", 2023-09-30T17:02:42.435 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2230000000000001e-06 2023-09-30T17:02:42.435 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.435 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.435 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:42.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.360480+0000", 2023-09-30T17:02:42.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.007703082 2023-09-30T17:02:42.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2023-09-30T17:02:42.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.360613+0000", 2023-09-30T17:02:42.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013267899999999999 2023-09-30T17:02:42.436 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.436 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.436 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2023-09-30T17:02:42.436 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.360741+0000", 2023-09-30T17:02:42.436 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012807500000000001 2023-09-30T17:02:42.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2023-09-30T17:02:42.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.373986+0000", 2023-09-30T17:02:42.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013244923 2023-09-30T17:02:42.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.437 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:42.437 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.376062+0000", 2023-09-30T17:02:42.437 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0020761600000000001 2023-09-30T17:02:42.437 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.437 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2023-09-30T17:02:42.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.376117+0000", 2023-09-30T17:02:42.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5211999999999999e-05 2023-09-30T17:02:42.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.438 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.438 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2023-09-30T17:02:42.438 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.376175+0000", 2023-09-30T17:02:42.438 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.8048999999999999e-05 2023-09-30T17:02:42.438 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:42.438 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2023-09-30T17:02:42.438 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:42.438 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.439 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:9 3.10 3:09401a81:::601.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:42.439 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2023-09-30T17:02:18.352642+0000", 2023-09-30T17:02:42.439 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.055701426999999, 2023-09-30T17:02:42.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.025205787, 2023-09-30T17:02:42.439 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2023-09-30T17:02:42.439 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:42.439 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2023-09-30T17:02:42.439 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.439 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2023-09-30T17:02:42.439 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352642+0000", 2023-09-30T17:02:42.439 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:42.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2023-09-30T17:02:42.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352642+0000", 2023-09-30T17:02:42.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:42.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.440 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.440 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2023-09-30T17:02:42.440 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352643+0000", 2023-09-30T17:02:42.440 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.274e-06 2023-09-30T17:02:42.440 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2023-09-30T17:02:42.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352650+0000", 2023-09-30T17:02:42.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4350000000000002e-06 2023-09-30T17:02:42.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2023-09-30T17:02:42.441 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352663+0000", 2023-09-30T17:02:42.441 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3726999999999999e-05 2023-09-30T17:02:42.441 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.441 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.441 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2023-09-30T17:02:42.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352675+0000", 2023-09-30T17:02:42.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1114000000000001e-05 2023-09-30T17:02:42.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:42.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352850+0000", 2023-09-30T17:02:42.442 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000175584 2023-09-30T17:02:42.442 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.442 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.442 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:42.442 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352855+0000", 2023-09-30T17:02:42.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0100000000000003e-06 2023-09-30T17:02:42.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:42.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.371933+0000", 2023-09-30T17:02:42.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019078023 2023-09-30T17:02:42.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.443 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.443 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2023-09-30T17:02:42.443 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.372003+0000", 2023-09-30T17:02:42.443 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9905000000000002e-05 2023-09-30T17:02:42.443 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2023-09-30T17:02:42.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.372145+0000", 2023-09-30T17:02:42.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000141939 2023-09-30T17:02:42.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.444 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2023-09-30T17:02:42.444 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.377025+0000", 2023-09-30T17:02:42.444 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048800930000000003 2023-09-30T17:02:42.444 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.444 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:42.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.377767+0000", 2023-09-30T17:02:42.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00074174500000000003 2023-09-30T17:02:42.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2023-09-30T17:02:42.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.377807+0000", 2023-09-30T17:02:42.445 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0454000000000003e-05 2023-09-30T17:02:42.445 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.445 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.445 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2023-09-30T17:02:42.445 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.377848+0000", 2023-09-30T17:02:42.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0484000000000001e-05 2023-09-30T17:02:42.446 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:42.446 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2023-09-30T17:02:42.446 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:42.446 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.446 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.446 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:10 3.10 3:0bd6d154:::602.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:42.446 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2023-09-30T17:02:18.352704+0000", 2023-09-30T17:02:42.446 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.055639704000001, 2023-09-30T17:02:42.446 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027898861, 2023-09-30T17:02:42.446 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2023-09-30T17:02:42.446 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:42.446 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2023-09-30T17:02:42.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2023-09-30T17:02:42.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352704+0000", 2023-09-30T17:02:42.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:42.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.447 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2023-09-30T17:02:42.447 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352704+0000", 2023-09-30T17:02:42.447 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:42.447 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.447 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2023-09-30T17:02:42.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352704+0000", 2023-09-30T17:02:42.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6700000000000003e-07 2023-09-30T17:02:42.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2023-09-30T17:02:42.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352709+0000", 2023-09-30T17:02:42.448 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2660000000000003e-06 2023-09-30T17:02:42.448 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.448 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.448 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2023-09-30T17:02:42.448 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352717+0000", 2023-09-30T17:02:42.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2630000000000003e-06 2023-09-30T17:02:42.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2023-09-30T17:02:42.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352723+0000", 2023-09-30T17:02:42.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5300000000000002e-06 2023-09-30T17:02:42.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.449 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.449 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:42.449 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352901+0000", 2023-09-30T17:02:42.449 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017788400000000001 2023-09-30T17:02:42.449 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:42.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352933+0000", 2023-09-30T17:02:42.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1550000000000001e-05 2023-09-30T17:02:42.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.450 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:42.450 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.372461+0000", 2023-09-30T17:02:42.450 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019527761000000001 2023-09-30T17:02:42.450 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.450 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2023-09-30T17:02:42.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.372575+0000", 2023-09-30T17:02:42.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011482899999999999 2023-09-30T17:02:42.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2023-09-30T17:02:42.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.372703+0000", 2023-09-30T17:02:42.451 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00012711299999999999 2023-09-30T17:02:42.451 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.451 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.451 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2023-09-30T17:02:42.451 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.377032+0000", 2023-09-30T17:02:42.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0043295 2023-09-30T17:02:42.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:42.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.380492+0000", 2023-09-30T17:02:42.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0034599850000000001 2023-09-30T17:02:42.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.452 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.452 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2023-09-30T17:02:42.452 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.380557+0000", 2023-09-30T17:02:42.452 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.5110999999999994e-05 2023-09-30T17:02:42.452 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.453 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2023-09-30T17:02:42.453 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.380603+0000", 2023-09-30T17:02:42.453 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5401999999999997e-05 2023-09-30T17:02:42.453 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:42.453 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2023-09-30T17:02:42.453 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:42.453 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.453 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.453 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:11 3.10 3:0bd6d154:::602.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:42.453 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2023-09-30T17:02:18.352735+0000", 2023-09-30T17:02:42.453 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.055608760999998, 2023-09-30T17:02:42.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027972103000000002, 2023-09-30T17:02:42.454 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2023-09-30T17:02:42.454 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:42.454 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2023-09-30T17:02:42.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2023-09-30T17:02:42.454 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352735+0000", 2023-09-30T17:02:42.454 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:42.454 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.454 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.454 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2023-09-30T17:02:42.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352735+0000", 2023-09-30T17:02:42.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:42.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2023-09-30T17:02:42.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352735+0000", 2023-09-30T17:02:42.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.7e-07 2023-09-30T17:02:42.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.455 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.455 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2023-09-30T17:02:42.455 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352749+0000", 2023-09-30T17:02:42.455 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.3380000000000001e-05 2023-09-30T17:02:42.455 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2023-09-30T17:02:42.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352757+0000", 2023-09-30T17:02:42.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.2020000000000004e-06 2023-09-30T17:02:42.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2023-09-30T17:02:42.456 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352765+0000", 2023-09-30T17:02:42.456 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4030000000000007e-06 2023-09-30T17:02:42.456 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.456 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.456 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:42.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353014+0000", 2023-09-30T17:02:42.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00024904199999999999 2023-09-30T17:02:42.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:42.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353023+0000", 2023-09-30T17:02:42.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.1500000000000005e-06 2023-09-30T17:02:42.457 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.457 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.457 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:42.457 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.373009+0000", 2023-09-30T17:02:42.457 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019985780000000002 2023-09-30T17:02:42.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2023-09-30T17:02:42.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.373089+0000", 2023-09-30T17:02:42.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9908999999999997e-05 2023-09-30T17:02:42.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.458 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.458 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2023-09-30T17:02:42.458 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.373235+0000", 2023-09-30T17:02:42.458 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014556700000000001 2023-09-30T17:02:42.458 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2023-09-30T17:02:42.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.377038+0000", 2023-09-30T17:02:42.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0038030500000000001 2023-09-30T17:02:42.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.459 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:42.459 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.380648+0000", 2023-09-30T17:02:42.459 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0036108300000000002 2023-09-30T17:02:42.459 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.459 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2023-09-30T17:02:42.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.380685+0000", 2023-09-30T17:02:42.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.6992000000000001e-05 2023-09-30T17:02:42.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.460 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.460 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2023-09-30T17:02:42.460 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.380707+0000", 2023-09-30T17:02:42.460 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1328e-05 2023-09-30T17:02:42.460 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:42.460 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2023-09-30T17:02:42.460 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:42.460 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.461 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:12 3.10 3:0d89b25e:::603.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:42.461 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2023-09-30T17:02:18.352883+0000", 2023-09-30T17:02:42.461 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.055460235000002, 2023-09-30T17:02:42.461 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027919086999999999, 2023-09-30T17:02:42.461 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2023-09-30T17:02:42.461 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:42.461 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2023-09-30T17:02:42.461 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.461 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2023-09-30T17:02:42.461 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352883+0000", 2023-09-30T17:02:42.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:42.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2023-09-30T17:02:42.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352883+0000", 2023-09-30T17:02:42.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:42.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.462 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.462 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2023-09-30T17:02:42.462 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352884+0000", 2023-09-30T17:02:42.462 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.4300000000000002e-07 2023-09-30T17:02:42.462 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2023-09-30T17:02:42.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352889+0000", 2023-09-30T17:02:42.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.276e-06 2023-09-30T17:02:42.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2023-09-30T17:02:42.463 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352901+0000", 2023-09-30T17:02:42.463 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1354e-05 2023-09-30T17:02:42.463 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.463 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.463 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2023-09-30T17:02:42.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352910+0000", 2023-09-30T17:02:42.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2590000000000006e-06 2023-09-30T17:02:42.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:42.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353075+0000", 2023-09-30T17:02:42.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00016486199999999999 2023-09-30T17:02:42.464 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.464 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.464 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:42.464 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353080+0000", 2023-09-30T17:02:42.464 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6699999999999999e-06 2023-09-30T17:02:42.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:42.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.374106+0000", 2023-09-30T17:02:42.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021025769999999999 2023-09-30T17:02:42.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2023-09-30T17:02:42.465 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.374497+0000", 2023-09-30T17:02:42.465 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00039031599999999998 2023-09-30T17:02:42.465 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.465 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.465 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2023-09-30T17:02:42.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.374625+0000", 2023-09-30T17:02:42.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000128288 2023-09-30T17:02:42.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2023-09-30T17:02:42.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.377184+0000", 2023-09-30T17:02:42.466 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025590069999999999 2023-09-30T17:02:42.466 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.466 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.466 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:42.466 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.380747+0000", 2023-09-30T17:02:42.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00356281 2023-09-30T17:02:42.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2023-09-30T17:02:42.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.380778+0000", 2023-09-30T17:02:42.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.1528e-05 2023-09-30T17:02:42.467 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.467 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.467 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2023-09-30T17:02:42.467 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.380802+0000", 2023-09-30T17:02:42.467 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4104000000000002e-05 2023-09-30T17:02:42.467 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:42.468 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2023-09-30T17:02:42.468 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:42.468 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.468 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:13 3.10 3:0d89b25e:::603.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:42.468 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2023-09-30T17:02:18.352934+0000", 2023-09-30T17:02:42.468 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.055409786999999, 2023-09-30T17:02:42.468 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.028004846999999999, 2023-09-30T17:02:42.468 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2023-09-30T17:02:42.468 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:42.468 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2023-09-30T17:02:42.468 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2023-09-30T17:02:42.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352934+0000", 2023-09-30T17:02:42.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:42.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2023-09-30T17:02:42.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352934+0000", 2023-09-30T17:02:42.469 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:42.469 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.469 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.469 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2023-09-30T17:02:42.469 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352934+0000", 2023-09-30T17:02:42.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.2399999999999997e-07 2023-09-30T17:02:42.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2023-09-30T17:02:42.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352939+0000", 2023-09-30T17:02:42.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6689999999999997e-06 2023-09-30T17:02:42.470 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.470 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.470 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2023-09-30T17:02:42.470 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352958+0000", 2023-09-30T17:02:42.470 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.9244000000000001e-05 2023-09-30T17:02:42.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2023-09-30T17:02:42.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.352966+0000", 2023-09-30T17:02:42.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.396e-06 2023-09-30T17:02:42.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.471 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:42.471 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353104+0000", 2023-09-30T17:02:42.471 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013801500000000001 2023-09-30T17:02:42.471 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.471 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:42.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353107+0000", 2023-09-30T17:02:42.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7780000000000001e-06 2023-09-30T17:02:42.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:42.472 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.376217+0000", 2023-09-30T17:02:42.472 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023109797000000001 2023-09-30T17:02:42.472 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.472 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.472 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2023-09-30T17:02:42.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.376310+0000", 2023-09-30T17:02:42.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2900999999999997e-05 2023-09-30T17:02:42.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2023-09-30T17:02:42.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.376449+0000", 2023-09-30T17:02:42.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013920499999999999 2023-09-30T17:02:42.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.473 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.473 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2023-09-30T17:02:42.473 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.379037+0000", 2023-09-30T17:02:42.473 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0025876570000000002 2023-09-30T17:02:42.473 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:42.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.380838+0000", 2023-09-30T17:02:42.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0018010229999999999 2023-09-30T17:02:42.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.474 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2023-09-30T17:02:42.474 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.380901+0000", 2023-09-30T17:02:42.474 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2985999999999996e-05 2023-09-30T17:02:42.474 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.474 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.475 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2023-09-30T17:02:42.475 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.380939+0000", 2023-09-30T17:02:42.475 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7452e-05 2023-09-30T17:02:42.475 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:42.475 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2023-09-30T17:02:42.475 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:42.475 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.475 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.475 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:18 3.14 3:2f55791f:::606.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:42.475 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2023-09-30T17:02:18.353000+0000", 2023-09-30T17:02:42.475 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.055343615999998, 2023-09-30T17:02:42.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020772597, 2023-09-30T17:02:42.476 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2023-09-30T17:02:42.476 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:42.476 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2023-09-30T17:02:42.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2023-09-30T17:02:42.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353000+0000", 2023-09-30T17:02:42.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:42.476 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.476 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.476 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2023-09-30T17:02:42.476 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353000+0000", 2023-09-30T17:02:42.476 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:42.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2023-09-30T17:02:42.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353001+0000", 2023-09-30T17:02:42.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3200000000000004e-07 2023-09-30T17:02:42.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.477 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2023-09-30T17:02:42.477 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353005+0000", 2023-09-30T17:02:42.477 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8729999999999998e-06 2023-09-30T17:02:42.477 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.477 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2023-09-30T17:02:42.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353015+0000", 2023-09-30T17:02:42.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8460000000000003e-06 2023-09-30T17:02:42.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2023-09-30T17:02:42.478 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353045+0000", 2023-09-30T17:02:42.478 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.9658e-05 2023-09-30T17:02:42.478 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.478 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.478 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:42.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353100+0000", 2023-09-30T17:02:42.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5367e-05 2023-09-30T17:02:42.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2023-09-30T17:02:42.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353106+0000", 2023-09-30T17:02:42.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7910000000000001e-06 2023-09-30T17:02:42.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.479 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.479 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:42.479 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.357335+0000", 2023-09-30T17:02:42.479 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0042287009999999996 2023-09-30T17:02:42.479 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2023-09-30T17:02:42.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.357559+0000", 2023-09-30T17:02:42.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00022433300000000001 2023-09-30T17:02:42.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.480 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2023-09-30T17:02:42.480 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.358628+0000", 2023-09-30T17:02:42.480 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0010683999999999999 2023-09-30T17:02:42.480 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.480 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2023-09-30T17:02:42.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.372097+0000", 2023-09-30T17:02:42.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013469907999999999 2023-09-30T17:02:42.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:42.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.373577+0000", 2023-09-30T17:02:42.481 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.001479494 2023-09-30T17:02:42.481 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.481 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.481 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2023-09-30T17:02:42.481 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.373724+0000", 2023-09-30T17:02:42.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00014686199999999999 2023-09-30T17:02:42.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.482 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2023-09-30T17:02:42.482 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.373772+0000", 2023-09-30T17:02:42.482 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.8631999999999998e-05 2023-09-30T17:02:42.482 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:42.482 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2023-09-30T17:02:42.482 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:42.482 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.482 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.482 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:19 3.14 3:2f55791f:::606.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:42.483 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2023-09-30T17:02:18.353071+0000", 2023-09-30T17:02:42.483 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.055272912, 2023-09-30T17:02:42.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024860190000000001, 2023-09-30T17:02:42.483 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2023-09-30T17:02:42.483 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:42.483 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2023-09-30T17:02:42.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.483 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2023-09-30T17:02:42.483 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353071+0000", 2023-09-30T17:02:42.483 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:42.483 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.483 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2023-09-30T17:02:42.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353071+0000", 2023-09-30T17:02:42.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:42.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2023-09-30T17:02:42.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353071+0000", 2023-09-30T17:02:42.484 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2500000000000005e-07 2023-09-30T17:02:42.484 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.484 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.484 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2023-09-30T17:02:42.484 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353076+0000", 2023-09-30T17:02:42.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0810000000000001e-06 2023-09-30T17:02:42.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2023-09-30T17:02:42.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353084+0000", 2023-09-30T17:02:42.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.0250000000000002e-06 2023-09-30T17:02:42.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.485 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.485 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2023-09-30T17:02:42.485 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353092+0000", 2023-09-30T17:02:42.485 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4250000000000001e-06 2023-09-30T17:02:42.485 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:42.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353145+0000", 2023-09-30T17:02:42.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3236999999999999e-05 2023-09-30T17:02:42.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.486 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:42.486 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353150+0000", 2023-09-30T17:02:42.486 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0989999999999998e-06 2023-09-30T17:02:42.486 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.486 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:42.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.360509+0000", 2023-09-30T17:02:42.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0073590690000000002 2023-09-30T17:02:42.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2023-09-30T17:02:42.487 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.360594+0000", 2023-09-30T17:02:42.487 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5345000000000004e-05 2023-09-30T17:02:42.487 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.487 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.487 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2023-09-30T17:02:42.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.360743+0000", 2023-09-30T17:02:42.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000148932 2023-09-30T17:02:42.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2023-09-30T17:02:42.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.374845+0000", 2023-09-30T17:02:42.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.014101948 2023-09-30T17:02:42.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.488 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.488 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:42.488 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.377844+0000", 2023-09-30T17:02:42.488 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.002998616 2023-09-30T17:02:42.488 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2023-09-30T17:02:42.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.377903+0000", 2023-09-30T17:02:42.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9555000000000002e-05 2023-09-30T17:02:42.489 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.489 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.489 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2023-09-30T17:02:42.489 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.377931+0000", 2023-09-30T17:02:42.489 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.7233000000000002e-05 2023-09-30T17:02:42.489 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:42.489 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2023-09-30T17:02:42.490 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:42.490 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.490 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:20 3.1c 3:3ed09add:::607.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:42.490 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2023-09-30T17:02:18.353105+0000", 2023-09-30T17:02:42.490 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.055238292999999, 2023-09-30T17:02:42.490 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.029421313000000001, 2023-09-30T17:02:42.490 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2023-09-30T17:02:42.490 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:42.490 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2023-09-30T17:02:42.490 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2023-09-30T17:02:42.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353105+0000", 2023-09-30T17:02:42.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:42.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2023-09-30T17:02:42.491 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353105+0000", 2023-09-30T17:02:42.491 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:42.491 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.491 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.491 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2023-09-30T17:02:42.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353106+0000", 2023-09-30T17:02:42.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9500000000000002e-07 2023-09-30T17:02:42.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2023-09-30T17:02:42.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353113+0000", 2023-09-30T17:02:42.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3769999999999998e-06 2023-09-30T17:02:42.492 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.492 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.492 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2023-09-30T17:02:42.492 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353121+0000", 2023-09-30T17:02:42.492 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1850000000000004e-06 2023-09-30T17:02:42.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2023-09-30T17:02:42.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353127+0000", 2023-09-30T17:02:42.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.9240000000000004e-06 2023-09-30T17:02:42.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.493 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:42.493 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353154+0000", 2023-09-30T17:02:42.493 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.6472999999999999e-05 2023-09-30T17:02:42.493 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.493 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2023-09-30T17:02:42.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353158+0000", 2023-09-30T17:02:42.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.765e-06 2023-09-30T17:02:42.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:42.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.377385+0000", 2023-09-30T17:02:42.494 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024227697999999999 2023-09-30T17:02:42.494 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.494 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.494 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2023-09-30T17:02:42.494 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.377482+0000", 2023-09-30T17:02:42.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.6884000000000003e-05 2023-09-30T17:02:42.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 1", 2023-09-30T17:02:42.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.377562+0000", 2023-09-30T17:02:42.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.9373000000000001e-05 2023-09-30T17:02:42.495 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.495 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.495 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2023-09-30T17:02:42.495 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.379336+0000", 2023-09-30T17:02:42.495 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0017747030000000001 2023-09-30T17:02:42.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:42.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.382435+0000", 2023-09-30T17:02:42.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0030985980000000002 2023-09-30T17:02:42.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.496 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2023-09-30T17:02:42.496 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.382489+0000", 2023-09-30T17:02:42.496 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3844000000000002e-05 2023-09-30T17:02:42.496 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.496 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.497 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2023-09-30T17:02:42.497 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.382526+0000", 2023-09-30T17:02:42.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.7793999999999998e-05 2023-09-30T17:02:42.497 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:42.497 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2023-09-30T17:02:42.497 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:42.497 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.497 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.497 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:21 3.1c 3:3ed09add:::607.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:42.497 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2023-09-30T17:02:18.353138+0000", 2023-09-30T17:02:42.497 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.055204997000001, 2023-09-30T17:02:42.497 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.029470686999999999, 2023-09-30T17:02:42.498 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2023-09-30T17:02:42.498 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:42.498 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2023-09-30T17:02:42.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2023-09-30T17:02:42.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353138+0000", 2023-09-30T17:02:42.498 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:42.498 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.498 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.498 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2023-09-30T17:02:42.498 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353138+0000", 2023-09-30T17:02:42.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:42.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2023-09-30T17:02:42.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353139+0000", 2023-09-30T17:02:42.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.5999999999999999e-07 2023-09-30T17:02:42.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.499 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.499 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2023-09-30T17:02:42.499 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353151+0000", 2023-09-30T17:02:42.499 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.1724e-05 2023-09-30T17:02:42.499 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2023-09-30T17:02:42.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353158+0000", 2023-09-30T17:02:42.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.311e-06 2023-09-30T17:02:42.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2023-09-30T17:02:42.500 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353165+0000", 2023-09-30T17:02:42.500 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.7710000000000001e-06 2023-09-30T17:02:42.500 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.500 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.500 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:42.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353206+0000", 2023-09-30T17:02:42.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.0927999999999998e-05 2023-09-30T17:02:42.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:42.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353210+0000", 2023-09-30T17:02:42.501 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.4129999999999999e-06 2023-09-30T17:02:42.501 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.501 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.501 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:42.501 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.377847+0000", 2023-09-30T17:02:42.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.024636974999999998 2023-09-30T17:02:42.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2023-09-30T17:02:42.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.377920+0000", 2023-09-30T17:02:42.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.3379000000000003e-05 2023-09-30T17:02:42.502 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.502 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.502 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 1", 2023-09-30T17:02:42.502 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.378019+0000", 2023-09-30T17:02:42.502 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8188000000000002e-05 2023-09-30T17:02:42.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2023-09-30T17:02:42.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.379339+0000", 2023-09-30T17:02:42.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0013208269999999999 2023-09-30T17:02:42.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.503 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:42.503 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.382555+0000", 2023-09-30T17:02:42.503 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0032160719999999999 2023-09-30T17:02:42.503 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.503 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2023-09-30T17:02:42.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.382588+0000", 2023-09-30T17:02:42.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.2551000000000001e-05 2023-09-30T17:02:42.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.504 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2023-09-30T17:02:42.504 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.382609+0000", 2023-09-30T17:02:42.504 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1087999999999999e-05 2023-09-30T17:02:42.504 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:42.504 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2023-09-30T17:02:42.504 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:42.504 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.504 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.505 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:31 3.13 3:cd5a64a3:::100.00000000:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:42.505 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2023-09-30T17:02:18.353177+0000", 2023-09-30T17:02:42.505 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.055165977000001, 2023-09-30T17:02:42.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021468628999999999, 2023-09-30T17:02:42.505 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2023-09-30T17:02:42.505 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:42.505 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2023-09-30T17:02:42.505 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.505 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2023-09-30T17:02:42.505 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353177+0000", 2023-09-30T17:02:42.505 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:42.505 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2023-09-30T17:02:42.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353177+0000", 2023-09-30T17:02:42.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:42.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.506 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2023-09-30T17:02:42.506 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353178+0000", 2023-09-30T17:02:42.506 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6400000000000002e-07 2023-09-30T17:02:42.506 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.506 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2023-09-30T17:02:42.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353194+0000", 2023-09-30T17:02:42.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.6368999999999999e-05 2023-09-30T17:02:42.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2023-09-30T17:02:42.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353202+0000", 2023-09-30T17:02:42.507 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.6850000000000001e-06 2023-09-30T17:02:42.507 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.507 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.507 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2023-09-30T17:02:42.507 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353208+0000", 2023-09-30T17:02:42.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.1500000000000004e-06 2023-09-30T17:02:42.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:42.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353264+0000", 2023-09-30T17:02:42.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.592e-05 2023-09-30T17:02:42.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.508 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.508 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2023-09-30T17:02:42.508 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353270+0000", 2023-09-30T17:02:42.508 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.5729999999999998e-06 2023-09-30T17:02:42.508 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:42.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.359790+0000", 2023-09-30T17:02:42.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0065198909999999999 2023-09-30T17:02:42.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2023-09-30T17:02:42.509 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.359923+0000", 2023-09-30T17:02:42.509 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000133409 2023-09-30T17:02:42.509 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.509 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.509 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 1", 2023-09-30T17:02:42.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.360093+0000", 2023-09-30T17:02:42.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00017002799999999999 2023-09-30T17:02:42.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2023-09-30T17:02:42.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.363179+0000", 2023-09-30T17:02:42.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003086175 2023-09-30T17:02:42.510 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.510 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.510 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:42.510 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.374547+0000", 2023-09-30T17:02:42.510 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011367393999999999 2023-09-30T17:02:42.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2023-09-30T17:02:42.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.374604+0000", 2023-09-30T17:02:42.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.698e-05 2023-09-30T17:02:42.511 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.511 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.511 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2023-09-30T17:02:42.511 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.374646+0000", 2023-09-30T17:02:42.511 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.2490999999999997e-05 2023-09-30T17:02:42.511 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:42.511 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2023-09-30T17:02:42.512 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:42.512 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.512 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:1 3.14 3:292cf221:::200.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:42.512 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2023-09-30T17:02:18.353229+0000", 2023-09-30T17:02:42.512 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.055114742000001, 2023-09-30T17:02:42.512 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.027370586999999998, 2023-09-30T17:02:42.512 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2023-09-30T17:02:42.512 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:42.512 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2023-09-30T17:02:42.512 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.512 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2023-09-30T17:02:42.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353229+0000", 2023-09-30T17:02:42.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:42.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2023-09-30T17:02:42.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353229+0000", 2023-09-30T17:02:42.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:42.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.513 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.513 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2023-09-30T17:02:42.513 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353229+0000", 2023-09-30T17:02:42.513 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.5300000000000003e-07 2023-09-30T17:02:42.513 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2023-09-30T17:02:42.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353235+0000", 2023-09-30T17:02:42.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.0159999999999997e-06 2023-09-30T17:02:42.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2023-09-30T17:02:42.514 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353245+0000", 2023-09-30T17:02:42.514 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.8239999999999995e-06 2023-09-30T17:02:42.514 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.514 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.514 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2023-09-30T17:02:42.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353251+0000", 2023-09-30T17:02:42.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.105e-06 2023-09-30T17:02:42.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:42.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353303+0000", 2023-09-30T17:02:42.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1118000000000001e-05 2023-09-30T17:02:42.515 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.515 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.515 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:42.515 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353327+0000", 2023-09-30T17:02:42.515 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.4494999999999998e-05 2023-09-30T17:02:42.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:42.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.372517+0000", 2023-09-30T17:02:42.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019190005 2023-09-30T17:02:42.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.516 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2023-09-30T17:02:42.516 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.372655+0000", 2023-09-30T17:02:42.516 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013773 2023-09-30T17:02:42.516 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.516 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2023-09-30T17:02:42.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.372793+0000", 2023-09-30T17:02:42.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000138417 2023-09-30T17:02:42.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2023-09-30T17:02:42.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.376928+0000", 2023-09-30T17:02:42.517 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0041351139999999996 2023-09-30T17:02:42.517 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.517 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.517 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:42.517 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.380517+0000", 2023-09-30T17:02:42.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0035886469999999999 2023-09-30T17:02:42.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2023-09-30T17:02:42.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.380560+0000", 2023-09-30T17:02:42.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.3415999999999999e-05 2023-09-30T17:02:42.518 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.518 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.518 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2023-09-30T17:02:42.518 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.380599+0000", 2023-09-30T17:02:42.518 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.8946999999999998e-05 2023-09-30T17:02:42.518 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:42.519 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2023-09-30T17:02:42.519 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:42.519 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.519 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:2 3.f 3:f1f69726:::400.00000000:head [writefull 0~22] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:42.519 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2023-09-30T17:02:18.353267+0000", 2023-09-30T17:02:42.519 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.055076281000002, 2023-09-30T17:02:42.519 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.022828642999999999, 2023-09-30T17:02:42.519 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2023-09-30T17:02:42.519 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:42.519 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2023-09-30T17:02:42.519 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2023-09-30T17:02:42.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353267+0000", 2023-09-30T17:02:42.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:42.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2023-09-30T17:02:42.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353267+0000", 2023-09-30T17:02:42.520 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:42.520 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.520 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.520 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2023-09-30T17:02:42.520 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353268+0000", 2023-09-30T17:02:42.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.4600000000000004e-07 2023-09-30T17:02:42.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2023-09-30T17:02:42.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353274+0000", 2023-09-30T17:02:42.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2090000000000002e-06 2023-09-30T17:02:42.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.521 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.521 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2023-09-30T17:02:42.521 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353292+0000", 2023-09-30T17:02:42.521 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.8281999999999999e-05 2023-09-30T17:02:42.521 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2023-09-30T17:02:42.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353313+0000", 2023-09-30T17:02:42.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.065e-05 2023-09-30T17:02:42.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:42.522 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353907+0000", 2023-09-30T17:02:42.522 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000594219 2023-09-30T17:02:42.522 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.522 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.522 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2023-09-30T17:02:42.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353913+0000", 2023-09-30T17:02:42.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.117e-06 2023-09-30T17:02:42.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:42.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.363363+0000", 2023-09-30T17:02:42.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0094493890000000007 2023-09-30T17:02:42.523 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.523 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.523 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2023-09-30T17:02:42.523 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.363470+0000", 2023-09-30T17:02:42.523 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000106891 2023-09-30T17:02:42.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2023-09-30T17:02:42.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.363571+0000", 2023-09-30T17:02:42.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000101745 2023-09-30T17:02:42.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.524 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:42.524 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.375870+0000", 2023-09-30T17:02:42.524 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.01229859 2023-09-30T17:02:42.524 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.524 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2023-09-30T17:02:42.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.375885+0000", 2023-09-30T17:02:42.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.4849e-05 2023-09-30T17:02:42.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2023-09-30T17:02:42.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.375936+0000", 2023-09-30T17:02:42.525 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.1125000000000003e-05 2023-09-30T17:02:42.525 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.525 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.525 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2023-09-30T17:02:42.525 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.376096+0000", 2023-09-30T17:02:42.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00015993100000000001 2023-09-30T17:02:42.526 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:42.526 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2023-09-30T17:02:42.526 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:42.526 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.526 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.526 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:3 3.14 3:287034c4:::1.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:42.526 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2023-09-30T17:02:18.353855+0000", 2023-09-30T17:02:42.526 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.054488085999999, 2023-09-30T17:02:42.526 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026925168999999999, 2023-09-30T17:02:42.526 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2023-09-30T17:02:42.526 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:42.527 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2023-09-30T17:02:42.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2023-09-30T17:02:42.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353855+0000", 2023-09-30T17:02:42.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:42.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.527 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2023-09-30T17:02:42.527 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353855+0000", 2023-09-30T17:02:42.527 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:42.527 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.527 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2023-09-30T17:02:42.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353856+0000", 2023-09-30T17:02:42.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3200000000000004e-07 2023-09-30T17:02:42.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2023-09-30T17:02:42.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353866+0000", 2023-09-30T17:02:42.528 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.995e-06 2023-09-30T17:02:42.528 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.528 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.528 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2023-09-30T17:02:42.528 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353888+0000", 2023-09-30T17:02:42.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 2.1501e-05 2023-09-30T17:02:42.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2023-09-30T17:02:42.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.353897+0000", 2023-09-30T17:02:42.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2930000000000006e-06 2023-09-30T17:02:42.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.529 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:42.529 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.354214+0000", 2023-09-30T17:02:42.529 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00031667899999999999 2023-09-30T17:02:42.529 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.529 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:42.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.354224+0000", 2023-09-30T17:02:42.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.0183000000000001e-05 2023-09-30T17:02:42.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:42.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.373813+0000", 2023-09-30T17:02:42.530 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.019589123 2023-09-30T17:02:42.530 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.530 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.530 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2023-09-30T17:02:42.530 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.373949+0000", 2023-09-30T17:02:42.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000135716 2023-09-30T17:02:42.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2023-09-30T17:02:42.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.374086+0000", 2023-09-30T17:02:42.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00013770500000000001 2023-09-30T17:02:42.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.531 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.531 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2023-09-30T17:02:42.531 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.377359+0000", 2023-09-30T17:02:42.531 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00327225 2023-09-30T17:02:42.531 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:42.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.380664+0000", 2023-09-30T17:02:42.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.003305672 2023-09-30T17:02:42.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2023-09-30T17:02:42.532 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.380727+0000", 2023-09-30T17:02:42.532 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.2748000000000003e-05 2023-09-30T17:02:42.532 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.532 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.532 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2023-09-30T17:02:42.533 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.380781+0000", 2023-09-30T17:02:42.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.3471999999999999e-05 2023-09-30T17:02:42.533 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:42.533 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2023-09-30T17:02:42.533 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:42.533 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.533 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.533 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:26 3.13 3:c91d4a1d:::mds0_inotable:head [writefull 0~34] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:42.533 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2023-09-30T17:02:18.354158+0000", 2023-09-30T17:02:42.533 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.054185223000001, 2023-09-30T17:02:42.533 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.021615973, 2023-09-30T17:02:42.533 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2023-09-30T17:02:42.534 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:42.534 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2023-09-30T17:02:42.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2023-09-30T17:02:42.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.354158+0000", 2023-09-30T17:02:42.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:42.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.534 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.534 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2023-09-30T17:02:42.534 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.354158+0000", 2023-09-30T17:02:42.534 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:42.534 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2023-09-30T17:02:42.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.354159+0000", 2023-09-30T17:02:42.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.5199999999999995e-07 2023-09-30T17:02:42.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2023-09-30T17:02:42.535 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.354166+0000", 2023-09-30T17:02:42.535 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.1010000000000003e-06 2023-09-30T17:02:42.535 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.535 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.535 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2023-09-30T17:02:42.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.354236+0000", 2023-09-30T17:02:42.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.9417000000000003e-05 2023-09-30T17:02:42.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2023-09-30T17:02:42.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.354243+0000", 2023-09-30T17:02:42.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4279999999999999e-06 2023-09-30T17:02:42.536 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.536 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.536 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:42.536 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.360488+0000", 2023-09-30T17:02:42.536 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0062447520000000001 2023-09-30T17:02:42.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2023-09-30T17:02:42.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.360607+0000", 2023-09-30T17:02:42.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00011969 2023-09-30T17:02:42.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.537 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 1", 2023-09-30T17:02:42.537 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.360753+0000", 2023-09-30T17:02:42.537 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000145768 2023-09-30T17:02:42.537 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.537 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2023-09-30T17:02:42.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.363914+0000", 2023-09-30T17:02:42.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0031611069999999998 2023-09-30T17:02:42.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:42.538 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.375134+0000", 2023-09-30T17:02:42.538 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.011219665 2023-09-30T17:02:42.538 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.538 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.538 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2023-09-30T17:02:42.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.375200+0000", 2023-09-30T17:02:42.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.6311999999999998e-05 2023-09-30T17:02:42.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.539 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2023-09-30T17:02:42.539 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.375774+0000", 2023-09-30T17:02:42.539 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00057388100000000004 2023-09-30T17:02:42.539 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:42.539 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2023-09-30T17:02:42.539 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:42.539 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.539 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.540 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:29 3.d 3:b50e409b:::mds_snaptable:head [writefull 0~70] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:42.540 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2023-09-30T17:02:18.354261+0000", 2023-09-30T17:02:42.540 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.054082112, 2023-09-30T17:02:42.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.023631425000000001, 2023-09-30T17:02:42.540 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2023-09-30T17:02:42.540 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:42.540 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2023-09-30T17:02:42.540 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.540 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2023-09-30T17:02:42.540 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.354261+0000", 2023-09-30T17:02:42.540 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:42.540 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2023-09-30T17:02:42.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.354261+0000", 2023-09-30T17:02:42.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:42.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2023-09-30T17:02:42.541 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.354262+0000", 2023-09-30T17:02:42.541 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.1800000000000005e-07 2023-09-30T17:02:42.541 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.541 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.541 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2023-09-30T17:02:42.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.354267+0000", 2023-09-30T17:02:42.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 4.6890000000000003e-06 2023-09-30T17:02:42.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2023-09-30T17:02:42.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.354323+0000", 2023-09-30T17:02:42.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.6051000000000003e-05 2023-09-30T17:02:42.542 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.542 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.542 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2023-09-30T17:02:42.542 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.354332+0000", 2023-09-30T17:02:42.542 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.2909999999999996e-06 2023-09-30T17:02:42.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:42.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.354389+0000", 2023-09-30T17:02:42.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.7015000000000002e-05 2023-09-30T17:02:42.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.543 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op must wait for map", 2023-09-30T17:02:42.543 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.354396+0000", 2023-09-30T17:02:42.543 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 6.8079999999999999e-06 2023-09-30T17:02:42.543 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.543 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:42.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.360121+0000", 2023-09-30T17:02:42.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0057245320000000001 2023-09-30T17:02:42.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2023-09-30T17:02:42.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.360253+0000", 2023-09-30T17:02:42.544 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000132514 2023-09-30T17:02:42.544 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.544 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.544 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting for subops from 0", 2023-09-30T17:02:42.544 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.360494+0000", 2023-09-30T17:02:42.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.000241258 2023-09-30T17:02:42.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "op_commit", 2023-09-30T17:02:42.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.374022+0000", 2023-09-30T17:02:42.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.013527627 2023-09-30T17:02:42.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.545 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:42.545 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.377760+0000", 2023-09-30T17:02:42.545 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0037381099999999998 2023-09-30T17:02:42.545 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.545 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "commit_sent", 2023-09-30T17:02:42.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.377854+0000", 2023-09-30T17:02:42.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 9.3511999999999995e-05 2023-09-30T17:02:42.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.546 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.546 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2023-09-30T17:02:42.546 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.377893+0000", 2023-09-30T17:02:42.546 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9199999999999997e-05 2023-09-30T17:02:42.546 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:42.546 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2023-09-30T17:02:42.546 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:42.546 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.547 INFO:teuthology.orchestra.run.smithi134.stdout: "description": "osd_op(mds.0.3:32 3.14 3:2e2fa760:::200.00000001:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:42.547 INFO:teuthology.orchestra.run.smithi134.stdout: "initiated_at": "2023-09-30T17:02:18.354348+0000", 2023-09-30T17:02:42.547 INFO:teuthology.orchestra.run.smithi134.stdout: "age": 24.053995294, 2023-09-30T17:02:42.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.026568931, 2023-09-30T17:02:42.547 INFO:teuthology.orchestra.run.smithi134.stdout: "type_data": { 2023-09-30T17:02:42.547 INFO:teuthology.orchestra.run.smithi134.stdout: "flag_point": "started", 2023-09-30T17:02:42.547 INFO:teuthology.orchestra.run.smithi134.stdout: "events": [ 2023-09-30T17:02:42.547 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.547 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "initiated", 2023-09-30T17:02:42.547 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.354348+0000", 2023-09-30T17:02:42.547 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:42.547 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "header_read", 2023-09-30T17:02:42.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.354348+0000", 2023-09-30T17:02:42.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0 2023-09-30T17:02:42.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "throttled", 2023-09-30T17:02:42.548 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.354349+0000", 2023-09-30T17:02:42.548 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 8.3600000000000002e-07 2023-09-30T17:02:42.548 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.548 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.548 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "all_read", 2023-09-30T17:02:42.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.354353+0000", 2023-09-30T17:02:42.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 3.9500000000000003e-06 2023-09-30T17:02:42.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "dispatched", 2023-09-30T17:02:42.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.354366+0000", 2023-09-30T17:02:42.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 1.2632999999999999e-05 2023-09-30T17:02:42.549 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.549 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.549 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "queued_for_pg", 2023-09-30T17:02:42.549 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.354373+0000", 2023-09-30T17:02:42.549 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 7.4070000000000004e-06 2023-09-30T17:02:42.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:42.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.354487+0000", 2023-09-30T17:02:42.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0001145 2023-09-30T17:02:42.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.550 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:42.550 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.354493+0000", 2023-09-30T17:02:42.550 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 5.0869999999999997e-06 2023-09-30T17:02:42.550 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.550 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "reached_pg", 2023-09-30T17:02:42.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.375266+0000", 2023-09-30T17:02:42.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.020773335 2023-09-30T17:02:42.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "started", 2023-09-30T17:02:42.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.376029+0000", 2023-09-30T17:02:42.551 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.00076351900000000005 2023-09-30T17:02:42.551 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2023-09-30T17:02:42.551 INFO:teuthology.orchestra.run.smithi134.stdout: { 2023-09-30T17:02:42.551 INFO:teuthology.orchestra.run.smithi134.stdout: "event": "done", 2023-09-30T17:02:42.551 INFO:teuthology.orchestra.run.smithi134.stdout: "time": "2023-09-30T17:02:18.380917+0000", 2023-09-30T17:02:42.552 INFO:teuthology.orchestra.run.smithi134.stdout: "duration": 0.0048876639999999999 2023-09-30T17:02:42.552 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:42.552 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2023-09-30T17:02:42.552 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:42.552 INFO:teuthology.orchestra.run.smithi134.stdout: } 2023-09-30T17:02:42.552 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2023-09-30T17:02:42.552 INFO:teuthology.orchestra.run.smithi134.stdout:} 2023-09-30T17:02:42.553 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:02:42.554 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:02:42.554 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-09-30T17:02:42.554 INFO:tasks.ceph.osd.2.smithi134.stderr:2023-09-30T17:02:42.552+0000 7efd10b20700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 96961) UID: 0 2023-09-30T17:02:42.555 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:02:42.555 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-09-30T17:02:42.556 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-09-30T17:02:42.556 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-09-30T17:02:42.654 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:42.655+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:42.701 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:42.701 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:42.712 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:02:42.755 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:42.755+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:42.855 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:42.856+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:42.883 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:42.884 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:42.895 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:02:42.978 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:42.979+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:43.058 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:43.058+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:43.067 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:43.068 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:43.079 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:02:43.159 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:43.159+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:43.219 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:43.219 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:43.229 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:02:43.273 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [] live_osds: [0, 1, 2] 2023-09-30T17:02:43.273 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-09-30T17:02:43.273 INFO:tasks.thrashosds.thrasher:Killing osd 2, live_osds are [0, 1, 2] 2023-09-30T17:02:43.273 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.2 doing powercycle of ubuntu@smithi134.front.sepia.ceph.com 2023-09-30T17:02:43.274 INFO:teuthology.orchestra.console.smithi134:Power off 2023-09-30T17:02:43.274 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-30T17:02:43.282 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:43.276+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:43.296 DEBUG:teuthology.orchestra.console.smithi134:power off output: Chassis Power Control: Down/Off 2023-09-30T17:02:43.296 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T17:02:43.318 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2023-09-30T17:02:43.356 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:43.356 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:43.360 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:43.361+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:43.366 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:02:43.428 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-09-30T17:02:43.461 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:43.461+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:43.533 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:43.533 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:43.543 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:02:43.587 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:43.588+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:43.663 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:43.663+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:43.686 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:43.687 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:43.697 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:02:43.764 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:43.765+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:43.865 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:43.865+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:43.870 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:43.870 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:43.880 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:02:43.966 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:43.966+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:44.052 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:44.052 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:44.062 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:02:44.107 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:44.107+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:44.168 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:44.169+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:44.192 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:44.193 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:44.202 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:02:44.287 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:44.287+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:44.370 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:44.370 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:44.370 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:44.370+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:44.382 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:02:44.410 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is unset 2023-09-30T17:02:44.471 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:44.471+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:44.549 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:44.549 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:44.557 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-09-30T17:02:44.559 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:02:44.601 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:44.601+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:44.673 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:44.673+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:44.698 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:44.698 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:44.708 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:02:44.709 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:02:44.730 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:02:44.749 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-09-30T17:02:44.751 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-09-30T17:02:44.751 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-09-30T17:02:44.751 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'true' 2023-09-30T17:02:44.773 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:44.773+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:44.840 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:02:44.840 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:02:44.840 INFO:teuthology.orchestra.run.smithi031.stdout: "complaint_time": 30, 2023-09-30T17:02:44.840 INFO:teuthology.orchestra.run.smithi031.stdout: "num_blocked_ops": 0 2023-09-30T17:02:44.840 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:02:44.850 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:02:44.874 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:44.874+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:44.975 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:44.975+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:45.024 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:02:45.025 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 20, 2023-09-30T17:02:45.025 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 600, 2023-09-30T17:02:45.025 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:02:45.025 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.025 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:32 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'18, mlcod=11'14)", 2023-09-30T17:02:45.025 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:02:45.025 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 37.661997749000001, 2023-09-30T17:02:45.025 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051629809999999996, 2023-09-30T17:02:45.025 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:45.025 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:45.025 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:45.026 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.026 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:45.026 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:02:45.026 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:45.026 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.026 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.026 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:45.026 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:02:45.026 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:45.026 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.026 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.027 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:45.027 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:02:45.027 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2099999999999996e-07 2023-09-30T17:02:45.027 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.027 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.027 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:45.027 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361407+0000", 2023-09-30T17:02:45.027 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7499e-05 2023-09-30T17:02:45.027 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.027 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.027 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:45.027 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361418+0000", 2023-09-30T17:02:45.028 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1127999999999999e-05 2023-09-30T17:02:45.028 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.028 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.028 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:45.028 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361423+0000", 2023-09-30T17:02:45.028 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1930000000000001e-06 2023-09-30T17:02:45.028 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.028 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.028 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:45.028 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361476+0000", 2023-09-30T17:02:45.028 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3399000000000002e-05 2023-09-30T17:02:45.029 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.029 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.029 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:45.029 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361496+0000", 2023-09-30T17:02:45.029 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9638000000000001e-05 2023-09-30T17:02:45.029 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.029 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.029 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:45.029 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.366474+0000", 2023-09-30T17:02:45.029 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0049778829999999998 2023-09-30T17:02:45.029 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.029 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.030 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:45.030 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.366512+0000", 2023-09-30T17:02:45.030 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7620000000000002e-05 2023-09-30T17:02:45.030 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:45.030 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:45.030 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:45.030 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.030 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.030 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:37 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'23, mlcod=11'15)", 2023-09-30T17:02:45.030 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:02:45.030 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 37.659395752000002, 2023-09-30T17:02:45.031 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053985689999999998, 2023-09-30T17:02:45.031 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:45.031 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:45.031 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:45.031 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.031 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:45.031 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:02:45.031 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:45.031 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.031 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.031 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:45.032 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:02:45.032 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:45.032 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.032 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.032 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:45.032 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:02:45.032 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4400000000000001e-07 2023-09-30T17:02:45.032 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.032 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.032 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:45.032 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363956+0000", 2023-09-30T17:02:45.032 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.921e-06 2023-09-30T17:02:45.033 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.033 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.033 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:45.033 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363966+0000", 2023-09-30T17:02:45.033 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0351e-05 2023-09-30T17:02:45.033 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.033 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.033 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:45.033 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363971+0000", 2023-09-30T17:02:45.033 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.023e-06 2023-09-30T17:02:45.033 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.034 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.034 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:45.034 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.364013+0000", 2023-09-30T17:02:45.034 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1575000000000001e-05 2023-09-30T17:02:45.034 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.034 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.034 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:45.034 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.364026+0000", 2023-09-30T17:02:45.034 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3044000000000001e-05 2023-09-30T17:02:45.034 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.034 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.034 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:45.035 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.369308+0000", 2023-09-30T17:02:45.035 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005282152 2023-09-30T17:02:45.035 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.035 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.035 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:45.035 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.369349+0000", 2023-09-30T17:02:45.035 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1059000000000001e-05 2023-09-30T17:02:45.035 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:45.035 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:45.035 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:45.035 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.036 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.036 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:155 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'109, mlcod=11'105)", 2023-09-30T17:02:45.036 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:02:45.036 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 37.177700066, 2023-09-30T17:02:45.036 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053867639999999996, 2023-09-30T17:02:45.036 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:45.036 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:45.036 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:45.036 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.036 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:45.036 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:02:45.037 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:45.037 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.037 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.037 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:45.037 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:02:45.037 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:45.037 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.037 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.037 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:45.037 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845647+0000", 2023-09-30T17:02:45.037 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7599999999999997e-07 2023-09-30T17:02:45.037 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.038 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.038 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:45.038 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845699+0000", 2023-09-30T17:02:45.038 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1758000000000001e-05 2023-09-30T17:02:45.038 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.038 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.038 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:45.038 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845708+0000", 2023-09-30T17:02:45.038 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2159999999999995e-06 2023-09-30T17:02:45.038 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.038 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.039 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:45.039 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845712+0000", 2023-09-30T17:02:45.039 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2579999999999997e-06 2023-09-30T17:02:45.039 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.039 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.039 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:45.039 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845756+0000", 2023-09-30T17:02:45.039 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4119999999999998e-05 2023-09-30T17:02:45.039 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.039 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.039 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:45.040 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845779+0000", 2023-09-30T17:02:45.040 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2311e-05 2023-09-30T17:02:45.040 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.040 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.040 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:45.040 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.850982+0000", 2023-09-30T17:02:45.040 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005203053 2023-09-30T17:02:45.040 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.040 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.040 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:45.040 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851033+0000", 2023-09-30T17:02:45.040 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1471999999999998e-05 2023-09-30T17:02:45.041 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:45.041 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:45.041 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:45.041 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.041 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.041 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:156 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'110, mlcod=11'105)", 2023-09-30T17:02:45.041 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:02:45.041 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 37.177167140000002, 2023-09-30T17:02:45.041 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0052834759999999996, 2023-09-30T17:02:45.041 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:45.041 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:45.042 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:45.042 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.042 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:45.042 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:02:45.043 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:45.043 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.043 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.043 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:45.043 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:02:45.043 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:45.044 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.044 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.044 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:45.044 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846180+0000", 2023-09-30T17:02:45.044 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6300000000000005e-07 2023-09-30T17:02:45.044 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.044 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.044 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:45.044 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846184+0000", 2023-09-30T17:02:45.044 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3789999999999999e-06 2023-09-30T17:02:45.045 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.045 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.045 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:45.045 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846195+0000", 2023-09-30T17:02:45.045 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0778000000000001e-05 2023-09-30T17:02:45.045 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.045 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.045 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:45.045 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846200+0000", 2023-09-30T17:02:45.045 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1540000000000001e-06 2023-09-30T17:02:45.045 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.045 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.046 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:45.046 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846274+0000", 2023-09-30T17:02:45.046 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4129999999999997e-05 2023-09-30T17:02:45.046 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.046 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.046 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:45.046 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846286+0000", 2023-09-30T17:02:45.046 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1744e-05 2023-09-30T17:02:45.046 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.046 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.046 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:45.047 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851432+0000", 2023-09-30T17:02:45.047 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051462110000000004 2023-09-30T17:02:45.047 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.047 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.047 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:45.047 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851463+0000", 2023-09-30T17:02:45.047 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0516999999999999e-05 2023-09-30T17:02:45.047 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:45.047 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:45.047 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:45.047 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.047 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.048 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:203 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'149, mlcod=11'145)", 2023-09-30T17:02:45.048 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:02:45.048 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 36.821131231000003, 2023-09-30T17:02:45.048 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051867459999999999, 2023-09-30T17:02:45.048 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:45.048 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:45.048 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:45.048 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.048 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:45.048 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:02:45.048 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:45.049 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.049 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.049 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:45.049 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:02:45.049 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:45.049 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.049 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.049 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:45.049 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202216+0000", 2023-09-30T17:02:45.049 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7e-07 2023-09-30T17:02:45.049 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.049 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.050 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:45.050 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202271+0000", 2023-09-30T17:02:45.050 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5163e-05 2023-09-30T17:02:45.050 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.050 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.050 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:45.050 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202282+0000", 2023-09-30T17:02:45.050 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1319e-05 2023-09-30T17:02:45.050 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.050 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.050 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:45.051 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202288+0000", 2023-09-30T17:02:45.051 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2899999999999999e-06 2023-09-30T17:02:45.051 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.051 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.051 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:45.051 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202331+0000", 2023-09-30T17:02:45.051 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2147999999999997e-05 2023-09-30T17:02:45.051 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.051 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.051 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:45.051 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202348+0000", 2023-09-30T17:02:45.052 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7317e-05 2023-09-30T17:02:45.052 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.052 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.052 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:45.052 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.207357+0000", 2023-09-30T17:02:45.052 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0050095440000000003 2023-09-30T17:02:45.052 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.052 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.052 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:45.052 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.207402+0000", 2023-09-30T17:02:45.052 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4495e-05 2023-09-30T17:02:45.052 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:45.053 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:45.053 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:45.053 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.053 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.053 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:45.053 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:02:45.053 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 26.671800943000001, 2023-09-30T17:02:45.053 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.025313649000000001, 2023-09-30T17:02:45.053 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:45.053 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:45.053 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:45.053 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.053 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:45.054 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:02:45.054 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:45.054 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.054 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.054 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:45.054 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:02:45.054 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:45.054 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.054 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.054 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:45.054 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351551+0000", 2023-09-30T17:02:45.055 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3380000000000004e-06 2023-09-30T17:02:45.055 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.055 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.055 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:45.055 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351559+0000", 2023-09-30T17:02:45.055 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9589999999999995e-06 2023-09-30T17:02:45.055 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.055 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.055 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:45.055 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351571+0000", 2023-09-30T17:02:45.055 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2065999999999999e-05 2023-09-30T17:02:45.055 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.056 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.056 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:45.056 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351706+0000", 2023-09-30T17:02:45.056 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00013553799999999999 2023-09-30T17:02:45.056 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.056 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.056 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:45.056 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353016+0000", 2023-09-30T17:02:45.056 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0013099209999999999 2023-09-30T17:02:45.056 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.056 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.056 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:02:45.057 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353023+0000", 2023-09-30T17:02:45.057 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2479999999999999e-06 2023-09-30T17:02:45.057 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.057 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.057 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:45.057 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360348+0000", 2023-09-30T17:02:45.057 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0073248949999999997 2023-09-30T17:02:45.057 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.057 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.057 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:45.057 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360787+0000", 2023-09-30T17:02:45.057 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00043875199999999999 2023-09-30T17:02:45.058 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.058 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.058 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:45.058 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360892+0000", 2023-09-30T17:02:45.058 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010508199999999999 2023-09-30T17:02:45.058 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.058 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.058 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:02:45.058 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365132+0000", 2023-09-30T17:02:45.058 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0042396480000000004 2023-09-30T17:02:45.058 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.059 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.059 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:45.059 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376746+0000", 2023-09-30T17:02:45.059 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011614157 2023-09-30T17:02:45.059 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.059 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.059 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:45.059 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376811+0000", 2023-09-30T17:02:45.059 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5005999999999994e-05 2023-09-30T17:02:45.059 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.059 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.059 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:45.060 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376859+0000", 2023-09-30T17:02:45.060 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8038999999999999e-05 2023-09-30T17:02:45.060 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:45.060 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:45.060 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:45.060 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.060 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.060 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:45.060 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:02:45.060 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 26.671303143999999, 2023-09-30T17:02:45.060 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024923989000000001, 2023-09-30T17:02:45.060 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:45.061 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:45.061 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:45.061 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.061 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:45.061 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:02:45.061 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:45.061 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.061 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.061 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:45.061 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:02:45.061 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:45.061 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.062 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.062 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:45.062 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352044+0000", 2023-09-30T17:02:45.062 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9199999999999999e-07 2023-09-30T17:02:45.062 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.062 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.062 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:45.062 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352050+0000", 2023-09-30T17:02:45.062 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8880000000000002e-06 2023-09-30T17:02:45.062 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.062 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.063 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:45.063 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352143+0000", 2023-09-30T17:02:45.063 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2721999999999998e-05 2023-09-30T17:02:45.063 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.063 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.063 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:45.063 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352155+0000", 2023-09-30T17:02:45.063 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2279000000000001e-05 2023-09-30T17:02:45.063 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.063 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.063 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:45.063 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353114+0000", 2023-09-30T17:02:45.064 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00095943700000000005 2023-09-30T17:02:45.064 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.064 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.064 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:45.064 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353121+0000", 2023-09-30T17:02:45.064 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.494e-06 2023-09-30T17:02:45.064 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.064 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.064 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:45.064 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361491+0000", 2023-09-30T17:02:45.064 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0083697359999999991 2023-09-30T17:02:45.064 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.065 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.065 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:45.065 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361573+0000", 2023-09-30T17:02:45.065 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2822000000000001e-05 2023-09-30T17:02:45.065 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.065 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.065 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:45.065 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362166+0000", 2023-09-30T17:02:45.065 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00059223299999999995 2023-09-30T17:02:45.065 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.065 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.066 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:02:45.066 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365209+0000", 2023-09-30T17:02:45.066 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.003043212 2023-09-30T17:02:45.066 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.066 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.066 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:45.066 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376910+0000", 2023-09-30T17:02:45.066 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011700898 2023-09-30T17:02:45.066 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.066 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.066 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:45.066 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376945+0000", 2023-09-30T17:02:45.067 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4795000000000001e-05 2023-09-30T17:02:45.067 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.067 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.067 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:45.067 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376967+0000", 2023-09-30T17:02:45.067 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2580999999999999e-05 2023-09-30T17:02:45.067 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:45.067 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:45.067 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:45.067 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.067 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.068 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:45.068 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:02:45.068 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 26.671133223999998, 2023-09-30T17:02:45.068 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023120405, 2023-09-30T17:02:45.068 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:45.068 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:45.068 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:45.068 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.068 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:45.068 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:02:45.068 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:45.069 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.069 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.069 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:45.069 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:02:45.069 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:45.069 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.069 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.069 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:45.069 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352214+0000", 2023-09-30T17:02:45.069 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8400000000000003e-07 2023-09-30T17:02:45.069 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.069 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.070 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:45.070 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352233+0000", 2023-09-30T17:02:45.070 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8946000000000001e-05 2023-09-30T17:02:45.070 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.070 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.070 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:45.070 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352297+0000", 2023-09-30T17:02:45.070 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3540999999999994e-05 2023-09-30T17:02:45.070 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.070 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.071 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:45.071 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352450+0000", 2023-09-30T17:02:45.071 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015364799999999999 2023-09-30T17:02:45.071 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.071 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.071 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:45.071 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353098+0000", 2023-09-30T17:02:45.071 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00064820299999999997 2023-09-30T17:02:45.071 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.071 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.073 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:02:45.073 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353103+0000", 2023-09-30T17:02:45.073 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0529999999999997e-06 2023-09-30T17:02:45.073 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.073 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.073 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:45.073 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.358558+0000", 2023-09-30T17:02:45.073 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0054550249999999996 2023-09-30T17:02:45.073 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.073 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.074 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:45.074 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.358741+0000", 2023-09-30T17:02:45.074 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00018210200000000001 2023-09-30T17:02:45.074 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.074 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.074 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:45.074 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.359683+0000", 2023-09-30T17:02:45.074 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00094202299999999995 2023-09-30T17:02:45.074 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.074 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.074 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:02:45.075 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365044+0000", 2023-09-30T17:02:45.075 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053616219999999999 2023-09-30T17:02:45.075 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.075 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.075 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:45.075 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375256+0000", 2023-09-30T17:02:45.075 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010212156 2023-09-30T17:02:45.075 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.075 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.075 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:45.076 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375300+0000", 2023-09-30T17:02:45.076 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3961999999999997e-05 2023-09-30T17:02:45.076 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.076 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.076 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:45.076 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375334+0000", 2023-09-30T17:02:45.076 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.324e-05 2023-09-30T17:02:45.076 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:45.076 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:45.076 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:45.076 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.076 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.077 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:45.077 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:02:45.077 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 26.670818206, 2023-09-30T17:02:45.077 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024240660000000001, 2023-09-30T17:02:45.077 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:45.077 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:45.077 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:45.077 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.077 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:45.077 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:02:45.077 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:45.078 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.078 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.078 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:45.078 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:02:45.078 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:45.078 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.078 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.078 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:45.078 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352529+0000", 2023-09-30T17:02:45.078 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1379999999999999e-06 2023-09-30T17:02:45.078 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.079 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.079 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:45.079 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352536+0000", 2023-09-30T17:02:45.079 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3489999999999997e-06 2023-09-30T17:02:45.079 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.079 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.079 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:45.079 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352547+0000", 2023-09-30T17:02:45.079 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1109e-05 2023-09-30T17:02:45.079 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.079 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.079 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:45.080 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352560+0000", 2023-09-30T17:02:45.080 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3046e-05 2023-09-30T17:02:45.080 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.080 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.080 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:45.080 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353142+0000", 2023-09-30T17:02:45.080 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00058174699999999997 2023-09-30T17:02:45.080 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.080 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.080 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:45.080 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353147+0000", 2023-09-30T17:02:45.081 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5840000000000002e-06 2023-09-30T17:02:45.081 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.081 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.081 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:45.081 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360374+0000", 2023-09-30T17:02:45.081 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0072270049999999999 2023-09-30T17:02:45.081 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.081 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.081 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:45.081 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360795+0000", 2023-09-30T17:02:45.082 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00042088999999999999 2023-09-30T17:02:45.082 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.082 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.082 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:45.082 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360967+0000", 2023-09-30T17:02:45.082 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017235699999999999 2023-09-30T17:02:45.082 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.082 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.082 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:02:45.082 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365051+0000", 2023-09-30T17:02:45.082 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0040837429999999999 2023-09-30T17:02:45.083 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.083 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.083 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:45.083 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376708+0000", 2023-09-30T17:02:45.083 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011656866 2023-09-30T17:02:45.083 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.083 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.083 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:45.083 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376745+0000", 2023-09-30T17:02:45.083 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6769e-05 2023-09-30T17:02:45.083 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.083 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.084 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:45.084 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376769+0000", 2023-09-30T17:02:45.084 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4057e-05 2023-09-30T17:02:45.084 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:45.084 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:45.084 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:45.084 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.084 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.084 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:45.084 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:02:45.084 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 26.670558850999999, 2023-09-30T17:02:45.085 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023472704, 2023-09-30T17:02:45.085 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:45.085 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:45.085 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:45.085 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.085 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:45.085 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:02:45.085 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:45.085 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.085 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.085 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:45.086 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:02:45.086 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:45.086 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.086 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.086 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:45.086 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:02:45.086 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8000000000000005e-07 2023-09-30T17:02:45.086 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.086 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.086 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:45.086 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352794+0000", 2023-09-30T17:02:45.087 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.789e-06 2023-09-30T17:02:45.087 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.087 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.087 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:45.087 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352805+0000", 2023-09-30T17:02:45.087 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0848e-05 2023-09-30T17:02:45.087 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.087 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.087 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:45.087 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352812+0000", 2023-09-30T17:02:45.087 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4449999999999999e-06 2023-09-30T17:02:45.087 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.088 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.088 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:45.088 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353063+0000", 2023-09-30T17:02:45.088 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00025046299999999998 2023-09-30T17:02:45.088 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.088 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.088 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:02:45.088 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353071+0000", 2023-09-30T17:02:45.088 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6739999999999997e-06 2023-09-30T17:02:45.088 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.088 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.089 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:45.089 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361696+0000", 2023-09-30T17:02:45.089 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0086251609999999992 2023-09-30T17:02:45.089 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.089 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.089 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:45.089 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362284+0000", 2023-09-30T17:02:45.089 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00058872299999999998 2023-09-30T17:02:45.089 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.089 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.089 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:45.090 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362429+0000", 2023-09-30T17:02:45.090 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014509000000000001 2023-09-30T17:02:45.090 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.090 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.090 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:02:45.090 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365330+0000", 2023-09-30T17:02:45.090 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0029005419999999999 2023-09-30T17:02:45.090 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.090 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.090 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:45.090 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376196+0000", 2023-09-30T17:02:45.090 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.01086615 2023-09-30T17:02:45.091 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.091 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.091 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:45.091 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376230+0000", 2023-09-30T17:02:45.091 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3858e-05 2023-09-30T17:02:45.091 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.091 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.091 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:45.091 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376260+0000", 2023-09-30T17:02:45.091 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0181000000000001e-05 2023-09-30T17:02:45.091 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:45.091 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:45.092 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:45.092 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.092 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.092 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:45.092 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:02:45.092 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 26.670325281, 2023-09-30T17:02:45.092 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023406132999999999, 2023-09-30T17:02:45.092 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:45.092 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:45.092 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:45.092 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.093 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:45.093 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:02:45.093 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:45.093 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.093 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.093 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:45.093 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:02:45.093 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:45.093 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.093 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.093 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:45.093 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353022+0000", 2023-09-30T17:02:45.094 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.78e-07 2023-09-30T17:02:45.094 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.094 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.094 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:45.094 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353027+0000", 2023-09-30T17:02:45.094 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9089999999999999e-06 2023-09-30T17:02:45.094 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.094 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.094 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:45.094 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353035+0000", 2023-09-30T17:02:45.094 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0430000000000008e-06 2023-09-30T17:02:45.095 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.095 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.095 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:45.095 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353047+0000", 2023-09-30T17:02:45.095 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1674e-05 2023-09-30T17:02:45.095 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.095 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.095 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:45.095 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353105+0000", 2023-09-30T17:02:45.095 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8891999999999998e-05 2023-09-30T17:02:45.095 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.095 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.096 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:45.096 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353112+0000", 2023-09-30T17:02:45.096 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7059999999999998e-06 2023-09-30T17:02:45.096 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.096 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.096 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:45.096 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362733+0000", 2023-09-30T17:02:45.096 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0096205869999999999 2023-09-30T17:02:45.096 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.096 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.096 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:45.096 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362833+0000", 2023-09-30T17:02:45.097 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000100227 2023-09-30T17:02:45.097 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.097 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.097 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:45.097 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363000+0000", 2023-09-30T17:02:45.097 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016670899999999999 2023-09-30T17:02:45.097 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.097 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.097 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:02:45.097 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365550+0000", 2023-09-30T17:02:45.097 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0025499199999999998 2023-09-30T17:02:45.097 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.098 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.098 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:45.098 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376315+0000", 2023-09-30T17:02:45.098 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010765011999999999 2023-09-30T17:02:45.098 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.098 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.098 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:45.098 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376386+0000", 2023-09-30T17:02:45.098 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0866999999999998e-05 2023-09-30T17:02:45.098 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.098 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.098 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:45.099 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376427+0000", 2023-09-30T17:02:45.099 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1709000000000003e-05 2023-09-30T17:02:45.099 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:45.099 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:45.099 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:45.099 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.099 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.099 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:45.099 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:02:45.099 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 26.670284644999999, 2023-09-30T17:02:45.099 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024076238, 2023-09-30T17:02:45.099 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:45.100 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:45.100 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:45.100 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.100 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:45.100 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:02:45.100 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:45.100 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.100 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.100 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:45.100 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:02:45.100 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:45.100 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.101 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.101 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:45.101 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:02:45.101 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8699999999999995e-07 2023-09-30T17:02:45.101 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.101 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.101 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:45.101 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353067+0000", 2023-09-30T17:02:45.101 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.605e-06 2023-09-30T17:02:45.101 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.101 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.102 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:45.102 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353073+0000", 2023-09-30T17:02:45.102 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8900000000000004e-06 2023-09-30T17:02:45.102 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.102 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.102 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:45.102 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353083+0000", 2023-09-30T17:02:45.102 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0200000000000001e-05 2023-09-30T17:02:45.102 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.102 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.102 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:45.102 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353186+0000", 2023-09-30T17:02:45.103 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010256599999999999 2023-09-30T17:02:45.103 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.103 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.103 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:45.103 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353190+0000", 2023-09-30T17:02:45.103 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9709999999999998e-06 2023-09-30T17:02:45.103 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.103 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.103 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:45.103 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362946+0000", 2023-09-30T17:02:45.103 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0097563330000000007 2023-09-30T17:02:45.103 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.103 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.104 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:45.104 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363088+0000", 2023-09-30T17:02:45.104 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014259200000000001 2023-09-30T17:02:45.104 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.104 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.104 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:45.104 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363555+0000", 2023-09-30T17:02:45.104 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00046627799999999998 2023-09-30T17:02:45.104 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.104 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.104 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:02:45.105 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365871+0000", 2023-09-30T17:02:45.105 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0023167589999999998 2023-09-30T17:02:45.105 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.105 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.105 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:45.105 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377033+0000", 2023-09-30T17:02:45.105 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011161203999999999 2023-09-30T17:02:45.105 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.105 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.105 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:45.105 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377100+0000", 2023-09-30T17:02:45.106 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7230999999999994e-05 2023-09-30T17:02:45.106 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.106 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.106 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:45.106 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377138+0000", 2023-09-30T17:02:45.106 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8022000000000003e-05 2023-09-30T17:02:45.106 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:45.106 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:45.106 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:45.106 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.106 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.106 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:45.107 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:02:45.107 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 26.670183695999999, 2023-09-30T17:02:45.107 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.020304412000000001, 2023-09-30T17:02:45.107 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:45.107 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:02:45.107 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:45.107 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.107 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:45.107 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:02:45.107 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:45.107 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.107 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.108 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:45.108 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:02:45.108 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:45.108 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.108 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.108 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:45.108 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353164+0000", 2023-09-30T17:02:45.108 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7100000000000011e-07 2023-09-30T17:02:45.108 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.108 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.108 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:45.109 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353168+0000", 2023-09-30T17:02:45.109 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0600000000000001e-06 2023-09-30T17:02:45.109 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.109 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.109 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:45.109 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353177+0000", 2023-09-30T17:02:45.109 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1409999999999994e-06 2023-09-30T17:02:45.109 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.109 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.109 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:45.109 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353185+0000", 2023-09-30T17:02:45.109 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2479999999999996e-06 2023-09-30T17:02:45.110 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.110 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.110 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:45.110 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353246+0000", 2023-09-30T17:02:45.110 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0519000000000001e-05 2023-09-30T17:02:45.110 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.110 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.110 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:02:45.110 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353252+0000", 2023-09-30T17:02:45.110 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7859999999999999e-06 2023-09-30T17:02:45.110 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.110 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.111 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:45.111 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354979+0000", 2023-09-30T17:02:45.111 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0017270090000000001 2023-09-30T17:02:45.111 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.111 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.111 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:45.111 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355097+0000", 2023-09-30T17:02:45.111 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000117472 2023-09-30T17:02:45.111 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.111 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.111 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:45.112 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.373467+0000", 2023-09-30T17:02:45.112 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.018370206 2023-09-30T17:02:45.112 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:45.112 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:45.112 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:45.112 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.112 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.112 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:45.112 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:02:45.112 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 26.670142958, 2023-09-30T17:02:45.112 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.012725089, 2023-09-30T17:02:45.112 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:45.113 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:02:45.113 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:45.113 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.113 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:45.113 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:02:45.113 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:45.113 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.113 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.113 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:45.113 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:02:45.113 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:45.113 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.114 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.114 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:45.114 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353204+0000", 2023-09-30T17:02:45.114 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7100000000000002e-07 2023-09-30T17:02:45.114 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.114 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.114 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:45.114 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353213+0000", 2023-09-30T17:02:45.114 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8580000000000006e-06 2023-09-30T17:02:45.114 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.114 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.114 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:45.115 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353219+0000", 2023-09-30T17:02:45.115 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8939999999999998e-06 2023-09-30T17:02:45.115 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.115 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.115 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:45.115 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353223+0000", 2023-09-30T17:02:45.115 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.357e-06 2023-09-30T17:02:45.115 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.115 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.115 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:45.115 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353278+0000", 2023-09-30T17:02:45.115 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5228e-05 2023-09-30T17:02:45.116 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.116 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.116 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:02:45.116 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353284+0000", 2023-09-30T17:02:45.116 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8209999999999998e-06 2023-09-30T17:02:45.116 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.116 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.116 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:45.116 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355095+0000", 2023-09-30T17:02:45.116 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001811404 2023-09-30T17:02:45.116 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.117 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.117 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:45.117 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355256+0000", 2023-09-30T17:02:45.117 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000160898 2023-09-30T17:02:45.117 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.117 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.117 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:45.117 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365928+0000", 2023-09-30T17:02:45.117 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010672157999999999 2023-09-30T17:02:45.117 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:45.117 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:45.117 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:45.118 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.118 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.118 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-09-30T17:02:45.118 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:02:45.118 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 26.669611751000001, 2023-09-30T17:02:45.118 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0056863460000000001, 2023-09-30T17:02:45.118 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:45.118 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "reached pg", 2023-09-30T17:02:45.118 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:45.118 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.119 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:45.119 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:02:45.119 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:45.119 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.119 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.119 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:45.119 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:02:45.119 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:45.119 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.119 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.119 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:45.119 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:02:45.120 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5700000000000002e-07 2023-09-30T17:02:45.120 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.120 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.120 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:45.120 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353747+0000", 2023-09-30T17:02:45.120 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1899000000000001e-05 2023-09-30T17:02:45.120 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.120 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.120 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:45.120 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353776+0000", 2023-09-30T17:02:45.120 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.8767000000000001e-05 2023-09-30T17:02:45.120 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.121 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.121 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:45.121 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353792+0000", 2023-09-30T17:02:45.121 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5914999999999999e-05 2023-09-30T17:02:45.121 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.121 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.121 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:45.121 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353900+0000", 2023-09-30T17:02:45.121 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010774500000000001 2023-09-30T17:02:45.121 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.121 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.122 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:45.122 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.359421+0000", 2023-09-30T17:02:45.122 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0055213629999999996 2023-09-30T17:02:45.122 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:45.122 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:45.122 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:45.122 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.122 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.122 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:02:45.122 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:02:45.122 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 26.668940151000001, 2023-09-30T17:02:45.123 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0069196370000000002, 2023-09-30T17:02:45.123 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:45.123 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:45.123 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:45.123 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.123 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:45.123 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:02:45.123 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:45.123 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.123 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.123 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:45.123 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:02:45.123 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:45.124 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.124 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.124 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:45.124 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354407+0000", 2023-09-30T17:02:45.124 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7400000000000002e-07 2023-09-30T17:02:45.124 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.124 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.124 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:45.124 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354414+0000", 2023-09-30T17:02:45.124 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1040000000000001e-06 2023-09-30T17:02:45.124 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.125 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.125 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:45.125 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354425+0000", 2023-09-30T17:02:45.125 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1090000000000001e-05 2023-09-30T17:02:45.125 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.125 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.125 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:45.125 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354435+0000", 2023-09-30T17:02:45.125 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8169999999999994e-06 2023-09-30T17:02:45.125 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.125 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.126 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:45.126 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355741+0000", 2023-09-30T17:02:45.126 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0013063160000000001 2023-09-30T17:02:45.126 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.126 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.126 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:45.126 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355763+0000", 2023-09-30T17:02:45.126 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1688e-05 2023-09-30T17:02:45.126 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.126 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.127 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:45.127 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361289+0000", 2023-09-30T17:02:45.127 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0055258269999999996 2023-09-30T17:02:45.127 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.127 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.127 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:45.127 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361326+0000", 2023-09-30T17:02:45.127 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7020999999999997e-05 2023-09-30T17:02:45.127 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:45.127 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:45.127 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:45.128 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.128 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.128 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:30 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2023-09-30T17:02:45.128 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:02:45.128 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 26.667566192999999, 2023-09-30T17:02:45.128 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0069996629999999997, 2023-09-30T17:02:45.128 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:45.128 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:45.128 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:45.128 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.128 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:45.128 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:02:45.129 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:45.129 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.129 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.129 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:45.129 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:02:45.129 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:45.129 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.129 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.129 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:45.129 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355781+0000", 2023-09-30T17:02:45.129 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9599999999999999e-07 2023-09-30T17:02:45.130 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.130 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.130 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:45.130 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355788+0000", 2023-09-30T17:02:45.130 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8129999999999996e-06 2023-09-30T17:02:45.130 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.130 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.130 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:45.130 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355798+0000", 2023-09-30T17:02:45.130 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2909999999999996e-06 2023-09-30T17:02:45.130 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.130 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.131 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:45.131 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355807+0000", 2023-09-30T17:02:45.131 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8619999999999992e-06 2023-09-30T17:02:45.131 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.131 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.131 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:45.131 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.357264+0000", 2023-09-30T17:02:45.131 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0014578289999999999 2023-09-30T17:02:45.131 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.131 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.131 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:45.132 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.357916+0000", 2023-09-30T17:02:45.132 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00065170500000000004 2023-09-30T17:02:45.132 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.132 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.132 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:45.132 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362731+0000", 2023-09-30T17:02:45.132 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0048149849999999999 2023-09-30T17:02:45.132 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.132 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.132 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:45.132 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362780+0000", 2023-09-30T17:02:45.132 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8681999999999999e-05 2023-09-30T17:02:45.133 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:45.133 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:45.133 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:45.133 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.133 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.133 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2023-09-30T17:02:45.133 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:02:45.133 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 26.648915142, 2023-09-30T17:02:45.133 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005905998, 2023-09-30T17:02:45.133 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:45.133 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:45.133 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:45.133 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.134 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:45.134 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:02:45.134 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:45.134 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.134 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.134 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:45.134 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:02:45.134 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:45.134 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.134 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.134 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:45.134 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:02:45.135 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1e-07 2023-09-30T17:02:45.135 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.135 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.135 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:45.135 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374455+0000", 2023-09-30T17:02:45.135 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.3091999999999998e-05 2023-09-30T17:02:45.135 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.135 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.135 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:45.135 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374462+0000", 2023-09-30T17:02:45.135 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5170000000000002e-06 2023-09-30T17:02:45.135 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.136 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.136 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:45.136 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374469+0000", 2023-09-30T17:02:45.136 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8199999999999999e-06 2023-09-30T17:02:45.136 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.136 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.136 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:45.136 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374550+0000", 2023-09-30T17:02:45.136 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0978999999999998e-05 2023-09-30T17:02:45.136 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.136 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.136 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:45.137 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374562+0000", 2023-09-30T17:02:45.137 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2472e-05 2023-09-30T17:02:45.137 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.137 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.137 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:45.137 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380293+0000", 2023-09-30T17:02:45.137 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0057310379999999999 2023-09-30T17:02:45.137 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.137 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.137 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:45.137 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380337+0000", 2023-09-30T17:02:45.137 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3869999999999998e-05 2023-09-30T17:02:45.138 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:45.138 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:45.138 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:45.138 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.138 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.138 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2023-09-30T17:02:45.138 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:02:45.138 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 26.648728392999999, 2023-09-30T17:02:45.138 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0057590560000000002, 2023-09-30T17:02:45.138 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:45.138 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:45.139 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:45.139 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.139 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:45.139 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:02:45.139 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:45.139 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.139 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.139 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:45.139 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:02:45.139 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:45.139 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.139 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.140 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:45.140 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:02:45.140 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4900000000000001e-07 2023-09-30T17:02:45.140 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.140 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.140 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:45.140 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374629+0000", 2023-09-30T17:02:45.140 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1014e-05 2023-09-30T17:02:45.140 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.140 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.140 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:45.140 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374636+0000", 2023-09-30T17:02:45.141 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5889999999999999e-06 2023-09-30T17:02:45.141 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.141 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.141 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:45.141 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374642+0000", 2023-09-30T17:02:45.141 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.48e-06 2023-09-30T17:02:45.141 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.141 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.141 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:45.141 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374681+0000", 2023-09-30T17:02:45.141 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9320000000000003e-05 2023-09-30T17:02:45.141 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.141 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.142 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:45.142 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374694+0000", 2023-09-30T17:02:45.142 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3351e-05 2023-09-30T17:02:45.142 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.142 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.142 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:45.142 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380319+0000", 2023-09-30T17:02:45.142 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0056243880000000001 2023-09-30T17:02:45.142 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.142 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.142 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:45.142 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380377+0000", 2023-09-30T17:02:45.143 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8464999999999997e-05 2023-09-30T17:02:45.143 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:45.143 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:45.143 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:45.143 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.143 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.143 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=0'0)", 2023-09-30T17:02:45.143 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:02:45.143 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 26.648017482, 2023-09-30T17:02:45.143 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051157370000000004, 2023-09-30T17:02:45.143 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:45.144 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:45.144 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:45.144 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.144 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:45.144 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:02:45.144 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:45.144 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.144 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.144 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:45.144 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:02:45.144 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:45.144 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.145 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.145 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:45.145 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:02:45.145 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0199999999999998e-07 2023-09-30T17:02:45.145 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.145 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.145 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:45.145 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375334+0000", 2023-09-30T17:02:45.145 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8799999999999999e-06 2023-09-30T17:02:45.145 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.145 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.145 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:45.146 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375343+0000", 2023-09-30T17:02:45.146 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5490000000000006e-06 2023-09-30T17:02:45.146 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.146 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.146 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:45.146 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375350+0000", 2023-09-30T17:02:45.146 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5700000000000004e-06 2023-09-30T17:02:45.146 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.146 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.146 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:45.146 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375396+0000", 2023-09-30T17:02:45.147 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5550999999999998e-05 2023-09-30T17:02:45.147 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.147 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.147 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:45.147 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375410+0000", 2023-09-30T17:02:45.147 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4518999999999999e-05 2023-09-30T17:02:45.147 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.147 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.147 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:45.147 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380401+0000", 2023-09-30T17:02:45.147 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0049903430000000004 2023-09-30T17:02:45.147 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:45.147 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:45.148 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:45.148 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380445+0000", 2023-09-30T17:02:45.148 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4023000000000002e-05 2023-09-30T17:02:45.148 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:45.148 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:45.148 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:45.148 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:45.148 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:45.148 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:02:45.150 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:02:45.150 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:45.150+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:45.250 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:45.250+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:45.281 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:02:45.281 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:02:45.281 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2023-09-30T17:02:45.281 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:02:45.291 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:02:45.351 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:45.352+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:45.418 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:02:45.418 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:02:45.419 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2023-09-30T17:02:45.419 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2023-09-30T17:02:45.419 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:02:45.428 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:02:45.453 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:45.452+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:45.553 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:45.553+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:45.598 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:02:45.599 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2023-09-30T17:02:45.599 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2023-09-30T17:02:45.599 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2023-09-30T17:02:45.599 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.599 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:45.599 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:02:45.599 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 27.245467058999999, 2023-09-30T17:02:45.599 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093789779999999996, 2023-09-30T17:02:45.599 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:45.599 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:45.599 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:45.600 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.600 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:45.600 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:02:45.600 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:45.600 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.600 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.600 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:45.600 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:02:45.600 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:45.600 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.600 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.601 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:45.601 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352027+0000", 2023-09-30T17:02:45.601 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0224000000000001e-05 2023-09-30T17:02:45.601 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.601 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.601 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:45.601 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352039+0000", 2023-09-30T17:02:45.601 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1569000000000001e-05 2023-09-30T17:02:45.601 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.601 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.602 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:45.602 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352052+0000", 2023-09-30T17:02:45.602 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2605999999999999e-05 2023-09-30T17:02:45.602 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.602 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.602 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:45.602 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352064+0000", 2023-09-30T17:02:45.602 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2666999999999999e-05 2023-09-30T17:02:45.602 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.602 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.603 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:45.603 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352147+0000", 2023-09-30T17:02:45.603 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3125000000000001e-05 2023-09-30T17:02:45.603 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.603 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.603 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:45.603 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352306+0000", 2023-09-30T17:02:45.603 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015881900000000001 2023-09-30T17:02:45.603 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.603 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.603 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:45.603 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352450+0000", 2023-09-30T17:02:45.604 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014420700000000001 2023-09-30T17:02:45.604 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.604 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.604 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:45.604 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355975+0000", 2023-09-30T17:02:45.604 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003524246 2023-09-30T17:02:45.604 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.604 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.604 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:45.604 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361279+0000", 2023-09-30T17:02:45.605 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005304507 2023-09-30T17:02:45.605 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.605 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.605 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:45.605 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361344+0000", 2023-09-30T17:02:45.605 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4548999999999995e-05 2023-09-30T17:02:45.605 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.605 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.605 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:45.605 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361396+0000", 2023-09-30T17:02:45.606 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2459e-05 2023-09-30T17:02:45.606 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:45.606 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:45.606 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:45.606 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.606 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.606 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:45.606 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:02:45.606 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 27.245374767000001, 2023-09-30T17:02:45.606 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021233007000000002, 2023-09-30T17:02:45.607 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:45.607 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:45.607 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:45.607 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.607 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:45.607 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:02:45.607 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:45.607 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.607 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.607 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:45.607 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:02:45.607 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:45.608 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.608 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.608 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:45.608 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352110+0000", 2023-09-30T17:02:45.608 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6000000000000002e-07 2023-09-30T17:02:45.608 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.608 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.608 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:45.608 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352117+0000", 2023-09-30T17:02:45.608 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5930000000000002e-06 2023-09-30T17:02:45.608 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.609 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.609 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:45.609 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352126+0000", 2023-09-30T17:02:45.609 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0729999999999994e-06 2023-09-30T17:02:45.609 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.609 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.609 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:45.609 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352136+0000", 2023-09-30T17:02:45.609 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0380000000000001e-05 2023-09-30T17:02:45.609 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.609 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.609 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:45.610 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353279+0000", 2023-09-30T17:02:45.610 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0011424670000000001 2023-09-30T17:02:45.610 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.610 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.610 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:45.610 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353707+0000", 2023-09-30T17:02:45.610 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00042829800000000003 2023-09-30T17:02:45.610 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.610 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.610 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:45.610 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354104+0000", 2023-09-30T17:02:45.611 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00039643399999999998 2023-09-30T17:02:45.611 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.611 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.611 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:45.611 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356925+0000", 2023-09-30T17:02:45.611 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0028210900000000001 2023-09-30T17:02:45.611 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.611 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.611 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:45.612 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373243+0000", 2023-09-30T17:02:45.612 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016318461999999999 2023-09-30T17:02:45.612 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.612 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.612 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:45.612 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373301+0000", 2023-09-30T17:02:45.612 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7435000000000002e-05 2023-09-30T17:02:45.612 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.612 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.612 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:45.612 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373342+0000", 2023-09-30T17:02:45.612 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1915000000000001e-05 2023-09-30T17:02:45.613 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:45.613 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:45.613 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:45.613 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.613 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.613 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:45.613 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:02:45.613 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 27.245332156, 2023-09-30T17:02:45.613 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011988331, 2023-09-30T17:02:45.613 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:45.613 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:45.614 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:45.614 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.614 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:45.614 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:02:45.614 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:45.614 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.614 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.614 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:45.614 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:02:45.614 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:45.614 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.614 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.615 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:45.615 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352153+0000", 2023-09-30T17:02:45.615 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0500000000000003e-07 2023-09-30T17:02:45.615 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.615 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.615 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:45.615 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352157+0000", 2023-09-30T17:02:45.615 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9790000000000004e-06 2023-09-30T17:02:45.615 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.615 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.615 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:45.616 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352173+0000", 2023-09-30T17:02:45.616 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6535999999999999e-05 2023-09-30T17:02:45.616 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.616 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.616 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:45.616 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352180+0000", 2023-09-30T17:02:45.616 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7700000000000004e-06 2023-09-30T17:02:45.616 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.616 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.616 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:45.616 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353526+0000", 2023-09-30T17:02:45.616 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0013458330000000001 2023-09-30T17:02:45.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.617 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.617 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:45.617 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353648+0000", 2023-09-30T17:02:45.617 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012262899999999999 2023-09-30T17:02:45.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.617 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.617 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:02:45.617 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354141+0000", 2023-09-30T17:02:45.617 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00049222899999999995 2023-09-30T17:02:45.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.618 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.618 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:45.618 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356931+0000", 2023-09-30T17:02:45.618 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0027900860000000002 2023-09-30T17:02:45.618 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.618 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.618 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:45.618 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364066+0000", 2023-09-30T17:02:45.618 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071355050000000003 2023-09-30T17:02:45.618 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.618 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.619 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:45.619 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364103+0000", 2023-09-30T17:02:45.619 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6944999999999999e-05 2023-09-30T17:02:45.619 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.619 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.619 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:45.619 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364140+0000", 2023-09-30T17:02:45.619 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7214e-05 2023-09-30T17:02:45.619 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:45.619 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:45.620 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:45.620 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.620 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.620 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:45.620 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:02:45.620 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 27.245292925000001, 2023-09-30T17:02:45.620 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012110921, 2023-09-30T17:02:45.620 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:45.620 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:45.620 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:45.621 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.621 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:45.621 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:02:45.621 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:45.621 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.621 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.621 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:45.621 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:02:45.621 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:45.621 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.621 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.621 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:45.622 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352192+0000", 2023-09-30T17:02:45.622 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7300000000000005e-07 2023-09-30T17:02:45.622 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.622 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.622 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:45.622 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352196+0000", 2023-09-30T17:02:45.622 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2370000000000003e-06 2023-09-30T17:02:45.622 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.622 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.622 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:45.623 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352205+0000", 2023-09-30T17:02:45.623 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6659999999999997e-06 2023-09-30T17:02:45.623 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.623 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.623 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:45.623 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352214+0000", 2023-09-30T17:02:45.623 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8259999999999999e-06 2023-09-30T17:02:45.623 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.623 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.623 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:45.623 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354470+0000", 2023-09-30T17:02:45.624 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022557340000000001 2023-09-30T17:02:45.624 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.624 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.624 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:45.624 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354557+0000", 2023-09-30T17:02:45.624 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6909000000000004e-05 2023-09-30T17:02:45.624 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.624 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.624 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:02:45.624 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354694+0000", 2023-09-30T17:02:45.624 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013774800000000001 2023-09-30T17:02:45.625 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.625 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.625 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:45.625 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356937+0000", 2023-09-30T17:02:45.625 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022424540000000001 2023-09-30T17:02:45.625 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.625 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.625 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:45.625 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364227+0000", 2023-09-30T17:02:45.625 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072902430000000001 2023-09-30T17:02:45.625 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.625 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.626 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:45.626 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364278+0000", 2023-09-30T17:02:45.626 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1180999999999997e-05 2023-09-30T17:02:45.626 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.626 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.626 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:45.626 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364302+0000", 2023-09-30T17:02:45.626 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4049999999999998e-05 2023-09-30T17:02:45.626 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:45.626 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:45.626 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:45.627 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.627 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.627 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:45.627 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:02:45.627 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 27.245259586, 2023-09-30T17:02:45.627 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021258651999999999, 2023-09-30T17:02:45.627 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:45.627 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:45.627 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:45.627 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.628 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:45.628 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:02:45.628 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:45.628 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.628 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.628 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:45.628 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:02:45.628 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:45.628 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.628 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:45.629 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:02:45.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6899999999999997e-07 2023-09-30T17:02:45.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:45.629 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352236+0000", 2023-09-30T17:02:45.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0251000000000001e-05 2023-09-30T17:02:45.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:45.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352244+0000", 2023-09-30T17:02:45.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0770000000000008e-06 2023-09-30T17:02:45.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.630 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:45.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352251+0000", 2023-09-30T17:02:45.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4749999999999996e-06 2023-09-30T17:02:45.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.630 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:45.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354455+0000", 2023-09-30T17:02:45.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022043660000000001 2023-09-30T17:02:45.631 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.631 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.631 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:45.631 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354577+0000", 2023-09-30T17:02:45.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000121054 2023-09-30T17:02:45.631 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.631 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.631 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:45.631 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354723+0000", 2023-09-30T17:02:45.632 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014693900000000001 2023-09-30T17:02:45.632 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.632 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.632 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:45.632 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356941+0000", 2023-09-30T17:02:45.632 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002217199 2023-09-30T17:02:45.632 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.632 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.632 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:45.632 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373392+0000", 2023-09-30T17:02:45.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016451774999999998 2023-09-30T17:02:45.633 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.633 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.633 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:45.633 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373445+0000", 2023-09-30T17:02:45.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.308e-05 2023-09-30T17:02:45.633 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.633 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.633 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:45.633 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373483+0000", 2023-09-30T17:02:45.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7766999999999999e-05 2023-09-30T17:02:45.634 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:45.634 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:45.634 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:45.634 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.634 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:45.634 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:02:45.634 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 27.245223495000001, 2023-09-30T17:02:45.634 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020903497, 2023-09-30T17:02:45.634 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:45.635 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:45.635 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:45.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:45.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:02:45.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:45.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:45.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:02:45.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:45.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:45.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:02:45.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0800000000000004e-07 2023-09-30T17:02:45.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:45.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352266+0000", 2023-09-30T17:02:45.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1280000000000001e-06 2023-09-30T17:02:45.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.637 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:45.637 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352273+0000", 2023-09-30T17:02:45.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3730000000000004e-06 2023-09-30T17:02:45.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.637 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:45.637 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352279+0000", 2023-09-30T17:02:45.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7699999999999998e-06 2023-09-30T17:02:45.638 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.638 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:45.638 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352334+0000", 2023-09-30T17:02:45.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5547999999999997e-05 2023-09-30T17:02:45.638 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.638 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:45.638 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352435+0000", 2023-09-30T17:02:45.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100688 2023-09-30T17:02:45.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:45.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352585+0000", 2023-09-30T17:02:45.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000150068 2023-09-30T17:02:45.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:45.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354912+0000", 2023-09-30T17:02:45.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0023266770000000001 2023-09-30T17:02:45.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:45.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373066+0000", 2023-09-30T17:02:45.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018154474 2023-09-30T17:02:45.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:45.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373122+0000", 2023-09-30T17:02:45.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6193000000000002e-05 2023-09-30T17:02:45.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:45.641 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373164+0000", 2023-09-30T17:02:45.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1869999999999997e-05 2023-09-30T17:02:45.641 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:45.641 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:45.641 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:45.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.641 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:45.641 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:02:45.641 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 27.245187819000002, 2023-09-30T17:02:45.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021015097999999999, 2023-09-30T17:02:45.642 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:45.642 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:45.642 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:45.642 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.642 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:45.642 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:02:45.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:45.642 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.642 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.642 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:45.642 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:02:45.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:45.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.643 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:45.643 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352297+0000", 2023-09-30T17:02:45.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8299999999999997e-07 2023-09-30T17:02:45.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.643 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:45.643 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352300+0000", 2023-09-30T17:02:45.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7460000000000001e-06 2023-09-30T17:02:45.644 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:45.644 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352307+0000", 2023-09-30T17:02:45.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4959999999999999e-06 2023-09-30T17:02:45.644 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:45.644 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352314+0000", 2023-09-30T17:02:45.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0190000000000001e-06 2023-09-30T17:02:45.644 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.645 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:45.645 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354070+0000", 2023-09-30T17:02:45.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001755936 2023-09-30T17:02:45.645 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.645 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.645 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:45.645 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354221+0000", 2023-09-30T17:02:45.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000150884 2023-09-30T17:02:45.645 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.645 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.645 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:45.646 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373311+0000", 2023-09-30T17:02:45.646 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019090434 2023-09-30T17:02:45.646 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:45.646 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:45.646 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:45.646 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.646 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.646 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:45.646 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:02:45.646 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 27.245159099999999, 2023-09-30T17:02:45.646 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021255174000000002, 2023-09-30T17:02:45.646 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:45.647 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:45.647 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:45.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.647 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:45.647 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:02:45.647 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:45.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.647 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:45.647 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:02:45.648 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:45.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:45.648 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352326+0000", 2023-09-30T17:02:45.648 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3200000000000005e-07 2023-09-30T17:02:45.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:45.648 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352349+0000", 2023-09-30T17:02:45.648 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3183000000000001e-05 2023-09-30T17:02:45.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.649 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:45.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352358+0000", 2023-09-30T17:02:45.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5230000000000001e-06 2023-09-30T17:02:45.649 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.649 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:45.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352365+0000", 2023-09-30T17:02:45.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3260000000000001e-06 2023-09-30T17:02:45.649 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.650 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:45.650 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355450+0000", 2023-09-30T17:02:45.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0030854049999999998 2023-09-30T17:02:45.650 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.650 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.650 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:45.650 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355583+0000", 2023-09-30T17:02:45.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000133189 2023-09-30T17:02:45.650 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.650 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.651 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:45.651 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373580+0000", 2023-09-30T17:02:45.651 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017997016000000001 2023-09-30T17:02:45.651 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:45.651 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:45.651 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:45.651 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.651 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:45.651 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:02:45.652 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 27.245107677, 2023-09-30T17:02:45.652 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010380537, 2023-09-30T17:02:45.652 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:45.652 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:45.652 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:45.652 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.652 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:45.652 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:02:45.652 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:45.652 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.652 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.653 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:45.653 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:02:45.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:45.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.653 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:45.653 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:02:45.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1500000000000003e-07 2023-09-30T17:02:45.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.654 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:45.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352381+0000", 2023-09-30T17:02:45.654 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6330000000000002e-06 2023-09-30T17:02:45.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.654 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:45.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352388+0000", 2023-09-30T17:02:45.654 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7229999999999998e-06 2023-09-30T17:02:45.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.654 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:45.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352394+0000", 2023-09-30T17:02:45.655 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1789999999999996e-06 2023-09-30T17:02:45.655 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.655 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.655 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:45.655 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353259+0000", 2023-09-30T17:02:45.655 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000865221 2023-09-30T17:02:45.655 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.655 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.655 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:45.655 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353391+0000", 2023-09-30T17:02:45.656 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013217700000000001 2023-09-30T17:02:45.656 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.656 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.656 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:45.656 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362757+0000", 2023-09-30T17:02:45.656 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093657889999999994 2023-09-30T17:02:45.656 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:45.656 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:45.656 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:45.656 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.657 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-09-30T17:02:45.657 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:02:45.657 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 27.238807385000001, 2023-09-30T17:02:45.657 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0061813579999999996, 2023-09-30T17:02:45.657 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:45.657 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2023-09-30T17:02:45.657 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:45.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.657 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:45.657 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:02:45.658 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:45.658 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:45.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:02:45.658 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:45.658 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:45.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:02:45.658 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5499999999999999e-07 2023-09-30T17:02:45.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.659 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.659 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:45.659 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358686+0000", 2023-09-30T17:02:45.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9979999999999992e-06 2023-09-30T17:02:45.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.659 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.659 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:45.659 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358700+0000", 2023-09-30T17:02:45.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3635000000000001e-05 2023-09-30T17:02:45.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.660 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.660 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:45.660 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358714+0000", 2023-09-30T17:02:45.660 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4470999999999999e-05 2023-09-30T17:02:45.660 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.660 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.660 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:45.660 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358767+0000", 2023-09-30T17:02:45.660 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2651999999999997e-05 2023-09-30T17:02:45.660 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.660 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.661 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:45.661 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364858+0000", 2023-09-30T17:02:45.661 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060912470000000002 2023-09-30T17:02:45.661 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:45.661 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:45.661 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:45.661 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.661 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.661 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2023-09-30T17:02:45.661 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:02:45.661 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 27.236442544999999, 2023-09-30T17:02:45.662 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00036246299999999999, 2023-09-30T17:02:45.662 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:45.662 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:45.662 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:45.662 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.662 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:45.662 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:02:45.662 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:45.662 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.662 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.662 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:45.663 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:02:45.663 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:45.663 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.663 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.663 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:45.663 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:02:45.663 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3099999999999999e-07 2023-09-30T17:02:45.663 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.663 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.663 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:45.663 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361045+0000", 2023-09-30T17:02:45.663 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.49e-06 2023-09-30T17:02:45.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.664 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:45.664 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361056+0000", 2023-09-30T17:02:45.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0910000000000001e-05 2023-09-30T17:02:45.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.664 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:45.664 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361067+0000", 2023-09-30T17:02:45.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0531e-05 2023-09-30T17:02:45.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:45.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361263+0000", 2023-09-30T17:02:45.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000196486 2023-09-30T17:02:45.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:45.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361273+0000", 2023-09-30T17:02:45.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3379999999999994e-06 2023-09-30T17:02:45.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.666 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:45.666 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361404+0000", 2023-09-30T17:02:45.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013137700000000001 2023-09-30T17:02:45.666 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:45.666 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:45.666 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:45.666 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.666 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:31 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:02:45.666 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:02:45.666 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 27.235466515999999, 2023-09-30T17:02:45.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006676408, 2023-09-30T17:02:45.667 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:45.667 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:45.667 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:45.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:45.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:02:45.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:45.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:45.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:02:45.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:45.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.668 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:45.668 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:02:45.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5600000000000002e-07 2023-09-30T17:02:45.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.668 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:45.668 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362044+0000", 2023-09-30T17:02:45.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5987999999999999e-05 2023-09-30T17:02:45.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.669 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.669 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:45.669 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362051+0000", 2023-09-30T17:02:45.669 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2599999999999999e-06 2023-09-30T17:02:45.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.669 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.669 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:45.669 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362057+0000", 2023-09-30T17:02:45.669 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.19e-06 2023-09-30T17:02:45.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.669 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.670 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:45.670 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362096+0000", 2023-09-30T17:02:45.670 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8278000000000002e-05 2023-09-30T17:02:45.670 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.670 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.670 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:45.670 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362114+0000", 2023-09-30T17:02:45.670 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8808e-05 2023-09-30T17:02:45.670 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.670 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.670 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:45.671 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368658+0000", 2023-09-30T17:02:45.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065433540000000004 2023-09-30T17:02:45.671 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.671 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.671 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:45.671 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368694+0000", 2023-09-30T17:02:45.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6273999999999999e-05 2023-09-30T17:02:45.671 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:45.671 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:45.671 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:45.671 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.672 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:26 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-09-30T17:02:45.672 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:02:45.672 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 27.235375743999999, 2023-09-30T17:02:45.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0066596119999999996, 2023-09-30T17:02:45.672 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:45.672 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:45.672 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:45.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.672 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:45.672 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:02:45.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:45.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.673 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:45.673 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:02:45.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:45.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.673 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:45.673 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362109+0000", 2023-09-30T17:02:45.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5699999999999999e-07 2023-09-30T17:02:45.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.674 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:45.674 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362112+0000", 2023-09-30T17:02:45.674 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8410000000000002e-06 2023-09-30T17:02:45.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.674 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:45.674 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362117+0000", 2023-09-30T17:02:45.674 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.792e-06 2023-09-30T17:02:45.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.675 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:45.675 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362122+0000", 2023-09-30T17:02:45.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.763e-06 2023-09-30T17:02:45.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.675 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:45.675 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362344+0000", 2023-09-30T17:02:45.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022181600000000001 2023-09-30T17:02:45.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:45.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362357+0000", 2023-09-30T17:02:45.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2864000000000001e-05 2023-09-30T17:02:45.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:45.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368738+0000", 2023-09-30T17:02:45.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063809499999999998 2023-09-30T17:02:45.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:45.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368768+0000", 2023-09-30T17:02:45.677 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0429e-05 2023-09-30T17:02:45.677 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:45.677 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:45.677 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:45.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.677 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2023-09-30T17:02:45.677 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:02:45.677 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 27.234159577, 2023-09-30T17:02:45.677 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00082185400000000001, 2023-09-30T17:02:45.677 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:45.677 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:45.678 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:45.678 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.678 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:45.678 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:02:45.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:45.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.678 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.678 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:45.678 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:02:45.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:45.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.679 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:45.679 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:02:45.679 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.22e-07 2023-09-30T17:02:45.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.679 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:45.679 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363327+0000", 2023-09-30T17:02:45.679 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4480000000000001e-06 2023-09-30T17:02:45.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.679 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:45.680 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363333+0000", 2023-09-30T17:02:45.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9989999999999997e-06 2023-09-30T17:02:45.680 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.680 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:45.680 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363354+0000", 2023-09-30T17:02:45.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0547000000000002e-05 2023-09-30T17:02:45.680 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.680 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:45.680 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364057+0000", 2023-09-30T17:02:45.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00070306600000000002 2023-09-30T17:02:45.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.681 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:45.681 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364063+0000", 2023-09-30T17:02:45.681 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.694e-06 2023-09-30T17:02:45.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.681 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:45.681 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364146+0000", 2023-09-30T17:02:45.681 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3877999999999999e-05 2023-09-30T17:02:45.682 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:45.682 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:45.682 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:45.682 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.682 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.682 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e18/16 ondisk, result = 0)", 2023-09-30T17:02:45.682 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:02:45.682 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 27.233846045, 2023-09-30T17:02:45.682 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00067007199999999996, 2023-09-30T17:02:45.683 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:45.683 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:45.683 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:45.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.683 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:45.683 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:02:45.683 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:45.683 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.684 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:45.684 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:02:45.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:45.684 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.684 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:45.684 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:02:45.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.41e-07 2023-09-30T17:02:45.684 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.685 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:45.685 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363641+0000", 2023-09-30T17:02:45.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4830000000000002e-06 2023-09-30T17:02:45.685 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.685 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:45.685 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363647+0000", 2023-09-30T17:02:45.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4869999999999999e-06 2023-09-30T17:02:45.685 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.686 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:45.686 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363654+0000", 2023-09-30T17:02:45.686 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5889999999999999e-06 2023-09-30T17:02:45.686 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.686 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.686 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:45.686 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364217+0000", 2023-09-30T17:02:45.686 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00056263199999999998 2023-09-30T17:02:45.686 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.686 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.686 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:45.687 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364222+0000", 2023-09-30T17:02:45.687 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.242e-06 2023-09-30T17:02:45.687 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.687 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.687 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:45.687 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364308+0000", 2023-09-30T17:02:45.687 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6397999999999995e-05 2023-09-30T17:02:45.687 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:45.687 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:45.687 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:45.687 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.687 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.688 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2023-09-30T17:02:45.688 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:02:45.688 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 27.224258134999999, 2023-09-30T17:02:45.688 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000359561, 2023-09-30T17:02:45.688 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:45.688 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2023-09-30T17:02:45.688 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:45.688 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.688 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:45.688 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:02:45.688 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:45.688 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.689 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:45.689 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:02:45.689 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:45.689 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.689 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:45.689 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:02:45.689 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1e-07 2023-09-30T17:02:45.689 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.689 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:45.689 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373228+0000", 2023-09-30T17:02:45.690 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9420000000000002e-06 2023-09-30T17:02:45.690 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.690 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:45.690 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373235+0000", 2023-09-30T17:02:45.690 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4230000000000002e-06 2023-09-30T17:02:45.690 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.690 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:45.690 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373239+0000", 2023-09-30T17:02:45.690 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6809999999999997e-06 2023-09-30T17:02:45.690 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.691 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.691 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:45.691 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373518+0000", 2023-09-30T17:02:45.691 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000278311 2023-09-30T17:02:45.691 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.691 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.691 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:45.691 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373586+0000", 2023-09-30T17:02:45.691 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7994e-05 2023-09-30T17:02:45.691 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:45.691 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:45.692 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:45.692 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.692 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.692 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:02:45.692 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:02:45.692 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 27.219832061999998, 2023-09-30T17:02:45.692 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0046632949999999996, 2023-09-30T17:02:45.692 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:45.692 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:45.692 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:45.692 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.692 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:45.693 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:02:45.693 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:45.693 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.693 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.693 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:45.693 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:02:45.693 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:45.693 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.693 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.693 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:45.693 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377653+0000", 2023-09-30T17:02:45.693 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7800000000000002e-07 2023-09-30T17:02:45.694 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.694 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.694 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:45.694 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377657+0000", 2023-09-30T17:02:45.694 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5859999999999998e-06 2023-09-30T17:02:45.694 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.694 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.694 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:45.694 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377677+0000", 2023-09-30T17:02:45.694 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9508999999999999e-05 2023-09-30T17:02:45.694 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.694 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.695 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:45.695 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377682+0000", 2023-09-30T17:02:45.695 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8300000000000001e-06 2023-09-30T17:02:45.695 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.695 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.695 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:45.695 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377725+0000", 2023-09-30T17:02:45.695 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2425000000000001e-05 2023-09-30T17:02:45.695 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.695 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.695 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:45.696 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377738+0000", 2023-09-30T17:02:45.696 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2899e-05 2023-09-30T17:02:45.696 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.696 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.696 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:45.696 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382268+0000", 2023-09-30T17:02:45.696 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045301289999999999 2023-09-30T17:02:45.696 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.696 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.696 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:45.696 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382315+0000", 2023-09-30T17:02:45.696 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7539e-05 2023-09-30T17:02:45.697 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:45.697 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:45.697 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:45.697 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.697 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.697 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-09-30T17:02:45.697 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:02:45.697 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 27.219382611, 2023-09-30T17:02:45.697 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042540670000000003, 2023-09-30T17:02:45.697 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:45.697 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:45.697 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:45.698 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.698 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:45.698 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:02:45.698 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:45.698 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.698 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.698 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:45.698 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:02:45.698 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:45.698 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.698 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.698 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:45.699 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:02:45.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0299999999999998e-07 2023-09-30T17:02:45.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.699 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:45.699 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378107+0000", 2023-09-30T17:02:45.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9250000000000003e-06 2023-09-30T17:02:45.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.699 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:45.699 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378116+0000", 2023-09-30T17:02:45.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.037e-06 2023-09-30T17:02:45.700 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.700 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.700 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:45.700 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378123+0000", 2023-09-30T17:02:45.700 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1879999999999996e-06 2023-09-30T17:02:45.700 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.700 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.700 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:45.700 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378174+0000", 2023-09-30T17:02:45.700 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0998000000000002e-05 2023-09-30T17:02:45.700 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.700 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.701 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:45.701 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378197+0000", 2023-09-30T17:02:45.701 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2558e-05 2023-09-30T17:02:45.701 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.701 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.701 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:45.701 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382319+0000", 2023-09-30T17:02:45.701 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041220950000000001 2023-09-30T17:02:45.701 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.701 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.701 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:45.702 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382356+0000", 2023-09-30T17:02:45.702 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6563000000000002e-05 2023-09-30T17:02:45.702 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:45.702 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:45.702 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:45.702 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.702 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.702 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-09-30T17:02:45.702 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:02:45.702 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.161618786999998, 2023-09-30T17:02:45.702 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00171641, 2023-09-30T17:02:45.702 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:45.703 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:45.703 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:45.703 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.703 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:45.703 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:02:45.703 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:45.703 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.703 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.703 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:45.703 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:02:45.703 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:45.703 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.704 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.704 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:45.704 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435868+0000", 2023-09-30T17:02:45.704 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5840000000000002e-06 2023-09-30T17:02:45.704 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.704 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.704 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:45.704 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435892+0000", 2023-09-30T17:02:45.704 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3625000000000002e-05 2023-09-30T17:02:45.704 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.704 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.704 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:45.705 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435908+0000", 2023-09-30T17:02:45.705 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6548000000000001e-05 2023-09-30T17:02:45.705 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.705 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.705 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:45.705 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435935+0000", 2023-09-30T17:02:45.705 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6516000000000002e-05 2023-09-30T17:02:45.705 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.705 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.705 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:45.705 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435996+0000", 2023-09-30T17:02:45.705 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1433999999999995e-05 2023-09-30T17:02:45.706 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.706 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.706 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:45.706 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436114+0000", 2023-09-30T17:02:45.706 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000118344 2023-09-30T17:02:45.706 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.706 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.706 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:45.706 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436219+0000", 2023-09-30T17:02:45.706 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010453100000000001 2023-09-30T17:02:45.706 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.707 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.707 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:45.707 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436900+0000", 2023-09-30T17:02:45.707 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00068121299999999996 2023-09-30T17:02:45.707 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.707 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.707 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:45.707 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437508+0000", 2023-09-30T17:02:45.707 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00060817399999999995 2023-09-30T17:02:45.707 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.707 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.708 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:45.708 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437554+0000", 2023-09-30T17:02:45.708 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5609000000000003e-05 2023-09-30T17:02:45.708 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.708 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.708 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:45.708 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437582+0000", 2023-09-30T17:02:45.708 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7832000000000001e-05 2023-09-30T17:02:45.708 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:45.708 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:45.708 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:45.708 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.709 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.709 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2023-09-30T17:02:45.709 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:02:45.709 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.1613072930000001, 2023-09-30T17:02:45.709 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001456199, 2023-09-30T17:02:45.709 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:45.709 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:45.709 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:45.709 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.709 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:45.709 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:02:45.710 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:45.710 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.710 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.710 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:45.710 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:02:45.710 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:45.710 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.710 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.710 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:45.710 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436178+0000", 2023-09-30T17:02:45.710 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.494e-06 2023-09-30T17:02:45.710 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.711 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.711 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:45.711 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436184+0000", 2023-09-30T17:02:45.711 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2809999999999999e-06 2023-09-30T17:02:45.711 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.711 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.711 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:45.711 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436198+0000", 2023-09-30T17:02:45.711 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3978000000000001e-05 2023-09-30T17:02:45.711 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.711 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.711 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:45.712 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436206+0000", 2023-09-30T17:02:45.712 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8040000000000007e-06 2023-09-30T17:02:45.712 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.712 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.712 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:45.712 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436268+0000", 2023-09-30T17:02:45.712 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1484999999999998e-05 2023-09-30T17:02:45.712 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.712 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.712 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:45.712 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436339+0000", 2023-09-30T17:02:45.712 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1000000000000005e-05 2023-09-30T17:02:45.713 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.713 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.713 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:45.713 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436438+0000", 2023-09-30T17:02:45.713 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9389000000000007e-05 2023-09-30T17:02:45.713 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.713 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.713 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:45.713 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436986+0000", 2023-09-30T17:02:45.713 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054723399999999996 2023-09-30T17:02:45.713 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.713 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.713 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:45.714 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437566+0000", 2023-09-30T17:02:45.714 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00058017599999999996 2023-09-30T17:02:45.714 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.714 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.714 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:45.714 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437606+0000", 2023-09-30T17:02:45.714 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9891999999999997e-05 2023-09-30T17:02:45.714 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:45.714 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:45.714 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:45.714 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437633+0000", 2023-09-30T17:02:45.715 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7466000000000001e-05 2023-09-30T17:02:45.715 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:45.715 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:45.715 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:45.715 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:45.715 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:45.715 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:02:45.716 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:45.717+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:45.717 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:02:45.817 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:45.817+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:45.858 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:02:45.858 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:02:45.859 INFO:teuthology.orchestra.run.smithi031.stdout: "num_ops": 0 2023-09-30T17:02:45.859 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:02:45.869 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:02:45.954 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:45.953+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:46.019 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:46.018+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:46.040 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:02:46.041 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:02:46.041 INFO:teuthology.orchestra.run.smithi031.stdout: "complaint_time": 30, 2023-09-30T17:02:46.041 INFO:teuthology.orchestra.run.smithi031.stdout: "num_blocked_ops": 0 2023-09-30T17:02:46.041 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:02:46.051 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:02:46.119 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:46.119+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:46.220 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:46.219+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:46.225 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:02:46.225 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 20, 2023-09-30T17:02:46.225 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 600, 2023-09-30T17:02:46.225 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:02:46.226 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.226 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:32 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'18, mlcod=11'14)", 2023-09-30T17:02:46.226 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:02:46.226 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 38.863037198000001, 2023-09-30T17:02:46.226 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051629809999999996, 2023-09-30T17:02:46.226 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:46.226 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:46.226 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:46.226 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.226 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:46.227 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:02:46.227 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:46.227 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.227 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.227 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:46.227 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:02:46.227 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:46.227 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.227 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.227 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:46.227 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:02:46.227 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2099999999999996e-07 2023-09-30T17:02:46.228 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.228 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.228 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:46.228 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361407+0000", 2023-09-30T17:02:46.228 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7499e-05 2023-09-30T17:02:46.228 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.228 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.228 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:46.228 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361418+0000", 2023-09-30T17:02:46.228 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1127999999999999e-05 2023-09-30T17:02:46.228 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.229 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.229 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:46.229 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361423+0000", 2023-09-30T17:02:46.229 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1930000000000001e-06 2023-09-30T17:02:46.229 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.229 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.229 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:46.229 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361476+0000", 2023-09-30T17:02:46.229 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3399000000000002e-05 2023-09-30T17:02:46.229 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.229 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.229 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:46.230 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361496+0000", 2023-09-30T17:02:46.230 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9638000000000001e-05 2023-09-30T17:02:46.230 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.230 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.230 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:46.230 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.366474+0000", 2023-09-30T17:02:46.230 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0049778829999999998 2023-09-30T17:02:46.230 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.230 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.230 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:46.231 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.366512+0000", 2023-09-30T17:02:46.231 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7620000000000002e-05 2023-09-30T17:02:46.231 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:46.231 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:46.231 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:46.231 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.231 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.231 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:37 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'23, mlcod=11'15)", 2023-09-30T17:02:46.231 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:02:46.231 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 38.860435201000001, 2023-09-30T17:02:46.231 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053985689999999998, 2023-09-30T17:02:46.231 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:46.232 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:46.232 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:46.232 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.232 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:46.232 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:02:46.232 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:46.232 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.232 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.232 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:46.232 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:02:46.232 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:46.233 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.233 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.233 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:46.233 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:02:46.233 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4400000000000001e-07 2023-09-30T17:02:46.233 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.233 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.233 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:46.233 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363956+0000", 2023-09-30T17:02:46.233 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.921e-06 2023-09-30T17:02:46.233 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.234 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.234 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:46.234 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363966+0000", 2023-09-30T17:02:46.234 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0351e-05 2023-09-30T17:02:46.234 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.234 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.234 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:46.234 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363971+0000", 2023-09-30T17:02:46.234 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.023e-06 2023-09-30T17:02:46.234 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.234 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.235 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:46.235 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.364013+0000", 2023-09-30T17:02:46.235 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1575000000000001e-05 2023-09-30T17:02:46.235 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.235 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.235 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:46.235 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.364026+0000", 2023-09-30T17:02:46.235 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3044000000000001e-05 2023-09-30T17:02:46.235 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.235 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.235 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:46.235 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.369308+0000", 2023-09-30T17:02:46.236 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005282152 2023-09-30T17:02:46.236 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.236 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.236 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:46.236 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.369349+0000", 2023-09-30T17:02:46.236 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1059000000000001e-05 2023-09-30T17:02:46.236 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:46.236 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:46.236 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:46.236 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.236 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.237 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:155 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'109, mlcod=11'105)", 2023-09-30T17:02:46.237 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:02:46.237 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 38.378739514999999, 2023-09-30T17:02:46.237 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053867639999999996, 2023-09-30T17:02:46.237 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:46.237 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:46.237 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:46.237 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.237 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:46.237 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:02:46.237 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:46.237 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.238 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.238 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:46.238 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:02:46.238 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:46.238 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.238 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.238 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:46.238 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845647+0000", 2023-09-30T17:02:46.238 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7599999999999997e-07 2023-09-30T17:02:46.238 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.238 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.239 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:46.239 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845699+0000", 2023-09-30T17:02:46.239 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1758000000000001e-05 2023-09-30T17:02:46.239 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.239 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.239 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:46.239 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845708+0000", 2023-09-30T17:02:46.239 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2159999999999995e-06 2023-09-30T17:02:46.239 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.239 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.239 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:46.239 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845712+0000", 2023-09-30T17:02:46.240 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2579999999999997e-06 2023-09-30T17:02:46.240 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.240 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.240 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:46.240 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845756+0000", 2023-09-30T17:02:46.240 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4119999999999998e-05 2023-09-30T17:02:46.240 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.240 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.240 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:46.240 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845779+0000", 2023-09-30T17:02:46.240 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2311e-05 2023-09-30T17:02:46.240 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.241 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.241 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:46.241 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.850982+0000", 2023-09-30T17:02:46.241 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005203053 2023-09-30T17:02:46.241 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.241 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.241 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:46.241 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851033+0000", 2023-09-30T17:02:46.241 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1471999999999998e-05 2023-09-30T17:02:46.241 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:46.241 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:46.241 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:46.242 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.242 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.242 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:156 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'110, mlcod=11'105)", 2023-09-30T17:02:46.242 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:02:46.242 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 38.378206589000001, 2023-09-30T17:02:46.242 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0052834759999999996, 2023-09-30T17:02:46.242 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:46.242 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:46.242 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:46.242 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.242 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:46.243 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:02:46.243 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:46.243 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.243 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.243 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:46.243 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:02:46.243 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:46.243 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.243 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.243 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:46.243 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846180+0000", 2023-09-30T17:02:46.243 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6300000000000005e-07 2023-09-30T17:02:46.244 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.244 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.244 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:46.244 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846184+0000", 2023-09-30T17:02:46.244 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3789999999999999e-06 2023-09-30T17:02:46.244 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.244 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.244 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:46.244 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846195+0000", 2023-09-30T17:02:46.244 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0778000000000001e-05 2023-09-30T17:02:46.244 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.244 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.245 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:46.245 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846200+0000", 2023-09-30T17:02:46.245 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1540000000000001e-06 2023-09-30T17:02:46.245 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.245 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.245 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:46.245 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846274+0000", 2023-09-30T17:02:46.245 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4129999999999997e-05 2023-09-30T17:02:46.245 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.245 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.245 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:46.246 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846286+0000", 2023-09-30T17:02:46.246 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1744e-05 2023-09-30T17:02:46.246 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.246 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.246 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:46.246 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851432+0000", 2023-09-30T17:02:46.246 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051462110000000004 2023-09-30T17:02:46.246 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.246 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.246 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:46.246 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851463+0000", 2023-09-30T17:02:46.247 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0516999999999999e-05 2023-09-30T17:02:46.247 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:46.247 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:46.247 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:46.247 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.247 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.247 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:203 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'149, mlcod=11'145)", 2023-09-30T17:02:46.247 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:02:46.247 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 38.022170680000002, 2023-09-30T17:02:46.247 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051867459999999999, 2023-09-30T17:02:46.247 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:46.247 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:46.248 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:46.248 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.248 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:46.248 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:02:46.248 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:46.248 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.248 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.248 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:46.248 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:02:46.248 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:46.248 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.248 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.249 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:46.249 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202216+0000", 2023-09-30T17:02:46.249 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7e-07 2023-09-30T17:02:46.249 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.249 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.249 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:46.249 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202271+0000", 2023-09-30T17:02:46.249 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5163e-05 2023-09-30T17:02:46.249 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.249 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.249 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:46.249 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202282+0000", 2023-09-30T17:02:46.250 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1319e-05 2023-09-30T17:02:46.250 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.250 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.250 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:46.250 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202288+0000", 2023-09-30T17:02:46.250 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2899999999999999e-06 2023-09-30T17:02:46.250 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.250 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.250 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:46.250 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202331+0000", 2023-09-30T17:02:46.250 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2147999999999997e-05 2023-09-30T17:02:46.250 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.251 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.251 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:46.251 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202348+0000", 2023-09-30T17:02:46.251 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7317e-05 2023-09-30T17:02:46.251 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.251 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.251 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:46.251 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.207357+0000", 2023-09-30T17:02:46.251 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0050095440000000003 2023-09-30T17:02:46.251 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.251 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.252 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:46.252 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.207402+0000", 2023-09-30T17:02:46.252 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4495e-05 2023-09-30T17:02:46.252 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:46.252 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:46.252 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:46.252 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.252 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.252 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:46.252 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:02:46.252 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 27.872840392000001, 2023-09-30T17:02:46.252 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.025313649000000001, 2023-09-30T17:02:46.253 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:46.253 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:46.253 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:46.253 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.253 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:46.253 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:02:46.253 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:46.253 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.253 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.253 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:46.253 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:02:46.253 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:46.254 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.254 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.254 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:46.254 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351551+0000", 2023-09-30T17:02:46.254 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3380000000000004e-06 2023-09-30T17:02:46.254 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.254 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.254 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:46.254 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351559+0000", 2023-09-30T17:02:46.254 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9589999999999995e-06 2023-09-30T17:02:46.254 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.255 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.255 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:46.255 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351571+0000", 2023-09-30T17:02:46.255 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2065999999999999e-05 2023-09-30T17:02:46.255 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.255 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.255 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:46.255 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351706+0000", 2023-09-30T17:02:46.255 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00013553799999999999 2023-09-30T17:02:46.255 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.256 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.256 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:46.256 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353016+0000", 2023-09-30T17:02:46.256 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0013099209999999999 2023-09-30T17:02:46.256 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.256 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.256 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:02:46.256 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353023+0000", 2023-09-30T17:02:46.256 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2479999999999999e-06 2023-09-30T17:02:46.256 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.256 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.256 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:46.256 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360348+0000", 2023-09-30T17:02:46.257 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0073248949999999997 2023-09-30T17:02:46.257 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.257 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.257 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:46.257 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360787+0000", 2023-09-30T17:02:46.257 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00043875199999999999 2023-09-30T17:02:46.257 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.257 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.257 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:46.257 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360892+0000", 2023-09-30T17:02:46.257 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010508199999999999 2023-09-30T17:02:46.257 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.257 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.258 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:02:46.258 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365132+0000", 2023-09-30T17:02:46.258 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0042396480000000004 2023-09-30T17:02:46.258 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.258 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.258 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:46.258 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376746+0000", 2023-09-30T17:02:46.258 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011614157 2023-09-30T17:02:46.258 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.258 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.258 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:46.259 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376811+0000", 2023-09-30T17:02:46.259 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5005999999999994e-05 2023-09-30T17:02:46.259 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.259 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.259 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:46.259 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376859+0000", 2023-09-30T17:02:46.259 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8038999999999999e-05 2023-09-30T17:02:46.259 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:46.259 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:46.259 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:46.259 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.259 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.260 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:46.260 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:02:46.260 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 27.872342592999999, 2023-09-30T17:02:46.260 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024923989000000001, 2023-09-30T17:02:46.260 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:46.260 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:46.260 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:46.260 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.260 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:46.260 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:02:46.260 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:46.261 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.261 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.261 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:46.261 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:02:46.261 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:46.261 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.261 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.261 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:46.261 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352044+0000", 2023-09-30T17:02:46.261 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9199999999999999e-07 2023-09-30T17:02:46.261 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.261 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.262 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:46.262 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352050+0000", 2023-09-30T17:02:46.262 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8880000000000002e-06 2023-09-30T17:02:46.262 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.262 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.262 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:46.262 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352143+0000", 2023-09-30T17:02:46.262 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2721999999999998e-05 2023-09-30T17:02:46.262 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.262 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.262 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:46.263 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352155+0000", 2023-09-30T17:02:46.263 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2279000000000001e-05 2023-09-30T17:02:46.263 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.263 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.263 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:46.263 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353114+0000", 2023-09-30T17:02:46.263 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00095943700000000005 2023-09-30T17:02:46.263 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.263 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.263 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:46.263 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353121+0000", 2023-09-30T17:02:46.263 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.494e-06 2023-09-30T17:02:46.264 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.264 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.264 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:46.264 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361491+0000", 2023-09-30T17:02:46.264 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0083697359999999991 2023-09-30T17:02:46.264 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.264 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.264 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:46.264 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361573+0000", 2023-09-30T17:02:46.264 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2822000000000001e-05 2023-09-30T17:02:46.264 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.264 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.265 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:46.265 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362166+0000", 2023-09-30T17:02:46.265 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00059223299999999995 2023-09-30T17:02:46.265 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.265 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.265 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:02:46.265 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365209+0000", 2023-09-30T17:02:46.265 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.003043212 2023-09-30T17:02:46.265 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.265 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.265 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:46.265 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376910+0000", 2023-09-30T17:02:46.266 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011700898 2023-09-30T17:02:46.266 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.266 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.266 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:46.266 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376945+0000", 2023-09-30T17:02:46.266 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4795000000000001e-05 2023-09-30T17:02:46.266 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.266 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.266 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:46.266 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376967+0000", 2023-09-30T17:02:46.266 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2580999999999999e-05 2023-09-30T17:02:46.267 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:46.267 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:46.267 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:46.267 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.267 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.267 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:46.267 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:02:46.267 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 27.872172673000001, 2023-09-30T17:02:46.267 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023120405, 2023-09-30T17:02:46.267 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:46.267 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:46.268 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:46.268 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.268 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:46.268 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:02:46.268 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:46.268 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.268 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.268 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:46.268 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:02:46.268 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:46.268 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.268 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.269 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:46.269 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352214+0000", 2023-09-30T17:02:46.269 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8400000000000003e-07 2023-09-30T17:02:46.269 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.269 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.269 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:46.269 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352233+0000", 2023-09-30T17:02:46.269 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8946000000000001e-05 2023-09-30T17:02:46.269 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.269 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.269 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:46.269 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352297+0000", 2023-09-30T17:02:46.270 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3540999999999994e-05 2023-09-30T17:02:46.270 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.270 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.270 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:46.270 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352450+0000", 2023-09-30T17:02:46.270 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015364799999999999 2023-09-30T17:02:46.270 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.270 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.270 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:46.270 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353098+0000", 2023-09-30T17:02:46.271 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00064820299999999997 2023-09-30T17:02:46.271 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.271 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.271 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:02:46.271 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353103+0000", 2023-09-30T17:02:46.271 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0529999999999997e-06 2023-09-30T17:02:46.271 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.271 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.271 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:46.271 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.358558+0000", 2023-09-30T17:02:46.271 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0054550249999999996 2023-09-30T17:02:46.271 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.272 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.272 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:46.272 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.358741+0000", 2023-09-30T17:02:46.272 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00018210200000000001 2023-09-30T17:02:46.272 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.272 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.272 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:46.272 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.359683+0000", 2023-09-30T17:02:46.272 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00094202299999999995 2023-09-30T17:02:46.272 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.272 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.273 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:02:46.273 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365044+0000", 2023-09-30T17:02:46.273 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053616219999999999 2023-09-30T17:02:46.273 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.273 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.273 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:46.273 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375256+0000", 2023-09-30T17:02:46.273 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010212156 2023-09-30T17:02:46.273 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.273 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.273 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:46.273 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375300+0000", 2023-09-30T17:02:46.274 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3961999999999997e-05 2023-09-30T17:02:46.274 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.274 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.274 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:46.274 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375334+0000", 2023-09-30T17:02:46.274 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.324e-05 2023-09-30T17:02:46.274 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:46.274 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:46.274 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:46.274 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.274 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.274 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:46.275 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:02:46.275 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 27.871857654999999, 2023-09-30T17:02:46.275 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024240660000000001, 2023-09-30T17:02:46.275 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:46.275 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:46.275 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:46.275 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.275 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:46.275 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:02:46.275 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:46.276 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.276 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.276 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:46.276 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:02:46.276 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:46.276 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.276 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.276 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:46.276 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352529+0000", 2023-09-30T17:02:46.276 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1379999999999999e-06 2023-09-30T17:02:46.276 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.276 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.277 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:46.277 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352536+0000", 2023-09-30T17:02:46.277 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3489999999999997e-06 2023-09-30T17:02:46.277 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.277 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.277 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:46.277 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352547+0000", 2023-09-30T17:02:46.277 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1109e-05 2023-09-30T17:02:46.277 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.277 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.277 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:46.277 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352560+0000", 2023-09-30T17:02:46.278 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3046e-05 2023-09-30T17:02:46.278 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.278 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.278 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:46.278 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353142+0000", 2023-09-30T17:02:46.278 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00058174699999999997 2023-09-30T17:02:46.278 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.278 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.278 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:46.278 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353147+0000", 2023-09-30T17:02:46.278 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5840000000000002e-06 2023-09-30T17:02:46.279 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.279 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.279 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:46.279 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360374+0000", 2023-09-30T17:02:46.279 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0072270049999999999 2023-09-30T17:02:46.279 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.279 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.279 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:46.279 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360795+0000", 2023-09-30T17:02:46.279 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00042088999999999999 2023-09-30T17:02:46.279 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.280 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.280 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:46.280 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360967+0000", 2023-09-30T17:02:46.280 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017235699999999999 2023-09-30T17:02:46.280 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.280 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.280 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:02:46.280 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365051+0000", 2023-09-30T17:02:46.280 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0040837429999999999 2023-09-30T17:02:46.280 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.280 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.280 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:46.281 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376708+0000", 2023-09-30T17:02:46.281 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011656866 2023-09-30T17:02:46.281 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.281 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.281 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:46.281 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376745+0000", 2023-09-30T17:02:46.281 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6769e-05 2023-09-30T17:02:46.281 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.281 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.281 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:46.281 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376769+0000", 2023-09-30T17:02:46.281 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4057e-05 2023-09-30T17:02:46.282 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:46.282 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:46.282 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:46.282 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.282 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.282 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:46.282 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:02:46.282 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 27.871598299999999, 2023-09-30T17:02:46.282 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023472704, 2023-09-30T17:02:46.282 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:46.282 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:46.282 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:46.283 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.283 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:46.283 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:02:46.283 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:46.283 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.283 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.283 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:46.283 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:02:46.283 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:46.283 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.283 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.283 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:46.284 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:02:46.284 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8000000000000005e-07 2023-09-30T17:02:46.284 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.284 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.284 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:46.284 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352794+0000", 2023-09-30T17:02:46.284 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.789e-06 2023-09-30T17:02:46.284 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.284 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.284 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:46.284 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352805+0000", 2023-09-30T17:02:46.284 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0848e-05 2023-09-30T17:02:46.285 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.285 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.285 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:46.285 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352812+0000", 2023-09-30T17:02:46.285 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4449999999999999e-06 2023-09-30T17:02:46.285 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.285 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.285 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:46.285 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353063+0000", 2023-09-30T17:02:46.285 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00025046299999999998 2023-09-30T17:02:46.285 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.285 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.286 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:02:46.286 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353071+0000", 2023-09-30T17:02:46.286 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6739999999999997e-06 2023-09-30T17:02:46.286 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.286 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.286 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:46.286 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361696+0000", 2023-09-30T17:02:46.286 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0086251609999999992 2023-09-30T17:02:46.286 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.286 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.287 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:46.287 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362284+0000", 2023-09-30T17:02:46.287 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00058872299999999998 2023-09-30T17:02:46.287 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.287 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.287 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:46.287 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362429+0000", 2023-09-30T17:02:46.287 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014509000000000001 2023-09-30T17:02:46.287 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.287 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.287 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:02:46.287 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365330+0000", 2023-09-30T17:02:46.288 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0029005419999999999 2023-09-30T17:02:46.288 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.288 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.288 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:46.288 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376196+0000", 2023-09-30T17:02:46.288 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.01086615 2023-09-30T17:02:46.288 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.288 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.288 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:46.288 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376230+0000", 2023-09-30T17:02:46.288 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3858e-05 2023-09-30T17:02:46.288 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.288 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.289 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:46.289 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376260+0000", 2023-09-30T17:02:46.289 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0181000000000001e-05 2023-09-30T17:02:46.289 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:46.289 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:46.289 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:46.289 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.289 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.289 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:46.289 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:02:46.289 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 27.87136473, 2023-09-30T17:02:46.290 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023406132999999999, 2023-09-30T17:02:46.290 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:46.290 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:46.290 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:46.290 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.290 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:46.290 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:02:46.290 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:46.290 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.290 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.290 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:46.290 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:02:46.291 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:46.291 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.291 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.291 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:46.291 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353022+0000", 2023-09-30T17:02:46.291 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.78e-07 2023-09-30T17:02:46.291 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.291 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.291 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:46.291 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353027+0000", 2023-09-30T17:02:46.291 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9089999999999999e-06 2023-09-30T17:02:46.292 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.292 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.292 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:46.292 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353035+0000", 2023-09-30T17:02:46.292 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0430000000000008e-06 2023-09-30T17:02:46.292 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.292 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.292 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:46.292 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353047+0000", 2023-09-30T17:02:46.292 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1674e-05 2023-09-30T17:02:46.292 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.292 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.293 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:46.293 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353105+0000", 2023-09-30T17:02:46.293 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8891999999999998e-05 2023-09-30T17:02:46.293 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.293 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.293 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:46.293 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353112+0000", 2023-09-30T17:02:46.293 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7059999999999998e-06 2023-09-30T17:02:46.293 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.293 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.293 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:46.293 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362733+0000", 2023-09-30T17:02:46.294 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0096205869999999999 2023-09-30T17:02:46.294 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.294 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.294 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:46.294 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362833+0000", 2023-09-30T17:02:46.294 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000100227 2023-09-30T17:02:46.294 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.294 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.294 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:46.294 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363000+0000", 2023-09-30T17:02:46.294 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016670899999999999 2023-09-30T17:02:46.294 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.295 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.295 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:02:46.295 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365550+0000", 2023-09-30T17:02:46.295 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0025499199999999998 2023-09-30T17:02:46.295 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.295 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.295 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:46.295 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376315+0000", 2023-09-30T17:02:46.295 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010765011999999999 2023-09-30T17:02:46.295 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.295 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.295 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:46.296 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376386+0000", 2023-09-30T17:02:46.297 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0866999999999998e-05 2023-09-30T17:02:46.297 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.297 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.297 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:46.297 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376427+0000", 2023-09-30T17:02:46.297 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1709000000000003e-05 2023-09-30T17:02:46.297 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:46.297 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:46.297 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:46.298 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.298 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.298 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:46.298 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:02:46.298 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 27.871324093999998, 2023-09-30T17:02:46.298 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024076238, 2023-09-30T17:02:46.298 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:46.298 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:46.298 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:46.298 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.298 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:46.299 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:02:46.299 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:46.299 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.299 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.299 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:46.299 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:02:46.299 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:46.299 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.299 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.299 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:46.299 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:02:46.300 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8699999999999995e-07 2023-09-30T17:02:46.300 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.300 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.300 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:46.300 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353067+0000", 2023-09-30T17:02:46.300 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.605e-06 2023-09-30T17:02:46.300 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.300 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.300 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:46.300 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353073+0000", 2023-09-30T17:02:46.300 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8900000000000004e-06 2023-09-30T17:02:46.300 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.300 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.301 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:46.301 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353083+0000", 2023-09-30T17:02:46.301 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0200000000000001e-05 2023-09-30T17:02:46.301 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.301 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.301 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:46.301 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353186+0000", 2023-09-30T17:02:46.301 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010256599999999999 2023-09-30T17:02:46.301 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.301 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.301 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:46.301 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353190+0000", 2023-09-30T17:02:46.302 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9709999999999998e-06 2023-09-30T17:02:46.302 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.302 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.302 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:46.302 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362946+0000", 2023-09-30T17:02:46.302 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0097563330000000007 2023-09-30T17:02:46.302 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.302 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.302 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:46.302 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363088+0000", 2023-09-30T17:02:46.302 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014259200000000001 2023-09-30T17:02:46.303 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.303 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.303 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:46.303 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363555+0000", 2023-09-30T17:02:46.303 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00046627799999999998 2023-09-30T17:02:46.303 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.303 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.303 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:02:46.303 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365871+0000", 2023-09-30T17:02:46.303 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0023167589999999998 2023-09-30T17:02:46.303 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.303 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.304 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:46.304 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377033+0000", 2023-09-30T17:02:46.304 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011161203999999999 2023-09-30T17:02:46.304 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.304 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.304 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:46.304 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377100+0000", 2023-09-30T17:02:46.304 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7230999999999994e-05 2023-09-30T17:02:46.304 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.304 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.304 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:46.305 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377138+0000", 2023-09-30T17:02:46.305 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8022000000000003e-05 2023-09-30T17:02:46.305 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:46.305 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:46.305 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:46.305 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.305 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.305 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:46.305 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:02:46.305 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 27.871223144999998, 2023-09-30T17:02:46.305 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.020304412000000001, 2023-09-30T17:02:46.305 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:46.306 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:02:46.306 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:46.306 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.306 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:46.306 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:02:46.306 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:46.306 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.306 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.306 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:46.306 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:02:46.306 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:46.306 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.307 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.307 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:46.307 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353164+0000", 2023-09-30T17:02:46.307 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7100000000000011e-07 2023-09-30T17:02:46.307 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.307 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.307 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:46.307 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353168+0000", 2023-09-30T17:02:46.307 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0600000000000001e-06 2023-09-30T17:02:46.307 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.307 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.308 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:46.308 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353177+0000", 2023-09-30T17:02:46.308 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1409999999999994e-06 2023-09-30T17:02:46.308 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.308 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.308 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:46.308 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353185+0000", 2023-09-30T17:02:46.308 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2479999999999996e-06 2023-09-30T17:02:46.308 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.308 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.308 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:46.308 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353246+0000", 2023-09-30T17:02:46.308 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0519000000000001e-05 2023-09-30T17:02:46.309 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.309 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.309 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:02:46.309 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353252+0000", 2023-09-30T17:02:46.309 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7859999999999999e-06 2023-09-30T17:02:46.309 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.309 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.309 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:46.309 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354979+0000", 2023-09-30T17:02:46.309 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0017270090000000001 2023-09-30T17:02:46.309 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.310 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.310 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:46.310 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355097+0000", 2023-09-30T17:02:46.310 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000117472 2023-09-30T17:02:46.310 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.310 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.310 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:46.310 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.373467+0000", 2023-09-30T17:02:46.310 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.018370206 2023-09-30T17:02:46.310 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:46.310 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:46.311 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:46.311 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.311 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.311 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:46.311 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:02:46.311 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 27.871182406999999, 2023-09-30T17:02:46.311 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.012725089, 2023-09-30T17:02:46.311 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:46.311 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:02:46.311 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:46.311 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.312 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:46.312 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:02:46.312 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:46.312 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.312 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.312 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:46.312 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:02:46.312 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:46.312 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.312 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.312 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:46.312 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353204+0000", 2023-09-30T17:02:46.313 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7100000000000002e-07 2023-09-30T17:02:46.313 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.313 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.313 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:46.313 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353213+0000", 2023-09-30T17:02:46.313 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8580000000000006e-06 2023-09-30T17:02:46.313 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.313 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.313 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:46.313 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353219+0000", 2023-09-30T17:02:46.313 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8939999999999998e-06 2023-09-30T17:02:46.313 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.314 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.314 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:46.314 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353223+0000", 2023-09-30T17:02:46.314 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.357e-06 2023-09-30T17:02:46.314 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.314 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.314 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:46.314 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353278+0000", 2023-09-30T17:02:46.314 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5228e-05 2023-09-30T17:02:46.314 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.315 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.315 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:02:46.315 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353284+0000", 2023-09-30T17:02:46.315 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8209999999999998e-06 2023-09-30T17:02:46.315 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.315 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.315 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:46.315 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355095+0000", 2023-09-30T17:02:46.315 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001811404 2023-09-30T17:02:46.315 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.315 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.316 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:46.316 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355256+0000", 2023-09-30T17:02:46.316 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000160898 2023-09-30T17:02:46.316 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.316 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.316 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:46.316 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365928+0000", 2023-09-30T17:02:46.316 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010672157999999999 2023-09-30T17:02:46.316 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:46.316 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:46.316 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:46.316 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.316 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.317 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-09-30T17:02:46.317 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:02:46.317 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 27.870651200000001, 2023-09-30T17:02:46.317 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0056863460000000001, 2023-09-30T17:02:46.317 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:46.317 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "reached pg", 2023-09-30T17:02:46.317 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:46.317 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.317 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:46.317 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:02:46.317 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:46.318 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.318 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.318 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:46.318 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:02:46.318 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:46.318 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.318 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.318 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:46.318 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:02:46.318 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5700000000000002e-07 2023-09-30T17:02:46.318 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.318 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.319 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:46.319 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353747+0000", 2023-09-30T17:02:46.319 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1899000000000001e-05 2023-09-30T17:02:46.319 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.319 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.319 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:46.319 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353776+0000", 2023-09-30T17:02:46.319 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.8767000000000001e-05 2023-09-30T17:02:46.319 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.319 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.319 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:46.319 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353792+0000", 2023-09-30T17:02:46.320 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5914999999999999e-05 2023-09-30T17:02:46.320 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.320 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.320 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:46.320 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353900+0000", 2023-09-30T17:02:46.320 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010774500000000001 2023-09-30T17:02:46.320 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.320 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.320 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:46.320 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.359421+0000", 2023-09-30T17:02:46.320 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0055213629999999996 2023-09-30T17:02:46.320 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:46.321 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:46.321 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:46.321 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.321 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.321 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:02:46.321 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:02:46.321 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 27.869979600000001, 2023-09-30T17:02:46.321 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0069196370000000002, 2023-09-30T17:02:46.321 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:46.321 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:46.321 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:46.321 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.322 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:46.322 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:02:46.322 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:46.322 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.322 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.322 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:46.322 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:02:46.322 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:46.322 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.322 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.322 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:46.322 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354407+0000", 2023-09-30T17:02:46.323 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7400000000000002e-07 2023-09-30T17:02:46.323 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.323 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.323 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:46.323 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354414+0000", 2023-09-30T17:02:46.323 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1040000000000001e-06 2023-09-30T17:02:46.323 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.323 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.323 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:46.323 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354425+0000", 2023-09-30T17:02:46.323 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1090000000000001e-05 2023-09-30T17:02:46.323 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.323 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.324 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:46.324 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354435+0000", 2023-09-30T17:02:46.324 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8169999999999994e-06 2023-09-30T17:02:46.324 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.324 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.324 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:46.324 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355741+0000", 2023-09-30T17:02:46.324 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0013063160000000001 2023-09-30T17:02:46.324 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.324 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.324 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:46.324 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355763+0000", 2023-09-30T17:02:46.325 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1688e-05 2023-09-30T17:02:46.325 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.325 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.325 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:46.325 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361289+0000", 2023-09-30T17:02:46.325 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0055258269999999996 2023-09-30T17:02:46.325 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.325 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.325 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:46.325 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361326+0000", 2023-09-30T17:02:46.325 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7020999999999997e-05 2023-09-30T17:02:46.325 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:46.326 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:46.326 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:46.326 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.326 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.326 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:30 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2023-09-30T17:02:46.326 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:02:46.326 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 27.868605641999999, 2023-09-30T17:02:46.326 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0069996629999999997, 2023-09-30T17:02:46.326 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:46.326 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:46.326 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:46.326 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.327 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:46.327 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:02:46.327 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:46.327 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.327 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.327 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:46.327 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:02:46.327 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:46.327 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.327 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.327 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:46.327 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355781+0000", 2023-09-30T17:02:46.328 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9599999999999999e-07 2023-09-30T17:02:46.328 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.328 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.328 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:46.328 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355788+0000", 2023-09-30T17:02:46.328 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8129999999999996e-06 2023-09-30T17:02:46.328 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.328 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.328 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:46.328 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355798+0000", 2023-09-30T17:02:46.328 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2909999999999996e-06 2023-09-30T17:02:46.328 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.329 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.329 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:46.329 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355807+0000", 2023-09-30T17:02:46.329 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8619999999999992e-06 2023-09-30T17:02:46.329 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.329 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.329 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:46.329 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.357264+0000", 2023-09-30T17:02:46.329 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0014578289999999999 2023-09-30T17:02:46.329 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.329 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.329 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:46.330 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.357916+0000", 2023-09-30T17:02:46.330 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00065170500000000004 2023-09-30T17:02:46.330 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.330 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.330 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:46.330 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362731+0000", 2023-09-30T17:02:46.330 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0048149849999999999 2023-09-30T17:02:46.330 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.330 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.330 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:46.330 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362780+0000", 2023-09-30T17:02:46.331 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8681999999999999e-05 2023-09-30T17:02:46.331 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:46.331 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:46.331 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:46.331 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.331 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.331 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2023-09-30T17:02:46.331 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:02:46.331 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 27.849954590999999, 2023-09-30T17:02:46.331 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005905998, 2023-09-30T17:02:46.331 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:46.331 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:46.332 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:46.332 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.332 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:46.332 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:02:46.332 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:46.332 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.332 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.332 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:46.332 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:02:46.332 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:46.332 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.333 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.333 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:46.333 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:02:46.333 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1e-07 2023-09-30T17:02:46.333 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.333 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.333 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:46.333 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374455+0000", 2023-09-30T17:02:46.333 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.3091999999999998e-05 2023-09-30T17:02:46.333 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.333 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.334 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:46.334 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374462+0000", 2023-09-30T17:02:46.334 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5170000000000002e-06 2023-09-30T17:02:46.334 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.334 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.334 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:46.334 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374469+0000", 2023-09-30T17:02:46.334 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8199999999999999e-06 2023-09-30T17:02:46.334 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.334 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.334 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:46.334 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374550+0000", 2023-09-30T17:02:46.335 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0978999999999998e-05 2023-09-30T17:02:46.335 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.335 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.335 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:46.335 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374562+0000", 2023-09-30T17:02:46.335 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2472e-05 2023-09-30T17:02:46.335 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.335 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.335 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:46.335 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380293+0000", 2023-09-30T17:02:46.335 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0057310379999999999 2023-09-30T17:02:46.335 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.336 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.336 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:46.336 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380337+0000", 2023-09-30T17:02:46.336 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3869999999999998e-05 2023-09-30T17:02:46.336 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:46.336 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:46.336 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:46.336 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.336 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.336 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2023-09-30T17:02:46.336 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:02:46.336 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 27.849767841999999, 2023-09-30T17:02:46.336 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0057590560000000002, 2023-09-30T17:02:46.337 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:46.337 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:46.337 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:46.337 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.337 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:46.337 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:02:46.337 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:46.337 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.337 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.337 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:46.337 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:02:46.337 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:46.338 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.338 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.338 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:46.338 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:02:46.338 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4900000000000001e-07 2023-09-30T17:02:46.338 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.338 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.338 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:46.338 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374629+0000", 2023-09-30T17:02:46.338 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1014e-05 2023-09-30T17:02:46.339 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.339 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.339 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:46.339 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374636+0000", 2023-09-30T17:02:46.339 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5889999999999999e-06 2023-09-30T17:02:46.339 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.339 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.339 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:46.339 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374642+0000", 2023-09-30T17:02:46.339 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.48e-06 2023-09-30T17:02:46.339 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.339 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.340 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:46.340 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374681+0000", 2023-09-30T17:02:46.340 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9320000000000003e-05 2023-09-30T17:02:46.340 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.340 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.340 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:46.340 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374694+0000", 2023-09-30T17:02:46.340 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3351e-05 2023-09-30T17:02:46.340 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.340 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.340 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:46.341 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380319+0000", 2023-09-30T17:02:46.341 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0056243880000000001 2023-09-30T17:02:46.341 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.341 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.341 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:46.341 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380377+0000", 2023-09-30T17:02:46.341 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8464999999999997e-05 2023-09-30T17:02:46.341 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:46.341 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:46.341 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:46.341 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.341 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.342 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=0'0)", 2023-09-30T17:02:46.342 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:02:46.342 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 27.849056931, 2023-09-30T17:02:46.342 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051157370000000004, 2023-09-30T17:02:46.342 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:46.342 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:46.342 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:46.342 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.342 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:46.342 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:02:46.342 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:46.343 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.343 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.343 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:46.343 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:02:46.343 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:46.343 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.343 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.343 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:46.343 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:02:46.343 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0199999999999998e-07 2023-09-30T17:02:46.343 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.343 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.344 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:46.344 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375334+0000", 2023-09-30T17:02:46.344 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8799999999999999e-06 2023-09-30T17:02:46.344 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.344 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.344 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:46.344 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375343+0000", 2023-09-30T17:02:46.344 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5490000000000006e-06 2023-09-30T17:02:46.344 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.344 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.344 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:46.345 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375350+0000", 2023-09-30T17:02:46.345 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5700000000000004e-06 2023-09-30T17:02:46.345 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.345 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.345 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:46.345 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375396+0000", 2023-09-30T17:02:46.345 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5550999999999998e-05 2023-09-30T17:02:46.345 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.345 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.345 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:46.345 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375410+0000", 2023-09-30T17:02:46.345 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4518999999999999e-05 2023-09-30T17:02:46.345 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.346 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.346 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:46.346 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380401+0000", 2023-09-30T17:02:46.346 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0049903430000000004 2023-09-30T17:02:46.346 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:46.346 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:46.346 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:46.346 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380445+0000", 2023-09-30T17:02:46.346 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4023000000000002e-05 2023-09-30T17:02:46.346 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:46.346 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:46.347 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:46.347 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:46.347 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:46.347 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:02:46.348 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:02:46.349 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:46.347+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:46.422 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-09-30T17:02:46.448 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:46.448+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:46.486 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:02:46.486 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:02:46.486 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2023-09-30T17:02:46.486 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:02:46.496 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:02:46.550 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:46.549+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:46.622 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:02:46.623 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:02:46.623 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2023-09-30T17:02:46.623 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2023-09-30T17:02:46.623 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:02:46.632 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:02:46.650 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:46.649+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:46.751 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:46.750+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:46.760 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:02:46.761 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2023-09-30T17:02:46.761 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2023-09-30T17:02:46.761 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2023-09-30T17:02:46.761 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.761 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:46.761 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:02:46.761 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 28.407682041000001, 2023-09-30T17:02:46.761 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093789779999999996, 2023-09-30T17:02:46.761 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:46.761 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:46.761 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:46.762 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.762 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:46.762 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:02:46.762 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:46.762 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.762 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.762 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:46.762 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:02:46.762 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:46.762 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.762 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.763 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:46.763 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352027+0000", 2023-09-30T17:02:46.763 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0224000000000001e-05 2023-09-30T17:02:46.763 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.763 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.763 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:46.763 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352039+0000", 2023-09-30T17:02:46.763 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1569000000000001e-05 2023-09-30T17:02:46.763 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.763 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.763 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:46.764 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352052+0000", 2023-09-30T17:02:46.764 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2605999999999999e-05 2023-09-30T17:02:46.764 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.764 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.764 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:46.764 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352064+0000", 2023-09-30T17:02:46.764 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2666999999999999e-05 2023-09-30T17:02:46.764 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.764 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.764 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:46.764 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352147+0000", 2023-09-30T17:02:46.765 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3125000000000001e-05 2023-09-30T17:02:46.765 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.765 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.765 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:46.765 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352306+0000", 2023-09-30T17:02:46.765 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015881900000000001 2023-09-30T17:02:46.765 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.765 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.765 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:46.765 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352450+0000", 2023-09-30T17:02:46.765 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014420700000000001 2023-09-30T17:02:46.765 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.766 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.766 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:46.766 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355975+0000", 2023-09-30T17:02:46.766 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003524246 2023-09-30T17:02:46.766 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.766 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.766 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:46.766 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361279+0000", 2023-09-30T17:02:46.766 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005304507 2023-09-30T17:02:46.766 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.766 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.767 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:46.767 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361344+0000", 2023-09-30T17:02:46.767 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4548999999999995e-05 2023-09-30T17:02:46.767 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.767 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.767 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:46.767 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361396+0000", 2023-09-30T17:02:46.767 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2459e-05 2023-09-30T17:02:46.767 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:46.767 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:46.767 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:46.767 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.768 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.768 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:46.768 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:02:46.768 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 28.407589749, 2023-09-30T17:02:46.768 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021233007000000002, 2023-09-30T17:02:46.768 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:46.768 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:46.768 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:46.768 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.768 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:46.768 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:02:46.768 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:46.769 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.769 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.769 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:46.769 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:02:46.769 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:46.769 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.769 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.769 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:46.769 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352110+0000", 2023-09-30T17:02:46.769 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6000000000000002e-07 2023-09-30T17:02:46.769 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.770 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.770 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:46.770 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352117+0000", 2023-09-30T17:02:46.770 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5930000000000002e-06 2023-09-30T17:02:46.770 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.770 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.770 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:46.770 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352126+0000", 2023-09-30T17:02:46.770 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0729999999999994e-06 2023-09-30T17:02:46.770 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.770 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.770 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:46.771 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352136+0000", 2023-09-30T17:02:46.771 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0380000000000001e-05 2023-09-30T17:02:46.771 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.771 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.771 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:46.771 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353279+0000", 2023-09-30T17:02:46.771 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0011424670000000001 2023-09-30T17:02:46.771 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.771 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.771 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:46.771 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353707+0000", 2023-09-30T17:02:46.771 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00042829800000000003 2023-09-30T17:02:46.772 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.772 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.772 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:46.772 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354104+0000", 2023-09-30T17:02:46.772 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00039643399999999998 2023-09-30T17:02:46.772 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.772 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.772 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:46.772 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356925+0000", 2023-09-30T17:02:46.772 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0028210900000000001 2023-09-30T17:02:46.772 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.772 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.773 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:46.773 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373243+0000", 2023-09-30T17:02:46.773 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016318461999999999 2023-09-30T17:02:46.773 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.773 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.773 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:46.773 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373301+0000", 2023-09-30T17:02:46.773 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7435000000000002e-05 2023-09-30T17:02:46.773 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.773 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.773 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:46.773 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373342+0000", 2023-09-30T17:02:46.774 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1915000000000001e-05 2023-09-30T17:02:46.774 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:46.774 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:46.774 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:46.774 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.774 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.774 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:46.774 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:02:46.774 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 28.407547137999998, 2023-09-30T17:02:46.774 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011988331, 2023-09-30T17:02:46.774 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:46.774 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:46.775 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:46.775 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.775 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:46.775 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:02:46.775 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:46.775 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.775 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.775 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:46.775 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:02:46.775 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:46.775 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.775 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.776 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:46.776 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352153+0000", 2023-09-30T17:02:46.776 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0500000000000003e-07 2023-09-30T17:02:46.776 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.776 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.776 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:46.776 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352157+0000", 2023-09-30T17:02:46.776 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9790000000000004e-06 2023-09-30T17:02:46.776 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.776 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.776 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:46.777 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352173+0000", 2023-09-30T17:02:46.777 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6535999999999999e-05 2023-09-30T17:02:46.777 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.777 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.777 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:46.777 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352180+0000", 2023-09-30T17:02:46.777 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7700000000000004e-06 2023-09-30T17:02:46.777 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.777 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.777 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:46.777 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353526+0000", 2023-09-30T17:02:46.778 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0013458330000000001 2023-09-30T17:02:46.778 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.778 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.778 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:46.778 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353648+0000", 2023-09-30T17:02:46.778 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012262899999999999 2023-09-30T17:02:46.778 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.778 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.778 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:02:46.778 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354141+0000", 2023-09-30T17:02:46.778 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00049222899999999995 2023-09-30T17:02:46.779 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.779 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.779 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:46.779 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356931+0000", 2023-09-30T17:02:46.779 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0027900860000000002 2023-09-30T17:02:46.779 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.779 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.779 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:46.779 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364066+0000", 2023-09-30T17:02:46.779 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071355050000000003 2023-09-30T17:02:46.779 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.780 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.780 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:46.780 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364103+0000", 2023-09-30T17:02:46.780 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6944999999999999e-05 2023-09-30T17:02:46.780 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.780 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.780 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:46.780 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364140+0000", 2023-09-30T17:02:46.780 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7214e-05 2023-09-30T17:02:46.780 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:46.780 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:46.780 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:46.781 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.781 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.781 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:46.781 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:02:46.781 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 28.407507906999999, 2023-09-30T17:02:46.781 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012110921, 2023-09-30T17:02:46.781 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:46.781 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:46.781 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:46.781 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.782 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:46.782 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:02:46.782 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:46.782 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.782 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.782 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:46.782 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:02:46.782 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:46.782 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.782 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.782 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:46.782 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352192+0000", 2023-09-30T17:02:46.783 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7300000000000005e-07 2023-09-30T17:02:46.783 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.783 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.783 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:46.783 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352196+0000", 2023-09-30T17:02:46.783 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2370000000000003e-06 2023-09-30T17:02:46.783 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.783 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.783 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:46.783 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352205+0000", 2023-09-30T17:02:46.783 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6659999999999997e-06 2023-09-30T17:02:46.784 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.784 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.784 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:46.784 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352214+0000", 2023-09-30T17:02:46.784 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8259999999999999e-06 2023-09-30T17:02:46.784 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.784 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.784 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:46.784 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354470+0000", 2023-09-30T17:02:46.784 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022557340000000001 2023-09-30T17:02:46.784 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.785 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.785 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:46.785 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354557+0000", 2023-09-30T17:02:46.785 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6909000000000004e-05 2023-09-30T17:02:46.785 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.785 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.785 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:02:46.785 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354694+0000", 2023-09-30T17:02:46.785 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013774800000000001 2023-09-30T17:02:46.785 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.785 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.786 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:46.786 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356937+0000", 2023-09-30T17:02:46.786 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022424540000000001 2023-09-30T17:02:46.786 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.786 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.786 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:46.786 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364227+0000", 2023-09-30T17:02:46.786 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072902430000000001 2023-09-30T17:02:46.786 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.786 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.786 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:46.786 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364278+0000", 2023-09-30T17:02:46.787 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1180999999999997e-05 2023-09-30T17:02:46.787 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.787 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.787 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:46.787 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364302+0000", 2023-09-30T17:02:46.787 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4049999999999998e-05 2023-09-30T17:02:46.787 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:46.787 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:46.787 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:46.787 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.787 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.787 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:46.788 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:02:46.788 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 28.407474568000001, 2023-09-30T17:02:46.788 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021258651999999999, 2023-09-30T17:02:46.788 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:46.788 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:46.788 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:46.788 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.788 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:46.788 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:02:46.788 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:46.788 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.789 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.789 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:46.789 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:02:46.789 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:46.789 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.789 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.789 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:46.789 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:02:46.789 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6899999999999997e-07 2023-09-30T17:02:46.789 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.789 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.789 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:46.790 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352236+0000", 2023-09-30T17:02:46.790 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0251000000000001e-05 2023-09-30T17:02:46.790 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.790 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.790 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:46.790 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352244+0000", 2023-09-30T17:02:46.790 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0770000000000008e-06 2023-09-30T17:02:46.790 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.790 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.790 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:46.790 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352251+0000", 2023-09-30T17:02:46.791 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4749999999999996e-06 2023-09-30T17:02:46.791 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.791 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.791 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:46.791 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354455+0000", 2023-09-30T17:02:46.791 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022043660000000001 2023-09-30T17:02:46.791 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.791 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.791 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:46.791 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354577+0000", 2023-09-30T17:02:46.791 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000121054 2023-09-30T17:02:46.791 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.792 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.792 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:46.792 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354723+0000", 2023-09-30T17:02:46.792 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014693900000000001 2023-09-30T17:02:46.792 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.792 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.792 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:46.792 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356941+0000", 2023-09-30T17:02:46.792 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002217199 2023-09-30T17:02:46.792 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.792 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.793 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:46.793 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373392+0000", 2023-09-30T17:02:46.793 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016451774999999998 2023-09-30T17:02:46.793 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.793 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.793 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:46.793 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373445+0000", 2023-09-30T17:02:46.793 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.308e-05 2023-09-30T17:02:46.793 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.793 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.793 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:46.793 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373483+0000", 2023-09-30T17:02:46.794 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7766999999999999e-05 2023-09-30T17:02:46.794 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:46.794 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:46.794 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:46.794 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.794 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.794 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:46.794 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:02:46.794 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 28.407438476999999, 2023-09-30T17:02:46.794 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020903497, 2023-09-30T17:02:46.794 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:46.795 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:46.795 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:46.795 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.795 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:46.795 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:02:46.795 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:46.795 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.795 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.795 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:46.795 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:02:46.795 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:46.795 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.796 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.796 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:46.796 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:02:46.796 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0800000000000004e-07 2023-09-30T17:02:46.796 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.796 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.796 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:46.796 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352266+0000", 2023-09-30T17:02:46.796 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1280000000000001e-06 2023-09-30T17:02:46.796 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.796 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.796 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:46.797 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352273+0000", 2023-09-30T17:02:46.797 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3730000000000004e-06 2023-09-30T17:02:46.797 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.797 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.797 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:46.797 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352279+0000", 2023-09-30T17:02:46.797 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7699999999999998e-06 2023-09-30T17:02:46.797 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.797 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.797 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:46.797 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352334+0000", 2023-09-30T17:02:46.797 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5547999999999997e-05 2023-09-30T17:02:46.798 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.798 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.798 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:46.798 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352435+0000", 2023-09-30T17:02:46.798 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100688 2023-09-30T17:02:46.798 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.798 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.798 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:46.798 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352585+0000", 2023-09-30T17:02:46.798 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000150068 2023-09-30T17:02:46.798 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.799 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.799 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:46.799 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354912+0000", 2023-09-30T17:02:46.799 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0023266770000000001 2023-09-30T17:02:46.799 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.799 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.799 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:46.799 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373066+0000", 2023-09-30T17:02:46.799 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018154474 2023-09-30T17:02:46.799 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.799 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.800 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:46.800 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373122+0000", 2023-09-30T17:02:46.800 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6193000000000002e-05 2023-09-30T17:02:46.800 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.800 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.800 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:46.800 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373164+0000", 2023-09-30T17:02:46.800 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1869999999999997e-05 2023-09-30T17:02:46.800 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:46.800 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:46.800 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:46.801 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.801 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.801 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:46.801 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:02:46.801 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 28.407402801, 2023-09-30T17:02:46.801 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021015097999999999, 2023-09-30T17:02:46.801 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:46.801 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:46.801 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:46.801 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.801 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:46.801 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:02:46.802 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:46.802 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.802 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.802 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:46.802 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:02:46.802 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:46.802 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.802 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.802 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:46.802 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352297+0000", 2023-09-30T17:02:46.802 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8299999999999997e-07 2023-09-30T17:02:46.803 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.803 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.803 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:46.803 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352300+0000", 2023-09-30T17:02:46.803 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7460000000000001e-06 2023-09-30T17:02:46.803 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.803 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.803 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:46.803 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352307+0000", 2023-09-30T17:02:46.803 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4959999999999999e-06 2023-09-30T17:02:46.803 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.804 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.804 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:46.804 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352314+0000", 2023-09-30T17:02:46.804 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0190000000000001e-06 2023-09-30T17:02:46.804 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.804 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.804 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:46.804 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354070+0000", 2023-09-30T17:02:46.804 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001755936 2023-09-30T17:02:46.804 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.804 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.804 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:46.805 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354221+0000", 2023-09-30T17:02:46.805 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000150884 2023-09-30T17:02:46.805 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.805 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.805 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:46.805 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373311+0000", 2023-09-30T17:02:46.805 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019090434 2023-09-30T17:02:46.805 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:46.805 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:46.806 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:46.806 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.806 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.806 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:46.806 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:02:46.806 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 28.407374082, 2023-09-30T17:02:46.806 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021255174000000002, 2023-09-30T17:02:46.806 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:46.806 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:46.806 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:46.806 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.807 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:46.807 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:02:46.807 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:46.807 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.807 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.807 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:46.807 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:02:46.807 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:46.807 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.807 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.807 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:46.808 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352326+0000", 2023-09-30T17:02:46.808 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3200000000000005e-07 2023-09-30T17:02:46.808 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.808 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.808 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:46.808 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352349+0000", 2023-09-30T17:02:46.808 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3183000000000001e-05 2023-09-30T17:02:46.808 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.808 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.808 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:46.808 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352358+0000", 2023-09-30T17:02:46.809 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5230000000000001e-06 2023-09-30T17:02:46.809 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.809 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.809 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:46.809 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352365+0000", 2023-09-30T17:02:46.809 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3260000000000001e-06 2023-09-30T17:02:46.809 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.809 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.809 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:46.809 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355450+0000", 2023-09-30T17:02:46.809 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0030854049999999998 2023-09-30T17:02:46.810 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.810 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.810 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:46.810 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355583+0000", 2023-09-30T17:02:46.810 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000133189 2023-09-30T17:02:46.810 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.810 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.810 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:46.810 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373580+0000", 2023-09-30T17:02:46.810 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017997016000000001 2023-09-30T17:02:46.810 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:46.810 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:46.811 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:46.811 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.811 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.811 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:46.811 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:02:46.811 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 28.407322658999998, 2023-09-30T17:02:46.811 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010380537, 2023-09-30T17:02:46.811 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:46.811 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:46.811 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:46.812 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.812 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:46.812 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:02:46.812 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:46.812 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.812 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.812 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:46.812 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:02:46.812 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:46.812 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.812 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.812 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:46.813 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:02:46.813 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1500000000000003e-07 2023-09-30T17:02:46.813 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.813 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:46.813 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352381+0000", 2023-09-30T17:02:46.813 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6330000000000002e-06 2023-09-30T17:02:46.813 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.813 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:46.813 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352388+0000", 2023-09-30T17:02:46.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7229999999999998e-06 2023-09-30T17:02:46.814 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.814 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.814 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:46.814 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352394+0000", 2023-09-30T17:02:46.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1789999999999996e-06 2023-09-30T17:02:46.814 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.814 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.814 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:46.814 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353259+0000", 2023-09-30T17:02:46.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000865221 2023-09-30T17:02:46.815 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.815 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.815 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:46.815 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353391+0000", 2023-09-30T17:02:46.815 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013217700000000001 2023-09-30T17:02:46.815 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.815 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.815 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:46.815 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362757+0000", 2023-09-30T17:02:46.815 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093657889999999994 2023-09-30T17:02:46.815 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:46.816 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:46.816 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:46.816 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.816 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.816 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-09-30T17:02:46.816 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:02:46.816 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 28.401022366999999, 2023-09-30T17:02:46.816 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0061813579999999996, 2023-09-30T17:02:46.816 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:46.816 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2023-09-30T17:02:46.816 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:46.816 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.817 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:46.817 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:02:46.817 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:46.817 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.817 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.817 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:46.817 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:02:46.817 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:46.817 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.817 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.817 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:46.818 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:02:46.818 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5499999999999999e-07 2023-09-30T17:02:46.818 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.818 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.818 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:46.818 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358686+0000", 2023-09-30T17:02:46.818 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9979999999999992e-06 2023-09-30T17:02:46.818 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.818 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.818 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:46.818 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358700+0000", 2023-09-30T17:02:46.818 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3635000000000001e-05 2023-09-30T17:02:46.819 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.819 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.819 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:46.819 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358714+0000", 2023-09-30T17:02:46.819 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4470999999999999e-05 2023-09-30T17:02:46.819 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.819 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.819 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:46.819 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358767+0000", 2023-09-30T17:02:46.819 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2651999999999997e-05 2023-09-30T17:02:46.819 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.820 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.820 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:46.820 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364858+0000", 2023-09-30T17:02:46.820 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060912470000000002 2023-09-30T17:02:46.820 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:46.820 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:46.820 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:46.820 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.820 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.820 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2023-09-30T17:02:46.820 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:02:46.820 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 28.398657527000001, 2023-09-30T17:02:46.821 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00036246299999999999, 2023-09-30T17:02:46.821 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:46.821 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:46.821 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:46.821 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.821 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:46.821 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:02:46.821 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:46.821 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.821 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.821 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:46.821 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:02:46.822 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:46.822 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.822 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.822 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:46.822 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:02:46.822 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3099999999999999e-07 2023-09-30T17:02:46.822 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.822 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.822 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:46.822 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361045+0000", 2023-09-30T17:02:46.823 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.49e-06 2023-09-30T17:02:46.823 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.823 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.823 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:46.823 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361056+0000", 2023-09-30T17:02:46.823 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0910000000000001e-05 2023-09-30T17:02:46.823 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.823 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.823 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:46.823 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361067+0000", 2023-09-30T17:02:46.823 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0531e-05 2023-09-30T17:02:46.823 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.824 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.824 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:46.824 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361263+0000", 2023-09-30T17:02:46.824 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000196486 2023-09-30T17:02:46.824 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.824 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.824 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:46.824 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361273+0000", 2023-09-30T17:02:46.824 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3379999999999994e-06 2023-09-30T17:02:46.824 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.824 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.825 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:46.825 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361404+0000", 2023-09-30T17:02:46.825 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013137700000000001 2023-09-30T17:02:46.825 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:46.825 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:46.825 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:46.825 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.825 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:31 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:02:46.825 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:02:46.825 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 28.397681498000001, 2023-09-30T17:02:46.825 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006676408, 2023-09-30T17:02:46.826 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:46.826 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:46.826 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:46.826 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.826 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:46.826 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:02:46.826 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:46.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.826 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.826 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:46.826 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:02:46.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:46.827 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.827 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.827 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:46.827 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:02:46.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5600000000000002e-07 2023-09-30T17:02:46.827 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.827 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.827 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:46.827 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362044+0000", 2023-09-30T17:02:46.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5987999999999999e-05 2023-09-30T17:02:46.827 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.828 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.828 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:46.828 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362051+0000", 2023-09-30T17:02:46.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2599999999999999e-06 2023-09-30T17:02:46.828 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.828 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.828 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:46.828 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362057+0000", 2023-09-30T17:02:46.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.19e-06 2023-09-30T17:02:46.828 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.829 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:46.829 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362096+0000", 2023-09-30T17:02:46.829 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8278000000000002e-05 2023-09-30T17:02:46.829 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.829 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:46.829 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362114+0000", 2023-09-30T17:02:46.829 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8808e-05 2023-09-30T17:02:46.829 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.829 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:46.830 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368658+0000", 2023-09-30T17:02:46.830 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065433540000000004 2023-09-30T17:02:46.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.830 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.830 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:46.830 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368694+0000", 2023-09-30T17:02:46.830 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6273999999999999e-05 2023-09-30T17:02:46.830 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:46.830 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:46.830 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:46.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.831 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.831 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:26 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-09-30T17:02:46.831 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:02:46.831 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 28.397590726000001, 2023-09-30T17:02:46.831 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0066596119999999996, 2023-09-30T17:02:46.831 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:46.831 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:46.831 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:46.831 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.831 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:46.831 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:02:46.832 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:46.832 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.832 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.832 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:46.832 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:02:46.832 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:46.832 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.832 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.832 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:46.832 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362109+0000", 2023-09-30T17:02:46.832 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5699999999999999e-07 2023-09-30T17:02:46.832 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.833 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.833 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:46.833 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362112+0000", 2023-09-30T17:02:46.833 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8410000000000002e-06 2023-09-30T17:02:46.833 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.833 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.833 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:46.833 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362117+0000", 2023-09-30T17:02:46.833 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.792e-06 2023-09-30T17:02:46.833 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.833 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.833 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:46.834 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362122+0000", 2023-09-30T17:02:46.834 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.763e-06 2023-09-30T17:02:46.834 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.834 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.834 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:46.834 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362344+0000", 2023-09-30T17:02:46.834 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022181600000000001 2023-09-30T17:02:46.834 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.834 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.834 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:46.834 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362357+0000", 2023-09-30T17:02:46.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2864000000000001e-05 2023-09-30T17:02:46.835 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.835 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.835 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:46.835 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368738+0000", 2023-09-30T17:02:46.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063809499999999998 2023-09-30T17:02:46.835 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.835 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.835 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:46.835 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368768+0000", 2023-09-30T17:02:46.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0429e-05 2023-09-30T17:02:46.835 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:46.836 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:46.836 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:46.836 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.836 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.836 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2023-09-30T17:02:46.836 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:02:46.836 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 28.396374559000002, 2023-09-30T17:02:46.836 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00082185400000000001, 2023-09-30T17:02:46.836 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:46.836 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:46.836 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:46.836 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.837 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:46.837 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:02:46.837 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:46.837 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.837 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.837 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:46.837 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:02:46.837 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:46.837 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.837 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.837 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:46.837 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:02:46.838 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.22e-07 2023-09-30T17:02:46.838 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.838 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.838 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:46.838 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363327+0000", 2023-09-30T17:02:46.838 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4480000000000001e-06 2023-09-30T17:02:46.838 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.838 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.838 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:46.838 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363333+0000", 2023-09-30T17:02:46.838 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9989999999999997e-06 2023-09-30T17:02:46.838 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.839 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.839 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:46.839 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363354+0000", 2023-09-30T17:02:46.839 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0547000000000002e-05 2023-09-30T17:02:46.839 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.839 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.839 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:46.839 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364057+0000", 2023-09-30T17:02:46.839 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00070306600000000002 2023-09-30T17:02:46.839 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.839 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.840 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:46.840 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364063+0000", 2023-09-30T17:02:46.840 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.694e-06 2023-09-30T17:02:46.840 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.840 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.840 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:46.840 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364146+0000", 2023-09-30T17:02:46.840 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3877999999999999e-05 2023-09-30T17:02:46.840 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:46.840 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:46.840 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:46.840 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.841 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.841 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e18/16 ondisk, result = 0)", 2023-09-30T17:02:46.841 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:02:46.841 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 28.396061027000002, 2023-09-30T17:02:46.841 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00067007199999999996, 2023-09-30T17:02:46.841 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:46.841 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:46.841 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:46.841 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.841 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:46.841 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:02:46.842 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:46.842 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.842 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.842 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:46.842 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:02:46.842 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:46.842 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.842 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.842 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:46.843 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:02:46.843 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.41e-07 2023-09-30T17:02:46.843 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.843 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.843 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:46.843 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363641+0000", 2023-09-30T17:02:46.843 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4830000000000002e-06 2023-09-30T17:02:46.843 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.843 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.843 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:46.843 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363647+0000", 2023-09-30T17:02:46.843 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4869999999999999e-06 2023-09-30T17:02:46.844 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.844 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.844 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:46.844 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363654+0000", 2023-09-30T17:02:46.844 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5889999999999999e-06 2023-09-30T17:02:46.844 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.844 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.844 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:46.844 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364217+0000", 2023-09-30T17:02:46.844 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00056263199999999998 2023-09-30T17:02:46.844 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.845 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.845 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:46.845 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364222+0000", 2023-09-30T17:02:46.845 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.242e-06 2023-09-30T17:02:46.845 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.845 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.845 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:46.845 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364308+0000", 2023-09-30T17:02:46.845 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6397999999999995e-05 2023-09-30T17:02:46.845 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:46.845 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:46.845 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:46.846 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.846 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.846 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2023-09-30T17:02:46.846 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:02:46.846 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 28.386473117000001, 2023-09-30T17:02:46.846 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000359561, 2023-09-30T17:02:46.846 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:46.846 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2023-09-30T17:02:46.846 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:46.846 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.846 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:46.847 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:02:46.847 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:46.847 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.847 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.847 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:46.847 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:02:46.847 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:46.847 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.847 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.847 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:46.847 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:02:46.847 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1e-07 2023-09-30T17:02:46.848 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.848 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.848 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:46.848 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373228+0000", 2023-09-30T17:02:46.848 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9420000000000002e-06 2023-09-30T17:02:46.848 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.848 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.848 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:46.848 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373235+0000", 2023-09-30T17:02:46.848 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4230000000000002e-06 2023-09-30T17:02:46.848 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.848 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.849 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:46.849 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373239+0000", 2023-09-30T17:02:46.849 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6809999999999997e-06 2023-09-30T17:02:46.849 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.849 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.849 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:46.849 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373518+0000", 2023-09-30T17:02:46.849 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000278311 2023-09-30T17:02:46.849 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.849 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.849 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:46.850 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373586+0000", 2023-09-30T17:02:46.850 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7994e-05 2023-09-30T17:02:46.850 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:46.850 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:46.850 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:46.850 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.850 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.850 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:02:46.850 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:02:46.850 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 28.382047044, 2023-09-30T17:02:46.850 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0046632949999999996, 2023-09-30T17:02:46.850 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:46.851 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:46.851 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:46.851 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.851 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:46.851 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:02:46.851 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:46.851 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.851 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.851 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:46.851 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:02:46.851 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:46.851 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.852 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.852 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:46.852 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377653+0000", 2023-09-30T17:02:46.852 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7800000000000002e-07 2023-09-30T17:02:46.852 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.852 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.852 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:46.852 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377657+0000", 2023-09-30T17:02:46.852 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5859999999999998e-06 2023-09-30T17:02:46.852 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.852 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.853 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:46.853 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377677+0000", 2023-09-30T17:02:46.853 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9508999999999999e-05 2023-09-30T17:02:46.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.853 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.853 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:46.853 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377682+0000", 2023-09-30T17:02:46.853 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8300000000000001e-06 2023-09-30T17:02:46.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.853 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.853 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:46.853 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377725+0000", 2023-09-30T17:02:46.854 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2425000000000001e-05 2023-09-30T17:02:46.854 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.854 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.854 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:46.854 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377738+0000", 2023-09-30T17:02:46.854 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2899e-05 2023-09-30T17:02:46.854 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.854 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.854 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:46.854 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382268+0000", 2023-09-30T17:02:46.854 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045301289999999999 2023-09-30T17:02:46.854 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.855 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.855 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:46.855 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382315+0000", 2023-09-30T17:02:46.855 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7539e-05 2023-09-30T17:02:46.855 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:46.855 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:46.855 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:46.855 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.855 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.855 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-09-30T17:02:46.855 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:02:46.856 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 28.381597592999999, 2023-09-30T17:02:46.856 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042540670000000003, 2023-09-30T17:02:46.856 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:46.856 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:46.856 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:46.856 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.856 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:46.856 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:02:46.856 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:46.856 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.856 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.856 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:46.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:02:46.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:46.857 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.857 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:46.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:02:46.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0299999999999998e-07 2023-09-30T17:02:46.857 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.857 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:46.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378107+0000", 2023-09-30T17:02:46.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9250000000000003e-06 2023-09-30T17:02:46.858 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.858 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.858 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:46.858 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378116+0000", 2023-09-30T17:02:46.858 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.037e-06 2023-09-30T17:02:46.858 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.858 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.858 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:46.858 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378123+0000", 2023-09-30T17:02:46.858 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1879999999999996e-06 2023-09-30T17:02:46.858 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.859 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.859 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:46.859 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378174+0000", 2023-09-30T17:02:46.859 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0998000000000002e-05 2023-09-30T17:02:46.859 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.859 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.859 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:46.859 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378197+0000", 2023-09-30T17:02:46.859 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2558e-05 2023-09-30T17:02:46.859 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.859 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.859 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:46.860 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382319+0000", 2023-09-30T17:02:46.860 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041220950000000001 2023-09-30T17:02:46.860 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.860 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.860 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:46.860 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382356+0000", 2023-09-30T17:02:46.860 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6563000000000002e-05 2023-09-30T17:02:46.860 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:46.860 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:46.860 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:46.860 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.860 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.860 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-09-30T17:02:46.861 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:02:46.861 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 24.323833769, 2023-09-30T17:02:46.861 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00171641, 2023-09-30T17:02:46.861 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:46.861 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:46.861 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:46.861 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.861 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:46.861 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:02:46.861 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:46.861 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.861 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.862 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:46.862 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:02:46.862 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:46.862 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.862 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.862 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:46.862 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435868+0000", 2023-09-30T17:02:46.862 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5840000000000002e-06 2023-09-30T17:02:46.862 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.862 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.862 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:46.862 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435892+0000", 2023-09-30T17:02:46.863 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3625000000000002e-05 2023-09-30T17:02:46.863 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.863 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.863 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:46.863 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435908+0000", 2023-09-30T17:02:46.863 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6548000000000001e-05 2023-09-30T17:02:46.863 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.863 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.863 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:46.863 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435935+0000", 2023-09-30T17:02:46.863 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6516000000000002e-05 2023-09-30T17:02:46.863 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.864 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:46.864 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435996+0000", 2023-09-30T17:02:46.864 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1433999999999995e-05 2023-09-30T17:02:46.864 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.864 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:46.864 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436114+0000", 2023-09-30T17:02:46.864 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000118344 2023-09-30T17:02:46.864 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.864 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:46.865 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436219+0000", 2023-09-30T17:02:46.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010453100000000001 2023-09-30T17:02:46.865 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.865 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.865 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:46.865 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436900+0000", 2023-09-30T17:02:46.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00068121299999999996 2023-09-30T17:02:46.865 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.865 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.865 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:46.865 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437508+0000", 2023-09-30T17:02:46.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00060817399999999995 2023-09-30T17:02:46.866 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.866 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.866 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:46.866 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437554+0000", 2023-09-30T17:02:46.866 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5609000000000003e-05 2023-09-30T17:02:46.866 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.866 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.866 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:46.866 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437582+0000", 2023-09-30T17:02:46.866 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7832000000000001e-05 2023-09-30T17:02:46.866 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:46.866 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:46.867 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:46.867 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.867 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.867 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2023-09-30T17:02:46.867 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:02:46.867 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.3235222750000002, 2023-09-30T17:02:46.867 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001456199, 2023-09-30T17:02:46.867 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:46.867 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:46.867 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:46.867 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.867 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:46.868 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:02:46.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:46.868 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:46.868 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:02:46.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:46.868 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:46.868 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436178+0000", 2023-09-30T17:02:46.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.494e-06 2023-09-30T17:02:46.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.869 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:46.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436184+0000", 2023-09-30T17:02:46.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2809999999999999e-06 2023-09-30T17:02:46.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.869 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:46.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436198+0000", 2023-09-30T17:02:46.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3978000000000001e-05 2023-09-30T17:02:46.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.870 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:46.870 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436206+0000", 2023-09-30T17:02:46.870 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8040000000000007e-06 2023-09-30T17:02:46.870 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.870 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:46.870 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436268+0000", 2023-09-30T17:02:46.870 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1484999999999998e-05 2023-09-30T17:02:46.870 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.870 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:46.871 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436339+0000", 2023-09-30T17:02:46.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1000000000000005e-05 2023-09-30T17:02:46.871 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.871 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.871 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:46.871 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436438+0000", 2023-09-30T17:02:46.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9389000000000007e-05 2023-09-30T17:02:46.871 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.871 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.871 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:46.871 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436986+0000", 2023-09-30T17:02:46.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054723399999999996 2023-09-30T17:02:46.872 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:46.872 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437566+0000", 2023-09-30T17:02:46.872 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00058017599999999996 2023-09-30T17:02:46.872 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:46.872 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437606+0000", 2023-09-30T17:02:46.872 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9891999999999997e-05 2023-09-30T17:02:46.872 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:46.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:46.873 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:46.873 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437633+0000", 2023-09-30T17:02:46.873 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7466000000000001e-05 2023-09-30T17:02:46.873 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:46.873 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:46.873 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:46.873 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:46.873 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:46.873 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:02:46.873 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-09-30T17:02:46.876 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:46.874+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:46.876 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:02:46.976 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:46.975+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:47.017 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:02:47.017 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:02:47.017 INFO:teuthology.orchestra.run.smithi031.stdout: "num_ops": 0 2023-09-30T17:02:47.018 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:02:47.027 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:02:47.028 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:02:47.047 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:02:47.069 INFO:teuthology.orchestra.run.smithi007.stdout:osd.2: {} 2023-09-30T17:02:47.071 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-09-30T17:02:47.071 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-09-30T17:02:47.071 INFO:teuthology.orchestra.run.smithi007.stderr:osd.2: osd_enable_op_tracker = 'false' 2023-09-30T17:02:47.076 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:47.076+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:47.160 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:47.160 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:47.170 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:02:47.211 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:47.211+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:47.264 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is unset 2023-09-30T17:02:47.278 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:47.278+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:47.319 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T17:02:47.347 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:47.348 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:47.357 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:02:47.402 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:47.401+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:47.428 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2023-09-30T17:02:47.480 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-09-30T17:02:47.480 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:47.479+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:47.488 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:47.489 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:47.499 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:02:47.581 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:47.581+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:47.665 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:47.665 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:47.675 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:02:47.681 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:47.681+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:47.782 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:47.782+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:47.801 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:47.801 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:47.811 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:02:47.883 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:47.882+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:47.947 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:47.947 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:47.958 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:02:48.001 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:48.001+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:48.084 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:48.083+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:48.089 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:48.089 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:48.100 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:02:48.185 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:48.184+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:48.275 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:48.275 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:48.286 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:02:48.286 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:48.285+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:48.386 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:48.385+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:48.418 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:48.418 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:48.428 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:02:48.486 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:48.486+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:48.587 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:48.586+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:48.595 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:48.595 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:48.605 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:02:48.690 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:48.689+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:48.772 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:48.773 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:48.783 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:02:48.826 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:48.826+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:48.889 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:48.888+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:48.919 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:48.919 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:48.929 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:02:48.990 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:48.990+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:49.083 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-09-30T17:02:49.091 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:49.091+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:49.101 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:49.102 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:49.112 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:02:49.192 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:49.191+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:49.234 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:02:49.257 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:02:49.257 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-09-30T17:02:49.257 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-09-30T17:02:49.257 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:02:49.261 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:02:49.261 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:02:49.276 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-09-30T17:02:49.287 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:02:49.287 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 20, 2023-09-30T17:02:49.287 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 600, 2023-09-30T17:02:49.287 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:02:49.287 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.287 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:32 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'18, mlcod=11'14)", 2023-09-30T17:02:49.287 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:02:49.287 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 41.924418867999997, 2023-09-30T17:02:49.288 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051629809999999996, 2023-09-30T17:02:49.288 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:49.288 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:49.288 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:49.288 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.288 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:49.288 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:02:49.288 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:49.288 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.288 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.288 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:49.289 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:02:49.289 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:49.289 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.289 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.289 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:49.289 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:02:49.289 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2099999999999996e-07 2023-09-30T17:02:49.289 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.289 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.289 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:49.289 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361407+0000", 2023-09-30T17:02:49.290 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7499e-05 2023-09-30T17:02:49.290 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.290 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.290 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:49.290 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361418+0000", 2023-09-30T17:02:49.290 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1127999999999999e-05 2023-09-30T17:02:49.290 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.290 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.290 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:49.290 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361423+0000", 2023-09-30T17:02:49.290 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1930000000000001e-06 2023-09-30T17:02:49.291 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.291 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.291 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:49.291 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361476+0000", 2023-09-30T17:02:49.291 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3399000000000002e-05 2023-09-30T17:02:49.291 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.291 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.291 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:49.291 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361496+0000", 2023-09-30T17:02:49.291 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9638000000000001e-05 2023-09-30T17:02:49.291 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.291 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.292 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:49.292 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.366474+0000", 2023-09-30T17:02:49.292 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0049778829999999998 2023-09-30T17:02:49.292 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.292 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.292 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:49.292 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.366512+0000", 2023-09-30T17:02:49.292 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7620000000000002e-05 2023-09-30T17:02:49.292 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:49.292 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:49.292 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:49.293 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.293 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.293 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:37 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'23, mlcod=11'15)", 2023-09-30T17:02:49.293 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:02:49.293 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 41.921816870999997, 2023-09-30T17:02:49.293 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053985689999999998, 2023-09-30T17:02:49.293 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:49.293 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:49.293 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:49.293 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.293 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:49.293 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:02:49.294 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:49.294 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.294 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.294 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:49.294 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:02:49.294 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:49.294 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.294 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.294 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:49.294 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:02:49.294 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4400000000000001e-07 2023-09-30T17:02:49.295 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.295 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.295 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:49.295 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363956+0000", 2023-09-30T17:02:49.295 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.921e-06 2023-09-30T17:02:49.295 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.295 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.295 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:49.295 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363966+0000", 2023-09-30T17:02:49.295 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0351e-05 2023-09-30T17:02:49.295 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.296 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.296 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:49.296 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363971+0000", 2023-09-30T17:02:49.296 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.023e-06 2023-09-30T17:02:49.296 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.296 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.296 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:49.296 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.364013+0000", 2023-09-30T17:02:49.296 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1575000000000001e-05 2023-09-30T17:02:49.296 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.296 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.296 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:49.297 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.364026+0000", 2023-09-30T17:02:49.297 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3044000000000001e-05 2023-09-30T17:02:49.297 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.297 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.297 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:49.297 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.369308+0000", 2023-09-30T17:02:49.297 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005282152 2023-09-30T17:02:49.297 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.297 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.297 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:49.297 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.369349+0000", 2023-09-30T17:02:49.297 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1059000000000001e-05 2023-09-30T17:02:49.298 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:49.298 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:49.298 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:49.298 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.298 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.298 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:155 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'109, mlcod=11'105)", 2023-09-30T17:02:49.298 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:02:49.298 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 41.440121185000002, 2023-09-30T17:02:49.298 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053867639999999996, 2023-09-30T17:02:49.298 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:49.298 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:49.299 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:49.299 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.299 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:49.299 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:02:49.299 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:49.299 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.299 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.299 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:49.299 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:02:49.299 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:49.299 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.300 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.300 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:49.300 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845647+0000", 2023-09-30T17:02:49.300 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7599999999999997e-07 2023-09-30T17:02:49.300 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.300 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.300 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:49.300 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845699+0000", 2023-09-30T17:02:49.300 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1758000000000001e-05 2023-09-30T17:02:49.300 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.300 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.301 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:49.301 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845708+0000", 2023-09-30T17:02:49.301 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2159999999999995e-06 2023-09-30T17:02:49.301 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.301 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.301 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:49.301 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845712+0000", 2023-09-30T17:02:49.301 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2579999999999997e-06 2023-09-30T17:02:49.301 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.301 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.301 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:49.301 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845756+0000", 2023-09-30T17:02:49.302 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4119999999999998e-05 2023-09-30T17:02:49.302 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.302 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.302 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:49.302 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845779+0000", 2023-09-30T17:02:49.302 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2311e-05 2023-09-30T17:02:49.302 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.302 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.302 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:49.302 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.850982+0000", 2023-09-30T17:02:49.302 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005203053 2023-09-30T17:02:49.303 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.303 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.303 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:49.303 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851033+0000", 2023-09-30T17:02:49.303 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1471999999999998e-05 2023-09-30T17:02:49.303 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:49.303 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:49.303 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:49.303 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.303 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.303 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:156 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'110, mlcod=11'105)", 2023-09-30T17:02:49.303 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:02:49.304 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 41.439588258999997, 2023-09-30T17:02:49.304 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0052834759999999996, 2023-09-30T17:02:49.304 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:49.304 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:49.304 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:49.304 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.304 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:49.304 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:02:49.304 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:49.304 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.304 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.304 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:49.305 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:02:49.305 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:49.305 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.305 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.305 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:49.305 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846180+0000", 2023-09-30T17:02:49.305 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6300000000000005e-07 2023-09-30T17:02:49.305 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.305 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.305 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:49.305 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846184+0000", 2023-09-30T17:02:49.306 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3789999999999999e-06 2023-09-30T17:02:49.306 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.306 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.306 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:49.306 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846195+0000", 2023-09-30T17:02:49.306 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0778000000000001e-05 2023-09-30T17:02:49.306 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.306 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.306 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:49.306 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846200+0000", 2023-09-30T17:02:49.306 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1540000000000001e-06 2023-09-30T17:02:49.307 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.307 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.307 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:49.307 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846274+0000", 2023-09-30T17:02:49.307 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4129999999999997e-05 2023-09-30T17:02:49.307 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.307 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.307 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:49.307 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846286+0000", 2023-09-30T17:02:49.307 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1744e-05 2023-09-30T17:02:49.307 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.307 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.308 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:49.308 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851432+0000", 2023-09-30T17:02:49.308 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051462110000000004 2023-09-30T17:02:49.308 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.308 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.308 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:49.308 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851463+0000", 2023-09-30T17:02:49.308 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0516999999999999e-05 2023-09-30T17:02:49.308 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:49.308 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:49.308 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:49.308 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.309 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.309 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:203 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'149, mlcod=11'145)", 2023-09-30T17:02:49.309 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:02:49.309 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 41.083552349999998, 2023-09-30T17:02:49.309 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051867459999999999, 2023-09-30T17:02:49.309 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:49.309 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:49.309 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:49.309 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.309 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:49.309 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:02:49.309 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:49.310 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.310 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.310 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:49.310 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:02:49.310 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:49.310 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.310 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.310 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:49.310 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202216+0000", 2023-09-30T17:02:49.310 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7e-07 2023-09-30T17:02:49.310 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.311 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.311 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:49.311 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202271+0000", 2023-09-30T17:02:49.311 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5163e-05 2023-09-30T17:02:49.311 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.311 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.311 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:49.311 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202282+0000", 2023-09-30T17:02:49.311 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1319e-05 2023-09-30T17:02:49.311 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.311 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.312 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:49.312 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202288+0000", 2023-09-30T17:02:49.312 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2899999999999999e-06 2023-09-30T17:02:49.312 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.312 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.312 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:49.312 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202331+0000", 2023-09-30T17:02:49.312 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2147999999999997e-05 2023-09-30T17:02:49.312 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.312 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.312 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:49.312 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202348+0000", 2023-09-30T17:02:49.313 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7317e-05 2023-09-30T17:02:49.313 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.313 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.313 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:49.313 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.207357+0000", 2023-09-30T17:02:49.313 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0050095440000000003 2023-09-30T17:02:49.313 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.313 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.313 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:49.313 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.207402+0000", 2023-09-30T17:02:49.313 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4495e-05 2023-09-30T17:02:49.314 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:49.314 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:49.314 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:49.314 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.314 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.314 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:49.314 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:02:49.314 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 30.934222062, 2023-09-30T17:02:49.314 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.025313649000000001, 2023-09-30T17:02:49.314 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:49.314 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:49.315 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:49.315 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.315 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:49.315 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:02:49.315 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:49.315 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.315 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.315 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:49.315 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:02:49.315 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:49.315 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.315 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.316 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:49.316 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351551+0000", 2023-09-30T17:02:49.316 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3380000000000004e-06 2023-09-30T17:02:49.316 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.316 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.316 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:49.316 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351559+0000", 2023-09-30T17:02:49.316 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9589999999999995e-06 2023-09-30T17:02:49.316 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.316 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.316 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:49.316 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351571+0000", 2023-09-30T17:02:49.317 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2065999999999999e-05 2023-09-30T17:02:49.317 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.317 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.317 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:49.317 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351706+0000", 2023-09-30T17:02:49.317 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00013553799999999999 2023-09-30T17:02:49.317 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.317 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.317 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:49.317 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353016+0000", 2023-09-30T17:02:49.317 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0013099209999999999 2023-09-30T17:02:49.317 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.318 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.318 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:02:49.318 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353023+0000", 2023-09-30T17:02:49.318 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2479999999999999e-06 2023-09-30T17:02:49.318 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.318 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.318 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:49.318 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360348+0000", 2023-09-30T17:02:49.318 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0073248949999999997 2023-09-30T17:02:49.318 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.318 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.319 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:49.319 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360787+0000", 2023-09-30T17:02:49.319 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00043875199999999999 2023-09-30T17:02:49.319 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.319 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.319 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:49.319 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360892+0000", 2023-09-30T17:02:49.319 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010508199999999999 2023-09-30T17:02:49.319 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.319 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.319 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:02:49.319 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365132+0000", 2023-09-30T17:02:49.320 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0042396480000000004 2023-09-30T17:02:49.320 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.320 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.320 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:49.320 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376746+0000", 2023-09-30T17:02:49.320 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011614157 2023-09-30T17:02:49.320 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.320 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.320 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:49.320 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376811+0000", 2023-09-30T17:02:49.320 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5005999999999994e-05 2023-09-30T17:02:49.320 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.321 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.321 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:49.321 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376859+0000", 2023-09-30T17:02:49.321 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8038999999999999e-05 2023-09-30T17:02:49.321 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:49.321 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:49.321 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:49.321 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.321 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.321 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:49.321 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:02:49.322 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 30.933724262999998, 2023-09-30T17:02:49.322 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024923989000000001, 2023-09-30T17:02:49.322 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:49.322 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:49.322 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:49.322 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.322 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:49.322 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:02:49.322 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:49.322 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.322 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.323 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:49.323 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:02:49.323 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:49.323 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.323 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.323 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:49.323 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352044+0000", 2023-09-30T17:02:49.323 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9199999999999999e-07 2023-09-30T17:02:49.323 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.323 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.323 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:49.323 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352050+0000", 2023-09-30T17:02:49.324 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8880000000000002e-06 2023-09-30T17:02:49.324 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.324 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.324 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:49.324 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352143+0000", 2023-09-30T17:02:49.324 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2721999999999998e-05 2023-09-30T17:02:49.324 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.324 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.324 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:49.324 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352155+0000", 2023-09-30T17:02:49.324 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2279000000000001e-05 2023-09-30T17:02:49.325 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.325 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.325 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:49.325 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353114+0000", 2023-09-30T17:02:49.325 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00095943700000000005 2023-09-30T17:02:49.325 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.325 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.325 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:49.325 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353121+0000", 2023-09-30T17:02:49.325 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.494e-06 2023-09-30T17:02:49.325 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.325 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.326 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:49.326 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361491+0000", 2023-09-30T17:02:49.326 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0083697359999999991 2023-09-30T17:02:49.326 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.326 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.326 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:49.326 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361573+0000", 2023-09-30T17:02:49.326 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2822000000000001e-05 2023-09-30T17:02:49.326 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.326 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.326 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:49.327 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362166+0000", 2023-09-30T17:02:49.327 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00059223299999999995 2023-09-30T17:02:49.327 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.327 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.327 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:02:49.327 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365209+0000", 2023-09-30T17:02:49.327 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.003043212 2023-09-30T17:02:49.327 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.327 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.327 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:49.327 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376910+0000", 2023-09-30T17:02:49.328 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011700898 2023-09-30T17:02:49.328 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.328 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.328 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:49.328 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376945+0000", 2023-09-30T17:02:49.328 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4795000000000001e-05 2023-09-30T17:02:49.328 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.328 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.328 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:49.328 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376967+0000", 2023-09-30T17:02:49.328 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2580999999999999e-05 2023-09-30T17:02:49.328 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:49.329 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:49.329 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:49.329 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.329 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.329 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:49.329 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:02:49.329 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 30.933554343000001, 2023-09-30T17:02:49.329 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023120405, 2023-09-30T17:02:49.329 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:49.329 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:49.329 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:49.329 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.330 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:49.330 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:02:49.330 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:49.330 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.330 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.330 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:49.330 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:02:49.330 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:49.330 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.330 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.331 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:49.331 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352214+0000", 2023-09-30T17:02:49.331 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8400000000000003e-07 2023-09-30T17:02:49.331 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.331 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.331 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:49.331 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352233+0000", 2023-09-30T17:02:49.331 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8946000000000001e-05 2023-09-30T17:02:49.331 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.331 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.331 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:49.331 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352297+0000", 2023-09-30T17:02:49.332 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3540999999999994e-05 2023-09-30T17:02:49.332 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.332 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.332 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:49.332 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352450+0000", 2023-09-30T17:02:49.332 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015364799999999999 2023-09-30T17:02:49.332 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.332 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.332 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:49.332 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353098+0000", 2023-09-30T17:02:49.332 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00064820299999999997 2023-09-30T17:02:49.333 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.333 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.333 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:02:49.333 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353103+0000", 2023-09-30T17:02:49.333 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0529999999999997e-06 2023-09-30T17:02:49.333 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.333 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.333 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:49.333 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.358558+0000", 2023-09-30T17:02:49.333 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0054550249999999996 2023-09-30T17:02:49.333 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.334 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.334 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:49.334 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.358741+0000", 2023-09-30T17:02:49.334 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00018210200000000001 2023-09-30T17:02:49.334 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.334 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.334 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:49.334 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.359683+0000", 2023-09-30T17:02:49.334 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00094202299999999995 2023-09-30T17:02:49.334 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.334 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.334 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:02:49.335 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365044+0000", 2023-09-30T17:02:49.335 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053616219999999999 2023-09-30T17:02:49.335 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.335 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.335 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:49.335 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375256+0000", 2023-09-30T17:02:49.335 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010212156 2023-09-30T17:02:49.335 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.335 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.335 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:49.335 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375300+0000", 2023-09-30T17:02:49.336 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3961999999999997e-05 2023-09-30T17:02:49.336 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.336 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.336 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:49.336 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375334+0000", 2023-09-30T17:02:49.336 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.324e-05 2023-09-30T17:02:49.336 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:49.336 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:49.336 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:49.336 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.336 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.337 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:49.337 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:02:49.337 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 30.933239324999999, 2023-09-30T17:02:49.337 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024240660000000001, 2023-09-30T17:02:49.337 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:49.337 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:49.337 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:49.337 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.337 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:49.337 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:02:49.337 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:49.337 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.338 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.338 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:49.338 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:02:49.338 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:49.338 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.338 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.338 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:49.338 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352529+0000", 2023-09-30T17:02:49.338 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1379999999999999e-06 2023-09-30T17:02:49.338 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.339 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.339 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:49.339 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352536+0000", 2023-09-30T17:02:49.339 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3489999999999997e-06 2023-09-30T17:02:49.339 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.339 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.339 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:49.339 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352547+0000", 2023-09-30T17:02:49.339 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1109e-05 2023-09-30T17:02:49.339 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.339 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.340 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:49.340 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352560+0000", 2023-09-30T17:02:49.340 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3046e-05 2023-09-30T17:02:49.340 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.340 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.340 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:49.340 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353142+0000", 2023-09-30T17:02:49.340 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00058174699999999997 2023-09-30T17:02:49.340 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.340 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.340 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:49.341 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353147+0000", 2023-09-30T17:02:49.341 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5840000000000002e-06 2023-09-30T17:02:49.341 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.341 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.341 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:49.341 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360374+0000", 2023-09-30T17:02:49.341 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0072270049999999999 2023-09-30T17:02:49.341 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.341 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.341 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:49.341 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360795+0000", 2023-09-30T17:02:49.342 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00042088999999999999 2023-09-30T17:02:49.342 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.342 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.342 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:49.342 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360967+0000", 2023-09-30T17:02:49.342 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017235699999999999 2023-09-30T17:02:49.342 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.342 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.342 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:02:49.342 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365051+0000", 2023-09-30T17:02:49.342 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0040837429999999999 2023-09-30T17:02:49.343 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.343 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.343 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:49.343 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376708+0000", 2023-09-30T17:02:49.343 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011656866 2023-09-30T17:02:49.343 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.343 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.343 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:49.343 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376745+0000", 2023-09-30T17:02:49.343 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6769e-05 2023-09-30T17:02:49.343 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.344 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.344 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:49.344 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376769+0000", 2023-09-30T17:02:49.344 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4057e-05 2023-09-30T17:02:49.344 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:49.344 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:49.344 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:49.344 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.344 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.344 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:49.344 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:02:49.344 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 30.932979970000002, 2023-09-30T17:02:49.345 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023472704, 2023-09-30T17:02:49.345 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:49.345 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:49.345 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:49.345 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.345 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:49.345 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:02:49.345 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:49.345 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.345 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.345 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:49.346 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:02:49.346 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:49.346 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.346 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.346 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:49.346 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:02:49.346 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8000000000000005e-07 2023-09-30T17:02:49.346 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.346 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.346 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:49.346 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352794+0000", 2023-09-30T17:02:49.346 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.789e-06 2023-09-30T17:02:49.347 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.347 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.347 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:49.347 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352805+0000", 2023-09-30T17:02:49.347 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0848e-05 2023-09-30T17:02:49.347 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.347 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.347 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:49.347 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352812+0000", 2023-09-30T17:02:49.347 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4449999999999999e-06 2023-09-30T17:02:49.347 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.348 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.348 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:49.348 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353063+0000", 2023-09-30T17:02:49.348 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00025046299999999998 2023-09-30T17:02:49.348 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.348 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.348 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:02:49.348 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353071+0000", 2023-09-30T17:02:49.348 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6739999999999997e-06 2023-09-30T17:02:49.348 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.348 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.348 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:49.349 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361696+0000", 2023-09-30T17:02:49.349 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0086251609999999992 2023-09-30T17:02:49.349 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.349 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.349 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:49.349 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362284+0000", 2023-09-30T17:02:49.349 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00058872299999999998 2023-09-30T17:02:49.349 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.349 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.349 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:49.349 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362429+0000", 2023-09-30T17:02:49.350 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014509000000000001 2023-09-30T17:02:49.350 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.350 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.350 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:02:49.350 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365330+0000", 2023-09-30T17:02:49.350 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0029005419999999999 2023-09-30T17:02:49.350 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.350 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.350 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:49.350 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376196+0000", 2023-09-30T17:02:49.350 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.01086615 2023-09-30T17:02:49.350 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.351 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.351 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:49.351 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376230+0000", 2023-09-30T17:02:49.351 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3858e-05 2023-09-30T17:02:49.351 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.351 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.351 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:49.351 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376260+0000", 2023-09-30T17:02:49.351 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0181000000000001e-05 2023-09-30T17:02:49.351 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:49.351 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:49.351 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:49.352 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.352 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.352 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:49.352 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:02:49.352 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 30.932746399999999, 2023-09-30T17:02:49.352 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023406132999999999, 2023-09-30T17:02:49.352 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:49.352 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:49.352 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:49.352 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.352 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:49.353 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:02:49.353 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:49.353 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.353 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.353 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:49.353 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:02:49.353 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:49.353 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.353 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.353 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:49.353 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353022+0000", 2023-09-30T17:02:49.353 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.78e-07 2023-09-30T17:02:49.354 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.354 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.354 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:49.354 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353027+0000", 2023-09-30T17:02:49.354 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9089999999999999e-06 2023-09-30T17:02:49.354 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.354 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.354 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:49.354 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353035+0000", 2023-09-30T17:02:49.354 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0430000000000008e-06 2023-09-30T17:02:49.354 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.355 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.355 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:49.355 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353047+0000", 2023-09-30T17:02:49.355 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1674e-05 2023-09-30T17:02:49.355 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.355 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.355 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:49.355 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353105+0000", 2023-09-30T17:02:49.355 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8891999999999998e-05 2023-09-30T17:02:49.355 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.357 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.357 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:49.357 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353112+0000", 2023-09-30T17:02:49.357 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7059999999999998e-06 2023-09-30T17:02:49.357 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.357 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.358 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:49.358 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362733+0000", 2023-09-30T17:02:49.358 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0096205869999999999 2023-09-30T17:02:49.358 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.358 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.358 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:49.358 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362833+0000", 2023-09-30T17:02:49.358 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000100227 2023-09-30T17:02:49.358 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.358 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.359 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:49.359 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363000+0000", 2023-09-30T17:02:49.359 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016670899999999999 2023-09-30T17:02:49.359 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.359 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.359 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:02:49.359 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365550+0000", 2023-09-30T17:02:49.359 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0025499199999999998 2023-09-30T17:02:49.359 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.359 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.359 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:49.359 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376315+0000", 2023-09-30T17:02:49.360 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010765011999999999 2023-09-30T17:02:49.360 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.360 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.360 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:49.360 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376386+0000", 2023-09-30T17:02:49.360 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0866999999999998e-05 2023-09-30T17:02:49.360 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.360 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.360 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:49.360 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376427+0000", 2023-09-30T17:02:49.360 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1709000000000003e-05 2023-09-30T17:02:49.361 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:49.361 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:49.361 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:49.361 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.361 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.361 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:49.361 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:02:49.361 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 30.932705764000001, 2023-09-30T17:02:49.361 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024076238, 2023-09-30T17:02:49.361 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:49.361 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:49.362 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:49.362 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.362 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:49.362 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:02:49.362 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:49.362 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.362 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.362 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:49.362 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:02:49.362 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:49.362 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.363 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.363 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:49.363 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:02:49.363 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8699999999999995e-07 2023-09-30T17:02:49.363 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.363 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.363 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:49.363 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353067+0000", 2023-09-30T17:02:49.363 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.605e-06 2023-09-30T17:02:49.363 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.363 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.363 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:49.364 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353073+0000", 2023-09-30T17:02:49.364 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8900000000000004e-06 2023-09-30T17:02:49.364 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.364 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.364 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:49.364 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353083+0000", 2023-09-30T17:02:49.364 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0200000000000001e-05 2023-09-30T17:02:49.364 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.364 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.364 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:49.364 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353186+0000", 2023-09-30T17:02:49.364 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010256599999999999 2023-09-30T17:02:49.364 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.365 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.365 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:49.365 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353190+0000", 2023-09-30T17:02:49.365 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9709999999999998e-06 2023-09-30T17:02:49.365 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.365 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.365 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:49.365 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362946+0000", 2023-09-30T17:02:49.365 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0097563330000000007 2023-09-30T17:02:49.365 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.365 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.366 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:49.366 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363088+0000", 2023-09-30T17:02:49.366 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014259200000000001 2023-09-30T17:02:49.366 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.366 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.366 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:49.366 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363555+0000", 2023-09-30T17:02:49.366 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00046627799999999998 2023-09-30T17:02:49.366 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.366 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.366 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:02:49.367 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365871+0000", 2023-09-30T17:02:49.367 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0023167589999999998 2023-09-30T17:02:49.367 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.367 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.367 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:49.367 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377033+0000", 2023-09-30T17:02:49.367 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011161203999999999 2023-09-30T17:02:49.367 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.367 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.367 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:49.367 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377100+0000", 2023-09-30T17:02:49.367 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7230999999999994e-05 2023-09-30T17:02:49.368 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.368 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.368 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:49.368 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377138+0000", 2023-09-30T17:02:49.368 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8022000000000003e-05 2023-09-30T17:02:49.368 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:49.368 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:49.368 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:49.368 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.368 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.368 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:49.369 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:02:49.369 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 30.932604815000001, 2023-09-30T17:02:49.369 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.020304412000000001, 2023-09-30T17:02:49.369 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:49.369 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:02:49.369 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:49.369 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.369 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:49.369 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:02:49.369 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:49.369 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.369 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.370 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:49.370 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:02:49.370 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:49.370 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.370 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.370 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:49.370 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353164+0000", 2023-09-30T17:02:49.370 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7100000000000011e-07 2023-09-30T17:02:49.370 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.370 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.370 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:49.371 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353168+0000", 2023-09-30T17:02:49.371 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0600000000000001e-06 2023-09-30T17:02:49.371 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.371 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.371 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:49.371 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353177+0000", 2023-09-30T17:02:49.371 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1409999999999994e-06 2023-09-30T17:02:49.371 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.371 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.371 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:49.371 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353185+0000", 2023-09-30T17:02:49.371 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2479999999999996e-06 2023-09-30T17:02:49.372 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.372 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.372 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:49.372 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353246+0000", 2023-09-30T17:02:49.372 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0519000000000001e-05 2023-09-30T17:02:49.372 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.372 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.372 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:02:49.372 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353252+0000", 2023-09-30T17:02:49.372 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7859999999999999e-06 2023-09-30T17:02:49.372 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.372 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.373 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:49.373 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354979+0000", 2023-09-30T17:02:49.373 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0017270090000000001 2023-09-30T17:02:49.373 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.373 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.373 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:49.373 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355097+0000", 2023-09-30T17:02:49.373 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000117472 2023-09-30T17:02:49.373 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.373 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.373 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:49.374 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.373467+0000", 2023-09-30T17:02:49.374 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.018370206 2023-09-30T17:02:49.374 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:49.374 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:49.374 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:49.374 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.374 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.374 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:49.374 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:02:49.374 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 30.932564076999999, 2023-09-30T17:02:49.374 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.012725089, 2023-09-30T17:02:49.375 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:49.375 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:02:49.375 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:49.375 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.375 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:49.375 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:02:49.375 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:49.375 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.375 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.375 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:49.375 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:02:49.375 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:49.376 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.376 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.376 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:49.376 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353204+0000", 2023-09-30T17:02:49.376 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7100000000000002e-07 2023-09-30T17:02:49.376 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.376 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.376 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:49.376 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353213+0000", 2023-09-30T17:02:49.376 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8580000000000006e-06 2023-09-30T17:02:49.376 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.376 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.377 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:49.377 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353219+0000", 2023-09-30T17:02:49.377 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8939999999999998e-06 2023-09-30T17:02:49.377 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.377 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.377 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:49.377 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353223+0000", 2023-09-30T17:02:49.377 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.357e-06 2023-09-30T17:02:49.377 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.377 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.377 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:49.378 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353278+0000", 2023-09-30T17:02:49.378 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5228e-05 2023-09-30T17:02:49.378 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.378 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.378 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:02:49.378 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353284+0000", 2023-09-30T17:02:49.378 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8209999999999998e-06 2023-09-30T17:02:49.378 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.378 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.378 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:49.378 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355095+0000", 2023-09-30T17:02:49.379 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001811404 2023-09-30T17:02:49.379 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.379 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.379 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:49.379 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355256+0000", 2023-09-30T17:02:49.379 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000160898 2023-09-30T17:02:49.379 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.379 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.379 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:49.379 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365928+0000", 2023-09-30T17:02:49.379 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010672157999999999 2023-09-30T17:02:49.379 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:49.380 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:49.380 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:49.380 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.380 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.380 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-09-30T17:02:49.380 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:02:49.380 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 30.93203287, 2023-09-30T17:02:49.380 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0056863460000000001, 2023-09-30T17:02:49.380 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:49.380 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "reached pg", 2023-09-30T17:02:49.380 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:49.380 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.381 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:49.381 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:02:49.381 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:49.381 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.381 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.381 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:49.381 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:02:49.381 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:49.381 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.381 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.381 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:49.381 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:02:49.382 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5700000000000002e-07 2023-09-30T17:02:49.382 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.382 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.382 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:49.382 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353747+0000", 2023-09-30T17:02:49.382 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1899000000000001e-05 2023-09-30T17:02:49.382 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.382 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.382 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:49.382 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353776+0000", 2023-09-30T17:02:49.382 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.8767000000000001e-05 2023-09-30T17:02:49.383 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.383 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.383 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:49.383 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353792+0000", 2023-09-30T17:02:49.383 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5914999999999999e-05 2023-09-30T17:02:49.383 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.383 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.383 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:49.383 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353900+0000", 2023-09-30T17:02:49.383 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010774500000000001 2023-09-30T17:02:49.383 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.383 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.384 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:49.384 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.359421+0000", 2023-09-30T17:02:49.384 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0055213629999999996 2023-09-30T17:02:49.384 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:49.384 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:49.384 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:49.384 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.384 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.384 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:02:49.384 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:02:49.384 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 30.93136127, 2023-09-30T17:02:49.384 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0069196370000000002, 2023-09-30T17:02:49.385 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:49.385 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:49.385 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:49.385 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.385 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:49.385 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:02:49.385 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:49.385 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.385 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.385 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:49.385 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:02:49.386 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:49.386 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.386 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.386 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:49.386 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354407+0000", 2023-09-30T17:02:49.386 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7400000000000002e-07 2023-09-30T17:02:49.386 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.386 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.386 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:49.386 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354414+0000", 2023-09-30T17:02:49.386 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1040000000000001e-06 2023-09-30T17:02:49.387 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.387 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.387 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:49.387 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354425+0000", 2023-09-30T17:02:49.387 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1090000000000001e-05 2023-09-30T17:02:49.387 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.387 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.387 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:49.387 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354435+0000", 2023-09-30T17:02:49.387 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8169999999999994e-06 2023-09-30T17:02:49.387 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.387 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.388 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:49.388 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355741+0000", 2023-09-30T17:02:49.388 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0013063160000000001 2023-09-30T17:02:49.388 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.388 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.388 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:49.388 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355763+0000", 2023-09-30T17:02:49.388 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1688e-05 2023-09-30T17:02:49.388 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.388 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.388 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:49.389 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361289+0000", 2023-09-30T17:02:49.389 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0055258269999999996 2023-09-30T17:02:49.389 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.389 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.389 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:49.389 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361326+0000", 2023-09-30T17:02:49.389 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7020999999999997e-05 2023-09-30T17:02:49.389 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:49.389 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:49.389 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:49.389 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.390 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.390 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:30 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2023-09-30T17:02:49.390 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:02:49.390 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 30.929987312000002, 2023-09-30T17:02:49.390 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0069996629999999997, 2023-09-30T17:02:49.390 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:49.390 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:49.390 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:49.390 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.390 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:49.390 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:02:49.390 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:49.391 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.391 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.391 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:49.391 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:02:49.391 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:49.391 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.391 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.391 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:49.391 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355781+0000", 2023-09-30T17:02:49.391 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9599999999999999e-07 2023-09-30T17:02:49.391 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.392 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.392 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:49.392 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355788+0000", 2023-09-30T17:02:49.392 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8129999999999996e-06 2023-09-30T17:02:49.392 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.392 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.392 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:49.392 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355798+0000", 2023-09-30T17:02:49.392 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2909999999999996e-06 2023-09-30T17:02:49.392 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.392 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.393 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:49.393 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355807+0000", 2023-09-30T17:02:49.393 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8619999999999992e-06 2023-09-30T17:02:49.393 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.393 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.393 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:49.393 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.357264+0000", 2023-09-30T17:02:49.393 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0014578289999999999 2023-09-30T17:02:49.393 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.393 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.393 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:49.394 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.357916+0000", 2023-09-30T17:02:49.394 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00065170500000000004 2023-09-30T17:02:49.394 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.394 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.394 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:49.394 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362731+0000", 2023-09-30T17:02:49.394 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0048149849999999999 2023-09-30T17:02:49.394 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.394 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.394 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:49.394 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362780+0000", 2023-09-30T17:02:49.395 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8681999999999999e-05 2023-09-30T17:02:49.395 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:49.395 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:49.395 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:49.395 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.395 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.395 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2023-09-30T17:02:49.395 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:02:49.395 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 30.911336260999999, 2023-09-30T17:02:49.395 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005905998, 2023-09-30T17:02:49.395 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:49.395 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:49.396 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:49.396 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.396 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:49.396 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:02:49.396 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:49.396 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.396 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.396 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:49.396 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:02:49.396 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:49.396 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.397 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.397 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:49.397 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:02:49.397 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1e-07 2023-09-30T17:02:49.397 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.397 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.397 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:49.397 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374455+0000", 2023-09-30T17:02:49.397 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.3091999999999998e-05 2023-09-30T17:02:49.397 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.397 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.398 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:49.398 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374462+0000", 2023-09-30T17:02:49.398 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5170000000000002e-06 2023-09-30T17:02:49.398 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.398 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.398 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:49.398 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374469+0000", 2023-09-30T17:02:49.398 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8199999999999999e-06 2023-09-30T17:02:49.398 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.398 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.398 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:49.399 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374550+0000", 2023-09-30T17:02:49.399 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0978999999999998e-05 2023-09-30T17:02:49.399 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.399 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.399 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:49.399 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374562+0000", 2023-09-30T17:02:49.399 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2472e-05 2023-09-30T17:02:49.399 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.399 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.399 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:49.399 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380293+0000", 2023-09-30T17:02:49.399 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0057310379999999999 2023-09-30T17:02:49.400 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.400 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.400 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:49.400 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380337+0000", 2023-09-30T17:02:49.400 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3869999999999998e-05 2023-09-30T17:02:49.400 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:49.400 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:49.400 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:49.400 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.400 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.400 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2023-09-30T17:02:49.400 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:02:49.401 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 30.911149512000001, 2023-09-30T17:02:49.401 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0057590560000000002, 2023-09-30T17:02:49.401 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:49.401 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:49.401 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:49.401 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.401 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:49.401 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:02:49.401 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:49.401 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.401 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.402 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:49.402 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:02:49.402 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:49.402 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.402 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.402 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:49.402 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:02:49.402 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4900000000000001e-07 2023-09-30T17:02:49.402 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.402 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.403 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:49.403 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374629+0000", 2023-09-30T17:02:49.403 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1014e-05 2023-09-30T17:02:49.403 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.403 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.403 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:49.403 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374636+0000", 2023-09-30T17:02:49.403 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5889999999999999e-06 2023-09-30T17:02:49.403 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.403 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.403 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:49.403 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374642+0000", 2023-09-30T17:02:49.404 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.48e-06 2023-09-30T17:02:49.404 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.404 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.404 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:49.404 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374681+0000", 2023-09-30T17:02:49.404 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9320000000000003e-05 2023-09-30T17:02:49.404 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.404 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.404 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:49.404 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374694+0000", 2023-09-30T17:02:49.404 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3351e-05 2023-09-30T17:02:49.405 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.405 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.405 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:49.405 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380319+0000", 2023-09-30T17:02:49.405 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0056243880000000001 2023-09-30T17:02:49.405 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.405 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.405 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:49.405 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380377+0000", 2023-09-30T17:02:49.405 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8464999999999997e-05 2023-09-30T17:02:49.405 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:49.405 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:49.406 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:49.406 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.406 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.406 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=0'0)", 2023-09-30T17:02:49.406 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:02:49.406 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 30.910438600999999, 2023-09-30T17:02:49.406 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051157370000000004, 2023-09-30T17:02:49.406 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:49.406 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:49.406 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:49.407 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.407 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:49.407 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:02:49.407 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:49.407 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.407 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.407 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:49.407 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:02:49.407 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:49.407 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.407 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.407 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:49.407 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:02:49.408 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0199999999999998e-07 2023-09-30T17:02:49.408 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.408 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.408 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:49.408 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375334+0000", 2023-09-30T17:02:49.408 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8799999999999999e-06 2023-09-30T17:02:49.408 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.408 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.408 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:49.408 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375343+0000", 2023-09-30T17:02:49.408 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5490000000000006e-06 2023-09-30T17:02:49.409 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.409 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.409 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:49.409 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375350+0000", 2023-09-30T17:02:49.409 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5700000000000004e-06 2023-09-30T17:02:49.409 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.409 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.409 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:49.409 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375396+0000", 2023-09-30T17:02:49.409 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5550999999999998e-05 2023-09-30T17:02:49.409 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.409 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.409 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:49.410 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375410+0000", 2023-09-30T17:02:49.410 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4518999999999999e-05 2023-09-30T17:02:49.410 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.410 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.410 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:49.410 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380401+0000", 2023-09-30T17:02:49.410 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0049903430000000004 2023-09-30T17:02:49.410 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:49.410 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:49.410 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:49.410 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380445+0000", 2023-09-30T17:02:49.411 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4023000000000002e-05 2023-09-30T17:02:49.411 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:49.411 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:49.411 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:49.411 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:49.411 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:49.411 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:02:49.413 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:02:49.413 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:49.412+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:49.513 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:49.513+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:49.546 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:02:49.546 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:02:49.546 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2023-09-30T17:02:49.546 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:02:49.556 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:02:49.614 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:49.613+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:49.681 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:02:49.682 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:02:49.682 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2023-09-30T17:02:49.682 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2023-09-30T17:02:49.682 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:02:49.691 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:02:49.733 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:49.732+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:49.815 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:49.814+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:49.861 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:02:49.861 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2023-09-30T17:02:49.861 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2023-09-30T17:02:49.861 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2023-09-30T17:02:49.862 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.862 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:49.862 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:02:49.862 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 31.50818323, 2023-09-30T17:02:49.862 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093789779999999996, 2023-09-30T17:02:49.862 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:49.862 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:49.862 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:49.862 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.862 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:49.862 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:02:49.863 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:49.863 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.863 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.863 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:49.863 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:02:49.863 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:49.863 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.863 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.863 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:49.863 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352027+0000", 2023-09-30T17:02:49.863 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0224000000000001e-05 2023-09-30T17:02:49.863 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.864 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:49.864 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352039+0000", 2023-09-30T17:02:49.864 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1569000000000001e-05 2023-09-30T17:02:49.864 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.864 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:49.864 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352052+0000", 2023-09-30T17:02:49.864 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2605999999999999e-05 2023-09-30T17:02:49.864 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.865 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:49.865 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352064+0000", 2023-09-30T17:02:49.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2666999999999999e-05 2023-09-30T17:02:49.865 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.865 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.865 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:49.865 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352147+0000", 2023-09-30T17:02:49.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3125000000000001e-05 2023-09-30T17:02:49.865 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.865 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.865 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:49.866 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352306+0000", 2023-09-30T17:02:49.866 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015881900000000001 2023-09-30T17:02:49.866 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.866 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.866 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:49.866 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352450+0000", 2023-09-30T17:02:49.866 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014420700000000001 2023-09-30T17:02:49.866 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.866 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.866 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:49.866 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355975+0000", 2023-09-30T17:02:49.867 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003524246 2023-09-30T17:02:49.867 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.867 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.867 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:49.867 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361279+0000", 2023-09-30T17:02:49.867 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005304507 2023-09-30T17:02:49.867 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.867 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.867 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:49.867 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361344+0000", 2023-09-30T17:02:49.867 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4548999999999995e-05 2023-09-30T17:02:49.867 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.867 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:49.868 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361396+0000", 2023-09-30T17:02:49.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2459e-05 2023-09-30T17:02:49.868 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:49.868 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:49.868 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:49.868 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.868 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:49.868 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:02:49.868 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 31.508090937999999, 2023-09-30T17:02:49.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021233007000000002, 2023-09-30T17:02:49.869 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:49.869 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:49.869 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:49.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.869 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:49.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:02:49.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:49.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.869 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:49.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:02:49.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:49.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.870 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:49.870 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352110+0000", 2023-09-30T17:02:49.870 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6000000000000002e-07 2023-09-30T17:02:49.870 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.870 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:49.870 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352117+0000", 2023-09-30T17:02:49.870 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5930000000000002e-06 2023-09-30T17:02:49.870 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.871 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:49.871 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352126+0000", 2023-09-30T17:02:49.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0729999999999994e-06 2023-09-30T17:02:49.871 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.871 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.871 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:49.871 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352136+0000", 2023-09-30T17:02:49.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0380000000000001e-05 2023-09-30T17:02:49.871 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.871 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.871 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:49.872 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353279+0000", 2023-09-30T17:02:49.872 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0011424670000000001 2023-09-30T17:02:49.872 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:49.872 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353707+0000", 2023-09-30T17:02:49.872 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00042829800000000003 2023-09-30T17:02:49.872 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:49.872 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354104+0000", 2023-09-30T17:02:49.872 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00039643399999999998 2023-09-30T17:02:49.873 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.873 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.873 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:49.873 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356925+0000", 2023-09-30T17:02:49.873 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0028210900000000001 2023-09-30T17:02:49.873 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.873 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.873 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:49.873 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373243+0000", 2023-09-30T17:02:49.873 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016318461999999999 2023-09-30T17:02:49.873 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.873 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.874 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:49.874 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373301+0000", 2023-09-30T17:02:49.874 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7435000000000002e-05 2023-09-30T17:02:49.874 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.874 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.874 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:49.874 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373342+0000", 2023-09-30T17:02:49.874 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1915000000000001e-05 2023-09-30T17:02:49.874 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:49.874 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:49.874 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:49.875 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.875 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.875 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:49.875 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:02:49.875 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 31.508048327000001, 2023-09-30T17:02:49.875 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011988331, 2023-09-30T17:02:49.875 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:49.875 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:49.875 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:49.875 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.875 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:49.875 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:02:49.876 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:49.876 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.876 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.876 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:49.876 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:02:49.876 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:49.876 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.876 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.876 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:49.876 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352153+0000", 2023-09-30T17:02:49.876 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0500000000000003e-07 2023-09-30T17:02:49.876 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.877 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.877 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:49.877 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352157+0000", 2023-09-30T17:02:49.877 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9790000000000004e-06 2023-09-30T17:02:49.877 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.877 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.877 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:49.877 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352173+0000", 2023-09-30T17:02:49.877 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6535999999999999e-05 2023-09-30T17:02:49.877 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.877 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.878 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:49.878 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352180+0000", 2023-09-30T17:02:49.878 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7700000000000004e-06 2023-09-30T17:02:49.878 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.878 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.878 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:49.878 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353526+0000", 2023-09-30T17:02:49.878 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0013458330000000001 2023-09-30T17:02:49.878 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.878 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.878 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:49.878 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353648+0000", 2023-09-30T17:02:49.879 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012262899999999999 2023-09-30T17:02:49.879 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.879 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.879 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:02:49.879 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354141+0000", 2023-09-30T17:02:49.879 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00049222899999999995 2023-09-30T17:02:49.879 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.879 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.879 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:49.879 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356931+0000", 2023-09-30T17:02:49.879 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0027900860000000002 2023-09-30T17:02:49.879 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.880 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.880 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:49.880 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364066+0000", 2023-09-30T17:02:49.880 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071355050000000003 2023-09-30T17:02:49.880 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.880 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.880 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:49.880 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364103+0000", 2023-09-30T17:02:49.880 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6944999999999999e-05 2023-09-30T17:02:49.880 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.880 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.880 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:49.881 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364140+0000", 2023-09-30T17:02:49.881 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7214e-05 2023-09-30T17:02:49.881 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:49.881 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:49.881 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:49.881 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.881 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.881 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:49.881 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:02:49.881 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 31.508009095999999, 2023-09-30T17:02:49.881 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012110921, 2023-09-30T17:02:49.881 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:49.882 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:49.882 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:49.882 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.882 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:49.882 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:02:49.882 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:49.882 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.882 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.882 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:49.882 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:02:49.882 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:49.882 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.883 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.883 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:49.883 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352192+0000", 2023-09-30T17:02:49.883 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7300000000000005e-07 2023-09-30T17:02:49.883 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.883 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.883 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:49.883 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352196+0000", 2023-09-30T17:02:49.883 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2370000000000003e-06 2023-09-30T17:02:49.883 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.883 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.883 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:49.884 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352205+0000", 2023-09-30T17:02:49.884 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6659999999999997e-06 2023-09-30T17:02:49.884 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.884 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.884 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:49.884 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352214+0000", 2023-09-30T17:02:49.884 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8259999999999999e-06 2023-09-30T17:02:49.884 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.884 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.884 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:49.884 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354470+0000", 2023-09-30T17:02:49.885 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022557340000000001 2023-09-30T17:02:49.885 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.885 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.885 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:49.885 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354557+0000", 2023-09-30T17:02:49.885 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6909000000000004e-05 2023-09-30T17:02:49.885 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.885 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.885 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:02:49.885 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354694+0000", 2023-09-30T17:02:49.885 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013774800000000001 2023-09-30T17:02:49.885 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.886 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.886 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:49.886 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356937+0000", 2023-09-30T17:02:49.886 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022424540000000001 2023-09-30T17:02:49.886 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.886 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.886 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:49.886 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364227+0000", 2023-09-30T17:02:49.886 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072902430000000001 2023-09-30T17:02:49.886 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.886 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.886 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:49.887 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364278+0000", 2023-09-30T17:02:49.887 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1180999999999997e-05 2023-09-30T17:02:49.887 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.887 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.887 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:49.887 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364302+0000", 2023-09-30T17:02:49.887 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4049999999999998e-05 2023-09-30T17:02:49.887 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:49.887 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:49.887 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:49.887 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.887 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.888 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:49.888 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:02:49.888 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 31.507975757000001, 2023-09-30T17:02:49.888 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021258651999999999, 2023-09-30T17:02:49.888 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:49.888 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:49.888 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:49.888 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.888 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:49.888 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:02:49.888 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:49.888 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.889 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.889 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:49.889 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:02:49.889 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:49.889 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.889 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.889 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:49.889 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:02:49.889 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6899999999999997e-07 2023-09-30T17:02:49.889 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.889 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.889 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:49.890 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352236+0000", 2023-09-30T17:02:49.890 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0251000000000001e-05 2023-09-30T17:02:49.890 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.890 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.890 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:49.890 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352244+0000", 2023-09-30T17:02:49.890 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0770000000000008e-06 2023-09-30T17:02:49.890 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.890 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.890 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:49.890 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352251+0000", 2023-09-30T17:02:49.891 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4749999999999996e-06 2023-09-30T17:02:49.891 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.891 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.891 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:49.891 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354455+0000", 2023-09-30T17:02:49.891 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022043660000000001 2023-09-30T17:02:49.891 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.891 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.891 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:49.891 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354577+0000", 2023-09-30T17:02:49.891 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000121054 2023-09-30T17:02:49.891 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.892 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.892 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:49.892 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354723+0000", 2023-09-30T17:02:49.892 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014693900000000001 2023-09-30T17:02:49.892 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.892 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.892 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:49.892 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356941+0000", 2023-09-30T17:02:49.892 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002217199 2023-09-30T17:02:49.892 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.892 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.892 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:49.893 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373392+0000", 2023-09-30T17:02:49.893 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016451774999999998 2023-09-30T17:02:49.893 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.893 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.893 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:49.893 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373445+0000", 2023-09-30T17:02:49.893 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.308e-05 2023-09-30T17:02:49.893 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.893 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.893 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:49.893 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373483+0000", 2023-09-30T17:02:49.893 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7766999999999999e-05 2023-09-30T17:02:49.894 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:49.894 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:49.894 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:49.894 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.894 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.894 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:49.894 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:02:49.894 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 31.507939665999999, 2023-09-30T17:02:49.894 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020903497, 2023-09-30T17:02:49.894 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:49.894 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:49.895 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:49.895 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.895 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:49.895 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:02:49.895 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:49.895 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.895 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.895 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:49.895 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:02:49.895 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:49.895 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.896 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.896 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:49.896 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:02:49.896 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0800000000000004e-07 2023-09-30T17:02:49.896 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.896 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.896 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:49.896 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352266+0000", 2023-09-30T17:02:49.896 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1280000000000001e-06 2023-09-30T17:02:49.896 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.896 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.897 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:49.897 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352273+0000", 2023-09-30T17:02:49.897 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3730000000000004e-06 2023-09-30T17:02:49.897 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.897 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.897 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:49.897 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352279+0000", 2023-09-30T17:02:49.897 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7699999999999998e-06 2023-09-30T17:02:49.897 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.897 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.897 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:49.897 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352334+0000", 2023-09-30T17:02:49.897 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5547999999999997e-05 2023-09-30T17:02:49.898 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.898 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.898 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:49.898 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352435+0000", 2023-09-30T17:02:49.898 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100688 2023-09-30T17:02:49.898 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.898 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.898 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:49.898 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352585+0000", 2023-09-30T17:02:49.898 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000150068 2023-09-30T17:02:49.898 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.899 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.899 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:49.899 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354912+0000", 2023-09-30T17:02:49.899 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0023266770000000001 2023-09-30T17:02:49.899 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.899 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.899 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:49.899 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373066+0000", 2023-09-30T17:02:49.899 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018154474 2023-09-30T17:02:49.899 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.899 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.899 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:49.900 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373122+0000", 2023-09-30T17:02:49.900 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6193000000000002e-05 2023-09-30T17:02:49.900 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.900 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.900 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:49.900 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373164+0000", 2023-09-30T17:02:49.900 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1869999999999997e-05 2023-09-30T17:02:49.900 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:49.900 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:49.900 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:49.900 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.900 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.901 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:49.901 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:02:49.901 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 31.507903989999999, 2023-09-30T17:02:49.901 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021015097999999999, 2023-09-30T17:02:49.901 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:49.901 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:49.901 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:49.901 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.901 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:49.901 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:02:49.901 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:49.902 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.902 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.902 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:49.902 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:02:49.902 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:49.902 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.902 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.902 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:49.902 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352297+0000", 2023-09-30T17:02:49.902 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8299999999999997e-07 2023-09-30T17:02:49.902 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.902 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.903 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:49.903 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352300+0000", 2023-09-30T17:02:49.903 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7460000000000001e-06 2023-09-30T17:02:49.903 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.903 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.903 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:49.903 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352307+0000", 2023-09-30T17:02:49.903 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4959999999999999e-06 2023-09-30T17:02:49.903 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.903 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.903 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:49.903 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352314+0000", 2023-09-30T17:02:49.904 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0190000000000001e-06 2023-09-30T17:02:49.904 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.904 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.904 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:49.904 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354070+0000", 2023-09-30T17:02:49.904 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001755936 2023-09-30T17:02:49.904 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.904 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.904 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:49.904 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354221+0000", 2023-09-30T17:02:49.904 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000150884 2023-09-30T17:02:49.905 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.905 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.905 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:49.905 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373311+0000", 2023-09-30T17:02:49.905 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019090434 2023-09-30T17:02:49.905 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:49.905 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:49.905 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:49.905 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.905 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.905 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:49.906 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:02:49.906 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 31.507875271, 2023-09-30T17:02:49.906 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021255174000000002, 2023-09-30T17:02:49.906 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:49.906 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:49.906 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:49.906 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.906 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:49.906 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:02:49.906 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:49.906 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.906 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.907 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:49.907 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:02:49.907 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:49.907 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.907 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.907 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:49.907 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352326+0000", 2023-09-30T17:02:49.907 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3200000000000005e-07 2023-09-30T17:02:49.907 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.907 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.907 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:49.907 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352349+0000", 2023-09-30T17:02:49.908 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3183000000000001e-05 2023-09-30T17:02:49.908 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.908 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.908 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:49.908 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352358+0000", 2023-09-30T17:02:49.908 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5230000000000001e-06 2023-09-30T17:02:49.908 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.908 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.908 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:49.908 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352365+0000", 2023-09-30T17:02:49.908 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3260000000000001e-06 2023-09-30T17:02:49.909 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.909 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.909 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:49.909 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355450+0000", 2023-09-30T17:02:49.909 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0030854049999999998 2023-09-30T17:02:49.909 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.909 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.909 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:49.909 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355583+0000", 2023-09-30T17:02:49.909 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000133189 2023-09-30T17:02:49.909 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.909 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.910 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:49.910 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373580+0000", 2023-09-30T17:02:49.910 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017997016000000001 2023-09-30T17:02:49.910 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:49.910 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:49.910 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:49.910 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.910 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.910 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:49.910 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:02:49.910 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 31.507823848000001, 2023-09-30T17:02:49.911 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010380537, 2023-09-30T17:02:49.911 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:49.911 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:49.911 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:49.911 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.911 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:49.911 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:02:49.911 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:49.911 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.911 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.911 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:49.912 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:02:49.912 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:49.912 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.912 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.912 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:49.912 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:02:49.912 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1500000000000003e-07 2023-09-30T17:02:49.912 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.912 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.912 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:49.912 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352381+0000", 2023-09-30T17:02:49.912 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6330000000000002e-06 2023-09-30T17:02:49.913 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.913 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.913 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:49.913 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352388+0000", 2023-09-30T17:02:49.913 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7229999999999998e-06 2023-09-30T17:02:49.913 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.913 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.913 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:49.913 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352394+0000", 2023-09-30T17:02:49.913 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1789999999999996e-06 2023-09-30T17:02:49.913 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.913 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.914 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:49.914 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353259+0000", 2023-09-30T17:02:49.914 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000865221 2023-09-30T17:02:49.914 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.914 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.914 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:49.914 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353391+0000", 2023-09-30T17:02:49.914 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013217700000000001 2023-09-30T17:02:49.914 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.914 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.915 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:49.915 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362757+0000", 2023-09-30T17:02:49.915 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093657889999999994 2023-09-30T17:02:49.915 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:49.915 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:49.915 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:49.915 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.915 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.915 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-09-30T17:02:49.915 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:02:49.915 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 31.501523555999999, 2023-09-30T17:02:49.916 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0061813579999999996, 2023-09-30T17:02:49.916 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:49.916 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2023-09-30T17:02:49.916 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:49.916 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.916 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:49.916 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:02:49.916 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:49.916 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.916 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.916 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:49.917 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:02:49.917 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:49.917 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.917 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.917 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:49.917 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:02:49.917 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5499999999999999e-07 2023-09-30T17:02:49.917 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.917 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.917 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:49.917 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358686+0000", 2023-09-30T17:02:49.917 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9979999999999992e-06 2023-09-30T17:02:49.917 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.918 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.918 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:49.918 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358700+0000", 2023-09-30T17:02:49.918 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3635000000000001e-05 2023-09-30T17:02:49.918 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.918 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.918 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:49.918 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358714+0000", 2023-09-30T17:02:49.918 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4470999999999999e-05 2023-09-30T17:02:49.918 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.919 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.919 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:49.919 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358767+0000", 2023-09-30T17:02:49.919 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2651999999999997e-05 2023-09-30T17:02:49.919 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.919 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.919 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:49.919 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364858+0000", 2023-09-30T17:02:49.919 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060912470000000002 2023-09-30T17:02:49.919 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:49.919 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:49.919 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:49.920 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.920 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.920 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2023-09-30T17:02:49.920 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:02:49.920 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 31.499158716, 2023-09-30T17:02:49.920 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00036246299999999999, 2023-09-30T17:02:49.920 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:49.920 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:49.920 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:49.920 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.920 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:49.921 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:02:49.921 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:49.921 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.921 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.921 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:49.921 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:02:49.921 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:49.921 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.921 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.921 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:49.921 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:02:49.922 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3099999999999999e-07 2023-09-30T17:02:49.922 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.922 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.922 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:49.922 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361045+0000", 2023-09-30T17:02:49.922 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.49e-06 2023-09-30T17:02:49.922 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.922 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.922 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:49.922 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361056+0000", 2023-09-30T17:02:49.922 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0910000000000001e-05 2023-09-30T17:02:49.923 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.923 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.923 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:49.923 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361067+0000", 2023-09-30T17:02:49.923 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0531e-05 2023-09-30T17:02:49.923 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.923 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.923 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:49.923 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361263+0000", 2023-09-30T17:02:49.923 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000196486 2023-09-30T17:02:49.923 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.923 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.924 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:49.924 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361273+0000", 2023-09-30T17:02:49.924 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3379999999999994e-06 2023-09-30T17:02:49.924 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.924 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.924 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:49.924 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361404+0000", 2023-09-30T17:02:49.924 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013137700000000001 2023-09-30T17:02:49.924 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:49.924 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:49.924 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:49.925 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.925 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.925 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:31 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:02:49.925 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:02:49.925 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 31.498182687, 2023-09-30T17:02:49.925 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006676408, 2023-09-30T17:02:49.925 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:49.925 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:49.925 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:49.925 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.925 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:49.925 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:02:49.926 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:49.926 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.926 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.926 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:49.926 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:02:49.926 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:49.926 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.926 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.926 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:49.926 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:02:49.926 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5600000000000002e-07 2023-09-30T17:02:49.927 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.927 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.927 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:49.927 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362044+0000", 2023-09-30T17:02:49.927 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5987999999999999e-05 2023-09-30T17:02:49.927 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.927 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.927 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:49.927 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362051+0000", 2023-09-30T17:02:49.927 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2599999999999999e-06 2023-09-30T17:02:49.927 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.928 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.928 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:49.928 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362057+0000", 2023-09-30T17:02:49.928 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.19e-06 2023-09-30T17:02:49.928 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.928 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.928 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:49.928 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362096+0000", 2023-09-30T17:02:49.928 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8278000000000002e-05 2023-09-30T17:02:49.928 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.928 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.929 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:49.929 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362114+0000", 2023-09-30T17:02:49.929 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8808e-05 2023-09-30T17:02:49.929 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.929 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.929 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:49.929 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368658+0000", 2023-09-30T17:02:49.929 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065433540000000004 2023-09-30T17:02:49.929 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.929 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.929 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:49.930 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368694+0000", 2023-09-30T17:02:49.930 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6273999999999999e-05 2023-09-30T17:02:49.930 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:49.930 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:49.930 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:49.930 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.930 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.930 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:26 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-09-30T17:02:49.930 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:02:49.930 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 31.498091915, 2023-09-30T17:02:49.930 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0066596119999999996, 2023-09-30T17:02:49.931 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:49.931 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:49.931 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:49.931 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.931 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:49.931 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:02:49.931 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:49.931 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.931 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.931 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:49.931 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:02:49.931 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:49.932 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.932 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.932 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:49.932 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362109+0000", 2023-09-30T17:02:49.932 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5699999999999999e-07 2023-09-30T17:02:49.932 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.932 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.932 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:49.932 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362112+0000", 2023-09-30T17:02:49.932 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8410000000000002e-06 2023-09-30T17:02:49.932 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.933 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.933 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:49.933 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362117+0000", 2023-09-30T17:02:49.933 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.792e-06 2023-09-30T17:02:49.933 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.933 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.933 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:49.933 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362122+0000", 2023-09-30T17:02:49.933 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.763e-06 2023-09-30T17:02:49.933 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.933 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.933 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:49.934 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362344+0000", 2023-09-30T17:02:49.934 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022181600000000001 2023-09-30T17:02:49.934 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.934 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.934 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:49.934 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362357+0000", 2023-09-30T17:02:49.934 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2864000000000001e-05 2023-09-30T17:02:49.934 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.934 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.934 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:49.934 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368738+0000", 2023-09-30T17:02:49.935 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063809499999999998 2023-09-30T17:02:49.935 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.935 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.935 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:49.935 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368768+0000", 2023-09-30T17:02:49.935 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0429e-05 2023-09-30T17:02:49.935 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:49.935 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:49.935 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:49.935 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.935 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.936 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2023-09-30T17:02:49.936 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:02:49.936 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 31.496875748000001, 2023-09-30T17:02:49.936 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00082185400000000001, 2023-09-30T17:02:49.936 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:49.936 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:49.936 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:49.936 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.936 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:49.936 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:02:49.936 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:49.936 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.937 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.937 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:49.937 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:02:49.937 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:49.937 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.937 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.937 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:49.937 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:02:49.937 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.22e-07 2023-09-30T17:02:49.937 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.937 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.938 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:49.938 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363327+0000", 2023-09-30T17:02:49.938 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4480000000000001e-06 2023-09-30T17:02:49.938 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.938 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.938 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:49.938 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363333+0000", 2023-09-30T17:02:49.938 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9989999999999997e-06 2023-09-30T17:02:49.938 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.938 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.938 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:49.938 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363354+0000", 2023-09-30T17:02:49.939 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0547000000000002e-05 2023-09-30T17:02:49.939 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.939 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.939 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:49.939 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364057+0000", 2023-09-30T17:02:49.939 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00070306600000000002 2023-09-30T17:02:49.939 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.939 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.939 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:49.939 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364063+0000", 2023-09-30T17:02:49.939 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.694e-06 2023-09-30T17:02:49.939 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.940 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.940 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:49.940 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364146+0000", 2023-09-30T17:02:49.940 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3877999999999999e-05 2023-09-30T17:02:49.940 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:49.940 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:49.940 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:49.940 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.940 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.940 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e18/16 ondisk, result = 0)", 2023-09-30T17:02:49.940 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:02:49.941 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 31.496562216000001, 2023-09-30T17:02:49.941 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00067007199999999996, 2023-09-30T17:02:49.941 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:49.941 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:49.941 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:49.941 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.941 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:49.941 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:02:49.941 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:49.941 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.941 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.941 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:49.942 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:02:49.942 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:49.942 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.942 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.942 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:49.942 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:02:49.942 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.41e-07 2023-09-30T17:02:49.942 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.942 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.942 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:49.942 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363641+0000", 2023-09-30T17:02:49.942 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4830000000000002e-06 2023-09-30T17:02:49.942 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.943 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.943 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:49.943 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363647+0000", 2023-09-30T17:02:49.943 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4869999999999999e-06 2023-09-30T17:02:49.943 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.943 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.943 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:49.943 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363654+0000", 2023-09-30T17:02:49.943 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5889999999999999e-06 2023-09-30T17:02:49.943 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.943 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.943 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:49.944 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364217+0000", 2023-09-30T17:02:49.944 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00056263199999999998 2023-09-30T17:02:49.944 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.944 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.944 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:49.944 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364222+0000", 2023-09-30T17:02:49.944 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.242e-06 2023-09-30T17:02:49.944 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.944 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.944 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:49.944 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364308+0000", 2023-09-30T17:02:49.944 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6397999999999995e-05 2023-09-30T17:02:49.945 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:49.945 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:49.945 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:49.945 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.945 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.945 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2023-09-30T17:02:49.945 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:02:49.945 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 31.486974306, 2023-09-30T17:02:49.945 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000359561, 2023-09-30T17:02:49.945 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:49.945 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2023-09-30T17:02:49.946 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:49.946 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.946 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:49.946 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:02:49.946 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:49.946 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.946 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.946 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:49.946 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:02:49.946 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:49.946 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.947 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.947 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:49.947 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:02:49.947 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1e-07 2023-09-30T17:02:49.947 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.947 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.947 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:49.947 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373228+0000", 2023-09-30T17:02:49.947 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9420000000000002e-06 2023-09-30T17:02:49.947 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.947 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.947 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:49.947 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373235+0000", 2023-09-30T17:02:49.948 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4230000000000002e-06 2023-09-30T17:02:49.948 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.948 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.948 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:49.948 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373239+0000", 2023-09-30T17:02:49.948 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6809999999999997e-06 2023-09-30T17:02:49.948 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.948 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.948 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:49.948 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373518+0000", 2023-09-30T17:02:49.948 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000278311 2023-09-30T17:02:49.948 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.949 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.949 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:49.949 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373586+0000", 2023-09-30T17:02:49.949 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7994e-05 2023-09-30T17:02:49.949 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:49.949 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:49.949 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:49.949 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.949 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.949 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:02:49.949 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:02:49.949 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 31.482548232999999, 2023-09-30T17:02:49.950 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0046632949999999996, 2023-09-30T17:02:49.950 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:49.950 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:49.950 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:49.950 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.950 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:49.950 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:02:49.950 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:49.950 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.950 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.950 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:49.951 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:02:49.951 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:49.951 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.951 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.951 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:49.951 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377653+0000", 2023-09-30T17:02:49.951 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7800000000000002e-07 2023-09-30T17:02:49.951 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.951 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.951 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:49.951 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377657+0000", 2023-09-30T17:02:49.951 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5859999999999998e-06 2023-09-30T17:02:49.952 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.952 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.952 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:49.952 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377677+0000", 2023-09-30T17:02:49.952 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9508999999999999e-05 2023-09-30T17:02:49.952 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.952 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.952 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:49.952 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377682+0000", 2023-09-30T17:02:49.952 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8300000000000001e-06 2023-09-30T17:02:49.952 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.953 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.953 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:49.953 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377725+0000", 2023-09-30T17:02:49.953 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2425000000000001e-05 2023-09-30T17:02:49.953 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.953 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.953 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:49.953 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377738+0000", 2023-09-30T17:02:49.953 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2899e-05 2023-09-30T17:02:49.953 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.953 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.953 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:49.954 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382268+0000", 2023-09-30T17:02:49.954 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045301289999999999 2023-09-30T17:02:49.954 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.954 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.954 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:49.954 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382315+0000", 2023-09-30T17:02:49.954 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7539e-05 2023-09-30T17:02:49.954 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:49.954 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:49.954 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:49.954 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.955 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.955 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-09-30T17:02:49.955 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:02:49.955 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 31.482098782000001, 2023-09-30T17:02:49.955 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042540670000000003, 2023-09-30T17:02:49.955 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:49.955 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:49.955 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:49.955 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.955 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:49.955 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:02:49.955 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:49.956 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.956 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.956 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:49.956 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:02:49.956 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:49.956 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.956 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.956 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:49.956 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:02:49.956 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0299999999999998e-07 2023-09-30T17:02:49.956 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.956 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.957 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:49.957 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378107+0000", 2023-09-30T17:02:49.957 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9250000000000003e-06 2023-09-30T17:02:49.957 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.957 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.957 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:49.957 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378116+0000", 2023-09-30T17:02:49.957 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.037e-06 2023-09-30T17:02:49.957 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.957 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.957 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:49.957 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378123+0000", 2023-09-30T17:02:49.958 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1879999999999996e-06 2023-09-30T17:02:49.958 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.958 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.958 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:49.958 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378174+0000", 2023-09-30T17:02:49.958 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0998000000000002e-05 2023-09-30T17:02:49.958 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.958 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.958 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:49.958 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378197+0000", 2023-09-30T17:02:49.958 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2558e-05 2023-09-30T17:02:49.958 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.959 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.959 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:49.959 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382319+0000", 2023-09-30T17:02:49.959 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041220950000000001 2023-09-30T17:02:49.959 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.959 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.959 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:49.959 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382356+0000", 2023-09-30T17:02:49.959 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6563000000000002e-05 2023-09-30T17:02:49.959 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:49.959 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:49.959 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:49.960 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.960 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.960 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-09-30T17:02:49.960 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:02:49.960 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 27.424334957999999, 2023-09-30T17:02:49.960 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00171641, 2023-09-30T17:02:49.960 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:49.960 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:49.960 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:49.960 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.960 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:49.960 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:02:49.961 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:49.961 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.961 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.961 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:49.961 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:02:49.961 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:49.961 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.961 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.961 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:49.961 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435868+0000", 2023-09-30T17:02:49.961 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5840000000000002e-06 2023-09-30T17:02:49.961 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.962 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.962 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:49.962 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435892+0000", 2023-09-30T17:02:49.962 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3625000000000002e-05 2023-09-30T17:02:49.962 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.962 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.962 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:49.962 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435908+0000", 2023-09-30T17:02:49.962 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6548000000000001e-05 2023-09-30T17:02:49.962 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.962 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.963 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:49.963 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435935+0000", 2023-09-30T17:02:49.963 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6516000000000002e-05 2023-09-30T17:02:49.963 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.963 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.963 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:49.963 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435996+0000", 2023-09-30T17:02:49.963 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1433999999999995e-05 2023-09-30T17:02:49.963 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.963 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.963 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:49.963 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436114+0000", 2023-09-30T17:02:49.964 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000118344 2023-09-30T17:02:49.964 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.964 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.964 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:49.964 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436219+0000", 2023-09-30T17:02:49.964 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010453100000000001 2023-09-30T17:02:49.964 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.964 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.964 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:49.964 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436900+0000", 2023-09-30T17:02:49.964 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00068121299999999996 2023-09-30T17:02:49.965 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.965 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.965 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:49.965 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437508+0000", 2023-09-30T17:02:49.965 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00060817399999999995 2023-09-30T17:02:49.965 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.965 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.965 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:49.965 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437554+0000", 2023-09-30T17:02:49.965 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5609000000000003e-05 2023-09-30T17:02:49.965 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.965 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.966 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:49.966 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437582+0000", 2023-09-30T17:02:49.966 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7832000000000001e-05 2023-09-30T17:02:49.966 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:49.966 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:49.966 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:49.966 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.966 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.966 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2023-09-30T17:02:49.966 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:02:49.966 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 7.4240234640000002, 2023-09-30T17:02:49.967 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001456199, 2023-09-30T17:02:49.967 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:49.967 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:49.967 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:49.967 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.967 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:49.967 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:02:49.967 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:49.967 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.967 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.967 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:49.968 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:02:49.968 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:49.968 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.968 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.968 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:49.968 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436178+0000", 2023-09-30T17:02:49.968 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.494e-06 2023-09-30T17:02:49.968 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.968 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.968 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:49.968 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436184+0000", 2023-09-30T17:02:49.968 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2809999999999999e-06 2023-09-30T17:02:49.969 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.969 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.969 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:49.969 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436198+0000", 2023-09-30T17:02:49.969 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3978000000000001e-05 2023-09-30T17:02:49.969 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.969 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.969 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:49.969 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436206+0000", 2023-09-30T17:02:49.969 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8040000000000007e-06 2023-09-30T17:02:49.969 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.969 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.970 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:49.970 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436268+0000", 2023-09-30T17:02:49.970 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1484999999999998e-05 2023-09-30T17:02:49.970 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.970 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.970 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:49.970 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436339+0000", 2023-09-30T17:02:49.970 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1000000000000005e-05 2023-09-30T17:02:49.970 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.970 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.970 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:49.971 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436438+0000", 2023-09-30T17:02:49.971 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9389000000000007e-05 2023-09-30T17:02:49.971 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.971 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.971 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:49.971 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436986+0000", 2023-09-30T17:02:49.971 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054723399999999996 2023-09-30T17:02:49.971 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.971 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.971 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:49.973 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437566+0000", 2023-09-30T17:02:49.973 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00058017599999999996 2023-09-30T17:02:49.973 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.973 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.973 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:49.973 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437606+0000", 2023-09-30T17:02:49.973 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9891999999999997e-05 2023-09-30T17:02:49.973 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:49.974 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:49.974 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:49.974 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437633+0000", 2023-09-30T17:02:49.974 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7466000000000001e-05 2023-09-30T17:02:49.974 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:49.974 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:49.974 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:49.974 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:49.974 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:49.974 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:02:49.975 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:49.975+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:49.976 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:02:50.077 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:50.076+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:50.122 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:02:50.122 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:02:50.122 INFO:teuthology.orchestra.run.smithi031.stdout: "num_ops": 0 2023-09-30T17:02:50.122 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:02:50.132 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:02:50.178 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:50.177+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:50.264 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:02:50.264 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:02:50.264 INFO:teuthology.orchestra.run.smithi031.stdout: "complaint_time": 30, 2023-09-30T17:02:50.264 INFO:teuthology.orchestra.run.smithi031.stdout: "num_blocked_ops": 0 2023-09-30T17:02:50.264 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:02:50.274 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is set 2023-09-30T17:02:50.275 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:02:50.278 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:50.278+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:50.378 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:50.378+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:50.450 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:02:50.450 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 20, 2023-09-30T17:02:50.450 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 600, 2023-09-30T17:02:50.450 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:02:50.450 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.450 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:32 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'18, mlcod=11'14)", 2023-09-30T17:02:50.450 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:02:50.450 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 43.087572862000002, 2023-09-30T17:02:50.451 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051629809999999996, 2023-09-30T17:02:50.451 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:50.451 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:50.451 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:50.451 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.451 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:50.451 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:02:50.451 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:50.451 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.451 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.451 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:50.452 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:02:50.452 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:50.452 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.452 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.452 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:50.452 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:02:50.452 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2099999999999996e-07 2023-09-30T17:02:50.452 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.452 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.452 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:50.452 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361407+0000", 2023-09-30T17:02:50.452 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7499e-05 2023-09-30T17:02:50.453 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.453 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.453 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:50.453 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361418+0000", 2023-09-30T17:02:50.453 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1127999999999999e-05 2023-09-30T17:02:50.453 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.453 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.453 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:50.453 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361423+0000", 2023-09-30T17:02:50.453 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1930000000000001e-06 2023-09-30T17:02:50.453 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.454 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.454 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:50.454 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361476+0000", 2023-09-30T17:02:50.454 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3399000000000002e-05 2023-09-30T17:02:50.454 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.454 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.454 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:50.454 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361496+0000", 2023-09-30T17:02:50.454 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9638000000000001e-05 2023-09-30T17:02:50.454 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.454 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.455 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:50.455 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.366474+0000", 2023-09-30T17:02:50.455 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0049778829999999998 2023-09-30T17:02:50.455 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.455 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.455 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:50.455 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.366512+0000", 2023-09-30T17:02:50.455 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7620000000000002e-05 2023-09-30T17:02:50.455 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:50.455 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:50.455 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:50.456 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.456 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.456 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:37 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'23, mlcod=11'15)", 2023-09-30T17:02:50.456 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:02:50.456 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 43.084970865000003, 2023-09-30T17:02:50.456 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053985689999999998, 2023-09-30T17:02:50.456 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:50.456 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:50.456 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:50.456 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.456 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:50.457 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:02:50.457 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:50.457 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.457 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.457 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:50.457 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:02:50.457 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:50.457 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.457 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.457 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:50.457 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:02:50.458 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4400000000000001e-07 2023-09-30T17:02:50.458 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.458 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.458 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:50.458 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363956+0000", 2023-09-30T17:02:50.458 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.921e-06 2023-09-30T17:02:50.458 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.458 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.458 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:50.458 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363966+0000", 2023-09-30T17:02:50.458 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0351e-05 2023-09-30T17:02:50.458 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.459 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.459 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:50.459 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363971+0000", 2023-09-30T17:02:50.459 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.023e-06 2023-09-30T17:02:50.459 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.459 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.459 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:50.459 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.364013+0000", 2023-09-30T17:02:50.459 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1575000000000001e-05 2023-09-30T17:02:50.459 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.459 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.460 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:50.460 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.364026+0000", 2023-09-30T17:02:50.460 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3044000000000001e-05 2023-09-30T17:02:50.460 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.460 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.460 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:50.460 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.369308+0000", 2023-09-30T17:02:50.460 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005282152 2023-09-30T17:02:50.460 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.460 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.460 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:50.460 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.369349+0000", 2023-09-30T17:02:50.461 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1059000000000001e-05 2023-09-30T17:02:50.461 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:50.461 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:50.461 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:50.461 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.461 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.461 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:155 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'109, mlcod=11'105)", 2023-09-30T17:02:50.461 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:02:50.461 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 42.603275179000001, 2023-09-30T17:02:50.461 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053867639999999996, 2023-09-30T17:02:50.461 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:50.462 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:50.462 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:50.462 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.462 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:50.462 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:02:50.462 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:50.462 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.462 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.462 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:50.462 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:02:50.462 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:50.463 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.463 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.463 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:50.463 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845647+0000", 2023-09-30T17:02:50.463 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7599999999999997e-07 2023-09-30T17:02:50.463 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.463 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.463 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:50.463 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845699+0000", 2023-09-30T17:02:50.463 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1758000000000001e-05 2023-09-30T17:02:50.463 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.463 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.464 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:50.464 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845708+0000", 2023-09-30T17:02:50.464 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2159999999999995e-06 2023-09-30T17:02:50.464 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.464 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.464 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:50.464 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845712+0000", 2023-09-30T17:02:50.464 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2579999999999997e-06 2023-09-30T17:02:50.464 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.464 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.464 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:50.465 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845756+0000", 2023-09-30T17:02:50.465 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4119999999999998e-05 2023-09-30T17:02:50.465 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.465 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.465 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:50.465 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845779+0000", 2023-09-30T17:02:50.465 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2311e-05 2023-09-30T17:02:50.465 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.465 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.465 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:50.465 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.850982+0000", 2023-09-30T17:02:50.466 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005203053 2023-09-30T17:02:50.466 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.466 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.466 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:50.466 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851033+0000", 2023-09-30T17:02:50.466 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1471999999999998e-05 2023-09-30T17:02:50.466 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:50.466 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:50.466 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:50.466 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.466 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.466 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:156 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'110, mlcod=11'105)", 2023-09-30T17:02:50.467 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:02:50.467 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 42.602742253000002, 2023-09-30T17:02:50.467 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0052834759999999996, 2023-09-30T17:02:50.467 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:50.467 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:50.467 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:50.467 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.467 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:50.467 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:02:50.467 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:50.468 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.468 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.468 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:50.468 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:02:50.468 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:50.468 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.468 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.468 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:50.468 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846180+0000", 2023-09-30T17:02:50.468 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6300000000000005e-07 2023-09-30T17:02:50.468 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.468 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.469 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:50.469 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846184+0000", 2023-09-30T17:02:50.469 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3789999999999999e-06 2023-09-30T17:02:50.469 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.469 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.469 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:50.469 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846195+0000", 2023-09-30T17:02:50.469 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0778000000000001e-05 2023-09-30T17:02:50.469 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.469 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.469 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:50.470 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846200+0000", 2023-09-30T17:02:50.470 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1540000000000001e-06 2023-09-30T17:02:50.470 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.470 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.470 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:50.470 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846274+0000", 2023-09-30T17:02:50.470 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4129999999999997e-05 2023-09-30T17:02:50.470 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.470 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.470 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:50.470 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846286+0000", 2023-09-30T17:02:50.471 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1744e-05 2023-09-30T17:02:50.471 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.471 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.471 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:50.471 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851432+0000", 2023-09-30T17:02:50.471 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051462110000000004 2023-09-30T17:02:50.471 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.471 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.471 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:50.471 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851463+0000", 2023-09-30T17:02:50.471 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0516999999999999e-05 2023-09-30T17:02:50.471 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:50.472 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:50.472 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:50.472 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.472 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.472 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:203 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'149, mlcod=11'145)", 2023-09-30T17:02:50.472 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:02:50.472 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 42.246706344000003, 2023-09-30T17:02:50.472 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051867459999999999, 2023-09-30T17:02:50.472 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:50.472 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:50.472 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:50.472 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.473 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:50.473 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:02:50.473 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:50.473 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.473 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.473 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:50.473 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:02:50.473 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:50.473 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.473 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.473 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:50.474 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202216+0000", 2023-09-30T17:02:50.474 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7e-07 2023-09-30T17:02:50.474 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.474 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.474 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:50.474 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202271+0000", 2023-09-30T17:02:50.474 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5163e-05 2023-09-30T17:02:50.474 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.474 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.474 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:50.474 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202282+0000", 2023-09-30T17:02:50.474 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1319e-05 2023-09-30T17:02:50.475 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.475 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.475 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:50.475 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202288+0000", 2023-09-30T17:02:50.475 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2899999999999999e-06 2023-09-30T17:02:50.475 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.475 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.475 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:50.475 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202331+0000", 2023-09-30T17:02:50.475 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2147999999999997e-05 2023-09-30T17:02:50.475 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.476 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.476 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:50.476 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202348+0000", 2023-09-30T17:02:50.476 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7317e-05 2023-09-30T17:02:50.476 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.476 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.476 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:50.476 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.207357+0000", 2023-09-30T17:02:50.476 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0050095440000000003 2023-09-30T17:02:50.476 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.476 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.477 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:50.477 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.207402+0000", 2023-09-30T17:02:50.477 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4495e-05 2023-09-30T17:02:50.477 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:50.477 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:50.477 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:50.477 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.477 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.477 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:50.477 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:02:50.477 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 32.097376056000002, 2023-09-30T17:02:50.478 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.025313649000000001, 2023-09-30T17:02:50.478 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:50.478 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:50.478 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:50.478 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.478 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:50.478 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:02:50.478 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:50.478 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.478 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.478 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:50.479 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:02:50.479 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:50.479 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.479 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.479 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:50.479 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351551+0000", 2023-09-30T17:02:50.479 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3380000000000004e-06 2023-09-30T17:02:50.479 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.479 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.479 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:50.479 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351559+0000", 2023-09-30T17:02:50.480 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9589999999999995e-06 2023-09-30T17:02:50.480 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.480 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.480 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:50.480 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351571+0000", 2023-09-30T17:02:50.480 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2065999999999999e-05 2023-09-30T17:02:50.480 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.480 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.480 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:50.480 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351706+0000", 2023-09-30T17:02:50.480 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00013553799999999999 2023-09-30T17:02:50.480 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.481 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.481 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:50.481 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353016+0000", 2023-09-30T17:02:50.481 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0013099209999999999 2023-09-30T17:02:50.481 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.481 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.481 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:02:50.481 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353023+0000", 2023-09-30T17:02:50.481 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2479999999999999e-06 2023-09-30T17:02:50.481 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.481 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.481 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:50.482 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360348+0000", 2023-09-30T17:02:50.482 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0073248949999999997 2023-09-30T17:02:50.482 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.482 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.482 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:50.482 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360787+0000", 2023-09-30T17:02:50.482 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00043875199999999999 2023-09-30T17:02:50.482 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.482 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.482 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:50.482 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360892+0000", 2023-09-30T17:02:50.483 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010508199999999999 2023-09-30T17:02:50.483 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.483 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.483 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:02:50.483 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365132+0000", 2023-09-30T17:02:50.483 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0042396480000000004 2023-09-30T17:02:50.483 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.483 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.483 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:50.483 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376746+0000", 2023-09-30T17:02:50.483 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011614157 2023-09-30T17:02:50.483 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.484 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.484 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:50.484 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376811+0000", 2023-09-30T17:02:50.484 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5005999999999994e-05 2023-09-30T17:02:50.484 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.484 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.484 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:50.484 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376859+0000", 2023-09-30T17:02:50.484 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8038999999999999e-05 2023-09-30T17:02:50.484 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:50.484 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:50.485 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:50.485 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.485 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.485 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:50.485 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:02:50.485 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 32.096878257, 2023-09-30T17:02:50.485 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024923989000000001, 2023-09-30T17:02:50.485 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:50.485 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:50.485 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:50.485 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.486 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:50.486 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:02:50.486 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:50.486 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.486 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.486 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:50.486 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:02:50.486 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:50.486 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.486 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.486 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:50.487 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352044+0000", 2023-09-30T17:02:50.487 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9199999999999999e-07 2023-09-30T17:02:50.487 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.487 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.487 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:50.487 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352050+0000", 2023-09-30T17:02:50.487 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8880000000000002e-06 2023-09-30T17:02:50.487 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.487 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.487 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:50.487 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352143+0000", 2023-09-30T17:02:50.487 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2721999999999998e-05 2023-09-30T17:02:50.488 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.488 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.488 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:50.488 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352155+0000", 2023-09-30T17:02:50.488 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2279000000000001e-05 2023-09-30T17:02:50.488 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.488 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.488 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:50.488 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353114+0000", 2023-09-30T17:02:50.488 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00095943700000000005 2023-09-30T17:02:50.488 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.489 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.489 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:50.489 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353121+0000", 2023-09-30T17:02:50.489 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.494e-06 2023-09-30T17:02:50.489 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.489 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.489 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:50.489 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361491+0000", 2023-09-30T17:02:50.489 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0083697359999999991 2023-09-30T17:02:50.489 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.489 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.490 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:50.490 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361573+0000", 2023-09-30T17:02:50.490 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2822000000000001e-05 2023-09-30T17:02:50.490 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.490 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.490 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:50.490 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362166+0000", 2023-09-30T17:02:50.490 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00059223299999999995 2023-09-30T17:02:50.490 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.490 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.490 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:02:50.490 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365209+0000", 2023-09-30T17:02:50.491 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.003043212 2023-09-30T17:02:50.491 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.491 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.491 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:50.491 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376910+0000", 2023-09-30T17:02:50.491 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011700898 2023-09-30T17:02:50.491 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.491 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.491 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:50.491 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376945+0000", 2023-09-30T17:02:50.491 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4795000000000001e-05 2023-09-30T17:02:50.492 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.492 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.492 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:50.492 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376967+0000", 2023-09-30T17:02:50.492 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2580999999999999e-05 2023-09-30T17:02:50.492 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:50.492 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:50.492 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:50.492 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.492 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.492 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:50.493 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:02:50.493 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 32.096708337000003, 2023-09-30T17:02:50.493 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023120405, 2023-09-30T17:02:50.493 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:50.493 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:50.493 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:50.493 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.493 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:50.493 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:02:50.493 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:50.493 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.493 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.494 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:50.494 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:02:50.494 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:50.494 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.494 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.494 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:50.494 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352214+0000", 2023-09-30T17:02:50.494 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8400000000000003e-07 2023-09-30T17:02:50.494 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.494 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.494 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:50.495 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352233+0000", 2023-09-30T17:02:50.495 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8946000000000001e-05 2023-09-30T17:02:50.495 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.495 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.495 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:50.495 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352297+0000", 2023-09-30T17:02:50.495 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3540999999999994e-05 2023-09-30T17:02:50.495 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.495 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.495 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:50.495 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352450+0000", 2023-09-30T17:02:50.496 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015364799999999999 2023-09-30T17:02:50.496 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.496 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.496 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:50.496 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353098+0000", 2023-09-30T17:02:50.496 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00064820299999999997 2023-09-30T17:02:50.496 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.496 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.496 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:02:50.496 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353103+0000", 2023-09-30T17:02:50.496 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0529999999999997e-06 2023-09-30T17:02:50.497 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.497 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.497 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:50.497 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.358558+0000", 2023-09-30T17:02:50.497 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0054550249999999996 2023-09-30T17:02:50.497 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.497 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.497 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:50.497 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.358741+0000", 2023-09-30T17:02:50.497 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00018210200000000001 2023-09-30T17:02:50.497 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.497 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.498 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:50.498 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.359683+0000", 2023-09-30T17:02:50.498 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00094202299999999995 2023-09-30T17:02:50.498 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.498 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.498 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:02:50.498 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365044+0000", 2023-09-30T17:02:50.498 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053616219999999999 2023-09-30T17:02:50.498 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.498 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.498 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:50.499 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375256+0000", 2023-09-30T17:02:50.499 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010212156 2023-09-30T17:02:50.499 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.499 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.499 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:50.499 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375300+0000", 2023-09-30T17:02:50.499 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3961999999999997e-05 2023-09-30T17:02:50.499 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.499 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.499 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:50.499 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375334+0000", 2023-09-30T17:02:50.500 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.324e-05 2023-09-30T17:02:50.500 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:50.500 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:50.500 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:50.500 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.500 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.500 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:50.500 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:02:50.500 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 32.096393319000001, 2023-09-30T17:02:50.500 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024240660000000001, 2023-09-30T17:02:50.500 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:50.501 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:50.501 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:50.501 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.501 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:50.501 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:02:50.501 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:50.501 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.501 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.501 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:50.501 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:02:50.501 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:50.502 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.502 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.502 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:50.502 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352529+0000", 2023-09-30T17:02:50.502 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1379999999999999e-06 2023-09-30T17:02:50.502 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.502 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.502 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:50.502 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352536+0000", 2023-09-30T17:02:50.502 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3489999999999997e-06 2023-09-30T17:02:50.502 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.502 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.503 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:50.503 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352547+0000", 2023-09-30T17:02:50.503 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1109e-05 2023-09-30T17:02:50.503 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.503 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.503 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:50.503 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352560+0000", 2023-09-30T17:02:50.503 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3046e-05 2023-09-30T17:02:50.503 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.503 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.503 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:50.503 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353142+0000", 2023-09-30T17:02:50.504 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00058174699999999997 2023-09-30T17:02:50.504 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.504 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.504 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:50.504 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353147+0000", 2023-09-30T17:02:50.504 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5840000000000002e-06 2023-09-30T17:02:50.504 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.504 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.504 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:50.504 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360374+0000", 2023-09-30T17:02:50.504 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0072270049999999999 2023-09-30T17:02:50.505 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.505 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.505 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:50.505 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360795+0000", 2023-09-30T17:02:50.505 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00042088999999999999 2023-09-30T17:02:50.505 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.505 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.505 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:50.505 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360967+0000", 2023-09-30T17:02:50.505 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017235699999999999 2023-09-30T17:02:50.505 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.505 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.506 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:02:50.506 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365051+0000", 2023-09-30T17:02:50.506 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0040837429999999999 2023-09-30T17:02:50.506 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.506 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.506 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:50.506 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376708+0000", 2023-09-30T17:02:50.506 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011656866 2023-09-30T17:02:50.506 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.506 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.506 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:50.507 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376745+0000", 2023-09-30T17:02:50.507 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6769e-05 2023-09-30T17:02:50.507 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.507 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.507 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:50.507 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376769+0000", 2023-09-30T17:02:50.507 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4057e-05 2023-09-30T17:02:50.507 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:50.507 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:50.507 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:50.507 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.507 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.508 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:50.508 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:02:50.508 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 32.096133964000003, 2023-09-30T17:02:50.508 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023472704, 2023-09-30T17:02:50.508 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:50.508 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:50.508 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:50.508 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.508 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:50.508 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:02:50.508 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:50.508 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.509 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.509 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:50.509 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:02:50.509 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:50.509 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.509 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.509 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:50.509 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:02:50.509 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8000000000000005e-07 2023-09-30T17:02:50.509 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.509 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.509 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:50.510 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352794+0000", 2023-09-30T17:02:50.510 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.789e-06 2023-09-30T17:02:50.510 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.510 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.510 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:50.510 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352805+0000", 2023-09-30T17:02:50.510 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0848e-05 2023-09-30T17:02:50.510 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.510 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.510 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:50.510 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352812+0000", 2023-09-30T17:02:50.511 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4449999999999999e-06 2023-09-30T17:02:50.511 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.511 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.511 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:50.511 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353063+0000", 2023-09-30T17:02:50.511 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00025046299999999998 2023-09-30T17:02:50.511 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.511 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.511 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:02:50.511 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353071+0000", 2023-09-30T17:02:50.511 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6739999999999997e-06 2023-09-30T17:02:50.511 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.512 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.512 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:50.512 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361696+0000", 2023-09-30T17:02:50.512 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0086251609999999992 2023-09-30T17:02:50.512 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.512 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.512 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:50.512 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362284+0000", 2023-09-30T17:02:50.512 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00058872299999999998 2023-09-30T17:02:50.512 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.512 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.513 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:50.513 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362429+0000", 2023-09-30T17:02:50.513 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014509000000000001 2023-09-30T17:02:50.513 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.513 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.513 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:02:50.513 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365330+0000", 2023-09-30T17:02:50.513 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0029005419999999999 2023-09-30T17:02:50.513 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.513 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.513 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:50.514 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376196+0000", 2023-09-30T17:02:50.514 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.01086615 2023-09-30T17:02:50.514 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.514 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.514 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:50.514 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376230+0000", 2023-09-30T17:02:50.514 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3858e-05 2023-09-30T17:02:50.514 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.514 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.514 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:50.514 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376260+0000", 2023-09-30T17:02:50.515 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0181000000000001e-05 2023-09-30T17:02:50.515 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:50.515 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:50.515 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:50.515 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.515 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.515 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:50.515 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:02:50.515 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 32.095900393999997, 2023-09-30T17:02:50.515 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023406132999999999, 2023-09-30T17:02:50.515 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:50.515 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:50.516 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:50.516 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.516 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:50.516 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:02:50.516 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:50.516 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.516 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.516 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:50.516 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:02:50.516 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:50.516 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.517 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.517 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:50.517 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353022+0000", 2023-09-30T17:02:50.517 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.78e-07 2023-09-30T17:02:50.517 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.517 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.517 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:50.517 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353027+0000", 2023-09-30T17:02:50.517 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9089999999999999e-06 2023-09-30T17:02:50.517 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.517 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.518 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:50.518 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353035+0000", 2023-09-30T17:02:50.518 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0430000000000008e-06 2023-09-30T17:02:50.518 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.518 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.518 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:50.518 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353047+0000", 2023-09-30T17:02:50.518 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1674e-05 2023-09-30T17:02:50.518 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.518 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.518 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:50.519 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353105+0000", 2023-09-30T17:02:50.519 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8891999999999998e-05 2023-09-30T17:02:50.519 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.519 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.519 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:50.519 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353112+0000", 2023-09-30T17:02:50.519 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7059999999999998e-06 2023-09-30T17:02:50.519 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.519 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.519 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:50.519 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362733+0000", 2023-09-30T17:02:50.520 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0096205869999999999 2023-09-30T17:02:50.520 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.520 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.520 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:50.520 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362833+0000", 2023-09-30T17:02:50.520 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000100227 2023-09-30T17:02:50.520 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.520 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.520 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:50.520 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363000+0000", 2023-09-30T17:02:50.520 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016670899999999999 2023-09-30T17:02:50.521 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.521 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.521 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:02:50.521 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365550+0000", 2023-09-30T17:02:50.521 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0025499199999999998 2023-09-30T17:02:50.521 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.521 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.521 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:50.521 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376315+0000", 2023-09-30T17:02:50.521 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010765011999999999 2023-09-30T17:02:50.521 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.522 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.522 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:50.522 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376386+0000", 2023-09-30T17:02:50.522 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0866999999999998e-05 2023-09-30T17:02:50.522 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.522 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.522 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:50.522 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376427+0000", 2023-09-30T17:02:50.522 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1709000000000003e-05 2023-09-30T17:02:50.522 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:50.522 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:50.523 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:50.523 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.523 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.523 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:50.523 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:02:50.523 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 32.095859758000003, 2023-09-30T17:02:50.523 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024076238, 2023-09-30T17:02:50.523 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:50.523 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:50.523 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:50.523 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.523 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:50.524 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:02:50.524 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:50.524 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.524 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.524 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:50.524 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:02:50.524 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:50.524 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.524 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.524 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:50.524 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:02:50.524 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8699999999999995e-07 2023-09-30T17:02:50.525 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.525 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.525 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:50.525 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353067+0000", 2023-09-30T17:02:50.525 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.605e-06 2023-09-30T17:02:50.525 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.525 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.525 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:50.525 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353073+0000", 2023-09-30T17:02:50.525 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8900000000000004e-06 2023-09-30T17:02:50.525 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.526 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.526 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:50.526 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353083+0000", 2023-09-30T17:02:50.526 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0200000000000001e-05 2023-09-30T17:02:50.526 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.526 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.526 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:50.526 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353186+0000", 2023-09-30T17:02:50.526 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010256599999999999 2023-09-30T17:02:50.526 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.526 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.527 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:50.527 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353190+0000", 2023-09-30T17:02:50.527 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9709999999999998e-06 2023-09-30T17:02:50.527 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.527 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.527 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:50.527 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362946+0000", 2023-09-30T17:02:50.527 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0097563330000000007 2023-09-30T17:02:50.527 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.527 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.527 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:50.527 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363088+0000", 2023-09-30T17:02:50.528 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014259200000000001 2023-09-30T17:02:50.528 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.528 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.528 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:50.528 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363555+0000", 2023-09-30T17:02:50.528 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00046627799999999998 2023-09-30T17:02:50.528 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.528 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.528 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:02:50.528 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365871+0000", 2023-09-30T17:02:50.528 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0023167589999999998 2023-09-30T17:02:50.529 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.529 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.529 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:50.529 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377033+0000", 2023-09-30T17:02:50.529 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011161203999999999 2023-09-30T17:02:50.529 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.529 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.529 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:50.529 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377100+0000", 2023-09-30T17:02:50.529 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7230999999999994e-05 2023-09-30T17:02:50.529 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.529 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.530 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:50.530 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377138+0000", 2023-09-30T17:02:50.530 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8022000000000003e-05 2023-09-30T17:02:50.530 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:50.530 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:50.530 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:50.530 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.530 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.530 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:50.530 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:02:50.530 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 32.095758809000003, 2023-09-30T17:02:50.530 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.020304412000000001, 2023-09-30T17:02:50.531 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:50.531 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:02:50.531 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:50.531 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.531 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:50.531 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:02:50.531 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:50.531 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.531 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.531 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:50.531 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:02:50.531 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:50.532 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.532 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.532 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:50.532 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353164+0000", 2023-09-30T17:02:50.532 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7100000000000011e-07 2023-09-30T17:02:50.532 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.532 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.532 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:50.532 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353168+0000", 2023-09-30T17:02:50.532 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0600000000000001e-06 2023-09-30T17:02:50.532 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.532 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.533 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:50.533 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353177+0000", 2023-09-30T17:02:50.533 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1409999999999994e-06 2023-09-30T17:02:50.533 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.533 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.533 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:50.533 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353185+0000", 2023-09-30T17:02:50.533 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2479999999999996e-06 2023-09-30T17:02:50.533 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.533 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.533 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:50.533 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353246+0000", 2023-09-30T17:02:50.534 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0519000000000001e-05 2023-09-30T17:02:50.534 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.534 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.534 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:02:50.534 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353252+0000", 2023-09-30T17:02:50.534 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7859999999999999e-06 2023-09-30T17:02:50.534 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.534 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.534 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:50.534 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354979+0000", 2023-09-30T17:02:50.534 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0017270090000000001 2023-09-30T17:02:50.535 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.535 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.535 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:50.535 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355097+0000", 2023-09-30T17:02:50.535 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000117472 2023-09-30T17:02:50.535 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.535 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.535 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:50.535 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.373467+0000", 2023-09-30T17:02:50.535 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.018370206 2023-09-30T17:02:50.535 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:50.536 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:50.536 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:50.536 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.536 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.536 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:50.536 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:02:50.536 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 32.095718071, 2023-09-30T17:02:50.536 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.012725089, 2023-09-30T17:02:50.536 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:50.536 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:02:50.536 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:50.536 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.537 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:50.537 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:02:50.537 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:50.537 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.537 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.537 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:50.537 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:02:50.537 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:50.537 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.537 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.537 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:50.537 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353204+0000", 2023-09-30T17:02:50.538 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7100000000000002e-07 2023-09-30T17:02:50.538 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.538 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.538 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:50.538 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353213+0000", 2023-09-30T17:02:50.538 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8580000000000006e-06 2023-09-30T17:02:50.538 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.538 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.538 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:50.538 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353219+0000", 2023-09-30T17:02:50.538 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8939999999999998e-06 2023-09-30T17:02:50.539 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.539 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.539 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:50.539 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353223+0000", 2023-09-30T17:02:50.539 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.357e-06 2023-09-30T17:02:50.539 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.539 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.539 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:50.539 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353278+0000", 2023-09-30T17:02:50.539 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5228e-05 2023-09-30T17:02:50.539 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.539 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.540 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:02:50.540 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353284+0000", 2023-09-30T17:02:50.540 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8209999999999998e-06 2023-09-30T17:02:50.540 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.540 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.540 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:50.540 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355095+0000", 2023-09-30T17:02:50.540 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001811404 2023-09-30T17:02:50.540 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.540 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.540 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:50.540 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355256+0000", 2023-09-30T17:02:50.541 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000160898 2023-09-30T17:02:50.541 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.541 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.541 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:50.541 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365928+0000", 2023-09-30T17:02:50.541 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010672157999999999 2023-09-30T17:02:50.541 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:50.541 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:50.541 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:50.541 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.542 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.542 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-09-30T17:02:50.542 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:02:50.542 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 32.095186863999999, 2023-09-30T17:02:50.542 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0056863460000000001, 2023-09-30T17:02:50.542 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:50.542 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "reached pg", 2023-09-30T17:02:50.542 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:50.542 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.542 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:50.542 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:02:50.543 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:50.543 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.543 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.543 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:50.543 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:02:50.543 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:50.543 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.543 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.543 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:50.543 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:02:50.543 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5700000000000002e-07 2023-09-30T17:02:50.543 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.544 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.544 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:50.544 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353747+0000", 2023-09-30T17:02:50.544 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1899000000000001e-05 2023-09-30T17:02:50.544 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.544 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.544 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:50.544 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353776+0000", 2023-09-30T17:02:50.544 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.8767000000000001e-05 2023-09-30T17:02:50.544 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.544 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.545 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:50.545 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353792+0000", 2023-09-30T17:02:50.545 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5914999999999999e-05 2023-09-30T17:02:50.545 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.545 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.545 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:50.545 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353900+0000", 2023-09-30T17:02:50.545 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010774500000000001 2023-09-30T17:02:50.545 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.545 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.546 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:50.546 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.359421+0000", 2023-09-30T17:02:50.546 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0055213629999999996 2023-09-30T17:02:50.546 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:50.546 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:50.546 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:50.546 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.546 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.546 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:02:50.546 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:02:50.546 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 32.094515264000002, 2023-09-30T17:02:50.547 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0069196370000000002, 2023-09-30T17:02:50.547 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:50.547 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:50.547 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:50.547 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.547 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:50.547 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:02:50.547 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:50.547 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.547 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.547 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:50.547 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:02:50.548 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:50.548 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.548 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.548 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:50.548 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354407+0000", 2023-09-30T17:02:50.548 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7400000000000002e-07 2023-09-30T17:02:50.548 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.548 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.548 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:50.548 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354414+0000", 2023-09-30T17:02:50.548 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1040000000000001e-06 2023-09-30T17:02:50.548 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.549 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.549 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:50.549 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354425+0000", 2023-09-30T17:02:50.549 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1090000000000001e-05 2023-09-30T17:02:50.549 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.549 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.549 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:50.549 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354435+0000", 2023-09-30T17:02:50.549 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8169999999999994e-06 2023-09-30T17:02:50.549 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.549 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.549 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:50.550 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355741+0000", 2023-09-30T17:02:50.550 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0013063160000000001 2023-09-30T17:02:50.550 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.550 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.550 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:50.550 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355763+0000", 2023-09-30T17:02:50.550 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1688e-05 2023-09-30T17:02:50.550 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.550 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.550 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:50.550 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361289+0000", 2023-09-30T17:02:50.550 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0055258269999999996 2023-09-30T17:02:50.551 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.551 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.551 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:50.551 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361326+0000", 2023-09-30T17:02:50.551 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7020999999999997e-05 2023-09-30T17:02:50.551 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:50.551 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:50.551 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:50.551 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.551 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.551 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:30 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2023-09-30T17:02:50.552 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:02:50.552 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 32.093141306, 2023-09-30T17:02:50.552 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0069996629999999997, 2023-09-30T17:02:50.552 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:50.552 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:50.552 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:50.552 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.552 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:50.552 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:02:50.552 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:50.552 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.552 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.553 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:50.553 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:02:50.553 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:50.553 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.553 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.553 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:50.553 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355781+0000", 2023-09-30T17:02:50.553 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9599999999999999e-07 2023-09-30T17:02:50.553 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.553 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.553 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:50.553 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355788+0000", 2023-09-30T17:02:50.554 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8129999999999996e-06 2023-09-30T17:02:50.554 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.554 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.554 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:50.554 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355798+0000", 2023-09-30T17:02:50.554 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2909999999999996e-06 2023-09-30T17:02:50.554 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.554 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.554 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:50.554 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355807+0000", 2023-09-30T17:02:50.554 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8619999999999992e-06 2023-09-30T17:02:50.555 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.555 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.555 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:50.555 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.357264+0000", 2023-09-30T17:02:50.555 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0014578289999999999 2023-09-30T17:02:50.555 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.555 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.555 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:50.555 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.357916+0000", 2023-09-30T17:02:50.555 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00065170500000000004 2023-09-30T17:02:50.555 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.556 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.556 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:50.556 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362731+0000", 2023-09-30T17:02:50.556 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0048149849999999999 2023-09-30T17:02:50.556 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.556 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.556 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:50.556 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362780+0000", 2023-09-30T17:02:50.556 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8681999999999999e-05 2023-09-30T17:02:50.556 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:50.556 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:50.556 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:50.557 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.557 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.557 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2023-09-30T17:02:50.557 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:02:50.557 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 32.074490255000001, 2023-09-30T17:02:50.557 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005905998, 2023-09-30T17:02:50.557 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:50.557 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:50.557 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:50.557 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.557 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:50.558 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:02:50.558 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:50.558 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.558 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.558 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:50.558 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:02:50.558 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:50.558 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.558 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.558 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:50.558 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:02:50.559 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1e-07 2023-09-30T17:02:50.559 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.559 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.559 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:50.559 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374455+0000", 2023-09-30T17:02:50.559 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.3091999999999998e-05 2023-09-30T17:02:50.559 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.559 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.559 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:50.559 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374462+0000", 2023-09-30T17:02:50.559 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5170000000000002e-06 2023-09-30T17:02:50.559 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.560 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.560 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:50.560 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374469+0000", 2023-09-30T17:02:50.560 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8199999999999999e-06 2023-09-30T17:02:50.560 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.560 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.560 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:50.560 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374550+0000", 2023-09-30T17:02:50.560 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0978999999999998e-05 2023-09-30T17:02:50.560 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.560 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.560 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:50.561 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374562+0000", 2023-09-30T17:02:50.561 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2472e-05 2023-09-30T17:02:50.561 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.561 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.561 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:50.561 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380293+0000", 2023-09-30T17:02:50.561 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0057310379999999999 2023-09-30T17:02:50.561 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.561 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.561 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:50.561 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380337+0000", 2023-09-30T17:02:50.561 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3869999999999998e-05 2023-09-30T17:02:50.562 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:50.562 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:50.562 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:50.562 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.562 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.562 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2023-09-30T17:02:50.562 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:02:50.562 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 32.074303506, 2023-09-30T17:02:50.562 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0057590560000000002, 2023-09-30T17:02:50.562 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:50.562 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:50.562 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:50.563 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.563 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:50.563 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:02:50.563 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:50.563 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.563 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.563 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:50.563 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:02:50.563 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:50.563 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.563 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.564 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:50.564 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:02:50.564 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4900000000000001e-07 2023-09-30T17:02:50.564 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.564 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.564 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:50.564 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374629+0000", 2023-09-30T17:02:50.564 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1014e-05 2023-09-30T17:02:50.564 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.564 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.564 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:50.565 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374636+0000", 2023-09-30T17:02:50.565 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5889999999999999e-06 2023-09-30T17:02:50.565 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.565 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.565 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:50.565 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374642+0000", 2023-09-30T17:02:50.565 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.48e-06 2023-09-30T17:02:50.565 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.565 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.565 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:50.565 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374681+0000", 2023-09-30T17:02:50.566 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9320000000000003e-05 2023-09-30T17:02:50.566 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.566 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.566 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:50.566 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374694+0000", 2023-09-30T17:02:50.566 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3351e-05 2023-09-30T17:02:50.566 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.566 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.566 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:50.566 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380319+0000", 2023-09-30T17:02:50.566 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0056243880000000001 2023-09-30T17:02:50.567 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.567 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.567 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:50.567 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380377+0000", 2023-09-30T17:02:50.567 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8464999999999997e-05 2023-09-30T17:02:50.567 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:50.567 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:50.567 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:50.567 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.567 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.567 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=0'0)", 2023-09-30T17:02:50.567 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:02:50.568 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 32.073592595000001, 2023-09-30T17:02:50.568 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051157370000000004, 2023-09-30T17:02:50.568 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:50.568 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:50.568 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:50.568 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.568 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:50.568 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:02:50.568 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:50.568 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.568 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.569 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:50.569 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:02:50.569 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:50.569 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.569 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.569 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:50.569 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:02:50.569 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0199999999999998e-07 2023-09-30T17:02:50.569 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.569 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.569 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:50.569 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375334+0000", 2023-09-30T17:02:50.570 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8799999999999999e-06 2023-09-30T17:02:50.570 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.570 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.570 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:50.570 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375343+0000", 2023-09-30T17:02:50.570 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5490000000000006e-06 2023-09-30T17:02:50.570 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.570 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.570 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:50.570 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375350+0000", 2023-09-30T17:02:50.570 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5700000000000004e-06 2023-09-30T17:02:50.571 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.571 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.571 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:50.571 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375396+0000", 2023-09-30T17:02:50.571 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5550999999999998e-05 2023-09-30T17:02:50.571 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.571 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.571 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:50.571 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375410+0000", 2023-09-30T17:02:50.571 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4518999999999999e-05 2023-09-30T17:02:50.571 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.571 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.572 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:50.572 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380401+0000", 2023-09-30T17:02:50.572 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0049903430000000004 2023-09-30T17:02:50.572 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:50.572 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:50.572 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:50.572 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380445+0000", 2023-09-30T17:02:50.572 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4023000000000002e-05 2023-09-30T17:02:50.572 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:50.572 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:50.572 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:50.572 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:50.573 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:50.573 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:02:50.574 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:02:50.574 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:50.573+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:50.675 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:50.674+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:50.710 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:02:50.710 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:02:50.710 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2023-09-30T17:02:50.710 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:02:50.720 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:02:50.805 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:50.804+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:50.876 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:50.875+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:50.885 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:02:50.886 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:02:50.886 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2023-09-30T17:02:50.886 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2023-09-30T17:02:50.886 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:02:50.896 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:02:50.980 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:50.979+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:51.064 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:02:51.064 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2023-09-30T17:02:51.064 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2023-09-30T17:02:51.064 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2023-09-30T17:02:51.064 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.064 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:51.065 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:02:51.065 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 32.710975625000003, 2023-09-30T17:02:51.065 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093789779999999996, 2023-09-30T17:02:51.065 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:51.065 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:51.065 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:51.065 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.065 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:51.065 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:02:51.065 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:51.065 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.065 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.066 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:51.066 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:02:51.066 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:51.066 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.066 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.066 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:51.066 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352027+0000", 2023-09-30T17:02:51.066 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0224000000000001e-05 2023-09-30T17:02:51.066 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.066 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.066 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:51.067 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352039+0000", 2023-09-30T17:02:51.067 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1569000000000001e-05 2023-09-30T17:02:51.067 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.067 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.067 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:51.067 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352052+0000", 2023-09-30T17:02:51.067 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2605999999999999e-05 2023-09-30T17:02:51.067 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.067 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.067 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:51.067 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352064+0000", 2023-09-30T17:02:51.067 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2666999999999999e-05 2023-09-30T17:02:51.068 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.068 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.068 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:51.068 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352147+0000", 2023-09-30T17:02:51.068 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3125000000000001e-05 2023-09-30T17:02:51.068 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.068 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.068 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:51.068 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352306+0000", 2023-09-30T17:02:51.068 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015881900000000001 2023-09-30T17:02:51.068 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.069 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.069 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:51.069 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352450+0000", 2023-09-30T17:02:51.069 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014420700000000001 2023-09-30T17:02:51.069 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.069 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.069 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:51.069 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355975+0000", 2023-09-30T17:02:51.069 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003524246 2023-09-30T17:02:51.069 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.069 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.069 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:51.070 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361279+0000", 2023-09-30T17:02:51.070 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005304507 2023-09-30T17:02:51.070 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.070 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.070 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:51.070 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361344+0000", 2023-09-30T17:02:51.070 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4548999999999995e-05 2023-09-30T17:02:51.070 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.070 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.070 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:51.070 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361396+0000", 2023-09-30T17:02:51.071 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2459e-05 2023-09-30T17:02:51.071 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:51.071 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:51.071 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:51.071 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.071 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.071 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:51.071 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:02:51.071 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 32.710883332999998, 2023-09-30T17:02:51.071 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021233007000000002, 2023-09-30T17:02:51.071 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:51.071 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:51.072 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:51.072 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.072 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:51.072 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:02:51.072 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:51.072 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.072 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.072 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:51.072 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:02:51.072 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:51.072 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.072 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.073 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:51.073 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352110+0000", 2023-09-30T17:02:51.073 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6000000000000002e-07 2023-09-30T17:02:51.073 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.073 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.073 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:51.073 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352117+0000", 2023-09-30T17:02:51.073 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5930000000000002e-06 2023-09-30T17:02:51.073 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.073 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.073 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:51.073 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352126+0000", 2023-09-30T17:02:51.074 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0729999999999994e-06 2023-09-30T17:02:51.074 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.074 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.074 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:51.074 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352136+0000", 2023-09-30T17:02:51.074 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0380000000000001e-05 2023-09-30T17:02:51.074 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.074 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.074 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:51.074 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353279+0000", 2023-09-30T17:02:51.074 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0011424670000000001 2023-09-30T17:02:51.075 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.075 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.075 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:51.075 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353707+0000", 2023-09-30T17:02:51.075 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00042829800000000003 2023-09-30T17:02:51.075 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.075 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.075 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:51.075 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354104+0000", 2023-09-30T17:02:51.075 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00039643399999999998 2023-09-30T17:02:51.075 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.076 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.076 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:51.076 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356925+0000", 2023-09-30T17:02:51.076 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0028210900000000001 2023-09-30T17:02:51.076 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.076 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.076 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:51.076 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373243+0000", 2023-09-30T17:02:51.076 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016318461999999999 2023-09-30T17:02:51.076 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.076 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.076 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:51.077 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373301+0000", 2023-09-30T17:02:51.077 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7435000000000002e-05 2023-09-30T17:02:51.077 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.077 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.077 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:51.077 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373342+0000", 2023-09-30T17:02:51.077 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1915000000000001e-05 2023-09-30T17:02:51.077 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:51.077 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:51.077 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:51.077 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.077 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.078 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:51.078 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:02:51.078 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 32.710840722, 2023-09-30T17:02:51.078 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011988331, 2023-09-30T17:02:51.078 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:51.078 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:51.078 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:51.078 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.078 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:51.078 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:02:51.078 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:51.079 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.079 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.079 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:51.079 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:02:51.079 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:51.079 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.079 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.079 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:51.079 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352153+0000", 2023-09-30T17:02:51.079 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0500000000000003e-07 2023-09-30T17:02:51.079 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.079 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.080 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:51.080 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352157+0000", 2023-09-30T17:02:51.080 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9790000000000004e-06 2023-09-30T17:02:51.080 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.080 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.080 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:51.080 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352173+0000", 2023-09-30T17:02:51.080 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6535999999999999e-05 2023-09-30T17:02:51.080 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.080 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.080 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:51.081 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352180+0000", 2023-09-30T17:02:51.081 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7700000000000004e-06 2023-09-30T17:02:51.081 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.081 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.081 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:51.081 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353526+0000", 2023-09-30T17:02:51.081 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0013458330000000001 2023-09-30T17:02:51.081 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.081 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.081 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:51.081 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353648+0000", 2023-09-30T17:02:51.082 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012262899999999999 2023-09-30T17:02:51.082 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.082 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.082 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:02:51.082 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354141+0000", 2023-09-30T17:02:51.082 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00049222899999999995 2023-09-30T17:02:51.082 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.082 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.082 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:51.082 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356931+0000", 2023-09-30T17:02:51.082 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0027900860000000002 2023-09-30T17:02:51.082 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.083 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.083 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:51.083 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364066+0000", 2023-09-30T17:02:51.083 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071355050000000003 2023-09-30T17:02:51.083 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.083 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.083 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:51.083 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364103+0000", 2023-09-30T17:02:51.083 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6944999999999999e-05 2023-09-30T17:02:51.083 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.083 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.084 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:51.084 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364140+0000", 2023-09-30T17:02:51.084 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7214e-05 2023-09-30T17:02:51.084 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:51.084 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:51.084 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:51.084 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.084 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.084 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:51.084 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:02:51.084 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 32.710801490999998, 2023-09-30T17:02:51.085 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012110921, 2023-09-30T17:02:51.085 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:51.085 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:51.085 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:51.085 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.085 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:51.085 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:02:51.085 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:51.085 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.085 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.085 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:51.085 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:02:51.086 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:51.086 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.086 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.086 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:51.086 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352192+0000", 2023-09-30T17:02:51.086 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7300000000000005e-07 2023-09-30T17:02:51.086 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.086 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.086 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:51.086 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352196+0000", 2023-09-30T17:02:51.087 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2370000000000003e-06 2023-09-30T17:02:51.087 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.087 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.087 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:51.087 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352205+0000", 2023-09-30T17:02:51.087 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6659999999999997e-06 2023-09-30T17:02:51.087 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.087 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.087 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:51.087 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352214+0000", 2023-09-30T17:02:51.087 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8259999999999999e-06 2023-09-30T17:02:51.087 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.088 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.088 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:51.088 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354470+0000", 2023-09-30T17:02:51.088 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022557340000000001 2023-09-30T17:02:51.088 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.088 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.088 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:51.088 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354557+0000", 2023-09-30T17:02:51.088 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6909000000000004e-05 2023-09-30T17:02:51.088 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.088 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.088 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:02:51.089 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354694+0000", 2023-09-30T17:02:51.089 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013774800000000001 2023-09-30T17:02:51.089 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.089 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.089 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:51.089 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356937+0000", 2023-09-30T17:02:51.089 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022424540000000001 2023-09-30T17:02:51.089 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.089 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.089 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:51.089 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364227+0000", 2023-09-30T17:02:51.089 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072902430000000001 2023-09-30T17:02:51.090 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.090 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.090 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:51.090 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364278+0000", 2023-09-30T17:02:51.090 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1180999999999997e-05 2023-09-30T17:02:51.090 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.090 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.090 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:51.090 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364302+0000", 2023-09-30T17:02:51.090 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4049999999999998e-05 2023-09-30T17:02:51.090 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:51.090 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:51.091 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:51.091 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.091 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.091 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:51.091 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:02:51.091 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 32.710768152, 2023-09-30T17:02:51.091 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021258651999999999, 2023-09-30T17:02:51.091 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:51.091 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:51.091 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:51.091 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.092 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:51.092 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:02:51.092 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:51.092 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.092 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.092 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:51.092 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:02:51.092 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:51.092 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.092 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.092 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:51.092 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:02:51.093 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6899999999999997e-07 2023-09-30T17:02:51.093 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.093 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.093 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:51.093 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352236+0000", 2023-09-30T17:02:51.093 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0251000000000001e-05 2023-09-30T17:02:51.093 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.093 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.093 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:51.093 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352244+0000", 2023-09-30T17:02:51.093 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0770000000000008e-06 2023-09-30T17:02:51.094 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.094 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.094 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:51.094 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352251+0000", 2023-09-30T17:02:51.094 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4749999999999996e-06 2023-09-30T17:02:51.094 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.094 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.094 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:51.094 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354455+0000", 2023-09-30T17:02:51.094 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022043660000000001 2023-09-30T17:02:51.094 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.095 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.095 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:51.095 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354577+0000", 2023-09-30T17:02:51.095 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000121054 2023-09-30T17:02:51.095 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.095 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.095 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:51.095 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354723+0000", 2023-09-30T17:02:51.095 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014693900000000001 2023-09-30T17:02:51.095 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.095 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.096 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:51.096 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356941+0000", 2023-09-30T17:02:51.096 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002217199 2023-09-30T17:02:51.096 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.096 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.096 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:51.096 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373392+0000", 2023-09-30T17:02:51.096 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016451774999999998 2023-09-30T17:02:51.096 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.096 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.096 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:51.096 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373445+0000", 2023-09-30T17:02:51.097 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.308e-05 2023-09-30T17:02:51.097 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.097 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.097 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:51.097 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373483+0000", 2023-09-30T17:02:51.097 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7766999999999999e-05 2023-09-30T17:02:51.097 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:51.097 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:51.097 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:51.097 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.097 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.098 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:51.098 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:02:51.098 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 32.710732061000002, 2023-09-30T17:02:51.098 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020903497, 2023-09-30T17:02:51.098 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:51.098 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:51.098 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:51.098 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.098 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:51.098 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:02:51.098 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:51.098 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.099 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.099 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:51.099 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:02:51.099 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:51.099 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.099 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.099 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:51.099 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:02:51.099 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0800000000000004e-07 2023-09-30T17:02:51.099 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.099 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.099 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:51.100 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352266+0000", 2023-09-30T17:02:51.100 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1280000000000001e-06 2023-09-30T17:02:51.100 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.100 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.100 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:51.100 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352273+0000", 2023-09-30T17:02:51.100 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3730000000000004e-06 2023-09-30T17:02:51.100 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.100 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.100 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:51.100 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352279+0000", 2023-09-30T17:02:51.101 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7699999999999998e-06 2023-09-30T17:02:51.101 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.101 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.101 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:51.101 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352334+0000", 2023-09-30T17:02:51.101 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5547999999999997e-05 2023-09-30T17:02:51.101 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.101 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.101 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:51.101 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352435+0000", 2023-09-30T17:02:51.101 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100688 2023-09-30T17:02:51.102 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.102 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.102 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:51.102 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352585+0000", 2023-09-30T17:02:51.102 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000150068 2023-09-30T17:02:51.102 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.102 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.102 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:51.102 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354912+0000", 2023-09-30T17:02:51.102 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0023266770000000001 2023-09-30T17:02:51.102 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.103 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.103 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:51.103 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373066+0000", 2023-09-30T17:02:51.103 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018154474 2023-09-30T17:02:51.103 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.103 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.103 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:51.103 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373122+0000", 2023-09-30T17:02:51.103 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6193000000000002e-05 2023-09-30T17:02:51.103 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.103 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.103 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:51.104 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373164+0000", 2023-09-30T17:02:51.104 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1869999999999997e-05 2023-09-30T17:02:51.104 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:51.104 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:51.104 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:51.104 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.104 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.104 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:51.104 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:02:51.104 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 32.710696384999999, 2023-09-30T17:02:51.104 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021015097999999999, 2023-09-30T17:02:51.104 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:51.105 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:51.105 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:51.105 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.105 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:51.105 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:02:51.105 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:51.105 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.105 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.105 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:51.105 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:02:51.105 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:51.106 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.106 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.106 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:51.106 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352297+0000", 2023-09-30T17:02:51.106 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8299999999999997e-07 2023-09-30T17:02:51.106 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.106 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.106 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:51.106 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352300+0000", 2023-09-30T17:02:51.106 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7460000000000001e-06 2023-09-30T17:02:51.106 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.106 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.107 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:51.107 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352307+0000", 2023-09-30T17:02:51.107 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4959999999999999e-06 2023-09-30T17:02:51.107 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.107 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.107 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:51.107 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352314+0000", 2023-09-30T17:02:51.107 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0190000000000001e-06 2023-09-30T17:02:51.107 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.107 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.107 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:51.107 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354070+0000", 2023-09-30T17:02:51.108 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001755936 2023-09-30T17:02:51.108 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.108 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.108 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:51.108 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354221+0000", 2023-09-30T17:02:51.108 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000150884 2023-09-30T17:02:51.108 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.108 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.108 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:51.108 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373311+0000", 2023-09-30T17:02:51.108 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019090434 2023-09-30T17:02:51.109 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:51.109 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:51.109 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:51.109 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.109 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.109 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:51.109 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:02:51.109 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 32.710667665999999, 2023-09-30T17:02:51.109 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021255174000000002, 2023-09-30T17:02:51.109 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:51.109 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:51.109 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:51.110 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.110 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:51.110 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:02:51.110 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:51.110 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.110 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.110 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:51.110 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:02:51.110 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:51.110 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.110 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.111 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:51.111 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352326+0000", 2023-09-30T17:02:51.111 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3200000000000005e-07 2023-09-30T17:02:51.111 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.111 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.111 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:51.111 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352349+0000", 2023-09-30T17:02:51.111 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3183000000000001e-05 2023-09-30T17:02:51.111 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.111 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.111 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:51.112 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352358+0000", 2023-09-30T17:02:51.112 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5230000000000001e-06 2023-09-30T17:02:51.112 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.112 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.112 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:51.112 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352365+0000", 2023-09-30T17:02:51.112 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3260000000000001e-06 2023-09-30T17:02:51.112 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.112 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.112 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:51.112 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355450+0000", 2023-09-30T17:02:51.112 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0030854049999999998 2023-09-30T17:02:51.113 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.113 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.113 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:51.113 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355583+0000", 2023-09-30T17:02:51.113 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000133189 2023-09-30T17:02:51.113 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.113 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.113 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:51.113 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373580+0000", 2023-09-30T17:02:51.113 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017997016000000001 2023-09-30T17:02:51.113 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:51.113 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:51.114 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:51.114 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.114 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.114 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:51.114 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:02:51.114 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 32.710616242999997, 2023-09-30T17:02:51.114 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010380537, 2023-09-30T17:02:51.114 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:51.114 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:51.114 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:51.115 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.115 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:51.115 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:02:51.115 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:51.115 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.115 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.115 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:51.115 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:02:51.115 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:51.115 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.115 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.116 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:51.116 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:02:51.116 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1500000000000003e-07 2023-09-30T17:02:51.116 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.116 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.116 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:51.116 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352381+0000", 2023-09-30T17:02:51.116 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6330000000000002e-06 2023-09-30T17:02:51.116 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.116 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.116 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:51.117 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352388+0000", 2023-09-30T17:02:51.117 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7229999999999998e-06 2023-09-30T17:02:51.117 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.117 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.117 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:51.117 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352394+0000", 2023-09-30T17:02:51.117 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1789999999999996e-06 2023-09-30T17:02:51.117 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.117 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.117 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:51.117 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353259+0000", 2023-09-30T17:02:51.117 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000865221 2023-09-30T17:02:51.118 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.118 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.118 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:51.118 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353391+0000", 2023-09-30T17:02:51.118 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013217700000000001 2023-09-30T17:02:51.118 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.118 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.118 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:51.118 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362757+0000", 2023-09-30T17:02:51.118 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093657889999999994 2023-09-30T17:02:51.118 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:51.119 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:51.119 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:51.119 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.119 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.119 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-09-30T17:02:51.119 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:02:51.119 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 32.704315950999998, 2023-09-30T17:02:51.119 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0061813579999999996, 2023-09-30T17:02:51.119 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:51.119 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2023-09-30T17:02:51.119 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:51.119 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.120 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:51.120 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:02:51.120 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:51.120 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.120 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.120 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:51.120 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:02:51.120 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:51.120 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.120 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.120 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:51.120 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:02:51.121 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5499999999999999e-07 2023-09-30T17:02:51.121 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.121 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.121 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:51.121 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358686+0000", 2023-09-30T17:02:51.121 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9979999999999992e-06 2023-09-30T17:02:51.121 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.121 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.121 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:51.121 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358700+0000", 2023-09-30T17:02:51.121 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3635000000000001e-05 2023-09-30T17:02:51.122 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.122 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.122 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:51.122 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358714+0000", 2023-09-30T17:02:51.122 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4470999999999999e-05 2023-09-30T17:02:51.122 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.122 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.122 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:51.122 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358767+0000", 2023-09-30T17:02:51.122 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2651999999999997e-05 2023-09-30T17:02:51.122 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.123 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.123 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:51.123 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364858+0000", 2023-09-30T17:02:51.123 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060912470000000002 2023-09-30T17:02:51.123 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:51.123 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:51.123 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:51.123 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.123 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.123 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2023-09-30T17:02:51.123 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:02:51.123 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 32.701951111, 2023-09-30T17:02:51.124 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00036246299999999999, 2023-09-30T17:02:51.124 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:51.124 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:51.124 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:51.124 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.124 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:51.124 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:02:51.124 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:51.124 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.124 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.124 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:51.124 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:02:51.125 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:51.125 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.125 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.125 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:51.125 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:02:51.125 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3099999999999999e-07 2023-09-30T17:02:51.125 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.125 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.125 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:51.125 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361045+0000", 2023-09-30T17:02:51.125 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.49e-06 2023-09-30T17:02:51.126 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.126 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.126 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:51.126 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361056+0000", 2023-09-30T17:02:51.126 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0910000000000001e-05 2023-09-30T17:02:51.126 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.126 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.126 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:51.126 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361067+0000", 2023-09-30T17:02:51.126 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0531e-05 2023-09-30T17:02:51.126 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.127 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.127 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:51.127 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361263+0000", 2023-09-30T17:02:51.127 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000196486 2023-09-30T17:02:51.127 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.127 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.127 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:51.127 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361273+0000", 2023-09-30T17:02:51.127 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3379999999999994e-06 2023-09-30T17:02:51.127 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.127 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.127 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:51.128 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361404+0000", 2023-09-30T17:02:51.128 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013137700000000001 2023-09-30T17:02:51.128 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:51.128 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:51.128 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:51.128 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.128 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.128 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:31 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:02:51.128 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:02:51.128 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 32.700975081999999, 2023-09-30T17:02:51.128 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006676408, 2023-09-30T17:02:51.129 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:51.129 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:51.129 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:51.129 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.129 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:51.129 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:02:51.129 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:51.129 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.129 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.129 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:51.129 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:02:51.129 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:51.130 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.130 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.130 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:51.130 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:02:51.130 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5600000000000002e-07 2023-09-30T17:02:51.130 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.130 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.130 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:51.130 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362044+0000", 2023-09-30T17:02:51.130 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5987999999999999e-05 2023-09-30T17:02:51.130 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.131 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.131 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:51.131 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362051+0000", 2023-09-30T17:02:51.131 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2599999999999999e-06 2023-09-30T17:02:51.131 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.131 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.131 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:51.131 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362057+0000", 2023-09-30T17:02:51.131 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.19e-06 2023-09-30T17:02:51.131 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.131 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.132 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:51.132 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362096+0000", 2023-09-30T17:02:51.132 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8278000000000002e-05 2023-09-30T17:02:51.132 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.132 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.132 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:51.132 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362114+0000", 2023-09-30T17:02:51.132 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8808e-05 2023-09-30T17:02:51.132 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.132 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.132 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:51.132 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368658+0000", 2023-09-30T17:02:51.133 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065433540000000004 2023-09-30T17:02:51.133 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.133 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:51.133 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368694+0000", 2023-09-30T17:02:51.133 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6273999999999999e-05 2023-09-30T17:02:51.133 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:51.133 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:51.133 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:51.133 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.133 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:26 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-09-30T17:02:51.134 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:02:51.134 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 32.700884309999999, 2023-09-30T17:02:51.134 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0066596119999999996, 2023-09-30T17:02:51.134 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:51.134 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:51.134 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:51.134 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.134 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:51.134 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:02:51.134 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:51.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.135 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.135 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:51.135 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:02:51.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:51.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.135 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.135 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:51.135 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362109+0000", 2023-09-30T17:02:51.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5699999999999999e-07 2023-09-30T17:02:51.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.135 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.136 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:51.136 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362112+0000", 2023-09-30T17:02:51.136 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8410000000000002e-06 2023-09-30T17:02:51.136 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.136 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.136 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:51.136 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362117+0000", 2023-09-30T17:02:51.136 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.792e-06 2023-09-30T17:02:51.136 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.136 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.136 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:51.136 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362122+0000", 2023-09-30T17:02:51.137 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.763e-06 2023-09-30T17:02:51.137 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.137 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.137 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:51.137 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362344+0000", 2023-09-30T17:02:51.137 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022181600000000001 2023-09-30T17:02:51.137 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.137 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.137 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:51.137 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362357+0000", 2023-09-30T17:02:51.137 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2864000000000001e-05 2023-09-30T17:02:51.137 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.138 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.138 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:51.138 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368738+0000", 2023-09-30T17:02:51.138 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063809499999999998 2023-09-30T17:02:51.138 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.138 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.138 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:51.138 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368768+0000", 2023-09-30T17:02:51.138 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0429e-05 2023-09-30T17:02:51.138 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:51.138 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:51.138 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:51.139 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.139 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.139 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2023-09-30T17:02:51.139 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:02:51.139 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 32.699668142999997, 2023-09-30T17:02:51.139 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00082185400000000001, 2023-09-30T17:02:51.139 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:51.139 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:51.139 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:51.139 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.139 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:51.139 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:02:51.140 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:51.140 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.140 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.140 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:51.140 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:02:51.140 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:51.140 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.140 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.140 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:51.140 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:02:51.140 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.22e-07 2023-09-30T17:02:51.140 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.141 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.141 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:51.141 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363327+0000", 2023-09-30T17:02:51.141 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4480000000000001e-06 2023-09-30T17:02:51.141 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.141 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.141 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:51.141 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363333+0000", 2023-09-30T17:02:51.141 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9989999999999997e-06 2023-09-30T17:02:51.141 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.141 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.142 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:51.142 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363354+0000", 2023-09-30T17:02:51.142 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0547000000000002e-05 2023-09-30T17:02:51.142 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.142 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.142 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:51.142 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364057+0000", 2023-09-30T17:02:51.142 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00070306600000000002 2023-09-30T17:02:51.142 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.142 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.142 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:51.142 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364063+0000", 2023-09-30T17:02:51.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.694e-06 2023-09-30T17:02:51.143 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.143 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.143 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:51.143 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364146+0000", 2023-09-30T17:02:51.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3877999999999999e-05 2023-09-30T17:02:51.143 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:51.143 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:51.143 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:51.143 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.143 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.143 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e18/16 ondisk, result = 0)", 2023-09-30T17:02:51.144 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:02:51.144 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 32.699354610999997, 2023-09-30T17:02:51.144 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00067007199999999996, 2023-09-30T17:02:51.144 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:51.144 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:51.144 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:51.144 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.144 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:51.144 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:02:51.144 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:51.144 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.145 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.145 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:51.145 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:02:51.145 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:51.145 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.145 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.145 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:51.145 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:02:51.145 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.41e-07 2023-09-30T17:02:51.145 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.145 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.145 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:51.146 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363641+0000", 2023-09-30T17:02:51.146 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4830000000000002e-06 2023-09-30T17:02:51.146 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.146 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.146 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:51.146 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363647+0000", 2023-09-30T17:02:51.146 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4869999999999999e-06 2023-09-30T17:02:51.146 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.146 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.146 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:51.147 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363654+0000", 2023-09-30T17:02:51.147 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5889999999999999e-06 2023-09-30T17:02:51.147 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.147 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.147 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:51.147 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364217+0000", 2023-09-30T17:02:51.147 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00056263199999999998 2023-09-30T17:02:51.147 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.147 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.147 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:51.147 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364222+0000", 2023-09-30T17:02:51.148 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.242e-06 2023-09-30T17:02:51.148 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.148 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.148 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:51.148 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364308+0000", 2023-09-30T17:02:51.148 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6397999999999995e-05 2023-09-30T17:02:51.148 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:51.148 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:51.148 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:51.148 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.148 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.149 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2023-09-30T17:02:51.149 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:02:51.149 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 32.689766701000003, 2023-09-30T17:02:51.149 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000359561, 2023-09-30T17:02:51.149 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:51.149 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2023-09-30T17:02:51.149 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:51.149 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.149 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:51.149 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:02:51.149 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:51.149 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.150 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.150 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:51.150 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:02:51.150 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:51.150 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.150 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.150 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:51.150 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:02:51.150 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1e-07 2023-09-30T17:02:51.150 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.150 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.151 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:51.151 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373228+0000", 2023-09-30T17:02:51.151 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9420000000000002e-06 2023-09-30T17:02:51.151 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.151 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.151 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:51.151 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373235+0000", 2023-09-30T17:02:51.151 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4230000000000002e-06 2023-09-30T17:02:51.151 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.151 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.151 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:51.151 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373239+0000", 2023-09-30T17:02:51.152 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6809999999999997e-06 2023-09-30T17:02:51.152 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.152 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.152 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:51.152 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373518+0000", 2023-09-30T17:02:51.152 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000278311 2023-09-30T17:02:51.152 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.152 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.152 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:51.152 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373586+0000", 2023-09-30T17:02:51.152 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7994e-05 2023-09-30T17:02:51.153 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:51.153 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:51.153 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:51.153 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.153 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.153 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:02:51.153 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:02:51.153 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 32.685340627999999, 2023-09-30T17:02:51.153 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0046632949999999996, 2023-09-30T17:02:51.153 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:51.153 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:51.154 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:51.154 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.154 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:51.154 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:02:51.154 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:51.154 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.154 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.154 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:51.154 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:02:51.154 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:51.155 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.155 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.155 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:51.155 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377653+0000", 2023-09-30T17:02:51.155 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7800000000000002e-07 2023-09-30T17:02:51.155 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.155 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.155 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:51.155 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377657+0000", 2023-09-30T17:02:51.155 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5859999999999998e-06 2023-09-30T17:02:51.155 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.155 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.156 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:51.156 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377677+0000", 2023-09-30T17:02:51.156 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9508999999999999e-05 2023-09-30T17:02:51.156 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.156 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.156 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:51.156 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377682+0000", 2023-09-30T17:02:51.156 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8300000000000001e-06 2023-09-30T17:02:51.156 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.156 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.156 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:51.157 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377725+0000", 2023-09-30T17:02:51.157 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2425000000000001e-05 2023-09-30T17:02:51.157 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.157 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.157 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:51.157 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377738+0000", 2023-09-30T17:02:51.157 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2899e-05 2023-09-30T17:02:51.157 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.157 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.157 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:51.157 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382268+0000", 2023-09-30T17:02:51.158 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045301289999999999 2023-09-30T17:02:51.158 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.158 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.158 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:51.158 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382315+0000", 2023-09-30T17:02:51.158 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7539e-05 2023-09-30T17:02:51.158 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:51.158 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:51.158 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:51.158 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.159 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.159 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-09-30T17:02:51.159 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:02:51.159 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 32.684891176999997, 2023-09-30T17:02:51.159 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042540670000000003, 2023-09-30T17:02:51.159 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:51.159 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:51.159 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:51.159 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.159 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:51.159 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:02:51.159 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:51.160 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.160 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.160 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:51.160 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:02:51.160 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:51.160 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.160 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.160 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:51.160 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:02:51.160 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0299999999999998e-07 2023-09-30T17:02:51.160 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.160 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.161 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:51.161 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378107+0000", 2023-09-30T17:02:51.161 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9250000000000003e-06 2023-09-30T17:02:51.161 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.161 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.161 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:51.161 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378116+0000", 2023-09-30T17:02:51.161 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.037e-06 2023-09-30T17:02:51.161 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.161 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.161 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:51.161 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378123+0000", 2023-09-30T17:02:51.162 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1879999999999996e-06 2023-09-30T17:02:51.162 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.162 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.162 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:51.162 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378174+0000", 2023-09-30T17:02:51.162 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0998000000000002e-05 2023-09-30T17:02:51.162 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.162 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.162 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:51.162 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378197+0000", 2023-09-30T17:02:51.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2558e-05 2023-09-30T17:02:51.163 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.163 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.163 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:51.163 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382319+0000", 2023-09-30T17:02:51.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041220950000000001 2023-09-30T17:02:51.163 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.163 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.163 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:51.163 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382356+0000", 2023-09-30T17:02:51.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6563000000000002e-05 2023-09-30T17:02:51.163 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:51.164 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:51.164 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:51.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.164 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-09-30T17:02:51.164 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:02:51.164 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 28.627127352999999, 2023-09-30T17:02:51.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00171641, 2023-09-30T17:02:51.164 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:51.164 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:51.164 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:51.165 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.165 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:51.165 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:02:51.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:51.165 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.165 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.165 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:51.165 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:02:51.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:51.165 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.165 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.166 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:51.166 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435868+0000", 2023-09-30T17:02:51.166 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5840000000000002e-06 2023-09-30T17:02:51.166 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.166 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:51.166 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435892+0000", 2023-09-30T17:02:51.166 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3625000000000002e-05 2023-09-30T17:02:51.166 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.166 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:51.167 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435908+0000", 2023-09-30T17:02:51.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6548000000000001e-05 2023-09-30T17:02:51.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.167 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:51.167 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435935+0000", 2023-09-30T17:02:51.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6516000000000002e-05 2023-09-30T17:02:51.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.167 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:51.167 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435996+0000", 2023-09-30T17:02:51.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1433999999999995e-05 2023-09-30T17:02:51.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:51.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436114+0000", 2023-09-30T17:02:51.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000118344 2023-09-30T17:02:51.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:51.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436219+0000", 2023-09-30T17:02:51.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010453100000000001 2023-09-30T17:02:51.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:51.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436900+0000", 2023-09-30T17:02:51.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00068121299999999996 2023-09-30T17:02:51.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:51.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437508+0000", 2023-09-30T17:02:51.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00060817399999999995 2023-09-30T17:02:51.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:51.170 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437554+0000", 2023-09-30T17:02:51.170 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5609000000000003e-05 2023-09-30T17:02:51.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.170 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:51.170 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437582+0000", 2023-09-30T17:02:51.170 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7832000000000001e-05 2023-09-30T17:02:51.170 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:51.170 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:51.170 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:51.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.171 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2023-09-30T17:02:51.171 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:02:51.171 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 8.6268158590000006, 2023-09-30T17:02:51.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001456199, 2023-09-30T17:02:51.171 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:51.171 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:51.171 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:51.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:51.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:02:51.172 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:51.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.172 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:51.172 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:02:51.172 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:51.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.172 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:51.172 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436178+0000", 2023-09-30T17:02:51.172 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.494e-06 2023-09-30T17:02:51.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.173 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:51.173 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436184+0000", 2023-09-30T17:02:51.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2809999999999999e-06 2023-09-30T17:02:51.173 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.173 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:51.173 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436198+0000", 2023-09-30T17:02:51.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3978000000000001e-05 2023-09-30T17:02:51.173 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:51.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436206+0000", 2023-09-30T17:02:51.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8040000000000007e-06 2023-09-30T17:02:51.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:51.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436268+0000", 2023-09-30T17:02:51.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1484999999999998e-05 2023-09-30T17:02:51.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.175 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:51.175 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436339+0000", 2023-09-30T17:02:51.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1000000000000005e-05 2023-09-30T17:02:51.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.175 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:51.175 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436438+0000", 2023-09-30T17:02:51.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9389000000000007e-05 2023-09-30T17:02:51.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:51.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436986+0000", 2023-09-30T17:02:51.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054723399999999996 2023-09-30T17:02:51.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:51.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437566+0000", 2023-09-30T17:02:51.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00058017599999999996 2023-09-30T17:02:51.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:51.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437606+0000", 2023-09-30T17:02:51.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9891999999999997e-05 2023-09-30T17:02:51.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:51.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:51.177 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:51.177 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437633+0000", 2023-09-30T17:02:51.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7466000000000001e-05 2023-09-30T17:02:51.177 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:51.177 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:51.177 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:51.177 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:51.177 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:51.178 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:02:51.179 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:02:51.179 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:51.178+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:51.262 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-09-30T17:02:51.279 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:51.279+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:51.325 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:02:51.325 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:02:51.325 INFO:teuthology.orchestra.run.smithi031.stdout: "num_ops": 0 2023-09-30T17:02:51.325 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:02:51.335 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:02:51.380 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:51.379+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:51.420 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:02:51.429 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T17:02:51.444 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:02:51.444 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-09-30T17:02:51.444 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-09-30T17:02:51.445 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:02:51.447 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:02:51.447 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:02:51.467 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:51.468 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:51.478 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:02:51.518 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:51.518+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:51.539 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off 2023-09-30T17:02:51.581 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:51.580+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:51.639 INFO:teuthology.orchestra.console.smithi134:Power off completed 2023-09-30T17:02:51.649 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:51.649 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:51.659 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:02:51.703 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:51.702+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:51.782 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:51.781+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:51.790 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:51.790 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:51.800 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:02:51.883 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:51.883+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:51.965 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:51.965 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:51.975 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:02:51.984 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:51.984+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:52.084 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:52.084+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:52.101 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:52.101 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:52.111 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:02:52.185 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:52.184+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:52.249 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:52.249 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:52.259 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:02:52.285 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:52.285+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:52.287 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-09-30T17:02:52.386 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:52.385+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:52.431 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:52.431 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:52.441 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:02:52.487 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:52.486+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:52.588 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:52.587+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:52.614 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:52.614 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:52.624 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:02:52.689 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:52.688+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:52.754 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:52.754 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:52.764 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:02:52.805 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:52.804+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:52.892 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:52.891+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:52.930 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:52.930 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:52.940 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:02:52.992 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:52.991+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:53.066 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:53.066 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:53.076 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:02:53.119 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:53.119+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:53.195 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:53.194+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:53.213 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:53.213 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:53.223 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:02:53.281 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is set 2023-09-30T17:02:53.283 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~6s 2023-09-30T17:02:53.307 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:53.307+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:53.396 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:53.396 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:53.396 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:53.396+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:53.406 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:02:53.449 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-09-30T17:02:53.497 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:53.497+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:53.578 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:53.578 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:53.588 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:02:53.598 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:53.598+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:53.602 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:02:53.622 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:02:53.622 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-09-30T17:02:53.622 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-09-30T17:02:53.623 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:02:53.625 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:02:53.625 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:02:53.699 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:53.698+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:53.722 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:02:53.722 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:02:53.723 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2023-09-30T17:02:53.723 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:02:53.732 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:02:53.800 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:53.799+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:53.858 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:02:53.858 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:02:53.858 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2023-09-30T17:02:53.858 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2023-09-30T17:02:53.859 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:02:53.868 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:02:53.912 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:53.911+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:53.996 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:02:53.996 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2023-09-30T17:02:53.996 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2023-09-30T17:02:53.996 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2023-09-30T17:02:53.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:53.997 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:53.997 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:02:53.997 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 35.642944272999998, 2023-09-30T17:02:53.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093789779999999996, 2023-09-30T17:02:53.997 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:53.997 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:53.997 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:53.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:53.997 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:53.997 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:02:53.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:53.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:53.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:53.998 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:53.998 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:02:53.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:53.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:53.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:53.998 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:53.998 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352027+0000", 2023-09-30T17:02:53.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0224000000000001e-05 2023-09-30T17:02:53.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:53.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:53.999 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:53.999 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352039+0000", 2023-09-30T17:02:53.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1569000000000001e-05 2023-09-30T17:02:53.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:53.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:53.999 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:53.999 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352052+0000", 2023-09-30T17:02:53.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2605999999999999e-05 2023-09-30T17:02:53.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:53.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:53.999 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:53.999 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352064+0000", 2023-09-30T17:02:54.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2666999999999999e-05 2023-09-30T17:02:54.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.000 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:54.000 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352147+0000", 2023-09-30T17:02:54.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3125000000000001e-05 2023-09-30T17:02:54.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.000 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:54.000 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352306+0000", 2023-09-30T17:02:54.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015881900000000001 2023-09-30T17:02:54.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.001 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:54.001 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352450+0000", 2023-09-30T17:02:54.001 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014420700000000001 2023-09-30T17:02:54.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.001 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:54.001 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355975+0000", 2023-09-30T17:02:54.001 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003524246 2023-09-30T17:02:54.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.001 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:54.002 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361279+0000", 2023-09-30T17:02:54.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005304507 2023-09-30T17:02:54.002 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.002 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:54.002 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361344+0000", 2023-09-30T17:02:54.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4548999999999995e-05 2023-09-30T17:02:54.002 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.002 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:54.002 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361396+0000", 2023-09-30T17:02:54.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2459e-05 2023-09-30T17:02:54.003 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:54.003 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:54.003 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:54.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.003 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.003 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:54.003 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:02:54.003 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 35.642851981, 2023-09-30T17:02:54.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021233007000000002, 2023-09-30T17:02:54.003 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:54.003 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:54.004 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:54.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:54.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:02:54.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:54.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:54.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:02:54.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:54.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.005 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:54.005 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352110+0000", 2023-09-30T17:02:54.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6000000000000002e-07 2023-09-30T17:02:54.005 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.005 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:54.005 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352117+0000", 2023-09-30T17:02:54.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5930000000000002e-06 2023-09-30T17:02:54.005 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.005 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:54.005 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352126+0000", 2023-09-30T17:02:54.006 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0729999999999994e-06 2023-09-30T17:02:54.006 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.006 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:54.006 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352136+0000", 2023-09-30T17:02:54.006 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0380000000000001e-05 2023-09-30T17:02:54.006 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.006 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:54.006 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353279+0000", 2023-09-30T17:02:54.006 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0011424670000000001 2023-09-30T17:02:54.006 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.007 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:54.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353707+0000", 2023-09-30T17:02:54.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00042829800000000003 2023-09-30T17:02:54.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.007 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:54.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354104+0000", 2023-09-30T17:02:54.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00039643399999999998 2023-09-30T17:02:54.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.007 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:54.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356925+0000", 2023-09-30T17:02:54.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0028210900000000001 2023-09-30T17:02:54.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.008 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:54.008 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373243+0000", 2023-09-30T17:02:54.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016318461999999999 2023-09-30T17:02:54.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.008 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:54.008 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373301+0000", 2023-09-30T17:02:54.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7435000000000002e-05 2023-09-30T17:02:54.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.009 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:54.009 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373342+0000", 2023-09-30T17:02:54.009 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1915000000000001e-05 2023-09-30T17:02:54.009 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:54.009 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:54.009 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:54.009 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.009 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:54.009 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:02:54.009 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 35.642809370000002, 2023-09-30T17:02:54.010 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011988331, 2023-09-30T17:02:54.010 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:54.010 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:54.010 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:54.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.010 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:54.010 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:02:54.010 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:54.010 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.010 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:54.010 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:02:54.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:54.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:54.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352153+0000", 2023-09-30T17:02:54.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0500000000000003e-07 2023-09-30T17:02:54.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:54.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352157+0000", 2023-09-30T17:02:54.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9790000000000004e-06 2023-09-30T17:02:54.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:54.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352173+0000", 2023-09-30T17:02:54.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6535999999999999e-05 2023-09-30T17:02:54.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:54.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352180+0000", 2023-09-30T17:02:54.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7700000000000004e-06 2023-09-30T17:02:54.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:54.013 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353526+0000", 2023-09-30T17:02:54.013 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0013458330000000001 2023-09-30T17:02:54.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.013 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:54.013 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353648+0000", 2023-09-30T17:02:54.013 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012262899999999999 2023-09-30T17:02:54.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.013 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:02:54.013 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354141+0000", 2023-09-30T17:02:54.013 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00049222899999999995 2023-09-30T17:02:54.014 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.014 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.014 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:54.014 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356931+0000", 2023-09-30T17:02:54.014 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0027900860000000002 2023-09-30T17:02:54.014 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.014 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.014 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:54.014 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364066+0000", 2023-09-30T17:02:54.014 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071355050000000003 2023-09-30T17:02:54.014 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:54.015 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364103+0000", 2023-09-30T17:02:54.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6944999999999999e-05 2023-09-30T17:02:54.015 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:54.015 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364140+0000", 2023-09-30T17:02:54.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7214e-05 2023-09-30T17:02:54.015 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:54.015 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:54.015 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:54.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.016 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:54.016 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:02:54.016 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 35.642770139, 2023-09-30T17:02:54.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012110921, 2023-09-30T17:02:54.016 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:54.016 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:54.016 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:54.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:54.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:02:54.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:54.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:54.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:02:54.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:54.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:54.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352192+0000", 2023-09-30T17:02:54.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7300000000000005e-07 2023-09-30T17:02:54.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.018 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:54.018 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352196+0000", 2023-09-30T17:02:54.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2370000000000003e-06 2023-09-30T17:02:54.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.018 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:54.018 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352205+0000", 2023-09-30T17:02:54.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6659999999999997e-06 2023-09-30T17:02:54.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.019 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:54.019 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352214+0000", 2023-09-30T17:02:54.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8259999999999999e-06 2023-09-30T17:02:54.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.019 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:54.019 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354470+0000", 2023-09-30T17:02:54.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022557340000000001 2023-09-30T17:02:54.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.019 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:54.019 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354557+0000", 2023-09-30T17:02:54.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6909000000000004e-05 2023-09-30T17:02:54.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:02:54.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354694+0000", 2023-09-30T17:02:54.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013774800000000001 2023-09-30T17:02:54.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:54.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356937+0000", 2023-09-30T17:02:54.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022424540000000001 2023-09-30T17:02:54.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.021 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:54.021 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364227+0000", 2023-09-30T17:02:54.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072902430000000001 2023-09-30T17:02:54.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.021 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:54.021 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364278+0000", 2023-09-30T17:02:54.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1180999999999997e-05 2023-09-30T17:02:54.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.021 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:54.022 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364302+0000", 2023-09-30T17:02:54.022 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4049999999999998e-05 2023-09-30T17:02:54.022 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:54.022 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:54.022 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:54.022 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.022 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.022 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:54.022 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:02:54.022 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 35.642736800000002, 2023-09-30T17:02:54.022 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021258651999999999, 2023-09-30T17:02:54.023 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:54.023 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:54.023 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:54.023 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.023 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:54.023 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:02:54.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:54.023 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.023 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.023 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:54.023 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:02:54.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:54.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.024 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:54.024 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:02:54.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6899999999999997e-07 2023-09-30T17:02:54.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.024 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:54.024 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352236+0000", 2023-09-30T17:02:54.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0251000000000001e-05 2023-09-30T17:02:54.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.025 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:54.025 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352244+0000", 2023-09-30T17:02:54.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0770000000000008e-06 2023-09-30T17:02:54.025 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.025 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.025 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:54.025 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352251+0000", 2023-09-30T17:02:54.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4749999999999996e-06 2023-09-30T17:02:54.025 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.025 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.025 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:54.025 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354455+0000", 2023-09-30T17:02:54.026 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022043660000000001 2023-09-30T17:02:54.026 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.026 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:54.026 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354577+0000", 2023-09-30T17:02:54.026 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000121054 2023-09-30T17:02:54.026 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.026 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:54.026 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354723+0000", 2023-09-30T17:02:54.026 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014693900000000001 2023-09-30T17:02:54.027 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.027 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:54.027 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356941+0000", 2023-09-30T17:02:54.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002217199 2023-09-30T17:02:54.027 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.027 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:54.027 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373392+0000", 2023-09-30T17:02:54.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016451774999999998 2023-09-30T17:02:54.027 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.028 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:54.028 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373445+0000", 2023-09-30T17:02:54.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.308e-05 2023-09-30T17:02:54.028 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.028 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.028 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:54.028 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373483+0000", 2023-09-30T17:02:54.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7766999999999999e-05 2023-09-30T17:02:54.028 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:54.028 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:54.028 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:54.028 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.029 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:54.029 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:02:54.029 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 35.642700709000003, 2023-09-30T17:02:54.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020903497, 2023-09-30T17:02:54.029 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:54.029 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:54.029 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:54.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.029 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:54.029 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:02:54.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:54.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.030 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:54.030 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:02:54.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:54.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.030 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:54.030 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:02:54.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0800000000000004e-07 2023-09-30T17:02:54.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:54.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352266+0000", 2023-09-30T17:02:54.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1280000000000001e-06 2023-09-30T17:02:54.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:54.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352273+0000", 2023-09-30T17:02:54.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3730000000000004e-06 2023-09-30T17:02:54.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:54.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352279+0000", 2023-09-30T17:02:54.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7699999999999998e-06 2023-09-30T17:02:54.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.032 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:54.032 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352334+0000", 2023-09-30T17:02:54.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5547999999999997e-05 2023-09-30T17:02:54.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.032 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:54.032 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352435+0000", 2023-09-30T17:02:54.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100688 2023-09-30T17:02:54.033 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.033 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.033 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:54.033 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352585+0000", 2023-09-30T17:02:54.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000150068 2023-09-30T17:02:54.033 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.033 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.033 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:54.033 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354912+0000", 2023-09-30T17:02:54.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0023266770000000001 2023-09-30T17:02:54.033 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.033 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.034 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:54.034 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373066+0000", 2023-09-30T17:02:54.034 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018154474 2023-09-30T17:02:54.034 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.034 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:54.034 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373122+0000", 2023-09-30T17:02:54.034 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6193000000000002e-05 2023-09-30T17:02:54.034 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.034 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:54.034 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373164+0000", 2023-09-30T17:02:54.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1869999999999997e-05 2023-09-30T17:02:54.035 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:54.035 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:54.035 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:54.035 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.035 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.035 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:54.035 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:02:54.035 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 35.642665033, 2023-09-30T17:02:54.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021015097999999999, 2023-09-30T17:02:54.035 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:54.035 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:54.036 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:54.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:54.036 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:02:54.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:54.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:54.036 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:02:54.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:54.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:54.037 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352297+0000", 2023-09-30T17:02:54.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8299999999999997e-07 2023-09-30T17:02:54.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:54.037 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352300+0000", 2023-09-30T17:02:54.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7460000000000001e-06 2023-09-30T17:02:54.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:54.037 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352307+0000", 2023-09-30T17:02:54.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4959999999999999e-06 2023-09-30T17:02:54.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.038 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:54.038 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352314+0000", 2023-09-30T17:02:54.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0190000000000001e-06 2023-09-30T17:02:54.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.038 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:54.038 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354070+0000", 2023-09-30T17:02:54.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001755936 2023-09-30T17:02:54.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.039 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:54.039 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354221+0000", 2023-09-30T17:02:54.039 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000150884 2023-09-30T17:02:54.039 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.039 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:54.039 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373311+0000", 2023-09-30T17:02:54.039 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019090434 2023-09-30T17:02:54.039 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:54.039 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:54.039 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:54.040 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.040 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.040 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:54.040 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:02:54.040 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 35.642636314000001, 2023-09-30T17:02:54.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021255174000000002, 2023-09-30T17:02:54.040 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:54.040 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:54.040 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:54.040 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.040 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:54.040 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:02:54.041 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:54.041 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.041 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.041 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:54.041 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:02:54.041 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:54.041 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.041 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.041 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:54.041 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352326+0000", 2023-09-30T17:02:54.041 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3200000000000005e-07 2023-09-30T17:02:54.042 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.042 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.042 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:54.042 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352349+0000", 2023-09-30T17:02:54.042 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3183000000000001e-05 2023-09-30T17:02:54.042 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.042 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.042 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:54.042 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352358+0000", 2023-09-30T17:02:54.042 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5230000000000001e-06 2023-09-30T17:02:54.042 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.043 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.043 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:54.043 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352365+0000", 2023-09-30T17:02:54.043 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3260000000000001e-06 2023-09-30T17:02:54.043 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.043 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.043 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:54.043 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355450+0000", 2023-09-30T17:02:54.043 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0030854049999999998 2023-09-30T17:02:54.043 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.043 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.043 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:54.043 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355583+0000", 2023-09-30T17:02:54.044 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000133189 2023-09-30T17:02:54.044 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.044 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.044 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:54.044 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373580+0000", 2023-09-30T17:02:54.044 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017997016000000001 2023-09-30T17:02:54.044 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:54.044 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:54.044 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:54.044 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.044 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.045 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:54.045 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:02:54.045 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 35.642584890999998, 2023-09-30T17:02:54.045 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010380537, 2023-09-30T17:02:54.045 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:54.045 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:54.045 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:54.045 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.045 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:54.045 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:02:54.045 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:54.045 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.046 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.046 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:54.046 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:02:54.046 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:54.046 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.046 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.046 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:54.046 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:02:54.046 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1500000000000003e-07 2023-09-30T17:02:54.046 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.046 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.046 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:54.047 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352381+0000", 2023-09-30T17:02:54.047 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6330000000000002e-06 2023-09-30T17:02:54.047 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.047 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.047 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:54.047 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352388+0000", 2023-09-30T17:02:54.047 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7229999999999998e-06 2023-09-30T17:02:54.047 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.047 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.047 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:54.047 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352394+0000", 2023-09-30T17:02:54.047 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1789999999999996e-06 2023-09-30T17:02:54.048 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.048 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.048 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:54.048 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353259+0000", 2023-09-30T17:02:54.048 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000865221 2023-09-30T17:02:54.048 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.048 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.048 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:54.048 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353391+0000", 2023-09-30T17:02:54.048 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013217700000000001 2023-09-30T17:02:54.048 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.049 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.049 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:54.049 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362757+0000", 2023-09-30T17:02:54.049 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093657889999999994 2023-09-30T17:02:54.049 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:54.049 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:54.049 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:54.049 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.049 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.049 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-09-30T17:02:54.049 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:02:54.049 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 35.636284599, 2023-09-30T17:02:54.049 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0061813579999999996, 2023-09-30T17:02:54.050 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:54.050 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2023-09-30T17:02:54.050 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:54.050 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.050 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:54.050 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:02:54.050 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:54.050 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.050 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.050 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:54.050 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:02:54.051 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:54.051 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.051 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.051 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:54.051 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:02:54.051 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5499999999999999e-07 2023-09-30T17:02:54.051 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.051 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.051 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:54.051 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358686+0000", 2023-09-30T17:02:54.051 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9979999999999992e-06 2023-09-30T17:02:54.051 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.052 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:54.052 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358700+0000", 2023-09-30T17:02:54.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3635000000000001e-05 2023-09-30T17:02:54.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.052 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:54.052 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358714+0000", 2023-09-30T17:02:54.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4470999999999999e-05 2023-09-30T17:02:54.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.052 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:54.053 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358767+0000", 2023-09-30T17:02:54.053 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2651999999999997e-05 2023-09-30T17:02:54.053 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.053 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.053 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:54.053 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364858+0000", 2023-09-30T17:02:54.053 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060912470000000002 2023-09-30T17:02:54.053 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:54.053 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:54.053 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:54.053 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.053 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.054 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2023-09-30T17:02:54.054 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:02:54.054 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 35.633919759000001, 2023-09-30T17:02:54.054 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00036246299999999999, 2023-09-30T17:02:54.054 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:54.054 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:54.054 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:54.054 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.054 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:54.054 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:02:54.054 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:54.054 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.055 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.055 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:54.055 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:02:54.055 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:54.055 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.055 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.055 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:54.055 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:02:54.055 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3099999999999999e-07 2023-09-30T17:02:54.055 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.055 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.055 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:54.055 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361045+0000", 2023-09-30T17:02:54.056 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.49e-06 2023-09-30T17:02:54.056 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.056 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.056 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:54.056 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361056+0000", 2023-09-30T17:02:54.056 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0910000000000001e-05 2023-09-30T17:02:54.056 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.056 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.056 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:54.056 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361067+0000", 2023-09-30T17:02:54.056 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0531e-05 2023-09-30T17:02:54.056 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.057 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.057 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:54.057 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361263+0000", 2023-09-30T17:02:54.057 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000196486 2023-09-30T17:02:54.057 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.057 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.057 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:54.057 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361273+0000", 2023-09-30T17:02:54.057 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3379999999999994e-06 2023-09-30T17:02:54.057 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.057 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.057 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:54.058 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361404+0000", 2023-09-30T17:02:54.058 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013137700000000001 2023-09-30T17:02:54.058 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:54.058 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:54.058 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:54.058 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.058 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.058 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:31 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:02:54.058 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:02:54.058 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 35.632943730000001, 2023-09-30T17:02:54.058 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006676408, 2023-09-30T17:02:54.058 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:54.059 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:54.059 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:54.059 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.059 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:54.059 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:02:54.059 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:54.059 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.059 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.059 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:54.059 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:02:54.061 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:54.061 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.061 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.061 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:54.061 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:02:54.061 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5600000000000002e-07 2023-09-30T17:02:54.061 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.061 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.061 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:54.062 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362044+0000", 2023-09-30T17:02:54.062 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5987999999999999e-05 2023-09-30T17:02:54.062 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.062 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.062 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:54.062 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362051+0000", 2023-09-30T17:02:54.062 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2599999999999999e-06 2023-09-30T17:02:54.062 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.062 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.062 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:54.062 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362057+0000", 2023-09-30T17:02:54.063 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.19e-06 2023-09-30T17:02:54.063 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.063 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.063 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:54.063 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362096+0000", 2023-09-30T17:02:54.063 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8278000000000002e-05 2023-09-30T17:02:54.063 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.063 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.063 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:54.063 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362114+0000", 2023-09-30T17:02:54.063 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8808e-05 2023-09-30T17:02:54.063 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.064 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.064 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:54.064 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368658+0000", 2023-09-30T17:02:54.064 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065433540000000004 2023-09-30T17:02:54.064 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.064 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.064 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:54.064 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368694+0000", 2023-09-30T17:02:54.064 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6273999999999999e-05 2023-09-30T17:02:54.064 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:54.064 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:54.064 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:54.065 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.065 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.065 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:26 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-09-30T17:02:54.065 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:02:54.065 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 35.632852958000001, 2023-09-30T17:02:54.065 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0066596119999999996, 2023-09-30T17:02:54.065 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:54.065 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:54.065 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:54.065 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.065 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:54.065 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:02:54.066 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:54.066 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.066 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.066 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:54.066 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:02:54.066 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:54.066 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.066 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.066 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:54.066 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362109+0000", 2023-09-30T17:02:54.066 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5699999999999999e-07 2023-09-30T17:02:54.066 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.067 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.067 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:54.067 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362112+0000", 2023-09-30T17:02:54.067 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8410000000000002e-06 2023-09-30T17:02:54.067 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.067 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.067 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:54.067 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362117+0000", 2023-09-30T17:02:54.067 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.792e-06 2023-09-30T17:02:54.067 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.067 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.067 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:54.068 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362122+0000", 2023-09-30T17:02:54.068 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.763e-06 2023-09-30T17:02:54.068 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.068 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.068 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:54.068 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362344+0000", 2023-09-30T17:02:54.068 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022181600000000001 2023-09-30T17:02:54.068 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.068 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.068 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:54.068 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362357+0000", 2023-09-30T17:02:54.068 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2864000000000001e-05 2023-09-30T17:02:54.069 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.069 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.069 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:54.069 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368738+0000", 2023-09-30T17:02:54.069 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063809499999999998 2023-09-30T17:02:54.069 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.069 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.069 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:54.069 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368768+0000", 2023-09-30T17:02:54.069 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0429e-05 2023-09-30T17:02:54.069 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:54.069 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:54.070 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:54.070 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.070 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.070 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2023-09-30T17:02:54.070 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:02:54.070 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 35.631636790999998, 2023-09-30T17:02:54.070 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00082185400000000001, 2023-09-30T17:02:54.070 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:54.070 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:54.070 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:54.070 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.070 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:54.071 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:02:54.071 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:54.071 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.071 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.071 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:54.071 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:02:54.071 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:54.071 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.071 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.071 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:54.071 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:02:54.071 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.22e-07 2023-09-30T17:02:54.072 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.072 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.072 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:54.072 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363327+0000", 2023-09-30T17:02:54.072 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4480000000000001e-06 2023-09-30T17:02:54.072 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.072 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.072 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:54.072 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363333+0000", 2023-09-30T17:02:54.072 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9989999999999997e-06 2023-09-30T17:02:54.072 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.072 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.073 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:54.073 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363354+0000", 2023-09-30T17:02:54.073 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0547000000000002e-05 2023-09-30T17:02:54.073 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.073 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.073 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:54.073 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364057+0000", 2023-09-30T17:02:54.073 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00070306600000000002 2023-09-30T17:02:54.073 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.073 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.073 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:54.073 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364063+0000", 2023-09-30T17:02:54.074 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.694e-06 2023-09-30T17:02:54.074 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.074 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.074 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:54.074 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364146+0000", 2023-09-30T17:02:54.074 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3877999999999999e-05 2023-09-30T17:02:54.074 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:54.074 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:54.074 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:54.074 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.074 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.074 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e18/16 ondisk, result = 0)", 2023-09-30T17:02:54.075 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:02:54.075 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 35.631323258999998, 2023-09-30T17:02:54.075 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00067007199999999996, 2023-09-30T17:02:54.075 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:54.075 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:54.075 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:54.075 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.075 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:54.075 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:02:54.075 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:54.075 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.075 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.076 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:54.076 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:02:54.076 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:54.076 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.076 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.076 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:54.076 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:02:54.076 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.41e-07 2023-09-30T17:02:54.076 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.076 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.076 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:54.076 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363641+0000", 2023-09-30T17:02:54.077 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4830000000000002e-06 2023-09-30T17:02:54.077 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.077 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.077 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:54.077 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363647+0000", 2023-09-30T17:02:54.077 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4869999999999999e-06 2023-09-30T17:02:54.077 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.077 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.077 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:54.077 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363654+0000", 2023-09-30T17:02:54.077 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5889999999999999e-06 2023-09-30T17:02:54.077 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.078 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.078 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:54.078 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364217+0000", 2023-09-30T17:02:54.078 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00056263199999999998 2023-09-30T17:02:54.078 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.078 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.078 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:54.078 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364222+0000", 2023-09-30T17:02:54.078 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.242e-06 2023-09-30T17:02:54.078 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.078 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.078 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:54.079 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364308+0000", 2023-09-30T17:02:54.079 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6397999999999995e-05 2023-09-30T17:02:54.079 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:54.079 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:54.079 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:54.079 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.079 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.079 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2023-09-30T17:02:54.079 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:02:54.079 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 35.621735348999998, 2023-09-30T17:02:54.079 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000359561, 2023-09-30T17:02:54.080 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:54.080 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2023-09-30T17:02:54.080 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:54.080 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.080 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:54.080 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:02:54.080 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:54.080 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.080 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.080 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:54.080 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:02:54.080 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:54.080 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.081 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.081 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:54.081 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:02:54.081 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1e-07 2023-09-30T17:02:54.081 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.081 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.081 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:54.081 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373228+0000", 2023-09-30T17:02:54.081 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9420000000000002e-06 2023-09-30T17:02:54.081 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.081 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.082 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:54.082 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373235+0000", 2023-09-30T17:02:54.082 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4230000000000002e-06 2023-09-30T17:02:54.082 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.082 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.082 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:54.082 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373239+0000", 2023-09-30T17:02:54.082 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6809999999999997e-06 2023-09-30T17:02:54.082 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.082 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.082 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:54.082 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373518+0000", 2023-09-30T17:02:54.083 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000278311 2023-09-30T17:02:54.083 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.083 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.083 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:54.083 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373586+0000", 2023-09-30T17:02:54.083 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7994e-05 2023-09-30T17:02:54.083 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:54.083 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:54.083 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:54.083 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.083 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.083 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:02:54.084 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:02:54.084 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 35.617309276, 2023-09-30T17:02:54.084 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0046632949999999996, 2023-09-30T17:02:54.084 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:54.084 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:54.084 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:54.084 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.084 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:54.084 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:02:54.084 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:54.084 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.084 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.085 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:54.085 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:02:54.085 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:54.085 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.085 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.085 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:54.085 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377653+0000", 2023-09-30T17:02:54.085 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7800000000000002e-07 2023-09-30T17:02:54.085 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.085 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.085 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:54.085 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377657+0000", 2023-09-30T17:02:54.086 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5859999999999998e-06 2023-09-30T17:02:54.086 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.086 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.086 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:54.086 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377677+0000", 2023-09-30T17:02:54.086 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9508999999999999e-05 2023-09-30T17:02:54.086 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.086 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.086 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:54.086 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377682+0000", 2023-09-30T17:02:54.086 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8300000000000001e-06 2023-09-30T17:02:54.086 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.087 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.087 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:54.087 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377725+0000", 2023-09-30T17:02:54.087 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2425000000000001e-05 2023-09-30T17:02:54.087 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.087 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.087 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:54.087 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377738+0000", 2023-09-30T17:02:54.087 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2899e-05 2023-09-30T17:02:54.087 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.087 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.087 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:54.087 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382268+0000", 2023-09-30T17:02:54.088 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045301289999999999 2023-09-30T17:02:54.088 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.088 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.088 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:54.088 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382315+0000", 2023-09-30T17:02:54.088 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7539e-05 2023-09-30T17:02:54.088 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:54.088 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:54.088 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:54.088 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.088 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.088 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-09-30T17:02:54.089 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:02:54.089 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 35.616859824999999, 2023-09-30T17:02:54.089 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042540670000000003, 2023-09-30T17:02:54.089 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:54.089 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:54.089 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:54.089 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.089 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:54.089 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:02:54.089 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:54.089 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.089 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.090 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:54.090 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:02:54.090 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:54.090 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.090 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.090 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:54.090 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:02:54.090 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0299999999999998e-07 2023-09-30T17:02:54.090 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.090 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.090 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:54.091 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378107+0000", 2023-09-30T17:02:54.091 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9250000000000003e-06 2023-09-30T17:02:54.091 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.091 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.091 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:54.091 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378116+0000", 2023-09-30T17:02:54.091 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.037e-06 2023-09-30T17:02:54.091 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.091 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.091 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:54.091 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378123+0000", 2023-09-30T17:02:54.091 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1879999999999996e-06 2023-09-30T17:02:54.092 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.092 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.092 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:54.092 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378174+0000", 2023-09-30T17:02:54.092 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0998000000000002e-05 2023-09-30T17:02:54.092 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.092 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.092 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:54.092 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378197+0000", 2023-09-30T17:02:54.092 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2558e-05 2023-09-30T17:02:54.092 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.092 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.093 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:54.093 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382319+0000", 2023-09-30T17:02:54.093 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041220950000000001 2023-09-30T17:02:54.093 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.093 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.093 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:54.093 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382356+0000", 2023-09-30T17:02:54.093 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6563000000000002e-05 2023-09-30T17:02:54.093 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:54.093 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:54.093 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:54.093 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.093 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.094 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-09-30T17:02:54.094 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:02:54.094 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 31.559096001, 2023-09-30T17:02:54.094 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00171641, 2023-09-30T17:02:54.094 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:54.094 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:54.094 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:54.094 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.094 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:54.094 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:02:54.094 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:54.094 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.095 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.095 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:54.095 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:02:54.095 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:54.095 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.095 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.095 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:54.095 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435868+0000", 2023-09-30T17:02:54.095 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5840000000000002e-06 2023-09-30T17:02:54.095 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.095 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.095 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:54.096 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435892+0000", 2023-09-30T17:02:54.096 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3625000000000002e-05 2023-09-30T17:02:54.096 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.096 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.096 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:54.096 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435908+0000", 2023-09-30T17:02:54.096 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6548000000000001e-05 2023-09-30T17:02:54.096 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.096 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.096 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:54.096 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435935+0000", 2023-09-30T17:02:54.096 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6516000000000002e-05 2023-09-30T17:02:54.097 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.097 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.097 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:54.097 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435996+0000", 2023-09-30T17:02:54.097 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1433999999999995e-05 2023-09-30T17:02:54.097 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.097 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.097 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:54.097 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436114+0000", 2023-09-30T17:02:54.097 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000118344 2023-09-30T17:02:54.097 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.097 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.098 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:54.098 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436219+0000", 2023-09-30T17:02:54.098 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010453100000000001 2023-09-30T17:02:54.098 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.098 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.098 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:54.098 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436900+0000", 2023-09-30T17:02:54.098 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00068121299999999996 2023-09-30T17:02:54.098 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.098 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.098 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:54.098 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437508+0000", 2023-09-30T17:02:54.099 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00060817399999999995 2023-09-30T17:02:54.099 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.099 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.099 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:54.099 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437554+0000", 2023-09-30T17:02:54.099 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5609000000000003e-05 2023-09-30T17:02:54.099 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.099 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.099 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:54.099 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437582+0000", 2023-09-30T17:02:54.099 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7832000000000001e-05 2023-09-30T17:02:54.099 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:54.100 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:54.100 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:54.100 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.100 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.100 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2023-09-30T17:02:54.100 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:02:54.100 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 11.558784507, 2023-09-30T17:02:54.100 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001456199, 2023-09-30T17:02:54.100 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:54.100 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:54.100 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:54.100 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.101 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:54.101 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:02:54.101 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:54.101 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.101 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.101 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:54.101 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:02:54.101 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:54.101 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.101 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.101 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:54.101 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436178+0000", 2023-09-30T17:02:54.102 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.494e-06 2023-09-30T17:02:54.102 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.102 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.102 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:54.102 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436184+0000", 2023-09-30T17:02:54.102 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2809999999999999e-06 2023-09-30T17:02:54.102 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.102 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.102 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:54.102 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436198+0000", 2023-09-30T17:02:54.102 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3978000000000001e-05 2023-09-30T17:02:54.102 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.103 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.103 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:54.103 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436206+0000", 2023-09-30T17:02:54.103 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8040000000000007e-06 2023-09-30T17:02:54.103 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.103 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.103 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:54.103 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436268+0000", 2023-09-30T17:02:54.103 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1484999999999998e-05 2023-09-30T17:02:54.103 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.103 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.103 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:54.104 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436339+0000", 2023-09-30T17:02:54.104 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1000000000000005e-05 2023-09-30T17:02:54.104 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.104 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.104 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:54.104 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436438+0000", 2023-09-30T17:02:54.104 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9389000000000007e-05 2023-09-30T17:02:54.104 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.104 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.104 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:54.104 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436986+0000", 2023-09-30T17:02:54.104 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054723399999999996 2023-09-30T17:02:54.105 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.105 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.105 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:54.105 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437566+0000", 2023-09-30T17:02:54.105 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00058017599999999996 2023-09-30T17:02:54.105 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.105 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.105 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:54.105 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437606+0000", 2023-09-30T17:02:54.105 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9891999999999997e-05 2023-09-30T17:02:54.105 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:54.105 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:54.106 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:54.106 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437633+0000", 2023-09-30T17:02:54.106 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7466000000000001e-05 2023-09-30T17:02:54.106 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:54.106 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:54.106 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:54.106 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:54.106 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:54.106 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:02:54.108 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:54.107+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:54.108 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:02:54.208 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:54.207+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:54.246 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:02:54.246 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:02:54.246 INFO:teuthology.orchestra.run.smithi031.stdout: "num_ops": 0 2023-09-30T17:02:54.246 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:02:54.256 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:02:54.340 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:54.340+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:54.409 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:54.409+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:54.428 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:02:54.428 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:02:54.428 INFO:teuthology.orchestra.run.smithi031.stdout: "complaint_time": 30, 2023-09-30T17:02:54.428 INFO:teuthology.orchestra.run.smithi031.stdout: "num_blocked_ops": 0 2023-09-30T17:02:54.428 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:02:54.438 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:02:54.510 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:54.510+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:54.611 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:54.610+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:54.612 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:02:54.612 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 20, 2023-09-30T17:02:54.612 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 600, 2023-09-30T17:02:54.612 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:02:54.612 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.612 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:32 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'18, mlcod=11'14)", 2023-09-30T17:02:54.613 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:02:54.613 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 47.249758241000002, 2023-09-30T17:02:54.613 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051629809999999996, 2023-09-30T17:02:54.613 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:54.613 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:54.613 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:54.613 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.613 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:54.613 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:02:54.613 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:54.613 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.614 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.614 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:54.614 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:02:54.614 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:54.614 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.614 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.614 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:54.614 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:02:54.614 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2099999999999996e-07 2023-09-30T17:02:54.614 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.614 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.615 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:54.615 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361407+0000", 2023-09-30T17:02:54.615 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7499e-05 2023-09-30T17:02:54.615 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.615 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.615 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:54.615 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361418+0000", 2023-09-30T17:02:54.616 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1127999999999999e-05 2023-09-30T17:02:54.616 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.616 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.616 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:54.616 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361423+0000", 2023-09-30T17:02:54.616 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1930000000000001e-06 2023-09-30T17:02:54.616 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.616 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.616 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:54.616 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361476+0000", 2023-09-30T17:02:54.617 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3399000000000002e-05 2023-09-30T17:02:54.617 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.617 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.617 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:54.617 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361496+0000", 2023-09-30T17:02:54.617 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9638000000000001e-05 2023-09-30T17:02:54.617 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.617 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.617 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:54.618 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.366474+0000", 2023-09-30T17:02:54.618 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0049778829999999998 2023-09-30T17:02:54.618 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.618 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.618 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:54.618 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.366512+0000", 2023-09-30T17:02:54.618 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7620000000000002e-05 2023-09-30T17:02:54.618 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:54.618 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:54.619 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:54.619 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.619 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.619 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:37 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'23, mlcod=11'15)", 2023-09-30T17:02:54.619 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:02:54.619 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 47.247156244000003, 2023-09-30T17:02:54.619 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053985689999999998, 2023-09-30T17:02:54.619 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:54.619 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:54.619 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:54.619 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.619 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:54.620 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:02:54.620 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:54.620 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.620 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.620 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:54.620 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:02:54.620 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:54.620 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.620 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.620 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:54.620 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:02:54.621 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4400000000000001e-07 2023-09-30T17:02:54.621 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.621 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.621 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:54.621 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363956+0000", 2023-09-30T17:02:54.621 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.921e-06 2023-09-30T17:02:54.621 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.621 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.621 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:54.621 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363966+0000", 2023-09-30T17:02:54.621 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0351e-05 2023-09-30T17:02:54.622 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.622 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.622 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:54.622 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363971+0000", 2023-09-30T17:02:54.622 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.023e-06 2023-09-30T17:02:54.622 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.622 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.622 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:54.622 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.364013+0000", 2023-09-30T17:02:54.622 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1575000000000001e-05 2023-09-30T17:02:54.622 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.622 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.623 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:54.623 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.364026+0000", 2023-09-30T17:02:54.623 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3044000000000001e-05 2023-09-30T17:02:54.623 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.623 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.623 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:54.623 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.369308+0000", 2023-09-30T17:02:54.623 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005282152 2023-09-30T17:02:54.623 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.623 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.623 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:54.623 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.369349+0000", 2023-09-30T17:02:54.624 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1059000000000001e-05 2023-09-30T17:02:54.624 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:54.624 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:54.624 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:54.624 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.624 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.624 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:155 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'109, mlcod=11'105)", 2023-09-30T17:02:54.624 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:02:54.624 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 46.765460558000001, 2023-09-30T17:02:54.624 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053867639999999996, 2023-09-30T17:02:54.624 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:54.624 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:54.625 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:54.625 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.625 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:54.625 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:02:54.625 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:54.625 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.625 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.625 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:54.625 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:02:54.625 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:54.625 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.626 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.626 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:54.626 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845647+0000", 2023-09-30T17:02:54.626 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7599999999999997e-07 2023-09-30T17:02:54.626 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.626 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.626 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:54.627 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845699+0000", 2023-09-30T17:02:54.627 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1758000000000001e-05 2023-09-30T17:02:54.627 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.627 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.627 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:54.627 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845708+0000", 2023-09-30T17:02:54.627 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2159999999999995e-06 2023-09-30T17:02:54.627 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.627 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.627 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:54.627 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845712+0000", 2023-09-30T17:02:54.627 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2579999999999997e-06 2023-09-30T17:02:54.628 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.628 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.628 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:54.628 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845756+0000", 2023-09-30T17:02:54.628 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4119999999999998e-05 2023-09-30T17:02:54.628 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.628 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.628 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:54.628 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845779+0000", 2023-09-30T17:02:54.628 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2311e-05 2023-09-30T17:02:54.628 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.628 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.629 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:54.629 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.850982+0000", 2023-09-30T17:02:54.629 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005203053 2023-09-30T17:02:54.629 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.629 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.629 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:54.629 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851033+0000", 2023-09-30T17:02:54.629 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1471999999999998e-05 2023-09-30T17:02:54.629 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:54.629 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:54.629 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:54.629 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.629 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.630 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:156 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'110, mlcod=11'105)", 2023-09-30T17:02:54.630 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:02:54.630 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 46.764927632000003, 2023-09-30T17:02:54.630 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0052834759999999996, 2023-09-30T17:02:54.630 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:54.630 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:54.630 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:54.630 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.630 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:54.630 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:02:54.630 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:54.631 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.631 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.631 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:54.631 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:02:54.631 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:54.631 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.631 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.631 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:54.631 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846180+0000", 2023-09-30T17:02:54.631 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6300000000000005e-07 2023-09-30T17:02:54.631 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.631 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.632 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:54.632 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846184+0000", 2023-09-30T17:02:54.632 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3789999999999999e-06 2023-09-30T17:02:54.632 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.632 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.632 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:54.632 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846195+0000", 2023-09-30T17:02:54.632 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0778000000000001e-05 2023-09-30T17:02:54.632 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.632 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.632 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:54.632 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846200+0000", 2023-09-30T17:02:54.633 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1540000000000001e-06 2023-09-30T17:02:54.633 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.633 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.633 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:54.633 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846274+0000", 2023-09-30T17:02:54.633 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4129999999999997e-05 2023-09-30T17:02:54.633 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.633 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.633 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:54.633 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846286+0000", 2023-09-30T17:02:54.633 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1744e-05 2023-09-30T17:02:54.633 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.634 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.634 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:54.634 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851432+0000", 2023-09-30T17:02:54.634 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051462110000000004 2023-09-30T17:02:54.634 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.634 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.634 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:54.634 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851463+0000", 2023-09-30T17:02:54.634 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0516999999999999e-05 2023-09-30T17:02:54.634 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:54.634 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:54.634 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:54.635 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.635 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.635 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:203 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'149, mlcod=11'145)", 2023-09-30T17:02:54.635 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:02:54.635 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 46.408891722999996, 2023-09-30T17:02:54.635 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051867459999999999, 2023-09-30T17:02:54.635 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:54.635 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:54.635 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:54.635 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.635 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:54.636 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:02:54.636 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:54.636 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.636 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.636 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:54.636 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:02:54.636 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:54.636 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.636 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.636 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:54.636 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202216+0000", 2023-09-30T17:02:54.636 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7e-07 2023-09-30T17:02:54.637 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.637 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.637 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:54.637 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202271+0000", 2023-09-30T17:02:54.637 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5163e-05 2023-09-30T17:02:54.637 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.637 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.637 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:54.637 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202282+0000", 2023-09-30T17:02:54.637 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1319e-05 2023-09-30T17:02:54.637 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.637 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.638 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:54.638 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202288+0000", 2023-09-30T17:02:54.638 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2899999999999999e-06 2023-09-30T17:02:54.638 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.638 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.638 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:54.638 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202331+0000", 2023-09-30T17:02:54.638 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2147999999999997e-05 2023-09-30T17:02:54.638 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.638 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.639 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:54.639 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202348+0000", 2023-09-30T17:02:54.639 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7317e-05 2023-09-30T17:02:54.639 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.639 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.639 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:54.639 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.207357+0000", 2023-09-30T17:02:54.639 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0050095440000000003 2023-09-30T17:02:54.639 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.639 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.639 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:54.639 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.207402+0000", 2023-09-30T17:02:54.640 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4495e-05 2023-09-30T17:02:54.640 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:54.640 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:54.640 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:54.640 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.640 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.640 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:54.640 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:02:54.640 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 36.259561435000002, 2023-09-30T17:02:54.640 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.025313649000000001, 2023-09-30T17:02:54.640 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:54.641 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:54.641 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:54.641 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.641 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:54.641 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:02:54.641 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:54.641 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.641 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.641 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:54.641 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:02:54.641 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:54.641 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.642 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.642 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:54.642 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351551+0000", 2023-09-30T17:02:54.642 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3380000000000004e-06 2023-09-30T17:02:54.642 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.642 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.642 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:54.642 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351559+0000", 2023-09-30T17:02:54.642 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9589999999999995e-06 2023-09-30T17:02:54.642 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.642 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.643 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:54.643 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351571+0000", 2023-09-30T17:02:54.643 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2065999999999999e-05 2023-09-30T17:02:54.643 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.643 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.643 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:54.643 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351706+0000", 2023-09-30T17:02:54.643 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00013553799999999999 2023-09-30T17:02:54.643 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.643 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.643 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:54.643 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353016+0000", 2023-09-30T17:02:54.644 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0013099209999999999 2023-09-30T17:02:54.644 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.644 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.644 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:02:54.644 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353023+0000", 2023-09-30T17:02:54.644 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2479999999999999e-06 2023-09-30T17:02:54.644 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.644 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.644 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:54.644 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360348+0000", 2023-09-30T17:02:54.644 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0073248949999999997 2023-09-30T17:02:54.644 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.645 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.645 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:54.645 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360787+0000", 2023-09-30T17:02:54.645 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00043875199999999999 2023-09-30T17:02:54.645 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.645 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.645 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:54.645 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360892+0000", 2023-09-30T17:02:54.645 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010508199999999999 2023-09-30T17:02:54.645 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.645 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.645 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:02:54.646 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365132+0000", 2023-09-30T17:02:54.646 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0042396480000000004 2023-09-30T17:02:54.646 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.646 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.646 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:54.646 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376746+0000", 2023-09-30T17:02:54.646 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011614157 2023-09-30T17:02:54.646 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.646 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.646 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:54.646 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376811+0000", 2023-09-30T17:02:54.646 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5005999999999994e-05 2023-09-30T17:02:54.647 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.647 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.647 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:54.647 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376859+0000", 2023-09-30T17:02:54.647 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8038999999999999e-05 2023-09-30T17:02:54.647 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:54.647 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:54.647 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:54.647 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.647 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.647 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:54.648 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:02:54.648 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 36.259063636, 2023-09-30T17:02:54.648 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024923989000000001, 2023-09-30T17:02:54.648 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:54.648 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:54.648 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:54.648 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.648 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:54.648 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:02:54.648 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:54.648 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.648 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.648 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:54.649 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:02:54.649 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:54.649 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.649 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.649 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:54.649 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352044+0000", 2023-09-30T17:02:54.649 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9199999999999999e-07 2023-09-30T17:02:54.649 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.649 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.649 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:54.649 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352050+0000", 2023-09-30T17:02:54.649 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8880000000000002e-06 2023-09-30T17:02:54.650 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.650 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.650 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:54.650 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352143+0000", 2023-09-30T17:02:54.650 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2721999999999998e-05 2023-09-30T17:02:54.650 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.650 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.650 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:54.650 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352155+0000", 2023-09-30T17:02:54.651 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2279000000000001e-05 2023-09-30T17:02:54.651 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.651 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.651 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:54.651 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353114+0000", 2023-09-30T17:02:54.651 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00095943700000000005 2023-09-30T17:02:54.651 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.651 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.651 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:54.651 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353121+0000", 2023-09-30T17:02:54.651 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.494e-06 2023-09-30T17:02:54.652 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.652 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.652 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:54.652 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361491+0000", 2023-09-30T17:02:54.652 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0083697359999999991 2023-09-30T17:02:54.652 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.652 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.652 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:54.652 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361573+0000", 2023-09-30T17:02:54.652 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2822000000000001e-05 2023-09-30T17:02:54.652 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.652 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.653 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:54.653 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362166+0000", 2023-09-30T17:02:54.653 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00059223299999999995 2023-09-30T17:02:54.653 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.653 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.653 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:02:54.653 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365209+0000", 2023-09-30T17:02:54.653 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.003043212 2023-09-30T17:02:54.653 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.653 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.653 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:54.653 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376910+0000", 2023-09-30T17:02:54.654 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011700898 2023-09-30T17:02:54.654 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.654 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.654 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:54.654 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376945+0000", 2023-09-30T17:02:54.654 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4795000000000001e-05 2023-09-30T17:02:54.654 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.654 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.654 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:54.654 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376967+0000", 2023-09-30T17:02:54.654 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2580999999999999e-05 2023-09-30T17:02:54.654 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:54.655 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:54.655 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:54.655 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.655 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.655 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:54.655 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:02:54.655 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 36.258893716000003, 2023-09-30T17:02:54.655 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023120405, 2023-09-30T17:02:54.655 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:54.655 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:54.655 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:54.656 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.656 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:54.656 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:02:54.656 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:54.656 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.656 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.656 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:54.656 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:02:54.656 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:54.656 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.656 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.656 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:54.657 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352214+0000", 2023-09-30T17:02:54.657 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8400000000000003e-07 2023-09-30T17:02:54.657 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.657 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.657 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:54.657 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352233+0000", 2023-09-30T17:02:54.657 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8946000000000001e-05 2023-09-30T17:02:54.657 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.657 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.657 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:54.657 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352297+0000", 2023-09-30T17:02:54.657 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3540999999999994e-05 2023-09-30T17:02:54.658 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.658 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.658 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:54.658 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352450+0000", 2023-09-30T17:02:54.658 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015364799999999999 2023-09-30T17:02:54.658 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.658 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.658 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:54.658 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353098+0000", 2023-09-30T17:02:54.658 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00064820299999999997 2023-09-30T17:02:54.658 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.658 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.659 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:02:54.659 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353103+0000", 2023-09-30T17:02:54.659 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0529999999999997e-06 2023-09-30T17:02:54.659 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.659 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.659 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:54.659 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.358558+0000", 2023-09-30T17:02:54.659 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0054550249999999996 2023-09-30T17:02:54.659 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.659 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.659 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:54.659 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.358741+0000", 2023-09-30T17:02:54.660 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00018210200000000001 2023-09-30T17:02:54.660 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.660 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.660 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:54.660 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.359683+0000", 2023-09-30T17:02:54.660 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00094202299999999995 2023-09-30T17:02:54.660 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.660 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.660 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:02:54.660 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365044+0000", 2023-09-30T17:02:54.660 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053616219999999999 2023-09-30T17:02:54.660 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.661 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.661 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:54.661 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375256+0000", 2023-09-30T17:02:54.661 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010212156 2023-09-30T17:02:54.661 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.661 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.661 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:54.661 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375300+0000", 2023-09-30T17:02:54.661 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3961999999999997e-05 2023-09-30T17:02:54.661 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.661 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.662 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:54.662 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375334+0000", 2023-09-30T17:02:54.662 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.324e-05 2023-09-30T17:02:54.662 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:54.662 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:54.662 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:54.662 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.662 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.662 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:54.662 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:02:54.662 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 36.258578698000001, 2023-09-30T17:02:54.662 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024240660000000001, 2023-09-30T17:02:54.663 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:54.663 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:54.663 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:54.663 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.663 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:54.663 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:02:54.663 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:54.663 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.663 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.663 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:54.663 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:02:54.664 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:54.664 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.664 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.664 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:54.664 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352529+0000", 2023-09-30T17:02:54.664 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1379999999999999e-06 2023-09-30T17:02:54.664 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.664 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.664 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:54.664 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352536+0000", 2023-09-30T17:02:54.664 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3489999999999997e-06 2023-09-30T17:02:54.664 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.665 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.665 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:54.665 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352547+0000", 2023-09-30T17:02:54.665 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1109e-05 2023-09-30T17:02:54.665 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.665 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.665 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:54.665 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352560+0000", 2023-09-30T17:02:54.665 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3046e-05 2023-09-30T17:02:54.665 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.665 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.665 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:54.666 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353142+0000", 2023-09-30T17:02:54.666 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00058174699999999997 2023-09-30T17:02:54.666 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.666 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.666 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:54.666 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353147+0000", 2023-09-30T17:02:54.666 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5840000000000002e-06 2023-09-30T17:02:54.666 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.666 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.666 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:54.666 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360374+0000", 2023-09-30T17:02:54.667 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0072270049999999999 2023-09-30T17:02:54.667 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.667 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.667 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:54.667 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360795+0000", 2023-09-30T17:02:54.667 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00042088999999999999 2023-09-30T17:02:54.667 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.667 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.667 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:54.667 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360967+0000", 2023-09-30T17:02:54.667 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017235699999999999 2023-09-30T17:02:54.667 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.668 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.668 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:02:54.668 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365051+0000", 2023-09-30T17:02:54.668 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0040837429999999999 2023-09-30T17:02:54.668 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.668 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.668 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:54.668 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376708+0000", 2023-09-30T17:02:54.668 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011656866 2023-09-30T17:02:54.668 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.668 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.668 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:54.669 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376745+0000", 2023-09-30T17:02:54.669 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6769e-05 2023-09-30T17:02:54.669 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.669 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.669 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:54.669 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376769+0000", 2023-09-30T17:02:54.669 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4057e-05 2023-09-30T17:02:54.669 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:54.669 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:54.669 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:54.669 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.670 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.670 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:54.670 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:02:54.670 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 36.258319342999997, 2023-09-30T17:02:54.670 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023472704, 2023-09-30T17:02:54.670 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:54.670 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:54.670 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:54.670 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.670 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:54.670 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:02:54.671 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:54.671 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.671 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.671 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:54.671 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:02:54.671 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:54.671 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.671 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.671 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:54.671 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:02:54.671 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8000000000000005e-07 2023-09-30T17:02:54.671 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.672 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.672 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:54.672 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352794+0000", 2023-09-30T17:02:54.672 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.789e-06 2023-09-30T17:02:54.672 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.672 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.672 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:54.672 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352805+0000", 2023-09-30T17:02:54.672 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0848e-05 2023-09-30T17:02:54.672 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.672 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.673 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:54.673 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352812+0000", 2023-09-30T17:02:54.673 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4449999999999999e-06 2023-09-30T17:02:54.673 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.673 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.673 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:54.673 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353063+0000", 2023-09-30T17:02:54.673 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00025046299999999998 2023-09-30T17:02:54.673 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.673 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.673 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:02:54.673 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353071+0000", 2023-09-30T17:02:54.674 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6739999999999997e-06 2023-09-30T17:02:54.674 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.674 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.674 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:54.674 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361696+0000", 2023-09-30T17:02:54.674 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0086251609999999992 2023-09-30T17:02:54.674 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.674 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.674 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:54.674 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362284+0000", 2023-09-30T17:02:54.674 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00058872299999999998 2023-09-30T17:02:54.675 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.675 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.675 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:54.675 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362429+0000", 2023-09-30T17:02:54.675 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014509000000000001 2023-09-30T17:02:54.675 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.675 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.675 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:02:54.675 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365330+0000", 2023-09-30T17:02:54.675 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0029005419999999999 2023-09-30T17:02:54.675 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.675 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.676 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:54.676 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376196+0000", 2023-09-30T17:02:54.676 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.01086615 2023-09-30T17:02:54.677 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.677 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.677 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:54.677 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376230+0000", 2023-09-30T17:02:54.677 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3858e-05 2023-09-30T17:02:54.677 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.677 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.677 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:54.678 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376260+0000", 2023-09-30T17:02:54.678 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0181000000000001e-05 2023-09-30T17:02:54.678 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:54.678 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:54.678 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:54.678 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.678 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.678 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:54.678 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:02:54.678 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 36.258085772999998, 2023-09-30T17:02:54.678 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023406132999999999, 2023-09-30T17:02:54.678 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:54.679 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:54.679 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:54.679 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.679 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:54.679 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:02:54.679 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:54.679 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.679 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.679 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:54.679 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:02:54.679 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:54.679 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.680 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.680 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:54.680 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353022+0000", 2023-09-30T17:02:54.680 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.78e-07 2023-09-30T17:02:54.680 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.680 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.680 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:54.680 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353027+0000", 2023-09-30T17:02:54.680 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9089999999999999e-06 2023-09-30T17:02:54.680 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.680 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.681 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:54.681 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353035+0000", 2023-09-30T17:02:54.681 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0430000000000008e-06 2023-09-30T17:02:54.681 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.681 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.681 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:54.681 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353047+0000", 2023-09-30T17:02:54.681 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1674e-05 2023-09-30T17:02:54.681 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.681 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.681 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:54.682 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353105+0000", 2023-09-30T17:02:54.682 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8891999999999998e-05 2023-09-30T17:02:54.682 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.682 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.682 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:54.682 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353112+0000", 2023-09-30T17:02:54.682 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7059999999999998e-06 2023-09-30T17:02:54.682 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.682 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.682 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:54.682 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362733+0000", 2023-09-30T17:02:54.682 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0096205869999999999 2023-09-30T17:02:54.682 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.683 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.683 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:54.683 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362833+0000", 2023-09-30T17:02:54.683 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000100227 2023-09-30T17:02:54.683 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.683 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.683 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:54.683 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363000+0000", 2023-09-30T17:02:54.683 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016670899999999999 2023-09-30T17:02:54.683 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.683 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.684 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:02:54.684 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365550+0000", 2023-09-30T17:02:54.684 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0025499199999999998 2023-09-30T17:02:54.684 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.684 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.684 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:54.684 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376315+0000", 2023-09-30T17:02:54.684 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010765011999999999 2023-09-30T17:02:54.684 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.684 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.684 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:54.684 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376386+0000", 2023-09-30T17:02:54.684 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0866999999999998e-05 2023-09-30T17:02:54.685 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.685 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.685 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:54.685 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376427+0000", 2023-09-30T17:02:54.685 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1709000000000003e-05 2023-09-30T17:02:54.685 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:54.685 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:54.685 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:54.685 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.685 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.685 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:54.685 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:02:54.686 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 36.258045137000003, 2023-09-30T17:02:54.686 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024076238, 2023-09-30T17:02:54.686 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:54.686 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:54.686 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:54.686 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.686 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:54.686 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:02:54.686 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:54.686 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.686 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.687 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:54.687 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:02:54.687 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:54.687 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.687 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.687 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:54.687 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:02:54.687 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8699999999999995e-07 2023-09-30T17:02:54.687 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.687 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.687 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:54.687 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353067+0000", 2023-09-30T17:02:54.688 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.605e-06 2023-09-30T17:02:54.688 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.688 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.688 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:54.688 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353073+0000", 2023-09-30T17:02:54.688 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8900000000000004e-06 2023-09-30T17:02:54.688 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.688 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.688 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:54.688 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353083+0000", 2023-09-30T17:02:54.688 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0200000000000001e-05 2023-09-30T17:02:54.688 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.688 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.689 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:54.689 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353186+0000", 2023-09-30T17:02:54.689 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010256599999999999 2023-09-30T17:02:54.689 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.689 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.689 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:54.689 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353190+0000", 2023-09-30T17:02:54.689 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9709999999999998e-06 2023-09-30T17:02:54.689 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.689 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.689 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:54.690 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362946+0000", 2023-09-30T17:02:54.690 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0097563330000000007 2023-09-30T17:02:54.690 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.690 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.690 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:54.690 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363088+0000", 2023-09-30T17:02:54.690 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014259200000000001 2023-09-30T17:02:54.690 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.690 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.690 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:54.690 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363555+0000", 2023-09-30T17:02:54.690 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00046627799999999998 2023-09-30T17:02:54.691 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.691 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.691 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:02:54.691 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365871+0000", 2023-09-30T17:02:54.691 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0023167589999999998 2023-09-30T17:02:54.691 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.691 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.691 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:54.691 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377033+0000", 2023-09-30T17:02:54.691 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011161203999999999 2023-09-30T17:02:54.691 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.692 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.692 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:54.692 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377100+0000", 2023-09-30T17:02:54.692 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7230999999999994e-05 2023-09-30T17:02:54.692 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.692 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.692 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:54.692 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377138+0000", 2023-09-30T17:02:54.692 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8022000000000003e-05 2023-09-30T17:02:54.692 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:54.692 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:54.692 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:54.692 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.693 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.693 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:54.693 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:02:54.693 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 36.257944188000003, 2023-09-30T17:02:54.693 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.020304412000000001, 2023-09-30T17:02:54.693 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:54.693 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:02:54.693 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:54.693 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.693 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:54.693 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:02:54.693 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:54.694 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.694 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.694 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:54.694 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:02:54.694 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:54.694 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.694 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.694 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:54.694 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353164+0000", 2023-09-30T17:02:54.694 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7100000000000011e-07 2023-09-30T17:02:54.694 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.694 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.694 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:54.695 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353168+0000", 2023-09-30T17:02:54.695 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0600000000000001e-06 2023-09-30T17:02:54.695 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.695 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.695 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:54.695 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353177+0000", 2023-09-30T17:02:54.695 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1409999999999994e-06 2023-09-30T17:02:54.695 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.695 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.695 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:54.695 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353185+0000", 2023-09-30T17:02:54.696 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2479999999999996e-06 2023-09-30T17:02:54.696 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.696 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.696 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:54.696 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353246+0000", 2023-09-30T17:02:54.696 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0519000000000001e-05 2023-09-30T17:02:54.696 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.696 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.696 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:02:54.696 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353252+0000", 2023-09-30T17:02:54.696 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7859999999999999e-06 2023-09-30T17:02:54.696 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.697 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.697 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:54.697 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354979+0000", 2023-09-30T17:02:54.697 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0017270090000000001 2023-09-30T17:02:54.697 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.697 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.697 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:54.697 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355097+0000", 2023-09-30T17:02:54.697 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000117472 2023-09-30T17:02:54.697 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.697 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.697 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:54.698 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.373467+0000", 2023-09-30T17:02:54.698 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.018370206 2023-09-30T17:02:54.698 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:54.698 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:54.698 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:54.698 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.698 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.698 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:54.698 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:02:54.698 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 36.257903450000001, 2023-09-30T17:02:54.698 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.012725089, 2023-09-30T17:02:54.699 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:54.699 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:02:54.699 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:54.699 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.699 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:54.699 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:02:54.699 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:54.699 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.699 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.699 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:54.699 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:02:54.699 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:54.700 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.700 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.700 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:54.700 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353204+0000", 2023-09-30T17:02:54.700 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7100000000000002e-07 2023-09-30T17:02:54.700 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.700 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.700 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:54.700 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353213+0000", 2023-09-30T17:02:54.700 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8580000000000006e-06 2023-09-30T17:02:54.700 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.701 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.701 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:54.701 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353219+0000", 2023-09-30T17:02:54.701 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8939999999999998e-06 2023-09-30T17:02:54.701 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.701 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.701 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:54.701 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353223+0000", 2023-09-30T17:02:54.701 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.357e-06 2023-09-30T17:02:54.701 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.701 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.701 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:54.702 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353278+0000", 2023-09-30T17:02:54.702 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5228e-05 2023-09-30T17:02:54.702 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.702 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.702 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:02:54.702 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353284+0000", 2023-09-30T17:02:54.702 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8209999999999998e-06 2023-09-30T17:02:54.702 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.702 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.702 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:54.702 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355095+0000", 2023-09-30T17:02:54.702 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001811404 2023-09-30T17:02:54.703 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.703 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.703 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:54.703 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355256+0000", 2023-09-30T17:02:54.703 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000160898 2023-09-30T17:02:54.703 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.703 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.703 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:54.703 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365928+0000", 2023-09-30T17:02:54.703 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010672157999999999 2023-09-30T17:02:54.703 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:54.703 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:54.704 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:54.704 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.704 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.704 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-09-30T17:02:54.704 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:02:54.704 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 36.257372242999999, 2023-09-30T17:02:54.704 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0056863460000000001, 2023-09-30T17:02:54.704 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:54.704 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "reached pg", 2023-09-30T17:02:54.704 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:54.704 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.704 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:54.704 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:02:54.705 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:54.705 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.705 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.705 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:54.705 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:02:54.705 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:54.705 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.705 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.705 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:54.705 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:02:54.705 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5700000000000002e-07 2023-09-30T17:02:54.705 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.706 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.706 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:54.706 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353747+0000", 2023-09-30T17:02:54.706 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1899000000000001e-05 2023-09-30T17:02:54.706 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.706 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.706 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:54.706 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353776+0000", 2023-09-30T17:02:54.706 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.8767000000000001e-05 2023-09-30T17:02:54.706 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.706 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.706 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:54.707 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353792+0000", 2023-09-30T17:02:54.707 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5914999999999999e-05 2023-09-30T17:02:54.707 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.707 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.707 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:54.707 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353900+0000", 2023-09-30T17:02:54.707 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010774500000000001 2023-09-30T17:02:54.707 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.707 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.707 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:54.707 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.359421+0000", 2023-09-30T17:02:54.707 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0055213629999999996 2023-09-30T17:02:54.708 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:54.708 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:54.708 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:54.708 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.708 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.708 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:02:54.708 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:02:54.708 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 36.256700643000002, 2023-09-30T17:02:54.708 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0069196370000000002, 2023-09-30T17:02:54.708 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:54.708 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:54.708 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:54.709 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.709 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:54.709 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:02:54.709 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:54.709 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.709 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.709 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:54.709 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:02:54.709 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:54.709 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.709 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.709 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:54.710 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354407+0000", 2023-09-30T17:02:54.710 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7400000000000002e-07 2023-09-30T17:02:54.710 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.710 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.710 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:54.710 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354414+0000", 2023-09-30T17:02:54.710 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1040000000000001e-06 2023-09-30T17:02:54.710 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.710 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.710 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:54.710 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354425+0000", 2023-09-30T17:02:54.710 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1090000000000001e-05 2023-09-30T17:02:54.710 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.711 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.711 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:54.711 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354435+0000", 2023-09-30T17:02:54.711 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8169999999999994e-06 2023-09-30T17:02:54.711 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.711 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.711 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:54.711 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355741+0000", 2023-09-30T17:02:54.711 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0013063160000000001 2023-09-30T17:02:54.711 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.711 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.711 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:54.712 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355763+0000", 2023-09-30T17:02:54.712 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1688e-05 2023-09-30T17:02:54.712 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.712 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.712 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:54.712 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361289+0000", 2023-09-30T17:02:54.712 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0055258269999999996 2023-09-30T17:02:54.712 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.712 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.712 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:54.712 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361326+0000", 2023-09-30T17:02:54.712 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7020999999999997e-05 2023-09-30T17:02:54.713 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:54.713 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:54.713 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:54.713 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.713 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.713 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:30 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2023-09-30T17:02:54.713 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:02:54.713 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 36.255326685, 2023-09-30T17:02:54.713 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0069996629999999997, 2023-09-30T17:02:54.713 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:54.713 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:54.713 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:54.714 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.714 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:54.714 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:02:54.714 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:54.714 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.714 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.714 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:54.714 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:02:54.714 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:54.714 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.714 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.714 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:54.715 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355781+0000", 2023-09-30T17:02:54.715 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9599999999999999e-07 2023-09-30T17:02:54.715 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.715 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.715 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:54.715 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355788+0000", 2023-09-30T17:02:54.715 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8129999999999996e-06 2023-09-30T17:02:54.715 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.715 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.715 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:54.715 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355798+0000", 2023-09-30T17:02:54.715 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2909999999999996e-06 2023-09-30T17:02:54.716 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.716 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.716 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:54.716 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355807+0000", 2023-09-30T17:02:54.716 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8619999999999992e-06 2023-09-30T17:02:54.716 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.716 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.716 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:54.716 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.357264+0000", 2023-09-30T17:02:54.716 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0014578289999999999 2023-09-30T17:02:54.716 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.716 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.717 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:54.717 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.357916+0000", 2023-09-30T17:02:54.717 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00065170500000000004 2023-09-30T17:02:54.717 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.717 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.717 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:54.717 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362731+0000", 2023-09-30T17:02:54.717 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0048149849999999999 2023-09-30T17:02:54.717 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.717 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.717 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:54.717 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362780+0000", 2023-09-30T17:02:54.718 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8681999999999999e-05 2023-09-30T17:02:54.718 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:54.718 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:54.718 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:54.718 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.718 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.718 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2023-09-30T17:02:54.718 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:02:54.718 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 36.236675634000001, 2023-09-30T17:02:54.718 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005905998, 2023-09-30T17:02:54.718 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:54.718 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:54.719 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:54.719 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.719 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:54.719 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:02:54.719 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:54.719 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.719 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.719 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:54.719 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:02:54.719 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:54.719 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.719 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.720 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:54.720 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:02:54.720 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1e-07 2023-09-30T17:02:54.720 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.720 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.720 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:54.720 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374455+0000", 2023-09-30T17:02:54.720 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.3091999999999998e-05 2023-09-30T17:02:54.720 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.720 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.720 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:54.721 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374462+0000", 2023-09-30T17:02:54.721 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5170000000000002e-06 2023-09-30T17:02:54.721 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.721 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.721 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:54.721 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374469+0000", 2023-09-30T17:02:54.721 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8199999999999999e-06 2023-09-30T17:02:54.721 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.721 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.721 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:54.721 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374550+0000", 2023-09-30T17:02:54.721 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0978999999999998e-05 2023-09-30T17:02:54.722 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.722 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.722 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:54.722 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374562+0000", 2023-09-30T17:02:54.722 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2472e-05 2023-09-30T17:02:54.722 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.722 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.722 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:54.722 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380293+0000", 2023-09-30T17:02:54.722 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0057310379999999999 2023-09-30T17:02:54.722 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.723 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.723 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:54.723 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380337+0000", 2023-09-30T17:02:54.723 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3869999999999998e-05 2023-09-30T17:02:54.723 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:54.723 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:54.723 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:54.723 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.723 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.723 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2023-09-30T17:02:54.723 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:02:54.724 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 36.236488885, 2023-09-30T17:02:54.724 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0057590560000000002, 2023-09-30T17:02:54.724 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:54.724 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:54.724 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:54.724 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.724 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:54.724 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:02:54.724 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:54.724 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.724 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.724 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:54.724 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:02:54.725 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:54.725 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.725 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.725 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:54.725 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:02:54.725 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4900000000000001e-07 2023-09-30T17:02:54.725 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.725 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.725 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:54.725 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374629+0000", 2023-09-30T17:02:54.726 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1014e-05 2023-09-30T17:02:54.726 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.726 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.726 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:54.726 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374636+0000", 2023-09-30T17:02:54.726 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5889999999999999e-06 2023-09-30T17:02:54.726 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.726 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.726 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:54.726 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374642+0000", 2023-09-30T17:02:54.726 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.48e-06 2023-09-30T17:02:54.727 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.727 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.727 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:54.727 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374681+0000", 2023-09-30T17:02:54.727 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9320000000000003e-05 2023-09-30T17:02:54.727 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.727 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.727 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:54.727 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374694+0000", 2023-09-30T17:02:54.727 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3351e-05 2023-09-30T17:02:54.727 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.727 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.727 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:54.728 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380319+0000", 2023-09-30T17:02:54.728 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0056243880000000001 2023-09-30T17:02:54.728 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.728 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.728 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:54.728 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380377+0000", 2023-09-30T17:02:54.728 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8464999999999997e-05 2023-09-30T17:02:54.728 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:54.728 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:54.728 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:54.728 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.729 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.729 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=0'0)", 2023-09-30T17:02:54.729 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:02:54.729 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 36.235777974000001, 2023-09-30T17:02:54.729 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051157370000000004, 2023-09-30T17:02:54.729 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:54.729 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:54.729 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:54.729 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.729 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:54.729 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:02:54.730 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:54.730 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.730 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.730 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:54.730 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:02:54.730 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:54.730 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.730 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.730 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:54.730 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:02:54.730 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0199999999999998e-07 2023-09-30T17:02:54.731 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.731 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.731 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:54.731 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375334+0000", 2023-09-30T17:02:54.731 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8799999999999999e-06 2023-09-30T17:02:54.731 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.731 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.731 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:54.731 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375343+0000", 2023-09-30T17:02:54.731 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5490000000000006e-06 2023-09-30T17:02:54.732 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.732 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.732 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:54.732 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375350+0000", 2023-09-30T17:02:54.732 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5700000000000004e-06 2023-09-30T17:02:54.732 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.732 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.732 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:54.732 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375396+0000", 2023-09-30T17:02:54.732 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5550999999999998e-05 2023-09-30T17:02:54.732 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.732 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.733 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:54.733 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375410+0000", 2023-09-30T17:02:54.733 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4518999999999999e-05 2023-09-30T17:02:54.733 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.733 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.733 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:54.733 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380401+0000", 2023-09-30T17:02:54.733 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0049903430000000004 2023-09-30T17:02:54.733 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:54.733 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:54.733 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:54.733 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380445+0000", 2023-09-30T17:02:54.734 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4023000000000002e-05 2023-09-30T17:02:54.734 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:54.734 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:54.734 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:54.734 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:54.734 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:54.734 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:02:54.735 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:02:54.736 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:54.735+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:54.836 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:54.835+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:54.866 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:02:54.867 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:02:54.867 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2023-09-30T17:02:54.867 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:02:54.877 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:02:54.936 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:54.936+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:55.037 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:55.036+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:55.044 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:02:55.044 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:02:55.044 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2023-09-30T17:02:55.044 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2023-09-30T17:02:55.044 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:02:55.055 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:02:55.140 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:55.139+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:55.224 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:02:55.224 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2023-09-30T17:02:55.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2023-09-30T17:02:55.224 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2023-09-30T17:02:55.225 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.225 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:55.225 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:02:55.225 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 36.870268402000001, 2023-09-30T17:02:55.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093789779999999996, 2023-09-30T17:02:55.226 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:55.226 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:55.226 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:55.226 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.226 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:55.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:02:55.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:55.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:55.228 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:02:55.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:55.228 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.228 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.228 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:55.228 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352027+0000", 2023-09-30T17:02:55.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0224000000000001e-05 2023-09-30T17:02:55.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.229 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:55.229 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352039+0000", 2023-09-30T17:02:55.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1569000000000001e-05 2023-09-30T17:02:55.230 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.230 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:55.230 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352052+0000", 2023-09-30T17:02:55.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2605999999999999e-05 2023-09-30T17:02:55.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.231 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:55.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352064+0000", 2023-09-30T17:02:55.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2666999999999999e-05 2023-09-30T17:02:55.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:55.232 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352147+0000", 2023-09-30T17:02:55.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3125000000000001e-05 2023-09-30T17:02:55.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.233 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.233 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:55.233 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352306+0000", 2023-09-30T17:02:55.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015881900000000001 2023-09-30T17:02:55.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.234 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.234 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:55.234 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352450+0000", 2023-09-30T17:02:55.234 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014420700000000001 2023-09-30T17:02:55.234 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.235 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.235 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:55.235 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355975+0000", 2023-09-30T17:02:55.235 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003524246 2023-09-30T17:02:55.235 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.236 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.236 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:55.236 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361279+0000", 2023-09-30T17:02:55.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005304507 2023-09-30T17:02:55.236 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:55.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361344+0000", 2023-09-30T17:02:55.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4548999999999995e-05 2023-09-30T17:02:55.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:55.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361396+0000", 2023-09-30T17:02:55.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2459e-05 2023-09-30T17:02:55.238 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:55.239 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:55.239 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:55.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.239 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:55.240 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:02:55.240 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 36.870176110000003, 2023-09-30T17:02:55.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021233007000000002, 2023-09-30T17:02:55.240 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:55.240 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:55.241 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:55.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.241 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:55.241 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:02:55.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:55.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:55.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:02:55.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:55.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:55.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352110+0000", 2023-09-30T17:02:55.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6000000000000002e-07 2023-09-30T17:02:55.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:55.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352117+0000", 2023-09-30T17:02:55.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5930000000000002e-06 2023-09-30T17:02:55.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.245 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:55.245 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352126+0000", 2023-09-30T17:02:55.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0729999999999994e-06 2023-09-30T17:02:55.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.246 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:55.246 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352136+0000", 2023-09-30T17:02:55.246 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0380000000000001e-05 2023-09-30T17:02:55.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:55.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353279+0000", 2023-09-30T17:02:55.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0011424670000000001 2023-09-30T17:02:55.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:55.248 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353707+0000", 2023-09-30T17:02:55.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00042829800000000003 2023-09-30T17:02:55.248 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.248 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:55.249 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354104+0000", 2023-09-30T17:02:55.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00039643399999999998 2023-09-30T17:02:55.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.249 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:55.249 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356925+0000", 2023-09-30T17:02:55.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0028210900000000001 2023-09-30T17:02:55.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:55.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373243+0000", 2023-09-30T17:02:55.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016318461999999999 2023-09-30T17:02:55.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:55.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373301+0000", 2023-09-30T17:02:55.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7435000000000002e-05 2023-09-30T17:02:55.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:55.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373342+0000", 2023-09-30T17:02:55.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1915000000000001e-05 2023-09-30T17:02:55.252 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:55.253 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:55.253 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:55.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.253 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:55.253 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:02:55.254 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 36.870133498999998, 2023-09-30T17:02:55.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011988331, 2023-09-30T17:02:55.254 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:55.254 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:55.254 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:55.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:55.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:02:55.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:55.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:55.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:02:55.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:55.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.257 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:55.257 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352153+0000", 2023-09-30T17:02:55.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0500000000000003e-07 2023-09-30T17:02:55.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:55.258 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352157+0000", 2023-09-30T17:02:55.258 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9790000000000004e-06 2023-09-30T17:02:55.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.259 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:55.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352173+0000", 2023-09-30T17:02:55.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6535999999999999e-05 2023-09-30T17:02:55.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:55.261 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352180+0000", 2023-09-30T17:02:55.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7700000000000004e-06 2023-09-30T17:02:55.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.262 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:55.262 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353526+0000", 2023-09-30T17:02:55.262 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0013458330000000001 2023-09-30T17:02:55.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:55.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353648+0000", 2023-09-30T17:02:55.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012262899999999999 2023-09-30T17:02:55.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:02:55.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354141+0000", 2023-09-30T17:02:55.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00049222899999999995 2023-09-30T17:02:55.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.266 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.266 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:55.266 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356931+0000", 2023-09-30T17:02:55.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0027900860000000002 2023-09-30T17:02:55.267 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.267 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:55.268 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364066+0000", 2023-09-30T17:02:55.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071355050000000003 2023-09-30T17:02:55.268 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.269 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:55.269 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364103+0000", 2023-09-30T17:02:55.269 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6944999999999999e-05 2023-09-30T17:02:55.269 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.270 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:55.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364140+0000", 2023-09-30T17:02:55.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7214e-05 2023-09-30T17:02:55.271 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:55.271 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:55.271 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:55.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.272 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:55.272 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:02:55.272 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 36.870094268000003, 2023-09-30T17:02:55.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012110921, 2023-09-30T17:02:55.272 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:55.272 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:55.273 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:55.273 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.273 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:55.273 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:02:55.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:55.273 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.274 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:55.274 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:02:55.274 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:55.274 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.275 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:55.275 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352192+0000", 2023-09-30T17:02:55.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7300000000000005e-07 2023-09-30T17:02:55.275 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.275 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:55.275 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352196+0000", 2023-09-30T17:02:55.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2370000000000003e-06 2023-09-30T17:02:55.275 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:55.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352205+0000", 2023-09-30T17:02:55.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6659999999999997e-06 2023-09-30T17:02:55.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:55.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352214+0000", 2023-09-30T17:02:55.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8259999999999999e-06 2023-09-30T17:02:55.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:55.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354470+0000", 2023-09-30T17:02:55.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022557340000000001 2023-09-30T17:02:55.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:55.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354557+0000", 2023-09-30T17:02:55.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6909000000000004e-05 2023-09-30T17:02:55.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:02:55.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354694+0000", 2023-09-30T17:02:55.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013774800000000001 2023-09-30T17:02:55.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:55.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356937+0000", 2023-09-30T17:02:55.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022424540000000001 2023-09-30T17:02:55.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:55.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364227+0000", 2023-09-30T17:02:55.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072902430000000001 2023-09-30T17:02:55.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:55.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364278+0000", 2023-09-30T17:02:55.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1180999999999997e-05 2023-09-30T17:02:55.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.280 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:55.280 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364302+0000", 2023-09-30T17:02:55.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4049999999999998e-05 2023-09-30T17:02:55.280 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:55.280 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:55.280 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:55.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.280 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:55.281 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:02:55.281 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 36.870060928999997, 2023-09-30T17:02:55.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021258651999999999, 2023-09-30T17:02:55.281 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:55.281 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:55.281 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:55.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:55.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:02:55.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:55.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:55.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:02:55.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:55.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:55.283 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:02:55.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6899999999999997e-07 2023-09-30T17:02:55.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.283 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:55.283 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352236+0000", 2023-09-30T17:02:55.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0251000000000001e-05 2023-09-30T17:02:55.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.283 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:55.284 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352244+0000", 2023-09-30T17:02:55.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0770000000000008e-06 2023-09-30T17:02:55.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.284 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:55.284 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352251+0000", 2023-09-30T17:02:55.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4749999999999996e-06 2023-09-30T17:02:55.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.284 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:55.284 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354455+0000", 2023-09-30T17:02:55.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022043660000000001 2023-09-30T17:02:55.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:55.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354577+0000", 2023-09-30T17:02:55.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000121054 2023-09-30T17:02:55.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:55.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354723+0000", 2023-09-30T17:02:55.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014693900000000001 2023-09-30T17:02:55.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:55.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356941+0000", 2023-09-30T17:02:55.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002217199 2023-09-30T17:02:55.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:55.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373392+0000", 2023-09-30T17:02:55.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016451774999999998 2023-09-30T17:02:55.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:55.287 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373445+0000", 2023-09-30T17:02:55.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.308e-05 2023-09-30T17:02:55.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.289 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:55.289 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373483+0000", 2023-09-30T17:02:55.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7766999999999999e-05 2023-09-30T17:02:55.289 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:55.289 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:55.289 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:55.289 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.290 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:55.290 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:02:55.290 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 36.870024837999999, 2023-09-30T17:02:55.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020903497, 2023-09-30T17:02:55.290 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:55.290 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:55.290 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:55.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:55.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:02:55.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:55.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:55.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:02:55.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:55.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:55.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:02:55.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0800000000000004e-07 2023-09-30T17:02:55.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:55.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352266+0000", 2023-09-30T17:02:55.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1280000000000001e-06 2023-09-30T17:02:55.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:55.293 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352273+0000", 2023-09-30T17:02:55.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3730000000000004e-06 2023-09-30T17:02:55.293 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.293 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:55.293 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352279+0000", 2023-09-30T17:02:55.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7699999999999998e-06 2023-09-30T17:02:55.293 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.294 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:55.294 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352334+0000", 2023-09-30T17:02:55.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5547999999999997e-05 2023-09-30T17:02:55.294 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.294 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:55.294 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352435+0000", 2023-09-30T17:02:55.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100688 2023-09-30T17:02:55.294 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:55.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352585+0000", 2023-09-30T17:02:55.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000150068 2023-09-30T17:02:55.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:55.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354912+0000", 2023-09-30T17:02:55.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0023266770000000001 2023-09-30T17:02:55.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.296 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:55.296 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373066+0000", 2023-09-30T17:02:55.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018154474 2023-09-30T17:02:55.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:55.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373122+0000", 2023-09-30T17:02:55.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6193000000000002e-05 2023-09-30T17:02:55.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:55.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373164+0000", 2023-09-30T17:02:55.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1869999999999997e-05 2023-09-30T17:02:55.297 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:55.297 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:55.298 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:55.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.298 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:55.298 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:02:55.298 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 36.869989162000003, 2023-09-30T17:02:55.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021015097999999999, 2023-09-30T17:02:55.299 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:55.299 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:55.299 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:55.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.299 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:55.299 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:02:55.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:55.299 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.300 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:55.300 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:02:55.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:55.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.300 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:55.300 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352297+0000", 2023-09-30T17:02:55.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8299999999999997e-07 2023-09-30T17:02:55.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:55.301 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352300+0000", 2023-09-30T17:02:55.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7460000000000001e-06 2023-09-30T17:02:55.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:55.302 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352307+0000", 2023-09-30T17:02:55.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4959999999999999e-06 2023-09-30T17:02:55.302 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:55.302 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352314+0000", 2023-09-30T17:02:55.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0190000000000001e-06 2023-09-30T17:02:55.302 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:55.303 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354070+0000", 2023-09-30T17:02:55.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001755936 2023-09-30T17:02:55.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.303 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:55.303 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354221+0000", 2023-09-30T17:02:55.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000150884 2023-09-30T17:02:55.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.303 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:55.304 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373311+0000", 2023-09-30T17:02:55.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019090434 2023-09-30T17:02:55.304 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:55.304 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:55.304 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:55.304 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.304 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:55.304 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:02:55.305 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 36.869960442999997, 2023-09-30T17:02:55.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021255174000000002, 2023-09-30T17:02:55.305 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:55.305 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:55.305 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:55.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.305 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:55.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:02:55.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:55.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:55.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:02:55.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:55.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:55.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352326+0000", 2023-09-30T17:02:55.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3200000000000005e-07 2023-09-30T17:02:55.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:55.308 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352349+0000", 2023-09-30T17:02:55.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3183000000000001e-05 2023-09-30T17:02:55.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.308 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:55.308 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352358+0000", 2023-09-30T17:02:55.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5230000000000001e-06 2023-09-30T17:02:55.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:55.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352365+0000", 2023-09-30T17:02:55.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3260000000000001e-06 2023-09-30T17:02:55.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.310 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:55.310 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355450+0000", 2023-09-30T17:02:55.310 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0030854049999999998 2023-09-30T17:02:55.310 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.310 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.310 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:55.310 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355583+0000", 2023-09-30T17:02:55.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000133189 2023-09-30T17:02:55.311 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.311 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:55.311 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373580+0000", 2023-09-30T17:02:55.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017997016000000001 2023-09-30T17:02:55.311 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:55.312 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:55.312 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:55.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.312 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:55.312 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:02:55.312 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 36.869909020000001, 2023-09-30T17:02:55.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010380537, 2023-09-30T17:02:55.312 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:55.313 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:55.313 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:55.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:55.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:02:55.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:55.313 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:55.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:02:55.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:55.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:55.314 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:02:55.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1500000000000003e-07 2023-09-30T17:02:55.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:55.314 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352381+0000", 2023-09-30T17:02:55.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6330000000000002e-06 2023-09-30T17:02:55.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.315 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:55.315 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352388+0000", 2023-09-30T17:02:55.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7229999999999998e-06 2023-09-30T17:02:55.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.315 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:55.315 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352394+0000", 2023-09-30T17:02:55.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1789999999999996e-06 2023-09-30T17:02:55.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:55.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353259+0000", 2023-09-30T17:02:55.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000865221 2023-09-30T17:02:55.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:55.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353391+0000", 2023-09-30T17:02:55.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013217700000000001 2023-09-30T17:02:55.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.317 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:55.317 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362757+0000", 2023-09-30T17:02:55.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093657889999999994 2023-09-30T17:02:55.317 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:55.317 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:55.317 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:55.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.318 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-09-30T17:02:55.318 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:02:55.318 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 36.863608728000003, 2023-09-30T17:02:55.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0061813579999999996, 2023-09-30T17:02:55.318 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:55.318 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2023-09-30T17:02:55.318 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:55.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:55.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:02:55.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:55.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:55.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:02:55.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:55.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:55.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:02:55.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5499999999999999e-07 2023-09-30T17:02:55.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:55.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358686+0000", 2023-09-30T17:02:55.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9979999999999992e-06 2023-09-30T17:02:55.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.321 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:55.321 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358700+0000", 2023-09-30T17:02:55.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3635000000000001e-05 2023-09-30T17:02:55.321 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.321 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:55.321 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358714+0000", 2023-09-30T17:02:55.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4470999999999999e-05 2023-09-30T17:02:55.321 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:55.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358767+0000", 2023-09-30T17:02:55.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2651999999999997e-05 2023-09-30T17:02:55.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:55.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364858+0000", 2023-09-30T17:02:55.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060912470000000002 2023-09-30T17:02:55.322 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:55.323 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:55.323 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:55.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.323 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2023-09-30T17:02:55.323 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:02:55.323 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 36.861243887999997, 2023-09-30T17:02:55.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00036246299999999999, 2023-09-30T17:02:55.323 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:55.324 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:55.324 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:55.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:55.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:02:55.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:55.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:55.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:02:55.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:55.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:55.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:02:55.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3099999999999999e-07 2023-09-30T17:02:55.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:55.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361045+0000", 2023-09-30T17:02:55.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.49e-06 2023-09-30T17:02:55.326 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.326 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:55.326 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361056+0000", 2023-09-30T17:02:55.326 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0910000000000001e-05 2023-09-30T17:02:55.326 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.327 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:55.327 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361067+0000", 2023-09-30T17:02:55.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0531e-05 2023-09-30T17:02:55.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.327 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:55.327 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361263+0000", 2023-09-30T17:02:55.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000196486 2023-09-30T17:02:55.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:55.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361273+0000", 2023-09-30T17:02:55.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3379999999999994e-06 2023-09-30T17:02:55.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:55.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361404+0000", 2023-09-30T17:02:55.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013137700000000001 2023-09-30T17:02:55.328 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:55.329 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:55.329 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:55.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.329 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:31 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:02:55.329 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:02:55.329 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 36.860267858999997, 2023-09-30T17:02:55.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006676408, 2023-09-30T17:02:55.329 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:55.329 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:55.330 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:55.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.330 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:55.330 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:02:55.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:55.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.330 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:55.331 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:02:55.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:55.331 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.331 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.331 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:55.331 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:02:55.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5600000000000002e-07 2023-09-30T17:02:55.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:55.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362044+0000", 2023-09-30T17:02:55.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5987999999999999e-05 2023-09-30T17:02:55.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:55.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362051+0000", 2023-09-30T17:02:55.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2599999999999999e-06 2023-09-30T17:02:55.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:55.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362057+0000", 2023-09-30T17:02:55.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.19e-06 2023-09-30T17:02:55.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:55.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362096+0000", 2023-09-30T17:02:55.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8278000000000002e-05 2023-09-30T17:02:55.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:55.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362114+0000", 2023-09-30T17:02:55.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8808e-05 2023-09-30T17:02:55.335 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.335 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.335 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:55.335 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368658+0000", 2023-09-30T17:02:55.335 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065433540000000004 2023-09-30T17:02:55.335 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.335 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.335 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:55.335 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368694+0000", 2023-09-30T17:02:55.336 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6273999999999999e-05 2023-09-30T17:02:55.336 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:55.336 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:55.336 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:55.336 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.336 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.336 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:26 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-09-30T17:02:55.337 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:02:55.337 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 36.860177086999997, 2023-09-30T17:02:55.337 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0066596119999999996, 2023-09-30T17:02:55.337 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:55.337 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:55.337 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:55.337 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.337 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:55.337 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:02:55.338 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:55.338 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.338 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.338 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:55.338 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:02:55.338 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:55.338 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.339 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.339 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:55.339 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362109+0000", 2023-09-30T17:02:55.339 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5699999999999999e-07 2023-09-30T17:02:55.339 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.339 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.339 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:55.339 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362112+0000", 2023-09-30T17:02:55.340 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8410000000000002e-06 2023-09-30T17:02:55.340 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.340 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.340 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:55.340 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362117+0000", 2023-09-30T17:02:55.340 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.792e-06 2023-09-30T17:02:55.340 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.341 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:55.341 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362122+0000", 2023-09-30T17:02:55.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.763e-06 2023-09-30T17:02:55.341 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.341 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:55.341 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362344+0000", 2023-09-30T17:02:55.342 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022181600000000001 2023-09-30T17:02:55.342 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.342 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.342 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:55.342 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362357+0000", 2023-09-30T17:02:55.342 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2864000000000001e-05 2023-09-30T17:02:55.342 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.343 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.343 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:55.343 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368738+0000", 2023-09-30T17:02:55.343 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063809499999999998 2023-09-30T17:02:55.343 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.343 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.343 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:55.344 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368768+0000", 2023-09-30T17:02:55.344 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0429e-05 2023-09-30T17:02:55.344 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:55.344 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:55.344 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:55.344 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.345 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.345 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2023-09-30T17:02:55.345 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:02:55.345 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 36.858960920000001, 2023-09-30T17:02:55.345 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00082185400000000001, 2023-09-30T17:02:55.345 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:55.345 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:55.346 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:55.346 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.346 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:55.346 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:02:55.346 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:55.346 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.346 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.347 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:55.347 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:02:55.347 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:55.347 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.347 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.347 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:55.347 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:02:55.347 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.22e-07 2023-09-30T17:02:55.347 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.348 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.348 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:55.348 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363327+0000", 2023-09-30T17:02:55.348 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4480000000000001e-06 2023-09-30T17:02:55.348 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.348 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.348 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:55.348 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363333+0000", 2023-09-30T17:02:55.348 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9989999999999997e-06 2023-09-30T17:02:55.348 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.349 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.349 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:55.349 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363354+0000", 2023-09-30T17:02:55.349 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0547000000000002e-05 2023-09-30T17:02:55.349 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.349 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.349 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:55.349 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364057+0000", 2023-09-30T17:02:55.349 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00070306600000000002 2023-09-30T17:02:55.349 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.350 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.350 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:55.350 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364063+0000", 2023-09-30T17:02:55.350 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.694e-06 2023-09-30T17:02:55.350 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.350 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.350 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:55.350 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364146+0000", 2023-09-30T17:02:55.350 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3877999999999999e-05 2023-09-30T17:02:55.350 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:55.351 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:55.351 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:55.351 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.351 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.351 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e18/16 ondisk, result = 0)", 2023-09-30T17:02:55.351 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:02:55.351 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 36.858647388000001, 2023-09-30T17:02:55.351 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00067007199999999996, 2023-09-30T17:02:55.351 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:55.352 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:55.352 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:55.352 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.352 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:55.352 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:02:55.352 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:55.352 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.352 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.352 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:55.352 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:02:55.352 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:55.353 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.353 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.353 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:55.353 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:02:55.353 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.41e-07 2023-09-30T17:02:55.353 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.353 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.353 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:55.353 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363641+0000", 2023-09-30T17:02:55.353 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4830000000000002e-06 2023-09-30T17:02:55.354 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.354 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.354 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:55.354 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363647+0000", 2023-09-30T17:02:55.354 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4869999999999999e-06 2023-09-30T17:02:55.354 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.354 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.354 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:55.354 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363654+0000", 2023-09-30T17:02:55.355 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5889999999999999e-06 2023-09-30T17:02:55.355 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.355 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.355 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:55.355 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364217+0000", 2023-09-30T17:02:55.355 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00056263199999999998 2023-09-30T17:02:55.355 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.355 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.355 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:55.356 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364222+0000", 2023-09-30T17:02:55.356 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.242e-06 2023-09-30T17:02:55.356 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.356 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.356 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:55.356 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364308+0000", 2023-09-30T17:02:55.356 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6397999999999995e-05 2023-09-30T17:02:55.356 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:55.356 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:55.357 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:55.357 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.357 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.357 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2023-09-30T17:02:55.357 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:02:55.357 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 36.849059478000001, 2023-09-30T17:02:55.357 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000359561, 2023-09-30T17:02:55.357 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:55.357 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2023-09-30T17:02:55.357 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:55.358 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.358 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:55.358 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:02:55.358 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:55.358 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.358 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.358 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:55.358 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:02:55.358 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:55.358 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.359 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.359 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:55.359 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:02:55.359 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1e-07 2023-09-30T17:02:55.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.359 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.359 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:55.359 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373228+0000", 2023-09-30T17:02:55.359 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9420000000000002e-06 2023-09-30T17:02:55.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.360 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.360 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:55.360 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373235+0000", 2023-09-30T17:02:55.360 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4230000000000002e-06 2023-09-30T17:02:55.360 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.360 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.360 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:55.360 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373239+0000", 2023-09-30T17:02:55.360 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6809999999999997e-06 2023-09-30T17:02:55.361 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.361 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.361 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:55.361 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373518+0000", 2023-09-30T17:02:55.361 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000278311 2023-09-30T17:02:55.361 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.361 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.361 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:55.361 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373586+0000", 2023-09-30T17:02:55.361 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7994e-05 2023-09-30T17:02:55.361 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:55.362 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:55.362 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:55.362 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.362 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.362 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:02:55.362 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:02:55.362 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 36.844633405000003, 2023-09-30T17:02:55.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0046632949999999996, 2023-09-30T17:02:55.363 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:55.363 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:55.363 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:55.363 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.363 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:55.363 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:02:55.363 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:55.363 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.363 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.363 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:55.364 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:02:55.364 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:55.364 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.364 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.364 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:55.364 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377653+0000", 2023-09-30T17:02:55.364 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7800000000000002e-07 2023-09-30T17:02:55.364 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.364 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.364 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:55.365 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377657+0000", 2023-09-30T17:02:55.365 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5859999999999998e-06 2023-09-30T17:02:55.365 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.365 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.365 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:55.365 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377677+0000", 2023-09-30T17:02:55.365 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9508999999999999e-05 2023-09-30T17:02:55.365 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.365 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.366 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:55.366 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377682+0000", 2023-09-30T17:02:55.366 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8300000000000001e-06 2023-09-30T17:02:55.366 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.366 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.366 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:55.366 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377725+0000", 2023-09-30T17:02:55.366 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2425000000000001e-05 2023-09-30T17:02:55.366 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.367 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:55.367 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377738+0000", 2023-09-30T17:02:55.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2899e-05 2023-09-30T17:02:55.367 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.367 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:55.367 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382268+0000", 2023-09-30T17:02:55.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045301289999999999 2023-09-30T17:02:55.368 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:55.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382315+0000", 2023-09-30T17:02:55.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7539e-05 2023-09-30T17:02:55.368 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:55.368 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:55.369 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:55.369 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.369 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.369 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-09-30T17:02:55.369 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:02:55.369 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 36.844183954000002, 2023-09-30T17:02:55.369 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042540670000000003, 2023-09-30T17:02:55.369 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:55.369 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:55.369 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:55.370 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.370 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:55.370 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:02:55.370 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:55.370 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.370 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.371 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:55.371 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:02:55.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:55.371 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.371 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:55.371 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:02:55.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0299999999999998e-07 2023-09-30T17:02:55.371 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.372 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.372 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:55.372 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378107+0000", 2023-09-30T17:02:55.372 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9250000000000003e-06 2023-09-30T17:02:55.372 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.372 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.372 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:55.372 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378116+0000", 2023-09-30T17:02:55.373 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.037e-06 2023-09-30T17:02:55.373 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.373 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.373 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:55.373 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378123+0000", 2023-09-30T17:02:55.373 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1879999999999996e-06 2023-09-30T17:02:55.373 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.374 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.374 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:55.374 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378174+0000", 2023-09-30T17:02:55.374 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0998000000000002e-05 2023-09-30T17:02:55.374 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.374 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.374 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:55.375 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378197+0000", 2023-09-30T17:02:55.375 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2558e-05 2023-09-30T17:02:55.375 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.375 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.375 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:55.375 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382319+0000", 2023-09-30T17:02:55.375 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041220950000000001 2023-09-30T17:02:55.376 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.376 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.376 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:55.376 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382356+0000", 2023-09-30T17:02:55.376 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6563000000000002e-05 2023-09-30T17:02:55.376 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:55.376 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:55.376 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:55.377 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.377 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.377 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-09-30T17:02:55.377 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:02:55.377 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 32.786420130000003, 2023-09-30T17:02:55.377 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00171641, 2023-09-30T17:02:55.378 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:55.378 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:55.378 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:55.378 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.378 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:55.378 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:02:55.378 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:55.378 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.378 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.379 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:55.379 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:02:55.379 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:55.379 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.379 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.379 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:55.379 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435868+0000", 2023-09-30T17:02:55.379 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5840000000000002e-06 2023-09-30T17:02:55.379 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.379 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.380 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:55.380 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435892+0000", 2023-09-30T17:02:55.380 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3625000000000002e-05 2023-09-30T17:02:55.380 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.380 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.380 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:55.380 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435908+0000", 2023-09-30T17:02:55.380 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6548000000000001e-05 2023-09-30T17:02:55.380 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.381 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.381 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:55.381 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435935+0000", 2023-09-30T17:02:55.381 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6516000000000002e-05 2023-09-30T17:02:55.381 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.381 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.381 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:55.381 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435996+0000", 2023-09-30T17:02:55.381 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1433999999999995e-05 2023-09-30T17:02:55.381 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.382 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.382 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:55.382 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436114+0000", 2023-09-30T17:02:55.382 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000118344 2023-09-30T17:02:55.382 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.382 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.382 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:55.382 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436219+0000", 2023-09-30T17:02:55.382 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010453100000000001 2023-09-30T17:02:55.382 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.383 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.383 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:55.383 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436900+0000", 2023-09-30T17:02:55.383 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00068121299999999996 2023-09-30T17:02:55.383 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.383 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.383 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:55.383 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437508+0000", 2023-09-30T17:02:55.383 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00060817399999999995 2023-09-30T17:02:55.384 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.384 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.384 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:55.384 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437554+0000", 2023-09-30T17:02:55.384 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5609000000000003e-05 2023-09-30T17:02:55.384 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.384 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.384 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:55.384 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437582+0000", 2023-09-30T17:02:55.384 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7832000000000001e-05 2023-09-30T17:02:55.385 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:55.385 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:55.385 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:55.385 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.385 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.385 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2023-09-30T17:02:55.385 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:02:55.385 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 12.786108636, 2023-09-30T17:02:55.385 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001456199, 2023-09-30T17:02:55.385 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:55.386 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:55.386 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:55.386 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.386 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:55.386 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:02:55.386 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:55.386 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.386 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.386 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:55.387 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:02:55.387 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:55.387 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.387 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.387 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:55.387 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436178+0000", 2023-09-30T17:02:55.387 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.494e-06 2023-09-30T17:02:55.387 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.387 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.387 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:55.388 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436184+0000", 2023-09-30T17:02:55.388 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2809999999999999e-06 2023-09-30T17:02:55.388 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.388 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.388 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:55.388 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436198+0000", 2023-09-30T17:02:55.388 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3978000000000001e-05 2023-09-30T17:02:55.388 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.388 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.388 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:55.389 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436206+0000", 2023-09-30T17:02:55.389 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8040000000000007e-06 2023-09-30T17:02:55.389 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.389 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.389 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:55.389 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436268+0000", 2023-09-30T17:02:55.389 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1484999999999998e-05 2023-09-30T17:02:55.389 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.389 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.390 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:55.390 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436339+0000", 2023-09-30T17:02:55.390 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1000000000000005e-05 2023-09-30T17:02:55.390 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.390 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.390 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:55.390 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436438+0000", 2023-09-30T17:02:55.390 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9389000000000007e-05 2023-09-30T17:02:55.391 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.391 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.391 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:55.391 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436986+0000", 2023-09-30T17:02:55.391 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054723399999999996 2023-09-30T17:02:55.391 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.391 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.391 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:55.391 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437566+0000", 2023-09-30T17:02:55.391 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00058017599999999996 2023-09-30T17:02:55.392 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.392 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.392 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:55.392 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437606+0000", 2023-09-30T17:02:55.392 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9891999999999997e-05 2023-09-30T17:02:55.392 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:55.392 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:55.392 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:55.392 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437633+0000", 2023-09-30T17:02:55.393 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7466000000000001e-05 2023-09-30T17:02:55.393 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:55.393 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:55.393 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:55.393 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:55.393 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:55.393 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:02:55.394 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-09-30T17:02:55.395 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:55.394+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:55.396 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:02:55.495 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:55.495+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:55.542 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:02:55.543 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:02:55.543 INFO:teuthology.orchestra.run.smithi031.stdout: "num_ops": 0 2023-09-30T17:02:55.543 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:02:55.553 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:02:55.596 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:55.596+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:55.627 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-09-30T17:02:55.698 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:55.697+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:55.726 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:02:55.726 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:02:55.726 INFO:teuthology.orchestra.run.smithi031.stdout: "complaint_time": 30, 2023-09-30T17:02:55.726 INFO:teuthology.orchestra.run.smithi031.stdout: "num_blocked_ops": 0 2023-09-30T17:02:55.726 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:02:55.736 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:02:55.799 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:55.798+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:55.859 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:02:55.868 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:55.868 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:55.878 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:02:55.889 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:02:55.889 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-09-30T17:02:55.890 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-09-30T17:02:55.890 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:02:55.893 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:02:55.894 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:02:55.922 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:55.921+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:56.000 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:56.000+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:56.009 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:56.009 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:56.019 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:02:56.101 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:56.101+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:56.185 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:56.185 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:56.195 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:02:56.202 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:56.202+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:56.273 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is unset 2023-09-30T17:02:56.303 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:56.302+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:56.324 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:56.324 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:56.334 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:02:56.405 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:56.404+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:56.471 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:56.471 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:56.481 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:02:56.524 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:56.524+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:56.606 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:56.605+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:56.613 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:56.613 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:56.623 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:02:56.707 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:56.706+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:56.741 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2] out_osds: [] dead_osds: [2] live_osds: [0, 1] 2023-09-30T17:02:56.741 INFO:tasks.thrashosds.thrasher:Reviving osd 2 2023-09-30T17:02:56.741 INFO:tasks.ceph.ceph_manager.ceph:kill_osd on osd.2 doing powercycle of ubuntu@smithi134.front.sepia.ceph.com 2023-09-30T17:02:56.741 INFO:teuthology.orchestra.console.smithi134:Power on 2023-09-30T17:02:56.742 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2023-09-30T17:02:56.764 DEBUG:teuthology.orchestra.console.smithi134:power on output: Chassis Power Control: Up/On 2023-09-30T17:02:56.764 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T17:02:56.783 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off 2023-09-30T17:02:56.795 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:56.795 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:56.806 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:02:56.846 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:56.846+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:56.908 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:56.907+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:56.936 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:56.936 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:56.946 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:02:57.008 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:57.007+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:57.073 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:57.073 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:57.083 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:02:57.109 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:57.109+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:57.210 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:57.210+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:57.249 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:57.249 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:57.259 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:02:57.311 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:57.310+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:57.402 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:57.402 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:57.411 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:57.411+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:57.413 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:02:57.512 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:57.512+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:57.585 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:57.585 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:57.595 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:02:57.638 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:57.638+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:57.714 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:57.713+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:57.727 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:57.727 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:57.738 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:02:57.815 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:57.813+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:57.867 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:57.867 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:57.877 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:02:57.895 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-09-30T17:02:57.915 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:57.915+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:58.016 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:58.015+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:58.043 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:02:58.044 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:02:58.054 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:02:58.128 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:02:58.139 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:58.138+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:58.164 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:02:58.165 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-09-30T17:02:58.165 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-09-30T17:02:58.165 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:02:58.169 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:02:58.169 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:02:58.219 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:58.218+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:58.224 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:02:58.225 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2023-09-30T17:02:58.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2023-09-30T17:02:58.225 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2023-09-30T17:02:58.225 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.225 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:58.225 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:02:58.225 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 39.871405234999997, 2023-09-30T17:02:58.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093789779999999996, 2023-09-30T17:02:58.225 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:58.225 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:58.226 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:58.226 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.226 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:58.226 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:02:58.226 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:58.226 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.226 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.226 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:58.226 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:02:58.226 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:58.226 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.226 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:58.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352027+0000", 2023-09-30T17:02:58.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0224000000000001e-05 2023-09-30T17:02:58.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:58.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352039+0000", 2023-09-30T17:02:58.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1569000000000001e-05 2023-09-30T17:02:58.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:58.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352052+0000", 2023-09-30T17:02:58.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2605999999999999e-05 2023-09-30T17:02:58.228 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.228 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.228 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:58.228 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352064+0000", 2023-09-30T17:02:58.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2666999999999999e-05 2023-09-30T17:02:58.228 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.228 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.228 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:58.228 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352147+0000", 2023-09-30T17:02:58.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3125000000000001e-05 2023-09-30T17:02:58.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.229 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:58.229 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352306+0000", 2023-09-30T17:02:58.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015881900000000001 2023-09-30T17:02:58.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.229 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:58.229 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352450+0000", 2023-09-30T17:02:58.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014420700000000001 2023-09-30T17:02:58.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.230 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:58.230 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355975+0000", 2023-09-30T17:02:58.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003524246 2023-09-30T17:02:58.230 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.230 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:58.230 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361279+0000", 2023-09-30T17:02:58.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005304507 2023-09-30T17:02:58.230 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.230 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:58.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361344+0000", 2023-09-30T17:02:58.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4548999999999995e-05 2023-09-30T17:02:58.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.231 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:58.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361396+0000", 2023-09-30T17:02:58.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2459e-05 2023-09-30T17:02:58.231 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:58.231 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:58.231 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:58.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.232 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:58.232 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:02:58.232 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 39.871312943, 2023-09-30T17:02:58.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021233007000000002, 2023-09-30T17:02:58.232 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:58.232 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:58.232 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:58.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:58.232 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:02:58.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:58.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.233 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.233 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:58.233 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:02:58.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:58.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.233 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.233 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:58.233 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352110+0000", 2023-09-30T17:02:58.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6000000000000002e-07 2023-09-30T17:02:58.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.233 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.234 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:58.234 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352117+0000", 2023-09-30T17:02:58.234 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5930000000000002e-06 2023-09-30T17:02:58.234 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.234 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.234 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:58.234 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352126+0000", 2023-09-30T17:02:58.234 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0729999999999994e-06 2023-09-30T17:02:58.234 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.234 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.234 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:58.235 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352136+0000", 2023-09-30T17:02:58.235 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0380000000000001e-05 2023-09-30T17:02:58.235 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.235 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.235 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:58.235 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353279+0000", 2023-09-30T17:02:58.235 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0011424670000000001 2023-09-30T17:02:58.235 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.235 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.235 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:58.235 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353707+0000", 2023-09-30T17:02:58.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00042829800000000003 2023-09-30T17:02:58.236 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.236 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.236 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:58.236 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354104+0000", 2023-09-30T17:02:58.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00039643399999999998 2023-09-30T17:02:58.236 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.236 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.236 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:58.236 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356925+0000", 2023-09-30T17:02:58.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0028210900000000001 2023-09-30T17:02:58.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:58.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373243+0000", 2023-09-30T17:02:58.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016318461999999999 2023-09-30T17:02:58.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:58.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373301+0000", 2023-09-30T17:02:58.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7435000000000002e-05 2023-09-30T17:02:58.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:58.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373342+0000", 2023-09-30T17:02:58.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1915000000000001e-05 2023-09-30T17:02:58.238 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:58.238 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:58.238 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:58.238 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.238 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:58.238 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:02:58.238 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 39.871270332000002, 2023-09-30T17:02:58.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011988331, 2023-09-30T17:02:58.239 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:58.239 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:58.239 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:58.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.239 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:58.239 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:02:58.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:58.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.239 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:58.239 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:02:58.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:58.240 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.240 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.240 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:58.240 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352153+0000", 2023-09-30T17:02:58.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0500000000000003e-07 2023-09-30T17:02:58.240 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.240 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.240 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:58.240 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352157+0000", 2023-09-30T17:02:58.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9790000000000004e-06 2023-09-30T17:02:58.240 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.241 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:58.241 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352173+0000", 2023-09-30T17:02:58.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6535999999999999e-05 2023-09-30T17:02:58.241 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.241 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:58.241 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352180+0000", 2023-09-30T17:02:58.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7700000000000004e-06 2023-09-30T17:02:58.241 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:58.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353526+0000", 2023-09-30T17:02:58.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0013458330000000001 2023-09-30T17:02:58.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:58.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353648+0000", 2023-09-30T17:02:58.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012262899999999999 2023-09-30T17:02:58.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:02:58.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354141+0000", 2023-09-30T17:02:58.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00049222899999999995 2023-09-30T17:02:58.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:58.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356931+0000", 2023-09-30T17:02:58.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0027900860000000002 2023-09-30T17:02:58.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:58.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364066+0000", 2023-09-30T17:02:58.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071355050000000003 2023-09-30T17:02:58.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:58.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364103+0000", 2023-09-30T17:02:58.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6944999999999999e-05 2023-09-30T17:02:58.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:58.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364140+0000", 2023-09-30T17:02:58.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7214e-05 2023-09-30T17:02:58.244 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:58.244 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:58.244 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:58.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.245 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:58.245 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:02:58.245 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 39.871231100999999, 2023-09-30T17:02:58.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012110921, 2023-09-30T17:02:58.245 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:58.245 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:58.245 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:58.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.245 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:58.245 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:02:58.246 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:58.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.246 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:58.246 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:02:58.246 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:58.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.246 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:58.246 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352192+0000", 2023-09-30T17:02:58.246 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7300000000000005e-07 2023-09-30T17:02:58.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:58.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352196+0000", 2023-09-30T17:02:58.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2370000000000003e-06 2023-09-30T17:02:58.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:58.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352205+0000", 2023-09-30T17:02:58.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6659999999999997e-06 2023-09-30T17:02:58.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:58.248 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352214+0000", 2023-09-30T17:02:58.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8259999999999999e-06 2023-09-30T17:02:58.248 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.248 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:58.248 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354470+0000", 2023-09-30T17:02:58.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022557340000000001 2023-09-30T17:02:58.248 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.248 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:58.248 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354557+0000", 2023-09-30T17:02:58.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6909000000000004e-05 2023-09-30T17:02:58.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.249 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:02:58.249 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354694+0000", 2023-09-30T17:02:58.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013774800000000001 2023-09-30T17:02:58.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.249 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:58.249 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356937+0000", 2023-09-30T17:02:58.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022424540000000001 2023-09-30T17:02:58.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:58.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364227+0000", 2023-09-30T17:02:58.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072902430000000001 2023-09-30T17:02:58.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:58.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364278+0000", 2023-09-30T17:02:58.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1180999999999997e-05 2023-09-30T17:02:58.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:58.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364302+0000", 2023-09-30T17:02:58.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4049999999999998e-05 2023-09-30T17:02:58.251 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:58.251 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:58.251 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:58.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.251 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:58.251 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:02:58.251 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 39.871197762000001, 2023-09-30T17:02:58.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021258651999999999, 2023-09-30T17:02:58.251 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:58.251 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:58.251 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:58.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:58.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:02:58.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:58.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:58.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:02:58.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:58.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:58.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:02:58.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6899999999999997e-07 2023-09-30T17:02:58.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.253 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:58.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352236+0000", 2023-09-30T17:02:58.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0251000000000001e-05 2023-09-30T17:02:58.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.253 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:58.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352244+0000", 2023-09-30T17:02:58.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0770000000000008e-06 2023-09-30T17:02:58.254 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.254 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:58.254 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352251+0000", 2023-09-30T17:02:58.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4749999999999996e-06 2023-09-30T17:02:58.254 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.254 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:58.254 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354455+0000", 2023-09-30T17:02:58.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022043660000000001 2023-09-30T17:02:58.254 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:58.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354577+0000", 2023-09-30T17:02:58.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000121054 2023-09-30T17:02:58.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:58.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354723+0000", 2023-09-30T17:02:58.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014693900000000001 2023-09-30T17:02:58.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:58.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356941+0000", 2023-09-30T17:02:58.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002217199 2023-09-30T17:02:58.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:58.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373392+0000", 2023-09-30T17:02:58.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016451774999999998 2023-09-30T17:02:58.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:58.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373445+0000", 2023-09-30T17:02:58.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.308e-05 2023-09-30T17:02:58.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.257 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.257 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:58.257 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373483+0000", 2023-09-30T17:02:58.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7766999999999999e-05 2023-09-30T17:02:58.257 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:58.257 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:58.257 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:58.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.257 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.257 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:58.257 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:02:58.257 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 39.871161671000003, 2023-09-30T17:02:58.258 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020903497, 2023-09-30T17:02:58.258 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:58.258 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:58.258 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:58.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:58.258 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:02:58.258 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:58.258 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:58.258 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:02:58.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:58.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.259 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:58.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:02:58.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0800000000000004e-07 2023-09-30T17:02:58.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.259 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:58.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352266+0000", 2023-09-30T17:02:58.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1280000000000001e-06 2023-09-30T17:02:58.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:58.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352273+0000", 2023-09-30T17:02:58.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3730000000000004e-06 2023-09-30T17:02:58.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:58.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352279+0000", 2023-09-30T17:02:58.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7699999999999998e-06 2023-09-30T17:02:58.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:58.261 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352334+0000", 2023-09-30T17:02:58.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5547999999999997e-05 2023-09-30T17:02:58.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.261 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:58.261 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352435+0000", 2023-09-30T17:02:58.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100688 2023-09-30T17:02:58.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.261 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:58.261 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352585+0000", 2023-09-30T17:02:58.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000150068 2023-09-30T17:02:58.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.262 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:58.262 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354912+0000", 2023-09-30T17:02:58.262 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0023266770000000001 2023-09-30T17:02:58.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.262 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:58.262 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373066+0000", 2023-09-30T17:02:58.262 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018154474 2023-09-30T17:02:58.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:58.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373122+0000", 2023-09-30T17:02:58.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6193000000000002e-05 2023-09-30T17:02:58.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:58.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373164+0000", 2023-09-30T17:02:58.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1869999999999997e-05 2023-09-30T17:02:58.263 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:58.263 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:58.263 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:58.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.264 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:58.264 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:02:58.264 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 39.871125995, 2023-09-30T17:02:58.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021015097999999999, 2023-09-30T17:02:58.264 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:58.264 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:58.264 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:58.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:58.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:02:58.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:58.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:58.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:02:58.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:58.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:58.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352297+0000", 2023-09-30T17:02:58.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8299999999999997e-07 2023-09-30T17:02:58.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.266 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:58.266 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352300+0000", 2023-09-30T17:02:58.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7460000000000001e-06 2023-09-30T17:02:58.266 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.266 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.266 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:58.266 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352307+0000", 2023-09-30T17:02:58.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4959999999999999e-06 2023-09-30T17:02:58.266 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.266 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.266 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:58.267 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352314+0000", 2023-09-30T17:02:58.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0190000000000001e-06 2023-09-30T17:02:58.267 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.267 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:58.267 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354070+0000", 2023-09-30T17:02:58.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001755936 2023-09-30T17:02:58.267 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.267 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:58.267 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354221+0000", 2023-09-30T17:02:58.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000150884 2023-09-30T17:02:58.268 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.268 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:58.268 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373311+0000", 2023-09-30T17:02:58.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019090434 2023-09-30T17:02:58.268 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:58.268 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:58.268 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:58.268 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.268 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:58.269 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:02:58.269 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 39.871097276, 2023-09-30T17:02:58.269 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021255174000000002, 2023-09-30T17:02:58.269 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:58.269 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:58.269 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:58.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.269 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:58.269 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:02:58.269 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:58.269 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.270 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:58.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:02:58.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:58.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.270 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:58.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352326+0000", 2023-09-30T17:02:58.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3200000000000005e-07 2023-09-30T17:02:58.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.270 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:58.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352349+0000", 2023-09-30T17:02:58.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3183000000000001e-05 2023-09-30T17:02:58.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:58.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352358+0000", 2023-09-30T17:02:58.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5230000000000001e-06 2023-09-30T17:02:58.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:58.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352365+0000", 2023-09-30T17:02:58.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3260000000000001e-06 2023-09-30T17:02:58.272 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.272 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:58.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355450+0000", 2023-09-30T17:02:58.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0030854049999999998 2023-09-30T17:02:58.272 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.272 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:58.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355583+0000", 2023-09-30T17:02:58.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000133189 2023-09-30T17:02:58.272 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.273 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:58.273 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373580+0000", 2023-09-30T17:02:58.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017997016000000001 2023-09-30T17:02:58.273 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:58.273 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:58.273 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:58.273 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.273 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.273 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:58.273 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:02:58.273 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 39.871045852999998, 2023-09-30T17:02:58.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010380537, 2023-09-30T17:02:58.274 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:58.274 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:58.274 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:58.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.274 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:58.274 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:02:58.274 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:58.274 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.274 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:58.274 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:02:58.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:58.275 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.275 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:58.275 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:02:58.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1500000000000003e-07 2023-09-30T17:02:58.275 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.275 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:58.275 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352381+0000", 2023-09-30T17:02:58.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6330000000000002e-06 2023-09-30T17:02:58.275 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:58.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352388+0000", 2023-09-30T17:02:58.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7229999999999998e-06 2023-09-30T17:02:58.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:58.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352394+0000", 2023-09-30T17:02:58.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1789999999999996e-06 2023-09-30T17:02:58.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:58.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353259+0000", 2023-09-30T17:02:58.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000865221 2023-09-30T17:02:58.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:58.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353391+0000", 2023-09-30T17:02:58.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013217700000000001 2023-09-30T17:02:58.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:58.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362757+0000", 2023-09-30T17:02:58.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093657889999999994 2023-09-30T17:02:58.278 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:58.278 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:58.278 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:58.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.278 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-09-30T17:02:58.278 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:02:58.278 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 39.864745560999999, 2023-09-30T17:02:58.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0061813579999999996, 2023-09-30T17:02:58.278 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:58.278 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2023-09-30T17:02:58.278 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:58.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:58.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:02:58.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:58.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:58.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:02:58.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:58.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:58.280 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:02:58.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5499999999999999e-07 2023-09-30T17:02:58.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.280 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:58.280 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358686+0000", 2023-09-30T17:02:58.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9979999999999992e-06 2023-09-30T17:02:58.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.280 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:58.280 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358700+0000", 2023-09-30T17:02:58.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3635000000000001e-05 2023-09-30T17:02:58.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:58.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358714+0000", 2023-09-30T17:02:58.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4470999999999999e-05 2023-09-30T17:02:58.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:58.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358767+0000", 2023-09-30T17:02:58.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2651999999999997e-05 2023-09-30T17:02:58.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:58.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364858+0000", 2023-09-30T17:02:58.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060912470000000002 2023-09-30T17:02:58.282 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:58.282 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:58.282 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:58.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.282 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2023-09-30T17:02:58.282 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:02:58.282 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 39.862380721000001, 2023-09-30T17:02:58.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00036246299999999999, 2023-09-30T17:02:58.283 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:58.283 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:58.283 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:58.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.283 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:58.283 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:02:58.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:58.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.283 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:58.283 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:02:58.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:58.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.284 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:58.284 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:02:58.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3099999999999999e-07 2023-09-30T17:02:58.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.284 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:58.284 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361045+0000", 2023-09-30T17:02:58.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.49e-06 2023-09-30T17:02:58.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:58.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361056+0000", 2023-09-30T17:02:58.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0910000000000001e-05 2023-09-30T17:02:58.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:58.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361067+0000", 2023-09-30T17:02:58.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0531e-05 2023-09-30T17:02:58.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:58.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361263+0000", 2023-09-30T17:02:58.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000196486 2023-09-30T17:02:58.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:58.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361273+0000", 2023-09-30T17:02:58.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3379999999999994e-06 2023-09-30T17:02:58.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:58.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361404+0000", 2023-09-30T17:02:58.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013137700000000001 2023-09-30T17:02:58.286 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:58.287 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:58.287 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:58.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.287 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:31 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:02:58.287 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:02:58.287 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 39.861404692000001, 2023-09-30T17:02:58.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006676408, 2023-09-30T17:02:58.287 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:58.287 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:58.287 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:58.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:58.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:02:58.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:58.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:58.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:02:58.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:58.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:58.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:02:58.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5600000000000002e-07 2023-09-30T17:02:58.289 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.289 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:58.289 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362044+0000", 2023-09-30T17:02:58.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5987999999999999e-05 2023-09-30T17:02:58.289 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.289 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:58.289 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362051+0000", 2023-09-30T17:02:58.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2599999999999999e-06 2023-09-30T17:02:58.289 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:58.290 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362057+0000", 2023-09-30T17:02:58.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.19e-06 2023-09-30T17:02:58.290 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:58.290 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362096+0000", 2023-09-30T17:02:58.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8278000000000002e-05 2023-09-30T17:02:58.290 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:58.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362114+0000", 2023-09-30T17:02:58.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8808e-05 2023-09-30T17:02:58.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:58.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368658+0000", 2023-09-30T17:02:58.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065433540000000004 2023-09-30T17:02:58.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:58.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368694+0000", 2023-09-30T17:02:58.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6273999999999999e-05 2023-09-30T17:02:58.292 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:58.292 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:58.292 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:58.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.292 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:26 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-09-30T17:02:58.292 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:02:58.292 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 39.861313920000001, 2023-09-30T17:02:58.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0066596119999999996, 2023-09-30T17:02:58.292 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:58.292 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:58.292 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:58.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.293 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:58.293 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:02:58.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:58.293 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.293 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:58.293 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:02:58.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:58.293 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.293 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:58.294 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362109+0000", 2023-09-30T17:02:58.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5699999999999999e-07 2023-09-30T17:02:58.294 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.294 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:58.294 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362112+0000", 2023-09-30T17:02:58.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8410000000000002e-06 2023-09-30T17:02:58.294 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.294 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:58.294 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362117+0000", 2023-09-30T17:02:58.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.792e-06 2023-09-30T17:02:58.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:58.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362122+0000", 2023-09-30T17:02:58.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.763e-06 2023-09-30T17:02:58.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:58.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362344+0000", 2023-09-30T17:02:58.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022181600000000001 2023-09-30T17:02:58.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.296 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:58.296 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362357+0000", 2023-09-30T17:02:58.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2864000000000001e-05 2023-09-30T17:02:58.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.296 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:58.296 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368738+0000", 2023-09-30T17:02:58.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063809499999999998 2023-09-30T17:02:58.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.296 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:58.296 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368768+0000", 2023-09-30T17:02:58.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0429e-05 2023-09-30T17:02:58.297 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:58.297 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:58.297 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:58.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.297 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2023-09-30T17:02:58.297 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:02:58.297 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 39.860097752999998, 2023-09-30T17:02:58.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00082185400000000001, 2023-09-30T17:02:58.297 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:58.297 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:58.298 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:58.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:58.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:02:58.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:58.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:58.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:02:58.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:58.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.299 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:58.299 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:02:58.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.22e-07 2023-09-30T17:02:58.299 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.299 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:58.299 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363327+0000", 2023-09-30T17:02:58.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4480000000000001e-06 2023-09-30T17:02:58.299 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.299 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:58.299 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363333+0000", 2023-09-30T17:02:58.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9989999999999997e-06 2023-09-30T17:02:58.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.300 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:58.300 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363354+0000", 2023-09-30T17:02:58.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0547000000000002e-05 2023-09-30T17:02:58.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.300 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:58.300 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364057+0000", 2023-09-30T17:02:58.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00070306600000000002 2023-09-30T17:02:58.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:58.301 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364063+0000", 2023-09-30T17:02:58.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.694e-06 2023-09-30T17:02:58.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:58.301 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364146+0000", 2023-09-30T17:02:58.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3877999999999999e-05 2023-09-30T17:02:58.301 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:58.301 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:58.301 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:58.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.302 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e18/16 ondisk, result = 0)", 2023-09-30T17:02:58.302 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:02:58.302 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 39.859784220999998, 2023-09-30T17:02:58.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00067007199999999996, 2023-09-30T17:02:58.302 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:58.302 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:58.302 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:58.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:58.302 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:02:58.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:58.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.303 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:58.303 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:02:58.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:58.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.303 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:58.303 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:02:58.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.41e-07 2023-09-30T17:02:58.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.304 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:58.304 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363641+0000", 2023-09-30T17:02:58.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4830000000000002e-06 2023-09-30T17:02:58.304 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.304 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:58.304 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363647+0000", 2023-09-30T17:02:58.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4869999999999999e-06 2023-09-30T17:02:58.304 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.304 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:58.304 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363654+0000", 2023-09-30T17:02:58.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5889999999999999e-06 2023-09-30T17:02:58.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.305 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:58.305 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364217+0000", 2023-09-30T17:02:58.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00056263199999999998 2023-09-30T17:02:58.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.305 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:58.305 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364222+0000", 2023-09-30T17:02:58.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.242e-06 2023-09-30T17:02:58.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:58.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364308+0000", 2023-09-30T17:02:58.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6397999999999995e-05 2023-09-30T17:02:58.306 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:58.306 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:58.306 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:58.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.306 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2023-09-30T17:02:58.306 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:02:58.306 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 39.850196310999998, 2023-09-30T17:02:58.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000359561, 2023-09-30T17:02:58.307 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:58.307 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2023-09-30T17:02:58.307 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:58.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:58.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:02:58.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:58.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:58.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:02:58.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:58.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.308 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:58.308 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:02:58.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1e-07 2023-09-30T17:02:58.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.308 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:58.308 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373228+0000", 2023-09-30T17:02:58.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9420000000000002e-06 2023-09-30T17:02:58.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:58.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373235+0000", 2023-09-30T17:02:58.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4230000000000002e-06 2023-09-30T17:02:58.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:58.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373239+0000", 2023-09-30T17:02:58.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6809999999999997e-06 2023-09-30T17:02:58.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:58.310 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373518+0000", 2023-09-30T17:02:58.310 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000278311 2023-09-30T17:02:58.310 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.310 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.310 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:58.310 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373586+0000", 2023-09-30T17:02:58.310 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7994e-05 2023-09-30T17:02:58.310 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:58.310 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:58.310 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:58.310 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.310 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.311 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:02:58.311 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:02:58.311 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 39.845770238, 2023-09-30T17:02:58.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0046632949999999996, 2023-09-30T17:02:58.311 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:58.311 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:58.311 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:58.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.311 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:58.311 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:02:58.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:58.311 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:58.312 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:02:58.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:58.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:58.312 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377653+0000", 2023-09-30T17:02:58.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7800000000000002e-07 2023-09-30T17:02:58.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:58.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377657+0000", 2023-09-30T17:02:58.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5859999999999998e-06 2023-09-30T17:02:58.313 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:58.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377677+0000", 2023-09-30T17:02:58.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9508999999999999e-05 2023-09-30T17:02:58.313 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:58.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377682+0000", 2023-09-30T17:02:58.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8300000000000001e-06 2023-09-30T17:02:58.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:58.314 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377725+0000", 2023-09-30T17:02:58.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2425000000000001e-05 2023-09-30T17:02:58.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:58.314 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377738+0000", 2023-09-30T17:02:58.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2899e-05 2023-09-30T17:02:58.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.315 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:58.315 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382268+0000", 2023-09-30T17:02:58.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045301289999999999 2023-09-30T17:02:58.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.315 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:58.315 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382315+0000", 2023-09-30T17:02:58.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7539e-05 2023-09-30T17:02:58.315 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:58.315 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:58.315 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:58.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.316 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-09-30T17:02:58.316 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:02:58.316 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 39.845320786999999, 2023-09-30T17:02:58.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042540670000000003, 2023-09-30T17:02:58.316 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:58.316 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:58.316 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:58.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:58.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:02:58.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:58.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.317 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:58.317 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:02:58.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:58.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.317 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:58.317 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:02:58.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0299999999999998e-07 2023-09-30T17:02:58.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:58.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378107+0000", 2023-09-30T17:02:58.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9250000000000003e-06 2023-09-30T17:02:58.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:58.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378116+0000", 2023-09-30T17:02:58.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.037e-06 2023-09-30T17:02:58.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:58.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378123+0000", 2023-09-30T17:02:58.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1879999999999996e-06 2023-09-30T17:02:58.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:58.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378174+0000", 2023-09-30T17:02:58.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0998000000000002e-05 2023-09-30T17:02:58.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:58.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378197+0000", 2023-09-30T17:02:58.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2558e-05 2023-09-30T17:02:58.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:58.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382319+0000", 2023-09-30T17:02:58.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041220950000000001 2023-09-30T17:02:58.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:58.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382356+0000", 2023-09-30T17:02:58.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6563000000000002e-05 2023-09-30T17:02:58.320 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:58.320 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:58.321 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:58.321 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.321 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-09-30T17:02:58.321 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:02:58.321 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 35.787556963, 2023-09-30T17:02:58.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00171641, 2023-09-30T17:02:58.321 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:58.321 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:58.321 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:58.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.321 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:58.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:02:58.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:58.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:58.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:02:58.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:58.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:58.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435868+0000", 2023-09-30T17:02:58.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5840000000000002e-06 2023-09-30T17:02:58.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:58.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435892+0000", 2023-09-30T17:02:58.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3625000000000002e-05 2023-09-30T17:02:58.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:58.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435908+0000", 2023-09-30T17:02:58.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6548000000000001e-05 2023-09-30T17:02:58.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:58.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435935+0000", 2023-09-30T17:02:58.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6516000000000002e-05 2023-09-30T17:02:58.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:58.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435996+0000", 2023-09-30T17:02:58.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1433999999999995e-05 2023-09-30T17:02:58.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:58.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436114+0000", 2023-09-30T17:02:58.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000118344 2023-09-30T17:02:58.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:58.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436219+0000", 2023-09-30T17:02:58.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010453100000000001 2023-09-30T17:02:58.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:58.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436900+0000", 2023-09-30T17:02:58.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00068121299999999996 2023-09-30T17:02:58.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.326 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:58.326 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437508+0000", 2023-09-30T17:02:58.326 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00060817399999999995 2023-09-30T17:02:58.326 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.326 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:58.326 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437554+0000", 2023-09-30T17:02:58.326 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5609000000000003e-05 2023-09-30T17:02:58.326 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.327 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:58.327 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437582+0000", 2023-09-30T17:02:58.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7832000000000001e-05 2023-09-30T17:02:58.327 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:58.327 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:58.327 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:58.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.327 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2023-09-30T17:02:58.327 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:02:58.327 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 15.787245469, 2023-09-30T17:02:58.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001456199, 2023-09-30T17:02:58.327 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:58.328 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:58.328 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:58.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:58.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:02:58.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:58.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:58.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:02:58.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:58.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.329 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:58.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436178+0000", 2023-09-30T17:02:58.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.494e-06 2023-09-30T17:02:58.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.329 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:58.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436184+0000", 2023-09-30T17:02:58.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2809999999999999e-06 2023-09-30T17:02:58.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.329 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:58.330 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436198+0000", 2023-09-30T17:02:58.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3978000000000001e-05 2023-09-30T17:02:58.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.330 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:58.330 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436206+0000", 2023-09-30T17:02:58.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8040000000000007e-06 2023-09-30T17:02:58.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.330 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:58.330 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436268+0000", 2023-09-30T17:02:58.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1484999999999998e-05 2023-09-30T17:02:58.331 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.331 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.331 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:58.331 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436339+0000", 2023-09-30T17:02:58.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1000000000000005e-05 2023-09-30T17:02:58.331 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.331 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.331 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:58.331 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436438+0000", 2023-09-30T17:02:58.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9389000000000007e-05 2023-09-30T17:02:58.331 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.331 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:58.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436986+0000", 2023-09-30T17:02:58.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054723399999999996 2023-09-30T17:02:58.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:58.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437566+0000", 2023-09-30T17:02:58.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00058017599999999996 2023-09-30T17:02:58.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:58.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437606+0000", 2023-09-30T17:02:58.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9891999999999997e-05 2023-09-30T17:02:58.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:58.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:58.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:58.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437633+0000", 2023-09-30T17:02:58.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7466000000000001e-05 2023-09-30T17:02:58.333 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:58.333 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:58.333 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:58.333 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:58.333 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:58.333 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:02:58.334 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-09-30T17:02:58.336 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:02:58.336 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:58.335+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:58.435 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:58.435+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:58.483 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:02:58.483 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:02:58.483 INFO:teuthology.orchestra.run.smithi031.stdout: "num_ops": 0 2023-09-30T17:02:58.483 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:02:58.493 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:02:58.537 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:58.536+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:58.637 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:58.637+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:58.666 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:02:58.666 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:02:58.666 INFO:teuthology.orchestra.run.smithi031.stdout: "complaint_time": 30, 2023-09-30T17:02:58.666 INFO:teuthology.orchestra.run.smithi031.stdout: "num_blocked_ops": 0 2023-09-30T17:02:58.666 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:02:58.676 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:02:58.738 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:58.738+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:58.810 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:02:58.810 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 20, 2023-09-30T17:02:58.810 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 600, 2023-09-30T17:02:58.810 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:02:58.810 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.810 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:32 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'18, mlcod=11'14)", 2023-09-30T17:02:58.811 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:02:58.811 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 51.44724755, 2023-09-30T17:02:58.811 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051629809999999996, 2023-09-30T17:02:58.811 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:58.811 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:58.811 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:58.811 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.811 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:58.811 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:02:58.811 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:58.811 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.812 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.812 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:58.812 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:02:58.812 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:58.812 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.812 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.812 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:58.812 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:02:58.812 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2099999999999996e-07 2023-09-30T17:02:58.812 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.812 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.812 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:58.813 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361407+0000", 2023-09-30T17:02:58.813 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7499e-05 2023-09-30T17:02:58.813 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.813 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.813 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:58.813 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361418+0000", 2023-09-30T17:02:58.813 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1127999999999999e-05 2023-09-30T17:02:58.813 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.813 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.813 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:58.813 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361423+0000", 2023-09-30T17:02:58.813 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1930000000000001e-06 2023-09-30T17:02:58.814 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.814 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.814 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:58.814 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361476+0000", 2023-09-30T17:02:58.814 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3399000000000002e-05 2023-09-30T17:02:58.814 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.814 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.814 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:58.814 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361496+0000", 2023-09-30T17:02:58.814 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9638000000000001e-05 2023-09-30T17:02:58.814 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.815 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.815 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:58.815 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.366474+0000", 2023-09-30T17:02:58.815 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0049778829999999998 2023-09-30T17:02:58.815 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.815 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.815 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:58.815 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.366512+0000", 2023-09-30T17:02:58.815 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7620000000000002e-05 2023-09-30T17:02:58.815 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:58.816 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:58.816 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:58.816 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.816 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.816 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:37 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'23, mlcod=11'15)", 2023-09-30T17:02:58.816 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:02:58.816 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 51.444645553000001, 2023-09-30T17:02:58.816 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053985689999999998, 2023-09-30T17:02:58.816 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:58.816 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:58.816 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:58.816 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.817 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:58.817 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:02:58.817 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:58.817 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.817 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.817 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:58.817 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:02:58.817 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:58.817 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.817 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.817 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:58.817 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:02:58.818 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4400000000000001e-07 2023-09-30T17:02:58.818 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.818 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.818 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:58.818 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363956+0000", 2023-09-30T17:02:58.818 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.921e-06 2023-09-30T17:02:58.818 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.818 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.818 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:58.818 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363966+0000", 2023-09-30T17:02:58.818 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0351e-05 2023-09-30T17:02:58.819 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.819 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.819 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:58.819 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363971+0000", 2023-09-30T17:02:58.819 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.023e-06 2023-09-30T17:02:58.819 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.819 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.819 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:58.819 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.364013+0000", 2023-09-30T17:02:58.819 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1575000000000001e-05 2023-09-30T17:02:58.819 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.819 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.820 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:58.820 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.364026+0000", 2023-09-30T17:02:58.820 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3044000000000001e-05 2023-09-30T17:02:58.820 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.820 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.820 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:58.820 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.369308+0000", 2023-09-30T17:02:58.820 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005282152 2023-09-30T17:02:58.820 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.820 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.820 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:58.820 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.369349+0000", 2023-09-30T17:02:58.821 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1059000000000001e-05 2023-09-30T17:02:58.821 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:58.821 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:58.821 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:58.821 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.821 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.821 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:155 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'109, mlcod=11'105)", 2023-09-30T17:02:58.821 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:02:58.821 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 50.962949866999999, 2023-09-30T17:02:58.821 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053867639999999996, 2023-09-30T17:02:58.821 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:58.821 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:58.822 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:58.822 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.822 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:58.822 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:02:58.822 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:58.822 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.822 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.822 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:58.822 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:02:58.822 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:58.822 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.823 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.823 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:58.823 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845647+0000", 2023-09-30T17:02:58.823 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7599999999999997e-07 2023-09-30T17:02:58.823 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.823 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.823 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:58.823 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845699+0000", 2023-09-30T17:02:58.823 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1758000000000001e-05 2023-09-30T17:02:58.823 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.824 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.824 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:58.824 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845708+0000", 2023-09-30T17:02:58.824 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2159999999999995e-06 2023-09-30T17:02:58.824 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.824 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.824 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:58.824 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845712+0000", 2023-09-30T17:02:58.824 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2579999999999997e-06 2023-09-30T17:02:58.824 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.824 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.824 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:58.825 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845756+0000", 2023-09-30T17:02:58.825 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4119999999999998e-05 2023-09-30T17:02:58.825 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.825 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.825 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:58.825 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845779+0000", 2023-09-30T17:02:58.825 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2311e-05 2023-09-30T17:02:58.825 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.825 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.825 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:58.825 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.850982+0000", 2023-09-30T17:02:58.826 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005203053 2023-09-30T17:02:58.826 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.826 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.826 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:58.826 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851033+0000", 2023-09-30T17:02:58.826 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1471999999999998e-05 2023-09-30T17:02:58.826 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:58.826 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:58.826 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:58.826 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.826 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.827 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:156 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'110, mlcod=11'105)", 2023-09-30T17:02:58.827 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:02:58.827 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 50.962416941000001, 2023-09-30T17:02:58.827 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0052834759999999996, 2023-09-30T17:02:58.827 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:58.827 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:58.827 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:58.827 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.827 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:58.827 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:02:58.827 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:58.827 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.828 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.828 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:58.828 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:02:58.828 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:58.828 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.828 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.828 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:58.828 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846180+0000", 2023-09-30T17:02:58.828 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6300000000000005e-07 2023-09-30T17:02:58.828 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.828 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.828 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:58.829 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846184+0000", 2023-09-30T17:02:58.829 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3789999999999999e-06 2023-09-30T17:02:58.829 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.829 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.829 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:58.829 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846195+0000", 2023-09-30T17:02:58.829 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0778000000000001e-05 2023-09-30T17:02:58.829 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.830 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.830 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:58.830 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846200+0000", 2023-09-30T17:02:58.830 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1540000000000001e-06 2023-09-30T17:02:58.830 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.830 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.830 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:58.830 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846274+0000", 2023-09-30T17:02:58.830 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4129999999999997e-05 2023-09-30T17:02:58.830 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.831 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.831 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:58.831 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846286+0000", 2023-09-30T17:02:58.831 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1744e-05 2023-09-30T17:02:58.831 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.831 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.831 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:58.831 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851432+0000", 2023-09-30T17:02:58.831 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051462110000000004 2023-09-30T17:02:58.831 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.832 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.832 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:58.832 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851463+0000", 2023-09-30T17:02:58.832 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0516999999999999e-05 2023-09-30T17:02:58.832 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:58.832 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:58.832 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:58.832 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.832 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.832 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:203 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'149, mlcod=11'145)", 2023-09-30T17:02:58.832 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:02:58.833 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 50.606381032000002, 2023-09-30T17:02:58.833 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051867459999999999, 2023-09-30T17:02:58.833 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:58.833 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:58.833 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:58.833 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.833 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:58.833 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:02:58.833 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:58.834 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.834 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.834 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:58.834 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:02:58.834 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:58.834 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.834 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.834 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:58.834 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202216+0000", 2023-09-30T17:02:58.834 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7e-07 2023-09-30T17:02:58.834 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.835 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.835 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:58.835 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202271+0000", 2023-09-30T17:02:58.835 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5163e-05 2023-09-30T17:02:58.835 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.835 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.835 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:58.835 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202282+0000", 2023-09-30T17:02:58.836 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1319e-05 2023-09-30T17:02:58.836 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.836 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.836 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:58.836 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202288+0000", 2023-09-30T17:02:58.836 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2899999999999999e-06 2023-09-30T17:02:58.836 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.836 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.836 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:58.836 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202331+0000", 2023-09-30T17:02:58.836 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2147999999999997e-05 2023-09-30T17:02:58.837 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.837 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.837 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:58.837 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202348+0000", 2023-09-30T17:02:58.837 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7317e-05 2023-09-30T17:02:58.837 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.837 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.837 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:58.837 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.207357+0000", 2023-09-30T17:02:58.838 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0050095440000000003 2023-09-30T17:02:58.838 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.838 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.838 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:58.838 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.207402+0000", 2023-09-30T17:02:58.838 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4495e-05 2023-09-30T17:02:58.838 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:58.838 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:58.839 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:58.839 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.839 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.839 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:58.839 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:02:58.839 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 40.457050744, 2023-09-30T17:02:58.839 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.025313649000000001, 2023-09-30T17:02:58.839 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:58.839 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:58.840 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:58.840 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.840 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:58.840 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:02:58.840 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:58.840 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.840 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.840 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:58.841 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:02:58.841 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:58.841 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.841 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.841 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:58.841 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351551+0000", 2023-09-30T17:02:58.841 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3380000000000004e-06 2023-09-30T17:02:58.841 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.841 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.842 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:58.842 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351559+0000", 2023-09-30T17:02:58.842 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9589999999999995e-06 2023-09-30T17:02:58.842 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.842 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.842 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:58.842 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351571+0000", 2023-09-30T17:02:58.842 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2065999999999999e-05 2023-09-30T17:02:58.842 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.843 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.843 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:58.843 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351706+0000", 2023-09-30T17:02:58.843 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00013553799999999999 2023-09-30T17:02:58.843 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.843 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.843 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:58.843 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353016+0000", 2023-09-30T17:02:58.843 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0013099209999999999 2023-09-30T17:02:58.843 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.843 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.843 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:02:58.844 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353023+0000", 2023-09-30T17:02:58.844 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2479999999999999e-06 2023-09-30T17:02:58.844 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.844 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.844 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:58.844 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360348+0000", 2023-09-30T17:02:58.844 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0073248949999999997 2023-09-30T17:02:58.844 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.844 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.844 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:58.844 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360787+0000", 2023-09-30T17:02:58.844 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00043875199999999999 2023-09-30T17:02:58.845 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.845 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.845 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:58.845 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360892+0000", 2023-09-30T17:02:58.845 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010508199999999999 2023-09-30T17:02:58.845 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.845 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.845 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:02:58.845 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365132+0000", 2023-09-30T17:02:58.845 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0042396480000000004 2023-09-30T17:02:58.845 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.845 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.846 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:58.846 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376746+0000", 2023-09-30T17:02:58.846 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011614157 2023-09-30T17:02:58.846 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.846 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.846 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:58.846 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376811+0000", 2023-09-30T17:02:58.846 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5005999999999994e-05 2023-09-30T17:02:58.846 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.846 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.846 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:58.847 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376859+0000", 2023-09-30T17:02:58.847 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8038999999999999e-05 2023-09-30T17:02:58.847 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:58.847 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:58.847 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:58.847 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.847 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.847 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:58.847 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:02:58.847 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 40.456552944999999, 2023-09-30T17:02:58.847 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024923989000000001, 2023-09-30T17:02:58.847 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:58.848 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:58.848 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:58.848 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.848 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:58.848 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:02:58.848 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:58.848 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.848 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.848 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:58.848 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:02:58.848 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:58.848 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.849 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.849 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:58.849 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352044+0000", 2023-09-30T17:02:58.849 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9199999999999999e-07 2023-09-30T17:02:58.849 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.849 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.849 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:58.849 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352050+0000", 2023-09-30T17:02:58.849 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8880000000000002e-06 2023-09-30T17:02:58.849 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.849 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.850 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:58.850 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352143+0000", 2023-09-30T17:02:58.850 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2721999999999998e-05 2023-09-30T17:02:58.850 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.850 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.850 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:58.850 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352155+0000", 2023-09-30T17:02:58.850 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2279000000000001e-05 2023-09-30T17:02:58.850 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.850 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.850 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:58.850 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353114+0000", 2023-09-30T17:02:58.851 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00095943700000000005 2023-09-30T17:02:58.851 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.851 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.851 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:58.851 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353121+0000", 2023-09-30T17:02:58.851 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.494e-06 2023-09-30T17:02:58.851 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.851 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.851 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:58.851 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361491+0000", 2023-09-30T17:02:58.851 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0083697359999999991 2023-09-30T17:02:58.852 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.852 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.852 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:58.852 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361573+0000", 2023-09-30T17:02:58.852 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2822000000000001e-05 2023-09-30T17:02:58.852 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.852 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.852 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:58.852 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362166+0000", 2023-09-30T17:02:58.852 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00059223299999999995 2023-09-30T17:02:58.852 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.852 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.853 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:02:58.853 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365209+0000", 2023-09-30T17:02:58.853 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.003043212 2023-09-30T17:02:58.853 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.853 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.853 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:58.853 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376910+0000", 2023-09-30T17:02:58.853 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011700898 2023-09-30T17:02:58.853 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.853 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.853 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:58.854 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376945+0000", 2023-09-30T17:02:58.854 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4795000000000001e-05 2023-09-30T17:02:58.854 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.854 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.854 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:58.854 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376967+0000", 2023-09-30T17:02:58.854 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2580999999999999e-05 2023-09-30T17:02:58.854 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:58.854 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:58.854 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:58.854 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.855 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.855 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:58.855 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:02:58.855 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 40.456383025000001, 2023-09-30T17:02:58.855 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023120405, 2023-09-30T17:02:58.855 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:58.855 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:58.855 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:58.855 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.855 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:58.855 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:02:58.856 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:58.856 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.856 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.856 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:58.856 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:02:58.856 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:58.856 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.856 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.856 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:58.856 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352214+0000", 2023-09-30T17:02:58.856 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8400000000000003e-07 2023-09-30T17:02:58.857 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.857 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.857 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:58.857 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352233+0000", 2023-09-30T17:02:58.857 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8946000000000001e-05 2023-09-30T17:02:58.857 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.857 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.857 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:58.857 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352297+0000", 2023-09-30T17:02:58.857 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3540999999999994e-05 2023-09-30T17:02:58.857 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.857 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.858 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:58.858 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352450+0000", 2023-09-30T17:02:58.858 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015364799999999999 2023-09-30T17:02:58.858 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.858 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.858 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:58.858 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353098+0000", 2023-09-30T17:02:58.858 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00064820299999999997 2023-09-30T17:02:58.858 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.858 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.858 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:02:58.859 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353103+0000", 2023-09-30T17:02:58.859 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0529999999999997e-06 2023-09-30T17:02:58.859 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.859 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.859 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:58.859 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.358558+0000", 2023-09-30T17:02:58.859 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0054550249999999996 2023-09-30T17:02:58.859 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.859 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.859 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:58.859 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.358741+0000", 2023-09-30T17:02:58.859 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00018210200000000001 2023-09-30T17:02:58.860 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.860 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.860 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:58.860 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.359683+0000", 2023-09-30T17:02:58.860 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00094202299999999995 2023-09-30T17:02:58.860 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.860 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.860 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:02:58.860 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365044+0000", 2023-09-30T17:02:58.860 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053616219999999999 2023-09-30T17:02:58.860 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.860 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.861 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:58.861 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375256+0000", 2023-09-30T17:02:58.861 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010212156 2023-09-30T17:02:58.861 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.861 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.861 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:58.861 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375300+0000", 2023-09-30T17:02:58.861 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3961999999999997e-05 2023-09-30T17:02:58.861 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.861 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.861 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:58.862 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375334+0000", 2023-09-30T17:02:58.862 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.324e-05 2023-09-30T17:02:58.862 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:58.862 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:58.862 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:58.862 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.862 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.862 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:58.862 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:02:58.862 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 40.456068006999999, 2023-09-30T17:02:58.862 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024240660000000001, 2023-09-30T17:02:58.863 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:58.863 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:58.863 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:58.863 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.863 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:58.863 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:02:58.863 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:58.863 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.864 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.864 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:58.864 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:02:58.864 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:58.864 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.864 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.864 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:58.864 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352529+0000", 2023-09-30T17:02:58.864 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1379999999999999e-06 2023-09-30T17:02:58.864 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.864 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.865 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:58.865 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352536+0000", 2023-09-30T17:02:58.865 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3489999999999997e-06 2023-09-30T17:02:58.865 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.865 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.865 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:58.865 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352547+0000", 2023-09-30T17:02:58.865 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1109e-05 2023-09-30T17:02:58.865 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.866 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.866 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:58.866 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352560+0000", 2023-09-30T17:02:58.866 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3046e-05 2023-09-30T17:02:58.866 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.866 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.866 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:58.866 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353142+0000", 2023-09-30T17:02:58.866 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00058174699999999997 2023-09-30T17:02:58.866 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.867 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.867 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:58.867 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353147+0000", 2023-09-30T17:02:58.867 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5840000000000002e-06 2023-09-30T17:02:58.867 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.867 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.867 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:58.867 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360374+0000", 2023-09-30T17:02:58.867 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0072270049999999999 2023-09-30T17:02:58.867 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.867 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.867 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:58.868 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360795+0000", 2023-09-30T17:02:58.868 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00042088999999999999 2023-09-30T17:02:58.868 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.868 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.868 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:58.868 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360967+0000", 2023-09-30T17:02:58.868 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017235699999999999 2023-09-30T17:02:58.868 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.868 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.868 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:02:58.868 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365051+0000", 2023-09-30T17:02:58.869 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0040837429999999999 2023-09-30T17:02:58.869 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.869 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.869 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:58.869 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376708+0000", 2023-09-30T17:02:58.869 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011656866 2023-09-30T17:02:58.869 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.869 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.869 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:58.869 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376745+0000", 2023-09-30T17:02:58.869 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6769e-05 2023-09-30T17:02:58.870 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.870 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.870 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:58.870 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376769+0000", 2023-09-30T17:02:58.870 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4057e-05 2023-09-30T17:02:58.870 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:58.870 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:58.870 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:58.870 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.871 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.871 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:58.871 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:02:58.871 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 40.455808652000002, 2023-09-30T17:02:58.871 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023472704, 2023-09-30T17:02:58.871 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:58.871 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:58.871 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:58.871 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.872 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:58.872 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:02:58.872 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:58.872 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.872 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.872 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:58.872 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:02:58.872 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:58.872 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.872 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.873 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:58.873 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:02:58.873 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8000000000000005e-07 2023-09-30T17:02:58.873 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.873 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.873 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:58.873 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352794+0000", 2023-09-30T17:02:58.873 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.789e-06 2023-09-30T17:02:58.874 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.874 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.874 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:58.874 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352805+0000", 2023-09-30T17:02:58.874 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0848e-05 2023-09-30T17:02:58.874 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.874 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.874 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:58.875 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352812+0000", 2023-09-30T17:02:58.875 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4449999999999999e-06 2023-09-30T17:02:58.875 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.875 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.875 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:58.875 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353063+0000", 2023-09-30T17:02:58.875 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00025046299999999998 2023-09-30T17:02:58.875 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.875 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.876 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:02:58.876 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353071+0000", 2023-09-30T17:02:58.876 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6739999999999997e-06 2023-09-30T17:02:58.876 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.876 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.876 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:58.876 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361696+0000", 2023-09-30T17:02:58.876 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0086251609999999992 2023-09-30T17:02:58.876 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.876 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.877 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:58.877 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362284+0000", 2023-09-30T17:02:58.877 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00058872299999999998 2023-09-30T17:02:58.877 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.877 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.877 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:58.877 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362429+0000", 2023-09-30T17:02:58.877 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014509000000000001 2023-09-30T17:02:58.877 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.877 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.877 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:02:58.878 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365330+0000", 2023-09-30T17:02:58.878 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0029005419999999999 2023-09-30T17:02:58.878 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.878 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.878 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:58.878 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376196+0000", 2023-09-30T17:02:58.878 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.01086615 2023-09-30T17:02:58.878 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.878 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.878 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:58.878 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376230+0000", 2023-09-30T17:02:58.879 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3858e-05 2023-09-30T17:02:58.879 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.879 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.879 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:58.879 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376260+0000", 2023-09-30T17:02:58.879 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0181000000000001e-05 2023-09-30T17:02:58.879 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:58.879 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:58.879 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:58.879 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.879 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.880 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:58.880 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:02:58.880 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 40.455575082000003, 2023-09-30T17:02:58.880 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023406132999999999, 2023-09-30T17:02:58.880 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:58.880 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:58.880 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:58.880 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.880 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:58.880 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:02:58.880 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:58.881 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.881 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.881 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:58.881 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:02:58.881 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:58.881 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.881 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.881 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:58.881 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353022+0000", 2023-09-30T17:02:58.881 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.78e-07 2023-09-30T17:02:58.881 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.882 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.882 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:58.882 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353027+0000", 2023-09-30T17:02:58.882 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9089999999999999e-06 2023-09-30T17:02:58.882 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.882 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.882 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:58.882 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353035+0000", 2023-09-30T17:02:58.882 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0430000000000008e-06 2023-09-30T17:02:58.882 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.882 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.883 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:58.883 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353047+0000", 2023-09-30T17:02:58.883 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1674e-05 2023-09-30T17:02:58.883 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.883 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.883 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:58.883 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353105+0000", 2023-09-30T17:02:58.883 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8891999999999998e-05 2023-09-30T17:02:58.883 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.883 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.883 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:58.884 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353112+0000", 2023-09-30T17:02:58.884 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7059999999999998e-06 2023-09-30T17:02:58.884 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.884 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.884 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:58.884 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362733+0000", 2023-09-30T17:02:58.884 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0096205869999999999 2023-09-30T17:02:58.884 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.884 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.884 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:58.884 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362833+0000", 2023-09-30T17:02:58.885 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000100227 2023-09-30T17:02:58.885 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.885 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.885 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:58.885 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363000+0000", 2023-09-30T17:02:58.885 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016670899999999999 2023-09-30T17:02:58.885 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.885 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.885 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:02:58.885 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365550+0000", 2023-09-30T17:02:58.885 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0025499199999999998 2023-09-30T17:02:58.885 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.886 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.886 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:58.886 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376315+0000", 2023-09-30T17:02:58.886 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010765011999999999 2023-09-30T17:02:58.886 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.886 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.886 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:58.886 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376386+0000", 2023-09-30T17:02:58.886 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0866999999999998e-05 2023-09-30T17:02:58.886 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.886 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.887 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:58.887 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376427+0000", 2023-09-30T17:02:58.887 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1709000000000003e-05 2023-09-30T17:02:58.887 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:58.887 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:58.887 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:58.887 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.887 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.887 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:58.887 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:02:58.887 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 40.455534446000001, 2023-09-30T17:02:58.887 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024076238, 2023-09-30T17:02:58.888 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:58.888 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:58.888 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:58.888 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.888 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:58.888 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:02:58.888 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:58.888 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.888 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.888 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:58.889 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:02:58.889 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:58.889 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.889 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.889 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:58.889 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:02:58.889 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8699999999999995e-07 2023-09-30T17:02:58.889 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.889 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.889 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:58.889 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353067+0000", 2023-09-30T17:02:58.889 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.605e-06 2023-09-30T17:02:58.890 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.890 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.890 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:58.890 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353073+0000", 2023-09-30T17:02:58.890 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8900000000000004e-06 2023-09-30T17:02:58.890 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.890 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.890 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:58.890 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353083+0000", 2023-09-30T17:02:58.890 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0200000000000001e-05 2023-09-30T17:02:58.890 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.891 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.891 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:58.891 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353186+0000", 2023-09-30T17:02:58.891 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010256599999999999 2023-09-30T17:02:58.891 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.891 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.891 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:02:58.891 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353190+0000", 2023-09-30T17:02:58.891 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9709999999999998e-06 2023-09-30T17:02:58.891 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.891 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.891 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:58.892 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362946+0000", 2023-09-30T17:02:58.892 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0097563330000000007 2023-09-30T17:02:58.892 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.892 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.892 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:58.892 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363088+0000", 2023-09-30T17:02:58.892 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014259200000000001 2023-09-30T17:02:58.892 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.892 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.892 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:58.892 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363555+0000", 2023-09-30T17:02:58.892 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00046627799999999998 2023-09-30T17:02:58.893 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.893 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.893 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:02:58.893 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365871+0000", 2023-09-30T17:02:58.893 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0023167589999999998 2023-09-30T17:02:58.893 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.893 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.893 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:58.893 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377033+0000", 2023-09-30T17:02:58.893 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011161203999999999 2023-09-30T17:02:58.893 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.893 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.894 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:58.894 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377100+0000", 2023-09-30T17:02:58.894 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7230999999999994e-05 2023-09-30T17:02:58.894 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.894 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.894 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:58.894 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377138+0000", 2023-09-30T17:02:58.894 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8022000000000003e-05 2023-09-30T17:02:58.894 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:58.894 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:58.895 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:58.895 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.895 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.895 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:58.895 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:02:58.895 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 40.455433497000001, 2023-09-30T17:02:58.895 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.020304412000000001, 2023-09-30T17:02:58.895 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:58.895 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:02:58.895 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:58.896 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.896 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:58.896 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:02:58.896 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:58.896 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.896 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.896 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:58.896 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:02:58.896 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:58.896 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.897 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.897 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:58.897 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353164+0000", 2023-09-30T17:02:58.897 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7100000000000011e-07 2023-09-30T17:02:58.897 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.897 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.897 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:58.897 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353168+0000", 2023-09-30T17:02:58.897 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0600000000000001e-06 2023-09-30T17:02:58.897 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.897 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.898 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:58.898 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353177+0000", 2023-09-30T17:02:58.898 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1409999999999994e-06 2023-09-30T17:02:58.898 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.898 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.898 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:58.898 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353185+0000", 2023-09-30T17:02:58.898 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2479999999999996e-06 2023-09-30T17:02:58.898 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.899 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.899 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:58.899 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353246+0000", 2023-09-30T17:02:58.899 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0519000000000001e-05 2023-09-30T17:02:58.899 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.899 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.899 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:02:58.899 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353252+0000", 2023-09-30T17:02:58.899 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7859999999999999e-06 2023-09-30T17:02:58.899 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.900 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.900 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:58.900 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354979+0000", 2023-09-30T17:02:58.900 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0017270090000000001 2023-09-30T17:02:58.900 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.900 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.900 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:58.900 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355097+0000", 2023-09-30T17:02:58.900 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000117472 2023-09-30T17:02:58.900 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.901 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.901 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:58.901 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.373467+0000", 2023-09-30T17:02:58.901 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.018370206 2023-09-30T17:02:58.901 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:58.901 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:58.901 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:58.901 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.901 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.901 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:58.902 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:02:58.902 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 40.455392758999999, 2023-09-30T17:02:58.902 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.012725089, 2023-09-30T17:02:58.902 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:58.902 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:02:58.902 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:58.902 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.902 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:58.902 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:02:58.903 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:58.903 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.903 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.903 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:58.903 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:02:58.903 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:58.903 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.903 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.903 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:58.904 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353204+0000", 2023-09-30T17:02:58.904 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7100000000000002e-07 2023-09-30T17:02:58.904 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.904 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.904 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:58.904 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353213+0000", 2023-09-30T17:02:58.904 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8580000000000006e-06 2023-09-30T17:02:58.904 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.904 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.905 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:58.905 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353219+0000", 2023-09-30T17:02:58.905 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8939999999999998e-06 2023-09-30T17:02:58.905 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.905 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.905 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:58.905 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353223+0000", 2023-09-30T17:02:58.905 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.357e-06 2023-09-30T17:02:58.905 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.905 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.906 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:58.906 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353278+0000", 2023-09-30T17:02:58.906 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5228e-05 2023-09-30T17:02:58.906 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.906 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.906 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:02:58.906 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353284+0000", 2023-09-30T17:02:58.907 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8209999999999998e-06 2023-09-30T17:02:58.907 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.907 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.907 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:58.907 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355095+0000", 2023-09-30T17:02:58.907 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001811404 2023-09-30T17:02:58.907 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.907 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.908 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:58.908 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355256+0000", 2023-09-30T17:02:58.908 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000160898 2023-09-30T17:02:58.908 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.908 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.908 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:58.908 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365928+0000", 2023-09-30T17:02:58.908 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010672157999999999 2023-09-30T17:02:58.908 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:58.908 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:58.909 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:58.909 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.909 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.909 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-09-30T17:02:58.909 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:02:58.909 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 40.454861551999997, 2023-09-30T17:02:58.909 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0056863460000000001, 2023-09-30T17:02:58.909 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:58.909 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "reached pg", 2023-09-30T17:02:58.909 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:58.909 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.909 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:58.910 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:02:58.910 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:58.910 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.910 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.910 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:58.910 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:02:58.910 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:58.910 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.910 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.910 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:58.910 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:02:58.911 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5700000000000002e-07 2023-09-30T17:02:58.911 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.911 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.911 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:58.911 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353747+0000", 2023-09-30T17:02:58.911 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1899000000000001e-05 2023-09-30T17:02:58.911 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.911 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.911 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:58.911 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353776+0000", 2023-09-30T17:02:58.911 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.8767000000000001e-05 2023-09-30T17:02:58.911 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.912 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.912 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:58.912 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353792+0000", 2023-09-30T17:02:58.912 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5914999999999999e-05 2023-09-30T17:02:58.912 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.912 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.912 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:58.912 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353900+0000", 2023-09-30T17:02:58.912 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010774500000000001 2023-09-30T17:02:58.912 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.912 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.912 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:58.913 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.359421+0000", 2023-09-30T17:02:58.913 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0055213629999999996 2023-09-30T17:02:58.913 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:58.913 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:58.913 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:58.913 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.913 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.913 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:02:58.913 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:02:58.913 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 40.454189952, 2023-09-30T17:02:58.913 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0069196370000000002, 2023-09-30T17:02:58.913 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:58.914 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:58.914 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:58.914 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.914 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:58.914 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:02:58.914 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:58.914 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.914 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.914 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:58.914 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:02:58.914 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:58.914 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.915 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.915 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:58.915 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354407+0000", 2023-09-30T17:02:58.915 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7400000000000002e-07 2023-09-30T17:02:58.915 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.915 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.915 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:58.915 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354414+0000", 2023-09-30T17:02:58.915 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1040000000000001e-06 2023-09-30T17:02:58.915 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.915 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.916 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:58.916 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354425+0000", 2023-09-30T17:02:58.916 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1090000000000001e-05 2023-09-30T17:02:58.916 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.916 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.916 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:58.916 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354435+0000", 2023-09-30T17:02:58.916 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8169999999999994e-06 2023-09-30T17:02:58.916 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.916 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.917 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:58.917 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355741+0000", 2023-09-30T17:02:58.917 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0013063160000000001 2023-09-30T17:02:58.917 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.917 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.917 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:58.917 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355763+0000", 2023-09-30T17:02:58.917 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1688e-05 2023-09-30T17:02:58.917 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.917 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.917 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:58.917 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361289+0000", 2023-09-30T17:02:58.918 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0055258269999999996 2023-09-30T17:02:58.918 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.918 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.918 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:58.918 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361326+0000", 2023-09-30T17:02:58.918 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7020999999999997e-05 2023-09-30T17:02:58.918 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:58.918 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:58.918 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:58.918 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.918 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.919 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:30 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2023-09-30T17:02:58.919 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:02:58.919 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 40.452815993999998, 2023-09-30T17:02:58.919 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0069996629999999997, 2023-09-30T17:02:58.919 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:58.919 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:58.919 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:58.919 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.919 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:58.919 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:02:58.919 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:58.920 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.920 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.920 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:58.920 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:02:58.920 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:58.920 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.920 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.920 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:58.920 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355781+0000", 2023-09-30T17:02:58.920 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9599999999999999e-07 2023-09-30T17:02:58.920 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.921 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.921 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:58.921 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355788+0000", 2023-09-30T17:02:58.921 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8129999999999996e-06 2023-09-30T17:02:58.921 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.921 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.921 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:58.921 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355798+0000", 2023-09-30T17:02:58.921 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2909999999999996e-06 2023-09-30T17:02:58.921 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.921 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.921 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:58.922 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355807+0000", 2023-09-30T17:02:58.922 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8619999999999992e-06 2023-09-30T17:02:58.922 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.922 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.922 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:58.922 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.357264+0000", 2023-09-30T17:02:58.922 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0014578289999999999 2023-09-30T17:02:58.922 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.922 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.922 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:58.922 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.357916+0000", 2023-09-30T17:02:58.922 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00065170500000000004 2023-09-30T17:02:58.923 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.923 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.923 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:58.923 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362731+0000", 2023-09-30T17:02:58.923 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0048149849999999999 2023-09-30T17:02:58.923 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.923 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.923 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:58.923 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362780+0000", 2023-09-30T17:02:58.923 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8681999999999999e-05 2023-09-30T17:02:58.923 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:58.923 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:58.924 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:58.924 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.924 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.924 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2023-09-30T17:02:58.924 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:02:58.924 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 40.434164942999999, 2023-09-30T17:02:58.924 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005905998, 2023-09-30T17:02:58.924 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:58.924 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:58.924 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:58.924 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.924 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:58.925 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:02:58.925 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:58.925 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.925 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.925 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:58.925 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:02:58.925 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:58.925 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.925 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.925 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:58.925 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:02:58.925 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1e-07 2023-09-30T17:02:58.926 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.926 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.926 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:58.926 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374455+0000", 2023-09-30T17:02:58.926 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.3091999999999998e-05 2023-09-30T17:02:58.926 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.926 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.926 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:58.926 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374462+0000", 2023-09-30T17:02:58.926 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5170000000000002e-06 2023-09-30T17:02:58.926 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.927 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.927 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:58.927 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374469+0000", 2023-09-30T17:02:58.927 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8199999999999999e-06 2023-09-30T17:02:58.927 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.927 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.927 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:58.927 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374550+0000", 2023-09-30T17:02:58.927 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0978999999999998e-05 2023-09-30T17:02:58.927 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.927 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.927 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:58.928 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374562+0000", 2023-09-30T17:02:58.928 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2472e-05 2023-09-30T17:02:58.928 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.928 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.928 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:58.928 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380293+0000", 2023-09-30T17:02:58.928 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0057310379999999999 2023-09-30T17:02:58.928 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.928 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.928 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:58.928 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380337+0000", 2023-09-30T17:02:58.929 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3869999999999998e-05 2023-09-30T17:02:58.929 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:58.929 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:58.929 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:58.929 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.929 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.930 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2023-09-30T17:02:58.930 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:02:58.930 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 40.433978193999998, 2023-09-30T17:02:58.930 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0057590560000000002, 2023-09-30T17:02:58.930 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:58.930 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:58.930 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:58.930 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.930 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:58.930 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:02:58.931 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:58.931 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.931 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.931 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:58.931 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:02:58.931 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:58.931 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.931 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.931 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:58.932 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:02:58.932 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4900000000000001e-07 2023-09-30T17:02:58.932 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.932 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.932 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:58.932 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374629+0000", 2023-09-30T17:02:58.932 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1014e-05 2023-09-30T17:02:58.932 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.932 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.932 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:58.932 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374636+0000", 2023-09-30T17:02:58.933 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5889999999999999e-06 2023-09-30T17:02:58.933 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.933 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.933 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:58.933 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374642+0000", 2023-09-30T17:02:58.933 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.48e-06 2023-09-30T17:02:58.933 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.933 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.934 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:58.934 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374681+0000", 2023-09-30T17:02:58.934 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9320000000000003e-05 2023-09-30T17:02:58.934 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.934 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.934 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:58.934 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374694+0000", 2023-09-30T17:02:58.934 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3351e-05 2023-09-30T17:02:58.934 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.934 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.934 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:58.935 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380319+0000", 2023-09-30T17:02:58.935 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0056243880000000001 2023-09-30T17:02:58.935 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.935 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.935 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:58.935 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380377+0000", 2023-09-30T17:02:58.935 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8464999999999997e-05 2023-09-30T17:02:58.935 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:58.935 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:58.935 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:58.936 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.936 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.936 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=0'0)", 2023-09-30T17:02:58.936 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:02:58.936 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 40.433267282999999, 2023-09-30T17:02:58.936 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051157370000000004, 2023-09-30T17:02:58.936 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:02:58.936 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:58.936 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:02:58.936 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.936 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:02:58.937 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:02:58.937 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:58.937 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.937 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.937 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:02:58.937 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:02:58.937 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:02:58.937 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.938 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.938 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:02:58.938 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:02:58.938 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0199999999999998e-07 2023-09-30T17:02:58.938 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.938 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.938 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:02:58.938 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375334+0000", 2023-09-30T17:02:58.938 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8799999999999999e-06 2023-09-30T17:02:58.939 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.939 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.939 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:02:58.939 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375343+0000", 2023-09-30T17:02:58.939 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5490000000000006e-06 2023-09-30T17:02:58.939 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.939 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.939 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:02:58.939 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375350+0000", 2023-09-30T17:02:58.940 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5700000000000004e-06 2023-09-30T17:02:58.940 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.940 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.940 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:02:58.940 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375396+0000", 2023-09-30T17:02:58.940 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5550999999999998e-05 2023-09-30T17:02:58.940 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.940 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.941 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:02:58.941 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375410+0000", 2023-09-30T17:02:58.941 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4518999999999999e-05 2023-09-30T17:02:58.941 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.941 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.941 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:02:58.941 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380401+0000", 2023-09-30T17:02:58.942 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0049903430000000004 2023-09-30T17:02:58.942 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:02:58.942 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:02:58.942 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:02:58.942 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380445+0000", 2023-09-30T17:02:58.942 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4023000000000002e-05 2023-09-30T17:02:58.942 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:58.942 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:58.942 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:58.943 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:02:58.943 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:02:58.943 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:02:58.944 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:58.944+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:58.945 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:02:59.044 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:59.043+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:59.075 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:02:59.076 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:02:59.076 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2023-09-30T17:02:59.076 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:02:59.085 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:02:59.145 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:59.145+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:59.245 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~12s 2023-09-30T17:02:59.246 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:59.245+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:59.251 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:02:59.251 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:02:59.251 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2023-09-30T17:02:59.251 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2023-09-30T17:02:59.251 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:02:59.261 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:02:59.277 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is unset 2023-09-30T17:02:59.347 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:59.346+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:59.430 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:02:59.431 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2023-09-30T17:02:59.431 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2023-09-30T17:02:59.431 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2023-09-30T17:02:59.431 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.431 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:59.431 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:02:59.431 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 41.077264614000001, 2023-09-30T17:02:59.432 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093789779999999996, 2023-09-30T17:02:59.432 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:59.432 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:59.432 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:59.432 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.432 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:59.432 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:02:59.433 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:59.433 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.433 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.433 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:59.433 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:02:59.433 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:59.433 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.433 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.433 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:59.434 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352027+0000", 2023-09-30T17:02:59.434 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0224000000000001e-05 2023-09-30T17:02:59.434 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.434 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.434 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:59.434 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352039+0000", 2023-09-30T17:02:59.434 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1569000000000001e-05 2023-09-30T17:02:59.434 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.435 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.435 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:59.435 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352052+0000", 2023-09-30T17:02:59.435 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2605999999999999e-05 2023-09-30T17:02:59.435 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.435 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.435 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:59.436 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352064+0000", 2023-09-30T17:02:59.436 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2666999999999999e-05 2023-09-30T17:02:59.436 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.436 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.436 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:59.436 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352147+0000", 2023-09-30T17:02:59.436 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3125000000000001e-05 2023-09-30T17:02:59.436 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.436 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.437 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:59.437 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352306+0000", 2023-09-30T17:02:59.437 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015881900000000001 2023-09-30T17:02:59.437 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.437 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.437 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:59.437 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352450+0000", 2023-09-30T17:02:59.437 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014420700000000001 2023-09-30T17:02:59.437 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.437 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.437 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:59.438 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355975+0000", 2023-09-30T17:02:59.438 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003524246 2023-09-30T17:02:59.438 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.438 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.438 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:59.438 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361279+0000", 2023-09-30T17:02:59.438 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005304507 2023-09-30T17:02:59.439 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.439 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.439 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:59.439 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361344+0000", 2023-09-30T17:02:59.439 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4548999999999995e-05 2023-09-30T17:02:59.439 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.439 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.440 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:59.440 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361396+0000", 2023-09-30T17:02:59.440 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2459e-05 2023-09-30T17:02:59.440 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:59.440 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:59.440 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:59.441 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.441 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.441 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:59.441 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:02:59.441 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 41.077172322000003, 2023-09-30T17:02:59.441 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021233007000000002, 2023-09-30T17:02:59.441 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:59.441 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:59.442 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:59.442 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.442 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:59.442 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:02:59.442 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:59.442 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.442 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.442 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:59.442 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:02:59.442 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:59.443 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.443 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:59.443 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352110+0000", 2023-09-30T17:02:59.443 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6000000000000002e-07 2023-09-30T17:02:59.443 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.443 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:59.443 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352117+0000", 2023-09-30T17:02:59.443 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5930000000000002e-06 2023-09-30T17:02:59.444 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.444 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.444 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:59.444 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352126+0000", 2023-09-30T17:02:59.444 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0729999999999994e-06 2023-09-30T17:02:59.444 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.444 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.444 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:59.444 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352136+0000", 2023-09-30T17:02:59.444 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0380000000000001e-05 2023-09-30T17:02:59.445 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.445 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.445 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:59.445 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353279+0000", 2023-09-30T17:02:59.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0011424670000000001 2023-09-30T17:02:59.445 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.445 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.445 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:59.445 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353707+0000", 2023-09-30T17:02:59.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00042829800000000003 2023-09-30T17:02:59.446 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.446 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.446 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:59.446 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354104+0000", 2023-09-30T17:02:59.446 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00039643399999999998 2023-09-30T17:02:59.446 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.446 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.446 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:59.446 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356925+0000", 2023-09-30T17:02:59.446 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0028210900000000001 2023-09-30T17:02:59.447 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.447 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:59.447 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373243+0000", 2023-09-30T17:02:59.447 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016318461999999999 2023-09-30T17:02:59.447 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.447 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:59.447 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373301+0000", 2023-09-30T17:02:59.447 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7435000000000002e-05 2023-09-30T17:02:59.448 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.448 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:59.448 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373342+0000", 2023-09-30T17:02:59.448 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1915000000000001e-05 2023-09-30T17:02:59.448 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:59.448 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:59.448 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:59.448 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.449 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:59.449 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:02:59.449 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 41.077129710999998, 2023-09-30T17:02:59.449 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011988331, 2023-09-30T17:02:59.449 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:59.449 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:59.449 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:59.449 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.449 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:59.450 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:02:59.450 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:59.450 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.450 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.450 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:59.450 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:02:59.450 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:59.450 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.450 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.450 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:59.451 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352153+0000", 2023-09-30T17:02:59.451 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0500000000000003e-07 2023-09-30T17:02:59.451 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.451 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.451 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:59.451 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352157+0000", 2023-09-30T17:02:59.451 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9790000000000004e-06 2023-09-30T17:02:59.451 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.451 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.451 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:59.452 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352173+0000", 2023-09-30T17:02:59.452 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6535999999999999e-05 2023-09-30T17:02:59.452 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.452 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.452 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:59.452 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352180+0000", 2023-09-30T17:02:59.452 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7700000000000004e-06 2023-09-30T17:02:59.452 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.452 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.452 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:59.453 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353526+0000", 2023-09-30T17:02:59.453 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0013458330000000001 2023-09-30T17:02:59.453 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.453 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.453 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:59.453 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353648+0000", 2023-09-30T17:02:59.453 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012262899999999999 2023-09-30T17:02:59.453 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.453 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.453 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:02:59.454 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354141+0000", 2023-09-30T17:02:59.454 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00049222899999999995 2023-09-30T17:02:59.454 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.454 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.454 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:59.454 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356931+0000", 2023-09-30T17:02:59.454 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0027900860000000002 2023-09-30T17:02:59.454 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.454 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.455 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:59.455 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364066+0000", 2023-09-30T17:02:59.455 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071355050000000003 2023-09-30T17:02:59.455 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.455 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.455 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:59.455 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364103+0000", 2023-09-30T17:02:59.455 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6944999999999999e-05 2023-09-30T17:02:59.455 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.455 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.456 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:59.456 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364140+0000", 2023-09-30T17:02:59.456 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7214e-05 2023-09-30T17:02:59.456 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:59.456 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:59.456 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:59.456 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.456 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.456 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:59.456 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:02:59.457 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 41.077090480000003, 2023-09-30T17:02:59.457 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012110921, 2023-09-30T17:02:59.457 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:59.457 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:59.457 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:59.457 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.457 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:59.457 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:02:59.457 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:59.457 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.458 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.458 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:59.458 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:02:59.458 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:59.458 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.458 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.458 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:59.458 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352192+0000", 2023-09-30T17:02:59.458 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7300000000000005e-07 2023-09-30T17:02:59.458 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.459 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.459 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:59.459 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352196+0000", 2023-09-30T17:02:59.459 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2370000000000003e-06 2023-09-30T17:02:59.459 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.459 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.459 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:59.459 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352205+0000", 2023-09-30T17:02:59.459 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6659999999999997e-06 2023-09-30T17:02:59.459 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.460 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.460 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:59.460 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352214+0000", 2023-09-30T17:02:59.460 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8259999999999999e-06 2023-09-30T17:02:59.460 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.460 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.460 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:59.460 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354470+0000", 2023-09-30T17:02:59.460 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022557340000000001 2023-09-30T17:02:59.460 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.461 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.461 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:59.461 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354557+0000", 2023-09-30T17:02:59.461 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6909000000000004e-05 2023-09-30T17:02:59.461 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.461 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.461 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:02:59.461 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354694+0000", 2023-09-30T17:02:59.461 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013774800000000001 2023-09-30T17:02:59.461 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.462 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.462 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:59.462 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356937+0000", 2023-09-30T17:02:59.462 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022424540000000001 2023-09-30T17:02:59.462 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.462 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.462 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:59.462 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364227+0000", 2023-09-30T17:02:59.462 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072902430000000001 2023-09-30T17:02:59.463 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.463 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:59.463 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364278+0000", 2023-09-30T17:02:59.463 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1180999999999997e-05 2023-09-30T17:02:59.463 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.463 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:59.464 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364302+0000", 2023-09-30T17:02:59.464 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4049999999999998e-05 2023-09-30T17:02:59.464 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:59.464 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:59.464 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:59.464 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.464 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.464 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:59.464 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:02:59.465 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 41.077057140999997, 2023-09-30T17:02:59.465 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021258651999999999, 2023-09-30T17:02:59.465 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:59.465 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:59.465 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:59.465 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.465 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:59.465 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:02:59.466 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:59.466 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.466 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.466 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:59.466 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:02:59.466 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:59.466 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.466 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.467 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:59.467 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:02:59.467 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6899999999999997e-07 2023-09-30T17:02:59.467 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.467 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.467 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:59.467 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352236+0000", 2023-09-30T17:02:59.467 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0251000000000001e-05 2023-09-30T17:02:59.468 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.468 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.468 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:59.468 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352244+0000", 2023-09-30T17:02:59.468 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0770000000000008e-06 2023-09-30T17:02:59.468 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.468 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.468 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:59.469 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352251+0000", 2023-09-30T17:02:59.469 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4749999999999996e-06 2023-09-30T17:02:59.469 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.469 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.469 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:59.469 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354455+0000", 2023-09-30T17:02:59.469 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022043660000000001 2023-09-30T17:02:59.470 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.470 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.470 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:59.470 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354577+0000", 2023-09-30T17:02:59.470 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000121054 2023-09-30T17:02:59.470 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.470 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.471 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:59.471 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354723+0000", 2023-09-30T17:02:59.471 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014693900000000001 2023-09-30T17:02:59.471 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.471 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.471 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:59.471 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356941+0000", 2023-09-30T17:02:59.472 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002217199 2023-09-30T17:02:59.472 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.472 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.472 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:59.472 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373392+0000", 2023-09-30T17:02:59.472 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016451774999999998 2023-09-30T17:02:59.472 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.472 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.473 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:59.473 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373445+0000", 2023-09-30T17:02:59.473 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.308e-05 2023-09-30T17:02:59.473 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.473 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.473 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:59.473 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373483+0000", 2023-09-30T17:02:59.473 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7766999999999999e-05 2023-09-30T17:02:59.473 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:59.474 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:59.474 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:59.474 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.474 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.474 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:59.474 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:02:59.474 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 41.077021049999999, 2023-09-30T17:02:59.474 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020903497, 2023-09-30T17:02:59.474 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:59.475 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:59.475 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:59.475 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.475 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:59.475 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:02:59.475 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:59.475 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.475 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.475 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:59.475 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:02:59.476 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:59.476 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.476 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.476 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:59.476 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:02:59.476 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0800000000000004e-07 2023-09-30T17:02:59.476 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.476 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.476 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:59.476 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352266+0000", 2023-09-30T17:02:59.476 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1280000000000001e-06 2023-09-30T17:02:59.477 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.477 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.477 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:59.477 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352273+0000", 2023-09-30T17:02:59.477 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3730000000000004e-06 2023-09-30T17:02:59.477 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.477 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.477 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:59.477 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352279+0000", 2023-09-30T17:02:59.477 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7699999999999998e-06 2023-09-30T17:02:59.478 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.478 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.478 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:59.478 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352334+0000", 2023-09-30T17:02:59.478 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5547999999999997e-05 2023-09-30T17:02:59.478 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.478 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.478 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:59.478 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352435+0000", 2023-09-30T17:02:59.478 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100688 2023-09-30T17:02:59.479 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.479 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.479 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:59.479 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352585+0000", 2023-09-30T17:02:59.479 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000150068 2023-09-30T17:02:59.479 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.479 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.479 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:59.479 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354912+0000", 2023-09-30T17:02:59.479 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0023266770000000001 2023-09-30T17:02:59.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.480 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:59.480 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373066+0000", 2023-09-30T17:02:59.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018154474 2023-09-30T17:02:59.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.480 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:59.480 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373122+0000", 2023-09-30T17:02:59.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6193000000000002e-05 2023-09-30T17:02:59.481 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.481 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.481 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:59.481 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373164+0000", 2023-09-30T17:02:59.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1869999999999997e-05 2023-09-30T17:02:59.481 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:59.481 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:59.481 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:59.481 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.482 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.482 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:59.482 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:02:59.482 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 41.076985374000003, 2023-09-30T17:02:59.482 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021015097999999999, 2023-09-30T17:02:59.482 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:59.482 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:59.482 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:59.482 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.482 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:59.483 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:02:59.483 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:59.483 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.483 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.483 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:59.483 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:02:59.483 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:59.483 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.483 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.484 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:59.484 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352297+0000", 2023-09-30T17:02:59.484 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8299999999999997e-07 2023-09-30T17:02:59.484 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.484 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.484 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:59.484 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352300+0000", 2023-09-30T17:02:59.484 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7460000000000001e-06 2023-09-30T17:02:59.484 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.484 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.485 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:59.485 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352307+0000", 2023-09-30T17:02:59.485 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4959999999999999e-06 2023-09-30T17:02:59.485 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.485 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.485 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:59.485 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352314+0000", 2023-09-30T17:02:59.485 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0190000000000001e-06 2023-09-30T17:02:59.485 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.485 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.486 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:59.486 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354070+0000", 2023-09-30T17:02:59.486 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001755936 2023-09-30T17:02:59.486 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.486 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.486 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:59.486 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354221+0000", 2023-09-30T17:02:59.486 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000150884 2023-09-30T17:02:59.486 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.487 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.487 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:59.487 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373311+0000", 2023-09-30T17:02:59.487 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019090434 2023-09-30T17:02:59.487 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:59.487 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:59.487 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:59.487 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.487 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.487 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:59.488 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:02:59.488 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 41.076956654999996, 2023-09-30T17:02:59.488 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021255174000000002, 2023-09-30T17:02:59.488 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:59.488 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:59.488 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:59.488 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.488 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:59.488 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:02:59.489 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:59.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.489 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:59.489 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:02:59.489 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:59.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.489 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:59.489 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352326+0000", 2023-09-30T17:02:59.490 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3200000000000005e-07 2023-09-30T17:02:59.490 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.490 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.490 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:59.490 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352349+0000", 2023-09-30T17:02:59.490 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3183000000000001e-05 2023-09-30T17:02:59.490 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.490 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.490 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:59.491 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352358+0000", 2023-09-30T17:02:59.491 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5230000000000001e-06 2023-09-30T17:02:59.491 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.491 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.491 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:59.491 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352365+0000", 2023-09-30T17:02:59.491 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3260000000000001e-06 2023-09-30T17:02:59.491 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.491 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.492 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:59.492 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355450+0000", 2023-09-30T17:02:59.492 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0030854049999999998 2023-09-30T17:02:59.492 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.492 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.492 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:59.492 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355583+0000", 2023-09-30T17:02:59.492 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000133189 2023-09-30T17:02:59.492 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.492 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.492 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:59.493 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373580+0000", 2023-09-30T17:02:59.493 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017997016000000001 2023-09-30T17:02:59.493 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:59.493 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:59.493 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:59.493 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.493 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.493 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:02:59.493 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:02:59.493 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 41.076905232000001, 2023-09-30T17:02:59.494 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010380537, 2023-09-30T17:02:59.494 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:59.494 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:59.494 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:59.494 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.494 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:59.495 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:02:59.495 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:59.495 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.495 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.495 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:59.495 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:02:59.495 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:59.495 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.495 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.495 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:59.495 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:02:59.496 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1500000000000003e-07 2023-09-30T17:02:59.496 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.496 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.496 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:59.496 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352381+0000", 2023-09-30T17:02:59.496 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6330000000000002e-06 2023-09-30T17:02:59.496 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.497 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.497 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:59.497 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352388+0000", 2023-09-30T17:02:59.497 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7229999999999998e-06 2023-09-30T17:02:59.497 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.497 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.497 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:59.497 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352394+0000", 2023-09-30T17:02:59.497 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1789999999999996e-06 2023-09-30T17:02:59.497 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.498 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.498 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:59.498 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353259+0000", 2023-09-30T17:02:59.498 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000865221 2023-09-30T17:02:59.498 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.498 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.498 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:59.499 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353391+0000", 2023-09-30T17:02:59.499 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013217700000000001 2023-09-30T17:02:59.499 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.499 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.499 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:59.499 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362757+0000", 2023-09-30T17:02:59.499 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093657889999999994 2023-09-30T17:02:59.499 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:59.499 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:59.500 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:59.500 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.500 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.500 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-09-30T17:02:59.500 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:02:59.500 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 41.070604940000003, 2023-09-30T17:02:59.500 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0061813579999999996, 2023-09-30T17:02:59.500 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:59.500 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2023-09-30T17:02:59.501 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:59.501 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.501 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:59.501 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:02:59.501 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:59.501 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.501 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.501 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:59.502 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:02:59.502 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:59.502 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.502 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.502 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:59.502 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:02:59.502 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5499999999999999e-07 2023-09-30T17:02:59.503 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.503 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.503 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:59.503 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358686+0000", 2023-09-30T17:02:59.503 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9979999999999992e-06 2023-09-30T17:02:59.503 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.503 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.503 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:59.503 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358700+0000", 2023-09-30T17:02:59.503 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3635000000000001e-05 2023-09-30T17:02:59.503 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.504 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.504 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:59.504 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358714+0000", 2023-09-30T17:02:59.504 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4470999999999999e-05 2023-09-30T17:02:59.504 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.504 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.504 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:59.504 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358767+0000", 2023-09-30T17:02:59.504 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2651999999999997e-05 2023-09-30T17:02:59.504 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.505 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.505 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:59.505 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364858+0000", 2023-09-30T17:02:59.505 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060912470000000002 2023-09-30T17:02:59.505 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:59.505 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:59.505 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:59.505 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.505 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.505 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2023-09-30T17:02:59.506 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:02:59.506 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 41.068240099999997, 2023-09-30T17:02:59.506 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00036246299999999999, 2023-09-30T17:02:59.506 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:59.506 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:59.506 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:59.507 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.507 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:59.507 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:02:59.507 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:59.507 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.507 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.507 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:59.508 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:02:59.508 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:59.508 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.508 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.508 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:59.508 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:02:59.508 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3099999999999999e-07 2023-09-30T17:02:59.508 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.508 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.508 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:59.509 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361045+0000", 2023-09-30T17:02:59.509 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.49e-06 2023-09-30T17:02:59.509 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.509 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.509 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:59.509 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361056+0000", 2023-09-30T17:02:59.509 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0910000000000001e-05 2023-09-30T17:02:59.509 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.509 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.509 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:59.510 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361067+0000", 2023-09-30T17:02:59.510 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0531e-05 2023-09-30T17:02:59.510 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.510 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.510 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:59.510 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361263+0000", 2023-09-30T17:02:59.510 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000196486 2023-09-30T17:02:59.510 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.510 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.511 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:59.511 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361273+0000", 2023-09-30T17:02:59.511 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3379999999999994e-06 2023-09-30T17:02:59.511 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.511 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.511 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:59.511 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361404+0000", 2023-09-30T17:02:59.511 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013137700000000001 2023-09-30T17:02:59.511 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:59.511 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:59.512 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:59.512 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.512 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.512 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:31 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:02:59.512 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:02:59.512 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 41.067264070999997, 2023-09-30T17:02:59.512 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006676408, 2023-09-30T17:02:59.512 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:59.512 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:59.512 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:59.513 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.513 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:59.513 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:02:59.513 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:59.513 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.513 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.513 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:59.513 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:02:59.513 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:59.513 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.514 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.514 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:59.514 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:02:59.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5600000000000002e-07 2023-09-30T17:02:59.514 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.514 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.514 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:59.514 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362044+0000", 2023-09-30T17:02:59.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5987999999999999e-05 2023-09-30T17:02:59.514 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.515 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:59.515 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362051+0000", 2023-09-30T17:02:59.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2599999999999999e-06 2023-09-30T17:02:59.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.515 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:59.515 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362057+0000", 2023-09-30T17:02:59.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.19e-06 2023-09-30T17:02:59.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.516 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:59.516 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362096+0000", 2023-09-30T17:02:59.516 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8278000000000002e-05 2023-09-30T17:02:59.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.516 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:59.516 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362114+0000", 2023-09-30T17:02:59.516 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8808e-05 2023-09-30T17:02:59.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.517 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:59.517 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368658+0000", 2023-09-30T17:02:59.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065433540000000004 2023-09-30T17:02:59.517 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.517 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:59.517 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368694+0000", 2023-09-30T17:02:59.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6273999999999999e-05 2023-09-30T17:02:59.517 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:59.518 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:59.518 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:59.518 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.518 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.518 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:26 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-09-30T17:02:59.518 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:02:59.518 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 41.067173298999997, 2023-09-30T17:02:59.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0066596119999999996, 2023-09-30T17:02:59.518 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:59.519 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:59.519 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:59.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.519 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:59.519 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:02:59.519 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:59.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.519 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:59.519 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:02:59.520 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:59.520 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.520 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.520 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:59.520 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362109+0000", 2023-09-30T17:02:59.520 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5699999999999999e-07 2023-09-30T17:02:59.520 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.520 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.520 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:59.520 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362112+0000", 2023-09-30T17:02:59.521 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8410000000000002e-06 2023-09-30T17:02:59.521 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.521 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.521 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:59.521 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362117+0000", 2023-09-30T17:02:59.521 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.792e-06 2023-09-30T17:02:59.521 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.521 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.521 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:59.522 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362122+0000", 2023-09-30T17:02:59.522 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.763e-06 2023-09-30T17:02:59.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.522 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:59.522 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362344+0000", 2023-09-30T17:02:59.522 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022181600000000001 2023-09-30T17:02:59.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.522 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:59.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362357+0000", 2023-09-30T17:02:59.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2864000000000001e-05 2023-09-30T17:02:59.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.523 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:59.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368738+0000", 2023-09-30T17:02:59.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063809499999999998 2023-09-30T17:02:59.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.524 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:59.524 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368768+0000", 2023-09-30T17:02:59.524 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0429e-05 2023-09-30T17:02:59.524 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:59.524 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:59.524 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:59.524 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.524 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.524 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2023-09-30T17:02:59.524 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:02:59.525 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 41.065957132000001, 2023-09-30T17:02:59.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00082185400000000001, 2023-09-30T17:02:59.525 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:59.525 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:59.525 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:59.525 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.525 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:59.525 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:02:59.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:59.525 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.526 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:59.526 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:02:59.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:59.526 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.526 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:59.526 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:02:59.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.22e-07 2023-09-30T17:02:59.527 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.527 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.527 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:59.527 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363327+0000", 2023-09-30T17:02:59.527 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4480000000000001e-06 2023-09-30T17:02:59.527 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.527 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.527 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:59.527 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363333+0000", 2023-09-30T17:02:59.528 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9989999999999997e-06 2023-09-30T17:02:59.528 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.528 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.528 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:59.528 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363354+0000", 2023-09-30T17:02:59.528 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0547000000000002e-05 2023-09-30T17:02:59.528 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.528 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.528 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:59.528 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364057+0000", 2023-09-30T17:02:59.528 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00070306600000000002 2023-09-30T17:02:59.529 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.529 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.529 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:59.529 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364063+0000", 2023-09-30T17:02:59.529 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.694e-06 2023-09-30T17:02:59.529 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.529 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.529 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:59.530 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364146+0000", 2023-09-30T17:02:59.530 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3877999999999999e-05 2023-09-30T17:02:59.530 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:59.530 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:59.530 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:59.530 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.530 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.530 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e18/16 ondisk, result = 0)", 2023-09-30T17:02:59.531 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:02:59.531 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 41.065643600000001, 2023-09-30T17:02:59.531 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00067007199999999996, 2023-09-30T17:02:59.531 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:59.531 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:02:59.531 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:59.531 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.531 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:59.531 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:02:59.532 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:59.532 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.532 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.532 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:59.532 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:02:59.532 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:59.532 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.533 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.533 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:59.533 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:02:59.533 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.41e-07 2023-09-30T17:02:59.533 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.533 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.533 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:59.533 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363641+0000", 2023-09-30T17:02:59.533 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4830000000000002e-06 2023-09-30T17:02:59.534 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.534 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.534 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:59.534 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363647+0000", 2023-09-30T17:02:59.534 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4869999999999999e-06 2023-09-30T17:02:59.534 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.534 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.534 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:59.535 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363654+0000", 2023-09-30T17:02:59.535 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5889999999999999e-06 2023-09-30T17:02:59.535 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.535 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.535 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:59.535 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364217+0000", 2023-09-30T17:02:59.535 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00056263199999999998 2023-09-30T17:02:59.535 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.535 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.536 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:59.536 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364222+0000", 2023-09-30T17:02:59.536 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.242e-06 2023-09-30T17:02:59.536 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.536 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.536 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:59.536 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364308+0000", 2023-09-30T17:02:59.536 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6397999999999995e-05 2023-09-30T17:02:59.537 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:59.537 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:59.537 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:59.537 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.537 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.537 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2023-09-30T17:02:59.537 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:02:59.538 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 41.056055690000001, 2023-09-30T17:02:59.538 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000359561, 2023-09-30T17:02:59.538 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:59.538 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2023-09-30T17:02:59.538 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:59.538 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.538 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:59.539 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:02:59.539 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:59.539 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.539 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.539 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:59.539 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:02:59.539 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:59.539 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.540 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.540 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:59.540 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:02:59.540 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1e-07 2023-09-30T17:02:59.540 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.540 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.540 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:59.541 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373228+0000", 2023-09-30T17:02:59.541 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9420000000000002e-06 2023-09-30T17:02:59.541 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.541 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.541 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:59.541 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373235+0000", 2023-09-30T17:02:59.541 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4230000000000002e-06 2023-09-30T17:02:59.541 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.541 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.541 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:59.542 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373239+0000", 2023-09-30T17:02:59.542 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6809999999999997e-06 2023-09-30T17:02:59.542 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.542 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.542 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:59.542 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373518+0000", 2023-09-30T17:02:59.542 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000278311 2023-09-30T17:02:59.542 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.542 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.543 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:59.543 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373586+0000", 2023-09-30T17:02:59.543 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7994e-05 2023-09-30T17:02:59.543 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:59.543 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:59.543 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:59.543 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.543 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.543 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:02:59.543 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:02:59.544 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 41.051629617000003, 2023-09-30T17:02:59.544 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0046632949999999996, 2023-09-30T17:02:59.544 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:59.544 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:59.544 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:59.544 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.544 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:59.544 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:02:59.544 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:59.544 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.545 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.545 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:59.545 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:02:59.545 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:59.545 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.545 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.545 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:59.545 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377653+0000", 2023-09-30T17:02:59.545 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7800000000000002e-07 2023-09-30T17:02:59.545 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.546 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.546 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:59.546 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377657+0000", 2023-09-30T17:02:59.546 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5859999999999998e-06 2023-09-30T17:02:59.546 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.546 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.546 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:59.546 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377677+0000", 2023-09-30T17:02:59.546 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9508999999999999e-05 2023-09-30T17:02:59.547 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.547 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.547 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:59.547 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377682+0000", 2023-09-30T17:02:59.547 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8300000000000001e-06 2023-09-30T17:02:59.547 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.547 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.547 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:59.547 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377725+0000", 2023-09-30T17:02:59.547 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2425000000000001e-05 2023-09-30T17:02:59.547 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.548 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.548 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:59.548 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377738+0000", 2023-09-30T17:02:59.548 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2899e-05 2023-09-30T17:02:59.548 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.548 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.548 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:59.548 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382268+0000", 2023-09-30T17:02:59.548 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045301289999999999 2023-09-30T17:02:59.548 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.549 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.549 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:59.549 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382315+0000", 2023-09-30T17:02:59.549 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7539e-05 2023-09-30T17:02:59.549 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:59.549 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:59.549 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:59.549 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.549 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.549 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-09-30T17:02:59.550 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:02:59.550 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 41.051180166000002, 2023-09-30T17:02:59.550 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042540670000000003, 2023-09-30T17:02:59.550 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:59.550 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:59.550 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:59.550 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.550 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:59.550 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:02:59.550 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:59.551 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.551 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.551 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:59.551 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:02:59.551 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:59.551 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.551 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.551 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:59.551 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:02:59.551 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0299999999999998e-07 2023-09-30T17:02:59.552 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.552 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.552 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:59.552 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378107+0000", 2023-09-30T17:02:59.552 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9250000000000003e-06 2023-09-30T17:02:59.552 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.552 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.552 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:59.552 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378116+0000", 2023-09-30T17:02:59.552 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.037e-06 2023-09-30T17:02:59.553 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.553 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.553 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:59.553 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378123+0000", 2023-09-30T17:02:59.553 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1879999999999996e-06 2023-09-30T17:02:59.553 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.553 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.553 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:59.553 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378174+0000", 2023-09-30T17:02:59.553 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0998000000000002e-05 2023-09-30T17:02:59.554 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.554 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.554 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:59.554 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378197+0000", 2023-09-30T17:02:59.554 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2558e-05 2023-09-30T17:02:59.554 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.554 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.554 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:59.554 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382319+0000", 2023-09-30T17:02:59.554 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041220950000000001 2023-09-30T17:02:59.555 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.555 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.555 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:59.555 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382356+0000", 2023-09-30T17:02:59.555 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6563000000000002e-05 2023-09-30T17:02:59.555 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:59.555 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:59.555 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:59.555 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.555 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.556 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-09-30T17:02:59.556 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:02:59.556 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 36.993416342000003, 2023-09-30T17:02:59.556 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00171641, 2023-09-30T17:02:59.556 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:59.556 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:59.556 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:59.556 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.556 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:59.556 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:02:59.556 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:59.557 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.557 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.557 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:59.557 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:02:59.557 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:59.557 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.557 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.557 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:59.557 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435868+0000", 2023-09-30T17:02:59.557 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5840000000000002e-06 2023-09-30T17:02:59.558 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.558 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.558 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:59.558 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435892+0000", 2023-09-30T17:02:59.558 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3625000000000002e-05 2023-09-30T17:02:59.558 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.558 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.558 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:59.558 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435908+0000", 2023-09-30T17:02:59.559 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6548000000000001e-05 2023-09-30T17:02:59.559 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.559 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.559 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:59.559 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435935+0000", 2023-09-30T17:02:59.559 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6516000000000002e-05 2023-09-30T17:02:59.559 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.559 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.559 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:59.560 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435996+0000", 2023-09-30T17:02:59.560 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1433999999999995e-05 2023-09-30T17:02:59.560 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.560 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.560 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:59.560 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436114+0000", 2023-09-30T17:02:59.560 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000118344 2023-09-30T17:02:59.560 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.561 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.561 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:59.561 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436219+0000", 2023-09-30T17:02:59.561 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010453100000000001 2023-09-30T17:02:59.561 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.561 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.561 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:59.561 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436900+0000", 2023-09-30T17:02:59.562 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00068121299999999996 2023-09-30T17:02:59.562 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.562 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.562 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:59.562 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437508+0000", 2023-09-30T17:02:59.562 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00060817399999999995 2023-09-30T17:02:59.562 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.562 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.562 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:59.563 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437554+0000", 2023-09-30T17:02:59.563 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5609000000000003e-05 2023-09-30T17:02:59.563 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.563 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.563 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:59.563 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437582+0000", 2023-09-30T17:02:59.563 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7832000000000001e-05 2023-09-30T17:02:59.564 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:59.564 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:59.564 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:59.564 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.564 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.564 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2023-09-30T17:02:59.564 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:02:59.564 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 16.993104848000002, 2023-09-30T17:02:59.564 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001456199, 2023-09-30T17:02:59.564 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:02:59.565 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:02:59.565 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:02:59.565 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.565 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:02:59.565 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:02:59.565 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:59.566 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.566 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.566 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:02:59.566 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:02:59.566 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:02:59.566 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.566 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.566 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:02:59.566 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436178+0000", 2023-09-30T17:02:59.566 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.494e-06 2023-09-30T17:02:59.566 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.567 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.567 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:02:59.567 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436184+0000", 2023-09-30T17:02:59.567 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2809999999999999e-06 2023-09-30T17:02:59.567 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.567 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.568 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:02:59.568 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436198+0000", 2023-09-30T17:02:59.568 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3978000000000001e-05 2023-09-30T17:02:59.568 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.568 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.568 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:02:59.568 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436206+0000", 2023-09-30T17:02:59.568 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8040000000000007e-06 2023-09-30T17:02:59.568 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.569 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.569 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:02:59.569 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436268+0000", 2023-09-30T17:02:59.569 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1484999999999998e-05 2023-09-30T17:02:59.569 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.569 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.569 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:02:59.569 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436339+0000", 2023-09-30T17:02:59.570 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1000000000000005e-05 2023-09-30T17:02:59.570 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.570 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.570 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:02:59.570 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436438+0000", 2023-09-30T17:02:59.570 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9389000000000007e-05 2023-09-30T17:02:59.570 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.571 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.571 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:02:59.571 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436986+0000", 2023-09-30T17:02:59.571 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054723399999999996 2023-09-30T17:02:59.571 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.571 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.571 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:02:59.572 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437566+0000", 2023-09-30T17:02:59.572 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00058017599999999996 2023-09-30T17:02:59.572 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.572 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.572 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:02:59.572 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437606+0000", 2023-09-30T17:02:59.572 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9891999999999997e-05 2023-09-30T17:02:59.573 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:02:59.573 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:02:59.573 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:02:59.573 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437633+0000", 2023-09-30T17:02:59.573 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7466000000000001e-05 2023-09-30T17:02:59.573 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:59.573 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:59.574 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:59.574 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:02:59.574 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:02:59.574 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:02:59.575 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:59.575+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:59.576 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:02:59.676 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:02:59.675+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:02:59.722 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:02:59.722 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:02:59.722 INFO:teuthology.orchestra.run.smithi031.stdout: "num_ops": 0 2023-09-30T17:02:59.722 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:02:59.732 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:02:59.777 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:59.776+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:59.864 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:02:59.864 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:02:59.864 INFO:teuthology.orchestra.run.smithi031.stdout: "complaint_time": 30, 2023-09-30T17:02:59.864 INFO:teuthology.orchestra.run.smithi031.stdout: "num_blocked_ops": 0 2023-09-30T17:02:59.864 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:02:59.874 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:02:59.916 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:59.915+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:02:59.979 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:02:59.978+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:00.048 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:00.049 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 20, 2023-09-30T17:03:00.049 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 600, 2023-09-30T17:03:00.049 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:03:00.049 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.049 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:32 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'18, mlcod=11'14)", 2023-09-30T17:03:00.049 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:03:00.049 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 52.685860261000002, 2023-09-30T17:03:00.049 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051629809999999996, 2023-09-30T17:03:00.049 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:00.049 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:00.049 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:00.050 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.050 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:00.050 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:03:00.050 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:00.050 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.050 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.050 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:00.050 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:03:00.050 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:00.050 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.050 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.051 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:00.051 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:03:00.051 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2099999999999996e-07 2023-09-30T17:03:00.051 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.051 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.051 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:00.051 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361407+0000", 2023-09-30T17:03:00.051 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7499e-05 2023-09-30T17:03:00.051 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.052 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.052 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:00.052 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361418+0000", 2023-09-30T17:03:00.052 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1127999999999999e-05 2023-09-30T17:03:00.052 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.052 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.052 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:00.052 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361423+0000", 2023-09-30T17:03:00.052 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1930000000000001e-06 2023-09-30T17:03:00.052 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.052 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.053 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:00.053 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361476+0000", 2023-09-30T17:03:00.053 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3399000000000002e-05 2023-09-30T17:03:00.053 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.053 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.053 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:00.053 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361496+0000", 2023-09-30T17:03:00.053 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9638000000000001e-05 2023-09-30T17:03:00.053 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.053 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.053 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:00.054 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.366474+0000", 2023-09-30T17:03:00.054 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0049778829999999998 2023-09-30T17:03:00.054 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.054 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.054 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:00.054 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.366512+0000", 2023-09-30T17:03:00.054 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7620000000000002e-05 2023-09-30T17:03:00.054 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:00.054 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:00.054 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:00.054 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.054 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.055 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:37 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'23, mlcod=11'15)", 2023-09-30T17:03:00.055 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:03:00.055 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 52.683258264000003, 2023-09-30T17:03:00.055 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053985689999999998, 2023-09-30T17:03:00.055 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:00.055 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:00.055 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:00.055 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.055 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:00.055 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:03:00.056 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:00.056 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.056 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.056 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:00.056 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:03:00.056 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:00.056 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.056 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.056 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:00.056 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:03:00.056 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4400000000000001e-07 2023-09-30T17:03:00.056 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.056 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.057 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:00.057 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363956+0000", 2023-09-30T17:03:00.057 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.921e-06 2023-09-30T17:03:00.057 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.057 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.057 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:00.057 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363966+0000", 2023-09-30T17:03:00.057 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0351e-05 2023-09-30T17:03:00.057 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.057 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.058 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:00.058 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363971+0000", 2023-09-30T17:03:00.058 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.023e-06 2023-09-30T17:03:00.058 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.058 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.058 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:00.058 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.364013+0000", 2023-09-30T17:03:00.058 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1575000000000001e-05 2023-09-30T17:03:00.058 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.058 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.058 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:00.059 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.364026+0000", 2023-09-30T17:03:00.059 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3044000000000001e-05 2023-09-30T17:03:00.059 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.059 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.059 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:00.059 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.369308+0000", 2023-09-30T17:03:00.059 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005282152 2023-09-30T17:03:00.059 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.059 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.059 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:00.059 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.369349+0000", 2023-09-30T17:03:00.060 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1059000000000001e-05 2023-09-30T17:03:00.060 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:00.060 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:00.060 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:00.060 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.060 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.060 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:155 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'109, mlcod=11'105)", 2023-09-30T17:03:00.060 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:03:00.060 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 52.201562578000001, 2023-09-30T17:03:00.060 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053867639999999996, 2023-09-30T17:03:00.060 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:00.061 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:00.061 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:00.061 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.061 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:00.061 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:03:00.061 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:00.061 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.061 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.061 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:00.061 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:03:00.061 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:00.062 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.062 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.062 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:00.062 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845647+0000", 2023-09-30T17:03:00.062 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7599999999999997e-07 2023-09-30T17:03:00.062 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.062 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.062 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:00.062 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845699+0000", 2023-09-30T17:03:00.062 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1758000000000001e-05 2023-09-30T17:03:00.062 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.062 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.063 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:00.063 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845708+0000", 2023-09-30T17:03:00.063 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2159999999999995e-06 2023-09-30T17:03:00.063 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.063 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.063 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:00.063 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845712+0000", 2023-09-30T17:03:00.063 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2579999999999997e-06 2023-09-30T17:03:00.063 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.063 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.063 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:00.063 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845756+0000", 2023-09-30T17:03:00.064 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4119999999999998e-05 2023-09-30T17:03:00.064 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.064 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.064 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:00.064 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845779+0000", 2023-09-30T17:03:00.064 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2311e-05 2023-09-30T17:03:00.064 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.064 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.064 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:00.064 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.850982+0000", 2023-09-30T17:03:00.064 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005203053 2023-09-30T17:03:00.064 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.065 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.065 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:00.065 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851033+0000", 2023-09-30T17:03:00.065 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1471999999999998e-05 2023-09-30T17:03:00.065 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:00.065 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:00.065 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:00.065 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.065 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.065 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:156 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'110, mlcod=11'105)", 2023-09-30T17:03:00.065 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:03:00.065 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 52.201029652000003, 2023-09-30T17:03:00.066 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0052834759999999996, 2023-09-30T17:03:00.066 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:00.066 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:00.066 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:00.066 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.066 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:00.066 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:03:00.066 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:00.066 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.066 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.066 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:00.067 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:03:00.067 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:00.067 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.067 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.067 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:00.067 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846180+0000", 2023-09-30T17:03:00.067 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6300000000000005e-07 2023-09-30T17:03:00.067 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.067 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.067 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:00.067 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846184+0000", 2023-09-30T17:03:00.067 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3789999999999999e-06 2023-09-30T17:03:00.068 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.068 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.068 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:00.068 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846195+0000", 2023-09-30T17:03:00.068 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0778000000000001e-05 2023-09-30T17:03:00.068 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.068 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.068 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:00.068 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846200+0000", 2023-09-30T17:03:00.068 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1540000000000001e-06 2023-09-30T17:03:00.068 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.068 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.069 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:00.069 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846274+0000", 2023-09-30T17:03:00.069 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4129999999999997e-05 2023-09-30T17:03:00.069 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.069 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.069 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:00.069 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846286+0000", 2023-09-30T17:03:00.069 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1744e-05 2023-09-30T17:03:00.069 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.069 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.069 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:00.069 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851432+0000", 2023-09-30T17:03:00.070 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051462110000000004 2023-09-30T17:03:00.070 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.070 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.070 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:00.070 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851463+0000", 2023-09-30T17:03:00.070 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0516999999999999e-05 2023-09-30T17:03:00.070 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:00.070 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:00.070 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:00.070 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.070 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.071 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:203 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'149, mlcod=11'145)", 2023-09-30T17:03:00.071 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:03:00.071 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 51.844993743000003, 2023-09-30T17:03:00.071 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051867459999999999, 2023-09-30T17:03:00.071 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:00.071 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:00.071 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:00.071 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.072 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:00.072 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:03:00.072 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:00.072 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.072 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.072 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:00.072 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:03:00.072 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:00.072 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.072 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.072 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:00.073 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202216+0000", 2023-09-30T17:03:00.073 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7e-07 2023-09-30T17:03:00.073 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.073 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.073 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:00.073 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202271+0000", 2023-09-30T17:03:00.073 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5163e-05 2023-09-30T17:03:00.074 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.074 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.074 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:00.074 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202282+0000", 2023-09-30T17:03:00.074 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1319e-05 2023-09-30T17:03:00.074 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.074 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.074 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:00.074 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202288+0000", 2023-09-30T17:03:00.074 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2899999999999999e-06 2023-09-30T17:03:00.075 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.075 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.075 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:00.075 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202331+0000", 2023-09-30T17:03:00.075 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2147999999999997e-05 2023-09-30T17:03:00.075 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.075 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.075 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:00.075 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202348+0000", 2023-09-30T17:03:00.076 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7317e-05 2023-09-30T17:03:00.076 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.076 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.076 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:00.076 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.207357+0000", 2023-09-30T17:03:00.076 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0050095440000000003 2023-09-30T17:03:00.076 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.076 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.076 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:00.076 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.207402+0000", 2023-09-30T17:03:00.076 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4495e-05 2023-09-30T17:03:00.077 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:00.077 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:00.077 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:00.077 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.077 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.077 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:00.077 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:03:00.077 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 41.695663455000002, 2023-09-30T17:03:00.078 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.025313649000000001, 2023-09-30T17:03:00.078 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:00.078 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:00.078 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:00.078 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.078 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:00.078 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:03:00.078 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:00.078 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.078 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.079 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:00.079 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:03:00.079 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:00.079 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.079 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.079 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:00.079 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351551+0000", 2023-09-30T17:03:00.080 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3380000000000004e-06 2023-09-30T17:03:00.080 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.080 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.080 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:00.080 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351559+0000", 2023-09-30T17:03:00.080 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9589999999999995e-06 2023-09-30T17:03:00.080 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.080 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.080 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:00.081 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351571+0000", 2023-09-30T17:03:00.081 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2065999999999999e-05 2023-09-30T17:03:00.081 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.081 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.081 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:00.081 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351706+0000", 2023-09-30T17:03:00.081 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00013553799999999999 2023-09-30T17:03:00.081 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.081 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.082 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:00.082 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353016+0000", 2023-09-30T17:03:00.082 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0013099209999999999 2023-09-30T17:03:00.082 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.082 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.082 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:00.082 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353023+0000", 2023-09-30T17:03:00.082 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2479999999999999e-06 2023-09-30T17:03:00.083 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.083 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.083 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:00.083 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360348+0000", 2023-09-30T17:03:00.083 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0073248949999999997 2023-09-30T17:03:00.083 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.083 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.083 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:00.084 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360787+0000", 2023-09-30T17:03:00.084 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00043875199999999999 2023-09-30T17:03:00.084 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.084 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.084 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:00.084 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360892+0000", 2023-09-30T17:03:00.084 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010508199999999999 2023-09-30T17:03:00.084 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.084 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.084 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:00.084 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365132+0000", 2023-09-30T17:03:00.084 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0042396480000000004 2023-09-30T17:03:00.084 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.085 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.085 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:00.085 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376746+0000", 2023-09-30T17:03:00.085 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011614157 2023-09-30T17:03:00.085 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.085 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.085 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:00.085 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376811+0000", 2023-09-30T17:03:00.085 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5005999999999994e-05 2023-09-30T17:03:00.085 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.085 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.086 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:00.086 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376859+0000", 2023-09-30T17:03:00.086 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8038999999999999e-05 2023-09-30T17:03:00.086 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:00.086 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:00.086 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:00.086 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.086 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.086 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:00.086 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:03:00.086 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 41.695165656, 2023-09-30T17:03:00.087 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024923989000000001, 2023-09-30T17:03:00.087 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:00.087 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:00.087 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:00.087 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.087 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:00.087 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:03:00.087 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:00.087 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.087 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.087 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:00.087 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:03:00.088 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:00.088 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.088 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.088 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:00.088 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352044+0000", 2023-09-30T17:03:00.088 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9199999999999999e-07 2023-09-30T17:03:00.088 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.088 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.088 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:00.088 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352050+0000", 2023-09-30T17:03:00.088 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8880000000000002e-06 2023-09-30T17:03:00.088 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.089 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.089 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:00.089 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352143+0000", 2023-09-30T17:03:00.089 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2721999999999998e-05 2023-09-30T17:03:00.089 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.089 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.089 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:00.089 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352155+0000", 2023-09-30T17:03:00.089 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2279000000000001e-05 2023-09-30T17:03:00.089 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.089 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.089 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:00.089 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353114+0000", 2023-09-30T17:03:00.090 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00095943700000000005 2023-09-30T17:03:00.090 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.090 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.090 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:00.090 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353121+0000", 2023-09-30T17:03:00.090 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.494e-06 2023-09-30T17:03:00.090 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.090 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.090 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:00.090 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361491+0000", 2023-09-30T17:03:00.090 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0083697359999999991 2023-09-30T17:03:00.091 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.091 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.091 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:00.091 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361573+0000", 2023-09-30T17:03:00.091 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2822000000000001e-05 2023-09-30T17:03:00.091 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.091 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.091 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:00.091 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362166+0000", 2023-09-30T17:03:00.091 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00059223299999999995 2023-09-30T17:03:00.091 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.091 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.092 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:00.092 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365209+0000", 2023-09-30T17:03:00.092 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.003043212 2023-09-30T17:03:00.092 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.092 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.092 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:00.092 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376910+0000", 2023-09-30T17:03:00.092 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011700898 2023-09-30T17:03:00.092 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.092 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.092 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:00.092 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376945+0000", 2023-09-30T17:03:00.093 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4795000000000001e-05 2023-09-30T17:03:00.093 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.093 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.093 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:00.093 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376967+0000", 2023-09-30T17:03:00.093 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2580999999999999e-05 2023-09-30T17:03:00.093 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:00.093 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:00.093 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:00.093 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.094 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.094 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:00.094 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:03:00.094 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 41.694995736000003, 2023-09-30T17:03:00.094 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023120405, 2023-09-30T17:03:00.094 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:00.094 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:00.094 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:00.094 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.094 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:00.094 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:03:00.094 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:00.095 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.095 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.095 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:00.095 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:03:00.095 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:00.095 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.095 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.095 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:00.095 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352214+0000", 2023-09-30T17:03:00.095 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8400000000000003e-07 2023-09-30T17:03:00.095 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.096 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.096 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:00.096 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352233+0000", 2023-09-30T17:03:00.096 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8946000000000001e-05 2023-09-30T17:03:00.096 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.096 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.096 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:00.096 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352297+0000", 2023-09-30T17:03:00.096 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3540999999999994e-05 2023-09-30T17:03:00.096 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.096 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.097 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:00.097 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352450+0000", 2023-09-30T17:03:00.097 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015364799999999999 2023-09-30T17:03:00.097 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.097 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.097 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:00.097 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353098+0000", 2023-09-30T17:03:00.097 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00064820299999999997 2023-09-30T17:03:00.097 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.097 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.097 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:00.097 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353103+0000", 2023-09-30T17:03:00.098 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0529999999999997e-06 2023-09-30T17:03:00.098 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.098 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.098 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:00.098 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.358558+0000", 2023-09-30T17:03:00.098 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0054550249999999996 2023-09-30T17:03:00.098 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.098 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.098 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:00.098 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.358741+0000", 2023-09-30T17:03:00.099 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00018210200000000001 2023-09-30T17:03:00.099 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.099 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.099 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:00.099 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.359683+0000", 2023-09-30T17:03:00.099 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00094202299999999995 2023-09-30T17:03:00.099 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.099 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.099 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:00.099 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365044+0000", 2023-09-30T17:03:00.100 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053616219999999999 2023-09-30T17:03:00.100 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.100 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.100 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:00.100 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375256+0000", 2023-09-30T17:03:00.100 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010212156 2023-09-30T17:03:00.100 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.100 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.100 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:00.100 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375300+0000", 2023-09-30T17:03:00.100 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3961999999999997e-05 2023-09-30T17:03:00.101 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.101 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.101 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:00.101 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375334+0000", 2023-09-30T17:03:00.101 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.324e-05 2023-09-30T17:03:00.101 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:00.101 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:00.101 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:00.101 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.101 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.101 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:00.102 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:03:00.102 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 41.694680718000001, 2023-09-30T17:03:00.102 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024240660000000001, 2023-09-30T17:03:00.102 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:00.102 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:00.102 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:00.102 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.102 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:00.102 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:03:00.102 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:00.102 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.103 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.103 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:00.103 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:03:00.103 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:00.103 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.103 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.103 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:00.103 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352529+0000", 2023-09-30T17:03:00.103 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1379999999999999e-06 2023-09-30T17:03:00.103 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.103 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.104 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:00.104 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352536+0000", 2023-09-30T17:03:00.104 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3489999999999997e-06 2023-09-30T17:03:00.104 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.104 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.104 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:00.104 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352547+0000", 2023-09-30T17:03:00.104 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1109e-05 2023-09-30T17:03:00.104 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.104 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.105 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:00.105 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352560+0000", 2023-09-30T17:03:00.105 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3046e-05 2023-09-30T17:03:00.105 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.105 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.105 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:00.105 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353142+0000", 2023-09-30T17:03:00.105 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00058174699999999997 2023-09-30T17:03:00.105 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.105 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.105 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:00.106 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353147+0000", 2023-09-30T17:03:00.106 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5840000000000002e-06 2023-09-30T17:03:00.106 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.106 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.106 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:00.106 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360374+0000", 2023-09-30T17:03:00.106 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0072270049999999999 2023-09-30T17:03:00.106 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.106 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.106 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:00.106 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360795+0000", 2023-09-30T17:03:00.107 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00042088999999999999 2023-09-30T17:03:00.107 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.107 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.107 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:00.107 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360967+0000", 2023-09-30T17:03:00.107 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017235699999999999 2023-09-30T17:03:00.107 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.107 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.107 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:00.107 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365051+0000", 2023-09-30T17:03:00.107 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0040837429999999999 2023-09-30T17:03:00.107 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.108 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.108 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:00.108 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376708+0000", 2023-09-30T17:03:00.108 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011656866 2023-09-30T17:03:00.108 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.108 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.108 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:00.108 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376745+0000", 2023-09-30T17:03:00.108 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6769e-05 2023-09-30T17:03:00.108 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.108 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.109 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:00.109 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376769+0000", 2023-09-30T17:03:00.109 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4057e-05 2023-09-30T17:03:00.109 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:00.109 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:00.109 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:00.109 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.109 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.109 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:00.109 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:00.109 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 41.694421363000004, 2023-09-30T17:03:00.110 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023472704, 2023-09-30T17:03:00.110 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:00.110 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:00.110 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:00.110 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.110 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:00.110 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:00.110 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:00.110 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.110 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.110 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:00.110 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:00.111 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:00.111 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.111 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.111 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:00.111 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:00.111 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8000000000000005e-07 2023-09-30T17:03:00.111 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.111 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.111 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:00.111 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352794+0000", 2023-09-30T17:03:00.111 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.789e-06 2023-09-30T17:03:00.112 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.112 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.112 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:00.112 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352805+0000", 2023-09-30T17:03:00.112 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0848e-05 2023-09-30T17:03:00.112 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.112 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.112 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:00.112 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352812+0000", 2023-09-30T17:03:00.112 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4449999999999999e-06 2023-09-30T17:03:00.112 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.113 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.113 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:00.113 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353063+0000", 2023-09-30T17:03:00.113 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00025046299999999998 2023-09-30T17:03:00.113 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.113 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.113 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:00.113 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353071+0000", 2023-09-30T17:03:00.113 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6739999999999997e-06 2023-09-30T17:03:00.113 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.113 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.113 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:00.114 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361696+0000", 2023-09-30T17:03:00.114 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0086251609999999992 2023-09-30T17:03:00.114 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.114 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.114 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:00.114 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362284+0000", 2023-09-30T17:03:00.114 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00058872299999999998 2023-09-30T17:03:00.114 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.114 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.114 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:00.114 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362429+0000", 2023-09-30T17:03:00.115 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014509000000000001 2023-09-30T17:03:00.115 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.115 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.115 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:00.115 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365330+0000", 2023-09-30T17:03:00.115 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0029005419999999999 2023-09-30T17:03:00.115 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.115 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.115 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:00.115 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376196+0000", 2023-09-30T17:03:00.115 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.01086615 2023-09-30T17:03:00.116 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.116 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.116 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:00.116 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376230+0000", 2023-09-30T17:03:00.116 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3858e-05 2023-09-30T17:03:00.116 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.116 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.116 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:00.116 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376260+0000", 2023-09-30T17:03:00.116 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0181000000000001e-05 2023-09-30T17:03:00.116 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:00.116 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:00.117 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:00.117 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.117 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.117 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:00.117 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:03:00.117 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 41.694187792999998, 2023-09-30T17:03:00.117 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023406132999999999, 2023-09-30T17:03:00.117 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:00.117 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:00.117 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:00.117 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.118 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:00.118 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:03:00.118 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:00.118 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.118 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.118 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:00.118 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:03:00.118 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:00.118 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.118 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.118 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:00.119 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353022+0000", 2023-09-30T17:03:00.119 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.78e-07 2023-09-30T17:03:00.119 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.119 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.119 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:00.119 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353027+0000", 2023-09-30T17:03:00.119 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9089999999999999e-06 2023-09-30T17:03:00.119 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.119 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.119 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:00.119 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353035+0000", 2023-09-30T17:03:00.120 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0430000000000008e-06 2023-09-30T17:03:00.120 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.120 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.120 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:00.120 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353047+0000", 2023-09-30T17:03:00.120 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1674e-05 2023-09-30T17:03:00.120 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.120 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.120 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:00.120 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353105+0000", 2023-09-30T17:03:00.120 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8891999999999998e-05 2023-09-30T17:03:00.121 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.121 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.121 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:00.121 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353112+0000", 2023-09-30T17:03:00.121 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7059999999999998e-06 2023-09-30T17:03:00.121 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.121 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.121 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:00.121 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362733+0000", 2023-09-30T17:03:00.121 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0096205869999999999 2023-09-30T17:03:00.121 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.122 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.122 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:00.122 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362833+0000", 2023-09-30T17:03:00.122 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000100227 2023-09-30T17:03:00.122 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.122 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.122 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:00.122 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363000+0000", 2023-09-30T17:03:00.122 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016670899999999999 2023-09-30T17:03:00.122 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.122 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.122 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:00.123 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365550+0000", 2023-09-30T17:03:00.123 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0025499199999999998 2023-09-30T17:03:00.123 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.123 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.123 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:00.123 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376315+0000", 2023-09-30T17:03:00.123 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010765011999999999 2023-09-30T17:03:00.123 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.123 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.123 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:00.123 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376386+0000", 2023-09-30T17:03:00.124 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0866999999999998e-05 2023-09-30T17:03:00.124 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.124 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.124 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:00.124 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376427+0000", 2023-09-30T17:03:00.124 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1709000000000003e-05 2023-09-30T17:03:00.124 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:00.124 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:00.124 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:00.124 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.124 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.124 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:00.125 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:00.125 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 41.694147157000003, 2023-09-30T17:03:00.125 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024076238, 2023-09-30T17:03:00.125 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:00.125 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:00.125 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:00.125 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.125 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:00.125 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:00.125 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:00.125 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.125 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.126 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:00.126 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:00.126 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:00.126 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.126 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.126 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:00.126 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:00.126 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8699999999999995e-07 2023-09-30T17:03:00.126 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.126 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.127 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:00.127 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353067+0000", 2023-09-30T17:03:00.127 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.605e-06 2023-09-30T17:03:00.127 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.127 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.127 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:00.127 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353073+0000", 2023-09-30T17:03:00.127 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8900000000000004e-06 2023-09-30T17:03:00.127 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.127 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.127 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:00.127 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353083+0000", 2023-09-30T17:03:00.127 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0200000000000001e-05 2023-09-30T17:03:00.128 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.128 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.128 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:00.128 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353186+0000", 2023-09-30T17:03:00.128 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010256599999999999 2023-09-30T17:03:00.128 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.128 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.128 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:00.128 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353190+0000", 2023-09-30T17:03:00.128 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9709999999999998e-06 2023-09-30T17:03:00.128 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.128 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.129 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:00.129 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362946+0000", 2023-09-30T17:03:00.129 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0097563330000000007 2023-09-30T17:03:00.129 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.129 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.129 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:00.129 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363088+0000", 2023-09-30T17:03:00.129 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014259200000000001 2023-09-30T17:03:00.129 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.129 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.129 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:00.129 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363555+0000", 2023-09-30T17:03:00.130 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00046627799999999998 2023-09-30T17:03:00.130 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.130 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.130 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:00.130 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365871+0000", 2023-09-30T17:03:00.130 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0023167589999999998 2023-09-30T17:03:00.130 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.130 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.130 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:00.130 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377033+0000", 2023-09-30T17:03:00.130 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011161203999999999 2023-09-30T17:03:00.130 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.131 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.131 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:00.131 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377100+0000", 2023-09-30T17:03:00.131 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7230999999999994e-05 2023-09-30T17:03:00.131 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.131 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.131 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:00.131 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377138+0000", 2023-09-30T17:03:00.131 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8022000000000003e-05 2023-09-30T17:03:00.131 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:00.131 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:00.131 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:00.132 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.132 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.132 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:00.132 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:03:00.132 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 41.694046208000003, 2023-09-30T17:03:00.132 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.020304412000000001, 2023-09-30T17:03:00.132 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:00.132 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:00.132 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:00.132 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.133 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:00.133 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:03:00.133 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:00.133 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.133 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.133 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:00.133 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:03:00.133 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:00.133 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.133 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.133 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:00.134 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353164+0000", 2023-09-30T17:03:00.134 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7100000000000011e-07 2023-09-30T17:03:00.134 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.134 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.134 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:00.134 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353168+0000", 2023-09-30T17:03:00.134 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0600000000000001e-06 2023-09-30T17:03:00.134 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.134 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.134 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:00.134 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353177+0000", 2023-09-30T17:03:00.135 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1409999999999994e-06 2023-09-30T17:03:00.135 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.135 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.135 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:00.135 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353185+0000", 2023-09-30T17:03:00.135 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2479999999999996e-06 2023-09-30T17:03:00.135 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.135 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.135 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:00.135 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353246+0000", 2023-09-30T17:03:00.135 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0519000000000001e-05 2023-09-30T17:03:00.135 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.136 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.136 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:00.136 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353252+0000", 2023-09-30T17:03:00.136 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7859999999999999e-06 2023-09-30T17:03:00.136 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.136 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.136 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:00.136 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354979+0000", 2023-09-30T17:03:00.136 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0017270090000000001 2023-09-30T17:03:00.136 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.137 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.137 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:00.137 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355097+0000", 2023-09-30T17:03:00.137 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000117472 2023-09-30T17:03:00.137 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.137 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.137 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:00.137 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.373467+0000", 2023-09-30T17:03:00.137 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.018370206 2023-09-30T17:03:00.137 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:00.137 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:00.138 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:00.138 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.138 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.138 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:00.138 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:03:00.138 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 41.69400547, 2023-09-30T17:03:00.138 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.012725089, 2023-09-30T17:03:00.138 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:00.138 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:00.138 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:00.138 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.138 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:00.139 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:03:00.139 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:00.139 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.139 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.139 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:00.139 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:03:00.139 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:00.139 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.139 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.139 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:00.139 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353204+0000", 2023-09-30T17:03:00.140 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7100000000000002e-07 2023-09-30T17:03:00.140 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.140 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.140 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:00.140 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353213+0000", 2023-09-30T17:03:00.140 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8580000000000006e-06 2023-09-30T17:03:00.140 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.140 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.140 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:00.140 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353219+0000", 2023-09-30T17:03:00.140 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8939999999999998e-06 2023-09-30T17:03:00.140 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.141 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.141 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:00.141 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353223+0000", 2023-09-30T17:03:00.141 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.357e-06 2023-09-30T17:03:00.141 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.141 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.141 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:00.141 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353278+0000", 2023-09-30T17:03:00.141 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5228e-05 2023-09-30T17:03:00.141 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.141 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.142 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:00.142 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353284+0000", 2023-09-30T17:03:00.142 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8209999999999998e-06 2023-09-30T17:03:00.142 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.142 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.142 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:00.142 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355095+0000", 2023-09-30T17:03:00.142 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001811404 2023-09-30T17:03:00.142 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.142 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.142 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:00.143 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355256+0000", 2023-09-30T17:03:00.143 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000160898 2023-09-30T17:03:00.143 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.143 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.143 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:00.143 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365928+0000", 2023-09-30T17:03:00.143 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010672157999999999 2023-09-30T17:03:00.143 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:00.143 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:00.143 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:00.143 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.144 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.144 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-09-30T17:03:00.144 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:03:00.144 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 41.693474262999999, 2023-09-30T17:03:00.144 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0056863460000000001, 2023-09-30T17:03:00.144 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:00.144 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "reached pg", 2023-09-30T17:03:00.144 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:00.144 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.144 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:00.144 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:03:00.145 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:00.145 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.145 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.145 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:00.145 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:03:00.145 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:00.145 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.145 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.145 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:00.145 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:03:00.145 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5700000000000002e-07 2023-09-30T17:03:00.145 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.146 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.146 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:00.146 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353747+0000", 2023-09-30T17:03:00.146 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1899000000000001e-05 2023-09-30T17:03:00.146 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.146 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.146 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:00.146 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353776+0000", 2023-09-30T17:03:00.146 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.8767000000000001e-05 2023-09-30T17:03:00.146 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.146 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.147 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:00.147 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353792+0000", 2023-09-30T17:03:00.147 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5914999999999999e-05 2023-09-30T17:03:00.147 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.147 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.147 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:00.147 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353900+0000", 2023-09-30T17:03:00.147 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010774500000000001 2023-09-30T17:03:00.147 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.147 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.147 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:00.147 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.359421+0000", 2023-09-30T17:03:00.148 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0055213629999999996 2023-09-30T17:03:00.148 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:00.148 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:00.148 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:00.148 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.148 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.148 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:03:00.148 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:03:00.148 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 41.692802663000002, 2023-09-30T17:03:00.148 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0069196370000000002, 2023-09-30T17:03:00.148 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:00.148 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:00.149 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:00.149 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.149 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:00.149 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:03:00.149 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:00.149 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.149 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.149 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:00.149 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:03:00.149 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:00.149 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.150 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.150 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:00.150 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354407+0000", 2023-09-30T17:03:00.150 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7400000000000002e-07 2023-09-30T17:03:00.150 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.150 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.150 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:00.150 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354414+0000", 2023-09-30T17:03:00.150 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1040000000000001e-06 2023-09-30T17:03:00.150 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.150 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.150 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:00.151 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354425+0000", 2023-09-30T17:03:00.151 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1090000000000001e-05 2023-09-30T17:03:00.151 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.151 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.151 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:00.151 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354435+0000", 2023-09-30T17:03:00.151 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8169999999999994e-06 2023-09-30T17:03:00.151 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.151 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.151 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:00.151 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355741+0000", 2023-09-30T17:03:00.151 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0013063160000000001 2023-09-30T17:03:00.152 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.152 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.152 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:00.152 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355763+0000", 2023-09-30T17:03:00.152 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1688e-05 2023-09-30T17:03:00.152 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.152 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.152 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:00.152 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361289+0000", 2023-09-30T17:03:00.152 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0055258269999999996 2023-09-30T17:03:00.152 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.153 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.153 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:00.153 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361326+0000", 2023-09-30T17:03:00.153 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7020999999999997e-05 2023-09-30T17:03:00.153 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:00.153 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:00.153 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:00.153 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.153 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.153 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:30 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2023-09-30T17:03:00.153 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:03:00.153 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 41.691428705, 2023-09-30T17:03:00.154 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0069996629999999997, 2023-09-30T17:03:00.154 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:00.154 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:00.154 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:00.154 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.154 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:00.154 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:03:00.154 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:00.154 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.154 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.154 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:00.154 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:03:00.155 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:00.155 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.155 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.155 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:00.155 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355781+0000", 2023-09-30T17:03:00.155 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9599999999999999e-07 2023-09-30T17:03:00.155 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.155 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.155 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:00.155 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355788+0000", 2023-09-30T17:03:00.155 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8129999999999996e-06 2023-09-30T17:03:00.156 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.156 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.156 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:00.156 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355798+0000", 2023-09-30T17:03:00.156 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2909999999999996e-06 2023-09-30T17:03:00.156 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.156 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.156 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:00.156 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355807+0000", 2023-09-30T17:03:00.156 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8619999999999992e-06 2023-09-30T17:03:00.156 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.156 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.157 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:00.157 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.357264+0000", 2023-09-30T17:03:00.157 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0014578289999999999 2023-09-30T17:03:00.157 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.157 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.157 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:00.157 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.357916+0000", 2023-09-30T17:03:00.157 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00065170500000000004 2023-09-30T17:03:00.157 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.157 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.157 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:00.158 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362731+0000", 2023-09-30T17:03:00.158 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0048149849999999999 2023-09-30T17:03:00.158 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.158 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.158 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:00.158 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362780+0000", 2023-09-30T17:03:00.158 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8681999999999999e-05 2023-09-30T17:03:00.158 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:00.158 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:00.158 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:00.158 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.158 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.159 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2023-09-30T17:03:00.159 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:03:00.159 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 41.672777654000001, 2023-09-30T17:03:00.159 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005905998, 2023-09-30T17:03:00.159 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:00.159 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:00.159 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:00.159 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.159 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:00.159 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:03:00.159 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:00.159 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.160 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.160 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:00.160 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:03:00.160 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:00.160 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.160 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.160 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:00.160 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:03:00.160 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1e-07 2023-09-30T17:03:00.160 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.160 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.160 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:00.161 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374455+0000", 2023-09-30T17:03:00.161 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.3091999999999998e-05 2023-09-30T17:03:00.161 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.161 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.161 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:00.161 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374462+0000", 2023-09-30T17:03:00.161 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5170000000000002e-06 2023-09-30T17:03:00.161 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.161 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.161 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:00.161 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374469+0000", 2023-09-30T17:03:00.162 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8199999999999999e-06 2023-09-30T17:03:00.162 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.162 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.162 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:00.162 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374550+0000", 2023-09-30T17:03:00.162 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0978999999999998e-05 2023-09-30T17:03:00.162 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.162 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.162 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:00.162 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374562+0000", 2023-09-30T17:03:00.162 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2472e-05 2023-09-30T17:03:00.162 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.163 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.163 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:00.163 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380293+0000", 2023-09-30T17:03:00.163 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0057310379999999999 2023-09-30T17:03:00.163 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.163 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.163 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:00.163 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380337+0000", 2023-09-30T17:03:00.163 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3869999999999998e-05 2023-09-30T17:03:00.163 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:00.163 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:00.163 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:00.164 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.164 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.164 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2023-09-30T17:03:00.164 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:03:00.164 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 41.672590905, 2023-09-30T17:03:00.164 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0057590560000000002, 2023-09-30T17:03:00.164 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:00.164 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:00.164 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:00.164 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.164 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:00.164 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:03:00.165 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:00.165 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.165 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.165 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:00.165 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:03:00.165 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:00.165 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.165 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.165 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:00.165 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:03:00.165 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4900000000000001e-07 2023-09-30T17:03:00.165 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.165 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.166 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:00.166 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374629+0000", 2023-09-30T17:03:00.166 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1014e-05 2023-09-30T17:03:00.166 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.166 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.166 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:00.166 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374636+0000", 2023-09-30T17:03:00.166 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5889999999999999e-06 2023-09-30T17:03:00.166 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.166 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.167 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:00.167 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374642+0000", 2023-09-30T17:03:00.167 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.48e-06 2023-09-30T17:03:00.167 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.167 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.167 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:00.167 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374681+0000", 2023-09-30T17:03:00.167 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9320000000000003e-05 2023-09-30T17:03:00.167 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.167 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.167 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:00.167 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374694+0000", 2023-09-30T17:03:00.168 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3351e-05 2023-09-30T17:03:00.168 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.168 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.168 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:00.168 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380319+0000", 2023-09-30T17:03:00.168 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0056243880000000001 2023-09-30T17:03:00.168 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.168 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.168 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:00.168 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380377+0000", 2023-09-30T17:03:00.168 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8464999999999997e-05 2023-09-30T17:03:00.169 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:00.169 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:00.169 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:00.169 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.169 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.169 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=0'0)", 2023-09-30T17:03:00.169 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:03:00.169 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 41.671879994000001, 2023-09-30T17:03:00.169 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051157370000000004, 2023-09-30T17:03:00.169 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:00.169 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:00.169 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:00.170 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.170 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:00.170 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:03:00.170 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:00.170 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.170 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.170 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:00.170 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:03:00.170 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:00.170 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.170 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.171 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:00.171 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:03:00.171 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0199999999999998e-07 2023-09-30T17:03:00.171 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.171 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.171 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:00.171 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375334+0000", 2023-09-30T17:03:00.171 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8799999999999999e-06 2023-09-30T17:03:00.171 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.171 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.171 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:00.171 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375343+0000", 2023-09-30T17:03:00.172 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5490000000000006e-06 2023-09-30T17:03:00.172 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.172 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.172 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:00.172 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375350+0000", 2023-09-30T17:03:00.172 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5700000000000004e-06 2023-09-30T17:03:00.172 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.172 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.172 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:00.172 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375396+0000", 2023-09-30T17:03:00.172 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5550999999999998e-05 2023-09-30T17:03:00.172 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.173 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.173 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:00.173 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375410+0000", 2023-09-30T17:03:00.173 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4518999999999999e-05 2023-09-30T17:03:00.173 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.173 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.173 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:00.173 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380401+0000", 2023-09-30T17:03:00.173 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0049903430000000004 2023-09-30T17:03:00.173 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:00.173 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:00.174 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:00.174 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380445+0000", 2023-09-30T17:03:00.174 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4023000000000002e-05 2023-09-30T17:03:00.174 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:00.174 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:00.174 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:00.174 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:00.174 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:00.174 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:00.175 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-09-30T17:03:00.176 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:03:00.177 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:00.175+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:00.276 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:00.276+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:00.314 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:00.314 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:03:00.315 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2023-09-30T17:03:00.315 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:00.324 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:03:00.378 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:00.377+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:00.393 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:03:00.413 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:03:00.413 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-09-30T17:03:00.413 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-09-30T17:03:00.413 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:03:00.416 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:03:00.417 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:03:00.451 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:00.451 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:00.461 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:03:00.504 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:00.503+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:00.580 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:00.580+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:00.587 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:00.587 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:00.597 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:03:00.681 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:00.681+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:00.743 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:00.743 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:00.754 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:03:00.784 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T17:03:00.796 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:00.795+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:00.884 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:00.883+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:00.893 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off 2023-09-30T17:03:00.928 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:00.928 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:00.938 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:03:00.984 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:00.983+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:01.070 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:01.070 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:01.080 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:03:01.085 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:01.084+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:01.185 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:01.185+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:01.210 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:01.210 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:01.222 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:03:01.287 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:01.286+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:01.293 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-09-30T17:03:01.349 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:01.349 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:01.359 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:03:01.387 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:01.387+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:01.486 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:01.486 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:01.488 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:01.488+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:01.496 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:03:01.590 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:01.589+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:01.636 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:01.637 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:01.647 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:03:01.691 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:01.691+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:01.791 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:01.791+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:01.818 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:01.818 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:01.830 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:03:01.892 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:01.891+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:01.993 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:01.993+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:02.001 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:02.001 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:02.012 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:03:02.094 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:02.093+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:02.141 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:02.141 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:02.151 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:03:02.195 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:02.195+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:02.283 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is set 2023-09-30T17:03:02.335 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:02.336 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:02.336 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:03:02.336 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:02.334+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:02.417 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-09-30T17:03:02.435 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:02.435+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:02.503 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:02.503 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:02.513 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:03:02.536 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:02.536+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:02.637 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:02.637+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:02.651 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:03:02.654 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:02.654 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:03:02.655 INFO:teuthology.orchestra.run.smithi031.stdout: "num_ops": 0 2023-09-30T17:03:02.655 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:02.665 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:03:02.688 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:03:02.688 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-09-30T17:03:02.689 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-09-30T17:03:02.689 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:03:02.692 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:03:02.693 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:03:02.738 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:02.738+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:02.796 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:02.796 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:03:02.796 INFO:teuthology.orchestra.run.smithi031.stdout: "complaint_time": 30, 2023-09-30T17:03:02.796 INFO:teuthology.orchestra.run.smithi031.stdout: "num_blocked_ops": 0 2023-09-30T17:03:02.796 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:02.806 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:03:02.839 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:02.839+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:02.940 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:02.940 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 20, 2023-09-30T17:03:02.940 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 600, 2023-09-30T17:03:02.940 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:03:02.941 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.941 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:32 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'18, mlcod=11'14)", 2023-09-30T17:03:02.941 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:03:02.941 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 55.577464562999999, 2023-09-30T17:03:02.941 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051629809999999996, 2023-09-30T17:03:02.941 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:02.941 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:02.941 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:02.941 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.941 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:02.942 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:03:02.942 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:02.942 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.942 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.942 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:02.942 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:03:02.942 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:02.942 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.942 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.943 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:02.943 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:03:02.943 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2099999999999996e-07 2023-09-30T17:03:02.943 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.943 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.943 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:02.943 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361407+0000", 2023-09-30T17:03:02.943 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7499e-05 2023-09-30T17:03:02.943 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.943 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.944 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:02.944 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361418+0000", 2023-09-30T17:03:02.944 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1127999999999999e-05 2023-09-30T17:03:02.944 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.944 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.944 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:02.944 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361423+0000", 2023-09-30T17:03:02.944 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1930000000000001e-06 2023-09-30T17:03:02.944 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.944 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.945 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:02.945 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361476+0000", 2023-09-30T17:03:02.945 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3399000000000002e-05 2023-09-30T17:03:02.945 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.945 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.945 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:02.945 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361496+0000", 2023-09-30T17:03:02.945 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9638000000000001e-05 2023-09-30T17:03:02.945 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.945 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.946 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:02.946 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.366474+0000", 2023-09-30T17:03:02.946 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0049778829999999998 2023-09-30T17:03:02.946 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.946 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.946 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:02.946 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.366512+0000", 2023-09-30T17:03:02.946 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7620000000000002e-05 2023-09-30T17:03:02.946 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:02.947 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:02.947 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:02.947 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.947 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.947 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:37 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'23, mlcod=11'15)", 2023-09-30T17:03:02.947 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:03:02.947 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 55.574862566, 2023-09-30T17:03:02.947 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053985689999999998, 2023-09-30T17:03:02.947 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:02.948 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:02.948 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:02.948 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.948 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:02.948 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:03:02.948 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:02.948 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.948 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.948 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:02.948 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:03:02.949 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:02.949 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.949 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.949 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:02.949 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:03:02.949 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4400000000000001e-07 2023-09-30T17:03:02.949 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.949 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.949 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:02.949 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363956+0000", 2023-09-30T17:03:02.950 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.921e-06 2023-09-30T17:03:02.950 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.950 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.950 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:02.950 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363966+0000", 2023-09-30T17:03:02.950 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0351e-05 2023-09-30T17:03:02.950 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.950 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.950 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:02.950 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363971+0000", 2023-09-30T17:03:02.951 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.023e-06 2023-09-30T17:03:02.951 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.951 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.951 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:02.951 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.364013+0000", 2023-09-30T17:03:02.951 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1575000000000001e-05 2023-09-30T17:03:02.951 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.951 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.951 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:02.951 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.364026+0000", 2023-09-30T17:03:02.952 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3044000000000001e-05 2023-09-30T17:03:02.952 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.952 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.952 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:02.952 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.369308+0000", 2023-09-30T17:03:02.952 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005282152 2023-09-30T17:03:02.952 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.952 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.952 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:02.952 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.369349+0000", 2023-09-30T17:03:02.953 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1059000000000001e-05 2023-09-30T17:03:02.953 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:02.953 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:02.953 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:02.953 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.953 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.953 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:155 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'109, mlcod=11'105)", 2023-09-30T17:03:02.953 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:03:02.953 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 55.093166879999998, 2023-09-30T17:03:02.953 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053867639999999996, 2023-09-30T17:03:02.954 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:02.954 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:02.954 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:02.954 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.954 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:02.954 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:03:02.954 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:02.954 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.954 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.954 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:02.955 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:03:02.955 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:02.955 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.955 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.955 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:02.955 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845647+0000", 2023-09-30T17:03:02.955 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7599999999999997e-07 2023-09-30T17:03:02.955 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.955 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.955 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:02.956 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845699+0000", 2023-09-30T17:03:02.956 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1758000000000001e-05 2023-09-30T17:03:02.956 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.956 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.956 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:02.956 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845708+0000", 2023-09-30T17:03:02.956 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2159999999999995e-06 2023-09-30T17:03:02.956 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.956 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.956 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:02.957 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845712+0000", 2023-09-30T17:03:02.957 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2579999999999997e-06 2023-09-30T17:03:02.957 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.957 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.957 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:02.957 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845756+0000", 2023-09-30T17:03:02.957 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4119999999999998e-05 2023-09-30T17:03:02.957 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.957 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.957 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:02.958 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845779+0000", 2023-09-30T17:03:02.958 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2311e-05 2023-09-30T17:03:02.958 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.958 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.958 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:02.958 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.850982+0000", 2023-09-30T17:03:02.958 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005203053 2023-09-30T17:03:02.958 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.958 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.958 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:02.959 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851033+0000", 2023-09-30T17:03:02.959 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1471999999999998e-05 2023-09-30T17:03:02.959 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:02.959 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:02.959 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:02.959 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.959 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.959 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:156 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'110, mlcod=11'105)", 2023-09-30T17:03:02.959 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:03:02.959 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 55.092633954, 2023-09-30T17:03:02.960 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0052834759999999996, 2023-09-30T17:03:02.960 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:02.960 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:02.960 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:02.960 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.960 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:02.960 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:03:02.960 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:02.960 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.960 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.961 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:02.961 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:03:02.961 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:02.961 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.961 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.961 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:02.961 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846180+0000", 2023-09-30T17:03:02.961 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6300000000000005e-07 2023-09-30T17:03:02.961 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.961 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.962 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:02.962 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846184+0000", 2023-09-30T17:03:02.962 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3789999999999999e-06 2023-09-30T17:03:02.962 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.962 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.962 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:02.962 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846195+0000", 2023-09-30T17:03:02.962 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0778000000000001e-05 2023-09-30T17:03:02.962 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.963 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.963 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:02.963 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846200+0000", 2023-09-30T17:03:02.963 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1540000000000001e-06 2023-09-30T17:03:02.963 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.963 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.963 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:02.963 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846274+0000", 2023-09-30T17:03:02.963 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4129999999999997e-05 2023-09-30T17:03:02.963 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.964 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.964 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:02.964 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846286+0000", 2023-09-30T17:03:02.964 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1744e-05 2023-09-30T17:03:02.964 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.964 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.964 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:02.964 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851432+0000", 2023-09-30T17:03:02.964 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051462110000000004 2023-09-30T17:03:02.964 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.965 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.965 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:02.965 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851463+0000", 2023-09-30T17:03:02.965 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0516999999999999e-05 2023-09-30T17:03:02.965 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:02.965 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:02.965 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:02.965 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.965 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.965 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:203 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'149, mlcod=11'145)", 2023-09-30T17:03:02.966 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:03:02.966 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 54.736598045000001, 2023-09-30T17:03:02.966 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051867459999999999, 2023-09-30T17:03:02.966 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:02.966 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:02.966 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:02.966 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.966 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:02.966 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:03:02.967 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:02.967 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.967 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.967 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:02.967 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:03:02.967 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:02.967 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.967 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.967 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:02.967 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202216+0000", 2023-09-30T17:03:02.968 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7e-07 2023-09-30T17:03:02.968 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.968 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.968 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:02.968 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202271+0000", 2023-09-30T17:03:02.968 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5163e-05 2023-09-30T17:03:02.968 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.968 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.968 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:02.968 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202282+0000", 2023-09-30T17:03:02.969 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1319e-05 2023-09-30T17:03:02.969 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.969 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.969 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:02.969 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202288+0000", 2023-09-30T17:03:02.969 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2899999999999999e-06 2023-09-30T17:03:02.969 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.969 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.969 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:02.969 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202331+0000", 2023-09-30T17:03:02.970 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2147999999999997e-05 2023-09-30T17:03:02.970 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.970 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.970 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:02.970 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202348+0000", 2023-09-30T17:03:02.970 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7317e-05 2023-09-30T17:03:02.970 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.970 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.970 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:02.971 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.207357+0000", 2023-09-30T17:03:02.971 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0050095440000000003 2023-09-30T17:03:02.971 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.971 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.971 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:02.971 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.207402+0000", 2023-09-30T17:03:02.971 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4495e-05 2023-09-30T17:03:02.971 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:02.971 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:02.971 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:02.972 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.972 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.972 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:02.972 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:03:02.972 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 44.587267756999999, 2023-09-30T17:03:02.972 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.025313649000000001, 2023-09-30T17:03:02.972 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:02.972 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:02.972 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:02.972 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.973 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:02.973 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:03:02.973 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:02.973 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.973 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.973 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:02.973 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:03:02.973 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:02.973 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.973 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.974 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:02.974 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351551+0000", 2023-09-30T17:03:02.974 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3380000000000004e-06 2023-09-30T17:03:02.974 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.974 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.974 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:02.974 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351559+0000", 2023-09-30T17:03:02.974 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9589999999999995e-06 2023-09-30T17:03:02.974 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.975 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.975 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:02.975 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351571+0000", 2023-09-30T17:03:02.975 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2065999999999999e-05 2023-09-30T17:03:02.975 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.975 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.975 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:02.975 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351706+0000", 2023-09-30T17:03:02.975 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00013553799999999999 2023-09-30T17:03:02.975 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.976 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.976 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:02.976 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353016+0000", 2023-09-30T17:03:02.976 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0013099209999999999 2023-09-30T17:03:02.976 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.976 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.976 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:02.976 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353023+0000", 2023-09-30T17:03:02.976 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2479999999999999e-06 2023-09-30T17:03:02.976 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.977 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.977 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:02.977 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360348+0000", 2023-09-30T17:03:02.977 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0073248949999999997 2023-09-30T17:03:02.977 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.977 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.977 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:02.977 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360787+0000", 2023-09-30T17:03:02.977 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00043875199999999999 2023-09-30T17:03:02.977 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.978 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.978 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:02.978 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360892+0000", 2023-09-30T17:03:02.978 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010508199999999999 2023-09-30T17:03:02.978 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.978 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.978 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:02.978 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365132+0000", 2023-09-30T17:03:02.978 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0042396480000000004 2023-09-30T17:03:02.979 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.979 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.979 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:02.979 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376746+0000", 2023-09-30T17:03:02.979 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011614157 2023-09-30T17:03:02.979 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.979 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.979 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:02.979 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376811+0000", 2023-09-30T17:03:02.979 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5005999999999994e-05 2023-09-30T17:03:02.980 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.980 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.980 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:02.980 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376859+0000", 2023-09-30T17:03:02.980 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8038999999999999e-05 2023-09-30T17:03:02.980 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:02.980 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:02.980 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:02.980 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.981 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.981 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:02.981 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:03:02.981 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 44.586769957999998, 2023-09-30T17:03:02.981 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024923989000000001, 2023-09-30T17:03:02.981 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:02.981 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:02.981 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:02.981 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.981 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:02.982 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:03:02.982 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:02.982 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.982 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.982 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:02.982 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:03:02.982 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:02.982 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.982 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.982 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:02.983 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352044+0000", 2023-09-30T17:03:02.983 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9199999999999999e-07 2023-09-30T17:03:02.983 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.983 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.983 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:02.983 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352050+0000", 2023-09-30T17:03:02.983 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8880000000000002e-06 2023-09-30T17:03:02.983 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.983 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.984 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:02.984 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352143+0000", 2023-09-30T17:03:02.984 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2721999999999998e-05 2023-09-30T17:03:02.984 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.984 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.984 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:02.984 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352155+0000", 2023-09-30T17:03:02.984 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2279000000000001e-05 2023-09-30T17:03:02.984 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.984 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.985 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:02.985 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353114+0000", 2023-09-30T17:03:02.985 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00095943700000000005 2023-09-30T17:03:02.985 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.985 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.985 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:02.985 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353121+0000", 2023-09-30T17:03:02.985 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.494e-06 2023-09-30T17:03:02.985 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.986 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.986 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:02.986 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361491+0000", 2023-09-30T17:03:02.986 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0083697359999999991 2023-09-30T17:03:02.986 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.986 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.986 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:02.986 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361573+0000", 2023-09-30T17:03:02.986 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2822000000000001e-05 2023-09-30T17:03:02.986 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.987 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.987 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:02.987 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362166+0000", 2023-09-30T17:03:02.987 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00059223299999999995 2023-09-30T17:03:02.987 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.987 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.987 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:02.987 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365209+0000", 2023-09-30T17:03:02.987 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.003043212 2023-09-30T17:03:02.987 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.988 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.988 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:02.988 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376910+0000", 2023-09-30T17:03:02.988 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011700898 2023-09-30T17:03:02.988 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.988 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.988 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:02.988 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376945+0000", 2023-09-30T17:03:02.988 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4795000000000001e-05 2023-09-30T17:03:02.988 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.989 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.989 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:02.989 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376967+0000", 2023-09-30T17:03:02.989 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2580999999999999e-05 2023-09-30T17:03:02.989 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:02.989 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:02.989 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:02.989 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.989 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.990 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:02.990 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:03:02.990 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 44.586600038, 2023-09-30T17:03:02.990 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023120405, 2023-09-30T17:03:02.990 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:02.990 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:02.990 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:02.990 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.990 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:02.990 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:03:02.991 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:02.991 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.991 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.991 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:02.991 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:03:02.991 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:02.991 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.991 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.991 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:02.992 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352214+0000", 2023-09-30T17:03:02.992 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8400000000000003e-07 2023-09-30T17:03:02.992 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.992 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.992 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:02.992 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352233+0000", 2023-09-30T17:03:02.992 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8946000000000001e-05 2023-09-30T17:03:02.992 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.992 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.992 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:02.993 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352297+0000", 2023-09-30T17:03:02.993 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3540999999999994e-05 2023-09-30T17:03:02.993 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.993 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.993 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:02.993 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352450+0000", 2023-09-30T17:03:02.993 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015364799999999999 2023-09-30T17:03:02.993 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.993 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.993 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:02.994 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353098+0000", 2023-09-30T17:03:02.994 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00064820299999999997 2023-09-30T17:03:02.994 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.994 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.994 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:02.994 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353103+0000", 2023-09-30T17:03:02.994 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0529999999999997e-06 2023-09-30T17:03:02.994 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.994 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.994 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:02.995 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.358558+0000", 2023-09-30T17:03:02.995 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0054550249999999996 2023-09-30T17:03:02.995 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.995 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.995 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:02.995 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.358741+0000", 2023-09-30T17:03:02.995 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00018210200000000001 2023-09-30T17:03:02.995 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.995 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.995 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:02.996 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.359683+0000", 2023-09-30T17:03:02.996 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00094202299999999995 2023-09-30T17:03:02.996 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.996 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.996 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:02.996 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365044+0000", 2023-09-30T17:03:02.996 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053616219999999999 2023-09-30T17:03:02.996 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.996 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.996 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:02.997 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375256+0000", 2023-09-30T17:03:02.997 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010212156 2023-09-30T17:03:02.997 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.997 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.997 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:02.997 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375300+0000", 2023-09-30T17:03:02.997 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3961999999999997e-05 2023-09-30T17:03:02.997 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.997 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.997 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:02.998 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375334+0000", 2023-09-30T17:03:02.998 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.324e-05 2023-09-30T17:03:02.998 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:02.998 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:02.998 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:02.998 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:02.998 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.998 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:02.998 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:03:02.999 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 44.586285019999998, 2023-09-30T17:03:02.999 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024240660000000001, 2023-09-30T17:03:02.999 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:02.999 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:02.999 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:02.999 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:02.999 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:02.999 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:03:02.999 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:02.999 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.000 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.000 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:03.000 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:03:03.000 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:03.000 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.000 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.000 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:03.000 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352529+0000", 2023-09-30T17:03:03.000 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1379999999999999e-06 2023-09-30T17:03:03.001 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.001 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.001 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:03.001 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352536+0000", 2023-09-30T17:03:03.001 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3489999999999997e-06 2023-09-30T17:03:03.001 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.001 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.001 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:03.001 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352547+0000", 2023-09-30T17:03:03.001 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1109e-05 2023-09-30T17:03:03.001 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.002 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.002 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:03.002 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352560+0000", 2023-09-30T17:03:03.002 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3046e-05 2023-09-30T17:03:03.002 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.002 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.002 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:03.002 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353142+0000", 2023-09-30T17:03:03.002 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00058174699999999997 2023-09-30T17:03:03.003 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.003 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.003 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:03.003 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353147+0000", 2023-09-30T17:03:03.003 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5840000000000002e-06 2023-09-30T17:03:03.003 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.003 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.003 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:03.003 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360374+0000", 2023-09-30T17:03:03.003 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0072270049999999999 2023-09-30T17:03:03.004 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.004 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.004 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:03.004 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360795+0000", 2023-09-30T17:03:03.004 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00042088999999999999 2023-09-30T17:03:03.004 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.004 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.004 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:03.004 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360967+0000", 2023-09-30T17:03:03.004 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017235699999999999 2023-09-30T17:03:03.005 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.005 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.005 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:03.005 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365051+0000", 2023-09-30T17:03:03.005 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0040837429999999999 2023-09-30T17:03:03.005 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.005 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.005 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:03.005 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376708+0000", 2023-09-30T17:03:03.005 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011656866 2023-09-30T17:03:03.006 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.006 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.006 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:03.006 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376745+0000", 2023-09-30T17:03:03.006 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6769e-05 2023-09-30T17:03:03.006 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.006 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.006 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:03.006 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376769+0000", 2023-09-30T17:03:03.006 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4057e-05 2023-09-30T17:03:03.007 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:03.007 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:03.007 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:03.007 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.007 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.007 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:03.007 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:03.007 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 44.586025665000001, 2023-09-30T17:03:03.007 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023472704, 2023-09-30T17:03:03.008 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:03.008 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:03.008 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:03.008 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.008 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:03.008 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:03.008 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:03.008 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.008 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.008 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:03.009 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:03.009 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:03.009 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.009 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.009 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:03.009 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:03.009 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8000000000000005e-07 2023-09-30T17:03:03.009 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.009 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.009 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:03.010 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352794+0000", 2023-09-30T17:03:03.010 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.789e-06 2023-09-30T17:03:03.010 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.010 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.010 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:03.010 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352805+0000", 2023-09-30T17:03:03.010 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0848e-05 2023-09-30T17:03:03.010 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.010 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.011 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:03.011 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352812+0000", 2023-09-30T17:03:03.011 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4449999999999999e-06 2023-09-30T17:03:03.011 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.011 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.011 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:03.011 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353063+0000", 2023-09-30T17:03:03.011 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00025046299999999998 2023-09-30T17:03:03.011 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.011 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.012 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:03.012 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353071+0000", 2023-09-30T17:03:03.012 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6739999999999997e-06 2023-09-30T17:03:03.012 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.012 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.012 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:03.012 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361696+0000", 2023-09-30T17:03:03.012 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0086251609999999992 2023-09-30T17:03:03.012 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.012 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.013 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:03.013 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362284+0000", 2023-09-30T17:03:03.013 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00058872299999999998 2023-09-30T17:03:03.013 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.013 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.013 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:03.013 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362429+0000", 2023-09-30T17:03:03.013 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014509000000000001 2023-09-30T17:03:03.013 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.013 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.013 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:03.014 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365330+0000", 2023-09-30T17:03:03.014 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0029005419999999999 2023-09-30T17:03:03.014 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.014 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.014 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:03.014 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376196+0000", 2023-09-30T17:03:03.014 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.01086615 2023-09-30T17:03:03.014 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.014 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.014 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:03.015 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376230+0000", 2023-09-30T17:03:03.015 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3858e-05 2023-09-30T17:03:03.015 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.015 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.015 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:03.015 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376260+0000", 2023-09-30T17:03:03.015 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0181000000000001e-05 2023-09-30T17:03:03.015 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:03.015 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:03.016 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:03.016 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.016 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.016 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:03.016 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:03:03.016 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 44.585792095000002, 2023-09-30T17:03:03.016 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023406132999999999, 2023-09-30T17:03:03.016 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:03.016 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:03.016 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:03.017 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.017 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:03.017 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:03:03.017 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:03.017 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.017 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.017 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:03.017 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:03:03.017 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:03.017 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.018 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.018 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:03.018 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353022+0000", 2023-09-30T17:03:03.018 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.78e-07 2023-09-30T17:03:03.018 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.018 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.018 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:03.018 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353027+0000", 2023-09-30T17:03:03.018 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9089999999999999e-06 2023-09-30T17:03:03.018 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.019 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.019 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:03.019 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353035+0000", 2023-09-30T17:03:03.019 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0430000000000008e-06 2023-09-30T17:03:03.019 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.019 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.019 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:03.019 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353047+0000", 2023-09-30T17:03:03.019 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1674e-05 2023-09-30T17:03:03.019 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.020 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.020 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:03.020 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353105+0000", 2023-09-30T17:03:03.020 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8891999999999998e-05 2023-09-30T17:03:03.020 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.020 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.020 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:03.020 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353112+0000", 2023-09-30T17:03:03.020 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7059999999999998e-06 2023-09-30T17:03:03.021 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.021 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.021 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:03.021 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362733+0000", 2023-09-30T17:03:03.021 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0096205869999999999 2023-09-30T17:03:03.021 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.021 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.021 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:03.021 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362833+0000", 2023-09-30T17:03:03.021 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000100227 2023-09-30T17:03:03.022 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.022 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.022 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:03.022 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363000+0000", 2023-09-30T17:03:03.022 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016670899999999999 2023-09-30T17:03:03.022 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.022 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.022 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:03.022 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365550+0000", 2023-09-30T17:03:03.022 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0025499199999999998 2023-09-30T17:03:03.023 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.023 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.023 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:03.023 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376315+0000", 2023-09-30T17:03:03.023 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010765011999999999 2023-09-30T17:03:03.023 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.023 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.023 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:03.023 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376386+0000", 2023-09-30T17:03:03.023 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0866999999999998e-05 2023-09-30T17:03:03.024 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.024 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.024 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:03.024 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376427+0000", 2023-09-30T17:03:03.024 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1709000000000003e-05 2023-09-30T17:03:03.024 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:03.024 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:03.024 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:03.024 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.024 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.025 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:03.025 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:03.025 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 44.585751459000001, 2023-09-30T17:03:03.025 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024076238, 2023-09-30T17:03:03.025 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:03.025 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:03.025 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:03.025 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.025 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:03.026 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:03.026 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:03.026 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.026 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.026 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:03.026 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:03.026 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:03.026 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.026 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.027 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:03.027 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:03.027 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8699999999999995e-07 2023-09-30T17:03:03.027 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.027 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.027 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:03.027 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353067+0000", 2023-09-30T17:03:03.027 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.605e-06 2023-09-30T17:03:03.027 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.027 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.028 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:03.028 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353073+0000", 2023-09-30T17:03:03.028 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8900000000000004e-06 2023-09-30T17:03:03.028 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.028 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.028 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:03.028 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353083+0000", 2023-09-30T17:03:03.028 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0200000000000001e-05 2023-09-30T17:03:03.028 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.029 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.029 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:03.029 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353186+0000", 2023-09-30T17:03:03.029 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010256599999999999 2023-09-30T17:03:03.029 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.029 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.029 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:03.029 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353190+0000", 2023-09-30T17:03:03.029 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9709999999999998e-06 2023-09-30T17:03:03.029 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.030 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.030 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:03.030 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362946+0000", 2023-09-30T17:03:03.030 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0097563330000000007 2023-09-30T17:03:03.030 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.030 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.030 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:03.030 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363088+0000", 2023-09-30T17:03:03.030 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014259200000000001 2023-09-30T17:03:03.031 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.031 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.031 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:03.031 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363555+0000", 2023-09-30T17:03:03.031 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00046627799999999998 2023-09-30T17:03:03.031 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.031 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.031 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:03.031 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365871+0000", 2023-09-30T17:03:03.031 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0023167589999999998 2023-09-30T17:03:03.032 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.032 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.032 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:03.032 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377033+0000", 2023-09-30T17:03:03.032 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011161203999999999 2023-09-30T17:03:03.032 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.032 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.032 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:03.032 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377100+0000", 2023-09-30T17:03:03.032 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7230999999999994e-05 2023-09-30T17:03:03.033 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.033 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.033 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:03.033 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377138+0000", 2023-09-30T17:03:03.033 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8022000000000003e-05 2023-09-30T17:03:03.033 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:03.033 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:03.033 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:03.033 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.034 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.034 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:03.034 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:03:03.034 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 44.585650510000001, 2023-09-30T17:03:03.034 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.020304412000000001, 2023-09-30T17:03:03.034 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:03.034 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:03.034 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:03.034 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.034 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:03.035 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:03:03.035 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:03.035 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.035 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.035 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:03.035 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:03:03.035 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:03.035 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.035 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.035 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:03.036 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353164+0000", 2023-09-30T17:03:03.036 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7100000000000011e-07 2023-09-30T17:03:03.036 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.036 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.036 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:03.036 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353168+0000", 2023-09-30T17:03:03.036 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0600000000000001e-06 2023-09-30T17:03:03.036 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.036 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.036 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:03.037 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353177+0000", 2023-09-30T17:03:03.037 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1409999999999994e-06 2023-09-30T17:03:03.037 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.037 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.037 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:03.037 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353185+0000", 2023-09-30T17:03:03.037 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2479999999999996e-06 2023-09-30T17:03:03.037 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.037 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.037 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:03.038 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353246+0000", 2023-09-30T17:03:03.038 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0519000000000001e-05 2023-09-30T17:03:03.038 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.038 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.038 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:03.038 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353252+0000", 2023-09-30T17:03:03.038 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7859999999999999e-06 2023-09-30T17:03:03.038 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.039 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.039 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:03.039 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354979+0000", 2023-09-30T17:03:03.039 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0017270090000000001 2023-09-30T17:03:03.039 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.039 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.039 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:03.039 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355097+0000", 2023-09-30T17:03:03.039 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000117472 2023-09-30T17:03:03.039 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.040 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.040 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:03.040 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.373467+0000", 2023-09-30T17:03:03.040 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.018370206 2023-09-30T17:03:03.040 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:03.040 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:03.040 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:03.040 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.040 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.041 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:03.041 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:03:03.041 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 44.585609771999998, 2023-09-30T17:03:03.041 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.012725089, 2023-09-30T17:03:03.041 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:03.041 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:03.041 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:03.041 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.041 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:03.041 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:03:03.042 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:03.042 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.042 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.042 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:03.042 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:03:03.042 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:03.042 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.042 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.042 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:03.043 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353204+0000", 2023-09-30T17:03:03.043 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7100000000000002e-07 2023-09-30T17:03:03.043 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.043 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.043 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:03.043 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353213+0000", 2023-09-30T17:03:03.043 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8580000000000006e-06 2023-09-30T17:03:03.043 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.043 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.043 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:03.043 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353219+0000", 2023-09-30T17:03:03.044 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8939999999999998e-06 2023-09-30T17:03:03.044 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.044 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.044 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:03.044 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353223+0000", 2023-09-30T17:03:03.044 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.357e-06 2023-09-30T17:03:03.044 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.044 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.044 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:03.044 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353278+0000", 2023-09-30T17:03:03.045 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5228e-05 2023-09-30T17:03:03.045 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.045 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.045 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:03.045 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353284+0000", 2023-09-30T17:03:03.045 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8209999999999998e-06 2023-09-30T17:03:03.045 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.045 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.045 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:03.046 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355095+0000", 2023-09-30T17:03:03.046 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001811404 2023-09-30T17:03:03.046 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.046 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.046 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:03.046 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355256+0000", 2023-09-30T17:03:03.046 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000160898 2023-09-30T17:03:03.046 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.046 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.046 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:03.047 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365928+0000", 2023-09-30T17:03:03.047 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010672157999999999 2023-09-30T17:03:03.047 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:03.047 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:03.047 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:03.047 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.047 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.047 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-09-30T17:03:03.048 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:03:03.048 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 44.585078565000003, 2023-09-30T17:03:03.048 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0056863460000000001, 2023-09-30T17:03:03.048 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:03.048 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "reached pg", 2023-09-30T17:03:03.048 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:03.048 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.048 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:03.048 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:03:03.049 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:03.049 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.049 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.049 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:03.049 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:03:03.049 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:03.049 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.049 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.049 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:03.049 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:03:03.050 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5700000000000002e-07 2023-09-30T17:03:03.050 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.050 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.050 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:03.050 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353747+0000", 2023-09-30T17:03:03.050 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1899000000000001e-05 2023-09-30T17:03:03.050 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.050 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.050 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:03.051 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353776+0000", 2023-09-30T17:03:03.051 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.8767000000000001e-05 2023-09-30T17:03:03.051 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.051 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.053 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:03.053 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353792+0000", 2023-09-30T17:03:03.053 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5914999999999999e-05 2023-09-30T17:03:03.053 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.053 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.053 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:03.053 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353900+0000", 2023-09-30T17:03:03.054 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010774500000000001 2023-09-30T17:03:03.054 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.054 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.054 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:03.054 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.359421+0000", 2023-09-30T17:03:03.054 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0055213629999999996 2023-09-30T17:03:03.054 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:03.054 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:03.054 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:03.054 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.055 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.055 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:03:03.055 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:03:03.055 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 44.584406964999999, 2023-09-30T17:03:03.055 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0069196370000000002, 2023-09-30T17:03:03.055 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:03.055 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:03.055 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:03.055 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.055 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:03.056 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:03:03.056 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:03.056 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.056 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.056 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:03.056 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:03:03.056 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:03.056 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.056 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.056 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:03.057 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354407+0000", 2023-09-30T17:03:03.057 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7400000000000002e-07 2023-09-30T17:03:03.057 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.057 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.057 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:03.057 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354414+0000", 2023-09-30T17:03:03.057 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1040000000000001e-06 2023-09-30T17:03:03.057 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.057 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.057 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:03.058 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354425+0000", 2023-09-30T17:03:03.058 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1090000000000001e-05 2023-09-30T17:03:03.058 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.058 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.058 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:03.058 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354435+0000", 2023-09-30T17:03:03.058 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8169999999999994e-06 2023-09-30T17:03:03.058 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.058 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.058 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:03.059 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355741+0000", 2023-09-30T17:03:03.059 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0013063160000000001 2023-09-30T17:03:03.059 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.059 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.059 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:03.059 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355763+0000", 2023-09-30T17:03:03.059 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1688e-05 2023-09-30T17:03:03.059 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.059 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.059 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:03.059 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361289+0000", 2023-09-30T17:03:03.060 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0055258269999999996 2023-09-30T17:03:03.060 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.060 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.060 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:03.060 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361326+0000", 2023-09-30T17:03:03.060 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7020999999999997e-05 2023-09-30T17:03:03.060 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:03.060 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:03.060 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:03.061 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.061 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.061 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:30 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2023-09-30T17:03:03.061 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:03:03.061 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 44.583033006999997, 2023-09-30T17:03:03.061 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0069996629999999997, 2023-09-30T17:03:03.061 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:03.061 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:03.061 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:03.062 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.062 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:03.062 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:03:03.062 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:03.062 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.062 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.062 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:03.062 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:03:03.062 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:03.062 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.063 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.063 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:03.063 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355781+0000", 2023-09-30T17:03:03.063 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9599999999999999e-07 2023-09-30T17:03:03.063 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.063 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.063 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:03.063 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355788+0000", 2023-09-30T17:03:03.063 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8129999999999996e-06 2023-09-30T17:03:03.063 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.064 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.064 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:03.064 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355798+0000", 2023-09-30T17:03:03.064 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2909999999999996e-06 2023-09-30T17:03:03.064 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.064 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.064 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:03.064 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355807+0000", 2023-09-30T17:03:03.064 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8619999999999992e-06 2023-09-30T17:03:03.064 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.065 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.065 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:03.065 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.357264+0000", 2023-09-30T17:03:03.065 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0014578289999999999 2023-09-30T17:03:03.065 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.065 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.065 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:03.065 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.357916+0000", 2023-09-30T17:03:03.065 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00065170500000000004 2023-09-30T17:03:03.065 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.066 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.066 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:03.066 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362731+0000", 2023-09-30T17:03:03.066 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0048149849999999999 2023-09-30T17:03:03.066 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.066 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.066 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:03.066 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362780+0000", 2023-09-30T17:03:03.066 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8681999999999999e-05 2023-09-30T17:03:03.067 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:03.067 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:03.067 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:03.067 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.067 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.067 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2023-09-30T17:03:03.067 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:03:03.067 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 44.564381955999998, 2023-09-30T17:03:03.067 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005905998, 2023-09-30T17:03:03.067 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:03.068 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:03.068 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:03.068 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.068 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:03.068 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:03:03.068 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:03.068 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.068 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.068 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:03.068 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:03:03.069 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:03.069 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.069 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.069 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:03.069 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:03:03.069 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1e-07 2023-09-30T17:03:03.069 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.069 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.069 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:03.069 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374455+0000", 2023-09-30T17:03:03.070 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.3091999999999998e-05 2023-09-30T17:03:03.070 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.070 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.070 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:03.070 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374462+0000", 2023-09-30T17:03:03.070 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5170000000000002e-06 2023-09-30T17:03:03.070 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.070 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.070 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:03.070 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374469+0000", 2023-09-30T17:03:03.071 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8199999999999999e-06 2023-09-30T17:03:03.071 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.071 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.071 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:03.071 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374550+0000", 2023-09-30T17:03:03.071 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0978999999999998e-05 2023-09-30T17:03:03.071 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.071 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.071 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:03.071 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374562+0000", 2023-09-30T17:03:03.072 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2472e-05 2023-09-30T17:03:03.072 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.072 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.072 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:03.072 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380293+0000", 2023-09-30T17:03:03.072 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0057310379999999999 2023-09-30T17:03:03.072 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.072 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.072 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:03.072 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380337+0000", 2023-09-30T17:03:03.073 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3869999999999998e-05 2023-09-30T17:03:03.073 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:03.073 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:03.073 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:03.073 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.073 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.073 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2023-09-30T17:03:03.073 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:03:03.073 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 44.564195206999997, 2023-09-30T17:03:03.073 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0057590560000000002, 2023-09-30T17:03:03.074 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:03.074 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:03.074 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:03.074 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.074 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:03.074 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:03:03.074 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:03.074 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.074 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.074 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:03.075 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:03:03.075 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:03.075 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.075 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.075 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:03.075 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:03:03.075 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4900000000000001e-07 2023-09-30T17:03:03.075 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.075 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.075 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:03.076 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374629+0000", 2023-09-30T17:03:03.076 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1014e-05 2023-09-30T17:03:03.076 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.076 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.076 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:03.076 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374636+0000", 2023-09-30T17:03:03.076 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5889999999999999e-06 2023-09-30T17:03:03.076 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.076 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.076 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:03.077 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374642+0000", 2023-09-30T17:03:03.077 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.48e-06 2023-09-30T17:03:03.077 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.077 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.077 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:03.077 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374681+0000", 2023-09-30T17:03:03.077 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9320000000000003e-05 2023-09-30T17:03:03.077 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.077 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.077 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:03.077 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374694+0000", 2023-09-30T17:03:03.078 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3351e-05 2023-09-30T17:03:03.078 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.078 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.078 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:03.078 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380319+0000", 2023-09-30T17:03:03.078 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0056243880000000001 2023-09-30T17:03:03.078 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.078 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.078 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:03.078 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380377+0000", 2023-09-30T17:03:03.079 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8464999999999997e-05 2023-09-30T17:03:03.079 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:03.079 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:03.079 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:03.079 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.079 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.079 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=0'0)", 2023-09-30T17:03:03.079 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:03:03.079 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 44.563484295999999, 2023-09-30T17:03:03.080 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051157370000000004, 2023-09-30T17:03:03.080 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:03.080 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:03.080 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:03.080 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.080 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:03.080 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:03:03.080 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:03.080 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.080 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.081 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:03.081 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:03:03.081 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:03.081 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.081 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.081 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:03.081 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:03:03.081 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0199999999999998e-07 2023-09-30T17:03:03.081 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.081 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.081 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:03.082 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375334+0000", 2023-09-30T17:03:03.082 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8799999999999999e-06 2023-09-30T17:03:03.082 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.082 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.082 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:03.082 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375343+0000", 2023-09-30T17:03:03.082 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5490000000000006e-06 2023-09-30T17:03:03.082 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.082 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.082 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:03.083 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375350+0000", 2023-09-30T17:03:03.083 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5700000000000004e-06 2023-09-30T17:03:03.083 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.083 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.083 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:03.083 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375396+0000", 2023-09-30T17:03:03.083 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5550999999999998e-05 2023-09-30T17:03:03.083 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.083 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.083 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:03.084 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375410+0000", 2023-09-30T17:03:03.084 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4518999999999999e-05 2023-09-30T17:03:03.084 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.084 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.084 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:03.084 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380401+0000", 2023-09-30T17:03:03.084 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0049903430000000004 2023-09-30T17:03:03.084 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:03.084 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:03.084 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:03.085 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380445+0000", 2023-09-30T17:03:03.085 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4023000000000002e-05 2023-09-30T17:03:03.085 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:03.085 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:03.085 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:03.085 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:03.085 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:03.085 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:03.087 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:03:03.087 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:03.086+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:03.187 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:03.187+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:03.217 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:03.217 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:03:03.217 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2023-09-30T17:03:03.217 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:03.227 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:03:03.289 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:03.288+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:03.352 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:03.353 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:03:03.353 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2023-09-30T17:03:03.353 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2023-09-30T17:03:03.353 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:03.362 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:03:03.390 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:03.389+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:03.490 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:03.490+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:03.531 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:03.532 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2023-09-30T17:03:03.532 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2023-09-30T17:03:03.532 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2023-09-30T17:03:03.532 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.532 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:03.532 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:03:03.532 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 45.178370502999996, 2023-09-30T17:03:03.532 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093789779999999996, 2023-09-30T17:03:03.532 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:03.532 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:03.532 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:03.533 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.533 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:03.533 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:03:03.533 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:03.533 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.533 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.533 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:03.533 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:03:03.533 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:03.533 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.533 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.533 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:03.534 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352027+0000", 2023-09-30T17:03:03.534 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0224000000000001e-05 2023-09-30T17:03:03.534 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.534 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.534 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:03.534 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352039+0000", 2023-09-30T17:03:03.534 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1569000000000001e-05 2023-09-30T17:03:03.534 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.534 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.534 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:03.534 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352052+0000", 2023-09-30T17:03:03.535 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2605999999999999e-05 2023-09-30T17:03:03.535 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.535 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.535 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:03.535 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352064+0000", 2023-09-30T17:03:03.535 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2666999999999999e-05 2023-09-30T17:03:03.535 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.535 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.535 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:03.535 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352147+0000", 2023-09-30T17:03:03.535 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3125000000000001e-05 2023-09-30T17:03:03.535 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.536 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.536 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:03.536 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352306+0000", 2023-09-30T17:03:03.536 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015881900000000001 2023-09-30T17:03:03.536 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.536 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.536 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:03.536 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352450+0000", 2023-09-30T17:03:03.536 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014420700000000001 2023-09-30T17:03:03.536 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.536 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.536 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:03.537 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355975+0000", 2023-09-30T17:03:03.537 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003524246 2023-09-30T17:03:03.537 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.537 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.537 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:03.537 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361279+0000", 2023-09-30T17:03:03.537 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005304507 2023-09-30T17:03:03.537 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.537 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.537 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:03.537 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361344+0000", 2023-09-30T17:03:03.537 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4548999999999995e-05 2023-09-30T17:03:03.538 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.538 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.538 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:03.538 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361396+0000", 2023-09-30T17:03:03.538 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2459e-05 2023-09-30T17:03:03.538 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:03.538 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:03.538 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:03.538 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.538 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.538 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:03.538 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:03:03.539 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 45.178278210999999, 2023-09-30T17:03:03.539 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021233007000000002, 2023-09-30T17:03:03.539 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:03.539 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:03.539 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:03.539 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.539 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:03.539 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:03:03.539 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:03.539 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.539 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.539 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:03.539 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:03:03.540 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:03.540 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.540 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.540 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:03.540 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352110+0000", 2023-09-30T17:03:03.540 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6000000000000002e-07 2023-09-30T17:03:03.540 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.540 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.540 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:03.540 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352117+0000", 2023-09-30T17:03:03.540 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5930000000000002e-06 2023-09-30T17:03:03.540 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.541 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.541 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:03.541 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352126+0000", 2023-09-30T17:03:03.541 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0729999999999994e-06 2023-09-30T17:03:03.541 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.541 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.541 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:03.541 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352136+0000", 2023-09-30T17:03:03.541 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0380000000000001e-05 2023-09-30T17:03:03.541 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.541 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.541 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:03.541 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353279+0000", 2023-09-30T17:03:03.542 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0011424670000000001 2023-09-30T17:03:03.542 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.542 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.542 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:03.542 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353707+0000", 2023-09-30T17:03:03.542 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00042829800000000003 2023-09-30T17:03:03.542 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.542 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.542 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:03.542 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354104+0000", 2023-09-30T17:03:03.542 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00039643399999999998 2023-09-30T17:03:03.543 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.543 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.543 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:03.543 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356925+0000", 2023-09-30T17:03:03.543 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0028210900000000001 2023-09-30T17:03:03.543 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.543 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.543 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:03.543 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373243+0000", 2023-09-30T17:03:03.544 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016318461999999999 2023-09-30T17:03:03.544 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.544 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.544 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:03.544 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373301+0000", 2023-09-30T17:03:03.544 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7435000000000002e-05 2023-09-30T17:03:03.544 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.544 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.544 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:03.544 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373342+0000", 2023-09-30T17:03:03.544 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1915000000000001e-05 2023-09-30T17:03:03.544 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:03.545 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:03.545 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:03.545 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.545 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.545 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:03.545 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:03:03.545 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 45.178235600000001, 2023-09-30T17:03:03.545 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011988331, 2023-09-30T17:03:03.545 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:03.545 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:03.545 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:03.546 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.546 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:03.546 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:03:03.546 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:03.546 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.546 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.546 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:03.546 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:03:03.546 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:03.546 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.547 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.547 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:03.547 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352153+0000", 2023-09-30T17:03:03.547 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0500000000000003e-07 2023-09-30T17:03:03.547 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.547 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.547 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:03.547 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352157+0000", 2023-09-30T17:03:03.547 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9790000000000004e-06 2023-09-30T17:03:03.547 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.547 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.548 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:03.548 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352173+0000", 2023-09-30T17:03:03.548 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6535999999999999e-05 2023-09-30T17:03:03.548 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.548 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.548 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:03.548 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352180+0000", 2023-09-30T17:03:03.548 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7700000000000004e-06 2023-09-30T17:03:03.548 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.548 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.549 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:03.549 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353526+0000", 2023-09-30T17:03:03.549 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0013458330000000001 2023-09-30T17:03:03.549 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.549 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.549 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:03.549 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353648+0000", 2023-09-30T17:03:03.549 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012262899999999999 2023-09-30T17:03:03.549 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.549 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.550 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:03.550 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354141+0000", 2023-09-30T17:03:03.550 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00049222899999999995 2023-09-30T17:03:03.550 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.550 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.550 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:03.550 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356931+0000", 2023-09-30T17:03:03.550 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0027900860000000002 2023-09-30T17:03:03.550 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.550 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.550 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:03.551 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364066+0000", 2023-09-30T17:03:03.551 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071355050000000003 2023-09-30T17:03:03.551 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.551 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.551 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:03.551 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364103+0000", 2023-09-30T17:03:03.551 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6944999999999999e-05 2023-09-30T17:03:03.551 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.551 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.552 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:03.552 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364140+0000", 2023-09-30T17:03:03.552 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7214e-05 2023-09-30T17:03:03.552 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:03.552 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:03.552 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:03.552 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.552 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.552 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:03.552 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:03:03.552 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 45.178196368999998, 2023-09-30T17:03:03.553 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012110921, 2023-09-30T17:03:03.553 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:03.553 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:03.553 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:03.553 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.553 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:03.553 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:03:03.553 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:03.554 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.554 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.554 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:03.554 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:03:03.554 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:03.554 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.554 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.554 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:03.554 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352192+0000", 2023-09-30T17:03:03.555 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7300000000000005e-07 2023-09-30T17:03:03.555 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.555 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.555 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:03.555 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352196+0000", 2023-09-30T17:03:03.555 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2370000000000003e-06 2023-09-30T17:03:03.555 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.555 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.555 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:03.556 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352205+0000", 2023-09-30T17:03:03.556 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6659999999999997e-06 2023-09-30T17:03:03.556 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.556 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.556 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:03.556 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352214+0000", 2023-09-30T17:03:03.556 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8259999999999999e-06 2023-09-30T17:03:03.556 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.556 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.557 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:03.557 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354470+0000", 2023-09-30T17:03:03.557 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022557340000000001 2023-09-30T17:03:03.557 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.557 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.557 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:03.557 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354557+0000", 2023-09-30T17:03:03.557 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6909000000000004e-05 2023-09-30T17:03:03.557 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.557 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.557 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:03.557 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354694+0000", 2023-09-30T17:03:03.558 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013774800000000001 2023-09-30T17:03:03.558 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.558 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.558 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:03.558 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356937+0000", 2023-09-30T17:03:03.558 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022424540000000001 2023-09-30T17:03:03.558 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.558 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.558 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:03.558 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364227+0000", 2023-09-30T17:03:03.558 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072902430000000001 2023-09-30T17:03:03.558 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.559 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.559 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:03.559 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364278+0000", 2023-09-30T17:03:03.559 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1180999999999997e-05 2023-09-30T17:03:03.559 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.559 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.559 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:03.559 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364302+0000", 2023-09-30T17:03:03.559 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4049999999999998e-05 2023-09-30T17:03:03.559 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:03.559 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:03.559 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:03.560 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.560 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.560 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:03.560 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:03.560 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 45.17816303, 2023-09-30T17:03:03.560 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021258651999999999, 2023-09-30T17:03:03.560 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:03.560 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:03.560 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:03.560 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.560 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:03.560 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:03.560 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:03.561 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.561 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.561 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:03.561 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:03.561 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:03.561 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.561 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.561 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:03.561 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:03.561 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6899999999999997e-07 2023-09-30T17:03:03.561 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.561 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.562 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:03.562 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352236+0000", 2023-09-30T17:03:03.562 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0251000000000001e-05 2023-09-30T17:03:03.562 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.562 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.562 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:03.562 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352244+0000", 2023-09-30T17:03:03.562 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0770000000000008e-06 2023-09-30T17:03:03.562 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.562 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.562 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:03.562 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352251+0000", 2023-09-30T17:03:03.563 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4749999999999996e-06 2023-09-30T17:03:03.563 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.563 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.563 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:03.563 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354455+0000", 2023-09-30T17:03:03.563 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022043660000000001 2023-09-30T17:03:03.563 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.563 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.563 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:03.563 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354577+0000", 2023-09-30T17:03:03.563 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000121054 2023-09-30T17:03:03.563 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.564 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.564 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:03.564 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354723+0000", 2023-09-30T17:03:03.564 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014693900000000001 2023-09-30T17:03:03.564 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.564 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.564 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:03.564 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356941+0000", 2023-09-30T17:03:03.564 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002217199 2023-09-30T17:03:03.564 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.564 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.564 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:03.564 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373392+0000", 2023-09-30T17:03:03.565 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016451774999999998 2023-09-30T17:03:03.565 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.565 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.565 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:03.565 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373445+0000", 2023-09-30T17:03:03.565 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.308e-05 2023-09-30T17:03:03.565 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.565 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.565 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:03.565 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373483+0000", 2023-09-30T17:03:03.565 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7766999999999999e-05 2023-09-30T17:03:03.565 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:03.566 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:03.566 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:03.566 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.566 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.566 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:03.566 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:03.566 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 45.178126939000002, 2023-09-30T17:03:03.566 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020903497, 2023-09-30T17:03:03.566 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:03.566 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:03.566 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:03.567 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.567 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:03.567 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:03.567 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:03.567 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.567 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.567 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:03.567 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:03.567 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:03.567 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.567 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.567 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:03.568 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:03.568 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0800000000000004e-07 2023-09-30T17:03:03.568 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.568 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.568 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:03.568 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352266+0000", 2023-09-30T17:03:03.568 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1280000000000001e-06 2023-09-30T17:03:03.568 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.568 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.568 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:03.568 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352273+0000", 2023-09-30T17:03:03.568 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3730000000000004e-06 2023-09-30T17:03:03.568 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.569 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.569 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:03.569 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352279+0000", 2023-09-30T17:03:03.569 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7699999999999998e-06 2023-09-30T17:03:03.569 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.569 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.569 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:03.569 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352334+0000", 2023-09-30T17:03:03.569 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5547999999999997e-05 2023-09-30T17:03:03.569 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.569 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.569 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:03.570 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352435+0000", 2023-09-30T17:03:03.570 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100688 2023-09-30T17:03:03.570 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.570 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.570 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:03.570 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352585+0000", 2023-09-30T17:03:03.570 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000150068 2023-09-30T17:03:03.570 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.570 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.570 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:03.570 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354912+0000", 2023-09-30T17:03:03.570 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0023266770000000001 2023-09-30T17:03:03.571 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.571 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.571 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:03.571 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373066+0000", 2023-09-30T17:03:03.571 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018154474 2023-09-30T17:03:03.571 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.571 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.571 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:03.571 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373122+0000", 2023-09-30T17:03:03.571 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6193000000000002e-05 2023-09-30T17:03:03.571 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.571 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.572 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:03.572 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373164+0000", 2023-09-30T17:03:03.572 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1869999999999997e-05 2023-09-30T17:03:03.572 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:03.572 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:03.572 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:03.572 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.572 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.572 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:03.572 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:03:03.572 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 45.178091262999999, 2023-09-30T17:03:03.572 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021015097999999999, 2023-09-30T17:03:03.573 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:03.573 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:03.573 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:03.573 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.573 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:03.573 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:03:03.573 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:03.573 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.573 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.573 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:03.573 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:03:03.573 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:03.574 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.574 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.574 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:03.574 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352297+0000", 2023-09-30T17:03:03.574 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8299999999999997e-07 2023-09-30T17:03:03.574 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.574 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.574 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:03.574 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352300+0000", 2023-09-30T17:03:03.574 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7460000000000001e-06 2023-09-30T17:03:03.574 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.574 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.575 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:03.575 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352307+0000", 2023-09-30T17:03:03.575 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4959999999999999e-06 2023-09-30T17:03:03.575 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.575 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.575 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:03.575 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352314+0000", 2023-09-30T17:03:03.575 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0190000000000001e-06 2023-09-30T17:03:03.575 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.575 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.575 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:03.575 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354070+0000", 2023-09-30T17:03:03.576 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001755936 2023-09-30T17:03:03.576 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.576 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.576 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:03.576 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354221+0000", 2023-09-30T17:03:03.576 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000150884 2023-09-30T17:03:03.576 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.576 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.576 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:03.576 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373311+0000", 2023-09-30T17:03:03.576 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019090434 2023-09-30T17:03:03.576 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:03.577 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:03.577 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:03.577 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.577 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.577 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:03.577 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:03:03.577 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 45.178062543999999, 2023-09-30T17:03:03.577 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021255174000000002, 2023-09-30T17:03:03.577 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:03.577 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:03.577 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:03.577 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.578 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:03.578 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:03:03.578 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:03.578 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.578 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.578 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:03.578 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:03:03.578 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:03.578 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.579 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.579 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:03.579 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352326+0000", 2023-09-30T17:03:03.579 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3200000000000005e-07 2023-09-30T17:03:03.579 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.579 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.579 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:03.579 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352349+0000", 2023-09-30T17:03:03.579 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3183000000000001e-05 2023-09-30T17:03:03.579 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.579 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.579 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:03.580 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352358+0000", 2023-09-30T17:03:03.580 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5230000000000001e-06 2023-09-30T17:03:03.580 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.580 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.580 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:03.580 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352365+0000", 2023-09-30T17:03:03.580 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3260000000000001e-06 2023-09-30T17:03:03.580 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.580 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.581 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:03.581 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355450+0000", 2023-09-30T17:03:03.581 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0030854049999999998 2023-09-30T17:03:03.581 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.581 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.581 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:03.581 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355583+0000", 2023-09-30T17:03:03.581 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000133189 2023-09-30T17:03:03.581 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.581 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.581 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:03.581 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373580+0000", 2023-09-30T17:03:03.582 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017997016000000001 2023-09-30T17:03:03.582 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:03.582 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:03.582 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:03.582 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.582 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.582 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:03.583 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:03:03.583 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 45.178011120999997, 2023-09-30T17:03:03.583 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010380537, 2023-09-30T17:03:03.583 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:03.583 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:03.583 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:03.583 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.583 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:03.583 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:03:03.583 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:03.583 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.584 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.584 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:03.584 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:03:03.584 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:03.584 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.584 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.584 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:03.584 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:03:03.585 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1500000000000003e-07 2023-09-30T17:03:03.585 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.585 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.585 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:03.585 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352381+0000", 2023-09-30T17:03:03.585 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6330000000000002e-06 2023-09-30T17:03:03.585 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.585 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.585 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:03.586 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352388+0000", 2023-09-30T17:03:03.586 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7229999999999998e-06 2023-09-30T17:03:03.586 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.586 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.586 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:03.586 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352394+0000", 2023-09-30T17:03:03.586 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1789999999999996e-06 2023-09-30T17:03:03.586 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.586 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.587 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:03.587 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353259+0000", 2023-09-30T17:03:03.587 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000865221 2023-09-30T17:03:03.587 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.587 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.587 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:03.587 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353391+0000", 2023-09-30T17:03:03.587 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013217700000000001 2023-09-30T17:03:03.587 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.588 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.588 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:03.588 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362757+0000", 2023-09-30T17:03:03.588 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093657889999999994 2023-09-30T17:03:03.588 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:03.588 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:03.588 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:03.588 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.588 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.588 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-09-30T17:03:03.589 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:03:03.589 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 45.171710828999998, 2023-09-30T17:03:03.589 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0061813579999999996, 2023-09-30T17:03:03.589 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:03.589 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2023-09-30T17:03:03.589 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:03.589 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.589 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:03.589 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:03:03.589 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:03.589 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.589 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.590 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:03.590 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:03:03.590 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:03.590 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.590 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.590 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:03.590 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:03:03.590 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5499999999999999e-07 2023-09-30T17:03:03.590 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.590 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.590 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:03.591 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358686+0000", 2023-09-30T17:03:03.591 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9979999999999992e-06 2023-09-30T17:03:03.591 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.591 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.591 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:03.591 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358700+0000", 2023-09-30T17:03:03.591 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3635000000000001e-05 2023-09-30T17:03:03.591 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.591 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.591 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:03.591 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358714+0000", 2023-09-30T17:03:03.591 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4470999999999999e-05 2023-09-30T17:03:03.592 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.592 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.592 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:03.592 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358767+0000", 2023-09-30T17:03:03.592 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2651999999999997e-05 2023-09-30T17:03:03.592 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.592 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.592 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:03.592 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364858+0000", 2023-09-30T17:03:03.592 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060912470000000002 2023-09-30T17:03:03.592 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:03.593 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:03.593 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:03.593 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.593 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.593 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2023-09-30T17:03:03.593 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:03:03.593 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 45.169345989, 2023-09-30T17:03:03.593 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00036246299999999999, 2023-09-30T17:03:03.593 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:03.593 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:03.593 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:03.593 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.594 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:03.594 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:03:03.594 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:03.594 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.594 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.594 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:03.594 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:03:03.594 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:03.594 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.594 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.594 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:03.594 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:03:03.595 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3099999999999999e-07 2023-09-30T17:03:03.595 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.595 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.595 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:03.595 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361045+0000", 2023-09-30T17:03:03.595 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.49e-06 2023-09-30T17:03:03.595 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.595 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.595 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:03.595 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361056+0000", 2023-09-30T17:03:03.595 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0910000000000001e-05 2023-09-30T17:03:03.595 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.596 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.596 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:03.596 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361067+0000", 2023-09-30T17:03:03.596 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0531e-05 2023-09-30T17:03:03.596 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.596 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.596 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:03.596 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361263+0000", 2023-09-30T17:03:03.596 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000196486 2023-09-30T17:03:03.596 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.596 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.597 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:03.597 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361273+0000", 2023-09-30T17:03:03.597 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3379999999999994e-06 2023-09-30T17:03:03.597 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.597 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.597 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:03.597 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361404+0000", 2023-09-30T17:03:03.597 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013137700000000001 2023-09-30T17:03:03.597 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:03.597 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:03.597 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:03.597 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.597 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.598 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:31 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:03:03.598 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:03:03.598 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 45.16836996, 2023-09-30T17:03:03.598 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006676408, 2023-09-30T17:03:03.598 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:03.598 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:03.598 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:03.598 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.598 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:03.598 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:03:03.598 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:03.598 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.599 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.599 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:03.599 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:03:03.599 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:03.599 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.599 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.599 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:03.599 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:03:03.599 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5600000000000002e-07 2023-09-30T17:03:03.599 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.599 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.599 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:03.600 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362044+0000", 2023-09-30T17:03:03.600 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5987999999999999e-05 2023-09-30T17:03:03.600 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.600 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.600 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:03.600 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362051+0000", 2023-09-30T17:03:03.600 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2599999999999999e-06 2023-09-30T17:03:03.600 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.600 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.600 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:03.600 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362057+0000", 2023-09-30T17:03:03.600 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.19e-06 2023-09-30T17:03:03.601 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.601 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.601 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:03.601 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362096+0000", 2023-09-30T17:03:03.601 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8278000000000002e-05 2023-09-30T17:03:03.601 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.601 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.601 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:03.601 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362114+0000", 2023-09-30T17:03:03.601 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8808e-05 2023-09-30T17:03:03.601 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.601 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.602 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:03.602 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368658+0000", 2023-09-30T17:03:03.602 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065433540000000004 2023-09-30T17:03:03.602 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.602 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.602 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:03.602 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368694+0000", 2023-09-30T17:03:03.602 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6273999999999999e-05 2023-09-30T17:03:03.602 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:03.602 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:03.602 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:03.602 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.603 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.603 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:26 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-09-30T17:03:03.603 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:03:03.603 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 45.168279188, 2023-09-30T17:03:03.603 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0066596119999999996, 2023-09-30T17:03:03.603 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:03.603 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:03.603 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:03.603 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.603 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:03.603 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:03:03.603 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:03.604 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.604 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.604 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:03.604 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:03:03.604 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:03.604 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.604 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.604 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:03.604 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362109+0000", 2023-09-30T17:03:03.604 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5699999999999999e-07 2023-09-30T17:03:03.604 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.604 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.605 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:03.605 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362112+0000", 2023-09-30T17:03:03.605 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8410000000000002e-06 2023-09-30T17:03:03.605 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.605 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.605 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:03.605 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362117+0000", 2023-09-30T17:03:03.605 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.792e-06 2023-09-30T17:03:03.605 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.605 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.605 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:03.605 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362122+0000", 2023-09-30T17:03:03.606 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.763e-06 2023-09-30T17:03:03.606 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.606 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.606 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:03.606 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362344+0000", 2023-09-30T17:03:03.606 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022181600000000001 2023-09-30T17:03:03.606 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.606 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.606 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:03.606 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362357+0000", 2023-09-30T17:03:03.606 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2864000000000001e-05 2023-09-30T17:03:03.606 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.606 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.607 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:03.607 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368738+0000", 2023-09-30T17:03:03.607 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063809499999999998 2023-09-30T17:03:03.607 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.607 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.607 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:03.607 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368768+0000", 2023-09-30T17:03:03.607 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0429e-05 2023-09-30T17:03:03.607 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:03.607 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:03.607 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:03.607 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.608 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.608 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2023-09-30T17:03:03.608 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:03:03.608 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 45.167063020999997, 2023-09-30T17:03:03.608 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00082185400000000001, 2023-09-30T17:03:03.608 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:03.608 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:03.608 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:03.608 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.608 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:03.608 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:03:03.608 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:03.609 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.609 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.609 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:03.609 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:03:03.609 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:03.609 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.609 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.609 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:03.609 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:03:03.609 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.22e-07 2023-09-30T17:03:03.609 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.609 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.609 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:03.610 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363327+0000", 2023-09-30T17:03:03.610 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4480000000000001e-06 2023-09-30T17:03:03.610 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.610 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.610 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:03.610 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363333+0000", 2023-09-30T17:03:03.610 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9989999999999997e-06 2023-09-30T17:03:03.610 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.610 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.610 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:03.610 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363354+0000", 2023-09-30T17:03:03.610 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0547000000000002e-05 2023-09-30T17:03:03.611 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.611 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.611 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:03.611 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364057+0000", 2023-09-30T17:03:03.611 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00070306600000000002 2023-09-30T17:03:03.611 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.611 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.611 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:03.611 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364063+0000", 2023-09-30T17:03:03.611 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.694e-06 2023-09-30T17:03:03.611 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.612 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.612 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:03.612 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364146+0000", 2023-09-30T17:03:03.612 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3877999999999999e-05 2023-09-30T17:03:03.612 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:03.612 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:03.612 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:03.612 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.612 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.612 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e18/16 ondisk, result = 0)", 2023-09-30T17:03:03.612 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:03:03.612 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 45.166749488999997, 2023-09-30T17:03:03.613 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00067007199999999996, 2023-09-30T17:03:03.613 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:03.613 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:03.613 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:03.613 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.613 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:03.613 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:03:03.613 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:03.613 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.613 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.614 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:03.614 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:03:03.614 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:03.614 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.614 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.614 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:03.614 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:03:03.614 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.41e-07 2023-09-30T17:03:03.614 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.614 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.615 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:03.615 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363641+0000", 2023-09-30T17:03:03.615 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4830000000000002e-06 2023-09-30T17:03:03.615 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.615 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.615 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:03.615 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363647+0000", 2023-09-30T17:03:03.615 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4869999999999999e-06 2023-09-30T17:03:03.615 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.615 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.615 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:03.616 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363654+0000", 2023-09-30T17:03:03.616 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5889999999999999e-06 2023-09-30T17:03:03.616 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.616 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.616 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:03.616 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364217+0000", 2023-09-30T17:03:03.616 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00056263199999999998 2023-09-30T17:03:03.616 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.616 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.616 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:03.617 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364222+0000", 2023-09-30T17:03:03.617 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.242e-06 2023-09-30T17:03:03.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.617 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.617 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:03.617 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364308+0000", 2023-09-30T17:03:03.617 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6397999999999995e-05 2023-09-30T17:03:03.617 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:03.617 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:03.617 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:03.618 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.618 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.618 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2023-09-30T17:03:03.618 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:03:03.618 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 45.157161578999997, 2023-09-30T17:03:03.618 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000359561, 2023-09-30T17:03:03.618 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:03.618 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2023-09-30T17:03:03.618 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:03.618 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.619 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:03.619 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:03:03.619 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:03.619 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.619 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.619 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:03.619 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:03:03.619 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:03.619 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.619 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.620 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:03.620 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:03:03.620 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1e-07 2023-09-30T17:03:03.620 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.620 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.620 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:03.620 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373228+0000", 2023-09-30T17:03:03.620 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9420000000000002e-06 2023-09-30T17:03:03.620 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.620 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.621 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:03.621 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373235+0000", 2023-09-30T17:03:03.621 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4230000000000002e-06 2023-09-30T17:03:03.621 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.621 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.621 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:03.621 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373239+0000", 2023-09-30T17:03:03.621 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6809999999999997e-06 2023-09-30T17:03:03.621 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.622 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.622 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:03.622 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373518+0000", 2023-09-30T17:03:03.622 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000278311 2023-09-30T17:03:03.622 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.622 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.622 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:03.622 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373586+0000", 2023-09-30T17:03:03.622 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7994e-05 2023-09-30T17:03:03.623 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:03.623 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:03.623 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:03.623 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.623 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.623 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:03:03.623 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:03:03.623 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 45.152735505999999, 2023-09-30T17:03:03.624 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0046632949999999996, 2023-09-30T17:03:03.624 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:03.624 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:03.624 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:03.624 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.624 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:03.624 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:03:03.624 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:03.624 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.624 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.624 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:03.625 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:03:03.625 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:03.625 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.625 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.625 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:03.625 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377653+0000", 2023-09-30T17:03:03.625 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7800000000000002e-07 2023-09-30T17:03:03.625 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.625 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.625 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:03.625 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377657+0000", 2023-09-30T17:03:03.626 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5859999999999998e-06 2023-09-30T17:03:03.626 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.626 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.626 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:03.626 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377677+0000", 2023-09-30T17:03:03.626 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9508999999999999e-05 2023-09-30T17:03:03.626 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.626 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.626 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:03.626 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377682+0000", 2023-09-30T17:03:03.626 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8300000000000001e-06 2023-09-30T17:03:03.626 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.626 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.627 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:03.627 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377725+0000", 2023-09-30T17:03:03.627 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2425000000000001e-05 2023-09-30T17:03:03.627 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.627 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.627 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:03.627 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377738+0000", 2023-09-30T17:03:03.627 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2899e-05 2023-09-30T17:03:03.627 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.627 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.627 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:03.627 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382268+0000", 2023-09-30T17:03:03.628 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045301289999999999 2023-09-30T17:03:03.628 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.628 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.628 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:03.628 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382315+0000", 2023-09-30T17:03:03.628 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7539e-05 2023-09-30T17:03:03.628 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:03.628 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:03.628 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:03.628 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.628 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.628 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-09-30T17:03:03.629 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:03:03.629 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 45.152286054999998, 2023-09-30T17:03:03.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042540670000000003, 2023-09-30T17:03:03.629 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:03.629 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:03.629 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:03.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:03.629 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:03:03.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:03.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.630 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:03.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:03:03.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:03.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.630 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:03.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:03:03.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0299999999999998e-07 2023-09-30T17:03:03.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.630 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:03.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378107+0000", 2023-09-30T17:03:03.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9250000000000003e-06 2023-09-30T17:03:03.631 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.631 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.631 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:03.631 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378116+0000", 2023-09-30T17:03:03.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.037e-06 2023-09-30T17:03:03.631 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.631 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.631 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:03.631 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378123+0000", 2023-09-30T17:03:03.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1879999999999996e-06 2023-09-30T17:03:03.631 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.632 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.632 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:03.632 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378174+0000", 2023-09-30T17:03:03.632 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0998000000000002e-05 2023-09-30T17:03:03.632 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.632 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.632 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:03.632 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378197+0000", 2023-09-30T17:03:03.632 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2558e-05 2023-09-30T17:03:03.632 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.632 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.633 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:03.633 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382319+0000", 2023-09-30T17:03:03.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041220950000000001 2023-09-30T17:03:03.633 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.633 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.633 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:03.633 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382356+0000", 2023-09-30T17:03:03.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6563000000000002e-05 2023-09-30T17:03:03.633 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:03.633 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:03.633 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:03.634 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.634 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-09-30T17:03:03.634 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:03:03.634 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 41.094522230999999, 2023-09-30T17:03:03.634 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00171641, 2023-09-30T17:03:03.634 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:03.634 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:03.634 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:03.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.634 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:03.634 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:03:03.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:03.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:03.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:03:03.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:03.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:03.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435868+0000", 2023-09-30T17:03:03.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5840000000000002e-06 2023-09-30T17:03:03.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:03.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435892+0000", 2023-09-30T17:03:03.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3625000000000002e-05 2023-09-30T17:03:03.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:03.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435908+0000", 2023-09-30T17:03:03.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6548000000000001e-05 2023-09-30T17:03:03.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:03.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435935+0000", 2023-09-30T17:03:03.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6516000000000002e-05 2023-09-30T17:03:03.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.637 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:03.637 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435996+0000", 2023-09-30T17:03:03.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1433999999999995e-05 2023-09-30T17:03:03.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.637 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:03.637 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436114+0000", 2023-09-30T17:03:03.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000118344 2023-09-30T17:03:03.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.638 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:03.638 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436219+0000", 2023-09-30T17:03:03.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010453100000000001 2023-09-30T17:03:03.638 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.638 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:03.638 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436900+0000", 2023-09-30T17:03:03.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00068121299999999996 2023-09-30T17:03:03.638 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.638 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:03.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437508+0000", 2023-09-30T17:03:03.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00060817399999999995 2023-09-30T17:03:03.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:03.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437554+0000", 2023-09-30T17:03:03.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5609000000000003e-05 2023-09-30T17:03:03.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:03.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437582+0000", 2023-09-30T17:03:03.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7832000000000001e-05 2023-09-30T17:03:03.640 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:03.640 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:03.640 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:03.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.640 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2023-09-30T17:03:03.640 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:03:03.640 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 21.094210737000001, 2023-09-30T17:03:03.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001456199, 2023-09-30T17:03:03.640 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:03.640 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:03.640 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:03.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:03.641 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:03:03.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:03.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:03.641 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:03:03.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:03.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:03.641 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436178+0000", 2023-09-30T17:03:03.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.494e-06 2023-09-30T17:03:03.642 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.642 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.642 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:03.642 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436184+0000", 2023-09-30T17:03:03.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2809999999999999e-06 2023-09-30T17:03:03.642 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.642 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.642 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:03.642 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436198+0000", 2023-09-30T17:03:03.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3978000000000001e-05 2023-09-30T17:03:03.642 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.643 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:03.643 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436206+0000", 2023-09-30T17:03:03.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8040000000000007e-06 2023-09-30T17:03:03.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.643 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:03.643 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436268+0000", 2023-09-30T17:03:03.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1484999999999998e-05 2023-09-30T17:03:03.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:03.644 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436339+0000", 2023-09-30T17:03:03.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1000000000000005e-05 2023-09-30T17:03:03.644 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:03.644 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436438+0000", 2023-09-30T17:03:03.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9389000000000007e-05 2023-09-30T17:03:03.644 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.645 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:03.645 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436986+0000", 2023-09-30T17:03:03.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054723399999999996 2023-09-30T17:03:03.645 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.645 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.645 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:03.645 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437566+0000", 2023-09-30T17:03:03.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00058017599999999996 2023-09-30T17:03:03.645 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.645 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.645 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:03.645 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437606+0000", 2023-09-30T17:03:03.646 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9891999999999997e-05 2023-09-30T17:03:03.646 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:03.646 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:03.646 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:03.646 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437633+0000", 2023-09-30T17:03:03.646 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7466000000000001e-05 2023-09-30T17:03:03.646 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:03.646 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:03.646 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:03.647 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:03.647 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:03.647 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:03.648 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:03:03.649 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:03.648+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:03.749 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:03.749+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:03.795 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:03.795 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:03:03.795 INFO:teuthology.orchestra.run.smithi031.stdout: "num_ops": 0 2023-09-30T17:03:03.795 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:03.805 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:03:03.889 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:03.889+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:03.951 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:03.950+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:03.977 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:03.977 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:03:03.977 INFO:teuthology.orchestra.run.smithi031.stdout: "complaint_time": 30, 2023-09-30T17:03:03.977 INFO:teuthology.orchestra.run.smithi031.stdout: "num_blocked_ops": 0 2023-09-30T17:03:03.977 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:03.989 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:03:04.052 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:04.051+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:04.152 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:04.152+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:04.162 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:04.163 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 20, 2023-09-30T17:03:04.163 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 600, 2023-09-30T17:03:04.163 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:03:04.163 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.163 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:32 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'18, mlcod=11'14)", 2023-09-30T17:03:04.163 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:03:04.163 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 56.800207968000002, 2023-09-30T17:03:04.163 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051629809999999996, 2023-09-30T17:03:04.163 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:04.163 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:04.164 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:04.164 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.164 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:04.164 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:03:04.164 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:04.164 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.164 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.164 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:04.164 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:03:04.164 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:04.164 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.165 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.165 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:04.165 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:03:04.165 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2099999999999996e-07 2023-09-30T17:03:04.165 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.165 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.165 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:04.165 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361407+0000", 2023-09-30T17:03:04.165 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7499e-05 2023-09-30T17:03:04.165 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.165 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.166 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:04.166 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361418+0000", 2023-09-30T17:03:04.166 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1127999999999999e-05 2023-09-30T17:03:04.166 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.166 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.166 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:04.166 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361423+0000", 2023-09-30T17:03:04.166 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1930000000000001e-06 2023-09-30T17:03:04.166 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.166 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.166 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:04.167 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361476+0000", 2023-09-30T17:03:04.167 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3399000000000002e-05 2023-09-30T17:03:04.167 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.167 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.167 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:04.167 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361496+0000", 2023-09-30T17:03:04.167 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9638000000000001e-05 2023-09-30T17:03:04.167 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.167 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.167 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:04.167 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.366474+0000", 2023-09-30T17:03:04.167 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0049778829999999998 2023-09-30T17:03:04.168 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.168 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.168 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:04.168 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.366512+0000", 2023-09-30T17:03:04.168 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7620000000000002e-05 2023-09-30T17:03:04.168 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:04.168 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:04.168 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:04.168 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.168 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.168 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:37 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'23, mlcod=11'15)", 2023-09-30T17:03:04.168 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:03:04.169 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 56.797605971000003, 2023-09-30T17:03:04.169 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053985689999999998, 2023-09-30T17:03:04.169 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:04.169 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:04.169 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:04.169 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.169 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:04.169 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:03:04.169 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:04.169 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.169 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.170 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:04.170 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:03:04.170 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:04.170 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.170 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.170 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:04.170 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:03:04.170 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4400000000000001e-07 2023-09-30T17:03:04.170 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.170 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.170 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:04.171 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363956+0000", 2023-09-30T17:03:04.171 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.921e-06 2023-09-30T17:03:04.171 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.171 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.171 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:04.171 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363966+0000", 2023-09-30T17:03:04.171 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0351e-05 2023-09-30T17:03:04.171 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.171 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.171 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:04.171 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363971+0000", 2023-09-30T17:03:04.171 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.023e-06 2023-09-30T17:03:04.172 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.172 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.172 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:04.172 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.364013+0000", 2023-09-30T17:03:04.172 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1575000000000001e-05 2023-09-30T17:03:04.172 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.172 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.172 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:04.172 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.364026+0000", 2023-09-30T17:03:04.172 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3044000000000001e-05 2023-09-30T17:03:04.172 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.173 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.173 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:04.173 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.369308+0000", 2023-09-30T17:03:04.173 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005282152 2023-09-30T17:03:04.173 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.173 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.173 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:04.173 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.369349+0000", 2023-09-30T17:03:04.173 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1059000000000001e-05 2023-09-30T17:03:04.173 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:04.173 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:04.174 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:04.174 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.174 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.174 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:155 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'109, mlcod=11'105)", 2023-09-30T17:03:04.174 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:03:04.174 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 56.315910285000001, 2023-09-30T17:03:04.174 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053867639999999996, 2023-09-30T17:03:04.174 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:04.174 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:04.174 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:04.174 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.175 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:04.175 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:03:04.175 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:04.175 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.175 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.175 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:04.175 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:03:04.175 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:04.175 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.175 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.175 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:04.176 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845647+0000", 2023-09-30T17:03:04.176 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7599999999999997e-07 2023-09-30T17:03:04.176 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.176 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.176 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:04.176 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845699+0000", 2023-09-30T17:03:04.176 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1758000000000001e-05 2023-09-30T17:03:04.176 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.176 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.176 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:04.176 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845708+0000", 2023-09-30T17:03:04.176 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2159999999999995e-06 2023-09-30T17:03:04.177 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.177 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.177 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:04.177 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845712+0000", 2023-09-30T17:03:04.177 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2579999999999997e-06 2023-09-30T17:03:04.177 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.177 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.177 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:04.177 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845756+0000", 2023-09-30T17:03:04.177 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4119999999999998e-05 2023-09-30T17:03:04.177 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.177 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.178 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:04.178 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845779+0000", 2023-09-30T17:03:04.178 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2311e-05 2023-09-30T17:03:04.178 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.178 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.178 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:04.178 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.850982+0000", 2023-09-30T17:03:04.178 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005203053 2023-09-30T17:03:04.178 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.178 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.178 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:04.178 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851033+0000", 2023-09-30T17:03:04.179 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1471999999999998e-05 2023-09-30T17:03:04.179 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:04.179 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:04.179 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:04.179 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.179 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.179 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:156 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'110, mlcod=11'105)", 2023-09-30T17:03:04.179 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:03:04.179 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 56.315377359000003, 2023-09-30T17:03:04.180 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0052834759999999996, 2023-09-30T17:03:04.180 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:04.180 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:04.180 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:04.180 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.180 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:04.180 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:03:04.180 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:04.180 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.180 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.181 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:04.181 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:03:04.181 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:04.181 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.181 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.181 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:04.181 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846180+0000", 2023-09-30T17:03:04.181 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6300000000000005e-07 2023-09-30T17:03:04.181 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.181 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.181 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:04.182 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846184+0000", 2023-09-30T17:03:04.182 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3789999999999999e-06 2023-09-30T17:03:04.182 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.182 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.182 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:04.182 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846195+0000", 2023-09-30T17:03:04.182 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0778000000000001e-05 2023-09-30T17:03:04.182 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.182 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.182 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:04.183 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846200+0000", 2023-09-30T17:03:04.183 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1540000000000001e-06 2023-09-30T17:03:04.183 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.183 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.183 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:04.183 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846274+0000", 2023-09-30T17:03:04.183 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4129999999999997e-05 2023-09-30T17:03:04.183 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.183 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.183 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:04.183 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846286+0000", 2023-09-30T17:03:04.183 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1744e-05 2023-09-30T17:03:04.184 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.184 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.184 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:04.184 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851432+0000", 2023-09-30T17:03:04.184 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051462110000000004 2023-09-30T17:03:04.184 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.184 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.184 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:04.184 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851463+0000", 2023-09-30T17:03:04.184 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0516999999999999e-05 2023-09-30T17:03:04.184 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:04.184 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:04.185 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:04.185 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.185 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.185 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:203 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'149, mlcod=11'145)", 2023-09-30T17:03:04.185 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:03:04.185 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 55.959341449999997, 2023-09-30T17:03:04.185 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051867459999999999, 2023-09-30T17:03:04.185 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:04.185 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:04.185 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:04.185 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.185 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:04.186 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:03:04.186 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:04.186 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.186 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.186 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:04.186 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:03:04.186 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:04.186 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.186 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.186 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:04.187 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202216+0000", 2023-09-30T17:03:04.187 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7e-07 2023-09-30T17:03:04.187 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.187 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.187 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:04.187 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202271+0000", 2023-09-30T17:03:04.187 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5163e-05 2023-09-30T17:03:04.187 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.187 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.187 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:04.187 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202282+0000", 2023-09-30T17:03:04.187 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1319e-05 2023-09-30T17:03:04.188 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.188 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.188 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:04.188 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202288+0000", 2023-09-30T17:03:04.188 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2899999999999999e-06 2023-09-30T17:03:04.188 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.188 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.188 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:04.188 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202331+0000", 2023-09-30T17:03:04.188 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2147999999999997e-05 2023-09-30T17:03:04.188 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.189 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.189 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:04.189 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202348+0000", 2023-09-30T17:03:04.189 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7317e-05 2023-09-30T17:03:04.189 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.189 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.189 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:04.189 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.207357+0000", 2023-09-30T17:03:04.189 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0050095440000000003 2023-09-30T17:03:04.189 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.190 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.190 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:04.190 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.207402+0000", 2023-09-30T17:03:04.190 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4495e-05 2023-09-30T17:03:04.190 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:04.190 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:04.190 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:04.190 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.190 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.190 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:04.190 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:03:04.191 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 45.810011162000002, 2023-09-30T17:03:04.191 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.025313649000000001, 2023-09-30T17:03:04.191 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:04.191 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:04.191 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:04.191 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.191 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:04.191 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:03:04.191 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:04.191 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.191 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.191 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:04.192 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:03:04.192 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:04.192 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.192 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.192 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:04.192 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351551+0000", 2023-09-30T17:03:04.192 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3380000000000004e-06 2023-09-30T17:03:04.192 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.192 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.192 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:04.192 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351559+0000", 2023-09-30T17:03:04.192 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9589999999999995e-06 2023-09-30T17:03:04.192 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.193 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.193 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:04.193 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351571+0000", 2023-09-30T17:03:04.193 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2065999999999999e-05 2023-09-30T17:03:04.193 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.193 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.193 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:04.193 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351706+0000", 2023-09-30T17:03:04.193 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00013553799999999999 2023-09-30T17:03:04.193 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.193 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.193 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:04.194 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353016+0000", 2023-09-30T17:03:04.194 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0013099209999999999 2023-09-30T17:03:04.194 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.194 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.194 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:04.194 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353023+0000", 2023-09-30T17:03:04.194 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2479999999999999e-06 2023-09-30T17:03:04.194 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.194 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.194 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:04.194 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360348+0000", 2023-09-30T17:03:04.195 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0073248949999999997 2023-09-30T17:03:04.195 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.195 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.195 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:04.195 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360787+0000", 2023-09-30T17:03:04.195 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00043875199999999999 2023-09-30T17:03:04.195 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.195 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.195 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:04.195 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360892+0000", 2023-09-30T17:03:04.196 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010508199999999999 2023-09-30T17:03:04.196 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.196 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.196 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:04.196 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365132+0000", 2023-09-30T17:03:04.196 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0042396480000000004 2023-09-30T17:03:04.196 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.196 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.196 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:04.196 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376746+0000", 2023-09-30T17:03:04.196 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011614157 2023-09-30T17:03:04.197 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.197 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.197 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:04.197 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376811+0000", 2023-09-30T17:03:04.197 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5005999999999994e-05 2023-09-30T17:03:04.197 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.197 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.197 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:04.197 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376859+0000", 2023-09-30T17:03:04.197 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8038999999999999e-05 2023-09-30T17:03:04.197 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:04.197 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:04.198 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:04.198 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.198 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.198 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:04.198 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:03:04.198 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 45.809513363000001, 2023-09-30T17:03:04.198 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024923989000000001, 2023-09-30T17:03:04.198 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:04.198 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:04.199 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:04.199 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.199 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:04.199 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:03:04.199 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:04.199 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.199 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.199 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:04.199 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:03:04.199 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:04.199 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.200 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.200 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:04.200 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352044+0000", 2023-09-30T17:03:04.200 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9199999999999999e-07 2023-09-30T17:03:04.200 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.200 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.200 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:04.200 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352050+0000", 2023-09-30T17:03:04.200 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8880000000000002e-06 2023-09-30T17:03:04.200 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.200 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.200 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:04.201 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352143+0000", 2023-09-30T17:03:04.201 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2721999999999998e-05 2023-09-30T17:03:04.201 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.201 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.201 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:04.201 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352155+0000", 2023-09-30T17:03:04.201 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2279000000000001e-05 2023-09-30T17:03:04.201 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.201 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.201 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:04.201 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353114+0000", 2023-09-30T17:03:04.202 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00095943700000000005 2023-09-30T17:03:04.202 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.202 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.202 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:04.202 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353121+0000", 2023-09-30T17:03:04.202 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.494e-06 2023-09-30T17:03:04.202 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.202 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.202 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:04.202 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361491+0000", 2023-09-30T17:03:04.202 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0083697359999999991 2023-09-30T17:03:04.203 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.203 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.203 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:04.203 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361573+0000", 2023-09-30T17:03:04.203 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2822000000000001e-05 2023-09-30T17:03:04.203 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.203 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.203 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:04.203 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362166+0000", 2023-09-30T17:03:04.203 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00059223299999999995 2023-09-30T17:03:04.203 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.204 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.204 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:04.204 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365209+0000", 2023-09-30T17:03:04.204 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.003043212 2023-09-30T17:03:04.204 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.204 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.204 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:04.204 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376910+0000", 2023-09-30T17:03:04.204 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011700898 2023-09-30T17:03:04.204 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.204 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.204 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:04.205 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376945+0000", 2023-09-30T17:03:04.205 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4795000000000001e-05 2023-09-30T17:03:04.205 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.205 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.205 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:04.205 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376967+0000", 2023-09-30T17:03:04.205 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2580999999999999e-05 2023-09-30T17:03:04.205 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:04.205 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:04.205 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:04.205 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.205 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.206 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:04.206 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:03:04.206 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 45.809343443000003, 2023-09-30T17:03:04.206 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023120405, 2023-09-30T17:03:04.206 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:04.206 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:04.206 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:04.206 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.206 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:04.206 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:03:04.206 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:04.207 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.207 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.207 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:04.207 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:03:04.207 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:04.207 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.207 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.207 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:04.207 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352214+0000", 2023-09-30T17:03:04.207 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8400000000000003e-07 2023-09-30T17:03:04.207 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.207 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.207 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:04.208 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352233+0000", 2023-09-30T17:03:04.208 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8946000000000001e-05 2023-09-30T17:03:04.208 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.208 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.208 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:04.208 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352297+0000", 2023-09-30T17:03:04.208 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3540999999999994e-05 2023-09-30T17:03:04.208 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.208 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.208 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:04.208 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352450+0000", 2023-09-30T17:03:04.209 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015364799999999999 2023-09-30T17:03:04.209 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.209 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.209 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:04.209 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353098+0000", 2023-09-30T17:03:04.209 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00064820299999999997 2023-09-30T17:03:04.209 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.209 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.209 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:04.209 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353103+0000", 2023-09-30T17:03:04.209 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0529999999999997e-06 2023-09-30T17:03:04.209 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.210 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.210 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:04.210 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.358558+0000", 2023-09-30T17:03:04.210 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0054550249999999996 2023-09-30T17:03:04.210 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.210 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.210 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:04.210 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.358741+0000", 2023-09-30T17:03:04.210 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00018210200000000001 2023-09-30T17:03:04.210 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.210 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.211 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:04.211 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.359683+0000", 2023-09-30T17:03:04.211 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00094202299999999995 2023-09-30T17:03:04.211 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.211 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.211 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:04.211 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365044+0000", 2023-09-30T17:03:04.211 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053616219999999999 2023-09-30T17:03:04.211 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.211 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.211 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:04.212 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375256+0000", 2023-09-30T17:03:04.212 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010212156 2023-09-30T17:03:04.212 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.212 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.212 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:04.212 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375300+0000", 2023-09-30T17:03:04.212 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3961999999999997e-05 2023-09-30T17:03:04.212 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.212 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.212 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:04.212 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375334+0000", 2023-09-30T17:03:04.212 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.324e-05 2023-09-30T17:03:04.213 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:04.213 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:04.213 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:04.213 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.213 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.213 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:04.213 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:03:04.213 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 45.809028425000001, 2023-09-30T17:03:04.213 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024240660000000001, 2023-09-30T17:03:04.213 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:04.213 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:04.214 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:04.214 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.214 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:04.214 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:03:04.214 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:04.214 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.214 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.214 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:04.214 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:03:04.214 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:04.214 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.215 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.215 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:04.215 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352529+0000", 2023-09-30T17:03:04.215 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1379999999999999e-06 2023-09-30T17:03:04.215 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.215 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.215 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:04.215 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352536+0000", 2023-09-30T17:03:04.215 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3489999999999997e-06 2023-09-30T17:03:04.215 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.215 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.215 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:04.215 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352547+0000", 2023-09-30T17:03:04.216 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1109e-05 2023-09-30T17:03:04.216 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.216 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.216 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:04.216 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352560+0000", 2023-09-30T17:03:04.216 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3046e-05 2023-09-30T17:03:04.216 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.216 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.216 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:04.216 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353142+0000", 2023-09-30T17:03:04.216 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00058174699999999997 2023-09-30T17:03:04.217 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.217 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.217 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:04.217 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353147+0000", 2023-09-30T17:03:04.217 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5840000000000002e-06 2023-09-30T17:03:04.217 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.217 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.217 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:04.217 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360374+0000", 2023-09-30T17:03:04.217 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0072270049999999999 2023-09-30T17:03:04.217 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.217 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.218 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:04.218 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360795+0000", 2023-09-30T17:03:04.218 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00042088999999999999 2023-09-30T17:03:04.218 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.218 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.218 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:04.218 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360967+0000", 2023-09-30T17:03:04.218 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017235699999999999 2023-09-30T17:03:04.218 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.218 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.218 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:04.219 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365051+0000", 2023-09-30T17:03:04.219 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0040837429999999999 2023-09-30T17:03:04.219 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.219 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.219 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:04.219 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376708+0000", 2023-09-30T17:03:04.219 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011656866 2023-09-30T17:03:04.219 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.219 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.219 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:04.219 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376745+0000", 2023-09-30T17:03:04.220 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6769e-05 2023-09-30T17:03:04.220 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.220 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.220 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:04.220 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376769+0000", 2023-09-30T17:03:04.220 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4057e-05 2023-09-30T17:03:04.220 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:04.220 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:04.220 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:04.220 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.220 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.220 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:04.221 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:04.221 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 45.808769069999997, 2023-09-30T17:03:04.221 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023472704, 2023-09-30T17:03:04.221 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:04.221 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:04.221 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:04.221 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.221 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:04.221 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:04.221 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:04.221 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.222 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.222 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:04.222 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:04.222 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:04.222 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.222 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.222 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:04.222 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:04.222 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8000000000000005e-07 2023-09-30T17:03:04.222 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.222 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.222 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:04.223 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352794+0000", 2023-09-30T17:03:04.223 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.789e-06 2023-09-30T17:03:04.223 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.223 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.223 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:04.223 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352805+0000", 2023-09-30T17:03:04.223 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0848e-05 2023-09-30T17:03:04.223 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.223 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.223 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:04.223 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352812+0000", 2023-09-30T17:03:04.223 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4449999999999999e-06 2023-09-30T17:03:04.224 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.224 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.224 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:04.224 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353063+0000", 2023-09-30T17:03:04.224 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00025046299999999998 2023-09-30T17:03:04.224 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.224 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.224 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:04.224 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353071+0000", 2023-09-30T17:03:04.224 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6739999999999997e-06 2023-09-30T17:03:04.224 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.225 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.225 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:04.225 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361696+0000", 2023-09-30T17:03:04.225 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0086251609999999992 2023-09-30T17:03:04.225 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.225 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.225 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:04.225 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362284+0000", 2023-09-30T17:03:04.225 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00058872299999999998 2023-09-30T17:03:04.225 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.225 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.226 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:04.226 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362429+0000", 2023-09-30T17:03:04.226 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014509000000000001 2023-09-30T17:03:04.226 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.226 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.226 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:04.226 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365330+0000", 2023-09-30T17:03:04.226 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0029005419999999999 2023-09-30T17:03:04.226 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.226 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.226 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:04.227 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376196+0000", 2023-09-30T17:03:04.227 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.01086615 2023-09-30T17:03:04.227 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.227 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.227 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:04.227 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376230+0000", 2023-09-30T17:03:04.227 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3858e-05 2023-09-30T17:03:04.227 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.227 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.227 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:04.227 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376260+0000", 2023-09-30T17:03:04.227 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0181000000000001e-05 2023-09-30T17:03:04.228 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:04.228 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:04.228 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:04.228 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.228 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.228 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:04.228 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:03:04.228 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 45.808535499999998, 2023-09-30T17:03:04.228 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023406132999999999, 2023-09-30T17:03:04.228 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:04.228 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:04.229 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:04.229 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.229 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:04.229 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:03:04.229 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:04.229 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.229 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.229 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:04.229 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:03:04.229 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:04.229 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.229 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.230 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:04.230 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353022+0000", 2023-09-30T17:03:04.230 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.78e-07 2023-09-30T17:03:04.230 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.230 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.230 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:04.230 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353027+0000", 2023-09-30T17:03:04.230 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9089999999999999e-06 2023-09-30T17:03:04.230 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.230 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.230 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:04.231 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353035+0000", 2023-09-30T17:03:04.231 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0430000000000008e-06 2023-09-30T17:03:04.231 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.231 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.231 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:04.231 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353047+0000", 2023-09-30T17:03:04.231 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1674e-05 2023-09-30T17:03:04.231 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.231 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.231 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:04.231 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353105+0000", 2023-09-30T17:03:04.231 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8891999999999998e-05 2023-09-30T17:03:04.232 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.232 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.232 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:04.232 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353112+0000", 2023-09-30T17:03:04.232 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7059999999999998e-06 2023-09-30T17:03:04.232 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.232 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.232 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:04.232 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362733+0000", 2023-09-30T17:03:04.232 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0096205869999999999 2023-09-30T17:03:04.232 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.233 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.233 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:04.233 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362833+0000", 2023-09-30T17:03:04.233 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000100227 2023-09-30T17:03:04.233 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.233 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.233 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:04.233 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363000+0000", 2023-09-30T17:03:04.233 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016670899999999999 2023-09-30T17:03:04.233 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.233 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.233 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:04.234 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365550+0000", 2023-09-30T17:03:04.234 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0025499199999999998 2023-09-30T17:03:04.234 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.234 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.234 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:04.234 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376315+0000", 2023-09-30T17:03:04.234 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010765011999999999 2023-09-30T17:03:04.234 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.234 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.234 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:04.234 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376386+0000", 2023-09-30T17:03:04.235 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0866999999999998e-05 2023-09-30T17:03:04.235 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.235 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.235 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:04.235 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376427+0000", 2023-09-30T17:03:04.235 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1709000000000003e-05 2023-09-30T17:03:04.235 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:04.235 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:04.235 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:04.235 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.235 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.235 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:04.236 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:04.236 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 45.808494863999996, 2023-09-30T17:03:04.236 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024076238, 2023-09-30T17:03:04.236 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:04.236 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:04.236 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:04.236 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.236 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:04.236 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:04.236 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:04.236 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.236 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.237 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:04.237 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:04.237 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:04.237 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.237 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.237 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:04.237 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:04.237 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8699999999999995e-07 2023-09-30T17:03:04.237 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.237 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.237 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:04.237 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353067+0000", 2023-09-30T17:03:04.238 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.605e-06 2023-09-30T17:03:04.238 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.238 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.238 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:04.238 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353073+0000", 2023-09-30T17:03:04.238 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8900000000000004e-06 2023-09-30T17:03:04.238 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.238 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.238 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:04.238 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353083+0000", 2023-09-30T17:03:04.238 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0200000000000001e-05 2023-09-30T17:03:04.238 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.239 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.239 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:04.239 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353186+0000", 2023-09-30T17:03:04.239 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010256599999999999 2023-09-30T17:03:04.239 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.239 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.239 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:04.239 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353190+0000", 2023-09-30T17:03:04.239 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9709999999999998e-06 2023-09-30T17:03:04.239 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.239 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.239 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:04.240 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362946+0000", 2023-09-30T17:03:04.240 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0097563330000000007 2023-09-30T17:03:04.240 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.240 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.240 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:04.240 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363088+0000", 2023-09-30T17:03:04.240 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014259200000000001 2023-09-30T17:03:04.240 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.240 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.240 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:04.240 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363555+0000", 2023-09-30T17:03:04.240 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00046627799999999998 2023-09-30T17:03:04.241 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.241 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.241 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:04.241 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365871+0000", 2023-09-30T17:03:04.241 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0023167589999999998 2023-09-30T17:03:04.241 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.241 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.241 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:04.241 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377033+0000", 2023-09-30T17:03:04.241 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011161203999999999 2023-09-30T17:03:04.241 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.241 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.242 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:04.242 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377100+0000", 2023-09-30T17:03:04.242 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7230999999999994e-05 2023-09-30T17:03:04.242 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.242 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.242 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:04.242 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377138+0000", 2023-09-30T17:03:04.242 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8022000000000003e-05 2023-09-30T17:03:04.242 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:04.242 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:04.242 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:04.242 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.243 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.243 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:04.243 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:03:04.243 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 45.808393915000003, 2023-09-30T17:03:04.243 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.020304412000000001, 2023-09-30T17:03:04.243 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:04.243 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:04.243 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:04.243 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.243 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:04.243 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:03:04.244 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:04.244 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.244 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.244 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:04.244 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:03:04.244 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:04.244 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.244 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.244 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:04.244 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353164+0000", 2023-09-30T17:03:04.244 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7100000000000011e-07 2023-09-30T17:03:04.244 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.245 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.245 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:04.245 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353168+0000", 2023-09-30T17:03:04.245 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0600000000000001e-06 2023-09-30T17:03:04.245 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.245 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.245 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:04.245 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353177+0000", 2023-09-30T17:03:04.245 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1409999999999994e-06 2023-09-30T17:03:04.245 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.245 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.245 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:04.245 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353185+0000", 2023-09-30T17:03:04.246 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2479999999999996e-06 2023-09-30T17:03:04.246 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.246 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.246 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:04.246 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353246+0000", 2023-09-30T17:03:04.246 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0519000000000001e-05 2023-09-30T17:03:04.246 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.246 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.246 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:04.246 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353252+0000", 2023-09-30T17:03:04.246 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7859999999999999e-06 2023-09-30T17:03:04.247 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.247 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.247 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:04.247 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354979+0000", 2023-09-30T17:03:04.247 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0017270090000000001 2023-09-30T17:03:04.247 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.247 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.247 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:04.247 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355097+0000", 2023-09-30T17:03:04.247 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000117472 2023-09-30T17:03:04.247 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.247 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.248 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:04.248 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.373467+0000", 2023-09-30T17:03:04.248 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.018370206 2023-09-30T17:03:04.248 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:04.248 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:04.248 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:04.248 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.248 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.248 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:04.248 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:03:04.248 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 45.808353177000001, 2023-09-30T17:03:04.248 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.012725089, 2023-09-30T17:03:04.249 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:04.249 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:04.249 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:04.249 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.249 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:04.249 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:03:04.249 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:04.249 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.249 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.249 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:04.249 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:03:04.249 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:04.250 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.250 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.250 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:04.250 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353204+0000", 2023-09-30T17:03:04.250 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7100000000000002e-07 2023-09-30T17:03:04.250 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.250 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.250 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:04.250 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353213+0000", 2023-09-30T17:03:04.250 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8580000000000006e-06 2023-09-30T17:03:04.250 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.251 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.251 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:04.251 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353219+0000", 2023-09-30T17:03:04.251 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8939999999999998e-06 2023-09-30T17:03:04.251 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.251 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.251 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:04.251 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353223+0000", 2023-09-30T17:03:04.251 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.357e-06 2023-09-30T17:03:04.251 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.251 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.252 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:04.252 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353278+0000", 2023-09-30T17:03:04.252 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5228e-05 2023-09-30T17:03:04.252 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.252 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.252 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:04.252 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353284+0000", 2023-09-30T17:03:04.252 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8209999999999998e-06 2023-09-30T17:03:04.252 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.252 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.252 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:04.252 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355095+0000", 2023-09-30T17:03:04.253 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001811404 2023-09-30T17:03:04.253 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.253 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.253 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:04.253 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355256+0000", 2023-09-30T17:03:04.253 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000160898 2023-09-30T17:03:04.253 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.253 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.253 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:04.253 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365928+0000", 2023-09-30T17:03:04.253 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010672157999999999 2023-09-30T17:03:04.253 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:04.254 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:04.254 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:04.254 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.254 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.254 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-09-30T17:03:04.254 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:03:04.254 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 45.807821969999999, 2023-09-30T17:03:04.254 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0056863460000000001, 2023-09-30T17:03:04.254 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:04.254 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "reached pg", 2023-09-30T17:03:04.254 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:04.255 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.255 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:04.255 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:03:04.255 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:04.255 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.255 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.255 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:04.255 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:03:04.255 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:04.255 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.255 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.256 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:04.256 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:03:04.256 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5700000000000002e-07 2023-09-30T17:03:04.256 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.256 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.256 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:04.256 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353747+0000", 2023-09-30T17:03:04.256 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1899000000000001e-05 2023-09-30T17:03:04.256 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.256 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.256 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:04.256 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353776+0000", 2023-09-30T17:03:04.257 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.8767000000000001e-05 2023-09-30T17:03:04.257 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.257 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.257 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:04.257 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353792+0000", 2023-09-30T17:03:04.257 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5914999999999999e-05 2023-09-30T17:03:04.257 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.257 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.257 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:04.257 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353900+0000", 2023-09-30T17:03:04.257 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010774500000000001 2023-09-30T17:03:04.257 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.258 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.258 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:04.258 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.359421+0000", 2023-09-30T17:03:04.258 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0055213629999999996 2023-09-30T17:03:04.258 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:04.258 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:04.258 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:04.258 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.258 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.258 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:03:04.258 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:03:04.259 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 45.807150370000002, 2023-09-30T17:03:04.259 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0069196370000000002, 2023-09-30T17:03:04.259 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:04.259 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:04.259 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:04.259 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.259 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:04.259 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:03:04.259 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:04.259 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.259 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.260 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:04.260 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:03:04.260 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:04.260 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.260 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.260 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:04.260 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354407+0000", 2023-09-30T17:03:04.260 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7400000000000002e-07 2023-09-30T17:03:04.260 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.260 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.260 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:04.261 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354414+0000", 2023-09-30T17:03:04.261 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1040000000000001e-06 2023-09-30T17:03:04.261 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.261 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.261 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:04.261 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354425+0000", 2023-09-30T17:03:04.261 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1090000000000001e-05 2023-09-30T17:03:04.261 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.261 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.261 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:04.261 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354435+0000", 2023-09-30T17:03:04.261 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8169999999999994e-06 2023-09-30T17:03:04.262 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.262 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.262 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:04.262 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355741+0000", 2023-09-30T17:03:04.262 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0013063160000000001 2023-09-30T17:03:04.262 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.262 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.262 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:04.262 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355763+0000", 2023-09-30T17:03:04.262 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1688e-05 2023-09-30T17:03:04.262 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.263 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.263 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:04.263 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361289+0000", 2023-09-30T17:03:04.263 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0055258269999999996 2023-09-30T17:03:04.263 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.263 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.263 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:04.263 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361326+0000", 2023-09-30T17:03:04.263 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7020999999999997e-05 2023-09-30T17:03:04.263 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:04.263 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:04.264 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:04.264 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.264 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.264 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:30 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2023-09-30T17:03:04.264 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:03:04.264 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 45.805776412, 2023-09-30T17:03:04.264 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0069996629999999997, 2023-09-30T17:03:04.264 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:04.264 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:04.264 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:04.264 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.265 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:04.265 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:03:04.265 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:04.265 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.265 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.265 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:04.265 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:03:04.265 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:04.265 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.265 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.265 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:04.265 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355781+0000", 2023-09-30T17:03:04.266 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9599999999999999e-07 2023-09-30T17:03:04.266 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.266 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.266 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:04.266 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355788+0000", 2023-09-30T17:03:04.266 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8129999999999996e-06 2023-09-30T17:03:04.266 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.266 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.266 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:04.266 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355798+0000", 2023-09-30T17:03:04.266 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2909999999999996e-06 2023-09-30T17:03:04.267 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.267 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.267 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:04.267 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355807+0000", 2023-09-30T17:03:04.267 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8619999999999992e-06 2023-09-30T17:03:04.267 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.267 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.267 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:04.267 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.357264+0000", 2023-09-30T17:03:04.267 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0014578289999999999 2023-09-30T17:03:04.267 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.268 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.268 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:04.268 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.357916+0000", 2023-09-30T17:03:04.268 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00065170500000000004 2023-09-30T17:03:04.268 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.268 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.268 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:04.268 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362731+0000", 2023-09-30T17:03:04.268 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0048149849999999999 2023-09-30T17:03:04.268 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.268 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.268 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:04.269 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362780+0000", 2023-09-30T17:03:04.269 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8681999999999999e-05 2023-09-30T17:03:04.269 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:04.269 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:04.269 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:04.269 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.269 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.269 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2023-09-30T17:03:04.269 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:03:04.269 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 45.787125361000001, 2023-09-30T17:03:04.269 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005905998, 2023-09-30T17:03:04.270 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:04.270 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:04.270 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:04.270 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.270 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:04.270 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:03:04.270 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:04.270 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.270 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.270 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:04.270 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:03:04.270 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:04.271 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.271 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.271 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:04.271 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:03:04.271 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1e-07 2023-09-30T17:03:04.271 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.271 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.271 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:04.271 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374455+0000", 2023-09-30T17:03:04.271 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.3091999999999998e-05 2023-09-30T17:03:04.271 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.272 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.272 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:04.272 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374462+0000", 2023-09-30T17:03:04.272 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5170000000000002e-06 2023-09-30T17:03:04.272 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.272 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.272 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:04.272 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374469+0000", 2023-09-30T17:03:04.272 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8199999999999999e-06 2023-09-30T17:03:04.272 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.272 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.272 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:04.273 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374550+0000", 2023-09-30T17:03:04.273 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0978999999999998e-05 2023-09-30T17:03:04.273 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.273 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.273 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:04.273 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374562+0000", 2023-09-30T17:03:04.273 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2472e-05 2023-09-30T17:03:04.273 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.273 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.273 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:04.273 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380293+0000", 2023-09-30T17:03:04.273 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0057310379999999999 2023-09-30T17:03:04.274 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.274 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.274 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:04.274 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380337+0000", 2023-09-30T17:03:04.274 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3869999999999998e-05 2023-09-30T17:03:04.274 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:04.274 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:04.274 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:04.274 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.274 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.274 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2023-09-30T17:03:04.275 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:03:04.275 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 45.786938612, 2023-09-30T17:03:04.275 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0057590560000000002, 2023-09-30T17:03:04.275 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:04.275 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:04.275 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:04.275 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.275 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:04.275 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:03:04.275 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:04.275 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.276 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.276 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:04.276 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:03:04.276 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:04.276 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.276 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.276 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:04.276 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:03:04.276 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4900000000000001e-07 2023-09-30T17:03:04.276 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.276 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.276 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:04.277 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374629+0000", 2023-09-30T17:03:04.277 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1014e-05 2023-09-30T17:03:04.277 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.277 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.277 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:04.277 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374636+0000", 2023-09-30T17:03:04.277 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5889999999999999e-06 2023-09-30T17:03:04.277 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.277 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.278 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:04.278 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374642+0000", 2023-09-30T17:03:04.278 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.48e-06 2023-09-30T17:03:04.278 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.278 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.278 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:04.278 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374681+0000", 2023-09-30T17:03:04.278 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9320000000000003e-05 2023-09-30T17:03:04.278 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.278 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.278 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:04.278 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374694+0000", 2023-09-30T17:03:04.279 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3351e-05 2023-09-30T17:03:04.279 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.279 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.279 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:04.279 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380319+0000", 2023-09-30T17:03:04.279 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0056243880000000001 2023-09-30T17:03:04.279 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.279 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.279 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:04.279 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380377+0000", 2023-09-30T17:03:04.279 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8464999999999997e-05 2023-09-30T17:03:04.279 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:04.281 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:04.281 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:04.281 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.281 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.281 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=0'0)", 2023-09-30T17:03:04.281 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:03:04.281 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 45.786227701000001, 2023-09-30T17:03:04.281 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051157370000000004, 2023-09-30T17:03:04.281 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:04.282 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:04.282 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:04.282 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.282 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:04.282 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:03:04.282 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:04.282 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.282 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.282 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:04.282 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:03:04.282 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:04.283 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.283 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.283 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:04.283 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:03:04.283 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0199999999999998e-07 2023-09-30T17:03:04.283 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.283 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.283 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:04.283 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375334+0000", 2023-09-30T17:03:04.283 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8799999999999999e-06 2023-09-30T17:03:04.283 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.283 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.284 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:04.284 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375343+0000", 2023-09-30T17:03:04.284 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5490000000000006e-06 2023-09-30T17:03:04.284 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.284 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.284 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:04.284 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375350+0000", 2023-09-30T17:03:04.284 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5700000000000004e-06 2023-09-30T17:03:04.284 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.284 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.284 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:04.284 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375396+0000", 2023-09-30T17:03:04.285 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5550999999999998e-05 2023-09-30T17:03:04.285 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.285 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.285 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:04.285 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375410+0000", 2023-09-30T17:03:04.285 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4518999999999999e-05 2023-09-30T17:03:04.285 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.285 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.285 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:04.285 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380401+0000", 2023-09-30T17:03:04.285 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0049903430000000004 2023-09-30T17:03:04.286 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:04.286 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:04.286 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:04.286 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380445+0000", 2023-09-30T17:03:04.286 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4023000000000002e-05 2023-09-30T17:03:04.286 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:04.286 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:04.286 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:04.286 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:04.286 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:04.286 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:04.288 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:03:04.288 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:04.287+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:04.337 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-09-30T17:03:04.388 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:04.387+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:04.426 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:04.426 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:03:04.426 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2023-09-30T17:03:04.426 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:04.436 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:03:04.519 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:04.518+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:04.590 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:04.590+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:04.602 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:04.602 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:03:04.602 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2023-09-30T17:03:04.602 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2023-09-30T17:03:04.602 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:04.612 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:03:04.691 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:04.691+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:04.694 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-09-30T17:03:04.779 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:04.779 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2023-09-30T17:03:04.779 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2023-09-30T17:03:04.779 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2023-09-30T17:03:04.779 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.779 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:04.779 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:03:04.779 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 46.425929865999997, 2023-09-30T17:03:04.779 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093789779999999996, 2023-09-30T17:03:04.779 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:04.780 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:04.780 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:04.780 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.780 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:04.780 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:03:04.780 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:04.780 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.780 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.780 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:04.780 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:03:04.780 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:04.780 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.781 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.781 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:04.781 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352027+0000", 2023-09-30T17:03:04.781 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0224000000000001e-05 2023-09-30T17:03:04.781 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.781 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.781 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:04.781 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352039+0000", 2023-09-30T17:03:04.781 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1569000000000001e-05 2023-09-30T17:03:04.781 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.781 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.781 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:04.782 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352052+0000", 2023-09-30T17:03:04.782 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2605999999999999e-05 2023-09-30T17:03:04.782 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.782 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.782 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:04.782 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352064+0000", 2023-09-30T17:03:04.782 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2666999999999999e-05 2023-09-30T17:03:04.782 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.782 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.782 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:04.782 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352147+0000", 2023-09-30T17:03:04.783 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3125000000000001e-05 2023-09-30T17:03:04.783 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.783 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.783 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:04.783 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352306+0000", 2023-09-30T17:03:04.783 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015881900000000001 2023-09-30T17:03:04.783 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.783 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.783 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:04.783 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352450+0000", 2023-09-30T17:03:04.783 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014420700000000001 2023-09-30T17:03:04.784 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.784 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.784 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:04.784 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355975+0000", 2023-09-30T17:03:04.784 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003524246 2023-09-30T17:03:04.784 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.784 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.784 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:04.784 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361279+0000", 2023-09-30T17:03:04.784 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005304507 2023-09-30T17:03:04.784 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.784 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.784 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:04.785 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361344+0000", 2023-09-30T17:03:04.785 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4548999999999995e-05 2023-09-30T17:03:04.785 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.785 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.785 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:04.785 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361396+0000", 2023-09-30T17:03:04.785 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2459e-05 2023-09-30T17:03:04.785 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:04.785 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:04.785 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:04.785 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.785 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.786 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:04.786 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:03:04.786 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 46.425837573999999, 2023-09-30T17:03:04.786 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021233007000000002, 2023-09-30T17:03:04.786 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:04.786 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:04.786 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:04.786 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.786 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:04.786 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:03:04.786 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:04.787 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.787 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.787 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:04.787 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:03:04.787 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:04.787 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.787 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.787 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:04.787 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352110+0000", 2023-09-30T17:03:04.787 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6000000000000002e-07 2023-09-30T17:03:04.787 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.787 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.788 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:04.788 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352117+0000", 2023-09-30T17:03:04.788 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5930000000000002e-06 2023-09-30T17:03:04.788 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.788 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.788 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:04.788 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352126+0000", 2023-09-30T17:03:04.788 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0729999999999994e-06 2023-09-30T17:03:04.788 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.788 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.788 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:04.788 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352136+0000", 2023-09-30T17:03:04.789 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0380000000000001e-05 2023-09-30T17:03:04.789 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.789 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.789 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:04.789 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353279+0000", 2023-09-30T17:03:04.789 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0011424670000000001 2023-09-30T17:03:04.789 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.789 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.789 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:04.789 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353707+0000", 2023-09-30T17:03:04.789 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00042829800000000003 2023-09-30T17:03:04.789 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.790 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.790 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:04.790 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354104+0000", 2023-09-30T17:03:04.790 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00039643399999999998 2023-09-30T17:03:04.790 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.790 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.790 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:04.790 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356925+0000", 2023-09-30T17:03:04.790 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0028210900000000001 2023-09-30T17:03:04.790 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.790 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.790 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:04.791 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373243+0000", 2023-09-30T17:03:04.791 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016318461999999999 2023-09-30T17:03:04.791 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.791 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.791 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:04.791 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373301+0000", 2023-09-30T17:03:04.791 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7435000000000002e-05 2023-09-30T17:03:04.791 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.791 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.791 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:04.791 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373342+0000", 2023-09-30T17:03:04.791 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1915000000000001e-05 2023-09-30T17:03:04.792 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:04.792 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:04.792 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:04.792 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.792 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.792 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:04.792 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:03:04.792 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 46.425794963000001, 2023-09-30T17:03:04.792 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011988331, 2023-09-30T17:03:04.792 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:04.792 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:04.793 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:04.793 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.793 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:04.793 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:03:04.793 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:04.793 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.793 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.793 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:04.793 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:03:04.793 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:04.793 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.793 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.794 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:04.794 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352153+0000", 2023-09-30T17:03:04.794 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0500000000000003e-07 2023-09-30T17:03:04.794 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.794 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.794 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:04.794 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352157+0000", 2023-09-30T17:03:04.794 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9790000000000004e-06 2023-09-30T17:03:04.794 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.794 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.794 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:04.795 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352173+0000", 2023-09-30T17:03:04.795 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6535999999999999e-05 2023-09-30T17:03:04.795 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.795 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.795 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:04.795 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352180+0000", 2023-09-30T17:03:04.795 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7700000000000004e-06 2023-09-30T17:03:04.795 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.795 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.795 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:04.795 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353526+0000", 2023-09-30T17:03:04.796 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0013458330000000001 2023-09-30T17:03:04.796 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.796 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.796 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:04.796 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353648+0000", 2023-09-30T17:03:04.796 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012262899999999999 2023-09-30T17:03:04.796 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.796 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.796 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:04.796 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354141+0000", 2023-09-30T17:03:04.796 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00049222899999999995 2023-09-30T17:03:04.796 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.796 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.797 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:04.797 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356931+0000", 2023-09-30T17:03:04.797 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0027900860000000002 2023-09-30T17:03:04.797 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.797 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.797 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:04.797 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364066+0000", 2023-09-30T17:03:04.797 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071355050000000003 2023-09-30T17:03:04.797 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.797 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.797 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:04.797 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364103+0000", 2023-09-30T17:03:04.797 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6944999999999999e-05 2023-09-30T17:03:04.797 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.798 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.798 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:04.798 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364140+0000", 2023-09-30T17:03:04.798 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7214e-05 2023-09-30T17:03:04.798 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:04.798 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:04.798 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:04.798 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.798 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.798 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:04.798 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:03:04.798 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 46.425755731999999, 2023-09-30T17:03:04.799 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012110921, 2023-09-30T17:03:04.799 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:04.799 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:04.799 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:04.799 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.799 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:04.799 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:03:04.799 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:04.799 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.799 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.799 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:04.799 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:03:04.800 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:04.800 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.800 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.800 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:04.800 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352192+0000", 2023-09-30T17:03:04.800 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7300000000000005e-07 2023-09-30T17:03:04.800 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.800 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.800 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:04.800 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352196+0000", 2023-09-30T17:03:04.800 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2370000000000003e-06 2023-09-30T17:03:04.800 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.801 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.801 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:04.801 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352205+0000", 2023-09-30T17:03:04.801 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6659999999999997e-06 2023-09-30T17:03:04.801 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.801 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.801 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:04.801 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352214+0000", 2023-09-30T17:03:04.801 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8259999999999999e-06 2023-09-30T17:03:04.801 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.801 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.801 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:04.801 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354470+0000", 2023-09-30T17:03:04.802 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022557340000000001 2023-09-30T17:03:04.802 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.802 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.802 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:04.802 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354557+0000", 2023-09-30T17:03:04.802 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6909000000000004e-05 2023-09-30T17:03:04.802 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.802 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.802 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:04.802 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354694+0000", 2023-09-30T17:03:04.802 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013774800000000001 2023-09-30T17:03:04.803 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.803 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.803 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:04.803 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356937+0000", 2023-09-30T17:03:04.803 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022424540000000001 2023-09-30T17:03:04.803 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.803 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.803 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:04.803 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364227+0000", 2023-09-30T17:03:04.803 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072902430000000001 2023-09-30T17:03:04.803 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.803 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.804 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:04.804 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364278+0000", 2023-09-30T17:03:04.804 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1180999999999997e-05 2023-09-30T17:03:04.804 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.804 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.804 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:04.804 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364302+0000", 2023-09-30T17:03:04.804 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4049999999999998e-05 2023-09-30T17:03:04.804 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:04.804 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:04.804 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:04.805 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.805 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.805 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:04.805 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:04.805 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 46.425722393000001, 2023-09-30T17:03:04.805 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021258651999999999, 2023-09-30T17:03:04.805 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:04.805 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:04.805 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:04.805 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.805 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:04.806 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:04.806 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:04.806 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.806 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.806 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:04.806 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:04.806 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:04.806 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.806 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.806 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:04.806 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:04.806 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6899999999999997e-07 2023-09-30T17:03:04.806 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.807 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.807 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:04.807 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352236+0000", 2023-09-30T17:03:04.807 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0251000000000001e-05 2023-09-30T17:03:04.807 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.807 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.807 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:04.807 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352244+0000", 2023-09-30T17:03:04.807 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0770000000000008e-06 2023-09-30T17:03:04.807 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.807 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.807 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:04.807 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352251+0000", 2023-09-30T17:03:04.808 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4749999999999996e-06 2023-09-30T17:03:04.808 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.808 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.808 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:04.808 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354455+0000", 2023-09-30T17:03:04.808 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022043660000000001 2023-09-30T17:03:04.808 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.808 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.808 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:04.808 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354577+0000", 2023-09-30T17:03:04.808 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000121054 2023-09-30T17:03:04.808 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.808 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.809 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:04.809 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354723+0000", 2023-09-30T17:03:04.809 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014693900000000001 2023-09-30T17:03:04.809 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.809 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.809 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:04.809 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356941+0000", 2023-09-30T17:03:04.809 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002217199 2023-09-30T17:03:04.809 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.809 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.809 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:04.809 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373392+0000", 2023-09-30T17:03:04.809 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016451774999999998 2023-09-30T17:03:04.810 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.810 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.810 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:04.810 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373445+0000", 2023-09-30T17:03:04.810 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.308e-05 2023-09-30T17:03:04.810 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.810 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.810 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:04.810 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373483+0000", 2023-09-30T17:03:04.810 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7766999999999999e-05 2023-09-30T17:03:04.810 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:04.810 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:04.811 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:04.811 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.811 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.811 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:04.811 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:04.811 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 46.425686302000003, 2023-09-30T17:03:04.811 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020903497, 2023-09-30T17:03:04.811 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:04.811 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:04.811 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:04.811 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.811 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:04.812 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:04.812 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:04.812 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.812 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.812 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:04.812 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:04.812 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:04.812 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.812 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.812 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:04.812 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:04.812 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0800000000000004e-07 2023-09-30T17:03:04.812 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.813 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:04.813 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352266+0000", 2023-09-30T17:03:04.813 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1280000000000001e-06 2023-09-30T17:03:04.813 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.813 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:04.813 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352273+0000", 2023-09-30T17:03:04.813 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3730000000000004e-06 2023-09-30T17:03:04.813 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.813 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:04.813 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352279+0000", 2023-09-30T17:03:04.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7699999999999998e-06 2023-09-30T17:03:04.814 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.814 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.814 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:04.814 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352334+0000", 2023-09-30T17:03:04.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5547999999999997e-05 2023-09-30T17:03:04.814 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.814 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.814 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:04.814 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352435+0000", 2023-09-30T17:03:04.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100688 2023-09-30T17:03:04.814 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.815 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.815 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:04.815 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352585+0000", 2023-09-30T17:03:04.815 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000150068 2023-09-30T17:03:04.815 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.815 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.815 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:04.815 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354912+0000", 2023-09-30T17:03:04.815 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0023266770000000001 2023-09-30T17:03:04.815 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.815 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.815 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:04.816 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373066+0000", 2023-09-30T17:03:04.816 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018154474 2023-09-30T17:03:04.816 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.816 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.816 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:04.816 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373122+0000", 2023-09-30T17:03:04.816 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6193000000000002e-05 2023-09-30T17:03:04.816 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.816 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.816 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:04.816 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373164+0000", 2023-09-30T17:03:04.817 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1869999999999997e-05 2023-09-30T17:03:04.817 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:04.817 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:04.817 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:04.817 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.817 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.817 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:04.817 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:03:04.817 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 46.425650625999999, 2023-09-30T17:03:04.817 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021015097999999999, 2023-09-30T17:03:04.817 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:04.817 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:04.817 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:04.818 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.818 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:04.818 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:03:04.818 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:04.818 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.818 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.818 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:04.818 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:03:04.818 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:04.818 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.818 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.819 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:04.819 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352297+0000", 2023-09-30T17:03:04.819 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8299999999999997e-07 2023-09-30T17:03:04.819 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.819 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.819 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:04.819 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352300+0000", 2023-09-30T17:03:04.819 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7460000000000001e-06 2023-09-30T17:03:04.819 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.819 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.819 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:04.820 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352307+0000", 2023-09-30T17:03:04.820 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4959999999999999e-06 2023-09-30T17:03:04.820 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.820 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.820 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:04.820 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352314+0000", 2023-09-30T17:03:04.820 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0190000000000001e-06 2023-09-30T17:03:04.820 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.820 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.820 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:04.820 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354070+0000", 2023-09-30T17:03:04.820 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001755936 2023-09-30T17:03:04.821 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.821 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.821 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:04.821 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354221+0000", 2023-09-30T17:03:04.821 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000150884 2023-09-30T17:03:04.821 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.821 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.821 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:04.821 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373311+0000", 2023-09-30T17:03:04.821 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019090434 2023-09-30T17:03:04.821 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:04.822 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:04.822 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:04.822 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.822 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.822 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:04.822 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:03:04.822 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 46.425621907, 2023-09-30T17:03:04.822 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021255174000000002, 2023-09-30T17:03:04.822 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:04.822 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:04.822 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:04.823 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.823 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:04.823 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:03:04.823 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:04.823 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.823 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.823 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:04.823 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:03:04.823 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:04.823 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.823 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.823 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:04.824 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352326+0000", 2023-09-30T17:03:04.824 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3200000000000005e-07 2023-09-30T17:03:04.824 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.824 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.824 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:04.824 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352349+0000", 2023-09-30T17:03:04.824 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3183000000000001e-05 2023-09-30T17:03:04.824 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.824 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.824 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:04.824 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352358+0000", 2023-09-30T17:03:04.824 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5230000000000001e-06 2023-09-30T17:03:04.824 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.825 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:04.825 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352365+0000", 2023-09-30T17:03:04.825 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3260000000000001e-06 2023-09-30T17:03:04.825 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.825 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:04.825 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355450+0000", 2023-09-30T17:03:04.825 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0030854049999999998 2023-09-30T17:03:04.825 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.825 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:04.826 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355583+0000", 2023-09-30T17:03:04.826 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000133189 2023-09-30T17:03:04.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.826 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.826 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:04.826 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373580+0000", 2023-09-30T17:03:04.826 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017997016000000001 2023-09-30T17:03:04.826 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:04.826 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:04.826 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:04.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.827 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.827 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:04.827 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:03:04.827 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 46.425570483999998, 2023-09-30T17:03:04.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010380537, 2023-09-30T17:03:04.827 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:04.827 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:04.827 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:04.827 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.827 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:04.827 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:03:04.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:04.827 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.828 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.828 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:04.828 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:03:04.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:04.828 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.828 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.828 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:04.828 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:03:04.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1500000000000003e-07 2023-09-30T17:03:04.828 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.828 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.829 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:04.829 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352381+0000", 2023-09-30T17:03:04.829 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6330000000000002e-06 2023-09-30T17:03:04.829 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.829 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:04.829 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352388+0000", 2023-09-30T17:03:04.829 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7229999999999998e-06 2023-09-30T17:03:04.829 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.830 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:04.830 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352394+0000", 2023-09-30T17:03:04.830 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1789999999999996e-06 2023-09-30T17:03:04.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.830 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.830 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:04.830 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353259+0000", 2023-09-30T17:03:04.830 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000865221 2023-09-30T17:03:04.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.830 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.830 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:04.831 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353391+0000", 2023-09-30T17:03:04.831 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013217700000000001 2023-09-30T17:03:04.831 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.831 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.831 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:04.831 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362757+0000", 2023-09-30T17:03:04.831 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093657889999999994 2023-09-30T17:03:04.831 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:04.831 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:04.831 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:04.831 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.832 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.832 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-09-30T17:03:04.832 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:03:04.832 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 46.419270191999999, 2023-09-30T17:03:04.832 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0061813579999999996, 2023-09-30T17:03:04.832 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:04.832 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2023-09-30T17:03:04.832 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:04.832 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.832 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:04.832 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:03:04.832 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:04.833 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.833 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.833 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:04.833 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:03:04.833 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:04.833 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.833 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.833 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:04.833 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:03:04.833 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5499999999999999e-07 2023-09-30T17:03:04.833 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.833 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.834 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:04.834 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358686+0000", 2023-09-30T17:03:04.834 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9979999999999992e-06 2023-09-30T17:03:04.834 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.834 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.834 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:04.834 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358700+0000", 2023-09-30T17:03:04.834 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3635000000000001e-05 2023-09-30T17:03:04.834 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.834 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.834 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:04.835 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358714+0000", 2023-09-30T17:03:04.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4470999999999999e-05 2023-09-30T17:03:04.835 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.835 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.835 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:04.835 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358767+0000", 2023-09-30T17:03:04.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2651999999999997e-05 2023-09-30T17:03:04.835 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.835 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.835 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:04.835 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364858+0000", 2023-09-30T17:03:04.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060912470000000002 2023-09-30T17:03:04.835 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:04.836 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:04.836 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:04.836 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.836 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.836 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2023-09-30T17:03:04.836 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:03:04.836 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 46.416905352000001, 2023-09-30T17:03:04.836 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00036246299999999999, 2023-09-30T17:03:04.836 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:04.836 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:04.836 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:04.836 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.837 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:04.837 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:03:04.837 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:04.837 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.837 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.837 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:04.837 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:03:04.837 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:04.837 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.837 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.837 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:04.837 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:03:04.838 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3099999999999999e-07 2023-09-30T17:03:04.838 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.838 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.838 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:04.838 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361045+0000", 2023-09-30T17:03:04.838 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.49e-06 2023-09-30T17:03:04.838 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.838 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.838 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:04.838 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361056+0000", 2023-09-30T17:03:04.838 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0910000000000001e-05 2023-09-30T17:03:04.838 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.839 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.839 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:04.839 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361067+0000", 2023-09-30T17:03:04.839 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0531e-05 2023-09-30T17:03:04.839 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.839 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.839 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:04.839 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361263+0000", 2023-09-30T17:03:04.839 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000196486 2023-09-30T17:03:04.839 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.839 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.840 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:04.840 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361273+0000", 2023-09-30T17:03:04.840 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3379999999999994e-06 2023-09-30T17:03:04.840 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.840 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.840 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:04.840 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361404+0000", 2023-09-30T17:03:04.840 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013137700000000001 2023-09-30T17:03:04.840 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:04.840 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:04.840 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:04.840 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.841 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.841 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:31 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:03:04.841 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:03:04.841 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 46.415929323, 2023-09-30T17:03:04.841 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006676408, 2023-09-30T17:03:04.841 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:04.841 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:04.841 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:04.841 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.841 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:04.841 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:03:04.842 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:04.842 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.842 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.842 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:04.842 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:03:04.842 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:04.842 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.842 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.842 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:04.842 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:03:04.842 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5600000000000002e-07 2023-09-30T17:03:04.842 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.843 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.843 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:04.843 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362044+0000", 2023-09-30T17:03:04.843 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5987999999999999e-05 2023-09-30T17:03:04.843 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.843 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.843 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:04.843 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362051+0000", 2023-09-30T17:03:04.843 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2599999999999999e-06 2023-09-30T17:03:04.843 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.843 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.844 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:04.844 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362057+0000", 2023-09-30T17:03:04.844 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.19e-06 2023-09-30T17:03:04.844 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.844 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.844 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:04.844 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362096+0000", 2023-09-30T17:03:04.844 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8278000000000002e-05 2023-09-30T17:03:04.844 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.844 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.844 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:04.844 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362114+0000", 2023-09-30T17:03:04.845 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8808e-05 2023-09-30T17:03:04.845 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.845 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.845 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:04.845 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368658+0000", 2023-09-30T17:03:04.845 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065433540000000004 2023-09-30T17:03:04.845 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.845 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.845 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:04.845 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368694+0000", 2023-09-30T17:03:04.845 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6273999999999999e-05 2023-09-30T17:03:04.845 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:04.845 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:04.846 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:04.846 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.846 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.846 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:26 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-09-30T17:03:04.846 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:03:04.846 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 46.415838551, 2023-09-30T17:03:04.846 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0066596119999999996, 2023-09-30T17:03:04.846 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:04.846 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:04.846 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:04.846 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.846 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:04.847 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:03:04.847 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:04.847 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.847 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.847 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:04.847 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:03:04.847 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:04.847 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.847 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.847 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:04.847 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362109+0000", 2023-09-30T17:03:04.847 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5699999999999999e-07 2023-09-30T17:03:04.848 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.848 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.848 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:04.848 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362112+0000", 2023-09-30T17:03:04.848 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8410000000000002e-06 2023-09-30T17:03:04.848 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.848 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.848 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:04.848 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362117+0000", 2023-09-30T17:03:04.848 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.792e-06 2023-09-30T17:03:04.848 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.848 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.849 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:04.849 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362122+0000", 2023-09-30T17:03:04.849 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.763e-06 2023-09-30T17:03:04.849 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.849 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.849 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:04.849 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362344+0000", 2023-09-30T17:03:04.849 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022181600000000001 2023-09-30T17:03:04.849 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.849 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.849 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:04.849 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362357+0000", 2023-09-30T17:03:04.850 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2864000000000001e-05 2023-09-30T17:03:04.850 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.850 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.850 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:04.850 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368738+0000", 2023-09-30T17:03:04.850 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063809499999999998 2023-09-30T17:03:04.850 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.850 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.850 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:04.850 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368768+0000", 2023-09-30T17:03:04.850 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0429e-05 2023-09-30T17:03:04.851 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:04.851 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:04.851 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:04.851 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.851 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.851 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2023-09-30T17:03:04.851 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:03:04.851 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 46.414622383999998, 2023-09-30T17:03:04.851 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00082185400000000001, 2023-09-30T17:03:04.851 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:04.851 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:04.851 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:04.852 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.852 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:04.852 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:03:04.852 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:04.852 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.852 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.852 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:04.852 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:03:04.852 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:04.852 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.852 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.852 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:04.853 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:03:04.853 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.22e-07 2023-09-30T17:03:04.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.853 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.853 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:04.853 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363327+0000", 2023-09-30T17:03:04.853 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4480000000000001e-06 2023-09-30T17:03:04.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.853 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.853 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:04.853 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363333+0000", 2023-09-30T17:03:04.854 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9989999999999997e-06 2023-09-30T17:03:04.854 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.854 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.854 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:04.854 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363354+0000", 2023-09-30T17:03:04.854 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0547000000000002e-05 2023-09-30T17:03:04.854 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.854 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.854 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:04.854 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364057+0000", 2023-09-30T17:03:04.854 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00070306600000000002 2023-09-30T17:03:04.854 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.855 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.855 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:04.855 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364063+0000", 2023-09-30T17:03:04.855 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.694e-06 2023-09-30T17:03:04.855 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.855 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.855 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:04.855 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364146+0000", 2023-09-30T17:03:04.855 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3877999999999999e-05 2023-09-30T17:03:04.855 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:04.855 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:04.856 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:04.856 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.856 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.856 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e18/16 ondisk, result = 0)", 2023-09-30T17:03:04.856 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:03:04.856 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 46.414308851999998, 2023-09-30T17:03:04.856 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00067007199999999996, 2023-09-30T17:03:04.856 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:04.856 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:04.856 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:04.856 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.856 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:04.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:03:04.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:04.857 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.857 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:04.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:03:04.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:04.857 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.857 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:04.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:03:04.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.41e-07 2023-09-30T17:03:04.858 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.858 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.858 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:04.858 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363641+0000", 2023-09-30T17:03:04.858 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4830000000000002e-06 2023-09-30T17:03:04.858 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.858 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.858 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:04.858 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363647+0000", 2023-09-30T17:03:04.858 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4869999999999999e-06 2023-09-30T17:03:04.858 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.859 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.859 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:04.859 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363654+0000", 2023-09-30T17:03:04.859 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5889999999999999e-06 2023-09-30T17:03:04.859 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.859 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.859 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:04.859 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364217+0000", 2023-09-30T17:03:04.859 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00056263199999999998 2023-09-30T17:03:04.859 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.859 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.859 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:04.860 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364222+0000", 2023-09-30T17:03:04.860 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.242e-06 2023-09-30T17:03:04.860 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.860 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.860 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:04.860 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364308+0000", 2023-09-30T17:03:04.860 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6397999999999995e-05 2023-09-30T17:03:04.860 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:04.860 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:04.860 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:04.860 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.861 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.861 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2023-09-30T17:03:04.861 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:03:04.861 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 46.404720941999997, 2023-09-30T17:03:04.861 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000359561, 2023-09-30T17:03:04.861 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:04.861 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2023-09-30T17:03:04.861 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:04.861 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.861 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:04.861 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:03:04.861 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:04.862 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.862 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.862 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:04.862 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:03:04.862 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:04.862 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.862 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.862 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:04.862 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:03:04.862 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1e-07 2023-09-30T17:03:04.862 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.862 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.863 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:04.863 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373228+0000", 2023-09-30T17:03:04.863 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9420000000000002e-06 2023-09-30T17:03:04.863 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.863 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.863 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:04.863 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373235+0000", 2023-09-30T17:03:04.863 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4230000000000002e-06 2023-09-30T17:03:04.863 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.863 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.863 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:04.863 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373239+0000", 2023-09-30T17:03:04.864 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6809999999999997e-06 2023-09-30T17:03:04.864 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.864 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:04.864 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373518+0000", 2023-09-30T17:03:04.864 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000278311 2023-09-30T17:03:04.864 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.864 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:04.864 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373586+0000", 2023-09-30T17:03:04.864 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7994e-05 2023-09-30T17:03:04.865 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:04.865 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:04.865 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:04.865 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.865 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.865 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:03:04.865 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:03:04.865 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 46.400294869, 2023-09-30T17:03:04.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0046632949999999996, 2023-09-30T17:03:04.865 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:04.865 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:04.865 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:04.866 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.866 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:04.866 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:03:04.866 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:04.866 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.866 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.866 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:04.866 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:03:04.866 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:04.866 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.866 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.866 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:04.867 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377653+0000", 2023-09-30T17:03:04.867 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7800000000000002e-07 2023-09-30T17:03:04.867 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.867 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.867 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:04.867 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377657+0000", 2023-09-30T17:03:04.867 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5859999999999998e-06 2023-09-30T17:03:04.867 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.867 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.867 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:04.867 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377677+0000", 2023-09-30T17:03:04.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9508999999999999e-05 2023-09-30T17:03:04.868 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:04.868 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377682+0000", 2023-09-30T17:03:04.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8300000000000001e-06 2023-09-30T17:03:04.868 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:04.868 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377725+0000", 2023-09-30T17:03:04.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2425000000000001e-05 2023-09-30T17:03:04.868 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.869 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:04.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377738+0000", 2023-09-30T17:03:04.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2899e-05 2023-09-30T17:03:04.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.869 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:04.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382268+0000", 2023-09-30T17:03:04.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045301289999999999 2023-09-30T17:03:04.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.869 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:04.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382315+0000", 2023-09-30T17:03:04.870 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7539e-05 2023-09-30T17:03:04.870 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:04.870 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:04.870 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:04.870 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.870 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-09-30T17:03:04.870 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:03:04.870 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 46.399845417999998, 2023-09-30T17:03:04.870 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042540670000000003, 2023-09-30T17:03:04.870 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:04.871 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:04.871 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:04.871 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.871 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:04.871 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:03:04.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:04.871 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.871 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.871 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:04.871 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:03:04.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:04.871 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:04.872 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:03:04.872 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0299999999999998e-07 2023-09-30T17:03:04.872 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:04.872 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378107+0000", 2023-09-30T17:03:04.872 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9250000000000003e-06 2023-09-30T17:03:04.872 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:04.873 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378116+0000", 2023-09-30T17:03:04.873 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.037e-06 2023-09-30T17:03:04.873 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.873 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.873 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:04.873 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378123+0000", 2023-09-30T17:03:04.873 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1879999999999996e-06 2023-09-30T17:03:04.873 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.873 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.873 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:04.873 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378174+0000", 2023-09-30T17:03:04.874 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0998000000000002e-05 2023-09-30T17:03:04.874 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.874 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.874 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:04.874 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378197+0000", 2023-09-30T17:03:04.874 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2558e-05 2023-09-30T17:03:04.874 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.874 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.874 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:04.874 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382319+0000", 2023-09-30T17:03:04.874 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041220950000000001 2023-09-30T17:03:04.874 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.875 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.875 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:04.875 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382356+0000", 2023-09-30T17:03:04.875 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6563000000000002e-05 2023-09-30T17:03:04.875 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:04.875 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:04.875 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:04.875 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.875 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.875 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-09-30T17:03:04.875 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:03:04.875 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 42.342081594, 2023-09-30T17:03:04.875 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00171641, 2023-09-30T17:03:04.876 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:04.876 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:04.876 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:04.876 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.876 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:04.876 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:03:04.876 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:04.876 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.876 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.876 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:04.876 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:03:04.877 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:04.877 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.877 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.877 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:04.877 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435868+0000", 2023-09-30T17:03:04.877 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5840000000000002e-06 2023-09-30T17:03:04.877 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.877 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.877 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:04.877 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435892+0000", 2023-09-30T17:03:04.877 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3625000000000002e-05 2023-09-30T17:03:04.877 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.877 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.878 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:04.878 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435908+0000", 2023-09-30T17:03:04.878 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6548000000000001e-05 2023-09-30T17:03:04.878 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.878 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.878 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:04.878 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435935+0000", 2023-09-30T17:03:04.878 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6516000000000002e-05 2023-09-30T17:03:04.878 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.878 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.878 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:04.879 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435996+0000", 2023-09-30T17:03:04.879 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1433999999999995e-05 2023-09-30T17:03:04.879 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.879 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.879 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:04.879 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436114+0000", 2023-09-30T17:03:04.879 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000118344 2023-09-30T17:03:04.879 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.879 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.879 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:04.879 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436219+0000", 2023-09-30T17:03:04.879 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010453100000000001 2023-09-30T17:03:04.879 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.880 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.880 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:04.880 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436900+0000", 2023-09-30T17:03:04.880 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00068121299999999996 2023-09-30T17:03:04.880 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.880 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.880 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:04.880 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437508+0000", 2023-09-30T17:03:04.880 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00060817399999999995 2023-09-30T17:03:04.880 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.880 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.880 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:04.881 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437554+0000", 2023-09-30T17:03:04.881 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5609000000000003e-05 2023-09-30T17:03:04.881 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.881 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.881 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:04.881 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437582+0000", 2023-09-30T17:03:04.881 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7832000000000001e-05 2023-09-30T17:03:04.881 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:04.881 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:04.881 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:04.881 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.881 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.882 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2023-09-30T17:03:04.882 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:03:04.882 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 22.341770100000002, 2023-09-30T17:03:04.882 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001456199, 2023-09-30T17:03:04.882 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:04.882 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:04.882 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:04.882 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.882 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:04.882 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:03:04.882 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:04.882 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.883 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.883 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:04.883 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:03:04.883 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:04.883 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.883 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.883 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:04.883 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436178+0000", 2023-09-30T17:03:04.883 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.494e-06 2023-09-30T17:03:04.883 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.883 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.883 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:04.884 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436184+0000", 2023-09-30T17:03:04.884 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2809999999999999e-06 2023-09-30T17:03:04.884 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.884 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.884 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:04.884 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436198+0000", 2023-09-30T17:03:04.884 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3978000000000001e-05 2023-09-30T17:03:04.884 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.884 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.884 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:04.884 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436206+0000", 2023-09-30T17:03:04.884 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8040000000000007e-06 2023-09-30T17:03:04.884 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.885 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.885 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:04.885 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436268+0000", 2023-09-30T17:03:04.885 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1484999999999998e-05 2023-09-30T17:03:04.885 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.885 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.885 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:04.885 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436339+0000", 2023-09-30T17:03:04.885 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1000000000000005e-05 2023-09-30T17:03:04.885 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.885 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.886 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:04.886 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436438+0000", 2023-09-30T17:03:04.886 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9389000000000007e-05 2023-09-30T17:03:04.886 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.886 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.886 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:04.886 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436986+0000", 2023-09-30T17:03:04.886 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054723399999999996 2023-09-30T17:03:04.886 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.886 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.886 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:04.886 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437566+0000", 2023-09-30T17:03:04.886 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00058017599999999996 2023-09-30T17:03:04.887 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.887 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.887 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:04.887 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437606+0000", 2023-09-30T17:03:04.887 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9891999999999997e-05 2023-09-30T17:03:04.887 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:04.887 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:04.887 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:04.887 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437633+0000", 2023-09-30T17:03:04.887 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7466000000000001e-05 2023-09-30T17:03:04.887 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:04.888 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:04.888 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:04.888 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:04.888 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:04.888 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:04.889 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:03:04.890 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:04.889+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:04.894 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T17:03:04.928 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:03:04.964 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:03:04.964 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-09-30T17:03:04.964 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-09-30T17:03:04.964 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:03:04.968 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:03:04.969 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:03:04.990 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:04.989+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:05.005 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2023-09-30T17:03:05.035 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:05.036 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:05.046 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:03:05.091 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:05.091+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:05.106 INFO:teuthology.orchestra.console.smithi134:Power on completed 2023-09-30T17:03:05.191 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~18s 2023-09-30T17:03:05.192 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:05.191+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:05.207 DEBUG:teuthology.orchestra.console.smithi134:Waiting for login prompt 2023-09-30T17:03:05.207 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: console -M conserver.front.sepia.ceph.com -p 3109 -f smithi134 2023-09-30T17:03:05.219 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:05.220 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:05.230 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:03:05.294 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:05.292+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:05.295 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is set 2023-09-30T17:03:05.394 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:05.394+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:05.403 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:05.403 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:05.414 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:03:05.494 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:05.494+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:05.549 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:05.550 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:05.560 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:03:05.596 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:05.595+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:05.685 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:05.685 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:05.695 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:03:05.697 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:05.696+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:05.798 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:05.797+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:05.821 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:05.821 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:05.831 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:03:05.898 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:05.898+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:05.970 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:05.970 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:05.980 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:03:05.999 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:05.999+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:06.100 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:06.099+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:06.152 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:06.152 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:06.162 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:03:06.203 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:06.203+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:06.302 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:06.302+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:06.335 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:06.335 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:06.345 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:03:06.403 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:06.403+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:06.477 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:06.478 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:06.489 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:03:06.504 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:06.504+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:06.605 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:06.604+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:06.615 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:06.615 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:06.625 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:03:06.706 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:06.706+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:06.750 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:06.751 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:06.761 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:03:06.806 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:06.806+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:06.896 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:06.897 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:06.907 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:03:06.907 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:06.906+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:06.969 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-09-30T17:03:07.008 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:07.007+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:07.079 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:07.079 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:07.089 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:03:07.130 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:07.130+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:07.197 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:03:07.209 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:07.209+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:07.233 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:03:07.233 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-09-30T17:03:07.234 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-09-30T17:03:07.234 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:03:07.237 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:03:07.238 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:03:07.264 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:07.264 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 20, 2023-09-30T17:03:07.264 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 600, 2023-09-30T17:03:07.264 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:03:07.264 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.264 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:32 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'18, mlcod=11'14)", 2023-09-30T17:03:07.264 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:03:07.265 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 59.901652525000003, 2023-09-30T17:03:07.265 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051629809999999996, 2023-09-30T17:03:07.265 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:07.265 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:07.265 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:07.265 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.265 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:07.265 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:03:07.265 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:07.265 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.265 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.265 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:07.266 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:03:07.266 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:07.266 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.266 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.266 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:07.266 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:03:07.266 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2099999999999996e-07 2023-09-30T17:03:07.266 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.266 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.266 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:07.267 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361407+0000", 2023-09-30T17:03:07.267 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7499e-05 2023-09-30T17:03:07.267 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.267 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.267 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:07.267 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361418+0000", 2023-09-30T17:03:07.267 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1127999999999999e-05 2023-09-30T17:03:07.267 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.267 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.267 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:07.267 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361423+0000", 2023-09-30T17:03:07.267 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1930000000000001e-06 2023-09-30T17:03:07.268 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.268 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.268 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:07.268 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361476+0000", 2023-09-30T17:03:07.268 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3399000000000002e-05 2023-09-30T17:03:07.268 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.268 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.268 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:07.268 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361496+0000", 2023-09-30T17:03:07.268 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9638000000000001e-05 2023-09-30T17:03:07.268 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.268 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.269 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:07.269 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.366474+0000", 2023-09-30T17:03:07.269 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0049778829999999998 2023-09-30T17:03:07.269 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.269 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.269 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:07.269 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.366512+0000", 2023-09-30T17:03:07.269 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7620000000000002e-05 2023-09-30T17:03:07.269 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:07.269 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:07.269 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:07.269 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.270 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.270 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:37 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'23, mlcod=11'15)", 2023-09-30T17:03:07.270 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:03:07.270 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 59.899050527999997, 2023-09-30T17:03:07.270 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053985689999999998, 2023-09-30T17:03:07.270 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:07.270 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:07.270 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:07.270 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.271 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:07.271 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:03:07.271 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:07.271 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.271 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.271 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:07.271 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:03:07.271 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:07.271 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.271 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.271 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:07.271 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:03:07.272 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4400000000000001e-07 2023-09-30T17:03:07.272 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.272 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.272 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:07.272 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363956+0000", 2023-09-30T17:03:07.272 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.921e-06 2023-09-30T17:03:07.272 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.272 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.272 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:07.272 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363966+0000", 2023-09-30T17:03:07.272 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0351e-05 2023-09-30T17:03:07.273 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.273 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.273 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:07.273 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363971+0000", 2023-09-30T17:03:07.273 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.023e-06 2023-09-30T17:03:07.273 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.273 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.273 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:07.273 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.364013+0000", 2023-09-30T17:03:07.273 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1575000000000001e-05 2023-09-30T17:03:07.273 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.273 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.274 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:07.274 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.364026+0000", 2023-09-30T17:03:07.274 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3044000000000001e-05 2023-09-30T17:03:07.274 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.274 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.274 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:07.274 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.369308+0000", 2023-09-30T17:03:07.274 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005282152 2023-09-30T17:03:07.274 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.274 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.274 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:07.275 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.369349+0000", 2023-09-30T17:03:07.275 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1059000000000001e-05 2023-09-30T17:03:07.275 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:07.275 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:07.275 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:07.275 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.275 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.275 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:155 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'109, mlcod=11'105)", 2023-09-30T17:03:07.275 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:03:07.275 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 59.417354842000002, 2023-09-30T17:03:07.275 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053867639999999996, 2023-09-30T17:03:07.275 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:07.276 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:07.276 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:07.276 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.276 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:07.276 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:03:07.276 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:07.276 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.276 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.276 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:07.276 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:03:07.276 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:07.277 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.277 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.277 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:07.277 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845647+0000", 2023-09-30T17:03:07.277 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7599999999999997e-07 2023-09-30T17:03:07.277 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.277 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.277 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:07.277 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845699+0000", 2023-09-30T17:03:07.277 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1758000000000001e-05 2023-09-30T17:03:07.277 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.277 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.278 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:07.278 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845708+0000", 2023-09-30T17:03:07.278 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2159999999999995e-06 2023-09-30T17:03:07.278 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.278 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.278 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:07.278 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845712+0000", 2023-09-30T17:03:07.278 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2579999999999997e-06 2023-09-30T17:03:07.278 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.278 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.278 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:07.278 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845756+0000", 2023-09-30T17:03:07.279 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4119999999999998e-05 2023-09-30T17:03:07.279 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.279 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.279 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:07.279 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845779+0000", 2023-09-30T17:03:07.279 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2311e-05 2023-09-30T17:03:07.279 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.279 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.279 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:07.279 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.850982+0000", 2023-09-30T17:03:07.279 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005203053 2023-09-30T17:03:07.280 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.280 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.280 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:07.280 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851033+0000", 2023-09-30T17:03:07.280 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1471999999999998e-05 2023-09-30T17:03:07.280 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:07.280 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:07.280 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:07.280 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.280 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.280 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:156 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'110, mlcod=11'105)", 2023-09-30T17:03:07.280 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:03:07.281 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 59.416821916000004, 2023-09-30T17:03:07.281 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0052834759999999996, 2023-09-30T17:03:07.281 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:07.281 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:07.281 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:07.281 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.281 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:07.281 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:03:07.281 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:07.281 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.281 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.282 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:07.282 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:03:07.282 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:07.282 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.282 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.282 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:07.282 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846180+0000", 2023-09-30T17:03:07.282 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6300000000000005e-07 2023-09-30T17:03:07.282 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.282 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.282 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:07.283 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846184+0000", 2023-09-30T17:03:07.283 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3789999999999999e-06 2023-09-30T17:03:07.283 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.283 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.283 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:07.283 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846195+0000", 2023-09-30T17:03:07.283 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0778000000000001e-05 2023-09-30T17:03:07.283 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.283 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.283 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:07.283 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846200+0000", 2023-09-30T17:03:07.283 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1540000000000001e-06 2023-09-30T17:03:07.284 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.284 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.284 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:07.284 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846274+0000", 2023-09-30T17:03:07.284 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4129999999999997e-05 2023-09-30T17:03:07.284 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.284 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.284 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:07.284 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846286+0000", 2023-09-30T17:03:07.284 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1744e-05 2023-09-30T17:03:07.284 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.285 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.285 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:07.285 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851432+0000", 2023-09-30T17:03:07.285 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051462110000000004 2023-09-30T17:03:07.285 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.285 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.285 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:07.285 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851463+0000", 2023-09-30T17:03:07.285 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0516999999999999e-05 2023-09-30T17:03:07.285 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:07.285 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:07.286 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:07.286 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.286 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.286 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:203 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'149, mlcod=11'145)", 2023-09-30T17:03:07.286 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:03:07.286 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 59.060786006999997, 2023-09-30T17:03:07.286 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051867459999999999, 2023-09-30T17:03:07.286 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:07.286 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:07.286 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:07.286 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.286 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:07.287 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:03:07.287 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:07.287 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.287 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.287 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:07.287 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:03:07.287 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:07.287 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.287 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.287 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:07.287 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202216+0000", 2023-09-30T17:03:07.287 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7e-07 2023-09-30T17:03:07.287 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.288 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.288 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:07.288 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202271+0000", 2023-09-30T17:03:07.288 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5163e-05 2023-09-30T17:03:07.288 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.288 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.288 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:07.288 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202282+0000", 2023-09-30T17:03:07.288 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1319e-05 2023-09-30T17:03:07.289 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.289 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.289 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:07.289 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202288+0000", 2023-09-30T17:03:07.289 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2899999999999999e-06 2023-09-30T17:03:07.289 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.289 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.289 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:07.289 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202331+0000", 2023-09-30T17:03:07.289 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2147999999999997e-05 2023-09-30T17:03:07.289 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.289 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.289 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:07.290 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202348+0000", 2023-09-30T17:03:07.290 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7317e-05 2023-09-30T17:03:07.290 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.290 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.290 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:07.290 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.207357+0000", 2023-09-30T17:03:07.290 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0050095440000000003 2023-09-30T17:03:07.290 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.290 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.290 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:07.291 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.207402+0000", 2023-09-30T17:03:07.291 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4495e-05 2023-09-30T17:03:07.291 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:07.291 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:07.291 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:07.291 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.291 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.291 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:07.291 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:03:07.291 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 48.911455719000003, 2023-09-30T17:03:07.291 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.025313649000000001, 2023-09-30T17:03:07.292 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:07.292 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:07.292 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:07.292 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.292 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:07.292 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:03:07.292 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:07.292 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.292 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.292 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:07.292 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:03:07.292 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:07.293 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.293 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.293 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:07.293 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351551+0000", 2023-09-30T17:03:07.293 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3380000000000004e-06 2023-09-30T17:03:07.293 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.293 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.293 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:07.293 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351559+0000", 2023-09-30T17:03:07.293 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9589999999999995e-06 2023-09-30T17:03:07.293 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.293 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.294 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:07.294 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351571+0000", 2023-09-30T17:03:07.294 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2065999999999999e-05 2023-09-30T17:03:07.294 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.294 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.294 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:07.294 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351706+0000", 2023-09-30T17:03:07.294 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00013553799999999999 2023-09-30T17:03:07.294 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.294 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.295 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:07.295 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353016+0000", 2023-09-30T17:03:07.295 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0013099209999999999 2023-09-30T17:03:07.295 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.295 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.295 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:07.295 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353023+0000", 2023-09-30T17:03:07.295 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2479999999999999e-06 2023-09-30T17:03:07.295 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.295 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.295 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:07.295 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360348+0000", 2023-09-30T17:03:07.296 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0073248949999999997 2023-09-30T17:03:07.296 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.296 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.296 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:07.296 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360787+0000", 2023-09-30T17:03:07.296 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00043875199999999999 2023-09-30T17:03:07.296 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.296 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.296 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:07.296 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360892+0000", 2023-09-30T17:03:07.296 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010508199999999999 2023-09-30T17:03:07.297 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.297 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.297 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:07.297 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365132+0000", 2023-09-30T17:03:07.297 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0042396480000000004 2023-09-30T17:03:07.297 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.297 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.297 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:07.297 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376746+0000", 2023-09-30T17:03:07.297 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011614157 2023-09-30T17:03:07.297 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.297 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.297 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:07.298 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376811+0000", 2023-09-30T17:03:07.298 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5005999999999994e-05 2023-09-30T17:03:07.298 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.298 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.298 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:07.298 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376859+0000", 2023-09-30T17:03:07.298 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8038999999999999e-05 2023-09-30T17:03:07.298 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:07.298 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:07.298 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:07.299 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.299 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.299 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:07.299 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:03:07.299 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 48.910957920000001, 2023-09-30T17:03:07.299 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024923989000000001, 2023-09-30T17:03:07.299 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:07.299 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:07.299 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:07.299 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.299 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:07.299 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:03:07.300 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:07.300 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.300 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.300 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:07.300 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:03:07.300 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:07.300 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.300 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.300 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:07.300 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352044+0000", 2023-09-30T17:03:07.300 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9199999999999999e-07 2023-09-30T17:03:07.300 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.301 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.301 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:07.301 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352050+0000", 2023-09-30T17:03:07.301 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8880000000000002e-06 2023-09-30T17:03:07.301 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.301 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.301 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:07.301 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352143+0000", 2023-09-30T17:03:07.301 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2721999999999998e-05 2023-09-30T17:03:07.301 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.302 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.302 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:07.302 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352155+0000", 2023-09-30T17:03:07.302 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2279000000000001e-05 2023-09-30T17:03:07.302 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.302 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.302 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:07.302 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353114+0000", 2023-09-30T17:03:07.302 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00095943700000000005 2023-09-30T17:03:07.302 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.303 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.303 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:07.303 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353121+0000", 2023-09-30T17:03:07.303 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.494e-06 2023-09-30T17:03:07.303 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.303 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.303 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:07.303 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361491+0000", 2023-09-30T17:03:07.303 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0083697359999999991 2023-09-30T17:03:07.303 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.303 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.303 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:07.304 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361573+0000", 2023-09-30T17:03:07.304 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2822000000000001e-05 2023-09-30T17:03:07.304 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.304 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.304 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:07.304 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362166+0000", 2023-09-30T17:03:07.304 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00059223299999999995 2023-09-30T17:03:07.304 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.304 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.304 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:07.305 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365209+0000", 2023-09-30T17:03:07.305 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.003043212 2023-09-30T17:03:07.305 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.305 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.305 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:07.305 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376910+0000", 2023-09-30T17:03:07.305 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011700898 2023-09-30T17:03:07.305 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.305 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.305 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:07.305 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376945+0000", 2023-09-30T17:03:07.305 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4795000000000001e-05 2023-09-30T17:03:07.306 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.306 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.306 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:07.306 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376967+0000", 2023-09-30T17:03:07.306 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2580999999999999e-05 2023-09-30T17:03:07.306 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:07.306 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:07.306 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:07.306 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.306 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.306 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:07.307 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:03:07.307 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 48.910787999999997, 2023-09-30T17:03:07.307 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023120405, 2023-09-30T17:03:07.307 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:07.307 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:07.307 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:07.307 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.307 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:07.307 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:03:07.307 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:07.307 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.307 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.307 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:07.308 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:03:07.308 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:07.308 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.308 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.308 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:07.308 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352214+0000", 2023-09-30T17:03:07.308 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8400000000000003e-07 2023-09-30T17:03:07.308 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.308 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.308 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:07.308 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352233+0000", 2023-09-30T17:03:07.308 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8946000000000001e-05 2023-09-30T17:03:07.309 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.309 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.309 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:07.309 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352297+0000", 2023-09-30T17:03:07.309 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3540999999999994e-05 2023-09-30T17:03:07.309 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.309 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.309 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:07.309 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352450+0000", 2023-09-30T17:03:07.309 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015364799999999999 2023-09-30T17:03:07.309 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.309 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.310 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:07.310 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353098+0000", 2023-09-30T17:03:07.310 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00064820299999999997 2023-09-30T17:03:07.310 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.310 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.310 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:07.310 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353103+0000", 2023-09-30T17:03:07.310 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0529999999999997e-06 2023-09-30T17:03:07.310 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.310 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.310 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:07.311 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.358558+0000", 2023-09-30T17:03:07.311 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0054550249999999996 2023-09-30T17:03:07.311 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.311 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.311 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:07.311 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.358741+0000", 2023-09-30T17:03:07.311 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00018210200000000001 2023-09-30T17:03:07.311 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.311 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.311 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:07.311 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.359683+0000", 2023-09-30T17:03:07.311 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00094202299999999995 2023-09-30T17:03:07.311 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.312 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.312 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:07.312 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365044+0000", 2023-09-30T17:03:07.312 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053616219999999999 2023-09-30T17:03:07.312 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.312 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.312 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:07.312 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375256+0000", 2023-09-30T17:03:07.312 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010212156 2023-09-30T17:03:07.312 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.312 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.313 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:07.313 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375300+0000", 2023-09-30T17:03:07.313 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3961999999999997e-05 2023-09-30T17:03:07.313 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.313 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.313 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:07.313 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375334+0000", 2023-09-30T17:03:07.313 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.324e-05 2023-09-30T17:03:07.313 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:07.313 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:07.313 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:07.313 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.314 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.314 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:07.314 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:03:07.314 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 48.910472982000002, 2023-09-30T17:03:07.314 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024240660000000001, 2023-09-30T17:03:07.314 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:07.314 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:07.314 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:07.314 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.314 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:07.314 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:03:07.315 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:07.315 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.315 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.315 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:07.315 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:03:07.315 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:07.315 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.315 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.315 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:07.315 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352529+0000", 2023-09-30T17:03:07.315 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1379999999999999e-06 2023-09-30T17:03:07.316 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.316 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.316 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:07.316 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352536+0000", 2023-09-30T17:03:07.316 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3489999999999997e-06 2023-09-30T17:03:07.316 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.316 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.316 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:07.316 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352547+0000", 2023-09-30T17:03:07.316 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1109e-05 2023-09-30T17:03:07.316 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.316 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.317 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:07.317 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352560+0000", 2023-09-30T17:03:07.317 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3046e-05 2023-09-30T17:03:07.317 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.317 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.317 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:07.317 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353142+0000", 2023-09-30T17:03:07.317 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00058174699999999997 2023-09-30T17:03:07.317 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.317 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.317 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:07.318 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353147+0000", 2023-09-30T17:03:07.318 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5840000000000002e-06 2023-09-30T17:03:07.318 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.318 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.318 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:07.318 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360374+0000", 2023-09-30T17:03:07.318 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0072270049999999999 2023-09-30T17:03:07.318 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.318 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.318 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:07.319 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360795+0000", 2023-09-30T17:03:07.319 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00042088999999999999 2023-09-30T17:03:07.319 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.319 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.319 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:07.319 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360967+0000", 2023-09-30T17:03:07.319 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017235699999999999 2023-09-30T17:03:07.319 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.319 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.319 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:07.319 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365051+0000", 2023-09-30T17:03:07.320 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0040837429999999999 2023-09-30T17:03:07.320 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.320 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.320 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:07.320 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376708+0000", 2023-09-30T17:03:07.320 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011656866 2023-09-30T17:03:07.320 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.320 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.320 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:07.320 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376745+0000", 2023-09-30T17:03:07.320 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6769e-05 2023-09-30T17:03:07.321 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.321 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.321 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:07.321 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376769+0000", 2023-09-30T17:03:07.321 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4057e-05 2023-09-30T17:03:07.321 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:07.321 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:07.321 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:07.321 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.321 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.321 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:07.321 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:07.322 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 48.910213626999997, 2023-09-30T17:03:07.322 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023472704, 2023-09-30T17:03:07.322 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:07.322 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:07.322 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:07.322 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.322 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:07.322 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:07.322 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:07.322 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.322 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.323 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:07.323 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:07.323 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:07.323 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.323 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.323 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:07.323 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:07.323 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8000000000000005e-07 2023-09-30T17:03:07.323 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.323 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.323 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:07.323 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352794+0000", 2023-09-30T17:03:07.324 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.789e-06 2023-09-30T17:03:07.324 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.324 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.324 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:07.324 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352805+0000", 2023-09-30T17:03:07.324 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0848e-05 2023-09-30T17:03:07.324 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.324 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.324 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:07.324 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352812+0000", 2023-09-30T17:03:07.324 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4449999999999999e-06 2023-09-30T17:03:07.324 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.325 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.325 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:07.325 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353063+0000", 2023-09-30T17:03:07.325 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00025046299999999998 2023-09-30T17:03:07.325 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.325 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.325 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:07.325 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353071+0000", 2023-09-30T17:03:07.325 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6739999999999997e-06 2023-09-30T17:03:07.325 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.325 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.326 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:07.326 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361696+0000", 2023-09-30T17:03:07.326 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0086251609999999992 2023-09-30T17:03:07.326 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.326 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.326 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:07.326 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362284+0000", 2023-09-30T17:03:07.326 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00058872299999999998 2023-09-30T17:03:07.326 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.326 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.326 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:07.327 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362429+0000", 2023-09-30T17:03:07.327 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014509000000000001 2023-09-30T17:03:07.327 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.327 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.327 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:07.327 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365330+0000", 2023-09-30T17:03:07.327 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0029005419999999999 2023-09-30T17:03:07.327 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.327 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.327 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:07.327 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376196+0000", 2023-09-30T17:03:07.327 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.01086615 2023-09-30T17:03:07.328 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.328 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.328 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:07.328 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376230+0000", 2023-09-30T17:03:07.328 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3858e-05 2023-09-30T17:03:07.328 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.328 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.328 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:07.328 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376260+0000", 2023-09-30T17:03:07.328 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0181000000000001e-05 2023-09-30T17:03:07.328 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:07.328 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:07.328 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:07.329 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.329 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.329 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:07.329 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:03:07.329 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 48.909980056999999, 2023-09-30T17:03:07.329 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023406132999999999, 2023-09-30T17:03:07.329 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:07.329 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:07.329 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:07.329 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.329 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:07.329 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:03:07.330 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:07.330 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.330 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.330 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:07.330 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:03:07.330 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:07.330 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.330 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.330 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:07.330 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353022+0000", 2023-09-30T17:03:07.330 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.78e-07 2023-09-30T17:03:07.330 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.331 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.331 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:07.331 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353027+0000", 2023-09-30T17:03:07.331 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9089999999999999e-06 2023-09-30T17:03:07.331 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.331 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.331 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:07.331 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353035+0000", 2023-09-30T17:03:07.331 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0430000000000008e-06 2023-09-30T17:03:07.331 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.331 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.332 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:07.332 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353047+0000", 2023-09-30T17:03:07.332 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1674e-05 2023-09-30T17:03:07.332 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.332 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.332 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:07.332 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353105+0000", 2023-09-30T17:03:07.332 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8891999999999998e-05 2023-09-30T17:03:07.332 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.332 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.332 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:07.332 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353112+0000", 2023-09-30T17:03:07.333 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7059999999999998e-06 2023-09-30T17:03:07.333 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.333 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.333 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:07.333 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362733+0000", 2023-09-30T17:03:07.333 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0096205869999999999 2023-09-30T17:03:07.333 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.333 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.333 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:07.333 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362833+0000", 2023-09-30T17:03:07.333 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000100227 2023-09-30T17:03:07.333 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.334 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.334 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:07.334 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363000+0000", 2023-09-30T17:03:07.334 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016670899999999999 2023-09-30T17:03:07.334 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.334 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.334 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:07.334 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365550+0000", 2023-09-30T17:03:07.334 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0025499199999999998 2023-09-30T17:03:07.334 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.334 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.334 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:07.335 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376315+0000", 2023-09-30T17:03:07.335 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010765011999999999 2023-09-30T17:03:07.335 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.335 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.335 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:07.335 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376386+0000", 2023-09-30T17:03:07.335 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0866999999999998e-05 2023-09-30T17:03:07.335 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.335 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.335 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:07.335 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376427+0000", 2023-09-30T17:03:07.336 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1709000000000003e-05 2023-09-30T17:03:07.336 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:07.336 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:07.336 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:07.336 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.336 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.336 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:07.336 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:07.336 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 48.909939420999997, 2023-09-30T17:03:07.336 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024076238, 2023-09-30T17:03:07.336 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:07.337 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:07.337 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:07.337 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.337 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:07.337 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:07.337 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:07.337 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.337 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.337 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:07.337 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:07.337 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:07.337 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.338 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.338 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:07.338 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:07.338 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8699999999999995e-07 2023-09-30T17:03:07.338 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.338 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.338 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:07.338 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353067+0000", 2023-09-30T17:03:07.338 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.605e-06 2023-09-30T17:03:07.338 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.338 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.339 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:07.339 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353073+0000", 2023-09-30T17:03:07.339 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8900000000000004e-06 2023-09-30T17:03:07.339 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.339 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.339 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:07.339 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353083+0000", 2023-09-30T17:03:07.339 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0200000000000001e-05 2023-09-30T17:03:07.339 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.339 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.339 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:07.339 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353186+0000", 2023-09-30T17:03:07.340 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010256599999999999 2023-09-30T17:03:07.340 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.340 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.340 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:07.340 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353190+0000", 2023-09-30T17:03:07.340 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9709999999999998e-06 2023-09-30T17:03:07.340 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.340 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.340 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:07.340 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362946+0000", 2023-09-30T17:03:07.340 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0097563330000000007 2023-09-30T17:03:07.340 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.341 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.341 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:07.341 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363088+0000", 2023-09-30T17:03:07.341 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014259200000000001 2023-09-30T17:03:07.341 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.341 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.341 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:07.341 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363555+0000", 2023-09-30T17:03:07.341 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00046627799999999998 2023-09-30T17:03:07.341 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.341 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.341 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:07.342 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365871+0000", 2023-09-30T17:03:07.342 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0023167589999999998 2023-09-30T17:03:07.342 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.342 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.342 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:07.342 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377033+0000", 2023-09-30T17:03:07.342 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011161203999999999 2023-09-30T17:03:07.342 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.342 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.342 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:07.342 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377100+0000", 2023-09-30T17:03:07.343 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7230999999999994e-05 2023-09-30T17:03:07.343 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.343 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.343 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:07.343 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377138+0000", 2023-09-30T17:03:07.343 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8022000000000003e-05 2023-09-30T17:03:07.343 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:07.343 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:07.343 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:07.343 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.343 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.343 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:07.344 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:03:07.344 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 48.909838471999997, 2023-09-30T17:03:07.344 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.020304412000000001, 2023-09-30T17:03:07.344 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:07.344 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:07.344 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:07.344 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.344 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:07.344 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:03:07.344 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:07.344 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.344 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.345 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:07.345 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:03:07.345 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:07.345 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.345 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.345 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:07.345 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353164+0000", 2023-09-30T17:03:07.345 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7100000000000011e-07 2023-09-30T17:03:07.345 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.345 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.345 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:07.346 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353168+0000", 2023-09-30T17:03:07.346 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0600000000000001e-06 2023-09-30T17:03:07.346 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.346 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.346 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:07.346 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353177+0000", 2023-09-30T17:03:07.346 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1409999999999994e-06 2023-09-30T17:03:07.346 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.346 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.346 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:07.346 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353185+0000", 2023-09-30T17:03:07.347 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2479999999999996e-06 2023-09-30T17:03:07.347 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.347 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.347 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:07.347 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353246+0000", 2023-09-30T17:03:07.347 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0519000000000001e-05 2023-09-30T17:03:07.347 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.347 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.347 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:07.347 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353252+0000", 2023-09-30T17:03:07.347 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7859999999999999e-06 2023-09-30T17:03:07.349 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.349 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.349 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:07.349 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354979+0000", 2023-09-30T17:03:07.349 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0017270090000000001 2023-09-30T17:03:07.349 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.349 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.349 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:07.350 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355097+0000", 2023-09-30T17:03:07.350 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000117472 2023-09-30T17:03:07.350 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.350 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.350 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:07.350 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.373467+0000", 2023-09-30T17:03:07.350 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.018370206 2023-09-30T17:03:07.350 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:07.350 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:07.350 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:07.350 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.351 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.351 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:07.351 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:03:07.351 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 48.909797734000001, 2023-09-30T17:03:07.351 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.012725089, 2023-09-30T17:03:07.351 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:07.351 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:07.351 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:07.351 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.351 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:07.351 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:03:07.352 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:07.352 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.352 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.352 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:07.352 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:03:07.352 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:07.352 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.352 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.352 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:07.352 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353204+0000", 2023-09-30T17:03:07.352 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7100000000000002e-07 2023-09-30T17:03:07.352 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.353 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.353 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:07.353 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353213+0000", 2023-09-30T17:03:07.353 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8580000000000006e-06 2023-09-30T17:03:07.353 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.353 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.353 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:07.353 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353219+0000", 2023-09-30T17:03:07.353 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8939999999999998e-06 2023-09-30T17:03:07.353 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.353 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.353 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:07.354 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353223+0000", 2023-09-30T17:03:07.354 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.357e-06 2023-09-30T17:03:07.354 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.354 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.354 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:07.354 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353278+0000", 2023-09-30T17:03:07.354 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5228e-05 2023-09-30T17:03:07.354 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.354 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.354 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:07.354 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353284+0000", 2023-09-30T17:03:07.355 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8209999999999998e-06 2023-09-30T17:03:07.355 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.355 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.355 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:07.355 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355095+0000", 2023-09-30T17:03:07.355 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001811404 2023-09-30T17:03:07.355 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.355 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.355 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:07.355 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355256+0000", 2023-09-30T17:03:07.355 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000160898 2023-09-30T17:03:07.356 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.356 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.356 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:07.356 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365928+0000", 2023-09-30T17:03:07.356 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010672157999999999 2023-09-30T17:03:07.356 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:07.356 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:07.356 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:07.356 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.356 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.356 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-09-30T17:03:07.356 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:03:07.357 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 48.909266527, 2023-09-30T17:03:07.357 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0056863460000000001, 2023-09-30T17:03:07.357 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:07.357 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "reached pg", 2023-09-30T17:03:07.357 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:07.357 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.357 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:07.357 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:03:07.357 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:07.357 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.357 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.358 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:07.358 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:03:07.358 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:07.358 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.358 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.358 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:07.358 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:03:07.358 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5700000000000002e-07 2023-09-30T17:03:07.358 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.358 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.358 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:07.358 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353747+0000", 2023-09-30T17:03:07.359 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1899000000000001e-05 2023-09-30T17:03:07.359 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.359 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.359 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:07.359 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353776+0000", 2023-09-30T17:03:07.359 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.8767000000000001e-05 2023-09-30T17:03:07.359 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.359 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.359 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:07.359 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353792+0000", 2023-09-30T17:03:07.359 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5914999999999999e-05 2023-09-30T17:03:07.359 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.360 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.360 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:07.360 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353900+0000", 2023-09-30T17:03:07.360 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010774500000000001 2023-09-30T17:03:07.360 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.360 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.360 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:07.360 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.359421+0000", 2023-09-30T17:03:07.360 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0055213629999999996 2023-09-30T17:03:07.360 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:07.360 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:07.360 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:07.361 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.361 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.361 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:03:07.361 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:03:07.361 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 48.908594927000003, 2023-09-30T17:03:07.361 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0069196370000000002, 2023-09-30T17:03:07.361 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:07.361 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:07.361 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:07.361 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.361 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:07.361 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:03:07.362 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:07.362 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.362 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.362 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:07.362 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:03:07.362 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:07.362 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.362 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.362 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:07.362 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354407+0000", 2023-09-30T17:03:07.362 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7400000000000002e-07 2023-09-30T17:03:07.363 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.363 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.363 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:07.363 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354414+0000", 2023-09-30T17:03:07.363 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1040000000000001e-06 2023-09-30T17:03:07.363 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.363 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.363 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:07.363 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354425+0000", 2023-09-30T17:03:07.363 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1090000000000001e-05 2023-09-30T17:03:07.363 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.363 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.363 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:07.364 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354435+0000", 2023-09-30T17:03:07.364 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8169999999999994e-06 2023-09-30T17:03:07.364 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.364 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.364 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:07.364 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355741+0000", 2023-09-30T17:03:07.364 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0013063160000000001 2023-09-30T17:03:07.364 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.364 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.364 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:07.364 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355763+0000", 2023-09-30T17:03:07.364 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1688e-05 2023-09-30T17:03:07.364 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.365 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.365 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:07.365 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361289+0000", 2023-09-30T17:03:07.365 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0055258269999999996 2023-09-30T17:03:07.365 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.365 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.365 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:07.365 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361326+0000", 2023-09-30T17:03:07.365 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7020999999999997e-05 2023-09-30T17:03:07.365 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:07.366 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:07.366 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:07.366 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.366 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.366 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:30 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2023-09-30T17:03:07.366 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:03:07.366 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 48.907220969000001, 2023-09-30T17:03:07.366 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0069996629999999997, 2023-09-30T17:03:07.366 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:07.366 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:07.366 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:07.366 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.367 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:07.367 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:03:07.367 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:07.367 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.367 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.367 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:07.367 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:03:07.367 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:07.367 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.367 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.367 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:07.368 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355781+0000", 2023-09-30T17:03:07.368 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9599999999999999e-07 2023-09-30T17:03:07.368 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.368 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.368 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:07.368 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355788+0000", 2023-09-30T17:03:07.368 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8129999999999996e-06 2023-09-30T17:03:07.368 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.368 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.368 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:07.368 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355798+0000", 2023-09-30T17:03:07.368 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2909999999999996e-06 2023-09-30T17:03:07.369 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.369 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.369 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:07.369 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355807+0000", 2023-09-30T17:03:07.369 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8619999999999992e-06 2023-09-30T17:03:07.369 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.369 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.369 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:07.369 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.357264+0000", 2023-09-30T17:03:07.369 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0014578289999999999 2023-09-30T17:03:07.369 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.369 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.370 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:07.370 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.357916+0000", 2023-09-30T17:03:07.370 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00065170500000000004 2023-09-30T17:03:07.370 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.370 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.370 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:07.370 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362731+0000", 2023-09-30T17:03:07.370 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0048149849999999999 2023-09-30T17:03:07.370 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.370 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.370 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:07.370 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362780+0000", 2023-09-30T17:03:07.371 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8681999999999999e-05 2023-09-30T17:03:07.371 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:07.371 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:07.371 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:07.371 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.371 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.371 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2023-09-30T17:03:07.371 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:03:07.371 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 48.888569918000002, 2023-09-30T17:03:07.371 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005905998, 2023-09-30T17:03:07.371 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:07.372 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:07.372 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:07.372 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.372 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:07.372 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:03:07.372 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:07.372 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.372 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.372 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:07.372 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:03:07.372 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:07.372 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.373 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.373 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:07.373 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:03:07.373 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1e-07 2023-09-30T17:03:07.373 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.373 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.373 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:07.373 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374455+0000", 2023-09-30T17:03:07.373 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.3091999999999998e-05 2023-09-30T17:03:07.373 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.373 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.374 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:07.374 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374462+0000", 2023-09-30T17:03:07.374 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5170000000000002e-06 2023-09-30T17:03:07.374 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.374 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.374 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:07.374 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374469+0000", 2023-09-30T17:03:07.374 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8199999999999999e-06 2023-09-30T17:03:07.374 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.374 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.375 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:07.375 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374550+0000", 2023-09-30T17:03:07.375 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0978999999999998e-05 2023-09-30T17:03:07.375 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.375 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.375 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:07.375 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374562+0000", 2023-09-30T17:03:07.375 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2472e-05 2023-09-30T17:03:07.375 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.375 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.375 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:07.375 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380293+0000", 2023-09-30T17:03:07.376 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0057310379999999999 2023-09-30T17:03:07.376 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.376 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.376 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:07.376 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380337+0000", 2023-09-30T17:03:07.376 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3869999999999998e-05 2023-09-30T17:03:07.376 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:07.376 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:07.376 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:07.376 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.376 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.376 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2023-09-30T17:03:07.377 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:03:07.377 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 48.888383169000001, 2023-09-30T17:03:07.377 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0057590560000000002, 2023-09-30T17:03:07.377 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:07.377 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:07.377 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:07.377 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.377 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:07.377 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:03:07.377 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:07.377 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.377 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.377 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:07.378 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:03:07.378 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:07.378 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.378 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.378 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:07.378 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:03:07.378 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4900000000000001e-07 2023-09-30T17:03:07.378 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.378 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.378 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:07.378 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374629+0000", 2023-09-30T17:03:07.378 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1014e-05 2023-09-30T17:03:07.379 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.379 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.379 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:07.379 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374636+0000", 2023-09-30T17:03:07.379 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5889999999999999e-06 2023-09-30T17:03:07.379 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.379 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.379 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:07.379 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374642+0000", 2023-09-30T17:03:07.379 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.48e-06 2023-09-30T17:03:07.379 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.379 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.380 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:07.380 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374681+0000", 2023-09-30T17:03:07.380 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9320000000000003e-05 2023-09-30T17:03:07.380 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.380 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.380 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:07.380 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374694+0000", 2023-09-30T17:03:07.380 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3351e-05 2023-09-30T17:03:07.380 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.380 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.380 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:07.381 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380319+0000", 2023-09-30T17:03:07.381 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0056243880000000001 2023-09-30T17:03:07.381 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.381 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.381 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:07.381 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380377+0000", 2023-09-30T17:03:07.381 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8464999999999997e-05 2023-09-30T17:03:07.381 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:07.381 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:07.381 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:07.381 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.381 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.382 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=0'0)", 2023-09-30T17:03:07.382 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:03:07.382 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 48.887672258000002, 2023-09-30T17:03:07.382 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051157370000000004, 2023-09-30T17:03:07.382 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:07.382 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:07.382 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:07.382 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.382 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:07.382 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:03:07.382 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:07.382 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.383 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.383 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:07.383 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:03:07.383 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:07.383 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.383 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.383 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:07.383 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:03:07.383 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0199999999999998e-07 2023-09-30T17:03:07.383 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.383 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.383 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:07.384 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375334+0000", 2023-09-30T17:03:07.384 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8799999999999999e-06 2023-09-30T17:03:07.384 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.384 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.384 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:07.384 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375343+0000", 2023-09-30T17:03:07.384 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5490000000000006e-06 2023-09-30T17:03:07.384 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.384 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.384 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:07.384 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375350+0000", 2023-09-30T17:03:07.384 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5700000000000004e-06 2023-09-30T17:03:07.385 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.385 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.385 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:07.385 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375396+0000", 2023-09-30T17:03:07.385 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5550999999999998e-05 2023-09-30T17:03:07.385 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.385 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.385 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:07.385 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375410+0000", 2023-09-30T17:03:07.385 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4518999999999999e-05 2023-09-30T17:03:07.385 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.385 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.386 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:07.386 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380401+0000", 2023-09-30T17:03:07.386 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0049903430000000004 2023-09-30T17:03:07.386 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:07.386 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:07.386 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:07.386 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380445+0000", 2023-09-30T17:03:07.386 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4023000000000002e-05 2023-09-30T17:03:07.386 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:07.386 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:07.386 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:07.387 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:07.387 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:07.387 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:07.387 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-09-30T17:03:07.388 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:07.388+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:07.389 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:03:07.489 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:07.488+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:07.523 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:07.523 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:03:07.523 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2023-09-30T17:03:07.523 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:07.533 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:03:07.616 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:07.615+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:07.691 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:07.691+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:07.700 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:07.700 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:03:07.700 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2023-09-30T17:03:07.700 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2023-09-30T17:03:07.700 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:07.709 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:03:07.794 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:07.793+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:07.878 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:07.878 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2023-09-30T17:03:07.878 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2023-09-30T17:03:07.878 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2023-09-30T17:03:07.878 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.878 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:07.878 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:03:07.878 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 49.524941018, 2023-09-30T17:03:07.879 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093789779999999996, 2023-09-30T17:03:07.879 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:07.879 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:07.879 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:07.879 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.879 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:07.879 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:03:07.879 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:07.879 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.879 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.879 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:07.879 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:03:07.879 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:07.880 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.880 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.880 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:07.880 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352027+0000", 2023-09-30T17:03:07.880 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0224000000000001e-05 2023-09-30T17:03:07.880 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.880 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.880 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:07.880 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352039+0000", 2023-09-30T17:03:07.880 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1569000000000001e-05 2023-09-30T17:03:07.880 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.880 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.881 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:07.881 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352052+0000", 2023-09-30T17:03:07.881 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2605999999999999e-05 2023-09-30T17:03:07.881 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.881 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.881 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:07.881 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352064+0000", 2023-09-30T17:03:07.881 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2666999999999999e-05 2023-09-30T17:03:07.881 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.881 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.881 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:07.881 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352147+0000", 2023-09-30T17:03:07.882 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3125000000000001e-05 2023-09-30T17:03:07.882 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.882 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.882 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:07.882 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352306+0000", 2023-09-30T17:03:07.882 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015881900000000001 2023-09-30T17:03:07.882 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.882 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.882 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:07.882 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352450+0000", 2023-09-30T17:03:07.882 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014420700000000001 2023-09-30T17:03:07.882 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.882 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.883 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:07.883 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355975+0000", 2023-09-30T17:03:07.883 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003524246 2023-09-30T17:03:07.883 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.883 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.883 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:07.883 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361279+0000", 2023-09-30T17:03:07.883 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005304507 2023-09-30T17:03:07.883 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.883 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.883 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:07.883 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361344+0000", 2023-09-30T17:03:07.884 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4548999999999995e-05 2023-09-30T17:03:07.884 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.884 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.884 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:07.884 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361396+0000", 2023-09-30T17:03:07.884 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2459e-05 2023-09-30T17:03:07.884 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:07.884 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:07.884 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:07.884 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.884 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.884 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:07.885 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:03:07.885 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 49.524848726000002, 2023-09-30T17:03:07.885 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021233007000000002, 2023-09-30T17:03:07.885 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:07.885 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:07.885 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:07.885 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.885 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:07.885 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:03:07.885 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:07.885 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.885 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.886 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:07.886 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:03:07.886 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:07.886 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.886 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.886 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:07.886 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352110+0000", 2023-09-30T17:03:07.886 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6000000000000002e-07 2023-09-30T17:03:07.886 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.886 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.886 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:07.886 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352117+0000", 2023-09-30T17:03:07.887 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5930000000000002e-06 2023-09-30T17:03:07.887 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.887 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.887 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:07.887 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352126+0000", 2023-09-30T17:03:07.887 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0729999999999994e-06 2023-09-30T17:03:07.887 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.887 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.887 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:07.887 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352136+0000", 2023-09-30T17:03:07.887 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0380000000000001e-05 2023-09-30T17:03:07.888 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.888 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.888 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:07.888 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353279+0000", 2023-09-30T17:03:07.888 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0011424670000000001 2023-09-30T17:03:07.888 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.888 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.888 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:07.888 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353707+0000", 2023-09-30T17:03:07.888 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00042829800000000003 2023-09-30T17:03:07.888 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.888 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.888 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:07.889 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354104+0000", 2023-09-30T17:03:07.889 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00039643399999999998 2023-09-30T17:03:07.889 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.889 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.889 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:07.889 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356925+0000", 2023-09-30T17:03:07.889 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0028210900000000001 2023-09-30T17:03:07.889 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.889 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.889 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:07.889 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373243+0000", 2023-09-30T17:03:07.889 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016318461999999999 2023-09-30T17:03:07.889 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.890 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.890 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:07.890 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373301+0000", 2023-09-30T17:03:07.890 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7435000000000002e-05 2023-09-30T17:03:07.890 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.890 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.890 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:07.890 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373342+0000", 2023-09-30T17:03:07.890 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1915000000000001e-05 2023-09-30T17:03:07.890 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:07.890 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:07.890 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:07.891 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.891 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.891 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:07.891 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:03:07.891 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 49.524806114999997, 2023-09-30T17:03:07.891 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011988331, 2023-09-30T17:03:07.891 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:07.891 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:07.891 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:07.891 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.891 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:07.891 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:03:07.892 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:07.892 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.892 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.892 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:07.892 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:03:07.892 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:07.892 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.892 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.892 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:07.892 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352153+0000", 2023-09-30T17:03:07.892 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0500000000000003e-07 2023-09-30T17:03:07.893 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.893 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.893 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:07.893 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352157+0000", 2023-09-30T17:03:07.893 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9790000000000004e-06 2023-09-30T17:03:07.893 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.893 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.893 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:07.893 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352173+0000", 2023-09-30T17:03:07.893 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6535999999999999e-05 2023-09-30T17:03:07.893 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.893 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.893 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:07.894 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352180+0000", 2023-09-30T17:03:07.894 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7700000000000004e-06 2023-09-30T17:03:07.894 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.894 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.894 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:07.894 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353526+0000", 2023-09-30T17:03:07.894 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0013458330000000001 2023-09-30T17:03:07.894 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.894 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.894 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:07.894 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353648+0000", 2023-09-30T17:03:07.894 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012262899999999999 2023-09-30T17:03:07.895 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.895 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.895 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:07.895 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354141+0000", 2023-09-30T17:03:07.895 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00049222899999999995 2023-09-30T17:03:07.895 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.895 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.895 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:07.895 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356931+0000", 2023-09-30T17:03:07.895 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0027900860000000002 2023-09-30T17:03:07.895 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.895 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.896 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:07.896 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364066+0000", 2023-09-30T17:03:07.896 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071355050000000003 2023-09-30T17:03:07.896 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.896 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.896 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:07.896 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364103+0000", 2023-09-30T17:03:07.896 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6944999999999999e-05 2023-09-30T17:03:07.896 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.896 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.896 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:07.897 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364140+0000", 2023-09-30T17:03:07.897 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7214e-05 2023-09-30T17:03:07.897 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:07.897 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:07.897 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:07.897 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.897 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.897 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:07.897 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:03:07.897 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 49.524766884000002, 2023-09-30T17:03:07.897 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012110921, 2023-09-30T17:03:07.897 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:07.897 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:07.898 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:07.898 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.898 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:07.898 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:03:07.898 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:07.898 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.898 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.898 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:07.898 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:03:07.898 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:07.898 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.898 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.899 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:07.899 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352192+0000", 2023-09-30T17:03:07.899 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7300000000000005e-07 2023-09-30T17:03:07.899 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.899 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.899 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:07.899 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352196+0000", 2023-09-30T17:03:07.899 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2370000000000003e-06 2023-09-30T17:03:07.899 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.899 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.899 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:07.899 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352205+0000", 2023-09-30T17:03:07.900 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6659999999999997e-06 2023-09-30T17:03:07.900 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.900 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.900 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:07.900 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352214+0000", 2023-09-30T17:03:07.900 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8259999999999999e-06 2023-09-30T17:03:07.900 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.900 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.900 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:07.900 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354470+0000", 2023-09-30T17:03:07.900 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022557340000000001 2023-09-30T17:03:07.900 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.900 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.901 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:07.901 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354557+0000", 2023-09-30T17:03:07.901 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6909000000000004e-05 2023-09-30T17:03:07.901 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.901 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.901 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:07.901 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354694+0000", 2023-09-30T17:03:07.901 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013774800000000001 2023-09-30T17:03:07.901 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.901 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.901 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:07.901 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356937+0000", 2023-09-30T17:03:07.902 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022424540000000001 2023-09-30T17:03:07.902 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.902 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.902 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:07.902 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364227+0000", 2023-09-30T17:03:07.902 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072902430000000001 2023-09-30T17:03:07.902 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.902 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.902 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:07.902 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364278+0000", 2023-09-30T17:03:07.902 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1180999999999997e-05 2023-09-30T17:03:07.902 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.903 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.903 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:07.903 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364302+0000", 2023-09-30T17:03:07.903 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4049999999999998e-05 2023-09-30T17:03:07.903 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:07.903 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:07.903 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:07.903 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.903 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.903 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:07.903 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:07.903 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 49.524733544999997, 2023-09-30T17:03:07.904 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021258651999999999, 2023-09-30T17:03:07.904 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:07.904 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:07.904 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:07.904 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.904 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:07.904 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:07.904 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:07.904 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.904 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.904 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:07.904 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:07.904 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:07.905 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.905 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.905 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:07.905 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:07.905 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6899999999999997e-07 2023-09-30T17:03:07.905 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.905 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.905 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:07.905 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352236+0000", 2023-09-30T17:03:07.905 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0251000000000001e-05 2023-09-30T17:03:07.905 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.905 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.906 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:07.906 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352244+0000", 2023-09-30T17:03:07.906 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0770000000000008e-06 2023-09-30T17:03:07.906 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.906 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.906 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:07.906 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352251+0000", 2023-09-30T17:03:07.906 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4749999999999996e-06 2023-09-30T17:03:07.906 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.906 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.906 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:07.907 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354455+0000", 2023-09-30T17:03:07.907 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022043660000000001 2023-09-30T17:03:07.907 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.907 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.907 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:07.907 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354577+0000", 2023-09-30T17:03:07.907 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000121054 2023-09-30T17:03:07.907 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.907 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.907 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:07.907 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354723+0000", 2023-09-30T17:03:07.907 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014693900000000001 2023-09-30T17:03:07.908 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.908 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.908 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:07.908 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356941+0000", 2023-09-30T17:03:07.908 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002217199 2023-09-30T17:03:07.908 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.908 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.908 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:07.908 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373392+0000", 2023-09-30T17:03:07.908 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016451774999999998 2023-09-30T17:03:07.908 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.908 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.908 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:07.909 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373445+0000", 2023-09-30T17:03:07.909 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.308e-05 2023-09-30T17:03:07.909 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.909 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.909 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:07.909 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373483+0000", 2023-09-30T17:03:07.909 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7766999999999999e-05 2023-09-30T17:03:07.909 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:07.909 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:07.909 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:07.909 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.909 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.910 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:07.910 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:07.910 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 49.524697453999998, 2023-09-30T17:03:07.910 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020903497, 2023-09-30T17:03:07.910 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:07.910 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:07.910 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:07.910 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.910 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:07.910 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:07.910 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:07.910 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.911 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.911 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:07.911 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:07.911 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:07.911 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.911 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.911 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:07.911 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:07.911 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0800000000000004e-07 2023-09-30T17:03:07.911 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.911 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.911 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:07.912 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352266+0000", 2023-09-30T17:03:07.912 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1280000000000001e-06 2023-09-30T17:03:07.912 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.912 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.912 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:07.912 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352273+0000", 2023-09-30T17:03:07.912 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3730000000000004e-06 2023-09-30T17:03:07.912 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.912 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.912 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:07.912 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352279+0000", 2023-09-30T17:03:07.912 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7699999999999998e-06 2023-09-30T17:03:07.913 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.913 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.913 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:07.913 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352334+0000", 2023-09-30T17:03:07.913 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5547999999999997e-05 2023-09-30T17:03:07.913 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.913 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.913 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:07.913 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352435+0000", 2023-09-30T17:03:07.913 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100688 2023-09-30T17:03:07.913 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.914 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.914 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:07.914 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352585+0000", 2023-09-30T17:03:07.914 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000150068 2023-09-30T17:03:07.914 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.914 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.914 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:07.914 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354912+0000", 2023-09-30T17:03:07.914 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0023266770000000001 2023-09-30T17:03:07.914 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.914 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.914 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:07.915 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373066+0000", 2023-09-30T17:03:07.915 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018154474 2023-09-30T17:03:07.915 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.915 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.915 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:07.915 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373122+0000", 2023-09-30T17:03:07.915 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6193000000000002e-05 2023-09-30T17:03:07.915 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.915 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.915 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:07.915 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373164+0000", 2023-09-30T17:03:07.915 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1869999999999997e-05 2023-09-30T17:03:07.916 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:07.916 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:07.916 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:07.916 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.916 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.916 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:07.916 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:03:07.916 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 49.524661778000002, 2023-09-30T17:03:07.916 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021015097999999999, 2023-09-30T17:03:07.916 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:07.916 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:07.916 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:07.917 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.917 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:07.917 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:03:07.917 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:07.917 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.917 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.917 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:07.917 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:03:07.917 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:07.917 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.917 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.917 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:07.917 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352297+0000", 2023-09-30T17:03:07.918 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8299999999999997e-07 2023-09-30T17:03:07.918 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.918 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.918 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:07.918 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352300+0000", 2023-09-30T17:03:07.918 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7460000000000001e-06 2023-09-30T17:03:07.918 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.918 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.918 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:07.918 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352307+0000", 2023-09-30T17:03:07.918 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4959999999999999e-06 2023-09-30T17:03:07.919 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.919 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.919 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:07.919 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352314+0000", 2023-09-30T17:03:07.919 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0190000000000001e-06 2023-09-30T17:03:07.919 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.919 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.919 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:07.919 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354070+0000", 2023-09-30T17:03:07.919 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001755936 2023-09-30T17:03:07.919 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.919 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.920 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:07.920 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354221+0000", 2023-09-30T17:03:07.920 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000150884 2023-09-30T17:03:07.920 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.920 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.920 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:07.920 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373311+0000", 2023-09-30T17:03:07.920 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019090434 2023-09-30T17:03:07.920 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:07.920 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:07.920 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:07.920 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.920 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.921 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:07.921 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:03:07.921 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 49.524633059000003, 2023-09-30T17:03:07.921 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021255174000000002, 2023-09-30T17:03:07.921 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:07.921 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:07.921 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:07.921 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.921 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:07.921 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:03:07.921 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:07.921 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.921 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.922 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:07.922 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:03:07.922 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:07.922 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.922 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.922 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:07.922 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352326+0000", 2023-09-30T17:03:07.922 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3200000000000005e-07 2023-09-30T17:03:07.922 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.922 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.922 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:07.922 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352349+0000", 2023-09-30T17:03:07.922 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3183000000000001e-05 2023-09-30T17:03:07.923 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.923 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.923 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:07.923 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352358+0000", 2023-09-30T17:03:07.923 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5230000000000001e-06 2023-09-30T17:03:07.923 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.923 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.923 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:07.923 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352365+0000", 2023-09-30T17:03:07.923 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3260000000000001e-06 2023-09-30T17:03:07.923 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.923 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.923 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:07.924 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355450+0000", 2023-09-30T17:03:07.924 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0030854049999999998 2023-09-30T17:03:07.924 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.924 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.924 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:07.924 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355583+0000", 2023-09-30T17:03:07.924 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000133189 2023-09-30T17:03:07.924 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.924 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.924 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:07.924 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373580+0000", 2023-09-30T17:03:07.924 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017997016000000001 2023-09-30T17:03:07.925 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:07.925 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:07.925 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:07.925 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.925 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.925 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:07.925 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:03:07.925 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 49.524581636000001, 2023-09-30T17:03:07.925 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010380537, 2023-09-30T17:03:07.925 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:07.925 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:07.926 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:07.926 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.926 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:07.926 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:03:07.926 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:07.926 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.926 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.926 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:07.926 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:03:07.926 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:07.926 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.926 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.926 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:07.927 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:03:07.927 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1500000000000003e-07 2023-09-30T17:03:07.927 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.927 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.927 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:07.927 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352381+0000", 2023-09-30T17:03:07.927 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6330000000000002e-06 2023-09-30T17:03:07.927 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.927 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.927 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:07.927 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352388+0000", 2023-09-30T17:03:07.927 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7229999999999998e-06 2023-09-30T17:03:07.928 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.928 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.928 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:07.928 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352394+0000", 2023-09-30T17:03:07.928 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1789999999999996e-06 2023-09-30T17:03:07.928 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.928 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.928 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:07.928 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353259+0000", 2023-09-30T17:03:07.928 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000865221 2023-09-30T17:03:07.928 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.928 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.928 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:07.929 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353391+0000", 2023-09-30T17:03:07.929 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013217700000000001 2023-09-30T17:03:07.929 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.929 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.929 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:07.929 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362757+0000", 2023-09-30T17:03:07.929 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093657889999999994 2023-09-30T17:03:07.929 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:07.929 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:07.929 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:07.929 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.929 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.930 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-09-30T17:03:07.930 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:03:07.930 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 49.518281344000002, 2023-09-30T17:03:07.930 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0061813579999999996, 2023-09-30T17:03:07.930 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:07.930 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2023-09-30T17:03:07.930 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:07.930 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.930 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:07.930 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:03:07.930 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:07.930 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.931 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.931 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:07.931 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:03:07.931 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:07.931 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.931 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.931 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:07.931 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:03:07.931 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5499999999999999e-07 2023-09-30T17:03:07.931 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.931 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.931 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:07.932 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358686+0000", 2023-09-30T17:03:07.932 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9979999999999992e-06 2023-09-30T17:03:07.932 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.932 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.932 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:07.932 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358700+0000", 2023-09-30T17:03:07.932 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3635000000000001e-05 2023-09-30T17:03:07.932 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.932 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.932 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:07.932 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358714+0000", 2023-09-30T17:03:07.932 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4470999999999999e-05 2023-09-30T17:03:07.932 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.933 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.933 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:07.933 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358767+0000", 2023-09-30T17:03:07.933 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2651999999999997e-05 2023-09-30T17:03:07.933 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.933 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.933 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:07.933 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364858+0000", 2023-09-30T17:03:07.933 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060912470000000002 2023-09-30T17:03:07.933 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:07.933 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:07.933 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:07.933 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.934 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.934 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2023-09-30T17:03:07.934 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:03:07.934 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 49.515916504000003, 2023-09-30T17:03:07.934 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00036246299999999999, 2023-09-30T17:03:07.934 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:07.934 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:07.934 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:07.934 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.934 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:07.934 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:03:07.934 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:07.935 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.935 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.935 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:07.935 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:03:07.935 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:07.935 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.935 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.935 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:07.935 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:03:07.935 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3099999999999999e-07 2023-09-30T17:03:07.935 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.935 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.936 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:07.936 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361045+0000", 2023-09-30T17:03:07.936 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.49e-06 2023-09-30T17:03:07.936 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.936 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.936 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:07.936 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361056+0000", 2023-09-30T17:03:07.936 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0910000000000001e-05 2023-09-30T17:03:07.936 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.936 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.936 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:07.936 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361067+0000", 2023-09-30T17:03:07.937 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0531e-05 2023-09-30T17:03:07.937 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.937 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.937 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:07.937 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361263+0000", 2023-09-30T17:03:07.937 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000196486 2023-09-30T17:03:07.937 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.937 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.937 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:07.937 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361273+0000", 2023-09-30T17:03:07.937 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3379999999999994e-06 2023-09-30T17:03:07.937 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.938 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.938 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:07.938 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361404+0000", 2023-09-30T17:03:07.938 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013137700000000001 2023-09-30T17:03:07.938 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:07.938 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:07.938 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:07.938 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.938 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.938 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:31 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:03:07.938 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:03:07.938 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 49.514940475000003, 2023-09-30T17:03:07.939 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006676408, 2023-09-30T17:03:07.939 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:07.939 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:07.939 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:07.939 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.939 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:07.939 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:03:07.939 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:07.939 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.939 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.939 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:07.939 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:03:07.940 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:07.940 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.940 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.940 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:07.940 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:03:07.940 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5600000000000002e-07 2023-09-30T17:03:07.940 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.940 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.940 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:07.940 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362044+0000", 2023-09-30T17:03:07.940 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5987999999999999e-05 2023-09-30T17:03:07.940 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.940 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.941 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:07.941 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362051+0000", 2023-09-30T17:03:07.941 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2599999999999999e-06 2023-09-30T17:03:07.941 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.941 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.941 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:07.941 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362057+0000", 2023-09-30T17:03:07.941 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.19e-06 2023-09-30T17:03:07.941 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.941 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.941 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:07.942 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362096+0000", 2023-09-30T17:03:07.942 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8278000000000002e-05 2023-09-30T17:03:07.942 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.942 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.942 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:07.942 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362114+0000", 2023-09-30T17:03:07.942 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8808e-05 2023-09-30T17:03:07.942 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.942 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.942 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:07.942 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368658+0000", 2023-09-30T17:03:07.942 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065433540000000004 2023-09-30T17:03:07.943 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.943 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.943 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:07.943 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368694+0000", 2023-09-30T17:03:07.943 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6273999999999999e-05 2023-09-30T17:03:07.943 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:07.943 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:07.943 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:07.943 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.943 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.943 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:26 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-09-30T17:03:07.943 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:03:07.944 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 49.514849703000003, 2023-09-30T17:03:07.944 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0066596119999999996, 2023-09-30T17:03:07.944 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:07.944 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:07.944 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:07.944 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.944 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:07.944 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:03:07.944 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:07.944 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.944 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.944 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:07.945 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:03:07.945 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:07.945 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.945 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.945 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:07.945 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362109+0000", 2023-09-30T17:03:07.945 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5699999999999999e-07 2023-09-30T17:03:07.945 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.945 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.945 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:07.945 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362112+0000", 2023-09-30T17:03:07.945 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8410000000000002e-06 2023-09-30T17:03:07.945 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.946 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.946 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:07.946 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362117+0000", 2023-09-30T17:03:07.946 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.792e-06 2023-09-30T17:03:07.946 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.946 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.946 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:07.946 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362122+0000", 2023-09-30T17:03:07.946 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.763e-06 2023-09-30T17:03:07.946 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.946 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.947 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:07.947 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362344+0000", 2023-09-30T17:03:07.947 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022181600000000001 2023-09-30T17:03:07.947 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.947 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.947 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:07.947 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362357+0000", 2023-09-30T17:03:07.947 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2864000000000001e-05 2023-09-30T17:03:07.947 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.947 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.947 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:07.947 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368738+0000", 2023-09-30T17:03:07.948 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063809499999999998 2023-09-30T17:03:07.948 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.948 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.948 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:07.948 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368768+0000", 2023-09-30T17:03:07.948 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0429e-05 2023-09-30T17:03:07.948 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:07.948 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:07.948 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:07.948 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.948 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.948 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2023-09-30T17:03:07.948 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:03:07.949 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 49.513633536, 2023-09-30T17:03:07.949 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00082185400000000001, 2023-09-30T17:03:07.949 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:07.949 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:07.949 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:07.949 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.949 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:07.949 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:03:07.949 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:07.949 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.949 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.949 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:07.950 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:03:07.950 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:07.950 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.950 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.950 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:07.950 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:03:07.950 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.22e-07 2023-09-30T17:03:07.950 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.950 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.950 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:07.950 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363327+0000", 2023-09-30T17:03:07.950 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4480000000000001e-06 2023-09-30T17:03:07.951 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.951 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.951 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:07.951 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363333+0000", 2023-09-30T17:03:07.951 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9989999999999997e-06 2023-09-30T17:03:07.951 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.951 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.951 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:07.951 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363354+0000", 2023-09-30T17:03:07.951 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0547000000000002e-05 2023-09-30T17:03:07.951 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.951 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.952 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:07.952 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364057+0000", 2023-09-30T17:03:07.952 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00070306600000000002 2023-09-30T17:03:07.952 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.952 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.952 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:07.952 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364063+0000", 2023-09-30T17:03:07.952 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.694e-06 2023-09-30T17:03:07.952 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.952 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.952 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:07.952 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364146+0000", 2023-09-30T17:03:07.953 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3877999999999999e-05 2023-09-30T17:03:07.953 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:07.953 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:07.953 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:07.953 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.953 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.953 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e18/16 ondisk, result = 0)", 2023-09-30T17:03:07.953 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:03:07.953 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 49.513320004000001, 2023-09-30T17:03:07.953 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00067007199999999996, 2023-09-30T17:03:07.953 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:07.953 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:07.954 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:07.954 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.954 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:07.954 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:03:07.954 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:07.954 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.954 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.954 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:07.954 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:03:07.954 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:07.954 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.954 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.955 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:07.955 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:03:07.955 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.41e-07 2023-09-30T17:03:07.955 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.955 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.955 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:07.955 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363641+0000", 2023-09-30T17:03:07.955 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4830000000000002e-06 2023-09-30T17:03:07.955 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.955 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.955 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:07.955 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363647+0000", 2023-09-30T17:03:07.956 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4869999999999999e-06 2023-09-30T17:03:07.956 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.956 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.956 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:07.956 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363654+0000", 2023-09-30T17:03:07.956 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5889999999999999e-06 2023-09-30T17:03:07.956 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.956 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.956 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:07.956 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364217+0000", 2023-09-30T17:03:07.956 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00056263199999999998 2023-09-30T17:03:07.956 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.956 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.957 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:07.957 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364222+0000", 2023-09-30T17:03:07.957 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.242e-06 2023-09-30T17:03:07.957 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.957 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.957 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:07.957 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364308+0000", 2023-09-30T17:03:07.957 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6397999999999995e-05 2023-09-30T17:03:07.957 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:07.957 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:07.957 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:07.957 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.958 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.958 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2023-09-30T17:03:07.958 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:03:07.958 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 49.503732094, 2023-09-30T17:03:07.958 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000359561, 2023-09-30T17:03:07.958 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:07.958 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2023-09-30T17:03:07.958 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:07.958 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.958 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:07.958 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:03:07.958 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:07.958 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.959 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.959 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:07.959 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:03:07.959 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:07.959 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.959 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.959 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:07.959 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:03:07.959 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1e-07 2023-09-30T17:03:07.959 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.959 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.961 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:07.961 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373228+0000", 2023-09-30T17:03:07.961 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9420000000000002e-06 2023-09-30T17:03:07.961 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.961 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.961 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:07.961 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373235+0000", 2023-09-30T17:03:07.962 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4230000000000002e-06 2023-09-30T17:03:07.962 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.962 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.962 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:07.962 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373239+0000", 2023-09-30T17:03:07.962 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6809999999999997e-06 2023-09-30T17:03:07.962 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.962 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.962 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:07.962 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373518+0000", 2023-09-30T17:03:07.962 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000278311 2023-09-30T17:03:07.962 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.963 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.963 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:07.963 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373586+0000", 2023-09-30T17:03:07.963 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7994e-05 2023-09-30T17:03:07.963 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:07.963 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:07.963 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:07.963 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.963 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.963 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:03:07.963 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:03:07.963 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 49.499306021000002, 2023-09-30T17:03:07.964 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0046632949999999996, 2023-09-30T17:03:07.964 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:07.964 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:07.964 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:07.964 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.964 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:07.964 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:03:07.964 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:07.964 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.964 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.964 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:07.964 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:03:07.965 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:07.965 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.965 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.965 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:07.965 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377653+0000", 2023-09-30T17:03:07.965 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7800000000000002e-07 2023-09-30T17:03:07.965 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.965 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.965 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:07.965 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377657+0000", 2023-09-30T17:03:07.965 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5859999999999998e-06 2023-09-30T17:03:07.965 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.966 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.966 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:07.966 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377677+0000", 2023-09-30T17:03:07.966 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9508999999999999e-05 2023-09-30T17:03:07.966 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.966 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.966 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:07.966 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377682+0000", 2023-09-30T17:03:07.966 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8300000000000001e-06 2023-09-30T17:03:07.966 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.966 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.966 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:07.967 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377725+0000", 2023-09-30T17:03:07.967 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2425000000000001e-05 2023-09-30T17:03:07.967 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.967 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.967 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:07.967 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377738+0000", 2023-09-30T17:03:07.967 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2899e-05 2023-09-30T17:03:07.967 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.967 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.967 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:07.967 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382268+0000", 2023-09-30T17:03:07.967 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045301289999999999 2023-09-30T17:03:07.968 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.968 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.968 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:07.968 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382315+0000", 2023-09-30T17:03:07.968 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7539e-05 2023-09-30T17:03:07.968 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:07.968 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:07.968 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:07.968 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.968 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.968 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-09-30T17:03:07.968 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:03:07.968 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 49.498856570000001, 2023-09-30T17:03:07.969 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042540670000000003, 2023-09-30T17:03:07.969 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:07.969 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:07.969 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:07.969 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.969 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:07.969 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:03:07.969 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:07.969 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.969 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.969 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:07.969 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:03:07.970 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:07.970 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.970 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.970 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:07.970 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:03:07.970 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0299999999999998e-07 2023-09-30T17:03:07.970 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.970 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.970 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:07.970 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378107+0000", 2023-09-30T17:03:07.970 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9250000000000003e-06 2023-09-30T17:03:07.970 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.971 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.971 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:07.971 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378116+0000", 2023-09-30T17:03:07.971 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.037e-06 2023-09-30T17:03:07.971 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.971 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.971 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:07.971 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378123+0000", 2023-09-30T17:03:07.971 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1879999999999996e-06 2023-09-30T17:03:07.971 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.971 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.971 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:07.972 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378174+0000", 2023-09-30T17:03:07.972 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0998000000000002e-05 2023-09-30T17:03:07.972 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.972 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.972 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:07.972 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378197+0000", 2023-09-30T17:03:07.972 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2558e-05 2023-09-30T17:03:07.972 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.972 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.972 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:07.972 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382319+0000", 2023-09-30T17:03:07.972 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041220950000000001 2023-09-30T17:03:07.973 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.973 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.973 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:07.973 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382356+0000", 2023-09-30T17:03:07.973 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6563000000000002e-05 2023-09-30T17:03:07.973 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:07.973 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:07.973 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:07.973 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.973 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.973 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-09-30T17:03:07.973 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:03:07.973 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 45.441092746000002, 2023-09-30T17:03:07.974 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00171641, 2023-09-30T17:03:07.974 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:07.974 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:07.974 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:07.974 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.974 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:07.974 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:03:07.974 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:07.974 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.974 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.974 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:07.974 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:03:07.975 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:07.975 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.975 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.975 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:07.975 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435868+0000", 2023-09-30T17:03:07.975 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5840000000000002e-06 2023-09-30T17:03:07.975 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.975 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.975 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:07.975 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435892+0000", 2023-09-30T17:03:07.975 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3625000000000002e-05 2023-09-30T17:03:07.976 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.976 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.976 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:07.976 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435908+0000", 2023-09-30T17:03:07.976 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6548000000000001e-05 2023-09-30T17:03:07.976 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.976 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.976 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:07.976 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435935+0000", 2023-09-30T17:03:07.976 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6516000000000002e-05 2023-09-30T17:03:07.976 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.976 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.976 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:07.977 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435996+0000", 2023-09-30T17:03:07.977 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1433999999999995e-05 2023-09-30T17:03:07.977 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.977 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.977 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:07.977 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436114+0000", 2023-09-30T17:03:07.977 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000118344 2023-09-30T17:03:07.977 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.977 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.977 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:07.977 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436219+0000", 2023-09-30T17:03:07.977 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010453100000000001 2023-09-30T17:03:07.977 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.978 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.978 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:07.978 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436900+0000", 2023-09-30T17:03:07.978 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00068121299999999996 2023-09-30T17:03:07.978 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.978 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.978 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:07.978 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437508+0000", 2023-09-30T17:03:07.978 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00060817399999999995 2023-09-30T17:03:07.978 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.978 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.978 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:07.978 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437554+0000", 2023-09-30T17:03:07.979 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5609000000000003e-05 2023-09-30T17:03:07.979 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.979 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.979 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:07.979 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437582+0000", 2023-09-30T17:03:07.979 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7832000000000001e-05 2023-09-30T17:03:07.979 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:07.979 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:07.979 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:07.979 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.979 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.979 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2023-09-30T17:03:07.979 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:03:07.980 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 25.440781252000001, 2023-09-30T17:03:07.980 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001456199, 2023-09-30T17:03:07.980 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:07.980 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:07.980 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:07.980 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.980 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:07.980 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:03:07.980 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:07.980 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.980 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.980 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:07.980 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:03:07.981 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:07.981 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.981 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.981 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:07.981 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436178+0000", 2023-09-30T17:03:07.981 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.494e-06 2023-09-30T17:03:07.981 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.981 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.981 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:07.981 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436184+0000", 2023-09-30T17:03:07.981 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2809999999999999e-06 2023-09-30T17:03:07.981 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.982 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.982 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:07.982 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436198+0000", 2023-09-30T17:03:07.982 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3978000000000001e-05 2023-09-30T17:03:07.982 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.982 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.982 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:07.982 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436206+0000", 2023-09-30T17:03:07.982 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8040000000000007e-06 2023-09-30T17:03:07.982 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.982 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.982 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:07.982 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436268+0000", 2023-09-30T17:03:07.983 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1484999999999998e-05 2023-09-30T17:03:07.983 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.983 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.983 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:07.983 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436339+0000", 2023-09-30T17:03:07.983 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1000000000000005e-05 2023-09-30T17:03:07.983 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.983 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.983 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:07.983 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436438+0000", 2023-09-30T17:03:07.983 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9389000000000007e-05 2023-09-30T17:03:07.983 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.984 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.984 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:07.984 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436986+0000", 2023-09-30T17:03:07.984 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054723399999999996 2023-09-30T17:03:07.984 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.984 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.984 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:07.984 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437566+0000", 2023-09-30T17:03:07.984 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00058017599999999996 2023-09-30T17:03:07.984 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.984 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.984 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:07.985 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437606+0000", 2023-09-30T17:03:07.985 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9891999999999997e-05 2023-09-30T17:03:07.985 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:07.985 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:07.985 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:07.985 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437633+0000", 2023-09-30T17:03:07.985 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7466000000000001e-05 2023-09-30T17:03:07.985 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:07.985 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:07.985 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:07.985 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:07.985 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:07.986 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:07.987 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:07.986+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:07.987 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:03:08.087 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:08.086+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:08.132 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:08.133 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:03:08.133 INFO:teuthology.orchestra.run.smithi031.stdout: "num_ops": 0 2023-09-30T17:03:08.133 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:08.143 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:03:08.188 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:08.188+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:08.289 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:08.289+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:08.304 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is unset 2023-09-30T17:03:08.317 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:08.318 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:03:08.318 INFO:teuthology.orchestra.run.smithi031.stdout: "complaint_time": 30, 2023-09-30T17:03:08.318 INFO:teuthology.orchestra.run.smithi031.stdout: "num_blocked_ops": 0 2023-09-30T17:03:08.318 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:08.328 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:03:08.390 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:08.390+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:08.461 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:08.461 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 20, 2023-09-30T17:03:08.461 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 600, 2023-09-30T17:03:08.462 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:03:08.462 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.462 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:32 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'18, mlcod=11'14)", 2023-09-30T17:03:08.462 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:03:08.462 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 61.099007204000003, 2023-09-30T17:03:08.462 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051629809999999996, 2023-09-30T17:03:08.462 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:08.462 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:08.462 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:08.462 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.462 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:08.463 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:03:08.463 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:08.463 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.463 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.463 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:08.463 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:03:08.463 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:08.463 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.463 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.463 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:08.463 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:03:08.463 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2099999999999996e-07 2023-09-30T17:03:08.464 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.464 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.464 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:08.464 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361407+0000", 2023-09-30T17:03:08.464 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7499e-05 2023-09-30T17:03:08.464 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.464 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.464 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:08.464 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361418+0000", 2023-09-30T17:03:08.464 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1127999999999999e-05 2023-09-30T17:03:08.464 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.464 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.464 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:08.465 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361423+0000", 2023-09-30T17:03:08.465 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1930000000000001e-06 2023-09-30T17:03:08.465 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.465 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.465 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:08.465 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361476+0000", 2023-09-30T17:03:08.465 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3399000000000002e-05 2023-09-30T17:03:08.465 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.465 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.465 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:08.465 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361496+0000", 2023-09-30T17:03:08.465 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9638000000000001e-05 2023-09-30T17:03:08.466 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.466 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.466 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:08.466 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.366474+0000", 2023-09-30T17:03:08.466 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0049778829999999998 2023-09-30T17:03:08.466 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.466 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.466 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:08.466 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.366512+0000", 2023-09-30T17:03:08.466 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7620000000000002e-05 2023-09-30T17:03:08.466 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:08.467 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:08.467 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:08.467 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.467 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.467 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:37 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'23, mlcod=11'15)", 2023-09-30T17:03:08.467 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:03:08.467 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 61.096405206999997, 2023-09-30T17:03:08.467 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053985689999999998, 2023-09-30T17:03:08.467 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:08.467 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:08.467 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:08.467 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.468 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:08.468 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:03:08.468 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:08.468 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.468 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.468 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:08.468 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:03:08.468 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:08.468 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.468 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.468 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:08.468 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:03:08.468 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4400000000000001e-07 2023-09-30T17:03:08.469 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.469 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.469 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:08.469 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363956+0000", 2023-09-30T17:03:08.469 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.921e-06 2023-09-30T17:03:08.469 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.469 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.469 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:08.469 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363966+0000", 2023-09-30T17:03:08.469 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0351e-05 2023-09-30T17:03:08.469 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.470 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.470 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:08.470 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363971+0000", 2023-09-30T17:03:08.470 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.023e-06 2023-09-30T17:03:08.470 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.470 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.470 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:08.470 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.364013+0000", 2023-09-30T17:03:08.470 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1575000000000001e-05 2023-09-30T17:03:08.470 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.470 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.471 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:08.471 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.364026+0000", 2023-09-30T17:03:08.471 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3044000000000001e-05 2023-09-30T17:03:08.471 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.471 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.471 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:08.471 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.369308+0000", 2023-09-30T17:03:08.471 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005282152 2023-09-30T17:03:08.471 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.471 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.471 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:08.471 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.369349+0000", 2023-09-30T17:03:08.472 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1059000000000001e-05 2023-09-30T17:03:08.472 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:08.472 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:08.472 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:08.472 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.472 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.472 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:155 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'109, mlcod=11'105)", 2023-09-30T17:03:08.472 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:03:08.472 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 60.614709521000002, 2023-09-30T17:03:08.472 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053867639999999996, 2023-09-30T17:03:08.472 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:08.472 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:08.473 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:08.473 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.473 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:08.473 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:03:08.473 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:08.473 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.473 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.473 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:08.473 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:03:08.473 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:08.473 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.473 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.473 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:08.474 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845647+0000", 2023-09-30T17:03:08.474 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7599999999999997e-07 2023-09-30T17:03:08.474 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.474 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.474 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:08.474 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845699+0000", 2023-09-30T17:03:08.474 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1758000000000001e-05 2023-09-30T17:03:08.474 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.474 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.474 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:08.474 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845708+0000", 2023-09-30T17:03:08.475 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2159999999999995e-06 2023-09-30T17:03:08.475 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.475 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.475 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:08.475 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845712+0000", 2023-09-30T17:03:08.475 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2579999999999997e-06 2023-09-30T17:03:08.475 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.475 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.475 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:08.475 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845756+0000", 2023-09-30T17:03:08.475 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4119999999999998e-05 2023-09-30T17:03:08.475 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.476 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.476 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:08.476 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845779+0000", 2023-09-30T17:03:08.476 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2311e-05 2023-09-30T17:03:08.476 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.476 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.476 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:08.476 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.850982+0000", 2023-09-30T17:03:08.476 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005203053 2023-09-30T17:03:08.476 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.476 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.476 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:08.477 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851033+0000", 2023-09-30T17:03:08.477 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1471999999999998e-05 2023-09-30T17:03:08.477 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:08.477 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:08.477 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:08.477 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.477 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.477 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:156 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'110, mlcod=11'105)", 2023-09-30T17:03:08.477 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:03:08.477 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 60.614176595000004, 2023-09-30T17:03:08.477 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0052834759999999996, 2023-09-30T17:03:08.477 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:08.478 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:08.478 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:08.478 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.478 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:08.478 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:03:08.478 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:08.478 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.478 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.478 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:08.478 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:03:08.479 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:08.479 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.479 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.479 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:08.479 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846180+0000", 2023-09-30T17:03:08.479 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6300000000000005e-07 2023-09-30T17:03:08.479 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.479 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.479 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:08.479 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846184+0000", 2023-09-30T17:03:08.479 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3789999999999999e-06 2023-09-30T17:03:08.479 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.479 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.480 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:08.480 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846195+0000", 2023-09-30T17:03:08.480 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0778000000000001e-05 2023-09-30T17:03:08.480 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.480 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.480 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:08.480 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846200+0000", 2023-09-30T17:03:08.480 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1540000000000001e-06 2023-09-30T17:03:08.480 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.480 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.480 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:08.480 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846274+0000", 2023-09-30T17:03:08.481 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4129999999999997e-05 2023-09-30T17:03:08.481 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.481 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.481 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:08.481 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846286+0000", 2023-09-30T17:03:08.481 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1744e-05 2023-09-30T17:03:08.481 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.481 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.481 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:08.481 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851432+0000", 2023-09-30T17:03:08.481 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051462110000000004 2023-09-30T17:03:08.481 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.482 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.482 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:08.482 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851463+0000", 2023-09-30T17:03:08.482 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0516999999999999e-05 2023-09-30T17:03:08.482 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:08.482 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:08.482 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:08.482 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.482 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.482 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:203 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'149, mlcod=11'145)", 2023-09-30T17:03:08.482 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:03:08.482 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 60.258140685999997, 2023-09-30T17:03:08.483 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051867459999999999, 2023-09-30T17:03:08.483 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:08.483 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:08.483 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:08.483 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.483 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:08.483 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:03:08.483 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:08.483 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.483 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.483 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:08.483 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:03:08.483 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:08.484 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.484 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.484 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:08.484 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202216+0000", 2023-09-30T17:03:08.484 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7e-07 2023-09-30T17:03:08.484 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.484 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.484 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:08.484 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202271+0000", 2023-09-30T17:03:08.484 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5163e-05 2023-09-30T17:03:08.484 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.484 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.485 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:08.485 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202282+0000", 2023-09-30T17:03:08.485 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1319e-05 2023-09-30T17:03:08.485 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.485 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.485 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:08.485 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202288+0000", 2023-09-30T17:03:08.485 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2899999999999999e-06 2023-09-30T17:03:08.485 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.485 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.485 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:08.485 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202331+0000", 2023-09-30T17:03:08.486 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2147999999999997e-05 2023-09-30T17:03:08.486 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.486 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.486 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:08.486 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202348+0000", 2023-09-30T17:03:08.486 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7317e-05 2023-09-30T17:03:08.486 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.486 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.486 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:08.486 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.207357+0000", 2023-09-30T17:03:08.486 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0050095440000000003 2023-09-30T17:03:08.486 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.486 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.487 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:08.487 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.207402+0000", 2023-09-30T17:03:08.487 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4495e-05 2023-09-30T17:03:08.487 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:08.487 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:08.487 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:08.487 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.487 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.487 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:08.487 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:03:08.487 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 50.108810398000003, 2023-09-30T17:03:08.487 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.025313649000000001, 2023-09-30T17:03:08.488 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:08.488 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:08.488 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:08.488 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.488 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:08.488 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:03:08.488 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:08.488 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.488 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.488 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:08.488 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:03:08.488 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:08.489 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.489 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.489 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:08.489 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351551+0000", 2023-09-30T17:03:08.489 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3380000000000004e-06 2023-09-30T17:03:08.489 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.489 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.489 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:08.489 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351559+0000", 2023-09-30T17:03:08.489 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9589999999999995e-06 2023-09-30T17:03:08.489 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.489 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.489 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:08.490 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351571+0000", 2023-09-30T17:03:08.490 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2065999999999999e-05 2023-09-30T17:03:08.490 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.490 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.490 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:08.490 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351706+0000", 2023-09-30T17:03:08.490 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00013553799999999999 2023-09-30T17:03:08.490 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.490 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.490 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:08.490 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353016+0000", 2023-09-30T17:03:08.490 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0013099209999999999 2023-09-30T17:03:08.491 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.491 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.491 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:08.491 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353023+0000", 2023-09-30T17:03:08.491 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2479999999999999e-06 2023-09-30T17:03:08.491 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.491 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.491 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:08.491 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360348+0000", 2023-09-30T17:03:08.491 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0073248949999999997 2023-09-30T17:03:08.491 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.491 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.492 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:08.492 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360787+0000", 2023-09-30T17:03:08.492 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00043875199999999999 2023-09-30T17:03:08.492 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.492 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.492 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:08.492 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360892+0000", 2023-09-30T17:03:08.492 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010508199999999999 2023-09-30T17:03:08.492 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.492 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.492 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:08.492 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365132+0000", 2023-09-30T17:03:08.493 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0042396480000000004 2023-09-30T17:03:08.493 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.493 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.493 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:08.493 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376746+0000", 2023-09-30T17:03:08.493 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011614157 2023-09-30T17:03:08.493 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.493 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.493 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:08.493 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376811+0000", 2023-09-30T17:03:08.493 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5005999999999994e-05 2023-09-30T17:03:08.493 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.494 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.494 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:08.494 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376859+0000", 2023-09-30T17:03:08.494 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8038999999999999e-05 2023-09-30T17:03:08.494 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:08.494 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:08.494 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:08.494 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.494 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.494 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:08.494 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:03:08.494 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 50.108312599000001, 2023-09-30T17:03:08.495 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024923989000000001, 2023-09-30T17:03:08.495 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:08.495 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:08.495 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:08.495 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.495 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:08.495 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:03:08.495 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:08.495 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.495 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.495 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:08.495 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:03:08.496 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:08.496 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.496 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.496 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:08.496 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352044+0000", 2023-09-30T17:03:08.496 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9199999999999999e-07 2023-09-30T17:03:08.496 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.496 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.496 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:08.496 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352050+0000", 2023-09-30T17:03:08.496 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8880000000000002e-06 2023-09-30T17:03:08.496 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.497 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.497 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:08.497 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352143+0000", 2023-09-30T17:03:08.497 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2721999999999998e-05 2023-09-30T17:03:08.497 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.497 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.497 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:08.497 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352155+0000", 2023-09-30T17:03:08.497 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2279000000000001e-05 2023-09-30T17:03:08.497 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.497 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.497 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:08.498 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353114+0000", 2023-09-30T17:03:08.498 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00095943700000000005 2023-09-30T17:03:08.498 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.498 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.498 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:08.498 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353121+0000", 2023-09-30T17:03:08.498 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.494e-06 2023-09-30T17:03:08.498 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.498 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.498 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:08.498 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361491+0000", 2023-09-30T17:03:08.498 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0083697359999999991 2023-09-30T17:03:08.499 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.499 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.499 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:08.499 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361573+0000", 2023-09-30T17:03:08.499 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2822000000000001e-05 2023-09-30T17:03:08.499 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.499 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.499 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:08.499 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362166+0000", 2023-09-30T17:03:08.499 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00059223299999999995 2023-09-30T17:03:08.499 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.499 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.500 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:08.500 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365209+0000", 2023-09-30T17:03:08.500 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.003043212 2023-09-30T17:03:08.500 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.500 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.500 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:08.500 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376910+0000", 2023-09-30T17:03:08.500 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011700898 2023-09-30T17:03:08.500 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.500 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.500 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:08.500 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376945+0000", 2023-09-30T17:03:08.501 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4795000000000001e-05 2023-09-30T17:03:08.501 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.501 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.501 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:08.501 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376967+0000", 2023-09-30T17:03:08.501 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2580999999999999e-05 2023-09-30T17:03:08.501 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:08.501 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:08.501 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:08.501 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.501 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.501 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:08.502 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:03:08.502 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 50.108142678999997, 2023-09-30T17:03:08.502 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023120405, 2023-09-30T17:03:08.502 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:08.502 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:08.502 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:08.502 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.502 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:08.502 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:03:08.502 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:08.502 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.502 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.503 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:08.503 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:03:08.503 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:08.503 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.503 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.503 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:08.503 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352214+0000", 2023-09-30T17:03:08.503 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8400000000000003e-07 2023-09-30T17:03:08.503 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.503 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.503 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:08.503 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352233+0000", 2023-09-30T17:03:08.504 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8946000000000001e-05 2023-09-30T17:03:08.504 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.504 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.504 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:08.504 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352297+0000", 2023-09-30T17:03:08.504 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3540999999999994e-05 2023-09-30T17:03:08.504 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.504 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.504 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:08.504 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352450+0000", 2023-09-30T17:03:08.504 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015364799999999999 2023-09-30T17:03:08.504 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.505 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.505 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:08.505 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353098+0000", 2023-09-30T17:03:08.505 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00064820299999999997 2023-09-30T17:03:08.505 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.505 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.505 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:08.505 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353103+0000", 2023-09-30T17:03:08.505 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0529999999999997e-06 2023-09-30T17:03:08.505 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.505 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.505 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:08.506 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.358558+0000", 2023-09-30T17:03:08.506 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0054550249999999996 2023-09-30T17:03:08.506 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.506 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.506 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:08.506 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.358741+0000", 2023-09-30T17:03:08.506 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00018210200000000001 2023-09-30T17:03:08.506 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.506 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.506 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:08.506 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.359683+0000", 2023-09-30T17:03:08.506 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00094202299999999995 2023-09-30T17:03:08.507 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.507 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.507 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:08.507 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365044+0000", 2023-09-30T17:03:08.507 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053616219999999999 2023-09-30T17:03:08.507 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.507 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.507 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:08.507 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375256+0000", 2023-09-30T17:03:08.507 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010212156 2023-09-30T17:03:08.507 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.507 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.508 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:08.508 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375300+0000", 2023-09-30T17:03:08.508 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3961999999999997e-05 2023-09-30T17:03:08.508 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.508 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.508 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:08.508 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375334+0000", 2023-09-30T17:03:08.508 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.324e-05 2023-09-30T17:03:08.508 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:08.508 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:08.508 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:08.508 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.508 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.509 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:08.509 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:03:08.509 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 50.107827661000002, 2023-09-30T17:03:08.509 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024240660000000001, 2023-09-30T17:03:08.509 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:08.509 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:08.509 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:08.509 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.509 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:08.509 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:03:08.509 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:08.509 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.510 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.510 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:08.510 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:03:08.510 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:08.510 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.510 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.510 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:08.510 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352529+0000", 2023-09-30T17:03:08.510 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1379999999999999e-06 2023-09-30T17:03:08.510 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.510 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.510 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:08.511 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352536+0000", 2023-09-30T17:03:08.511 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3489999999999997e-06 2023-09-30T17:03:08.511 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.511 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.511 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:08.511 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352547+0000", 2023-09-30T17:03:08.511 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1109e-05 2023-09-30T17:03:08.511 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.511 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.511 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:08.511 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352560+0000", 2023-09-30T17:03:08.511 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3046e-05 2023-09-30T17:03:08.512 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.512 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.512 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:08.512 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353142+0000", 2023-09-30T17:03:08.512 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00058174699999999997 2023-09-30T17:03:08.512 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.512 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.512 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:08.512 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353147+0000", 2023-09-30T17:03:08.512 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5840000000000002e-06 2023-09-30T17:03:08.512 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.512 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.513 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:08.513 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360374+0000", 2023-09-30T17:03:08.513 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0072270049999999999 2023-09-30T17:03:08.513 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.513 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.513 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:08.513 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360795+0000", 2023-09-30T17:03:08.513 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00042088999999999999 2023-09-30T17:03:08.513 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.513 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.513 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:08.513 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360967+0000", 2023-09-30T17:03:08.513 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017235699999999999 2023-09-30T17:03:08.514 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.514 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.514 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:08.514 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365051+0000", 2023-09-30T17:03:08.514 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0040837429999999999 2023-09-30T17:03:08.514 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.514 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.514 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:08.514 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376708+0000", 2023-09-30T17:03:08.514 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011656866 2023-09-30T17:03:08.514 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.515 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.515 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:08.515 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376745+0000", 2023-09-30T17:03:08.515 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6769e-05 2023-09-30T17:03:08.515 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.515 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.515 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:08.515 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376769+0000", 2023-09-30T17:03:08.515 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4057e-05 2023-09-30T17:03:08.515 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:08.515 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:08.515 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:08.516 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.516 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.516 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:08.516 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:08.516 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 50.107568305999997, 2023-09-30T17:03:08.516 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023472704, 2023-09-30T17:03:08.516 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:08.516 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:08.516 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:08.516 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.516 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:08.516 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:08.517 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:08.517 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.517 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.517 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:08.517 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:08.517 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:08.517 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.517 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.517 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:08.517 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:08.517 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8000000000000005e-07 2023-09-30T17:03:08.517 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.518 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.518 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:08.518 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352794+0000", 2023-09-30T17:03:08.518 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.789e-06 2023-09-30T17:03:08.518 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.518 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.518 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:08.518 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352805+0000", 2023-09-30T17:03:08.518 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0848e-05 2023-09-30T17:03:08.518 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.518 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.518 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:08.518 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352812+0000", 2023-09-30T17:03:08.519 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4449999999999999e-06 2023-09-30T17:03:08.519 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.519 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.519 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:08.519 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353063+0000", 2023-09-30T17:03:08.519 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00025046299999999998 2023-09-30T17:03:08.519 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.519 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.519 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:08.519 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353071+0000", 2023-09-30T17:03:08.519 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6739999999999997e-06 2023-09-30T17:03:08.519 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.520 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.520 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:08.520 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361696+0000", 2023-09-30T17:03:08.520 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0086251609999999992 2023-09-30T17:03:08.520 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.520 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.520 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:08.520 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362284+0000", 2023-09-30T17:03:08.520 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00058872299999999998 2023-09-30T17:03:08.520 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.520 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.520 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:08.521 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362429+0000", 2023-09-30T17:03:08.521 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014509000000000001 2023-09-30T17:03:08.521 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.521 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.521 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:08.521 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365330+0000", 2023-09-30T17:03:08.521 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0029005419999999999 2023-09-30T17:03:08.521 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.521 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.521 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:08.521 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376196+0000", 2023-09-30T17:03:08.521 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.01086615 2023-09-30T17:03:08.521 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.522 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.522 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:08.522 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376230+0000", 2023-09-30T17:03:08.522 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3858e-05 2023-09-30T17:03:08.522 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.522 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.522 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:08.522 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376260+0000", 2023-09-30T17:03:08.522 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0181000000000001e-05 2023-09-30T17:03:08.522 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:08.522 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:08.522 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:08.523 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.523 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.523 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:08.523 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:03:08.523 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 50.107334735999999, 2023-09-30T17:03:08.523 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023406132999999999, 2023-09-30T17:03:08.523 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:08.523 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:08.523 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:08.523 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.523 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:08.523 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:03:08.523 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:08.524 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.524 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.524 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:08.524 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:03:08.524 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:08.524 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.524 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.524 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:08.524 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353022+0000", 2023-09-30T17:03:08.524 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.78e-07 2023-09-30T17:03:08.524 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.524 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.525 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:08.525 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353027+0000", 2023-09-30T17:03:08.525 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9089999999999999e-06 2023-09-30T17:03:08.525 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.525 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.525 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:08.525 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353035+0000", 2023-09-30T17:03:08.525 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0430000000000008e-06 2023-09-30T17:03:08.525 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.525 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.525 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:08.525 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353047+0000", 2023-09-30T17:03:08.526 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1674e-05 2023-09-30T17:03:08.526 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.526 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.526 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:08.526 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353105+0000", 2023-09-30T17:03:08.526 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8891999999999998e-05 2023-09-30T17:03:08.526 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.526 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.526 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:08.526 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353112+0000", 2023-09-30T17:03:08.526 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7059999999999998e-06 2023-09-30T17:03:08.526 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.527 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.527 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:08.527 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362733+0000", 2023-09-30T17:03:08.527 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0096205869999999999 2023-09-30T17:03:08.527 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.527 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.527 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:08.527 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362833+0000", 2023-09-30T17:03:08.527 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000100227 2023-09-30T17:03:08.527 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.527 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.527 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:08.527 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363000+0000", 2023-09-30T17:03:08.528 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016670899999999999 2023-09-30T17:03:08.528 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.528 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.528 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:08.528 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365550+0000", 2023-09-30T17:03:08.528 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0025499199999999998 2023-09-30T17:03:08.528 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.528 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.528 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:08.528 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376315+0000", 2023-09-30T17:03:08.528 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010765011999999999 2023-09-30T17:03:08.528 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.529 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.529 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:08.529 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376386+0000", 2023-09-30T17:03:08.529 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0866999999999998e-05 2023-09-30T17:03:08.529 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.529 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.529 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:08.529 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376427+0000", 2023-09-30T17:03:08.529 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1709000000000003e-05 2023-09-30T17:03:08.529 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:08.529 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:08.529 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:08.530 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.530 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.530 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:08.530 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:08.530 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 50.107294099999997, 2023-09-30T17:03:08.530 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024076238, 2023-09-30T17:03:08.530 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:08.530 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:08.530 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:08.530 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.530 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:08.530 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:08.531 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:08.531 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.531 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.531 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:08.531 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:08.531 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:08.531 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.531 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.531 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:08.531 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:08.531 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8699999999999995e-07 2023-09-30T17:03:08.531 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.532 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.532 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:08.532 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353067+0000", 2023-09-30T17:03:08.532 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.605e-06 2023-09-30T17:03:08.532 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.532 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.532 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:08.532 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353073+0000", 2023-09-30T17:03:08.532 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8900000000000004e-06 2023-09-30T17:03:08.532 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.532 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.532 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:08.532 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353083+0000", 2023-09-30T17:03:08.533 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0200000000000001e-05 2023-09-30T17:03:08.533 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.533 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.533 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:08.533 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353186+0000", 2023-09-30T17:03:08.533 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010256599999999999 2023-09-30T17:03:08.533 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.533 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.533 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:08.533 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353190+0000", 2023-09-30T17:03:08.533 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9709999999999998e-06 2023-09-30T17:03:08.533 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.534 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.534 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:08.534 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362946+0000", 2023-09-30T17:03:08.534 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0097563330000000007 2023-09-30T17:03:08.534 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.534 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.534 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:08.534 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363088+0000", 2023-09-30T17:03:08.534 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014259200000000001 2023-09-30T17:03:08.534 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.534 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.534 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:08.535 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363555+0000", 2023-09-30T17:03:08.535 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00046627799999999998 2023-09-30T17:03:08.535 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.535 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.535 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:08.535 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365871+0000", 2023-09-30T17:03:08.535 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0023167589999999998 2023-09-30T17:03:08.535 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.535 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.535 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:08.535 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377033+0000", 2023-09-30T17:03:08.535 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011161203999999999 2023-09-30T17:03:08.536 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.536 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.536 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:08.536 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377100+0000", 2023-09-30T17:03:08.536 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7230999999999994e-05 2023-09-30T17:03:08.536 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.536 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.536 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:08.536 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377138+0000", 2023-09-30T17:03:08.536 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8022000000000003e-05 2023-09-30T17:03:08.536 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:08.536 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:08.537 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:08.537 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.537 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.537 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:08.537 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:03:08.537 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 50.107193150999997, 2023-09-30T17:03:08.537 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.020304412000000001, 2023-09-30T17:03:08.537 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:08.537 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:08.537 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:08.537 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.537 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:08.538 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:03:08.538 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:08.538 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.538 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.538 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:08.538 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:03:08.538 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:08.538 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.538 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.538 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:08.538 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353164+0000", 2023-09-30T17:03:08.538 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7100000000000011e-07 2023-09-30T17:03:08.539 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.539 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.539 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:08.539 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353168+0000", 2023-09-30T17:03:08.539 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0600000000000001e-06 2023-09-30T17:03:08.539 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.539 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.539 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:08.539 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353177+0000", 2023-09-30T17:03:08.539 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1409999999999994e-06 2023-09-30T17:03:08.539 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.539 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.539 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:08.540 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353185+0000", 2023-09-30T17:03:08.540 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2479999999999996e-06 2023-09-30T17:03:08.540 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.540 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.540 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:08.540 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353246+0000", 2023-09-30T17:03:08.540 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0519000000000001e-05 2023-09-30T17:03:08.540 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.540 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.540 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:08.540 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353252+0000", 2023-09-30T17:03:08.540 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7859999999999999e-06 2023-09-30T17:03:08.541 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.541 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.541 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:08.541 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354979+0000", 2023-09-30T17:03:08.541 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0017270090000000001 2023-09-30T17:03:08.541 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.541 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.541 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:08.541 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355097+0000", 2023-09-30T17:03:08.541 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000117472 2023-09-30T17:03:08.541 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.541 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.542 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:08.542 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.373467+0000", 2023-09-30T17:03:08.542 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.018370206 2023-09-30T17:03:08.542 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:08.542 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:08.542 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:08.542 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.542 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.542 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:08.542 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:03:08.542 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 50.107152413000001, 2023-09-30T17:03:08.542 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.012725089, 2023-09-30T17:03:08.543 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:08.543 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:08.543 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:08.543 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.543 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:08.543 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:03:08.543 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:08.543 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.543 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.543 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:08.543 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:03:08.543 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:08.544 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.544 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.544 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:08.544 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353204+0000", 2023-09-30T17:03:08.544 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7100000000000002e-07 2023-09-30T17:03:08.544 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.544 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.544 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:08.544 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353213+0000", 2023-09-30T17:03:08.544 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8580000000000006e-06 2023-09-30T17:03:08.544 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.544 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.545 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:08.545 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353219+0000", 2023-09-30T17:03:08.545 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8939999999999998e-06 2023-09-30T17:03:08.545 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.545 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.545 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:08.545 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353223+0000", 2023-09-30T17:03:08.545 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.357e-06 2023-09-30T17:03:08.545 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.545 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.545 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:08.545 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353278+0000", 2023-09-30T17:03:08.546 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5228e-05 2023-09-30T17:03:08.546 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.546 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.546 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:08.546 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353284+0000", 2023-09-30T17:03:08.546 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8209999999999998e-06 2023-09-30T17:03:08.546 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.546 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.546 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:08.546 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355095+0000", 2023-09-30T17:03:08.546 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001811404 2023-09-30T17:03:08.546 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.547 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.547 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:08.547 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355256+0000", 2023-09-30T17:03:08.547 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000160898 2023-09-30T17:03:08.547 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.547 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.547 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:08.547 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365928+0000", 2023-09-30T17:03:08.547 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010672157999999999 2023-09-30T17:03:08.547 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:08.547 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:08.547 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:08.548 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.548 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.548 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-09-30T17:03:08.548 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:03:08.548 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 50.106621206, 2023-09-30T17:03:08.548 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0056863460000000001, 2023-09-30T17:03:08.548 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:08.548 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "reached pg", 2023-09-30T17:03:08.548 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:08.548 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.548 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:08.548 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:03:08.549 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:08.549 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.549 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.549 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:08.549 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:03:08.549 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:08.549 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.549 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.549 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:08.549 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:03:08.549 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5700000000000002e-07 2023-09-30T17:03:08.549 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.550 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.550 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:08.550 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353747+0000", 2023-09-30T17:03:08.550 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1899000000000001e-05 2023-09-30T17:03:08.550 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.550 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.550 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:08.550 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353776+0000", 2023-09-30T17:03:08.550 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.8767000000000001e-05 2023-09-30T17:03:08.550 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.550 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.550 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:08.551 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353792+0000", 2023-09-30T17:03:08.551 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5914999999999999e-05 2023-09-30T17:03:08.551 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.551 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.551 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:08.551 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353900+0000", 2023-09-30T17:03:08.551 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010774500000000001 2023-09-30T17:03:08.551 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.551 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.551 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:08.551 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.359421+0000", 2023-09-30T17:03:08.551 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0055213629999999996 2023-09-30T17:03:08.552 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:08.552 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:08.552 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:08.552 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.552 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.552 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:03:08.552 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:03:08.552 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 50.105949606000003, 2023-09-30T17:03:08.552 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0069196370000000002, 2023-09-30T17:03:08.552 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:08.552 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:08.552 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:08.553 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.553 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:08.553 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:03:08.553 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:08.553 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.553 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.553 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:08.553 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:03:08.553 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:08.553 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.553 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.553 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:08.553 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354407+0000", 2023-09-30T17:03:08.554 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7400000000000002e-07 2023-09-30T17:03:08.554 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.554 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.554 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:08.554 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354414+0000", 2023-09-30T17:03:08.554 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1040000000000001e-06 2023-09-30T17:03:08.554 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.554 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.554 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:08.554 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354425+0000", 2023-09-30T17:03:08.554 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1090000000000001e-05 2023-09-30T17:03:08.554 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.555 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.555 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:08.555 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354435+0000", 2023-09-30T17:03:08.555 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8169999999999994e-06 2023-09-30T17:03:08.555 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.555 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.555 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:08.555 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355741+0000", 2023-09-30T17:03:08.555 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0013063160000000001 2023-09-30T17:03:08.555 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.555 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.555 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:08.556 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355763+0000", 2023-09-30T17:03:08.556 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1688e-05 2023-09-30T17:03:08.556 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.556 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.556 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:08.556 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361289+0000", 2023-09-30T17:03:08.556 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0055258269999999996 2023-09-30T17:03:08.556 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.556 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.556 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:08.556 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361326+0000", 2023-09-30T17:03:08.556 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7020999999999997e-05 2023-09-30T17:03:08.557 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:08.557 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:08.557 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:08.557 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.557 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.557 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:30 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2023-09-30T17:03:08.557 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:03:08.557 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 50.104575648000001, 2023-09-30T17:03:08.557 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0069996629999999997, 2023-09-30T17:03:08.557 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:08.557 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:08.557 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:08.557 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.558 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:08.558 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:03:08.558 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:08.558 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.558 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.558 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:08.558 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:03:08.558 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:08.558 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.558 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.558 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:08.558 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355781+0000", 2023-09-30T17:03:08.559 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9599999999999999e-07 2023-09-30T17:03:08.559 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.559 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.559 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:08.559 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355788+0000", 2023-09-30T17:03:08.559 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8129999999999996e-06 2023-09-30T17:03:08.559 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.559 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.559 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:08.559 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355798+0000", 2023-09-30T17:03:08.559 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2909999999999996e-06 2023-09-30T17:03:08.559 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.560 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.560 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:08.560 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355807+0000", 2023-09-30T17:03:08.560 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8619999999999992e-06 2023-09-30T17:03:08.560 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.560 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.560 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:08.560 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.357264+0000", 2023-09-30T17:03:08.560 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0014578289999999999 2023-09-30T17:03:08.560 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.560 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.560 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:08.561 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.357916+0000", 2023-09-30T17:03:08.561 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00065170500000000004 2023-09-30T17:03:08.561 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.561 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.561 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:08.561 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362731+0000", 2023-09-30T17:03:08.561 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0048149849999999999 2023-09-30T17:03:08.561 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.561 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.561 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:08.561 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362780+0000", 2023-09-30T17:03:08.561 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8681999999999999e-05 2023-09-30T17:03:08.562 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:08.562 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:08.562 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:08.562 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.562 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.562 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2023-09-30T17:03:08.562 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:03:08.562 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 50.085924597000002, 2023-09-30T17:03:08.562 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005905998, 2023-09-30T17:03:08.562 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:08.562 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:08.562 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:08.563 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.563 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:08.563 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:03:08.563 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:08.563 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.563 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.563 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:08.563 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:03:08.563 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:08.563 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.563 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.563 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:08.563 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:03:08.564 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1e-07 2023-09-30T17:03:08.564 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.564 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.564 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:08.564 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374455+0000", 2023-09-30T17:03:08.564 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.3091999999999998e-05 2023-09-30T17:03:08.564 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.564 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.564 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:08.564 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374462+0000", 2023-09-30T17:03:08.564 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5170000000000002e-06 2023-09-30T17:03:08.564 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.565 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.565 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:08.565 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374469+0000", 2023-09-30T17:03:08.565 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8199999999999999e-06 2023-09-30T17:03:08.565 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.565 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.565 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:08.565 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374550+0000", 2023-09-30T17:03:08.565 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0978999999999998e-05 2023-09-30T17:03:08.565 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.565 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.565 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:08.566 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374562+0000", 2023-09-30T17:03:08.566 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2472e-05 2023-09-30T17:03:08.566 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.566 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.566 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:08.566 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380293+0000", 2023-09-30T17:03:08.566 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0057310379999999999 2023-09-30T17:03:08.566 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.566 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.566 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:08.566 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380337+0000", 2023-09-30T17:03:08.566 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3869999999999998e-05 2023-09-30T17:03:08.566 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:08.567 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:08.567 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:08.567 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.567 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.567 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2023-09-30T17:03:08.567 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:03:08.567 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 50.085737848000001, 2023-09-30T17:03:08.567 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0057590560000000002, 2023-09-30T17:03:08.567 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:08.567 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:08.567 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:08.567 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.568 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:08.568 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:03:08.568 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:08.568 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.568 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.568 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:08.568 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:03:08.568 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:08.568 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.568 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.568 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:08.568 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:03:08.569 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4900000000000001e-07 2023-09-30T17:03:08.569 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.569 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.569 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:08.569 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374629+0000", 2023-09-30T17:03:08.569 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1014e-05 2023-09-30T17:03:08.569 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.569 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.569 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:08.569 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374636+0000", 2023-09-30T17:03:08.569 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5889999999999999e-06 2023-09-30T17:03:08.569 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.569 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.570 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:08.570 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374642+0000", 2023-09-30T17:03:08.570 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.48e-06 2023-09-30T17:03:08.570 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.570 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.570 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:08.570 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374681+0000", 2023-09-30T17:03:08.570 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9320000000000003e-05 2023-09-30T17:03:08.570 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.570 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.570 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:08.570 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374694+0000", 2023-09-30T17:03:08.571 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3351e-05 2023-09-30T17:03:08.571 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.571 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.571 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:08.571 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380319+0000", 2023-09-30T17:03:08.571 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0056243880000000001 2023-09-30T17:03:08.571 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.571 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.571 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:08.571 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380377+0000", 2023-09-30T17:03:08.571 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8464999999999997e-05 2023-09-30T17:03:08.571 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:08.573 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:08.573 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:08.573 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.573 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.573 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=0'0)", 2023-09-30T17:03:08.573 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:03:08.573 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 50.085026937000002, 2023-09-30T17:03:08.573 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051157370000000004, 2023-09-30T17:03:08.573 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:08.573 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:08.574 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:08.574 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.574 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:08.574 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:03:08.574 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:08.574 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.574 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.574 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:08.574 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:03:08.574 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:08.574 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.574 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.575 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:08.575 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:03:08.575 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0199999999999998e-07 2023-09-30T17:03:08.575 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.575 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.575 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:08.575 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375334+0000", 2023-09-30T17:03:08.575 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8799999999999999e-06 2023-09-30T17:03:08.575 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.575 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.575 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:08.575 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375343+0000", 2023-09-30T17:03:08.575 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5490000000000006e-06 2023-09-30T17:03:08.576 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.576 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.576 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:08.576 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375350+0000", 2023-09-30T17:03:08.576 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5700000000000004e-06 2023-09-30T17:03:08.576 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.576 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.576 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:08.576 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375396+0000", 2023-09-30T17:03:08.576 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5550999999999998e-05 2023-09-30T17:03:08.576 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.576 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.577 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:08.577 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375410+0000", 2023-09-30T17:03:08.577 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4518999999999999e-05 2023-09-30T17:03:08.577 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.577 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.577 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:08.577 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380401+0000", 2023-09-30T17:03:08.577 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0049903430000000004 2023-09-30T17:03:08.577 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:08.577 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:08.577 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:08.577 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380445+0000", 2023-09-30T17:03:08.578 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4023000000000002e-05 2023-09-30T17:03:08.578 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:08.578 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:08.578 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:08.578 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:08.578 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:08.578 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:08.579 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:03:08.580 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:08.579+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:08.680 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:08.679+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:08.713 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:08.713 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:03:08.714 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2023-09-30T17:03:08.714 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:08.723 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:03:08.781 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:08.781+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:08.883 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:08.882+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:08.890 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:08.890 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:03:08.890 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2023-09-30T17:03:08.890 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2023-09-30T17:03:08.890 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:08.900 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:03:08.984 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:08.983+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:09.028 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:09.028 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2023-09-30T17:03:09.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2023-09-30T17:03:09.028 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2023-09-30T17:03:09.028 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.028 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:09.028 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:03:09.028 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 50.674895653, 2023-09-30T17:03:09.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093789779999999996, 2023-09-30T17:03:09.029 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:09.029 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:09.029 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:09.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.029 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:09.029 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:03:09.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:09.029 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.029 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:09.029 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:03:09.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:09.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.030 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:09.030 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352027+0000", 2023-09-30T17:03:09.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0224000000000001e-05 2023-09-30T17:03:09.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.030 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:09.030 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352039+0000", 2023-09-30T17:03:09.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1569000000000001e-05 2023-09-30T17:03:09.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:09.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352052+0000", 2023-09-30T17:03:09.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2605999999999999e-05 2023-09-30T17:03:09.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:09.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352064+0000", 2023-09-30T17:03:09.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2666999999999999e-05 2023-09-30T17:03:09.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:09.032 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352147+0000", 2023-09-30T17:03:09.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3125000000000001e-05 2023-09-30T17:03:09.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.032 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:09.032 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352306+0000", 2023-09-30T17:03:09.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015881900000000001 2023-09-30T17:03:09.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.032 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:09.032 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352450+0000", 2023-09-30T17:03:09.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014420700000000001 2023-09-30T17:03:09.033 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.033 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.033 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:09.033 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355975+0000", 2023-09-30T17:03:09.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003524246 2023-09-30T17:03:09.033 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.033 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.033 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:09.033 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361279+0000", 2023-09-30T17:03:09.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005304507 2023-09-30T17:03:09.033 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.034 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:09.034 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361344+0000", 2023-09-30T17:03:09.034 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4548999999999995e-05 2023-09-30T17:03:09.034 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.034 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:09.034 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361396+0000", 2023-09-30T17:03:09.034 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2459e-05 2023-09-30T17:03:09.034 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:09.034 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:09.034 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:09.035 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.035 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.035 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:09.035 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:03:09.035 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 50.674803361000002, 2023-09-30T17:03:09.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021233007000000002, 2023-09-30T17:03:09.035 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:09.035 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:09.035 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:09.035 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.035 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:09.035 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:03:09.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:09.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:09.036 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:03:09.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:09.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:09.036 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352110+0000", 2023-09-30T17:03:09.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6000000000000002e-07 2023-09-30T17:03:09.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:09.037 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352117+0000", 2023-09-30T17:03:09.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5930000000000002e-06 2023-09-30T17:03:09.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:09.037 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352126+0000", 2023-09-30T17:03:09.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0729999999999994e-06 2023-09-30T17:03:09.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:09.037 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352136+0000", 2023-09-30T17:03:09.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0380000000000001e-05 2023-09-30T17:03:09.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.038 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:09.038 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353279+0000", 2023-09-30T17:03:09.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0011424670000000001 2023-09-30T17:03:09.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.038 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:09.038 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353707+0000", 2023-09-30T17:03:09.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00042829800000000003 2023-09-30T17:03:09.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.039 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:09.039 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354104+0000", 2023-09-30T17:03:09.039 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00039643399999999998 2023-09-30T17:03:09.039 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.039 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:09.039 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356925+0000", 2023-09-30T17:03:09.039 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0028210900000000001 2023-09-30T17:03:09.039 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.039 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:09.040 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373243+0000", 2023-09-30T17:03:09.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016318461999999999 2023-09-30T17:03:09.040 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.040 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.040 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:09.040 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373301+0000", 2023-09-30T17:03:09.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7435000000000002e-05 2023-09-30T17:03:09.040 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.040 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.040 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:09.040 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373342+0000", 2023-09-30T17:03:09.041 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1915000000000001e-05 2023-09-30T17:03:09.041 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:09.041 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:09.041 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:09.041 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.041 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.041 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:09.041 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:03:09.041 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 50.674760749999997, 2023-09-30T17:03:09.041 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011988331, 2023-09-30T17:03:09.041 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:09.041 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:09.041 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:09.042 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.042 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:09.042 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:03:09.042 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:09.042 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.042 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.042 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:09.042 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:03:09.042 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:09.042 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.042 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.042 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:09.043 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352153+0000", 2023-09-30T17:03:09.043 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0500000000000003e-07 2023-09-30T17:03:09.043 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.043 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.043 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:09.043 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352157+0000", 2023-09-30T17:03:09.043 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9790000000000004e-06 2023-09-30T17:03:09.043 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.043 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.043 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:09.043 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352173+0000", 2023-09-30T17:03:09.043 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6535999999999999e-05 2023-09-30T17:03:09.044 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.044 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.044 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:09.044 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352180+0000", 2023-09-30T17:03:09.044 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7700000000000004e-06 2023-09-30T17:03:09.044 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.044 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.044 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:09.044 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353526+0000", 2023-09-30T17:03:09.044 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0013458330000000001 2023-09-30T17:03:09.044 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.044 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.045 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:09.045 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353648+0000", 2023-09-30T17:03:09.045 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012262899999999999 2023-09-30T17:03:09.045 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.045 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.045 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:09.045 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354141+0000", 2023-09-30T17:03:09.045 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00049222899999999995 2023-09-30T17:03:09.045 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.045 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.045 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:09.045 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356931+0000", 2023-09-30T17:03:09.046 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0027900860000000002 2023-09-30T17:03:09.046 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.046 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.046 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:09.046 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364066+0000", 2023-09-30T17:03:09.046 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071355050000000003 2023-09-30T17:03:09.046 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.046 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.046 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:09.046 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364103+0000", 2023-09-30T17:03:09.046 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6944999999999999e-05 2023-09-30T17:03:09.046 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.047 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.047 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:09.047 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364140+0000", 2023-09-30T17:03:09.047 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7214e-05 2023-09-30T17:03:09.047 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:09.047 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:09.047 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:09.047 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.047 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.047 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:09.047 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:03:09.047 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 50.674721519000002, 2023-09-30T17:03:09.048 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012110921, 2023-09-30T17:03:09.048 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:09.048 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:09.048 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:09.048 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.048 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:09.048 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:03:09.048 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:09.048 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.048 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.048 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:09.048 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:03:09.049 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:09.049 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.049 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.049 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:09.049 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352192+0000", 2023-09-30T17:03:09.049 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7300000000000005e-07 2023-09-30T17:03:09.049 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.049 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.049 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:09.049 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352196+0000", 2023-09-30T17:03:09.049 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2370000000000003e-06 2023-09-30T17:03:09.049 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.050 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.050 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:09.050 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352205+0000", 2023-09-30T17:03:09.050 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6659999999999997e-06 2023-09-30T17:03:09.050 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.050 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.050 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:09.050 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352214+0000", 2023-09-30T17:03:09.050 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8259999999999999e-06 2023-09-30T17:03:09.050 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.050 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.050 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:09.051 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354470+0000", 2023-09-30T17:03:09.051 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022557340000000001 2023-09-30T17:03:09.051 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.051 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.051 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:09.051 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354557+0000", 2023-09-30T17:03:09.051 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6909000000000004e-05 2023-09-30T17:03:09.051 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.051 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.051 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:09.051 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354694+0000", 2023-09-30T17:03:09.051 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013774800000000001 2023-09-30T17:03:09.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.052 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:09.052 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356937+0000", 2023-09-30T17:03:09.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022424540000000001 2023-09-30T17:03:09.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.052 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:09.052 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364227+0000", 2023-09-30T17:03:09.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072902430000000001 2023-09-30T17:03:09.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.053 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:09.053 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364278+0000", 2023-09-30T17:03:09.053 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1180999999999997e-05 2023-09-30T17:03:09.053 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.053 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.053 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:09.053 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364302+0000", 2023-09-30T17:03:09.053 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4049999999999998e-05 2023-09-30T17:03:09.053 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:09.053 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:09.053 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:09.053 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.054 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.054 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:09.054 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:09.054 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 50.674688179999997, 2023-09-30T17:03:09.054 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021258651999999999, 2023-09-30T17:03:09.054 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:09.054 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:09.054 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:09.054 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.054 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:09.054 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:09.054 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:09.055 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.055 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.055 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:09.055 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:09.055 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:09.055 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.055 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.055 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:09.055 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:09.055 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6899999999999997e-07 2023-09-30T17:03:09.055 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.056 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.056 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:09.056 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352236+0000", 2023-09-30T17:03:09.056 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0251000000000001e-05 2023-09-30T17:03:09.056 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.056 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.056 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:09.056 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352244+0000", 2023-09-30T17:03:09.056 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0770000000000008e-06 2023-09-30T17:03:09.056 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.056 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.056 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:09.056 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352251+0000", 2023-09-30T17:03:09.057 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4749999999999996e-06 2023-09-30T17:03:09.057 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.057 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.057 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:09.057 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354455+0000", 2023-09-30T17:03:09.057 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022043660000000001 2023-09-30T17:03:09.057 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.057 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.057 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:09.057 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354577+0000", 2023-09-30T17:03:09.057 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000121054 2023-09-30T17:03:09.057 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.058 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.058 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:09.058 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354723+0000", 2023-09-30T17:03:09.058 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014693900000000001 2023-09-30T17:03:09.058 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.058 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.058 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:09.058 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356941+0000", 2023-09-30T17:03:09.058 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002217199 2023-09-30T17:03:09.058 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.058 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.058 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:09.059 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373392+0000", 2023-09-30T17:03:09.059 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016451774999999998 2023-09-30T17:03:09.059 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.059 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.059 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:09.059 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373445+0000", 2023-09-30T17:03:09.059 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.308e-05 2023-09-30T17:03:09.059 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.059 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.059 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:09.059 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373483+0000", 2023-09-30T17:03:09.059 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7766999999999999e-05 2023-09-30T17:03:09.060 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:09.060 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:09.060 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:09.060 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.060 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.060 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:09.060 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:09.060 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 50.674652088999999, 2023-09-30T17:03:09.060 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020903497, 2023-09-30T17:03:09.060 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:09.060 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:09.061 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:09.061 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.061 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:09.061 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:09.061 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:09.061 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.061 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.061 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:09.061 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:09.061 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:09.061 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.061 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.062 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:09.062 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:09.062 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0800000000000004e-07 2023-09-30T17:03:09.062 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.062 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.062 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:09.062 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352266+0000", 2023-09-30T17:03:09.062 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1280000000000001e-06 2023-09-30T17:03:09.062 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.062 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.062 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:09.062 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352273+0000", 2023-09-30T17:03:09.063 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3730000000000004e-06 2023-09-30T17:03:09.063 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.063 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.063 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:09.063 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352279+0000", 2023-09-30T17:03:09.063 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7699999999999998e-06 2023-09-30T17:03:09.063 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.063 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.063 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:09.063 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352334+0000", 2023-09-30T17:03:09.063 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5547999999999997e-05 2023-09-30T17:03:09.063 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.064 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.064 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:09.064 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352435+0000", 2023-09-30T17:03:09.064 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100688 2023-09-30T17:03:09.064 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.064 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.064 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:09.064 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352585+0000", 2023-09-30T17:03:09.064 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000150068 2023-09-30T17:03:09.064 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.064 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.064 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:09.065 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354912+0000", 2023-09-30T17:03:09.065 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0023266770000000001 2023-09-30T17:03:09.065 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.065 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.065 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:09.065 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373066+0000", 2023-09-30T17:03:09.065 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018154474 2023-09-30T17:03:09.065 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.065 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.065 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:09.065 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373122+0000", 2023-09-30T17:03:09.065 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6193000000000002e-05 2023-09-30T17:03:09.066 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.066 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.066 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:09.066 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373164+0000", 2023-09-30T17:03:09.066 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1869999999999997e-05 2023-09-30T17:03:09.066 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:09.066 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:09.066 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:09.066 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.066 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.066 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:09.066 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:03:09.067 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 50.674616413000003, 2023-09-30T17:03:09.067 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021015097999999999, 2023-09-30T17:03:09.067 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:09.067 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:09.067 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:09.067 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.067 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:09.067 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:03:09.067 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:09.067 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.067 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.067 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:09.068 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:03:09.068 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:09.068 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.068 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.068 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:09.068 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352297+0000", 2023-09-30T17:03:09.068 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8299999999999997e-07 2023-09-30T17:03:09.068 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.068 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.068 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:09.068 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352300+0000", 2023-09-30T17:03:09.068 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7460000000000001e-06 2023-09-30T17:03:09.068 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.069 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.069 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:09.069 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352307+0000", 2023-09-30T17:03:09.069 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4959999999999999e-06 2023-09-30T17:03:09.069 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.069 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.069 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:09.069 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352314+0000", 2023-09-30T17:03:09.069 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0190000000000001e-06 2023-09-30T17:03:09.069 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.069 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.069 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:09.070 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354070+0000", 2023-09-30T17:03:09.070 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001755936 2023-09-30T17:03:09.070 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.070 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.070 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:09.070 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354221+0000", 2023-09-30T17:03:09.070 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000150884 2023-09-30T17:03:09.070 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.070 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.070 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:09.070 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373311+0000", 2023-09-30T17:03:09.070 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019090434 2023-09-30T17:03:09.071 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:09.071 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:09.071 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:09.071 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.071 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.071 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:09.071 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:03:09.071 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 50.674587694000003, 2023-09-30T17:03:09.071 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021255174000000002, 2023-09-30T17:03:09.071 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:09.071 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:09.071 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:09.072 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.072 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:09.072 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:03:09.072 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:09.072 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.072 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.072 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:09.072 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:03:09.072 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:09.072 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.072 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.072 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:09.073 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352326+0000", 2023-09-30T17:03:09.073 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3200000000000005e-07 2023-09-30T17:03:09.073 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.073 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.073 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:09.073 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352349+0000", 2023-09-30T17:03:09.073 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3183000000000001e-05 2023-09-30T17:03:09.073 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.073 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.073 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:09.073 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352358+0000", 2023-09-30T17:03:09.073 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5230000000000001e-06 2023-09-30T17:03:09.073 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.074 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.074 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:09.074 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352365+0000", 2023-09-30T17:03:09.074 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3260000000000001e-06 2023-09-30T17:03:09.074 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.074 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.074 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:09.074 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355450+0000", 2023-09-30T17:03:09.074 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0030854049999999998 2023-09-30T17:03:09.074 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.074 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.075 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:09.075 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355583+0000", 2023-09-30T17:03:09.075 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000133189 2023-09-30T17:03:09.075 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.075 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.075 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:09.075 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373580+0000", 2023-09-30T17:03:09.075 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017997016000000001 2023-09-30T17:03:09.075 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:09.075 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:09.075 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:09.075 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.075 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.076 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:09.076 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:03:09.076 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 50.674536271000001, 2023-09-30T17:03:09.076 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010380537, 2023-09-30T17:03:09.076 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:09.076 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:09.076 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:09.076 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.076 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:09.076 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:03:09.076 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:09.076 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.077 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.077 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:09.077 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:03:09.077 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:09.077 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.077 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.077 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:09.077 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:03:09.077 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1500000000000003e-07 2023-09-30T17:03:09.077 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.077 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.077 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:09.078 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352381+0000", 2023-09-30T17:03:09.078 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6330000000000002e-06 2023-09-30T17:03:09.078 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.078 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.078 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:09.078 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352388+0000", 2023-09-30T17:03:09.078 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7229999999999998e-06 2023-09-30T17:03:09.078 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.078 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.078 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:09.078 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352394+0000", 2023-09-30T17:03:09.078 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1789999999999996e-06 2023-09-30T17:03:09.079 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.079 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.079 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:09.079 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353259+0000", 2023-09-30T17:03:09.079 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000865221 2023-09-30T17:03:09.079 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.079 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.079 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:09.079 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353391+0000", 2023-09-30T17:03:09.079 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013217700000000001 2023-09-30T17:03:09.079 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.079 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.080 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:09.080 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362757+0000", 2023-09-30T17:03:09.080 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093657889999999994 2023-09-30T17:03:09.080 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:09.080 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:09.080 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:09.080 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.080 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.080 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-09-30T17:03:09.080 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:03:09.080 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 50.668235979000002, 2023-09-30T17:03:09.080 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0061813579999999996, 2023-09-30T17:03:09.081 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:09.081 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2023-09-30T17:03:09.081 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:09.081 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.081 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:09.081 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:03:09.081 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:09.081 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.081 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.081 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:09.081 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:03:09.081 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:09.082 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.082 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.082 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:09.082 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:03:09.082 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5499999999999999e-07 2023-09-30T17:03:09.082 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.082 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.082 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:09.082 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358686+0000", 2023-09-30T17:03:09.082 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9979999999999992e-06 2023-09-30T17:03:09.082 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.082 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.083 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:09.083 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358700+0000", 2023-09-30T17:03:09.083 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3635000000000001e-05 2023-09-30T17:03:09.083 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.083 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.083 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:09.083 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358714+0000", 2023-09-30T17:03:09.083 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4470999999999999e-05 2023-09-30T17:03:09.083 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.083 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.083 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:09.083 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358767+0000", 2023-09-30T17:03:09.084 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2651999999999997e-05 2023-09-30T17:03:09.084 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.084 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.084 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:09.084 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364858+0000", 2023-09-30T17:03:09.084 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060912470000000002 2023-09-30T17:03:09.084 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:09.084 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:09.084 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:09.084 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.084 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.084 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2023-09-30T17:03:09.084 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:03:09.085 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 50.665871138999997, 2023-09-30T17:03:09.085 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00036246299999999999, 2023-09-30T17:03:09.085 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:09.085 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:09.085 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:09.085 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.085 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:09.085 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:03:09.085 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:09.085 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.085 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.085 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:09.086 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:03:09.086 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:09.086 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.086 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.086 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:09.086 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:03:09.086 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3099999999999999e-07 2023-09-30T17:03:09.086 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.086 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.086 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:09.086 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361045+0000", 2023-09-30T17:03:09.086 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.49e-06 2023-09-30T17:03:09.087 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.087 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.087 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:09.087 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361056+0000", 2023-09-30T17:03:09.087 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0910000000000001e-05 2023-09-30T17:03:09.087 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.087 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.087 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:09.087 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361067+0000", 2023-09-30T17:03:09.087 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0531e-05 2023-09-30T17:03:09.087 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.087 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.088 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:09.088 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361263+0000", 2023-09-30T17:03:09.088 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000196486 2023-09-30T17:03:09.088 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.088 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.088 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:09.088 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361273+0000", 2023-09-30T17:03:09.088 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3379999999999994e-06 2023-09-30T17:03:09.088 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.088 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.088 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:09.088 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361404+0000", 2023-09-30T17:03:09.089 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013137700000000001 2023-09-30T17:03:09.089 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:09.089 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:09.089 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:09.089 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.089 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.089 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:31 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:03:09.089 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:03:09.089 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 50.664895110000003, 2023-09-30T17:03:09.089 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006676408, 2023-09-30T17:03:09.089 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:09.089 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:09.089 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:09.090 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.090 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:09.090 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:03:09.090 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:09.090 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.090 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.090 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:09.090 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:03:09.090 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:09.090 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.090 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.090 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:09.091 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:03:09.091 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5600000000000002e-07 2023-09-30T17:03:09.091 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.091 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.091 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:09.091 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362044+0000", 2023-09-30T17:03:09.091 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5987999999999999e-05 2023-09-30T17:03:09.091 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.091 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.091 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:09.091 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362051+0000", 2023-09-30T17:03:09.091 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2599999999999999e-06 2023-09-30T17:03:09.092 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.092 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.092 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:09.092 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362057+0000", 2023-09-30T17:03:09.092 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.19e-06 2023-09-30T17:03:09.092 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.092 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.092 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:09.092 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362096+0000", 2023-09-30T17:03:09.092 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8278000000000002e-05 2023-09-30T17:03:09.092 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.092 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.093 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:09.093 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362114+0000", 2023-09-30T17:03:09.093 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8808e-05 2023-09-30T17:03:09.093 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.093 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.093 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:09.093 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368658+0000", 2023-09-30T17:03:09.093 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065433540000000004 2023-09-30T17:03:09.093 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.093 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.093 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:09.093 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368694+0000", 2023-09-30T17:03:09.094 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6273999999999999e-05 2023-09-30T17:03:09.094 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:09.094 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:09.094 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:09.094 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.094 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.094 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:26 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-09-30T17:03:09.094 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:03:09.094 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 50.664804338000003, 2023-09-30T17:03:09.094 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0066596119999999996, 2023-09-30T17:03:09.094 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:09.094 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:09.095 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:09.095 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.095 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:09.095 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:03:09.095 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:09.095 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.095 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.095 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:09.095 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:03:09.095 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:09.095 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.096 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.096 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:09.096 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362109+0000", 2023-09-30T17:03:09.096 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5699999999999999e-07 2023-09-30T17:03:09.096 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.096 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.096 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:09.096 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362112+0000", 2023-09-30T17:03:09.096 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8410000000000002e-06 2023-09-30T17:03:09.096 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.096 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.096 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:09.096 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362117+0000", 2023-09-30T17:03:09.097 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.792e-06 2023-09-30T17:03:09.097 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.097 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.097 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:09.097 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362122+0000", 2023-09-30T17:03:09.097 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.763e-06 2023-09-30T17:03:09.097 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.097 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.097 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:09.097 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362344+0000", 2023-09-30T17:03:09.097 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022181600000000001 2023-09-30T17:03:09.097 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.098 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.098 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:09.098 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362357+0000", 2023-09-30T17:03:09.098 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2864000000000001e-05 2023-09-30T17:03:09.098 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.098 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.098 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:09.098 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368738+0000", 2023-09-30T17:03:09.098 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063809499999999998 2023-09-30T17:03:09.098 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.098 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.099 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:09.099 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368768+0000", 2023-09-30T17:03:09.099 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0429e-05 2023-09-30T17:03:09.099 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:09.099 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:09.099 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:09.099 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.099 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.099 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2023-09-30T17:03:09.099 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:03:09.099 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 50.663588171000001, 2023-09-30T17:03:09.099 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00082185400000000001, 2023-09-30T17:03:09.100 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:09.100 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:09.100 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:09.100 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.100 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:09.100 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:03:09.100 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:09.100 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.100 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.100 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:09.100 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:03:09.101 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:09.101 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.101 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.101 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:09.101 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:03:09.101 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.22e-07 2023-09-30T17:03:09.101 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.101 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.101 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:09.101 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363327+0000", 2023-09-30T17:03:09.101 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4480000000000001e-06 2023-09-30T17:03:09.101 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.102 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.102 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:09.102 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363333+0000", 2023-09-30T17:03:09.102 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9989999999999997e-06 2023-09-30T17:03:09.102 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.102 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.102 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:09.102 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363354+0000", 2023-09-30T17:03:09.102 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0547000000000002e-05 2023-09-30T17:03:09.102 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.102 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.102 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:09.103 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364057+0000", 2023-09-30T17:03:09.103 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00070306600000000002 2023-09-30T17:03:09.103 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.103 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.103 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:09.103 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364063+0000", 2023-09-30T17:03:09.103 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.694e-06 2023-09-30T17:03:09.103 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.103 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.103 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:09.103 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364146+0000", 2023-09-30T17:03:09.103 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3877999999999999e-05 2023-09-30T17:03:09.104 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:09.104 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:09.104 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:09.104 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.104 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.104 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e18/16 ondisk, result = 0)", 2023-09-30T17:03:09.104 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:03:09.104 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 50.663274639000001, 2023-09-30T17:03:09.104 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00067007199999999996, 2023-09-30T17:03:09.104 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:09.104 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:09.104 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:09.105 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.105 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:09.105 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:03:09.105 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:09.105 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.105 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.105 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:09.105 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:03:09.105 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:09.105 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.105 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.105 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:09.106 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:03:09.106 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.41e-07 2023-09-30T17:03:09.106 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.106 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.106 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:09.106 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363641+0000", 2023-09-30T17:03:09.106 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4830000000000002e-06 2023-09-30T17:03:09.106 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.106 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.106 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:09.106 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363647+0000", 2023-09-30T17:03:09.107 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4869999999999999e-06 2023-09-30T17:03:09.107 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.107 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.107 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:09.107 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363654+0000", 2023-09-30T17:03:09.107 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5889999999999999e-06 2023-09-30T17:03:09.107 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.107 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.107 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:09.107 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364217+0000", 2023-09-30T17:03:09.107 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00056263199999999998 2023-09-30T17:03:09.107 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.108 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.108 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:09.108 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364222+0000", 2023-09-30T17:03:09.108 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.242e-06 2023-09-30T17:03:09.108 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.108 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.108 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:09.108 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364308+0000", 2023-09-30T17:03:09.108 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6397999999999995e-05 2023-09-30T17:03:09.108 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:09.108 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:09.108 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:09.109 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.109 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.109 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2023-09-30T17:03:09.109 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:03:09.109 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 50.653686729, 2023-09-30T17:03:09.109 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000359561, 2023-09-30T17:03:09.109 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:09.109 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2023-09-30T17:03:09.109 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:09.109 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.109 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:09.109 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:03:09.110 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:09.110 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.110 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.110 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:09.110 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:03:09.110 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:09.110 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.110 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.110 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:09.110 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:03:09.110 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1e-07 2023-09-30T17:03:09.110 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.111 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.111 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:09.111 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373228+0000", 2023-09-30T17:03:09.111 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9420000000000002e-06 2023-09-30T17:03:09.111 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.111 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.111 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:09.111 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373235+0000", 2023-09-30T17:03:09.111 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4230000000000002e-06 2023-09-30T17:03:09.111 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.111 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.111 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:09.112 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373239+0000", 2023-09-30T17:03:09.112 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6809999999999997e-06 2023-09-30T17:03:09.112 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.112 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.112 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:09.112 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373518+0000", 2023-09-30T17:03:09.112 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000278311 2023-09-30T17:03:09.112 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.112 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.112 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:09.112 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373586+0000", 2023-09-30T17:03:09.112 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7994e-05 2023-09-30T17:03:09.113 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:09.113 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:09.113 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:09.113 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.113 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.113 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:03:09.113 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:03:09.113 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 50.649260656000003, 2023-09-30T17:03:09.113 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0046632949999999996, 2023-09-30T17:03:09.113 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:09.113 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:09.113 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:09.114 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.114 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:09.114 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:03:09.114 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:09.114 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.114 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.114 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:09.114 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:03:09.114 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:09.114 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.114 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.114 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:09.115 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377653+0000", 2023-09-30T17:03:09.115 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7800000000000002e-07 2023-09-30T17:03:09.115 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.115 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.115 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:09.115 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377657+0000", 2023-09-30T17:03:09.115 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5859999999999998e-06 2023-09-30T17:03:09.115 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.115 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.115 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:09.115 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377677+0000", 2023-09-30T17:03:09.116 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9508999999999999e-05 2023-09-30T17:03:09.116 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.116 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.116 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:09.116 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377682+0000", 2023-09-30T17:03:09.116 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8300000000000001e-06 2023-09-30T17:03:09.116 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.116 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.116 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:09.116 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377725+0000", 2023-09-30T17:03:09.116 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2425000000000001e-05 2023-09-30T17:03:09.117 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.117 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.117 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:09.117 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377738+0000", 2023-09-30T17:03:09.117 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2899e-05 2023-09-30T17:03:09.117 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.117 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.117 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:09.117 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382268+0000", 2023-09-30T17:03:09.117 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045301289999999999 2023-09-30T17:03:09.117 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.118 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.118 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:09.118 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382315+0000", 2023-09-30T17:03:09.118 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7539e-05 2023-09-30T17:03:09.118 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:09.118 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:09.118 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:09.118 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.118 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.118 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-09-30T17:03:09.118 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:03:09.118 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 50.648811205000001, 2023-09-30T17:03:09.119 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042540670000000003, 2023-09-30T17:03:09.119 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:09.119 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:09.119 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:09.119 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.119 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:09.119 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:03:09.119 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:09.119 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.119 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.119 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:09.119 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:03:09.120 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:09.120 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.120 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.120 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:09.120 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:03:09.120 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0299999999999998e-07 2023-09-30T17:03:09.120 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.120 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.120 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:09.120 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378107+0000", 2023-09-30T17:03:09.120 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9250000000000003e-06 2023-09-30T17:03:09.120 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.121 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.121 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:09.121 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378116+0000", 2023-09-30T17:03:09.121 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.037e-06 2023-09-30T17:03:09.121 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.121 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.121 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:09.121 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378123+0000", 2023-09-30T17:03:09.121 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1879999999999996e-06 2023-09-30T17:03:09.121 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.121 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.122 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:09.122 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378174+0000", 2023-09-30T17:03:09.122 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0998000000000002e-05 2023-09-30T17:03:09.122 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.122 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.122 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:09.122 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378197+0000", 2023-09-30T17:03:09.122 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2558e-05 2023-09-30T17:03:09.122 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.122 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.122 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:09.122 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382319+0000", 2023-09-30T17:03:09.123 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041220950000000001 2023-09-30T17:03:09.123 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.123 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.123 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:09.123 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382356+0000", 2023-09-30T17:03:09.123 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6563000000000002e-05 2023-09-30T17:03:09.123 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:09.123 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:09.123 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:09.123 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.123 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.123 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-09-30T17:03:09.124 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:03:09.124 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 46.591047381000003, 2023-09-30T17:03:09.124 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00171641, 2023-09-30T17:03:09.124 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:09.124 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:09.124 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:09.124 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.124 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:09.124 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:03:09.124 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:09.124 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.125 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.125 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:09.125 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:03:09.125 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:09.125 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.125 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.125 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:09.125 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435868+0000", 2023-09-30T17:03:09.125 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5840000000000002e-06 2023-09-30T17:03:09.125 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.125 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.125 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:09.126 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435892+0000", 2023-09-30T17:03:09.126 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3625000000000002e-05 2023-09-30T17:03:09.126 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.126 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.126 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:09.126 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435908+0000", 2023-09-30T17:03:09.126 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6548000000000001e-05 2023-09-30T17:03:09.126 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.126 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.126 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:09.126 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435935+0000", 2023-09-30T17:03:09.127 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6516000000000002e-05 2023-09-30T17:03:09.127 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.127 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.127 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:09.127 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435996+0000", 2023-09-30T17:03:09.127 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1433999999999995e-05 2023-09-30T17:03:09.127 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.127 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.127 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:09.127 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436114+0000", 2023-09-30T17:03:09.127 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000118344 2023-09-30T17:03:09.127 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.128 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.128 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:09.128 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436219+0000", 2023-09-30T17:03:09.128 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010453100000000001 2023-09-30T17:03:09.128 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.128 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.128 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:09.128 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436900+0000", 2023-09-30T17:03:09.128 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00068121299999999996 2023-09-30T17:03:09.128 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.128 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.128 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:09.129 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437508+0000", 2023-09-30T17:03:09.129 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00060817399999999995 2023-09-30T17:03:09.129 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.129 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.129 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:09.129 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437554+0000", 2023-09-30T17:03:09.129 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5609000000000003e-05 2023-09-30T17:03:09.129 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.129 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.129 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:09.129 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437582+0000", 2023-09-30T17:03:09.129 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7832000000000001e-05 2023-09-30T17:03:09.130 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:09.130 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:09.130 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:09.130 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.130 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.130 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2023-09-30T17:03:09.130 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:03:09.130 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 26.590735887000001, 2023-09-30T17:03:09.130 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001456199, 2023-09-30T17:03:09.130 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:09.130 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:09.130 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:09.130 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.131 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:09.131 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:03:09.131 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:09.131 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.131 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.131 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:09.131 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:03:09.131 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:09.131 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.131 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.131 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:09.131 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436178+0000", 2023-09-30T17:03:09.132 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.494e-06 2023-09-30T17:03:09.132 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.132 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.132 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:09.132 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436184+0000", 2023-09-30T17:03:09.132 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2809999999999999e-06 2023-09-30T17:03:09.132 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.132 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.132 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:09.132 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436198+0000", 2023-09-30T17:03:09.132 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3978000000000001e-05 2023-09-30T17:03:09.132 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.133 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:09.133 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436206+0000", 2023-09-30T17:03:09.133 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8040000000000007e-06 2023-09-30T17:03:09.133 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.133 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:09.133 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436268+0000", 2023-09-30T17:03:09.133 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1484999999999998e-05 2023-09-30T17:03:09.133 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.133 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:09.134 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436339+0000", 2023-09-30T17:03:09.134 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1000000000000005e-05 2023-09-30T17:03:09.134 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.134 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.134 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:09.134 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436438+0000", 2023-09-30T17:03:09.134 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9389000000000007e-05 2023-09-30T17:03:09.134 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.134 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.134 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:09.134 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436986+0000", 2023-09-30T17:03:09.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054723399999999996 2023-09-30T17:03:09.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.135 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.135 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:09.135 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437566+0000", 2023-09-30T17:03:09.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00058017599999999996 2023-09-30T17:03:09.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.135 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.135 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:09.135 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437606+0000", 2023-09-30T17:03:09.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9891999999999997e-05 2023-09-30T17:03:09.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:09.135 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:09.136 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:09.136 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437633+0000", 2023-09-30T17:03:09.136 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7466000000000001e-05 2023-09-30T17:03:09.136 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:09.136 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:09.136 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:09.136 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:09.136 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:09.136 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:09.138 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:03:09.138 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:09.137+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:09.239 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-09-30T17:03:09.239 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:09.238+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:09.284 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:09.284 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:03:09.284 INFO:teuthology.orchestra.run.smithi031.stdout: "num_ops": 0 2023-09-30T17:03:09.284 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:09.295 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:03:09.378 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:09.378+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:09.415 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:03:09.440 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:09.440+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:09.452 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:03:09.452 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-09-30T17:03:09.452 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-09-30T17:03:09.453 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:03:09.456 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:03:09.456 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:03:09.467 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:09.467 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:09.477 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:03:09.541 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:09.541+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:09.641 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:09.641+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:09.650 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:09.651 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:09.661 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:03:09.742 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:09.741+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:09.789 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:09.789 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:09.799 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:03:09.882 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:09.882+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:09.944 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:09.944+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:09.965 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:09.966 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:09.975 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:03:10.045 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:10.045+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:10.143 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:10.143 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:10.146 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:10.146+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:10.153 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:03:10.247 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:10.246+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:10.292 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:10.292 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:10.302 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:03:10.320 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-09-30T17:03:10.348 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:10.348+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:10.449 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:10.449+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:10.474 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:10.474 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:10.484 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:03:10.549 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:10.550+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:10.615 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:10.616 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:10.626 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:03:10.650 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:10.650+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:10.751 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:10.751+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:10.756 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:10.756 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:10.766 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:03:10.852 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:10.852+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:10.892 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:10.892 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:10.902 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:03:10.953 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:10.953+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:10.998 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~24s 2023-09-30T17:03:11.027 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:11.028 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:11.037 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:03:11.079 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:11.079+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:11.154 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:11.154+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:11.174 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:11.174 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:11.185 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:03:11.268 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:11.268+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:11.313 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is unset 2023-09-30T17:03:11.356 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:11.356+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:11.357 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:11.357 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:11.368 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:03:11.457 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:11.456+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:11.457 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-09-30T17:03:11.539 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:11.539 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:11.549 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:03:11.590 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:11.590+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:11.655 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:03:11.659 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:11.658+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:11.678 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:11.678 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:11.689 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:03:11.692 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:03:11.692 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-09-30T17:03:11.693 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-09-30T17:03:11.693 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:03:11.697 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:03:11.697 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:03:11.760 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:11.759+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:11.814 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:11.815 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:03:11.815 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2023-09-30T17:03:11.815 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2023-09-30T17:03:11.815 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:11.824 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:03:11.860 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:11.860+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:11.951 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:11.952 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2023-09-30T17:03:11.952 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2023-09-30T17:03:11.952 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2023-09-30T17:03:11.952 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.952 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:11.952 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:03:11.952 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 53.598545057000003, 2023-09-30T17:03:11.952 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093789779999999996, 2023-09-30T17:03:11.952 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:11.952 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:11.952 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:11.952 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.953 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:11.953 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:03:11.953 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:11.953 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.953 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.953 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:11.953 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:03:11.953 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:11.953 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.953 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.953 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:11.953 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352027+0000", 2023-09-30T17:03:11.954 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0224000000000001e-05 2023-09-30T17:03:11.954 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.954 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.954 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:11.954 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352039+0000", 2023-09-30T17:03:11.954 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1569000000000001e-05 2023-09-30T17:03:11.954 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.954 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.954 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:11.954 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352052+0000", 2023-09-30T17:03:11.954 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2605999999999999e-05 2023-09-30T17:03:11.954 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.955 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.955 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:11.955 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352064+0000", 2023-09-30T17:03:11.955 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2666999999999999e-05 2023-09-30T17:03:11.955 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.955 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.955 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:11.955 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352147+0000", 2023-09-30T17:03:11.955 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3125000000000001e-05 2023-09-30T17:03:11.955 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.955 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.955 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:11.955 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352306+0000", 2023-09-30T17:03:11.956 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015881900000000001 2023-09-30T17:03:11.956 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.956 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.956 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:11.956 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352450+0000", 2023-09-30T17:03:11.956 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014420700000000001 2023-09-30T17:03:11.956 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.956 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.956 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:11.956 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355975+0000", 2023-09-30T17:03:11.956 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003524246 2023-09-30T17:03:11.956 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.957 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.957 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:11.957 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361279+0000", 2023-09-30T17:03:11.957 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005304507 2023-09-30T17:03:11.957 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.957 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.957 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:11.957 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361344+0000", 2023-09-30T17:03:11.957 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4548999999999995e-05 2023-09-30T17:03:11.957 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.957 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.957 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:11.957 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361396+0000", 2023-09-30T17:03:11.958 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2459e-05 2023-09-30T17:03:11.958 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:11.958 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:11.958 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:11.958 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.958 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.958 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:11.958 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:03:11.958 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 53.598452764999998, 2023-09-30T17:03:11.958 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021233007000000002, 2023-09-30T17:03:11.958 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:11.958 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:11.959 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:11.959 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.959 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:11.959 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:03:11.959 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:11.959 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.959 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.959 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:11.959 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:03:11.959 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:11.959 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.959 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.960 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:11.960 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352110+0000", 2023-09-30T17:03:11.960 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6000000000000002e-07 2023-09-30T17:03:11.960 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.960 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.960 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:11.960 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352117+0000", 2023-09-30T17:03:11.960 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5930000000000002e-06 2023-09-30T17:03:11.960 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.960 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.960 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:11.960 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352126+0000", 2023-09-30T17:03:11.960 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0729999999999994e-06 2023-09-30T17:03:11.961 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.961 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.961 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:11.961 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352136+0000", 2023-09-30T17:03:11.961 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0380000000000001e-05 2023-09-30T17:03:11.961 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.961 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.961 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:11.961 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353279+0000", 2023-09-30T17:03:11.961 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0011424670000000001 2023-09-30T17:03:11.961 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.961 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.962 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:11.962 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353707+0000", 2023-09-30T17:03:11.962 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00042829800000000003 2023-09-30T17:03:11.962 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.962 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.962 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:11.962 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354104+0000", 2023-09-30T17:03:11.962 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00039643399999999998 2023-09-30T17:03:11.962 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.962 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.962 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:11.963 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356925+0000", 2023-09-30T17:03:11.963 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0028210900000000001 2023-09-30T17:03:11.963 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.963 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.963 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:11.963 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373243+0000", 2023-09-30T17:03:11.963 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016318461999999999 2023-09-30T17:03:11.963 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.963 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.963 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:11.963 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373301+0000", 2023-09-30T17:03:11.963 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7435000000000002e-05 2023-09-30T17:03:11.964 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.964 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.964 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:11.964 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373342+0000", 2023-09-30T17:03:11.964 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1915000000000001e-05 2023-09-30T17:03:11.964 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:11.964 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:11.964 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:11.964 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.964 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.964 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:11.964 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:03:11.964 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 53.598410154, 2023-09-30T17:03:11.965 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011988331, 2023-09-30T17:03:11.965 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:11.965 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:11.965 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:11.965 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.965 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:11.965 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:03:11.965 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:11.965 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.965 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.965 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:11.965 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:03:11.966 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:11.966 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.966 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.966 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:11.966 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352153+0000", 2023-09-30T17:03:11.966 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0500000000000003e-07 2023-09-30T17:03:11.966 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.966 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.966 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:11.966 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352157+0000", 2023-09-30T17:03:11.966 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9790000000000004e-06 2023-09-30T17:03:11.966 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.966 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.967 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:11.967 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352173+0000", 2023-09-30T17:03:11.967 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6535999999999999e-05 2023-09-30T17:03:11.967 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.967 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.967 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:11.967 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352180+0000", 2023-09-30T17:03:11.967 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7700000000000004e-06 2023-09-30T17:03:11.967 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.967 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.967 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:11.967 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353526+0000", 2023-09-30T17:03:11.968 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0013458330000000001 2023-09-30T17:03:11.968 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.968 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.968 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:11.968 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353648+0000", 2023-09-30T17:03:11.968 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012262899999999999 2023-09-30T17:03:11.968 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.968 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.968 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:11.968 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354141+0000", 2023-09-30T17:03:11.968 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00049222899999999995 2023-09-30T17:03:11.968 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.969 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.969 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:11.969 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356931+0000", 2023-09-30T17:03:11.969 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0027900860000000002 2023-09-30T17:03:11.969 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.969 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.969 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:11.969 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364066+0000", 2023-09-30T17:03:11.969 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071355050000000003 2023-09-30T17:03:11.969 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.969 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.969 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:11.969 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364103+0000", 2023-09-30T17:03:11.970 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6944999999999999e-05 2023-09-30T17:03:11.970 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.970 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.970 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:11.970 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364140+0000", 2023-09-30T17:03:11.970 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7214e-05 2023-09-30T17:03:11.970 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:11.970 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:11.970 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:11.970 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.970 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.970 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:11.971 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:03:11.971 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 53.598370922999997, 2023-09-30T17:03:11.971 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012110921, 2023-09-30T17:03:11.971 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:11.971 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:11.971 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:11.971 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.971 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:11.971 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:03:11.971 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:11.971 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.972 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.972 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:11.972 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:03:11.972 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:11.972 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.972 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.972 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:11.972 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352192+0000", 2023-09-30T17:03:11.972 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7300000000000005e-07 2023-09-30T17:03:11.972 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.972 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.972 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:11.973 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352196+0000", 2023-09-30T17:03:11.973 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2370000000000003e-06 2023-09-30T17:03:11.973 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.973 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.973 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:11.973 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352205+0000", 2023-09-30T17:03:11.973 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6659999999999997e-06 2023-09-30T17:03:11.973 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.973 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.973 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:11.973 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352214+0000", 2023-09-30T17:03:11.974 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8259999999999999e-06 2023-09-30T17:03:11.974 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.974 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.974 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:11.974 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354470+0000", 2023-09-30T17:03:11.974 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022557340000000001 2023-09-30T17:03:11.974 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.974 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.974 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:11.974 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354557+0000", 2023-09-30T17:03:11.974 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6909000000000004e-05 2023-09-30T17:03:11.974 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.975 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.975 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:11.975 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354694+0000", 2023-09-30T17:03:11.975 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013774800000000001 2023-09-30T17:03:11.975 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.975 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.975 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:11.975 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356937+0000", 2023-09-30T17:03:11.975 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022424540000000001 2023-09-30T17:03:11.975 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.975 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.975 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:11.976 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364227+0000", 2023-09-30T17:03:11.976 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072902430000000001 2023-09-30T17:03:11.976 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.976 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.976 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:11.976 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364278+0000", 2023-09-30T17:03:11.976 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1180999999999997e-05 2023-09-30T17:03:11.976 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.976 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.976 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:11.976 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364302+0000", 2023-09-30T17:03:11.976 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4049999999999998e-05 2023-09-30T17:03:11.977 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:11.977 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:11.977 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:11.977 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.977 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.977 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:11.977 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:11.977 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 53.598337583999999, 2023-09-30T17:03:11.977 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021258651999999999, 2023-09-30T17:03:11.977 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:11.977 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:11.977 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:11.978 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.978 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:11.978 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:11.978 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:11.978 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.978 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.978 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:11.978 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:11.978 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:11.978 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.978 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.978 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:11.979 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:11.979 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6899999999999997e-07 2023-09-30T17:03:11.979 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.979 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.979 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:11.979 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352236+0000", 2023-09-30T17:03:11.979 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0251000000000001e-05 2023-09-30T17:03:11.979 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.979 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.979 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:11.979 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352244+0000", 2023-09-30T17:03:11.979 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0770000000000008e-06 2023-09-30T17:03:11.979 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.980 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.980 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:11.980 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352251+0000", 2023-09-30T17:03:11.980 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4749999999999996e-06 2023-09-30T17:03:11.980 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.980 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.980 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:11.980 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354455+0000", 2023-09-30T17:03:11.980 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022043660000000001 2023-09-30T17:03:11.980 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.980 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.980 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:11.981 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354577+0000", 2023-09-30T17:03:11.981 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000121054 2023-09-30T17:03:11.981 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.981 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.981 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:11.981 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354723+0000", 2023-09-30T17:03:11.981 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014693900000000001 2023-09-30T17:03:11.981 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.981 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.981 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:11.981 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356941+0000", 2023-09-30T17:03:11.981 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002217199 2023-09-30T17:03:11.982 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.982 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.982 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:11.982 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373392+0000", 2023-09-30T17:03:11.982 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016451774999999998 2023-09-30T17:03:11.982 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.982 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.982 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:11.982 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373445+0000", 2023-09-30T17:03:11.982 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.308e-05 2023-09-30T17:03:11.982 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.982 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.983 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:11.983 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373483+0000", 2023-09-30T17:03:11.983 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7766999999999999e-05 2023-09-30T17:03:11.983 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:11.983 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:11.983 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:11.983 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.983 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.983 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:11.983 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:11.983 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 53.598301493000001, 2023-09-30T17:03:11.983 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020903497, 2023-09-30T17:03:11.984 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:11.984 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:11.984 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:11.984 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.984 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:11.984 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:11.984 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:11.984 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.984 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.984 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:11.984 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:11.984 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:11.985 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.985 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.985 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:11.985 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:11.985 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0800000000000004e-07 2023-09-30T17:03:11.985 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.985 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.985 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:11.985 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352266+0000", 2023-09-30T17:03:11.985 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1280000000000001e-06 2023-09-30T17:03:11.985 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.986 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.986 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:11.986 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352273+0000", 2023-09-30T17:03:11.986 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3730000000000004e-06 2023-09-30T17:03:11.986 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.986 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.986 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:11.986 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352279+0000", 2023-09-30T17:03:11.986 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7699999999999998e-06 2023-09-30T17:03:11.986 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.986 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.987 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:11.987 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352334+0000", 2023-09-30T17:03:11.987 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5547999999999997e-05 2023-09-30T17:03:11.987 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.987 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.987 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:11.987 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352435+0000", 2023-09-30T17:03:11.987 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100688 2023-09-30T17:03:11.987 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.987 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.987 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:11.987 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352585+0000", 2023-09-30T17:03:11.988 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000150068 2023-09-30T17:03:11.988 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.988 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:11.988 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354912+0000", 2023-09-30T17:03:11.988 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0023266770000000001 2023-09-30T17:03:11.988 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.988 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:11.988 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373066+0000", 2023-09-30T17:03:11.988 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018154474 2023-09-30T17:03:11.989 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.989 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.989 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:11.989 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373122+0000", 2023-09-30T17:03:11.989 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6193000000000002e-05 2023-09-30T17:03:11.989 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.989 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.989 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:11.989 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373164+0000", 2023-09-30T17:03:11.989 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1869999999999997e-05 2023-09-30T17:03:11.989 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:11.989 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:11.990 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:11.990 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.990 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.990 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:11.990 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:03:11.990 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 53.598265816999998, 2023-09-30T17:03:11.990 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021015097999999999, 2023-09-30T17:03:11.990 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:11.990 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:11.990 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:11.990 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.991 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:11.991 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:03:11.991 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:11.991 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.991 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.991 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:11.991 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:03:11.991 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:11.991 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.991 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:11.992 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352297+0000", 2023-09-30T17:03:11.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8299999999999997e-07 2023-09-30T17:03:11.992 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:11.992 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352300+0000", 2023-09-30T17:03:11.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7460000000000001e-06 2023-09-30T17:03:11.992 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:11.992 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352307+0000", 2023-09-30T17:03:11.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4959999999999999e-06 2023-09-30T17:03:11.993 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.993 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.993 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:11.993 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352314+0000", 2023-09-30T17:03:11.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0190000000000001e-06 2023-09-30T17:03:11.993 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.993 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.993 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:11.993 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354070+0000", 2023-09-30T17:03:11.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001755936 2023-09-30T17:03:11.993 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.993 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.993 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:11.994 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354221+0000", 2023-09-30T17:03:11.994 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000150884 2023-09-30T17:03:11.994 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.994 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.994 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:11.994 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373311+0000", 2023-09-30T17:03:11.994 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019090434 2023-09-30T17:03:11.994 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:11.994 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:11.994 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:11.994 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.994 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.995 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:11.995 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:03:11.995 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 53.598237097999998, 2023-09-30T17:03:11.995 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021255174000000002, 2023-09-30T17:03:11.995 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:11.995 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:11.995 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:11.995 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.995 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:11.995 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:03:11.995 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:11.996 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.996 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:11.996 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:03:11.996 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:11.996 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.996 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:11.996 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352326+0000", 2023-09-30T17:03:11.996 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3200000000000005e-07 2023-09-30T17:03:11.996 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.997 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:11.997 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352349+0000", 2023-09-30T17:03:11.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3183000000000001e-05 2023-09-30T17:03:11.997 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.997 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:11.997 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352358+0000", 2023-09-30T17:03:11.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5230000000000001e-06 2023-09-30T17:03:11.997 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.997 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:11.997 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352365+0000", 2023-09-30T17:03:11.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3260000000000001e-06 2023-09-30T17:03:11.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.998 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:11.998 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355450+0000", 2023-09-30T17:03:11.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0030854049999999998 2023-09-30T17:03:11.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.998 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:11.998 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355583+0000", 2023-09-30T17:03:11.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000133189 2023-09-30T17:03:11.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.999 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:11.999 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373580+0000", 2023-09-30T17:03:11.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017997016000000001 2023-09-30T17:03:11.999 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:11.999 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:11.999 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:11.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:11.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:11.999 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:11.999 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:03:11.999 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 53.598185675000003, 2023-09-30T17:03:11.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010380537, 2023-09-30T17:03:12.000 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:12.000 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:12.000 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:12.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.000 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:12.000 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:03:12.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:12.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.000 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:12.000 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:03:12.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:12.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.001 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:12.001 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:03:12.001 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1500000000000003e-07 2023-09-30T17:03:12.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.001 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:12.001 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352381+0000", 2023-09-30T17:03:12.001 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6330000000000002e-06 2023-09-30T17:03:12.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.002 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:12.002 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352388+0000", 2023-09-30T17:03:12.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7229999999999998e-06 2023-09-30T17:03:12.002 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.002 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:12.002 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352394+0000", 2023-09-30T17:03:12.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1789999999999996e-06 2023-09-30T17:03:12.002 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.002 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:12.003 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353259+0000", 2023-09-30T17:03:12.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000865221 2023-09-30T17:03:12.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.003 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.003 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:12.003 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353391+0000", 2023-09-30T17:03:12.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013217700000000001 2023-09-30T17:03:12.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.003 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.003 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:12.003 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362757+0000", 2023-09-30T17:03:12.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093657889999999994 2023-09-30T17:03:12.003 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:12.004 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:12.004 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:12.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.004 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-09-30T17:03:12.004 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:03:12.004 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 53.591885382999997, 2023-09-30T17:03:12.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0061813579999999996, 2023-09-30T17:03:12.004 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:12.004 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2023-09-30T17:03:12.004 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:12.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.005 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:12.005 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:03:12.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:12.005 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.005 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:12.005 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:03:12.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:12.005 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.005 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:12.006 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:03:12.006 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5499999999999999e-07 2023-09-30T17:03:12.006 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.006 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:12.006 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358686+0000", 2023-09-30T17:03:12.006 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9979999999999992e-06 2023-09-30T17:03:12.006 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.006 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:12.006 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358700+0000", 2023-09-30T17:03:12.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3635000000000001e-05 2023-09-30T17:03:12.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.007 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:12.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358714+0000", 2023-09-30T17:03:12.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4470999999999999e-05 2023-09-30T17:03:12.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.007 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:12.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358767+0000", 2023-09-30T17:03:12.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2651999999999997e-05 2023-09-30T17:03:12.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.008 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:12.008 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364858+0000", 2023-09-30T17:03:12.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060912470000000002 2023-09-30T17:03:12.008 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:12.008 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:12.008 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:12.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.008 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2023-09-30T17:03:12.008 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:03:12.008 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 53.589520542999999, 2023-09-30T17:03:12.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00036246299999999999, 2023-09-30T17:03:12.009 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:12.009 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:12.009 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:12.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.009 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:12.009 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:03:12.009 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:12.009 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.009 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:12.009 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:03:12.009 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:12.010 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.010 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:12.010 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:03:12.010 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3099999999999999e-07 2023-09-30T17:03:12.010 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.010 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:12.010 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361045+0000", 2023-09-30T17:03:12.010 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.49e-06 2023-09-30T17:03:12.010 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:12.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361056+0000", 2023-09-30T17:03:12.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0910000000000001e-05 2023-09-30T17:03:12.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:12.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361067+0000", 2023-09-30T17:03:12.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0531e-05 2023-09-30T17:03:12.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:12.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361263+0000", 2023-09-30T17:03:12.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000196486 2023-09-30T17:03:12.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:12.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361273+0000", 2023-09-30T17:03:12.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3379999999999994e-06 2023-09-30T17:03:12.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:12.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361404+0000", 2023-09-30T17:03:12.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013137700000000001 2023-09-30T17:03:12.013 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:12.013 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:12.013 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:12.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.013 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:31 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:03:12.013 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:03:12.013 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 53.588544513999999, 2023-09-30T17:03:12.013 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006676408, 2023-09-30T17:03:12.013 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:12.013 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:12.013 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:12.014 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.014 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:12.014 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:03:12.014 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:12.014 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.014 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.014 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:12.014 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:03:12.014 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:12.014 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.014 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.014 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:12.015 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:03:12.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5600000000000002e-07 2023-09-30T17:03:12.015 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:12.015 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362044+0000", 2023-09-30T17:03:12.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5987999999999999e-05 2023-09-30T17:03:12.015 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:12.015 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362051+0000", 2023-09-30T17:03:12.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2599999999999999e-06 2023-09-30T17:03:12.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:12.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362057+0000", 2023-09-30T17:03:12.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.19e-06 2023-09-30T17:03:12.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:12.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362096+0000", 2023-09-30T17:03:12.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8278000000000002e-05 2023-09-30T17:03:12.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:12.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362114+0000", 2023-09-30T17:03:12.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8808e-05 2023-09-30T17:03:12.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:12.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368658+0000", 2023-09-30T17:03:12.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065433540000000004 2023-09-30T17:03:12.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:12.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368694+0000", 2023-09-30T17:03:12.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6273999999999999e-05 2023-09-30T17:03:12.018 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:12.018 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:12.018 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:12.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.018 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:26 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-09-30T17:03:12.018 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:03:12.018 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 53.588453741999999, 2023-09-30T17:03:12.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0066596119999999996, 2023-09-30T17:03:12.018 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:12.019 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:12.019 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:12.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.019 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:12.019 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:03:12.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:12.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.019 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:12.019 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:03:12.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:12.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:12.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362109+0000", 2023-09-30T17:03:12.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5699999999999999e-07 2023-09-30T17:03:12.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:12.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362112+0000", 2023-09-30T17:03:12.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8410000000000002e-06 2023-09-30T17:03:12.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:12.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362117+0000", 2023-09-30T17:03:12.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.792e-06 2023-09-30T17:03:12.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.021 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:12.021 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362122+0000", 2023-09-30T17:03:12.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.763e-06 2023-09-30T17:03:12.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.021 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:12.021 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362344+0000", 2023-09-30T17:03:12.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022181600000000001 2023-09-30T17:03:12.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.022 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:12.022 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362357+0000", 2023-09-30T17:03:12.022 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2864000000000001e-05 2023-09-30T17:03:12.022 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.022 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.022 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:12.022 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368738+0000", 2023-09-30T17:03:12.022 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063809499999999998 2023-09-30T17:03:12.022 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.022 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.022 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:12.023 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368768+0000", 2023-09-30T17:03:12.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0429e-05 2023-09-30T17:03:12.023 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:12.023 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:12.023 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:12.023 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.023 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.023 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2023-09-30T17:03:12.023 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:03:12.023 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 53.587237575000003, 2023-09-30T17:03:12.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00082185400000000001, 2023-09-30T17:03:12.023 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:12.023 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:12.024 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:12.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.024 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:12.024 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:03:12.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:12.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.024 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:12.024 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:03:12.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:12.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.025 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.025 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:12.025 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:03:12.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.22e-07 2023-09-30T17:03:12.025 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.025 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.025 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:12.025 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363327+0000", 2023-09-30T17:03:12.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4480000000000001e-06 2023-09-30T17:03:12.025 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.025 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.025 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:12.026 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363333+0000", 2023-09-30T17:03:12.026 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9989999999999997e-06 2023-09-30T17:03:12.026 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.026 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:12.026 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363354+0000", 2023-09-30T17:03:12.026 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0547000000000002e-05 2023-09-30T17:03:12.026 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.026 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:12.026 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364057+0000", 2023-09-30T17:03:12.026 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00070306600000000002 2023-09-30T17:03:12.027 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.027 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:12.027 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364063+0000", 2023-09-30T17:03:12.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.694e-06 2023-09-30T17:03:12.027 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.027 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:12.027 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364146+0000", 2023-09-30T17:03:12.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3877999999999999e-05 2023-09-30T17:03:12.027 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:12.027 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:12.028 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:12.028 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.028 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.028 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e18/16 ondisk, result = 0)", 2023-09-30T17:03:12.028 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:03:12.028 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 53.586924043000003, 2023-09-30T17:03:12.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00067007199999999996, 2023-09-30T17:03:12.028 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:12.028 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:12.028 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:12.028 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.028 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:12.029 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:03:12.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:12.029 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.029 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:12.029 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:03:12.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:12.029 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.029 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:12.029 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:03:12.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.41e-07 2023-09-30T17:03:12.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.030 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:12.030 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363641+0000", 2023-09-30T17:03:12.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4830000000000002e-06 2023-09-30T17:03:12.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.030 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:12.030 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363647+0000", 2023-09-30T17:03:12.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4869999999999999e-06 2023-09-30T17:03:12.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.030 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:12.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363654+0000", 2023-09-30T17:03:12.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5889999999999999e-06 2023-09-30T17:03:12.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:12.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364217+0000", 2023-09-30T17:03:12.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00056263199999999998 2023-09-30T17:03:12.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:12.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364222+0000", 2023-09-30T17:03:12.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.242e-06 2023-09-30T17:03:12.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.032 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:12.032 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364308+0000", 2023-09-30T17:03:12.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6397999999999995e-05 2023-09-30T17:03:12.032 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:12.032 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:12.032 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:12.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.032 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2023-09-30T17:03:12.032 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:03:12.033 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 53.577336133000003, 2023-09-30T17:03:12.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000359561, 2023-09-30T17:03:12.033 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:12.033 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2023-09-30T17:03:12.033 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:12.033 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.033 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:12.033 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:03:12.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:12.033 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.033 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.033 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:12.034 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:03:12.034 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:12.034 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.034 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:12.034 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:03:12.034 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1e-07 2023-09-30T17:03:12.034 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.034 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:12.034 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373228+0000", 2023-09-30T17:03:12.034 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9420000000000002e-06 2023-09-30T17:03:12.035 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.035 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.035 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:12.035 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373235+0000", 2023-09-30T17:03:12.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4230000000000002e-06 2023-09-30T17:03:12.035 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.035 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.035 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:12.035 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373239+0000", 2023-09-30T17:03:12.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6809999999999997e-06 2023-09-30T17:03:12.035 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:12.036 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373518+0000", 2023-09-30T17:03:12.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000278311 2023-09-30T17:03:12.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:12.036 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373586+0000", 2023-09-30T17:03:12.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7994e-05 2023-09-30T17:03:12.036 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:12.036 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:12.036 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:12.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.037 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:03:12.037 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:03:12.037 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 53.572910059999998, 2023-09-30T17:03:12.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0046632949999999996, 2023-09-30T17:03:12.037 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:12.037 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:12.037 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:12.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:12.037 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:03:12.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:12.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.038 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:12.038 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:03:12.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:12.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.038 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:12.038 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377653+0000", 2023-09-30T17:03:12.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7800000000000002e-07 2023-09-30T17:03:12.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.039 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:12.039 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377657+0000", 2023-09-30T17:03:12.039 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5859999999999998e-06 2023-09-30T17:03:12.039 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.039 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:12.039 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377677+0000", 2023-09-30T17:03:12.039 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9508999999999999e-05 2023-09-30T17:03:12.039 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.039 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:12.039 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377682+0000", 2023-09-30T17:03:12.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8300000000000001e-06 2023-09-30T17:03:12.040 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.040 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.040 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:12.040 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377725+0000", 2023-09-30T17:03:12.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2425000000000001e-05 2023-09-30T17:03:12.040 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.040 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.040 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:12.040 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377738+0000", 2023-09-30T17:03:12.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2899e-05 2023-09-30T17:03:12.040 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.040 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.041 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:12.041 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382268+0000", 2023-09-30T17:03:12.041 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045301289999999999 2023-09-30T17:03:12.041 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.041 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.041 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:12.041 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382315+0000", 2023-09-30T17:03:12.041 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7539e-05 2023-09-30T17:03:12.041 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:12.041 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:12.041 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:12.041 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.042 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.042 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-09-30T17:03:12.042 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:03:12.042 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 53.572460608999997, 2023-09-30T17:03:12.042 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042540670000000003, 2023-09-30T17:03:12.042 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:12.042 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:12.042 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:12.042 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.042 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:12.042 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:03:12.042 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:12.043 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.043 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.043 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:12.043 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:03:12.043 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:12.043 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.043 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.043 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:12.043 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:03:12.043 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0299999999999998e-07 2023-09-30T17:03:12.043 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.043 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.043 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:12.044 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378107+0000", 2023-09-30T17:03:12.044 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9250000000000003e-06 2023-09-30T17:03:12.044 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.044 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.044 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:12.044 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378116+0000", 2023-09-30T17:03:12.044 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.037e-06 2023-09-30T17:03:12.044 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.044 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.044 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:12.044 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378123+0000", 2023-09-30T17:03:12.045 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1879999999999996e-06 2023-09-30T17:03:12.045 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.045 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.045 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:12.045 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378174+0000", 2023-09-30T17:03:12.045 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0998000000000002e-05 2023-09-30T17:03:12.045 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.045 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.045 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:12.045 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378197+0000", 2023-09-30T17:03:12.045 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2558e-05 2023-09-30T17:03:12.045 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.046 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.046 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:12.046 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382319+0000", 2023-09-30T17:03:12.046 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041220950000000001 2023-09-30T17:03:12.046 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.046 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.046 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:12.046 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382356+0000", 2023-09-30T17:03:12.046 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6563000000000002e-05 2023-09-30T17:03:12.046 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:12.046 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:12.046 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:12.047 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.049 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.049 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-09-30T17:03:12.049 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:03:12.049 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 49.514696784999998, 2023-09-30T17:03:12.050 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00171641, 2023-09-30T17:03:12.050 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:12.050 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:12.050 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:12.050 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.050 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:12.050 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:03:12.050 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:12.050 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.050 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.050 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:12.050 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:03:12.050 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:12.051 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.051 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.051 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:12.051 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435868+0000", 2023-09-30T17:03:12.051 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5840000000000002e-06 2023-09-30T17:03:12.051 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.051 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.051 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:12.051 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435892+0000", 2023-09-30T17:03:12.051 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3625000000000002e-05 2023-09-30T17:03:12.051 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.052 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:12.052 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435908+0000", 2023-09-30T17:03:12.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6548000000000001e-05 2023-09-30T17:03:12.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.052 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:12.052 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435935+0000", 2023-09-30T17:03:12.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6516000000000002e-05 2023-09-30T17:03:12.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.052 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:12.053 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435996+0000", 2023-09-30T17:03:12.053 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1433999999999995e-05 2023-09-30T17:03:12.053 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.053 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.053 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:12.053 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436114+0000", 2023-09-30T17:03:12.053 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000118344 2023-09-30T17:03:12.053 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.053 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.053 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:12.053 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436219+0000", 2023-09-30T17:03:12.053 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010453100000000001 2023-09-30T17:03:12.054 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.054 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.054 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:12.054 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436900+0000", 2023-09-30T17:03:12.054 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00068121299999999996 2023-09-30T17:03:12.054 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.054 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.054 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:12.054 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437508+0000", 2023-09-30T17:03:12.054 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00060817399999999995 2023-09-30T17:03:12.054 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.055 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.055 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:12.055 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437554+0000", 2023-09-30T17:03:12.055 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5609000000000003e-05 2023-09-30T17:03:12.055 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.055 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.055 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:12.055 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437582+0000", 2023-09-30T17:03:12.055 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7832000000000001e-05 2023-09-30T17:03:12.055 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:12.055 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:12.055 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:12.056 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.056 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.056 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2023-09-30T17:03:12.056 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:03:12.056 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 29.514385291, 2023-09-30T17:03:12.056 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001456199, 2023-09-30T17:03:12.056 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:12.056 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:12.056 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:12.056 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.056 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:12.056 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:03:12.057 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:12.057 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.057 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.057 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:12.057 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:03:12.057 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:12.057 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.057 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.057 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:12.057 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436178+0000", 2023-09-30T17:03:12.057 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.494e-06 2023-09-30T17:03:12.057 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.058 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.058 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:12.058 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436184+0000", 2023-09-30T17:03:12.058 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2809999999999999e-06 2023-09-30T17:03:12.058 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.058 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.058 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:12.058 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436198+0000", 2023-09-30T17:03:12.058 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3978000000000001e-05 2023-09-30T17:03:12.058 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.058 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.058 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:12.058 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436206+0000", 2023-09-30T17:03:12.059 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8040000000000007e-06 2023-09-30T17:03:12.059 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.059 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.059 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:12.059 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436268+0000", 2023-09-30T17:03:12.059 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1484999999999998e-05 2023-09-30T17:03:12.059 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.059 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.059 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:12.059 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436339+0000", 2023-09-30T17:03:12.059 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1000000000000005e-05 2023-09-30T17:03:12.060 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.060 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.060 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:12.060 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436438+0000", 2023-09-30T17:03:12.060 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9389000000000007e-05 2023-09-30T17:03:12.060 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.060 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.060 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:12.060 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436986+0000", 2023-09-30T17:03:12.060 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054723399999999996 2023-09-30T17:03:12.060 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.060 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.061 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:12.061 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437566+0000", 2023-09-30T17:03:12.061 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00058017599999999996 2023-09-30T17:03:12.061 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.061 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.061 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:12.061 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437606+0000", 2023-09-30T17:03:12.061 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9891999999999997e-05 2023-09-30T17:03:12.061 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:12.061 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:12.061 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:12.061 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437633+0000", 2023-09-30T17:03:12.062 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7466000000000001e-05 2023-09-30T17:03:12.062 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:12.062 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:12.062 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:12.062 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:12.062 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:12.062 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:12.063 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:12.063+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:12.064 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:03:12.164 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:12.164+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:12.203 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:12.203 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:03:12.203 INFO:teuthology.orchestra.run.smithi031.stdout: "num_ops": 0 2023-09-30T17:03:12.203 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:12.213 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:03:12.264 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:12.264+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:12.345 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:12.345 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:03:12.346 INFO:teuthology.orchestra.run.smithi031.stdout: "complaint_time": 30, 2023-09-30T17:03:12.346 INFO:teuthology.orchestra.run.smithi031.stdout: "num_blocked_ops": 0 2023-09-30T17:03:12.346 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:12.355 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:03:12.399 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:12.399+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:12.465 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:12.465+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:12.489 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:12.489 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 20, 2023-09-30T17:03:12.489 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 600, 2023-09-30T17:03:12.489 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:03:12.489 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.489 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:32 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'18, mlcod=11'14)", 2023-09-30T17:03:12.489 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:03:12.490 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 65.126629535999996, 2023-09-30T17:03:12.490 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051629809999999996, 2023-09-30T17:03:12.490 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:12.490 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:12.490 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:12.490 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.490 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:12.490 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:03:12.490 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:12.490 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.490 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.491 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:12.491 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:03:12.491 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:12.491 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.491 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.491 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:12.491 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:03:12.491 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2099999999999996e-07 2023-09-30T17:03:12.491 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.491 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.491 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:12.491 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361407+0000", 2023-09-30T17:03:12.492 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7499e-05 2023-09-30T17:03:12.492 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.492 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.492 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:12.492 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361418+0000", 2023-09-30T17:03:12.492 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1127999999999999e-05 2023-09-30T17:03:12.492 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.492 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.492 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:12.492 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361423+0000", 2023-09-30T17:03:12.492 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1930000000000001e-06 2023-09-30T17:03:12.493 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.493 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.493 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:12.493 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361476+0000", 2023-09-30T17:03:12.493 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3399000000000002e-05 2023-09-30T17:03:12.493 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.493 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.493 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:12.493 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361496+0000", 2023-09-30T17:03:12.493 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9638000000000001e-05 2023-09-30T17:03:12.493 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.493 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.494 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:12.494 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.366474+0000", 2023-09-30T17:03:12.494 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0049778829999999998 2023-09-30T17:03:12.494 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.494 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.494 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:12.494 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.366512+0000", 2023-09-30T17:03:12.494 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7620000000000002e-05 2023-09-30T17:03:12.494 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:12.494 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:12.494 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:12.495 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.495 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.495 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:37 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'23, mlcod=11'15)", 2023-09-30T17:03:12.495 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:03:12.495 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 65.124027538999997, 2023-09-30T17:03:12.495 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053985689999999998, 2023-09-30T17:03:12.495 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:12.495 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:12.495 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:12.495 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.495 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:12.495 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:03:12.496 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:12.496 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.496 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.496 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:12.496 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:03:12.496 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:12.496 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.496 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.496 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:12.496 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:03:12.496 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4400000000000001e-07 2023-09-30T17:03:12.497 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.497 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.497 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:12.497 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363956+0000", 2023-09-30T17:03:12.497 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.921e-06 2023-09-30T17:03:12.497 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.497 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.497 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:12.497 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363966+0000", 2023-09-30T17:03:12.497 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0351e-05 2023-09-30T17:03:12.497 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.497 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.498 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:12.498 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363971+0000", 2023-09-30T17:03:12.498 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.023e-06 2023-09-30T17:03:12.498 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.498 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.498 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:12.498 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.364013+0000", 2023-09-30T17:03:12.498 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1575000000000001e-05 2023-09-30T17:03:12.498 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.498 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.498 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:12.499 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.364026+0000", 2023-09-30T17:03:12.499 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3044000000000001e-05 2023-09-30T17:03:12.499 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.499 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.499 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:12.499 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.369308+0000", 2023-09-30T17:03:12.499 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005282152 2023-09-30T17:03:12.499 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.499 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.499 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:12.499 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.369349+0000", 2023-09-30T17:03:12.499 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1059000000000001e-05 2023-09-30T17:03:12.500 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:12.500 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:12.500 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:12.500 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.500 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.500 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:155 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'109, mlcod=11'105)", 2023-09-30T17:03:12.500 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:03:12.500 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 64.642331853000002, 2023-09-30T17:03:12.500 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053867639999999996, 2023-09-30T17:03:12.500 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:12.500 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:12.500 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:12.501 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.501 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:12.501 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:03:12.501 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:12.501 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.501 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.501 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:12.501 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:03:12.501 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:12.501 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.501 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.501 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:12.502 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845647+0000", 2023-09-30T17:03:12.502 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7599999999999997e-07 2023-09-30T17:03:12.502 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.502 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.502 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:12.502 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845699+0000", 2023-09-30T17:03:12.502 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1758000000000001e-05 2023-09-30T17:03:12.502 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.502 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.502 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:12.503 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845708+0000", 2023-09-30T17:03:12.503 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2159999999999995e-06 2023-09-30T17:03:12.503 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.503 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.503 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:12.503 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845712+0000", 2023-09-30T17:03:12.503 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2579999999999997e-06 2023-09-30T17:03:12.503 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.503 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.503 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:12.503 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845756+0000", 2023-09-30T17:03:12.503 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4119999999999998e-05 2023-09-30T17:03:12.504 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.504 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.504 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:12.504 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845779+0000", 2023-09-30T17:03:12.504 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2311e-05 2023-09-30T17:03:12.504 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.504 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.504 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:12.504 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.850982+0000", 2023-09-30T17:03:12.504 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005203053 2023-09-30T17:03:12.504 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.505 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.505 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:12.505 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851033+0000", 2023-09-30T17:03:12.505 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1471999999999998e-05 2023-09-30T17:03:12.505 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:12.505 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:12.505 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:12.505 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.505 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.505 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:156 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'110, mlcod=11'105)", 2023-09-30T17:03:12.505 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:03:12.505 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 64.641798926999996, 2023-09-30T17:03:12.506 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0052834759999999996, 2023-09-30T17:03:12.506 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:12.506 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:12.506 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:12.506 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.506 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:12.506 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:03:12.506 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:12.507 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.507 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.507 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:12.507 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:03:12.507 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:12.507 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.507 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.507 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:12.507 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846180+0000", 2023-09-30T17:03:12.507 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6300000000000005e-07 2023-09-30T17:03:12.508 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.508 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.508 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:12.508 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846184+0000", 2023-09-30T17:03:12.508 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3789999999999999e-06 2023-09-30T17:03:12.508 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.508 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.508 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:12.508 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846195+0000", 2023-09-30T17:03:12.508 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0778000000000001e-05 2023-09-30T17:03:12.508 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.509 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.509 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:12.509 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846200+0000", 2023-09-30T17:03:12.509 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1540000000000001e-06 2023-09-30T17:03:12.509 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.509 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.509 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:12.509 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846274+0000", 2023-09-30T17:03:12.509 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4129999999999997e-05 2023-09-30T17:03:12.509 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.509 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.510 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:12.510 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846286+0000", 2023-09-30T17:03:12.510 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1744e-05 2023-09-30T17:03:12.510 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.510 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.510 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:12.510 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851432+0000", 2023-09-30T17:03:12.510 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051462110000000004 2023-09-30T17:03:12.510 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.510 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.510 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:12.511 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851463+0000", 2023-09-30T17:03:12.511 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0516999999999999e-05 2023-09-30T17:03:12.511 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:12.511 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:12.511 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:12.511 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.511 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.511 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:203 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'149, mlcod=11'145)", 2023-09-30T17:03:12.511 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:03:12.511 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 64.285763017999997, 2023-09-30T17:03:12.511 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051867459999999999, 2023-09-30T17:03:12.511 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:12.512 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:12.512 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:12.512 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.512 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:12.512 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:03:12.512 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:12.512 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.512 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.512 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:12.512 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:03:12.512 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:12.512 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.513 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.513 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:12.513 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202216+0000", 2023-09-30T17:03:12.513 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7e-07 2023-09-30T17:03:12.513 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.513 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.513 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:12.513 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202271+0000", 2023-09-30T17:03:12.513 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5163e-05 2023-09-30T17:03:12.513 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.513 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.514 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:12.514 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202282+0000", 2023-09-30T17:03:12.514 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1319e-05 2023-09-30T17:03:12.514 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.514 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.514 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:12.514 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202288+0000", 2023-09-30T17:03:12.514 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2899999999999999e-06 2023-09-30T17:03:12.514 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.514 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.515 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:12.515 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202331+0000", 2023-09-30T17:03:12.515 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2147999999999997e-05 2023-09-30T17:03:12.515 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.515 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.515 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:12.515 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202348+0000", 2023-09-30T17:03:12.515 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7317e-05 2023-09-30T17:03:12.515 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.515 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.516 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:12.516 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.207357+0000", 2023-09-30T17:03:12.516 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0050095440000000003 2023-09-30T17:03:12.516 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.516 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.516 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:12.516 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.207402+0000", 2023-09-30T17:03:12.516 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4495e-05 2023-09-30T17:03:12.516 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:12.516 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:12.516 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:12.517 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.517 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.517 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:12.517 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:03:12.517 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 54.136432730000003, 2023-09-30T17:03:12.517 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.025313649000000001, 2023-09-30T17:03:12.517 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:12.517 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:12.517 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:12.518 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.518 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:12.518 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:03:12.518 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:12.518 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.518 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.518 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:12.518 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:03:12.518 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:12.518 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.518 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.519 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:12.519 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351551+0000", 2023-09-30T17:03:12.519 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3380000000000004e-06 2023-09-30T17:03:12.519 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.519 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.519 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:12.519 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351559+0000", 2023-09-30T17:03:12.519 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9589999999999995e-06 2023-09-30T17:03:12.519 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.519 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.519 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:12.520 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351571+0000", 2023-09-30T17:03:12.520 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2065999999999999e-05 2023-09-30T17:03:12.520 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.520 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.520 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:12.520 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351706+0000", 2023-09-30T17:03:12.520 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00013553799999999999 2023-09-30T17:03:12.520 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.520 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.520 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:12.520 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353016+0000", 2023-09-30T17:03:12.521 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0013099209999999999 2023-09-30T17:03:12.521 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.521 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.521 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:12.521 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353023+0000", 2023-09-30T17:03:12.521 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2479999999999999e-06 2023-09-30T17:03:12.521 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.521 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.521 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:12.522 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360348+0000", 2023-09-30T17:03:12.522 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0073248949999999997 2023-09-30T17:03:12.522 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.522 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.522 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:12.522 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360787+0000", 2023-09-30T17:03:12.522 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00043875199999999999 2023-09-30T17:03:12.522 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.522 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.522 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:12.523 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360892+0000", 2023-09-30T17:03:12.523 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010508199999999999 2023-09-30T17:03:12.523 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.523 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.523 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:12.523 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365132+0000", 2023-09-30T17:03:12.523 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0042396480000000004 2023-09-30T17:03:12.523 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.523 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.523 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:12.523 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376746+0000", 2023-09-30T17:03:12.524 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011614157 2023-09-30T17:03:12.524 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.524 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.524 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:12.524 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376811+0000", 2023-09-30T17:03:12.524 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5005999999999994e-05 2023-09-30T17:03:12.524 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.524 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.524 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:12.524 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376859+0000", 2023-09-30T17:03:12.524 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8038999999999999e-05 2023-09-30T17:03:12.525 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:12.525 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:12.525 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:12.525 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.525 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.525 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:12.525 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:03:12.525 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 54.135934931000001, 2023-09-30T17:03:12.525 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024923989000000001, 2023-09-30T17:03:12.525 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:12.525 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:12.525 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:12.526 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.526 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:12.526 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:03:12.526 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:12.526 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.526 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.526 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:12.526 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:03:12.526 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:12.526 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.526 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.527 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:12.527 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352044+0000", 2023-09-30T17:03:12.527 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9199999999999999e-07 2023-09-30T17:03:12.527 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.527 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.527 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:12.527 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352050+0000", 2023-09-30T17:03:12.527 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8880000000000002e-06 2023-09-30T17:03:12.527 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.527 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.527 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:12.528 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352143+0000", 2023-09-30T17:03:12.528 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2721999999999998e-05 2023-09-30T17:03:12.528 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.528 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.528 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:12.528 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352155+0000", 2023-09-30T17:03:12.528 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2279000000000001e-05 2023-09-30T17:03:12.528 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.528 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.528 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:12.528 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353114+0000", 2023-09-30T17:03:12.528 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00095943700000000005 2023-09-30T17:03:12.529 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.529 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.529 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:12.529 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353121+0000", 2023-09-30T17:03:12.529 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.494e-06 2023-09-30T17:03:12.529 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.529 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.529 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:12.529 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361491+0000", 2023-09-30T17:03:12.529 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0083697359999999991 2023-09-30T17:03:12.529 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.530 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.530 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:12.530 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361573+0000", 2023-09-30T17:03:12.530 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2822000000000001e-05 2023-09-30T17:03:12.530 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.530 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.530 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:12.530 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362166+0000", 2023-09-30T17:03:12.530 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00059223299999999995 2023-09-30T17:03:12.530 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.530 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.531 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:12.531 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365209+0000", 2023-09-30T17:03:12.531 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.003043212 2023-09-30T17:03:12.531 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.531 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.531 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:12.531 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376910+0000", 2023-09-30T17:03:12.531 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011700898 2023-09-30T17:03:12.531 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.531 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.531 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:12.531 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376945+0000", 2023-09-30T17:03:12.532 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4795000000000001e-05 2023-09-30T17:03:12.532 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.532 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.532 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:12.532 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376967+0000", 2023-09-30T17:03:12.532 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2580999999999999e-05 2023-09-30T17:03:12.532 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:12.532 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:12.532 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:12.532 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.532 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.533 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:12.533 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:03:12.533 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 54.135765010999997, 2023-09-30T17:03:12.533 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023120405, 2023-09-30T17:03:12.533 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:12.533 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:12.533 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:12.533 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.533 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:12.533 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:03:12.533 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:12.533 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.534 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.534 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:12.534 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:03:12.534 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:12.534 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.534 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.534 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:12.534 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352214+0000", 2023-09-30T17:03:12.534 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8400000000000003e-07 2023-09-30T17:03:12.534 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.534 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.534 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:12.535 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352233+0000", 2023-09-30T17:03:12.535 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8946000000000001e-05 2023-09-30T17:03:12.535 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.535 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.535 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:12.535 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352297+0000", 2023-09-30T17:03:12.535 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3540999999999994e-05 2023-09-30T17:03:12.535 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.535 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.535 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:12.535 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352450+0000", 2023-09-30T17:03:12.536 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015364799999999999 2023-09-30T17:03:12.536 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.536 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.536 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:12.536 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353098+0000", 2023-09-30T17:03:12.536 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00064820299999999997 2023-09-30T17:03:12.536 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.536 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.536 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:12.536 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353103+0000", 2023-09-30T17:03:12.536 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0529999999999997e-06 2023-09-30T17:03:12.536 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.537 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.537 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:12.537 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.358558+0000", 2023-09-30T17:03:12.537 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0054550249999999996 2023-09-30T17:03:12.537 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.537 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.537 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:12.537 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.358741+0000", 2023-09-30T17:03:12.537 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00018210200000000001 2023-09-30T17:03:12.537 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.537 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.537 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:12.538 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.359683+0000", 2023-09-30T17:03:12.538 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00094202299999999995 2023-09-30T17:03:12.538 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.538 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.538 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:12.538 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365044+0000", 2023-09-30T17:03:12.538 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053616219999999999 2023-09-30T17:03:12.538 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.538 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.538 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:12.538 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375256+0000", 2023-09-30T17:03:12.539 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010212156 2023-09-30T17:03:12.539 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.539 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.539 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:12.539 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375300+0000", 2023-09-30T17:03:12.539 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3961999999999997e-05 2023-09-30T17:03:12.539 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.539 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.539 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:12.539 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375334+0000", 2023-09-30T17:03:12.540 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.324e-05 2023-09-30T17:03:12.540 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:12.540 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:12.540 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:12.540 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.540 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.540 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:12.540 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:03:12.540 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 54.135449993000002, 2023-09-30T17:03:12.540 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024240660000000001, 2023-09-30T17:03:12.540 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:12.541 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:12.541 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:12.541 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.541 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:12.541 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:03:12.541 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:12.541 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.541 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.541 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:12.541 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:03:12.541 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:12.542 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.542 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.542 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:12.542 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352529+0000", 2023-09-30T17:03:12.542 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1379999999999999e-06 2023-09-30T17:03:12.542 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.542 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.542 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:12.542 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352536+0000", 2023-09-30T17:03:12.542 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3489999999999997e-06 2023-09-30T17:03:12.542 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.543 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.543 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:12.543 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352547+0000", 2023-09-30T17:03:12.543 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1109e-05 2023-09-30T17:03:12.543 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.543 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.543 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:12.543 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352560+0000", 2023-09-30T17:03:12.543 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3046e-05 2023-09-30T17:03:12.543 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.543 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.543 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:12.544 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353142+0000", 2023-09-30T17:03:12.544 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00058174699999999997 2023-09-30T17:03:12.544 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.544 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.544 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:12.544 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353147+0000", 2023-09-30T17:03:12.544 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5840000000000002e-06 2023-09-30T17:03:12.544 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.544 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.544 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:12.544 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360374+0000", 2023-09-30T17:03:12.545 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0072270049999999999 2023-09-30T17:03:12.545 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.545 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.545 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:12.545 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360795+0000", 2023-09-30T17:03:12.545 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00042088999999999999 2023-09-30T17:03:12.545 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.545 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.545 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:12.545 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360967+0000", 2023-09-30T17:03:12.545 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017235699999999999 2023-09-30T17:03:12.546 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.546 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.546 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:12.546 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365051+0000", 2023-09-30T17:03:12.546 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0040837429999999999 2023-09-30T17:03:12.546 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.546 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.546 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:12.546 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376708+0000", 2023-09-30T17:03:12.546 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011656866 2023-09-30T17:03:12.546 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.547 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.547 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:12.547 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376745+0000", 2023-09-30T17:03:12.547 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6769e-05 2023-09-30T17:03:12.547 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.547 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.547 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:12.547 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376769+0000", 2023-09-30T17:03:12.547 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4057e-05 2023-09-30T17:03:12.547 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:12.547 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:12.547 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:12.548 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.548 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.548 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:12.548 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:12.548 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 54.135190637999997, 2023-09-30T17:03:12.548 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023472704, 2023-09-30T17:03:12.548 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:12.548 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:12.548 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:12.548 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.548 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:12.548 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:12.549 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:12.549 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.549 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.549 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:12.549 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:12.549 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:12.549 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.549 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.549 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:12.549 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:12.549 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8000000000000005e-07 2023-09-30T17:03:12.550 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.550 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.550 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:12.550 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352794+0000", 2023-09-30T17:03:12.550 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.789e-06 2023-09-30T17:03:12.550 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.550 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.550 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:12.550 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352805+0000", 2023-09-30T17:03:12.550 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0848e-05 2023-09-30T17:03:12.550 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.551 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.551 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:12.551 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352812+0000", 2023-09-30T17:03:12.551 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4449999999999999e-06 2023-09-30T17:03:12.551 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.551 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.551 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:12.551 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353063+0000", 2023-09-30T17:03:12.551 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00025046299999999998 2023-09-30T17:03:12.551 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.552 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.552 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:12.552 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353071+0000", 2023-09-30T17:03:12.552 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6739999999999997e-06 2023-09-30T17:03:12.552 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.552 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.552 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:12.552 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361696+0000", 2023-09-30T17:03:12.552 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0086251609999999992 2023-09-30T17:03:12.552 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.552 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.553 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:12.553 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362284+0000", 2023-09-30T17:03:12.553 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00058872299999999998 2023-09-30T17:03:12.553 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.553 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.553 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:12.553 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362429+0000", 2023-09-30T17:03:12.553 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014509000000000001 2023-09-30T17:03:12.553 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.553 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.553 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:12.553 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365330+0000", 2023-09-30T17:03:12.554 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0029005419999999999 2023-09-30T17:03:12.554 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.554 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.554 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:12.554 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376196+0000", 2023-09-30T17:03:12.554 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.01086615 2023-09-30T17:03:12.554 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.554 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.554 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:12.554 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376230+0000", 2023-09-30T17:03:12.554 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3858e-05 2023-09-30T17:03:12.555 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.555 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.555 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:12.555 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376260+0000", 2023-09-30T17:03:12.555 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0181000000000001e-05 2023-09-30T17:03:12.555 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:12.555 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:12.555 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:12.555 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.555 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.555 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:12.555 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:03:12.556 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 54.134957067999999, 2023-09-30T17:03:12.556 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023406132999999999, 2023-09-30T17:03:12.556 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:12.556 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:12.556 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:12.556 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.556 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:12.556 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:03:12.556 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:12.556 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.556 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.557 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:12.557 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:03:12.557 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:12.557 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.557 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.557 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:12.557 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353022+0000", 2023-09-30T17:03:12.557 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.78e-07 2023-09-30T17:03:12.557 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.557 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.557 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:12.557 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353027+0000", 2023-09-30T17:03:12.558 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9089999999999999e-06 2023-09-30T17:03:12.558 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.558 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.558 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:12.558 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353035+0000", 2023-09-30T17:03:12.558 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0430000000000008e-06 2023-09-30T17:03:12.558 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.558 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.558 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:12.558 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353047+0000", 2023-09-30T17:03:12.558 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1674e-05 2023-09-30T17:03:12.558 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.559 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.559 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:12.559 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353105+0000", 2023-09-30T17:03:12.559 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8891999999999998e-05 2023-09-30T17:03:12.559 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.559 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.559 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:12.559 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353112+0000", 2023-09-30T17:03:12.559 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7059999999999998e-06 2023-09-30T17:03:12.559 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.559 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.560 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:12.560 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362733+0000", 2023-09-30T17:03:12.560 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0096205869999999999 2023-09-30T17:03:12.560 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.560 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.560 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:12.560 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362833+0000", 2023-09-30T17:03:12.560 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000100227 2023-09-30T17:03:12.560 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.560 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.561 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:12.561 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363000+0000", 2023-09-30T17:03:12.561 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016670899999999999 2023-09-30T17:03:12.561 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.561 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.561 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:12.561 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365550+0000", 2023-09-30T17:03:12.561 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0025499199999999998 2023-09-30T17:03:12.561 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.561 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.562 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:12.562 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376315+0000", 2023-09-30T17:03:12.562 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010765011999999999 2023-09-30T17:03:12.562 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.562 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.562 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:12.562 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376386+0000", 2023-09-30T17:03:12.562 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0866999999999998e-05 2023-09-30T17:03:12.562 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.562 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.562 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:12.563 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376427+0000", 2023-09-30T17:03:12.563 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1709000000000003e-05 2023-09-30T17:03:12.563 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:12.563 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:12.563 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:12.563 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.563 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.563 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:12.563 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:12.563 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 54.134916431999997, 2023-09-30T17:03:12.563 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024076238, 2023-09-30T17:03:12.564 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:12.564 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:12.564 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:12.564 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.564 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:12.564 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:12.564 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:12.564 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.564 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.564 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:12.564 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:12.565 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:12.565 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.565 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.565 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:12.565 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:12.565 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8699999999999995e-07 2023-09-30T17:03:12.565 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.565 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.565 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:12.565 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353067+0000", 2023-09-30T17:03:12.566 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.605e-06 2023-09-30T17:03:12.566 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.566 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.566 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:12.566 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353073+0000", 2023-09-30T17:03:12.566 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8900000000000004e-06 2023-09-30T17:03:12.566 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.566 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.566 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:12.567 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353083+0000", 2023-09-30T17:03:12.567 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0200000000000001e-05 2023-09-30T17:03:12.567 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.567 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.567 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:12.567 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353186+0000", 2023-09-30T17:03:12.567 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010256599999999999 2023-09-30T17:03:12.567 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.567 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.567 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:12.567 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353190+0000", 2023-09-30T17:03:12.568 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9709999999999998e-06 2023-09-30T17:03:12.568 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.568 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.568 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:12.568 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362946+0000", 2023-09-30T17:03:12.568 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0097563330000000007 2023-09-30T17:03:12.568 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.568 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.568 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:12.568 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363088+0000", 2023-09-30T17:03:12.568 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014259200000000001 2023-09-30T17:03:12.569 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.569 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.569 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:12.569 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363555+0000", 2023-09-30T17:03:12.569 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00046627799999999998 2023-09-30T17:03:12.569 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.569 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.569 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:12.569 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365871+0000", 2023-09-30T17:03:12.569 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0023167589999999998 2023-09-30T17:03:12.570 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.570 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.570 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:12.570 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377033+0000", 2023-09-30T17:03:12.570 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011161203999999999 2023-09-30T17:03:12.570 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.570 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.570 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:12.570 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377100+0000", 2023-09-30T17:03:12.571 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7230999999999994e-05 2023-09-30T17:03:12.571 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.571 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.571 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:12.571 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377138+0000", 2023-09-30T17:03:12.571 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8022000000000003e-05 2023-09-30T17:03:12.571 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:12.571 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:12.571 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:12.571 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.571 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.572 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:12.572 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:03:12.572 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 54.134815482999997, 2023-09-30T17:03:12.572 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.020304412000000001, 2023-09-30T17:03:12.572 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:12.572 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:12.572 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:12.572 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.572 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:12.572 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:03:12.573 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:12.573 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.573 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.573 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:12.573 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:03:12.573 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:12.573 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.573 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.573 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:12.573 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353164+0000", 2023-09-30T17:03:12.573 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7100000000000011e-07 2023-09-30T17:03:12.574 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.574 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.574 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:12.574 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353168+0000", 2023-09-30T17:03:12.574 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0600000000000001e-06 2023-09-30T17:03:12.574 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.574 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.574 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:12.574 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353177+0000", 2023-09-30T17:03:12.574 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1409999999999994e-06 2023-09-30T17:03:12.575 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.575 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.575 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:12.575 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353185+0000", 2023-09-30T17:03:12.575 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2479999999999996e-06 2023-09-30T17:03:12.575 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.575 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.575 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:12.575 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353246+0000", 2023-09-30T17:03:12.575 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0519000000000001e-05 2023-09-30T17:03:12.575 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.576 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.576 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:12.576 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353252+0000", 2023-09-30T17:03:12.576 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7859999999999999e-06 2023-09-30T17:03:12.576 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.576 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.576 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:12.576 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354979+0000", 2023-09-30T17:03:12.576 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0017270090000000001 2023-09-30T17:03:12.576 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.576 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.576 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:12.577 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355097+0000", 2023-09-30T17:03:12.577 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000117472 2023-09-30T17:03:12.577 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.577 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.577 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:12.577 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.373467+0000", 2023-09-30T17:03:12.577 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.018370206 2023-09-30T17:03:12.577 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:12.577 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:12.577 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:12.577 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.578 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.578 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:12.578 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:03:12.578 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 54.134774745000001, 2023-09-30T17:03:12.578 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.012725089, 2023-09-30T17:03:12.578 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:12.578 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:12.578 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:12.578 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.578 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:12.578 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:03:12.579 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:12.579 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.579 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.579 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:12.579 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:03:12.579 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:12.579 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.579 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.579 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:12.579 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353204+0000", 2023-09-30T17:03:12.580 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7100000000000002e-07 2023-09-30T17:03:12.580 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.580 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.580 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:12.580 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353213+0000", 2023-09-30T17:03:12.580 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8580000000000006e-06 2023-09-30T17:03:12.580 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.580 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.580 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:12.580 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353219+0000", 2023-09-30T17:03:12.580 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8939999999999998e-06 2023-09-30T17:03:12.581 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.581 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.581 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:12.581 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353223+0000", 2023-09-30T17:03:12.581 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.357e-06 2023-09-30T17:03:12.581 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.581 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.581 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:12.581 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353278+0000", 2023-09-30T17:03:12.581 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5228e-05 2023-09-30T17:03:12.581 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.582 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.582 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:12.582 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353284+0000", 2023-09-30T17:03:12.582 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8209999999999998e-06 2023-09-30T17:03:12.582 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.582 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.582 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:12.582 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355095+0000", 2023-09-30T17:03:12.582 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001811404 2023-09-30T17:03:12.582 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.583 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.583 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:12.583 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355256+0000", 2023-09-30T17:03:12.583 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000160898 2023-09-30T17:03:12.583 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.583 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.583 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:12.583 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365928+0000", 2023-09-30T17:03:12.583 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010672157999999999 2023-09-30T17:03:12.583 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:12.583 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:12.583 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:12.584 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.584 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.584 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-09-30T17:03:12.584 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:03:12.584 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 54.134243538, 2023-09-30T17:03:12.584 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0056863460000000001, 2023-09-30T17:03:12.584 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:12.584 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "reached pg", 2023-09-30T17:03:12.584 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:12.584 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.585 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:12.585 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:03:12.585 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:12.585 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.585 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.585 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:12.585 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:03:12.585 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:12.585 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.585 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.585 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:12.585 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:03:12.586 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5700000000000002e-07 2023-09-30T17:03:12.586 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.586 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.586 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:12.586 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353747+0000", 2023-09-30T17:03:12.586 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1899000000000001e-05 2023-09-30T17:03:12.586 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.586 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.586 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:12.586 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353776+0000", 2023-09-30T17:03:12.586 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.8767000000000001e-05 2023-09-30T17:03:12.587 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.587 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.587 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:12.587 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353792+0000", 2023-09-30T17:03:12.587 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5914999999999999e-05 2023-09-30T17:03:12.587 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.587 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.587 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:12.587 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353900+0000", 2023-09-30T17:03:12.587 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010774500000000001 2023-09-30T17:03:12.587 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.588 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.588 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:12.588 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.359421+0000", 2023-09-30T17:03:12.588 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0055213629999999996 2023-09-30T17:03:12.588 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:12.588 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:12.588 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:12.588 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.588 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.588 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:03:12.588 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:03:12.588 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 54.133571938000003, 2023-09-30T17:03:12.589 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0069196370000000002, 2023-09-30T17:03:12.589 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:12.589 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:12.589 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:12.589 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.589 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:12.589 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:03:12.589 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:12.589 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.589 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.589 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:12.589 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:03:12.590 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:12.590 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.590 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.590 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:12.590 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354407+0000", 2023-09-30T17:03:12.590 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7400000000000002e-07 2023-09-30T17:03:12.590 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.590 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.590 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:12.590 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354414+0000", 2023-09-30T17:03:12.590 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1040000000000001e-06 2023-09-30T17:03:12.591 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.591 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.591 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:12.591 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354425+0000", 2023-09-30T17:03:12.591 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1090000000000001e-05 2023-09-30T17:03:12.591 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.591 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.591 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:12.591 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354435+0000", 2023-09-30T17:03:12.591 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8169999999999994e-06 2023-09-30T17:03:12.592 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.592 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.592 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:12.592 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355741+0000", 2023-09-30T17:03:12.592 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0013063160000000001 2023-09-30T17:03:12.592 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.592 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.592 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:12.592 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355763+0000", 2023-09-30T17:03:12.592 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1688e-05 2023-09-30T17:03:12.593 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.593 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.593 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:12.593 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361289+0000", 2023-09-30T17:03:12.593 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0055258269999999996 2023-09-30T17:03:12.593 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.593 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.593 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:12.593 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361326+0000", 2023-09-30T17:03:12.593 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7020999999999997e-05 2023-09-30T17:03:12.594 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:12.594 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:12.594 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:12.594 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.594 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.594 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:30 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2023-09-30T17:03:12.594 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:03:12.594 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 54.132197980000001, 2023-09-30T17:03:12.594 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0069996629999999997, 2023-09-30T17:03:12.594 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:12.595 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:12.595 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:12.595 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.595 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:12.595 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:03:12.595 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:12.595 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.595 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.595 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:12.596 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:03:12.596 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:12.596 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.596 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.596 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:12.596 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355781+0000", 2023-09-30T17:03:12.596 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9599999999999999e-07 2023-09-30T17:03:12.596 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.596 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.596 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:12.597 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355788+0000", 2023-09-30T17:03:12.597 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8129999999999996e-06 2023-09-30T17:03:12.597 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.597 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.597 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:12.597 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355798+0000", 2023-09-30T17:03:12.597 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2909999999999996e-06 2023-09-30T17:03:12.597 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.597 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.597 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:12.597 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355807+0000", 2023-09-30T17:03:12.598 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8619999999999992e-06 2023-09-30T17:03:12.598 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.598 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.598 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:12.598 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.357264+0000", 2023-09-30T17:03:12.598 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0014578289999999999 2023-09-30T17:03:12.598 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.598 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.598 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:12.598 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.357916+0000", 2023-09-30T17:03:12.598 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00065170500000000004 2023-09-30T17:03:12.599 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.599 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.599 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:12.599 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362731+0000", 2023-09-30T17:03:12.599 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0048149849999999999 2023-09-30T17:03:12.599 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.599 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.599 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:12.599 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362780+0000", 2023-09-30T17:03:12.600 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8681999999999999e-05 2023-09-30T17:03:12.600 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:12.600 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:12.600 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:12.600 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.600 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.600 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2023-09-30T17:03:12.600 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:03:12.600 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 54.113546929000002, 2023-09-30T17:03:12.600 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005905998, 2023-09-30T17:03:12.600 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:12.601 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:12.601 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:12.601 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.601 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:12.601 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:03:12.601 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:12.601 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.601 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.601 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:12.601 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:03:12.602 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:12.602 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.602 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.602 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:12.602 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:03:12.602 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1e-07 2023-09-30T17:03:12.602 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.602 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.603 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:12.603 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374455+0000", 2023-09-30T17:03:12.603 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.3091999999999998e-05 2023-09-30T17:03:12.603 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.603 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.603 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:12.603 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374462+0000", 2023-09-30T17:03:12.603 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5170000000000002e-06 2023-09-30T17:03:12.603 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.603 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.605 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:12.605 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374469+0000", 2023-09-30T17:03:12.605 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8199999999999999e-06 2023-09-30T17:03:12.605 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.605 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.605 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:12.606 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374550+0000", 2023-09-30T17:03:12.606 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0978999999999998e-05 2023-09-30T17:03:12.606 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.606 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.606 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:12.606 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374562+0000", 2023-09-30T17:03:12.606 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2472e-05 2023-09-30T17:03:12.606 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.607 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.607 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:12.607 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380293+0000", 2023-09-30T17:03:12.607 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0057310379999999999 2023-09-30T17:03:12.607 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.607 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.607 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:12.607 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380337+0000", 2023-09-30T17:03:12.607 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3869999999999998e-05 2023-09-30T17:03:12.608 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:12.608 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:12.608 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:12.608 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.608 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.608 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2023-09-30T17:03:12.608 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:03:12.608 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 54.113360180000001, 2023-09-30T17:03:12.608 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0057590560000000002, 2023-09-30T17:03:12.609 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:12.609 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:12.609 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:12.609 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.609 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:12.609 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:03:12.609 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:12.609 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.609 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.610 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:12.610 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:03:12.610 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:12.610 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.610 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.610 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:12.610 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:03:12.610 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4900000000000001e-07 2023-09-30T17:03:12.611 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.611 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.611 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:12.611 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374629+0000", 2023-09-30T17:03:12.611 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1014e-05 2023-09-30T17:03:12.611 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.611 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.611 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:12.611 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374636+0000", 2023-09-30T17:03:12.612 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5889999999999999e-06 2023-09-30T17:03:12.612 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.612 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.612 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:12.612 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374642+0000", 2023-09-30T17:03:12.612 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.48e-06 2023-09-30T17:03:12.612 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.612 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.613 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:12.613 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374681+0000", 2023-09-30T17:03:12.613 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9320000000000003e-05 2023-09-30T17:03:12.613 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.613 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.613 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:12.613 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374694+0000", 2023-09-30T17:03:12.613 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3351e-05 2023-09-30T17:03:12.613 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.613 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.613 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:12.613 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380319+0000", 2023-09-30T17:03:12.614 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0056243880000000001 2023-09-30T17:03:12.614 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.614 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.614 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:12.614 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380377+0000", 2023-09-30T17:03:12.614 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8464999999999997e-05 2023-09-30T17:03:12.614 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:12.614 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:12.614 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:12.615 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.615 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.615 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=0'0)", 2023-09-30T17:03:12.615 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:03:12.615 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 54.112649269000002, 2023-09-30T17:03:12.615 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051157370000000004, 2023-09-30T17:03:12.615 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:12.615 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:12.615 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:12.615 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.615 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:12.616 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:03:12.616 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:12.616 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.616 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.616 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:12.616 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:03:12.616 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:12.616 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.616 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.616 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:12.616 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:03:12.616 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0199999999999998e-07 2023-09-30T17:03:12.617 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.617 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.617 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:12.617 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375334+0000", 2023-09-30T17:03:12.617 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8799999999999999e-06 2023-09-30T17:03:12.617 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.617 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.617 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:12.617 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375343+0000", 2023-09-30T17:03:12.617 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5490000000000006e-06 2023-09-30T17:03:12.618 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.618 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.618 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:12.618 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375350+0000", 2023-09-30T17:03:12.618 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5700000000000004e-06 2023-09-30T17:03:12.618 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.618 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.618 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:12.618 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375396+0000", 2023-09-30T17:03:12.618 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5550999999999998e-05 2023-09-30T17:03:12.619 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.619 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.619 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:12.619 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375410+0000", 2023-09-30T17:03:12.619 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4518999999999999e-05 2023-09-30T17:03:12.619 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.619 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.619 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:12.619 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380401+0000", 2023-09-30T17:03:12.619 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0049903430000000004 2023-09-30T17:03:12.619 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:12.620 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:12.620 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:12.620 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380445+0000", 2023-09-30T17:03:12.620 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4023000000000002e-05 2023-09-30T17:03:12.620 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:12.620 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:12.620 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:12.620 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:12.620 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:12.621 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:12.622 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:03:12.623 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:12.622+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:12.723 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:12.723+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:12.749 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:12.750 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:03:12.750 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2023-09-30T17:03:12.750 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:12.760 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:03:12.843 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:12.843+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:12.925 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:12.925+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:12.926 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:12.926 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:03:12.926 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2023-09-30T17:03:12.926 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2023-09-30T17:03:12.926 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:12.936 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:03:13.026 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:13.026+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:13.104 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:13.105 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2023-09-30T17:03:13.105 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2023-09-30T17:03:13.105 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2023-09-30T17:03:13.105 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.105 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:13.105 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:03:13.105 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 54.751383515000001, 2023-09-30T17:03:13.105 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093789779999999996, 2023-09-30T17:03:13.105 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:13.105 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:13.106 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:13.106 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.106 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:13.106 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:03:13.106 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:13.106 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.106 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.106 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:13.106 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:03:13.106 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:13.107 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.107 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.107 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:13.107 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352027+0000", 2023-09-30T17:03:13.107 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0224000000000001e-05 2023-09-30T17:03:13.107 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.107 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.107 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:13.107 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352039+0000", 2023-09-30T17:03:13.107 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1569000000000001e-05 2023-09-30T17:03:13.107 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.108 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.108 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:13.108 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352052+0000", 2023-09-30T17:03:13.108 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2605999999999999e-05 2023-09-30T17:03:13.108 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.108 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.108 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:13.108 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352064+0000", 2023-09-30T17:03:13.108 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2666999999999999e-05 2023-09-30T17:03:13.108 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.108 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.108 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:13.109 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352147+0000", 2023-09-30T17:03:13.109 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3125000000000001e-05 2023-09-30T17:03:13.109 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.109 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.109 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:13.109 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352306+0000", 2023-09-30T17:03:13.109 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015881900000000001 2023-09-30T17:03:13.109 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.109 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.109 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:13.110 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352450+0000", 2023-09-30T17:03:13.110 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014420700000000001 2023-09-30T17:03:13.110 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.110 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.110 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:13.110 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355975+0000", 2023-09-30T17:03:13.110 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003524246 2023-09-30T17:03:13.110 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.110 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.110 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:13.111 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361279+0000", 2023-09-30T17:03:13.111 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005304507 2023-09-30T17:03:13.111 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.111 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.111 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:13.111 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361344+0000", 2023-09-30T17:03:13.111 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4548999999999995e-05 2023-09-30T17:03:13.111 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.111 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.111 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:13.111 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361396+0000", 2023-09-30T17:03:13.111 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2459e-05 2023-09-30T17:03:13.112 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:13.112 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:13.112 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:13.112 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.112 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.112 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:13.112 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:03:13.112 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 54.751291223000003, 2023-09-30T17:03:13.112 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021233007000000002, 2023-09-30T17:03:13.112 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:13.112 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:13.113 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:13.113 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.113 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:13.113 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:03:13.113 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:13.113 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.113 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.113 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:13.113 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:03:13.113 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:13.114 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.114 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.114 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:13.114 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352110+0000", 2023-09-30T17:03:13.114 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6000000000000002e-07 2023-09-30T17:03:13.114 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.114 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.114 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:13.114 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352117+0000", 2023-09-30T17:03:13.114 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5930000000000002e-06 2023-09-30T17:03:13.115 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.115 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.115 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:13.115 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352126+0000", 2023-09-30T17:03:13.115 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0729999999999994e-06 2023-09-30T17:03:13.115 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.115 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.115 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:13.115 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352136+0000", 2023-09-30T17:03:13.115 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0380000000000001e-05 2023-09-30T17:03:13.115 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.115 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.116 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:13.116 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353279+0000", 2023-09-30T17:03:13.116 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0011424670000000001 2023-09-30T17:03:13.116 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.116 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.116 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:13.116 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353707+0000", 2023-09-30T17:03:13.116 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00042829800000000003 2023-09-30T17:03:13.116 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.116 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.116 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:13.117 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354104+0000", 2023-09-30T17:03:13.117 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00039643399999999998 2023-09-30T17:03:13.117 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.117 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.117 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:13.117 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356925+0000", 2023-09-30T17:03:13.117 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0028210900000000001 2023-09-30T17:03:13.117 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.117 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.117 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:13.117 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373243+0000", 2023-09-30T17:03:13.118 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016318461999999999 2023-09-30T17:03:13.118 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.118 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.118 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:13.118 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373301+0000", 2023-09-30T17:03:13.118 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7435000000000002e-05 2023-09-30T17:03:13.118 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.118 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.118 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:13.118 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373342+0000", 2023-09-30T17:03:13.118 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1915000000000001e-05 2023-09-30T17:03:13.118 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:13.119 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:13.119 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:13.119 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.119 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.119 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:13.119 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:03:13.119 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 54.751248611999998, 2023-09-30T17:03:13.119 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011988331, 2023-09-30T17:03:13.119 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:13.119 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:13.120 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:13.120 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.120 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:13.120 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:03:13.120 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:13.120 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.120 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.120 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:13.120 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:03:13.120 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:13.120 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.121 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.121 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:13.121 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352153+0000", 2023-09-30T17:03:13.121 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0500000000000003e-07 2023-09-30T17:03:13.121 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.121 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.121 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:13.121 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352157+0000", 2023-09-30T17:03:13.121 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9790000000000004e-06 2023-09-30T17:03:13.121 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.121 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.122 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:13.122 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352173+0000", 2023-09-30T17:03:13.122 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6535999999999999e-05 2023-09-30T17:03:13.122 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.122 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.122 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:13.122 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352180+0000", 2023-09-30T17:03:13.122 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7700000000000004e-06 2023-09-30T17:03:13.122 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.122 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.122 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:13.123 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353526+0000", 2023-09-30T17:03:13.123 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0013458330000000001 2023-09-30T17:03:13.123 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.123 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.123 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:13.123 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353648+0000", 2023-09-30T17:03:13.123 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012262899999999999 2023-09-30T17:03:13.123 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.123 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.123 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:13.123 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354141+0000", 2023-09-30T17:03:13.123 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00049222899999999995 2023-09-30T17:03:13.124 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.124 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.124 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:13.124 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356931+0000", 2023-09-30T17:03:13.124 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0027900860000000002 2023-09-30T17:03:13.124 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.124 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.124 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:13.124 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364066+0000", 2023-09-30T17:03:13.124 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071355050000000003 2023-09-30T17:03:13.124 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.124 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.125 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:13.125 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364103+0000", 2023-09-30T17:03:13.125 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6944999999999999e-05 2023-09-30T17:03:13.125 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.125 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.125 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:13.125 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364140+0000", 2023-09-30T17:03:13.125 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7214e-05 2023-09-30T17:03:13.125 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:13.125 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:13.125 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:13.125 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.126 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.126 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:13.126 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:03:13.126 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 54.751209381000002, 2023-09-30T17:03:13.126 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012110921, 2023-09-30T17:03:13.126 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:13.126 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:13.126 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:13.126 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.126 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:13.126 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:03:13.127 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:13.127 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.127 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.127 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:13.127 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:03:13.127 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:13.127 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.127 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.127 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:13.127 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352192+0000", 2023-09-30T17:03:13.127 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7300000000000005e-07 2023-09-30T17:03:13.127 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.128 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.128 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:13.128 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352196+0000", 2023-09-30T17:03:13.128 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2370000000000003e-06 2023-09-30T17:03:13.128 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.128 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.128 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:13.128 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352205+0000", 2023-09-30T17:03:13.128 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6659999999999997e-06 2023-09-30T17:03:13.128 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.128 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.129 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:13.129 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352214+0000", 2023-09-30T17:03:13.129 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8259999999999999e-06 2023-09-30T17:03:13.129 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.129 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.129 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:13.129 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354470+0000", 2023-09-30T17:03:13.129 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022557340000000001 2023-09-30T17:03:13.129 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.129 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.129 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:13.130 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354557+0000", 2023-09-30T17:03:13.130 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6909000000000004e-05 2023-09-30T17:03:13.130 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.130 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.130 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:13.130 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354694+0000", 2023-09-30T17:03:13.130 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013774800000000001 2023-09-30T17:03:13.130 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.130 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.130 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:13.130 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356937+0000", 2023-09-30T17:03:13.131 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022424540000000001 2023-09-30T17:03:13.131 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.131 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.131 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:13.131 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364227+0000", 2023-09-30T17:03:13.131 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072902430000000001 2023-09-30T17:03:13.131 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.131 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.131 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:13.131 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364278+0000", 2023-09-30T17:03:13.131 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1180999999999997e-05 2023-09-30T17:03:13.131 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.132 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.132 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:13.132 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364302+0000", 2023-09-30T17:03:13.132 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4049999999999998e-05 2023-09-30T17:03:13.132 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:13.132 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:13.132 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:13.132 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.132 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.132 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:13.132 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:13.132 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 54.751176041999997, 2023-09-30T17:03:13.133 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021258651999999999, 2023-09-30T17:03:13.133 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:13.133 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:13.133 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:13.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.133 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:13.133 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:13.133 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:13.133 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.134 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:13.134 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:13.134 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:13.134 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.134 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.134 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:13.134 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:13.134 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6899999999999997e-07 2023-09-30T17:03:13.134 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.134 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.134 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:13.135 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352236+0000", 2023-09-30T17:03:13.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0251000000000001e-05 2023-09-30T17:03:13.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.135 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.135 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:13.135 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352244+0000", 2023-09-30T17:03:13.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0770000000000008e-06 2023-09-30T17:03:13.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.135 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.135 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:13.135 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352251+0000", 2023-09-30T17:03:13.136 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4749999999999996e-06 2023-09-30T17:03:13.136 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.136 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.136 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:13.136 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354455+0000", 2023-09-30T17:03:13.136 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022043660000000001 2023-09-30T17:03:13.136 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.136 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.136 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:13.136 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354577+0000", 2023-09-30T17:03:13.136 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000121054 2023-09-30T17:03:13.137 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.137 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.137 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:13.137 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354723+0000", 2023-09-30T17:03:13.137 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014693900000000001 2023-09-30T17:03:13.137 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.137 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.137 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:13.137 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356941+0000", 2023-09-30T17:03:13.137 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002217199 2023-09-30T17:03:13.137 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.137 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.138 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:13.138 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373392+0000", 2023-09-30T17:03:13.138 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016451774999999998 2023-09-30T17:03:13.138 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.138 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.138 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:13.138 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373445+0000", 2023-09-30T17:03:13.138 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.308e-05 2023-09-30T17:03:13.138 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.138 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.139 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:13.139 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373483+0000", 2023-09-30T17:03:13.139 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7766999999999999e-05 2023-09-30T17:03:13.139 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:13.139 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:13.139 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:13.139 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.139 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.139 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:13.139 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:13.139 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 54.751139950999999, 2023-09-30T17:03:13.140 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020903497, 2023-09-30T17:03:13.140 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:13.140 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:13.140 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:13.140 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.140 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:13.140 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:13.140 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:13.140 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.140 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.140 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:13.141 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:13.141 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:13.141 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.141 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.141 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:13.141 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:13.141 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0800000000000004e-07 2023-09-30T17:03:13.141 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.141 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.141 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:13.141 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352266+0000", 2023-09-30T17:03:13.142 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1280000000000001e-06 2023-09-30T17:03:13.142 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.142 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.142 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:13.142 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352273+0000", 2023-09-30T17:03:13.142 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3730000000000004e-06 2023-09-30T17:03:13.142 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.142 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.142 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:13.142 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352279+0000", 2023-09-30T17:03:13.142 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7699999999999998e-06 2023-09-30T17:03:13.142 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.143 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.143 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:13.143 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352334+0000", 2023-09-30T17:03:13.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5547999999999997e-05 2023-09-30T17:03:13.143 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.143 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.143 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:13.143 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352435+0000", 2023-09-30T17:03:13.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100688 2023-09-30T17:03:13.143 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.143 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.143 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:13.144 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352585+0000", 2023-09-30T17:03:13.144 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000150068 2023-09-30T17:03:13.144 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.144 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.144 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:13.144 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354912+0000", 2023-09-30T17:03:13.144 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0023266770000000001 2023-09-30T17:03:13.144 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.144 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.144 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:13.144 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373066+0000", 2023-09-30T17:03:13.144 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018154474 2023-09-30T17:03:13.145 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.145 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.145 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:13.145 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373122+0000", 2023-09-30T17:03:13.145 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6193000000000002e-05 2023-09-30T17:03:13.145 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.145 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.145 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:13.145 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373164+0000", 2023-09-30T17:03:13.145 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1869999999999997e-05 2023-09-30T17:03:13.145 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:13.146 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:13.146 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:13.146 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.146 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.146 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:13.146 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:03:13.146 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 54.751104275000003, 2023-09-30T17:03:13.146 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021015097999999999, 2023-09-30T17:03:13.146 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:13.146 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:13.146 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:13.147 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.147 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:13.147 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:03:13.147 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:13.147 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.147 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.147 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:13.147 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:03:13.147 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:13.147 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.147 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.147 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:13.148 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352297+0000", 2023-09-30T17:03:13.148 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8299999999999997e-07 2023-09-30T17:03:13.148 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.148 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.148 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:13.148 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352300+0000", 2023-09-30T17:03:13.148 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7460000000000001e-06 2023-09-30T17:03:13.148 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.148 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.148 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:13.148 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352307+0000", 2023-09-30T17:03:13.148 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4959999999999999e-06 2023-09-30T17:03:13.149 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.149 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.149 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:13.149 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352314+0000", 2023-09-30T17:03:13.149 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0190000000000001e-06 2023-09-30T17:03:13.149 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.149 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.149 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:13.149 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354070+0000", 2023-09-30T17:03:13.149 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001755936 2023-09-30T17:03:13.149 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.149 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.150 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:13.150 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354221+0000", 2023-09-30T17:03:13.150 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000150884 2023-09-30T17:03:13.150 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.150 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.150 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:13.150 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373311+0000", 2023-09-30T17:03:13.150 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019090434 2023-09-30T17:03:13.150 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:13.150 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:13.150 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:13.151 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.151 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.151 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:13.151 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:03:13.151 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 54.751075556000004, 2023-09-30T17:03:13.151 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021255174000000002, 2023-09-30T17:03:13.151 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:13.151 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:13.151 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:13.151 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.151 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:13.151 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:03:13.152 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:13.152 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.152 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.152 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:13.152 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:03:13.152 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:13.152 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.152 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.152 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:13.152 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352326+0000", 2023-09-30T17:03:13.152 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3200000000000005e-07 2023-09-30T17:03:13.153 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.153 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.153 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:13.153 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352349+0000", 2023-09-30T17:03:13.153 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3183000000000001e-05 2023-09-30T17:03:13.153 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.153 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.153 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:13.153 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352358+0000", 2023-09-30T17:03:13.153 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5230000000000001e-06 2023-09-30T17:03:13.153 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.153 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.154 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:13.154 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352365+0000", 2023-09-30T17:03:13.154 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3260000000000001e-06 2023-09-30T17:03:13.154 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.154 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.154 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:13.154 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355450+0000", 2023-09-30T17:03:13.154 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0030854049999999998 2023-09-30T17:03:13.154 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.154 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.154 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:13.155 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355583+0000", 2023-09-30T17:03:13.155 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000133189 2023-09-30T17:03:13.155 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.155 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.155 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:13.155 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373580+0000", 2023-09-30T17:03:13.155 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017997016000000001 2023-09-30T17:03:13.155 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:13.155 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:13.155 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:13.155 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.155 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.156 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:13.156 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:03:13.156 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 54.751024133000001, 2023-09-30T17:03:13.156 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010380537, 2023-09-30T17:03:13.156 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:13.156 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:13.156 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:13.156 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.156 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:13.156 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:03:13.156 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:13.156 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.157 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.157 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:13.157 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:03:13.157 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:13.157 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.157 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.157 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:13.157 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:03:13.157 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1500000000000003e-07 2023-09-30T17:03:13.157 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.157 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.158 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:13.158 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352381+0000", 2023-09-30T17:03:13.158 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6330000000000002e-06 2023-09-30T17:03:13.158 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.158 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.158 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:13.158 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352388+0000", 2023-09-30T17:03:13.158 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7229999999999998e-06 2023-09-30T17:03:13.158 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.158 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.158 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:13.158 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352394+0000", 2023-09-30T17:03:13.159 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1789999999999996e-06 2023-09-30T17:03:13.159 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.159 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.159 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:13.159 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353259+0000", 2023-09-30T17:03:13.159 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000865221 2023-09-30T17:03:13.159 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.159 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.159 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:13.159 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353391+0000", 2023-09-30T17:03:13.160 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013217700000000001 2023-09-30T17:03:13.160 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.160 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.160 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:13.160 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362757+0000", 2023-09-30T17:03:13.160 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093657889999999994 2023-09-30T17:03:13.160 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:13.160 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:13.160 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:13.160 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.160 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.160 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-09-30T17:03:13.161 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:03:13.161 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 54.744723841000003, 2023-09-30T17:03:13.161 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0061813579999999996, 2023-09-30T17:03:13.161 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:13.161 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2023-09-30T17:03:13.161 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:13.161 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.161 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:13.161 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:03:13.161 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:13.161 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.161 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.162 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:13.162 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:03:13.162 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:13.162 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.162 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.162 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:13.162 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:03:13.162 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5499999999999999e-07 2023-09-30T17:03:13.162 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.162 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.163 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:13.163 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358686+0000", 2023-09-30T17:03:13.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9979999999999992e-06 2023-09-30T17:03:13.163 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.163 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.163 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:13.163 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358700+0000", 2023-09-30T17:03:13.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3635000000000001e-05 2023-09-30T17:03:13.163 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.163 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.163 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:13.164 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358714+0000", 2023-09-30T17:03:13.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4470999999999999e-05 2023-09-30T17:03:13.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.164 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:13.164 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358767+0000", 2023-09-30T17:03:13.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2651999999999997e-05 2023-09-30T17:03:13.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.164 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:13.164 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364858+0000", 2023-09-30T17:03:13.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060912470000000002 2023-09-30T17:03:13.165 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:13.165 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:13.165 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:13.165 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.165 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.165 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2023-09-30T17:03:13.165 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:03:13.165 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 54.742359000999997, 2023-09-30T17:03:13.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00036246299999999999, 2023-09-30T17:03:13.165 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:13.165 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:13.166 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:13.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.166 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:13.166 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:03:13.166 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:13.166 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.166 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:13.166 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:03:13.166 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:13.166 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.167 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:13.167 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:03:13.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3099999999999999e-07 2023-09-30T17:03:13.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.167 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:13.167 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361045+0000", 2023-09-30T17:03:13.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.49e-06 2023-09-30T17:03:13.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.167 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:13.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361056+0000", 2023-09-30T17:03:13.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0910000000000001e-05 2023-09-30T17:03:13.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:13.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361067+0000", 2023-09-30T17:03:13.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0531e-05 2023-09-30T17:03:13.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:13.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361263+0000", 2023-09-30T17:03:13.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000196486 2023-09-30T17:03:13.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:13.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361273+0000", 2023-09-30T17:03:13.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3379999999999994e-06 2023-09-30T17:03:13.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:13.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361404+0000", 2023-09-30T17:03:13.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013137700000000001 2023-09-30T17:03:13.169 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:13.170 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:13.170 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:13.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.170 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:31 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:03:13.170 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:03:13.170 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 54.741382971999997, 2023-09-30T17:03:13.170 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006676408, 2023-09-30T17:03:13.170 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:13.170 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:13.170 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:13.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:13.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:03:13.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:13.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:13.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:03:13.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:13.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:13.172 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:03:13.172 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5600000000000002e-07 2023-09-30T17:03:13.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.172 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:13.172 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362044+0000", 2023-09-30T17:03:13.172 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5987999999999999e-05 2023-09-30T17:03:13.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.172 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:13.172 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362051+0000", 2023-09-30T17:03:13.172 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2599999999999999e-06 2023-09-30T17:03:13.173 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.173 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:13.173 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362057+0000", 2023-09-30T17:03:13.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.19e-06 2023-09-30T17:03:13.173 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.173 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:13.173 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362096+0000", 2023-09-30T17:03:13.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8278000000000002e-05 2023-09-30T17:03:13.173 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:13.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362114+0000", 2023-09-30T17:03:13.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8808e-05 2023-09-30T17:03:13.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:13.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368658+0000", 2023-09-30T17:03:13.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065433540000000004 2023-09-30T17:03:13.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.175 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:13.175 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368694+0000", 2023-09-30T17:03:13.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6273999999999999e-05 2023-09-30T17:03:13.175 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:13.175 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:13.175 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:13.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.175 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:26 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-09-30T17:03:13.175 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:03:13.175 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 54.741292199999997, 2023-09-30T17:03:13.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0066596119999999996, 2023-09-30T17:03:13.176 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:13.176 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:13.176 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:13.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:13.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:03:13.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:13.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:13.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:03:13.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:13.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.177 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:13.177 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362109+0000", 2023-09-30T17:03:13.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5699999999999999e-07 2023-09-30T17:03:13.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.177 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:13.177 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362112+0000", 2023-09-30T17:03:13.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8410000000000002e-06 2023-09-30T17:03:13.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.178 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:13.178 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362117+0000", 2023-09-30T17:03:13.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.792e-06 2023-09-30T17:03:13.178 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.178 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.178 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:13.178 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362122+0000", 2023-09-30T17:03:13.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.763e-06 2023-09-30T17:03:13.178 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.178 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.178 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:13.178 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362344+0000", 2023-09-30T17:03:13.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022181600000000001 2023-09-30T17:03:13.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:13.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362357+0000", 2023-09-30T17:03:13.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2864000000000001e-05 2023-09-30T17:03:13.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:13.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368738+0000", 2023-09-30T17:03:13.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063809499999999998 2023-09-30T17:03:13.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.180 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:13.180 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368768+0000", 2023-09-30T17:03:13.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0429e-05 2023-09-30T17:03:13.180 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:13.180 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:13.180 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:13.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.180 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2023-09-30T17:03:13.180 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:03:13.180 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 54.740076033000001, 2023-09-30T17:03:13.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00082185400000000001, 2023-09-30T17:03:13.181 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:13.181 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:13.181 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:13.181 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.181 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:13.181 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:03:13.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:13.181 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.181 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.181 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:13.182 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:03:13.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:13.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.182 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:13.182 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:03:13.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.22e-07 2023-09-30T17:03:13.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.182 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:13.182 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363327+0000", 2023-09-30T17:03:13.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4480000000000001e-06 2023-09-30T17:03:13.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:13.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363333+0000", 2023-09-30T17:03:13.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9989999999999997e-06 2023-09-30T17:03:13.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:13.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363354+0000", 2023-09-30T17:03:13.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0547000000000002e-05 2023-09-30T17:03:13.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.184 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:13.184 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364057+0000", 2023-09-30T17:03:13.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00070306600000000002 2023-09-30T17:03:13.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.184 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:13.184 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364063+0000", 2023-09-30T17:03:13.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.694e-06 2023-09-30T17:03:13.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.184 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:13.185 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364146+0000", 2023-09-30T17:03:13.185 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3877999999999999e-05 2023-09-30T17:03:13.185 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:13.185 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:13.185 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:13.185 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.185 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.185 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e18/16 ondisk, result = 0)", 2023-09-30T17:03:13.185 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:03:13.185 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 54.739762501000001, 2023-09-30T17:03:13.185 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00067007199999999996, 2023-09-30T17:03:13.185 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:13.185 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:13.186 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:13.186 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.186 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:13.186 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:03:13.186 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:13.186 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.186 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.186 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:13.186 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:03:13.186 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:13.186 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:13.187 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:03:13.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.41e-07 2023-09-30T17:03:13.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:13.187 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363641+0000", 2023-09-30T17:03:13.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4830000000000002e-06 2023-09-30T17:03:13.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:13.187 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363647+0000", 2023-09-30T17:03:13.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4869999999999999e-06 2023-09-30T17:03:13.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.188 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:13.188 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363654+0000", 2023-09-30T17:03:13.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5889999999999999e-06 2023-09-30T17:03:13.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.188 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:13.188 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364217+0000", 2023-09-30T17:03:13.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00056263199999999998 2023-09-30T17:03:13.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:13.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364222+0000", 2023-09-30T17:03:13.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.242e-06 2023-09-30T17:03:13.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:13.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364308+0000", 2023-09-30T17:03:13.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6397999999999995e-05 2023-09-30T17:03:13.189 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:13.189 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:13.189 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:13.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.190 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2023-09-30T17:03:13.190 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:03:13.190 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 54.730174591000001, 2023-09-30T17:03:13.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000359561, 2023-09-30T17:03:13.190 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:13.190 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2023-09-30T17:03:13.190 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:13.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.190 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:13.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:03:13.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:13.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.191 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:13.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:03:13.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:13.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.191 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:13.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:03:13.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1e-07 2023-09-30T17:03:13.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:13.192 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373228+0000", 2023-09-30T17:03:13.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9420000000000002e-06 2023-09-30T17:03:13.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:13.192 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373235+0000", 2023-09-30T17:03:13.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4230000000000002e-06 2023-09-30T17:03:13.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:13.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373239+0000", 2023-09-30T17:03:13.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6809999999999997e-06 2023-09-30T17:03:13.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:13.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373518+0000", 2023-09-30T17:03:13.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000278311 2023-09-30T17:03:13.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:13.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373586+0000", 2023-09-30T17:03:13.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7994e-05 2023-09-30T17:03:13.194 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:13.194 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:13.194 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:13.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.194 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:03:13.194 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:03:13.195 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 54.725748518000003, 2023-09-30T17:03:13.195 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0046632949999999996, 2023-09-30T17:03:13.195 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:13.195 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:13.195 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:13.195 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.195 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:13.195 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:03:13.195 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:13.196 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.196 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.196 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:13.196 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:03:13.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:13.196 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.196 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.196 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:13.196 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377653+0000", 2023-09-30T17:03:13.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7800000000000002e-07 2023-09-30T17:03:13.197 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.197 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:13.197 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377657+0000", 2023-09-30T17:03:13.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5859999999999998e-06 2023-09-30T17:03:13.197 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.197 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:13.197 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377677+0000", 2023-09-30T17:03:13.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9508999999999999e-05 2023-09-30T17:03:13.198 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.198 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.198 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:13.198 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377682+0000", 2023-09-30T17:03:13.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8300000000000001e-06 2023-09-30T17:03:13.198 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.198 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.198 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:13.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377725+0000", 2023-09-30T17:03:13.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2425000000000001e-05 2023-09-30T17:03:13.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:13.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377738+0000", 2023-09-30T17:03:13.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2899e-05 2023-09-30T17:03:13.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:13.200 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382268+0000", 2023-09-30T17:03:13.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045301289999999999 2023-09-30T17:03:13.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:13.200 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382315+0000", 2023-09-30T17:03:13.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7539e-05 2023-09-30T17:03:13.200 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:13.200 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:13.200 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:13.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.201 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-09-30T17:03:13.201 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:03:13.201 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 54.725299067000002, 2023-09-30T17:03:13.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042540670000000003, 2023-09-30T17:03:13.201 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:13.201 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:13.201 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:13.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.201 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:13.202 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:03:13.202 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:13.202 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.202 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:13.202 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:03:13.202 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:13.202 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.202 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:13.202 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:03:13.202 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0299999999999998e-07 2023-09-30T17:03:13.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.203 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.203 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:13.203 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378107+0000", 2023-09-30T17:03:13.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9250000000000003e-06 2023-09-30T17:03:13.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.203 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.203 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:13.203 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378116+0000", 2023-09-30T17:03:13.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.037e-06 2023-09-30T17:03:13.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.203 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.204 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:13.204 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378123+0000", 2023-09-30T17:03:13.204 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1879999999999996e-06 2023-09-30T17:03:13.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.204 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:13.204 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378174+0000", 2023-09-30T17:03:13.204 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0998000000000002e-05 2023-09-30T17:03:13.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.204 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:13.205 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378197+0000", 2023-09-30T17:03:13.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2558e-05 2023-09-30T17:03:13.205 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.205 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:13.205 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382319+0000", 2023-09-30T17:03:13.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041220950000000001 2023-09-30T17:03:13.205 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.205 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:13.205 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382356+0000", 2023-09-30T17:03:13.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6563000000000002e-05 2023-09-30T17:03:13.206 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:13.206 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:13.206 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:13.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.206 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-09-30T17:03:13.206 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:03:13.206 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 50.667535243000003, 2023-09-30T17:03:13.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00171641, 2023-09-30T17:03:13.206 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:13.206 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:13.207 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:13.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.207 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:13.207 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:03:13.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:13.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.207 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:13.207 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:03:13.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:13.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.208 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:13.208 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435868+0000", 2023-09-30T17:03:13.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5840000000000002e-06 2023-09-30T17:03:13.208 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.208 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:13.208 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435892+0000", 2023-09-30T17:03:13.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3625000000000002e-05 2023-09-30T17:03:13.208 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.208 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:13.209 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435908+0000", 2023-09-30T17:03:13.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6548000000000001e-05 2023-09-30T17:03:13.209 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.209 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:13.209 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435935+0000", 2023-09-30T17:03:13.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6516000000000002e-05 2023-09-30T17:03:13.209 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.209 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:13.209 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435996+0000", 2023-09-30T17:03:13.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1433999999999995e-05 2023-09-30T17:03:13.209 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:13.210 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436114+0000", 2023-09-30T17:03:13.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000118344 2023-09-30T17:03:13.210 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:13.210 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436219+0000", 2023-09-30T17:03:13.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010453100000000001 2023-09-30T17:03:13.210 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:13.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436900+0000", 2023-09-30T17:03:13.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00068121299999999996 2023-09-30T17:03:13.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:13.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437508+0000", 2023-09-30T17:03:13.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00060817399999999995 2023-09-30T17:03:13.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:13.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437554+0000", 2023-09-30T17:03:13.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5609000000000003e-05 2023-09-30T17:03:13.212 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.212 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:13.212 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437582+0000", 2023-09-30T17:03:13.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7832000000000001e-05 2023-09-30T17:03:13.212 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:13.212 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:13.212 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:13.212 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.212 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2023-09-30T17:03:13.213 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:03:13.213 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 30.667223749000001, 2023-09-30T17:03:13.213 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001456199, 2023-09-30T17:03:13.213 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:13.213 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:13.213 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:13.213 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.213 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:13.213 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:03:13.213 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:13.213 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.213 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.214 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:13.214 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:03:13.214 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:13.214 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.214 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:13.214 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436178+0000", 2023-09-30T17:03:13.214 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.494e-06 2023-09-30T17:03:13.214 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.214 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:13.214 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436184+0000", 2023-09-30T17:03:13.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2809999999999999e-06 2023-09-30T17:03:13.215 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.215 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:13.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436198+0000", 2023-09-30T17:03:13.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3978000000000001e-05 2023-09-30T17:03:13.215 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.215 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:13.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436206+0000", 2023-09-30T17:03:13.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8040000000000007e-06 2023-09-30T17:03:13.215 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.216 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.216 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:13.216 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436268+0000", 2023-09-30T17:03:13.216 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1484999999999998e-05 2023-09-30T17:03:13.216 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.216 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.216 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:13.216 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436339+0000", 2023-09-30T17:03:13.216 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1000000000000005e-05 2023-09-30T17:03:13.216 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.216 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.216 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:13.217 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436438+0000", 2023-09-30T17:03:13.217 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9389000000000007e-05 2023-09-30T17:03:13.217 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.217 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:13.217 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436986+0000", 2023-09-30T17:03:13.217 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054723399999999996 2023-09-30T17:03:13.217 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.217 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:13.217 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437566+0000", 2023-09-30T17:03:13.217 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00058017599999999996 2023-09-30T17:03:13.218 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.218 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.218 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:13.218 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437606+0000", 2023-09-30T17:03:13.218 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9891999999999997e-05 2023-09-30T17:03:13.218 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:13.218 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:13.218 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:13.218 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437633+0000", 2023-09-30T17:03:13.218 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7466000000000001e-05 2023-09-30T17:03:13.218 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:13.219 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:13.219 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:13.219 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:13.219 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:13.219 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:13.220 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:13.220+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:13.221 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:03:13.321 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:13.322+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:13.329 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-09-30T17:03:13.368 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:13.368 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:03:13.368 INFO:teuthology.orchestra.run.smithi031.stdout: "num_ops": 0 2023-09-30T17:03:13.368 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:13.379 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:03:13.422 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:13.422+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:13.511 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:13.511 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:03:13.511 INFO:teuthology.orchestra.run.smithi031.stdout: "complaint_time": 30, 2023-09-30T17:03:13.511 INFO:teuthology.orchestra.run.smithi031.stdout: "num_blocked_ops": 0 2023-09-30T17:03:13.511 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:13.521 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:03:13.561 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:13.561+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:13.624 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:13.624+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:13.694 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:13.694 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 20, 2023-09-30T17:03:13.694 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 600, 2023-09-30T17:03:13.694 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:03:13.695 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.695 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:32 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'18, mlcod=11'14)", 2023-09-30T17:03:13.695 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:03:13.695 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 66.331852005000002, 2023-09-30T17:03:13.695 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051629809999999996, 2023-09-30T17:03:13.695 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:13.695 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:13.695 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:13.695 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.695 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:13.695 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:03:13.695 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:13.696 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.696 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.696 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:13.696 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:03:13.696 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:13.696 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.696 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.696 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:13.696 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:03:13.696 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2099999999999996e-07 2023-09-30T17:03:13.696 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.696 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.697 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:13.697 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361407+0000", 2023-09-30T17:03:13.697 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7499e-05 2023-09-30T17:03:13.697 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.697 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.697 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:13.697 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361418+0000", 2023-09-30T17:03:13.697 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1127999999999999e-05 2023-09-30T17:03:13.697 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.697 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.697 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:13.697 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361423+0000", 2023-09-30T17:03:13.697 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1930000000000001e-06 2023-09-30T17:03:13.698 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.698 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.698 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:13.698 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361476+0000", 2023-09-30T17:03:13.698 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3399000000000002e-05 2023-09-30T17:03:13.698 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.698 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.698 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:13.698 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361496+0000", 2023-09-30T17:03:13.698 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9638000000000001e-05 2023-09-30T17:03:13.698 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.699 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.699 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:13.699 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.366474+0000", 2023-09-30T17:03:13.699 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0049778829999999998 2023-09-30T17:03:13.699 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.699 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.699 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:13.699 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.366512+0000", 2023-09-30T17:03:13.699 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7620000000000002e-05 2023-09-30T17:03:13.699 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:13.699 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:13.699 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:13.700 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.700 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.700 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:37 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'23, mlcod=11'15)", 2023-09-30T17:03:13.700 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:03:13.700 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 66.329250008000002, 2023-09-30T17:03:13.700 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053985689999999998, 2023-09-30T17:03:13.700 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:13.700 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:13.700 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:13.700 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.700 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:13.700 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:03:13.701 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:13.701 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.701 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.701 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:13.701 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:03:13.701 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:13.701 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.701 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.701 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:13.701 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:03:13.701 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4400000000000001e-07 2023-09-30T17:03:13.701 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.701 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.702 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:13.702 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363956+0000", 2023-09-30T17:03:13.702 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.921e-06 2023-09-30T17:03:13.702 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.702 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.702 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:13.702 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363966+0000", 2023-09-30T17:03:13.702 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0351e-05 2023-09-30T17:03:13.702 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.702 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.702 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:13.703 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363971+0000", 2023-09-30T17:03:13.703 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.023e-06 2023-09-30T17:03:13.703 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.703 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.703 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:13.703 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.364013+0000", 2023-09-30T17:03:13.703 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1575000000000001e-05 2023-09-30T17:03:13.703 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.703 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.703 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:13.703 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.364026+0000", 2023-09-30T17:03:13.703 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3044000000000001e-05 2023-09-30T17:03:13.704 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.704 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.704 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:13.704 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.369308+0000", 2023-09-30T17:03:13.704 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005282152 2023-09-30T17:03:13.704 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.704 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.704 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:13.704 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.369349+0000", 2023-09-30T17:03:13.704 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1059000000000001e-05 2023-09-30T17:03:13.704 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:13.704 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:13.705 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:13.705 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.705 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.705 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:155 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'109, mlcod=11'105)", 2023-09-30T17:03:13.705 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:03:13.705 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 65.847554321999993, 2023-09-30T17:03:13.705 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053867639999999996, 2023-09-30T17:03:13.705 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:13.705 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:13.705 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:13.705 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.705 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:13.706 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:03:13.706 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:13.706 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.706 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.706 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:13.706 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:03:13.706 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:13.706 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.706 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.706 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:13.706 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845647+0000", 2023-09-30T17:03:13.706 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7599999999999997e-07 2023-09-30T17:03:13.707 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.707 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.707 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:13.707 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845699+0000", 2023-09-30T17:03:13.707 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1758000000000001e-05 2023-09-30T17:03:13.707 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.707 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.707 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:13.707 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845708+0000", 2023-09-30T17:03:13.707 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2159999999999995e-06 2023-09-30T17:03:13.707 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.707 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.708 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:13.708 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845712+0000", 2023-09-30T17:03:13.708 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2579999999999997e-06 2023-09-30T17:03:13.708 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.708 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.708 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:13.708 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845756+0000", 2023-09-30T17:03:13.708 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4119999999999998e-05 2023-09-30T17:03:13.708 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.708 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.708 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:13.708 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845779+0000", 2023-09-30T17:03:13.709 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2311e-05 2023-09-30T17:03:13.709 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.709 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.709 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:13.709 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.850982+0000", 2023-09-30T17:03:13.709 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005203053 2023-09-30T17:03:13.709 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.709 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.709 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:13.709 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851033+0000", 2023-09-30T17:03:13.709 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1471999999999998e-05 2023-09-30T17:03:13.709 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:13.710 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:13.710 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:13.710 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.710 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.710 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:156 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'110, mlcod=11'105)", 2023-09-30T17:03:13.710 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:03:13.710 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 65.847021396000002, 2023-09-30T17:03:13.710 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0052834759999999996, 2023-09-30T17:03:13.710 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:13.710 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:13.710 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:13.711 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.711 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:13.711 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:03:13.711 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:13.711 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.711 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.711 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:13.711 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:03:13.711 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:13.711 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.711 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.712 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:13.712 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846180+0000", 2023-09-30T17:03:13.712 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6300000000000005e-07 2023-09-30T17:03:13.712 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.712 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.712 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:13.712 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846184+0000", 2023-09-30T17:03:13.712 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3789999999999999e-06 2023-09-30T17:03:13.712 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.712 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.712 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:13.712 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846195+0000", 2023-09-30T17:03:13.712 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0778000000000001e-05 2023-09-30T17:03:13.713 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.713 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.713 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:13.713 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846200+0000", 2023-09-30T17:03:13.713 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1540000000000001e-06 2023-09-30T17:03:13.713 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.713 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.713 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:13.713 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846274+0000", 2023-09-30T17:03:13.713 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4129999999999997e-05 2023-09-30T17:03:13.713 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.714 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.714 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:13.714 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846286+0000", 2023-09-30T17:03:13.714 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1744e-05 2023-09-30T17:03:13.714 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.714 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.714 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:13.714 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851432+0000", 2023-09-30T17:03:13.714 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051462110000000004 2023-09-30T17:03:13.714 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.714 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.714 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:13.715 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851463+0000", 2023-09-30T17:03:13.715 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0516999999999999e-05 2023-09-30T17:03:13.715 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:13.715 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:13.715 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:13.715 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.715 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.715 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:203 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'149, mlcod=11'145)", 2023-09-30T17:03:13.715 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:03:13.715 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 65.490985487000003, 2023-09-30T17:03:13.715 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051867459999999999, 2023-09-30T17:03:13.715 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:13.715 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:13.716 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:13.716 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.716 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:13.716 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:03:13.716 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:13.716 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.716 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.716 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:13.716 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:03:13.716 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:13.716 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.716 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.717 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:13.717 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202216+0000", 2023-09-30T17:03:13.717 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7e-07 2023-09-30T17:03:13.717 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.717 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.717 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:13.717 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202271+0000", 2023-09-30T17:03:13.717 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5163e-05 2023-09-30T17:03:13.717 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.717 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.717 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:13.717 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202282+0000", 2023-09-30T17:03:13.717 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1319e-05 2023-09-30T17:03:13.718 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.718 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.718 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:13.718 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202288+0000", 2023-09-30T17:03:13.718 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2899999999999999e-06 2023-09-30T17:03:13.718 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.718 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.718 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:13.718 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202331+0000", 2023-09-30T17:03:13.718 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2147999999999997e-05 2023-09-30T17:03:13.718 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.718 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.719 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:13.719 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202348+0000", 2023-09-30T17:03:13.719 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7317e-05 2023-09-30T17:03:13.719 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.719 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.719 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:13.719 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.207357+0000", 2023-09-30T17:03:13.719 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0050095440000000003 2023-09-30T17:03:13.719 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.719 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.719 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:13.719 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.207402+0000", 2023-09-30T17:03:13.720 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4495e-05 2023-09-30T17:03:13.720 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:13.720 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:13.720 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:13.720 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.720 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.720 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:13.720 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:03:13.720 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 55.341655199000002, 2023-09-30T17:03:13.720 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.025313649000000001, 2023-09-30T17:03:13.720 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:13.720 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:13.720 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:13.721 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.721 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:13.721 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:03:13.721 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:13.721 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.721 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.721 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:13.721 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:03:13.721 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:13.721 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.721 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.721 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:13.722 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351551+0000", 2023-09-30T17:03:13.722 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3380000000000004e-06 2023-09-30T17:03:13.722 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.722 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.722 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:13.722 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351559+0000", 2023-09-30T17:03:13.722 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9589999999999995e-06 2023-09-30T17:03:13.722 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.722 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.722 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:13.722 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351571+0000", 2023-09-30T17:03:13.722 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2065999999999999e-05 2023-09-30T17:03:13.722 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.723 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.723 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:13.723 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351706+0000", 2023-09-30T17:03:13.723 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00013553799999999999 2023-09-30T17:03:13.723 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.723 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.723 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:13.723 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353016+0000", 2023-09-30T17:03:13.723 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0013099209999999999 2023-09-30T17:03:13.723 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.723 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.723 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:13.724 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353023+0000", 2023-09-30T17:03:13.724 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2479999999999999e-06 2023-09-30T17:03:13.724 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.724 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.724 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:13.724 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360348+0000", 2023-09-30T17:03:13.724 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0073248949999999997 2023-09-30T17:03:13.724 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.724 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.724 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:13.724 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360787+0000", 2023-09-30T17:03:13.724 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00043875199999999999 2023-09-30T17:03:13.725 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.725 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.725 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:13.725 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360892+0000", 2023-09-30T17:03:13.725 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010508199999999999 2023-09-30T17:03:13.725 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.725 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.725 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:13.725 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365132+0000", 2023-09-30T17:03:13.725 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0042396480000000004 2023-09-30T17:03:13.725 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.725 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.725 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:13.726 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376746+0000", 2023-09-30T17:03:13.726 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011614157 2023-09-30T17:03:13.726 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.726 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.726 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:13.726 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376811+0000", 2023-09-30T17:03:13.726 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5005999999999994e-05 2023-09-30T17:03:13.726 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.726 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.726 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:13.726 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376859+0000", 2023-09-30T17:03:13.727 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8038999999999999e-05 2023-09-30T17:03:13.727 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:13.727 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:13.727 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:13.727 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.727 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.727 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:13.727 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:03:13.727 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 55.3411574, 2023-09-30T17:03:13.727 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024923989000000001, 2023-09-30T17:03:13.727 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:13.727 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:13.727 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:13.728 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.728 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:13.728 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:03:13.728 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:13.728 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.728 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.728 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:13.728 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:03:13.728 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:13.728 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.728 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.729 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:13.729 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352044+0000", 2023-09-30T17:03:13.729 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9199999999999999e-07 2023-09-30T17:03:13.729 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.729 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.729 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:13.729 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352050+0000", 2023-09-30T17:03:13.729 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8880000000000002e-06 2023-09-30T17:03:13.729 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.729 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.729 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:13.730 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352143+0000", 2023-09-30T17:03:13.730 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2721999999999998e-05 2023-09-30T17:03:13.730 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.730 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.730 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:13.730 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352155+0000", 2023-09-30T17:03:13.730 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2279000000000001e-05 2023-09-30T17:03:13.730 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.730 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.730 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:13.731 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353114+0000", 2023-09-30T17:03:13.731 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00095943700000000005 2023-09-30T17:03:13.731 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.731 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.731 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:13.731 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353121+0000", 2023-09-30T17:03:13.731 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.494e-06 2023-09-30T17:03:13.731 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.731 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.731 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:13.731 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361491+0000", 2023-09-30T17:03:13.732 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0083697359999999991 2023-09-30T17:03:13.732 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.732 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.732 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:13.732 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361573+0000", 2023-09-30T17:03:13.732 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2822000000000001e-05 2023-09-30T17:03:13.732 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.732 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.732 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:13.732 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362166+0000", 2023-09-30T17:03:13.732 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00059223299999999995 2023-09-30T17:03:13.732 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.733 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.733 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:13.733 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365209+0000", 2023-09-30T17:03:13.733 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.003043212 2023-09-30T17:03:13.733 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.733 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.733 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:13.733 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376910+0000", 2023-09-30T17:03:13.733 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011700898 2023-09-30T17:03:13.733 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.733 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.733 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:13.734 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376945+0000", 2023-09-30T17:03:13.734 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4795000000000001e-05 2023-09-30T17:03:13.734 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.734 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.734 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:13.734 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376967+0000", 2023-09-30T17:03:13.734 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2580999999999999e-05 2023-09-30T17:03:13.734 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:13.734 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:13.734 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:13.734 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.734 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.735 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:13.735 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:03:13.735 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 55.340987480000003, 2023-09-30T17:03:13.735 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023120405, 2023-09-30T17:03:13.735 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:13.735 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:13.735 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:13.735 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.735 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:13.735 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:03:13.735 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:13.735 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.736 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.736 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:13.736 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:03:13.736 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:13.736 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.736 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.736 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:13.736 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352214+0000", 2023-09-30T17:03:13.736 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8400000000000003e-07 2023-09-30T17:03:13.736 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.736 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.736 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:13.737 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352233+0000", 2023-09-30T17:03:13.737 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8946000000000001e-05 2023-09-30T17:03:13.737 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.737 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.737 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:13.737 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352297+0000", 2023-09-30T17:03:13.737 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3540999999999994e-05 2023-09-30T17:03:13.737 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.737 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.737 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:13.737 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352450+0000", 2023-09-30T17:03:13.737 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015364799999999999 2023-09-30T17:03:13.737 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.738 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.738 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:13.738 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353098+0000", 2023-09-30T17:03:13.738 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00064820299999999997 2023-09-30T17:03:13.738 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.738 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.738 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:13.738 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353103+0000", 2023-09-30T17:03:13.738 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0529999999999997e-06 2023-09-30T17:03:13.738 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.738 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.738 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:13.739 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.358558+0000", 2023-09-30T17:03:13.739 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0054550249999999996 2023-09-30T17:03:13.739 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.739 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.739 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:13.739 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.358741+0000", 2023-09-30T17:03:13.739 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00018210200000000001 2023-09-30T17:03:13.739 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.739 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.739 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:13.739 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.359683+0000", 2023-09-30T17:03:13.739 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00094202299999999995 2023-09-30T17:03:13.740 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.740 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.740 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:13.740 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365044+0000", 2023-09-30T17:03:13.740 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053616219999999999 2023-09-30T17:03:13.740 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.740 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.740 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:13.740 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375256+0000", 2023-09-30T17:03:13.740 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010212156 2023-09-30T17:03:13.740 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.740 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.741 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:13.741 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375300+0000", 2023-09-30T17:03:13.741 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3961999999999997e-05 2023-09-30T17:03:13.741 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.741 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.741 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:13.741 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375334+0000", 2023-09-30T17:03:13.741 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.324e-05 2023-09-30T17:03:13.741 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:13.741 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:13.741 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:13.741 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.741 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.742 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:13.742 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:03:13.742 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 55.340672462000001, 2023-09-30T17:03:13.742 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024240660000000001, 2023-09-30T17:03:13.742 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:13.742 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:13.742 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:13.742 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.742 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:13.742 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:03:13.742 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:13.743 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.743 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.743 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:13.743 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:03:13.743 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:13.743 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.743 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.743 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:13.743 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352529+0000", 2023-09-30T17:03:13.743 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1379999999999999e-06 2023-09-30T17:03:13.743 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.743 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.744 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:13.744 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352536+0000", 2023-09-30T17:03:13.744 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3489999999999997e-06 2023-09-30T17:03:13.744 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.744 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.744 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:13.744 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352547+0000", 2023-09-30T17:03:13.744 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1109e-05 2023-09-30T17:03:13.744 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.744 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.744 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:13.744 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352560+0000", 2023-09-30T17:03:13.745 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3046e-05 2023-09-30T17:03:13.745 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.745 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.745 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:13.745 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353142+0000", 2023-09-30T17:03:13.745 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00058174699999999997 2023-09-30T17:03:13.745 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.745 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.745 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:13.745 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353147+0000", 2023-09-30T17:03:13.745 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5840000000000002e-06 2023-09-30T17:03:13.745 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.746 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.746 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:13.746 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360374+0000", 2023-09-30T17:03:13.746 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0072270049999999999 2023-09-30T17:03:13.746 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.746 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.746 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:13.746 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360795+0000", 2023-09-30T17:03:13.746 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00042088999999999999 2023-09-30T17:03:13.746 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.746 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.746 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:13.747 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360967+0000", 2023-09-30T17:03:13.747 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017235699999999999 2023-09-30T17:03:13.747 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.747 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.747 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:13.747 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365051+0000", 2023-09-30T17:03:13.747 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0040837429999999999 2023-09-30T17:03:13.747 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.747 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.747 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:13.747 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376708+0000", 2023-09-30T17:03:13.747 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011656866 2023-09-30T17:03:13.747 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.748 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.748 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:13.748 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376745+0000", 2023-09-30T17:03:13.748 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6769e-05 2023-09-30T17:03:13.748 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.748 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.748 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:13.748 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376769+0000", 2023-09-30T17:03:13.748 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4057e-05 2023-09-30T17:03:13.748 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:13.748 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:13.748 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:13.749 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.749 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.749 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:13.749 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:13.749 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 55.340413107000003, 2023-09-30T17:03:13.749 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023472704, 2023-09-30T17:03:13.749 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:13.749 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:13.749 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:13.749 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.749 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:13.749 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:13.750 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:13.750 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.750 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.750 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:13.750 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:13.750 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:13.750 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.750 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.750 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:13.750 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:13.750 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8000000000000005e-07 2023-09-30T17:03:13.750 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.751 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.751 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:13.751 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352794+0000", 2023-09-30T17:03:13.751 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.789e-06 2023-09-30T17:03:13.751 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.751 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.751 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:13.751 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352805+0000", 2023-09-30T17:03:13.751 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0848e-05 2023-09-30T17:03:13.751 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.751 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.751 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:13.752 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352812+0000", 2023-09-30T17:03:13.752 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4449999999999999e-06 2023-09-30T17:03:13.752 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.752 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.752 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:13.752 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353063+0000", 2023-09-30T17:03:13.752 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00025046299999999998 2023-09-30T17:03:13.752 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.752 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.752 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:13.752 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353071+0000", 2023-09-30T17:03:13.752 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6739999999999997e-06 2023-09-30T17:03:13.752 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.753 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.753 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:13.753 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361696+0000", 2023-09-30T17:03:13.753 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0086251609999999992 2023-09-30T17:03:13.753 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.753 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.753 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:13.753 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362284+0000", 2023-09-30T17:03:13.753 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00058872299999999998 2023-09-30T17:03:13.753 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.753 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.753 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:13.754 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362429+0000", 2023-09-30T17:03:13.754 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014509000000000001 2023-09-30T17:03:13.754 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.754 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.754 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:13.754 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365330+0000", 2023-09-30T17:03:13.754 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0029005419999999999 2023-09-30T17:03:13.754 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.754 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.754 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:13.755 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376196+0000", 2023-09-30T17:03:13.755 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.01086615 2023-09-30T17:03:13.755 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.755 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.755 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:13.755 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376230+0000", 2023-09-30T17:03:13.755 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3858e-05 2023-09-30T17:03:13.755 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.755 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.755 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:13.756 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376260+0000", 2023-09-30T17:03:13.756 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0181000000000001e-05 2023-09-30T17:03:13.756 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:13.756 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:13.756 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:13.756 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.756 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.756 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:13.756 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:03:13.756 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 55.340179536999997, 2023-09-30T17:03:13.756 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023406132999999999, 2023-09-30T17:03:13.756 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:13.757 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:13.757 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:13.757 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.757 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:13.757 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:03:13.757 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:13.757 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.757 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.757 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:13.757 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:03:13.758 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:13.758 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.758 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.758 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:13.758 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353022+0000", 2023-09-30T17:03:13.758 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.78e-07 2023-09-30T17:03:13.758 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.758 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.758 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:13.759 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353027+0000", 2023-09-30T17:03:13.759 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9089999999999999e-06 2023-09-30T17:03:13.759 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.759 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.759 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:13.759 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353035+0000", 2023-09-30T17:03:13.759 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0430000000000008e-06 2023-09-30T17:03:13.759 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.759 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.759 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:13.759 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353047+0000", 2023-09-30T17:03:13.760 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1674e-05 2023-09-30T17:03:13.760 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.760 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.760 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:13.760 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353105+0000", 2023-09-30T17:03:13.760 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8891999999999998e-05 2023-09-30T17:03:13.760 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.760 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.760 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:13.760 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353112+0000", 2023-09-30T17:03:13.760 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7059999999999998e-06 2023-09-30T17:03:13.760 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.761 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.761 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:13.761 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362733+0000", 2023-09-30T17:03:13.761 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0096205869999999999 2023-09-30T17:03:13.761 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.761 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.761 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:13.761 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362833+0000", 2023-09-30T17:03:13.761 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000100227 2023-09-30T17:03:13.761 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.761 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.761 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:13.762 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363000+0000", 2023-09-30T17:03:13.762 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016670899999999999 2023-09-30T17:03:13.762 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.762 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.762 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:13.762 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365550+0000", 2023-09-30T17:03:13.762 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0025499199999999998 2023-09-30T17:03:13.762 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.762 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.762 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:13.762 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376315+0000", 2023-09-30T17:03:13.762 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010765011999999999 2023-09-30T17:03:13.763 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.763 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.763 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:13.763 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376386+0000", 2023-09-30T17:03:13.763 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0866999999999998e-05 2023-09-30T17:03:13.763 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.763 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.763 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:13.763 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376427+0000", 2023-09-30T17:03:13.763 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1709000000000003e-05 2023-09-30T17:03:13.763 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:13.763 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:13.764 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:13.764 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.764 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.764 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:13.764 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:13.764 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 55.340138901000003, 2023-09-30T17:03:13.764 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024076238, 2023-09-30T17:03:13.764 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:13.764 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:13.764 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:13.764 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.764 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:13.765 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:13.765 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:13.765 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.765 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.765 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:13.765 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:13.765 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:13.765 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.765 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.765 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:13.765 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:13.765 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8699999999999995e-07 2023-09-30T17:03:13.765 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.766 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.766 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:13.766 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353067+0000", 2023-09-30T17:03:13.766 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.605e-06 2023-09-30T17:03:13.766 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.766 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.766 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:13.766 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353073+0000", 2023-09-30T17:03:13.766 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8900000000000004e-06 2023-09-30T17:03:13.766 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.766 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.766 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:13.767 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353083+0000", 2023-09-30T17:03:13.767 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0200000000000001e-05 2023-09-30T17:03:13.767 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.767 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.767 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:13.767 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353186+0000", 2023-09-30T17:03:13.767 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010256599999999999 2023-09-30T17:03:13.767 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.767 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.767 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:13.767 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353190+0000", 2023-09-30T17:03:13.767 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9709999999999998e-06 2023-09-30T17:03:13.768 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.768 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.768 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:13.768 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362946+0000", 2023-09-30T17:03:13.768 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0097563330000000007 2023-09-30T17:03:13.768 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.768 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.768 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:13.768 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363088+0000", 2023-09-30T17:03:13.768 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014259200000000001 2023-09-30T17:03:13.768 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.768 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.769 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:13.769 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363555+0000", 2023-09-30T17:03:13.769 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00046627799999999998 2023-09-30T17:03:13.769 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.769 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.769 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:13.769 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365871+0000", 2023-09-30T17:03:13.769 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0023167589999999998 2023-09-30T17:03:13.769 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.769 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.769 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:13.769 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377033+0000", 2023-09-30T17:03:13.769 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011161203999999999 2023-09-30T17:03:13.770 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.770 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.770 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:13.770 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377100+0000", 2023-09-30T17:03:13.770 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7230999999999994e-05 2023-09-30T17:03:13.770 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.770 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.770 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:13.770 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377138+0000", 2023-09-30T17:03:13.770 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8022000000000003e-05 2023-09-30T17:03:13.770 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:13.771 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:13.771 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:13.771 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.771 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.771 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:13.771 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:03:13.771 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 55.340037952000003, 2023-09-30T17:03:13.771 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.020304412000000001, 2023-09-30T17:03:13.771 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:13.771 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:13.771 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:13.771 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.771 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:13.772 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:03:13.772 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:13.772 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.772 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.772 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:13.772 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:03:13.772 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:13.772 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.772 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.772 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:13.772 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353164+0000", 2023-09-30T17:03:13.772 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7100000000000011e-07 2023-09-30T17:03:13.773 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.773 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.773 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:13.773 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353168+0000", 2023-09-30T17:03:13.773 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0600000000000001e-06 2023-09-30T17:03:13.773 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.773 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.773 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:13.773 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353177+0000", 2023-09-30T17:03:13.773 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1409999999999994e-06 2023-09-30T17:03:13.773 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.773 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.773 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:13.774 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353185+0000", 2023-09-30T17:03:13.774 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2479999999999996e-06 2023-09-30T17:03:13.774 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.774 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.774 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:13.774 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353246+0000", 2023-09-30T17:03:13.774 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0519000000000001e-05 2023-09-30T17:03:13.774 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.774 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.774 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:13.774 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353252+0000", 2023-09-30T17:03:13.774 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7859999999999999e-06 2023-09-30T17:03:13.775 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.775 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.775 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:13.775 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354979+0000", 2023-09-30T17:03:13.775 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0017270090000000001 2023-09-30T17:03:13.775 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.775 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.775 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:13.775 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355097+0000", 2023-09-30T17:03:13.775 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000117472 2023-09-30T17:03:13.775 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.775 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.775 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:13.776 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.373467+0000", 2023-09-30T17:03:13.776 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.018370206 2023-09-30T17:03:13.776 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:13.776 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:13.776 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:13.776 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.776 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.776 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:13.776 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:03:13.776 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 55.339997214, 2023-09-30T17:03:13.776 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.012725089, 2023-09-30T17:03:13.776 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:13.777 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:13.777 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:13.777 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.777 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:13.777 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:03:13.777 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:13.777 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.777 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.777 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:13.777 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:03:13.777 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:13.777 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.778 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.778 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:13.778 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353204+0000", 2023-09-30T17:03:13.778 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7100000000000002e-07 2023-09-30T17:03:13.778 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.778 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.778 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:13.778 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353213+0000", 2023-09-30T17:03:13.778 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8580000000000006e-06 2023-09-30T17:03:13.778 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.778 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.778 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:13.779 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353219+0000", 2023-09-30T17:03:13.779 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8939999999999998e-06 2023-09-30T17:03:13.779 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.779 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.779 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:13.779 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353223+0000", 2023-09-30T17:03:13.779 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.357e-06 2023-09-30T17:03:13.779 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.779 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.779 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:13.779 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353278+0000", 2023-09-30T17:03:13.779 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5228e-05 2023-09-30T17:03:13.780 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.780 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.780 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:13.780 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353284+0000", 2023-09-30T17:03:13.780 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8209999999999998e-06 2023-09-30T17:03:13.780 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.780 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.780 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:13.780 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355095+0000", 2023-09-30T17:03:13.780 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001811404 2023-09-30T17:03:13.780 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.780 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.780 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:13.781 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355256+0000", 2023-09-30T17:03:13.781 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000160898 2023-09-30T17:03:13.781 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.781 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.781 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:13.781 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365928+0000", 2023-09-30T17:03:13.781 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010672157999999999 2023-09-30T17:03:13.781 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:13.781 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:13.781 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:13.781 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.781 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.782 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-09-30T17:03:13.782 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:03:13.782 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 55.339466006999999, 2023-09-30T17:03:13.782 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0056863460000000001, 2023-09-30T17:03:13.782 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:13.782 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "reached pg", 2023-09-30T17:03:13.782 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:13.782 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.782 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:13.782 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:03:13.782 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:13.782 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.783 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.783 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:13.783 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:03:13.783 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:13.783 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.783 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.783 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:13.783 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:03:13.783 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5700000000000002e-07 2023-09-30T17:03:13.783 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.783 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.783 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:13.784 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353747+0000", 2023-09-30T17:03:13.784 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1899000000000001e-05 2023-09-30T17:03:13.784 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.784 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.784 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:13.784 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353776+0000", 2023-09-30T17:03:13.784 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.8767000000000001e-05 2023-09-30T17:03:13.784 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.784 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.784 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:13.784 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353792+0000", 2023-09-30T17:03:13.784 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5914999999999999e-05 2023-09-30T17:03:13.784 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.785 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.785 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:13.785 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353900+0000", 2023-09-30T17:03:13.785 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010774500000000001 2023-09-30T17:03:13.785 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.785 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.785 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:13.785 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.359421+0000", 2023-09-30T17:03:13.785 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0055213629999999996 2023-09-30T17:03:13.785 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:13.785 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:13.785 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:13.786 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.786 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.786 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:03:13.786 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:03:13.786 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 55.338794407000002, 2023-09-30T17:03:13.786 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0069196370000000002, 2023-09-30T17:03:13.786 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:13.786 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:13.786 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:13.786 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.786 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:13.786 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:03:13.787 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:13.787 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.787 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.787 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:13.787 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:03:13.787 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:13.787 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.787 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.787 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:13.787 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354407+0000", 2023-09-30T17:03:13.787 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7400000000000002e-07 2023-09-30T17:03:13.787 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.788 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.788 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:13.788 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354414+0000", 2023-09-30T17:03:13.788 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1040000000000001e-06 2023-09-30T17:03:13.788 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.788 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.788 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:13.788 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354425+0000", 2023-09-30T17:03:13.788 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1090000000000001e-05 2023-09-30T17:03:13.788 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.788 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.788 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:13.789 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354435+0000", 2023-09-30T17:03:13.789 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8169999999999994e-06 2023-09-30T17:03:13.789 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.789 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.789 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:13.789 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355741+0000", 2023-09-30T17:03:13.789 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0013063160000000001 2023-09-30T17:03:13.789 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.789 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.789 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:13.789 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355763+0000", 2023-09-30T17:03:13.789 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1688e-05 2023-09-30T17:03:13.789 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.790 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.790 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:13.790 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361289+0000", 2023-09-30T17:03:13.790 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0055258269999999996 2023-09-30T17:03:13.790 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.790 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.790 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:13.790 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361326+0000", 2023-09-30T17:03:13.790 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7020999999999997e-05 2023-09-30T17:03:13.790 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:13.790 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:13.790 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:13.791 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.791 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.791 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:30 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2023-09-30T17:03:13.791 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:03:13.791 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 55.337420449, 2023-09-30T17:03:13.791 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0069996629999999997, 2023-09-30T17:03:13.791 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:13.791 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:13.791 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:13.791 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.791 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:13.792 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:03:13.792 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:13.792 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.792 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.792 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:13.792 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:03:13.792 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:13.792 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.792 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.792 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:13.792 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355781+0000", 2023-09-30T17:03:13.792 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9599999999999999e-07 2023-09-30T17:03:13.792 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.793 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.793 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:13.793 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355788+0000", 2023-09-30T17:03:13.793 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8129999999999996e-06 2023-09-30T17:03:13.793 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.793 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.793 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:13.793 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355798+0000", 2023-09-30T17:03:13.793 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2909999999999996e-06 2023-09-30T17:03:13.793 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.793 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.793 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:13.794 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355807+0000", 2023-09-30T17:03:13.794 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8619999999999992e-06 2023-09-30T17:03:13.794 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.794 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.794 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:13.794 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.357264+0000", 2023-09-30T17:03:13.794 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0014578289999999999 2023-09-30T17:03:13.794 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.794 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.794 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:13.794 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.357916+0000", 2023-09-30T17:03:13.794 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00065170500000000004 2023-09-30T17:03:13.795 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.795 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.795 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:13.795 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362731+0000", 2023-09-30T17:03:13.795 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0048149849999999999 2023-09-30T17:03:13.795 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.795 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.795 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:13.795 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362780+0000", 2023-09-30T17:03:13.795 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8681999999999999e-05 2023-09-30T17:03:13.795 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:13.795 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:13.796 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:13.796 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.796 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.796 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2023-09-30T17:03:13.796 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:03:13.796 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 55.318769398000001, 2023-09-30T17:03:13.796 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005905998, 2023-09-30T17:03:13.796 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:13.796 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:13.796 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:13.796 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.797 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:13.797 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:03:13.797 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:13.797 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.797 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.797 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:13.797 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:03:13.797 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:13.797 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.797 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.797 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:13.797 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:03:13.798 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1e-07 2023-09-30T17:03:13.798 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.798 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.798 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:13.798 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374455+0000", 2023-09-30T17:03:13.798 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.3091999999999998e-05 2023-09-30T17:03:13.798 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.798 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.798 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:13.798 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374462+0000", 2023-09-30T17:03:13.798 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5170000000000002e-06 2023-09-30T17:03:13.798 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.799 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.799 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:13.799 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374469+0000", 2023-09-30T17:03:13.799 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8199999999999999e-06 2023-09-30T17:03:13.799 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.799 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.799 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:13.799 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374550+0000", 2023-09-30T17:03:13.799 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0978999999999998e-05 2023-09-30T17:03:13.799 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.799 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.800 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:13.800 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374562+0000", 2023-09-30T17:03:13.800 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2472e-05 2023-09-30T17:03:13.800 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.800 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.800 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:13.800 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380293+0000", 2023-09-30T17:03:13.800 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0057310379999999999 2023-09-30T17:03:13.800 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.800 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.800 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:13.800 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380337+0000", 2023-09-30T17:03:13.801 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3869999999999998e-05 2023-09-30T17:03:13.801 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:13.801 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:13.801 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:13.801 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.801 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.801 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2023-09-30T17:03:13.801 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:03:13.801 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 55.318582649, 2023-09-30T17:03:13.801 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0057590560000000002, 2023-09-30T17:03:13.801 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:13.801 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:13.802 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:13.802 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.802 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:13.802 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:03:13.802 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:13.802 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.802 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.802 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:13.802 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:03:13.802 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:13.802 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.803 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.803 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:13.803 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:03:13.803 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4900000000000001e-07 2023-09-30T17:03:13.803 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.803 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.803 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:13.803 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374629+0000", 2023-09-30T17:03:13.803 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1014e-05 2023-09-30T17:03:13.803 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.803 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.803 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:13.804 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374636+0000", 2023-09-30T17:03:13.804 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5889999999999999e-06 2023-09-30T17:03:13.804 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.804 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.804 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:13.804 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374642+0000", 2023-09-30T17:03:13.804 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.48e-06 2023-09-30T17:03:13.804 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.804 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.804 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:13.804 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374681+0000", 2023-09-30T17:03:13.804 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9320000000000003e-05 2023-09-30T17:03:13.805 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.805 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.805 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:13.805 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374694+0000", 2023-09-30T17:03:13.805 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3351e-05 2023-09-30T17:03:13.805 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.805 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.805 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:13.805 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380319+0000", 2023-09-30T17:03:13.805 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0056243880000000001 2023-09-30T17:03:13.805 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.805 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.806 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:13.806 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380377+0000", 2023-09-30T17:03:13.806 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8464999999999997e-05 2023-09-30T17:03:13.806 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:13.806 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:13.806 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:13.806 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.806 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.806 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=0'0)", 2023-09-30T17:03:13.806 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:03:13.806 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 55.317871738000001, 2023-09-30T17:03:13.806 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051157370000000004, 2023-09-30T17:03:13.807 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:13.807 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:13.807 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:13.807 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.807 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:13.807 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:03:13.807 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:13.807 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.807 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.807 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:13.807 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:03:13.807 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:13.808 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.808 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.808 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:13.808 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:03:13.808 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0199999999999998e-07 2023-09-30T17:03:13.808 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.808 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.808 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:13.808 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375334+0000", 2023-09-30T17:03:13.808 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8799999999999999e-06 2023-09-30T17:03:13.808 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.808 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.809 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:13.809 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375343+0000", 2023-09-30T17:03:13.809 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5490000000000006e-06 2023-09-30T17:03:13.809 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.809 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.809 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:13.809 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375350+0000", 2023-09-30T17:03:13.809 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5700000000000004e-06 2023-09-30T17:03:13.809 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.809 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.809 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:13.809 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375396+0000", 2023-09-30T17:03:13.810 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5550999999999998e-05 2023-09-30T17:03:13.810 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.810 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.810 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:13.810 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375410+0000", 2023-09-30T17:03:13.810 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4518999999999999e-05 2023-09-30T17:03:13.810 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.810 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.810 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:13.810 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380401+0000", 2023-09-30T17:03:13.810 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0049903430000000004 2023-09-30T17:03:13.810 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:13.811 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:13.811 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:13.811 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380445+0000", 2023-09-30T17:03:13.811 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4023000000000002e-05 2023-09-30T17:03:13.811 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:13.811 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:13.811 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:13.811 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:13.811 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:13.811 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:13.812 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-09-30T17:03:13.813 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:03:13.814 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:13.813+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:13.914 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:13.914+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:13.944 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:13.944 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:03:13.944 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2023-09-30T17:03:13.944 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:13.954 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:03:13.976 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:03:13.997 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:03:13.997 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-09-30T17:03:13.997 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-09-30T17:03:13.997 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:03:14.001 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:03:14.001 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:03:14.014 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:14.015+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:14.081 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:14.081 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:14.091 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:03:14.133 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:14.133+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:14.215 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:14.215+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:14.259 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:14.259 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:14.270 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:03:14.316 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is set 2023-09-30T17:03:14.316 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:14.316+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:14.417 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:14.416+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:14.419 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:14.419 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:14.430 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:03:14.517 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:14.518+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:14.602 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:14.603 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:14.613 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:03:14.619 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:14.619+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:14.719 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:14.719+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:14.744 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:14.744 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:14.754 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:03:14.820 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:14.820+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:14.883 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:14.883 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:14.893 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:03:14.937 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:14.937+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:15.019 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:15.020 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:15.022 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:15.022+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:15.030 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:03:15.123 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:15.123+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:15.196 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:15.196 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:15.206 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:03:15.247 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:15.247+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:15.326 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:15.325+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:15.344 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:15.344 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:15.354 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:03:15.444 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:15.444+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:15.526 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:15.526 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:15.530 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:15.529+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:15.537 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:03:15.630 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:15.631+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:15.708 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:15.708 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:15.718 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:03:15.763 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:15.762+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:15.832 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:15.832+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:15.857 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:15.857 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:15.867 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:03:15.933 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:15.933+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:16.002 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-09-30T17:03:16.033 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:16.033 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:16.034 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:16.034+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:16.043 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:03:16.135 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:16.134+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:16.163 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:03:16.183 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:03:16.183 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-09-30T17:03:16.183 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-09-30T17:03:16.184 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:03:16.188 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:03:16.188 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:03:16.213 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:16.213 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2023-09-30T17:03:16.213 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2023-09-30T17:03:16.213 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2023-09-30T17:03:16.213 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.214 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:16.214 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:03:16.214 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 57.860133157, 2023-09-30T17:03:16.214 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093789779999999996, 2023-09-30T17:03:16.214 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:16.214 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:16.214 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:16.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.214 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:16.214 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:03:16.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:16.215 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.215 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:16.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:03:16.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:16.215 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.215 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:16.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352027+0000", 2023-09-30T17:03:16.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0224000000000001e-05 2023-09-30T17:03:16.216 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.216 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.216 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:16.216 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352039+0000", 2023-09-30T17:03:16.216 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1569000000000001e-05 2023-09-30T17:03:16.216 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.216 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.216 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:16.216 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352052+0000", 2023-09-30T17:03:16.217 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2605999999999999e-05 2023-09-30T17:03:16.217 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.217 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:16.217 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352064+0000", 2023-09-30T17:03:16.217 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2666999999999999e-05 2023-09-30T17:03:16.217 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.217 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:16.217 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352147+0000", 2023-09-30T17:03:16.218 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3125000000000001e-05 2023-09-30T17:03:16.218 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.218 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.218 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:16.218 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352306+0000", 2023-09-30T17:03:16.218 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015881900000000001 2023-09-30T17:03:16.218 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.218 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.218 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:16.218 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352450+0000", 2023-09-30T17:03:16.218 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014420700000000001 2023-09-30T17:03:16.219 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.219 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:16.219 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355975+0000", 2023-09-30T17:03:16.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003524246 2023-09-30T17:03:16.219 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.219 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:16.219 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361279+0000", 2023-09-30T17:03:16.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005304507 2023-09-30T17:03:16.219 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.220 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:16.220 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361344+0000", 2023-09-30T17:03:16.220 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4548999999999995e-05 2023-09-30T17:03:16.220 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.220 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.220 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:16.220 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361396+0000", 2023-09-30T17:03:16.220 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2459e-05 2023-09-30T17:03:16.220 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:16.220 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:16.220 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:16.220 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.221 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.221 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:16.221 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:03:16.221 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 57.860040865000002, 2023-09-30T17:03:16.221 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021233007000000002, 2023-09-30T17:03:16.221 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:16.221 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:16.221 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:16.221 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.221 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:16.221 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:03:16.221 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:16.222 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.222 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.222 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:16.222 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:03:16.222 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:16.222 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.222 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.222 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:16.222 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352110+0000", 2023-09-30T17:03:16.222 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6000000000000002e-07 2023-09-30T17:03:16.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.223 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:16.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352117+0000", 2023-09-30T17:03:16.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5930000000000002e-06 2023-09-30T17:03:16.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.223 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:16.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352126+0000", 2023-09-30T17:03:16.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0729999999999994e-06 2023-09-30T17:03:16.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.224 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:16.224 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352136+0000", 2023-09-30T17:03:16.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0380000000000001e-05 2023-09-30T17:03:16.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.224 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.224 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:16.224 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353279+0000", 2023-09-30T17:03:16.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0011424670000000001 2023-09-30T17:03:16.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.224 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.224 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:16.224 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353707+0000", 2023-09-30T17:03:16.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00042829800000000003 2023-09-30T17:03:16.225 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.225 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.225 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:16.225 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354104+0000", 2023-09-30T17:03:16.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00039643399999999998 2023-09-30T17:03:16.225 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.225 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.225 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:16.225 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356925+0000", 2023-09-30T17:03:16.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0028210900000000001 2023-09-30T17:03:16.226 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.226 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.226 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:16.226 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373243+0000", 2023-09-30T17:03:16.226 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016318461999999999 2023-09-30T17:03:16.226 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.226 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.226 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:16.226 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373301+0000", 2023-09-30T17:03:16.226 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7435000000000002e-05 2023-09-30T17:03:16.226 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:16.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373342+0000", 2023-09-30T17:03:16.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1915000000000001e-05 2023-09-30T17:03:16.227 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:16.227 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:16.227 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:16.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.227 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:16.227 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:03:16.227 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 57.859998253999997, 2023-09-30T17:03:16.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011988331, 2023-09-30T17:03:16.228 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:16.228 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:16.228 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:16.228 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.228 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:16.228 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:03:16.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:16.228 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.228 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.228 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:16.228 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:03:16.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:16.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.229 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:16.229 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352153+0000", 2023-09-30T17:03:16.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0500000000000003e-07 2023-09-30T17:03:16.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.229 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:16.229 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352157+0000", 2023-09-30T17:03:16.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9790000000000004e-06 2023-09-30T17:03:16.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.229 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:16.230 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352173+0000", 2023-09-30T17:03:16.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6535999999999999e-05 2023-09-30T17:03:16.230 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.230 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:16.230 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352180+0000", 2023-09-30T17:03:16.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7700000000000004e-06 2023-09-30T17:03:16.230 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.230 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:16.230 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353526+0000", 2023-09-30T17:03:16.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0013458330000000001 2023-09-30T17:03:16.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.231 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:16.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353648+0000", 2023-09-30T17:03:16.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012262899999999999 2023-09-30T17:03:16.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.231 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:16.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354141+0000", 2023-09-30T17:03:16.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00049222899999999995 2023-09-30T17:03:16.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.231 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:16.232 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356931+0000", 2023-09-30T17:03:16.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0027900860000000002 2023-09-30T17:03:16.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:16.232 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364066+0000", 2023-09-30T17:03:16.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071355050000000003 2023-09-30T17:03:16.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:16.232 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364103+0000", 2023-09-30T17:03:16.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6944999999999999e-05 2023-09-30T17:03:16.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.233 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.233 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:16.233 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364140+0000", 2023-09-30T17:03:16.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7214e-05 2023-09-30T17:03:16.233 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:16.233 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:16.233 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:16.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.233 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.233 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:16.234 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:03:16.234 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 57.859959023000002, 2023-09-30T17:03:16.234 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012110921, 2023-09-30T17:03:16.234 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:16.234 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:16.234 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:16.234 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.234 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:16.234 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:03:16.234 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:16.234 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.234 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.235 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:16.235 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:03:16.235 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:16.235 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.235 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.235 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:16.235 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352192+0000", 2023-09-30T17:03:16.235 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7300000000000005e-07 2023-09-30T17:03:16.235 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.235 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.235 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:16.236 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352196+0000", 2023-09-30T17:03:16.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2370000000000003e-06 2023-09-30T17:03:16.236 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.236 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.236 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:16.236 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352205+0000", 2023-09-30T17:03:16.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6659999999999997e-06 2023-09-30T17:03:16.236 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.236 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.236 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:16.236 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352214+0000", 2023-09-30T17:03:16.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8259999999999999e-06 2023-09-30T17:03:16.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:16.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354470+0000", 2023-09-30T17:03:16.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022557340000000001 2023-09-30T17:03:16.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:16.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354557+0000", 2023-09-30T17:03:16.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6909000000000004e-05 2023-09-30T17:03:16.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:16.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354694+0000", 2023-09-30T17:03:16.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013774800000000001 2023-09-30T17:03:16.238 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:16.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356937+0000", 2023-09-30T17:03:16.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022424540000000001 2023-09-30T17:03:16.238 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:16.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364227+0000", 2023-09-30T17:03:16.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072902430000000001 2023-09-30T17:03:16.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.239 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:16.239 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364278+0000", 2023-09-30T17:03:16.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1180999999999997e-05 2023-09-30T17:03:16.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.239 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:16.239 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364302+0000", 2023-09-30T17:03:16.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4049999999999998e-05 2023-09-30T17:03:16.240 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:16.240 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:16.240 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:16.240 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.240 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.240 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:16.240 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:16.240 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 57.859925683999997, 2023-09-30T17:03:16.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021258651999999999, 2023-09-30T17:03:16.240 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:16.240 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:16.240 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:16.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.241 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:16.241 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:16.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:16.241 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.241 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:16.241 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:16.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:16.241 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.241 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:16.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:16.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6899999999999997e-07 2023-09-30T17:03:16.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:16.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352236+0000", 2023-09-30T17:03:16.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0251000000000001e-05 2023-09-30T17:03:16.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:16.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352244+0000", 2023-09-30T17:03:16.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0770000000000008e-06 2023-09-30T17:03:16.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:16.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352251+0000", 2023-09-30T17:03:16.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4749999999999996e-06 2023-09-30T17:03:16.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:16.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354455+0000", 2023-09-30T17:03:16.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022043660000000001 2023-09-30T17:03:16.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:16.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354577+0000", 2023-09-30T17:03:16.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000121054 2023-09-30T17:03:16.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:16.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354723+0000", 2023-09-30T17:03:16.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014693900000000001 2023-09-30T17:03:16.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:16.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356941+0000", 2023-09-30T17:03:16.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002217199 2023-09-30T17:03:16.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.245 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:16.245 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373392+0000", 2023-09-30T17:03:16.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016451774999999998 2023-09-30T17:03:16.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.245 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:16.245 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373445+0000", 2023-09-30T17:03:16.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.308e-05 2023-09-30T17:03:16.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.246 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:16.246 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373483+0000", 2023-09-30T17:03:16.246 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7766999999999999e-05 2023-09-30T17:03:16.246 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:16.246 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:16.246 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:16.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.246 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:16.246 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:16.246 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 57.859889592999998, 2023-09-30T17:03:16.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020903497, 2023-09-30T17:03:16.247 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:16.247 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:16.247 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:16.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:16.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:16.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:16.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:16.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:16.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:16.248 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.248 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:16.248 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:16.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0800000000000004e-07 2023-09-30T17:03:16.248 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.248 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:16.248 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352266+0000", 2023-09-30T17:03:16.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1280000000000001e-06 2023-09-30T17:03:16.248 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.249 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:16.249 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352273+0000", 2023-09-30T17:03:16.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3730000000000004e-06 2023-09-30T17:03:16.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.249 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:16.249 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352279+0000", 2023-09-30T17:03:16.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7699999999999998e-06 2023-09-30T17:03:16.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.249 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:16.249 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352334+0000", 2023-09-30T17:03:16.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5547999999999997e-05 2023-09-30T17:03:16.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:16.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352435+0000", 2023-09-30T17:03:16.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100688 2023-09-30T17:03:16.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:16.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352585+0000", 2023-09-30T17:03:16.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000150068 2023-09-30T17:03:16.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:16.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354912+0000", 2023-09-30T17:03:16.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0023266770000000001 2023-09-30T17:03:16.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:16.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373066+0000", 2023-09-30T17:03:16.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018154474 2023-09-30T17:03:16.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:16.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373122+0000", 2023-09-30T17:03:16.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6193000000000002e-05 2023-09-30T17:03:16.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:16.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373164+0000", 2023-09-30T17:03:16.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1869999999999997e-05 2023-09-30T17:03:16.252 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:16.252 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:16.252 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:16.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.253 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:16.253 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:03:16.253 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 57.859853917000002, 2023-09-30T17:03:16.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021015097999999999, 2023-09-30T17:03:16.253 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:16.253 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:16.253 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:16.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.253 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:16.254 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:03:16.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:16.254 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.254 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:16.254 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:03:16.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:16.254 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.254 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:16.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352297+0000", 2023-09-30T17:03:16.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8299999999999997e-07 2023-09-30T17:03:16.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:16.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352300+0000", 2023-09-30T17:03:16.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7460000000000001e-06 2023-09-30T17:03:16.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:16.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352307+0000", 2023-09-30T17:03:16.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4959999999999999e-06 2023-09-30T17:03:16.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:16.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352314+0000", 2023-09-30T17:03:16.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0190000000000001e-06 2023-09-30T17:03:16.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:16.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354070+0000", 2023-09-30T17:03:16.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001755936 2023-09-30T17:03:16.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.257 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:16.257 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354221+0000", 2023-09-30T17:03:16.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000150884 2023-09-30T17:03:16.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.257 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.257 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:16.257 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373311+0000", 2023-09-30T17:03:16.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019090434 2023-09-30T17:03:16.257 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:16.257 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:16.257 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:16.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.258 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:16.258 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:03:16.258 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 57.859825198000003, 2023-09-30T17:03:16.258 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021255174000000002, 2023-09-30T17:03:16.258 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:16.258 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:16.258 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:16.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:16.258 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:03:16.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:16.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.259 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:16.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:03:16.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:16.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.259 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:16.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352326+0000", 2023-09-30T17:03:16.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3200000000000005e-07 2023-09-30T17:03:16.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:16.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352349+0000", 2023-09-30T17:03:16.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3183000000000001e-05 2023-09-30T17:03:16.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:16.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352358+0000", 2023-09-30T17:03:16.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5230000000000001e-06 2023-09-30T17:03:16.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:16.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352365+0000", 2023-09-30T17:03:16.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3260000000000001e-06 2023-09-30T17:03:16.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.261 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:16.261 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355450+0000", 2023-09-30T17:03:16.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0030854049999999998 2023-09-30T17:03:16.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.261 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:16.261 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355583+0000", 2023-09-30T17:03:16.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000133189 2023-09-30T17:03:16.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.262 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:16.262 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373580+0000", 2023-09-30T17:03:16.262 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017997016000000001 2023-09-30T17:03:16.262 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:16.262 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:16.262 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:16.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.262 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:16.262 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:03:16.263 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 57.859773775000001, 2023-09-30T17:03:16.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010380537, 2023-09-30T17:03:16.263 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:16.263 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:16.263 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:16.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:16.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:03:16.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:16.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:16.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:03:16.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:16.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:16.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:03:16.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1500000000000003e-07 2023-09-30T17:03:16.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:16.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352381+0000", 2023-09-30T17:03:16.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6330000000000002e-06 2023-09-30T17:03:16.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:16.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352388+0000", 2023-09-30T17:03:16.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7229999999999998e-06 2023-09-30T17:03:16.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:16.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352394+0000", 2023-09-30T17:03:16.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1789999999999996e-06 2023-09-30T17:03:16.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.266 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.266 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:16.266 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353259+0000", 2023-09-30T17:03:16.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000865221 2023-09-30T17:03:16.266 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.266 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.266 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:16.266 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353391+0000", 2023-09-30T17:03:16.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013217700000000001 2023-09-30T17:03:16.266 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.266 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.267 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:16.267 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362757+0000", 2023-09-30T17:03:16.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093657889999999994 2023-09-30T17:03:16.267 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:16.267 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:16.267 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:16.267 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.267 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-09-30T17:03:16.267 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:03:16.268 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 57.853473483000002, 2023-09-30T17:03:16.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0061813579999999996, 2023-09-30T17:03:16.268 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:16.268 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2023-09-30T17:03:16.268 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:16.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.268 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:16.268 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:03:16.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:16.268 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.269 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:16.269 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:03:16.269 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:16.269 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.269 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:16.269 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:03:16.269 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5499999999999999e-07 2023-09-30T17:03:16.269 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.270 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:16.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358686+0000", 2023-09-30T17:03:16.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9979999999999992e-06 2023-09-30T17:03:16.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.270 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:16.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358700+0000", 2023-09-30T17:03:16.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3635000000000001e-05 2023-09-30T17:03:16.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.270 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:16.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358714+0000", 2023-09-30T17:03:16.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4470999999999999e-05 2023-09-30T17:03:16.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:16.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358767+0000", 2023-09-30T17:03:16.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2651999999999997e-05 2023-09-30T17:03:16.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:16.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364858+0000", 2023-09-30T17:03:16.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060912470000000002 2023-09-30T17:03:16.271 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:16.272 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:16.272 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:16.272 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.272 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2023-09-30T17:03:16.272 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:03:16.272 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 57.851108643000003, 2023-09-30T17:03:16.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00036246299999999999, 2023-09-30T17:03:16.272 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:16.272 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:16.273 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:16.273 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.273 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:16.273 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:03:16.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:16.273 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.273 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.273 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:16.273 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:03:16.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:16.273 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.274 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:16.274 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:03:16.274 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3099999999999999e-07 2023-09-30T17:03:16.274 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.274 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:16.274 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361045+0000", 2023-09-30T17:03:16.274 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.49e-06 2023-09-30T17:03:16.274 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.275 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:16.275 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361056+0000", 2023-09-30T17:03:16.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0910000000000001e-05 2023-09-30T17:03:16.275 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.275 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:16.275 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361067+0000", 2023-09-30T17:03:16.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0531e-05 2023-09-30T17:03:16.275 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:16.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361263+0000", 2023-09-30T17:03:16.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000196486 2023-09-30T17:03:16.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:16.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361273+0000", 2023-09-30T17:03:16.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3379999999999994e-06 2023-09-30T17:03:16.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:16.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361404+0000", 2023-09-30T17:03:16.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013137700000000001 2023-09-30T17:03:16.277 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:16.277 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:16.277 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:16.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.277 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:31 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:03:16.277 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:03:16.277 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 57.850132614000003, 2023-09-30T17:03:16.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006676408, 2023-09-30T17:03:16.278 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:16.278 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:16.278 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:16.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:16.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:03:16.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:16.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:16.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:03:16.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:16.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:16.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:03:16.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5600000000000002e-07 2023-09-30T17:03:16.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:16.280 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362044+0000", 2023-09-30T17:03:16.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5987999999999999e-05 2023-09-30T17:03:16.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.280 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:16.280 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362051+0000", 2023-09-30T17:03:16.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2599999999999999e-06 2023-09-30T17:03:16.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.280 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:16.280 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362057+0000", 2023-09-30T17:03:16.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.19e-06 2023-09-30T17:03:16.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:16.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362096+0000", 2023-09-30T17:03:16.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8278000000000002e-05 2023-09-30T17:03:16.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:16.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362114+0000", 2023-09-30T17:03:16.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8808e-05 2023-09-30T17:03:16.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:16.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368658+0000", 2023-09-30T17:03:16.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065433540000000004 2023-09-30T17:03:16.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:16.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368694+0000", 2023-09-30T17:03:16.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6273999999999999e-05 2023-09-30T17:03:16.282 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:16.282 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:16.282 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:16.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.283 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:26 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-09-30T17:03:16.283 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:03:16.283 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 57.850041842000003, 2023-09-30T17:03:16.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0066596119999999996, 2023-09-30T17:03:16.283 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:16.283 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:16.283 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:16.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.284 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:16.284 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:03:16.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:16.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.284 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:16.284 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:03:16.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:16.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.284 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:16.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362109+0000", 2023-09-30T17:03:16.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5699999999999999e-07 2023-09-30T17:03:16.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:16.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362112+0000", 2023-09-30T17:03:16.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8410000000000002e-06 2023-09-30T17:03:16.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:16.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362117+0000", 2023-09-30T17:03:16.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.792e-06 2023-09-30T17:03:16.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:16.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362122+0000", 2023-09-30T17:03:16.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.763e-06 2023-09-30T17:03:16.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:16.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362344+0000", 2023-09-30T17:03:16.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022181600000000001 2023-09-30T17:03:16.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:16.287 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362357+0000", 2023-09-30T17:03:16.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2864000000000001e-05 2023-09-30T17:03:16.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:16.287 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368738+0000", 2023-09-30T17:03:16.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063809499999999998 2023-09-30T17:03:16.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:16.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368768+0000", 2023-09-30T17:03:16.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0429e-05 2023-09-30T17:03:16.288 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:16.288 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:16.288 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:16.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.288 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2023-09-30T17:03:16.288 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:03:16.289 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 57.848825675000001, 2023-09-30T17:03:16.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00082185400000000001, 2023-09-30T17:03:16.289 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:16.289 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:16.289 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:16.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.289 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:16.289 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:03:16.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:16.289 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:16.290 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:03:16.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:16.290 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:16.290 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:03:16.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.22e-07 2023-09-30T17:03:16.290 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:16.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363327+0000", 2023-09-30T17:03:16.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4480000000000001e-06 2023-09-30T17:03:16.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:16.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363333+0000", 2023-09-30T17:03:16.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9989999999999997e-06 2023-09-30T17:03:16.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:16.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363354+0000", 2023-09-30T17:03:16.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0547000000000002e-05 2023-09-30T17:03:16.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:16.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364057+0000", 2023-09-30T17:03:16.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00070306600000000002 2023-09-30T17:03:16.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:16.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364063+0000", 2023-09-30T17:03:16.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.694e-06 2023-09-30T17:03:16.293 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.293 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:16.293 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364146+0000", 2023-09-30T17:03:16.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3877999999999999e-05 2023-09-30T17:03:16.293 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:16.293 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:16.293 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:16.293 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.293 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e18/16 ondisk, result = 0)", 2023-09-30T17:03:16.293 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:03:16.294 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 57.848512143000001, 2023-09-30T17:03:16.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00067007199999999996, 2023-09-30T17:03:16.294 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:16.294 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:16.294 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:16.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.294 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:16.294 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:03:16.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:16.294 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:16.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:03:16.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:16.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:16.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:03:16.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.41e-07 2023-09-30T17:03:16.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:16.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363641+0000", 2023-09-30T17:03:16.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4830000000000002e-06 2023-09-30T17:03:16.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.296 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:16.296 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363647+0000", 2023-09-30T17:03:16.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4869999999999999e-06 2023-09-30T17:03:16.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.296 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:16.296 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363654+0000", 2023-09-30T17:03:16.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5889999999999999e-06 2023-09-30T17:03:16.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:16.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364217+0000", 2023-09-30T17:03:16.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00056263199999999998 2023-09-30T17:03:16.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:16.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364222+0000", 2023-09-30T17:03:16.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.242e-06 2023-09-30T17:03:16.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:16.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364308+0000", 2023-09-30T17:03:16.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6397999999999995e-05 2023-09-30T17:03:16.298 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:16.298 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:16.298 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:16.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.298 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2023-09-30T17:03:16.298 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:03:16.298 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 57.838924233, 2023-09-30T17:03:16.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000359561, 2023-09-30T17:03:16.299 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:16.299 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2023-09-30T17:03:16.299 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:16.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.299 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:16.299 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:03:16.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:16.299 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.299 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:16.299 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:03:16.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:16.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.300 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:16.300 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:03:16.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1e-07 2023-09-30T17:03:16.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.300 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:16.300 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373228+0000", 2023-09-30T17:03:16.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9420000000000002e-06 2023-09-30T17:03:16.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:16.301 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373235+0000", 2023-09-30T17:03:16.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4230000000000002e-06 2023-09-30T17:03:16.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:16.301 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373239+0000", 2023-09-30T17:03:16.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6809999999999997e-06 2023-09-30T17:03:16.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:16.302 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373518+0000", 2023-09-30T17:03:16.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000278311 2023-09-30T17:03:16.302 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:16.302 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373586+0000", 2023-09-30T17:03:16.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7994e-05 2023-09-30T17:03:16.302 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:16.302 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:16.303 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:16.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.303 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:03:16.303 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:03:16.303 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 57.834498160000003, 2023-09-30T17:03:16.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0046632949999999996, 2023-09-30T17:03:16.303 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:16.303 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:16.303 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:16.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.304 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:16.304 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:03:16.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:16.304 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.304 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:16.304 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:03:16.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:16.304 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.304 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:16.304 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377653+0000", 2023-09-30T17:03:16.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7800000000000002e-07 2023-09-30T17:03:16.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.305 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:16.305 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377657+0000", 2023-09-30T17:03:16.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5859999999999998e-06 2023-09-30T17:03:16.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.305 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:16.305 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377677+0000", 2023-09-30T17:03:16.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9508999999999999e-05 2023-09-30T17:03:16.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:16.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377682+0000", 2023-09-30T17:03:16.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8300000000000001e-06 2023-09-30T17:03:16.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:16.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377725+0000", 2023-09-30T17:03:16.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2425000000000001e-05 2023-09-30T17:03:16.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:16.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377738+0000", 2023-09-30T17:03:16.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2899e-05 2023-09-30T17:03:16.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:16.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382268+0000", 2023-09-30T17:03:16.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045301289999999999 2023-09-30T17:03:16.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:16.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382315+0000", 2023-09-30T17:03:16.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7539e-05 2023-09-30T17:03:16.308 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:16.308 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:16.308 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:16.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.308 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-09-30T17:03:16.308 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:03:16.308 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 57.834048709000001, 2023-09-30T17:03:16.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042540670000000003, 2023-09-30T17:03:16.308 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:16.308 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:16.308 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:16.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:16.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:03:16.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:16.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:16.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:03:16.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:16.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.310 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:16.310 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:03:16.310 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0299999999999998e-07 2023-09-30T17:03:16.310 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.310 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.310 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:16.310 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378107+0000", 2023-09-30T17:03:16.310 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9250000000000003e-06 2023-09-30T17:03:16.310 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.310 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.310 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:16.310 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378116+0000", 2023-09-30T17:03:16.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.037e-06 2023-09-30T17:03:16.311 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.311 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:16.311 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378123+0000", 2023-09-30T17:03:16.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1879999999999996e-06 2023-09-30T17:03:16.311 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.311 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:16.311 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378174+0000", 2023-09-30T17:03:16.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0998000000000002e-05 2023-09-30T17:03:16.311 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:16.312 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378197+0000", 2023-09-30T17:03:16.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2558e-05 2023-09-30T17:03:16.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:16.312 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382319+0000", 2023-09-30T17:03:16.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041220950000000001 2023-09-30T17:03:16.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:16.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382356+0000", 2023-09-30T17:03:16.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6563000000000002e-05 2023-09-30T17:03:16.313 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:16.313 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:16.313 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:16.313 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.313 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-09-30T17:03:16.313 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:03:16.313 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 53.776284885000003, 2023-09-30T17:03:16.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00171641, 2023-09-30T17:03:16.314 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:16.314 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:16.314 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:16.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:16.314 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:03:16.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:16.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:16.314 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:03:16.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:16.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.315 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:16.315 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435868+0000", 2023-09-30T17:03:16.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5840000000000002e-06 2023-09-30T17:03:16.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.315 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:16.315 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435892+0000", 2023-09-30T17:03:16.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3625000000000002e-05 2023-09-30T17:03:16.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:16.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435908+0000", 2023-09-30T17:03:16.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6548000000000001e-05 2023-09-30T17:03:16.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:16.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435935+0000", 2023-09-30T17:03:16.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6516000000000002e-05 2023-09-30T17:03:16.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:16.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435996+0000", 2023-09-30T17:03:16.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1433999999999995e-05 2023-09-30T17:03:16.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.317 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:16.317 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436114+0000", 2023-09-30T17:03:16.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000118344 2023-09-30T17:03:16.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.317 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:16.317 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436219+0000", 2023-09-30T17:03:16.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010453100000000001 2023-09-30T17:03:16.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:16.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436900+0000", 2023-09-30T17:03:16.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00068121299999999996 2023-09-30T17:03:16.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:16.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437508+0000", 2023-09-30T17:03:16.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00060817399999999995 2023-09-30T17:03:16.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:16.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437554+0000", 2023-09-30T17:03:16.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5609000000000003e-05 2023-09-30T17:03:16.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:16.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437582+0000", 2023-09-30T17:03:16.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7832000000000001e-05 2023-09-30T17:03:16.319 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:16.319 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:16.319 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:16.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.320 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2023-09-30T17:03:16.320 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:03:16.320 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 33.775973391000001, 2023-09-30T17:03:16.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001456199, 2023-09-30T17:03:16.320 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:16.320 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:16.320 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:16.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:16.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:03:16.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:16.321 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.321 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:16.321 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:03:16.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:16.321 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.321 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:16.321 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436178+0000", 2023-09-30T17:03:16.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.494e-06 2023-09-30T17:03:16.321 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:16.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436184+0000", 2023-09-30T17:03:16.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2809999999999999e-06 2023-09-30T17:03:16.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:16.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436198+0000", 2023-09-30T17:03:16.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3978000000000001e-05 2023-09-30T17:03:16.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:16.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436206+0000", 2023-09-30T17:03:16.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8040000000000007e-06 2023-09-30T17:03:16.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:16.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436268+0000", 2023-09-30T17:03:16.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1484999999999998e-05 2023-09-30T17:03:16.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:16.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436339+0000", 2023-09-30T17:03:16.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1000000000000005e-05 2023-09-30T17:03:16.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:16.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436438+0000", 2023-09-30T17:03:16.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9389000000000007e-05 2023-09-30T17:03:16.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:16.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436986+0000", 2023-09-30T17:03:16.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054723399999999996 2023-09-30T17:03:16.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.326 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:16.326 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437566+0000", 2023-09-30T17:03:16.326 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00058017599999999996 2023-09-30T17:03:16.326 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.326 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:16.326 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437606+0000", 2023-09-30T17:03:16.326 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9891999999999997e-05 2023-09-30T17:03:16.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:16.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:16.327 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:16.327 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437633+0000", 2023-09-30T17:03:16.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7466000000000001e-05 2023-09-30T17:03:16.327 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:16.327 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:16.327 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:16.327 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:16.327 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:16.328 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:16.328 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-09-30T17:03:16.329 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:16.329+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:16.330 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:03:16.429 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:16.429+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:16.476 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:16.476 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:03:16.476 INFO:teuthology.orchestra.run.smithi031.stdout: "num_ops": 0 2023-09-30T17:03:16.476 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:16.487 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:03:16.569 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:16.569+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:16.631 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:16.631+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:16.659 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:16.659 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:03:16.659 INFO:teuthology.orchestra.run.smithi031.stdout: "complaint_time": 30, 2023-09-30T17:03:16.659 INFO:teuthology.orchestra.run.smithi031.stdout: "num_blocked_ops": 0 2023-09-30T17:03:16.659 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:16.670 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:03:16.732 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:16.732+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:16.831 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~29s 2023-09-30T17:03:16.832 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:16.832+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:16.844 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:16.844 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 20, 2023-09-30T17:03:16.844 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 600, 2023-09-30T17:03:16.844 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:03:16.844 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.844 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:32 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'18, mlcod=11'14)", 2023-09-30T17:03:16.844 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:03:16.845 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 69.481702424999995, 2023-09-30T17:03:16.845 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051629809999999996, 2023-09-30T17:03:16.845 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:16.845 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:16.845 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:16.845 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.845 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:16.845 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:03:16.845 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:16.845 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.845 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.845 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:16.846 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:03:16.846 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:16.846 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.846 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.846 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:16.846 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:03:16.846 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2099999999999996e-07 2023-09-30T17:03:16.846 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.846 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.846 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:16.846 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361407+0000", 2023-09-30T17:03:16.847 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7499e-05 2023-09-30T17:03:16.847 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.847 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.847 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:16.847 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361418+0000", 2023-09-30T17:03:16.847 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1127999999999999e-05 2023-09-30T17:03:16.847 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.847 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.847 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:16.847 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361423+0000", 2023-09-30T17:03:16.847 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1930000000000001e-06 2023-09-30T17:03:16.847 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.847 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.848 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:16.848 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361476+0000", 2023-09-30T17:03:16.848 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3399000000000002e-05 2023-09-30T17:03:16.848 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.848 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.848 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:16.848 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361496+0000", 2023-09-30T17:03:16.848 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9638000000000001e-05 2023-09-30T17:03:16.848 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.848 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.848 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:16.849 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.366474+0000", 2023-09-30T17:03:16.849 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0049778829999999998 2023-09-30T17:03:16.849 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.849 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.849 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:16.849 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.366512+0000", 2023-09-30T17:03:16.849 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7620000000000002e-05 2023-09-30T17:03:16.849 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:16.849 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:16.849 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:16.849 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.849 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.849 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:37 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'23, mlcod=11'15)", 2023-09-30T17:03:16.850 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:03:16.850 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 69.479100427999995, 2023-09-30T17:03:16.850 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053985689999999998, 2023-09-30T17:03:16.850 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:16.850 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:16.850 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:16.850 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.850 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:16.850 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:03:16.850 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:16.850 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.850 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.851 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:16.851 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:03:16.851 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:16.851 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.851 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.851 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:16.851 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:03:16.851 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4400000000000001e-07 2023-09-30T17:03:16.851 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.851 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.851 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:16.851 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363956+0000", 2023-09-30T17:03:16.852 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.921e-06 2023-09-30T17:03:16.852 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.852 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.852 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:16.852 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363966+0000", 2023-09-30T17:03:16.852 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0351e-05 2023-09-30T17:03:16.852 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.852 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.852 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:16.852 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363971+0000", 2023-09-30T17:03:16.852 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.023e-06 2023-09-30T17:03:16.852 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.853 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.853 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:16.853 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.364013+0000", 2023-09-30T17:03:16.853 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1575000000000001e-05 2023-09-30T17:03:16.853 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.853 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.853 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:16.853 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.364026+0000", 2023-09-30T17:03:16.853 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3044000000000001e-05 2023-09-30T17:03:16.853 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.853 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.853 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:16.854 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.369308+0000", 2023-09-30T17:03:16.854 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005282152 2023-09-30T17:03:16.854 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.854 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.854 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:16.854 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.369349+0000", 2023-09-30T17:03:16.854 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1059000000000001e-05 2023-09-30T17:03:16.854 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:16.854 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:16.854 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:16.854 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.854 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.855 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:155 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'109, mlcod=11'105)", 2023-09-30T17:03:16.855 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:03:16.855 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 68.997404742000001, 2023-09-30T17:03:16.855 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053867639999999996, 2023-09-30T17:03:16.855 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:16.855 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:16.855 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:16.855 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.855 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:16.855 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:03:16.855 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:16.855 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.856 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.856 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:16.856 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:03:16.856 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:16.856 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.856 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.856 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:16.856 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845647+0000", 2023-09-30T17:03:16.856 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7599999999999997e-07 2023-09-30T17:03:16.856 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.856 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.856 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:16.857 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845699+0000", 2023-09-30T17:03:16.857 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1758000000000001e-05 2023-09-30T17:03:16.857 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.857 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.857 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:16.857 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845708+0000", 2023-09-30T17:03:16.857 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2159999999999995e-06 2023-09-30T17:03:16.857 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.857 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.857 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:16.857 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845712+0000", 2023-09-30T17:03:16.857 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2579999999999997e-06 2023-09-30T17:03:16.857 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.858 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.858 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:16.858 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845756+0000", 2023-09-30T17:03:16.858 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4119999999999998e-05 2023-09-30T17:03:16.858 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.858 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.858 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:16.858 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845779+0000", 2023-09-30T17:03:16.858 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2311e-05 2023-09-30T17:03:16.858 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.858 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.858 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:16.859 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.850982+0000", 2023-09-30T17:03:16.859 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005203053 2023-09-30T17:03:16.859 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.859 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.859 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:16.859 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851033+0000", 2023-09-30T17:03:16.859 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1471999999999998e-05 2023-09-30T17:03:16.859 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:16.859 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:16.859 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:16.859 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.859 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.860 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:156 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'110, mlcod=11'105)", 2023-09-30T17:03:16.860 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:03:16.860 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 68.996871815999995, 2023-09-30T17:03:16.860 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0052834759999999996, 2023-09-30T17:03:16.860 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:16.860 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:16.860 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:16.860 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.860 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:16.860 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:03:16.860 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:16.860 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.861 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.861 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:16.861 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:03:16.861 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:16.861 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.861 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.861 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:16.861 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846180+0000", 2023-09-30T17:03:16.861 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6300000000000005e-07 2023-09-30T17:03:16.861 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.861 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.861 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:16.862 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846184+0000", 2023-09-30T17:03:16.862 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3789999999999999e-06 2023-09-30T17:03:16.862 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.862 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.862 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:16.862 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846195+0000", 2023-09-30T17:03:16.862 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0778000000000001e-05 2023-09-30T17:03:16.862 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.862 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.862 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:16.862 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846200+0000", 2023-09-30T17:03:16.862 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1540000000000001e-06 2023-09-30T17:03:16.863 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.863 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.863 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:16.863 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846274+0000", 2023-09-30T17:03:16.863 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4129999999999997e-05 2023-09-30T17:03:16.863 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.863 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.863 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:16.863 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846286+0000", 2023-09-30T17:03:16.863 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1744e-05 2023-09-30T17:03:16.863 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.863 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.864 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:16.864 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851432+0000", 2023-09-30T17:03:16.864 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051462110000000004 2023-09-30T17:03:16.864 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.864 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.864 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:16.864 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851463+0000", 2023-09-30T17:03:16.864 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0516999999999999e-05 2023-09-30T17:03:16.864 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:16.864 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:16.864 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:16.864 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.865 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.865 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:203 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'149, mlcod=11'145)", 2023-09-30T17:03:16.865 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:03:16.865 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 68.640835906999996, 2023-09-30T17:03:16.865 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051867459999999999, 2023-09-30T17:03:16.865 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:16.865 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:16.865 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:16.865 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.865 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:16.865 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:03:16.865 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:16.865 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.866 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.866 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:16.866 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:03:16.866 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:16.866 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.866 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.866 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:16.866 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202216+0000", 2023-09-30T17:03:16.866 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7e-07 2023-09-30T17:03:16.866 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.866 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.866 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:16.867 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202271+0000", 2023-09-30T17:03:16.867 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5163e-05 2023-09-30T17:03:16.867 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.867 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.867 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:16.867 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202282+0000", 2023-09-30T17:03:16.867 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1319e-05 2023-09-30T17:03:16.867 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.867 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.867 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:16.867 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202288+0000", 2023-09-30T17:03:16.867 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2899999999999999e-06 2023-09-30T17:03:16.868 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.868 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.868 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:16.868 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202331+0000", 2023-09-30T17:03:16.868 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2147999999999997e-05 2023-09-30T17:03:16.868 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.868 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.868 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:16.868 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202348+0000", 2023-09-30T17:03:16.868 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7317e-05 2023-09-30T17:03:16.868 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.868 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.869 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:16.869 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.207357+0000", 2023-09-30T17:03:16.869 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0050095440000000003 2023-09-30T17:03:16.869 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.869 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.869 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:16.869 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.207402+0000", 2023-09-30T17:03:16.869 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4495e-05 2023-09-30T17:03:16.869 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:16.869 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:16.869 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:16.869 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.870 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.870 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:16.870 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:03:16.870 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 58.491505619000002, 2023-09-30T17:03:16.870 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.025313649000000001, 2023-09-30T17:03:16.870 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:16.870 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:16.870 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:16.870 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.870 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:16.870 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:03:16.870 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:16.871 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.871 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.871 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:16.871 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:03:16.871 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:16.871 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.871 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.871 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:16.871 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351551+0000", 2023-09-30T17:03:16.871 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3380000000000004e-06 2023-09-30T17:03:16.871 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.871 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.872 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:16.872 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351559+0000", 2023-09-30T17:03:16.872 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9589999999999995e-06 2023-09-30T17:03:16.872 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.872 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.872 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:16.872 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351571+0000", 2023-09-30T17:03:16.872 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2065999999999999e-05 2023-09-30T17:03:16.872 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.872 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.872 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:16.872 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351706+0000", 2023-09-30T17:03:16.872 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00013553799999999999 2023-09-30T17:03:16.873 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.873 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.873 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:16.873 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353016+0000", 2023-09-30T17:03:16.873 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0013099209999999999 2023-09-30T17:03:16.873 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.873 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.873 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:16.873 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353023+0000", 2023-09-30T17:03:16.873 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2479999999999999e-06 2023-09-30T17:03:16.873 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.874 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.874 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:16.874 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360348+0000", 2023-09-30T17:03:16.874 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0073248949999999997 2023-09-30T17:03:16.874 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.874 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.874 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:16.874 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360787+0000", 2023-09-30T17:03:16.874 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00043875199999999999 2023-09-30T17:03:16.874 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.874 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.874 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:16.875 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360892+0000", 2023-09-30T17:03:16.875 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010508199999999999 2023-09-30T17:03:16.875 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.875 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.875 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:16.875 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365132+0000", 2023-09-30T17:03:16.875 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0042396480000000004 2023-09-30T17:03:16.875 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.875 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.875 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:16.875 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376746+0000", 2023-09-30T17:03:16.875 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011614157 2023-09-30T17:03:16.876 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.876 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.876 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:16.876 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376811+0000", 2023-09-30T17:03:16.876 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5005999999999994e-05 2023-09-30T17:03:16.876 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.876 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.876 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:16.876 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376859+0000", 2023-09-30T17:03:16.876 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8038999999999999e-05 2023-09-30T17:03:16.876 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:16.876 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:16.877 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:16.877 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.877 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.877 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:16.877 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:03:16.877 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 58.49100782, 2023-09-30T17:03:16.877 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024923989000000001, 2023-09-30T17:03:16.877 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:16.877 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:16.877 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:16.877 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.877 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:16.877 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:03:16.878 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:16.878 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.878 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.878 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:16.878 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:03:16.878 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:16.878 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.878 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.878 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:16.878 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352044+0000", 2023-09-30T17:03:16.878 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9199999999999999e-07 2023-09-30T17:03:16.878 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.879 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.879 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:16.879 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352050+0000", 2023-09-30T17:03:16.879 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8880000000000002e-06 2023-09-30T17:03:16.879 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.879 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.879 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:16.879 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352143+0000", 2023-09-30T17:03:16.879 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2721999999999998e-05 2023-09-30T17:03:16.879 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.879 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.879 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:16.880 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352155+0000", 2023-09-30T17:03:16.880 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2279000000000001e-05 2023-09-30T17:03:16.880 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.880 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.880 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:16.880 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353114+0000", 2023-09-30T17:03:16.880 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00095943700000000005 2023-09-30T17:03:16.880 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.880 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.880 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:16.880 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353121+0000", 2023-09-30T17:03:16.880 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.494e-06 2023-09-30T17:03:16.881 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.881 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.881 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:16.881 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361491+0000", 2023-09-30T17:03:16.881 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0083697359999999991 2023-09-30T17:03:16.881 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.881 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.881 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:16.881 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361573+0000", 2023-09-30T17:03:16.881 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2822000000000001e-05 2023-09-30T17:03:16.881 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.881 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.882 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:16.882 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362166+0000", 2023-09-30T17:03:16.882 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00059223299999999995 2023-09-30T17:03:16.882 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.882 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.882 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:16.882 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365209+0000", 2023-09-30T17:03:16.882 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.003043212 2023-09-30T17:03:16.882 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.882 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.882 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:16.882 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376910+0000", 2023-09-30T17:03:16.883 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011700898 2023-09-30T17:03:16.883 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.883 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.883 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:16.883 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376945+0000", 2023-09-30T17:03:16.883 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4795000000000001e-05 2023-09-30T17:03:16.883 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.883 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.883 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:16.883 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376967+0000", 2023-09-30T17:03:16.883 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2580999999999999e-05 2023-09-30T17:03:16.883 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:16.884 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:16.884 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:16.884 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.884 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.884 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:16.884 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:03:16.884 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 58.490837900000002, 2023-09-30T17:03:16.884 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023120405, 2023-09-30T17:03:16.884 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:16.884 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:16.884 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:16.884 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.885 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:16.885 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:03:16.885 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:16.885 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.885 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.885 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:16.885 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:03:16.885 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:16.885 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.885 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.885 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:16.885 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352214+0000", 2023-09-30T17:03:16.886 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8400000000000003e-07 2023-09-30T17:03:16.886 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.886 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.886 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:16.886 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352233+0000", 2023-09-30T17:03:16.886 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8946000000000001e-05 2023-09-30T17:03:16.886 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.886 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.886 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:16.886 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352297+0000", 2023-09-30T17:03:16.886 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3540999999999994e-05 2023-09-30T17:03:16.886 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.887 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.887 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:16.887 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352450+0000", 2023-09-30T17:03:16.887 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015364799999999999 2023-09-30T17:03:16.887 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.887 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.887 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:16.887 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353098+0000", 2023-09-30T17:03:16.887 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00064820299999999997 2023-09-30T17:03:16.887 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.887 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.887 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:16.888 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353103+0000", 2023-09-30T17:03:16.888 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0529999999999997e-06 2023-09-30T17:03:16.888 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.888 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.888 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:16.888 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.358558+0000", 2023-09-30T17:03:16.888 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0054550249999999996 2023-09-30T17:03:16.888 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.888 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.888 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:16.888 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.358741+0000", 2023-09-30T17:03:16.888 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00018210200000000001 2023-09-30T17:03:16.889 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.889 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.889 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:16.889 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.359683+0000", 2023-09-30T17:03:16.889 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00094202299999999995 2023-09-30T17:03:16.889 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.889 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.889 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:16.889 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365044+0000", 2023-09-30T17:03:16.889 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053616219999999999 2023-09-30T17:03:16.889 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.889 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.889 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:16.890 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375256+0000", 2023-09-30T17:03:16.890 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010212156 2023-09-30T17:03:16.890 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.890 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.890 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:16.890 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375300+0000", 2023-09-30T17:03:16.890 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3961999999999997e-05 2023-09-30T17:03:16.890 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.890 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.890 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:16.890 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375334+0000", 2023-09-30T17:03:16.890 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.324e-05 2023-09-30T17:03:16.891 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:16.891 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:16.891 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:16.891 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.891 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.891 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:16.891 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:03:16.891 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 58.490522882, 2023-09-30T17:03:16.891 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024240660000000001, 2023-09-30T17:03:16.891 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:16.891 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:16.892 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:16.892 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.892 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:16.892 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:03:16.892 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:16.892 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.892 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.892 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:16.892 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:03:16.892 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:16.892 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.892 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.893 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:16.893 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352529+0000", 2023-09-30T17:03:16.893 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1379999999999999e-06 2023-09-30T17:03:16.893 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.893 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.893 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:16.893 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352536+0000", 2023-09-30T17:03:16.893 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3489999999999997e-06 2023-09-30T17:03:16.893 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.893 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.893 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:16.893 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352547+0000", 2023-09-30T17:03:16.893 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1109e-05 2023-09-30T17:03:16.894 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.894 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.894 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:16.894 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352560+0000", 2023-09-30T17:03:16.894 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3046e-05 2023-09-30T17:03:16.894 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.894 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.894 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:16.894 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353142+0000", 2023-09-30T17:03:16.894 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00058174699999999997 2023-09-30T17:03:16.894 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.895 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.895 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:16.895 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353147+0000", 2023-09-30T17:03:16.895 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5840000000000002e-06 2023-09-30T17:03:16.895 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.895 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.895 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:16.895 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360374+0000", 2023-09-30T17:03:16.895 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0072270049999999999 2023-09-30T17:03:16.895 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.895 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.896 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:16.896 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360795+0000", 2023-09-30T17:03:16.896 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00042088999999999999 2023-09-30T17:03:16.896 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.896 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.896 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:16.896 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360967+0000", 2023-09-30T17:03:16.896 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017235699999999999 2023-09-30T17:03:16.896 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.896 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.896 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:16.896 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365051+0000", 2023-09-30T17:03:16.896 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0040837429999999999 2023-09-30T17:03:16.897 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.897 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.897 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:16.897 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376708+0000", 2023-09-30T17:03:16.897 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011656866 2023-09-30T17:03:16.897 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.897 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.897 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:16.897 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376745+0000", 2023-09-30T17:03:16.897 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6769e-05 2023-09-30T17:03:16.897 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.897 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.898 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:16.898 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376769+0000", 2023-09-30T17:03:16.898 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4057e-05 2023-09-30T17:03:16.898 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:16.898 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:16.898 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:16.898 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.898 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.898 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:16.898 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:16.898 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 58.490263527000003, 2023-09-30T17:03:16.899 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023472704, 2023-09-30T17:03:16.899 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:16.899 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:16.899 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:16.899 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.899 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:16.899 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:16.899 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:16.899 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.899 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.899 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:16.899 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:16.900 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:16.900 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.900 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.900 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:16.900 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:16.900 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8000000000000005e-07 2023-09-30T17:03:16.900 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.900 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.900 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:16.900 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352794+0000", 2023-09-30T17:03:16.900 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.789e-06 2023-09-30T17:03:16.900 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.901 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.901 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:16.901 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352805+0000", 2023-09-30T17:03:16.901 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0848e-05 2023-09-30T17:03:16.901 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.901 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.901 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:16.901 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352812+0000", 2023-09-30T17:03:16.901 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4449999999999999e-06 2023-09-30T17:03:16.901 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.901 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.901 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:16.901 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353063+0000", 2023-09-30T17:03:16.902 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00025046299999999998 2023-09-30T17:03:16.902 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.902 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.902 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:16.902 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353071+0000", 2023-09-30T17:03:16.902 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6739999999999997e-06 2023-09-30T17:03:16.902 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.902 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.902 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:16.902 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361696+0000", 2023-09-30T17:03:16.902 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0086251609999999992 2023-09-30T17:03:16.902 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.903 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.903 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:16.903 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362284+0000", 2023-09-30T17:03:16.903 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00058872299999999998 2023-09-30T17:03:16.903 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.903 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.903 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:16.903 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362429+0000", 2023-09-30T17:03:16.903 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014509000000000001 2023-09-30T17:03:16.903 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.903 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.903 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:16.904 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365330+0000", 2023-09-30T17:03:16.904 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0029005419999999999 2023-09-30T17:03:16.904 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.904 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.904 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:16.904 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376196+0000", 2023-09-30T17:03:16.904 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.01086615 2023-09-30T17:03:16.904 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.904 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.904 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:16.904 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376230+0000", 2023-09-30T17:03:16.904 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3858e-05 2023-09-30T17:03:16.905 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.905 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.905 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:16.905 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376260+0000", 2023-09-30T17:03:16.905 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0181000000000001e-05 2023-09-30T17:03:16.905 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:16.905 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:16.905 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:16.905 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.905 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.905 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:16.906 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:03:16.906 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 58.490029956999997, 2023-09-30T17:03:16.906 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023406132999999999, 2023-09-30T17:03:16.906 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:16.906 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:16.906 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:16.906 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.906 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:16.906 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:03:16.906 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:16.906 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.906 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.907 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:16.907 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:03:16.907 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:16.907 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.907 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.907 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:16.907 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353022+0000", 2023-09-30T17:03:16.907 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.78e-07 2023-09-30T17:03:16.907 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.907 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.907 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:16.907 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353027+0000", 2023-09-30T17:03:16.908 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9089999999999999e-06 2023-09-30T17:03:16.908 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.908 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.908 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:16.908 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353035+0000", 2023-09-30T17:03:16.908 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0430000000000008e-06 2023-09-30T17:03:16.908 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.908 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.908 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:16.908 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353047+0000", 2023-09-30T17:03:16.908 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1674e-05 2023-09-30T17:03:16.908 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.909 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.909 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:16.909 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353105+0000", 2023-09-30T17:03:16.909 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8891999999999998e-05 2023-09-30T17:03:16.909 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.909 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.909 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:16.909 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353112+0000", 2023-09-30T17:03:16.909 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7059999999999998e-06 2023-09-30T17:03:16.909 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.909 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.909 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:16.910 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362733+0000", 2023-09-30T17:03:16.910 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0096205869999999999 2023-09-30T17:03:16.910 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.910 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.910 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:16.910 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362833+0000", 2023-09-30T17:03:16.910 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000100227 2023-09-30T17:03:16.910 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.910 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.910 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:16.910 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363000+0000", 2023-09-30T17:03:16.910 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016670899999999999 2023-09-30T17:03:16.911 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.911 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.911 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:16.911 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365550+0000", 2023-09-30T17:03:16.911 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0025499199999999998 2023-09-30T17:03:16.911 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.911 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.911 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:16.911 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376315+0000", 2023-09-30T17:03:16.911 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010765011999999999 2023-09-30T17:03:16.911 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.911 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.912 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:16.912 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376386+0000", 2023-09-30T17:03:16.912 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0866999999999998e-05 2023-09-30T17:03:16.912 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.912 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.912 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:16.912 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376427+0000", 2023-09-30T17:03:16.912 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1709000000000003e-05 2023-09-30T17:03:16.912 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:16.912 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:16.912 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:16.912 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.912 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.913 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:16.913 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:16.913 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 58.489989321000003, 2023-09-30T17:03:16.913 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024076238, 2023-09-30T17:03:16.913 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:16.913 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:16.913 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:16.913 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.913 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:16.913 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:16.913 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:16.913 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.914 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.914 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:16.914 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:16.914 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:16.914 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.914 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.914 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:16.914 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:16.914 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8699999999999995e-07 2023-09-30T17:03:16.914 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.914 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.914 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:16.915 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353067+0000", 2023-09-30T17:03:16.915 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.605e-06 2023-09-30T17:03:16.915 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.915 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.915 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:16.915 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353073+0000", 2023-09-30T17:03:16.915 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8900000000000004e-06 2023-09-30T17:03:16.915 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.915 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.915 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:16.915 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353083+0000", 2023-09-30T17:03:16.915 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0200000000000001e-05 2023-09-30T17:03:16.915 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.916 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.916 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:16.916 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353186+0000", 2023-09-30T17:03:16.916 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010256599999999999 2023-09-30T17:03:16.916 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.916 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.916 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:16.916 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353190+0000", 2023-09-30T17:03:16.916 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9709999999999998e-06 2023-09-30T17:03:16.916 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.916 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.916 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:16.917 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362946+0000", 2023-09-30T17:03:16.917 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0097563330000000007 2023-09-30T17:03:16.917 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.917 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.917 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:16.917 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363088+0000", 2023-09-30T17:03:16.917 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014259200000000001 2023-09-30T17:03:16.917 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.917 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.917 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:16.917 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363555+0000", 2023-09-30T17:03:16.917 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00046627799999999998 2023-09-30T17:03:16.918 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.918 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.918 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:16.918 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365871+0000", 2023-09-30T17:03:16.918 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0023167589999999998 2023-09-30T17:03:16.918 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.918 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.918 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:16.918 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377033+0000", 2023-09-30T17:03:16.918 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011161203999999999 2023-09-30T17:03:16.918 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.918 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.919 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:16.919 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377100+0000", 2023-09-30T17:03:16.919 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7230999999999994e-05 2023-09-30T17:03:16.919 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.919 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.919 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:16.919 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377138+0000", 2023-09-30T17:03:16.919 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8022000000000003e-05 2023-09-30T17:03:16.919 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:16.919 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:16.919 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:16.919 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.920 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.920 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:16.920 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:03:16.920 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 58.489888372000003, 2023-09-30T17:03:16.920 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.020304412000000001, 2023-09-30T17:03:16.920 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:16.920 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:16.920 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:16.920 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.920 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:16.920 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:03:16.920 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:16.920 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.921 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.921 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:16.921 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:03:16.921 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:16.921 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.921 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.921 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:16.921 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353164+0000", 2023-09-30T17:03:16.921 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7100000000000011e-07 2023-09-30T17:03:16.921 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.921 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.921 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:16.922 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353168+0000", 2023-09-30T17:03:16.922 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0600000000000001e-06 2023-09-30T17:03:16.922 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.922 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.922 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:16.922 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353177+0000", 2023-09-30T17:03:16.922 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1409999999999994e-06 2023-09-30T17:03:16.922 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.922 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.922 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:16.922 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353185+0000", 2023-09-30T17:03:16.922 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2479999999999996e-06 2023-09-30T17:03:16.923 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.923 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.923 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:16.923 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353246+0000", 2023-09-30T17:03:16.923 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0519000000000001e-05 2023-09-30T17:03:16.923 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.923 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.923 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:16.923 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353252+0000", 2023-09-30T17:03:16.923 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7859999999999999e-06 2023-09-30T17:03:16.923 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.923 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.924 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:16.924 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354979+0000", 2023-09-30T17:03:16.924 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0017270090000000001 2023-09-30T17:03:16.924 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.924 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.924 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:16.924 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355097+0000", 2023-09-30T17:03:16.924 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000117472 2023-09-30T17:03:16.924 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.924 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.924 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:16.924 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.373467+0000", 2023-09-30T17:03:16.925 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.018370206 2023-09-30T17:03:16.925 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:16.925 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:16.925 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:16.925 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.925 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.925 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:16.925 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:03:16.925 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 58.489847634, 2023-09-30T17:03:16.925 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.012725089, 2023-09-30T17:03:16.925 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:16.925 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:16.926 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:16.926 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.926 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:16.926 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:03:16.926 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:16.926 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.926 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.926 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:16.926 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:03:16.926 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:16.926 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.926 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.927 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:16.927 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353204+0000", 2023-09-30T17:03:16.927 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7100000000000002e-07 2023-09-30T17:03:16.927 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.927 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.927 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:16.927 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353213+0000", 2023-09-30T17:03:16.927 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8580000000000006e-06 2023-09-30T17:03:16.927 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.927 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.927 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:16.927 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353219+0000", 2023-09-30T17:03:16.928 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8939999999999998e-06 2023-09-30T17:03:16.928 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.928 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.928 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:16.928 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353223+0000", 2023-09-30T17:03:16.928 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.357e-06 2023-09-30T17:03:16.928 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.928 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.928 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:16.928 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353278+0000", 2023-09-30T17:03:16.928 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5228e-05 2023-09-30T17:03:16.928 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.929 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.929 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:16.929 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353284+0000", 2023-09-30T17:03:16.929 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8209999999999998e-06 2023-09-30T17:03:16.929 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.929 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.929 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:16.929 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355095+0000", 2023-09-30T17:03:16.929 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001811404 2023-09-30T17:03:16.929 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.929 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.930 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:16.930 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355256+0000", 2023-09-30T17:03:16.930 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000160898 2023-09-30T17:03:16.930 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.930 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.930 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:16.930 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365928+0000", 2023-09-30T17:03:16.930 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010672157999999999 2023-09-30T17:03:16.930 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:16.930 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:16.930 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:16.931 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.931 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.931 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-09-30T17:03:16.931 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:03:16.931 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 58.489316426999999, 2023-09-30T17:03:16.931 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0056863460000000001, 2023-09-30T17:03:16.931 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:16.931 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "reached pg", 2023-09-30T17:03:16.931 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:16.931 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.932 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:16.932 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:03:16.932 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:16.932 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.932 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.932 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:16.932 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:03:16.932 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:16.932 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.932 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.933 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:16.933 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:03:16.933 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5700000000000002e-07 2023-09-30T17:03:16.933 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.933 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.933 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:16.933 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353747+0000", 2023-09-30T17:03:16.933 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1899000000000001e-05 2023-09-30T17:03:16.933 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.933 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.933 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:16.933 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353776+0000", 2023-09-30T17:03:16.934 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.8767000000000001e-05 2023-09-30T17:03:16.934 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.934 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.934 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:16.934 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353792+0000", 2023-09-30T17:03:16.934 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5914999999999999e-05 2023-09-30T17:03:16.934 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.934 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.934 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:16.934 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353900+0000", 2023-09-30T17:03:16.934 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010774500000000001 2023-09-30T17:03:16.935 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.935 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.935 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:16.935 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.359421+0000", 2023-09-30T17:03:16.935 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0055213629999999996 2023-09-30T17:03:16.935 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:16.935 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:16.935 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:16.935 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.935 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.935 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:03:16.936 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:03:16.936 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 58.488644827000002, 2023-09-30T17:03:16.936 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0069196370000000002, 2023-09-30T17:03:16.936 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:16.936 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:16.936 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:16.936 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.936 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:16.936 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:03:16.936 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:16.936 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.937 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.937 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:16.937 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:03:16.937 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:16.937 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.937 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.937 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:16.937 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354407+0000", 2023-09-30T17:03:16.937 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7400000000000002e-07 2023-09-30T17:03:16.937 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.937 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.938 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:16.938 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354414+0000", 2023-09-30T17:03:16.938 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1040000000000001e-06 2023-09-30T17:03:16.938 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.938 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.938 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:16.938 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354425+0000", 2023-09-30T17:03:16.938 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1090000000000001e-05 2023-09-30T17:03:16.938 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.938 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.938 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:16.939 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354435+0000", 2023-09-30T17:03:16.939 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8169999999999994e-06 2023-09-30T17:03:16.939 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.939 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.939 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:16.939 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355741+0000", 2023-09-30T17:03:16.939 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0013063160000000001 2023-09-30T17:03:16.939 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.939 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.939 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:16.939 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355763+0000", 2023-09-30T17:03:16.940 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1688e-05 2023-09-30T17:03:16.940 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.940 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.940 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:16.940 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361289+0000", 2023-09-30T17:03:16.940 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0055258269999999996 2023-09-30T17:03:16.940 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.940 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.940 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:16.940 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361326+0000", 2023-09-30T17:03:16.940 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7020999999999997e-05 2023-09-30T17:03:16.941 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:16.941 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:16.941 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:16.941 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.941 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.941 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:30 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2023-09-30T17:03:16.941 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:03:16.941 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 58.487270869, 2023-09-30T17:03:16.941 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0069996629999999997, 2023-09-30T17:03:16.941 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:16.942 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:16.942 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:16.942 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.942 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:16.942 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:03:16.942 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:16.942 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.942 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.942 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:16.942 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:03:16.943 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:16.943 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.943 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.943 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:16.943 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355781+0000", 2023-09-30T17:03:16.943 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9599999999999999e-07 2023-09-30T17:03:16.943 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.943 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.943 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:16.943 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355788+0000", 2023-09-30T17:03:16.943 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8129999999999996e-06 2023-09-30T17:03:16.944 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.944 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.944 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:16.944 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355798+0000", 2023-09-30T17:03:16.944 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2909999999999996e-06 2023-09-30T17:03:16.944 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.944 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.944 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:16.944 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355807+0000", 2023-09-30T17:03:16.944 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8619999999999992e-06 2023-09-30T17:03:16.944 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.945 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.945 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:16.945 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.357264+0000", 2023-09-30T17:03:16.945 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0014578289999999999 2023-09-30T17:03:16.945 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.945 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.945 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:16.945 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.357916+0000", 2023-09-30T17:03:16.945 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00065170500000000004 2023-09-30T17:03:16.945 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.945 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.946 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:16.946 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362731+0000", 2023-09-30T17:03:16.946 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0048149849999999999 2023-09-30T17:03:16.946 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.946 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.946 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:16.946 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362780+0000", 2023-09-30T17:03:16.946 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8681999999999999e-05 2023-09-30T17:03:16.946 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:16.946 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:16.946 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:16.947 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.947 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.947 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2023-09-30T17:03:16.947 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:03:16.947 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 58.468619818000001, 2023-09-30T17:03:16.947 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005905998, 2023-09-30T17:03:16.947 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:16.947 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:16.947 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:16.947 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.947 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:16.948 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:03:16.948 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:16.948 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.948 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.948 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:16.948 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:03:16.948 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:16.948 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.948 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.948 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:16.948 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:03:16.949 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1e-07 2023-09-30T17:03:16.949 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.949 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.949 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:16.949 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374455+0000", 2023-09-30T17:03:16.949 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.3091999999999998e-05 2023-09-30T17:03:16.949 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.949 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.949 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:16.949 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374462+0000", 2023-09-30T17:03:16.949 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5170000000000002e-06 2023-09-30T17:03:16.950 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.950 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.950 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:16.950 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374469+0000", 2023-09-30T17:03:16.950 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8199999999999999e-06 2023-09-30T17:03:16.950 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.950 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.950 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:16.950 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374550+0000", 2023-09-30T17:03:16.950 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0978999999999998e-05 2023-09-30T17:03:16.950 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.951 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.951 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:16.951 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374562+0000", 2023-09-30T17:03:16.951 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2472e-05 2023-09-30T17:03:16.951 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.951 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.951 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:16.951 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380293+0000", 2023-09-30T17:03:16.951 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0057310379999999999 2023-09-30T17:03:16.951 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.952 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.952 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:16.952 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380337+0000", 2023-09-30T17:03:16.952 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3869999999999998e-05 2023-09-30T17:03:16.952 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:16.952 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:16.952 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:16.952 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.952 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.952 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2023-09-30T17:03:16.953 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:03:16.953 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 58.468433069, 2023-09-30T17:03:16.953 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0057590560000000002, 2023-09-30T17:03:16.953 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:16.953 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:16.953 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:16.953 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.953 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:16.953 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:03:16.953 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:16.954 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.954 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.954 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:16.954 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:03:16.954 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:16.954 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.954 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.954 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:16.954 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:03:16.954 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4900000000000001e-07 2023-09-30T17:03:16.955 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.955 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.955 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:16.955 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374629+0000", 2023-09-30T17:03:16.955 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1014e-05 2023-09-30T17:03:16.955 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.955 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.955 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:16.955 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374636+0000", 2023-09-30T17:03:16.955 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5889999999999999e-06 2023-09-30T17:03:16.956 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.956 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.956 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:16.956 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374642+0000", 2023-09-30T17:03:16.956 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.48e-06 2023-09-30T17:03:16.956 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.956 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.956 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:16.956 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374681+0000", 2023-09-30T17:03:16.956 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9320000000000003e-05 2023-09-30T17:03:16.956 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.957 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.957 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:16.957 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374694+0000", 2023-09-30T17:03:16.957 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3351e-05 2023-09-30T17:03:16.957 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.957 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.957 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:16.957 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380319+0000", 2023-09-30T17:03:16.957 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0056243880000000001 2023-09-30T17:03:16.957 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.957 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.958 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:16.958 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380377+0000", 2023-09-30T17:03:16.958 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8464999999999997e-05 2023-09-30T17:03:16.958 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:16.958 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:16.958 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:16.958 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.958 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.958 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=0'0)", 2023-09-30T17:03:16.959 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:03:16.959 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 58.467722158000001, 2023-09-30T17:03:16.959 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051157370000000004, 2023-09-30T17:03:16.959 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:16.959 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:16.959 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:16.959 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.959 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:16.959 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:03:16.959 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:16.959 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.959 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.960 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:16.960 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:03:16.961 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:16.961 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.961 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.961 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:16.961 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:03:16.961 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0199999999999998e-07 2023-09-30T17:03:16.961 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.961 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.962 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:16.962 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375334+0000", 2023-09-30T17:03:16.962 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8799999999999999e-06 2023-09-30T17:03:16.962 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.962 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.962 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:16.962 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375343+0000", 2023-09-30T17:03:16.962 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5490000000000006e-06 2023-09-30T17:03:16.962 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.962 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.962 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:16.962 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375350+0000", 2023-09-30T17:03:16.963 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5700000000000004e-06 2023-09-30T17:03:16.963 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.963 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.963 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:16.963 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375396+0000", 2023-09-30T17:03:16.963 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5550999999999998e-05 2023-09-30T17:03:16.963 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.963 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.963 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:16.963 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375410+0000", 2023-09-30T17:03:16.963 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4518999999999999e-05 2023-09-30T17:03:16.963 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.964 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.964 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:16.964 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380401+0000", 2023-09-30T17:03:16.964 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0049903430000000004 2023-09-30T17:03:16.964 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:16.964 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:16.964 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:16.964 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380445+0000", 2023-09-30T17:03:16.964 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4023000000000002e-05 2023-09-30T17:03:16.964 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:16.964 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:16.964 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:16.964 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:16.964 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:16.965 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:16.966 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:03:16.966 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:16.966+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:17.066 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:17.066+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:17.102 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:17.102 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:03:17.102 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2023-09-30T17:03:17.102 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:17.113 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:03:17.167 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:17.167+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:17.239 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:17.239 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:03:17.239 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2023-09-30T17:03:17.239 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2023-09-30T17:03:17.239 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:17.249 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:03:17.290 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:17.290+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:17.317 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is set 2023-09-30T17:03:17.369 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:17.370+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:17.418 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:17.419 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2023-09-30T17:03:17.419 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2023-09-30T17:03:17.419 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2023-09-30T17:03:17.419 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.419 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:17.419 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:03:17.419 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 59.065806539, 2023-09-30T17:03:17.419 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093789779999999996, 2023-09-30T17:03:17.419 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:17.419 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:17.419 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:17.420 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.420 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:17.420 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:03:17.420 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:17.420 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.420 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.420 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:17.420 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:03:17.420 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:17.420 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.420 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.421 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:17.421 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352027+0000", 2023-09-30T17:03:17.421 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0224000000000001e-05 2023-09-30T17:03:17.421 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.421 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.421 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:17.421 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352039+0000", 2023-09-30T17:03:17.421 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1569000000000001e-05 2023-09-30T17:03:17.421 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.421 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.421 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:17.421 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352052+0000", 2023-09-30T17:03:17.422 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2605999999999999e-05 2023-09-30T17:03:17.422 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.422 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.422 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:17.422 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352064+0000", 2023-09-30T17:03:17.422 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2666999999999999e-05 2023-09-30T17:03:17.422 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.422 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.422 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:17.422 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352147+0000", 2023-09-30T17:03:17.422 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3125000000000001e-05 2023-09-30T17:03:17.423 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.423 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.423 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:17.423 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352306+0000", 2023-09-30T17:03:17.423 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015881900000000001 2023-09-30T17:03:17.423 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.423 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.423 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:17.423 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352450+0000", 2023-09-30T17:03:17.423 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014420700000000001 2023-09-30T17:03:17.423 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.424 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.424 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:17.424 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355975+0000", 2023-09-30T17:03:17.424 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003524246 2023-09-30T17:03:17.424 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.424 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.424 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:17.424 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361279+0000", 2023-09-30T17:03:17.424 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005304507 2023-09-30T17:03:17.424 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.424 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.424 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:17.424 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361344+0000", 2023-09-30T17:03:17.425 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4548999999999995e-05 2023-09-30T17:03:17.425 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.425 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.425 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:17.425 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361396+0000", 2023-09-30T17:03:17.425 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2459e-05 2023-09-30T17:03:17.425 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:17.425 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:17.425 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:17.425 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.425 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.426 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:17.426 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:03:17.426 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 59.065714247000003, 2023-09-30T17:03:17.426 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021233007000000002, 2023-09-30T17:03:17.426 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:17.426 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:17.426 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:17.426 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.426 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:17.426 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:03:17.426 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:17.426 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.427 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.427 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:17.427 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:03:17.427 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:17.427 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.427 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.427 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:17.427 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352110+0000", 2023-09-30T17:03:17.427 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6000000000000002e-07 2023-09-30T17:03:17.427 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.427 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.428 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:17.428 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352117+0000", 2023-09-30T17:03:17.428 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5930000000000002e-06 2023-09-30T17:03:17.428 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.428 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.428 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:17.428 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352126+0000", 2023-09-30T17:03:17.428 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0729999999999994e-06 2023-09-30T17:03:17.428 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.428 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.428 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:17.428 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352136+0000", 2023-09-30T17:03:17.429 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0380000000000001e-05 2023-09-30T17:03:17.429 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.429 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.429 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:17.429 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353279+0000", 2023-09-30T17:03:17.429 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0011424670000000001 2023-09-30T17:03:17.429 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.429 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.429 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:17.429 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353707+0000", 2023-09-30T17:03:17.429 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00042829800000000003 2023-09-30T17:03:17.429 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.430 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.430 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:17.430 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354104+0000", 2023-09-30T17:03:17.430 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00039643399999999998 2023-09-30T17:03:17.430 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.430 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.430 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:17.430 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356925+0000", 2023-09-30T17:03:17.430 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0028210900000000001 2023-09-30T17:03:17.430 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.430 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.430 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:17.431 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373243+0000", 2023-09-30T17:03:17.431 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016318461999999999 2023-09-30T17:03:17.431 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.431 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.431 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:17.431 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373301+0000", 2023-09-30T17:03:17.431 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7435000000000002e-05 2023-09-30T17:03:17.431 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.431 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.431 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:17.431 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373342+0000", 2023-09-30T17:03:17.431 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1915000000000001e-05 2023-09-30T17:03:17.432 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:17.432 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:17.432 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:17.432 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.432 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.432 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:17.432 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:03:17.432 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 59.065671635999998, 2023-09-30T17:03:17.432 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011988331, 2023-09-30T17:03:17.432 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:17.432 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:17.433 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:17.433 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.433 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:17.433 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:03:17.433 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:17.433 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.433 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.433 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:17.433 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:03:17.433 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:17.433 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.433 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.433 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:17.434 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352153+0000", 2023-09-30T17:03:17.434 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0500000000000003e-07 2023-09-30T17:03:17.434 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.434 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.434 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:17.434 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352157+0000", 2023-09-30T17:03:17.434 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9790000000000004e-06 2023-09-30T17:03:17.434 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.434 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.434 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:17.434 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352173+0000", 2023-09-30T17:03:17.434 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6535999999999999e-05 2023-09-30T17:03:17.435 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.435 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.435 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:17.435 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352180+0000", 2023-09-30T17:03:17.435 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7700000000000004e-06 2023-09-30T17:03:17.435 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.435 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.435 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:17.435 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353526+0000", 2023-09-30T17:03:17.435 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0013458330000000001 2023-09-30T17:03:17.435 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.436 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.436 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:17.436 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353648+0000", 2023-09-30T17:03:17.436 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012262899999999999 2023-09-30T17:03:17.436 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.436 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.436 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:17.436 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354141+0000", 2023-09-30T17:03:17.436 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00049222899999999995 2023-09-30T17:03:17.436 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.436 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.436 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:17.437 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356931+0000", 2023-09-30T17:03:17.437 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0027900860000000002 2023-09-30T17:03:17.437 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.437 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.437 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:17.437 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364066+0000", 2023-09-30T17:03:17.437 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071355050000000003 2023-09-30T17:03:17.437 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.437 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.437 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:17.437 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364103+0000", 2023-09-30T17:03:17.437 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6944999999999999e-05 2023-09-30T17:03:17.438 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.438 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.438 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:17.438 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364140+0000", 2023-09-30T17:03:17.438 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7214e-05 2023-09-30T17:03:17.438 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:17.438 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:17.438 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:17.438 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.438 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.438 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:17.439 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:03:17.439 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 59.065632405000002, 2023-09-30T17:03:17.439 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012110921, 2023-09-30T17:03:17.439 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:17.439 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:17.439 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:17.439 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.439 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:17.439 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:03:17.439 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:17.439 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.439 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.440 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:17.440 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:03:17.440 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:17.440 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.440 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.440 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:17.440 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352192+0000", 2023-09-30T17:03:17.440 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7300000000000005e-07 2023-09-30T17:03:17.440 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.440 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.440 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:17.440 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352196+0000", 2023-09-30T17:03:17.441 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2370000000000003e-06 2023-09-30T17:03:17.441 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.441 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.441 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:17.441 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352205+0000", 2023-09-30T17:03:17.441 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6659999999999997e-06 2023-09-30T17:03:17.441 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.441 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.441 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:17.441 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352214+0000", 2023-09-30T17:03:17.441 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8259999999999999e-06 2023-09-30T17:03:17.441 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.442 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.442 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:17.442 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354470+0000", 2023-09-30T17:03:17.442 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022557340000000001 2023-09-30T17:03:17.442 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.442 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.442 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:17.442 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354557+0000", 2023-09-30T17:03:17.442 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6909000000000004e-05 2023-09-30T17:03:17.442 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.442 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.443 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:17.443 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354694+0000", 2023-09-30T17:03:17.443 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013774800000000001 2023-09-30T17:03:17.443 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.443 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:17.443 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356937+0000", 2023-09-30T17:03:17.443 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022424540000000001 2023-09-30T17:03:17.443 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.443 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:17.443 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364227+0000", 2023-09-30T17:03:17.444 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072902430000000001 2023-09-30T17:03:17.444 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.444 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.444 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:17.444 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364278+0000", 2023-09-30T17:03:17.444 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1180999999999997e-05 2023-09-30T17:03:17.444 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.444 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.444 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:17.444 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364302+0000", 2023-09-30T17:03:17.444 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4049999999999998e-05 2023-09-30T17:03:17.444 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:17.445 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:17.445 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:17.445 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.445 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.445 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:17.445 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:17.445 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 59.065599065999997, 2023-09-30T17:03:17.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021258651999999999, 2023-09-30T17:03:17.445 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:17.445 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:17.445 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:17.445 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.446 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:17.446 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:17.446 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:17.446 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.446 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.446 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:17.446 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:17.446 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:17.446 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.446 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.446 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:17.447 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:17.447 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6899999999999997e-07 2023-09-30T17:03:17.447 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.447 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:17.447 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352236+0000", 2023-09-30T17:03:17.447 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0251000000000001e-05 2023-09-30T17:03:17.447 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.447 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:17.447 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352244+0000", 2023-09-30T17:03:17.447 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0770000000000008e-06 2023-09-30T17:03:17.448 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.448 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:17.448 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352251+0000", 2023-09-30T17:03:17.448 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4749999999999996e-06 2023-09-30T17:03:17.448 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.448 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:17.448 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354455+0000", 2023-09-30T17:03:17.448 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022043660000000001 2023-09-30T17:03:17.448 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.448 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:17.449 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354577+0000", 2023-09-30T17:03:17.449 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000121054 2023-09-30T17:03:17.449 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.449 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.449 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:17.449 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354723+0000", 2023-09-30T17:03:17.449 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014693900000000001 2023-09-30T17:03:17.449 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.449 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.449 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:17.449 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356941+0000", 2023-09-30T17:03:17.449 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002217199 2023-09-30T17:03:17.450 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.450 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.450 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:17.450 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373392+0000", 2023-09-30T17:03:17.450 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016451774999999998 2023-09-30T17:03:17.450 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.450 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.450 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:17.450 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373445+0000", 2023-09-30T17:03:17.450 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.308e-05 2023-09-30T17:03:17.450 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.451 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.451 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:17.451 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373483+0000", 2023-09-30T17:03:17.451 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7766999999999999e-05 2023-09-30T17:03:17.451 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:17.451 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:17.451 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:17.451 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.451 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.451 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:17.451 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:17.451 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 59.065562974999999, 2023-09-30T17:03:17.452 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020903497, 2023-09-30T17:03:17.452 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:17.452 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:17.452 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:17.452 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.452 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:17.452 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:17.452 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:17.452 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.452 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.452 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:17.452 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:17.453 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:17.453 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.453 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.453 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:17.453 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:17.453 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0800000000000004e-07 2023-09-30T17:03:17.453 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.453 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.453 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:17.453 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352266+0000", 2023-09-30T17:03:17.453 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1280000000000001e-06 2023-09-30T17:03:17.453 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.454 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.454 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:17.454 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352273+0000", 2023-09-30T17:03:17.454 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3730000000000004e-06 2023-09-30T17:03:17.454 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.454 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.454 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:17.454 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352279+0000", 2023-09-30T17:03:17.454 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7699999999999998e-06 2023-09-30T17:03:17.454 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.454 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.454 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:17.455 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352334+0000", 2023-09-30T17:03:17.455 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5547999999999997e-05 2023-09-30T17:03:17.455 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.455 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.455 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:17.455 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352435+0000", 2023-09-30T17:03:17.455 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100688 2023-09-30T17:03:17.455 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.455 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.455 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:17.455 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352585+0000", 2023-09-30T17:03:17.455 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000150068 2023-09-30T17:03:17.455 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.456 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.456 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:17.456 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354912+0000", 2023-09-30T17:03:17.456 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0023266770000000001 2023-09-30T17:03:17.456 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.456 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.456 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:17.456 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373066+0000", 2023-09-30T17:03:17.456 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018154474 2023-09-30T17:03:17.456 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.456 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.456 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:17.457 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373122+0000", 2023-09-30T17:03:17.457 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6193000000000002e-05 2023-09-30T17:03:17.457 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.457 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.457 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:17.457 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373164+0000", 2023-09-30T17:03:17.457 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1869999999999997e-05 2023-09-30T17:03:17.457 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:17.457 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:17.457 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:17.457 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.457 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.458 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:17.458 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:03:17.458 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 59.065527299000003, 2023-09-30T17:03:17.458 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021015097999999999, 2023-09-30T17:03:17.458 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:17.458 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:17.458 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:17.458 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.458 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:17.458 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:03:17.458 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:17.458 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.458 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.459 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:17.459 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:03:17.459 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:17.459 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.459 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.459 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:17.459 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352297+0000", 2023-09-30T17:03:17.459 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8299999999999997e-07 2023-09-30T17:03:17.459 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.459 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.459 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:17.459 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352300+0000", 2023-09-30T17:03:17.460 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7460000000000001e-06 2023-09-30T17:03:17.460 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.460 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.460 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:17.460 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352307+0000", 2023-09-30T17:03:17.460 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4959999999999999e-06 2023-09-30T17:03:17.460 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.460 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.460 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:17.460 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352314+0000", 2023-09-30T17:03:17.460 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0190000000000001e-06 2023-09-30T17:03:17.460 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.460 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.461 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:17.461 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354070+0000", 2023-09-30T17:03:17.461 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001755936 2023-09-30T17:03:17.461 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.461 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.461 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:17.461 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354221+0000", 2023-09-30T17:03:17.461 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000150884 2023-09-30T17:03:17.461 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.461 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.461 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:17.461 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373311+0000", 2023-09-30T17:03:17.462 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019090434 2023-09-30T17:03:17.462 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:17.462 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:17.462 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:17.462 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.462 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.462 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:17.462 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:03:17.462 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 59.065498580000003, 2023-09-30T17:03:17.462 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021255174000000002, 2023-09-30T17:03:17.462 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:17.462 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:17.463 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:17.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.463 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:17.463 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:03:17.463 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:17.463 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.463 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:17.463 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:03:17.463 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:17.463 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.464 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:17.464 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352326+0000", 2023-09-30T17:03:17.464 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3200000000000005e-07 2023-09-30T17:03:17.464 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.464 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.464 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:17.464 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352349+0000", 2023-09-30T17:03:17.464 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3183000000000001e-05 2023-09-30T17:03:17.464 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.464 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.464 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:17.464 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352358+0000", 2023-09-30T17:03:17.464 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5230000000000001e-06 2023-09-30T17:03:17.465 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.465 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.465 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:17.465 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352365+0000", 2023-09-30T17:03:17.465 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3260000000000001e-06 2023-09-30T17:03:17.465 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.465 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.465 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:17.465 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355450+0000", 2023-09-30T17:03:17.465 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0030854049999999998 2023-09-30T17:03:17.465 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.466 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.466 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:17.466 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355583+0000", 2023-09-30T17:03:17.466 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000133189 2023-09-30T17:03:17.466 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.466 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.466 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:17.466 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373580+0000", 2023-09-30T17:03:17.466 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017997016000000001 2023-09-30T17:03:17.466 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:17.466 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:17.466 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:17.466 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.467 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.467 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:17.467 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:03:17.467 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 59.065447157000001, 2023-09-30T17:03:17.467 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010380537, 2023-09-30T17:03:17.467 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:17.467 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:17.467 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:17.467 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.467 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:17.467 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:03:17.467 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:17.468 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.468 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.468 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:17.468 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:03:17.468 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:17.468 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.468 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.468 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:17.468 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:03:17.468 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1500000000000003e-07 2023-09-30T17:03:17.468 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.468 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.469 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:17.469 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352381+0000", 2023-09-30T17:03:17.469 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6330000000000002e-06 2023-09-30T17:03:17.469 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.469 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.469 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:17.469 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352388+0000", 2023-09-30T17:03:17.469 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7229999999999998e-06 2023-09-30T17:03:17.469 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.469 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.469 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:17.469 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352394+0000", 2023-09-30T17:03:17.470 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1789999999999996e-06 2023-09-30T17:03:17.470 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.470 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.470 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:17.470 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353259+0000", 2023-09-30T17:03:17.470 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000865221 2023-09-30T17:03:17.470 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.470 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.470 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:17.470 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353391+0000", 2023-09-30T17:03:17.470 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013217700000000001 2023-09-30T17:03:17.470 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.471 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.471 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:17.471 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362757+0000", 2023-09-30T17:03:17.471 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093657889999999994 2023-09-30T17:03:17.471 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:17.471 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:17.471 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:17.471 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.471 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.471 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-09-30T17:03:17.471 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:03:17.471 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 59.059146865000002, 2023-09-30T17:03:17.472 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0061813579999999996, 2023-09-30T17:03:17.472 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:17.472 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2023-09-30T17:03:17.472 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:17.472 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.472 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:17.472 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:03:17.472 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:17.472 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.472 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.472 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:17.472 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:03:17.472 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:17.473 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.473 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.473 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:17.473 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:03:17.473 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5499999999999999e-07 2023-09-30T17:03:17.473 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.473 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.473 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:17.473 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358686+0000", 2023-09-30T17:03:17.473 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9979999999999992e-06 2023-09-30T17:03:17.473 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.473 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.474 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:17.474 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358700+0000", 2023-09-30T17:03:17.474 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3635000000000001e-05 2023-09-30T17:03:17.474 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.474 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.474 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:17.474 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358714+0000", 2023-09-30T17:03:17.474 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4470999999999999e-05 2023-09-30T17:03:17.474 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.474 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.474 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:17.474 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358767+0000", 2023-09-30T17:03:17.475 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2651999999999997e-05 2023-09-30T17:03:17.475 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.475 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.475 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:17.475 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364858+0000", 2023-09-30T17:03:17.475 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060912470000000002 2023-09-30T17:03:17.475 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:17.475 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:17.475 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:17.475 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.475 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.475 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2023-09-30T17:03:17.476 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:03:17.476 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 59.056782024999997, 2023-09-30T17:03:17.476 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00036246299999999999, 2023-09-30T17:03:17.476 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:17.476 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:17.476 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:17.476 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.476 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:17.476 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:03:17.476 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:17.476 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.477 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.477 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:17.477 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:03:17.477 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:17.477 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.477 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.477 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:17.477 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:03:17.477 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3099999999999999e-07 2023-09-30T17:03:17.477 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.477 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.477 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:17.478 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361045+0000", 2023-09-30T17:03:17.478 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.49e-06 2023-09-30T17:03:17.478 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.478 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.478 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:17.478 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361056+0000", 2023-09-30T17:03:17.478 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0910000000000001e-05 2023-09-30T17:03:17.478 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.478 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.478 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:17.478 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361067+0000", 2023-09-30T17:03:17.479 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0531e-05 2023-09-30T17:03:17.479 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.479 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.479 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:17.479 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361263+0000", 2023-09-30T17:03:17.479 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000196486 2023-09-30T17:03:17.479 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.479 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.479 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:17.479 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361273+0000", 2023-09-30T17:03:17.479 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3379999999999994e-06 2023-09-30T17:03:17.479 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.479 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.480 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:17.480 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361404+0000", 2023-09-30T17:03:17.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013137700000000001 2023-09-30T17:03:17.480 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:17.480 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:17.480 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:17.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.480 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:31 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:03:17.480 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:03:17.480 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 59.055805995999997, 2023-09-30T17:03:17.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006676408, 2023-09-30T17:03:17.481 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:17.481 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:17.481 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:17.481 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.481 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:17.481 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:03:17.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:17.481 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.481 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.481 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:17.481 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:03:17.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:17.482 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.482 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.482 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:17.482 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:03:17.482 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5600000000000002e-07 2023-09-30T17:03:17.482 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.482 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.482 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:17.482 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362044+0000", 2023-09-30T17:03:17.482 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5987999999999999e-05 2023-09-30T17:03:17.482 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.482 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.482 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:17.483 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362051+0000", 2023-09-30T17:03:17.483 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2599999999999999e-06 2023-09-30T17:03:17.483 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.483 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.483 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:17.483 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362057+0000", 2023-09-30T17:03:17.483 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.19e-06 2023-09-30T17:03:17.483 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.483 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.483 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:17.483 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362096+0000", 2023-09-30T17:03:17.484 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8278000000000002e-05 2023-09-30T17:03:17.484 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.484 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.484 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:17.484 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362114+0000", 2023-09-30T17:03:17.484 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8808e-05 2023-09-30T17:03:17.484 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.484 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.484 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:17.484 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368658+0000", 2023-09-30T17:03:17.484 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065433540000000004 2023-09-30T17:03:17.484 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.485 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.485 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:17.485 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368694+0000", 2023-09-30T17:03:17.485 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6273999999999999e-05 2023-09-30T17:03:17.485 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:17.485 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:17.485 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:17.485 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.485 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.485 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:26 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-09-30T17:03:17.485 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:03:17.485 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 59.055715223999997, 2023-09-30T17:03:17.486 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0066596119999999996, 2023-09-30T17:03:17.486 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:17.486 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:17.486 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:17.486 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.486 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:17.486 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:03:17.486 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:17.486 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.486 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.486 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:17.487 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:03:17.487 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:17.487 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.487 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.487 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:17.487 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362109+0000", 2023-09-30T17:03:17.487 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5699999999999999e-07 2023-09-30T17:03:17.487 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.487 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.487 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:17.487 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362112+0000", 2023-09-30T17:03:17.487 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8410000000000002e-06 2023-09-30T17:03:17.487 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.488 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.488 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:17.488 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362117+0000", 2023-09-30T17:03:17.488 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.792e-06 2023-09-30T17:03:17.488 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.488 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.488 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:17.488 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362122+0000", 2023-09-30T17:03:17.488 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.763e-06 2023-09-30T17:03:17.488 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.488 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.489 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:17.489 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362344+0000", 2023-09-30T17:03:17.489 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022181600000000001 2023-09-30T17:03:17.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.489 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:17.489 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362357+0000", 2023-09-30T17:03:17.489 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2864000000000001e-05 2023-09-30T17:03:17.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.489 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:17.489 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368738+0000", 2023-09-30T17:03:17.489 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063809499999999998 2023-09-30T17:03:17.490 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.490 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.490 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:17.490 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368768+0000", 2023-09-30T17:03:17.490 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0429e-05 2023-09-30T17:03:17.490 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:17.490 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:17.490 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:17.490 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.490 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.490 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2023-09-30T17:03:17.490 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:03:17.491 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 59.054499057000001, 2023-09-30T17:03:17.491 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00082185400000000001, 2023-09-30T17:03:17.491 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:17.491 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:17.491 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:17.491 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.491 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:17.491 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:03:17.491 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:17.491 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.491 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.491 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:17.491 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:03:17.491 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:17.492 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.492 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.492 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:17.492 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:03:17.492 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.22e-07 2023-09-30T17:03:17.492 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.492 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.492 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:17.492 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363327+0000", 2023-09-30T17:03:17.492 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4480000000000001e-06 2023-09-30T17:03:17.492 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.492 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.492 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:17.493 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363333+0000", 2023-09-30T17:03:17.493 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9989999999999997e-06 2023-09-30T17:03:17.493 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.493 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.493 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:17.493 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363354+0000", 2023-09-30T17:03:17.493 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0547000000000002e-05 2023-09-30T17:03:17.493 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.493 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.493 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:17.493 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364057+0000", 2023-09-30T17:03:17.493 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00070306600000000002 2023-09-30T17:03:17.494 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.494 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.494 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:17.494 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364063+0000", 2023-09-30T17:03:17.494 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.694e-06 2023-09-30T17:03:17.494 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.494 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.494 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:17.494 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364146+0000", 2023-09-30T17:03:17.494 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3877999999999999e-05 2023-09-30T17:03:17.494 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:17.495 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:17.495 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:17.495 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.495 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.495 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e18/16 ondisk, result = 0)", 2023-09-30T17:03:17.495 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:03:17.495 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 59.054185525000001, 2023-09-30T17:03:17.495 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00067007199999999996, 2023-09-30T17:03:17.495 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:17.495 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:17.495 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:17.496 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.496 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:17.496 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:03:17.496 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:17.496 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.496 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.496 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:17.496 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:03:17.496 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:17.496 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.496 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.496 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:17.497 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:03:17.497 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.41e-07 2023-09-30T17:03:17.497 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.497 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.497 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:17.497 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363641+0000", 2023-09-30T17:03:17.497 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4830000000000002e-06 2023-09-30T17:03:17.497 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.497 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.497 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:17.497 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363647+0000", 2023-09-30T17:03:17.497 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4869999999999999e-06 2023-09-30T17:03:17.497 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.498 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.498 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:17.498 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363654+0000", 2023-09-30T17:03:17.498 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5889999999999999e-06 2023-09-30T17:03:17.498 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.498 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.498 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:17.498 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364217+0000", 2023-09-30T17:03:17.498 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00056263199999999998 2023-09-30T17:03:17.498 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.498 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.498 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:17.499 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364222+0000", 2023-09-30T17:03:17.499 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.242e-06 2023-09-30T17:03:17.499 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.499 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.499 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:17.499 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364308+0000", 2023-09-30T17:03:17.499 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6397999999999995e-05 2023-09-30T17:03:17.499 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:17.499 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:17.499 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:17.499 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.499 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.499 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2023-09-30T17:03:17.500 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:03:17.500 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 59.044597615000001, 2023-09-30T17:03:17.500 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000359561, 2023-09-30T17:03:17.500 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:17.500 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2023-09-30T17:03:17.500 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:17.500 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.500 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:17.500 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:03:17.500 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:17.500 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.500 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.501 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:17.501 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:03:17.501 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:17.501 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.501 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.501 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:17.501 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:03:17.501 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1e-07 2023-09-30T17:03:17.501 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.501 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.501 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:17.501 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373228+0000", 2023-09-30T17:03:17.502 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9420000000000002e-06 2023-09-30T17:03:17.502 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.502 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.502 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:17.502 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373235+0000", 2023-09-30T17:03:17.502 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4230000000000002e-06 2023-09-30T17:03:17.502 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.502 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.502 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:17.502 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373239+0000", 2023-09-30T17:03:17.502 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6809999999999997e-06 2023-09-30T17:03:17.502 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.503 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.503 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:17.503 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373518+0000", 2023-09-30T17:03:17.503 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000278311 2023-09-30T17:03:17.503 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.503 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.503 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:17.503 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373586+0000", 2023-09-30T17:03:17.503 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7994e-05 2023-09-30T17:03:17.503 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:17.503 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:17.503 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:17.504 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.504 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.504 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:03:17.504 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:03:17.504 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 59.040171542000003, 2023-09-30T17:03:17.504 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0046632949999999996, 2023-09-30T17:03:17.504 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:17.504 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:17.504 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:17.504 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.504 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:17.504 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:03:17.505 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:17.505 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.505 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.505 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:17.505 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:03:17.505 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:17.505 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.505 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.505 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:17.505 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377653+0000", 2023-09-30T17:03:17.505 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7800000000000002e-07 2023-09-30T17:03:17.505 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.506 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:17.506 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377657+0000", 2023-09-30T17:03:17.506 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5859999999999998e-06 2023-09-30T17:03:17.506 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.506 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:17.506 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377677+0000", 2023-09-30T17:03:17.506 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9508999999999999e-05 2023-09-30T17:03:17.506 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.506 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:17.506 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377682+0000", 2023-09-30T17:03:17.507 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8300000000000001e-06 2023-09-30T17:03:17.507 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.507 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.507 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:17.507 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377725+0000", 2023-09-30T17:03:17.507 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2425000000000001e-05 2023-09-30T17:03:17.507 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.507 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.507 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:17.507 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377738+0000", 2023-09-30T17:03:17.507 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2899e-05 2023-09-30T17:03:17.508 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.508 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.508 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:17.508 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382268+0000", 2023-09-30T17:03:17.508 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045301289999999999 2023-09-30T17:03:17.508 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.508 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.508 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:17.508 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382315+0000", 2023-09-30T17:03:17.508 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7539e-05 2023-09-30T17:03:17.508 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:17.508 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:17.509 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:17.509 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.509 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.509 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-09-30T17:03:17.509 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:03:17.509 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 59.039722091000002, 2023-09-30T17:03:17.509 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042540670000000003, 2023-09-30T17:03:17.509 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:17.509 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:17.509 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:17.509 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.509 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:17.509 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:03:17.510 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:17.510 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.510 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.510 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:17.510 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:03:17.510 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:17.510 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.510 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.510 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:17.510 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:03:17.510 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0299999999999998e-07 2023-09-30T17:03:17.511 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.511 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.511 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:17.511 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378107+0000", 2023-09-30T17:03:17.511 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9250000000000003e-06 2023-09-30T17:03:17.511 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.511 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.511 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:17.511 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378116+0000", 2023-09-30T17:03:17.511 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.037e-06 2023-09-30T17:03:17.511 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.511 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.511 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:17.512 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378123+0000", 2023-09-30T17:03:17.512 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1879999999999996e-06 2023-09-30T17:03:17.512 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.512 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.512 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:17.512 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378174+0000", 2023-09-30T17:03:17.512 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0998000000000002e-05 2023-09-30T17:03:17.512 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.512 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.512 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:17.512 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378197+0000", 2023-09-30T17:03:17.512 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2558e-05 2023-09-30T17:03:17.513 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.513 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.513 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:17.513 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382319+0000", 2023-09-30T17:03:17.513 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041220950000000001 2023-09-30T17:03:17.513 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.513 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.513 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:17.513 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382356+0000", 2023-09-30T17:03:17.513 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6563000000000002e-05 2023-09-30T17:03:17.513 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:17.513 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:17.514 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:17.514 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.514 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.514 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-09-30T17:03:17.514 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:03:17.514 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 54.981958267000003, 2023-09-30T17:03:17.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00171641, 2023-09-30T17:03:17.514 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:17.514 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:17.514 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:17.514 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.514 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:17.515 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:03:17.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:17.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.515 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:17.515 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:03:17.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:17.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.515 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:17.515 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435868+0000", 2023-09-30T17:03:17.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5840000000000002e-06 2023-09-30T17:03:17.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.516 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:17.516 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435892+0000", 2023-09-30T17:03:17.516 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3625000000000002e-05 2023-09-30T17:03:17.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.516 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:17.516 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435908+0000", 2023-09-30T17:03:17.516 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6548000000000001e-05 2023-09-30T17:03:17.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.517 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:17.517 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435935+0000", 2023-09-30T17:03:17.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6516000000000002e-05 2023-09-30T17:03:17.517 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.517 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:17.517 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435996+0000", 2023-09-30T17:03:17.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1433999999999995e-05 2023-09-30T17:03:17.517 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.517 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:17.518 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436114+0000", 2023-09-30T17:03:17.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000118344 2023-09-30T17:03:17.518 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.518 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.518 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:17.518 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436219+0000", 2023-09-30T17:03:17.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010453100000000001 2023-09-30T17:03:17.518 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.518 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.518 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:17.518 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436900+0000", 2023-09-30T17:03:17.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00068121299999999996 2023-09-30T17:03:17.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.519 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:17.519 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437508+0000", 2023-09-30T17:03:17.519 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00060817399999999995 2023-09-30T17:03:17.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.519 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:17.519 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437554+0000", 2023-09-30T17:03:17.519 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5609000000000003e-05 2023-09-30T17:03:17.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.520 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:17.520 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437582+0000", 2023-09-30T17:03:17.520 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7832000000000001e-05 2023-09-30T17:03:17.520 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:17.520 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:17.520 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:17.520 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.520 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.520 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2023-09-30T17:03:17.520 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:03:17.520 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 34.981646773000001, 2023-09-30T17:03:17.520 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001456199, 2023-09-30T17:03:17.520 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:17.521 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:17.521 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:17.521 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.521 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:17.521 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:03:17.521 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:17.521 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.521 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.521 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:17.521 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:03:17.521 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:17.521 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.522 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:17.522 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436178+0000", 2023-09-30T17:03:17.522 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.494e-06 2023-09-30T17:03:17.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.522 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:17.522 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436184+0000", 2023-09-30T17:03:17.522 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2809999999999999e-06 2023-09-30T17:03:17.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.522 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:17.522 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436198+0000", 2023-09-30T17:03:17.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3978000000000001e-05 2023-09-30T17:03:17.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.523 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:17.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436206+0000", 2023-09-30T17:03:17.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8040000000000007e-06 2023-09-30T17:03:17.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.523 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:17.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436268+0000", 2023-09-30T17:03:17.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1484999999999998e-05 2023-09-30T17:03:17.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.524 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:17.524 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436339+0000", 2023-09-30T17:03:17.524 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1000000000000005e-05 2023-09-30T17:03:17.524 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.524 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.524 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:17.524 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436438+0000", 2023-09-30T17:03:17.524 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9389000000000007e-05 2023-09-30T17:03:17.524 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.524 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.524 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:17.524 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436986+0000", 2023-09-30T17:03:17.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054723399999999996 2023-09-30T17:03:17.525 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.525 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.525 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:17.525 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437566+0000", 2023-09-30T17:03:17.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00058017599999999996 2023-09-30T17:03:17.525 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.525 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.525 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:17.525 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437606+0000", 2023-09-30T17:03:17.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9891999999999997e-05 2023-09-30T17:03:17.525 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:17.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:17.526 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:17.526 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437633+0000", 2023-09-30T17:03:17.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7466000000000001e-05 2023-09-30T17:03:17.526 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:17.526 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:17.526 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:17.526 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:17.526 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:17.526 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:17.527 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:03:17.528 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:17.527+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:17.628 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:17.627+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:17.673 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:17.673 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:03:17.673 INFO:teuthology.orchestra.run.smithi031.stdout: "num_ops": 0 2023-09-30T17:03:17.674 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:17.684 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:03:17.767 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:17.767+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:17.829 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:17.830+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:17.857 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:17.857 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:03:17.857 INFO:teuthology.orchestra.run.smithi031.stdout: "complaint_time": 30, 2023-09-30T17:03:17.857 INFO:teuthology.orchestra.run.smithi031.stdout: "num_blocked_ops": 0 2023-09-30T17:03:17.857 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:17.867 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:03:17.950 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:17.950+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:18.033 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:18.032+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:18.042 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:18.042 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 20, 2023-09-30T17:03:18.042 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 600, 2023-09-30T17:03:18.042 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:03:18.042 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.042 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:32 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'18, mlcod=11'14)", 2023-09-30T17:03:18.042 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:03:18.042 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 70.679303222000001, 2023-09-30T17:03:18.042 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051629809999999996, 2023-09-30T17:03:18.042 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:18.043 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:18.043 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:18.043 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.043 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:18.043 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:03:18.043 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:18.043 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.043 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.043 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:18.043 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:03:18.043 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:18.043 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.043 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.044 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:18.044 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:03:18.044 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2099999999999996e-07 2023-09-30T17:03:18.044 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.044 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.044 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:18.044 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361407+0000", 2023-09-30T17:03:18.044 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7499e-05 2023-09-30T17:03:18.044 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.044 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.044 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:18.044 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361418+0000", 2023-09-30T17:03:18.044 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1127999999999999e-05 2023-09-30T17:03:18.045 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.045 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.045 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:18.045 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361423+0000", 2023-09-30T17:03:18.045 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1930000000000001e-06 2023-09-30T17:03:18.045 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.045 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.045 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:18.045 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361476+0000", 2023-09-30T17:03:18.045 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3399000000000002e-05 2023-09-30T17:03:18.045 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.046 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.046 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:18.046 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361496+0000", 2023-09-30T17:03:18.046 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9638000000000001e-05 2023-09-30T17:03:18.046 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.046 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.046 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:18.046 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.366474+0000", 2023-09-30T17:03:18.046 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0049778829999999998 2023-09-30T17:03:18.046 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.046 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.047 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:18.047 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.366512+0000", 2023-09-30T17:03:18.047 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7620000000000002e-05 2023-09-30T17:03:18.047 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:18.047 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:18.047 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:18.047 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.047 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.047 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:37 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'23, mlcod=11'15)", 2023-09-30T17:03:18.048 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:03:18.048 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 70.676701225000002, 2023-09-30T17:03:18.048 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053985689999999998, 2023-09-30T17:03:18.048 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:18.048 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:18.048 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:18.048 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.048 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:18.048 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:03:18.048 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:18.049 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.049 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.049 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:18.049 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:03:18.049 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:18.049 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.049 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.049 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:18.049 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:03:18.049 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4400000000000001e-07 2023-09-30T17:03:18.050 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.050 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.050 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:18.050 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363956+0000", 2023-09-30T17:03:18.050 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.921e-06 2023-09-30T17:03:18.050 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.050 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.050 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:18.050 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363966+0000", 2023-09-30T17:03:18.050 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0351e-05 2023-09-30T17:03:18.051 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.051 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.051 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:18.051 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363971+0000", 2023-09-30T17:03:18.051 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.023e-06 2023-09-30T17:03:18.051 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.051 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.051 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:18.051 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.364013+0000", 2023-09-30T17:03:18.051 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1575000000000001e-05 2023-09-30T17:03:18.051 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.052 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.052 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:18.052 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.364026+0000", 2023-09-30T17:03:18.052 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3044000000000001e-05 2023-09-30T17:03:18.052 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.052 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.052 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:18.052 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.369308+0000", 2023-09-30T17:03:18.052 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005282152 2023-09-30T17:03:18.052 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.052 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.053 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:18.053 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.369349+0000", 2023-09-30T17:03:18.053 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1059000000000001e-05 2023-09-30T17:03:18.053 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:18.053 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:18.053 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:18.053 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.053 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.053 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:155 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'109, mlcod=11'105)", 2023-09-30T17:03:18.053 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:03:18.053 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 70.195005538999993, 2023-09-30T17:03:18.053 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053867639999999996, 2023-09-30T17:03:18.054 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:18.054 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:18.054 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:18.054 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.054 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:18.054 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:03:18.054 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:18.054 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.054 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.054 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:18.054 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:03:18.055 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:18.055 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.055 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.055 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:18.055 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845647+0000", 2023-09-30T17:03:18.055 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7599999999999997e-07 2023-09-30T17:03:18.055 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.055 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.055 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:18.055 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845699+0000", 2023-09-30T17:03:18.055 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1758000000000001e-05 2023-09-30T17:03:18.055 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.055 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.056 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:18.056 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845708+0000", 2023-09-30T17:03:18.056 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2159999999999995e-06 2023-09-30T17:03:18.056 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.056 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.056 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:18.056 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845712+0000", 2023-09-30T17:03:18.056 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2579999999999997e-06 2023-09-30T17:03:18.056 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.056 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.056 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:18.056 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845756+0000", 2023-09-30T17:03:18.057 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4119999999999998e-05 2023-09-30T17:03:18.057 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.057 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.057 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:18.057 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845779+0000", 2023-09-30T17:03:18.057 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2311e-05 2023-09-30T17:03:18.057 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.057 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.057 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:18.057 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.850982+0000", 2023-09-30T17:03:18.057 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005203053 2023-09-30T17:03:18.057 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.057 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.058 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:18.058 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851033+0000", 2023-09-30T17:03:18.058 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1471999999999998e-05 2023-09-30T17:03:18.058 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:18.058 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:18.058 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:18.058 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.058 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.058 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:156 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'110, mlcod=11'105)", 2023-09-30T17:03:18.058 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:03:18.058 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 70.194472613000002, 2023-09-30T17:03:18.058 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0052834759999999996, 2023-09-30T17:03:18.059 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:18.059 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:18.059 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:18.059 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.059 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:18.059 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:03:18.059 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:18.059 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.059 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.059 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:18.059 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:03:18.059 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:18.060 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.060 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.060 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:18.060 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846180+0000", 2023-09-30T17:03:18.060 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6300000000000005e-07 2023-09-30T17:03:18.060 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.060 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.060 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:18.060 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846184+0000", 2023-09-30T17:03:18.060 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3789999999999999e-06 2023-09-30T17:03:18.060 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.060 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.061 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:18.061 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846195+0000", 2023-09-30T17:03:18.061 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0778000000000001e-05 2023-09-30T17:03:18.061 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.061 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.061 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:18.061 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846200+0000", 2023-09-30T17:03:18.061 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1540000000000001e-06 2023-09-30T17:03:18.061 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.061 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.061 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:18.061 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846274+0000", 2023-09-30T17:03:18.062 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4129999999999997e-05 2023-09-30T17:03:18.062 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.062 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.062 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:18.062 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846286+0000", 2023-09-30T17:03:18.062 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1744e-05 2023-09-30T17:03:18.062 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.062 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.062 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:18.062 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851432+0000", 2023-09-30T17:03:18.062 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051462110000000004 2023-09-30T17:03:18.062 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.063 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.063 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:18.063 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851463+0000", 2023-09-30T17:03:18.063 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0516999999999999e-05 2023-09-30T17:03:18.063 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:18.063 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:18.063 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:18.063 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.063 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.063 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:203 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'149, mlcod=11'145)", 2023-09-30T17:03:18.063 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:03:18.063 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 69.838436704000003, 2023-09-30T17:03:18.064 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051867459999999999, 2023-09-30T17:03:18.064 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:18.064 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:18.064 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:18.064 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.064 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:18.064 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:03:18.064 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:18.064 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.064 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.064 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:18.064 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:03:18.065 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:18.065 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.065 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.065 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:18.065 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202216+0000", 2023-09-30T17:03:18.065 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7e-07 2023-09-30T17:03:18.065 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.065 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.065 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:18.065 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202271+0000", 2023-09-30T17:03:18.065 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5163e-05 2023-09-30T17:03:18.065 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.066 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.066 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:18.066 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202282+0000", 2023-09-30T17:03:18.066 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1319e-05 2023-09-30T17:03:18.066 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.066 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.066 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:18.066 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202288+0000", 2023-09-30T17:03:18.066 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2899999999999999e-06 2023-09-30T17:03:18.066 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.066 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.066 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:18.067 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202331+0000", 2023-09-30T17:03:18.067 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2147999999999997e-05 2023-09-30T17:03:18.067 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.067 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.067 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:18.067 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202348+0000", 2023-09-30T17:03:18.067 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7317e-05 2023-09-30T17:03:18.067 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.067 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.067 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:18.067 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.207357+0000", 2023-09-30T17:03:18.067 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0050095440000000003 2023-09-30T17:03:18.068 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.068 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.068 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:18.068 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.207402+0000", 2023-09-30T17:03:18.068 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4495e-05 2023-09-30T17:03:18.068 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:18.068 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:18.068 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:18.068 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.068 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.068 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:18.068 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:03:18.069 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 59.689106416000001, 2023-09-30T17:03:18.069 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.025313649000000001, 2023-09-30T17:03:18.069 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:18.069 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:18.069 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:18.069 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.069 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:18.069 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:03:18.069 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:18.069 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.069 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.069 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:18.070 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:03:18.070 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:18.070 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.070 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.070 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:18.070 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351551+0000", 2023-09-30T17:03:18.070 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3380000000000004e-06 2023-09-30T17:03:18.070 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.070 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.070 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:18.070 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351559+0000", 2023-09-30T17:03:18.070 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9589999999999995e-06 2023-09-30T17:03:18.071 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.071 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.071 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:18.071 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351571+0000", 2023-09-30T17:03:18.071 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2065999999999999e-05 2023-09-30T17:03:18.071 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.071 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.071 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:18.071 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351706+0000", 2023-09-30T17:03:18.071 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00013553799999999999 2023-09-30T17:03:18.071 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.071 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.072 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:18.072 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353016+0000", 2023-09-30T17:03:18.072 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0013099209999999999 2023-09-30T17:03:18.072 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.072 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.072 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:18.072 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353023+0000", 2023-09-30T17:03:18.072 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2479999999999999e-06 2023-09-30T17:03:18.072 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.072 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.072 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:18.072 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360348+0000", 2023-09-30T17:03:18.073 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0073248949999999997 2023-09-30T17:03:18.073 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.073 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.073 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:18.073 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360787+0000", 2023-09-30T17:03:18.073 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00043875199999999999 2023-09-30T17:03:18.073 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.073 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.073 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:18.073 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360892+0000", 2023-09-30T17:03:18.073 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010508199999999999 2023-09-30T17:03:18.073 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.074 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.074 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:18.074 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365132+0000", 2023-09-30T17:03:18.074 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0042396480000000004 2023-09-30T17:03:18.074 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.074 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.074 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:18.074 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376746+0000", 2023-09-30T17:03:18.074 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011614157 2023-09-30T17:03:18.074 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.074 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.074 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:18.075 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376811+0000", 2023-09-30T17:03:18.075 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5005999999999994e-05 2023-09-30T17:03:18.075 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.075 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.075 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:18.075 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376859+0000", 2023-09-30T17:03:18.075 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8038999999999999e-05 2023-09-30T17:03:18.075 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:18.075 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:18.075 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:18.075 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.075 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.076 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:18.076 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:03:18.076 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 59.688608617, 2023-09-30T17:03:18.076 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024923989000000001, 2023-09-30T17:03:18.076 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:18.076 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:18.076 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:18.076 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.076 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:18.076 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:03:18.076 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:18.076 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.077 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.077 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:18.077 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:03:18.077 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:18.077 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.077 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.077 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:18.077 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352044+0000", 2023-09-30T17:03:18.077 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9199999999999999e-07 2023-09-30T17:03:18.077 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.077 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.078 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:18.078 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352050+0000", 2023-09-30T17:03:18.078 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8880000000000002e-06 2023-09-30T17:03:18.078 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.078 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.078 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:18.078 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352143+0000", 2023-09-30T17:03:18.078 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2721999999999998e-05 2023-09-30T17:03:18.078 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.078 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.078 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:18.078 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352155+0000", 2023-09-30T17:03:18.079 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2279000000000001e-05 2023-09-30T17:03:18.079 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.079 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.079 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:18.079 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353114+0000", 2023-09-30T17:03:18.079 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00095943700000000005 2023-09-30T17:03:18.079 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.079 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.079 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:18.079 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353121+0000", 2023-09-30T17:03:18.079 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.494e-06 2023-09-30T17:03:18.080 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.080 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.080 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:18.080 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361491+0000", 2023-09-30T17:03:18.080 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0083697359999999991 2023-09-30T17:03:18.080 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.080 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.080 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:18.080 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361573+0000", 2023-09-30T17:03:18.080 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2822000000000001e-05 2023-09-30T17:03:18.080 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.080 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.081 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:18.081 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362166+0000", 2023-09-30T17:03:18.081 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00059223299999999995 2023-09-30T17:03:18.081 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.081 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.081 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:18.081 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365209+0000", 2023-09-30T17:03:18.081 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.003043212 2023-09-30T17:03:18.081 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.081 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.081 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:18.081 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376910+0000", 2023-09-30T17:03:18.081 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011700898 2023-09-30T17:03:18.082 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.082 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.082 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:18.082 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376945+0000", 2023-09-30T17:03:18.082 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4795000000000001e-05 2023-09-30T17:03:18.082 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.082 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.082 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:18.082 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376967+0000", 2023-09-30T17:03:18.082 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2580999999999999e-05 2023-09-30T17:03:18.082 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:18.082 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:18.083 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:18.083 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.083 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.083 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:18.083 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:03:18.083 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 59.688438697000002, 2023-09-30T17:03:18.083 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023120405, 2023-09-30T17:03:18.083 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:18.083 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:18.083 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:18.083 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.083 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:18.084 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:03:18.084 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:18.084 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.084 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.084 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:18.084 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:03:18.084 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:18.084 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.084 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.084 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:18.084 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352214+0000", 2023-09-30T17:03:18.084 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8400000000000003e-07 2023-09-30T17:03:18.085 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.085 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.085 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:18.085 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352233+0000", 2023-09-30T17:03:18.085 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8946000000000001e-05 2023-09-30T17:03:18.085 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.085 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.085 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:18.085 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352297+0000", 2023-09-30T17:03:18.085 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3540999999999994e-05 2023-09-30T17:03:18.085 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.085 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.086 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:18.086 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352450+0000", 2023-09-30T17:03:18.086 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015364799999999999 2023-09-30T17:03:18.086 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.086 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.086 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:18.086 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353098+0000", 2023-09-30T17:03:18.086 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00064820299999999997 2023-09-30T17:03:18.086 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.086 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.086 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:18.086 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353103+0000", 2023-09-30T17:03:18.086 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0529999999999997e-06 2023-09-30T17:03:18.087 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.087 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.087 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:18.087 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.358558+0000", 2023-09-30T17:03:18.087 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0054550249999999996 2023-09-30T17:03:18.087 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.087 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.087 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:18.087 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.358741+0000", 2023-09-30T17:03:18.087 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00018210200000000001 2023-09-30T17:03:18.087 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.087 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.088 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:18.088 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.359683+0000", 2023-09-30T17:03:18.088 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00094202299999999995 2023-09-30T17:03:18.088 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.088 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.088 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:18.088 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365044+0000", 2023-09-30T17:03:18.088 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053616219999999999 2023-09-30T17:03:18.088 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.088 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.088 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:18.088 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375256+0000", 2023-09-30T17:03:18.089 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010212156 2023-09-30T17:03:18.089 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.089 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.089 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:18.089 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375300+0000", 2023-09-30T17:03:18.089 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3961999999999997e-05 2023-09-30T17:03:18.089 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.089 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.089 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:18.089 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375334+0000", 2023-09-30T17:03:18.089 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.324e-05 2023-09-30T17:03:18.089 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:18.090 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:18.090 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:18.090 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.090 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.090 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:18.090 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:03:18.090 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 59.688123679, 2023-09-30T17:03:18.090 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024240660000000001, 2023-09-30T17:03:18.090 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:18.090 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:18.090 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:18.091 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.091 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:18.091 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:03:18.091 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:18.091 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.091 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.091 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:18.091 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:03:18.091 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:18.091 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.091 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.092 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:18.092 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352529+0000", 2023-09-30T17:03:18.092 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1379999999999999e-06 2023-09-30T17:03:18.092 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.092 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.092 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:18.092 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352536+0000", 2023-09-30T17:03:18.092 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3489999999999997e-06 2023-09-30T17:03:18.092 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.092 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.092 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:18.092 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352547+0000", 2023-09-30T17:03:18.092 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1109e-05 2023-09-30T17:03:18.093 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.093 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.093 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:18.093 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352560+0000", 2023-09-30T17:03:18.093 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3046e-05 2023-09-30T17:03:18.093 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.093 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.093 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:18.093 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353142+0000", 2023-09-30T17:03:18.093 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00058174699999999997 2023-09-30T17:03:18.093 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.093 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.094 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:18.094 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353147+0000", 2023-09-30T17:03:18.094 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5840000000000002e-06 2023-09-30T17:03:18.094 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.094 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.094 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:18.094 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360374+0000", 2023-09-30T17:03:18.094 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0072270049999999999 2023-09-30T17:03:18.094 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.094 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.094 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:18.095 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360795+0000", 2023-09-30T17:03:18.095 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00042088999999999999 2023-09-30T17:03:18.095 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.095 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.095 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:18.095 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360967+0000", 2023-09-30T17:03:18.095 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017235699999999999 2023-09-30T17:03:18.095 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.095 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.095 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:18.095 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365051+0000", 2023-09-30T17:03:18.095 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0040837429999999999 2023-09-30T17:03:18.096 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.096 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.096 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:18.096 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376708+0000", 2023-09-30T17:03:18.096 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011656866 2023-09-30T17:03:18.096 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.096 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.096 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:18.096 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376745+0000", 2023-09-30T17:03:18.096 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6769e-05 2023-09-30T17:03:18.096 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.097 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.097 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:18.097 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376769+0000", 2023-09-30T17:03:18.097 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4057e-05 2023-09-30T17:03:18.097 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:18.097 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:18.097 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:18.097 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.097 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.097 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:18.097 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:18.098 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 59.687864324000003, 2023-09-30T17:03:18.098 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023472704, 2023-09-30T17:03:18.098 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:18.098 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:18.098 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:18.098 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.098 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:18.098 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:18.098 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:18.098 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.098 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.099 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:18.099 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:18.099 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:18.099 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.099 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.099 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:18.099 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:18.099 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8000000000000005e-07 2023-09-30T17:03:18.099 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.099 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.099 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:18.100 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352794+0000", 2023-09-30T17:03:18.100 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.789e-06 2023-09-30T17:03:18.100 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.100 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.100 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:18.100 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352805+0000", 2023-09-30T17:03:18.100 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0848e-05 2023-09-30T17:03:18.100 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.100 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.100 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:18.100 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352812+0000", 2023-09-30T17:03:18.100 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4449999999999999e-06 2023-09-30T17:03:18.101 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.101 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.101 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:18.101 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353063+0000", 2023-09-30T17:03:18.101 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00025046299999999998 2023-09-30T17:03:18.101 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.101 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.101 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:18.101 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353071+0000", 2023-09-30T17:03:18.101 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6739999999999997e-06 2023-09-30T17:03:18.101 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.101 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.102 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:18.102 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361696+0000", 2023-09-30T17:03:18.102 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0086251609999999992 2023-09-30T17:03:18.102 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.102 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.102 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:18.102 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362284+0000", 2023-09-30T17:03:18.102 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00058872299999999998 2023-09-30T17:03:18.102 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.102 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.102 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:18.102 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362429+0000", 2023-09-30T17:03:18.103 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014509000000000001 2023-09-30T17:03:18.103 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.103 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.103 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:18.103 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365330+0000", 2023-09-30T17:03:18.103 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0029005419999999999 2023-09-30T17:03:18.103 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.103 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.103 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:18.103 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376196+0000", 2023-09-30T17:03:18.103 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.01086615 2023-09-30T17:03:18.103 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.104 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.104 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:18.104 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376230+0000", 2023-09-30T17:03:18.104 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3858e-05 2023-09-30T17:03:18.104 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.104 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.104 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:18.104 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376260+0000", 2023-09-30T17:03:18.104 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0181000000000001e-05 2023-09-30T17:03:18.104 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:18.104 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:18.104 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:18.104 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.105 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.105 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:18.105 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:03:18.105 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 59.687630753999997, 2023-09-30T17:03:18.105 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023406132999999999, 2023-09-30T17:03:18.105 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:18.105 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:18.105 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:18.105 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.105 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:18.105 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:03:18.105 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:18.106 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.106 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.106 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:18.106 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:03:18.106 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:18.106 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.106 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.106 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:18.106 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353022+0000", 2023-09-30T17:03:18.106 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.78e-07 2023-09-30T17:03:18.106 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.106 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.107 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:18.107 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353027+0000", 2023-09-30T17:03:18.107 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9089999999999999e-06 2023-09-30T17:03:18.107 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.107 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.107 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:18.107 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353035+0000", 2023-09-30T17:03:18.107 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0430000000000008e-06 2023-09-30T17:03:18.107 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.108 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.108 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:18.108 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353047+0000", 2023-09-30T17:03:18.108 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1674e-05 2023-09-30T17:03:18.108 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.108 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.108 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:18.108 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353105+0000", 2023-09-30T17:03:18.108 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8891999999999998e-05 2023-09-30T17:03:18.108 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.108 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.109 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:18.109 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353112+0000", 2023-09-30T17:03:18.109 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7059999999999998e-06 2023-09-30T17:03:18.109 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.109 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.109 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:18.109 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362733+0000", 2023-09-30T17:03:18.109 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0096205869999999999 2023-09-30T17:03:18.109 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.109 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.109 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:18.109 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362833+0000", 2023-09-30T17:03:18.110 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000100227 2023-09-30T17:03:18.110 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.110 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.110 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:18.110 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363000+0000", 2023-09-30T17:03:18.110 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016670899999999999 2023-09-30T17:03:18.110 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.110 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.110 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:18.110 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365550+0000", 2023-09-30T17:03:18.110 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0025499199999999998 2023-09-30T17:03:18.111 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.111 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.111 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:18.111 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376315+0000", 2023-09-30T17:03:18.111 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010765011999999999 2023-09-30T17:03:18.111 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.111 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.111 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:18.111 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376386+0000", 2023-09-30T17:03:18.111 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0866999999999998e-05 2023-09-30T17:03:18.111 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.112 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.112 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:18.112 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376427+0000", 2023-09-30T17:03:18.112 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1709000000000003e-05 2023-09-30T17:03:18.112 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:18.112 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:18.112 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:18.112 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.112 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.112 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:18.112 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:18.112 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 59.687590118000003, 2023-09-30T17:03:18.113 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024076238, 2023-09-30T17:03:18.113 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:18.113 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:18.113 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:18.113 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.113 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:18.113 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:18.113 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:18.113 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.113 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.113 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:18.113 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:18.114 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:18.114 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.114 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.114 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:18.114 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:18.114 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8699999999999995e-07 2023-09-30T17:03:18.114 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.114 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.114 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:18.114 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353067+0000", 2023-09-30T17:03:18.114 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.605e-06 2023-09-30T17:03:18.114 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.115 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.115 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:18.115 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353073+0000", 2023-09-30T17:03:18.115 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8900000000000004e-06 2023-09-30T17:03:18.115 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.115 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.115 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:18.115 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353083+0000", 2023-09-30T17:03:18.115 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0200000000000001e-05 2023-09-30T17:03:18.115 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.115 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.115 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:18.116 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353186+0000", 2023-09-30T17:03:18.116 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010256599999999999 2023-09-30T17:03:18.116 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.116 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.116 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:18.116 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353190+0000", 2023-09-30T17:03:18.116 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9709999999999998e-06 2023-09-30T17:03:18.116 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.116 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.116 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:18.116 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362946+0000", 2023-09-30T17:03:18.116 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0097563330000000007 2023-09-30T17:03:18.117 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.117 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.117 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:18.117 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363088+0000", 2023-09-30T17:03:18.117 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014259200000000001 2023-09-30T17:03:18.117 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.117 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.117 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:18.117 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363555+0000", 2023-09-30T17:03:18.117 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00046627799999999998 2023-09-30T17:03:18.117 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.117 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.118 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:18.118 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365871+0000", 2023-09-30T17:03:18.118 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0023167589999999998 2023-09-30T17:03:18.118 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.118 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.118 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:18.118 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377033+0000", 2023-09-30T17:03:18.118 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011161203999999999 2023-09-30T17:03:18.118 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.118 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.118 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:18.118 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377100+0000", 2023-09-30T17:03:18.119 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7230999999999994e-05 2023-09-30T17:03:18.119 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.119 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.119 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:18.119 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377138+0000", 2023-09-30T17:03:18.119 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8022000000000003e-05 2023-09-30T17:03:18.119 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:18.119 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:18.119 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:18.119 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.119 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.119 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:18.120 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:03:18.120 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 59.687489169000003, 2023-09-30T17:03:18.120 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.020304412000000001, 2023-09-30T17:03:18.120 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:18.120 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:18.120 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:18.120 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.120 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:18.120 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:03:18.120 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:18.120 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.120 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.121 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:18.121 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:03:18.121 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:18.121 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.121 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.121 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:18.121 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353164+0000", 2023-09-30T17:03:18.121 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7100000000000011e-07 2023-09-30T17:03:18.121 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.121 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.121 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:18.121 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353168+0000", 2023-09-30T17:03:18.121 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0600000000000001e-06 2023-09-30T17:03:18.122 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.122 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.122 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:18.122 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353177+0000", 2023-09-30T17:03:18.122 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1409999999999994e-06 2023-09-30T17:03:18.122 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.122 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.122 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:18.122 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353185+0000", 2023-09-30T17:03:18.122 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2479999999999996e-06 2023-09-30T17:03:18.122 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.123 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.123 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:18.123 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353246+0000", 2023-09-30T17:03:18.123 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0519000000000001e-05 2023-09-30T17:03:18.123 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.123 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.123 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:18.123 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353252+0000", 2023-09-30T17:03:18.123 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7859999999999999e-06 2023-09-30T17:03:18.123 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.123 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.123 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:18.124 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354979+0000", 2023-09-30T17:03:18.124 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0017270090000000001 2023-09-30T17:03:18.124 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.124 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.124 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:18.124 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355097+0000", 2023-09-30T17:03:18.124 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000117472 2023-09-30T17:03:18.124 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.124 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.124 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:18.124 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.373467+0000", 2023-09-30T17:03:18.124 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.018370206 2023-09-30T17:03:18.125 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:18.125 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:18.125 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:18.125 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.125 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.125 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:18.125 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:03:18.125 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 59.687448431, 2023-09-30T17:03:18.125 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.012725089, 2023-09-30T17:03:18.125 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:18.125 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:18.125 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:18.126 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.126 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:18.126 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:03:18.126 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:18.126 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.126 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.126 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:18.126 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:03:18.126 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:18.126 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.126 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.126 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:18.127 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353204+0000", 2023-09-30T17:03:18.127 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7100000000000002e-07 2023-09-30T17:03:18.127 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.127 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.127 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:18.127 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353213+0000", 2023-09-30T17:03:18.127 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8580000000000006e-06 2023-09-30T17:03:18.127 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.127 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.127 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:18.127 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353219+0000", 2023-09-30T17:03:18.127 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8939999999999998e-06 2023-09-30T17:03:18.128 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.128 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.128 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:18.128 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353223+0000", 2023-09-30T17:03:18.128 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.357e-06 2023-09-30T17:03:18.128 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.128 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.128 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:18.128 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353278+0000", 2023-09-30T17:03:18.128 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5228e-05 2023-09-30T17:03:18.128 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.128 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.129 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:18.129 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353284+0000", 2023-09-30T17:03:18.129 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8209999999999998e-06 2023-09-30T17:03:18.129 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.129 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.129 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:18.129 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355095+0000", 2023-09-30T17:03:18.129 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001811404 2023-09-30T17:03:18.129 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.129 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.129 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:18.130 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355256+0000", 2023-09-30T17:03:18.130 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000160898 2023-09-30T17:03:18.130 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.130 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.130 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:18.130 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365928+0000", 2023-09-30T17:03:18.130 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010672157999999999 2023-09-30T17:03:18.130 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:18.130 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:18.130 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:18.130 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.130 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.131 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-09-30T17:03:18.131 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:03:18.131 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 59.686917223999998, 2023-09-30T17:03:18.131 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0056863460000000001, 2023-09-30T17:03:18.131 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:18.131 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "reached pg", 2023-09-30T17:03:18.131 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:18.131 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.131 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:18.131 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:03:18.131 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:18.131 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.131 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.132 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:18.132 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:03:18.132 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:18.132 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.132 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.132 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:18.132 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:03:18.132 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5700000000000002e-07 2023-09-30T17:03:18.132 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.132 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.132 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:18.133 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353747+0000", 2023-09-30T17:03:18.133 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1899000000000001e-05 2023-09-30T17:03:18.133 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.133 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.133 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:18.133 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353776+0000", 2023-09-30T17:03:18.133 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.8767000000000001e-05 2023-09-30T17:03:18.133 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.133 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.133 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:18.133 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353792+0000", 2023-09-30T17:03:18.133 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5914999999999999e-05 2023-09-30T17:03:18.134 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.134 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.134 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:18.134 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353900+0000", 2023-09-30T17:03:18.134 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010774500000000001 2023-09-30T17:03:18.134 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.134 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.134 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:18.134 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.359421+0000", 2023-09-30T17:03:18.134 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0055213629999999996 2023-09-30T17:03:18.134 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:18.135 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:18.135 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:18.135 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.135 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.135 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:03:18.135 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:03:18.135 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 59.686245624000001, 2023-09-30T17:03:18.135 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0069196370000000002, 2023-09-30T17:03:18.135 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:18.135 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:18.135 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:18.135 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.136 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:18.136 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:03:18.136 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:18.136 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.136 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.136 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:18.136 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:03:18.136 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:18.136 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.136 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.136 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:18.136 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354407+0000", 2023-09-30T17:03:18.137 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7400000000000002e-07 2023-09-30T17:03:18.137 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.137 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.137 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:18.137 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354414+0000", 2023-09-30T17:03:18.137 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1040000000000001e-06 2023-09-30T17:03:18.137 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.137 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.137 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:18.137 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354425+0000", 2023-09-30T17:03:18.137 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1090000000000001e-05 2023-09-30T17:03:18.138 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.138 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.138 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:18.138 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354435+0000", 2023-09-30T17:03:18.138 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8169999999999994e-06 2023-09-30T17:03:18.138 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.138 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.138 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:18.138 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355741+0000", 2023-09-30T17:03:18.138 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0013063160000000001 2023-09-30T17:03:18.138 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.139 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.139 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:18.139 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355763+0000", 2023-09-30T17:03:18.139 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1688e-05 2023-09-30T17:03:18.139 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.139 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.139 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:18.139 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361289+0000", 2023-09-30T17:03:18.139 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0055258269999999996 2023-09-30T17:03:18.139 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.139 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.139 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:18.140 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361326+0000", 2023-09-30T17:03:18.140 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7020999999999997e-05 2023-09-30T17:03:18.140 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:18.140 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:18.140 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:18.140 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.140 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.140 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:30 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2023-09-30T17:03:18.140 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:03:18.140 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 59.684871665999999, 2023-09-30T17:03:18.140 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0069996629999999997, 2023-09-30T17:03:18.141 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:18.141 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:18.141 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:18.141 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.141 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:18.141 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:03:18.141 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:18.141 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.141 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.141 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:18.141 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:03:18.141 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:18.142 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.142 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.142 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:18.142 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355781+0000", 2023-09-30T17:03:18.142 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9599999999999999e-07 2023-09-30T17:03:18.142 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.142 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.142 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:18.142 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355788+0000", 2023-09-30T17:03:18.142 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8129999999999996e-06 2023-09-30T17:03:18.142 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.143 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.143 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:18.143 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355798+0000", 2023-09-30T17:03:18.143 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2909999999999996e-06 2023-09-30T17:03:18.143 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.143 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.143 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:18.143 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355807+0000", 2023-09-30T17:03:18.143 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8619999999999992e-06 2023-09-30T17:03:18.143 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.143 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.143 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:18.144 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.357264+0000", 2023-09-30T17:03:18.144 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0014578289999999999 2023-09-30T17:03:18.144 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.144 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.144 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:18.144 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.357916+0000", 2023-09-30T17:03:18.144 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00065170500000000004 2023-09-30T17:03:18.144 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.144 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.144 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:18.144 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362731+0000", 2023-09-30T17:03:18.144 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0048149849999999999 2023-09-30T17:03:18.145 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.145 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.145 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:18.145 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362780+0000", 2023-09-30T17:03:18.145 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8681999999999999e-05 2023-09-30T17:03:18.145 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:18.145 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:18.145 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:18.145 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.145 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.145 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2023-09-30T17:03:18.146 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:03:18.146 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 59.666220615, 2023-09-30T17:03:18.146 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005905998, 2023-09-30T17:03:18.146 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:18.146 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:18.146 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:18.146 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.146 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:18.146 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:03:18.146 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:18.146 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.146 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.147 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:18.147 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:03:18.147 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:18.147 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.147 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.147 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:18.147 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:03:18.147 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1e-07 2023-09-30T17:03:18.147 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.148 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.148 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:18.148 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374455+0000", 2023-09-30T17:03:18.148 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.3091999999999998e-05 2023-09-30T17:03:18.148 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.148 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.148 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:18.148 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374462+0000", 2023-09-30T17:03:18.148 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5170000000000002e-06 2023-09-30T17:03:18.148 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.148 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.149 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:18.149 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374469+0000", 2023-09-30T17:03:18.149 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8199999999999999e-06 2023-09-30T17:03:18.149 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.149 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.149 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:18.149 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374550+0000", 2023-09-30T17:03:18.149 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0978999999999998e-05 2023-09-30T17:03:18.149 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.150 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.150 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:18.150 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374562+0000", 2023-09-30T17:03:18.150 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2472e-05 2023-09-30T17:03:18.150 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.150 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.150 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:18.150 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380293+0000", 2023-09-30T17:03:18.150 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0057310379999999999 2023-09-30T17:03:18.150 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.150 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.151 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:18.151 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380337+0000", 2023-09-30T17:03:18.151 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3869999999999998e-05 2023-09-30T17:03:18.151 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:18.151 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:18.151 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:18.151 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.151 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.151 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2023-09-30T17:03:18.151 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:03:18.151 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 59.666033865999999, 2023-09-30T17:03:18.151 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0057590560000000002, 2023-09-30T17:03:18.152 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:18.152 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:18.152 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:18.152 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.152 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:18.152 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:03:18.152 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:18.152 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.152 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.152 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:18.152 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:03:18.152 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:18.153 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.153 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.153 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:18.153 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:03:18.153 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4900000000000001e-07 2023-09-30T17:03:18.153 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.153 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.153 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:18.153 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374629+0000", 2023-09-30T17:03:18.153 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1014e-05 2023-09-30T17:03:18.153 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.153 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.154 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:18.154 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374636+0000", 2023-09-30T17:03:18.154 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5889999999999999e-06 2023-09-30T17:03:18.154 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.154 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.154 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:18.154 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374642+0000", 2023-09-30T17:03:18.154 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.48e-06 2023-09-30T17:03:18.154 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.154 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.154 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:18.154 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374681+0000", 2023-09-30T17:03:18.155 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9320000000000003e-05 2023-09-30T17:03:18.155 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.155 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.155 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:18.155 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374694+0000", 2023-09-30T17:03:18.155 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3351e-05 2023-09-30T17:03:18.155 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.155 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.155 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:18.155 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380319+0000", 2023-09-30T17:03:18.155 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0056243880000000001 2023-09-30T17:03:18.155 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.156 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.156 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:18.156 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380377+0000", 2023-09-30T17:03:18.156 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8464999999999997e-05 2023-09-30T17:03:18.156 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:18.156 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:18.156 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:18.156 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.156 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.156 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=0'0)", 2023-09-30T17:03:18.156 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:03:18.156 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 59.665322955000001, 2023-09-30T17:03:18.157 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051157370000000004, 2023-09-30T17:03:18.157 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:18.157 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:18.157 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:18.157 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.157 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:18.157 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:03:18.157 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:18.157 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.157 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.157 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:18.157 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:03:18.158 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:18.158 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.158 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.158 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:18.158 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:03:18.158 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0199999999999998e-07 2023-09-30T17:03:18.158 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.158 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.158 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:18.158 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375334+0000", 2023-09-30T17:03:18.158 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8799999999999999e-06 2023-09-30T17:03:18.158 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.159 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.159 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:18.159 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375343+0000", 2023-09-30T17:03:18.159 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5490000000000006e-06 2023-09-30T17:03:18.159 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.159 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.159 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:18.159 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375350+0000", 2023-09-30T17:03:18.159 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5700000000000004e-06 2023-09-30T17:03:18.159 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.159 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.159 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:18.159 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375396+0000", 2023-09-30T17:03:18.160 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5550999999999998e-05 2023-09-30T17:03:18.160 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.160 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.160 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:18.160 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375410+0000", 2023-09-30T17:03:18.160 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4518999999999999e-05 2023-09-30T17:03:18.160 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.160 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.160 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:18.160 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380401+0000", 2023-09-30T17:03:18.160 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0049903430000000004 2023-09-30T17:03:18.160 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:18.161 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:18.161 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:18.161 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380445+0000", 2023-09-30T17:03:18.161 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4023000000000002e-05 2023-09-30T17:03:18.161 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:18.161 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:18.161 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:18.161 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:18.161 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:18.161 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:18.163 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:03:18.163 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:18.162+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:18.190 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-09-30T17:03:18.263 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:18.262+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:18.293 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:18.294 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:03:18.294 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2023-09-30T17:03:18.294 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:18.304 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:03:18.364 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:18.364+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:18.385 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:03:18.406 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:03:18.406 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-09-30T17:03:18.406 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-09-30T17:03:18.406 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:03:18.410 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:03:18.410 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:03:18.430 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:18.430 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:18.440 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:03:18.464 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:18.464+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:18.565 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:18.565+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:18.567 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:18.567 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:18.577 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:03:18.666 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:18.666+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:18.722 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:18.722 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:18.733 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:03:18.767 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:18.767+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:18.865 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:18.865 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:18.868 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:18.867+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:18.875 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:03:18.969 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:18.969+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:19.046 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:19.046 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:19.057 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:03:19.070 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:19.070+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:19.170 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:19.170+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:19.186 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:19.186 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:19.196 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:03:19.271 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:19.271+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:19.321 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:19.321 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:19.331 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:03:19.332 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-09-30T17:03:19.375 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:19.375+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:19.456 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:19.457 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:19.466 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:03:19.510 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:19.510+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:19.574 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:19.574+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:19.601 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:19.601 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:19.611 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:03:19.695 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:19.695+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:19.776 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:19.775+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:19.783 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:19.783 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:19.794 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:03:19.876 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:19.876+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:19.965 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:19.965 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:19.976 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:03:19.977 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:19.976+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:20.078 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:20.078+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:20.107 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:20.108 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:20.117 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:03:20.179 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:20.178+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:20.279 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:20.280+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:20.284 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:20.284 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:20.294 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:03:20.323 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is unset 2023-09-30T17:03:20.380 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:20.379+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:20.411 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-09-30T17:03:20.461 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:20.462 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:20.471 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:03:20.515 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:20.515+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:20.559 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:03:20.579 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:03:20.579 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-09-30T17:03:20.580 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-09-30T17:03:20.580 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:03:20.582 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:20.582+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:20.582 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:03:20.583 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:03:20.608 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:20.608 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:03:20.608 INFO:teuthology.orchestra.run.smithi031.stdout: "num_ops": 0 2023-09-30T17:03:20.609 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:20.618 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:03:20.682 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:20.683+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:20.783 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:20.782+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:20.790 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:20.790 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:03:20.790 INFO:teuthology.orchestra.run.smithi031.stdout: "complaint_time": 30, 2023-09-30T17:03:20.790 INFO:teuthology.orchestra.run.smithi031.stdout: "num_blocked_ops": 0 2023-09-30T17:03:20.790 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:20.800 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:03:20.884 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:20.884+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:20.974 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:20.974 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 20, 2023-09-30T17:03:20.974 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 600, 2023-09-30T17:03:20.974 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:03:20.974 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.975 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:32 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'18, mlcod=11'14)", 2023-09-30T17:03:20.975 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:03:20.975 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 73.611795177000005, 2023-09-30T17:03:20.975 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051629809999999996, 2023-09-30T17:03:20.975 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:20.975 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:20.975 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:20.975 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.975 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:20.975 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:03:20.976 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:20.976 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:20.976 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.976 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:20.976 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:03:20.976 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:20.976 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:20.976 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.976 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:20.976 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:03:20.976 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2099999999999996e-07 2023-09-30T17:03:20.976 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:20.977 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.977 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:20.977 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361407+0000", 2023-09-30T17:03:20.977 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7499e-05 2023-09-30T17:03:20.977 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:20.977 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.977 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:20.977 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361418+0000", 2023-09-30T17:03:20.977 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1127999999999999e-05 2023-09-30T17:03:20.977 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:20.977 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.977 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:20.978 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361423+0000", 2023-09-30T17:03:20.978 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1930000000000001e-06 2023-09-30T17:03:20.978 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:20.978 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.978 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:20.978 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361476+0000", 2023-09-30T17:03:20.978 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3399000000000002e-05 2023-09-30T17:03:20.978 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:20.978 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.978 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:20.978 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361496+0000", 2023-09-30T17:03:20.979 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9638000000000001e-05 2023-09-30T17:03:20.979 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:20.979 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.979 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:20.979 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.366474+0000", 2023-09-30T17:03:20.979 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0049778829999999998 2023-09-30T17:03:20.979 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:20.979 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.979 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:20.979 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.366512+0000", 2023-09-30T17:03:20.979 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7620000000000002e-05 2023-09-30T17:03:20.979 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:20.980 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:20.980 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:20.980 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:20.980 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.980 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:37 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'23, mlcod=11'15)", 2023-09-30T17:03:20.980 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:03:20.980 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 73.609193180000005, 2023-09-30T17:03:20.980 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053985689999999998, 2023-09-30T17:03:20.980 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:20.980 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:20.980 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:20.980 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.981 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:20.981 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:03:20.981 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:20.981 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:20.981 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.981 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:20.981 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:03:20.981 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:20.981 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:20.981 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.981 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:20.982 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:03:20.982 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4400000000000001e-07 2023-09-30T17:03:20.982 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:20.982 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.982 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:20.982 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363956+0000", 2023-09-30T17:03:20.982 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.921e-06 2023-09-30T17:03:20.982 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:20.982 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.982 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:20.982 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363966+0000", 2023-09-30T17:03:20.982 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0351e-05 2023-09-30T17:03:20.983 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:20.983 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.983 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:20.983 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363971+0000", 2023-09-30T17:03:20.983 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.023e-06 2023-09-30T17:03:20.983 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:20.983 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.983 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:20.983 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.364013+0000", 2023-09-30T17:03:20.983 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1575000000000001e-05 2023-09-30T17:03:20.983 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:20.983 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.983 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:20.984 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.364026+0000", 2023-09-30T17:03:20.984 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3044000000000001e-05 2023-09-30T17:03:20.984 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:20.984 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.984 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:20.984 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.369308+0000", 2023-09-30T17:03:20.984 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005282152 2023-09-30T17:03:20.984 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:20.984 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.984 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:20.984 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.369349+0000", 2023-09-30T17:03:20.984 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1059000000000001e-05 2023-09-30T17:03:20.985 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:20.985 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:20.985 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:20.985 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:20.985 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.985 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:155 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'109, mlcod=11'105)", 2023-09-30T17:03:20.985 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:03:20.985 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 73.127497493999996, 2023-09-30T17:03:20.985 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053867639999999996, 2023-09-30T17:03:20.985 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:20.985 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:20.985 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:20.986 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.986 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:20.986 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:03:20.986 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:20.986 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:20.986 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.986 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:20.986 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:03:20.986 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:20.986 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:20.986 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.986 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:20.987 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845647+0000", 2023-09-30T17:03:20.987 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7599999999999997e-07 2023-09-30T17:03:20.987 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:20.987 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.987 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:20.987 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845699+0000", 2023-09-30T17:03:20.987 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1758000000000001e-05 2023-09-30T17:03:20.987 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:20.987 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.987 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:20.987 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845708+0000", 2023-09-30T17:03:20.987 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2159999999999995e-06 2023-09-30T17:03:20.988 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:20.988 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.988 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:20.988 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845712+0000", 2023-09-30T17:03:20.988 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2579999999999997e-06 2023-09-30T17:03:20.988 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:20.988 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.988 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:20.988 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845756+0000", 2023-09-30T17:03:20.988 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4119999999999998e-05 2023-09-30T17:03:20.988 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:20.988 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.989 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:20.989 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845779+0000", 2023-09-30T17:03:20.989 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2311e-05 2023-09-30T17:03:20.989 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:20.989 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.989 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:20.989 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.850982+0000", 2023-09-30T17:03:20.989 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005203053 2023-09-30T17:03:20.989 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:20.989 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.989 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:20.989 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851033+0000", 2023-09-30T17:03:20.990 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1471999999999998e-05 2023-09-30T17:03:20.990 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:20.990 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:20.990 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:20.990 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:20.990 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.990 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:156 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'110, mlcod=11'105)", 2023-09-30T17:03:20.990 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:03:20.990 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 73.126964568000005, 2023-09-30T17:03:20.990 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0052834759999999996, 2023-09-30T17:03:20.990 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:20.991 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:20.991 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:20.991 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.991 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:20.991 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:03:20.991 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:20.991 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:20.991 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.991 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:20.991 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:03:20.991 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:20.991 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:20.992 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.992 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:20.992 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846180+0000", 2023-09-30T17:03:20.992 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6300000000000005e-07 2023-09-30T17:03:20.992 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:20.992 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.992 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:20.992 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846184+0000", 2023-09-30T17:03:20.992 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3789999999999999e-06 2023-09-30T17:03:20.992 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:20.992 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.992 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:20.993 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846195+0000", 2023-09-30T17:03:20.993 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0778000000000001e-05 2023-09-30T17:03:20.993 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:20.993 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.993 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:20.993 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846200+0000", 2023-09-30T17:03:20.993 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1540000000000001e-06 2023-09-30T17:03:20.993 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:20.993 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.993 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:20.993 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846274+0000", 2023-09-30T17:03:20.993 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4129999999999997e-05 2023-09-30T17:03:20.994 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:20.994 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.994 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:20.994 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846286+0000", 2023-09-30T17:03:20.994 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1744e-05 2023-09-30T17:03:20.994 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:20.994 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.994 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:20.994 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851432+0000", 2023-09-30T17:03:20.994 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051462110000000004 2023-09-30T17:03:20.994 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:20.995 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.995 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:20.995 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851463+0000", 2023-09-30T17:03:20.995 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0516999999999999e-05 2023-09-30T17:03:20.995 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:20.995 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:20.995 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:20.995 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:20.995 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.995 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:203 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'149, mlcod=11'145)", 2023-09-30T17:03:20.995 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:03:20.995 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 72.770928659000006, 2023-09-30T17:03:20.996 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051867459999999999, 2023-09-30T17:03:20.996 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:20.996 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:20.996 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:20.996 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.996 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:20.996 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:03:20.996 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:20.996 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:20.996 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.996 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:20.996 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:03:20.997 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:20.997 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:20.997 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.997 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:20.997 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202216+0000", 2023-09-30T17:03:20.997 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7e-07 2023-09-30T17:03:20.997 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:20.997 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.997 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:20.997 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202271+0000", 2023-09-30T17:03:20.997 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5163e-05 2023-09-30T17:03:20.997 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:20.998 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.998 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:20.998 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202282+0000", 2023-09-30T17:03:20.998 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1319e-05 2023-09-30T17:03:20.998 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:20.998 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.998 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:20.998 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202288+0000", 2023-09-30T17:03:20.998 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2899999999999999e-06 2023-09-30T17:03:20.998 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:20.998 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.998 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:20.999 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202331+0000", 2023-09-30T17:03:20.999 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2147999999999997e-05 2023-09-30T17:03:20.999 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:20.999 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.999 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:20.999 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202348+0000", 2023-09-30T17:03:20.999 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7317e-05 2023-09-30T17:03:20.999 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:20.999 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:20.999 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:20.999 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.207357+0000", 2023-09-30T17:03:20.999 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0050095440000000003 2023-09-30T17:03:21.000 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.000 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.000 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:21.000 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.207402+0000", 2023-09-30T17:03:21.000 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4495e-05 2023-09-30T17:03:21.000 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:21.000 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:21.000 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:21.000 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.000 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.000 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:21.000 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:03:21.000 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 62.621598370999997, 2023-09-30T17:03:21.001 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.025313649000000001, 2023-09-30T17:03:21.001 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:21.001 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:21.001 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:21.001 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.001 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:21.001 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:03:21.001 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:21.001 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.001 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.001 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:21.001 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:03:21.001 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:21.002 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.002 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.002 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:21.002 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351551+0000", 2023-09-30T17:03:21.002 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3380000000000004e-06 2023-09-30T17:03:21.002 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.002 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.002 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:21.002 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351559+0000", 2023-09-30T17:03:21.002 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9589999999999995e-06 2023-09-30T17:03:21.002 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.003 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.003 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:21.003 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351571+0000", 2023-09-30T17:03:21.003 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2065999999999999e-05 2023-09-30T17:03:21.003 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.003 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.003 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:21.003 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351706+0000", 2023-09-30T17:03:21.003 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00013553799999999999 2023-09-30T17:03:21.003 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.003 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.004 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:21.004 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353016+0000", 2023-09-30T17:03:21.004 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0013099209999999999 2023-09-30T17:03:21.004 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.004 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.004 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:21.004 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353023+0000", 2023-09-30T17:03:21.004 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2479999999999999e-06 2023-09-30T17:03:21.004 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.004 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.004 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:21.004 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360348+0000", 2023-09-30T17:03:21.005 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0073248949999999997 2023-09-30T17:03:21.005 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.005 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.005 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:21.005 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360787+0000", 2023-09-30T17:03:21.005 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00043875199999999999 2023-09-30T17:03:21.005 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.005 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.005 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:21.005 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360892+0000", 2023-09-30T17:03:21.005 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010508199999999999 2023-09-30T17:03:21.005 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.006 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.006 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:21.006 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365132+0000", 2023-09-30T17:03:21.006 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0042396480000000004 2023-09-30T17:03:21.006 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.006 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.006 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:21.006 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376746+0000", 2023-09-30T17:03:21.006 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011614157 2023-09-30T17:03:21.006 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.006 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.006 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:21.007 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376811+0000", 2023-09-30T17:03:21.007 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5005999999999994e-05 2023-09-30T17:03:21.007 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.007 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.007 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:21.007 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376859+0000", 2023-09-30T17:03:21.007 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8038999999999999e-05 2023-09-30T17:03:21.007 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:21.007 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:21.007 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:21.007 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.007 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.008 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:21.008 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:03:21.008 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 62.621100572000003, 2023-09-30T17:03:21.008 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024923989000000001, 2023-09-30T17:03:21.008 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:21.008 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:21.008 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:21.008 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.008 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:21.008 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:03:21.008 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:21.008 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.009 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.009 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:21.009 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:03:21.009 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:21.009 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.009 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.009 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:21.009 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352044+0000", 2023-09-30T17:03:21.009 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9199999999999999e-07 2023-09-30T17:03:21.009 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.009 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.009 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:21.010 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352050+0000", 2023-09-30T17:03:21.010 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8880000000000002e-06 2023-09-30T17:03:21.010 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.010 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.010 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:21.010 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352143+0000", 2023-09-30T17:03:21.010 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2721999999999998e-05 2023-09-30T17:03:21.010 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.010 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.010 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:21.010 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352155+0000", 2023-09-30T17:03:21.011 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2279000000000001e-05 2023-09-30T17:03:21.011 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.011 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.011 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:21.011 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353114+0000", 2023-09-30T17:03:21.011 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00095943700000000005 2023-09-30T17:03:21.011 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.011 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.011 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:21.011 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353121+0000", 2023-09-30T17:03:21.011 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.494e-06 2023-09-30T17:03:21.011 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.012 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.012 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:21.012 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361491+0000", 2023-09-30T17:03:21.012 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0083697359999999991 2023-09-30T17:03:21.012 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.012 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.012 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:21.012 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361573+0000", 2023-09-30T17:03:21.012 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2822000000000001e-05 2023-09-30T17:03:21.013 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.013 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.013 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:21.013 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362166+0000", 2023-09-30T17:03:21.013 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00059223299999999995 2023-09-30T17:03:21.013 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.013 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.013 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:21.013 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365209+0000", 2023-09-30T17:03:21.013 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.003043212 2023-09-30T17:03:21.013 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.014 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.014 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:21.014 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376910+0000", 2023-09-30T17:03:21.014 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011700898 2023-09-30T17:03:21.014 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.014 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.014 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:21.014 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376945+0000", 2023-09-30T17:03:21.014 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4795000000000001e-05 2023-09-30T17:03:21.014 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.014 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.014 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:21.015 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376967+0000", 2023-09-30T17:03:21.015 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2580999999999999e-05 2023-09-30T17:03:21.015 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:21.015 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:21.015 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:21.015 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.015 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.015 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:21.015 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:03:21.015 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 62.620930651999998, 2023-09-30T17:03:21.015 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023120405, 2023-09-30T17:03:21.015 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:21.016 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:21.016 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:21.016 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.016 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:21.016 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:03:21.016 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:21.016 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.016 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.016 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:21.016 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:03:21.016 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:21.016 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.017 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.017 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:21.017 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352214+0000", 2023-09-30T17:03:21.017 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8400000000000003e-07 2023-09-30T17:03:21.017 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.017 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.017 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:21.017 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352233+0000", 2023-09-30T17:03:21.017 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8946000000000001e-05 2023-09-30T17:03:21.017 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.017 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.017 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:21.017 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352297+0000", 2023-09-30T17:03:21.018 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3540999999999994e-05 2023-09-30T17:03:21.018 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.018 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.018 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:21.018 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352450+0000", 2023-09-30T17:03:21.018 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015364799999999999 2023-09-30T17:03:21.018 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.018 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.018 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:21.018 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353098+0000", 2023-09-30T17:03:21.018 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00064820299999999997 2023-09-30T17:03:21.019 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.019 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.019 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:21.019 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353103+0000", 2023-09-30T17:03:21.019 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0529999999999997e-06 2023-09-30T17:03:21.019 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.019 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.019 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:21.019 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.358558+0000", 2023-09-30T17:03:21.019 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0054550249999999996 2023-09-30T17:03:21.019 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.019 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.020 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:21.020 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.358741+0000", 2023-09-30T17:03:21.020 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00018210200000000001 2023-09-30T17:03:21.020 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.020 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.020 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:21.020 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.359683+0000", 2023-09-30T17:03:21.020 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00094202299999999995 2023-09-30T17:03:21.020 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.020 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.020 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:21.020 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365044+0000", 2023-09-30T17:03:21.020 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053616219999999999 2023-09-30T17:03:21.021 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.021 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.021 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:21.021 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375256+0000", 2023-09-30T17:03:21.021 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010212156 2023-09-30T17:03:21.021 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.021 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.021 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:21.021 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375300+0000", 2023-09-30T17:03:21.021 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3961999999999997e-05 2023-09-30T17:03:21.021 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.021 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.022 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:21.022 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375334+0000", 2023-09-30T17:03:21.022 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.324e-05 2023-09-30T17:03:21.022 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:21.022 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:21.022 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:21.022 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.022 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.022 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:21.022 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:03:21.022 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 62.620615634000004, 2023-09-30T17:03:21.023 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024240660000000001, 2023-09-30T17:03:21.023 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:21.023 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:21.023 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:21.023 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.023 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:21.023 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:03:21.023 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:21.023 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.023 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.023 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:21.023 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:03:21.024 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:21.024 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.024 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.024 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:21.024 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352529+0000", 2023-09-30T17:03:21.024 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1379999999999999e-06 2023-09-30T17:03:21.024 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.024 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.024 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:21.024 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352536+0000", 2023-09-30T17:03:21.024 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3489999999999997e-06 2023-09-30T17:03:21.024 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.024 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.025 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:21.025 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352547+0000", 2023-09-30T17:03:21.025 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1109e-05 2023-09-30T17:03:21.025 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.025 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.025 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:21.025 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352560+0000", 2023-09-30T17:03:21.025 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3046e-05 2023-09-30T17:03:21.025 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.025 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.025 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:21.026 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353142+0000", 2023-09-30T17:03:21.026 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00058174699999999997 2023-09-30T17:03:21.026 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.026 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.026 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:21.026 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353147+0000", 2023-09-30T17:03:21.026 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5840000000000002e-06 2023-09-30T17:03:21.026 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.026 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.026 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:21.026 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360374+0000", 2023-09-30T17:03:21.026 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0072270049999999999 2023-09-30T17:03:21.027 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.027 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.027 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:21.027 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360795+0000", 2023-09-30T17:03:21.027 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00042088999999999999 2023-09-30T17:03:21.027 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.027 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.027 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:21.027 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360967+0000", 2023-09-30T17:03:21.027 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017235699999999999 2023-09-30T17:03:21.027 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.028 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.028 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:21.028 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365051+0000", 2023-09-30T17:03:21.028 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0040837429999999999 2023-09-30T17:03:21.028 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.028 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.028 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:21.028 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376708+0000", 2023-09-30T17:03:21.028 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011656866 2023-09-30T17:03:21.028 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.028 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.028 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:21.028 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376745+0000", 2023-09-30T17:03:21.029 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6769e-05 2023-09-30T17:03:21.029 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.029 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.029 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:21.029 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376769+0000", 2023-09-30T17:03:21.029 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4057e-05 2023-09-30T17:03:21.029 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:21.029 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:21.029 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:21.029 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.029 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.029 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:21.030 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:21.030 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 62.620356278999999, 2023-09-30T17:03:21.030 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023472704, 2023-09-30T17:03:21.030 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:21.030 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:21.030 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:21.030 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.030 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:21.030 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:21.030 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:21.030 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.030 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.031 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:21.031 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:21.031 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:21.031 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.031 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.031 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:21.031 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:21.031 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8000000000000005e-07 2023-09-30T17:03:21.031 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.031 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.031 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:21.031 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352794+0000", 2023-09-30T17:03:21.032 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.789e-06 2023-09-30T17:03:21.032 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.032 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.032 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:21.032 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352805+0000", 2023-09-30T17:03:21.032 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0848e-05 2023-09-30T17:03:21.032 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.032 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.032 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:21.032 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352812+0000", 2023-09-30T17:03:21.032 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4449999999999999e-06 2023-09-30T17:03:21.032 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.032 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.033 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:21.033 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353063+0000", 2023-09-30T17:03:21.033 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00025046299999999998 2023-09-30T17:03:21.033 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.033 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.033 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:21.033 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353071+0000", 2023-09-30T17:03:21.033 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6739999999999997e-06 2023-09-30T17:03:21.033 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.033 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.033 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:21.033 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361696+0000", 2023-09-30T17:03:21.034 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0086251609999999992 2023-09-30T17:03:21.034 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.034 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.034 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:21.034 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362284+0000", 2023-09-30T17:03:21.034 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00058872299999999998 2023-09-30T17:03:21.034 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.034 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.034 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:21.034 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362429+0000", 2023-09-30T17:03:21.034 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014509000000000001 2023-09-30T17:03:21.035 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.035 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.035 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:21.035 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365330+0000", 2023-09-30T17:03:21.035 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0029005419999999999 2023-09-30T17:03:21.035 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.035 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.035 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:21.035 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376196+0000", 2023-09-30T17:03:21.035 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.01086615 2023-09-30T17:03:21.035 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.035 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.036 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:21.036 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376230+0000", 2023-09-30T17:03:21.036 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3858e-05 2023-09-30T17:03:21.036 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.036 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.036 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:21.036 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376260+0000", 2023-09-30T17:03:21.036 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0181000000000001e-05 2023-09-30T17:03:21.036 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:21.036 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:21.036 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:21.037 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.037 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.037 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:21.037 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:03:21.037 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 62.620122709, 2023-09-30T17:03:21.037 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023406132999999999, 2023-09-30T17:03:21.037 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:21.037 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:21.037 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:21.037 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.037 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:21.037 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:03:21.037 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:21.038 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.038 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.038 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:21.038 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:03:21.038 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:21.038 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.038 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.038 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:21.038 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353022+0000", 2023-09-30T17:03:21.038 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.78e-07 2023-09-30T17:03:21.038 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.038 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.039 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:21.039 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353027+0000", 2023-09-30T17:03:21.039 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9089999999999999e-06 2023-09-30T17:03:21.039 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.039 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.039 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:21.039 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353035+0000", 2023-09-30T17:03:21.039 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0430000000000008e-06 2023-09-30T17:03:21.039 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.039 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.039 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:21.039 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353047+0000", 2023-09-30T17:03:21.040 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1674e-05 2023-09-30T17:03:21.040 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.040 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.040 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:21.040 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353105+0000", 2023-09-30T17:03:21.040 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8891999999999998e-05 2023-09-30T17:03:21.040 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.040 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.040 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:21.040 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353112+0000", 2023-09-30T17:03:21.040 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7059999999999998e-06 2023-09-30T17:03:21.040 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.041 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.041 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:21.041 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362733+0000", 2023-09-30T17:03:21.041 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0096205869999999999 2023-09-30T17:03:21.041 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.041 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.041 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:21.041 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362833+0000", 2023-09-30T17:03:21.041 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000100227 2023-09-30T17:03:21.041 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.041 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.041 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:21.042 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363000+0000", 2023-09-30T17:03:21.042 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016670899999999999 2023-09-30T17:03:21.042 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.042 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.042 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:21.042 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365550+0000", 2023-09-30T17:03:21.042 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0025499199999999998 2023-09-30T17:03:21.042 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.042 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.042 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:21.042 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376315+0000", 2023-09-30T17:03:21.042 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010765011999999999 2023-09-30T17:03:21.043 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.043 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.043 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:21.045 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376386+0000", 2023-09-30T17:03:21.045 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0866999999999998e-05 2023-09-30T17:03:21.045 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.045 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.045 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:21.045 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376427+0000", 2023-09-30T17:03:21.045 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1709000000000003e-05 2023-09-30T17:03:21.045 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:21.045 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:21.046 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:21.046 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.046 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.046 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:21.046 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:21.046 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 62.620082072999999, 2023-09-30T17:03:21.046 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024076238, 2023-09-30T17:03:21.046 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:21.046 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:21.046 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:21.047 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.047 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:21.047 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:21.047 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:21.047 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.047 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.047 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:21.047 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:21.047 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:21.047 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.048 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.048 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:21.048 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:21.048 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8699999999999995e-07 2023-09-30T17:03:21.048 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.048 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.048 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:21.048 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353067+0000", 2023-09-30T17:03:21.048 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.605e-06 2023-09-30T17:03:21.048 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.048 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.048 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:21.049 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353073+0000", 2023-09-30T17:03:21.049 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8900000000000004e-06 2023-09-30T17:03:21.049 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.049 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.049 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:21.049 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353083+0000", 2023-09-30T17:03:21.049 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0200000000000001e-05 2023-09-30T17:03:21.049 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.049 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.049 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:21.049 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353186+0000", 2023-09-30T17:03:21.049 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010256599999999999 2023-09-30T17:03:21.050 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.050 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.050 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:21.050 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353190+0000", 2023-09-30T17:03:21.050 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9709999999999998e-06 2023-09-30T17:03:21.050 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.050 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.050 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:21.050 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362946+0000", 2023-09-30T17:03:21.050 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0097563330000000007 2023-09-30T17:03:21.050 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.050 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.051 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:21.051 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363088+0000", 2023-09-30T17:03:21.051 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014259200000000001 2023-09-30T17:03:21.051 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.051 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.051 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:21.051 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363555+0000", 2023-09-30T17:03:21.051 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00046627799999999998 2023-09-30T17:03:21.051 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.051 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.051 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:21.051 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365871+0000", 2023-09-30T17:03:21.052 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0023167589999999998 2023-09-30T17:03:21.052 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.052 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.052 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:21.052 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377033+0000", 2023-09-30T17:03:21.052 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011161203999999999 2023-09-30T17:03:21.052 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.052 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.052 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:21.052 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377100+0000", 2023-09-30T17:03:21.052 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7230999999999994e-05 2023-09-30T17:03:21.053 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.053 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.053 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:21.053 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377138+0000", 2023-09-30T17:03:21.053 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8022000000000003e-05 2023-09-30T17:03:21.053 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:21.053 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:21.053 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:21.053 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.053 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.054 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:21.054 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:03:21.054 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 62.619981123999999, 2023-09-30T17:03:21.054 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.020304412000000001, 2023-09-30T17:03:21.054 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:21.054 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:21.054 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:21.054 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.054 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:21.054 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:03:21.054 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:21.054 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.055 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.055 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:21.055 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:03:21.055 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:21.055 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.055 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.055 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:21.055 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353164+0000", 2023-09-30T17:03:21.055 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7100000000000011e-07 2023-09-30T17:03:21.055 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.055 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.056 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:21.056 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353168+0000", 2023-09-30T17:03:21.056 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0600000000000001e-06 2023-09-30T17:03:21.056 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.056 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.056 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:21.056 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353177+0000", 2023-09-30T17:03:21.056 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1409999999999994e-06 2023-09-30T17:03:21.056 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.056 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.056 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:21.057 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353185+0000", 2023-09-30T17:03:21.057 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2479999999999996e-06 2023-09-30T17:03:21.057 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.057 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.057 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:21.057 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353246+0000", 2023-09-30T17:03:21.057 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0519000000000001e-05 2023-09-30T17:03:21.057 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.057 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.057 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:21.057 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353252+0000", 2023-09-30T17:03:21.057 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7859999999999999e-06 2023-09-30T17:03:21.058 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.058 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.058 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:21.058 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354979+0000", 2023-09-30T17:03:21.058 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0017270090000000001 2023-09-30T17:03:21.058 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.058 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.058 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:21.058 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355097+0000", 2023-09-30T17:03:21.058 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000117472 2023-09-30T17:03:21.058 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.059 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.059 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:21.059 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.373467+0000", 2023-09-30T17:03:21.059 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.018370206 2023-09-30T17:03:21.059 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:21.059 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:21.059 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:21.059 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.059 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.059 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:21.059 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:03:21.060 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 62.619940386000003, 2023-09-30T17:03:21.060 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.012725089, 2023-09-30T17:03:21.060 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:21.060 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:21.060 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:21.060 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.060 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:21.060 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:03:21.060 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:21.060 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.060 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.060 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:21.061 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:03:21.061 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:21.061 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.061 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.061 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:21.061 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353204+0000", 2023-09-30T17:03:21.061 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7100000000000002e-07 2023-09-30T17:03:21.061 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.061 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.061 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:21.061 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353213+0000", 2023-09-30T17:03:21.061 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8580000000000006e-06 2023-09-30T17:03:21.062 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.062 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.062 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:21.062 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353219+0000", 2023-09-30T17:03:21.062 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8939999999999998e-06 2023-09-30T17:03:21.062 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.062 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.062 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:21.062 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353223+0000", 2023-09-30T17:03:21.062 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.357e-06 2023-09-30T17:03:21.062 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.062 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.063 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:21.063 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353278+0000", 2023-09-30T17:03:21.063 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5228e-05 2023-09-30T17:03:21.063 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.063 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.063 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:21.063 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353284+0000", 2023-09-30T17:03:21.063 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8209999999999998e-06 2023-09-30T17:03:21.063 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.063 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.063 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:21.064 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355095+0000", 2023-09-30T17:03:21.064 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001811404 2023-09-30T17:03:21.064 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.064 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.064 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:21.064 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355256+0000", 2023-09-30T17:03:21.064 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000160898 2023-09-30T17:03:21.064 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.064 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.064 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:21.064 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365928+0000", 2023-09-30T17:03:21.064 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010672157999999999 2023-09-30T17:03:21.065 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:21.065 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:21.065 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:21.065 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.065 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.065 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-09-30T17:03:21.065 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:03:21.065 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 62.619409179000002, 2023-09-30T17:03:21.065 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0056863460000000001, 2023-09-30T17:03:21.065 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:21.065 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "reached pg", 2023-09-30T17:03:21.065 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:21.066 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.066 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:21.066 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:03:21.066 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:21.066 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.066 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.066 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:21.066 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:03:21.066 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:21.066 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.066 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.066 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:21.067 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:03:21.067 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5700000000000002e-07 2023-09-30T17:03:21.067 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.067 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.067 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:21.067 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353747+0000", 2023-09-30T17:03:21.067 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1899000000000001e-05 2023-09-30T17:03:21.067 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.067 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.067 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:21.067 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353776+0000", 2023-09-30T17:03:21.067 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.8767000000000001e-05 2023-09-30T17:03:21.068 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.068 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.068 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:21.068 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353792+0000", 2023-09-30T17:03:21.068 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5914999999999999e-05 2023-09-30T17:03:21.068 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.068 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.068 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:21.068 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353900+0000", 2023-09-30T17:03:21.068 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010774500000000001 2023-09-30T17:03:21.068 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.068 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.069 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:21.069 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.359421+0000", 2023-09-30T17:03:21.069 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0055213629999999996 2023-09-30T17:03:21.069 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:21.069 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:21.069 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:21.069 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.069 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.069 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:03:21.069 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:03:21.069 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 62.618737578999998, 2023-09-30T17:03:21.069 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0069196370000000002, 2023-09-30T17:03:21.070 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:21.070 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:21.070 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:21.070 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.070 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:21.070 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:03:21.070 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:21.070 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.070 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.070 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:21.070 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:03:21.070 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:21.071 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.071 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.071 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:21.071 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354407+0000", 2023-09-30T17:03:21.071 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7400000000000002e-07 2023-09-30T17:03:21.071 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.071 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.071 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:21.071 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354414+0000", 2023-09-30T17:03:21.071 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1040000000000001e-06 2023-09-30T17:03:21.071 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.071 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.072 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:21.072 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354425+0000", 2023-09-30T17:03:21.072 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1090000000000001e-05 2023-09-30T17:03:21.072 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.072 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.072 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:21.072 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354435+0000", 2023-09-30T17:03:21.072 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8169999999999994e-06 2023-09-30T17:03:21.072 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.072 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.072 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:21.072 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355741+0000", 2023-09-30T17:03:21.072 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0013063160000000001 2023-09-30T17:03:21.073 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.073 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.073 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:21.073 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355763+0000", 2023-09-30T17:03:21.073 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1688e-05 2023-09-30T17:03:21.073 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.073 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.073 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:21.073 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361289+0000", 2023-09-30T17:03:21.073 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0055258269999999996 2023-09-30T17:03:21.073 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.074 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.074 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:21.074 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361326+0000", 2023-09-30T17:03:21.074 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7020999999999997e-05 2023-09-30T17:03:21.074 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:21.074 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:21.074 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:21.074 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.074 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.074 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:30 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2023-09-30T17:03:21.074 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:03:21.074 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 62.617363621000003, 2023-09-30T17:03:21.075 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0069996629999999997, 2023-09-30T17:03:21.075 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:21.075 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:21.075 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:21.075 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.075 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:21.075 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:03:21.075 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:21.075 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.075 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.075 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:21.075 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:03:21.076 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:21.076 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.076 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.076 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:21.076 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355781+0000", 2023-09-30T17:03:21.076 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9599999999999999e-07 2023-09-30T17:03:21.076 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.076 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.076 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:21.076 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355788+0000", 2023-09-30T17:03:21.076 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8129999999999996e-06 2023-09-30T17:03:21.076 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.077 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.077 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:21.077 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355798+0000", 2023-09-30T17:03:21.077 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2909999999999996e-06 2023-09-30T17:03:21.077 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.077 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.077 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:21.077 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355807+0000", 2023-09-30T17:03:21.077 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8619999999999992e-06 2023-09-30T17:03:21.077 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.077 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.077 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:21.078 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.357264+0000", 2023-09-30T17:03:21.078 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0014578289999999999 2023-09-30T17:03:21.078 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.078 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.078 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:21.078 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.357916+0000", 2023-09-30T17:03:21.078 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00065170500000000004 2023-09-30T17:03:21.078 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.078 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.078 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:21.078 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362731+0000", 2023-09-30T17:03:21.078 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0048149849999999999 2023-09-30T17:03:21.079 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.079 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.079 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:21.079 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362780+0000", 2023-09-30T17:03:21.079 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8681999999999999e-05 2023-09-30T17:03:21.079 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:21.079 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:21.079 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:21.079 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.079 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.079 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2023-09-30T17:03:21.079 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:03:21.080 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 62.598712570000004, 2023-09-30T17:03:21.080 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005905998, 2023-09-30T17:03:21.080 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:21.080 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:21.080 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:21.080 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.080 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:21.080 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:03:21.080 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:21.080 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.080 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.081 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:21.081 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:03:21.081 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:21.081 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.081 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.081 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:21.081 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:03:21.081 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1e-07 2023-09-30T17:03:21.081 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.081 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.081 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:21.082 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374455+0000", 2023-09-30T17:03:21.082 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.3091999999999998e-05 2023-09-30T17:03:21.082 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.082 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.082 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:21.082 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374462+0000", 2023-09-30T17:03:21.082 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5170000000000002e-06 2023-09-30T17:03:21.082 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.082 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.082 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:21.082 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374469+0000", 2023-09-30T17:03:21.082 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8199999999999999e-06 2023-09-30T17:03:21.083 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.083 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.083 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:21.083 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374550+0000", 2023-09-30T17:03:21.083 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0978999999999998e-05 2023-09-30T17:03:21.083 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.083 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.083 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:21.083 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374562+0000", 2023-09-30T17:03:21.083 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2472e-05 2023-09-30T17:03:21.083 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.083 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.084 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:21.084 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380293+0000", 2023-09-30T17:03:21.084 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0057310379999999999 2023-09-30T17:03:21.084 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.084 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.084 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:21.084 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380337+0000", 2023-09-30T17:03:21.084 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3869999999999998e-05 2023-09-30T17:03:21.084 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:21.084 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:21.084 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:21.085 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.085 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.085 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2023-09-30T17:03:21.085 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:03:21.085 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 62.598525821000003, 2023-09-30T17:03:21.085 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0057590560000000002, 2023-09-30T17:03:21.085 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:21.085 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:21.085 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:21.085 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.085 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:21.085 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:03:21.086 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:21.086 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.086 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.086 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:21.086 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:03:21.086 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:21.086 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.086 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.086 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:21.086 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:03:21.086 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4900000000000001e-07 2023-09-30T17:03:21.087 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.087 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.087 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:21.087 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374629+0000", 2023-09-30T17:03:21.087 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1014e-05 2023-09-30T17:03:21.087 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.087 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.087 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:21.087 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374636+0000", 2023-09-30T17:03:21.087 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5889999999999999e-06 2023-09-30T17:03:21.087 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.087 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.088 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:21.088 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374642+0000", 2023-09-30T17:03:21.088 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.48e-06 2023-09-30T17:03:21.088 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.088 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.088 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:21.088 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374681+0000", 2023-09-30T17:03:21.088 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9320000000000003e-05 2023-09-30T17:03:21.088 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.088 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.088 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:21.088 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374694+0000", 2023-09-30T17:03:21.089 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3351e-05 2023-09-30T17:03:21.089 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.089 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.089 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:21.089 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380319+0000", 2023-09-30T17:03:21.089 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0056243880000000001 2023-09-30T17:03:21.089 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.089 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.089 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:21.089 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380377+0000", 2023-09-30T17:03:21.089 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8464999999999997e-05 2023-09-30T17:03:21.089 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:21.090 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:21.090 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:21.090 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.090 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.090 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=0'0)", 2023-09-30T17:03:21.090 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:03:21.090 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 62.597814909999997, 2023-09-30T17:03:21.090 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051157370000000004, 2023-09-30T17:03:21.090 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:21.090 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:21.090 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:21.091 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.091 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:21.091 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:03:21.091 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:21.091 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.091 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.091 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:21.091 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:03:21.091 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:21.091 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.091 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.091 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:21.092 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:03:21.092 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0199999999999998e-07 2023-09-30T17:03:21.092 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.092 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.092 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:21.092 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375334+0000", 2023-09-30T17:03:21.092 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8799999999999999e-06 2023-09-30T17:03:21.092 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.092 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.092 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:21.093 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375343+0000", 2023-09-30T17:03:21.093 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5490000000000006e-06 2023-09-30T17:03:21.093 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.093 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.093 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:21.093 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375350+0000", 2023-09-30T17:03:21.093 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5700000000000004e-06 2023-09-30T17:03:21.093 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.093 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.093 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:21.093 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375396+0000", 2023-09-30T17:03:21.093 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5550999999999998e-05 2023-09-30T17:03:21.094 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.094 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.094 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:21.094 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375410+0000", 2023-09-30T17:03:21.094 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4518999999999999e-05 2023-09-30T17:03:21.094 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.094 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.094 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:21.094 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380401+0000", 2023-09-30T17:03:21.094 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0049903430000000004 2023-09-30T17:03:21.094 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:21.094 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:21.095 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:21.095 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380445+0000", 2023-09-30T17:03:21.095 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4023000000000002e-05 2023-09-30T17:03:21.095 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:21.095 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:21.095 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:21.095 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:21.095 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:21.095 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:21.097 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:03:21.097 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:21.096+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:21.197 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:21.197+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:21.227 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:21.227 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:03:21.227 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2023-09-30T17:03:21.227 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:21.237 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:03:21.298 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:21.298+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:21.399 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:21.399+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:21.403 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:21.403 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:03:21.404 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2023-09-30T17:03:21.404 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2023-09-30T17:03:21.404 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:21.413 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:03:21.499 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:21.499+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:21.582 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:21.582 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2023-09-30T17:03:21.582 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2023-09-30T17:03:21.583 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2023-09-30T17:03:21.583 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.583 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:21.583 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:03:21.583 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 63.229236352999997, 2023-09-30T17:03:21.583 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093789779999999996, 2023-09-30T17:03:21.583 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:21.583 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:21.583 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:21.583 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.583 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:21.584 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:03:21.584 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:21.584 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.584 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.584 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:21.584 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:03:21.584 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:21.584 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.584 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.584 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:21.584 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352027+0000", 2023-09-30T17:03:21.584 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0224000000000001e-05 2023-09-30T17:03:21.585 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.585 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.585 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:21.585 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352039+0000", 2023-09-30T17:03:21.585 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1569000000000001e-05 2023-09-30T17:03:21.585 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.585 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.585 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:21.585 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352052+0000", 2023-09-30T17:03:21.585 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2605999999999999e-05 2023-09-30T17:03:21.585 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.585 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.586 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:21.586 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352064+0000", 2023-09-30T17:03:21.586 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2666999999999999e-05 2023-09-30T17:03:21.586 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.586 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.586 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:21.586 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352147+0000", 2023-09-30T17:03:21.586 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3125000000000001e-05 2023-09-30T17:03:21.586 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.586 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.586 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:21.587 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352306+0000", 2023-09-30T17:03:21.587 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015881900000000001 2023-09-30T17:03:21.587 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.587 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.587 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:21.587 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352450+0000", 2023-09-30T17:03:21.587 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014420700000000001 2023-09-30T17:03:21.587 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.587 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.587 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:21.587 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355975+0000", 2023-09-30T17:03:21.587 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003524246 2023-09-30T17:03:21.588 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.588 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.588 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:21.588 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361279+0000", 2023-09-30T17:03:21.588 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005304507 2023-09-30T17:03:21.588 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.588 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.588 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:21.588 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361344+0000", 2023-09-30T17:03:21.588 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4548999999999995e-05 2023-09-30T17:03:21.588 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.588 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.589 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:21.589 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361396+0000", 2023-09-30T17:03:21.589 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2459e-05 2023-09-30T17:03:21.589 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:21.589 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:21.589 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:21.589 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.589 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.589 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:21.589 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:03:21.590 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 63.229144061, 2023-09-30T17:03:21.590 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021233007000000002, 2023-09-30T17:03:21.590 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:21.590 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:21.590 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:21.590 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.590 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:21.590 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:03:21.590 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:21.590 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.590 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.591 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:21.591 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:03:21.591 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:21.591 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.591 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.591 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:21.591 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352110+0000", 2023-09-30T17:03:21.591 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6000000000000002e-07 2023-09-30T17:03:21.591 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.591 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.591 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:21.592 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352117+0000", 2023-09-30T17:03:21.592 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5930000000000002e-06 2023-09-30T17:03:21.592 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.592 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.592 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:21.592 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352126+0000", 2023-09-30T17:03:21.592 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0729999999999994e-06 2023-09-30T17:03:21.592 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.592 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.592 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:21.592 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352136+0000", 2023-09-30T17:03:21.592 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0380000000000001e-05 2023-09-30T17:03:21.593 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.593 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.593 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:21.593 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353279+0000", 2023-09-30T17:03:21.593 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0011424670000000001 2023-09-30T17:03:21.593 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.593 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.593 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:21.593 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353707+0000", 2023-09-30T17:03:21.593 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00042829800000000003 2023-09-30T17:03:21.593 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.594 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.594 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:21.594 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354104+0000", 2023-09-30T17:03:21.594 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00039643399999999998 2023-09-30T17:03:21.594 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.594 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.594 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:21.594 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356925+0000", 2023-09-30T17:03:21.594 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0028210900000000001 2023-09-30T17:03:21.594 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.594 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.595 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:21.595 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373243+0000", 2023-09-30T17:03:21.595 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016318461999999999 2023-09-30T17:03:21.595 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.595 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.595 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:21.595 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373301+0000", 2023-09-30T17:03:21.595 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7435000000000002e-05 2023-09-30T17:03:21.595 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.595 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.595 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:21.596 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373342+0000", 2023-09-30T17:03:21.596 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1915000000000001e-05 2023-09-30T17:03:21.596 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:21.596 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:21.596 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:21.596 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.596 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.596 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:21.596 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:03:21.596 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 63.229101450000002, 2023-09-30T17:03:21.596 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011988331, 2023-09-30T17:03:21.597 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:21.597 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:21.597 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:21.597 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.597 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:21.597 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:03:21.597 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:21.597 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.597 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.597 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:21.597 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:03:21.597 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:21.597 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.598 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.598 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:21.598 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352153+0000", 2023-09-30T17:03:21.598 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0500000000000003e-07 2023-09-30T17:03:21.598 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.598 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.598 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:21.598 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352157+0000", 2023-09-30T17:03:21.598 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9790000000000004e-06 2023-09-30T17:03:21.598 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.598 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.598 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:21.599 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352173+0000", 2023-09-30T17:03:21.599 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6535999999999999e-05 2023-09-30T17:03:21.599 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.599 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.599 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:21.599 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352180+0000", 2023-09-30T17:03:21.599 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7700000000000004e-06 2023-09-30T17:03:21.599 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.599 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.599 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:21.599 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353526+0000", 2023-09-30T17:03:21.600 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0013458330000000001 2023-09-30T17:03:21.600 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.600 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.600 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:21.600 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353648+0000", 2023-09-30T17:03:21.600 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012262899999999999 2023-09-30T17:03:21.600 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.600 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.600 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:21.600 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354141+0000", 2023-09-30T17:03:21.600 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00049222899999999995 2023-09-30T17:03:21.601 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.601 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.601 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:21.601 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356931+0000", 2023-09-30T17:03:21.601 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0027900860000000002 2023-09-30T17:03:21.601 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.601 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.601 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:21.601 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364066+0000", 2023-09-30T17:03:21.601 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071355050000000003 2023-09-30T17:03:21.602 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.602 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.602 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:21.602 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364103+0000", 2023-09-30T17:03:21.602 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6944999999999999e-05 2023-09-30T17:03:21.602 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.602 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.602 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:21.602 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364140+0000", 2023-09-30T17:03:21.602 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7214e-05 2023-09-30T17:03:21.602 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:21.602 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:21.603 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:21.603 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.603 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.603 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:21.603 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:03:21.603 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 63.229062218999999, 2023-09-30T17:03:21.603 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012110921, 2023-09-30T17:03:21.603 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:21.603 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:21.603 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:21.603 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.603 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:21.603 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:03:21.604 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:21.604 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.604 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.604 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:21.604 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:03:21.604 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:21.604 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.604 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.604 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:21.604 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352192+0000", 2023-09-30T17:03:21.604 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7300000000000005e-07 2023-09-30T17:03:21.605 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.605 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.605 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:21.605 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352196+0000", 2023-09-30T17:03:21.605 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2370000000000003e-06 2023-09-30T17:03:21.605 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.605 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.605 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:21.605 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352205+0000", 2023-09-30T17:03:21.605 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6659999999999997e-06 2023-09-30T17:03:21.605 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.605 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.606 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:21.606 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352214+0000", 2023-09-30T17:03:21.606 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8259999999999999e-06 2023-09-30T17:03:21.606 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.606 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.606 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:21.606 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354470+0000", 2023-09-30T17:03:21.606 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022557340000000001 2023-09-30T17:03:21.606 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.606 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.606 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:21.606 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354557+0000", 2023-09-30T17:03:21.607 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6909000000000004e-05 2023-09-30T17:03:21.607 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.607 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.607 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:21.607 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354694+0000", 2023-09-30T17:03:21.607 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013774800000000001 2023-09-30T17:03:21.607 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.607 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.607 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:21.607 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356937+0000", 2023-09-30T17:03:21.607 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022424540000000001 2023-09-30T17:03:21.607 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.608 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.608 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:21.608 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364227+0000", 2023-09-30T17:03:21.608 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072902430000000001 2023-09-30T17:03:21.608 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.608 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.608 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:21.608 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364278+0000", 2023-09-30T17:03:21.608 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1180999999999997e-05 2023-09-30T17:03:21.608 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.608 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.608 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:21.608 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364302+0000", 2023-09-30T17:03:21.609 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4049999999999998e-05 2023-09-30T17:03:21.609 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:21.609 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:21.609 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:21.609 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.609 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.609 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:21.609 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:21.609 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 63.229028880000001, 2023-09-30T17:03:21.609 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021258651999999999, 2023-09-30T17:03:21.609 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:21.609 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:21.610 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:21.610 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.610 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:21.610 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:21.610 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:21.610 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.610 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.610 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:21.610 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:21.610 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:21.611 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.611 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.611 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:21.611 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:21.611 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6899999999999997e-07 2023-09-30T17:03:21.611 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.611 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.611 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:21.611 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352236+0000", 2023-09-30T17:03:21.611 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0251000000000001e-05 2023-09-30T17:03:21.611 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.611 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.612 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:21.612 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352244+0000", 2023-09-30T17:03:21.612 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0770000000000008e-06 2023-09-30T17:03:21.612 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.612 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.612 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:21.612 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352251+0000", 2023-09-30T17:03:21.612 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4749999999999996e-06 2023-09-30T17:03:21.612 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.612 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.612 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:21.612 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354455+0000", 2023-09-30T17:03:21.612 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022043660000000001 2023-09-30T17:03:21.613 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.613 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.613 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:21.613 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354577+0000", 2023-09-30T17:03:21.613 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000121054 2023-09-30T17:03:21.613 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.613 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.613 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:21.613 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354723+0000", 2023-09-30T17:03:21.613 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014693900000000001 2023-09-30T17:03:21.613 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.613 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.614 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:21.614 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356941+0000", 2023-09-30T17:03:21.614 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002217199 2023-09-30T17:03:21.614 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.614 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.614 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:21.614 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373392+0000", 2023-09-30T17:03:21.614 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016451774999999998 2023-09-30T17:03:21.614 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.614 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.615 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:21.615 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373445+0000", 2023-09-30T17:03:21.615 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.308e-05 2023-09-30T17:03:21.615 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.615 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.615 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:21.615 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373483+0000", 2023-09-30T17:03:21.615 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7766999999999999e-05 2023-09-30T17:03:21.615 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:21.615 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:21.615 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:21.615 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.616 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.616 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:21.616 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:21.616 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 63.228992789000003, 2023-09-30T17:03:21.616 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020903497, 2023-09-30T17:03:21.616 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:21.616 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:21.616 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:21.616 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.616 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:21.616 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:21.617 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:21.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.617 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.617 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:21.617 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:21.617 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:21.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.617 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.617 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:21.617 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:21.618 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0800000000000004e-07 2023-09-30T17:03:21.618 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.618 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.618 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:21.618 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352266+0000", 2023-09-30T17:03:21.618 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1280000000000001e-06 2023-09-30T17:03:21.618 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.618 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.619 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:21.619 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352273+0000", 2023-09-30T17:03:21.619 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3730000000000004e-06 2023-09-30T17:03:21.619 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.619 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.619 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:21.619 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352279+0000", 2023-09-30T17:03:21.619 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7699999999999998e-06 2023-09-30T17:03:21.619 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.619 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.619 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:21.619 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352334+0000", 2023-09-30T17:03:21.620 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5547999999999997e-05 2023-09-30T17:03:21.620 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.620 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.620 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:21.620 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352435+0000", 2023-09-30T17:03:21.620 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100688 2023-09-30T17:03:21.620 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.620 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.620 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:21.620 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352585+0000", 2023-09-30T17:03:21.620 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000150068 2023-09-30T17:03:21.621 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.621 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.621 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:21.621 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354912+0000", 2023-09-30T17:03:21.621 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0023266770000000001 2023-09-30T17:03:21.621 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.621 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.621 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:21.621 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373066+0000", 2023-09-30T17:03:21.621 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018154474 2023-09-30T17:03:21.621 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.622 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.622 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:21.622 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373122+0000", 2023-09-30T17:03:21.622 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6193000000000002e-05 2023-09-30T17:03:21.622 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.622 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.622 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:21.622 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373164+0000", 2023-09-30T17:03:21.622 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1869999999999997e-05 2023-09-30T17:03:21.622 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:21.622 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:21.622 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:21.623 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.623 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.623 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:21.623 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:03:21.623 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 63.228957113, 2023-09-30T17:03:21.623 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021015097999999999, 2023-09-30T17:03:21.623 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:21.623 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:21.623 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:21.623 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.623 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:21.624 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:03:21.624 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:21.624 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.624 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.624 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:21.624 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:03:21.624 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:21.624 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.624 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.624 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:21.625 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352297+0000", 2023-09-30T17:03:21.625 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8299999999999997e-07 2023-09-30T17:03:21.625 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.625 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.625 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:21.625 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352300+0000", 2023-09-30T17:03:21.625 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7460000000000001e-06 2023-09-30T17:03:21.625 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.625 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.625 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:21.625 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352307+0000", 2023-09-30T17:03:21.626 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4959999999999999e-06 2023-09-30T17:03:21.626 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.626 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.626 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:21.626 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352314+0000", 2023-09-30T17:03:21.626 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0190000000000001e-06 2023-09-30T17:03:21.626 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.626 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.626 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:21.626 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354070+0000", 2023-09-30T17:03:21.626 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001755936 2023-09-30T17:03:21.627 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.627 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.627 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:21.627 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354221+0000", 2023-09-30T17:03:21.627 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000150884 2023-09-30T17:03:21.627 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.627 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.627 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:21.627 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373311+0000", 2023-09-30T17:03:21.627 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019090434 2023-09-30T17:03:21.627 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:21.627 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:21.628 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:21.628 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.628 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.628 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:21.628 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:03:21.628 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 63.228928394, 2023-09-30T17:03:21.628 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021255174000000002, 2023-09-30T17:03:21.628 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:21.628 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:21.628 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:21.628 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.628 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:21.629 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:03:21.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:21.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:21.629 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:03:21.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:21.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:21.629 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352326+0000", 2023-09-30T17:03:21.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3200000000000005e-07 2023-09-30T17:03:21.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.630 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:21.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352349+0000", 2023-09-30T17:03:21.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3183000000000001e-05 2023-09-30T17:03:21.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.630 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:21.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352358+0000", 2023-09-30T17:03:21.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5230000000000001e-06 2023-09-30T17:03:21.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.631 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.631 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:21.631 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352365+0000", 2023-09-30T17:03:21.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3260000000000001e-06 2023-09-30T17:03:21.631 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.631 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.631 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:21.631 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355450+0000", 2023-09-30T17:03:21.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0030854049999999998 2023-09-30T17:03:21.631 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.631 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.631 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:21.632 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355583+0000", 2023-09-30T17:03:21.632 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000133189 2023-09-30T17:03:21.632 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.632 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.632 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:21.632 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373580+0000", 2023-09-30T17:03:21.632 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017997016000000001 2023-09-30T17:03:21.632 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:21.632 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:21.632 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:21.632 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.632 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.633 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:21.633 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:03:21.633 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 63.228876970999998, 2023-09-30T17:03:21.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010380537, 2023-09-30T17:03:21.633 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:21.633 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:21.633 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:21.633 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.633 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:21.633 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:03:21.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:21.634 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.634 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:21.634 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:03:21.634 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:21.634 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.634 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:21.634 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:03:21.634 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1500000000000003e-07 2023-09-30T17:03:21.634 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:21.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352381+0000", 2023-09-30T17:03:21.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6330000000000002e-06 2023-09-30T17:03:21.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:21.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352388+0000", 2023-09-30T17:03:21.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7229999999999998e-06 2023-09-30T17:03:21.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:21.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352394+0000", 2023-09-30T17:03:21.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1789999999999996e-06 2023-09-30T17:03:21.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:21.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353259+0000", 2023-09-30T17:03:21.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000865221 2023-09-30T17:03:21.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:21.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353391+0000", 2023-09-30T17:03:21.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013217700000000001 2023-09-30T17:03:21.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.637 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:21.637 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362757+0000", 2023-09-30T17:03:21.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093657889999999994 2023-09-30T17:03:21.637 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:21.637 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:21.637 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:21.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.637 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-09-30T17:03:21.638 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:03:21.638 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 63.222576678999999, 2023-09-30T17:03:21.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0061813579999999996, 2023-09-30T17:03:21.638 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:21.638 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2023-09-30T17:03:21.638 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:21.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.638 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:21.638 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:03:21.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:21.638 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:21.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:03:21.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:21.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:21.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:03:21.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5499999999999999e-07 2023-09-30T17:03:21.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:21.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358686+0000", 2023-09-30T17:03:21.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9979999999999992e-06 2023-09-30T17:03:21.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:21.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358700+0000", 2023-09-30T17:03:21.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3635000000000001e-05 2023-09-30T17:03:21.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:21.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358714+0000", 2023-09-30T17:03:21.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4470999999999999e-05 2023-09-30T17:03:21.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:21.641 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358767+0000", 2023-09-30T17:03:21.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2651999999999997e-05 2023-09-30T17:03:21.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:21.641 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364858+0000", 2023-09-30T17:03:21.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060912470000000002 2023-09-30T17:03:21.641 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:21.641 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:21.641 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:21.642 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.642 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.642 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2023-09-30T17:03:21.642 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:03:21.642 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 63.220211839000001, 2023-09-30T17:03:21.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00036246299999999999, 2023-09-30T17:03:21.642 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:21.642 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:21.642 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:21.642 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.642 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:21.643 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:03:21.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:21.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.643 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:21.643 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:03:21.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:21.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.643 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:21.643 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:03:21.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3099999999999999e-07 2023-09-30T17:03:21.644 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:21.644 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361045+0000", 2023-09-30T17:03:21.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.49e-06 2023-09-30T17:03:21.644 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:21.644 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361056+0000", 2023-09-30T17:03:21.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0910000000000001e-05 2023-09-30T17:03:21.644 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.645 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:21.645 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361067+0000", 2023-09-30T17:03:21.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0531e-05 2023-09-30T17:03:21.645 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.645 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.645 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:21.645 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361263+0000", 2023-09-30T17:03:21.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000196486 2023-09-30T17:03:21.645 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.645 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.645 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:21.646 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361273+0000", 2023-09-30T17:03:21.646 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3379999999999994e-06 2023-09-30T17:03:21.646 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.646 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.646 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:21.646 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361404+0000", 2023-09-30T17:03:21.646 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013137700000000001 2023-09-30T17:03:21.646 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:21.646 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:21.646 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:21.646 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.646 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.647 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:31 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:03:21.647 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:03:21.647 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 63.219235810000001, 2023-09-30T17:03:21.647 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006676408, 2023-09-30T17:03:21.647 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:21.647 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:21.647 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:21.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.647 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:21.647 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:03:21.647 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:21.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:21.648 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:03:21.648 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:21.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:21.648 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:03:21.648 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5600000000000002e-07 2023-09-30T17:03:21.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:21.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362044+0000", 2023-09-30T17:03:21.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5987999999999999e-05 2023-09-30T17:03:21.649 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.649 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:21.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362051+0000", 2023-09-30T17:03:21.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2599999999999999e-06 2023-09-30T17:03:21.649 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.649 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:21.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362057+0000", 2023-09-30T17:03:21.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.19e-06 2023-09-30T17:03:21.650 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.650 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.650 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:21.650 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362096+0000", 2023-09-30T17:03:21.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8278000000000002e-05 2023-09-30T17:03:21.650 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.650 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.650 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:21.650 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362114+0000", 2023-09-30T17:03:21.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8808e-05 2023-09-30T17:03:21.651 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.651 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:21.651 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368658+0000", 2023-09-30T17:03:21.651 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065433540000000004 2023-09-30T17:03:21.651 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.651 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:21.651 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368694+0000", 2023-09-30T17:03:21.651 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6273999999999999e-05 2023-09-30T17:03:21.651 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:21.652 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:21.652 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:21.652 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.652 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.652 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:26 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-09-30T17:03:21.652 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:03:21.652 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 63.219145038000001, 2023-09-30T17:03:21.652 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0066596119999999996, 2023-09-30T17:03:21.652 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:21.652 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:21.652 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:21.652 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.652 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:21.653 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:03:21.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:21.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.653 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:21.653 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:03:21.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:21.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.653 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:21.653 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362109+0000", 2023-09-30T17:03:21.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5699999999999999e-07 2023-09-30T17:03:21.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.654 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:21.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362112+0000", 2023-09-30T17:03:21.654 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8410000000000002e-06 2023-09-30T17:03:21.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.657 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:21.657 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362117+0000", 2023-09-30T17:03:21.657 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.792e-06 2023-09-30T17:03:21.657 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.657 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:21.657 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362122+0000", 2023-09-30T17:03:21.657 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.763e-06 2023-09-30T17:03:21.657 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:21.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362344+0000", 2023-09-30T17:03:21.658 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022181600000000001 2023-09-30T17:03:21.658 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:21.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362357+0000", 2023-09-30T17:03:21.658 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2864000000000001e-05 2023-09-30T17:03:21.658 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:21.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368738+0000", 2023-09-30T17:03:21.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063809499999999998 2023-09-30T17:03:21.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.659 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.659 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:21.659 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368768+0000", 2023-09-30T17:03:21.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0429e-05 2023-09-30T17:03:21.659 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:21.659 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:21.659 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:21.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.659 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.660 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2023-09-30T17:03:21.660 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:03:21.660 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 63.217928870999998, 2023-09-30T17:03:21.660 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00082185400000000001, 2023-09-30T17:03:21.660 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:21.660 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:21.660 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:21.660 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.660 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:21.660 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:03:21.660 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:21.661 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.661 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.661 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:21.661 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:03:21.661 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:21.661 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.661 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.661 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:21.661 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:03:21.661 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.22e-07 2023-09-30T17:03:21.661 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.661 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.662 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:21.662 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363327+0000", 2023-09-30T17:03:21.662 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4480000000000001e-06 2023-09-30T17:03:21.662 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.662 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.662 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:21.662 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363333+0000", 2023-09-30T17:03:21.662 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9989999999999997e-06 2023-09-30T17:03:21.662 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.662 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.662 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:21.662 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363354+0000", 2023-09-30T17:03:21.663 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0547000000000002e-05 2023-09-30T17:03:21.663 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.663 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.663 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:21.663 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364057+0000", 2023-09-30T17:03:21.663 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00070306600000000002 2023-09-30T17:03:21.663 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.663 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.663 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:21.663 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364063+0000", 2023-09-30T17:03:21.663 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.694e-06 2023-09-30T17:03:21.663 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.664 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:21.664 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364146+0000", 2023-09-30T17:03:21.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3877999999999999e-05 2023-09-30T17:03:21.664 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:21.664 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:21.664 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:21.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.664 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e18/16 ondisk, result = 0)", 2023-09-30T17:03:21.664 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:03:21.664 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 63.217615338999998, 2023-09-30T17:03:21.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00067007199999999996, 2023-09-30T17:03:21.665 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:21.665 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:21.665 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:21.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:21.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:03:21.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:21.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.666 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:21.666 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:03:21.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:21.666 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.666 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:21.666 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:03:21.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.41e-07 2023-09-30T17:03:21.666 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.666 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:21.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363641+0000", 2023-09-30T17:03:21.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4830000000000002e-06 2023-09-30T17:03:21.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:21.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363647+0000", 2023-09-30T17:03:21.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4869999999999999e-06 2023-09-30T17:03:21.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:21.668 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363654+0000", 2023-09-30T17:03:21.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5889999999999999e-06 2023-09-30T17:03:21.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.668 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:21.668 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364217+0000", 2023-09-30T17:03:21.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00056263199999999998 2023-09-30T17:03:21.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.668 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:21.668 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364222+0000", 2023-09-30T17:03:21.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.242e-06 2023-09-30T17:03:21.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.669 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.669 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:21.669 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364308+0000", 2023-09-30T17:03:21.669 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6397999999999995e-05 2023-09-30T17:03:21.669 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:21.669 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:21.669 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:21.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.669 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.669 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2023-09-30T17:03:21.670 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:03:21.670 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 63.208027428999998, 2023-09-30T17:03:21.670 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000359561, 2023-09-30T17:03:21.670 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:21.670 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2023-09-30T17:03:21.670 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:21.670 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.670 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:21.670 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:03:21.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:21.671 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.671 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.671 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:21.671 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:03:21.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:21.671 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.671 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.671 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:21.671 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:03:21.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1e-07 2023-09-30T17:03:21.671 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.672 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:21.672 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373228+0000", 2023-09-30T17:03:21.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9420000000000002e-06 2023-09-30T17:03:21.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.672 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:21.672 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373235+0000", 2023-09-30T17:03:21.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4230000000000002e-06 2023-09-30T17:03:21.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.672 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:21.673 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373239+0000", 2023-09-30T17:03:21.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6809999999999997e-06 2023-09-30T17:03:21.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.673 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:21.673 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373518+0000", 2023-09-30T17:03:21.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000278311 2023-09-30T17:03:21.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.673 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:21.673 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373586+0000", 2023-09-30T17:03:21.674 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7994e-05 2023-09-30T17:03:21.674 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:21.674 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:21.674 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:21.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.674 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:03:21.674 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:03:21.674 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 63.203601356, 2023-09-30T17:03:21.674 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0046632949999999996, 2023-09-30T17:03:21.674 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:21.675 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:21.675 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:21.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.675 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:21.675 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:03:21.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:21.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.675 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:21.675 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:03:21.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:21.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:21.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377653+0000", 2023-09-30T17:03:21.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7800000000000002e-07 2023-09-30T17:03:21.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:21.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377657+0000", 2023-09-30T17:03:21.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5859999999999998e-06 2023-09-30T17:03:21.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.677 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:21.677 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377677+0000", 2023-09-30T17:03:21.677 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9508999999999999e-05 2023-09-30T17:03:21.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.677 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:21.677 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377682+0000", 2023-09-30T17:03:21.677 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8300000000000001e-06 2023-09-30T17:03:21.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.677 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:21.677 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377725+0000", 2023-09-30T17:03:21.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2425000000000001e-05 2023-09-30T17:03:21.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.678 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.678 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:21.678 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377738+0000", 2023-09-30T17:03:21.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2899e-05 2023-09-30T17:03:21.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.678 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.678 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:21.678 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382268+0000", 2023-09-30T17:03:21.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045301289999999999 2023-09-30T17:03:21.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.679 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:21.679 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382315+0000", 2023-09-30T17:03:21.679 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7539e-05 2023-09-30T17:03:21.679 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:21.679 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:21.679 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:21.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.679 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-09-30T17:03:21.679 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:03:21.680 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 63.203151904999999, 2023-09-30T17:03:21.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042540670000000003, 2023-09-30T17:03:21.680 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:21.680 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:21.680 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:21.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.680 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:21.680 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:03:21.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:21.680 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.680 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:21.680 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:03:21.681 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:21.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.681 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:21.681 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:03:21.681 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0299999999999998e-07 2023-09-30T17:03:21.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.681 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:21.681 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378107+0000", 2023-09-30T17:03:21.681 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9250000000000003e-06 2023-09-30T17:03:21.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.682 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.682 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:21.682 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378116+0000", 2023-09-30T17:03:21.682 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.037e-06 2023-09-30T17:03:21.682 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.682 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.682 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:21.682 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378123+0000", 2023-09-30T17:03:21.682 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1879999999999996e-06 2023-09-30T17:03:21.682 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.682 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.683 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:21.683 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378174+0000", 2023-09-30T17:03:21.683 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0998000000000002e-05 2023-09-30T17:03:21.683 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.683 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:21.683 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378197+0000", 2023-09-30T17:03:21.683 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2558e-05 2023-09-30T17:03:21.683 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.683 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:21.684 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382319+0000", 2023-09-30T17:03:21.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041220950000000001 2023-09-30T17:03:21.684 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.684 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:21.684 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382356+0000", 2023-09-30T17:03:21.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6563000000000002e-05 2023-09-30T17:03:21.684 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:21.684 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:21.684 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:21.684 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.685 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-09-30T17:03:21.685 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:03:21.685 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 59.145388081, 2023-09-30T17:03:21.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00171641, 2023-09-30T17:03:21.685 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:21.685 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:21.685 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:21.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.685 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:21.685 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:03:21.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:21.686 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.686 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.686 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:21.686 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:03:21.686 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:21.686 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.686 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.686 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:21.686 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435868+0000", 2023-09-30T17:03:21.686 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5840000000000002e-06 2023-09-30T17:03:21.686 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.687 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.687 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:21.687 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435892+0000", 2023-09-30T17:03:21.687 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3625000000000002e-05 2023-09-30T17:03:21.687 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.687 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.687 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:21.687 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435908+0000", 2023-09-30T17:03:21.687 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6548000000000001e-05 2023-09-30T17:03:21.687 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.687 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.687 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:21.688 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435935+0000", 2023-09-30T17:03:21.688 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6516000000000002e-05 2023-09-30T17:03:21.688 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.688 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.688 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:21.688 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435996+0000", 2023-09-30T17:03:21.688 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1433999999999995e-05 2023-09-30T17:03:21.688 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.688 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.688 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:21.688 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436114+0000", 2023-09-30T17:03:21.688 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000118344 2023-09-30T17:03:21.689 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.689 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:21.689 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436219+0000", 2023-09-30T17:03:21.689 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010453100000000001 2023-09-30T17:03:21.689 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.689 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:21.689 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436900+0000", 2023-09-30T17:03:21.689 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00068121299999999996 2023-09-30T17:03:21.689 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.690 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:21.690 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437508+0000", 2023-09-30T17:03:21.690 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00060817399999999995 2023-09-30T17:03:21.690 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.690 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:21.690 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437554+0000", 2023-09-30T17:03:21.690 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5609000000000003e-05 2023-09-30T17:03:21.690 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.690 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:21.691 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437582+0000", 2023-09-30T17:03:21.691 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7832000000000001e-05 2023-09-30T17:03:21.691 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:21.691 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:21.691 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:21.691 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.691 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.691 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2023-09-30T17:03:21.691 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:03:21.691 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 39.145076586999998, 2023-09-30T17:03:21.691 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001456199, 2023-09-30T17:03:21.691 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:21.692 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:21.692 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:21.692 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.692 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:21.692 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:03:21.692 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:21.692 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.692 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.692 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:21.692 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:03:21.692 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:21.692 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.693 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.693 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:21.693 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436178+0000", 2023-09-30T17:03:21.693 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.494e-06 2023-09-30T17:03:21.693 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.693 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.693 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:21.693 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436184+0000", 2023-09-30T17:03:21.693 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2809999999999999e-06 2023-09-30T17:03:21.693 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.693 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.693 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:21.694 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436198+0000", 2023-09-30T17:03:21.694 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3978000000000001e-05 2023-09-30T17:03:21.694 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.694 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.694 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:21.694 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436206+0000", 2023-09-30T17:03:21.694 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8040000000000007e-06 2023-09-30T17:03:21.694 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.694 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.694 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:21.694 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436268+0000", 2023-09-30T17:03:21.694 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1484999999999998e-05 2023-09-30T17:03:21.695 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.695 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.695 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:21.695 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436339+0000", 2023-09-30T17:03:21.695 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1000000000000005e-05 2023-09-30T17:03:21.695 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.695 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.695 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:21.695 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436438+0000", 2023-09-30T17:03:21.695 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9389000000000007e-05 2023-09-30T17:03:21.695 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.696 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.696 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:21.696 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436986+0000", 2023-09-30T17:03:21.696 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054723399999999996 2023-09-30T17:03:21.696 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.696 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.696 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:21.696 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437566+0000", 2023-09-30T17:03:21.696 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00058017599999999996 2023-09-30T17:03:21.696 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.696 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.697 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:21.697 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437606+0000", 2023-09-30T17:03:21.697 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9891999999999997e-05 2023-09-30T17:03:21.697 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:21.697 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:21.697 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:21.697 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437633+0000", 2023-09-30T17:03:21.697 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7466000000000001e-05 2023-09-30T17:03:21.697 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:21.697 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:21.697 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:21.697 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:21.698 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:21.698 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:21.699 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:21.699+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:21.699 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:03:21.800 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:21.799+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:21.845 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:21.845 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:03:21.845 INFO:teuthology.orchestra.run.smithi031.stdout: "num_ops": 0 2023-09-30T17:03:21.845 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:21.856 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:03:21.939 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:21.939+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:22.002 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:22.002+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:22.028 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:22.028 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:03:22.028 INFO:teuthology.orchestra.run.smithi031.stdout: "complaint_time": 30, 2023-09-30T17:03:22.028 INFO:teuthology.orchestra.run.smithi031.stdout: "num_blocked_ops": 0 2023-09-30T17:03:22.028 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:22.039 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:03:22.102 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:22.103+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:22.203 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:22.203+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:22.213 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:22.213 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 20, 2023-09-30T17:03:22.213 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 600, 2023-09-30T17:03:22.213 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:03:22.213 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.214 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:32 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'18, mlcod=11'14)", 2023-09-30T17:03:22.214 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:03:22.214 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 74.850872820999996, 2023-09-30T17:03:22.214 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051629809999999996, 2023-09-30T17:03:22.214 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:22.214 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:22.214 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:22.214 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.214 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:22.214 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:03:22.214 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:22.215 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.215 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.215 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:22.215 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:03:22.215 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:22.215 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.215 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.215 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:22.215 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:03:22.215 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2099999999999996e-07 2023-09-30T17:03:22.215 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.216 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.216 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:22.216 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361407+0000", 2023-09-30T17:03:22.216 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7499e-05 2023-09-30T17:03:22.216 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.216 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.216 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:22.216 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361418+0000", 2023-09-30T17:03:22.216 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1127999999999999e-05 2023-09-30T17:03:22.216 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.216 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.216 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:22.217 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361423+0000", 2023-09-30T17:03:22.217 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1930000000000001e-06 2023-09-30T17:03:22.217 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.217 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.217 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:22.217 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361476+0000", 2023-09-30T17:03:22.217 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3399000000000002e-05 2023-09-30T17:03:22.217 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.217 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.217 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:22.217 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361496+0000", 2023-09-30T17:03:22.217 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9638000000000001e-05 2023-09-30T17:03:22.218 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.218 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.218 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:22.218 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.366474+0000", 2023-09-30T17:03:22.218 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0049778829999999998 2023-09-30T17:03:22.218 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.218 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.218 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:22.218 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.366512+0000", 2023-09-30T17:03:22.218 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7620000000000002e-05 2023-09-30T17:03:22.218 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:22.218 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:22.219 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:22.219 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.219 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.219 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:37 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'23, mlcod=11'15)", 2023-09-30T17:03:22.219 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:03:22.219 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 74.848270823999997, 2023-09-30T17:03:22.219 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053985689999999998, 2023-09-30T17:03:22.219 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:22.219 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:22.219 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:22.219 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.219 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:22.220 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:03:22.220 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:22.220 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.220 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.220 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:22.220 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:03:22.220 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:22.220 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.220 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.220 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:22.220 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:03:22.220 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4400000000000001e-07 2023-09-30T17:03:22.221 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.221 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.221 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:22.221 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363956+0000", 2023-09-30T17:03:22.221 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.921e-06 2023-09-30T17:03:22.221 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.221 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.221 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:22.221 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363966+0000", 2023-09-30T17:03:22.221 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0351e-05 2023-09-30T17:03:22.222 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.222 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.222 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:22.222 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363971+0000", 2023-09-30T17:03:22.222 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.023e-06 2023-09-30T17:03:22.222 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.222 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.222 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:22.222 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.364013+0000", 2023-09-30T17:03:22.222 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1575000000000001e-05 2023-09-30T17:03:22.222 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.222 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.223 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:22.223 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.364026+0000", 2023-09-30T17:03:22.223 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3044000000000001e-05 2023-09-30T17:03:22.223 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.223 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.223 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:22.223 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.369308+0000", 2023-09-30T17:03:22.223 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005282152 2023-09-30T17:03:22.223 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.223 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.223 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:22.224 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.369349+0000", 2023-09-30T17:03:22.224 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1059000000000001e-05 2023-09-30T17:03:22.224 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:22.224 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:22.224 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:22.224 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.224 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.224 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:155 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'109, mlcod=11'105)", 2023-09-30T17:03:22.224 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:03:22.224 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 74.366575138000002, 2023-09-30T17:03:22.224 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053867639999999996, 2023-09-30T17:03:22.225 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:22.225 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:22.225 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:22.225 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.225 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:22.225 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:03:22.225 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:22.225 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.225 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.225 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:22.225 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:03:22.226 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:22.226 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.226 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.226 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:22.226 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845647+0000", 2023-09-30T17:03:22.226 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7599999999999997e-07 2023-09-30T17:03:22.226 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.226 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.226 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:22.226 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845699+0000", 2023-09-30T17:03:22.226 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1758000000000001e-05 2023-09-30T17:03:22.226 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.227 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.227 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:22.227 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845708+0000", 2023-09-30T17:03:22.227 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2159999999999995e-06 2023-09-30T17:03:22.227 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.227 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.227 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:22.227 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845712+0000", 2023-09-30T17:03:22.227 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2579999999999997e-06 2023-09-30T17:03:22.227 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.227 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.227 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:22.228 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845756+0000", 2023-09-30T17:03:22.228 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4119999999999998e-05 2023-09-30T17:03:22.228 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.228 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.228 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:22.228 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845779+0000", 2023-09-30T17:03:22.228 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2311e-05 2023-09-30T17:03:22.228 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.228 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.228 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:22.228 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.850982+0000", 2023-09-30T17:03:22.228 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005203053 2023-09-30T17:03:22.229 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.229 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.229 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:22.229 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851033+0000", 2023-09-30T17:03:22.229 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1471999999999998e-05 2023-09-30T17:03:22.229 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:22.229 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:22.229 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:22.229 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.229 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.229 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:156 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'110, mlcod=11'105)", 2023-09-30T17:03:22.229 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:03:22.229 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 74.366042211999996, 2023-09-30T17:03:22.230 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0052834759999999996, 2023-09-30T17:03:22.230 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:22.230 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:22.230 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:22.230 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.230 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:22.230 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:03:22.230 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:22.230 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.230 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.230 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:22.231 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:03:22.231 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:22.231 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.231 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.231 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:22.231 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846180+0000", 2023-09-30T17:03:22.231 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6300000000000005e-07 2023-09-30T17:03:22.231 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.231 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.231 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:22.231 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846184+0000", 2023-09-30T17:03:22.231 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3789999999999999e-06 2023-09-30T17:03:22.232 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.232 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.232 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:22.232 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846195+0000", 2023-09-30T17:03:22.232 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0778000000000001e-05 2023-09-30T17:03:22.232 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.232 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.232 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:22.232 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846200+0000", 2023-09-30T17:03:22.232 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1540000000000001e-06 2023-09-30T17:03:22.232 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.232 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.233 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:22.233 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846274+0000", 2023-09-30T17:03:22.233 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4129999999999997e-05 2023-09-30T17:03:22.233 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.233 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.233 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:22.233 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846286+0000", 2023-09-30T17:03:22.233 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1744e-05 2023-09-30T17:03:22.233 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.233 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.233 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:22.233 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851432+0000", 2023-09-30T17:03:22.234 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051462110000000004 2023-09-30T17:03:22.234 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.234 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.234 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:22.234 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851463+0000", 2023-09-30T17:03:22.234 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0516999999999999e-05 2023-09-30T17:03:22.234 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:22.234 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:22.234 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:22.234 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.234 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.234 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:203 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'149, mlcod=11'145)", 2023-09-30T17:03:22.235 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:03:22.235 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 74.010006302999997, 2023-09-30T17:03:22.235 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051867459999999999, 2023-09-30T17:03:22.235 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:22.235 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:22.235 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:22.235 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.235 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:22.235 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:03:22.235 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:22.235 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.235 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.236 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:22.236 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:03:22.236 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:22.236 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.236 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.236 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:22.236 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202216+0000", 2023-09-30T17:03:22.236 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7e-07 2023-09-30T17:03:22.236 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.236 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.236 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:22.236 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202271+0000", 2023-09-30T17:03:22.237 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5163e-05 2023-09-30T17:03:22.237 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.237 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.237 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:22.237 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202282+0000", 2023-09-30T17:03:22.237 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1319e-05 2023-09-30T17:03:22.237 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.237 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.237 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:22.237 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202288+0000", 2023-09-30T17:03:22.237 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2899999999999999e-06 2023-09-30T17:03:22.237 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.238 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.238 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:22.238 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202331+0000", 2023-09-30T17:03:22.238 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2147999999999997e-05 2023-09-30T17:03:22.238 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.238 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.238 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:22.238 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202348+0000", 2023-09-30T17:03:22.238 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7317e-05 2023-09-30T17:03:22.238 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.238 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.238 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:22.239 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.207357+0000", 2023-09-30T17:03:22.239 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0050095440000000003 2023-09-30T17:03:22.239 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.239 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.239 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:22.239 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.207402+0000", 2023-09-30T17:03:22.239 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4495e-05 2023-09-30T17:03:22.239 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:22.239 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:22.239 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:22.239 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.240 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.240 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:22.240 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:03:22.240 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 63.860676015000003, 2023-09-30T17:03:22.240 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.025313649000000001, 2023-09-30T17:03:22.240 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:22.240 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:22.240 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:22.240 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.240 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:22.240 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:03:22.240 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:22.241 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.241 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.241 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:22.241 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:03:22.241 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:22.241 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.241 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.241 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:22.241 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351551+0000", 2023-09-30T17:03:22.241 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3380000000000004e-06 2023-09-30T17:03:22.241 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.242 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.242 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:22.242 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351559+0000", 2023-09-30T17:03:22.242 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9589999999999995e-06 2023-09-30T17:03:22.242 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.242 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.242 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:22.242 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351571+0000", 2023-09-30T17:03:22.242 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2065999999999999e-05 2023-09-30T17:03:22.242 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.242 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.242 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:22.243 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351706+0000", 2023-09-30T17:03:22.243 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00013553799999999999 2023-09-30T17:03:22.243 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.243 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.243 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:22.243 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353016+0000", 2023-09-30T17:03:22.243 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0013099209999999999 2023-09-30T17:03:22.243 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.243 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.243 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:22.243 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353023+0000", 2023-09-30T17:03:22.243 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2479999999999999e-06 2023-09-30T17:03:22.244 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.244 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.244 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:22.244 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360348+0000", 2023-09-30T17:03:22.244 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0073248949999999997 2023-09-30T17:03:22.244 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.244 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.244 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:22.244 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360787+0000", 2023-09-30T17:03:22.244 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00043875199999999999 2023-09-30T17:03:22.244 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.245 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.245 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:22.245 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360892+0000", 2023-09-30T17:03:22.245 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010508199999999999 2023-09-30T17:03:22.245 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.245 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.245 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:22.245 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365132+0000", 2023-09-30T17:03:22.245 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0042396480000000004 2023-09-30T17:03:22.245 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.245 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.245 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:22.246 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376746+0000", 2023-09-30T17:03:22.246 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011614157 2023-09-30T17:03:22.246 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.246 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.246 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:22.246 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376811+0000", 2023-09-30T17:03:22.246 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5005999999999994e-05 2023-09-30T17:03:22.246 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.246 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.246 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:22.246 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376859+0000", 2023-09-30T17:03:22.247 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8038999999999999e-05 2023-09-30T17:03:22.247 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:22.247 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:22.247 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:22.247 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.247 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.247 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:22.247 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:03:22.247 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 63.860178216000001, 2023-09-30T17:03:22.247 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024923989000000001, 2023-09-30T17:03:22.247 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:22.247 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:22.248 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:22.248 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.248 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:22.248 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:03:22.248 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:22.248 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.248 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.248 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:22.248 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:03:22.248 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:22.248 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.249 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.249 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:22.249 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352044+0000", 2023-09-30T17:03:22.249 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9199999999999999e-07 2023-09-30T17:03:22.249 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.249 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.249 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:22.249 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352050+0000", 2023-09-30T17:03:22.249 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8880000000000002e-06 2023-09-30T17:03:22.249 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.249 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.250 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:22.250 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352143+0000", 2023-09-30T17:03:22.250 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2721999999999998e-05 2023-09-30T17:03:22.250 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.250 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.250 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:22.250 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352155+0000", 2023-09-30T17:03:22.250 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2279000000000001e-05 2023-09-30T17:03:22.250 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.250 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.251 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:22.251 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353114+0000", 2023-09-30T17:03:22.251 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00095943700000000005 2023-09-30T17:03:22.251 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.251 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.251 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:22.251 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353121+0000", 2023-09-30T17:03:22.251 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.494e-06 2023-09-30T17:03:22.252 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.252 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.252 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:22.252 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361491+0000", 2023-09-30T17:03:22.252 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0083697359999999991 2023-09-30T17:03:22.252 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.252 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.252 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:22.252 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361573+0000", 2023-09-30T17:03:22.252 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2822000000000001e-05 2023-09-30T17:03:22.253 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.253 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.253 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:22.253 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362166+0000", 2023-09-30T17:03:22.253 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00059223299999999995 2023-09-30T17:03:22.253 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.253 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.253 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:22.253 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365209+0000", 2023-09-30T17:03:22.253 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.003043212 2023-09-30T17:03:22.253 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.253 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.254 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:22.254 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376910+0000", 2023-09-30T17:03:22.254 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011700898 2023-09-30T17:03:22.254 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.254 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.254 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:22.254 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376945+0000", 2023-09-30T17:03:22.254 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4795000000000001e-05 2023-09-30T17:03:22.254 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.254 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.254 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:22.254 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376967+0000", 2023-09-30T17:03:22.255 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2580999999999999e-05 2023-09-30T17:03:22.255 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:22.255 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:22.255 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:22.255 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.255 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.255 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:22.255 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:03:22.255 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 63.860008295999997, 2023-09-30T17:03:22.255 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023120405, 2023-09-30T17:03:22.255 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:22.255 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:22.256 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:22.256 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.256 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:22.256 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:03:22.256 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:22.256 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.256 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.256 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:22.256 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:03:22.256 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:22.256 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.256 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.257 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:22.257 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352214+0000", 2023-09-30T17:03:22.257 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8400000000000003e-07 2023-09-30T17:03:22.257 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.257 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.257 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:22.257 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352233+0000", 2023-09-30T17:03:22.257 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8946000000000001e-05 2023-09-30T17:03:22.257 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.257 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.257 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:22.257 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352297+0000", 2023-09-30T17:03:22.258 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3540999999999994e-05 2023-09-30T17:03:22.258 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.258 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.258 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:22.258 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352450+0000", 2023-09-30T17:03:22.258 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015364799999999999 2023-09-30T17:03:22.258 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.258 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.258 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:22.258 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353098+0000", 2023-09-30T17:03:22.258 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00064820299999999997 2023-09-30T17:03:22.258 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.259 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.259 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:22.259 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353103+0000", 2023-09-30T17:03:22.259 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0529999999999997e-06 2023-09-30T17:03:22.259 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.259 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.259 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:22.259 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.358558+0000", 2023-09-30T17:03:22.259 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0054550249999999996 2023-09-30T17:03:22.259 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.259 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.259 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:22.260 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.358741+0000", 2023-09-30T17:03:22.260 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00018210200000000001 2023-09-30T17:03:22.260 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.260 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.260 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:22.260 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.359683+0000", 2023-09-30T17:03:22.260 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00094202299999999995 2023-09-30T17:03:22.260 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.260 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.260 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:22.260 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365044+0000", 2023-09-30T17:03:22.260 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053616219999999999 2023-09-30T17:03:22.261 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.261 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.261 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:22.261 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375256+0000", 2023-09-30T17:03:22.261 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010212156 2023-09-30T17:03:22.261 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.261 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.261 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:22.261 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375300+0000", 2023-09-30T17:03:22.261 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3961999999999997e-05 2023-09-30T17:03:22.261 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.261 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.262 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:22.262 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375334+0000", 2023-09-30T17:03:22.262 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.324e-05 2023-09-30T17:03:22.262 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:22.262 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:22.262 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:22.262 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.262 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.262 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:22.262 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:03:22.262 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 63.859693278000002, 2023-09-30T17:03:22.262 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024240660000000001, 2023-09-30T17:03:22.263 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:22.263 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:22.263 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:22.263 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.263 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:22.263 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:03:22.263 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:22.263 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.263 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.263 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:22.263 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:03:22.264 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:22.264 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.264 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.264 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:22.264 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352529+0000", 2023-09-30T17:03:22.264 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1379999999999999e-06 2023-09-30T17:03:22.264 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.264 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.264 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:22.264 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352536+0000", 2023-09-30T17:03:22.264 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3489999999999997e-06 2023-09-30T17:03:22.264 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.265 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.265 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:22.265 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352547+0000", 2023-09-30T17:03:22.265 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1109e-05 2023-09-30T17:03:22.265 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.265 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.265 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:22.265 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352560+0000", 2023-09-30T17:03:22.265 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3046e-05 2023-09-30T17:03:22.265 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.265 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.265 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:22.266 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353142+0000", 2023-09-30T17:03:22.266 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00058174699999999997 2023-09-30T17:03:22.266 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.266 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.266 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:22.266 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353147+0000", 2023-09-30T17:03:22.266 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5840000000000002e-06 2023-09-30T17:03:22.266 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.266 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.266 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:22.266 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360374+0000", 2023-09-30T17:03:22.266 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0072270049999999999 2023-09-30T17:03:22.267 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.267 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.267 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:22.267 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360795+0000", 2023-09-30T17:03:22.267 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00042088999999999999 2023-09-30T17:03:22.267 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.267 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.267 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:22.267 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360967+0000", 2023-09-30T17:03:22.267 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017235699999999999 2023-09-30T17:03:22.267 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.267 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.268 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:22.268 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365051+0000", 2023-09-30T17:03:22.268 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0040837429999999999 2023-09-30T17:03:22.268 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.268 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.268 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:22.268 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376708+0000", 2023-09-30T17:03:22.268 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011656866 2023-09-30T17:03:22.268 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.268 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.268 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:22.269 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376745+0000", 2023-09-30T17:03:22.269 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6769e-05 2023-09-30T17:03:22.269 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.269 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.269 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:22.269 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376769+0000", 2023-09-30T17:03:22.269 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4057e-05 2023-09-30T17:03:22.269 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:22.269 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:22.269 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:22.269 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.269 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.270 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:22.270 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:22.270 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 63.859433922999997, 2023-09-30T17:03:22.270 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023472704, 2023-09-30T17:03:22.270 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:22.270 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:22.270 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:22.270 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.270 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:22.270 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:22.270 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:22.270 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.271 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.271 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:22.271 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:22.271 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:22.271 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.271 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.271 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:22.271 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:22.271 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8000000000000005e-07 2023-09-30T17:03:22.271 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.271 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.271 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:22.271 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352794+0000", 2023-09-30T17:03:22.272 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.789e-06 2023-09-30T17:03:22.272 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.272 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.272 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:22.272 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352805+0000", 2023-09-30T17:03:22.272 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0848e-05 2023-09-30T17:03:22.272 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.272 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.272 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:22.272 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352812+0000", 2023-09-30T17:03:22.272 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4449999999999999e-06 2023-09-30T17:03:22.272 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.273 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.273 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:22.273 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353063+0000", 2023-09-30T17:03:22.273 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00025046299999999998 2023-09-30T17:03:22.273 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.273 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.273 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:22.273 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353071+0000", 2023-09-30T17:03:22.273 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6739999999999997e-06 2023-09-30T17:03:22.273 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.273 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.274 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:22.274 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361696+0000", 2023-09-30T17:03:22.274 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0086251609999999992 2023-09-30T17:03:22.274 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.274 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.274 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:22.274 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362284+0000", 2023-09-30T17:03:22.274 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00058872299999999998 2023-09-30T17:03:22.274 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.274 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.274 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:22.275 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362429+0000", 2023-09-30T17:03:22.275 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014509000000000001 2023-09-30T17:03:22.275 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.275 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.275 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:22.275 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365330+0000", 2023-09-30T17:03:22.275 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0029005419999999999 2023-09-30T17:03:22.275 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.275 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.275 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:22.275 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376196+0000", 2023-09-30T17:03:22.275 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.01086615 2023-09-30T17:03:22.276 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.276 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.276 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:22.276 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376230+0000", 2023-09-30T17:03:22.276 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3858e-05 2023-09-30T17:03:22.276 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.276 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.276 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:22.276 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376260+0000", 2023-09-30T17:03:22.276 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0181000000000001e-05 2023-09-30T17:03:22.276 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:22.276 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:22.277 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:22.277 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.277 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.277 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:22.277 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:03:22.277 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 63.859200352999999, 2023-09-30T17:03:22.277 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023406132999999999, 2023-09-30T17:03:22.277 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:22.277 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:22.277 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:22.277 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.278 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:22.278 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:03:22.278 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:22.278 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.278 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.278 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:22.278 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:03:22.278 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:22.278 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.278 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.278 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:22.278 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353022+0000", 2023-09-30T17:03:22.279 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.78e-07 2023-09-30T17:03:22.279 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.279 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.279 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:22.279 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353027+0000", 2023-09-30T17:03:22.279 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9089999999999999e-06 2023-09-30T17:03:22.279 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.279 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.279 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:22.279 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353035+0000", 2023-09-30T17:03:22.279 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0430000000000008e-06 2023-09-30T17:03:22.279 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.280 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.280 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:22.280 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353047+0000", 2023-09-30T17:03:22.280 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1674e-05 2023-09-30T17:03:22.280 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.280 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.280 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:22.280 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353105+0000", 2023-09-30T17:03:22.280 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8891999999999998e-05 2023-09-30T17:03:22.280 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.280 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.280 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:22.281 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353112+0000", 2023-09-30T17:03:22.281 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7059999999999998e-06 2023-09-30T17:03:22.281 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.281 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.281 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:22.281 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362733+0000", 2023-09-30T17:03:22.281 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0096205869999999999 2023-09-30T17:03:22.281 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.281 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.281 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:22.281 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362833+0000", 2023-09-30T17:03:22.281 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000100227 2023-09-30T17:03:22.282 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.282 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.282 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:22.282 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363000+0000", 2023-09-30T17:03:22.282 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016670899999999999 2023-09-30T17:03:22.282 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.282 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.282 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:22.282 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365550+0000", 2023-09-30T17:03:22.282 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0025499199999999998 2023-09-30T17:03:22.282 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.283 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.283 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:22.283 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376315+0000", 2023-09-30T17:03:22.283 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010765011999999999 2023-09-30T17:03:22.283 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.283 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.283 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:22.283 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376386+0000", 2023-09-30T17:03:22.283 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0866999999999998e-05 2023-09-30T17:03:22.283 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.283 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.283 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:22.284 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376427+0000", 2023-09-30T17:03:22.284 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1709000000000003e-05 2023-09-30T17:03:22.284 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:22.284 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:22.284 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:22.284 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.284 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.284 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:22.284 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:22.284 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 63.859159716999997, 2023-09-30T17:03:22.284 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024076238, 2023-09-30T17:03:22.284 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:22.285 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:22.285 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:22.285 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.285 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:22.285 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:22.285 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:22.285 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.285 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.285 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:22.285 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:22.285 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:22.285 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.286 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.286 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:22.286 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:22.286 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8699999999999995e-07 2023-09-30T17:03:22.286 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.286 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.286 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:22.286 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353067+0000", 2023-09-30T17:03:22.286 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.605e-06 2023-09-30T17:03:22.286 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.286 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.286 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:22.287 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353073+0000", 2023-09-30T17:03:22.287 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8900000000000004e-06 2023-09-30T17:03:22.287 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.287 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.287 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:22.287 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353083+0000", 2023-09-30T17:03:22.287 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0200000000000001e-05 2023-09-30T17:03:22.287 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.287 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.287 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:22.287 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353186+0000", 2023-09-30T17:03:22.287 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010256599999999999 2023-09-30T17:03:22.288 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.288 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.288 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:22.288 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353190+0000", 2023-09-30T17:03:22.288 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9709999999999998e-06 2023-09-30T17:03:22.288 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.288 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.288 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:22.288 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362946+0000", 2023-09-30T17:03:22.288 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0097563330000000007 2023-09-30T17:03:22.288 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.288 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.289 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:22.289 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363088+0000", 2023-09-30T17:03:22.289 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014259200000000001 2023-09-30T17:03:22.289 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.289 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.289 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:22.289 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363555+0000", 2023-09-30T17:03:22.289 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00046627799999999998 2023-09-30T17:03:22.289 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.289 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.289 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:22.289 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365871+0000", 2023-09-30T17:03:22.289 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0023167589999999998 2023-09-30T17:03:22.290 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.290 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.290 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:22.290 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377033+0000", 2023-09-30T17:03:22.290 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011161203999999999 2023-09-30T17:03:22.290 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.290 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.290 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:22.290 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377100+0000", 2023-09-30T17:03:22.290 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7230999999999994e-05 2023-09-30T17:03:22.290 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.290 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.291 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:22.291 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377138+0000", 2023-09-30T17:03:22.291 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8022000000000003e-05 2023-09-30T17:03:22.291 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:22.291 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:22.291 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:22.291 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.291 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.291 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:22.291 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:03:22.291 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 63.859058767999997, 2023-09-30T17:03:22.291 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.020304412000000001, 2023-09-30T17:03:22.291 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:22.292 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:22.292 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:22.292 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.292 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:22.292 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:03:22.292 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:22.292 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.292 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.292 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:22.292 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:03:22.292 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:22.292 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.293 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.293 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:22.293 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353164+0000", 2023-09-30T17:03:22.293 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7100000000000011e-07 2023-09-30T17:03:22.293 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.293 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.293 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:22.293 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353168+0000", 2023-09-30T17:03:22.293 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0600000000000001e-06 2023-09-30T17:03:22.293 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.293 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.293 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:22.294 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353177+0000", 2023-09-30T17:03:22.294 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1409999999999994e-06 2023-09-30T17:03:22.294 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.294 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.294 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:22.294 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353185+0000", 2023-09-30T17:03:22.294 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2479999999999996e-06 2023-09-30T17:03:22.294 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.294 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.294 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:22.294 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353246+0000", 2023-09-30T17:03:22.294 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0519000000000001e-05 2023-09-30T17:03:22.295 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.295 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.295 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:22.295 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353252+0000", 2023-09-30T17:03:22.295 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7859999999999999e-06 2023-09-30T17:03:22.295 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.295 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.295 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:22.295 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354979+0000", 2023-09-30T17:03:22.295 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0017270090000000001 2023-09-30T17:03:22.295 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.296 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.296 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:22.296 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355097+0000", 2023-09-30T17:03:22.296 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000117472 2023-09-30T17:03:22.296 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.296 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.296 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:22.296 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.373467+0000", 2023-09-30T17:03:22.296 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.018370206 2023-09-30T17:03:22.296 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:22.296 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:22.296 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:22.296 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.297 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.297 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:22.297 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:03:22.297 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 63.859018030000001, 2023-09-30T17:03:22.297 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.012725089, 2023-09-30T17:03:22.297 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:22.297 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:22.297 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:22.297 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.297 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:22.297 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:03:22.298 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:22.298 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.298 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.298 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:22.298 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:03:22.298 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:22.298 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.298 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.298 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:22.298 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353204+0000", 2023-09-30T17:03:22.298 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7100000000000002e-07 2023-09-30T17:03:22.298 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.299 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.299 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:22.299 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353213+0000", 2023-09-30T17:03:22.299 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8580000000000006e-06 2023-09-30T17:03:22.299 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.299 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.299 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:22.299 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353219+0000", 2023-09-30T17:03:22.299 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8939999999999998e-06 2023-09-30T17:03:22.299 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.299 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.299 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:22.300 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353223+0000", 2023-09-30T17:03:22.300 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.357e-06 2023-09-30T17:03:22.300 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.300 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.300 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:22.300 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353278+0000", 2023-09-30T17:03:22.300 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5228e-05 2023-09-30T17:03:22.300 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.300 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.300 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:22.300 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353284+0000", 2023-09-30T17:03:22.300 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8209999999999998e-06 2023-09-30T17:03:22.301 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.301 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.301 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:22.301 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355095+0000", 2023-09-30T17:03:22.301 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001811404 2023-09-30T17:03:22.301 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.301 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.301 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:22.301 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355256+0000", 2023-09-30T17:03:22.301 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000160898 2023-09-30T17:03:22.301 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.301 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.302 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:22.302 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365928+0000", 2023-09-30T17:03:22.302 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010672157999999999 2023-09-30T17:03:22.302 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:22.302 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:22.302 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:22.302 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.302 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.302 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-09-30T17:03:22.302 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:03:22.302 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 63.858486823, 2023-09-30T17:03:22.302 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0056863460000000001, 2023-09-30T17:03:22.303 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:22.303 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "reached pg", 2023-09-30T17:03:22.303 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:22.303 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.303 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:22.303 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:03:22.303 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:22.303 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.303 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.303 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:22.303 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:03:22.304 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:22.304 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.304 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.304 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:22.304 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:03:22.304 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5700000000000002e-07 2023-09-30T17:03:22.304 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.304 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.304 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:22.304 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353747+0000", 2023-09-30T17:03:22.304 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1899000000000001e-05 2023-09-30T17:03:22.304 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.305 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.305 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:22.305 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353776+0000", 2023-09-30T17:03:22.305 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.8767000000000001e-05 2023-09-30T17:03:22.305 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.305 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.305 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:22.305 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353792+0000", 2023-09-30T17:03:22.305 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5914999999999999e-05 2023-09-30T17:03:22.305 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.305 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.305 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:22.306 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353900+0000", 2023-09-30T17:03:22.306 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010774500000000001 2023-09-30T17:03:22.306 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.306 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.306 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:22.306 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.359421+0000", 2023-09-30T17:03:22.306 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0055213629999999996 2023-09-30T17:03:22.306 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:22.306 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:22.306 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:22.306 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.306 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.307 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:03:22.307 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:03:22.307 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 63.857815223000003, 2023-09-30T17:03:22.307 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0069196370000000002, 2023-09-30T17:03:22.307 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:22.307 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:22.307 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:22.307 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.307 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:22.307 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:03:22.307 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:22.307 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.308 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.308 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:22.308 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:03:22.308 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:22.308 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.308 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.308 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:22.308 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354407+0000", 2023-09-30T17:03:22.308 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7400000000000002e-07 2023-09-30T17:03:22.308 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.308 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.308 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:22.309 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354414+0000", 2023-09-30T17:03:22.309 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1040000000000001e-06 2023-09-30T17:03:22.309 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.309 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.309 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:22.309 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354425+0000", 2023-09-30T17:03:22.309 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1090000000000001e-05 2023-09-30T17:03:22.309 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.309 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.309 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:22.309 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354435+0000", 2023-09-30T17:03:22.309 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8169999999999994e-06 2023-09-30T17:03:22.310 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.310 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.310 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:22.310 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355741+0000", 2023-09-30T17:03:22.310 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0013063160000000001 2023-09-30T17:03:22.310 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.310 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.310 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:22.310 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355763+0000", 2023-09-30T17:03:22.310 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1688e-05 2023-09-30T17:03:22.310 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.310 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.310 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:22.311 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361289+0000", 2023-09-30T17:03:22.311 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0055258269999999996 2023-09-30T17:03:22.311 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.311 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.311 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:22.311 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361326+0000", 2023-09-30T17:03:22.311 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7020999999999997e-05 2023-09-30T17:03:22.311 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:22.311 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:22.311 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:22.311 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.311 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.312 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:30 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2023-09-30T17:03:22.312 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:03:22.312 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 63.856441265000001, 2023-09-30T17:03:22.312 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0069996629999999997, 2023-09-30T17:03:22.312 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:22.312 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:22.312 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:22.312 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.312 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:22.312 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:03:22.312 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:22.312 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.313 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.313 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:22.313 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:03:22.313 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:22.313 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.313 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.313 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:22.313 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355781+0000", 2023-09-30T17:03:22.313 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9599999999999999e-07 2023-09-30T17:03:22.313 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.313 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.313 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:22.314 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355788+0000", 2023-09-30T17:03:22.314 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8129999999999996e-06 2023-09-30T17:03:22.314 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.314 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.314 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:22.314 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355798+0000", 2023-09-30T17:03:22.314 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2909999999999996e-06 2023-09-30T17:03:22.314 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.314 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.314 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:22.314 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355807+0000", 2023-09-30T17:03:22.314 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8619999999999992e-06 2023-09-30T17:03:22.315 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.315 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.315 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:22.315 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.357264+0000", 2023-09-30T17:03:22.315 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0014578289999999999 2023-09-30T17:03:22.315 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.315 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.315 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:22.315 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.357916+0000", 2023-09-30T17:03:22.315 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00065170500000000004 2023-09-30T17:03:22.315 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.315 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.316 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:22.316 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362731+0000", 2023-09-30T17:03:22.316 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0048149849999999999 2023-09-30T17:03:22.316 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.316 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.316 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:22.316 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362780+0000", 2023-09-30T17:03:22.316 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8681999999999999e-05 2023-09-30T17:03:22.316 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:22.316 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:22.316 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:22.316 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.316 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.317 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2023-09-30T17:03:22.317 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:03:22.317 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 63.837790214000002, 2023-09-30T17:03:22.317 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005905998, 2023-09-30T17:03:22.317 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:22.317 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:22.317 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:22.317 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.317 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:22.317 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:03:22.317 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:22.317 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.318 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.318 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:22.318 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:03:22.318 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:22.318 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.318 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.318 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:22.318 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:03:22.318 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1e-07 2023-09-30T17:03:22.318 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.318 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.318 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:22.319 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374455+0000", 2023-09-30T17:03:22.319 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.3091999999999998e-05 2023-09-30T17:03:22.319 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.319 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.319 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:22.319 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374462+0000", 2023-09-30T17:03:22.319 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5170000000000002e-06 2023-09-30T17:03:22.319 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.319 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.319 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:22.319 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374469+0000", 2023-09-30T17:03:22.319 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8199999999999999e-06 2023-09-30T17:03:22.320 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.320 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.320 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:22.320 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374550+0000", 2023-09-30T17:03:22.320 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0978999999999998e-05 2023-09-30T17:03:22.320 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.320 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.320 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:22.320 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374562+0000", 2023-09-30T17:03:22.320 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2472e-05 2023-09-30T17:03:22.320 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.320 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.320 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:22.321 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380293+0000", 2023-09-30T17:03:22.321 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0057310379999999999 2023-09-30T17:03:22.321 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.321 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.321 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:22.321 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380337+0000", 2023-09-30T17:03:22.321 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3869999999999998e-05 2023-09-30T17:03:22.321 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:22.321 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:22.321 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:22.321 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.321 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.322 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2023-09-30T17:03:22.322 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:03:22.322 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 63.837603465000001, 2023-09-30T17:03:22.322 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0057590560000000002, 2023-09-30T17:03:22.322 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:22.322 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:22.322 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:22.322 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.322 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:22.322 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:03:22.322 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:22.323 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.323 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.323 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:22.323 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:03:22.323 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:22.323 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.323 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.323 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:22.323 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:03:22.323 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4900000000000001e-07 2023-09-30T17:03:22.323 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.323 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.324 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:22.324 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374629+0000", 2023-09-30T17:03:22.324 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1014e-05 2023-09-30T17:03:22.324 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.324 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.324 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:22.324 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374636+0000", 2023-09-30T17:03:22.324 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5889999999999999e-06 2023-09-30T17:03:22.324 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.324 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.324 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:22.324 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374642+0000", 2023-09-30T17:03:22.325 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.48e-06 2023-09-30T17:03:22.325 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.325 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.325 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:22.325 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374681+0000", 2023-09-30T17:03:22.325 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9320000000000003e-05 2023-09-30T17:03:22.325 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.325 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.325 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:22.325 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374694+0000", 2023-09-30T17:03:22.325 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3351e-05 2023-09-30T17:03:22.326 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.326 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.326 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:22.326 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380319+0000", 2023-09-30T17:03:22.326 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0056243880000000001 2023-09-30T17:03:22.326 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.326 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.326 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:22.326 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380377+0000", 2023-09-30T17:03:22.326 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8464999999999997e-05 2023-09-30T17:03:22.326 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:22.326 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:22.327 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:22.327 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.327 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.327 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=0'0)", 2023-09-30T17:03:22.327 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:03:22.327 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 63.836892554000002, 2023-09-30T17:03:22.327 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051157370000000004, 2023-09-30T17:03:22.327 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:22.327 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:22.327 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:22.327 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.327 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:22.328 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:03:22.328 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:22.328 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.328 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.328 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:22.328 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:03:22.328 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:22.328 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.328 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.328 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:22.328 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:03:22.328 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0199999999999998e-07 2023-09-30T17:03:22.329 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.329 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.329 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:22.329 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375334+0000", 2023-09-30T17:03:22.329 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8799999999999999e-06 2023-09-30T17:03:22.329 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.329 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.329 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:22.329 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375343+0000", 2023-09-30T17:03:22.329 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5490000000000006e-06 2023-09-30T17:03:22.329 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.329 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.330 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:22.330 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375350+0000", 2023-09-30T17:03:22.330 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5700000000000004e-06 2023-09-30T17:03:22.330 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.330 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.330 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:22.330 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375396+0000", 2023-09-30T17:03:22.330 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5550999999999998e-05 2023-09-30T17:03:22.330 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.330 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.330 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:22.330 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375410+0000", 2023-09-30T17:03:22.331 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4518999999999999e-05 2023-09-30T17:03:22.331 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.331 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.331 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:22.331 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380401+0000", 2023-09-30T17:03:22.331 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0049903430000000004 2023-09-30T17:03:22.331 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:22.331 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:22.331 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:22.331 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380445+0000", 2023-09-30T17:03:22.331 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4023000000000002e-05 2023-09-30T17:03:22.331 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:22.331 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:22.332 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:22.332 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:22.332 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:22.332 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:22.333 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:03:22.334 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:22.332+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:22.335 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-09-30T17:03:22.434 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:22.434+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:22.464 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:22.465 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:03:22.465 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2023-09-30T17:03:22.465 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:22.477 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:03:22.535 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:22.534+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:22.584 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-09-30T17:03:22.603 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:22.603 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:03:22.603 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2023-09-30T17:03:22.603 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2023-09-30T17:03:22.603 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:22.613 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:03:22.636 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:22.636+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:22.656 INFO:tasks.workunit.client.0.smithi007.stderr:Note: switching to '1d10b71792f3be8887a7631e69851ac2df3585af'. 2023-09-30T17:03:22.657 INFO:tasks.workunit.client.0.smithi007.stderr: 2023-09-30T17:03:22.657 INFO:tasks.workunit.client.0.smithi007.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2023-09-30T17:03:22.657 INFO:tasks.workunit.client.0.smithi007.stderr:changes and commit them, and you can discard any commits you make in this 2023-09-30T17:03:22.657 INFO:tasks.workunit.client.0.smithi007.stderr:state without impacting any branches by switching back to a branch. 2023-09-30T17:03:22.657 INFO:tasks.workunit.client.0.smithi007.stderr: 2023-09-30T17:03:22.657 INFO:tasks.workunit.client.0.smithi007.stderr:If you want to create a new branch to retain commits you create, you may 2023-09-30T17:03:22.657 INFO:tasks.workunit.client.0.smithi007.stderr:do so (now or later) by using -c with the switch command. Example: 2023-09-30T17:03:22.657 INFO:tasks.workunit.client.0.smithi007.stderr: 2023-09-30T17:03:22.657 INFO:tasks.workunit.client.0.smithi007.stderr: git switch -c 2023-09-30T17:03:22.657 INFO:tasks.workunit.client.0.smithi007.stderr: 2023-09-30T17:03:22.657 INFO:tasks.workunit.client.0.smithi007.stderr:Or undo this operation with: 2023-09-30T17:03:22.658 INFO:tasks.workunit.client.0.smithi007.stderr: 2023-09-30T17:03:22.658 INFO:tasks.workunit.client.0.smithi007.stderr: git switch - 2023-09-30T17:03:22.658 INFO:tasks.workunit.client.0.smithi007.stderr: 2023-09-30T17:03:22.658 INFO:tasks.workunit.client.0.smithi007.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2023-09-30T17:03:22.658 INFO:tasks.workunit.client.0.smithi007.stderr: 2023-09-30T17:03:22.658 INFO:tasks.workunit.client.0.smithi007.stderr:HEAD is now at 1d10b71792f Merge pull request #53723 from zdover23/wip-doc-2023-09-29-architecture-13-of-x 2023-09-30T17:03:22.661 DEBUG:teuthology.orchestra.run.smithi007:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2023-09-30T17:03:22.682 INFO:tasks.workunit.client.0.smithi007.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2023-09-30T17:03:22.685 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-09-30T17:03:22.685 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2023-09-30T17:03:22.735 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:03:22.737 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~35s 2023-09-30T17:03:22.737 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:22.737+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:22.742 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:22.742 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2023-09-30T17:03:22.742 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2023-09-30T17:03:22.742 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2023-09-30T17:03:22.742 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.743 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:22.743 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:03:22.743 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 64.389257391000001, 2023-09-30T17:03:22.743 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093789779999999996, 2023-09-30T17:03:22.743 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:22.743 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:22.743 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:22.743 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.743 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:22.743 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:03:22.743 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:22.744 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.744 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:22.744 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:03:22.744 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:22.744 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.744 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:22.744 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352027+0000", 2023-09-30T17:03:22.744 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0224000000000001e-05 2023-09-30T17:03:22.744 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.745 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:22.745 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352039+0000", 2023-09-30T17:03:22.745 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1569000000000001e-05 2023-09-30T17:03:22.745 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.745 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.745 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:22.745 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352052+0000", 2023-09-30T17:03:22.745 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2605999999999999e-05 2023-09-30T17:03:22.745 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.745 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.745 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:22.745 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352064+0000", 2023-09-30T17:03:22.746 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2666999999999999e-05 2023-09-30T17:03:22.746 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.746 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.746 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:22.746 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352147+0000", 2023-09-30T17:03:22.746 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3125000000000001e-05 2023-09-30T17:03:22.746 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.746 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.746 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:22.746 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352306+0000", 2023-09-30T17:03:22.747 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015881900000000001 2023-09-30T17:03:22.747 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.747 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.747 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:22.747 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352450+0000", 2023-09-30T17:03:22.747 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014420700000000001 2023-09-30T17:03:22.747 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.747 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.747 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:22.747 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355975+0000", 2023-09-30T17:03:22.747 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003524246 2023-09-30T17:03:22.747 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.748 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.748 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:22.748 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361279+0000", 2023-09-30T17:03:22.748 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005304507 2023-09-30T17:03:22.748 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.748 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.748 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:22.748 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361344+0000", 2023-09-30T17:03:22.748 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4548999999999995e-05 2023-09-30T17:03:22.748 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.748 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.748 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:22.749 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361396+0000", 2023-09-30T17:03:22.749 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2459e-05 2023-09-30T17:03:22.749 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:22.749 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:22.749 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:22.749 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.749 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.749 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:22.749 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:03:22.749 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 64.389165098999996, 2023-09-30T17:03:22.749 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021233007000000002, 2023-09-30T17:03:22.749 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:22.750 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:22.750 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:22.750 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.750 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:22.750 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:03:22.750 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:22.750 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.750 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.750 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:22.750 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:03:22.751 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:22.751 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.751 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.751 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:22.751 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352110+0000", 2023-09-30T17:03:22.751 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6000000000000002e-07 2023-09-30T17:03:22.751 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.751 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.751 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:22.751 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352117+0000", 2023-09-30T17:03:22.751 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5930000000000002e-06 2023-09-30T17:03:22.752 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.752 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.752 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:22.752 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352126+0000", 2023-09-30T17:03:22.752 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0729999999999994e-06 2023-09-30T17:03:22.752 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.752 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.752 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:22.752 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352136+0000", 2023-09-30T17:03:22.752 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0380000000000001e-05 2023-09-30T17:03:22.752 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.753 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.753 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:22.753 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353279+0000", 2023-09-30T17:03:22.753 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0011424670000000001 2023-09-30T17:03:22.753 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.753 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.753 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:22.753 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353707+0000", 2023-09-30T17:03:22.753 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00042829800000000003 2023-09-30T17:03:22.753 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.754 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.754 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:22.754 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354104+0000", 2023-09-30T17:03:22.754 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00039643399999999998 2023-09-30T17:03:22.754 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.754 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.754 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:22.754 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356925+0000", 2023-09-30T17:03:22.754 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0028210900000000001 2023-09-30T17:03:22.754 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.755 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.755 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:22.755 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373243+0000", 2023-09-30T17:03:22.755 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016318461999999999 2023-09-30T17:03:22.755 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.755 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.755 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:22.755 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373301+0000", 2023-09-30T17:03:22.755 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7435000000000002e-05 2023-09-30T17:03:22.755 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.756 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.756 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:22.756 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373342+0000", 2023-09-30T17:03:22.756 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1915000000000001e-05 2023-09-30T17:03:22.756 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:22.756 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:22.756 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:22.756 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.756 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.756 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:22.756 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:03:22.757 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 64.389122487999998, 2023-09-30T17:03:22.757 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011988331, 2023-09-30T17:03:22.757 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:22.757 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:22.757 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:22.757 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.757 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:22.757 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:03:22.757 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:22.757 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.757 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.757 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:22.758 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:03:22.758 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:22.758 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.758 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.758 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:22.758 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352153+0000", 2023-09-30T17:03:22.758 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0500000000000003e-07 2023-09-30T17:03:22.758 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.758 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.758 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:22.758 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352157+0000", 2023-09-30T17:03:22.758 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9790000000000004e-06 2023-09-30T17:03:22.759 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.759 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.759 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:22.759 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352173+0000", 2023-09-30T17:03:22.759 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6535999999999999e-05 2023-09-30T17:03:22.759 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.759 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.759 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:22.759 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352180+0000", 2023-09-30T17:03:22.759 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7700000000000004e-06 2023-09-30T17:03:22.759 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.759 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.760 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:22.760 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353526+0000", 2023-09-30T17:03:22.760 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0013458330000000001 2023-09-30T17:03:22.760 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.760 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.760 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:22.760 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353648+0000", 2023-09-30T17:03:22.760 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012262899999999999 2023-09-30T17:03:22.760 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.760 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.760 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:22.761 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354141+0000", 2023-09-30T17:03:22.761 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00049222899999999995 2023-09-30T17:03:22.761 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.761 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.761 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:22.761 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356931+0000", 2023-09-30T17:03:22.761 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0027900860000000002 2023-09-30T17:03:22.761 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.761 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.761 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:22.761 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364066+0000", 2023-09-30T17:03:22.762 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071355050000000003 2023-09-30T17:03:22.762 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.762 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.762 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:22.762 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364103+0000", 2023-09-30T17:03:22.762 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6944999999999999e-05 2023-09-30T17:03:22.762 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.762 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.762 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:22.763 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364140+0000", 2023-09-30T17:03:22.763 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7214e-05 2023-09-30T17:03:22.763 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:22.763 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:22.763 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:22.763 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.763 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.763 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:22.763 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:03:22.763 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 64.389083256999996, 2023-09-30T17:03:22.763 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012110921, 2023-09-30T17:03:22.764 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:22.764 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:22.764 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:22.764 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.764 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:22.764 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:03:22.764 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:22.764 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.764 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.764 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:22.764 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:03:22.764 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:22.765 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.765 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.765 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:22.765 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352192+0000", 2023-09-30T17:03:22.765 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7300000000000005e-07 2023-09-30T17:03:22.765 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.765 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.765 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:22.765 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352196+0000", 2023-09-30T17:03:22.765 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2370000000000003e-06 2023-09-30T17:03:22.765 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.766 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.766 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:22.766 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352205+0000", 2023-09-30T17:03:22.766 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6659999999999997e-06 2023-09-30T17:03:22.766 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.766 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.766 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:22.766 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352214+0000", 2023-09-30T17:03:22.766 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8259999999999999e-06 2023-09-30T17:03:22.766 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.767 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.767 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:22.767 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354470+0000", 2023-09-30T17:03:22.767 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022557340000000001 2023-09-30T17:03:22.767 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.767 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.767 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:22.767 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354557+0000", 2023-09-30T17:03:22.767 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6909000000000004e-05 2023-09-30T17:03:22.767 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.768 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.768 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:22.768 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354694+0000", 2023-09-30T17:03:22.768 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013774800000000001 2023-09-30T17:03:22.768 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.768 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.768 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:22.768 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356937+0000", 2023-09-30T17:03:22.768 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022424540000000001 2023-09-30T17:03:22.768 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.768 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.768 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:22.769 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364227+0000", 2023-09-30T17:03:22.769 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072902430000000001 2023-09-30T17:03:22.769 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.769 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.769 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:22.769 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364278+0000", 2023-09-30T17:03:22.769 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1180999999999997e-05 2023-09-30T17:03:22.769 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.769 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.769 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:22.769 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364302+0000", 2023-09-30T17:03:22.770 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4049999999999998e-05 2023-09-30T17:03:22.770 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:22.770 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:22.770 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:22.770 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.770 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.770 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:22.770 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:22.770 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 64.389049917999998, 2023-09-30T17:03:22.770 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021258651999999999, 2023-09-30T17:03:22.770 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:22.771 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:22.771 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:22.771 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.771 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:22.771 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:22.771 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:22.771 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.771 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.771 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:22.771 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:22.772 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:22.772 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.772 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.772 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:22.772 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:22.772 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6899999999999997e-07 2023-09-30T17:03:22.772 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.772 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.772 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:22.772 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352236+0000", 2023-09-30T17:03:22.773 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0251000000000001e-05 2023-09-30T17:03:22.773 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.773 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.773 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:22.773 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352244+0000", 2023-09-30T17:03:22.773 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0770000000000008e-06 2023-09-30T17:03:22.773 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.773 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.773 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:22.773 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352251+0000", 2023-09-30T17:03:22.773 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4749999999999996e-06 2023-09-30T17:03:22.774 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.774 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.774 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:22.774 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354455+0000", 2023-09-30T17:03:22.774 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022043660000000001 2023-09-30T17:03:22.774 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.774 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.774 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:22.774 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354577+0000", 2023-09-30T17:03:22.774 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000121054 2023-09-30T17:03:22.775 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.775 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.775 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:22.775 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354723+0000", 2023-09-30T17:03:22.775 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014693900000000001 2023-09-30T17:03:22.775 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.775 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.775 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:22.775 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356941+0000", 2023-09-30T17:03:22.775 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002217199 2023-09-30T17:03:22.775 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.775 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.776 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:22.776 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373392+0000", 2023-09-30T17:03:22.776 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016451774999999998 2023-09-30T17:03:22.776 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.776 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.776 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:22.776 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373445+0000", 2023-09-30T17:03:22.776 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.308e-05 2023-09-30T17:03:22.776 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.776 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.776 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:22.777 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373483+0000", 2023-09-30T17:03:22.777 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7766999999999999e-05 2023-09-30T17:03:22.777 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:22.777 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:22.777 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:22.777 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.777 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.777 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:22.777 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:22.777 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 64.389013826999999, 2023-09-30T17:03:22.777 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020903497, 2023-09-30T17:03:22.778 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:22.778 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:22.778 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:22.778 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.778 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:22.778 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:22.778 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:22.778 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.778 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.778 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:22.778 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:22.778 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:22.779 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.779 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.779 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:22.779 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:22.779 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0800000000000004e-07 2023-09-30T17:03:22.779 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.779 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.779 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:22.779 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352266+0000", 2023-09-30T17:03:22.779 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1280000000000001e-06 2023-09-30T17:03:22.779 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.779 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.780 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:22.780 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352273+0000", 2023-09-30T17:03:22.780 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3730000000000004e-06 2023-09-30T17:03:22.780 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.780 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.780 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:22.780 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352279+0000", 2023-09-30T17:03:22.780 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7699999999999998e-06 2023-09-30T17:03:22.780 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.780 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.780 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:22.780 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352334+0000", 2023-09-30T17:03:22.781 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5547999999999997e-05 2023-09-30T17:03:22.781 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.781 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.781 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:22.781 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352435+0000", 2023-09-30T17:03:22.781 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100688 2023-09-30T17:03:22.781 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.781 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.781 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:22.781 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352585+0000", 2023-09-30T17:03:22.781 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000150068 2023-09-30T17:03:22.782 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.782 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.782 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:22.782 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354912+0000", 2023-09-30T17:03:22.782 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0023266770000000001 2023-09-30T17:03:22.782 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.782 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.782 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:22.782 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373066+0000", 2023-09-30T17:03:22.782 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018154474 2023-09-30T17:03:22.782 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.782 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.783 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:22.783 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373122+0000", 2023-09-30T17:03:22.783 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6193000000000002e-05 2023-09-30T17:03:22.783 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.783 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.783 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:22.783 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373164+0000", 2023-09-30T17:03:22.783 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1869999999999997e-05 2023-09-30T17:03:22.783 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:22.783 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:22.783 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:22.783 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.784 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.784 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:22.784 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:03:22.784 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 64.388978151000003, 2023-09-30T17:03:22.784 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021015097999999999, 2023-09-30T17:03:22.784 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:22.784 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:22.784 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:22.784 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.784 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:22.784 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:03:22.785 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:22.785 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.785 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.785 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:22.785 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:03:22.785 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:22.785 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.785 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.785 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:22.785 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352297+0000", 2023-09-30T17:03:22.785 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8299999999999997e-07 2023-09-30T17:03:22.785 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.786 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.786 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:22.786 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352300+0000", 2023-09-30T17:03:22.786 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7460000000000001e-06 2023-09-30T17:03:22.786 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.786 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.786 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:22.786 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352307+0000", 2023-09-30T17:03:22.786 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4959999999999999e-06 2023-09-30T17:03:22.786 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.786 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.786 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:22.787 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352314+0000", 2023-09-30T17:03:22.787 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0190000000000001e-06 2023-09-30T17:03:22.787 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.787 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.787 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:22.787 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354070+0000", 2023-09-30T17:03:22.787 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001755936 2023-09-30T17:03:22.787 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.787 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.787 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:22.787 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354221+0000", 2023-09-30T17:03:22.787 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000150884 2023-09-30T17:03:22.788 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.788 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.788 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:22.788 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373311+0000", 2023-09-30T17:03:22.788 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019090434 2023-09-30T17:03:22.788 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:22.788 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:22.788 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:22.788 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.788 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.788 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:22.788 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:03:22.789 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 64.388949432000004, 2023-09-30T17:03:22.789 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021255174000000002, 2023-09-30T17:03:22.789 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:22.789 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:22.789 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:22.789 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.789 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:22.789 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:03:22.789 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:22.789 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.789 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.789 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:22.790 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:03:22.790 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:22.790 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.790 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.790 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:22.790 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352326+0000", 2023-09-30T17:03:22.790 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3200000000000005e-07 2023-09-30T17:03:22.790 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.790 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.790 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:22.790 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352349+0000", 2023-09-30T17:03:22.791 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3183000000000001e-05 2023-09-30T17:03:22.791 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.791 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.791 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:22.791 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352358+0000", 2023-09-30T17:03:22.791 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5230000000000001e-06 2023-09-30T17:03:22.791 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.791 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.791 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:22.791 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352365+0000", 2023-09-30T17:03:22.791 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3260000000000001e-06 2023-09-30T17:03:22.791 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.792 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.792 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:22.792 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355450+0000", 2023-09-30T17:03:22.792 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0030854049999999998 2023-09-30T17:03:22.792 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.792 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.792 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:22.792 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355583+0000", 2023-09-30T17:03:22.792 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000133189 2023-09-30T17:03:22.792 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.792 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.792 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:22.793 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373580+0000", 2023-09-30T17:03:22.793 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017997016000000001 2023-09-30T17:03:22.793 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:22.793 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:22.793 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:22.793 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.793 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.793 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:22.793 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:03:22.793 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 64.388898009000002, 2023-09-30T17:03:22.793 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010380537, 2023-09-30T17:03:22.793 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:22.794 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:22.794 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:22.794 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.794 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:22.794 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:03:22.794 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:22.794 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.794 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.794 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:22.794 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:03:22.794 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:22.795 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.795 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.795 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:22.795 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:03:22.795 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1500000000000003e-07 2023-09-30T17:03:22.795 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.795 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.795 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:22.795 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352381+0000", 2023-09-30T17:03:22.795 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6330000000000002e-06 2023-09-30T17:03:22.795 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.795 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.796 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:22.796 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352388+0000", 2023-09-30T17:03:22.796 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7229999999999998e-06 2023-09-30T17:03:22.796 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.796 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.796 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:22.796 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352394+0000", 2023-09-30T17:03:22.796 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1789999999999996e-06 2023-09-30T17:03:22.796 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.796 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.796 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:22.796 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353259+0000", 2023-09-30T17:03:22.797 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000865221 2023-09-30T17:03:22.797 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.797 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.797 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:22.797 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353391+0000", 2023-09-30T17:03:22.797 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013217700000000001 2023-09-30T17:03:22.797 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.797 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.797 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:22.797 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362757+0000", 2023-09-30T17:03:22.797 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093657889999999994 2023-09-30T17:03:22.798 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:22.798 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:22.798 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:22.798 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.798 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.798 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-09-30T17:03:22.798 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:03:22.798 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 64.382597716999996, 2023-09-30T17:03:22.798 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0061813579999999996, 2023-09-30T17:03:22.798 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:22.798 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2023-09-30T17:03:22.798 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:22.799 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.799 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:22.799 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:03:22.799 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:22.799 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.799 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.799 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:22.799 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:03:22.799 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:22.799 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.799 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.799 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:22.800 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:03:22.800 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5499999999999999e-07 2023-09-30T17:03:22.800 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.800 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.800 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:22.800 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358686+0000", 2023-09-30T17:03:22.800 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9979999999999992e-06 2023-09-30T17:03:22.800 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.800 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.800 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:22.800 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358700+0000", 2023-09-30T17:03:22.800 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3635000000000001e-05 2023-09-30T17:03:22.801 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.801 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.801 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:22.801 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358714+0000", 2023-09-30T17:03:22.801 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4470999999999999e-05 2023-09-30T17:03:22.801 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.801 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.801 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:22.801 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358767+0000", 2023-09-30T17:03:22.801 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2651999999999997e-05 2023-09-30T17:03:22.801 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.801 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.802 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:22.802 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364858+0000", 2023-09-30T17:03:22.802 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060912470000000002 2023-09-30T17:03:22.802 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:22.802 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:22.802 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:22.802 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.802 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.802 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:4 3.1f e18/16 ondisk, result = 0)", 2023-09-30T17:03:22.802 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:03:22.802 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 64.380232876999997, 2023-09-30T17:03:22.802 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00036246299999999999, 2023-09-30T17:03:22.803 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:22.803 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:22.803 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:22.803 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.803 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:22.803 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:03:22.803 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:22.803 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.803 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.803 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:22.803 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:03:22.803 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:22.804 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.804 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.804 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:22.804 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361042+0000", 2023-09-30T17:03:22.804 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3099999999999999e-07 2023-09-30T17:03:22.804 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.804 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.804 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:22.804 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361045+0000", 2023-09-30T17:03:22.804 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.49e-06 2023-09-30T17:03:22.804 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.804 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.804 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:22.805 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361056+0000", 2023-09-30T17:03:22.805 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0910000000000001e-05 2023-09-30T17:03:22.805 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.805 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.805 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:22.805 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361067+0000", 2023-09-30T17:03:22.805 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0531e-05 2023-09-30T17:03:22.805 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.805 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.805 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:22.805 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361263+0000", 2023-09-30T17:03:22.805 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000196486 2023-09-30T17:03:22.806 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.806 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.806 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:22.806 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361273+0000", 2023-09-30T17:03:22.806 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3379999999999994e-06 2023-09-30T17:03:22.806 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.806 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.806 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:22.806 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361404+0000", 2023-09-30T17:03:22.806 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013137700000000001 2023-09-30T17:03:22.806 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:22.806 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:22.807 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:22.807 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.807 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.807 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:31 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:03:22.807 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:03:22.807 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 64.379256847999997, 2023-09-30T17:03:22.807 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006676408, 2023-09-30T17:03:22.807 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:22.807 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:22.807 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:22.807 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.807 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:22.808 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:03:22.808 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:22.808 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.808 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.808 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:22.808 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:03:22.808 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:22.808 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.808 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.808 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:22.808 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:03:22.808 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5600000000000002e-07 2023-09-30T17:03:22.809 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.809 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.809 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:22.809 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362044+0000", 2023-09-30T17:03:22.809 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5987999999999999e-05 2023-09-30T17:03:22.809 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.809 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.809 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:22.809 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362051+0000", 2023-09-30T17:03:22.809 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2599999999999999e-06 2023-09-30T17:03:22.809 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.809 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.810 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:22.810 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362057+0000", 2023-09-30T17:03:22.810 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.19e-06 2023-09-30T17:03:22.810 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.810 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.810 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:22.810 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362096+0000", 2023-09-30T17:03:22.810 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8278000000000002e-05 2023-09-30T17:03:22.810 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.810 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.810 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:22.811 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362114+0000", 2023-09-30T17:03:22.811 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8808e-05 2023-09-30T17:03:22.811 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.811 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.811 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:22.811 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368658+0000", 2023-09-30T17:03:22.811 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065433540000000004 2023-09-30T17:03:22.811 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.811 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.811 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:22.811 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368694+0000", 2023-09-30T17:03:22.811 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6273999999999999e-05 2023-09-30T17:03:22.812 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:22.812 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:22.812 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:22.812 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.812 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.812 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:26 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-09-30T17:03:22.812 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:03:22.812 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 64.379166076000004, 2023-09-30T17:03:22.812 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0066596119999999996, 2023-09-30T17:03:22.812 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:22.812 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:22.812 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:22.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.813 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:22.813 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:03:22.813 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:22.813 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.813 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:22.813 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:03:22.813 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:22.813 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.813 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:22.814 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362109+0000", 2023-09-30T17:03:22.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5699999999999999e-07 2023-09-30T17:03:22.814 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.814 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.814 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:22.814 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362112+0000", 2023-09-30T17:03:22.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8410000000000002e-06 2023-09-30T17:03:22.814 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.814 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.814 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:22.814 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362117+0000", 2023-09-30T17:03:22.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.792e-06 2023-09-30T17:03:22.815 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.815 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.815 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:22.815 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362122+0000", 2023-09-30T17:03:22.815 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.763e-06 2023-09-30T17:03:22.815 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.815 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.815 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:22.815 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362344+0000", 2023-09-30T17:03:22.815 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022181600000000001 2023-09-30T17:03:22.815 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.815 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.816 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:22.816 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362357+0000", 2023-09-30T17:03:22.816 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2864000000000001e-05 2023-09-30T17:03:22.816 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.816 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.816 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:22.816 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368738+0000", 2023-09-30T17:03:22.816 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063809499999999998 2023-09-30T17:03:22.816 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.816 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.816 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:22.816 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368768+0000", 2023-09-30T17:03:22.817 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0429e-05 2023-09-30T17:03:22.817 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:22.817 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:22.817 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:22.817 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.817 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.817 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2023-09-30T17:03:22.817 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:03:22.817 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 64.377949908999994, 2023-09-30T17:03:22.817 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00082185400000000001, 2023-09-30T17:03:22.817 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:22.817 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:22.818 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:22.818 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.818 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:22.818 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:03:22.818 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:22.818 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.818 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.818 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:22.818 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:03:22.818 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:22.818 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.819 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.819 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:22.819 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:03:22.819 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.22e-07 2023-09-30T17:03:22.819 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.819 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.819 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:22.819 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363327+0000", 2023-09-30T17:03:22.819 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4480000000000001e-06 2023-09-30T17:03:22.819 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.819 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.819 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:22.820 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363333+0000", 2023-09-30T17:03:22.820 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9989999999999997e-06 2023-09-30T17:03:22.820 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.820 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.820 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:22.820 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363354+0000", 2023-09-30T17:03:22.820 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0547000000000002e-05 2023-09-30T17:03:22.820 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.820 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.820 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:22.820 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364057+0000", 2023-09-30T17:03:22.820 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00070306600000000002 2023-09-30T17:03:22.821 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.821 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.821 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:22.821 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364063+0000", 2023-09-30T17:03:22.821 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.694e-06 2023-09-30T17:03:22.821 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.821 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.821 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:22.821 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364146+0000", 2023-09-30T17:03:22.821 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3877999999999999e-05 2023-09-30T17:03:22.821 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:22.821 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:22.822 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:22.822 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.822 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.822 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e18/16 ondisk, result = 0)", 2023-09-30T17:03:22.822 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:03:22.822 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 64.377636377000002, 2023-09-30T17:03:22.822 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00067007199999999996, 2023-09-30T17:03:22.822 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:22.822 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:22.822 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:22.822 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.822 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:22.823 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:03:22.823 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:22.823 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.823 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.823 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:22.823 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:03:22.823 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:22.823 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.823 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.823 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:22.823 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:03:22.823 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.41e-07 2023-09-30T17:03:22.824 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.824 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.824 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:22.824 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363641+0000", 2023-09-30T17:03:22.824 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4830000000000002e-06 2023-09-30T17:03:22.824 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.824 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.824 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:22.824 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363647+0000", 2023-09-30T17:03:22.824 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4869999999999999e-06 2023-09-30T17:03:22.824 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.825 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:22.825 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363654+0000", 2023-09-30T17:03:22.825 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5889999999999999e-06 2023-09-30T17:03:22.825 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.825 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:22.825 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364217+0000", 2023-09-30T17:03:22.825 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00056263199999999998 2023-09-30T17:03:22.825 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.825 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:22.826 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364222+0000", 2023-09-30T17:03:22.826 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.242e-06 2023-09-30T17:03:22.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.826 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.826 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:22.826 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364308+0000", 2023-09-30T17:03:22.826 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6397999999999995e-05 2023-09-30T17:03:22.826 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:22.826 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:22.826 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:22.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.826 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.827 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing_reply(3.1f epoch 18/16 rep_tid 8 lcod 18'4)", 2023-09-30T17:03:22.827 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:03:22.827 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 64.368048466999994, 2023-09-30T17:03:22.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000359561, 2023-09-30T17:03:22.827 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:22.827 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2023-09-30T17:03:22.827 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:22.827 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.827 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:22.827 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:03:22.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:22.828 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.828 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.828 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:22.828 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:03:22.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:22.828 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.828 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.828 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:22.828 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373226+0000", 2023-09-30T17:03:22.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1e-07 2023-09-30T17:03:22.828 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.829 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:22.829 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373228+0000", 2023-09-30T17:03:22.829 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9420000000000002e-06 2023-09-30T17:03:22.829 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.829 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:22.829 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373235+0000", 2023-09-30T17:03:22.829 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4230000000000002e-06 2023-09-30T17:03:22.829 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.829 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:22.830 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373239+0000", 2023-09-30T17:03:22.830 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6809999999999997e-06 2023-09-30T17:03:22.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.830 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.830 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:22.830 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373518+0000", 2023-09-30T17:03:22.830 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000278311 2023-09-30T17:03:22.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.830 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.830 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:22.830 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373586+0000", 2023-09-30T17:03:22.831 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7994e-05 2023-09-30T17:03:22.831 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:22.831 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:22.831 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:22.831 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.831 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.831 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:03:22.831 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:03:22.831 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 64.363622394000004, 2023-09-30T17:03:22.831 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0046632949999999996, 2023-09-30T17:03:22.831 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:22.831 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:22.832 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:22.832 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.832 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:22.832 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:03:22.832 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:22.832 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.832 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.832 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:22.832 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:03:22.832 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:22.832 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.833 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.833 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:22.833 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377653+0000", 2023-09-30T17:03:22.833 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7800000000000002e-07 2023-09-30T17:03:22.833 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.833 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.833 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:22.833 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377657+0000", 2023-09-30T17:03:22.833 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5859999999999998e-06 2023-09-30T17:03:22.833 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.833 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.833 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:22.834 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377677+0000", 2023-09-30T17:03:22.834 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9508999999999999e-05 2023-09-30T17:03:22.834 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.834 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.834 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:22.834 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377682+0000", 2023-09-30T17:03:22.834 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8300000000000001e-06 2023-09-30T17:03:22.834 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.834 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.834 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:22.834 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377725+0000", 2023-09-30T17:03:22.834 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2425000000000001e-05 2023-09-30T17:03:22.835 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.835 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.835 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:22.835 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377738+0000", 2023-09-30T17:03:22.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2899e-05 2023-09-30T17:03:22.835 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.835 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.835 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:22.835 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382268+0000", 2023-09-30T17:03:22.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045301289999999999 2023-09-30T17:03:22.835 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.835 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.836 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:22.836 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382315+0000", 2023-09-30T17:03:22.836 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7539e-05 2023-09-30T17:03:22.836 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:22.836 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:22.836 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:22.836 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.836 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.836 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-09-30T17:03:22.836 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:03:22.836 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 64.363172942999995, 2023-09-30T17:03:22.836 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042540670000000003, 2023-09-30T17:03:22.837 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:22.837 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:22.837 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:22.837 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.837 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:22.837 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:03:22.837 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:22.837 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.837 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.837 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:22.837 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:03:22.837 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:22.838 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.838 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.838 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:22.838 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:03:22.838 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0299999999999998e-07 2023-09-30T17:03:22.838 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.838 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.838 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:22.838 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378107+0000", 2023-09-30T17:03:22.838 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9250000000000003e-06 2023-09-30T17:03:22.838 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.838 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.839 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:22.839 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378116+0000", 2023-09-30T17:03:22.839 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.037e-06 2023-09-30T17:03:22.839 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.839 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.839 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:22.839 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378123+0000", 2023-09-30T17:03:22.839 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1879999999999996e-06 2023-09-30T17:03:22.839 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.839 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.839 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:22.839 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378174+0000", 2023-09-30T17:03:22.840 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0998000000000002e-05 2023-09-30T17:03:22.840 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.840 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.840 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:22.840 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378197+0000", 2023-09-30T17:03:22.840 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2558e-05 2023-09-30T17:03:22.840 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.840 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.840 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:22.840 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382319+0000", 2023-09-30T17:03:22.840 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041220950000000001 2023-09-30T17:03:22.840 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.841 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.841 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:22.841 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382356+0000", 2023-09-30T17:03:22.841 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6563000000000002e-05 2023-09-30T17:03:22.841 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:22.841 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:22.841 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:22.841 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.841 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.841 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-09-30T17:03:22.841 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:03:22.841 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 60.305409118999997, 2023-09-30T17:03:22.842 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00171641, 2023-09-30T17:03:22.842 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:22.842 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:22.842 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:22.842 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.842 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:22.842 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:03:22.842 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:22.842 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.842 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.842 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:22.843 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:03:22.843 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:22.843 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.843 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.843 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:22.843 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435868+0000", 2023-09-30T17:03:22.843 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5840000000000002e-06 2023-09-30T17:03:22.843 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.843 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.843 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:22.843 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435892+0000", 2023-09-30T17:03:22.843 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3625000000000002e-05 2023-09-30T17:03:22.844 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.844 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.844 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:22.844 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435908+0000", 2023-09-30T17:03:22.844 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6548000000000001e-05 2023-09-30T17:03:22.844 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.844 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.844 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:22.844 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435935+0000", 2023-09-30T17:03:22.844 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6516000000000002e-05 2023-09-30T17:03:22.844 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.844 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.845 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:22.845 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435996+0000", 2023-09-30T17:03:22.845 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1433999999999995e-05 2023-09-30T17:03:22.845 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.845 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.845 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:22.845 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436114+0000", 2023-09-30T17:03:22.845 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000118344 2023-09-30T17:03:22.845 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.845 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.845 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:22.845 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436219+0000", 2023-09-30T17:03:22.846 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010453100000000001 2023-09-30T17:03:22.846 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.846 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.846 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:22.846 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436900+0000", 2023-09-30T17:03:22.846 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00068121299999999996 2023-09-30T17:03:22.846 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.846 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.846 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:22.846 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437508+0000", 2023-09-30T17:03:22.846 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00060817399999999995 2023-09-30T17:03:22.846 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.847 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.847 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:22.847 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437554+0000", 2023-09-30T17:03:22.847 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5609000000000003e-05 2023-09-30T17:03:22.847 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.847 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.847 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:22.847 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437582+0000", 2023-09-30T17:03:22.847 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7832000000000001e-05 2023-09-30T17:03:22.847 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:22.847 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:22.847 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:22.848 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.848 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.848 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2023-09-30T17:03:22.848 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:03:22.848 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 40.305097625000002, 2023-09-30T17:03:22.848 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001456199, 2023-09-30T17:03:22.848 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:22.848 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:22.848 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:22.848 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.848 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:22.848 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:03:22.849 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:22.849 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.849 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.849 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:22.849 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:03:22.849 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:22.849 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.849 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.849 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:22.849 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436178+0000", 2023-09-30T17:03:22.849 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.494e-06 2023-09-30T17:03:22.849 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.850 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.850 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:22.850 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436184+0000", 2023-09-30T17:03:22.850 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2809999999999999e-06 2023-09-30T17:03:22.850 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.850 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.850 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:22.850 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436198+0000", 2023-09-30T17:03:22.850 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3978000000000001e-05 2023-09-30T17:03:22.850 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.850 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.851 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:22.851 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436206+0000", 2023-09-30T17:03:22.851 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8040000000000007e-06 2023-09-30T17:03:22.851 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.851 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.851 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:22.851 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436268+0000", 2023-09-30T17:03:22.851 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1484999999999998e-05 2023-09-30T17:03:22.851 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.851 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.851 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:22.851 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436339+0000", 2023-09-30T17:03:22.852 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1000000000000005e-05 2023-09-30T17:03:22.852 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.852 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.852 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:22.852 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436438+0000", 2023-09-30T17:03:22.852 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9389000000000007e-05 2023-09-30T17:03:22.852 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.852 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.852 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:22.852 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436986+0000", 2023-09-30T17:03:22.852 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054723399999999996 2023-09-30T17:03:22.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.853 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.853 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:22.853 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437566+0000", 2023-09-30T17:03:22.853 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00058017599999999996 2023-09-30T17:03:22.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.853 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.853 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:22.853 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437606+0000", 2023-09-30T17:03:22.853 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9891999999999997e-05 2023-09-30T17:03:22.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:22.853 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:22.854 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:22.854 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437633+0000", 2023-09-30T17:03:22.854 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7466000000000001e-05 2023-09-30T17:03:22.854 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:22.854 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:22.854 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:22.854 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:22.854 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:22.854 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:22.855 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:03:22.856 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:03:22.856 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:03:22.857 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-09-30T17:03:22.857 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-09-30T17:03:22.857 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:03:22.857 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:03:22.858 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:22.855+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:22.956 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:22.956+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:23.000 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:23.000 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:23.010 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:03:23.057 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:23.058+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:23.141 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:23.141 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:23.151 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:03:23.195 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:23.195+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:23.197 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2023-09-30T17:03:23.250 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2023-09-30T17:03:23.258 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:23.258+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:23.283 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:23.283 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:23.288 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2023-09-30T17:03:23.290 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-09-30T17:03:23.290 INFO:tasks.workunit.client.0.smithi007.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2023-09-30T17:03:23.294 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:03:23.329 INFO:tasks.workunit.client.0.smithi007.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2023-09-30T17:03:23.332 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is unset 2023-09-30T17:03:23.333 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-09-30T17:03:23.333 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2023-09-30T17:03:23.350 INFO:tasks.workunit:Running workunits matching suites/fsync-tester.sh on client.0... 2023-09-30T17:03:23.351 INFO:tasks.workunit:Running workunit suites/fsync-tester.sh... 2023-09-30T17:03:23.352 DEBUG:teuthology.orchestra.run.smithi007:workunit test suites/fsync-tester.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1d10b71792f3be8887a7631e69851ac2df3585af TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsync-tester.sh 2023-09-30T17:03:23.359 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:23.359+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:23.414 INFO:tasks.workunit.client.0.smithi007.stderr:+ wget http://download.ceph.com/qa/fsync-tester.c 2023-09-30T17:03:23.424 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:23.424 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:23.434 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:03:23.449 INFO:tasks.workunit.client.0.smithi007.stderr:--2023-09-30 17:03:23-- http://download.ceph.com/qa/fsync-tester.c 2023-09-30T17:03:23.450 INFO:tasks.workunit.client.0.smithi007.stderr:Resolving download.ceph.com (download.ceph.com)... 158.69.68.124, 2607:5300:201:2000::3:58a1 2023-09-30T17:03:23.459 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:23.459+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:23.471 INFO:tasks.workunit.client.0.smithi007.stderr:Connecting to download.ceph.com (download.ceph.com)|158.69.68.124|:80... connected. 2023-09-30T17:03:23.493 INFO:tasks.workunit.client.0.smithi007.stderr:HTTP request sent, awaiting response... 200 OK 2023-09-30T17:03:23.494 INFO:tasks.workunit.client.0.smithi007.stderr:Length: 3024 (3.0K) [application/octet-stream] 2023-09-30T17:03:23.494 INFO:tasks.workunit.client.0.smithi007.stderr:Saving to: ‘fsync-tester.c’ 2023-09-30T17:03:23.499 INFO:tasks.workunit.client.0.smithi007.stderr: 2023-09-30T17:03:23.500 INFO:tasks.workunit.client.0.smithi007.stderr: 0K .. 100% 412M=0s 2023-09-30T17:03:23.500 INFO:tasks.workunit.client.0.smithi007.stderr: 2023-09-30T17:03:23.500 INFO:tasks.workunit.client.0.smithi007.stderr:2023-09-30 17:03:23 (412 MB/s) - ‘fsync-tester.c’ saved [3024/3024] 2023-09-30T17:03:23.500 INFO:tasks.workunit.client.0.smithi007.stderr: 2023-09-30T17:03:23.500 INFO:tasks.workunit.client.0.smithi007.stderr:+ gcc -D_GNU_SOURCE fsync-tester.c -o fsync-tester 2023-09-30T17:03:23.558 INFO:tasks.workunit.client.0.smithi007.stderr:+ ./fsync-tester 2023-09-30T17:03:23.560 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:23.560+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:23.561 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:23.561 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:23.572 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:03:23.662 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:23.662+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:23.699 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:23.700 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:23.710 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:03:23.763 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:23.763+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:23.846 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:23.847 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:23.857 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:03:23.900 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:23.900+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:23.965 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:23.965+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:23.989 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:23.989 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:24.000 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:03:24.082 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:24.082+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:24.167 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:24.167+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:24.176 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:24.176 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:24.186 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:03:24.267 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:24.267+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:24.316 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:24.316 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:24.327 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:03:24.368 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:24.368+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:24.468 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:24.468+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:24.494 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:24.494 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:24.505 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:03:24.569 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:24.569+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:24.632 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:24.632 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:24.642 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:03:24.683 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:24.683+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:24.770 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:24.770+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:24.779 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:24.780 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:24.790 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:03:24.858 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-09-30T17:03:24.874 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:24.874+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:24.963 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:24.963 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:24.973 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:24.973+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:24.974 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:03:25.022 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:03:25.045 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:03:25.045 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-09-30T17:03:25.045 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-09-30T17:03:25.045 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:03:25.048 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:03:25.048 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:03:25.073 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:25.074+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:25.149 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:25.149 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 20, 2023-09-30T17:03:25.149 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 600, 2023-09-30T17:03:25.149 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:03:25.149 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.149 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:32 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'18, mlcod=11'14)", 2023-09-30T17:03:25.149 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:03:25.149 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 77.786379596000003, 2023-09-30T17:03:25.149 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051629809999999996, 2023-09-30T17:03:25.149 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:25.150 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:25.150 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:25.150 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.150 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:25.150 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:03:25.150 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:25.150 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.150 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.150 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:25.150 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:03:25.151 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:25.151 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.151 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.151 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:25.151 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361349+0000", 2023-09-30T17:03:25.151 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2099999999999996e-07 2023-09-30T17:03:25.151 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.151 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.151 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:25.151 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361407+0000", 2023-09-30T17:03:25.151 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7499e-05 2023-09-30T17:03:25.152 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.152 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.152 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:25.152 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361418+0000", 2023-09-30T17:03:25.152 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1127999999999999e-05 2023-09-30T17:03:25.152 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.152 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.152 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:25.152 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361423+0000", 2023-09-30T17:03:25.153 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1930000000000001e-06 2023-09-30T17:03:25.153 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.153 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.153 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:25.153 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361476+0000", 2023-09-30T17:03:25.153 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3399000000000002e-05 2023-09-30T17:03:25.153 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.153 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.153 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:25.153 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.361496+0000", 2023-09-30T17:03:25.154 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9638000000000001e-05 2023-09-30T17:03:25.154 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.154 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.154 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:25.154 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.366474+0000", 2023-09-30T17:03:25.154 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0049778829999999998 2023-09-30T17:03:25.154 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.154 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.154 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:25.155 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.366512+0000", 2023-09-30T17:03:25.155 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7620000000000002e-05 2023-09-30T17:03:25.155 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:25.155 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:25.155 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:25.155 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.155 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.155 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:37 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'23, mlcod=11'15)", 2023-09-30T17:03:25.155 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:03:25.155 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 77.783777599000004, 2023-09-30T17:03:25.155 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053985689999999998, 2023-09-30T17:03:25.156 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:25.156 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:25.156 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:25.156 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.156 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:25.156 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:03:25.156 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:25.156 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.156 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.156 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:25.156 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:03:25.157 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:25.157 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.157 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.157 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:25.157 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363951+0000", 2023-09-30T17:03:25.157 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4400000000000001e-07 2023-09-30T17:03:25.157 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.157 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.157 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:25.157 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363956+0000", 2023-09-30T17:03:25.157 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.921e-06 2023-09-30T17:03:25.157 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.158 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.158 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:25.158 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363966+0000", 2023-09-30T17:03:25.158 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0351e-05 2023-09-30T17:03:25.158 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.158 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.158 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:25.158 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.363971+0000", 2023-09-30T17:03:25.158 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.023e-06 2023-09-30T17:03:25.158 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.158 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.159 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:25.159 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.364013+0000", 2023-09-30T17:03:25.159 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1575000000000001e-05 2023-09-30T17:03:25.160 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.160 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.160 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:25.160 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.364026+0000", 2023-09-30T17:03:25.160 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3044000000000001e-05 2023-09-30T17:03:25.160 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.160 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.160 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:25.160 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.369308+0000", 2023-09-30T17:03:25.160 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005282152 2023-09-30T17:03:25.160 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.161 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.161 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:25.161 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.369349+0000", 2023-09-30T17:03:25.161 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1059000000000001e-05 2023-09-30T17:03:25.161 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:25.161 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:25.161 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:25.161 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.161 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.161 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:155 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'109, mlcod=11'105)", 2023-09-30T17:03:25.161 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:03:25.161 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 77.302081912999995, 2023-09-30T17:03:25.162 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053867639999999996, 2023-09-30T17:03:25.162 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:25.162 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:25.162 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:25.162 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.162 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:25.162 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:03:25.162 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:25.162 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.162 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.163 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:25.163 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845646+0000", 2023-09-30T17:03:25.163 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:25.163 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.163 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.163 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:25.163 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845647+0000", 2023-09-30T17:03:25.163 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7599999999999997e-07 2023-09-30T17:03:25.163 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.163 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.163 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:25.163 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845699+0000", 2023-09-30T17:03:25.164 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1758000000000001e-05 2023-09-30T17:03:25.164 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.164 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.164 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:25.164 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845708+0000", 2023-09-30T17:03:25.164 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2159999999999995e-06 2023-09-30T17:03:25.164 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.164 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.164 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:25.164 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845712+0000", 2023-09-30T17:03:25.165 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2579999999999997e-06 2023-09-30T17:03:25.165 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.165 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.165 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:25.165 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845756+0000", 2023-09-30T17:03:25.165 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4119999999999998e-05 2023-09-30T17:03:25.165 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.165 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.165 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:25.165 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.845779+0000", 2023-09-30T17:03:25.165 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2311e-05 2023-09-30T17:03:25.166 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.166 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.166 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:25.166 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.850982+0000", 2023-09-30T17:03:25.166 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005203053 2023-09-30T17:03:25.166 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.166 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.166 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:25.166 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851033+0000", 2023-09-30T17:03:25.166 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1471999999999998e-05 2023-09-30T17:03:25.166 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:25.166 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:25.166 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:25.167 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.167 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.167 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:156 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'110, mlcod=11'105)", 2023-09-30T17:03:25.167 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:03:25.167 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 77.301548987000004, 2023-09-30T17:03:25.167 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0052834759999999996, 2023-09-30T17:03:25.167 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:25.167 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:25.168 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:25.168 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.168 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:25.168 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:03:25.168 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:25.168 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.168 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.168 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:25.168 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846179+0000", 2023-09-30T17:03:25.168 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:25.168 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.169 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.169 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:25.169 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846180+0000", 2023-09-30T17:03:25.169 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6300000000000005e-07 2023-09-30T17:03:25.169 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.169 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.169 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:25.169 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846184+0000", 2023-09-30T17:03:25.169 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3789999999999999e-06 2023-09-30T17:03:25.169 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.169 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.169 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:25.170 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846195+0000", 2023-09-30T17:03:25.170 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0778000000000001e-05 2023-09-30T17:03:25.170 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.170 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.170 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:25.170 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846200+0000", 2023-09-30T17:03:25.170 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1540000000000001e-06 2023-09-30T17:03:25.170 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.170 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.170 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:25.171 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846274+0000", 2023-09-30T17:03:25.171 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4129999999999997e-05 2023-09-30T17:03:25.171 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.171 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.171 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:25.171 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.846286+0000", 2023-09-30T17:03:25.171 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1744e-05 2023-09-30T17:03:25.171 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.171 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.171 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:25.171 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851432+0000", 2023-09-30T17:03:25.171 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051462110000000004 2023-09-30T17:03:25.172 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.172 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.172 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:25.172 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:07.851463+0000", 2023-09-30T17:03:25.172 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0516999999999999e-05 2023-09-30T17:03:25.172 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:25.172 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:25.172 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:25.172 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.172 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.172 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4153.0:203 1.0 e11/10 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 11'149, mlcod=11'145)", 2023-09-30T17:03:25.173 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:03:25.173 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 76.945513078000005, 2023-09-30T17:03:25.173 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051867459999999999, 2023-09-30T17:03:25.173 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:25.173 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:25.173 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:25.173 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.173 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:25.173 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:03:25.173 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:25.173 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.173 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.174 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:25.174 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202215+0000", 2023-09-30T17:03:25.174 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:25.174 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.174 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.174 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:25.174 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202216+0000", 2023-09-30T17:03:25.174 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7e-07 2023-09-30T17:03:25.174 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.174 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.174 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:25.175 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202271+0000", 2023-09-30T17:03:25.175 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5163e-05 2023-09-30T17:03:25.175 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.175 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.175 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:25.175 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202282+0000", 2023-09-30T17:03:25.175 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1319e-05 2023-09-30T17:03:25.175 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.175 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.175 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:25.175 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202288+0000", 2023-09-30T17:03:25.175 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2899999999999999e-06 2023-09-30T17:03:25.176 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.176 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.176 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:25.176 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202331+0000", 2023-09-30T17:03:25.176 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2147999999999997e-05 2023-09-30T17:03:25.176 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.176 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.176 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:25.176 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.202348+0000", 2023-09-30T17:03:25.176 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7317e-05 2023-09-30T17:03:25.176 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.176 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.177 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:25.177 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.207357+0000", 2023-09-30T17:03:25.177 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0050095440000000003 2023-09-30T17:03:25.177 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.177 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.177 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:25.177 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:08.207402+0000", 2023-09-30T17:03:25.177 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4495e-05 2023-09-30T17:03:25.177 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:25.177 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:25.177 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:25.177 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.178 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.178 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:25.178 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:03:25.178 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 66.796182790000003, 2023-09-30T17:03:25.178 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.025313649000000001, 2023-09-30T17:03:25.178 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:25.178 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:25.178 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:25.178 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.178 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:25.178 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:03:25.179 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:25.179 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.179 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.179 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:25.179 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:03:25.179 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:25.179 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.179 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.179 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:25.179 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351551+0000", 2023-09-30T17:03:25.179 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3380000000000004e-06 2023-09-30T17:03:25.180 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.180 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.180 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:25.180 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351559+0000", 2023-09-30T17:03:25.180 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9589999999999995e-06 2023-09-30T17:03:25.180 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.180 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.180 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:25.180 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351571+0000", 2023-09-30T17:03:25.180 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2065999999999999e-05 2023-09-30T17:03:25.180 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.181 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.181 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:25.181 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351706+0000", 2023-09-30T17:03:25.181 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00013553799999999999 2023-09-30T17:03:25.181 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.181 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.181 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:25.181 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353016+0000", 2023-09-30T17:03:25.181 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0013099209999999999 2023-09-30T17:03:25.181 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.181 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.181 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:25.182 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353023+0000", 2023-09-30T17:03:25.182 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2479999999999999e-06 2023-09-30T17:03:25.182 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.182 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.182 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:25.182 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360348+0000", 2023-09-30T17:03:25.182 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0073248949999999997 2023-09-30T17:03:25.182 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.182 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.182 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:25.182 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360787+0000", 2023-09-30T17:03:25.183 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00043875199999999999 2023-09-30T17:03:25.183 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.183 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.183 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:25.183 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360892+0000", 2023-09-30T17:03:25.183 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010508199999999999 2023-09-30T17:03:25.183 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.183 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.183 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:25.183 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365132+0000", 2023-09-30T17:03:25.183 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0042396480000000004 2023-09-30T17:03:25.184 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.184 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.184 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:25.184 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376746+0000", 2023-09-30T17:03:25.184 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011614157 2023-09-30T17:03:25.184 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.184 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.184 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:25.184 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376811+0000", 2023-09-30T17:03:25.184 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5005999999999994e-05 2023-09-30T17:03:25.185 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.185 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.185 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:25.185 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376859+0000", 2023-09-30T17:03:25.185 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8038999999999999e-05 2023-09-30T17:03:25.185 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:25.185 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:25.185 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:25.185 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.185 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.185 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:25.186 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:03:25.186 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 66.795684991000002, 2023-09-30T17:03:25.186 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024923989000000001, 2023-09-30T17:03:25.186 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:25.186 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:25.186 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:25.186 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.186 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:25.186 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:03:25.186 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:25.186 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.187 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.187 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:25.187 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:03:25.187 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:25.187 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.187 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.187 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:25.187 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352044+0000", 2023-09-30T17:03:25.187 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9199999999999999e-07 2023-09-30T17:03:25.187 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.188 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.188 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:25.188 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352050+0000", 2023-09-30T17:03:25.188 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8880000000000002e-06 2023-09-30T17:03:25.188 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.188 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.188 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:25.188 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352143+0000", 2023-09-30T17:03:25.188 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2721999999999998e-05 2023-09-30T17:03:25.188 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.188 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.189 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:25.189 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352155+0000", 2023-09-30T17:03:25.189 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2279000000000001e-05 2023-09-30T17:03:25.189 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.189 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.189 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:25.189 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353114+0000", 2023-09-30T17:03:25.189 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00095943700000000005 2023-09-30T17:03:25.189 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.189 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.189 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:25.190 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353121+0000", 2023-09-30T17:03:25.190 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.494e-06 2023-09-30T17:03:25.190 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.190 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.190 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:25.190 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361491+0000", 2023-09-30T17:03:25.190 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0083697359999999991 2023-09-30T17:03:25.190 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.190 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.190 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:25.190 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361573+0000", 2023-09-30T17:03:25.191 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2822000000000001e-05 2023-09-30T17:03:25.191 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.191 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.191 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:25.191 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362166+0000", 2023-09-30T17:03:25.191 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00059223299999999995 2023-09-30T17:03:25.191 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.191 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.191 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:25.191 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365209+0000", 2023-09-30T17:03:25.192 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.003043212 2023-09-30T17:03:25.192 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.192 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.192 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:25.192 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376910+0000", 2023-09-30T17:03:25.192 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011700898 2023-09-30T17:03:25.192 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.192 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.192 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:25.192 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376945+0000", 2023-09-30T17:03:25.193 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4795000000000001e-05 2023-09-30T17:03:25.193 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.193 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.193 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:25.193 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376967+0000", 2023-09-30T17:03:25.193 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2580999999999999e-05 2023-09-30T17:03:25.193 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:25.193 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:25.193 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:25.193 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.193 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.193 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:25.193 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:03:25.194 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 66.795515070999997, 2023-09-30T17:03:25.194 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023120405, 2023-09-30T17:03:25.194 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:25.194 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:25.194 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:25.194 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.194 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:25.194 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:03:25.194 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:25.194 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.194 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.194 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:25.195 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:03:25.195 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:25.195 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.195 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.195 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:25.195 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352214+0000", 2023-09-30T17:03:25.195 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8400000000000003e-07 2023-09-30T17:03:25.195 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.195 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.195 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:25.195 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352233+0000", 2023-09-30T17:03:25.196 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8946000000000001e-05 2023-09-30T17:03:25.196 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.196 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.196 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:25.196 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352297+0000", 2023-09-30T17:03:25.196 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3540999999999994e-05 2023-09-30T17:03:25.196 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.196 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.196 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:25.196 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352450+0000", 2023-09-30T17:03:25.196 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015364799999999999 2023-09-30T17:03:25.196 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.197 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.197 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:25.197 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353098+0000", 2023-09-30T17:03:25.197 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00064820299999999997 2023-09-30T17:03:25.197 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.197 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.197 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:25.197 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353103+0000", 2023-09-30T17:03:25.197 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0529999999999997e-06 2023-09-30T17:03:25.197 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.197 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.198 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:25.198 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.358558+0000", 2023-09-30T17:03:25.198 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0054550249999999996 2023-09-30T17:03:25.198 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.198 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.198 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:25.198 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.358741+0000", 2023-09-30T17:03:25.198 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00018210200000000001 2023-09-30T17:03:25.198 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.198 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.198 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:25.199 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.359683+0000", 2023-09-30T17:03:25.199 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00094202299999999995 2023-09-30T17:03:25.199 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.199 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.199 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:25.199 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365044+0000", 2023-09-30T17:03:25.199 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053616219999999999 2023-09-30T17:03:25.199 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.199 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.199 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:25.199 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375256+0000", 2023-09-30T17:03:25.200 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010212156 2023-09-30T17:03:25.200 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.200 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.200 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:25.200 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375300+0000", 2023-09-30T17:03:25.200 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3961999999999997e-05 2023-09-30T17:03:25.201 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.201 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.201 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:25.201 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375334+0000", 2023-09-30T17:03:25.201 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.324e-05 2023-09-30T17:03:25.201 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:25.201 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:25.201 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:25.201 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.201 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.201 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:25.201 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:03:25.202 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 66.795200053000002, 2023-09-30T17:03:25.202 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024240660000000001, 2023-09-30T17:03:25.202 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:25.202 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:25.202 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:25.202 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.202 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:25.202 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:03:25.202 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:25.202 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.202 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.203 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:25.203 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:03:25.203 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:25.203 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.203 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.203 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:25.203 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352529+0000", 2023-09-30T17:03:25.203 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1379999999999999e-06 2023-09-30T17:03:25.203 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.203 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.203 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:25.203 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352536+0000", 2023-09-30T17:03:25.204 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3489999999999997e-06 2023-09-30T17:03:25.204 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.204 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.204 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:25.204 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352547+0000", 2023-09-30T17:03:25.204 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1109e-05 2023-09-30T17:03:25.204 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.204 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.204 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:25.204 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352560+0000", 2023-09-30T17:03:25.204 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3046e-05 2023-09-30T17:03:25.204 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.205 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.205 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:25.205 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353142+0000", 2023-09-30T17:03:25.205 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00058174699999999997 2023-09-30T17:03:25.205 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.205 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.205 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:25.205 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353147+0000", 2023-09-30T17:03:25.205 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5840000000000002e-06 2023-09-30T17:03:25.205 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.205 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.206 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:25.206 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360374+0000", 2023-09-30T17:03:25.206 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0072270049999999999 2023-09-30T17:03:25.206 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.206 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.206 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:25.206 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360795+0000", 2023-09-30T17:03:25.206 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00042088999999999999 2023-09-30T17:03:25.206 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.206 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.206 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:25.207 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360967+0000", 2023-09-30T17:03:25.207 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017235699999999999 2023-09-30T17:03:25.207 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.207 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.207 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:25.207 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365051+0000", 2023-09-30T17:03:25.207 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0040837429999999999 2023-09-30T17:03:25.207 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.207 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.207 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:25.207 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376708+0000", 2023-09-30T17:03:25.208 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011656866 2023-09-30T17:03:25.208 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.208 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.208 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:25.208 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376745+0000", 2023-09-30T17:03:25.208 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6769e-05 2023-09-30T17:03:25.208 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.208 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.208 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:25.208 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376769+0000", 2023-09-30T17:03:25.208 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4057e-05 2023-09-30T17:03:25.208 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:25.209 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:25.209 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:25.209 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.209 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.209 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:25.209 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:25.209 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 66.794940698000005, 2023-09-30T17:03:25.209 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023472704, 2023-09-30T17:03:25.209 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:25.209 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:25.209 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:25.209 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.209 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:25.209 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:25.210 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:25.210 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.210 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.210 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:25.210 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:25.210 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:25.210 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.210 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.210 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:25.210 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:25.210 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8000000000000005e-07 2023-09-30T17:03:25.211 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.211 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.211 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:25.211 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352794+0000", 2023-09-30T17:03:25.211 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.789e-06 2023-09-30T17:03:25.211 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.211 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.211 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:25.211 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352805+0000", 2023-09-30T17:03:25.211 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0848e-05 2023-09-30T17:03:25.211 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.212 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.212 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:25.212 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352812+0000", 2023-09-30T17:03:25.212 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4449999999999999e-06 2023-09-30T17:03:25.212 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.212 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.212 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:25.212 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353063+0000", 2023-09-30T17:03:25.212 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00025046299999999998 2023-09-30T17:03:25.212 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.212 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.212 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:25.213 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353071+0000", 2023-09-30T17:03:25.213 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6739999999999997e-06 2023-09-30T17:03:25.213 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.213 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.213 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:25.213 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361696+0000", 2023-09-30T17:03:25.213 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0086251609999999992 2023-09-30T17:03:25.213 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.213 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.213 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:25.213 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362284+0000", 2023-09-30T17:03:25.214 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00058872299999999998 2023-09-30T17:03:25.214 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.214 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.214 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:25.214 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362429+0000", 2023-09-30T17:03:25.214 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014509000000000001 2023-09-30T17:03:25.214 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.214 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.214 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:25.214 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365330+0000", 2023-09-30T17:03:25.214 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0029005419999999999 2023-09-30T17:03:25.215 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.215 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.215 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:25.215 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376196+0000", 2023-09-30T17:03:25.215 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.01086615 2023-09-30T17:03:25.215 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.215 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.215 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:25.215 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376230+0000", 2023-09-30T17:03:25.215 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3858e-05 2023-09-30T17:03:25.215 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.215 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.216 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:25.216 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376260+0000", 2023-09-30T17:03:25.216 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0181000000000001e-05 2023-09-30T17:03:25.216 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:25.216 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:25.216 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:25.216 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.216 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.216 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:25.216 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:03:25.216 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 66.794707127999999, 2023-09-30T17:03:25.216 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023406132999999999, 2023-09-30T17:03:25.217 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:25.217 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:25.217 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:25.217 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.217 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:25.217 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:03:25.217 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:25.217 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.217 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.217 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:25.217 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:03:25.218 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:25.218 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.218 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.218 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:25.218 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353022+0000", 2023-09-30T17:03:25.218 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.78e-07 2023-09-30T17:03:25.218 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.218 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.218 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:25.218 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353027+0000", 2023-09-30T17:03:25.218 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9089999999999999e-06 2023-09-30T17:03:25.219 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.219 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.219 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:25.219 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353035+0000", 2023-09-30T17:03:25.219 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0430000000000008e-06 2023-09-30T17:03:25.219 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.219 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.219 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:25.219 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353047+0000", 2023-09-30T17:03:25.219 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1674e-05 2023-09-30T17:03:25.219 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.219 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.220 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:25.220 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353105+0000", 2023-09-30T17:03:25.220 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8891999999999998e-05 2023-09-30T17:03:25.220 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.220 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.220 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:25.220 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353112+0000", 2023-09-30T17:03:25.220 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7059999999999998e-06 2023-09-30T17:03:25.220 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.220 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.220 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:25.220 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362733+0000", 2023-09-30T17:03:25.221 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0096205869999999999 2023-09-30T17:03:25.221 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.221 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.221 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:25.221 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362833+0000", 2023-09-30T17:03:25.221 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000100227 2023-09-30T17:03:25.221 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.221 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.221 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:25.221 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363000+0000", 2023-09-30T17:03:25.222 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016670899999999999 2023-09-30T17:03:25.222 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.222 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.222 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:25.222 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365550+0000", 2023-09-30T17:03:25.222 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0025499199999999998 2023-09-30T17:03:25.222 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.222 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.222 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:25.222 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376315+0000", 2023-09-30T17:03:25.222 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010765011999999999 2023-09-30T17:03:25.223 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.223 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.223 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:25.223 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376386+0000", 2023-09-30T17:03:25.223 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0866999999999998e-05 2023-09-30T17:03:25.223 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.223 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.223 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:25.223 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376427+0000", 2023-09-30T17:03:25.223 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1709000000000003e-05 2023-09-30T17:03:25.223 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:25.224 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:25.224 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:25.224 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.224 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.224 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:25.224 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:25.224 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 66.794666492000005, 2023-09-30T17:03:25.224 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024076238, 2023-09-30T17:03:25.224 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:25.224 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:25.224 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:25.224 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.225 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:25.225 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:25.225 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:25.225 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.225 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.225 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:25.225 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:25.225 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:25.225 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.225 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.225 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:25.226 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:25.226 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8699999999999995e-07 2023-09-30T17:03:25.226 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.226 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.226 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:25.226 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353067+0000", 2023-09-30T17:03:25.226 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.605e-06 2023-09-30T17:03:25.226 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.226 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.226 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:25.227 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353073+0000", 2023-09-30T17:03:25.227 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8900000000000004e-06 2023-09-30T17:03:25.227 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.227 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.227 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:25.227 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353083+0000", 2023-09-30T17:03:25.227 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0200000000000001e-05 2023-09-30T17:03:25.227 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.227 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.227 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:25.227 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353186+0000", 2023-09-30T17:03:25.228 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010256599999999999 2023-09-30T17:03:25.228 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.228 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.228 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:25.228 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353190+0000", 2023-09-30T17:03:25.228 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9709999999999998e-06 2023-09-30T17:03:25.228 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.228 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.228 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:25.228 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362946+0000", 2023-09-30T17:03:25.228 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0097563330000000007 2023-09-30T17:03:25.229 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.229 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.229 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:25.229 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363088+0000", 2023-09-30T17:03:25.229 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014259200000000001 2023-09-30T17:03:25.229 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.229 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.229 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:25.229 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363555+0000", 2023-09-30T17:03:25.229 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00046627799999999998 2023-09-30T17:03:25.229 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.229 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.230 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:25.230 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365871+0000", 2023-09-30T17:03:25.230 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0023167589999999998 2023-09-30T17:03:25.230 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.230 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.230 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:25.230 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377033+0000", 2023-09-30T17:03:25.230 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011161203999999999 2023-09-30T17:03:25.230 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.230 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.231 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:25.231 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377100+0000", 2023-09-30T17:03:25.231 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7230999999999994e-05 2023-09-30T17:03:25.231 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.231 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.231 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:25.231 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377138+0000", 2023-09-30T17:03:25.231 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8022000000000003e-05 2023-09-30T17:03:25.231 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:25.231 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:25.231 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:25.232 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.232 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.232 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:25.232 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:03:25.232 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 66.794565543000004, 2023-09-30T17:03:25.232 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.020304412000000001, 2023-09-30T17:03:25.232 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:25.232 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:25.232 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:25.232 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.232 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:25.233 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:03:25.233 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:25.233 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.233 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.233 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:25.233 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:03:25.233 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:25.233 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.233 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.233 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:25.233 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353164+0000", 2023-09-30T17:03:25.233 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7100000000000011e-07 2023-09-30T17:03:25.233 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.234 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.234 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:25.234 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353168+0000", 2023-09-30T17:03:25.234 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0600000000000001e-06 2023-09-30T17:03:25.234 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.234 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.234 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:25.234 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353177+0000", 2023-09-30T17:03:25.234 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1409999999999994e-06 2023-09-30T17:03:25.234 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.235 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.235 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:25.235 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353185+0000", 2023-09-30T17:03:25.235 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2479999999999996e-06 2023-09-30T17:03:25.235 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.235 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.235 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:25.235 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353246+0000", 2023-09-30T17:03:25.235 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0519000000000001e-05 2023-09-30T17:03:25.235 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.235 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.236 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:25.236 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353252+0000", 2023-09-30T17:03:25.236 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7859999999999999e-06 2023-09-30T17:03:25.236 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.236 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.236 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:25.236 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354979+0000", 2023-09-30T17:03:25.236 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0017270090000000001 2023-09-30T17:03:25.236 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.236 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.236 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:25.236 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355097+0000", 2023-09-30T17:03:25.237 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000117472 2023-09-30T17:03:25.237 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.237 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.237 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:25.237 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.373467+0000", 2023-09-30T17:03:25.237 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.018370206 2023-09-30T17:03:25.237 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:25.237 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:25.237 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:25.237 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.237 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.238 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:25.238 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:03:25.238 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 66.794524804999995, 2023-09-30T17:03:25.238 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.012725089, 2023-09-30T17:03:25.238 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:25.238 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:25.238 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:25.238 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.238 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:25.238 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:03:25.238 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:25.238 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.239 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.239 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:25.239 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:03:25.239 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:25.239 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.239 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.239 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:25.239 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353204+0000", 2023-09-30T17:03:25.239 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7100000000000002e-07 2023-09-30T17:03:25.239 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.240 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.240 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:25.240 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353213+0000", 2023-09-30T17:03:25.240 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8580000000000006e-06 2023-09-30T17:03:25.240 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.240 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.240 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:25.240 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353219+0000", 2023-09-30T17:03:25.240 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8939999999999998e-06 2023-09-30T17:03:25.240 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.240 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.241 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:25.241 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353223+0000", 2023-09-30T17:03:25.241 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.357e-06 2023-09-30T17:03:25.241 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.241 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.241 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:25.241 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353278+0000", 2023-09-30T17:03:25.241 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5228e-05 2023-09-30T17:03:25.241 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.241 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.241 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:25.242 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353284+0000", 2023-09-30T17:03:25.242 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8209999999999998e-06 2023-09-30T17:03:25.242 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.242 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.242 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:25.242 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355095+0000", 2023-09-30T17:03:25.242 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001811404 2023-09-30T17:03:25.242 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.242 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.242 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:25.243 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355256+0000", 2023-09-30T17:03:25.243 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000160898 2023-09-30T17:03:25.243 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.243 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.243 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:25.243 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365928+0000", 2023-09-30T17:03:25.243 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010672157999999999 2023-09-30T17:03:25.243 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:25.243 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:25.243 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:25.243 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.244 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.244 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "pg_update_log_missing(3.1e epoch 18/16 rep_tid 2 entries 18'1 (0'0) error 3:7bf7e7b5:::200.00000006:head by mds.0.3:37 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-09-30T17:03:25.244 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:03:25.244 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 66.793993598, 2023-09-30T17:03:25.244 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0056863460000000001, 2023-09-30T17:03:25.244 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:25.244 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "reached pg", 2023-09-30T17:03:25.244 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:25.244 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.244 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:25.244 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:03:25.245 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:25.245 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.245 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.245 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:25.245 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:03:25.245 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:25.245 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.245 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.245 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:25.245 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353735+0000", 2023-09-30T17:03:25.245 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5700000000000002e-07 2023-09-30T17:03:25.245 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.246 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.246 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:25.246 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353747+0000", 2023-09-30T17:03:25.246 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1899000000000001e-05 2023-09-30T17:03:25.246 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.246 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.246 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:25.246 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353776+0000", 2023-09-30T17:03:25.246 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.8767000000000001e-05 2023-09-30T17:03:25.246 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.247 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.247 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:25.247 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353792+0000", 2023-09-30T17:03:25.247 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5914999999999999e-05 2023-09-30T17:03:25.247 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.247 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.247 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:25.247 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353900+0000", 2023-09-30T17:03:25.247 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010774500000000001 2023-09-30T17:03:25.247 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.247 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.248 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:25.248 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.359421+0000", 2023-09-30T17:03:25.248 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0055213629999999996 2023-09-30T17:03:25.248 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:25.248 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:25.248 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:25.248 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.248 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.248 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:24 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:03:25.248 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:03:25.248 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 66.793321997999996, 2023-09-30T17:03:25.248 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0069196370000000002, 2023-09-30T17:03:25.249 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:25.249 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:25.249 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:25.249 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.249 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:25.249 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:03:25.249 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:25.249 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.249 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.249 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:25.249 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354406+0000", 2023-09-30T17:03:25.250 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:25.250 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.250 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.250 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:25.250 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354407+0000", 2023-09-30T17:03:25.250 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7400000000000002e-07 2023-09-30T17:03:25.250 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.250 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.250 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:25.250 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354414+0000", 2023-09-30T17:03:25.250 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1040000000000001e-06 2023-09-30T17:03:25.251 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.251 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.251 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:25.251 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354425+0000", 2023-09-30T17:03:25.251 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1090000000000001e-05 2023-09-30T17:03:25.251 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.251 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.251 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:25.251 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354435+0000", 2023-09-30T17:03:25.251 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8169999999999994e-06 2023-09-30T17:03:25.251 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.251 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.252 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:25.252 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355741+0000", 2023-09-30T17:03:25.252 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0013063160000000001 2023-09-30T17:03:25.252 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.252 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.252 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:25.252 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355763+0000", 2023-09-30T17:03:25.252 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1688e-05 2023-09-30T17:03:25.252 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.252 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.252 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:25.253 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361289+0000", 2023-09-30T17:03:25.253 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0055258269999999996 2023-09-30T17:03:25.253 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.253 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.253 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:25.253 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361326+0000", 2023-09-30T17:03:25.253 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7020999999999997e-05 2023-09-30T17:03:25.253 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:25.253 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:25.253 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:25.253 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.253 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.254 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:30 3.7 e18/16 3:e0b41d06:::609.00000000:head v 18'2, mlcod=0'0)", 2023-09-30T17:03:25.254 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:03:25.254 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 66.791948039999994, 2023-09-30T17:03:25.254 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0069996629999999997, 2023-09-30T17:03:25.254 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:25.254 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:25.254 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:25.254 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.254 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:25.254 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:03:25.254 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:25.254 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.254 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.255 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:25.255 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355780+0000", 2023-09-30T17:03:25.255 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:25.255 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.255 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.255 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:25.255 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355781+0000", 2023-09-30T17:03:25.255 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9599999999999999e-07 2023-09-30T17:03:25.255 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.255 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.255 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:25.255 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355788+0000", 2023-09-30T17:03:25.256 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8129999999999996e-06 2023-09-30T17:03:25.256 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.256 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.256 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:25.256 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355798+0000", 2023-09-30T17:03:25.256 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2909999999999996e-06 2023-09-30T17:03:25.256 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.256 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.256 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:25.256 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355807+0000", 2023-09-30T17:03:25.256 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8619999999999992e-06 2023-09-30T17:03:25.257 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.257 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.257 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:25.257 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.357264+0000", 2023-09-30T17:03:25.257 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0014578289999999999 2023-09-30T17:03:25.257 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.257 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.257 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:25.257 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.357916+0000", 2023-09-30T17:03:25.257 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00065170500000000004 2023-09-30T17:03:25.257 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.257 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.257 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:25.258 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362731+0000", 2023-09-30T17:03:25.258 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0048149849999999999 2023-09-30T17:03:25.258 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.258 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.258 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:25.258 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362780+0000", 2023-09-30T17:03:25.258 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8681999999999999e-05 2023-09-30T17:03:25.258 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:25.258 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:25.258 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:25.258 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.258 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.259 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:10 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'5, mlcod=0'0)", 2023-09-30T17:03:25.259 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:03:25.259 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 66.773296989000002, 2023-09-30T17:03:25.259 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005905998, 2023-09-30T17:03:25.259 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:25.259 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:25.259 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:25.259 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.259 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:25.259 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:03:25.259 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:25.259 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.260 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.260 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:25.260 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:03:25.260 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:25.260 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.260 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.260 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:25.260 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374431+0000", 2023-09-30T17:03:25.260 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1e-07 2023-09-30T17:03:25.260 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.260 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.261 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:25.261 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374455+0000", 2023-09-30T17:03:25.261 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.3091999999999998e-05 2023-09-30T17:03:25.261 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.261 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.261 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:25.261 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374462+0000", 2023-09-30T17:03:25.261 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5170000000000002e-06 2023-09-30T17:03:25.261 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.261 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.261 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:25.261 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374469+0000", 2023-09-30T17:03:25.262 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8199999999999999e-06 2023-09-30T17:03:25.262 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.262 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.262 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:25.262 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374550+0000", 2023-09-30T17:03:25.262 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0978999999999998e-05 2023-09-30T17:03:25.262 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.262 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.262 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:25.262 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374562+0000", 2023-09-30T17:03:25.262 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2472e-05 2023-09-30T17:03:25.262 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.263 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.263 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:25.263 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380293+0000", 2023-09-30T17:03:25.263 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0057310379999999999 2023-09-30T17:03:25.263 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.263 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.263 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:25.263 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380337+0000", 2023-09-30T17:03:25.263 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3869999999999998e-05 2023-09-30T17:03:25.263 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:25.263 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:25.263 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:25.264 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.264 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.264 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:1 3.14 e18/16 3:292cf221:::200.00000000:head v 18'3, mlcod=0'0)", 2023-09-30T17:03:25.264 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:03:25.264 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 66.773110239999994, 2023-09-30T17:03:25.264 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0057590560000000002, 2023-09-30T17:03:25.264 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:25.264 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:25.264 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:25.264 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.264 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:25.264 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:03:25.264 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:25.265 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.265 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.265 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:25.265 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:03:25.265 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:25.265 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.265 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.265 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:25.265 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374618+0000", 2023-09-30T17:03:25.265 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4900000000000001e-07 2023-09-30T17:03:25.265 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.265 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.266 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:25.266 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374629+0000", 2023-09-30T17:03:25.266 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1014e-05 2023-09-30T17:03:25.266 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.266 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.266 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:25.266 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374636+0000", 2023-09-30T17:03:25.266 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5889999999999999e-06 2023-09-30T17:03:25.266 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.266 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.266 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:25.266 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374642+0000", 2023-09-30T17:03:25.266 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.48e-06 2023-09-30T17:03:25.267 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.267 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.267 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:25.267 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374681+0000", 2023-09-30T17:03:25.267 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9320000000000003e-05 2023-09-30T17:03:25.267 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.267 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.267 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:25.267 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.374694+0000", 2023-09-30T17:03:25.267 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3351e-05 2023-09-30T17:03:25.267 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.268 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.268 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:25.268 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380319+0000", 2023-09-30T17:03:25.268 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0056243880000000001 2023-09-30T17:03:25.268 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.268 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.268 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:25.268 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380377+0000", 2023-09-30T17:03:25.268 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8464999999999997e-05 2023-09-30T17:03:25.268 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:25.268 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:25.268 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:25.269 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.269 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.269 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(mds.0.3:11 3.10 e18/16 3:0bd6d154:::602.00000000:head v 18'6, mlcod=0'0)", 2023-09-30T17:03:25.269 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:03:25.269 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 66.772399328999995, 2023-09-30T17:03:25.269 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051157370000000004, 2023-09-30T17:03:25.269 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:25.269 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:25.269 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:25.269 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.269 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:25.269 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:03:25.270 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:25.270 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.270 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.270 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:25.270 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:03:25.270 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:25.270 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.270 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.270 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:25.270 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375329+0000", 2023-09-30T17:03:25.270 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0199999999999998e-07 2023-09-30T17:03:25.271 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.271 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.271 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:25.271 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375334+0000", 2023-09-30T17:03:25.271 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8799999999999999e-06 2023-09-30T17:03:25.271 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.271 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.271 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:25.271 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375343+0000", 2023-09-30T17:03:25.271 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5490000000000006e-06 2023-09-30T17:03:25.271 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.271 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.271 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:25.272 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375350+0000", 2023-09-30T17:03:25.272 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5700000000000004e-06 2023-09-30T17:03:25.272 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.272 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.272 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:25.272 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375396+0000", 2023-09-30T17:03:25.272 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5550999999999998e-05 2023-09-30T17:03:25.272 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.272 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.272 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:25.272 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375410+0000", 2023-09-30T17:03:25.272 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4518999999999999e-05 2023-09-30T17:03:25.273 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.273 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.273 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:25.273 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380401+0000", 2023-09-30T17:03:25.273 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0049903430000000004 2023-09-30T17:03:25.273 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:25.273 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:25.273 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:25.273 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.380445+0000", 2023-09-30T17:03:25.273 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4023000000000002e-05 2023-09-30T17:03:25.273 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:25.273 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:25.274 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:25.274 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:25.274 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:25.274 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:25.275 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:25.275+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:25.276 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:03:25.345 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-09-30T17:03:25.375 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:25.375+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:25.401 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:25.402 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:03:25.402 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2023-09-30T17:03:25.402 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:25.411 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:03:25.476 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:25.476+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:25.577 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:25.577+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:25.578 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:25.578 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:03:25.579 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2023-09-30T17:03:25.579 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2023-09-30T17:03:25.579 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:25.590 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:03:25.678 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:25.678+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:25.759 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:25.759 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2023-09-30T17:03:25.759 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2023-09-30T17:03:25.759 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2023-09-30T17:03:25.760 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.760 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:4 3.1f 3:ff5b34d6:::1.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:25.760 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:03:25.760 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 67.406071491000006, 2023-09-30T17:03:25.760 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093789779999999996, 2023-09-30T17:03:25.760 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:25.760 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:25.760 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:25.760 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.760 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:25.760 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:03:25.761 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:25.761 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.761 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.761 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:25.761 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352017+0000", 2023-09-30T17:03:25.761 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:25.761 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.761 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.761 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:25.761 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352027+0000", 2023-09-30T17:03:25.761 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0224000000000001e-05 2023-09-30T17:03:25.761 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.762 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.762 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:25.762 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352039+0000", 2023-09-30T17:03:25.762 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1569000000000001e-05 2023-09-30T17:03:25.762 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.762 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.762 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:25.762 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352052+0000", 2023-09-30T17:03:25.762 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2605999999999999e-05 2023-09-30T17:03:25.762 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.762 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.763 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:25.763 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352064+0000", 2023-09-30T17:03:25.763 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2666999999999999e-05 2023-09-30T17:03:25.763 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.763 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.763 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:25.763 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352147+0000", 2023-09-30T17:03:25.763 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3125000000000001e-05 2023-09-30T17:03:25.763 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.763 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.763 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:25.764 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352306+0000", 2023-09-30T17:03:25.764 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015881900000000001 2023-09-30T17:03:25.764 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.764 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.764 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:25.764 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352450+0000", 2023-09-30T17:03:25.764 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014420700000000001 2023-09-30T17:03:25.764 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.764 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.764 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:25.764 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355975+0000", 2023-09-30T17:03:25.765 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003524246 2023-09-30T17:03:25.765 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.765 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.765 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:25.765 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361279+0000", 2023-09-30T17:03:25.765 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005304507 2023-09-30T17:03:25.765 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.765 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.765 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:25.765 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361344+0000", 2023-09-30T17:03:25.765 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4548999999999995e-05 2023-09-30T17:03:25.766 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.766 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.766 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:25.766 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.361396+0000", 2023-09-30T17:03:25.766 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2459e-05 2023-09-30T17:03:25.766 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:25.766 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:25.766 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:25.766 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.766 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.766 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:25.767 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:03:25.767 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 67.405979199000001, 2023-09-30T17:03:25.767 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021233007000000002, 2023-09-30T17:03:25.767 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:25.767 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:25.767 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:25.767 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.767 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:25.767 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:03:25.767 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:25.767 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.767 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.768 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:25.768 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:03:25.768 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:25.768 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.768 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.768 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:25.768 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352110+0000", 2023-09-30T17:03:25.768 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6000000000000002e-07 2023-09-30T17:03:25.768 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.768 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.768 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:25.768 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352117+0000", 2023-09-30T17:03:25.769 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5930000000000002e-06 2023-09-30T17:03:25.769 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.769 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.769 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:25.769 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352126+0000", 2023-09-30T17:03:25.769 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0729999999999994e-06 2023-09-30T17:03:25.769 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.769 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.769 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:25.769 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352136+0000", 2023-09-30T17:03:25.769 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0380000000000001e-05 2023-09-30T17:03:25.770 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.770 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.770 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:25.770 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353279+0000", 2023-09-30T17:03:25.770 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0011424670000000001 2023-09-30T17:03:25.770 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.770 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.770 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:25.770 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353707+0000", 2023-09-30T17:03:25.770 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00042829800000000003 2023-09-30T17:03:25.770 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.770 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.771 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:25.771 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354104+0000", 2023-09-30T17:03:25.771 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00039643399999999998 2023-09-30T17:03:25.771 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.771 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.771 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:25.771 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356925+0000", 2023-09-30T17:03:25.771 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0028210900000000001 2023-09-30T17:03:25.771 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.771 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.771 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:25.771 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373243+0000", 2023-09-30T17:03:25.772 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016318461999999999 2023-09-30T17:03:25.772 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.772 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.772 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:25.772 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373301+0000", 2023-09-30T17:03:25.772 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7435000000000002e-05 2023-09-30T17:03:25.772 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.772 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.772 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:25.772 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373342+0000", 2023-09-30T17:03:25.772 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1915000000000001e-05 2023-09-30T17:03:25.772 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:25.772 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:25.773 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:25.773 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.773 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.773 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:25.773 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:03:25.773 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 67.405936588000003, 2023-09-30T17:03:25.773 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011988331, 2023-09-30T17:03:25.773 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:25.773 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:25.773 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:25.773 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.773 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:25.774 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:03:25.774 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:25.774 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.774 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.774 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:25.774 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:03:25.774 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:25.774 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.774 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.774 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:25.774 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352153+0000", 2023-09-30T17:03:25.774 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0500000000000003e-07 2023-09-30T17:03:25.775 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.775 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.775 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:25.775 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352157+0000", 2023-09-30T17:03:25.775 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9790000000000004e-06 2023-09-30T17:03:25.775 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.775 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.775 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:25.775 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352173+0000", 2023-09-30T17:03:25.775 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6535999999999999e-05 2023-09-30T17:03:25.775 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.775 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.776 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:25.776 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352180+0000", 2023-09-30T17:03:25.776 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7700000000000004e-06 2023-09-30T17:03:25.776 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.776 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.776 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:25.776 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353526+0000", 2023-09-30T17:03:25.776 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0013458330000000001 2023-09-30T17:03:25.776 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.776 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.776 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:25.776 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353648+0000", 2023-09-30T17:03:25.777 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012262899999999999 2023-09-30T17:03:25.777 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.777 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.777 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:25.777 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354141+0000", 2023-09-30T17:03:25.777 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00049222899999999995 2023-09-30T17:03:25.777 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.777 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.777 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:25.777 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356931+0000", 2023-09-30T17:03:25.777 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0027900860000000002 2023-09-30T17:03:25.777 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.778 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.778 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:25.778 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364066+0000", 2023-09-30T17:03:25.778 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071355050000000003 2023-09-30T17:03:25.778 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.778 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.778 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:25.778 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364103+0000", 2023-09-30T17:03:25.778 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6944999999999999e-05 2023-09-30T17:03:25.778 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.778 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.779 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:25.779 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364140+0000", 2023-09-30T17:03:25.779 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7214e-05 2023-09-30T17:03:25.779 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:25.779 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:25.779 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:25.779 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.779 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.779 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:25.779 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:03:25.779 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 67.405897357000001, 2023-09-30T17:03:25.779 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012110921, 2023-09-30T17:03:25.780 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:25.780 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:25.780 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:25.780 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.780 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:25.780 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:03:25.780 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:25.780 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.780 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.780 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:25.780 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:03:25.780 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:25.781 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.781 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.781 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:25.781 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352192+0000", 2023-09-30T17:03:25.781 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7300000000000005e-07 2023-09-30T17:03:25.781 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.781 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.781 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:25.781 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352196+0000", 2023-09-30T17:03:25.781 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2370000000000003e-06 2023-09-30T17:03:25.781 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.781 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.781 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:25.782 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352205+0000", 2023-09-30T17:03:25.782 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6659999999999997e-06 2023-09-30T17:03:25.782 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.782 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.782 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:25.782 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352214+0000", 2023-09-30T17:03:25.782 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8259999999999999e-06 2023-09-30T17:03:25.782 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.782 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.782 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:25.782 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354470+0000", 2023-09-30T17:03:25.783 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022557340000000001 2023-09-30T17:03:25.783 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.783 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.783 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:25.783 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354557+0000", 2023-09-30T17:03:25.783 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6909000000000004e-05 2023-09-30T17:03:25.783 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.783 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.783 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:25.783 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354694+0000", 2023-09-30T17:03:25.783 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013774800000000001 2023-09-30T17:03:25.783 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.784 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.784 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:25.784 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356937+0000", 2023-09-30T17:03:25.784 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022424540000000001 2023-09-30T17:03:25.784 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.784 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.784 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:25.784 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364227+0000", 2023-09-30T17:03:25.784 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072902430000000001 2023-09-30T17:03:25.784 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.784 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.784 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:25.785 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364278+0000", 2023-09-30T17:03:25.785 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1180999999999997e-05 2023-09-30T17:03:25.785 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.785 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.785 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:25.785 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364302+0000", 2023-09-30T17:03:25.785 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4049999999999998e-05 2023-09-30T17:03:25.785 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:25.785 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:25.785 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:25.785 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.785 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.786 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:25.786 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:25.786 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 67.405864018000003, 2023-09-30T17:03:25.786 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021258651999999999, 2023-09-30T17:03:25.786 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:25.786 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:25.786 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:25.786 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.786 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:25.786 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:25.786 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:25.787 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.787 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.787 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:25.787 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:25.787 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:25.787 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.787 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.787 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:25.787 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:25.787 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6899999999999997e-07 2023-09-30T17:03:25.787 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.787 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.788 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:25.788 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352236+0000", 2023-09-30T17:03:25.788 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0251000000000001e-05 2023-09-30T17:03:25.788 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.788 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.788 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:25.788 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352244+0000", 2023-09-30T17:03:25.788 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0770000000000008e-06 2023-09-30T17:03:25.788 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.788 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.788 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:25.788 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352251+0000", 2023-09-30T17:03:25.788 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4749999999999996e-06 2023-09-30T17:03:25.789 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.789 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.789 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:25.789 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354455+0000", 2023-09-30T17:03:25.789 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022043660000000001 2023-09-30T17:03:25.789 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.789 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.789 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:25.789 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354577+0000", 2023-09-30T17:03:25.789 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000121054 2023-09-30T17:03:25.789 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.789 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.790 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:25.790 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354723+0000", 2023-09-30T17:03:25.790 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014693900000000001 2023-09-30T17:03:25.790 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.790 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.790 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:25.790 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356941+0000", 2023-09-30T17:03:25.790 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002217199 2023-09-30T17:03:25.790 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.790 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.790 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:25.791 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373392+0000", 2023-09-30T17:03:25.791 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016451774999999998 2023-09-30T17:03:25.791 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.791 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.791 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:25.791 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373445+0000", 2023-09-30T17:03:25.791 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.308e-05 2023-09-30T17:03:25.791 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.791 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.791 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:25.791 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373483+0000", 2023-09-30T17:03:25.792 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7766999999999999e-05 2023-09-30T17:03:25.792 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:25.792 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:25.792 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:25.792 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.792 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.792 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:25.792 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:25.792 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 67.405827927000004, 2023-09-30T17:03:25.792 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020903497, 2023-09-30T17:03:25.792 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:25.792 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:25.793 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:25.793 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.793 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:25.793 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:25.793 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:25.793 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.793 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.793 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:25.793 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:25.793 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:25.793 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.793 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.794 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:25.794 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:25.794 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0800000000000004e-07 2023-09-30T17:03:25.794 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.794 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.794 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:25.794 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352266+0000", 2023-09-30T17:03:25.794 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1280000000000001e-06 2023-09-30T17:03:25.794 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.794 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.794 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:25.794 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352273+0000", 2023-09-30T17:03:25.795 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3730000000000004e-06 2023-09-30T17:03:25.795 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.795 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.795 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:25.795 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352279+0000", 2023-09-30T17:03:25.795 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7699999999999998e-06 2023-09-30T17:03:25.795 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.795 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.795 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:25.795 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352334+0000", 2023-09-30T17:03:25.795 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5547999999999997e-05 2023-09-30T17:03:25.796 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.796 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.796 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:25.796 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352435+0000", 2023-09-30T17:03:25.796 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100688 2023-09-30T17:03:25.796 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.796 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.796 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:25.796 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352585+0000", 2023-09-30T17:03:25.796 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000150068 2023-09-30T17:03:25.796 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.796 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.797 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:25.797 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354912+0000", 2023-09-30T17:03:25.797 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0023266770000000001 2023-09-30T17:03:25.797 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.797 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.797 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:25.797 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373066+0000", 2023-09-30T17:03:25.797 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018154474 2023-09-30T17:03:25.797 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.797 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.797 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:25.798 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373122+0000", 2023-09-30T17:03:25.798 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6193000000000002e-05 2023-09-30T17:03:25.798 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.798 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.798 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:25.798 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373164+0000", 2023-09-30T17:03:25.798 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1869999999999997e-05 2023-09-30T17:03:25.798 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:25.798 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:25.798 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:25.798 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.798 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.799 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:25.799 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:03:25.799 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 67.405792250999994, 2023-09-30T17:03:25.799 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021015097999999999, 2023-09-30T17:03:25.799 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:25.799 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:25.799 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:25.799 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.799 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:25.799 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:03:25.799 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:25.799 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.800 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.800 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:25.800 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:03:25.800 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:25.800 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.800 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.800 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:25.800 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352297+0000", 2023-09-30T17:03:25.800 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8299999999999997e-07 2023-09-30T17:03:25.800 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.800 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.800 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:25.801 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352300+0000", 2023-09-30T17:03:25.801 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7460000000000001e-06 2023-09-30T17:03:25.801 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.801 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.801 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:25.801 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352307+0000", 2023-09-30T17:03:25.801 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4959999999999999e-06 2023-09-30T17:03:25.801 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.801 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.801 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:25.801 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352314+0000", 2023-09-30T17:03:25.801 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0190000000000001e-06 2023-09-30T17:03:25.801 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.802 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.802 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:25.802 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354070+0000", 2023-09-30T17:03:25.802 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001755936 2023-09-30T17:03:25.802 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.802 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.802 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:25.802 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354221+0000", 2023-09-30T17:03:25.802 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000150884 2023-09-30T17:03:25.802 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.802 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.803 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:25.803 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373311+0000", 2023-09-30T17:03:25.803 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019090434 2023-09-30T17:03:25.803 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:25.803 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:25.803 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:25.803 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.803 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.803 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:25.803 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:03:25.803 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 67.405763531999995, 2023-09-30T17:03:25.803 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021255174000000002, 2023-09-30T17:03:25.804 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:25.804 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:25.804 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:25.804 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.804 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:25.804 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:03:25.804 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:25.804 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.804 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.804 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:25.804 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:03:25.804 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:25.804 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.805 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.805 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:25.805 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352326+0000", 2023-09-30T17:03:25.805 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3200000000000005e-07 2023-09-30T17:03:25.805 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.805 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.805 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:25.805 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352349+0000", 2023-09-30T17:03:25.805 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3183000000000001e-05 2023-09-30T17:03:25.805 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.805 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.805 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:25.806 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352358+0000", 2023-09-30T17:03:25.806 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5230000000000001e-06 2023-09-30T17:03:25.806 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.806 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.806 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:25.806 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352365+0000", 2023-09-30T17:03:25.806 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3260000000000001e-06 2023-09-30T17:03:25.806 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.806 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.806 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:25.806 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355450+0000", 2023-09-30T17:03:25.806 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0030854049999999998 2023-09-30T17:03:25.807 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.807 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.807 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:25.807 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355583+0000", 2023-09-30T17:03:25.807 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000133189 2023-09-30T17:03:25.807 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.807 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.807 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:25.807 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373580+0000", 2023-09-30T17:03:25.807 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017997016000000001 2023-09-30T17:03:25.807 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:25.807 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:25.808 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:25.808 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.808 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.808 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:25.808 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:03:25.808 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 67.405712109000007, 2023-09-30T17:03:25.808 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010380537, 2023-09-30T17:03:25.808 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:25.808 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:25.808 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:25.808 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.809 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:25.809 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:03:25.809 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:25.809 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.809 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.809 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:25.809 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:03:25.809 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:25.809 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.809 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.809 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:25.809 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:03:25.810 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1500000000000003e-07 2023-09-30T17:03:25.810 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.810 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.810 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:25.810 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352381+0000", 2023-09-30T17:03:25.810 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6330000000000002e-06 2023-09-30T17:03:25.810 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.810 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.810 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:25.810 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352388+0000", 2023-09-30T17:03:25.810 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7229999999999998e-06 2023-09-30T17:03:25.811 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.811 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.811 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:25.811 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352394+0000", 2023-09-30T17:03:25.811 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1789999999999996e-06 2023-09-30T17:03:25.811 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.811 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.811 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:25.811 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353259+0000", 2023-09-30T17:03:25.811 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000865221 2023-09-30T17:03:25.811 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.812 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.812 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:25.812 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353391+0000", 2023-09-30T17:03:25.812 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013217700000000001 2023-09-30T17:03:25.812 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.812 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.812 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:25.812 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362757+0000", 2023-09-30T17:03:25.812 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093657889999999994 2023-09-30T17:03:25.812 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:25.812 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:25.812 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:25.813 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.813 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "pg_update_log_missing(3.1a epoch 18/16 rep_tid 1 entries 18'1 (0'0) error 3:5e41ab69:::200.00000005:head by mds.0.3:36 0.000000 -2 ObjectCleanRegions clean_offsets: [(0, 18446744073709551615)], clean_omap: true, new_object: false trim_to 0'0 roll_forward_to 0'0)", 2023-09-30T17:03:25.813 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:03:25.813 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 67.399411817000001, 2023-09-30T17:03:25.813 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0061813579999999996, 2023-09-30T17:03:25.813 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:25.813 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2023-09-30T17:03:25.813 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:25.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.813 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:25.813 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:03:25.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:25.814 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.814 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.814 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:25.814 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:03:25.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:25.814 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.814 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.814 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:25.814 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358677+0000", 2023-09-30T17:03:25.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5499999999999999e-07 2023-09-30T17:03:25.814 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.815 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.815 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:25.815 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358686+0000", 2023-09-30T17:03:25.815 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9979999999999992e-06 2023-09-30T17:03:25.815 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.815 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.815 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:25.815 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358700+0000", 2023-09-30T17:03:25.815 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3635000000000001e-05 2023-09-30T17:03:25.815 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.815 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.815 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:25.816 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358714+0000", 2023-09-30T17:03:25.816 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4470999999999999e-05 2023-09-30T17:03:25.816 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.816 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.816 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:25.816 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.358767+0000", 2023-09-30T17:03:25.816 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2651999999999997e-05 2023-09-30T17:03:25.816 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.816 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.816 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:25.816 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364858+0000", 2023-09-30T17:03:25.816 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060912470000000002 2023-09-30T17:03:25.817 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:25.817 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:25.817 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:25.817 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.817 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.817 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:31 3.13 e18/16 3:cd5a64a3:::100.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:03:25.817 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:03:25.817 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 67.396070948000002, 2023-09-30T17:03:25.817 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006676408, 2023-09-30T17:03:25.817 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:25.817 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:25.817 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:25.817 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.818 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:25.818 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:03:25.818 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:25.818 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.818 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.818 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:25.818 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:03:25.818 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:25.818 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.818 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.818 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:25.819 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362018+0000", 2023-09-30T17:03:25.819 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5600000000000002e-07 2023-09-30T17:03:25.819 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.819 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.819 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:25.819 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362044+0000", 2023-09-30T17:03:25.819 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5987999999999999e-05 2023-09-30T17:03:25.819 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.819 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.819 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:25.819 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362051+0000", 2023-09-30T17:03:25.819 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2599999999999999e-06 2023-09-30T17:03:25.819 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.820 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.820 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:25.820 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362057+0000", 2023-09-30T17:03:25.820 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.19e-06 2023-09-30T17:03:25.820 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.820 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.820 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:25.820 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362096+0000", 2023-09-30T17:03:25.820 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8278000000000002e-05 2023-09-30T17:03:25.820 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.820 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.820 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:25.821 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362114+0000", 2023-09-30T17:03:25.821 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8808e-05 2023-09-30T17:03:25.821 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.821 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.821 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:25.821 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368658+0000", 2023-09-30T17:03:25.821 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065433540000000004 2023-09-30T17:03:25.821 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.821 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.821 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:25.821 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368694+0000", 2023-09-30T17:03:25.821 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6273999999999999e-05 2023-09-30T17:03:25.822 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:25.822 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:25.822 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:25.822 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.822 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.822 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:26 3.13 e18/16 3:c91d4a1d:::mds0_inotable:head v 18'2, mlcod=0'0)", 2023-09-30T17:03:25.822 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:03:25.822 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 67.395980175999995, 2023-09-30T17:03:25.822 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0066596119999999996, 2023-09-30T17:03:25.822 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:25.822 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:25.822 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:25.823 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.823 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:25.823 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:03:25.823 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:25.823 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.823 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.823 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:25.823 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362108+0000", 2023-09-30T17:03:25.823 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:25.823 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.823 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.823 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:25.823 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362109+0000", 2023-09-30T17:03:25.824 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5699999999999999e-07 2023-09-30T17:03:25.824 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.824 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.824 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:25.824 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362112+0000", 2023-09-30T17:03:25.824 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8410000000000002e-06 2023-09-30T17:03:25.824 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.824 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.824 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:25.824 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362117+0000", 2023-09-30T17:03:25.824 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.792e-06 2023-09-30T17:03:25.825 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.825 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:25.825 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362122+0000", 2023-09-30T17:03:25.825 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.763e-06 2023-09-30T17:03:25.825 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.825 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:25.825 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362344+0000", 2023-09-30T17:03:25.825 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022181600000000001 2023-09-30T17:03:25.825 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.825 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:25.826 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362357+0000", 2023-09-30T17:03:25.826 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2864000000000001e-05 2023-09-30T17:03:25.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.826 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.826 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:25.826 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368738+0000", 2023-09-30T17:03:25.826 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063809499999999998 2023-09-30T17:03:25.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.826 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.826 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:25.826 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.368768+0000", 2023-09-30T17:03:25.826 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0429e-05 2023-09-30T17:03:25.827 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:25.827 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:25.827 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:25.827 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.827 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.827 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:24 3.7 e18/16 ondisk, result = 0)", 2023-09-30T17:03:25.827 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:03:25.827 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 67.394764008999999, 2023-09-30T17:03:25.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00082185400000000001, 2023-09-30T17:03:25.827 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:25.827 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:25.827 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:25.828 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.828 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:25.828 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:03:25.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:25.828 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.828 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.829 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:25.829 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:03:25.829 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:25.829 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.829 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:25.829 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363325+0000", 2023-09-30T17:03:25.829 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.22e-07 2023-09-30T17:03:25.829 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.830 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.830 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:25.830 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363327+0000", 2023-09-30T17:03:25.830 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4480000000000001e-06 2023-09-30T17:03:25.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.830 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.830 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:25.830 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363333+0000", 2023-09-30T17:03:25.830 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9989999999999997e-06 2023-09-30T17:03:25.831 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.831 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.831 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:25.831 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363354+0000", 2023-09-30T17:03:25.831 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0547000000000002e-05 2023-09-30T17:03:25.831 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.831 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.831 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:25.831 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364057+0000", 2023-09-30T17:03:25.832 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00070306600000000002 2023-09-30T17:03:25.832 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.832 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.832 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:25.832 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364063+0000", 2023-09-30T17:03:25.832 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.694e-06 2023-09-30T17:03:25.832 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.832 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.833 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:25.833 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364146+0000", 2023-09-30T17:03:25.833 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3877999999999999e-05 2023-09-30T17:03:25.833 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:25.833 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:25.833 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:25.833 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.833 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.834 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(mds.0.3:30 3.7 e18/16 ondisk, result = 0)", 2023-09-30T17:03:25.834 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:03:25.834 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 67.394450477000007, 2023-09-30T17:03:25.834 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00067007199999999996, 2023-09-30T17:03:25.834 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:25.834 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:25.834 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:25.834 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.835 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:25.835 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:03:25.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:25.835 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.835 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.835 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:25.835 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:03:25.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:25.835 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.836 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.836 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:25.836 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363638+0000", 2023-09-30T17:03:25.836 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.41e-07 2023-09-30T17:03:25.836 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.836 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.836 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:25.836 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363641+0000", 2023-09-30T17:03:25.836 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4830000000000002e-06 2023-09-30T17:03:25.836 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.837 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.837 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:25.837 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363647+0000", 2023-09-30T17:03:25.837 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4869999999999999e-06 2023-09-30T17:03:25.837 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.837 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.837 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:25.837 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.363654+0000", 2023-09-30T17:03:25.837 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5889999999999999e-06 2023-09-30T17:03:25.837 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.838 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.838 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:25.838 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364217+0000", 2023-09-30T17:03:25.838 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00056263199999999998 2023-09-30T17:03:25.838 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.838 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.838 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:25.838 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364222+0000", 2023-09-30T17:03:25.838 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.242e-06 2023-09-30T17:03:25.838 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.838 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.839 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:25.839 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364308+0000", 2023-09-30T17:03:25.839 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6397999999999995e-05 2023-09-30T17:03:25.839 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:25.839 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:25.839 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:25.839 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.839 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.839 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:20 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'1, mlcod=0'0)", 2023-09-30T17:03:25.839 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:03:25.839 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 67.380436493999994, 2023-09-30T17:03:25.839 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0046632949999999996, 2023-09-30T17:03:25.840 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:25.840 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:25.840 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:25.840 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.840 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:25.840 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:03:25.840 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:25.840 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.840 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.840 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:25.840 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377652+0000", 2023-09-30T17:03:25.840 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:25.841 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.841 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.841 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:25.841 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377653+0000", 2023-09-30T17:03:25.841 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7800000000000002e-07 2023-09-30T17:03:25.841 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.841 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.841 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:25.841 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377657+0000", 2023-09-30T17:03:25.841 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5859999999999998e-06 2023-09-30T17:03:25.841 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.841 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.841 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:25.842 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377677+0000", 2023-09-30T17:03:25.842 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9508999999999999e-05 2023-09-30T17:03:25.842 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.842 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.842 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:25.842 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377682+0000", 2023-09-30T17:03:25.842 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8300000000000001e-06 2023-09-30T17:03:25.842 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.842 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.842 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:25.842 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377725+0000", 2023-09-30T17:03:25.843 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2425000000000001e-05 2023-09-30T17:03:25.843 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.843 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.843 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:25.843 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.377738+0000", 2023-09-30T17:03:25.843 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2899e-05 2023-09-30T17:03:25.843 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.843 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.843 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:25.843 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382268+0000", 2023-09-30T17:03:25.843 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045301289999999999 2023-09-30T17:03:25.844 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.844 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.844 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:25.844 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382315+0000", 2023-09-30T17:03:25.844 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7539e-05 2023-09-30T17:03:25.844 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:25.844 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:25.844 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:25.844 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.844 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.844 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(mds.0.3:21 3.1c e18/16 3:3ed09add:::607.00000000:head v 18'2, mlcod=0'0)", 2023-09-30T17:03:25.844 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:03:25.845 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 67.379987043, 2023-09-30T17:03:25.845 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042540670000000003, 2023-09-30T17:03:25.845 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:25.845 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:25.845 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:25.845 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.845 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:25.845 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:03:25.845 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:25.845 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.845 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.845 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:25.846 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:03:25.846 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:25.846 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.846 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.846 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:25.846 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378102+0000", 2023-09-30T17:03:25.846 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0299999999999998e-07 2023-09-30T17:03:25.846 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.846 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.846 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:25.846 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378107+0000", 2023-09-30T17:03:25.847 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9250000000000003e-06 2023-09-30T17:03:25.847 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.847 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.847 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:25.847 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378116+0000", 2023-09-30T17:03:25.847 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.037e-06 2023-09-30T17:03:25.847 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.847 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.847 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:25.847 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378123+0000", 2023-09-30T17:03:25.847 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1879999999999996e-06 2023-09-30T17:03:25.847 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.848 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.848 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:25.848 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378174+0000", 2023-09-30T17:03:25.848 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0998000000000002e-05 2023-09-30T17:03:25.848 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.848 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.848 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:25.848 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.378197+0000", 2023-09-30T17:03:25.848 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2558e-05 2023-09-30T17:03:25.848 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.848 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.848 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:25.849 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382319+0000", 2023-09-30T17:03:25.849 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041220950000000001 2023-09-30T17:03:25.849 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.849 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.849 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:25.849 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.382356+0000", 2023-09-30T17:03:25.849 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6563000000000002e-05 2023-09-30T17:03:25.849 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:25.849 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:25.849 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:25.849 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.849 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.850 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:39 3.6 3:654134d2:::mds0_openfiles.0:head [omap-clear,omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e19)", 2023-09-30T17:03:25.850 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:03:25.850 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 63.322223219000001, 2023-09-30T17:03:25.850 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00171641, 2023-09-30T17:03:25.850 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:25.850 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:25.850 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:25.850 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.850 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:25.850 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:03:25.850 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:25.850 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.851 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.851 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:25.851 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435865+0000", 2023-09-30T17:03:25.851 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:25.851 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.851 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.851 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:25.851 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435868+0000", 2023-09-30T17:03:25.851 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5840000000000002e-06 2023-09-30T17:03:25.851 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.851 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.852 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:25.852 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435892+0000", 2023-09-30T17:03:25.852 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3625000000000002e-05 2023-09-30T17:03:25.852 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.852 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.852 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:25.852 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435908+0000", 2023-09-30T17:03:25.852 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6548000000000001e-05 2023-09-30T17:03:25.852 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.852 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.852 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:25.852 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435935+0000", 2023-09-30T17:03:25.853 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6516000000000002e-05 2023-09-30T17:03:25.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.853 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.853 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:25.853 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.435996+0000", 2023-09-30T17:03:25.853 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1433999999999995e-05 2023-09-30T17:03:25.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.853 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.853 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:25.853 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436114+0000", 2023-09-30T17:03:25.853 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000118344 2023-09-30T17:03:25.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.854 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.854 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:25.854 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436219+0000", 2023-09-30T17:03:25.854 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010453100000000001 2023-09-30T17:03:25.854 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.854 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.854 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:25.854 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.436900+0000", 2023-09-30T17:03:25.854 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00068121299999999996 2023-09-30T17:03:25.854 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.854 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.854 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:25.855 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437508+0000", 2023-09-30T17:03:25.855 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00060817399999999995 2023-09-30T17:03:25.855 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.855 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.855 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:25.855 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437554+0000", 2023-09-30T17:03:25.855 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5609000000000003e-05 2023-09-30T17:03:25.855 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.855 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.855 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:25.855 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:22.437582+0000", 2023-09-30T17:03:25.855 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7832000000000001e-05 2023-09-30T17:03:25.856 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:25.856 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:25.856 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:25.856 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.856 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.856 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:43 3.6 3:654134d2:::mds0_openfiles.0:head [omap-set-header,omap-set-vals] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e21)", 2023-09-30T17:03:25.856 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:03:25.856 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 43.321911725, 2023-09-30T17:03:25.856 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001456199, 2023-09-30T17:03:25.856 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:25.856 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:25.856 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:25.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.857 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:25.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:03:25.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:25.857 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.857 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:25.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436177+0000", 2023-09-30T17:03:25.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:25.857 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.857 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:25.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436178+0000", 2023-09-30T17:03:25.858 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.494e-06 2023-09-30T17:03:25.858 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.858 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.858 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:25.858 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436184+0000", 2023-09-30T17:03:25.858 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2809999999999999e-06 2023-09-30T17:03:25.858 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.858 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.858 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:25.858 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436198+0000", 2023-09-30T17:03:25.858 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3978000000000001e-05 2023-09-30T17:03:25.858 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.859 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.859 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:25.859 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436206+0000", 2023-09-30T17:03:25.859 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8040000000000007e-06 2023-09-30T17:03:25.859 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.859 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.859 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:25.859 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436268+0000", 2023-09-30T17:03:25.859 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1484999999999998e-05 2023-09-30T17:03:25.859 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.859 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.860 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:25.860 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436339+0000", 2023-09-30T17:03:25.860 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1000000000000005e-05 2023-09-30T17:03:25.860 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.860 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.860 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:25.860 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436438+0000", 2023-09-30T17:03:25.860 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9389000000000007e-05 2023-09-30T17:03:25.860 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.860 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.860 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:25.861 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.436986+0000", 2023-09-30T17:03:25.861 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00054723399999999996 2023-09-30T17:03:25.861 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.861 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.861 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:25.861 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437566+0000", 2023-09-30T17:03:25.861 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00058017599999999996 2023-09-30T17:03:25.861 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.861 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.861 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:25.861 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437606+0000", 2023-09-30T17:03:25.861 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9891999999999997e-05 2023-09-30T17:03:25.862 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.862 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.862 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:25.862 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:42.437633+0000", 2023-09-30T17:03:25.862 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7466000000000001e-05 2023-09-30T17:03:25.862 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:25.862 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:25.862 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:25.862 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.862 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.862 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:22 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-09-30T17:03:25.863 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:25.074944+0000", 2023-09-30T17:03:25.863 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.68314463999999997, 2023-09-30T17:03:25.863 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017740700000000002, 2023-09-30T17:03:25.863 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:25.863 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:25.863 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:25.863 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:25.863 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:25.863 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 22 2023-09-30T17:03:25.863 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.863 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:25.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.864 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:25.864 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.074944+0000", 2023-09-30T17:03:25.864 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:25.864 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.864 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:25.864 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.074944+0000", 2023-09-30T17:03:25.864 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:25.864 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.865 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:25.865 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.074945+0000", 2023-09-30T17:03:25.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0890000000000001e-06 2023-09-30T17:03:25.865 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.865 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.865 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:25.865 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.078709+0000", 2023-09-30T17:03:25.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0037635339999999998 2023-09-30T17:03:25.865 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.865 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.865 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:25.866 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.078723+0000", 2023-09-30T17:03:25.866 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4562000000000001e-05 2023-09-30T17:03:25.866 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.866 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.866 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:25.866 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.078738+0000", 2023-09-30T17:03:25.866 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5065000000000001e-05 2023-09-30T17:03:25.866 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.866 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.866 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:25.866 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.078794+0000", 2023-09-30T17:03:25.866 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5642e-05 2023-09-30T17:03:25.867 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.867 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.867 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:25.867 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.078893+0000", 2023-09-30T17:03:25.867 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8863000000000005e-05 2023-09-30T17:03:25.867 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.867 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.867 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:25.867 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.078998+0000", 2023-09-30T17:03:25.867 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000105153 2023-09-30T17:03:25.868 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:25.868 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.084862+0000", 2023-09-30T17:03:25.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0058643300000000001 2023-09-30T17:03:25.868 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:25.868 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.092503+0000", 2023-09-30T17:03:25.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0076404589999999996 2023-09-30T17:03:25.868 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.869 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:25.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.092619+0000", 2023-09-30T17:03:25.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011675699999999999 2023-09-30T17:03:25.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.869 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:25.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.092685+0000", 2023-09-30T17:03:25.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5246000000000005e-05 2023-09-30T17:03:25.869 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:25.869 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:25.869 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:25.870 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.870 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:24 4.36 e36/17 4:6c9c34b1:::100000001f8.00000010:head v 36'2, mlcod=0'0)", 2023-09-30T17:03:25.870 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:25.258418+0000", 2023-09-30T17:03:25.870 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.49967057799999998, 2023-09-30T17:03:25.870 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.01152803, 2023-09-30T17:03:25.870 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:25.870 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:25.870 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:25.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.870 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:25.870 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.258418+0000", 2023-09-30T17:03:25.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:25.871 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.871 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.871 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:25.871 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.258418+0000", 2023-09-30T17:03:25.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:25.871 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.871 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.871 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:25.871 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.258419+0000", 2023-09-30T17:03:25.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6599999999999996e-07 2023-09-30T17:03:25.871 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:25.872 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.262535+0000", 2023-09-30T17:03:25.872 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041165100000000003 2023-09-30T17:03:25.872 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:25.872 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.262549+0000", 2023-09-30T17:03:25.872 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4219999999999999e-05 2023-09-30T17:03:25.872 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:25.873 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.262558+0000", 2023-09-30T17:03:25.873 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6899999999999998e-06 2023-09-30T17:03:25.873 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.873 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.873 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:25.873 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.262631+0000", 2023-09-30T17:03:25.873 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3071000000000006e-05 2023-09-30T17:03:25.873 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.873 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.873 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:25.873 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.262650+0000", 2023-09-30T17:03:25.873 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8467000000000001e-05 2023-09-30T17:03:25.874 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.874 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.874 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:25.874 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.269897+0000", 2023-09-30T17:03:25.874 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072468369999999999 2023-09-30T17:03:25.874 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:25.874 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:25.874 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:25.874 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.269946+0000", 2023-09-30T17:03:25.874 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9568999999999999e-05 2023-09-30T17:03:25.874 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:25.874 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:25.875 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:25.875 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:25.875 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:25.875 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:25.876 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:03:25.877 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:25.876+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:25.977 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:25.977+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:26.018 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:26.018 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:03:26.018 INFO:teuthology.orchestra.run.smithi031.stdout: "num_ops": 0 2023-09-30T17:03:26.018 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:26.028 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:03:26.078 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:26.079+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:26.162 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:26.162 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:03:26.162 INFO:teuthology.orchestra.run.smithi031.stdout: "complaint_time": 30, 2023-09-30T17:03:26.162 INFO:teuthology.orchestra.run.smithi031.stdout: "num_blocked_ops": 0 2023-09-30T17:03:26.163 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:26.172 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:03:26.216 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:26.216+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:26.280 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:26.280+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:26.307 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:26.307 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 20, 2023-09-30T17:03:26.307 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 600, 2023-09-30T17:03:26.307 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:03:26.307 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.308 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:26.308 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:03:26.308 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 67.954538525000004, 2023-09-30T17:03:26.308 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.025313649000000001, 2023-09-30T17:03:26.308 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:26.308 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:26.308 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:26.308 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.308 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:26.308 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:03:26.308 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:26.309 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.309 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.309 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:26.309 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:03:26.309 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:26.309 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.309 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.309 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:26.309 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351551+0000", 2023-09-30T17:03:26.309 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3380000000000004e-06 2023-09-30T17:03:26.309 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.309 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.310 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:26.310 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351559+0000", 2023-09-30T17:03:26.310 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9589999999999995e-06 2023-09-30T17:03:26.310 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.310 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.310 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:26.310 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351571+0000", 2023-09-30T17:03:26.310 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2065999999999999e-05 2023-09-30T17:03:26.310 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.310 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.310 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:26.310 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351706+0000", 2023-09-30T17:03:26.311 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00013553799999999999 2023-09-30T17:03:26.311 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.311 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.311 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:26.311 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353016+0000", 2023-09-30T17:03:26.311 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0013099209999999999 2023-09-30T17:03:26.311 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.311 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.311 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:26.311 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353023+0000", 2023-09-30T17:03:26.311 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2479999999999999e-06 2023-09-30T17:03:26.311 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.312 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.312 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:26.312 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360348+0000", 2023-09-30T17:03:26.312 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0073248949999999997 2023-09-30T17:03:26.312 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.312 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.312 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:26.312 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360787+0000", 2023-09-30T17:03:26.312 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00043875199999999999 2023-09-30T17:03:26.312 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.312 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.312 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:26.313 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360892+0000", 2023-09-30T17:03:26.313 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010508199999999999 2023-09-30T17:03:26.313 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.313 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.313 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:26.313 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365132+0000", 2023-09-30T17:03:26.313 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0042396480000000004 2023-09-30T17:03:26.313 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.313 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.314 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:26.314 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376746+0000", 2023-09-30T17:03:26.314 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011614157 2023-09-30T17:03:26.314 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.314 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.314 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:26.314 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376811+0000", 2023-09-30T17:03:26.314 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5005999999999994e-05 2023-09-30T17:03:26.314 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.314 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.314 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:26.314 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376859+0000", 2023-09-30T17:03:26.314 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8038999999999999e-05 2023-09-30T17:03:26.315 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:26.315 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:26.315 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:26.315 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.315 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.315 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:26.315 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:03:26.315 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 67.954040726000002, 2023-09-30T17:03:26.315 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024923989000000001, 2023-09-30T17:03:26.315 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:26.315 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:26.315 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:26.316 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.316 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:26.316 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:03:26.316 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:26.316 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.316 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.316 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:26.316 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:03:26.316 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:26.316 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.316 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.316 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:26.317 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352044+0000", 2023-09-30T17:03:26.317 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9199999999999999e-07 2023-09-30T17:03:26.317 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.317 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.317 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:26.317 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352050+0000", 2023-09-30T17:03:26.317 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8880000000000002e-06 2023-09-30T17:03:26.317 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.317 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.317 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:26.317 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352143+0000", 2023-09-30T17:03:26.317 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2721999999999998e-05 2023-09-30T17:03:26.318 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.318 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.318 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:26.318 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352155+0000", 2023-09-30T17:03:26.318 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2279000000000001e-05 2023-09-30T17:03:26.318 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.318 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.318 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:26.318 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353114+0000", 2023-09-30T17:03:26.318 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00095943700000000005 2023-09-30T17:03:26.318 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.318 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.319 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:26.319 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353121+0000", 2023-09-30T17:03:26.319 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.494e-06 2023-09-30T17:03:26.319 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.319 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.319 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:26.319 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361491+0000", 2023-09-30T17:03:26.319 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0083697359999999991 2023-09-30T17:03:26.319 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.319 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.319 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:26.319 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361573+0000", 2023-09-30T17:03:26.320 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2822000000000001e-05 2023-09-30T17:03:26.320 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.320 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.320 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:26.320 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362166+0000", 2023-09-30T17:03:26.320 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00059223299999999995 2023-09-30T17:03:26.320 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.320 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.320 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:26.320 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365209+0000", 2023-09-30T17:03:26.320 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.003043212 2023-09-30T17:03:26.321 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.321 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.321 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:26.321 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376910+0000", 2023-09-30T17:03:26.321 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011700898 2023-09-30T17:03:26.321 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.321 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.321 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:26.321 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376945+0000", 2023-09-30T17:03:26.321 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4795000000000001e-05 2023-09-30T17:03:26.321 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.321 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.322 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:26.322 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376967+0000", 2023-09-30T17:03:26.322 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2580999999999999e-05 2023-09-30T17:03:26.322 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:26.322 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:26.322 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:26.322 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.322 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.322 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:26.322 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:03:26.322 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 67.953870805999998, 2023-09-30T17:03:26.322 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023120405, 2023-09-30T17:03:26.323 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:26.323 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:26.323 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:26.323 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.323 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:26.323 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:03:26.323 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:26.323 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.323 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.323 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:26.323 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:03:26.324 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:26.324 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.324 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.324 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:26.324 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352214+0000", 2023-09-30T17:03:26.324 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8400000000000003e-07 2023-09-30T17:03:26.324 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.324 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.324 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:26.324 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352233+0000", 2023-09-30T17:03:26.324 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8946000000000001e-05 2023-09-30T17:03:26.324 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.325 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.325 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:26.325 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352297+0000", 2023-09-30T17:03:26.325 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3540999999999994e-05 2023-09-30T17:03:26.325 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.325 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.325 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:26.325 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352450+0000", 2023-09-30T17:03:26.325 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015364799999999999 2023-09-30T17:03:26.325 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.325 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.325 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:26.326 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353098+0000", 2023-09-30T17:03:26.326 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00064820299999999997 2023-09-30T17:03:26.326 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.326 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.326 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:26.326 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353103+0000", 2023-09-30T17:03:26.326 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0529999999999997e-06 2023-09-30T17:03:26.326 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.326 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.326 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:26.326 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.358558+0000", 2023-09-30T17:03:26.326 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0054550249999999996 2023-09-30T17:03:26.327 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.327 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.327 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:26.327 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.358741+0000", 2023-09-30T17:03:26.327 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00018210200000000001 2023-09-30T17:03:26.327 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.327 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.327 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:26.327 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.359683+0000", 2023-09-30T17:03:26.327 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00094202299999999995 2023-09-30T17:03:26.327 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.327 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.328 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:26.328 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365044+0000", 2023-09-30T17:03:26.328 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053616219999999999 2023-09-30T17:03:26.328 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.328 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.328 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:26.328 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375256+0000", 2023-09-30T17:03:26.328 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010212156 2023-09-30T17:03:26.328 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.328 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.328 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:26.329 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375300+0000", 2023-09-30T17:03:26.329 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3961999999999997e-05 2023-09-30T17:03:26.329 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.329 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.329 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:26.329 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375334+0000", 2023-09-30T17:03:26.329 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.324e-05 2023-09-30T17:03:26.329 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:26.329 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:26.329 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:26.330 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.330 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.330 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:26.330 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:03:26.330 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 67.953555788000003, 2023-09-30T17:03:26.330 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024240660000000001, 2023-09-30T17:03:26.330 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:26.330 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:26.330 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:26.330 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.330 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:26.330 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:03:26.331 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:26.331 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.331 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.331 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:26.331 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:03:26.331 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:26.331 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.331 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.331 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:26.331 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352529+0000", 2023-09-30T17:03:26.331 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1379999999999999e-06 2023-09-30T17:03:26.331 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.332 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.332 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:26.332 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352536+0000", 2023-09-30T17:03:26.332 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3489999999999997e-06 2023-09-30T17:03:26.332 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.332 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.332 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:26.332 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352547+0000", 2023-09-30T17:03:26.332 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1109e-05 2023-09-30T17:03:26.332 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.332 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.332 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:26.333 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352560+0000", 2023-09-30T17:03:26.333 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3046e-05 2023-09-30T17:03:26.333 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.333 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.333 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:26.333 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353142+0000", 2023-09-30T17:03:26.333 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00058174699999999997 2023-09-30T17:03:26.333 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.333 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.333 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:26.333 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353147+0000", 2023-09-30T17:03:26.334 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5840000000000002e-06 2023-09-30T17:03:26.334 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.334 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.334 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:26.334 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360374+0000", 2023-09-30T17:03:26.334 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0072270049999999999 2023-09-30T17:03:26.334 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.334 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.334 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:26.334 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360795+0000", 2023-09-30T17:03:26.334 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00042088999999999999 2023-09-30T17:03:26.335 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.335 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.335 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:26.335 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360967+0000", 2023-09-30T17:03:26.335 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017235699999999999 2023-09-30T17:03:26.335 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.335 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.335 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:26.335 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365051+0000", 2023-09-30T17:03:26.335 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0040837429999999999 2023-09-30T17:03:26.335 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.336 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.336 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:26.336 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376708+0000", 2023-09-30T17:03:26.336 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011656866 2023-09-30T17:03:26.336 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.336 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.336 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:26.336 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376745+0000", 2023-09-30T17:03:26.336 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6769e-05 2023-09-30T17:03:26.336 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.336 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.336 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:26.337 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376769+0000", 2023-09-30T17:03:26.337 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4057e-05 2023-09-30T17:03:26.337 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:26.337 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:26.337 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:26.337 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.337 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.337 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:26.337 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:26.337 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 67.953296433000006, 2023-09-30T17:03:26.337 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023472704, 2023-09-30T17:03:26.337 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:26.338 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:26.338 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:26.338 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.338 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:26.338 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:26.338 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:26.338 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.338 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.338 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:26.338 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:26.338 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:26.339 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.339 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.339 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:26.339 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:26.339 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8000000000000005e-07 2023-09-30T17:03:26.339 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.339 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.339 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:26.339 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352794+0000", 2023-09-30T17:03:26.339 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.789e-06 2023-09-30T17:03:26.339 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.339 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.340 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:26.340 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352805+0000", 2023-09-30T17:03:26.340 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0848e-05 2023-09-30T17:03:26.340 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.340 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.340 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:26.340 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352812+0000", 2023-09-30T17:03:26.340 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4449999999999999e-06 2023-09-30T17:03:26.340 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.340 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.340 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:26.341 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353063+0000", 2023-09-30T17:03:26.341 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00025046299999999998 2023-09-30T17:03:26.341 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.341 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.341 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:26.341 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353071+0000", 2023-09-30T17:03:26.341 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6739999999999997e-06 2023-09-30T17:03:26.341 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.341 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.341 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:26.341 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361696+0000", 2023-09-30T17:03:26.342 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0086251609999999992 2023-09-30T17:03:26.342 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.342 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.342 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:26.342 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362284+0000", 2023-09-30T17:03:26.342 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00058872299999999998 2023-09-30T17:03:26.342 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.342 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.342 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:26.342 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362429+0000", 2023-09-30T17:03:26.342 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014509000000000001 2023-09-30T17:03:26.342 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.343 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.343 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:26.343 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365330+0000", 2023-09-30T17:03:26.343 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0029005419999999999 2023-09-30T17:03:26.343 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.343 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.343 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:26.343 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376196+0000", 2023-09-30T17:03:26.343 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.01086615 2023-09-30T17:03:26.343 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.343 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.343 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:26.344 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376230+0000", 2023-09-30T17:03:26.344 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3858e-05 2023-09-30T17:03:26.344 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.344 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.344 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:26.344 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376260+0000", 2023-09-30T17:03:26.344 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0181000000000001e-05 2023-09-30T17:03:26.344 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:26.344 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:26.344 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:26.344 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.344 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.345 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:26.345 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:03:26.345 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 67.953062863, 2023-09-30T17:03:26.345 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023406132999999999, 2023-09-30T17:03:26.345 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:26.345 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:26.345 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:26.345 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.345 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:26.346 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:03:26.346 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:26.346 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.346 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.346 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:26.346 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:03:26.346 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:26.346 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.346 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.346 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:26.346 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353022+0000", 2023-09-30T17:03:26.347 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.78e-07 2023-09-30T17:03:26.347 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.347 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.347 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:26.347 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353027+0000", 2023-09-30T17:03:26.347 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9089999999999999e-06 2023-09-30T17:03:26.347 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.347 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.347 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:26.347 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353035+0000", 2023-09-30T17:03:26.347 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0430000000000008e-06 2023-09-30T17:03:26.347 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.348 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.348 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:26.348 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353047+0000", 2023-09-30T17:03:26.348 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1674e-05 2023-09-30T17:03:26.348 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.348 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.348 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:26.348 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353105+0000", 2023-09-30T17:03:26.348 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8891999999999998e-05 2023-09-30T17:03:26.348 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.348 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.349 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:26.349 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353112+0000", 2023-09-30T17:03:26.349 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7059999999999998e-06 2023-09-30T17:03:26.349 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.349 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.349 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:26.349 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362733+0000", 2023-09-30T17:03:26.349 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0096205869999999999 2023-09-30T17:03:26.349 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.349 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.349 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:26.349 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362833+0000", 2023-09-30T17:03:26.350 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000100227 2023-09-30T17:03:26.350 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.350 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.350 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:26.350 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363000+0000", 2023-09-30T17:03:26.350 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016670899999999999 2023-09-30T17:03:26.350 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.350 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.350 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:26.350 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365550+0000", 2023-09-30T17:03:26.350 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0025499199999999998 2023-09-30T17:03:26.351 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.351 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.351 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:26.351 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376315+0000", 2023-09-30T17:03:26.351 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010765011999999999 2023-09-30T17:03:26.351 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.351 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.351 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:26.351 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376386+0000", 2023-09-30T17:03:26.351 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0866999999999998e-05 2023-09-30T17:03:26.351 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.351 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.352 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:26.352 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376427+0000", 2023-09-30T17:03:26.352 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1709000000000003e-05 2023-09-30T17:03:26.352 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:26.352 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:26.352 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:26.352 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.352 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.352 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:26.352 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:26.352 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 67.953022227000005, 2023-09-30T17:03:26.352 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024076238, 2023-09-30T17:03:26.353 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:26.353 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:26.353 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:26.353 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.353 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:26.353 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:26.353 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:26.353 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.353 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.353 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:26.353 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:26.353 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:26.354 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.354 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.354 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:26.354 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:26.354 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8699999999999995e-07 2023-09-30T17:03:26.354 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.354 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.354 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:26.354 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353067+0000", 2023-09-30T17:03:26.354 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.605e-06 2023-09-30T17:03:26.354 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.354 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.355 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:26.355 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353073+0000", 2023-09-30T17:03:26.355 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8900000000000004e-06 2023-09-30T17:03:26.355 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.355 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.355 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:26.355 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353083+0000", 2023-09-30T17:03:26.355 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0200000000000001e-05 2023-09-30T17:03:26.355 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.355 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.355 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:26.355 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353186+0000", 2023-09-30T17:03:26.356 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010256599999999999 2023-09-30T17:03:26.356 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.356 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.356 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:26.356 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353190+0000", 2023-09-30T17:03:26.356 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9709999999999998e-06 2023-09-30T17:03:26.356 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.356 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.356 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:26.356 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362946+0000", 2023-09-30T17:03:26.356 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0097563330000000007 2023-09-30T17:03:26.357 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.357 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.357 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:26.357 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363088+0000", 2023-09-30T17:03:26.357 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014259200000000001 2023-09-30T17:03:26.357 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.357 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.357 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:26.357 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363555+0000", 2023-09-30T17:03:26.357 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00046627799999999998 2023-09-30T17:03:26.357 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.357 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.358 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:26.358 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365871+0000", 2023-09-30T17:03:26.358 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0023167589999999998 2023-09-30T17:03:26.358 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.358 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.358 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:26.361 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377033+0000", 2023-09-30T17:03:26.361 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011161203999999999 2023-09-30T17:03:26.361 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.361 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.361 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:26.361 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377100+0000", 2023-09-30T17:03:26.361 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7230999999999994e-05 2023-09-30T17:03:26.361 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.361 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.362 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:26.362 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377138+0000", 2023-09-30T17:03:26.362 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8022000000000003e-05 2023-09-30T17:03:26.362 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:26.362 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:26.362 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:26.362 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.362 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.362 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:26.362 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:03:26.362 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 67.952921278000005, 2023-09-30T17:03:26.362 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.020304412000000001, 2023-09-30T17:03:26.363 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:26.363 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:26.363 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:26.363 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.363 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:26.363 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:03:26.363 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:26.363 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.363 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.363 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:26.364 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:03:26.364 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:26.364 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.364 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.364 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:26.364 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353164+0000", 2023-09-30T17:03:26.364 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7100000000000011e-07 2023-09-30T17:03:26.364 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.364 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.364 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:26.364 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353168+0000", 2023-09-30T17:03:26.365 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0600000000000001e-06 2023-09-30T17:03:26.365 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.365 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.365 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:26.365 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353177+0000", 2023-09-30T17:03:26.365 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1409999999999994e-06 2023-09-30T17:03:26.365 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.365 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.365 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:26.365 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353185+0000", 2023-09-30T17:03:26.365 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2479999999999996e-06 2023-09-30T17:03:26.366 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.366 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.366 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:26.366 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353246+0000", 2023-09-30T17:03:26.366 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0519000000000001e-05 2023-09-30T17:03:26.366 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.366 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.366 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:26.366 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353252+0000", 2023-09-30T17:03:26.366 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7859999999999999e-06 2023-09-30T17:03:26.366 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.366 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.367 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:26.367 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354979+0000", 2023-09-30T17:03:26.367 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0017270090000000001 2023-09-30T17:03:26.367 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.367 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.367 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:26.367 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355097+0000", 2023-09-30T17:03:26.367 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000117472 2023-09-30T17:03:26.367 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.367 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.367 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:26.368 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.373467+0000", 2023-09-30T17:03:26.368 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.018370206 2023-09-30T17:03:26.368 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:26.368 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:26.368 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:26.368 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.368 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.368 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:26.368 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:03:26.368 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 67.952880539999995, 2023-09-30T17:03:26.368 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.012725089, 2023-09-30T17:03:26.369 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:26.369 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:26.369 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:26.369 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.369 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:26.369 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:03:26.369 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:26.369 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.369 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.369 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:26.369 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:03:26.370 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:26.370 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.370 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.370 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:26.370 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353204+0000", 2023-09-30T17:03:26.370 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7100000000000002e-07 2023-09-30T17:03:26.370 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.370 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.370 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:26.370 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353213+0000", 2023-09-30T17:03:26.370 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8580000000000006e-06 2023-09-30T17:03:26.371 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.371 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.371 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:26.371 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353219+0000", 2023-09-30T17:03:26.371 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8939999999999998e-06 2023-09-30T17:03:26.371 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.371 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.371 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:26.371 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353223+0000", 2023-09-30T17:03:26.371 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.357e-06 2023-09-30T17:03:26.371 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.372 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.372 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:26.372 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353278+0000", 2023-09-30T17:03:26.372 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5228e-05 2023-09-30T17:03:26.372 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.372 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.372 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:26.372 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353284+0000", 2023-09-30T17:03:26.372 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8209999999999998e-06 2023-09-30T17:03:26.372 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.372 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.372 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:26.373 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355095+0000", 2023-09-30T17:03:26.373 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001811404 2023-09-30T17:03:26.373 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.373 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.373 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:26.373 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355256+0000", 2023-09-30T17:03:26.373 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000160898 2023-09-30T17:03:26.373 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.373 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.373 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:26.373 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365928+0000", 2023-09-30T17:03:26.374 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010672157999999999 2023-09-30T17:03:26.374 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:26.374 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:26.374 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:26.374 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.374 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.374 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:22 4.2d e36/17 4:b7099a35:::100000001f8.0000000e:head v 36'1, mlcod=0'0)", 2023-09-30T17:03:26.374 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:25.079146+0000", 2023-09-30T17:03:26.374 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 1.2269376780000001, 2023-09-30T17:03:26.374 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.012983130000000001, 2023-09-30T17:03:26.374 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:26.375 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:26.375 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:26.375 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.375 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:26.375 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.079146+0000", 2023-09-30T17:03:26.375 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:26.375 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.375 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.375 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:26.375 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.079146+0000", 2023-09-30T17:03:26.375 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:26.376 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.376 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.376 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:26.376 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.079148+0000", 2023-09-30T17:03:26.376 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.412e-06 2023-09-30T17:03:26.376 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.376 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.376 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:26.376 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.084608+0000", 2023-09-30T17:03:26.376 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0054598659999999999 2023-09-30T17:03:26.376 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.376 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.377 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:26.377 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.084630+0000", 2023-09-30T17:03:26.377 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2163000000000001e-05 2023-09-30T17:03:26.377 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.377 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.377 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:26.377 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.084641+0000", 2023-09-30T17:03:26.377 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1136e-05 2023-09-30T17:03:26.377 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.377 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.377 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:26.377 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.084704+0000", 2023-09-30T17:03:26.378 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3521000000000004e-05 2023-09-30T17:03:26.378 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.378 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.378 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:26.378 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.084730+0000", 2023-09-30T17:03:26.378 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.5522000000000001e-05 2023-09-30T17:03:26.378 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.378 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.378 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:26.378 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.092064+0000", 2023-09-30T17:03:26.378 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0073344530000000003 2023-09-30T17:03:26.379 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.379 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.379 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:26.379 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.092129+0000", 2023-09-30T17:03:26.379 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5056999999999997e-05 2023-09-30T17:03:26.379 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:26.379 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:26.379 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:26.379 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.379 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.379 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23 4.24 4:27adda6e:::100000001f8.0000000f:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-09-30T17:03:26.379 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:25.167117+0000", 2023-09-30T17:03:26.380 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 1.1389671530000001, 2023-09-30T17:03:26.380 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010434196, 2023-09-30T17:03:26.380 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:26.380 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:26.380 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:26.380 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:26.380 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:26.380 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23 2023-09-30T17:03:26.380 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.380 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:26.380 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.380 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:26.381 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.167117+0000", 2023-09-30T17:03:26.381 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:26.381 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.381 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.381 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:26.381 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.167117+0000", 2023-09-30T17:03:26.381 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:26.381 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.381 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.381 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:26.381 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.167121+0000", 2023-09-30T17:03:26.381 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1400000000000002e-06 2023-09-30T17:03:26.382 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.382 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.382 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:26.382 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.171536+0000", 2023-09-30T17:03:26.382 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0044146569999999998 2023-09-30T17:03:26.382 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.382 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.382 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:26.382 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.171560+0000", 2023-09-30T17:03:26.382 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4289000000000001e-05 2023-09-30T17:03:26.382 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.382 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.383 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:26.383 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.171570+0000", 2023-09-30T17:03:26.383 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0581000000000001e-05 2023-09-30T17:03:26.383 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.383 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.383 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:26.383 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.171662+0000", 2023-09-30T17:03:26.383 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1947999999999994e-05 2023-09-30T17:03:26.383 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.383 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.383 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:26.383 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.171776+0000", 2023-09-30T17:03:26.384 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000113229 2023-09-30T17:03:26.384 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.384 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.384 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:26.384 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.177469+0000", 2023-09-30T17:03:26.384 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0056937730000000001 2023-09-30T17:03:26.384 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.384 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.384 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:26.384 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.177503+0000", 2023-09-30T17:03:26.384 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3627999999999997e-05 2023-09-30T17:03:26.384 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.385 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.385 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:26.385 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.177551+0000", 2023-09-30T17:03:26.385 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7951000000000002e-05 2023-09-30T17:03:26.385 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:26.385 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:26.385 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:26.385 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.385 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.385 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:24 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-09-30T17:03:26.385 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:25.254047+0000", 2023-09-30T17:03:26.385 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 1.0520370189999999, 2023-09-30T17:03:26.386 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.016430255000000001, 2023-09-30T17:03:26.386 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:26.386 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:26.386 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:26.386 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:26.386 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:26.386 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 24 2023-09-30T17:03:26.386 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.386 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:26.386 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.386 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:26.386 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.254047+0000", 2023-09-30T17:03:26.387 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:26.387 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.387 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.387 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:26.387 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.254047+0000", 2023-09-30T17:03:26.387 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:26.387 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.387 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.387 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:26.387 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.254050+0000", 2023-09-30T17:03:26.387 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.9500000000000001e-06 2023-09-30T17:03:26.387 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.387 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.388 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:26.388 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.257929+0000", 2023-09-30T17:03:26.388 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0038787190000000001 2023-09-30T17:03:26.388 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.388 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.388 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:26.388 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.257945+0000", 2023-09-30T17:03:26.388 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5991e-05 2023-09-30T17:03:26.388 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.388 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.388 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:26.388 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.257952+0000", 2023-09-30T17:03:26.389 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6170000000000001e-06 2023-09-30T17:03:26.389 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.389 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.389 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:26.389 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.258009+0000", 2023-09-30T17:03:26.389 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6768999999999998e-05 2023-09-30T17:03:26.389 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.389 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.389 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:26.389 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.258111+0000", 2023-09-30T17:03:26.389 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000101739 2023-09-30T17:03:26.389 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.389 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.390 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:26.390 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.258215+0000", 2023-09-30T17:03:26.390 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010414 2023-09-30T17:03:26.390 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.390 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.390 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:26.390 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.264291+0000", 2023-09-30T17:03:26.390 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0060763789999999998 2023-09-30T17:03:26.390 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.390 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.390 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:26.390 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.270347+0000", 2023-09-30T17:03:26.391 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0060554149999999998 2023-09-30T17:03:26.391 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.391 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.391 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:26.391 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.270431+0000", 2023-09-30T17:03:26.391 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4285999999999999e-05 2023-09-30T17:03:26.391 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.391 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.391 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:26.391 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.270477+0000", 2023-09-30T17:03:26.391 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6249999999999999e-05 2023-09-30T17:03:26.391 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:26.392 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:26.392 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:26.392 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.392 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.392 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:25 4.2a 4:57147dc3:::100000001f8.00000011:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-09-30T17:03:26.392 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:25.347146+0000", 2023-09-30T17:03:26.392 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.95893789699999998, 2023-09-30T17:03:26.392 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0097041969999999995, 2023-09-30T17:03:26.392 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:26.392 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:26.392 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:26.392 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:26.393 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:26.393 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 25 2023-09-30T17:03:26.393 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.393 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:26.393 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.393 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:26.393 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.347146+0000", 2023-09-30T17:03:26.393 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:26.393 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.393 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.393 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:26.393 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.347146+0000", 2023-09-30T17:03:26.394 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:26.394 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.394 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.394 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:26.394 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.347149+0000", 2023-09-30T17:03:26.394 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.287e-06 2023-09-30T17:03:26.394 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.394 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.394 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:26.394 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.350767+0000", 2023-09-30T17:03:26.394 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0036178310000000002 2023-09-30T17:03:26.394 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.395 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.395 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:26.395 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.350783+0000", 2023-09-30T17:03:26.395 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6243999999999999e-05 2023-09-30T17:03:26.395 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.395 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.395 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:26.395 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.350791+0000", 2023-09-30T17:03:26.395 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7700000000000001e-06 2023-09-30T17:03:26.395 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.395 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.395 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:26.396 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.350869+0000", 2023-09-30T17:03:26.396 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7538000000000002e-05 2023-09-30T17:03:26.396 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.396 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.396 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:26.396 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.350977+0000", 2023-09-30T17:03:26.396 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000108353 2023-09-30T17:03:26.396 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.396 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.396 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:26.396 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.356762+0000", 2023-09-30T17:03:26.396 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0057848450000000003 2023-09-30T17:03:26.397 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.397 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.397 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:26.397 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.356798+0000", 2023-09-30T17:03:26.397 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6547000000000001e-05 2023-09-30T17:03:26.397 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.397 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.397 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:26.397 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.356850+0000", 2023-09-30T17:03:26.397 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1782e-05 2023-09-30T17:03:26.397 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:26.397 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:26.397 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:26.398 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.398 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.398 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:26 4.32 4:4f726a0c:::100000001f8.00000012:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-09-30T17:03:26.398 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:25.466331+0000", 2023-09-30T17:03:26.398 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.83975272599999995, 2023-09-30T17:03:26.398 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0098016849999999992, 2023-09-30T17:03:26.398 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:26.398 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:26.398 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:26.398 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:26.398 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:26.399 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 26 2023-09-30T17:03:26.399 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.399 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:26.399 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.399 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:26.399 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.466331+0000", 2023-09-30T17:03:26.399 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:26.399 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.399 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.399 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:26.399 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.466331+0000", 2023-09-30T17:03:26.399 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:26.400 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.400 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.400 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:26.400 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.466334+0000", 2023-09-30T17:03:26.400 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.2200000000000001e-06 2023-09-30T17:03:26.400 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.400 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.400 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:26.400 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.470006+0000", 2023-09-30T17:03:26.400 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0036712170000000001 2023-09-30T17:03:26.400 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.401 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.401 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:26.401 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.470021+0000", 2023-09-30T17:03:26.401 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5216e-05 2023-09-30T17:03:26.401 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.401 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.401 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:26.401 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.470030+0000", 2023-09-30T17:03:26.401 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.7080000000000003e-06 2023-09-30T17:03:26.401 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.401 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.401 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:26.401 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.470111+0000", 2023-09-30T17:03:26.402 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1390000000000005e-05 2023-09-30T17:03:26.402 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.402 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.402 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:26.402 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.470219+0000", 2023-09-30T17:03:26.402 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010765 2023-09-30T17:03:26.402 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.402 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.402 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:26.402 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.476035+0000", 2023-09-30T17:03:26.402 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0058167770000000004 2023-09-30T17:03:26.403 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.403 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.403 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:26.403 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.476073+0000", 2023-09-30T17:03:26.403 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.718e-05 2023-09-30T17:03:26.403 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.403 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.403 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:26.403 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.476133+0000", 2023-09-30T17:03:26.403 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0327e-05 2023-09-30T17:03:26.403 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:26.403 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:26.404 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:26.404 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.404 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.404 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:27 4.36 4:6fa85f86:::100000001f8.00000013:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-09-30T17:03:26.404 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:25.573750+0000", 2023-09-30T17:03:26.404 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.73233383100000005, 2023-09-30T17:03:26.404 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.014811728, 2023-09-30T17:03:26.404 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:26.404 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:26.404 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:26.404 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:26.404 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:26.405 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 27 2023-09-30T17:03:26.405 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.405 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:26.405 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.405 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:26.405 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.573750+0000", 2023-09-30T17:03:26.405 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:26.405 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.405 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.405 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:26.405 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.573750+0000", 2023-09-30T17:03:26.405 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:26.405 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.406 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.406 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:26.406 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.573753+0000", 2023-09-30T17:03:26.406 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.5399999999999998e-06 2023-09-30T17:03:26.406 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.406 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.406 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:26.406 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.577633+0000", 2023-09-30T17:03:26.406 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0038801030000000002 2023-09-30T17:03:26.406 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.406 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.406 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:26.407 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.577649+0000", 2023-09-30T17:03:26.407 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5897e-05 2023-09-30T17:03:26.407 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.407 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.407 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:26.407 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.577656+0000", 2023-09-30T17:03:26.407 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1640000000000004e-06 2023-09-30T17:03:26.407 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.407 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.407 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:26.407 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.577707+0000", 2023-09-30T17:03:26.407 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0930000000000002e-05 2023-09-30T17:03:26.407 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.408 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.408 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:26.408 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.577818+0000", 2023-09-30T17:03:26.408 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000111477 2023-09-30T17:03:26.408 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.408 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.408 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:26.408 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.577916+0000", 2023-09-30T17:03:26.408 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7281000000000006e-05 2023-09-30T17:03:26.408 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.408 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.408 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:26.409 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.583899+0000", 2023-09-30T17:03:26.409 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0059835829999999998 2023-09-30T17:03:26.409 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.409 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.409 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:26.409 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.588490+0000", 2023-09-30T17:03:26.409 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0045904819999999999 2023-09-30T17:03:26.409 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.409 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.409 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:26.409 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.588533+0000", 2023-09-30T17:03:26.409 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3231e-05 2023-09-30T17:03:26.410 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.410 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.410 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:26.410 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.588562+0000", 2023-09-30T17:03:26.410 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.904e-05 2023-09-30T17:03:26.410 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:26.410 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:26.410 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:26.410 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.410 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.410 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:29 4.12 e36/17 4:48ab9bde:::100000001f8.00000015:head v 36'4, mlcod=36'2)", 2023-09-30T17:03:26.410 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:25.772296+0000", 2023-09-30T17:03:26.411 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.53378800400000004, 2023-09-30T17:03:26.411 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.015379528999999999, 2023-09-30T17:03:26.411 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:26.411 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:26.411 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:26.411 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.411 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:26.411 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.772296+0000", 2023-09-30T17:03:26.411 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:26.411 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.411 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.411 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:26.412 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.772296+0000", 2023-09-30T17:03:26.412 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:26.412 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.412 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.412 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:26.412 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.772298+0000", 2023-09-30T17:03:26.412 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.0099999999999998e-06 2023-09-30T17:03:26.412 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.412 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.412 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:26.412 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.778708+0000", 2023-09-30T17:03:26.413 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0064101679999999999 2023-09-30T17:03:26.413 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.413 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.413 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:26.413 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.778726+0000", 2023-09-30T17:03:26.413 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7427000000000001e-05 2023-09-30T17:03:26.413 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.413 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.413 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:26.413 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.778734+0000", 2023-09-30T17:03:26.413 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5019999999999992e-06 2023-09-30T17:03:26.413 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.414 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.414 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:26.414 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.778807+0000", 2023-09-30T17:03:26.414 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2556000000000001e-05 2023-09-30T17:03:26.414 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.414 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.414 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:26.414 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.778830+0000", 2023-09-30T17:03:26.414 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.3434e-05 2023-09-30T17:03:26.414 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.414 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.415 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:26.415 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.787611+0000", 2023-09-30T17:03:26.415 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0087809919999999996 2023-09-30T17:03:26.415 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.415 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.415 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:26.415 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.787675+0000", 2023-09-30T17:03:26.415 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.444e-05 2023-09-30T17:03:26.415 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:26.415 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:26.415 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:26.416 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.416 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.416 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:30 4.14 4:2b28d75f:::100000001f8.00000016:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-09-30T17:03:26.416 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:25.858076+0000", 2023-09-30T17:03:26.416 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.44800773399999999, 2023-09-30T17:03:26.416 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.014984442000000001, 2023-09-30T17:03:26.416 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:26.416 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:26.416 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:26.416 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:26.416 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:26.416 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 30 2023-09-30T17:03:26.417 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.417 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:26.417 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.417 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:26.417 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.858076+0000", 2023-09-30T17:03:26.417 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:26.417 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.417 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.417 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:26.417 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.858076+0000", 2023-09-30T17:03:26.417 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:26.417 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.417 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.418 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:26.418 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.858080+0000", 2023-09-30T17:03:26.418 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7170000000000002e-06 2023-09-30T17:03:26.418 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.418 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.418 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:26.418 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.862044+0000", 2023-09-30T17:03:26.418 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0039641549999999996 2023-09-30T17:03:26.418 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.418 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.418 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:26.418 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.862064+0000", 2023-09-30T17:03:26.419 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9479000000000001e-05 2023-09-30T17:03:26.419 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.419 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.419 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:26.419 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.862073+0000", 2023-09-30T17:03:26.419 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.6209999999999999e-06 2023-09-30T17:03:26.419 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.419 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.419 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:26.419 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.862187+0000", 2023-09-30T17:03:26.419 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000113365 2023-09-30T17:03:26.419 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.420 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.420 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:26.420 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.862314+0000", 2023-09-30T17:03:26.420 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00012777200000000001 2023-09-30T17:03:26.420 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.420 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.420 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:26.420 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.862428+0000", 2023-09-30T17:03:26.420 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000113569 2023-09-30T17:03:26.420 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.420 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.420 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:26.421 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.868349+0000", 2023-09-30T17:03:26.421 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0059214439999999997 2023-09-30T17:03:26.421 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.421 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.421 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:26.421 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.872988+0000", 2023-09-30T17:03:26.421 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0046389509999999997 2023-09-30T17:03:26.421 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.421 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.421 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:26.421 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.873031+0000", 2023-09-30T17:03:26.422 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2852000000000002e-05 2023-09-30T17:03:26.422 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.422 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.422 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:26.422 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.873061+0000", 2023-09-30T17:03:26.422 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.9516999999999999e-05 2023-09-30T17:03:26.422 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:26.422 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:26.422 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:26.422 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.422 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.423 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:32 4.27 4:e68799fb:::100000001f8.00000018:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-09-30T17:03:26.423 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:26.043279+0000", 2023-09-30T17:03:26.423 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.26280532000000001, 2023-09-30T17:03:26.423 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.013503962, 2023-09-30T17:03:26.423 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:26.423 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:26.423 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:26.423 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:26.423 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:26.423 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 32 2023-09-30T17:03:26.423 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.423 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:26.424 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.424 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:26.424 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.043279+0000", 2023-09-30T17:03:26.424 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:26.424 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.424 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.424 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:26.424 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.043279+0000", 2023-09-30T17:03:26.424 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:26.424 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.424 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.424 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:26.425 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.043281+0000", 2023-09-30T17:03:26.425 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.368e-06 2023-09-30T17:03:26.425 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.425 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.425 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:26.425 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.047152+0000", 2023-09-30T17:03:26.425 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0038711549999999998 2023-09-30T17:03:26.425 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.425 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.425 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:26.425 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.047180+0000", 2023-09-30T17:03:26.426 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.8289e-05 2023-09-30T17:03:26.426 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.426 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.426 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:26.426 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.047192+0000", 2023-09-30T17:03:26.426 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.206e-05 2023-09-30T17:03:26.426 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.426 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.426 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:26.426 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.047257+0000", 2023-09-30T17:03:26.426 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4598999999999996e-05 2023-09-30T17:03:26.427 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.427 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.427 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:26.427 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.047362+0000", 2023-09-30T17:03:26.427 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000104862 2023-09-30T17:03:26.427 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.427 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.427 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:26.427 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.056674+0000", 2023-09-30T17:03:26.427 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0093115539999999997 2023-09-30T17:03:26.427 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.427 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.428 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:26.428 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.056733+0000", 2023-09-30T17:03:26.428 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9447000000000002e-05 2023-09-30T17:03:26.428 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.428 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.428 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:26.428 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.056783+0000", 2023-09-30T17:03:26.428 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9628e-05 2023-09-30T17:03:26.428 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:26.428 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:26.428 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:26.428 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.428 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.429 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:33 4.f e36/17 4:f2a80dfe:::100000001f8.00000019:head v 36'2, mlcod=0'0)", 2023-09-30T17:03:26.429 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:26.134788+0000", 2023-09-30T17:03:26.429 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.171295744, 2023-09-30T17:03:26.429 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0092503069999999993, 2023-09-30T17:03:26.429 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:26.429 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:26.429 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:26.429 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.429 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:26.429 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.134788+0000", 2023-09-30T17:03:26.429 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:26.429 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.430 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.430 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:26.430 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.134788+0000", 2023-09-30T17:03:26.430 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:26.430 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.430 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.430 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:26.430 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.134790+0000", 2023-09-30T17:03:26.430 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6789999999999999e-06 2023-09-30T17:03:26.430 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.430 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.431 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:26.431 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.138682+0000", 2023-09-30T17:03:26.431 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0038923730000000002 2023-09-30T17:03:26.431 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.431 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.431 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:26.431 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.138704+0000", 2023-09-30T17:03:26.431 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1437000000000002e-05 2023-09-30T17:03:26.431 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.431 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.431 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:26.432 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.138720+0000", 2023-09-30T17:03:26.432 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6293000000000001e-05 2023-09-30T17:03:26.432 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.432 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.432 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:26.432 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.138807+0000", 2023-09-30T17:03:26.432 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.6712999999999995e-05 2023-09-30T17:03:26.432 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.432 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.432 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:26.432 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.138828+0000", 2023-09-30T17:03:26.432 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1480000000000001e-05 2023-09-30T17:03:26.433 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.433 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.433 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:26.433 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.143991+0000", 2023-09-30T17:03:26.433 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051625450000000002 2023-09-30T17:03:26.433 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.433 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.433 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:26.433 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.144039+0000", 2023-09-30T17:03:26.433 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7787000000000002e-05 2023-09-30T17:03:26.433 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:26.433 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:26.433 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:26.434 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.434 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.434 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:34 4.3b 4:dcc0c15f:::100000001f8.0000001a:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-09-30T17:03:26.434 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:26.217323+0000", 2023-09-30T17:03:26.434 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.088761213000000005, 2023-09-30T17:03:26.434 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.015860697, 2023-09-30T17:03:26.434 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:26.434 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:26.434 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:26.434 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:26.434 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:26.434 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 34 2023-09-30T17:03:26.435 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.435 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:26.435 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.435 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:26.435 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.217323+0000", 2023-09-30T17:03:26.435 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:26.435 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.435 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.435 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:26.435 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.217323+0000", 2023-09-30T17:03:26.435 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:26.436 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.436 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.436 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:26.436 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.217325+0000", 2023-09-30T17:03:26.436 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.244e-06 2023-09-30T17:03:26.436 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.436 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.436 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:26.436 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.221135+0000", 2023-09-30T17:03:26.436 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0038104480000000001 2023-09-30T17:03:26.436 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.437 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.437 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:26.437 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.221171+0000", 2023-09-30T17:03:26.437 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5302000000000002e-05 2023-09-30T17:03:26.437 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.437 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.437 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:26.437 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.221183+0000", 2023-09-30T17:03:26.437 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2670999999999999e-05 2023-09-30T17:03:26.437 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.437 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.438 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:26.438 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.221251+0000", 2023-09-30T17:03:26.438 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7229000000000003e-05 2023-09-30T17:03:26.438 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.438 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.438 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:26.438 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.221361+0000", 2023-09-30T17:03:26.438 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000110806 2023-09-30T17:03:26.438 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.438 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.438 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:26.439 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.221460+0000", 2023-09-30T17:03:26.439 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8326999999999996e-05 2023-09-30T17:03:26.439 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.439 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.439 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:26.439 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.227385+0000", 2023-09-30T17:03:26.439 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0059254620000000003 2023-09-30T17:03:26.439 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.439 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.439 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:26.439 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.233109+0000", 2023-09-30T17:03:26.439 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0057238480000000001 2023-09-30T17:03:26.440 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.440 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.440 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:26.440 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.233148+0000", 2023-09-30T17:03:26.440 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8701000000000001e-05 2023-09-30T17:03:26.440 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:26.440 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:26.440 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:26.440 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.233183+0000", 2023-09-30T17:03:26.440 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5658999999999999e-05 2023-09-30T17:03:26.440 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:26.440 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:26.441 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:26.441 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:26.441 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:26.441 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:26.443 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is set 2023-09-30T17:03:26.443 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:03:26.444 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:26.442+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:26.543 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:26.543+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:26.574 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:26.574 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:03:26.575 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2023-09-30T17:03:26.575 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:26.584 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:03:26.644 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:26.644+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:26.745 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:26.745+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:26.755 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:26.755 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:03:26.755 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2023-09-30T17:03:26.755 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2023-09-30T17:03:26.755 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:26.765 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:03:26.846 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:26.845+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:26.933 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:26.933 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2023-09-30T17:03:26.933 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2023-09-30T17:03:26.934 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2023-09-30T17:03:26.934 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.934 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:26.934 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:03:26.934 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 68.579508180999994, 2023-09-30T17:03:26.934 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021233007000000002, 2023-09-30T17:03:26.934 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:26.935 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:26.935 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:26.935 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.935 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:26.935 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:03:26.935 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:26.935 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.936 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.936 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:26.936 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:03:26.936 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:26.936 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.936 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.936 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:26.936 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352110+0000", 2023-09-30T17:03:26.937 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6000000000000002e-07 2023-09-30T17:03:26.937 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.937 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.937 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:26.937 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352117+0000", 2023-09-30T17:03:26.937 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5930000000000002e-06 2023-09-30T17:03:26.937 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.938 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.938 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:26.938 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352126+0000", 2023-09-30T17:03:26.938 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0729999999999994e-06 2023-09-30T17:03:26.938 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.938 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.938 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:26.938 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352136+0000", 2023-09-30T17:03:26.938 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0380000000000001e-05 2023-09-30T17:03:26.938 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.939 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.939 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:26.939 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353279+0000", 2023-09-30T17:03:26.939 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0011424670000000001 2023-09-30T17:03:26.939 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.939 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.939 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:26.939 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353707+0000", 2023-09-30T17:03:26.939 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00042829800000000003 2023-09-30T17:03:26.939 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.939 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.939 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:26.940 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354104+0000", 2023-09-30T17:03:26.940 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00039643399999999998 2023-09-30T17:03:26.940 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.940 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.940 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:26.940 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356925+0000", 2023-09-30T17:03:26.940 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0028210900000000001 2023-09-30T17:03:26.940 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.940 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.940 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:26.940 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373243+0000", 2023-09-30T17:03:26.940 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016318461999999999 2023-09-30T17:03:26.941 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.941 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.941 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:26.941 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373301+0000", 2023-09-30T17:03:26.941 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7435000000000002e-05 2023-09-30T17:03:26.941 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.941 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.941 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:26.941 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373342+0000", 2023-09-30T17:03:26.942 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1915000000000001e-05 2023-09-30T17:03:26.942 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:26.942 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:26.942 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:26.942 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.942 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.942 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:24 3.7 3:e0b41d06:::609.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:26.942 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:03:26.942 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 68.579465569999996, 2023-09-30T17:03:26.942 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011988331, 2023-09-30T17:03:26.942 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:26.943 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:26.943 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:26.943 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.943 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:26.943 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:03:26.943 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:26.943 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.943 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.943 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:26.943 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352152+0000", 2023-09-30T17:03:26.943 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:26.943 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.944 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.944 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:26.944 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352153+0000", 2023-09-30T17:03:26.944 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0500000000000003e-07 2023-09-30T17:03:26.944 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.944 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.944 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:26.944 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352157+0000", 2023-09-30T17:03:26.944 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9790000000000004e-06 2023-09-30T17:03:26.944 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.944 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.945 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:26.945 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352173+0000", 2023-09-30T17:03:26.945 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6535999999999999e-05 2023-09-30T17:03:26.945 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.945 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.945 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:26.945 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352180+0000", 2023-09-30T17:03:26.945 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7700000000000004e-06 2023-09-30T17:03:26.945 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.945 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.945 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:26.945 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353526+0000", 2023-09-30T17:03:26.946 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0013458330000000001 2023-09-30T17:03:26.946 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.946 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.946 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:26.946 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353648+0000", 2023-09-30T17:03:26.946 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012262899999999999 2023-09-30T17:03:26.946 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.946 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.946 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:26.946 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354141+0000", 2023-09-30T17:03:26.946 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00049222899999999995 2023-09-30T17:03:26.947 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.947 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.947 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:26.947 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356931+0000", 2023-09-30T17:03:26.947 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0027900860000000002 2023-09-30T17:03:26.947 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.947 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.947 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:26.947 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364066+0000", 2023-09-30T17:03:26.947 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071355050000000003 2023-09-30T17:03:26.947 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.947 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.948 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:26.948 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364103+0000", 2023-09-30T17:03:26.948 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6944999999999999e-05 2023-09-30T17:03:26.948 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.948 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.948 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:26.948 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364140+0000", 2023-09-30T17:03:26.948 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7214e-05 2023-09-30T17:03:26.948 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:26.948 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:26.948 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:26.948 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.949 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.949 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:30 3.7 3:e0b41d06:::609.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:26.949 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:03:26.949 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 68.579426338999994, 2023-09-30T17:03:26.949 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012110921, 2023-09-30T17:03:26.949 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:26.949 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:26.949 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:26.949 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.949 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:26.949 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:03:26.949 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:26.950 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.950 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.950 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:26.950 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352191+0000", 2023-09-30T17:03:26.950 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:26.950 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.950 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.950 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:26.951 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352192+0000", 2023-09-30T17:03:26.951 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7300000000000005e-07 2023-09-30T17:03:26.951 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.951 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.951 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:26.951 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352196+0000", 2023-09-30T17:03:26.951 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2370000000000003e-06 2023-09-30T17:03:26.951 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.951 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.951 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:26.951 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352205+0000", 2023-09-30T17:03:26.952 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6659999999999997e-06 2023-09-30T17:03:26.952 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.952 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.952 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:26.952 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352214+0000", 2023-09-30T17:03:26.952 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8259999999999999e-06 2023-09-30T17:03:26.952 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.952 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.952 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:26.952 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354470+0000", 2023-09-30T17:03:26.952 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022557340000000001 2023-09-30T17:03:26.952 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.953 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.953 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:26.953 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354557+0000", 2023-09-30T17:03:26.953 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6909000000000004e-05 2023-09-30T17:03:26.953 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.953 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.953 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:26.953 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354694+0000", 2023-09-30T17:03:26.953 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013774800000000001 2023-09-30T17:03:26.953 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.953 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.953 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:26.954 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356937+0000", 2023-09-30T17:03:26.954 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022424540000000001 2023-09-30T17:03:26.954 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.954 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.954 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:26.954 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364227+0000", 2023-09-30T17:03:26.954 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072902430000000001 2023-09-30T17:03:26.954 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.954 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.954 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:26.954 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364278+0000", 2023-09-30T17:03:26.955 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1180999999999997e-05 2023-09-30T17:03:26.955 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.955 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.955 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:26.955 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.364302+0000", 2023-09-30T17:03:26.955 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4049999999999998e-05 2023-09-30T17:03:26.955 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:26.955 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:26.955 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:26.955 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.955 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.955 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:26.956 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:26.956 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 68.579392999999996, 2023-09-30T17:03:26.956 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021258651999999999, 2023-09-30T17:03:26.956 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:26.956 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:26.956 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:26.956 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.956 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:26.956 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:26.956 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:26.956 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.957 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.957 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:26.957 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:26.957 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:26.957 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.957 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.957 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:26.957 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:26.957 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6899999999999997e-07 2023-09-30T17:03:26.957 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.957 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.957 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:26.958 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352236+0000", 2023-09-30T17:03:26.958 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0251000000000001e-05 2023-09-30T17:03:26.958 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.958 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.958 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:26.958 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352244+0000", 2023-09-30T17:03:26.958 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0770000000000008e-06 2023-09-30T17:03:26.958 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.958 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.958 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:26.958 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352251+0000", 2023-09-30T17:03:26.958 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4749999999999996e-06 2023-09-30T17:03:26.959 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.959 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.959 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:26.959 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354455+0000", 2023-09-30T17:03:26.959 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022043660000000001 2023-09-30T17:03:26.959 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.959 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.959 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:26.959 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354577+0000", 2023-09-30T17:03:26.959 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000121054 2023-09-30T17:03:26.959 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.960 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.960 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:26.960 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354723+0000", 2023-09-30T17:03:26.960 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014693900000000001 2023-09-30T17:03:26.960 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.960 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.960 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:26.960 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356941+0000", 2023-09-30T17:03:26.960 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002217199 2023-09-30T17:03:26.960 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.960 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.960 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:26.961 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373392+0000", 2023-09-30T17:03:26.961 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016451774999999998 2023-09-30T17:03:26.961 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.961 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.961 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:26.961 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373445+0000", 2023-09-30T17:03:26.961 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.308e-05 2023-09-30T17:03:26.961 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.961 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.961 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:26.961 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373483+0000", 2023-09-30T17:03:26.961 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7766999999999999e-05 2023-09-30T17:03:26.962 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:26.962 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:26.962 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:26.962 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.962 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.962 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:26.962 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:26.962 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 68.579356908999998, 2023-09-30T17:03:26.962 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020903497, 2023-09-30T17:03:26.962 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:26.962 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:26.962 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:26.963 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.963 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:26.963 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:26.963 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:26.963 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.963 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.963 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:26.963 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:26.963 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:26.963 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.963 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.964 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:26.964 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:26.964 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0800000000000004e-07 2023-09-30T17:03:26.964 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.964 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.964 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:26.964 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352266+0000", 2023-09-30T17:03:26.964 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1280000000000001e-06 2023-09-30T17:03:26.964 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.964 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.964 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:26.964 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352273+0000", 2023-09-30T17:03:26.964 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3730000000000004e-06 2023-09-30T17:03:26.965 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.965 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.965 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:26.965 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352279+0000", 2023-09-30T17:03:26.965 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7699999999999998e-06 2023-09-30T17:03:26.965 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.965 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.965 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:26.965 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352334+0000", 2023-09-30T17:03:26.965 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5547999999999997e-05 2023-09-30T17:03:26.965 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.965 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.966 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:26.966 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352435+0000", 2023-09-30T17:03:26.966 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100688 2023-09-30T17:03:26.966 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.966 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.966 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:26.966 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352585+0000", 2023-09-30T17:03:26.966 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000150068 2023-09-30T17:03:26.966 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.966 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.966 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:26.967 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354912+0000", 2023-09-30T17:03:26.967 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0023266770000000001 2023-09-30T17:03:26.967 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.967 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.967 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:26.967 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373066+0000", 2023-09-30T17:03:26.967 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018154474 2023-09-30T17:03:26.967 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.967 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.967 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:26.967 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373122+0000", 2023-09-30T17:03:26.967 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6193000000000002e-05 2023-09-30T17:03:26.968 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.968 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.968 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:26.968 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373164+0000", 2023-09-30T17:03:26.968 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1869999999999997e-05 2023-09-30T17:03:26.968 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:26.968 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:26.968 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:26.968 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.968 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.968 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:26.969 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:03:26.969 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 68.579321233000002, 2023-09-30T17:03:26.969 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021015097999999999, 2023-09-30T17:03:26.969 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:26.969 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:26.969 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:26.969 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.969 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:26.969 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:03:26.969 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:26.969 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.969 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.970 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:26.970 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:03:26.970 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:26.970 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.970 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.970 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:26.970 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352297+0000", 2023-09-30T17:03:26.970 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8299999999999997e-07 2023-09-30T17:03:26.970 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.970 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.970 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:26.971 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352300+0000", 2023-09-30T17:03:26.971 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7460000000000001e-06 2023-09-30T17:03:26.971 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.971 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.971 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:26.971 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352307+0000", 2023-09-30T17:03:26.971 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4959999999999999e-06 2023-09-30T17:03:26.973 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.973 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.973 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:26.973 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352314+0000", 2023-09-30T17:03:26.973 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0190000000000001e-06 2023-09-30T17:03:26.973 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.973 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.973 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:26.973 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354070+0000", 2023-09-30T17:03:26.974 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001755936 2023-09-30T17:03:26.974 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.974 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.974 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:26.974 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354221+0000", 2023-09-30T17:03:26.974 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000150884 2023-09-30T17:03:26.974 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.974 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.974 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:26.974 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373311+0000", 2023-09-30T17:03:26.974 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019090434 2023-09-30T17:03:26.975 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:26.975 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:26.975 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:26.975 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.975 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.975 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:26.975 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:03:26.975 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 68.579292514000002, 2023-09-30T17:03:26.975 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021255174000000002, 2023-09-30T17:03:26.975 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:26.975 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:26.975 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:26.976 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.976 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:26.976 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:03:26.976 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:26.976 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.976 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.976 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:26.976 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:03:26.976 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:26.976 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.976 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.977 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:26.977 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352326+0000", 2023-09-30T17:03:26.977 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3200000000000005e-07 2023-09-30T17:03:26.977 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.977 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.977 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:26.977 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352349+0000", 2023-09-30T17:03:26.977 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3183000000000001e-05 2023-09-30T17:03:26.977 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.977 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.977 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:26.977 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352358+0000", 2023-09-30T17:03:26.978 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5230000000000001e-06 2023-09-30T17:03:26.978 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.978 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.978 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:26.978 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352365+0000", 2023-09-30T17:03:26.978 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3260000000000001e-06 2023-09-30T17:03:26.978 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.978 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.978 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:26.978 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355450+0000", 2023-09-30T17:03:26.979 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0030854049999999998 2023-09-30T17:03:26.979 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.979 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.979 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:26.979 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355583+0000", 2023-09-30T17:03:26.979 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000133189 2023-09-30T17:03:26.979 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.979 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.979 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:26.979 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373580+0000", 2023-09-30T17:03:26.979 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017997016000000001 2023-09-30T17:03:26.979 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:26.980 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:26.980 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:26.980 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.980 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.980 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:37 3.1e 3:7bf7e7b5:::200.00000006:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:26.980 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:03:26.980 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 68.579241091, 2023-09-30T17:03:26.980 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010380537, 2023-09-30T17:03:26.980 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:26.980 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:26.981 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:26.981 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.981 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:26.981 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:03:26.981 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:26.981 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.981 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.981 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:26.981 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:03:26.981 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:26.981 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.981 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.982 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:26.982 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352377+0000", 2023-09-30T17:03:26.982 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1500000000000003e-07 2023-09-30T17:03:26.982 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.982 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.982 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:26.982 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352381+0000", 2023-09-30T17:03:26.982 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6330000000000002e-06 2023-09-30T17:03:26.982 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.982 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.982 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:26.983 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352388+0000", 2023-09-30T17:03:26.983 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7229999999999998e-06 2023-09-30T17:03:26.983 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.983 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.983 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:26.983 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352394+0000", 2023-09-30T17:03:26.983 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1789999999999996e-06 2023-09-30T17:03:26.983 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.983 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.983 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:26.983 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353259+0000", 2023-09-30T17:03:26.983 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000865221 2023-09-30T17:03:26.983 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.984 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.984 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:26.984 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353391+0000", 2023-09-30T17:03:26.984 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013217700000000001 2023-09-30T17:03:26.984 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.984 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.984 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:26.984 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.362757+0000", 2023-09-30T17:03:26.984 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093657889999999994 2023-09-30T17:03:26.984 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:26.984 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:26.984 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:26.984 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.985 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.985 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:22 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-09-30T17:03:26.985 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:25.074944+0000", 2023-09-30T17:03:26.985 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 1.856673622, 2023-09-30T17:03:26.985 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017740700000000002, 2023-09-30T17:03:26.985 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:26.985 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:26.985 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:26.985 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:26.985 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:26.985 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 22 2023-09-30T17:03:26.985 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.986 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:26.986 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.986 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:26.986 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.074944+0000", 2023-09-30T17:03:26.986 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:26.986 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.986 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.986 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:26.986 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.074944+0000", 2023-09-30T17:03:26.986 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:26.987 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.987 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.987 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:26.987 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.074945+0000", 2023-09-30T17:03:26.987 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0890000000000001e-06 2023-09-30T17:03:26.987 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.987 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.987 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:26.987 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.078709+0000", 2023-09-30T17:03:26.987 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0037635339999999998 2023-09-30T17:03:26.987 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.987 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.988 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:26.988 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.078723+0000", 2023-09-30T17:03:26.988 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4562000000000001e-05 2023-09-30T17:03:26.988 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.988 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:26.988 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.078738+0000", 2023-09-30T17:03:26.988 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5065000000000001e-05 2023-09-30T17:03:26.988 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.989 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:26.989 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.078794+0000", 2023-09-30T17:03:26.989 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5642e-05 2023-09-30T17:03:26.989 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.989 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.989 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:26.989 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.078893+0000", 2023-09-30T17:03:26.989 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8863000000000005e-05 2023-09-30T17:03:26.989 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.989 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.989 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:26.990 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.078998+0000", 2023-09-30T17:03:26.990 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000105153 2023-09-30T17:03:26.990 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.990 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.990 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:26.990 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.084862+0000", 2023-09-30T17:03:26.990 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0058643300000000001 2023-09-30T17:03:26.990 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.990 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.990 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:26.991 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.092503+0000", 2023-09-30T17:03:26.991 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0076404589999999996 2023-09-30T17:03:26.991 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.991 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.991 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:26.991 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.092619+0000", 2023-09-30T17:03:26.991 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011675699999999999 2023-09-30T17:03:26.991 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.991 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.991 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:26.991 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.092685+0000", 2023-09-30T17:03:26.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5246000000000005e-05 2023-09-30T17:03:26.992 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:26.992 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:26.992 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:26.992 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.992 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:24 4.36 e36/17 4:6c9c34b1:::100000001f8.00000010:head v 36'2, mlcod=0'0)", 2023-09-30T17:03:26.992 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:25.258418+0000", 2023-09-30T17:03:26.992 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 1.67319956, 2023-09-30T17:03:26.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.01152803, 2023-09-30T17:03:26.992 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:26.992 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:26.993 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:26.993 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.993 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:26.993 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.258418+0000", 2023-09-30T17:03:26.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:26.993 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.993 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.993 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:26.993 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.258418+0000", 2023-09-30T17:03:26.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:26.993 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.994 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.994 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:26.994 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.258419+0000", 2023-09-30T17:03:26.994 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6599999999999996e-07 2023-09-30T17:03:26.994 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.994 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.994 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:26.994 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.262535+0000", 2023-09-30T17:03:26.994 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041165100000000003 2023-09-30T17:03:26.994 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.994 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.994 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:26.995 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.262549+0000", 2023-09-30T17:03:26.995 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4219999999999999e-05 2023-09-30T17:03:26.995 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.995 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.995 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:26.995 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.262558+0000", 2023-09-30T17:03:26.995 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6899999999999998e-06 2023-09-30T17:03:26.995 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.995 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.995 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:26.995 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.262631+0000", 2023-09-30T17:03:26.996 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3071000000000006e-05 2023-09-30T17:03:26.996 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.996 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:26.996 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.262650+0000", 2023-09-30T17:03:26.996 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8467000000000001e-05 2023-09-30T17:03:26.996 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.996 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:26.996 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.269897+0000", 2023-09-30T17:03:26.996 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072468369999999999 2023-09-30T17:03:26.996 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.997 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:26.997 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.269946+0000", 2023-09-30T17:03:26.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9568999999999999e-05 2023-09-30T17:03:26.997 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:26.997 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:26.997 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:26.997 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.997 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:27 4.36 e36/17 4:6fa85f86:::100000001f8.00000013:head v 36'3, mlcod=36'1)", 2023-09-30T17:03:26.997 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:25.578023+0000", 2023-09-30T17:03:26.997 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 1.3535942329999999, 2023-09-30T17:03:26.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010238067999999999, 2023-09-30T17:03:26.998 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:26.998 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:26.998 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:26.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.998 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:26.998 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.578023+0000", 2023-09-30T17:03:26.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:26.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.998 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:26.999 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.578023+0000", 2023-09-30T17:03:26.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:26.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.999 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:26.999 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.578025+0000", 2023-09-30T17:03:26.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3629999999999999e-06 2023-09-30T17:03:26.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:26.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:26.999 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:26.999 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.581888+0000", 2023-09-30T17:03:26.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003863586 2023-09-30T17:03:27.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.000 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:27.000 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.581910+0000", 2023-09-30T17:03:27.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2137000000000002e-05 2023-09-30T17:03:27.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.000 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:27.000 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.581923+0000", 2023-09-30T17:03:27.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2787e-05 2023-09-30T17:03:27.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.001 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:27.001 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.581990+0000", 2023-09-30T17:03:27.001 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6550999999999994e-05 2023-09-30T17:03:27.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.001 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:27.001 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.582011+0000", 2023-09-30T17:03:27.001 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1019999999999999e-05 2023-09-30T17:03:27.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.001 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:27.001 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.588214+0000", 2023-09-30T17:03:27.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0062026989999999999 2023-09-30T17:03:27.002 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.002 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:27.002 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.588261+0000", 2023-09-30T17:03:27.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7924999999999999e-05 2023-09-30T17:03:27.002 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:27.002 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:27.002 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:27.002 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.003 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:28 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-09-30T17:03:27.003 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:25.675225+0000", 2023-09-30T17:03:27.003 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 1.256393088, 2023-09-30T17:03:27.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010307914, 2023-09-30T17:03:27.003 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:27.003 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:27.003 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:27.003 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:27.003 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:27.003 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 28 2023-09-30T17:03:27.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.003 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:27.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:27.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.675225+0000", 2023-09-30T17:03:27.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:27.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:27.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.675225+0000", 2023-09-30T17:03:27.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:27.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:27.005 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.675226+0000", 2023-09-30T17:03:27.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7940000000000001e-06 2023-09-30T17:03:27.005 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.005 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:27.005 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.679192+0000", 2023-09-30T17:03:27.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039661640000000003 2023-09-30T17:03:27.005 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.005 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:27.005 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.679217+0000", 2023-09-30T17:03:27.006 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4253999999999999e-05 2023-09-30T17:03:27.006 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.006 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:27.006 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.679231+0000", 2023-09-30T17:03:27.006 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.384e-05 2023-09-30T17:03:27.006 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.006 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:27.006 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.679299+0000", 2023-09-30T17:03:27.006 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8232999999999995e-05 2023-09-30T17:03:27.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.007 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:27.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.679416+0000", 2023-09-30T17:03:27.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000117207 2023-09-30T17:03:27.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.007 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:27.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.685360+0000", 2023-09-30T17:03:27.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059437780000000003 2023-09-30T17:03:27.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.008 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:27.008 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.685438+0000", 2023-09-30T17:03:27.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8029999999999997e-05 2023-09-30T17:03:27.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.008 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:27.008 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.685532+0000", 2023-09-30T17:03:27.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4613999999999999e-05 2023-09-30T17:03:27.008 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:27.008 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:27.008 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:27.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.009 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:29 4.12 4:48ab9bde:::100000001f8.00000015:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-09-30T17:03:27.009 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:25.767986+0000", 2023-09-30T17:03:27.009 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 1.163631753, 2023-09-30T17:03:27.009 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020236621999999999, 2023-09-30T17:03:27.009 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:27.009 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:27.009 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:27.009 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:27.009 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:27.009 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 29 2023-09-30T17:03:27.009 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.010 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:27.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.010 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:27.010 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.767986+0000", 2023-09-30T17:03:27.010 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:27.010 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.010 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:27.010 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.767986+0000", 2023-09-30T17:03:27.010 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:27.010 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:27.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.767988+0000", 2023-09-30T17:03:27.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.193e-06 2023-09-30T17:03:27.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:27.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.771721+0000", 2023-09-30T17:03:27.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0037333790000000002 2023-09-30T17:03:27.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:27.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.771744+0000", 2023-09-30T17:03:27.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3053000000000001e-05 2023-09-30T17:03:27.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:27.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.771755+0000", 2023-09-30T17:03:27.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0135999999999999e-05 2023-09-30T17:03:27.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:27.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.771821+0000", 2023-09-30T17:03:27.013 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6524000000000002e-05 2023-09-30T17:03:27.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.013 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:27.013 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.771933+0000", 2023-09-30T17:03:27.013 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111558 2023-09-30T17:03:27.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.013 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:27.013 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.772045+0000", 2023-09-30T17:03:27.013 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000112019 2023-09-30T17:03:27.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.014 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.014 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:27.014 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.777763+0000", 2023-09-30T17:03:27.014 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057178209999999997 2023-09-30T17:03:27.014 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.014 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.014 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:27.014 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.787968+0000", 2023-09-30T17:03:27.014 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010205133 2023-09-30T17:03:27.014 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.014 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.014 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:27.015 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.788137+0000", 2023-09-30T17:03:27.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016922700000000001 2023-09-30T17:03:27.015 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:27.015 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.788222+0000", 2023-09-30T17:03:27.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5579000000000002e-05 2023-09-30T17:03:27.015 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:27.015 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:27.015 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:27.015 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.016 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:31 4.30 4:0c89e311:::100000001f8.00000017:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-09-30T17:03:27.016 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:25.955300+0000", 2023-09-30T17:03:27.016 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.97631749899999998, 2023-09-30T17:03:27.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010030809, 2023-09-30T17:03:27.016 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:27.016 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:27.016 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:27.016 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:27.016 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:27.016 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 31 2023-09-30T17:03:27.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.017 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:27.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:27.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.955300+0000", 2023-09-30T17:03:27.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:27.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:27.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.955300+0000", 2023-09-30T17:03:27.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:27.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.018 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:27.018 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.955303+0000", 2023-09-30T17:03:27.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6560000000000001e-06 2023-09-30T17:03:27.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.018 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:27.018 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.959244+0000", 2023-09-30T17:03:27.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039417239999999997 2023-09-30T17:03:27.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.019 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:27.019 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.959262+0000", 2023-09-30T17:03:27.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7753000000000001e-05 2023-09-30T17:03:27.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.019 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:27.019 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.959273+0000", 2023-09-30T17:03:27.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0501e-05 2023-09-30T17:03:27.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.019 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:27.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.959356+0000", 2023-09-30T17:03:27.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2855000000000005e-05 2023-09-30T17:03:27.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:27.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.959463+0000", 2023-09-30T17:03:27.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0001076 2023-09-30T17:03:27.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:27.021 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.965187+0000", 2023-09-30T17:03:27.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057236739999999998 2023-09-30T17:03:27.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.021 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:27.021 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.965241+0000", 2023-09-30T17:03:27.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4503999999999999e-05 2023-09-30T17:03:27.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.021 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:27.022 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.965331+0000", 2023-09-30T17:03:27.022 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9542000000000004e-05 2023-09-30T17:03:27.022 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:27.022 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:27.022 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:27.022 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.022 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.022 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:33 4.f 4:f2a80dfe:::100000001f8.00000019:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-09-30T17:03:27.022 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:26.130423+0000", 2023-09-30T17:03:27.022 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.80119427099999996, 2023-09-30T17:03:27.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014165723, 2023-09-30T17:03:27.023 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:27.023 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:27.023 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:27.023 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:27.023 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:27.023 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 33 2023-09-30T17:03:27.023 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.023 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:27.023 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.023 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:27.024 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.130423+0000", 2023-09-30T17:03:27.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:27.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.024 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:27.024 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.130423+0000", 2023-09-30T17:03:27.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:27.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.024 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:27.024 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.130426+0000", 2023-09-30T17:03:27.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7300000000000001e-06 2023-09-30T17:03:27.025 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.025 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.025 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:27.025 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.134275+0000", 2023-09-30T17:03:27.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038491570000000002 2023-09-30T17:03:27.025 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.025 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.025 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:27.025 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.134289+0000", 2023-09-30T17:03:27.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3842999999999999e-05 2023-09-30T17:03:27.025 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.026 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:27.026 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.134297+0000", 2023-09-30T17:03:27.026 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3990000000000004e-06 2023-09-30T17:03:27.026 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.026 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:27.026 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.134381+0000", 2023-09-30T17:03:27.026 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3776000000000006e-05 2023-09-30T17:03:27.026 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.027 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:27.027 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.134492+0000", 2023-09-30T17:03:27.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111084 2023-09-30T17:03:27.027 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.027 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:27.027 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.134600+0000", 2023-09-30T17:03:27.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000107209 2023-09-30T17:03:27.027 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.027 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:27.028 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.140283+0000", 2023-09-30T17:03:27.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056839000000000004 2023-09-30T17:03:27.028 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.028 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.028 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:27.028 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.144379+0000", 2023-09-30T17:03:27.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0040952159999999996 2023-09-30T17:03:27.028 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.028 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.028 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:27.028 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.144476+0000", 2023-09-30T17:03:27.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7658000000000006e-05 2023-09-30T17:03:27.029 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.029 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:27.029 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.144589+0000", 2023-09-30T17:03:27.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011275100000000001 2023-09-30T17:03:27.029 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:27.029 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:27.029 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:27.029 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.029 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:34 4.3b e36/17 4:dcc0c15f:::100000001f8.0000001a:head v 36'1, mlcod=0'0)", 2023-09-30T17:03:27.030 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:26.221672+0000", 2023-09-30T17:03:27.030 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.70994563600000005, 2023-09-30T17:03:27.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011255905, 2023-09-30T17:03:27.030 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:27.030 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:27.030 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:27.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.030 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:27.030 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.221672+0000", 2023-09-30T17:03:27.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:27.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:27.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.221672+0000", 2023-09-30T17:03:27.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:27.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:27.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.221674+0000", 2023-09-30T17:03:27.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5400000000000001e-06 2023-09-30T17:03:27.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:27.032 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.225522+0000", 2023-09-30T17:03:27.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038486560000000002 2023-09-30T17:03:27.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.032 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:27.032 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.225537+0000", 2023-09-30T17:03:27.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4501999999999999e-05 2023-09-30T17:03:27.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.032 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:27.032 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.225561+0000", 2023-09-30T17:03:27.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3850999999999999e-05 2023-09-30T17:03:27.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.033 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.033 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:27.033 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.225613+0000", 2023-09-30T17:03:27.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2318000000000003e-05 2023-09-30T17:03:27.033 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.033 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.033 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:27.033 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.225638+0000", 2023-09-30T17:03:27.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5103999999999999e-05 2023-09-30T17:03:27.033 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.033 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.033 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:27.034 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.232883+0000", 2023-09-30T17:03:27.034 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072450839999999997 2023-09-30T17:03:27.034 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.034 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:27.034 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.232928+0000", 2023-09-30T17:03:27.034 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4849999999999999e-05 2023-09-30T17:03:27.034 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:27.034 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:27.034 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:27.034 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.035 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.035 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:37 4.2d 4:b4aa06e9:::100000001f8.0000001d:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-09-30T17:03:27.035 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:26.500137+0000", 2023-09-30T17:03:27.035 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.43148055299999999, 2023-09-30T17:03:27.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.01450341, 2023-09-30T17:03:27.035 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:27.035 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:27.035 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:27.035 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:27.035 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:27.036 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 37 2023-09-30T17:03:27.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.036 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:27.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:27.036 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.500137+0000", 2023-09-30T17:03:27.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:27.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:27.036 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.500137+0000", 2023-09-30T17:03:27.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:27.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:27.037 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.500139+0000", 2023-09-30T17:03:27.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.086e-06 2023-09-30T17:03:27.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:27.037 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.503855+0000", 2023-09-30T17:03:27.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0037161820000000002 2023-09-30T17:03:27.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.038 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:27.038 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.503880+0000", 2023-09-30T17:03:27.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5106e-05 2023-09-30T17:03:27.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.038 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:27.038 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.503891+0000", 2023-09-30T17:03:27.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1063999999999999e-05 2023-09-30T17:03:27.039 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.039 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:27.039 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.503965+0000", 2023-09-30T17:03:27.039 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3980000000000007e-05 2023-09-30T17:03:27.039 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.039 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:27.039 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.504085+0000", 2023-09-30T17:03:27.039 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000119454 2023-09-30T17:03:27.039 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.040 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:27.040 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.504189+0000", 2023-09-30T17:03:27.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000104127 2023-09-30T17:03:27.040 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.040 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.040 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:27.040 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.510284+0000", 2023-09-30T17:03:27.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060949619999999998 2023-09-30T17:03:27.040 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.040 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.040 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:27.040 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.514567+0000", 2023-09-30T17:03:27.041 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042826549999999998 2023-09-30T17:03:27.041 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.041 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.041 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:27.041 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.514607+0000", 2023-09-30T17:03:27.041 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0145999999999998e-05 2023-09-30T17:03:27.041 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.041 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.041 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:27.041 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.514640+0000", 2023-09-30T17:03:27.041 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3648e-05 2023-09-30T17:03:27.041 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:27.042 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:27.042 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:27.042 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.042 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.042 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:38 4.6 e37/17 4:63e80496:::100000001f8.0000001e:head v 37'2, mlcod=0'0)", 2023-09-30T17:03:27.042 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:26.601615+0000", 2023-09-30T17:03:27.042 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.33000222000000001, 2023-09-30T17:03:27.042 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010122439, 2023-09-30T17:03:27.042 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:27.042 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:27.042 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:27.043 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.043 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:27.043 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.601615+0000", 2023-09-30T17:03:27.043 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:27.043 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.043 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.043 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:27.043 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.601615+0000", 2023-09-30T17:03:27.043 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:27.043 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.044 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.044 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:27.044 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.601617+0000", 2023-09-30T17:03:27.044 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.778e-06 2023-09-30T17:03:27.044 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.044 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.044 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:27.044 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.605333+0000", 2023-09-30T17:03:27.044 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0037155550000000002 2023-09-30T17:03:27.044 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.044 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.045 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:27.045 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.605355+0000", 2023-09-30T17:03:27.045 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2087e-05 2023-09-30T17:03:27.045 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.045 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.045 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:27.045 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.605382+0000", 2023-09-30T17:03:27.045 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7277999999999999e-05 2023-09-30T17:03:27.045 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.045 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.045 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:27.046 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.605447+0000", 2023-09-30T17:03:27.046 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4795000000000006e-05 2023-09-30T17:03:27.046 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.046 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.046 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:27.046 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.605473+0000", 2023-09-30T17:03:27.046 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5990999999999999e-05 2023-09-30T17:03:27.046 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.046 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.046 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:27.046 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.611683+0000", 2023-09-30T17:03:27.047 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0062104509999999996 2023-09-30T17:03:27.047 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.047 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.047 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:27.047 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.611738+0000", 2023-09-30T17:03:27.047 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4503999999999999e-05 2023-09-30T17:03:27.047 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:27.047 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:27.047 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:27.047 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.047 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.048 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:39 4.f 4:f0d983b2:::100000001f8.0000001f:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-09-30T17:03:27.048 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:26.693515+0000", 2023-09-30T17:03:27.048 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.23810284700000001, 2023-09-30T17:03:27.048 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.01438743, 2023-09-30T17:03:27.048 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:27.048 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:27.048 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:27.048 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:27.048 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:27.048 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 39 2023-09-30T17:03:27.049 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.049 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:27.049 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.049 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:27.049 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.693515+0000", 2023-09-30T17:03:27.049 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:27.049 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.049 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.049 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:27.049 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.693515+0000", 2023-09-30T17:03:27.049 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:27.049 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.050 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.050 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:27.050 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.693516+0000", 2023-09-30T17:03:27.050 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.702e-06 2023-09-30T17:03:27.050 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.050 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.050 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:27.050 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.697237+0000", 2023-09-30T17:03:27.050 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003720101 2023-09-30T17:03:27.050 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.050 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.051 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:27.051 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.697259+0000", 2023-09-30T17:03:27.051 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2047000000000001e-05 2023-09-30T17:03:27.051 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.051 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.051 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:27.051 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.697269+0000", 2023-09-30T17:03:27.051 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0318e-05 2023-09-30T17:03:27.051 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.051 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.051 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:27.051 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.697361+0000", 2023-09-30T17:03:27.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1601999999999995e-05 2023-09-30T17:03:27.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.052 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:27.052 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.697554+0000", 2023-09-30T17:03:27.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000193539 2023-09-30T17:03:27.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.052 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:27.052 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.697747+0000", 2023-09-30T17:03:27.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019315000000000001 2023-09-30T17:03:27.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.053 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.053 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:27.053 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.705564+0000", 2023-09-30T17:03:27.053 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0078170659999999993 2023-09-30T17:03:27.053 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.053 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.053 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:27.053 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.707827+0000", 2023-09-30T17:03:27.053 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022626259999999998 2023-09-30T17:03:27.053 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.053 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.053 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:27.054 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.707870+0000", 2023-09-30T17:03:27.054 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2688000000000002e-05 2023-09-30T17:03:27.054 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.054 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.054 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:27.054 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.707902+0000", 2023-09-30T17:03:27.054 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2591e-05 2023-09-30T17:03:27.054 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:27.054 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:27.054 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:27.054 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.055 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.055 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:40 4.37 4:ef395e89:::100000001f8.00000020:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-09-30T17:03:27.055 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:26.791231+0000", 2023-09-30T17:03:27.055 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.140386126, 2023-09-30T17:03:27.055 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014453594, 2023-09-30T17:03:27.055 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:27.055 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:27.055 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:27.055 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:27.055 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:27.055 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 40 2023-09-30T17:03:27.056 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.056 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:27.056 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.056 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:27.056 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.791231+0000", 2023-09-30T17:03:27.056 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:27.056 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.056 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.056 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:27.056 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.791231+0000", 2023-09-30T17:03:27.056 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:27.057 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.057 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.057 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:27.057 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.791234+0000", 2023-09-30T17:03:27.057 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0169999999999999e-06 2023-09-30T17:03:27.057 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.057 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.057 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:27.057 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.794933+0000", 2023-09-30T17:03:27.057 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00369952 2023-09-30T17:03:27.057 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.057 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.058 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:27.058 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.794953+0000", 2023-09-30T17:03:27.058 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9748000000000001e-05 2023-09-30T17:03:27.058 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.058 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.058 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:27.058 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.794982+0000", 2023-09-30T17:03:27.058 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9237000000000001e-05 2023-09-30T17:03:27.058 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.058 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.058 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:27.059 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.795053+0000", 2023-09-30T17:03:27.059 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1060000000000001e-05 2023-09-30T17:03:27.059 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.059 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.059 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:27.059 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.795165+0000", 2023-09-30T17:03:27.059 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000112351 2023-09-30T17:03:27.059 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.059 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.059 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:27.059 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.795268+0000", 2023-09-30T17:03:27.060 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010299899999999999 2023-09-30T17:03:27.060 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.060 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.060 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:27.060 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.801561+0000", 2023-09-30T17:03:27.060 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0062930080000000001 2023-09-30T17:03:27.060 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.060 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.060 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:27.060 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.805616+0000", 2023-09-30T17:03:27.060 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0040545599999999996 2023-09-30T17:03:27.060 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.061 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.061 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:27.061 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.805654+0000", 2023-09-30T17:03:27.061 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8498999999999999e-05 2023-09-30T17:03:27.061 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:27.061 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:27.061 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:27.061 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.805685+0000", 2023-09-30T17:03:27.061 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0595000000000001e-05 2023-09-30T17:03:27.061 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:27.061 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:27.061 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:27.062 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:27.062 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:27.062 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:27.062 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-09-30T17:03:27.064 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:27.063+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:27.064 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:03:27.164 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:27.164+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:27.204 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:27.204 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:03:27.204 INFO:teuthology.orchestra.run.smithi031.stdout: "num_ops": 0 2023-09-30T17:03:27.204 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:27.215 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:03:27.219 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:03:27.241 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:03:27.241 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-09-30T17:03:27.241 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-09-30T17:03:27.241 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:03:27.244 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:03:27.245 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:03:27.264 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:27.265+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:27.365 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:27.366+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:27.390 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:27.390 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:27.401 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:03:27.466 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:27.467+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:27.532 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:27.532 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:27.543 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:03:27.567 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:27.567+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:27.668 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:27.668+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:27.676 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:27.676 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:27.686 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:03:27.769 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:27.769+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:27.814 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:27.814 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:27.823 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:03:27.908 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:27.908+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:27.971 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:27.970+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:27.993 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:27.993 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:28.001 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:03:28.072 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:28.072+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:28.135 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:28.135 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:28.145 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:03:28.173 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:28.174+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:28.274 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:28.274+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:28.318 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:28.318 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:28.329 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:03:28.412 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:28.412+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:28.444 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-09-30T17:03:28.475 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:28.475+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:28.502 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:28.502 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:28.512 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:03:28.542 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~41s 2023-09-30T17:03:28.577 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:28.577+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:28.645 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:28.645 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:28.656 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:03:28.677 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:28.677+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:28.777 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:28.778+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:28.784 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:28.784 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:28.794 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:03:28.879 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:28.879+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:28.961 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:28.961 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:28.971 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:03:29.015 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:29.014+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:29.081 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:29.081+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:29.109 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:29.109 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:29.121 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:03:29.182 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:29.182+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:29.245 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-09-30T17:03:29.283 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:29.282+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:29.294 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:29.294 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:29.304 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:03:29.349 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is set 2023-09-30T17:03:29.384 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:29.384+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:29.406 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:03:29.429 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:03:29.429 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-09-30T17:03:29.429 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-09-30T17:03:29.429 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:03:29.432 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:03:29.432 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:03:29.481 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:29.481 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 20, 2023-09-30T17:03:29.481 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 600, 2023-09-30T17:03:29.481 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:03:29.481 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.482 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:29.482 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:03:29.482 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 71.128042106999999, 2023-09-30T17:03:29.482 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.025313649000000001, 2023-09-30T17:03:29.482 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:29.482 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:29.482 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:29.482 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.482 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:29.482 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:03:29.482 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:29.483 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.483 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.483 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:29.483 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:03:29.483 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:29.483 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.483 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.483 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:29.483 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351551+0000", 2023-09-30T17:03:29.483 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3380000000000004e-06 2023-09-30T17:03:29.483 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.483 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.484 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:29.484 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351559+0000", 2023-09-30T17:03:29.484 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9589999999999995e-06 2023-09-30T17:03:29.484 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.484 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.484 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:29.484 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351571+0000", 2023-09-30T17:03:29.484 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2065999999999999e-05 2023-09-30T17:03:29.484 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.484 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.484 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:29.485 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351706+0000", 2023-09-30T17:03:29.485 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00013553799999999999 2023-09-30T17:03:29.485 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.485 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.485 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:29.485 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353016+0000", 2023-09-30T17:03:29.485 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0013099209999999999 2023-09-30T17:03:29.485 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.485 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.485 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:29.485 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353023+0000", 2023-09-30T17:03:29.485 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2479999999999999e-06 2023-09-30T17:03:29.486 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.486 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.486 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:29.486 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360348+0000", 2023-09-30T17:03:29.486 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0073248949999999997 2023-09-30T17:03:29.486 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.486 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.486 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:29.486 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360787+0000", 2023-09-30T17:03:29.486 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00043875199999999999 2023-09-30T17:03:29.486 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.486 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.487 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:29.487 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360892+0000", 2023-09-30T17:03:29.487 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010508199999999999 2023-09-30T17:03:29.487 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.487 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.487 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:29.487 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365132+0000", 2023-09-30T17:03:29.487 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0042396480000000004 2023-09-30T17:03:29.487 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.487 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.487 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:29.488 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376746+0000", 2023-09-30T17:03:29.488 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011614157 2023-09-30T17:03:29.488 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.488 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.488 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:29.488 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376811+0000", 2023-09-30T17:03:29.488 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5005999999999994e-05 2023-09-30T17:03:29.488 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.488 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.488 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:29.488 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376859+0000", 2023-09-30T17:03:29.488 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8038999999999999e-05 2023-09-30T17:03:29.488 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:29.489 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:29.489 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:29.489 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.489 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.489 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:29.489 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:03:29.489 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 71.127544307999997, 2023-09-30T17:03:29.489 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024923989000000001, 2023-09-30T17:03:29.489 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:29.489 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:29.489 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:29.489 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.490 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:29.490 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:03:29.490 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:29.490 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.490 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.490 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:29.490 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:03:29.490 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:29.490 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.490 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.490 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:29.491 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352044+0000", 2023-09-30T17:03:29.491 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9199999999999999e-07 2023-09-30T17:03:29.491 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.491 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.491 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:29.491 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352050+0000", 2023-09-30T17:03:29.491 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8880000000000002e-06 2023-09-30T17:03:29.491 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.491 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.491 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:29.491 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352143+0000", 2023-09-30T17:03:29.492 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2721999999999998e-05 2023-09-30T17:03:29.492 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.492 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.492 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:29.492 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352155+0000", 2023-09-30T17:03:29.492 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2279000000000001e-05 2023-09-30T17:03:29.492 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.492 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.492 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:29.492 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353114+0000", 2023-09-30T17:03:29.492 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00095943700000000005 2023-09-30T17:03:29.493 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.493 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.493 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:29.493 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353121+0000", 2023-09-30T17:03:29.493 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.494e-06 2023-09-30T17:03:29.493 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.493 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.493 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:29.493 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361491+0000", 2023-09-30T17:03:29.493 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0083697359999999991 2023-09-30T17:03:29.493 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.493 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.494 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:29.494 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361573+0000", 2023-09-30T17:03:29.494 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2822000000000001e-05 2023-09-30T17:03:29.494 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.494 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.494 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:29.494 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362166+0000", 2023-09-30T17:03:29.494 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00059223299999999995 2023-09-30T17:03:29.494 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.494 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.494 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:29.494 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365209+0000", 2023-09-30T17:03:29.495 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.003043212 2023-09-30T17:03:29.495 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.495 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.495 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:29.495 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376910+0000", 2023-09-30T17:03:29.495 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011700898 2023-09-30T17:03:29.495 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.495 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.495 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:29.495 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376945+0000", 2023-09-30T17:03:29.495 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4795000000000001e-05 2023-09-30T17:03:29.495 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.496 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.496 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:29.496 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376967+0000", 2023-09-30T17:03:29.496 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2580999999999999e-05 2023-09-30T17:03:29.496 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:29.496 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:29.496 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:29.496 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.496 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.496 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:29.496 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:03:29.496 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 71.127374388000007, 2023-09-30T17:03:29.497 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023120405, 2023-09-30T17:03:29.497 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:29.497 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:29.497 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:29.497 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.497 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:29.497 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:03:29.497 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:29.497 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.497 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.497 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:29.498 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:03:29.498 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:29.498 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.498 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.498 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:29.498 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352214+0000", 2023-09-30T17:03:29.498 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8400000000000003e-07 2023-09-30T17:03:29.498 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.498 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.498 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:29.499 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352233+0000", 2023-09-30T17:03:29.499 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8946000000000001e-05 2023-09-30T17:03:29.499 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.499 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.499 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:29.499 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352297+0000", 2023-09-30T17:03:29.499 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3540999999999994e-05 2023-09-30T17:03:29.499 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.499 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.499 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:29.499 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352450+0000", 2023-09-30T17:03:29.500 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015364799999999999 2023-09-30T17:03:29.500 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.500 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.500 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:29.500 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353098+0000", 2023-09-30T17:03:29.500 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00064820299999999997 2023-09-30T17:03:29.500 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.500 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.500 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:29.500 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353103+0000", 2023-09-30T17:03:29.500 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0529999999999997e-06 2023-09-30T17:03:29.501 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.501 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.501 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:29.501 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.358558+0000", 2023-09-30T17:03:29.501 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0054550249999999996 2023-09-30T17:03:29.501 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.501 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.501 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:29.501 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.358741+0000", 2023-09-30T17:03:29.501 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00018210200000000001 2023-09-30T17:03:29.501 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.501 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.502 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:29.502 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.359683+0000", 2023-09-30T17:03:29.502 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00094202299999999995 2023-09-30T17:03:29.502 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.502 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.502 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:29.502 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365044+0000", 2023-09-30T17:03:29.502 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053616219999999999 2023-09-30T17:03:29.502 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.502 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.502 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:29.502 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375256+0000", 2023-09-30T17:03:29.503 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010212156 2023-09-30T17:03:29.503 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.503 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.503 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:29.503 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375300+0000", 2023-09-30T17:03:29.503 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3961999999999997e-05 2023-09-30T17:03:29.503 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.503 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.503 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:29.503 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375334+0000", 2023-09-30T17:03:29.503 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.324e-05 2023-09-30T17:03:29.503 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:29.504 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:29.504 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:29.504 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.504 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.504 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:29.504 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:03:29.504 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 71.127059369999998, 2023-09-30T17:03:29.504 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024240660000000001, 2023-09-30T17:03:29.504 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:29.504 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:29.504 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:29.504 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.505 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:29.505 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:03:29.505 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:29.505 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.505 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.505 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:29.505 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:03:29.505 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:29.505 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.505 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.505 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:29.505 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352529+0000", 2023-09-30T17:03:29.506 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1379999999999999e-06 2023-09-30T17:03:29.506 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.506 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.506 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:29.506 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352536+0000", 2023-09-30T17:03:29.506 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3489999999999997e-06 2023-09-30T17:03:29.506 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.506 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.506 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:29.506 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352547+0000", 2023-09-30T17:03:29.506 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1109e-05 2023-09-30T17:03:29.506 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.507 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.507 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:29.507 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352560+0000", 2023-09-30T17:03:29.507 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3046e-05 2023-09-30T17:03:29.507 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.507 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.507 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:29.507 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353142+0000", 2023-09-30T17:03:29.507 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00058174699999999997 2023-09-30T17:03:29.507 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.507 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.507 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:29.508 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353147+0000", 2023-09-30T17:03:29.508 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5840000000000002e-06 2023-09-30T17:03:29.508 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.508 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.508 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:29.508 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360374+0000", 2023-09-30T17:03:29.508 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0072270049999999999 2023-09-30T17:03:29.508 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.508 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.508 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:29.508 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360795+0000", 2023-09-30T17:03:29.508 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00042088999999999999 2023-09-30T17:03:29.509 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.509 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.509 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:29.509 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360967+0000", 2023-09-30T17:03:29.509 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017235699999999999 2023-09-30T17:03:29.509 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.509 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.509 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:29.509 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365051+0000", 2023-09-30T17:03:29.509 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0040837429999999999 2023-09-30T17:03:29.509 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.509 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.510 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:29.510 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376708+0000", 2023-09-30T17:03:29.510 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011656866 2023-09-30T17:03:29.510 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.510 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.510 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:29.510 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376745+0000", 2023-09-30T17:03:29.510 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6769e-05 2023-09-30T17:03:29.510 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.510 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.510 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:29.510 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376769+0000", 2023-09-30T17:03:29.511 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4057e-05 2023-09-30T17:03:29.511 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:29.511 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:29.511 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:29.511 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.511 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.511 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:29.511 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:29.511 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 71.126800015000001, 2023-09-30T17:03:29.511 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023472704, 2023-09-30T17:03:29.511 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:29.512 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:29.512 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:29.512 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.512 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:29.512 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:29.512 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:29.512 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.512 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.512 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:29.512 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:29.512 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:29.512 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.513 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.513 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:29.513 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:29.513 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8000000000000005e-07 2023-09-30T17:03:29.513 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.513 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.513 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:29.513 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352794+0000", 2023-09-30T17:03:29.513 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.789e-06 2023-09-30T17:03:29.513 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.513 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.513 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:29.514 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352805+0000", 2023-09-30T17:03:29.514 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0848e-05 2023-09-30T17:03:29.514 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.514 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.514 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:29.514 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352812+0000", 2023-09-30T17:03:29.514 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4449999999999999e-06 2023-09-30T17:03:29.514 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.514 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.514 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:29.514 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353063+0000", 2023-09-30T17:03:29.514 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00025046299999999998 2023-09-30T17:03:29.515 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.515 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.515 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:29.515 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353071+0000", 2023-09-30T17:03:29.515 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6739999999999997e-06 2023-09-30T17:03:29.515 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.515 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.515 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:29.515 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361696+0000", 2023-09-30T17:03:29.515 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0086251609999999992 2023-09-30T17:03:29.515 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.516 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.516 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:29.516 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362284+0000", 2023-09-30T17:03:29.516 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00058872299999999998 2023-09-30T17:03:29.516 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.516 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.516 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:29.516 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362429+0000", 2023-09-30T17:03:29.516 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014509000000000001 2023-09-30T17:03:29.516 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.516 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.516 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:29.517 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365330+0000", 2023-09-30T17:03:29.517 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0029005419999999999 2023-09-30T17:03:29.517 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.517 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.517 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:29.517 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376196+0000", 2023-09-30T17:03:29.517 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.01086615 2023-09-30T17:03:29.517 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.517 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.517 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:29.517 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376230+0000", 2023-09-30T17:03:29.517 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3858e-05 2023-09-30T17:03:29.518 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.518 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.518 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:29.518 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376260+0000", 2023-09-30T17:03:29.518 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0181000000000001e-05 2023-09-30T17:03:29.518 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:29.518 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:29.518 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:29.518 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.518 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.518 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:29.518 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:03:29.519 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 71.126566444999995, 2023-09-30T17:03:29.519 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023406132999999999, 2023-09-30T17:03:29.519 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:29.519 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:29.519 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:29.519 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.519 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:29.519 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:03:29.519 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:29.519 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.519 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.520 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:29.520 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:03:29.520 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:29.520 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.520 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.520 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:29.520 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353022+0000", 2023-09-30T17:03:29.520 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.78e-07 2023-09-30T17:03:29.520 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.520 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.520 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:29.520 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353027+0000", 2023-09-30T17:03:29.521 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9089999999999999e-06 2023-09-30T17:03:29.521 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.521 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.521 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:29.521 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353035+0000", 2023-09-30T17:03:29.521 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0430000000000008e-06 2023-09-30T17:03:29.521 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.521 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.521 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:29.521 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353047+0000", 2023-09-30T17:03:29.521 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1674e-05 2023-09-30T17:03:29.521 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.522 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.522 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:29.522 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353105+0000", 2023-09-30T17:03:29.522 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8891999999999998e-05 2023-09-30T17:03:29.522 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.522 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.522 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:29.522 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353112+0000", 2023-09-30T17:03:29.522 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7059999999999998e-06 2023-09-30T17:03:29.522 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.522 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.523 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:29.523 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362733+0000", 2023-09-30T17:03:29.523 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0096205869999999999 2023-09-30T17:03:29.523 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.523 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.523 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:29.523 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362833+0000", 2023-09-30T17:03:29.523 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000100227 2023-09-30T17:03:29.523 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.523 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.523 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:29.523 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363000+0000", 2023-09-30T17:03:29.524 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016670899999999999 2023-09-30T17:03:29.524 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.524 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.524 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:29.524 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365550+0000", 2023-09-30T17:03:29.524 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0025499199999999998 2023-09-30T17:03:29.524 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.524 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.524 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:29.524 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376315+0000", 2023-09-30T17:03:29.524 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010765011999999999 2023-09-30T17:03:29.525 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.525 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.525 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:29.525 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376386+0000", 2023-09-30T17:03:29.525 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0866999999999998e-05 2023-09-30T17:03:29.525 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.525 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.525 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:29.525 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376427+0000", 2023-09-30T17:03:29.525 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1709000000000003e-05 2023-09-30T17:03:29.525 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:29.526 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:29.526 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:29.526 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.526 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.526 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:29.526 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:29.526 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 71.126525809, 2023-09-30T17:03:29.526 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024076238, 2023-09-30T17:03:29.526 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:29.526 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:29.526 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:29.526 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.527 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:29.527 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:29.527 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:29.527 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.527 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.527 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:29.527 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:29.527 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:29.527 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.527 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.527 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:29.528 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:29.528 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8699999999999995e-07 2023-09-30T17:03:29.528 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.528 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.528 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:29.528 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353067+0000", 2023-09-30T17:03:29.528 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.605e-06 2023-09-30T17:03:29.528 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.528 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.528 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:29.528 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353073+0000", 2023-09-30T17:03:29.528 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8900000000000004e-06 2023-09-30T17:03:29.529 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.529 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.529 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:29.529 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353083+0000", 2023-09-30T17:03:29.529 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0200000000000001e-05 2023-09-30T17:03:29.529 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.529 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.529 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:29.529 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353186+0000", 2023-09-30T17:03:29.529 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010256599999999999 2023-09-30T17:03:29.529 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.530 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.530 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:29.530 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353190+0000", 2023-09-30T17:03:29.530 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9709999999999998e-06 2023-09-30T17:03:29.530 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.530 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.530 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:29.530 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362946+0000", 2023-09-30T17:03:29.530 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0097563330000000007 2023-09-30T17:03:29.530 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.530 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.531 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:29.531 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363088+0000", 2023-09-30T17:03:29.531 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014259200000000001 2023-09-30T17:03:29.531 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.531 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.531 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:29.531 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363555+0000", 2023-09-30T17:03:29.531 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00046627799999999998 2023-09-30T17:03:29.531 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.531 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.531 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:29.532 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365871+0000", 2023-09-30T17:03:29.532 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0023167589999999998 2023-09-30T17:03:29.532 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.532 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.532 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:29.532 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377033+0000", 2023-09-30T17:03:29.532 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011161203999999999 2023-09-30T17:03:29.532 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.532 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.532 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:29.532 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377100+0000", 2023-09-30T17:03:29.532 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7230999999999994e-05 2023-09-30T17:03:29.533 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.533 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.533 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:29.533 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377138+0000", 2023-09-30T17:03:29.533 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8022000000000003e-05 2023-09-30T17:03:29.533 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:29.533 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:29.533 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:29.533 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.533 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.533 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:29.534 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:03:29.534 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 71.12642486, 2023-09-30T17:03:29.534 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.020304412000000001, 2023-09-30T17:03:29.534 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:29.534 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:29.534 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:29.534 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.534 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:29.534 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:03:29.534 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:29.534 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.535 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.535 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:29.535 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:03:29.535 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:29.535 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.535 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.535 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:29.535 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353164+0000", 2023-09-30T17:03:29.535 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7100000000000011e-07 2023-09-30T17:03:29.535 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.535 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.536 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:29.536 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353168+0000", 2023-09-30T17:03:29.536 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0600000000000001e-06 2023-09-30T17:03:29.536 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.536 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.536 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:29.536 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353177+0000", 2023-09-30T17:03:29.536 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1409999999999994e-06 2023-09-30T17:03:29.536 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.536 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.536 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:29.536 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353185+0000", 2023-09-30T17:03:29.536 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2479999999999996e-06 2023-09-30T17:03:29.537 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.537 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.537 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:29.537 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353246+0000", 2023-09-30T17:03:29.537 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0519000000000001e-05 2023-09-30T17:03:29.537 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.537 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.537 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:29.537 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353252+0000", 2023-09-30T17:03:29.537 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7859999999999999e-06 2023-09-30T17:03:29.537 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.537 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.538 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:29.538 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354979+0000", 2023-09-30T17:03:29.538 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0017270090000000001 2023-09-30T17:03:29.538 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.538 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.538 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:29.538 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355097+0000", 2023-09-30T17:03:29.538 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000117472 2023-09-30T17:03:29.538 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.538 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.538 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:29.539 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.373467+0000", 2023-09-30T17:03:29.539 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.018370206 2023-09-30T17:03:29.539 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:29.539 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:29.539 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:29.539 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.539 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.539 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:36 3.1a 3:5e41ab69:::200.00000005:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:29.539 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:03:29.539 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 71.126384122000005, 2023-09-30T17:03:29.539 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.012725089, 2023-09-30T17:03:29.539 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:29.540 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:29.540 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:29.540 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.540 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:29.540 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:03:29.540 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:29.540 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.540 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.540 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:29.540 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353203+0000", 2023-09-30T17:03:29.541 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:29.541 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.541 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.541 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:29.541 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353204+0000", 2023-09-30T17:03:29.541 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7100000000000002e-07 2023-09-30T17:03:29.541 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.541 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.541 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:29.541 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353213+0000", 2023-09-30T17:03:29.541 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8580000000000006e-06 2023-09-30T17:03:29.541 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.542 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.542 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:29.542 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353219+0000", 2023-09-30T17:03:29.542 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8939999999999998e-06 2023-09-30T17:03:29.542 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.542 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.542 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:29.542 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353223+0000", 2023-09-30T17:03:29.542 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.357e-06 2023-09-30T17:03:29.542 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.542 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.543 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:29.543 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353278+0000", 2023-09-30T17:03:29.543 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5228e-05 2023-09-30T17:03:29.543 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.543 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.543 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:29.543 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353284+0000", 2023-09-30T17:03:29.543 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8209999999999998e-06 2023-09-30T17:03:29.543 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.543 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.543 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:29.543 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355095+0000", 2023-09-30T17:03:29.544 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001811404 2023-09-30T17:03:29.544 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.544 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.544 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:29.544 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355256+0000", 2023-09-30T17:03:29.544 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000160898 2023-09-30T17:03:29.544 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.544 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.544 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:29.544 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365928+0000", 2023-09-30T17:03:29.544 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010672157999999999 2023-09-30T17:03:29.544 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:29.545 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:29.545 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:29.545 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.545 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.545 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:22 4.2d e36/17 4:b7099a35:::100000001f8.0000000e:head v 36'1, mlcod=0'0)", 2023-09-30T17:03:29.545 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:25.079146+0000", 2023-09-30T17:03:29.545 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4.40044126, 2023-09-30T17:03:29.545 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.012983130000000001, 2023-09-30T17:03:29.545 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:29.545 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:29.545 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:29.545 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.546 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:29.546 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.079146+0000", 2023-09-30T17:03:29.546 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:29.546 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.546 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.546 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:29.546 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.079146+0000", 2023-09-30T17:03:29.546 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:29.546 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.546 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.546 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:29.546 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.079148+0000", 2023-09-30T17:03:29.547 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.412e-06 2023-09-30T17:03:29.547 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.547 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.547 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:29.547 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.084608+0000", 2023-09-30T17:03:29.547 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0054598659999999999 2023-09-30T17:03:29.547 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.547 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.547 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:29.547 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.084630+0000", 2023-09-30T17:03:29.547 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2163000000000001e-05 2023-09-30T17:03:29.547 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.548 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.548 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:29.548 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.084641+0000", 2023-09-30T17:03:29.548 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1136e-05 2023-09-30T17:03:29.548 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.548 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.548 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:29.548 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.084704+0000", 2023-09-30T17:03:29.548 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3521000000000004e-05 2023-09-30T17:03:29.548 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.549 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.549 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:29.549 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.084730+0000", 2023-09-30T17:03:29.549 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.5522000000000001e-05 2023-09-30T17:03:29.549 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.549 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.549 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:29.549 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.092064+0000", 2023-09-30T17:03:29.549 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0073344530000000003 2023-09-30T17:03:29.549 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.549 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.550 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:29.550 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.092129+0000", 2023-09-30T17:03:29.550 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5056999999999997e-05 2023-09-30T17:03:29.550 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:29.550 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:29.550 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:29.550 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.550 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.550 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:24 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-09-30T17:03:29.550 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:25.254047+0000", 2023-09-30T17:03:29.550 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4.2255406009999996, 2023-09-30T17:03:29.551 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.016430255000000001, 2023-09-30T17:03:29.551 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:29.551 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:29.551 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:29.551 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:29.551 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:29.551 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 24 2023-09-30T17:03:29.551 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.551 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:29.551 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.551 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:29.551 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.254047+0000", 2023-09-30T17:03:29.552 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:29.552 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.552 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.552 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:29.552 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.254047+0000", 2023-09-30T17:03:29.552 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:29.552 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.552 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.552 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:29.552 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.254050+0000", 2023-09-30T17:03:29.552 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.9500000000000001e-06 2023-09-30T17:03:29.553 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.553 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.553 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:29.553 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.257929+0000", 2023-09-30T17:03:29.553 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0038787190000000001 2023-09-30T17:03:29.553 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.553 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.553 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:29.553 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.257945+0000", 2023-09-30T17:03:29.553 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5991e-05 2023-09-30T17:03:29.553 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.553 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.554 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:29.554 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.257952+0000", 2023-09-30T17:03:29.554 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6170000000000001e-06 2023-09-30T17:03:29.554 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.554 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.554 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:29.554 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.258009+0000", 2023-09-30T17:03:29.554 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6768999999999998e-05 2023-09-30T17:03:29.554 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.554 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.554 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:29.555 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.258111+0000", 2023-09-30T17:03:29.555 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000101739 2023-09-30T17:03:29.555 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.555 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.555 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:29.555 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.258215+0000", 2023-09-30T17:03:29.555 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010414 2023-09-30T17:03:29.555 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.555 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.555 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:29.555 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.264291+0000", 2023-09-30T17:03:29.556 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0060763789999999998 2023-09-30T17:03:29.556 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.556 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.556 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:29.556 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.270347+0000", 2023-09-30T17:03:29.556 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0060554149999999998 2023-09-30T17:03:29.556 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.556 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.556 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:29.556 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.270431+0000", 2023-09-30T17:03:29.556 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4285999999999999e-05 2023-09-30T17:03:29.557 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.557 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.557 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:29.557 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.270477+0000", 2023-09-30T17:03:29.557 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6249999999999999e-05 2023-09-30T17:03:29.557 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:29.557 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:29.557 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:29.557 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.557 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.557 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:27 4.36 4:6fa85f86:::100000001f8.00000013:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-09-30T17:03:29.558 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:25.573750+0000", 2023-09-30T17:03:29.558 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 3.905837413, 2023-09-30T17:03:29.558 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.014811728, 2023-09-30T17:03:29.558 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:29.558 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:29.558 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:29.558 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:29.558 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:29.558 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 27 2023-09-30T17:03:29.558 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.558 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:29.559 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.559 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:29.559 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.573750+0000", 2023-09-30T17:03:29.559 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:29.559 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.559 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.559 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:29.559 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.573750+0000", 2023-09-30T17:03:29.559 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:29.559 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.559 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.559 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:29.560 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.573753+0000", 2023-09-30T17:03:29.560 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.5399999999999998e-06 2023-09-30T17:03:29.560 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.560 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.560 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:29.560 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.577633+0000", 2023-09-30T17:03:29.560 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0038801030000000002 2023-09-30T17:03:29.560 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.560 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.560 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:29.560 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.577649+0000", 2023-09-30T17:03:29.561 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5897e-05 2023-09-30T17:03:29.561 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.561 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.561 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:29.561 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.577656+0000", 2023-09-30T17:03:29.561 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1640000000000004e-06 2023-09-30T17:03:29.561 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.561 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.561 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:29.561 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.577707+0000", 2023-09-30T17:03:29.561 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0930000000000002e-05 2023-09-30T17:03:29.562 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.562 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.562 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:29.562 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.577818+0000", 2023-09-30T17:03:29.562 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000111477 2023-09-30T17:03:29.562 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.562 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.562 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:29.562 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.577916+0000", 2023-09-30T17:03:29.562 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7281000000000006e-05 2023-09-30T17:03:29.562 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.563 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.563 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:29.563 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.583899+0000", 2023-09-30T17:03:29.563 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0059835829999999998 2023-09-30T17:03:29.563 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.563 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.563 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:29.563 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.588490+0000", 2023-09-30T17:03:29.563 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0045904819999999999 2023-09-30T17:03:29.563 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.563 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.563 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:29.564 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.588533+0000", 2023-09-30T17:03:29.564 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3231e-05 2023-09-30T17:03:29.564 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.564 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.564 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:29.564 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.588562+0000", 2023-09-30T17:03:29.564 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.904e-05 2023-09-30T17:03:29.564 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:29.564 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:29.564 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:29.564 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.565 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.565 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:29 4.12 e36/17 4:48ab9bde:::100000001f8.00000015:head v 36'4, mlcod=36'2)", 2023-09-30T17:03:29.565 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:25.772296+0000", 2023-09-30T17:03:29.565 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 3.7072915860000002, 2023-09-30T17:03:29.565 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.015379528999999999, 2023-09-30T17:03:29.565 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:29.565 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:29.565 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:29.565 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.565 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:29.565 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.772296+0000", 2023-09-30T17:03:29.565 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:29.566 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.566 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.566 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:29.566 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.772296+0000", 2023-09-30T17:03:29.566 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:29.566 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.566 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.566 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:29.566 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.772298+0000", 2023-09-30T17:03:29.566 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.0099999999999998e-06 2023-09-30T17:03:29.566 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.567 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.567 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:29.567 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.778708+0000", 2023-09-30T17:03:29.567 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0064101679999999999 2023-09-30T17:03:29.567 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.567 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.567 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:29.567 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.778726+0000", 2023-09-30T17:03:29.567 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7427000000000001e-05 2023-09-30T17:03:29.567 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.567 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.567 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:29.568 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.778734+0000", 2023-09-30T17:03:29.568 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5019999999999992e-06 2023-09-30T17:03:29.568 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.568 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.568 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:29.568 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.778807+0000", 2023-09-30T17:03:29.568 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2556000000000001e-05 2023-09-30T17:03:29.568 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.568 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.568 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:29.568 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.778830+0000", 2023-09-30T17:03:29.569 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.3434e-05 2023-09-30T17:03:29.569 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.569 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.569 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:29.569 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.787611+0000", 2023-09-30T17:03:29.569 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0087809919999999996 2023-09-30T17:03:29.569 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.569 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.569 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:29.569 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.787675+0000", 2023-09-30T17:03:29.569 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.444e-05 2023-09-30T17:03:29.569 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:29.570 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:29.570 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:29.570 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.570 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.570 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:30 4.14 4:2b28d75f:::100000001f8.00000016:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-09-30T17:03:29.570 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:25.858076+0000", 2023-09-30T17:03:29.570 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 3.6215113159999999, 2023-09-30T17:03:29.570 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.014984442000000001, 2023-09-30T17:03:29.570 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:29.570 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:29.570 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:29.571 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:29.571 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:29.571 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 30 2023-09-30T17:03:29.571 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.571 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:29.571 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.571 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:29.571 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.858076+0000", 2023-09-30T17:03:29.571 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:29.571 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.571 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.571 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:29.572 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.858076+0000", 2023-09-30T17:03:29.572 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:29.572 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.572 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.572 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:29.572 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.858080+0000", 2023-09-30T17:03:29.572 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7170000000000002e-06 2023-09-30T17:03:29.572 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.572 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.572 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:29.572 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.862044+0000", 2023-09-30T17:03:29.573 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0039641549999999996 2023-09-30T17:03:29.573 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.573 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.573 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:29.573 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.862064+0000", 2023-09-30T17:03:29.573 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9479000000000001e-05 2023-09-30T17:03:29.573 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.573 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.573 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:29.573 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.862073+0000", 2023-09-30T17:03:29.573 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.6209999999999999e-06 2023-09-30T17:03:29.573 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.574 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.574 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:29.574 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.862187+0000", 2023-09-30T17:03:29.574 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000113365 2023-09-30T17:03:29.574 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.574 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.574 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:29.574 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.862314+0000", 2023-09-30T17:03:29.574 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00012777200000000001 2023-09-30T17:03:29.574 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.574 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.575 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:29.575 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.862428+0000", 2023-09-30T17:03:29.575 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000113569 2023-09-30T17:03:29.575 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.575 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.575 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:29.575 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.868349+0000", 2023-09-30T17:03:29.575 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0059214439999999997 2023-09-30T17:03:29.575 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.575 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.575 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:29.576 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.872988+0000", 2023-09-30T17:03:29.576 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0046389509999999997 2023-09-30T17:03:29.576 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.576 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.576 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:29.576 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.873031+0000", 2023-09-30T17:03:29.576 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2852000000000002e-05 2023-09-30T17:03:29.576 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.576 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.576 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:29.576 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.873061+0000", 2023-09-30T17:03:29.577 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.9516999999999999e-05 2023-09-30T17:03:29.577 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:29.577 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:29.577 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:29.577 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.577 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.577 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:32 4.27 4:e68799fb:::100000001f8.00000018:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-09-30T17:03:29.577 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:26.043279+0000", 2023-09-30T17:03:29.577 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 3.4363089019999999, 2023-09-30T17:03:29.577 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.013503962, 2023-09-30T17:03:29.577 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:29.578 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:29.578 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:29.578 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:29.578 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:29.578 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 32 2023-09-30T17:03:29.578 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.578 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:29.578 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.578 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:29.578 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.043279+0000", 2023-09-30T17:03:29.578 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:29.579 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.579 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.579 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:29.579 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.043279+0000", 2023-09-30T17:03:29.579 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:29.579 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.579 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.579 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:29.579 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.043281+0000", 2023-09-30T17:03:29.579 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.368e-06 2023-09-30T17:03:29.579 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.579 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.579 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:29.580 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.047152+0000", 2023-09-30T17:03:29.580 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0038711549999999998 2023-09-30T17:03:29.580 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.580 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.580 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:29.580 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.047180+0000", 2023-09-30T17:03:29.580 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.8289e-05 2023-09-30T17:03:29.580 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.580 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.580 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:29.580 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.047192+0000", 2023-09-30T17:03:29.580 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.206e-05 2023-09-30T17:03:29.581 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.581 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.581 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:29.581 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.047257+0000", 2023-09-30T17:03:29.581 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4598999999999996e-05 2023-09-30T17:03:29.581 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.581 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.581 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:29.581 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.047362+0000", 2023-09-30T17:03:29.581 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000104862 2023-09-30T17:03:29.581 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.582 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.582 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:29.582 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.056674+0000", 2023-09-30T17:03:29.582 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0093115539999999997 2023-09-30T17:03:29.582 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.582 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.582 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:29.582 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.056733+0000", 2023-09-30T17:03:29.582 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9447000000000002e-05 2023-09-30T17:03:29.582 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.583 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.583 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:29.583 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.056783+0000", 2023-09-30T17:03:29.583 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9628e-05 2023-09-30T17:03:29.583 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:29.583 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:29.583 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:29.583 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.583 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.583 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:34 4.3b 4:dcc0c15f:::100000001f8.0000001a:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-09-30T17:03:29.583 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:26.217323+0000", 2023-09-30T17:03:29.583 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 3.2622647950000001, 2023-09-30T17:03:29.584 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.015860697, 2023-09-30T17:03:29.584 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:29.584 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:29.584 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:29.584 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:29.584 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:29.584 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 34 2023-09-30T17:03:29.584 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.584 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:29.584 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.584 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:29.584 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.217323+0000", 2023-09-30T17:03:29.585 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:29.585 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.585 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.585 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:29.585 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.217323+0000", 2023-09-30T17:03:29.585 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:29.585 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.585 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.585 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:29.585 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.217325+0000", 2023-09-30T17:03:29.585 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.244e-06 2023-09-30T17:03:29.585 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.586 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.586 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:29.586 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.221135+0000", 2023-09-30T17:03:29.586 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0038104480000000001 2023-09-30T17:03:29.586 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.586 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.586 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:29.586 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.221171+0000", 2023-09-30T17:03:29.586 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5302000000000002e-05 2023-09-30T17:03:29.586 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.586 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.587 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:29.587 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.221183+0000", 2023-09-30T17:03:29.587 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2670999999999999e-05 2023-09-30T17:03:29.587 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.587 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.587 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:29.587 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.221251+0000", 2023-09-30T17:03:29.587 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7229000000000003e-05 2023-09-30T17:03:29.587 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.587 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.588 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:29.588 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.221361+0000", 2023-09-30T17:03:29.588 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000110806 2023-09-30T17:03:29.588 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.588 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.588 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:29.588 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.221460+0000", 2023-09-30T17:03:29.588 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8326999999999996e-05 2023-09-30T17:03:29.588 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.588 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.588 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:29.588 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.227385+0000", 2023-09-30T17:03:29.589 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0059254620000000003 2023-09-30T17:03:29.589 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.589 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.589 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:29.589 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.233109+0000", 2023-09-30T17:03:29.589 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0057238480000000001 2023-09-30T17:03:29.589 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.589 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.589 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:29.589 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.233148+0000", 2023-09-30T17:03:29.589 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8701000000000001e-05 2023-09-30T17:03:29.589 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.590 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.590 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:29.590 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.233183+0000", 2023-09-30T17:03:29.590 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5658999999999999e-05 2023-09-30T17:03:29.590 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:29.590 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:29.590 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:29.590 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.590 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.590 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:36 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-09-30T17:03:29.590 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:26.405253+0000", 2023-09-30T17:03:29.590 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 3.074334634, 2023-09-30T17:03:29.591 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.014826545999999999, 2023-09-30T17:03:29.591 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:29.591 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:29.591 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:29.591 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:29.591 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:29.591 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 36 2023-09-30T17:03:29.591 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.591 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:29.591 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.591 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:29.591 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.405253+0000", 2023-09-30T17:03:29.592 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:29.592 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.592 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.592 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:29.592 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.405253+0000", 2023-09-30T17:03:29.592 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:29.592 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.592 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.592 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:29.592 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.405256+0000", 2023-09-30T17:03:29.592 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.1e-06 2023-09-30T17:03:29.592 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.593 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.593 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:29.593 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.408900+0000", 2023-09-30T17:03:29.593 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.003644128 2023-09-30T17:03:29.593 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.593 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.593 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:29.593 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.408918+0000", 2023-09-30T17:03:29.593 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7428999999999999e-05 2023-09-30T17:03:29.593 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.593 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.593 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:29.594 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.408927+0000", 2023-09-30T17:03:29.594 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1339999999999993e-06 2023-09-30T17:03:29.594 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.594 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.594 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:29.594 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.409018+0000", 2023-09-30T17:03:29.594 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1414000000000003e-05 2023-09-30T17:03:29.594 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.594 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.594 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:29.594 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.409144+0000", 2023-09-30T17:03:29.595 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000126222 2023-09-30T17:03:29.595 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.595 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.595 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:29.595 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.409240+0000", 2023-09-30T17:03:29.595 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.6019000000000003e-05 2023-09-30T17:03:29.595 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.595 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.595 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:29.595 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.415821+0000", 2023-09-30T17:03:29.595 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0065809559999999998 2023-09-30T17:03:29.595 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.596 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.596 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:29.596 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.419904+0000", 2023-09-30T17:03:29.596 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0040827429999999998 2023-09-30T17:03:29.596 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.596 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.596 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:29.596 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.420032+0000", 2023-09-30T17:03:29.596 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000128307 2023-09-30T17:03:29.596 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.596 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.596 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:29.597 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.420079+0000", 2023-09-30T17:03:29.597 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7094e-05 2023-09-30T17:03:29.597 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:29.597 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:29.597 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:29.597 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.597 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.597 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:38 4.6 4:63e80496:::100000001f8.0000001e:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-09-30T17:03:29.597 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:26.597453+0000", 2023-09-30T17:03:29.597 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 2.8821349180000002, 2023-09-30T17:03:29.597 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.014866199, 2023-09-30T17:03:29.597 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:29.598 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:29.598 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:29.598 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:29.598 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:29.598 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 38 2023-09-30T17:03:29.598 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.598 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:29.598 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.598 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:29.598 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.597453+0000", 2023-09-30T17:03:29.598 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:29.598 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.599 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.599 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:29.599 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.597453+0000", 2023-09-30T17:03:29.599 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:29.599 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.599 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.599 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:29.599 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.597456+0000", 2023-09-30T17:03:29.599 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4529999999999998e-06 2023-09-30T17:03:29.599 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.599 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.599 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:29.600 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.601152+0000", 2023-09-30T17:03:29.600 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0036961730000000001 2023-09-30T17:03:29.600 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.600 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.600 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:29.600 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.601175+0000", 2023-09-30T17:03:29.600 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.3050000000000001e-05 2023-09-30T17:03:29.600 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.600 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.600 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:29.600 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.601184+0000", 2023-09-30T17:03:29.601 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4710000000000007e-06 2023-09-30T17:03:29.601 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.601 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.601 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:29.601 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.601240+0000", 2023-09-30T17:03:29.601 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5999999999999999e-05 2023-09-30T17:03:29.601 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.601 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.601 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:29.601 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.601354+0000", 2023-09-30T17:03:29.601 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000113849 2023-09-30T17:03:29.601 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.602 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.602 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:29.602 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.601456+0000", 2023-09-30T17:03:29.602 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010277600000000001 2023-09-30T17:03:29.602 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.602 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.602 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:29.602 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.607840+0000", 2023-09-30T17:03:29.602 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0063832089999999999 2023-09-30T17:03:29.602 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.602 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.602 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:29.603 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.612184+0000", 2023-09-30T17:03:29.603 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0043445280000000003 2023-09-30T17:03:29.603 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.603 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.603 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:29.603 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.612272+0000", 2023-09-30T17:03:29.603 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8258999999999996e-05 2023-09-30T17:03:29.603 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.603 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.603 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:29.603 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.612319+0000", 2023-09-30T17:03:29.603 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6431000000000003e-05 2023-09-30T17:03:29.604 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:29.604 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:29.604 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:29.604 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.604 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.604 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:41 4.3 4:c222b65c:::100000001f8.00000021:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-09-30T17:03:29.604 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:26.887934+0000", 2023-09-30T17:03:29.604 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 2.5916530949999999, 2023-09-30T17:03:29.604 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.012780278000000001, 2023-09-30T17:03:29.604 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:29.604 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:29.604 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:29.605 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:29.605 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:29.605 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 41 2023-09-30T17:03:29.605 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.605 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:29.605 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.605 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:29.605 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.887934+0000", 2023-09-30T17:03:29.605 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:29.605 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.605 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.605 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:29.606 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.887934+0000", 2023-09-30T17:03:29.606 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:29.606 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.606 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.606 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:29.606 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.887938+0000", 2023-09-30T17:03:29.606 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7459999999999998e-06 2023-09-30T17:03:29.606 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.606 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.606 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:29.606 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.892178+0000", 2023-09-30T17:03:29.607 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.004239456 2023-09-30T17:03:29.607 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.607 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.607 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:29.607 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.892196+0000", 2023-09-30T17:03:29.607 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8417e-05 2023-09-30T17:03:29.607 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.607 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.607 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:29.607 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.892205+0000", 2023-09-30T17:03:29.607 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5820000000000002e-06 2023-09-30T17:03:29.607 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.608 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.608 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:29.608 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.892284+0000", 2023-09-30T17:03:29.608 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8942000000000004e-05 2023-09-30T17:03:29.608 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.608 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.608 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:29.608 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.892468+0000", 2023-09-30T17:03:29.608 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000184165 2023-09-30T17:03:29.608 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.608 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.608 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:29.609 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.900612+0000", 2023-09-30T17:03:29.609 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0081442600000000004 2023-09-30T17:03:29.609 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.609 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.609 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:29.609 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.900660+0000", 2023-09-30T17:03:29.609 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7710999999999998e-05 2023-09-30T17:03:29.609 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.609 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.609 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:29.609 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.900715+0000", 2023-09-30T17:03:29.609 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4999e-05 2023-09-30T17:03:29.610 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:29.610 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:29.610 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:29.610 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.610 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.610 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:44 4.31 4:8fb8ba0c:::100000001f8.00000024:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-09-30T17:03:29.610 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:27.182700+0000", 2023-09-30T17:03:29.610 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 2.2968874210000001, 2023-09-30T17:03:29.610 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.013815208000000001, 2023-09-30T17:03:29.610 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:29.610 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:29.611 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:29.611 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:29.611 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:29.611 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 44 2023-09-30T17:03:29.611 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.611 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:29.611 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.611 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:29.611 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:27.182700+0000", 2023-09-30T17:03:29.611 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:29.611 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.611 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.612 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:29.612 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:27.182700+0000", 2023-09-30T17:03:29.612 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:29.612 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.612 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.612 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:29.612 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:27.182703+0000", 2023-09-30T17:03:29.612 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.65e-06 2023-09-30T17:03:29.612 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.612 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.612 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:29.612 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:27.186592+0000", 2023-09-30T17:03:29.612 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0038894369999999999 2023-09-30T17:03:29.613 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.613 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.613 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:29.613 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:27.186617+0000", 2023-09-30T17:03:29.613 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.5182e-05 2023-09-30T17:03:29.613 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.613 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.613 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:29.613 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:27.186633+0000", 2023-09-30T17:03:29.613 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5964000000000002e-05 2023-09-30T17:03:29.613 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.614 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.614 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:29.614 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:27.186729+0000", 2023-09-30T17:03:29.614 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.5765000000000002e-05 2023-09-30T17:03:29.614 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.614 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.614 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:29.614 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:27.186858+0000", 2023-09-30T17:03:29.614 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000129185 2023-09-30T17:03:29.614 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.614 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.614 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:29.615 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:27.196423+0000", 2023-09-30T17:03:29.615 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0095642709999999992 2023-09-30T17:03:29.615 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.615 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.615 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:29.615 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:27.196463+0000", 2023-09-30T17:03:29.615 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0258e-05 2023-09-30T17:03:29.615 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:29.615 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:29.615 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:29.615 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:27.196515+0000", 2023-09-30T17:03:29.615 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2496e-05 2023-09-30T17:03:29.616 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:29.616 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:29.616 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:29.616 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:29.616 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:29.616 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:29.617 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:03:29.618 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:29.617+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:29.718 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:29.718+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:29.747 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:29.747 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:03:29.747 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2023-09-30T17:03:29.747 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:29.757 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:03:29.819 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:29.819+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:29.920 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:29.920+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:30.911 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:30.911+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:30.912 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:30.912 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:03:30.912 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2023-09-30T17:03:30.912 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2023-09-30T17:03:30.912 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:30.913 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:03:31.012 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:31.012+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:31.113 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:31.113+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:31.126 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:31.127 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2023-09-30T17:03:31.127 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2023-09-30T17:03:31.127 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2023-09-30T17:03:31.127 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.127 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:31.127 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:03:31.127 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 72.772304083999998, 2023-09-30T17:03:31.127 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021233007000000002, 2023-09-30T17:03:31.127 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:31.127 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:31.127 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:31.128 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.128 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:31.128 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:03:31.128 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:31.128 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.128 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.128 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:31.128 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:03:31.128 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:31.128 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.128 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.128 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:31.129 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352110+0000", 2023-09-30T17:03:31.129 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6000000000000002e-07 2023-09-30T17:03:31.129 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.129 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.129 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:31.129 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352117+0000", 2023-09-30T17:03:31.129 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5930000000000002e-06 2023-09-30T17:03:31.129 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.129 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.129 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:31.129 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352126+0000", 2023-09-30T17:03:31.130 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0729999999999994e-06 2023-09-30T17:03:31.130 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.130 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.130 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:31.130 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352136+0000", 2023-09-30T17:03:31.130 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0380000000000001e-05 2023-09-30T17:03:31.130 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.130 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.130 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:31.130 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353279+0000", 2023-09-30T17:03:31.131 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0011424670000000001 2023-09-30T17:03:31.131 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.131 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.131 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:31.131 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353707+0000", 2023-09-30T17:03:31.131 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00042829800000000003 2023-09-30T17:03:31.131 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.131 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.131 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:31.131 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354104+0000", 2023-09-30T17:03:31.131 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00039643399999999998 2023-09-30T17:03:31.131 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.132 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.132 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:31.132 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356925+0000", 2023-09-30T17:03:31.132 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0028210900000000001 2023-09-30T17:03:31.132 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.132 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.132 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:31.132 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373243+0000", 2023-09-30T17:03:31.132 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016318461999999999 2023-09-30T17:03:31.132 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.132 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.133 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:31.133 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373301+0000", 2023-09-30T17:03:31.133 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7435000000000002e-05 2023-09-30T17:03:31.133 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.133 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:31.133 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373342+0000", 2023-09-30T17:03:31.133 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1915000000000001e-05 2023-09-30T17:03:31.133 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:31.133 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:31.133 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:31.134 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.134 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.134 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:31.134 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:31.134 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 72.772188903, 2023-09-30T17:03:31.134 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021258651999999999, 2023-09-30T17:03:31.134 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:31.134 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:31.134 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:31.134 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.134 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:31.134 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:31.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:31.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.135 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.135 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:31.135 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:31.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:31.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.135 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.135 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:31.135 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:31.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6899999999999997e-07 2023-09-30T17:03:31.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.136 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.136 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:31.136 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352236+0000", 2023-09-30T17:03:31.136 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0251000000000001e-05 2023-09-30T17:03:31.136 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.136 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.136 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:31.136 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352244+0000", 2023-09-30T17:03:31.136 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0770000000000008e-06 2023-09-30T17:03:31.136 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.136 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.137 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:31.137 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352251+0000", 2023-09-30T17:03:31.137 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4749999999999996e-06 2023-09-30T17:03:31.137 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.137 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.137 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:31.137 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354455+0000", 2023-09-30T17:03:31.137 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022043660000000001 2023-09-30T17:03:31.137 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.137 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.137 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:31.137 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354577+0000", 2023-09-30T17:03:31.138 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000121054 2023-09-30T17:03:31.138 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.138 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.138 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:31.138 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354723+0000", 2023-09-30T17:03:31.138 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014693900000000001 2023-09-30T17:03:31.138 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.138 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.138 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:31.138 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356941+0000", 2023-09-30T17:03:31.138 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002217199 2023-09-30T17:03:31.138 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.139 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.139 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:31.139 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373392+0000", 2023-09-30T17:03:31.139 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016451774999999998 2023-09-30T17:03:31.139 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.139 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.139 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:31.139 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373445+0000", 2023-09-30T17:03:31.139 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.308e-05 2023-09-30T17:03:31.139 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.139 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.139 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:31.140 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373483+0000", 2023-09-30T17:03:31.140 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7766999999999999e-05 2023-09-30T17:03:31.140 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:31.140 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:31.140 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:31.140 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.140 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.140 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:31.140 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:31.140 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 72.772152812000002, 2023-09-30T17:03:31.140 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020903497, 2023-09-30T17:03:31.140 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:31.141 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:31.141 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:31.141 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.141 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:31.141 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:31.141 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:31.141 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.141 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.141 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:31.141 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:31.141 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:31.141 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.142 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.142 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:31.142 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:31.142 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0800000000000004e-07 2023-09-30T17:03:31.142 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.142 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.142 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:31.142 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352266+0000", 2023-09-30T17:03:31.142 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1280000000000001e-06 2023-09-30T17:03:31.142 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.142 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.143 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:31.143 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352273+0000", 2023-09-30T17:03:31.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3730000000000004e-06 2023-09-30T17:03:31.143 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.143 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.143 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:31.143 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352279+0000", 2023-09-30T17:03:31.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7699999999999998e-06 2023-09-30T17:03:31.143 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.143 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.143 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:31.143 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352334+0000", 2023-09-30T17:03:31.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5547999999999997e-05 2023-09-30T17:03:31.144 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.144 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.144 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:31.144 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352435+0000", 2023-09-30T17:03:31.144 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100688 2023-09-30T17:03:31.144 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.144 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.144 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:31.144 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352585+0000", 2023-09-30T17:03:31.144 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000150068 2023-09-30T17:03:31.144 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.144 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.144 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:31.145 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354912+0000", 2023-09-30T17:03:31.145 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0023266770000000001 2023-09-30T17:03:31.145 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.145 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.145 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:31.145 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373066+0000", 2023-09-30T17:03:31.145 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018154474 2023-09-30T17:03:31.145 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.145 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.145 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:31.145 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373122+0000", 2023-09-30T17:03:31.145 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6193000000000002e-05 2023-09-30T17:03:31.146 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.146 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.146 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:31.146 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373164+0000", 2023-09-30T17:03:31.146 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1869999999999997e-05 2023-09-30T17:03:31.146 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:31.146 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:31.146 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:31.146 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.146 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.146 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:31.147 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:03:31.147 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 72.772117136000006, 2023-09-30T17:03:31.147 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021015097999999999, 2023-09-30T17:03:31.147 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:31.147 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:31.147 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:31.147 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.147 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:31.147 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:03:31.147 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:31.147 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.148 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.148 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:31.148 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:03:31.148 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:31.148 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.148 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.148 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:31.148 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352297+0000", 2023-09-30T17:03:31.148 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8299999999999997e-07 2023-09-30T17:03:31.148 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.148 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.148 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:31.149 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352300+0000", 2023-09-30T17:03:31.149 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7460000000000001e-06 2023-09-30T17:03:31.149 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.149 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.149 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:31.149 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352307+0000", 2023-09-30T17:03:31.149 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4959999999999999e-06 2023-09-30T17:03:31.149 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.149 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.149 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:31.149 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352314+0000", 2023-09-30T17:03:31.149 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0190000000000001e-06 2023-09-30T17:03:31.150 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.150 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.150 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:31.150 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354070+0000", 2023-09-30T17:03:31.150 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001755936 2023-09-30T17:03:31.150 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.150 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.150 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:31.150 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354221+0000", 2023-09-30T17:03:31.150 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000150884 2023-09-30T17:03:31.150 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.151 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.151 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:31.151 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373311+0000", 2023-09-30T17:03:31.151 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019090434 2023-09-30T17:03:31.151 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:31.151 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:31.151 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:31.151 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.151 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.151 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:31.151 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:03:31.151 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 72.772088417000006, 2023-09-30T17:03:31.152 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021255174000000002, 2023-09-30T17:03:31.152 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:31.152 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:31.152 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:31.152 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.152 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:31.152 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:03:31.152 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:31.152 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.152 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.152 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:31.152 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:03:31.153 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:31.153 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.153 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.153 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:31.153 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352326+0000", 2023-09-30T17:03:31.153 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3200000000000005e-07 2023-09-30T17:03:31.153 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.153 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.153 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:31.153 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352349+0000", 2023-09-30T17:03:31.153 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3183000000000001e-05 2023-09-30T17:03:31.153 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.154 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.154 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:31.154 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352358+0000", 2023-09-30T17:03:31.154 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5230000000000001e-06 2023-09-30T17:03:31.154 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.154 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.154 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:31.154 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352365+0000", 2023-09-30T17:03:31.154 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3260000000000001e-06 2023-09-30T17:03:31.154 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.154 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.155 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:31.155 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355450+0000", 2023-09-30T17:03:31.155 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0030854049999999998 2023-09-30T17:03:31.155 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.155 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.155 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:31.155 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355583+0000", 2023-09-30T17:03:31.155 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000133189 2023-09-30T17:03:31.155 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.155 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.155 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:31.155 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373580+0000", 2023-09-30T17:03:31.156 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017997016000000001 2023-09-30T17:03:31.156 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:31.156 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:31.156 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:31.156 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.156 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.156 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:22 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-09-30T17:03:31.156 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:25.074944+0000", 2023-09-30T17:03:31.156 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 6.0494695250000001, 2023-09-30T17:03:31.156 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017740700000000002, 2023-09-30T17:03:31.156 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:31.156 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:31.157 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:31.157 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:31.157 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:31.157 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 22 2023-09-30T17:03:31.157 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.157 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:31.157 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.157 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:31.157 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.074944+0000", 2023-09-30T17:03:31.157 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:31.157 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.157 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.158 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:31.158 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.074944+0000", 2023-09-30T17:03:31.158 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:31.158 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.158 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.158 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:31.158 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.074945+0000", 2023-09-30T17:03:31.158 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0890000000000001e-06 2023-09-30T17:03:31.158 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.158 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.159 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:31.159 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.078709+0000", 2023-09-30T17:03:31.159 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0037635339999999998 2023-09-30T17:03:31.159 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.159 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.159 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:31.159 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.078723+0000", 2023-09-30T17:03:31.159 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4562000000000001e-05 2023-09-30T17:03:31.159 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.159 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.159 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:31.160 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.078738+0000", 2023-09-30T17:03:31.160 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5065000000000001e-05 2023-09-30T17:03:31.160 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.160 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.160 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:31.160 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.078794+0000", 2023-09-30T17:03:31.160 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5642e-05 2023-09-30T17:03:31.160 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.160 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.160 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:31.160 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.078893+0000", 2023-09-30T17:03:31.160 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8863000000000005e-05 2023-09-30T17:03:31.161 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.161 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.161 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:31.161 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.078998+0000", 2023-09-30T17:03:31.161 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000105153 2023-09-30T17:03:31.161 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.161 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.161 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:31.161 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.084862+0000", 2023-09-30T17:03:31.161 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0058643300000000001 2023-09-30T17:03:31.161 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.161 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.161 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:31.162 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.092503+0000", 2023-09-30T17:03:31.162 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0076404589999999996 2023-09-30T17:03:31.162 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.162 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.162 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:31.162 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.092619+0000", 2023-09-30T17:03:31.162 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011675699999999999 2023-09-30T17:03:31.162 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.162 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.162 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:31.162 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.092685+0000", 2023-09-30T17:03:31.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5246000000000005e-05 2023-09-30T17:03:31.163 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:31.163 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:31.163 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:31.163 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.163 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.163 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:29 4.12 4:48ab9bde:::100000001f8.00000015:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-09-30T17:03:31.163 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:25.767986+0000", 2023-09-30T17:03:31.163 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 5.3564276560000001, 2023-09-30T17:03:31.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020236621999999999, 2023-09-30T17:03:31.163 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:31.163 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:31.163 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:31.164 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:31.164 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:31.164 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 29 2023-09-30T17:03:31.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.164 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:31.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.164 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:31.164 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.767986+0000", 2023-09-30T17:03:31.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:31.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.164 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:31.165 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.767986+0000", 2023-09-30T17:03:31.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:31.165 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.165 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.165 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:31.165 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.767988+0000", 2023-09-30T17:03:31.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.193e-06 2023-09-30T17:03:31.165 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.165 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.165 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:31.165 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.771721+0000", 2023-09-30T17:03:31.166 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0037333790000000002 2023-09-30T17:03:31.166 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.166 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:31.166 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.771744+0000", 2023-09-30T17:03:31.166 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3053000000000001e-05 2023-09-30T17:03:31.166 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.166 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:31.166 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.771755+0000", 2023-09-30T17:03:31.166 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0135999999999999e-05 2023-09-30T17:03:31.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.167 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:31.167 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.771821+0000", 2023-09-30T17:03:31.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6524000000000002e-05 2023-09-30T17:03:31.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.167 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:31.167 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.771933+0000", 2023-09-30T17:03:31.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111558 2023-09-30T17:03:31.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:31.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.772045+0000", 2023-09-30T17:03:31.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000112019 2023-09-30T17:03:31.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:31.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.777763+0000", 2023-09-30T17:03:31.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057178209999999997 2023-09-30T17:03:31.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:31.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.787968+0000", 2023-09-30T17:03:31.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010205133 2023-09-30T17:03:31.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:31.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.788137+0000", 2023-09-30T17:03:31.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016922700000000001 2023-09-30T17:03:31.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:31.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.788222+0000", 2023-09-30T17:03:31.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5579000000000002e-05 2023-09-30T17:03:31.169 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:31.170 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:31.170 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:31.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.170 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:37 4.2d 4:b4aa06e9:::100000001f8.0000001d:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-09-30T17:03:31.170 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:26.500137+0000", 2023-09-30T17:03:31.170 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.6242764560000005, 2023-09-30T17:03:31.170 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.01450341, 2023-09-30T17:03:31.170 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:31.170 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:31.170 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:31.171 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:31.171 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:31.171 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 37 2023-09-30T17:03:31.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.171 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:31.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:31.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.500137+0000", 2023-09-30T17:03:31.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:31.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.172 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:31.172 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.500137+0000", 2023-09-30T17:03:31.172 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:31.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.172 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:31.172 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.500139+0000", 2023-09-30T17:03:31.172 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.086e-06 2023-09-30T17:03:31.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.172 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:31.173 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.503855+0000", 2023-09-30T17:03:31.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0037161820000000002 2023-09-30T17:03:31.173 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.173 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:31.173 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.503880+0000", 2023-09-30T17:03:31.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5106e-05 2023-09-30T17:03:31.173 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.173 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:31.173 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.503891+0000", 2023-09-30T17:03:31.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1063999999999999e-05 2023-09-30T17:03:31.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:31.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.503965+0000", 2023-09-30T17:03:31.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3980000000000007e-05 2023-09-30T17:03:31.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:31.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.504085+0000", 2023-09-30T17:03:31.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000119454 2023-09-30T17:03:31.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.175 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:31.175 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.504189+0000", 2023-09-30T17:03:31.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000104127 2023-09-30T17:03:31.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.175 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:31.175 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.510284+0000", 2023-09-30T17:03:31.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060949619999999998 2023-09-30T17:03:31.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:31.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.514567+0000", 2023-09-30T17:03:31.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042826549999999998 2023-09-30T17:03:31.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:31.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.514607+0000", 2023-09-30T17:03:31.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0145999999999998e-05 2023-09-30T17:03:31.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:31.177 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.514640+0000", 2023-09-30T17:03:31.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3648e-05 2023-09-30T17:03:31.177 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:31.177 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:31.177 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:31.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.177 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:40 4.37 4:ef395e89:::100000001f8.00000020:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-09-30T17:03:31.177 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:26.791231+0000", 2023-09-30T17:03:31.177 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.3331820289999996, 2023-09-30T17:03:31.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014453594, 2023-09-30T17:03:31.177 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:31.178 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:31.178 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:31.178 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:31.178 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:31.178 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 40 2023-09-30T17:03:31.178 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.178 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:31.178 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.178 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:31.178 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.791231+0000", 2023-09-30T17:03:31.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:31.178 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:31.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.791231+0000", 2023-09-30T17:03:31.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:31.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:31.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.791234+0000", 2023-09-30T17:03:31.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0169999999999999e-06 2023-09-30T17:03:31.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:31.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.794933+0000", 2023-09-30T17:03:31.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00369952 2023-09-30T17:03:31.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.180 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:31.180 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.794953+0000", 2023-09-30T17:03:31.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9748000000000001e-05 2023-09-30T17:03:31.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.180 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:31.180 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.794982+0000", 2023-09-30T17:03:31.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9237000000000001e-05 2023-09-30T17:03:31.181 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.181 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.181 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:31.181 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.795053+0000", 2023-09-30T17:03:31.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1060000000000001e-05 2023-09-30T17:03:31.181 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.181 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.181 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:31.181 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.795165+0000", 2023-09-30T17:03:31.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000112351 2023-09-30T17:03:31.181 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.181 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.182 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:31.182 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.795268+0000", 2023-09-30T17:03:31.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010299899999999999 2023-09-30T17:03:31.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.182 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:31.182 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.801561+0000", 2023-09-30T17:03:31.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0062930080000000001 2023-09-30T17:03:31.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.182 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:31.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.805616+0000", 2023-09-30T17:03:31.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0040545599999999996 2023-09-30T17:03:31.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:31.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.805654+0000", 2023-09-30T17:03:31.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8498999999999999e-05 2023-09-30T17:03:31.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:31.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:26.805685+0000", 2023-09-30T17:03:31.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0595000000000001e-05 2023-09-30T17:03:31.183 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:31.184 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:31.184 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:31.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.184 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:2039 4.37 4:eff9002a:::100000001f8.00000003:head [write 999424~4096,write 1040384~4096,write 1069056~8192,write 1105920~4096,write 1118208~4096,write 1290240~4096,write 1359872~4096,write 1421312~4096,write 1593344~4096,write 1667072~4096,write 1875968~4096,write 2056192~4096,write 2260992~4096,write 2351104~4096,write 2486272~4096,write 2523136~4096,write 2650112~4096,write 2727936~4096,write 2818048~4096,write 3026944~4096,write 3035136~4096,write 3051520~4096,write 3121152~4096,write 3149824~4096,write 3158016~4096,write 3338240~4096,write 3395584~4096,write 3411968~4096,write 3473408~4096,write 3522560~4096,write 3596288~4096,write 3678208~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-09-30T17:03:31.184 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:30.710385+0000", 2023-09-30T17:03:31.184 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.41402856799999999, 2023-09-30T17:03:31.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014473744, 2023-09-30T17:03:31.184 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:31.184 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:31.184 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:31.185 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:31.185 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:31.185 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 2039 2023-09-30T17:03:31.185 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.185 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:31.185 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.185 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:31.185 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:30.710385+0000", 2023-09-30T17:03:31.185 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:31.185 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.185 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.185 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:31.186 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:30.710385+0000", 2023-09-30T17:03:31.186 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:31.186 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.186 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.186 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:31.186 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:30.710386+0000", 2023-09-30T17:03:31.186 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8899999999999999e-07 2023-09-30T17:03:31.186 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.186 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.186 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:31.186 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:30.710548+0000", 2023-09-30T17:03:31.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016286 2023-09-30T17:03:31.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:31.187 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:30.710564+0000", 2023-09-30T17:03:31.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5741999999999999e-05 2023-09-30T17:03:31.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:31.187 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:30.710572+0000", 2023-09-30T17:03:31.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3010000000000001e-06 2023-09-30T17:03:31.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.188 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:31.188 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:30.710616+0000", 2023-09-30T17:03:31.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4350000000000001e-05 2023-09-30T17:03:31.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.188 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:31.188 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:30.710687+0000", 2023-09-30T17:03:31.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1060000000000001e-05 2023-09-30T17:03:31.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.188 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:31.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:30.711143+0000", 2023-09-30T17:03:31.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00045595 2023-09-30T17:03:31.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:31.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:30.720201+0000", 2023-09-30T17:03:31.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090580669999999995 2023-09-30T17:03:31.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:31.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:30.724780+0000", 2023-09-30T17:03:31.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045788770000000003 2023-09-30T17:03:31.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.190 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:31.190 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:30.724834+0000", 2023-09-30T17:03:31.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3944999999999999e-05 2023-09-30T17:03:31.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.190 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:31.190 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:30.724859+0000", 2023-09-30T17:03:31.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4902999999999999e-05 2023-09-30T17:03:31.190 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:31.190 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:31.191 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:31.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.191 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:2995 4.2c 4:35cbff5f:::100000001f8.00000033:head [write 1245184~4096,write 1318912~4096,write 1671168~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-09-30T17:03:31.191 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:31.073151+0000", 2023-09-30T17:03:31.191 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.051262700000000001, 2023-09-30T17:03:31.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014640633, 2023-09-30T17:03:31.191 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:31.191 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:31.191 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:31.191 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:31.192 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:31.192 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 2995 2023-09-30T17:03:31.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.192 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:31.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:31.192 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.073151+0000", 2023-09-30T17:03:31.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:31.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:31.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.073151+0000", 2023-09-30T17:03:31.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:31.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:31.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.073152+0000", 2023-09-30T17:03:31.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6600000000000005e-07 2023-09-30T17:03:31.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:31.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.073186+0000", 2023-09-30T17:03:31.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4173e-05 2023-09-30T17:03:31.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:31.194 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.073197+0000", 2023-09-30T17:03:31.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0910000000000001e-05 2023-09-30T17:03:31.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:31.194 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.073202+0000", 2023-09-30T17:03:31.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0010000000000001e-06 2023-09-30T17:03:31.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.195 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.195 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:31.195 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.073832+0000", 2023-09-30T17:03:31.195 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00063021799999999999 2023-09-30T17:03:31.195 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.195 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.195 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:31.195 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.073902+0000", 2023-09-30T17:03:31.195 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0185999999999995e-05 2023-09-30T17:03:31.195 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.195 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.195 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:31.196 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.087694+0000", 2023-09-30T17:03:31.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.01379178 2023-09-30T17:03:31.196 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.196 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.196 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:31.196 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.087730+0000", 2023-09-30T17:03:31.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6378000000000003e-05 2023-09-30T17:03:31.196 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.196 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.196 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:31.196 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.087791+0000", 2023-09-30T17:03:31.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1121e-05 2023-09-30T17:03:31.197 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:31.197 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:31.197 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:31.197 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.197 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:2996 4.12 4:4be51a30:::100000001f8.0000000b:head [write 2252800~4096,write 2301952~4096,write 2416640~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-09-30T17:03:31.197 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:31.073468+0000", 2023-09-30T17:03:31.197 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.050945608000000003, 2023-09-30T17:03:31.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017978257000000001, 2023-09-30T17:03:31.197 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:31.197 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:31.198 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:31.198 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:31.198 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:31.198 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 2996 2023-09-30T17:03:31.198 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.198 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:31.198 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.198 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:31.198 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.073468+0000", 2023-09-30T17:03:31.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:31.198 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:31.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.073468+0000", 2023-09-30T17:03:31.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:31.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:31.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.073468+0000", 2023-09-30T17:03:31.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8400000000000005e-07 2023-09-30T17:03:31.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:31.200 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.073529+0000", 2023-09-30T17:03:31.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0414999999999997e-05 2023-09-30T17:03:31.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:31.200 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.073539+0000", 2023-09-30T17:03:31.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0113e-05 2023-09-30T17:03:31.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:31.200 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.073546+0000", 2023-09-30T17:03:31.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4479999999999997e-06 2023-09-30T17:03:31.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.201 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:31.201 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.073632+0000", 2023-09-30T17:03:31.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5741000000000005e-05 2023-09-30T17:03:31.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.201 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:31.201 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.073692+0000", 2023-09-30T17:03:31.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9917999999999998e-05 2023-09-30T17:03:31.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.202 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:31.202 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.073830+0000", 2023-09-30T17:03:31.202 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013761599999999999 2023-09-30T17:03:31.202 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.202 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:31.202 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.087547+0000", 2023-09-30T17:03:31.202 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013717411000000001 2023-09-30T17:03:31.202 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.202 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:31.203 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.091362+0000", 2023-09-30T17:03:31.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003814816 2023-09-30T17:03:31.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.203 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.203 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:31.203 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.091411+0000", 2023-09-30T17:03:31.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8962999999999999e-05 2023-09-30T17:03:31.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.203 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.203 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:31.203 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.091446+0000", 2023-09-30T17:03:31.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5332e-05 2023-09-30T17:03:31.204 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:31.204 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:31.204 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:31.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.204 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:2997 4.36 e38/17 4:6da220e6:::100000001f8.0000003f:head v 38'146, mlcod=38'144)", 2023-09-30T17:03:31.204 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:31.074214+0000", 2023-09-30T17:03:31.204 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.050199291, 2023-09-30T17:03:31.204 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015106174, 2023-09-30T17:03:31.204 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:31.204 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:31.204 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:31.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.205 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:31.205 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.074214+0000", 2023-09-30T17:03:31.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:31.205 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.205 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:31.205 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.074214+0000", 2023-09-30T17:03:31.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:31.205 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.206 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:31.206 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.074215+0000", 2023-09-30T17:03:31.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1099999999999996e-07 2023-09-30T17:03:31.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.206 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:31.206 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.074227+0000", 2023-09-30T17:03:31.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1832e-05 2023-09-30T17:03:31.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.207 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:31.207 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.074235+0000", 2023-09-30T17:03:31.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7360000000000007e-06 2023-09-30T17:03:31.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.207 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:31.207 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.074241+0000", 2023-09-30T17:03:31.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1369999999999999e-06 2023-09-30T17:03:31.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.207 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:31.207 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.074284+0000", 2023-09-30T17:03:31.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2253999999999999e-05 2023-09-30T17:03:31.208 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.208 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:31.208 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.074302+0000", 2023-09-30T17:03:31.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8289999999999999e-05 2023-09-30T17:03:31.208 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.208 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:31.208 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.089280+0000", 2023-09-30T17:03:31.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014978492 2023-09-30T17:03:31.208 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.209 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:31.209 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.089320+0000", 2023-09-30T17:03:31.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9922000000000002e-05 2023-09-30T17:03:31.209 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:31.209 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:31.209 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:31.209 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.209 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:3000 4.37 4:ef395e89:::100000001f8.00000020:head [write 3305472~4096,write 3670016~4096,write 3887104~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-09-30T17:03:31.209 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:31.074421+0000", 2023-09-30T17:03:31.210 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.049992605000000002, 2023-09-30T17:03:31.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017182372000000001, 2023-09-30T17:03:31.210 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:31.210 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:31.210 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:31.210 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:31.210 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:31.210 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 3000 2023-09-30T17:03:31.210 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.210 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:31.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:31.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.074421+0000", 2023-09-30T17:03:31.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:31.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:31.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.074421+0000", 2023-09-30T17:03:31.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:31.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:31.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.074422+0000", 2023-09-30T17:03:31.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0999999999999998e-07 2023-09-30T17:03:31.212 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.212 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:31.212 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.074464+0000", 2023-09-30T17:03:31.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2157000000000003e-05 2023-09-30T17:03:31.212 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.212 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:31.212 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.074471+0000", 2023-09-30T17:03:31.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3780000000000003e-06 2023-09-30T17:03:31.212 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.212 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:31.213 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.074476+0000", 2023-09-30T17:03:31.213 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0520000000000001e-06 2023-09-30T17:03:31.213 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.213 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.213 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:31.213 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.074563+0000", 2023-09-30T17:03:31.213 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7101999999999994e-05 2023-09-30T17:03:31.213 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.213 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.213 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:31.213 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.074637+0000", 2023-09-30T17:03:31.214 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3677999999999995e-05 2023-09-30T17:03:31.214 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.214 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:31.214 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.074784+0000", 2023-09-30T17:03:31.214 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000147214 2023-09-30T17:03:31.214 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.214 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:31.214 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.086546+0000", 2023-09-30T17:03:31.214 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011761667 2023-09-30T17:03:31.215 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.215 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:31.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.091446+0000", 2023-09-30T17:03:31.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0048998169999999999 2023-09-30T17:03:31.215 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.215 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:31.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.091564+0000", 2023-09-30T17:03:31.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000118186 2023-09-30T17:03:31.215 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.216 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:31.216 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.091603+0000", 2023-09-30T17:03:31.216 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9511000000000002e-05 2023-09-30T17:03:31.216 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:31.216 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:31.216 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:31.216 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.216 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.216 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:3001 4.38 4:1dcf718c:::100000001f8.00000022:head [write 958464~4096,write 1056768~4096,write 1265664~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-09-30T17:03:31.216 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:31.074718+0000", 2023-09-30T17:03:31.216 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.049695778000000003, 2023-09-30T17:03:31.216 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015861157000000001, 2023-09-30T17:03:31.217 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:31.217 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:31.217 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:31.217 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:31.217 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:31.217 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 3001 2023-09-30T17:03:31.217 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.217 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:31.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.217 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:31.217 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.074718+0000", 2023-09-30T17:03:31.217 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:31.218 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.218 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.218 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:31.218 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.074718+0000", 2023-09-30T17:03:31.218 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:31.218 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.218 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.218 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:31.218 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.074719+0000", 2023-09-30T17:03:31.218 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3799999999999996e-07 2023-09-30T17:03:31.218 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.219 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:31.219 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.074766+0000", 2023-09-30T17:03:31.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6959999999999998e-05 2023-09-30T17:03:31.219 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.219 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:31.219 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.074775+0000", 2023-09-30T17:03:31.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9740000000000008e-06 2023-09-30T17:03:31.219 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.219 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:31.220 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.074784+0000", 2023-09-30T17:03:31.220 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2560000000000008e-06 2023-09-30T17:03:31.220 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.220 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.220 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:31.220 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.074825+0000", 2023-09-30T17:03:31.220 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1607999999999999e-05 2023-09-30T17:03:31.220 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.220 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.220 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:31.220 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.074882+0000", 2023-09-30T17:03:31.220 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6555000000000003e-05 2023-09-30T17:03:31.221 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.221 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.221 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:31.221 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.090476+0000", 2023-09-30T17:03:31.221 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015593928999999999 2023-09-30T17:03:31.221 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.221 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.221 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:31.221 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.090505+0000", 2023-09-30T17:03:31.221 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9167e-05 2023-09-30T17:03:31.221 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.221 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.221 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:31.222 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.090579+0000", 2023-09-30T17:03:31.222 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3869999999999996e-05 2023-09-30T17:03:31.222 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:31.222 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:31.222 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:31.222 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.222 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.222 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:3003 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 3555328~4096,write 3592192~4096,write 3629056~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-09-30T17:03:31.222 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:31.075291+0000", 2023-09-30T17:03:31.222 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.049122864000000002, 2023-09-30T17:03:31.222 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015068443000000001, 2023-09-30T17:03:31.223 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:31.223 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:31.223 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:31.223 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:31.223 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:31.223 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 3003 2023-09-30T17:03:31.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.223 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:31.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.223 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:31.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.075291+0000", 2023-09-30T17:03:31.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:31.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.224 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.224 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:31.224 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.075291+0000", 2023-09-30T17:03:31.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:31.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.224 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.224 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:31.224 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.075291+0000", 2023-09-30T17:03:31.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0500000000000003e-07 2023-09-30T17:03:31.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.224 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.225 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:31.225 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.075340+0000", 2023-09-30T17:03:31.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8885999999999999e-05 2023-09-30T17:03:31.225 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.225 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.225 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:31.225 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.075350+0000", 2023-09-30T17:03:31.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2799999999999992e-06 2023-09-30T17:03:31.225 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.225 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.225 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:31.226 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.075354+0000", 2023-09-30T17:03:31.226 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9200000000000003e-06 2023-09-30T17:03:31.226 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.226 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.226 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:31.226 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.075401+0000", 2023-09-30T17:03:31.226 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6168999999999998e-05 2023-09-30T17:03:31.226 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.226 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.226 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:31.226 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.075483+0000", 2023-09-30T17:03:31.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2468999999999999e-05 2023-09-30T17:03:31.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:31.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.090208+0000", 2023-09-30T17:03:31.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014724757 2023-09-30T17:03:31.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:31.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.090267+0000", 2023-09-30T17:03:31.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9376999999999997e-05 2023-09-30T17:03:31.228 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.228 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.228 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:31.228 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.090359+0000", 2023-09-30T17:03:31.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1879999999999994e-05 2023-09-30T17:03:31.228 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:31.228 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:31.228 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:31.228 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.228 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.229 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:3002 4.28 e38/17 4:153ae410:::100000001f8.0000003b:head v 38'86, mlcod=38'84)", 2023-09-30T17:03:31.229 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:31.075529+0000", 2023-09-30T17:03:31.229 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.048884236999999997, 2023-09-30T17:03:31.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016179148000000001, 2023-09-30T17:03:31.229 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:31.229 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:31.229 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:31.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.229 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:31.229 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.075529+0000", 2023-09-30T17:03:31.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:31.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.230 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:31.230 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.075529+0000", 2023-09-30T17:03:31.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:31.230 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.230 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:31.230 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.075530+0000", 2023-09-30T17:03:31.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8800000000000003e-07 2023-09-30T17:03:31.230 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.231 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:31.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.075544+0000", 2023-09-30T17:03:31.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4671999999999999e-05 2023-09-30T17:03:31.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.231 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:31.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.075552+0000", 2023-09-30T17:03:31.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9170000000000006e-06 2023-09-30T17:03:31.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.231 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:31.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.075558+0000", 2023-09-30T17:03:31.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0460000000000002e-06 2023-09-30T17:03:31.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:31.232 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.086544+0000", 2023-09-30T17:03:31.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010986068 2023-09-30T17:03:31.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:31.232 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.086566+0000", 2023-09-30T17:03:31.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1426000000000001e-05 2023-09-30T17:03:31.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.233 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.233 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:31.233 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.091676+0000", 2023-09-30T17:03:31.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0051097269999999997 2023-09-30T17:03:31.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.233 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.233 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:31.233 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.091708+0000", 2023-09-30T17:03:31.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2804e-05 2023-09-30T17:03:31.233 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:31.233 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:31.234 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:31.234 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.234 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.234 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:3005 4.12 4:48ab9bde:::100000001f8.00000015:head [write 2072576~4096,write 2383872~4096,write 2428928~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-09-30T17:03:31.234 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:31.075936+0000", 2023-09-30T17:03:31.234 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.048477155000000001, 2023-09-30T17:03:31.234 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015603194000000001, 2023-09-30T17:03:31.234 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:31.234 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:31.234 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:31.234 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:31.234 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:31.235 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 3005 2023-09-30T17:03:31.235 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.235 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:31.235 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.235 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:31.235 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.075936+0000", 2023-09-30T17:03:31.235 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:31.235 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.235 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.235 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:31.235 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.075936+0000", 2023-09-30T17:03:31.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:31.236 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.236 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.236 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:31.236 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.075937+0000", 2023-09-30T17:03:31.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4099999999999997e-07 2023-09-30T17:03:31.236 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.236 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.236 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:31.236 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.075953+0000", 2023-09-30T17:03:31.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5665999999999999e-05 2023-09-30T17:03:31.236 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:31.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.075963+0000", 2023-09-30T17:03:31.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7310000000000005e-06 2023-09-30T17:03:31.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:31.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.075968+0000", 2023-09-30T17:03:31.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9219999999999996e-06 2023-09-30T17:03:31.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:31.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.076012+0000", 2023-09-30T17:03:31.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4505999999999997e-05 2023-09-30T17:03:31.238 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:31.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.076074+0000", 2023-09-30T17:03:31.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1785000000000006e-05 2023-09-30T17:03:31.238 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:31.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.076196+0000", 2023-09-30T17:03:31.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012214600000000001 2023-09-30T17:03:31.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.239 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:31.239 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.089321+0000", 2023-09-30T17:03:31.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013124577 2023-09-30T17:03:31.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.239 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:31.239 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.091454+0000", 2023-09-30T17:03:31.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0021335909999999998 2023-09-30T17:03:31.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.240 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:31.240 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.091501+0000", 2023-09-30T17:03:31.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7091e-05 2023-09-30T17:03:31.240 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.240 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.240 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:31.240 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.091540+0000", 2023-09-30T17:03:31.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8337999999999998e-05 2023-09-30T17:03:31.240 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:31.240 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:31.240 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:31.240 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.241 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:3012 4.12 4:4be51a30:::100000001f8.0000000b:head [write 2859008~4096,write 2891776~4096,write 2961408~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-09-30T17:03:31.241 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:31.078343+0000", 2023-09-30T17:03:31.241 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.046070211, 2023-09-30T17:03:31.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015609381, 2023-09-30T17:03:31.241 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:31.241 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:31.241 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:31.241 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:31.241 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:31.241 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 3012 2023-09-30T17:03:31.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.242 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:31.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:31.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.078343+0000", 2023-09-30T17:03:31.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:31.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:31.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.078343+0000", 2023-09-30T17:03:31.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:31.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:31.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.078345+0000", 2023-09-30T17:03:31.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.362e-06 2023-09-30T17:03:31.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:31.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.078356+0000", 2023-09-30T17:03:31.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1116e-05 2023-09-30T17:03:31.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:31.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.078368+0000", 2023-09-30T17:03:31.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2092999999999999e-05 2023-09-30T17:03:31.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:31.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.078374+0000", 2023-09-30T17:03:31.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4060000000000002e-06 2023-09-30T17:03:31.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:31.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.087645+0000", 2023-09-30T17:03:31.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0092703590000000006 2023-09-30T17:03:31.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.245 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:31.245 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.087695+0000", 2023-09-30T17:03:31.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0634999999999999e-05 2023-09-30T17:03:31.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.245 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:31.245 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.087796+0000", 2023-09-30T17:03:31.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010024800000000001 2023-09-30T17:03:31.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.246 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:31.246 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.091669+0000", 2023-09-30T17:03:31.246 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038738079999999999 2023-09-30T17:03:31.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.246 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:31.246 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.093869+0000", 2023-09-30T17:03:31.246 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0021992349999999999 2023-09-30T17:03:31.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:31.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.093919+0000", 2023-09-30T17:03:31.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0654e-05 2023-09-30T17:03:31.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:31.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.093953+0000", 2023-09-30T17:03:31.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3464999999999999e-05 2023-09-30T17:03:31.247 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:31.247 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:31.247 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:31.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.248 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:3014 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 278528~4096,write 352256~4096,write 389120~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-09-30T17:03:31.248 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:31.078861+0000", 2023-09-30T17:03:31.248 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.045552082000000001, 2023-09-30T17:03:31.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014731147, 2023-09-30T17:03:31.248 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:31.248 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:31.248 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:31.248 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:31.248 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:31.248 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 3014 2023-09-30T17:03:31.248 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.248 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:31.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.249 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:31.249 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.078861+0000", 2023-09-30T17:03:31.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:31.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.249 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:31.249 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.078861+0000", 2023-09-30T17:03:31.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:31.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.249 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:31.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.078862+0000", 2023-09-30T17:03:31.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1299999999999999e-07 2023-09-30T17:03:31.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:31.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.078877+0000", 2023-09-30T17:03:31.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5047e-05 2023-09-30T17:03:31.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:31.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.078888+0000", 2023-09-30T17:03:31.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0395e-05 2023-09-30T17:03:31.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:31.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.078895+0000", 2023-09-30T17:03:31.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9890000000000003e-06 2023-09-30T17:03:31.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:31.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.086587+0000", 2023-09-30T17:03:31.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0076920909999999999 2023-09-30T17:03:31.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:31.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.086670+0000", 2023-09-30T17:03:31.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3449999999999996e-05 2023-09-30T17:03:31.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:31.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.093453+0000", 2023-09-30T17:03:31.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0067824970000000002 2023-09-30T17:03:31.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:31.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.093495+0000", 2023-09-30T17:03:31.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2267e-05 2023-09-30T17:03:31.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:31.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:31.253 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:31.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.093593+0000", 2023-09-30T17:03:31.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7597999999999996e-05 2023-09-30T17:03:31.253 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:31.253 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:31.253 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:31.253 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:31.253 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:31.253 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:31.255 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:31.254+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:31.255 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:03:31.356 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:31.356+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:31.440 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-09-30T17:03:31.440 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-09-30T17:03:31.448 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:31.448 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:03:31.448 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:31.448 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:4038 4.6 4:616d4c41:::100000001f8.00000034:head [write 3842048~4096 in=4096b,write 3850240~4096 in=4096b,write 3911680~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-09-30T17:03:31.448 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:31.444722+0000", 2023-09-30T17:03:31.449 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0038867900000000002, 2023-09-30T17:03:31.449 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0038916100000000002, 2023-09-30T17:03:31.449 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:31.449 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:31.449 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:31.449 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:31.449 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:31.449 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 4038 2023-09-30T17:03:31.449 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:31.449 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:31.449 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:31.450 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:31.450 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.444722+0000", 2023-09-30T17:03:31.450 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:31.450 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:31.450 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:31.450 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:31.450 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.444722+0000", 2023-09-30T17:03:31.450 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:31.450 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:31.450 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:31.450 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:31.451 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.444722+0000", 2023-09-30T17:03:31.451 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3600000000000003e-07 2023-09-30T17:03:31.451 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:31.451 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:31.451 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:31.451 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.444736+0000", 2023-09-30T17:03:31.451 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3351e-05 2023-09-30T17:03:31.451 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:31.451 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:31.451 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:31.451 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.444746+0000", 2023-09-30T17:03:31.452 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.012e-05 2023-09-30T17:03:31.452 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:31.452 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:31.452 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:31.452 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.444751+0000", 2023-09-30T17:03:31.452 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1930000000000001e-06 2023-09-30T17:03:31.452 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:31.452 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:31.452 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:31.452 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.444791+0000", 2023-09-30T17:03:31.452 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9714e-05 2023-09-30T17:03:31.453 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:31.453 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:31.453 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:31.453 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.444841+0000", 2023-09-30T17:03:31.453 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0371999999999998e-05 2023-09-30T17:03:31.453 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:31.453 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:31.453 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:31.453 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.444932+0000", 2023-09-30T17:03:31.453 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1145999999999998e-05 2023-09-30T17:03:31.453 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:31.454 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:31.454 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:31.454 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.446164+0000", 2023-09-30T17:03:31.454 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001231287 2023-09-30T17:03:31.454 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:31.454 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:31.454 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:31.454 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.448561+0000", 2023-09-30T17:03:31.454 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0023978250000000001 2023-09-30T17:03:31.454 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:31.454 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:31.455 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:31.455 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.448594+0000", 2023-09-30T17:03:31.455 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.2447000000000003e-05 2023-09-30T17:03:31.455 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:31.455 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:31.455 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:31.455 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.448613+0000", 2023-09-30T17:03:31.455 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9419000000000002e-05 2023-09-30T17:03:31.455 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:31.455 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:31.455 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:31.455 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:31.456 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:31.456 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:4042 4.36 4:6fa85f86:::100000001f8.00000013:head [write 1335296~4096 in=4096b,write 1363968~4096 in=4096b,write 1376256~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-09-30T17:03:31.456 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:31.446551+0000", 2023-09-30T17:03:31.456 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0020573089999999998, 2023-09-30T17:03:31.456 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0021769530000000001, 2023-09-30T17:03:31.456 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:31.456 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:31.456 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:31.456 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:31.456 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:31.456 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 4042 2023-09-30T17:03:31.457 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:31.457 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:31.457 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:31.457 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:31.457 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.446551+0000", 2023-09-30T17:03:31.457 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:31.457 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:31.457 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:31.457 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:31.457 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.446551+0000", 2023-09-30T17:03:31.457 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:31.458 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:31.458 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:31.458 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:31.458 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.446552+0000", 2023-09-30T17:03:31.458 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8400000000000004e-07 2023-09-30T17:03:31.458 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:31.458 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:31.458 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:31.458 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.446564+0000", 2023-09-30T17:03:31.458 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1807000000000001e-05 2023-09-30T17:03:31.458 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:31.458 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:31.459 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:31.459 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.446574+0000", 2023-09-30T17:03:31.459 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0261999999999999e-05 2023-09-30T17:03:31.459 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:31.459 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:31.459 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:31.459 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.446579+0000", 2023-09-30T17:03:31.459 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2179999999999998e-06 2023-09-30T17:03:31.459 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:31.459 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:31.459 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:31.460 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.446620+0000", 2023-09-30T17:03:31.460 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0419e-05 2023-09-30T17:03:31.460 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:31.460 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:31.460 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:31.460 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.446666+0000", 2023-09-30T17:03:31.460 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6773000000000001e-05 2023-09-30T17:03:31.460 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:31.460 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:31.460 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:31.461 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.446758+0000", 2023-09-30T17:03:31.461 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1592e-05 2023-09-30T17:03:31.461 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:31.461 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:31.461 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:31.461 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:31.461 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:31.461 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:4045 4.3 4:c222b65c:::100000001f8.00000021:head [write 716800~4096 in=4096b,write 831488~4096 in=4096b,write 1478656~12288 in=12288b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-09-30T17:03:31.461 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:31.447626+0000", 2023-09-30T17:03:31.461 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.00098243700000000007, 2023-09-30T17:03:31.461 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0011522150000000001, 2023-09-30T17:03:31.461 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:31.461 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:31.462 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:31.462 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:31.462 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:31.462 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 4045 2023-09-30T17:03:31.462 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:31.462 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:31.462 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:31.462 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:31.462 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.447626+0000", 2023-09-30T17:03:31.462 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:31.463 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:31.463 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:31.463 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:31.463 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.447626+0000", 2023-09-30T17:03:31.463 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:31.463 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:31.463 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:31.463 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:31.463 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.447627+0000", 2023-09-30T17:03:31.463 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0399999999999996e-07 2023-09-30T17:03:31.463 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:31.463 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:31.464 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:31.464 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.447644+0000", 2023-09-30T17:03:31.464 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7187e-05 2023-09-30T17:03:31.464 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:31.464 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:31.464 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:31.464 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.447654+0000", 2023-09-30T17:03:31.464 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0192e-05 2023-09-30T17:03:31.464 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:31.464 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:31.464 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:31.464 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.447659+0000", 2023-09-30T17:03:31.465 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8640000000000004e-06 2023-09-30T17:03:31.465 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:31.465 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:31.465 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:31.465 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.447722+0000", 2023-09-30T17:03:31.465 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2988000000000001e-05 2023-09-30T17:03:31.465 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:31.465 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:31.465 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:31.465 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.447826+0000", 2023-09-30T17:03:31.466 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000104094 2023-09-30T17:03:31.466 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:31.466 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:31.466 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:31.466 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:31.466 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:31.466 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:4046 4.3f 4:fde182c5:::100000001f8.00000039:head [write 3371008~4096 in=4096b,write 3387392~4096 in=4096b,write 3452928~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-09-30T17:03:31.466 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:31.448290+0000", 2023-09-30T17:03:31.466 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.00031803400000000003, 2023-09-30T17:03:31.466 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00052924999999999999, 2023-09-30T17:03:31.466 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:31.467 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:31.467 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:31.467 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:31.467 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:31.467 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 4046 2023-09-30T17:03:31.467 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:31.467 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:31.467 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:31.467 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:31.467 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.448290+0000", 2023-09-30T17:03:31.467 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:31.468 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:31.468 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:31.468 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:31.468 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.448290+0000", 2023-09-30T17:03:31.468 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:31.468 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:31.468 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:31.468 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:31.468 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.448291+0000", 2023-09-30T17:03:31.468 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7800000000000002e-07 2023-09-30T17:03:31.468 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:31.468 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:31.469 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:31.469 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.448300+0000", 2023-09-30T17:03:31.469 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3710000000000006e-06 2023-09-30T17:03:31.469 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:31.469 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:31.469 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:31.469 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.448313+0000", 2023-09-30T17:03:31.469 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2493999999999999e-05 2023-09-30T17:03:31.469 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:31.469 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:31.469 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:31.469 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.448317+0000", 2023-09-30T17:03:31.470 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2699999999999998e-06 2023-09-30T17:03:31.470 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:31.470 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:31.470 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:31.470 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.448368+0000", 2023-09-30T17:03:31.470 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1436e-05 2023-09-30T17:03:31.470 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:31.470 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:31.470 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:31.470 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.448470+0000", 2023-09-30T17:03:31.470 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010199100000000001 2023-09-30T17:03:31.471 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:31.471 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:31.471 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:31.471 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.448636+0000", 2023-09-30T17:03:31.471 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000165088 2023-09-30T17:03:31.471 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:31.471 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:31.471 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:31.471 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:31.471 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-09-30T17:03:31.471 INFO:teuthology.orchestra.run.smithi031.stdout: "num_ops": 4 2023-09-30T17:03:31.471 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:31.475 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:31.474+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:31.475 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:03:31.575 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:31.574+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:31.622 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:03:31.644 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:03:31.644 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-09-30T17:03:31.644 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-09-30T17:03:31.645 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:03:31.647 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:03:31.648 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:03:31.652 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:31.653 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:31.665 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:03:31.706 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:31.706+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:31.778 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:31.778+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:31.879 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:31.879+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:31.880 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:31.881 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:31.895 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:03:31.979 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:31.979+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:32.066 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:32.066 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:32.077 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:03:32.080 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:32.080+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:32.180 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:32.180+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:32.250 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:32.250 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:32.262 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:03:32.281 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:32.281+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:32.382 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:32.382+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:32.403 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is unset 2023-09-30T17:03:32.428 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:32.428 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:32.443 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:03:32.486 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:32.486+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:32.584 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:32.583+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:32.638 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:32.638 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:32.654 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:03:32.694 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:32.694+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:32.786 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:32.786+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:32.868 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:32.868 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:32.879 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:03:32.886 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:32.887+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:32.987 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:32.987+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:33.053 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:33.078 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:33.080 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:03:33.122 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:33.121+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:33.188 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:33.188+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:33.254 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:33.254 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:33.267 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:03:33.289 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:33.288+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:33.389 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:33.390+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:33.435 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:33.435 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:33.449 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:03:33.490 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:33.490+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:33.590 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:33.590+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:33.649 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-09-30T17:03:33.663 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:33.663 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:33.676 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:03:33.691 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:33.691+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:33.792 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:33.791+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:33.819 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:03:33.842 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:03:33.842 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-09-30T17:03:33.842 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-09-30T17:03:33.842 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:03:33.845 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:03:33.846 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:03:33.855 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:33.855 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:03:33.855 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.855 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:10438 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 3833856~4096 in=4096b,write 3899392~4096 in=4096b,write 4091904~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-09-30T17:03:33.855 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:33.850865+0000", 2023-09-30T17:03:33.855 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0040445380000000003, 2023-09-30T17:03:33.856 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.004071257, 2023-09-30T17:03:33.856 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:33.856 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:33.856 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:33.856 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:33.856 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:33.856 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 10438 2023-09-30T17:03:33.856 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.856 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:33.856 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.856 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:33.857 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.850865+0000", 2023-09-30T17:03:33.857 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:33.857 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.857 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.857 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:33.857 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.850865+0000", 2023-09-30T17:03:33.857 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:33.857 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.857 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.857 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:33.857 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.850866+0000", 2023-09-30T17:03:33.857 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3900000000000004e-07 2023-09-30T17:03:33.858 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.858 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.858 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:33.858 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.850886+0000", 2023-09-30T17:03:33.858 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9527000000000001e-05 2023-09-30T17:03:33.858 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.858 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.858 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:33.858 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.850892+0000", 2023-09-30T17:03:33.858 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2330000000000003e-06 2023-09-30T17:03:33.858 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.859 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.859 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:33.859 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.850896+0000", 2023-09-30T17:03:33.859 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3379999999999998e-06 2023-09-30T17:03:33.859 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.859 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.859 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:33.859 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.850938+0000", 2023-09-30T17:03:33.859 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1990000000000003e-05 2023-09-30T17:03:33.859 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.859 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.860 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:33.860 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.851025+0000", 2023-09-30T17:03:33.860 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.7000000000000001e-05 2023-09-30T17:03:33.860 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.860 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.860 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:33.860 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.851186+0000", 2023-09-30T17:03:33.860 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016104800000000001 2023-09-30T17:03:33.860 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.860 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.860 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:33.860 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.853062+0000", 2023-09-30T17:03:33.861 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0018761990000000001 2023-09-30T17:03:33.861 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:33.861 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:33.861 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:33.861 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.861 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.861 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:10439 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 2560000~4096 in=4096b,write 2752512~4096 in=4096b,write 2809856~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-09-30T17:03:33.861 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:33.851169+0000", 2023-09-30T17:03:33.861 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0037405020000000001, 2023-09-30T17:03:33.861 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0038579339999999999, 2023-09-30T17:03:33.861 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:33.862 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:33.862 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:33.862 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:33.862 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:33.862 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 10439 2023-09-30T17:03:33.862 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.862 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:33.862 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.862 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:33.862 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.851169+0000", 2023-09-30T17:03:33.862 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:33.863 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.863 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.863 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:33.863 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.851169+0000", 2023-09-30T17:03:33.863 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:33.863 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.863 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.863 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:33.863 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.851170+0000", 2023-09-30T17:03:33.863 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0500000000000003e-07 2023-09-30T17:03:33.863 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.863 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.864 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:33.864 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.851181+0000", 2023-09-30T17:03:33.864 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0573e-05 2023-09-30T17:03:33.864 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.864 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.864 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:33.864 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.851192+0000", 2023-09-30T17:03:33.864 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1912999999999999e-05 2023-09-30T17:03:33.864 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.864 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.864 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:33.865 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.851198+0000", 2023-09-30T17:03:33.865 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3990000000000003e-06 2023-09-30T17:03:33.865 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.865 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.865 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:33.865 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.852389+0000", 2023-09-30T17:03:33.865 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001191239 2023-09-30T17:03:33.865 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.865 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.865 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:33.865 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.852438+0000", 2023-09-30T17:03:33.865 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9206999999999998e-05 2023-09-30T17:03:33.866 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.866 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.866 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:33.866 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.852527+0000", 2023-09-30T17:03:33.866 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8591999999999995e-05 2023-09-30T17:03:33.866 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:33.866 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:33.866 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:33.866 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.866 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.866 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:10441 4.1c 4:39b842ef:::100000001f8.00000029:head [write 3317760~4096 in=4096b,write 3342336~4096 in=4096b,write 3371008~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-09-30T17:03:33.867 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:33.851702+0000", 2023-09-30T17:03:33.867 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0032081050000000002, 2023-09-30T17:03:33.867 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0034160950000000001, 2023-09-30T17:03:33.867 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:33.867 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:33.867 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:33.867 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:33.867 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:33.867 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 10441 2023-09-30T17:03:33.867 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.867 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:33.867 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.868 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:33.868 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.851702+0000", 2023-09-30T17:03:33.868 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:33.868 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.868 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.868 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:33.868 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.851702+0000", 2023-09-30T17:03:33.868 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:33.868 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.868 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.868 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:33.869 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.851702+0000", 2023-09-30T17:03:33.869 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8500000000000001e-07 2023-09-30T17:03:33.869 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.869 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.869 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:33.869 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.851714+0000", 2023-09-30T17:03:33.869 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.154e-05 2023-09-30T17:03:33.869 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.869 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.869 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:33.869 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.851722+0000", 2023-09-30T17:03:33.869 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0700000000000007e-06 2023-09-30T17:03:33.870 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.870 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.870 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:33.870 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.851726+0000", 2023-09-30T17:03:33.870 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2169999999999996e-06 2023-09-30T17:03:33.870 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.870 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.870 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:33.870 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.851761+0000", 2023-09-30T17:03:33.870 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5293999999999998e-05 2023-09-30T17:03:33.870 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.870 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.871 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:33.871 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.851831+0000", 2023-09-30T17:03:33.871 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9216999999999998e-05 2023-09-30T17:03:33.871 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.871 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.871 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:33.871 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.851980+0000", 2023-09-30T17:03:33.871 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014905300000000001 2023-09-30T17:03:33.871 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.871 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.871 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:33.871 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.853676+0000", 2023-09-30T17:03:33.872 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001696021 2023-09-30T17:03:33.872 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:33.872 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:33.872 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:33.872 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.872 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.872 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:10443 4.22 4:47e99c31:::100000001f8.00000025:head [write 2809856~4096 in=4096b,write 2846720~4096 in=4096b,write 3469312~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-09-30T17:03:33.872 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:33.852674+0000", 2023-09-30T17:03:33.872 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0022357340000000001, 2023-09-30T17:03:33.872 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0025320049999999999, 2023-09-30T17:03:33.872 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:33.873 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:33.873 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:33.873 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:33.873 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:33.873 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 10443 2023-09-30T17:03:33.873 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.873 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:33.873 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.873 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:33.873 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.852674+0000", 2023-09-30T17:03:33.873 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:33.873 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.874 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.874 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:33.874 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.852674+0000", 2023-09-30T17:03:33.874 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:33.874 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.874 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.874 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:33.874 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.852675+0000", 2023-09-30T17:03:33.874 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5600000000000004e-07 2023-09-30T17:03:33.874 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.874 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.874 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:33.875 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.852687+0000", 2023-09-30T17:03:33.875 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1535000000000001e-05 2023-09-30T17:03:33.875 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.875 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.875 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:33.875 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.852702+0000", 2023-09-30T17:03:33.875 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5705999999999998e-05 2023-09-30T17:03:33.875 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.875 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.875 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:33.875 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.852711+0000", 2023-09-30T17:03:33.876 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2e-06 2023-09-30T17:03:33.876 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.876 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.876 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:33.876 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.852793+0000", 2023-09-30T17:03:33.876 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1936999999999998e-05 2023-09-30T17:03:33.876 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.876 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.876 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:33.876 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.852891+0000", 2023-09-30T17:03:33.876 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7860000000000002e-05 2023-09-30T17:03:33.876 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:33.877 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:33.877 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:33.877 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.877 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.877 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:10444 4.2d e39/17 4:b7099a35:::100000001f8.0000000e:head v 39'334, mlcod=39'331)", 2023-09-30T17:03:33.877 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:33.853419+0000", 2023-09-30T17:03:33.877 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.001490526, 2023-09-30T17:03:33.877 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001853155, 2023-09-30T17:03:33.877 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:33.877 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:33.877 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:33.878 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.878 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:33.878 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.853419+0000", 2023-09-30T17:03:33.878 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:33.878 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.878 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.878 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:33.878 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.853419+0000", 2023-09-30T17:03:33.878 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:33.878 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.879 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.879 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:33.879 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.853420+0000", 2023-09-30T17:03:33.879 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7899999999999999e-07 2023-09-30T17:03:33.879 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.879 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.879 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:33.879 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.853434+0000", 2023-09-30T17:03:33.879 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4062e-05 2023-09-30T17:03:33.879 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.879 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.880 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:33.880 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.853442+0000", 2023-09-30T17:03:33.880 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2099999999999993e-06 2023-09-30T17:03:33.880 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.880 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.880 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:33.880 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.853447+0000", 2023-09-30T17:03:33.880 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6399999999999996e-06 2023-09-30T17:03:33.880 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.880 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.880 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:33.881 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.853483+0000", 2023-09-30T17:03:33.881 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5855000000000001e-05 2023-09-30T17:03:33.881 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.881 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.881 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:33.881 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.853493+0000", 2023-09-30T17:03:33.881 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0776e-05 2023-09-30T17:03:33.881 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:33.881 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:33.881 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:33.881 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.882 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.882 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:10445 4.1c 4:39b842ef:::100000001f8.00000029:head [write 3411968~4096 in=4096b,write 3424256~4096 in=4096b,write 3588096~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-09-30T17:03:33.882 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:33.853765+0000", 2023-09-30T17:03:33.882 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0011448039999999999, 2023-09-30T17:03:33.882 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0015832260000000001, 2023-09-30T17:03:33.882 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:33.882 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:33.882 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:33.882 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:33.882 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:33.882 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 10445 2023-09-30T17:03:33.883 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.883 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:33.883 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.883 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:33.883 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.853765+0000", 2023-09-30T17:03:33.883 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:33.883 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.883 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.883 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:33.883 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.853765+0000", 2023-09-30T17:03:33.883 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:33.883 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.883 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.884 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:33.884 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.853766+0000", 2023-09-30T17:03:33.884 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7599999999999997e-07 2023-09-30T17:03:33.884 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.884 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.884 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:33.884 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.853777+0000", 2023-09-30T17:03:33.884 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1449e-05 2023-09-30T17:03:33.884 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.884 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.884 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:33.884 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.853790+0000", 2023-09-30T17:03:33.885 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3038e-05 2023-09-30T17:03:33.885 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.885 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.885 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:33.885 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.853799+0000", 2023-09-30T17:03:33.885 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2399999999999996e-06 2023-09-30T17:03:33.885 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.885 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.885 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:33.885 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.853845+0000", 2023-09-30T17:03:33.885 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5800999999999997e-05 2023-09-30T17:03:33.885 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.886 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.886 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:33.886 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.853910+0000", 2023-09-30T17:03:33.886 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4904000000000001e-05 2023-09-30T17:03:33.886 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.886 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.886 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:33.886 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.854060+0000", 2023-09-30T17:03:33.886 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014958699999999999 2023-09-30T17:03:33.886 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:33.886 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:33.886 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:33.887 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.887 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.887 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:10446 4.6 4:63e80496:::100000001f8.0000001e:head [write 126976~4096 in=4096b,write 786432~4096 in=4096b,write 806912~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-09-30T17:03:33.887 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:33.854549+0000", 2023-09-30T17:03:33.887 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.00036076000000000001, 2023-09-30T17:03:33.887 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00089562300000000001, 2023-09-30T17:03:33.887 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:33.887 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:33.887 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:33.887 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:33.887 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:33.887 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 10446 2023-09-30T17:03:33.888 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.888 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:33.888 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.888 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:33.888 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.854549+0000", 2023-09-30T17:03:33.888 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:33.888 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.888 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.888 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:33.888 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.854549+0000", 2023-09-30T17:03:33.888 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:33.888 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.889 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.889 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:33.889 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.854550+0000", 2023-09-30T17:03:33.889 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2699999999999999e-07 2023-09-30T17:03:33.889 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.889 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.889 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:33.889 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.854561+0000", 2023-09-30T17:03:33.889 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1053000000000001e-05 2023-09-30T17:03:33.889 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.889 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.889 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:33.889 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.854571+0000", 2023-09-30T17:03:33.890 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0484e-05 2023-09-30T17:03:33.890 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.890 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.890 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:33.890 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.854576+0000", 2023-09-30T17:03:33.890 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0719999999999999e-06 2023-09-30T17:03:33.890 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.890 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.890 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:33.890 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.854655+0000", 2023-09-30T17:03:33.890 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8391000000000002e-05 2023-09-30T17:03:33.890 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.891 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.891 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:33.891 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.854722+0000", 2023-09-30T17:03:33.891 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.6983999999999994e-05 2023-09-30T17:03:33.891 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.891 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.891 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:33.891 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.854818+0000", 2023-09-30T17:03:33.891 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.6102999999999998e-05 2023-09-30T17:03:33.891 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:33.891 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:33.891 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:33.892 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.892 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.892 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop_reply(client.4547.0:10438 4.6 e39/17)", 2023-09-30T17:03:33.892 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:33.854689+0000", 2023-09-30T17:03:33.892 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.00022086799999999999, 2023-09-30T17:03:33.892 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00081417800000000004, 2023-09-30T17:03:33.892 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:33.892 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:33.892 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:33.892 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.892 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:33.893 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.854689+0000", 2023-09-30T17:03:33.893 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:33.893 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.893 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.893 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:33.893 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.854689+0000", 2023-09-30T17:03:33.893 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:33.893 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.893 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.893 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:33.893 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.854690+0000", 2023-09-30T17:03:33.893 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0500000000000004e-07 2023-09-30T17:03:33.894 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.894 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.894 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:33.894 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.854692+0000", 2023-09-30T17:03:33.894 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.9179999999999998e-06 2023-09-30T17:03:33.894 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.894 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.894 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:33.894 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.854702+0000", 2023-09-30T17:03:33.894 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.9869999999999994e-06 2023-09-30T17:03:33.894 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.894 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.895 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:33.895 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.854707+0000", 2023-09-30T17:03:33.895 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.442e-06 2023-09-30T17:03:33.895 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:33.895 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:33.895 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:33.895 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.895 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.895 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:10449 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-09-30T17:03:33.895 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:33.855497+0000", 2023-09-30T17:03:33.895 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.999413, 2023-09-30T17:03:33.895 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3962999999999999e-05, 2023-09-30T17:03:33.895 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:33.896 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:33.896 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:33.896 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:33.896 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:33.896 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 10449 2023-09-30T17:03:33.896 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.896 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:33.896 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.896 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:33.896 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.855497+0000", 2023-09-30T17:03:33.896 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:33.897 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.897 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.897 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:33.897 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.855497+0000", 2023-09-30T17:03:33.897 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:33.897 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.897 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.897 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:33.897 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.855498+0000", 2023-09-30T17:03:33.897 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.4200000000000004e-07 2023-09-30T17:03:33.897 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.897 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.898 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:33.898 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.855509+0000", 2023-09-30T17:03:33.898 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1501000000000001e-05 2023-09-30T17:03:33.898 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.898 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.898 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:33.898 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.855522+0000", 2023-09-30T17:03:33.898 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2774e-05 2023-09-30T17:03:33.898 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:33.898 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:33.898 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:33.898 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.855528+0000", 2023-09-30T17:03:33.899 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.485e-06 2023-09-30T17:03:33.899 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:33.899 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:33.899 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:33.899 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:33.899 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-09-30T17:03:33.899 INFO:teuthology.orchestra.run.smithi031.stdout: "num_ops": 9 2023-09-30T17:03:33.899 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:33.900 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:03:33.901 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:33.900+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:34.000 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:34.001+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:34.101 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:34.101+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:34.122 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:34.122 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:03:34.122 INFO:teuthology.orchestra.run.smithi031.stdout: "complaint_time": 30, 2023-09-30T17:03:34.122 INFO:teuthology.orchestra.run.smithi031.stdout: "num_blocked_ops": 0 2023-09-30T17:03:34.123 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:34.138 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:03:34.202 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:34.202+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:34.302 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:34.302+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:34.329 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:34.329 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 20, 2023-09-30T17:03:34.329 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 600, 2023-09-30T17:03:34.329 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:03:34.330 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.330 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:34.330 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:03:34.330 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 75.975836834000006, 2023-09-30T17:03:34.330 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.025313649000000001, 2023-09-30T17:03:34.330 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:34.330 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:34.330 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:34.330 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.330 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:34.330 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:03:34.331 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:34.331 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.331 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.331 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:34.331 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:03:34.331 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:34.331 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.331 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.331 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:34.331 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351551+0000", 2023-09-30T17:03:34.331 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3380000000000004e-06 2023-09-30T17:03:34.331 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.332 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.332 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:34.332 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351559+0000", 2023-09-30T17:03:34.332 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9589999999999995e-06 2023-09-30T17:03:34.332 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.332 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.332 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:34.332 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351571+0000", 2023-09-30T17:03:34.332 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2065999999999999e-05 2023-09-30T17:03:34.332 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.332 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.332 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:34.333 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351706+0000", 2023-09-30T17:03:34.333 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00013553799999999999 2023-09-30T17:03:34.333 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.333 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.333 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:34.333 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353016+0000", 2023-09-30T17:03:34.333 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0013099209999999999 2023-09-30T17:03:34.333 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.333 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.333 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:34.333 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353023+0000", 2023-09-30T17:03:34.334 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2479999999999999e-06 2023-09-30T17:03:34.334 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.334 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.334 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:34.334 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360348+0000", 2023-09-30T17:03:34.334 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0073248949999999997 2023-09-30T17:03:34.334 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.334 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.334 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:34.334 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360787+0000", 2023-09-30T17:03:34.334 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00043875199999999999 2023-09-30T17:03:34.334 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.335 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.335 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:34.335 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360892+0000", 2023-09-30T17:03:34.335 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010508199999999999 2023-09-30T17:03:34.335 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.335 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.335 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:34.335 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365132+0000", 2023-09-30T17:03:34.335 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0042396480000000004 2023-09-30T17:03:34.335 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.335 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.335 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:34.336 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376746+0000", 2023-09-30T17:03:34.336 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011614157 2023-09-30T17:03:34.336 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.336 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.336 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:34.336 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376811+0000", 2023-09-30T17:03:34.336 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5005999999999994e-05 2023-09-30T17:03:34.336 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.336 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.336 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:34.336 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376859+0000", 2023-09-30T17:03:34.336 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8038999999999999e-05 2023-09-30T17:03:34.337 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:34.337 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:34.337 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:34.337 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.337 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.337 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:34.337 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:03:34.337 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 75.975339035000005, 2023-09-30T17:03:34.337 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024923989000000001, 2023-09-30T17:03:34.337 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:34.337 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:34.337 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:34.338 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.338 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:34.338 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:03:34.338 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:34.338 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.338 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.338 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:34.341 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:03:34.341 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:34.341 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.341 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.341 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:34.342 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352044+0000", 2023-09-30T17:03:34.342 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9199999999999999e-07 2023-09-30T17:03:34.342 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.342 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.342 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:34.342 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352050+0000", 2023-09-30T17:03:34.342 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8880000000000002e-06 2023-09-30T17:03:34.342 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.342 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.342 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:34.342 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352143+0000", 2023-09-30T17:03:34.343 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2721999999999998e-05 2023-09-30T17:03:34.343 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.343 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.343 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:34.343 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352155+0000", 2023-09-30T17:03:34.343 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2279000000000001e-05 2023-09-30T17:03:34.343 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.343 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.343 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:34.343 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353114+0000", 2023-09-30T17:03:34.343 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00095943700000000005 2023-09-30T17:03:34.343 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.344 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.344 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:34.344 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353121+0000", 2023-09-30T17:03:34.344 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.494e-06 2023-09-30T17:03:34.344 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.344 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.344 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:34.344 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361491+0000", 2023-09-30T17:03:34.344 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0083697359999999991 2023-09-30T17:03:34.344 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.344 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.344 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:34.345 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361573+0000", 2023-09-30T17:03:34.345 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2822000000000001e-05 2023-09-30T17:03:34.345 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.345 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.345 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:34.345 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362166+0000", 2023-09-30T17:03:34.345 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00059223299999999995 2023-09-30T17:03:34.345 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.345 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.345 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:34.345 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365209+0000", 2023-09-30T17:03:34.345 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.003043212 2023-09-30T17:03:34.346 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.346 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.346 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:34.346 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376910+0000", 2023-09-30T17:03:34.346 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011700898 2023-09-30T17:03:34.346 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.346 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.346 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:34.346 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376945+0000", 2023-09-30T17:03:34.346 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4795000000000001e-05 2023-09-30T17:03:34.346 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.347 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.347 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:34.347 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376967+0000", 2023-09-30T17:03:34.347 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2580999999999999e-05 2023-09-30T17:03:34.347 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:34.347 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:34.347 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:34.347 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.347 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.347 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:34.347 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:03:34.347 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 75.975169115, 2023-09-30T17:03:34.348 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023120405, 2023-09-30T17:03:34.348 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:34.348 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:34.348 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:34.348 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.348 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:34.348 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:03:34.348 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:34.348 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.348 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.348 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:34.348 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:03:34.349 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:34.349 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.349 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.349 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:34.349 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352214+0000", 2023-09-30T17:03:34.349 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8400000000000003e-07 2023-09-30T17:03:34.349 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.349 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.349 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:34.349 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352233+0000", 2023-09-30T17:03:34.349 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8946000000000001e-05 2023-09-30T17:03:34.349 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.350 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.350 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:34.350 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352297+0000", 2023-09-30T17:03:34.350 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3540999999999994e-05 2023-09-30T17:03:34.350 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.350 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.350 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:34.350 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352450+0000", 2023-09-30T17:03:34.350 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015364799999999999 2023-09-30T17:03:34.350 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.350 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.350 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:34.351 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353098+0000", 2023-09-30T17:03:34.351 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00064820299999999997 2023-09-30T17:03:34.351 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.351 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.351 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:34.351 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353103+0000", 2023-09-30T17:03:34.351 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0529999999999997e-06 2023-09-30T17:03:34.351 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.351 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.351 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:34.351 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.358558+0000", 2023-09-30T17:03:34.352 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0054550249999999996 2023-09-30T17:03:34.352 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.352 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.352 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:34.352 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.358741+0000", 2023-09-30T17:03:34.352 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00018210200000000001 2023-09-30T17:03:34.352 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.352 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.352 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:34.352 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.359683+0000", 2023-09-30T17:03:34.352 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00094202299999999995 2023-09-30T17:03:34.352 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.353 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.353 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:34.353 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365044+0000", 2023-09-30T17:03:34.353 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053616219999999999 2023-09-30T17:03:34.353 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.353 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.353 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:34.353 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375256+0000", 2023-09-30T17:03:34.353 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010212156 2023-09-30T17:03:34.353 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.353 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.353 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:34.354 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375300+0000", 2023-09-30T17:03:34.354 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3961999999999997e-05 2023-09-30T17:03:34.354 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.354 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.354 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:34.354 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375334+0000", 2023-09-30T17:03:34.354 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.324e-05 2023-09-30T17:03:34.354 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:34.354 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:34.354 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:34.354 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.355 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.355 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:34.355 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:03:34.355 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 75.974854097000005, 2023-09-30T17:03:34.355 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024240660000000001, 2023-09-30T17:03:34.355 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:34.355 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:34.355 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:34.355 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.355 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:34.355 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:03:34.355 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:34.356 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.356 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.356 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:34.356 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:03:34.356 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:34.356 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.356 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.356 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:34.356 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352529+0000", 2023-09-30T17:03:34.356 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1379999999999999e-06 2023-09-30T17:03:34.356 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.356 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.357 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:34.357 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352536+0000", 2023-09-30T17:03:34.357 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3489999999999997e-06 2023-09-30T17:03:34.357 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.357 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.357 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:34.357 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352547+0000", 2023-09-30T17:03:34.357 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1109e-05 2023-09-30T17:03:34.357 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.357 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.357 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:34.358 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352560+0000", 2023-09-30T17:03:34.358 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3046e-05 2023-09-30T17:03:34.358 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.358 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.358 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:34.358 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353142+0000", 2023-09-30T17:03:34.358 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00058174699999999997 2023-09-30T17:03:34.358 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.358 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.358 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:34.358 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353147+0000", 2023-09-30T17:03:34.358 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5840000000000002e-06 2023-09-30T17:03:34.359 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.359 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.359 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:34.359 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360374+0000", 2023-09-30T17:03:34.359 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0072270049999999999 2023-09-30T17:03:34.359 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.359 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.359 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:34.359 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360795+0000", 2023-09-30T17:03:34.359 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00042088999999999999 2023-09-30T17:03:34.359 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.359 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.360 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:34.360 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360967+0000", 2023-09-30T17:03:34.360 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017235699999999999 2023-09-30T17:03:34.360 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.360 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.360 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:34.360 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365051+0000", 2023-09-30T17:03:34.360 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0040837429999999999 2023-09-30T17:03:34.360 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.360 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.360 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:34.360 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376708+0000", 2023-09-30T17:03:34.360 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011656866 2023-09-30T17:03:34.361 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.361 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.361 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:34.361 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376745+0000", 2023-09-30T17:03:34.361 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6769e-05 2023-09-30T17:03:34.361 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.361 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.361 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:34.361 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376769+0000", 2023-09-30T17:03:34.361 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4057e-05 2023-09-30T17:03:34.361 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:34.361 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:34.362 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:34.362 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.362 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.362 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:34.362 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:34.362 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 75.974594741999994, 2023-09-30T17:03:34.362 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023472704, 2023-09-30T17:03:34.362 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:34.362 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:34.362 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:34.362 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.363 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:34.363 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:34.363 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:34.363 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.363 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.363 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:34.363 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:34.363 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:34.363 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.363 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.363 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:34.363 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:34.364 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8000000000000005e-07 2023-09-30T17:03:34.364 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.364 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.364 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:34.364 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352794+0000", 2023-09-30T17:03:34.364 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.789e-06 2023-09-30T17:03:34.364 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.364 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.364 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:34.364 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352805+0000", 2023-09-30T17:03:34.364 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0848e-05 2023-09-30T17:03:34.364 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.365 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.365 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:34.365 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352812+0000", 2023-09-30T17:03:34.365 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4449999999999999e-06 2023-09-30T17:03:34.365 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.365 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.365 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:34.365 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353063+0000", 2023-09-30T17:03:34.365 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00025046299999999998 2023-09-30T17:03:34.365 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.365 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.365 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:34.366 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353071+0000", 2023-09-30T17:03:34.366 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6739999999999997e-06 2023-09-30T17:03:34.366 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.366 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.366 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:34.366 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361696+0000", 2023-09-30T17:03:34.366 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0086251609999999992 2023-09-30T17:03:34.366 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.366 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.366 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:34.366 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362284+0000", 2023-09-30T17:03:34.366 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00058872299999999998 2023-09-30T17:03:34.367 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.367 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.367 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:34.367 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362429+0000", 2023-09-30T17:03:34.367 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014509000000000001 2023-09-30T17:03:34.367 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.367 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.367 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:34.367 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365330+0000", 2023-09-30T17:03:34.367 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0029005419999999999 2023-09-30T17:03:34.367 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.367 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.368 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:34.368 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376196+0000", 2023-09-30T17:03:34.368 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.01086615 2023-09-30T17:03:34.368 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.368 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.368 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:34.368 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376230+0000", 2023-09-30T17:03:34.368 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3858e-05 2023-09-30T17:03:34.368 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.368 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.368 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:34.369 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376260+0000", 2023-09-30T17:03:34.369 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0181000000000001e-05 2023-09-30T17:03:34.369 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:34.369 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:34.369 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:34.369 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.369 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.369 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:34.369 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:03:34.369 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 75.974361172000002, 2023-09-30T17:03:34.369 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023406132999999999, 2023-09-30T17:03:34.369 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:34.370 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:34.370 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:34.370 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.370 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:34.370 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:03:34.370 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:34.370 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.370 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.370 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:34.370 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:03:34.370 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:34.371 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.371 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.371 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:34.371 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353022+0000", 2023-09-30T17:03:34.371 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.78e-07 2023-09-30T17:03:34.371 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.371 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.371 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:34.371 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353027+0000", 2023-09-30T17:03:34.371 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9089999999999999e-06 2023-09-30T17:03:34.371 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.371 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.372 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:34.372 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353035+0000", 2023-09-30T17:03:34.372 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0430000000000008e-06 2023-09-30T17:03:34.372 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.372 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.372 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:34.372 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353047+0000", 2023-09-30T17:03:34.372 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1674e-05 2023-09-30T17:03:34.372 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.372 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.372 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:34.372 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353105+0000", 2023-09-30T17:03:34.373 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8891999999999998e-05 2023-09-30T17:03:34.373 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.373 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.373 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:34.373 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353112+0000", 2023-09-30T17:03:34.373 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7059999999999998e-06 2023-09-30T17:03:34.373 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.373 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.373 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:34.373 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362733+0000", 2023-09-30T17:03:34.373 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0096205869999999999 2023-09-30T17:03:34.373 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.374 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.374 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:34.374 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362833+0000", 2023-09-30T17:03:34.374 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000100227 2023-09-30T17:03:34.374 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.374 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.374 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:34.374 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363000+0000", 2023-09-30T17:03:34.374 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016670899999999999 2023-09-30T17:03:34.374 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.374 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.375 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:34.375 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365550+0000", 2023-09-30T17:03:34.375 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0025499199999999998 2023-09-30T17:03:34.375 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.375 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.375 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:34.375 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376315+0000", 2023-09-30T17:03:34.375 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010765011999999999 2023-09-30T17:03:34.375 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.375 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.375 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:34.375 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376386+0000", 2023-09-30T17:03:34.376 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0866999999999998e-05 2023-09-30T17:03:34.376 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.376 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.376 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:34.376 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376427+0000", 2023-09-30T17:03:34.376 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1709000000000003e-05 2023-09-30T17:03:34.376 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:34.376 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:34.376 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:34.376 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.376 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.376 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:34.377 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:34.377 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 75.974320535999993, 2023-09-30T17:03:34.377 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024076238, 2023-09-30T17:03:34.377 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:34.377 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:34.377 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:34.377 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.377 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:34.377 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:34.377 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:34.377 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.378 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.378 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:34.378 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:34.378 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:34.378 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.378 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.378 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:34.378 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:34.378 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8699999999999995e-07 2023-09-30T17:03:34.378 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.378 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.379 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:34.379 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353067+0000", 2023-09-30T17:03:34.379 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.605e-06 2023-09-30T17:03:34.379 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.379 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.379 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:34.379 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353073+0000", 2023-09-30T17:03:34.379 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8900000000000004e-06 2023-09-30T17:03:34.379 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.379 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.379 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:34.379 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353083+0000", 2023-09-30T17:03:34.380 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0200000000000001e-05 2023-09-30T17:03:34.380 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.380 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.380 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:34.380 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353186+0000", 2023-09-30T17:03:34.380 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010256599999999999 2023-09-30T17:03:34.380 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.380 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.380 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:34.380 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353190+0000", 2023-09-30T17:03:34.380 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9709999999999998e-06 2023-09-30T17:03:34.381 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.381 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.381 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:34.381 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362946+0000", 2023-09-30T17:03:34.381 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0097563330000000007 2023-09-30T17:03:34.381 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.381 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.381 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:34.381 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363088+0000", 2023-09-30T17:03:34.381 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014259200000000001 2023-09-30T17:03:34.381 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.381 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.382 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:34.382 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363555+0000", 2023-09-30T17:03:34.382 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00046627799999999998 2023-09-30T17:03:34.382 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.382 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.382 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:34.382 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365871+0000", 2023-09-30T17:03:34.382 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0023167589999999998 2023-09-30T17:03:34.382 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.382 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.382 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:34.383 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377033+0000", 2023-09-30T17:03:34.383 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011161203999999999 2023-09-30T17:03:34.383 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.383 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.383 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:34.383 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377100+0000", 2023-09-30T17:03:34.383 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7230999999999994e-05 2023-09-30T17:03:34.383 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.383 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.383 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:34.383 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377138+0000", 2023-09-30T17:03:34.383 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8022000000000003e-05 2023-09-30T17:03:34.384 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:34.384 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:34.384 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:34.384 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.384 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.384 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:34.384 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:03:34.384 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 75.974219586999993, 2023-09-30T17:03:34.384 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.020304412000000001, 2023-09-30T17:03:34.384 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:34.384 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:34.384 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:34.385 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.385 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:34.385 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:03:34.385 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:34.385 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.385 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.385 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:34.385 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:03:34.385 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:34.385 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.385 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.385 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:34.386 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353164+0000", 2023-09-30T17:03:34.386 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7100000000000011e-07 2023-09-30T17:03:34.386 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.386 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.386 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:34.386 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353168+0000", 2023-09-30T17:03:34.386 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0600000000000001e-06 2023-09-30T17:03:34.386 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.386 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.386 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:34.386 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353177+0000", 2023-09-30T17:03:34.386 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1409999999999994e-06 2023-09-30T17:03:34.387 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.387 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.387 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:34.387 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353185+0000", 2023-09-30T17:03:34.387 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2479999999999996e-06 2023-09-30T17:03:34.387 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.387 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.387 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:34.387 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353246+0000", 2023-09-30T17:03:34.387 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0519000000000001e-05 2023-09-30T17:03:34.387 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.388 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.388 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:34.388 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353252+0000", 2023-09-30T17:03:34.388 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7859999999999999e-06 2023-09-30T17:03:34.388 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.388 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.388 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:34.388 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354979+0000", 2023-09-30T17:03:34.388 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0017270090000000001 2023-09-30T17:03:34.388 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.388 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.388 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:34.389 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355097+0000", 2023-09-30T17:03:34.389 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000117472 2023-09-30T17:03:34.389 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.389 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.389 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:34.389 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.373467+0000", 2023-09-30T17:03:34.389 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.018370206 2023-09-30T17:03:34.389 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:34.389 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:34.389 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:34.389 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.389 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.390 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:24 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-09-30T17:03:34.390 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:25.254047+0000", 2023-09-30T17:03:34.390 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 9.0733353280000006, 2023-09-30T17:03:34.390 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.016430255000000001, 2023-09-30T17:03:34.390 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:34.390 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:34.390 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:34.390 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:34.390 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:34.390 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 24 2023-09-30T17:03:34.391 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.391 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:34.391 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.391 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:34.391 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.254047+0000", 2023-09-30T17:03:34.391 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:34.391 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.391 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.391 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:34.391 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.254047+0000", 2023-09-30T17:03:34.391 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:34.391 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.392 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.392 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:34.392 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.254050+0000", 2023-09-30T17:03:34.392 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.9500000000000001e-06 2023-09-30T17:03:34.392 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.392 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.392 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:34.392 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.257929+0000", 2023-09-30T17:03:34.392 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0038787190000000001 2023-09-30T17:03:34.392 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.392 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.392 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:34.393 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.257945+0000", 2023-09-30T17:03:34.393 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5991e-05 2023-09-30T17:03:34.393 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.393 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.393 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:34.393 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.257952+0000", 2023-09-30T17:03:34.393 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6170000000000001e-06 2023-09-30T17:03:34.393 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.393 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.393 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:34.393 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.258009+0000", 2023-09-30T17:03:34.394 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6768999999999998e-05 2023-09-30T17:03:34.394 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.394 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.394 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:34.394 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.258111+0000", 2023-09-30T17:03:34.394 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000101739 2023-09-30T17:03:34.394 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.394 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.394 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:34.394 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.258215+0000", 2023-09-30T17:03:34.394 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010414 2023-09-30T17:03:34.394 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.395 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.395 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:34.395 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.264291+0000", 2023-09-30T17:03:34.395 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0060763789999999998 2023-09-30T17:03:34.395 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.395 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.395 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:34.395 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.270347+0000", 2023-09-30T17:03:34.395 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0060554149999999998 2023-09-30T17:03:34.395 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.395 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.395 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:34.396 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.270431+0000", 2023-09-30T17:03:34.396 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4285999999999999e-05 2023-09-30T17:03:34.396 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.396 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.396 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:34.396 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.270477+0000", 2023-09-30T17:03:34.396 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6249999999999999e-05 2023-09-30T17:03:34.396 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:34.396 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:34.396 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:34.396 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.396 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.397 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:29 4.12 e36/17 4:48ab9bde:::100000001f8.00000015:head v 36'4, mlcod=36'2)", 2023-09-30T17:03:34.397 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:25.772296+0000", 2023-09-30T17:03:34.397 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 8.5550863130000003, 2023-09-30T17:03:34.397 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.015379528999999999, 2023-09-30T17:03:34.397 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:34.397 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:34.397 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:34.397 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.397 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:34.397 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.772296+0000", 2023-09-30T17:03:34.397 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:34.397 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.398 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.398 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:34.398 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.772296+0000", 2023-09-30T17:03:34.398 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:34.398 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.398 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.398 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:34.398 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.772298+0000", 2023-09-30T17:03:34.398 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.0099999999999998e-06 2023-09-30T17:03:34.398 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.398 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.399 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:34.399 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.778708+0000", 2023-09-30T17:03:34.399 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0064101679999999999 2023-09-30T17:03:34.399 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.399 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.399 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:34.399 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.778726+0000", 2023-09-30T17:03:34.399 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7427000000000001e-05 2023-09-30T17:03:34.399 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.399 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.399 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:34.399 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.778734+0000", 2023-09-30T17:03:34.400 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5019999999999992e-06 2023-09-30T17:03:34.400 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.400 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.400 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:34.400 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.778807+0000", 2023-09-30T17:03:34.400 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2556000000000001e-05 2023-09-30T17:03:34.400 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.400 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.400 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:34.400 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.778830+0000", 2023-09-30T17:03:34.400 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.3434e-05 2023-09-30T17:03:34.400 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.401 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.401 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:34.401 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.787611+0000", 2023-09-30T17:03:34.401 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0087809919999999996 2023-09-30T17:03:34.401 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.401 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.401 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:34.401 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.787675+0000", 2023-09-30T17:03:34.401 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.444e-05 2023-09-30T17:03:34.401 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:34.401 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:34.402 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:34.402 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.402 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.402 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:30 4.14 4:2b28d75f:::100000001f8.00000016:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-09-30T17:03:34.402 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:25.858076+0000", 2023-09-30T17:03:34.402 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 8.4693060429999996, 2023-09-30T17:03:34.402 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.014984442000000001, 2023-09-30T17:03:34.402 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:34.402 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:34.402 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:34.402 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:34.403 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:34.403 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 30 2023-09-30T17:03:34.403 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.403 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:34.403 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.403 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:34.403 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.858076+0000", 2023-09-30T17:03:34.403 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:34.403 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.403 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.403 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:34.403 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.858076+0000", 2023-09-30T17:03:34.403 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:34.404 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.404 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.404 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:34.404 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.858080+0000", 2023-09-30T17:03:34.404 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7170000000000002e-06 2023-09-30T17:03:34.404 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.404 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.404 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:34.404 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.862044+0000", 2023-09-30T17:03:34.404 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0039641549999999996 2023-09-30T17:03:34.404 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.404 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.405 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:34.405 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.862064+0000", 2023-09-30T17:03:34.405 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9479000000000001e-05 2023-09-30T17:03:34.405 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.405 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.405 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:34.405 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.862073+0000", 2023-09-30T17:03:34.405 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.6209999999999999e-06 2023-09-30T17:03:34.405 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.405 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.405 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:34.406 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.862187+0000", 2023-09-30T17:03:34.406 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000113365 2023-09-30T17:03:34.406 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.406 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.406 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:34.406 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.862314+0000", 2023-09-30T17:03:34.406 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00012777200000000001 2023-09-30T17:03:34.406 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.406 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.406 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:34.406 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.862428+0000", 2023-09-30T17:03:34.407 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000113569 2023-09-30T17:03:34.407 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.407 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.407 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:34.407 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.868349+0000", 2023-09-30T17:03:34.407 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0059214439999999997 2023-09-30T17:03:34.407 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.407 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.407 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:34.407 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.872988+0000", 2023-09-30T17:03:34.407 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0046389509999999997 2023-09-30T17:03:34.407 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.407 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.408 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:34.408 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.873031+0000", 2023-09-30T17:03:34.408 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2852000000000002e-05 2023-09-30T17:03:34.408 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.408 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.408 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:34.408 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:25.873061+0000", 2023-09-30T17:03:34.408 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.9516999999999999e-05 2023-09-30T17:03:34.408 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:34.408 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:34.408 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:34.408 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.408 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.409 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:34 4.3b 4:dcc0c15f:::100000001f8.0000001a:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-09-30T17:03:34.409 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:26.217323+0000", 2023-09-30T17:03:34.409 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 8.1100595220000002, 2023-09-30T17:03:34.409 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.015860697, 2023-09-30T17:03:34.409 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:34.409 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:34.409 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:34.409 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:34.409 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:34.409 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 34 2023-09-30T17:03:34.409 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.410 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:34.410 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.410 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:34.410 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.217323+0000", 2023-09-30T17:03:34.410 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:34.410 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.410 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.410 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:34.410 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.217323+0000", 2023-09-30T17:03:34.410 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:34.410 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.411 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.411 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:34.411 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.217325+0000", 2023-09-30T17:03:34.411 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.244e-06 2023-09-30T17:03:34.411 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.411 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.411 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:34.411 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.221135+0000", 2023-09-30T17:03:34.411 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0038104480000000001 2023-09-30T17:03:34.411 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.411 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.411 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:34.411 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.221171+0000", 2023-09-30T17:03:34.412 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5302000000000002e-05 2023-09-30T17:03:34.412 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.412 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.412 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:34.412 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.221183+0000", 2023-09-30T17:03:34.412 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2670999999999999e-05 2023-09-30T17:03:34.412 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.412 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.412 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:34.412 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.221251+0000", 2023-09-30T17:03:34.412 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7229000000000003e-05 2023-09-30T17:03:34.412 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.413 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.413 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:34.413 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.221361+0000", 2023-09-30T17:03:34.413 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000110806 2023-09-30T17:03:34.413 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.413 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.413 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:34.413 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.221460+0000", 2023-09-30T17:03:34.413 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8326999999999996e-05 2023-09-30T17:03:34.413 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.413 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.413 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:34.414 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.227385+0000", 2023-09-30T17:03:34.414 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0059254620000000003 2023-09-30T17:03:34.414 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.414 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.414 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:34.414 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.233109+0000", 2023-09-30T17:03:34.414 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0057238480000000001 2023-09-30T17:03:34.414 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.414 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.414 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:34.414 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.233148+0000", 2023-09-30T17:03:34.415 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8701000000000001e-05 2023-09-30T17:03:34.415 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.415 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.415 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:34.415 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.233183+0000", 2023-09-30T17:03:34.415 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5658999999999999e-05 2023-09-30T17:03:34.415 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:34.415 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:34.415 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:34.415 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.415 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.415 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:38 4.6 4:63e80496:::100000001f8.0000001e:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-09-30T17:03:34.416 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:26.597453+0000", 2023-09-30T17:03:34.416 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 7.7299296450000003, 2023-09-30T17:03:34.416 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.014866199, 2023-09-30T17:03:34.416 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:34.416 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:34.416 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:34.416 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:34.416 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:34.416 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 38 2023-09-30T17:03:34.416 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.416 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:34.416 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.417 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:34.417 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.597453+0000", 2023-09-30T17:03:34.417 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:34.417 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.417 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.417 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:34.417 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.597453+0000", 2023-09-30T17:03:34.417 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:34.417 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.417 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.417 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:34.417 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.597456+0000", 2023-09-30T17:03:34.418 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4529999999999998e-06 2023-09-30T17:03:34.418 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.418 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.418 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:34.418 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.601152+0000", 2023-09-30T17:03:34.418 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0036961730000000001 2023-09-30T17:03:34.418 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.418 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.418 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:34.418 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.601175+0000", 2023-09-30T17:03:34.419 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.3050000000000001e-05 2023-09-30T17:03:34.419 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.419 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.419 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:34.419 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.601184+0000", 2023-09-30T17:03:34.419 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4710000000000007e-06 2023-09-30T17:03:34.419 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.419 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.419 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:34.419 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.601240+0000", 2023-09-30T17:03:34.419 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5999999999999999e-05 2023-09-30T17:03:34.419 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.419 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.420 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:34.420 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.601354+0000", 2023-09-30T17:03:34.420 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000113849 2023-09-30T17:03:34.420 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.420 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.420 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:34.420 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.601456+0000", 2023-09-30T17:03:34.420 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010277600000000001 2023-09-30T17:03:34.420 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.420 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.420 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:34.420 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.607840+0000", 2023-09-30T17:03:34.421 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0063832089999999999 2023-09-30T17:03:34.421 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.421 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.421 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:34.421 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.612184+0000", 2023-09-30T17:03:34.421 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0043445280000000003 2023-09-30T17:03:34.421 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.421 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.421 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:34.421 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.612272+0000", 2023-09-30T17:03:34.421 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8258999999999996e-05 2023-09-30T17:03:34.422 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.422 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.422 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:34.422 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:26.612319+0000", 2023-09-30T17:03:34.422 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6431000000000003e-05 2023-09-30T17:03:34.422 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:34.422 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:34.422 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:34.422 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.422 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.422 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:67 4.28 4:153ae410:::100000001f8.0000003b:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e37)", 2023-09-30T17:03:34.422 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:29.409717+0000", 2023-09-30T17:03:34.423 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4.9176653239999997, 2023-09-30T17:03:34.423 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.016649002999999999, 2023-09-30T17:03:34.423 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:34.423 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:34.423 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:34.423 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:34.423 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:34.423 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 67 2023-09-30T17:03:34.423 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.423 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:34.423 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.423 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:34.424 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:29.409717+0000", 2023-09-30T17:03:34.424 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:34.424 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.424 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.424 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:34.424 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:29.409717+0000", 2023-09-30T17:03:34.424 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:34.424 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.424 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.424 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:34.424 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:29.409718+0000", 2023-09-30T17:03:34.424 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1000000000000001e-06 2023-09-30T17:03:34.425 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.425 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.425 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:34.425 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:29.413477+0000", 2023-09-30T17:03:34.425 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0037585069999999999 2023-09-30T17:03:34.425 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.425 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.425 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:34.425 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:29.413498+0000", 2023-09-30T17:03:34.425 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1263999999999998e-05 2023-09-30T17:03:34.425 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.425 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.426 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:34.426 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:29.413509+0000", 2023-09-30T17:03:34.426 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0699e-05 2023-09-30T17:03:34.426 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.426 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.426 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:34.426 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:29.413621+0000", 2023-09-30T17:03:34.426 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000112648 2023-09-30T17:03:34.426 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.426 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.426 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:34.427 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:29.413737+0000", 2023-09-30T17:03:34.427 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00011586699999999999 2023-09-30T17:03:34.427 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.427 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.427 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:34.427 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:29.413834+0000", 2023-09-30T17:03:34.427 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7081000000000001e-05 2023-09-30T17:03:34.427 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.427 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.427 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:34.427 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:29.419468+0000", 2023-09-30T17:03:34.427 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0056335650000000001 2023-09-30T17:03:34.428 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.428 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.428 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:34.428 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:29.426283+0000", 2023-09-30T17:03:34.428 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0068157570000000004 2023-09-30T17:03:34.428 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.428 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.428 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:34.428 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:29.426323+0000", 2023-09-30T17:03:34.428 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9533999999999998e-05 2023-09-30T17:03:34.428 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.428 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.429 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:34.429 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:29.426366+0000", 2023-09-30T17:03:34.429 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2981000000000001e-05 2023-09-30T17:03:34.429 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:34.429 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:34.429 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:34.429 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.429 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.429 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:69 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-09-30T17:03:34.429 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:29.602556+0000", 2023-09-30T17:03:34.429 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4.7248261190000003, 2023-09-30T17:03:34.430 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.016528879, 2023-09-30T17:03:34.430 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:34.430 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:34.430 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:34.430 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:34.430 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:34.430 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 69 2023-09-30T17:03:34.430 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.430 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:34.430 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.430 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:34.431 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:29.602556+0000", 2023-09-30T17:03:34.431 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:34.431 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.431 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.431 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:34.431 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:29.602556+0000", 2023-09-30T17:03:34.431 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:34.431 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.431 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.431 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:34.431 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:29.602559+0000", 2023-09-30T17:03:34.431 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.3760000000000002e-06 2023-09-30T17:03:34.432 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.432 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.432 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:34.432 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:29.606153+0000", 2023-09-30T17:03:34.432 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0035943210000000001 2023-09-30T17:03:34.432 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.432 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.432 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:34.432 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:29.606172+0000", 2023-09-30T17:03:34.432 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8987e-05 2023-09-30T17:03:34.432 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.432 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.432 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:34.433 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:29.606182+0000", 2023-09-30T17:03:34.433 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.9850000000000001e-06 2023-09-30T17:03:34.433 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.433 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.433 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:34.433 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:29.606262+0000", 2023-09-30T17:03:34.433 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0377000000000006e-05 2023-09-30T17:03:34.433 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.433 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.433 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:34.433 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:29.606376+0000", 2023-09-30T17:03:34.434 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000113983 2023-09-30T17:03:34.434 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.434 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.434 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:34.434 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:29.606475+0000", 2023-09-30T17:03:34.434 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8459e-05 2023-09-30T17:03:34.434 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.434 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.434 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:34.434 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:29.612887+0000", 2023-09-30T17:03:34.434 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0064121129999999997 2023-09-30T17:03:34.434 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.435 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.435 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:34.435 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:29.618987+0000", 2023-09-30T17:03:34.435 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0061004140000000002 2023-09-30T17:03:34.435 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.435 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.435 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:34.435 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:29.619026+0000", 2023-09-30T17:03:34.435 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8800000000000001e-05 2023-09-30T17:03:34.435 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.435 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.436 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:34.436 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:29.619085+0000", 2023-09-30T17:03:34.436 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9064000000000002e-05 2023-09-30T17:03:34.436 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:34.436 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:34.436 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:34.436 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.436 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.436 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:72 4.36 4:6da220e6:::100000001f8.0000003f:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-09-30T17:03:34.436 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:29.845119+0000", 2023-09-30T17:03:34.436 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4.4822632330000003, 2023-09-30T17:03:34.436 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.014867083, 2023-09-30T17:03:34.437 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:34.437 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:34.437 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:34.437 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:34.437 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:34.437 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 72 2023-09-30T17:03:34.437 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.437 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:34.437 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.437 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:34.437 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:29.845119+0000", 2023-09-30T17:03:34.437 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:34.438 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.438 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.438 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:34.438 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:29.845119+0000", 2023-09-30T17:03:34.438 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:34.438 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.438 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.438 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:34.438 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:29.845121+0000", 2023-09-30T17:03:34.438 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8610000000000001e-06 2023-09-30T17:03:34.438 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.438 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.439 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:34.439 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:29.848806+0000", 2023-09-30T17:03:34.439 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0036848129999999999 2023-09-30T17:03:34.439 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.439 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.439 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:34.439 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:29.848822+0000", 2023-09-30T17:03:34.439 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6413e-05 2023-09-30T17:03:34.439 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.439 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.439 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:34.439 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:29.848830+0000", 2023-09-30T17:03:34.440 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8490000000000006e-06 2023-09-30T17:03:34.440 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.440 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.440 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:34.440 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:29.848881+0000", 2023-09-30T17:03:34.440 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0742000000000003e-05 2023-09-30T17:03:34.440 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.440 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.440 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:34.440 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:29.848995+0000", 2023-09-30T17:03:34.440 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000114324 2023-09-30T17:03:34.441 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.441 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.441 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:34.441 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:29.849099+0000", 2023-09-30T17:03:34.441 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000103791 2023-09-30T17:03:34.441 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.441 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.441 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:34.441 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:29.855261+0000", 2023-09-30T17:03:34.441 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0061617970000000001 2023-09-30T17:03:34.441 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.441 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.442 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:34.442 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:29.859915+0000", 2023-09-30T17:03:34.442 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0046543299999999999 2023-09-30T17:03:34.442 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.442 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.442 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:34.442 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:29.859956+0000", 2023-09-30T17:03:34.442 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0976000000000002e-05 2023-09-30T17:03:34.442 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.442 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.442 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:34.442 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:29.859986+0000", 2023-09-30T17:03:34.443 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0187000000000001e-05 2023-09-30T17:03:34.443 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:34.443 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:34.443 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:34.443 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.443 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.443 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:2997 4.36 4:6da220e6:::100000001f8.0000003f:head [write 1171456~4096,write 1200128~4096,write 1236992~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-09-30T17:03:34.443 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:31.073765+0000", 2023-09-30T17:03:34.443 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 3.2536171989999998, 2023-09-30T17:03:34.443 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.016183809, 2023-09-30T17:03:34.443 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:34.443 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:34.444 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:34.444 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:34.444 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:34.444 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 2997 2023-09-30T17:03:34.444 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.444 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:34.444 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.444 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:34.444 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.073765+0000", 2023-09-30T17:03:34.444 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:34.444 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.444 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.444 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:34.445 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.073765+0000", 2023-09-30T17:03:34.445 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:34.445 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.445 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.445 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:34.445 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.073766+0000", 2023-09-30T17:03:34.445 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2399999999999997e-07 2023-09-30T17:03:34.445 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.445 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.445 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:34.445 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.073789+0000", 2023-09-30T17:03:34.445 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2959000000000002e-05 2023-09-30T17:03:34.446 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.446 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.446 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:34.446 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.073796+0000", 2023-09-30T17:03:34.446 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2840000000000001e-06 2023-09-30T17:03:34.446 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.446 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.446 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:34.446 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.073800+0000", 2023-09-30T17:03:34.446 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4649999999999996e-06 2023-09-30T17:03:34.446 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.447 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.447 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:34.447 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.073858+0000", 2023-09-30T17:03:34.447 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7055000000000002e-05 2023-09-30T17:03:34.447 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.447 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.447 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:34.447 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.073967+0000", 2023-09-30T17:03:34.447 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000109577 2023-09-30T17:03:34.447 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.447 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.447 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:34.448 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.074144+0000", 2023-09-30T17:03:34.448 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017665500000000001 2023-09-30T17:03:34.448 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.448 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.448 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:34.448 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.075953+0000", 2023-09-30T17:03:34.448 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0018096469999999999 2023-09-30T17:03:34.448 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.448 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.448 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:34.448 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.089856+0000", 2023-09-30T17:03:34.448 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.013902897000000001 2023-09-30T17:03:34.449 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.449 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.449 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:34.449 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.089914+0000", 2023-09-30T17:03:34.449 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7837999999999997e-05 2023-09-30T17:03:34.449 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.449 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.449 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:34.449 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.089949+0000", 2023-09-30T17:03:34.449 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4708e-05 2023-09-30T17:03:34.449 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:34.450 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:34.450 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:34.450 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.450 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.450 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:3002 4.28 4:153ae410:::100000001f8.0000003b:head [write 2404352~4096,write 2416640~4096,write 2473984~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-09-30T17:03:34.450 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:31.075051+0000", 2023-09-30T17:03:34.450 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 3.252330776, 2023-09-30T17:03:34.450 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.016877504000000002, 2023-09-30T17:03:34.450 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:34.450 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:34.450 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:34.450 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:34.451 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:34.451 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 3002 2023-09-30T17:03:34.451 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.451 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:34.451 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.451 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:34.451 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.075051+0000", 2023-09-30T17:03:34.451 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:34.451 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.451 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.451 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:34.451 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.075051+0000", 2023-09-30T17:03:34.452 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:34.452 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.452 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.452 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:34.452 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.075052+0000", 2023-09-30T17:03:34.452 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9699999999999995e-07 2023-09-30T17:03:34.452 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.452 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.452 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:34.452 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.075067+0000", 2023-09-30T17:03:34.452 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4362000000000001e-05 2023-09-30T17:03:34.452 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.453 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.453 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:34.453 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.075074+0000", 2023-09-30T17:03:34.453 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4370000000000001e-06 2023-09-30T17:03:34.453 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.453 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.453 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:34.453 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.075081+0000", 2023-09-30T17:03:34.453 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5810000000000002e-06 2023-09-30T17:03:34.453 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.453 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.453 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:34.454 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.075118+0000", 2023-09-30T17:03:34.454 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7493999999999997e-05 2023-09-30T17:03:34.454 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.454 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.454 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:34.454 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.075206+0000", 2023-09-30T17:03:34.454 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8065999999999993e-05 2023-09-30T17:03:34.454 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.454 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.454 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:34.454 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.075416+0000", 2023-09-30T17:03:34.454 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000210065 2023-09-30T17:03:34.455 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.455 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.455 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:34.455 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.077514+0000", 2023-09-30T17:03:34.455 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0020980349999999998 2023-09-30T17:03:34.455 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.455 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.455 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:34.455 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.091863+0000", 2023-09-30T17:03:34.455 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.014348869 2023-09-30T17:03:34.455 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.456 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.456 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:34.456 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.091897+0000", 2023-09-30T17:03:34.456 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3720000000000002e-05 2023-09-30T17:03:34.456 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.456 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.456 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:34.456 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.091929+0000", 2023-09-30T17:03:34.456 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.2178000000000003e-05 2023-09-30T17:03:34.456 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:34.456 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:34.456 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:34.456 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.457 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.457 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:10658 4.36 4:6fa85f86:::100000001f8.00000013:head [write 4096~4096,write 24576~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-09-30T17:03:34.457 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:33.930495+0000", 2023-09-30T17:03:34.457 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.396886884, 2023-09-30T17:03:34.457 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.016057434999999998, 2023-09-30T17:03:34.457 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:34.457 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:34.457 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:34.457 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:34.457 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:34.457 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 10658 2023-09-30T17:03:34.457 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.458 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:34.458 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.458 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:34.458 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.930495+0000", 2023-09-30T17:03:34.458 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:34.458 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.458 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.458 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:34.458 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.930495+0000", 2023-09-30T17:03:34.458 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:34.458 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.459 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.459 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:34.459 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.930496+0000", 2023-09-30T17:03:34.459 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0500000000000003e-07 2023-09-30T17:03:34.459 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.459 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.459 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:34.459 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.930504+0000", 2023-09-30T17:03:34.459 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9710000000000004e-06 2023-09-30T17:03:34.459 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.459 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.459 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:34.459 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.930519+0000", 2023-09-30T17:03:34.460 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4932999999999999e-05 2023-09-30T17:03:34.460 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.460 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.460 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:34.460 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.930525+0000", 2023-09-30T17:03:34.460 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4189999999999999e-06 2023-09-30T17:03:34.460 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.460 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.460 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:34.460 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.930573+0000", 2023-09-30T17:03:34.460 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7994999999999997e-05 2023-09-30T17:03:34.461 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.461 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.461 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:34.461 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.930644+0000", 2023-09-30T17:03:34.461 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0211999999999998e-05 2023-09-30T17:03:34.461 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.461 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.461 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:34.461 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.930741+0000", 2023-09-30T17:03:34.461 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7746999999999998e-05 2023-09-30T17:03:34.461 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.461 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.462 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:34.462 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.931667+0000", 2023-09-30T17:03:34.462 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00092519100000000001 2023-09-30T17:03:34.462 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.462 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.462 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:34.462 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.946477+0000", 2023-09-30T17:03:34.462 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.014809987 2023-09-30T17:03:34.462 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.462 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.462 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:34.462 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.946511+0000", 2023-09-30T17:03:34.463 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4350000000000001e-05 2023-09-30T17:03:34.463 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.463 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.463 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:34.463 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:33.946553+0000", 2023-09-30T17:03:34.463 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1925000000000003e-05 2023-09-30T17:03:34.463 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:34.463 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:34.463 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:34.463 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.463 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.463 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:11371 4.28 4:153ae410:::100000001f8.0000003b:head [write 4042752~4096,write 4050944~4096,write 4100096~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-09-30T17:03:34.464 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:34.179448+0000", 2023-09-30T17:03:34.464 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.14793452800000001, 2023-09-30T17:03:34.464 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.016739657000000002, 2023-09-30T17:03:34.464 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:34.464 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:34.464 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:34.464 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:34.464 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:34.464 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 11371 2023-09-30T17:03:34.464 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.464 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:34.464 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.465 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:34.465 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.179448+0000", 2023-09-30T17:03:34.465 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:34.465 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.465 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.465 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:34.465 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.179448+0000", 2023-09-30T17:03:34.465 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:34.465 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.465 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.465 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:34.465 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.179448+0000", 2023-09-30T17:03:34.466 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5499999999999997e-07 2023-09-30T17:03:34.466 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.466 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.466 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:34.466 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.179460+0000", 2023-09-30T17:03:34.466 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1114999999999999e-05 2023-09-30T17:03:34.466 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.466 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.466 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:34.466 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.179470+0000", 2023-09-30T17:03:34.466 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0383e-05 2023-09-30T17:03:34.466 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.467 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.467 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:34.467 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.179477+0000", 2023-09-30T17:03:34.467 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1199999999999996e-06 2023-09-30T17:03:34.467 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.467 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.467 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:34.467 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.179527+0000", 2023-09-30T17:03:34.467 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9639999999999999e-05 2023-09-30T17:03:34.467 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.467 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.467 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:34.467 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.179604+0000", 2023-09-30T17:03:34.468 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7305000000000006e-05 2023-09-30T17:03:34.468 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.468 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.468 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:34.468 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.179731+0000", 2023-09-30T17:03:34.468 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00012680499999999999 2023-09-30T17:03:34.468 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.468 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.468 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:34.468 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.181248+0000", 2023-09-30T17:03:34.468 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001517071 2023-09-30T17:03:34.468 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.469 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.469 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:34.469 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.196109+0000", 2023-09-30T17:03:34.469 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.014860824 2023-09-30T17:03:34.469 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.469 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.469 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:34.469 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.196146+0000", 2023-09-30T17:03:34.469 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6891000000000003e-05 2023-09-30T17:03:34.469 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:34.469 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:34.469 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:34.470 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.196187+0000", 2023-09-30T17:03:34.470 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1748000000000001e-05 2023-09-30T17:03:34.470 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:34.470 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:34.470 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:34.470 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:34.470 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:34.470 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:34.471 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-09-30T17:03:34.471 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~47s 2023-09-30T17:03:34.472 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:34.471+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:34.473 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:03:34.572 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:34.572+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:34.647 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:34.647 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2023-09-30T17:03:34.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:34.647 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:12614 4.36 e39/17 4:6da220e6:::100000001f8.0000003f:head v 39'598, mlcod=39'596)", 2023-09-30T17:03:34.647 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:34.646187+0000", 2023-09-30T17:03:34.647 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.00092327700000000002, 2023-09-30T17:03:34.648 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00094595599999999997, 2023-09-30T17:03:34.648 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:34.648 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:34.648 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:34.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:34.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:34.648 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.646187+0000", 2023-09-30T17:03:34.648 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:34.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:34.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:34.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:34.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.646187+0000", 2023-09-30T17:03:34.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:34.649 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:34.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:34.649 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:34.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.646188+0000", 2023-09-30T17:03:34.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.34e-07 2023-09-30T17:03:34.649 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:34.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:34.649 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:34.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.646197+0000", 2023-09-30T17:03:34.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3070000000000008e-06 2023-09-30T17:03:34.650 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:34.650 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:34.650 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:34.650 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.646205+0000", 2023-09-30T17:03:34.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6279999999999996e-06 2023-09-30T17:03:34.650 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:34.650 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:34.650 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:34.650 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.646209+0000", 2023-09-30T17:03:34.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8720000000000004e-06 2023-09-30T17:03:34.650 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:34.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:34.651 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:34.651 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.646254+0000", 2023-09-30T17:03:34.651 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5062000000000003e-05 2023-09-30T17:03:34.651 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:34.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:34.651 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:34.651 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.646273+0000", 2023-09-30T17:03:34.651 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9364e-05 2023-09-30T17:03:34.651 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:34.651 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:34.651 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:34.652 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:34.652 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:34.652 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:12616 4.6 e39/17 4:635f8cb4:::100000001f8.0000003c:head v 39'779, mlcod=39'776)", 2023-09-30T17:03:34.652 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:34.646720+0000", 2023-09-30T17:03:34.652 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.00039102499999999998, 2023-09-30T17:03:34.652 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00048337, 2023-09-30T17:03:34.652 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:34.652 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:34.652 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:34.652 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:34.652 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:34.653 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.646720+0000", 2023-09-30T17:03:34.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:34.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:34.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:34.653 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:34.653 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.646720+0000", 2023-09-30T17:03:34.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:34.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:34.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:34.653 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:34.653 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.646720+0000", 2023-09-30T17:03:34.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.39e-07 2023-09-30T17:03:34.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:34.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:34.654 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:34.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.646732+0000", 2023-09-30T17:03:34.654 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.172e-05 2023-09-30T17:03:34.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:34.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:34.654 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:34.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.646746+0000", 2023-09-30T17:03:34.654 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4221e-05 2023-09-30T17:03:34.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:34.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:34.655 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:34.655 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.646750+0000", 2023-09-30T17:03:34.655 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7790000000000002e-06 2023-09-30T17:03:34.655 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:34.655 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:34.655 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:34.655 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.646789+0000", 2023-09-30T17:03:34.655 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9279999999999997e-05 2023-09-30T17:03:34.655 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:34.655 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:34.655 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:34.655 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.646808+0000", 2023-09-30T17:03:34.656 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8527000000000001e-05 2023-09-30T17:03:34.656 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:34.656 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:34.656 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:34.656 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:34.656 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:34.656 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:12617 4.33 e39/17 4:cf6d7a6c:::100000001f8.0000000a:head v 39'203, mlcod=39'201)", 2023-09-30T17:03:34.656 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:34.646903+0000", 2023-09-30T17:03:34.656 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.00020745900000000001, 2023-09-30T17:03:34.656 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000370961, 2023-09-30T17:03:34.656 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:34.656 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:34.657 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:34.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:34.657 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:34.657 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.646903+0000", 2023-09-30T17:03:34.657 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:34.657 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:34.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:34.657 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:34.657 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.646903+0000", 2023-09-30T17:03:34.657 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:34.657 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:34.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:34.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:34.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.646903+0000", 2023-09-30T17:03:34.658 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4900000000000002e-07 2023-09-30T17:03:34.658 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:34.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:34.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:34.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.646913+0000", 2023-09-30T17:03:34.658 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9729999999999992e-06 2023-09-30T17:03:34.658 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:34.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:34.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:34.659 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.646926+0000", 2023-09-30T17:03:34.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2819999999999999e-05 2023-09-30T17:03:34.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:34.659 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:34.659 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:34.659 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.646930+0000", 2023-09-30T17:03:34.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6480000000000001e-06 2023-09-30T17:03:34.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:34.659 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:34.659 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:34.659 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.646968+0000", 2023-09-30T17:03:34.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8238000000000002e-05 2023-09-30T17:03:34.660 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:34.660 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:34.660 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:34.660 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.646980+0000", 2023-09-30T17:03:34.660 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2269999999999999e-05 2023-09-30T17:03:34.660 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:34.660 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:34.660 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:34.660 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:34.660 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:34.660 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:12606 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 1880064~4096 in=4096b,write 1912832~4096 in=4096b,write 2236416~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-09-30T17:03:34.660 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:34.641850+0000", 2023-09-30T17:03:34.661 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0052610060000000004, 2023-09-30T17:03:34.661 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054962470000000001, 2023-09-30T17:03:34.661 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:34.661 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:34.661 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:34.661 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:34.661 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:34.661 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 12606 2023-09-30T17:03:34.661 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:34.661 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:34.661 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:34.661 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:34.662 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.641850+0000", 2023-09-30T17:03:34.662 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:34.662 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:34.662 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:34.662 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:34.662 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.641850+0000", 2023-09-30T17:03:34.662 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:34.662 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:34.662 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:34.662 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:34.662 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.641851+0000", 2023-09-30T17:03:34.662 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3900000000000003e-07 2023-09-30T17:03:34.663 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:34.663 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:34.663 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:34.663 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.641864+0000", 2023-09-30T17:03:34.663 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3614e-05 2023-09-30T17:03:34.663 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:34.663 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:34.663 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:34.663 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.641878+0000", 2023-09-30T17:03:34.663 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4032999999999999e-05 2023-09-30T17:03:34.663 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:34.663 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:34.663 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:34.664 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.641887+0000", 2023-09-30T17:03:34.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2649999999999996e-06 2023-09-30T17:03:34.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:34.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:34.664 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:34.664 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.641940+0000", 2023-09-30T17:03:34.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3567999999999999e-05 2023-09-30T17:03:34.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:34.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:34.664 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:34.664 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.641998+0000", 2023-09-30T17:03:34.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8322000000000002e-05 2023-09-30T17:03:34.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:34.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:34.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:34.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.642086+0000", 2023-09-30T17:03:34.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7726000000000007e-05 2023-09-30T17:03:34.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:34.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:34.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:34.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.643667+0000", 2023-09-30T17:03:34.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001580943 2023-09-30T17:03:34.665 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:34.666 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:34.666 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:34.666 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:34.666 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2023-09-30T17:03:34.666 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 4 2023-09-30T17:03:34.666 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:34.667 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:03:34.711 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:34.711+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:34.774 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:34.773+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:34.831 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:34.832 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:03:34.832 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2023-09-30T17:03:34.832 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2023-09-30T17:03:34.832 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:34.845 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:03:34.887 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:34.886+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:34.975 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:34.975+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:35.063 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:35.063 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2023-09-30T17:03:35.063 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2023-09-30T17:03:35.063 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2023-09-30T17:03:35.064 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.064 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:5 3.1f 3:ff5b34d6:::1.00000000:head [create,setxattr parent (30) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:35.064 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:03:35.064 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 76.708873185000002, 2023-09-30T17:03:35.064 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021233007000000002, 2023-09-30T17:03:35.064 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:35.064 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:35.064 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:35.064 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.064 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:35.065 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:03:35.065 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:35.065 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.065 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.065 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:35.065 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352109+0000", 2023-09-30T17:03:35.065 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:35.065 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.065 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.065 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:35.065 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352110+0000", 2023-09-30T17:03:35.066 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6000000000000002e-07 2023-09-30T17:03:35.066 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.066 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.066 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:35.066 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352117+0000", 2023-09-30T17:03:35.066 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5930000000000002e-06 2023-09-30T17:03:35.066 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.066 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.066 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:35.066 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352126+0000", 2023-09-30T17:03:35.066 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0729999999999994e-06 2023-09-30T17:03:35.067 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.067 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.067 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:35.067 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352136+0000", 2023-09-30T17:03:35.067 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0380000000000001e-05 2023-09-30T17:03:35.067 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.067 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.067 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:35.067 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353279+0000", 2023-09-30T17:03:35.067 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0011424670000000001 2023-09-30T17:03:35.067 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.068 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.068 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:35.068 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.353707+0000", 2023-09-30T17:03:35.068 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00042829800000000003 2023-09-30T17:03:35.068 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.068 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.068 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:35.068 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354104+0000", 2023-09-30T17:03:35.068 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00039643399999999998 2023-09-30T17:03:35.068 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.068 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.069 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:35.069 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356925+0000", 2023-09-30T17:03:35.069 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0028210900000000001 2023-09-30T17:03:35.069 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.069 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.069 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:35.069 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373243+0000", 2023-09-30T17:03:35.069 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016318461999999999 2023-09-30T17:03:35.069 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.069 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.069 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:35.070 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373301+0000", 2023-09-30T17:03:35.070 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7435000000000002e-05 2023-09-30T17:03:35.070 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.070 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.070 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:35.070 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373342+0000", 2023-09-30T17:03:35.070 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1915000000000001e-05 2023-09-30T17:03:35.070 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:35.070 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:35.070 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:35.070 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.071 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.071 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:25 3.1f 3:fe07bba1:::100.00000000.inode:head [writefull 0~582] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:35.071 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:35.071 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 76.708758004000003, 2023-09-30T17:03:35.071 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021258651999999999, 2023-09-30T17:03:35.071 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:35.071 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:35.071 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:35.071 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.071 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:35.072 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:35.072 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:35.072 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.072 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.072 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:35.072 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:35.072 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:35.072 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.072 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.072 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:35.072 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352225+0000", 2023-09-30T17:03:35.073 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6899999999999997e-07 2023-09-30T17:03:35.073 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.073 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.073 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:35.073 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352236+0000", 2023-09-30T17:03:35.073 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0251000000000001e-05 2023-09-30T17:03:35.073 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.073 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.073 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:35.073 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352244+0000", 2023-09-30T17:03:35.073 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0770000000000008e-06 2023-09-30T17:03:35.073 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.074 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.074 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:35.074 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352251+0000", 2023-09-30T17:03:35.074 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4749999999999996e-06 2023-09-30T17:03:35.074 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.074 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.074 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:35.074 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354455+0000", 2023-09-30T17:03:35.074 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022043660000000001 2023-09-30T17:03:35.074 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.075 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.075 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:35.075 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354577+0000", 2023-09-30T17:03:35.075 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000121054 2023-09-30T17:03:35.075 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.075 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.075 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:35.075 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354723+0000", 2023-09-30T17:03:35.075 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014693900000000001 2023-09-30T17:03:35.075 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.075 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.075 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:35.076 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.356941+0000", 2023-09-30T17:03:35.076 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002217199 2023-09-30T17:03:35.076 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.076 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.076 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:35.076 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373392+0000", 2023-09-30T17:03:35.076 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016451774999999998 2023-09-30T17:03:35.076 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.076 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.076 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:35.076 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373445+0000", 2023-09-30T17:03:35.077 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.308e-05 2023-09-30T17:03:35.077 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.077 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.077 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:35.077 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373483+0000", 2023-09-30T17:03:35.077 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7766999999999999e-05 2023-09-30T17:03:35.077 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:35.077 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:35.077 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:35.077 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.077 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.078 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:27 3.b 3:d0630e4c:::mds0_sessionmap:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:35.078 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:35.078 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 76.708721913000005, 2023-09-30T17:03:35.078 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020903497, 2023-09-30T17:03:35.078 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:35.078 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:35.078 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:35.078 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.078 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:35.078 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:35.078 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:35.079 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.079 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.079 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:35.079 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:35.079 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:35.079 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.079 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.079 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:35.079 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352261+0000", 2023-09-30T17:03:35.079 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0800000000000004e-07 2023-09-30T17:03:35.079 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.079 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.080 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:35.080 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352266+0000", 2023-09-30T17:03:35.080 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1280000000000001e-06 2023-09-30T17:03:35.080 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.080 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.080 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:35.080 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352273+0000", 2023-09-30T17:03:35.080 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3730000000000004e-06 2023-09-30T17:03:35.080 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.080 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.080 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:35.081 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352279+0000", 2023-09-30T17:03:35.081 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7699999999999998e-06 2023-09-30T17:03:35.081 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.081 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.081 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:35.081 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352334+0000", 2023-09-30T17:03:35.081 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5547999999999997e-05 2023-09-30T17:03:35.081 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.081 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.081 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:35.081 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352435+0000", 2023-09-30T17:03:35.082 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100688 2023-09-30T17:03:35.082 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.082 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.082 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:35.082 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352585+0000", 2023-09-30T17:03:35.082 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000150068 2023-09-30T17:03:35.082 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.082 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.082 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:35.082 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354912+0000", 2023-09-30T17:03:35.083 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0023266770000000001 2023-09-30T17:03:35.083 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.083 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.083 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:35.083 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373066+0000", 2023-09-30T17:03:35.083 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018154474 2023-09-30T17:03:35.083 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.083 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.083 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:35.083 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373122+0000", 2023-09-30T17:03:35.084 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6193000000000002e-05 2023-09-30T17:03:35.084 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.084 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.084 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:35.084 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373164+0000", 2023-09-30T17:03:35.084 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1869999999999997e-05 2023-09-30T17:03:35.084 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:35.084 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:35.084 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:35.084 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.085 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.085 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:34 3.b 3:d5c7a900:::200.00000003:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:35.085 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:03:35.085 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 76.708686236999995, 2023-09-30T17:03:35.085 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021015097999999999, 2023-09-30T17:03:35.085 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:35.085 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:35.085 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:35.085 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.085 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:35.085 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:03:35.086 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:35.086 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.086 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.086 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:35.086 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352296+0000", 2023-09-30T17:03:35.086 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:35.086 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.086 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.086 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:35.086 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352297+0000", 2023-09-30T17:03:35.086 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8299999999999997e-07 2023-09-30T17:03:35.087 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.087 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.087 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:35.087 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352300+0000", 2023-09-30T17:03:35.087 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7460000000000001e-06 2023-09-30T17:03:35.087 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.087 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.087 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:35.087 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352307+0000", 2023-09-30T17:03:35.087 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4959999999999999e-06 2023-09-30T17:03:35.087 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.088 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.088 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:35.088 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352314+0000", 2023-09-30T17:03:35.088 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0190000000000001e-06 2023-09-30T17:03:35.088 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.088 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.088 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:35.088 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354070+0000", 2023-09-30T17:03:35.088 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001755936 2023-09-30T17:03:35.088 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.088 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.088 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:35.089 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.354221+0000", 2023-09-30T17:03:35.089 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000150884 2023-09-30T17:03:35.089 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.089 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.089 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:35.089 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373311+0000", 2023-09-30T17:03:35.089 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019090434 2023-09-30T17:03:35.089 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:35.089 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:35.089 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:35.089 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.090 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.090 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:35 3.1f 3:f83d65d8:::200.00000004:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:35.090 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:03:35.090 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 76.708657517999995, 2023-09-30T17:03:35.090 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021255174000000002, 2023-09-30T17:03:35.090 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:35.090 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:35.090 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:35.090 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.090 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:35.090 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:03:35.091 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:35.091 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.091 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.091 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:35.091 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352325+0000", 2023-09-30T17:03:35.091 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:35.091 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.091 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.091 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:35.091 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352326+0000", 2023-09-30T17:03:35.091 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3200000000000005e-07 2023-09-30T17:03:35.091 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.092 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.092 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:35.092 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352349+0000", 2023-09-30T17:03:35.092 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3183000000000001e-05 2023-09-30T17:03:35.092 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.092 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.092 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:35.092 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352358+0000", 2023-09-30T17:03:35.092 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5230000000000001e-06 2023-09-30T17:03:35.092 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.092 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.092 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:35.093 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.352365+0000", 2023-09-30T17:03:35.093 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3260000000000001e-06 2023-09-30T17:03:35.093 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.093 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.093 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:35.093 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355450+0000", 2023-09-30T17:03:35.093 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0030854049999999998 2023-09-30T17:03:35.093 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.093 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.093 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:35.093 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.355583+0000", 2023-09-30T17:03:35.093 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000133189 2023-09-30T17:03:35.093 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.094 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.094 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:35.094 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:02:18.373580+0000", 2023-09-30T17:03:35.094 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017997016000000001 2023-09-30T17:03:35.094 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:35.094 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:35.094 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:35.094 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.094 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.094 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:22 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-09-30T17:03:35.094 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:25.074944+0000", 2023-09-30T17:03:35.094 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.9860386259999991, 2023-09-30T17:03:35.095 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017740700000000002, 2023-09-30T17:03:35.095 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:35.095 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:35.095 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:35.095 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:35.095 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:35.095 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 22 2023-09-30T17:03:35.095 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.095 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:35.095 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.095 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:35.095 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.074944+0000", 2023-09-30T17:03:35.096 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:35.096 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.096 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.096 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:35.096 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.074944+0000", 2023-09-30T17:03:35.096 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:35.096 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.096 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.096 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:35.096 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.074945+0000", 2023-09-30T17:03:35.096 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0890000000000001e-06 2023-09-30T17:03:35.096 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.097 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.097 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:35.097 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.078709+0000", 2023-09-30T17:03:35.097 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0037635339999999998 2023-09-30T17:03:35.097 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.097 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.097 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:35.097 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.078723+0000", 2023-09-30T17:03:35.097 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4562000000000001e-05 2023-09-30T17:03:35.097 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.097 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.097 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:35.098 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.078738+0000", 2023-09-30T17:03:35.098 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5065000000000001e-05 2023-09-30T17:03:35.098 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.098 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.098 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:35.098 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.078794+0000", 2023-09-30T17:03:35.098 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5642e-05 2023-09-30T17:03:35.098 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.098 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.098 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:35.098 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.078893+0000", 2023-09-30T17:03:35.099 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8863000000000005e-05 2023-09-30T17:03:35.099 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.099 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.099 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:35.099 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.078998+0000", 2023-09-30T17:03:35.099 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000105153 2023-09-30T17:03:35.099 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.099 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.099 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:35.099 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.084862+0000", 2023-09-30T17:03:35.099 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0058643300000000001 2023-09-30T17:03:35.100 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.100 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.100 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:35.100 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.092503+0000", 2023-09-30T17:03:35.100 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0076404589999999996 2023-09-30T17:03:35.100 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.100 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.100 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:35.100 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.092619+0000", 2023-09-30T17:03:35.100 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011675699999999999 2023-09-30T17:03:35.100 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.101 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.101 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:35.101 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.092685+0000", 2023-09-30T17:03:35.101 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5246000000000005e-05 2023-09-30T17:03:35.101 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:35.101 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:35.101 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:35.101 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.101 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.101 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:29 4.12 4:48ab9bde:::100000001f8.00000015:head [write 0~4194304] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e36)", 2023-09-30T17:03:35.101 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:25.767986+0000", 2023-09-30T17:03:35.102 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.2929967569999992, 2023-09-30T17:03:35.102 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020236621999999999, 2023-09-30T17:03:35.102 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:35.102 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:35.102 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:35.102 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:35.102 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:35.102 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 29 2023-09-30T17:03:35.102 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.102 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:35.102 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.102 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:35.103 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.767986+0000", 2023-09-30T17:03:35.103 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:35.103 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.103 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.103 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:35.103 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.767986+0000", 2023-09-30T17:03:35.103 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:35.103 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.103 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.103 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:35.103 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.767988+0000", 2023-09-30T17:03:35.103 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.193e-06 2023-09-30T17:03:35.104 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.104 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.104 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:35.104 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.771721+0000", 2023-09-30T17:03:35.104 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0037333790000000002 2023-09-30T17:03:35.104 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.104 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.104 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:35.104 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.771744+0000", 2023-09-30T17:03:35.104 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3053000000000001e-05 2023-09-30T17:03:35.104 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.104 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.105 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:35.105 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.771755+0000", 2023-09-30T17:03:35.105 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0135999999999999e-05 2023-09-30T17:03:35.105 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.105 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.105 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:35.105 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.771821+0000", 2023-09-30T17:03:35.105 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6524000000000002e-05 2023-09-30T17:03:35.105 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.105 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.105 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:35.106 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.771933+0000", 2023-09-30T17:03:35.106 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111558 2023-09-30T17:03:35.106 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.106 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.106 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:35.106 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.772045+0000", 2023-09-30T17:03:35.106 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000112019 2023-09-30T17:03:35.106 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.106 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.106 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:35.106 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.777763+0000", 2023-09-30T17:03:35.106 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057178209999999997 2023-09-30T17:03:35.107 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.107 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.107 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:35.107 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.787968+0000", 2023-09-30T17:03:35.107 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010205133 2023-09-30T17:03:35.107 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.107 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.107 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:35.107 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.788137+0000", 2023-09-30T17:03:35.107 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016922700000000001 2023-09-30T17:03:35.107 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.107 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.108 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:35.108 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:25.788222+0000", 2023-09-30T17:03:35.108 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5579000000000002e-05 2023-09-30T17:03:35.108 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:35.108 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:35.108 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:35.108 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.108 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.108 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:2996 4.12 4:4be51a30:::100000001f8.0000000b:head [write 2252800~4096,write 2301952~4096,write 2416640~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-09-30T17:03:35.108 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:31.073468+0000", 2023-09-30T17:03:35.108 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.987514709, 2023-09-30T17:03:35.109 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017978257000000001, 2023-09-30T17:03:35.109 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:35.109 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:35.109 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:35.109 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:35.109 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:35.109 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 2996 2023-09-30T17:03:35.109 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.109 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:35.109 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.109 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:35.110 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.073468+0000", 2023-09-30T17:03:35.110 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:35.110 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.110 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.110 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:35.110 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.073468+0000", 2023-09-30T17:03:35.110 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:35.110 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.110 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.110 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:35.110 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.073468+0000", 2023-09-30T17:03:35.110 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8400000000000005e-07 2023-09-30T17:03:35.111 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.111 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.111 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:35.111 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.073529+0000", 2023-09-30T17:03:35.111 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0414999999999997e-05 2023-09-30T17:03:35.111 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.111 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.111 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:35.111 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.073539+0000", 2023-09-30T17:03:35.111 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0113e-05 2023-09-30T17:03:35.111 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.112 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.112 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:35.112 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.073546+0000", 2023-09-30T17:03:35.112 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4479999999999997e-06 2023-09-30T17:03:35.112 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.112 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.112 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:35.112 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.073632+0000", 2023-09-30T17:03:35.112 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5741000000000005e-05 2023-09-30T17:03:35.112 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.112 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.113 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:35.113 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.073692+0000", 2023-09-30T17:03:35.113 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9917999999999998e-05 2023-09-30T17:03:35.113 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.113 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.113 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:35.113 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.073830+0000", 2023-09-30T17:03:35.113 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013761599999999999 2023-09-30T17:03:35.113 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.113 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.113 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:35.114 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.087547+0000", 2023-09-30T17:03:35.114 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013717411000000001 2023-09-30T17:03:35.114 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.114 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.114 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:35.114 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.091362+0000", 2023-09-30T17:03:35.114 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003814816 2023-09-30T17:03:35.114 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.114 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.114 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:35.114 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.091411+0000", 2023-09-30T17:03:35.115 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8962999999999999e-05 2023-09-30T17:03:35.115 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.115 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.115 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:35.115 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.091446+0000", 2023-09-30T17:03:35.115 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5332e-05 2023-09-30T17:03:35.115 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:35.115 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:35.115 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:35.115 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.115 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.116 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:3000 4.37 4:ef395e89:::100000001f8.00000020:head [write 3305472~4096,write 3670016~4096,write 3887104~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-09-30T17:03:35.116 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:31.074421+0000", 2023-09-30T17:03:35.116 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.9865617059999998, 2023-09-30T17:03:35.116 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017182372000000001, 2023-09-30T17:03:35.116 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:35.116 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:35.116 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:35.116 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:35.116 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:35.116 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 3000 2023-09-30T17:03:35.116 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.117 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:35.117 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.117 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:35.117 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.074421+0000", 2023-09-30T17:03:35.117 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:35.117 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.117 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.117 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:35.117 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.074421+0000", 2023-09-30T17:03:35.117 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:35.117 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.117 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.118 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:35.118 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.074422+0000", 2023-09-30T17:03:35.118 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0999999999999998e-07 2023-09-30T17:03:35.118 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.118 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.118 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:35.118 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.074464+0000", 2023-09-30T17:03:35.118 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2157000000000003e-05 2023-09-30T17:03:35.118 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.118 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.119 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:35.119 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.074471+0000", 2023-09-30T17:03:35.119 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3780000000000003e-06 2023-09-30T17:03:35.119 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.119 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.119 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:35.119 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.074476+0000", 2023-09-30T17:03:35.119 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0520000000000001e-06 2023-09-30T17:03:35.120 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.120 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.120 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:35.120 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.074563+0000", 2023-09-30T17:03:35.120 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7101999999999994e-05 2023-09-30T17:03:35.120 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.120 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.120 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:35.120 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.074637+0000", 2023-09-30T17:03:35.120 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3677999999999995e-05 2023-09-30T17:03:35.120 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.120 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.121 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:35.121 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.074784+0000", 2023-09-30T17:03:35.121 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000147214 2023-09-30T17:03:35.121 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.121 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.121 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:35.121 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.086546+0000", 2023-09-30T17:03:35.121 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011761667 2023-09-30T17:03:35.121 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.121 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.121 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:35.122 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.091446+0000", 2023-09-30T17:03:35.122 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0048998169999999999 2023-09-30T17:03:35.122 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.122 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.122 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:35.122 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.091564+0000", 2023-09-30T17:03:35.122 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000118186 2023-09-30T17:03:35.122 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.122 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.122 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:35.123 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:31.091603+0000", 2023-09-30T17:03:35.123 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9511000000000002e-05 2023-09-30T17:03:35.123 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:35.123 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:35.123 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:35.123 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.123 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.123 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:11344 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 2846720~4096,write 2879488~4096,write 2912256~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-09-30T17:03:35.123 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:34.171534+0000", 2023-09-30T17:03:35.123 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.88944837099999996, 2023-09-30T17:03:35.124 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017422098, 2023-09-30T17:03:35.124 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:35.124 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:35.124 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:35.124 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:35.124 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:35.124 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 11344 2023-09-30T17:03:35.124 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.124 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:35.124 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.125 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:35.125 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.171534+0000", 2023-09-30T17:03:35.125 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:35.125 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.125 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.125 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:35.125 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.171534+0000", 2023-09-30T17:03:35.125 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:35.125 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.125 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.125 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:35.126 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.171535+0000", 2023-09-30T17:03:35.126 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7400000000000003e-07 2023-09-30T17:03:35.126 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.126 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.126 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:35.126 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.171546+0000", 2023-09-30T17:03:35.126 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1345999999999999e-05 2023-09-30T17:03:35.126 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.126 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.126 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:35.127 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.171553+0000", 2023-09-30T17:03:35.127 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5089999999999999e-06 2023-09-30T17:03:35.127 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.127 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.127 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:35.127 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.171558+0000", 2023-09-30T17:03:35.127 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3870000000000003e-06 2023-09-30T17:03:35.127 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.127 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.127 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:35.127 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.174564+0000", 2023-09-30T17:03:35.128 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0030063260000000001 2023-09-30T17:03:35.128 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.128 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.128 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:35.128 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.174614+0000", 2023-09-30T17:03:35.128 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9156000000000002e-05 2023-09-30T17:03:35.128 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.128 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.128 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:35.128 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.188821+0000", 2023-09-30T17:03:35.128 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.01420742 2023-09-30T17:03:35.129 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.129 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.129 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:35.129 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.188882+0000", 2023-09-30T17:03:35.129 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1408000000000006e-05 2023-09-30T17:03:35.129 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.129 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.129 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:35.129 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.188956+0000", 2023-09-30T17:03:35.131 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3972000000000003e-05 2023-09-30T17:03:35.131 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:35.131 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:35.131 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:35.131 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.131 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.131 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:11359 4.38 4:1dcf718c:::100000001f8.00000022:head [write 380928~4096,write 1290240~4096,write 1605632~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-09-30T17:03:35.131 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:34.176094+0000", 2023-09-30T17:03:35.132 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.88488850900000005, 2023-09-30T17:03:35.132 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017066512999999998, 2023-09-30T17:03:35.132 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:35.132 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:35.132 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:35.132 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:35.132 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:35.132 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 11359 2023-09-30T17:03:35.132 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.132 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:35.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.133 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:35.133 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.176094+0000", 2023-09-30T17:03:35.133 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:35.133 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.133 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:35.133 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.176094+0000", 2023-09-30T17:03:35.133 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:35.133 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.134 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:35.134 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.176095+0000", 2023-09-30T17:03:35.134 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6700000000000003e-07 2023-09-30T17:03:35.134 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.134 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.134 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:35.134 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.176108+0000", 2023-09-30T17:03:35.134 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.358e-05 2023-09-30T17:03:35.134 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.135 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.135 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:35.135 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.176119+0000", 2023-09-30T17:03:35.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0069e-05 2023-09-30T17:03:35.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.135 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.135 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:35.135 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.176125+0000", 2023-09-30T17:03:35.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6390000000000003e-06 2023-09-30T17:03:35.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.135 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.136 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:35.136 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.176171+0000", 2023-09-30T17:03:35.136 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5862000000000002e-05 2023-09-30T17:03:35.136 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.136 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.136 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:35.136 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.176230+0000", 2023-09-30T17:03:35.136 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8752000000000003e-05 2023-09-30T17:03:35.136 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.136 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.136 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:35.137 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.193038+0000", 2023-09-30T17:03:35.137 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016807736 2023-09-30T17:03:35.137 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.137 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.137 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:35.137 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.193087+0000", 2023-09-30T17:03:35.137 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9740999999999997e-05 2023-09-30T17:03:35.137 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.137 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.137 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:35.137 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.193161+0000", 2023-09-30T17:03:35.137 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3367000000000004e-05 2023-09-30T17:03:35.138 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:35.138 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:35.138 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:35.138 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.138 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.138 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:12973 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 1630208~8192,write 1642496~4096,write 1658880~4096,write 2117632~4096,write 2183168~4096,write 2191360~4096,write 2359296~4096,write 2609152~4096,write 2658304~4096,write 2719744~4096,write 2727936~4096,write 2805760~4096,write 2990080~4096,write 3166208~4096,write 3244032~4096,write 3313664~4096,write 3379200~4096,write 3391488~4096,write 3473408~4096,write 3489792~4096,write 3514368~4096,write 3551232~4096,write 3686400~4096,write 3764224~4096,write 3792896~4096,write 3825664~4096,write 3874816~4096,write 3989504~4096,write 4145152~8192,write 4165632~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-09-30T17:03:35.138 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:34.773130+0000", 2023-09-30T17:03:35.138 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.287852467, 2023-09-30T17:03:35.138 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017500231000000002, 2023-09-30T17:03:35.138 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:35.138 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:35.139 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:35.139 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:35.139 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:35.139 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 12973 2023-09-30T17:03:35.139 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.139 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:35.139 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.139 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:35.139 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.773130+0000", 2023-09-30T17:03:35.139 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:35.139 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.140 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.140 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:35.140 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.773130+0000", 2023-09-30T17:03:35.140 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:35.140 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.140 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.140 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:35.140 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.773131+0000", 2023-09-30T17:03:35.140 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4300000000000003e-07 2023-09-30T17:03:35.140 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.140 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.141 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:35.141 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.773273+0000", 2023-09-30T17:03:35.141 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000142552 2023-09-30T17:03:35.141 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.141 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.141 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:35.141 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.773282+0000", 2023-09-30T17:03:35.141 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8759999999999994e-06 2023-09-30T17:03:35.141 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.141 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.141 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:35.141 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.773288+0000", 2023-09-30T17:03:35.142 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0820000000000004e-06 2023-09-30T17:03:35.142 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.142 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.142 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:35.142 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.774903+0000", 2023-09-30T17:03:35.142 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0016148930000000001 2023-09-30T17:03:35.142 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.142 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.142 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:35.142 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.775011+0000", 2023-09-30T17:03:35.142 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000107897 2023-09-30T17:03:35.143 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.143 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.143 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:35.143 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.777147+0000", 2023-09-30T17:03:35.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002136191 2023-09-30T17:03:35.143 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.143 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.143 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:35.143 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.786902+0000", 2023-09-30T17:03:35.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0097550180000000007 2023-09-30T17:03:35.143 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.143 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.144 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:35.144 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.790504+0000", 2023-09-30T17:03:35.144 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003602095 2023-09-30T17:03:35.144 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.144 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.144 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:35.144 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.790591+0000", 2023-09-30T17:03:35.144 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6556000000000003e-05 2023-09-30T17:03:35.144 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.144 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.144 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:35.144 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.790630+0000", 2023-09-30T17:03:35.145 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9527999999999998e-05 2023-09-30T17:03:35.145 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:35.145 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:35.145 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:35.145 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.145 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.145 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:12974 4.12 4:48ab9bde:::100000001f8.00000015:head [write 98304~4096,write 114688~4096,write 122880~4096,write 135168~4096,write 225280~4096,write 565248~4096,write 745472~4096,write 774144~4096,write 917504~4096,write 946176~4096,write 958464~8192,write 983040~4096,write 1048576~4096,write 1327104~4096,write 1363968~4096,write 1675264~4096,write 1765376~4096,write 1794048~4096,write 1810432~4096,write 1867776~4096,write 1888256~8192,write 1925120~4096,write 1953792~4096,write 2007040~4096,write 2027520~4096,write 2633728~4096,write 2736128~4096,write 2899968~4096,write 3334144~4096,write 3354624~4096,write 3407872~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-09-30T17:03:35.145 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:34.773334+0000", 2023-09-30T17:03:35.145 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.28764869500000001, 2023-09-30T17:03:35.146 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019788156000000001, 2023-09-30T17:03:35.146 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:35.146 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:35.146 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:35.146 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:35.146 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:35.146 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 12974 2023-09-30T17:03:35.146 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.146 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:35.146 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.146 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:35.147 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.773334+0000", 2023-09-30T17:03:35.147 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:35.147 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.147 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.147 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:35.147 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.773334+0000", 2023-09-30T17:03:35.147 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:35.147 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.147 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.147 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:35.148 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.773334+0000", 2023-09-30T17:03:35.148 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3399999999999999e-07 2023-09-30T17:03:35.148 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.148 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.148 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:35.148 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.773481+0000", 2023-09-30T17:03:35.148 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000146241 2023-09-30T17:03:35.148 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.148 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.148 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:35.148 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.773490+0000", 2023-09-30T17:03:35.148 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.166e-06 2023-09-30T17:03:35.149 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.149 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.149 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:35.149 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.773514+0000", 2023-09-30T17:03:35.149 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4097e-05 2023-09-30T17:03:35.149 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.149 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.149 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:35.149 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.773565+0000", 2023-09-30T17:03:35.149 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1239999999999997e-05 2023-09-30T17:03:35.149 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.150 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.150 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:35.150 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.773678+0000", 2023-09-30T17:03:35.150 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000112435 2023-09-30T17:03:35.150 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.150 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.150 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:35.150 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.774267+0000", 2023-09-30T17:03:35.150 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00058893699999999999 2023-09-30T17:03:35.150 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.150 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.151 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:35.151 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.786986+0000", 2023-09-30T17:03:35.151 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012719789 2023-09-30T17:03:35.151 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.151 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.151 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:35.151 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.793043+0000", 2023-09-30T17:03:35.151 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006056339 2023-09-30T17:03:35.151 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.151 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.151 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:35.152 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.793094+0000", 2023-09-30T17:03:35.152 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1773e-05 2023-09-30T17:03:35.152 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.152 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.152 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:35.152 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.793122+0000", 2023-09-30T17:03:35.152 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7605000000000001e-05 2023-09-30T17:03:35.152 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:35.152 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:35.152 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:35.152 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.153 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.153 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:13053 4.38 4:1d13bf87:::100000001f8.00000030:head [write 2101248~4096,write 2166784~4096,write 2191360~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-09-30T17:03:35.153 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:34.830455+0000", 2023-09-30T17:03:35.153 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.230527336, 2023-09-30T17:03:35.153 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021510899999999999, 2023-09-30T17:03:35.153 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:35.153 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:35.153 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:35.153 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:35.153 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:35.153 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 13053 2023-09-30T17:03:35.154 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.154 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:35.154 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.154 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:35.154 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.830455+0000", 2023-09-30T17:03:35.154 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:35.154 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.154 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.154 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:35.154 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.830455+0000", 2023-09-30T17:03:35.154 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:35.154 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.155 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.155 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:35.155 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.830456+0000", 2023-09-30T17:03:35.155 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4399999999999999e-07 2023-09-30T17:03:35.155 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.155 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.155 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:35.155 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.830466+0000", 2023-09-30T17:03:35.155 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0051000000000001e-05 2023-09-30T17:03:35.155 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.155 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.156 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:35.156 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.830476+0000", 2023-09-30T17:03:35.156 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0304e-05 2023-09-30T17:03:35.156 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.156 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.156 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:35.156 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.830484+0000", 2023-09-30T17:03:35.156 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.153e-06 2023-09-30T17:03:35.156 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.156 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.156 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:35.156 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.830536+0000", 2023-09-30T17:03:35.157 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2132999999999997e-05 2023-09-30T17:03:35.157 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.157 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.157 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:35.157 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.830624+0000", 2023-09-30T17:03:35.157 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8486999999999995e-05 2023-09-30T17:03:35.157 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.157 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.157 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:35.157 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.851827+0000", 2023-09-30T17:03:35.158 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021202803999999999 2023-09-30T17:03:35.158 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.158 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.158 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:35.158 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.851877+0000", 2023-09-30T17:03:35.158 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0214999999999999e-05 2023-09-30T17:03:35.158 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.158 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.158 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:35.158 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.851966+0000", 2023-09-30T17:03:35.158 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9009000000000001e-05 2023-09-30T17:03:35.159 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:35.159 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:35.159 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:35.159 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.159 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.159 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:13058 4.38 4:1d13bf87:::100000001f8.00000030:head [write 1875968~4096,write 1957888~4096,write 2215936~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-09-30T17:03:35.159 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:34.831824+0000", 2023-09-30T17:03:35.159 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.229158589, 2023-09-30T17:03:35.159 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020274692, 2023-09-30T17:03:35.159 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:35.159 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:35.159 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:35.160 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:35.160 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:35.160 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 13058 2023-09-30T17:03:35.160 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.160 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:35.160 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.160 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:35.160 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.831824+0000", 2023-09-30T17:03:35.160 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:35.160 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.160 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.160 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:35.161 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.831824+0000", 2023-09-30T17:03:35.161 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:35.161 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.161 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.161 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:35.161 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.831825+0000", 2023-09-30T17:03:35.161 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1200000000000001e-07 2023-09-30T17:03:35.161 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.161 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.161 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:35.161 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.831845+0000", 2023-09-30T17:03:35.161 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9636e-05 2023-09-30T17:03:35.162 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.162 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.162 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:35.162 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.831861+0000", 2023-09-30T17:03:35.162 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6691e-05 2023-09-30T17:03:35.162 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.162 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.162 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:35.162 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.831870+0000", 2023-09-30T17:03:35.162 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8200000000000003e-06 2023-09-30T17:03:35.162 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.163 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.163 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:35.163 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.831928+0000", 2023-09-30T17:03:35.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7908000000000002e-05 2023-09-30T17:03:35.163 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.163 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.163 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:35.163 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.832002+0000", 2023-09-30T17:03:35.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3588000000000001e-05 2023-09-30T17:03:35.163 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.163 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.163 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:35.164 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.851977+0000", 2023-09-30T17:03:35.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019975026999999999 2023-09-30T17:03:35.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.164 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:35.164 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.852030+0000", 2023-09-30T17:03:35.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3000000000000001e-05 2023-09-30T17:03:35.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.164 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:35.164 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.852099+0000", 2023-09-30T17:03:35.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9109999999999994e-05 2023-09-30T17:03:35.165 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:35.165 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:35.165 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:35.165 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.165 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.165 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:13078 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 1798144~4096,write 1822720~4096,write 1863680~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-09-30T17:03:35.165 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:34.837099+0000", 2023-09-30T17:03:35.165 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.223884111, 2023-09-30T17:03:35.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018083497, 2023-09-30T17:03:35.165 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:35.165 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:35.165 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:35.166 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:35.166 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:35.166 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 13078 2023-09-30T17:03:35.166 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.166 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:35.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.166 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:35.166 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.837099+0000", 2023-09-30T17:03:35.166 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:35.166 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.167 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:35.167 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.837099+0000", 2023-09-30T17:03:35.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:35.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.167 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:35.167 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.837099+0000", 2023-09-30T17:03:35.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8100000000000002e-07 2023-09-30T17:03:35.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.167 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:35.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.837108+0000", 2023-09-30T17:03:35.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6179999999999995e-06 2023-09-30T17:03:35.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:35.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.837117+0000", 2023-09-30T17:03:35.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0450000000000006e-06 2023-09-30T17:03:35.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:35.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.837124+0000", 2023-09-30T17:03:35.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8349999999999998e-06 2023-09-30T17:03:35.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:35.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.837188+0000", 2023-09-30T17:03:35.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3812999999999994e-05 2023-09-30T17:03:35.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:35.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.837267+0000", 2023-09-30T17:03:35.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9157000000000001e-05 2023-09-30T17:03:35.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.170 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:35.170 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.855051+0000", 2023-09-30T17:03:35.170 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017783842000000001 2023-09-30T17:03:35.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.170 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:35.170 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.855107+0000", 2023-09-30T17:03:35.170 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6335999999999997e-05 2023-09-30T17:03:35.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:35.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.855182+0000", 2023-09-30T17:03:35.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5069999999999998e-05 2023-09-30T17:03:35.171 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:35.171 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:35.171 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:35.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.171 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:13081 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 1040384~4096,write 1064960~4096,write 1130496~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-09-30T17:03:35.171 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:34.838043+0000", 2023-09-30T17:03:35.171 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.22294001699999999, 2023-09-30T17:03:35.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020639687, 2023-09-30T17:03:35.172 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:35.172 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:35.172 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:35.172 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:35.172 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:35.172 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 13081 2023-09-30T17:03:35.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.172 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:35.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.172 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:35.172 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.838043+0000", 2023-09-30T17:03:35.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:35.173 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.173 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:35.173 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.838043+0000", 2023-09-30T17:03:35.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:35.173 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.173 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:35.173 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.838043+0000", 2023-09-30T17:03:35.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1600000000000001e-07 2023-09-30T17:03:35.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:35.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.838057+0000", 2023-09-30T17:03:35.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4085e-05 2023-09-30T17:03:35.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:35.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.838066+0000", 2023-09-30T17:03:35.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5150000000000006e-06 2023-09-30T17:03:35.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.175 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:35.175 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.838072+0000", 2023-09-30T17:03:35.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3729999999999998e-06 2023-09-30T17:03:35.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.175 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:35.175 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.838217+0000", 2023-09-30T17:03:35.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014465499999999999 2023-09-30T17:03:35.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:35.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.838324+0000", 2023-09-30T17:03:35.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010694199999999999 2023-09-30T17:03:35.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:35.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.858543+0000", 2023-09-30T17:03:35.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020219043999999999 2023-09-30T17:03:35.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:35.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.858607+0000", 2023-09-30T17:03:35.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3817000000000002e-05 2023-09-30T17:03:35.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.177 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:35.177 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.858682+0000", 2023-09-30T17:03:35.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5640000000000001e-05 2023-09-30T17:03:35.177 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:35.177 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:35.177 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:35.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.178 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:13088 4.28 e39/17 4:15eeb89b:::100000001f8.00000032:head v 39'383, mlcod=39'381)", 2023-09-30T17:03:35.178 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:34.840187+0000", 2023-09-30T17:03:35.178 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.22079526799999999, 2023-09-30T17:03:35.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018533054, 2023-09-30T17:03:35.178 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:35.178 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:35.178 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:35.178 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.178 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:35.178 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.840187+0000", 2023-09-30T17:03:35.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:35.178 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:35.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.840187+0000", 2023-09-30T17:03:35.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:35.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:35.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.840188+0000", 2023-09-30T17:03:35.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1699999999999998e-07 2023-09-30T17:03:35.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.180 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:35.180 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.840203+0000", 2023-09-30T17:03:35.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4783999999999999e-05 2023-09-30T17:03:35.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.180 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:35.180 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.840212+0000", 2023-09-30T17:03:35.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1700000000000003e-06 2023-09-30T17:03:35.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.180 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:35.180 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.840218+0000", 2023-09-30T17:03:35.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5910000000000001e-06 2023-09-30T17:03:35.181 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.181 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.181 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:35.181 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.840267+0000", 2023-09-30T17:03:35.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8538999999999997e-05 2023-09-30T17:03:35.181 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.181 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.181 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:35.181 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.840298+0000", 2023-09-30T17:03:35.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0905999999999999e-05 2023-09-30T17:03:35.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.182 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:35.182 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.858687+0000", 2023-09-30T17:03:35.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018388802999999999 2023-09-30T17:03:35.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.182 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:35.182 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.858720+0000", 2023-09-30T17:03:35.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3744000000000001e-05 2023-09-30T17:03:35.182 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:35.183 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:35.183 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:35.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.183 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:13307 4.f 4:f0d983b2:::100000001f8.0000001f:head [write 192512~4096,write 217088~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-09-30T17:03:35.183 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:34.917852+0000", 2023-09-30T17:03:35.183 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.143130376, 2023-09-30T17:03:35.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018908504999999999, 2023-09-30T17:03:35.183 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:35.183 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:35.184 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:35.184 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:35.184 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:35.184 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 13307 2023-09-30T17:03:35.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.184 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:35.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.184 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:35.184 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.917852+0000", 2023-09-30T17:03:35.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:35.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.185 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:35.185 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.917852+0000", 2023-09-30T17:03:35.185 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:35.185 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.185 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.185 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:35.185 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.917853+0000", 2023-09-30T17:03:35.185 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.06e-07 2023-09-30T17:03:35.185 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.185 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.186 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:35.186 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.917863+0000", 2023-09-30T17:03:35.186 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0180000000000001e-05 2023-09-30T17:03:35.186 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.186 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.186 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:35.186 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.917879+0000", 2023-09-30T17:03:35.186 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5579000000000001e-05 2023-09-30T17:03:35.186 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:35.187 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.917895+0000", 2023-09-30T17:03:35.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6303999999999998e-05 2023-09-30T17:03:35.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:35.187 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.924173+0000", 2023-09-30T17:03:35.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0062777049999999997 2023-09-30T17:03:35.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:35.188 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.924251+0000", 2023-09-30T17:03:35.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7898999999999994e-05 2023-09-30T17:03:35.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.188 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:35.188 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.924382+0000", 2023-09-30T17:03:35.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013139099999999999 2023-09-30T17:03:35.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.188 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:35.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.928348+0000", 2023-09-30T17:03:35.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039663299999999997 2023-09-30T17:03:35.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:35.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.936684+0000", 2023-09-30T17:03:35.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0083353569999999998 2023-09-30T17:03:35.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:35.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.936739+0000", 2023-09-30T17:03:35.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5102999999999997e-05 2023-09-30T17:03:35.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.190 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:35.190 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.936761+0000", 2023-09-30T17:03:35.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1951e-05 2023-09-30T17:03:35.190 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:35.190 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:35.190 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:35.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.191 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:13312 4.f 4:f2a80dfe:::100000001f8.00000019:head [write 1306624~4096,write 1359872~4096,write 1372160~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-09-30T17:03:35.191 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:34.919515+0000", 2023-09-30T17:03:35.191 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.141467132, 2023-09-30T17:03:35.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017375781999999999, 2023-09-30T17:03:35.191 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:35.191 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:35.191 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:35.191 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:35.191 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:35.191 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 13312 2023-09-30T17:03:35.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.192 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:35.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:35.192 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.919515+0000", 2023-09-30T17:03:35.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:35.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:35.192 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.919515+0000", 2023-09-30T17:03:35.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:35.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:35.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.919516+0000", 2023-09-30T17:03:35.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5199999999999995e-07 2023-09-30T17:03:35.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:35.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.919532+0000", 2023-09-30T17:03:35.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5088e-05 2023-09-30T17:03:35.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:35.194 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.919545+0000", 2023-09-30T17:03:35.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3947999999999999e-05 2023-09-30T17:03:35.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:35.194 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.919553+0000", 2023-09-30T17:03:35.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4250000000000001e-06 2023-09-30T17:03:35.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:35.194 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.925117+0000", 2023-09-30T17:03:35.195 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005564378 2023-09-30T17:03:35.195 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.195 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.195 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:35.195 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.925193+0000", 2023-09-30T17:03:35.195 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5371999999999996e-05 2023-09-30T17:03:35.195 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.195 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.195 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:35.195 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.925343+0000", 2023-09-30T17:03:35.195 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015018900000000001 2023-09-30T17:03:35.196 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.196 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.196 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:35.196 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.928353+0000", 2023-09-30T17:03:35.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0030106099999999999 2023-09-30T17:03:35.196 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.196 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.196 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:35.196 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.936802+0000", 2023-09-30T17:03:35.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0084488989999999993 2023-09-30T17:03:35.197 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.197 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:35.197 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.936855+0000", 2023-09-30T17:03:35.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3059000000000001e-05 2023-09-30T17:03:35.197 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:35.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:35.197 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:35.197 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:34.936891+0000", 2023-09-30T17:03:35.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5862000000000003e-05 2023-09-30T17:03:35.197 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:35.197 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:35.198 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:35.198 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:35.198 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:35.198 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:35.199 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:35.199+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:35.200 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:03:35.300 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:35.300+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:35.388 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:35.389 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:03:35.389 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.389 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:14646 4.28 4:153ae410:::100000001f8.0000003b:head [write 135168~4096 in=4096b,write 401408~4096 in=4096b,write 491520~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-09-30T17:03:35.389 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:35.386317+0000", 2023-09-30T17:03:35.389 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0023333469999999999, 2023-09-30T17:03:35.389 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0023689000000000002, 2023-09-30T17:03:35.389 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:35.389 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:35.390 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:35.390 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:35.390 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:35.390 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 14646 2023-09-30T17:03:35.390 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.390 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:35.390 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.390 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:35.390 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.386317+0000", 2023-09-30T17:03:35.390 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:35.390 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.390 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.391 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:35.391 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.386317+0000", 2023-09-30T17:03:35.391 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:35.391 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.391 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.391 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:35.391 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.386318+0000", 2023-09-30T17:03:35.391 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3200000000000004e-07 2023-09-30T17:03:35.391 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.391 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.392 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:35.392 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.386332+0000", 2023-09-30T17:03:35.392 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4266e-05 2023-09-30T17:03:35.392 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.392 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.392 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:35.392 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.386345+0000", 2023-09-30T17:03:35.392 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2661e-05 2023-09-30T17:03:35.392 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.392 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.393 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:35.393 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.386353+0000", 2023-09-30T17:03:35.393 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2209999999999997e-06 2023-09-30T17:03:35.393 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.393 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.393 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:35.393 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.386403+0000", 2023-09-30T17:03:35.393 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9892000000000003e-05 2023-09-30T17:03:35.393 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.393 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.393 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:35.394 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.386455+0000", 2023-09-30T17:03:35.394 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1845999999999998e-05 2023-09-30T17:03:35.394 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.394 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.394 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:35.394 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.386546+0000", 2023-09-30T17:03:35.394 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.0608999999999999e-05 2023-09-30T17:03:35.394 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.394 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.394 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:35.394 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.387441+0000", 2023-09-30T17:03:35.395 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00089530499999999999 2023-09-30T17:03:35.395 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.395 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:35.395 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.395 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.395 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.395 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:14650 4.36 4:6da220e6:::100000001f8.0000003f:head [write 770048~4096 in=4096b,write 782336~4096 in=4096b,write 839680~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-09-30T17:03:35.395 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:35.387390+0000", 2023-09-30T17:03:35.395 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0012611040000000001, 2023-09-30T17:03:35.395 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001392522, 2023-09-30T17:03:35.395 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:35.395 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:35.396 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:35.396 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:35.396 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:35.396 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 14650 2023-09-30T17:03:35.396 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.396 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:35.396 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.396 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:35.396 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.387390+0000", 2023-09-30T17:03:35.396 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:35.396 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.396 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.397 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:35.397 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.387390+0000", 2023-09-30T17:03:35.397 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:35.397 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.397 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.397 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:35.397 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.387390+0000", 2023-09-30T17:03:35.397 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.09e-07 2023-09-30T17:03:35.397 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.397 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.397 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:35.398 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.387407+0000", 2023-09-30T17:03:35.398 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7013000000000001e-05 2023-09-30T17:03:35.398 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.398 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.398 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:35.398 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.387421+0000", 2023-09-30T17:03:35.398 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3583e-05 2023-09-30T17:03:35.398 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.398 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.398 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:35.398 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.387427+0000", 2023-09-30T17:03:35.399 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.677e-06 2023-09-30T17:03:35.399 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.399 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.399 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:35.399 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.387472+0000", 2023-09-30T17:03:35.399 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5194999999999997e-05 2023-09-30T17:03:35.399 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.399 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.399 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:35.399 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.387521+0000", 2023-09-30T17:03:35.399 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9431999999999997e-05 2023-09-30T17:03:35.400 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.400 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.400 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:35.400 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.387604+0000", 2023-09-30T17:03:35.400 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2743000000000004e-05 2023-09-30T17:03:35.400 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.400 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:35.400 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.401 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.401 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.401 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:14653 4.19 4:997b7129:::100000001f8.00000000:head [write 4026368~4096 in=4096b,write 4034560~4096 in=4096b,write 4145152~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-09-30T17:03:35.401 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:35.388358+0000", 2023-09-30T17:03:35.401 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.000292902, 2023-09-30T17:03:35.401 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00051689100000000001, 2023-09-30T17:03:35.401 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:35.401 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:35.401 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:35.401 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:35.401 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:35.402 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 14653 2023-09-30T17:03:35.402 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.402 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:35.402 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.402 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:35.402 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.388358+0000", 2023-09-30T17:03:35.402 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:35.402 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.402 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.402 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:35.403 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.388358+0000", 2023-09-30T17:03:35.403 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:35.403 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.403 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.403 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:35.403 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.388359+0000", 2023-09-30T17:03:35.403 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8899999999999998e-07 2023-09-30T17:03:35.403 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.403 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.403 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:35.403 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.388379+0000", 2023-09-30T17:03:35.403 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.0508000000000001e-05 2023-09-30T17:03:35.404 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.404 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.404 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:35.404 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.388392+0000", 2023-09-30T17:03:35.404 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3069e-05 2023-09-30T17:03:35.404 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.404 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.404 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:35.404 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.388400+0000", 2023-09-30T17:03:35.404 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9160000000000001e-06 2023-09-30T17:03:35.404 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.404 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.405 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:35.405 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.388447+0000", 2023-09-30T17:03:35.405 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6755999999999998e-05 2023-09-30T17:03:35.405 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.405 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.405 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:35.405 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.388507+0000", 2023-09-30T17:03:35.405 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0154e-05 2023-09-30T17:03:35.405 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.405 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.405 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:35.406 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.388619+0000", 2023-09-30T17:03:35.406 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000111829 2023-09-30T17:03:35.406 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.406 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:35.406 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.406 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.406 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.406 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:14652 4.12 e39/17 4:48ab9bde:::100000001f8.00000015:head v 39'467, mlcod=39'465)", 2023-09-30T17:03:35.406 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:35.388409+0000", 2023-09-30T17:03:35.406 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.00024156700000000001, 2023-09-30T17:03:35.406 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00051299400000000002, 2023-09-30T17:03:35.407 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:35.407 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:35.407 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:35.407 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.407 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:35.407 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.388409+0000", 2023-09-30T17:03:35.407 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:35.407 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.407 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.407 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:35.407 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.388409+0000", 2023-09-30T17:03:35.407 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:35.408 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.408 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.408 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:35.408 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.388410+0000", 2023-09-30T17:03:35.408 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8299999999999997e-07 2023-09-30T17:03:35.408 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.408 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.408 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:35.408 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.388424+0000", 2023-09-30T17:03:35.408 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4365000000000001e-05 2023-09-30T17:03:35.408 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.409 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.409 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:35.409 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.388433+0000", 2023-09-30T17:03:35.409 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8049999999999996e-06 2023-09-30T17:03:35.409 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.409 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.409 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:35.409 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.388439+0000", 2023-09-30T17:03:35.409 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5540000000000003e-06 2023-09-30T17:03:35.409 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.409 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.410 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:35.410 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.388485+0000", 2023-09-30T17:03:35.410 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5961999999999998e-05 2023-09-30T17:03:35.410 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.410 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.410 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:35.410 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.388506+0000", 2023-09-30T17:03:35.410 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.0692000000000001e-05 2023-09-30T17:03:35.410 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.410 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:35.410 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.411 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.411 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.411 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:14654 4.3b 4:dcc0c15f:::100000001f8.0000001a:head [write 2310144~4096 in=4096b,write 2490368~4096 in=4096b,write 2572288~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-09-30T17:03:35.411 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:35.388607+0000", 2023-09-30T17:03:35.411 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4.3466e-05, 2023-09-30T17:03:35.411 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000352445, 2023-09-30T17:03:35.411 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:35.411 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:35.411 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:35.411 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:35.411 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:35.411 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 14654 2023-09-30T17:03:35.412 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.412 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:35.412 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.412 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:35.412 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.388607+0000", 2023-09-30T17:03:35.412 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:35.412 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.412 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.412 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:35.412 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.388607+0000", 2023-09-30T17:03:35.412 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:35.413 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.413 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.413 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:35.413 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.388608+0000", 2023-09-30T17:03:35.413 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.16e-07 2023-09-30T17:03:35.413 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.413 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.413 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:35.413 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.388620+0000", 2023-09-30T17:03:35.413 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1924e-05 2023-09-30T17:03:35.413 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.413 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.414 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:35.414 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.388632+0000", 2023-09-30T17:03:35.414 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1505000000000001e-05 2023-09-30T17:03:35.414 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.414 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.414 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:35.414 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.388640+0000", 2023-09-30T17:03:35.414 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5129999999999996e-06 2023-09-30T17:03:35.414 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.414 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.414 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:35.414 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.388717+0000", 2023-09-30T17:03:35.415 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6805999999999996e-05 2023-09-30T17:03:35.415 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.415 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.415 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:35.415 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.388803+0000", 2023-09-30T17:03:35.415 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.6611000000000001e-05 2023-09-30T17:03:35.415 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.415 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:35.415 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.415 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.415 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-09-30T17:03:35.416 INFO:teuthology.orchestra.run.smithi031.stdout: "num_ops": 5 2023-09-30T17:03:35.416 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:35.416 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is unset 2023-09-30T17:03:35.417 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:35.417+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:35.418 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:03:35.518 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:35.518+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:35.606 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:35.606 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:03:35.606 INFO:teuthology.orchestra.run.smithi031.stdout: "complaint_time": 30, 2023-09-30T17:03:35.606 INFO:teuthology.orchestra.run.smithi031.stdout: "num_blocked_ops": 0 2023-09-30T17:03:35.606 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:35.618 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:35.618+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:35.620 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:03:35.720 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:35.719+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:35.805 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:35.806 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 20, 2023-09-30T17:03:35.806 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 600, 2023-09-30T17:03:35.806 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:03:35.806 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.806 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:14 3.15 3:a93a17c2:::604.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:35.806 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:03:35.806 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 77.452301477000006, 2023-09-30T17:03:35.806 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.025313649000000001, 2023-09-30T17:03:35.806 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:35.807 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:35.807 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:35.807 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.807 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:35.807 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:03:35.807 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:35.807 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.807 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.807 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:35.807 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351545+0000", 2023-09-30T17:03:35.807 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:35.808 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.808 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.808 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:35.808 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351551+0000", 2023-09-30T17:03:35.808 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3380000000000004e-06 2023-09-30T17:03:35.808 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.808 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.808 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:35.808 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351559+0000", 2023-09-30T17:03:35.808 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9589999999999995e-06 2023-09-30T17:03:35.808 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.809 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.809 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:35.809 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351571+0000", 2023-09-30T17:03:35.809 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2065999999999999e-05 2023-09-30T17:03:35.809 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.809 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.809 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:35.809 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.351706+0000", 2023-09-30T17:03:35.809 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00013553799999999999 2023-09-30T17:03:35.809 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.809 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.809 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:35.810 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353016+0000", 2023-09-30T17:03:35.810 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0013099209999999999 2023-09-30T17:03:35.810 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.810 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.810 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:35.810 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353023+0000", 2023-09-30T17:03:35.810 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2479999999999999e-06 2023-09-30T17:03:35.810 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.810 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.810 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:35.811 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360348+0000", 2023-09-30T17:03:35.811 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0073248949999999997 2023-09-30T17:03:35.811 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.811 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.811 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:35.811 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360787+0000", 2023-09-30T17:03:35.811 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00043875199999999999 2023-09-30T17:03:35.811 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.811 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.811 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:35.811 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360892+0000", 2023-09-30T17:03:35.811 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010508199999999999 2023-09-30T17:03:35.812 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.812 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.812 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:35.812 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365132+0000", 2023-09-30T17:03:35.812 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0042396480000000004 2023-09-30T17:03:35.812 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.812 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.812 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:35.812 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376746+0000", 2023-09-30T17:03:35.812 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011614157 2023-09-30T17:03:35.812 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.812 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.813 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:35.813 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376811+0000", 2023-09-30T17:03:35.813 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5005999999999994e-05 2023-09-30T17:03:35.813 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.813 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.813 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:35.813 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376859+0000", 2023-09-30T17:03:35.813 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8038999999999999e-05 2023-09-30T17:03:35.813 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.813 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:35.813 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.814 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.814 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.814 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:15 3.15 3:a93a17c2:::604.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:35.814 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:03:35.814 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 77.451803678000005, 2023-09-30T17:03:35.814 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024923989000000001, 2023-09-30T17:03:35.814 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:35.814 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:35.814 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:35.814 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.814 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:35.815 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:03:35.815 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:35.815 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.815 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.815 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:35.815 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352043+0000", 2023-09-30T17:03:35.815 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:35.815 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.815 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.815 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:35.815 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352044+0000", 2023-09-30T17:03:35.815 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9199999999999999e-07 2023-09-30T17:03:35.816 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.816 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.816 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:35.816 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352050+0000", 2023-09-30T17:03:35.816 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8880000000000002e-06 2023-09-30T17:03:35.816 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.816 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.816 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:35.816 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352143+0000", 2023-09-30T17:03:35.816 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2721999999999998e-05 2023-09-30T17:03:35.816 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.816 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.816 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:35.817 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352155+0000", 2023-09-30T17:03:35.817 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2279000000000001e-05 2023-09-30T17:03:35.817 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.817 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.817 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:35.817 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353114+0000", 2023-09-30T17:03:35.817 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00095943700000000005 2023-09-30T17:03:35.817 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.817 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.817 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:35.817 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353121+0000", 2023-09-30T17:03:35.817 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.494e-06 2023-09-30T17:03:35.818 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.818 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.818 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:35.818 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361491+0000", 2023-09-30T17:03:35.818 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0083697359999999991 2023-09-30T17:03:35.818 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.818 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.818 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:35.818 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361573+0000", 2023-09-30T17:03:35.818 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2822000000000001e-05 2023-09-30T17:03:35.818 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.818 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.819 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:35.819 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362166+0000", 2023-09-30T17:03:35.819 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00059223299999999995 2023-09-30T17:03:35.819 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.819 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.819 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:35.819 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365209+0000", 2023-09-30T17:03:35.819 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.003043212 2023-09-30T17:03:35.819 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.819 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.819 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:35.819 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376910+0000", 2023-09-30T17:03:35.820 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011700898 2023-09-30T17:03:35.820 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.820 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.820 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:35.820 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376945+0000", 2023-09-30T17:03:35.820 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4795000000000001e-05 2023-09-30T17:03:35.820 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.820 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.820 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:35.820 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376967+0000", 2023-09-30T17:03:35.820 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2580999999999999e-05 2023-09-30T17:03:35.820 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.820 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:35.821 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.821 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.821 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.821 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:16 3.1d 3:b871830b:::605.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:35.821 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:03:35.821 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 77.451633758, 2023-09-30T17:03:35.821 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023120405, 2023-09-30T17:03:35.821 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:35.821 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:35.821 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:35.821 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.821 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:35.822 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:03:35.822 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:35.822 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.822 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.822 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:35.822 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352213+0000", 2023-09-30T17:03:35.822 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:35.822 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.822 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.822 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:35.822 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352214+0000", 2023-09-30T17:03:35.823 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8400000000000003e-07 2023-09-30T17:03:35.823 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.823 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.823 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:35.823 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352233+0000", 2023-09-30T17:03:35.823 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8946000000000001e-05 2023-09-30T17:03:35.823 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.823 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.823 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:35.823 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352297+0000", 2023-09-30T17:03:35.823 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3540999999999994e-05 2023-09-30T17:03:35.823 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.823 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.824 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:35.824 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352450+0000", 2023-09-30T17:03:35.824 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015364799999999999 2023-09-30T17:03:35.824 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.824 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.824 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:35.824 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353098+0000", 2023-09-30T17:03:35.824 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00064820299999999997 2023-09-30T17:03:35.824 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.824 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.824 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:35.824 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353103+0000", 2023-09-30T17:03:35.825 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0529999999999997e-06 2023-09-30T17:03:35.825 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.825 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.825 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:35.825 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.358558+0000", 2023-09-30T17:03:35.825 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0054550249999999996 2023-09-30T17:03:35.825 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.825 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.825 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:35.825 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.358741+0000", 2023-09-30T17:03:35.825 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00018210200000000001 2023-09-30T17:03:35.825 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.826 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.826 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:35.826 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.359683+0000", 2023-09-30T17:03:35.826 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00094202299999999995 2023-09-30T17:03:35.826 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.826 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.826 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:35.826 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365044+0000", 2023-09-30T17:03:35.826 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053616219999999999 2023-09-30T17:03:35.826 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.826 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.826 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:35.827 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375256+0000", 2023-09-30T17:03:35.827 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010212156 2023-09-30T17:03:35.827 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.827 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.827 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:35.827 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375300+0000", 2023-09-30T17:03:35.827 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3961999999999997e-05 2023-09-30T17:03:35.827 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.827 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.827 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:35.827 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.375334+0000", 2023-09-30T17:03:35.828 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.324e-05 2023-09-30T17:03:35.828 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.828 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:35.828 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.828 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.828 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.828 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:17 3.1d 3:b871830b:::605.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:35.828 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:03:35.828 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 77.451318740000005, 2023-09-30T17:03:35.828 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024240660000000001, 2023-09-30T17:03:35.828 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:35.828 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:35.829 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:35.829 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.829 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:35.829 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:03:35.829 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:35.829 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.829 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.829 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:35.829 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352528+0000", 2023-09-30T17:03:35.829 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:35.829 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.829 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.830 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:35.830 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352529+0000", 2023-09-30T17:03:35.830 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1379999999999999e-06 2023-09-30T17:03:35.830 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.830 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.830 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:35.830 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352536+0000", 2023-09-30T17:03:35.830 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3489999999999997e-06 2023-09-30T17:03:35.830 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.830 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.830 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:35.830 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352547+0000", 2023-09-30T17:03:35.831 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1109e-05 2023-09-30T17:03:35.831 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.831 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.831 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:35.831 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352560+0000", 2023-09-30T17:03:35.831 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3046e-05 2023-09-30T17:03:35.831 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.831 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.831 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:35.831 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353142+0000", 2023-09-30T17:03:35.831 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00058174699999999997 2023-09-30T17:03:35.831 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.831 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.832 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:35.832 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353147+0000", 2023-09-30T17:03:35.832 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5840000000000002e-06 2023-09-30T17:03:35.832 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.832 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.832 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:35.832 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360374+0000", 2023-09-30T17:03:35.832 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0072270049999999999 2023-09-30T17:03:35.832 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.832 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.832 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:35.833 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360795+0000", 2023-09-30T17:03:35.833 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00042088999999999999 2023-09-30T17:03:35.833 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.833 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.833 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:35.833 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.360967+0000", 2023-09-30T17:03:35.833 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017235699999999999 2023-09-30T17:03:35.833 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.833 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.833 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:35.833 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365051+0000", 2023-09-30T17:03:35.833 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0040837429999999999 2023-09-30T17:03:35.834 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.834 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.834 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:35.834 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376708+0000", 2023-09-30T17:03:35.834 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011656866 2023-09-30T17:03:35.834 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.834 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.834 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:35.834 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376745+0000", 2023-09-30T17:03:35.834 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6769e-05 2023-09-30T17:03:35.834 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.834 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.835 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:35.835 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376769+0000", 2023-09-30T17:03:35.835 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4057e-05 2023-09-30T17:03:35.835 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.835 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:35.835 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.835 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.835 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.835 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:22 3.e 3:717a0223:::608.00000000:head [omap-set-header] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:35.835 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:35.835 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 77.451059384999994, 2023-09-30T17:03:35.835 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023472704, 2023-09-30T17:03:35.835 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:35.836 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:35.836 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:35.836 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.836 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:35.836 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:35.836 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:35.836 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.836 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.836 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:35.836 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:35.836 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:35.836 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.837 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.837 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:35.837 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352788+0000", 2023-09-30T17:03:35.837 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8000000000000005e-07 2023-09-30T17:03:35.837 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.837 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.837 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:35.837 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352794+0000", 2023-09-30T17:03:35.837 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.789e-06 2023-09-30T17:03:35.837 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.837 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.837 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:35.838 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352805+0000", 2023-09-30T17:03:35.838 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0848e-05 2023-09-30T17:03:35.838 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.838 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.838 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:35.838 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.352812+0000", 2023-09-30T17:03:35.838 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4449999999999999e-06 2023-09-30T17:03:35.838 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.838 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.838 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:35.838 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353063+0000", 2023-09-30T17:03:35.839 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00025046299999999998 2023-09-30T17:03:35.839 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.839 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.839 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:35.839 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353071+0000", 2023-09-30T17:03:35.839 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6739999999999997e-06 2023-09-30T17:03:35.839 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.839 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.839 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:35.839 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.361696+0000", 2023-09-30T17:03:35.839 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0086251609999999992 2023-09-30T17:03:35.839 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.840 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.840 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:35.840 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362284+0000", 2023-09-30T17:03:35.840 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00058872299999999998 2023-09-30T17:03:35.840 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.840 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.840 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:35.840 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362429+0000", 2023-09-30T17:03:35.840 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014509000000000001 2023-09-30T17:03:35.840 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.840 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.840 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:35.841 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365330+0000", 2023-09-30T17:03:35.841 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0029005419999999999 2023-09-30T17:03:35.841 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.841 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.841 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:35.841 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376196+0000", 2023-09-30T17:03:35.841 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.01086615 2023-09-30T17:03:35.841 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.841 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.841 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:35.841 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376230+0000", 2023-09-30T17:03:35.841 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3858e-05 2023-09-30T17:03:35.842 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.842 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.842 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:35.842 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376260+0000", 2023-09-30T17:03:35.842 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0181000000000001e-05 2023-09-30T17:03:35.842 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.842 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:35.842 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.842 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.842 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.842 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:23 3.e 3:717a0223:::608.00000000:head [create,setxattr parent (62) in=6b,setxattr layout (30) in=6b] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:35.842 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:03:35.843 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 77.450825815000002, 2023-09-30T17:03:35.843 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023406132999999999, 2023-09-30T17:03:35.843 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:35.843 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:35.843 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:35.843 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.843 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:35.843 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:03:35.843 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:35.843 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.843 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.843 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:35.843 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353021+0000", 2023-09-30T17:03:35.844 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:35.844 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.844 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.844 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:35.844 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353022+0000", 2023-09-30T17:03:35.844 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.78e-07 2023-09-30T17:03:35.844 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.844 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.844 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:35.844 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353027+0000", 2023-09-30T17:03:35.844 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9089999999999999e-06 2023-09-30T17:03:35.844 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.845 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.845 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:35.845 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353035+0000", 2023-09-30T17:03:35.845 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0430000000000008e-06 2023-09-30T17:03:35.845 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.845 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.845 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:35.845 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353047+0000", 2023-09-30T17:03:35.845 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1674e-05 2023-09-30T17:03:35.845 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.845 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.845 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:35.846 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353105+0000", 2023-09-30T17:03:35.846 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8891999999999998e-05 2023-09-30T17:03:35.846 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.846 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.846 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:35.846 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353112+0000", 2023-09-30T17:03:35.846 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7059999999999998e-06 2023-09-30T17:03:35.846 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.846 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.846 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:35.846 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362733+0000", 2023-09-30T17:03:35.847 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0096205869999999999 2023-09-30T17:03:35.847 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.847 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.847 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:35.847 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362833+0000", 2023-09-30T17:03:35.847 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000100227 2023-09-30T17:03:35.847 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.847 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.847 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:35.847 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363000+0000", 2023-09-30T17:03:35.847 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016670899999999999 2023-09-30T17:03:35.848 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.848 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.848 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:35.848 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365550+0000", 2023-09-30T17:03:35.848 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0025499199999999998 2023-09-30T17:03:35.848 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.848 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.848 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:35.848 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376315+0000", 2023-09-30T17:03:35.848 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010765011999999999 2023-09-30T17:03:35.848 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.848 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.849 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:35.849 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376386+0000", 2023-09-30T17:03:35.849 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0866999999999998e-05 2023-09-30T17:03:35.849 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.849 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.849 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:35.849 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.376427+0000", 2023-09-30T17:03:35.849 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1709000000000003e-05 2023-09-30T17:03:35.849 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.849 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:35.849 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.849 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.850 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.850 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:28 3.15 3:aa448500:::500.00000000:head [writefull 0~90] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:35.850 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:35.850 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 77.450785178999993, 2023-09-30T17:03:35.850 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024076238, 2023-09-30T17:03:35.850 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:35.850 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:35.850 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:35.850 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.851 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:35.851 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:35.851 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:35.851 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.851 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.851 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:35.851 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:35.851 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:35.851 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.852 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.852 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:35.852 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353062+0000", 2023-09-30T17:03:35.852 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8699999999999995e-07 2023-09-30T17:03:35.852 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.852 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.852 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:35.852 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353067+0000", 2023-09-30T17:03:35.853 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.605e-06 2023-09-30T17:03:35.853 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.853 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.853 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:35.853 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353073+0000", 2023-09-30T17:03:35.853 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8900000000000004e-06 2023-09-30T17:03:35.853 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.853 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.854 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:35.854 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353083+0000", 2023-09-30T17:03:35.854 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0200000000000001e-05 2023-09-30T17:03:35.854 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.854 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.854 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:35.854 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353186+0000", 2023-09-30T17:03:35.854 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010256599999999999 2023-09-30T17:03:35.855 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.855 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.855 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting_for_map not empty", 2023-09-30T17:03:35.855 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353190+0000", 2023-09-30T17:03:35.855 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9709999999999998e-06 2023-09-30T17:03:35.855 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.855 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.856 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:35.856 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.362946+0000", 2023-09-30T17:03:35.856 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0097563330000000007 2023-09-30T17:03:35.856 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.856 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.856 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:35.856 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363088+0000", 2023-09-30T17:03:35.856 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014259200000000001 2023-09-30T17:03:35.856 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.856 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.857 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 2", 2023-09-30T17:03:35.857 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.363555+0000", 2023-09-30T17:03:35.857 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00046627799999999998 2023-09-30T17:03:35.857 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.857 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.857 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:35.857 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.365871+0000", 2023-09-30T17:03:35.857 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0023167589999999998 2023-09-30T17:03:35.857 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.857 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.857 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:35.857 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377033+0000", 2023-09-30T17:03:35.858 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011161203999999999 2023-09-30T17:03:35.858 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.858 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.858 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:35.858 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377100+0000", 2023-09-30T17:03:35.858 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7230999999999994e-05 2023-09-30T17:03:35.858 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.858 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.858 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:35.858 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.377138+0000", 2023-09-30T17:03:35.858 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8022000000000003e-05 2023-09-30T17:03:35.858 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.859 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:35.859 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.859 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.859 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.859 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(mds.0.3:33 3.1b 3:ddb4e4d7:::200.00000002:head [delete] snapc 0=[] ondisk+write+known_if_redirected+full_force+supports_pool_eio e18)", 2023-09-30T17:03:35.859 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:03:35.859 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 77.450684229999993, 2023-09-30T17:03:35.859 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.020304412000000001, 2023-09-30T17:03:35.859 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:35.859 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:35.859 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:35.859 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.860 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:35.860 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:03:35.860 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:35.860 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.860 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.860 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:35.860 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353163+0000", 2023-09-30T17:03:35.860 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:35.860 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.860 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.860 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:35.860 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353164+0000", 2023-09-30T17:03:35.861 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7100000000000011e-07 2023-09-30T17:03:35.861 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.861 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.861 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:35.861 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353168+0000", 2023-09-30T17:03:35.861 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0600000000000001e-06 2023-09-30T17:03:35.861 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.861 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.861 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:35.861 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353177+0000", 2023-09-30T17:03:35.861 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1409999999999994e-06 2023-09-30T17:03:35.861 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.862 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.862 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:35.862 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353185+0000", 2023-09-30T17:03:35.862 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2479999999999996e-06 2023-09-30T17:03:35.862 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.862 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.862 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:35.862 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353246+0000", 2023-09-30T17:03:35.862 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0519000000000001e-05 2023-09-30T17:03:35.862 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.862 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.862 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op must wait for map", 2023-09-30T17:03:35.863 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.353252+0000", 2023-09-30T17:03:35.863 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7859999999999999e-06 2023-09-30T17:03:35.863 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.863 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.863 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:35.863 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.354979+0000", 2023-09-30T17:03:35.863 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0017270090000000001 2023-09-30T17:03:35.863 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.863 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.863 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:35.863 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.355097+0000", 2023-09-30T17:03:35.863 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000117472 2023-09-30T17:03:35.864 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.864 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.864 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:35.864 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:02:18.373467+0000", 2023-09-30T17:03:35.864 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.018370206 2023-09-30T17:03:35.864 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.864 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:35.864 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.864 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.864 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.864 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:3002 4.28 4:153ae410:::100000001f8.0000003b:head [write 2404352~4096,write 2416640~4096,write 2473984~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e38)", 2023-09-30T17:03:35.864 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:31.075051+0000", 2023-09-30T17:03:35.865 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4.7287954189999999, 2023-09-30T17:03:35.865 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.016877504000000002, 2023-09-30T17:03:35.865 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:35.865 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:35.865 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:35.865 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:35.865 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:35.865 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 3002 2023-09-30T17:03:35.865 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.865 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:35.865 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.866 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:35.866 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.075051+0000", 2023-09-30T17:03:35.866 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:35.866 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.866 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.866 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:35.866 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.075051+0000", 2023-09-30T17:03:35.866 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:35.866 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.866 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.866 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:35.866 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.075052+0000", 2023-09-30T17:03:35.867 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9699999999999995e-07 2023-09-30T17:03:35.867 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.867 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.867 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:35.867 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.075067+0000", 2023-09-30T17:03:35.867 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4362000000000001e-05 2023-09-30T17:03:35.867 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.867 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.867 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:35.867 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.075074+0000", 2023-09-30T17:03:35.867 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4370000000000001e-06 2023-09-30T17:03:35.867 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.868 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.868 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:35.868 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.075081+0000", 2023-09-30T17:03:35.868 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5810000000000002e-06 2023-09-30T17:03:35.868 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.868 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.868 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:35.868 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.075118+0000", 2023-09-30T17:03:35.868 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7493999999999997e-05 2023-09-30T17:03:35.868 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.868 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.869 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:35.869 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.075206+0000", 2023-09-30T17:03:35.869 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8065999999999993e-05 2023-09-30T17:03:35.869 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.869 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.869 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:35.869 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.075416+0000", 2023-09-30T17:03:35.869 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000210065 2023-09-30T17:03:35.869 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.869 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.869 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:35.869 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.077514+0000", 2023-09-30T17:03:35.870 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0020980349999999998 2023-09-30T17:03:35.870 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.870 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.870 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:35.870 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.091863+0000", 2023-09-30T17:03:35.870 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.014348869 2023-09-30T17:03:35.870 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.870 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.870 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:35.870 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.091897+0000", 2023-09-30T17:03:35.870 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3720000000000002e-05 2023-09-30T17:03:35.870 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.871 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.871 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:35.871 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:31.091929+0000", 2023-09-30T17:03:35.871 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.2178000000000003e-05 2023-09-30T17:03:35.871 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.871 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:35.871 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.871 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.871 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.871 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:11371 4.28 4:153ae410:::100000001f8.0000003b:head [write 4042752~4096,write 4050944~4096,write 4100096~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-09-30T17:03:35.871 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:34.179448+0000", 2023-09-30T17:03:35.872 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 1.6243991709999999, 2023-09-30T17:03:35.872 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.016739657000000002, 2023-09-30T17:03:35.872 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:35.872 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:35.872 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:35.872 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:35.872 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:35.872 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 11371 2023-09-30T17:03:35.872 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.872 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:35.872 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.872 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:35.873 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.179448+0000", 2023-09-30T17:03:35.873 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:35.873 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.873 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.873 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:35.873 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.179448+0000", 2023-09-30T17:03:35.873 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:35.873 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.874 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.874 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:35.874 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.179448+0000", 2023-09-30T17:03:35.874 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5499999999999997e-07 2023-09-30T17:03:35.874 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.874 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.874 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:35.874 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.179460+0000", 2023-09-30T17:03:35.875 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1114999999999999e-05 2023-09-30T17:03:35.875 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.875 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.875 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:35.875 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.179470+0000", 2023-09-30T17:03:35.875 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0383e-05 2023-09-30T17:03:35.875 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.876 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.876 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:35.876 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.179477+0000", 2023-09-30T17:03:35.876 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1199999999999996e-06 2023-09-30T17:03:35.876 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.876 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.876 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:35.876 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.179527+0000", 2023-09-30T17:03:35.877 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9639999999999999e-05 2023-09-30T17:03:35.877 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.877 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.877 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:35.877 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.179604+0000", 2023-09-30T17:03:35.877 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7305000000000006e-05 2023-09-30T17:03:35.877 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.877 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.878 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:35.878 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.179731+0000", 2023-09-30T17:03:35.878 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00012680499999999999 2023-09-30T17:03:35.878 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.878 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.878 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:35.879 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.181248+0000", 2023-09-30T17:03:35.879 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001517071 2023-09-30T17:03:35.879 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.879 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.879 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:35.879 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.196109+0000", 2023-09-30T17:03:35.879 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.014860824 2023-09-30T17:03:35.879 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.879 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.879 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:35.880 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.196146+0000", 2023-09-30T17:03:35.880 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6891000000000003e-05 2023-09-30T17:03:35.880 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.880 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.880 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:35.880 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.196187+0000", 2023-09-30T17:03:35.880 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1748000000000001e-05 2023-09-30T17:03:35.880 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.880 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:35.880 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.880 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.881 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.881 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:12970 4.22 4:47e99c31:::100000001f8.00000025:head [write 1056768~8192,write 1138688~4096,write 1159168~4096,write 1249280~4096,write 1277952~4096,write 1363968~4096,write 1499136~4096,write 1691648~4096,write 2064384~4096,write 2338816~4096,write 2461696~4096,write 2486272~4096,write 2686976~4096,write 2822144~4096,write 2904064~4096,write 2924544~4096,write 2932736~4096,write 3112960~4096,write 3141632~4096,write 3219456~4096,write 3252224~4096,write 3383296~4096,write 3444736~4096,write 3469312~8192,write 3538944~4096,write 3645440~4096,write 3670016~4096,write 3702784~4096,write 3891200~4096,write 3997696~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-09-30T17:03:35.881 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:34.772814+0000", 2023-09-30T17:03:35.881 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 1.0310330080000001, 2023-09-30T17:03:35.881 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.020367430999999998, 2023-09-30T17:03:35.881 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:35.881 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:35.881 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:35.881 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:35.881 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:35.881 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 12970 2023-09-30T17:03:35.882 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.882 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:35.882 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.882 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:35.882 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.772814+0000", 2023-09-30T17:03:35.882 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:35.882 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.882 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.882 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:35.882 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.772814+0000", 2023-09-30T17:03:35.882 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:35.883 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.883 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.883 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:35.883 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.772815+0000", 2023-09-30T17:03:35.883 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1299999999999999e-07 2023-09-30T17:03:35.883 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.883 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.883 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:35.883 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.772937+0000", 2023-09-30T17:03:35.883 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00012238400000000001 2023-09-30T17:03:35.883 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.884 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.884 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:35.884 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.772947+0000", 2023-09-30T17:03:35.884 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0263e-05 2023-09-30T17:03:35.884 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.884 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.884 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:35.884 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.772955+0000", 2023-09-30T17:03:35.884 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0609999999999996e-06 2023-09-30T17:03:35.884 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.885 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.885 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:35.885 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.772998+0000", 2023-09-30T17:03:35.885 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2911000000000003e-05 2023-09-30T17:03:35.885 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.885 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.885 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:35.885 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.773062+0000", 2023-09-30T17:03:35.885 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3235e-05 2023-09-30T17:03:35.885 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.886 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.886 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:35.886 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.792972+0000", 2023-09-30T17:03:35.886 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.019910895000000001 2023-09-30T17:03:35.886 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.886 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.886 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:35.886 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.793075+0000", 2023-09-30T17:03:35.886 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000102834 2023-09-30T17:03:35.886 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.886 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.887 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:35.887 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.793181+0000", 2023-09-30T17:03:35.887 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000106035 2023-09-30T17:03:35.887 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.887 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:35.887 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.887 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.887 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.887 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:12974 4.12 e39/17 4:48ab9bde:::100000001f8.00000015:head v 39'414, mlcod=39'412)", 2023-09-30T17:03:35.887 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:34.774433+0000", 2023-09-30T17:03:35.887 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 1.0294134720000001, 2023-09-30T17:03:35.888 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.018505372999999999, 2023-09-30T17:03:35.888 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:35.888 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:35.888 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:35.888 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.888 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:35.888 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.774433+0000", 2023-09-30T17:03:35.888 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:35.888 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.888 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.888 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:35.888 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.774433+0000", 2023-09-30T17:03:35.889 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:35.889 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.889 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.889 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:35.889 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.774434+0000", 2023-09-30T17:03:35.889 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7999999999999996e-07 2023-09-30T17:03:35.889 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.889 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.889 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:35.889 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.774669+0000", 2023-09-30T17:03:35.889 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000235095 2023-09-30T17:03:35.889 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.890 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.890 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:35.890 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.774681+0000", 2023-09-30T17:03:35.890 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2033e-05 2023-09-30T17:03:35.890 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.890 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.890 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:35.890 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.774688+0000", 2023-09-30T17:03:35.890 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9229999999999996e-06 2023-09-30T17:03:35.890 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.890 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.890 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:35.891 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.774738+0000", 2023-09-30T17:03:35.891 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0346000000000002e-05 2023-09-30T17:03:35.891 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.891 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.891 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:35.891 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.774760+0000", 2023-09-30T17:03:35.891 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1441999999999999e-05 2023-09-30T17:03:35.891 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.891 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.891 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:35.891 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.792907+0000", 2023-09-30T17:03:35.891 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.018147595999999998 2023-09-30T17:03:35.892 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.892 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.892 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:35.892 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.792939+0000", 2023-09-30T17:03:35.892 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.1458000000000003e-05 2023-09-30T17:03:35.892 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.892 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:35.892 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.892 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.892 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.892 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:13088 4.28 4:15eeb89b:::100000001f8.00000032:head [write 319488~8192,write 376832~4096,write 577536~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-09-30T17:03:35.893 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:34.839902+0000", 2023-09-30T17:03:35.893 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.96394508599999995, 2023-09-30T17:03:35.893 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.018992879000000001, 2023-09-30T17:03:35.893 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:35.893 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:35.893 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:35.893 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:35.893 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:35.893 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 13088 2023-09-30T17:03:35.893 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.893 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:35.893 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.894 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:35.894 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.839902+0000", 2023-09-30T17:03:35.894 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:35.894 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.894 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.894 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:35.894 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.839902+0000", 2023-09-30T17:03:35.894 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:35.894 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.895 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.895 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:35.895 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.839903+0000", 2023-09-30T17:03:35.895 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8700000000000004e-07 2023-09-30T17:03:35.895 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.895 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.895 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:35.895 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.839920+0000", 2023-09-30T17:03:35.896 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7263999999999999e-05 2023-09-30T17:03:35.896 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.896 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.896 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:35.896 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.839930+0000", 2023-09-30T17:03:35.896 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0078000000000001e-05 2023-09-30T17:03:35.896 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.896 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.897 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:35.897 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.839939+0000", 2023-09-30T17:03:35.897 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2299999999999997e-06 2023-09-30T17:03:35.897 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.897 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.897 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:35.897 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.839994+0000", 2023-09-30T17:03:35.897 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5019000000000003e-05 2023-09-30T17:03:35.898 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.898 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.898 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:35.898 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.840040+0000", 2023-09-30T17:03:35.898 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5611000000000001e-05 2023-09-30T17:03:35.898 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.898 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.899 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:35.899 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.840125+0000", 2023-09-30T17:03:35.899 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5458999999999996e-05 2023-09-30T17:03:35.899 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.899 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.899 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:35.899 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.843013+0000", 2023-09-30T17:03:35.899 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0028874600000000001 2023-09-30T17:03:35.899 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.899 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.899 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:35.899 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.858845+0000", 2023-09-30T17:03:35.900 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.015831883000000001 2023-09-30T17:03:35.900 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.900 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.900 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:35.900 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.858874+0000", 2023-09-30T17:03:35.900 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.9037e-05 2023-09-30T17:03:35.900 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.900 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.900 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:35.900 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:34.858895+0000", 2023-09-30T17:03:35.900 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.0951e-05 2023-09-30T17:03:35.900 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.900 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:35.901 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.901 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.901 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.901 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:14213 4.3f 4:fde182c5:::100000001f8.00000039:head [write 462848~4096,write 577536~4096,write 720896~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-09-30T17:03:35.901 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:35.229950+0000", 2023-09-30T17:03:35.901 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.57389724900000005, 2023-09-30T17:03:35.901 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.019151562, 2023-09-30T17:03:35.901 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:35.901 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:35.901 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:35.901 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:35.901 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:35.902 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 14213 2023-09-30T17:03:35.902 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.902 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:35.902 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.902 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:35.902 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.229950+0000", 2023-09-30T17:03:35.902 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:35.902 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.902 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.902 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:35.902 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.229950+0000", 2023-09-30T17:03:35.902 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:35.903 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.903 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.903 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:35.903 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.229951+0000", 2023-09-30T17:03:35.903 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1299999999999998e-07 2023-09-30T17:03:35.903 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.903 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.903 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:35.903 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.229963+0000", 2023-09-30T17:03:35.903 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2437e-05 2023-09-30T17:03:35.903 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.903 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.904 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:35.904 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.229977+0000", 2023-09-30T17:03:35.904 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3879e-05 2023-09-30T17:03:35.904 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.904 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.904 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:35.904 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.229984+0000", 2023-09-30T17:03:35.904 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4329999999999998e-06 2023-09-30T17:03:35.904 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.904 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.904 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:35.904 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.230030+0000", 2023-09-30T17:03:35.904 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5405000000000003e-05 2023-09-30T17:03:35.905 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.905 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.905 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:35.905 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.230076+0000", 2023-09-30T17:03:35.905 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5788999999999998e-05 2023-09-30T17:03:35.905 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.905 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.905 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:35.905 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.230170+0000", 2023-09-30T17:03:35.905 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.4878999999999997e-05 2023-09-30T17:03:35.905 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.905 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.906 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:35.906 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.236261+0000", 2023-09-30T17:03:35.906 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0060903040000000004 2023-09-30T17:03:35.906 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.906 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.906 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:35.906 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.248402+0000", 2023-09-30T17:03:35.906 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.012140928 2023-09-30T17:03:35.906 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.906 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.906 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:35.906 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.249061+0000", 2023-09-30T17:03:35.906 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00065962499999999995 2023-09-30T17:03:35.907 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.907 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.907 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:35.907 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.249101+0000", 2023-09-30T17:03:35.907 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9969999999999998e-05 2023-09-30T17:03:35.907 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.907 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:35.907 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.907 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.907 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.908 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:14217 4.36 4:6fa85f86:::100000001f8.00000013:head [write 1183744~12288,write 1224704~4096,write 1314816~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-09-30T17:03:35.908 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:35.231445+0000", 2023-09-30T17:03:35.908 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.57240218200000004, 2023-09-30T17:03:35.908 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.017192974999999999, 2023-09-30T17:03:35.908 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:35.908 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:35.908 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:35.908 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:35.908 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:35.908 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 14217 2023-09-30T17:03:35.908 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.908 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:35.909 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.909 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:35.909 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.231445+0000", 2023-09-30T17:03:35.909 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:35.909 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.909 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.909 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:35.909 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.231445+0000", 2023-09-30T17:03:35.909 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:35.909 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.909 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.909 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:35.910 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.231445+0000", 2023-09-30T17:03:35.910 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7199999999999998e-07 2023-09-30T17:03:35.910 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.910 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.910 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:35.910 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.231460+0000", 2023-09-30T17:03:35.910 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4817000000000001e-05 2023-09-30T17:03:35.910 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.910 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.910 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:35.910 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.231471+0000", 2023-09-30T17:03:35.910 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0555e-05 2023-09-30T17:03:35.911 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.911 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.911 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:35.911 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.231476+0000", 2023-09-30T17:03:35.911 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3569999999999997e-06 2023-09-30T17:03:35.911 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.911 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.911 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:35.911 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.231526+0000", 2023-09-30T17:03:35.911 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0022999999999999e-05 2023-09-30T17:03:35.911 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.911 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.911 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:35.912 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.231583+0000", 2023-09-30T17:03:35.912 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6304999999999997e-05 2023-09-30T17:03:35.912 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.912 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.912 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:35.912 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.231672+0000", 2023-09-30T17:03:35.912 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9191999999999996e-05 2023-09-30T17:03:35.912 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.912 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.912 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:35.912 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.237725+0000", 2023-09-30T17:03:35.912 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0060529720000000002 2023-09-30T17:03:35.913 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.913 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.913 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:35.913 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.248569+0000", 2023-09-30T17:03:35.913 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010844482000000001 2023-09-30T17:03:35.913 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.913 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.913 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:35.913 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.248602+0000", 2023-09-30T17:03:35.913 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.2348999999999998e-05 2023-09-30T17:03:35.913 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.913 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.914 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:35.914 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.248638+0000", 2023-09-30T17:03:35.914 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6151e-05 2023-09-30T17:03:35.914 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.914 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:35.914 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.914 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.914 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.914 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:14218 4.3b 4:dcc0c15f:::100000001f8.0000001a:head [write 4120576~4096,write 4173824~4096,write 4186112~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-09-30T17:03:35.914 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:35.231871+0000", 2023-09-30T17:03:35.915 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.57197638399999995, 2023-09-30T17:03:35.915 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.016803116999999999, 2023-09-30T17:03:35.915 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:35.915 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:35.915 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:35.915 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:35.915 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:35.915 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 14218 2023-09-30T17:03:35.916 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.916 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:35.916 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.916 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:35.916 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.231871+0000", 2023-09-30T17:03:35.916 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:35.916 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.916 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.917 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:35.917 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.231871+0000", 2023-09-30T17:03:35.917 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:35.917 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.917 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.917 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:35.917 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.231871+0000", 2023-09-30T17:03:35.917 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.37e-07 2023-09-30T17:03:35.918 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.918 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.918 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:35.918 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.231888+0000", 2023-09-30T17:03:35.918 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6568000000000001e-05 2023-09-30T17:03:35.918 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.918 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.918 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:35.918 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.231894+0000", 2023-09-30T17:03:35.919 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.754e-06 2023-09-30T17:03:35.919 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.919 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.919 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:35.919 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.231898+0000", 2023-09-30T17:03:35.919 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7249999999999999e-06 2023-09-30T17:03:35.919 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.919 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.919 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:35.919 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.231936+0000", 2023-09-30T17:03:35.919 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8121000000000003e-05 2023-09-30T17:03:35.919 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.920 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.920 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:35.920 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.231996+0000", 2023-09-30T17:03:35.920 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0263000000000002e-05 2023-09-30T17:03:35.920 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.920 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.920 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:35.920 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.232110+0000", 2023-09-30T17:03:35.920 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000113094 2023-09-30T17:03:35.920 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.920 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.921 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:35.921 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.239263+0000", 2023-09-30T17:03:35.921 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00715353 2023-09-30T17:03:35.921 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.921 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.921 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:35.921 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.248576+0000", 2023-09-30T17:03:35.921 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0093125559999999996 2023-09-30T17:03:35.921 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.921 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.921 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:35.921 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.248634+0000", 2023-09-30T17:03:35.921 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7926000000000001e-05 2023-09-30T17:03:35.922 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.922 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.922 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:35.922 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.248674+0000", 2023-09-30T17:03:35.922 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0043000000000003e-05 2023-09-30T17:03:35.922 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.922 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:35.922 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.922 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.922 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.922 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:14220 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 1261568~4096,write 1282048~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-09-30T17:03:35.923 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:35.232431+0000", 2023-09-30T17:03:35.923 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.57141593599999996, 2023-09-30T17:03:35.923 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.018606082999999999, 2023-09-30T17:03:35.923 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:35.923 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:35.923 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:35.923 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:35.923 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:35.923 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 14220 2023-09-30T17:03:35.923 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.923 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:35.923 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.924 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:35.924 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.232431+0000", 2023-09-30T17:03:35.924 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:35.924 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.924 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.924 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:35.924 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.232431+0000", 2023-09-30T17:03:35.924 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:35.924 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.924 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.924 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:35.924 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.232432+0000", 2023-09-30T17:03:35.925 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3399999999999997e-07 2023-09-30T17:03:35.925 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.925 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.925 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:35.925 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.232441+0000", 2023-09-30T17:03:35.925 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9369999999999993e-06 2023-09-30T17:03:35.925 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.925 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.925 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:35.925 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.232456+0000", 2023-09-30T17:03:35.925 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5412000000000001e-05 2023-09-30T17:03:35.925 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.926 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.926 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:35.926 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.232462+0000", 2023-09-30T17:03:35.926 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4700000000000001e-06 2023-09-30T17:03:35.926 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.926 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.926 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:35.926 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.235149+0000", 2023-09-30T17:03:35.926 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0026877509999999999 2023-09-30T17:03:35.926 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.926 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.926 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:35.927 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.235246+0000", 2023-09-30T17:03:35.927 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.6144999999999995e-05 2023-09-30T17:03:35.927 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.927 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.927 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:35.927 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.235388+0000", 2023-09-30T17:03:35.927 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014202900000000001 2023-09-30T17:03:35.927 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.927 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.927 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:35.927 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.237925+0000", 2023-09-30T17:03:35.927 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0025378129999999999 2023-09-30T17:03:35.928 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.928 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.928 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:35.928 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.250950+0000", 2023-09-30T17:03:35.928 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.013024061999999999 2023-09-30T17:03:35.928 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.928 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.928 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:35.928 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.251003+0000", 2023-09-30T17:03:35.928 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3352e-05 2023-09-30T17:03:35.928 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.928 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.929 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:35.929 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.251037+0000", 2023-09-30T17:03:35.929 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4177999999999997e-05 2023-09-30T17:03:35.929 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.929 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:35.929 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.929 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.929 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.929 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:14224 4.6 4:616d4c41:::100000001f8.00000034:head [write 1286144~4096,write 1376256~4096,write 1400832~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-09-30T17:03:35.929 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:35.233659+0000", 2023-09-30T17:03:35.929 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.57018839300000002, 2023-09-30T17:03:35.929 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.018591073, 2023-09-30T17:03:35.930 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:35.930 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:35.930 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:35.930 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:35.930 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:35.930 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 14224 2023-09-30T17:03:35.930 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.930 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:35.930 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.930 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:35.930 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.233659+0000", 2023-09-30T17:03:35.930 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:35.931 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.931 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.931 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:35.931 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.233659+0000", 2023-09-30T17:03:35.931 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:35.931 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.931 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.931 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:35.931 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.233660+0000", 2023-09-30T17:03:35.931 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.048e-06 2023-09-30T17:03:35.931 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.931 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.931 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:35.932 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.233690+0000", 2023-09-30T17:03:35.932 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0534000000000003e-05 2023-09-30T17:03:35.932 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.932 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.932 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:35.932 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.233717+0000", 2023-09-30T17:03:35.932 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.7358000000000001e-05 2023-09-30T17:03:35.932 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.932 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.932 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:35.932 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.233726+0000", 2023-09-30T17:03:35.932 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2689999999999999e-06 2023-09-30T17:03:35.933 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.933 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.933 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:35.933 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.235133+0000", 2023-09-30T17:03:35.933 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001407352 2023-09-30T17:03:35.933 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.933 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.933 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:35.933 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.235206+0000", 2023-09-30T17:03:35.933 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2698000000000001e-05 2023-09-30T17:03:35.933 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.933 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.934 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:35.934 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.235348+0000", 2023-09-30T17:03:35.934 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014248900000000001 2023-09-30T17:03:35.934 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.934 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.934 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:35.934 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.237953+0000", 2023-09-30T17:03:35.934 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0026046120000000001 2023-09-30T17:03:35.934 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.934 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.934 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:35.934 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.252180+0000", 2023-09-30T17:03:35.935 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.014226951 2023-09-30T17:03:35.935 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.935 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.935 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:35.935 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.252212+0000", 2023-09-30T17:03:35.935 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.1844000000000002e-05 2023-09-30T17:03:35.935 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.935 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.935 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:35.935 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.252250+0000", 2023-09-30T17:03:35.935 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7917999999999998e-05 2023-09-30T17:03:35.935 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.936 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:35.936 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.936 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.936 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.936 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:14249 4.3f 4:fde182c5:::100000001f8.00000039:head [write 3944448~4096,write 3993600~4096,write 4145152~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e39)", 2023-09-30T17:03:35.936 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:35.241556+0000", 2023-09-30T17:03:35.936 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.56229129899999997, 2023-09-30T17:03:35.936 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.020017223000000001, 2023-09-30T17:03:35.936 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:35.936 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:35.936 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:35.936 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:35.937 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:35.937 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 14249 2023-09-30T17:03:35.937 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.937 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:35.937 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.937 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:35.937 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.241556+0000", 2023-09-30T17:03:35.937 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:35.937 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.937 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.937 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:35.937 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.241556+0000", 2023-09-30T17:03:35.937 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:35.938 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.938 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.938 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:35.938 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.241556+0000", 2023-09-30T17:03:35.938 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0299999999999998e-07 2023-09-30T17:03:35.938 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.938 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.938 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:35.938 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.241588+0000", 2023-09-30T17:03:35.938 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.1668999999999998e-05 2023-09-30T17:03:35.938 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.938 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.939 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:35.939 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.241603+0000", 2023-09-30T17:03:35.939 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5460000000000001e-05 2023-09-30T17:03:35.939 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.939 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.939 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:35.939 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.241624+0000", 2023-09-30T17:03:35.939 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.0492e-05 2023-09-30T17:03:35.939 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.939 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.939 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:35.939 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.249210+0000", 2023-09-30T17:03:35.940 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0075857490000000001 2023-09-30T17:03:35.940 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.940 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.940 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:35.940 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.249293+0000", 2023-09-30T17:03:35.940 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.373e-05 2023-09-30T17:03:35.940 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.940 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.940 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:35.940 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.249434+0000", 2023-09-30T17:03:35.940 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014051600000000001 2023-09-30T17:03:35.940 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.941 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.941 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:35.941 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.251878+0000", 2023-09-30T17:03:35.941 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0024437529999999999 2023-09-30T17:03:35.941 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.941 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.941 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:35.941 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.261486+0000", 2023-09-30T17:03:35.941 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0096081670000000008 2023-09-30T17:03:35.941 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.941 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.941 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:35.942 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.261537+0000", 2023-09-30T17:03:35.942 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1427000000000001e-05 2023-09-30T17:03:35.942 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.942 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.942 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:35.942 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.261573+0000", 2023-09-30T17:03:35.942 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5556999999999999e-05 2023-09-30T17:03:35.942 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.942 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:35.942 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.942 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.942 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.943 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:14974 4.36 4:6da220e6:::100000001f8.0000003f:head [write 3248128~4096,write 3289088~4096,write 3629056~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-09-30T17:03:35.943 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:35.500519+0000", 2023-09-30T17:03:35.943 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.30332797500000003, 2023-09-30T17:03:35.943 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.016974228000000001, 2023-09-30T17:03:35.943 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:35.943 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:35.943 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:35.943 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:35.943 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:35.943 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 14974 2023-09-30T17:03:35.943 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.944 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:35.944 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.944 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:35.944 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.500519+0000", 2023-09-30T17:03:35.944 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:35.944 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.944 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.944 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:35.944 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.500519+0000", 2023-09-30T17:03:35.944 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:35.944 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.945 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.945 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:35.945 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.500520+0000", 2023-09-30T17:03:35.945 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9800000000000003e-07 2023-09-30T17:03:35.945 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.945 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.945 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:35.945 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.500548+0000", 2023-09-30T17:03:35.945 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.7994999999999999e-05 2023-09-30T17:03:35.945 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.945 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.945 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:35.946 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.500567+0000", 2023-09-30T17:03:35.946 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9468999999999999e-05 2023-09-30T17:03:35.946 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.946 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.946 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:35.946 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.500575+0000", 2023-09-30T17:03:35.946 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8290000000000008e-06 2023-09-30T17:03:35.946 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.946 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.946 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:35.946 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.500637+0000", 2023-09-30T17:03:35.946 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1680999999999994e-05 2023-09-30T17:03:35.947 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.947 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.947 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:35.947 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.500707+0000", 2023-09-30T17:03:35.947 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0649999999999996e-05 2023-09-30T17:03:35.947 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.947 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.947 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:35.947 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.500834+0000", 2023-09-30T17:03:35.947 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00012714200000000001 2023-09-30T17:03:35.947 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.947 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.948 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:35.948 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.502962+0000", 2023-09-30T17:03:35.948 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0021274390000000001 2023-09-30T17:03:35.948 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.948 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.948 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:35.948 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.517442+0000", 2023-09-30T17:03:35.948 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.014480253 2023-09-30T17:03:35.948 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.948 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.948 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:35.948 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.517471+0000", 2023-09-30T17:03:35.949 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.8351999999999999e-05 2023-09-30T17:03:35.949 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:35.949 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:35.949 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:35.949 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:35.517493+0000", 2023-09-30T17:03:35.949 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.262e-05 2023-09-30T17:03:35.949 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.949 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:35.949 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.949 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:35.949 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:35.949 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:35.950 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-09-30T17:03:35.952 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:03:35.952 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:35.950+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:36.052 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:36.051+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:36.117 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:36.118 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2023-09-30T17:03:36.118 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.118 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:16601 4.2e e40/17 4:75be0f36:::100000001f8.0000003d:head v 40'264, mlcod=40'262)", 2023-09-30T17:03:36.118 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:36.113283+0000", 2023-09-30T17:03:36.118 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0029221899999999999, 2023-09-30T17:03:36.118 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0029376710000000002, 2023-09-30T17:03:36.118 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:36.118 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:36.118 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:36.118 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.118 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:36.119 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.113283+0000", 2023-09-30T17:03:36.119 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:36.119 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.119 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.119 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:36.119 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.113283+0000", 2023-09-30T17:03:36.119 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:36.119 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.119 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.119 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:36.119 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.113283+0000", 2023-09-30T17:03:36.119 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7100000000000002e-07 2023-09-30T17:03:36.120 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.120 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.120 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:36.120 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.113306+0000", 2023-09-30T17:03:36.120 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3146000000000002e-05 2023-09-30T17:03:36.120 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.120 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.120 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:36.120 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.113314+0000", 2023-09-30T17:03:36.120 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5440000000000001e-06 2023-09-30T17:03:36.120 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.120 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.121 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:36.121 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.113321+0000", 2023-09-30T17:03:36.121 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2180000000000002e-06 2023-09-30T17:03:36.121 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.121 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.121 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:36.121 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.113377+0000", 2023-09-30T17:03:36.121 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5587000000000002e-05 2023-09-30T17:03:36.121 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.121 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.121 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:36.121 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.113405+0000", 2023-09-30T17:03:36.122 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8938e-05 2023-09-30T17:03:36.122 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.122 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.122 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:36.122 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.116187+0000", 2023-09-30T17:03:36.122 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002781576 2023-09-30T17:03:36.122 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.122 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.122 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:36.122 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.116220+0000", 2023-09-30T17:03:36.122 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3191000000000001e-05 2023-09-30T17:03:36.122 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:36.123 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:36.123 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:36.123 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.123 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.123 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:16576 4.f 4:f26fdfa9:::100000001f8.00000002:head [write 2465792~4096 in=4096b,write 2478080~4096 in=4096b,write 2605056~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-09-30T17:03:36.123 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:36.098601+0000", 2023-09-30T17:03:36.123 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.017603371999999999, 2023-09-30T17:03:36.123 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017705364000000001, 2023-09-30T17:03:36.123 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:36.123 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:36.123 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:36.123 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:36.124 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:36.124 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 16576 2023-09-30T17:03:36.124 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.124 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:36.124 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.124 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:36.124 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.098601+0000", 2023-09-30T17:03:36.124 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:36.124 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.124 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.124 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:36.124 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.098601+0000", 2023-09-30T17:03:36.125 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:36.125 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.125 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.125 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:36.125 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.098602+0000", 2023-09-30T17:03:36.125 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.61e-07 2023-09-30T17:03:36.125 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.125 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.125 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:36.125 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.098615+0000", 2023-09-30T17:03:36.125 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2616000000000001e-05 2023-09-30T17:03:36.126 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.126 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.126 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:36.126 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.098623+0000", 2023-09-30T17:03:36.126 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3240000000000003e-06 2023-09-30T17:03:36.126 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.126 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.126 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:36.126 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.098630+0000", 2023-09-30T17:03:36.126 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.956e-06 2023-09-30T17:03:36.126 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.126 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.127 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:36.127 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.112902+0000", 2023-09-30T17:03:36.127 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014272091000000001 2023-09-30T17:03:36.127 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.127 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.127 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:36.127 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.112985+0000", 2023-09-30T17:03:36.127 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3314999999999998e-05 2023-09-30T17:03:36.127 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.127 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.127 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:36.127 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.113174+0000", 2023-09-30T17:03:36.128 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000189061 2023-09-30T17:03:36.128 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:36.128 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:36.128 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:36.128 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.128 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.128 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:16603 4.2d 4:b4aa06e9:::100000001f8.0000001d:head [write 2658304~4096 in=4096b,write 2842624~4096 in=4096b,write 3375104~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-09-30T17:03:36.128 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:36.114363+0000", 2023-09-30T17:03:36.128 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.001841945, 2023-09-30T17:03:36.128 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0020229969999999999, 2023-09-30T17:03:36.128 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:36.128 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:36.129 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:36.129 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:36.129 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:36.129 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 16603 2023-09-30T17:03:36.129 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.129 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:36.129 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.129 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:36.129 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.114363+0000", 2023-09-30T17:03:36.129 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:36.129 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.129 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.130 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:36.130 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.114363+0000", 2023-09-30T17:03:36.130 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:36.130 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.130 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.130 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:36.130 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.114364+0000", 2023-09-30T17:03:36.130 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.02e-07 2023-09-30T17:03:36.130 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.130 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.130 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:36.130 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.114379+0000", 2023-09-30T17:03:36.131 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5211999999999999e-05 2023-09-30T17:03:36.131 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.131 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.131 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:36.131 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.114391+0000", 2023-09-30T17:03:36.131 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2439999999999999e-05 2023-09-30T17:03:36.131 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.131 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.131 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:36.131 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.114401+0000", 2023-09-30T17:03:36.131 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9490000000000008e-06 2023-09-30T17:03:36.131 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.132 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.132 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:36.132 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.114458+0000", 2023-09-30T17:03:36.132 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6477999999999997e-05 2023-09-30T17:03:36.132 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.132 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.132 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:36.132 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.114550+0000", 2023-09-30T17:03:36.132 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2402000000000001e-05 2023-09-30T17:03:36.132 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.132 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.133 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:36.133 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.114723+0000", 2023-09-30T17:03:36.133 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017251300000000001 2023-09-30T17:03:36.133 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:36.133 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:36.133 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:36.133 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.133 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:16604 4.23 4:c6f90462:::100000001f8.00000037:head [write 3485696~4096 in=4096b,write 3604480~4096 in=4096b,write 3780608~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-09-30T17:03:36.133 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:36.114654+0000", 2023-09-30T17:03:36.133 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.001550966, 2023-09-30T17:03:36.134 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001816472, 2023-09-30T17:03:36.134 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:36.134 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:36.134 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:36.134 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:36.134 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:36.134 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 16604 2023-09-30T17:03:36.134 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.134 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:36.134 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.134 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:36.135 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.114654+0000", 2023-09-30T17:03:36.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:36.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.135 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.135 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:36.135 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.114654+0000", 2023-09-30T17:03:36.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:36.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.135 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.135 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:36.135 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.114654+0000", 2023-09-30T17:03:36.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5200000000000002e-07 2023-09-30T17:03:36.136 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.136 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.136 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:36.136 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.114668+0000", 2023-09-30T17:03:36.136 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3378e-05 2023-09-30T17:03:36.136 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.136 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.136 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:36.136 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.114673+0000", 2023-09-30T17:03:36.136 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1270000000000002e-06 2023-09-30T17:03:36.136 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.136 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.137 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:36.137 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.114677+0000", 2023-09-30T17:03:36.137 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8240000000000001e-06 2023-09-30T17:03:36.137 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.137 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.137 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:36.137 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.114715+0000", 2023-09-30T17:03:36.137 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8033e-05 2023-09-30T17:03:36.137 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.137 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.137 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:36.138 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.114771+0000", 2023-09-30T17:03:36.138 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6501e-05 2023-09-30T17:03:36.138 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.138 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.138 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:36.138 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.114914+0000", 2023-09-30T17:03:36.138 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014305200000000001 2023-09-30T17:03:36.138 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:36.138 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:36.138 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:36.138 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.138 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.139 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:16579 4.f 4:f0d983b2:::100000001f8.0000001f:head [write 598016~4096 in=4096b,write 720896~4096 in=4096b,write 765952~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-09-30T17:03:36.139 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:36.100363+0000", 2023-09-30T17:03:36.139 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.015842203999999999, 2023-09-30T17:03:36.139 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016195157000000002, 2023-09-30T17:03:36.139 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:36.139 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:36.139 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:36.139 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:36.139 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:36.139 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 16579 2023-09-30T17:03:36.139 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.140 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:36.140 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.140 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:36.140 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.100363+0000", 2023-09-30T17:03:36.140 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:36.140 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.140 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.140 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:36.140 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.100363+0000", 2023-09-30T17:03:36.140 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:36.140 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.140 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.140 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:36.141 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.100363+0000", 2023-09-30T17:03:36.141 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3600000000000002e-07 2023-09-30T17:03:36.141 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.141 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.141 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:36.141 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.100374+0000", 2023-09-30T17:03:36.141 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0964e-05 2023-09-30T17:03:36.141 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.141 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.141 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:36.141 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.100386+0000", 2023-09-30T17:03:36.141 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1960000000000001e-05 2023-09-30T17:03:36.142 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.142 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.142 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:36.142 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.100393+0000", 2023-09-30T17:03:36.142 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0369999999999997e-06 2023-09-30T17:03:36.142 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.142 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.142 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:36.142 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.113895+0000", 2023-09-30T17:03:36.142 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013501173999999999 2023-09-30T17:03:36.142 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.143 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.143 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:36.143 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.113944+0000", 2023-09-30T17:03:36.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9298000000000001e-05 2023-09-30T17:03:36.143 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.143 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.143 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:36.143 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.114049+0000", 2023-09-30T17:03:36.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010548 2023-09-30T17:03:36.143 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:36.143 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:36.144 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:36.144 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.144 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.144 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:16605 4.6 e40/17 4:616d4c41:::100000001f8.00000034:head v 40'1022, mlcod=40'1020)", 2023-09-30T17:03:36.144 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:36.115279+0000", 2023-09-30T17:03:36.144 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.00092598300000000001, 2023-09-30T17:03:36.144 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0013472289999999999, 2023-09-30T17:03:36.144 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:36.144 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:36.144 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:36.144 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.144 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:36.145 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.115279+0000", 2023-09-30T17:03:36.145 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:36.145 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.145 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.145 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:36.145 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.115279+0000", 2023-09-30T17:03:36.145 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:36.145 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.145 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.145 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:36.145 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.115279+0000", 2023-09-30T17:03:36.146 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0200000000000002e-07 2023-09-30T17:03:36.146 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.146 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.146 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:36.146 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.115295+0000", 2023-09-30T17:03:36.146 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5693999999999999e-05 2023-09-30T17:03:36.146 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.146 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.146 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:36.146 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.115304+0000", 2023-09-30T17:03:36.146 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8310000000000007e-06 2023-09-30T17:03:36.146 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.147 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.147 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:36.147 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.115310+0000", 2023-09-30T17:03:36.147 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.976e-06 2023-09-30T17:03:36.147 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.147 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.147 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:36.147 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.115356+0000", 2023-09-30T17:03:36.147 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6026000000000003e-05 2023-09-30T17:03:36.147 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.147 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.148 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:36.148 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.115374+0000", 2023-09-30T17:03:36.148 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8080999999999998e-05 2023-09-30T17:03:36.148 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:36.148 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:36.148 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:36.148 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.148 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.148 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:16580 4.f 4:f2a80dfe:::100000001f8.00000019:head [write 3133440~4096 in=4096b,write 3207168~4096 in=4096b,write 3260416~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-09-30T17:03:36.148 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:36.100677+0000", 2023-09-30T17:03:36.148 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.015528052000000001, 2023-09-30T17:03:36.149 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016033103999999999, 2023-09-30T17:03:36.149 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:36.149 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:36.149 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:36.149 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:36.149 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:36.149 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 16580 2023-09-30T17:03:36.149 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.149 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:36.149 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.149 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:36.149 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.100677+0000", 2023-09-30T17:03:36.150 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:36.150 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.150 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.150 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:36.150 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.100677+0000", 2023-09-30T17:03:36.150 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:36.150 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.150 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.150 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:36.150 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.100677+0000", 2023-09-30T17:03:36.150 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7300000000000005e-07 2023-09-30T17:03:36.150 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.151 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.151 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:36.151 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.100698+0000", 2023-09-30T17:03:36.151 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.02e-05 2023-09-30T17:03:36.151 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.151 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.151 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:36.151 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.100711+0000", 2023-09-30T17:03:36.151 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3288000000000001e-05 2023-09-30T17:03:36.151 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.151 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.151 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:36.152 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.100718+0000", 2023-09-30T17:03:36.152 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3529999999999997e-06 2023-09-30T17:03:36.152 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.152 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.152 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:36.152 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.115001+0000", 2023-09-30T17:03:36.152 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014282994 2023-09-30T17:03:36.152 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.152 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.152 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:36.152 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.115082+0000", 2023-09-30T17:03:36.152 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0421999999999997e-05 2023-09-30T17:03:36.153 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.153 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.153 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:36.153 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.115245+0000", 2023-09-30T17:03:36.153 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016309500000000001 2023-09-30T17:03:36.153 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:36.153 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:36.153 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:36.153 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.153 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.153 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:16581 4.f 4:f2a80dfe:::100000001f8.00000019:head [write 720896~4096 in=4096b,write 794624~4096 in=4096b,write 819200~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-09-30T17:03:36.153 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:36.101112+0000", 2023-09-30T17:03:36.154 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.015092563, 2023-09-30T17:03:36.154 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015686433, 2023-09-30T17:03:36.154 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:36.154 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:36.154 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:36.154 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:36.154 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:36.154 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 16581 2023-09-30T17:03:36.154 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.154 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:36.154 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.154 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:36.155 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.101112+0000", 2023-09-30T17:03:36.155 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:36.155 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.155 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.155 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:36.155 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.101112+0000", 2023-09-30T17:03:36.155 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:36.155 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.155 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.155 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:36.155 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.101113+0000", 2023-09-30T17:03:36.156 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9699999999999995e-07 2023-09-30T17:03:36.156 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.156 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.156 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:36.156 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.101125+0000", 2023-09-30T17:03:36.156 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.236e-05 2023-09-30T17:03:36.156 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.156 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.156 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:36.156 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.101137+0000", 2023-09-30T17:03:36.156 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1715999999999999e-05 2023-09-30T17:03:36.156 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.156 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.157 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:36.157 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.101144+0000", 2023-09-30T17:03:36.157 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1330000000000001e-06 2023-09-30T17:03:36.157 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.157 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.157 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:36.157 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.116400+0000", 2023-09-30T17:03:36.157 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015255787 2023-09-30T17:03:36.157 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.157 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.157 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:36.157 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.116452+0000", 2023-09-30T17:03:36.157 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1601999999999998e-05 2023-09-30T17:03:36.158 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.158 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.158 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:36.158 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.116555+0000", 2023-09-30T17:03:36.158 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000103643 2023-09-30T17:03:36.158 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:36.158 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:36.158 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:36.158 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.158 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.158 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:16607 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-09-30T17:03:36.159 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:36.115814+0000", 2023-09-30T17:03:36.159 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.00039041100000000001, 2023-09-30T17:03:36.159 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0010657780000000001, 2023-09-30T17:03:36.159 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:36.159 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:36.159 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:36.159 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:36.159 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:36.159 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 16607 2023-09-30T17:03:36.159 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.160 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:36.160 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.160 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:36.160 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.115814+0000", 2023-09-30T17:03:36.160 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:36.160 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.160 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.160 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:36.160 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.115814+0000", 2023-09-30T17:03:36.160 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:36.160 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.160 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.161 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:36.161 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.115815+0000", 2023-09-30T17:03:36.161 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4200000000000005e-07 2023-09-30T17:03:36.161 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.161 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.161 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:36.161 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.115830+0000", 2023-09-30T17:03:36.161 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4649e-05 2023-09-30T17:03:36.161 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.161 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.161 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:36.162 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.115844+0000", 2023-09-30T17:03:36.162 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4138000000000001e-05 2023-09-30T17:03:36.162 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.162 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.162 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:36.162 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.115850+0000", 2023-09-30T17:03:36.162 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1650000000000003e-06 2023-09-30T17:03:36.162 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:36.162 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:36.162 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:36.162 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.162 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.163 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:16582 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-09-30T17:03:36.163 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:36.101562+0000", 2023-09-30T17:03:36.163 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.01464241, 2023-09-30T17:03:36.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015393172, 2023-09-30T17:03:36.163 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:36.163 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:36.163 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:36.163 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:36.163 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:36.163 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 16582 2023-09-30T17:03:36.163 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.163 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:36.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.164 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:36.164 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.101562+0000", 2023-09-30T17:03:36.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:36.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.164 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:36.164 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.101562+0000", 2023-09-30T17:03:36.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:36.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.165 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:36.165 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.101563+0000", 2023-09-30T17:03:36.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5900000000000005e-07 2023-09-30T17:03:36.165 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.165 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.165 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:36.165 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.101593+0000", 2023-09-30T17:03:36.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9776000000000001e-05 2023-09-30T17:03:36.165 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.165 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.165 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:36.166 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.101602+0000", 2023-09-30T17:03:36.166 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0629999999999995e-06 2023-09-30T17:03:36.166 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.166 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:36.166 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.101610+0000", 2023-09-30T17:03:36.166 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0269999999999995e-06 2023-09-30T17:03:36.166 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:36.166 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:36.166 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:36.166 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.167 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:16608 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-09-30T17:03:36.167 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:36.116174+0000", 2023-09-30T17:03:36.167 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.0476000000000001e-05, 2023-09-30T17:03:36.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00083909299999999996, 2023-09-30T17:03:36.167 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:36.167 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:36.167 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:36.167 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:36.167 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:36.167 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 16608 2023-09-30T17:03:36.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.168 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:36.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:36.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.116174+0000", 2023-09-30T17:03:36.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:36.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:36.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.116174+0000", 2023-09-30T17:03:36.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:36.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:36.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.116175+0000", 2023-09-30T17:03:36.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5199999999999995e-07 2023-09-30T17:03:36.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:36.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.116187+0000", 2023-09-30T17:03:36.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1505000000000001e-05 2023-09-30T17:03:36.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:36.170 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.116201+0000", 2023-09-30T17:03:36.170 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.454e-05 2023-09-30T17:03:36.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.170 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:36.170 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.116209+0000", 2023-09-30T17:03:36.170 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0409999999999998e-06 2023-09-30T17:03:36.170 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:36.170 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:36.170 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:36.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.171 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:16609 4.2c 4:35cbff5f:::100000001f8.00000033:head [write 442368~4096 in=4096b,write 704512~4096 in=4096b,write 757760~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-09-30T17:03:36.171 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:36.116584+0000", 2023-09-30T17:03:36.171 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9996204, 2023-09-30T17:03:36.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00048696200000000002, 2023-09-30T17:03:36.171 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:36.171 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:36.171 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:36.171 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:36.171 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:36.171 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 16609 2023-09-30T17:03:36.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.172 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:36.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.172 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:36.172 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.116584+0000", 2023-09-30T17:03:36.172 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:36.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.172 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:36.172 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.116584+0000", 2023-09-30T17:03:36.172 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:36.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.173 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:36.173 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.116585+0000", 2023-09-30T17:03:36.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2200000000000003e-07 2023-09-30T17:03:36.173 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.173 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:36.173 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.116597+0000", 2023-09-30T17:03:36.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2349e-05 2023-09-30T17:03:36.173 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.173 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:36.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.116607+0000", 2023-09-30T17:03:36.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8619999999999998e-06 2023-09-30T17:03:36.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:36.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.116614+0000", 2023-09-30T17:03:36.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2749999999999998e-06 2023-09-30T17:03:36.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:36.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.116659+0000", 2023-09-30T17:03:36.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4833999999999998e-05 2023-09-30T17:03:36.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.175 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:36.175 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.116725+0000", 2023-09-30T17:03:36.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5743999999999999e-05 2023-09-30T17:03:36.175 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:36.175 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:36.175 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:36.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.175 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(client.4547.0:16579 4.f e40/17)", 2023-09-30T17:03:36.176 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:36.116925+0000", 2023-09-30T17:03:36.176 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9992795, 2023-09-30T17:03:36.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00020624099999999999, 2023-09-30T17:03:36.176 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:36.176 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:36.176 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:36.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.177 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:36.177 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.116925+0000", 2023-09-30T17:03:36.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:36.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.177 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:36.178 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.116925+0000", 2023-09-30T17:03:36.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:36.178 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.178 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.178 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:36.178 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.116925+0000", 2023-09-30T17:03:36.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3000000000000001e-07 2023-09-30T17:03:36.178 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.178 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.178 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:36.178 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.116932+0000", 2023-09-30T17:03:36.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4069999999999998e-06 2023-09-30T17:03:36.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:36.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.116940+0000", 2023-09-30T17:03:36.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8229999999999995e-06 2023-09-30T17:03:36.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:36.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.116946+0000", 2023-09-30T17:03:36.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3790000000000003e-06 2023-09-30T17:03:36.179 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:36.179 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:36.180 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:36.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.180 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:16590 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-09-30T17:03:36.180 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:36.105338+0000", 2023-09-30T17:03:36.180 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.010866600000000001, 2023-09-30T17:03:36.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011841773999999999, 2023-09-30T17:03:36.180 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:36.180 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:36.180 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:36.180 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:36.180 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:36.181 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 16590 2023-09-30T17:03:36.181 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.181 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:36.181 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.181 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:36.181 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.105338+0000", 2023-09-30T17:03:36.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:36.181 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.181 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.181 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:36.181 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.105338+0000", 2023-09-30T17:03:36.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:36.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.182 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:36.182 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.105339+0000", 2023-09-30T17:03:36.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0400000000000005e-07 2023-09-30T17:03:36.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.182 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:36.182 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.105348+0000", 2023-09-30T17:03:36.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1980000000000007e-06 2023-09-30T17:03:36.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:36.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.105360+0000", 2023-09-30T17:03:36.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1970000000000001e-05 2023-09-30T17:03:36.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:36.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.105366+0000", 2023-09-30T17:03:36.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5940000000000001e-06 2023-09-30T17:03:36.183 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:36.183 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:36.183 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:36.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.184 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:16600 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-09-30T17:03:36.184 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:36.111160+0000", 2023-09-30T17:03:36.184 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0050442519999999999, 2023-09-30T17:03:36.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060761180000000001, 2023-09-30T17:03:36.184 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:36.184 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:36.184 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:36.184 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:36.184 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:36.185 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 16600 2023-09-30T17:03:36.185 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.185 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:36.185 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.185 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:36.185 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.111160+0000", 2023-09-30T17:03:36.185 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:36.185 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.185 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.185 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:36.185 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.111160+0000", 2023-09-30T17:03:36.186 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:36.186 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.186 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.186 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:36.186 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.111161+0000", 2023-09-30T17:03:36.186 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0800000000000004e-07 2023-09-30T17:03:36.186 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.186 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.186 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:36.186 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.111174+0000", 2023-09-30T17:03:36.186 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3052e-05 2023-09-30T17:03:36.186 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:36.187 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.111184+0000", 2023-09-30T17:03:36.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8430000000000005e-06 2023-09-30T17:03:36.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:36.187 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.111191+0000", 2023-09-30T17:03:36.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8739999999999997e-06 2023-09-30T17:03:36.187 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:36.187 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:36.188 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:36.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.188 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:16572 4.37 4:ef395e89:::100000001f8.00000020:head [write 3108864~4096 in=4096b,write 3174400~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-09-30T17:03:36.188 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:36.097224+0000", 2023-09-30T17:03:36.188 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.018980554, 2023-09-30T17:03:36.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020078658999999999, 2023-09-30T17:03:36.188 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:36.188 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:36.188 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:36.188 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:36.188 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:36.189 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 16572 2023-09-30T17:03:36.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.189 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:36.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:36.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.097224+0000", 2023-09-30T17:03:36.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:36.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:36.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.097224+0000", 2023-09-30T17:03:36.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:36.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.190 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:36.190 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.097225+0000", 2023-09-30T17:03:36.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2600000000000001e-07 2023-09-30T17:03:36.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.190 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:36.190 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.097240+0000", 2023-09-30T17:03:36.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4615e-05 2023-09-30T17:03:36.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.191 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:36.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.097251+0000", 2023-09-30T17:03:36.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1158999999999999e-05 2023-09-30T17:03:36.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.191 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:36.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.097258+0000", 2023-09-30T17:03:36.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9079999999999998e-06 2023-09-30T17:03:36.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.191 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:36.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.111396+0000", 2023-09-30T17:03:36.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014137953999999999 2023-09-30T17:03:36.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:36.192 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.111476+0000", 2023-09-30T17:03:36.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0484999999999999e-05 2023-09-30T17:03:36.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:36.192 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.111630+0000", 2023-09-30T17:03:36.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015374400000000001 2023-09-30T17:03:36.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:36.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.114814+0000", 2023-09-30T17:03:36.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0031837409999999999 2023-09-30T17:03:36.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:36.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.117220+0000", 2023-09-30T17:03:36.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0024059820000000001 2023-09-30T17:03:36.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:36.194 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.117266+0000", 2023-09-30T17:03:36.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5932e-05 2023-09-30T17:03:36.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:36.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:36.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:36.194 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:36.117303+0000", 2023-09-30T17:03:36.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7313e-05 2023-09-30T17:03:36.194 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:36.194 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:36.194 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:36.194 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:36.194 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2023-09-30T17:03:36.195 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 16 2023-09-30T17:03:36.195 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:36.196 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:36.195+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:36.196 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:03:36.196 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:03:36.197 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:03:36.198 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:03:36.198 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-09-30T17:03:36.198 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-09-30T17:03:36.198 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:03:36.199 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:03:36.296 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:36.295+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:36.375 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:36.375 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:36.389 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:03:36.430 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:36.429+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:36.497 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:36.497+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:36.598 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:36.597+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:36.604 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:36.604 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:36.616 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:03:36.698 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:36.698+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:36.799 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:36.798+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:36.807 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:36.807 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:36.818 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:03:36.900 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:36.899+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:37.000 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:37.000+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:37.001 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:37.001 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:37.016 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:03:37.101 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:37.100+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:37.201 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:37.200+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:37.241 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:37.241 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:37.256 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:03:37.302 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:37.301+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:37.403 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:37.402+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:37.423 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-09-30T17:03:37.428 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:37.428 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:37.443 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:03:37.504 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:37.503+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:37.604 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:37.603+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:37.661 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:37.662 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:37.675 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:03:37.705 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:37.705+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:37.806 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:37.805+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:37.877 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:37.877 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:37.891 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:03:37.935 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:37.935+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:38.008 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:38.007+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:38.076 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:38.076 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:38.090 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:03:38.109 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:38.108+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:38.200 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-09-30T17:03:38.217 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:38.215+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:38.311 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:38.310+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:38.318 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:38.318 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:38.332 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:03:38.375 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:03:38.399 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:03:38.399 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-09-30T17:03:38.399 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-09-30T17:03:38.399 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:03:38.402 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:03:38.403 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:03:38.412 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:38.411+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:38.418 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is set 2023-09-30T17:03:38.513 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:38.512+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:38.520 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:38.520 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 20, 2023-09-30T17:03:38.520 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 600, 2023-09-30T17:03:38.520 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:03:38.520 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.520 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:16442 4.36 4:6fa85f86:::100000001f8.00000013:head [write 2519040~4096,write 2547712~4096,write 2760704~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-09-30T17:03:38.520 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:36.053495+0000", 2023-09-30T17:03:38.521 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 2.4633054539999999, 2023-09-30T17:03:38.521 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.036321902000000003, 2023-09-30T17:03:38.521 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:38.521 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:38.521 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:38.521 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:38.521 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:38.521 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 16442 2023-09-30T17:03:38.521 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.521 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:38.521 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.521 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:38.522 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.053495+0000", 2023-09-30T17:03:38.522 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:38.522 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.522 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.522 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:38.522 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.053495+0000", 2023-09-30T17:03:38.522 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:38.522 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.522 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.522 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:38.523 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.053496+0000", 2023-09-30T17:03:38.523 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5700000000000001e-07 2023-09-30T17:03:38.523 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.523 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.523 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:38.523 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.053512+0000", 2023-09-30T17:03:38.523 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5362999999999998e-05 2023-09-30T17:03:38.523 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.523 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.523 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:38.523 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.053522+0000", 2023-09-30T17:03:38.523 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0774999999999999e-05 2023-09-30T17:03:38.524 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.524 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.524 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:38.524 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.053529+0000", 2023-09-30T17:03:38.524 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0190000000000001e-06 2023-09-30T17:03:38.524 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.525 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.525 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:38.525 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.053597+0000", 2023-09-30T17:03:38.525 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7522999999999997e-05 2023-09-30T17:03:38.525 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.525 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.525 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:38.526 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.053696+0000", 2023-09-30T17:03:38.526 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8883999999999997e-05 2023-09-30T17:03:38.526 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.526 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.526 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:38.526 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.053873+0000", 2023-09-30T17:03:38.527 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017674100000000001 2023-09-30T17:03:38.527 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.527 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.527 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:38.527 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.058007+0000", 2023-09-30T17:03:38.527 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0041339929999999999 2023-09-30T17:03:38.527 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.527 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.527 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:38.527 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.089723+0000", 2023-09-30T17:03:38.527 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.031716251000000001 2023-09-30T17:03:38.527 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.528 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.528 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:38.528 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.089776+0000", 2023-09-30T17:03:38.528 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.287e-05 2023-09-30T17:03:38.528 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.528 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.528 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:38.528 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.089817+0000", 2023-09-30T17:03:38.528 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1625999999999998e-05 2023-09-30T17:03:38.528 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:38.528 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:38.528 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:38.529 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.529 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.529 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:16443 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 1343488~4096,write 1527808~4096,write 1699840~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-09-30T17:03:38.529 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:36.053725+0000", 2023-09-30T17:03:38.529 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 2.463075801, 2023-09-30T17:03:38.529 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.036382484, 2023-09-30T17:03:38.529 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:38.529 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:38.529 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:38.529 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:38.529 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:38.529 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 16443 2023-09-30T17:03:38.530 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.530 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:38.530 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.530 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:38.530 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.053725+0000", 2023-09-30T17:03:38.530 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:38.530 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.530 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.530 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:38.530 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.053725+0000", 2023-09-30T17:03:38.530 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:38.531 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.531 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.531 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:38.531 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.053726+0000", 2023-09-30T17:03:38.531 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8000000000000005e-07 2023-09-30T17:03:38.531 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.531 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.531 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:38.531 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.053754+0000", 2023-09-30T17:03:38.531 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.7963999999999999e-05 2023-09-30T17:03:38.531 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.531 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.532 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:38.532 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.053769+0000", 2023-09-30T17:03:38.532 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4868000000000001e-05 2023-09-30T17:03:38.532 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.532 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.532 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:38.532 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.053777+0000", 2023-09-30T17:03:38.532 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7980000000000006e-06 2023-09-30T17:03:38.532 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.532 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.532 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:38.533 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.053813+0000", 2023-09-30T17:03:38.533 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6627e-05 2023-09-30T17:03:38.533 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.533 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.533 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:38.533 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.053859+0000", 2023-09-30T17:03:38.533 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6292000000000003e-05 2023-09-30T17:03:38.533 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.533 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.533 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:38.533 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.054015+0000", 2023-09-30T17:03:38.533 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015504399999999999 2023-09-30T17:03:38.534 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.534 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.534 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:38.534 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.059150+0000", 2023-09-30T17:03:38.534 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051353229999999998 2023-09-30T17:03:38.534 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.534 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.534 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:38.534 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.090009+0000", 2023-09-30T17:03:38.534 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.030859379999999999 2023-09-30T17:03:38.534 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.534 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.535 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:38.535 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.090069+0000", 2023-09-30T17:03:38.535 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.978e-05 2023-09-30T17:03:38.535 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.535 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.535 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:38.535 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.090108+0000", 2023-09-30T17:03:38.535 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8627999999999997e-05 2023-09-30T17:03:38.535 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:38.535 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:38.536 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:38.536 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.536 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.536 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:16445 4.36 4:6da220e6:::100000001f8.0000003f:head [write 3227648~4096,write 3293184~4096,write 3317760~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-09-30T17:03:38.536 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:36.054679+0000", 2023-09-30T17:03:38.536 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 2.4621221769999999, 2023-09-30T17:03:38.536 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.035268196000000002, 2023-09-30T17:03:38.536 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:38.537 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:38.537 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:38.537 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:38.537 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:38.537 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 16445 2023-09-30T17:03:38.537 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.537 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:38.537 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.537 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:38.537 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.054679+0000", 2023-09-30T17:03:38.537 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:38.537 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.538 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.538 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:38.538 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.054679+0000", 2023-09-30T17:03:38.538 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:38.538 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.538 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.538 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:38.538 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.054680+0000", 2023-09-30T17:03:38.538 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9400000000000004e-07 2023-09-30T17:03:38.538 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.538 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.539 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:38.539 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.054690+0000", 2023-09-30T17:03:38.539 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0182e-05 2023-09-30T17:03:38.539 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.539 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.539 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:38.539 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.054699+0000", 2023-09-30T17:03:38.539 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7690000000000008e-06 2023-09-30T17:03:38.539 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.539 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.539 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:38.540 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.054705+0000", 2023-09-30T17:03:38.540 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6359999999999999e-06 2023-09-30T17:03:38.540 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.540 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.540 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:38.540 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.054925+0000", 2023-09-30T17:03:38.540 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00022002600000000001 2023-09-30T17:03:38.540 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.540 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.540 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:38.540 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.054976+0000", 2023-09-30T17:03:38.540 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0773000000000003e-05 2023-09-30T17:03:38.541 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.541 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.541 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:38.541 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.055188+0000", 2023-09-30T17:03:38.541 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000212186 2023-09-30T17:03:38.541 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.541 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.541 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:38.541 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.059162+0000", 2023-09-30T17:03:38.541 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0039736820000000001 2023-09-30T17:03:38.541 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.541 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.542 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:38.542 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.089863+0000", 2023-09-30T17:03:38.542 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.030701244999999999 2023-09-30T17:03:38.542 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.542 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.542 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:38.542 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.089911+0000", 2023-09-30T17:03:38.542 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7871999999999998e-05 2023-09-30T17:03:38.542 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.542 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.542 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:38.543 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.089947+0000", 2023-09-30T17:03:38.543 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6031000000000001e-05 2023-09-30T17:03:38.543 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:38.543 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:38.543 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:38.543 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.543 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.543 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:16447 4.36 4:6da220e6:::100000001f8.0000003f:head [write 2699264~4096,write 2863104~4096,write 3014656~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-09-30T17:03:38.543 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:36.055226+0000", 2023-09-30T17:03:38.543 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 2.4615745740000001, 2023-09-30T17:03:38.543 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.036330697000000002, 2023-09-30T17:03:38.543 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:38.544 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:38.544 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:38.544 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:38.544 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:38.544 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 16447 2023-09-30T17:03:38.544 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.545 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:38.545 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.545 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:38.545 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.055226+0000", 2023-09-30T17:03:38.545 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:38.545 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.545 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.545 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:38.545 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.055226+0000", 2023-09-30T17:03:38.545 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:38.545 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.545 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.546 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:38.546 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.055227+0000", 2023-09-30T17:03:38.546 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5400000000000001e-07 2023-09-30T17:03:38.546 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.546 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.546 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:38.546 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.055236+0000", 2023-09-30T17:03:38.547 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8179999999999993e-06 2023-09-30T17:03:38.547 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.547 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.547 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:38.547 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.055243+0000", 2023-09-30T17:03:38.547 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8000000000000001e-06 2023-09-30T17:03:38.547 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.547 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.547 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:38.547 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.055250+0000", 2023-09-30T17:03:38.547 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0430000000000002e-06 2023-09-30T17:03:38.548 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.548 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.548 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:38.548 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.055939+0000", 2023-09-30T17:03:38.548 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00068932499999999996 2023-09-30T17:03:38.548 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.548 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.548 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:38.548 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.056028+0000", 2023-09-30T17:03:38.548 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8521000000000002e-05 2023-09-30T17:03:38.548 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.549 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.549 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:38.549 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.056205+0000", 2023-09-30T17:03:38.549 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017779499999999999 2023-09-30T17:03:38.549 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.549 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.549 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:38.549 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.059167+0000", 2023-09-30T17:03:38.549 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0029614709999999998 2023-09-30T17:03:38.549 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.549 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.549 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:38.550 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.091498+0000", 2023-09-30T17:03:38.550 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.032331416000000002 2023-09-30T17:03:38.550 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.550 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.550 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:38.550 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.091536+0000", 2023-09-30T17:03:38.550 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7478999999999998e-05 2023-09-30T17:03:38.550 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.550 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.550 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:38.550 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.091557+0000", 2023-09-30T17:03:38.551 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1375000000000001e-05 2023-09-30T17:03:38.551 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:38.551 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:38.551 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:38.551 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.551 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.551 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:16455 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 1949696~4096,write 1970176~4096,write 2011136~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-09-30T17:03:38.551 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:36.057952+0000", 2023-09-30T17:03:38.551 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 2.4588486189999998, 2023-09-30T17:03:38.552 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.035762575999999997, 2023-09-30T17:03:38.552 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:38.552 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:38.553 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:38.553 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:38.553 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:38.553 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 16455 2023-09-30T17:03:38.553 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.553 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:38.553 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.554 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:38.554 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.057952+0000", 2023-09-30T17:03:38.554 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:38.554 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.554 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.554 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:38.554 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.057952+0000", 2023-09-30T17:03:38.554 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:38.554 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.554 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.554 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:38.555 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.057953+0000", 2023-09-30T17:03:38.555 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3500000000000005e-07 2023-09-30T17:03:38.555 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.555 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.555 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:38.555 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.057975+0000", 2023-09-30T17:03:38.555 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2055000000000001e-05 2023-09-30T17:03:38.555 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.555 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.555 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:38.555 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.057986+0000", 2023-09-30T17:03:38.555 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0934999999999999e-05 2023-09-30T17:03:38.556 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.556 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.556 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:38.556 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.057995+0000", 2023-09-30T17:03:38.556 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8920000000000006e-06 2023-09-30T17:03:38.556 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.556 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.556 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:38.556 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.058040+0000", 2023-09-30T17:03:38.556 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4551000000000001e-05 2023-09-30T17:03:38.556 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.557 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.557 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:38.557 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.058102+0000", 2023-09-30T17:03:38.557 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2188999999999997e-05 2023-09-30T17:03:38.557 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.557 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.557 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:38.557 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.058206+0000", 2023-09-30T17:03:38.557 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010418599999999999 2023-09-30T17:03:38.557 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.557 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.557 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:38.557 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.059591+0000", 2023-09-30T17:03:38.558 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0013852999999999999 2023-09-30T17:03:38.558 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.558 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.558 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:38.558 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.093623+0000", 2023-09-30T17:03:38.558 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.034031548000000002 2023-09-30T17:03:38.558 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.558 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.558 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:38.558 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.093680+0000", 2023-09-30T17:03:38.558 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7054e-05 2023-09-30T17:03:38.559 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.559 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.559 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:38.559 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.093715+0000", 2023-09-30T17:03:38.559 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4931000000000001e-05 2023-09-30T17:03:38.559 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:38.559 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:38.559 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:38.559 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.559 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.559 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:16458 4.28 4:153ae410:::100000001f8.0000003b:head [write 2772992~4096,write 2826240~4096,write 2854912~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-09-30T17:03:38.560 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:36.059061+0000", 2023-09-30T17:03:38.560 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 2.4577403800000002, 2023-09-30T17:03:38.560 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.032405154999999998, 2023-09-30T17:03:38.560 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:38.560 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:38.560 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:38.560 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:38.560 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:38.560 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 16458 2023-09-30T17:03:38.560 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.560 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:38.561 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.561 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:38.561 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.059061+0000", 2023-09-30T17:03:38.561 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:38.561 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.561 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.561 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:38.561 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.059061+0000", 2023-09-30T17:03:38.561 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:38.561 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.561 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.561 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:38.562 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.059062+0000", 2023-09-30T17:03:38.562 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8599999999999996e-07 2023-09-30T17:03:38.562 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.562 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.562 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:38.562 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.059077+0000", 2023-09-30T17:03:38.562 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5085e-05 2023-09-30T17:03:38.562 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.562 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.562 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:38.563 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.059092+0000", 2023-09-30T17:03:38.563 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5271999999999999e-05 2023-09-30T17:03:38.563 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.563 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.563 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:38.563 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.059102+0000", 2023-09-30T17:03:38.563 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0091e-05 2023-09-30T17:03:38.563 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.563 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.563 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:38.563 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.059171+0000", 2023-09-30T17:03:38.564 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9429000000000002e-05 2023-09-30T17:03:38.564 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.564 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.564 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:38.564 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.059220+0000", 2023-09-30T17:03:38.564 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8281000000000001e-05 2023-09-30T17:03:38.564 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.564 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.564 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:38.564 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.059305+0000", 2023-09-30T17:03:38.564 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4893000000000002e-05 2023-09-30T17:03:38.565 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.565 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.565 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:38.565 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.065426+0000", 2023-09-30T17:03:38.565 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.006121703 2023-09-30T17:03:38.565 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.565 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.565 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:38.565 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.091385+0000", 2023-09-30T17:03:38.565 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.025958446999999999 2023-09-30T17:03:38.566 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.566 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.566 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:38.566 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.091426+0000", 2023-09-30T17:03:38.566 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1548000000000003e-05 2023-09-30T17:03:38.566 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.566 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.566 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:38.566 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.091466+0000", 2023-09-30T17:03:38.566 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9419999999999999e-05 2023-09-30T17:03:38.566 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:38.566 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:38.567 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:38.567 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.567 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.567 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:16460 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 3194880~4096,write 3952640~4096,write 4042752~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-09-30T17:03:38.567 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:36.059835+0000", 2023-09-30T17:03:38.567 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 2.4569657409999999, 2023-09-30T17:03:38.567 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.037614398, 2023-09-30T17:03:38.567 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:38.567 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:38.567 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:38.567 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:38.568 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:38.568 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 16460 2023-09-30T17:03:38.568 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.568 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:38.568 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.568 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:38.568 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.059835+0000", 2023-09-30T17:03:38.568 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:38.568 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.568 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.569 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:38.569 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.059835+0000", 2023-09-30T17:03:38.569 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:38.569 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.569 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.569 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:38.569 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.059836+0000", 2023-09-30T17:03:38.569 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4300000000000003e-07 2023-09-30T17:03:38.569 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.569 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.569 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:38.569 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.059852+0000", 2023-09-30T17:03:38.570 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6555999999999999e-05 2023-09-30T17:03:38.570 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.570 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.570 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:38.570 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.059858+0000", 2023-09-30T17:03:38.570 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7769999999999999e-06 2023-09-30T17:03:38.570 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.570 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.570 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:38.570 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.059868+0000", 2023-09-30T17:03:38.571 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.5170000000000005e-06 2023-09-30T17:03:38.571 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.571 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.571 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:38.571 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.059923+0000", 2023-09-30T17:03:38.571 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5695000000000001e-05 2023-09-30T17:03:38.571 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.571 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.572 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:38.572 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.060012+0000", 2023-09-30T17:03:38.572 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8842000000000001e-05 2023-09-30T17:03:38.572 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.572 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.572 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:38.572 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.060186+0000", 2023-09-30T17:03:38.572 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017340899999999999 2023-09-30T17:03:38.573 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.573 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.573 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:38.573 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.068328+0000", 2023-09-30T17:03:38.573 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00814258 2023-09-30T17:03:38.573 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.573 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.573 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:38.573 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.097327+0000", 2023-09-30T17:03:38.573 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.028999292999999999 2023-09-30T17:03:38.573 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.574 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.574 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:38.574 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.097409+0000", 2023-09-30T17:03:38.574 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1601999999999996e-05 2023-09-30T17:03:38.574 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.574 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.574 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:38.574 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.097450+0000", 2023-09-30T17:03:38.574 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0584000000000003e-05 2023-09-30T17:03:38.574 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:38.574 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:38.575 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:38.575 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.575 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.575 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:16472 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 929792~4096,write 983040~4096,write 991232~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-09-30T17:03:38.575 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:36.063155+0000", 2023-09-30T17:03:38.575 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 2.453645453, 2023-09-30T17:03:38.575 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.031562031999999997, 2023-09-30T17:03:38.575 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:38.575 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:38.575 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:38.576 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:38.576 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:38.576 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 16472 2023-09-30T17:03:38.576 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.576 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:38.576 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.576 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:38.576 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.063155+0000", 2023-09-30T17:03:38.576 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:38.576 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.576 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.577 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:38.577 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.063155+0000", 2023-09-30T17:03:38.577 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:38.577 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.577 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.577 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:38.577 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.063159+0000", 2023-09-30T17:03:38.577 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4429999999999999e-06 2023-09-30T17:03:38.577 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.577 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.577 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:38.577 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.063180+0000", 2023-09-30T17:03:38.578 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1362e-05 2023-09-30T17:03:38.578 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.578 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.578 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:38.578 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.063190+0000", 2023-09-30T17:03:38.578 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0190999999999999e-05 2023-09-30T17:03:38.578 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.578 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.578 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:38.578 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.063195+0000", 2023-09-30T17:03:38.579 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.882e-06 2023-09-30T17:03:38.579 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.579 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.579 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:38.579 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.063233+0000", 2023-09-30T17:03:38.579 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7897e-05 2023-09-30T17:03:38.579 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.579 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.579 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:38.579 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.063298+0000", 2023-09-30T17:03:38.579 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4298e-05 2023-09-30T17:03:38.580 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.580 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.580 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:38.580 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.063389+0000", 2023-09-30T17:03:38.580 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1016999999999999e-05 2023-09-30T17:03:38.580 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.580 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.580 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:38.580 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.069064+0000", 2023-09-30T17:03:38.580 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0056759139999999998 2023-09-30T17:03:38.580 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.580 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.581 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:38.581 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.094653+0000", 2023-09-30T17:03:38.581 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.025588436999999999 2023-09-30T17:03:38.581 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.581 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.581 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:38.581 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.094687+0000", 2023-09-30T17:03:38.581 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3969e-05 2023-09-30T17:03:38.581 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.581 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.581 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:38.581 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.094718+0000", 2023-09-30T17:03:38.582 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0621999999999999e-05 2023-09-30T17:03:38.582 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:38.582 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:38.582 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:38.582 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.582 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.582 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:16478 4.36 4:6da220e6:::100000001f8.0000003f:head [write 3338240~4096,write 3395584~4096,write 3452928~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-09-30T17:03:38.582 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:36.064857+0000", 2023-09-30T17:03:38.582 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 2.4519442630000001, 2023-09-30T17:03:38.582 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.033975933, 2023-09-30T17:03:38.583 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:38.583 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:38.583 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:38.583 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:38.583 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:38.583 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 16478 2023-09-30T17:03:38.583 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.583 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:38.583 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.583 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:38.583 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.064857+0000", 2023-09-30T17:03:38.584 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:38.584 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.584 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.584 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:38.584 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.064857+0000", 2023-09-30T17:03:38.584 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:38.584 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.584 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.584 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:38.584 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.064857+0000", 2023-09-30T17:03:38.584 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.65e-07 2023-09-30T17:03:38.584 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.585 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.585 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:38.585 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.064869+0000", 2023-09-30T17:03:38.585 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1885999999999999e-05 2023-09-30T17:03:38.585 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.585 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.585 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:38.585 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.064876+0000", 2023-09-30T17:03:38.585 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1110000000000002e-06 2023-09-30T17:03:38.586 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.586 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.586 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:38.586 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.064880+0000", 2023-09-30T17:03:38.586 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8770000000000003e-06 2023-09-30T17:03:38.586 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.586 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.586 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:38.586 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.064924+0000", 2023-09-30T17:03:38.586 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3995000000000001e-05 2023-09-30T17:03:38.586 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.586 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.587 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:38.587 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.065015+0000", 2023-09-30T17:03:38.587 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1459999999999995e-05 2023-09-30T17:03:38.587 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.587 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.587 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:38.587 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.065186+0000", 2023-09-30T17:03:38.587 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000171065 2023-09-30T17:03:38.587 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.587 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.587 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:38.587 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.069071+0000", 2023-09-30T17:03:38.588 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0038846129999999999 2023-09-30T17:03:38.588 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.588 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.588 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:38.588 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.098749+0000", 2023-09-30T17:03:38.588 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.029677594000000002 2023-09-30T17:03:38.588 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.588 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.588 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:38.588 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.098794+0000", 2023-09-30T17:03:38.588 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4985999999999999e-05 2023-09-30T17:03:38.588 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.589 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.589 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:38.589 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.098833+0000", 2023-09-30T17:03:38.589 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8980999999999998e-05 2023-09-30T17:03:38.589 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:38.589 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:38.590 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:38.590 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.590 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.590 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:16479 4.6 4:616d4c41:::100000001f8.00000034:head [write 704512~4096,write 823296~4096,write 835584~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-09-30T17:03:38.590 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:36.065217+0000", 2023-09-30T17:03:38.590 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 2.4515835369999999, 2023-09-30T17:03:38.590 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.043636744999999998, 2023-09-30T17:03:38.590 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:38.590 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:38.590 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:38.590 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:38.591 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:38.591 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 16479 2023-09-30T17:03:38.591 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.591 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:38.591 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.591 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:38.591 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.065217+0000", 2023-09-30T17:03:38.591 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:38.591 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.591 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.591 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:38.591 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.065217+0000", 2023-09-30T17:03:38.592 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:38.592 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.592 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.592 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:38.592 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.065218+0000", 2023-09-30T17:03:38.592 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4499999999999996e-07 2023-09-30T17:03:38.592 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.592 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.592 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:38.592 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.065230+0000", 2023-09-30T17:03:38.592 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2218999999999999e-05 2023-09-30T17:03:38.593 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.593 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.593 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:38.593 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.065242+0000", 2023-09-30T17:03:38.593 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1674e-05 2023-09-30T17:03:38.593 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.593 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.593 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:38.593 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.065250+0000", 2023-09-30T17:03:38.593 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8800000000000008e-06 2023-09-30T17:03:38.593 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.593 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.594 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:38.594 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.065675+0000", 2023-09-30T17:03:38.594 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00042495599999999999 2023-09-30T17:03:38.594 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.594 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.594 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:38.594 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.065756+0000", 2023-09-30T17:03:38.594 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0959999999999997e-05 2023-09-30T17:03:38.594 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.594 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.594 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:38.595 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.065921+0000", 2023-09-30T17:03:38.595 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000164661 2023-09-30T17:03:38.595 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.595 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.595 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:38.595 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.072587+0000", 2023-09-30T17:03:38.595 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0066664990000000002 2023-09-30T17:03:38.595 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.595 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.595 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:38.596 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.108797+0000", 2023-09-30T17:03:38.596 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.036210237999999999 2023-09-30T17:03:38.596 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.596 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.596 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:38.596 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.108830+0000", 2023-09-30T17:03:38.596 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3031000000000003e-05 2023-09-30T17:03:38.596 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.596 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.596 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:38.596 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.108854+0000", 2023-09-30T17:03:38.597 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.3782e-05 2023-09-30T17:03:38.597 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:38.597 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:38.597 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:38.597 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.597 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.597 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:16487 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 2158592~4096,write 2183168~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-09-30T17:03:38.597 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:36.067966+0000", 2023-09-30T17:03:38.597 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 2.448834669, 2023-09-30T17:03:38.597 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.040147479, 2023-09-30T17:03:38.597 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:38.598 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:38.598 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:38.598 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:38.598 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:38.598 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 16487 2023-09-30T17:03:38.598 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.598 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:38.598 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.598 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:38.598 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.067966+0000", 2023-09-30T17:03:38.599 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:38.599 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.599 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.599 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:38.599 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.067966+0000", 2023-09-30T17:03:38.599 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:38.599 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.599 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.599 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:38.599 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.067969+0000", 2023-09-30T17:03:38.599 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.9799999999999998e-06 2023-09-30T17:03:38.599 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.600 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.600 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:38.600 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.067996+0000", 2023-09-30T17:03:38.600 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.6735000000000001e-05 2023-09-30T17:03:38.600 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.600 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.600 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:38.600 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.068007+0000", 2023-09-30T17:03:38.600 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1306e-05 2023-09-30T17:03:38.600 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.600 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.601 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:38.601 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.068015+0000", 2023-09-30T17:03:38.601 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9100000000000005e-06 2023-09-30T17:03:38.601 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.601 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.601 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:38.601 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.068069+0000", 2023-09-30T17:03:38.601 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3690000000000003e-05 2023-09-30T17:03:38.601 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.601 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.601 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:38.601 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.068114+0000", 2023-09-30T17:03:38.601 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5281000000000002e-05 2023-09-30T17:03:38.602 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.602 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.602 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:38.602 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.068390+0000", 2023-09-30T17:03:38.602 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00027580600000000002 2023-09-30T17:03:38.602 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.602 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.602 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:38.602 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.072590+0000", 2023-09-30T17:03:38.602 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0042003889999999997 2023-09-30T17:03:38.602 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.603 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.603 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:38.603 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.108027+0000", 2023-09-30T17:03:38.603 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.035436349999999998 2023-09-30T17:03:38.603 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.603 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.603 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:38.603 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.108080+0000", 2023-09-30T17:03:38.603 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3491e-05 2023-09-30T17:03:38.603 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.603 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.603 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:38.604 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.108114+0000", 2023-09-30T17:03:38.604 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3541000000000003e-05 2023-09-30T17:03:38.604 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:38.604 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:38.604 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:38.604 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.604 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.604 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:16488 4.28 4:153ae410:::100000001f8.0000003b:head [write 4096~4096,write 86016~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-09-30T17:03:38.604 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:36.068328+0000", 2023-09-30T17:03:38.604 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 2.4484733539999999, 2023-09-30T17:03:38.604 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.028605790999999998, 2023-09-30T17:03:38.605 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:38.605 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:38.605 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:38.605 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:38.605 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:38.605 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 16488 2023-09-30T17:03:38.605 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.605 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:38.605 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.605 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:38.605 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.068328+0000", 2023-09-30T17:03:38.606 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:38.606 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.606 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.606 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:38.606 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.068328+0000", 2023-09-30T17:03:38.606 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:38.606 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.606 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.606 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:38.606 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.068328+0000", 2023-09-30T17:03:38.606 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3300000000000002e-07 2023-09-30T17:03:38.606 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.607 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.607 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:38.607 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.068339+0000", 2023-09-30T17:03:38.607 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0684e-05 2023-09-30T17:03:38.607 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.607 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.607 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:38.607 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.068346+0000", 2023-09-30T17:03:38.607 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7279999999999998e-06 2023-09-30T17:03:38.607 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.607 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.608 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:38.608 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.068350+0000", 2023-09-30T17:03:38.608 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8210000000000001e-06 2023-09-30T17:03:38.608 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.608 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.608 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:38.608 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.068458+0000", 2023-09-30T17:03:38.608 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000107229 2023-09-30T17:03:38.608 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.608 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.608 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:38.609 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.068533+0000", 2023-09-30T17:03:38.609 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5532999999999997e-05 2023-09-30T17:03:38.609 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.609 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.609 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:38.609 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.068681+0000", 2023-09-30T17:03:38.609 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014814 2023-09-30T17:03:38.609 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.609 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.609 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:38.609 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.072764+0000", 2023-09-30T17:03:38.610 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0040830529999999997 2023-09-30T17:03:38.610 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.610 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.610 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:38.610 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.096832+0000", 2023-09-30T17:03:38.610 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024068079999999999 2023-09-30T17:03:38.610 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.610 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.610 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:38.610 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.096891+0000", 2023-09-30T17:03:38.610 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.872e-05 2023-09-30T17:03:38.611 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.611 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.611 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:38.611 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.096933+0000", 2023-09-30T17:03:38.611 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2169999999999998e-05 2023-09-30T17:03:38.611 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:38.611 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:38.611 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:38.611 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.611 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.611 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:16492 4.36 4:6da220e6:::100000001f8.0000003f:head [write 258048~4096,write 475136~4096,write 782336~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-09-30T17:03:38.612 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:36.069674+0000", 2023-09-30T17:03:38.612 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 2.4471273299999998, 2023-09-30T17:03:38.612 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.039190028000000002, 2023-09-30T17:03:38.612 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:38.612 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:38.612 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:38.612 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:38.612 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:38.612 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 16492 2023-09-30T17:03:38.612 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.612 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:38.613 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.613 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:38.613 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.069674+0000", 2023-09-30T17:03:38.613 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:38.613 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.613 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.613 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:38.613 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.069674+0000", 2023-09-30T17:03:38.613 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:38.613 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.613 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.613 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:38.613 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.069674+0000", 2023-09-30T17:03:38.614 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0900000000000001e-07 2023-09-30T17:03:38.614 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.614 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.614 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:38.614 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.069687+0000", 2023-09-30T17:03:38.614 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2374e-05 2023-09-30T17:03:38.614 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.614 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.614 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:38.614 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.069694+0000", 2023-09-30T17:03:38.614 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4089999999999997e-06 2023-09-30T17:03:38.614 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.615 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.615 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:38.615 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.069699+0000", 2023-09-30T17:03:38.615 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.921e-06 2023-09-30T17:03:38.615 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.615 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.615 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:38.615 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.069739+0000", 2023-09-30T17:03:38.615 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9595000000000003e-05 2023-09-30T17:03:38.615 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.615 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.615 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:38.616 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.069785+0000", 2023-09-30T17:03:38.616 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6854000000000002e-05 2023-09-30T17:03:38.616 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.616 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.616 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:38.616 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.069872+0000", 2023-09-30T17:03:38.616 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.6614999999999997e-05 2023-09-30T17:03:38.616 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.616 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.616 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:38.616 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.072818+0000", 2023-09-30T17:03:38.616 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.002945619 2023-09-30T17:03:38.617 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.617 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.617 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:38.617 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.108811+0000", 2023-09-30T17:03:38.617 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.035993656999999998 2023-09-30T17:03:38.617 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.617 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.617 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:38.617 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.108843+0000", 2023-09-30T17:03:38.617 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.1853999999999997e-05 2023-09-30T17:03:38.617 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.618 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.618 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:38.618 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.108864+0000", 2023-09-30T17:03:38.618 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.0421e-05 2023-09-30T17:03:38.618 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:38.618 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:38.618 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:38.618 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.618 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.618 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:16495 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 3227648~4096,write 3330048~4096,write 3432448~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-09-30T17:03:38.618 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:36.070550+0000", 2023-09-30T17:03:38.619 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 2.4462513860000001, 2023-09-30T17:03:38.619 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.038434251000000003, 2023-09-30T17:03:38.619 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:38.619 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:38.619 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:38.619 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:38.619 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:38.619 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 16495 2023-09-30T17:03:38.619 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.619 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:38.619 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.619 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:38.620 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.070550+0000", 2023-09-30T17:03:38.620 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:38.620 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.620 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.620 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:38.620 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.070550+0000", 2023-09-30T17:03:38.620 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:38.620 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.620 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.620 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:38.620 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.070550+0000", 2023-09-30T17:03:38.620 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7299999999999996e-07 2023-09-30T17:03:38.621 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.621 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.621 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:38.621 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.070568+0000", 2023-09-30T17:03:38.621 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7459e-05 2023-09-30T17:03:38.621 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.621 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.621 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:38.621 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.070575+0000", 2023-09-30T17:03:38.621 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3590000000000002e-06 2023-09-30T17:03:38.621 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.621 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.622 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:38.622 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.070580+0000", 2023-09-30T17:03:38.622 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7040000000000002e-06 2023-09-30T17:03:38.622 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.622 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.622 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:38.622 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.070613+0000", 2023-09-30T17:03:38.622 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3824e-05 2023-09-30T17:03:38.623 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.623 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.623 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:38.623 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.070661+0000", 2023-09-30T17:03:38.623 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7734000000000001e-05 2023-09-30T17:03:38.623 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.623 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.623 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:38.623 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.070771+0000", 2023-09-30T17:03:38.623 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000110289 2023-09-30T17:03:38.623 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.623 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.624 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:38.624 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.072859+0000", 2023-09-30T17:03:38.624 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0020870250000000002 2023-09-30T17:03:38.624 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.624 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.624 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:38.624 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.108891+0000", 2023-09-30T17:03:38.624 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.036032195000000003 2023-09-30T17:03:38.624 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.624 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.624 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:38.624 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.108951+0000", 2023-09-30T17:03:38.625 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0470999999999998e-05 2023-09-30T17:03:38.625 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.625 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.625 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:38.625 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.108984+0000", 2023-09-30T17:03:38.625 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.2617999999999998e-05 2023-09-30T17:03:38.625 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:38.625 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:38.625 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:38.625 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.625 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.625 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:16496 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 659456~4096,write 720896~4096,write 880640~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-09-30T17:03:38.626 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:36.071012+0000", 2023-09-30T17:03:38.626 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 2.4457887999999999, 2023-09-30T17:03:38.626 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.040533778999999999, 2023-09-30T17:03:38.626 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:38.626 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:38.626 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:38.626 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:38.626 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:38.626 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 16496 2023-09-30T17:03:38.626 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.626 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:38.627 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.627 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:38.627 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.071012+0000", 2023-09-30T17:03:38.627 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:38.627 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.627 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.627 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:38.627 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.071012+0000", 2023-09-30T17:03:38.627 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:38.627 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.627 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.628 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:38.628 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.071013+0000", 2023-09-30T17:03:38.628 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3200000000000005e-07 2023-09-30T17:03:38.628 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.628 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.628 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:38.628 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.071021+0000", 2023-09-30T17:03:38.628 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4079999999999998e-06 2023-09-30T17:03:38.628 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.628 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.628 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:38.628 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.071029+0000", 2023-09-30T17:03:38.629 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9370000000000004e-06 2023-09-30T17:03:38.629 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.629 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.629 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:38.629 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.071033+0000", 2023-09-30T17:03:38.629 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.335e-06 2023-09-30T17:03:38.629 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.629 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.629 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:38.629 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.071069+0000", 2023-09-30T17:03:38.629 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5074999999999999e-05 2023-09-30T17:03:38.630 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.630 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.630 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:38.630 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.071114+0000", 2023-09-30T17:03:38.630 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5871000000000002e-05 2023-09-30T17:03:38.630 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.630 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.630 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:38.630 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.071207+0000", 2023-09-30T17:03:38.630 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2353000000000002e-05 2023-09-30T17:03:38.630 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.631 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.631 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:38.631 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.072907+0000", 2023-09-30T17:03:38.631 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0017000660000000001 2023-09-30T17:03:38.631 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.631 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.631 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:38.631 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.111449+0000", 2023-09-30T17:03:38.631 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.038542659 2023-09-30T17:03:38.631 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.631 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.631 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:38.632 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.111504+0000", 2023-09-30T17:03:38.632 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4574999999999998e-05 2023-09-30T17:03:38.632 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.632 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.632 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:38.632 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.111546+0000", 2023-09-30T17:03:38.632 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1868e-05 2023-09-30T17:03:38.632 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:38.632 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:38.632 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:38.632 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.632 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.633 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:16498 4.36 4:6fa85f86:::100000001f8.00000013:head [write 3375104~4096,write 3457024~4096,write 3592192~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-09-30T17:03:38.633 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:36.071627+0000", 2023-09-30T17:03:38.633 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 2.4451735050000001, 2023-09-30T17:03:38.633 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.039880545000000003, 2023-09-30T17:03:38.633 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:38.633 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:38.633 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:38.633 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:38.633 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:38.633 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 16498 2023-09-30T17:03:38.633 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.633 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:38.634 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.634 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:38.634 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.071627+0000", 2023-09-30T17:03:38.634 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:38.634 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.634 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.634 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:38.634 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.071627+0000", 2023-09-30T17:03:38.634 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:38.634 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.634 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.635 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:38.635 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.071628+0000", 2023-09-30T17:03:38.635 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.4499999999999995e-07 2023-09-30T17:03:38.635 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.635 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.635 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:38.635 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.071659+0000", 2023-09-30T17:03:38.635 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0391000000000001e-05 2023-09-30T17:03:38.635 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.635 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.635 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:38.637 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.071669+0000", 2023-09-30T17:03:38.637 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8500000000000006e-06 2023-09-30T17:03:38.637 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.637 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.638 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:38.638 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.071676+0000", 2023-09-30T17:03:38.638 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0169999999999999e-06 2023-09-30T17:03:38.638 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.638 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.638 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:38.638 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.071724+0000", 2023-09-30T17:03:38.638 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8285000000000003e-05 2023-09-30T17:03:38.638 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.638 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.638 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:38.639 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.071799+0000", 2023-09-30T17:03:38.639 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4999000000000005e-05 2023-09-30T17:03:38.639 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.639 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.639 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:38.639 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.071893+0000", 2023-09-30T17:03:38.639 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.4436000000000002e-05 2023-09-30T17:03:38.639 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.639 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.639 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:38.639 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.073805+0000", 2023-09-30T17:03:38.639 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001911413 2023-09-30T17:03:38.639 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.640 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.640 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:38.640 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.111430+0000", 2023-09-30T17:03:38.640 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.037625088000000001 2023-09-30T17:03:38.640 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.640 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.640 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:38.640 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.111483+0000", 2023-09-30T17:03:38.640 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3418999999999998e-05 2023-09-30T17:03:38.640 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.640 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.641 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:38.641 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.111508+0000", 2023-09-30T17:03:38.641 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4702000000000002e-05 2023-09-30T17:03:38.641 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:38.641 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:38.641 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:38.641 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.641 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.641 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:16510 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 598016~4096,write 630784~4096,write 651264~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-09-30T17:03:38.641 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:36.075530+0000", 2023-09-30T17:03:38.642 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 2.4412711480000002, 2023-09-30T17:03:38.642 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.036168112000000002, 2023-09-30T17:03:38.642 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:38.642 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:38.642 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:38.642 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:38.642 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:38.642 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 16510 2023-09-30T17:03:38.642 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.642 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:38.642 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.643 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:38.643 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.075530+0000", 2023-09-30T17:03:38.643 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:38.643 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.643 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.643 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:38.643 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.075530+0000", 2023-09-30T17:03:38.643 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:38.643 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.643 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.643 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:38.644 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.075531+0000", 2023-09-30T17:03:38.644 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.6300000000000004e-07 2023-09-30T17:03:38.644 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.644 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.644 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:38.644 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.075542+0000", 2023-09-30T17:03:38.644 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1028e-05 2023-09-30T17:03:38.644 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.644 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.644 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:38.645 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.075554+0000", 2023-09-30T17:03:38.645 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1935e-05 2023-09-30T17:03:38.645 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.645 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.645 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:38.645 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.075562+0000", 2023-09-30T17:03:38.645 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8060000000000001e-06 2023-09-30T17:03:38.645 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.645 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.645 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:38.645 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.075629+0000", 2023-09-30T17:03:38.645 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.6619999999999996e-05 2023-09-30T17:03:38.646 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.646 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.646 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:38.646 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.075695+0000", 2023-09-30T17:03:38.646 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5717999999999997e-05 2023-09-30T17:03:38.646 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.646 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.646 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:38.646 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.075790+0000", 2023-09-30T17:03:38.646 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.5228000000000004e-05 2023-09-30T17:03:38.647 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.647 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.647 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:38.647 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.076854+0000", 2023-09-30T17:03:38.647 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001064059 2023-09-30T17:03:38.647 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.647 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.647 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:38.647 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.111590+0000", 2023-09-30T17:03:38.647 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.034735817000000002 2023-09-30T17:03:38.648 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.648 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.648 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:38.648 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.111653+0000", 2023-09-30T17:03:38.648 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2806999999999997e-05 2023-09-30T17:03:38.648 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.648 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.648 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:38.648 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.111698+0000", 2023-09-30T17:03:38.648 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5231000000000001e-05 2023-09-30T17:03:38.648 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:38.649 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:38.649 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:38.649 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.649 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.649 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:16538 4.36 4:6da220e6:::100000001f8.0000003f:head [write 3911680~4096,write 4022272~4096,write 4042752~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-09-30T17:03:38.649 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:36.084169+0000", 2023-09-30T17:03:38.649 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 2.4326322249999999, 2023-09-30T17:03:38.649 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.027427979000000002, 2023-09-30T17:03:38.649 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:38.649 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:38.649 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:38.649 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:38.650 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:38.650 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 16538 2023-09-30T17:03:38.650 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.650 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:38.650 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.650 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:38.650 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.084169+0000", 2023-09-30T17:03:38.650 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:38.650 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.650 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.650 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:38.651 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.084169+0000", 2023-09-30T17:03:38.651 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:38.651 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.651 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.651 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:38.651 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.084170+0000", 2023-09-30T17:03:38.651 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.16e-07 2023-09-30T17:03:38.651 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.651 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.651 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:38.651 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.084199+0000", 2023-09-30T17:03:38.651 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.9019000000000001e-05 2023-09-30T17:03:38.652 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.652 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.652 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:38.652 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.084209+0000", 2023-09-30T17:03:38.652 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0783e-05 2023-09-30T17:03:38.652 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.652 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.652 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:38.652 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.084217+0000", 2023-09-30T17:03:38.652 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6170000000000001e-06 2023-09-30T17:03:38.652 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.653 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.653 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:38.653 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.084278+0000", 2023-09-30T17:03:38.653 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1341999999999996e-05 2023-09-30T17:03:38.653 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.653 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.653 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:38.653 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.084361+0000", 2023-09-30T17:03:38.653 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2695999999999996e-05 2023-09-30T17:03:38.653 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.654 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.654 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:38.654 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.084471+0000", 2023-09-30T17:03:38.654 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000110349 2023-09-30T17:03:38.654 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.654 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.654 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:38.654 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.088847+0000", 2023-09-30T17:03:38.654 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0043758360000000001 2023-09-30T17:03:38.654 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.654 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.655 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:38.655 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.111540+0000", 2023-09-30T17:03:38.655 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.022692912999999999 2023-09-30T17:03:38.655 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.655 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.655 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:38.655 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.111577+0000", 2023-09-30T17:03:38.655 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6890000000000001e-05 2023-09-30T17:03:38.655 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.655 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.655 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:38.655 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.111597+0000", 2023-09-30T17:03:38.656 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9718e-05 2023-09-30T17:03:38.656 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:38.656 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:38.656 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:38.656 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.656 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.656 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:16540 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 856064~4096,write 888832~4096,write 1052672~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-09-30T17:03:38.656 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:36.084727+0000", 2023-09-30T17:03:38.656 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 2.4320738290000001, 2023-09-30T17:03:38.656 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.027108574999999999, 2023-09-30T17:03:38.656 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:38.657 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:38.657 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:38.657 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:38.657 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:38.657 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 16540 2023-09-30T17:03:38.657 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.657 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:38.657 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.657 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:38.657 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.084727+0000", 2023-09-30T17:03:38.657 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:38.657 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.657 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.658 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:38.658 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.084727+0000", 2023-09-30T17:03:38.658 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:38.658 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.658 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.658 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:38.658 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.084728+0000", 2023-09-30T17:03:38.658 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1999999999999998e-07 2023-09-30T17:03:38.658 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.658 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.659 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:38.659 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.084754+0000", 2023-09-30T17:03:38.659 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.5743000000000001e-05 2023-09-30T17:03:38.659 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.659 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.659 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:38.659 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.084765+0000", 2023-09-30T17:03:38.659 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1086e-05 2023-09-30T17:03:38.659 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.659 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.659 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:38.659 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.084772+0000", 2023-09-30T17:03:38.660 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2740000000000002e-06 2023-09-30T17:03:38.660 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.660 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.660 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:38.660 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.084823+0000", 2023-09-30T17:03:38.660 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1149000000000001e-05 2023-09-30T17:03:38.660 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.660 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.660 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:38.660 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.084908+0000", 2023-09-30T17:03:38.660 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4764000000000004e-05 2023-09-30T17:03:38.661 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.661 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.661 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:38.661 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.085061+0000", 2023-09-30T17:03:38.661 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015339499999999999 2023-09-30T17:03:38.661 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.661 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.661 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:38.661 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.088888+0000", 2023-09-30T17:03:38.661 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0038267489999999999 2023-09-30T17:03:38.661 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.662 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.662 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:38.662 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.111755+0000", 2023-09-30T17:03:38.662 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.022866640000000001 2023-09-30T17:03:38.662 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.662 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.662 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:38.662 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.111800+0000", 2023-09-30T17:03:38.662 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5405999999999999e-05 2023-09-30T17:03:38.662 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.662 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.662 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:38.663 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.111836+0000", 2023-09-30T17:03:38.663 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5549000000000001e-05 2023-09-30T17:03:38.663 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:38.663 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:38.663 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:38.663 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.663 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.663 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:16541 4.6 4:63e80496:::100000001f8.0000001e:head [write 3166208~4096,write 3186688~4096,write 3194880~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e40)", 2023-09-30T17:03:38.663 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:36.085240+0000", 2023-09-30T17:03:38.663 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 2.4315610310000002, 2023-09-30T17:03:38.664 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.026594877999999999, 2023-09-30T17:03:38.664 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:38.664 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:38.664 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:38.664 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:38.664 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:38.664 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 16541 2023-09-30T17:03:38.664 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.664 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:38.664 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.664 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:38.664 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.085240+0000", 2023-09-30T17:03:38.665 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:38.665 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.665 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.665 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:38.665 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.085240+0000", 2023-09-30T17:03:38.665 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:38.665 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.665 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.665 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:38.665 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.085241+0000", 2023-09-30T17:03:38.665 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8899999999999998e-07 2023-09-30T17:03:38.665 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.666 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.666 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:38.666 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.085258+0000", 2023-09-30T17:03:38.666 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7305000000000001e-05 2023-09-30T17:03:38.666 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.666 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.666 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:38.666 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.085271+0000", 2023-09-30T17:03:38.666 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2683e-05 2023-09-30T17:03:38.666 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.667 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.667 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:38.667 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.085279+0000", 2023-09-30T17:03:38.667 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0420000000000003e-06 2023-09-30T17:03:38.667 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.667 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.667 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:38.667 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.085721+0000", 2023-09-30T17:03:38.667 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00044171899999999998 2023-09-30T17:03:38.667 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.667 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.667 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:38.667 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.085821+0000", 2023-09-30T17:03:38.668 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010001999999999999 2023-09-30T17:03:38.668 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.668 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.668 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:38.668 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.086041+0000", 2023-09-30T17:03:38.668 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00022082100000000001 2023-09-30T17:03:38.668 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.668 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.668 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:38.668 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.088900+0000", 2023-09-30T17:03:38.668 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0028582379999999999 2023-09-30T17:03:38.669 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.669 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.669 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:38.669 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.111755+0000", 2023-09-30T17:03:38.669 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.022855750000000001 2023-09-30T17:03:38.669 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.669 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.669 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:38.669 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.111797+0000", 2023-09-30T17:03:38.669 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1591000000000002e-05 2023-09-30T17:03:38.669 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:38.669 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:38.670 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:38.670 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:36.111835+0000", 2023-09-30T17:03:38.670 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7719999999999998e-05 2023-09-30T17:03:38.670 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:38.670 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:38.670 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:38.670 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:38.670 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:38.670 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:38.672 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:03:38.672 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:38.671+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:38.810 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:38.810 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2023-09-30T17:03:38.810 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.811 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:23704 4.14 e41/17 4:2b28d75f:::100000001f8.00000016:head v 41'381, mlcod=41'379)", 2023-09-30T17:03:38.811 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.711674+0000", 2023-09-30T17:03:38.811 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.098325756, 2023-09-30T17:03:38.811 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.098352105999999995, 2023-09-30T17:03:38.813 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:38.813 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:38.813 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:38.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.813 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:38.813 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.711674+0000", 2023-09-30T17:03:38.813 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:38.813 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.814 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:38.814 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.711674+0000", 2023-09-30T17:03:38.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:38.814 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.814 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.814 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:38.814 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.711674+0000", 2023-09-30T17:03:38.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2000000000000001e-07 2023-09-30T17:03:38.814 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.814 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.815 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:38.815 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.711685+0000", 2023-09-30T17:03:38.815 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.117e-05 2023-09-30T17:03:38.815 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.815 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.815 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:38.815 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.711691+0000", 2023-09-30T17:03:38.816 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2129999999999996e-06 2023-09-30T17:03:38.816 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.816 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.816 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:38.816 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.711696+0000", 2023-09-30T17:03:38.816 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7339999999999999e-06 2023-09-30T17:03:38.816 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.816 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.816 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:38.816 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713583+0000", 2023-09-30T17:03:38.817 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0018866219999999999 2023-09-30T17:03:38.817 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.817 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.817 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:38.817 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713603+0000", 2023-09-30T17:03:38.817 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0142000000000001e-05 2023-09-30T17:03:38.817 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:38.817 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:38.817 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:38.817 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.817 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.817 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:23708 4.14 e41/17 4:2b28d75f:::100000001f8.00000016:head v 41'382, mlcod=41'379)", 2023-09-30T17:03:38.818 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713552+0000", 2023-09-30T17:03:38.818 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.096446934999999998, 2023-09-30T17:03:38.818 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.096511270999999996, 2023-09-30T17:03:38.818 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:38.818 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:38.818 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:38.818 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.818 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:38.818 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713552+0000", 2023-09-30T17:03:38.818 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:38.818 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.819 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.819 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:38.819 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713552+0000", 2023-09-30T17:03:38.819 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:38.819 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.819 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.819 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:38.819 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713553+0000", 2023-09-30T17:03:38.819 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0999999999999999e-07 2023-09-30T17:03:38.819 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.819 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.820 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:38.820 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713564+0000", 2023-09-30T17:03:38.820 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0851e-05 2023-09-30T17:03:38.820 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.820 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.820 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:38.820 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713570+0000", 2023-09-30T17:03:38.820 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1480000000000003e-06 2023-09-30T17:03:38.820 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.820 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.820 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:38.820 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713574+0000", 2023-09-30T17:03:38.821 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.464e-06 2023-09-30T17:03:38.821 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.821 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.821 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:38.821 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.714408+0000", 2023-09-30T17:03:38.821 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00083399400000000001 2023-09-30T17:03:38.821 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.821 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.821 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:38.821 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.714425+0000", 2023-09-30T17:03:38.821 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7234000000000001e-05 2023-09-30T17:03:38.822 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:38.822 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:38.822 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:38.822 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.822 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.822 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23700 4.30 4:0c89e311:::100000001f8.00000017:head [write 1548288~4096 in=4096b,write 1638400~4096 in=4096b,write 1814528~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:38.822 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713661+0000", 2023-09-30T17:03:38.822 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.096338799000000003, 2023-09-30T17:03:38.822 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.096444547000000005, 2023-09-30T17:03:38.822 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:38.822 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:38.823 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:38.823 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:38.823 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:38.823 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23700 2023-09-30T17:03:38.823 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.823 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:38.823 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.823 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:38.823 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713661+0000", 2023-09-30T17:03:38.824 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:38.824 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.824 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.824 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:38.824 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713661+0000", 2023-09-30T17:03:38.824 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:38.824 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.824 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.824 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:38.824 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713661+0000", 2023-09-30T17:03:38.824 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6000000000000004e-07 2023-09-30T17:03:38.825 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.825 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:38.825 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713669+0000", 2023-09-30T17:03:38.825 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2039999999999997e-06 2023-09-30T17:03:38.825 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.825 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:38.825 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713679+0000", 2023-09-30T17:03:38.825 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5999999999999996e-06 2023-09-30T17:03:38.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.826 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.826 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:38.826 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713683+0000", 2023-09-30T17:03:38.826 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4390000000000002e-06 2023-09-30T17:03:38.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.826 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.826 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:38.826 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713722+0000", 2023-09-30T17:03:38.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8707000000000001e-05 2023-09-30T17:03:38.827 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.827 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.827 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:38.827 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713780+0000", 2023-09-30T17:03:38.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8242000000000002e-05 2023-09-30T17:03:38.827 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:38.827 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:38.827 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:38.827 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.827 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.828 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23703 4.38 4:1d13bf87:::100000001f8.00000030:head [write 839680~4096 in=4096b,write 1101824~4096 in=4096b,write 1155072~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:38.828 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713696+0000", 2023-09-30T17:03:38.828 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.096303719999999995, 2023-09-30T17:03:38.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.096450868999999995, 2023-09-30T17:03:38.828 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:38.828 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:38.828 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:38.828 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:38.828 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:38.829 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23703 2023-09-30T17:03:38.829 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.829 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:38.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.829 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:38.829 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713696+0000", 2023-09-30T17:03:38.829 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:38.829 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.829 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:38.829 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713696+0000", 2023-09-30T17:03:38.829 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:38.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.830 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.830 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:38.830 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713696+0000", 2023-09-30T17:03:38.830 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9500000000000003e-07 2023-09-30T17:03:38.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.830 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.830 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:38.830 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713711+0000", 2023-09-30T17:03:38.830 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5251e-05 2023-09-30T17:03:38.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.831 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.831 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:38.831 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713718+0000", 2023-09-30T17:03:38.831 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9430000000000003e-06 2023-09-30T17:03:38.831 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.831 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.831 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:38.831 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713723+0000", 2023-09-30T17:03:38.831 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4240000000000003e-06 2023-09-30T17:03:38.831 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.831 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.832 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:38.832 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713757+0000", 2023-09-30T17:03:38.832 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4128999999999998e-05 2023-09-30T17:03:38.832 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.832 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.832 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:38.832 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713841+0000", 2023-09-30T17:03:38.832 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3845999999999996e-05 2023-09-30T17:03:38.832 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:38.832 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:38.832 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:38.833 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.833 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.833 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23706 4.f 4:f0d983b2:::100000001f8.0000001f:head [write 1003520~4096 in=4096b,write 1146880~4096 in=4096b,write 1163264~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:38.833 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713730+0000", 2023-09-30T17:03:38.833 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.096269665000000004, 2023-09-30T17:03:38.833 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.096455221999999993, 2023-09-30T17:03:38.833 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:38.833 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:38.833 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:38.833 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:38.833 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:38.834 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23706 2023-09-30T17:03:38.834 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.834 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:38.834 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.834 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:38.834 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713730+0000", 2023-09-30T17:03:38.834 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:38.834 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.834 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.834 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:38.834 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713730+0000", 2023-09-30T17:03:38.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:38.835 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.835 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.835 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:38.835 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713730+0000", 2023-09-30T17:03:38.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0900000000000001e-07 2023-09-30T17:03:38.835 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.835 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.835 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:38.835 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713740+0000", 2023-09-30T17:03:38.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0115999999999999e-05 2023-09-30T17:03:38.836 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.836 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.836 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:38.836 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713747+0000", 2023-09-30T17:03:38.836 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5429999999999999e-06 2023-09-30T17:03:38.836 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.836 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.836 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:38.836 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713752+0000", 2023-09-30T17:03:38.836 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1270000000000002e-06 2023-09-30T17:03:38.836 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.836 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.837 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:38.837 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713788+0000", 2023-09-30T17:03:38.837 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5762000000000001e-05 2023-09-30T17:03:38.837 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.837 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.837 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:38.837 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713835+0000", 2023-09-30T17:03:38.837 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6808000000000003e-05 2023-09-30T17:03:38.837 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.837 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.837 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:38.837 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713962+0000", 2023-09-30T17:03:38.838 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000127315 2023-09-30T17:03:38.838 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:38.838 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:38.838 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:38.838 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.838 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.838 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23707 4.2f 4:f59f865b:::100000001f8.00000007:head [write 3575808~4096 in=4096b,write 3932160~4096 in=4096b,write 4063232~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:38.838 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713764+0000", 2023-09-30T17:03:38.838 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.096235221999999995, 2023-09-30T17:03:38.838 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.096461876000000002, 2023-09-30T17:03:38.838 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:38.839 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:38.839 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:38.839 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:38.839 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:38.839 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23707 2023-09-30T17:03:38.839 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.839 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:38.839 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.839 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:38.839 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713764+0000", 2023-09-30T17:03:38.839 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:38.840 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.840 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.840 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:38.840 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713764+0000", 2023-09-30T17:03:38.840 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:38.840 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.840 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.840 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:38.840 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713765+0000", 2023-09-30T17:03:38.840 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4099999999999999e-07 2023-09-30T17:03:38.840 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.841 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.841 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:38.841 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713775+0000", 2023-09-30T17:03:38.841 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0253e-05 2023-09-30T17:03:38.841 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.841 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.841 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:38.841 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713781+0000", 2023-09-30T17:03:38.841 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1770000000000003e-06 2023-09-30T17:03:38.841 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.841 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.842 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:38.842 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713787+0000", 2023-09-30T17:03:38.842 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.784e-06 2023-09-30T17:03:38.842 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.842 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.842 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:38.842 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713824+0000", 2023-09-30T17:03:38.842 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7258000000000001e-05 2023-09-30T17:03:38.842 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.842 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.843 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:38.843 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713897+0000", 2023-09-30T17:03:38.843 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3255000000000003e-05 2023-09-30T17:03:38.843 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.843 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.843 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:38.843 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.714035+0000", 2023-09-30T17:03:38.843 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013741799999999999 2023-09-30T17:03:38.843 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:38.843 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:38.843 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:38.843 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.844 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.844 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23709 4.37 4:ef395e89:::100000001f8.00000020:head [write 4042752~4096 in=4096b,write 4124672~4096 in=4096b,write 4182016~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:38.844 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713796+0000", 2023-09-30T17:03:38.844 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.096203002999999995, 2023-09-30T17:03:38.844 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.096470613999999996, 2023-09-30T17:03:38.844 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:38.844 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "reached pg", 2023-09-30T17:03:38.844 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:38.844 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:38.844 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:38.844 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23709 2023-09-30T17:03:38.845 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.845 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:38.845 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.845 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:38.845 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713796+0000", 2023-09-30T17:03:38.845 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:38.845 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.845 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.845 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:38.845 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713796+0000", 2023-09-30T17:03:38.845 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:38.845 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.846 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.846 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:38.846 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713797+0000", 2023-09-30T17:03:38.846 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2200000000000004e-07 2023-09-30T17:03:38.846 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.846 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.846 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:38.846 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713807+0000", 2023-09-30T17:03:38.846 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.815e-06 2023-09-30T17:03:38.846 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.846 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.846 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:38.847 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713813+0000", 2023-09-30T17:03:38.847 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5899999999999996e-06 2023-09-30T17:03:38.847 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.847 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.847 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:38.847 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713818+0000", 2023-09-30T17:03:38.847 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2639999999999999e-06 2023-09-30T17:03:38.847 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.847 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.847 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:38.847 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.714818+0000", 2023-09-30T17:03:38.848 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00099973500000000008 2023-09-30T17:03:38.848 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:38.848 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:38.848 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:38.848 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.848 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.848 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23710 4.12 4:4be51a30:::100000001f8.0000000b:head [write 3772416~4096 in=4096b,write 3825664~4096 in=4096b,write 3833856~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:38.848 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713827+0000", 2023-09-30T17:03:38.848 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.096172517999999999, 2023-09-30T17:03:38.848 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.096475439999999996, 2023-09-30T17:03:38.848 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:38.848 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:38.849 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:38.849 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:38.849 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:38.849 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23710 2023-09-30T17:03:38.849 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.849 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:38.849 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.849 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:38.849 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713827+0000", 2023-09-30T17:03:38.849 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:38.849 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.849 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.850 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:38.850 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713827+0000", 2023-09-30T17:03:38.850 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:38.850 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.850 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.850 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:38.850 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713827+0000", 2023-09-30T17:03:38.850 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.51e-07 2023-09-30T17:03:38.850 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.850 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.850 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:38.850 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713837+0000", 2023-09-30T17:03:38.851 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8239999999999995e-06 2023-09-30T17:03:38.851 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.851 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.851 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:38.851 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713843+0000", 2023-09-30T17:03:38.851 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3729999999999998e-06 2023-09-30T17:03:38.851 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.851 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.851 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:38.851 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713849+0000", 2023-09-30T17:03:38.851 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3480000000000003e-06 2023-09-30T17:03:38.852 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.852 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.852 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:38.852 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713896+0000", 2023-09-30T17:03:38.852 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7426999999999998e-05 2023-09-30T17:03:38.852 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.852 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.852 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:38.852 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713969+0000", 2023-09-30T17:03:38.852 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2496000000000005e-05 2023-09-30T17:03:38.852 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.852 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.853 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:38.853 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.714114+0000", 2023-09-30T17:03:38.853 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014550699999999999 2023-09-30T17:03:38.853 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:38.853 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:38.853 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:38.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.853 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.853 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23711 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 270336~4096 in=4096b,write 876544~4096 in=4096b,write 933888~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:38.853 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713868+0000", 2023-09-30T17:03:38.853 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.096131657999999995, 2023-09-30T17:03:38.854 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.096476121999999997, 2023-09-30T17:03:38.854 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:38.854 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:38.854 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:38.854 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:38.854 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:38.854 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23711 2023-09-30T17:03:38.854 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.854 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:38.854 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.854 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:38.854 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713868+0000", 2023-09-30T17:03:38.855 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:38.855 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.855 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.855 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:38.855 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713868+0000", 2023-09-30T17:03:38.855 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:38.855 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.855 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.855 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:38.855 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713868+0000", 2023-09-30T17:03:38.855 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.75e-07 2023-09-30T17:03:38.855 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.856 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.856 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:38.856 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713879+0000", 2023-09-30T17:03:38.856 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0494e-05 2023-09-30T17:03:38.856 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.856 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.856 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:38.856 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713886+0000", 2023-09-30T17:03:38.856 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3159999999999999e-06 2023-09-30T17:03:38.856 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.856 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.856 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:38.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713892+0000", 2023-09-30T17:03:38.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7200000000000003e-06 2023-09-30T17:03:38.857 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.857 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:38.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.714747+0000", 2023-09-30T17:03:38.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00085524699999999995 2023-09-30T17:03:38.857 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.857 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:38.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.714822+0000", 2023-09-30T17:03:38.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5444999999999993e-05 2023-09-30T17:03:38.858 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:38.858 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:38.858 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:38.858 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.858 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.858 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23712 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:38.858 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713901+0000", 2023-09-30T17:03:38.858 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.096098600000000006, 2023-09-30T17:03:38.858 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.096477681999999995, 2023-09-30T17:03:38.858 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:38.858 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:38.859 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:38.859 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:38.859 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:38.859 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23712 2023-09-30T17:03:38.859 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.859 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:38.859 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.859 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:38.859 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713901+0000", 2023-09-30T17:03:38.859 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:38.859 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.860 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.860 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:38.860 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713901+0000", 2023-09-30T17:03:38.860 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:38.860 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.860 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.860 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:38.860 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713901+0000", 2023-09-30T17:03:38.860 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.96e-07 2023-09-30T17:03:38.860 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.860 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.860 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:38.861 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713912+0000", 2023-09-30T17:03:38.861 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0543999999999999e-05 2023-09-30T17:03:38.861 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.861 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.861 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:38.861 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713918+0000", 2023-09-30T17:03:38.861 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4420000000000003e-06 2023-09-30T17:03:38.861 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:38.861 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:38.861 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:38.861 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713923+0000", 2023-09-30T17:03:38.862 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3059999999999997e-06 2023-09-30T17:03:38.862 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:38.862 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:38.862 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:38.862 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:38.862 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2023-09-30T17:03:38.862 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 10 2023-09-30T17:03:38.862 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:38.864 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:03:38.873 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:38.873+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:38.922 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:38.772+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:38.975 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:38.974+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:39.077 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:39.076+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:39.109 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:39.110 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:03:39.110 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2023-09-30T17:03:39.110 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2023-09-30T17:03:39.110 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:39.126 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:03:39.211 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:39.210+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:39.278 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:39.278+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:39.364 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:39.364 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2023-09-30T17:03:39.364 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2023-09-30T17:03:39.364 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2023-09-30T17:03:39.364 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.364 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:23704 4.14 e41/17 4:2b28d75f:::100000001f8.00000016:head v 41'381, mlcod=41'379)", 2023-09-30T17:03:39.365 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.711674+0000", 2023-09-30T17:03:39.365 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.65021444399999995, 2023-09-30T17:03:39.365 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.225773745, 2023-09-30T17:03:39.365 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:39.365 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:39.365 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:39.365 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.365 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:39.365 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.711674+0000", 2023-09-30T17:03:39.365 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:39.365 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.366 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.366 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:39.366 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.711674+0000", 2023-09-30T17:03:39.366 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:39.366 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.366 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.366 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:39.366 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.711674+0000", 2023-09-30T17:03:39.366 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2000000000000001e-07 2023-09-30T17:03:39.366 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.366 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.367 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:39.367 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.711685+0000", 2023-09-30T17:03:39.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.117e-05 2023-09-30T17:03:39.367 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.367 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:39.367 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.711691+0000", 2023-09-30T17:03:39.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2129999999999996e-06 2023-09-30T17:03:39.367 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.367 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:39.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.711696+0000", 2023-09-30T17:03:39.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7339999999999999e-06 2023-09-30T17:03:39.368 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:39.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713583+0000", 2023-09-30T17:03:39.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0018866219999999999 2023-09-30T17:03:39.368 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:39.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713603+0000", 2023-09-30T17:03:39.369 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0142000000000001e-05 2023-09-30T17:03:39.369 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.369 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.369 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:39.369 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.937407+0000", 2023-09-30T17:03:39.369 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.223804165 2023-09-30T17:03:39.369 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.369 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.369 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:39.369 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.937447+0000", 2023-09-30T17:03:39.369 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0479000000000003e-05 2023-09-30T17:03:39.369 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:39.370 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:39.370 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:39.370 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.370 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.370 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:23708 4.14 e41/17 4:2b28d75f:::100000001f8.00000016:head v 41'382, mlcod=41'379)", 2023-09-30T17:03:39.370 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713552+0000", 2023-09-30T17:03:39.370 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.64833562300000003, 2023-09-30T17:03:39.370 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.22392661999999999, 2023-09-30T17:03:39.370 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:39.370 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:39.370 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:39.370 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.371 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:39.371 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713552+0000", 2023-09-30T17:03:39.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:39.371 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.371 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:39.371 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713552+0000", 2023-09-30T17:03:39.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:39.371 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.371 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:39.371 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713553+0000", 2023-09-30T17:03:39.372 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0999999999999999e-07 2023-09-30T17:03:39.372 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.372 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.372 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:39.372 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713564+0000", 2023-09-30T17:03:39.372 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0851e-05 2023-09-30T17:03:39.372 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.372 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.372 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:39.372 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713570+0000", 2023-09-30T17:03:39.372 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1480000000000003e-06 2023-09-30T17:03:39.372 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.373 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.373 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:39.373 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713574+0000", 2023-09-30T17:03:39.373 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.464e-06 2023-09-30T17:03:39.373 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.373 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.373 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:39.373 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.714408+0000", 2023-09-30T17:03:39.373 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00083399400000000001 2023-09-30T17:03:39.373 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.373 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.373 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:39.374 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.714425+0000", 2023-09-30T17:03:39.374 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7234000000000001e-05 2023-09-30T17:03:39.374 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.374 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.374 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:39.374 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.937451+0000", 2023-09-30T17:03:39.374 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.22302575899999999 2023-09-30T17:03:39.374 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.374 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.374 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:39.374 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.937479+0000", 2023-09-30T17:03:39.374 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7759999999999998e-05 2023-09-30T17:03:39.375 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:39.375 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:39.375 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:39.375 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.375 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.375 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23700 4.30 4:0c89e311:::100000001f8.00000017:head [write 1548288~4096 in=4096b,write 1638400~4096 in=4096b,write 1814528~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:39.375 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713661+0000", 2023-09-30T17:03:39.375 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.64822748699999999, 2023-09-30T17:03:39.375 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.21981082900000001, 2023-09-30T17:03:39.375 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:39.375 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:39.376 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:39.376 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:39.376 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:39.376 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23700 2023-09-30T17:03:39.376 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.376 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:39.376 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.376 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:39.376 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713661+0000", 2023-09-30T17:03:39.376 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:39.376 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.376 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.376 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:39.377 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713661+0000", 2023-09-30T17:03:39.377 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:39.377 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.377 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.377 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:39.377 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713661+0000", 2023-09-30T17:03:39.377 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6000000000000004e-07 2023-09-30T17:03:39.377 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.377 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.377 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:39.377 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713669+0000", 2023-09-30T17:03:39.377 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2039999999999997e-06 2023-09-30T17:03:39.378 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.378 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.378 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:39.378 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713679+0000", 2023-09-30T17:03:39.378 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5999999999999996e-06 2023-09-30T17:03:39.378 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.378 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.378 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:39.378 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713683+0000", 2023-09-30T17:03:39.378 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4390000000000002e-06 2023-09-30T17:03:39.378 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.378 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.379 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:39.379 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713722+0000", 2023-09-30T17:03:39.379 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8707000000000001e-05 2023-09-30T17:03:39.379 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.379 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.379 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:39.379 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713780+0000", 2023-09-30T17:03:39.379 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8242000000000002e-05 2023-09-30T17:03:39.379 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.379 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.379 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:39.379 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.933335+0000", 2023-09-30T17:03:39.380 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.21955456500000001 2023-09-30T17:03:39.380 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.380 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.380 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:39.380 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.933388+0000", 2023-09-30T17:03:39.380 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2843999999999998e-05 2023-09-30T17:03:39.380 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.380 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.380 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:39.380 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.933471+0000", 2023-09-30T17:03:39.380 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3667999999999999e-05 2023-09-30T17:03:39.380 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:39.381 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:39.381 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:39.381 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.381 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.381 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23703 4.38 4:1d13bf87:::100000001f8.00000030:head [write 839680~4096 in=4096b,write 1101824~4096 in=4096b,write 1155072~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:39.381 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713696+0000", 2023-09-30T17:03:39.381 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.648192408, 2023-09-30T17:03:39.381 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.23500357699999999, 2023-09-30T17:03:39.381 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:39.381 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:39.381 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:39.382 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:39.382 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:39.382 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23703 2023-09-30T17:03:39.382 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.382 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:39.382 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.382 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:39.382 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713696+0000", 2023-09-30T17:03:39.382 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:39.382 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.382 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.383 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:39.383 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713696+0000", 2023-09-30T17:03:39.383 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:39.383 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.383 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.383 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:39.383 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713696+0000", 2023-09-30T17:03:39.383 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9500000000000003e-07 2023-09-30T17:03:39.383 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.383 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.383 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:39.383 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713711+0000", 2023-09-30T17:03:39.384 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5251e-05 2023-09-30T17:03:39.384 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.384 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.384 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:39.384 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713718+0000", 2023-09-30T17:03:39.384 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9430000000000003e-06 2023-09-30T17:03:39.384 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.384 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.384 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:39.384 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713723+0000", 2023-09-30T17:03:39.384 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4240000000000003e-06 2023-09-30T17:03:39.384 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.385 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.385 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:39.385 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713757+0000", 2023-09-30T17:03:39.385 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4128999999999998e-05 2023-09-30T17:03:39.385 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.385 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.385 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:39.385 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713841+0000", 2023-09-30T17:03:39.385 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3845999999999996e-05 2023-09-30T17:03:39.385 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.385 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.385 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:39.386 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.948561+0000", 2023-09-30T17:03:39.386 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.234720286 2023-09-30T17:03:39.386 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.386 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.386 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:39.386 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.948624+0000", 2023-09-30T17:03:39.386 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2961999999999998e-05 2023-09-30T17:03:39.386 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.386 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.386 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:39.386 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.948699+0000", 2023-09-30T17:03:39.387 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5240999999999993e-05 2023-09-30T17:03:39.387 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:39.387 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:39.387 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:39.387 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.387 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.387 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23706 4.f 4:f0d983b2:::100000001f8.0000001f:head [write 1003520~4096 in=4096b,write 1146880~4096 in=4096b,write 1163264~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:39.387 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713730+0000", 2023-09-30T17:03:39.387 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.64815835300000002, 2023-09-30T17:03:39.387 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.22546488100000001, 2023-09-30T17:03:39.387 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:39.388 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:39.388 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:39.388 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:39.388 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:39.388 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23706 2023-09-30T17:03:39.388 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.388 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:39.388 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.388 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:39.388 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713730+0000", 2023-09-30T17:03:39.388 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:39.389 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.389 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.389 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:39.389 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713730+0000", 2023-09-30T17:03:39.389 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:39.389 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.389 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.389 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:39.389 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713730+0000", 2023-09-30T17:03:39.389 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0900000000000001e-07 2023-09-30T17:03:39.389 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.389 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.390 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:39.390 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713740+0000", 2023-09-30T17:03:39.390 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0115999999999999e-05 2023-09-30T17:03:39.390 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.390 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.390 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:39.390 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713747+0000", 2023-09-30T17:03:39.390 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5429999999999999e-06 2023-09-30T17:03:39.390 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.390 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.390 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:39.390 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713752+0000", 2023-09-30T17:03:39.391 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1270000000000002e-06 2023-09-30T17:03:39.391 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.391 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.391 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:39.391 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713788+0000", 2023-09-30T17:03:39.391 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5762000000000001e-05 2023-09-30T17:03:39.391 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.391 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.391 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:39.391 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713835+0000", 2023-09-30T17:03:39.391 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6808000000000003e-05 2023-09-30T17:03:39.392 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.392 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.392 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:39.392 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713962+0000", 2023-09-30T17:03:39.392 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000127315 2023-09-30T17:03:39.392 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.392 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.392 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:39.392 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.923977+0000", 2023-09-30T17:03:39.392 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.21001473100000001 2023-09-30T17:03:39.392 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.392 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.393 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:39.393 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939118+0000", 2023-09-30T17:03:39.393 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015141297999999999 2023-09-30T17:03:39.393 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.393 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.393 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:39.393 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939161+0000", 2023-09-30T17:03:39.393 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3458999999999998e-05 2023-09-30T17:03:39.393 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.393 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.393 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:39.394 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939195+0000", 2023-09-30T17:03:39.394 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3113e-05 2023-09-30T17:03:39.394 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:39.394 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:39.394 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:39.394 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.394 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.394 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23707 4.2f 4:f59f865b:::100000001f8.00000007:head [write 3575808~4096 in=4096b,write 3932160~4096 in=4096b,write 4063232~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:39.394 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713764+0000", 2023-09-30T17:03:39.394 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.64812391000000003, 2023-09-30T17:03:39.394 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.225343612, 2023-09-30T17:03:39.395 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:39.395 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:39.395 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:39.395 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:39.395 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:39.395 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23707 2023-09-30T17:03:39.395 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.395 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:39.395 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.395 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:39.396 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713764+0000", 2023-09-30T17:03:39.396 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:39.396 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.396 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.396 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:39.396 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713764+0000", 2023-09-30T17:03:39.396 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:39.396 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.396 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.396 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:39.396 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713765+0000", 2023-09-30T17:03:39.396 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4099999999999999e-07 2023-09-30T17:03:39.397 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.397 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.397 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:39.397 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713775+0000", 2023-09-30T17:03:39.397 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0253e-05 2023-09-30T17:03:39.397 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.397 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.397 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:39.397 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713781+0000", 2023-09-30T17:03:39.397 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1770000000000003e-06 2023-09-30T17:03:39.397 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.398 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.398 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:39.398 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713787+0000", 2023-09-30T17:03:39.398 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.784e-06 2023-09-30T17:03:39.398 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.398 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.398 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:39.398 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713824+0000", 2023-09-30T17:03:39.398 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7258000000000001e-05 2023-09-30T17:03:39.398 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.398 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.399 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:39.399 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713897+0000", 2023-09-30T17:03:39.399 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3255000000000003e-05 2023-09-30T17:03:39.399 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.399 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.399 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:39.399 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.714035+0000", 2023-09-30T17:03:39.399 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013741799999999999 2023-09-30T17:03:39.399 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.399 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.399 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:39.399 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.924017+0000", 2023-09-30T17:03:39.400 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.20998277000000001 2023-09-30T17:03:39.400 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.400 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.400 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:39.400 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939013+0000", 2023-09-30T17:03:39.400 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014995432 2023-09-30T17:03:39.400 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.400 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.400 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:39.400 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939064+0000", 2023-09-30T17:03:39.400 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0784e-05 2023-09-30T17:03:39.401 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.401 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.401 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:39.401 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939108+0000", 2023-09-30T17:03:39.401 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4039999999999998e-05 2023-09-30T17:03:39.401 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:39.401 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:39.401 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:39.401 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.401 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.401 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23709 4.37 4:ef395e89:::100000001f8.00000020:head [write 4042752~4096 in=4096b,write 4124672~4096 in=4096b,write 4182016~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:39.402 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713796+0000", 2023-09-30T17:03:39.402 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.64809169099999997, 2023-09-30T17:03:39.402 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.23291700700000001, 2023-09-30T17:03:39.402 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:39.402 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:39.403 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:39.403 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:39.403 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:39.403 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23709 2023-09-30T17:03:39.403 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.403 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:39.404 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.404 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:39.404 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713796+0000", 2023-09-30T17:03:39.404 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:39.404 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.404 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.404 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:39.404 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713796+0000", 2023-09-30T17:03:39.404 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:39.404 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.404 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.404 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:39.405 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713797+0000", 2023-09-30T17:03:39.405 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2200000000000004e-07 2023-09-30T17:03:39.405 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.405 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.405 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:39.405 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713807+0000", 2023-09-30T17:03:39.405 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.815e-06 2023-09-30T17:03:39.405 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.405 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.405 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:39.405 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713813+0000", 2023-09-30T17:03:39.406 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5899999999999996e-06 2023-09-30T17:03:39.406 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.406 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.406 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:39.406 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713818+0000", 2023-09-30T17:03:39.406 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2639999999999999e-06 2023-09-30T17:03:39.406 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.406 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.406 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:39.406 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.714818+0000", 2023-09-30T17:03:39.406 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00099973500000000008 2023-09-30T17:03:39.406 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.407 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.407 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:39.407 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.921155+0000", 2023-09-30T17:03:39.407 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.206336778 2023-09-30T17:03:39.407 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.407 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.407 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:39.407 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.921347+0000", 2023-09-30T17:03:39.407 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000191917 2023-09-30T17:03:39.407 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.407 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.408 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:39.408 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.944206+0000", 2023-09-30T17:03:39.408 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022859349000000001 2023-09-30T17:03:39.408 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.408 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.408 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:39.408 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.946622+0000", 2023-09-30T17:03:39.408 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0024161849999999999 2023-09-30T17:03:39.408 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.408 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.408 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:39.408 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.946673+0000", 2023-09-30T17:03:39.409 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0670000000000001e-05 2023-09-30T17:03:39.409 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.409 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.409 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:39.409 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.946713+0000", 2023-09-30T17:03:39.409 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0182000000000003e-05 2023-09-30T17:03:39.409 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:39.409 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:39.409 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:39.409 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.409 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.410 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23710 4.12 4:4be51a30:::100000001f8.0000000b:head [write 3772416~4096 in=4096b,write 3825664~4096 in=4096b,write 3833856~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:39.410 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713827+0000", 2023-09-30T17:03:39.410 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.64806120599999995, 2023-09-30T17:03:39.410 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.214817016, 2023-09-30T17:03:39.410 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:39.410 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:39.410 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:39.410 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:39.410 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:39.410 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23710 2023-09-30T17:03:39.410 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.411 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:39.411 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.411 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:39.411 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713827+0000", 2023-09-30T17:03:39.411 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:39.411 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.411 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.411 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:39.411 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713827+0000", 2023-09-30T17:03:39.411 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:39.411 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.411 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.412 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:39.412 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713827+0000", 2023-09-30T17:03:39.412 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.51e-07 2023-09-30T17:03:39.412 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.412 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.412 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:39.412 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713837+0000", 2023-09-30T17:03:39.412 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8239999999999995e-06 2023-09-30T17:03:39.412 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.412 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.412 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:39.412 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713843+0000", 2023-09-30T17:03:39.413 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3729999999999998e-06 2023-09-30T17:03:39.413 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.413 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.413 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:39.413 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713849+0000", 2023-09-30T17:03:39.413 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3480000000000003e-06 2023-09-30T17:03:39.413 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.413 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.413 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:39.413 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713896+0000", 2023-09-30T17:03:39.413 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7426999999999998e-05 2023-09-30T17:03:39.414 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.414 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.414 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:39.414 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713969+0000", 2023-09-30T17:03:39.414 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2496000000000005e-05 2023-09-30T17:03:39.414 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.414 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.414 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:39.414 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.714114+0000", 2023-09-30T17:03:39.414 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014550699999999999 2023-09-30T17:03:39.414 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.415 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.415 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:39.415 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.922604+0000", 2023-09-30T17:03:39.415 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.20848978900000001 2023-09-30T17:03:39.415 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.415 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.415 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:39.415 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.928219+0000", 2023-09-30T17:03:39.415 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056147159999999996 2023-09-30T17:03:39.415 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.415 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.415 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:39.416 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.928268+0000", 2023-09-30T17:03:39.416 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9353e-05 2023-09-30T17:03:39.416 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.416 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.416 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:39.416 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.928644+0000", 2023-09-30T17:03:39.416 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00037573199999999999 2023-09-30T17:03:39.416 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:39.416 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:39.416 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:39.416 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.416 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.416 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23711 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 270336~4096 in=4096b,write 876544~4096 in=4096b,write 933888~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:39.417 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713868+0000", 2023-09-30T17:03:39.417 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.64802034600000002, 2023-09-30T17:03:39.417 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.234682211, 2023-09-30T17:03:39.417 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:39.417 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:39.417 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:39.417 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:39.417 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:39.417 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23711 2023-09-30T17:03:39.417 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.417 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:39.417 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.418 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:39.418 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713868+0000", 2023-09-30T17:03:39.418 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:39.418 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.418 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.418 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:39.418 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713868+0000", 2023-09-30T17:03:39.418 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:39.418 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.418 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.419 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:39.419 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713868+0000", 2023-09-30T17:03:39.419 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.75e-07 2023-09-30T17:03:39.419 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.419 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.419 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:39.419 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713879+0000", 2023-09-30T17:03:39.419 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0494e-05 2023-09-30T17:03:39.419 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.419 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.419 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:39.419 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713886+0000", 2023-09-30T17:03:39.419 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3159999999999999e-06 2023-09-30T17:03:39.420 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.420 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.420 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:39.421 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713892+0000", 2023-09-30T17:03:39.421 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7200000000000003e-06 2023-09-30T17:03:39.421 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.421 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.421 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:39.421 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.714747+0000", 2023-09-30T17:03:39.421 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00085524699999999995 2023-09-30T17:03:39.421 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.421 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.421 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:39.421 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.714822+0000", 2023-09-30T17:03:39.422 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5444999999999993e-05 2023-09-30T17:03:39.422 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.422 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.422 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:39.422 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.947884+0000", 2023-09-30T17:03:39.422 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.233061449 2023-09-30T17:03:39.422 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.422 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.422 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:39.422 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.947942+0000", 2023-09-30T17:03:39.422 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7649999999999999e-05 2023-09-30T17:03:39.423 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.423 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.423 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:39.423 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.948550+0000", 2023-09-30T17:03:39.423 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00060831500000000001 2023-09-30T17:03:39.423 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:39.423 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:39.423 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:39.423 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.423 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.423 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23712 4.37 4:eff9002a:::100000001f8.00000003:head [write 3387392~8192,write 3452928~4096,write 3710976~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:39.423 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713901+0000", 2023-09-30T17:03:39.424 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.64798728800000005, 2023-09-30T17:03:39.424 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.25525220700000001, 2023-09-30T17:03:39.424 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:39.424 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:39.424 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:39.424 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:39.424 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:39.424 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23712 2023-09-30T17:03:39.424 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.424 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:39.424 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.424 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:39.425 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713901+0000", 2023-09-30T17:03:39.425 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:39.425 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.425 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.425 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:39.425 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713901+0000", 2023-09-30T17:03:39.425 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:39.425 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.425 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.425 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:39.425 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713901+0000", 2023-09-30T17:03:39.425 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.96e-07 2023-09-30T17:03:39.426 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.426 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.426 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:39.426 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713912+0000", 2023-09-30T17:03:39.426 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0543999999999999e-05 2023-09-30T17:03:39.426 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.426 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.426 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:39.426 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713918+0000", 2023-09-30T17:03:39.426 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4420000000000003e-06 2023-09-30T17:03:39.426 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.427 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.427 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:39.427 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713923+0000", 2023-09-30T17:03:39.427 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3059999999999997e-06 2023-09-30T17:03:39.427 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.427 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.427 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:39.427 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.946744+0000", 2023-09-30T17:03:39.427 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.23282061100000001 2023-09-30T17:03:39.427 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.427 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.427 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:39.428 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.946818+0000", 2023-09-30T17:03:39.428 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3762000000000003e-05 2023-09-30T17:03:39.428 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.428 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.428 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:39.428 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.946949+0000", 2023-09-30T17:03:39.428 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013133900000000001 2023-09-30T17:03:39.428 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.428 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.428 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:39.428 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.951383+0000", 2023-09-30T17:03:39.428 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0044336999999999996 2023-09-30T17:03:39.429 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.429 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.429 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:39.429 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.969076+0000", 2023-09-30T17:03:39.429 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017693303000000001 2023-09-30T17:03:39.429 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.429 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.429 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:39.429 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.969119+0000", 2023-09-30T17:03:39.429 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3208999999999999e-05 2023-09-30T17:03:39.429 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.430 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.430 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:39.430 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.969153+0000", 2023-09-30T17:03:39.430 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3594999999999999e-05 2023-09-30T17:03:39.430 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:39.430 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:39.430 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:39.430 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.430 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.430 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:23713 4.33 e41/17 4:cf6d7a6c:::100000001f8.0000000a:head v 41'399, mlcod=41'397)", 2023-09-30T17:03:39.430 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.715224+0000", 2023-09-30T17:03:39.430 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.64666400800000001, 2023-09-30T17:03:39.431 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.230022326, 2023-09-30T17:03:39.431 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:39.431 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:39.431 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:39.431 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.431 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:39.431 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.715224+0000", 2023-09-30T17:03:39.431 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:39.431 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.431 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.431 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:39.432 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.715224+0000", 2023-09-30T17:03:39.432 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:39.432 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.432 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.432 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:39.432 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.715228+0000", 2023-09-30T17:03:39.432 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4220000000000002e-06 2023-09-30T17:03:39.432 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.432 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.432 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:39.432 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.715239+0000", 2023-09-30T17:03:39.432 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0261999999999999e-05 2023-09-30T17:03:39.433 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.433 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.433 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:39.433 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.921195+0000", 2023-09-30T17:03:39.433 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.205955902 2023-09-30T17:03:39.433 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.433 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.433 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:39.433 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.921210+0000", 2023-09-30T17:03:39.433 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5109999999999999e-05 2023-09-30T17:03:39.434 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.434 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.434 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:39.434 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.921430+0000", 2023-09-30T17:03:39.434 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022019300000000001 2023-09-30T17:03:39.434 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.434 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.434 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:39.434 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.921454+0000", 2023-09-30T17:03:39.434 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4142e-05 2023-09-30T17:03:39.434 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.435 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.435 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:39.435 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.945208+0000", 2023-09-30T17:03:39.435 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.023753765999999999 2023-09-30T17:03:39.435 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.435 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.435 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:39.435 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.945246+0000", 2023-09-30T17:03:39.435 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8529000000000003e-05 2023-09-30T17:03:39.435 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:39.435 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:39.435 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:39.436 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.436 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.436 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24202 4.38 4:1dcf718c:::100000001f8.00000022:head [write 966656~4096,write 995328~4096,write 1007616~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:39.436 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.938506+0000", 2023-09-30T17:03:39.436 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.42338241900000001, 2023-09-30T17:03:39.436 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.19404896199999999, 2023-09-30T17:03:39.436 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:39.436 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:39.436 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:39.436 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:39.436 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:39.436 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24202 2023-09-30T17:03:39.437 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.437 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:39.437 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.437 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:39.437 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938506+0000", 2023-09-30T17:03:39.437 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:39.437 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.437 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.437 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:39.437 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938506+0000", 2023-09-30T17:03:39.437 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:39.437 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.438 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.438 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:39.438 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938506+0000", 2023-09-30T17:03:39.438 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7899999999999999e-07 2023-09-30T17:03:39.438 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.438 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.438 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:39.438 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938539+0000", 2023-09-30T17:03:39.438 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2839999999999997e-05 2023-09-30T17:03:39.438 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.438 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.439 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:39.439 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938549+0000", 2023-09-30T17:03:39.439 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0202e-05 2023-09-30T17:03:39.439 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.439 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.439 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:39.439 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938554+0000", 2023-09-30T17:03:39.439 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1660000000000002e-06 2023-09-30T17:03:39.439 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.439 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.439 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:39.440 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.107092+0000", 2023-09-30T17:03:39.440 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.168537457 2023-09-30T17:03:39.440 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.440 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.440 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:39.440 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.107174+0000", 2023-09-30T17:03:39.440 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2380999999999996e-05 2023-09-30T17:03:39.440 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.440 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.440 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:39.440 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.132433+0000", 2023-09-30T17:03:39.441 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.025258939000000001 2023-09-30T17:03:39.441 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.441 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.441 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:39.441 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.132483+0000", 2023-09-30T17:03:39.441 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9951000000000003e-05 2023-09-30T17:03:39.441 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.441 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.441 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:39.441 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.132555+0000", 2023-09-30T17:03:39.441 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1647e-05 2023-09-30T17:03:39.442 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:39.442 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:39.442 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:39.442 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.442 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.442 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24207 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 2002944~4096,write 2060288~4096,write 2068480~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:39.442 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.938605+0000", 2023-09-30T17:03:39.442 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.423283152, 2023-09-30T17:03:39.442 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.19406049, 2023-09-30T17:03:39.442 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:39.442 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:39.443 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:39.443 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:39.443 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:39.443 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24207 2023-09-30T17:03:39.443 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.443 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:39.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.443 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:39.443 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938605+0000", 2023-09-30T17:03:39.443 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:39.443 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.444 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:39.444 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938605+0000", 2023-09-30T17:03:39.444 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:39.444 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.444 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.444 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:39.444 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938605+0000", 2023-09-30T17:03:39.444 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2899999999999999e-07 2023-09-30T17:03:39.444 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.444 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.444 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:39.444 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938621+0000", 2023-09-30T17:03:39.444 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5624000000000002e-05 2023-09-30T17:03:39.445 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.445 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.445 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:39.445 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938627+0000", 2023-09-30T17:03:39.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.925e-06 2023-09-30T17:03:39.445 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.445 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.445 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:39.445 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938630+0000", 2023-09-30T17:03:39.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4599999999999999e-06 2023-09-30T17:03:39.445 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.445 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.445 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:39.446 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.110850+0000", 2023-09-30T17:03:39.446 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.17221983699999999 2023-09-30T17:03:39.446 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.446 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.446 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:39.446 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.110930+0000", 2023-09-30T17:03:39.447 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0092999999999994e-05 2023-09-30T17:03:39.447 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.447 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:39.447 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.132561+0000", 2023-09-30T17:03:39.447 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021631371999999999 2023-09-30T17:03:39.447 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.447 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:39.447 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.132604+0000", 2023-09-30T17:03:39.447 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2818999999999998e-05 2023-09-30T17:03:39.447 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.448 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:39.448 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.132665+0000", 2023-09-30T17:03:39.448 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1030999999999999e-05 2023-09-30T17:03:39.448 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:39.448 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:39.448 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:39.448 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.448 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24210 4.30 4:0c89e311:::100000001f8.00000017:head [write 3231744~4096,write 3272704~4096,write 3346432~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:39.448 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.938660+0000", 2023-09-30T17:03:39.448 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.42322808299999998, 2023-09-30T17:03:39.449 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.194937256, 2023-09-30T17:03:39.449 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:39.449 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:39.449 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:39.449 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:39.449 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:39.449 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24210 2023-09-30T17:03:39.449 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.449 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:39.449 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.449 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:39.449 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938660+0000", 2023-09-30T17:03:39.450 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:39.450 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.450 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.450 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:39.450 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938660+0000", 2023-09-30T17:03:39.450 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:39.450 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.450 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.450 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:39.450 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938660+0000", 2023-09-30T17:03:39.450 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5800000000000001e-07 2023-09-30T17:03:39.451 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.451 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.451 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:39.451 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938676+0000", 2023-09-30T17:03:39.451 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5650000000000001e-05 2023-09-30T17:03:39.451 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.451 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.451 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:39.451 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938685+0000", 2023-09-30T17:03:39.451 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9250000000000001e-06 2023-09-30T17:03:39.451 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.451 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.452 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:39.452 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938690+0000", 2023-09-30T17:03:39.452 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8160000000000001e-06 2023-09-30T17:03:39.452 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.452 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.452 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:39.452 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.110993+0000", 2023-09-30T17:03:39.452 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.172303714 2023-09-30T17:03:39.452 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.452 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.452 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:39.452 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.111072+0000", 2023-09-30T17:03:39.453 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8448999999999994e-05 2023-09-30T17:03:39.453 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.453 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.453 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:39.453 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.133463+0000", 2023-09-30T17:03:39.453 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022391297000000001 2023-09-30T17:03:39.453 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.453 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.453 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:39.453 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.133518+0000", 2023-09-30T17:03:39.453 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5278999999999997e-05 2023-09-30T17:03:39.453 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.454 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.454 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:39.454 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.133597+0000", 2023-09-30T17:03:39.454 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8868000000000005e-05 2023-09-30T17:03:39.454 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:39.454 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:39.454 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:39.454 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.454 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.454 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24218 4.30 4:0c89e311:::100000001f8.00000017:head [write 1191936~4096,write 1245184~4096,write 1261568~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:39.454 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.938815+0000", 2023-09-30T17:03:39.455 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.42307280000000003, 2023-09-30T17:03:39.455 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.19788513899999999, 2023-09-30T17:03:39.455 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:39.455 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:39.455 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:39.455 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:39.455 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:39.455 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24218 2023-09-30T17:03:39.455 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.455 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:39.455 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.455 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:39.456 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938815+0000", 2023-09-30T17:03:39.456 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:39.456 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.456 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.456 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:39.456 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938815+0000", 2023-09-30T17:03:39.456 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:39.456 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.456 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.456 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:39.456 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938816+0000", 2023-09-30T17:03:39.456 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8699999999999995e-07 2023-09-30T17:03:39.457 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.457 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.457 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:39.457 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938837+0000", 2023-09-30T17:03:39.457 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1534000000000001e-05 2023-09-30T17:03:39.457 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.457 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.457 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:39.457 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938845+0000", 2023-09-30T17:03:39.457 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7190000000000001e-06 2023-09-30T17:03:39.457 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.457 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.457 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:39.458 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938850+0000", 2023-09-30T17:03:39.458 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1220000000000003e-06 2023-09-30T17:03:39.458 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.458 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.458 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:39.458 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.113486+0000", 2023-09-30T17:03:39.458 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.17463620299999999 2023-09-30T17:03:39.458 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.458 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.458 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:39.458 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.113626+0000", 2023-09-30T17:03:39.458 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013924799999999999 2023-09-30T17:03:39.459 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.459 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.459 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:39.459 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.136575+0000", 2023-09-30T17:03:39.459 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022949701999999999 2023-09-30T17:03:39.459 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.459 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.459 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:39.459 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.136623+0000", 2023-09-30T17:03:39.459 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7808e-05 2023-09-30T17:03:39.459 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.459 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.460 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:39.460 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.136700+0000", 2023-09-30T17:03:39.460 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7316000000000003e-05 2023-09-30T17:03:39.460 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:39.460 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:39.460 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:39.460 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.460 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.460 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24223 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 2449408~4096,write 2936832~4096,write 2973696~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:39.460 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.938922+0000", 2023-09-30T17:03:39.460 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.42296597200000002, 2023-09-30T17:03:39.460 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.19909703600000001, 2023-09-30T17:03:39.461 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:39.461 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:39.461 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:39.461 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:39.461 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:39.461 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24223 2023-09-30T17:03:39.461 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.461 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:39.461 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.461 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:39.461 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938922+0000", 2023-09-30T17:03:39.462 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:39.462 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.462 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.462 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:39.462 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938922+0000", 2023-09-30T17:03:39.462 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:39.462 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.462 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.462 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:39.462 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938922+0000", 2023-09-30T17:03:39.462 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8599999999999999e-07 2023-09-30T17:03:39.462 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.463 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:39.463 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938943+0000", 2023-09-30T17:03:39.463 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0588999999999999e-05 2023-09-30T17:03:39.463 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.463 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:39.463 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938958+0000", 2023-09-30T17:03:39.463 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4915e-05 2023-09-30T17:03:39.463 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.464 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:39.464 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938964+0000", 2023-09-30T17:03:39.464 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8329999999999999e-06 2023-09-30T17:03:39.464 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.464 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.464 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:39.464 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.114879+0000", 2023-09-30T17:03:39.464 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.17591552699999999 2023-09-30T17:03:39.464 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.464 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.464 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:39.464 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.114958+0000", 2023-09-30T17:03:39.465 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8666999999999997e-05 2023-09-30T17:03:39.465 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.465 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.465 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:39.465 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.137905+0000", 2023-09-30T17:03:39.465 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022947381999999999 2023-09-30T17:03:39.465 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.465 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.465 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:39.465 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.137948+0000", 2023-09-30T17:03:39.465 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2851e-05 2023-09-30T17:03:39.466 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.466 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.466 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:39.466 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.138019+0000", 2023-09-30T17:03:39.466 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0885999999999999e-05 2023-09-30T17:03:39.466 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:39.466 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:39.466 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:39.466 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.466 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.466 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24231 4.30 4:0c89e311:::100000001f8.00000017:head [write 3121152~4096,write 3174400~4096,write 3198976~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:39.466 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.939120+0000", 2023-09-30T17:03:39.467 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.42276763299999998, 2023-09-30T17:03:39.467 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.199038715, 2023-09-30T17:03:39.467 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:39.467 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:39.467 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:39.467 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:39.467 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:39.467 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24231 2023-09-30T17:03:39.467 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.467 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:39.467 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.467 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:39.468 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939120+0000", 2023-09-30T17:03:39.468 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:39.468 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.468 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.468 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:39.468 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939120+0000", 2023-09-30T17:03:39.468 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:39.468 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.468 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.468 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:39.469 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939121+0000", 2023-09-30T17:03:39.469 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5799999999999999e-07 2023-09-30T17:03:39.469 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.469 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.469 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:39.469 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939138+0000", 2023-09-30T17:03:39.469 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6742e-05 2023-09-30T17:03:39.469 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.469 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.469 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:39.469 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939145+0000", 2023-09-30T17:03:39.469 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2230000000000001e-06 2023-09-30T17:03:39.470 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.470 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.470 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:39.470 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939155+0000", 2023-09-30T17:03:39.470 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.995e-06 2023-09-30T17:03:39.470 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.470 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.470 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:39.470 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.116318+0000", 2023-09-30T17:03:39.470 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.17716331799999999 2023-09-30T17:03:39.470 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.471 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.471 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:39.471 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.116392+0000", 2023-09-30T17:03:39.471 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3379000000000003e-05 2023-09-30T17:03:39.471 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.471 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.471 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:39.471 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.138027+0000", 2023-09-30T17:03:39.471 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021635318000000001 2023-09-30T17:03:39.471 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.471 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.471 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:39.472 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.138076+0000", 2023-09-30T17:03:39.472 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9055999999999999e-05 2023-09-30T17:03:39.472 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.472 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.472 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:39.472 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.138159+0000", 2023-09-30T17:03:39.472 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3126000000000003e-05 2023-09-30T17:03:39.472 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:39.472 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:39.472 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:39.472 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.472 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.472 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24247 4.30 4:0c89e311:::100000001f8.00000017:head [write 2134016~4096,write 2150400~4096,write 2207744~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:39.473 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.939330+0000", 2023-09-30T17:03:39.473 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.42255794000000002, 2023-09-30T17:03:39.473 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.200392818, 2023-09-30T17:03:39.473 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:39.473 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:39.473 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:39.473 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:39.473 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:39.473 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24247 2023-09-30T17:03:39.473 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.473 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:39.474 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.474 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:39.474 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939330+0000", 2023-09-30T17:03:39.474 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:39.474 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.474 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.474 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:39.474 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939330+0000", 2023-09-30T17:03:39.474 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:39.474 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.474 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.474 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:39.475 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939330+0000", 2023-09-30T17:03:39.475 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7500000000000001e-07 2023-09-30T17:03:39.475 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.475 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.475 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:39.475 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939339+0000", 2023-09-30T17:03:39.475 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6719999999999993e-06 2023-09-30T17:03:39.475 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.475 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.475 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:39.475 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939342+0000", 2023-09-30T17:03:39.475 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4170000000000001e-06 2023-09-30T17:03:39.476 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.476 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.476 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:39.476 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939345+0000", 2023-09-30T17:03:39.476 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7190000000000001e-06 2023-09-30T17:03:39.476 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.476 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.476 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:39.476 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.126008+0000", 2023-09-30T17:03:39.476 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.18666300499999999 2023-09-30T17:03:39.476 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.476 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.477 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:39.477 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.126132+0000", 2023-09-30T17:03:39.477 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012387800000000001 2023-09-30T17:03:39.477 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.477 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.477 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:39.477 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.139635+0000", 2023-09-30T17:03:39.477 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013502739 2023-09-30T17:03:39.477 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.477 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.477 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:39.477 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.139669+0000", 2023-09-30T17:03:39.478 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3810000000000003e-05 2023-09-30T17:03:39.478 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.478 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.478 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:39.478 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.139723+0000", 2023-09-30T17:03:39.478 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4302999999999998e-05 2023-09-30T17:03:39.478 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:39.478 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:39.478 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:39.478 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.478 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.479 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24272 4.38 4:1fc350da:::100000001f8.0000002f:head [write 638976~4096,write 843776~4096,write 864256~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:39.479 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.939523+0000", 2023-09-30T17:03:39.479 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.42236503199999997, 2023-09-30T17:03:39.479 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.19876761700000001, 2023-09-30T17:03:39.479 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:39.479 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:39.479 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:39.479 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:39.479 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:39.479 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24272 2023-09-30T17:03:39.479 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.479 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:39.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.480 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:39.480 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939523+0000", 2023-09-30T17:03:39.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:39.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.480 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:39.480 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939523+0000", 2023-09-30T17:03:39.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:39.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.480 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:39.481 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939523+0000", 2023-09-30T17:03:39.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6199999999999999e-07 2023-09-30T17:03:39.481 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.481 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.481 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:39.481 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939538+0000", 2023-09-30T17:03:39.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5122e-05 2023-09-30T17:03:39.481 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.481 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.481 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:39.481 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939544+0000", 2023-09-30T17:03:39.482 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.327e-06 2023-09-30T17:03:39.482 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.482 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.482 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:39.482 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939549+0000", 2023-09-30T17:03:39.482 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8130000000000003e-06 2023-09-30T17:03:39.482 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.482 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.482 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:39.482 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.123535+0000", 2023-09-30T17:03:39.483 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.18398595700000001 2023-09-30T17:03:39.483 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.483 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.483 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:39.483 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.123962+0000", 2023-09-30T17:03:39.483 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000427136 2023-09-30T17:03:39.483 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.483 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.483 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:39.483 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.138167+0000", 2023-09-30T17:03:39.483 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014205096 2023-09-30T17:03:39.484 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.484 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.484 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:39.484 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.138217+0000", 2023-09-30T17:03:39.484 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0241999999999998e-05 2023-09-30T17:03:39.484 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.484 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.484 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:39.484 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.138291+0000", 2023-09-30T17:03:39.484 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3561999999999998e-05 2023-09-30T17:03:39.484 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:39.484 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:39.485 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:39.485 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.485 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.485 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24277 4.38 4:1fc350da:::100000001f8.0000002f:head [write 1036288~4096,write 1122304~4096,write 1220608~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:39.485 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.939581+0000", 2023-09-30T17:03:39.485 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.42230725800000002, 2023-09-30T17:03:39.485 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.200284616, 2023-09-30T17:03:39.485 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:39.485 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:39.485 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:39.485 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:39.485 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:39.486 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24277 2023-09-30T17:03:39.486 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.486 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:39.486 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.486 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:39.486 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939581+0000", 2023-09-30T17:03:39.486 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:39.486 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.486 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.486 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:39.486 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939581+0000", 2023-09-30T17:03:39.487 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:39.487 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.487 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.487 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:39.487 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939581+0000", 2023-09-30T17:03:39.487 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4499999999999998e-07 2023-09-30T17:03:39.487 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.487 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.487 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:39.487 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939596+0000", 2023-09-30T17:03:39.487 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5007999999999999e-05 2023-09-30T17:03:39.487 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.488 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.488 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:39.488 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939600+0000", 2023-09-30T17:03:39.488 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6859999999999999e-06 2023-09-30T17:03:39.488 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.488 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.488 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:39.488 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939603+0000", 2023-09-30T17:03:39.488 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8700000000000001e-06 2023-09-30T17:03:39.488 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.488 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.488 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:39.489 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.129152+0000", 2023-09-30T17:03:39.489 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.18954922599999999 2023-09-30T17:03:39.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.489 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:39.489 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.129238+0000", 2023-09-30T17:03:39.489 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6446000000000005e-05 2023-09-30T17:03:39.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.489 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:39.489 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.139771+0000", 2023-09-30T17:03:39.489 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010532674000000001 2023-09-30T17:03:39.490 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.490 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.490 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:39.490 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.139819+0000", 2023-09-30T17:03:39.490 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7633999999999998e-05 2023-09-30T17:03:39.490 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:39.490 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:39.490 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:39.490 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.139865+0000", 2023-09-30T17:03:39.490 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6826999999999997e-05 2023-09-30T17:03:39.490 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:39.491 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:39.491 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:39.491 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:39.491 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:39.491 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:39.492 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:39.492+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:39.493 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:03:39.592 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:39.593+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:39.682 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:39.682 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:03:39.682 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.682 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:26461 4.33 4:cf6d7a6c:::100000001f8.0000000a:head [write 3174400~4096 in=4096b,write 3690496~4096 in=4096b,write 3706880~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:39.682 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:39.678743+0000", 2023-09-30T17:03:39.682 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0029769900000000001, 2023-09-30T17:03:39.683 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.003000239, 2023-09-30T17:03:39.683 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:39.683 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:39.683 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:39.683 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:39.683 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:39.683 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 26461 2023-09-30T17:03:39.683 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.683 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:39.683 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.684 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:39.684 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.678743+0000", 2023-09-30T17:03:39.684 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:39.684 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.684 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.684 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:39.684 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.678743+0000", 2023-09-30T17:03:39.684 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:39.684 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.684 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.685 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:39.685 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.678744+0000", 2023-09-30T17:03:39.685 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8100000000000002e-07 2023-09-30T17:03:39.685 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.685 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.685 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:39.685 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.678754+0000", 2023-09-30T17:03:39.685 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8109999999999997e-06 2023-09-30T17:03:39.685 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.685 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.686 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:39.686 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.678762+0000", 2023-09-30T17:03:39.686 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5690000000000005e-06 2023-09-30T17:03:39.686 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.686 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.686 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:39.686 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.678767+0000", 2023-09-30T17:03:39.686 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0150000000000003e-06 2023-09-30T17:03:39.686 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.686 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.687 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:39.687 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.678819+0000", 2023-09-30T17:03:39.687 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1864999999999999e-05 2023-09-30T17:03:39.687 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.687 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.687 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:39.687 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.678910+0000", 2023-09-30T17:03:39.687 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.0906e-05 2023-09-30T17:03:39.687 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.687 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.688 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:39.688 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.679080+0000", 2023-09-30T17:03:39.688 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016971900000000001 2023-09-30T17:03:39.688 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.688 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.688 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:39.688 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.680674+0000", 2023-09-30T17:03:39.688 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0015943629999999999 2023-09-30T17:03:39.688 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:39.688 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:39.689 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:39.689 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.689 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.689 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:26462 4.1c 4:39b842ef:::100000001f8.00000029:head [write 344064~8192 in=8192b,write 466944~4096 in=4096b,write 512000~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:39.689 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:39.679482+0000", 2023-09-30T17:03:39.689 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.002238304, 2023-09-30T17:03:39.689 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.002364087, 2023-09-30T17:03:39.689 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:39.689 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:39.689 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:39.690 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:39.690 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:39.690 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 26462 2023-09-30T17:03:39.690 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.690 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:39.690 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.690 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:39.690 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.679482+0000", 2023-09-30T17:03:39.690 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:39.690 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.691 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.691 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:39.691 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.679482+0000", 2023-09-30T17:03:39.691 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:39.691 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.691 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.691 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:39.691 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.679483+0000", 2023-09-30T17:03:39.691 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.54e-07 2023-09-30T17:03:39.691 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.692 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.692 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:39.692 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.679497+0000", 2023-09-30T17:03:39.692 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3781000000000001e-05 2023-09-30T17:03:39.692 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.692 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.692 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:39.692 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.679508+0000", 2023-09-30T17:03:39.692 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1615e-05 2023-09-30T17:03:39.692 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.693 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.693 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:39.693 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.679516+0000", 2023-09-30T17:03:39.693 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0050000000000004e-06 2023-09-30T17:03:39.693 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.693 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.693 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:39.693 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.679799+0000", 2023-09-30T17:03:39.693 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00028285000000000002 2023-09-30T17:03:39.693 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.694 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.694 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:39.694 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.679847+0000", 2023-09-30T17:03:39.694 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7873000000000001e-05 2023-09-30T17:03:39.694 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.694 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.694 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:39.694 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.679971+0000", 2023-09-30T17:03:39.694 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00012393699999999999 2023-09-30T17:03:39.694 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.695 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.695 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:39.695 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.681461+0000", 2023-09-30T17:03:39.695 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001490388 2023-09-30T17:03:39.695 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:39.695 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:39.695 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:39.695 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.695 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.695 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:26463 4.31 4:8fb8ba0c:::100000001f8.00000024:head [write 651264~4096 in=4096b,write 688128~4096 in=4096b,write 991232~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:39.696 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:39.680732+0000", 2023-09-30T17:03:39.696 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.00098849099999999998, 2023-09-30T17:03:39.696 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0012140930000000001, 2023-09-30T17:03:39.696 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:39.696 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:39.696 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:39.696 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:39.696 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:39.696 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 26463 2023-09-30T17:03:39.696 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.697 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:39.697 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.697 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:39.697 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.680732+0000", 2023-09-30T17:03:39.697 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:39.697 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.697 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.697 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:39.697 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.680732+0000", 2023-09-30T17:03:39.697 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:39.698 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.698 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.698 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:39.698 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.680733+0000", 2023-09-30T17:03:39.698 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4900000000000005e-07 2023-09-30T17:03:39.698 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.698 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.698 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:39.698 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.680744+0000", 2023-09-30T17:03:39.698 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1004e-05 2023-09-30T17:03:39.699 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.699 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.699 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:39.699 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.680753+0000", 2023-09-30T17:03:39.699 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3810000000000005e-06 2023-09-30T17:03:39.699 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.699 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.699 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:39.699 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.680758+0000", 2023-09-30T17:03:39.699 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.395e-06 2023-09-30T17:03:39.700 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.700 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.700 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:39.700 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.680804+0000", 2023-09-30T17:03:39.700 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5364999999999997e-05 2023-09-30T17:03:39.700 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.700 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.700 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:39.700 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.680859+0000", 2023-09-30T17:03:39.700 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4968e-05 2023-09-30T17:03:39.700 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:39.701 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:39.701 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:39.701 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.701 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.701 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:26465 4.28 4:153ae410:::100000001f8.0000003b:head [write 3645440~4096 in=4096b,write 3702784~4096 in=4096b,write 3715072~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:39.701 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:39.681472+0000", 2023-09-30T17:03:39.701 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.00024779100000000003, 2023-09-30T17:03:39.701 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000567247, 2023-09-30T17:03:39.701 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:39.701 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:39.702 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:39.702 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:39.702 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:39.702 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 26465 2023-09-30T17:03:39.702 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.702 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:39.702 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.702 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:39.702 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.681472+0000", 2023-09-30T17:03:39.703 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:39.703 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.703 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.703 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:39.703 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.681472+0000", 2023-09-30T17:03:39.703 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:39.703 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.703 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.703 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:39.703 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.681473+0000", 2023-09-30T17:03:39.704 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5099999999999998e-07 2023-09-30T17:03:39.704 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.704 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.704 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:39.704 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.681485+0000", 2023-09-30T17:03:39.704 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1851999999999999e-05 2023-09-30T17:03:39.704 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.704 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.704 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:39.704 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.681498+0000", 2023-09-30T17:03:39.705 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2578999999999999e-05 2023-09-30T17:03:39.705 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.705 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.705 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:39.705 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.681506+0000", 2023-09-30T17:03:39.705 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9300000000000003e-06 2023-09-30T17:03:39.705 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.705 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.705 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:39.706 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.681568+0000", 2023-09-30T17:03:39.706 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2237999999999996e-05 2023-09-30T17:03:39.706 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.706 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.706 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:39.706 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.681646+0000", 2023-09-30T17:03:39.706 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8079999999999998e-05 2023-09-30T17:03:39.706 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.706 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.706 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:39.707 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.681740+0000", 2023-09-30T17:03:39.707 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3770000000000005e-05 2023-09-30T17:03:39.707 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:39.707 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:39.707 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:39.707 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.707 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.707 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:26466 4.6 4:616d4c41:::100000001f8.00000034:head [write 843776~4096 in=4096b,write 860160~4096 in=4096b,write 1515520~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:39.707 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:39.681717+0000", 2023-09-30T17:03:39.707 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 3.3739999999999998e-06, 2023-09-30T17:03:39.708 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000430803, 2023-09-30T17:03:39.708 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:39.708 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:39.708 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:39.708 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:39.708 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:39.708 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 26466 2023-09-30T17:03:39.708 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.708 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:39.708 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.709 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:39.709 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.681717+0000", 2023-09-30T17:03:39.709 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:39.709 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.709 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.709 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:39.709 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.681717+0000", 2023-09-30T17:03:39.709 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:39.709 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.709 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.710 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:39.710 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.681718+0000", 2023-09-30T17:03:39.710 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.13e-07 2023-09-30T17:03:39.710 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.710 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.710 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:39.710 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.681734+0000", 2023-09-30T17:03:39.710 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6830999999999999e-05 2023-09-30T17:03:39.710 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.711 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.711 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:39.711 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.681742+0000", 2023-09-30T17:03:39.711 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2200000000000003e-06 2023-09-30T17:03:39.711 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.711 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.711 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:39.711 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.681746+0000", 2023-09-30T17:03:39.711 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9089999999999999e-06 2023-09-30T17:03:39.711 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.711 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.712 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:39.712 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.681800+0000", 2023-09-30T17:03:39.712 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3035999999999998e-05 2023-09-30T17:03:39.712 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.712 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.712 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:39.712 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.681891+0000", 2023-09-30T17:03:39.712 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1856999999999998e-05 2023-09-30T17:03:39.712 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.712 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.713 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:39.713 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.682064+0000", 2023-09-30T17:03:39.713 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017267699999999999 2023-09-30T17:03:39.713 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:39.713 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:39.713 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:39.713 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.713 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.713 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:26467 4.6 4.8232b686 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:39.713 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:39.682001+0000", 2023-09-30T17:03:39.714 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.9997196, 2023-09-30T17:03:39.714 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000242704, 2023-09-30T17:03:39.714 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:39.714 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:39.714 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:39.714 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:39.714 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:39.714 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 26467 2023-09-30T17:03:39.714 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.714 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:39.715 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.715 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:39.715 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.682001+0000", 2023-09-30T17:03:39.715 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:39.715 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.715 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.715 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:39.715 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.682001+0000", 2023-09-30T17:03:39.715 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:39.715 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.716 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.716 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:39.716 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.682002+0000", 2023-09-30T17:03:39.716 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1800000000000005e-07 2023-09-30T17:03:39.716 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.716 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.716 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:39.716 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.682010+0000", 2023-09-30T17:03:39.716 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0420000000000003e-06 2023-09-30T17:03:39.716 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.717 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.717 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:39.717 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.682017+0000", 2023-09-30T17:03:39.717 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1709999999999996e-06 2023-09-30T17:03:39.717 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.717 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.717 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:39.717 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.682021+0000", 2023-09-30T17:03:39.717 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.391e-06 2023-09-30T17:03:39.717 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:39.718 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:39.718 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:39.718 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.718 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.718 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:26468 4.13 4.6028f753 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:39.718 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:39.682263+0000", 2023-09-30T17:03:39.718 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.9994578, 2023-09-30T17:03:39.718 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4283000000000003e-05, 2023-09-30T17:03:39.718 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:39.718 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:39.718 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:39.719 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:39.719 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:39.719 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 26468 2023-09-30T17:03:39.719 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.719 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:39.719 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.719 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:39.719 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.682263+0000", 2023-09-30T17:03:39.719 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:39.720 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.720 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.720 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:39.720 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.682263+0000", 2023-09-30T17:03:39.720 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:39.720 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.720 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.720 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:39.720 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.682263+0000", 2023-09-30T17:03:39.720 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1600000000000001e-07 2023-09-30T17:03:39.721 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.721 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.721 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:39.721 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.682271+0000", 2023-09-30T17:03:39.721 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7279999999999995e-06 2023-09-30T17:03:39.721 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.721 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.721 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:39.721 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.682282+0000", 2023-09-30T17:03:39.721 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0992000000000001e-05 2023-09-30T17:03:39.722 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:39.722 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:39.722 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:39.722 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.682289+0000", 2023-09-30T17:03:39.722 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.289e-06 2023-09-30T17:03:39.722 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:39.722 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:39.722 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:39.722 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:39.723 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-09-30T17:03:39.723 INFO:teuthology.orchestra.run.smithi031.stdout: "num_ops": 7 2023-09-30T17:03:39.723 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:39.724 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:03:39.725 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:39.724+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:39.824 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:39.825+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:39.926 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:39.926+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:39.951 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:39.951 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:03:39.951 INFO:teuthology.orchestra.run.smithi031.stdout: "complaint_time": 30, 2023-09-30T17:03:39.951 INFO:teuthology.orchestra.run.smithi031.stdout: "num_blocked_ops": 0 2023-09-30T17:03:39.952 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:39.967 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:03:40.053 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:40.054+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:40.127 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:40.127+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:40.191 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:40.191 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 20, 2023-09-30T17:03:40.191 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 600, 2023-09-30T17:03:40.191 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:03:40.191 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.191 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23704 4.14 4:2b28d75f:::100000001f8.00000016:head [write 262144~4096,write 274432~4096,write 405504~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:40.191 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.711008+0000", 2023-09-30T17:03:40.192 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 1.477839503, 2023-09-30T17:03:40.192 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.229109541, 2023-09-30T17:03:40.192 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:40.192 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:40.192 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:40.192 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:40.192 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:40.192 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23704 2023-09-30T17:03:40.192 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.192 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:40.192 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.193 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:40.193 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711008+0000", 2023-09-30T17:03:40.193 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:40.193 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.193 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.193 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:40.193 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711008+0000", 2023-09-30T17:03:40.193 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:40.193 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.193 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.193 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:40.194 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711009+0000", 2023-09-30T17:03:40.194 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5899999999999995e-07 2023-09-30T17:03:40.194 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.194 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.194 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:40.194 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711042+0000", 2023-09-30T17:03:40.194 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3149999999999999e-05 2023-09-30T17:03:40.194 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.194 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.194 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:40.194 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711054+0000", 2023-09-30T17:03:40.194 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1742999999999999e-05 2023-09-30T17:03:40.195 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.195 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.195 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:40.195 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711059+0000", 2023-09-30T17:03:40.195 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3009999999999997e-06 2023-09-30T17:03:40.195 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.195 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.195 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:40.195 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711120+0000", 2023-09-30T17:03:40.196 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1228000000000004e-05 2023-09-30T17:03:40.196 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.196 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.196 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:40.196 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711205+0000", 2023-09-30T17:03:40.196 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4489999999999999e-05 2023-09-30T17:03:40.196 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.196 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.196 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:40.196 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711371+0000", 2023-09-30T17:03:40.196 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016639500000000001 2023-09-30T17:03:40.196 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.197 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.197 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:40.197 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.716551+0000", 2023-09-30T17:03:40.197 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051799929999999999 2023-09-30T17:03:40.197 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.197 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.197 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:40.197 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.940040+0000", 2023-09-30T17:03:40.197 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22348859800000001 2023-09-30T17:03:40.197 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.197 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.197 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:40.198 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.940080+0000", 2023-09-30T17:03:40.198 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0114999999999998e-05 2023-09-30T17:03:40.198 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.198 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.198 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:40.198 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.940118+0000", 2023-09-30T17:03:40.198 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7768999999999997e-05 2023-09-30T17:03:40.198 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:40.198 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:40.198 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:40.198 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.199 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.199 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23713 4.33 4:cf6d7a6c:::100000001f8.0000000a:head [write 585728~4096,write 925696~4096,write 937984~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:40.199 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.714948+0000", 2023-09-30T17:03:40.199 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 1.4738997890000001, 2023-09-30T17:03:40.199 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23061467099999999, 2023-09-30T17:03:40.199 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:40.199 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:40.199 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:40.199 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:40.199 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:40.199 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23713 2023-09-30T17:03:40.199 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.200 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:40.200 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.200 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:40.200 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.714948+0000", 2023-09-30T17:03:40.200 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:40.200 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.200 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.200 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:40.200 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.714948+0000", 2023-09-30T17:03:40.200 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:40.200 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.200 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.201 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:40.201 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.714949+0000", 2023-09-30T17:03:40.201 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1399999999999995e-07 2023-09-30T17:03:40.201 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.201 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.201 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:40.201 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.714961+0000", 2023-09-30T17:03:40.201 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1916000000000001e-05 2023-09-30T17:03:40.201 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.201 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.201 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:40.201 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.714979+0000", 2023-09-30T17:03:40.202 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8070000000000001e-05 2023-09-30T17:03:40.202 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.202 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.202 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:40.202 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.714987+0000", 2023-09-30T17:03:40.202 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4179999999999997e-06 2023-09-30T17:03:40.202 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.202 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.202 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:40.202 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.715034+0000", 2023-09-30T17:03:40.202 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6563999999999997e-05 2023-09-30T17:03:40.202 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.203 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.203 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:40.203 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.715083+0000", 2023-09-30T17:03:40.203 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9310000000000001e-05 2023-09-30T17:03:40.203 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.203 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.203 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:40.203 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.715177+0000", 2023-09-30T17:03:40.203 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3525999999999999e-05 2023-09-30T17:03:40.203 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.203 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.204 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:40.204 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.719724+0000", 2023-09-30T17:03:40.204 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0045477210000000002 2023-09-30T17:03:40.204 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.204 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.204 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:40.204 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.945467+0000", 2023-09-30T17:03:40.204 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22574224500000001 2023-09-30T17:03:40.204 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.204 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.204 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:40.204 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.945524+0000", 2023-09-30T17:03:40.204 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7105999999999998e-05 2023-09-30T17:03:40.205 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.205 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.205 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:40.205 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.945563+0000", 2023-09-30T17:03:40.205 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8881000000000003e-05 2023-09-30T17:03:40.205 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:40.205 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:40.205 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:40.205 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.205 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.205 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23735 4.6 4:616d4c41:::100000001f8.00000034:head [write 991232~4096,write 1040384~4096,write 1200128~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:40.205 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.722398+0000", 2023-09-30T17:03:40.206 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 1.4664494340000001, 2023-09-30T17:03:40.206 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.230202669, 2023-09-30T17:03:40.206 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:40.206 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:40.206 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:40.206 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:40.206 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:40.206 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23735 2023-09-30T17:03:40.206 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.206 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:40.206 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.207 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:40.207 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722398+0000", 2023-09-30T17:03:40.207 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:40.207 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.207 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.207 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:40.207 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722398+0000", 2023-09-30T17:03:40.207 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:40.207 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.207 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.207 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:40.208 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722399+0000", 2023-09-30T17:03:40.208 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2799999999999996e-07 2023-09-30T17:03:40.208 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.208 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.208 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:40.208 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722423+0000", 2023-09-30T17:03:40.208 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4134e-05 2023-09-30T17:03:40.208 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.208 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.208 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:40.208 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722429+0000", 2023-09-30T17:03:40.209 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4590000000000003e-06 2023-09-30T17:03:40.209 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.209 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.209 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:40.209 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722434+0000", 2023-09-30T17:03:40.209 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1779999999999996e-06 2023-09-30T17:03:40.209 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.209 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.209 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:40.209 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722490+0000", 2023-09-30T17:03:40.209 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6215999999999998e-05 2023-09-30T17:03:40.209 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.210 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.210 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:40.210 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722600+0000", 2023-09-30T17:03:40.210 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00011017 2023-09-30T17:03:40.210 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.210 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.210 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:40.210 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722769+0000", 2023-09-30T17:03:40.210 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0001695 2023-09-30T17:03:40.210 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.210 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.210 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:40.211 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725807+0000", 2023-09-30T17:03:40.211 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0030372120000000001 2023-09-30T17:03:40.211 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.211 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.211 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:40.211 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.952546+0000", 2023-09-30T17:03:40.211 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22673923600000001 2023-09-30T17:03:40.211 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.211 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.211 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:40.211 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.952579+0000", 2023-09-30T17:03:40.211 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3111000000000002e-05 2023-09-30T17:03:40.212 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.212 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.212 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:40.212 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.952601+0000", 2023-09-30T17:03:40.212 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1925000000000001e-05 2023-09-30T17:03:40.212 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:40.212 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:40.212 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:40.212 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.212 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.212 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23738 4.6 4:616d4c41:::100000001f8.00000034:head [write 3043328~4096,write 3055616~4096,write 3080192~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:40.213 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.723439+0000", 2023-09-30T17:03:40.213 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 1.465408461, 2023-09-30T17:03:40.213 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23665340400000001, 2023-09-30T17:03:40.213 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:40.213 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:40.213 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:40.213 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:40.213 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:40.213 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23738 2023-09-30T17:03:40.213 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.213 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:40.213 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.214 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:40.214 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723439+0000", 2023-09-30T17:03:40.214 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:40.214 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.214 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.214 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:40.214 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723439+0000", 2023-09-30T17:03:40.214 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:40.214 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.214 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.214 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:40.215 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723440+0000", 2023-09-30T17:03:40.215 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.23e-07 2023-09-30T17:03:40.215 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.215 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.215 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:40.215 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723452+0000", 2023-09-30T17:03:40.215 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2147000000000001e-05 2023-09-30T17:03:40.215 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.215 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.215 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:40.215 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723461+0000", 2023-09-30T17:03:40.215 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3839999999999997e-06 2023-09-30T17:03:40.216 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.216 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.216 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:40.216 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723465+0000", 2023-09-30T17:03:40.216 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7559999999999999e-06 2023-09-30T17:03:40.216 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.216 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.216 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:40.216 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723924+0000", 2023-09-30T17:03:40.216 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00045910299999999999 2023-09-30T17:03:40.216 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.217 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.217 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:40.217 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723970+0000", 2023-09-30T17:03:40.217 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5126999999999997e-05 2023-09-30T17:03:40.217 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.217 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.218 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:40.218 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724057+0000", 2023-09-30T17:03:40.218 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.7142e-05 2023-09-30T17:03:40.218 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.218 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.218 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:40.218 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.726148+0000", 2023-09-30T17:03:40.218 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.002091449 2023-09-30T17:03:40.218 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.218 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.219 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:40.219 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.960040+0000", 2023-09-30T17:03:40.219 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23389163299999999 2023-09-30T17:03:40.219 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.219 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.219 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:40.219 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.960071+0000", 2023-09-30T17:03:40.219 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.133e-05 2023-09-30T17:03:40.219 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.219 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.219 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:40.219 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.960093+0000", 2023-09-30T17:03:40.220 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1509999999999999e-05 2023-09-30T17:03:40.220 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:40.220 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:40.220 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:40.220 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.220 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.220 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23740 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 3780608~4096,write 3788800~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:40.220 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.723994+0000", 2023-09-30T17:03:40.220 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 1.464853685, 2023-09-30T17:03:40.220 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.234031238, 2023-09-30T17:03:40.220 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:40.220 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:40.221 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:40.221 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:40.221 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:40.221 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23740 2023-09-30T17:03:40.221 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.221 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:40.221 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.221 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:40.221 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723994+0000", 2023-09-30T17:03:40.221 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:40.221 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.222 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.222 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:40.222 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723994+0000", 2023-09-30T17:03:40.222 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:40.222 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.222 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.222 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:40.222 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723995+0000", 2023-09-30T17:03:40.222 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6000000000000003e-07 2023-09-30T17:03:40.222 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.222 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.222 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:40.223 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724004+0000", 2023-09-30T17:03:40.223 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.4909999999999994e-06 2023-09-30T17:03:40.223 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.223 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.223 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:40.223 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724012+0000", 2023-09-30T17:03:40.223 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4590000000000001e-06 2023-09-30T17:03:40.223 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.223 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.223 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:40.223 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724016+0000", 2023-09-30T17:03:40.223 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9890000000000003e-06 2023-09-30T17:03:40.224 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.224 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.224 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:40.224 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724060+0000", 2023-09-30T17:03:40.224 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4339999999999999e-05 2023-09-30T17:03:40.224 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.224 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.224 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:40.224 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724141+0000", 2023-09-30T17:03:40.224 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1384000000000005e-05 2023-09-30T17:03:40.224 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.224 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.225 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:40.225 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724300+0000", 2023-09-30T17:03:40.225 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015870700000000001 2023-09-30T17:03:40.225 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.225 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.225 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:40.225 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.726182+0000", 2023-09-30T17:03:40.225 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0018816060000000001 2023-09-30T17:03:40.225 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.225 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.225 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:40.225 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.957929+0000", 2023-09-30T17:03:40.226 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23174703399999999 2023-09-30T17:03:40.226 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.226 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.226 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:40.226 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.957983+0000", 2023-09-30T17:03:40.226 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4107999999999998e-05 2023-09-30T17:03:40.226 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.226 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.226 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:40.226 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.958025+0000", 2023-09-30T17:03:40.226 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2360000000000001e-05 2023-09-30T17:03:40.227 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:40.227 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:40.227 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:40.227 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.227 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.227 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23746 4.28 4:15eeb89b:::100000001f8.00000032:head [write 3731456~4096,write 3919872~4096,write 3952640~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:40.227 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.725721+0000", 2023-09-30T17:03:40.227 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 1.463126301, 2023-09-30T17:03:40.227 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.24024479800000001, 2023-09-30T17:03:40.227 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:40.227 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:40.228 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:40.228 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:40.228 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:40.228 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23746 2023-09-30T17:03:40.228 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.228 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:40.228 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.228 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:40.228 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725721+0000", 2023-09-30T17:03:40.228 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:40.228 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.228 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.228 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:40.229 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725721+0000", 2023-09-30T17:03:40.229 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:40.229 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.229 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.229 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:40.229 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725722+0000", 2023-09-30T17:03:40.229 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6499999999999999e-07 2023-09-30T17:03:40.229 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.229 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.229 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:40.229 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725732+0000", 2023-09-30T17:03:40.229 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7559999999999994e-06 2023-09-30T17:03:40.230 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.230 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.230 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:40.230 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725738+0000", 2023-09-30T17:03:40.230 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8360000000000003e-06 2023-09-30T17:03:40.230 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.230 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.230 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:40.230 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725746+0000", 2023-09-30T17:03:40.230 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4200000000000001e-06 2023-09-30T17:03:40.230 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.230 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.231 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:40.231 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725805+0000", 2023-09-30T17:03:40.231 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9318999999999999e-05 2023-09-30T17:03:40.231 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.231 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.231 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:40.231 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725904+0000", 2023-09-30T17:03:40.231 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8747999999999997e-05 2023-09-30T17:03:40.231 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.231 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.231 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:40.231 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.726075+0000", 2023-09-30T17:03:40.232 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017153700000000001 2023-09-30T17:03:40.232 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.232 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.232 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:40.232 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.727419+0000", 2023-09-30T17:03:40.232 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001343571 2023-09-30T17:03:40.232 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.232 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.232 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:40.232 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.965839+0000", 2023-09-30T17:03:40.232 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.238420467 2023-09-30T17:03:40.232 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.233 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.233 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:40.233 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.965922+0000", 2023-09-30T17:03:40.233 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2905000000000007e-05 2023-09-30T17:03:40.233 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.233 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.233 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:40.233 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.965966+0000", 2023-09-30T17:03:40.233 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3773999999999998e-05 2023-09-30T17:03:40.233 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:40.233 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:40.233 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:40.233 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.234 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.234 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23757 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 2117632~8192,write 2228224~4096,write 2453504~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:40.234 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.728711+0000", 2023-09-30T17:03:40.234 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 1.460136726, 2023-09-30T17:03:40.234 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23330704499999999, 2023-09-30T17:03:40.234 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:40.234 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:40.234 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:40.234 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:40.234 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:40.234 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23757 2023-09-30T17:03:40.235 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.235 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:40.235 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.235 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:40.235 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728711+0000", 2023-09-30T17:03:40.235 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:40.235 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.235 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.235 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:40.235 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728711+0000", 2023-09-30T17:03:40.235 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:40.235 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.236 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.236 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:40.236 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728712+0000", 2023-09-30T17:03:40.236 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4199999999999995e-07 2023-09-30T17:03:40.236 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.236 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.236 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:40.236 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728738+0000", 2023-09-30T17:03:40.236 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.6761e-05 2023-09-30T17:03:40.236 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.236 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.236 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:40.237 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728745+0000", 2023-09-30T17:03:40.237 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9940000000000003e-06 2023-09-30T17:03:40.237 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.237 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.237 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:40.237 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728749+0000", 2023-09-30T17:03:40.237 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.053e-06 2023-09-30T17:03:40.237 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.237 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.237 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:40.237 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728802+0000", 2023-09-30T17:03:40.238 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2918999999999999e-05 2023-09-30T17:03:40.238 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.238 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.238 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:40.238 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728923+0000", 2023-09-30T17:03:40.238 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00012084200000000001 2023-09-30T17:03:40.238 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.238 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.238 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:40.238 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.729101+0000", 2023-09-30T17:03:40.238 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000178226 2023-09-30T17:03:40.238 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.239 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.239 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:40.239 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732207+0000", 2023-09-30T17:03:40.239 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0031059849999999999 2023-09-30T17:03:40.239 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.239 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.239 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:40.239 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.961949+0000", 2023-09-30T17:03:40.239 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.229741842 2023-09-30T17:03:40.239 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.239 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.240 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:40.240 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.961986+0000", 2023-09-30T17:03:40.240 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7147000000000002e-05 2023-09-30T17:03:40.240 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.240 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.240 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:40.240 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.962018+0000", 2023-09-30T17:03:40.240 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.1634000000000002e-05 2023-09-30T17:03:40.240 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:40.240 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:40.240 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:40.240 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.241 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.241 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23768 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 1257472~4096,write 1384448~4096,write 1474560~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:40.241 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.732216+0000", 2023-09-30T17:03:40.241 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 1.4566320939999999, 2023-09-30T17:03:40.241 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22951861000000001, 2023-09-30T17:03:40.241 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:40.241 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:40.241 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:40.241 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:40.241 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:40.241 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23768 2023-09-30T17:03:40.241 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.242 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:40.242 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.242 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:40.242 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732216+0000", 2023-09-30T17:03:40.242 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:40.242 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.242 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.242 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:40.242 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732216+0000", 2023-09-30T17:03:40.242 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:40.242 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.243 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.243 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:40.243 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732216+0000", 2023-09-30T17:03:40.243 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.71e-07 2023-09-30T17:03:40.243 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.243 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.243 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:40.243 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732231+0000", 2023-09-30T17:03:40.243 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5007e-05 2023-09-30T17:03:40.243 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.243 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.243 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:40.244 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732239+0000", 2023-09-30T17:03:40.244 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8509999999999999e-06 2023-09-30T17:03:40.244 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.244 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.244 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:40.244 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732244+0000", 2023-09-30T17:03:40.244 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2000000000000002e-06 2023-09-30T17:03:40.244 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.244 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.244 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:40.244 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732285+0000", 2023-09-30T17:03:40.244 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0877000000000002e-05 2023-09-30T17:03:40.245 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.245 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.245 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:40.245 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732331+0000", 2023-09-30T17:03:40.245 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5906999999999999e-05 2023-09-30T17:03:40.245 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.245 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.245 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:40.245 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732421+0000", 2023-09-30T17:03:40.245 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9993000000000004e-05 2023-09-30T17:03:40.245 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.245 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.246 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:40.246 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.737687+0000", 2023-09-30T17:03:40.246 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005265792 2023-09-30T17:03:40.246 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.246 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.246 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:40.246 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.961667+0000", 2023-09-30T17:03:40.246 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22398030799999999 2023-09-30T17:03:40.246 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.246 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.246 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:40.247 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.961703+0000", 2023-09-30T17:03:40.247 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5221e-05 2023-09-30T17:03:40.247 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.247 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.247 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:40.247 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.961734+0000", 2023-09-30T17:03:40.247 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.1582999999999999e-05 2023-09-30T17:03:40.247 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:40.247 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:40.247 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:40.247 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.247 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.248 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23780 4.36 4:6fa85f86:::100000001f8.00000013:head [write 3469312~4096,write 3522560~4096,write 3579904~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:40.248 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.735686+0000", 2023-09-30T17:03:40.248 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 1.4531618630000001, 2023-09-30T17:03:40.248 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22921459399999999, 2023-09-30T17:03:40.248 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:40.248 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:40.248 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:40.248 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:40.248 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:40.248 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23780 2023-09-30T17:03:40.248 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.248 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:40.248 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.249 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:40.249 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.735686+0000", 2023-09-30T17:03:40.249 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:40.249 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.249 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.249 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:40.249 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.735686+0000", 2023-09-30T17:03:40.249 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:40.249 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.249 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.249 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:40.249 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.735687+0000", 2023-09-30T17:03:40.250 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3399999999999998e-07 2023-09-30T17:03:40.250 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.250 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.250 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:40.250 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.735701+0000", 2023-09-30T17:03:40.250 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4324999999999999e-05 2023-09-30T17:03:40.250 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.250 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.250 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:40.250 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.735713+0000", 2023-09-30T17:03:40.250 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1678999999999999e-05 2023-09-30T17:03:40.250 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.251 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.251 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:40.251 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.735720+0000", 2023-09-30T17:03:40.251 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8490000000000006e-06 2023-09-30T17:03:40.251 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.251 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.251 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:40.251 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.736637+0000", 2023-09-30T17:03:40.251 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00091620799999999995 2023-09-30T17:03:40.251 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.251 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.251 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:40.252 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.736719+0000", 2023-09-30T17:03:40.252 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2608999999999995e-05 2023-09-30T17:03:40.252 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.252 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.252 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:40.252 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.736876+0000", 2023-09-30T17:03:40.252 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015636799999999999 2023-09-30T17:03:40.252 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.252 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.252 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:40.252 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.742934+0000", 2023-09-30T17:03:40.252 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0060581619999999997 2023-09-30T17:03:40.253 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.253 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.253 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:40.253 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.964798+0000", 2023-09-30T17:03:40.253 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22186376599999999 2023-09-30T17:03:40.253 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.253 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.253 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:40.253 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.964859+0000", 2023-09-30T17:03:40.253 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1668000000000007e-05 2023-09-30T17:03:40.253 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.253 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.254 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:40.254 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.964900+0000", 2023-09-30T17:03:40.254 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1125999999999999e-05 2023-09-30T17:03:40.254 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:40.254 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:40.254 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:40.254 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.254 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.254 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23856 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 3538944~4096,write 3616768~4096,write 3686400~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:40.254 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.759274+0000", 2023-09-30T17:03:40.254 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 1.429573982, 2023-09-30T17:03:40.254 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.234084127, 2023-09-30T17:03:40.255 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:40.255 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:40.255 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:40.255 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:40.255 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:40.255 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23856 2023-09-30T17:03:40.255 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.255 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:40.255 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.255 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:40.255 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759274+0000", 2023-09-30T17:03:40.255 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:40.256 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.256 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.256 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:40.256 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759274+0000", 2023-09-30T17:03:40.256 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:40.256 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.256 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.256 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:40.256 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759274+0000", 2023-09-30T17:03:40.256 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7899999999999998e-07 2023-09-30T17:03:40.256 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.256 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.257 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:40.257 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759293+0000", 2023-09-30T17:03:40.257 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8410000000000002e-05 2023-09-30T17:03:40.257 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.257 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.257 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:40.257 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759302+0000", 2023-09-30T17:03:40.257 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8599999999999999e-06 2023-09-30T17:03:40.257 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.257 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.257 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:40.257 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759306+0000", 2023-09-30T17:03:40.258 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4499999999999997e-06 2023-09-30T17:03:40.258 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.258 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.258 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:40.258 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759984+0000", 2023-09-30T17:03:40.258 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00067830600000000005 2023-09-30T17:03:40.258 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.258 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.258 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:40.258 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.760041+0000", 2023-09-30T17:03:40.258 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.643e-05 2023-09-30T17:03:40.259 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.259 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.259 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:40.259 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.760135+0000", 2023-09-30T17:03:40.259 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3795999999999994e-05 2023-09-30T17:03:40.259 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.259 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.259 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:40.259 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764097+0000", 2023-09-30T17:03:40.259 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0039625629999999997 2023-09-30T17:03:40.259 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.259 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.260 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:40.260 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993282+0000", 2023-09-30T17:03:40.260 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22918461500000001 2023-09-30T17:03:40.260 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.260 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.260 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:40.260 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993320+0000", 2023-09-30T17:03:40.260 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8600999999999999e-05 2023-09-30T17:03:40.260 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.260 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.260 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:40.260 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993358+0000", 2023-09-30T17:03:40.261 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7517e-05 2023-09-30T17:03:40.261 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:40.261 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:40.261 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:40.261 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.261 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.261 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23865 4.36 4:6da220e6:::100000001f8.0000003f:head [write 3715072~4096,write 3850240~4096,write 4059136~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:40.261 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.761946+0000", 2023-09-30T17:03:40.261 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 1.426901497, 2023-09-30T17:03:40.261 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.231486097, 2023-09-30T17:03:40.261 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:40.261 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:40.262 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:40.262 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:40.262 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:40.262 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23865 2023-09-30T17:03:40.262 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.262 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:40.262 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.262 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:40.262 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.761946+0000", 2023-09-30T17:03:40.262 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:40.262 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.262 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.263 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:40.263 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.761946+0000", 2023-09-30T17:03:40.263 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:40.263 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.263 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.263 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:40.263 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.761947+0000", 2023-09-30T17:03:40.263 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7000000000000004e-07 2023-09-30T17:03:40.263 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.263 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.263 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:40.263 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.761959+0000", 2023-09-30T17:03:40.264 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2265e-05 2023-09-30T17:03:40.264 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.264 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.264 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:40.264 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.761970+0000", 2023-09-30T17:03:40.264 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0474e-05 2023-09-30T17:03:40.264 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.264 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.264 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:40.264 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.761976+0000", 2023-09-30T17:03:40.264 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1340000000000001e-06 2023-09-30T17:03:40.264 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.265 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.265 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:40.265 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.762063+0000", 2023-09-30T17:03:40.265 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.6728e-05 2023-09-30T17:03:40.265 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.265 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.265 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:40.265 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.762125+0000", 2023-09-30T17:03:40.265 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2869999999999999e-05 2023-09-30T17:03:40.265 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.265 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.265 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:40.266 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.762235+0000", 2023-09-30T17:03:40.266 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000109139 2023-09-30T17:03:40.266 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.266 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.266 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:40.266 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764102+0000", 2023-09-30T17:03:40.266 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001867121 2023-09-30T17:03:40.266 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.266 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.266 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:40.266 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993327+0000", 2023-09-30T17:03:40.266 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22922526800000001 2023-09-30T17:03:40.266 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.267 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.267 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:40.267 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993391+0000", 2023-09-30T17:03:40.267 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3839999999999999e-05 2023-09-30T17:03:40.267 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.267 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.267 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:40.267 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993432+0000", 2023-09-30T17:03:40.267 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1488e-05 2023-09-30T17:03:40.267 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:40.267 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:40.269 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:40.269 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.269 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.269 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23875 4.36 4:6da220e6:::100000001f8.0000003f:head [write 364544~4096,write 499712~4096,write 655360~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:40.269 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.764904+0000", 2023-09-30T17:03:40.269 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 1.4239433130000001, 2023-09-30T17:03:40.269 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.228631693, 2023-09-30T17:03:40.269 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:40.270 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:40.270 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:40.270 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:40.270 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:40.270 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23875 2023-09-30T17:03:40.270 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.270 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:40.270 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.270 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:40.270 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764904+0000", 2023-09-30T17:03:40.270 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:40.271 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.271 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.271 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:40.271 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764904+0000", 2023-09-30T17:03:40.271 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:40.271 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.271 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.271 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:40.271 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764905+0000", 2023-09-30T17:03:40.271 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2799999999999995e-07 2023-09-30T17:03:40.271 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.271 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.272 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:40.272 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764915+0000", 2023-09-30T17:03:40.272 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8099999999999992e-06 2023-09-30T17:03:40.272 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.272 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.272 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:40.272 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764926+0000", 2023-09-30T17:03:40.272 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0858e-05 2023-09-30T17:03:40.272 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.272 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.272 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:40.272 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764931+0000", 2023-09-30T17:03:40.273 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2170000000000002e-06 2023-09-30T17:03:40.273 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.273 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.273 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:40.273 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764963+0000", 2023-09-30T17:03:40.273 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.2319e-05 2023-09-30T17:03:40.273 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.273 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.273 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:40.273 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.765009+0000", 2023-09-30T17:03:40.273 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5753000000000001e-05 2023-09-30T17:03:40.274 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.274 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.274 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:40.274 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.765093+0000", 2023-09-30T17:03:40.274 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4259999999999996e-05 2023-09-30T17:03:40.274 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.274 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.274 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:40.274 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766238+0000", 2023-09-30T17:03:40.274 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0011442550000000001 2023-09-30T17:03:40.274 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.275 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.275 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:40.275 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993469+0000", 2023-09-30T17:03:40.275 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22723121800000001 2023-09-30T17:03:40.275 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.275 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.275 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:40.275 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993501+0000", 2023-09-30T17:03:40.275 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.2576000000000001e-05 2023-09-30T17:03:40.275 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.275 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.275 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:40.276 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993536+0000", 2023-09-30T17:03:40.276 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4699000000000001e-05 2023-09-30T17:03:40.276 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:40.276 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:40.276 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:40.276 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.276 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.276 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23881 4.36 4:6da220e6:::100000001f8.0000003f:head [write 3366912~4096,write 3694592~4096,write 4071424~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:40.276 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.766444+0000", 2023-09-30T17:03:40.276 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 1.4224038919999999, 2023-09-30T17:03:40.276 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23475070200000001, 2023-09-30T17:03:40.277 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:40.277 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:40.277 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:40.277 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:40.277 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:40.277 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23881 2023-09-30T17:03:40.277 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.277 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:40.277 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.277 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:40.277 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766444+0000", 2023-09-30T17:03:40.277 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:40.278 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.278 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.278 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:40.278 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766444+0000", 2023-09-30T17:03:40.278 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:40.278 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.278 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.278 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:40.278 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766444+0000", 2023-09-30T17:03:40.278 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3e-07 2023-09-30T17:03:40.278 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.279 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.279 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:40.279 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766455+0000", 2023-09-30T17:03:40.279 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0454e-05 2023-09-30T17:03:40.279 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.279 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.279 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:40.279 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766469+0000", 2023-09-30T17:03:40.279 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3568e-05 2023-09-30T17:03:40.279 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.279 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.279 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:40.280 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766474+0000", 2023-09-30T17:03:40.280 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1669999999999998e-06 2023-09-30T17:03:40.280 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.280 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.280 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:40.280 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766527+0000", 2023-09-30T17:03:40.280 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3650000000000003e-05 2023-09-30T17:03:40.280 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.280 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.280 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:40.280 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766611+0000", 2023-09-30T17:03:40.280 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3230000000000001e-05 2023-09-30T17:03:40.281 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.281 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.281 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:40.281 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766767+0000", 2023-09-30T17:03:40.281 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015688 2023-09-30T17:03:40.281 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.281 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.281 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:40.281 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.770254+0000", 2023-09-30T17:03:40.281 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0034870090000000001 2023-09-30T17:03:40.281 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.281 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.282 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:40.282 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.001100+0000", 2023-09-30T17:03:40.282 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23084518700000001 2023-09-30T17:03:40.282 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.282 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.282 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:40.282 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.001154+0000", 2023-09-30T17:03:40.282 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4453000000000002e-05 2023-09-30T17:03:40.282 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.282 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.282 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:40.282 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.001194+0000", 2023-09-30T17:03:40.283 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0373999999999997e-05 2023-09-30T17:03:40.283 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:40.283 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:40.283 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:40.283 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.283 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.283 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23901 4.6 4:63e80496:::100000001f8.0000001e:head [write 2617344~4096,write 2646016~4096,write 2662400~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:40.283 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.772204+0000", 2023-09-30T17:03:40.283 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 1.4166438750000001, 2023-09-30T17:03:40.283 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.228858799, 2023-09-30T17:03:40.283 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:40.283 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:40.284 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:40.284 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:40.284 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:40.284 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23901 2023-09-30T17:03:40.284 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.284 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:40.284 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.284 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:40.284 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772204+0000", 2023-09-30T17:03:40.284 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:40.284 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.284 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.285 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:40.285 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772204+0000", 2023-09-30T17:03:40.285 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:40.285 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.285 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.285 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:40.285 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772205+0000", 2023-09-30T17:03:40.285 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3600000000000002e-07 2023-09-30T17:03:40.285 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.285 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.285 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:40.285 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772217+0000", 2023-09-30T17:03:40.286 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2459999999999999e-05 2023-09-30T17:03:40.286 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.286 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.286 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:40.286 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772228+0000", 2023-09-30T17:03:40.286 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0614e-05 2023-09-30T17:03:40.286 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.286 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.286 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:40.286 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772236+0000", 2023-09-30T17:03:40.286 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7610000000000007e-06 2023-09-30T17:03:40.287 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.287 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.287 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:40.287 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772280+0000", 2023-09-30T17:03:40.287 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4360000000000002e-05 2023-09-30T17:03:40.287 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.287 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.287 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:40.287 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772328+0000", 2023-09-30T17:03:40.287 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8041000000000003e-05 2023-09-30T17:03:40.287 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.287 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.288 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:40.288 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772417+0000", 2023-09-30T17:03:40.288 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9226000000000003e-05 2023-09-30T17:03:40.288 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.288 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.288 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:40.288 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.774997+0000", 2023-09-30T17:03:40.288 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0025795039999999998 2023-09-30T17:03:40.288 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.288 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.288 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:40.288 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.000979+0000", 2023-09-30T17:03:40.289 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22598211700000001 2023-09-30T17:03:40.289 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.289 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.289 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:40.289 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.001025+0000", 2023-09-30T17:03:40.289 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6347999999999997e-05 2023-09-30T17:03:40.289 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.289 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.289 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:40.289 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.001063+0000", 2023-09-30T17:03:40.289 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7431999999999997e-05 2023-09-30T17:03:40.289 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:40.289 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:40.290 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:40.290 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.290 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.290 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23924 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 1196032~4096,write 1249280~4096,write 1294336~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:40.290 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.778807+0000", 2023-09-30T17:03:40.290 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 1.4100410160000001, 2023-09-30T17:03:40.290 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23068708600000001, 2023-09-30T17:03:40.290 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:40.290 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:40.290 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:40.290 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:40.291 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:40.291 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23924 2023-09-30T17:03:40.291 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.291 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:40.291 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.291 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:40.291 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778807+0000", 2023-09-30T17:03:40.291 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:40.291 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.291 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.291 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:40.291 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778807+0000", 2023-09-30T17:03:40.292 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:40.292 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.292 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.292 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:40.292 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778807+0000", 2023-09-30T17:03:40.292 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3600000000000003e-07 2023-09-30T17:03:40.292 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.292 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.292 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:40.292 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778832+0000", 2023-09-30T17:03:40.292 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4905999999999998e-05 2023-09-30T17:03:40.292 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.293 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.293 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:40.293 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778839+0000", 2023-09-30T17:03:40.293 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.097e-06 2023-09-30T17:03:40.293 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.293 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.293 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:40.293 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778843+0000", 2023-09-30T17:03:40.293 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8279999999999996e-06 2023-09-30T17:03:40.293 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.293 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.293 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:40.294 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778875+0000", 2023-09-30T17:03:40.294 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.1792000000000003e-05 2023-09-30T17:03:40.294 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.294 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.294 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:40.294 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778922+0000", 2023-09-30T17:03:40.294 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7034999999999999e-05 2023-09-30T17:03:40.294 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.294 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.294 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:40.294 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.779010+0000", 2023-09-30T17:03:40.294 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8305000000000002e-05 2023-09-30T17:03:40.295 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.295 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.295 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:40.295 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.781442+0000", 2023-09-30T17:03:40.295 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0024313550000000001 2023-09-30T17:03:40.295 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.295 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.295 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:40.295 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.009433+0000", 2023-09-30T17:03:40.295 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.227991044 2023-09-30T17:03:40.295 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.296 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.296 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:40.296 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.009471+0000", 2023-09-30T17:03:40.296 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8720999999999997e-05 2023-09-30T17:03:40.296 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.296 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.296 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:40.296 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.009494+0000", 2023-09-30T17:03:40.296 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2367000000000001e-05 2023-09-30T17:03:40.296 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:40.296 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:40.296 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:40.297 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.297 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.297 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23990 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 4157440~4096,write 4186112~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:40.297 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.798667+0000", 2023-09-30T17:03:40.297 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 1.3901805010000001, 2023-09-30T17:03:40.297 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23029929399999999, 2023-09-30T17:03:40.297 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:40.297 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:40.297 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:40.297 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:40.297 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:40.297 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23990 2023-09-30T17:03:40.298 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.298 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:40.298 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.298 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:40.298 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798667+0000", 2023-09-30T17:03:40.298 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:40.298 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.298 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.298 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:40.298 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798667+0000", 2023-09-30T17:03:40.298 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:40.299 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.299 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.299 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:40.299 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798668+0000", 2023-09-30T17:03:40.299 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7000000000000005e-07 2023-09-30T17:03:40.299 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.299 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.299 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:40.299 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798675+0000", 2023-09-30T17:03:40.299 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1269999999999997e-06 2023-09-30T17:03:40.299 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.299 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.300 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:40.300 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798681+0000", 2023-09-30T17:03:40.300 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3500000000000002e-06 2023-09-30T17:03:40.300 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.300 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.300 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:40.300 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798685+0000", 2023-09-30T17:03:40.300 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.63e-06 2023-09-30T17:03:40.300 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.300 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.300 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:40.300 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798726+0000", 2023-09-30T17:03:40.301 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.163e-05 2023-09-30T17:03:40.301 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.301 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.301 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:40.301 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798790+0000", 2023-09-30T17:03:40.301 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3781999999999993e-05 2023-09-30T17:03:40.301 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.301 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.301 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:40.301 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798933+0000", 2023-09-30T17:03:40.301 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014272199999999999 2023-09-30T17:03:40.302 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.302 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.302 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:40.302 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.802788+0000", 2023-09-30T17:03:40.302 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.003855509 2023-09-30T17:03:40.302 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.302 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.302 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:40.302 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.028891+0000", 2023-09-30T17:03:40.302 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.226102847 2023-09-30T17:03:40.302 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.302 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.303 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:40.303 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.028945+0000", 2023-09-30T17:03:40.303 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3600000000000002e-05 2023-09-30T17:03:40.303 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.303 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.303 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:40.303 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.028966+0000", 2023-09-30T17:03:40.303 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1526999999999999e-05 2023-09-30T17:03:40.303 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:40.303 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:40.303 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:40.303 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.304 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.304 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23991 4.6 4:63e80496:::100000001f8.0000001e:head [write 327680~4096,write 335872~4096,write 491520~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:40.304 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.798864+0000", 2023-09-30T17:03:40.304 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 1.3899839169999999, 2023-09-30T17:03:40.304 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23025762699999999, 2023-09-30T17:03:40.304 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:40.304 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:40.304 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:40.304 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:40.304 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:40.304 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23991 2023-09-30T17:03:40.304 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.304 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:40.305 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.305 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:40.305 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798864+0000", 2023-09-30T17:03:40.305 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:40.305 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.305 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.305 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:40.305 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798864+0000", 2023-09-30T17:03:40.305 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:40.305 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.305 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.305 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:40.306 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798864+0000", 2023-09-30T17:03:40.306 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3099999999999998e-07 2023-09-30T17:03:40.306 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.306 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.306 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:40.306 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798873+0000", 2023-09-30T17:03:40.306 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4789999999999996e-06 2023-09-30T17:03:40.306 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.306 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.306 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:40.307 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798878+0000", 2023-09-30T17:03:40.307 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6579999999999999e-06 2023-09-30T17:03:40.307 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.307 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.307 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:40.307 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798882+0000", 2023-09-30T17:03:40.307 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.985e-06 2023-09-30T17:03:40.307 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.307 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.307 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:40.307 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.799659+0000", 2023-09-30T17:03:40.307 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00077693900000000004 2023-09-30T17:03:40.308 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.308 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.308 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:40.308 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.799712+0000", 2023-09-30T17:03:40.308 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2694000000000001e-05 2023-09-30T17:03:40.308 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.308 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.308 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:40.308 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.799796+0000", 2023-09-30T17:03:40.308 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3943999999999995e-05 2023-09-30T17:03:40.308 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.308 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.309 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:40.309 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.802821+0000", 2023-09-30T17:03:40.309 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0030251850000000001 2023-09-30T17:03:40.309 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.309 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.309 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:40.309 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.029027+0000", 2023-09-30T17:03:40.309 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22620609999999999 2023-09-30T17:03:40.309 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.309 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.309 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:40.309 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.029083+0000", 2023-09-30T17:03:40.310 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5926e-05 2023-09-30T17:03:40.310 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.310 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.310 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:40.310 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.029121+0000", 2023-09-30T17:03:40.310 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8186000000000003e-05 2023-09-30T17:03:40.310 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:40.310 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:40.310 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:40.310 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.310 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.310 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:24052 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 3448832~4096,write 3493888~4096,write 3502080~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:40.311 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.817515+0000", 2023-09-30T17:03:40.311 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 1.371332607, 2023-09-30T17:03:40.311 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23184106800000001, 2023-09-30T17:03:40.311 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:40.311 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:40.311 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:40.311 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:40.311 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:40.311 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 24052 2023-09-30T17:03:40.311 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.311 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:40.312 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.312 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:40.312 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.817515+0000", 2023-09-30T17:03:40.312 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:40.312 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.312 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.312 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:40.312 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.817515+0000", 2023-09-30T17:03:40.312 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:40.312 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.312 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.312 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:40.312 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.817516+0000", 2023-09-30T17:03:40.313 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9899999999999999e-07 2023-09-30T17:03:40.313 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.313 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.313 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:40.313 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.817531+0000", 2023-09-30T17:03:40.313 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5483000000000001e-05 2023-09-30T17:03:40.313 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.313 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.313 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:40.313 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.817545+0000", 2023-09-30T17:03:40.313 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3209e-05 2023-09-30T17:03:40.313 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.314 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.314 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:40.314 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.817553+0000", 2023-09-30T17:03:40.314 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.994e-06 2023-09-30T17:03:40.314 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.314 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.314 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:40.314 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.818753+0000", 2023-09-30T17:03:40.314 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0012000909999999999 2023-09-30T17:03:40.314 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.314 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.314 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:40.315 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.818838+0000", 2023-09-30T17:03:40.315 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5389999999999994e-05 2023-09-30T17:03:40.315 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.315 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.315 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:40.315 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.818996+0000", 2023-09-30T17:03:40.315 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000158116 2023-09-30T17:03:40.315 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.315 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.315 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:40.315 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.822334+0000", 2023-09-30T17:03:40.316 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0033373230000000001 2023-09-30T17:03:40.316 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.316 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.316 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:40.316 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049259+0000", 2023-09-30T17:03:40.316 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22692517400000001 2023-09-30T17:03:40.316 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.316 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.316 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:40.316 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049323+0000", 2023-09-30T17:03:40.316 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4348000000000001e-05 2023-09-30T17:03:40.317 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.317 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.317 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:40.317 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049356+0000", 2023-09-30T17:03:40.317 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3040999999999998e-05 2023-09-30T17:03:40.317 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:40.317 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:40.317 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:40.317 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.317 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.317 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:24058 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 172032~4096,write 200704~4096,write 249856~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:40.318 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.819363+0000", 2023-09-30T17:03:40.318 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 1.369485131, 2023-09-30T17:03:40.318 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23030741099999999, 2023-09-30T17:03:40.318 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:40.318 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:40.318 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:40.318 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:40.318 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:40.318 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 24058 2023-09-30T17:03:40.318 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.318 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:40.319 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.319 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:40.319 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819363+0000", 2023-09-30T17:03:40.319 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:40.319 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.319 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.319 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:40.319 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819363+0000", 2023-09-30T17:03:40.319 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:40.319 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.319 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.320 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:40.320 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819363+0000", 2023-09-30T17:03:40.320 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8400000000000003e-07 2023-09-30T17:03:40.320 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.320 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.320 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:40.320 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819373+0000", 2023-09-30T17:03:40.320 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.9930000000000007e-06 2023-09-30T17:03:40.320 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.320 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.320 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:40.320 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819383+0000", 2023-09-30T17:03:40.321 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.4059999999999994e-06 2023-09-30T17:03:40.321 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.321 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.321 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:40.321 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819388+0000", 2023-09-30T17:03:40.321 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3299999999999998e-06 2023-09-30T17:03:40.321 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.321 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.321 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:40.321 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819584+0000", 2023-09-30T17:03:40.321 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00019642600000000001 2023-09-30T17:03:40.322 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.322 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.322 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:40.322 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819627+0000", 2023-09-30T17:03:40.322 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2150999999999997e-05 2023-09-30T17:03:40.322 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.322 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.322 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:40.322 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819712+0000", 2023-09-30T17:03:40.322 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5255999999999998e-05 2023-09-30T17:03:40.322 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.323 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.323 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:40.323 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.822340+0000", 2023-09-30T17:03:40.323 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0026283029999999998 2023-09-30T17:03:40.323 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.323 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.323 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:40.323 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049621+0000", 2023-09-30T17:03:40.323 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.227281176 2023-09-30T17:03:40.323 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.323 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.323 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:40.324 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049652+0000", 2023-09-30T17:03:40.324 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0528000000000003e-05 2023-09-30T17:03:40.324 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.324 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.324 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:40.324 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049670+0000", 2023-09-30T17:03:40.324 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8057999999999999e-05 2023-09-30T17:03:40.324 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:40.324 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:40.324 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:40.324 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.324 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.325 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:24064 4.6 4:616d4c41:::100000001f8.00000034:head [write 4132864~4096,write 4173824~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:40.325 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.820931+0000", 2023-09-30T17:03:40.325 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 1.3679167699999999, 2023-09-30T17:03:40.325 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22854920400000001, 2023-09-30T17:03:40.325 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:40.325 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:40.325 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:40.325 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:40.325 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:40.325 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 24064 2023-09-30T17:03:40.325 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.325 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:40.326 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.326 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:40.326 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.820931+0000", 2023-09-30T17:03:40.326 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:40.326 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.326 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.326 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:40.326 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.820931+0000", 2023-09-30T17:03:40.326 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:40.326 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.326 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.327 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:40.327 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.820932+0000", 2023-09-30T17:03:40.327 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4300000000000002e-07 2023-09-30T17:03:40.327 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.327 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.327 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:40.327 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.820941+0000", 2023-09-30T17:03:40.327 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.5650000000000007e-06 2023-09-30T17:03:40.327 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.327 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.327 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:40.327 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.820952+0000", 2023-09-30T17:03:40.327 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0566e-05 2023-09-30T17:03:40.328 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.328 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.328 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:40.328 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.820957+0000", 2023-09-30T17:03:40.328 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3800000000000002e-06 2023-09-30T17:03:40.328 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.328 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.328 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:40.328 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.821008+0000", 2023-09-30T17:03:40.328 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1070999999999999e-05 2023-09-30T17:03:40.328 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.328 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.329 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:40.329 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.821075+0000", 2023-09-30T17:03:40.329 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.648e-05 2023-09-30T17:03:40.329 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.329 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.329 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:40.329 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.821236+0000", 2023-09-30T17:03:40.329 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016120899999999999 2023-09-30T17:03:40.329 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.329 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.329 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:40.330 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.823356+0000", 2023-09-30T17:03:40.330 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.002120458 2023-09-30T17:03:40.330 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.330 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.330 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:40.330 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049389+0000", 2023-09-30T17:03:40.330 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22603278199999999 2023-09-30T17:03:40.330 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.330 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.330 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:40.330 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049443+0000", 2023-09-30T17:03:40.331 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4033000000000003e-05 2023-09-30T17:03:40.331 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:40.331 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:40.331 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:40.331 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049480+0000", 2023-09-30T17:03:40.331 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6816999999999997e-05 2023-09-30T17:03:40.331 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:40.331 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:40.331 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:40.331 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:40.331 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:40.332 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:40.333 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:40.332+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:40.333 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:03:40.404 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-09-30T17:03:40.433 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~53s 2023-09-30T17:03:40.433 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-09-30T17:03:40.433 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:40.434+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:40.511 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:40.511 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2023-09-30T17:03:40.511 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.511 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:28700 4.f 4:f26fdfa9:::100000001f8.00000002:head [write 4022272~4096 in=4096b,write 4087808~4096 in=4096b,write 4161536~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:40.512 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:40.507985+0000", 2023-09-30T17:03:40.512 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0028835039999999998, 2023-09-30T17:03:40.512 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0029101980000000001, 2023-09-30T17:03:40.512 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:40.512 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:40.512 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:40.512 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:40.512 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:40.512 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 28700 2023-09-30T17:03:40.512 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.512 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:40.512 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.513 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:40.513 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.507985+0000", 2023-09-30T17:03:40.513 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:40.513 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.513 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.513 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:40.513 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.507985+0000", 2023-09-30T17:03:40.513 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:40.513 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.513 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.513 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:40.513 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.507986+0000", 2023-09-30T17:03:40.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8899999999999999e-07 2023-09-30T17:03:40.514 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.514 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.514 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:40.514 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.508001+0000", 2023-09-30T17:03:40.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5126000000000001e-05 2023-09-30T17:03:40.514 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.514 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.514 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:40.514 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.508012+0000", 2023-09-30T17:03:40.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0866999999999999e-05 2023-09-30T17:03:40.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.515 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:40.515 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.508018+0000", 2023-09-30T17:03:40.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4250000000000003e-06 2023-09-30T17:03:40.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.515 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:40.515 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.508064+0000", 2023-09-30T17:03:40.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5614000000000001e-05 2023-09-30T17:03:40.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.516 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:40.516 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.508155+0000", 2023-09-30T17:03:40.516 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1024000000000001e-05 2023-09-30T17:03:40.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.516 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:40.516 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.508301+0000", 2023-09-30T17:03:40.516 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014617699999999999 2023-09-30T17:03:40.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.517 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:40.517 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.509928+0000", 2023-09-30T17:03:40.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0016265489999999999 2023-09-30T17:03:40.517 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:40.517 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:40.517 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:40.517 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.517 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:28701 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 2072576~4096 in=4096b,write 2215936~4096 in=4096b,write 2424832~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:40.517 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:40.508386+0000", 2023-09-30T17:03:40.517 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0024829980000000001, 2023-09-30T17:03:40.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0026080389999999999, 2023-09-30T17:03:40.518 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:40.518 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:40.518 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:40.518 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:40.518 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:40.518 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 28701 2023-09-30T17:03:40.518 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.518 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:40.518 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.518 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:40.518 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.508386+0000", 2023-09-30T17:03:40.519 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:40.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.519 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:40.519 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.508386+0000", 2023-09-30T17:03:40.519 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:40.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.519 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:40.519 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.508386+0000", 2023-09-30T17:03:40.519 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3900000000000004e-07 2023-09-30T17:03:40.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.520 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.520 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:40.520 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.508399+0000", 2023-09-30T17:03:40.520 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2427e-05 2023-09-30T17:03:40.520 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.520 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.520 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:40.520 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.508408+0000", 2023-09-30T17:03:40.520 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8999999999999995e-06 2023-09-30T17:03:40.520 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.520 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.520 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:40.521 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.508415+0000", 2023-09-30T17:03:40.521 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4880000000000001e-06 2023-09-30T17:03:40.521 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.521 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.521 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:40.521 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.508610+0000", 2023-09-30T17:03:40.521 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019509200000000001 2023-09-30T17:03:40.521 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.521 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.521 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:40.521 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.508706+0000", 2023-09-30T17:03:40.521 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5307000000000001e-05 2023-09-30T17:03:40.522 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:40.522 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:40.522 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:40.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.522 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:28703 4.2d 4:b4aa06e9:::100000001f8.0000001d:head [write 1576960~4096 in=4096b,write 1716224~4096 in=4096b,write 2056192~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:40.522 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:40.509492+0000", 2023-09-30T17:03:40.522 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0013772980000000001, 2023-09-30T17:03:40.522 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0016065929999999999, 2023-09-30T17:03:40.522 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:40.522 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:40.522 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:40.523 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:40.523 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:40.523 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 28703 2023-09-30T17:03:40.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.523 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:40.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.523 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:40.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.509492+0000", 2023-09-30T17:03:40.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:40.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.524 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.524 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:40.524 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.509492+0000", 2023-09-30T17:03:40.524 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:40.524 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.524 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.524 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:40.524 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.509492+0000", 2023-09-30T17:03:40.524 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3399999999999999e-07 2023-09-30T17:03:40.524 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.524 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.524 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:40.525 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.509503+0000", 2023-09-30T17:03:40.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0862999999999999e-05 2023-09-30T17:03:40.525 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.525 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.525 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:40.525 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.509519+0000", 2023-09-30T17:03:40.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5653000000000001e-05 2023-09-30T17:03:40.525 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.525 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.525 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:40.525 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.509526+0000", 2023-09-30T17:03:40.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9979999999999997e-06 2023-09-30T17:03:40.526 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.526 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:40.526 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.509564+0000", 2023-09-30T17:03:40.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8699999999999999e-05 2023-09-30T17:03:40.526 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.526 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:40.526 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.509630+0000", 2023-09-30T17:03:40.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5209999999999994e-05 2023-09-30T17:03:40.526 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.527 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:40.527 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.509734+0000", 2023-09-30T17:03:40.527 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000104597 2023-09-30T17:03:40.527 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:40.527 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:40.527 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:40.527 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.527 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.527 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:28705 4.2c 4:36128e15:::100000001f8.00000008:head [write 3903488~4096 in=4096b,write 4022272~4096 in=4096b,write 4046848~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:40.527 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:40.510343+0000", 2023-09-30T17:03:40.527 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.00052617099999999997, 2023-09-30T17:03:40.527 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00085424600000000002, 2023-09-30T17:03:40.528 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:40.528 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:40.528 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:40.528 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:40.528 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:40.528 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 28705 2023-09-30T17:03:40.528 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.528 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:40.528 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.528 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:40.528 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.510343+0000", 2023-09-30T17:03:40.529 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:40.529 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.529 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.529 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:40.529 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.510343+0000", 2023-09-30T17:03:40.529 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:40.529 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.529 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.529 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:40.529 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.510343+0000", 2023-09-30T17:03:40.529 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.44e-07 2023-09-30T17:03:40.529 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.530 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.530 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:40.530 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.510351+0000", 2023-09-30T17:03:40.530 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0879999999999995e-06 2023-09-30T17:03:40.530 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.530 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.530 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:40.530 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.510358+0000", 2023-09-30T17:03:40.530 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2600000000000002e-06 2023-09-30T17:03:40.530 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.530 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.530 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:40.531 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.510362+0000", 2023-09-30T17:03:40.531 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3789999999999999e-06 2023-09-30T17:03:40.531 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.531 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.531 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:40.531 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.510398+0000", 2023-09-30T17:03:40.531 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5683999999999999e-05 2023-09-30T17:03:40.531 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.531 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.531 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:40.531 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.510449+0000", 2023-09-30T17:03:40.531 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1106000000000002e-05 2023-09-30T17:03:40.532 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:40.532 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:40.532 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:40.532 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.532 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.532 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:28704 4.6 e41/17 4:635f8cb4:::100000001f8.0000003c:head v 41'1794, mlcod=41'1792)", 2023-09-30T17:03:40.532 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:40.510472+0000", 2023-09-30T17:03:40.532 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.000396838, 2023-09-30T17:03:40.532 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00080015499999999999, 2023-09-30T17:03:40.532 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:40.532 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:40.532 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:40.533 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.533 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:40.533 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.510472+0000", 2023-09-30T17:03:40.533 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:40.533 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.533 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.533 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:40.533 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.510472+0000", 2023-09-30T17:03:40.533 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:40.533 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.534 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.534 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:40.534 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.510473+0000", 2023-09-30T17:03:40.534 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7599999999999997e-07 2023-09-30T17:03:40.534 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.534 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.534 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:40.534 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.510486+0000", 2023-09-30T17:03:40.534 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3560000000000001e-05 2023-09-30T17:03:40.534 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.534 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.535 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:40.535 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.510494+0000", 2023-09-30T17:03:40.535 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4030000000000001e-06 2023-09-30T17:03:40.535 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.535 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.535 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:40.535 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.510501+0000", 2023-09-30T17:03:40.535 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0999999999999998e-06 2023-09-30T17:03:40.535 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.535 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.535 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:40.535 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.510541+0000", 2023-09-30T17:03:40.536 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0351e-05 2023-09-30T17:03:40.536 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.536 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.536 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:40.536 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.510558+0000", 2023-09-30T17:03:40.536 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6648000000000001e-05 2023-09-30T17:03:40.536 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:40.536 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:40.536 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:40.536 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.536 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.536 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:28706 4.37 4:eff9002a:::100000001f8.00000003:head [write 3620864~4096 in=4096b,write 3727360~4096 in=4096b,write 3764224~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:40.537 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:40.510722+0000", 2023-09-30T17:03:40.537 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.000147007, 2023-09-30T17:03:40.537 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00064841300000000003, 2023-09-30T17:03:40.537 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:40.537 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:40.537 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:40.537 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:40.537 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:40.537 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 28706 2023-09-30T17:03:40.537 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.537 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:40.537 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.538 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:40.538 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.510722+0000", 2023-09-30T17:03:40.538 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:40.538 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.538 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.538 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:40.538 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.510722+0000", 2023-09-30T17:03:40.538 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:40.538 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.538 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.538 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:40.539 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.510723+0000", 2023-09-30T17:03:40.539 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6199999999999997e-07 2023-09-30T17:03:40.539 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.539 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.539 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:40.539 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.510737+0000", 2023-09-30T17:03:40.539 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4681000000000001e-05 2023-09-30T17:03:40.539 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.539 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.539 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:40.539 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.510749+0000", 2023-09-30T17:03:40.539 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1525999999999999e-05 2023-09-30T17:03:40.540 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.540 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.540 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:40.540 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.510755+0000", 2023-09-30T17:03:40.540 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5599999999999999e-06 2023-09-30T17:03:40.540 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.540 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.540 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:40.540 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.510808+0000", 2023-09-30T17:03:40.540 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2580000000000001e-05 2023-09-30T17:03:40.540 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.540 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.541 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:40.541 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.510891+0000", 2023-09-30T17:03:40.541 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3424000000000006e-05 2023-09-30T17:03:40.541 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.541 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.541 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:40.541 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.511060+0000", 2023-09-30T17:03:40.541 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000169104 2023-09-30T17:03:40.541 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:40.541 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:40.541 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:40.541 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.542 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.542 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:28707 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 2813952~4096 in=4096b,write 2875392~4096 in=4096b,write 2924544~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:40.542 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:40.511027+0000", 2023-09-30T17:03:40.542 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9998422, 2023-09-30T17:03:40.542 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00043457800000000003, 2023-09-30T17:03:40.542 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:40.542 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:40.542 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:40.542 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:40.542 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:40.542 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 28707 2023-09-30T17:03:40.542 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.543 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:40.543 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.543 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:40.543 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.511027+0000", 2023-09-30T17:03:40.543 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:40.543 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.543 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.543 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:40.543 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.511027+0000", 2023-09-30T17:03:40.543 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:40.543 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.543 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.544 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:40.544 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.511027+0000", 2023-09-30T17:03:40.544 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1999999999999998e-07 2023-09-30T17:03:40.544 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.544 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.544 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:40.544 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.511039+0000", 2023-09-30T17:03:40.544 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1763000000000001e-05 2023-09-30T17:03:40.544 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.544 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.544 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:40.544 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.511050+0000", 2023-09-30T17:03:40.545 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0944000000000001e-05 2023-09-30T17:03:40.545 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.545 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.545 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:40.545 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.511058+0000", 2023-09-30T17:03:40.545 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7559999999999999e-06 2023-09-30T17:03:40.545 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.545 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.545 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:40.545 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.511098+0000", 2023-09-30T17:03:40.545 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0565000000000002e-05 2023-09-30T17:03:40.545 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.546 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.546 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:40.546 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.511148+0000", 2023-09-30T17:03:40.546 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9172999999999998e-05 2023-09-30T17:03:40.546 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:40.546 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:40.546 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:40.546 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.546 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.546 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:28708 4.35 4:af28909f:::100000001f8.0000001b:head [write 1024000~4096 in=4096b,write 1236992~4096 in=4096b,write 1351680~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:40.546 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:40.511297+0000", 2023-09-30T17:03:40.547 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9995718, 2023-09-30T17:03:40.547 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00023341900000000001, 2023-09-30T17:03:40.547 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:40.547 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:40.547 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:40.547 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:40.547 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:40.547 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 28708 2023-09-30T17:03:40.547 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.547 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:40.547 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.547 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:40.547 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.511297+0000", 2023-09-30T17:03:40.548 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:40.548 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.548 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.548 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:40.548 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.511297+0000", 2023-09-30T17:03:40.548 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:40.548 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.548 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.548 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:40.548 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.511298+0000", 2023-09-30T17:03:40.548 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4000000000000001e-07 2023-09-30T17:03:40.549 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.549 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.549 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:40.549 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.511317+0000", 2023-09-30T17:03:40.549 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9559e-05 2023-09-30T17:03:40.549 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.549 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.549 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:40.549 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.511326+0000", 2023-09-30T17:03:40.549 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1390000000000001e-06 2023-09-30T17:03:40.550 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.550 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.550 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:40.550 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.511334+0000", 2023-09-30T17:03:40.550 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6529999999999994e-06 2023-09-30T17:03:40.550 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.550 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.550 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:40.550 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.511387+0000", 2023-09-30T17:03:40.550 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2865999999999998e-05 2023-09-30T17:03:40.550 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:40.550 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:40.551 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:40.551 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:40.511478+0000", 2023-09-30T17:03:40.551 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0807e-05 2023-09-30T17:03:40.551 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:40.551 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:40.551 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:40.551 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:40.551 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2023-09-30T17:03:40.551 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 8 2023-09-30T17:03:40.552 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:40.553 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:03:40.553 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:40.553+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:40.594 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:03:40.623 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:03:40.624 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-09-30T17:03:40.624 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-09-30T17:03:40.624 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:03:40.627 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:03:40.628 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:03:40.654 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:40.653+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:40.726 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:40.726 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:40.740 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:03:40.781 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:40.780+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:40.854 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:40.855+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:40.955 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:40.956+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:40.961 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:40.961 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:40.976 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:03:41.056 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:41.056+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:41.157 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:41.156+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:41.163 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:41.163 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:41.178 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:03:41.257 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:41.258+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:41.359 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:41.358+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:41.366 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:41.366 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:41.380 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:03:41.423 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is set 2023-09-30T17:03:41.464 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:41.465+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:41.560 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:41.560+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:41.617 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:41.617 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:41.628 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:03:41.669 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:41.670+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:41.762 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:41.762+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:41.810 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:41.810 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:41.824 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:03:41.962 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:41.962 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:41.963 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:41.963+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:41.972 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:03:42.094 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:41.867+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:42.095 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:42.063+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:42.102 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:42.102 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:42.120 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:03:42.165 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:42.165+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:42.265 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:42.266+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:42.316 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:42.316 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:42.331 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:03:42.366 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:42.365+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:42.467 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:42.467+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:42.568 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:42.567+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:42.569 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:42.569 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:42.583 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:03:42.629 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-09-30T17:03:42.669 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:42.669+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:42.770 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:42.771+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:42.811 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:03:42.817 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:42.817 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 20, 2023-09-30T17:03:42.817 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 600, 2023-09-30T17:03:42.817 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:03:42.817 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.817 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23704 4.14 4:2b28d75f:::100000001f8.00000016:head [write 262144~4096,write 274432~4096,write 405504~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:42.817 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.711008+0000", 2023-09-30T17:03:42.817 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4.1032565759999997, 2023-09-30T17:03:42.817 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.229109541, 2023-09-30T17:03:42.817 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:42.817 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:42.818 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:42.818 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:42.818 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:42.818 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23704 2023-09-30T17:03:42.818 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.818 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:42.818 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.818 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:42.818 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711008+0000", 2023-09-30T17:03:42.818 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:42.818 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.819 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.819 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:42.819 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711008+0000", 2023-09-30T17:03:42.819 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:42.819 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.819 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.819 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:42.819 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711009+0000", 2023-09-30T17:03:42.819 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5899999999999995e-07 2023-09-30T17:03:42.819 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.819 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.819 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:42.820 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711042+0000", 2023-09-30T17:03:42.820 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3149999999999999e-05 2023-09-30T17:03:42.820 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.820 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.820 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:42.820 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711054+0000", 2023-09-30T17:03:42.820 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1742999999999999e-05 2023-09-30T17:03:42.820 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.820 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.820 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:42.820 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711059+0000", 2023-09-30T17:03:42.820 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3009999999999997e-06 2023-09-30T17:03:42.821 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.821 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.821 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:42.821 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711120+0000", 2023-09-30T17:03:42.821 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1228000000000004e-05 2023-09-30T17:03:42.821 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.821 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.821 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:42.821 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711205+0000", 2023-09-30T17:03:42.821 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4489999999999999e-05 2023-09-30T17:03:42.821 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.822 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.822 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:42.822 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711371+0000", 2023-09-30T17:03:42.822 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016639500000000001 2023-09-30T17:03:42.822 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.822 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.822 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:42.822 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.716551+0000", 2023-09-30T17:03:42.822 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051799929999999999 2023-09-30T17:03:42.822 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.822 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.822 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:42.823 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.940040+0000", 2023-09-30T17:03:42.823 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22348859800000001 2023-09-30T17:03:42.823 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.823 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.823 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:42.823 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.940080+0000", 2023-09-30T17:03:42.823 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0114999999999998e-05 2023-09-30T17:03:42.823 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.823 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.823 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:42.823 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.940118+0000", 2023-09-30T17:03:42.824 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7768999999999997e-05 2023-09-30T17:03:42.824 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:42.824 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:42.824 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:42.824 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.824 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.824 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23713 4.33 4:cf6d7a6c:::100000001f8.0000000a:head [write 585728~4096,write 925696~4096,write 937984~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:42.824 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.714948+0000", 2023-09-30T17:03:42.824 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4.0993168620000002, 2023-09-30T17:03:42.824 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23061467099999999, 2023-09-30T17:03:42.824 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:42.824 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:42.825 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:42.825 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:42.825 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:42.825 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23713 2023-09-30T17:03:42.825 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.825 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:42.825 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.825 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:42.825 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.714948+0000", 2023-09-30T17:03:42.825 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:42.825 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.825 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.826 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:42.826 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.714948+0000", 2023-09-30T17:03:42.826 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:42.826 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.826 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.826 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:42.826 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.714949+0000", 2023-09-30T17:03:42.826 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1399999999999995e-07 2023-09-30T17:03:42.826 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.826 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.826 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:42.827 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.714961+0000", 2023-09-30T17:03:42.827 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1916000000000001e-05 2023-09-30T17:03:42.827 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.827 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.827 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:42.827 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.714979+0000", 2023-09-30T17:03:42.827 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8070000000000001e-05 2023-09-30T17:03:42.827 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.827 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.827 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:42.827 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.714987+0000", 2023-09-30T17:03:42.827 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4179999999999997e-06 2023-09-30T17:03:42.828 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.828 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.828 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:42.828 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.715034+0000", 2023-09-30T17:03:42.828 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6563999999999997e-05 2023-09-30T17:03:42.828 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.828 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.828 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:42.828 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.715083+0000", 2023-09-30T17:03:42.828 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9310000000000001e-05 2023-09-30T17:03:42.828 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.828 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.829 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:42.829 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.715177+0000", 2023-09-30T17:03:42.829 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3525999999999999e-05 2023-09-30T17:03:42.829 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.829 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.829 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:42.829 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.719724+0000", 2023-09-30T17:03:42.829 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0045477210000000002 2023-09-30T17:03:42.829 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.829 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.829 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:42.829 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.945467+0000", 2023-09-30T17:03:42.829 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22574224500000001 2023-09-30T17:03:42.830 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.830 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.830 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:42.830 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.945524+0000", 2023-09-30T17:03:42.830 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7105999999999998e-05 2023-09-30T17:03:42.830 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.830 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.830 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:42.830 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.945563+0000", 2023-09-30T17:03:42.830 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8881000000000003e-05 2023-09-30T17:03:42.830 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:42.831 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:42.831 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:42.831 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.831 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.831 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23735 4.6 4:616d4c41:::100000001f8.00000034:head [write 991232~4096,write 1040384~4096,write 1200128~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:42.831 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.722398+0000", 2023-09-30T17:03:42.831 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4.0918665069999998, 2023-09-30T17:03:42.831 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.230202669, 2023-09-30T17:03:42.831 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:42.831 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:42.831 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:42.831 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:42.832 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:42.832 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23735 2023-09-30T17:03:42.832 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.832 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:42.832 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.832 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:42.832 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722398+0000", 2023-09-30T17:03:42.832 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:42.832 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.832 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.832 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:42.833 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722398+0000", 2023-09-30T17:03:42.833 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:42.833 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.833 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.833 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:42.833 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722399+0000", 2023-09-30T17:03:42.833 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2799999999999996e-07 2023-09-30T17:03:42.833 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.833 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.833 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:42.833 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722423+0000", 2023-09-30T17:03:42.833 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4134e-05 2023-09-30T17:03:42.834 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.834 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.834 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:42.834 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722429+0000", 2023-09-30T17:03:42.834 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4590000000000003e-06 2023-09-30T17:03:42.834 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.834 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.834 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:42.834 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722434+0000", 2023-09-30T17:03:42.834 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1779999999999996e-06 2023-09-30T17:03:42.834 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.835 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.835 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:42.835 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722490+0000", 2023-09-30T17:03:42.835 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6215999999999998e-05 2023-09-30T17:03:42.835 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.835 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.835 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:42.835 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722600+0000", 2023-09-30T17:03:42.835 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00011017 2023-09-30T17:03:42.835 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.835 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.835 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:42.836 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722769+0000", 2023-09-30T17:03:42.836 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0001695 2023-09-30T17:03:42.836 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.836 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.836 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:42.836 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725807+0000", 2023-09-30T17:03:42.836 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0030372120000000001 2023-09-30T17:03:42.836 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.836 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.836 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:42.836 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.952546+0000", 2023-09-30T17:03:42.836 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22673923600000001 2023-09-30T17:03:42.836 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.837 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.837 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:42.837 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.952579+0000", 2023-09-30T17:03:42.837 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3111000000000002e-05 2023-09-30T17:03:42.837 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.837 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.837 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:42.837 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.952601+0000", 2023-09-30T17:03:42.837 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1925000000000001e-05 2023-09-30T17:03:42.837 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:42.837 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:42.837 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:42.838 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.838 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.838 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23738 4.6 4:616d4c41:::100000001f8.00000034:head [write 3043328~4096,write 3055616~4096,write 3080192~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:42.838 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.723439+0000", 2023-09-30T17:03:42.838 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4.0908255340000004, 2023-09-30T17:03:42.838 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23665340400000001, 2023-09-30T17:03:42.838 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:42.838 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:42.838 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:42.838 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:42.838 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:42.838 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23738 2023-09-30T17:03:42.839 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.839 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:42.839 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.839 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:42.839 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723439+0000", 2023-09-30T17:03:42.839 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:42.839 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.839 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.839 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:42.839 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723439+0000", 2023-09-30T17:03:42.839 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:42.839 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.840 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.840 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:42.840 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723440+0000", 2023-09-30T17:03:42.840 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.23e-07 2023-09-30T17:03:42.840 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.840 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.840 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:42.840 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723452+0000", 2023-09-30T17:03:42.840 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2147000000000001e-05 2023-09-30T17:03:42.840 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.840 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.840 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:42.840 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723461+0000", 2023-09-30T17:03:42.841 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3839999999999997e-06 2023-09-30T17:03:42.841 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.841 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.841 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:42.841 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723465+0000", 2023-09-30T17:03:42.841 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7559999999999999e-06 2023-09-30T17:03:42.841 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.841 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.841 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:42.841 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723924+0000", 2023-09-30T17:03:42.841 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00045910299999999999 2023-09-30T17:03:42.841 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.842 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.842 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:42.842 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723970+0000", 2023-09-30T17:03:42.842 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5126999999999997e-05 2023-09-30T17:03:42.842 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.842 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.842 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:42.842 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724057+0000", 2023-09-30T17:03:42.842 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.7142e-05 2023-09-30T17:03:42.842 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.842 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.842 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:42.843 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.726148+0000", 2023-09-30T17:03:42.843 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.002091449 2023-09-30T17:03:42.843 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.843 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.843 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:42.843 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.960040+0000", 2023-09-30T17:03:42.843 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23389163299999999 2023-09-30T17:03:42.843 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.843 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.843 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:42.843 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.960071+0000", 2023-09-30T17:03:42.843 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.133e-05 2023-09-30T17:03:42.844 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.844 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.844 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:42.844 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.960093+0000", 2023-09-30T17:03:42.844 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1509999999999999e-05 2023-09-30T17:03:42.844 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:42.844 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:42.844 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:42.844 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.844 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.844 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23740 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 3780608~4096,write 3788800~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:42.844 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.723994+0000", 2023-09-30T17:03:42.845 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4.090270758, 2023-09-30T17:03:42.845 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.234031238, 2023-09-30T17:03:42.845 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:42.845 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:42.845 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:42.845 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:42.845 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:42.845 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23740 2023-09-30T17:03:42.845 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.845 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:42.845 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.845 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:42.846 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723994+0000", 2023-09-30T17:03:42.846 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:42.846 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.846 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.846 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:42.846 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723994+0000", 2023-09-30T17:03:42.846 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:42.846 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.846 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.846 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:42.846 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723995+0000", 2023-09-30T17:03:42.846 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6000000000000003e-07 2023-09-30T17:03:42.847 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.847 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.847 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:42.847 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724004+0000", 2023-09-30T17:03:42.847 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.4909999999999994e-06 2023-09-30T17:03:42.847 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.847 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.847 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:42.847 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724012+0000", 2023-09-30T17:03:42.847 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4590000000000001e-06 2023-09-30T17:03:42.847 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.847 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.848 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:42.849 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724016+0000", 2023-09-30T17:03:42.849 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9890000000000003e-06 2023-09-30T17:03:42.849 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.849 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.849 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:42.849 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724060+0000", 2023-09-30T17:03:42.850 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4339999999999999e-05 2023-09-30T17:03:42.850 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.850 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.850 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:42.850 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724141+0000", 2023-09-30T17:03:42.850 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1384000000000005e-05 2023-09-30T17:03:42.850 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.850 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.850 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:42.850 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724300+0000", 2023-09-30T17:03:42.850 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015870700000000001 2023-09-30T17:03:42.851 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.851 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.851 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:42.851 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.726182+0000", 2023-09-30T17:03:42.851 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0018816060000000001 2023-09-30T17:03:42.851 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.851 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.851 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:42.851 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.957929+0000", 2023-09-30T17:03:42.851 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23174703399999999 2023-09-30T17:03:42.851 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.851 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.852 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:42.852 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.957983+0000", 2023-09-30T17:03:42.852 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4107999999999998e-05 2023-09-30T17:03:42.852 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.852 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.852 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:42.852 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.958025+0000", 2023-09-30T17:03:42.852 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2360000000000001e-05 2023-09-30T17:03:42.852 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:42.852 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:42.852 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:42.852 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.853 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.853 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23746 4.28 4:15eeb89b:::100000001f8.00000032:head [write 3731456~4096,write 3919872~4096,write 3952640~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:42.853 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.725721+0000", 2023-09-30T17:03:42.853 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4.0885433740000003, 2023-09-30T17:03:42.853 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.24024479800000001, 2023-09-30T17:03:42.853 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:42.853 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:42.853 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:42.853 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:42.853 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:42.853 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23746 2023-09-30T17:03:42.853 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.854 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:42.854 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.854 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:42.854 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725721+0000", 2023-09-30T17:03:42.854 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:42.854 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.854 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.854 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:42.854 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725721+0000", 2023-09-30T17:03:42.854 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:42.854 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.854 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.855 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:42.855 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725722+0000", 2023-09-30T17:03:42.855 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6499999999999999e-07 2023-09-30T17:03:42.855 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.855 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.855 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:42.855 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725732+0000", 2023-09-30T17:03:42.855 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7559999999999994e-06 2023-09-30T17:03:42.855 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.855 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.855 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:42.855 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725738+0000", 2023-09-30T17:03:42.856 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8360000000000003e-06 2023-09-30T17:03:42.856 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.856 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.856 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:42.856 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725746+0000", 2023-09-30T17:03:42.856 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4200000000000001e-06 2023-09-30T17:03:42.856 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.856 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.856 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:42.856 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725805+0000", 2023-09-30T17:03:42.856 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9318999999999999e-05 2023-09-30T17:03:42.856 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.857 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.857 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:42.857 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725904+0000", 2023-09-30T17:03:42.857 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8747999999999997e-05 2023-09-30T17:03:42.857 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.857 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.857 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:42.857 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.726075+0000", 2023-09-30T17:03:42.857 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017153700000000001 2023-09-30T17:03:42.857 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.857 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.857 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:42.858 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.727419+0000", 2023-09-30T17:03:42.858 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001343571 2023-09-30T17:03:42.858 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.858 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.858 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:42.858 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.965839+0000", 2023-09-30T17:03:42.858 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.238420467 2023-09-30T17:03:42.858 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.858 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.858 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:42.858 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.965922+0000", 2023-09-30T17:03:42.858 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2905000000000007e-05 2023-09-30T17:03:42.859 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.859 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.859 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:42.859 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.965966+0000", 2023-09-30T17:03:42.859 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3773999999999998e-05 2023-09-30T17:03:42.859 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:42.859 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:42.859 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:42.859 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.859 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.859 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23757 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 2117632~8192,write 2228224~4096,write 2453504~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:42.859 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.728711+0000", 2023-09-30T17:03:42.860 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4.0855537990000004, 2023-09-30T17:03:42.860 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23330704499999999, 2023-09-30T17:03:42.860 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:42.860 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:42.860 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:42.860 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:42.860 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:42.860 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23757 2023-09-30T17:03:42.860 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.860 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:42.860 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.860 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:42.861 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728711+0000", 2023-09-30T17:03:42.861 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:42.861 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.861 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.861 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:42.861 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728711+0000", 2023-09-30T17:03:42.861 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:42.861 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.861 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.861 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:42.861 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728712+0000", 2023-09-30T17:03:42.861 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4199999999999995e-07 2023-09-30T17:03:42.862 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.862 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.862 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:42.862 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728738+0000", 2023-09-30T17:03:42.862 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.6761e-05 2023-09-30T17:03:42.862 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.862 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.862 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:42.862 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728745+0000", 2023-09-30T17:03:42.862 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9940000000000003e-06 2023-09-30T17:03:42.862 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.862 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.863 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:42.863 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728749+0000", 2023-09-30T17:03:42.863 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.053e-06 2023-09-30T17:03:42.863 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.863 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.863 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:42.863 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728802+0000", 2023-09-30T17:03:42.863 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2918999999999999e-05 2023-09-30T17:03:42.863 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.863 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.863 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:42.863 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728923+0000", 2023-09-30T17:03:42.864 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00012084200000000001 2023-09-30T17:03:42.864 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.864 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.864 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:42.864 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.729101+0000", 2023-09-30T17:03:42.864 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000178226 2023-09-30T17:03:42.864 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.864 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.864 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:42.864 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732207+0000", 2023-09-30T17:03:42.864 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0031059849999999999 2023-09-30T17:03:42.864 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.865 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.865 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:42.865 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.961949+0000", 2023-09-30T17:03:42.865 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.229741842 2023-09-30T17:03:42.865 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.865 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.865 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:42.865 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.961986+0000", 2023-09-30T17:03:42.865 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7147000000000002e-05 2023-09-30T17:03:42.865 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.865 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.865 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:42.866 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.962018+0000", 2023-09-30T17:03:42.866 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.1634000000000002e-05 2023-09-30T17:03:42.866 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:42.866 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:42.866 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:42.866 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.866 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.866 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23768 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 1257472~4096,write 1384448~4096,write 1474560~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:42.866 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.732216+0000", 2023-09-30T17:03:42.866 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4.0820491670000001, 2023-09-30T17:03:42.866 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22951861000000001, 2023-09-30T17:03:42.867 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:42.867 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:42.867 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:42.867 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:42.867 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:42.867 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23768 2023-09-30T17:03:42.867 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.867 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:42.867 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.867 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:42.867 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732216+0000", 2023-09-30T17:03:42.867 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:42.868 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.868 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.868 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:42.868 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732216+0000", 2023-09-30T17:03:42.868 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:42.868 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.868 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.868 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:42.868 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732216+0000", 2023-09-30T17:03:42.868 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.71e-07 2023-09-30T17:03:42.868 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.869 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.869 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:42.869 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732231+0000", 2023-09-30T17:03:42.869 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5007e-05 2023-09-30T17:03:42.869 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.869 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.869 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:42.869 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732239+0000", 2023-09-30T17:03:42.869 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8509999999999999e-06 2023-09-30T17:03:42.869 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.869 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.869 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:42.870 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732244+0000", 2023-09-30T17:03:42.870 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2000000000000002e-06 2023-09-30T17:03:42.870 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.870 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.870 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:42.870 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732285+0000", 2023-09-30T17:03:42.870 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0877000000000002e-05 2023-09-30T17:03:42.870 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.870 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.870 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:42.870 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732331+0000", 2023-09-30T17:03:42.870 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5906999999999999e-05 2023-09-30T17:03:42.871 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.871 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.871 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:42.871 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732421+0000", 2023-09-30T17:03:42.871 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9993000000000004e-05 2023-09-30T17:03:42.871 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.871 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.871 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:42.871 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.737687+0000", 2023-09-30T17:03:42.871 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005265792 2023-09-30T17:03:42.871 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.871 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.872 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:42.872 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.961667+0000", 2023-09-30T17:03:42.872 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22398030799999999 2023-09-30T17:03:42.872 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.872 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.872 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:42.872 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.961703+0000", 2023-09-30T17:03:42.872 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5221e-05 2023-09-30T17:03:42.872 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.872 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.872 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:42.872 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.961734+0000", 2023-09-30T17:03:42.873 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.1582999999999999e-05 2023-09-30T17:03:42.873 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:42.873 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:42.873 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:42.873 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.873 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.873 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23780 4.36 4:6fa85f86:::100000001f8.00000013:head [write 3469312~4096,write 3522560~4096,write 3579904~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:42.873 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.735686+0000", 2023-09-30T17:03:42.873 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4.0785789360000004, 2023-09-30T17:03:42.873 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22921459399999999, 2023-09-30T17:03:42.873 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:42.873 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:42.874 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:42.874 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:42.874 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:42.874 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23780 2023-09-30T17:03:42.874 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.874 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:42.874 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.874 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:42.874 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.735686+0000", 2023-09-30T17:03:42.874 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:42.874 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.875 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.875 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:42.875 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.735686+0000", 2023-09-30T17:03:42.875 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:42.875 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.875 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.875 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:42.875 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.735687+0000", 2023-09-30T17:03:42.875 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3399999999999998e-07 2023-09-30T17:03:42.875 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.875 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.875 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:42.876 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.735701+0000", 2023-09-30T17:03:42.876 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4324999999999999e-05 2023-09-30T17:03:42.876 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.876 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.876 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:42.876 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.735713+0000", 2023-09-30T17:03:42.876 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1678999999999999e-05 2023-09-30T17:03:42.876 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.876 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.876 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:42.876 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.735720+0000", 2023-09-30T17:03:42.876 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8490000000000006e-06 2023-09-30T17:03:42.877 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.877 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.877 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:42.877 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.736637+0000", 2023-09-30T17:03:42.877 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00091620799999999995 2023-09-30T17:03:42.877 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.877 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.877 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:42.877 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.736719+0000", 2023-09-30T17:03:42.877 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2608999999999995e-05 2023-09-30T17:03:42.877 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.877 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.878 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:42.878 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.736876+0000", 2023-09-30T17:03:42.878 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015636799999999999 2023-09-30T17:03:42.878 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.878 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.878 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:42.878 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.742934+0000", 2023-09-30T17:03:42.878 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0060581619999999997 2023-09-30T17:03:42.878 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.878 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.878 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:42.878 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.964798+0000", 2023-09-30T17:03:42.879 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22186376599999999 2023-09-30T17:03:42.879 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.879 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.879 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:42.879 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.964859+0000", 2023-09-30T17:03:42.879 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1668000000000007e-05 2023-09-30T17:03:42.879 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.879 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.879 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:42.879 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.964900+0000", 2023-09-30T17:03:42.879 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1125999999999999e-05 2023-09-30T17:03:42.879 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:42.880 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:42.880 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:42.880 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.880 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.880 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23856 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 3538944~4096,write 3616768~4096,write 3686400~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:42.880 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.759274+0000", 2023-09-30T17:03:42.880 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4.0549910550000003, 2023-09-30T17:03:42.880 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.234084127, 2023-09-30T17:03:42.880 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:42.880 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:42.880 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:42.880 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:42.881 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:42.881 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23856 2023-09-30T17:03:42.881 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.881 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:42.881 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.881 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:42.881 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759274+0000", 2023-09-30T17:03:42.881 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:42.881 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.881 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.881 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:42.881 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759274+0000", 2023-09-30T17:03:42.882 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:42.882 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.882 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.882 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:42.882 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759274+0000", 2023-09-30T17:03:42.882 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7899999999999998e-07 2023-09-30T17:03:42.882 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.882 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.882 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:42.882 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759293+0000", 2023-09-30T17:03:42.882 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8410000000000002e-05 2023-09-30T17:03:42.883 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.883 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.883 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:42.883 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759302+0000", 2023-09-30T17:03:42.883 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8599999999999999e-06 2023-09-30T17:03:42.883 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.883 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.883 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:42.883 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759306+0000", 2023-09-30T17:03:42.883 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4499999999999997e-06 2023-09-30T17:03:42.883 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.883 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.884 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:42.884 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759984+0000", 2023-09-30T17:03:42.884 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00067830600000000005 2023-09-30T17:03:42.884 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.884 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.884 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:42.884 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.760041+0000", 2023-09-30T17:03:42.884 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.643e-05 2023-09-30T17:03:42.884 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.884 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.884 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:42.884 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.760135+0000", 2023-09-30T17:03:42.885 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3795999999999994e-05 2023-09-30T17:03:42.885 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.885 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.885 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:42.885 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764097+0000", 2023-09-30T17:03:42.885 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0039625629999999997 2023-09-30T17:03:42.885 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.885 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.885 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:42.885 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993282+0000", 2023-09-30T17:03:42.885 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22918461500000001 2023-09-30T17:03:42.885 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.886 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.886 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:42.886 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993320+0000", 2023-09-30T17:03:42.886 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8600999999999999e-05 2023-09-30T17:03:42.886 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.886 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.886 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:42.886 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993358+0000", 2023-09-30T17:03:42.886 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7517e-05 2023-09-30T17:03:42.886 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:42.887 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:42.887 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:42.887 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.887 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.887 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23865 4.36 4:6da220e6:::100000001f8.0000003f:head [write 3715072~4096,write 3850240~4096,write 4059136~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:42.887 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.761946+0000", 2023-09-30T17:03:42.887 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4.0523185699999997, 2023-09-30T17:03:42.887 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.231486097, 2023-09-30T17:03:42.887 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:42.887 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:42.887 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:42.887 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:42.888 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:42.888 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23865 2023-09-30T17:03:42.888 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.888 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:42.888 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.888 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:42.888 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.761946+0000", 2023-09-30T17:03:42.888 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:42.888 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.888 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.888 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:42.888 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.761946+0000", 2023-09-30T17:03:42.889 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:42.889 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.889 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.889 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:42.889 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.761947+0000", 2023-09-30T17:03:42.889 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7000000000000004e-07 2023-09-30T17:03:42.889 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.889 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.889 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:42.889 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.761959+0000", 2023-09-30T17:03:42.889 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2265e-05 2023-09-30T17:03:42.889 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.890 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.890 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:42.890 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.761970+0000", 2023-09-30T17:03:42.890 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0474e-05 2023-09-30T17:03:42.890 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.890 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.890 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:42.890 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.761976+0000", 2023-09-30T17:03:42.890 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1340000000000001e-06 2023-09-30T17:03:42.890 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.890 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.891 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:42.891 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.762063+0000", 2023-09-30T17:03:42.891 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.6728e-05 2023-09-30T17:03:42.891 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.891 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.891 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:42.891 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.762125+0000", 2023-09-30T17:03:42.891 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2869999999999999e-05 2023-09-30T17:03:42.891 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.891 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.891 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:42.891 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.762235+0000", 2023-09-30T17:03:42.892 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000109139 2023-09-30T17:03:42.892 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.892 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.892 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:42.892 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764102+0000", 2023-09-30T17:03:42.892 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001867121 2023-09-30T17:03:42.892 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.892 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.892 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:42.892 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993327+0000", 2023-09-30T17:03:42.892 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22922526800000001 2023-09-30T17:03:42.892 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.893 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.893 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:42.893 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993391+0000", 2023-09-30T17:03:42.893 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3839999999999999e-05 2023-09-30T17:03:42.893 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.893 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.893 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:42.893 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993432+0000", 2023-09-30T17:03:42.893 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1488e-05 2023-09-30T17:03:42.893 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:42.893 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:42.893 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:42.894 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.894 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.894 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23875 4.36 4:6da220e6:::100000001f8.0000003f:head [write 364544~4096,write 499712~4096,write 655360~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:42.894 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.764904+0000", 2023-09-30T17:03:42.894 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4.049360386, 2023-09-30T17:03:42.894 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.228631693, 2023-09-30T17:03:42.894 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:42.894 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:42.894 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:42.894 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:42.894 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:42.894 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23875 2023-09-30T17:03:42.895 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.895 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:42.895 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.895 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:42.895 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764904+0000", 2023-09-30T17:03:42.895 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:42.895 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.895 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.895 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:42.895 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764904+0000", 2023-09-30T17:03:42.895 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:42.895 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.896 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.896 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:42.896 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764905+0000", 2023-09-30T17:03:42.896 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2799999999999995e-07 2023-09-30T17:03:42.896 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.896 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.896 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:42.896 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764915+0000", 2023-09-30T17:03:42.896 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8099999999999992e-06 2023-09-30T17:03:42.896 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.896 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.896 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:42.897 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764926+0000", 2023-09-30T17:03:42.897 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0858e-05 2023-09-30T17:03:42.897 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.897 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.897 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:42.897 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764931+0000", 2023-09-30T17:03:42.897 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2170000000000002e-06 2023-09-30T17:03:42.897 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.897 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.897 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:42.897 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764963+0000", 2023-09-30T17:03:42.897 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.2319e-05 2023-09-30T17:03:42.898 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.898 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.898 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:42.898 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.765009+0000", 2023-09-30T17:03:42.898 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5753000000000001e-05 2023-09-30T17:03:42.898 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.898 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.898 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:42.898 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.765093+0000", 2023-09-30T17:03:42.898 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4259999999999996e-05 2023-09-30T17:03:42.898 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.898 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.899 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:42.899 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766238+0000", 2023-09-30T17:03:42.899 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0011442550000000001 2023-09-30T17:03:42.899 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.899 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.899 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:42.899 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993469+0000", 2023-09-30T17:03:42.899 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22723121800000001 2023-09-30T17:03:42.899 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.899 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.899 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:42.899 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993501+0000", 2023-09-30T17:03:42.900 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.2576000000000001e-05 2023-09-30T17:03:42.900 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.900 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.900 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:42.900 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993536+0000", 2023-09-30T17:03:42.900 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4699000000000001e-05 2023-09-30T17:03:42.900 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:42.900 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:42.900 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:42.900 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.900 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.900 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23881 4.36 4:6da220e6:::100000001f8.0000003f:head [write 3366912~4096,write 3694592~4096,write 4071424~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:42.901 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.766444+0000", 2023-09-30T17:03:42.901 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4.0478209649999997, 2023-09-30T17:03:42.901 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23475070200000001, 2023-09-30T17:03:42.901 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:42.901 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:42.901 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:42.901 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:42.901 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:42.901 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23881 2023-09-30T17:03:42.901 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.901 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:42.901 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.902 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:42.902 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766444+0000", 2023-09-30T17:03:42.902 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:42.902 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.902 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.902 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:42.902 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766444+0000", 2023-09-30T17:03:42.902 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:42.902 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.902 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.902 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:42.902 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766444+0000", 2023-09-30T17:03:42.903 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3e-07 2023-09-30T17:03:42.903 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.903 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.903 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:42.903 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766455+0000", 2023-09-30T17:03:42.903 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0454e-05 2023-09-30T17:03:42.903 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.903 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.903 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:42.903 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766469+0000", 2023-09-30T17:03:42.903 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3568e-05 2023-09-30T17:03:42.903 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.904 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.904 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:42.904 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766474+0000", 2023-09-30T17:03:42.904 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1669999999999998e-06 2023-09-30T17:03:42.904 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.904 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.904 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:42.904 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766527+0000", 2023-09-30T17:03:42.904 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3650000000000003e-05 2023-09-30T17:03:42.904 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.904 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.904 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:42.904 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766611+0000", 2023-09-30T17:03:42.905 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3230000000000001e-05 2023-09-30T17:03:42.905 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.905 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.905 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:42.905 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766767+0000", 2023-09-30T17:03:42.905 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015688 2023-09-30T17:03:42.905 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.905 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.905 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:42.905 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.770254+0000", 2023-09-30T17:03:42.905 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0034870090000000001 2023-09-30T17:03:42.905 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.906 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.906 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:42.906 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.001100+0000", 2023-09-30T17:03:42.906 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23084518700000001 2023-09-30T17:03:42.906 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.906 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.906 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:42.906 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.001154+0000", 2023-09-30T17:03:42.906 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4453000000000002e-05 2023-09-30T17:03:42.906 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.906 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.906 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:42.907 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.001194+0000", 2023-09-30T17:03:42.907 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0373999999999997e-05 2023-09-30T17:03:42.907 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:42.907 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:42.907 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:42.907 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.907 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.907 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23901 4.6 4:63e80496:::100000001f8.0000001e:head [write 2617344~4096,write 2646016~4096,write 2662400~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:42.907 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.772204+0000", 2023-09-30T17:03:42.907 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4.0420609479999996, 2023-09-30T17:03:42.907 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.228858799, 2023-09-30T17:03:42.907 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:42.908 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:42.908 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:42.908 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:42.908 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:42.908 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23901 2023-09-30T17:03:42.908 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.908 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:42.908 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.908 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:42.908 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772204+0000", 2023-09-30T17:03:42.908 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:42.908 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.909 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.909 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:42.909 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772204+0000", 2023-09-30T17:03:42.909 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:42.909 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.909 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.909 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:42.909 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772205+0000", 2023-09-30T17:03:42.909 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3600000000000002e-07 2023-09-30T17:03:42.909 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.909 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.909 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:42.910 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772217+0000", 2023-09-30T17:03:42.910 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2459999999999999e-05 2023-09-30T17:03:42.910 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.910 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.910 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:42.910 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772228+0000", 2023-09-30T17:03:42.910 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0614e-05 2023-09-30T17:03:42.910 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.910 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.910 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:42.910 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772236+0000", 2023-09-30T17:03:42.910 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7610000000000007e-06 2023-09-30T17:03:42.911 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.911 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.911 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:42.911 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772280+0000", 2023-09-30T17:03:42.911 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4360000000000002e-05 2023-09-30T17:03:42.911 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.911 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.911 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:42.911 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772328+0000", 2023-09-30T17:03:42.911 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8041000000000003e-05 2023-09-30T17:03:42.911 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.911 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.912 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:42.912 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772417+0000", 2023-09-30T17:03:42.912 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9226000000000003e-05 2023-09-30T17:03:42.912 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.912 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.912 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:42.912 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.774997+0000", 2023-09-30T17:03:42.912 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0025795039999999998 2023-09-30T17:03:42.912 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.912 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.912 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:42.913 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.000979+0000", 2023-09-30T17:03:42.913 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22598211700000001 2023-09-30T17:03:42.913 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.913 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.913 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:42.913 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.001025+0000", 2023-09-30T17:03:42.913 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6347999999999997e-05 2023-09-30T17:03:42.913 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.913 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.913 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:42.913 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.001063+0000", 2023-09-30T17:03:42.913 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7431999999999997e-05 2023-09-30T17:03:42.913 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:42.914 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:42.914 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:42.914 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.914 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.914 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23924 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 1196032~4096,write 1249280~4096,write 1294336~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:42.914 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.778807+0000", 2023-09-30T17:03:42.914 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4.0354580889999996, 2023-09-30T17:03:42.914 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23068708600000001, 2023-09-30T17:03:42.914 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:42.914 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:42.914 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:42.915 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:42.915 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:42.915 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23924 2023-09-30T17:03:42.915 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.915 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:42.915 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.915 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:42.915 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778807+0000", 2023-09-30T17:03:42.915 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:42.915 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.915 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.915 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:42.916 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778807+0000", 2023-09-30T17:03:42.916 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:42.916 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.916 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.916 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:42.916 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778807+0000", 2023-09-30T17:03:42.916 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3600000000000003e-07 2023-09-30T17:03:42.916 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.916 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.916 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:42.916 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778832+0000", 2023-09-30T17:03:42.916 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4905999999999998e-05 2023-09-30T17:03:42.917 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.917 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.917 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:42.917 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778839+0000", 2023-09-30T17:03:42.917 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.097e-06 2023-09-30T17:03:42.917 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.917 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.917 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:42.917 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778843+0000", 2023-09-30T17:03:42.917 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8279999999999996e-06 2023-09-30T17:03:42.917 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.917 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.918 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:42.918 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778875+0000", 2023-09-30T17:03:42.918 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.1792000000000003e-05 2023-09-30T17:03:42.918 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.918 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.918 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:42.918 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778922+0000", 2023-09-30T17:03:42.918 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7034999999999999e-05 2023-09-30T17:03:42.918 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.918 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.918 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:42.918 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.779010+0000", 2023-09-30T17:03:42.918 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8305000000000002e-05 2023-09-30T17:03:42.919 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.919 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.919 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:42.919 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.781442+0000", 2023-09-30T17:03:42.919 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0024313550000000001 2023-09-30T17:03:42.919 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.919 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.919 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:42.919 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.009433+0000", 2023-09-30T17:03:42.919 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.227991044 2023-09-30T17:03:42.919 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.919 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.920 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:42.920 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.009471+0000", 2023-09-30T17:03:42.920 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8720999999999997e-05 2023-09-30T17:03:42.920 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.920 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.920 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:42.920 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.009494+0000", 2023-09-30T17:03:42.920 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2367000000000001e-05 2023-09-30T17:03:42.920 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:42.920 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:42.920 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:42.921 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.921 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.921 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23990 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 4157440~4096,write 4186112~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:42.921 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.798667+0000", 2023-09-30T17:03:42.921 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4.0155975740000001, 2023-09-30T17:03:42.921 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23029929399999999, 2023-09-30T17:03:42.921 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:42.921 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:42.921 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:42.921 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:42.921 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:42.921 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23990 2023-09-30T17:03:42.921 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.922 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:42.922 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.922 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:42.922 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798667+0000", 2023-09-30T17:03:42.922 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:42.922 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.922 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.922 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:42.922 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798667+0000", 2023-09-30T17:03:42.922 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:42.922 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.923 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.923 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:42.923 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798668+0000", 2023-09-30T17:03:42.923 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7000000000000005e-07 2023-09-30T17:03:42.923 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.923 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.923 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:42.923 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798675+0000", 2023-09-30T17:03:42.923 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1269999999999997e-06 2023-09-30T17:03:42.923 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.923 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.923 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:42.924 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798681+0000", 2023-09-30T17:03:42.924 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3500000000000002e-06 2023-09-30T17:03:42.924 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.924 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.924 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:42.924 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798685+0000", 2023-09-30T17:03:42.924 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.63e-06 2023-09-30T17:03:42.924 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.924 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.924 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:42.924 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798726+0000", 2023-09-30T17:03:42.924 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.163e-05 2023-09-30T17:03:42.924 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.925 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.925 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:42.925 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798790+0000", 2023-09-30T17:03:42.925 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3781999999999993e-05 2023-09-30T17:03:42.925 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.925 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.925 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:42.925 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798933+0000", 2023-09-30T17:03:42.925 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014272199999999999 2023-09-30T17:03:42.925 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.925 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.926 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:42.926 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.802788+0000", 2023-09-30T17:03:42.926 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.003855509 2023-09-30T17:03:42.926 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.926 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.926 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:42.926 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.028891+0000", 2023-09-30T17:03:42.926 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.226102847 2023-09-30T17:03:42.926 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.926 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.926 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:42.926 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.028945+0000", 2023-09-30T17:03:42.927 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3600000000000002e-05 2023-09-30T17:03:42.927 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.927 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.927 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:42.927 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.028966+0000", 2023-09-30T17:03:42.927 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1526999999999999e-05 2023-09-30T17:03:42.927 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:42.927 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:42.927 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:42.927 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.927 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.927 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23991 4.6 4:63e80496:::100000001f8.0000001e:head [write 327680~4096,write 335872~4096,write 491520~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:42.928 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.798864+0000", 2023-09-30T17:03:42.928 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4.0154009899999998, 2023-09-30T17:03:42.928 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23025762699999999, 2023-09-30T17:03:42.928 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:42.928 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:42.928 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:42.928 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:42.928 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:42.928 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23991 2023-09-30T17:03:42.928 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.928 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:42.928 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.929 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:42.929 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798864+0000", 2023-09-30T17:03:42.929 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:42.929 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.929 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.929 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:42.929 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798864+0000", 2023-09-30T17:03:42.929 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:42.929 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.929 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.929 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:42.929 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798864+0000", 2023-09-30T17:03:42.930 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3099999999999998e-07 2023-09-30T17:03:42.930 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.930 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.930 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:42.930 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798873+0000", 2023-09-30T17:03:42.930 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4789999999999996e-06 2023-09-30T17:03:42.930 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.930 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.930 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:42.930 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798878+0000", 2023-09-30T17:03:42.930 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6579999999999999e-06 2023-09-30T17:03:42.930 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.931 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.931 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:42.931 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798882+0000", 2023-09-30T17:03:42.931 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.985e-06 2023-09-30T17:03:42.931 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.931 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.931 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:42.931 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.799659+0000", 2023-09-30T17:03:42.931 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00077693900000000004 2023-09-30T17:03:42.931 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.931 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.931 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:42.932 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.799712+0000", 2023-09-30T17:03:42.932 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2694000000000001e-05 2023-09-30T17:03:42.932 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.932 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.932 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:42.932 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.799796+0000", 2023-09-30T17:03:42.932 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3943999999999995e-05 2023-09-30T17:03:42.932 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.932 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.932 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:42.932 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.802821+0000", 2023-09-30T17:03:42.932 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0030251850000000001 2023-09-30T17:03:42.932 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.933 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.933 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:42.933 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.029027+0000", 2023-09-30T17:03:42.933 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22620609999999999 2023-09-30T17:03:42.933 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.933 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.933 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:42.933 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.029083+0000", 2023-09-30T17:03:42.933 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5926e-05 2023-09-30T17:03:42.933 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.945 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.945 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:42.945 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.029121+0000", 2023-09-30T17:03:42.945 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8186000000000003e-05 2023-09-30T17:03:42.945 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:42.945 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:42.946 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:42.946 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.946 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.946 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:24052 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 3448832~4096,write 3493888~4096,write 3502080~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:42.946 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.817515+0000", 2023-09-30T17:03:42.946 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 3.9967496799999997, 2023-09-30T17:03:42.946 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23184106800000001, 2023-09-30T17:03:42.946 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:42.946 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:42.946 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:42.946 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:42.946 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:42.947 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 24052 2023-09-30T17:03:42.947 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.947 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:42.947 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.947 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:42.947 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.817515+0000", 2023-09-30T17:03:42.947 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:42.947 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.947 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.947 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:42.947 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.817515+0000", 2023-09-30T17:03:42.947 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:42.948 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.948 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.948 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:42.948 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.817516+0000", 2023-09-30T17:03:42.948 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9899999999999999e-07 2023-09-30T17:03:42.948 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.948 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.948 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:42.948 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.817531+0000", 2023-09-30T17:03:42.948 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5483000000000001e-05 2023-09-30T17:03:42.948 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.948 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.949 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:42.949 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.817545+0000", 2023-09-30T17:03:42.949 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3209e-05 2023-09-30T17:03:42.949 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.949 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.949 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:42.949 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.817553+0000", 2023-09-30T17:03:42.949 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.994e-06 2023-09-30T17:03:42.949 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.949 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.949 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:42.949 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.818753+0000", 2023-09-30T17:03:42.950 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0012000909999999999 2023-09-30T17:03:42.950 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.950 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.950 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:42.950 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.818838+0000", 2023-09-30T17:03:42.950 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5389999999999994e-05 2023-09-30T17:03:42.950 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.950 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.950 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:42.950 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.818996+0000", 2023-09-30T17:03:42.950 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000158116 2023-09-30T17:03:42.951 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.951 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.951 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:42.951 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.822334+0000", 2023-09-30T17:03:42.951 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0033373230000000001 2023-09-30T17:03:42.951 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.951 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.951 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:42.951 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049259+0000", 2023-09-30T17:03:42.951 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22692517400000001 2023-09-30T17:03:42.951 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.951 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.961 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:42.961 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049323+0000", 2023-09-30T17:03:42.961 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4348000000000001e-05 2023-09-30T17:03:42.961 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.961 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.961 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:42.961 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049356+0000", 2023-09-30T17:03:42.961 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3040999999999998e-05 2023-09-30T17:03:42.962 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:42.962 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:42.962 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:42.962 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.962 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.962 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:24058 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 172032~4096,write 200704~4096,write 249856~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:42.962 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.819363+0000", 2023-09-30T17:03:42.962 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 3.9949022039999997, 2023-09-30T17:03:42.962 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23030741099999999, 2023-09-30T17:03:42.962 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:42.962 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:42.962 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:42.963 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:42.963 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:42.963 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 24058 2023-09-30T17:03:42.963 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.963 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:42.963 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.963 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:42.963 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819363+0000", 2023-09-30T17:03:42.963 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:42.963 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.963 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.964 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:42.964 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819363+0000", 2023-09-30T17:03:42.964 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:42.964 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.964 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.964 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:42.964 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819363+0000", 2023-09-30T17:03:42.964 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8400000000000003e-07 2023-09-30T17:03:42.964 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.964 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.964 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:42.964 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819373+0000", 2023-09-30T17:03:42.965 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.9930000000000007e-06 2023-09-30T17:03:42.965 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.965 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.965 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:42.965 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819383+0000", 2023-09-30T17:03:42.965 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.4059999999999994e-06 2023-09-30T17:03:42.965 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.965 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.965 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:42.965 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819388+0000", 2023-09-30T17:03:42.965 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3299999999999998e-06 2023-09-30T17:03:42.965 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.966 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.966 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:42.966 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819584+0000", 2023-09-30T17:03:42.966 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00019642600000000001 2023-09-30T17:03:42.966 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.966 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.966 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:42.966 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819627+0000", 2023-09-30T17:03:42.966 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2150999999999997e-05 2023-09-30T17:03:42.966 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.966 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.967 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:42.967 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819712+0000", 2023-09-30T17:03:42.967 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5255999999999998e-05 2023-09-30T17:03:42.967 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.967 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.967 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:42.967 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.822340+0000", 2023-09-30T17:03:42.967 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0026283029999999998 2023-09-30T17:03:42.967 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.967 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.967 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:42.967 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049621+0000", 2023-09-30T17:03:42.968 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.227281176 2023-09-30T17:03:42.968 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.968 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.968 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:42.968 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049652+0000", 2023-09-30T17:03:42.968 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0528000000000003e-05 2023-09-30T17:03:42.968 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.968 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.968 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:42.968 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049670+0000", 2023-09-30T17:03:42.968 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8057999999999999e-05 2023-09-30T17:03:42.969 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:42.969 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:42.969 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:42.969 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.969 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.969 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:24064 4.6 4:616d4c41:::100000001f8.00000034:head [write 4132864~4096,write 4173824~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:42.970 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.820931+0000", 2023-09-30T17:03:42.970 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 3.9933338430000003, 2023-09-30T17:03:42.970 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22854920400000001, 2023-09-30T17:03:42.970 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:42.970 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:42.970 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:42.970 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:42.971 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:42.971 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 24064 2023-09-30T17:03:42.971 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.971 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:42.971 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.971 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:42.971 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.820931+0000", 2023-09-30T17:03:42.971 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:42.971 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.971 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.971 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:42.972 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.820931+0000", 2023-09-30T17:03:42.972 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:42.972 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.972 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.972 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:42.972 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.820932+0000", 2023-09-30T17:03:42.972 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4300000000000002e-07 2023-09-30T17:03:42.972 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.972 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.972 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:42.972 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.820941+0000", 2023-09-30T17:03:42.972 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.5650000000000007e-06 2023-09-30T17:03:42.973 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.973 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.973 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:42.973 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.820952+0000", 2023-09-30T17:03:42.973 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0566e-05 2023-09-30T17:03:42.973 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.973 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.973 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:42.973 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.820957+0000", 2023-09-30T17:03:42.973 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3800000000000002e-06 2023-09-30T17:03:42.973 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.973 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.974 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:42.974 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.821008+0000", 2023-09-30T17:03:42.974 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1070999999999999e-05 2023-09-30T17:03:42.974 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.974 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.974 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:42.974 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.821075+0000", 2023-09-30T17:03:42.974 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.648e-05 2023-09-30T17:03:42.974 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.974 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.974 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:42.974 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.821236+0000", 2023-09-30T17:03:42.975 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016120899999999999 2023-09-30T17:03:42.975 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.975 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.975 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:42.975 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.823356+0000", 2023-09-30T17:03:42.975 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.002120458 2023-09-30T17:03:42.975 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.975 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.975 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:42.975 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049389+0000", 2023-09-30T17:03:42.975 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22603278199999999 2023-09-30T17:03:42.975 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.976 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.976 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:42.976 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049443+0000", 2023-09-30T17:03:42.976 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4033000000000003e-05 2023-09-30T17:03:42.976 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:42.976 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:42.976 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:42.976 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049480+0000", 2023-09-30T17:03:42.976 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6816999999999997e-05 2023-09-30T17:03:42.976 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:42.976 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:42.976 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:42.977 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:42.977 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:42.977 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:42.978 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:03:42.978 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:42.977+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:42.979 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:03:42.981 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:03:42.981 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-09-30T17:03:42.981 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-09-30T17:03:42.981 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:03:42.981 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:03:43.078 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:43.078+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:43.166 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:43.166 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2023-09-30T17:03:43.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.167 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:36103 4.23 4:c6f90462:::100000001f8.00000037:head [write 3100672~4096 in=4096b,write 3121152~4096 in=4096b,write 3137536~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-09-30T17:03:43.167 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:43.161820+0000", 2023-09-30T17:03:43.167 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.004295859, 2023-09-30T17:03:43.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0043168130000000001, 2023-09-30T17:03:43.167 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:43.167 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:43.167 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:43.167 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:43.167 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:43.167 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 36103 2023-09-30T17:03:43.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.167 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:43.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:43.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.161820+0000", 2023-09-30T17:03:43.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:43.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.161820+0000", 2023-09-30T17:03:43.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:43.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.161821+0000", 2023-09-30T17:03:43.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7899999999999997e-07 2023-09-30T17:03:43.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:43.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.161832+0000", 2023-09-30T17:03:43.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0769e-05 2023-09-30T17:03:43.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:43.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.161842+0000", 2023-09-30T17:03:43.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0185e-05 2023-09-30T17:03:43.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.170 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:43.170 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.161850+0000", 2023-09-30T17:03:43.170 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6820000000000003e-06 2023-09-30T17:03:43.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.170 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:43.170 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.161896+0000", 2023-09-30T17:03:43.170 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6309e-05 2023-09-30T17:03:43.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:43.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.161983+0000", 2023-09-30T17:03:43.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6748000000000004e-05 2023-09-30T17:03:43.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:43.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.162127+0000", 2023-09-30T17:03:43.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014413800000000001 2023-09-30T17:03:43.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:43.172 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.163922+0000", 2023-09-30T17:03:43.172 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0017950799999999999 2023-09-30T17:03:43.172 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.172 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:43.172 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.172 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:36109 4.f 4:f0d983b2:::100000001f8.0000001f:head [write 4091904~4096 in=4096b,write 4145152~4096 in=4096b,write 4177920~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-09-30T17:03:43.172 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:43.163703+0000", 2023-09-30T17:03:43.172 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.00241347, 2023-09-30T17:03:43.172 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0025035589999999998, 2023-09-30T17:03:43.172 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:43.173 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:43.173 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:43.173 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:43.173 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:43.173 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 36109 2023-09-30T17:03:43.173 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.173 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:43.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.173 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:43.173 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.163703+0000", 2023-09-30T17:03:43.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.173 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:43.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.163703+0000", 2023-09-30T17:03:43.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:43.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.163704+0000", 2023-09-30T17:03:43.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0500000000000002e-07 2023-09-30T17:03:43.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:43.175 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.163713+0000", 2023-09-30T17:03:43.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6840000000000008e-06 2023-09-30T17:03:43.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.175 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:43.175 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.163724+0000", 2023-09-30T17:03:43.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0339999999999999e-05 2023-09-30T17:03:43.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.175 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:43.175 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.163731+0000", 2023-09-30T17:03:43.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9550000000000003e-06 2023-09-30T17:03:43.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:43.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.163774+0000", 2023-09-30T17:03:43.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3874e-05 2023-09-30T17:03:43.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:43.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.163865+0000", 2023-09-30T17:03:43.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0554000000000001e-05 2023-09-30T17:03:43.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.177 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:43.177 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.164008+0000", 2023-09-30T17:03:43.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014298699999999999 2023-09-30T17:03:43.177 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.177 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:43.177 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.177 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:36110 4.28 e42/17 4:15eeb89b:::100000001f8.00000032:head v 42'1121, mlcod=42'1119)", 2023-09-30T17:03:43.177 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:43.164420+0000", 2023-09-30T17:03:43.177 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.001696616, 2023-09-30T17:03:43.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0018292709999999999, 2023-09-30T17:03:43.178 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:43.178 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:43.178 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:43.178 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.178 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:43.178 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.164420+0000", 2023-09-30T17:03:43.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.178 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.178 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.178 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:43.178 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.164420+0000", 2023-09-30T17:03:43.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:43.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.164420+0000", 2023-09-30T17:03:43.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5799999999999999e-07 2023-09-30T17:03:43.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:43.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.164436+0000", 2023-09-30T17:03:43.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6018000000000001e-05 2023-09-30T17:03:43.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.180 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:43.180 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.164446+0000", 2023-09-30T17:03:43.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2609999999999999e-06 2023-09-30T17:03:43.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.180 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:43.180 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.164452+0000", 2023-09-30T17:03:43.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7789999999999998e-06 2023-09-30T17:03:43.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.180 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:43.180 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.164499+0000", 2023-09-30T17:03:43.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6199000000000003e-05 2023-09-30T17:03:43.181 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.181 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.181 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:43.181 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.164523+0000", 2023-09-30T17:03:43.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4102999999999999e-05 2023-09-30T17:03:43.181 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.181 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:43.181 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.181 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.181 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.181 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:36111 4.2e e42/17 4:75be0f36:::100000001f8.0000003d:head v 42'558, mlcod=42'556)", 2023-09-30T17:03:43.182 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:43.164808+0000", 2023-09-30T17:03:43.182 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0013082899999999999, 2023-09-30T17:03:43.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001482936, 2023-09-30T17:03:43.182 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:43.182 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:43.182 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:43.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.182 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:43.182 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.164808+0000", 2023-09-30T17:03:43.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:43.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.164808+0000", 2023-09-30T17:03:43.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:43.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.164808+0000", 2023-09-30T17:03:43.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8599999999999998e-07 2023-09-30T17:03:43.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:43.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.164822+0000", 2023-09-30T17:03:43.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4076999999999999e-05 2023-09-30T17:03:43.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.184 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:43.184 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.164831+0000", 2023-09-30T17:03:43.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0450000000000001e-06 2023-09-30T17:03:43.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.184 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:43.184 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.164837+0000", 2023-09-30T17:03:43.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1489999999999999e-06 2023-09-30T17:03:43.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.185 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.185 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:43.185 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.164887+0000", 2023-09-30T17:03:43.185 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0661000000000002e-05 2023-09-30T17:03:43.185 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.185 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.185 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:43.185 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.164915+0000", 2023-09-30T17:03:43.185 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7937e-05 2023-09-30T17:03:43.185 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.185 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:43.185 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.186 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.186 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.186 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:36108 4.36 e42/17 4:6fa85f86:::100000001f8.00000013:head v 42'1710, mlcod=42'1707)", 2023-09-30T17:03:43.186 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:43.164856+0000", 2023-09-30T17:03:43.186 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0012606850000000001, 2023-09-30T17:03:43.186 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014721789999999999, 2023-09-30T17:03:43.186 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:43.186 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:43.186 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:43.186 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.186 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:43.186 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.164856+0000", 2023-09-30T17:03:43.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:43.187 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.164856+0000", 2023-09-30T17:03:43.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:43.187 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.164856+0000", 2023-09-30T17:03:43.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1800000000000002e-07 2023-09-30T17:03:43.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.188 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:43.188 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.164872+0000", 2023-09-30T17:03:43.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6402999999999999e-05 2023-09-30T17:03:43.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.188 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:43.188 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.164880+0000", 2023-09-30T17:03:43.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5480000000000004e-06 2023-09-30T17:03:43.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.188 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:43.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.164886+0000", 2023-09-30T17:03:43.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4489999999999996e-06 2023-09-30T17:03:43.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:43.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.164929+0000", 2023-09-30T17:03:43.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2262000000000003e-05 2023-09-30T17:03:43.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:43.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.164957+0000", 2023-09-30T17:03:43.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8762e-05 2023-09-30T17:03:43.190 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.190 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:43.190 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.190 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:36112 4.3b e42/17 4:dcc0c15f:::100000001f8.0000001a:head v 42'574, mlcod=42'572)", 2023-09-30T17:03:43.190 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:43.164901+0000", 2023-09-30T17:03:43.190 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.001215598, 2023-09-30T17:03:43.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014593080000000001, 2023-09-30T17:03:43.190 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:43.190 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:43.191 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:43.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.191 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:43.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.164901+0000", 2023-09-30T17:03:43.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.191 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:43.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.164901+0000", 2023-09-30T17:03:43.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.191 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:43.192 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.164901+0000", 2023-09-30T17:03:43.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1899999999999998e-07 2023-09-30T17:03:43.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:43.192 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.164913+0000", 2023-09-30T17:03:43.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1703e-05 2023-09-30T17:03:43.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:43.192 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.164923+0000", 2023-09-30T17:03:43.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.004e-05 2023-09-30T17:03:43.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:43.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.164928+0000", 2023-09-30T17:03:43.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4589999999999997e-06 2023-09-30T17:03:43.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:43.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.164973+0000", 2023-09-30T17:03:43.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4431000000000002e-05 2023-09-30T17:03:43.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:43.194 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.164993+0000", 2023-09-30T17:03:43.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0842000000000001e-05 2023-09-30T17:03:43.194 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.194 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:43.194 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.194 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:36116 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 696320~4096 in=4096b,write 798720~4096 in=4096b,write 954368~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-09-30T17:03:43.194 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:43.165852+0000", 2023-09-30T17:03:43.194 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.00026399399999999998, 2023-09-30T17:03:43.195 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00056090600000000001, 2023-09-30T17:03:43.195 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:43.195 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:43.195 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:43.195 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:43.195 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:43.195 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 36116 2023-09-30T17:03:43.195 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.195 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:43.195 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.195 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:43.195 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.165852+0000", 2023-09-30T17:03:43.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.196 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.196 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.196 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:43.196 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.165852+0000", 2023-09-30T17:03:43.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.196 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.196 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.196 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:43.196 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.165853+0000", 2023-09-30T17:03:43.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1999999999999998e-07 2023-09-30T17:03:43.196 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.197 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:43.197 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.165868+0000", 2023-09-30T17:03:43.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4747e-05 2023-09-30T17:03:43.197 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.197 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:43.197 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.165878+0000", 2023-09-30T17:03:43.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6150000000000003e-06 2023-09-30T17:03:43.197 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.197 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:43.197 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.165884+0000", 2023-09-30T17:03:43.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6290000000000004e-06 2023-09-30T17:03:43.198 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.198 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.198 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:43.198 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.165914+0000", 2023-09-30T17:03:43.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0331000000000001e-05 2023-09-30T17:03:43.198 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.198 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.198 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:43.198 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.165959+0000", 2023-09-30T17:03:43.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4057000000000002e-05 2023-09-30T17:03:43.198 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:43.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.166078+0000", 2023-09-30T17:03:43.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000119599 2023-09-30T17:03:43.199 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.199 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:43.199 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.199 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:36115 4.28 e42/17 4:15eeb89b:::100000001f8.00000032:head v 42'1122, mlcod=42'1119)", 2023-09-30T17:03:43.199 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:43.166374+0000", 2023-09-30T17:03:43.199 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.999742, 2023-09-30T17:03:43.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000123402, 2023-09-30T17:03:43.200 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:43.200 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:43.200 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:43.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:43.200 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.166374+0000", 2023-09-30T17:03:43.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:43.201 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.166374+0000", 2023-09-30T17:03:43.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.201 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:43.201 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.166374+0000", 2023-09-30T17:03:43.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8100000000000003e-07 2023-09-30T17:03:43.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.201 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:43.201 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.166388+0000", 2023-09-30T17:03:43.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3344e-05 2023-09-30T17:03:43.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.202 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:43.202 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.166396+0000", 2023-09-30T17:03:43.202 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9459999999999998e-06 2023-09-30T17:03:43.202 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.202 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:43.202 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.166400+0000", 2023-09-30T17:03:43.202 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6179999999999997e-06 2023-09-30T17:03:43.202 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.202 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:43.203 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.166447+0000", 2023-09-30T17:03:43.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6508000000000003e-05 2023-09-30T17:03:43.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.203 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.203 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:43.203 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:43.166469+0000", 2023-09-30T17:03:43.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1954e-05 2023-09-30T17:03:43.203 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.203 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:43.203 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.203 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.204 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2023-09-30T17:03:43.204 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 8 2023-09-30T17:03:43.204 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:43.205 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:03:43.205 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:43.205+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:43.306 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:43.306+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:43.407 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:43.406+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:43.426 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:43.426 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:03:43.426 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2023-09-30T17:03:43.427 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2023-09-30T17:03:43.427 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:43.438 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-09-30T17:03:43.442 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:03:43.507 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:43.508+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:43.608 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:43.608+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:43.663 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:43.663 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2023-09-30T17:03:43.663 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2023-09-30T17:03:43.663 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2023-09-30T17:03:43.663 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.663 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:23704 4.14 e41/17 4:2b28d75f:::100000001f8.00000016:head v 41'381, mlcod=41'379)", 2023-09-30T17:03:43.663 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.711674+0000", 2023-09-30T17:03:43.663 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.9490108580000003, 2023-09-30T17:03:43.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.225773745, 2023-09-30T17:03:43.664 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:43.664 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:43.664 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:43.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.664 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:43.664 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.711674+0000", 2023-09-30T17:03:43.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.664 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:43.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.711674+0000", 2023-09-30T17:03:43.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:43.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.711674+0000", 2023-09-30T17:03:43.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2000000000000001e-07 2023-09-30T17:03:43.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:43.666 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.711685+0000", 2023-09-30T17:03:43.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.117e-05 2023-09-30T17:03:43.666 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.666 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:43.666 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.711691+0000", 2023-09-30T17:03:43.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2129999999999996e-06 2023-09-30T17:03:43.666 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.666 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:43.666 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.711696+0000", 2023-09-30T17:03:43.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7339999999999999e-06 2023-09-30T17:03:43.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:43.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713583+0000", 2023-09-30T17:03:43.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0018866219999999999 2023-09-30T17:03:43.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:43.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713603+0000", 2023-09-30T17:03:43.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0142000000000001e-05 2023-09-30T17:03:43.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.668 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:43.668 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.937407+0000", 2023-09-30T17:03:43.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.223804165 2023-09-30T17:03:43.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.668 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:43.668 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.937447+0000", 2023-09-30T17:03:43.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0479000000000003e-05 2023-09-30T17:03:43.669 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.669 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:43.669 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.669 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.669 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:23708 4.14 e41/17 4:2b28d75f:::100000001f8.00000016:head v 41'382, mlcod=41'379)", 2023-09-30T17:03:43.669 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713552+0000", 2023-09-30T17:03:43.669 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.9471320370000003, 2023-09-30T17:03:43.669 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.22392661999999999, 2023-09-30T17:03:43.669 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:43.669 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:43.670 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:43.670 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.670 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:43.670 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713552+0000", 2023-09-30T17:03:43.670 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.670 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.670 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.670 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:43.670 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713552+0000", 2023-09-30T17:03:43.670 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.670 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.671 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.671 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:43.671 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713553+0000", 2023-09-30T17:03:43.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0999999999999999e-07 2023-09-30T17:03:43.671 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.671 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.672 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:43.672 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713564+0000", 2023-09-30T17:03:43.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0851e-05 2023-09-30T17:03:43.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.672 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:43.672 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713570+0000", 2023-09-30T17:03:43.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1480000000000003e-06 2023-09-30T17:03:43.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.672 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:43.672 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713574+0000", 2023-09-30T17:03:43.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.464e-06 2023-09-30T17:03:43.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.673 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:43.673 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.714408+0000", 2023-09-30T17:03:43.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00083399400000000001 2023-09-30T17:03:43.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.673 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:43.673 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.714425+0000", 2023-09-30T17:03:43.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7234000000000001e-05 2023-09-30T17:03:43.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.674 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:43.674 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.937451+0000", 2023-09-30T17:03:43.674 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.22302575899999999 2023-09-30T17:03:43.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.674 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:43.674 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.937479+0000", 2023-09-30T17:03:43.674 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7759999999999998e-05 2023-09-30T17:03:43.675 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.675 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:43.675 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.675 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23700 4.30 4:0c89e311:::100000001f8.00000017:head [write 1548288~4096 in=4096b,write 1638400~4096 in=4096b,write 1814528~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:43.675 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713661+0000", 2023-09-30T17:03:43.675 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.9470239009999997, 2023-09-30T17:03:43.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.21981082900000001, 2023-09-30T17:03:43.675 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:43.675 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:43.676 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:43.676 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:43.676 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:43.676 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23700 2023-09-30T17:03:43.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.676 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:43.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:43.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713661+0000", 2023-09-30T17:03:43.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.677 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:43.677 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713661+0000", 2023-09-30T17:03:43.677 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.677 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:43.677 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713661+0000", 2023-09-30T17:03:43.677 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6000000000000004e-07 2023-09-30T17:03:43.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.678 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.678 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:43.678 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713669+0000", 2023-09-30T17:03:43.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2039999999999997e-06 2023-09-30T17:03:43.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.678 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.678 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:43.678 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713679+0000", 2023-09-30T17:03:43.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5999999999999996e-06 2023-09-30T17:03:43.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.678 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.678 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:43.679 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713683+0000", 2023-09-30T17:03:43.679 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4390000000000002e-06 2023-09-30T17:03:43.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.679 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:43.679 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713722+0000", 2023-09-30T17:03:43.679 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8707000000000001e-05 2023-09-30T17:03:43.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.679 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:43.679 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713780+0000", 2023-09-30T17:03:43.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8242000000000002e-05 2023-09-30T17:03:43.680 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.680 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:43.680 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.933335+0000", 2023-09-30T17:03:43.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.21955456500000001 2023-09-30T17:03:43.680 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.680 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:43.680 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.933388+0000", 2023-09-30T17:03:43.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2843999999999998e-05 2023-09-30T17:03:43.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.681 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:43.681 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.933471+0000", 2023-09-30T17:03:43.681 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3667999999999999e-05 2023-09-30T17:03:43.681 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.681 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:43.681 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.681 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23703 4.38 4:1d13bf87:::100000001f8.00000030:head [write 839680~4096 in=4096b,write 1101824~4096 in=4096b,write 1155072~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:43.682 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713696+0000", 2023-09-30T17:03:43.682 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.9469888219999998, 2023-09-30T17:03:43.682 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.23500357699999999, 2023-09-30T17:03:43.682 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:43.682 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:43.682 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:43.682 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:43.682 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:43.682 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23703 2023-09-30T17:03:43.682 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.682 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:43.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.683 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:43.683 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713696+0000", 2023-09-30T17:03:43.683 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.683 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.683 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:43.683 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713696+0000", 2023-09-30T17:03:43.683 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.683 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.684 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:43.684 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713696+0000", 2023-09-30T17:03:43.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9500000000000003e-07 2023-09-30T17:03:43.684 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.684 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:43.684 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713711+0000", 2023-09-30T17:03:43.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5251e-05 2023-09-30T17:03:43.684 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.685 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:43.685 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713718+0000", 2023-09-30T17:03:43.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9430000000000003e-06 2023-09-30T17:03:43.685 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.685 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:43.685 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713723+0000", 2023-09-30T17:03:43.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4240000000000003e-06 2023-09-30T17:03:43.685 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.685 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:43.686 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713757+0000", 2023-09-30T17:03:43.686 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4128999999999998e-05 2023-09-30T17:03:43.686 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.686 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.686 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:43.686 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713841+0000", 2023-09-30T17:03:43.686 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3845999999999996e-05 2023-09-30T17:03:43.686 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.686 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.687 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:43.687 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.948561+0000", 2023-09-30T17:03:43.687 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.234720286 2023-09-30T17:03:43.687 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.687 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.687 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:43.687 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.948624+0000", 2023-09-30T17:03:43.687 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2961999999999998e-05 2023-09-30T17:03:43.687 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.687 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.687 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:43.688 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.948699+0000", 2023-09-30T17:03:43.688 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5240999999999993e-05 2023-09-30T17:03:43.688 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.688 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:43.688 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.688 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.688 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.688 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23706 4.f 4:f0d983b2:::100000001f8.0000001f:head [write 1003520~4096 in=4096b,write 1146880~4096 in=4096b,write 1163264~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:43.688 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713730+0000", 2023-09-30T17:03:43.688 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.9469547670000003, 2023-09-30T17:03:43.688 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.22546488100000001, 2023-09-30T17:03:43.688 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:43.689 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:43.689 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:43.689 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:43.689 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:43.689 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23706 2023-09-30T17:03:43.689 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.689 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:43.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.689 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:43.689 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713730+0000", 2023-09-30T17:03:43.689 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.690 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.690 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:43.690 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713730+0000", 2023-09-30T17:03:43.690 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.690 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.690 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:43.690 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713730+0000", 2023-09-30T17:03:43.690 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0900000000000001e-07 2023-09-30T17:03:43.690 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.691 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:43.691 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713740+0000", 2023-09-30T17:03:43.691 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0115999999999999e-05 2023-09-30T17:03:43.691 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.691 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.691 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:43.691 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713747+0000", 2023-09-30T17:03:43.691 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5429999999999999e-06 2023-09-30T17:03:43.691 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.691 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.691 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:43.692 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713752+0000", 2023-09-30T17:03:43.692 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1270000000000002e-06 2023-09-30T17:03:43.692 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.692 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.692 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:43.692 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713788+0000", 2023-09-30T17:03:43.692 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5762000000000001e-05 2023-09-30T17:03:43.692 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.692 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.693 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:43.693 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713835+0000", 2023-09-30T17:03:43.693 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6808000000000003e-05 2023-09-30T17:03:43.693 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.693 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.693 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:43.693 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713962+0000", 2023-09-30T17:03:43.693 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000127315 2023-09-30T17:03:43.693 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.693 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.693 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:43.693 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.923977+0000", 2023-09-30T17:03:43.694 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.21001473100000001 2023-09-30T17:03:43.694 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.694 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.694 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:43.694 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939118+0000", 2023-09-30T17:03:43.694 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015141297999999999 2023-09-30T17:03:43.694 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.694 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.694 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:43.694 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939161+0000", 2023-09-30T17:03:43.694 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3458999999999998e-05 2023-09-30T17:03:43.694 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.695 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.695 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:43.695 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939195+0000", 2023-09-30T17:03:43.695 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3113e-05 2023-09-30T17:03:43.695 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.695 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:43.695 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.695 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.695 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.695 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23707 4.2f 4:f59f865b:::100000001f8.00000007:head [write 3575808~4096 in=4096b,write 3932160~4096 in=4096b,write 4063232~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:43.695 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713764+0000", 2023-09-30T17:03:43.695 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.9469203239999997, 2023-09-30T17:03:43.696 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.225343612, 2023-09-30T17:03:43.696 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:43.696 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:43.696 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:43.696 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:43.696 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:43.696 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23707 2023-09-30T17:03:43.696 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.696 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:43.696 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.696 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:43.697 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713764+0000", 2023-09-30T17:03:43.697 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.697 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.741 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.741 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:43.741 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713764+0000", 2023-09-30T17:03:43.741 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.741 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.741 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.741 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:43.741 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713765+0000", 2023-09-30T17:03:43.742 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4099999999999999e-07 2023-09-30T17:03:43.742 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.742 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.742 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:43.742 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713775+0000", 2023-09-30T17:03:43.742 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0253e-05 2023-09-30T17:03:43.742 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.742 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.742 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:43.742 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713781+0000", 2023-09-30T17:03:43.743 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1770000000000003e-06 2023-09-30T17:03:43.743 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.743 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.743 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:43.743 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713787+0000", 2023-09-30T17:03:43.767 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.784e-06 2023-09-30T17:03:43.767 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.767 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.767 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:43.767 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713824+0000", 2023-09-30T17:03:43.767 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7258000000000001e-05 2023-09-30T17:03:43.767 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.767 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.768 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:43.768 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713897+0000", 2023-09-30T17:03:43.768 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3255000000000003e-05 2023-09-30T17:03:43.768 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.768 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.768 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:43.768 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.714035+0000", 2023-09-30T17:03:43.768 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013741799999999999 2023-09-30T17:03:43.768 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.768 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.768 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:43.768 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.924017+0000", 2023-09-30T17:03:43.769 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.20998277000000001 2023-09-30T17:03:43.769 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.769 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.769 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:43.769 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939013+0000", 2023-09-30T17:03:43.769 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014995432 2023-09-30T17:03:43.769 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.769 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.769 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:43.769 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939064+0000", 2023-09-30T17:03:43.769 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0784e-05 2023-09-30T17:03:43.769 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.770 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.770 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:43.770 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939108+0000", 2023-09-30T17:03:43.770 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4039999999999998e-05 2023-09-30T17:03:43.770 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.770 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:43.770 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.770 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.770 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.770 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23709 4.37 4:ef395e89:::100000001f8.00000020:head [write 4042752~4096 in=4096b,write 4124672~4096 in=4096b,write 4182016~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:43.770 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713796+0000", 2023-09-30T17:03:43.771 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.9468881050000002, 2023-09-30T17:03:43.771 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.23291700700000001, 2023-09-30T17:03:43.771 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:43.771 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:43.771 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:43.771 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:43.771 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:43.771 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23709 2023-09-30T17:03:43.771 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.771 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:43.771 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.771 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:43.772 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713796+0000", 2023-09-30T17:03:43.772 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.772 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.772 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.772 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:43.772 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713796+0000", 2023-09-30T17:03:43.772 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.772 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.772 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.772 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:43.772 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713797+0000", 2023-09-30T17:03:43.772 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2200000000000004e-07 2023-09-30T17:03:43.773 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.773 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.773 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:43.773 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713807+0000", 2023-09-30T17:03:43.773 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.815e-06 2023-09-30T17:03:43.773 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.773 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.773 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:43.773 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713813+0000", 2023-09-30T17:03:43.773 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5899999999999996e-06 2023-09-30T17:03:43.773 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.773 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.773 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:43.774 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713818+0000", 2023-09-30T17:03:43.774 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2639999999999999e-06 2023-09-30T17:03:43.774 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.774 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.774 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:43.774 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.714818+0000", 2023-09-30T17:03:43.774 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00099973500000000008 2023-09-30T17:03:43.774 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.774 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.774 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:43.774 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.921155+0000", 2023-09-30T17:03:43.775 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.206336778 2023-09-30T17:03:43.775 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.775 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.775 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:43.775 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.921347+0000", 2023-09-30T17:03:43.775 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000191917 2023-09-30T17:03:43.775 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.775 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.775 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:43.775 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.944206+0000", 2023-09-30T17:03:43.775 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022859349000000001 2023-09-30T17:03:43.776 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.776 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.776 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:43.776 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.946622+0000", 2023-09-30T17:03:43.776 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0024161849999999999 2023-09-30T17:03:43.776 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.776 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.776 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:43.776 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.946673+0000", 2023-09-30T17:03:43.776 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0670000000000001e-05 2023-09-30T17:03:43.776 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.776 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.777 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:43.777 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.946713+0000", 2023-09-30T17:03:43.777 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0182000000000003e-05 2023-09-30T17:03:43.777 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.777 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:43.777 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.777 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.777 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.777 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23710 4.12 4:4be51a30:::100000001f8.0000000b:head [write 3772416~4096 in=4096b,write 3825664~4096 in=4096b,write 3833856~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:43.777 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713827+0000", 2023-09-30T17:03:43.777 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.9468576200000003, 2023-09-30T17:03:43.777 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.214817016, 2023-09-30T17:03:43.778 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:43.778 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:43.778 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:43.778 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:43.778 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:43.778 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23710 2023-09-30T17:03:43.778 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.778 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:43.778 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.778 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:43.778 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713827+0000", 2023-09-30T17:03:43.778 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.779 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.779 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.779 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:43.779 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713827+0000", 2023-09-30T17:03:43.779 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.779 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.779 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.779 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:43.779 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713827+0000", 2023-09-30T17:03:43.779 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.51e-07 2023-09-30T17:03:43.779 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.779 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.780 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:43.780 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713837+0000", 2023-09-30T17:03:43.780 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8239999999999995e-06 2023-09-30T17:03:43.780 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.780 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.780 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:43.780 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713843+0000", 2023-09-30T17:03:43.780 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3729999999999998e-06 2023-09-30T17:03:43.780 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.780 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.781 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:43.781 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713849+0000", 2023-09-30T17:03:43.781 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3480000000000003e-06 2023-09-30T17:03:43.781 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.781 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.781 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:43.781 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713896+0000", 2023-09-30T17:03:43.781 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7426999999999998e-05 2023-09-30T17:03:43.781 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.781 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.781 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:43.782 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713969+0000", 2023-09-30T17:03:43.782 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2496000000000005e-05 2023-09-30T17:03:43.782 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.782 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.782 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:43.782 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.714114+0000", 2023-09-30T17:03:43.782 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014550699999999999 2023-09-30T17:03:43.782 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.782 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.782 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:43.782 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.922604+0000", 2023-09-30T17:03:43.783 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.20848978900000001 2023-09-30T17:03:43.783 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.783 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.783 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:43.783 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.928219+0000", 2023-09-30T17:03:43.783 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056147159999999996 2023-09-30T17:03:43.783 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.783 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.783 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:43.783 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.928268+0000", 2023-09-30T17:03:43.783 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9353e-05 2023-09-30T17:03:43.783 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.784 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.784 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:43.784 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.928644+0000", 2023-09-30T17:03:43.784 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00037573199999999999 2023-09-30T17:03:43.784 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.784 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:43.784 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.784 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.784 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.784 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23711 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 270336~4096 in=4096b,write 876544~4096 in=4096b,write 933888~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:43.784 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713868+0000", 2023-09-30T17:03:43.785 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.9468167599999999, 2023-09-30T17:03:43.785 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.234682211, 2023-09-30T17:03:43.785 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:43.785 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:43.785 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:43.785 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:43.785 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:43.785 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23711 2023-09-30T17:03:43.785 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.785 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:43.785 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.785 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:43.786 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713868+0000", 2023-09-30T17:03:43.786 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.786 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.786 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.786 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:43.786 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713868+0000", 2023-09-30T17:03:43.786 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.786 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.786 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.786 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:43.786 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713868+0000", 2023-09-30T17:03:43.787 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.75e-07 2023-09-30T17:03:43.787 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.787 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.787 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:43.787 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713879+0000", 2023-09-30T17:03:43.787 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0494e-05 2023-09-30T17:03:43.787 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.787 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.787 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:43.787 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713886+0000", 2023-09-30T17:03:43.787 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3159999999999999e-06 2023-09-30T17:03:43.788 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.788 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.788 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:43.788 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713892+0000", 2023-09-30T17:03:43.788 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7200000000000003e-06 2023-09-30T17:03:43.788 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.788 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.788 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:43.788 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.714747+0000", 2023-09-30T17:03:43.788 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00085524699999999995 2023-09-30T17:03:43.788 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.789 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.789 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:43.789 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.714822+0000", 2023-09-30T17:03:43.789 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5444999999999993e-05 2023-09-30T17:03:43.789 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.789 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.789 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:43.789 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.947884+0000", 2023-09-30T17:03:43.789 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.233061449 2023-09-30T17:03:43.789 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.789 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.789 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:43.790 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.947942+0000", 2023-09-30T17:03:43.790 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7649999999999999e-05 2023-09-30T17:03:43.790 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.790 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.790 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:43.790 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.948550+0000", 2023-09-30T17:03:43.790 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00060831500000000001 2023-09-30T17:03:43.790 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.790 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:43.790 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.791 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.791 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.791 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23712 4.37 4:eff9002a:::100000001f8.00000003:head [write 3387392~8192,write 3452928~4096,write 3710976~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:43.791 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713901+0000", 2023-09-30T17:03:43.791 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.9467837020000003, 2023-09-30T17:03:43.791 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.25525220700000001, 2023-09-30T17:03:43.791 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:43.791 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:43.791 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:43.791 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:43.791 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:43.791 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23712 2023-09-30T17:03:43.792 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.792 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:43.792 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.792 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:43.792 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713901+0000", 2023-09-30T17:03:43.792 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.792 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.792 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.792 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:43.792 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713901+0000", 2023-09-30T17:03:43.792 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.792 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.793 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.793 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:43.793 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713901+0000", 2023-09-30T17:03:43.793 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.96e-07 2023-09-30T17:03:43.793 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.793 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.793 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:43.793 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713912+0000", 2023-09-30T17:03:43.793 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0543999999999999e-05 2023-09-30T17:03:43.793 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.793 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.793 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:43.794 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713918+0000", 2023-09-30T17:03:43.794 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4420000000000003e-06 2023-09-30T17:03:43.794 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.794 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.794 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:43.794 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713923+0000", 2023-09-30T17:03:43.794 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3059999999999997e-06 2023-09-30T17:03:43.794 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.794 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.794 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:43.794 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.946744+0000", 2023-09-30T17:03:43.794 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.23282061100000001 2023-09-30T17:03:43.795 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.795 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.795 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:43.795 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.946818+0000", 2023-09-30T17:03:43.795 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3762000000000003e-05 2023-09-30T17:03:43.795 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.795 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.795 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:43.795 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.946949+0000", 2023-09-30T17:03:43.795 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013133900000000001 2023-09-30T17:03:43.795 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.795 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.796 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:43.796 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.951383+0000", 2023-09-30T17:03:43.796 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0044336999999999996 2023-09-30T17:03:43.796 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.796 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.796 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:43.796 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.969076+0000", 2023-09-30T17:03:43.796 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017693303000000001 2023-09-30T17:03:43.796 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.796 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.796 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:43.796 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.969119+0000", 2023-09-30T17:03:43.797 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3208999999999999e-05 2023-09-30T17:03:43.797 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.797 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.797 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:43.797 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.969153+0000", 2023-09-30T17:03:43.797 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3594999999999999e-05 2023-09-30T17:03:43.797 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.797 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:43.797 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.797 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.797 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.797 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:23713 4.33 e41/17 4:cf6d7a6c:::100000001f8.0000000a:head v 41'399, mlcod=41'397)", 2023-09-30T17:03:43.797 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.715224+0000", 2023-09-30T17:03:43.798 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.945460422, 2023-09-30T17:03:43.798 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.230022326, 2023-09-30T17:03:43.798 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:43.798 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:43.798 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:43.798 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.798 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:43.798 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.715224+0000", 2023-09-30T17:03:43.798 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.798 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.799 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.799 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:43.799 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.715224+0000", 2023-09-30T17:03:43.799 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.799 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.799 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.799 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:43.799 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.715228+0000", 2023-09-30T17:03:43.799 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4220000000000002e-06 2023-09-30T17:03:43.799 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.799 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.800 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:43.800 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.715239+0000", 2023-09-30T17:03:43.800 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0261999999999999e-05 2023-09-30T17:03:43.800 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.800 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.800 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:43.800 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.921195+0000", 2023-09-30T17:03:43.800 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.205955902 2023-09-30T17:03:43.800 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.800 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.800 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:43.800 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.921210+0000", 2023-09-30T17:03:43.800 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5109999999999999e-05 2023-09-30T17:03:43.800 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.801 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.801 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:43.801 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.921430+0000", 2023-09-30T17:03:43.801 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022019300000000001 2023-09-30T17:03:43.801 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.801 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.801 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:43.801 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.921454+0000", 2023-09-30T17:03:43.801 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4142e-05 2023-09-30T17:03:43.801 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.801 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.801 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:43.802 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.945208+0000", 2023-09-30T17:03:43.802 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.023753765999999999 2023-09-30T17:03:43.802 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.802 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.802 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:43.802 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.945246+0000", 2023-09-30T17:03:43.802 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8529000000000003e-05 2023-09-30T17:03:43.802 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.802 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:43.802 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.802 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.803 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.803 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24202 4.38 4:1dcf718c:::100000001f8.00000022:head [write 966656~4096,write 995328~4096,write 1007616~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:43.803 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.938506+0000", 2023-09-30T17:03:43.803 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.7221788330000001, 2023-09-30T17:03:43.803 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.19404896199999999, 2023-09-30T17:03:43.803 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:43.803 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:43.803 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:43.803 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:43.803 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:43.803 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24202 2023-09-30T17:03:43.804 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.804 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:43.804 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.804 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:43.804 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938506+0000", 2023-09-30T17:03:43.804 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.804 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.804 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.804 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:43.804 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938506+0000", 2023-09-30T17:03:43.804 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.805 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.805 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.805 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:43.805 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938506+0000", 2023-09-30T17:03:43.805 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7899999999999999e-07 2023-09-30T17:03:43.805 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.805 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.805 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:43.805 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938539+0000", 2023-09-30T17:03:43.805 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2839999999999997e-05 2023-09-30T17:03:43.805 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.806 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.806 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:43.806 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938549+0000", 2023-09-30T17:03:43.806 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0202e-05 2023-09-30T17:03:43.806 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.806 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.806 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:43.806 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938554+0000", 2023-09-30T17:03:43.806 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1660000000000002e-06 2023-09-30T17:03:43.806 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.806 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.807 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:43.807 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.107092+0000", 2023-09-30T17:03:43.807 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.168537457 2023-09-30T17:03:43.807 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.807 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.807 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:43.807 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.107174+0000", 2023-09-30T17:03:43.807 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2380999999999996e-05 2023-09-30T17:03:43.807 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.807 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.807 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:43.807 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.132433+0000", 2023-09-30T17:03:43.807 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.025258939000000001 2023-09-30T17:03:43.808 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.808 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.808 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:43.808 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.132483+0000", 2023-09-30T17:03:43.808 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9951000000000003e-05 2023-09-30T17:03:43.808 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.808 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.808 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:43.808 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.132555+0000", 2023-09-30T17:03:43.808 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1647e-05 2023-09-30T17:03:43.808 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.809 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:43.809 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.809 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.809 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.809 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24207 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 2002944~4096,write 2060288~4096,write 2068480~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:43.809 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.938605+0000", 2023-09-30T17:03:43.809 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.7220795659999997, 2023-09-30T17:03:43.809 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.19406049, 2023-09-30T17:03:43.809 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:43.809 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:43.809 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:43.809 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:43.809 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:43.810 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24207 2023-09-30T17:03:43.810 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.810 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:43.810 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.810 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:43.810 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938605+0000", 2023-09-30T17:03:43.810 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.810 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.810 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.810 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:43.810 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938605+0000", 2023-09-30T17:03:43.810 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.811 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.811 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.811 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:43.811 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938605+0000", 2023-09-30T17:03:43.811 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2899999999999999e-07 2023-09-30T17:03:43.811 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.811 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.811 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:43.811 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938621+0000", 2023-09-30T17:03:43.811 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5624000000000002e-05 2023-09-30T17:03:43.811 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.811 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.811 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:43.812 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938627+0000", 2023-09-30T17:03:43.812 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.925e-06 2023-09-30T17:03:43.812 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.812 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.812 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:43.812 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938630+0000", 2023-09-30T17:03:43.812 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4599999999999999e-06 2023-09-30T17:03:43.812 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.812 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.812 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:43.812 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.110850+0000", 2023-09-30T17:03:43.813 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.17221983699999999 2023-09-30T17:03:43.813 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.813 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:43.813 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.110930+0000", 2023-09-30T17:03:43.813 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0092999999999994e-05 2023-09-30T17:03:43.813 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.813 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:43.813 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.132561+0000", 2023-09-30T17:03:43.813 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021631371999999999 2023-09-30T17:03:43.813 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.814 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.814 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:43.814 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.132604+0000", 2023-09-30T17:03:43.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2818999999999998e-05 2023-09-30T17:03:43.814 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.814 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.814 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:43.814 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.132665+0000", 2023-09-30T17:03:43.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1030999999999999e-05 2023-09-30T17:03:43.814 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.814 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:43.814 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.815 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.815 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.815 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24210 4.30 4:0c89e311:::100000001f8.00000017:head [write 3231744~4096,write 3272704~4096,write 3346432~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:43.815 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.938660+0000", 2023-09-30T17:03:43.815 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.7220244969999996, 2023-09-30T17:03:43.815 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.194937256, 2023-09-30T17:03:43.815 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:43.815 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:43.815 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:43.815 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:43.815 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:43.816 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24210 2023-09-30T17:03:43.816 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.816 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:43.816 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.816 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:43.816 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938660+0000", 2023-09-30T17:03:43.816 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.816 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.816 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.816 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:43.816 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938660+0000", 2023-09-30T17:03:43.816 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.817 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.817 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.817 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:43.821 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938660+0000", 2023-09-30T17:03:43.821 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5800000000000001e-07 2023-09-30T17:03:43.821 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.821 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.822 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:43.822 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938676+0000", 2023-09-30T17:03:43.822 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5650000000000001e-05 2023-09-30T17:03:43.822 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.822 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.822 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:43.822 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938685+0000", 2023-09-30T17:03:43.822 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9250000000000001e-06 2023-09-30T17:03:43.822 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.822 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.822 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:43.823 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938690+0000", 2023-09-30T17:03:43.823 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8160000000000001e-06 2023-09-30T17:03:43.823 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.823 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.823 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:43.823 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.110993+0000", 2023-09-30T17:03:43.823 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.172303714 2023-09-30T17:03:43.823 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.823 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.823 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:43.823 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.111072+0000", 2023-09-30T17:03:43.823 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8448999999999994e-05 2023-09-30T17:03:43.824 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.824 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.824 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:43.824 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.133463+0000", 2023-09-30T17:03:43.824 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022391297000000001 2023-09-30T17:03:43.824 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.824 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.824 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:43.824 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.133518+0000", 2023-09-30T17:03:43.824 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5278999999999997e-05 2023-09-30T17:03:43.824 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.824 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.825 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:43.825 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.133597+0000", 2023-09-30T17:03:43.825 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8868000000000005e-05 2023-09-30T17:03:43.825 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.825 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:43.825 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.825 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.825 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24218 4.30 4:0c89e311:::100000001f8.00000017:head [write 1191936~4096,write 1245184~4096,write 1261568~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:43.825 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.938815+0000", 2023-09-30T17:03:43.825 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.7218692139999998, 2023-09-30T17:03:43.826 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.19788513899999999, 2023-09-30T17:03:43.826 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:43.826 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:43.826 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:43.826 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:43.826 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:43.826 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24218 2023-09-30T17:03:43.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.826 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:43.826 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.826 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:43.827 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938815+0000", 2023-09-30T17:03:43.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.827 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.827 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.827 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:43.827 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938815+0000", 2023-09-30T17:03:43.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.827 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.827 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.827 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:43.827 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938816+0000", 2023-09-30T17:03:43.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8699999999999995e-07 2023-09-30T17:03:43.828 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.828 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.828 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:43.828 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938837+0000", 2023-09-30T17:03:43.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1534000000000001e-05 2023-09-30T17:03:43.828 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.828 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.828 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:43.828 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938845+0000", 2023-09-30T17:03:43.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7190000000000001e-06 2023-09-30T17:03:43.828 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.828 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.829 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:43.829 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938850+0000", 2023-09-30T17:03:43.829 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1220000000000003e-06 2023-09-30T17:03:43.829 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.829 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:43.829 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.113486+0000", 2023-09-30T17:03:43.829 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.17463620299999999 2023-09-30T17:03:43.829 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.829 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:43.829 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.113626+0000", 2023-09-30T17:03:43.830 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013924799999999999 2023-09-30T17:03:43.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.830 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.830 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:43.830 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.136575+0000", 2023-09-30T17:03:43.830 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022949701999999999 2023-09-30T17:03:43.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.830 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.830 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:43.830 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.136623+0000", 2023-09-30T17:03:43.830 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7808e-05 2023-09-30T17:03:43.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.831 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.831 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:43.831 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.136700+0000", 2023-09-30T17:03:43.831 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7316000000000003e-05 2023-09-30T17:03:43.831 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.831 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:43.831 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.831 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.831 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.831 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24223 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 2449408~4096,write 2936832~4096,write 2973696~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:43.831 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.938922+0000", 2023-09-30T17:03:43.831 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.721762386, 2023-09-30T17:03:43.831 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.19909703600000001, 2023-09-30T17:03:43.832 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:43.832 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:43.832 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:43.832 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:43.832 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:43.832 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24223 2023-09-30T17:03:43.832 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.832 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:43.832 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.832 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:43.832 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938922+0000", 2023-09-30T17:03:43.832 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.833 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.833 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.833 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:43.833 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938922+0000", 2023-09-30T17:03:43.833 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.833 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.833 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.833 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:43.833 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938922+0000", 2023-09-30T17:03:43.833 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8599999999999999e-07 2023-09-30T17:03:43.833 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.833 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.834 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:43.834 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938943+0000", 2023-09-30T17:03:43.834 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0588999999999999e-05 2023-09-30T17:03:43.834 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.834 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.834 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:43.834 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938958+0000", 2023-09-30T17:03:43.834 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4915e-05 2023-09-30T17:03:43.834 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.834 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.834 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:43.834 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938964+0000", 2023-09-30T17:03:43.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8329999999999999e-06 2023-09-30T17:03:43.835 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.835 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.835 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:43.835 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.114879+0000", 2023-09-30T17:03:43.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.17591552699999999 2023-09-30T17:03:43.835 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.835 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.835 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:43.835 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.114958+0000", 2023-09-30T17:03:43.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8666999999999997e-05 2023-09-30T17:03:43.835 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.836 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.836 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:43.836 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.137905+0000", 2023-09-30T17:03:43.836 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022947381999999999 2023-09-30T17:03:43.836 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.836 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.836 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:43.836 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.137948+0000", 2023-09-30T17:03:43.836 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2851e-05 2023-09-30T17:03:43.836 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.836 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.836 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:43.837 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.138019+0000", 2023-09-30T17:03:43.837 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0885999999999999e-05 2023-09-30T17:03:43.837 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.837 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:43.837 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.837 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.837 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.837 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24231 4.30 4:0c89e311:::100000001f8.00000017:head [write 3121152~4096,write 3174400~4096,write 3198976~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:43.837 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.939120+0000", 2023-09-30T17:03:43.837 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.7215640470000002, 2023-09-30T17:03:43.837 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.199038715, 2023-09-30T17:03:43.837 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:43.838 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:43.838 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:43.838 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:43.838 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:43.838 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24231 2023-09-30T17:03:43.838 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.838 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:43.838 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.838 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:43.838 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939120+0000", 2023-09-30T17:03:43.838 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.838 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.839 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.839 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:43.839 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939120+0000", 2023-09-30T17:03:43.839 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.839 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.839 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.839 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:43.839 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939121+0000", 2023-09-30T17:03:43.839 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5799999999999999e-07 2023-09-30T17:03:43.839 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.839 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.839 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:43.840 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939138+0000", 2023-09-30T17:03:43.840 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6742e-05 2023-09-30T17:03:43.840 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.840 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.840 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:43.840 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939145+0000", 2023-09-30T17:03:43.840 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2230000000000001e-06 2023-09-30T17:03:43.840 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.840 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.840 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:43.840 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939155+0000", 2023-09-30T17:03:43.840 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.995e-06 2023-09-30T17:03:43.841 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.841 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.841 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:43.841 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.116318+0000", 2023-09-30T17:03:43.841 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.17716331799999999 2023-09-30T17:03:43.841 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.841 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.841 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:43.841 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.116392+0000", 2023-09-30T17:03:43.841 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3379000000000003e-05 2023-09-30T17:03:43.841 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.841 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.842 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:43.842 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.138027+0000", 2023-09-30T17:03:43.842 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021635318000000001 2023-09-30T17:03:43.842 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.842 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.842 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:43.842 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.138076+0000", 2023-09-30T17:03:43.842 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9055999999999999e-05 2023-09-30T17:03:43.842 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.842 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.842 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:43.843 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.138159+0000", 2023-09-30T17:03:43.843 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3126000000000003e-05 2023-09-30T17:03:43.843 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.843 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:43.843 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.843 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.843 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.843 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24247 4.30 4:0c89e311:::100000001f8.00000017:head [write 2134016~4096,write 2150400~4096,write 2207744~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:43.843 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.939330+0000", 2023-09-30T17:03:43.843 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.7213543539999998, 2023-09-30T17:03:43.843 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.200392818, 2023-09-30T17:03:43.843 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:43.844 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:43.844 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:43.844 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:43.844 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:43.844 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24247 2023-09-30T17:03:43.844 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.844 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:43.844 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.844 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:43.844 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939330+0000", 2023-09-30T17:03:43.863 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.863 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.863 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.864 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:43.864 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939330+0000", 2023-09-30T17:03:43.864 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.864 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.864 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:43.864 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939330+0000", 2023-09-30T17:03:43.864 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7500000000000001e-07 2023-09-30T17:03:43.864 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.864 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:43.864 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939339+0000", 2023-09-30T17:03:43.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6719999999999993e-06 2023-09-30T17:03:43.865 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.865 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.865 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:43.865 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939342+0000", 2023-09-30T17:03:43.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4170000000000001e-06 2023-09-30T17:03:43.865 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.865 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.865 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:43.865 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939345+0000", 2023-09-30T17:03:43.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7190000000000001e-06 2023-09-30T17:03:43.865 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.866 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.866 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:43.866 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.126008+0000", 2023-09-30T17:03:43.866 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.18666300499999999 2023-09-30T17:03:43.866 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.866 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.866 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:43.866 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.126132+0000", 2023-09-30T17:03:43.866 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012387800000000001 2023-09-30T17:03:43.866 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.866 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.866 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:43.867 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.139635+0000", 2023-09-30T17:03:43.867 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013502739 2023-09-30T17:03:43.867 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.867 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.867 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:43.867 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.139669+0000", 2023-09-30T17:03:43.867 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3810000000000003e-05 2023-09-30T17:03:43.867 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.867 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.867 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:43.867 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.139723+0000", 2023-09-30T17:03:43.867 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4302999999999998e-05 2023-09-30T17:03:43.868 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.868 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:43.868 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.868 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.868 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24272 4.38 4:1fc350da:::100000001f8.0000002f:head [write 638976~4096,write 843776~4096,write 864256~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:43.868 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.939523+0000", 2023-09-30T17:03:43.868 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.721161446, 2023-09-30T17:03:43.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.19876761700000001, 2023-09-30T17:03:43.868 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:43.868 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:43.868 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:43.869 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:43.869 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:43.869 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24272 2023-09-30T17:03:43.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.869 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:43.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.869 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:43.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939523+0000", 2023-09-30T17:03:43.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.869 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:43.870 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939523+0000", 2023-09-30T17:03:43.870 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.870 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.870 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:43.870 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939523+0000", 2023-09-30T17:03:43.870 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6199999999999999e-07 2023-09-30T17:03:43.870 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.870 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:43.870 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939538+0000", 2023-09-30T17:03:43.870 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5122e-05 2023-09-30T17:03:43.871 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.871 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.871 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:43.871 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939544+0000", 2023-09-30T17:03:43.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.327e-06 2023-09-30T17:03:43.871 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.871 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.871 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:43.871 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939549+0000", 2023-09-30T17:03:43.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8130000000000003e-06 2023-09-30T17:03:43.871 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.871 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:43.872 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.123535+0000", 2023-09-30T17:03:43.872 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.18398595700000001 2023-09-30T17:03:43.872 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:43.872 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.123962+0000", 2023-09-30T17:03:43.872 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000427136 2023-09-30T17:03:43.872 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:43.872 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.138167+0000", 2023-09-30T17:03:43.873 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014205096 2023-09-30T17:03:43.873 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.873 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.873 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:43.873 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.138217+0000", 2023-09-30T17:03:43.873 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0241999999999998e-05 2023-09-30T17:03:43.873 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.873 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.873 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:43.873 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.138291+0000", 2023-09-30T17:03:43.873 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3561999999999998e-05 2023-09-30T17:03:43.873 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.874 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:43.874 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.874 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.874 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.874 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24277 4.38 4:1fc350da:::100000001f8.0000002f:head [write 1036288~4096,write 1122304~4096,write 1220608~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:43.874 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.939581+0000", 2023-09-30T17:03:43.874 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.7211036719999999, 2023-09-30T17:03:43.874 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.200284616, 2023-09-30T17:03:43.874 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:43.874 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:43.874 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:43.875 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:43.875 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:43.875 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24277 2023-09-30T17:03:43.875 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.895 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:43.895 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.895 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:43.895 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939581+0000", 2023-09-30T17:03:43.895 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.895 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.895 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.895 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:43.895 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939581+0000", 2023-09-30T17:03:43.895 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:43.895 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.896 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.896 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:43.896 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939581+0000", 2023-09-30T17:03:43.896 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4499999999999998e-07 2023-09-30T17:03:43.896 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.896 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.896 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:43.896 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939596+0000", 2023-09-30T17:03:43.896 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5007999999999999e-05 2023-09-30T17:03:43.896 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.896 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.896 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:43.897 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939600+0000", 2023-09-30T17:03:43.897 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6859999999999999e-06 2023-09-30T17:03:43.897 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.897 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.897 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:43.897 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939603+0000", 2023-09-30T17:03:43.897 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8700000000000001e-06 2023-09-30T17:03:43.897 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.897 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.897 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:43.897 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.129152+0000", 2023-09-30T17:03:43.897 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.18954922599999999 2023-09-30T17:03:43.898 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.898 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.898 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:43.898 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.129238+0000", 2023-09-30T17:03:43.898 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6446000000000005e-05 2023-09-30T17:03:43.898 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.898 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.898 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:43.898 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.139771+0000", 2023-09-30T17:03:43.898 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010532674000000001 2023-09-30T17:03:43.898 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.899 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.899 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:43.899 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.139819+0000", 2023-09-30T17:03:43.899 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7633999999999998e-05 2023-09-30T17:03:43.899 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:43.899 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:43.899 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:43.899 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.139865+0000", 2023-09-30T17:03:43.899 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6826999999999997e-05 2023-09-30T17:03:43.899 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.899 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:43.899 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.899 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:43.900 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:43.900 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:43.901 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:43.900+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:43.901 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:03:44.002 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:44.001+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:44.095 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:44.096 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:03:44.096 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.096 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:38595 4.36 4.670445b6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-09-30T17:03:44.096 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:44.068289+0000", 2023-09-30T17:03:44.096 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.023567336000000001, 2023-09-30T17:03:44.096 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023592208999999999, 2023-09-30T17:03:44.096 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.096 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:44.096 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.096 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.096 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.097 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 38595 2023-09-30T17:03:44.097 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.097 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.097 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.097 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.097 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.068289+0000", 2023-09-30T17:03:44.097 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.097 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.097 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.097 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.097 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.068289+0000", 2023-09-30T17:03:44.098 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.098 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.098 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.098 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.098 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.068290+0000", 2023-09-30T17:03:44.098 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6699999999999999e-07 2023-09-30T17:03:44.098 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.098 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.098 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.098 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.068352+0000", 2023-09-30T17:03:44.098 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2607000000000006e-05 2023-09-30T17:03:44.099 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.099 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.099 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.099 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.068365+0000", 2023-09-30T17:03:44.099 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2993000000000001e-05 2023-09-30T17:03:44.099 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.099 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.099 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.099 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.068370+0000", 2023-09-30T17:03:44.099 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4410000000000003e-06 2023-09-30T17:03:44.099 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.099 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.100 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.100 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.100 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.100 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:38654 4.f e42/17 4:f0d983b2:::100000001f8.0000001f:head v 42'1826, mlcod=42'1821)", 2023-09-30T17:03:44.100 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:44.088335+0000", 2023-09-30T17:03:44.100 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0035211470000000001, 2023-09-30T17:03:44.100 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0036256259999999998, 2023-09-30T17:03:44.100 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.100 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:44.100 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.100 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.100 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.101 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.088335+0000", 2023-09-30T17:03:44.101 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.101 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.101 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.101 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.101 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.088335+0000", 2023-09-30T17:03:44.101 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.101 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.101 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.101 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.101 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.088336+0000", 2023-09-30T17:03:44.102 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4200000000000001e-07 2023-09-30T17:03:44.102 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.102 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.102 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.102 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.088347+0000", 2023-09-30T17:03:44.102 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1056999999999999e-05 2023-09-30T17:03:44.102 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.102 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.102 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.102 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.088355+0000", 2023-09-30T17:03:44.102 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0229999999999992e-06 2023-09-30T17:03:44.103 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.103 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.103 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.103 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.088361+0000", 2023-09-30T17:03:44.103 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2400000000000004e-06 2023-09-30T17:03:44.103 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.103 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.103 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:44.103 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.090636+0000", 2023-09-30T17:03:44.103 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.002274365 2023-09-30T17:03:44.103 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.103 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.104 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:44.104 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.090667+0000", 2023-09-30T17:03:44.104 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.1445000000000001e-05 2023-09-30T17:03:44.104 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.104 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.104 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.104 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.104 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.104 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:38596 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-09-30T17:03:44.104 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:44.068522+0000", 2023-09-30T17:03:44.104 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.023334242000000002, 2023-09-30T17:03:44.104 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023504193999999999, 2023-09-30T17:03:44.105 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.105 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:44.105 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.105 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.105 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.105 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 38596 2023-09-30T17:03:44.105 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.105 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.105 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.105 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.105 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.068522+0000", 2023-09-30T17:03:44.106 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.106 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.106 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.106 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.106 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.068522+0000", 2023-09-30T17:03:44.106 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.106 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.106 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.106 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.106 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.068523+0000", 2023-09-30T17:03:44.106 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8699999999999995e-07 2023-09-30T17:03:44.107 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.107 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.107 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.107 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.068588+0000", 2023-09-30T17:03:44.107 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5463000000000007e-05 2023-09-30T17:03:44.107 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.107 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.107 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.107 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.068604+0000", 2023-09-30T17:03:44.107 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5409000000000001e-05 2023-09-30T17:03:44.107 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.107 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.107 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.108 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.068608+0000", 2023-09-30T17:03:44.108 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1479999999999999e-06 2023-09-30T17:03:44.108 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.108 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.108 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.108 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.108 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.108 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:38657 4.3b 4:dcc0c15f:::100000001f8.0000001a:head [write 212992~4096 in=4096b,write 409600~4096 in=4096b,write 573440~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-09-30T17:03:44.108 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:44.089089+0000", 2023-09-30T17:03:44.108 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0027671979999999998, 2023-09-30T17:03:44.108 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0029960830000000001, 2023-09-30T17:03:44.108 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.109 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:44.109 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.109 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.109 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.109 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 38657 2023-09-30T17:03:44.109 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.109 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.109 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.109 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.109 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.089089+0000", 2023-09-30T17:03:44.109 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.109 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.110 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.110 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.110 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.089089+0000", 2023-09-30T17:03:44.110 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.110 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.110 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.110 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.110 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.089090+0000", 2023-09-30T17:03:44.110 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7800000000000001e-07 2023-09-30T17:03:44.110 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.110 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.110 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.111 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.089103+0000", 2023-09-30T17:03:44.111 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2582000000000001e-05 2023-09-30T17:03:44.111 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.111 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.111 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.111 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.089114+0000", 2023-09-30T17:03:44.111 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1172000000000001e-05 2023-09-30T17:03:44.111 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.111 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.111 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.111 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.089122+0000", 2023-09-30T17:03:44.111 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9990000000000008e-06 2023-09-30T17:03:44.112 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.112 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.112 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:44.112 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.089183+0000", 2023-09-30T17:03:44.112 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0885999999999999e-05 2023-09-30T17:03:44.112 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.112 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.112 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:44.112 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.089284+0000", 2023-09-30T17:03:44.112 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000101588 2023-09-30T17:03:44.112 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.113 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.113 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:44.113 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.089472+0000", 2023-09-30T17:03:44.113 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00018752800000000001 2023-09-30T17:03:44.113 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.113 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.113 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.113 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.113 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.113 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:38659 4.23 e42/17 4:c6f90462:::100000001f8.00000037:head v 42'602, mlcod=42'600)", 2023-09-30T17:03:44.113 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:44.090197+0000", 2023-09-30T17:03:44.113 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.001659366, 2023-09-30T17:03:44.114 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001991371, 2023-09-30T17:03:44.114 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.114 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:44.114 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.114 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.114 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.114 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.090197+0000", 2023-09-30T17:03:44.114 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.114 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.114 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.114 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.115 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.090197+0000", 2023-09-30T17:03:44.115 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.115 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.115 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.115 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.115 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.090198+0000", 2023-09-30T17:03:44.115 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3900000000000004e-07 2023-09-30T17:03:44.115 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.115 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.115 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.115 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.090211+0000", 2023-09-30T17:03:44.115 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3570999999999999e-05 2023-09-30T17:03:44.115 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.116 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.116 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.116 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.090222+0000", 2023-09-30T17:03:44.116 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0964999999999999e-05 2023-09-30T17:03:44.116 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.116 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.116 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.116 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.090230+0000", 2023-09-30T17:03:44.116 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4279999999999999e-06 2023-09-30T17:03:44.116 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.116 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.117 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:44.117 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.090450+0000", 2023-09-30T17:03:44.117 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000220208 2023-09-30T17:03:44.117 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.117 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.117 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:44.117 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.090473+0000", 2023-09-30T17:03:44.117 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2478000000000001e-05 2023-09-30T17:03:44.117 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.117 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.117 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.117 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.117 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.118 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:38629 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-09-30T17:03:44.118 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:44.081791+0000", 2023-09-30T17:03:44.118 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.010066021, 2023-09-30T17:03:44.118 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010469826, 2023-09-30T17:03:44.118 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.118 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:44.118 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.118 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.118 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.118 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 38629 2023-09-30T17:03:44.119 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.119 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.119 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.119 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.119 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.081791+0000", 2023-09-30T17:03:44.119 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.119 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.119 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.119 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.119 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.081791+0000", 2023-09-30T17:03:44.119 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.119 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.120 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.120 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.120 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.081792+0000", 2023-09-30T17:03:44.120 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0079999999999999e-06 2023-09-30T17:03:44.120 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.120 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.120 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.120 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.081808+0000", 2023-09-30T17:03:44.120 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6396e-05 2023-09-30T17:03:44.120 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.120 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.120 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.121 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.081818+0000", 2023-09-30T17:03:44.121 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8230000000000006e-06 2023-09-30T17:03:44.121 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.121 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.121 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.121 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.081825+0000", 2023-09-30T17:03:44.121 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6499999999999996e-06 2023-09-30T17:03:44.121 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.121 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.121 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.121 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.121 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.122 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:38662 4.8 4:11ee3b64:::100000001f8.0000003e:head [write 3194880~4096 in=4096b,write 3207168~4096 in=4096b,write 3215360~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-09-30T17:03:44.122 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:44.091542+0000", 2023-09-30T17:03:44.122 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.000314383, 2023-09-30T17:03:44.122 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00076740800000000002, 2023-09-30T17:03:44.122 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.122 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:44.122 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.122 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.122 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.122 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 38662 2023-09-30T17:03:44.122 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.122 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.123 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.123 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.123 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.091542+0000", 2023-09-30T17:03:44.123 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.123 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.123 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.123 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.123 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.091542+0000", 2023-09-30T17:03:44.123 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.123 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.123 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.124 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.124 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.091543+0000", 2023-09-30T17:03:44.124 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.159e-06 2023-09-30T17:03:44.124 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.124 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.124 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.124 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.091553+0000", 2023-09-30T17:03:44.124 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2380000000000003e-06 2023-09-30T17:03:44.124 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.124 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.124 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.124 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.091567+0000", 2023-09-30T17:03:44.125 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4669e-05 2023-09-30T17:03:44.125 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.125 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.125 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.125 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.091573+0000", 2023-09-30T17:03:44.125 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7899999999999996e-06 2023-09-30T17:03:44.125 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.125 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.125 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:44.125 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.091623+0000", 2023-09-30T17:03:44.125 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9858999999999998e-05 2023-09-30T17:03:44.125 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.126 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.126 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:44.126 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.091703+0000", 2023-09-30T17:03:44.126 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0370999999999993e-05 2023-09-30T17:03:44.126 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.126 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.126 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.126 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.126 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.126 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:38598 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-09-30T17:03:44.126 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:44.069255+0000", 2023-09-30T17:03:44.126 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.022601911999999998, 2023-09-30T17:03:44.127 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023140074, 2023-09-30T17:03:44.127 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.127 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:44.127 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.127 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.127 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.127 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 38598 2023-09-30T17:03:44.127 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.127 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.127 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.127 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.128 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.069255+0000", 2023-09-30T17:03:44.128 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.128 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.128 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.128 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.128 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.069255+0000", 2023-09-30T17:03:44.128 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.128 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.128 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.128 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.128 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.069255+0000", 2023-09-30T17:03:44.128 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.06e-07 2023-09-30T17:03:44.128 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.129 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.129 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.129 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.069266+0000", 2023-09-30T17:03:44.129 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0766e-05 2023-09-30T17:03:44.129 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.129 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.129 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.129 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.069275+0000", 2023-09-30T17:03:44.129 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8140000000000007e-06 2023-09-30T17:03:44.129 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.129 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.130 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.130 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.069280+0000", 2023-09-30T17:03:44.130 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.13e-06 2023-09-30T17:03:44.130 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.130 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.130 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.130 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.130 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.130 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:38661 4.12 e42/17 4:48ab9bde:::100000001f8.00000015:head v 42'1192, mlcod=42'1190)", 2023-09-30T17:03:44.130 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:44.091586+0000", 2023-09-30T17:03:44.130 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.000271115, 2023-09-30T17:03:44.131 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00096510400000000005, 2023-09-30T17:03:44.131 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.131 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:44.131 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.131 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.131 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.131 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.091586+0000", 2023-09-30T17:03:44.131 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.131 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.131 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.131 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.132 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.091586+0000", 2023-09-30T17:03:44.132 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.132 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.132 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.132 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.132 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.091586+0000", 2023-09-30T17:03:44.132 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9299999999999998e-07 2023-09-30T17:03:44.132 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.132 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.132 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.132 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.091599+0000", 2023-09-30T17:03:44.132 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2828e-05 2023-09-30T17:03:44.133 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.133 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.133 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.133 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.091609+0000", 2023-09-30T17:03:44.133 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7289999999999995e-06 2023-09-30T17:03:44.133 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.133 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.133 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.133 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.091617+0000", 2023-09-30T17:03:44.133 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5529999999999993e-06 2023-09-30T17:03:44.133 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.134 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.134 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:44.134 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.091661+0000", 2023-09-30T17:03:44.134 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4067999999999999e-05 2023-09-30T17:03:44.134 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.134 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.134 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:44.134 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.091680+0000", 2023-09-30T17:03:44.134 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8765000000000001e-05 2023-09-30T17:03:44.134 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.134 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.134 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.135 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.135 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.135 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:38567 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 1990656~4096 in=4096b,write 2027520~4096 in=4096b,write 2322432~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-09-30T17:03:44.135 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:44.060276+0000", 2023-09-30T17:03:44.135 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.031581115999999999, 2023-09-30T17:03:44.135 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.032357018000000001, 2023-09-30T17:03:44.135 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.135 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:44.135 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.135 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.135 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.135 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 38567 2023-09-30T17:03:44.136 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.136 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.136 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.136 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.136 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.060276+0000", 2023-09-30T17:03:44.136 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.136 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.136 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.136 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.136 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.060276+0000", 2023-09-30T17:03:44.136 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.137 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.137 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.137 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.137 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.060276+0000", 2023-09-30T17:03:44.137 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.51e-07 2023-09-30T17:03:44.137 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.137 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.137 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.137 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.060310+0000", 2023-09-30T17:03:44.137 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3658999999999997e-05 2023-09-30T17:03:44.137 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.137 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.138 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.138 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.060317+0000", 2023-09-30T17:03:44.138 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1350000000000003e-06 2023-09-30T17:03:44.138 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.138 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.138 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.138 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.060320+0000", 2023-09-30T17:03:44.138 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4249999999999998e-06 2023-09-30T17:03:44.138 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.138 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.138 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:44.138 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.081558+0000", 2023-09-30T17:03:44.139 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.021237604 2023-09-30T17:03:44.139 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.139 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.139 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:44.139 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.081651+0000", 2023-09-30T17:03:44.139 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3387000000000006e-05 2023-09-30T17:03:44.139 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.139 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.139 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:44.139 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.081821+0000", 2023-09-30T17:03:44.139 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016946100000000001 2023-09-30T17:03:44.140 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.140 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.140 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:44.140 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.088619+0000", 2023-09-30T17:03:44.140 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0067983990000000001 2023-09-30T17:03:44.140 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.140 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.140 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.140 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.140 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.140 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:38599 4.36 4.670445b6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-09-30T17:03:44.140 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:44.069660+0000", 2023-09-30T17:03:44.141 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.022196315000000001, 2023-09-30T17:03:44.141 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023059263999999999, 2023-09-30T17:03:44.141 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.141 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:44.141 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.141 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.141 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.141 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 38599 2023-09-30T17:03:44.141 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.141 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.141 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.141 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.142 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.069660+0000", 2023-09-30T17:03:44.142 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.142 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.142 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.142 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.142 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.069660+0000", 2023-09-30T17:03:44.142 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.142 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.142 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.142 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.142 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.069661+0000", 2023-09-30T17:03:44.143 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.6899999999999997e-07 2023-09-30T17:03:44.143 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.143 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.143 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.143 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.069669+0000", 2023-09-30T17:03:44.143 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3010000000000007e-06 2023-09-30T17:03:44.143 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.143 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.143 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.143 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.069684+0000", 2023-09-30T17:03:44.143 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4565e-05 2023-09-30T17:03:44.143 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.143 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.144 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.144 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.069689+0000", 2023-09-30T17:03:44.144 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9239999999999998e-06 2023-09-30T17:03:44.144 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.144 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.144 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.144 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.144 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.144 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:38635 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-09-30T17:03:44.144 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:44.081992+0000", 2023-09-30T17:03:44.144 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0098643680000000001, 2023-09-30T17:03:44.144 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010798006000000001, 2023-09-30T17:03:44.145 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.145 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:44.145 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.145 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.145 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.145 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 38635 2023-09-30T17:03:44.145 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.145 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.145 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.145 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.145 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.081992+0000", 2023-09-30T17:03:44.145 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.146 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.146 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.146 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.146 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.081992+0000", 2023-09-30T17:03:44.146 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.146 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.146 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.146 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.146 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.081993+0000", 2023-09-30T17:03:44.146 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8899999999999999e-07 2023-09-30T17:03:44.146 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.147 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.147 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.147 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.082003+0000", 2023-09-30T17:03:44.147 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0023e-05 2023-09-30T17:03:44.147 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.147 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.147 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.147 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.082011+0000", 2023-09-30T17:03:44.147 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3159999999999997e-06 2023-09-30T17:03:44.147 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.147 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.149 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.149 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.082018+0000", 2023-09-30T17:03:44.149 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4760000000000003e-06 2023-09-30T17:03:44.149 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.149 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.149 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.149 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.149 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.150 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:38663 4.3f 4:fde182c5:::100000001f8.00000039:head [write 2576384~4096 in=4096b,write 3305472~4096 in=4096b,write 3506176~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-09-30T17:03:44.150 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:44.092430+0000", 2023-09-30T17:03:44.150 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.9994268, 2023-09-30T17:03:44.150 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00042740299999999997, 2023-09-30T17:03:44.151 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.151 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:44.151 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.151 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.152 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.152 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 38663 2023-09-30T17:03:44.152 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.152 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.152 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.152 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.152 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.092430+0000", 2023-09-30T17:03:44.152 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.152 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.152 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.152 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.153 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.092430+0000", 2023-09-30T17:03:44.153 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.153 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.153 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.153 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.153 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.092431+0000", 2023-09-30T17:03:44.153 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6400000000000001e-07 2023-09-30T17:03:44.153 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.153 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.153 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.153 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.092443+0000", 2023-09-30T17:03:44.153 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2446000000000001e-05 2023-09-30T17:03:44.154 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.154 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.154 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.154 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.092453+0000", 2023-09-30T17:03:44.154 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0341e-05 2023-09-30T17:03:44.154 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.154 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.154 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.154 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.092461+0000", 2023-09-30T17:03:44.154 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8329999999999994e-06 2023-09-30T17:03:44.154 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.154 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.155 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:44.155 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.092762+0000", 2023-09-30T17:03:44.155 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00030033499999999999 2023-09-30T17:03:44.155 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.155 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.155 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:44.155 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.092840+0000", 2023-09-30T17:03:44.155 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7886999999999995e-05 2023-09-30T17:03:44.155 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.155 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.155 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.155 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.156 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.156 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:38664 4.3d 4:bd3afb9d:::100000001f8.00000009:head [write 1757184~4096 in=4096b,write 1839104~4096 in=4096b,write 1847296~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-09-30T17:03:44.156 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:44.092479+0000", 2023-09-30T17:03:44.156 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.9993777, 2023-09-30T17:03:44.156 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000457551, 2023-09-30T17:03:44.156 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.156 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:44.156 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.156 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.156 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.156 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 38664 2023-09-30T17:03:44.156 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.157 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.157 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.157 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.157 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.092479+0000", 2023-09-30T17:03:44.157 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.157 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.157 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.157 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.157 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.092479+0000", 2023-09-30T17:03:44.157 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.157 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.158 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.158 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.158 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.092479+0000", 2023-09-30T17:03:44.158 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9999999999999998e-07 2023-09-30T17:03:44.158 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.158 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.158 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.158 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.092489+0000", 2023-09-30T17:03:44.158 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0066e-05 2023-09-30T17:03:44.158 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.158 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.158 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.159 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.092498+0000", 2023-09-30T17:03:44.159 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5150000000000006e-06 2023-09-30T17:03:44.159 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.159 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.159 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.159 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.092507+0000", 2023-09-30T17:03:44.159 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.7399999999999993e-06 2023-09-30T17:03:44.159 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.159 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.159 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:44.159 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.092560+0000", 2023-09-30T17:03:44.159 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2960000000000001e-05 2023-09-30T17:03:44.160 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.160 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.160 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:44.160 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.092648+0000", 2023-09-30T17:03:44.160 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8702999999999994e-05 2023-09-30T17:03:44.160 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.160 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.160 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.160 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.160 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.160 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:38665 4.e 4.c27217ce (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-09-30T17:03:44.161 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:44.092756+0000", 2023-09-30T17:03:44.161 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.9991007, 2023-09-30T17:03:44.161 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00025944599999999998, 2023-09-30T17:03:44.161 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.161 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:44.161 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.161 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.161 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.161 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 38665 2023-09-30T17:03:44.161 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.161 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.161 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.162 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.162 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.092756+0000", 2023-09-30T17:03:44.162 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.162 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.162 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.162 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.162 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.092756+0000", 2023-09-30T17:03:44.162 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.162 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.162 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.162 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.162 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.092757+0000", 2023-09-30T17:03:44.163 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2500000000000004e-07 2023-09-30T17:03:44.163 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.163 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.163 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.163 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.092772+0000", 2023-09-30T17:03:44.163 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5645e-05 2023-09-30T17:03:44.163 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.163 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.163 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.163 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.092782+0000", 2023-09-30T17:03:44.163 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.4360000000000008e-06 2023-09-30T17:03:44.163 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.164 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.164 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.164 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.092790+0000", 2023-09-30T17:03:44.164 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.6100000000000006e-06 2023-09-30T17:03:44.164 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.164 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.164 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.164 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.164 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.164 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop_reply(client.4547.0:38576 4.36 e42/17)", 2023-09-30T17:03:44.164 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:44.092860+0000", 2023-09-30T17:03:44.164 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.9989967, 2023-09-30T17:03:44.165 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00021271800000000001, 2023-09-30T17:03:44.165 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.165 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:44.165 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.165 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.165 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.165 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.092860+0000", 2023-09-30T17:03:44.165 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.165 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.165 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.165 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.166 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.092860+0000", 2023-09-30T17:03:44.166 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.166 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.166 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.166 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.166 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.092860+0000", 2023-09-30T17:03:44.166 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7899999999999998e-07 2023-09-30T17:03:44.166 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.166 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.166 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.166 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.092864+0000", 2023-09-30T17:03:44.167 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5300000000000001e-06 2023-09-30T17:03:44.167 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.167 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.167 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.167 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.092873+0000", 2023-09-30T17:03:44.167 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.5249999999999994e-06 2023-09-30T17:03:44.167 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.167 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.167 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.167 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.092880+0000", 2023-09-30T17:03:44.167 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5740000000000001e-06 2023-09-30T17:03:44.167 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.168 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.168 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.168 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.168 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.168 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop_reply(client.4547.0:38580 4.36 e42/17)", 2023-09-30T17:03:44.168 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:44.092894+0000", 2023-09-30T17:03:44.168 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.9989629, 2023-09-30T17:03:44.168 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000229192, 2023-09-30T17:03:44.168 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.168 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:44.168 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.168 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.169 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.169 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.092894+0000", 2023-09-30T17:03:44.169 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.169 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.169 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.169 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.169 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.092894+0000", 2023-09-30T17:03:44.169 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.169 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.169 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.169 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.169 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.092894+0000", 2023-09-30T17:03:44.170 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3000000000000002e-07 2023-09-30T17:03:44.170 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.170 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.170 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.170 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.092896+0000", 2023-09-30T17:03:44.170 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9599999999999999e-06 2023-09-30T17:03:44.170 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.170 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.170 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.170 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.092902+0000", 2023-09-30T17:03:44.170 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6350000000000003e-06 2023-09-30T17:03:44.170 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.171 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.171 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.171 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.092906+0000", 2023-09-30T17:03:44.171 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3719999999999998e-06 2023-09-30T17:03:44.171 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.171 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.171 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.171 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.171 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.171 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:38575 4.6 4:616d4c41:::100000001f8.00000034:head [write 4132864~4096 in=4096b,write 4157440~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-09-30T17:03:44.171 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:44.062778+0000", 2023-09-30T17:03:44.171 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.029078611000000001, 2023-09-30T17:03:44.172 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.030406553999999999, 2023-09-30T17:03:44.172 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.172 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:44.172 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.172 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.172 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.172 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 38575 2023-09-30T17:03:44.172 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.172 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.172 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.172 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.172 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.062778+0000", 2023-09-30T17:03:44.173 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.173 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.173 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.173 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.173 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.062778+0000", 2023-09-30T17:03:44.173 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.173 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.173 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.173 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.173 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.062779+0000", 2023-09-30T17:03:44.173 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.92e-07 2023-09-30T17:03:44.174 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.174 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.174 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.174 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.062795+0000", 2023-09-30T17:03:44.174 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5993000000000001e-05 2023-09-30T17:03:44.174 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.174 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.174 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.174 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.062807+0000", 2023-09-30T17:03:44.174 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2366e-05 2023-09-30T17:03:44.174 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.174 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.175 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.175 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.062814+0000", 2023-09-30T17:03:44.175 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2629999999999997e-06 2023-09-30T17:03:44.175 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.175 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.175 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:44.175 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.084228+0000", 2023-09-30T17:03:44.175 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.021413767 2023-09-30T17:03:44.175 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.175 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.175 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:44.176 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.084307+0000", 2023-09-30T17:03:44.176 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8647999999999996e-05 2023-09-30T17:03:44.176 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.176 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.176 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:44.176 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.084404+0000", 2023-09-30T17:03:44.176 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.6769999999999997e-05 2023-09-30T17:03:44.176 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.176 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.176 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:44.176 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.092094+0000", 2023-09-30T17:03:44.177 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0076904790000000001 2023-09-30T17:03:44.177 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.177 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.177 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.177 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.177 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.177 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:38576 4.36 4:6da220e6:::100000001f8.0000003f:head [write 3792896~4096 in=4096b,write 3891200~4096 in=4096b,write 3919872~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-09-30T17:03:44.177 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:44.062910+0000", 2023-09-30T17:03:44.177 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.028946169000000001, 2023-09-30T17:03:44.177 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.03035937, 2023-09-30T17:03:44.177 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.177 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:44.178 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.178 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.178 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.178 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 38576 2023-09-30T17:03:44.178 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.178 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.178 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.178 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.178 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.062910+0000", 2023-09-30T17:03:44.178 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.178 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.178 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.179 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.179 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.062910+0000", 2023-09-30T17:03:44.179 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.179 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.179 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.179 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.179 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.062911+0000", 2023-09-30T17:03:44.179 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1500000000000005e-07 2023-09-30T17:03:44.179 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.179 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.179 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.179 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.062945+0000", 2023-09-30T17:03:44.180 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4319999999999997e-05 2023-09-30T17:03:44.180 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.180 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.180 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.180 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.062953+0000", 2023-09-30T17:03:44.180 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6650000000000003e-06 2023-09-30T17:03:44.180 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.180 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.180 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.180 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.062957+0000", 2023-09-30T17:03:44.180 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.216e-06 2023-09-30T17:03:44.180 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.181 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.181 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:44.181 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.086713+0000", 2023-09-30T17:03:44.181 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023756005 2023-09-30T17:03:44.181 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.181 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.181 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:44.181 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.086795+0000", 2023-09-30T17:03:44.181 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1374999999999999e-05 2023-09-30T17:03:44.181 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.181 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.182 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:44.182 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.086966+0000", 2023-09-30T17:03:44.182 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000171402 2023-09-30T17:03:44.182 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.182 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.182 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.182 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.182 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.182 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:38641 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-09-30T17:03:44.182 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:44.084281+0000", 2023-09-30T17:03:44.182 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0075760020000000001, 2023-09-30T17:03:44.182 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0090622029999999996, 2023-09-30T17:03:44.183 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.183 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:44.183 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.183 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.183 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.183 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 38641 2023-09-30T17:03:44.183 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.183 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.183 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.183 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.183 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.084281+0000", 2023-09-30T17:03:44.184 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.184 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.184 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.184 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.184 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.084281+0000", 2023-09-30T17:03:44.184 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.184 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.184 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.184 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.184 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.084282+0000", 2023-09-30T17:03:44.184 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1999999999999998e-07 2023-09-30T17:03:44.184 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.185 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.185 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.185 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.084301+0000", 2023-09-30T17:03:44.185 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8989000000000001e-05 2023-09-30T17:03:44.185 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.185 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.185 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.185 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.084311+0000", 2023-09-30T17:03:44.185 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0607e-05 2023-09-30T17:03:44.185 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.185 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.185 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.185 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.084319+0000", 2023-09-30T17:03:44.186 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7200000000000006e-06 2023-09-30T17:03:44.186 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.186 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.186 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.186 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.186 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.186 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:38580 4.36 4:6fa85f86:::100000001f8.00000013:head [write 4116480~4096 in=4096b,write 4124672~4096 in=4096b,write 4136960~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-09-30T17:03:44.186 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:44.064363+0000", 2023-09-30T17:03:44.186 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.027493752, 2023-09-30T17:03:44.186 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.029042119000000002, 2023-09-30T17:03:44.186 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.187 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:44.187 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.187 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.187 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.187 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 38580 2023-09-30T17:03:44.187 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.187 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.187 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.187 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.187 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.064363+0000", 2023-09-30T17:03:44.187 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.187 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.188 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.188 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.188 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.064363+0000", 2023-09-30T17:03:44.188 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.188 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.188 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.188 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.188 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.064364+0000", 2023-09-30T17:03:44.188 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9899999999999999e-07 2023-09-30T17:03:44.188 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.188 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.188 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.189 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.064375+0000", 2023-09-30T17:03:44.189 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1148999999999999e-05 2023-09-30T17:03:44.189 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.189 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.189 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.189 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.064384+0000", 2023-09-30T17:03:44.189 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.6289999999999999e-06 2023-09-30T17:03:44.189 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.189 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.189 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.189 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.064391+0000", 2023-09-30T17:03:44.190 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9529999999999999e-06 2023-09-30T17:03:44.190 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.190 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.190 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:44.190 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.088650+0000", 2023-09-30T17:03:44.190 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024258709 2023-09-30T17:03:44.190 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.190 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.190 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:44.190 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.088720+0000", 2023-09-30T17:03:44.190 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9476999999999999e-05 2023-09-30T17:03:44.191 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.191 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.191 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:44.191 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.088814+0000", 2023-09-30T17:03:44.191 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.4582999999999999e-05 2023-09-30T17:03:44.191 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.191 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.191 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.191 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.191 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.191 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:38642 4.36 4.670445b6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-09-30T17:03:44.191 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:44.084450+0000", 2023-09-30T17:03:44.192 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0074061780000000002, 2023-09-30T17:03:44.192 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0090328990000000005, 2023-09-30T17:03:44.192 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.192 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:44.192 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.192 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.192 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.192 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 38642 2023-09-30T17:03:44.192 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.192 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.192 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.192 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.193 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.084450+0000", 2023-09-30T17:03:44.193 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.193 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.193 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.193 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.193 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.084450+0000", 2023-09-30T17:03:44.193 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.193 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.193 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.193 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.193 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.084451+0000", 2023-09-30T17:03:44.193 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7000000000000004e-07 2023-09-30T17:03:44.193 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.194 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.194 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.194 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.084465+0000", 2023-09-30T17:03:44.194 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3414000000000001e-05 2023-09-30T17:03:44.194 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.194 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.194 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.194 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.084476+0000", 2023-09-30T17:03:44.194 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.186e-05 2023-09-30T17:03:44.194 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.194 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.195 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.195 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.084484+0000", 2023-09-30T17:03:44.195 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.464e-06 2023-09-30T17:03:44.195 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.195 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.195 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.195 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.195 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.195 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:38610 4.e 4.c27217ce (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-09-30T17:03:44.195 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:44.073356+0000", 2023-09-30T17:03:44.195 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.01850104, 2023-09-30T17:03:44.195 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.020192668, 2023-09-30T17:03:44.195 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.196 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:44.196 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.196 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.196 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.196 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 38610 2023-09-30T17:03:44.196 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.196 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.196 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.196 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.196 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.073356+0000", 2023-09-30T17:03:44.196 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.197 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.197 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.197 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.197 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.073356+0000", 2023-09-30T17:03:44.197 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.197 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.197 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.197 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.197 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.073356+0000", 2023-09-30T17:03:44.197 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1500000000000004e-07 2023-09-30T17:03:44.197 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.197 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.198 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.198 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.073367+0000", 2023-09-30T17:03:44.198 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1232e-05 2023-09-30T17:03:44.198 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.198 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.198 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.198 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.073377+0000", 2023-09-30T17:03:44.198 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3579999999999992e-06 2023-09-30T17:03:44.198 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.198 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.198 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.198 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.073381+0000", 2023-09-30T17:03:44.199 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3120000000000004e-06 2023-09-30T17:03:44.199 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.199 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.199 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.199 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.199 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.199 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:38637 4.2d e42/17 4:b7099a35:::100000001f8.0000000e:head v 42'1161, mlcod=42'1155)", 2023-09-30T17:03:44.199 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:44.084631+0000", 2023-09-30T17:03:44.199 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0072256519999999999, 2023-09-30T17:03:44.199 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0089852049999999996, 2023-09-30T17:03:44.199 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.199 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:44.200 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.200 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.200 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.200 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.084631+0000", 2023-09-30T17:03:44.200 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.200 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.200 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.200 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.200 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.084631+0000", 2023-09-30T17:03:44.200 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.200 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.201 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.201 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.201 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.084632+0000", 2023-09-30T17:03:44.201 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4499999999999997e-07 2023-09-30T17:03:44.201 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.201 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.201 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.201 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.084646+0000", 2023-09-30T17:03:44.201 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4255e-05 2023-09-30T17:03:44.201 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.201 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.201 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.202 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.084655+0000", 2023-09-30T17:03:44.202 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2210000000000003e-06 2023-09-30T17:03:44.202 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.202 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.202 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.202 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.084662+0000", 2023-09-30T17:03:44.202 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5060000000000001e-06 2023-09-30T17:03:44.202 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.202 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.202 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:44.202 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.085501+0000", 2023-09-30T17:03:44.202 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00083936000000000004 2023-09-30T17:03:44.203 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.203 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.203 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:44.203 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.085522+0000", 2023-09-30T17:03:44.203 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.0970000000000001e-05 2023-09-30T17:03:44.203 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.203 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.203 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.203 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.203 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.203 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:38644 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-09-30T17:03:44.204 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:44.085179+0000", 2023-09-30T17:03:44.204 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0066772239999999998, 2023-09-30T17:03:44.204 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0085125519999999996, 2023-09-30T17:03:44.204 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.204 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:44.204 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.204 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.204 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.204 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 38644 2023-09-30T17:03:44.204 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.204 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.204 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.205 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.205 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.085179+0000", 2023-09-30T17:03:44.205 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.205 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.205 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.205 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.205 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.085179+0000", 2023-09-30T17:03:44.205 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.205 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.205 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.205 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.205 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.085180+0000", 2023-09-30T17:03:44.206 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.6899999999999997e-07 2023-09-30T17:03:44.206 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.206 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.206 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.206 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.085191+0000", 2023-09-30T17:03:44.206 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0560999999999999e-05 2023-09-30T17:03:44.206 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.206 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.206 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.206 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.085202+0000", 2023-09-30T17:03:44.206 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0925e-05 2023-09-30T17:03:44.207 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.207 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.207 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.207 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.085208+0000", 2023-09-30T17:03:44.207 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7299999999999999e-06 2023-09-30T17:03:44.207 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.207 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.207 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.207 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.207 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.207 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:38581 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 1695744~4096 in=4096b,write 1716224~4096 in=4096b,write 1785856~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-09-30T17:03:44.207 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:44.064434+0000", 2023-09-30T17:03:44.208 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.027422551999999999, 2023-09-30T17:03:44.208 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.029331627999999998, 2023-09-30T17:03:44.208 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.208 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:44.208 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.208 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.208 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.208 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 38581 2023-09-30T17:03:44.208 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.208 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.208 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.208 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.209 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.064434+0000", 2023-09-30T17:03:44.209 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.209 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.209 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.209 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.209 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.064434+0000", 2023-09-30T17:03:44.209 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.209 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.209 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.209 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.209 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.064435+0000", 2023-09-30T17:03:44.209 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5700000000000002e-07 2023-09-30T17:03:44.210 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.210 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.210 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.210 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.065252+0000", 2023-09-30T17:03:44.210 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000817522 2023-09-30T17:03:44.210 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.210 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.210 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.210 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.065262+0000", 2023-09-30T17:03:44.210 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.5780000000000005e-06 2023-09-30T17:03:44.210 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.210 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.211 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.211 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.065269+0000", 2023-09-30T17:03:44.211 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.6209999999999998e-06 2023-09-30T17:03:44.211 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.211 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.211 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:44.211 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.088939+0000", 2023-09-30T17:03:44.211 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023670354000000001 2023-09-30T17:03:44.211 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.211 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.211 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:44.211 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.089022+0000", 2023-09-30T17:03:44.212 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2806000000000006e-05 2023-09-30T17:03:44.212 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.212 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.212 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:44.212 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.089207+0000", 2023-09-30T17:03:44.212 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00018480600000000001 2023-09-30T17:03:44.212 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.212 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.212 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.212 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.212 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.213 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:38613 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-09-30T17:03:44.213 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:44.074196+0000", 2023-09-30T17:03:44.213 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.017660505999999999, 2023-09-30T17:03:44.213 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.019641907, 2023-09-30T17:03:44.213 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.213 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:44.213 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.213 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.213 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.213 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 38613 2023-09-30T17:03:44.213 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.213 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.213 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.214 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.214 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.074196+0000", 2023-09-30T17:03:44.214 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.214 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.214 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.214 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.214 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.074196+0000", 2023-09-30T17:03:44.214 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.214 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.214 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.214 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.215 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.074197+0000", 2023-09-30T17:03:44.215 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0999999999999997e-07 2023-09-30T17:03:44.215 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.215 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.215 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.215 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.074209+0000", 2023-09-30T17:03:44.215 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1593000000000001e-05 2023-09-30T17:03:44.215 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.215 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.215 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.215 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.074216+0000", 2023-09-30T17:03:44.215 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7710000000000006e-06 2023-09-30T17:03:44.216 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.216 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.216 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.216 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.074222+0000", 2023-09-30T17:03:44.216 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3149999999999999e-06 2023-09-30T17:03:44.216 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.216 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.216 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.216 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.216 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.216 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:38646 4.34 4:2d2c9530:::100000001f8.00000036:head [write 3014656~4096 in=4096b,write 3059712~4096 in=4096b,write 3088384~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-09-30T17:03:44.217 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:44.085703+0000", 2023-09-30T17:03:44.217 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0061537279999999998, 2023-09-30T17:03:44.217 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0080471329999999997, 2023-09-30T17:03:44.217 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.217 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:44.217 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.217 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.217 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.217 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 38646 2023-09-30T17:03:44.217 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.217 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.217 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.218 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.218 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.085703+0000", 2023-09-30T17:03:44.218 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.218 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.218 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.218 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.218 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.085703+0000", 2023-09-30T17:03:44.218 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.218 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.218 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.219 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.219 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.085704+0000", 2023-09-30T17:03:44.219 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0499999999999999e-06 2023-09-30T17:03:44.219 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.219 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.219 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.219 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.085716+0000", 2023-09-30T17:03:44.219 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2298e-05 2023-09-30T17:03:44.219 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.219 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.219 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.220 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.085727+0000", 2023-09-30T17:03:44.220 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0849000000000001e-05 2023-09-30T17:03:44.220 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.220 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.220 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.220 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.085734+0000", 2023-09-30T17:03:44.220 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8700000000000003e-06 2023-09-30T17:03:44.220 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.220 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.220 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:44.220 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.085788+0000", 2023-09-30T17:03:44.220 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4511e-05 2023-09-30T17:03:44.221 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.221 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.221 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:44.221 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.085873+0000", 2023-09-30T17:03:44.221 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4969000000000006e-05 2023-09-30T17:03:44.221 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.221 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.221 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:44.221 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.093607+0000", 2023-09-30T17:03:44.221 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.007733261 2023-09-30T17:03:44.221 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.221 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.222 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:44.222 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.093667+0000", 2023-09-30T17:03:44.222 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9877000000000003e-05 2023-09-30T17:03:44.222 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.222 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.222 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:44.222 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.093750+0000", 2023-09-30T17:03:44.222 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3448000000000005e-05 2023-09-30T17:03:44.222 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.222 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.222 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.223 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.223 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.223 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:38614 4.6 4.2d31fac6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-09-30T17:03:44.223 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:44.074432+0000", 2023-09-30T17:03:44.223 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.017424238000000002, 2023-09-30T17:03:44.223 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.019545672, 2023-09-30T17:03:44.223 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.223 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:44.223 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.223 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.223 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.224 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 38614 2023-09-30T17:03:44.224 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.224 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.224 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.224 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.224 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.074432+0000", 2023-09-30T17:03:44.224 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.224 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.224 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.224 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.224 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.074432+0000", 2023-09-30T17:03:44.224 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.225 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.225 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.225 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.225 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.074433+0000", 2023-09-30T17:03:44.225 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5199999999999996e-07 2023-09-30T17:03:44.225 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.225 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.225 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.225 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.074450+0000", 2023-09-30T17:03:44.225 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6558e-05 2023-09-30T17:03:44.225 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.226 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.226 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.226 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.074461+0000", 2023-09-30T17:03:44.226 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1453e-05 2023-09-30T17:03:44.226 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.226 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.226 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.226 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.074468+0000", 2023-09-30T17:03:44.226 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0210000000000002e-06 2023-09-30T17:03:44.226 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.226 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.226 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.227 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.227 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.227 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:38647 4.3d 4:bd3afb9d:::100000001f8.00000009:head [write 4100096~4096 in=4096b,write 4120576~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-09-30T17:03:44.227 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:44.086065+0000", 2023-09-30T17:03:44.227 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0057916729999999998, 2023-09-30T17:03:44.227 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0079835159999999995, 2023-09-30T17:03:44.227 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.227 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:44.227 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.227 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.227 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.227 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 38647 2023-09-30T17:03:44.228 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.228 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.228 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.228 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.228 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.086065+0000", 2023-09-30T17:03:44.228 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.228 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.228 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.228 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.228 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.086065+0000", 2023-09-30T17:03:44.228 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.228 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.229 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.229 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.229 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.086066+0000", 2023-09-30T17:03:44.229 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0449999999999999e-06 2023-09-30T17:03:44.229 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.229 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.229 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.229 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.086077+0000", 2023-09-30T17:03:44.229 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1034e-05 2023-09-30T17:03:44.229 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.229 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.229 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.229 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.086090+0000", 2023-09-30T17:03:44.230 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2785e-05 2023-09-30T17:03:44.230 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.230 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.230 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.230 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.086100+0000", 2023-09-30T17:03:44.230 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0025e-05 2023-09-30T17:03:44.230 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.230 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.230 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:44.230 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.088405+0000", 2023-09-30T17:03:44.230 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.002305316 2023-09-30T17:03:44.231 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.231 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.231 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:44.231 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.088489+0000", 2023-09-30T17:03:44.231 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3712000000000001e-05 2023-09-30T17:03:44.231 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.231 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.231 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:44.231 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.093972+0000", 2023-09-30T17:03:44.231 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0054827979999999997 2023-09-30T17:03:44.231 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.231 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.232 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:44.232 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.094018+0000", 2023-09-30T17:03:44.232 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6805999999999999e-05 2023-09-30T17:03:44.232 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.232 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.232 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.232 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.232 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.232 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:38585 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 3145728~4096 in=4096b,write 3166208~4096 in=4096b,write 3280896~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-09-30T17:03:44.232 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:44.065674+0000", 2023-09-30T17:03:44.232 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.026182191, 2023-09-30T17:03:44.233 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.028489380000000002, 2023-09-30T17:03:44.233 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.233 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:44.233 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.233 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.233 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.233 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 38585 2023-09-30T17:03:44.233 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.233 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.233 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.233 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.233 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.065674+0000", 2023-09-30T17:03:44.234 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.234 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.234 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.234 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.234 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.065674+0000", 2023-09-30T17:03:44.234 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.234 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.234 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.234 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.234 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.065675+0000", 2023-09-30T17:03:44.234 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.5900000000000005e-07 2023-09-30T17:03:44.235 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.235 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.235 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.235 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.065691+0000", 2023-09-30T17:03:44.235 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5457000000000001e-05 2023-09-30T17:03:44.235 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.235 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.235 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.235 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.065701+0000", 2023-09-30T17:03:44.235 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.9650000000000003e-06 2023-09-30T17:03:44.235 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.235 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.236 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.236 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.065708+0000", 2023-09-30T17:03:44.236 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6179999999999997e-06 2023-09-30T17:03:44.236 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.236 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.236 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:44.236 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.090927+0000", 2023-09-30T17:03:44.236 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.025219005999999999 2023-09-30T17:03:44.236 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.236 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.236 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:44.237 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.091007+0000", 2023-09-30T17:03:44.237 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9610000000000005e-05 2023-09-30T17:03:44.237 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.237 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.237 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:44.237 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.091163+0000", 2023-09-30T17:03:44.237 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015576500000000001 2023-09-30T17:03:44.237 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.237 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.237 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.237 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.237 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.237 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:38616 4.36 4.670445b6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-09-30T17:03:44.238 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:44.075386+0000", 2023-09-30T17:03:44.238 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.016470254, 2023-09-30T17:03:44.238 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.018863540000000002, 2023-09-30T17:03:44.238 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.238 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:44.238 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.238 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.238 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.238 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 38616 2023-09-30T17:03:44.238 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.238 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.239 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.239 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.239 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.075386+0000", 2023-09-30T17:03:44.239 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.239 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.239 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.239 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.239 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.075386+0000", 2023-09-30T17:03:44.239 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.239 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.239 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.239 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.240 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.075387+0000", 2023-09-30T17:03:44.240 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4199999999999995e-07 2023-09-30T17:03:44.240 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.240 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.240 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.240 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.075397+0000", 2023-09-30T17:03:44.240 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0189e-05 2023-09-30T17:03:44.240 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.240 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.240 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.240 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.075408+0000", 2023-09-30T17:03:44.240 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1072e-05 2023-09-30T17:03:44.241 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.241 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.241 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.241 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.075414+0000", 2023-09-30T17:03:44.241 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.451e-06 2023-09-30T17:03:44.241 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.241 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.241 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.241 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.241 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.241 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:38619 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-09-30T17:03:44.241 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:44.076116+0000", 2023-09-30T17:03:44.242 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.015740431999999999, 2023-09-30T17:03:44.242 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.018199595999999998, 2023-09-30T17:03:44.242 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.242 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:44.242 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.242 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.242 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.242 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 38619 2023-09-30T17:03:44.242 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.242 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.242 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.242 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.243 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.076116+0000", 2023-09-30T17:03:44.243 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.243 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.243 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.243 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.243 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.076116+0000", 2023-09-30T17:03:44.243 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.243 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.243 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.243 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.243 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.076117+0000", 2023-09-30T17:03:44.244 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1299999999999999e-07 2023-09-30T17:03:44.244 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.244 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.244 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.244 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.076132+0000", 2023-09-30T17:03:44.244 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4865000000000001e-05 2023-09-30T17:03:44.244 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.244 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.244 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.244 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.076141+0000", 2023-09-30T17:03:44.244 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.4490000000000005e-06 2023-09-30T17:03:44.244 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.245 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.245 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.245 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.076149+0000", 2023-09-30T17:03:44.245 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3390000000000004e-06 2023-09-30T17:03:44.245 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.245 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.245 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.245 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.245 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.245 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:38586 4.6 4:63e80496:::100000001f8.0000001e:head [write 585728~4096 in=4096b,write 606208~4096 in=4096b,write 811008~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-09-30T17:03:44.245 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:44.065936+0000", 2023-09-30T17:03:44.246 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.025920255, 2023-09-30T17:03:44.246 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.02845023, 2023-09-30T17:03:44.246 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.246 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:44.246 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.246 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.246 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.246 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 38586 2023-09-30T17:03:44.246 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.246 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.246 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.246 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.247 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.065936+0000", 2023-09-30T17:03:44.247 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.247 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.247 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.247 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.247 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.065936+0000", 2023-09-30T17:03:44.247 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.247 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.247 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.247 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.247 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.065937+0000", 2023-09-30T17:03:44.247 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4900000000000005e-07 2023-09-30T17:03:44.248 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.248 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.248 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.248 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.065948+0000", 2023-09-30T17:03:44.248 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0574000000000001e-05 2023-09-30T17:03:44.248 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.248 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.248 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.248 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.065959+0000", 2023-09-30T17:03:44.248 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1639e-05 2023-09-30T17:03:44.248 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.248 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.249 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.249 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.065966+0000", 2023-09-30T17:03:44.249 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.708e-06 2023-09-30T17:03:44.249 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.249 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.249 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:44.249 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.092131+0000", 2023-09-30T17:03:44.249 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.026164751999999999 2023-09-30T17:03:44.249 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.249 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.249 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:44.250 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.092227+0000", 2023-09-30T17:03:44.250 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.5768999999999997e-05 2023-09-30T17:03:44.250 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.250 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.250 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:44.250 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.092409+0000", 2023-09-30T17:03:44.250 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00018293399999999999 2023-09-30T17:03:44.250 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.250 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.250 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.250 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.250 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.251 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:38588 4.e 4:73e84e43:::100000001f8.00000004:head [write 106496~4096 in=4096b,write 122880~4096 in=4096b,write 172032~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-09-30T17:03:44.251 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:44.066434+0000", 2023-09-30T17:03:44.251 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.025422691000000001, 2023-09-30T17:03:44.251 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.028047618, 2023-09-30T17:03:44.251 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.251 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:44.251 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.251 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.251 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.251 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 38588 2023-09-30T17:03:44.251 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.251 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.252 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.252 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.252 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.066434+0000", 2023-09-30T17:03:44.252 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.252 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.252 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.252 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.252 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.066434+0000", 2023-09-30T17:03:44.252 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.252 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.252 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.252 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.253 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.066435+0000", 2023-09-30T17:03:44.253 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0809999999999999e-06 2023-09-30T17:03:44.253 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.253 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.253 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.253 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.066490+0000", 2023-09-30T17:03:44.253 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5417999999999997e-05 2023-09-30T17:03:44.253 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.253 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.253 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.253 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.066506+0000", 2023-09-30T17:03:44.253 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5379999999999998e-05 2023-09-30T17:03:44.254 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.254 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.254 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.254 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.066518+0000", 2023-09-30T17:03:44.254 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2132e-05 2023-09-30T17:03:44.254 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.254 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.254 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:44.254 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.094284+0000", 2023-09-30T17:03:44.254 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.027766414 2023-09-30T17:03:44.254 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.255 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.255 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:44.255 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.094367+0000", 2023-09-30T17:03:44.255 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3098999999999998e-05 2023-09-30T17:03:44.255 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.255 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.255 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.255 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.255 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.255 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:38621 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-09-30T17:03:44.255 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:44.076840+0000", 2023-09-30T17:03:44.255 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.015016499000000001, 2023-09-30T17:03:44.256 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.017720340000000001, 2023-09-30T17:03:44.256 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.256 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:44.256 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.256 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.256 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.256 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 38621 2023-09-30T17:03:44.256 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.256 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.256 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.256 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.256 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.076840+0000", 2023-09-30T17:03:44.257 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.257 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.257 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.257 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.257 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.076840+0000", 2023-09-30T17:03:44.257 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.257 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.257 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.257 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.257 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.076845+0000", 2023-09-30T17:03:44.257 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8439999999999997e-06 2023-09-30T17:03:44.257 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.258 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.258 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.258 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.076858+0000", 2023-09-30T17:03:44.258 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2709e-05 2023-09-30T17:03:44.258 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.258 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.258 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.258 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.076868+0000", 2023-09-30T17:03:44.258 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0776e-05 2023-09-30T17:03:44.258 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.258 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.258 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.259 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.076875+0000", 2023-09-30T17:03:44.259 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4969999999999998e-06 2023-09-30T17:03:44.259 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.259 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.259 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.259 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.259 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.259 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:38652 4.34 4:2d2c9530:::100000001f8.00000036:head [write 532480~4096 in=4096b,write 606208~4096 in=4096b,write 794624~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-09-30T17:03:44.259 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:44.088015+0000", 2023-09-30T17:03:44.259 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0038417099999999999, 2023-09-30T17:03:44.259 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0066175089999999997, 2023-09-30T17:03:44.259 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.260 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:44.260 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.260 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.260 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.260 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 38652 2023-09-30T17:03:44.260 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.260 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.260 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.260 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.260 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.088015+0000", 2023-09-30T17:03:44.260 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.260 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.261 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.261 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.261 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.088015+0000", 2023-09-30T17:03:44.261 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.261 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.261 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.261 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.261 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.088016+0000", 2023-09-30T17:03:44.261 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8899999999999999e-07 2023-09-30T17:03:44.261 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.261 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.261 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.262 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.088024+0000", 2023-09-30T17:03:44.262 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.7809999999999994e-06 2023-09-30T17:03:44.262 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.262 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.262 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.262 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.088032+0000", 2023-09-30T17:03:44.262 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4540000000000001e-06 2023-09-30T17:03:44.262 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.262 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.262 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.262 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.088037+0000", 2023-09-30T17:03:44.263 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4739999999999996e-06 2023-09-30T17:03:44.263 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.263 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.263 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:44.263 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.088448+0000", 2023-09-30T17:03:44.263 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0004105 2023-09-30T17:03:44.263 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.263 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.263 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:44.263 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.088506+0000", 2023-09-30T17:03:44.263 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8180000000000002e-05 2023-09-30T17:03:44.263 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.264 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.264 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.264 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.264 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.264 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:38653 4.36 4.670445b6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-09-30T17:03:44.264 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:44.088047+0000", 2023-09-30T17:03:44.264 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0038096660000000002, 2023-09-30T17:03:44.265 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0066616399999999999, 2023-09-30T17:03:44.265 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.266 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:44.266 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.266 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.266 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.266 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 38653 2023-09-30T17:03:44.266 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.266 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.266 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.266 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.266 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.088047+0000", 2023-09-30T17:03:44.266 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.267 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.267 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.267 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.267 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.088047+0000", 2023-09-30T17:03:44.267 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.267 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.267 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.267 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.267 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.088047+0000", 2023-09-30T17:03:44.267 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.41e-07 2023-09-30T17:03:44.267 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.267 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.268 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.268 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.088055+0000", 2023-09-30T17:03:44.268 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3849999999999996e-06 2023-09-30T17:03:44.268 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.268 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.268 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.268 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.088061+0000", 2023-09-30T17:03:44.268 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8599999999999998e-06 2023-09-30T17:03:44.268 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.268 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.268 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.269 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.088064+0000", 2023-09-30T17:03:44.269 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4300000000000002e-06 2023-09-30T17:03:44.269 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.269 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.269 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.269 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.269 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.269 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:38590 4.e 4.c27217ce (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-09-30T17:03:44.269 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:44.066995+0000", 2023-09-30T17:03:44.269 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.024861344, 2023-09-30T17:03:44.269 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.027746870999999999, 2023-09-30T17:03:44.269 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.270 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:44.270 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.270 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.270 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.270 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 38590 2023-09-30T17:03:44.270 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.270 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.270 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.270 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.270 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.066995+0000", 2023-09-30T17:03:44.270 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.271 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.271 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.271 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.271 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.066995+0000", 2023-09-30T17:03:44.271 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.271 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.271 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.271 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.271 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.066996+0000", 2023-09-30T17:03:44.271 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1500000000000003e-07 2023-09-30T17:03:44.271 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.271 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.272 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.272 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.067049+0000", 2023-09-30T17:03:44.272 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3168999999999999e-05 2023-09-30T17:03:44.272 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.272 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.272 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.272 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.067061+0000", 2023-09-30T17:03:44.272 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1294999999999999e-05 2023-09-30T17:03:44.272 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.272 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.272 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.272 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.067069+0000", 2023-09-30T17:03:44.273 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5539999999999998e-06 2023-09-30T17:03:44.273 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.273 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.273 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.273 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.273 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.273 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:38623 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-09-30T17:03:44.273 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:44.077483+0000", 2023-09-30T17:03:44.273 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.014373520000000001, 2023-09-30T17:03:44.273 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.017300310999999999, 2023-09-30T17:03:44.273 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.273 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:44.274 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.274 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.274 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.274 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 38623 2023-09-30T17:03:44.274 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.274 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.274 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.274 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.274 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.077483+0000", 2023-09-30T17:03:44.274 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.274 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.275 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.275 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.275 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.077483+0000", 2023-09-30T17:03:44.275 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.275 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.275 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.275 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.275 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.077484+0000", 2023-09-30T17:03:44.275 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.85e-07 2023-09-30T17:03:44.275 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.275 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.275 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.276 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.077497+0000", 2023-09-30T17:03:44.276 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2751999999999999e-05 2023-09-30T17:03:44.276 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.276 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.276 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.276 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.077505+0000", 2023-09-30T17:03:44.276 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.7390000000000005e-06 2023-09-30T17:03:44.276 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.276 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.276 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.276 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.077516+0000", 2023-09-30T17:03:44.277 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0268999999999999e-05 2023-09-30T17:03:44.277 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.277 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.277 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.277 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.277 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.277 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:38655 4.3f 4:fde182c5:::100000001f8.00000039:head [write 1724416~4096 in=4096b,write 1777664~4096 in=4096b,write 1814528~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e42)", 2023-09-30T17:03:44.277 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:44.088120+0000", 2023-09-30T17:03:44.277 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.003736723, 2023-09-30T17:03:44.277 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0067038330000000002, 2023-09-30T17:03:44.278 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.278 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:44.278 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.278 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.278 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.278 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 38655 2023-09-30T17:03:44.278 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.278 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.278 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.278 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.278 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.088120+0000", 2023-09-30T17:03:44.279 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.279 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.279 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.279 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.279 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.088120+0000", 2023-09-30T17:03:44.279 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.279 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.279 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.279 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.279 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.088121+0000", 2023-09-30T17:03:44.279 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9699999999999995e-07 2023-09-30T17:03:44.280 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.280 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.280 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.280 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.088136+0000", 2023-09-30T17:03:44.280 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5017999999999999e-05 2023-09-30T17:03:44.280 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.280 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.280 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.280 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.088148+0000", 2023-09-30T17:03:44.280 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1943999999999999e-05 2023-09-30T17:03:44.280 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.280 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.281 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.281 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.088155+0000", 2023-09-30T17:03:44.281 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3660000000000003e-06 2023-09-30T17:03:44.281 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.281 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.281 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:44.281 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.091197+0000", 2023-09-30T17:03:44.281 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0030421179999999999 2023-09-30T17:03:44.281 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.281 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.281 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:44.281 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.091277+0000", 2023-09-30T17:03:44.282 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9383999999999998e-05 2023-09-30T17:03:44.282 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.282 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.282 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:44.282 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.091416+0000", 2023-09-30T17:03:44.282 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00013918399999999999 2023-09-30T17:03:44.282 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.282 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.282 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:44.282 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:44.094475+0000", 2023-09-30T17:03:44.282 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0030593199999999999 2023-09-30T17:03:44.282 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.283 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.283 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.283 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.283 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-09-30T17:03:44.283 INFO:teuthology.orchestra.run.smithi031.stdout: "num_ops": 41 2023-09-30T17:03:44.283 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:44.283 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:03:44.284 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:44.264+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:44.366 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:44.366+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:44.432 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is unset 2023-09-30T17:03:44.466 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:44.466+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:44.468 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:44.468 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:03:44.468 INFO:teuthology.orchestra.run.smithi031.stdout: "complaint_time": 30, 2023-09-30T17:03:44.468 INFO:teuthology.orchestra.run.smithi031.stdout: "num_blocked_ops": 0 2023-09-30T17:03:44.468 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:44.483 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:03:44.567 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:44.566+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:44.668 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:44.668+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:44.728 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:44.728 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 20, 2023-09-30T17:03:44.728 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 600, 2023-09-30T17:03:44.728 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:03:44.729 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.729 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23704 4.14 4:2b28d75f:::100000001f8.00000016:head [write 262144~4096,write 274432~4096,write 405504~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:44.729 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.711008+0000", 2023-09-30T17:03:44.729 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 6.0146993169999998, 2023-09-30T17:03:44.729 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.229109541, 2023-09-30T17:03:44.729 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.729 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:44.729 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.729 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.729 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.729 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23704 2023-09-30T17:03:44.730 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.730 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.730 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.730 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.730 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711008+0000", 2023-09-30T17:03:44.730 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.730 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.730 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.730 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.730 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711008+0000", 2023-09-30T17:03:44.730 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.731 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.731 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.731 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.731 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711009+0000", 2023-09-30T17:03:44.731 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5899999999999995e-07 2023-09-30T17:03:44.731 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.731 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.731 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.731 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711042+0000", 2023-09-30T17:03:44.731 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3149999999999999e-05 2023-09-30T17:03:44.731 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.731 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.732 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.732 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711054+0000", 2023-09-30T17:03:44.732 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1742999999999999e-05 2023-09-30T17:03:44.732 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.732 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.732 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.732 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711059+0000", 2023-09-30T17:03:44.732 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3009999999999997e-06 2023-09-30T17:03:44.732 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.732 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.732 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:44.732 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711120+0000", 2023-09-30T17:03:44.733 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1228000000000004e-05 2023-09-30T17:03:44.733 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.733 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.733 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:44.733 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711205+0000", 2023-09-30T17:03:44.733 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4489999999999999e-05 2023-09-30T17:03:44.733 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.733 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.733 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:44.733 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711371+0000", 2023-09-30T17:03:44.733 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016639500000000001 2023-09-30T17:03:44.734 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.734 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.734 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:44.734 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.716551+0000", 2023-09-30T17:03:44.734 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051799929999999999 2023-09-30T17:03:44.734 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.734 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.734 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:44.734 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.940040+0000", 2023-09-30T17:03:44.734 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22348859800000001 2023-09-30T17:03:44.734 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.734 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.735 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:44.735 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.940080+0000", 2023-09-30T17:03:44.735 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0114999999999998e-05 2023-09-30T17:03:44.735 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.735 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.735 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:44.735 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.940118+0000", 2023-09-30T17:03:44.735 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7768999999999997e-05 2023-09-30T17:03:44.735 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.735 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.735 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.736 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.736 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.736 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23713 4.33 4:cf6d7a6c:::100000001f8.0000000a:head [write 585728~4096,write 925696~4096,write 937984~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:44.736 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.714948+0000", 2023-09-30T17:03:44.736 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 6.0107596030000003, 2023-09-30T17:03:44.736 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23061467099999999, 2023-09-30T17:03:44.736 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.736 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:44.736 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.736 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.736 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.736 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23713 2023-09-30T17:03:44.737 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.737 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.737 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.737 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.737 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.714948+0000", 2023-09-30T17:03:44.737 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.737 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.737 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.737 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.737 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.714948+0000", 2023-09-30T17:03:44.737 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.737 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.738 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.738 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.738 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.714949+0000", 2023-09-30T17:03:44.738 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1399999999999995e-07 2023-09-30T17:03:44.738 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.738 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.738 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.738 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.714961+0000", 2023-09-30T17:03:44.738 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1916000000000001e-05 2023-09-30T17:03:44.738 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.738 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.739 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.739 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.714979+0000", 2023-09-30T17:03:44.739 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8070000000000001e-05 2023-09-30T17:03:44.739 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.739 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.739 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.739 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.714987+0000", 2023-09-30T17:03:44.739 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4179999999999997e-06 2023-09-30T17:03:44.739 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.739 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.739 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:44.739 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.715034+0000", 2023-09-30T17:03:44.740 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6563999999999997e-05 2023-09-30T17:03:44.740 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.740 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.740 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:44.740 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.715083+0000", 2023-09-30T17:03:44.740 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9310000000000001e-05 2023-09-30T17:03:44.740 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.740 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.740 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:44.740 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.715177+0000", 2023-09-30T17:03:44.740 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3525999999999999e-05 2023-09-30T17:03:44.741 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.741 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.741 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:44.741 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.719724+0000", 2023-09-30T17:03:44.741 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0045477210000000002 2023-09-30T17:03:44.741 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.741 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.741 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:44.741 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.945467+0000", 2023-09-30T17:03:44.741 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22574224500000001 2023-09-30T17:03:44.741 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.741 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.742 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:44.742 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.945524+0000", 2023-09-30T17:03:44.742 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7105999999999998e-05 2023-09-30T17:03:44.742 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.742 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.742 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:44.742 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.945563+0000", 2023-09-30T17:03:44.742 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8881000000000003e-05 2023-09-30T17:03:44.742 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.742 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.742 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.743 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.743 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.743 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23735 4.6 4:616d4c41:::100000001f8.00000034:head [write 991232~4096,write 1040384~4096,write 1200128~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:44.743 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.722398+0000", 2023-09-30T17:03:44.743 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 6.0033092479999999, 2023-09-30T17:03:44.743 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.230202669, 2023-09-30T17:03:44.743 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.743 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:44.743 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.743 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.743 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.743 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23735 2023-09-30T17:03:44.744 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.744 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.744 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.744 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.744 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722398+0000", 2023-09-30T17:03:44.744 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.744 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.744 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.744 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.744 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722398+0000", 2023-09-30T17:03:44.744 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.744 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.745 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.745 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.745 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722399+0000", 2023-09-30T17:03:44.745 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2799999999999996e-07 2023-09-30T17:03:44.745 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.745 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.745 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.745 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722423+0000", 2023-09-30T17:03:44.745 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4134e-05 2023-09-30T17:03:44.745 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.745 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.746 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.746 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722429+0000", 2023-09-30T17:03:44.746 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4590000000000003e-06 2023-09-30T17:03:44.746 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.746 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.746 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.746 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722434+0000", 2023-09-30T17:03:44.746 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1779999999999996e-06 2023-09-30T17:03:44.746 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.746 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.746 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:44.746 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722490+0000", 2023-09-30T17:03:44.747 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6215999999999998e-05 2023-09-30T17:03:44.747 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.747 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.747 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:44.747 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722600+0000", 2023-09-30T17:03:44.747 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00011017 2023-09-30T17:03:44.747 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.747 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.747 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:44.747 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722769+0000", 2023-09-30T17:03:44.747 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0001695 2023-09-30T17:03:44.748 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.748 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.748 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:44.748 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725807+0000", 2023-09-30T17:03:44.748 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0030372120000000001 2023-09-30T17:03:44.748 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.748 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.748 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:44.748 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.952546+0000", 2023-09-30T17:03:44.748 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22673923600000001 2023-09-30T17:03:44.748 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.748 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.749 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:44.749 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.952579+0000", 2023-09-30T17:03:44.749 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3111000000000002e-05 2023-09-30T17:03:44.749 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.749 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.749 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:44.749 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.952601+0000", 2023-09-30T17:03:44.749 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1925000000000001e-05 2023-09-30T17:03:44.749 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.749 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.749 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.749 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.750 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.750 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23738 4.6 4:616d4c41:::100000001f8.00000034:head [write 3043328~4096,write 3055616~4096,write 3080192~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:44.750 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.723439+0000", 2023-09-30T17:03:44.750 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 6.0022682749999996, 2023-09-30T17:03:44.750 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23665340400000001, 2023-09-30T17:03:44.750 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.750 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:44.750 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.750 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.750 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.750 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23738 2023-09-30T17:03:44.751 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.751 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.751 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.751 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.751 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723439+0000", 2023-09-30T17:03:44.751 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.751 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.751 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.751 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.751 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723439+0000", 2023-09-30T17:03:44.751 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.751 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.752 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.752 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.752 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723440+0000", 2023-09-30T17:03:44.752 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.23e-07 2023-09-30T17:03:44.752 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.752 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.752 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.752 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723452+0000", 2023-09-30T17:03:44.752 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2147000000000001e-05 2023-09-30T17:03:44.752 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.752 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.753 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.753 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723461+0000", 2023-09-30T17:03:44.753 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3839999999999997e-06 2023-09-30T17:03:44.753 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.753 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.753 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.753 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723465+0000", 2023-09-30T17:03:44.753 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7559999999999999e-06 2023-09-30T17:03:44.753 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.753 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.753 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:44.753 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723924+0000", 2023-09-30T17:03:44.753 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00045910299999999999 2023-09-30T17:03:44.754 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.754 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.754 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:44.754 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723970+0000", 2023-09-30T17:03:44.754 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5126999999999997e-05 2023-09-30T17:03:44.754 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.754 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.754 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:44.754 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724057+0000", 2023-09-30T17:03:44.754 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.7142e-05 2023-09-30T17:03:44.754 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.755 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.755 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:44.755 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.726148+0000", 2023-09-30T17:03:44.755 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.002091449 2023-09-30T17:03:44.755 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.755 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.755 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:44.755 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.960040+0000", 2023-09-30T17:03:44.755 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23389163299999999 2023-09-30T17:03:44.755 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.755 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.756 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:44.756 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.960071+0000", 2023-09-30T17:03:44.756 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.133e-05 2023-09-30T17:03:44.756 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.756 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.756 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:44.756 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.960093+0000", 2023-09-30T17:03:44.756 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1509999999999999e-05 2023-09-30T17:03:44.756 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.756 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.756 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.756 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.757 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.757 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23740 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 3780608~4096,write 3788800~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:44.757 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.723994+0000", 2023-09-30T17:03:44.757 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 6.0017134990000001, 2023-09-30T17:03:44.757 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.234031238, 2023-09-30T17:03:44.757 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.757 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:44.757 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.757 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.757 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.757 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23740 2023-09-30T17:03:44.757 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.758 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.758 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.758 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.758 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723994+0000", 2023-09-30T17:03:44.758 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.758 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.758 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.758 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.758 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723994+0000", 2023-09-30T17:03:44.758 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.758 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.759 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.759 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.759 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723995+0000", 2023-09-30T17:03:44.759 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6000000000000003e-07 2023-09-30T17:03:44.759 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.759 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.759 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.761 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724004+0000", 2023-09-30T17:03:44.761 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.4909999999999994e-06 2023-09-30T17:03:44.761 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.761 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.761 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.761 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724012+0000", 2023-09-30T17:03:44.761 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4590000000000001e-06 2023-09-30T17:03:44.761 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.761 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.762 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.762 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724016+0000", 2023-09-30T17:03:44.762 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9890000000000003e-06 2023-09-30T17:03:44.762 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.762 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.762 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:44.762 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724060+0000", 2023-09-30T17:03:44.762 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4339999999999999e-05 2023-09-30T17:03:44.762 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.762 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.762 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:44.763 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724141+0000", 2023-09-30T17:03:44.763 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1384000000000005e-05 2023-09-30T17:03:44.763 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.763 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.763 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:44.763 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724300+0000", 2023-09-30T17:03:44.763 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015870700000000001 2023-09-30T17:03:44.763 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.763 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.763 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:44.763 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.726182+0000", 2023-09-30T17:03:44.764 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0018816060000000001 2023-09-30T17:03:44.764 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.764 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.764 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:44.764 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.957929+0000", 2023-09-30T17:03:44.764 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23174703399999999 2023-09-30T17:03:44.764 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.764 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.764 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:44.764 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.957983+0000", 2023-09-30T17:03:44.764 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4107999999999998e-05 2023-09-30T17:03:44.764 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.765 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.765 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:44.765 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.958025+0000", 2023-09-30T17:03:44.765 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2360000000000001e-05 2023-09-30T17:03:44.765 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.765 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.765 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.765 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.765 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.765 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23746 4.28 4:15eeb89b:::100000001f8.00000032:head [write 3731456~4096,write 3919872~4096,write 3952640~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:44.765 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.725721+0000", 2023-09-30T17:03:44.765 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.9999861150000005, 2023-09-30T17:03:44.766 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.24024479800000001, 2023-09-30T17:03:44.766 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.766 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:44.766 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.766 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.766 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.766 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23746 2023-09-30T17:03:44.766 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.766 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.766 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.766 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.767 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725721+0000", 2023-09-30T17:03:44.767 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.767 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.767 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.767 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.767 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725721+0000", 2023-09-30T17:03:44.767 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.767 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.767 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.767 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.767 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725722+0000", 2023-09-30T17:03:44.768 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6499999999999999e-07 2023-09-30T17:03:44.768 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.768 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.768 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.768 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725732+0000", 2023-09-30T17:03:44.768 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7559999999999994e-06 2023-09-30T17:03:44.768 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.768 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.768 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.768 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725738+0000", 2023-09-30T17:03:44.768 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8360000000000003e-06 2023-09-30T17:03:44.768 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.769 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.769 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.769 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725746+0000", 2023-09-30T17:03:44.769 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4200000000000001e-06 2023-09-30T17:03:44.769 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.769 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.769 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:44.769 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725805+0000", 2023-09-30T17:03:44.769 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9318999999999999e-05 2023-09-30T17:03:44.769 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.769 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.769 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:44.770 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725904+0000", 2023-09-30T17:03:44.770 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8747999999999997e-05 2023-09-30T17:03:44.770 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.770 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.770 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:44.770 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.726075+0000", 2023-09-30T17:03:44.770 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017153700000000001 2023-09-30T17:03:44.770 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.770 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.770 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:44.770 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.727419+0000", 2023-09-30T17:03:44.770 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001343571 2023-09-30T17:03:44.771 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.771 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.771 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:44.771 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.965839+0000", 2023-09-30T17:03:44.771 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.238420467 2023-09-30T17:03:44.771 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.771 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.771 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:44.771 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.965922+0000", 2023-09-30T17:03:44.771 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2905000000000007e-05 2023-09-30T17:03:44.771 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.772 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.772 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:44.772 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.965966+0000", 2023-09-30T17:03:44.772 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3773999999999998e-05 2023-09-30T17:03:44.772 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.772 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.772 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.772 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.772 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.772 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23757 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 2117632~8192,write 2228224~4096,write 2453504~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:44.772 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.728711+0000", 2023-09-30T17:03:44.772 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.9969965399999996, 2023-09-30T17:03:44.773 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23330704499999999, 2023-09-30T17:03:44.773 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.773 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:44.773 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.773 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.773 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.773 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23757 2023-09-30T17:03:44.773 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.773 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.773 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.773 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.774 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728711+0000", 2023-09-30T17:03:44.774 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.774 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.774 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.774 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.774 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728711+0000", 2023-09-30T17:03:44.774 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.774 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.774 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.774 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.774 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728712+0000", 2023-09-30T17:03:44.774 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4199999999999995e-07 2023-09-30T17:03:44.775 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.775 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.775 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.775 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728738+0000", 2023-09-30T17:03:44.775 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.6761e-05 2023-09-30T17:03:44.775 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.775 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.775 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.775 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728745+0000", 2023-09-30T17:03:44.775 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9940000000000003e-06 2023-09-30T17:03:44.775 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.776 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.776 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.776 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728749+0000", 2023-09-30T17:03:44.776 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.053e-06 2023-09-30T17:03:44.776 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.776 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.776 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:44.776 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728802+0000", 2023-09-30T17:03:44.776 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2918999999999999e-05 2023-09-30T17:03:44.776 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.776 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.776 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:44.777 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728923+0000", 2023-09-30T17:03:44.777 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00012084200000000001 2023-09-30T17:03:44.777 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.777 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.777 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:44.777 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.729101+0000", 2023-09-30T17:03:44.777 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000178226 2023-09-30T17:03:44.777 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.777 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.777 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:44.777 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732207+0000", 2023-09-30T17:03:44.777 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0031059849999999999 2023-09-30T17:03:44.778 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.778 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.778 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:44.778 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.961949+0000", 2023-09-30T17:03:44.778 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.229741842 2023-09-30T17:03:44.778 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.778 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.778 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:44.778 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.961986+0000", 2023-09-30T17:03:44.778 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7147000000000002e-05 2023-09-30T17:03:44.778 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.779 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.779 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:44.779 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.962018+0000", 2023-09-30T17:03:44.779 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.1634000000000002e-05 2023-09-30T17:03:44.779 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.779 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.779 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.779 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.779 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.779 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23768 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 1257472~4096,write 1384448~4096,write 1474560~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:44.779 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.732216+0000", 2023-09-30T17:03:44.779 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.9934919080000002, 2023-09-30T17:03:44.780 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22951861000000001, 2023-09-30T17:03:44.780 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.780 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:44.780 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.780 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.780 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.780 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23768 2023-09-30T17:03:44.780 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.780 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.780 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.780 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.781 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732216+0000", 2023-09-30T17:03:44.781 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.781 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.781 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.781 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.781 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732216+0000", 2023-09-30T17:03:44.781 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.781 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.781 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.781 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.781 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732216+0000", 2023-09-30T17:03:44.782 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.71e-07 2023-09-30T17:03:44.782 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.782 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.782 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.782 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732231+0000", 2023-09-30T17:03:44.782 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5007e-05 2023-09-30T17:03:44.782 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.782 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.782 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.782 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732239+0000", 2023-09-30T17:03:44.782 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8509999999999999e-06 2023-09-30T17:03:44.783 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.783 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.783 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.783 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732244+0000", 2023-09-30T17:03:44.783 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2000000000000002e-06 2023-09-30T17:03:44.783 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.783 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.783 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:44.783 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732285+0000", 2023-09-30T17:03:44.783 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0877000000000002e-05 2023-09-30T17:03:44.783 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.783 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.784 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:44.784 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732331+0000", 2023-09-30T17:03:44.784 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5906999999999999e-05 2023-09-30T17:03:44.784 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.784 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.784 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:44.784 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732421+0000", 2023-09-30T17:03:44.784 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9993000000000004e-05 2023-09-30T17:03:44.784 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.784 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.784 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:44.785 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.737687+0000", 2023-09-30T17:03:44.785 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005265792 2023-09-30T17:03:44.785 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.785 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.785 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:44.785 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.961667+0000", 2023-09-30T17:03:44.785 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22398030799999999 2023-09-30T17:03:44.785 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.785 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.785 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:44.785 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.961703+0000", 2023-09-30T17:03:44.785 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5221e-05 2023-09-30T17:03:44.786 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.786 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.786 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:44.786 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.961734+0000", 2023-09-30T17:03:44.786 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.1582999999999999e-05 2023-09-30T17:03:44.786 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.786 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.786 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.786 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.786 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.786 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23780 4.36 4:6fa85f86:::100000001f8.00000013:head [write 3469312~4096,write 3522560~4096,write 3579904~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:44.787 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.735686+0000", 2023-09-30T17:03:44.787 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.9900216769999997, 2023-09-30T17:03:44.787 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22921459399999999, 2023-09-30T17:03:44.787 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.787 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:44.787 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.787 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.787 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.787 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23780 2023-09-30T17:03:44.787 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.787 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.787 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.788 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.788 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.735686+0000", 2023-09-30T17:03:44.788 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.788 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.788 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.788 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.788 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.735686+0000", 2023-09-30T17:03:44.788 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.788 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.788 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.788 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.788 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.735687+0000", 2023-09-30T17:03:44.789 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3399999999999998e-07 2023-09-30T17:03:44.789 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.789 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.789 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.789 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.735701+0000", 2023-09-30T17:03:44.789 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4324999999999999e-05 2023-09-30T17:03:44.789 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.789 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.789 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.789 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.735713+0000", 2023-09-30T17:03:44.789 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1678999999999999e-05 2023-09-30T17:03:44.789 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.790 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.790 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.790 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.735720+0000", 2023-09-30T17:03:44.790 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8490000000000006e-06 2023-09-30T17:03:44.790 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.790 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.790 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:44.790 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.736637+0000", 2023-09-30T17:03:44.790 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00091620799999999995 2023-09-30T17:03:44.790 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.790 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.791 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:44.791 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.736719+0000", 2023-09-30T17:03:44.791 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2608999999999995e-05 2023-09-30T17:03:44.791 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.791 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.791 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:44.791 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.736876+0000", 2023-09-30T17:03:44.791 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015636799999999999 2023-09-30T17:03:44.791 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.791 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.791 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:44.792 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.742934+0000", 2023-09-30T17:03:44.792 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0060581619999999997 2023-09-30T17:03:44.792 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.792 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.792 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:44.792 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.964798+0000", 2023-09-30T17:03:44.792 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22186376599999999 2023-09-30T17:03:44.792 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.792 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.792 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:44.792 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.964859+0000", 2023-09-30T17:03:44.792 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1668000000000007e-05 2023-09-30T17:03:44.793 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.793 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.793 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:44.793 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.964900+0000", 2023-09-30T17:03:44.793 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1125999999999999e-05 2023-09-30T17:03:44.793 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.793 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.793 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.793 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.793 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.793 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23856 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 3538944~4096,write 3616768~4096,write 3686400~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:44.794 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.759274+0000", 2023-09-30T17:03:44.794 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.9664337960000005, 2023-09-30T17:03:44.794 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.234084127, 2023-09-30T17:03:44.794 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.794 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:44.794 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.794 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.794 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.794 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23856 2023-09-30T17:03:44.794 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.794 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.795 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.795 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.795 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759274+0000", 2023-09-30T17:03:44.795 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.795 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.795 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.795 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.795 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759274+0000", 2023-09-30T17:03:44.795 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.795 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.795 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.796 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.796 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759274+0000", 2023-09-30T17:03:44.796 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7899999999999998e-07 2023-09-30T17:03:44.796 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.796 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.796 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.796 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759293+0000", 2023-09-30T17:03:44.796 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8410000000000002e-05 2023-09-30T17:03:44.796 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.796 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.796 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.796 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759302+0000", 2023-09-30T17:03:44.797 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8599999999999999e-06 2023-09-30T17:03:44.797 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.797 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.797 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.797 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759306+0000", 2023-09-30T17:03:44.797 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4499999999999997e-06 2023-09-30T17:03:44.797 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.797 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.797 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:44.797 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759984+0000", 2023-09-30T17:03:44.797 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00067830600000000005 2023-09-30T17:03:44.798 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.798 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.798 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:44.798 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.760041+0000", 2023-09-30T17:03:44.798 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.643e-05 2023-09-30T17:03:44.798 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.798 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.798 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:44.798 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.760135+0000", 2023-09-30T17:03:44.798 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3795999999999994e-05 2023-09-30T17:03:44.798 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.799 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.799 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:44.799 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764097+0000", 2023-09-30T17:03:44.799 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0039625629999999997 2023-09-30T17:03:44.799 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.799 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.799 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:44.799 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993282+0000", 2023-09-30T17:03:44.799 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22918461500000001 2023-09-30T17:03:44.799 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.799 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.800 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:44.800 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993320+0000", 2023-09-30T17:03:44.800 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8600999999999999e-05 2023-09-30T17:03:44.800 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.800 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.800 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:44.800 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993358+0000", 2023-09-30T17:03:44.800 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7517e-05 2023-09-30T17:03:44.800 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.800 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.800 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.800 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.801 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.801 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23865 4.36 4:6da220e6:::100000001f8.0000003f:head [write 3715072~4096,write 3850240~4096,write 4059136~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:44.801 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.761946+0000", 2023-09-30T17:03:44.801 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.9637613109999998, 2023-09-30T17:03:44.801 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.231486097, 2023-09-30T17:03:44.801 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.801 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:44.801 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.801 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.801 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.801 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23865 2023-09-30T17:03:44.801 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.802 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.802 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.802 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.802 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.761946+0000", 2023-09-30T17:03:44.802 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.802 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.802 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.802 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.802 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.761946+0000", 2023-09-30T17:03:44.802 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.802 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.803 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.803 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.803 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.761947+0000", 2023-09-30T17:03:44.803 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7000000000000004e-07 2023-09-30T17:03:44.803 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.803 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.803 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.803 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.761959+0000", 2023-09-30T17:03:44.803 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2265e-05 2023-09-30T17:03:44.803 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.803 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.804 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.804 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.761970+0000", 2023-09-30T17:03:44.804 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0474e-05 2023-09-30T17:03:44.804 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.804 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.804 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.804 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.761976+0000", 2023-09-30T17:03:44.804 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1340000000000001e-06 2023-09-30T17:03:44.804 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.804 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.804 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:44.804 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.762063+0000", 2023-09-30T17:03:44.805 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.6728e-05 2023-09-30T17:03:44.805 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.805 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.805 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:44.805 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.762125+0000", 2023-09-30T17:03:44.805 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2869999999999999e-05 2023-09-30T17:03:44.805 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.805 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.805 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:44.805 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.762235+0000", 2023-09-30T17:03:44.805 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000109139 2023-09-30T17:03:44.806 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.806 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.806 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:44.806 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764102+0000", 2023-09-30T17:03:44.806 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001867121 2023-09-30T17:03:44.806 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.806 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.806 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:44.806 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993327+0000", 2023-09-30T17:03:44.806 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22922526800000001 2023-09-30T17:03:44.806 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.807 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.807 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:44.807 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993391+0000", 2023-09-30T17:03:44.807 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3839999999999999e-05 2023-09-30T17:03:44.807 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.807 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.807 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:44.807 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993432+0000", 2023-09-30T17:03:44.807 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1488e-05 2023-09-30T17:03:44.807 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.807 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.807 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.808 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.808 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.808 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23875 4.36 4:6da220e6:::100000001f8.0000003f:head [write 364544~4096,write 499712~4096,write 655360~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:44.808 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.764904+0000", 2023-09-30T17:03:44.808 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.9608031270000001, 2023-09-30T17:03:44.808 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.228631693, 2023-09-30T17:03:44.808 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.808 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:44.808 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.808 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.808 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.808 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23875 2023-09-30T17:03:44.809 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.809 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.809 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.809 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.809 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764904+0000", 2023-09-30T17:03:44.809 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.809 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.809 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.809 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.809 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764904+0000", 2023-09-30T17:03:44.809 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.809 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.810 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.810 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.810 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764905+0000", 2023-09-30T17:03:44.810 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2799999999999995e-07 2023-09-30T17:03:44.810 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.810 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.810 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.810 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764915+0000", 2023-09-30T17:03:44.810 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8099999999999992e-06 2023-09-30T17:03:44.810 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.810 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.811 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.811 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764926+0000", 2023-09-30T17:03:44.811 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0858e-05 2023-09-30T17:03:44.811 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.811 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.811 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.811 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764931+0000", 2023-09-30T17:03:44.811 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2170000000000002e-06 2023-09-30T17:03:44.811 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.811 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.811 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:44.811 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764963+0000", 2023-09-30T17:03:44.812 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.2319e-05 2023-09-30T17:03:44.812 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.812 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.812 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:44.812 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.765009+0000", 2023-09-30T17:03:44.812 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5753000000000001e-05 2023-09-30T17:03:44.812 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.812 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.812 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:44.812 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.765093+0000", 2023-09-30T17:03:44.812 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4259999999999996e-05 2023-09-30T17:03:44.813 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.813 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.813 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:44.813 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766238+0000", 2023-09-30T17:03:44.813 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0011442550000000001 2023-09-30T17:03:44.813 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.813 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.813 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:44.813 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993469+0000", 2023-09-30T17:03:44.813 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22723121800000001 2023-09-30T17:03:44.813 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.813 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.814 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:44.814 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993501+0000", 2023-09-30T17:03:44.814 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.2576000000000001e-05 2023-09-30T17:03:44.814 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.814 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.814 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:44.814 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993536+0000", 2023-09-30T17:03:44.814 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4699000000000001e-05 2023-09-30T17:03:44.814 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.814 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.814 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.815 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.815 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.815 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23881 4.36 4:6da220e6:::100000001f8.0000003f:head [write 3366912~4096,write 3694592~4096,write 4071424~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:44.815 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.766444+0000", 2023-09-30T17:03:44.815 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.9592637059999998, 2023-09-30T17:03:44.815 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23475070200000001, 2023-09-30T17:03:44.815 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.815 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:44.815 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.815 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.815 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.816 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23881 2023-09-30T17:03:44.816 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.816 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.816 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.816 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.816 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766444+0000", 2023-09-30T17:03:44.816 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.816 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.816 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.816 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.816 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766444+0000", 2023-09-30T17:03:44.816 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.817 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.817 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.817 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.817 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766444+0000", 2023-09-30T17:03:44.817 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3e-07 2023-09-30T17:03:44.817 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.817 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.817 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.817 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766455+0000", 2023-09-30T17:03:44.817 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0454e-05 2023-09-30T17:03:44.817 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.817 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.818 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.818 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766469+0000", 2023-09-30T17:03:44.818 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3568e-05 2023-09-30T17:03:44.818 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.818 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.818 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.818 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766474+0000", 2023-09-30T17:03:44.818 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1669999999999998e-06 2023-09-30T17:03:44.818 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.818 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.818 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:44.819 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766527+0000", 2023-09-30T17:03:44.819 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3650000000000003e-05 2023-09-30T17:03:44.819 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.819 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.819 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:44.819 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766611+0000", 2023-09-30T17:03:44.819 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3230000000000001e-05 2023-09-30T17:03:44.819 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.819 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.819 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:44.819 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766767+0000", 2023-09-30T17:03:44.819 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015688 2023-09-30T17:03:44.820 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.820 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.820 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:44.820 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.770254+0000", 2023-09-30T17:03:44.820 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0034870090000000001 2023-09-30T17:03:44.820 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.820 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.820 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:44.820 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.001100+0000", 2023-09-30T17:03:44.820 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23084518700000001 2023-09-30T17:03:44.820 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.820 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.821 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:44.821 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.001154+0000", 2023-09-30T17:03:44.821 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4453000000000002e-05 2023-09-30T17:03:44.821 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.821 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.821 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:44.821 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.001194+0000", 2023-09-30T17:03:44.821 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0373999999999997e-05 2023-09-30T17:03:44.821 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.821 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.821 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.821 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.822 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.822 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23901 4.6 4:63e80496:::100000001f8.0000001e:head [write 2617344~4096,write 2646016~4096,write 2662400~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:44.822 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.772204+0000", 2023-09-30T17:03:44.822 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.9535036889999997, 2023-09-30T17:03:44.822 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.228858799, 2023-09-30T17:03:44.822 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.822 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:44.822 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.822 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.822 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.822 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23901 2023-09-30T17:03:44.822 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.823 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.823 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.823 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.823 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772204+0000", 2023-09-30T17:03:44.823 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.823 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.823 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.823 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.823 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772204+0000", 2023-09-30T17:03:44.823 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.823 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.823 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.824 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.824 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772205+0000", 2023-09-30T17:03:44.824 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3600000000000002e-07 2023-09-30T17:03:44.824 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.824 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.824 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.824 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772217+0000", 2023-09-30T17:03:44.824 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2459999999999999e-05 2023-09-30T17:03:44.824 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.824 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.824 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.825 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772228+0000", 2023-09-30T17:03:44.825 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0614e-05 2023-09-30T17:03:44.825 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.825 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.825 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.825 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772236+0000", 2023-09-30T17:03:44.825 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7610000000000007e-06 2023-09-30T17:03:44.825 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.825 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.825 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:44.825 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772280+0000", 2023-09-30T17:03:44.825 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4360000000000002e-05 2023-09-30T17:03:44.825 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.826 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.826 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:44.826 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772328+0000", 2023-09-30T17:03:44.826 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8041000000000003e-05 2023-09-30T17:03:44.826 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.826 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.826 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:44.826 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772417+0000", 2023-09-30T17:03:44.826 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9226000000000003e-05 2023-09-30T17:03:44.826 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.826 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.827 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:44.827 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.774997+0000", 2023-09-30T17:03:44.827 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0025795039999999998 2023-09-30T17:03:44.827 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.827 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.827 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:44.827 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.000979+0000", 2023-09-30T17:03:44.827 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22598211700000001 2023-09-30T17:03:44.827 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.827 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.827 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:44.827 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.001025+0000", 2023-09-30T17:03:44.828 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6347999999999997e-05 2023-09-30T17:03:44.828 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.828 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.828 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:44.828 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.001063+0000", 2023-09-30T17:03:44.828 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7431999999999997e-05 2023-09-30T17:03:44.828 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.828 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.828 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.828 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.828 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.829 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23924 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 1196032~4096,write 1249280~4096,write 1294336~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:44.829 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.778807+0000", 2023-09-30T17:03:44.829 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.9469008299999997, 2023-09-30T17:03:44.829 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23068708600000001, 2023-09-30T17:03:44.829 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.829 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:44.829 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.829 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.829 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.829 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23924 2023-09-30T17:03:44.829 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.829 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.830 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.830 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.830 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778807+0000", 2023-09-30T17:03:44.830 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.830 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.830 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.830 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.830 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778807+0000", 2023-09-30T17:03:44.830 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.830 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.830 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.830 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.831 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778807+0000", 2023-09-30T17:03:44.831 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3600000000000003e-07 2023-09-30T17:03:44.831 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.831 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.831 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.831 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778832+0000", 2023-09-30T17:03:44.831 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4905999999999998e-05 2023-09-30T17:03:44.831 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.831 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.831 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.831 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778839+0000", 2023-09-30T17:03:44.832 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.097e-06 2023-09-30T17:03:44.832 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.832 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.832 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.832 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778843+0000", 2023-09-30T17:03:44.832 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8279999999999996e-06 2023-09-30T17:03:44.832 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.832 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.832 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:44.832 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778875+0000", 2023-09-30T17:03:44.832 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.1792000000000003e-05 2023-09-30T17:03:44.832 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.833 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.833 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:44.833 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778922+0000", 2023-09-30T17:03:44.833 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7034999999999999e-05 2023-09-30T17:03:44.833 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.833 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.833 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:44.833 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.779010+0000", 2023-09-30T17:03:44.833 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8305000000000002e-05 2023-09-30T17:03:44.833 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.833 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.834 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:44.834 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.781442+0000", 2023-09-30T17:03:44.834 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0024313550000000001 2023-09-30T17:03:44.834 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.834 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.834 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:44.834 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.009433+0000", 2023-09-30T17:03:44.834 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.227991044 2023-09-30T17:03:44.834 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.834 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.834 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:44.834 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.009471+0000", 2023-09-30T17:03:44.835 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8720999999999997e-05 2023-09-30T17:03:44.835 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.835 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.835 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:44.835 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.009494+0000", 2023-09-30T17:03:44.835 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2367000000000001e-05 2023-09-30T17:03:44.835 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.835 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.835 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.835 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.835 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.835 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23990 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 4157440~4096,write 4186112~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:44.836 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.798667+0000", 2023-09-30T17:03:44.836 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.9270403150000002, 2023-09-30T17:03:44.836 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23029929399999999, 2023-09-30T17:03:44.836 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.836 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:44.836 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.836 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.836 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.836 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23990 2023-09-30T17:03:44.836 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.836 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.837 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.837 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.837 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798667+0000", 2023-09-30T17:03:44.837 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.837 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.837 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.837 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.837 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798667+0000", 2023-09-30T17:03:44.837 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.837 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.837 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.837 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.838 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798668+0000", 2023-09-30T17:03:44.838 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7000000000000005e-07 2023-09-30T17:03:44.838 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.838 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.838 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.838 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798675+0000", 2023-09-30T17:03:44.838 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1269999999999997e-06 2023-09-30T17:03:44.838 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.838 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.838 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.838 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798681+0000", 2023-09-30T17:03:44.839 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3500000000000002e-06 2023-09-30T17:03:44.839 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.839 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.839 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.839 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798685+0000", 2023-09-30T17:03:44.839 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.63e-06 2023-09-30T17:03:44.839 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.839 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.839 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:44.839 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798726+0000", 2023-09-30T17:03:44.839 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.163e-05 2023-09-30T17:03:44.839 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.840 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.840 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:44.840 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798790+0000", 2023-09-30T17:03:44.840 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3781999999999993e-05 2023-09-30T17:03:44.840 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.840 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.840 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:44.840 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798933+0000", 2023-09-30T17:03:44.840 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014272199999999999 2023-09-30T17:03:44.840 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.840 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.841 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:44.841 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.802788+0000", 2023-09-30T17:03:44.841 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.003855509 2023-09-30T17:03:44.841 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.841 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.841 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:44.841 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.028891+0000", 2023-09-30T17:03:44.841 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.226102847 2023-09-30T17:03:44.841 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.841 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.841 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:44.841 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.028945+0000", 2023-09-30T17:03:44.842 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3600000000000002e-05 2023-09-30T17:03:44.842 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.842 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.842 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:44.842 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.028966+0000", 2023-09-30T17:03:44.842 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1526999999999999e-05 2023-09-30T17:03:44.842 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.842 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.842 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.842 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.842 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.843 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23991 4.6 4:63e80496:::100000001f8.0000001e:head [write 327680~4096,write 335872~4096,write 491520~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:44.843 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.798864+0000", 2023-09-30T17:03:44.843 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.9268437309999999, 2023-09-30T17:03:44.843 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23025762699999999, 2023-09-30T17:03:44.843 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.843 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:44.843 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.843 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.843 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.843 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23991 2023-09-30T17:03:44.843 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.844 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.844 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.844 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.844 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798864+0000", 2023-09-30T17:03:44.844 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.844 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.844 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.844 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.844 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798864+0000", 2023-09-30T17:03:44.844 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.844 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.844 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.845 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.845 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798864+0000", 2023-09-30T17:03:44.845 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3099999999999998e-07 2023-09-30T17:03:44.845 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.845 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.845 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.845 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798873+0000", 2023-09-30T17:03:44.846 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4789999999999996e-06 2023-09-30T17:03:44.846 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.846 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.846 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.846 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798878+0000", 2023-09-30T17:03:44.846 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6579999999999999e-06 2023-09-30T17:03:44.846 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.846 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.846 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.847 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798882+0000", 2023-09-30T17:03:44.847 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.985e-06 2023-09-30T17:03:44.847 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.847 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.847 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:44.847 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.799659+0000", 2023-09-30T17:03:44.847 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00077693900000000004 2023-09-30T17:03:44.847 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.847 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.847 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:44.847 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.799712+0000", 2023-09-30T17:03:44.848 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2694000000000001e-05 2023-09-30T17:03:44.848 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.848 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.848 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:44.848 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.799796+0000", 2023-09-30T17:03:44.848 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3943999999999995e-05 2023-09-30T17:03:44.848 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.848 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.848 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:44.848 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.802821+0000", 2023-09-30T17:03:44.848 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0030251850000000001 2023-09-30T17:03:44.848 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.849 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.849 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:44.849 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.029027+0000", 2023-09-30T17:03:44.849 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22620609999999999 2023-09-30T17:03:44.849 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.849 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.849 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:44.849 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.029083+0000", 2023-09-30T17:03:44.849 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5926e-05 2023-09-30T17:03:44.849 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.849 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.850 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:44.850 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.029121+0000", 2023-09-30T17:03:44.850 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8186000000000003e-05 2023-09-30T17:03:44.850 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.850 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.850 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.850 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.850 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.850 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:24052 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 3448832~4096,write 3493888~4096,write 3502080~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:44.850 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.817515+0000", 2023-09-30T17:03:44.850 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.9081924209999999, 2023-09-30T17:03:44.851 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23184106800000001, 2023-09-30T17:03:44.851 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.851 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:44.851 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.851 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.851 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.851 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 24052 2023-09-30T17:03:44.851 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.851 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.851 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.851 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.851 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.817515+0000", 2023-09-30T17:03:44.852 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.852 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.852 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.852 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.852 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.817515+0000", 2023-09-30T17:03:44.852 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.852 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.852 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.852 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.852 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.817516+0000", 2023-09-30T17:03:44.852 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9899999999999999e-07 2023-09-30T17:03:44.853 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.853 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.853 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.853 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.817531+0000", 2023-09-30T17:03:44.853 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5483000000000001e-05 2023-09-30T17:03:44.853 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.853 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.853 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.853 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.817545+0000", 2023-09-30T17:03:44.853 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3209e-05 2023-09-30T17:03:44.853 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.853 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.854 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.854 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.817553+0000", 2023-09-30T17:03:44.854 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.994e-06 2023-09-30T17:03:44.854 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.854 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.854 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:44.854 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.818753+0000", 2023-09-30T17:03:44.854 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0012000909999999999 2023-09-30T17:03:44.854 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.854 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.854 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:44.854 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.818838+0000", 2023-09-30T17:03:44.855 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5389999999999994e-05 2023-09-30T17:03:44.855 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.855 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.855 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:44.855 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.818996+0000", 2023-09-30T17:03:44.855 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000158116 2023-09-30T17:03:44.855 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.855 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.855 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:44.855 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.822334+0000", 2023-09-30T17:03:44.855 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0033373230000000001 2023-09-30T17:03:44.855 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.856 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.856 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:44.856 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049259+0000", 2023-09-30T17:03:44.856 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22692517400000001 2023-09-30T17:03:44.856 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.856 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.856 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:44.856 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049323+0000", 2023-09-30T17:03:44.856 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4348000000000001e-05 2023-09-30T17:03:44.856 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.856 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.856 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:44.857 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049356+0000", 2023-09-30T17:03:44.857 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3040999999999998e-05 2023-09-30T17:03:44.857 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.857 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.857 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.857 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.857 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.857 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:24058 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 172032~4096,write 200704~4096,write 249856~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:44.857 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.819363+0000", 2023-09-30T17:03:44.857 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.9063449449999998, 2023-09-30T17:03:44.857 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23030741099999999, 2023-09-30T17:03:44.858 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.858 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:44.858 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.858 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.858 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.858 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 24058 2023-09-30T17:03:44.858 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.858 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.858 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.858 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.858 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819363+0000", 2023-09-30T17:03:44.858 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.859 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.859 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.859 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.859 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819363+0000", 2023-09-30T17:03:44.859 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.859 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.859 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.859 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.859 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819363+0000", 2023-09-30T17:03:44.859 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8400000000000003e-07 2023-09-30T17:03:44.859 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.860 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.861 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.861 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819373+0000", 2023-09-30T17:03:44.861 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.9930000000000007e-06 2023-09-30T17:03:44.861 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.861 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.861 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.861 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819383+0000", 2023-09-30T17:03:44.862 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.4059999999999994e-06 2023-09-30T17:03:44.862 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.862 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.862 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.862 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819388+0000", 2023-09-30T17:03:44.862 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3299999999999998e-06 2023-09-30T17:03:44.862 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.862 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.862 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:44.862 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819584+0000", 2023-09-30T17:03:44.862 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00019642600000000001 2023-09-30T17:03:44.862 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.863 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.863 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:44.863 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819627+0000", 2023-09-30T17:03:44.863 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2150999999999997e-05 2023-09-30T17:03:44.863 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.863 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.863 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:44.863 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819712+0000", 2023-09-30T17:03:44.863 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5255999999999998e-05 2023-09-30T17:03:44.863 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.863 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.864 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:44.864 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.822340+0000", 2023-09-30T17:03:44.864 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0026283029999999998 2023-09-30T17:03:44.864 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.864 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.864 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:44.864 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049621+0000", 2023-09-30T17:03:44.864 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.227281176 2023-09-30T17:03:44.864 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.864 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.864 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:44.864 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049652+0000", 2023-09-30T17:03:44.865 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0528000000000003e-05 2023-09-30T17:03:44.865 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.865 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.865 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:44.865 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049670+0000", 2023-09-30T17:03:44.865 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8057999999999999e-05 2023-09-30T17:03:44.865 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.865 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.865 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.865 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.865 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.866 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:24064 4.6 4:616d4c41:::100000001f8.00000034:head [write 4132864~4096,write 4173824~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:44.866 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.820931+0000", 2023-09-30T17:03:44.866 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.9047765840000004, 2023-09-30T17:03:44.866 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22854920400000001, 2023-09-30T17:03:44.866 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:44.866 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:44.866 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:44.866 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:44.866 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:44.866 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 24064 2023-09-30T17:03:44.866 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.867 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:44.867 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.867 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:44.867 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.820931+0000", 2023-09-30T17:03:44.867 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.867 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.867 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.867 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:44.867 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.820931+0000", 2023-09-30T17:03:44.867 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:44.867 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.867 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.868 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:44.868 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.820932+0000", 2023-09-30T17:03:44.868 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4300000000000002e-07 2023-09-30T17:03:44.868 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.868 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.868 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:44.868 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.820941+0000", 2023-09-30T17:03:44.868 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.5650000000000007e-06 2023-09-30T17:03:44.868 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.868 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.868 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:44.868 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.820952+0000", 2023-09-30T17:03:44.869 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0566e-05 2023-09-30T17:03:44.869 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.869 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.869 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:44.869 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.820957+0000", 2023-09-30T17:03:44.869 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3800000000000002e-06 2023-09-30T17:03:44.869 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.869 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.869 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:44.869 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.821008+0000", 2023-09-30T17:03:44.869 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1070999999999999e-05 2023-09-30T17:03:44.869 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.870 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.870 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:44.870 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.821075+0000", 2023-09-30T17:03:44.870 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.648e-05 2023-09-30T17:03:44.870 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.870 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.870 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:44.870 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.821236+0000", 2023-09-30T17:03:44.870 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016120899999999999 2023-09-30T17:03:44.870 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.870 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.870 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:44.871 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.823356+0000", 2023-09-30T17:03:44.871 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.002120458 2023-09-30T17:03:44.871 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.871 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.871 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:44.871 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049389+0000", 2023-09-30T17:03:44.871 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22603278199999999 2023-09-30T17:03:44.871 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.871 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.871 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:44.871 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049443+0000", 2023-09-30T17:03:44.872 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4033000000000003e-05 2023-09-30T17:03:44.872 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:44.872 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:44.872 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:44.872 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049480+0000", 2023-09-30T17:03:44.872 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6816999999999997e-05 2023-09-30T17:03:44.872 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.872 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.872 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.872 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:44.872 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:44.872 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:44.874 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:03:44.874 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:44.874+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:44.974 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:44.973+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:44.983 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-09-30T17:03:45.060 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:45.060 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2023-09-30T17:03:45.060 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.061 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:41302 4.f 4:f2a80dfe:::100000001f8.00000019:head [write 802816~4096 in=4096b,write 835584~4096 in=4096b,write 860160~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-09-30T17:03:45.061 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:45.053522+0000", 2023-09-30T17:03:45.061 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0057624709999999999, 2023-09-30T17:03:45.061 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057911109999999998, 2023-09-30T17:03:45.061 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:45.061 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:45.061 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:45.061 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:45.061 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:45.061 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 41302 2023-09-30T17:03:45.062 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.062 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:45.062 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.062 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:45.062 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.053522+0000", 2023-09-30T17:03:45.062 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:45.062 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.062 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.062 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:45.062 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.053522+0000", 2023-09-30T17:03:45.063 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:45.063 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.063 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.063 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:45.063 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.053523+0000", 2023-09-30T17:03:45.063 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6300000000000004e-07 2023-09-30T17:03:45.063 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.063 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.063 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:45.063 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.053534+0000", 2023-09-30T17:03:45.063 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1048e-05 2023-09-30T17:03:45.064 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.064 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.064 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:45.064 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.053547+0000", 2023-09-30T17:03:45.064 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2833999999999999e-05 2023-09-30T17:03:45.064 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.064 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.064 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:45.064 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.053554+0000", 2023-09-30T17:03:45.064 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4420000000000001e-06 2023-09-30T17:03:45.065 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.065 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.065 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:45.065 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.053838+0000", 2023-09-30T17:03:45.065 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00028343299999999998 2023-09-30T17:03:45.065 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.065 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.065 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:45.065 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.053907+0000", 2023-09-30T17:03:45.065 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8700000000000003e-05 2023-09-30T17:03:45.065 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.066 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.066 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:45.066 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.054060+0000", 2023-09-30T17:03:45.066 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015338999999999999 2023-09-30T17:03:45.066 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.066 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.066 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:45.066 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.056560+0000", 2023-09-30T17:03:45.066 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0024997040000000002 2023-09-30T17:03:45.066 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:45.067 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:45.067 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:45.067 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.067 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.067 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:41301 4.19 e43/17 4:9a4319fb:::100000001f8.0000002a:head v 43'1267, mlcod=43'1265)", 2023-09-30T17:03:45.067 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:45.053644+0000", 2023-09-30T17:03:45.067 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0056412040000000004, 2023-09-30T17:03:45.067 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057684019999999997, 2023-09-30T17:03:45.067 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:45.067 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:45.068 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:45.068 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.068 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:45.068 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.053644+0000", 2023-09-30T17:03:45.068 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:45.068 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.068 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.068 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:45.068 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.053644+0000", 2023-09-30T17:03:45.068 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:45.068 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.069 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.069 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:45.069 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.053644+0000", 2023-09-30T17:03:45.069 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9999999999999998e-07 2023-09-30T17:03:45.069 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.069 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.069 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:45.069 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.053658+0000", 2023-09-30T17:03:45.069 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3512e-05 2023-09-30T17:03:45.069 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.070 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.070 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:45.070 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.053665+0000", 2023-09-30T17:03:45.070 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8569999999999995e-06 2023-09-30T17:03:45.070 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.070 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.070 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:45.070 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.053672+0000", 2023-09-30T17:03:45.070 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2770000000000002e-06 2023-09-30T17:03:45.070 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.070 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.071 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:45.071 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.053718+0000", 2023-09-30T17:03:45.071 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5850000000000003e-05 2023-09-30T17:03:45.071 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.071 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.071 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:45.071 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.053737+0000", 2023-09-30T17:03:45.071 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8958999999999999e-05 2023-09-30T17:03:45.071 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:45.071 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:45.072 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:45.072 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.072 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.072 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:41304 4.2c 4:35cbff5f:::100000001f8.00000033:head [write 81920~4096 in=4096b,write 90112~4096 in=4096b,write 557056~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-09-30T17:03:45.072 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:45.054435+0000", 2023-09-30T17:03:45.072 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0048499490000000001, 2023-09-30T17:03:45.072 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005051982, 2023-09-30T17:03:45.072 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:45.072 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:45.072 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:45.073 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:45.073 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:45.073 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 41304 2023-09-30T17:03:45.073 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.073 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:45.073 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.073 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:45.073 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.054435+0000", 2023-09-30T17:03:45.073 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:45.073 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.073 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.074 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:45.074 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.054435+0000", 2023-09-30T17:03:45.074 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:45.074 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.074 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.074 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:45.074 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.054436+0000", 2023-09-30T17:03:45.074 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6000000000000003e-07 2023-09-30T17:03:45.074 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.074 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.075 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:45.075 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.054447+0000", 2023-09-30T17:03:45.075 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1063000000000001e-05 2023-09-30T17:03:45.075 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.075 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.075 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:45.075 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.054456+0000", 2023-09-30T17:03:45.075 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3770000000000002e-06 2023-09-30T17:03:45.075 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.075 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.075 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:45.076 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.054463+0000", 2023-09-30T17:03:45.076 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1289999999999998e-06 2023-09-30T17:03:45.076 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.076 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.076 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:45.076 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.054523+0000", 2023-09-30T17:03:45.076 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9666000000000001e-05 2023-09-30T17:03:45.076 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.076 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.076 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:45.077 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.054610+0000", 2023-09-30T17:03:45.077 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6707999999999997e-05 2023-09-30T17:03:45.077 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.077 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.077 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:45.077 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.059391+0000", 2023-09-30T17:03:45.077 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004781062 2023-09-30T17:03:45.077 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.077 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.077 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:45.078 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.059450+0000", 2023-09-30T17:03:45.078 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9126000000000003e-05 2023-09-30T17:03:45.078 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:45.078 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:45.078 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:45.078 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.078 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.078 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:41305 4.2c 4:35cbff5f:::100000001f8.00000033:head [write 1155072~4096 in=4096b,write 1216512~4096 in=4096b,write 1290240~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-09-30T17:03:45.078 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:45.054736+0000", 2023-09-30T17:03:45.078 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0045484030000000003, 2023-09-30T17:03:45.078 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004877574, 2023-09-30T17:03:45.079 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:45.079 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:45.079 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:45.079 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:45.079 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:45.079 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 41305 2023-09-30T17:03:45.079 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.079 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:45.079 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.079 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:45.080 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.054736+0000", 2023-09-30T17:03:45.080 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:45.080 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.080 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.080 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:45.080 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.054736+0000", 2023-09-30T17:03:45.080 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:45.080 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.080 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.080 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:45.081 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.054737+0000", 2023-09-30T17:03:45.081 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6599999999999996e-07 2023-09-30T17:03:45.081 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.081 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.081 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:45.081 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.054745+0000", 2023-09-30T17:03:45.081 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2060000000000007e-06 2023-09-30T17:03:45.081 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.081 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.081 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:45.082 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.054751+0000", 2023-09-30T17:03:45.082 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4589999999999997e-06 2023-09-30T17:03:45.082 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.082 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.082 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:45.082 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.054755+0000", 2023-09-30T17:03:45.082 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5360000000000003e-06 2023-09-30T17:03:45.082 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.082 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.082 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:45.082 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.055875+0000", 2023-09-30T17:03:45.083 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0011194320000000001 2023-09-30T17:03:45.083 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.083 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.083 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:45.083 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.055975+0000", 2023-09-30T17:03:45.083 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100634 2023-09-30T17:03:45.083 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:45.083 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:45.083 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:45.083 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.084 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.084 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:41308 4.11 4:8be3ecac:::100000001f8.00000005:head [write 974848~4096 in=4096b,write 1257472~4096 in=4096b,write 1335296~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-09-30T17:03:45.084 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:45.055555+0000", 2023-09-30T17:03:45.084 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.003729273, 2023-09-30T17:03:45.084 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041421870000000003, 2023-09-30T17:03:45.084 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:45.084 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:45.084 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:45.084 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:45.084 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:45.085 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 41308 2023-09-30T17:03:45.085 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.085 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:45.085 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.085 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:45.085 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.055555+0000", 2023-09-30T17:03:45.085 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:45.085 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.085 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.085 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:45.085 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.055555+0000", 2023-09-30T17:03:45.086 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:45.086 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.086 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.086 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:45.086 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.055556+0000", 2023-09-30T17:03:45.086 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9299999999999998e-07 2023-09-30T17:03:45.086 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.086 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.086 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:45.086 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.055567+0000", 2023-09-30T17:03:45.086 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0613e-05 2023-09-30T17:03:45.087 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.087 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.087 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:45.087 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.055574+0000", 2023-09-30T17:03:45.087 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8960000000000003e-06 2023-09-30T17:03:45.087 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.087 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.087 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:45.087 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.055579+0000", 2023-09-30T17:03:45.087 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6369999999999998e-06 2023-09-30T17:03:45.087 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.088 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.088 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:45.088 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.055632+0000", 2023-09-30T17:03:45.088 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2711999999999999e-05 2023-09-30T17:03:45.088 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.088 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.088 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:45.088 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.055690+0000", 2023-09-30T17:03:45.088 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8362999999999997e-05 2023-09-30T17:03:45.088 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:45.088 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:45.088 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:45.089 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.089 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.089 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:41309 4.37 4:eff9002a:::100000001f8.00000003:head [write 1732608~4096 in=4096b,write 1798144~4096 in=4096b,write 1818624~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-09-30T17:03:45.089 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:45.055922+0000", 2023-09-30T17:03:45.089 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0033629739999999999, 2023-09-30T17:03:45.089 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038692750000000001, 2023-09-30T17:03:45.089 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:45.089 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:45.089 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:45.089 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:45.089 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:45.090 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 41309 2023-09-30T17:03:45.090 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.090 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:45.090 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.090 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:45.090 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.055922+0000", 2023-09-30T17:03:45.090 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:45.090 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.090 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.090 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:45.090 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.055922+0000", 2023-09-30T17:03:45.090 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:45.091 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.091 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.091 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:45.091 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.055922+0000", 2023-09-30T17:03:45.091 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7700000000000004e-07 2023-09-30T17:03:45.091 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.091 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.091 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:45.091 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.055935+0000", 2023-09-30T17:03:45.091 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2670999999999999e-05 2023-09-30T17:03:45.091 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.092 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.092 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:45.092 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.055944+0000", 2023-09-30T17:03:45.092 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6119999999999999e-06 2023-09-30T17:03:45.092 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.092 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.092 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:45.092 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.055951+0000", 2023-09-30T17:03:45.092 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0559999999999999e-06 2023-09-30T17:03:45.092 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.092 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.093 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:45.093 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.056001+0000", 2023-09-30T17:03:45.093 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9960999999999998e-05 2023-09-30T17:03:45.093 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.093 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.093 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:45.093 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.056083+0000", 2023-09-30T17:03:45.093 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1856999999999999e-05 2023-09-30T17:03:45.093 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.093 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.093 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:45.093 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.056277+0000", 2023-09-30T17:03:45.094 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019438600000000001 2023-09-30T17:03:45.094 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.094 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.094 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:45.094 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.058731+0000", 2023-09-30T17:03:45.094 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0024542040000000002 2023-09-30T17:03:45.094 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:45.094 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:45.094 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:45.094 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.095 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.095 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:41313 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 24576~4096 in=4096b,write 172032~4096 in=4096b,write 217088~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-09-30T17:03:45.095 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:45.057075+0000", 2023-09-30T17:03:45.095 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0022094290000000002, 2023-09-30T17:03:45.095 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0028001459999999999, 2023-09-30T17:03:45.095 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:45.095 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:45.095 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:45.095 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:45.095 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:45.095 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 41313 2023-09-30T17:03:45.095 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.096 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:45.096 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.096 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:45.096 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.057075+0000", 2023-09-30T17:03:45.096 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:45.096 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.096 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.096 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:45.096 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.057075+0000", 2023-09-30T17:03:45.096 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:45.096 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.097 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.097 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:45.097 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.057076+0000", 2023-09-30T17:03:45.097 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7599999999999996e-07 2023-09-30T17:03:45.097 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.097 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.097 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:45.097 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.057088+0000", 2023-09-30T17:03:45.097 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.167e-05 2023-09-30T17:03:45.097 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.097 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.097 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:45.098 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.057102+0000", 2023-09-30T17:03:45.098 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4419999999999999e-05 2023-09-30T17:03:45.098 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.098 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.098 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:45.098 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.057110+0000", 2023-09-30T17:03:45.098 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2050000000000002e-06 2023-09-30T17:03:45.098 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.098 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.098 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:45.098 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.057164+0000", 2023-09-30T17:03:45.098 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3863999999999998e-05 2023-09-30T17:03:45.099 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.099 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.099 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:45.099 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.057228+0000", 2023-09-30T17:03:45.099 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3199000000000003e-05 2023-09-30T17:03:45.099 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:45.099 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:45.099 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:45.099 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.099 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.099 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:41314 4.2d 4:b4aa06e9:::100000001f8.0000001d:head [write 3239936~4096 in=4096b,write 3301376~4096 in=4096b,write 3317760~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-09-30T17:03:45.100 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:45.057332+0000", 2023-09-30T17:03:45.100 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0019532270000000001, 2023-09-30T17:03:45.100 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002613902, 2023-09-30T17:03:45.100 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:45.100 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:45.100 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:45.100 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:45.100 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:45.100 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 41314 2023-09-30T17:03:45.100 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.100 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:45.100 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.101 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:45.101 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.057332+0000", 2023-09-30T17:03:45.101 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:45.101 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.101 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.101 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:45.101 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.057332+0000", 2023-09-30T17:03:45.101 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:45.101 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.101 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.101 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:45.102 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.057332+0000", 2023-09-30T17:03:45.102 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7000000000000004e-07 2023-09-30T17:03:45.102 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.102 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.102 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:45.102 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.057345+0000", 2023-09-30T17:03:45.102 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2614e-05 2023-09-30T17:03:45.102 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.102 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.102 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:45.102 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.057353+0000", 2023-09-30T17:03:45.103 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7870000000000002e-06 2023-09-30T17:03:45.103 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.103 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.103 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:45.103 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.057359+0000", 2023-09-30T17:03:45.103 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4749999999999998e-06 2023-09-30T17:03:45.103 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.103 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.103 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:45.103 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.057421+0000", 2023-09-30T17:03:45.103 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2187999999999995e-05 2023-09-30T17:03:45.104 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.104 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.104 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:45.104 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.057508+0000", 2023-09-30T17:03:45.104 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6513000000000003e-05 2023-09-30T17:03:45.104 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.104 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.104 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:45.104 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.057666+0000", 2023-09-30T17:03:45.104 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015800800000000001 2023-09-30T17:03:45.104 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:45.104 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:45.105 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:45.105 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.105 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.105 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:41315 4.2e e43/17 4:75be0f36:::100000001f8.0000003d:head v 43'645, mlcod=43'643)", 2023-09-30T17:03:45.105 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:45.057901+0000", 2023-09-30T17:03:45.105 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0013841319999999999, 2023-09-30T17:03:45.105 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0021322939999999999, 2023-09-30T17:03:45.105 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:45.105 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:45.105 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:45.105 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.105 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:45.106 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.057901+0000", 2023-09-30T17:03:45.106 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:45.106 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.106 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.106 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:45.106 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.057901+0000", 2023-09-30T17:03:45.106 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:45.106 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.106 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.106 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:45.106 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.057901+0000", 2023-09-30T17:03:45.107 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5899999999999996e-07 2023-09-30T17:03:45.107 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.107 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.107 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:45.107 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.057929+0000", 2023-09-30T17:03:45.107 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7421000000000001e-05 2023-09-30T17:03:45.107 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.107 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.107 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:45.107 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.057939+0000", 2023-09-30T17:03:45.107 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0689e-05 2023-09-30T17:03:45.108 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.108 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.108 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:45.108 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.057946+0000", 2023-09-30T17:03:45.108 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7429999999999996e-06 2023-09-30T17:03:45.108 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.108 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.108 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:45.108 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.057993+0000", 2023-09-30T17:03:45.108 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7144000000000001e-05 2023-09-30T17:03:45.108 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.109 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.109 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:45.109 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.058005+0000", 2023-09-30T17:03:45.109 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2167000000000001e-05 2023-09-30T17:03:45.109 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:45.109 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:45.109 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:45.109 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.109 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.109 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:41318 4.2d 4:b4aa06e9:::100000001f8.0000001d:head [write 135168~4096 in=4096b,write 200704~4096 in=4096b,write 483328~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-09-30T17:03:45.109 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:45.058729+0000", 2023-09-30T17:03:45.109 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.00055605800000000001, 2023-09-30T17:03:45.110 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0013738929999999999, 2023-09-30T17:03:45.110 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:45.110 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:45.110 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:45.110 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:45.110 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:45.110 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 41318 2023-09-30T17:03:45.110 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.110 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:45.110 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.111 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:45.111 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.058729+0000", 2023-09-30T17:03:45.111 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:45.111 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.111 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.111 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:45.111 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.058729+0000", 2023-09-30T17:03:45.111 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:45.111 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.111 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.111 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:45.111 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.058729+0000", 2023-09-30T17:03:45.112 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7599999999999997e-07 2023-09-30T17:03:45.112 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.112 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.112 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:45.112 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.058743+0000", 2023-09-30T17:03:45.112 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3543999999999999e-05 2023-09-30T17:03:45.112 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.112 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.112 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:45.112 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.058749+0000", 2023-09-30T17:03:45.113 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5459999999999997e-06 2023-09-30T17:03:45.113 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.113 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.113 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:45.113 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.058754+0000", 2023-09-30T17:03:45.113 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4519999999999999e-06 2023-09-30T17:03:45.113 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.113 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.113 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:45.113 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.058835+0000", 2023-09-30T17:03:45.113 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0848999999999998e-05 2023-09-30T17:03:45.114 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.114 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.114 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:45.114 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.058887+0000", 2023-09-30T17:03:45.114 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1875000000000001e-05 2023-09-30T17:03:45.114 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.114 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.114 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:45.114 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.058986+0000", 2023-09-30T17:03:45.114 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9047000000000002e-05 2023-09-30T17:03:45.114 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:45.115 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:45.115 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:45.115 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.115 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.115 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:41319 4.38 4:1dcf718c:::100000001f8.00000022:head [write 3063808~4096 in=4096b,write 3084288~4096 in=4096b,write 3117056~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e43)", 2023-09-30T17:03:45.115 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:45.059153+0000", 2023-09-30T17:03:45.115 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.000131882, 2023-09-30T17:03:45.115 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0010347220000000001, 2023-09-30T17:03:45.115 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:45.115 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:45.115 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:45.115 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:45.116 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:45.116 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 41319 2023-09-30T17:03:45.116 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.116 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:45.116 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.116 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:45.116 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.059153+0000", 2023-09-30T17:03:45.116 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:45.116 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.116 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.116 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:45.117 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.059153+0000", 2023-09-30T17:03:45.117 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:45.117 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.117 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.117 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:45.117 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.059154+0000", 2023-09-30T17:03:45.117 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4000000000000001e-07 2023-09-30T17:03:45.117 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.117 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.117 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:45.117 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.059163+0000", 2023-09-30T17:03:45.117 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6309999999999998e-06 2023-09-30T17:03:45.118 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.118 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.118 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:45.118 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.059174+0000", 2023-09-30T17:03:45.118 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0542e-05 2023-09-30T17:03:45.118 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.118 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.118 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:45.118 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.059182+0000", 2023-09-30T17:03:45.118 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0520000000000002e-06 2023-09-30T17:03:45.118 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.119 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.119 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:45.119 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.059231+0000", 2023-09-30T17:03:45.119 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9737999999999997e-05 2023-09-30T17:03:45.119 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:45.119 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:45.119 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:45.119 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:45.059312+0000", 2023-09-30T17:03:45.119 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0479e-05 2023-09-30T17:03:45.119 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:45.119 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:45.119 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:45.120 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:45.120 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2023-09-30T17:03:45.120 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 11 2023-09-30T17:03:45.120 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:45.121 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:03:45.122 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:45.120+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:45.159 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:03:45.184 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:03:45.185 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-09-30T17:03:45.185 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-09-30T17:03:45.185 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:03:45.188 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:03:45.188 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:03:45.221 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:45.221+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:45.323 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:45.322+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:45.345 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:45.345 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:45.360 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:03:45.444 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:45.443+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:45.525 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:45.524+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:45.583 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:45.583 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:45.596 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:03:45.641 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:45.641+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:45.727 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:45.726+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:45.794 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:45.795 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:45.809 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:03:45.827 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:45.826+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:45.928 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:45.927+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:46.029 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:46.028+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:46.043 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:46.043 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:46.058 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:03:46.129 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:46.130+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:46.231 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:46.230+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:46.239 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~59s 2023-09-30T17:03:46.262 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:46.262 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:46.279 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:03:46.330 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:46.329+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:46.431 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:46.430+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:46.446 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-09-30T17:03:46.461 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:46.461 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:46.475 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:03:46.532 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:46.532+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:46.632 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:46.632+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:46.695 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:46.695 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:46.709 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:03:46.733 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:46.734+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:46.834 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:46.833+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:46.934 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:46.934 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:46.935 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:46.934+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:46.951 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:03:47.036 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:47.036+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:47.137 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:47.136+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:47.153 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:47.153 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:47.164 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:03:47.189 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-09-30T17:03:47.237 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:47.237+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:47.276 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is unset 2023-09-30T17:03:47.338 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:47.339+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:47.371 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:03:47.388 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:47.389 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:03:47.389 INFO:teuthology.orchestra.run.smithi031.stdout: "complaint_time": 30, 2023-09-30T17:03:47.389 INFO:teuthology.orchestra.run.smithi031.stdout: "num_blocked_ops": 0 2023-09-30T17:03:47.389 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:47.395 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:03:47.396 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-09-30T17:03:47.396 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-09-30T17:03:47.396 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:03:47.399 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:03:47.399 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:03:47.403 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:03:47.445 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:47.445+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:47.541 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:47.542+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:47.641 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:47.641 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 20, 2023-09-30T17:03:47.641 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 600, 2023-09-30T17:03:47.641 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:03:47.642 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.642 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23704 4.14 4:2b28d75f:::100000001f8.00000016:head [write 262144~4096,write 274432~4096,write 405504~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:47.642 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.711008+0000", 2023-09-30T17:03:47.642 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 8.9270452779999996, 2023-09-30T17:03:47.642 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.229109541, 2023-09-30T17:03:47.642 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:47.642 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:47.642 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:47.642 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:47.642 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:47.642 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23704 2023-09-30T17:03:47.642 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.643 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:47.643 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.643 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:47.643 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711008+0000", 2023-09-30T17:03:47.643 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:47.643 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.643 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.643 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:47.643 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711008+0000", 2023-09-30T17:03:47.643 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:47.643 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.643 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.644 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:47.644 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711009+0000", 2023-09-30T17:03:47.644 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5899999999999995e-07 2023-09-30T17:03:47.644 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.644 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.644 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:47.644 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711042+0000", 2023-09-30T17:03:47.644 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3149999999999999e-05 2023-09-30T17:03:47.644 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.644 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.644 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:47.644 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711054+0000", 2023-09-30T17:03:47.645 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1742999999999999e-05 2023-09-30T17:03:47.645 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.645 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.645 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:47.645 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711059+0000", 2023-09-30T17:03:47.645 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3009999999999997e-06 2023-09-30T17:03:47.645 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.645 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.645 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:47.645 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711120+0000", 2023-09-30T17:03:47.645 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1228000000000004e-05 2023-09-30T17:03:47.645 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.646 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.646 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:47.646 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711205+0000", 2023-09-30T17:03:47.646 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4489999999999999e-05 2023-09-30T17:03:47.646 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.646 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.646 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:47.646 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711371+0000", 2023-09-30T17:03:47.646 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016639500000000001 2023-09-30T17:03:47.646 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.646 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.647 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:47.647 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.716551+0000", 2023-09-30T17:03:47.647 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051799929999999999 2023-09-30T17:03:47.647 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.647 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.647 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:47.647 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.940040+0000", 2023-09-30T17:03:47.647 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22348859800000001 2023-09-30T17:03:47.647 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.647 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.647 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:47.648 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.940080+0000", 2023-09-30T17:03:47.648 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0114999999999998e-05 2023-09-30T17:03:47.648 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.648 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.648 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:47.648 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.940118+0000", 2023-09-30T17:03:47.648 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7768999999999997e-05 2023-09-30T17:03:47.648 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:47.648 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:47.648 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:47.648 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.648 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.649 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23713 4.33 4:cf6d7a6c:::100000001f8.0000000a:head [write 585728~4096,write 925696~4096,write 937984~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:47.649 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.714948+0000", 2023-09-30T17:03:47.649 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 8.9231055640000001, 2023-09-30T17:03:47.649 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23061467099999999, 2023-09-30T17:03:47.649 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:47.649 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:47.649 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:47.649 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:47.649 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:47.649 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23713 2023-09-30T17:03:47.649 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.650 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:47.650 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.650 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:47.650 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.714948+0000", 2023-09-30T17:03:47.650 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:47.650 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.650 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.650 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:47.650 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.714948+0000", 2023-09-30T17:03:47.650 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:47.650 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.650 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.651 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:47.651 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.714949+0000", 2023-09-30T17:03:47.651 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1399999999999995e-07 2023-09-30T17:03:47.651 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.651 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.651 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:47.651 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.714961+0000", 2023-09-30T17:03:47.651 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1916000000000001e-05 2023-09-30T17:03:47.651 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.651 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.651 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:47.652 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.714979+0000", 2023-09-30T17:03:47.652 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8070000000000001e-05 2023-09-30T17:03:47.652 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.652 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.652 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:47.652 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.714987+0000", 2023-09-30T17:03:47.652 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4179999999999997e-06 2023-09-30T17:03:47.652 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.652 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.652 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:47.652 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.715034+0000", 2023-09-30T17:03:47.652 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6563999999999997e-05 2023-09-30T17:03:47.652 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.653 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.653 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:47.653 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.715083+0000", 2023-09-30T17:03:47.653 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9310000000000001e-05 2023-09-30T17:03:47.653 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.653 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.653 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:47.653 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.715177+0000", 2023-09-30T17:03:47.653 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3525999999999999e-05 2023-09-30T17:03:47.653 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.653 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.654 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:47.654 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.719724+0000", 2023-09-30T17:03:47.654 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0045477210000000002 2023-09-30T17:03:47.654 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.654 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.654 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:47.654 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.945467+0000", 2023-09-30T17:03:47.654 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22574224500000001 2023-09-30T17:03:47.654 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.654 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.655 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:47.655 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.945524+0000", 2023-09-30T17:03:47.655 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7105999999999998e-05 2023-09-30T17:03:47.655 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.655 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.655 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:47.655 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.945563+0000", 2023-09-30T17:03:47.655 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8881000000000003e-05 2023-09-30T17:03:47.655 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:47.655 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:47.656 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:47.656 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.656 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.656 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23735 4.6 4:616d4c41:::100000001f8.00000034:head [write 991232~4096,write 1040384~4096,write 1200128~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:47.656 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.722398+0000", 2023-09-30T17:03:47.656 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 8.9156552090000005, 2023-09-30T17:03:47.656 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.230202669, 2023-09-30T17:03:47.656 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:47.656 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:47.656 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:47.657 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:47.657 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:47.657 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23735 2023-09-30T17:03:47.657 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.657 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:47.657 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.657 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:47.657 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722398+0000", 2023-09-30T17:03:47.657 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:47.657 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.658 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.658 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:47.658 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722398+0000", 2023-09-30T17:03:47.658 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:47.658 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.658 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.658 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:47.658 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722399+0000", 2023-09-30T17:03:47.658 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2799999999999996e-07 2023-09-30T17:03:47.658 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.658 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.659 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:47.659 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722423+0000", 2023-09-30T17:03:47.659 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4134e-05 2023-09-30T17:03:47.659 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.659 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.659 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:47.659 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722429+0000", 2023-09-30T17:03:47.659 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4590000000000003e-06 2023-09-30T17:03:47.659 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.659 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.659 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:47.660 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722434+0000", 2023-09-30T17:03:47.660 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1779999999999996e-06 2023-09-30T17:03:47.660 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.660 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.660 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:47.660 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722490+0000", 2023-09-30T17:03:47.661 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6215999999999998e-05 2023-09-30T17:03:47.661 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.661 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.661 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:47.661 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722600+0000", 2023-09-30T17:03:47.661 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00011017 2023-09-30T17:03:47.661 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.661 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.661 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:47.661 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722769+0000", 2023-09-30T17:03:47.662 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0001695 2023-09-30T17:03:47.662 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.662 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.662 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:47.662 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725807+0000", 2023-09-30T17:03:47.662 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0030372120000000001 2023-09-30T17:03:47.662 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.662 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.662 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:47.662 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.952546+0000", 2023-09-30T17:03:47.662 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22673923600000001 2023-09-30T17:03:47.663 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.663 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.663 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:47.663 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.952579+0000", 2023-09-30T17:03:47.663 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3111000000000002e-05 2023-09-30T17:03:47.663 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.663 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.663 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:47.663 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.952601+0000", 2023-09-30T17:03:47.663 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1925000000000001e-05 2023-09-30T17:03:47.663 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:47.664 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:47.664 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:47.664 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.664 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.664 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23738 4.6 4:616d4c41:::100000001f8.00000034:head [write 3043328~4096,write 3055616~4096,write 3080192~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:47.664 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.723439+0000", 2023-09-30T17:03:47.664 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 8.9146142360000002, 2023-09-30T17:03:47.664 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23665340400000001, 2023-09-30T17:03:47.664 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:47.664 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:47.664 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:47.664 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:47.665 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:47.665 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23738 2023-09-30T17:03:47.665 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.665 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:47.665 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.665 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:47.665 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723439+0000", 2023-09-30T17:03:47.665 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:47.665 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.665 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.665 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:47.666 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723439+0000", 2023-09-30T17:03:47.666 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:47.666 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.666 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.666 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:47.666 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723440+0000", 2023-09-30T17:03:47.666 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.23e-07 2023-09-30T17:03:47.666 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.666 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.666 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:47.666 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723452+0000", 2023-09-30T17:03:47.667 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2147000000000001e-05 2023-09-30T17:03:47.667 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.667 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.667 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:47.667 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723461+0000", 2023-09-30T17:03:47.667 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3839999999999997e-06 2023-09-30T17:03:47.667 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.667 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.667 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:47.667 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723465+0000", 2023-09-30T17:03:47.667 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7559999999999999e-06 2023-09-30T17:03:47.667 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.667 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.668 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:47.668 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723924+0000", 2023-09-30T17:03:47.668 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00045910299999999999 2023-09-30T17:03:47.668 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.668 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.668 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:47.668 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723970+0000", 2023-09-30T17:03:47.668 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5126999999999997e-05 2023-09-30T17:03:47.668 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.668 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.668 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:47.668 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724057+0000", 2023-09-30T17:03:47.669 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.7142e-05 2023-09-30T17:03:47.669 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.669 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.669 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:47.669 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.726148+0000", 2023-09-30T17:03:47.669 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.002091449 2023-09-30T17:03:47.669 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.669 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.669 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:47.669 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.960040+0000", 2023-09-30T17:03:47.669 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23389163299999999 2023-09-30T17:03:47.669 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.670 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.670 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:47.670 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.960071+0000", 2023-09-30T17:03:47.670 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.133e-05 2023-09-30T17:03:47.670 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.670 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.670 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:47.670 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.960093+0000", 2023-09-30T17:03:47.670 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1509999999999999e-05 2023-09-30T17:03:47.670 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:47.670 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:47.670 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:47.671 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.671 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.671 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23740 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 3780608~4096,write 3788800~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:47.671 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.723994+0000", 2023-09-30T17:03:47.671 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 8.9140594600000007, 2023-09-30T17:03:47.671 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.234031238, 2023-09-30T17:03:47.671 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:47.671 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:47.671 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:47.671 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:47.671 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:47.671 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23740 2023-09-30T17:03:47.672 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.672 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:47.672 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.672 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:47.672 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723994+0000", 2023-09-30T17:03:47.672 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:47.672 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.672 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.672 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:47.672 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723994+0000", 2023-09-30T17:03:47.672 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:47.672 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.672 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.673 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:47.673 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723995+0000", 2023-09-30T17:03:47.673 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6000000000000003e-07 2023-09-30T17:03:47.673 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.673 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.673 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:47.673 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724004+0000", 2023-09-30T17:03:47.673 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.4909999999999994e-06 2023-09-30T17:03:47.673 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.673 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.673 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:47.673 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724012+0000", 2023-09-30T17:03:47.674 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4590000000000001e-06 2023-09-30T17:03:47.674 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.674 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.674 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:47.674 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724016+0000", 2023-09-30T17:03:47.674 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9890000000000003e-06 2023-09-30T17:03:47.674 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.674 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.674 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:47.674 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724060+0000", 2023-09-30T17:03:47.674 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4339999999999999e-05 2023-09-30T17:03:47.674 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.675 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.675 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:47.675 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724141+0000", 2023-09-30T17:03:47.675 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1384000000000005e-05 2023-09-30T17:03:47.675 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.675 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.675 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:47.675 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724300+0000", 2023-09-30T17:03:47.675 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015870700000000001 2023-09-30T17:03:47.675 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.675 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.676 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:47.676 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.726182+0000", 2023-09-30T17:03:47.676 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0018816060000000001 2023-09-30T17:03:47.676 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.676 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.677 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:47.677 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.957929+0000", 2023-09-30T17:03:47.677 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23174703399999999 2023-09-30T17:03:47.678 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.678 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.678 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:47.678 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.957983+0000", 2023-09-30T17:03:47.678 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4107999999999998e-05 2023-09-30T17:03:47.678 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.678 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.678 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:47.678 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.958025+0000", 2023-09-30T17:03:47.678 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2360000000000001e-05 2023-09-30T17:03:47.678 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:47.678 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:47.679 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:47.679 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.679 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.679 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23746 4.28 4:15eeb89b:::100000001f8.00000032:head [write 3731456~4096,write 3919872~4096,write 3952640~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:47.679 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.725721+0000", 2023-09-30T17:03:47.679 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 8.9123320760000002, 2023-09-30T17:03:47.679 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.24024479800000001, 2023-09-30T17:03:47.679 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:47.679 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:47.679 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:47.679 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:47.680 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:47.680 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23746 2023-09-30T17:03:47.680 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.680 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:47.680 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.680 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:47.680 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725721+0000", 2023-09-30T17:03:47.680 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:47.680 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.680 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.680 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:47.680 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725721+0000", 2023-09-30T17:03:47.681 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:47.681 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.681 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.681 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:47.681 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725722+0000", 2023-09-30T17:03:47.681 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6499999999999999e-07 2023-09-30T17:03:47.681 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.681 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.681 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:47.681 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725732+0000", 2023-09-30T17:03:47.681 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7559999999999994e-06 2023-09-30T17:03:47.681 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.682 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.682 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:47.682 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725738+0000", 2023-09-30T17:03:47.682 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8360000000000003e-06 2023-09-30T17:03:47.682 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.682 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.682 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:47.682 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725746+0000", 2023-09-30T17:03:47.682 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4200000000000001e-06 2023-09-30T17:03:47.682 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.682 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.682 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:47.683 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725805+0000", 2023-09-30T17:03:47.683 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9318999999999999e-05 2023-09-30T17:03:47.683 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.683 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.683 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:47.683 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725904+0000", 2023-09-30T17:03:47.683 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8747999999999997e-05 2023-09-30T17:03:47.683 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.683 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.683 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:47.683 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.726075+0000", 2023-09-30T17:03:47.683 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017153700000000001 2023-09-30T17:03:47.684 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.684 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.684 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:47.684 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.727419+0000", 2023-09-30T17:03:47.684 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001343571 2023-09-30T17:03:47.684 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.684 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.684 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:47.684 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.965839+0000", 2023-09-30T17:03:47.684 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.238420467 2023-09-30T17:03:47.684 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.685 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.685 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:47.685 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.965922+0000", 2023-09-30T17:03:47.685 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2905000000000007e-05 2023-09-30T17:03:47.685 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.685 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.685 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:47.685 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.965966+0000", 2023-09-30T17:03:47.685 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3773999999999998e-05 2023-09-30T17:03:47.685 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:47.685 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:47.685 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:47.685 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.686 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.686 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23757 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 2117632~8192,write 2228224~4096,write 2453504~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:47.686 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.728711+0000", 2023-09-30T17:03:47.686 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 8.9093425009999994, 2023-09-30T17:03:47.686 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23330704499999999, 2023-09-30T17:03:47.686 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:47.686 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:47.686 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:47.686 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:47.686 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:47.686 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23757 2023-09-30T17:03:47.687 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.687 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:47.687 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.687 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:47.687 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728711+0000", 2023-09-30T17:03:47.687 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:47.687 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.687 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.687 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:47.687 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728711+0000", 2023-09-30T17:03:47.687 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:47.687 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.688 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.688 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:47.688 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728712+0000", 2023-09-30T17:03:47.688 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4199999999999995e-07 2023-09-30T17:03:47.688 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.688 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.688 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:47.688 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728738+0000", 2023-09-30T17:03:47.688 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.6761e-05 2023-09-30T17:03:47.688 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.688 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.688 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:47.689 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728745+0000", 2023-09-30T17:03:47.689 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9940000000000003e-06 2023-09-30T17:03:47.689 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.689 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.689 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:47.689 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728749+0000", 2023-09-30T17:03:47.689 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.053e-06 2023-09-30T17:03:47.689 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.689 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.689 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:47.689 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728802+0000", 2023-09-30T17:03:47.689 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2918999999999999e-05 2023-09-30T17:03:47.690 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.690 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.690 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:47.690 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728923+0000", 2023-09-30T17:03:47.690 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00012084200000000001 2023-09-30T17:03:47.690 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.690 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.690 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:47.690 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.729101+0000", 2023-09-30T17:03:47.690 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000178226 2023-09-30T17:03:47.690 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.691 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.691 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:47.691 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732207+0000", 2023-09-30T17:03:47.691 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0031059849999999999 2023-09-30T17:03:47.691 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.691 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.691 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:47.691 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.961949+0000", 2023-09-30T17:03:47.691 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.229741842 2023-09-30T17:03:47.691 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.691 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.691 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:47.692 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.961986+0000", 2023-09-30T17:03:47.692 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7147000000000002e-05 2023-09-30T17:03:47.692 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.692 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.692 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:47.692 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.962018+0000", 2023-09-30T17:03:47.692 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.1634000000000002e-05 2023-09-30T17:03:47.692 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:47.692 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:47.692 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:47.692 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.692 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.692 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23768 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 1257472~4096,write 1384448~4096,write 1474560~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:47.693 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.732216+0000", 2023-09-30T17:03:47.693 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 8.9058378689999991, 2023-09-30T17:03:47.693 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22951861000000001, 2023-09-30T17:03:47.693 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:47.693 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:47.693 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:47.693 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:47.693 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:47.693 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23768 2023-09-30T17:03:47.693 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.693 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:47.693 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.694 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:47.694 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732216+0000", 2023-09-30T17:03:47.694 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:47.694 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.694 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.694 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:47.694 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732216+0000", 2023-09-30T17:03:47.694 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:47.694 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.694 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.694 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:47.695 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732216+0000", 2023-09-30T17:03:47.695 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.71e-07 2023-09-30T17:03:47.695 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.695 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.695 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:47.695 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732231+0000", 2023-09-30T17:03:47.695 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5007e-05 2023-09-30T17:03:47.695 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.695 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.695 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:47.695 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732239+0000", 2023-09-30T17:03:47.695 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8509999999999999e-06 2023-09-30T17:03:47.696 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.696 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.696 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:47.696 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732244+0000", 2023-09-30T17:03:47.696 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2000000000000002e-06 2023-09-30T17:03:47.696 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.696 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.696 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:47.696 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732285+0000", 2023-09-30T17:03:47.696 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0877000000000002e-05 2023-09-30T17:03:47.696 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.696 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.697 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:47.697 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732331+0000", 2023-09-30T17:03:47.697 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5906999999999999e-05 2023-09-30T17:03:47.697 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.697 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.697 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:47.697 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732421+0000", 2023-09-30T17:03:47.697 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9993000000000004e-05 2023-09-30T17:03:47.697 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.697 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.697 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:47.698 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.737687+0000", 2023-09-30T17:03:47.698 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005265792 2023-09-30T17:03:47.698 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.698 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.698 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:47.698 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.961667+0000", 2023-09-30T17:03:47.698 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22398030799999999 2023-09-30T17:03:47.698 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.698 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.698 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:47.699 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.961703+0000", 2023-09-30T17:03:47.699 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5221e-05 2023-09-30T17:03:47.699 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.699 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.699 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:47.699 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.961734+0000", 2023-09-30T17:03:47.699 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.1582999999999999e-05 2023-09-30T17:03:47.699 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:47.699 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:47.699 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:47.699 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.700 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.700 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23780 4.36 4:6fa85f86:::100000001f8.00000013:head [write 3469312~4096,write 3522560~4096,write 3579904~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:47.700 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.735686+0000", 2023-09-30T17:03:47.700 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 8.9023676379999994, 2023-09-30T17:03:47.700 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22921459399999999, 2023-09-30T17:03:47.700 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:47.700 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:47.700 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:47.700 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:47.700 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:47.700 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23780 2023-09-30T17:03:47.701 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.701 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:47.701 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.701 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:47.701 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.735686+0000", 2023-09-30T17:03:47.701 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:47.701 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.701 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.701 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:47.701 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.735686+0000", 2023-09-30T17:03:47.701 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:47.701 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.701 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.702 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:47.702 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.735687+0000", 2023-09-30T17:03:47.702 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3399999999999998e-07 2023-09-30T17:03:47.702 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.702 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.702 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:47.702 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.735701+0000", 2023-09-30T17:03:47.702 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4324999999999999e-05 2023-09-30T17:03:47.702 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.702 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.702 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:47.703 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.735713+0000", 2023-09-30T17:03:47.703 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1678999999999999e-05 2023-09-30T17:03:47.703 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.703 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.703 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:47.703 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.735720+0000", 2023-09-30T17:03:47.703 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8490000000000006e-06 2023-09-30T17:03:47.703 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.703 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.703 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:47.703 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.736637+0000", 2023-09-30T17:03:47.703 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00091620799999999995 2023-09-30T17:03:47.704 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.704 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.704 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:47.704 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.736719+0000", 2023-09-30T17:03:47.704 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2608999999999995e-05 2023-09-30T17:03:47.704 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.704 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.704 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:47.704 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.736876+0000", 2023-09-30T17:03:47.704 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015636799999999999 2023-09-30T17:03:47.704 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.705 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.705 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:47.705 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.742934+0000", 2023-09-30T17:03:47.705 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0060581619999999997 2023-09-30T17:03:47.705 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.705 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.705 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:47.705 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.964798+0000", 2023-09-30T17:03:47.705 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22186376599999999 2023-09-30T17:03:47.705 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.705 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.705 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:47.706 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.964859+0000", 2023-09-30T17:03:47.706 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1668000000000007e-05 2023-09-30T17:03:47.706 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.706 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.706 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:47.706 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.964900+0000", 2023-09-30T17:03:47.706 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1125999999999999e-05 2023-09-30T17:03:47.706 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:47.706 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:47.706 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:47.706 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.707 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.707 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23856 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 3538944~4096,write 3616768~4096,write 3686400~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:47.707 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.759274+0000", 2023-09-30T17:03:47.707 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 8.8787797570000002, 2023-09-30T17:03:47.707 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.234084127, 2023-09-30T17:03:47.707 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:47.707 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:47.707 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:47.707 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:47.707 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:47.708 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23856 2023-09-30T17:03:47.708 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.708 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:47.708 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.708 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:47.708 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759274+0000", 2023-09-30T17:03:47.708 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:47.708 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.708 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.708 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:47.708 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759274+0000", 2023-09-30T17:03:47.708 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:47.708 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.709 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.709 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:47.709 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759274+0000", 2023-09-30T17:03:47.709 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7899999999999998e-07 2023-09-30T17:03:47.709 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.709 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.709 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:47.709 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759293+0000", 2023-09-30T17:03:47.709 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8410000000000002e-05 2023-09-30T17:03:47.709 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.709 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.709 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:47.710 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759302+0000", 2023-09-30T17:03:47.710 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8599999999999999e-06 2023-09-30T17:03:47.710 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.710 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.710 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:47.710 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759306+0000", 2023-09-30T17:03:47.710 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4499999999999997e-06 2023-09-30T17:03:47.710 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.710 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.710 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:47.710 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759984+0000", 2023-09-30T17:03:47.711 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00067830600000000005 2023-09-30T17:03:47.711 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.711 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.711 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:47.711 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.760041+0000", 2023-09-30T17:03:47.711 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.643e-05 2023-09-30T17:03:47.711 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.711 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.711 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:47.711 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.760135+0000", 2023-09-30T17:03:47.711 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3795999999999994e-05 2023-09-30T17:03:47.711 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.712 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.712 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:47.712 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764097+0000", 2023-09-30T17:03:47.712 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0039625629999999997 2023-09-30T17:03:47.712 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.712 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.712 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:47.712 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993282+0000", 2023-09-30T17:03:47.712 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22918461500000001 2023-09-30T17:03:47.712 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.713 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.713 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:47.713 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993320+0000", 2023-09-30T17:03:47.713 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8600999999999999e-05 2023-09-30T17:03:47.713 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.713 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.713 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:47.713 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993358+0000", 2023-09-30T17:03:47.713 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7517e-05 2023-09-30T17:03:47.713 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:47.713 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:47.713 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:47.713 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.714 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.714 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23865 4.36 4:6da220e6:::100000001f8.0000003f:head [write 3715072~4096,write 3850240~4096,write 4059136~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:47.714 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.761946+0000", 2023-09-30T17:03:47.714 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 8.8761072720000005, 2023-09-30T17:03:47.714 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.231486097, 2023-09-30T17:03:47.714 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:47.714 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:47.714 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:47.714 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:47.714 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:47.714 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23865 2023-09-30T17:03:47.714 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.715 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:47.715 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.715 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:47.715 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.761946+0000", 2023-09-30T17:03:47.715 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:47.715 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.715 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.715 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:47.715 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.761946+0000", 2023-09-30T17:03:47.715 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:47.715 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.715 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.716 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:47.716 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.761947+0000", 2023-09-30T17:03:47.716 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7000000000000004e-07 2023-09-30T17:03:47.716 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.716 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.716 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:47.716 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.761959+0000", 2023-09-30T17:03:47.716 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2265e-05 2023-09-30T17:03:47.716 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.716 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.716 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:47.717 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.761970+0000", 2023-09-30T17:03:47.717 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0474e-05 2023-09-30T17:03:47.717 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.717 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.717 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:47.717 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.761976+0000", 2023-09-30T17:03:47.717 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1340000000000001e-06 2023-09-30T17:03:47.717 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.717 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.717 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:47.717 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.762063+0000", 2023-09-30T17:03:47.717 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.6728e-05 2023-09-30T17:03:47.718 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.718 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.718 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:47.718 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.762125+0000", 2023-09-30T17:03:47.718 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2869999999999999e-05 2023-09-30T17:03:47.718 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.718 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.718 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:47.718 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.762235+0000", 2023-09-30T17:03:47.718 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000109139 2023-09-30T17:03:47.718 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.718 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.719 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:47.719 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764102+0000", 2023-09-30T17:03:47.719 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001867121 2023-09-30T17:03:47.719 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.719 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.719 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:47.719 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993327+0000", 2023-09-30T17:03:47.719 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22922526800000001 2023-09-30T17:03:47.719 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.719 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.719 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:47.719 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993391+0000", 2023-09-30T17:03:47.720 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3839999999999999e-05 2023-09-30T17:03:47.720 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.720 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.720 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:47.720 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993432+0000", 2023-09-30T17:03:47.720 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1488e-05 2023-09-30T17:03:47.720 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:47.720 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:47.720 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:47.720 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.720 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.720 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23875 4.36 4:6da220e6:::100000001f8.0000003f:head [write 364544~4096,write 499712~4096,write 655360~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:47.721 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.764904+0000", 2023-09-30T17:03:47.721 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 8.8731490879999999, 2023-09-30T17:03:47.721 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.228631693, 2023-09-30T17:03:47.721 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:47.721 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:47.721 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:47.721 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:47.721 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:47.721 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23875 2023-09-30T17:03:47.721 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.721 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:47.721 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.722 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:47.722 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764904+0000", 2023-09-30T17:03:47.722 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:47.722 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.722 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.722 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:47.722 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764904+0000", 2023-09-30T17:03:47.722 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:47.722 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.722 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.722 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:47.722 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764905+0000", 2023-09-30T17:03:47.722 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2799999999999995e-07 2023-09-30T17:03:47.723 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.723 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.723 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:47.723 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764915+0000", 2023-09-30T17:03:47.723 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8099999999999992e-06 2023-09-30T17:03:47.723 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.723 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.723 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:47.723 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764926+0000", 2023-09-30T17:03:47.723 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0858e-05 2023-09-30T17:03:47.723 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.723 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.724 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:47.724 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764931+0000", 2023-09-30T17:03:47.724 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2170000000000002e-06 2023-09-30T17:03:47.724 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.724 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.724 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:47.724 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764963+0000", 2023-09-30T17:03:47.724 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.2319e-05 2023-09-30T17:03:47.724 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.724 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.724 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:47.724 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.765009+0000", 2023-09-30T17:03:47.724 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5753000000000001e-05 2023-09-30T17:03:47.725 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.725 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.725 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:47.725 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.765093+0000", 2023-09-30T17:03:47.725 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4259999999999996e-05 2023-09-30T17:03:47.725 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.725 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.725 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:47.725 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766238+0000", 2023-09-30T17:03:47.725 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0011442550000000001 2023-09-30T17:03:47.725 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.725 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.726 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:47.726 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993469+0000", 2023-09-30T17:03:47.726 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22723121800000001 2023-09-30T17:03:47.726 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.726 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.726 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:47.726 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993501+0000", 2023-09-30T17:03:47.726 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.2576000000000001e-05 2023-09-30T17:03:47.726 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.726 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.726 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:47.727 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993536+0000", 2023-09-30T17:03:47.727 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4699000000000001e-05 2023-09-30T17:03:47.727 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:47.727 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:47.727 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:47.727 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.727 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.727 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23881 4.36 4:6da220e6:::100000001f8.0000003f:head [write 3366912~4096,write 3694592~4096,write 4071424~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:47.727 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.766444+0000", 2023-09-30T17:03:47.727 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 8.8716096669999995, 2023-09-30T17:03:47.728 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23475070200000001, 2023-09-30T17:03:47.728 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:47.728 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:47.728 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:47.728 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:47.728 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:47.728 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23881 2023-09-30T17:03:47.728 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.728 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:47.728 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.728 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:47.728 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766444+0000", 2023-09-30T17:03:47.729 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:47.729 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.729 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.729 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:47.729 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766444+0000", 2023-09-30T17:03:47.729 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:47.729 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.729 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.729 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:47.729 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766444+0000", 2023-09-30T17:03:47.729 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3e-07 2023-09-30T17:03:47.729 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.729 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.730 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:47.730 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766455+0000", 2023-09-30T17:03:47.730 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0454e-05 2023-09-30T17:03:47.730 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.730 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.730 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:47.730 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766469+0000", 2023-09-30T17:03:47.730 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3568e-05 2023-09-30T17:03:47.730 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.730 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.730 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:47.731 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766474+0000", 2023-09-30T17:03:47.731 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1669999999999998e-06 2023-09-30T17:03:47.731 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.731 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.731 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:47.731 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766527+0000", 2023-09-30T17:03:47.731 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3650000000000003e-05 2023-09-30T17:03:47.731 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.731 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.731 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:47.731 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766611+0000", 2023-09-30T17:03:47.732 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3230000000000001e-05 2023-09-30T17:03:47.732 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.732 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.732 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:47.732 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766767+0000", 2023-09-30T17:03:47.732 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015688 2023-09-30T17:03:47.732 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.732 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.732 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:47.732 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.770254+0000", 2023-09-30T17:03:47.732 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0034870090000000001 2023-09-30T17:03:47.732 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.732 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.733 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:47.733 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.001100+0000", 2023-09-30T17:03:47.733 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23084518700000001 2023-09-30T17:03:47.733 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.733 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.733 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:47.733 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.001154+0000", 2023-09-30T17:03:47.733 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4453000000000002e-05 2023-09-30T17:03:47.733 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.733 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.733 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:47.734 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.001194+0000", 2023-09-30T17:03:47.734 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0373999999999997e-05 2023-09-30T17:03:47.734 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:47.734 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:47.734 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:47.734 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.734 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.734 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23901 4.6 4:63e80496:::100000001f8.0000001e:head [write 2617344~4096,write 2646016~4096,write 2662400~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:47.734 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.772204+0000", 2023-09-30T17:03:47.734 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 8.8658496499999995, 2023-09-30T17:03:47.734 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.228858799, 2023-09-30T17:03:47.734 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:47.735 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:47.735 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:47.735 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:47.735 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:47.735 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23901 2023-09-30T17:03:47.735 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.735 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:47.735 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.735 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:47.735 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772204+0000", 2023-09-30T17:03:47.735 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:47.735 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.736 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.736 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:47.736 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772204+0000", 2023-09-30T17:03:47.736 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:47.736 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.736 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.736 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:47.736 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772205+0000", 2023-09-30T17:03:47.736 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3600000000000002e-07 2023-09-30T17:03:47.736 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.736 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.736 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:47.736 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772217+0000", 2023-09-30T17:03:47.737 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2459999999999999e-05 2023-09-30T17:03:47.737 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.737 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.737 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:47.737 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772228+0000", 2023-09-30T17:03:47.737 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0614e-05 2023-09-30T17:03:47.737 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.737 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.737 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:47.737 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772236+0000", 2023-09-30T17:03:47.737 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7610000000000007e-06 2023-09-30T17:03:47.738 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.738 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.738 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:47.738 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772280+0000", 2023-09-30T17:03:47.738 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4360000000000002e-05 2023-09-30T17:03:47.738 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.738 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.738 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:47.738 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772328+0000", 2023-09-30T17:03:47.738 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8041000000000003e-05 2023-09-30T17:03:47.738 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.739 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.739 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:47.739 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772417+0000", 2023-09-30T17:03:47.739 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9226000000000003e-05 2023-09-30T17:03:47.739 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.739 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.739 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:47.739 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.774997+0000", 2023-09-30T17:03:47.739 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0025795039999999998 2023-09-30T17:03:47.739 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.739 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.740 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:47.740 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.000979+0000", 2023-09-30T17:03:47.740 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22598211700000001 2023-09-30T17:03:47.740 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.740 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.740 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:47.740 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.001025+0000", 2023-09-30T17:03:47.740 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6347999999999997e-05 2023-09-30T17:03:47.740 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.740 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.740 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:47.740 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.001063+0000", 2023-09-30T17:03:47.741 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7431999999999997e-05 2023-09-30T17:03:47.741 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:47.741 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:47.741 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:47.741 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.741 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.741 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23924 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 1196032~4096,write 1249280~4096,write 1294336~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:47.741 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.778807+0000", 2023-09-30T17:03:47.741 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 8.8592467910000003, 2023-09-30T17:03:47.741 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23068708600000001, 2023-09-30T17:03:47.741 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:47.741 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:47.742 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:47.742 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:47.742 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:47.742 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23924 2023-09-30T17:03:47.742 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.742 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:47.742 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.742 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:47.742 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778807+0000", 2023-09-30T17:03:47.742 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:47.742 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.742 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.743 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:47.743 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778807+0000", 2023-09-30T17:03:47.743 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:47.743 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.743 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.743 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:47.743 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778807+0000", 2023-09-30T17:03:47.743 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3600000000000003e-07 2023-09-30T17:03:47.743 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.743 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.743 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:47.744 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778832+0000", 2023-09-30T17:03:47.744 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4905999999999998e-05 2023-09-30T17:03:47.744 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.744 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.744 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:47.744 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778839+0000", 2023-09-30T17:03:47.744 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.097e-06 2023-09-30T17:03:47.744 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.744 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.744 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:47.744 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778843+0000", 2023-09-30T17:03:47.744 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8279999999999996e-06 2023-09-30T17:03:47.745 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.745 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.745 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:47.745 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778875+0000", 2023-09-30T17:03:47.745 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.1792000000000003e-05 2023-09-30T17:03:47.745 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.745 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.745 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:47.745 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778922+0000", 2023-09-30T17:03:47.745 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7034999999999999e-05 2023-09-30T17:03:47.745 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.745 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.746 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:47.746 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.779010+0000", 2023-09-30T17:03:47.746 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8305000000000002e-05 2023-09-30T17:03:47.746 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.746 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.746 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:47.746 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.781442+0000", 2023-09-30T17:03:47.746 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0024313550000000001 2023-09-30T17:03:47.746 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.746 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.746 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:47.746 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.009433+0000", 2023-09-30T17:03:47.747 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.227991044 2023-09-30T17:03:47.747 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.747 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.747 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:47.747 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.009471+0000", 2023-09-30T17:03:47.747 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8720999999999997e-05 2023-09-30T17:03:47.747 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.747 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.747 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:47.747 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.009494+0000", 2023-09-30T17:03:47.748 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2367000000000001e-05 2023-09-30T17:03:47.748 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:47.748 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:47.748 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:47.748 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.748 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.748 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23990 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 4157440~4096,write 4186112~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:47.748 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.798667+0000", 2023-09-30T17:03:47.748 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 8.8393862760000008, 2023-09-30T17:03:47.748 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23029929399999999, 2023-09-30T17:03:47.748 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:47.749 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:47.749 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:47.749 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:47.749 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:47.749 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23990 2023-09-30T17:03:47.749 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.749 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:47.749 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.749 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:47.749 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798667+0000", 2023-09-30T17:03:47.749 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:47.749 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.750 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.750 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:47.750 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798667+0000", 2023-09-30T17:03:47.750 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:47.750 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.750 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.750 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:47.750 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798668+0000", 2023-09-30T17:03:47.750 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7000000000000005e-07 2023-09-30T17:03:47.750 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.750 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.751 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:47.751 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798675+0000", 2023-09-30T17:03:47.751 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1269999999999997e-06 2023-09-30T17:03:47.751 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.751 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.751 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:47.751 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798681+0000", 2023-09-30T17:03:47.751 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3500000000000002e-06 2023-09-30T17:03:47.751 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.751 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.751 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:47.751 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798685+0000", 2023-09-30T17:03:47.752 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.63e-06 2023-09-30T17:03:47.752 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.752 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.752 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:47.752 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798726+0000", 2023-09-30T17:03:47.752 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.163e-05 2023-09-30T17:03:47.752 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.752 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.752 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:47.752 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798790+0000", 2023-09-30T17:03:47.752 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3781999999999993e-05 2023-09-30T17:03:47.752 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.753 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.753 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:47.753 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798933+0000", 2023-09-30T17:03:47.753 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014272199999999999 2023-09-30T17:03:47.753 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.753 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.753 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:47.753 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.802788+0000", 2023-09-30T17:03:47.753 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.003855509 2023-09-30T17:03:47.753 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.753 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.754 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:47.754 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.028891+0000", 2023-09-30T17:03:47.754 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.226102847 2023-09-30T17:03:47.754 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.754 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.754 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:47.754 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.028945+0000", 2023-09-30T17:03:47.754 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3600000000000002e-05 2023-09-30T17:03:47.754 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.754 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.754 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:47.755 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.028966+0000", 2023-09-30T17:03:47.755 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1526999999999999e-05 2023-09-30T17:03:47.755 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:47.755 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:47.755 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:47.755 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.755 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.755 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23991 4.6 4:63e80496:::100000001f8.0000001e:head [write 327680~4096,write 335872~4096,write 491520~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:47.755 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.798864+0000", 2023-09-30T17:03:47.755 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 8.8391896919999997, 2023-09-30T17:03:47.755 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23025762699999999, 2023-09-30T17:03:47.755 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:47.756 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:47.756 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:47.756 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:47.756 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:47.756 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23991 2023-09-30T17:03:47.756 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.756 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:47.756 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.756 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:47.756 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798864+0000", 2023-09-30T17:03:47.756 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:47.756 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.756 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.757 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:47.757 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798864+0000", 2023-09-30T17:03:47.757 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:47.757 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.757 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.757 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:47.757 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798864+0000", 2023-09-30T17:03:47.757 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3099999999999998e-07 2023-09-30T17:03:47.757 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.757 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.757 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:47.757 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798873+0000", 2023-09-30T17:03:47.758 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4789999999999996e-06 2023-09-30T17:03:47.758 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.758 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.758 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:47.758 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798878+0000", 2023-09-30T17:03:47.758 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6579999999999999e-06 2023-09-30T17:03:47.758 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.758 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.758 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:47.758 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798882+0000", 2023-09-30T17:03:47.758 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.985e-06 2023-09-30T17:03:47.758 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.759 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.759 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:47.759 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.799659+0000", 2023-09-30T17:03:47.759 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00077693900000000004 2023-09-30T17:03:47.759 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.759 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.759 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:47.759 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.799712+0000", 2023-09-30T17:03:47.759 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2694000000000001e-05 2023-09-30T17:03:47.759 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.760 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.760 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:47.760 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.799796+0000", 2023-09-30T17:03:47.760 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3943999999999995e-05 2023-09-30T17:03:47.760 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.760 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.760 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:47.760 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.802821+0000", 2023-09-30T17:03:47.760 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0030251850000000001 2023-09-30T17:03:47.760 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.760 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.761 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:47.761 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.029027+0000", 2023-09-30T17:03:47.761 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22620609999999999 2023-09-30T17:03:47.761 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.761 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.761 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:47.761 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.029083+0000", 2023-09-30T17:03:47.761 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5926e-05 2023-09-30T17:03:47.761 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.761 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.761 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:47.762 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.029121+0000", 2023-09-30T17:03:47.762 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8186000000000003e-05 2023-09-30T17:03:47.762 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:47.762 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:47.762 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:47.762 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.762 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.762 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:24052 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 3448832~4096,write 3493888~4096,write 3502080~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:47.762 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.817515+0000", 2023-09-30T17:03:47.762 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 8.8205383820000005, 2023-09-30T17:03:47.762 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23184106800000001, 2023-09-30T17:03:47.762 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:47.763 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:47.763 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:47.763 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:47.763 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:47.763 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 24052 2023-09-30T17:03:47.763 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.763 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:47.763 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.763 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:47.763 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.817515+0000", 2023-09-30T17:03:47.763 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:47.763 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.764 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.764 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:47.764 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.817515+0000", 2023-09-30T17:03:47.764 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:47.764 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.764 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.764 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:47.764 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.817516+0000", 2023-09-30T17:03:47.764 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9899999999999999e-07 2023-09-30T17:03:47.764 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.764 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.765 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:47.765 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.817531+0000", 2023-09-30T17:03:47.765 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5483000000000001e-05 2023-09-30T17:03:47.765 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.765 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.765 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:47.765 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.817545+0000", 2023-09-30T17:03:47.765 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3209e-05 2023-09-30T17:03:47.765 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.765 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.765 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:47.766 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.817553+0000", 2023-09-30T17:03:47.766 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.994e-06 2023-09-30T17:03:47.766 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.766 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.766 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:47.766 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.818753+0000", 2023-09-30T17:03:47.766 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0012000909999999999 2023-09-30T17:03:47.766 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.766 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.766 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:47.766 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.818838+0000", 2023-09-30T17:03:47.767 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5389999999999994e-05 2023-09-30T17:03:47.767 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.767 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.767 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:47.767 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.818996+0000", 2023-09-30T17:03:47.767 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000158116 2023-09-30T17:03:47.767 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.767 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.767 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:47.768 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.822334+0000", 2023-09-30T17:03:47.768 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0033373230000000001 2023-09-30T17:03:47.768 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.768 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.768 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:47.768 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049259+0000", 2023-09-30T17:03:47.768 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22692517400000001 2023-09-30T17:03:47.768 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.768 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.768 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:47.768 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049323+0000", 2023-09-30T17:03:47.768 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4348000000000001e-05 2023-09-30T17:03:47.769 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.769 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.769 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:47.769 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049356+0000", 2023-09-30T17:03:47.769 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3040999999999998e-05 2023-09-30T17:03:47.769 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:47.769 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:47.769 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:47.769 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.769 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.770 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:24058 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 172032~4096,write 200704~4096,write 249856~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:47.770 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.819363+0000", 2023-09-30T17:03:47.770 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 8.8186909060000005, 2023-09-30T17:03:47.770 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23030741099999999, 2023-09-30T17:03:47.770 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:47.770 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:47.770 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:47.770 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:47.770 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:47.770 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 24058 2023-09-30T17:03:47.771 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.771 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:47.771 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.771 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:47.771 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819363+0000", 2023-09-30T17:03:47.771 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:47.771 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.771 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.771 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:47.771 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819363+0000", 2023-09-30T17:03:47.772 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:47.772 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.772 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.772 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:47.772 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819363+0000", 2023-09-30T17:03:47.772 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8400000000000003e-07 2023-09-30T17:03:47.772 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.772 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.772 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:47.772 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819373+0000", 2023-09-30T17:03:47.772 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.9930000000000007e-06 2023-09-30T17:03:47.773 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.773 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.773 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:47.773 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819383+0000", 2023-09-30T17:03:47.773 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.4059999999999994e-06 2023-09-30T17:03:47.773 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.773 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.773 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:47.773 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819388+0000", 2023-09-30T17:03:47.773 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3299999999999998e-06 2023-09-30T17:03:47.773 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.774 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.774 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:47.774 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819584+0000", 2023-09-30T17:03:47.774 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00019642600000000001 2023-09-30T17:03:47.774 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.774 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.774 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:47.774 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819627+0000", 2023-09-30T17:03:47.774 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2150999999999997e-05 2023-09-30T17:03:47.774 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.774 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.775 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:47.775 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819712+0000", 2023-09-30T17:03:47.775 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5255999999999998e-05 2023-09-30T17:03:47.775 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.775 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.775 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:47.775 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.822340+0000", 2023-09-30T17:03:47.775 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0026283029999999998 2023-09-30T17:03:47.775 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.775 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.776 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:47.776 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049621+0000", 2023-09-30T17:03:47.776 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.227281176 2023-09-30T17:03:47.776 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.776 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.776 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:47.776 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049652+0000", 2023-09-30T17:03:47.776 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0528000000000003e-05 2023-09-30T17:03:47.776 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.776 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.776 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:47.776 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049670+0000", 2023-09-30T17:03:47.777 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8057999999999999e-05 2023-09-30T17:03:47.777 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:47.777 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:47.777 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:47.777 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.777 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.777 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:24064 4.6 4:616d4c41:::100000001f8.00000034:head [write 4132864~4096,write 4173824~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:47.777 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.820931+0000", 2023-09-30T17:03:47.777 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 8.8171225450000001, 2023-09-30T17:03:47.777 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22854920400000001, 2023-09-30T17:03:47.777 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:47.777 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:47.778 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:47.778 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:47.778 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:47.778 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 24064 2023-09-30T17:03:47.778 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.778 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:47.778 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.778 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:47.778 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.820931+0000", 2023-09-30T17:03:47.778 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:47.778 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.779 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.779 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:47.779 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.820931+0000", 2023-09-30T17:03:47.779 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:47.779 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.779 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.779 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:47.779 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.820932+0000", 2023-09-30T17:03:47.779 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4300000000000002e-07 2023-09-30T17:03:47.779 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.779 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.779 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:47.780 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.820941+0000", 2023-09-30T17:03:47.780 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.5650000000000007e-06 2023-09-30T17:03:47.780 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.780 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.780 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:47.780 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.820952+0000", 2023-09-30T17:03:47.780 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0566e-05 2023-09-30T17:03:47.780 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.780 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.780 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:47.780 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.820957+0000", 2023-09-30T17:03:47.780 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3800000000000002e-06 2023-09-30T17:03:47.780 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.781 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.781 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:47.781 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.821008+0000", 2023-09-30T17:03:47.781 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1070999999999999e-05 2023-09-30T17:03:47.781 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.781 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.781 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:47.781 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.821075+0000", 2023-09-30T17:03:47.781 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.648e-05 2023-09-30T17:03:47.781 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.781 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.781 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:47.782 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.821236+0000", 2023-09-30T17:03:47.782 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016120899999999999 2023-09-30T17:03:47.782 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.782 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.782 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:47.782 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.823356+0000", 2023-09-30T17:03:47.782 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.002120458 2023-09-30T17:03:47.782 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.782 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.782 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:47.782 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049389+0000", 2023-09-30T17:03:47.782 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22603278199999999 2023-09-30T17:03:47.783 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.783 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.783 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:47.783 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049443+0000", 2023-09-30T17:03:47.783 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4033000000000003e-05 2023-09-30T17:03:47.783 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:47.783 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:47.783 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:47.783 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049480+0000", 2023-09-30T17:03:47.783 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6816999999999997e-05 2023-09-30T17:03:47.783 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:47.784 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:47.784 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:47.784 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:47.784 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:47.784 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:47.785 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:03:47.786 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:47.784+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:47.886 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:47.886+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:47.975 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:47.975 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2023-09-30T17:03:47.975 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:47.975 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:49261 4.12 4:48ab9bde:::100000001f8.00000015:head [write 3907584~4096 in=4096b,write 3919872~4096 in=4096b,write 3944448~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-09-30T17:03:47.975 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:47.974047+0000", 2023-09-30T17:03:47.975 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.00031192900000000001, 2023-09-30T17:03:47.975 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00033419, 2023-09-30T17:03:47.975 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:47.975 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:47.976 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:47.976 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:47.976 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:47.976 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 49261 2023-09-30T17:03:47.976 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:47.976 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:47.976 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:47.976 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:47.976 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.974047+0000", 2023-09-30T17:03:47.976 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:47.977 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:47.977 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:47.977 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:47.977 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.974047+0000", 2023-09-30T17:03:47.977 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:47.977 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:47.978 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:47.978 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:47.978 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.974047+0000", 2023-09-30T17:03:47.978 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6499999999999998e-07 2023-09-30T17:03:47.978 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:47.978 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:47.978 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:47.978 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.974059+0000", 2023-09-30T17:03:47.979 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1303e-05 2023-09-30T17:03:47.979 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:47.979 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:47.979 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:47.979 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.974069+0000", 2023-09-30T17:03:47.979 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0458e-05 2023-09-30T17:03:47.979 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:47.979 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:47.979 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:47.980 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.974076+0000", 2023-09-30T17:03:47.980 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3989999999999998e-06 2023-09-30T17:03:47.980 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:47.980 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:47.980 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:47.980 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.974165+0000", 2023-09-30T17:03:47.980 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8517000000000006e-05 2023-09-30T17:03:47.980 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:47.980 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:47.980 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:47.980 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.974238+0000", 2023-09-30T17:03:47.981 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2648e-05 2023-09-30T17:03:47.981 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:47.981 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:47.981 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:47.981 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.974380+0000", 2023-09-30T17:03:47.981 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014214699999999999 2023-09-30T17:03:47.981 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:47.981 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:47.981 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:47.981 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:47.981 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:47.982 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:49238 4.6 e44/17 4:616d4c41:::100000001f8.00000034:head v 44'3036, mlcod=44'3033)", 2023-09-30T17:03:47.982 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:47.966894+0000", 2023-09-30T17:03:47.982 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0074646879999999997, 2023-09-30T17:03:47.982 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075451570000000003, 2023-09-30T17:03:47.982 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:47.982 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:47.982 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:47.982 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:47.982 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:47.983 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.966894+0000", 2023-09-30T17:03:47.983 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:47.983 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:47.983 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:47.983 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:47.983 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.966894+0000", 2023-09-30T17:03:47.983 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:47.983 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:47.983 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:47.983 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:47.984 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.966894+0000", 2023-09-30T17:03:47.984 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9900000000000001e-07 2023-09-30T17:03:47.984 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:47.984 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:47.984 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:47.984 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.966907+0000", 2023-09-30T17:03:47.984 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2961e-05 2023-09-30T17:03:47.984 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:47.984 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:47.984 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:47.984 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.966916+0000", 2023-09-30T17:03:47.985 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9390000000000003e-06 2023-09-30T17:03:47.985 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:47.985 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:47.985 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:47.985 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.966923+0000", 2023-09-30T17:03:47.985 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6449999999999999e-06 2023-09-30T17:03:47.985 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:47.985 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:47.985 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:47.985 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.966966+0000", 2023-09-30T17:03:47.985 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3608e-05 2023-09-30T17:03:47.986 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:47.986 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:47.986 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:47.986 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.966986+0000", 2023-09-30T17:03:47.986 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9225999999999999e-05 2023-09-30T17:03:47.986 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:47.986 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:47.986 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:47.986 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:47.986 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:47.986 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:49240 4.6 e44/17 4:63e80496:::100000001f8.0000001e:head v 44'3037, mlcod=44'3033)", 2023-09-30T17:03:47.987 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:47.969015+0000", 2023-09-30T17:03:47.987 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0053434099999999998, 2023-09-30T17:03:47.987 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054606079999999996, 2023-09-30T17:03:47.987 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:47.987 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:47.987 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:47.987 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:47.987 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:47.987 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.969015+0000", 2023-09-30T17:03:47.987 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:47.987 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:47.987 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:47.987 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:47.988 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.969015+0000", 2023-09-30T17:03:47.988 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:47.988 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:47.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:47.988 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:47.988 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.969015+0000", 2023-09-30T17:03:47.988 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2399999999999999e-07 2023-09-30T17:03:47.988 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:47.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:47.988 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:47.988 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.969032+0000", 2023-09-30T17:03:47.989 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6517000000000001e-05 2023-09-30T17:03:47.989 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:47.989 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:47.989 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:47.989 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.969042+0000", 2023-09-30T17:03:47.989 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0054999999999999e-05 2023-09-30T17:03:47.989 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:47.989 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:47.989 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:47.990 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.969048+0000", 2023-09-30T17:03:47.990 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6849999999999998e-06 2023-09-30T17:03:47.990 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:47.990 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:47.990 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:47.990 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.969934+0000", 2023-09-30T17:03:47.990 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000885913 2023-09-30T17:03:47.990 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:47.990 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:47.990 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:47.990 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.969950+0000", 2023-09-30T17:03:47.990 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6030000000000001e-05 2023-09-30T17:03:47.991 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:47.991 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:47.991 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:47.991 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:47.991 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:47.991 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:49242 4.36 e44/17 4:6fa85f86:::100000001f8.00000013:head v 44'2325, mlcod=44'2322)", 2023-09-30T17:03:47.991 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:47.969073+0000", 2023-09-30T17:03:47.991 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0052857290000000003, 2023-09-30T17:03:47.991 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054420409999999999, 2023-09-30T17:03:47.991 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:47.991 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:47.992 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:47.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:47.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:47.992 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.969073+0000", 2023-09-30T17:03:47.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:47.992 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:47.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:47.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:47.992 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.969073+0000", 2023-09-30T17:03:47.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:47.992 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:47.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:47.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:47.993 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.969073+0000", 2023-09-30T17:03:47.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8299999999999998e-07 2023-09-30T17:03:47.993 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:47.993 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:47.993 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:47.993 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.969099+0000", 2023-09-30T17:03:47.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5885999999999999e-05 2023-09-30T17:03:47.993 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:47.993 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:47.993 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:47.993 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.969108+0000", 2023-09-30T17:03:47.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6489999999999997e-06 2023-09-30T17:03:47.994 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:47.994 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:47.994 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:47.994 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.969113+0000", 2023-09-30T17:03:47.994 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1200000000000001e-06 2023-09-30T17:03:47.994 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:47.994 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:47.994 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:47.994 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.969923+0000", 2023-09-30T17:03:47.994 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00081040699999999997 2023-09-30T17:03:47.994 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:47.995 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:47.995 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:47.995 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.969940+0000", 2023-09-30T17:03:47.995 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6572999999999999e-05 2023-09-30T17:03:47.995 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:47.995 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:47.995 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:47.995 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:47.995 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:47.995 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:49254 4.38 4:1fc350da:::100000001f8.0000002f:head [write 2093056~4096 in=4096b,write 2117632~4096 in=4096b,write 2367488~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-09-30T17:03:47.995 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:47.971424+0000", 2023-09-30T17:03:47.996 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0029349390000000001, 2023-09-30T17:03:47.996 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0031357680000000001, 2023-09-30T17:03:47.996 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:47.996 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:47.996 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:47.996 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:47.996 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:47.996 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 49254 2023-09-30T17:03:47.996 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:47.996 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:47.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:47.997 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:47.997 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.971424+0000", 2023-09-30T17:03:47.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:47.997 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:47.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:47.997 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:47.997 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.971424+0000", 2023-09-30T17:03:47.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:47.997 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:47.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:47.997 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:47.998 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.971425+0000", 2023-09-30T17:03:47.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.003e-06 2023-09-30T17:03:47.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:47.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:47.998 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:47.998 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.971444+0000", 2023-09-30T17:03:47.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9796000000000002e-05 2023-09-30T17:03:47.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:47.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:47.998 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:47.998 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.971455+0000", 2023-09-30T17:03:47.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0665999999999999e-05 2023-09-30T17:03:47.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:47.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:47.999 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:47.999 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.971463+0000", 2023-09-30T17:03:47.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9279999999999993e-06 2023-09-30T17:03:47.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:47.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:47.999 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:48.000 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.971527+0000", 2023-09-30T17:03:48.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3718000000000002e-05 2023-09-30T17:03:48.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.000 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:48.000 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.971617+0000", 2023-09-30T17:03:48.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9980000000000002e-05 2023-09-30T17:03:48.000 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.000 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:48.001 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.001 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:49252 4.6 e44/17 4:616d4c41:::100000001f8.00000034:head v 44'3038, mlcod=44'3033)", 2023-09-30T17:03:48.001 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:47.971905+0000", 2023-09-30T17:03:48.001 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0024534819999999999, 2023-09-30T17:03:48.001 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002727499, 2023-09-30T17:03:48.001 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:48.002 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:48.002 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:48.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.002 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:48.002 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.971905+0000", 2023-09-30T17:03:48.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:48.002 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.002 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:48.002 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.971905+0000", 2023-09-30T17:03:48.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:48.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.003 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.003 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:48.003 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.971905+0000", 2023-09-30T17:03:48.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0999999999999999e-07 2023-09-30T17:03:48.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.003 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.003 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:48.003 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.971921+0000", 2023-09-30T17:03:48.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5054e-05 2023-09-30T17:03:48.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.003 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:48.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.971930+0000", 2023-09-30T17:03:48.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1479999999999995e-06 2023-09-30T17:03:48.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:48.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.971936+0000", 2023-09-30T17:03:48.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.066e-06 2023-09-30T17:03:48.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:48.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.972261+0000", 2023-09-30T17:03:48.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000325524 2023-09-30T17:03:48.005 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.005 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:48.005 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.972288+0000", 2023-09-30T17:03:48.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6828000000000001e-05 2023-09-30T17:03:48.005 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.005 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:48.005 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.005 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.006 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:49247 4.3f e44/17 4:fde182c5:::100000001f8.00000039:head v 44'774, mlcod=44'770)", 2023-09-30T17:03:48.006 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:47.971948+0000", 2023-09-30T17:03:48.006 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0024101219999999998, 2023-09-30T17:03:48.006 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002750831, 2023-09-30T17:03:48.006 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:48.006 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:48.006 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:48.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.006 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:48.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.971948+0000", 2023-09-30T17:03:48.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:48.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.007 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:48.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.971948+0000", 2023-09-30T17:03:48.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:48.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.007 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:48.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.971949+0000", 2023-09-30T17:03:48.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8700000000000002e-07 2023-09-30T17:03:48.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.008 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:48.008 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.971959+0000", 2023-09-30T17:03:48.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0648999999999999e-05 2023-09-30T17:03:48.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.008 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:48.008 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.971966+0000", 2023-09-30T17:03:48.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1969999999999999e-06 2023-09-30T17:03:48.009 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.009 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:48.009 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.971971+0000", 2023-09-30T17:03:48.009 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1880000000000004e-06 2023-09-30T17:03:48.009 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.009 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:48.009 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.972004+0000", 2023-09-30T17:03:48.009 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3351e-05 2023-09-30T17:03:48.009 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.009 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:48.010 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.972017+0000", 2023-09-30T17:03:48.010 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3406e-05 2023-09-30T17:03:48.010 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.010 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:48.010 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.010 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.010 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:49258 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 2207744~4096 in=4096b,write 2240512~4096 in=4096b,write 2256896~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-09-30T17:03:48.010 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:47.972606+0000", 2023-09-30T17:03:48.010 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.001752396, 2023-09-30T17:03:48.010 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0021659700000000001, 2023-09-30T17:03:48.010 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:48.011 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:48.011 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:48.011 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:48.011 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:48.011 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 49258 2023-09-30T17:03:48.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.011 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:48.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:48.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.972606+0000", 2023-09-30T17:03:48.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:48.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:48.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.972606+0000", 2023-09-30T17:03:48.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:48.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:48.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.972607+0000", 2023-09-30T17:03:48.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0400000000000005e-07 2023-09-30T17:03:48.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.013 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:48.013 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.972626+0000", 2023-09-30T17:03:48.013 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.88e-05 2023-09-30T17:03:48.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.013 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:48.013 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.972642+0000", 2023-09-30T17:03:48.013 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.596e-05 2023-09-30T17:03:48.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.014 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.014 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:48.014 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.972650+0000", 2023-09-30T17:03:48.014 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5939999999999994e-06 2023-09-30T17:03:48.014 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.014 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.014 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:48.014 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.972717+0000", 2023-09-30T17:03:48.014 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6633999999999999e-05 2023-09-30T17:03:48.014 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:48.015 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.972935+0000", 2023-09-30T17:03:48.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0002184 2023-09-30T17:03:48.015 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:48.015 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.973087+0000", 2023-09-30T17:03:48.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015190200000000001 2023-09-30T17:03:48.015 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.015 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:48.015 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.016 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:49259 4.35 4:af28909f:::100000001f8.0000001b:head [write 1421312~4096 in=4096b,write 1433600~4096 in=4096b,write 1650688~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-09-30T17:03:48.016 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:47.973541+0000", 2023-09-30T17:03:48.016 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.00081739099999999999, 2023-09-30T17:03:48.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0013234099999999999, 2023-09-30T17:03:48.016 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:48.016 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:48.016 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:48.016 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:48.016 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:48.016 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 49259 2023-09-30T17:03:48.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.017 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:48.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:48.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.973541+0000", 2023-09-30T17:03:48.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:48.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:48.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.973541+0000", 2023-09-30T17:03:48.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:48.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.018 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:48.018 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.973542+0000", 2023-09-30T17:03:48.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7199999999999998e-07 2023-09-30T17:03:48.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.018 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:48.018 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.973553+0000", 2023-09-30T17:03:48.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0837e-05 2023-09-30T17:03:48.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.018 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:48.019 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.973564+0000", 2023-09-30T17:03:48.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1780000000000001e-05 2023-09-30T17:03:48.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.019 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:48.019 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.973572+0000", 2023-09-30T17:03:48.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5950000000000001e-06 2023-09-30T17:03:48.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.019 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:48.019 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.973632+0000", 2023-09-30T17:03:48.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9583000000000002e-05 2023-09-30T17:03:48.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:48.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.973748+0000", 2023-09-30T17:03:48.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011611 2023-09-30T17:03:48.020 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.020 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:48.020 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.021 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:49260 4.29 4:94178d8a:::100000001f8.00000006:head [write 3559424~4096 in=4096b,write 3584000~4096 in=4096b,write 3829760~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-09-30T17:03:48.021 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:47.973728+0000", 2023-09-30T17:03:48.021 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.00063087899999999999, 2023-09-30T17:03:48.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0012156319999999999, 2023-09-30T17:03:48.021 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:48.021 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:48.021 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:48.021 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:48.021 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:48.021 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 49260 2023-09-30T17:03:48.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.021 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:48.022 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.022 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:48.022 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.973728+0000", 2023-09-30T17:03:48.022 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:48.022 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.022 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.022 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:48.022 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.973728+0000", 2023-09-30T17:03:48.022 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:48.022 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.022 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.023 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:48.023 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.973728+0000", 2023-09-30T17:03:48.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1999999999999998e-07 2023-09-30T17:03:48.023 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.023 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.023 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:48.023 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.973745+0000", 2023-09-30T17:03:48.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6884e-05 2023-09-30T17:03:48.023 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.023 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.024 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:48.024 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.973757+0000", 2023-09-30T17:03:48.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1435e-05 2023-09-30T17:03:48.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.024 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:48.024 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.973765+0000", 2023-09-30T17:03:48.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9629999999999998e-06 2023-09-30T17:03:48.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.024 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:48.025 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.973813+0000", 2023-09-30T17:03:48.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8662000000000003e-05 2023-09-30T17:03:48.025 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.025 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.025 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:48.025 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:47.973887+0000", 2023-09-30T17:03:48.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3857999999999997e-05 2023-09-30T17:03:48.025 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.025 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:48.025 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.025 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.025 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2023-09-30T17:03:48.025 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 10 2023-09-30T17:03:48.026 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:48.027 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:03:48.028 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:48.027+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:48.129 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:48.128+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:48.220 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:48.220 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:03:48.221 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2023-09-30T17:03:48.221 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2023-09-30T17:03:48.221 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:48.229 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:48.228+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:48.236 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:03:48.330 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:48.331+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:48.431 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:48.430+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:48.461 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:48.461 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2023-09-30T17:03:48.461 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2023-09-30T17:03:48.461 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2023-09-30T17:03:48.461 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.462 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:23704 4.14 e41/17 4:2b28d75f:::100000001f8.00000016:head v 41'381, mlcod=41'379)", 2023-09-30T17:03:48.462 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.711674+0000", 2023-09-30T17:03:48.462 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.7472451020000008, 2023-09-30T17:03:48.462 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.225773745, 2023-09-30T17:03:48.462 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:48.462 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:48.462 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:48.462 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.463 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:48.463 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.711674+0000", 2023-09-30T17:03:48.463 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:48.463 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.463 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:48.463 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.711674+0000", 2023-09-30T17:03:48.463 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:48.463 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.464 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.464 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:48.464 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.711674+0000", 2023-09-30T17:03:48.464 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2000000000000001e-07 2023-09-30T17:03:48.464 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.464 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.464 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:48.465 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.711685+0000", 2023-09-30T17:03:48.465 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.117e-05 2023-09-30T17:03:48.465 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.465 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.465 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:48.465 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.711691+0000", 2023-09-30T17:03:48.465 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2129999999999996e-06 2023-09-30T17:03:48.465 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.465 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.466 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:48.466 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.711696+0000", 2023-09-30T17:03:48.466 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7339999999999999e-06 2023-09-30T17:03:48.466 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.466 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.466 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:48.466 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713583+0000", 2023-09-30T17:03:48.466 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0018866219999999999 2023-09-30T17:03:48.466 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.467 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.467 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:48.467 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713603+0000", 2023-09-30T17:03:48.467 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0142000000000001e-05 2023-09-30T17:03:48.467 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.467 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.467 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:48.467 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.937407+0000", 2023-09-30T17:03:48.468 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.223804165 2023-09-30T17:03:48.468 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.468 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.468 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:48.468 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.937447+0000", 2023-09-30T17:03:48.468 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0479000000000003e-05 2023-09-30T17:03:48.468 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.468 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:48.469 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.469 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.469 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.469 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:23708 4.14 e41/17 4:2b28d75f:::100000001f8.00000016:head v 41'382, mlcod=41'379)", 2023-09-30T17:03:48.469 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713552+0000", 2023-09-30T17:03:48.469 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.7453662810000008, 2023-09-30T17:03:48.469 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.22392661999999999, 2023-09-30T17:03:48.469 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:48.470 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:48.470 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:48.470 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.470 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:48.470 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713552+0000", 2023-09-30T17:03:48.470 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:48.470 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.470 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.470 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:48.470 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713552+0000", 2023-09-30T17:03:48.470 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:48.471 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.471 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.471 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:48.471 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713553+0000", 2023-09-30T17:03:48.471 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0999999999999999e-07 2023-09-30T17:03:48.471 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.471 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.471 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:48.471 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713564+0000", 2023-09-30T17:03:48.471 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0851e-05 2023-09-30T17:03:48.471 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.472 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.472 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:48.472 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713570+0000", 2023-09-30T17:03:48.472 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1480000000000003e-06 2023-09-30T17:03:48.472 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.472 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.472 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:48.472 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713574+0000", 2023-09-30T17:03:48.472 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.464e-06 2023-09-30T17:03:48.472 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.473 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.473 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:48.473 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.714408+0000", 2023-09-30T17:03:48.473 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00083399400000000001 2023-09-30T17:03:48.473 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.473 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.473 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:48.473 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.714425+0000", 2023-09-30T17:03:48.473 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7234000000000001e-05 2023-09-30T17:03:48.473 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.473 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.474 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:48.474 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.937451+0000", 2023-09-30T17:03:48.474 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.22302575899999999 2023-09-30T17:03:48.474 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.474 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.474 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:48.474 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.937479+0000", 2023-09-30T17:03:48.474 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7759999999999998e-05 2023-09-30T17:03:48.474 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.474 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:48.474 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.475 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.475 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.475 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23700 4.30 4:0c89e311:::100000001f8.00000017:head [write 1548288~4096 in=4096b,write 1638400~4096 in=4096b,write 1814528~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:48.475 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713661+0000", 2023-09-30T17:03:48.475 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.7452581449999993, 2023-09-30T17:03:48.475 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.21981082900000001, 2023-09-30T17:03:48.475 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:48.475 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:48.475 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:48.475 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:48.475 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:48.476 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23700 2023-09-30T17:03:48.476 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.476 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:48.476 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.476 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:48.476 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713661+0000", 2023-09-30T17:03:48.476 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:48.476 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.476 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.476 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:48.476 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713661+0000", 2023-09-30T17:03:48.477 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:48.477 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.477 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.477 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:48.477 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713661+0000", 2023-09-30T17:03:48.477 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6000000000000004e-07 2023-09-30T17:03:48.477 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.477 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.477 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:48.477 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713669+0000", 2023-09-30T17:03:48.477 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2039999999999997e-06 2023-09-30T17:03:48.478 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.478 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.478 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:48.478 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713679+0000", 2023-09-30T17:03:48.478 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5999999999999996e-06 2023-09-30T17:03:48.478 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.478 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.478 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:48.478 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713683+0000", 2023-09-30T17:03:48.478 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4390000000000002e-06 2023-09-30T17:03:48.478 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.479 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.479 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:48.479 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713722+0000", 2023-09-30T17:03:48.479 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8707000000000001e-05 2023-09-30T17:03:48.479 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.479 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.479 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:48.479 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713780+0000", 2023-09-30T17:03:48.479 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8242000000000002e-05 2023-09-30T17:03:48.479 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.479 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.479 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:48.480 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.933335+0000", 2023-09-30T17:03:48.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.21955456500000001 2023-09-30T17:03:48.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.480 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:48.480 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.933388+0000", 2023-09-30T17:03:48.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2843999999999998e-05 2023-09-30T17:03:48.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.480 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:48.480 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.933471+0000", 2023-09-30T17:03:48.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3667999999999999e-05 2023-09-30T17:03:48.481 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.481 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:48.481 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.481 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.481 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.481 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23703 4.38 4:1d13bf87:::100000001f8.00000030:head [write 839680~4096 in=4096b,write 1101824~4096 in=4096b,write 1155072~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:48.481 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713696+0000", 2023-09-30T17:03:48.481 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.7452230659999994, 2023-09-30T17:03:48.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.23500357699999999, 2023-09-30T17:03:48.481 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:48.482 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:48.482 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:48.482 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:48.482 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:48.482 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23703 2023-09-30T17:03:48.482 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.482 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:48.482 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.482 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:48.482 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713696+0000", 2023-09-30T17:03:48.482 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:48.482 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.483 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.483 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:48.483 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713696+0000", 2023-09-30T17:03:48.483 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:48.483 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.483 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.483 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:48.483 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713696+0000", 2023-09-30T17:03:48.483 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9500000000000003e-07 2023-09-30T17:03:48.483 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.483 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.484 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:48.484 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713711+0000", 2023-09-30T17:03:48.484 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5251e-05 2023-09-30T17:03:48.484 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.484 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.484 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:48.484 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713718+0000", 2023-09-30T17:03:48.484 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9430000000000003e-06 2023-09-30T17:03:48.484 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.484 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.484 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:48.484 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713723+0000", 2023-09-30T17:03:48.485 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4240000000000003e-06 2023-09-30T17:03:48.485 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.485 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.485 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:48.485 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713757+0000", 2023-09-30T17:03:48.485 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4128999999999998e-05 2023-09-30T17:03:48.485 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.485 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.485 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:48.485 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713841+0000", 2023-09-30T17:03:48.485 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3845999999999996e-05 2023-09-30T17:03:48.486 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.486 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.486 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:48.486 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.948561+0000", 2023-09-30T17:03:48.486 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.234720286 2023-09-30T17:03:48.486 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.486 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.486 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:48.486 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.948624+0000", 2023-09-30T17:03:48.486 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2961999999999998e-05 2023-09-30T17:03:48.487 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.487 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.487 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:48.487 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.948699+0000", 2023-09-30T17:03:48.487 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5240999999999993e-05 2023-09-30T17:03:48.487 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.487 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:48.487 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.487 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.487 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.487 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23706 4.f 4:f0d983b2:::100000001f8.0000001f:head [write 1003520~4096 in=4096b,write 1146880~4096 in=4096b,write 1163264~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:48.487 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713730+0000", 2023-09-30T17:03:48.487 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.7451890110000008, 2023-09-30T17:03:48.488 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.22546488100000001, 2023-09-30T17:03:48.488 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:48.488 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:48.488 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:48.488 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:48.488 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:48.488 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23706 2023-09-30T17:03:48.488 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.488 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:48.488 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.488 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:48.488 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713730+0000", 2023-09-30T17:03:48.489 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:48.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.489 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:48.489 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713730+0000", 2023-09-30T17:03:48.489 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:48.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.489 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:48.489 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713730+0000", 2023-09-30T17:03:48.489 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0900000000000001e-07 2023-09-30T17:03:48.490 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.490 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.490 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:48.490 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713740+0000", 2023-09-30T17:03:48.490 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0115999999999999e-05 2023-09-30T17:03:48.490 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.490 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.490 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:48.490 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713747+0000", 2023-09-30T17:03:48.490 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5429999999999999e-06 2023-09-30T17:03:48.490 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.491 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.491 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:48.491 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713752+0000", 2023-09-30T17:03:48.491 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1270000000000002e-06 2023-09-30T17:03:48.491 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.491 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.491 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:48.491 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713788+0000", 2023-09-30T17:03:48.491 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5762000000000001e-05 2023-09-30T17:03:48.491 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.491 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.492 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:48.492 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713835+0000", 2023-09-30T17:03:48.492 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6808000000000003e-05 2023-09-30T17:03:48.492 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.492 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.492 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:48.492 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713962+0000", 2023-09-30T17:03:48.492 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000127315 2023-09-30T17:03:48.492 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.492 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.492 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:48.492 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.923977+0000", 2023-09-30T17:03:48.493 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.21001473100000001 2023-09-30T17:03:48.493 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.493 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.493 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:48.493 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939118+0000", 2023-09-30T17:03:48.493 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015141297999999999 2023-09-30T17:03:48.493 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.493 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.493 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:48.493 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939161+0000", 2023-09-30T17:03:48.493 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3458999999999998e-05 2023-09-30T17:03:48.494 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.494 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.494 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:48.494 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939195+0000", 2023-09-30T17:03:48.494 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3113e-05 2023-09-30T17:03:48.494 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.494 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:48.494 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.494 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.494 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.495 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23707 4.2f 4:f59f865b:::100000001f8.00000007:head [write 3575808~4096 in=4096b,write 3932160~4096 in=4096b,write 4063232~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:48.495 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713764+0000", 2023-09-30T17:03:48.495 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.7451545680000002, 2023-09-30T17:03:48.495 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.225343612, 2023-09-30T17:03:48.495 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:48.495 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:48.495 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:48.495 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:48.495 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:48.495 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23707 2023-09-30T17:03:48.495 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.496 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:48.496 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.496 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:48.496 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713764+0000", 2023-09-30T17:03:48.496 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:48.496 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.496 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.496 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:48.496 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713764+0000", 2023-09-30T17:03:48.496 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:48.496 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.497 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.497 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:48.497 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713765+0000", 2023-09-30T17:03:48.497 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4099999999999999e-07 2023-09-30T17:03:48.497 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.497 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.497 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:48.497 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713775+0000", 2023-09-30T17:03:48.497 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0253e-05 2023-09-30T17:03:48.497 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.497 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.498 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:48.498 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713781+0000", 2023-09-30T17:03:48.498 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1770000000000003e-06 2023-09-30T17:03:48.498 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.498 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.498 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:48.498 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713787+0000", 2023-09-30T17:03:48.498 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.784e-06 2023-09-30T17:03:48.498 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.498 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.498 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:48.498 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713824+0000", 2023-09-30T17:03:48.499 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7258000000000001e-05 2023-09-30T17:03:48.499 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.499 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.499 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:48.499 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713897+0000", 2023-09-30T17:03:48.499 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3255000000000003e-05 2023-09-30T17:03:48.499 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.499 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.499 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:48.499 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.714035+0000", 2023-09-30T17:03:48.499 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013741799999999999 2023-09-30T17:03:48.500 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.500 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.500 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:48.500 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.924017+0000", 2023-09-30T17:03:48.500 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.20998277000000001 2023-09-30T17:03:48.500 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.500 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.500 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:48.500 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939013+0000", 2023-09-30T17:03:48.500 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014995432 2023-09-30T17:03:48.500 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.501 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.501 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:48.501 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939064+0000", 2023-09-30T17:03:48.501 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0784e-05 2023-09-30T17:03:48.501 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.501 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.501 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:48.501 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939108+0000", 2023-09-30T17:03:48.501 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4039999999999998e-05 2023-09-30T17:03:48.501 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.501 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:48.501 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.502 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.502 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.502 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23709 4.37 4:ef395e89:::100000001f8.00000020:head [write 4042752~4096 in=4096b,write 4124672~4096 in=4096b,write 4182016~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:48.502 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713796+0000", 2023-09-30T17:03:48.502 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.7451223490000007, 2023-09-30T17:03:48.502 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.23291700700000001, 2023-09-30T17:03:48.502 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:48.502 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:48.502 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:48.502 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:48.502 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:48.503 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23709 2023-09-30T17:03:48.503 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.503 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:48.503 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.503 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:48.503 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713796+0000", 2023-09-30T17:03:48.503 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:48.503 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.503 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.503 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:48.503 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713796+0000", 2023-09-30T17:03:48.504 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:48.504 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.504 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.504 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:48.504 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713797+0000", 2023-09-30T17:03:48.504 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2200000000000004e-07 2023-09-30T17:03:48.504 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.504 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.504 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:48.504 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713807+0000", 2023-09-30T17:03:48.504 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.815e-06 2023-09-30T17:03:48.505 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.505 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.505 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:48.505 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713813+0000", 2023-09-30T17:03:48.505 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5899999999999996e-06 2023-09-30T17:03:48.505 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.505 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.505 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:48.505 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713818+0000", 2023-09-30T17:03:48.505 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2639999999999999e-06 2023-09-30T17:03:48.505 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.506 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:48.506 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.714818+0000", 2023-09-30T17:03:48.506 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00099973500000000008 2023-09-30T17:03:48.506 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.506 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:48.506 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.921155+0000", 2023-09-30T17:03:48.506 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.206336778 2023-09-30T17:03:48.506 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.507 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:48.507 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.921347+0000", 2023-09-30T17:03:48.507 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000191917 2023-09-30T17:03:48.507 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.507 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.507 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:48.507 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.944206+0000", 2023-09-30T17:03:48.507 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022859349000000001 2023-09-30T17:03:48.507 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.507 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.530 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:48.530 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.946622+0000", 2023-09-30T17:03:48.530 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0024161849999999999 2023-09-30T17:03:48.530 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.530 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.531 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:48.531 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.946673+0000", 2023-09-30T17:03:48.531 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0670000000000001e-05 2023-09-30T17:03:48.531 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.531 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.531 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:48.531 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.946713+0000", 2023-09-30T17:03:48.532 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0182000000000003e-05 2023-09-30T17:03:48.532 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.532 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:48.532 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.532 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.532 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.532 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23710 4.12 4:4be51a30:::100000001f8.0000000b:head [write 3772416~4096 in=4096b,write 3825664~4096 in=4096b,write 3833856~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:48.532 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713827+0000", 2023-09-30T17:03:48.532 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.7450918640000008, 2023-09-30T17:03:48.532 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.214817016, 2023-09-30T17:03:48.532 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:48.533 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:48.533 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:48.533 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:48.533 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:48.533 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23710 2023-09-30T17:03:48.533 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.533 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:48.533 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.533 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:48.533 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713827+0000", 2023-09-30T17:03:48.533 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:48.533 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.534 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.534 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:48.534 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713827+0000", 2023-09-30T17:03:48.534 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:48.534 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.534 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.534 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:48.534 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713827+0000", 2023-09-30T17:03:48.534 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.51e-07 2023-09-30T17:03:48.534 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.534 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.535 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:48.535 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713837+0000", 2023-09-30T17:03:48.535 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8239999999999995e-06 2023-09-30T17:03:48.535 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.535 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.535 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:48.535 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713843+0000", 2023-09-30T17:03:48.535 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3729999999999998e-06 2023-09-30T17:03:48.535 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.535 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.535 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:48.536 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713849+0000", 2023-09-30T17:03:48.536 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3480000000000003e-06 2023-09-30T17:03:48.536 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.536 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.536 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:48.536 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713896+0000", 2023-09-30T17:03:48.536 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7426999999999998e-05 2023-09-30T17:03:48.536 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.536 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.536 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:48.536 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713969+0000", 2023-09-30T17:03:48.536 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2496000000000005e-05 2023-09-30T17:03:48.537 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.537 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.537 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:48.537 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.714114+0000", 2023-09-30T17:03:48.537 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014550699999999999 2023-09-30T17:03:48.537 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.537 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.537 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:48.537 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.922604+0000", 2023-09-30T17:03:48.537 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.20848978900000001 2023-09-30T17:03:48.537 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.538 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.538 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:48.538 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.928219+0000", 2023-09-30T17:03:48.538 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056147159999999996 2023-09-30T17:03:48.538 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.538 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.538 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:48.538 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.928268+0000", 2023-09-30T17:03:48.538 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9353e-05 2023-09-30T17:03:48.538 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.538 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.539 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:48.539 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.928644+0000", 2023-09-30T17:03:48.539 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00037573199999999999 2023-09-30T17:03:48.572 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.572 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:48.572 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.572 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.572 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.572 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23711 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 270336~4096 in=4096b,write 876544~4096 in=4096b,write 933888~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:48.572 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713868+0000", 2023-09-30T17:03:48.573 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.7450510040000005, 2023-09-30T17:03:48.573 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.234682211, 2023-09-30T17:03:48.573 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:48.573 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:48.573 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:48.573 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:48.573 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:48.573 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23711 2023-09-30T17:03:48.573 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.573 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:48.573 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.574 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:48.574 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713868+0000", 2023-09-30T17:03:48.574 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:48.574 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.574 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.574 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:48.574 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713868+0000", 2023-09-30T17:03:48.574 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:48.574 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.574 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.574 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:48.575 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713868+0000", 2023-09-30T17:03:48.575 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.75e-07 2023-09-30T17:03:48.575 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.575 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.575 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:48.575 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713879+0000", 2023-09-30T17:03:48.575 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0494e-05 2023-09-30T17:03:48.575 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.575 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.575 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:48.575 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713886+0000", 2023-09-30T17:03:48.576 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3159999999999999e-06 2023-09-30T17:03:48.576 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.576 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.576 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:48.576 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713892+0000", 2023-09-30T17:03:48.576 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7200000000000003e-06 2023-09-30T17:03:48.576 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.576 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.576 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:48.576 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.714747+0000", 2023-09-30T17:03:48.576 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00085524699999999995 2023-09-30T17:03:48.577 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.577 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.577 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:48.577 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.714822+0000", 2023-09-30T17:03:48.577 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5444999999999993e-05 2023-09-30T17:03:48.577 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.577 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.577 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:48.577 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.947884+0000", 2023-09-30T17:03:48.577 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.233061449 2023-09-30T17:03:48.577 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.578 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.578 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:48.578 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.947942+0000", 2023-09-30T17:03:48.578 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7649999999999999e-05 2023-09-30T17:03:48.578 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.578 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.578 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:48.578 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.948550+0000", 2023-09-30T17:03:48.578 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00060831500000000001 2023-09-30T17:03:48.578 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.579 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:48.579 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.579 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.579 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.579 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23712 4.37 4:eff9002a:::100000001f8.00000003:head [write 3387392~8192,write 3452928~4096,write 3710976~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:48.579 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713901+0000", 2023-09-30T17:03:48.579 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.7450179460000008, 2023-09-30T17:03:48.579 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.25525220700000001, 2023-09-30T17:03:48.579 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:48.579 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:48.579 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:48.580 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:48.580 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:48.580 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23712 2023-09-30T17:03:48.580 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.580 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:48.580 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.580 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:48.580 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713901+0000", 2023-09-30T17:03:48.580 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:48.580 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.581 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.581 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:48.581 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713901+0000", 2023-09-30T17:03:48.581 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:48.581 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.581 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.581 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:48.581 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713901+0000", 2023-09-30T17:03:48.581 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.96e-07 2023-09-30T17:03:48.581 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.581 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.582 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:48.582 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713912+0000", 2023-09-30T17:03:48.582 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0543999999999999e-05 2023-09-30T17:03:48.582 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.582 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.582 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:48.582 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713918+0000", 2023-09-30T17:03:48.582 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4420000000000003e-06 2023-09-30T17:03:48.582 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.582 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.582 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:48.583 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713923+0000", 2023-09-30T17:03:48.583 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3059999999999997e-06 2023-09-30T17:03:48.583 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.583 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.583 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:48.583 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.946744+0000", 2023-09-30T17:03:48.583 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.23282061100000001 2023-09-30T17:03:48.583 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.583 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.583 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:48.583 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.946818+0000", 2023-09-30T17:03:48.583 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3762000000000003e-05 2023-09-30T17:03:48.584 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.584 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.584 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:48.584 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.946949+0000", 2023-09-30T17:03:48.584 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013133900000000001 2023-09-30T17:03:48.584 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.584 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.584 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:48.584 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.951383+0000", 2023-09-30T17:03:48.584 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0044336999999999996 2023-09-30T17:03:48.584 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.585 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.585 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:48.585 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.969076+0000", 2023-09-30T17:03:48.585 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017693303000000001 2023-09-30T17:03:48.585 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.585 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.585 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:48.585 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.969119+0000", 2023-09-30T17:03:48.585 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3208999999999999e-05 2023-09-30T17:03:48.585 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.585 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.586 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:48.586 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.969153+0000", 2023-09-30T17:03:48.586 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3594999999999999e-05 2023-09-30T17:03:48.586 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.586 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:48.586 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.586 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.586 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.586 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:23713 4.33 e41/17 4:cf6d7a6c:::100000001f8.0000000a:head v 41'399, mlcod=41'397)", 2023-09-30T17:03:48.586 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.715224+0000", 2023-09-30T17:03:48.587 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.7436946659999997, 2023-09-30T17:03:48.587 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.230022326, 2023-09-30T17:03:48.587 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:48.587 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:48.587 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:48.587 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.587 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:48.587 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.715224+0000", 2023-09-30T17:03:48.587 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:48.587 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.587 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.587 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:48.588 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.715224+0000", 2023-09-30T17:03:48.588 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:48.588 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.588 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.588 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:48.588 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.715228+0000", 2023-09-30T17:03:48.588 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4220000000000002e-06 2023-09-30T17:03:48.588 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.588 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.588 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:48.588 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.715239+0000", 2023-09-30T17:03:48.589 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0261999999999999e-05 2023-09-30T17:03:48.589 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.589 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.589 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:48.589 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.921195+0000", 2023-09-30T17:03:48.589 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.205955902 2023-09-30T17:03:48.589 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.589 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.589 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:48.589 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.921210+0000", 2023-09-30T17:03:48.589 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5109999999999999e-05 2023-09-30T17:03:48.589 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.590 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.590 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:48.590 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.921430+0000", 2023-09-30T17:03:48.590 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022019300000000001 2023-09-30T17:03:48.590 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.590 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.590 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:48.590 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.921454+0000", 2023-09-30T17:03:48.590 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4142e-05 2023-09-30T17:03:48.590 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.591 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.591 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:48.591 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.945208+0000", 2023-09-30T17:03:48.591 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.023753765999999999 2023-09-30T17:03:48.591 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.591 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.591 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:48.591 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.945246+0000", 2023-09-30T17:03:48.591 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8529000000000003e-05 2023-09-30T17:03:48.591 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.592 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:48.592 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.592 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.592 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.592 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24202 4.38 4:1dcf718c:::100000001f8.00000022:head [write 966656~4096,write 995328~4096,write 1007616~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:48.592 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.938506+0000", 2023-09-30T17:03:48.592 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.5204130770000006, 2023-09-30T17:03:48.592 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.19404896199999999, 2023-09-30T17:03:48.592 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:48.592 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:48.593 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:48.593 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:48.593 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:48.593 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24202 2023-09-30T17:03:48.593 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.593 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:48.593 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.593 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:48.593 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938506+0000", 2023-09-30T17:03:48.593 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:48.593 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.593 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.594 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:48.594 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938506+0000", 2023-09-30T17:03:48.594 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:48.594 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.594 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.594 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:48.594 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938506+0000", 2023-09-30T17:03:48.594 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7899999999999999e-07 2023-09-30T17:03:48.594 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.594 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.595 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:48.595 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938539+0000", 2023-09-30T17:03:48.595 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2839999999999997e-05 2023-09-30T17:03:48.595 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.595 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.595 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:48.595 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938549+0000", 2023-09-30T17:03:48.595 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0202e-05 2023-09-30T17:03:48.595 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.596 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.596 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:48.596 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938554+0000", 2023-09-30T17:03:48.596 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1660000000000002e-06 2023-09-30T17:03:48.596 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.596 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.596 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:48.596 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.107092+0000", 2023-09-30T17:03:48.597 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.168537457 2023-09-30T17:03:48.597 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.597 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.597 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:48.597 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.107174+0000", 2023-09-30T17:03:48.597 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2380999999999996e-05 2023-09-30T17:03:48.597 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.597 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.597 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:48.597 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.132433+0000", 2023-09-30T17:03:48.598 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.025258939000000001 2023-09-30T17:03:48.598 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.598 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.598 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:48.598 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.132483+0000", 2023-09-30T17:03:48.598 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9951000000000003e-05 2023-09-30T17:03:48.598 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.598 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.598 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:48.599 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.132555+0000", 2023-09-30T17:03:48.599 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1647e-05 2023-09-30T17:03:48.599 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.599 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:48.599 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.599 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.599 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.599 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24207 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 2002944~4096,write 2060288~4096,write 2068480~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:48.599 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.938605+0000", 2023-09-30T17:03:48.599 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.5203138099999993, 2023-09-30T17:03:48.600 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.19406049, 2023-09-30T17:03:48.600 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:48.600 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:48.600 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:48.600 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:48.600 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:48.600 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24207 2023-09-30T17:03:48.600 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.600 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:48.601 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.601 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:48.601 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938605+0000", 2023-09-30T17:03:48.601 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:48.601 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.601 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.601 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:48.601 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938605+0000", 2023-09-30T17:03:48.601 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:48.601 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.602 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.602 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:48.602 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938605+0000", 2023-09-30T17:03:48.602 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2899999999999999e-07 2023-09-30T17:03:48.602 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.602 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.602 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:48.602 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938621+0000", 2023-09-30T17:03:48.602 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5624000000000002e-05 2023-09-30T17:03:48.602 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.602 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.603 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:48.603 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938627+0000", 2023-09-30T17:03:48.603 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.925e-06 2023-09-30T17:03:48.603 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.603 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.603 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:48.603 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938630+0000", 2023-09-30T17:03:48.603 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4599999999999999e-06 2023-09-30T17:03:48.603 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.603 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.603 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:48.603 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.110850+0000", 2023-09-30T17:03:48.604 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.17221983699999999 2023-09-30T17:03:48.604 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.604 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.604 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:48.604 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.110930+0000", 2023-09-30T17:03:48.604 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0092999999999994e-05 2023-09-30T17:03:48.604 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.604 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.604 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:48.604 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.132561+0000", 2023-09-30T17:03:48.604 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021631371999999999 2023-09-30T17:03:48.604 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.605 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.605 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:48.605 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.132604+0000", 2023-09-30T17:03:48.605 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2818999999999998e-05 2023-09-30T17:03:48.605 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.605 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.605 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:48.605 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.132665+0000", 2023-09-30T17:03:48.605 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1030999999999999e-05 2023-09-30T17:03:48.605 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.605 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:48.606 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.606 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.606 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.606 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24210 4.30 4:0c89e311:::100000001f8.00000017:head [write 3231744~4096,write 3272704~4096,write 3346432~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:48.606 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.938660+0000", 2023-09-30T17:03:48.606 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.5202587409999992, 2023-09-30T17:03:48.606 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.194937256, 2023-09-30T17:03:48.606 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:48.606 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:48.606 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:48.607 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:48.607 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:48.607 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24210 2023-09-30T17:03:48.607 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.607 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:48.607 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.607 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:48.607 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938660+0000", 2023-09-30T17:03:48.607 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:48.607 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.608 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.608 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:48.608 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938660+0000", 2023-09-30T17:03:48.608 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:48.608 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.608 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.608 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:48.608 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938660+0000", 2023-09-30T17:03:48.608 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5800000000000001e-07 2023-09-30T17:03:48.608 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.609 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.609 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:48.609 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938676+0000", 2023-09-30T17:03:48.609 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5650000000000001e-05 2023-09-30T17:03:48.609 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.609 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.609 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:48.609 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938685+0000", 2023-09-30T17:03:48.609 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9250000000000001e-06 2023-09-30T17:03:48.609 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.609 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.609 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:48.610 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938690+0000", 2023-09-30T17:03:48.610 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8160000000000001e-06 2023-09-30T17:03:48.610 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.610 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.610 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:48.610 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.110993+0000", 2023-09-30T17:03:48.610 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.172303714 2023-09-30T17:03:48.610 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.610 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.610 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:48.610 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.111072+0000", 2023-09-30T17:03:48.611 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8448999999999994e-05 2023-09-30T17:03:48.611 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.611 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.611 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:48.611 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.133463+0000", 2023-09-30T17:03:48.611 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022391297000000001 2023-09-30T17:03:48.611 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.611 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.611 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:48.612 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.133518+0000", 2023-09-30T17:03:48.612 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5278999999999997e-05 2023-09-30T17:03:48.612 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.612 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.612 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:48.612 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.133597+0000", 2023-09-30T17:03:48.612 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8868000000000005e-05 2023-09-30T17:03:48.612 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.612 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:48.612 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.612 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.613 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.613 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24218 4.30 4:0c89e311:::100000001f8.00000017:head [write 1191936~4096,write 1245184~4096,write 1261568~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:48.613 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.938815+0000", 2023-09-30T17:03:48.613 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.5201034579999995, 2023-09-30T17:03:48.613 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.19788513899999999, 2023-09-30T17:03:48.613 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:48.613 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:48.613 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:48.613 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:48.613 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:48.614 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24218 2023-09-30T17:03:48.614 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.614 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:48.614 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.614 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:48.614 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938815+0000", 2023-09-30T17:03:48.614 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:48.614 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.614 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.614 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:48.614 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938815+0000", 2023-09-30T17:03:48.615 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:48.615 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.615 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.615 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:48.615 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938816+0000", 2023-09-30T17:03:48.615 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8699999999999995e-07 2023-09-30T17:03:48.615 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.615 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.615 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:48.615 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938837+0000", 2023-09-30T17:03:48.615 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1534000000000001e-05 2023-09-30T17:03:48.615 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.616 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.616 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:48.616 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938845+0000", 2023-09-30T17:03:48.616 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7190000000000001e-06 2023-09-30T17:03:48.616 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.616 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.616 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:48.616 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938850+0000", 2023-09-30T17:03:48.616 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1220000000000003e-06 2023-09-30T17:03:48.616 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.616 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.617 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:48.617 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.113486+0000", 2023-09-30T17:03:48.617 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.17463620299999999 2023-09-30T17:03:48.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.617 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.617 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:48.617 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.113626+0000", 2023-09-30T17:03:48.617 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013924799999999999 2023-09-30T17:03:48.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.617 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.617 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:48.617 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.136575+0000", 2023-09-30T17:03:48.618 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022949701999999999 2023-09-30T17:03:48.618 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.618 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.618 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:48.618 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.136623+0000", 2023-09-30T17:03:48.618 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7808e-05 2023-09-30T17:03:48.618 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.618 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.618 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:48.618 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.136700+0000", 2023-09-30T17:03:48.618 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7316000000000003e-05 2023-09-30T17:03:48.619 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.619 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:48.619 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.619 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.619 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.619 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24223 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 2449408~4096,write 2936832~4096,write 2973696~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:48.619 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.938922+0000", 2023-09-30T17:03:48.619 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.5199966299999996, 2023-09-30T17:03:48.619 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.19909703600000001, 2023-09-30T17:03:48.619 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:48.619 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:48.620 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:48.620 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:48.620 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:48.620 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24223 2023-09-30T17:03:48.620 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.620 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:48.620 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.620 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:48.620 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938922+0000", 2023-09-30T17:03:48.620 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:48.620 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.620 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.621 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:48.621 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938922+0000", 2023-09-30T17:03:48.621 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:48.621 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.621 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.621 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:48.621 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938922+0000", 2023-09-30T17:03:48.621 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8599999999999999e-07 2023-09-30T17:03:48.621 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.621 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.621 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:48.622 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938943+0000", 2023-09-30T17:03:48.622 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0588999999999999e-05 2023-09-30T17:03:48.622 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.622 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.622 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:48.622 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938958+0000", 2023-09-30T17:03:48.622 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4915e-05 2023-09-30T17:03:48.622 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.622 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.622 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:48.622 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938964+0000", 2023-09-30T17:03:48.623 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8329999999999999e-06 2023-09-30T17:03:48.623 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.623 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.623 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:48.623 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.114879+0000", 2023-09-30T17:03:48.623 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.17591552699999999 2023-09-30T17:03:48.623 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.623 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.623 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:48.623 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.114958+0000", 2023-09-30T17:03:48.624 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8666999999999997e-05 2023-09-30T17:03:48.624 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.624 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.624 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:48.624 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.137905+0000", 2023-09-30T17:03:48.624 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022947381999999999 2023-09-30T17:03:48.624 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.624 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.624 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:48.624 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.137948+0000", 2023-09-30T17:03:48.624 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2851e-05 2023-09-30T17:03:48.624 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.625 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.625 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:48.625 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.138019+0000", 2023-09-30T17:03:48.625 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0885999999999999e-05 2023-09-30T17:03:48.625 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.625 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:48.625 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.625 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.625 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.625 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24231 4.30 4:0c89e311:::100000001f8.00000017:head [write 3121152~4096,write 3174400~4096,write 3198976~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:48.625 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.939120+0000", 2023-09-30T17:03:48.626 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.5197982910000007, 2023-09-30T17:03:48.626 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.199038715, 2023-09-30T17:03:48.626 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:48.626 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:48.626 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:48.626 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:48.626 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:48.626 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24231 2023-09-30T17:03:48.626 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.626 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:48.626 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.627 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:48.627 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939120+0000", 2023-09-30T17:03:48.627 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:48.627 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.627 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.627 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:48.627 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939120+0000", 2023-09-30T17:03:48.627 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:48.627 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.627 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.627 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:48.628 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939121+0000", 2023-09-30T17:03:48.628 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5799999999999999e-07 2023-09-30T17:03:48.628 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.628 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.628 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:48.628 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939138+0000", 2023-09-30T17:03:48.628 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6742e-05 2023-09-30T17:03:48.628 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.628 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.628 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:48.628 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939145+0000", 2023-09-30T17:03:48.628 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2230000000000001e-06 2023-09-30T17:03:48.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:48.629 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939155+0000", 2023-09-30T17:03:48.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.995e-06 2023-09-30T17:03:48.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:48.629 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.116318+0000", 2023-09-30T17:03:48.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.17716331799999999 2023-09-30T17:03:48.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.630 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:48.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.116392+0000", 2023-09-30T17:03:48.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3379000000000003e-05 2023-09-30T17:03:48.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.630 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:48.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.138027+0000", 2023-09-30T17:03:48.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021635318000000001 2023-09-30T17:03:48.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.630 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:48.631 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.138076+0000", 2023-09-30T17:03:48.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9055999999999999e-05 2023-09-30T17:03:48.631 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.631 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.631 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:48.631 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.138159+0000", 2023-09-30T17:03:48.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3126000000000003e-05 2023-09-30T17:03:48.631 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.632 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:48.632 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.632 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.632 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.632 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24247 4.30 4:0c89e311:::100000001f8.00000017:head [write 2134016~4096,write 2150400~4096,write 2207744~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:48.632 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.939330+0000", 2023-09-30T17:03:48.632 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.5195885980000003, 2023-09-30T17:03:48.632 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.200392818, 2023-09-30T17:03:48.632 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:48.632 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:48.632 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:48.633 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:48.633 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:48.633 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24247 2023-09-30T17:03:48.633 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.633 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:48.633 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.633 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:48.633 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939330+0000", 2023-09-30T17:03:48.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:48.633 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.633 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.633 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:48.634 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939330+0000", 2023-09-30T17:03:48.634 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:48.634 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.634 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:48.634 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939330+0000", 2023-09-30T17:03:48.634 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7500000000000001e-07 2023-09-30T17:03:48.634 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.634 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:48.634 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939339+0000", 2023-09-30T17:03:48.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6719999999999993e-06 2023-09-30T17:03:48.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:48.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939342+0000", 2023-09-30T17:03:48.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4170000000000001e-06 2023-09-30T17:03:48.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:48.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939345+0000", 2023-09-30T17:03:48.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7190000000000001e-06 2023-09-30T17:03:48.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:48.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.126008+0000", 2023-09-30T17:03:48.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.18666300499999999 2023-09-30T17:03:48.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:48.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.126132+0000", 2023-09-30T17:03:48.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012387800000000001 2023-09-30T17:03:48.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:48.637 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.139635+0000", 2023-09-30T17:03:48.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013502739 2023-09-30T17:03:48.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.637 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:48.637 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.139669+0000", 2023-09-30T17:03:48.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3810000000000003e-05 2023-09-30T17:03:48.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.637 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:48.637 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.139723+0000", 2023-09-30T17:03:48.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4302999999999998e-05 2023-09-30T17:03:48.638 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.638 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:48.638 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.638 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.638 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24272 4.38 4:1fc350da:::100000001f8.0000002f:head [write 638976~4096,write 843776~4096,write 864256~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:48.638 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.939523+0000", 2023-09-30T17:03:48.638 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.5193956899999996, 2023-09-30T17:03:48.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.19876761700000001, 2023-09-30T17:03:48.638 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:48.638 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:48.638 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:48.639 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:48.639 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:48.639 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24272 2023-09-30T17:03:48.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.639 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:48.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:48.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939523+0000", 2023-09-30T17:03:48.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:48.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:48.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939523+0000", 2023-09-30T17:03:48.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:48.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:48.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939523+0000", 2023-09-30T17:03:48.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6199999999999999e-07 2023-09-30T17:03:48.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:48.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939538+0000", 2023-09-30T17:03:48.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5122e-05 2023-09-30T17:03:48.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:48.641 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939544+0000", 2023-09-30T17:03:48.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.327e-06 2023-09-30T17:03:48.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:48.641 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939549+0000", 2023-09-30T17:03:48.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8130000000000003e-06 2023-09-30T17:03:48.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.642 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:48.642 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.123535+0000", 2023-09-30T17:03:48.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.18398595700000001 2023-09-30T17:03:48.642 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.642 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.642 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:48.642 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.123962+0000", 2023-09-30T17:03:48.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000427136 2023-09-30T17:03:48.642 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.642 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.642 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:48.642 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.138167+0000", 2023-09-30T17:03:48.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014205096 2023-09-30T17:03:48.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.643 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:48.643 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.138217+0000", 2023-09-30T17:03:48.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0241999999999998e-05 2023-09-30T17:03:48.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.643 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:48.643 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.138291+0000", 2023-09-30T17:03:48.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3561999999999998e-05 2023-09-30T17:03:48.643 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.644 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:48.644 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.644 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.644 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24277 4.38 4:1fc350da:::100000001f8.0000002f:head [write 1036288~4096,write 1122304~4096,write 1220608~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:48.644 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.939581+0000", 2023-09-30T17:03:48.644 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.5193379159999996, 2023-09-30T17:03:48.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.200284616, 2023-09-30T17:03:48.644 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:48.644 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:48.644 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:48.644 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:48.644 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:48.645 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24277 2023-09-30T17:03:48.645 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.645 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:48.645 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.645 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:48.645 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939581+0000", 2023-09-30T17:03:48.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:48.645 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.645 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.645 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:48.645 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939581+0000", 2023-09-30T17:03:48.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:48.646 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.646 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.646 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:48.646 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939581+0000", 2023-09-30T17:03:48.646 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4499999999999998e-07 2023-09-30T17:03:48.646 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.646 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.646 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:48.646 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939596+0000", 2023-09-30T17:03:48.646 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5007999999999999e-05 2023-09-30T17:03:48.646 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.647 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:48.647 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939600+0000", 2023-09-30T17:03:48.647 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6859999999999999e-06 2023-09-30T17:03:48.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.647 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:48.647 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939603+0000", 2023-09-30T17:03:48.647 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8700000000000001e-06 2023-09-30T17:03:48.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.649 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:48.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.129152+0000", 2023-09-30T17:03:48.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.18954922599999999 2023-09-30T17:03:48.650 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.650 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.650 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:48.650 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.129238+0000", 2023-09-30T17:03:48.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6446000000000005e-05 2023-09-30T17:03:48.650 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.650 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.650 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:48.650 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.139771+0000", 2023-09-30T17:03:48.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010532674000000001 2023-09-30T17:03:48.650 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.651 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:48.651 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.139819+0000", 2023-09-30T17:03:48.651 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7633999999999998e-05 2023-09-30T17:03:48.651 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:48.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:48.651 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:48.651 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.139865+0000", 2023-09-30T17:03:48.651 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6826999999999997e-05 2023-09-30T17:03:48.651 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.651 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:48.651 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.652 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:48.652 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:48.652 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:48.653 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:03:48.655 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:48.653+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:48.754 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:48.755+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:48.849 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:48.849 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:03:48.849 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.849 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:51693 4.6 4:616d4c41:::100000001f8.00000034:head [write 3252224~4096 in=4096b,write 3358720~4096 in=4096b,write 3522560~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-09-30T17:03:48.850 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:48.839925+0000", 2023-09-30T17:03:48.850 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0075533869999999999, 2023-09-30T17:03:48.850 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0075820210000000004, 2023-09-30T17:03:48.850 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:48.850 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:48.850 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:48.850 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:48.850 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:48.850 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 51693 2023-09-30T17:03:48.850 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.850 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:48.851 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.851 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:48.851 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.839925+0000", 2023-09-30T17:03:48.851 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:48.851 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.851 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.851 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:48.851 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.839925+0000", 2023-09-30T17:03:48.851 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:48.851 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.851 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.852 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:48.852 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.839926+0000", 2023-09-30T17:03:48.852 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1200000000000002e-07 2023-09-30T17:03:48.852 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.852 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.852 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:48.852 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.839939+0000", 2023-09-30T17:03:48.852 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2485e-05 2023-09-30T17:03:48.852 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.852 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.852 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:48.852 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.839948+0000", 2023-09-30T17:03:48.853 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.0040000000000005e-06 2023-09-30T17:03:48.853 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.853 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.853 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:48.853 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.839953+0000", 2023-09-30T17:03:48.853 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4530000000000001e-06 2023-09-30T17:03:48.853 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.853 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.853 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:48.853 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.840002+0000", 2023-09-30T17:03:48.853 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8714999999999997e-05 2023-09-30T17:03:48.853 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.854 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.854 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:48.854 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.840088+0000", 2023-09-30T17:03:48.854 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.6582000000000006e-05 2023-09-30T17:03:48.854 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.854 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.854 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:48.854 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.840256+0000", 2023-09-30T17:03:48.854 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016803400000000001 2023-09-30T17:03:48.854 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.855 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.855 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:48.855 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.844284+0000", 2023-09-30T17:03:48.855 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0040276089999999997 2023-09-30T17:03:48.855 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:48.855 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:48.855 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:48.855 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.855 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.855 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:51695 4.36 4:6da220e6:::100000001f8.0000003f:head [write 2084864~4096 in=4096b,write 2187264~4096 in=4096b,write 2236416~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-09-30T17:03:48.855 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:48.840599+0000", 2023-09-30T17:03:48.855 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0068800049999999998, 2023-09-30T17:03:48.856 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0070232610000000003, 2023-09-30T17:03:48.856 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:48.856 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:48.856 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:48.856 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:48.856 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:48.856 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 51695 2023-09-30T17:03:48.856 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.856 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:48.856 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.856 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:48.856 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.840599+0000", 2023-09-30T17:03:48.857 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:48.857 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.857 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.857 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:48.857 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.840599+0000", 2023-09-30T17:03:48.857 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:48.857 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.857 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.857 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:48.857 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.840599+0000", 2023-09-30T17:03:48.857 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.6000000000000003e-07 2023-09-30T17:03:48.858 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.858 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.858 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:48.858 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.840611+0000", 2023-09-30T17:03:48.858 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1902000000000001e-05 2023-09-30T17:03:48.858 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.858 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.858 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:48.858 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.840622+0000", 2023-09-30T17:03:48.858 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0176999999999999e-05 2023-09-30T17:03:48.858 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.858 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.859 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:48.859 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.840627+0000", 2023-09-30T17:03:48.859 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0649999999999998e-06 2023-09-30T17:03:48.859 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.859 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.859 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:48.859 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.842007+0000", 2023-09-30T17:03:48.859 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0013800469999999999 2023-09-30T17:03:48.859 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.859 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.859 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:48.859 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.842088+0000", 2023-09-30T17:03:48.859 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1357e-05 2023-09-30T17:03:48.860 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.860 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.860 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:48.860 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.842256+0000", 2023-09-30T17:03:48.860 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016753800000000001 2023-09-30T17:03:48.860 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.860 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.860 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:48.860 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.845803+0000", 2023-09-30T17:03:48.860 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.003547887 2023-09-30T17:03:48.860 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:48.860 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:48.861 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:48.861 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.861 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.861 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:51701 4.2f e44/17 4:f59f865b:::100000001f8.00000007:head v 44'762, mlcod=44'760)", 2023-09-30T17:03:48.861 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:48.842741+0000", 2023-09-30T17:03:48.861 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0047379910000000004, 2023-09-30T17:03:48.861 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.004967689, 2023-09-30T17:03:48.861 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:48.861 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:48.861 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:48.861 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.861 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:48.862 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.842741+0000", 2023-09-30T17:03:48.862 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:48.862 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.862 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.862 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:48.862 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.842741+0000", 2023-09-30T17:03:48.862 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:48.862 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.862 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.862 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:48.862 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.842741+0000", 2023-09-30T17:03:48.862 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8599999999999998e-07 2023-09-30T17:03:48.863 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.863 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.863 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:48.863 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.842757+0000", 2023-09-30T17:03:48.863 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5937999999999999e-05 2023-09-30T17:03:48.863 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.863 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.863 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:48.863 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.842767+0000", 2023-09-30T17:03:48.863 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.4059999999999994e-06 2023-09-30T17:03:48.863 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.863 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.864 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:48.864 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.842774+0000", 2023-09-30T17:03:48.864 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0439999999999998e-06 2023-09-30T17:03:48.864 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.864 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.864 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:48.864 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.842817+0000", 2023-09-30T17:03:48.864 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2755e-05 2023-09-30T17:03:48.864 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.864 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.864 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:48.864 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.842831+0000", 2023-09-30T17:03:48.864 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4834000000000001e-05 2023-09-30T17:03:48.865 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:48.865 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:48.865 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:48.865 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.865 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.865 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:51704 4.f e44/17 4:f2a80dfe:::100000001f8.00000019:head v 44'2435, mlcod=44'2433)", 2023-09-30T17:03:48.865 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:48.843665+0000", 2023-09-30T17:03:48.865 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0038142390000000001, 2023-09-30T17:03:48.865 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0041060589999999996, 2023-09-30T17:03:48.865 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:48.865 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:48.865 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:48.866 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.866 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:48.866 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.843665+0000", 2023-09-30T17:03:48.866 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:48.866 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.866 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.866 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:48.866 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.843665+0000", 2023-09-30T17:03:48.866 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:48.866 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.866 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.867 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:48.867 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.843665+0000", 2023-09-30T17:03:48.867 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0500000000000003e-07 2023-09-30T17:03:48.867 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.867 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.867 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:48.867 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.843680+0000", 2023-09-30T17:03:48.867 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4824000000000001e-05 2023-09-30T17:03:48.867 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.867 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.867 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:48.867 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.843689+0000", 2023-09-30T17:03:48.868 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.7229999999999993e-06 2023-09-30T17:03:48.868 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.868 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.868 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:48.868 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.843696+0000", 2023-09-30T17:03:48.868 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8070000000000002e-06 2023-09-30T17:03:48.868 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.868 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.868 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:48.868 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.843751+0000", 2023-09-30T17:03:48.868 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5003000000000002e-05 2023-09-30T17:03:48.869 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.869 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.869 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:48.869 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.843766+0000", 2023-09-30T17:03:48.869 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5897999999999999e-05 2023-09-30T17:03:48.869 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:48.869 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:48.869 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:48.869 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.869 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.869 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:51702 4.3 4:c222b65c:::100000001f8.00000021:head [write 569344~4096 in=4096b,write 614400~4096 in=4096b,write 835584~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-09-30T17:03:48.869 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:48.843762+0000", 2023-09-30T17:03:48.870 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0037172609999999999, 2023-09-30T17:03:48.870 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0040907460000000001, 2023-09-30T17:03:48.870 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:48.870 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:48.870 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:48.870 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:48.870 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:48.870 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 51702 2023-09-30T17:03:48.870 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.870 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:48.870 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.870 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:48.871 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.843762+0000", 2023-09-30T17:03:48.871 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:48.871 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.871 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.871 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:48.871 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.843762+0000", 2023-09-30T17:03:48.871 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:48.871 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.871 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.871 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:48.871 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.843763+0000", 2023-09-30T17:03:48.871 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.4499999999999995e-07 2023-09-30T17:03:48.872 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.872 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.872 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:48.872 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.843776+0000", 2023-09-30T17:03:48.872 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2999e-05 2023-09-30T17:03:48.872 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.872 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.872 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:48.872 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.843787+0000", 2023-09-30T17:03:48.872 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1969e-05 2023-09-30T17:03:48.872 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.872 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.873 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:48.873 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.843796+0000", 2023-09-30T17:03:48.873 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4100000000000008e-06 2023-09-30T17:03:48.873 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.873 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.873 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:48.873 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.843847+0000", 2023-09-30T17:03:48.873 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1227000000000003e-05 2023-09-30T17:03:48.873 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.873 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.873 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:48.874 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.843910+0000", 2023-09-30T17:03:48.874 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3258999999999999e-05 2023-09-30T17:03:48.874 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:48.874 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:48.874 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:48.874 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.874 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.874 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:51703 4.1c 4:39b842ef:::100000001f8.00000029:head [write 3706880~4096 in=4096b,write 3760128~4096 in=4096b,write 3772416~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-09-30T17:03:48.874 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:48.843815+0000", 2023-09-30T17:03:48.874 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0036633730000000002, 2023-09-30T17:03:48.874 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0041266059999999997, 2023-09-30T17:03:48.874 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:48.875 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:48.875 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:48.875 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:48.875 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:48.875 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 51703 2023-09-30T17:03:48.875 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.875 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:48.875 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.875 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:48.875 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.843815+0000", 2023-09-30T17:03:48.875 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:48.875 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.876 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.876 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:48.876 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.843815+0000", 2023-09-30T17:03:48.876 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:48.876 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.876 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.876 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:48.876 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.843830+0000", 2023-09-30T17:03:48.876 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4671999999999999e-05 2023-09-30T17:03:48.876 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.876 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.876 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:48.877 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.843850+0000", 2023-09-30T17:03:48.877 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9848e-05 2023-09-30T17:03:48.877 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.877 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.877 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:48.877 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.843861+0000", 2023-09-30T17:03:48.877 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0864e-05 2023-09-30T17:03:48.877 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.877 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.877 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:48.877 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.843868+0000", 2023-09-30T17:03:48.877 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0099999999999998e-06 2023-09-30T17:03:48.877 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.878 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.878 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:48.878 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.843918+0000", 2023-09-30T17:03:48.878 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0096000000000003e-05 2023-09-30T17:03:48.878 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.878 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.878 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:48.878 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.843994+0000", 2023-09-30T17:03:48.878 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5813000000000001e-05 2023-09-30T17:03:48.878 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.878 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.879 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:48.879 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.844136+0000", 2023-09-30T17:03:48.879 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014176299999999999 2023-09-30T17:03:48.879 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:48.879 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:48.879 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:48.879 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.879 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.879 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:51706 4.24 4:27adda6e:::100000001f8.0000000f:head [write 106496~4096 in=4096b,write 131072~4096 in=4096b,write 229376~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-09-30T17:03:48.879 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:48.843885+0000", 2023-09-30T17:03:48.879 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0035940680000000002, 2023-09-30T17:03:48.879 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0041465149999999999, 2023-09-30T17:03:48.880 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:48.880 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:48.880 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:48.880 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:48.880 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:48.880 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 51706 2023-09-30T17:03:48.880 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.880 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:48.880 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.880 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:48.880 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.843885+0000", 2023-09-30T17:03:48.880 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:48.881 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.881 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.881 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:48.881 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.843885+0000", 2023-09-30T17:03:48.881 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:48.881 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.881 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.881 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:48.881 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.843885+0000", 2023-09-30T17:03:48.881 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3499999999999996e-07 2023-09-30T17:03:48.881 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.881 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.882 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:48.882 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.843897+0000", 2023-09-30T17:03:48.882 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1601e-05 2023-09-30T17:03:48.882 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.882 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.882 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:48.882 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.843906+0000", 2023-09-30T17:03:48.882 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5839999999999995e-06 2023-09-30T17:03:48.882 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.882 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.882 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:48.883 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.843912+0000", 2023-09-30T17:03:48.883 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0240000000000003e-06 2023-09-30T17:03:48.883 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.883 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.883 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:48.883 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.843957+0000", 2023-09-30T17:03:48.883 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5593000000000002e-05 2023-09-30T17:03:48.883 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.883 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.883 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:48.883 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.844030+0000", 2023-09-30T17:03:48.883 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2657000000000006e-05 2023-09-30T17:03:48.884 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:48.884 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:48.884 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:48.884 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.884 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.884 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:51707 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 2052096~4096 in=4096b,write 2068480~4096 in=4096b,write 2101248~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-09-30T17:03:48.884 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:48.844246+0000", 2023-09-30T17:03:48.884 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0032325679999999999, 2023-09-30T17:03:48.884 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0038736439999999999, 2023-09-30T17:03:48.884 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:48.884 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:48.884 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:48.885 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:48.885 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:48.885 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 51707 2023-09-30T17:03:48.885 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.885 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:48.885 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.885 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:48.885 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.844246+0000", 2023-09-30T17:03:48.885 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:48.885 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.885 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.885 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:48.886 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.844246+0000", 2023-09-30T17:03:48.886 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:48.886 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.886 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.886 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:48.886 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.844247+0000", 2023-09-30T17:03:48.886 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3300000000000001e-07 2023-09-30T17:03:48.886 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.886 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.886 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:48.886 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.844258+0000", 2023-09-30T17:03:48.887 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1141000000000001e-05 2023-09-30T17:03:48.887 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.887 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.887 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:48.887 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.844269+0000", 2023-09-30T17:03:48.887 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1048e-05 2023-09-30T17:03:48.887 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.887 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.887 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:48.888 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.844277+0000", 2023-09-30T17:03:48.888 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.418e-06 2023-09-30T17:03:48.888 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.888 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.888 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:48.888 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.844317+0000", 2023-09-30T17:03:48.888 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0499e-05 2023-09-30T17:03:48.888 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.888 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.888 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:48.888 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.844393+0000", 2023-09-30T17:03:48.889 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6083999999999999e-05 2023-09-30T17:03:48.889 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.889 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.889 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:48.889 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.844554+0000", 2023-09-30T17:03:48.889 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016074500000000001 2023-09-30T17:03:48.889 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.889 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.889 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:48.889 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.847366+0000", 2023-09-30T17:03:48.889 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0028119379999999999 2023-09-30T17:03:48.889 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:48.890 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:48.890 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:48.890 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.890 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.890 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:51710 4.34 4:2d2c9530:::100000001f8.00000036:head [write 3641344~4096 in=4096b,write 3649536~4096 in=4096b,write 3731456~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-09-30T17:03:48.890 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:48.845185+0000", 2023-09-30T17:03:48.890 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0022942930000000002, 2023-09-30T17:03:48.890 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0030707999999999998, 2023-09-30T17:03:48.890 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:48.893 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:48.893 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:48.893 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:48.893 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:48.893 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 51710 2023-09-30T17:03:48.893 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.893 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:48.893 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.893 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:48.893 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.845185+0000", 2023-09-30T17:03:48.893 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:48.894 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.894 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.894 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:48.894 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.845185+0000", 2023-09-30T17:03:48.894 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:48.894 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.894 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.894 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:48.894 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.845186+0000", 2023-09-30T17:03:48.894 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0139999999999999e-06 2023-09-30T17:03:48.894 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.894 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.895 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:48.895 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.845197+0000", 2023-09-30T17:03:48.895 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1897e-05 2023-09-30T17:03:48.895 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.895 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.895 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:48.895 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.845214+0000", 2023-09-30T17:03:48.895 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6070999999999999e-05 2023-09-30T17:03:48.895 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.895 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.895 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:48.896 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.845223+0000", 2023-09-30T17:03:48.896 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3719999999999994e-06 2023-09-30T17:03:48.896 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.896 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.896 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:48.896 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.845504+0000", 2023-09-30T17:03:48.896 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00028093200000000001 2023-09-30T17:03:48.896 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.896 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.896 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:48.896 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.845573+0000", 2023-09-30T17:03:48.897 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9679999999999997e-05 2023-09-30T17:03:48.897 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:48.897 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:48.897 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:48.897 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.897 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.897 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:51712 4.d 4:b1164065:::100000001f8.00000035:head [write 1626112~4096 in=4096b,write 1662976~4096 in=4096b,write 1818624~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-09-30T17:03:48.897 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:48.845740+0000", 2023-09-30T17:03:48.897 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.001738465, 2023-09-30T17:03:48.897 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0026143669999999998, 2023-09-30T17:03:48.897 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:48.897 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:48.898 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:48.898 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:48.898 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:48.898 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 51712 2023-09-30T17:03:48.898 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.898 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:48.898 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.898 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:48.898 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.845740+0000", 2023-09-30T17:03:48.898 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:48.898 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.898 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.899 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:48.899 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.845740+0000", 2023-09-30T17:03:48.899 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:48.899 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.899 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.899 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:48.899 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.845741+0000", 2023-09-30T17:03:48.899 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.0999999999999997e-07 2023-09-30T17:03:48.899 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.899 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.899 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:48.899 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.845765+0000", 2023-09-30T17:03:48.900 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.3805e-05 2023-09-30T17:03:48.900 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.900 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.900 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:48.900 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.845781+0000", 2023-09-30T17:03:48.900 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5620999999999998e-05 2023-09-30T17:03:48.900 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.900 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.901 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:48.901 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.845789+0000", 2023-09-30T17:03:48.901 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.653e-06 2023-09-30T17:03:48.901 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.901 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.901 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:48.901 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.845837+0000", 2023-09-30T17:03:48.901 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8035999999999999e-05 2023-09-30T17:03:48.901 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.901 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.901 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:48.901 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.845886+0000", 2023-09-30T17:03:48.902 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8609999999999997e-05 2023-09-30T17:03:48.902 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:48.902 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:48.902 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:48.902 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.902 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.902 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:51714 4.1c 4:39b842ef:::100000001f8.00000029:head [write 1998848~4096 in=4096b,write 2482176~4096 in=4096b,write 2756608~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-09-30T17:03:48.902 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:48.846334+0000", 2023-09-30T17:03:48.902 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.001144412, 2023-09-30T17:03:48.902 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0020960530000000001, 2023-09-30T17:03:48.902 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:48.902 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:48.903 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:48.903 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:48.903 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:48.903 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 51714 2023-09-30T17:03:48.903 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.903 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:48.903 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.903 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:48.903 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.846334+0000", 2023-09-30T17:03:48.903 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:48.903 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.904 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.904 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:48.904 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.846334+0000", 2023-09-30T17:03:48.904 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:48.904 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.904 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.904 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:48.904 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.846335+0000", 2023-09-30T17:03:48.904 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1699999999999997e-07 2023-09-30T17:03:48.904 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.904 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.905 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:48.905 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.846350+0000", 2023-09-30T17:03:48.905 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4501000000000001e-05 2023-09-30T17:03:48.905 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.905 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.905 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:48.905 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.846367+0000", 2023-09-30T17:03:48.905 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6895e-05 2023-09-30T17:03:48.905 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.905 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.905 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:48.906 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.846376+0000", 2023-09-30T17:03:48.906 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8559999999999996e-06 2023-09-30T17:03:48.906 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.906 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.906 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:48.906 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.846422+0000", 2023-09-30T17:03:48.906 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6292999999999999e-05 2023-09-30T17:03:48.906 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.906 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.906 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:48.906 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.846502+0000", 2023-09-30T17:03:48.907 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0574000000000005e-05 2023-09-30T17:03:48.907 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.907 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.907 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:48.907 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.846672+0000", 2023-09-30T17:03:48.907 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016985399999999999 2023-09-30T17:03:48.907 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:48.907 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:48.907 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:48.907 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.907 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.907 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:51713 4.2d e44/17 4:b7099a35:::100000001f8.0000000e:head v 44'1571, mlcod=44'1569)", 2023-09-30T17:03:48.908 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:48.846378+0000", 2023-09-30T17:03:48.908 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0011004000000000001, 2023-09-30T17:03:48.908 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0021271549999999999, 2023-09-30T17:03:48.908 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:48.908 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:48.908 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:48.908 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.908 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:48.908 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.846378+0000", 2023-09-30T17:03:48.908 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:48.908 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.908 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.909 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:48.909 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.846378+0000", 2023-09-30T17:03:48.909 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:48.909 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.909 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.909 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:48.909 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.846379+0000", 2023-09-30T17:03:48.909 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7599999999999997e-07 2023-09-30T17:03:48.909 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.909 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.909 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:48.910 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.846388+0000", 2023-09-30T17:03:48.910 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.4590000000000004e-06 2023-09-30T17:03:48.910 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.910 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.910 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:48.910 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.846398+0000", 2023-09-30T17:03:48.910 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7319999999999993e-06 2023-09-30T17:03:48.910 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.910 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.910 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:48.910 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.846405+0000", 2023-09-30T17:03:48.910 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2230000000000001e-06 2023-09-30T17:03:48.910 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.911 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.911 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:48.911 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.846459+0000", 2023-09-30T17:03:48.911 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3310000000000003e-05 2023-09-30T17:03:48.911 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.911 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.911 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:48.911 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.846479+0000", 2023-09-30T17:03:48.911 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.0273000000000001e-05 2023-09-30T17:03:48.911 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:48.911 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:48.911 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:48.911 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.912 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.912 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:51715 4.2a 4:57147dc3:::100000001f8.00000011:head [write 1359872~4096 in=4096b,write 1388544~4096 in=4096b,write 1462272~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-09-30T17:03:48.912 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:48.846580+0000", 2023-09-30T17:03:48.912 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.00089886700000000003, 2023-09-30T17:03:48.912 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001991432, 2023-09-30T17:03:48.912 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:48.912 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:48.912 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:48.912 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:48.912 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:48.912 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 51715 2023-09-30T17:03:48.912 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.913 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:48.913 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.913 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:48.913 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.846580+0000", 2023-09-30T17:03:48.913 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:48.913 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.913 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.913 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:48.913 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.846580+0000", 2023-09-30T17:03:48.913 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:48.913 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.913 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.913 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:48.914 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.846581+0000", 2023-09-30T17:03:48.914 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1699999999999997e-07 2023-09-30T17:03:48.914 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.914 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.914 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:48.914 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.846596+0000", 2023-09-30T17:03:48.914 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5332000000000002e-05 2023-09-30T17:03:48.914 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.914 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.914 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:48.914 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.846608+0000", 2023-09-30T17:03:48.914 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1698e-05 2023-09-30T17:03:48.915 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.915 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.915 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:48.915 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.846616+0000", 2023-09-30T17:03:48.915 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7889999999999995e-06 2023-09-30T17:03:48.915 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.915 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.915 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:48.915 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.846686+0000", 2023-09-30T17:03:48.915 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0581999999999996e-05 2023-09-30T17:03:48.916 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.916 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.916 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:48.916 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.846772+0000", 2023-09-30T17:03:48.916 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5737999999999998e-05 2023-09-30T17:03:48.916 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:48.916 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:48.916 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:48.916 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.916 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.916 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:51716 4.23 e44/17 4:c6f90462:::100000001f8.00000037:head v 44'795, mlcod=44'793)", 2023-09-30T17:03:48.917 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:48.847210+0000", 2023-09-30T17:03:48.917 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.00026852100000000003, 2023-09-30T17:03:48.917 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0014351050000000001, 2023-09-30T17:03:48.917 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:48.917 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:48.917 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:48.917 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.917 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:48.917 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.847210+0000", 2023-09-30T17:03:48.917 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:48.917 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.918 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.918 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:48.918 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.847210+0000", 2023-09-30T17:03:48.918 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:48.918 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.918 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.918 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:48.918 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.847211+0000", 2023-09-30T17:03:48.918 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3900000000000004e-07 2023-09-30T17:03:48.918 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.918 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.919 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:48.919 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.847225+0000", 2023-09-30T17:03:48.919 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3575e-05 2023-09-30T17:03:48.919 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.919 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.919 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:48.919 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.847245+0000", 2023-09-30T17:03:48.919 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.0477000000000001e-05 2023-09-30T17:03:48.919 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.919 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.919 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:48.919 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.847252+0000", 2023-09-30T17:03:48.920 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9430000000000003e-06 2023-09-30T17:03:48.920 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.920 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.920 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:48.920 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.847327+0000", 2023-09-30T17:03:48.920 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4739000000000004e-05 2023-09-30T17:03:48.920 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.920 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.920 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:48.920 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.847345+0000", 2023-09-30T17:03:48.920 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8210999999999999e-05 2023-09-30T17:03:48.921 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:48.921 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:48.921 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:48.921 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.921 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.921 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:51718 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 3612672~4096 in=4096b,write 3665920~4096 in=4096b,write 3772416~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-09-30T17:03:48.921 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:48.847561+0000", 2023-09-30T17:03:48.921 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.999918, 2023-09-30T17:03:48.921 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0011582179999999999, 2023-09-30T17:03:48.921 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:48.922 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:48.922 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:48.922 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:48.922 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:48.922 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 51718 2023-09-30T17:03:48.922 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.922 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:48.922 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.922 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:48.922 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.847561+0000", 2023-09-30T17:03:48.923 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:48.923 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.923 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.923 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:48.923 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.847561+0000", 2023-09-30T17:03:48.923 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:48.923 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.923 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.923 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:48.923 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.847562+0000", 2023-09-30T17:03:48.923 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4900000000000005e-07 2023-09-30T17:03:48.923 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.924 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.924 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:48.924 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.847575+0000", 2023-09-30T17:03:48.924 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3200999999999999e-05 2023-09-30T17:03:48.924 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.924 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.924 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:48.924 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.847587+0000", 2023-09-30T17:03:48.924 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2028000000000001e-05 2023-09-30T17:03:48.924 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.924 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.925 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:48.925 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.847592+0000", 2023-09-30T17:03:48.925 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4439999999999999e-06 2023-09-30T17:03:48.925 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.925 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.925 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:48.925 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.847642+0000", 2023-09-30T17:03:48.925 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9530000000000002e-05 2023-09-30T17:03:48.926 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.926 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.926 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:48.926 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.847722+0000", 2023-09-30T17:03:48.926 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9783999999999994e-05 2023-09-30T17:03:48.926 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.926 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.926 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:48.926 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.847843+0000", 2023-09-30T17:03:48.926 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00012116999999999999 2023-09-30T17:03:48.926 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:48.927 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:48.927 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:48.927 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.927 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.927 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:51717 4.2d e44/17 4:b7099a35:::100000001f8.0000000e:head v 44'1572, mlcod=44'1569)", 2023-09-30T17:03:48.927 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:48.847775+0000", 2023-09-30T17:03:48.927 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.9997039, 2023-09-30T17:03:48.927 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0010202200000000001, 2023-09-30T17:03:48.927 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:48.927 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:48.927 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:48.928 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.928 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:48.928 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.847775+0000", 2023-09-30T17:03:48.928 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:48.928 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.928 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.928 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:48.928 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.847775+0000", 2023-09-30T17:03:48.928 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:48.928 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.928 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.928 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:48.929 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.847775+0000", 2023-09-30T17:03:48.929 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7000000000000005e-07 2023-09-30T17:03:48.929 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.929 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.929 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:48.929 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.847788+0000", 2023-09-30T17:03:48.929 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2680999999999999e-05 2023-09-30T17:03:48.929 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.929 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.929 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:48.929 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.847798+0000", 2023-09-30T17:03:48.929 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.859e-06 2023-09-30T17:03:48.930 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.930 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.930 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:48.930 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.847802+0000", 2023-09-30T17:03:48.930 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5700000000000003e-06 2023-09-30T17:03:48.930 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.930 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.930 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:48.930 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.848098+0000", 2023-09-30T17:03:48.930 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00029535800000000001 2023-09-30T17:03:48.930 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.930 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.931 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:48.931 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.848117+0000", 2023-09-30T17:03:48.931 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8859999999999999e-05 2023-09-30T17:03:48.931 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:48.931 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:48.931 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:48.931 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.931 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.931 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:51720 4.28 4:15eeb89b:::100000001f8.00000032:head [write 2768896~4096 in=4096b,write 3203072~4096 in=4096b,write 3244032~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-09-30T17:03:48.931 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:48.848244+0000", 2023-09-30T17:03:48.931 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.9992352, 2023-09-30T17:03:48.931 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00062101099999999998, 2023-09-30T17:03:48.932 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:48.932 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:48.932 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:48.932 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:48.932 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:48.932 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 51720 2023-09-30T17:03:48.932 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.932 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:48.932 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.932 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:48.932 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.848244+0000", 2023-09-30T17:03:48.932 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:48.933 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.933 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.933 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:48.933 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.848244+0000", 2023-09-30T17:03:48.933 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:48.933 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.933 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.933 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:48.933 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.848244+0000", 2023-09-30T17:03:48.933 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5899999999999996e-07 2023-09-30T17:03:48.933 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.933 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.933 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:48.934 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.848256+0000", 2023-09-30T17:03:48.934 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1432e-05 2023-09-30T17:03:48.934 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.934 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.934 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:48.934 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.848265+0000", 2023-09-30T17:03:48.934 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.4320000000000005e-06 2023-09-30T17:03:48.934 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.934 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.934 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:48.934 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.848274+0000", 2023-09-30T17:03:48.935 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3510000000000002e-06 2023-09-30T17:03:48.935 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.935 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.935 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:48.935 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.848327+0000", 2023-09-30T17:03:48.935 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2930000000000003e-05 2023-09-30T17:03:48.935 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.935 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.935 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:48.935 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.848406+0000", 2023-09-30T17:03:48.935 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9963999999999995e-05 2023-09-30T17:03:48.936 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.936 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.936 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:48.936 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.848566+0000", 2023-09-30T17:03:48.936 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000159672 2023-09-30T17:03:48.936 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:48.936 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:48.936 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:48.936 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.936 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.936 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:51721 4.14 4:2b28d75f:::100000001f8.00000016:head [write 1568768~4096 in=4096b,write 1581056~4096 in=4096b,write 1589248~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e44)", 2023-09-30T17:03:48.936 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:48.848702+0000", 2023-09-30T17:03:48.937 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.9987769, 2023-09-30T17:03:48.937 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00025325599999999999, 2023-09-30T17:03:48.937 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:48.937 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:48.937 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:48.937 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:48.937 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:48.937 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 51721 2023-09-30T17:03:48.937 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.937 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:48.937 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.937 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:48.938 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.848702+0000", 2023-09-30T17:03:48.938 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:48.938 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.938 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.938 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:48.938 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.848702+0000", 2023-09-30T17:03:48.938 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:48.938 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.938 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.938 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:48.938 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.848703+0000", 2023-09-30T17:03:48.939 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6499999999999999e-07 2023-09-30T17:03:48.939 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.939 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.939 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:48.939 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.848714+0000", 2023-09-30T17:03:48.939 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1134e-05 2023-09-30T17:03:48.939 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.939 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.939 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:48.939 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.848726+0000", 2023-09-30T17:03:48.939 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2006e-05 2023-09-30T17:03:48.939 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.940 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.940 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:48.940 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.848746+0000", 2023-09-30T17:03:48.940 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9720000000000001e-05 2023-09-30T17:03:48.940 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.940 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.940 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:48.940 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.848808+0000", 2023-09-30T17:03:48.940 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2686000000000003e-05 2023-09-30T17:03:48.940 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.940 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.940 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:48.941 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.848870+0000", 2023-09-30T17:03:48.941 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1739e-05 2023-09-30T17:03:48.941 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:48.941 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:48.941 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:48.941 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:48.848960+0000", 2023-09-30T17:03:48.941 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.0048000000000002e-05 2023-09-30T17:03:48.941 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:48.941 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:48.941 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:48.941 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:48.941 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-09-30T17:03:48.942 INFO:teuthology.orchestra.run.smithi031.stdout: "num_ops": 18 2023-09-30T17:03:48.942 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:48.943 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:03:48.943 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:48.943+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:49.044 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:49.043+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:49.144 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:49.145+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:49.181 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:49.181 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:03:49.181 INFO:teuthology.orchestra.run.smithi031.stdout: "complaint_time": 30, 2023-09-30T17:03:49.181 INFO:teuthology.orchestra.run.smithi031.stdout: "num_blocked_ops": 0 2023-09-30T17:03:49.181 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:49.195 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:03:49.245 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:49.244+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:49.290 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-09-30T17:03:49.346 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:49.345+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:49.401 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-09-30T17:03:49.432 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:49.432 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 20, 2023-09-30T17:03:49.432 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 600, 2023-09-30T17:03:49.432 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:03:49.432 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.432 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23704 4.14 4:2b28d75f:::100000001f8.00000016:head [write 262144~4096,write 274432~4096,write 405504~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:49.432 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.711008+0000", 2023-09-30T17:03:49.433 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 10.719200446, 2023-09-30T17:03:49.433 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.229109541, 2023-09-30T17:03:49.433 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:49.433 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:49.433 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:49.433 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:49.433 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:49.433 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23704 2023-09-30T17:03:49.433 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.433 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:49.433 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.433 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:49.434 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711008+0000", 2023-09-30T17:03:49.434 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:49.434 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.434 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.434 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:49.434 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711008+0000", 2023-09-30T17:03:49.434 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:49.434 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.434 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.434 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:49.434 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711009+0000", 2023-09-30T17:03:49.434 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5899999999999995e-07 2023-09-30T17:03:49.435 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.435 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.435 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:49.435 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711042+0000", 2023-09-30T17:03:49.435 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3149999999999999e-05 2023-09-30T17:03:49.435 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.435 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.435 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:49.435 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711054+0000", 2023-09-30T17:03:49.435 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1742999999999999e-05 2023-09-30T17:03:49.435 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.436 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.436 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:49.436 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711059+0000", 2023-09-30T17:03:49.436 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3009999999999997e-06 2023-09-30T17:03:49.436 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.436 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.436 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:49.436 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711120+0000", 2023-09-30T17:03:49.436 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1228000000000004e-05 2023-09-30T17:03:49.436 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.436 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.436 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:49.437 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711205+0000", 2023-09-30T17:03:49.437 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4489999999999999e-05 2023-09-30T17:03:49.437 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.437 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.437 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:49.437 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711371+0000", 2023-09-30T17:03:49.437 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016639500000000001 2023-09-30T17:03:49.437 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.437 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.437 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:49.437 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.716551+0000", 2023-09-30T17:03:49.437 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051799929999999999 2023-09-30T17:03:49.438 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.438 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.438 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:49.438 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.940040+0000", 2023-09-30T17:03:49.438 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22348859800000001 2023-09-30T17:03:49.438 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.438 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.438 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:49.438 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.940080+0000", 2023-09-30T17:03:49.438 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0114999999999998e-05 2023-09-30T17:03:49.439 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.439 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.439 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:49.439 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.940118+0000", 2023-09-30T17:03:49.439 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7768999999999997e-05 2023-09-30T17:03:49.439 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:49.439 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:49.439 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:49.439 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.439 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.439 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23713 4.33 4:cf6d7a6c:::100000001f8.0000000a:head [write 585728~4096,write 925696~4096,write 937984~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:49.439 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.714948+0000", 2023-09-30T17:03:49.440 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 10.715260732000001, 2023-09-30T17:03:49.440 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23061467099999999, 2023-09-30T17:03:49.440 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:49.440 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:49.440 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:49.440 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:49.440 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:49.440 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23713 2023-09-30T17:03:49.440 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.440 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:49.440 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.440 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:49.441 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.714948+0000", 2023-09-30T17:03:49.441 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:49.441 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.441 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.441 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:49.441 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.714948+0000", 2023-09-30T17:03:49.441 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:49.441 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.441 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.441 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:49.441 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.714949+0000", 2023-09-30T17:03:49.441 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1399999999999995e-07 2023-09-30T17:03:49.442 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.442 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.442 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:49.442 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.714961+0000", 2023-09-30T17:03:49.442 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1916000000000001e-05 2023-09-30T17:03:49.442 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.442 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.442 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:49.442 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.714979+0000", 2023-09-30T17:03:49.442 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8070000000000001e-05 2023-09-30T17:03:49.442 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.443 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.443 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:49.443 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.714987+0000", 2023-09-30T17:03:49.443 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4179999999999997e-06 2023-09-30T17:03:49.443 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.443 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.443 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:49.443 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.715034+0000", 2023-09-30T17:03:49.443 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6563999999999997e-05 2023-09-30T17:03:49.443 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.443 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.443 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:49.444 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.715083+0000", 2023-09-30T17:03:49.444 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9310000000000001e-05 2023-09-30T17:03:49.444 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.444 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.444 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:49.444 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.715177+0000", 2023-09-30T17:03:49.444 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3525999999999999e-05 2023-09-30T17:03:49.444 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.444 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.444 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:49.444 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.719724+0000", 2023-09-30T17:03:49.445 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0045477210000000002 2023-09-30T17:03:49.445 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.445 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.445 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:49.445 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.945467+0000", 2023-09-30T17:03:49.445 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22574224500000001 2023-09-30T17:03:49.445 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.445 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.445 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:49.445 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.945524+0000", 2023-09-30T17:03:49.445 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7105999999999998e-05 2023-09-30T17:03:49.445 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.446 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.446 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:49.446 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.945563+0000", 2023-09-30T17:03:49.446 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8881000000000003e-05 2023-09-30T17:03:49.446 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:49.446 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:49.446 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:49.446 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.446 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.446 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23735 4.6 4:616d4c41:::100000001f8.00000034:head [write 991232~4096,write 1040384~4096,write 1200128~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:49.446 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.722398+0000", 2023-09-30T17:03:49.446 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 10.707810376999999, 2023-09-30T17:03:49.447 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.230202669, 2023-09-30T17:03:49.447 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:49.447 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:49.447 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:49.447 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:49.447 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:49.447 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23735 2023-09-30T17:03:49.447 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.447 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:49.447 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.447 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:49.447 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722398+0000", 2023-09-30T17:03:49.447 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:49.448 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.448 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.448 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:49.448 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722398+0000", 2023-09-30T17:03:49.448 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:49.448 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.448 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.448 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:49.448 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722399+0000", 2023-09-30T17:03:49.448 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2799999999999996e-07 2023-09-30T17:03:49.448 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.448 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.449 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:49.449 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722423+0000", 2023-09-30T17:03:49.449 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4134e-05 2023-09-30T17:03:49.449 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.449 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.449 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:49.449 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722429+0000", 2023-09-30T17:03:49.449 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4590000000000003e-06 2023-09-30T17:03:49.449 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.449 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.449 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:49.449 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722434+0000", 2023-09-30T17:03:49.450 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1779999999999996e-06 2023-09-30T17:03:49.450 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.450 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.450 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:49.450 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722490+0000", 2023-09-30T17:03:49.450 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6215999999999998e-05 2023-09-30T17:03:49.450 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.450 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.450 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:49.450 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722600+0000", 2023-09-30T17:03:49.450 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00011017 2023-09-30T17:03:49.451 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.451 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.451 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:49.451 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722769+0000", 2023-09-30T17:03:49.451 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0001695 2023-09-30T17:03:49.451 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.451 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.451 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:49.451 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725807+0000", 2023-09-30T17:03:49.451 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0030372120000000001 2023-09-30T17:03:49.451 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.452 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.452 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:49.452 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.952546+0000", 2023-09-30T17:03:49.452 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22673923600000001 2023-09-30T17:03:49.452 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.452 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.452 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:49.452 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.952579+0000", 2023-09-30T17:03:49.452 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3111000000000002e-05 2023-09-30T17:03:49.452 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.452 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.452 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:49.453 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.952601+0000", 2023-09-30T17:03:49.453 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1925000000000001e-05 2023-09-30T17:03:49.453 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:49.453 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:49.453 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:49.453 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.453 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.453 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23738 4.6 4:616d4c41:::100000001f8.00000034:head [write 3043328~4096,write 3055616~4096,write 3080192~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:49.453 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.723439+0000", 2023-09-30T17:03:49.453 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 10.706769403999999, 2023-09-30T17:03:49.453 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23665340400000001, 2023-09-30T17:03:49.454 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:49.454 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:49.454 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:49.454 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:49.454 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:49.454 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23738 2023-09-30T17:03:49.454 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.454 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:49.454 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.454 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:49.454 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723439+0000", 2023-09-30T17:03:49.455 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:49.455 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.455 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.455 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:49.455 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723439+0000", 2023-09-30T17:03:49.455 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:49.455 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.455 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.455 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:49.455 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723440+0000", 2023-09-30T17:03:49.455 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.23e-07 2023-09-30T17:03:49.455 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.456 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.456 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:49.456 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723452+0000", 2023-09-30T17:03:49.456 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2147000000000001e-05 2023-09-30T17:03:49.456 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.456 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.456 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:49.456 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723461+0000", 2023-09-30T17:03:49.456 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3839999999999997e-06 2023-09-30T17:03:49.456 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.456 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.457 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:49.457 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723465+0000", 2023-09-30T17:03:49.457 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7559999999999999e-06 2023-09-30T17:03:49.457 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.457 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.457 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:49.457 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723924+0000", 2023-09-30T17:03:49.457 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00045910299999999999 2023-09-30T17:03:49.457 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.457 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.457 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:49.457 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723970+0000", 2023-09-30T17:03:49.458 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5126999999999997e-05 2023-09-30T17:03:49.458 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.458 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.458 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:49.458 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724057+0000", 2023-09-30T17:03:49.458 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.7142e-05 2023-09-30T17:03:49.458 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.458 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.458 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:49.458 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.726148+0000", 2023-09-30T17:03:49.458 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.002091449 2023-09-30T17:03:49.459 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.459 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.459 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:49.459 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.960040+0000", 2023-09-30T17:03:49.459 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23389163299999999 2023-09-30T17:03:49.459 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.459 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.459 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:49.459 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.960071+0000", 2023-09-30T17:03:49.459 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.133e-05 2023-09-30T17:03:49.459 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.460 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.460 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:49.460 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.960093+0000", 2023-09-30T17:03:49.460 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1509999999999999e-05 2023-09-30T17:03:49.460 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:49.460 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:49.460 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:49.460 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.460 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.460 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23740 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 3780608~4096,write 3788800~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:49.460 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.723994+0000", 2023-09-30T17:03:49.460 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 10.706214628, 2023-09-30T17:03:49.461 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.234031238, 2023-09-30T17:03:49.461 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:49.461 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:49.461 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:49.461 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:49.461 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:49.461 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23740 2023-09-30T17:03:49.461 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.461 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:49.461 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.461 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:49.461 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723994+0000", 2023-09-30T17:03:49.462 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:49.462 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.462 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.462 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:49.462 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723994+0000", 2023-09-30T17:03:49.462 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:49.462 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.462 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.462 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:49.462 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723995+0000", 2023-09-30T17:03:49.462 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6000000000000003e-07 2023-09-30T17:03:49.463 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.463 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.463 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:49.463 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724004+0000", 2023-09-30T17:03:49.463 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.4909999999999994e-06 2023-09-30T17:03:49.463 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.463 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.463 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:49.463 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724012+0000", 2023-09-30T17:03:49.465 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4590000000000001e-06 2023-09-30T17:03:49.465 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.465 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.465 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:49.465 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724016+0000", 2023-09-30T17:03:49.465 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9890000000000003e-06 2023-09-30T17:03:49.465 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.465 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.465 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:49.465 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724060+0000", 2023-09-30T17:03:49.466 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4339999999999999e-05 2023-09-30T17:03:49.466 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.466 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.466 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:49.466 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724141+0000", 2023-09-30T17:03:49.466 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1384000000000005e-05 2023-09-30T17:03:49.466 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.466 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.466 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:49.466 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724300+0000", 2023-09-30T17:03:49.466 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015870700000000001 2023-09-30T17:03:49.466 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.467 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.467 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:49.467 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.726182+0000", 2023-09-30T17:03:49.467 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0018816060000000001 2023-09-30T17:03:49.467 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.467 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.467 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:49.467 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.957929+0000", 2023-09-30T17:03:49.467 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23174703399999999 2023-09-30T17:03:49.467 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.467 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.467 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:49.468 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.957983+0000", 2023-09-30T17:03:49.468 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4107999999999998e-05 2023-09-30T17:03:49.468 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.468 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.468 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:49.468 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.958025+0000", 2023-09-30T17:03:49.468 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2360000000000001e-05 2023-09-30T17:03:49.468 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:49.468 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:49.468 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:49.468 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.468 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.469 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23746 4.28 4:15eeb89b:::100000001f8.00000032:head [write 3731456~4096,write 3919872~4096,write 3952640~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:49.469 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.725721+0000", 2023-09-30T17:03:49.469 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 10.704487243999999, 2023-09-30T17:03:49.469 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.24024479800000001, 2023-09-30T17:03:49.469 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:49.469 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:49.469 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:49.469 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:49.469 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:49.469 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23746 2023-09-30T17:03:49.469 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.469 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:49.470 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.470 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:49.470 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725721+0000", 2023-09-30T17:03:49.470 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:49.470 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.470 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.470 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:49.470 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725721+0000", 2023-09-30T17:03:49.470 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:49.470 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.470 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.470 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:49.471 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725722+0000", 2023-09-30T17:03:49.471 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6499999999999999e-07 2023-09-30T17:03:49.471 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.471 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.471 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:49.471 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725732+0000", 2023-09-30T17:03:49.471 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7559999999999994e-06 2023-09-30T17:03:49.471 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.471 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.471 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:49.471 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725738+0000", 2023-09-30T17:03:49.471 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8360000000000003e-06 2023-09-30T17:03:49.471 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.472 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.472 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:49.472 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725746+0000", 2023-09-30T17:03:49.472 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4200000000000001e-06 2023-09-30T17:03:49.472 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.472 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.472 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:49.472 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725805+0000", 2023-09-30T17:03:49.472 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9318999999999999e-05 2023-09-30T17:03:49.472 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.472 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.472 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:49.473 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725904+0000", 2023-09-30T17:03:49.473 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8747999999999997e-05 2023-09-30T17:03:49.473 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.473 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.473 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:49.473 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.726075+0000", 2023-09-30T17:03:49.473 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017153700000000001 2023-09-30T17:03:49.473 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.473 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.473 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:49.473 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.727419+0000", 2023-09-30T17:03:49.473 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001343571 2023-09-30T17:03:49.474 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.474 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.474 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:49.474 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.965839+0000", 2023-09-30T17:03:49.474 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.238420467 2023-09-30T17:03:49.474 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.474 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.474 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:49.474 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.965922+0000", 2023-09-30T17:03:49.474 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2905000000000007e-05 2023-09-30T17:03:49.474 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.474 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.475 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:49.475 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.965966+0000", 2023-09-30T17:03:49.475 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3773999999999998e-05 2023-09-30T17:03:49.475 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:49.475 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:49.475 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:49.475 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.475 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.475 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23757 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 2117632~8192,write 2228224~4096,write 2453504~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:49.475 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.728711+0000", 2023-09-30T17:03:49.475 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 10.701497669, 2023-09-30T17:03:49.475 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23330704499999999, 2023-09-30T17:03:49.476 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:49.476 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:49.476 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:49.476 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:49.476 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:49.476 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23757 2023-09-30T17:03:49.476 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.476 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:49.476 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.476 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:49.476 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728711+0000", 2023-09-30T17:03:49.476 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:49.476 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.477 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.477 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:49.477 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728711+0000", 2023-09-30T17:03:49.477 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:49.477 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.477 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.477 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:49.477 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728712+0000", 2023-09-30T17:03:49.477 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4199999999999995e-07 2023-09-30T17:03:49.477 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.477 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.477 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:49.478 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728738+0000", 2023-09-30T17:03:49.478 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.6761e-05 2023-09-30T17:03:49.478 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.478 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.478 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:49.478 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728745+0000", 2023-09-30T17:03:49.478 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9940000000000003e-06 2023-09-30T17:03:49.478 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.478 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.478 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:49.478 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728749+0000", 2023-09-30T17:03:49.479 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.053e-06 2023-09-30T17:03:49.479 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.479 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.479 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:49.479 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728802+0000", 2023-09-30T17:03:49.479 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2918999999999999e-05 2023-09-30T17:03:49.479 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.479 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.479 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:49.479 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728923+0000", 2023-09-30T17:03:49.479 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00012084200000000001 2023-09-30T17:03:49.479 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.480 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.480 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:49.480 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.729101+0000", 2023-09-30T17:03:49.480 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000178226 2023-09-30T17:03:49.480 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.480 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.480 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:49.480 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732207+0000", 2023-09-30T17:03:49.480 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0031059849999999999 2023-09-30T17:03:49.480 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.480 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.480 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:49.480 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.961949+0000", 2023-09-30T17:03:49.481 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.229741842 2023-09-30T17:03:49.481 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.481 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.481 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:49.481 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.961986+0000", 2023-09-30T17:03:49.481 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7147000000000002e-05 2023-09-30T17:03:49.481 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.481 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.481 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:49.481 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.962018+0000", 2023-09-30T17:03:49.481 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.1634000000000002e-05 2023-09-30T17:03:49.481 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:49.482 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:49.482 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:49.482 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.482 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.482 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23768 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 1257472~4096,write 1384448~4096,write 1474560~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:49.482 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.732216+0000", 2023-09-30T17:03:49.482 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 10.697993037, 2023-09-30T17:03:49.482 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22951861000000001, 2023-09-30T17:03:49.482 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:49.482 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:49.482 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:49.483 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:49.483 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:49.483 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23768 2023-09-30T17:03:49.483 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.483 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:49.483 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.483 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:49.483 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732216+0000", 2023-09-30T17:03:49.483 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:49.483 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.483 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.483 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:49.483 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732216+0000", 2023-09-30T17:03:49.484 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:49.484 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.484 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.484 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:49.484 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732216+0000", 2023-09-30T17:03:49.484 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.71e-07 2023-09-30T17:03:49.484 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.484 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.484 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:49.484 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732231+0000", 2023-09-30T17:03:49.484 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5007e-05 2023-09-30T17:03:49.484 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.484 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.485 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:49.485 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732239+0000", 2023-09-30T17:03:49.485 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8509999999999999e-06 2023-09-30T17:03:49.485 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.485 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.485 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:49.485 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732244+0000", 2023-09-30T17:03:49.485 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2000000000000002e-06 2023-09-30T17:03:49.485 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.485 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.485 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:49.485 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732285+0000", 2023-09-30T17:03:49.486 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0877000000000002e-05 2023-09-30T17:03:49.486 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.486 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.486 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:49.486 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732331+0000", 2023-09-30T17:03:49.486 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5906999999999999e-05 2023-09-30T17:03:49.486 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.486 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.486 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:49.486 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732421+0000", 2023-09-30T17:03:49.486 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9993000000000004e-05 2023-09-30T17:03:49.486 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.487 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.487 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:49.487 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.737687+0000", 2023-09-30T17:03:49.487 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005265792 2023-09-30T17:03:49.487 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.487 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.487 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:49.487 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.961667+0000", 2023-09-30T17:03:49.487 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22398030799999999 2023-09-30T17:03:49.487 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.487 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.487 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:49.488 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.961703+0000", 2023-09-30T17:03:49.488 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5221e-05 2023-09-30T17:03:49.488 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.488 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.488 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:49.488 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.961734+0000", 2023-09-30T17:03:49.488 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.1582999999999999e-05 2023-09-30T17:03:49.488 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:49.488 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:49.488 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:49.488 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.488 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.489 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23780 4.36 4:6fa85f86:::100000001f8.00000013:head [write 3469312~4096,write 3522560~4096,write 3579904~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:49.489 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.735686+0000", 2023-09-30T17:03:49.489 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 10.694522806, 2023-09-30T17:03:49.489 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22921459399999999, 2023-09-30T17:03:49.489 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:49.489 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:49.489 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:49.489 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:49.489 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:49.489 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23780 2023-09-30T17:03:49.489 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.489 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:49.490 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.490 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:49.490 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.735686+0000", 2023-09-30T17:03:49.490 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:49.490 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.490 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.490 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:49.490 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.735686+0000", 2023-09-30T17:03:49.490 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:49.490 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.490 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.491 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:49.491 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.735687+0000", 2023-09-30T17:03:49.491 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3399999999999998e-07 2023-09-30T17:03:49.491 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.491 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.491 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:49.491 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.735701+0000", 2023-09-30T17:03:49.491 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4324999999999999e-05 2023-09-30T17:03:49.491 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.491 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.491 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:49.492 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.735713+0000", 2023-09-30T17:03:49.492 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1678999999999999e-05 2023-09-30T17:03:49.492 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.492 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.492 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:49.492 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.735720+0000", 2023-09-30T17:03:49.492 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8490000000000006e-06 2023-09-30T17:03:49.492 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.492 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.492 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:49.492 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.736637+0000", 2023-09-30T17:03:49.492 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00091620799999999995 2023-09-30T17:03:49.493 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.493 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.493 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:49.493 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.736719+0000", 2023-09-30T17:03:49.493 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2608999999999995e-05 2023-09-30T17:03:49.493 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.493 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.493 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:49.493 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.736876+0000", 2023-09-30T17:03:49.493 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015636799999999999 2023-09-30T17:03:49.493 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.493 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.493 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:49.494 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.742934+0000", 2023-09-30T17:03:49.494 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0060581619999999997 2023-09-30T17:03:49.494 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.494 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.494 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:49.494 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.964798+0000", 2023-09-30T17:03:49.494 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22186376599999999 2023-09-30T17:03:49.494 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.494 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.494 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:49.494 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.964859+0000", 2023-09-30T17:03:49.495 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1668000000000007e-05 2023-09-30T17:03:49.495 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.495 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.495 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:49.495 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.964900+0000", 2023-09-30T17:03:49.495 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1125999999999999e-05 2023-09-30T17:03:49.495 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:49.495 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:49.495 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:49.495 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.495 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.495 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23856 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 3538944~4096,write 3616768~4096,write 3686400~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:49.496 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.759274+0000", 2023-09-30T17:03:49.496 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 10.670934924999999, 2023-09-30T17:03:49.496 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.234084127, 2023-09-30T17:03:49.496 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:49.496 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:49.496 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:49.496 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:49.496 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:49.496 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23856 2023-09-30T17:03:49.496 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.496 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:49.497 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.497 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:49.497 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759274+0000", 2023-09-30T17:03:49.497 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:49.497 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.497 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.497 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:49.497 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759274+0000", 2023-09-30T17:03:49.497 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:49.497 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.497 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.497 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:49.498 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759274+0000", 2023-09-30T17:03:49.498 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7899999999999998e-07 2023-09-30T17:03:49.498 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.498 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.498 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:49.498 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759293+0000", 2023-09-30T17:03:49.498 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8410000000000002e-05 2023-09-30T17:03:49.498 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.498 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.498 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:49.498 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759302+0000", 2023-09-30T17:03:49.499 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8599999999999999e-06 2023-09-30T17:03:49.499 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.499 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.499 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:49.499 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759306+0000", 2023-09-30T17:03:49.499 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4499999999999997e-06 2023-09-30T17:03:49.499 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.499 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.499 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:49.499 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759984+0000", 2023-09-30T17:03:49.499 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00067830600000000005 2023-09-30T17:03:49.500 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.500 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.500 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:49.500 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.760041+0000", 2023-09-30T17:03:49.500 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.643e-05 2023-09-30T17:03:49.500 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.500 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.500 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:49.500 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.760135+0000", 2023-09-30T17:03:49.500 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3795999999999994e-05 2023-09-30T17:03:49.500 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.500 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.501 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:49.501 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764097+0000", 2023-09-30T17:03:49.501 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0039625629999999997 2023-09-30T17:03:49.501 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.501 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.501 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:49.501 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993282+0000", 2023-09-30T17:03:49.501 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22918461500000001 2023-09-30T17:03:49.501 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.501 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.501 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:49.502 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993320+0000", 2023-09-30T17:03:49.502 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8600999999999999e-05 2023-09-30T17:03:49.502 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.502 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.502 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:49.502 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993358+0000", 2023-09-30T17:03:49.502 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7517e-05 2023-09-30T17:03:49.502 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:49.502 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:49.502 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:49.503 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.503 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.503 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23865 4.36 4:6da220e6:::100000001f8.0000003f:head [write 3715072~4096,write 3850240~4096,write 4059136~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:49.503 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.761946+0000", 2023-09-30T17:03:49.503 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 10.668262439999999, 2023-09-30T17:03:49.503 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.231486097, 2023-09-30T17:03:49.503 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:49.503 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:49.503 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:49.503 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:49.503 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:49.503 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23865 2023-09-30T17:03:49.504 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.504 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:49.504 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.504 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:49.504 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.761946+0000", 2023-09-30T17:03:49.504 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:49.504 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.504 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.504 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:49.504 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.761946+0000", 2023-09-30T17:03:49.504 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:49.504 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.505 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.505 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:49.505 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.761947+0000", 2023-09-30T17:03:49.505 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7000000000000004e-07 2023-09-30T17:03:49.505 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.505 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.505 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:49.505 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.761959+0000", 2023-09-30T17:03:49.505 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2265e-05 2023-09-30T17:03:49.505 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.505 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.505 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:49.505 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.761970+0000", 2023-09-30T17:03:49.506 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0474e-05 2023-09-30T17:03:49.506 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.506 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.506 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:49.506 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.761976+0000", 2023-09-30T17:03:49.506 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1340000000000001e-06 2023-09-30T17:03:49.506 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.506 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.506 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:49.506 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.762063+0000", 2023-09-30T17:03:49.507 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.6728e-05 2023-09-30T17:03:49.507 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.507 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.507 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:49.507 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.762125+0000", 2023-09-30T17:03:49.507 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2869999999999999e-05 2023-09-30T17:03:49.507 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.507 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.507 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:49.507 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.762235+0000", 2023-09-30T17:03:49.507 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000109139 2023-09-30T17:03:49.507 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.508 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.508 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:49.508 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764102+0000", 2023-09-30T17:03:49.508 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001867121 2023-09-30T17:03:49.508 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.508 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.508 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:49.508 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993327+0000", 2023-09-30T17:03:49.508 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22922526800000001 2023-09-30T17:03:49.508 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.508 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.509 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:49.509 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993391+0000", 2023-09-30T17:03:49.509 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3839999999999999e-05 2023-09-30T17:03:49.509 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.509 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.509 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:49.509 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993432+0000", 2023-09-30T17:03:49.509 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1488e-05 2023-09-30T17:03:49.509 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:49.509 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:49.509 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:49.509 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.510 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.510 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23875 4.36 4:6da220e6:::100000001f8.0000003f:head [write 364544~4096,write 499712~4096,write 655360~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:49.510 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.764904+0000", 2023-09-30T17:03:49.510 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 10.665304256000001, 2023-09-30T17:03:49.510 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.228631693, 2023-09-30T17:03:49.510 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:49.510 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:49.510 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:49.510 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:49.510 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:49.510 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23875 2023-09-30T17:03:49.511 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.511 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:49.511 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.511 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:49.511 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764904+0000", 2023-09-30T17:03:49.511 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:49.511 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.511 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.511 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:49.511 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764904+0000", 2023-09-30T17:03:49.511 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:49.511 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.512 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.512 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:49.512 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764905+0000", 2023-09-30T17:03:49.512 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2799999999999995e-07 2023-09-30T17:03:49.512 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.512 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.512 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:49.512 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764915+0000", 2023-09-30T17:03:49.512 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8099999999999992e-06 2023-09-30T17:03:49.512 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.512 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.512 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:49.513 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764926+0000", 2023-09-30T17:03:49.513 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0858e-05 2023-09-30T17:03:49.513 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.513 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.513 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:49.513 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764931+0000", 2023-09-30T17:03:49.513 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2170000000000002e-06 2023-09-30T17:03:49.513 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.513 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.513 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:49.513 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764963+0000", 2023-09-30T17:03:49.513 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.2319e-05 2023-09-30T17:03:49.514 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.514 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.514 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:49.514 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.765009+0000", 2023-09-30T17:03:49.514 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5753000000000001e-05 2023-09-30T17:03:49.514 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.514 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.514 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:49.514 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.765093+0000", 2023-09-30T17:03:49.514 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4259999999999996e-05 2023-09-30T17:03:49.514 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.515 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.515 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:49.515 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766238+0000", 2023-09-30T17:03:49.515 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0011442550000000001 2023-09-30T17:03:49.515 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.515 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.515 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:49.515 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993469+0000", 2023-09-30T17:03:49.515 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22723121800000001 2023-09-30T17:03:49.515 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.515 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.515 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:49.515 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993501+0000", 2023-09-30T17:03:49.516 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.2576000000000001e-05 2023-09-30T17:03:49.516 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.516 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.516 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:49.516 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993536+0000", 2023-09-30T17:03:49.516 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4699000000000001e-05 2023-09-30T17:03:49.516 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:49.516 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:49.516 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:49.516 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.516 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.516 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23881 4.36 4:6da220e6:::100000001f8.0000003f:head [write 3366912~4096,write 3694592~4096,write 4071424~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:49.517 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.766444+0000", 2023-09-30T17:03:49.517 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 10.663764835, 2023-09-30T17:03:49.517 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23475070200000001, 2023-09-30T17:03:49.517 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:49.517 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:49.517 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:49.517 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:49.517 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:49.517 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23881 2023-09-30T17:03:49.517 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.517 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:49.517 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.518 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:49.518 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766444+0000", 2023-09-30T17:03:49.518 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:49.518 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.518 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.518 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:49.518 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766444+0000", 2023-09-30T17:03:49.518 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:49.518 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.518 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.518 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:49.518 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766444+0000", 2023-09-30T17:03:49.519 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3e-07 2023-09-30T17:03:49.519 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.519 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.519 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:49.519 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766455+0000", 2023-09-30T17:03:49.519 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0454e-05 2023-09-30T17:03:49.519 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.519 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.519 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:49.519 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766469+0000", 2023-09-30T17:03:49.519 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3568e-05 2023-09-30T17:03:49.520 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.520 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.520 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:49.520 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766474+0000", 2023-09-30T17:03:49.520 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1669999999999998e-06 2023-09-30T17:03:49.520 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.520 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.520 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:49.520 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766527+0000", 2023-09-30T17:03:49.520 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3650000000000003e-05 2023-09-30T17:03:49.521 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.521 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.521 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:49.521 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766611+0000", 2023-09-30T17:03:49.521 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3230000000000001e-05 2023-09-30T17:03:49.521 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.521 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.521 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:49.521 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766767+0000", 2023-09-30T17:03:49.521 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015688 2023-09-30T17:03:49.521 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.521 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.522 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:49.522 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.770254+0000", 2023-09-30T17:03:49.522 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0034870090000000001 2023-09-30T17:03:49.522 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.522 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.522 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:49.522 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.001100+0000", 2023-09-30T17:03:49.522 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23084518700000001 2023-09-30T17:03:49.522 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.522 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.523 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:49.523 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.001154+0000", 2023-09-30T17:03:49.523 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4453000000000002e-05 2023-09-30T17:03:49.523 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.523 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.523 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:49.523 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.001194+0000", 2023-09-30T17:03:49.523 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0373999999999997e-05 2023-09-30T17:03:49.523 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:49.523 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:49.523 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:49.523 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.524 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.524 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23901 4.6 4:63e80496:::100000001f8.0000001e:head [write 2617344~4096,write 2646016~4096,write 2662400~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:49.524 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.772204+0000", 2023-09-30T17:03:49.524 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 10.658004818, 2023-09-30T17:03:49.524 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.228858799, 2023-09-30T17:03:49.524 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:49.524 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:49.524 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:49.524 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:49.524 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:49.524 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23901 2023-09-30T17:03:49.524 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.525 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:49.525 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.525 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:49.525 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772204+0000", 2023-09-30T17:03:49.525 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:49.525 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.525 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.525 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:49.525 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772204+0000", 2023-09-30T17:03:49.525 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:49.525 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.526 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.526 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:49.526 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772205+0000", 2023-09-30T17:03:49.526 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3600000000000002e-07 2023-09-30T17:03:49.526 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.526 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.526 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:49.526 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772217+0000", 2023-09-30T17:03:49.526 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2459999999999999e-05 2023-09-30T17:03:49.526 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.526 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.527 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:49.527 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772228+0000", 2023-09-30T17:03:49.527 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0614e-05 2023-09-30T17:03:49.527 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.527 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.527 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:49.527 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772236+0000", 2023-09-30T17:03:49.527 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7610000000000007e-06 2023-09-30T17:03:49.527 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.527 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.527 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:49.528 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772280+0000", 2023-09-30T17:03:49.528 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4360000000000002e-05 2023-09-30T17:03:49.528 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.528 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.528 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:49.528 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772328+0000", 2023-09-30T17:03:49.528 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8041000000000003e-05 2023-09-30T17:03:49.528 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.528 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.528 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:49.528 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772417+0000", 2023-09-30T17:03:49.529 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9226000000000003e-05 2023-09-30T17:03:49.529 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.529 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.529 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:49.529 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.774997+0000", 2023-09-30T17:03:49.529 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0025795039999999998 2023-09-30T17:03:49.529 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.529 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.529 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:49.529 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.000979+0000", 2023-09-30T17:03:49.529 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22598211700000001 2023-09-30T17:03:49.529 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.530 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.530 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:49.530 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.001025+0000", 2023-09-30T17:03:49.530 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6347999999999997e-05 2023-09-30T17:03:49.530 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.530 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.530 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:49.530 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.001063+0000", 2023-09-30T17:03:49.530 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7431999999999997e-05 2023-09-30T17:03:49.530 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:49.531 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:49.531 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:49.531 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.531 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.531 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23924 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 1196032~4096,write 1249280~4096,write 1294336~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:49.531 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.778807+0000", 2023-09-30T17:03:49.531 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 10.651401958999999, 2023-09-30T17:03:49.531 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23068708600000001, 2023-09-30T17:03:49.531 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:49.531 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:49.531 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:49.532 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:49.532 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:49.532 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23924 2023-09-30T17:03:49.532 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.532 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:49.532 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.532 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:49.532 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778807+0000", 2023-09-30T17:03:49.532 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:49.532 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.532 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.532 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:49.533 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778807+0000", 2023-09-30T17:03:49.533 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:49.533 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.533 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.533 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:49.533 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778807+0000", 2023-09-30T17:03:49.533 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3600000000000003e-07 2023-09-30T17:03:49.533 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.533 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.533 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:49.533 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778832+0000", 2023-09-30T17:03:49.533 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4905999999999998e-05 2023-09-30T17:03:49.534 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.534 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.534 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:49.534 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778839+0000", 2023-09-30T17:03:49.534 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.097e-06 2023-09-30T17:03:49.534 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.534 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.534 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:49.534 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778843+0000", 2023-09-30T17:03:49.534 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8279999999999996e-06 2023-09-30T17:03:49.534 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.534 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.535 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:49.535 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778875+0000", 2023-09-30T17:03:49.535 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.1792000000000003e-05 2023-09-30T17:03:49.535 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.535 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.535 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:49.535 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778922+0000", 2023-09-30T17:03:49.535 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7034999999999999e-05 2023-09-30T17:03:49.535 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.535 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.535 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:49.536 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.779010+0000", 2023-09-30T17:03:49.536 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8305000000000002e-05 2023-09-30T17:03:49.536 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.536 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.536 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:49.536 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.781442+0000", 2023-09-30T17:03:49.536 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0024313550000000001 2023-09-30T17:03:49.536 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.536 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.536 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:49.536 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.009433+0000", 2023-09-30T17:03:49.536 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.227991044 2023-09-30T17:03:49.537 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.537 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.537 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:49.537 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.009471+0000", 2023-09-30T17:03:49.537 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8720999999999997e-05 2023-09-30T17:03:49.537 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.537 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.537 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:49.537 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.009494+0000", 2023-09-30T17:03:49.537 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2367000000000001e-05 2023-09-30T17:03:49.537 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:49.537 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:49.538 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:49.538 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.538 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.538 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23990 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 4157440~4096,write 4186112~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:49.538 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.798667+0000", 2023-09-30T17:03:49.538 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 10.631541444, 2023-09-30T17:03:49.538 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23029929399999999, 2023-09-30T17:03:49.538 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:49.538 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:49.538 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:49.538 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:49.539 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:49.539 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23990 2023-09-30T17:03:49.539 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.539 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:49.539 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.539 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:49.539 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798667+0000", 2023-09-30T17:03:49.539 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:49.539 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.539 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.539 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:49.539 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798667+0000", 2023-09-30T17:03:49.539 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:49.540 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.540 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.540 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:49.540 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798668+0000", 2023-09-30T17:03:49.540 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7000000000000005e-07 2023-09-30T17:03:49.540 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.540 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.540 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:49.540 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798675+0000", 2023-09-30T17:03:49.540 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1269999999999997e-06 2023-09-30T17:03:49.540 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.541 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.541 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:49.541 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798681+0000", 2023-09-30T17:03:49.541 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3500000000000002e-06 2023-09-30T17:03:49.541 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.541 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.541 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:49.541 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798685+0000", 2023-09-30T17:03:49.541 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.63e-06 2023-09-30T17:03:49.541 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.541 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.541 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:49.542 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798726+0000", 2023-09-30T17:03:49.542 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.163e-05 2023-09-30T17:03:49.542 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.542 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.542 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:49.542 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798790+0000", 2023-09-30T17:03:49.542 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3781999999999993e-05 2023-09-30T17:03:49.542 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.542 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.542 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:49.542 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798933+0000", 2023-09-30T17:03:49.543 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014272199999999999 2023-09-30T17:03:49.543 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.543 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.543 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:49.543 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.802788+0000", 2023-09-30T17:03:49.543 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.003855509 2023-09-30T17:03:49.543 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.543 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.543 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:49.543 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.028891+0000", 2023-09-30T17:03:49.543 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.226102847 2023-09-30T17:03:49.543 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.544 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.544 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:49.544 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.028945+0000", 2023-09-30T17:03:49.544 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3600000000000002e-05 2023-09-30T17:03:49.544 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.544 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.544 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:49.544 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.028966+0000", 2023-09-30T17:03:49.544 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1526999999999999e-05 2023-09-30T17:03:49.544 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:49.544 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:49.544 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:49.544 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.545 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.545 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23991 4.6 4:63e80496:::100000001f8.0000001e:head [write 327680~4096,write 335872~4096,write 491520~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:49.545 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.798864+0000", 2023-09-30T17:03:49.545 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 10.63134486, 2023-09-30T17:03:49.545 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23025762699999999, 2023-09-30T17:03:49.545 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:49.545 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:49.545 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:49.545 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:49.545 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:49.545 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23991 2023-09-30T17:03:49.545 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.545 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:49.546 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.546 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:49.546 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798864+0000", 2023-09-30T17:03:49.546 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:49.546 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.546 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.546 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:49.546 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798864+0000", 2023-09-30T17:03:49.546 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:49.546 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.546 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.546 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:49.546 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798864+0000", 2023-09-30T17:03:49.547 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3099999999999998e-07 2023-09-30T17:03:49.547 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.547 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.547 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:49.547 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798873+0000", 2023-09-30T17:03:49.547 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4789999999999996e-06 2023-09-30T17:03:49.547 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.547 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.547 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:49.547 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798878+0000", 2023-09-30T17:03:49.547 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6579999999999999e-06 2023-09-30T17:03:49.547 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.548 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.548 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:49.548 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798882+0000", 2023-09-30T17:03:49.548 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.985e-06 2023-09-30T17:03:49.548 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.548 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.548 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:49.548 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.799659+0000", 2023-09-30T17:03:49.548 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00077693900000000004 2023-09-30T17:03:49.548 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.548 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.548 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:49.548 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.799712+0000", 2023-09-30T17:03:49.549 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2694000000000001e-05 2023-09-30T17:03:49.549 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.549 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.549 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:49.549 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.799796+0000", 2023-09-30T17:03:49.549 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3943999999999995e-05 2023-09-30T17:03:49.549 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.549 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.549 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:49.549 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.802821+0000", 2023-09-30T17:03:49.549 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0030251850000000001 2023-09-30T17:03:49.549 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.549 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.550 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:49.550 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.029027+0000", 2023-09-30T17:03:49.550 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22620609999999999 2023-09-30T17:03:49.550 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.550 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.550 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:49.550 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.029083+0000", 2023-09-30T17:03:49.550 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5926e-05 2023-09-30T17:03:49.550 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.550 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.550 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:49.551 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.029121+0000", 2023-09-30T17:03:49.551 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8186000000000003e-05 2023-09-30T17:03:49.551 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:49.551 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:49.551 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:49.551 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.551 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.551 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:24052 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 3448832~4096,write 3493888~4096,write 3502080~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:49.551 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.817515+0000", 2023-09-30T17:03:49.551 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 10.612693549999999, 2023-09-30T17:03:49.551 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23184106800000001, 2023-09-30T17:03:49.551 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:49.552 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:49.552 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:49.552 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:49.552 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:49.552 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 24052 2023-09-30T17:03:49.552 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.552 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:49.552 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.552 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:49.552 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.817515+0000", 2023-09-30T17:03:49.552 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:49.552 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.552 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.553 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:49.553 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.817515+0000", 2023-09-30T17:03:49.553 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:49.553 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.553 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.553 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:49.553 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.817516+0000", 2023-09-30T17:03:49.553 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9899999999999999e-07 2023-09-30T17:03:49.553 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.553 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.553 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:49.553 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.817531+0000", 2023-09-30T17:03:49.553 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5483000000000001e-05 2023-09-30T17:03:49.554 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.554 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.554 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:49.554 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.817545+0000", 2023-09-30T17:03:49.554 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3209e-05 2023-09-30T17:03:49.554 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.554 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.554 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:49.554 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.817553+0000", 2023-09-30T17:03:49.554 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.994e-06 2023-09-30T17:03:49.554 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.554 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.555 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:49.555 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.818753+0000", 2023-09-30T17:03:49.555 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0012000909999999999 2023-09-30T17:03:49.555 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.555 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.555 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:49.555 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.818838+0000", 2023-09-30T17:03:49.555 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5389999999999994e-05 2023-09-30T17:03:49.555 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.555 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.555 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:49.555 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.818996+0000", 2023-09-30T17:03:49.555 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000158116 2023-09-30T17:03:49.556 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.556 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.556 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:49.556 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.822334+0000", 2023-09-30T17:03:49.556 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0033373230000000001 2023-09-30T17:03:49.556 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.556 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.556 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:49.556 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049259+0000", 2023-09-30T17:03:49.556 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22692517400000001 2023-09-30T17:03:49.556 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.556 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.556 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:49.557 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049323+0000", 2023-09-30T17:03:49.557 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4348000000000001e-05 2023-09-30T17:03:49.557 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.557 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.557 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:49.557 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049356+0000", 2023-09-30T17:03:49.557 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3040999999999998e-05 2023-09-30T17:03:49.557 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:49.557 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:49.557 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:49.557 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.557 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.558 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:24058 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 172032~4096,write 200704~4096,write 249856~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:49.558 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.819363+0000", 2023-09-30T17:03:49.558 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 10.610846073999999, 2023-09-30T17:03:49.558 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23030741099999999, 2023-09-30T17:03:49.558 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:49.558 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:49.558 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:49.558 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:49.558 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:49.558 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 24058 2023-09-30T17:03:49.558 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.558 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:49.558 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.559 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:49.559 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819363+0000", 2023-09-30T17:03:49.559 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:49.559 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.559 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.559 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:49.559 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819363+0000", 2023-09-30T17:03:49.559 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:49.559 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.559 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.559 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:49.559 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819363+0000", 2023-09-30T17:03:49.559 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8400000000000003e-07 2023-09-30T17:03:49.560 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.560 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.560 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:49.560 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819373+0000", 2023-09-30T17:03:49.560 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.9930000000000007e-06 2023-09-30T17:03:49.560 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.560 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.560 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:49.560 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819383+0000", 2023-09-30T17:03:49.560 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.4059999999999994e-06 2023-09-30T17:03:49.560 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.560 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.561 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:49.561 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819388+0000", 2023-09-30T17:03:49.561 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3299999999999998e-06 2023-09-30T17:03:49.561 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.561 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.561 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:49.561 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819584+0000", 2023-09-30T17:03:49.561 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00019642600000000001 2023-09-30T17:03:49.561 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.561 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.561 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:49.561 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819627+0000", 2023-09-30T17:03:49.561 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2150999999999997e-05 2023-09-30T17:03:49.562 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.562 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.562 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:49.562 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819712+0000", 2023-09-30T17:03:49.562 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5255999999999998e-05 2023-09-30T17:03:49.562 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.562 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.562 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:49.562 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.822340+0000", 2023-09-30T17:03:49.562 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0026283029999999998 2023-09-30T17:03:49.562 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.563 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.563 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:49.563 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049621+0000", 2023-09-30T17:03:49.563 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.227281176 2023-09-30T17:03:49.563 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.563 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.563 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:49.563 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049652+0000", 2023-09-30T17:03:49.563 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0528000000000003e-05 2023-09-30T17:03:49.563 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.563 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.564 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:49.564 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049670+0000", 2023-09-30T17:03:49.564 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8057999999999999e-05 2023-09-30T17:03:49.564 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:49.564 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:49.564 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:49.564 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.564 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.564 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:24064 4.6 4:616d4c41:::100000001f8.00000034:head [write 4132864~4096,write 4173824~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:49.564 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.820931+0000", 2023-09-30T17:03:49.564 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 10.609277713000001, 2023-09-30T17:03:49.564 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22854920400000001, 2023-09-30T17:03:49.565 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:49.565 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:49.565 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:49.565 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:49.565 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:49.565 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 24064 2023-09-30T17:03:49.565 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.565 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:49.565 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.565 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:49.565 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.820931+0000", 2023-09-30T17:03:49.565 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:49.566 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.566 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.566 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:49.566 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.820931+0000", 2023-09-30T17:03:49.566 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:49.566 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.566 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.566 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:49.566 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.820932+0000", 2023-09-30T17:03:49.566 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4300000000000002e-07 2023-09-30T17:03:49.566 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.566 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.567 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:49.567 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.820941+0000", 2023-09-30T17:03:49.567 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.5650000000000007e-06 2023-09-30T17:03:49.567 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.567 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.567 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:49.567 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.820952+0000", 2023-09-30T17:03:49.567 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0566e-05 2023-09-30T17:03:49.567 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.567 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.567 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:49.567 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.820957+0000", 2023-09-30T17:03:49.567 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3800000000000002e-06 2023-09-30T17:03:49.568 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.568 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.568 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:49.568 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.821008+0000", 2023-09-30T17:03:49.568 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1070999999999999e-05 2023-09-30T17:03:49.568 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.568 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.568 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:49.568 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.821075+0000", 2023-09-30T17:03:49.568 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.648e-05 2023-09-30T17:03:49.568 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.568 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.568 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:49.569 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.821236+0000", 2023-09-30T17:03:49.569 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016120899999999999 2023-09-30T17:03:49.569 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.569 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.569 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:49.569 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.823356+0000", 2023-09-30T17:03:49.569 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.002120458 2023-09-30T17:03:49.569 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.569 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.569 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:49.569 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049389+0000", 2023-09-30T17:03:49.569 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22603278199999999 2023-09-30T17:03:49.569 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.570 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.570 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:49.570 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049443+0000", 2023-09-30T17:03:49.570 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4033000000000003e-05 2023-09-30T17:03:49.570 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:49.570 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:49.570 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:49.570 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049480+0000", 2023-09-30T17:03:49.570 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6816999999999997e-05 2023-09-30T17:03:49.570 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:49.570 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:49.570 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:49.571 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:49.571 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:49.571 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:49.572 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:03:49.573 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:49.571+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:49.580 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:03:49.605 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:03:49.605 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-09-30T17:03:49.605 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-09-30T17:03:49.605 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:03:49.609 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:03:49.609 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:03:49.673 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:49.672+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:49.760 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:49.760 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:49.773 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:49.773+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:49.776 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:03:49.874 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:49.873+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:49.965 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:49.965 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:49.975 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:49.974+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:49.977 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:03:50.079 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:50.078+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:50.179 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:50.178+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:50.211 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:50.212 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:50.223 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:03:50.281 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:50.281+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:50.382 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:50.381+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:50.405 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is set 2023-09-30T17:03:50.427 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:50.427 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:50.443 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:03:50.483 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:50.483+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:50.584 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:50.583+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:50.677 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:50.677 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:50.685 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:50.684+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:50.694 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:03:50.786 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:50.785+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:50.887 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:50.886+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:50.933 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:50.933 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:50.949 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:03:50.994 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:50.993+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:51.088 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:51.088+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:51.138 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:51.139 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:51.155 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:03:51.196 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:51.195+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:51.290 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:51.289+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:51.384 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:51.385 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:51.391 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:51.390+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:51.400 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:03:51.491 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:51.491+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:51.592 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:51.592+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:51.610 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-09-30T17:03:51.623 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:51.623 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:51.639 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:03:51.695 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:51.694+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:51.788 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:03:51.794 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:51.794+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:51.812 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:03:51.813 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-09-30T17:03:51.813 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-09-30T17:03:51.813 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:03:51.816 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:03:51.816 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:03:51.837 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:51.837 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:03:51.838 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.838 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:59819 4.12 e45/17 4:4be51a30:::100000001f8.0000000b:head v 45'1861, mlcod=45'1858)", 2023-09-30T17:03:51.838 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:51.824179+0000", 2023-09-30T17:03:51.838 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0098399460000000005, 2023-09-30T17:03:51.838 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0098591949999999994, 2023-09-30T17:03:51.838 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:51.838 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:51.838 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:51.838 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.838 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:51.838 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.824179+0000", 2023-09-30T17:03:51.839 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.839 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.839 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.839 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:51.839 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.824179+0000", 2023-09-30T17:03:51.839 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.839 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.839 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.839 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:51.839 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.824179+0000", 2023-09-30T17:03:51.839 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.06e-07 2023-09-30T17:03:51.840 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.840 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.840 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:51.840 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.824191+0000", 2023-09-30T17:03:51.840 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1565e-05 2023-09-30T17:03:51.840 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.840 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.840 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:51.840 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.824198+0000", 2023-09-30T17:03:51.840 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5140000000000004e-06 2023-09-30T17:03:51.840 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.840 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.841 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:51.841 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.824204+0000", 2023-09-30T17:03:51.841 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.48e-06 2023-09-30T17:03:51.841 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.841 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.841 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:51.841 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.824249+0000", 2023-09-30T17:03:51.841 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5194000000000001e-05 2023-09-30T17:03:51.841 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.841 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.841 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:51.841 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.824266+0000", 2023-09-30T17:03:51.842 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7388e-05 2023-09-30T17:03:51.842 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.842 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:51.842 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.842 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.842 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.842 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:59824 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-09-30T17:03:51.842 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:51.825081+0000", 2023-09-30T17:03:51.842 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0089376479999999994, 2023-09-30T17:03:51.842 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0089978899999999997, 2023-09-30T17:03:51.842 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:51.843 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:51.843 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:51.843 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:51.843 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:51.843 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 59824 2023-09-30T17:03:51.843 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.843 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:51.843 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.843 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:51.843 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.825081+0000", 2023-09-30T17:03:51.843 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.843 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.844 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.844 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:51.844 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.825081+0000", 2023-09-30T17:03:51.844 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.844 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.844 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.844 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:51.844 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.825082+0000", 2023-09-30T17:03:51.844 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8999999999999996e-07 2023-09-30T17:03:51.844 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.844 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.844 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:51.845 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.825090+0000", 2023-09-30T17:03:51.845 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8990000000000001e-06 2023-09-30T17:03:51.845 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.845 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.845 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:51.845 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.825097+0000", 2023-09-30T17:03:51.845 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9670000000000004e-06 2023-09-30T17:03:51.845 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.845 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.845 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:51.845 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.825101+0000", 2023-09-30T17:03:51.845 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1420000000000003e-06 2023-09-30T17:03:51.846 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.846 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:51.846 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.846 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.846 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.846 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:59826 4.15 4:aada5e43:::100000001f8.00000028:head [write 901120~4096 in=4096b,write 921600~4096 in=4096b,write 995328~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-09-30T17:03:51.846 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:51.825731+0000", 2023-09-30T17:03:51.846 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.008288007, 2023-09-30T17:03:51.846 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0083874359999999998, 2023-09-30T17:03:51.846 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:51.846 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:51.846 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:51.847 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:51.847 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:51.847 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 59826 2023-09-30T17:03:51.847 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.847 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:51.847 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.847 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:51.847 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.825731+0000", 2023-09-30T17:03:51.847 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.847 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.847 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.847 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:51.848 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.825731+0000", 2023-09-30T17:03:51.848 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.848 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.848 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.848 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:51.848 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.825731+0000", 2023-09-30T17:03:51.848 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.6499999999999999e-07 2023-09-30T17:03:51.848 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.848 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.848 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:51.848 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.825740+0000", 2023-09-30T17:03:51.848 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.7630000000000006e-06 2023-09-30T17:03:51.849 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.849 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.849 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:51.849 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.825751+0000", 2023-09-30T17:03:51.849 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0584999999999999e-05 2023-09-30T17:03:51.849 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.849 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.849 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:51.849 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.825756+0000", 2023-09-30T17:03:51.849 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4229999999999996e-06 2023-09-30T17:03:51.849 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.849 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.850 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:51.850 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.825809+0000", 2023-09-30T17:03:51.850 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3086e-05 2023-09-30T17:03:51.850 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.850 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.850 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:51.850 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.825867+0000", 2023-09-30T17:03:51.850 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7302999999999997e-05 2023-09-30T17:03:51.850 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.850 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.850 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:51.851 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.826042+0000", 2023-09-30T17:03:51.851 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017507499999999999 2023-09-30T17:03:51.851 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.851 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.851 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:51.851 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.831396+0000", 2023-09-30T17:03:51.851 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053548060000000001 2023-09-30T17:03:51.851 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.851 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:51.851 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.851 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.851 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.852 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:59825 4.2d e45/17 4:b7099a35:::100000001f8.0000000e:head v 45'1835, mlcod=45'1833)", 2023-09-30T17:03:51.852 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:51.825852+0000", 2023-09-30T17:03:51.852 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0081672410000000004, 2023-09-30T17:03:51.852 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0083232380000000002, 2023-09-30T17:03:51.852 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:51.852 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:51.852 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:51.852 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.852 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:51.852 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.825852+0000", 2023-09-30T17:03:51.852 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.852 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.853 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.853 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:51.853 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.825852+0000", 2023-09-30T17:03:51.853 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.853 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.853 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.853 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:51.853 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.825852+0000", 2023-09-30T17:03:51.853 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1099999999999996e-07 2023-09-30T17:03:51.853 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.853 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.853 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:51.853 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.825864+0000", 2023-09-30T17:03:51.854 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.204e-05 2023-09-30T17:03:51.854 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.854 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.854 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:51.854 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.825871+0000", 2023-09-30T17:03:51.854 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0550000000000002e-06 2023-09-30T17:03:51.854 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.854 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.854 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:51.854 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.825877+0000", 2023-09-30T17:03:51.854 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9490000000000001e-06 2023-09-30T17:03:51.855 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.855 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.855 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:51.855 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.825928+0000", 2023-09-30T17:03:51.855 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1134000000000002e-05 2023-09-30T17:03:51.855 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.855 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.855 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:51.855 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.825952+0000", 2023-09-30T17:03:51.855 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.3492000000000001e-05 2023-09-30T17:03:51.855 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.855 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:51.856 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.856 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.856 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.856 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:59827 4.3d 4:bd3afb9d:::100000001f8.00000009:head [write 2068480~4096 in=4096b,write 2146304~4096 in=4096b,write 2187264~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-09-30T17:03:51.856 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:51.825996+0000", 2023-09-30T17:03:51.856 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0080226519999999999, 2023-09-30T17:03:51.856 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0082178089999999995, 2023-09-30T17:03:51.856 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:51.856 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:51.856 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:51.856 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:51.856 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:51.857 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 59827 2023-09-30T17:03:51.857 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.857 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:51.857 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.857 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:51.857 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.825996+0000", 2023-09-30T17:03:51.857 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.857 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.857 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.857 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:51.857 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.825996+0000", 2023-09-30T17:03:51.857 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.858 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.858 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.858 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:51.858 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.825997+0000", 2023-09-30T17:03:51.858 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1699999999999998e-07 2023-09-30T17:03:51.858 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.858 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.858 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:51.858 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.826005+0000", 2023-09-30T17:03:51.858 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0569999999999993e-06 2023-09-30T17:03:51.858 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.858 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.859 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:51.859 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.826017+0000", 2023-09-30T17:03:51.859 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2660000000000001e-05 2023-09-30T17:03:51.859 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.859 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.859 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:51.859 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.826024+0000", 2023-09-30T17:03:51.859 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0430000000000004e-06 2023-09-30T17:03:51.859 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.859 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.859 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:51.859 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.827192+0000", 2023-09-30T17:03:51.860 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0011680169999999999 2023-09-30T17:03:51.860 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.860 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.860 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:51.860 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.827264+0000", 2023-09-30T17:03:51.860 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2329000000000005e-05 2023-09-30T17:03:51.860 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.860 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:51.860 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.860 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.860 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.861 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:59828 4.32 4:4f726a0c:::100000001f8.00000012:head [write 1216512~4096 in=4096b,write 1253376~4096 in=4096b,write 1544192~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-09-30T17:03:51.861 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:51.826386+0000", 2023-09-30T17:03:51.861 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0076328569999999998, 2023-09-30T17:03:51.861 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.007928226, 2023-09-30T17:03:51.861 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:51.861 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:51.861 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:51.861 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:51.861 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:51.861 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 59828 2023-09-30T17:03:51.861 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.861 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:51.862 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.862 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:51.862 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.826386+0000", 2023-09-30T17:03:51.862 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.862 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.862 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.862 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:51.862 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.826386+0000", 2023-09-30T17:03:51.862 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.862 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.862 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.862 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:51.863 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.826387+0000", 2023-09-30T17:03:51.863 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7000000000000004e-07 2023-09-30T17:03:51.863 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.863 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.863 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:51.863 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.826400+0000", 2023-09-30T17:03:51.863 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3168e-05 2023-09-30T17:03:51.863 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.863 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.863 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:51.863 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.826412+0000", 2023-09-30T17:03:51.863 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1871e-05 2023-09-30T17:03:51.864 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.864 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.864 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:51.864 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.826419+0000", 2023-09-30T17:03:51.864 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4379999999999998e-06 2023-09-30T17:03:51.864 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.864 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.864 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:51.864 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.826482+0000", 2023-09-30T17:03:51.864 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2836999999999995e-05 2023-09-30T17:03:51.864 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.864 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.865 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:51.865 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.826578+0000", 2023-09-30T17:03:51.865 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.6243000000000007e-05 2023-09-30T17:03:51.865 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.865 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:51.865 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.865 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.865 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.865 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:59830 4.3b 4:dcc0c15f:::100000001f8.0000001a:head [write 16384~4096 in=4096b,write 159744~4096 in=4096b,write 196608~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-09-30T17:03:51.865 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:51.827323+0000", 2023-09-30T17:03:51.865 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.006696095, 2023-09-30T17:03:51.865 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0070351880000000004, 2023-09-30T17:03:51.866 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:51.866 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:51.866 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:51.866 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:51.866 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:51.866 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 59830 2023-09-30T17:03:51.866 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.866 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:51.866 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.866 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:51.866 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.827323+0000", 2023-09-30T17:03:51.866 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.867 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.867 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.867 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:51.867 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.827323+0000", 2023-09-30T17:03:51.867 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.867 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.867 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.867 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:51.867 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.827324+0000", 2023-09-30T17:03:51.867 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2999999999999999e-07 2023-09-30T17:03:51.867 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.867 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.868 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:51.868 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.827337+0000", 2023-09-30T17:03:51.868 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2928999999999999e-05 2023-09-30T17:03:51.868 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.868 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.868 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:51.868 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.827347+0000", 2023-09-30T17:03:51.868 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0419e-05 2023-09-30T17:03:51.868 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.868 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.868 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:51.868 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.827355+0000", 2023-09-30T17:03:51.869 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0209999999999999e-06 2023-09-30T17:03:51.869 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.869 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.869 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:51.869 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.827420+0000", 2023-09-30T17:03:51.869 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4744000000000002e-05 2023-09-30T17:03:51.869 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.869 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.869 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:51.869 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.827466+0000", 2023-09-30T17:03:51.869 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6180000000000002e-05 2023-09-30T17:03:51.869 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.870 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.870 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:51.870 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.827550+0000", 2023-09-30T17:03:51.870 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4175e-05 2023-09-30T17:03:51.870 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.870 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.870 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:51.870 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.832984+0000", 2023-09-30T17:03:51.870 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0054336430000000002 2023-09-30T17:03:51.870 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.870 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:51.871 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.871 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.871 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.871 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:59831 4.e 4.c27217ce (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-09-30T17:03:51.871 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:51.827619+0000", 2023-09-30T17:03:51.871 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.006399376, 2023-09-30T17:03:51.871 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.006786037, 2023-09-30T17:03:51.871 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:51.871 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:51.871 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:51.871 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:51.871 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:51.872 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 59831 2023-09-30T17:03:51.872 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.872 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:51.872 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.872 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:51.872 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.827619+0000", 2023-09-30T17:03:51.872 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.872 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.872 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.872 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:51.872 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.827619+0000", 2023-09-30T17:03:51.872 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.873 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.873 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.873 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:51.873 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.827620+0000", 2023-09-30T17:03:51.873 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8599999999999997e-07 2023-09-30T17:03:51.873 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.873 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.873 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:51.873 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.827632+0000", 2023-09-30T17:03:51.873 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2121e-05 2023-09-30T17:03:51.873 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.873 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.874 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:51.874 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.827642+0000", 2023-09-30T17:03:51.874 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0189e-05 2023-09-30T17:03:51.874 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.874 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.874 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:51.874 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.827650+0000", 2023-09-30T17:03:51.874 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.391e-06 2023-09-30T17:03:51.874 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.874 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:51.874 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.874 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.875 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.875 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:59832 4.15 4:aada5e43:::100000001f8.00000028:head [write 1814528~4096 in=4096b,write 1974272~4096 in=4096b,write 2035712~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-09-30T17:03:51.875 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:51.827920+0000", 2023-09-30T17:03:51.875 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0060988350000000004, 2023-09-30T17:03:51.875 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0065398950000000004, 2023-09-30T17:03:51.875 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:51.875 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:51.875 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:51.875 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:51.875 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:51.875 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 59832 2023-09-30T17:03:51.875 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.876 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:51.876 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.876 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:51.876 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.827920+0000", 2023-09-30T17:03:51.876 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.876 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.876 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.876 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:51.876 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.827920+0000", 2023-09-30T17:03:51.876 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.876 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.876 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.877 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:51.877 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.827921+0000", 2023-09-30T17:03:51.877 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7599999999999997e-07 2023-09-30T17:03:51.877 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.877 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.877 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:51.877 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.827935+0000", 2023-09-30T17:03:51.877 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4626e-05 2023-09-30T17:03:51.877 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.877 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.877 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:51.877 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.827944+0000", 2023-09-30T17:03:51.878 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.7940000000000008e-06 2023-09-30T17:03:51.878 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.878 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.878 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:51.878 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.827951+0000", 2023-09-30T17:03:51.878 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8569999999999997e-06 2023-09-30T17:03:51.878 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.878 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.878 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:51.878 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.828576+0000", 2023-09-30T17:03:51.878 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00062562299999999996 2023-09-30T17:03:51.878 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.879 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.879 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:51.879 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.828626+0000", 2023-09-30T17:03:51.879 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9505000000000001e-05 2023-09-30T17:03:51.879 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.879 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.879 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:51.879 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.828734+0000", 2023-09-30T17:03:51.879 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000107808 2023-09-30T17:03:51.879 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.879 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:51.880 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.880 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.880 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.880 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:59829 4.37 e45/17 4:eff9002a:::100000001f8.00000003:head v 45'2800, mlcod=45'2798)", 2023-09-30T17:03:51.880 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:51.828178+0000", 2023-09-30T17:03:51.880 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0058405159999999996, 2023-09-30T17:03:51.880 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0063692779999999999, 2023-09-30T17:03:51.880 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:51.880 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:51.880 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:51.880 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.880 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:51.881 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.828178+0000", 2023-09-30T17:03:51.881 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.881 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.881 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.881 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:51.881 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.828178+0000", 2023-09-30T17:03:51.881 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.881 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.881 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.881 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:51.881 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.828179+0000", 2023-09-30T17:03:51.881 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2799999999999995e-07 2023-09-30T17:03:51.882 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.882 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.882 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:51.882 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.828192+0000", 2023-09-30T17:03:51.882 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3001e-05 2023-09-30T17:03:51.882 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.882 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.882 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:51.882 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.828201+0000", 2023-09-30T17:03:51.882 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1549999999999996e-06 2023-09-30T17:03:51.882 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.883 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.883 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:51.883 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.828208+0000", 2023-09-30T17:03:51.883 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.6189999999999996e-06 2023-09-30T17:03:51.883 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.883 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.883 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:51.883 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.828263+0000", 2023-09-30T17:03:51.883 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5006999999999997e-05 2023-09-30T17:03:51.883 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.883 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.883 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:51.884 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.828282+0000", 2023-09-30T17:03:51.884 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8732e-05 2023-09-30T17:03:51.884 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.884 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:51.884 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.884 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.884 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.884 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:59833 4.37 e45/17 4:ecbf0fb2:::100000001f8.00000038:head v 45'2801, mlcod=45'2798)", 2023-09-30T17:03:51.884 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:51.828931+0000", 2023-09-30T17:03:51.884 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0050879940000000002, 2023-09-30T17:03:51.884 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0057153880000000001, 2023-09-30T17:03:51.884 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:51.885 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:51.885 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:51.885 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.885 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:51.885 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.828931+0000", 2023-09-30T17:03:51.885 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.885 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.885 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.885 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:51.885 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.828931+0000", 2023-09-30T17:03:51.885 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.886 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.886 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.886 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:51.886 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.828931+0000", 2023-09-30T17:03:51.886 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0699999999999997e-07 2023-09-30T17:03:51.886 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.886 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.886 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:51.886 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.828948+0000", 2023-09-30T17:03:51.886 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6291e-05 2023-09-30T17:03:51.886 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.886 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.887 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:51.887 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.828957+0000", 2023-09-30T17:03:51.887 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.4769999999999992e-06 2023-09-30T17:03:51.887 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.887 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.887 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:51.887 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.828964+0000", 2023-09-30T17:03:51.887 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.126e-06 2023-09-30T17:03:51.887 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.887 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.887 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:51.887 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.831196+0000", 2023-09-30T17:03:51.888 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0022316319999999999 2023-09-30T17:03:51.888 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.888 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.888 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:51.888 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.831212+0000", 2023-09-30T17:03:51.888 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5583e-05 2023-09-30T17:03:51.888 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.888 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:51.888 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.888 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.888 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.888 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:59835 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-09-30T17:03:51.889 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:51.829121+0000", 2023-09-30T17:03:51.889 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0048979410000000003, 2023-09-30T17:03:51.889 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0056112419999999998, 2023-09-30T17:03:51.889 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:51.889 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:51.889 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:51.889 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:51.889 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:51.889 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 59835 2023-09-30T17:03:51.889 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.889 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:51.889 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.890 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:51.890 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.829121+0000", 2023-09-30T17:03:51.890 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.890 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.890 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.890 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:51.890 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.829121+0000", 2023-09-30T17:03:51.890 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.890 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.890 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.890 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:51.890 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.829122+0000", 2023-09-30T17:03:51.891 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3399999999999998e-07 2023-09-30T17:03:51.891 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.891 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.891 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:51.891 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.829132+0000", 2023-09-30T17:03:51.891 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0859000000000001e-05 2023-09-30T17:03:51.891 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.891 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.891 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:51.891 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.829143+0000", 2023-09-30T17:03:51.891 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0645999999999999e-05 2023-09-30T17:03:51.892 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.892 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.892 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:51.892 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.829149+0000", 2023-09-30T17:03:51.892 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4319999999999998e-06 2023-09-30T17:03:51.892 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.892 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:51.892 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.892 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.892 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.892 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:59836 4.3b 4:dcc0c15f:::100000001f8.0000001a:head [write 3014656~4096 in=4096b,write 3162112~4096 in=4096b,write 3182592~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-09-30T17:03:51.893 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:51.829391+0000", 2023-09-30T17:03:51.893 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0046278509999999997, 2023-09-30T17:03:51.893 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0053806679999999999, 2023-09-30T17:03:51.893 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:51.893 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:51.893 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:51.893 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:51.893 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:51.893 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 59836 2023-09-30T17:03:51.893 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.893 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:51.893 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.894 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:51.894 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.829391+0000", 2023-09-30T17:03:51.894 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.894 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.894 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.894 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:51.894 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.829391+0000", 2023-09-30T17:03:51.894 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.894 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.894 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.894 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:51.894 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.829392+0000", 2023-09-30T17:03:51.895 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7000000000000004e-07 2023-09-30T17:03:51.895 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.895 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.895 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:51.895 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.829403+0000", 2023-09-30T17:03:51.895 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1361e-05 2023-09-30T17:03:51.895 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.895 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.895 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:51.895 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.829412+0000", 2023-09-30T17:03:51.895 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.4730000000000006e-06 2023-09-30T17:03:51.896 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.896 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.896 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:51.896 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.829417+0000", 2023-09-30T17:03:51.896 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3819999999999997e-06 2023-09-30T17:03:51.896 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.896 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.896 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:51.896 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.831483+0000", 2023-09-30T17:03:51.896 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0020666489999999998 2023-09-30T17:03:51.896 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.896 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.896 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:51.897 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.831565+0000", 2023-09-30T17:03:51.897 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1162000000000007e-05 2023-09-30T17:03:51.897 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.897 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.897 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:51.897 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.831713+0000", 2023-09-30T17:03:51.897 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014799999999999999 2023-09-30T17:03:51.897 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.897 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.897 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:51.897 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.834461+0000", 2023-09-30T17:03:51.897 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0027479959999999999 2023-09-30T17:03:51.898 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.898 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:51.898 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.898 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.898 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.898 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:59838 4.1c 4:39b842ef:::100000001f8.00000029:head [write 290816~4096 in=4096b,write 393216~4096 in=4096b,write 409600~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-09-30T17:03:51.898 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:51.829962+0000", 2023-09-30T17:03:51.898 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0040565100000000002, 2023-09-30T17:03:51.898 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0048688999999999998, 2023-09-30T17:03:51.898 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:51.898 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:51.898 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:51.899 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:51.899 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:51.899 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 59838 2023-09-30T17:03:51.899 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.899 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:51.899 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.899 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:51.899 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.829962+0000", 2023-09-30T17:03:51.899 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.899 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.899 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.899 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:51.900 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.829962+0000", 2023-09-30T17:03:51.900 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.900 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.900 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.900 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:51.900 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.829963+0000", 2023-09-30T17:03:51.900 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2600000000000002e-07 2023-09-30T17:03:51.900 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.900 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.900 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:51.900 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.829973+0000", 2023-09-30T17:03:51.900 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0220999999999999e-05 2023-09-30T17:03:51.901 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.901 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.901 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:51.901 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.829996+0000", 2023-09-30T17:03:51.901 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2654999999999999e-05 2023-09-30T17:03:51.901 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.901 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.901 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:51.901 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.830001+0000", 2023-09-30T17:03:51.901 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7740000000000004e-06 2023-09-30T17:03:51.901 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.901 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.902 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:51.902 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.830059+0000", 2023-09-30T17:03:51.902 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8158000000000001e-05 2023-09-30T17:03:51.902 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.902 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.902 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:51.902 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.830150+0000", 2023-09-30T17:03:51.902 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1580000000000001e-05 2023-09-30T17:03:51.902 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.902 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.902 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:51.903 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.830336+0000", 2023-09-30T17:03:51.903 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00018531799999999999 2023-09-30T17:03:51.903 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.903 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.903 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:51.903 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.834520+0000", 2023-09-30T17:03:51.903 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0041845479999999997 2023-09-30T17:03:51.903 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.903 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:51.903 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.903 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.903 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.904 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:59807 4.36 4:6da220e6:::100000001f8.0000003f:head [write 2035712~4096 in=4096b,write 2080768~4096 in=4096b,write 2215936~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-09-30T17:03:51.904 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:51.819351+0000", 2023-09-30T17:03:51.904 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.014667355999999999, 2023-09-30T17:03:51.904 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.015606089, 2023-09-30T17:03:51.904 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:51.904 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:51.904 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:51.904 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:51.904 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:51.904 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 59807 2023-09-30T17:03:51.904 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.905 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:51.905 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.905 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:51.905 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.819351+0000", 2023-09-30T17:03:51.905 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.905 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.905 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.905 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:51.905 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.819351+0000", 2023-09-30T17:03:51.905 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.905 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.905 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.905 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:51.906 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.819352+0000", 2023-09-30T17:03:51.906 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.61e-07 2023-09-30T17:03:51.906 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.906 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.906 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:51.906 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.819364+0000", 2023-09-30T17:03:51.906 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2058999999999999e-05 2023-09-30T17:03:51.906 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.906 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.906 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:51.906 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.819375+0000", 2023-09-30T17:03:51.907 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0518e-05 2023-09-30T17:03:51.907 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.907 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.907 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:51.907 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.819382+0000", 2023-09-30T17:03:51.907 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5089999999999996e-06 2023-09-30T17:03:51.907 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.907 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.907 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:51.907 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.819462+0000", 2023-09-30T17:03:51.907 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0065e-05 2023-09-30T17:03:51.907 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.908 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.908 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:51.908 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.819547+0000", 2023-09-30T17:03:51.908 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4184000000000006e-05 2023-09-30T17:03:51.908 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.908 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.908 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:51.908 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.819703+0000", 2023-09-30T17:03:51.908 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015673 2023-09-30T17:03:51.908 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.908 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.908 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:51.909 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.828566+0000", 2023-09-30T17:03:51.909 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0088630610000000002 2023-09-30T17:03:51.909 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.909 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:51.909 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.909 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.909 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.909 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:59839 4.15 4:aada5e43:::100000001f8.00000028:head [write 1355776~4096 in=4096b,write 1458176~4096 in=4096b,write 1531904~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-09-30T17:03:51.909 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:51.830231+0000", 2023-09-30T17:03:51.909 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0037876030000000001, 2023-09-30T17:03:51.909 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0048281749999999997, 2023-09-30T17:03:51.909 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:51.910 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:51.910 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:51.910 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:51.910 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:51.910 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 59839 2023-09-30T17:03:51.910 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.910 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:51.910 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.910 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:51.910 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.830231+0000", 2023-09-30T17:03:51.910 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.910 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.911 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.911 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:51.911 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.830231+0000", 2023-09-30T17:03:51.911 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.911 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.911 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.911 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:51.911 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.830232+0000", 2023-09-30T17:03:51.911 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4900000000000005e-07 2023-09-30T17:03:51.911 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.911 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.912 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:51.912 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.830243+0000", 2023-09-30T17:03:51.912 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1167e-05 2023-09-30T17:03:51.912 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.912 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.912 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:51.912 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.830253+0000", 2023-09-30T17:03:51.912 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8810000000000008e-06 2023-09-30T17:03:51.912 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.912 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.912 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:51.912 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.830260+0000", 2023-09-30T17:03:51.913 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8229999999999997e-06 2023-09-30T17:03:51.913 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.913 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.913 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:51.913 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.831418+0000", 2023-09-30T17:03:51.913 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00115803 2023-09-30T17:03:51.913 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.913 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.913 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:51.913 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.831492+0000", 2023-09-30T17:03:51.913 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3936000000000005e-05 2023-09-30T17:03:51.914 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.914 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.914 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:51.914 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.831648+0000", 2023-09-30T17:03:51.914 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015640900000000001 2023-09-30T17:03:51.914 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.914 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:51.914 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.914 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.914 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.914 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:59809 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 2174976~4096 in=4096b,write 2318336~4096 in=4096b,write 2379776~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-09-30T17:03:51.915 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:51.819966+0000", 2023-09-30T17:03:51.915 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.014052869000000001, 2023-09-30T17:03:51.915 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.015221370999999999, 2023-09-30T17:03:51.915 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:51.915 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:51.915 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:51.915 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:51.915 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:51.915 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 59809 2023-09-30T17:03:51.915 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.915 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:51.917 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.917 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:51.917 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.819966+0000", 2023-09-30T17:03:51.917 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.917 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.917 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.917 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:51.918 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.819966+0000", 2023-09-30T17:03:51.918 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.918 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.918 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.918 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:51.918 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.819967+0000", 2023-09-30T17:03:51.918 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0900000000000001e-07 2023-09-30T17:03:51.918 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.918 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.918 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:51.919 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.819991+0000", 2023-09-30T17:03:51.919 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4192000000000001e-05 2023-09-30T17:03:51.919 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.919 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.919 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:51.919 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.820002+0000", 2023-09-30T17:03:51.919 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1293e-05 2023-09-30T17:03:51.919 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.919 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.919 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:51.919 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.820009+0000", 2023-09-30T17:03:51.919 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.939e-06 2023-09-30T17:03:51.920 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.920 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.920 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:51.920 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.825305+0000", 2023-09-30T17:03:51.920 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0052961589999999999 2023-09-30T17:03:51.920 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.920 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.920 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:51.920 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.825388+0000", 2023-09-30T17:03:51.920 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2785000000000001e-05 2023-09-30T17:03:51.920 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.921 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.921 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:51.921 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.825546+0000", 2023-09-30T17:03:51.921 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000158584 2023-09-30T17:03:51.921 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.921 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.921 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:51.921 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.831651+0000", 2023-09-30T17:03:51.921 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0061044410000000004 2023-09-30T17:03:51.921 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.921 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:51.921 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.922 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.922 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.922 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:59840 4.37 e45/17 4:eff9002a:::100000001f8.00000003:head v 45'2802, mlcod=45'2798)", 2023-09-30T17:03:51.922 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:51.830904+0000", 2023-09-30T17:03:51.922 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0031143479999999999, 2023-09-30T17:03:51.922 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.004370451, 2023-09-30T17:03:51.922 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:51.922 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:51.922 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:51.922 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.922 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:51.922 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.830904+0000", 2023-09-30T17:03:51.923 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.923 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.923 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.923 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:51.923 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.830904+0000", 2023-09-30T17:03:51.923 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.923 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.923 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.923 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:51.923 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.830905+0000", 2023-09-30T17:03:51.923 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4000000000000002e-07 2023-09-30T17:03:51.924 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.924 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.924 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:51.924 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.830919+0000", 2023-09-30T17:03:51.924 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3912e-05 2023-09-30T17:03:51.924 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.924 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.924 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:51.924 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.830930+0000", 2023-09-30T17:03:51.924 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1001e-05 2023-09-30T17:03:51.924 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.924 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.925 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:51.925 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.830935+0000", 2023-09-30T17:03:51.925 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8110000000000002e-06 2023-09-30T17:03:51.925 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.925 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.925 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:51.925 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.833031+0000", 2023-09-30T17:03:51.925 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0020963090000000002 2023-09-30T17:03:51.925 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.925 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.925 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:51.926 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.833050+0000", 2023-09-30T17:03:51.926 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9459000000000001e-05 2023-09-30T17:03:51.926 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.926 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:51.926 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.926 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.926 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.926 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:59841 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-09-30T17:03:51.926 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:51.831066+0000", 2023-09-30T17:03:51.926 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0029531639999999999, 2023-09-30T17:03:51.926 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0042682329999999997, 2023-09-30T17:03:51.926 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:51.927 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:51.927 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:51.927 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:51.927 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:51.927 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 59841 2023-09-30T17:03:51.927 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.927 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:51.927 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.927 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:51.927 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.831066+0000", 2023-09-30T17:03:51.927 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.927 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.928 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.928 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:51.928 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.831066+0000", 2023-09-30T17:03:51.928 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.928 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.928 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.928 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:51.928 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.831066+0000", 2023-09-30T17:03:51.928 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3900000000000004e-07 2023-09-30T17:03:51.928 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.928 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.928 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:51.929 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.831075+0000", 2023-09-30T17:03:51.929 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3159999999999997e-06 2023-09-30T17:03:51.929 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.929 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.929 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:51.929 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.831085+0000", 2023-09-30T17:03:51.929 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0161e-05 2023-09-30T17:03:51.929 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.929 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.929 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:51.929 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.831090+0000", 2023-09-30T17:03:51.929 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9370000000000003e-06 2023-09-30T17:03:51.930 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.930 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:51.930 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.930 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.930 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.930 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:59813 4.e 4:73e84e43:::100000001f8.00000004:head [write 2568192~4096 in=4096b,write 2654208~4096 in=4096b,write 2691072~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-09-30T17:03:51.930 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:51.821324+0000", 2023-09-30T17:03:51.930 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.012694548999999999, 2023-09-30T17:03:51.930 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.014070693, 2023-09-30T17:03:51.930 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:51.930 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:51.930 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:51.931 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:51.931 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:51.931 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 59813 2023-09-30T17:03:51.931 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.931 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:51.931 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.931 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:51.931 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.821324+0000", 2023-09-30T17:03:51.931 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.931 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.931 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.931 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:51.932 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.821324+0000", 2023-09-30T17:03:51.932 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.932 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.932 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.932 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:51.932 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.821325+0000", 2023-09-30T17:03:51.932 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.04e-06 2023-09-30T17:03:51.932 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.932 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.932 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:51.932 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.821338+0000", 2023-09-30T17:03:51.932 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2289e-05 2023-09-30T17:03:51.933 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.933 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.933 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:51.933 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.821349+0000", 2023-09-30T17:03:51.933 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1250000000000001e-05 2023-09-30T17:03:51.933 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.933 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.933 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:51.933 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.821357+0000", 2023-09-30T17:03:51.933 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8460000000000008e-06 2023-09-30T17:03:51.933 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.933 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.934 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:51.934 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.823875+0000", 2023-09-30T17:03:51.934 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0025185730000000001 2023-09-30T17:03:51.934 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.934 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.934 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:51.934 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.823965+0000", 2023-09-30T17:03:51.934 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9914999999999995e-05 2023-09-30T17:03:51.934 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.934 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:51.934 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.934 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.935 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.935 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:59842 4.6 4.2d31fac6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-09-30T17:03:51.935 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:51.831335+0000", 2023-09-30T17:03:51.935 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0026838919999999998, 2023-09-30T17:03:51.935 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0041294529999999999, 2023-09-30T17:03:51.935 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:51.935 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:51.935 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:51.935 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:51.935 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:51.935 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 59842 2023-09-30T17:03:51.935 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.936 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:51.936 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.936 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:51.936 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.831335+0000", 2023-09-30T17:03:51.936 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.936 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.936 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.936 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:51.936 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.831335+0000", 2023-09-30T17:03:51.936 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.936 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.936 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.936 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:51.937 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.831336+0000", 2023-09-30T17:03:51.937 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5799999999999998e-07 2023-09-30T17:03:51.937 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.937 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.937 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:51.937 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.831350+0000", 2023-09-30T17:03:51.937 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4643e-05 2023-09-30T17:03:51.937 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.937 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.937 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:51.937 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.831360+0000", 2023-09-30T17:03:51.938 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3100000000000006e-06 2023-09-30T17:03:51.938 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.938 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.938 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:51.938 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.831368+0000", 2023-09-30T17:03:51.938 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2709999999999992e-06 2023-09-30T17:03:51.938 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.938 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:51.938 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.938 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.938 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.938 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:59846 4.36 4.670445b6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-09-30T17:03:51.939 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:51.832592+0000", 2023-09-30T17:03:51.939 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.001426292, 2023-09-30T17:03:51.939 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0029264209999999998, 2023-09-30T17:03:51.939 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:51.939 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:51.939 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:51.939 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:51.939 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:51.939 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 59846 2023-09-30T17:03:51.939 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.939 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:51.939 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.940 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:51.940 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.832592+0000", 2023-09-30T17:03:51.940 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.940 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.940 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.940 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:51.940 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.832592+0000", 2023-09-30T17:03:51.940 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.940 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.940 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.940 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:51.940 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.832593+0000", 2023-09-30T17:03:51.941 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2399999999999996e-07 2023-09-30T17:03:51.941 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.941 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.941 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:51.941 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.832610+0000", 2023-09-30T17:03:51.941 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6637e-05 2023-09-30T17:03:51.941 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.941 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.941 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:51.941 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.832624+0000", 2023-09-30T17:03:51.941 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4348999999999999e-05 2023-09-30T17:03:51.941 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.942 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.942 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:51.942 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.832641+0000", 2023-09-30T17:03:51.942 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6104e-05 2023-09-30T17:03:51.942 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.942 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:51.942 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.942 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.942 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.942 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:59816 4.6 4:63e80496:::100000001f8.0000001e:head [write 782336~4096 in=4096b,write 794624~4096 in=4096b,write 901120~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-09-30T17:03:51.942 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:51.822155+0000", 2023-09-30T17:03:51.942 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.011864056, 2023-09-30T17:03:51.943 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.013423005, 2023-09-30T17:03:51.943 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:51.943 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:51.943 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:51.943 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:51.943 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:51.943 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 59816 2023-09-30T17:03:51.943 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.943 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:51.943 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.943 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:51.943 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.822155+0000", 2023-09-30T17:03:51.944 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.944 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.944 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.944 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:51.944 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.822155+0000", 2023-09-30T17:03:51.944 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.944 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.944 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.944 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:51.944 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.822155+0000", 2023-09-30T17:03:51.944 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6899999999999997e-07 2023-09-30T17:03:51.944 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.945 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.945 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:51.945 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.822176+0000", 2023-09-30T17:03:51.945 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1029000000000001e-05 2023-09-30T17:03:51.945 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.945 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.945 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:51.945 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.822187+0000", 2023-09-30T17:03:51.945 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1151999999999999e-05 2023-09-30T17:03:51.945 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.945 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.945 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:51.946 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.822194+0000", 2023-09-30T17:03:51.946 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2339999999999999e-06 2023-09-30T17:03:51.946 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.946 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.946 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:51.946 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.828676+0000", 2023-09-30T17:03:51.946 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0064822769999999998 2023-09-30T17:03:51.946 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.946 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.946 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:51.946 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.828765+0000", 2023-09-30T17:03:51.946 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8603999999999994e-05 2023-09-30T17:03:51.947 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.947 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.947 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:51.947 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.828903+0000", 2023-09-30T17:03:51.947 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00013848300000000001 2023-09-30T17:03:51.947 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.947 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:51.947 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.947 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.947 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.947 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:59845 4.12 e45/17 4:4be51a30:::100000001f8.0000000b:head v 45'1862, mlcod=45'1859)", 2023-09-30T17:03:51.947 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:51.832619+0000", 2023-09-30T17:03:51.948 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0013996169999999999, 2023-09-30T17:03:51.948 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0030335800000000001, 2023-09-30T17:03:51.948 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:51.948 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:51.948 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:51.948 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.948 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:51.948 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.832619+0000", 2023-09-30T17:03:51.948 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.948 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.948 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.948 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:51.949 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.832619+0000", 2023-09-30T17:03:51.949 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.949 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.949 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.949 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:51.949 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.832620+0000", 2023-09-30T17:03:51.949 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.51e-07 2023-09-30T17:03:51.949 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.949 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.949 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:51.949 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.832632+0000", 2023-09-30T17:03:51.949 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2156e-05 2023-09-30T17:03:51.949 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.950 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.950 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:51.950 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.832640+0000", 2023-09-30T17:03:51.950 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3070000000000003e-06 2023-09-30T17:03:51.950 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.950 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.950 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:51.950 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.832646+0000", 2023-09-30T17:03:51.950 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6339999999999998e-06 2023-09-30T17:03:51.950 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.950 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.950 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:51.951 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.832783+0000", 2023-09-30T17:03:51.951 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00013698599999999999 2023-09-30T17:03:51.951 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.951 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.951 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:51.951 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.832795+0000", 2023-09-30T17:03:51.951 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2213e-05 2023-09-30T17:03:51.951 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.951 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:51.951 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.951 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.951 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.952 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:59848 4.25 4:a76ff001:::100000001f8.0000002b:head [write 1748992~4096 in=4096b,write 1855488~4096 in=4096b,write 1998848~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-09-30T17:03:51.952 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:51.833290+0000", 2023-09-30T17:03:51.952 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.00072877900000000004, 2023-09-30T17:03:51.952 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0024326439999999999, 2023-09-30T17:03:51.952 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:51.952 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:51.952 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:51.952 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:51.952 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:51.952 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 59848 2023-09-30T17:03:51.952 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.952 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:51.952 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.953 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:51.953 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.833290+0000", 2023-09-30T17:03:51.953 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.953 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.953 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.953 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:51.953 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.833290+0000", 2023-09-30T17:03:51.953 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.953 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.953 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.953 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:51.954 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.833291+0000", 2023-09-30T17:03:51.954 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2299999999999999e-07 2023-09-30T17:03:51.954 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.954 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.954 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:51.954 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.833304+0000", 2023-09-30T17:03:51.954 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3176999999999999e-05 2023-09-30T17:03:51.954 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.954 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.954 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:51.954 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.833317+0000", 2023-09-30T17:03:51.954 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2839e-05 2023-09-30T17:03:51.955 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.955 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.955 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:51.955 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.833325+0000", 2023-09-30T17:03:51.955 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1480000000000006e-06 2023-09-30T17:03:51.955 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.955 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.955 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:51.955 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.834748+0000", 2023-09-30T17:03:51.955 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0014232979999999999 2023-09-30T17:03:51.955 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.955 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.956 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:51.956 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.834798+0000", 2023-09-30T17:03:51.956 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9280000000000003e-05 2023-09-30T17:03:51.956 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.956 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:51.956 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.956 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.956 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.956 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:59820 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 1265664~4096 in=4096b,write 1282048~4096 in=4096b,write 1392640~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-09-30T17:03:51.956 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:51.823183+0000", 2023-09-30T17:03:51.956 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.010835735000000001, 2023-09-30T17:03:51.957 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.012617768, 2023-09-30T17:03:51.957 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:51.957 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:51.957 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:51.957 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:51.957 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:51.957 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 59820 2023-09-30T17:03:51.957 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.957 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:51.957 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.957 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:51.957 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.823183+0000", 2023-09-30T17:03:51.957 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.958 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.958 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.958 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:51.958 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.823183+0000", 2023-09-30T17:03:51.958 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.958 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.958 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.958 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:51.958 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.823184+0000", 2023-09-30T17:03:51.958 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2900000000000003e-07 2023-09-30T17:03:51.958 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.958 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.959 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:51.959 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.823223+0000", 2023-09-30T17:03:51.959 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9610000000000002e-05 2023-09-30T17:03:51.959 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.959 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.959 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:51.959 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.823240+0000", 2023-09-30T17:03:51.959 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6801000000000001e-05 2023-09-30T17:03:51.959 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.959 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.959 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:51.959 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.823250+0000", 2023-09-30T17:03:51.960 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.4690000000000003e-06 2023-09-30T17:03:51.960 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.960 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.960 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:51.960 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.831648+0000", 2023-09-30T17:03:51.960 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0083985569999999992 2023-09-30T17:03:51.960 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.960 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.960 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:51.960 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.831722+0000", 2023-09-30T17:03:51.960 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3689000000000005e-05 2023-09-30T17:03:51.960 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.961 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.961 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:51.961 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.831901+0000", 2023-09-30T17:03:51.961 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000179154 2023-09-30T17:03:51.961 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.961 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:51.961 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.961 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.961 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.961 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:59821 4.13 4:caef1406:::100000001f8.00000031:head [write 2101248~4096 in=4096b,write 2129920~4096 in=4096b,write 2199552~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-09-30T17:03:51.961 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:51.823779+0000", 2023-09-30T17:03:51.961 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.010239451, 2023-09-30T17:03:51.962 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.012122091, 2023-09-30T17:03:51.962 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:51.962 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:51.962 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:51.962 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:51.962 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:51.962 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 59821 2023-09-30T17:03:51.962 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.962 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:51.962 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.962 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:51.962 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.823779+0000", 2023-09-30T17:03:51.963 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.963 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.963 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.963 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:51.963 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.823779+0000", 2023-09-30T17:03:51.963 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.963 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.963 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.963 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:51.963 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.823780+0000", 2023-09-30T17:03:51.963 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2900000000000002e-07 2023-09-30T17:03:51.963 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.964 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.964 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:51.964 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.823798+0000", 2023-09-30T17:03:51.964 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7989999999999999e-05 2023-09-30T17:03:51.964 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.964 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.964 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:51.964 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.823809+0000", 2023-09-30T17:03:51.964 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0492000000000001e-05 2023-09-30T17:03:51.964 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.964 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.964 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:51.964 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.823814+0000", 2023-09-30T17:03:51.965 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2310000000000004e-06 2023-09-30T17:03:51.965 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.965 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.965 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:51.965 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.827090+0000", 2023-09-30T17:03:51.965 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0032758470000000001 2023-09-30T17:03:51.965 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.965 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.965 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:51.965 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.827182+0000", 2023-09-30T17:03:51.965 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1840000000000002e-05 2023-09-30T17:03:51.965 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.966 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:51.966 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.966 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.966 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.966 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:59851 4.15 4:aada5e43:::100000001f8.00000028:head [write 139264~4096 in=4096b,write 278528~4096 in=4096b,write 360448~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-09-30T17:03:51.966 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:51.834306+0000", 2023-09-30T17:03:51.966 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.9997125, 2023-09-30T17:03:51.966 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0016752150000000001, 2023-09-30T17:03:51.966 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:51.966 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:51.966 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:51.966 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:51.966 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:51.967 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 59851 2023-09-30T17:03:51.967 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.967 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:51.967 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.967 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:51.967 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.834306+0000", 2023-09-30T17:03:51.967 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.967 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.967 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.967 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:51.967 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.834306+0000", 2023-09-30T17:03:51.967 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.968 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.968 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.968 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:51.968 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.834307+0000", 2023-09-30T17:03:51.968 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1800000000000005e-07 2023-09-30T17:03:51.968 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.968 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.968 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:51.968 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.834318+0000", 2023-09-30T17:03:51.968 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0614999999999999e-05 2023-09-30T17:03:51.968 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.968 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.969 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:51.969 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.834329+0000", 2023-09-30T17:03:51.969 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1215e-05 2023-09-30T17:03:51.969 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.969 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.969 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:51.969 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.834337+0000", 2023-09-30T17:03:51.969 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7910000000000005e-06 2023-09-30T17:03:51.969 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.969 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.969 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:51.969 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.834816+0000", 2023-09-30T17:03:51.969 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00047902099999999999 2023-09-30T17:03:51.970 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.970 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.970 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:51.970 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.834896+0000", 2023-09-30T17:03:51.970 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0241999999999995e-05 2023-09-30T17:03:51.970 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.970 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.970 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:51.970 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.835053+0000", 2023-09-30T17:03:51.970 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000157026 2023-09-30T17:03:51.970 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.970 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:51.971 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.971 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.971 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.971 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop_reply(client.4547.0:59816 4.6 e45/17)", 2023-09-30T17:03:51.971 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:51.834338+0000", 2023-09-30T17:03:51.971 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.999681, 2023-09-30T17:03:51.971 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0017281219999999999, 2023-09-30T17:03:51.971 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:51.971 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:51.971 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:51.971 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.971 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:51.971 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.834338+0000", 2023-09-30T17:03:51.972 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.972 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.972 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.972 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:51.972 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.834338+0000", 2023-09-30T17:03:51.972 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.972 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.972 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.972 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:51.972 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.834338+0000", 2023-09-30T17:03:51.972 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1399999999999997e-07 2023-09-30T17:03:51.972 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.972 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.973 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:51.973 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.834340+0000", 2023-09-30T17:03:51.973 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4679999999999999e-06 2023-09-30T17:03:51.973 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.973 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.973 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:51.973 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.834347+0000", 2023-09-30T17:03:51.973 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2589999999999997e-06 2023-09-30T17:03:51.973 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.973 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.973 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:51.973 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.834350+0000", 2023-09-30T17:03:51.974 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4680000000000001e-06 2023-09-30T17:03:51.974 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.974 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:51.974 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.974 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.974 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.974 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:59793 4.6 4:616d4c41:::100000001f8.00000034:head [write 24576~4096 in=4096b,write 495616~4096 in=4096b,write 540672~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-09-30T17:03:51.974 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:51.813439+0000", 2023-09-30T17:03:51.974 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.020579311999999999, 2023-09-30T17:03:51.974 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.022685688999999998, 2023-09-30T17:03:51.974 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:51.974 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:51.975 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:51.975 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:51.975 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:51.975 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 59793 2023-09-30T17:03:51.975 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.975 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:51.975 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.975 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:51.975 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.813439+0000", 2023-09-30T17:03:51.975 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.975 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.975 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.975 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:51.976 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.813439+0000", 2023-09-30T17:03:51.976 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:51.976 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.976 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.976 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:51.976 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.813440+0000", 2023-09-30T17:03:51.976 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.6099999999999999e-07 2023-09-30T17:03:51.976 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.976 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.976 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:51.976 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.813454+0000", 2023-09-30T17:03:51.976 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3115999999999999e-05 2023-09-30T17:03:51.977 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.977 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.977 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:51.977 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.813466+0000", 2023-09-30T17:03:51.977 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1959e-05 2023-09-30T17:03:51.977 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.977 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.977 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:51.977 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.813474+0000", 2023-09-30T17:03:51.977 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0949999999999996e-06 2023-09-30T17:03:51.977 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.977 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.978 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:51.978 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.815895+0000", 2023-09-30T17:03:51.978 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0024212439999999999 2023-09-30T17:03:51.978 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.978 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.978 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:51.978 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.815986+0000", 2023-09-30T17:03:51.978 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1595999999999995e-05 2023-09-30T17:03:51.978 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.978 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.978 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:51.978 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.816173+0000", 2023-09-30T17:03:51.979 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00018630200000000001 2023-09-30T17:03:51.979 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:51.979 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:51.979 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:51.979 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:51.825248+0000", 2023-09-30T17:03:51.979 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.009075039 2023-09-30T17:03:51.979 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.979 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:51.979 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.979 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:51.979 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-09-30T17:03:51.979 INFO:teuthology.orchestra.run.smithi031.stdout: "num_ops": 30 2023-09-30T17:03:51.980 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:51.981 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:03:51.982 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:51.980+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:52.081 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:52.081+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:52.182 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~65s 2023-09-30T17:03:52.183 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:52.182+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:52.234 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:52.234 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:03:52.234 INFO:teuthology.orchestra.run.smithi031.stdout: "complaint_time": 30, 2023-09-30T17:03:52.235 INFO:teuthology.orchestra.run.smithi031.stdout: "num_blocked_ops": 0 2023-09-30T17:03:52.235 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:52.241 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:03:52.284 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:52.283+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:52.384 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:52.384+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:52.420 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-09-30T17:03:52.484 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:52.484 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 20, 2023-09-30T17:03:52.484 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 600, 2023-09-30T17:03:52.484 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:03:52.484 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.484 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23704 4.14 4:2b28d75f:::100000001f8.00000016:head [write 262144~4096,write 274432~4096,write 405504~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:52.484 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.711008+0000", 2023-09-30T17:03:52.484 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 13.769856185, 2023-09-30T17:03:52.485 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.229109541, 2023-09-30T17:03:52.485 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:52.485 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:52.485 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:52.485 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:52.485 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:52.485 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23704 2023-09-30T17:03:52.485 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.485 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:52.485 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.486 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:52.486 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711008+0000", 2023-09-30T17:03:52.486 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:52.486 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.486 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.486 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:52.486 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711008+0000", 2023-09-30T17:03:52.486 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:52.486 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.486 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.486 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:52.487 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711009+0000", 2023-09-30T17:03:52.487 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5899999999999995e-07 2023-09-30T17:03:52.487 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.487 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.487 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:52.487 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711042+0000", 2023-09-30T17:03:52.487 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3149999999999999e-05 2023-09-30T17:03:52.487 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.487 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.487 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:52.487 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711054+0000", 2023-09-30T17:03:52.488 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1742999999999999e-05 2023-09-30T17:03:52.488 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.488 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.488 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:52.488 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711059+0000", 2023-09-30T17:03:52.488 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3009999999999997e-06 2023-09-30T17:03:52.488 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.488 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.488 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:52.488 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711120+0000", 2023-09-30T17:03:52.488 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1228000000000004e-05 2023-09-30T17:03:52.488 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.488 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.489 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:52.489 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711205+0000", 2023-09-30T17:03:52.489 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4489999999999999e-05 2023-09-30T17:03:52.489 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.489 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.489 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:52.489 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711371+0000", 2023-09-30T17:03:52.489 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016639500000000001 2023-09-30T17:03:52.489 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.489 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.489 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:52.490 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.716551+0000", 2023-09-30T17:03:52.490 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051799929999999999 2023-09-30T17:03:52.490 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.490 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.490 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:52.490 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.940040+0000", 2023-09-30T17:03:52.490 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22348859800000001 2023-09-30T17:03:52.490 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.490 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.490 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:52.490 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.940080+0000", 2023-09-30T17:03:52.490 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0114999999999998e-05 2023-09-30T17:03:52.491 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.491 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.491 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:52.491 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.940118+0000", 2023-09-30T17:03:52.491 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7768999999999997e-05 2023-09-30T17:03:52.491 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:52.491 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:52.491 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:52.491 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.491 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.491 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23713 4.33 4:cf6d7a6c:::100000001f8.0000000a:head [write 585728~4096,write 925696~4096,write 937984~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:52.492 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.714948+0000", 2023-09-30T17:03:52.492 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 13.765916471000001, 2023-09-30T17:03:52.492 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23061467099999999, 2023-09-30T17:03:52.492 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:52.492 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:52.492 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:52.492 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:52.492 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:52.492 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23713 2023-09-30T17:03:52.492 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.492 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:52.493 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.493 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:52.493 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.714948+0000", 2023-09-30T17:03:52.493 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:52.493 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.493 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.493 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:52.493 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.714948+0000", 2023-09-30T17:03:52.493 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:52.493 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.493 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.493 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:52.494 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.714949+0000", 2023-09-30T17:03:52.494 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1399999999999995e-07 2023-09-30T17:03:52.494 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.494 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.494 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:52.494 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.714961+0000", 2023-09-30T17:03:52.494 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1916000000000001e-05 2023-09-30T17:03:52.494 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.494 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.494 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:52.494 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.714979+0000", 2023-09-30T17:03:52.494 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8070000000000001e-05 2023-09-30T17:03:52.495 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.495 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.495 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:52.495 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.714987+0000", 2023-09-30T17:03:52.495 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4179999999999997e-06 2023-09-30T17:03:52.495 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.495 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.495 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:52.495 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.715034+0000", 2023-09-30T17:03:52.495 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6563999999999997e-05 2023-09-30T17:03:52.495 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.496 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.496 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:52.496 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.715083+0000", 2023-09-30T17:03:52.496 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9310000000000001e-05 2023-09-30T17:03:52.496 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.496 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.496 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:52.496 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.715177+0000", 2023-09-30T17:03:52.496 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3525999999999999e-05 2023-09-30T17:03:52.496 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.496 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.496 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:52.497 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.719724+0000", 2023-09-30T17:03:52.497 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0045477210000000002 2023-09-30T17:03:52.497 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.497 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.497 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:52.497 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.945467+0000", 2023-09-30T17:03:52.497 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22574224500000001 2023-09-30T17:03:52.497 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.497 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.497 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:52.497 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.945524+0000", 2023-09-30T17:03:52.497 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7105999999999998e-05 2023-09-30T17:03:52.498 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.498 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.498 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:52.498 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.945563+0000", 2023-09-30T17:03:52.498 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8881000000000003e-05 2023-09-30T17:03:52.498 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:52.498 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:52.498 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:52.498 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.498 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.499 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23735 4.6 4:616d4c41:::100000001f8.00000034:head [write 991232~4096,write 1040384~4096,write 1200128~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:52.499 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.722398+0000", 2023-09-30T17:03:52.499 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 13.758466115999999, 2023-09-30T17:03:52.499 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.230202669, 2023-09-30T17:03:52.499 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:52.499 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:52.499 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:52.499 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:52.499 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:52.499 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23735 2023-09-30T17:03:52.499 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.499 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:52.500 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.500 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:52.500 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722398+0000", 2023-09-30T17:03:52.500 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:52.500 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.500 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.500 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:52.500 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722398+0000", 2023-09-30T17:03:52.500 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:52.500 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.500 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.500 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:52.501 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722399+0000", 2023-09-30T17:03:52.501 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2799999999999996e-07 2023-09-30T17:03:52.501 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.501 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.501 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:52.501 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722423+0000", 2023-09-30T17:03:52.501 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4134e-05 2023-09-30T17:03:52.501 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.501 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.501 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:52.501 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722429+0000", 2023-09-30T17:03:52.502 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4590000000000003e-06 2023-09-30T17:03:52.502 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.502 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.502 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:52.502 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722434+0000", 2023-09-30T17:03:52.502 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1779999999999996e-06 2023-09-30T17:03:52.502 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.502 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.502 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:52.502 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722490+0000", 2023-09-30T17:03:52.502 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6215999999999998e-05 2023-09-30T17:03:52.503 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.503 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.503 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:52.503 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722600+0000", 2023-09-30T17:03:52.503 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00011017 2023-09-30T17:03:52.503 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.503 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.503 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:52.503 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722769+0000", 2023-09-30T17:03:52.503 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0001695 2023-09-30T17:03:52.503 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.504 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.504 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:52.504 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725807+0000", 2023-09-30T17:03:52.504 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0030372120000000001 2023-09-30T17:03:52.504 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.504 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.504 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:52.504 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.952546+0000", 2023-09-30T17:03:52.504 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22673923600000001 2023-09-30T17:03:52.504 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.504 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.505 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:52.505 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.952579+0000", 2023-09-30T17:03:52.505 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3111000000000002e-05 2023-09-30T17:03:52.505 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.505 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.505 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:52.505 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.952601+0000", 2023-09-30T17:03:52.505 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1925000000000001e-05 2023-09-30T17:03:52.505 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:52.505 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:52.505 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:52.505 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.506 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.506 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23738 4.6 4:616d4c41:::100000001f8.00000034:head [write 3043328~4096,write 3055616~4096,write 3080192~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:52.506 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.723439+0000", 2023-09-30T17:03:52.506 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 13.757425143000001, 2023-09-30T17:03:52.506 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23665340400000001, 2023-09-30T17:03:52.506 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:52.506 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:52.506 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:52.506 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:52.506 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:52.506 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23738 2023-09-30T17:03:52.506 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.507 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:52.507 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.507 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:52.507 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723439+0000", 2023-09-30T17:03:52.507 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:52.507 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.507 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.507 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:52.507 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723439+0000", 2023-09-30T17:03:52.507 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:52.507 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.508 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.508 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:52.508 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723440+0000", 2023-09-30T17:03:52.508 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.23e-07 2023-09-30T17:03:52.508 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.508 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.508 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:52.508 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723452+0000", 2023-09-30T17:03:52.508 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2147000000000001e-05 2023-09-30T17:03:52.508 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.508 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.508 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:52.509 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723461+0000", 2023-09-30T17:03:52.509 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3839999999999997e-06 2023-09-30T17:03:52.509 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.509 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.509 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:52.509 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723465+0000", 2023-09-30T17:03:52.509 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7559999999999999e-06 2023-09-30T17:03:52.509 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.509 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.509 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:52.509 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723924+0000", 2023-09-30T17:03:52.509 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00045910299999999999 2023-09-30T17:03:52.510 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.510 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.510 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:52.510 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723970+0000", 2023-09-30T17:03:52.510 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5126999999999997e-05 2023-09-30T17:03:52.510 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.510 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.510 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:52.510 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724057+0000", 2023-09-30T17:03:52.510 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.7142e-05 2023-09-30T17:03:52.510 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.511 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.511 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:52.511 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.726148+0000", 2023-09-30T17:03:52.511 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.002091449 2023-09-30T17:03:52.511 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.511 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.511 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:52.511 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.960040+0000", 2023-09-30T17:03:52.511 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23389163299999999 2023-09-30T17:03:52.511 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.511 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.511 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:52.512 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.960071+0000", 2023-09-30T17:03:52.512 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.133e-05 2023-09-30T17:03:52.512 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.512 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.512 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:52.512 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.960093+0000", 2023-09-30T17:03:52.512 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1509999999999999e-05 2023-09-30T17:03:52.512 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:52.512 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:52.512 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:52.512 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.512 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.513 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23740 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 3780608~4096,write 3788800~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:52.513 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.723994+0000", 2023-09-30T17:03:52.513 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 13.756870366999999, 2023-09-30T17:03:52.513 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.234031238, 2023-09-30T17:03:52.513 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:52.513 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:52.513 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:52.513 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:52.513 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:52.513 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23740 2023-09-30T17:03:52.513 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.513 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:52.514 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.514 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:52.514 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723994+0000", 2023-09-30T17:03:52.514 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:52.514 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.514 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.514 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:52.514 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723994+0000", 2023-09-30T17:03:52.514 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:52.514 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.514 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.514 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:52.515 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723995+0000", 2023-09-30T17:03:52.515 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6000000000000003e-07 2023-09-30T17:03:52.515 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.515 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.515 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:52.515 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724004+0000", 2023-09-30T17:03:52.515 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.4909999999999994e-06 2023-09-30T17:03:52.515 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.515 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.515 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:52.515 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724012+0000", 2023-09-30T17:03:52.516 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4590000000000001e-06 2023-09-30T17:03:52.516 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.516 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.516 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:52.516 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724016+0000", 2023-09-30T17:03:52.516 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9890000000000003e-06 2023-09-30T17:03:52.516 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.516 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.516 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:52.516 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724060+0000", 2023-09-30T17:03:52.516 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4339999999999999e-05 2023-09-30T17:03:52.516 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.517 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.517 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:52.517 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724141+0000", 2023-09-30T17:03:52.517 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1384000000000005e-05 2023-09-30T17:03:52.517 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.517 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.517 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:52.517 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724300+0000", 2023-09-30T17:03:52.517 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015870700000000001 2023-09-30T17:03:52.517 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.517 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.518 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:52.518 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.726182+0000", 2023-09-30T17:03:52.518 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0018816060000000001 2023-09-30T17:03:52.518 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.518 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.518 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:52.518 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.957929+0000", 2023-09-30T17:03:52.518 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23174703399999999 2023-09-30T17:03:52.518 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.518 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.518 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:52.519 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.957983+0000", 2023-09-30T17:03:52.519 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4107999999999998e-05 2023-09-30T17:03:52.519 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.519 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.519 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:52.519 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.958025+0000", 2023-09-30T17:03:52.519 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2360000000000001e-05 2023-09-30T17:03:52.519 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:52.519 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:52.519 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:52.519 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.520 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.520 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23746 4.28 4:15eeb89b:::100000001f8.00000032:head [write 3731456~4096,write 3919872~4096,write 3952640~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:52.520 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.725721+0000", 2023-09-30T17:03:52.520 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 13.755142983000001, 2023-09-30T17:03:52.520 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.24024479800000001, 2023-09-30T17:03:52.520 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:52.520 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:52.520 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:52.520 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:52.520 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:52.520 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23746 2023-09-30T17:03:52.521 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.521 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:52.521 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.521 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:52.521 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725721+0000", 2023-09-30T17:03:52.521 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:52.521 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.521 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.521 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:52.521 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725721+0000", 2023-09-30T17:03:52.521 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:52.522 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.522 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.522 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:52.522 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725722+0000", 2023-09-30T17:03:52.522 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6499999999999999e-07 2023-09-30T17:03:52.522 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.522 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.522 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:52.522 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725732+0000", 2023-09-30T17:03:52.522 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7559999999999994e-06 2023-09-30T17:03:52.522 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.522 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.523 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:52.523 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725738+0000", 2023-09-30T17:03:52.523 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8360000000000003e-06 2023-09-30T17:03:52.523 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.523 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.523 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:52.523 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725746+0000", 2023-09-30T17:03:52.523 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4200000000000001e-06 2023-09-30T17:03:52.523 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.523 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.523 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:52.524 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725805+0000", 2023-09-30T17:03:52.524 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9318999999999999e-05 2023-09-30T17:03:52.524 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.524 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.524 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:52.524 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725904+0000", 2023-09-30T17:03:52.524 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8747999999999997e-05 2023-09-30T17:03:52.524 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.524 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.524 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:52.524 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.726075+0000", 2023-09-30T17:03:52.525 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017153700000000001 2023-09-30T17:03:52.525 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.525 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.525 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:52.525 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.727419+0000", 2023-09-30T17:03:52.525 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001343571 2023-09-30T17:03:52.525 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.525 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.525 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:52.525 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.965839+0000", 2023-09-30T17:03:52.525 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.238420467 2023-09-30T17:03:52.525 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.526 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.526 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:52.526 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.965922+0000", 2023-09-30T17:03:52.526 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2905000000000007e-05 2023-09-30T17:03:52.526 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.526 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.526 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:52.526 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.965966+0000", 2023-09-30T17:03:52.526 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3773999999999998e-05 2023-09-30T17:03:52.526 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:52.526 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:52.526 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:52.527 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.527 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.527 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23757 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 2117632~8192,write 2228224~4096,write 2453504~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:52.527 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.728711+0000", 2023-09-30T17:03:52.527 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 13.752153408, 2023-09-30T17:03:52.527 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23330704499999999, 2023-09-30T17:03:52.527 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:52.527 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:52.527 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:52.527 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:52.527 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:52.529 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23757 2023-09-30T17:03:52.529 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.529 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:52.529 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.529 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:52.529 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728711+0000", 2023-09-30T17:03:52.529 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:52.529 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.530 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.530 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:52.530 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728711+0000", 2023-09-30T17:03:52.530 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:52.530 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.530 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.530 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:52.530 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728712+0000", 2023-09-30T17:03:52.530 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4199999999999995e-07 2023-09-30T17:03:52.530 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.530 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.530 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:52.531 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728738+0000", 2023-09-30T17:03:52.531 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.6761e-05 2023-09-30T17:03:52.531 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.531 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.531 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:52.531 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728745+0000", 2023-09-30T17:03:52.531 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9940000000000003e-06 2023-09-30T17:03:52.531 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.531 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.531 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:52.531 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728749+0000", 2023-09-30T17:03:52.532 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.053e-06 2023-09-30T17:03:52.532 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.532 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.532 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:52.532 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728802+0000", 2023-09-30T17:03:52.532 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2918999999999999e-05 2023-09-30T17:03:52.532 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.532 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.532 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:52.532 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728923+0000", 2023-09-30T17:03:52.532 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00012084200000000001 2023-09-30T17:03:52.533 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.533 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.533 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:52.533 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.729101+0000", 2023-09-30T17:03:52.533 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000178226 2023-09-30T17:03:52.533 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.533 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.533 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:52.533 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732207+0000", 2023-09-30T17:03:52.533 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0031059849999999999 2023-09-30T17:03:52.533 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.533 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.534 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:52.534 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.961949+0000", 2023-09-30T17:03:52.534 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.229741842 2023-09-30T17:03:52.534 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.534 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.534 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:52.534 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.961986+0000", 2023-09-30T17:03:52.534 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7147000000000002e-05 2023-09-30T17:03:52.534 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.534 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.534 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:52.535 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.962018+0000", 2023-09-30T17:03:52.535 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.1634000000000002e-05 2023-09-30T17:03:52.535 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:52.535 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:52.535 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:52.535 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.535 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.535 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23768 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 1257472~4096,write 1384448~4096,write 1474560~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:52.535 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.732216+0000", 2023-09-30T17:03:52.535 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 13.748648776, 2023-09-30T17:03:52.535 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22951861000000001, 2023-09-30T17:03:52.536 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:52.536 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:52.536 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:52.536 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:52.536 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:52.536 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23768 2023-09-30T17:03:52.536 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.536 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:52.536 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.536 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:52.536 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732216+0000", 2023-09-30T17:03:52.537 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:52.537 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.537 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.537 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:52.537 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732216+0000", 2023-09-30T17:03:52.537 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:52.537 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.537 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.537 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:52.537 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732216+0000", 2023-09-30T17:03:52.537 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.71e-07 2023-09-30T17:03:52.537 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.538 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.538 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:52.538 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732231+0000", 2023-09-30T17:03:52.538 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5007e-05 2023-09-30T17:03:52.538 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.538 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.538 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:52.538 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732239+0000", 2023-09-30T17:03:52.538 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8509999999999999e-06 2023-09-30T17:03:52.538 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.538 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.538 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:52.539 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732244+0000", 2023-09-30T17:03:52.539 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2000000000000002e-06 2023-09-30T17:03:52.539 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.539 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.539 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:52.539 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732285+0000", 2023-09-30T17:03:52.539 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0877000000000002e-05 2023-09-30T17:03:52.539 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.539 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.539 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:52.539 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732331+0000", 2023-09-30T17:03:52.539 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5906999999999999e-05 2023-09-30T17:03:52.540 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.540 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.540 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:52.540 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732421+0000", 2023-09-30T17:03:52.540 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9993000000000004e-05 2023-09-30T17:03:52.540 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.540 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.540 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:52.540 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.737687+0000", 2023-09-30T17:03:52.540 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005265792 2023-09-30T17:03:52.540 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.541 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.541 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:52.541 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.961667+0000", 2023-09-30T17:03:52.541 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22398030799999999 2023-09-30T17:03:52.541 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.541 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.541 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:52.541 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.961703+0000", 2023-09-30T17:03:52.541 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5221e-05 2023-09-30T17:03:52.541 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.541 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.541 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:52.542 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.961734+0000", 2023-09-30T17:03:52.542 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.1582999999999999e-05 2023-09-30T17:03:52.542 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:52.542 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:52.542 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:52.542 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.542 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.542 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23780 4.36 4:6fa85f86:::100000001f8.00000013:head [write 3469312~4096,write 3522560~4096,write 3579904~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:52.542 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.735686+0000", 2023-09-30T17:03:52.542 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 13.745178545, 2023-09-30T17:03:52.542 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22921459399999999, 2023-09-30T17:03:52.542 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:52.543 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:52.543 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:52.543 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:52.543 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:52.543 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23780 2023-09-30T17:03:52.543 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.543 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:52.543 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.543 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:52.543 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.735686+0000", 2023-09-30T17:03:52.543 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:52.544 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.544 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.544 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:52.544 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.735686+0000", 2023-09-30T17:03:52.544 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:52.544 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.544 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.544 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:52.544 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.735687+0000", 2023-09-30T17:03:52.544 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3399999999999998e-07 2023-09-30T17:03:52.544 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.544 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.545 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:52.545 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.735701+0000", 2023-09-30T17:03:52.545 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4324999999999999e-05 2023-09-30T17:03:52.545 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.545 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.545 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:52.545 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.735713+0000", 2023-09-30T17:03:52.545 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1678999999999999e-05 2023-09-30T17:03:52.545 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.545 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.545 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:52.546 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.735720+0000", 2023-09-30T17:03:52.546 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8490000000000006e-06 2023-09-30T17:03:52.546 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.546 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.546 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:52.546 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.736637+0000", 2023-09-30T17:03:52.546 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00091620799999999995 2023-09-30T17:03:52.546 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.546 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.546 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:52.547 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.736719+0000", 2023-09-30T17:03:52.547 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2608999999999995e-05 2023-09-30T17:03:52.547 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.547 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.547 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:52.547 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.736876+0000", 2023-09-30T17:03:52.547 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015636799999999999 2023-09-30T17:03:52.547 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.547 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.547 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:52.547 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.742934+0000", 2023-09-30T17:03:52.547 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0060581619999999997 2023-09-30T17:03:52.547 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.548 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.548 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:52.548 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.964798+0000", 2023-09-30T17:03:52.548 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22186376599999999 2023-09-30T17:03:52.548 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.548 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.548 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:52.548 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.964859+0000", 2023-09-30T17:03:52.548 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1668000000000007e-05 2023-09-30T17:03:52.548 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.548 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.549 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:52.549 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.964900+0000", 2023-09-30T17:03:52.549 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1125999999999999e-05 2023-09-30T17:03:52.549 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:52.549 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:52.549 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:52.549 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.549 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.549 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23856 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 3538944~4096,write 3616768~4096,write 3686400~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:52.549 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.759274+0000", 2023-09-30T17:03:52.549 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 13.721590664000001, 2023-09-30T17:03:52.549 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.234084127, 2023-09-30T17:03:52.550 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:52.550 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:52.550 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:52.550 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:52.550 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:52.550 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23856 2023-09-30T17:03:52.550 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.550 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:52.550 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.550 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:52.550 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759274+0000", 2023-09-30T17:03:52.551 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:52.551 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.551 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.551 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:52.551 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759274+0000", 2023-09-30T17:03:52.551 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:52.551 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.551 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.551 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:52.551 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759274+0000", 2023-09-30T17:03:52.551 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7899999999999998e-07 2023-09-30T17:03:52.552 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.552 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.552 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:52.552 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759293+0000", 2023-09-30T17:03:52.552 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8410000000000002e-05 2023-09-30T17:03:52.552 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.552 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.552 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:52.552 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759302+0000", 2023-09-30T17:03:52.552 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8599999999999999e-06 2023-09-30T17:03:52.552 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.552 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.553 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:52.553 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759306+0000", 2023-09-30T17:03:52.553 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4499999999999997e-06 2023-09-30T17:03:52.553 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.553 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.553 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:52.553 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759984+0000", 2023-09-30T17:03:52.553 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00067830600000000005 2023-09-30T17:03:52.553 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.553 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.553 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:52.553 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.760041+0000", 2023-09-30T17:03:52.554 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.643e-05 2023-09-30T17:03:52.554 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.554 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.554 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:52.554 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.760135+0000", 2023-09-30T17:03:52.554 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3795999999999994e-05 2023-09-30T17:03:52.554 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.554 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.554 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:52.554 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764097+0000", 2023-09-30T17:03:52.554 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0039625629999999997 2023-09-30T17:03:52.555 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.555 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.555 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:52.555 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993282+0000", 2023-09-30T17:03:52.555 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22918461500000001 2023-09-30T17:03:52.555 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.555 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.555 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:52.555 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993320+0000", 2023-09-30T17:03:52.555 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8600999999999999e-05 2023-09-30T17:03:52.555 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.556 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.556 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:52.556 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993358+0000", 2023-09-30T17:03:52.556 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7517e-05 2023-09-30T17:03:52.556 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:52.556 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:52.556 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:52.556 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.556 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.556 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23865 4.36 4:6da220e6:::100000001f8.0000003f:head [write 3715072~4096,write 3850240~4096,write 4059136~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:52.556 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.761946+0000", 2023-09-30T17:03:52.557 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 13.718918178999999, 2023-09-30T17:03:52.557 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.231486097, 2023-09-30T17:03:52.557 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:52.557 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:52.557 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:52.557 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:52.557 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:52.557 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23865 2023-09-30T17:03:52.557 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.557 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:52.557 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.558 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:52.558 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.761946+0000", 2023-09-30T17:03:52.558 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:52.558 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.558 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.558 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:52.558 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.761946+0000", 2023-09-30T17:03:52.558 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:52.558 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.558 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.558 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:52.558 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.761947+0000", 2023-09-30T17:03:52.559 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7000000000000004e-07 2023-09-30T17:03:52.559 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.559 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.559 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:52.559 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.761959+0000", 2023-09-30T17:03:52.559 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2265e-05 2023-09-30T17:03:52.559 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.559 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.559 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:52.559 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.761970+0000", 2023-09-30T17:03:52.559 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0474e-05 2023-09-30T17:03:52.559 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.560 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.560 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:52.560 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.761976+0000", 2023-09-30T17:03:52.560 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1340000000000001e-06 2023-09-30T17:03:52.560 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.560 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.560 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:52.560 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.762063+0000", 2023-09-30T17:03:52.560 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.6728e-05 2023-09-30T17:03:52.560 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.560 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.561 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:52.561 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.762125+0000", 2023-09-30T17:03:52.561 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2869999999999999e-05 2023-09-30T17:03:52.561 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.561 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.561 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:52.561 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.762235+0000", 2023-09-30T17:03:52.561 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000109139 2023-09-30T17:03:52.561 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.561 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.561 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:52.562 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764102+0000", 2023-09-30T17:03:52.562 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001867121 2023-09-30T17:03:52.562 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.562 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.562 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:52.562 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993327+0000", 2023-09-30T17:03:52.562 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22922526800000001 2023-09-30T17:03:52.562 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.562 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.562 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:52.562 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993391+0000", 2023-09-30T17:03:52.563 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3839999999999999e-05 2023-09-30T17:03:52.563 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.563 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.563 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:52.563 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993432+0000", 2023-09-30T17:03:52.563 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1488e-05 2023-09-30T17:03:52.563 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:52.563 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:52.563 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:52.563 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.563 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.564 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23875 4.36 4:6da220e6:::100000001f8.0000003f:head [write 364544~4096,write 499712~4096,write 655360~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:52.564 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.764904+0000", 2023-09-30T17:03:52.564 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 13.715959995, 2023-09-30T17:03:52.564 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.228631693, 2023-09-30T17:03:52.564 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:52.564 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:52.564 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:52.564 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:52.564 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:52.564 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23875 2023-09-30T17:03:52.564 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.564 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:52.565 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.565 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:52.565 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764904+0000", 2023-09-30T17:03:52.565 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:52.565 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.565 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.565 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:52.565 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764904+0000", 2023-09-30T17:03:52.565 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:52.565 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.565 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.566 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:52.566 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764905+0000", 2023-09-30T17:03:52.566 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2799999999999995e-07 2023-09-30T17:03:52.566 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.566 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.566 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:52.566 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764915+0000", 2023-09-30T17:03:52.566 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8099999999999992e-06 2023-09-30T17:03:52.566 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.566 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.566 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:52.566 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764926+0000", 2023-09-30T17:03:52.567 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0858e-05 2023-09-30T17:03:52.567 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.567 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.567 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:52.567 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764931+0000", 2023-09-30T17:03:52.567 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2170000000000002e-06 2023-09-30T17:03:52.567 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.567 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.567 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:52.567 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764963+0000", 2023-09-30T17:03:52.567 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.2319e-05 2023-09-30T17:03:52.568 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.568 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.568 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:52.568 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.765009+0000", 2023-09-30T17:03:52.568 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5753000000000001e-05 2023-09-30T17:03:52.568 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.568 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.568 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:52.568 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.765093+0000", 2023-09-30T17:03:52.568 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4259999999999996e-05 2023-09-30T17:03:52.568 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.569 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.569 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:52.569 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766238+0000", 2023-09-30T17:03:52.569 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0011442550000000001 2023-09-30T17:03:52.569 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.569 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.569 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:52.569 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993469+0000", 2023-09-30T17:03:52.569 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22723121800000001 2023-09-30T17:03:52.569 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.569 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.569 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:52.570 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993501+0000", 2023-09-30T17:03:52.570 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.2576000000000001e-05 2023-09-30T17:03:52.570 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.570 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.570 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:52.570 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993536+0000", 2023-09-30T17:03:52.570 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4699000000000001e-05 2023-09-30T17:03:52.570 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:52.570 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:52.570 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:52.570 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.571 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.571 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23881 4.36 4:6da220e6:::100000001f8.0000003f:head [write 3366912~4096,write 3694592~4096,write 4071424~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:52.571 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.766444+0000", 2023-09-30T17:03:52.571 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 13.714420574, 2023-09-30T17:03:52.571 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23475070200000001, 2023-09-30T17:03:52.571 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:52.571 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:52.571 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:52.571 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:52.571 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:52.571 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23881 2023-09-30T17:03:52.572 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.572 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:52.572 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.572 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:52.572 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766444+0000", 2023-09-30T17:03:52.572 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:52.572 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.572 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.572 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:52.572 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766444+0000", 2023-09-30T17:03:52.572 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:52.572 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.573 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.573 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:52.573 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766444+0000", 2023-09-30T17:03:52.573 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3e-07 2023-09-30T17:03:52.573 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.573 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.573 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:52.573 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766455+0000", 2023-09-30T17:03:52.573 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0454e-05 2023-09-30T17:03:52.573 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.573 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.574 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:52.574 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766469+0000", 2023-09-30T17:03:52.574 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3568e-05 2023-09-30T17:03:52.574 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.574 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.574 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:52.574 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766474+0000", 2023-09-30T17:03:52.574 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1669999999999998e-06 2023-09-30T17:03:52.574 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.574 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.574 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:52.575 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766527+0000", 2023-09-30T17:03:52.575 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3650000000000003e-05 2023-09-30T17:03:52.575 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.575 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.575 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:52.575 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766611+0000", 2023-09-30T17:03:52.575 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3230000000000001e-05 2023-09-30T17:03:52.575 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.575 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.575 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:52.575 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766767+0000", 2023-09-30T17:03:52.576 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015688 2023-09-30T17:03:52.576 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.576 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.576 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:52.576 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.770254+0000", 2023-09-30T17:03:52.576 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0034870090000000001 2023-09-30T17:03:52.576 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.576 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.576 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:52.576 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.001100+0000", 2023-09-30T17:03:52.576 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23084518700000001 2023-09-30T17:03:52.576 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.577 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.577 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:52.577 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.001154+0000", 2023-09-30T17:03:52.577 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4453000000000002e-05 2023-09-30T17:03:52.577 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.577 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.577 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:52.577 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.001194+0000", 2023-09-30T17:03:52.577 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0373999999999997e-05 2023-09-30T17:03:52.577 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:52.577 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:52.577 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:52.578 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.578 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.578 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23901 4.6 4:63e80496:::100000001f8.0000001e:head [write 2617344~4096,write 2646016~4096,write 2662400~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:52.578 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.772204+0000", 2023-09-30T17:03:52.578 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 13.708660557, 2023-09-30T17:03:52.578 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.228858799, 2023-09-30T17:03:52.578 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:52.578 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:52.578 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:52.578 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:52.578 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:52.579 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23901 2023-09-30T17:03:52.579 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.579 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:52.579 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.579 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:52.579 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772204+0000", 2023-09-30T17:03:52.579 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:52.579 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.579 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.579 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:52.579 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772204+0000", 2023-09-30T17:03:52.580 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:52.580 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.580 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.580 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:52.580 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772205+0000", 2023-09-30T17:03:52.580 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3600000000000002e-07 2023-09-30T17:03:52.580 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.580 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.580 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:52.580 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772217+0000", 2023-09-30T17:03:52.580 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2459999999999999e-05 2023-09-30T17:03:52.580 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.581 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.581 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:52.581 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772228+0000", 2023-09-30T17:03:52.581 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0614e-05 2023-09-30T17:03:52.581 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.581 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.581 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:52.581 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772236+0000", 2023-09-30T17:03:52.581 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7610000000000007e-06 2023-09-30T17:03:52.581 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.581 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.582 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:52.582 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772280+0000", 2023-09-30T17:03:52.582 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4360000000000002e-05 2023-09-30T17:03:52.582 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.582 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.582 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:52.582 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772328+0000", 2023-09-30T17:03:52.582 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8041000000000003e-05 2023-09-30T17:03:52.582 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.582 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.582 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:52.583 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772417+0000", 2023-09-30T17:03:52.583 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9226000000000003e-05 2023-09-30T17:03:52.583 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.583 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.583 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:52.583 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.774997+0000", 2023-09-30T17:03:52.583 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0025795039999999998 2023-09-30T17:03:52.583 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.583 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.583 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:52.583 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.000979+0000", 2023-09-30T17:03:52.583 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22598211700000001 2023-09-30T17:03:52.584 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.584 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.584 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:52.584 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.001025+0000", 2023-09-30T17:03:52.584 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6347999999999997e-05 2023-09-30T17:03:52.584 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.584 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.584 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:52.584 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.001063+0000", 2023-09-30T17:03:52.584 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7431999999999997e-05 2023-09-30T17:03:52.584 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:52.585 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:52.585 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:52.585 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.585 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.585 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23924 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 1196032~4096,write 1249280~4096,write 1294336~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:52.585 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.778807+0000", 2023-09-30T17:03:52.585 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 13.702057698000001, 2023-09-30T17:03:52.585 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23068708600000001, 2023-09-30T17:03:52.585 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:52.585 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:52.585 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:52.586 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:52.586 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:52.586 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23924 2023-09-30T17:03:52.586 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.586 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:52.586 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.586 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:52.586 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778807+0000", 2023-09-30T17:03:52.586 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:52.586 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.587 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.587 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:52.587 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778807+0000", 2023-09-30T17:03:52.587 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:52.587 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.587 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.587 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:52.587 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778807+0000", 2023-09-30T17:03:52.587 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3600000000000003e-07 2023-09-30T17:03:52.587 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.587 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.587 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:52.588 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778832+0000", 2023-09-30T17:03:52.588 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4905999999999998e-05 2023-09-30T17:03:52.588 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.588 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.588 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:52.588 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778839+0000", 2023-09-30T17:03:52.588 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.097e-06 2023-09-30T17:03:52.588 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.588 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.588 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:52.588 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778843+0000", 2023-09-30T17:03:52.589 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8279999999999996e-06 2023-09-30T17:03:52.589 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.589 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.589 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:52.589 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778875+0000", 2023-09-30T17:03:52.589 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.1792000000000003e-05 2023-09-30T17:03:52.589 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.589 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.589 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:52.589 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778922+0000", 2023-09-30T17:03:52.589 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7034999999999999e-05 2023-09-30T17:03:52.590 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.590 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.590 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:52.590 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.779010+0000", 2023-09-30T17:03:52.590 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8305000000000002e-05 2023-09-30T17:03:52.590 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.590 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.590 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:52.590 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.781442+0000", 2023-09-30T17:03:52.590 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0024313550000000001 2023-09-30T17:03:52.590 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.590 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.591 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:52.591 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.009433+0000", 2023-09-30T17:03:52.591 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.227991044 2023-09-30T17:03:52.591 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.591 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.591 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:52.591 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.009471+0000", 2023-09-30T17:03:52.591 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8720999999999997e-05 2023-09-30T17:03:52.591 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.591 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.591 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:52.591 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.009494+0000", 2023-09-30T17:03:52.592 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2367000000000001e-05 2023-09-30T17:03:52.592 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:52.592 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:52.592 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:52.592 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.592 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.592 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23990 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 4157440~4096,write 4186112~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:52.592 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.798667+0000", 2023-09-30T17:03:52.592 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 13.682197183, 2023-09-30T17:03:52.592 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23029929399999999, 2023-09-30T17:03:52.592 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:52.593 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:52.593 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:52.593 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:52.593 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:52.593 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23990 2023-09-30T17:03:52.593 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.593 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:52.593 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.593 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:52.593 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798667+0000", 2023-09-30T17:03:52.593 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:52.593 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.594 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.594 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:52.594 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798667+0000", 2023-09-30T17:03:52.594 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:52.594 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.594 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.594 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:52.594 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798668+0000", 2023-09-30T17:03:52.594 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7000000000000005e-07 2023-09-30T17:03:52.594 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.594 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.595 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:52.595 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798675+0000", 2023-09-30T17:03:52.595 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1269999999999997e-06 2023-09-30T17:03:52.595 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.595 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.595 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:52.595 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798681+0000", 2023-09-30T17:03:52.595 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3500000000000002e-06 2023-09-30T17:03:52.595 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.595 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.595 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:52.596 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798685+0000", 2023-09-30T17:03:52.596 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.63e-06 2023-09-30T17:03:52.596 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.596 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.596 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:52.596 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798726+0000", 2023-09-30T17:03:52.596 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.163e-05 2023-09-30T17:03:52.596 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.596 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.596 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:52.597 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798790+0000", 2023-09-30T17:03:52.597 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3781999999999993e-05 2023-09-30T17:03:52.597 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.597 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.597 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:52.597 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798933+0000", 2023-09-30T17:03:52.597 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014272199999999999 2023-09-30T17:03:52.597 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.597 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.597 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:52.598 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.802788+0000", 2023-09-30T17:03:52.598 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.003855509 2023-09-30T17:03:52.599 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.599 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.599 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:52.599 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.028891+0000", 2023-09-30T17:03:52.599 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.226102847 2023-09-30T17:03:52.599 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.599 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.599 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:52.599 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.028945+0000", 2023-09-30T17:03:52.599 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3600000000000002e-05 2023-09-30T17:03:52.599 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.599 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.600 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:52.600 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.028966+0000", 2023-09-30T17:03:52.600 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1526999999999999e-05 2023-09-30T17:03:52.600 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:52.600 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:52.600 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:52.600 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.600 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.600 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23991 4.6 4:63e80496:::100000001f8.0000001e:head [write 327680~4096,write 335872~4096,write 491520~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:52.600 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.798864+0000", 2023-09-30T17:03:52.600 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 13.682000599, 2023-09-30T17:03:52.601 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23025762699999999, 2023-09-30T17:03:52.601 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:52.601 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:52.601 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:52.601 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:52.601 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:52.601 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23991 2023-09-30T17:03:52.601 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.601 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:52.601 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.601 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:52.601 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798864+0000", 2023-09-30T17:03:52.602 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:52.602 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.602 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.602 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:52.602 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798864+0000", 2023-09-30T17:03:52.602 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:52.602 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.602 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.602 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:52.602 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798864+0000", 2023-09-30T17:03:52.602 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3099999999999998e-07 2023-09-30T17:03:52.603 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.603 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.603 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:52.603 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798873+0000", 2023-09-30T17:03:52.603 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4789999999999996e-06 2023-09-30T17:03:52.603 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.603 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.603 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:52.603 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798878+0000", 2023-09-30T17:03:52.603 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6579999999999999e-06 2023-09-30T17:03:52.603 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.604 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.604 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:52.604 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798882+0000", 2023-09-30T17:03:52.604 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.985e-06 2023-09-30T17:03:52.604 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.604 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.604 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:52.604 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.799659+0000", 2023-09-30T17:03:52.604 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00077693900000000004 2023-09-30T17:03:52.604 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.604 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.605 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:52.605 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.799712+0000", 2023-09-30T17:03:52.605 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2694000000000001e-05 2023-09-30T17:03:52.605 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.605 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.605 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:52.605 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.799796+0000", 2023-09-30T17:03:52.605 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3943999999999995e-05 2023-09-30T17:03:52.605 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.605 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.605 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:52.606 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.802821+0000", 2023-09-30T17:03:52.606 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0030251850000000001 2023-09-30T17:03:52.606 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.606 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.606 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:52.606 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.029027+0000", 2023-09-30T17:03:52.606 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22620609999999999 2023-09-30T17:03:52.606 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.606 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.606 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:52.606 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.029083+0000", 2023-09-30T17:03:52.606 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5926e-05 2023-09-30T17:03:52.607 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.607 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.607 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:52.607 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.029121+0000", 2023-09-30T17:03:52.607 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8186000000000003e-05 2023-09-30T17:03:52.607 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:52.607 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:52.607 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:52.607 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.607 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.607 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:24052 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 3448832~4096,write 3493888~4096,write 3502080~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:52.608 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.817515+0000", 2023-09-30T17:03:52.608 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 13.663349288999999, 2023-09-30T17:03:52.608 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23184106800000001, 2023-09-30T17:03:52.608 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:52.608 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:52.608 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:52.608 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:52.608 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:52.608 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 24052 2023-09-30T17:03:52.608 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.608 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:52.608 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.609 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:52.609 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.817515+0000", 2023-09-30T17:03:52.609 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:52.609 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.609 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.609 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:52.609 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.817515+0000", 2023-09-30T17:03:52.609 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:52.609 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.609 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.609 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:52.610 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.817516+0000", 2023-09-30T17:03:52.610 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9899999999999999e-07 2023-09-30T17:03:52.610 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.610 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.610 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:52.610 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.817531+0000", 2023-09-30T17:03:52.610 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5483000000000001e-05 2023-09-30T17:03:52.610 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.610 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.610 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:52.610 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.817545+0000", 2023-09-30T17:03:52.610 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3209e-05 2023-09-30T17:03:52.611 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.611 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.611 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:52.611 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.817553+0000", 2023-09-30T17:03:52.611 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.994e-06 2023-09-30T17:03:52.611 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.611 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.611 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:52.611 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.818753+0000", 2023-09-30T17:03:52.611 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0012000909999999999 2023-09-30T17:03:52.611 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.611 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.612 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:52.612 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.818838+0000", 2023-09-30T17:03:52.612 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5389999999999994e-05 2023-09-30T17:03:52.612 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.612 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.612 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:52.612 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.818996+0000", 2023-09-30T17:03:52.612 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000158116 2023-09-30T17:03:52.612 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.612 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.612 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:52.612 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.822334+0000", 2023-09-30T17:03:52.613 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0033373230000000001 2023-09-30T17:03:52.613 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.613 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.613 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:52.613 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049259+0000", 2023-09-30T17:03:52.613 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22692517400000001 2023-09-30T17:03:52.613 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.613 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.613 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:52.613 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049323+0000", 2023-09-30T17:03:52.613 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4348000000000001e-05 2023-09-30T17:03:52.614 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.614 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.614 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:52.614 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049356+0000", 2023-09-30T17:03:52.614 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3040999999999998e-05 2023-09-30T17:03:52.614 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:52.614 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:52.614 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:52.614 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.614 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.614 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:24058 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 172032~4096,write 200704~4096,write 249856~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:52.615 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.819363+0000", 2023-09-30T17:03:52.615 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 13.661501812999999, 2023-09-30T17:03:52.615 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23030741099999999, 2023-09-30T17:03:52.615 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:52.615 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:52.615 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:52.615 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:52.615 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:52.615 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 24058 2023-09-30T17:03:52.615 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.615 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:52.616 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.616 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:52.616 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819363+0000", 2023-09-30T17:03:52.616 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:52.616 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.616 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.616 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:52.616 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819363+0000", 2023-09-30T17:03:52.616 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:52.616 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.616 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.616 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:52.617 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819363+0000", 2023-09-30T17:03:52.617 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8400000000000003e-07 2023-09-30T17:03:52.617 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.617 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.617 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:52.617 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819373+0000", 2023-09-30T17:03:52.617 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.9930000000000007e-06 2023-09-30T17:03:52.617 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.617 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.617 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:52.617 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819383+0000", 2023-09-30T17:03:52.618 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.4059999999999994e-06 2023-09-30T17:03:52.618 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.618 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.618 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:52.618 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819388+0000", 2023-09-30T17:03:52.618 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3299999999999998e-06 2023-09-30T17:03:52.618 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.618 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.618 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:52.618 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819584+0000", 2023-09-30T17:03:52.618 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00019642600000000001 2023-09-30T17:03:52.619 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.619 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.619 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:52.619 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819627+0000", 2023-09-30T17:03:52.619 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2150999999999997e-05 2023-09-30T17:03:52.619 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.619 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.619 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:52.619 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819712+0000", 2023-09-30T17:03:52.619 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5255999999999998e-05 2023-09-30T17:03:52.619 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.620 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.620 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:52.620 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.822340+0000", 2023-09-30T17:03:52.620 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0026283029999999998 2023-09-30T17:03:52.620 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.620 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.620 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:52.620 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049621+0000", 2023-09-30T17:03:52.620 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.227281176 2023-09-30T17:03:52.620 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.621 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.621 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:52.621 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049652+0000", 2023-09-30T17:03:52.621 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0528000000000003e-05 2023-09-30T17:03:52.621 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.621 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.621 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:52.621 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049670+0000", 2023-09-30T17:03:52.621 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8057999999999999e-05 2023-09-30T17:03:52.621 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:52.621 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:52.621 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:52.622 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.654 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.654 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:24064 4.6 4:616d4c41:::100000001f8.00000034:head [write 4132864~4096,write 4173824~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:52.654 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.820931+0000", 2023-09-30T17:03:52.654 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 13.659933452000001, 2023-09-30T17:03:52.654 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22854920400000001, 2023-09-30T17:03:52.655 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:52.655 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:52.655 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:52.655 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:52.655 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:52.655 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 24064 2023-09-30T17:03:52.655 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.655 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:52.655 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.655 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:52.655 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.820931+0000", 2023-09-30T17:03:52.655 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:52.656 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.656 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.656 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:52.656 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.820931+0000", 2023-09-30T17:03:52.656 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:52.656 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.656 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.656 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:52.656 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.820932+0000", 2023-09-30T17:03:52.656 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4300000000000002e-07 2023-09-30T17:03:52.656 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.656 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.657 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:52.657 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.820941+0000", 2023-09-30T17:03:52.657 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.5650000000000007e-06 2023-09-30T17:03:52.657 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.657 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.657 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:52.657 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.820952+0000", 2023-09-30T17:03:52.657 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0566e-05 2023-09-30T17:03:52.657 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.657 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.657 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:52.657 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.820957+0000", 2023-09-30T17:03:52.658 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3800000000000002e-06 2023-09-30T17:03:52.658 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.658 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.658 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:52.658 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.821008+0000", 2023-09-30T17:03:52.658 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1070999999999999e-05 2023-09-30T17:03:52.658 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.658 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.658 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:52.658 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.821075+0000", 2023-09-30T17:03:52.658 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.648e-05 2023-09-30T17:03:52.658 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.658 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.659 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:52.677 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.821236+0000", 2023-09-30T17:03:52.677 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016120899999999999 2023-09-30T17:03:52.677 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.677 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.677 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:52.678 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.823356+0000", 2023-09-30T17:03:52.678 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.002120458 2023-09-30T17:03:52.678 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.678 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.678 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:52.678 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049389+0000", 2023-09-30T17:03:52.678 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22603278199999999 2023-09-30T17:03:52.678 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.678 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.678 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:52.678 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049443+0000", 2023-09-30T17:03:52.679 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4033000000000003e-05 2023-09-30T17:03:52.679 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:52.679 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:52.679 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:52.679 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049480+0000", 2023-09-30T17:03:52.679 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6816999999999997e-05 2023-09-30T17:03:52.679 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:52.679 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:52.679 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:52.679 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:52.679 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:52.679 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:52.681 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:03:52.682 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:52.680+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:52.781 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:52.781+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:52.876 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:52.876 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2023-09-30T17:03:52.877 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.877 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:62714 4.35 4:af28909f:::100000001f8.0000001b:head [write 1363968~4096 in=4096b,write 1400832~4096 in=4096b,write 1441792~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-09-30T17:03:52.877 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:52.872378+0000", 2023-09-30T17:03:52.877 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.002538092, 2023-09-30T17:03:52.877 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0025666130000000001, 2023-09-30T17:03:52.877 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:52.877 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:52.877 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:52.877 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:52.877 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:52.878 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 62714 2023-09-30T17:03:52.878 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.878 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:52.878 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.878 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:52.878 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.872378+0000", 2023-09-30T17:03:52.878 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:52.878 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.878 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.879 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:52.879 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.872378+0000", 2023-09-30T17:03:52.879 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:52.879 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.879 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.879 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:52.879 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.872379+0000", 2023-09-30T17:03:52.879 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9199999999999999e-07 2023-09-30T17:03:52.879 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.879 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.880 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:52.880 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.872390+0000", 2023-09-30T17:03:52.880 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1769e-05 2023-09-30T17:03:52.880 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.880 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.880 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:52.880 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.872402+0000", 2023-09-30T17:03:52.880 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1622e-05 2023-09-30T17:03:52.880 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.881 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.881 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:52.881 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.872409+0000", 2023-09-30T17:03:52.881 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4089999999999997e-06 2023-09-30T17:03:52.881 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.881 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.881 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:52.881 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.872453+0000", 2023-09-30T17:03:52.881 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4135999999999999e-05 2023-09-30T17:03:52.881 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.882 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.882 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:52.882 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.872504+0000", 2023-09-30T17:03:52.882 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0445000000000002e-05 2023-09-30T17:03:52.882 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:52.882 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:52.882 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:52.882 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.882 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.883 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:62713 4.2e e45/17 4:75be0f36:::100000001f8.0000003d:head v 45'973, mlcod=45'970)", 2023-09-30T17:03:52.883 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:52.872473+0000", 2023-09-30T17:03:52.883 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0024430089999999999, 2023-09-30T17:03:52.883 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002527493, 2023-09-30T17:03:52.883 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:52.883 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:52.883 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:52.883 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.883 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:52.883 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.872473+0000", 2023-09-30T17:03:52.884 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:52.884 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.884 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.884 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:52.884 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.872473+0000", 2023-09-30T17:03:52.884 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:52.884 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.884 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.884 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:52.885 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.872473+0000", 2023-09-30T17:03:52.885 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3099999999999998e-07 2023-09-30T17:03:52.885 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.885 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.885 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:52.885 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.872486+0000", 2023-09-30T17:03:52.885 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2386e-05 2023-09-30T17:03:52.886 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.886 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.886 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:52.886 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.872493+0000", 2023-09-30T17:03:52.886 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1570000000000003e-06 2023-09-30T17:03:52.886 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.886 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.886 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:52.886 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.872498+0000", 2023-09-30T17:03:52.887 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0350000000000001e-06 2023-09-30T17:03:52.887 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.887 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.887 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:52.887 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.872568+0000", 2023-09-30T17:03:52.887 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0011000000000004e-05 2023-09-30T17:03:52.887 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.887 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.888 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:52.888 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.872586+0000", 2023-09-30T17:03:52.888 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8227e-05 2023-09-30T17:03:52.888 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:52.888 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:52.888 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:52.889 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.889 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.889 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:62715 4.12 4:4be51a30:::100000001f8.0000000b:head [write 2588672~4096 in=4096b,write 2596864~4096 in=4096b,write 2715648~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-09-30T17:03:52.889 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:52.872884+0000", 2023-09-30T17:03:52.889 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0020315789999999999, 2023-09-30T17:03:52.889 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0021561829999999999, 2023-09-30T17:03:52.889 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:52.889 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:52.889 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:52.889 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:52.890 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:52.890 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 62715 2023-09-30T17:03:52.890 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.890 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:52.890 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.890 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:52.891 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.872884+0000", 2023-09-30T17:03:52.891 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:52.891 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.891 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.891 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:52.891 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.872884+0000", 2023-09-30T17:03:52.891 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:52.891 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.891 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.892 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:52.892 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.872885+0000", 2023-09-30T17:03:52.892 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8800000000000002e-07 2023-09-30T17:03:52.892 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.892 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.892 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:52.892 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.872895+0000", 2023-09-30T17:03:52.892 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0609e-05 2023-09-30T17:03:52.893 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.893 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.893 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:52.893 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.872908+0000", 2023-09-30T17:03:52.893 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2459999999999999e-05 2023-09-30T17:03:52.893 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.893 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.893 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:52.894 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.872915+0000", 2023-09-30T17:03:52.894 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2760000000000003e-06 2023-09-30T17:03:52.894 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.894 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.894 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:52.894 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.872969+0000", 2023-09-30T17:03:52.894 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3587e-05 2023-09-30T17:03:52.895 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.895 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.895 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:52.895 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.873059+0000", 2023-09-30T17:03:52.896 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0017000000000002e-05 2023-09-30T17:03:52.896 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.896 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.896 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:52.896 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.873202+0000", 2023-09-30T17:03:52.896 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014283899999999999 2023-09-30T17:03:52.896 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:52.897 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:52.897 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:52.897 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.897 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.897 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:62716 4.c 4:33b8095f:::100000001f8.0000003a:head [write 2965504~4096 in=4096b,write 2973696~4096 in=4096b,write 3006464~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-09-30T17:03:52.897 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:52.873532+0000", 2023-09-30T17:03:52.897 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.001383333, 2023-09-30T17:03:52.898 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001552592, 2023-09-30T17:03:52.898 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:52.898 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:52.898 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:52.898 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:52.899 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:52.899 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 62716 2023-09-30T17:03:52.899 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.899 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:52.899 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.899 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:52.899 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.873532+0000", 2023-09-30T17:03:52.899 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:52.900 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.900 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.900 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:52.900 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.873532+0000", 2023-09-30T17:03:52.900 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:52.900 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.900 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.900 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:52.900 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.873533+0000", 2023-09-30T17:03:52.901 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9100000000000003e-07 2023-09-30T17:03:52.901 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.901 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.901 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:52.901 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.873545+0000", 2023-09-30T17:03:52.901 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1773000000000001e-05 2023-09-30T17:03:52.901 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.902 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.902 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:52.902 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.873556+0000", 2023-09-30T17:03:52.902 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0958000000000001e-05 2023-09-30T17:03:52.902 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.903 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.903 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:52.903 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.873563+0000", 2023-09-30T17:03:52.903 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2470000000000002e-06 2023-09-30T17:03:52.903 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.903 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.903 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:52.903 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.873615+0000", 2023-09-30T17:03:52.903 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1768999999999999e-05 2023-09-30T17:03:52.903 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.904 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.904 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:52.904 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.873694+0000", 2023-09-30T17:03:52.904 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.941e-05 2023-09-30T17:03:52.904 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:52.904 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:52.904 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:52.904 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.904 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.904 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(client.4547.0:62666 4.37 e45/17)", 2023-09-30T17:03:52.905 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:52.873619+0000", 2023-09-30T17:03:52.905 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0012963709999999999, 2023-09-30T17:03:52.905 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0015029030000000001, 2023-09-30T17:03:52.905 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:52.905 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:52.905 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:52.906 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.906 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:52.906 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.873619+0000", 2023-09-30T17:03:52.906 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:52.906 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.906 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.906 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:52.906 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.873619+0000", 2023-09-30T17:03:52.907 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:52.907 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.907 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.907 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:52.907 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.873620+0000", 2023-09-30T17:03:52.907 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0699999999999998e-07 2023-09-30T17:03:52.907 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.907 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.907 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:52.908 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.873623+0000", 2023-09-30T17:03:52.908 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.954e-06 2023-09-30T17:03:52.908 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.908 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.908 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:52.908 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.873632+0000", 2023-09-30T17:03:52.908 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7750000000000004e-06 2023-09-30T17:03:52.908 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.908 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.908 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:52.909 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.873638+0000", 2023-09-30T17:03:52.909 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.665e-06 2023-09-30T17:03:52.909 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:52.909 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:52.909 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:52.909 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.909 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.909 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(client.4547.0:62686 4.f e45/17)", 2023-09-30T17:03:52.909 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:52.873647+0000", 2023-09-30T17:03:52.909 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0012684549999999999, 2023-09-30T17:03:52.910 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0015009999999999999, 2023-09-30T17:03:52.910 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:52.910 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:52.910 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:52.910 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.910 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:52.910 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.873647+0000", 2023-09-30T17:03:52.910 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:52.910 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.910 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.911 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:52.911 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.873647+0000", 2023-09-30T17:03:52.911 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:52.911 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.911 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.911 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:52.911 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.873647+0000", 2023-09-30T17:03:52.911 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3200000000000001e-07 2023-09-30T17:03:52.911 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.911 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.912 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:52.912 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.873649+0000", 2023-09-30T17:03:52.912 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.813e-06 2023-09-30T17:03:52.912 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.912 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.912 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:52.912 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.873655+0000", 2023-09-30T17:03:52.912 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4090000000000002e-06 2023-09-30T17:03:52.912 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.912 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.913 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:52.913 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.873659+0000", 2023-09-30T17:03:52.913 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9060000000000004e-06 2023-09-30T17:03:52.913 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:52.913 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:52.913 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:52.913 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.913 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.914 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:62683 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 2252800~8192 in=8192b,write 2293760~4096 in=4096b,write 2306048~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-09-30T17:03:52.914 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:52.862113+0000", 2023-09-30T17:03:52.914 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.012803132, 2023-09-30T17:03:52.914 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013066279, 2023-09-30T17:03:52.914 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:52.914 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:52.914 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:52.915 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:52.915 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:52.915 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 62683 2023-09-30T17:03:52.915 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.915 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:52.915 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.915 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:52.916 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.862113+0000", 2023-09-30T17:03:52.916 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:52.916 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.916 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.916 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:52.917 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.862113+0000", 2023-09-30T17:03:52.917 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:52.917 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.917 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.917 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:52.917 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.862113+0000", 2023-09-30T17:03:52.917 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.61e-07 2023-09-30T17:03:52.917 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.917 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.917 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:52.918 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.862127+0000", 2023-09-30T17:03:52.918 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3417e-05 2023-09-30T17:03:52.918 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.918 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.918 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:52.918 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.862136+0000", 2023-09-30T17:03:52.918 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8880000000000003e-06 2023-09-30T17:03:52.918 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.918 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.919 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:52.919 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.862142+0000", 2023-09-30T17:03:52.919 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9660000000000001e-06 2023-09-30T17:03:52.919 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.919 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.919 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:52.919 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.863688+0000", 2023-09-30T17:03:52.919 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0015468229999999999 2023-09-30T17:03:52.920 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.920 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.920 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:52.920 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.863786+0000", 2023-09-30T17:03:52.920 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7250000000000006e-05 2023-09-30T17:03:52.920 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:52.920 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:52.920 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:52.921 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.921 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.921 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(client.4547.0:62687 4.f e45/17)", 2023-09-30T17:03:52.921 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:52.873665+0000", 2023-09-30T17:03:52.921 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.001250583, 2023-09-30T17:03:52.921 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0015486779999999999, 2023-09-30T17:03:52.921 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:52.922 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:52.922 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:52.922 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.922 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:52.922 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.873665+0000", 2023-09-30T17:03:52.922 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:52.922 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.922 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.922 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:52.922 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.873665+0000", 2023-09-30T17:03:52.922 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:52.922 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.923 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.923 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:52.923 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.873665+0000", 2023-09-30T17:03:52.925 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.72e-07 2023-09-30T17:03:52.925 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.925 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.925 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:52.925 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.873667+0000", 2023-09-30T17:03:52.925 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4890000000000001e-06 2023-09-30T17:03:52.925 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.925 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.925 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:52.926 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.873672+0000", 2023-09-30T17:03:52.926 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0170000000000004e-06 2023-09-30T17:03:52.926 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.926 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.926 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:52.926 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.873676+0000", 2023-09-30T17:03:52.926 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7890000000000001e-06 2023-09-30T17:03:52.926 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:52.926 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:52.926 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:52.926 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.926 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.927 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:62717 4.14 e45/17 4:2b28d75f:::100000001f8.00000016:head v 45'968, mlcod=45'966)", 2023-09-30T17:03:52.927 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:52.874187+0000", 2023-09-30T17:03:52.927 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.00072843699999999996, 2023-09-30T17:03:52.927 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001055121, 2023-09-30T17:03:52.927 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:52.927 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:52.927 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:52.927 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.927 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:52.927 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.874187+0000", 2023-09-30T17:03:52.927 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:52.928 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.928 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.928 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:52.928 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.874187+0000", 2023-09-30T17:03:52.928 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:52.928 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.928 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.928 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:52.928 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.874188+0000", 2023-09-30T17:03:52.928 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8299999999999997e-07 2023-09-30T17:03:52.928 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.928 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.928 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:52.929 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.874203+0000", 2023-09-30T17:03:52.929 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5199e-05 2023-09-30T17:03:52.929 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.929 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.929 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:52.929 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.874211+0000", 2023-09-30T17:03:52.929 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8839999999999994e-06 2023-09-30T17:03:52.929 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.929 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.929 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:52.929 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.874218+0000", 2023-09-30T17:03:52.930 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3869999999999997e-06 2023-09-30T17:03:52.930 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.930 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.930 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:52.930 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.874262+0000", 2023-09-30T17:03:52.930 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4242000000000001e-05 2023-09-30T17:03:52.930 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.930 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.930 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:52.930 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.874283+0000", 2023-09-30T17:03:52.930 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0247000000000001e-05 2023-09-30T17:03:52.931 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:52.931 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:52.931 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:52.931 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.931 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.931 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:62686 4.f 4:f0d983b2:::100000001f8.0000001f:head [write 3104768~4096 in=4096b,write 3198976~4096 in=4096b,write 3264512~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-09-30T17:03:52.931 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:52.863442+0000", 2023-09-30T17:03:52.931 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.011473242, 2023-09-30T17:03:52.931 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011835760000000001, 2023-09-30T17:03:52.931 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:52.931 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:52.932 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:52.932 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:52.932 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:52.932 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 62686 2023-09-30T17:03:52.932 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.932 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:52.932 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.932 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:52.932 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.863442+0000", 2023-09-30T17:03:52.932 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:52.933 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.933 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.933 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:52.933 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.863442+0000", 2023-09-30T17:03:52.933 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:52.933 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.933 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.933 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:52.933 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.863443+0000", 2023-09-30T17:03:52.933 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3099999999999996e-07 2023-09-30T17:03:52.933 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.934 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.934 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:52.934 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.863456+0000", 2023-09-30T17:03:52.934 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.239e-05 2023-09-30T17:03:52.934 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.934 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.934 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:52.934 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.863465+0000", 2023-09-30T17:03:52.934 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6730000000000004e-06 2023-09-30T17:03:52.934 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.934 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.934 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:52.935 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.863475+0000", 2023-09-30T17:03:52.935 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2900000000000008e-06 2023-09-30T17:03:52.935 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.935 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.935 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:52.935 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.864867+0000", 2023-09-30T17:03:52.935 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0013918240000000001 2023-09-30T17:03:52.935 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.935 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.936 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:52.936 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.864948+0000", 2023-09-30T17:03:52.936 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1724000000000006e-05 2023-09-30T17:03:52.936 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.936 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.936 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:52.936 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.865113+0000", 2023-09-30T17:03:52.936 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000164501 2023-09-30T17:03:52.937 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:52.937 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:52.937 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:52.937 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.937 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.937 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:62718 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-09-30T17:03:52.937 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:52.874573+0000", 2023-09-30T17:03:52.937 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.000342391, 2023-09-30T17:03:52.937 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00074458599999999999, 2023-09-30T17:03:52.937 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:52.937 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:52.938 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:52.938 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:52.938 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:52.938 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 62718 2023-09-30T17:03:52.938 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.938 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:52.938 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.938 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:52.938 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.874573+0000", 2023-09-30T17:03:52.938 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:52.938 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.939 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.939 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:52.939 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.874573+0000", 2023-09-30T17:03:52.939 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:52.939 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.939 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.939 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:52.939 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.874574+0000", 2023-09-30T17:03:52.939 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7700000000000004e-07 2023-09-30T17:03:52.939 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.939 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.939 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:52.940 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.874586+0000", 2023-09-30T17:03:52.940 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1771e-05 2023-09-30T17:03:52.940 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.940 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.940 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:52.940 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.874615+0000", 2023-09-30T17:03:52.940 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9119e-05 2023-09-30T17:03:52.940 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.940 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.940 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:52.941 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.874623+0000", 2023-09-30T17:03:52.941 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4749999999999993e-06 2023-09-30T17:03:52.941 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:52.941 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:52.941 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:52.941 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.941 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.941 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:62687 4.f 4:f26fdfa9:::100000001f8.00000002:head [write 2310144~4096 in=4096b,write 2318336~4096 in=4096b,write 2617344~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-09-30T17:03:52.941 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:52.863527+0000", 2023-09-30T17:03:52.942 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.011388451000000001, 2023-09-30T17:03:52.942 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011823355000000001, 2023-09-30T17:03:52.942 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:52.942 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:52.942 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:52.942 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:52.942 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:52.942 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 62687 2023-09-30T17:03:52.942 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.942 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:52.942 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.943 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:52.943 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.863527+0000", 2023-09-30T17:03:52.943 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:52.943 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.943 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.943 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:52.943 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.863527+0000", 2023-09-30T17:03:52.943 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:52.943 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.943 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.943 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:52.944 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.863528+0000", 2023-09-30T17:03:52.944 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8199999999999999e-07 2023-09-30T17:03:52.944 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.944 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.944 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:52.944 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.863542+0000", 2023-09-30T17:03:52.944 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3652000000000001e-05 2023-09-30T17:03:52.944 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.944 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.944 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:52.944 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.863552+0000", 2023-09-30T17:03:52.944 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0475000000000001e-05 2023-09-30T17:03:52.944 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.945 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.945 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:52.945 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.863558+0000", 2023-09-30T17:03:52.945 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3489999999999997e-06 2023-09-30T17:03:52.945 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.945 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.945 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:52.945 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.869036+0000", 2023-09-30T17:03:52.945 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054777810000000001 2023-09-30T17:03:52.945 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.945 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.945 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:52.946 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.869118+0000", 2023-09-30T17:03:52.946 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2045999999999993e-05 2023-09-30T17:03:52.946 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.946 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.946 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:52.946 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.869264+0000", 2023-09-30T17:03:52.946 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014619899999999999 2023-09-30T17:03:52.946 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:52.946 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:52.946 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:52.946 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.947 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.947 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:62690 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 532480~4096 in=4096b,write 770048~4096 in=4096b,write 806912~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-09-30T17:03:52.947 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:52.864546+0000", 2023-09-30T17:03:52.947 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.010369793, 2023-09-30T17:03:52.947 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.01084688, 2023-09-30T17:03:52.947 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:52.947 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:52.947 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:52.947 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:52.947 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:52.947 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 62690 2023-09-30T17:03:52.947 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.948 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:52.948 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.948 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:52.948 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.864546+0000", 2023-09-30T17:03:52.948 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:52.948 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.948 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.948 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:52.948 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.864546+0000", 2023-09-30T17:03:52.948 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:52.948 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.948 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.949 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:52.949 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.864547+0000", 2023-09-30T17:03:52.949 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1500000000000003e-07 2023-09-30T17:03:52.949 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.949 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.949 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:52.949 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.864557+0000", 2023-09-30T17:03:52.949 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.045e-05 2023-09-30T17:03:52.949 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.949 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.950 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:52.950 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.864570+0000", 2023-09-30T17:03:52.950 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2531000000000001e-05 2023-09-30T17:03:52.950 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.950 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.950 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:52.950 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.864577+0000", 2023-09-30T17:03:52.950 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4989999999999997e-06 2023-09-30T17:03:52.950 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.950 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.951 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:52.951 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.871369+0000", 2023-09-30T17:03:52.951 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0067918980000000002 2023-09-30T17:03:52.951 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.951 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.951 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:52.951 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.871445+0000", 2023-09-30T17:03:52.951 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6297999999999994e-05 2023-09-30T17:03:52.951 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.951 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.951 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:52.951 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.871552+0000", 2023-09-30T17:03:52.952 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010610199999999999 2023-09-30T17:03:52.952 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:52.952 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:52.952 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:52.952 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.952 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.952 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:62666 4.37 4:eff9002a:::100000001f8.00000003:head [write 3895296~4096 in=4096b,write 3915776~4096 in=4096b,write 3936256~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-09-30T17:03:52.952 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:52.855464+0000", 2023-09-30T17:03:52.952 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.019451949999999999, 2023-09-30T17:03:52.952 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019979534, 2023-09-30T17:03:52.952 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:52.952 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:52.953 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:52.953 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:52.953 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:52.953 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 62666 2023-09-30T17:03:52.953 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.953 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:52.953 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.953 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:52.953 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.855464+0000", 2023-09-30T17:03:52.953 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:52.953 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.953 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.954 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:52.954 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.855464+0000", 2023-09-30T17:03:52.954 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:52.954 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.954 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.954 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:52.954 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.855465+0000", 2023-09-30T17:03:52.954 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6400000000000001e-07 2023-09-30T17:03:52.954 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.954 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.954 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:52.955 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.855476+0000", 2023-09-30T17:03:52.955 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1476e-05 2023-09-30T17:03:52.955 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.955 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.955 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:52.955 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.855487+0000", 2023-09-30T17:03:52.955 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1241e-05 2023-09-30T17:03:52.955 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.955 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.955 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:52.955 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.855495+0000", 2023-09-30T17:03:52.955 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8690000000000004e-06 2023-09-30T17:03:52.956 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.956 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.956 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:52.956 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.861494+0000", 2023-09-30T17:03:52.956 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059988489999999997 2023-09-30T17:03:52.956 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.956 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.956 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:52.956 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.861568+0000", 2023-09-30T17:03:52.956 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3610999999999997e-05 2023-09-30T17:03:52.956 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.956 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.957 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:52.957 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.861695+0000", 2023-09-30T17:03:52.957 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000127198 2023-09-30T17:03:52.957 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:52.957 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:52.957 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:52.957 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.957 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.957 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:62701 4.38 4:1d13bf87:::100000001f8.00000030:head [write 1171456~4096 in=4096b,write 1187840~4096 in=4096b,write 1646592~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-09-30T17:03:52.957 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:52.868533+0000", 2023-09-30T17:03:52.957 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0063830390000000001, 2023-09-30T17:03:52.958 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0069532140000000001, 2023-09-30T17:03:52.958 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:52.958 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:52.958 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:52.958 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:52.958 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:52.958 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 62701 2023-09-30T17:03:52.958 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.958 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:52.958 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.958 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:52.959 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.868533+0000", 2023-09-30T17:03:52.959 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:52.959 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.959 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.959 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:52.959 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.868533+0000", 2023-09-30T17:03:52.959 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:52.959 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.959 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.959 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:52.959 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.868534+0000", 2023-09-30T17:03:52.959 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3230000000000001e-06 2023-09-30T17:03:52.960 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.960 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.960 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:52.960 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.868551+0000", 2023-09-30T17:03:52.960 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6599000000000002e-05 2023-09-30T17:03:52.960 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.960 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.960 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:52.960 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.868563+0000", 2023-09-30T17:03:52.960 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2201000000000001e-05 2023-09-30T17:03:52.960 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.961 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.961 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:52.961 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.868571+0000", 2023-09-30T17:03:52.961 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8199999999999997e-06 2023-09-30T17:03:52.961 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.961 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.961 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:52.961 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.869272+0000", 2023-09-30T17:03:52.961 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00070169799999999995 2023-09-30T17:03:52.961 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.961 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.961 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:52.962 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.869359+0000", 2023-09-30T17:03:52.962 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6923999999999996e-05 2023-09-30T17:03:52.962 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:52.962 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:52.962 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:52.962 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.962 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.962 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:62702 4.36 e45/17 4:6da220e6:::100000001f8.0000003f:head v 45'2955, mlcod=45'2952)", 2023-09-30T17:03:52.962 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:52.868874+0000", 2023-09-30T17:03:52.962 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0060414500000000003, 2023-09-30T17:03:52.962 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0066739520000000004, 2023-09-30T17:03:52.963 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:52.963 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:52.963 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:52.963 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.963 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:52.963 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.868874+0000", 2023-09-30T17:03:52.963 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:52.963 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.963 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.963 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:52.963 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.868874+0000", 2023-09-30T17:03:52.964 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:52.964 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.964 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.964 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:52.964 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.868875+0000", 2023-09-30T17:03:52.964 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1600000000000001e-07 2023-09-30T17:03:52.965 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.965 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.965 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:52.965 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.868894+0000", 2023-09-30T17:03:52.965 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9343000000000001e-05 2023-09-30T17:03:52.965 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.966 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.966 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:52.966 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.868902+0000", 2023-09-30T17:03:52.966 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0409999999999998e-06 2023-09-30T17:03:52.966 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.966 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.966 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:52.966 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.868908+0000", 2023-09-30T17:03:52.966 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0249999999999999e-06 2023-09-30T17:03:52.967 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.967 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.967 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:52.967 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.870040+0000", 2023-09-30T17:03:52.967 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0011314470000000001 2023-09-30T17:03:52.967 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.967 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.968 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:52.968 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.870058+0000", 2023-09-30T17:03:52.968 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8176999999999999e-05 2023-09-30T17:03:52.968 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:52.968 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:52.968 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:52.968 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.968 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.969 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:62705 4.38 4:1d13bf87:::100000001f8.00000030:head [write 225280~4096 in=4096b,write 253952~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-09-30T17:03:52.969 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:52.869160+0000", 2023-09-30T17:03:52.969 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0057561289999999996, 2023-09-30T17:03:52.969 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064566249999999997, 2023-09-30T17:03:52.969 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:52.969 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:52.969 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:52.970 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:52.970 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:52.970 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 62705 2023-09-30T17:03:52.970 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.970 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:52.970 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.970 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:52.970 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.869160+0000", 2023-09-30T17:03:52.971 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:52.971 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.971 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.971 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:52.971 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.869160+0000", 2023-09-30T17:03:52.971 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:52.971 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.972 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.972 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:52.972 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.869160+0000", 2023-09-30T17:03:52.972 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7199999999999998e-07 2023-09-30T17:03:52.972 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.972 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.972 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:52.973 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.869169+0000", 2023-09-30T17:03:52.973 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3790000000000006e-06 2023-09-30T17:03:52.973 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.973 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.973 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:52.973 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.869176+0000", 2023-09-30T17:03:52.973 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3440000000000003e-06 2023-09-30T17:03:52.973 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.973 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.973 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:52.973 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.869181+0000", 2023-09-30T17:03:52.973 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2859999999999999e-06 2023-09-30T17:03:52.974 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.974 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.974 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:52.974 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.871885+0000", 2023-09-30T17:03:52.974 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0027038959999999999 2023-09-30T17:03:52.974 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.974 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.974 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:52.974 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.871931+0000", 2023-09-30T17:03:52.974 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6142e-05 2023-09-30T17:03:52.974 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:52.975 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:52.975 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:52.975 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.975 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.975 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:62708 4.38 4:1dcf718c:::100000001f8.00000022:head [write 3502080~4096 in=4096b,write 3526656~4096 in=4096b,write 3682304~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-09-30T17:03:52.975 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:52.870097+0000", 2023-09-30T17:03:52.975 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0048191090000000002, 2023-09-30T17:03:52.975 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0055989489999999998, 2023-09-30T17:03:52.975 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:52.975 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:52.975 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:52.975 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:52.976 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:52.976 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 62708 2023-09-30T17:03:52.976 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.976 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:52.976 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.976 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:52.976 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.870097+0000", 2023-09-30T17:03:52.976 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:52.976 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.976 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.976 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:52.976 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.870097+0000", 2023-09-30T17:03:52.977 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:52.977 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.977 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.977 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:52.977 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.870097+0000", 2023-09-30T17:03:52.977 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2399999999999997e-07 2023-09-30T17:03:52.977 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.977 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.977 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:52.977 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.870108+0000", 2023-09-30T17:03:52.977 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0852e-05 2023-09-30T17:03:52.977 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.977 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.978 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:52.978 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.870117+0000", 2023-09-30T17:03:52.978 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0690000000000008e-06 2023-09-30T17:03:52.978 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.978 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.978 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:52.978 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.870124+0000", 2023-09-30T17:03:52.978 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6560000000000003e-06 2023-09-30T17:03:52.978 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.978 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.978 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:52.979 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.873999+0000", 2023-09-30T17:03:52.979 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003874588 2023-09-30T17:03:52.979 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.979 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.979 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:52.979 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.874076+0000", 2023-09-30T17:03:52.979 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7631000000000003e-05 2023-09-30T17:03:52.979 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:52.979 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:52.979 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:52.980 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.980 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.980 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:62709 4.37 4:ef395e89:::100000001f8.00000020:head [write 2699264~4096 in=4096b,write 2879488~4096 in=4096b,write 2912256~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-09-30T17:03:52.980 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:52.870157+0000", 2023-09-30T17:03:52.980 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0047586540000000002, 2023-09-30T17:03:52.980 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056126800000000001, 2023-09-30T17:03:52.980 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:52.980 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:52.980 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:52.980 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:52.980 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:52.981 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 62709 2023-09-30T17:03:52.981 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.981 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:52.981 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.981 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:52.981 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.870157+0000", 2023-09-30T17:03:52.981 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:52.981 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.981 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.981 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:52.981 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.870157+0000", 2023-09-30T17:03:52.982 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:52.982 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.982 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.982 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:52.982 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.870158+0000", 2023-09-30T17:03:52.982 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7599999999999997e-07 2023-09-30T17:03:52.982 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.982 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.982 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:52.982 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.870177+0000", 2023-09-30T17:03:52.982 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9105000000000001e-05 2023-09-30T17:03:52.983 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.983 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.983 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:52.983 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.870185+0000", 2023-09-30T17:03:52.983 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1089999999999998e-06 2023-09-30T17:03:52.983 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.983 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.983 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:52.983 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.870191+0000", 2023-09-30T17:03:52.983 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0240000000000003e-06 2023-09-30T17:03:52.983 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.983 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.984 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:52.984 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.873220+0000", 2023-09-30T17:03:52.984 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0030294530000000001 2023-09-30T17:03:52.984 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.984 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.984 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:52.984 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.873294+0000", 2023-09-30T17:03:52.984 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3388999999999998e-05 2023-09-30T17:03:52.984 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.984 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.984 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:52.984 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.873383+0000", 2023-09-30T17:03:52.985 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9190000000000005e-05 2023-09-30T17:03:52.985 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:52.985 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:52.985 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:52.985 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.985 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.985 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:62677 4.38 4:1fc350da:::100000001f8.0000002f:head [write 471040~4096 in=4096b,write 512000~4096 in=4096b,write 544768~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-09-30T17:03:52.985 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:52.859184+0000", 2023-09-30T17:03:52.985 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.015731451, 2023-09-30T17:03:52.985 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016675998000000001, 2023-09-30T17:03:52.985 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:52.986 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:52.986 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:52.986 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:52.986 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:52.986 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 62677 2023-09-30T17:03:52.986 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.986 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:52.986 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.986 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:52.986 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.859184+0000", 2023-09-30T17:03:52.987 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:52.987 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.987 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.987 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:52.987 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.859184+0000", 2023-09-30T17:03:52.987 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:52.987 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.987 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.987 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:52.987 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.859185+0000", 2023-09-30T17:03:52.987 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4499999999999996e-07 2023-09-30T17:03:52.987 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.988 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:52.988 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.859196+0000", 2023-09-30T17:03:52.988 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1172000000000001e-05 2023-09-30T17:03:52.988 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.988 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:52.988 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.859207+0000", 2023-09-30T17:03:52.988 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0975000000000001e-05 2023-09-30T17:03:52.988 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.988 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:52.988 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.859215+0000", 2023-09-30T17:03:52.989 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9030000000000004e-06 2023-09-30T17:03:52.989 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.989 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.989 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:52.989 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.865933+0000", 2023-09-30T17:03:52.989 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0067183210000000002 2023-09-30T17:03:52.989 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.989 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.989 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:52.989 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.866022+0000", 2023-09-30T17:03:52.989 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8510000000000005e-05 2023-09-30T17:03:52.989 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:52.989 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:52.990 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:52.990 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.990 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.990 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:62710 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 3399680~4096 in=4096b,write 3465216~4096 in=4096b,write 3489792~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-09-30T17:03:52.990 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:52.870569+0000", 2023-09-30T17:03:52.990 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0043468739999999997, 2023-09-30T17:03:52.990 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053702359999999996, 2023-09-30T17:03:52.990 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:52.990 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:52.990 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:52.990 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:52.991 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:52.991 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 62710 2023-09-30T17:03:52.991 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.991 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:52.991 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.991 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:52.991 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.870569+0000", 2023-09-30T17:03:52.991 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:52.991 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.991 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.991 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:52.991 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.870569+0000", 2023-09-30T17:03:52.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:52.992 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:52.992 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.870570+0000", 2023-09-30T17:03:52.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4600000000000003e-07 2023-09-30T17:03:52.992 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:52.992 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.870587+0000", 2023-09-30T17:03:52.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7632999999999999e-05 2023-09-30T17:03:52.992 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.993 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.993 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:52.993 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.870600+0000", 2023-09-30T17:03:52.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2234e-05 2023-09-30T17:03:52.993 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.993 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.993 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:52.993 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.870609+0000", 2023-09-30T17:03:52.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0129999999999999e-06 2023-09-30T17:03:52.993 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.993 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.994 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:52.994 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.875788+0000", 2023-09-30T17:03:52.994 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0051797730000000004 2023-09-30T17:03:52.994 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.994 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.994 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:52.994 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.875869+0000", 2023-09-30T17:03:52.994 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0468000000000003e-05 2023-09-30T17:03:52.994 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:52.994 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:52.995 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:52.995 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.995 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.995 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:62711 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e45)", 2023-09-30T17:03:52.995 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:52.870963+0000", 2023-09-30T17:03:52.995 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0039527080000000001, 2023-09-30T17:03:52.995 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050515009999999999, 2023-09-30T17:03:52.995 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:52.995 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:52.995 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:52.995 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:52.995 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:52.995 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 62711 2023-09-30T17:03:52.996 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.996 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:52.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.996 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:52.996 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.870963+0000", 2023-09-30T17:03:52.996 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:52.996 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.996 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:52.996 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.870963+0000", 2023-09-30T17:03:52.996 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:52.996 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.997 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:52.997 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.870964+0000", 2023-09-30T17:03:52.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2699999999999999e-07 2023-09-30T17:03:52.997 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.997 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:52.997 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.870984+0000", 2023-09-30T17:03:52.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0115999999999998e-05 2023-09-30T17:03:52.997 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.997 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:52.998 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.870996+0000", 2023-09-30T17:03:52.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2459999999999999e-05 2023-09-30T17:03:52.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:52.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:52.998 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:52.998 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:52.871004+0000", 2023-09-30T17:03:52.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1200000000000002e-06 2023-09-30T17:03:52.998 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:52.999 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:52.999 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:52.999 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:52.999 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2023-09-30T17:03:52.999 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 22 2023-09-30T17:03:52.999 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:53.001 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:53.000+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:53.002 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:03:53.101 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:53.101+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:53.200 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:53.200 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:03:53.200 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2023-09-30T17:03:53.201 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2023-09-30T17:03:53.201 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:53.202 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:53.201+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:53.215 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:03:53.303 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:53.302+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:53.404 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:53.403+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:53.417 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:53.417 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2023-09-30T17:03:53.417 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2023-09-30T17:03:53.417 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2023-09-30T17:03:53.418 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.418 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:23704 4.14 e41/17 4:2b28d75f:::100000001f8.00000016:head v 41'381, mlcod=41'379)", 2023-09-30T17:03:53.418 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.711674+0000", 2023-09-30T17:03:53.418 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 14.703823793, 2023-09-30T17:03:53.418 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.225773745, 2023-09-30T17:03:53.418 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:53.418 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:53.418 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:53.418 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.418 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:53.418 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.711674+0000", 2023-09-30T17:03:53.419 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:53.419 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.419 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.419 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:53.419 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.711674+0000", 2023-09-30T17:03:53.419 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:53.419 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.419 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.419 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:53.419 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.711674+0000", 2023-09-30T17:03:53.419 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2000000000000001e-07 2023-09-30T17:03:53.420 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.420 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.420 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:53.420 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.711685+0000", 2023-09-30T17:03:53.420 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.117e-05 2023-09-30T17:03:53.420 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.420 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.420 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:53.420 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.711691+0000", 2023-09-30T17:03:53.420 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2129999999999996e-06 2023-09-30T17:03:53.420 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.421 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.421 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.421 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.711696+0000", 2023-09-30T17:03:53.421 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7339999999999999e-06 2023-09-30T17:03:53.421 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.421 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.421 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:53.421 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713583+0000", 2023-09-30T17:03:53.421 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0018866219999999999 2023-09-30T17:03:53.421 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.421 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.422 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:53.422 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713603+0000", 2023-09-30T17:03:53.422 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0142000000000001e-05 2023-09-30T17:03:53.422 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.422 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.422 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:53.422 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.937407+0000", 2023-09-30T17:03:53.422 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.223804165 2023-09-30T17:03:53.422 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.422 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.422 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:53.423 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.937447+0000", 2023-09-30T17:03:53.423 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0479000000000003e-05 2023-09-30T17:03:53.423 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:53.423 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:53.423 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:53.423 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.423 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.423 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:23708 4.14 e41/17 4:2b28d75f:::100000001f8.00000016:head v 41'382, mlcod=41'379)", 2023-09-30T17:03:53.423 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713552+0000", 2023-09-30T17:03:53.423 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 14.701944972, 2023-09-30T17:03:53.423 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.22392661999999999, 2023-09-30T17:03:53.424 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:53.424 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:53.424 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:53.424 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.424 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:53.424 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713552+0000", 2023-09-30T17:03:53.424 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:53.424 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.424 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.424 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:53.424 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713552+0000", 2023-09-30T17:03:53.425 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:53.425 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.425 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.425 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:53.425 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713553+0000", 2023-09-30T17:03:53.425 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0999999999999999e-07 2023-09-30T17:03:53.425 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.425 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.425 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:53.425 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713564+0000", 2023-09-30T17:03:53.425 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0851e-05 2023-09-30T17:03:53.425 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.426 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.426 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:53.426 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713570+0000", 2023-09-30T17:03:53.426 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1480000000000003e-06 2023-09-30T17:03:53.426 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.426 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.426 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.426 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713574+0000", 2023-09-30T17:03:53.426 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.464e-06 2023-09-30T17:03:53.426 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.426 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.427 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:53.427 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.714408+0000", 2023-09-30T17:03:53.427 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00083399400000000001 2023-09-30T17:03:53.427 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.427 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.427 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:53.427 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.714425+0000", 2023-09-30T17:03:53.427 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7234000000000001e-05 2023-09-30T17:03:53.427 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.427 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.427 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:53.428 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.937451+0000", 2023-09-30T17:03:53.428 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.22302575899999999 2023-09-30T17:03:53.428 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.428 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.428 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:53.428 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.937479+0000", 2023-09-30T17:03:53.428 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7759999999999998e-05 2023-09-30T17:03:53.428 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:53.428 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:53.428 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:53.428 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.429 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.429 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23700 4.30 4:0c89e311:::100000001f8.00000017:head [write 1548288~4096 in=4096b,write 1638400~4096 in=4096b,write 1814528~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:53.429 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713661+0000", 2023-09-30T17:03:53.429 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 14.701836836, 2023-09-30T17:03:53.429 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.21981082900000001, 2023-09-30T17:03:53.429 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:53.429 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:53.429 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:53.429 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:53.429 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:53.429 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23700 2023-09-30T17:03:53.429 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.430 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:53.430 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.430 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:53.430 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713661+0000", 2023-09-30T17:03:53.430 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:53.430 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.430 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.430 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:53.430 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713661+0000", 2023-09-30T17:03:53.430 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:53.431 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.431 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.431 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:53.431 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713661+0000", 2023-09-30T17:03:53.431 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6000000000000004e-07 2023-09-30T17:03:53.431 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.431 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.431 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:53.431 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713669+0000", 2023-09-30T17:03:53.431 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2039999999999997e-06 2023-09-30T17:03:53.431 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.432 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.432 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:53.432 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713679+0000", 2023-09-30T17:03:53.432 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5999999999999996e-06 2023-09-30T17:03:53.432 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.432 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.432 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.432 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713683+0000", 2023-09-30T17:03:53.432 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4390000000000002e-06 2023-09-30T17:03:53.432 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.432 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.433 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:53.433 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713722+0000", 2023-09-30T17:03:53.433 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8707000000000001e-05 2023-09-30T17:03:53.433 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.433 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.433 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:53.433 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713780+0000", 2023-09-30T17:03:53.433 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8242000000000002e-05 2023-09-30T17:03:53.433 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.433 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.433 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:53.433 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.933335+0000", 2023-09-30T17:03:53.434 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.21955456500000001 2023-09-30T17:03:53.434 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.434 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.434 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:53.434 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.933388+0000", 2023-09-30T17:03:53.434 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2843999999999998e-05 2023-09-30T17:03:53.434 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.434 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.434 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:53.434 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.933471+0000", 2023-09-30T17:03:53.435 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3667999999999999e-05 2023-09-30T17:03:53.435 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:53.435 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:53.435 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:53.435 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.435 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.435 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23703 4.38 4:1d13bf87:::100000001f8.00000030:head [write 839680~4096 in=4096b,write 1101824~4096 in=4096b,write 1155072~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:53.435 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713696+0000", 2023-09-30T17:03:53.435 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 14.701801757, 2023-09-30T17:03:53.435 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.23500357699999999, 2023-09-30T17:03:53.436 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:53.436 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:53.436 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:53.436 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:53.436 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:53.436 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23703 2023-09-30T17:03:53.436 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.436 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:53.436 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.436 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:53.436 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713696+0000", 2023-09-30T17:03:53.437 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:53.437 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.437 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.437 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:53.437 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713696+0000", 2023-09-30T17:03:53.437 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:53.437 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.437 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.437 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:53.437 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713696+0000", 2023-09-30T17:03:53.437 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9500000000000003e-07 2023-09-30T17:03:53.438 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.438 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.438 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:53.438 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713711+0000", 2023-09-30T17:03:53.438 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5251e-05 2023-09-30T17:03:53.438 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.438 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.438 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:53.438 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713718+0000", 2023-09-30T17:03:53.438 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9430000000000003e-06 2023-09-30T17:03:53.438 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.439 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.439 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.439 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713723+0000", 2023-09-30T17:03:53.439 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4240000000000003e-06 2023-09-30T17:03:53.439 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.439 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.439 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:53.439 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713757+0000", 2023-09-30T17:03:53.439 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4128999999999998e-05 2023-09-30T17:03:53.439 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.439 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.440 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:53.440 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713841+0000", 2023-09-30T17:03:53.440 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3845999999999996e-05 2023-09-30T17:03:53.440 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.440 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.440 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:53.440 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.948561+0000", 2023-09-30T17:03:53.440 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.234720286 2023-09-30T17:03:53.440 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.440 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.440 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:53.440 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.948624+0000", 2023-09-30T17:03:53.441 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2961999999999998e-05 2023-09-30T17:03:53.441 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.441 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.441 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:53.441 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.948699+0000", 2023-09-30T17:03:53.441 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5240999999999993e-05 2023-09-30T17:03:53.441 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:53.441 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:53.441 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:53.441 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.441 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.442 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23706 4.f 4:f0d983b2:::100000001f8.0000001f:head [write 1003520~4096 in=4096b,write 1146880~4096 in=4096b,write 1163264~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:53.442 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713730+0000", 2023-09-30T17:03:53.442 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 14.701767702, 2023-09-30T17:03:53.442 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.22546488100000001, 2023-09-30T17:03:53.442 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:53.442 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:53.442 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:53.442 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:53.442 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:53.442 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23706 2023-09-30T17:03:53.442 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.443 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:53.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.443 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:53.443 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713730+0000", 2023-09-30T17:03:53.443 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:53.443 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.443 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:53.443 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713730+0000", 2023-09-30T17:03:53.443 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:53.443 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.444 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.444 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:53.444 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713730+0000", 2023-09-30T17:03:53.444 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0900000000000001e-07 2023-09-30T17:03:53.444 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.444 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.444 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:53.444 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713740+0000", 2023-09-30T17:03:53.444 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0115999999999999e-05 2023-09-30T17:03:53.444 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.444 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.444 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:53.445 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713747+0000", 2023-09-30T17:03:53.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5429999999999999e-06 2023-09-30T17:03:53.445 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.445 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.445 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.445 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713752+0000", 2023-09-30T17:03:53.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1270000000000002e-06 2023-09-30T17:03:53.445 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.445 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.445 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:53.445 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713788+0000", 2023-09-30T17:03:53.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5762000000000001e-05 2023-09-30T17:03:53.446 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.446 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.446 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:53.446 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713835+0000", 2023-09-30T17:03:53.446 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6808000000000003e-05 2023-09-30T17:03:53.446 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.446 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.446 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:53.446 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713962+0000", 2023-09-30T17:03:53.446 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000127315 2023-09-30T17:03:53.446 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.447 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:53.447 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.923977+0000", 2023-09-30T17:03:53.447 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.21001473100000001 2023-09-30T17:03:53.447 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.447 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:53.447 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939118+0000", 2023-09-30T17:03:53.447 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015141297999999999 2023-09-30T17:03:53.447 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.448 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:53.448 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939161+0000", 2023-09-30T17:03:53.448 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3458999999999998e-05 2023-09-30T17:03:53.448 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.448 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:53.448 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939195+0000", 2023-09-30T17:03:53.448 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3113e-05 2023-09-30T17:03:53.448 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:53.448 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:53.448 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:53.449 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.449 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.449 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23707 4.2f 4:f59f865b:::100000001f8.00000007:head [write 3575808~4096 in=4096b,write 3932160~4096 in=4096b,write 4063232~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:53.449 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713764+0000", 2023-09-30T17:03:53.449 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 14.701733259000001, 2023-09-30T17:03:53.449 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.225343612, 2023-09-30T17:03:53.449 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:53.449 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:53.449 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:53.449 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:53.449 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:53.450 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23707 2023-09-30T17:03:53.450 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.450 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:53.450 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.450 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:53.450 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713764+0000", 2023-09-30T17:03:53.450 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:53.450 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.450 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.450 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:53.450 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713764+0000", 2023-09-30T17:03:53.450 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:53.451 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.451 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.451 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:53.451 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713765+0000", 2023-09-30T17:03:53.451 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4099999999999999e-07 2023-09-30T17:03:53.451 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.451 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.451 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:53.451 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713775+0000", 2023-09-30T17:03:53.451 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0253e-05 2023-09-30T17:03:53.451 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.452 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.452 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:53.452 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713781+0000", 2023-09-30T17:03:53.452 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1770000000000003e-06 2023-09-30T17:03:53.452 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.452 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.452 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.452 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713787+0000", 2023-09-30T17:03:53.452 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.784e-06 2023-09-30T17:03:53.452 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.452 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.452 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:53.453 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713824+0000", 2023-09-30T17:03:53.453 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7258000000000001e-05 2023-09-30T17:03:53.453 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.453 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.453 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:53.453 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713897+0000", 2023-09-30T17:03:53.453 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3255000000000003e-05 2023-09-30T17:03:53.453 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.453 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.453 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:53.453 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.714035+0000", 2023-09-30T17:03:53.454 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013741799999999999 2023-09-30T17:03:53.454 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.454 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.454 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:53.454 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.924017+0000", 2023-09-30T17:03:53.454 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.20998277000000001 2023-09-30T17:03:53.454 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.454 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.454 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:53.454 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939013+0000", 2023-09-30T17:03:53.454 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014995432 2023-09-30T17:03:53.455 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.455 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.455 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:53.455 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939064+0000", 2023-09-30T17:03:53.455 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0784e-05 2023-09-30T17:03:53.455 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.455 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.455 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:53.455 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939108+0000", 2023-09-30T17:03:53.455 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4039999999999998e-05 2023-09-30T17:03:53.455 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:53.456 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:53.456 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:53.456 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.456 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.456 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23709 4.37 4:ef395e89:::100000001f8.00000020:head [write 4042752~4096 in=4096b,write 4124672~4096 in=4096b,write 4182016~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:53.456 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713796+0000", 2023-09-30T17:03:53.456 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 14.70170104, 2023-09-30T17:03:53.456 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.23291700700000001, 2023-09-30T17:03:53.456 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:53.456 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:53.456 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:53.456 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:53.457 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:53.457 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23709 2023-09-30T17:03:53.457 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.457 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:53.457 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.457 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:53.457 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713796+0000", 2023-09-30T17:03:53.457 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:53.457 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.457 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.457 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:53.458 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713796+0000", 2023-09-30T17:03:53.458 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:53.458 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.458 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.458 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:53.458 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713797+0000", 2023-09-30T17:03:53.458 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2200000000000004e-07 2023-09-30T17:03:53.458 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.458 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.458 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:53.458 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713807+0000", 2023-09-30T17:03:53.459 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.815e-06 2023-09-30T17:03:53.459 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.459 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.459 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:53.459 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713813+0000", 2023-09-30T17:03:53.459 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5899999999999996e-06 2023-09-30T17:03:53.459 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.459 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.459 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.459 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713818+0000", 2023-09-30T17:03:53.459 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2639999999999999e-06 2023-09-30T17:03:53.459 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.460 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.460 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:53.460 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.714818+0000", 2023-09-30T17:03:53.460 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00099973500000000008 2023-09-30T17:03:53.460 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.460 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.460 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:53.460 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.921155+0000", 2023-09-30T17:03:53.460 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.206336778 2023-09-30T17:03:53.460 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.460 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.461 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:53.461 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.921347+0000", 2023-09-30T17:03:53.461 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000191917 2023-09-30T17:03:53.461 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.461 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.461 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:53.461 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.944206+0000", 2023-09-30T17:03:53.461 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022859349000000001 2023-09-30T17:03:53.461 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.461 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.461 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:53.462 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.946622+0000", 2023-09-30T17:03:53.462 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0024161849999999999 2023-09-30T17:03:53.462 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.462 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.462 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:53.462 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.946673+0000", 2023-09-30T17:03:53.462 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0670000000000001e-05 2023-09-30T17:03:53.462 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.462 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.462 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:53.462 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.946713+0000", 2023-09-30T17:03:53.463 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0182000000000003e-05 2023-09-30T17:03:53.463 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:53.463 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:53.463 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:53.463 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.463 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23710 4.12 4:4be51a30:::100000001f8.0000000b:head [write 3772416~4096 in=4096b,write 3825664~4096 in=4096b,write 3833856~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:53.463 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713827+0000", 2023-09-30T17:03:53.463 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 14.701670555, 2023-09-30T17:03:53.463 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.214817016, 2023-09-30T17:03:53.463 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:53.463 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:53.464 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:53.464 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:53.464 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:53.464 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23710 2023-09-30T17:03:53.464 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.464 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:53.464 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.464 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:53.464 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713827+0000", 2023-09-30T17:03:53.464 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:53.464 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.465 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.465 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:53.465 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713827+0000", 2023-09-30T17:03:53.465 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:53.465 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.465 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.465 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:53.465 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713827+0000", 2023-09-30T17:03:53.465 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.51e-07 2023-09-30T17:03:53.465 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.465 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.466 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:53.466 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713837+0000", 2023-09-30T17:03:53.466 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8239999999999995e-06 2023-09-30T17:03:53.466 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.466 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.466 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:53.466 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713843+0000", 2023-09-30T17:03:53.466 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3729999999999998e-06 2023-09-30T17:03:53.466 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.466 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.466 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.466 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713849+0000", 2023-09-30T17:03:53.467 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3480000000000003e-06 2023-09-30T17:03:53.467 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.467 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.467 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:53.467 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713896+0000", 2023-09-30T17:03:53.467 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7426999999999998e-05 2023-09-30T17:03:53.467 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.467 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.467 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:53.467 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713969+0000", 2023-09-30T17:03:53.467 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2496000000000005e-05 2023-09-30T17:03:53.468 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.468 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.468 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:53.468 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.714114+0000", 2023-09-30T17:03:53.468 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014550699999999999 2023-09-30T17:03:53.468 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.468 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.468 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:53.468 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.922604+0000", 2023-09-30T17:03:53.468 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.20848978900000001 2023-09-30T17:03:53.468 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.469 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.469 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:53.469 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.928219+0000", 2023-09-30T17:03:53.469 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056147159999999996 2023-09-30T17:03:53.469 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.469 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.469 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:53.469 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.928268+0000", 2023-09-30T17:03:53.469 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9353e-05 2023-09-30T17:03:53.469 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.469 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.470 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:53.470 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.928644+0000", 2023-09-30T17:03:53.470 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00037573199999999999 2023-09-30T17:03:53.470 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:53.470 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:53.470 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:53.470 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.470 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.470 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23711 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 270336~4096 in=4096b,write 876544~4096 in=4096b,write 933888~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:53.470 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713868+0000", 2023-09-30T17:03:53.470 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 14.701629694999999, 2023-09-30T17:03:53.471 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.234682211, 2023-09-30T17:03:53.471 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:53.471 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:53.471 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:53.471 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:53.471 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:53.471 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23711 2023-09-30T17:03:53.471 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.471 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:53.471 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.471 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:53.471 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713868+0000", 2023-09-30T17:03:53.472 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:53.472 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.472 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.472 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:53.472 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713868+0000", 2023-09-30T17:03:53.472 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:53.472 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.472 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.472 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:53.472 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713868+0000", 2023-09-30T17:03:53.472 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.75e-07 2023-09-30T17:03:53.473 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.473 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.473 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:53.473 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713879+0000", 2023-09-30T17:03:53.473 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0494e-05 2023-09-30T17:03:53.473 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.473 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.473 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:53.473 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713886+0000", 2023-09-30T17:03:53.473 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3159999999999999e-06 2023-09-30T17:03:53.473 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.473 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.474 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.474 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713892+0000", 2023-09-30T17:03:53.474 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7200000000000003e-06 2023-09-30T17:03:53.474 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.474 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.474 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:53.474 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.714747+0000", 2023-09-30T17:03:53.474 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00085524699999999995 2023-09-30T17:03:53.474 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.474 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.474 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:53.475 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.714822+0000", 2023-09-30T17:03:53.475 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5444999999999993e-05 2023-09-30T17:03:53.475 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.475 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.475 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:53.475 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.947884+0000", 2023-09-30T17:03:53.475 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.233061449 2023-09-30T17:03:53.475 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.475 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.475 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:53.475 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.947942+0000", 2023-09-30T17:03:53.475 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7649999999999999e-05 2023-09-30T17:03:53.476 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.476 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.476 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:53.476 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.948550+0000", 2023-09-30T17:03:53.476 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00060831500000000001 2023-09-30T17:03:53.476 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:53.476 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:53.476 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:53.476 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.476 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.476 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23712 4.37 4:eff9002a:::100000001f8.00000003:head [write 3387392~8192,write 3452928~4096,write 3710976~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:53.477 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713901+0000", 2023-09-30T17:03:53.477 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 14.701596637, 2023-09-30T17:03:53.477 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.25525220700000001, 2023-09-30T17:03:53.477 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:53.477 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:53.477 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:53.477 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:53.477 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:53.477 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23712 2023-09-30T17:03:53.477 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.477 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:53.478 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.478 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:53.478 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713901+0000", 2023-09-30T17:03:53.478 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:53.478 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.478 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.478 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:53.478 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713901+0000", 2023-09-30T17:03:53.478 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:53.478 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.478 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.478 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:53.479 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713901+0000", 2023-09-30T17:03:53.479 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.96e-07 2023-09-30T17:03:53.479 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.479 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.479 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:53.479 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713912+0000", 2023-09-30T17:03:53.479 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0543999999999999e-05 2023-09-30T17:03:53.479 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.479 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.479 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:53.479 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713918+0000", 2023-09-30T17:03:53.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4420000000000003e-06 2023-09-30T17:03:53.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.480 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.480 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713923+0000", 2023-09-30T17:03:53.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3059999999999997e-06 2023-09-30T17:03:53.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.480 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:53.480 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.946744+0000", 2023-09-30T17:03:53.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.23282061100000001 2023-09-30T17:03:53.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.481 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.481 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:53.481 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.946818+0000", 2023-09-30T17:03:53.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3762000000000003e-05 2023-09-30T17:03:53.481 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.481 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.481 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:53.481 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.946949+0000", 2023-09-30T17:03:53.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013133900000000001 2023-09-30T17:03:53.481 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.481 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.481 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:53.482 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.951383+0000", 2023-09-30T17:03:53.482 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0044336999999999996 2023-09-30T17:03:53.482 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.482 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.482 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:53.482 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.969076+0000", 2023-09-30T17:03:53.482 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017693303000000001 2023-09-30T17:03:53.482 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.482 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.482 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:53.483 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.969119+0000", 2023-09-30T17:03:53.483 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3208999999999999e-05 2023-09-30T17:03:53.483 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.483 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.483 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:53.483 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.969153+0000", 2023-09-30T17:03:53.483 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3594999999999999e-05 2023-09-30T17:03:53.483 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:53.483 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:53.483 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:53.483 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.483 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.484 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:23713 4.33 e41/17 4:cf6d7a6c:::100000001f8.0000000a:head v 41'399, mlcod=41'397)", 2023-09-30T17:03:53.484 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.715224+0000", 2023-09-30T17:03:53.484 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 14.700273357, 2023-09-30T17:03:53.484 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.230022326, 2023-09-30T17:03:53.484 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:53.484 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:53.484 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:53.484 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.484 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:53.484 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.715224+0000", 2023-09-30T17:03:53.484 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:53.485 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.485 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.485 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:53.485 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.715224+0000", 2023-09-30T17:03:53.485 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:53.485 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.485 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.485 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:53.485 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.715228+0000", 2023-09-30T17:03:53.485 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4220000000000002e-06 2023-09-30T17:03:53.485 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.486 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.486 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:53.486 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.715239+0000", 2023-09-30T17:03:53.486 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0261999999999999e-05 2023-09-30T17:03:53.486 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.486 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.486 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:53.486 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.921195+0000", 2023-09-30T17:03:53.486 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.205955902 2023-09-30T17:03:53.486 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.486 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.487 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.487 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.921210+0000", 2023-09-30T17:03:53.487 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5109999999999999e-05 2023-09-30T17:03:53.487 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.487 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.487 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:53.487 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.921430+0000", 2023-09-30T17:03:53.487 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022019300000000001 2023-09-30T17:03:53.487 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.487 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.487 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:53.488 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.921454+0000", 2023-09-30T17:03:53.488 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4142e-05 2023-09-30T17:03:53.488 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.488 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.488 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:53.488 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.945208+0000", 2023-09-30T17:03:53.488 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.023753765999999999 2023-09-30T17:03:53.488 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.488 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.488 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:53.488 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.945246+0000", 2023-09-30T17:03:53.489 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8529000000000003e-05 2023-09-30T17:03:53.489 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:53.489 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:53.489 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:53.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.489 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24202 4.38 4:1dcf718c:::100000001f8.00000022:head [write 966656~4096,write 995328~4096,write 1007616~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:53.489 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.938506+0000", 2023-09-30T17:03:53.489 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 14.476991768, 2023-09-30T17:03:53.489 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.19404896199999999, 2023-09-30T17:03:53.489 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:53.489 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:53.490 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:53.490 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:53.490 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:53.490 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24202 2023-09-30T17:03:53.490 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.490 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:53.490 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.490 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:53.490 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938506+0000", 2023-09-30T17:03:53.490 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:53.490 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.491 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.491 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:53.491 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938506+0000", 2023-09-30T17:03:53.491 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:53.491 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.491 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.491 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:53.491 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938506+0000", 2023-09-30T17:03:53.491 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7899999999999999e-07 2023-09-30T17:03:53.491 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.491 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.491 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:53.492 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938539+0000", 2023-09-30T17:03:53.492 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2839999999999997e-05 2023-09-30T17:03:53.492 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.492 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.492 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:53.492 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938549+0000", 2023-09-30T17:03:53.492 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0202e-05 2023-09-30T17:03:53.492 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.492 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.492 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.492 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938554+0000", 2023-09-30T17:03:53.493 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1660000000000002e-06 2023-09-30T17:03:53.493 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.493 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.493 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:53.493 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.107092+0000", 2023-09-30T17:03:53.493 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.168537457 2023-09-30T17:03:53.493 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.493 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.493 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:53.493 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.107174+0000", 2023-09-30T17:03:53.493 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2380999999999996e-05 2023-09-30T17:03:53.493 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.494 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.494 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:53.494 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.132433+0000", 2023-09-30T17:03:53.494 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.025258939000000001 2023-09-30T17:03:53.494 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.494 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.494 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:53.494 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.132483+0000", 2023-09-30T17:03:53.494 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9951000000000003e-05 2023-09-30T17:03:53.494 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.494 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.495 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:53.495 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.132555+0000", 2023-09-30T17:03:53.495 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1647e-05 2023-09-30T17:03:53.495 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:53.495 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:53.495 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:53.495 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.495 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.495 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24207 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 2002944~4096,write 2060288~4096,write 2068480~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:53.495 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.938605+0000", 2023-09-30T17:03:53.495 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 14.476892501, 2023-09-30T17:03:53.495 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.19406049, 2023-09-30T17:03:53.496 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:53.496 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:53.496 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:53.496 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:53.496 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:53.496 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24207 2023-09-30T17:03:53.496 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.496 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:53.496 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.496 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:53.496 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938605+0000", 2023-09-30T17:03:53.497 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:53.497 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.497 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.497 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:53.497 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938605+0000", 2023-09-30T17:03:53.497 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:53.497 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.497 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.497 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:53.497 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938605+0000", 2023-09-30T17:03:53.497 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2899999999999999e-07 2023-09-30T17:03:53.497 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.498 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.498 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:53.498 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938621+0000", 2023-09-30T17:03:53.498 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5624000000000002e-05 2023-09-30T17:03:53.498 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.498 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.498 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:53.498 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938627+0000", 2023-09-30T17:03:53.498 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.925e-06 2023-09-30T17:03:53.498 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.498 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.499 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.499 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938630+0000", 2023-09-30T17:03:53.499 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4599999999999999e-06 2023-09-30T17:03:53.499 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.499 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.499 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:53.499 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.110850+0000", 2023-09-30T17:03:53.499 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.17221983699999999 2023-09-30T17:03:53.499 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.499 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.499 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:53.500 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.110930+0000", 2023-09-30T17:03:53.500 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0092999999999994e-05 2023-09-30T17:03:53.500 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.500 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.500 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:53.500 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.132561+0000", 2023-09-30T17:03:53.500 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021631371999999999 2023-09-30T17:03:53.500 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.500 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.500 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:53.500 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.132604+0000", 2023-09-30T17:03:53.501 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2818999999999998e-05 2023-09-30T17:03:53.501 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.501 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.501 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:53.501 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.132665+0000", 2023-09-30T17:03:53.501 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1030999999999999e-05 2023-09-30T17:03:53.501 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:53.501 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:53.501 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:53.501 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.501 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.501 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24210 4.30 4:0c89e311:::100000001f8.00000017:head [write 3231744~4096,write 3272704~4096,write 3346432~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:53.502 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.938660+0000", 2023-09-30T17:03:53.502 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 14.476837432, 2023-09-30T17:03:53.502 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.194937256, 2023-09-30T17:03:53.502 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:53.502 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:53.502 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:53.502 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:53.502 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:53.502 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24210 2023-09-30T17:03:53.502 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.502 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:53.503 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.503 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:53.503 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938660+0000", 2023-09-30T17:03:53.503 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:53.503 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.503 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.503 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:53.503 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938660+0000", 2023-09-30T17:03:53.503 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:53.503 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.504 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.504 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:53.504 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938660+0000", 2023-09-30T17:03:53.504 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5800000000000001e-07 2023-09-30T17:03:53.504 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.504 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.504 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:53.504 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938676+0000", 2023-09-30T17:03:53.504 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5650000000000001e-05 2023-09-30T17:03:53.504 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.504 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.504 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:53.505 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938685+0000", 2023-09-30T17:03:53.505 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9250000000000001e-06 2023-09-30T17:03:53.505 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.505 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.505 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.505 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938690+0000", 2023-09-30T17:03:53.505 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8160000000000001e-06 2023-09-30T17:03:53.505 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.505 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.505 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:53.505 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.110993+0000", 2023-09-30T17:03:53.506 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.172303714 2023-09-30T17:03:53.506 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.506 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:53.506 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.111072+0000", 2023-09-30T17:03:53.506 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8448999999999994e-05 2023-09-30T17:03:53.506 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.506 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:53.506 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.133463+0000", 2023-09-30T17:03:53.506 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022391297000000001 2023-09-30T17:03:53.507 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.507 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.507 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:53.507 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.133518+0000", 2023-09-30T17:03:53.507 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5278999999999997e-05 2023-09-30T17:03:53.507 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.507 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.507 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:53.507 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.133597+0000", 2023-09-30T17:03:53.507 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8868000000000005e-05 2023-09-30T17:03:53.507 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:53.507 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:53.508 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:53.508 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.508 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.508 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24218 4.30 4:0c89e311:::100000001f8.00000017:head [write 1191936~4096,write 1245184~4096,write 1261568~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:53.508 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.938815+0000", 2023-09-30T17:03:53.508 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 14.476682149, 2023-09-30T17:03:53.508 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.19788513899999999, 2023-09-30T17:03:53.508 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:53.508 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:53.508 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:53.508 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:53.509 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:53.509 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24218 2023-09-30T17:03:53.509 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.509 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:53.509 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.509 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:53.509 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938815+0000", 2023-09-30T17:03:53.509 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:53.509 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.509 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.509 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:53.509 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938815+0000", 2023-09-30T17:03:53.510 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:53.510 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.510 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.510 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:53.510 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938816+0000", 2023-09-30T17:03:53.510 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8699999999999995e-07 2023-09-30T17:03:53.510 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.510 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.510 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:53.510 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938837+0000", 2023-09-30T17:03:53.510 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1534000000000001e-05 2023-09-30T17:03:53.510 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.511 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.511 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:53.511 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938845+0000", 2023-09-30T17:03:53.511 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7190000000000001e-06 2023-09-30T17:03:53.511 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.511 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.511 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.511 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938850+0000", 2023-09-30T17:03:53.511 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1220000000000003e-06 2023-09-30T17:03:53.511 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.511 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.512 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:53.512 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.113486+0000", 2023-09-30T17:03:53.512 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.17463620299999999 2023-09-30T17:03:53.512 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.512 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.512 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:53.512 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.113626+0000", 2023-09-30T17:03:53.512 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013924799999999999 2023-09-30T17:03:53.512 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.512 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.512 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:53.513 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.136575+0000", 2023-09-30T17:03:53.513 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022949701999999999 2023-09-30T17:03:53.513 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.513 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.513 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:53.513 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.136623+0000", 2023-09-30T17:03:53.513 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7808e-05 2023-09-30T17:03:53.513 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.513 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.513 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:53.513 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.136700+0000", 2023-09-30T17:03:53.513 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7316000000000003e-05 2023-09-30T17:03:53.514 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:53.514 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:53.514 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:53.514 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.514 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.514 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24223 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 2449408~4096,write 2936832~4096,write 2973696~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:53.514 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.938922+0000", 2023-09-30T17:03:53.514 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 14.476575321, 2023-09-30T17:03:53.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.19909703600000001, 2023-09-30T17:03:53.514 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:53.515 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:53.515 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:53.515 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:53.515 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:53.515 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24223 2023-09-30T17:03:53.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.515 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:53.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.515 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:53.515 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938922+0000", 2023-09-30T17:03:53.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:53.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.516 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:53.516 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938922+0000", 2023-09-30T17:03:53.516 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:53.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.516 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:53.516 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938922+0000", 2023-09-30T17:03:53.516 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8599999999999999e-07 2023-09-30T17:03:53.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.516 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:53.517 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938943+0000", 2023-09-30T17:03:53.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0588999999999999e-05 2023-09-30T17:03:53.517 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.517 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:53.517 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938958+0000", 2023-09-30T17:03:53.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4915e-05 2023-09-30T17:03:53.517 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.517 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.517 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938964+0000", 2023-09-30T17:03:53.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8329999999999999e-06 2023-09-30T17:03:53.518 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.518 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.518 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:53.518 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.114879+0000", 2023-09-30T17:03:53.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.17591552699999999 2023-09-30T17:03:53.518 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.518 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.518 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:53.518 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.114958+0000", 2023-09-30T17:03:53.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8666999999999997e-05 2023-09-30T17:03:53.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.519 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:53.519 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.137905+0000", 2023-09-30T17:03:53.519 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022947381999999999 2023-09-30T17:03:53.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.519 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:53.519 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.137948+0000", 2023-09-30T17:03:53.519 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2851e-05 2023-09-30T17:03:53.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.520 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:53.520 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.138019+0000", 2023-09-30T17:03:53.520 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0885999999999999e-05 2023-09-30T17:03:53.520 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:53.520 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:53.520 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:53.520 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.520 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.520 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24231 4.30 4:0c89e311:::100000001f8.00000017:head [write 3121152~4096,write 3174400~4096,write 3198976~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:53.520 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.939120+0000", 2023-09-30T17:03:53.520 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 14.476376982, 2023-09-30T17:03:53.521 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.199038715, 2023-09-30T17:03:53.521 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:53.521 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:53.521 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:53.521 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:53.521 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:53.521 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24231 2023-09-30T17:03:53.521 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.521 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:53.521 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.521 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:53.522 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939120+0000", 2023-09-30T17:03:53.522 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:53.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.522 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:53.522 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939120+0000", 2023-09-30T17:03:53.522 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:53.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.522 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:53.522 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939121+0000", 2023-09-30T17:03:53.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5799999999999999e-07 2023-09-30T17:03:53.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.523 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:53.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939138+0000", 2023-09-30T17:03:53.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6742e-05 2023-09-30T17:03:53.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.523 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:53.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939145+0000", 2023-09-30T17:03:53.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2230000000000001e-06 2023-09-30T17:03:53.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.524 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.524 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.524 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939155+0000", 2023-09-30T17:03:53.524 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.995e-06 2023-09-30T17:03:53.524 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.524 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.524 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:53.524 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.116318+0000", 2023-09-30T17:03:53.524 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.17716331799999999 2023-09-30T17:03:53.524 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.524 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.525 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:53.525 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.116392+0000", 2023-09-30T17:03:53.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3379000000000003e-05 2023-09-30T17:03:53.525 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.525 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.525 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:53.525 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.138027+0000", 2023-09-30T17:03:53.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021635318000000001 2023-09-30T17:03:53.525 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.525 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.525 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:53.526 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.138076+0000", 2023-09-30T17:03:53.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9055999999999999e-05 2023-09-30T17:03:53.526 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.526 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:53.526 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.138159+0000", 2023-09-30T17:03:53.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3126000000000003e-05 2023-09-30T17:03:53.526 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:53.526 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:53.526 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:53.526 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.527 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.527 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24247 4.30 4:0c89e311:::100000001f8.00000017:head [write 2134016~4096,write 2150400~4096,write 2207744~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:53.527 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.939330+0000", 2023-09-30T17:03:53.527 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 14.476167288999999, 2023-09-30T17:03:53.527 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.200392818, 2023-09-30T17:03:53.527 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:53.527 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:53.527 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:53.527 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:53.527 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:53.527 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24247 2023-09-30T17:03:53.528 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.528 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:53.528 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.528 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:53.528 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939330+0000", 2023-09-30T17:03:53.528 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:53.528 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.528 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.528 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:53.528 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939330+0000", 2023-09-30T17:03:53.528 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:53.528 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.529 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.529 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:53.529 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939330+0000", 2023-09-30T17:03:53.529 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7500000000000001e-07 2023-09-30T17:03:53.529 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.529 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.529 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:53.529 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939339+0000", 2023-09-30T17:03:53.529 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6719999999999993e-06 2023-09-30T17:03:53.529 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.529 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.530 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:53.530 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939342+0000", 2023-09-30T17:03:53.530 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4170000000000001e-06 2023-09-30T17:03:53.530 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.530 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.530 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.530 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939345+0000", 2023-09-30T17:03:53.530 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7190000000000001e-06 2023-09-30T17:03:53.530 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.530 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.530 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:53.531 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.126008+0000", 2023-09-30T17:03:53.531 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.18666300499999999 2023-09-30T17:03:53.531 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.531 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.531 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:53.531 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.126132+0000", 2023-09-30T17:03:53.531 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012387800000000001 2023-09-30T17:03:53.531 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.531 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.531 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:53.531 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.139635+0000", 2023-09-30T17:03:53.532 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013502739 2023-09-30T17:03:53.532 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.532 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.532 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:53.532 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.139669+0000", 2023-09-30T17:03:53.532 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3810000000000003e-05 2023-09-30T17:03:53.532 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.532 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.532 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:53.532 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.139723+0000", 2023-09-30T17:03:53.532 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4302999999999998e-05 2023-09-30T17:03:53.533 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:53.533 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:53.533 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:53.533 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.533 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.533 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24272 4.38 4:1fc350da:::100000001f8.0000002f:head [write 638976~4096,write 843776~4096,write 864256~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:53.533 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.939523+0000", 2023-09-30T17:03:53.533 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 14.475974381, 2023-09-30T17:03:53.533 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.19876761700000001, 2023-09-30T17:03:53.533 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:53.533 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:53.533 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:53.534 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:53.534 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:53.534 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24272 2023-09-30T17:03:53.534 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.534 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:53.534 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.534 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:53.534 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939523+0000", 2023-09-30T17:03:53.534 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:53.534 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.534 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.535 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:53.535 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939523+0000", 2023-09-30T17:03:53.535 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:53.535 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.535 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.535 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:53.535 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939523+0000", 2023-09-30T17:03:53.535 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6199999999999999e-07 2023-09-30T17:03:53.535 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.535 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.535 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:53.536 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939538+0000", 2023-09-30T17:03:53.536 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5122e-05 2023-09-30T17:03:53.536 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.536 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.536 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:53.536 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939544+0000", 2023-09-30T17:03:53.536 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.327e-06 2023-09-30T17:03:53.536 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.536 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.536 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.537 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939549+0000", 2023-09-30T17:03:53.537 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8130000000000003e-06 2023-09-30T17:03:53.537 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.537 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.537 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:53.537 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.123535+0000", 2023-09-30T17:03:53.537 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.18398595700000001 2023-09-30T17:03:53.537 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.537 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.537 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:53.537 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.123962+0000", 2023-09-30T17:03:53.538 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000427136 2023-09-30T17:03:53.538 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.538 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.538 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:53.538 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.138167+0000", 2023-09-30T17:03:53.538 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014205096 2023-09-30T17:03:53.538 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.538 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.538 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:53.538 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.138217+0000", 2023-09-30T17:03:53.538 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0241999999999998e-05 2023-09-30T17:03:53.539 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.539 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.539 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:53.539 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.138291+0000", 2023-09-30T17:03:53.539 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3561999999999998e-05 2023-09-30T17:03:53.539 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:53.539 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:53.539 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:53.539 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.539 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.539 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24277 4.38 4:1fc350da:::100000001f8.0000002f:head [write 1036288~4096,write 1122304~4096,write 1220608~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:53.540 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.939581+0000", 2023-09-30T17:03:53.540 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 14.475916607, 2023-09-30T17:03:53.540 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.200284616, 2023-09-30T17:03:53.540 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:53.540 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:53.540 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:53.540 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:53.540 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:53.540 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24277 2023-09-30T17:03:53.540 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.540 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:53.540 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.541 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:53.541 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939581+0000", 2023-09-30T17:03:53.541 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:53.541 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.541 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.541 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:53.541 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939581+0000", 2023-09-30T17:03:53.541 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:53.541 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.541 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.541 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:53.542 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939581+0000", 2023-09-30T17:03:53.542 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4499999999999998e-07 2023-09-30T17:03:53.542 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.542 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.542 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:53.542 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939596+0000", 2023-09-30T17:03:53.542 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5007999999999999e-05 2023-09-30T17:03:53.542 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.542 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.542 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:53.542 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939600+0000", 2023-09-30T17:03:53.543 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6859999999999999e-06 2023-09-30T17:03:53.543 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.543 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.543 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.543 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939603+0000", 2023-09-30T17:03:53.543 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8700000000000001e-06 2023-09-30T17:03:53.543 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.543 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.543 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:53.543 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.129152+0000", 2023-09-30T17:03:53.543 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.18954922599999999 2023-09-30T17:03:53.543 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.544 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.544 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:53.544 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.129238+0000", 2023-09-30T17:03:53.544 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6446000000000005e-05 2023-09-30T17:03:53.544 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.544 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.544 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:53.544 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.139771+0000", 2023-09-30T17:03:53.544 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010532674000000001 2023-09-30T17:03:53.544 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.544 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.544 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:53.545 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.139819+0000", 2023-09-30T17:03:53.545 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7633999999999998e-05 2023-09-30T17:03:53.545 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:53.545 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:53.545 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:53.545 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.139865+0000", 2023-09-30T17:03:53.545 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6826999999999997e-05 2023-09-30T17:03:53.545 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:53.545 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:53.545 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:53.545 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:53.545 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:53.545 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:53.547 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is set 2023-09-30T17:03:53.549 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:03:53.550 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:53.546+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:53.647 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:53.646+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:53.748 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:53.747+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:53.759 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:53.759 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:03:53.759 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.759 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:65183 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 462848~4096 in=4096b,write 487424~4096 in=4096b,write 610304~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-09-30T17:03:53.759 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:53.729124+0000", 2023-09-30T17:03:53.759 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.026068270000000001, 2023-09-30T17:03:53.760 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.026091878999999998, 2023-09-30T17:03:53.760 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:53.760 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:53.760 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:53.760 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:53.760 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:53.760 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 65183 2023-09-30T17:03:53.760 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.760 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:53.760 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.760 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:53.761 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.729124+0000", 2023-09-30T17:03:53.761 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.761 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.761 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.761 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:53.761 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.729124+0000", 2023-09-30T17:03:53.761 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.761 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.761 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.761 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:53.761 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.729125+0000", 2023-09-30T17:03:53.761 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5600000000000005e-07 2023-09-30T17:03:53.762 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.762 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.762 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:53.762 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.729160+0000", 2023-09-30T17:03:53.762 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5716000000000002e-05 2023-09-30T17:03:53.762 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.762 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.762 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:53.762 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.729172+0000", 2023-09-30T17:03:53.762 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1989e-05 2023-09-30T17:03:53.762 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.763 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.763 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.763 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.729180+0000", 2023-09-30T17:03:53.763 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8720000000000002e-06 2023-09-30T17:03:53.763 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.763 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.763 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:53.763 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.740484+0000", 2023-09-30T17:03:53.763 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011303624999999999 2023-09-30T17:03:53.763 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.763 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.763 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:53.764 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.740640+0000", 2023-09-30T17:03:53.764 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015591800000000001 2023-09-30T17:03:53.764 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.764 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.764 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:53.764 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.740826+0000", 2023-09-30T17:03:53.764 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00018595999999999999 2023-09-30T17:03:53.764 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.764 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.764 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:53.764 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.748558+0000", 2023-09-30T17:03:53.764 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0077322270000000004 2023-09-30T17:03:53.765 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.765 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:53.765 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.765 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.765 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.765 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:65198 4.37 e46/17 4:ecbf0fb2:::100000001f8.00000038:head v 46'3061, mlcod=46'3056)", 2023-09-30T17:03:53.765 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:53.740983+0000", 2023-09-30T17:03:53.765 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.014208722, 2023-09-30T17:03:53.765 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.014352136, 2023-09-30T17:03:53.765 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:53.765 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:53.766 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:53.766 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.766 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:53.766 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.740983+0000", 2023-09-30T17:03:53.766 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.766 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.766 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.766 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:53.766 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.740983+0000", 2023-09-30T17:03:53.766 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.766 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.766 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.767 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:53.767 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.740984+0000", 2023-09-30T17:03:53.767 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.53e-07 2023-09-30T17:03:53.767 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.767 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.767 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:53.767 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.741002+0000", 2023-09-30T17:03:53.767 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7824000000000001e-05 2023-09-30T17:03:53.767 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.767 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.767 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:53.767 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.741010+0000", 2023-09-30T17:03:53.768 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2640000000000008e-06 2023-09-30T17:03:53.768 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.768 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.768 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.768 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.741014+0000", 2023-09-30T17:03:53.768 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6249999999999998e-06 2023-09-30T17:03:53.768 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.768 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.768 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:53.768 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.742522+0000", 2023-09-30T17:03:53.768 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0015080269999999999 2023-09-30T17:03:53.768 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.769 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.769 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:53.769 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.742546+0000", 2023-09-30T17:03:53.769 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.3815000000000002e-05 2023-09-30T17:03:53.769 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.769 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:53.769 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.769 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.769 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.769 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:65240 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-09-30T17:03:53.769 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:53.748517+0000", 2023-09-30T17:03:53.770 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.006675027, 2023-09-30T17:03:53.770 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0068958980000000001, 2023-09-30T17:03:53.770 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:53.770 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:53.770 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:53.770 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:53.770 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:53.770 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 65240 2023-09-30T17:03:53.770 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.770 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:53.770 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.770 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:53.770 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.748517+0000", 2023-09-30T17:03:53.771 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.771 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.771 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.771 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:53.771 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.748517+0000", 2023-09-30T17:03:53.771 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.771 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.771 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.771 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:53.771 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.748518+0000", 2023-09-30T17:03:53.771 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2399999999999997e-07 2023-09-30T17:03:53.772 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.772 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.772 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:53.772 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.748532+0000", 2023-09-30T17:03:53.772 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3794e-05 2023-09-30T17:03:53.772 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.772 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.772 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:53.772 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.748542+0000", 2023-09-30T17:03:53.772 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.9000000000000001e-06 2023-09-30T17:03:53.772 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.773 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.773 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.773 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.748548+0000", 2023-09-30T17:03:53.773 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8650000000000003e-06 2023-09-30T17:03:53.773 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.773 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:53.773 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.773 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.773 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.773 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:65237 4.37 e46/17 4:ecbf0fb2:::100000001f8.00000038:head v 46'3064, mlcod=46'3058)", 2023-09-30T17:03:53.773 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:53.748593+0000", 2023-09-30T17:03:53.774 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0065990299999999997, 2023-09-30T17:03:53.774 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0068863819999999999, 2023-09-30T17:03:53.774 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:53.774 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:53.774 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:53.774 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.774 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:53.774 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.748593+0000", 2023-09-30T17:03:53.774 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.774 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.774 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.774 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:53.775 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.748593+0000", 2023-09-30T17:03:53.775 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.775 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.775 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.775 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:53.775 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.748594+0000", 2023-09-30T17:03:53.775 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.15e-07 2023-09-30T17:03:53.775 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.775 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.775 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:53.775 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.748607+0000", 2023-09-30T17:03:53.775 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3499000000000001e-05 2023-09-30T17:03:53.776 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.776 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.776 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:53.776 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.748614+0000", 2023-09-30T17:03:53.776 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4739999999999999e-06 2023-09-30T17:03:53.776 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.776 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.776 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.776 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.748620+0000", 2023-09-30T17:03:53.776 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6459999999999998e-06 2023-09-30T17:03:53.776 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.777 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.777 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:53.777 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.749697+0000", 2023-09-30T17:03:53.777 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0010771649999999999 2023-09-30T17:03:53.777 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.777 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.777 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:53.777 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.749716+0000", 2023-09-30T17:03:53.777 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8224e-05 2023-09-30T17:03:53.777 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.777 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:53.778 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.778 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.778 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.778 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:65186 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 643072~4096 in=4096b,write 729088~4096 in=4096b,write 794624~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-09-30T17:03:53.778 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:53.730080+0000", 2023-09-30T17:03:53.778 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.025111909000000002, 2023-09-30T17:03:53.778 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.025470541999999999, 2023-09-30T17:03:53.778 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:53.778 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:53.778 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:53.778 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:53.779 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:53.779 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 65186 2023-09-30T17:03:53.779 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.779 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:53.779 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.779 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:53.779 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.730080+0000", 2023-09-30T17:03:53.779 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.779 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.779 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.779 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:53.780 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.730080+0000", 2023-09-30T17:03:53.780 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.780 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.780 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.780 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:53.780 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.730081+0000", 2023-09-30T17:03:53.780 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4399999999999999e-07 2023-09-30T17:03:53.780 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.780 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.780 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:53.780 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.730123+0000", 2023-09-30T17:03:53.780 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1576000000000003e-05 2023-09-30T17:03:53.781 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.781 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.781 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:53.781 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.730133+0000", 2023-09-30T17:03:53.781 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0608000000000001e-05 2023-09-30T17:03:53.781 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.781 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.781 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.781 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.730141+0000", 2023-09-30T17:03:53.781 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0479999999999999e-06 2023-09-30T17:03:53.781 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.782 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.782 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:53.782 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.743501+0000", 2023-09-30T17:03:53.782 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.013359751 2023-09-30T17:03:53.782 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.782 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.782 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:53.782 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.743551+0000", 2023-09-30T17:03:53.782 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0447e-05 2023-09-30T17:03:53.782 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.782 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.782 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:53.783 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.743641+0000", 2023-09-30T17:03:53.783 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9154999999999996e-05 2023-09-30T17:03:53.783 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.783 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.783 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:53.783 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.748596+0000", 2023-09-30T17:03:53.783 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0049550820000000004 2023-09-30T17:03:53.783 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.783 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:53.783 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.783 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.784 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.784 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:65220 4.3b 4:dcc0c15f:::100000001f8.0000001a:head [write 1380352~4096 in=4096b,write 1417216~4096 in=4096b,write 1490944~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-09-30T17:03:53.784 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:53.741560+0000", 2023-09-30T17:03:53.784 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.013632233000000001, 2023-09-30T17:03:53.784 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.014090424000000001, 2023-09-30T17:03:53.784 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:53.784 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:53.784 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:53.784 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:53.784 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:53.784 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 65220 2023-09-30T17:03:53.784 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.785 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:53.785 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.785 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:53.785 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.741560+0000", 2023-09-30T17:03:53.785 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.785 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.785 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.785 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:53.785 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.741560+0000", 2023-09-30T17:03:53.785 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.785 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.785 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.786 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:53.786 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.741561+0000", 2023-09-30T17:03:53.786 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.54e-07 2023-09-30T17:03:53.786 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.786 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.786 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:53.786 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.741570+0000", 2023-09-30T17:03:53.786 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7240000000000004e-06 2023-09-30T17:03:53.786 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.786 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.787 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:53.787 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.741580+0000", 2023-09-30T17:03:53.787 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.825e-06 2023-09-30T17:03:53.787 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.787 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.787 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.787 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.741585+0000", 2023-09-30T17:03:53.787 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8849999999999998e-06 2023-09-30T17:03:53.787 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.787 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.787 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:53.787 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.744521+0000", 2023-09-30T17:03:53.788 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0029356730000000002 2023-09-30T17:03:53.788 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.788 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.788 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:53.788 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.744567+0000", 2023-09-30T17:03:53.788 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6428999999999999e-05 2023-09-30T17:03:53.788 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.788 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.788 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:53.788 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.744668+0000", 2023-09-30T17:03:53.788 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000100642 2023-09-30T17:03:53.788 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.789 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.789 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:53.789 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.748147+0000", 2023-09-30T17:03:53.789 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.003479621 2023-09-30T17:03:53.789 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.789 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:53.789 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.789 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.789 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.789 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:65222 4.13 4:cbf33e86:::100000001f8.00000026:head [write 3170304~4096 in=4096b,write 3252224~4096 in=4096b,write 3420160~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-09-30T17:03:53.789 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:53.742225+0000", 2023-09-30T17:03:53.789 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.012967365, 2023-09-30T17:03:53.790 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.013523891, 2023-09-30T17:03:53.790 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:53.790 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:53.790 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:53.790 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:53.790 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:53.790 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 65222 2023-09-30T17:03:53.790 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.790 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:53.790 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.790 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:53.790 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.742225+0000", 2023-09-30T17:03:53.791 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.791 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.791 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.791 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:53.791 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.742225+0000", 2023-09-30T17:03:53.791 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.791 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.791 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.791 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:53.791 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.742226+0000", 2023-09-30T17:03:53.791 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.850000000000001e-07 2023-09-30T17:03:53.791 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.792 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.792 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:53.792 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.742241+0000", 2023-09-30T17:03:53.792 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4902999999999999e-05 2023-09-30T17:03:53.792 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.792 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.792 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:53.792 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.742255+0000", 2023-09-30T17:03:53.792 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4182000000000001e-05 2023-09-30T17:03:53.792 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.792 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.793 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.793 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.742263+0000", 2023-09-30T17:03:53.793 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.276e-06 2023-09-30T17:03:53.793 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.793 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.793 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:53.793 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.748191+0000", 2023-09-30T17:03:53.793 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005928099 2023-09-30T17:03:53.793 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.793 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.793 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:53.793 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.748288+0000", 2023-09-30T17:03:53.794 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.6417999999999997e-05 2023-09-30T17:03:53.794 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.794 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:53.794 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.794 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.794 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.794 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:65211 4.37 e46/17 4:eff9002a:::100000001f8.00000003:head v 46'3062, mlcod=46'3056)", 2023-09-30T17:03:53.794 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:53.742474+0000", 2023-09-30T17:03:53.794 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.012718099, 2023-09-30T17:03:53.794 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.013367860000000001, 2023-09-30T17:03:53.794 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:53.794 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:53.795 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:53.795 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.795 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:53.795 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.742474+0000", 2023-09-30T17:03:53.795 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.795 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.795 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.795 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:53.795 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.742474+0000", 2023-09-30T17:03:53.795 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.795 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.795 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.796 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:53.796 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.742475+0000", 2023-09-30T17:03:53.796 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.82e-07 2023-09-30T17:03:53.796 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.796 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.796 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:53.796 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.742488+0000", 2023-09-30T17:03:53.796 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3359e-05 2023-09-30T17:03:53.796 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.796 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.796 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:53.796 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.742497+0000", 2023-09-30T17:03:53.797 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2350000000000005e-06 2023-09-30T17:03:53.797 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.797 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.797 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.797 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.742504+0000", 2023-09-30T17:03:53.797 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9720000000000003e-06 2023-09-30T17:03:53.797 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.797 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.797 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:53.797 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.745985+0000", 2023-09-30T17:03:53.797 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0034811740000000001 2023-09-30T17:03:53.797 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.798 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.798 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:53.798 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.746013+0000", 2023-09-30T17:03:53.798 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.7348e-05 2023-09-30T17:03:53.798 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.798 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:53.798 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.798 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.798 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.798 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:65242 4.2a 4:57147dc3:::100000001f8.00000011:head [write 1093632~4096 in=4096b,write 1515520~4096 in=4096b,write 1581056~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-09-30T17:03:53.798 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:53.749785+0000", 2023-09-30T17:03:53.799 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0054075829999999997, 2023-09-30T17:03:53.799 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0061316579999999999, 2023-09-30T17:03:53.799 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:53.799 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:53.799 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:53.799 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:53.799 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:53.799 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 65242 2023-09-30T17:03:53.799 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.799 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:53.799 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.799 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:53.800 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.749785+0000", 2023-09-30T17:03:53.800 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.800 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.800 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.800 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:53.800 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.749785+0000", 2023-09-30T17:03:53.800 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.800 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.800 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.800 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:53.800 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.749785+0000", 2023-09-30T17:03:53.800 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.5600000000000004e-07 2023-09-30T17:03:53.801 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.801 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.801 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:53.801 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.749800+0000", 2023-09-30T17:03:53.801 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4612e-05 2023-09-30T17:03:53.801 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.801 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.801 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:53.801 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.749827+0000", 2023-09-30T17:03:53.801 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.7093e-05 2023-09-30T17:03:53.801 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.801 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.802 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.802 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.749836+0000", 2023-09-30T17:03:53.802 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5469999999999997e-06 2023-09-30T17:03:53.802 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.802 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.802 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:53.802 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.749933+0000", 2023-09-30T17:03:53.802 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7028999999999995e-05 2023-09-30T17:03:53.802 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.802 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.802 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:53.803 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.750010+0000", 2023-09-30T17:03:53.803 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7595000000000005e-05 2023-09-30T17:03:53.803 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.803 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:53.803 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.803 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.803 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.803 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:65241 4.f e46/17 4:f0d983b2:::100000001f8.0000001f:head v 46'3096, mlcod=46'3094)", 2023-09-30T17:03:53.803 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:53.750422+0000", 2023-09-30T17:03:53.803 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0047705910000000002, 2023-09-30T17:03:53.803 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0055738960000000001, 2023-09-30T17:03:53.803 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:53.804 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:53.804 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:53.804 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.804 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:53.804 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.750422+0000", 2023-09-30T17:03:53.804 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.804 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.804 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.804 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:53.804 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.750422+0000", 2023-09-30T17:03:53.804 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.805 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.805 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.805 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:53.805 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.750422+0000", 2023-09-30T17:03:53.805 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8699999999999995e-07 2023-09-30T17:03:53.805 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.805 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.805 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:53.805 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.750436+0000", 2023-09-30T17:03:53.805 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3549e-05 2023-09-30T17:03:53.805 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.805 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.806 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:53.806 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.750447+0000", 2023-09-30T17:03:53.806 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1044e-05 2023-09-30T17:03:53.806 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.806 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.806 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.806 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.750452+0000", 2023-09-30T17:03:53.806 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7990000000000001e-06 2023-09-30T17:03:53.806 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.806 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.806 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:53.806 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.750495+0000", 2023-09-30T17:03:53.807 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3176000000000001e-05 2023-09-30T17:03:53.807 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.807 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.807 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:53.807 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.750514+0000", 2023-09-30T17:03:53.807 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9513000000000001e-05 2023-09-30T17:03:53.807 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.807 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:53.807 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.807 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.807 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.808 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:65246 4.3d 4:bd3afb9d:::100000001f8.00000009:head [write 77824~4096 in=4096b,write 106496~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-09-30T17:03:53.808 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:53.751262+0000", 2023-09-30T17:03:53.808 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0039300400000000001, 2023-09-30T17:03:53.808 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0048115429999999997, 2023-09-30T17:03:53.808 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:53.808 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:53.808 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:53.808 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:53.808 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:53.808 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 65246 2023-09-30T17:03:53.808 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.808 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:53.809 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.809 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:53.809 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.751262+0000", 2023-09-30T17:03:53.809 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.809 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.809 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.809 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:53.809 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.751262+0000", 2023-09-30T17:03:53.809 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.809 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.809 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.810 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:53.810 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.751263+0000", 2023-09-30T17:03:53.810 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3500000000000005e-07 2023-09-30T17:03:53.810 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.810 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.810 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:53.810 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.751273+0000", 2023-09-30T17:03:53.810 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.042e-05 2023-09-30T17:03:53.810 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.810 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.811 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:53.811 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.751284+0000", 2023-09-30T17:03:53.811 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0421999999999999e-05 2023-09-30T17:03:53.811 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.811 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.811 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.811 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.751293+0000", 2023-09-30T17:03:53.811 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3179999999999996e-06 2023-09-30T17:03:53.811 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.811 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.811 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:53.811 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.751347+0000", 2023-09-30T17:03:53.812 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4188999999999999e-05 2023-09-30T17:03:53.812 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.812 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.812 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:53.812 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.751403+0000", 2023-09-30T17:03:53.812 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5708000000000003e-05 2023-09-30T17:03:53.812 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.812 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:53.812 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.812 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.812 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.812 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:65247 4.25 4:a76ff001:::100000001f8.0000002b:head [write 548864~4096 in=4096b,write 700416~4096 in=4096b,write 724992~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-09-30T17:03:53.813 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:53.751476+0000", 2023-09-30T17:03:53.813 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0037160029999999998, 2023-09-30T17:03:53.813 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0046883690000000004, 2023-09-30T17:03:53.813 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:53.813 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:53.813 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:53.813 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:53.813 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:53.813 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 65247 2023-09-30T17:03:53.813 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.813 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:53.814 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.814 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:53.814 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.751476+0000", 2023-09-30T17:03:53.814 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.814 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.814 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.814 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:53.814 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.751476+0000", 2023-09-30T17:03:53.814 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.814 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.814 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.814 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:53.815 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.751477+0000", 2023-09-30T17:03:53.815 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4099999999999997e-07 2023-09-30T17:03:53.815 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.815 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.815 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:53.815 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.751488+0000", 2023-09-30T17:03:53.815 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1481000000000001e-05 2023-09-30T17:03:53.815 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.815 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.815 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:53.815 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.751499+0000", 2023-09-30T17:03:53.815 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0095000000000001e-05 2023-09-30T17:03:53.816 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.816 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.816 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.816 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.751505+0000", 2023-09-30T17:03:53.816 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7089999999999996e-06 2023-09-30T17:03:53.816 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.816 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.816 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:53.816 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.751553+0000", 2023-09-30T17:03:53.816 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7675e-05 2023-09-30T17:03:53.816 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.816 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.817 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:53.817 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.751624+0000", 2023-09-30T17:03:53.817 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0951999999999994e-05 2023-09-30T17:03:53.817 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.817 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:53.817 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.817 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.817 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.817 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:65224 4.36 4.670445b6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-09-30T17:03:53.817 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:53.743046+0000", 2023-09-30T17:03:53.817 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.012146351999999999, 2023-09-30T17:03:53.817 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.013200643, 2023-09-30T17:03:53.817 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:53.818 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:53.818 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:53.818 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:53.818 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:53.818 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 65224 2023-09-30T17:03:53.818 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.818 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:53.818 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.818 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:53.818 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.743046+0000", 2023-09-30T17:03:53.818 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.819 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.819 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.819 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:53.819 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.743046+0000", 2023-09-30T17:03:53.819 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.819 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.819 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.819 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:53.819 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.743047+0000", 2023-09-30T17:03:53.819 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2299999999999999e-07 2023-09-30T17:03:53.819 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.819 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.819 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:53.820 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.743061+0000", 2023-09-30T17:03:53.820 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4209000000000001e-05 2023-09-30T17:03:53.820 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.820 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.820 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:53.820 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.743074+0000", 2023-09-30T17:03:53.820 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2611e-05 2023-09-30T17:03:53.820 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.820 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.820 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.820 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.743082+0000", 2023-09-30T17:03:53.820 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.7299999999999994e-06 2023-09-30T17:03:53.821 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.821 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:53.821 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.821 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.821 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.821 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:65248 4.2a 4:57147dc3:::100000001f8.00000011:head [write 3657728~4096 in=4096b,write 3686400~4096 in=4096b,write 3702784~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-09-30T17:03:53.821 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:53.751755+0000", 2023-09-30T17:03:53.821 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0034370719999999998, 2023-09-30T17:03:53.821 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0045680549999999997, 2023-09-30T17:03:53.821 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:53.822 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:53.822 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:53.822 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:53.822 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:53.822 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 65248 2023-09-30T17:03:53.822 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.822 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:53.822 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.822 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:53.822 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.751755+0000", 2023-09-30T17:03:53.822 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.823 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.823 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.823 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:53.823 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.751755+0000", 2023-09-30T17:03:53.823 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.823 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.823 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.823 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:53.823 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.751756+0000", 2023-09-30T17:03:53.823 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3900000000000004e-07 2023-09-30T17:03:53.823 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.823 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.823 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:53.824 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.751767+0000", 2023-09-30T17:03:53.824 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1559999999999999e-05 2023-09-30T17:03:53.824 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.824 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.824 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:53.824 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.751775+0000", 2023-09-30T17:03:53.824 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8609999999999998e-06 2023-09-30T17:03:53.824 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.824 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.824 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.824 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.751780+0000", 2023-09-30T17:03:53.825 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7180000000000004e-06 2023-09-30T17:03:53.825 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.825 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.825 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:53.825 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.751817+0000", 2023-09-30T17:03:53.825 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7475999999999998e-05 2023-09-30T17:03:53.825 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.825 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.825 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:53.825 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.751866+0000", 2023-09-30T17:03:53.825 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8501000000000002e-05 2023-09-30T17:03:53.825 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.826 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:53.826 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.826 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.826 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.826 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:65245 4.f e46/17 4:f26fdfa9:::100000001f8.00000002:head v 46'3097, mlcod=46'3094)", 2023-09-30T17:03:53.826 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:53.752182+0000", 2023-09-30T17:03:53.826 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0030098, 2023-09-30T17:03:53.826 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.004223292, 2023-09-30T17:03:53.826 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:53.826 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:53.826 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:53.826 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.827 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:53.827 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.752182+0000", 2023-09-30T17:03:53.827 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.827 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.827 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.827 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:53.827 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.752182+0000", 2023-09-30T17:03:53.827 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.827 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.827 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.827 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:53.827 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.752183+0000", 2023-09-30T17:03:53.828 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0399999999999996e-07 2023-09-30T17:03:53.828 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.828 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.828 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:53.828 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.752195+0000", 2023-09-30T17:03:53.828 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2089000000000001e-05 2023-09-30T17:03:53.828 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.828 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.828 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:53.828 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.752205+0000", 2023-09-30T17:03:53.828 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.815e-06 2023-09-30T17:03:53.828 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.829 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.829 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.829 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.752211+0000", 2023-09-30T17:03:53.829 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.319e-06 2023-09-30T17:03:53.829 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.829 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.829 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:53.829 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.753256+0000", 2023-09-30T17:03:53.829 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0010445000000000001 2023-09-30T17:03:53.829 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.829 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.830 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:53.830 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.753276+0000", 2023-09-30T17:03:53.830 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.0713999999999999e-05 2023-09-30T17:03:53.830 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.830 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:53.830 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.830 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.830 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.830 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:65249 4.23 e46/17 4:c6f90462:::100000001f8.00000037:head v 46'1001, mlcod=46'999)", 2023-09-30T17:03:53.830 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:53.752444+0000", 2023-09-30T17:03:53.830 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0027484129999999999, 2023-09-30T17:03:53.830 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0040307030000000001, 2023-09-30T17:03:53.831 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:53.831 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:53.831 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:53.831 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.831 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:53.831 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.752444+0000", 2023-09-30T17:03:53.831 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.831 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.831 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.831 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:53.831 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.752444+0000", 2023-09-30T17:03:53.832 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.832 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.832 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.832 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:53.832 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.752444+0000", 2023-09-30T17:03:53.832 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4099999999999999e-07 2023-09-30T17:03:53.832 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.832 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.832 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:53.832 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.752458+0000", 2023-09-30T17:03:53.832 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3345e-05 2023-09-30T17:03:53.832 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.833 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.833 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:53.833 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.752467+0000", 2023-09-30T17:03:53.833 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.0119999999999994e-06 2023-09-30T17:03:53.833 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.833 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.833 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.833 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.752473+0000", 2023-09-30T17:03:53.833 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5150000000000003e-06 2023-09-30T17:03:53.833 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.833 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.833 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:53.834 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.752523+0000", 2023-09-30T17:03:53.834 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0102000000000002e-05 2023-09-30T17:03:53.834 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.834 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.834 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:53.834 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.752544+0000", 2023-09-30T17:03:53.834 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.0443000000000001e-05 2023-09-30T17:03:53.834 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.834 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:53.834 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.834 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.835 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.835 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:65227 4.3 4:c222b65c:::100000001f8.00000021:head [write 1400832~4096 in=4096b,write 1417216~4096 in=4096b,write 1679360~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-09-30T17:03:53.835 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:53.744270+0000", 2023-09-30T17:03:53.835 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.010922195000000001, 2023-09-30T17:03:53.835 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.01227206, 2023-09-30T17:03:53.835 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:53.835 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:53.835 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:53.835 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:53.835 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:53.835 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 65227 2023-09-30T17:03:53.835 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.836 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:53.836 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.836 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:53.836 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.744270+0000", 2023-09-30T17:03:53.836 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.836 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.836 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.836 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:53.836 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.744270+0000", 2023-09-30T17:03:53.836 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.836 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.837 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.837 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:53.837 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.744271+0000", 2023-09-30T17:03:53.837 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3200000000000003e-07 2023-09-30T17:03:53.837 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.837 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.837 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:53.837 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.744283+0000", 2023-09-30T17:03:53.837 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2285e-05 2023-09-30T17:03:53.837 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.837 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.837 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:53.838 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.744294+0000", 2023-09-30T17:03:53.838 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0795000000000001e-05 2023-09-30T17:03:53.838 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.838 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.838 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.838 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.744301+0000", 2023-09-30T17:03:53.838 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5390000000000002e-06 2023-09-30T17:03:53.838 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.838 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.838 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:53.838 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.750986+0000", 2023-09-30T17:03:53.839 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0066842990000000003 2023-09-30T17:03:53.839 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.839 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.839 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:53.839 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.751070+0000", 2023-09-30T17:03:53.839 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4080999999999997e-05 2023-09-30T17:03:53.839 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.839 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:53.839 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.839 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.839 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.839 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:65251 4.27 4:e68799fb:::100000001f8.00000018:head [write 2777088~4096 in=4096b,write 3301376~4096 in=4096b,write 3432448~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-09-30T17:03:53.840 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:53.752608+0000", 2023-09-30T17:03:53.840 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0025842339999999999, 2023-09-30T17:03:53.840 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0040049530000000003, 2023-09-30T17:03:53.840 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:53.840 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:53.840 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:53.840 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:53.840 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:53.840 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 65251 2023-09-30T17:03:53.840 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.840 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:53.841 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.841 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:53.841 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.752608+0000", 2023-09-30T17:03:53.841 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.841 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.841 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.841 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:53.841 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.752608+0000", 2023-09-30T17:03:53.841 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.841 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.841 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.842 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:53.842 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.752609+0000", 2023-09-30T17:03:53.842 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5099999999999999e-07 2023-09-30T17:03:53.842 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.842 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.842 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:53.842 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.752623+0000", 2023-09-30T17:03:53.842 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4715999999999999e-05 2023-09-30T17:03:53.842 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.842 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.842 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:53.842 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.752633+0000", 2023-09-30T17:03:53.843 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.5999999999999996e-06 2023-09-30T17:03:53.843 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.843 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.843 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.843 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.752641+0000", 2023-09-30T17:03:53.843 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6729999999999992e-06 2023-09-30T17:03:53.843 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.843 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.843 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:53.843 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.753224+0000", 2023-09-30T17:03:53.843 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00058372600000000001 2023-09-30T17:03:53.843 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.844 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.844 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:53.844 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.753309+0000", 2023-09-30T17:03:53.844 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4358999999999996e-05 2023-09-30T17:03:53.844 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.844 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:53.844 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.844 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.844 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.844 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:65228 4.e 4.c27217ce (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-09-30T17:03:53.844 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:53.744525+0000", 2023-09-30T17:03:53.845 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.010666691000000001, 2023-09-30T17:03:53.845 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.012152494999999999, 2023-09-30T17:03:53.845 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:53.845 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:53.845 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:53.845 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:53.845 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:53.845 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 65228 2023-09-30T17:03:53.845 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.845 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:53.845 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.846 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:53.846 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.744525+0000", 2023-09-30T17:03:53.846 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.846 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.846 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.846 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:53.846 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.744525+0000", 2023-09-30T17:03:53.846 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.846 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.846 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.846 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:53.846 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.744526+0000", 2023-09-30T17:03:53.846 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.78e-07 2023-09-30T17:03:53.847 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.847 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.847 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:53.847 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.744547+0000", 2023-09-30T17:03:53.847 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.0324999999999999e-05 2023-09-30T17:03:53.847 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.847 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.847 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:53.847 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.744560+0000", 2023-09-30T17:03:53.847 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.277e-05 2023-09-30T17:03:53.847 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.848 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.848 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.848 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.744568+0000", 2023-09-30T17:03:53.848 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3650000000000004e-06 2023-09-30T17:03:53.848 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.848 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:53.848 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.848 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.848 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.848 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:65252 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-09-30T17:03:53.848 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:53.752877+0000", 2023-09-30T17:03:53.848 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0023155110000000001, 2023-09-30T17:03:53.849 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0038559459999999999, 2023-09-30T17:03:53.849 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:53.849 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:53.849 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:53.849 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:53.849 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:53.849 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 65252 2023-09-30T17:03:53.849 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.849 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:53.849 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.849 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:53.849 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.752877+0000", 2023-09-30T17:03:53.850 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.850 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.850 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.850 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:53.850 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.752877+0000", 2023-09-30T17:03:53.850 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.850 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.850 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.850 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:53.850 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.752877+0000", 2023-09-30T17:03:53.850 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7000000000000004e-07 2023-09-30T17:03:53.851 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.851 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.851 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:53.851 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.752895+0000", 2023-09-30T17:03:53.851 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7571000000000002e-05 2023-09-30T17:03:53.851 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.851 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.851 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:53.851 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.752908+0000", 2023-09-30T17:03:53.851 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2862e-05 2023-09-30T17:03:53.851 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.852 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.852 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.852 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.752915+0000", 2023-09-30T17:03:53.852 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2840000000000001e-06 2023-09-30T17:03:53.852 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.852 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:53.852 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.852 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.852 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.852 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop_reply(client.4547.0:65199 4.6 e46/17)", 2023-09-30T17:03:53.852 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:53.753891+0000", 2023-09-30T17:03:53.852 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0013013969999999999, 2023-09-30T17:03:53.853 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0028967379999999998, 2023-09-30T17:03:53.853 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:53.853 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:53.853 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:53.853 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.853 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:53.853 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.753891+0000", 2023-09-30T17:03:53.853 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.853 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.853 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.853 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:53.853 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.753891+0000", 2023-09-30T17:03:53.854 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.854 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.854 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.854 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:53.854 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.753891+0000", 2023-09-30T17:03:53.854 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2900000000000004e-07 2023-09-30T17:03:53.854 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.854 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.854 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:53.854 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.753910+0000", 2023-09-30T17:03:53.854 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9063e-05 2023-09-30T17:03:53.854 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.855 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.855 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:53.855 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.753922+0000", 2023-09-30T17:03:53.855 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1523e-05 2023-09-30T17:03:53.855 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.855 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.855 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.855 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.753930+0000", 2023-09-30T17:03:53.855 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5750000000000001e-06 2023-09-30T17:03:53.855 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.855 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:53.855 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.856 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.856 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.856 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:65199 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 724992~4096 in=4096b,write 937984~4096 in=4096b,write 1331200~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-09-30T17:03:53.856 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:53.734554+0000", 2023-09-30T17:03:53.856 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.020637756, 2023-09-30T17:03:53.856 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.022287019000000002, 2023-09-30T17:03:53.856 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:53.856 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:53.856 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:53.856 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:53.856 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:53.857 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 65199 2023-09-30T17:03:53.857 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.857 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:53.857 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.857 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:53.857 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.734554+0000", 2023-09-30T17:03:53.857 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.857 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.857 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.857 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:53.857 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.734554+0000", 2023-09-30T17:03:53.857 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.858 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.858 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.858 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:53.858 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.734555+0000", 2023-09-30T17:03:53.858 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.6700000000000002e-07 2023-09-30T17:03:53.858 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.858 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.858 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:53.858 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.734567+0000", 2023-09-30T17:03:53.858 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1385e-05 2023-09-30T17:03:53.858 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.859 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.859 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:53.859 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.734577+0000", 2023-09-30T17:03:53.859 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.023e-05 2023-09-30T17:03:53.859 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.859 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.859 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.859 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.734584+0000", 2023-09-30T17:03:53.859 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5900000000000002e-06 2023-09-30T17:03:53.859 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.859 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.860 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:53.860 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.748630+0000", 2023-09-30T17:03:53.860 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.014045244 2023-09-30T17:03:53.860 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.860 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.860 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:53.860 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.748708+0000", 2023-09-30T17:03:53.860 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8139999999999994e-05 2023-09-30T17:03:53.860 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.860 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.860 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:53.861 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.748859+0000", 2023-09-30T17:03:53.861 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000151407 2023-09-30T17:03:53.861 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.861 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:53.861 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.861 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.861 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.861 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:65231 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-09-30T17:03:53.861 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:53.745395+0000", 2023-09-30T17:03:53.861 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0097975300000000005, 2023-09-30T17:03:53.861 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011530135, 2023-09-30T17:03:53.862 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:53.862 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:53.862 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:53.862 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:53.862 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:53.862 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 65231 2023-09-30T17:03:53.862 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.862 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:53.862 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.862 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:53.862 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.745395+0000", 2023-09-30T17:03:53.863 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.863 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.863 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.863 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:53.863 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.745395+0000", 2023-09-30T17:03:53.863 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.863 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.863 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.863 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:53.863 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.745395+0000", 2023-09-30T17:03:53.863 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0100000000000004e-07 2023-09-30T17:03:53.864 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.864 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.864 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:53.864 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.745408+0000", 2023-09-30T17:03:53.864 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2146e-05 2023-09-30T17:03:53.864 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.864 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.864 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:53.864 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.745418+0000", 2023-09-30T17:03:53.864 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0883000000000001e-05 2023-09-30T17:03:53.864 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.864 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.865 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.865 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.745428+0000", 2023-09-30T17:03:53.865 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.4779999999999997e-06 2023-09-30T17:03:53.865 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.865 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:53.865 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.865 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.865 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.865 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:65254 4.f e46/17 4:f26fdfa9:::100000001f8.00000002:head v 46'3098, mlcod=46'3094)", 2023-09-30T17:03:53.865 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:53.753950+0000", 2023-09-30T17:03:53.865 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0012423429999999999, 2023-09-30T17:03:53.866 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0030295420000000001, 2023-09-30T17:03:53.866 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:53.866 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:53.866 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:53.866 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.866 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:53.866 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.753950+0000", 2023-09-30T17:03:53.866 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.866 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.866 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.866 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:53.866 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.753950+0000", 2023-09-30T17:03:53.867 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.867 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.867 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.867 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:53.867 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.753950+0000", 2023-09-30T17:03:53.867 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1399999999999997e-07 2023-09-30T17:03:53.867 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.867 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.867 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:53.867 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.753962+0000", 2023-09-30T17:03:53.867 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1883e-05 2023-09-30T17:03:53.868 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.868 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.868 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:53.868 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.753970+0000", 2023-09-30T17:03:53.868 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1540000000000002e-06 2023-09-30T17:03:53.868 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.868 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.868 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.868 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.753976+0000", 2023-09-30T17:03:53.868 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.835e-06 2023-09-30T17:03:53.868 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.868 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.869 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:53.869 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.755793+0000", 2023-09-30T17:03:53.869 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0018165849999999999 2023-09-30T17:03:53.869 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.869 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.869 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:53.869 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.755810+0000", 2023-09-30T17:03:53.869 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7714e-05 2023-09-30T17:03:53.869 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.869 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:53.869 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.870 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.870 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.870 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:65203 4.6 4:616d4c41:::100000001f8.00000034:head [write 1396736~4096 in=4096b,write 1433600~4096 in=4096b,write 1638400~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-09-30T17:03:53.870 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:53.735114+0000", 2023-09-30T17:03:53.870 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.020078571, 2023-09-30T17:03:53.870 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.021947488000000001, 2023-09-30T17:03:53.870 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:53.870 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:53.870 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:53.870 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:53.870 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:53.871 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 65203 2023-09-30T17:03:53.871 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.871 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:53.871 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.871 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:53.871 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.735114+0000", 2023-09-30T17:03:53.871 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.871 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.871 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.871 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:53.871 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.735114+0000", 2023-09-30T17:03:53.872 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.872 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.872 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.872 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:53.872 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.735114+0000", 2023-09-30T17:03:53.872 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.6000000000000002e-07 2023-09-30T17:03:53.872 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.872 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.872 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:53.872 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.735128+0000", 2023-09-30T17:03:53.872 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3764000000000001e-05 2023-09-30T17:03:53.873 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.873 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.873 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:53.873 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.735139+0000", 2023-09-30T17:03:53.873 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0652999999999999e-05 2023-09-30T17:03:53.873 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.873 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.873 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.873 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.735148+0000", 2023-09-30T17:03:53.873 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.4579999999999999e-06 2023-09-30T17:03:53.873 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.874 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.874 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:53.874 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.751177+0000", 2023-09-30T17:03:53.874 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.016028503 2023-09-30T17:03:53.874 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.874 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.874 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:53.874 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.751249+0000", 2023-09-30T17:03:53.874 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2677999999999998e-05 2023-09-30T17:03:53.874 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.874 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.875 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:53.875 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.751392+0000", 2023-09-30T17:03:53.875 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000142507 2023-09-30T17:03:53.875 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.875 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:53.875 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.875 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.875 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.875 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop_reply(client.4547.0:65203 4.6 e46/17)", 2023-09-30T17:03:53.875 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:53.753994+0000", 2023-09-30T17:03:53.875 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.001198113, 2023-09-30T17:03:53.875 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0031390530000000002, 2023-09-30T17:03:53.876 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:53.876 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:53.876 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:53.876 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.876 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:53.876 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.753994+0000", 2023-09-30T17:03:53.876 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.876 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.876 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.876 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:53.876 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.753994+0000", 2023-09-30T17:03:53.877 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.877 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.877 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.877 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:53.877 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.753994+0000", 2023-09-30T17:03:53.877 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7899999999999999e-07 2023-09-30T17:03:53.877 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.877 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.877 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:53.877 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.753997+0000", 2023-09-30T17:03:53.877 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.7819999999999998e-06 2023-09-30T17:03:53.878 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.878 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.878 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:53.878 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.754004+0000", 2023-09-30T17:03:53.878 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9029999999999998e-06 2023-09-30T17:03:53.878 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.878 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.878 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.878 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.754009+0000", 2023-09-30T17:03:53.878 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.181e-06 2023-09-30T17:03:53.878 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.878 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:53.879 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.879 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.879 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.879 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:65256 4.24 4:27adda6e:::100000001f8.0000000f:head [write 679936~4096 in=4096b,write 782336~4096 in=4096b,write 897024~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-09-30T17:03:53.879 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:53.754353+0000", 2023-09-30T17:03:53.879 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.00083914199999999997, 2023-09-30T17:03:53.879 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0028410530000000001, 2023-09-30T17:03:53.879 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:53.879 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:53.879 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:53.879 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:53.880 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:53.880 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 65256 2023-09-30T17:03:53.880 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.880 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:53.880 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.880 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:53.880 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.754353+0000", 2023-09-30T17:03:53.880 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.880 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.880 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.880 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:53.880 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.754353+0000", 2023-09-30T17:03:53.881 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.881 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.881 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.881 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:53.881 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.754354+0000", 2023-09-30T17:03:53.881 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8400000000000002e-07 2023-09-30T17:03:53.881 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.881 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.881 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:53.881 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.754365+0000", 2023-09-30T17:03:53.881 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1433e-05 2023-09-30T17:03:53.882 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.882 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.882 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:53.882 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.754376+0000", 2023-09-30T17:03:53.882 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0995000000000001e-05 2023-09-30T17:03:53.882 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.882 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.882 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.882 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.754383+0000", 2023-09-30T17:03:53.882 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0450000000000003e-06 2023-09-30T17:03:53.882 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.883 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.883 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:53.883 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.754438+0000", 2023-09-30T17:03:53.883 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4375e-05 2023-09-30T17:03:53.883 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.883 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.883 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:53.883 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.754517+0000", 2023-09-30T17:03:53.883 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9274e-05 2023-09-30T17:03:53.883 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.884 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:53.884 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.884 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.884 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.884 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:65206 4.6 4:616d4c41:::100000001f8.00000034:head [write 3756032~4096 in=4096b,write 3788800~4096 in=4096b,write 3805184~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-09-30T17:03:53.884 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:53.735920+0000", 2023-09-30T17:03:53.884 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.019272588, 2023-09-30T17:03:53.884 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.021345299000000002, 2023-09-30T17:03:53.884 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:53.884 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:53.884 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:53.885 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:53.885 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:53.885 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 65206 2023-09-30T17:03:53.885 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.885 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:53.885 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.885 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:53.885 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.735920+0000", 2023-09-30T17:03:53.885 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.885 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.885 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.885 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:53.885 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.735920+0000", 2023-09-30T17:03:53.886 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.886 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.886 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.886 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:53.886 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.735920+0000", 2023-09-30T17:03:53.886 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8199999999999999e-07 2023-09-30T17:03:53.886 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.886 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.886 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:53.886 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.735933+0000", 2023-09-30T17:03:53.886 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2993000000000001e-05 2023-09-30T17:03:53.887 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.887 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.887 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:53.887 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.735944+0000", 2023-09-30T17:03:53.887 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0543999999999999e-05 2023-09-30T17:03:53.887 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.887 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.887 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.887 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.735951+0000", 2023-09-30T17:03:53.887 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8920000000000003e-06 2023-09-30T17:03:53.887 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.888 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.888 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:53.888 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.754011+0000", 2023-09-30T17:03:53.888 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.018060119999999999 2023-09-30T17:03:53.888 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.888 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.888 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:53.888 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.754112+0000", 2023-09-30T17:03:53.888 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000100908 2023-09-30T17:03:53.888 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.888 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.888 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:53.888 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.754279+0000", 2023-09-30T17:03:53.889 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016768100000000001 2023-09-30T17:03:53.889 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.889 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:53.889 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.889 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.889 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.889 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:65234 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-09-30T17:03:53.889 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:53.746214+0000", 2023-09-30T17:03:53.889 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.008978181, 2023-09-30T17:03:53.889 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011123465000000001, 2023-09-30T17:03:53.889 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:53.889 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:53.890 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:53.890 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:53.890 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:53.890 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 65234 2023-09-30T17:03:53.890 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.890 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:53.890 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.890 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:53.890 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.746214+0000", 2023-09-30T17:03:53.890 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.890 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.891 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.891 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:53.891 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.746214+0000", 2023-09-30T17:03:53.891 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.891 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.891 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.891 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:53.891 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.746215+0000", 2023-09-30T17:03:53.891 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.017e-06 2023-09-30T17:03:53.891 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.891 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.892 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:53.892 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.746231+0000", 2023-09-30T17:03:53.892 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6087e-05 2023-09-30T17:03:53.892 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.892 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.892 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:53.892 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.746246+0000", 2023-09-30T17:03:53.892 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5373e-05 2023-09-30T17:03:53.892 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.892 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.892 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.893 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.746255+0000", 2023-09-30T17:03:53.893 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.0459999999999994e-06 2023-09-30T17:03:53.893 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.893 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:53.893 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.893 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.893 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.893 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:65257 4.25 4:a76ff001:::100000001f8.0000002b:head [write 102400~4096 in=4096b,write 114688~4096 in=4096b,write 184320~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-09-30T17:03:53.893 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:53.754620+0000", 2023-09-30T17:03:53.893 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.00057178399999999999, 2023-09-30T17:03:53.893 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0027837180000000001, 2023-09-30T17:03:53.894 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:53.894 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:53.894 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:53.894 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:53.894 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:53.894 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 65257 2023-09-30T17:03:53.894 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.894 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:53.894 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.894 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:53.894 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.754620+0000", 2023-09-30T17:03:53.894 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.895 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.895 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.895 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:53.895 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.754620+0000", 2023-09-30T17:03:53.895 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.895 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.895 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.895 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:53.895 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.754621+0000", 2023-09-30T17:03:53.895 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1600000000000001e-07 2023-09-30T17:03:53.895 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.896 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.896 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:53.896 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.754633+0000", 2023-09-30T17:03:53.896 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1994000000000001e-05 2023-09-30T17:03:53.896 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.896 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.896 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:53.896 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.754643+0000", 2023-09-30T17:03:53.896 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.9580000000000002e-06 2023-09-30T17:03:53.896 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.896 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.896 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.896 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.754650+0000", 2023-09-30T17:03:53.897 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2110000000000001e-06 2023-09-30T17:03:53.897 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.897 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.897 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:53.897 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.754710+0000", 2023-09-30T17:03:53.897 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9882e-05 2023-09-30T17:03:53.897 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.897 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.897 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:53.897 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.754783+0000", 2023-09-30T17:03:53.897 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3118e-05 2023-09-30T17:03:53.898 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.898 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:53.898 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.898 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.898 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.898 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:65258 4.3d 4:bfffac44:::100000001f8.0000000c:head [write 2183168~4096 in=4096b,write 2232320~4096 in=4096b,write 2281472~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-09-30T17:03:53.898 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:53.755050+0000", 2023-09-30T17:03:53.898 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.00014166, 2023-09-30T17:03:53.898 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0024250809999999999, 2023-09-30T17:03:53.898 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:53.898 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:53.898 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:53.899 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:53.899 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:53.899 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 65258 2023-09-30T17:03:53.899 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.899 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:53.899 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.899 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:53.899 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.755050+0000", 2023-09-30T17:03:53.899 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.899 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.899 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.900 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:53.900 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.755050+0000", 2023-09-30T17:03:53.900 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.900 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.900 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.900 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:53.900 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.755051+0000", 2023-09-30T17:03:53.900 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5300000000000003e-07 2023-09-30T17:03:53.900 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.900 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.900 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:53.900 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.755063+0000", 2023-09-30T17:03:53.900 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1558e-05 2023-09-30T17:03:53.901 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.901 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.901 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:53.901 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.755074+0000", 2023-09-30T17:03:53.901 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1566000000000001e-05 2023-09-30T17:03:53.901 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.901 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.901 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.901 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.755081+0000", 2023-09-30T17:03:53.901 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8499999999999996e-06 2023-09-30T17:03:53.901 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.902 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.902 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:53.902 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.755136+0000", 2023-09-30T17:03:53.902 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4478999999999998e-05 2023-09-30T17:03:53.902 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.902 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.902 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:53.902 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.755287+0000", 2023-09-30T17:03:53.902 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015120699999999999 2023-09-30T17:03:53.902 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.902 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:53.903 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.903 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.903 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.903 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:65232 4.37 e46/17 4:eff9002a:::100000001f8.00000003:head v 46'3063, mlcod=46'3058)", 2023-09-30T17:03:53.903 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:53.746544+0000", 2023-09-30T17:03:53.903 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0086479490000000003, 2023-09-30T17:03:53.903 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010998729, 2023-09-30T17:03:53.903 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:53.903 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:53.903 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:53.903 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.903 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:53.904 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.746544+0000", 2023-09-30T17:03:53.904 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.904 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.904 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.904 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:53.904 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.746544+0000", 2023-09-30T17:03:53.904 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.904 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.904 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.904 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:53.904 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.746545+0000", 2023-09-30T17:03:53.904 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6800000000000001e-07 2023-09-30T17:03:53.905 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.905 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.905 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:53.905 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.746559+0000", 2023-09-30T17:03:53.905 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4211e-05 2023-09-30T17:03:53.905 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.905 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.905 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:53.905 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.746566+0000", 2023-09-30T17:03:53.905 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2110000000000001e-06 2023-09-30T17:03:53.905 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.905 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.906 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.906 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.746570+0000", 2023-09-30T17:03:53.906 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8130000000000002e-06 2023-09-30T17:03:53.906 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.906 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.906 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:53.906 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.747867+0000", 2023-09-30T17:03:53.906 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0012973209999999999 2023-09-30T17:03:53.906 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.906 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.906 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:53.906 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.747887+0000", 2023-09-30T17:03:53.907 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9879999999999999e-05 2023-09-30T17:03:53.907 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.907 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:53.907 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.907 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.907 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.907 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:65259 4.37 e46/17 4:eff9002a:::100000001f8.00000003:head v 46'3065, mlcod=46'3059)", 2023-09-30T17:03:53.907 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:53.755906+0000", 2023-09-30T17:03:53.907 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.9992862, 2023-09-30T17:03:53.907 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001708024, 2023-09-30T17:03:53.907 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:53.908 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:53.908 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:53.908 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.908 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:53.908 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.755906+0000", 2023-09-30T17:03:53.908 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.908 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.908 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.908 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:53.908 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.755906+0000", 2023-09-30T17:03:53.908 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.908 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.909 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.909 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:53.909 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.755907+0000", 2023-09-30T17:03:53.909 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1099999999999995e-07 2023-09-30T17:03:53.909 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.909 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.909 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:53.909 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.755919+0000", 2023-09-30T17:03:53.909 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2627e-05 2023-09-30T17:03:53.909 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.909 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.909 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:53.910 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.755931+0000", 2023-09-30T17:03:53.910 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1367e-05 2023-09-30T17:03:53.910 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.910 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.910 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.910 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.755938+0000", 2023-09-30T17:03:53.910 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1210000000000001e-06 2023-09-30T17:03:53.910 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.910 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.910 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:53.911 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.756225+0000", 2023-09-30T17:03:53.911 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00028749400000000001 2023-09-30T17:03:53.911 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.911 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.911 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:53.911 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.756248+0000", 2023-09-30T17:03:53.911 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2773999999999999e-05 2023-09-30T17:03:53.911 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.911 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:53.911 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.911 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.912 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.912 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:65236 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-09-30T17:03:53.912 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:53.746863+0000", 2023-09-30T17:03:53.912 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.00832893, 2023-09-30T17:03:53.912 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010816551000000001, 2023-09-30T17:03:53.912 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:53.912 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:53.912 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:53.912 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:53.912 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:53.912 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 65236 2023-09-30T17:03:53.912 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.913 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:53.913 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.913 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:53.913 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.746863+0000", 2023-09-30T17:03:53.913 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.913 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.913 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.913 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:53.913 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.746863+0000", 2023-09-30T17:03:53.913 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.913 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.913 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.914 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:53.914 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.746864+0000", 2023-09-30T17:03:53.914 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0900000000000002e-07 2023-09-30T17:03:53.914 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.914 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.914 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:53.914 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.746881+0000", 2023-09-30T17:03:53.914 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7629999999999999e-05 2023-09-30T17:03:53.914 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.914 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.914 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:53.914 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.746889+0000", 2023-09-30T17:03:53.915 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5480000000000004e-06 2023-09-30T17:03:53.915 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.915 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.915 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.915 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.746893+0000", 2023-09-30T17:03:53.915 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.279e-06 2023-09-30T17:03:53.915 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.915 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:53.915 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.915 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.915 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.916 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:65261 4.28 4:15eeb89b:::100000001f8.00000032:head [write 434176~4096 in=4096b,write 704512~4096 in=4096b,write 733184~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-09-30T17:03:53.916 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:53.756337+0000", 2023-09-30T17:03:53.916 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.9988551, 2023-09-30T17:03:53.916 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0014201789999999999, 2023-09-30T17:03:53.916 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:53.916 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:53.916 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:53.916 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:53.916 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:53.916 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 65261 2023-09-30T17:03:53.916 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.916 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:53.917 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.917 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:53.917 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.756337+0000", 2023-09-30T17:03:53.917 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.917 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.917 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.917 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:53.917 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.756337+0000", 2023-09-30T17:03:53.917 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.917 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.917 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.917 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:53.918 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.756338+0000", 2023-09-30T17:03:53.918 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.161e-06 2023-09-30T17:03:53.918 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.918 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.918 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:53.918 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.756350+0000", 2023-09-30T17:03:53.918 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2088e-05 2023-09-30T17:03:53.918 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.918 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.918 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:53.918 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.756363+0000", 2023-09-30T17:03:53.918 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3243e-05 2023-09-30T17:03:53.919 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.919 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.919 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.919 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.756372+0000", 2023-09-30T17:03:53.919 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.7229999999999993e-06 2023-09-30T17:03:53.919 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.919 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.919 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:53.919 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.756421+0000", 2023-09-30T17:03:53.919 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9262999999999999e-05 2023-09-30T17:03:53.919 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.920 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.920 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:53.920 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.756468+0000", 2023-09-30T17:03:53.920 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6983000000000001e-05 2023-09-30T17:03:53.920 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.920 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.920 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:53.920 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.756628+0000", 2023-09-30T17:03:53.920 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015934400000000001 2023-09-30T17:03:53.920 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.920 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:53.921 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.921 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.921 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.921 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:65265 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-09-30T17:03:53.921 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:53.757444+0000", 2023-09-30T17:03:53.921 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.9977479, 2023-09-30T17:03:53.921 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00039747799999999999, 2023-09-30T17:03:53.921 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:53.921 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:53.921 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:53.921 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:53.921 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:53.922 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 65265 2023-09-30T17:03:53.922 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.922 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:53.922 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.922 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:53.922 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.757444+0000", 2023-09-30T17:03:53.922 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.922 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.922 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.922 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:53.922 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.757444+0000", 2023-09-30T17:03:53.923 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.923 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.923 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.923 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:53.923 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.757445+0000", 2023-09-30T17:03:53.923 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8700000000000005e-07 2023-09-30T17:03:53.923 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.923 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.923 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:53.923 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.757454+0000", 2023-09-30T17:03:53.923 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3939999999999996e-06 2023-09-30T17:03:53.923 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.924 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.924 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:53.924 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.757464+0000", 2023-09-30T17:03:53.924 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0482999999999999e-05 2023-09-30T17:03:53.924 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.924 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.924 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.924 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.757470+0000", 2023-09-30T17:03:53.924 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6110000000000001e-06 2023-09-30T17:03:53.924 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.924 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:53.924 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.925 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.925 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.925 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:65266 4.e 4.c27217ce (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-09-30T17:03:53.925 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:53.757659+0000", 2023-09-30T17:03:53.925 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.9975333, 2023-09-30T17:03:53.925 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00025120399999999999, 2023-09-30T17:03:53.925 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:53.925 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:53.925 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:53.925 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:53.925 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:53.925 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 65266 2023-09-30T17:03:53.926 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.926 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:53.926 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.926 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:53.926 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.757659+0000", 2023-09-30T17:03:53.926 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.926 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.926 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.926 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:53.926 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.757659+0000", 2023-09-30T17:03:53.926 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.927 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.927 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.927 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:53.927 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.757659+0000", 2023-09-30T17:03:53.927 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.7300000000000005e-07 2023-09-30T17:03:53.927 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.927 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.927 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:53.927 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.757675+0000", 2023-09-30T17:03:53.927 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5322999999999999e-05 2023-09-30T17:03:53.927 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.927 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.928 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:53.928 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.757687+0000", 2023-09-30T17:03:53.928 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2003e-05 2023-09-30T17:03:53.928 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.928 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.928 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.928 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.757695+0000", 2023-09-30T17:03:53.928 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0790000000000001e-06 2023-09-30T17:03:53.928 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.928 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:53.928 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.928 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.929 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.929 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:65177 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 4087808~4096 in=4096b,write 4096000~4096 in=4096b,write 4186112~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-09-30T17:03:53.929 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:53.727278+0000", 2023-09-30T17:03:53.929 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.027914077999999998, 2023-09-30T17:03:53.929 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.030702665000000001, 2023-09-30T17:03:53.929 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:53.929 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:53.929 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:53.929 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:53.929 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:53.929 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 65177 2023-09-30T17:03:53.930 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.930 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:53.930 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.930 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:53.930 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.727278+0000", 2023-09-30T17:03:53.930 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.930 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.930 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.930 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:53.930 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.727278+0000", 2023-09-30T17:03:53.930 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.931 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.931 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.931 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:53.931 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.727279+0000", 2023-09-30T17:03:53.931 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.6899999999999996e-07 2023-09-30T17:03:53.931 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.931 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.931 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:53.931 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.727300+0000", 2023-09-30T17:03:53.931 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.0628999999999998e-05 2023-09-30T17:03:53.931 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.931 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.932 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:53.932 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.727312+0000", 2023-09-30T17:03:53.932 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2277e-05 2023-09-30T17:03:53.932 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.932 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.932 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.932 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.727319+0000", 2023-09-30T17:03:53.932 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3019999999999997e-06 2023-09-30T17:03:53.932 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.932 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.932 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:53.933 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.737908+0000", 2023-09-30T17:03:53.933 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010589046 2023-09-30T17:03:53.933 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.933 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.933 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:53.933 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.737952+0000", 2023-09-30T17:03:53.933 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4267999999999997e-05 2023-09-30T17:03:53.933 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.933 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.933 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:53.933 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.738040+0000", 2023-09-30T17:03:53.933 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.7613000000000003e-05 2023-09-30T17:03:53.934 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.934 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.934 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:53.934 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.748518+0000", 2023-09-30T17:03:53.934 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010477838 2023-09-30T17:03:53.934 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.934 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:53.934 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.934 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.934 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.934 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:65263 4.37 e46/17)", 2023-09-30T17:03:53.934 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:53.757927+0000", 2023-09-30T17:03:53.935 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.9972653, 2023-09-30T17:03:53.935 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015497300000000001, 2023-09-30T17:03:53.935 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:53.935 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:53.935 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:53.935 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.935 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:53.935 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.757927+0000", 2023-09-30T17:03:53.935 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.935 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.935 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.935 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:53.936 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.757927+0000", 2023-09-30T17:03:53.936 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.936 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.936 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.936 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:53.936 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.757928+0000", 2023-09-30T17:03:53.936 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9999999999999997e-07 2023-09-30T17:03:53.936 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.936 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.936 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:53.936 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.757940+0000", 2023-09-30T17:03:53.936 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2272999999999999e-05 2023-09-30T17:03:53.937 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.937 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.937 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:53.937 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.757950+0000", 2023-09-30T17:03:53.937 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8670000000000006e-06 2023-09-30T17:03:53.937 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.937 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.937 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.937 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.757957+0000", 2023-09-30T17:03:53.937 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5530000000000004e-06 2023-09-30T17:03:53.937 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.937 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:53.938 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.938 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.938 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.938 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:65214 4.36 4:6fa85f86:::100000001f8.00000013:head [write 1650688~4096 in=4096b,write 2105344~4096 in=4096b,write 2129920~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e46)", 2023-09-30T17:03:53.938 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:53.739417+0000", 2023-09-30T17:03:53.938 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.015775458999999999, 2023-09-30T17:03:53.938 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.018706536999999999, 2023-09-30T17:03:53.938 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:53.938 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:53.938 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:53.938 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:53.939 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:53.939 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 65214 2023-09-30T17:03:53.939 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.939 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:53.939 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.939 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:53.939 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.739417+0000", 2023-09-30T17:03:53.939 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.939 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.939 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.939 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:53.939 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.739417+0000", 2023-09-30T17:03:53.940 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:53.940 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.940 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.940 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:53.940 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.739417+0000", 2023-09-30T17:03:53.940 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3600000000000004e-07 2023-09-30T17:03:53.940 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.940 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.940 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:53.940 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.739428+0000", 2023-09-30T17:03:53.940 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0479000000000001e-05 2023-09-30T17:03:53.940 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.941 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.941 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:53.941 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.739436+0000", 2023-09-30T17:03:53.941 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9589999999999995e-06 2023-09-30T17:03:53.941 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.941 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.941 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:53.941 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.739444+0000", 2023-09-30T17:03:53.941 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.7169999999999997e-06 2023-09-30T17:03:53.941 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.941 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.942 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:53.942 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.753784+0000", 2023-09-30T17:03:53.942 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.014339986000000001 2023-09-30T17:03:53.942 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.942 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.942 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:53.942 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.753869+0000", 2023-09-30T17:03:53.942 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4730999999999999e-05 2023-09-30T17:03:53.942 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:53.942 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:53.942 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:53.942 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:53.754098+0000", 2023-09-30T17:03:53.943 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000228975 2023-09-30T17:03:53.943 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.943 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:53.943 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.943 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:53.943 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-09-30T17:03:53.943 INFO:teuthology.orchestra.run.smithi031.stdout: "num_ops": 40 2023-09-30T17:03:53.943 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:53.943 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-09-30T17:03:53.945 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:03:53.946 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:53.944+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:54.045 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:54.045+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:54.117 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:03:54.139 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:03:54.140 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-09-30T17:03:54.140 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-09-30T17:03:54.140 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:03:54.144 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:03:54.144 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:03:54.146 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:54.145+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:54.153 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:54.153 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:54.166 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:03:54.250 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:54.250+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:54.348 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:54.347+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:54.412 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:54.412 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:54.427 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:03:54.471 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:54.470+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:54.549 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:54.549+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:54.623 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:54.624 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:54.640 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:03:54.683 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:54.681+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:54.752 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:54.750+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:54.852 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:54.851+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:54.875 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:54.876 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:54.890 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:03:54.976 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:54.975+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:55.053 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:55.052+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:55.128 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:55.128 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:55.145 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:03:55.186 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:55.185+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:55.254 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:55.253+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:55.347 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:55.347 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:55.355 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:55.354+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:55.363 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:03:55.456 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:55.455+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:55.550 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-09-30T17:03:55.557 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:55.556+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:55.567 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:55.567 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:55.582 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:03:55.658 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:55.657+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:55.759 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:55.758+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:55.822 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:55.822 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:55.838 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:03:55.878 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:55.878+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:55.960 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:55.959+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:56.028 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:56.029 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:56.045 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:03:56.086 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:56.085+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:56.145 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-09-30T17:03:56.161 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:56.161+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:56.262 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:56.261+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:56.274 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is unset 2023-09-30T17:03:56.277 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:56.277 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:56.293 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:03:56.324 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:03:56.345 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:03:56.346 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-09-30T17:03:56.346 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-09-30T17:03:56.346 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:03:56.349 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:03:56.349 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:03:56.381 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:56.380+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:56.465 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:56.464+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:56.540 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:56.541 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2023-09-30T17:03:56.541 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2023-09-30T17:03:56.541 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2023-09-30T17:03:56.541 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.541 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:23704 4.14 e41/17 4:2b28d75f:::100000001f8.00000016:head v 41'381, mlcod=41'379)", 2023-09-30T17:03:56.541 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.711674+0000", 2023-09-30T17:03:56.541 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 17.824830050999999, 2023-09-30T17:03:56.541 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.225773745, 2023-09-30T17:03:56.541 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:56.542 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:56.542 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:56.542 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.542 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:56.542 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.711674+0000", 2023-09-30T17:03:56.542 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:56.542 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.542 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.542 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:56.542 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.711674+0000", 2023-09-30T17:03:56.543 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:56.543 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.543 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.543 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:56.543 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.711674+0000", 2023-09-30T17:03:56.543 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2000000000000001e-07 2023-09-30T17:03:56.543 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.543 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.543 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:56.543 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.711685+0000", 2023-09-30T17:03:56.543 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.117e-05 2023-09-30T17:03:56.543 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.544 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.544 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:56.544 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.711691+0000", 2023-09-30T17:03:56.544 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2129999999999996e-06 2023-09-30T17:03:56.544 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.544 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.544 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:56.544 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.711696+0000", 2023-09-30T17:03:56.544 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7339999999999999e-06 2023-09-30T17:03:56.544 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.545 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.545 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:56.545 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713583+0000", 2023-09-30T17:03:56.545 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0018866219999999999 2023-09-30T17:03:56.545 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.545 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.545 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:56.545 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713603+0000", 2023-09-30T17:03:56.545 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0142000000000001e-05 2023-09-30T17:03:56.545 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.546 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.546 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:56.546 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.937407+0000", 2023-09-30T17:03:56.546 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.223804165 2023-09-30T17:03:56.546 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.546 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.546 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:56.546 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.937447+0000", 2023-09-30T17:03:56.546 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0479000000000003e-05 2023-09-30T17:03:56.546 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:56.547 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:56.547 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:56.547 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.547 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.547 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:23708 4.14 e41/17 4:2b28d75f:::100000001f8.00000016:head v 41'382, mlcod=41'379)", 2023-09-30T17:03:56.547 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713552+0000", 2023-09-30T17:03:56.547 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 17.822951230000001, 2023-09-30T17:03:56.547 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.22392661999999999, 2023-09-30T17:03:56.547 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:56.547 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:56.547 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:56.548 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.548 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:56.548 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713552+0000", 2023-09-30T17:03:56.548 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:56.548 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.548 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.548 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:56.548 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713552+0000", 2023-09-30T17:03:56.548 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:56.548 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.548 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.548 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:56.549 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713553+0000", 2023-09-30T17:03:56.549 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0999999999999999e-07 2023-09-30T17:03:56.549 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.549 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.549 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:56.549 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713564+0000", 2023-09-30T17:03:56.549 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0851e-05 2023-09-30T17:03:56.549 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.549 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.549 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:56.550 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713570+0000", 2023-09-30T17:03:56.550 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1480000000000003e-06 2023-09-30T17:03:56.550 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.550 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.550 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:56.550 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713574+0000", 2023-09-30T17:03:56.550 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.464e-06 2023-09-30T17:03:56.550 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.550 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.550 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:56.550 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.714408+0000", 2023-09-30T17:03:56.551 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00083399400000000001 2023-09-30T17:03:56.551 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.551 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.551 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:56.551 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.714425+0000", 2023-09-30T17:03:56.551 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7234000000000001e-05 2023-09-30T17:03:56.551 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.551 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.551 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:56.551 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.937451+0000", 2023-09-30T17:03:56.551 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.22302575899999999 2023-09-30T17:03:56.552 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.552 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.552 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:56.552 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.937479+0000", 2023-09-30T17:03:56.552 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7759999999999998e-05 2023-09-30T17:03:56.552 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:56.552 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:56.552 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:56.552 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.552 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.552 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23700 4.30 4:0c89e311:::100000001f8.00000017:head [write 1548288~4096 in=4096b,write 1638400~4096 in=4096b,write 1814528~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:56.553 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713661+0000", 2023-09-30T17:03:56.553 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 17.822843094, 2023-09-30T17:03:56.553 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.21981082900000001, 2023-09-30T17:03:56.553 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:56.553 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:56.553 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:56.553 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:56.553 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:56.553 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23700 2023-09-30T17:03:56.553 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.553 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:56.554 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.554 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:56.554 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713661+0000", 2023-09-30T17:03:56.554 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:56.554 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.554 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.554 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:56.554 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713661+0000", 2023-09-30T17:03:56.554 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:56.554 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.554 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.555 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:56.555 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713661+0000", 2023-09-30T17:03:56.555 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6000000000000004e-07 2023-09-30T17:03:56.555 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.555 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.555 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:56.555 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713669+0000", 2023-09-30T17:03:56.555 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2039999999999997e-06 2023-09-30T17:03:56.555 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.555 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.555 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:56.556 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713679+0000", 2023-09-30T17:03:56.556 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5999999999999996e-06 2023-09-30T17:03:56.556 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.556 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.556 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:56.556 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713683+0000", 2023-09-30T17:03:56.556 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4390000000000002e-06 2023-09-30T17:03:56.556 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.556 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.556 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:56.556 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713722+0000", 2023-09-30T17:03:56.557 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8707000000000001e-05 2023-09-30T17:03:56.557 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.557 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.557 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:56.557 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713780+0000", 2023-09-30T17:03:56.557 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8242000000000002e-05 2023-09-30T17:03:56.557 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.557 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.557 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:56.557 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.933335+0000", 2023-09-30T17:03:56.557 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.21955456500000001 2023-09-30T17:03:56.558 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.558 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.558 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:56.558 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.933388+0000", 2023-09-30T17:03:56.558 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2843999999999998e-05 2023-09-30T17:03:56.558 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.558 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.558 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:56.558 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.933471+0000", 2023-09-30T17:03:56.558 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3667999999999999e-05 2023-09-30T17:03:56.558 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:56.559 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:56.559 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:56.559 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.559 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.559 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23703 4.38 4:1d13bf87:::100000001f8.00000030:head [write 839680~4096 in=4096b,write 1101824~4096 in=4096b,write 1155072~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:56.559 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713696+0000", 2023-09-30T17:03:56.559 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 17.822808015, 2023-09-30T17:03:56.559 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.23500357699999999, 2023-09-30T17:03:56.559 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:56.559 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:56.559 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:56.560 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:56.560 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:56.560 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23703 2023-09-30T17:03:56.560 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.560 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:56.560 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.560 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:56.560 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713696+0000", 2023-09-30T17:03:56.560 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:56.560 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.560 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.560 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:56.561 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713696+0000", 2023-09-30T17:03:56.561 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:56.561 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.561 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.561 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:56.561 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713696+0000", 2023-09-30T17:03:56.561 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9500000000000003e-07 2023-09-30T17:03:56.561 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.561 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.561 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:56.561 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713711+0000", 2023-09-30T17:03:56.562 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5251e-05 2023-09-30T17:03:56.562 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.562 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.562 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:56.562 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713718+0000", 2023-09-30T17:03:56.562 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9430000000000003e-06 2023-09-30T17:03:56.562 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.562 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.562 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:56.562 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713723+0000", 2023-09-30T17:03:56.563 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4240000000000003e-06 2023-09-30T17:03:56.563 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.563 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.563 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:56.563 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713757+0000", 2023-09-30T17:03:56.563 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4128999999999998e-05 2023-09-30T17:03:56.563 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.563 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.563 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:56.563 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713841+0000", 2023-09-30T17:03:56.563 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3845999999999996e-05 2023-09-30T17:03:56.564 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.564 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.564 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:56.564 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.948561+0000", 2023-09-30T17:03:56.564 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.234720286 2023-09-30T17:03:56.564 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.564 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.564 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:56.564 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.948624+0000", 2023-09-30T17:03:56.564 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2961999999999998e-05 2023-09-30T17:03:56.564 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.565 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.565 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:56.565 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.948699+0000", 2023-09-30T17:03:56.565 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5240999999999993e-05 2023-09-30T17:03:56.565 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:56.565 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:56.565 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:56.565 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.565 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.565 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23706 4.f 4:f0d983b2:::100000001f8.0000001f:head [write 1003520~4096 in=4096b,write 1146880~4096 in=4096b,write 1163264~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:56.565 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713730+0000", 2023-09-30T17:03:56.566 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 17.822773959999999, 2023-09-30T17:03:56.566 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.22546488100000001, 2023-09-30T17:03:56.566 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:56.566 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:56.566 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:56.566 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:56.566 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:56.566 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23706 2023-09-30T17:03:56.566 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.567 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:56.567 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.567 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:56.567 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713730+0000", 2023-09-30T17:03:56.567 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:56.567 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.567 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.567 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:56.567 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713730+0000", 2023-09-30T17:03:56.567 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:56.568 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.568 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.568 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:56.568 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713730+0000", 2023-09-30T17:03:56.568 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0900000000000001e-07 2023-09-30T17:03:56.568 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.568 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.568 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:56.568 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713740+0000", 2023-09-30T17:03:56.568 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0115999999999999e-05 2023-09-30T17:03:56.568 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.569 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.569 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:56.569 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713747+0000", 2023-09-30T17:03:56.569 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5429999999999999e-06 2023-09-30T17:03:56.569 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.569 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.569 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:56.569 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713752+0000", 2023-09-30T17:03:56.569 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1270000000000002e-06 2023-09-30T17:03:56.569 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.569 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.569 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:56.570 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713788+0000", 2023-09-30T17:03:56.570 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5762000000000001e-05 2023-09-30T17:03:56.570 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.570 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.570 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:56.570 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713835+0000", 2023-09-30T17:03:56.570 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6808000000000003e-05 2023-09-30T17:03:56.570 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.570 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.570 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:56.570 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713962+0000", 2023-09-30T17:03:56.570 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000127315 2023-09-30T17:03:56.571 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.571 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.571 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:56.571 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.923977+0000", 2023-09-30T17:03:56.571 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.21001473100000001 2023-09-30T17:03:56.571 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.571 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.571 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:56.571 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939118+0000", 2023-09-30T17:03:56.571 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015141297999999999 2023-09-30T17:03:56.571 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.572 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.572 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:56.572 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939161+0000", 2023-09-30T17:03:56.572 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3458999999999998e-05 2023-09-30T17:03:56.572 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.572 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.572 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:56.572 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939195+0000", 2023-09-30T17:03:56.572 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3113e-05 2023-09-30T17:03:56.572 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:56.573 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:56.573 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:56.573 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.573 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.573 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23707 4.2f 4:f59f865b:::100000001f8.00000007:head [write 3575808~4096 in=4096b,write 3932160~4096 in=4096b,write 4063232~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:56.573 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713764+0000", 2023-09-30T17:03:56.573 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 17.822739516999999, 2023-09-30T17:03:56.573 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.225343612, 2023-09-30T17:03:56.573 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:56.573 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:56.574 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:56.574 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:56.574 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:56.574 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23707 2023-09-30T17:03:56.574 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.574 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:56.574 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.574 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:56.574 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713764+0000", 2023-09-30T17:03:56.574 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:56.574 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.575 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.575 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:56.575 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713764+0000", 2023-09-30T17:03:56.575 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:56.575 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.575 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.575 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:56.575 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713765+0000", 2023-09-30T17:03:56.575 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4099999999999999e-07 2023-09-30T17:03:56.575 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.575 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.576 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:56.576 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713775+0000", 2023-09-30T17:03:56.576 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0253e-05 2023-09-30T17:03:56.576 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.576 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.576 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:56.576 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713781+0000", 2023-09-30T17:03:56.576 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1770000000000003e-06 2023-09-30T17:03:56.576 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.576 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.577 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:56.577 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713787+0000", 2023-09-30T17:03:56.577 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.784e-06 2023-09-30T17:03:56.577 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.577 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.577 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:56.577 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713824+0000", 2023-09-30T17:03:56.577 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7258000000000001e-05 2023-09-30T17:03:56.577 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.577 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.577 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:56.577 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713897+0000", 2023-09-30T17:03:56.578 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3255000000000003e-05 2023-09-30T17:03:56.578 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.578 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.578 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:56.578 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.714035+0000", 2023-09-30T17:03:56.578 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013741799999999999 2023-09-30T17:03:56.578 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.578 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.578 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:56.578 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.924017+0000", 2023-09-30T17:03:56.578 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.20998277000000001 2023-09-30T17:03:56.579 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.579 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.579 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:56.579 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939013+0000", 2023-09-30T17:03:56.579 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014995432 2023-09-30T17:03:56.579 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.579 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.579 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:56.579 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939064+0000", 2023-09-30T17:03:56.579 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0784e-05 2023-09-30T17:03:56.579 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.580 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.580 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:56.580 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939108+0000", 2023-09-30T17:03:56.580 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4039999999999998e-05 2023-09-30T17:03:56.580 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:56.580 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:56.580 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:56.580 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.580 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.580 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23709 4.37 4:ef395e89:::100000001f8.00000020:head [write 4042752~4096 in=4096b,write 4124672~4096 in=4096b,write 4182016~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:56.581 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713796+0000", 2023-09-30T17:03:56.581 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 17.822707298000001, 2023-09-30T17:03:56.581 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.23291700700000001, 2023-09-30T17:03:56.581 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:56.581 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:56.581 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:56.581 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:56.581 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:56.581 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23709 2023-09-30T17:03:56.581 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.581 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:56.582 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.582 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:56.582 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713796+0000", 2023-09-30T17:03:56.582 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:56.582 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.582 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.582 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:56.582 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713796+0000", 2023-09-30T17:03:56.582 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:56.582 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.582 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.583 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:56.583 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713797+0000", 2023-09-30T17:03:56.583 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2200000000000004e-07 2023-09-30T17:03:56.583 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.583 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.583 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:56.583 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713807+0000", 2023-09-30T17:03:56.583 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.815e-06 2023-09-30T17:03:56.583 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.583 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.583 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:56.584 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713813+0000", 2023-09-30T17:03:56.584 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5899999999999996e-06 2023-09-30T17:03:56.584 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.584 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.584 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:56.584 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713818+0000", 2023-09-30T17:03:56.584 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2639999999999999e-06 2023-09-30T17:03:56.584 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.584 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.584 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:56.585 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.714818+0000", 2023-09-30T17:03:56.585 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00099973500000000008 2023-09-30T17:03:56.585 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.585 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.585 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:56.585 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.921155+0000", 2023-09-30T17:03:56.585 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.206336778 2023-09-30T17:03:56.585 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.585 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.585 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:56.585 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.921347+0000", 2023-09-30T17:03:56.586 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000191917 2023-09-30T17:03:56.586 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.586 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.586 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:56.586 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.944206+0000", 2023-09-30T17:03:56.586 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022859349000000001 2023-09-30T17:03:56.586 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.586 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.586 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:56.586 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.946622+0000", 2023-09-30T17:03:56.586 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0024161849999999999 2023-09-30T17:03:56.587 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.587 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.587 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:56.587 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.946673+0000", 2023-09-30T17:03:56.587 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0670000000000001e-05 2023-09-30T17:03:56.587 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.587 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.587 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:56.587 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.946713+0000", 2023-09-30T17:03:56.587 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0182000000000003e-05 2023-09-30T17:03:56.587 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:56.588 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:56.588 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:56.588 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.588 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.588 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23710 4.12 4:4be51a30:::100000001f8.0000000b:head [write 3772416~4096 in=4096b,write 3825664~4096 in=4096b,write 3833856~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:56.588 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713827+0000", 2023-09-30T17:03:56.588 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 17.822676813000001, 2023-09-30T17:03:56.588 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.214817016, 2023-09-30T17:03:56.588 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:56.588 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:56.588 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:56.589 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:56.589 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:56.589 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23710 2023-09-30T17:03:56.589 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.589 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:56.589 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.589 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:56.589 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713827+0000", 2023-09-30T17:03:56.589 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:56.589 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.589 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.590 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:56.590 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713827+0000", 2023-09-30T17:03:56.590 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:56.590 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.590 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.590 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:56.590 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713827+0000", 2023-09-30T17:03:56.590 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.51e-07 2023-09-30T17:03:56.590 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.590 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.590 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:56.590 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713837+0000", 2023-09-30T17:03:56.591 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8239999999999995e-06 2023-09-30T17:03:56.591 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.591 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.591 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:56.591 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713843+0000", 2023-09-30T17:03:56.591 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3729999999999998e-06 2023-09-30T17:03:56.591 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.591 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.591 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:56.591 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713849+0000", 2023-09-30T17:03:56.591 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3480000000000003e-06 2023-09-30T17:03:56.592 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.592 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.592 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:56.592 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713896+0000", 2023-09-30T17:03:56.592 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7426999999999998e-05 2023-09-30T17:03:56.592 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.592 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.592 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:56.592 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713969+0000", 2023-09-30T17:03:56.592 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2496000000000005e-05 2023-09-30T17:03:56.592 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.593 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.593 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:56.593 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.714114+0000", 2023-09-30T17:03:56.593 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014550699999999999 2023-09-30T17:03:56.593 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.593 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.593 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:56.593 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.922604+0000", 2023-09-30T17:03:56.593 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.20848978900000001 2023-09-30T17:03:56.593 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.594 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.594 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:56.594 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.928219+0000", 2023-09-30T17:03:56.594 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056147159999999996 2023-09-30T17:03:56.594 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.594 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.594 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:56.594 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.928268+0000", 2023-09-30T17:03:56.594 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9353e-05 2023-09-30T17:03:56.594 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.594 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.595 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:56.595 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.928644+0000", 2023-09-30T17:03:56.595 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00037573199999999999 2023-09-30T17:03:56.595 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:56.595 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:56.595 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:56.595 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.595 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.595 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23711 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 270336~4096 in=4096b,write 876544~4096 in=4096b,write 933888~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:56.595 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713868+0000", 2023-09-30T17:03:56.596 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 17.822635952999999, 2023-09-30T17:03:56.596 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.234682211, 2023-09-30T17:03:56.596 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:56.596 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:56.596 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:56.596 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:56.596 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:56.596 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23711 2023-09-30T17:03:56.596 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.596 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:56.596 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.597 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:56.597 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713868+0000", 2023-09-30T17:03:56.597 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:56.597 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.597 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.597 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:56.597 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713868+0000", 2023-09-30T17:03:56.597 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:56.597 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.597 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.597 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:56.598 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713868+0000", 2023-09-30T17:03:56.598 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.75e-07 2023-09-30T17:03:56.598 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.598 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.598 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:56.598 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713879+0000", 2023-09-30T17:03:56.598 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0494e-05 2023-09-30T17:03:56.598 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.598 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.598 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:56.598 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713886+0000", 2023-09-30T17:03:56.599 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3159999999999999e-06 2023-09-30T17:03:56.599 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.599 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.599 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:56.599 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713892+0000", 2023-09-30T17:03:56.599 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7200000000000003e-06 2023-09-30T17:03:56.599 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.599 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.599 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:56.599 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.714747+0000", 2023-09-30T17:03:56.599 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00085524699999999995 2023-09-30T17:03:56.600 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.600 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.600 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:56.600 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.714822+0000", 2023-09-30T17:03:56.600 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5444999999999993e-05 2023-09-30T17:03:56.600 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.600 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.600 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:56.600 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.947884+0000", 2023-09-30T17:03:56.600 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.233061449 2023-09-30T17:03:56.601 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.601 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.601 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:56.601 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.947942+0000", 2023-09-30T17:03:56.601 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7649999999999999e-05 2023-09-30T17:03:56.601 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.601 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.601 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:56.601 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.948550+0000", 2023-09-30T17:03:56.601 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00060831500000000001 2023-09-30T17:03:56.601 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:56.602 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:56.602 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:56.602 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.602 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.602 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23712 4.37 4:eff9002a:::100000001f8.00000003:head [write 3387392~8192,write 3452928~4096,write 3710976~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:56.602 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713901+0000", 2023-09-30T17:03:56.602 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 17.822602894999999, 2023-09-30T17:03:56.602 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.25525220700000001, 2023-09-30T17:03:56.602 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:56.602 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:56.602 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:56.603 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:56.603 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:56.603 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23712 2023-09-30T17:03:56.603 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.603 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:56.603 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.603 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:56.603 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713901+0000", 2023-09-30T17:03:56.603 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:56.603 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.603 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.604 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:56.604 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713901+0000", 2023-09-30T17:03:56.604 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:56.604 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.604 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.604 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:56.604 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713901+0000", 2023-09-30T17:03:56.604 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.96e-07 2023-09-30T17:03:56.604 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.604 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.604 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:56.605 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713912+0000", 2023-09-30T17:03:56.605 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0543999999999999e-05 2023-09-30T17:03:56.605 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.605 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.605 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:56.605 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713918+0000", 2023-09-30T17:03:56.605 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4420000000000003e-06 2023-09-30T17:03:56.605 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.605 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.605 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:56.605 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713923+0000", 2023-09-30T17:03:56.606 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3059999999999997e-06 2023-09-30T17:03:56.606 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.606 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.606 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:56.606 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.946744+0000", 2023-09-30T17:03:56.606 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.23282061100000001 2023-09-30T17:03:56.606 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.606 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.606 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:56.606 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.946818+0000", 2023-09-30T17:03:56.607 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3762000000000003e-05 2023-09-30T17:03:56.607 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.607 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.607 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:56.607 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.946949+0000", 2023-09-30T17:03:56.607 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013133900000000001 2023-09-30T17:03:56.607 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.607 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.607 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:56.607 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.951383+0000", 2023-09-30T17:03:56.608 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0044336999999999996 2023-09-30T17:03:56.608 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.608 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.608 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:56.608 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.969076+0000", 2023-09-30T17:03:56.608 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017693303000000001 2023-09-30T17:03:56.608 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.608 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.608 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:56.608 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.969119+0000", 2023-09-30T17:03:56.608 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3208999999999999e-05 2023-09-30T17:03:56.608 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.609 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.609 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:56.609 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.969153+0000", 2023-09-30T17:03:56.609 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3594999999999999e-05 2023-09-30T17:03:56.609 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:56.609 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:56.609 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:56.609 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.609 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.609 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:23713 4.33 e41/17 4:cf6d7a6c:::100000001f8.0000000a:head v 41'399, mlcod=41'397)", 2023-09-30T17:03:56.610 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.715224+0000", 2023-09-30T17:03:56.610 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 17.821279615000002, 2023-09-30T17:03:56.610 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.230022326, 2023-09-30T17:03:56.610 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:56.610 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:56.610 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:56.610 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.610 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:56.610 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.715224+0000", 2023-09-30T17:03:56.610 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:56.610 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.610 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.611 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:56.611 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.715224+0000", 2023-09-30T17:03:56.611 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:56.611 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.611 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.611 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:56.611 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.715228+0000", 2023-09-30T17:03:56.611 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4220000000000002e-06 2023-09-30T17:03:56.611 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.611 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.611 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:56.612 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.715239+0000", 2023-09-30T17:03:56.612 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0261999999999999e-05 2023-09-30T17:03:56.612 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.612 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.612 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:56.612 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.921195+0000", 2023-09-30T17:03:56.612 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.205955902 2023-09-30T17:03:56.612 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.612 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.613 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:56.613 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.921210+0000", 2023-09-30T17:03:56.613 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5109999999999999e-05 2023-09-30T17:03:56.613 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.613 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.613 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:56.613 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.921430+0000", 2023-09-30T17:03:56.613 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022019300000000001 2023-09-30T17:03:56.613 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.613 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.613 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:56.614 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.921454+0000", 2023-09-30T17:03:56.614 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4142e-05 2023-09-30T17:03:56.614 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.614 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.614 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:56.614 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.945208+0000", 2023-09-30T17:03:56.614 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.023753765999999999 2023-09-30T17:03:56.614 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.614 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.614 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:56.614 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.945246+0000", 2023-09-30T17:03:56.614 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8529000000000003e-05 2023-09-30T17:03:56.615 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:56.615 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:56.615 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:56.615 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.615 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.615 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24202 4.38 4:1dcf718c:::100000001f8.00000022:head [write 966656~4096,write 995328~4096,write 1007616~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:56.615 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.938506+0000", 2023-09-30T17:03:56.615 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 17.597998025999999, 2023-09-30T17:03:56.615 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.19404896199999999, 2023-09-30T17:03:56.615 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:56.616 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:56.616 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:56.616 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:56.616 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:56.616 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24202 2023-09-30T17:03:56.616 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.616 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:56.616 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.616 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:56.616 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938506+0000", 2023-09-30T17:03:56.616 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:56.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.617 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.617 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:56.617 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938506+0000", 2023-09-30T17:03:56.617 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:56.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.617 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.617 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:56.617 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938506+0000", 2023-09-30T17:03:56.617 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7899999999999999e-07 2023-09-30T17:03:56.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.618 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.618 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:56.618 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938539+0000", 2023-09-30T17:03:56.618 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2839999999999997e-05 2023-09-30T17:03:56.618 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.618 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.618 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:56.618 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938549+0000", 2023-09-30T17:03:56.618 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0202e-05 2023-09-30T17:03:56.621 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.621 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.621 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:56.621 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938554+0000", 2023-09-30T17:03:56.621 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1660000000000002e-06 2023-09-30T17:03:56.621 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.622 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.622 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:56.622 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.107092+0000", 2023-09-30T17:03:56.622 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.168537457 2023-09-30T17:03:56.622 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.622 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.622 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:56.622 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.107174+0000", 2023-09-30T17:03:56.622 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2380999999999996e-05 2023-09-30T17:03:56.622 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.622 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.623 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:56.623 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.132433+0000", 2023-09-30T17:03:56.623 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.025258939000000001 2023-09-30T17:03:56.623 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.623 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.623 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:56.623 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.132483+0000", 2023-09-30T17:03:56.623 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9951000000000003e-05 2023-09-30T17:03:56.623 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.623 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.623 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:56.624 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.132555+0000", 2023-09-30T17:03:56.624 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1647e-05 2023-09-30T17:03:56.624 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:56.624 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:56.624 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:56.624 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.624 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.624 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24207 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 2002944~4096,write 2060288~4096,write 2068480~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:56.624 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.938605+0000", 2023-09-30T17:03:56.624 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 17.597898759, 2023-09-30T17:03:56.624 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.19406049, 2023-09-30T17:03:56.625 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:56.625 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:56.625 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:56.625 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:56.625 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:56.625 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24207 2023-09-30T17:03:56.625 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.625 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:56.625 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.625 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:56.625 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938605+0000", 2023-09-30T17:03:56.625 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:56.626 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.626 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.626 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:56.626 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938605+0000", 2023-09-30T17:03:56.626 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:56.626 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.626 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.626 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:56.626 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938605+0000", 2023-09-30T17:03:56.626 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2899999999999999e-07 2023-09-30T17:03:56.627 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.627 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.627 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:56.627 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938621+0000", 2023-09-30T17:03:56.627 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5624000000000002e-05 2023-09-30T17:03:56.627 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.627 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.627 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:56.627 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938627+0000", 2023-09-30T17:03:56.627 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.925e-06 2023-09-30T17:03:56.627 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.628 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.628 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:56.628 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938630+0000", 2023-09-30T17:03:56.628 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4599999999999999e-06 2023-09-30T17:03:56.628 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.628 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.628 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:56.628 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.110850+0000", 2023-09-30T17:03:56.628 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.17221983699999999 2023-09-30T17:03:56.628 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:56.629 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.110930+0000", 2023-09-30T17:03:56.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0092999999999994e-05 2023-09-30T17:03:56.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:56.629 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.132561+0000", 2023-09-30T17:03:56.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021631371999999999 2023-09-30T17:03:56.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.630 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:56.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.132604+0000", 2023-09-30T17:03:56.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2818999999999998e-05 2023-09-30T17:03:56.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.630 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:56.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.132665+0000", 2023-09-30T17:03:56.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1030999999999999e-05 2023-09-30T17:03:56.630 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:56.630 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:56.631 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:56.631 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.631 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.631 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24210 4.30 4:0c89e311:::100000001f8.00000017:head [write 3231744~4096,write 3272704~4096,write 3346432~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:56.631 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.938660+0000", 2023-09-30T17:03:56.631 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 17.597843690000001, 2023-09-30T17:03:56.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.194937256, 2023-09-30T17:03:56.631 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:56.631 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:56.631 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:56.632 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:56.632 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:56.632 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24210 2023-09-30T17:03:56.632 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.632 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:56.632 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.632 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:56.632 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938660+0000", 2023-09-30T17:03:56.632 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:56.632 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.633 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.633 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:56.633 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938660+0000", 2023-09-30T17:03:56.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:56.633 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.633 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.633 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:56.633 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938660+0000", 2023-09-30T17:03:56.634 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5800000000000001e-07 2023-09-30T17:03:56.634 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.634 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:56.634 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938676+0000", 2023-09-30T17:03:56.634 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5650000000000001e-05 2023-09-30T17:03:56.634 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.634 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:56.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938685+0000", 2023-09-30T17:03:56.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9250000000000001e-06 2023-09-30T17:03:56.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:56.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938690+0000", 2023-09-30T17:03:56.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8160000000000001e-06 2023-09-30T17:03:56.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:56.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.110993+0000", 2023-09-30T17:03:56.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.172303714 2023-09-30T17:03:56.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:56.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.111072+0000", 2023-09-30T17:03:56.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8448999999999994e-05 2023-09-30T17:03:56.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:56.637 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.133463+0000", 2023-09-30T17:03:56.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022391297000000001 2023-09-30T17:03:56.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.637 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:56.637 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.133518+0000", 2023-09-30T17:03:56.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5278999999999997e-05 2023-09-30T17:03:56.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.638 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:56.638 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.133597+0000", 2023-09-30T17:03:56.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8868000000000005e-05 2023-09-30T17:03:56.638 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:56.638 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:56.638 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:56.638 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.638 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24218 4.30 4:0c89e311:::100000001f8.00000017:head [write 1191936~4096,write 1245184~4096,write 1261568~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:56.639 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.938815+0000", 2023-09-30T17:03:56.639 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 17.597688407, 2023-09-30T17:03:56.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.19788513899999999, 2023-09-30T17:03:56.639 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:56.639 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:56.639 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:56.639 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:56.639 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:56.639 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24218 2023-09-30T17:03:56.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.640 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:56.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:56.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938815+0000", 2023-09-30T17:03:56.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:56.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:56.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938815+0000", 2023-09-30T17:03:56.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:56.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:56.641 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938816+0000", 2023-09-30T17:03:56.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8699999999999995e-07 2023-09-30T17:03:56.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:56.642 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938837+0000", 2023-09-30T17:03:56.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1534000000000001e-05 2023-09-30T17:03:56.642 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.642 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.642 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:56.642 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938845+0000", 2023-09-30T17:03:56.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7190000000000001e-06 2023-09-30T17:03:56.642 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.642 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.642 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:56.643 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938850+0000", 2023-09-30T17:03:56.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1220000000000003e-06 2023-09-30T17:03:56.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.643 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:56.643 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.113486+0000", 2023-09-30T17:03:56.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.17463620299999999 2023-09-30T17:03:56.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.643 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:56.644 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.113626+0000", 2023-09-30T17:03:56.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013924799999999999 2023-09-30T17:03:56.644 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:56.644 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.136575+0000", 2023-09-30T17:03:56.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022949701999999999 2023-09-30T17:03:56.644 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:56.644 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.136623+0000", 2023-09-30T17:03:56.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7808e-05 2023-09-30T17:03:56.645 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.645 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.645 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:56.645 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.136700+0000", 2023-09-30T17:03:56.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7316000000000003e-05 2023-09-30T17:03:56.645 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:56.645 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:56.645 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:56.645 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.645 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.646 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24223 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 2449408~4096,write 2936832~4096,write 2973696~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:56.646 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.938922+0000", 2023-09-30T17:03:56.646 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 17.597581579, 2023-09-30T17:03:56.646 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.19909703600000001, 2023-09-30T17:03:56.646 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:56.646 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:56.646 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:56.646 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:56.646 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:56.646 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24223 2023-09-30T17:03:56.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.647 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:56.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.647 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:56.647 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938922+0000", 2023-09-30T17:03:56.647 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:56.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.647 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:56.647 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938922+0000", 2023-09-30T17:03:56.647 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:56.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:56.648 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938922+0000", 2023-09-30T17:03:56.648 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8599999999999999e-07 2023-09-30T17:03:56.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:56.648 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938943+0000", 2023-09-30T17:03:56.648 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0588999999999999e-05 2023-09-30T17:03:56.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.649 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:56.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938958+0000", 2023-09-30T17:03:56.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4915e-05 2023-09-30T17:03:56.649 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.649 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:56.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938964+0000", 2023-09-30T17:03:56.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8329999999999999e-06 2023-09-30T17:03:56.649 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.650 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:56.650 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.114879+0000", 2023-09-30T17:03:56.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.17591552699999999 2023-09-30T17:03:56.650 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.650 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.650 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:56.650 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.114958+0000", 2023-09-30T17:03:56.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8666999999999997e-05 2023-09-30T17:03:56.650 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.650 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.651 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:56.651 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.137905+0000", 2023-09-30T17:03:56.651 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022947381999999999 2023-09-30T17:03:56.651 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.651 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:56.651 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.137948+0000", 2023-09-30T17:03:56.651 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2851e-05 2023-09-30T17:03:56.651 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.651 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:56.652 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.138019+0000", 2023-09-30T17:03:56.652 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0885999999999999e-05 2023-09-30T17:03:56.652 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:56.652 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:56.652 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:56.652 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.652 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.652 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24231 4.30 4:0c89e311:::100000001f8.00000017:head [write 3121152~4096,write 3174400~4096,write 3198976~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:56.652 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.939120+0000", 2023-09-30T17:03:56.652 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 17.597383239999999, 2023-09-30T17:03:56.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.199038715, 2023-09-30T17:03:56.653 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:56.653 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:56.653 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:56.653 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:56.653 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:56.653 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24231 2023-09-30T17:03:56.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.653 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:56.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.654 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:56.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939120+0000", 2023-09-30T17:03:56.654 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:56.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.654 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:56.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939120+0000", 2023-09-30T17:03:56.654 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:56.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.655 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:56.655 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939121+0000", 2023-09-30T17:03:56.655 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5799999999999999e-07 2023-09-30T17:03:56.655 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.655 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.655 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:56.655 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939138+0000", 2023-09-30T17:03:56.655 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6742e-05 2023-09-30T17:03:56.655 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.655 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.656 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:56.656 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939145+0000", 2023-09-30T17:03:56.656 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2230000000000001e-06 2023-09-30T17:03:56.656 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.656 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.656 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:56.656 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939155+0000", 2023-09-30T17:03:56.656 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.995e-06 2023-09-30T17:03:56.656 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.656 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.657 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:56.657 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.116318+0000", 2023-09-30T17:03:56.657 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.17716331799999999 2023-09-30T17:03:56.657 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.657 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:56.657 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.116392+0000", 2023-09-30T17:03:56.657 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3379000000000003e-05 2023-09-30T17:03:56.657 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.657 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:56.657 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.138027+0000", 2023-09-30T17:03:56.658 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021635318000000001 2023-09-30T17:03:56.658 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:56.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.138076+0000", 2023-09-30T17:03:56.658 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9055999999999999e-05 2023-09-30T17:03:56.658 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:56.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.138159+0000", 2023-09-30T17:03:56.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3126000000000003e-05 2023-09-30T17:03:56.659 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:56.659 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:56.659 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:56.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.659 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.659 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24247 4.30 4:0c89e311:::100000001f8.00000017:head [write 2134016~4096,write 2150400~4096,write 2207744~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:56.659 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.939330+0000", 2023-09-30T17:03:56.659 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 17.597173547000001, 2023-09-30T17:03:56.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.200392818, 2023-09-30T17:03:56.659 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:56.660 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:56.660 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:56.660 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:56.660 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:56.660 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24247 2023-09-30T17:03:56.660 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.660 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:56.660 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.660 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:56.660 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939330+0000", 2023-09-30T17:03:56.661 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:56.661 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.661 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.661 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:56.661 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939330+0000", 2023-09-30T17:03:56.661 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:56.661 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.661 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.661 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:56.661 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939330+0000", 2023-09-30T17:03:56.661 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7500000000000001e-07 2023-09-30T17:03:56.662 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.662 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.662 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:56.662 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939339+0000", 2023-09-30T17:03:56.662 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6719999999999993e-06 2023-09-30T17:03:56.662 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.662 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.662 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:56.662 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939342+0000", 2023-09-30T17:03:56.662 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4170000000000001e-06 2023-09-30T17:03:56.663 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.663 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.663 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:56.663 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939345+0000", 2023-09-30T17:03:56.663 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7190000000000001e-06 2023-09-30T17:03:56.663 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.663 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.663 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:56.663 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.126008+0000", 2023-09-30T17:03:56.663 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.18666300499999999 2023-09-30T17:03:56.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.664 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:56.664 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.126132+0000", 2023-09-30T17:03:56.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012387800000000001 2023-09-30T17:03:56.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.664 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:56.664 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.139635+0000", 2023-09-30T17:03:56.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013502739 2023-09-30T17:03:56.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:56.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.139669+0000", 2023-09-30T17:03:56.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3810000000000003e-05 2023-09-30T17:03:56.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:56.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.139723+0000", 2023-09-30T17:03:56.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4302999999999998e-05 2023-09-30T17:03:56.665 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:56.665 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:56.665 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:56.666 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.666 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24272 4.38 4:1fc350da:::100000001f8.0000002f:head [write 638976~4096,write 843776~4096,write 864256~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:56.666 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.939523+0000", 2023-09-30T17:03:56.666 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 17.596980639000002, 2023-09-30T17:03:56.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.19876761700000001, 2023-09-30T17:03:56.666 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:56.666 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:56.666 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:56.666 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:56.666 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:56.667 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24272 2023-09-30T17:03:56.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.667 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:56.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:56.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939523+0000", 2023-09-30T17:03:56.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:56.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:56.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939523+0000", 2023-09-30T17:03:56.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:56.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.668 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:56.668 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939523+0000", 2023-09-30T17:03:56.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6199999999999999e-07 2023-09-30T17:03:56.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.668 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:56.668 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939538+0000", 2023-09-30T17:03:56.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5122e-05 2023-09-30T17:03:56.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.669 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.669 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:56.669 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939544+0000", 2023-09-30T17:03:56.669 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.327e-06 2023-09-30T17:03:56.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.669 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.669 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:56.669 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939549+0000", 2023-09-30T17:03:56.669 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8130000000000003e-06 2023-09-30T17:03:56.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.670 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.670 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:56.670 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.123535+0000", 2023-09-30T17:03:56.670 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.18398595700000001 2023-09-30T17:03:56.670 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.670 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.670 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:56.670 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.123962+0000", 2023-09-30T17:03:56.670 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000427136 2023-09-30T17:03:56.670 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.670 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.671 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:56.671 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.138167+0000", 2023-09-30T17:03:56.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014205096 2023-09-30T17:03:56.671 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.671 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.671 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:56.671 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.138217+0000", 2023-09-30T17:03:56.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0241999999999998e-05 2023-09-30T17:03:56.671 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.671 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.671 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:56.672 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.138291+0000", 2023-09-30T17:03:56.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3561999999999998e-05 2023-09-30T17:03:56.672 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:56.672 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:56.672 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:56.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.672 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24277 4.38 4:1fc350da:::100000001f8.0000002f:head [write 1036288~4096,write 1122304~4096,write 1220608~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:56.672 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.939581+0000", 2023-09-30T17:03:56.672 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 17.596922865, 2023-09-30T17:03:56.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.200284616, 2023-09-30T17:03:56.673 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:56.673 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:56.673 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:56.673 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:56.673 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:56.673 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24277 2023-09-30T17:03:56.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.673 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:56.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.673 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:56.673 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939581+0000", 2023-09-30T17:03:56.674 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:56.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.674 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:56.674 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939581+0000", 2023-09-30T17:03:56.674 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:56.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.674 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:56.675 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939581+0000", 2023-09-30T17:03:56.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4499999999999998e-07 2023-09-30T17:03:56.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.675 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:56.675 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939596+0000", 2023-09-30T17:03:56.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5007999999999999e-05 2023-09-30T17:03:56.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.675 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:56.675 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939600+0000", 2023-09-30T17:03:56.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6859999999999999e-06 2023-09-30T17:03:56.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:56.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939603+0000", 2023-09-30T17:03:56.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8700000000000001e-06 2023-09-30T17:03:56.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:56.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.129152+0000", 2023-09-30T17:03:56.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.18954922599999999 2023-09-30T17:03:56.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.677 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:56.677 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.129238+0000", 2023-09-30T17:03:56.677 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6446000000000005e-05 2023-09-30T17:03:56.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.677 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:56.677 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.139771+0000", 2023-09-30T17:03:56.677 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010532674000000001 2023-09-30T17:03:56.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.678 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.678 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:03:56.678 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.139819+0000", 2023-09-30T17:03:56.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7633999999999998e-05 2023-09-30T17:03:56.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:56.678 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:56.678 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:03:56.678 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.139865+0000", 2023-09-30T17:03:56.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6826999999999997e-05 2023-09-30T17:03:56.678 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:56.678 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:56.679 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:56.679 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:56.679 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:56.679 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:56.680 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:56.679+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:56.681 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:03:56.781 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:56.780+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:56.882 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:56.882+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:56.889 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:56.889 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:03:56.889 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.889 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:73689 4.27 4.df99e167 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:56.889 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.813805+0000", 2023-09-30T17:03:56.890 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.067495147000000005, 2023-09-30T17:03:56.890 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.067511590999999996, 2023-09-30T17:03:56.890 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:56.890 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:56.890 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:56.890 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:56.890 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:56.891 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 73689 2023-09-30T17:03:56.891 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.891 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:56.891 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.891 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:56.891 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.813805+0000", 2023-09-30T17:03:56.891 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:56.892 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.892 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.892 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:56.892 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.813805+0000", 2023-09-30T17:03:56.892 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:56.892 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.892 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.892 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:56.892 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.813806+0000", 2023-09-30T17:03:56.892 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8800000000000002e-07 2023-09-30T17:03:56.892 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.893 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.893 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:56.893 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.813818+0000", 2023-09-30T17:03:56.893 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1902999999999999e-05 2023-09-30T17:03:56.893 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.893 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.893 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:56.893 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.813827+0000", 2023-09-30T17:03:56.894 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9989999999999997e-06 2023-09-30T17:03:56.894 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.894 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.894 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:56.894 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.813834+0000", 2023-09-30T17:03:56.894 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0389999999999999e-06 2023-09-30T17:03:56.894 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:56.895 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:56.895 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:56.895 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.895 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.895 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:73778 4.f e47/17 4:f0d983b2:::100000001f8.0000001f:head v 47'3504, mlcod=47'3493)", 2023-09-30T17:03:56.895 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.848676+0000", 2023-09-30T17:03:56.895 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.032624237, 2023-09-30T17:03:56.895 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.032680175999999998, 2023-09-30T17:03:56.895 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:56.896 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:56.896 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:56.896 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.896 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:56.896 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.848676+0000", 2023-09-30T17:03:56.896 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:56.896 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.896 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.896 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:56.896 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.848676+0000", 2023-09-30T17:03:56.896 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:56.897 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.897 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.897 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:56.897 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.848676+0000", 2023-09-30T17:03:56.897 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.5199999999999998e-07 2023-09-30T17:03:56.897 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.897 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.897 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:56.897 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.848686+0000", 2023-09-30T17:03:56.898 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.6050000000000004e-06 2023-09-30T17:03:56.898 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.898 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.898 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:56.898 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.848693+0000", 2023-09-30T17:03:56.898 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2899999999999997e-06 2023-09-30T17:03:56.898 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.898 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.899 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:56.899 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.848697+0000", 2023-09-30T17:03:56.899 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.145e-06 2023-09-30T17:03:56.899 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.899 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.899 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:56.900 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.865188+0000", 2023-09-30T17:03:56.900 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.016491446999999999 2023-09-30T17:03:56.900 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.900 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.900 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:56.900 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.865208+0000", 2023-09-30T17:03:56.900 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9683000000000001e-05 2023-09-30T17:03:56.900 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:56.901 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:56.901 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:56.901 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.901 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.901 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:73812 4.37 e47/17 4:eff9002a:::100000001f8.00000003:head v 47'3469, mlcod=47'3460)", 2023-09-30T17:03:56.901 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.860143+0000", 2023-09-30T17:03:56.902 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.021157355999999999, 2023-09-30T17:03:56.902 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.021248647999999998, 2023-09-30T17:03:56.902 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:56.902 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:56.902 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:56.902 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.903 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:56.903 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.860143+0000", 2023-09-30T17:03:56.903 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:56.903 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.903 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.903 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:56.903 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.860143+0000", 2023-09-30T17:03:56.903 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:56.903 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.903 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.903 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:56.904 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.860144+0000", 2023-09-30T17:03:56.904 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.13e-07 2023-09-30T17:03:56.904 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.904 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.904 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:56.904 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.860170+0000", 2023-09-30T17:03:56.904 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.6210000000000001e-05 2023-09-30T17:03:56.904 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.904 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.904 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:56.905 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.860177+0000", 2023-09-30T17:03:56.905 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.007e-06 2023-09-30T17:03:56.905 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.905 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.905 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:56.905 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.860181+0000", 2023-09-30T17:03:56.905 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6e-06 2023-09-30T17:03:56.905 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.905 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.905 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:56.905 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.880614+0000", 2023-09-30T17:03:56.906 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.020432775 2023-09-30T17:03:56.906 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.906 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.906 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:56.906 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.880635+0000", 2023-09-30T17:03:56.906 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1174000000000001e-05 2023-09-30T17:03:56.906 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:56.906 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:56.906 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:56.906 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.906 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.907 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:73854 4.12 e47/17 4:48ab9bde:::100000001f8.00000015:head v 47'2294, mlcod=47'2289)", 2023-09-30T17:03:56.907 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.870477+0000", 2023-09-30T17:03:56.907 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.01082373, 2023-09-30T17:03:56.907 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.01094824, 2023-09-30T17:03:56.907 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:56.907 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:56.907 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:56.907 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.907 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:56.907 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.870477+0000", 2023-09-30T17:03:56.908 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:56.908 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.908 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.908 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:56.908 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.870477+0000", 2023-09-30T17:03:56.908 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:56.908 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.908 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.909 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:56.909 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.870477+0000", 2023-09-30T17:03:56.909 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4999999999999998e-07 2023-09-30T17:03:56.909 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.909 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.909 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:56.909 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.870491+0000", 2023-09-30T17:03:56.909 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.381e-05 2023-09-30T17:03:56.909 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.909 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.909 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:56.910 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.870499+0000", 2023-09-30T17:03:56.910 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9279999999999993e-06 2023-09-30T17:03:56.910 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.910 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.910 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:56.910 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.870505+0000", 2023-09-30T17:03:56.910 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7980000000000002e-06 2023-09-30T17:03:56.910 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.910 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.910 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:56.911 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.875321+0000", 2023-09-30T17:03:56.911 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0048167660000000001 2023-09-30T17:03:56.911 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.911 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.911 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:56.911 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.875349+0000", 2023-09-30T17:03:56.911 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.7234e-05 2023-09-30T17:03:56.911 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:56.911 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:56.911 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:56.911 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.912 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.912 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:73792 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 1982464~4096 in=4096b,write 2043904~4096 in=4096b,write 2281472~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:56.912 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.848785+0000", 2023-09-30T17:03:56.912 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.032515441999999999, 2023-09-30T17:03:56.912 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.032683873000000002, 2023-09-30T17:03:56.912 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:56.912 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:56.912 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:56.912 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:56.912 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:56.912 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 73792 2023-09-30T17:03:56.913 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.913 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:56.913 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.913 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:56.913 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.848785+0000", 2023-09-30T17:03:56.913 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:56.913 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.913 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.913 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:56.913 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.848785+0000", 2023-09-30T17:03:56.913 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:56.914 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.914 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.914 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:56.914 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.848786+0000", 2023-09-30T17:03:56.914 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8500000000000001e-07 2023-09-30T17:03:56.914 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.914 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.914 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:56.914 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.848807+0000", 2023-09-30T17:03:56.914 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1526999999999999e-05 2023-09-30T17:03:56.915 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.915 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.915 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:56.915 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.848813+0000", 2023-09-30T17:03:56.915 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7520000000000002e-06 2023-09-30T17:03:56.915 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.915 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.915 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:56.915 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.848818+0000", 2023-09-30T17:03:56.915 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3290000000000001e-06 2023-09-30T17:03:56.916 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.916 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.916 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:56.916 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.862109+0000", 2023-09-30T17:03:56.916 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.013290877 2023-09-30T17:03:56.916 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.916 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.916 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:56.916 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.862193+0000", 2023-09-30T17:03:56.916 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3908999999999999e-05 2023-09-30T17:03:56.916 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.916 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.917 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:56.917 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.862328+0000", 2023-09-30T17:03:56.917 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000134902 2023-09-30T17:03:56.917 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.917 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.917 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:56.917 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.871859+0000", 2023-09-30T17:03:56.917 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0095310700000000009 2023-09-30T17:03:56.917 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:56.917 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:56.918 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:56.918 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.918 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.918 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:73815 4.f e47/17 4:f26fdfa9:::100000001f8.00000002:head v 47'3506, mlcod=47'3494)", 2023-09-30T17:03:56.918 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.860220+0000", 2023-09-30T17:03:56.918 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.021080733000000001, 2023-09-30T17:03:56.918 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.021329207999999999, 2023-09-30T17:03:56.918 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:56.919 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:56.919 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:56.919 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.919 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:56.919 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.860220+0000", 2023-09-30T17:03:56.919 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:56.919 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.919 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.919 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:56.919 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.860220+0000", 2023-09-30T17:03:56.920 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:56.920 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.920 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.920 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:56.920 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.860220+0000", 2023-09-30T17:03:56.920 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2199999999999999e-07 2023-09-30T17:03:56.920 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.920 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.920 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:56.920 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.860231+0000", 2023-09-30T17:03:56.921 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1165999999999999e-05 2023-09-30T17:03:56.921 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.921 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.921 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:56.921 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.860236+0000", 2023-09-30T17:03:56.921 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.977e-06 2023-09-30T17:03:56.921 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.921 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.921 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:56.921 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.860240+0000", 2023-09-30T17:03:56.921 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5949999999999999e-06 2023-09-30T17:03:56.922 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.922 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.922 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:56.922 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.880637+0000", 2023-09-30T17:03:56.922 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.020397192000000001 2023-09-30T17:03:56.922 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.922 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.922 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:56.922 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.880653+0000", 2023-09-30T17:03:56.922 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6004000000000001e-05 2023-09-30T17:03:56.923 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:56.923 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:56.923 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:56.923 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.923 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.923 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:73857 4.13 4:cbf33e86:::100000001f8.00000026:head [write 745472~8192 in=8192b,write 761856~4096 in=4096b,write 851968~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:56.923 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.870870+0000", 2023-09-30T17:03:56.923 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.010430188, 2023-09-30T17:03:56.923 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010716128, 2023-09-30T17:03:56.923 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:56.923 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:56.924 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:56.924 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:56.924 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:56.924 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 73857 2023-09-30T17:03:56.924 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.924 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:56.924 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.924 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:56.924 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.870870+0000", 2023-09-30T17:03:56.924 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:56.924 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.925 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.925 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:56.925 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.870870+0000", 2023-09-30T17:03:56.925 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:56.925 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.925 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.925 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:56.925 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.870871+0000", 2023-09-30T17:03:56.925 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.13e-07 2023-09-30T17:03:56.925 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.925 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.926 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:56.926 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.870886+0000", 2023-09-30T17:03:56.926 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4705000000000001e-05 2023-09-30T17:03:56.926 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.926 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.926 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:56.926 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.870895+0000", 2023-09-30T17:03:56.926 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.0380000000000005e-06 2023-09-30T17:03:56.926 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.926 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.926 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:56.927 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.870899+0000", 2023-09-30T17:03:56.927 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7620000000000003e-06 2023-09-30T17:03:56.927 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.927 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.927 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:56.927 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.873687+0000", 2023-09-30T17:03:56.927 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0027879039999999999 2023-09-30T17:03:56.927 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.927 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.927 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:56.927 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.873768+0000", 2023-09-30T17:03:56.928 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0574999999999993e-05 2023-09-30T17:03:56.928 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:56.928 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:56.928 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:56.928 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.928 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.928 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:73859 4.2a 4:57147dc3:::100000001f8.00000011:head [write 2117632~4096 in=4096b,write 2150400~4096 in=4096b,write 2207744~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:56.928 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.871510+0000", 2023-09-30T17:03:56.928 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0097907240000000006, 2023-09-30T17:03:56.928 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010117335, 2023-09-30T17:03:56.929 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:56.929 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:56.929 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:56.929 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:56.929 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:56.929 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 73859 2023-09-30T17:03:56.929 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.929 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:56.929 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.929 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:56.930 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.871510+0000", 2023-09-30T17:03:56.930 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:56.930 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.930 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.930 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:56.930 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.871510+0000", 2023-09-30T17:03:56.930 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:56.930 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.930 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.930 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:56.930 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.871511+0000", 2023-09-30T17:03:56.931 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6400000000000001e-07 2023-09-30T17:03:56.931 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.931 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.931 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:56.931 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.871526+0000", 2023-09-30T17:03:56.931 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5383000000000002e-05 2023-09-30T17:03:56.931 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.931 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.931 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:56.931 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.871536+0000", 2023-09-30T17:03:56.932 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.013e-05 2023-09-30T17:03:56.932 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.932 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.932 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:56.932 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.871543+0000", 2023-09-30T17:03:56.932 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8079999999999999e-06 2023-09-30T17:03:56.932 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.932 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.932 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:56.932 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.873954+0000", 2023-09-30T17:03:56.932 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0024114549999999998 2023-09-30T17:03:56.933 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.933 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.933 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:56.933 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.874042+0000", 2023-09-30T17:03:56.933 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8160999999999998e-05 2023-09-30T17:03:56.933 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:56.933 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:56.933 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:56.933 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.933 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.934 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:73783 4.2f e47/17 4:f59f865b:::100000001f8.00000007:head v 47'1094, mlcod=47'1090)", 2023-09-30T17:03:56.934 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.850846+0000", 2023-09-30T17:03:56.934 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.030454375999999998, 2023-09-30T17:03:56.934 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.030820981000000001, 2023-09-30T17:03:56.934 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:56.934 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:56.934 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:56.934 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.934 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:56.935 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.850846+0000", 2023-09-30T17:03:56.935 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:56.935 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.935 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.935 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:56.935 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.850846+0000", 2023-09-30T17:03:56.935 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:56.935 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.935 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.935 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:56.935 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.850847+0000", 2023-09-30T17:03:56.936 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7300000000000004e-07 2023-09-30T17:03:56.936 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.936 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.936 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:56.936 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.850863+0000", 2023-09-30T17:03:56.936 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5931999999999999e-05 2023-09-30T17:03:56.936 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.936 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.936 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:56.936 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.850874+0000", 2023-09-30T17:03:56.936 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0963e-05 2023-09-30T17:03:56.937 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.937 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.937 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:56.937 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.850883+0000", 2023-09-30T17:03:56.937 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2650000000000002e-06 2023-09-30T17:03:56.937 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.937 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.937 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:56.937 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.867486+0000", 2023-09-30T17:03:56.937 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.016602891000000002 2023-09-30T17:03:56.937 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.938 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.938 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:56.938 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.867510+0000", 2023-09-30T17:03:56.938 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.3693000000000002e-05 2023-09-30T17:03:56.938 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:56.938 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:56.938 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:56.938 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.938 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.938 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:73827 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 626688~4096 in=4096b,write 655360~4096 in=4096b,write 1097728~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:56.938 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.861422+0000", 2023-09-30T17:03:56.939 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.019878018000000001, 2023-09-30T17:03:56.939 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.020282184000000002, 2023-09-30T17:03:56.939 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:56.939 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:56.939 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:56.939 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:56.939 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:56.939 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 73827 2023-09-30T17:03:56.939 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.939 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:56.939 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.940 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:56.940 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.861422+0000", 2023-09-30T17:03:56.940 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:56.940 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.940 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.940 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:56.940 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.861422+0000", 2023-09-30T17:03:56.940 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:56.940 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.940 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.940 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:56.941 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.861423+0000", 2023-09-30T17:03:56.941 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7000000000000004e-07 2023-09-30T17:03:56.941 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.941 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.941 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:56.941 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.861437+0000", 2023-09-30T17:03:56.941 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4025e-05 2023-09-30T17:03:56.941 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.941 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.941 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:56.942 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.861453+0000", 2023-09-30T17:03:56.942 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6300999999999999e-05 2023-09-30T17:03:56.942 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.942 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.942 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:56.942 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.861460+0000", 2023-09-30T17:03:56.942 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7009999999999999e-06 2023-09-30T17:03:56.942 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.942 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.942 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:56.942 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.874863+0000", 2023-09-30T17:03:56.943 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.013402469 2023-09-30T17:03:56.943 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.943 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.943 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:56.943 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.874934+0000", 2023-09-30T17:03:56.943 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1412e-05 2023-09-30T17:03:56.943 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.943 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.943 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:56.943 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.875079+0000", 2023-09-30T17:03:56.943 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014454499999999999 2023-09-30T17:03:56.944 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:56.944 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:56.944 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:56.944 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.944 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.944 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:73862 4.3d 4:bfffac44:::100000001f8.0000000c:head [write 1617920~4096 in=4096b,write 1658880~4096 in=4096b,write 1761280~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:56.944 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.872576+0000", 2023-09-30T17:03:56.944 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0087246300000000006, 2023-09-30T17:03:56.944 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0092037820000000006, 2023-09-30T17:03:56.944 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:56.944 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:56.944 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:56.945 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:56.945 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:56.945 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 73862 2023-09-30T17:03:56.945 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.945 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:56.945 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.945 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:56.945 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.872576+0000", 2023-09-30T17:03:56.945 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:56.945 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.945 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.945 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:56.946 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.872576+0000", 2023-09-30T17:03:56.946 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:56.946 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.946 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.946 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:56.946 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.872577+0000", 2023-09-30T17:03:56.946 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9800000000000003e-07 2023-09-30T17:03:56.946 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.946 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.946 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:56.946 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.872587+0000", 2023-09-30T17:03:56.947 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0413e-05 2023-09-30T17:03:56.947 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.947 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.947 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:56.947 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.872608+0000", 2023-09-30T17:03:56.947 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.0704e-05 2023-09-30T17:03:56.947 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.947 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.947 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:56.947 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.872616+0000", 2023-09-30T17:03:56.948 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.7439999999999996e-06 2023-09-30T17:03:56.948 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.948 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.948 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:56.948 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.874509+0000", 2023-09-30T17:03:56.948 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0018928910000000001 2023-09-30T17:03:56.948 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.948 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.948 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:56.948 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.874600+0000", 2023-09-30T17:03:56.948 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1088999999999995e-05 2023-09-30T17:03:56.949 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:56.949 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:56.949 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:56.949 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.949 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.949 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:73758 4.27 4.df99e167 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:56.949 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.836771+0000", 2023-09-30T17:03:56.949 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.044529076000000001, 2023-09-30T17:03:56.949 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.045058599999999997, 2023-09-30T17:03:56.949 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:56.949 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:56.950 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:56.950 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:56.950 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:56.950 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 73758 2023-09-30T17:03:56.950 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.950 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:56.950 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.950 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:56.950 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.836771+0000", 2023-09-30T17:03:56.950 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:56.951 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.951 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.951 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:56.951 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.836771+0000", 2023-09-30T17:03:56.951 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:56.951 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.951 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.951 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:56.951 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.836772+0000", 2023-09-30T17:03:56.951 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5199999999999996e-07 2023-09-30T17:03:56.951 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.951 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.952 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:56.952 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.836808+0000", 2023-09-30T17:03:56.952 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5519999999999999e-05 2023-09-30T17:03:56.952 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.952 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.952 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:56.952 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.836816+0000", 2023-09-30T17:03:56.952 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.32e-06 2023-09-30T17:03:56.952 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.952 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.952 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:56.953 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.836821+0000", 2023-09-30T17:03:56.953 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2950000000000001e-06 2023-09-30T17:03:56.953 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:56.953 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:56.953 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:56.953 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.953 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.953 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:73798 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 196608~4096 in=4096b,write 212992~4096 in=4096b,write 249856~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:56.953 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.851070+0000", 2023-09-30T17:03:56.953 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.030230508999999999, 2023-09-30T17:03:56.953 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.030798835, 2023-09-30T17:03:56.954 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:56.954 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:56.954 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:56.954 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:56.954 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:56.954 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 73798 2023-09-30T17:03:56.954 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.954 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:56.954 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.954 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:56.954 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.851070+0000", 2023-09-30T17:03:56.955 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:56.955 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.955 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.955 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:56.955 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.851070+0000", 2023-09-30T17:03:56.955 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:56.955 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.955 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.955 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:56.955 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.851071+0000", 2023-09-30T17:03:56.955 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1900000000000001e-07 2023-09-30T17:03:56.956 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.956 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.956 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:56.956 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.851083+0000", 2023-09-30T17:03:56.956 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2503999999999999e-05 2023-09-30T17:03:56.956 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.956 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.956 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:56.956 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.851095+0000", 2023-09-30T17:03:56.956 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1382999999999999e-05 2023-09-30T17:03:56.956 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.957 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.957 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:56.957 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.851103+0000", 2023-09-30T17:03:56.957 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5580000000000001e-06 2023-09-30T17:03:56.957 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.957 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.957 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:56.957 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.864345+0000", 2023-09-30T17:03:56.957 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.013242165 2023-09-30T17:03:56.957 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.958 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.958 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:56.958 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.864418+0000", 2023-09-30T17:03:56.958 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2433000000000003e-05 2023-09-30T17:03:56.958 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.958 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.958 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:56.958 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.864532+0000", 2023-09-30T17:03:56.958 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00011380299999999999 2023-09-30T17:03:56.958 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.958 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.959 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:56.959 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.871958+0000", 2023-09-30T17:03:56.959 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0074266799999999997 2023-09-30T17:03:56.959 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:56.959 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:56.959 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:56.959 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.959 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.959 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:73861 4.37 e47/17)", 2023-09-30T17:03:56.959 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.872641+0000", 2023-09-30T17:03:56.960 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.008659702, 2023-09-30T17:03:56.960 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0092779170000000001, 2023-09-30T17:03:56.960 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:56.960 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:56.960 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:56.960 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.960 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:56.960 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.872641+0000", 2023-09-30T17:03:56.960 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:56.960 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.960 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.960 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:56.961 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.872641+0000", 2023-09-30T17:03:56.961 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:56.961 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.961 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.961 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:56.961 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.872641+0000", 2023-09-30T17:03:56.961 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1199999999999998e-07 2023-09-30T17:03:56.961 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.961 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.961 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:56.961 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.872653+0000", 2023-09-30T17:03:56.961 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1396999999999999e-05 2023-09-30T17:03:56.962 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.962 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.962 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:56.962 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.872661+0000", 2023-09-30T17:03:56.962 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.7590000000000003e-06 2023-09-30T17:03:56.962 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.962 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.962 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:56.962 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.872667+0000", 2023-09-30T17:03:56.962 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3800000000000002e-06 2023-09-30T17:03:56.962 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:56.963 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:56.963 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:56.963 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.963 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.963 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:73799 4.3f 4.a34187bf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:56.963 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.851335+0000", 2023-09-30T17:03:56.963 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.029964977, 2023-09-30T17:03:56.963 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.030611452000000001, 2023-09-30T17:03:56.963 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:56.963 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:56.963 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:56.964 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:56.964 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:56.964 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 73799 2023-09-30T17:03:56.964 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.964 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:56.964 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.964 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:56.964 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.851335+0000", 2023-09-30T17:03:56.964 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:56.964 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.964 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.965 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:56.965 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.851335+0000", 2023-09-30T17:03:56.965 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:56.965 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.965 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.965 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:56.965 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.851336+0000", 2023-09-30T17:03:56.965 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8299999999999995e-07 2023-09-30T17:03:56.965 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.965 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.965 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:56.966 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.851349+0000", 2023-09-30T17:03:56.966 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.26e-05 2023-09-30T17:03:56.966 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.966 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.966 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:56.966 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.851361+0000", 2023-09-30T17:03:56.966 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2228999999999999e-05 2023-09-30T17:03:56.966 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.966 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.966 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:56.966 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.851369+0000", 2023-09-30T17:03:56.967 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2700000000000004e-06 2023-09-30T17:03:56.967 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:56.967 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:56.967 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:56.967 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.967 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.967 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:73830 4.22 4:47e99c31:::100000001f8.00000025:head [write 483328~4096 in=4096b,write 610304~4096 in=4096b,write 679936~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:56.967 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.862111+0000", 2023-09-30T17:03:56.967 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.019189632000000002, 2023-09-30T17:03:56.967 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.019882585000000001, 2023-09-30T17:03:56.967 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:56.968 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:56.968 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:56.968 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:56.968 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:56.968 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 73830 2023-09-30T17:03:56.968 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.968 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:56.968 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.968 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:56.968 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.862111+0000", 2023-09-30T17:03:56.968 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:56.969 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.969 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.969 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:56.969 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.862111+0000", 2023-09-30T17:03:56.969 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:56.969 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.969 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.969 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:56.969 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.862112+0000", 2023-09-30T17:03:56.969 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0240000000000001e-06 2023-09-30T17:03:56.970 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.970 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.970 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:56.970 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.862124+0000", 2023-09-30T17:03:56.970 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2347999999999999e-05 2023-09-30T17:03:56.970 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.970 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.970 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:56.970 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.862139+0000", 2023-09-30T17:03:56.970 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.52e-05 2023-09-30T17:03:56.970 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.971 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.971 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:56.971 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.862150+0000", 2023-09-30T17:03:56.971 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0791000000000001e-05 2023-09-30T17:03:56.971 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.971 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.971 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:56.971 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.862213+0000", 2023-09-30T17:03:56.971 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2972999999999995e-05 2023-09-30T17:03:56.971 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.972 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.972 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:56.972 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.862268+0000", 2023-09-30T17:03:56.972 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5272999999999997e-05 2023-09-30T17:03:56.972 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:56.972 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:56.972 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:56.972 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.972 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.972 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:73865 4.32 4:4f726a0c:::100000001f8.00000012:head [write 327680~4096 in=4096b,write 376832~4096 in=4096b,write 454656~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:56.972 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.873613+0000", 2023-09-30T17:03:56.973 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0076871049999999996, 2023-09-30T17:03:56.973 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0084616029999999998, 2023-09-30T17:03:56.973 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:56.973 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:56.973 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:56.973 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:56.973 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:56.973 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 73865 2023-09-30T17:03:56.973 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.973 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:56.973 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.973 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:56.974 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.873613+0000", 2023-09-30T17:03:56.974 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:56.974 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.974 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.974 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:56.974 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.873613+0000", 2023-09-30T17:03:56.974 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:56.974 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.974 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.974 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:56.974 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.873614+0000", 2023-09-30T17:03:56.975 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.61e-07 2023-09-30T17:03:56.975 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.975 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.975 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:56.975 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.873625+0000", 2023-09-30T17:03:56.975 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0936e-05 2023-09-30T17:03:56.975 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.975 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.975 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:56.975 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.873635+0000", 2023-09-30T17:03:56.976 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0010000000000001e-05 2023-09-30T17:03:56.976 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.976 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.976 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:56.976 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.873642+0000", 2023-09-30T17:03:56.976 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.272e-06 2023-09-30T17:03:56.976 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.976 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.976 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:56.976 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.877300+0000", 2023-09-30T17:03:56.976 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0036577049999999998 2023-09-30T17:03:56.976 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.977 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.977 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:56.977 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.877376+0000", 2023-09-30T17:03:56.977 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5667000000000006e-05 2023-09-30T17:03:56.977 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:56.977 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:56.977 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:56.977 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.977 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.977 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:73800 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 1155072~4096 in=4096b,write 1261568~4096 in=4096b,write 1277952~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:56.977 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.851644+0000", 2023-09-30T17:03:56.977 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.029656076999999999, 2023-09-30T17:03:56.978 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.030520287, 2023-09-30T17:03:56.978 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:56.978 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:56.978 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:56.978 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:56.978 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:56.978 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 73800 2023-09-30T17:03:56.978 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.978 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:56.978 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.978 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:56.979 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.851644+0000", 2023-09-30T17:03:56.979 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:56.979 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.979 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.979 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:56.979 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.851644+0000", 2023-09-30T17:03:56.979 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:56.979 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.979 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.979 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:56.979 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.851645+0000", 2023-09-30T17:03:56.980 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6000000000000003e-07 2023-09-30T17:03:56.980 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.980 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.980 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:56.980 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.851657+0000", 2023-09-30T17:03:56.980 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1426999999999999e-05 2023-09-30T17:03:56.980 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.980 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.980 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:56.980 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.851665+0000", 2023-09-30T17:03:56.980 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8599999999999999e-06 2023-09-30T17:03:56.980 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.981 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.981 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:56.981 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.851672+0000", 2023-09-30T17:03:56.981 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0380000000000002e-06 2023-09-30T17:03:56.981 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.981 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.981 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:56.981 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.869271+0000", 2023-09-30T17:03:56.981 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.017598721000000001 2023-09-30T17:03:56.981 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.981 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.982 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:56.982 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.869330+0000", 2023-09-30T17:03:56.982 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8687999999999998e-05 2023-09-30T17:03:56.982 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.982 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.982 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:56.982 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.869427+0000", 2023-09-30T17:03:56.982 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.6669000000000006e-05 2023-09-30T17:03:56.982 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:56.982 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:56.982 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:56.983 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.983 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.983 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:73829 4.2d e47/17 4:b7099a35:::100000001f8.0000000e:head v 47'2261, mlcod=47'2259)", 2023-09-30T17:03:56.983 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.862264+0000", 2023-09-30T17:03:56.983 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.019036524999999999, 2023-09-30T17:03:56.983 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.019986094999999999, 2023-09-30T17:03:56.983 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:56.983 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:56.983 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:56.983 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.983 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:56.983 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.862264+0000", 2023-09-30T17:03:56.984 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:56.984 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.984 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.984 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:56.984 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.862264+0000", 2023-09-30T17:03:56.984 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:56.984 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.984 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.984 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:56.984 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.862265+0000", 2023-09-30T17:03:56.984 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8100000000000003e-07 2023-09-30T17:03:56.985 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.985 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.985 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:56.985 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.862283+0000", 2023-09-30T17:03:56.985 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8672999999999999e-05 2023-09-30T17:03:56.985 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.985 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.985 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:56.985 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.862295+0000", 2023-09-30T17:03:56.986 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1858000000000001e-05 2023-09-30T17:03:56.986 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.986 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.986 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:56.986 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.862304+0000", 2023-09-30T17:03:56.986 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9169999999999995e-06 2023-09-30T17:03:56.986 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.986 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.986 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:56.986 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.862348+0000", 2023-09-30T17:03:56.986 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4088000000000002e-05 2023-09-30T17:03:56.986 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.987 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.987 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:56.987 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.862367+0000", 2023-09-30T17:03:56.987 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8578999999999999e-05 2023-09-30T17:03:56.987 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:56.987 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:56.987 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:56.987 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.987 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.987 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:73868 4.13 4:caef1406:::100000001f8.00000031:head [write 2650112~4096 in=4096b,write 2756608~4096 in=4096b,write 2891776~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:56.987 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.875248+0000", 2023-09-30T17:03:56.988 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0060523479999999999, 2023-09-30T17:03:56.988 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0070789920000000001, 2023-09-30T17:03:56.988 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:56.988 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:56.988 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:56.988 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:56.988 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:56.988 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 73868 2023-09-30T17:03:56.988 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.988 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:56.988 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.988 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:56.989 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.875248+0000", 2023-09-30T17:03:56.989 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:56.989 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.989 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.989 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:56.989 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.875248+0000", 2023-09-30T17:03:56.989 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:56.989 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.989 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.989 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:56.989 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.875249+0000", 2023-09-30T17:03:56.990 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8700000000000004e-07 2023-09-30T17:03:56.990 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.990 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.990 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:56.990 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.875264+0000", 2023-09-30T17:03:56.990 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4582e-05 2023-09-30T17:03:56.990 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.990 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.990 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:56.990 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.875347+0000", 2023-09-30T17:03:56.990 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3744000000000003e-05 2023-09-30T17:03:56.990 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.991 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.991 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:56.991 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.875357+0000", 2023-09-30T17:03:56.991 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7559999999999994e-06 2023-09-30T17:03:56.991 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.991 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.991 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:56.991 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.876667+0000", 2023-09-30T17:03:56.991 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001309585 2023-09-30T17:03:56.991 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.991 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.992 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:56.992 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.876744+0000", 2023-09-30T17:03:56.992 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7383000000000001e-05 2023-09-30T17:03:56.992 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:56.992 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:56.992 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:56.992 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.992 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.992 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:73831 4.6 4:63e80496:::100000001f8.0000001e:head [write 581632~4096 in=4096b,write 835584~4096 in=4096b,write 860160~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:56.992 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.862359+0000", 2023-09-30T17:03:56.992 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.018941398000000002, 2023-09-30T17:03:56.992 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.020059496, 2023-09-30T17:03:56.993 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:56.993 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:56.993 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:56.993 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:56.993 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:56.993 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 73831 2023-09-30T17:03:56.993 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.993 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:56.993 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.993 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:56.993 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.862359+0000", 2023-09-30T17:03:56.994 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:56.994 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.994 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.994 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:56.994 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.862359+0000", 2023-09-30T17:03:56.994 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:56.994 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.994 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.994 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:56.994 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.862360+0000", 2023-09-30T17:03:56.994 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1200000000000002e-07 2023-09-30T17:03:56.994 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.995 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.995 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:56.995 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.862375+0000", 2023-09-30T17:03:56.995 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4939e-05 2023-09-30T17:03:56.995 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.995 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.995 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:56.995 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.862387+0000", 2023-09-30T17:03:56.995 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2249000000000001e-05 2023-09-30T17:03:56.995 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.995 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.995 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:56.996 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.862395+0000", 2023-09-30T17:03:56.996 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5610000000000001e-06 2023-09-30T17:03:56.996 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.996 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.996 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:56.996 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.882227+0000", 2023-09-30T17:03:56.996 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.019831905 2023-09-30T17:03:56.996 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.996 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.996 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:56.996 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.882307+0000", 2023-09-30T17:03:56.997 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0538999999999996e-05 2023-09-30T17:03:56.997 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:56.997 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:56.997 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:56.997 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.997 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.997 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:73869 4.1c 4:39b842ef:::100000001f8.00000029:head [write 1249280~8192 in=8192b,write 1269760~4096 in=4096b,write 1286144~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:56.997 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.875375+0000", 2023-09-30T17:03:56.997 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0059251410000000001, 2023-09-30T17:03:56.997 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0071329050000000001, 2023-09-30T17:03:56.997 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:56.998 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:56.998 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:56.998 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:56.998 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:56.998 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 73869 2023-09-30T17:03:56.998 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.998 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:56.998 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.998 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:56.998 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.875375+0000", 2023-09-30T17:03:56.998 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:56.999 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.999 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.999 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:56.999 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.875375+0000", 2023-09-30T17:03:56.999 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:56.999 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:56.999 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:56.999 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:56.999 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.875376+0000", 2023-09-30T17:03:56.999 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8700000000000005e-07 2023-09-30T17:03:56.999 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.000 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.000 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.000 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.875392+0000", 2023-09-30T17:03:57.000 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5624000000000002e-05 2023-09-30T17:03:57.000 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.000 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.000 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.000 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.875402+0000", 2023-09-30T17:03:57.000 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0030000000000001e-05 2023-09-30T17:03:57.000 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.000 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.001 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.001 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.875407+0000", 2023-09-30T17:03:57.001 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6879999999999996e-06 2023-09-30T17:03:57.001 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.001 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.001 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:57.001 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.875825+0000", 2023-09-30T17:03:57.001 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00041743599999999998 2023-09-30T17:03:57.001 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.001 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.001 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:57.002 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.875919+0000", 2023-09-30T17:03:57.002 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3864999999999997e-05 2023-09-30T17:03:57.002 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.002 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.002 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:57.002 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.876102+0000", 2023-09-30T17:03:57.002 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000183647 2023-09-30T17:03:57.002 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.002 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.002 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.003 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.003 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.003 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:73789 4.f e47/17 4:f0d983b2:::100000001f8.0000001f:head v 47'3505, mlcod=47'3493)", 2023-09-30T17:03:57.003 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.853246+0000", 2023-09-30T17:03:57.003 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.028054776, 2023-09-30T17:03:57.003 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.029363468, 2023-09-30T17:03:57.003 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.003 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:57.003 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.003 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.004 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.004 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.853246+0000", 2023-09-30T17:03:57.004 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.004 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.004 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.004 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.004 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.853246+0000", 2023-09-30T17:03:57.004 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.004 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.004 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.004 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.005 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.853246+0000", 2023-09-30T17:03:57.005 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8999999999999997e-07 2023-09-30T17:03:57.005 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.005 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.005 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.005 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.853261+0000", 2023-09-30T17:03:57.005 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4632e-05 2023-09-30T17:03:57.005 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.005 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.005 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.005 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.853272+0000", 2023-09-30T17:03:57.006 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.075e-05 2023-09-30T17:03:57.006 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.006 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.006 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.006 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.853279+0000", 2023-09-30T17:03:57.006 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6809999999999998e-06 2023-09-30T17:03:57.006 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.006 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.006 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:57.006 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.868623+0000", 2023-09-30T17:03:57.006 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.015343605999999999 2023-09-30T17:03:57.007 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.007 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.007 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:57.007 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.868634+0000", 2023-09-30T17:03:57.007 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1154e-05 2023-09-30T17:03:57.007 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.007 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.007 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.007 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.007 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.007 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:73833 4.32 4:4f726a0c:::100000001f8.00000012:head [write 978944~4096 in=4096b,write 1007616~4096 in=4096b,write 1073152~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:57.008 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.863124+0000", 2023-09-30T17:03:57.008 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.018176413999999998, 2023-09-30T17:03:57.008 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.019574087, 2023-09-30T17:03:57.008 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.008 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:57.008 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.008 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.008 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.008 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 73833 2023-09-30T17:03:57.008 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.008 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.008 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.009 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.009 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.863124+0000", 2023-09-30T17:03:57.009 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.009 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.009 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.009 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.009 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.863124+0000", 2023-09-30T17:03:57.009 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.009 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.009 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.009 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.010 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.863125+0000", 2023-09-30T17:03:57.010 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9599999999999998e-07 2023-09-30T17:03:57.010 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.010 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.010 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.010 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.863138+0000", 2023-09-30T17:03:57.010 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3352e-05 2023-09-30T17:03:57.010 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.010 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.010 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.010 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.863150+0000", 2023-09-30T17:03:57.011 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1899000000000001e-05 2023-09-30T17:03:57.011 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.011 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.011 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.011 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.863166+0000", 2023-09-30T17:03:57.011 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5472999999999999e-05 2023-09-30T17:03:57.011 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.011 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.011 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:57.011 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.863207+0000", 2023-09-30T17:03:57.011 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1335999999999999e-05 2023-09-30T17:03:57.012 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.012 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.012 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:57.012 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.863259+0000", 2023-09-30T17:03:57.012 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1647000000000002e-05 2023-09-30T17:03:57.012 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.012 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.012 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.012 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.012 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.012 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:73870 4.3f 4.a34187bf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:57.013 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.875581+0000", 2023-09-30T17:03:57.013 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0057197230000000003, 2023-09-30T17:03:57.013 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0072035199999999997, 2023-09-30T17:03:57.013 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.013 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:57.013 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.013 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.013 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.013 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 73870 2023-09-30T17:03:57.013 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.013 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.014 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.014 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.014 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.875581+0000", 2023-09-30T17:03:57.014 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.014 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.014 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.014 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.014 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.875581+0000", 2023-09-30T17:03:57.014 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.014 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.015 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.015 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.015 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.875581+0000", 2023-09-30T17:03:57.015 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.6899999999999997e-07 2023-09-30T17:03:57.015 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.015 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.015 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.015 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.875594+0000", 2023-09-30T17:03:57.015 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.22e-05 2023-09-30T17:03:57.015 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.015 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.016 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.016 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.875605+0000", 2023-09-30T17:03:57.016 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1420000000000001e-05 2023-09-30T17:03:57.016 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.016 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.016 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.016 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.875612+0000", 2023-09-30T17:03:57.016 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8210000000000004e-06 2023-09-30T17:03:57.016 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.016 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.016 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.017 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.017 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.017 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:73834 4.6 4.8232b686 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:57.017 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.863549+0000", 2023-09-30T17:03:57.017 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.017751935999999999, 2023-09-30T17:03:57.017 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.019293278000000001, 2023-09-30T17:03:57.017 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.017 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:57.017 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.017 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.018 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.018 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 73834 2023-09-30T17:03:57.018 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.018 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.018 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.018 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.018 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.863549+0000", 2023-09-30T17:03:57.018 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.018 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.018 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.018 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.019 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.863549+0000", 2023-09-30T17:03:57.019 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.019 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.019 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.019 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.019 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.863549+0000", 2023-09-30T17:03:57.019 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7300000000000005e-07 2023-09-30T17:03:57.019 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.019 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.019 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.019 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.863561+0000", 2023-09-30T17:03:57.020 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1392999999999999e-05 2023-09-30T17:03:57.020 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.020 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.020 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.020 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.863571+0000", 2023-09-30T17:03:57.020 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0331e-05 2023-09-30T17:03:57.020 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.020 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.020 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.020 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.863579+0000", 2023-09-30T17:03:57.020 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8869999999999992e-06 2023-09-30T17:03:57.021 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.021 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.021 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.021 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.021 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.021 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:73866 4.12 e47/17 4:48ab9bde:::100000001f8.00000015:head v 47'2295, mlcod=47'2289)", 2023-09-30T17:03:57.021 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.875811+0000", 2023-09-30T17:03:57.021 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.005489252, 2023-09-30T17:03:57.021 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0070921439999999999, 2023-09-30T17:03:57.021 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.021 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:57.022 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.022 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.022 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.022 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.875811+0000", 2023-09-30T17:03:57.022 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.022 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.022 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.022 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.022 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.875811+0000", 2023-09-30T17:03:57.022 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.022 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.023 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.023 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.023 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.875812+0000", 2023-09-30T17:03:57.023 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8999999999999996e-07 2023-09-30T17:03:57.023 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.023 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.023 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.023 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.875827+0000", 2023-09-30T17:03:57.023 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5150999999999999e-05 2023-09-30T17:03:57.023 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.023 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.024 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.024 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.875836+0000", 2023-09-30T17:03:57.024 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5990000000000002e-06 2023-09-30T17:03:57.024 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.024 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.024 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.024 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.875843+0000", 2023-09-30T17:03:57.024 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6920000000000002e-06 2023-09-30T17:03:57.024 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.024 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.024 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:57.025 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.877058+0000", 2023-09-30T17:03:57.025 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001214943 2023-09-30T17:03:57.025 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.025 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.025 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:57.025 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.877079+0000", 2023-09-30T17:03:57.025 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.0769999999999999e-05 2023-09-30T17:03:57.025 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.025 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.025 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.025 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.025 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.026 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:73864 4.37 e47/17)", 2023-09-30T17:03:57.026 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.875857+0000", 2023-09-30T17:03:57.026 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0054435890000000004, 2023-09-30T17:03:57.026 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0071066480000000001, 2023-09-30T17:03:57.026 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.026 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:57.026 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.026 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.026 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.026 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.875857+0000", 2023-09-30T17:03:57.027 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.027 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.027 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.027 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.027 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.875857+0000", 2023-09-30T17:03:57.027 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.027 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.027 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.027 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.027 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.875857+0000", 2023-09-30T17:03:57.027 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.41e-07 2023-09-30T17:03:57.027 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.028 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.028 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.028 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.875869+0000", 2023-09-30T17:03:57.028 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1768e-05 2023-09-30T17:03:57.028 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.028 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.028 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.028 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.875876+0000", 2023-09-30T17:03:57.028 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8639999999999998e-06 2023-09-30T17:03:57.028 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.028 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.029 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.029 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.875882+0000", 2023-09-30T17:03:57.029 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6890000000000001e-06 2023-09-30T17:03:57.029 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.029 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.029 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.029 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.029 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.029 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:73837 4.2f e47/17 4:f59f865b:::100000001f8.00000007:head v 47'1095, mlcod=47'1091)", 2023-09-30T17:03:57.029 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.864786+0000", 2023-09-30T17:03:57.029 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.016514270000000001, 2023-09-30T17:03:57.030 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.018225295999999998, 2023-09-30T17:03:57.030 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.030 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:57.030 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.030 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.030 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.030 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.864786+0000", 2023-09-30T17:03:57.030 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.030 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.030 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.031 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.031 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.864786+0000", 2023-09-30T17:03:57.031 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.031 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.031 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.031 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.031 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.864787+0000", 2023-09-30T17:03:57.031 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4000000000000001e-07 2023-09-30T17:03:57.031 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.031 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.031 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.031 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.864803+0000", 2023-09-30T17:03:57.032 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5922000000000001e-05 2023-09-30T17:03:57.032 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.032 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.032 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.032 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.864814+0000", 2023-09-30T17:03:57.032 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0701e-05 2023-09-30T17:03:57.032 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.032 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.032 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.032 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.864821+0000", 2023-09-30T17:03:57.033 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4730000000000003e-06 2023-09-30T17:03:57.033 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.033 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.033 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:57.033 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.882701+0000", 2023-09-30T17:03:57.033 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.017880388000000001 2023-09-30T17:03:57.033 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.033 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.033 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:57.033 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.882720+0000", 2023-09-30T17:03:57.033 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8110000000000001e-05 2023-09-30T17:03:57.034 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.034 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.034 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.034 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.034 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.034 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:73872 4.28 4:15eeb89b:::100000001f8.00000032:head [write 794624~4096 in=4096b,write 811008~4096 in=4096b,write 1036288~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:57.034 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.876200+0000", 2023-09-30T17:03:57.034 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0051001110000000001, 2023-09-30T17:03:57.034 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0068747870000000003, 2023-09-30T17:03:57.034 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.034 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:57.035 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.035 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.035 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.035 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 73872 2023-09-30T17:03:57.035 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.035 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.035 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.035 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.035 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.876200+0000", 2023-09-30T17:03:57.035 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.036 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.036 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.036 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.036 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.876200+0000", 2023-09-30T17:03:57.036 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.036 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.036 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.036 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.036 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.876201+0000", 2023-09-30T17:03:57.036 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7400000000000002e-07 2023-09-30T17:03:57.036 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.036 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.037 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.037 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.876212+0000", 2023-09-30T17:03:57.037 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0973e-05 2023-09-30T17:03:57.037 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.037 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.037 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.037 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.876222+0000", 2023-09-30T17:03:57.037 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.4630000000000007e-06 2023-09-30T17:03:57.037 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.037 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.037 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.038 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.876228+0000", 2023-09-30T17:03:57.038 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8759999999999999e-06 2023-09-30T17:03:57.038 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.038 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.038 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:57.038 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.876283+0000", 2023-09-30T17:03:57.038 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4758e-05 2023-09-30T17:03:57.038 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.038 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.038 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:57.039 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.876416+0000", 2023-09-30T17:03:57.039 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000133251 2023-09-30T17:03:57.039 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.039 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.039 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:57.039 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.876598+0000", 2023-09-30T17:03:57.039 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00018131700000000001 2023-09-30T17:03:57.039 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.039 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.039 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.039 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.040 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.040 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:73873 4.28 4:15eeb89b:::100000001f8.00000032:head [write 524288~4096 in=4096b,write 593920~4096 in=4096b,write 602112~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:57.040 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.876452+0000", 2023-09-30T17:03:57.040 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0048483780000000004, 2023-09-30T17:03:57.040 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0067193959999999999, 2023-09-30T17:03:57.040 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.040 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:57.040 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.040 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.041 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.041 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 73873 2023-09-30T17:03:57.041 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.041 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.041 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.041 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.041 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.876452+0000", 2023-09-30T17:03:57.041 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.041 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.041 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.041 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.041 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.876452+0000", 2023-09-30T17:03:57.042 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.042 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.042 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.042 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.042 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.876453+0000", 2023-09-30T17:03:57.042 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.47e-07 2023-09-30T17:03:57.042 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.042 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.042 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.042 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.876480+0000", 2023-09-30T17:03:57.042 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.6480000000000001e-05 2023-09-30T17:03:57.043 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.043 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.043 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.043 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.876498+0000", 2023-09-30T17:03:57.043 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8470000000000001e-05 2023-09-30T17:03:57.043 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.043 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.043 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.043 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.876507+0000", 2023-09-30T17:03:57.043 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.0710000000000001e-06 2023-09-30T17:03:57.043 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.043 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.044 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:57.044 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.882238+0000", 2023-09-30T17:03:57.044 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0057311319999999999 2023-09-30T17:03:57.044 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.044 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.044 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:57.044 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.882319+0000", 2023-09-30T17:03:57.044 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1218999999999996e-05 2023-09-30T17:03:57.044 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.044 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.044 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:57.045 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.882488+0000", 2023-09-30T17:03:57.045 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016858500000000001 2023-09-30T17:03:57.045 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.045 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.045 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.045 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.045 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.045 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:73639 4.27 4.df99e167 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:57.045 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.796903+0000", 2023-09-30T17:03:57.045 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.084397816000000001, 2023-09-30T17:03:57.045 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.086344447000000005, 2023-09-30T17:03:57.046 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.046 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:57.046 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.046 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.046 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.046 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 73639 2023-09-30T17:03:57.046 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.046 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.046 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.046 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.046 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.796903+0000", 2023-09-30T17:03:57.047 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.047 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.047 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.047 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.047 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.796903+0000", 2023-09-30T17:03:57.047 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.047 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.047 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.047 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.047 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.796904+0000", 2023-09-30T17:03:57.047 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0440000000000001e-06 2023-09-30T17:03:57.048 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.048 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.048 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.048 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.796918+0000", 2023-09-30T17:03:57.048 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4416000000000001e-05 2023-09-30T17:03:57.048 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.048 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.048 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.048 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.796930+0000", 2023-09-30T17:03:57.048 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1602e-05 2023-09-30T17:03:57.048 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.049 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.049 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.049 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.796938+0000", 2023-09-30T17:03:57.049 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4810000000000006e-06 2023-09-30T17:03:57.049 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.049 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.049 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.049 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.049 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.049 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:73838 4.12 e47/17 4:4be51a30:::100000001f8.0000000b:head v 47'2291, mlcod=47'2289)", 2023-09-30T17:03:57.049 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.865228+0000", 2023-09-30T17:03:57.050 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.016072389999999999, 2023-09-30T17:03:57.050 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.018082351, 2023-09-30T17:03:57.050 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.050 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:57.050 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.050 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.050 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.050 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.865228+0000", 2023-09-30T17:03:57.050 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.050 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.050 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.051 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.051 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.865228+0000", 2023-09-30T17:03:57.051 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.051 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.051 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.051 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.051 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.865229+0000", 2023-09-30T17:03:57.051 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4499999999999997e-07 2023-09-30T17:03:57.051 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.051 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.052 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.052 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.865242+0000", 2023-09-30T17:03:57.052 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3375e-05 2023-09-30T17:03:57.052 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.052 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.052 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.052 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.865253+0000", 2023-09-30T17:03:57.052 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0675e-05 2023-09-30T17:03:57.052 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.052 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.052 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.052 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.865260+0000", 2023-09-30T17:03:57.053 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3370000000000002e-06 2023-09-30T17:03:57.053 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.053 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.053 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:57.053 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.865307+0000", 2023-09-30T17:03:57.053 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7206999999999997e-05 2023-09-30T17:03:57.053 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.053 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.053 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:57.053 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.865327+0000", 2023-09-30T17:03:57.053 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9355999999999999e-05 2023-09-30T17:03:57.054 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.054 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.054 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.054 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.054 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.054 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:73874 4.1c 4:39b842ef:::100000001f8.00000029:head [write 2220032~4096 in=4096b,write 2297856~4096 in=4096b,write 2342912~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:57.054 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.876716+0000", 2023-09-30T17:03:57.054 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0045848540000000002, 2023-09-30T17:03:57.054 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0066683970000000004, 2023-09-30T17:03:57.054 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.054 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:57.055 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.055 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.055 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.055 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 73874 2023-09-30T17:03:57.055 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.055 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.055 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.055 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.055 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.876716+0000", 2023-09-30T17:03:57.055 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.055 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.056 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.056 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.056 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.876716+0000", 2023-09-30T17:03:57.056 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.056 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.056 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.056 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.056 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.876717+0000", 2023-09-30T17:03:57.056 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.0400000000000005e-07 2023-09-30T17:03:57.056 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.056 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.056 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.057 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.876728+0000", 2023-09-30T17:03:57.057 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1548e-05 2023-09-30T17:03:57.057 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.057 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.057 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.057 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.876740+0000", 2023-09-30T17:03:57.057 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1681e-05 2023-09-30T17:03:57.057 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.057 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.057 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.057 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.876748+0000", 2023-09-30T17:03:57.058 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8879999999999997e-06 2023-09-30T17:03:57.058 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.058 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.058 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:57.058 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.882600+0000", 2023-09-30T17:03:57.058 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0058522879999999998 2023-09-30T17:03:57.058 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.058 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.058 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:57.058 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.882677+0000", 2023-09-30T17:03:57.058 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6888e-05 2023-09-30T17:03:57.059 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.059 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.059 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:57.059 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.882818+0000", 2023-09-30T17:03:57.059 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014072800000000001 2023-09-30T17:03:57.059 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.059 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.059 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.059 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.059 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.059 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:73840 4.25 4:a76ff001:::100000001f8.0000002b:head [write 3878912~4096 in=4096b,write 4067328~4096 in=4096b,write 4075520~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:57.059 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.865479+0000", 2023-09-30T17:03:57.060 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.015821789999999999, 2023-09-30T17:03:57.060 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.017997314, 2023-09-30T17:03:57.060 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.060 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:57.060 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.060 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.060 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.060 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 73840 2023-09-30T17:03:57.060 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.060 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.060 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.061 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.061 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.865479+0000", 2023-09-30T17:03:57.061 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.061 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.061 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.061 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.061 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.865479+0000", 2023-09-30T17:03:57.061 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.061 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.061 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.061 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.061 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.865480+0000", 2023-09-30T17:03:57.062 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3200000000000003e-07 2023-09-30T17:03:57.062 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.062 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.062 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.062 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.865493+0000", 2023-09-30T17:03:57.062 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3097e-05 2023-09-30T17:03:57.062 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.062 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.062 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.063 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.865505+0000", 2023-09-30T17:03:57.063 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2136999999999999e-05 2023-09-30T17:03:57.063 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.063 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.063 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.063 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.865513+0000", 2023-09-30T17:03:57.063 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2819999999999996e-06 2023-09-30T17:03:57.063 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.063 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.063 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:57.063 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.865575+0000", 2023-09-30T17:03:57.064 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1970000000000005e-05 2023-09-30T17:03:57.064 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.064 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.064 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:57.064 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.865680+0000", 2023-09-30T17:03:57.064 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000104802 2023-09-30T17:03:57.064 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.064 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.064 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.064 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.064 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.065 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:73875 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:57.065 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.876974+0000", 2023-09-30T17:03:57.065 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.004326936, 2023-09-30T17:03:57.065 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0065824760000000003, 2023-09-30T17:03:57.065 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.065 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:57.065 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.065 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.065 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.065 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 73875 2023-09-30T17:03:57.065 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.066 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.066 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.066 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.066 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.876974+0000", 2023-09-30T17:03:57.066 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.066 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.066 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.066 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.066 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.876974+0000", 2023-09-30T17:03:57.066 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.066 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.066 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.067 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.067 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.876974+0000", 2023-09-30T17:03:57.067 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4200000000000005e-07 2023-09-30T17:03:57.067 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.067 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.067 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.067 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.877013+0000", 2023-09-30T17:03:57.067 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8600000000000003e-05 2023-09-30T17:03:57.067 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.067 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.067 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.067 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.877025+0000", 2023-09-30T17:03:57.068 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2269999999999999e-05 2023-09-30T17:03:57.068 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.068 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.068 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.068 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.877034+0000", 2023-09-30T17:03:57.068 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.6410000000000008e-06 2023-09-30T17:03:57.068 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.068 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.068 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.068 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.068 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.069 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:73794 4.37 e47/17 4:ef395e89:::100000001f8.00000020:head v 47'3466, mlcod=47'3459)", 2023-09-30T17:03:57.069 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.854947+0000", 2023-09-30T17:03:57.069 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.026353598999999998, 2023-09-30T17:03:57.069 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.028676295000000001, 2023-09-30T17:03:57.069 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.069 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:57.069 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.069 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.069 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.069 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.854947+0000", 2023-09-30T17:03:57.069 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.070 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.070 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.070 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.070 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.854947+0000", 2023-09-30T17:03:57.070 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.070 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.070 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.070 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.070 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.854947+0000", 2023-09-30T17:03:57.070 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9699999999999996e-07 2023-09-30T17:03:57.071 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.071 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.071 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.071 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.854963+0000", 2023-09-30T17:03:57.071 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5207e-05 2023-09-30T17:03:57.071 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.071 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.071 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.071 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.854972+0000", 2023-09-30T17:03:57.071 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9590000000000001e-06 2023-09-30T17:03:57.071 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.071 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.072 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.072 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.854978+0000", 2023-09-30T17:03:57.072 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3770000000000001e-06 2023-09-30T17:03:57.072 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.072 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.072 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:57.072 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.871847+0000", 2023-09-30T17:03:57.072 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.016868799 2023-09-30T17:03:57.072 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.072 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.072 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:57.072 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.871868+0000", 2023-09-30T17:03:57.073 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1219000000000001e-05 2023-09-30T17:03:57.073 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.073 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.073 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.073 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.073 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.073 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:73841 4.d 4:b1164065:::100000001f8.00000035:head [write 204800~4096 in=4096b,write 270336~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:57.073 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.865799+0000", 2023-09-30T17:03:57.073 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.015501084, 2023-09-30T17:03:57.073 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.017894839999999999, 2023-09-30T17:03:57.073 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.074 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:57.074 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.074 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.074 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.074 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 73841 2023-09-30T17:03:57.074 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.074 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.074 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.074 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.074 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.865799+0000", 2023-09-30T17:03:57.075 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.075 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.075 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.075 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.075 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.865799+0000", 2023-09-30T17:03:57.075 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.075 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.075 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.075 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.075 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.865800+0000", 2023-09-30T17:03:57.075 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2600000000000001e-07 2023-09-30T17:03:57.076 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.076 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.076 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.076 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.865817+0000", 2023-09-30T17:03:57.076 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6742999999999999e-05 2023-09-30T17:03:57.076 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.076 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.076 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.076 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.865831+0000", 2023-09-30T17:03:57.076 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3977e-05 2023-09-30T17:03:57.076 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.077 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.077 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.077 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.865838+0000", 2023-09-30T17:03:57.077 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2439999999999996e-06 2023-09-30T17:03:57.077 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.077 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.077 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:57.077 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.866008+0000", 2023-09-30T17:03:57.077 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016958300000000001 2023-09-30T17:03:57.077 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.077 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.077 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:57.078 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.866108+0000", 2023-09-30T17:03:57.078 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000100418 2023-09-30T17:03:57.078 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.078 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.078 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.078 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.078 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.078 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:73876 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:57.078 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.877347+0000", 2023-09-30T17:03:57.078 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0039539340000000001, 2023-09-30T17:03:57.078 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0064235020000000002, 2023-09-30T17:03:57.078 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.079 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:57.079 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.079 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.079 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.079 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 73876 2023-09-30T17:03:57.079 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.079 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.079 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.079 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.079 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.877347+0000", 2023-09-30T17:03:57.079 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.079 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.080 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.080 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.080 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.877347+0000", 2023-09-30T17:03:57.080 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.080 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.080 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.080 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.080 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.877348+0000", 2023-09-30T17:03:57.080 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0020000000000001e-06 2023-09-30T17:03:57.080 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.080 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.080 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.081 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.877359+0000", 2023-09-30T17:03:57.081 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1902999999999999e-05 2023-09-30T17:03:57.081 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.081 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.081 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.081 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.877375+0000", 2023-09-30T17:03:57.081 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5307000000000001e-05 2023-09-30T17:03:57.081 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.081 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.081 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.081 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.877383+0000", 2023-09-30T17:03:57.081 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3480000000000004e-06 2023-09-30T17:03:57.082 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.082 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.082 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.082 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.082 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.082 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:73842 4.1c 4:39b842ef:::100000001f8.00000029:head [write 3493888~4096 in=4096b,write 3518464~4096 in=4096b,write 3538944~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:57.082 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.866065+0000", 2023-09-30T17:03:57.082 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.015235465, 2023-09-30T17:03:57.082 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.017775250999999999, 2023-09-30T17:03:57.082 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.083 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:57.083 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.083 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.083 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.083 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 73842 2023-09-30T17:03:57.083 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.083 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.083 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.083 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.083 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.866065+0000", 2023-09-30T17:03:57.084 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.084 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.084 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.084 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.084 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.866065+0000", 2023-09-30T17:03:57.084 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.084 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.084 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.084 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.084 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.866066+0000", 2023-09-30T17:03:57.084 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3300000000000001e-07 2023-09-30T17:03:57.084 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.085 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.085 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.085 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.866082+0000", 2023-09-30T17:03:57.085 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5770999999999999e-05 2023-09-30T17:03:57.085 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.085 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.085 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.085 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.866092+0000", 2023-09-30T17:03:57.085 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0699999999999999e-05 2023-09-30T17:03:57.085 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.086 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.086 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.086 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.866099+0000", 2023-09-30T17:03:57.086 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9789999999999996e-06 2023-09-30T17:03:57.086 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.086 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.086 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:57.086 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.866280+0000", 2023-09-30T17:03:57.086 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00018066999999999999 2023-09-30T17:03:57.086 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.087 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.087 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:57.087 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.866359+0000", 2023-09-30T17:03:57.087 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9507999999999998e-05 2023-09-30T17:03:57.087 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.087 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.087 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:57.087 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.866504+0000", 2023-09-30T17:03:57.087 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014429699999999999 2023-09-30T17:03:57.087 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.088 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.088 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:57.088 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.871633+0000", 2023-09-30T17:03:57.088 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005129476 2023-09-30T17:03:57.088 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.088 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.088 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.088 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.088 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.088 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:73670 4.3f 4.a34187bf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:57.088 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.808972+0000", 2023-09-30T17:03:57.088 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.072328419000000005, 2023-09-30T17:03:57.089 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.074959825999999993, 2023-09-30T17:03:57.089 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.089 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:57.089 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.089 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.089 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.089 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 73670 2023-09-30T17:03:57.089 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.089 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.089 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.089 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.090 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.808972+0000", 2023-09-30T17:03:57.090 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.090 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.090 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.090 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.090 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.808972+0000", 2023-09-30T17:03:57.090 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.090 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.090 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.090 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.091 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.808973+0000", 2023-09-30T17:03:57.091 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8299999999999997e-07 2023-09-30T17:03:57.091 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.091 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.091 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.091 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.808982+0000", 2023-09-30T17:03:57.091 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.533e-06 2023-09-30T17:03:57.091 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.091 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.091 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.091 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.808987+0000", 2023-09-30T17:03:57.092 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9840000000000001e-06 2023-09-30T17:03:57.092 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.092 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.092 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.092 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.808991+0000", 2023-09-30T17:03:57.092 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.681e-06 2023-09-30T17:03:57.092 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.092 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.092 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.092 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.092 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.093 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:73877 4.f e47/17)", 2023-09-30T17:03:57.093 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.878026+0000", 2023-09-30T17:03:57.093 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.003274842, 2023-09-30T17:03:57.093 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0059667349999999999, 2023-09-30T17:03:57.093 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.093 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:57.093 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.093 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.093 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.093 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.878026+0000", 2023-09-30T17:03:57.094 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.094 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.094 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.094 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.094 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.878026+0000", 2023-09-30T17:03:57.094 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.094 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.094 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.094 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.094 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.878026+0000", 2023-09-30T17:03:57.095 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5499999999999999e-07 2023-09-30T17:03:57.095 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.095 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.095 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.095 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.878042+0000", 2023-09-30T17:03:57.095 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6215999999999999e-05 2023-09-30T17:03:57.095 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.095 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.095 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.095 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.878050+0000", 2023-09-30T17:03:57.095 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8320000000000006e-06 2023-09-30T17:03:57.096 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.096 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.096 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.096 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.878057+0000", 2023-09-30T17:03:57.096 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4410000000000004e-06 2023-09-30T17:03:57.096 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.096 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.096 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.096 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.096 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.096 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:73803 4.37 e47/17 4:eff9002a:::100000001f8.00000003:head v 47'3467, mlcod=47'3459)", 2023-09-30T17:03:57.097 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.857376+0000", 2023-09-30T17:03:57.097 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.023924193, 2023-09-30T17:03:57.097 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.026683385, 2023-09-30T17:03:57.097 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.097 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:57.097 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.097 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.097 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.097 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.857376+0000", 2023-09-30T17:03:57.097 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.098 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.098 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.098 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.098 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.857376+0000", 2023-09-30T17:03:57.098 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.098 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.098 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.098 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.098 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.857377+0000", 2023-09-30T17:03:57.098 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.91e-07 2023-09-30T17:03:57.098 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.099 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.099 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.099 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.857394+0000", 2023-09-30T17:03:57.099 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7054999999999998e-05 2023-09-30T17:03:57.099 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.099 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.099 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.099 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.857406+0000", 2023-09-30T17:03:57.099 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1962e-05 2023-09-30T17:03:57.100 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.100 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.100 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.100 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.857413+0000", 2023-09-30T17:03:57.100 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3329999999999999e-06 2023-09-30T17:03:57.100 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.100 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.100 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:57.100 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.874196+0000", 2023-09-30T17:03:57.100 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.016783343999999999 2023-09-30T17:03:57.100 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.101 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.101 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:57.101 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.874214+0000", 2023-09-30T17:03:57.101 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8159e-05 2023-09-30T17:03:57.101 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.101 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.101 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.101 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.101 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.101 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:73843 4.25 4:a76ff001:::100000001f8.0000002b:head [write 16384~4096 in=4096b,write 53248~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:57.101 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.866884+0000", 2023-09-30T17:03:57.102 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.014416488, 2023-09-30T17:03:57.102 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.017249071000000001, 2023-09-30T17:03:57.102 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.102 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:57.102 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.102 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.102 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.102 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 73843 2023-09-30T17:03:57.102 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.102 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.102 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.103 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.103 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.866884+0000", 2023-09-30T17:03:57.103 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.103 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.103 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.103 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.103 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.866884+0000", 2023-09-30T17:03:57.103 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.103 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.103 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.103 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.103 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.866885+0000", 2023-09-30T17:03:57.104 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2900000000000002e-07 2023-09-30T17:03:57.104 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.104 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.104 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.104 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.866896+0000", 2023-09-30T17:03:57.104 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0937e-05 2023-09-30T17:03:57.104 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.104 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.104 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.104 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.866908+0000", 2023-09-30T17:03:57.104 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2353e-05 2023-09-30T17:03:57.104 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.105 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.105 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.105 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.866916+0000", 2023-09-30T17:03:57.105 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5769999999999996e-06 2023-09-30T17:03:57.105 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.105 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.105 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:57.105 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.867366+0000", 2023-09-30T17:03:57.105 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00045036099999999998 2023-09-30T17:03:57.105 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.105 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.106 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:57.106 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.867451+0000", 2023-09-30T17:03:57.106 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4775000000000001e-05 2023-09-30T17:03:57.106 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.106 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.106 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.106 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.106 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.106 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:73881 4.22 4:47e99c31:::100000001f8.00000025:head [write 1884160~4096 in=4096b,write 2342912~4096 in=4096b,write 2392064~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:57.106 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.878808+0000", 2023-09-30T17:03:57.107 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0024921800000000001, 2023-09-30T17:03:57.107 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0054152929999999998, 2023-09-30T17:03:57.107 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.107 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:57.107 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.107 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.107 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.107 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 73881 2023-09-30T17:03:57.107 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.107 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.107 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.108 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.108 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.878808+0000", 2023-09-30T17:03:57.108 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.108 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.108 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.108 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.108 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.878808+0000", 2023-09-30T17:03:57.108 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.108 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.108 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.108 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.108 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.878809+0000", 2023-09-30T17:03:57.109 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.017e-06 2023-09-30T17:03:57.109 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.109 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.109 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.109 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.878821+0000", 2023-09-30T17:03:57.109 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1622e-05 2023-09-30T17:03:57.109 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.109 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.109 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.109 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.878838+0000", 2023-09-30T17:03:57.109 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7212000000000001e-05 2023-09-30T17:03:57.110 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.110 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.110 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.110 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.878849+0000", 2023-09-30T17:03:57.110 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1197e-05 2023-09-30T17:03:57.110 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.110 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.110 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:57.110 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.882377+0000", 2023-09-30T17:03:57.110 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0035273320000000002 2023-09-30T17:03:57.110 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.110 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.111 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:57.111 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.882465+0000", 2023-09-30T17:03:57.111 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.7931999999999998e-05 2023-09-30T17:03:57.111 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.111 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.111 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.111 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.111 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.111 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:73844 4.6 4.2d31fac6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:57.111 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.866929+0000", 2023-09-30T17:03:57.112 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.014371874, 2023-09-30T17:03:57.112 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.017372954999999999, 2023-09-30T17:03:57.112 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.112 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:57.112 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.112 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.112 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.112 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 73844 2023-09-30T17:03:57.112 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.112 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.112 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.113 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.113 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.866929+0000", 2023-09-30T17:03:57.113 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.113 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.113 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.113 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.113 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.866929+0000", 2023-09-30T17:03:57.113 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.113 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.113 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.114 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.114 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.866929+0000", 2023-09-30T17:03:57.114 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9599999999999999e-07 2023-09-30T17:03:57.114 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.114 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.114 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.114 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.866940+0000", 2023-09-30T17:03:57.114 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0876000000000001e-05 2023-09-30T17:03:57.114 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.114 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.114 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.115 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.866949+0000", 2023-09-30T17:03:57.115 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5490000000000006e-06 2023-09-30T17:03:57.115 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.115 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.115 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.115 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.866956+0000", 2023-09-30T17:03:57.115 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3640000000000001e-06 2023-09-30T17:03:57.115 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.115 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.115 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.115 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.116 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.116 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:73882 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:57.116 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.879128+0000", 2023-09-30T17:03:57.116 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.002171994, 2023-09-30T17:03:57.116 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0052433740000000003, 2023-09-30T17:03:57.116 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.116 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:57.116 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.116 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.116 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.116 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 73882 2023-09-30T17:03:57.117 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.117 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.117 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.117 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.117 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.879128+0000", 2023-09-30T17:03:57.117 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.117 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.117 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.117 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.117 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.879128+0000", 2023-09-30T17:03:57.117 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.118 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.118 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.118 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.118 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.879129+0000", 2023-09-30T17:03:57.118 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7800000000000001e-07 2023-09-30T17:03:57.118 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.118 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.118 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.118 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.879141+0000", 2023-09-30T17:03:57.118 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1347e-05 2023-09-30T17:03:57.119 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.119 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.119 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.119 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.879154+0000", 2023-09-30T17:03:57.119 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.367e-05 2023-09-30T17:03:57.119 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.119 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.119 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.119 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.879173+0000", 2023-09-30T17:03:57.119 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8879999999999999e-05 2023-09-30T17:03:57.119 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.120 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.120 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.120 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.120 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.120 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:73878 4.37 e47/17)", 2023-09-30T17:03:57.120 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.879780+0000", 2023-09-30T17:03:57.120 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0015204940000000001, 2023-09-30T17:03:57.120 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0046643869999999999, 2023-09-30T17:03:57.120 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.120 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:57.121 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.121 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.121 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.121 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.879780+0000", 2023-09-30T17:03:57.121 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.121 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.121 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.121 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.121 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.879780+0000", 2023-09-30T17:03:57.121 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.122 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.122 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.122 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.122 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.879781+0000", 2023-09-30T17:03:57.122 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.75e-07 2023-09-30T17:03:57.122 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.122 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.122 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.122 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.879800+0000", 2023-09-30T17:03:57.122 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9086e-05 2023-09-30T17:03:57.122 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.123 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.123 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.123 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.879809+0000", 2023-09-30T17:03:57.123 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2150000000000007e-06 2023-09-30T17:03:57.123 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.123 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.123 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.123 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.879814+0000", 2023-09-30T17:03:57.123 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6350000000000003e-06 2023-09-30T17:03:57.123 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.123 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.124 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.124 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.124 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.124 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:73885 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:57.124 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.879994+0000", 2023-09-30T17:03:57.124 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.001306436, 2023-09-30T17:03:57.124 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0045115850000000002, 2023-09-30T17:03:57.124 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.124 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:57.124 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.125 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.125 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.125 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 73885 2023-09-30T17:03:57.125 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.125 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.126 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.126 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.126 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.879994+0000", 2023-09-30T17:03:57.126 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.126 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.126 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.126 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.126 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.879994+0000", 2023-09-30T17:03:57.126 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.127 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.127 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.127 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.127 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.879995+0000", 2023-09-30T17:03:57.127 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.7899999999999997e-07 2023-09-30T17:03:57.127 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.127 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.127 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.127 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.880006+0000", 2023-09-30T17:03:57.127 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1327e-05 2023-09-30T17:03:57.127 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.128 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.128 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.128 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.880020+0000", 2023-09-30T17:03:57.128 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4003e-05 2023-09-30T17:03:57.128 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.128 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.128 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.128 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.880034+0000", 2023-09-30T17:03:57.128 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3268000000000001e-05 2023-09-30T17:03:57.128 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.128 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.129 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.129 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.129 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.129 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:73888 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:57.129 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.880960+0000", 2023-09-30T17:03:57.129 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.00034014400000000001, 2023-09-30T17:03:57.129 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0036093890000000002, 2023-09-30T17:03:57.129 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.129 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:57.129 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.130 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.130 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.130 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 73888 2023-09-30T17:03:57.130 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.130 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.130 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.130 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.130 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.880960+0000", 2023-09-30T17:03:57.130 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.130 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.130 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.131 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.131 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.880960+0000", 2023-09-30T17:03:57.131 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.131 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.131 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.131 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.131 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.880961+0000", 2023-09-30T17:03:57.131 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7400000000000003e-07 2023-09-30T17:03:57.131 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.131 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.131 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.132 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.880969+0000", 2023-09-30T17:03:57.132 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0539999999999995e-06 2023-09-30T17:03:57.132 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.132 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.132 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.132 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.880979+0000", 2023-09-30T17:03:57.132 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.9040000000000004e-06 2023-09-30T17:03:57.132 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.132 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.132 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.133 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.880985+0000", 2023-09-30T17:03:57.133 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5670000000000002e-06 2023-09-30T17:03:57.133 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.133 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.133 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.133 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.133 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.133 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:73820 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 4009984~4096 in=4096b,write 4030464~4096 in=4096b,write 4050944~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:57.133 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.858664+0000", 2023-09-30T17:03:57.133 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.022636369, 2023-09-30T17:03:57.134 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.025979544, 2023-09-30T17:03:57.134 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.134 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:57.134 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.134 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.134 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.134 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 73820 2023-09-30T17:03:57.134 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.134 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.135 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.135 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.135 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.858664+0000", 2023-09-30T17:03:57.135 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.135 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.135 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.135 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.135 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.858664+0000", 2023-09-30T17:03:57.135 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.135 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.135 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.136 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.136 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.858665+0000", 2023-09-30T17:03:57.136 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7999999999999996e-07 2023-09-30T17:03:57.136 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.136 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.136 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.136 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.858676+0000", 2023-09-30T17:03:57.136 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1758e-05 2023-09-30T17:03:57.136 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.136 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.137 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.137 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.858684+0000", 2023-09-30T17:03:57.137 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1179999999999992e-06 2023-09-30T17:03:57.137 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.137 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.137 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.137 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.858689+0000", 2023-09-30T17:03:57.137 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2710000000000003e-06 2023-09-30T17:03:57.137 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.137 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.137 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:57.138 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.871989+0000", 2023-09-30T17:03:57.138 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.013300144999999999 2023-09-30T17:03:57.138 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.138 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.138 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:57.138 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.872063+0000", 2023-09-30T17:03:57.138 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3851999999999997e-05 2023-09-30T17:03:57.138 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.138 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.138 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:57.139 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.872219+0000", 2023-09-30T17:03:57.139 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000156651 2023-09-30T17:03:57.139 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.139 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.139 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.139 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.139 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.139 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:73849 4.f e47/17 4:f2a80dfe:::100000001f8.00000019:head v 47'3507, mlcod=47'3495)", 2023-09-30T17:03:57.139 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.868386+0000", 2023-09-30T17:03:57.139 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.012914564, 2023-09-30T17:03:57.139 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.016331579999999998, 2023-09-30T17:03:57.140 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.140 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:57.140 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.140 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.140 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.140 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.868386+0000", 2023-09-30T17:03:57.140 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.140 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.140 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.140 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.140 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.868386+0000", 2023-09-30T17:03:57.141 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.141 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.141 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.141 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.141 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.868386+0000", 2023-09-30T17:03:57.141 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6899999999999997e-07 2023-09-30T17:03:57.141 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.141 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.141 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.141 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.868408+0000", 2023-09-30T17:03:57.142 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1229999999999998e-05 2023-09-30T17:03:57.142 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.142 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.142 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.142 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.868419+0000", 2023-09-30T17:03:57.142 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1409999999999999e-05 2023-09-30T17:03:57.142 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.142 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.142 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.142 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.868426+0000", 2023-09-30T17:03:57.142 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9020000000000002e-06 2023-09-30T17:03:57.143 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.143 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.143 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:57.143 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.883528+0000", 2023-09-30T17:03:57.143 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.015101992 2023-09-30T17:03:57.143 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.143 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.143 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:57.143 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.883545+0000", 2023-09-30T17:03:57.143 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7022999999999999e-05 2023-09-30T17:03:57.143 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.144 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.144 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.144 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.144 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.144 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:73889 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:57.144 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.881222+0000", 2023-09-30T17:03:57.144 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 7.8739000000000006e-05, 2023-09-30T17:03:57.144 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0035627219999999999, 2023-09-30T17:03:57.144 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.145 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:57.145 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.145 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.145 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.145 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 73889 2023-09-30T17:03:57.145 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.145 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.145 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.145 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.145 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.881222+0000", 2023-09-30T17:03:57.145 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.146 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.146 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.146 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.146 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.881222+0000", 2023-09-30T17:03:57.146 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.146 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.146 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.146 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.146 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.881222+0000", 2023-09-30T17:03:57.146 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4099999999999998e-07 2023-09-30T17:03:57.146 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.147 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.147 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.147 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.881242+0000", 2023-09-30T17:03:57.147 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9932000000000002e-05 2023-09-30T17:03:57.147 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.147 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.147 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.147 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.881257+0000", 2023-09-30T17:03:57.147 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4429e-05 2023-09-30T17:03:57.147 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.148 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.148 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.148 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.881264+0000", 2023-09-30T17:03:57.148 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6090000000000003e-06 2023-09-30T17:03:57.148 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.148 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.148 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.148 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.148 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.148 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:73804 4.37 e47/17 4:eff9002a:::100000001f8.00000003:head v 47'3468, mlcod=47'3460)", 2023-09-30T17:03:57.148 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.858780+0000", 2023-09-30T17:03:57.149 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.022520943000000002, 2023-09-30T17:03:57.149 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.026080222, 2023-09-30T17:03:57.149 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.149 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:57.149 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.149 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.149 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.149 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.858780+0000", 2023-09-30T17:03:57.149 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.149 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.149 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.149 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.150 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.858780+0000", 2023-09-30T17:03:57.150 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.150 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.150 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.150 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.150 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.858780+0000", 2023-09-30T17:03:57.150 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0999999999999998e-07 2023-09-30T17:03:57.150 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.150 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.150 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.150 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.858795+0000", 2023-09-30T17:03:57.151 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5011000000000001e-05 2023-09-30T17:03:57.151 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.151 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.151 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.151 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.858808+0000", 2023-09-30T17:03:57.151 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3128e-05 2023-09-30T17:03:57.151 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.151 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.151 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.151 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.858815+0000", 2023-09-30T17:03:57.151 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9500000000000004e-06 2023-09-30T17:03:57.152 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.152 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.152 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:57.152 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.878068+0000", 2023-09-30T17:03:57.152 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.019253039999999999 2023-09-30T17:03:57.152 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.152 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.152 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:57.152 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.878096+0000", 2023-09-30T17:03:57.152 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.7759999999999998e-05 2023-09-30T17:03:57.153 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.153 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.153 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.153 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.153 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.153 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:73848 4.3d 4:bd3afb9d:::100000001f8.00000009:head [write 2568192~4096 in=4096b,write 2580480~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:57.153 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.868422+0000", 2023-09-30T17:03:57.153 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.012878766, 2023-09-30T17:03:57.153 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.016505035000000001, 2023-09-30T17:03:57.153 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.154 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:57.154 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.154 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.154 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.154 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 73848 2023-09-30T17:03:57.154 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.154 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.154 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.154 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.154 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.868422+0000", 2023-09-30T17:03:57.155 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.155 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.155 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.155 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.155 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.868422+0000", 2023-09-30T17:03:57.155 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.155 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.155 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.155 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.155 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.868422+0000", 2023-09-30T17:03:57.155 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3000000000000001e-07 2023-09-30T17:03:57.156 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.156 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.156 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.156 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.868432+0000", 2023-09-30T17:03:57.156 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.4159999999999993e-06 2023-09-30T17:03:57.156 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.156 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.156 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.156 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.868439+0000", 2023-09-30T17:03:57.156 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.99e-06 2023-09-30T17:03:57.157 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.157 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.157 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.157 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.868442+0000", 2023-09-30T17:03:57.157 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6969999999999999e-06 2023-09-30T17:03:57.157 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.157 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.157 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:57.157 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.868828+0000", 2023-09-30T17:03:57.157 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00038585699999999998 2023-09-30T17:03:57.158 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.158 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.158 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:57.158 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.868928+0000", 2023-09-30T17:03:57.158 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.9753999999999994e-05 2023-09-30T17:03:57.158 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.158 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.158 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.158 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.158 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.158 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:73890 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:57.159 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.881475+0000", 2023-09-30T17:03:57.159 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.9998255, 2023-09-30T17:03:57.159 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0034935000000000001, 2023-09-30T17:03:57.159 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.159 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:57.159 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.159 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.159 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.159 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 73890 2023-09-30T17:03:57.159 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.160 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.160 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.160 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.160 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.881475+0000", 2023-09-30T17:03:57.160 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.160 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.160 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.160 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.160 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.881475+0000", 2023-09-30T17:03:57.160 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.160 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.160 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.160 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.161 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.881476+0000", 2023-09-30T17:03:57.161 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4900000000000005e-07 2023-09-30T17:03:57.161 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.161 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.161 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.161 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.881497+0000", 2023-09-30T17:03:57.161 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.0886999999999998e-05 2023-09-30T17:03:57.161 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.161 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.161 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.162 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.881510+0000", 2023-09-30T17:03:57.162 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2757e-05 2023-09-30T17:03:57.162 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.162 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.162 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.162 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.881517+0000", 2023-09-30T17:03:57.162 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6170000000000001e-06 2023-09-30T17:03:57.162 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.162 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.162 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.163 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.163 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.163 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:73821 4.36 4:6fa85f86:::100000001f8.00000013:head [write 3534848~4096 in=4096b,write 3788800~4096 in=4096b,write 3895296~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:57.163 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.858943+0000", 2023-09-30T17:03:57.163 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.022357418, 2023-09-30T17:03:57.163 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.026068797000000001, 2023-09-30T17:03:57.163 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.163 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:57.163 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.163 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.164 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.164 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 73821 2023-09-30T17:03:57.164 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.164 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.164 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.164 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.164 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.858943+0000", 2023-09-30T17:03:57.164 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.164 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.164 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.164 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.164 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.858943+0000", 2023-09-30T17:03:57.165 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.165 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.165 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.165 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.165 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.858944+0000", 2023-09-30T17:03:57.165 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9500000000000002e-07 2023-09-30T17:03:57.165 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.165 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.165 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.165 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.858956+0000", 2023-09-30T17:03:57.166 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2845e-05 2023-09-30T17:03:57.166 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.166 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.166 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.166 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.858966+0000", 2023-09-30T17:03:57.166 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7780000000000002e-06 2023-09-30T17:03:57.166 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.166 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.166 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.166 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.858974+0000", 2023-09-30T17:03:57.167 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6699999999999994e-06 2023-09-30T17:03:57.167 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.167 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.167 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:57.167 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.872010+0000", 2023-09-30T17:03:57.167 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.013035842000000001 2023-09-30T17:03:57.167 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.167 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.167 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:57.167 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.872090+0000", 2023-09-30T17:03:57.168 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0045999999999999e-05 2023-09-30T17:03:57.168 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.168 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.168 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:57.168 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.872229+0000", 2023-09-30T17:03:57.168 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00013903099999999999 2023-09-30T17:03:57.168 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.168 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.168 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.168 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.168 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.169 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:73891 4.d 4:b1164065:::100000001f8.00000035:head [write 188416~4096 in=4096b,write 344064~4096 in=4096b,write 475136~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:57.169 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.881726+0000", 2023-09-30T17:03:57.169 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.9995742, 2023-09-30T17:03:57.169 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0033291800000000002, 2023-09-30T17:03:57.169 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.169 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:57.169 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.169 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.169 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.169 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 73891 2023-09-30T17:03:57.169 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.170 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.170 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.170 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.170 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.881726+0000", 2023-09-30T17:03:57.170 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.170 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.170 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.170 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.170 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.881726+0000", 2023-09-30T17:03:57.170 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.170 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.171 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.171 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.171 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.881727+0000", 2023-09-30T17:03:57.171 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1999999999999999e-07 2023-09-30T17:03:57.171 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.171 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.171 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.171 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.881752+0000", 2023-09-30T17:03:57.171 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4783999999999999e-05 2023-09-30T17:03:57.171 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.171 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.171 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.172 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.881764+0000", 2023-09-30T17:03:57.172 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2551000000000001e-05 2023-09-30T17:03:57.172 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.172 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.172 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.172 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.881779+0000", 2023-09-30T17:03:57.172 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4695000000000001e-05 2023-09-30T17:03:57.172 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.172 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.172 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:57.173 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.881836+0000", 2023-09-30T17:03:57.173 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7145000000000003e-05 2023-09-30T17:03:57.173 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.173 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.173 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:57.173 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.881937+0000", 2023-09-30T17:03:57.173 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000100942 2023-09-30T17:03:57.173 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.173 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.173 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.173 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.174 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.174 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:73784 4.3f 4.a34187bf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:57.174 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.845699+0000", 2023-09-30T17:03:57.174 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.035601593000000001, 2023-09-30T17:03:57.174 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.039392978000000002, 2023-09-30T17:03:57.174 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.174 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:57.174 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.174 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.174 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.174 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 73784 2023-09-30T17:03:57.175 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.175 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.175 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.175 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.175 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.845699+0000", 2023-09-30T17:03:57.175 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.175 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.175 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.175 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.175 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.845699+0000", 2023-09-30T17:03:57.176 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.176 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.176 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.176 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.176 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.845700+0000", 2023-09-30T17:03:57.176 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5700000000000001e-07 2023-09-30T17:03:57.176 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.176 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.176 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.176 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.845713+0000", 2023-09-30T17:03:57.177 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.344e-05 2023-09-30T17:03:57.177 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.177 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.177 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.177 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.845724+0000", 2023-09-30T17:03:57.177 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0789e-05 2023-09-30T17:03:57.177 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.177 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.177 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.177 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.845731+0000", 2023-09-30T17:03:57.177 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2810000000000003e-06 2023-09-30T17:03:57.178 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.178 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.178 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.178 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.178 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.178 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:73822 4.36 4:6da220e6:::100000001f8.0000003f:head [write 1613824~4096 in=4096b,write 1744896~4096 in=4096b,write 2285568~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:57.178 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.859204+0000", 2023-09-30T17:03:57.178 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.022096886, 2023-09-30T17:03:57.178 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.025920935999999999, 2023-09-30T17:03:57.178 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.179 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:57.179 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.179 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.179 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.179 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 73822 2023-09-30T17:03:57.179 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.179 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.179 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.179 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.179 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.859204+0000", 2023-09-30T17:03:57.180 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.180 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.180 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.180 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.180 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.859204+0000", 2023-09-30T17:03:57.180 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.180 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.180 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.180 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.180 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.859204+0000", 2023-09-30T17:03:57.180 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2500000000000005e-07 2023-09-30T17:03:57.180 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.181 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.181 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.181 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.859223+0000", 2023-09-30T17:03:57.181 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9008000000000002e-05 2023-09-30T17:03:57.181 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.181 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.181 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.181 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.859232+0000", 2023-09-30T17:03:57.181 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.986e-06 2023-09-30T17:03:57.181 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.182 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.182 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.182 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.859239+0000", 2023-09-30T17:03:57.182 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5390000000000004e-06 2023-09-30T17:03:57.182 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.182 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.182 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:57.182 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.874537+0000", 2023-09-30T17:03:57.182 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.015298351 2023-09-30T17:03:57.182 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.182 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.183 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:57.183 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.874613+0000", 2023-09-30T17:03:57.183 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5624000000000006e-05 2023-09-30T17:03:57.183 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.183 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.183 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:57.183 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.874757+0000", 2023-09-30T17:03:57.183 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014399000000000001 2023-09-30T17:03:57.183 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.184 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.184 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.184 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.184 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.184 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:73892 4.36 4.670445b6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:57.184 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.882010+0000", 2023-09-30T17:03:57.184 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.9992905, 2023-09-30T17:03:57.184 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0031988730000000001, 2023-09-30T17:03:57.184 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.184 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:57.185 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.185 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.185 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.185 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 73892 2023-09-30T17:03:57.185 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.185 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.185 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.185 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.185 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.882010+0000", 2023-09-30T17:03:57.185 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.185 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.186 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.186 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.186 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.882010+0000", 2023-09-30T17:03:57.186 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.186 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.186 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.186 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.186 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.882011+0000", 2023-09-30T17:03:57.186 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1600000000000001e-07 2023-09-30T17:03:57.186 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.187 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.187 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.187 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.882035+0000", 2023-09-30T17:03:57.187 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4601999999999999e-05 2023-09-30T17:03:57.187 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.187 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.187 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.187 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.882045+0000", 2023-09-30T17:03:57.187 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.4609999999999997e-06 2023-09-30T17:03:57.187 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.188 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.188 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.188 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.882052+0000", 2023-09-30T17:03:57.188 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9290000000000001e-06 2023-09-30T17:03:57.188 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.188 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.188 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.188 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.188 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.188 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:73786 4.3f 4.a34187bf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:57.188 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.846319+0000", 2023-09-30T17:03:57.189 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.034981061000000001, 2023-09-30T17:03:57.189 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.038952207000000003, 2023-09-30T17:03:57.189 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.189 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:57.189 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.189 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.189 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.189 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 73786 2023-09-30T17:03:57.189 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.189 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.189 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.190 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.190 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.846319+0000", 2023-09-30T17:03:57.190 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.190 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.190 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.190 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.190 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.846319+0000", 2023-09-30T17:03:57.190 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.190 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.190 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.190 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.191 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.846320+0000", 2023-09-30T17:03:57.191 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1399999999999996e-07 2023-09-30T17:03:57.191 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.191 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.191 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.191 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.846334+0000", 2023-09-30T17:03:57.191 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3682e-05 2023-09-30T17:03:57.191 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.191 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.191 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.192 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.846346+0000", 2023-09-30T17:03:57.192 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2418e-05 2023-09-30T17:03:57.192 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.192 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.192 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.192 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.846353+0000", 2023-09-30T17:03:57.192 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5899999999999996e-06 2023-09-30T17:03:57.192 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.192 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.192 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.193 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.193 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.193 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:73894 4.13 4:caef1406:::100000001f8.00000031:head [write 98304~4096 in=4096b,write 200704~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:57.193 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.884694+0000", 2023-09-30T17:03:57.193 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.9966068, 2023-09-30T17:03:57.193 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00065121600000000003, 2023-09-30T17:03:57.193 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.193 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:57.193 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.193 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.193 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.193 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 73894 2023-09-30T17:03:57.194 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.194 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.194 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.194 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.194 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.884694+0000", 2023-09-30T17:03:57.194 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.194 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.194 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.194 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.194 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.884694+0000", 2023-09-30T17:03:57.195 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.195 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.195 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.195 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.195 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.884695+0000", 2023-09-30T17:03:57.195 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2500000000000004e-07 2023-09-30T17:03:57.195 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.195 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.195 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.196 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.884704+0000", 2023-09-30T17:03:57.196 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.4900000000000006e-06 2023-09-30T17:03:57.196 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.196 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.196 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.196 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.884720+0000", 2023-09-30T17:03:57.196 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6245000000000001e-05 2023-09-30T17:03:57.196 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.196 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.196 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.196 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.884730+0000", 2023-09-30T17:03:57.197 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.5370000000000003e-06 2023-09-30T17:03:57.197 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.197 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.197 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:57.197 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.884785+0000", 2023-09-30T17:03:57.197 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5102000000000002e-05 2023-09-30T17:03:57.197 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.197 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.197 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:57.197 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.884850+0000", 2023-09-30T17:03:57.197 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4777999999999995e-05 2023-09-30T17:03:57.198 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.198 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.198 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.198 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.198 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.198 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:73886 4.37 e47/17)", 2023-09-30T17:03:57.198 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.884725+0000", 2023-09-30T17:03:57.198 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.9965749, 2023-09-30T17:03:57.198 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00069675900000000003, 2023-09-30T17:03:57.198 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.198 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:57.199 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.199 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.199 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.199 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.884725+0000", 2023-09-30T17:03:57.199 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.199 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.199 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.199 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.199 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.884725+0000", 2023-09-30T17:03:57.199 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.199 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.200 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.200 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.200 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.884726+0000", 2023-09-30T17:03:57.200 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6400000000000003e-07 2023-09-30T17:03:57.200 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.200 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.200 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.200 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.884734+0000", 2023-09-30T17:03:57.200 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0600000000000008e-06 2023-09-30T17:03:57.200 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.200 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.201 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.201 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.884744+0000", 2023-09-30T17:03:57.201 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0485e-05 2023-09-30T17:03:57.201 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.201 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.201 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.201 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.884754+0000", 2023-09-30T17:03:57.201 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0020999999999999e-05 2023-09-30T17:03:57.201 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.201 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.201 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.202 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.202 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.202 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:73895 4.3d 4:bfffac44:::100000001f8.0000000c:head [write 2486272~4096 in=4096b,write 2543616~4096 in=4096b,write 3088384~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:57.202 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.884750+0000", 2023-09-30T17:03:57.202 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.996551, 2023-09-30T17:03:57.202 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00073716299999999999, 2023-09-30T17:03:57.202 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.202 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:57.202 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.202 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.203 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.203 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 73895 2023-09-30T17:03:57.203 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.203 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.203 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.203 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.203 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.884750+0000", 2023-09-30T17:03:57.203 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.203 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.203 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.203 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.204 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.884750+0000", 2023-09-30T17:03:57.204 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.204 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.204 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.204 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.204 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.884750+0000", 2023-09-30T17:03:57.204 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2500000000000004e-07 2023-09-30T17:03:57.204 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.204 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.204 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.204 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.884766+0000", 2023-09-30T17:03:57.205 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5065000000000001e-05 2023-09-30T17:03:57.205 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.205 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.205 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.205 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.884775+0000", 2023-09-30T17:03:57.205 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7189999999999996e-06 2023-09-30T17:03:57.205 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.205 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.205 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.205 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.884782+0000", 2023-09-30T17:03:57.205 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8329999999999996e-06 2023-09-30T17:03:57.206 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.206 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.206 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:57.206 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.885382+0000", 2023-09-30T17:03:57.206 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00060036200000000001 2023-09-30T17:03:57.206 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.206 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.206 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:57.206 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.885463+0000", 2023-09-30T17:03:57.206 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0395000000000005e-05 2023-09-30T17:03:57.206 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.207 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.207 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.207 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.207 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.207 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:73853 4.3d 4:bfffac44:::100000001f8.0000000c:head [write 2588672~4096 in=4096b,write 2834432~4096 in=4096b,write 2912256~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:57.207 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.870372+0000", 2023-09-30T17:03:57.207 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.010927983, 2023-09-30T17:03:57.207 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.015199152, 2023-09-30T17:03:57.207 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.207 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:57.207 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.207 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.208 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.208 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 73853 2023-09-30T17:03:57.208 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.208 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.208 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.208 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.208 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.870372+0000", 2023-09-30T17:03:57.208 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.208 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.208 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.208 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.209 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.870372+0000", 2023-09-30T17:03:57.209 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.209 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.209 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.209 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.209 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.870373+0000", 2023-09-30T17:03:57.209 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9599999999999999e-07 2023-09-30T17:03:57.209 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.209 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.209 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.209 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.870383+0000", 2023-09-30T17:03:57.210 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0519999999999999e-05 2023-09-30T17:03:57.210 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.210 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.210 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.210 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.870392+0000", 2023-09-30T17:03:57.210 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0900000000000005e-06 2023-09-30T17:03:57.210 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.210 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.210 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.210 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.870400+0000", 2023-09-30T17:03:57.210 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1969999999999996e-06 2023-09-30T17:03:57.211 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.211 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.211 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:57.211 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.872774+0000", 2023-09-30T17:03:57.211 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.002373984 2023-09-30T17:03:57.211 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.211 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.211 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:57.211 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.872840+0000", 2023-09-30T17:03:57.211 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5770000000000002e-05 2023-09-30T17:03:57.211 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.212 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.212 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.212 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.212 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.212 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:73897 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:57.212 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.884795+0000", 2023-09-30T17:03:57.212 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.9965053, 2023-09-30T17:03:57.212 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00085684499999999996, 2023-09-30T17:03:57.212 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.212 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:57.212 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.212 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.213 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.213 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 73897 2023-09-30T17:03:57.213 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.213 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.213 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.213 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.213 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.884795+0000", 2023-09-30T17:03:57.213 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.213 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.213 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.213 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.214 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.884795+0000", 2023-09-30T17:03:57.214 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.214 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.214 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.214 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.214 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.884796+0000", 2023-09-30T17:03:57.214 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2200000000000004e-07 2023-09-30T17:03:57.214 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.214 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.214 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.214 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.884808+0000", 2023-09-30T17:03:57.215 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2081e-05 2023-09-30T17:03:57.215 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.215 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.215 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.215 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.884816+0000", 2023-09-30T17:03:57.215 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1179999999999992e-06 2023-09-30T17:03:57.215 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.215 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.215 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.215 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.884822+0000", 2023-09-30T17:03:57.215 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3609999999999997e-06 2023-09-30T17:03:57.216 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.216 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.216 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.216 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.216 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.216 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:73724 4.27 4.df99e167 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:57.216 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.826087+0000", 2023-09-30T17:03:57.216 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.055213641000000001, 2023-09-30T17:03:57.216 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.059638498999999998, 2023-09-30T17:03:57.216 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.216 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:57.217 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.217 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.217 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.217 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 73724 2023-09-30T17:03:57.217 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.217 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.217 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.217 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.217 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.826087+0000", 2023-09-30T17:03:57.217 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.217 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.218 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.218 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.218 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.826087+0000", 2023-09-30T17:03:57.218 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.218 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.218 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.218 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.218 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.826087+0000", 2023-09-30T17:03:57.218 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2699999999999999e-07 2023-09-30T17:03:57.219 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.219 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.219 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.219 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.826100+0000", 2023-09-30T17:03:57.219 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2937e-05 2023-09-30T17:03:57.219 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.219 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.219 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.219 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.826108+0000", 2023-09-30T17:03:57.220 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0150000000000003e-06 2023-09-30T17:03:57.220 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.220 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.220 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.220 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.826114+0000", 2023-09-30T17:03:57.220 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9449999999999998e-06 2023-09-30T17:03:57.220 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.220 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.220 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.220 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.220 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.220 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:73851 4.2d e47/17 4:b7099a35:::100000001f8.0000000e:head v 47'2262, mlcod=47'2259)", 2023-09-30T17:03:57.221 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.870424+0000", 2023-09-30T17:03:57.221 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.010875991999999999, 2023-09-30T17:03:57.221 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.015365979, 2023-09-30T17:03:57.221 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.221 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:57.221 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.221 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.221 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.221 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.870424+0000", 2023-09-30T17:03:57.221 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.221 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.221 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.222 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.222 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.870424+0000", 2023-09-30T17:03:57.222 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.222 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.222 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.222 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.222 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.870425+0000", 2023-09-30T17:03:57.222 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8800000000000002e-07 2023-09-30T17:03:57.222 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.222 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.222 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.223 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.870445+0000", 2023-09-30T17:03:57.223 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.0341999999999999e-05 2023-09-30T17:03:57.223 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.223 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.223 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.223 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.870456+0000", 2023-09-30T17:03:57.223 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0573e-05 2023-09-30T17:03:57.223 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.223 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.223 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.223 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.870463+0000", 2023-09-30T17:03:57.223 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1849999999999998e-06 2023-09-30T17:03:57.224 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.224 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.224 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:57.224 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.871660+0000", 2023-09-30T17:03:57.224 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001196943 2023-09-30T17:03:57.224 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.224 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.224 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:57.224 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.871681+0000", 2023-09-30T17:03:57.224 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.0973000000000001e-05 2023-09-30T17:03:57.224 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.224 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.225 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.225 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.225 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.225 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:73899 4.d 4:b1164065:::100000001f8.00000035:head [write 167936~4096 in=4096b,write 180224~4096 in=4096b,write 823296~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:57.225 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:56.884831+0000", 2023-09-30T17:03:57.225 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.99647, 2023-09-30T17:03:57.225 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001038712, 2023-09-30T17:03:57.225 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.225 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:03:57.225 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.225 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.226 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.226 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 73899 2023-09-30T17:03:57.226 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.226 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.226 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.226 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.226 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.884831+0000", 2023-09-30T17:03:57.226 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.226 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.226 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.226 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.227 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.884831+0000", 2023-09-30T17:03:57.227 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.227 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.227 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.227 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.227 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.884831+0000", 2023-09-30T17:03:57.227 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4799999999999998e-07 2023-09-30T17:03:57.227 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.227 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.227 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.227 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.884842+0000", 2023-09-30T17:03:57.228 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0678e-05 2023-09-30T17:03:57.228 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.228 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.228 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.228 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.884849+0000", 2023-09-30T17:03:57.228 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9650000000000002e-06 2023-09-30T17:03:57.228 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.228 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.228 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.228 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.884856+0000", 2023-09-30T17:03:57.228 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5340000000000002e-06 2023-09-30T17:03:57.229 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.229 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.229 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:57.229 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.885364+0000", 2023-09-30T17:03:57.229 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00050798300000000005 2023-09-30T17:03:57.229 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.229 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.229 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:57.229 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:56.885450+0000", 2023-09-30T17:03:57.229 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5551999999999997e-05 2023-09-30T17:03:57.229 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.229 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.230 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.230 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.230 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-09-30T17:03:57.230 INFO:teuthology.orchestra.run.smithi031.stdout: "num_ops": 70 2023-09-30T17:03:57.230 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:57.233 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:03:57.233 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:57.230+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:57.332 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:57.332+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:57.433 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:57.433+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:57.478 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:57.478 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:03:57.478 INFO:teuthology.orchestra.run.smithi031.stdout: "complaint_time": 30, 2023-09-30T17:03:57.478 INFO:teuthology.orchestra.run.smithi031.stdout: "num_blocked_ops": 0 2023-09-30T17:03:57.478 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:57.492 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:03:57.535 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:57.534+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:57.635 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:57.634+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:57.737 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:03:57.737 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 20, 2023-09-30T17:03:57.737 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 600, 2023-09-30T17:03:57.738 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:03:57.738 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.738 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23704 4.14 4:2b28d75f:::100000001f8.00000016:head [write 262144~4096,write 274432~4096,write 405504~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:57.738 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.711008+0000", 2023-09-30T17:03:57.738 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 19.023508510999999, 2023-09-30T17:03:57.738 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.229109541, 2023-09-30T17:03:57.738 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.738 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:57.738 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.738 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.738 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.739 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23704 2023-09-30T17:03:57.739 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.739 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.739 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.739 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.739 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711008+0000", 2023-09-30T17:03:57.739 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.739 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.739 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.739 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.739 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711008+0000", 2023-09-30T17:03:57.739 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.740 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.740 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.740 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.740 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711009+0000", 2023-09-30T17:03:57.740 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5899999999999995e-07 2023-09-30T17:03:57.740 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.740 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.740 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.740 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711042+0000", 2023-09-30T17:03:57.740 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3149999999999999e-05 2023-09-30T17:03:57.740 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.740 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.741 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.741 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711054+0000", 2023-09-30T17:03:57.741 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1742999999999999e-05 2023-09-30T17:03:57.741 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.741 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.741 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.741 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711059+0000", 2023-09-30T17:03:57.741 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3009999999999997e-06 2023-09-30T17:03:57.741 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.741 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.741 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:57.742 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711120+0000", 2023-09-30T17:03:57.742 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1228000000000004e-05 2023-09-30T17:03:57.742 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.742 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.742 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:57.742 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711205+0000", 2023-09-30T17:03:57.742 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4489999999999999e-05 2023-09-30T17:03:57.742 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.742 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.742 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:57.743 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711371+0000", 2023-09-30T17:03:57.743 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016639500000000001 2023-09-30T17:03:57.743 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.743 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.743 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:57.743 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.716551+0000", 2023-09-30T17:03:57.743 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051799929999999999 2023-09-30T17:03:57.743 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.743 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.743 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:57.743 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.940040+0000", 2023-09-30T17:03:57.743 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22348859800000001 2023-09-30T17:03:57.744 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.744 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.744 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:57.744 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.940080+0000", 2023-09-30T17:03:57.744 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0114999999999998e-05 2023-09-30T17:03:57.744 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.744 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.744 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:57.744 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.940118+0000", 2023-09-30T17:03:57.744 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7768999999999997e-05 2023-09-30T17:03:57.744 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.744 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.745 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.745 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.745 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.745 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23713 4.33 4:cf6d7a6c:::100000001f8.0000000a:head [write 585728~4096,write 925696~4096,write 937984~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:57.745 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.714948+0000", 2023-09-30T17:03:57.745 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 19.019568797000002, 2023-09-30T17:03:57.745 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23061467099999999, 2023-09-30T17:03:57.745 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.745 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:57.745 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.745 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.746 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.746 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23713 2023-09-30T17:03:57.746 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.746 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.746 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.746 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.746 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.714948+0000", 2023-09-30T17:03:57.746 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.746 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.746 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.746 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.746 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.714948+0000", 2023-09-30T17:03:57.747 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.747 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.747 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.747 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.747 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.714949+0000", 2023-09-30T17:03:57.747 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1399999999999995e-07 2023-09-30T17:03:57.747 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.747 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.747 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.747 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.714961+0000", 2023-09-30T17:03:57.747 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1916000000000001e-05 2023-09-30T17:03:57.748 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.748 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.748 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.748 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.714979+0000", 2023-09-30T17:03:57.748 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8070000000000001e-05 2023-09-30T17:03:57.748 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.748 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.748 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.748 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.714987+0000", 2023-09-30T17:03:57.748 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4179999999999997e-06 2023-09-30T17:03:57.748 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.748 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.749 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:57.749 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.715034+0000", 2023-09-30T17:03:57.749 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6563999999999997e-05 2023-09-30T17:03:57.749 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.749 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.749 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:57.749 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.715083+0000", 2023-09-30T17:03:57.749 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9310000000000001e-05 2023-09-30T17:03:57.749 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.749 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.749 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:57.749 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.715177+0000", 2023-09-30T17:03:57.750 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3525999999999999e-05 2023-09-30T17:03:57.750 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.750 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.750 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:57.750 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.719724+0000", 2023-09-30T17:03:57.750 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0045477210000000002 2023-09-30T17:03:57.750 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.750 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.750 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:57.750 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.945467+0000", 2023-09-30T17:03:57.750 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22574224500000001 2023-09-30T17:03:57.751 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.751 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.751 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:57.751 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.945524+0000", 2023-09-30T17:03:57.751 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7105999999999998e-05 2023-09-30T17:03:57.751 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.751 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.751 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:57.751 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.945563+0000", 2023-09-30T17:03:57.751 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8881000000000003e-05 2023-09-30T17:03:57.751 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.752 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.752 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.752 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.752 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.752 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23735 4.6 4:616d4c41:::100000001f8.00000034:head [write 991232~4096,write 1040384~4096,write 1200128~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:57.752 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.722398+0000", 2023-09-30T17:03:57.752 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 19.012118441999998, 2023-09-30T17:03:57.752 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.230202669, 2023-09-30T17:03:57.752 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.752 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:57.752 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.752 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.753 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.753 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23735 2023-09-30T17:03:57.753 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.753 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.753 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.753 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.753 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722398+0000", 2023-09-30T17:03:57.753 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.753 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.753 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.753 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.753 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722398+0000", 2023-09-30T17:03:57.754 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.754 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.754 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.754 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.754 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722399+0000", 2023-09-30T17:03:57.754 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2799999999999996e-07 2023-09-30T17:03:57.754 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.754 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.754 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.754 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722423+0000", 2023-09-30T17:03:57.754 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4134e-05 2023-09-30T17:03:57.755 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.755 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.755 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.755 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722429+0000", 2023-09-30T17:03:57.755 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4590000000000003e-06 2023-09-30T17:03:57.755 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.755 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.755 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.755 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722434+0000", 2023-09-30T17:03:57.755 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1779999999999996e-06 2023-09-30T17:03:57.755 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.755 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.756 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:57.756 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722490+0000", 2023-09-30T17:03:57.756 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6215999999999998e-05 2023-09-30T17:03:57.756 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.756 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.756 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:57.756 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722600+0000", 2023-09-30T17:03:57.756 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00011017 2023-09-30T17:03:57.756 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.756 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.756 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:57.756 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722769+0000", 2023-09-30T17:03:57.757 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0001695 2023-09-30T17:03:57.757 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.757 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.757 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:57.757 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725807+0000", 2023-09-30T17:03:57.757 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0030372120000000001 2023-09-30T17:03:57.757 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.757 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.757 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:57.757 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.952546+0000", 2023-09-30T17:03:57.757 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22673923600000001 2023-09-30T17:03:57.757 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.758 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.758 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:57.758 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.952579+0000", 2023-09-30T17:03:57.758 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3111000000000002e-05 2023-09-30T17:03:57.758 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.758 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.758 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:57.758 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.952601+0000", 2023-09-30T17:03:57.758 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1925000000000001e-05 2023-09-30T17:03:57.758 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.758 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.758 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.759 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.759 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.759 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23738 4.6 4:616d4c41:::100000001f8.00000034:head [write 3043328~4096,write 3055616~4096,write 3080192~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:57.759 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.723439+0000", 2023-09-30T17:03:57.759 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 19.011077469, 2023-09-30T17:03:57.759 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23665340400000001, 2023-09-30T17:03:57.759 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.759 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:57.759 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.759 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.759 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.760 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23738 2023-09-30T17:03:57.760 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.760 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.760 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.760 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.760 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723439+0000", 2023-09-30T17:03:57.760 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.760 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.760 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.760 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.760 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723439+0000", 2023-09-30T17:03:57.761 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.761 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.761 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.761 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.761 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723440+0000", 2023-09-30T17:03:57.761 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.23e-07 2023-09-30T17:03:57.761 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.761 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.761 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.761 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723452+0000", 2023-09-30T17:03:57.761 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2147000000000001e-05 2023-09-30T17:03:57.761 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.762 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.762 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.762 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723461+0000", 2023-09-30T17:03:57.762 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3839999999999997e-06 2023-09-30T17:03:57.762 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.762 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.762 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.762 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723465+0000", 2023-09-30T17:03:57.762 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7559999999999999e-06 2023-09-30T17:03:57.762 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.762 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.763 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:57.763 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723924+0000", 2023-09-30T17:03:57.763 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00045910299999999999 2023-09-30T17:03:57.763 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.763 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.763 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:57.763 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723970+0000", 2023-09-30T17:03:57.763 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5126999999999997e-05 2023-09-30T17:03:57.763 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.763 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.763 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:57.764 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724057+0000", 2023-09-30T17:03:57.764 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.7142e-05 2023-09-30T17:03:57.764 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.764 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.764 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:57.764 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.726148+0000", 2023-09-30T17:03:57.764 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.002091449 2023-09-30T17:03:57.764 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.764 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.764 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:57.764 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.960040+0000", 2023-09-30T17:03:57.764 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23389163299999999 2023-09-30T17:03:57.765 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.765 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.765 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:57.765 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.960071+0000", 2023-09-30T17:03:57.765 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.133e-05 2023-09-30T17:03:57.765 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.765 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.765 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:57.765 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.960093+0000", 2023-09-30T17:03:57.765 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1509999999999999e-05 2023-09-30T17:03:57.765 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.766 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.766 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.766 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.766 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.766 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23740 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 3780608~4096,write 3788800~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:57.766 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.723994+0000", 2023-09-30T17:03:57.766 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 19.010522692999999, 2023-09-30T17:03:57.766 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.234031238, 2023-09-30T17:03:57.766 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.766 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:57.766 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.767 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.767 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.767 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23740 2023-09-30T17:03:57.767 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.767 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.767 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.767 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.767 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723994+0000", 2023-09-30T17:03:57.767 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.767 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.767 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.767 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.768 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723994+0000", 2023-09-30T17:03:57.768 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.768 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.768 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.768 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.768 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723995+0000", 2023-09-30T17:03:57.768 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6000000000000003e-07 2023-09-30T17:03:57.768 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.768 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.768 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.768 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724004+0000", 2023-09-30T17:03:57.769 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.4909999999999994e-06 2023-09-30T17:03:57.769 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.769 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.769 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.769 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724012+0000", 2023-09-30T17:03:57.769 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4590000000000001e-06 2023-09-30T17:03:57.769 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.769 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.769 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.769 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724016+0000", 2023-09-30T17:03:57.769 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9890000000000003e-06 2023-09-30T17:03:57.770 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.770 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.770 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:57.770 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724060+0000", 2023-09-30T17:03:57.770 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4339999999999999e-05 2023-09-30T17:03:57.770 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.770 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.770 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:57.770 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724141+0000", 2023-09-30T17:03:57.770 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1384000000000005e-05 2023-09-30T17:03:57.770 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.771 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.771 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:57.771 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724300+0000", 2023-09-30T17:03:57.771 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015870700000000001 2023-09-30T17:03:57.771 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.771 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.771 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:57.771 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.726182+0000", 2023-09-30T17:03:57.771 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0018816060000000001 2023-09-30T17:03:57.771 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.771 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.771 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:57.772 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.957929+0000", 2023-09-30T17:03:57.772 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23174703399999999 2023-09-30T17:03:57.772 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.772 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.772 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:57.772 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.957983+0000", 2023-09-30T17:03:57.772 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4107999999999998e-05 2023-09-30T17:03:57.772 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.772 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.772 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:57.772 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.958025+0000", 2023-09-30T17:03:57.773 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2360000000000001e-05 2023-09-30T17:03:57.773 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.773 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.773 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.773 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.773 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.773 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23746 4.28 4:15eeb89b:::100000001f8.00000032:head [write 3731456~4096,write 3919872~4096,write 3952640~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:57.773 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.725721+0000", 2023-09-30T17:03:57.773 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 19.008795309, 2023-09-30T17:03:57.773 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.24024479800000001, 2023-09-30T17:03:57.773 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.773 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:57.774 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.774 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.774 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.774 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23746 2023-09-30T17:03:57.774 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.774 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.774 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.774 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.774 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725721+0000", 2023-09-30T17:03:57.774 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.774 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.775 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.775 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.775 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725721+0000", 2023-09-30T17:03:57.775 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.775 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.775 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.775 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.775 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725722+0000", 2023-09-30T17:03:57.775 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6499999999999999e-07 2023-09-30T17:03:57.775 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.775 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.775 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.776 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725732+0000", 2023-09-30T17:03:57.776 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7559999999999994e-06 2023-09-30T17:03:57.776 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.776 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.776 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.776 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725738+0000", 2023-09-30T17:03:57.776 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8360000000000003e-06 2023-09-30T17:03:57.776 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.776 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.776 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.776 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725746+0000", 2023-09-30T17:03:57.776 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4200000000000001e-06 2023-09-30T17:03:57.777 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.777 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.777 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:57.777 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725805+0000", 2023-09-30T17:03:57.777 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9318999999999999e-05 2023-09-30T17:03:57.777 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.777 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.777 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:57.777 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725904+0000", 2023-09-30T17:03:57.777 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8747999999999997e-05 2023-09-30T17:03:57.777 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.777 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.778 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:57.778 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.726075+0000", 2023-09-30T17:03:57.778 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017153700000000001 2023-09-30T17:03:57.778 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.778 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.778 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:57.778 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.727419+0000", 2023-09-30T17:03:57.778 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001343571 2023-09-30T17:03:57.778 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.778 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.778 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:57.778 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.965839+0000", 2023-09-30T17:03:57.779 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.238420467 2023-09-30T17:03:57.779 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.779 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.779 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:57.779 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.965922+0000", 2023-09-30T17:03:57.779 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2905000000000007e-05 2023-09-30T17:03:57.779 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.779 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.779 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:57.779 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.965966+0000", 2023-09-30T17:03:57.779 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3773999999999998e-05 2023-09-30T17:03:57.779 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.780 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.780 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.780 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.780 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.780 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23757 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 2117632~8192,write 2228224~4096,write 2453504~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:57.780 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.728711+0000", 2023-09-30T17:03:57.780 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 19.005805733999999, 2023-09-30T17:03:57.780 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23330704499999999, 2023-09-30T17:03:57.780 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.780 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:57.780 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.780 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.781 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.781 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23757 2023-09-30T17:03:57.781 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.781 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.781 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.781 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.781 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728711+0000", 2023-09-30T17:03:57.781 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.781 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.781 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.781 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.782 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728711+0000", 2023-09-30T17:03:57.782 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.782 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.782 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.782 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.782 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728712+0000", 2023-09-30T17:03:57.782 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4199999999999995e-07 2023-09-30T17:03:57.782 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.782 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.782 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.782 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728738+0000", 2023-09-30T17:03:57.782 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.6761e-05 2023-09-30T17:03:57.783 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.783 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.783 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.783 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728745+0000", 2023-09-30T17:03:57.783 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9940000000000003e-06 2023-09-30T17:03:57.783 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.783 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.783 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.783 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728749+0000", 2023-09-30T17:03:57.783 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.053e-06 2023-09-30T17:03:57.783 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.783 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.784 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:57.784 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728802+0000", 2023-09-30T17:03:57.784 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2918999999999999e-05 2023-09-30T17:03:57.784 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.784 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.784 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:57.784 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728923+0000", 2023-09-30T17:03:57.784 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00012084200000000001 2023-09-30T17:03:57.784 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.784 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.784 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:57.784 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.729101+0000", 2023-09-30T17:03:57.785 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000178226 2023-09-30T17:03:57.785 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.785 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.785 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:57.785 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732207+0000", 2023-09-30T17:03:57.785 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0031059849999999999 2023-09-30T17:03:57.785 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.785 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.785 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:57.785 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.961949+0000", 2023-09-30T17:03:57.785 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.229741842 2023-09-30T17:03:57.786 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.786 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.786 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:57.786 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.961986+0000", 2023-09-30T17:03:57.786 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7147000000000002e-05 2023-09-30T17:03:57.786 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.786 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.786 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:57.786 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.962018+0000", 2023-09-30T17:03:57.786 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.1634000000000002e-05 2023-09-30T17:03:57.786 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.786 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.787 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.787 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.787 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.787 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23768 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 1257472~4096,write 1384448~4096,write 1474560~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:57.787 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.732216+0000", 2023-09-30T17:03:57.787 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 19.002301102000001, 2023-09-30T17:03:57.787 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22951861000000001, 2023-09-30T17:03:57.787 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.787 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:57.787 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.787 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.788 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.788 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23768 2023-09-30T17:03:57.788 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.788 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.788 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.788 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.788 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732216+0000", 2023-09-30T17:03:57.788 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.788 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.788 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.788 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.789 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732216+0000", 2023-09-30T17:03:57.789 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.789 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.789 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.789 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.789 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732216+0000", 2023-09-30T17:03:57.789 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.71e-07 2023-09-30T17:03:57.789 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.789 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.789 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.789 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732231+0000", 2023-09-30T17:03:57.789 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5007e-05 2023-09-30T17:03:57.790 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.790 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.790 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.790 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732239+0000", 2023-09-30T17:03:57.790 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8509999999999999e-06 2023-09-30T17:03:57.790 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.790 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.790 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.790 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732244+0000", 2023-09-30T17:03:57.790 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2000000000000002e-06 2023-09-30T17:03:57.790 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.791 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.791 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:57.791 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732285+0000", 2023-09-30T17:03:57.791 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0877000000000002e-05 2023-09-30T17:03:57.791 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.791 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.791 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:57.791 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732331+0000", 2023-09-30T17:03:57.791 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5906999999999999e-05 2023-09-30T17:03:57.791 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.791 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.792 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:57.792 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732421+0000", 2023-09-30T17:03:57.792 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9993000000000004e-05 2023-09-30T17:03:57.792 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.792 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.792 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:57.792 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.737687+0000", 2023-09-30T17:03:57.792 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005265792 2023-09-30T17:03:57.792 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.792 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.792 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:57.793 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.961667+0000", 2023-09-30T17:03:57.793 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22398030799999999 2023-09-30T17:03:57.793 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.793 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.793 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:57.793 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.961703+0000", 2023-09-30T17:03:57.793 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5221e-05 2023-09-30T17:03:57.793 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.793 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.793 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:57.793 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.961734+0000", 2023-09-30T17:03:57.793 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.1582999999999999e-05 2023-09-30T17:03:57.794 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.794 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.794 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.794 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.794 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.794 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23780 4.36 4:6fa85f86:::100000001f8.00000013:head [write 3469312~4096,write 3522560~4096,write 3579904~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:57.794 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.735686+0000", 2023-09-30T17:03:57.794 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 18.998830870999999, 2023-09-30T17:03:57.794 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22921459399999999, 2023-09-30T17:03:57.794 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.794 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:57.795 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.795 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.795 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.795 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23780 2023-09-30T17:03:57.795 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.795 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.795 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.795 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.795 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.735686+0000", 2023-09-30T17:03:57.795 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.795 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.796 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.796 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.796 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.735686+0000", 2023-09-30T17:03:57.796 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.796 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.796 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.796 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.796 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.735687+0000", 2023-09-30T17:03:57.796 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3399999999999998e-07 2023-09-30T17:03:57.796 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.796 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.796 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.797 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.735701+0000", 2023-09-30T17:03:57.797 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4324999999999999e-05 2023-09-30T17:03:57.797 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.797 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.797 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.797 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.735713+0000", 2023-09-30T17:03:57.797 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1678999999999999e-05 2023-09-30T17:03:57.797 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.797 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.797 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.797 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.735720+0000", 2023-09-30T17:03:57.798 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8490000000000006e-06 2023-09-30T17:03:57.798 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.798 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.798 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:57.798 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.736637+0000", 2023-09-30T17:03:57.798 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00091620799999999995 2023-09-30T17:03:57.798 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.798 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.798 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:57.798 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.736719+0000", 2023-09-30T17:03:57.798 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2608999999999995e-05 2023-09-30T17:03:57.798 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.799 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.799 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:57.799 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.736876+0000", 2023-09-30T17:03:57.799 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015636799999999999 2023-09-30T17:03:57.799 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.799 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.799 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:57.799 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.742934+0000", 2023-09-30T17:03:57.799 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0060581619999999997 2023-09-30T17:03:57.799 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.799 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.800 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:57.800 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.964798+0000", 2023-09-30T17:03:57.800 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22186376599999999 2023-09-30T17:03:57.800 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.800 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.800 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:57.800 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.964859+0000", 2023-09-30T17:03:57.800 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1668000000000007e-05 2023-09-30T17:03:57.800 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.800 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.800 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:57.800 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.964900+0000", 2023-09-30T17:03:57.801 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1125999999999999e-05 2023-09-30T17:03:57.801 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.801 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.801 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.801 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.801 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.801 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23856 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 3538944~4096,write 3616768~4096,write 3686400~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:57.801 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.759274+0000", 2023-09-30T17:03:57.801 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 18.975242990000002, 2023-09-30T17:03:57.801 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.234084127, 2023-09-30T17:03:57.801 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.801 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:57.802 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.802 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.802 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.802 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23856 2023-09-30T17:03:57.802 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.802 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.802 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.802 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.802 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759274+0000", 2023-09-30T17:03:57.802 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.802 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.803 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.803 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.803 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759274+0000", 2023-09-30T17:03:57.803 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.803 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.803 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.803 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.803 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759274+0000", 2023-09-30T17:03:57.803 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7899999999999998e-07 2023-09-30T17:03:57.803 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.803 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.803 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.804 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759293+0000", 2023-09-30T17:03:57.804 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8410000000000002e-05 2023-09-30T17:03:57.804 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.804 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.804 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.804 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759302+0000", 2023-09-30T17:03:57.804 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8599999999999999e-06 2023-09-30T17:03:57.804 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.804 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.804 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.804 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759306+0000", 2023-09-30T17:03:57.805 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4499999999999997e-06 2023-09-30T17:03:57.805 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.805 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.805 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:57.805 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759984+0000", 2023-09-30T17:03:57.805 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00067830600000000005 2023-09-30T17:03:57.805 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.805 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.805 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:57.805 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.760041+0000", 2023-09-30T17:03:57.805 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.643e-05 2023-09-30T17:03:57.805 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.806 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.806 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:57.806 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.760135+0000", 2023-09-30T17:03:57.806 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3795999999999994e-05 2023-09-30T17:03:57.806 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.806 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.806 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:57.806 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764097+0000", 2023-09-30T17:03:57.806 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0039625629999999997 2023-09-30T17:03:57.806 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.806 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.806 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:57.807 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993282+0000", 2023-09-30T17:03:57.807 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22918461500000001 2023-09-30T17:03:57.807 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.807 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.807 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:57.807 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993320+0000", 2023-09-30T17:03:57.807 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8600999999999999e-05 2023-09-30T17:03:57.807 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.807 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.807 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:57.807 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993358+0000", 2023-09-30T17:03:57.808 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7517e-05 2023-09-30T17:03:57.808 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.808 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.808 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.808 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.808 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.808 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23865 4.36 4:6da220e6:::100000001f8.0000003f:head [write 3715072~4096,write 3850240~4096,write 4059136~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:57.808 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.761946+0000", 2023-09-30T17:03:57.808 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 18.972570505, 2023-09-30T17:03:57.808 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.231486097, 2023-09-30T17:03:57.808 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.808 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:57.809 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.809 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.809 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.809 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23865 2023-09-30T17:03:57.809 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.809 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.809 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.809 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.809 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.761946+0000", 2023-09-30T17:03:57.809 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.809 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.810 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.810 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.810 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.761946+0000", 2023-09-30T17:03:57.810 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.810 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.810 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.810 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.810 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.761947+0000", 2023-09-30T17:03:57.810 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7000000000000004e-07 2023-09-30T17:03:57.810 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.810 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.810 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.811 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.761959+0000", 2023-09-30T17:03:57.811 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2265e-05 2023-09-30T17:03:57.811 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.811 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.811 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.811 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.761970+0000", 2023-09-30T17:03:57.811 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0474e-05 2023-09-30T17:03:57.811 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.811 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.811 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.811 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.761976+0000", 2023-09-30T17:03:57.812 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1340000000000001e-06 2023-09-30T17:03:57.812 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.812 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.812 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:57.812 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.762063+0000", 2023-09-30T17:03:57.812 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.6728e-05 2023-09-30T17:03:57.812 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.812 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.812 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:57.812 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.762125+0000", 2023-09-30T17:03:57.812 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2869999999999999e-05 2023-09-30T17:03:57.812 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.813 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.813 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:57.813 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.762235+0000", 2023-09-30T17:03:57.813 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000109139 2023-09-30T17:03:57.813 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.813 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.813 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:57.813 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764102+0000", 2023-09-30T17:03:57.813 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001867121 2023-09-30T17:03:57.813 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.813 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.814 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:57.814 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993327+0000", 2023-09-30T17:03:57.814 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22922526800000001 2023-09-30T17:03:57.814 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.814 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.814 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:57.814 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993391+0000", 2023-09-30T17:03:57.814 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3839999999999999e-05 2023-09-30T17:03:57.814 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.814 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.814 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:57.814 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993432+0000", 2023-09-30T17:03:57.815 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1488e-05 2023-09-30T17:03:57.815 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.815 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.815 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.815 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.815 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.815 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23875 4.36 4:6da220e6:::100000001f8.0000003f:head [write 364544~4096,write 499712~4096,write 655360~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:57.815 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.764904+0000", 2023-09-30T17:03:57.815 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 18.969612321, 2023-09-30T17:03:57.815 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.228631693, 2023-09-30T17:03:57.815 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.815 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:57.816 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.816 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.816 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.816 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23875 2023-09-30T17:03:57.816 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.816 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.816 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.816 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.816 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764904+0000", 2023-09-30T17:03:57.816 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.816 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.817 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.817 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.817 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764904+0000", 2023-09-30T17:03:57.817 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.817 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.817 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.817 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.817 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764905+0000", 2023-09-30T17:03:57.817 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2799999999999995e-07 2023-09-30T17:03:57.817 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.817 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.817 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.818 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764915+0000", 2023-09-30T17:03:57.818 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8099999999999992e-06 2023-09-30T17:03:57.818 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.818 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.818 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.818 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764926+0000", 2023-09-30T17:03:57.818 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0858e-05 2023-09-30T17:03:57.818 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.818 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.818 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.818 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764931+0000", 2023-09-30T17:03:57.819 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2170000000000002e-06 2023-09-30T17:03:57.819 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.819 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.819 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:57.819 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764963+0000", 2023-09-30T17:03:57.819 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.2319e-05 2023-09-30T17:03:57.819 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.819 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.819 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:57.819 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.765009+0000", 2023-09-30T17:03:57.819 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5753000000000001e-05 2023-09-30T17:03:57.819 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.820 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.820 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:57.820 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.765093+0000", 2023-09-30T17:03:57.820 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4259999999999996e-05 2023-09-30T17:03:57.820 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.820 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.820 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:57.820 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766238+0000", 2023-09-30T17:03:57.820 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0011442550000000001 2023-09-30T17:03:57.820 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.820 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.821 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:57.821 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993469+0000", 2023-09-30T17:03:57.821 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22723121800000001 2023-09-30T17:03:57.821 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.821 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.821 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:57.821 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993501+0000", 2023-09-30T17:03:57.821 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.2576000000000001e-05 2023-09-30T17:03:57.821 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.821 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.821 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:57.821 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993536+0000", 2023-09-30T17:03:57.822 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4699000000000001e-05 2023-09-30T17:03:57.822 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.822 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.822 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.822 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.822 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.822 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23881 4.36 4:6da220e6:::100000001f8.0000003f:head [write 3366912~4096,write 3694592~4096,write 4071424~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:57.822 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.766444+0000", 2023-09-30T17:03:57.822 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 18.968072899999999, 2023-09-30T17:03:57.822 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23475070200000001, 2023-09-30T17:03:57.822 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.823 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:57.823 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.823 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.823 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.823 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23881 2023-09-30T17:03:57.823 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.823 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.823 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.823 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.823 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766444+0000", 2023-09-30T17:03:57.823 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.824 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.824 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.824 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.824 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766444+0000", 2023-09-30T17:03:57.824 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.824 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.824 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.824 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.824 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766444+0000", 2023-09-30T17:03:57.824 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3e-07 2023-09-30T17:03:57.824 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.824 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.825 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.825 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766455+0000", 2023-09-30T17:03:57.825 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0454e-05 2023-09-30T17:03:57.825 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.825 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.825 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.825 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766469+0000", 2023-09-30T17:03:57.825 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3568e-05 2023-09-30T17:03:57.825 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.825 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.825 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.826 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766474+0000", 2023-09-30T17:03:57.826 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1669999999999998e-06 2023-09-30T17:03:57.826 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.826 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.826 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:57.826 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766527+0000", 2023-09-30T17:03:57.826 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3650000000000003e-05 2023-09-30T17:03:57.826 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.826 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.826 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:57.826 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766611+0000", 2023-09-30T17:03:57.826 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3230000000000001e-05 2023-09-30T17:03:57.827 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.827 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.827 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:57.827 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766767+0000", 2023-09-30T17:03:57.827 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015688 2023-09-30T17:03:57.827 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.827 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.827 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:57.827 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.770254+0000", 2023-09-30T17:03:57.827 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0034870090000000001 2023-09-30T17:03:57.827 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.827 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.828 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:57.828 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.001100+0000", 2023-09-30T17:03:57.828 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23084518700000001 2023-09-30T17:03:57.828 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.828 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.828 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:57.828 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.001154+0000", 2023-09-30T17:03:57.828 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4453000000000002e-05 2023-09-30T17:03:57.828 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.828 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.828 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:57.829 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.001194+0000", 2023-09-30T17:03:57.829 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0373999999999997e-05 2023-09-30T17:03:57.829 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.829 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.829 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.829 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.829 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.829 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23901 4.6 4:63e80496:::100000001f8.0000001e:head [write 2617344~4096,write 2646016~4096,write 2662400~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:57.829 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.772204+0000", 2023-09-30T17:03:57.829 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 18.962312882999999, 2023-09-30T17:03:57.829 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.228858799, 2023-09-30T17:03:57.829 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.830 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:57.830 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.830 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.830 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.830 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23901 2023-09-30T17:03:57.830 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.830 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.830 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.830 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.830 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772204+0000", 2023-09-30T17:03:57.830 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.831 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.831 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.831 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.831 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772204+0000", 2023-09-30T17:03:57.831 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.831 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.831 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.831 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.831 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772205+0000", 2023-09-30T17:03:57.831 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3600000000000002e-07 2023-09-30T17:03:57.831 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.831 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.832 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.832 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772217+0000", 2023-09-30T17:03:57.832 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2459999999999999e-05 2023-09-30T17:03:57.832 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.832 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.832 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.832 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772228+0000", 2023-09-30T17:03:57.832 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0614e-05 2023-09-30T17:03:57.832 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.832 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.832 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.833 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772236+0000", 2023-09-30T17:03:57.833 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7610000000000007e-06 2023-09-30T17:03:57.833 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.833 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.833 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:57.833 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772280+0000", 2023-09-30T17:03:57.833 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4360000000000002e-05 2023-09-30T17:03:57.833 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.833 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.833 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:57.833 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772328+0000", 2023-09-30T17:03:57.834 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8041000000000003e-05 2023-09-30T17:03:57.834 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.834 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.834 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:57.834 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772417+0000", 2023-09-30T17:03:57.834 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9226000000000003e-05 2023-09-30T17:03:57.834 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.834 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.834 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:57.834 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.774997+0000", 2023-09-30T17:03:57.834 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0025795039999999998 2023-09-30T17:03:57.835 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.835 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.835 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:57.835 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.000979+0000", 2023-09-30T17:03:57.835 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22598211700000001 2023-09-30T17:03:57.835 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.835 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.835 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:57.835 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.001025+0000", 2023-09-30T17:03:57.835 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6347999999999997e-05 2023-09-30T17:03:57.835 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.836 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.836 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:57.836 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.001063+0000", 2023-09-30T17:03:57.836 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7431999999999997e-05 2023-09-30T17:03:57.836 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.836 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.836 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.836 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.836 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.836 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23924 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 1196032~4096,write 1249280~4096,write 1294336~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:57.836 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.778807+0000", 2023-09-30T17:03:57.837 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 18.955710023999998, 2023-09-30T17:03:57.837 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23068708600000001, 2023-09-30T17:03:57.837 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.837 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:57.837 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.837 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.837 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.837 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23924 2023-09-30T17:03:57.837 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.837 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.837 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.837 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.838 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778807+0000", 2023-09-30T17:03:57.838 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.838 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.838 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.838 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.838 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778807+0000", 2023-09-30T17:03:57.838 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.838 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.838 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.838 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.838 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778807+0000", 2023-09-30T17:03:57.839 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3600000000000003e-07 2023-09-30T17:03:57.839 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.839 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.839 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.839 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778832+0000", 2023-09-30T17:03:57.839 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4905999999999998e-05 2023-09-30T17:03:57.839 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.839 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.839 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.839 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778839+0000", 2023-09-30T17:03:57.839 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.097e-06 2023-09-30T17:03:57.839 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.840 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.840 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.840 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778843+0000", 2023-09-30T17:03:57.840 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8279999999999996e-06 2023-09-30T17:03:57.840 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.840 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.840 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:57.840 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778875+0000", 2023-09-30T17:03:57.840 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.1792000000000003e-05 2023-09-30T17:03:57.840 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.840 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.840 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:57.841 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778922+0000", 2023-09-30T17:03:57.841 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7034999999999999e-05 2023-09-30T17:03:57.841 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.841 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.841 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:57.841 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.779010+0000", 2023-09-30T17:03:57.841 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8305000000000002e-05 2023-09-30T17:03:57.841 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.841 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.841 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:57.841 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.781442+0000", 2023-09-30T17:03:57.842 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0024313550000000001 2023-09-30T17:03:57.842 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.842 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.842 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:57.842 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.009433+0000", 2023-09-30T17:03:57.842 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.227991044 2023-09-30T17:03:57.842 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.842 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.842 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:57.842 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.009471+0000", 2023-09-30T17:03:57.842 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8720999999999997e-05 2023-09-30T17:03:57.842 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.843 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.843 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:57.843 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.009494+0000", 2023-09-30T17:03:57.843 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2367000000000001e-05 2023-09-30T17:03:57.843 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.843 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.843 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.843 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.843 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.843 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23990 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 4157440~4096,write 4186112~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:57.843 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.798667+0000", 2023-09-30T17:03:57.843 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 18.935849509000001, 2023-09-30T17:03:57.844 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23029929399999999, 2023-09-30T17:03:57.844 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.844 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:57.844 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.844 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.844 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.844 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23990 2023-09-30T17:03:57.844 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.844 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.844 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.844 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.845 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798667+0000", 2023-09-30T17:03:57.845 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.845 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.845 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.845 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.845 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798667+0000", 2023-09-30T17:03:57.845 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.845 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.845 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.845 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.845 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798668+0000", 2023-09-30T17:03:57.845 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7000000000000005e-07 2023-09-30T17:03:57.846 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.846 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.846 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.846 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798675+0000", 2023-09-30T17:03:57.846 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1269999999999997e-06 2023-09-30T17:03:57.846 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.846 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.846 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.846 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798681+0000", 2023-09-30T17:03:57.849 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3500000000000002e-06 2023-09-30T17:03:57.849 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.849 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.849 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.849 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798685+0000", 2023-09-30T17:03:57.849 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.63e-06 2023-09-30T17:03:57.849 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.849 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.850 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:57.850 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798726+0000", 2023-09-30T17:03:57.850 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.163e-05 2023-09-30T17:03:57.850 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.850 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.850 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:57.850 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798790+0000", 2023-09-30T17:03:57.850 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3781999999999993e-05 2023-09-30T17:03:57.850 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.850 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.850 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:57.851 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798933+0000", 2023-09-30T17:03:57.851 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014272199999999999 2023-09-30T17:03:57.851 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.851 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.851 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:57.851 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.802788+0000", 2023-09-30T17:03:57.851 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.003855509 2023-09-30T17:03:57.851 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.851 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.851 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:57.851 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.028891+0000", 2023-09-30T17:03:57.851 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.226102847 2023-09-30T17:03:57.852 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.852 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.852 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:57.852 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.028945+0000", 2023-09-30T17:03:57.852 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3600000000000002e-05 2023-09-30T17:03:57.852 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.852 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.852 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:57.852 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.028966+0000", 2023-09-30T17:03:57.852 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1526999999999999e-05 2023-09-30T17:03:57.852 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.852 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.853 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.853 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.853 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.853 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23991 4.6 4:63e80496:::100000001f8.0000001e:head [write 327680~4096,write 335872~4096,write 491520~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:57.853 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.798864+0000", 2023-09-30T17:03:57.853 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 18.935652924999999, 2023-09-30T17:03:57.853 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23025762699999999, 2023-09-30T17:03:57.853 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.853 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:57.853 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.853 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.853 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.854 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23991 2023-09-30T17:03:57.854 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.854 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.854 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.854 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.854 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798864+0000", 2023-09-30T17:03:57.854 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.854 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.854 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.854 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.854 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798864+0000", 2023-09-30T17:03:57.854 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.855 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.855 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.855 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.855 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798864+0000", 2023-09-30T17:03:57.855 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3099999999999998e-07 2023-09-30T17:03:57.855 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.855 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.855 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.855 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798873+0000", 2023-09-30T17:03:57.855 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4789999999999996e-06 2023-09-30T17:03:57.855 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.855 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.856 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.856 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798878+0000", 2023-09-30T17:03:57.856 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6579999999999999e-06 2023-09-30T17:03:57.856 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.856 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.856 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.856 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798882+0000", 2023-09-30T17:03:57.856 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.985e-06 2023-09-30T17:03:57.856 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.856 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.856 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:57.856 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.799659+0000", 2023-09-30T17:03:57.857 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00077693900000000004 2023-09-30T17:03:57.857 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.857 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.857 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:57.857 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.799712+0000", 2023-09-30T17:03:57.857 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2694000000000001e-05 2023-09-30T17:03:57.857 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.857 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.857 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:57.857 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.799796+0000", 2023-09-30T17:03:57.857 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3943999999999995e-05 2023-09-30T17:03:57.857 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.858 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.858 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:57.858 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.802821+0000", 2023-09-30T17:03:57.858 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0030251850000000001 2023-09-30T17:03:57.858 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.858 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.858 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:57.858 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.029027+0000", 2023-09-30T17:03:57.858 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22620609999999999 2023-09-30T17:03:57.858 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.858 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.858 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:57.859 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.029083+0000", 2023-09-30T17:03:57.859 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5926e-05 2023-09-30T17:03:57.859 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.859 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.859 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:57.859 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.029121+0000", 2023-09-30T17:03:57.859 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8186000000000003e-05 2023-09-30T17:03:57.859 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.859 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.859 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.859 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.860 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.860 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:24052 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 3448832~4096,write 3493888~4096,write 3502080~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:57.860 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.817515+0000", 2023-09-30T17:03:57.860 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 18.917001615, 2023-09-30T17:03:57.860 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23184106800000001, 2023-09-30T17:03:57.860 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.860 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:57.860 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.860 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.860 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.860 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 24052 2023-09-30T17:03:57.860 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.861 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.861 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.861 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.861 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.817515+0000", 2023-09-30T17:03:57.861 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.861 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.861 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.861 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.861 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.817515+0000", 2023-09-30T17:03:57.861 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.861 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.861 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.862 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.862 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.817516+0000", 2023-09-30T17:03:57.862 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9899999999999999e-07 2023-09-30T17:03:57.862 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.862 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.862 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.862 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.817531+0000", 2023-09-30T17:03:57.862 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5483000000000001e-05 2023-09-30T17:03:57.862 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.862 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.862 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.862 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.817545+0000", 2023-09-30T17:03:57.863 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3209e-05 2023-09-30T17:03:57.863 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.863 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.863 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.863 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.817553+0000", 2023-09-30T17:03:57.863 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.994e-06 2023-09-30T17:03:57.863 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.863 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.863 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:57.863 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.818753+0000", 2023-09-30T17:03:57.863 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0012000909999999999 2023-09-30T17:03:57.863 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.864 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.864 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:57.864 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.818838+0000", 2023-09-30T17:03:57.864 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5389999999999994e-05 2023-09-30T17:03:57.864 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.864 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.864 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:57.864 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.818996+0000", 2023-09-30T17:03:57.864 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000158116 2023-09-30T17:03:57.864 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.864 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.864 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:57.865 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.822334+0000", 2023-09-30T17:03:57.865 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0033373230000000001 2023-09-30T17:03:57.865 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.865 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.865 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:57.865 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049259+0000", 2023-09-30T17:03:57.865 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22692517400000001 2023-09-30T17:03:57.865 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.865 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.865 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:57.865 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049323+0000", 2023-09-30T17:03:57.865 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4348000000000001e-05 2023-09-30T17:03:57.866 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.866 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.866 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:57.866 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049356+0000", 2023-09-30T17:03:57.866 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3040999999999998e-05 2023-09-30T17:03:57.866 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.866 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.866 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.866 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.866 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.866 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:24058 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 172032~4096,write 200704~4096,write 249856~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:57.867 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.819363+0000", 2023-09-30T17:03:57.867 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 18.915154138999998, 2023-09-30T17:03:57.867 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23030741099999999, 2023-09-30T17:03:57.867 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.867 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:57.867 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.867 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.867 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.867 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 24058 2023-09-30T17:03:57.867 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.867 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.867 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.868 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.868 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819363+0000", 2023-09-30T17:03:57.868 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.868 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.868 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.868 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.868 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819363+0000", 2023-09-30T17:03:57.868 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.868 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.868 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.868 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.868 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819363+0000", 2023-09-30T17:03:57.869 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8400000000000003e-07 2023-09-30T17:03:57.869 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.869 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.869 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.869 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819373+0000", 2023-09-30T17:03:57.869 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.9930000000000007e-06 2023-09-30T17:03:57.869 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.869 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.869 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.869 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819383+0000", 2023-09-30T17:03:57.869 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.4059999999999994e-06 2023-09-30T17:03:57.869 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.870 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.870 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.870 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819388+0000", 2023-09-30T17:03:57.870 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3299999999999998e-06 2023-09-30T17:03:57.870 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.870 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.870 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:57.870 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819584+0000", 2023-09-30T17:03:57.870 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00019642600000000001 2023-09-30T17:03:57.870 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.870 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.871 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:57.871 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819627+0000", 2023-09-30T17:03:57.871 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2150999999999997e-05 2023-09-30T17:03:57.871 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.871 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.871 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:57.871 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819712+0000", 2023-09-30T17:03:57.871 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5255999999999998e-05 2023-09-30T17:03:57.871 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.871 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.871 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:57.872 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.822340+0000", 2023-09-30T17:03:57.872 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0026283029999999998 2023-09-30T17:03:57.872 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.872 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.872 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:57.872 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049621+0000", 2023-09-30T17:03:57.872 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.227281176 2023-09-30T17:03:57.872 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.872 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.872 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:57.872 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049652+0000", 2023-09-30T17:03:57.872 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0528000000000003e-05 2023-09-30T17:03:57.873 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.873 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.873 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:57.873 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049670+0000", 2023-09-30T17:03:57.873 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8057999999999999e-05 2023-09-30T17:03:57.873 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.873 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.873 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.873 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.873 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.873 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:24064 4.6 4:616d4c41:::100000001f8.00000034:head [write 4132864~4096,write 4173824~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:03:57.873 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.820931+0000", 2023-09-30T17:03:57.874 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 18.913585778000002, 2023-09-30T17:03:57.874 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22854920400000001, 2023-09-30T17:03:57.874 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:03:57.874 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:03:57.874 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:03:57.874 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:03:57.874 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:57.874 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 24064 2023-09-30T17:03:57.874 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.874 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:03:57.874 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.875 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:03:57.875 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.820931+0000", 2023-09-30T17:03:57.875 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.875 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.875 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.875 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:03:57.875 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.820931+0000", 2023-09-30T17:03:57.875 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:03:57.875 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.875 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.875 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:03:57.875 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.820932+0000", 2023-09-30T17:03:57.876 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4300000000000002e-07 2023-09-30T17:03:57.876 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.876 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.876 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:03:57.876 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.820941+0000", 2023-09-30T17:03:57.876 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.5650000000000007e-06 2023-09-30T17:03:57.876 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.876 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.876 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:03:57.876 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.820952+0000", 2023-09-30T17:03:57.876 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0566e-05 2023-09-30T17:03:57.877 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.877 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.877 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:03:57.877 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.820957+0000", 2023-09-30T17:03:57.877 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3800000000000002e-06 2023-09-30T17:03:57.877 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.877 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.877 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:03:57.877 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.821008+0000", 2023-09-30T17:03:57.877 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1070999999999999e-05 2023-09-30T17:03:57.877 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.877 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.878 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:03:57.878 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.821075+0000", 2023-09-30T17:03:57.878 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.648e-05 2023-09-30T17:03:57.878 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.878 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.878 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:03:57.878 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.821236+0000", 2023-09-30T17:03:57.878 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016120899999999999 2023-09-30T17:03:57.878 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.878 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.878 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:03:57.878 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.823356+0000", 2023-09-30T17:03:57.879 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.002120458 2023-09-30T17:03:57.879 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.879 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.879 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:03:57.879 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049389+0000", 2023-09-30T17:03:57.879 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22603278199999999 2023-09-30T17:03:57.879 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.879 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.879 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:03:57.879 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049443+0000", 2023-09-30T17:03:57.879 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4033000000000003e-05 2023-09-30T17:03:57.880 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:03:57.880 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:03:57.880 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:03:57.880 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049480+0000", 2023-09-30T17:03:57.880 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6816999999999997e-05 2023-09-30T17:03:57.880 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.880 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.880 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.880 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:03:57.880 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:03:57.880 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:03:57.881 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:57.736+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:57.882 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:03:57.922 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:57.922+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:57.984 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:57.983+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:58.085 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~71s 2023-09-30T17:03:58.085 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:58.085+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:58.094 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:03:58.094 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2023-09-30T17:03:58.094 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.094 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:77270 4.28 e47/17 4:15eeb89b:::100000001f8.00000032:head v 47'2392, mlcod=47'2388)", 2023-09-30T17:03:58.094 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:58.076447+0000", 2023-09-30T17:03:58.094 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.013002401, 2023-09-30T17:03:58.094 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013022334999999999, 2023-09-30T17:03:58.095 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:58.095 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:58.095 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:58.095 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.095 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:58.095 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.076447+0000", 2023-09-30T17:03:58.095 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.095 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.095 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.095 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:58.095 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.076447+0000", 2023-09-30T17:03:58.096 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.096 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.096 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.096 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:58.096 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.076447+0000", 2023-09-30T17:03:58.096 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.72e-07 2023-09-30T17:03:58.096 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.096 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.096 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:58.097 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.076460+0000", 2023-09-30T17:03:58.097 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3271999999999999e-05 2023-09-30T17:03:58.097 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.097 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.097 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:58.097 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.076468+0000", 2023-09-30T17:03:58.097 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0909999999999993e-06 2023-09-30T17:03:58.097 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.098 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.098 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:58.098 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.076475+0000", 2023-09-30T17:03:58.098 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6449999999999999e-06 2023-09-30T17:03:58.098 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.098 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.098 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:58.099 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.081274+0000", 2023-09-30T17:03:58.099 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047993319999999999 2023-09-30T17:03:58.099 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.099 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.099 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:58.099 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.081297+0000", 2023-09-30T17:03:58.099 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3153999999999999e-05 2023-09-30T17:03:58.099 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.100 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:58.100 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.100 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.100 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.100 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:77169 4.2f 4:f59f865b:::100000001f8.00000007:head [write 552960~4096 in=4096b,write 638976~4096 in=4096b,write 774144~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:58.100 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:58.041269+0000", 2023-09-30T17:03:58.100 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.048180294999999998, 2023-09-30T17:03:58.101 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048261248, 2023-09-30T17:03:58.101 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:58.101 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:58.101 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:58.101 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:58.101 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:58.101 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 77169 2023-09-30T17:03:58.102 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.102 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:58.102 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.102 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:58.102 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.041269+0000", 2023-09-30T17:03:58.102 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.102 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.102 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.102 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:58.102 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.041269+0000", 2023-09-30T17:03:58.103 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.103 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.103 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.103 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:58.103 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.041270+0000", 2023-09-30T17:03:58.103 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.173e-06 2023-09-30T17:03:58.103 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.103 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.103 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:58.103 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.041285+0000", 2023-09-30T17:03:58.103 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4905999999999999e-05 2023-09-30T17:03:58.104 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.104 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.104 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:58.104 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.041293+0000", 2023-09-30T17:03:58.104 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1839999999999999e-06 2023-09-30T17:03:58.104 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.104 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.104 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:58.104 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.041299+0000", 2023-09-30T17:03:58.104 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5459999999999997e-06 2023-09-30T17:03:58.104 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.104 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.105 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:58.105 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.065554+0000", 2023-09-30T17:03:58.105 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.024254173 2023-09-30T17:03:58.105 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.105 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.105 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:58.105 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.065643+0000", 2023-09-30T17:03:58.105 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8922e-05 2023-09-30T17:03:58.105 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.105 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.105 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:58.105 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.065798+0000", 2023-09-30T17:03:58.105 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015536400000000001 2023-09-30T17:03:58.106 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.106 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.106 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:58.106 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.078960+0000", 2023-09-30T17:03:58.106 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013162032000000001 2023-09-30T17:03:58.106 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.106 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:58.106 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.106 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.106 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.106 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:77272 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:58.107 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:58.076599+0000", 2023-09-30T17:03:58.107 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.012850299000000001, 2023-09-30T17:03:58.107 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012984997, 2023-09-30T17:03:58.107 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:58.107 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:58.107 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:58.107 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:58.107 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:58.107 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 77272 2023-09-30T17:03:58.107 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.107 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:58.107 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.108 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:58.108 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.076599+0000", 2023-09-30T17:03:58.108 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.108 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.108 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.108 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:58.108 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.076599+0000", 2023-09-30T17:03:58.108 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.108 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.108 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.108 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:58.109 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.076599+0000", 2023-09-30T17:03:58.109 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9599999999999999e-07 2023-09-30T17:03:58.109 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.109 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.109 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:58.109 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.076612+0000", 2023-09-30T17:03:58.109 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2368000000000001e-05 2023-09-30T17:03:58.109 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.109 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.109 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:58.109 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.076623+0000", 2023-09-30T17:03:58.110 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0882e-05 2023-09-30T17:03:58.110 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.110 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.110 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:58.110 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.076629+0000", 2023-09-30T17:03:58.110 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0510000000000002e-06 2023-09-30T17:03:58.110 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.110 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:58.110 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.110 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.110 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.111 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:77208 4.2f 4:f59f865b:::100000001f8.00000007:head [write 860160~4096 in=4096b,write 880640~4096 in=4096b,write 925696~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:58.111 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:58.053555+0000", 2023-09-30T17:03:58.111 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.035893921000000002, 2023-09-30T17:03:58.111 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.036097747999999999, 2023-09-30T17:03:58.111 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:58.111 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:58.111 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:58.111 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:58.111 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:58.111 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 77208 2023-09-30T17:03:58.111 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.112 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:58.112 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.112 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:58.112 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.053555+0000", 2023-09-30T17:03:58.112 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.112 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.112 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.112 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:58.112 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.053555+0000", 2023-09-30T17:03:58.112 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.112 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.113 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.113 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:58.113 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.053556+0000", 2023-09-30T17:03:58.113 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1100000000000004e-07 2023-09-30T17:03:58.113 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.113 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.113 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:58.113 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.053567+0000", 2023-09-30T17:03:58.113 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1045e-05 2023-09-30T17:03:58.114 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.114 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.114 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:58.114 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.053578+0000", 2023-09-30T17:03:58.115 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0631999999999999e-05 2023-09-30T17:03:58.115 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.115 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.115 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:58.116 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.053585+0000", 2023-09-30T17:03:58.116 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7659999999999998e-06 2023-09-30T17:03:58.116 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.116 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.116 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:58.116 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.078991+0000", 2023-09-30T17:03:58.116 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.025405753 2023-09-30T17:03:58.116 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.116 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.117 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:58.117 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.079142+0000", 2023-09-30T17:03:58.117 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000151142 2023-09-30T17:03:58.117 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.117 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.117 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:58.117 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.079230+0000", 2023-09-30T17:03:58.117 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7639000000000006e-05 2023-09-30T17:03:58.117 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.118 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.118 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:58.118 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.089516+0000", 2023-09-30T17:03:58.118 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010285871 2023-09-30T17:03:58.118 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.118 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:58.118 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.118 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.118 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.119 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:77274 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:58.119 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:58.077233+0000", 2023-09-30T17:03:58.119 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.012215681000000001, 2023-09-30T17:03:58.119 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012658478000000001, 2023-09-30T17:03:58.119 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:58.119 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:58.119 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:58.119 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:58.119 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:58.119 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 77274 2023-09-30T17:03:58.120 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.120 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:58.120 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.120 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:58.120 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.077233+0000", 2023-09-30T17:03:58.120 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.120 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.120 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.120 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:58.120 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.077233+0000", 2023-09-30T17:03:58.120 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.121 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.121 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.121 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:58.121 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.077234+0000", 2023-09-30T17:03:58.121 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3799999999999996e-07 2023-09-30T17:03:58.121 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.121 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.121 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:58.121 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.077250+0000", 2023-09-30T17:03:58.121 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5616000000000001e-05 2023-09-30T17:03:58.122 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.122 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.122 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:58.122 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.077262+0000", 2023-09-30T17:03:58.122 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2551999999999999e-05 2023-09-30T17:03:58.122 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.122 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.123 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:58.123 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.077269+0000", 2023-09-30T17:03:58.123 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8329999999999996e-06 2023-09-30T17:03:58.123 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.123 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:58.123 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.123 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.123 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.123 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:77173 4.f 4:f26fdfa9:::100000001f8.00000002:head [write 2572288~4096 in=4096b,write 2674688~4096 in=4096b,write 2826240~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:58.123 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:58.042366+0000", 2023-09-30T17:03:58.124 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.047082709, 2023-09-30T17:03:58.124 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.047590135999999998, 2023-09-30T17:03:58.124 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:58.124 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:58.124 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:58.124 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:58.124 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:58.125 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 77173 2023-09-30T17:03:58.125 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.125 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:58.125 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.125 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:58.125 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.042366+0000", 2023-09-30T17:03:58.125 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.125 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.125 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.125 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:58.126 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.042366+0000", 2023-09-30T17:03:58.126 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.126 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.126 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.126 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:58.126 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.042367+0000", 2023-09-30T17:03:58.126 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6300000000000004e-07 2023-09-30T17:03:58.126 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.127 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.127 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:58.127 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.042383+0000", 2023-09-30T17:03:58.127 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5395000000000001e-05 2023-09-30T17:03:58.127 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.127 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.127 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:58.127 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.042391+0000", 2023-09-30T17:03:58.128 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9029999999999993e-06 2023-09-30T17:03:58.128 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.128 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.128 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:58.128 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.042398+0000", 2023-09-30T17:03:58.128 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8789999999999997e-06 2023-09-30T17:03:58.128 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.128 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.128 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:58.129 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.069160+0000", 2023-09-30T17:03:58.129 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.026761536999999998 2023-09-30T17:03:58.129 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.129 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.129 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:58.129 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.069274+0000", 2023-09-30T17:03:58.129 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000114301 2023-09-30T17:03:58.129 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.129 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.129 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:58.130 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.069408+0000", 2023-09-30T17:03:58.130 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013432599999999999 2023-09-30T17:03:58.130 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.130 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.130 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:58.130 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.087112+0000", 2023-09-30T17:03:58.130 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017703862000000001 2023-09-30T17:03:58.130 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.131 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:58.131 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.131 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.131 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.131 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:77276 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:58.131 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:58.077734+0000", 2023-09-30T17:03:58.132 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.011715433000000001, 2023-09-30T17:03:58.132 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012300708, 2023-09-30T17:03:58.132 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:58.132 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:58.132 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:58.132 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:58.132 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:58.132 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 77276 2023-09-30T17:03:58.132 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.133 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:58.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.133 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:58.133 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.077734+0000", 2023-09-30T17:03:58.133 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.133 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.133 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:58.133 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.077734+0000", 2023-09-30T17:03:58.134 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.134 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.134 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.134 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:58.134 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.077735+0000", 2023-09-30T17:03:58.134 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8700000000000004e-07 2023-09-30T17:03:58.134 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.134 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.134 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:58.135 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.077752+0000", 2023-09-30T17:03:58.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7263999999999999e-05 2023-09-30T17:03:58.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.135 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.135 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:58.135 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.077763+0000", 2023-09-30T17:03:58.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0974e-05 2023-09-30T17:03:58.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.135 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.135 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:58.136 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.077771+0000", 2023-09-30T17:03:58.136 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8040000000000002e-06 2023-09-30T17:03:58.136 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.136 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:58.136 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.136 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.136 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.136 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:77278 4.38 4:1dcf718c:::100000001f8.00000022:head [write 45056~4096 in=4096b,write 106496~4096 in=4096b,write 212992~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:58.136 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:58.078362+0000", 2023-09-30T17:03:58.136 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.011086718000000001, 2023-09-30T17:03:58.137 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.01173273, 2023-09-30T17:03:58.137 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:58.137 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:58.137 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:58.137 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:58.137 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:58.137 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 77278 2023-09-30T17:03:58.137 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.137 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:58.137 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.137 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:58.138 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.078362+0000", 2023-09-30T17:03:58.138 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.138 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.138 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.138 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:58.138 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.078362+0000", 2023-09-30T17:03:58.138 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.138 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.138 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.138 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:58.138 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.078363+0000", 2023-09-30T17:03:58.139 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2999999999999999e-07 2023-09-30T17:03:58.139 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.139 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.139 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:58.139 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.078375+0000", 2023-09-30T17:03:58.139 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.218e-05 2023-09-30T17:03:58.139 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.139 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.139 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:58.139 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.078387+0000", 2023-09-30T17:03:58.139 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1942e-05 2023-09-30T17:03:58.140 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.140 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.140 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:58.140 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.078395+0000", 2023-09-30T17:03:58.140 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0779999999999996e-06 2023-09-30T17:03:58.140 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.140 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.140 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:58.140 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.087859+0000", 2023-09-30T17:03:58.140 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0094639689999999992 2023-09-30T17:03:58.141 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.141 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.141 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:58.141 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.087933+0000", 2023-09-30T17:03:58.141 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3659999999999996e-05 2023-09-30T17:03:58.141 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.141 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:58.141 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.141 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.142 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.142 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:77238 4.38 4:1dcf718c:::100000001f8.00000022:head [write 155648~8192 in=8192b,write 401408~4096 in=4096b,write 466944~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:58.142 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:58.067759+0000", 2023-09-30T17:03:58.142 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.021690141, 2023-09-30T17:03:58.142 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022407020999999999, 2023-09-30T17:03:58.142 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:58.142 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:58.142 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:58.142 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:58.142 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:58.142 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 77238 2023-09-30T17:03:58.142 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.143 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:58.143 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.143 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:58.143 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.067759+0000", 2023-09-30T17:03:58.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.143 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.143 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.143 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:58.143 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.067759+0000", 2023-09-30T17:03:58.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.143 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.143 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.144 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:58.144 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.067760+0000", 2023-09-30T17:03:58.144 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.037e-06 2023-09-30T17:03:58.144 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.144 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.144 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:58.144 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.067778+0000", 2023-09-30T17:03:58.144 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8087000000000001e-05 2023-09-30T17:03:58.144 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.144 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.145 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:58.145 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.067786+0000", 2023-09-30T17:03:58.145 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0360000000000006e-06 2023-09-30T17:03:58.145 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.145 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.145 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:58.145 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.067794+0000", 2023-09-30T17:03:58.145 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0900000000000005e-06 2023-09-30T17:03:58.145 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.145 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.145 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:58.145 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.070207+0000", 2023-09-30T17:03:58.146 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002413133 2023-09-30T17:03:58.146 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.146 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.146 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:58.146 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.070292+0000", 2023-09-30T17:03:58.146 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4895000000000006e-05 2023-09-30T17:03:58.146 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.146 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:58.146 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.146 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.146 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.147 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:77239 4.38 4:1d13bf87:::100000001f8.00000030:head [write 679936~8192 in=8192b,write 716800~4096 in=4096b,write 798720~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:58.147 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:58.067805+0000", 2023-09-30T17:03:58.147 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.021643641000000002, 2023-09-30T17:03:58.147 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022429560000000001, 2023-09-30T17:03:58.147 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:58.147 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:58.147 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:58.147 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:58.147 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:58.147 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 77239 2023-09-30T17:03:58.147 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.147 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:58.148 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.148 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:58.148 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.067805+0000", 2023-09-30T17:03:58.148 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.148 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.148 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.148 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:58.148 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.067805+0000", 2023-09-30T17:03:58.148 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.148 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.148 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.148 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:58.149 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.067806+0000", 2023-09-30T17:03:58.149 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9900000000000001e-07 2023-09-30T17:03:58.149 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.149 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.149 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:58.149 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.067819+0000", 2023-09-30T17:03:58.149 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3317e-05 2023-09-30T17:03:58.149 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.149 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.149 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:58.149 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.067825+0000", 2023-09-30T17:03:58.149 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3489999999999997e-06 2023-09-30T17:03:58.150 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.150 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.150 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:58.150 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.067830+0000", 2023-09-30T17:03:58.150 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9389999999999996e-06 2023-09-30T17:03:58.150 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.150 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.150 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:58.150 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.075132+0000", 2023-09-30T17:03:58.150 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073010949999999996 2023-09-30T17:03:58.151 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.151 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.151 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:58.151 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.075215+0000", 2023-09-30T17:03:58.151 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3437999999999996e-05 2023-09-30T17:03:58.151 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.151 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:58.151 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.151 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.151 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.152 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:77241 4.f 4:f0d983b2:::100000001f8.0000001f:head [write 3358720~4096 in=4096b,write 3493888~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:58.152 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:58.067837+0000", 2023-09-30T17:03:58.152 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.021611742, 2023-09-30T17:03:58.152 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022465855, 2023-09-30T17:03:58.152 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:58.152 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:58.152 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:58.152 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:58.152 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:58.152 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 77241 2023-09-30T17:03:58.152 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.153 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:58.153 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.153 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:58.153 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.067837+0000", 2023-09-30T17:03:58.153 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.153 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.153 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.153 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:58.154 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.067837+0000", 2023-09-30T17:03:58.154 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.154 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.154 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.154 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:58.154 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.067838+0000", 2023-09-30T17:03:58.154 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2500000000000001e-07 2023-09-30T17:03:58.154 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.154 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.154 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:58.155 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.067849+0000", 2023-09-30T17:03:58.155 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1843e-05 2023-09-30T17:03:58.155 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.155 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.155 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:58.155 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.067857+0000", 2023-09-30T17:03:58.155 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1359999999999999e-06 2023-09-30T17:03:58.156 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.156 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.156 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:58.156 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.067862+0000", 2023-09-30T17:03:58.156 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2909999999999998e-06 2023-09-30T17:03:58.156 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.156 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.156 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:58.156 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.087150+0000", 2023-09-30T17:03:58.156 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019288026999999999 2023-09-30T17:03:58.157 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.157 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.157 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:58.157 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.087236+0000", 2023-09-30T17:03:58.157 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6353000000000005e-05 2023-09-30T17:03:58.157 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.157 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.157 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:58.158 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.087354+0000", 2023-09-30T17:03:58.158 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011733799999999999 2023-09-30T17:03:58.158 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.158 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:58.158 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.159 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.159 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.159 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:77284 4.36 e47/17 4:6c9c34b1:::100000001f8.00000010:head v 47'3648, mlcod=47'3644)", 2023-09-30T17:03:58.159 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:58.081210+0000", 2023-09-30T17:03:58.159 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0082392790000000004, 2023-09-30T17:03:58.159 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0091653010000000007, 2023-09-30T17:03:58.159 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:58.159 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:58.159 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:58.159 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.159 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:58.160 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.081210+0000", 2023-09-30T17:03:58.160 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.160 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.160 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.160 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:58.160 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.081210+0000", 2023-09-30T17:03:58.160 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.160 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.160 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.160 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:58.160 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.081210+0000", 2023-09-30T17:03:58.161 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4799999999999999e-07 2023-09-30T17:03:58.161 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.161 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.161 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:58.161 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.081223+0000", 2023-09-30T17:03:58.161 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3264e-05 2023-09-30T17:03:58.161 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.161 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.161 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:58.161 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.081232+0000", 2023-09-30T17:03:58.161 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5580000000000001e-06 2023-09-30T17:03:58.161 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.162 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.162 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:58.162 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.081239+0000", 2023-09-30T17:03:58.162 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9500000000000004e-06 2023-09-30T17:03:58.162 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.162 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.162 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:58.162 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.081555+0000", 2023-09-30T17:03:58.162 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00031605199999999999 2023-09-30T17:03:58.162 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.162 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.162 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:58.163 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.081573+0000", 2023-09-30T17:03:58.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7949e-05 2023-09-30T17:03:58.163 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.163 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:58.163 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.163 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.163 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.163 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:77242 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 1642496~4096 in=4096b,write 1675264~4096 in=4096b,write 1884160~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:58.163 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:58.067869+0000", 2023-09-30T17:03:58.163 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.021580248999999999, 2023-09-30T17:03:58.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022570590000000001, 2023-09-30T17:03:58.164 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:58.164 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:58.164 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:58.164 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:58.164 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:58.164 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 77242 2023-09-30T17:03:58.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.164 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:58.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.164 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:58.164 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.067869+0000", 2023-09-30T17:03:58.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.165 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.165 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:58.165 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.067869+0000", 2023-09-30T17:03:58.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.165 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.165 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.165 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:58.165 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.067869+0000", 2023-09-30T17:03:58.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1699999999999999e-07 2023-09-30T17:03:58.165 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.165 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.165 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:58.166 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.067880+0000", 2023-09-30T17:03:58.166 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0933e-05 2023-09-30T17:03:58.166 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.166 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:58.166 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.067886+0000", 2023-09-30T17:03:58.166 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3929999999999996e-06 2023-09-30T17:03:58.166 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.166 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:58.166 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.067892+0000", 2023-09-30T17:03:58.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.463e-06 2023-09-30T17:03:58.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.167 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:58.167 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.080912+0000", 2023-09-30T17:03:58.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013019798000000001 2023-09-30T17:03:58.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.167 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:58.167 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.080962+0000", 2023-09-30T17:03:58.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0096999999999998e-05 2023-09-30T17:03:58.168 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.168 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:58.168 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.168 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:77285 4.28 e47/17 4:15eeb89b:::100000001f8.00000032:head v 47'2393, mlcod=47'2388)", 2023-09-30T17:03:58.168 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:58.081531+0000", 2023-09-30T17:03:58.168 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0079183959999999994, 2023-09-30T17:03:58.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0089751180000000007, 2023-09-30T17:03:58.168 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:58.168 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:58.168 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:58.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:58.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.081531+0000", 2023-09-30T17:03:58.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:58.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.081531+0000", 2023-09-30T17:03:58.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:58.170 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.081531+0000", 2023-09-30T17:03:58.170 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6100000000000001e-07 2023-09-30T17:03:58.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.170 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:58.170 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.081547+0000", 2023-09-30T17:03:58.170 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5648e-05 2023-09-30T17:03:58.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.170 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:58.170 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.081555+0000", 2023-09-30T17:03:58.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4999999999999999e-06 2023-09-30T17:03:58.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:58.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.081562+0000", 2023-09-30T17:03:58.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7229999999999998e-06 2023-09-30T17:03:58.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:58.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.083725+0000", 2023-09-30T17:03:58.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0021632470000000001 2023-09-30T17:03:58.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.172 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:58.172 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.083743+0000", 2023-09-30T17:03:58.172 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7550999999999998e-05 2023-09-30T17:03:58.172 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.172 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:58.172 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.172 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:77282 4.2d 4:b4aa06e9:::100000001f8.0000001d:head [write 3776512~4096 in=4096b,write 3981312~4096 in=4096b,write 4108288~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:58.173 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:58.081589+0000", 2023-09-30T17:03:58.173 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0078601560000000001, 2023-09-30T17:03:58.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0089899200000000002, 2023-09-30T17:03:58.173 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:58.173 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:58.173 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:58.173 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:58.173 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:58.173 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 77282 2023-09-30T17:03:58.173 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.173 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:58.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:58.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.081589+0000", 2023-09-30T17:03:58.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:58.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.081589+0000", 2023-09-30T17:03:58.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:58.175 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.081590+0000", 2023-09-30T17:03:58.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.189e-06 2023-09-30T17:03:58.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.175 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:58.175 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.081600+0000", 2023-09-30T17:03:58.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0071999999999999e-05 2023-09-30T17:03:58.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.175 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:58.175 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.081608+0000", 2023-09-30T17:03:58.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1559999999999995e-06 2023-09-30T17:03:58.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:58.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.081615+0000", 2023-09-30T17:03:58.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.365e-06 2023-09-30T17:03:58.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:58.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.082735+0000", 2023-09-30T17:03:58.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001120219 2023-09-30T17:03:58.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.177 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:58.177 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.082808+0000", 2023-09-30T17:03:58.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3536999999999997e-05 2023-09-30T17:03:58.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.177 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:58.177 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.082957+0000", 2023-09-30T17:03:58.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000148178 2023-09-30T17:03:58.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.177 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:58.178 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.087817+0000", 2023-09-30T17:03:58.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0048605369999999998 2023-09-30T17:03:58.178 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.178 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:58.178 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.178 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.178 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.178 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:77287 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:58.178 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:58.081631+0000", 2023-09-30T17:03:58.178 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.007817994, 2023-09-30T17:03:58.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090245940000000004, 2023-09-30T17:03:58.178 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:58.179 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:58.179 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:58.179 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:58.179 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:58.179 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 77287 2023-09-30T17:03:58.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.179 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:58.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:58.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.081631+0000", 2023-09-30T17:03:58.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.180 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:58.180 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.081631+0000", 2023-09-30T17:03:58.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.180 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:58.180 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.081631+0000", 2023-09-30T17:03:58.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0699999999999997e-07 2023-09-30T17:03:58.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.180 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:58.181 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.081643+0000", 2023-09-30T17:03:58.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1759e-05 2023-09-30T17:03:58.181 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.181 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.181 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:58.181 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.081650+0000", 2023-09-30T17:03:58.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2019999999999998e-06 2023-09-30T17:03:58.181 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.181 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.181 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:58.181 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.081656+0000", 2023-09-30T17:03:58.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4949999999999999e-06 2023-09-30T17:03:58.182 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.182 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:58.182 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.182 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:77180 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 1359872~4096 in=4096b,write 1392640~4096 in=4096b,write 1404928~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:58.182 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:58.044398+0000", 2023-09-30T17:03:58.182 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.045050866000000002, 2023-09-30T17:03:58.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.046316372000000001, 2023-09-30T17:03:58.182 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:58.183 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:58.183 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:58.183 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:58.183 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:58.183 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 77180 2023-09-30T17:03:58.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.183 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:58.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:58.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.044398+0000", 2023-09-30T17:03:58.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.184 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:58.184 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.044398+0000", 2023-09-30T17:03:58.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.184 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:58.184 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.044399+0000", 2023-09-30T17:03:58.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.035e-06 2023-09-30T17:03:58.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.185 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:58.185 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.044409+0000", 2023-09-30T17:03:58.185 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0339999999999999e-05 2023-09-30T17:03:58.185 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.185 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.185 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:58.185 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.044420+0000", 2023-09-30T17:03:58.185 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0662000000000001e-05 2023-09-30T17:03:58.185 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.185 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.185 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:58.185 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.044428+0000", 2023-09-30T17:03:58.185 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4599999999999997e-06 2023-09-30T17:03:58.186 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.186 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.186 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:58.186 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.069176+0000", 2023-09-30T17:03:58.186 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.024748541999999998 2023-09-30T17:03:58.186 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.186 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.186 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:58.186 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.069292+0000", 2023-09-30T17:03:58.186 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000116326 2023-09-30T17:03:58.186 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:58.187 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.069457+0000", 2023-09-30T17:03:58.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016408300000000001 2023-09-30T17:03:58.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:58.187 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.089497+0000", 2023-09-30T17:03:58.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020040734000000001 2023-09-30T17:03:58.187 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.187 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:58.187 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.188 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:77217 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 3948544~4096 in=4096b,write 3989504~4096 in=4096b,write 4120576~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:58.188 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:58.058620+0000", 2023-09-30T17:03:58.188 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.030828857000000001, 2023-09-30T17:03:58.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.032174425, 2023-09-30T17:03:58.188 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:58.188 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:58.188 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:58.188 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:58.188 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:58.188 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 77217 2023-09-30T17:03:58.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.189 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:58.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:58.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.058620+0000", 2023-09-30T17:03:58.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:58.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.058620+0000", 2023-09-30T17:03:58.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.190 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:58.190 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.058621+0000", 2023-09-30T17:03:58.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1500000000000005e-07 2023-09-30T17:03:58.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.190 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:58.190 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.058633+0000", 2023-09-30T17:03:58.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.257e-05 2023-09-30T17:03:58.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.190 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:58.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.058641+0000", 2023-09-30T17:03:58.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8210000000000002e-06 2023-09-30T17:03:58.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.191 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:58.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.058647+0000", 2023-09-30T17:03:58.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0449999999999997e-06 2023-09-30T17:03:58.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.191 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:58.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.083234+0000", 2023-09-30T17:03:58.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.024587378999999999 2023-09-30T17:03:58.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:58.192 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.083317+0000", 2023-09-30T17:03:58.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2163999999999995e-05 2023-09-30T17:03:58.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:58.192 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.083482+0000", 2023-09-30T17:03:58.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000164902 2023-09-30T17:03:58.192 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.193 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:58.193 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.193 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:77289 4.38 4.9b7e3478 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:58.193 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:58.081664+0000", 2023-09-30T17:03:58.193 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0077849010000000003, 2023-09-30T17:03:58.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0091994639999999992, 2023-09-30T17:03:58.193 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:58.193 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:58.193 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:58.193 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:58.194 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:58.194 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 77289 2023-09-30T17:03:58.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.194 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:58.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:58.194 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.081664+0000", 2023-09-30T17:03:58.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:58.195 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.081664+0000", 2023-09-30T17:03:58.195 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.195 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.195 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.195 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:58.195 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.081664+0000", 2023-09-30T17:03:58.195 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2300000000000002e-07 2023-09-30T17:03:58.195 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.195 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.195 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:58.195 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.081674+0000", 2023-09-30T17:03:58.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4490000000000005e-06 2023-09-30T17:03:58.196 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.196 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.196 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:58.196 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.081680+0000", 2023-09-30T17:03:58.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6629999999999998e-06 2023-09-30T17:03:58.196 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.196 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.196 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:58.196 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.081685+0000", 2023-09-30T17:03:58.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3059999999999997e-06 2023-09-30T17:03:58.196 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.197 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:58.197 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.197 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.197 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:77181 4.f 4:f0d983b2:::100000001f8.0000001f:head [write 2465792~4096 in=4096b,write 2617344~4096 in=4096b,write 2625536~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:58.197 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:58.044600+0000", 2023-09-30T17:03:58.197 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.044849262000000001, 2023-09-30T17:03:58.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.046321029999999999, 2023-09-30T17:03:58.197 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:58.197 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:58.197 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:58.197 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:58.198 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:58.198 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 77181 2023-09-30T17:03:58.198 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.198 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:58.198 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.198 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:58.198 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.044600+0000", 2023-09-30T17:03:58.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.198 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.198 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.198 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:58.198 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.044600+0000", 2023-09-30T17:03:58.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:58.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.044600+0000", 2023-09-30T17:03:58.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3300000000000001e-07 2023-09-30T17:03:58.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:58.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.044611+0000", 2023-09-30T17:03:58.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0397999999999999e-05 2023-09-30T17:03:58.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:58.200 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.044620+0000", 2023-09-30T17:03:58.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4490000000000005e-06 2023-09-30T17:03:58.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:58.200 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.044627+0000", 2023-09-30T17:03:58.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0790000000000003e-06 2023-09-30T17:03:58.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.201 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:58.201 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.072142+0000", 2023-09-30T17:03:58.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.027514555999999999 2023-09-30T17:03:58.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.201 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:58.201 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.072218+0000", 2023-09-30T17:03:58.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5735999999999995e-05 2023-09-30T17:03:58.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.201 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:58.201 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.072362+0000", 2023-09-30T17:03:58.202 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014426099999999999 2023-09-30T17:03:58.202 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.202 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:58.202 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.087118+0000", 2023-09-30T17:03:58.202 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014756450000000001 2023-09-30T17:03:58.202 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.202 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:58.202 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.202 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.203 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:77221 4.f 4:f26fdfa9:::100000001f8.00000002:head [write 1155072~4096 in=4096b,write 1179648~4096 in=4096b,write 1298432~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:58.203 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:58.058656+0000", 2023-09-30T17:03:58.203 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.030793278, 2023-09-30T17:03:58.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.032362558999999999, 2023-09-30T17:03:58.203 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:58.203 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:58.203 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:58.203 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:58.203 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:58.203 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 77221 2023-09-30T17:03:58.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.203 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:58.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.204 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:58.204 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.058656+0000", 2023-09-30T17:03:58.204 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.204 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:58.204 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.058656+0000", 2023-09-30T17:03:58.204 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.204 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:58.205 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.058656+0000", 2023-09-30T17:03:58.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0800000000000005e-07 2023-09-30T17:03:58.205 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.205 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:58.205 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.058666+0000", 2023-09-30T17:03:58.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8320000000000001e-06 2023-09-30T17:03:58.205 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.205 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:58.205 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.058673+0000", 2023-09-30T17:03:58.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8499999999999996e-06 2023-09-30T17:03:58.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.206 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:58.206 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.058678+0000", 2023-09-30T17:03:58.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3809999999999998e-06 2023-09-30T17:03:58.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.206 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:58.206 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.083024+0000", 2023-09-30T17:03:58.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.024345663 2023-09-30T17:03:58.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.207 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:58.207 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.083107+0000", 2023-09-30T17:03:58.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2887999999999997e-05 2023-09-30T17:03:58.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.207 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:58.207 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.083382+0000", 2023-09-30T17:03:58.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00027524599999999999 2023-09-30T17:03:58.207 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.207 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:58.208 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.208 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.208 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:77280 4.14 e47/17 4:2b28d75f:::100000001f8.00000016:head v 47'1194, mlcod=47'1191)", 2023-09-30T17:03:58.208 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:58.081768+0000", 2023-09-30T17:03:58.208 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0076806970000000002, 2023-09-30T17:03:58.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0093238369999999998, 2023-09-30T17:03:58.208 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:58.208 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:58.208 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:58.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.208 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:58.209 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.081768+0000", 2023-09-30T17:03:58.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.209 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.209 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:58.209 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.081768+0000", 2023-09-30T17:03:58.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.209 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.209 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:58.209 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.081769+0000", 2023-09-30T17:03:58.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1300000000000001e-07 2023-09-30T17:03:58.210 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:58.210 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.081810+0000", 2023-09-30T17:03:58.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1294000000000001e-05 2023-09-30T17:03:58.210 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:58.210 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.081817+0000", 2023-09-30T17:03:58.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8719999999999996e-06 2023-09-30T17:03:58.210 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:58.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.081822+0000", 2023-09-30T17:03:58.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4190000000000001e-06 2023-09-30T17:03:58.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:58.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.081874+0000", 2023-09-30T17:03:58.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1459999999999999e-05 2023-09-30T17:03:58.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:58.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.081894+0000", 2023-09-30T17:03:58.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0123999999999999e-05 2023-09-30T17:03:58.212 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.212 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:58.212 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.212 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.212 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:77248 4.f 4:f2a80dfe:::100000001f8.00000019:head [write 2179072~4096 in=4096b,write 2314240~4096 in=4096b,write 2412544~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:58.212 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:58.069860+0000", 2023-09-30T17:03:58.212 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.019588673000000001, 2023-09-30T17:03:58.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021296532, 2023-09-30T17:03:58.212 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:58.212 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:58.213 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:58.213 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:58.213 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:58.213 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 77248 2023-09-30T17:03:58.213 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.213 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:58.213 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.213 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:58.213 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.069860+0000", 2023-09-30T17:03:58.213 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.213 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.214 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:58.214 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.069860+0000", 2023-09-30T17:03:58.214 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.214 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.214 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:58.214 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.069861+0000", 2023-09-30T17:03:58.214 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1799999999999995e-07 2023-09-30T17:03:58.214 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.215 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:58.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.069872+0000", 2023-09-30T17:03:58.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1275e-05 2023-09-30T17:03:58.215 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.215 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:58.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.069880+0000", 2023-09-30T17:03:58.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6869999999999994e-06 2023-09-30T17:03:58.215 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.215 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:58.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.069885+0000", 2023-09-30T17:03:58.216 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7319999999999998e-06 2023-09-30T17:03:58.216 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.216 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.216 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:58.216 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.089524+0000", 2023-09-30T17:03:58.216 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019639903 2023-09-30T17:03:58.216 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.216 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.216 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:58.216 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.089614+0000", 2023-09-30T17:03:58.216 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9450000000000006e-05 2023-09-30T17:03:58.216 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.217 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:58.217 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.089774+0000", 2023-09-30T17:03:58.217 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016053199999999999 2023-09-30T17:03:58.217 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.217 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:58.217 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.217 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.217 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:77249 4.2f 4:f59f865b:::100000001f8.00000007:head [write 131072~4096 in=4096b,write 151552~4096 in=4096b,write 249856~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:58.217 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:58.069891+0000", 2023-09-30T17:03:58.218 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.019558086999999998, 2023-09-30T17:03:58.218 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021342087999999999, 2023-09-30T17:03:58.218 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:58.218 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:58.218 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:58.218 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:58.218 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:58.218 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 77249 2023-09-30T17:03:58.218 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.218 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:58.218 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.219 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:58.219 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.069891+0000", 2023-09-30T17:03:58.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.219 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.219 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:58.219 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.069891+0000", 2023-09-30T17:03:58.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.219 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.219 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:58.219 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.069891+0000", 2023-09-30T17:03:58.220 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8299999999999998e-07 2023-09-30T17:03:58.220 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.220 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.220 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:58.220 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.069904+0000", 2023-09-30T17:03:58.220 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2257e-05 2023-09-30T17:03:58.220 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.220 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.220 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:58.220 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.069911+0000", 2023-09-30T17:03:58.220 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9130000000000003e-06 2023-09-30T17:03:58.220 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.221 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.221 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:58.221 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.069916+0000", 2023-09-30T17:03:58.221 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6129999999999997e-06 2023-09-30T17:03:58.221 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.221 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.221 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:58.221 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.089543+0000", 2023-09-30T17:03:58.221 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019626622999999999 2023-09-30T17:03:58.221 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.222 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.222 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:58.222 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.089616+0000", 2023-09-30T17:03:58.222 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3629999999999998e-05 2023-09-30T17:03:58.222 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.222 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.222 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:58.222 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.089755+0000", 2023-09-30T17:03:58.222 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013874199999999999 2023-09-30T17:03:58.222 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.222 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:58.223 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.223 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:77292 4.2d 4:b4aa06e9:::100000001f8.0000001d:head [write 3526656~4096 in=4096b,write 3743744~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:58.223 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:58.083546+0000", 2023-09-30T17:03:58.223 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.005902633, 2023-09-30T17:03:58.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0077642529999999996, 2023-09-30T17:03:58.223 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:58.223 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:58.223 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:58.223 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:58.224 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:58.224 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 77292 2023-09-30T17:03:58.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.224 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:58.224 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.224 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:58.224 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.083546+0000", 2023-09-30T17:03:58.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.224 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.224 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:58.224 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.083546+0000", 2023-09-30T17:03:58.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.225 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.225 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.225 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:58.225 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.083547+0000", 2023-09-30T17:03:58.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0219999999999999e-06 2023-09-30T17:03:58.225 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.225 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.225 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:58.225 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.083560+0000", 2023-09-30T17:03:58.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2544000000000001e-05 2023-09-30T17:03:58.226 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.226 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.226 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:58.226 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.083573+0000", 2023-09-30T17:03:58.226 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3073e-05 2023-09-30T17:03:58.226 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.226 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.226 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:58.226 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.083584+0000", 2023-09-30T17:03:58.226 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0737000000000001e-05 2023-09-30T17:03:58.226 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.226 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:58.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.084720+0000", 2023-09-30T17:03:58.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0011366830000000001 2023-09-30T17:03:58.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:58.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.084803+0000", 2023-09-30T17:03:58.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2538000000000002e-05 2023-09-30T17:03:58.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:58.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.084974+0000", 2023-09-30T17:03:58.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017130199999999999 2023-09-30T17:03:58.228 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.228 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:58.228 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.228 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.228 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.228 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:77293 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:58.228 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:58.083605+0000", 2023-09-30T17:03:58.228 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0058434760000000002, 2023-09-30T17:03:58.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0077921539999999999, 2023-09-30T17:03:58.228 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:58.229 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:58.229 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:58.229 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:58.229 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:58.229 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 77293 2023-09-30T17:03:58.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.229 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:58.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.229 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:58.229 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.083605+0000", 2023-09-30T17:03:58.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.230 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:58.230 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.083605+0000", 2023-09-30T17:03:58.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.230 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.230 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:58.230 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.083606+0000", 2023-09-30T17:03:58.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7700000000000004e-07 2023-09-30T17:03:58.230 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.230 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:58.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.083618+0000", 2023-09-30T17:03:58.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1790000000000001e-05 2023-09-30T17:03:58.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.231 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:58.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.083627+0000", 2023-09-30T17:03:58.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8410000000000006e-06 2023-09-30T17:03:58.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.231 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:58.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.083633+0000", 2023-09-30T17:03:58.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5810000000000002e-06 2023-09-30T17:03:58.232 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.232 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:58.232 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.232 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:77253 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:58.232 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:58.069977+0000", 2023-09-30T17:03:58.232 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.019471847, 2023-09-30T17:03:58.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021480170999999999, 2023-09-30T17:03:58.232 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:58.232 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:58.232 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:58.233 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:58.233 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:58.233 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 77253 2023-09-30T17:03:58.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.233 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:58.233 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.233 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:58.233 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.069977+0000", 2023-09-30T17:03:58.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.233 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.234 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:58.234 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.069977+0000", 2023-09-30T17:03:58.234 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.234 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.234 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.234 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:58.234 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.069978+0000", 2023-09-30T17:03:58.234 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0999999999999997e-07 2023-09-30T17:03:58.234 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.234 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.234 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:58.234 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.069993+0000", 2023-09-30T17:03:58.235 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4588e-05 2023-09-30T17:03:58.235 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.235 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.235 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:58.235 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.070002+0000", 2023-09-30T17:03:58.235 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1460000000000002e-06 2023-09-30T17:03:58.235 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.235 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.235 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:58.235 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.070540+0000", 2023-09-30T17:03:58.235 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00053852499999999998 2023-09-30T17:03:58.236 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.236 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:58.236 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.236 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.236 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.236 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:77286 4.36 e47/17 4:6fa85f86:::100000001f8.00000013:head v 47'3649, mlcod=47'3644)", 2023-09-30T17:03:58.236 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:58.083651+0000", 2023-09-30T17:03:58.236 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0057980280000000002, 2023-09-30T17:03:58.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0078708930000000003, 2023-09-30T17:03:58.236 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:58.236 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:58.236 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:58.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:58.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.083651+0000", 2023-09-30T17:03:58.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:58.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.083651+0000", 2023-09-30T17:03:58.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:58.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.083651+0000", 2023-09-30T17:03:58.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2199999999999999e-07 2023-09-30T17:03:58.238 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:58.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.083664+0000", 2023-09-30T17:03:58.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2320000000000001e-05 2023-09-30T17:03:58.238 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:58.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.083672+0000", 2023-09-30T17:03:58.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5890000000000003e-06 2023-09-30T17:03:58.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.239 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:58.239 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.083678+0000", 2023-09-30T17:03:58.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4890000000000003e-06 2023-09-30T17:03:58.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.239 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:58.239 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.083826+0000", 2023-09-30T17:03:58.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014815499999999999 2023-09-30T17:03:58.240 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.240 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.240 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:58.240 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.083845+0000", 2023-09-30T17:03:58.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8746e-05 2023-09-30T17:03:58.240 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.240 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:58.240 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.240 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.240 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.240 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:77254 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:58.241 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:58.070554+0000", 2023-09-30T17:03:58.241 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.018895097999999999, 2023-09-30T17:03:58.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021044533000000001, 2023-09-30T17:03:58.241 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:58.241 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:58.241 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:58.241 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:58.241 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:58.241 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 77254 2023-09-30T17:03:58.241 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.241 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:58.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:58.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.070554+0000", 2023-09-30T17:03:58.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:58.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.070554+0000", 2023-09-30T17:03:58.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:58.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.070555+0000", 2023-09-30T17:03:58.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7800000000000001e-07 2023-09-30T17:03:58.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:58.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.070569+0000", 2023-09-30T17:03:58.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4436e-05 2023-09-30T17:03:58.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:58.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.070579+0000", 2023-09-30T17:03:58.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0465999999999999e-05 2023-09-30T17:03:58.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:58.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.070586+0000", 2023-09-30T17:03:58.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9280000000000004e-06 2023-09-30T17:03:58.244 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.244 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:58.244 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.245 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:77288 4.19 e47/17 4:997b7129:::100000001f8.00000000:head v 47'2434, mlcod=47'2430)", 2023-09-30T17:03:58.245 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:58.083687+0000", 2023-09-30T17:03:58.245 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0057617900000000001, 2023-09-30T17:03:58.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0079757209999999999, 2023-09-30T17:03:58.245 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:58.245 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:58.245 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:58.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.245 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:58.245 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.083687+0000", 2023-09-30T17:03:58.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.246 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:58.246 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.083687+0000", 2023-09-30T17:03:58.246 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.246 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:58.246 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.083687+0000", 2023-09-30T17:03:58.246 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1399999999999998e-07 2023-09-30T17:03:58.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:58.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.083700+0000", 2023-09-30T17:03:58.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2848e-05 2023-09-30T17:03:58.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:58.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.083709+0000", 2023-09-30T17:03:58.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9020000000000005e-06 2023-09-30T17:03:58.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:58.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.083714+0000", 2023-09-30T17:03:58.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.198e-06 2023-09-30T17:03:58.248 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.248 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:58.248 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.083755+0000", 2023-09-30T17:03:58.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0148999999999998e-05 2023-09-30T17:03:58.248 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.248 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:58.248 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.083771+0000", 2023-09-30T17:03:58.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6307000000000002e-05 2023-09-30T17:03:58.249 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.249 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:58.249 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.249 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:77257 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:58.249 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:58.070629+0000", 2023-09-30T17:03:58.249 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.018820255000000001, 2023-09-30T17:03:58.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021113990999999999, 2023-09-30T17:03:58.249 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:58.249 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:58.249 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:58.250 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:58.250 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:58.250 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 77257 2023-09-30T17:03:58.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.250 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:58.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:58.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.070629+0000", 2023-09-30T17:03:58.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:58.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.070629+0000", 2023-09-30T17:03:58.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:58.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.070629+0000", 2023-09-30T17:03:58.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0399999999999996e-07 2023-09-30T17:03:58.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:58.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.070639+0000", 2023-09-30T17:03:58.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9850000000000001e-06 2023-09-30T17:03:58.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:58.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.070645+0000", 2023-09-30T17:03:58.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4040000000000003e-06 2023-09-30T17:03:58.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:58.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.070650+0000", 2023-09-30T17:03:58.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.31e-06 2023-09-30T17:03:58.253 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.253 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:58.253 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.253 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:77291 4.28 e47/17 4:15eeb89b:::100000001f8.00000032:head v 47'2394, mlcod=47'2388)", 2023-09-30T17:03:58.253 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:58.083749+0000", 2023-09-30T17:03:58.253 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0056997999999999997, 2023-09-30T17:03:58.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080586049999999999, 2023-09-30T17:03:58.253 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:58.254 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:58.254 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:58.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.254 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:58.254 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.083749+0000", 2023-09-30T17:03:58.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.254 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.254 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:58.254 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.083749+0000", 2023-09-30T17:03:58.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.254 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:58.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.083749+0000", 2023-09-30T17:03:58.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6800000000000002e-07 2023-09-30T17:03:58.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:58.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.083762+0000", 2023-09-30T17:03:58.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2663000000000001e-05 2023-09-30T17:03:58.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.257 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.257 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:58.257 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.083769+0000", 2023-09-30T17:03:58.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8580000000000002e-06 2023-09-30T17:03:58.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.257 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:58.258 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.083774+0000", 2023-09-30T17:03:58.258 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0830000000000003e-06 2023-09-30T17:03:58.258 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:58.258 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.085767+0000", 2023-09-30T17:03:58.258 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019925799999999999 2023-09-30T17:03:58.258 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:58.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.085787+0000", 2023-09-30T17:03:58.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0173000000000002e-05 2023-09-30T17:03:58.259 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.259 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:58.259 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.259 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:77297 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:58.259 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:58.084403+0000", 2023-09-30T17:03:58.259 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0050455639999999998, 2023-09-30T17:03:58.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0074752610000000004, 2023-09-30T17:03:58.259 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:58.260 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:58.260 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:58.260 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:58.260 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:58.260 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 77297 2023-09-30T17:03:58.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.260 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:58.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:58.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.084403+0000", 2023-09-30T17:03:58.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.261 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:58.261 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.084403+0000", 2023-09-30T17:03:58.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.261 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:58.261 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.084404+0000", 2023-09-30T17:03:58.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6000000000000002e-07 2023-09-30T17:03:58.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.262 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:58.262 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.084416+0000", 2023-09-30T17:03:58.262 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2160999999999999e-05 2023-09-30T17:03:58.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.262 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:58.262 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.084430+0000", 2023-09-30T17:03:58.262 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3864e-05 2023-09-30T17:03:58.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.262 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:58.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.084438+0000", 2023-09-30T17:03:58.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1089999999999998e-06 2023-09-30T17:03:58.263 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.263 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:58.263 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.263 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:77256 4.28 e47/17 4:153ae410:::100000001f8.0000003b:head v 47'2390, mlcod=47'2387)", 2023-09-30T17:03:58.263 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:58.070923+0000", 2023-09-30T17:03:58.263 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.018525850999999999, 2023-09-30T17:03:58.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021021496000000001, 2023-09-30T17:03:58.264 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:58.264 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:58.264 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:58.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:58.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.070923+0000", 2023-09-30T17:03:58.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:58.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.070923+0000", 2023-09-30T17:03:58.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:58.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.070923+0000", 2023-09-30T17:03:58.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7700000000000001e-07 2023-09-30T17:03:58.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:58.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.070933+0000", 2023-09-30T17:03:58.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5000000000000005e-06 2023-09-30T17:03:58.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.266 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.266 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:58.266 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.070939+0000", 2023-09-30T17:03:58.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5570000000000001e-06 2023-09-30T17:03:58.266 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.266 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.266 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:58.266 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.070945+0000", 2023-09-30T17:03:58.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4949999999999999e-06 2023-09-30T17:03:58.266 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.266 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.266 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:58.267 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.075426+0000", 2023-09-30T17:03:58.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004480782 2023-09-30T17:03:58.267 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.267 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:58.267 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.075445+0000", 2023-09-30T17:03:58.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9103e-05 2023-09-30T17:03:58.267 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.267 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:58.267 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.267 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.268 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:77299 4.29 4:94178d8a:::100000001f8.00000006:head [write 1306624~4096 in=4096b,write 1425408~4096 in=4096b,write 1445888~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:58.268 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:58.085076+0000", 2023-09-30T17:03:58.268 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0043728100000000004, 2023-09-30T17:03:58.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0069289260000000002, 2023-09-30T17:03:58.268 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:58.268 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:58.268 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:58.268 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:58.268 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:58.268 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 77299 2023-09-30T17:03:58.268 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.269 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:58.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.269 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:58.269 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.085076+0000", 2023-09-30T17:03:58.269 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.269 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.269 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:58.269 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.085076+0000", 2023-09-30T17:03:58.269 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.269 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.270 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:58.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.085077+0000", 2023-09-30T17:03:58.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2600000000000001e-07 2023-09-30T17:03:58.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.270 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:58.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.085095+0000", 2023-09-30T17:03:58.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7538e-05 2023-09-30T17:03:58.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.270 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:58.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.085105+0000", 2023-09-30T17:03:58.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0169999999999999e-05 2023-09-30T17:03:58.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:58.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.085113+0000", 2023-09-30T17:03:58.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.994e-06 2023-09-30T17:03:58.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:58.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.085894+0000", 2023-09-30T17:03:58.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00078086900000000001 2023-09-30T17:03:58.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.272 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:58.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.085971+0000", 2023-09-30T17:03:58.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7014999999999994e-05 2023-09-30T17:03:58.272 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.272 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:58.272 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.272 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.272 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:77300 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:58.272 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:58.085355+0000", 2023-09-30T17:03:58.272 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0040937980000000001, 2023-09-30T17:03:58.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0066893439999999998, 2023-09-30T17:03:58.273 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:58.273 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:58.273 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:58.273 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:58.273 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:58.273 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 77300 2023-09-30T17:03:58.273 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.273 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:58.273 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.273 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:58.274 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.085355+0000", 2023-09-30T17:03:58.274 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.274 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.274 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:58.274 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.085355+0000", 2023-09-30T17:03:58.274 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.274 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.274 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:58.274 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.085356+0000", 2023-09-30T17:03:58.274 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8899999999999998e-07 2023-09-30T17:03:58.275 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.275 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:58.275 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.085368+0000", 2023-09-30T17:03:58.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1517e-05 2023-09-30T17:03:58.275 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.275 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:58.275 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.085377+0000", 2023-09-30T17:03:58.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4290000000000007e-06 2023-09-30T17:03:58.275 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:58.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.085384+0000", 2023-09-30T17:03:58.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6209999999999998e-06 2023-09-30T17:03:58.276 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.276 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:58.276 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.276 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:77260 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:58.276 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:58.071733+0000", 2023-09-30T17:03:58.276 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.017715821, 2023-09-30T17:03:58.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020344134999999999, 2023-09-30T17:03:58.277 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:58.277 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:58.277 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:58.277 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:58.277 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:58.277 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 77260 2023-09-30T17:03:58.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.277 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:58.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:58.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.071733+0000", 2023-09-30T17:03:58.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:58.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.071733+0000", 2023-09-30T17:03:58.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:58.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.071734+0000", 2023-09-30T17:03:58.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1800000000000005e-07 2023-09-30T17:03:58.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:58.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.072147+0000", 2023-09-30T17:03:58.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00041274600000000002 2023-09-30T17:03:58.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:58.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.072159+0000", 2023-09-30T17:03:58.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1980999999999999e-05 2023-09-30T17:03:58.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:58.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.072169+0000", 2023-09-30T17:03:58.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0295000000000001e-05 2023-09-30T17:03:58.280 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.280 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:58.280 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.280 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:77294 4.28 e47/17 4:153ae410:::100000001f8.0000003b:head v 47'2395, mlcod=47'2388)", 2023-09-30T17:03:58.280 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:58.085636+0000", 2023-09-30T17:03:58.280 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0038134240000000002, 2023-09-30T17:03:58.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064932669999999996, 2023-09-30T17:03:58.280 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:58.281 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:58.281 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:58.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:58.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.085636+0000", 2023-09-30T17:03:58.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:58.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.085636+0000", 2023-09-30T17:03:58.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:58.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.085636+0000", 2023-09-30T17:03:58.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.37e-07 2023-09-30T17:03:58.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:58.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.085659+0000", 2023-09-30T17:03:58.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2405e-05 2023-09-30T17:03:58.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:58.283 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.085668+0000", 2023-09-30T17:03:58.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2769999999999994e-06 2023-09-30T17:03:58.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.283 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:58.283 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.085675+0000", 2023-09-30T17:03:58.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7510000000000002e-06 2023-09-30T17:03:58.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.283 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:58.283 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.087868+0000", 2023-09-30T17:03:58.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0021928109999999998 2023-09-30T17:03:58.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.284 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:58.284 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.087885+0000", 2023-09-30T17:03:58.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7464000000000001e-05 2023-09-30T17:03:58.284 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.284 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:58.284 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.284 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:77227 4.37 4:ef395e89:::100000001f8.00000020:head [write 262144~4096 in=4096b,write 270336~4096 in=4096b,write 442368~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:58.284 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:58.061618+0000", 2023-09-30T17:03:58.285 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.027830924, 2023-09-30T17:03:58.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.030548605, 2023-09-30T17:03:58.285 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:58.285 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:58.285 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:58.285 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:58.285 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:58.285 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 77227 2023-09-30T17:03:58.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.285 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:58.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:58.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.061618+0000", 2023-09-30T17:03:58.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:58.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.061618+0000", 2023-09-30T17:03:58.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:58.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.061619+0000", 2023-09-30T17:03:58.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9399999999999995e-07 2023-09-30T17:03:58.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:58.287 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.061629+0000", 2023-09-30T17:03:58.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0465000000000001e-05 2023-09-30T17:03:58.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:58.287 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.061636+0000", 2023-09-30T17:03:58.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0899999999999999e-06 2023-09-30T17:03:58.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:58.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.061642+0000", 2023-09-30T17:03:58.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8089999999999998e-06 2023-09-30T17:03:58.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:58.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.087158+0000", 2023-09-30T17:03:58.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.025516416 2023-09-30T17:03:58.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:58.289 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.087226+0000", 2023-09-30T17:03:58.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7287999999999997e-05 2023-09-30T17:03:58.293 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.293 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:58.293 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.087312+0000", 2023-09-30T17:03:58.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6761999999999994e-05 2023-09-30T17:03:58.294 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.294 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:58.294 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.294 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.294 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:77261 4.28 e47/17 4:153ae410:::100000001f8.0000003b:head v 47'2391, mlcod=47'2387)", 2023-09-30T17:03:58.294 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:58.072870+0000", 2023-09-30T17:03:58.294 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.016578621000000002, 2023-09-30T17:03:58.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019343463000000002, 2023-09-30T17:03:58.295 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:58.295 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:58.295 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:58.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:58.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.072870+0000", 2023-09-30T17:03:58.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:58.296 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.072870+0000", 2023-09-30T17:03:58.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.296 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:58.296 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.072871+0000", 2023-09-30T17:03:58.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0699999999999996e-07 2023-09-30T17:03:58.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:58.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.072953+0000", 2023-09-30T17:03:58.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1584999999999999e-05 2023-09-30T17:03:58.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:58.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.072964+0000", 2023-09-30T17:03:58.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0947e-05 2023-09-30T17:03:58.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:58.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.072971+0000", 2023-09-30T17:03:58.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2830000000000004e-06 2023-09-30T17:03:58.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:58.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.078786+0000", 2023-09-30T17:03:58.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0058154540000000003 2023-09-30T17:03:58.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.299 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:58.299 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.078806+0000", 2023-09-30T17:03:58.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9808000000000001e-05 2023-09-30T17:03:58.299 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.299 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:58.299 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.299 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.299 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:77301 4.14 e47/17 4:2b28d75f:::100000001f8.00000016:head v 47'1195, mlcod=47'1191)", 2023-09-30T17:03:58.299 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:58.086056+0000", 2023-09-30T17:03:58.299 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.003393114, 2023-09-30T17:03:58.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0061946919999999999, 2023-09-30T17:03:58.300 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:58.300 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:58.300 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:58.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.300 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:58.300 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.086056+0000", 2023-09-30T17:03:58.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.300 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:58.301 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.086056+0000", 2023-09-30T17:03:58.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:58.301 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.086056+0000", 2023-09-30T17:03:58.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6100000000000001e-07 2023-09-30T17:03:58.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:58.302 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.086069+0000", 2023-09-30T17:03:58.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2082999999999999e-05 2023-09-30T17:03:58.302 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:58.302 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.086076+0000", 2023-09-30T17:03:58.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5039999999999996e-06 2023-09-30T17:03:58.302 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:58.303 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.086082+0000", 2023-09-30T17:03:58.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0340000000000002e-06 2023-09-30T17:03:58.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.303 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:58.303 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.086133+0000", 2023-09-30T17:03:58.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0689000000000002e-05 2023-09-30T17:03:58.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.304 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:58.304 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.086151+0000", 2023-09-30T17:03:58.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8270999999999998e-05 2023-09-30T17:03:58.304 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.304 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:58.304 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.304 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.304 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:77196 4.37 4:ef395e89:::100000001f8.00000020:head [write 2473984~4096 in=4096b,write 2519040~4096 in=4096b,write 2531328~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:58.304 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:58.052103+0000", 2023-09-30T17:03:58.305 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.037345547, 2023-09-30T17:03:58.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040183166999999999, 2023-09-30T17:03:58.305 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:58.305 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:58.305 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:58.305 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:58.305 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:58.305 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 77196 2023-09-30T17:03:58.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.305 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:58.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:58.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.052103+0000", 2023-09-30T17:03:58.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:58.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.052103+0000", 2023-09-30T17:03:58.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:58.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.052105+0000", 2023-09-30T17:03:58.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.669e-06 2023-09-30T17:03:58.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:58.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.052122+0000", 2023-09-30T17:03:58.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6782e-05 2023-09-30T17:03:58.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:58.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.052135+0000", 2023-09-30T17:03:58.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3004e-05 2023-09-30T17:03:58.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.308 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:58.308 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.052143+0000", 2023-09-30T17:03:58.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1470000000000001e-06 2023-09-30T17:03:58.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.308 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:58.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.074537+0000", 2023-09-30T17:03:58.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022394071000000002 2023-09-30T17:03:58.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:58.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.074631+0000", 2023-09-30T17:03:58.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4017000000000005e-05 2023-09-30T17:03:58.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:58.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.074826+0000", 2023-09-30T17:03:58.310 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019445000000000001 2023-09-30T17:03:58.310 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.310 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.310 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:58.310 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.089504+0000", 2023-09-30T17:03:58.310 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014678326 2023-09-30T17:03:58.310 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.310 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:58.310 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.310 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.310 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.311 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:77265 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:58.311 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:58.073360+0000", 2023-09-30T17:03:58.311 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.016089431000000001, 2023-09-30T17:03:58.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018970897, 2023-09-30T17:03:58.311 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:58.311 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:58.311 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:58.311 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:58.311 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:58.311 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 77265 2023-09-30T17:03:58.311 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.311 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:58.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:58.312 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.073360+0000", 2023-09-30T17:03:58.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:58.312 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.073360+0000", 2023-09-30T17:03:58.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:58.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.073360+0000", 2023-09-30T17:03:58.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.02e-07 2023-09-30T17:03:58.313 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:58.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.073451+0000", 2023-09-30T17:03:58.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0350000000000001e-05 2023-09-30T17:03:58.313 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:58.314 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.073462+0000", 2023-09-30T17:03:58.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1187e-05 2023-09-30T17:03:58.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:58.314 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.073470+0000", 2023-09-30T17:03:58.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6170000000000001e-06 2023-09-30T17:03:58.314 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.314 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:58.314 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.315 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:77305 4.30 4.88c79130 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:58.315 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:58.087213+0000", 2023-09-30T17:03:58.315 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.002236306, 2023-09-30T17:03:58.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0051658420000000004, 2023-09-30T17:03:58.315 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:58.315 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:58.315 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:58.315 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:58.316 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:58.316 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 77305 2023-09-30T17:03:58.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.316 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:58.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:58.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.087213+0000", 2023-09-30T17:03:58.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:58.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.087213+0000", 2023-09-30T17:03:58.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.317 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:58.317 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.087214+0000", 2023-09-30T17:03:58.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.048e-06 2023-09-30T17:03:58.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.317 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:58.317 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.087229+0000", 2023-09-30T17:03:58.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5472e-05 2023-09-30T17:03:58.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:58.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.087239+0000", 2023-09-30T17:03:58.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9150000000000008e-06 2023-09-30T17:03:58.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:58.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.087247+0000", 2023-09-30T17:03:58.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6450000000000005e-06 2023-09-30T17:03:58.318 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.319 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:58.319 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.319 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:77306 4.11 4:8be3ecac:::100000001f8.00000005:head [write 4149248~4096 in=4096b,write 4161536~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:58.319 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:58.087388+0000", 2023-09-30T17:03:58.319 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.00206061, 2023-09-30T17:03:58.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050286289999999997, 2023-09-30T17:03:58.319 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:58.319 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:58.319 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:58.319 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:58.320 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:58.320 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 77306 2023-09-30T17:03:58.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.320 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:58.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:58.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.087388+0000", 2023-09-30T17:03:58.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.321 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:58.321 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.087388+0000", 2023-09-30T17:03:58.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.321 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.321 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:58.321 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.087389+0000", 2023-09-30T17:03:58.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9400000000000005e-07 2023-09-30T17:03:58.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:58.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.087399+0000", 2023-09-30T17:03:58.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4660000000000005e-06 2023-09-30T17:03:58.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:58.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.087427+0000", 2023-09-30T17:03:58.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8452000000000001e-05 2023-09-30T17:03:58.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:58.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.087434+0000", 2023-09-30T17:03:58.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5009999999999998e-06 2023-09-30T17:03:58.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:58.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.087487+0000", 2023-09-30T17:03:58.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2747000000000002e-05 2023-09-30T17:03:58.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:58.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.087599+0000", 2023-09-30T17:03:58.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111951 2023-09-30T17:03:58.324 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.324 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:58.325 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.325 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:77307 4.1b 4:dbd503eb:::100000001f8.0000002e:head [write 1658880~4096 in=4096b,write 2088960~4096 in=4096b,write 2453504~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:58.325 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:58.087584+0000", 2023-09-30T17:03:58.325 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0018645389999999999, 2023-09-30T17:03:58.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0048780170000000001, 2023-09-30T17:03:58.326 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:58.326 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:58.326 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:58.326 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:58.326 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:58.326 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 77307 2023-09-30T17:03:58.326 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.326 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:58.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.326 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:58.327 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.087584+0000", 2023-09-30T17:03:58.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.327 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:58.327 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.087584+0000", 2023-09-30T17:03:58.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:58.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.087585+0000", 2023-09-30T17:03:58.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9599999999999998e-07 2023-09-30T17:03:58.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:58.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.087602+0000", 2023-09-30T17:03:58.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6388999999999998e-05 2023-09-30T17:03:58.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.329 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:58.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.087614+0000", 2023-09-30T17:03:58.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1922e-05 2023-09-30T17:03:58.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.329 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:58.330 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.087620+0000", 2023-09-30T17:03:58.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8709999999999999e-06 2023-09-30T17:03:58.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.330 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:58.330 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.087669+0000", 2023-09-30T17:03:58.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8668999999999998e-05 2023-09-30T17:03:58.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.331 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:58.331 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.087745+0000", 2023-09-30T17:03:58.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6125999999999996e-05 2023-09-30T17:03:58.331 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.331 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:58.331 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.331 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.331 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.331 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:77205 4.37 4:eff9002a:::100000001f8.00000003:head [write 3149824~4096 in=4096b,write 3252224~4096 in=4096b,write 3264512~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:58.331 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:58.052232+0000", 2023-09-30T17:03:58.331 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.037217308999999997, 2023-09-30T17:03:58.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040270255999999997, 2023-09-30T17:03:58.332 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:58.332 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:58.332 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:58.332 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:58.332 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:58.332 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 77205 2023-09-30T17:03:58.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.332 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:58.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:58.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.052232+0000", 2023-09-30T17:03:58.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:58.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.052232+0000", 2023-09-30T17:03:58.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:58.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.052232+0000", 2023-09-30T17:03:58.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9099999999999999e-07 2023-09-30T17:03:58.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:58.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.052241+0000", 2023-09-30T17:03:58.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.772e-06 2023-09-30T17:03:58.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:58.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.052258+0000", 2023-09-30T17:03:58.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7079999999999999e-05 2023-09-30T17:03:58.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.335 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.335 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:58.335 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.052269+0000", 2023-09-30T17:03:58.335 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0829000000000001e-05 2023-09-30T17:03:58.335 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.335 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.335 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:58.335 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.079035+0000", 2023-09-30T17:03:58.335 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.02676605 2023-09-30T17:03:58.336 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.336 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.336 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:58.336 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.079131+0000", 2023-09-30T17:03:58.336 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6279000000000004e-05 2023-09-30T17:03:58.336 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.336 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.336 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:58.336 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.079290+0000", 2023-09-30T17:03:58.336 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015893600000000001 2023-09-30T17:03:58.337 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.337 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:58.337 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.337 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.337 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.337 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:77295 4.36 e47/17 4:6c9c34b1:::100000001f8.00000010:head v 47'3650, mlcod=47'3645)", 2023-09-30T17:03:58.337 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:58.089536+0000", 2023-09-30T17:03:58.337 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9999127, 2023-09-30T17:03:58.337 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0030121829999999999, 2023-09-30T17:03:58.337 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:58.337 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:03:58.337 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:58.338 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.338 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:58.338 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.089536+0000", 2023-09-30T17:03:58.338 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.338 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.338 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.338 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:58.338 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.089536+0000", 2023-09-30T17:03:58.338 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.338 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.338 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.339 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:58.339 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.089537+0000", 2023-09-30T17:03:58.339 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6499999999999998e-07 2023-09-30T17:03:58.339 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.339 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.339 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:58.339 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.089553+0000", 2023-09-30T17:03:58.339 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6225000000000001e-05 2023-09-30T17:03:58.339 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.339 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.340 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:58.340 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.089564+0000", 2023-09-30T17:03:58.340 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0577000000000001e-05 2023-09-30T17:03:58.340 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.340 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.340 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:58.340 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.089571+0000", 2023-09-30T17:03:58.340 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6000000000000001e-06 2023-09-30T17:03:58.340 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.340 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.341 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:58.341 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.089621+0000", 2023-09-30T17:03:58.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9922000000000001e-05 2023-09-30T17:03:58.341 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.341 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:58.341 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.089641+0000", 2023-09-30T17:03:58.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9249000000000002e-05 2023-09-30T17:03:58.341 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.341 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:58.342 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.342 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.342 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.342 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:77164 4.f 4:f2a80dfe:::100000001f8.00000019:head [write 167936~4096 in=4096b,write 192512~4096 in=4096b,write 372736~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e47)", 2023-09-30T17:03:58.342 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:58.038963+0000", 2023-09-30T17:03:58.342 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.050486093000000003, 2023-09-30T17:03:58.342 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.053621572999999999, 2023-09-30T17:03:58.342 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:58.342 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:03:58.342 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:03:58.342 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:03:58.343 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:03:58.343 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 77164 2023-09-30T17:03:58.343 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.343 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:58.343 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.343 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:58.343 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.038963+0000", 2023-09-30T17:03:58.343 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.343 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.343 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.343 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:58.344 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.038963+0000", 2023-09-30T17:03:58.344 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.344 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.344 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.344 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:58.344 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.038964+0000", 2023-09-30T17:03:58.344 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3799999999999996e-07 2023-09-30T17:03:58.344 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.344 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.344 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:58.344 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.038974+0000", 2023-09-30T17:03:58.345 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0258000000000001e-05 2023-09-30T17:03:58.345 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.345 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.345 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:58.345 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.038983+0000", 2023-09-30T17:03:58.345 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6139999999999992e-06 2023-09-30T17:03:58.345 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.345 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.345 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:58.345 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.038989+0000", 2023-09-30T17:03:58.345 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4869999999999999e-06 2023-09-30T17:03:58.346 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.346 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.346 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:03:58.346 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.065497+0000", 2023-09-30T17:03:58.346 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.026507956999999999 2023-09-30T17:03:58.346 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.346 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.346 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:03:58.346 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.065555+0000", 2023-09-30T17:03:58.346 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7388e-05 2023-09-30T17:03:58.346 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.347 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.347 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:03:58.347 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.065694+0000", 2023-09-30T17:03:58.347 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013979300000000001 2023-09-30T17:03:58.347 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.347 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.347 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:03:58.347 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.080944+0000", 2023-09-30T17:03:58.347 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015249455 2023-09-30T17:03:58.347 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.347 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:58.348 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.348 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.348 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.348 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(client.4547.0:77169 4.2f e47/17)", 2023-09-30T17:03:58.348 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:58.089591+0000", 2023-09-30T17:03:58.348 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9998574, 2023-09-30T17:03:58.348 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0030363370000000001, 2023-09-30T17:03:58.348 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:03:58.348 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:03:58.348 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:03:58.348 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.349 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:03:58.349 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.089591+0000", 2023-09-30T17:03:58.349 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.349 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.349 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.349 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:03:58.349 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.089591+0000", 2023-09-30T17:03:58.349 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:03:58.349 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.349 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.349 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:03:58.350 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.089592+0000", 2023-09-30T17:03:58.350 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.34e-07 2023-09-30T17:03:58.350 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.350 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.350 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:03:58.350 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.089595+0000", 2023-09-30T17:03:58.350 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9119999999999998e-06 2023-09-30T17:03:58.350 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.350 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.350 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:03:58.350 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.089602+0000", 2023-09-30T17:03:58.351 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.973e-06 2023-09-30T17:03:58.351 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:03:58.351 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:03:58.351 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:03:58.351 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:58.089607+0000", 2023-09-30T17:03:58.351 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3750000000000002e-06 2023-09-30T17:03:58.351 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.351 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:03:58.351 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.351 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:03:58.352 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2023-09-30T17:03:58.352 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 50 2023-09-30T17:03:58.352 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:03:58.352 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-09-30T17:03:58.353 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-09-30T17:03:58.354 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:58.352+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:58.355 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:03:58.454 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:58.454+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:58.534 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:03:58.555 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:58.555+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:58.559 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:03:58.560 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-09-30T17:03:58.560 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-09-30T17:03:58.560 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:03:58.563 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:03:58.563 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:03:58.584 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:58.584 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:58.601 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:03:58.685 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:58.684+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:58.756 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:58.756+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:58.833 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:58.833 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:58.849 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:03:58.890 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:58.889+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:58.957 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:58.956+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:59.055 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:59.055 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:59.057 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:59.056+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:59.071 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:03:59.161 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:59.158+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:59.259 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:59.259+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:59.285 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is unset 2023-09-30T17:03:59.314 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:59.314 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:59.331 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:03:59.361 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:03:59.360+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:03:59.461 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:59.461+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:59.569 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:59.568+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:59.588 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:59.588 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:59.601 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:03:59.663 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:59.663+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:59.765 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:59.764+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:59.800 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:03:59.800 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:03:59.816 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:03:59.867 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:59.865+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:03:59.967 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:03:59.966+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:00.020 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:00.021 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:00.037 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:04:00.085 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:00.085+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:00.170 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:00.170+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:00.241 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:00.241 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:00.254 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:04:00.298 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:00.298+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:00.371 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:00.371+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:00.465 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:00.465 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:00.475 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:00.475+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:00.481 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:04:00.564 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-09-30T17:04:00.572 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:00.572+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:00.672 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:00.672+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:00.724 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:00.724 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:00.737 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:04:00.742 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:04:00.770 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:04:00.770 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-09-30T17:04:00.770 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-09-30T17:04:00.770 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:04:00.773 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:04:00.774 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:04:00.774 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:00.773+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:00.874 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:00.874+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:00.976 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:00.975+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:00.990 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:04:00.990 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 20, 2023-09-30T17:04:00.990 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 600, 2023-09-30T17:04:00.990 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:04:00.990 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:00.990 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23704 4.14 4:2b28d75f:::100000001f8.00000016:head [write 262144~4096,write 274432~4096,write 405504~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:04:00.990 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.711008+0000", 2023-09-30T17:04:00.990 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 22.275615146, 2023-09-30T17:04:00.991 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.229109541, 2023-09-30T17:04:00.991 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:00.991 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:00.991 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:00.991 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:00.991 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:00.991 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23704 2023-09-30T17:04:00.991 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:00.991 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:00.991 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:00.991 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:00.992 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711008+0000", 2023-09-30T17:04:00.992 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:00.992 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:00.992 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:00.992 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:00.992 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711008+0000", 2023-09-30T17:04:00.992 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:00.992 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:00.992 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:00.992 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:00.992 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711009+0000", 2023-09-30T17:04:00.993 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5899999999999995e-07 2023-09-30T17:04:00.993 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:00.993 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:00.993 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:00.993 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711042+0000", 2023-09-30T17:04:00.993 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3149999999999999e-05 2023-09-30T17:04:00.993 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:00.993 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:00.993 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:00.993 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711054+0000", 2023-09-30T17:04:00.993 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1742999999999999e-05 2023-09-30T17:04:00.994 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:00.994 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:00.994 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:00.994 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711059+0000", 2023-09-30T17:04:00.994 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3009999999999997e-06 2023-09-30T17:04:00.994 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:00.994 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:00.994 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:00.994 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711120+0000", 2023-09-30T17:04:00.994 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1228000000000004e-05 2023-09-30T17:04:00.995 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:00.995 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:00.995 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:00.995 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711205+0000", 2023-09-30T17:04:00.995 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4489999999999999e-05 2023-09-30T17:04:00.995 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:00.995 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:00.995 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:00.995 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.711371+0000", 2023-09-30T17:04:00.996 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016639500000000001 2023-09-30T17:04:00.996 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:00.996 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:00.996 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:00.996 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.716551+0000", 2023-09-30T17:04:00.996 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0051799929999999999 2023-09-30T17:04:00.996 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:00.996 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:00.997 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:00.997 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.940040+0000", 2023-09-30T17:04:00.997 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22348859800000001 2023-09-30T17:04:00.997 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:00.997 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:00.997 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:00.997 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.940080+0000", 2023-09-30T17:04:00.997 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0114999999999998e-05 2023-09-30T17:04:00.997 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:00.997 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:00.997 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:00.998 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.940118+0000", 2023-09-30T17:04:00.998 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7768999999999997e-05 2023-09-30T17:04:00.998 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:00.998 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:00.998 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:00.998 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:00.998 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:00.998 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23713 4.33 4:cf6d7a6c:::100000001f8.0000000a:head [write 585728~4096,write 925696~4096,write 937984~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:04:00.998 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.714948+0000", 2023-09-30T17:04:00.998 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 22.271675431999999, 2023-09-30T17:04:00.998 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23061467099999999, 2023-09-30T17:04:00.998 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:00.999 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:00.999 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:00.999 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:00.999 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:00.999 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23713 2023-09-30T17:04:00.999 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:00.999 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:00.999 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:00.999 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:00.999 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.714948+0000", 2023-09-30T17:04:01.000 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:01.000 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.000 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.000 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:01.000 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.714948+0000", 2023-09-30T17:04:01.000 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:01.000 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.000 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.000 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:01.000 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.714949+0000", 2023-09-30T17:04:01.000 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1399999999999995e-07 2023-09-30T17:04:01.001 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.001 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.001 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:01.001 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.714961+0000", 2023-09-30T17:04:01.001 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1916000000000001e-05 2023-09-30T17:04:01.001 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.001 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.001 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:01.001 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.714979+0000", 2023-09-30T17:04:01.001 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8070000000000001e-05 2023-09-30T17:04:01.001 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.002 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.002 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.002 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.714987+0000", 2023-09-30T17:04:01.002 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4179999999999997e-06 2023-09-30T17:04:01.002 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.002 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.002 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:01.002 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.715034+0000", 2023-09-30T17:04:01.002 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6563999999999997e-05 2023-09-30T17:04:01.002 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.003 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.003 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:01.003 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.715083+0000", 2023-09-30T17:04:01.003 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9310000000000001e-05 2023-09-30T17:04:01.003 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.003 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.003 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:01.003 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.715177+0000", 2023-09-30T17:04:01.003 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3525999999999999e-05 2023-09-30T17:04:01.003 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.003 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.003 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:01.004 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.719724+0000", 2023-09-30T17:04:01.004 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0045477210000000002 2023-09-30T17:04:01.004 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.004 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.004 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:01.004 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.945467+0000", 2023-09-30T17:04:01.004 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22574224500000001 2023-09-30T17:04:01.004 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.004 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.004 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:01.004 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.945524+0000", 2023-09-30T17:04:01.005 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7105999999999998e-05 2023-09-30T17:04:01.005 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.005 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.005 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:01.005 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.945563+0000", 2023-09-30T17:04:01.005 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8881000000000003e-05 2023-09-30T17:04:01.005 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:01.005 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:01.005 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:01.005 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.005 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.006 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23735 4.6 4:616d4c41:::100000001f8.00000034:head [write 991232~4096,write 1040384~4096,write 1200128~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:04:01.006 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.722398+0000", 2023-09-30T17:04:01.006 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 22.264225076999999, 2023-09-30T17:04:01.006 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.230202669, 2023-09-30T17:04:01.006 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:01.006 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:01.006 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:01.006 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:01.006 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:01.006 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23735 2023-09-30T17:04:01.006 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.006 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:01.007 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.007 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:01.007 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722398+0000", 2023-09-30T17:04:01.007 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:01.007 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.007 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.007 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:01.007 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722398+0000", 2023-09-30T17:04:01.007 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:01.007 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.007 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.007 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:01.008 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722399+0000", 2023-09-30T17:04:01.008 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2799999999999996e-07 2023-09-30T17:04:01.008 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.008 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.008 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:01.008 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722423+0000", 2023-09-30T17:04:01.008 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4134e-05 2023-09-30T17:04:01.008 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.008 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.008 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:01.008 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722429+0000", 2023-09-30T17:04:01.009 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4590000000000003e-06 2023-09-30T17:04:01.009 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.009 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.009 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.009 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722434+0000", 2023-09-30T17:04:01.009 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1779999999999996e-06 2023-09-30T17:04:01.009 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.009 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.009 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:01.009 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722490+0000", 2023-09-30T17:04:01.009 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6215999999999998e-05 2023-09-30T17:04:01.010 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.010 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.010 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:01.010 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722600+0000", 2023-09-30T17:04:01.010 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00011017 2023-09-30T17:04:01.010 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.011 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.011 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:01.011 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.722769+0000", 2023-09-30T17:04:01.011 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0001695 2023-09-30T17:04:01.011 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.011 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.011 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:01.011 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725807+0000", 2023-09-30T17:04:01.011 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0030372120000000001 2023-09-30T17:04:01.011 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.011 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.012 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:01.012 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.952546+0000", 2023-09-30T17:04:01.012 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22673923600000001 2023-09-30T17:04:01.012 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.012 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.012 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:01.012 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.952579+0000", 2023-09-30T17:04:01.012 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3111000000000002e-05 2023-09-30T17:04:01.012 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.012 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.012 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:01.012 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.952601+0000", 2023-09-30T17:04:01.013 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1925000000000001e-05 2023-09-30T17:04:01.013 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:01.013 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:01.013 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:01.013 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.013 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.013 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23738 4.6 4:616d4c41:::100000001f8.00000034:head [write 3043328~4096,write 3055616~4096,write 3080192~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:04:01.013 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.723439+0000", 2023-09-30T17:04:01.013 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 22.263184104, 2023-09-30T17:04:01.013 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23665340400000001, 2023-09-30T17:04:01.014 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:01.014 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:01.014 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:01.014 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:01.014 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:01.014 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23738 2023-09-30T17:04:01.014 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.014 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:01.014 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.015 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:01.015 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723439+0000", 2023-09-30T17:04:01.015 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:01.015 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.015 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.015 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:01.015 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723439+0000", 2023-09-30T17:04:01.015 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:01.015 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.015 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.015 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:01.015 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723440+0000", 2023-09-30T17:04:01.016 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.23e-07 2023-09-30T17:04:01.016 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.016 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.016 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:01.016 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723452+0000", 2023-09-30T17:04:01.016 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2147000000000001e-05 2023-09-30T17:04:01.016 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.016 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.016 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:01.016 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723461+0000", 2023-09-30T17:04:01.016 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3839999999999997e-06 2023-09-30T17:04:01.017 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.017 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.017 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.017 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723465+0000", 2023-09-30T17:04:01.017 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7559999999999999e-06 2023-09-30T17:04:01.017 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.017 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.017 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:01.017 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723924+0000", 2023-09-30T17:04:01.017 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00045910299999999999 2023-09-30T17:04:01.017 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.018 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.018 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:01.018 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723970+0000", 2023-09-30T17:04:01.018 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5126999999999997e-05 2023-09-30T17:04:01.018 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.018 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.018 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:01.018 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724057+0000", 2023-09-30T17:04:01.018 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.7142e-05 2023-09-30T17:04:01.018 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.018 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.019 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:01.019 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.726148+0000", 2023-09-30T17:04:01.019 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.002091449 2023-09-30T17:04:01.019 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.019 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.019 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:01.019 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.960040+0000", 2023-09-30T17:04:01.019 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23389163299999999 2023-09-30T17:04:01.019 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.019 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.019 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:01.020 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.960071+0000", 2023-09-30T17:04:01.020 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.133e-05 2023-09-30T17:04:01.020 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.020 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.020 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:01.020 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.960093+0000", 2023-09-30T17:04:01.020 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1509999999999999e-05 2023-09-30T17:04:01.020 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:01.020 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:01.020 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:01.020 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.020 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.021 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23740 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 3780608~4096,write 3788800~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:04:01.021 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.723994+0000", 2023-09-30T17:04:01.021 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 22.262629327999999, 2023-09-30T17:04:01.021 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.234031238, 2023-09-30T17:04:01.021 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:01.021 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:01.021 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:01.021 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:01.021 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:01.021 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23740 2023-09-30T17:04:01.021 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.021 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:01.022 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.022 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:01.022 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723994+0000", 2023-09-30T17:04:01.022 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:01.022 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.022 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.022 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:01.022 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723994+0000", 2023-09-30T17:04:01.022 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:01.022 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.022 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.023 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:01.023 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.723995+0000", 2023-09-30T17:04:01.023 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6000000000000003e-07 2023-09-30T17:04:01.023 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.023 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.023 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:01.023 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724004+0000", 2023-09-30T17:04:01.023 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.4909999999999994e-06 2023-09-30T17:04:01.023 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.023 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.023 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:01.024 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724012+0000", 2023-09-30T17:04:01.024 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4590000000000001e-06 2023-09-30T17:04:01.024 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.024 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.024 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.024 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724016+0000", 2023-09-30T17:04:01.024 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9890000000000003e-06 2023-09-30T17:04:01.024 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.024 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.024 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:01.024 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724060+0000", 2023-09-30T17:04:01.024 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4339999999999999e-05 2023-09-30T17:04:01.025 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.025 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.025 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:01.025 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724141+0000", 2023-09-30T17:04:01.025 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1384000000000005e-05 2023-09-30T17:04:01.025 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.025 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.025 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:01.025 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.724300+0000", 2023-09-30T17:04:01.025 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015870700000000001 2023-09-30T17:04:01.025 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.026 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.026 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:01.026 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.726182+0000", 2023-09-30T17:04:01.026 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0018816060000000001 2023-09-30T17:04:01.026 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.026 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.026 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:01.026 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.957929+0000", 2023-09-30T17:04:01.026 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23174703399999999 2023-09-30T17:04:01.026 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.026 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.027 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:01.027 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.957983+0000", 2023-09-30T17:04:01.027 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4107999999999998e-05 2023-09-30T17:04:01.027 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.027 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.027 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:01.027 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.958025+0000", 2023-09-30T17:04:01.027 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2360000000000001e-05 2023-09-30T17:04:01.027 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:01.027 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:01.027 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:01.028 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.028 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.028 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23746 4.28 4:15eeb89b:::100000001f8.00000032:head [write 3731456~4096,write 3919872~4096,write 3952640~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:04:01.028 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.725721+0000", 2023-09-30T17:04:01.028 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 22.260901944, 2023-09-30T17:04:01.028 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.24024479800000001, 2023-09-30T17:04:01.028 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:01.028 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:01.028 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:01.028 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:01.028 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:01.029 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23746 2023-09-30T17:04:01.029 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.029 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:01.029 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.029 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:01.029 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725721+0000", 2023-09-30T17:04:01.029 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:01.029 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.029 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.029 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:01.029 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725721+0000", 2023-09-30T17:04:01.030 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:01.030 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.030 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.030 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:01.030 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725722+0000", 2023-09-30T17:04:01.030 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6499999999999999e-07 2023-09-30T17:04:01.030 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.030 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.030 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:01.030 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725732+0000", 2023-09-30T17:04:01.031 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7559999999999994e-06 2023-09-30T17:04:01.031 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.031 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.031 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:01.031 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725738+0000", 2023-09-30T17:04:01.031 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8360000000000003e-06 2023-09-30T17:04:01.031 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.031 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.031 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.031 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725746+0000", 2023-09-30T17:04:01.031 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4200000000000001e-06 2023-09-30T17:04:01.032 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.032 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.032 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:01.032 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725805+0000", 2023-09-30T17:04:01.032 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9318999999999999e-05 2023-09-30T17:04:01.032 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.032 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.032 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:01.032 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.725904+0000", 2023-09-30T17:04:01.032 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8747999999999997e-05 2023-09-30T17:04:01.032 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.033 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.033 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:01.033 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.726075+0000", 2023-09-30T17:04:01.033 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017153700000000001 2023-09-30T17:04:01.033 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.033 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.033 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:01.033 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.727419+0000", 2023-09-30T17:04:01.033 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001343571 2023-09-30T17:04:01.033 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.033 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.034 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:01.034 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.965839+0000", 2023-09-30T17:04:01.034 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.238420467 2023-09-30T17:04:01.034 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.034 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.034 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:01.034 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.965922+0000", 2023-09-30T17:04:01.034 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2905000000000007e-05 2023-09-30T17:04:01.034 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.034 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.034 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:01.034 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.965966+0000", 2023-09-30T17:04:01.035 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3773999999999998e-05 2023-09-30T17:04:01.035 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:01.035 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:01.035 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:01.035 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.035 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.035 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23757 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 2117632~8192,write 2228224~4096,write 2453504~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:04:01.035 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.728711+0000", 2023-09-30T17:04:01.035 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 22.257912369, 2023-09-30T17:04:01.035 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23330704499999999, 2023-09-30T17:04:01.035 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:01.036 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:01.036 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:01.036 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:01.036 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:01.036 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23757 2023-09-30T17:04:01.036 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.036 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:01.036 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.036 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:01.036 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728711+0000", 2023-09-30T17:04:01.036 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:01.037 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.037 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.037 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:01.037 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728711+0000", 2023-09-30T17:04:01.037 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:01.037 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.037 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.037 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:01.037 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728712+0000", 2023-09-30T17:04:01.037 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4199999999999995e-07 2023-09-30T17:04:01.037 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.037 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.038 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:01.038 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728738+0000", 2023-09-30T17:04:01.038 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.6761e-05 2023-09-30T17:04:01.038 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.038 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.038 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:01.038 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728745+0000", 2023-09-30T17:04:01.038 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9940000000000003e-06 2023-09-30T17:04:01.038 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.038 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.038 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.039 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728749+0000", 2023-09-30T17:04:01.039 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.053e-06 2023-09-30T17:04:01.039 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.039 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.039 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:01.039 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728802+0000", 2023-09-30T17:04:01.039 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2918999999999999e-05 2023-09-30T17:04:01.039 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.039 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.039 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:01.039 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.728923+0000", 2023-09-30T17:04:01.040 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00012084200000000001 2023-09-30T17:04:01.040 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.040 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.040 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:01.040 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.729101+0000", 2023-09-30T17:04:01.040 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000178226 2023-09-30T17:04:01.040 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.040 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.040 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:01.040 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732207+0000", 2023-09-30T17:04:01.040 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0031059849999999999 2023-09-30T17:04:01.041 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.041 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.041 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:01.041 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.961949+0000", 2023-09-30T17:04:01.041 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.229741842 2023-09-30T17:04:01.041 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.041 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.041 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:01.041 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.961986+0000", 2023-09-30T17:04:01.041 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7147000000000002e-05 2023-09-30T17:04:01.041 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.041 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.042 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:01.042 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.962018+0000", 2023-09-30T17:04:01.042 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.1634000000000002e-05 2023-09-30T17:04:01.042 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:01.042 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:01.042 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:01.042 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.042 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.042 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23768 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 1257472~4096,write 1384448~4096,write 1474560~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:04:01.042 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.732216+0000", 2023-09-30T17:04:01.042 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 22.254407737000001, 2023-09-30T17:04:01.043 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22951861000000001, 2023-09-30T17:04:01.043 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:01.043 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:01.043 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:01.043 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:01.043 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:01.043 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23768 2023-09-30T17:04:01.043 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.043 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:01.043 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.043 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:01.043 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732216+0000", 2023-09-30T17:04:01.044 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:01.044 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.044 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.044 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:01.044 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732216+0000", 2023-09-30T17:04:01.044 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:01.044 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.044 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.044 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:01.044 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732216+0000", 2023-09-30T17:04:01.045 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.71e-07 2023-09-30T17:04:01.045 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.045 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.045 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:01.045 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732231+0000", 2023-09-30T17:04:01.045 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5007e-05 2023-09-30T17:04:01.045 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.045 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.045 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:01.045 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732239+0000", 2023-09-30T17:04:01.045 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8509999999999999e-06 2023-09-30T17:04:01.045 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.046 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.046 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.046 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732244+0000", 2023-09-30T17:04:01.046 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2000000000000002e-06 2023-09-30T17:04:01.046 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.046 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.046 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:01.046 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732285+0000", 2023-09-30T17:04:01.046 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0877000000000002e-05 2023-09-30T17:04:01.046 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.046 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.046 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:01.047 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732331+0000", 2023-09-30T17:04:01.047 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5906999999999999e-05 2023-09-30T17:04:01.047 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.047 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.047 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:01.047 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.732421+0000", 2023-09-30T17:04:01.047 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9993000000000004e-05 2023-09-30T17:04:01.047 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.047 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.047 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:01.048 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.737687+0000", 2023-09-30T17:04:01.048 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005265792 2023-09-30T17:04:01.048 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.048 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.048 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:01.048 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.961667+0000", 2023-09-30T17:04:01.048 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22398030799999999 2023-09-30T17:04:01.048 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.048 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.048 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:01.049 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.961703+0000", 2023-09-30T17:04:01.049 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5221e-05 2023-09-30T17:04:01.049 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.049 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.049 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:01.049 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.961734+0000", 2023-09-30T17:04:01.049 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.1582999999999999e-05 2023-09-30T17:04:01.049 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:01.049 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:01.049 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:01.050 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.050 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.050 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23780 4.36 4:6fa85f86:::100000001f8.00000013:head [write 3469312~4096,write 3522560~4096,write 3579904~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:04:01.050 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.735686+0000", 2023-09-30T17:04:01.050 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 22.250937506, 2023-09-30T17:04:01.050 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22921459399999999, 2023-09-30T17:04:01.050 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:01.050 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:01.050 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:01.050 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:01.050 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:01.051 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23780 2023-09-30T17:04:01.051 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.051 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:01.051 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.051 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:01.051 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.735686+0000", 2023-09-30T17:04:01.051 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:01.051 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.051 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.051 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:01.051 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.735686+0000", 2023-09-30T17:04:01.052 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:01.052 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.052 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.052 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:01.052 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.735687+0000", 2023-09-30T17:04:01.052 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3399999999999998e-07 2023-09-30T17:04:01.052 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.052 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.052 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:01.052 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.735701+0000", 2023-09-30T17:04:01.052 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4324999999999999e-05 2023-09-30T17:04:01.052 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.053 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.053 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:01.053 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.735713+0000", 2023-09-30T17:04:01.053 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1678999999999999e-05 2023-09-30T17:04:01.053 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.053 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.053 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.053 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.735720+0000", 2023-09-30T17:04:01.053 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8490000000000006e-06 2023-09-30T17:04:01.053 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.053 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.054 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:01.054 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.736637+0000", 2023-09-30T17:04:01.054 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00091620799999999995 2023-09-30T17:04:01.054 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.054 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.054 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:01.054 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.736719+0000", 2023-09-30T17:04:01.054 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2608999999999995e-05 2023-09-30T17:04:01.054 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.054 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.054 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:01.055 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.736876+0000", 2023-09-30T17:04:01.055 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015636799999999999 2023-09-30T17:04:01.055 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.055 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.055 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:01.055 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.742934+0000", 2023-09-30T17:04:01.055 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0060581619999999997 2023-09-30T17:04:01.055 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.055 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.055 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:01.055 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.964798+0000", 2023-09-30T17:04:01.056 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22186376599999999 2023-09-30T17:04:01.056 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.056 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.056 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:01.056 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.964859+0000", 2023-09-30T17:04:01.056 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1668000000000007e-05 2023-09-30T17:04:01.056 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.056 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.056 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:01.056 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.964900+0000", 2023-09-30T17:04:01.056 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1125999999999999e-05 2023-09-30T17:04:01.057 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:01.057 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:01.057 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:01.057 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.057 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.057 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23856 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 3538944~4096,write 3616768~4096,write 3686400~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:04:01.057 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.759274+0000", 2023-09-30T17:04:01.057 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 22.227349624999999, 2023-09-30T17:04:01.057 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.234084127, 2023-09-30T17:04:01.057 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:01.057 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:01.058 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:01.058 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:01.058 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:01.058 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23856 2023-09-30T17:04:01.058 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.058 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:01.058 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.058 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:01.058 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759274+0000", 2023-09-30T17:04:01.058 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:01.058 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.059 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.059 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:01.059 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759274+0000", 2023-09-30T17:04:01.059 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:01.059 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.059 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.059 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:01.059 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759274+0000", 2023-09-30T17:04:01.059 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7899999999999998e-07 2023-09-30T17:04:01.059 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.060 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.060 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:01.060 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759293+0000", 2023-09-30T17:04:01.060 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8410000000000002e-05 2023-09-30T17:04:01.060 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.060 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.060 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:01.060 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759302+0000", 2023-09-30T17:04:01.060 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8599999999999999e-06 2023-09-30T17:04:01.060 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.061 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.061 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.061 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759306+0000", 2023-09-30T17:04:01.061 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4499999999999997e-06 2023-09-30T17:04:01.061 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.061 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.061 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:01.061 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.759984+0000", 2023-09-30T17:04:01.061 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00067830600000000005 2023-09-30T17:04:01.061 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.062 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.062 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:01.062 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.760041+0000", 2023-09-30T17:04:01.062 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.643e-05 2023-09-30T17:04:01.062 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.062 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.062 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:01.062 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.760135+0000", 2023-09-30T17:04:01.062 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3795999999999994e-05 2023-09-30T17:04:01.062 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.063 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.063 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:01.063 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764097+0000", 2023-09-30T17:04:01.063 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0039625629999999997 2023-09-30T17:04:01.063 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.063 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.063 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:01.063 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993282+0000", 2023-09-30T17:04:01.063 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22918461500000001 2023-09-30T17:04:01.063 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.063 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.063 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:01.064 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993320+0000", 2023-09-30T17:04:01.064 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8600999999999999e-05 2023-09-30T17:04:01.064 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.064 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.064 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:01.064 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993358+0000", 2023-09-30T17:04:01.064 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7517e-05 2023-09-30T17:04:01.064 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:01.064 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:01.064 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:01.064 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.065 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.065 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23865 4.36 4:6da220e6:::100000001f8.0000003f:head [write 3715072~4096,write 3850240~4096,write 4059136~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:04:01.065 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.761946+0000", 2023-09-30T17:04:01.065 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 22.224677140000001, 2023-09-30T17:04:01.065 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.231486097, 2023-09-30T17:04:01.065 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:01.065 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:01.065 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:01.065 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:01.065 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:01.066 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23865 2023-09-30T17:04:01.066 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.066 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:01.066 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.066 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:01.066 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.761946+0000", 2023-09-30T17:04:01.066 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:01.066 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.066 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.066 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:01.066 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.761946+0000", 2023-09-30T17:04:01.067 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:01.067 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.067 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.067 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:01.067 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.761947+0000", 2023-09-30T17:04:01.067 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7000000000000004e-07 2023-09-30T17:04:01.067 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.067 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.067 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:01.067 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.761959+0000", 2023-09-30T17:04:01.067 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2265e-05 2023-09-30T17:04:01.067 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.068 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.068 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:01.068 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.761970+0000", 2023-09-30T17:04:01.068 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0474e-05 2023-09-30T17:04:01.068 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.068 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.068 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.068 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.761976+0000", 2023-09-30T17:04:01.068 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1340000000000001e-06 2023-09-30T17:04:01.068 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.068 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.068 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:01.069 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.762063+0000", 2023-09-30T17:04:01.069 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.6728e-05 2023-09-30T17:04:01.069 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.069 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.069 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:01.069 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.762125+0000", 2023-09-30T17:04:01.069 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2869999999999999e-05 2023-09-30T17:04:01.069 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.069 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.069 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:01.069 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.762235+0000", 2023-09-30T17:04:01.070 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000109139 2023-09-30T17:04:01.070 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.070 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.070 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:01.070 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764102+0000", 2023-09-30T17:04:01.070 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001867121 2023-09-30T17:04:01.070 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.070 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.070 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:01.070 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993327+0000", 2023-09-30T17:04:01.070 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22922526800000001 2023-09-30T17:04:01.071 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.071 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.071 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:01.071 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993391+0000", 2023-09-30T17:04:01.071 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3839999999999999e-05 2023-09-30T17:04:01.071 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.071 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.071 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:01.071 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993432+0000", 2023-09-30T17:04:01.071 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1488e-05 2023-09-30T17:04:01.072 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:01.072 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:01.072 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:01.072 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.072 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.072 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23875 4.36 4:6da220e6:::100000001f8.0000003f:head [write 364544~4096,write 499712~4096,write 655360~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:04:01.072 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.764904+0000", 2023-09-30T17:04:01.072 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 22.221718956, 2023-09-30T17:04:01.072 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.228631693, 2023-09-30T17:04:01.072 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:01.072 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:01.073 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:01.073 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:01.073 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:01.073 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23875 2023-09-30T17:04:01.073 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.073 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:01.073 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.073 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:01.073 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764904+0000", 2023-09-30T17:04:01.073 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:01.073 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.074 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.074 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:01.074 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764904+0000", 2023-09-30T17:04:01.074 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:01.074 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.074 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.074 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:01.074 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764905+0000", 2023-09-30T17:04:01.074 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2799999999999995e-07 2023-09-30T17:04:01.074 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.074 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.074 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:01.075 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764915+0000", 2023-09-30T17:04:01.075 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8099999999999992e-06 2023-09-30T17:04:01.075 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.075 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.075 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:01.075 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764926+0000", 2023-09-30T17:04:01.075 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0858e-05 2023-09-30T17:04:01.075 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.075 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.075 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.075 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764931+0000", 2023-09-30T17:04:01.075 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2170000000000002e-06 2023-09-30T17:04:01.076 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.076 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.076 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:01.076 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.764963+0000", 2023-09-30T17:04:01.076 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.2319e-05 2023-09-30T17:04:01.076 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.076 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.076 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:01.076 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.765009+0000", 2023-09-30T17:04:01.076 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5753000000000001e-05 2023-09-30T17:04:01.076 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.076 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.077 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:01.077 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.765093+0000", 2023-09-30T17:04:01.077 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4259999999999996e-05 2023-09-30T17:04:01.077 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.077 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.077 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:01.077 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766238+0000", 2023-09-30T17:04:01.077 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0011442550000000001 2023-09-30T17:04:01.077 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.077 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.077 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:01.078 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993469+0000", 2023-09-30T17:04:01.078 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22723121800000001 2023-09-30T17:04:01.078 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.078 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.078 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:01.078 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993501+0000", 2023-09-30T17:04:01.078 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.2576000000000001e-05 2023-09-30T17:04:01.078 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.078 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.078 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:01.078 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.993536+0000", 2023-09-30T17:04:01.079 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4699000000000001e-05 2023-09-30T17:04:01.079 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:01.079 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:01.079 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:01.079 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.079 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.079 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23881 4.36 4:6da220e6:::100000001f8.0000003f:head [write 3366912~4096,write 3694592~4096,write 4071424~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:04:01.079 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.766444+0000", 2023-09-30T17:04:01.079 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 22.220179535, 2023-09-30T17:04:01.079 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23475070200000001, 2023-09-30T17:04:01.079 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:01.079 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:01.080 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:01.080 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:01.080 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:01.080 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23881 2023-09-30T17:04:01.080 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.080 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:01.080 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.080 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:01.080 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766444+0000", 2023-09-30T17:04:01.080 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:01.080 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.080 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.081 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:01.081 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766444+0000", 2023-09-30T17:04:01.081 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:01.081 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.081 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.081 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:01.081 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766444+0000", 2023-09-30T17:04:01.081 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3e-07 2023-09-30T17:04:01.081 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.082 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.082 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:01.082 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766455+0000", 2023-09-30T17:04:01.082 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0454e-05 2023-09-30T17:04:01.082 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.082 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.082 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:01.082 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766469+0000", 2023-09-30T17:04:01.082 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3568e-05 2023-09-30T17:04:01.082 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.083 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.083 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.083 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766474+0000", 2023-09-30T17:04:01.083 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1669999999999998e-06 2023-09-30T17:04:01.083 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.083 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.083 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:01.083 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766527+0000", 2023-09-30T17:04:01.084 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3650000000000003e-05 2023-09-30T17:04:01.084 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.084 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.084 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:01.084 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766611+0000", 2023-09-30T17:04:01.084 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3230000000000001e-05 2023-09-30T17:04:01.084 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.084 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.084 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:01.084 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.766767+0000", 2023-09-30T17:04:01.085 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015688 2023-09-30T17:04:01.085 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.085 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.085 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:01.085 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.770254+0000", 2023-09-30T17:04:01.085 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0034870090000000001 2023-09-30T17:04:01.085 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.085 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.085 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:01.085 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.001100+0000", 2023-09-30T17:04:01.086 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23084518700000001 2023-09-30T17:04:01.086 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.086 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.086 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:01.086 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.001154+0000", 2023-09-30T17:04:01.086 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4453000000000002e-05 2023-09-30T17:04:01.086 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.086 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.086 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:01.087 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.001194+0000", 2023-09-30T17:04:01.087 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0373999999999997e-05 2023-09-30T17:04:01.087 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:01.087 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:01.087 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:01.087 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.087 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.087 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23901 4.6 4:63e80496:::100000001f8.0000001e:head [write 2617344~4096,write 2646016~4096,write 2662400~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:04:01.088 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.772204+0000", 2023-09-30T17:04:01.088 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 22.214419518, 2023-09-30T17:04:01.088 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.228858799, 2023-09-30T17:04:01.088 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:01.088 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:01.088 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:01.088 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:01.088 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:01.088 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23901 2023-09-30T17:04:01.088 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.089 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:01.089 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.089 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:01.089 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772204+0000", 2023-09-30T17:04:01.089 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:01.089 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.089 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.089 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:01.089 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772204+0000", 2023-09-30T17:04:01.089 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:01.090 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.090 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.090 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:01.090 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772205+0000", 2023-09-30T17:04:01.090 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3600000000000002e-07 2023-09-30T17:04:01.090 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.090 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.090 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:01.090 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772217+0000", 2023-09-30T17:04:01.091 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2459999999999999e-05 2023-09-30T17:04:01.091 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.091 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.091 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:01.091 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772228+0000", 2023-09-30T17:04:01.091 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0614e-05 2023-09-30T17:04:01.091 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.091 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.091 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.091 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772236+0000", 2023-09-30T17:04:01.091 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7610000000000007e-06 2023-09-30T17:04:01.092 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.092 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.092 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:01.092 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772280+0000", 2023-09-30T17:04:01.092 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4360000000000002e-05 2023-09-30T17:04:01.092 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.092 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.092 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:01.092 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772328+0000", 2023-09-30T17:04:01.092 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8041000000000003e-05 2023-09-30T17:04:01.092 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.093 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.093 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:01.093 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.772417+0000", 2023-09-30T17:04:01.093 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9226000000000003e-05 2023-09-30T17:04:01.093 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.093 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.093 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:01.093 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.774997+0000", 2023-09-30T17:04:01.093 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0025795039999999998 2023-09-30T17:04:01.093 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.093 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.093 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:01.094 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.000979+0000", 2023-09-30T17:04:01.094 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22598211700000001 2023-09-30T17:04:01.094 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.094 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.094 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:01.094 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.001025+0000", 2023-09-30T17:04:01.094 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6347999999999997e-05 2023-09-30T17:04:01.094 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.094 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.094 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:01.095 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.001063+0000", 2023-09-30T17:04:01.095 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7431999999999997e-05 2023-09-30T17:04:01.095 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:01.095 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:01.095 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:01.095 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.095 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.095 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23924 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 1196032~4096,write 1249280~4096,write 1294336~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:04:01.095 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.778807+0000", 2023-09-30T17:04:01.095 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 22.207816658999999, 2023-09-30T17:04:01.095 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23068708600000001, 2023-09-30T17:04:01.096 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:01.096 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:01.096 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:01.096 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:01.096 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:01.096 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23924 2023-09-30T17:04:01.096 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.096 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:01.096 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.096 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:01.096 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778807+0000", 2023-09-30T17:04:01.097 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:01.097 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.097 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.097 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:01.097 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778807+0000", 2023-09-30T17:04:01.097 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:01.097 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.097 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.097 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:01.097 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778807+0000", 2023-09-30T17:04:01.097 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3600000000000003e-07 2023-09-30T17:04:01.098 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.098 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.098 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:01.098 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778832+0000", 2023-09-30T17:04:01.098 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4905999999999998e-05 2023-09-30T17:04:01.098 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.098 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.098 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:01.098 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778839+0000", 2023-09-30T17:04:01.098 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.097e-06 2023-09-30T17:04:01.098 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.098 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.099 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.099 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778843+0000", 2023-09-30T17:04:01.099 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8279999999999996e-06 2023-09-30T17:04:01.099 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.099 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.099 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:01.099 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778875+0000", 2023-09-30T17:04:01.099 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.1792000000000003e-05 2023-09-30T17:04:01.099 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.099 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.099 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:01.100 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.778922+0000", 2023-09-30T17:04:01.100 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7034999999999999e-05 2023-09-30T17:04:01.100 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.100 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.100 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:01.100 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.779010+0000", 2023-09-30T17:04:01.100 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8305000000000002e-05 2023-09-30T17:04:01.100 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.100 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.100 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:01.100 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.781442+0000", 2023-09-30T17:04:01.100 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0024313550000000001 2023-09-30T17:04:01.101 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.101 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.101 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:01.101 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.009433+0000", 2023-09-30T17:04:01.101 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.227991044 2023-09-30T17:04:01.101 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.101 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.101 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:01.101 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.009471+0000", 2023-09-30T17:04:01.101 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8720999999999997e-05 2023-09-30T17:04:01.101 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.101 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.102 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:01.102 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.009494+0000", 2023-09-30T17:04:01.102 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2367000000000001e-05 2023-09-30T17:04:01.102 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:01.102 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:01.102 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:01.102 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.102 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.102 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23990 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 4157440~4096,write 4186112~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:04:01.102 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.798667+0000", 2023-09-30T17:04:01.102 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 22.187956144000001, 2023-09-30T17:04:01.103 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23029929399999999, 2023-09-30T17:04:01.103 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:01.103 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:01.103 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:01.103 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:01.103 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:01.103 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23990 2023-09-30T17:04:01.103 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.103 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:01.103 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.103 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:01.103 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798667+0000", 2023-09-30T17:04:01.103 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:01.104 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.104 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.104 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:01.104 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798667+0000", 2023-09-30T17:04:01.104 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:01.104 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.104 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.104 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:01.104 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798668+0000", 2023-09-30T17:04:01.104 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7000000000000005e-07 2023-09-30T17:04:01.104 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.104 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.105 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:01.105 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798675+0000", 2023-09-30T17:04:01.105 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1269999999999997e-06 2023-09-30T17:04:01.105 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.105 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.105 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:01.105 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798681+0000", 2023-09-30T17:04:01.105 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3500000000000002e-06 2023-09-30T17:04:01.105 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.105 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.105 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.106 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798685+0000", 2023-09-30T17:04:01.106 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.63e-06 2023-09-30T17:04:01.106 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.106 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.106 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:01.106 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798726+0000", 2023-09-30T17:04:01.106 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.163e-05 2023-09-30T17:04:01.106 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.106 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.106 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:01.106 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798790+0000", 2023-09-30T17:04:01.107 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3781999999999993e-05 2023-09-30T17:04:01.107 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.107 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.107 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:01.107 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798933+0000", 2023-09-30T17:04:01.107 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014272199999999999 2023-09-30T17:04:01.107 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.107 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.107 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:01.107 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.802788+0000", 2023-09-30T17:04:01.107 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.003855509 2023-09-30T17:04:01.108 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.108 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.108 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:01.108 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.028891+0000", 2023-09-30T17:04:01.108 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.226102847 2023-09-30T17:04:01.108 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.108 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.108 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:01.108 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.028945+0000", 2023-09-30T17:04:01.108 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3600000000000002e-05 2023-09-30T17:04:01.108 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.108 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.109 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:01.109 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.028966+0000", 2023-09-30T17:04:01.109 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1526999999999999e-05 2023-09-30T17:04:01.109 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:01.109 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:01.109 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:01.109 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.109 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.109 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:23991 4.6 4:63e80496:::100000001f8.0000001e:head [write 327680~4096,write 335872~4096,write 491520~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:04:01.109 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.798864+0000", 2023-09-30T17:04:01.109 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 22.18775956, 2023-09-30T17:04:01.110 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23025762699999999, 2023-09-30T17:04:01.110 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:01.110 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:01.110 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:01.110 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:01.110 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:01.110 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 23991 2023-09-30T17:04:01.110 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.110 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:01.110 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.110 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:01.110 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798864+0000", 2023-09-30T17:04:01.111 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:01.111 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.111 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.111 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:01.111 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798864+0000", 2023-09-30T17:04:01.111 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:01.111 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.111 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.111 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:01.111 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798864+0000", 2023-09-30T17:04:01.111 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3099999999999998e-07 2023-09-30T17:04:01.112 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.112 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.112 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:01.112 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798873+0000", 2023-09-30T17:04:01.112 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4789999999999996e-06 2023-09-30T17:04:01.112 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.112 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.112 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:01.112 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798878+0000", 2023-09-30T17:04:01.112 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6579999999999999e-06 2023-09-30T17:04:01.112 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.113 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.113 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.113 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.798882+0000", 2023-09-30T17:04:01.113 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.985e-06 2023-09-30T17:04:01.113 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.113 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.113 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:01.113 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.799659+0000", 2023-09-30T17:04:01.113 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00077693900000000004 2023-09-30T17:04:01.113 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.113 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.114 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:01.114 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.799712+0000", 2023-09-30T17:04:01.114 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2694000000000001e-05 2023-09-30T17:04:01.114 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.114 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.114 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:01.114 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.799796+0000", 2023-09-30T17:04:01.114 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3943999999999995e-05 2023-09-30T17:04:01.114 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.114 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.114 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:01.115 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.802821+0000", 2023-09-30T17:04:01.115 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0030251850000000001 2023-09-30T17:04:01.115 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.115 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.115 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:01.115 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.029027+0000", 2023-09-30T17:04:01.115 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22620609999999999 2023-09-30T17:04:01.115 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.115 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.115 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:01.117 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.029083+0000", 2023-09-30T17:04:01.117 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5926e-05 2023-09-30T17:04:01.117 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.117 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.117 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:01.117 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.029121+0000", 2023-09-30T17:04:01.117 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8186000000000003e-05 2023-09-30T17:04:01.118 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:01.118 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:01.118 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:01.118 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.118 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.118 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:24052 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 3448832~4096,write 3493888~4096,write 3502080~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:04:01.118 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.817515+0000", 2023-09-30T17:04:01.118 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 22.169108250000001, 2023-09-30T17:04:01.118 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23184106800000001, 2023-09-30T17:04:01.118 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:01.118 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:01.119 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:01.119 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:01.119 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:01.119 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 24052 2023-09-30T17:04:01.119 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.119 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:01.119 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.119 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:01.119 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.817515+0000", 2023-09-30T17:04:01.119 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:01.119 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.120 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.120 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:01.120 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.817515+0000", 2023-09-30T17:04:01.120 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:01.120 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.120 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.120 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:01.120 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.817516+0000", 2023-09-30T17:04:01.120 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9899999999999999e-07 2023-09-30T17:04:01.120 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.120 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.120 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:01.121 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.817531+0000", 2023-09-30T17:04:01.121 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5483000000000001e-05 2023-09-30T17:04:01.121 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.121 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.121 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:01.121 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.817545+0000", 2023-09-30T17:04:01.121 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3209e-05 2023-09-30T17:04:01.121 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.121 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.121 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.121 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.817553+0000", 2023-09-30T17:04:01.121 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.994e-06 2023-09-30T17:04:01.122 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.122 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.122 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:01.122 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.818753+0000", 2023-09-30T17:04:01.122 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0012000909999999999 2023-09-30T17:04:01.122 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.122 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.122 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:01.122 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.818838+0000", 2023-09-30T17:04:01.122 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5389999999999994e-05 2023-09-30T17:04:01.123 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.123 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.123 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:01.123 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.818996+0000", 2023-09-30T17:04:01.123 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000158116 2023-09-30T17:04:01.123 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.123 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.123 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:01.123 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.822334+0000", 2023-09-30T17:04:01.123 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0033373230000000001 2023-09-30T17:04:01.123 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.123 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.124 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:01.124 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049259+0000", 2023-09-30T17:04:01.124 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22692517400000001 2023-09-30T17:04:01.124 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.124 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.124 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:01.124 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049323+0000", 2023-09-30T17:04:01.124 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4348000000000001e-05 2023-09-30T17:04:01.124 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.124 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.124 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:01.124 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049356+0000", 2023-09-30T17:04:01.125 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3040999999999998e-05 2023-09-30T17:04:01.125 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:01.125 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:01.125 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:01.125 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.125 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.125 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:24058 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 172032~4096,write 200704~4096,write 249856~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:04:01.125 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.819363+0000", 2023-09-30T17:04:01.125 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 22.167260773999999, 2023-09-30T17:04:01.125 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23030741099999999, 2023-09-30T17:04:01.125 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:01.126 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:01.126 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:01.126 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:01.126 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:01.126 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 24058 2023-09-30T17:04:01.126 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.126 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:01.126 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.126 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:01.126 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819363+0000", 2023-09-30T17:04:01.126 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:01.127 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.127 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.127 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:01.127 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819363+0000", 2023-09-30T17:04:01.127 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:01.127 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.127 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.127 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:01.127 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819363+0000", 2023-09-30T17:04:01.127 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8400000000000003e-07 2023-09-30T17:04:01.127 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.127 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.128 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:01.128 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819373+0000", 2023-09-30T17:04:01.128 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.9930000000000007e-06 2023-09-30T17:04:01.128 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.128 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.128 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:01.128 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819383+0000", 2023-09-30T17:04:01.128 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.4059999999999994e-06 2023-09-30T17:04:01.128 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.128 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.128 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.128 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819388+0000", 2023-09-30T17:04:01.129 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3299999999999998e-06 2023-09-30T17:04:01.129 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.129 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.129 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:01.129 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819584+0000", 2023-09-30T17:04:01.129 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00019642600000000001 2023-09-30T17:04:01.129 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.129 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.129 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:01.129 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819627+0000", 2023-09-30T17:04:01.129 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2150999999999997e-05 2023-09-30T17:04:01.129 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.130 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.130 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:01.130 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.819712+0000", 2023-09-30T17:04:01.130 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5255999999999998e-05 2023-09-30T17:04:01.130 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.130 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.130 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:01.130 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.822340+0000", 2023-09-30T17:04:01.130 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0026283029999999998 2023-09-30T17:04:01.130 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.130 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.131 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:01.131 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049621+0000", 2023-09-30T17:04:01.131 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.227281176 2023-09-30T17:04:01.131 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.131 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.131 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:01.131 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049652+0000", 2023-09-30T17:04:01.131 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0528000000000003e-05 2023-09-30T17:04:01.131 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.131 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.131 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:01.131 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049670+0000", 2023-09-30T17:04:01.132 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8057999999999999e-05 2023-09-30T17:04:01.132 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:01.132 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:01.132 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:01.132 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.132 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.132 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:24064 4.6 4:616d4c41:::100000001f8.00000034:head [write 4132864~4096,write 4173824~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:04:01.132 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:03:38.820931+0000", 2023-09-30T17:04:01.132 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 22.165692412999999, 2023-09-30T17:04:01.132 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22854920400000001, 2023-09-30T17:04:01.132 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:01.132 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:01.133 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:01.133 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:01.133 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:01.133 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 24064 2023-09-30T17:04:01.133 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.133 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:01.133 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.133 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:01.133 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.820931+0000", 2023-09-30T17:04:01.133 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:01.133 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.133 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.134 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:01.134 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.820931+0000", 2023-09-30T17:04:01.134 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:01.134 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.134 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.134 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:01.134 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.820932+0000", 2023-09-30T17:04:01.134 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4300000000000002e-07 2023-09-30T17:04:01.134 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.134 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.134 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:01.135 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.820941+0000", 2023-09-30T17:04:01.135 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.5650000000000007e-06 2023-09-30T17:04:01.135 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.135 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.135 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:01.135 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.820952+0000", 2023-09-30T17:04:01.135 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0566e-05 2023-09-30T17:04:01.135 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.135 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.135 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.135 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.820957+0000", 2023-09-30T17:04:01.136 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3800000000000002e-06 2023-09-30T17:04:01.136 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.136 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.136 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:01.136 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.821008+0000", 2023-09-30T17:04:01.136 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1070999999999999e-05 2023-09-30T17:04:01.136 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.136 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.136 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:01.136 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.821075+0000", 2023-09-30T17:04:01.136 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.648e-05 2023-09-30T17:04:01.136 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.137 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.137 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:01.137 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.821236+0000", 2023-09-30T17:04:01.137 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016120899999999999 2023-09-30T17:04:01.137 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.137 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.137 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:01.137 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:38.823356+0000", 2023-09-30T17:04:01.137 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.002120458 2023-09-30T17:04:01.137 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.137 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.137 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:01.137 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049389+0000", 2023-09-30T17:04:01.138 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22603278199999999 2023-09-30T17:04:01.138 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.138 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.138 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:01.138 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049443+0000", 2023-09-30T17:04:01.138 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4033000000000003e-05 2023-09-30T17:04:01.138 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:01.138 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:01.138 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:01.138 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:03:39.049480+0000", 2023-09-30T17:04:01.138 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6816999999999997e-05 2023-09-30T17:04:01.139 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:01.139 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:01.139 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:01.139 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:01.139 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:01.139 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:04:01.140 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:04:01.141 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:01.140+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:01.244 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:01.243+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:01.300 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-09-30T17:04:01.343 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:01.342+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:01.347 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:04:01.347 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2023-09-30T17:04:01.348 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.348 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:86115 4.36 e48/17 4:6da220e6:::100000001f8.0000003f:head v 48'4070, mlcod=48'4058)", 2023-09-30T17:04:01.348 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.291310+0000", 2023-09-30T17:04:01.348 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.050726996000000003, 2023-09-30T17:04:01.348 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.050761911, 2023-09-30T17:04:01.348 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.348 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:01.348 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.348 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.348 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.348 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.291310+0000", 2023-09-30T17:04:01.349 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.349 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.349 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.349 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.349 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.291310+0000", 2023-09-30T17:04:01.349 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.349 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.349 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.349 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.349 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.291311+0000", 2023-09-30T17:04:01.350 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4200000000000002e-07 2023-09-30T17:04:01.350 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.350 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.350 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.350 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.291322+0000", 2023-09-30T17:04:01.350 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1399e-05 2023-09-30T17:04:01.350 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.350 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.350 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.350 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.291329+0000", 2023-09-30T17:04:01.350 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9079999999999998e-06 2023-09-30T17:04:01.351 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.351 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.351 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.351 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.291335+0000", 2023-09-30T17:04:01.351 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5979999999999996e-06 2023-09-30T17:04:01.351 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.351 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.351 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:01.351 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.335732+0000", 2023-09-30T17:04:01.351 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044397009000000001 2023-09-30T17:04:01.351 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.352 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.352 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:01.352 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.335744+0000", 2023-09-30T17:04:01.352 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2109e-05 2023-09-30T17:04:01.352 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.352 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.352 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.352 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.352 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.352 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:86314 4.6 e48/17)", 2023-09-30T17:04:01.352 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.331756+0000", 2023-09-30T17:04:01.352 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.01028099, 2023-09-30T17:04:01.353 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010393622, 2023-09-30T17:04:01.353 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.353 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:01.353 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.353 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.353 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.353 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.331756+0000", 2023-09-30T17:04:01.353 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.353 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.353 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.353 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.353 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.331756+0000", 2023-09-30T17:04:01.354 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.354 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.354 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.354 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.354 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.331757+0000", 2023-09-30T17:04:01.354 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.34e-07 2023-09-30T17:04:01.354 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.354 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.354 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.354 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.331771+0000", 2023-09-30T17:04:01.354 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4259e-05 2023-09-30T17:04:01.355 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.355 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.355 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.355 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.331778+0000", 2023-09-30T17:04:01.355 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.063e-06 2023-09-30T17:04:01.355 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.355 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.355 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.355 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.331784+0000", 2023-09-30T17:04:01.355 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7100000000000004e-06 2023-09-30T17:04:01.355 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.356 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.356 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.356 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.356 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.356 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:86201 4.38 4:1d13bf87:::100000001f8.00000030:head [write 815104~4096 in=4096b,write 1593344~4096 in=4096b,write 1851392~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-09-30T17:04:01.356 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.267843+0000", 2023-09-30T17:04:01.356 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.074193906000000004, 2023-09-30T17:04:01.356 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.074399871000000006, 2023-09-30T17:04:01.356 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.356 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:01.356 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:01.357 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:01.357 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:01.357 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 86201 2023-09-30T17:04:01.357 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.357 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.357 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.357 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.357 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.267843+0000", 2023-09-30T17:04:01.357 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.357 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.357 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.357 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.358 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.267843+0000", 2023-09-30T17:04:01.358 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.358 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.358 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.358 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.358 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.267844+0000", 2023-09-30T17:04:01.358 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7800000000000001e-07 2023-09-30T17:04:01.358 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.358 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.358 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.358 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.267863+0000", 2023-09-30T17:04:01.358 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8561000000000001e-05 2023-09-30T17:04:01.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.359 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.359 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.359 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.267873+0000", 2023-09-30T17:04:01.359 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0017000000000001e-05 2023-09-30T17:04:01.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.359 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.359 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.359 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.267880+0000", 2023-09-30T17:04:01.359 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0589999999999997e-06 2023-09-30T17:04:01.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.360 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.360 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:01.360 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.297667+0000", 2023-09-30T17:04:01.360 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.029787193 2023-09-30T17:04:01.360 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.360 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.360 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:01.360 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.297827+0000", 2023-09-30T17:04:01.360 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016046800000000001 2023-09-30T17:04:01.360 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.360 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.360 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.360 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.361 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.361 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:86265 4.6 e48/17)", 2023-09-30T17:04:01.361 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.315056+0000", 2023-09-30T17:04:01.361 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.026981529000000001, 2023-09-30T17:04:01.361 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.027232108000000001, 2023-09-30T17:04:01.361 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.361 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:01.361 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.361 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.361 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.361 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.315056+0000", 2023-09-30T17:04:01.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.362 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.362 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.362 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.362 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.315056+0000", 2023-09-30T17:04:01.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.362 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.362 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.362 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.362 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.315065+0000", 2023-09-30T17:04:01.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3400000000000004e-06 2023-09-30T17:04:01.363 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.363 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.363 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.363 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.315084+0000", 2023-09-30T17:04:01.363 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8779000000000001e-05 2023-09-30T17:04:01.363 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.363 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.363 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.363 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.315093+0000", 2023-09-30T17:04:01.363 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5810000000000003e-06 2023-09-30T17:04:01.363 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.364 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.364 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.364 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.315101+0000", 2023-09-30T17:04:01.364 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1760000000000004e-06 2023-09-30T17:04:01.364 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.364 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.364 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.364 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.364 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.365 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:86359 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 1413120~4096 in=4096b,write 1478656~4096 in=4096b,write 1564672~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-09-30T17:04:01.365 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.331831+0000", 2023-09-30T17:04:01.365 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.010206349999999999, 2023-09-30T17:04:01.365 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010502664, 2023-09-30T17:04:01.365 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.365 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:01.365 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:01.365 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:01.365 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:01.365 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 86359 2023-09-30T17:04:01.366 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.366 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.366 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.366 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.366 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.331831+0000", 2023-09-30T17:04:01.366 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.366 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.366 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.366 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.366 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.331831+0000", 2023-09-30T17:04:01.366 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.366 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.367 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.367 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.331832+0000", 2023-09-30T17:04:01.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.282e-06 2023-09-30T17:04:01.367 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.367 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.367 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.331851+0000", 2023-09-30T17:04:01.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8547e-05 2023-09-30T17:04:01.367 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.367 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.367 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.331862+0000", 2023-09-30T17:04:01.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1569999999999999e-05 2023-09-30T17:04:01.368 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.331870+0000", 2023-09-30T17:04:01.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0900000000000005e-06 2023-09-30T17:04:01.368 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:01.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.334692+0000", 2023-09-30T17:04:01.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002821114 2023-09-30T17:04:01.368 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.369 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.369 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:01.369 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.334788+0000", 2023-09-30T17:04:01.369 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6241000000000002e-05 2023-09-30T17:04:01.369 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.369 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.369 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:01.369 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.334948+0000", 2023-09-30T17:04:01.369 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016004100000000001 2023-09-30T17:04:01.369 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.370 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.370 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.370 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.370 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.370 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:86235 4.38 4:1d13bf87:::100000001f8.00000030:head [write 3944448~4096 in=4096b,write 4190208~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-09-30T17:04:01.370 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.279059+0000", 2023-09-30T17:04:01.370 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.062977910999999998, 2023-09-30T17:04:01.370 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.063320194999999996, 2023-09-30T17:04:01.370 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.370 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:01.370 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:01.370 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:01.371 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:01.371 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 86235 2023-09-30T17:04:01.371 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.371 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.371 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.371 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.279059+0000", 2023-09-30T17:04:01.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.371 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.371 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.371 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.279059+0000", 2023-09-30T17:04:01.372 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.372 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.372 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.372 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.372 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.279060+0000", 2023-09-30T17:04:01.372 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0800000000000005e-07 2023-09-30T17:04:01.372 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.372 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.372 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.372 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.279067+0000", 2023-09-30T17:04:01.372 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9430000000000003e-06 2023-09-30T17:04:01.373 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.373 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.373 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.373 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.279077+0000", 2023-09-30T17:04:01.373 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0138e-05 2023-09-30T17:04:01.373 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.373 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.373 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.373 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.279085+0000", 2023-09-30T17:04:01.373 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6960000000000005e-06 2023-09-30T17:04:01.373 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.373 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.374 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:01.374 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.324526+0000", 2023-09-30T17:04:01.374 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045441013000000002 2023-09-30T17:04:01.374 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.374 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.374 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:01.374 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.324574+0000", 2023-09-30T17:04:01.374 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7854e-05 2023-09-30T17:04:01.374 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.374 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.374 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.374 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.375 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.375 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:86262 4.36 e48/17)", 2023-09-30T17:04:01.375 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.315123+0000", 2023-09-30T17:04:01.375 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.026914790000000001, 2023-09-30T17:04:01.375 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.027309059, 2023-09-30T17:04:01.375 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.375 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:01.375 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.375 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.375 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.376 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.315123+0000", 2023-09-30T17:04:01.376 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.376 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.376 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.376 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.376 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.315123+0000", 2023-09-30T17:04:01.376 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.377 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.377 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.377 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.377 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.315123+0000", 2023-09-30T17:04:01.377 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5699999999999998e-07 2023-09-30T17:04:01.377 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.377 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.377 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.377 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.315135+0000", 2023-09-30T17:04:01.377 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1834000000000001e-05 2023-09-30T17:04:01.377 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.377 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.378 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.378 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.315142+0000", 2023-09-30T17:04:01.378 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0809999999999996e-06 2023-09-30T17:04:01.378 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.378 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.378 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.378 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.315147+0000", 2023-09-30T17:04:01.378 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2909999999999998e-06 2023-09-30T17:04:01.378 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.378 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.378 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.378 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.379 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.379 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:86360 4.2f 4:f59f865b:::100000001f8.00000007:head [write 1519616~4096 in=4096b,write 1556480~4096 in=4096b,write 2203648~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-09-30T17:04:01.379 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.331884+0000", 2023-09-30T17:04:01.379 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.01015313, 2023-09-30T17:04:01.379 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.01061029, 2023-09-30T17:04:01.379 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.379 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:01.379 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:01.379 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:01.379 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:01.379 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 86360 2023-09-30T17:04:01.380 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.380 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.380 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.380 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.380 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.331884+0000", 2023-09-30T17:04:01.380 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.380 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.380 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.380 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.380 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.331884+0000", 2023-09-30T17:04:01.380 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.381 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.381 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.381 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.381 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.331885+0000", 2023-09-30T17:04:01.381 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0200000000000002e-07 2023-09-30T17:04:01.381 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.381 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.381 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.381 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.331896+0000", 2023-09-30T17:04:01.381 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1827e-05 2023-09-30T17:04:01.382 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.382 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.382 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.382 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.331905+0000", 2023-09-30T17:04:01.382 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2020000000000004e-06 2023-09-30T17:04:01.382 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.382 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.382 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.382 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.331911+0000", 2023-09-30T17:04:01.382 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8459999999999996e-06 2023-09-30T17:04:01.382 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.382 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.383 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:01.383 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.333820+0000", 2023-09-30T17:04:01.383 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001909078 2023-09-30T17:04:01.383 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.383 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.383 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:01.383 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.333895+0000", 2023-09-30T17:04:01.383 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5475000000000005e-05 2023-09-30T17:04:01.383 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.383 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.383 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:01.383 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.334040+0000", 2023-09-30T17:04:01.384 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000144692 2023-09-30T17:04:01.384 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.384 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.384 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.384 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.384 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.384 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:86331 4.28 e48/17 4:15eeb89b:::100000001f8.00000032:head v 48'2678, mlcod=48'2672)", 2023-09-30T17:04:01.384 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.315508+0000", 2023-09-30T17:04:01.384 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.026529693999999999, 2023-09-30T17:04:01.385 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.027081287999999999, 2023-09-30T17:04:01.385 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.385 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:01.385 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.385 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.385 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.385 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.315508+0000", 2023-09-30T17:04:01.385 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.385 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.385 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.385 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.386 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.315508+0000", 2023-09-30T17:04:01.386 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.386 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.386 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.386 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.386 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.315508+0000", 2023-09-30T17:04:01.386 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.44e-07 2023-09-30T17:04:01.386 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.386 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.386 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.386 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.315529+0000", 2023-09-30T17:04:01.386 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0636e-05 2023-09-30T17:04:01.387 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.387 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.387 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.387 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.315536+0000", 2023-09-30T17:04:01.387 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4139999999999997e-06 2023-09-30T17:04:01.387 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.387 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.387 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.387 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.315541+0000", 2023-09-30T17:04:01.387 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3599999999999998e-06 2023-09-30T17:04:01.387 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.388 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.388 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:01.388 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.317405+0000", 2023-09-30T17:04:01.388 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001864 2023-09-30T17:04:01.388 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.388 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.388 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:01.388 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.317424+0000", 2023-09-30T17:04:01.388 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9194e-05 2023-09-30T17:04:01.388 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.388 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.388 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.389 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.389 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.389 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:86361 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 1429504~4096 in=4096b,write 1523712~4096 in=4096b,write 1556480~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-09-30T17:04:01.389 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.331919+0000", 2023-09-30T17:04:01.389 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.010118327999999999, 2023-09-30T17:04:01.389 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010743195000000001, 2023-09-30T17:04:01.389 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.389 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:01.389 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:01.389 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:01.389 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:01.389 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 86361 2023-09-30T17:04:01.390 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.390 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.390 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.390 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.390 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.331919+0000", 2023-09-30T17:04:01.390 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.390 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.390 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.390 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.390 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.331919+0000", 2023-09-30T17:04:01.390 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.391 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.391 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.391 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.391 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.331919+0000", 2023-09-30T17:04:01.391 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1699999999999998e-07 2023-09-30T17:04:01.391 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.391 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.391 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.391 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.331931+0000", 2023-09-30T17:04:01.391 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1189000000000001e-05 2023-09-30T17:04:01.391 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.392 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.392 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.392 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.331938+0000", 2023-09-30T17:04:01.392 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.401e-06 2023-09-30T17:04:01.392 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.392 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.392 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.392 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.331945+0000", 2023-09-30T17:04:01.392 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1400000000000002e-06 2023-09-30T17:04:01.392 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.392 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.392 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:01.393 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.341179+0000", 2023-09-30T17:04:01.393 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0092341550000000008 2023-09-30T17:04:01.393 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.393 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.393 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:01.393 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.341282+0000", 2023-09-30T17:04:01.393 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010247999999999999 2023-09-30T17:04:01.393 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.393 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.393 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.394 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.394 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.394 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:86362 4.38 4.9b7e3478 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-09-30T17:04:01.394 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.331954+0000", 2023-09-30T17:04:01.394 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.010083277999999999, 2023-09-30T17:04:01.394 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010783153, 2023-09-30T17:04:01.394 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.394 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:01.394 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:01.394 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:01.395 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:01.395 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 86362 2023-09-30T17:04:01.395 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.395 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.395 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.395 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.395 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.331954+0000", 2023-09-30T17:04:01.395 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.395 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.395 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.396 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.396 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.331954+0000", 2023-09-30T17:04:01.396 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.396 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.396 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.396 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.396 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.331954+0000", 2023-09-30T17:04:01.396 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5499999999999998e-07 2023-09-30T17:04:01.396 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.396 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.396 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.396 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.331966+0000", 2023-09-30T17:04:01.397 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1259e-05 2023-09-30T17:04:01.397 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.397 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.397 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.397 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.331973+0000", 2023-09-30T17:04:01.397 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5689999999999999e-06 2023-09-30T17:04:01.397 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.397 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.397 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.397 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.331979+0000", 2023-09-30T17:04:01.397 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9630000000000003e-06 2023-09-30T17:04:01.397 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.398 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.398 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.398 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.398 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.398 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:86363 4.35 4:ad9a5eb7:::100000001f8.00000023:head [write 3764224~4096 in=4096b,write 3776512~4096 in=4096b,write 4112384~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-09-30T17:04:01.398 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.331987+0000", 2023-09-30T17:04:01.398 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.010050351000000001, 2023-09-30T17:04:01.398 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010816684999999999, 2023-09-30T17:04:01.398 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.398 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:01.398 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:01.399 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:01.399 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:01.399 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 86363 2023-09-30T17:04:01.399 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.399 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.399 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.399 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.399 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.331987+0000", 2023-09-30T17:04:01.399 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.399 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.400 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.400 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.400 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.331987+0000", 2023-09-30T17:04:01.400 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.400 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.400 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.400 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.400 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.331987+0000", 2023-09-30T17:04:01.400 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.08e-07 2023-09-30T17:04:01.400 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.400 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.400 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.401 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.331997+0000", 2023-09-30T17:04:01.401 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8109999999999997e-06 2023-09-30T17:04:01.401 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.401 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.401 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.401 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.332004+0000", 2023-09-30T17:04:01.401 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1879999999999996e-06 2023-09-30T17:04:01.401 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.401 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.401 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.401 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.332010+0000", 2023-09-30T17:04:01.401 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5740000000000003e-06 2023-09-30T17:04:01.402 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.402 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.402 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:01.402 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.332054+0000", 2023-09-30T17:04:01.402 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4286999999999998e-05 2023-09-30T17:04:01.402 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.402 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.402 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:01.402 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.332139+0000", 2023-09-30T17:04:01.402 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4919999999999993e-05 2023-09-30T17:04:01.402 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.403 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.403 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.403 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.403 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.403 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:86188 4.2e e48/17)", 2023-09-30T17:04:01.403 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.303894+0000", 2023-09-30T17:04:01.403 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.038143298999999999, 2023-09-30T17:04:01.403 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.038979791, 2023-09-30T17:04:01.404 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.404 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:01.404 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.404 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.404 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.404 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.303894+0000", 2023-09-30T17:04:01.404 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.404 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.404 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.405 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.405 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.303894+0000", 2023-09-30T17:04:01.405 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.405 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.405 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.405 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.405 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.303895+0000", 2023-09-30T17:04:01.405 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1600000000000001e-07 2023-09-30T17:04:01.405 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.405 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.405 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.406 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.303906+0000", 2023-09-30T17:04:01.406 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1369000000000001e-05 2023-09-30T17:04:01.406 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.406 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.406 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.406 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.303916+0000", 2023-09-30T17:04:01.406 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0246e-05 2023-09-30T17:04:01.406 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.406 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.406 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.406 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.303921+0000", 2023-09-30T17:04:01.406 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.198e-06 2023-09-30T17:04:01.406 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.407 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.407 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.407 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.407 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.407 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:86365 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-09-30T17:04:01.407 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.332130+0000", 2023-09-30T17:04:01.407 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0099077929999999998, 2023-09-30T17:04:01.407 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010796336, 2023-09-30T17:04:01.407 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.407 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:01.407 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:01.407 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:01.408 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:01.408 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 86365 2023-09-30T17:04:01.408 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.408 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.408 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.408 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.408 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.332130+0000", 2023-09-30T17:04:01.408 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.408 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.408 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.409 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.409 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.332130+0000", 2023-09-30T17:04:01.409 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.409 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.409 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.409 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.409 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.332130+0000", 2023-09-30T17:04:01.409 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4899999999999995e-07 2023-09-30T17:04:01.409 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.409 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.409 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.409 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.332185+0000", 2023-09-30T17:04:01.410 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5158000000000003e-05 2023-09-30T17:04:01.410 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.410 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.410 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.410 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.332196+0000", 2023-09-30T17:04:01.410 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0642000000000001e-05 2023-09-30T17:04:01.410 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.410 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.410 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.410 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.332203+0000", 2023-09-30T17:04:01.410 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5299999999999999e-06 2023-09-30T17:04:01.410 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.411 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.411 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.411 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.411 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.411 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:86207 4.38 4:1fc350da:::100000001f8.0000002f:head [write 208896~4096 in=4096b,write 352256~4096 in=4096b,write 491520~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-09-30T17:04:01.411 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.270221+0000", 2023-09-30T17:04:01.411 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.071816252999999997, 2023-09-30T17:04:01.411 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.072768083999999997, 2023-09-30T17:04:01.411 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.411 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:01.412 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:01.412 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:01.412 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:01.412 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 86207 2023-09-30T17:04:01.412 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.412 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.412 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.412 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.412 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.270221+0000", 2023-09-30T17:04:01.412 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.412 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.413 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.413 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.413 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.270221+0000", 2023-09-30T17:04:01.413 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.413 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.413 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.413 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.413 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.270222+0000", 2023-09-30T17:04:01.413 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.065e-06 2023-09-30T17:04:01.413 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.414 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.414 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.414 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.270234+0000", 2023-09-30T17:04:01.414 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1572e-05 2023-09-30T17:04:01.414 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.414 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.414 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.414 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.270244+0000", 2023-09-30T17:04:01.414 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8309999999999996e-06 2023-09-30T17:04:01.414 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.414 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.415 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.415 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.270251+0000", 2023-09-30T17:04:01.415 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2119999999999997e-06 2023-09-30T17:04:01.415 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.415 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.415 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:01.415 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.312252+0000", 2023-09-30T17:04:01.415 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042001747999999998 2023-09-30T17:04:01.415 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.415 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.416 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:01.416 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.312347+0000", 2023-09-30T17:04:01.416 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4334999999999997e-05 2023-09-30T17:04:01.416 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.416 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.416 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.416 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.416 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.416 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:86148 4.6 e48/17 4:616d4c41:::100000001f8.00000034:head v 48'5308, mlcod=48'5297)", 2023-09-30T17:04:01.416 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.294930+0000", 2023-09-30T17:04:01.416 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.047107199000000002, 2023-09-30T17:04:01.417 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048129699999999997, 2023-09-30T17:04:01.417 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.417 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:01.417 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.417 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.417 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.417 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.294930+0000", 2023-09-30T17:04:01.417 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.417 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.417 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.417 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.417 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.294930+0000", 2023-09-30T17:04:01.417 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.418 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.418 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.418 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.418 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.294931+0000", 2023-09-30T17:04:01.418 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6299999999999993e-07 2023-09-30T17:04:01.418 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.418 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.418 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.418 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.294945+0000", 2023-09-30T17:04:01.419 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4168999999999999e-05 2023-09-30T17:04:01.419 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.419 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.419 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.419 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.294954+0000", 2023-09-30T17:04:01.419 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9109999999999999e-06 2023-09-30T17:04:01.419 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.419 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.419 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.419 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.294961+0000", 2023-09-30T17:04:01.419 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2899999999999997e-06 2023-09-30T17:04:01.419 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.420 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.420 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:01.420 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.337860+0000", 2023-09-30T17:04:01.420 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042898302999999999 2023-09-30T17:04:01.420 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.420 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.420 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:01.420 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.337877+0000", 2023-09-30T17:04:01.420 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.766e-05 2023-09-30T17:04:01.420 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.420 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.421 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.421 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.421 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.421 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:86185 4.6 e48/17)", 2023-09-30T17:04:01.421 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.303954+0000", 2023-09-30T17:04:01.421 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.038082940000000003, 2023-09-30T17:04:01.421 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039142867999999997, 2023-09-30T17:04:01.421 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.421 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:01.421 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.421 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.422 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.422 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.303954+0000", 2023-09-30T17:04:01.422 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.422 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.422 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.422 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.422 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.303954+0000", 2023-09-30T17:04:01.422 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.422 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.422 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.423 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.423 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.303955+0000", 2023-09-30T17:04:01.423 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2600000000000001e-07 2023-09-30T17:04:01.423 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.423 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.423 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.423 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.303963+0000", 2023-09-30T17:04:01.423 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9179999999999994e-06 2023-09-30T17:04:01.423 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.423 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.423 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.423 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.303967+0000", 2023-09-30T17:04:01.424 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5900000000000001e-06 2023-09-30T17:04:01.424 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.424 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.424 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.424 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.303978+0000", 2023-09-30T17:04:01.424 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0927999999999999e-05 2023-09-30T17:04:01.424 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.424 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.424 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.424 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.425 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.425 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:86367 4.2c 4:35cbff5f:::100000001f8.00000033:head [write 946176~4096 in=4096b,write 958464~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-09-30T17:04:01.425 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.333057+0000", 2023-09-30T17:04:01.425 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0089802839999999998, 2023-09-30T17:04:01.425 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010071412, 2023-09-30T17:04:01.425 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.425 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:01.425 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:01.425 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:01.426 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:01.426 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 86367 2023-09-30T17:04:01.426 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.426 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.426 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.426 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.426 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.333057+0000", 2023-09-30T17:04:01.426 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.426 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.427 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.427 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.427 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.333057+0000", 2023-09-30T17:04:01.427 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.427 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.427 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.427 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.427 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.333058+0000", 2023-09-30T17:04:01.427 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5499999999999996e-07 2023-09-30T17:04:01.427 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.428 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.428 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.428 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.333073+0000", 2023-09-30T17:04:01.428 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.467e-05 2023-09-30T17:04:01.428 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.428 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.428 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.428 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.333088+0000", 2023-09-30T17:04:01.428 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5534000000000001e-05 2023-09-30T17:04:01.428 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.428 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.429 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.429 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.333096+0000", 2023-09-30T17:04:01.429 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7530000000000001e-06 2023-09-30T17:04:01.429 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.429 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.429 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:01.429 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.333558+0000", 2023-09-30T17:04:01.429 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00046160999999999999 2023-09-30T17:04:01.429 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.430 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.430 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:01.430 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.333629+0000", 2023-09-30T17:04:01.430 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0967e-05 2023-09-30T17:04:01.430 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.430 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.430 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.430 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.430 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.431 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:86338 4.28 e48/17 4:15eeb89b:::100000001f8.00000032:head v 48'2679, mlcod=48'2672)", 2023-09-30T17:04:01.431 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.319059+0000", 2023-09-30T17:04:01.431 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.022977826, 2023-09-30T17:04:01.431 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.024113229, 2023-09-30T17:04:01.431 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.431 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:01.431 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.431 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.431 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.431 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.319059+0000", 2023-09-30T17:04:01.431 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.432 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.432 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.432 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.432 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.319059+0000", 2023-09-30T17:04:01.432 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.432 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.432 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.432 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.432 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.319060+0000", 2023-09-30T17:04:01.433 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2200000000000004e-07 2023-09-30T17:04:01.433 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.433 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.433 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.433 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.319087+0000", 2023-09-30T17:04:01.433 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6601000000000002e-05 2023-09-30T17:04:01.433 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.433 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.433 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.434 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.319096+0000", 2023-09-30T17:04:01.434 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7340000000000003e-06 2023-09-30T17:04:01.434 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.434 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.434 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.434 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.319104+0000", 2023-09-30T17:04:01.434 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9219999999999997e-06 2023-09-30T17:04:01.434 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.434 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.435 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:01.435 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.319951+0000", 2023-09-30T17:04:01.435 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00084653199999999999 2023-09-30T17:04:01.435 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.435 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.435 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:01.435 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.319969+0000", 2023-09-30T17:04:01.435 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8048999999999999e-05 2023-09-30T17:04:01.435 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.435 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.436 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.436 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.436 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.436 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:86366 4.33 e48/17 4:cf6d7a6c:::100000001f8.0000000a:head v 48'1367, mlcod=48'1364)", 2023-09-30T17:04:01.436 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.333149+0000", 2023-09-30T17:04:01.436 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0088883209999999994, 2023-09-30T17:04:01.436 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010056776999999999, 2023-09-30T17:04:01.436 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.437 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:01.437 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.437 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.437 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.437 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.333149+0000", 2023-09-30T17:04:01.437 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.437 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.437 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.437 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.437 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.333149+0000", 2023-09-30T17:04:01.438 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.438 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.438 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.438 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.438 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.333150+0000", 2023-09-30T17:04:01.438 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.37e-07 2023-09-30T17:04:01.438 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.438 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.438 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.438 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.333168+0000", 2023-09-30T17:04:01.438 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8620000000000001e-05 2023-09-30T17:04:01.439 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.439 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.439 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.439 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.333178+0000", 2023-09-30T17:04:01.439 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0043e-05 2023-09-30T17:04:01.439 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.439 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.439 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.439 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.333184+0000", 2023-09-30T17:04:01.439 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2979999999999997e-06 2023-09-30T17:04:01.439 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.439 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.440 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:01.440 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.333252+0000", 2023-09-30T17:04:01.440 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7669999999999994e-05 2023-09-30T17:04:01.440 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.440 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.440 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:01.440 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.333273+0000", 2023-09-30T17:04:01.440 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0457000000000001e-05 2023-09-30T17:04:01.440 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.440 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.440 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.440 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.441 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.441 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:86143 4.36 e48/17 4:6da220e6:::100000001f8.0000003f:head v 48'4071, mlcod=48'4058)", 2023-09-30T17:04:01.441 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.294988+0000", 2023-09-30T17:04:01.441 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.047049348999999997, 2023-09-30T17:04:01.441 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048250309999999998, 2023-09-30T17:04:01.441 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.441 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:01.441 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.441 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.441 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.441 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.294988+0000", 2023-09-30T17:04:01.441 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.442 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.442 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.442 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.442 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.294988+0000", 2023-09-30T17:04:01.442 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.442 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.442 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.442 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.442 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.294988+0000", 2023-09-30T17:04:01.442 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8500000000000002e-07 2023-09-30T17:04:01.442 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.442 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.443 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.443 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.295077+0000", 2023-09-30T17:04:01.443 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9027e-05 2023-09-30T17:04:01.443 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.443 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.443 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.295084+0000", 2023-09-30T17:04:01.443 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6200000000000001e-06 2023-09-30T17:04:01.443 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.444 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.444 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.295089+0000", 2023-09-30T17:04:01.444 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9470000000000002e-06 2023-09-30T17:04:01.444 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.444 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.444 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:01.444 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.337852+0000", 2023-09-30T17:04:01.444 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042762708000000003 2023-09-30T17:04:01.444 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.444 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.444 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:01.444 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.337872+0000", 2023-09-30T17:04:01.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0092e-05 2023-09-30T17:04:01.445 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.445 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.445 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.445 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.445 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.445 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:86315 4.6 e48/17)", 2023-09-30T17:04:01.445 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.334500+0000", 2023-09-30T17:04:01.445 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0075369479999999999, 2023-09-30T17:04:01.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0087742840000000002, 2023-09-30T17:04:01.445 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.445 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:01.446 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.446 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.446 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.446 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.334500+0000", 2023-09-30T17:04:01.446 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.446 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.446 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.446 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.446 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.334500+0000", 2023-09-30T17:04:01.446 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.446 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.446 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.447 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.447 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.334501+0000", 2023-09-30T17:04:01.447 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.68e-07 2023-09-30T17:04:01.447 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.447 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.447 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.334525+0000", 2023-09-30T17:04:01.447 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3980000000000001e-05 2023-09-30T17:04:01.447 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.447 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.447 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.334539+0000", 2023-09-30T17:04:01.448 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4059e-05 2023-09-30T17:04:01.448 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.448 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.448 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.334547+0000", 2023-09-30T17:04:01.448 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8990000000000001e-06 2023-09-30T17:04:01.448 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.448 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.448 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.448 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.448 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:86341 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 765952~4096 in=4096b,write 774144~4096 in=4096b,write 806912~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-09-30T17:04:01.448 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.319215+0000", 2023-09-30T17:04:01.449 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.022822206000000001, 2023-09-30T17:04:01.449 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.024117062000000002, 2023-09-30T17:04:01.449 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.449 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:01.449 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:01.449 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:01.449 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:01.449 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 86341 2023-09-30T17:04:01.449 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.449 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.449 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.450 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.450 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.319215+0000", 2023-09-30T17:04:01.450 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.450 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.450 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.450 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.450 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.319215+0000", 2023-09-30T17:04:01.450 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.450 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.450 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.450 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.450 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.319216+0000", 2023-09-30T17:04:01.451 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8800000000000002e-07 2023-09-30T17:04:01.451 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.451 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.451 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.451 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.319226+0000", 2023-09-30T17:04:01.451 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0362e-05 2023-09-30T17:04:01.451 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.451 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.451 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.451 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.319236+0000", 2023-09-30T17:04:01.451 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3060000000000003e-06 2023-09-30T17:04:01.451 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.452 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.452 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.452 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.319243+0000", 2023-09-30T17:04:01.452 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6149999999999999e-06 2023-09-30T17:04:01.452 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.452 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.452 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:01.452 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.332197+0000", 2023-09-30T17:04:01.452 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012954092 2023-09-30T17:04:01.452 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.452 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.452 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:01.453 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.332265+0000", 2023-09-30T17:04:01.453 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7549e-05 2023-09-30T17:04:01.453 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.453 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.453 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.453 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.453 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.453 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:86370 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-09-30T17:04:01.453 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.334570+0000", 2023-09-30T17:04:01.453 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0074675640000000003, 2023-09-30T17:04:01.453 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0087999419999999998, 2023-09-30T17:04:01.453 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.454 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:01.454 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:01.454 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:01.454 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:01.454 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 86370 2023-09-30T17:04:01.454 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.454 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.454 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.454 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.454 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.334570+0000", 2023-09-30T17:04:01.454 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.454 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.455 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.455 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.455 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.334570+0000", 2023-09-30T17:04:01.455 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.455 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.455 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.455 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.455 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.334570+0000", 2023-09-30T17:04:01.455 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.37e-07 2023-09-30T17:04:01.455 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.455 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.456 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.456 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.334586+0000", 2023-09-30T17:04:01.456 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5031999999999999e-05 2023-09-30T17:04:01.456 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.456 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.456 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.456 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.334597+0000", 2023-09-30T17:04:01.456 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1674e-05 2023-09-30T17:04:01.456 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.456 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.456 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.456 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.334606+0000", 2023-09-30T17:04:01.457 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7390000000000005e-06 2023-09-30T17:04:01.457 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.457 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.457 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.457 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.457 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.457 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:86277 4.2e e48/17)", 2023-09-30T17:04:01.457 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.319584+0000", 2023-09-30T17:04:01.457 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.022453562999999999, 2023-09-30T17:04:01.457 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.023815083000000001, 2023-09-30T17:04:01.458 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.458 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:01.458 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.458 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.458 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.458 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.319584+0000", 2023-09-30T17:04:01.458 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.458 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.458 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.458 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.459 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.319584+0000", 2023-09-30T17:04:01.459 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.459 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.459 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.459 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.459 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.319584+0000", 2023-09-30T17:04:01.459 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5499999999999998e-07 2023-09-30T17:04:01.459 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.459 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.459 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.460 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.319609+0000", 2023-09-30T17:04:01.460 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.44e-05 2023-09-30T17:04:01.460 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.460 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.460 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.460 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.319618+0000", 2023-09-30T17:04:01.460 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0159999999999997e-06 2023-09-30T17:04:01.460 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.460 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.461 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.461 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.319624+0000", 2023-09-30T17:04:01.461 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.139e-06 2023-09-30T17:04:01.461 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.461 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.461 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.461 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.461 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.461 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:86371 4.3f e48/17 4:fde182c5:::100000001f8.00000039:head v 48'1318, mlcod=48'1316)", 2023-09-30T17:04:01.461 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.334869+0000", 2023-09-30T17:04:01.461 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0071678569999999997, 2023-09-30T17:04:01.462 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085565559999999999, 2023-09-30T17:04:01.462 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.462 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:01.462 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.462 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.462 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.462 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.334869+0000", 2023-09-30T17:04:01.462 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.462 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.463 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.463 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.334869+0000", 2023-09-30T17:04:01.463 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.463 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.463 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.463 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.334870+0000", 2023-09-30T17:04:01.463 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1699999999999998e-07 2023-09-30T17:04:01.463 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.464 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.464 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.464 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.334890+0000", 2023-09-30T17:04:01.464 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9945999999999998e-05 2023-09-30T17:04:01.464 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.464 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.464 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.464 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.334901+0000", 2023-09-30T17:04:01.464 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0669000000000001e-05 2023-09-30T17:04:01.464 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.465 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.465 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.465 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.334911+0000", 2023-09-30T17:04:01.465 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8490000000000001e-06 2023-09-30T17:04:01.465 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.465 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.465 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:01.465 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.337208+0000", 2023-09-30T17:04:01.465 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002297005 2023-09-30T17:04:01.466 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.466 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.466 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:01.466 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.337238+0000", 2023-09-30T17:04:01.466 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0888e-05 2023-09-30T17:04:01.466 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.466 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.466 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.466 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.466 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.467 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:86373 4.35 4:ad9a5eb7:::100000001f8.00000023:head [write 1449984~4096 in=4096b,write 1527808~4096 in=4096b,write 1601536~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-09-30T17:04:01.467 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.335346+0000", 2023-09-30T17:04:01.467 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0066912680000000002, 2023-09-30T17:04:01.467 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0081156969999999998, 2023-09-30T17:04:01.467 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.467 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:01.467 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:01.467 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:01.467 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:01.468 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 86373 2023-09-30T17:04:01.468 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.468 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.468 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.468 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.468 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.335346+0000", 2023-09-30T17:04:01.468 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.468 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.468 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.468 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.468 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.335346+0000", 2023-09-30T17:04:01.469 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.469 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.469 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.469 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.469 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.335347+0000", 2023-09-30T17:04:01.469 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5099999999999998e-07 2023-09-30T17:04:01.469 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.469 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.469 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.469 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.335362+0000", 2023-09-30T17:04:01.469 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.483e-05 2023-09-30T17:04:01.469 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.470 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.470 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.470 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.335378+0000", 2023-09-30T17:04:01.470 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5988e-05 2023-09-30T17:04:01.470 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.470 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.470 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.470 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.335386+0000", 2023-09-30T17:04:01.470 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1829999999999994e-06 2023-09-30T17:04:01.471 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.471 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.471 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:01.471 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.339258+0000", 2023-09-30T17:04:01.471 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038717790000000001 2023-09-30T17:04:01.471 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.471 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.471 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:01.472 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.339345+0000", 2023-09-30T17:04:01.472 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6916000000000006e-05 2023-09-30T17:04:01.472 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.472 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.472 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.472 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.472 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.472 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:86345 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 2580480~4096 in=4096b,write 2637824~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-09-30T17:04:01.472 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.321901+0000", 2023-09-30T17:04:01.472 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.020136711000000002, 2023-09-30T17:04:01.473 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021604992999999999, 2023-09-30T17:04:01.473 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.473 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:01.473 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:01.473 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:01.473 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:01.473 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 86345 2023-09-30T17:04:01.473 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.473 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.473 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.473 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.473 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.321901+0000", 2023-09-30T17:04:01.474 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.474 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.474 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.474 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.474 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.321901+0000", 2023-09-30T17:04:01.474 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.474 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.474 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.474 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.474 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.321902+0000", 2023-09-30T17:04:01.474 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0729999999999999e-06 2023-09-30T17:04:01.475 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.475 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.475 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.475 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.321917+0000", 2023-09-30T17:04:01.475 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5362e-05 2023-09-30T17:04:01.475 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.475 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.475 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.475 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.321926+0000", 2023-09-30T17:04:01.475 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3190000000000001e-06 2023-09-30T17:04:01.476 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.476 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.476 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.476 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.321933+0000", 2023-09-30T17:04:01.476 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2500000000000003e-06 2023-09-30T17:04:01.476 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.476 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.476 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:01.476 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.337408+0000", 2023-09-30T17:04:01.476 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015475088999999999 2023-09-30T17:04:01.476 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.476 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.477 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:01.477 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.337496+0000", 2023-09-30T17:04:01.477 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8412000000000007e-05 2023-09-30T17:04:01.477 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.477 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.477 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.477 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.477 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.477 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:86376 4.38 4.9b7e3478 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-09-30T17:04:01.477 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.336603+0000", 2023-09-30T17:04:01.477 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0054343209999999998, 2023-09-30T17:04:01.477 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006982696, 2023-09-30T17:04:01.478 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.478 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:01.478 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:01.478 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:01.478 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:01.478 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 86376 2023-09-30T17:04:01.478 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.478 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.478 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.478 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.478 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.336603+0000", 2023-09-30T17:04:01.479 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.479 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.479 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.479 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.479 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.336603+0000", 2023-09-30T17:04:01.479 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.479 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.479 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.479 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.479 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.336604+0000", 2023-09-30T17:04:01.479 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7900000000000007e-07 2023-09-30T17:04:01.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.480 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.480 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.336632+0000", 2023-09-30T17:04:01.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7834000000000002e-05 2023-09-30T17:04:01.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.480 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.480 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.336645+0000", 2023-09-30T17:04:01.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3448999999999999e-05 2023-09-30T17:04:01.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.481 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.481 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.336654+0000", 2023-09-30T17:04:01.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.388e-06 2023-09-30T17:04:01.481 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.481 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.481 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.481 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.481 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.481 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:86193 4.2e e48/17)", 2023-09-30T17:04:01.481 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.305481+0000", 2023-09-30T17:04:01.481 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.036556204000000002, 2023-09-30T17:04:01.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.038167039, 2023-09-30T17:04:01.482 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.482 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:01.482 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.482 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.482 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.482 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.305481+0000", 2023-09-30T17:04:01.482 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.482 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.482 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.482 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.482 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.305481+0000", 2023-09-30T17:04:01.483 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.483 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.483 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.483 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.483 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.305481+0000", 2023-09-30T17:04:01.483 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.96e-07 2023-09-30T17:04:01.483 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.483 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.483 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.483 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.305488+0000", 2023-09-30T17:04:01.484 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0350000000000004e-06 2023-09-30T17:04:01.484 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.484 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.484 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.484 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.305495+0000", 2023-09-30T17:04:01.484 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6749999999999996e-06 2023-09-30T17:04:01.484 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.484 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.484 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.484 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.305499+0000", 2023-09-30T17:04:01.484 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9539999999999998e-06 2023-09-30T17:04:01.485 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.485 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.485 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.485 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.485 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.485 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:86318 4.6 e48/17)", 2023-09-30T17:04:01.485 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.336677+0000", 2023-09-30T17:04:01.485 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0053600779999999999, 2023-09-30T17:04:01.485 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070239050000000004, 2023-09-30T17:04:01.485 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.485 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:01.485 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.486 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.486 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.486 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.336677+0000", 2023-09-30T17:04:01.486 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.486 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.486 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.486 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.486 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.336677+0000", 2023-09-30T17:04:01.486 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.486 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.486 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.486 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.487 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.336678+0000", 2023-09-30T17:04:01.487 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8599999999999997e-07 2023-09-30T17:04:01.487 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.487 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.487 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.487 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.336691+0000", 2023-09-30T17:04:01.487 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3183999999999999e-05 2023-09-30T17:04:01.487 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.487 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.487 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.487 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.336700+0000", 2023-09-30T17:04:01.487 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1300000000000007e-06 2023-09-30T17:04:01.488 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.488 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.488 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.488 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.336706+0000", 2023-09-30T17:04:01.488 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.908e-06 2023-09-30T17:04:01.488 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.488 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.488 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.488 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.488 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.488 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:86283 4.6 e48/17)", 2023-09-30T17:04:01.489 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.322941+0000", 2023-09-30T17:04:01.489 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.019096128, 2023-09-30T17:04:01.489 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020793255, 2023-09-30T17:04:01.489 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.489 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:01.489 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.489 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.489 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.322941+0000", 2023-09-30T17:04:01.489 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.490 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.490 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.322941+0000", 2023-09-30T17:04:01.490 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.490 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.490 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.490 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.490 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.322942+0000", 2023-09-30T17:04:01.490 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.61e-07 2023-09-30T17:04:01.490 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.490 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.490 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.490 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.322966+0000", 2023-09-30T17:04:01.491 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3941e-05 2023-09-30T17:04:01.491 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.491 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.491 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.491 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.322979+0000", 2023-09-30T17:04:01.491 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2955999999999999e-05 2023-09-30T17:04:01.491 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.491 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.491 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.491 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.322985+0000", 2023-09-30T17:04:01.491 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.618e-06 2023-09-30T17:04:01.491 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.491 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.492 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.492 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.492 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.492 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:86344 4.36 e48/17)", 2023-09-30T17:04:01.492 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.336910+0000", 2023-09-30T17:04:01.492 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0051276849999999999, 2023-09-30T17:04:01.492 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006860456, 2023-09-30T17:04:01.492 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.492 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:01.492 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.492 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.493 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.493 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.336910+0000", 2023-09-30T17:04:01.493 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.493 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.493 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.493 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.493 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.336910+0000", 2023-09-30T17:04:01.493 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.493 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.494 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.494 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.494 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.336910+0000", 2023-09-30T17:04:01.494 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2e-07 2023-09-30T17:04:01.494 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.494 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.494 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.494 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.336923+0000", 2023-09-30T17:04:01.494 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3111e-05 2023-09-30T17:04:01.494 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.495 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.495 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.495 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.336943+0000", 2023-09-30T17:04:01.495 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.959e-05 2023-09-30T17:04:01.495 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.495 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.495 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.495 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.336950+0000", 2023-09-30T17:04:01.495 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8900000000000001e-06 2023-09-30T17:04:01.495 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.495 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.495 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.496 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.496 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.496 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:86280 4.2e e48/17)", 2023-09-30T17:04:01.496 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.323043+0000", 2023-09-30T17:04:01.496 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.018994015, 2023-09-30T17:04:01.496 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020764647000000001, 2023-09-30T17:04:01.496 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.496 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:01.496 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.496 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.496 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.497 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.323043+0000", 2023-09-30T17:04:01.497 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.497 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.497 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.497 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.497 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.323043+0000", 2023-09-30T17:04:01.497 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.497 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.497 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.497 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.498 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.323044+0000", 2023-09-30T17:04:01.498 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2500000000000001e-07 2023-09-30T17:04:01.498 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.498 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.498 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.498 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.323063+0000", 2023-09-30T17:04:01.498 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9426999999999999e-05 2023-09-30T17:04:01.498 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.498 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.498 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.498 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.323071+0000", 2023-09-30T17:04:01.499 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3989999999999998e-06 2023-09-30T17:04:01.499 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.499 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.499 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.499 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.323076+0000", 2023-09-30T17:04:01.499 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3340000000000001e-06 2023-09-30T17:04:01.499 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.499 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.499 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.499 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.499 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.500 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:86377 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-09-30T17:04:01.500 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.337037+0000", 2023-09-30T17:04:01.500 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0050002240000000002, 2023-09-30T17:04:01.500 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006800688, 2023-09-30T17:04:01.500 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.500 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:01.500 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:01.500 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:01.500 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:01.500 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 86377 2023-09-30T17:04:01.500 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.501 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.501 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.501 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.501 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.337037+0000", 2023-09-30T17:04:01.501 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.501 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.501 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.501 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.501 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.337037+0000", 2023-09-30T17:04:01.501 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.501 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.502 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.502 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.502 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.337038+0000", 2023-09-30T17:04:01.502 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8400000000000003e-07 2023-09-30T17:04:01.502 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.502 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.502 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.502 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.337054+0000", 2023-09-30T17:04:01.502 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.66e-05 2023-09-30T17:04:01.502 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.503 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.503 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.503 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.337076+0000", 2023-09-30T17:04:01.503 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1574999999999999e-05 2023-09-30T17:04:01.503 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.503 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.503 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.503 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.337086+0000", 2023-09-30T17:04:01.503 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.043e-05 2023-09-30T17:04:01.503 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.504 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.504 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.504 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.504 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.504 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:86219 4.38 4:1d13bf87:::100000001f8.00000030:head [write 2707456~4096 in=4096b,write 2785280~4096 in=4096b,write 2854912~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-09-30T17:04:01.504 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.273661+0000", 2023-09-30T17:04:01.504 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.068376110000000004, 2023-09-30T17:04:01.504 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.070217874999999999, 2023-09-30T17:04:01.504 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.504 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:01.504 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:01.505 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:01.505 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:01.505 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 86219 2023-09-30T17:04:01.505 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.505 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.505 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.505 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.505 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.273661+0000", 2023-09-30T17:04:01.505 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.505 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.505 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.505 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.506 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.273661+0000", 2023-09-30T17:04:01.506 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.506 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.506 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.506 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.273662+0000", 2023-09-30T17:04:01.506 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9999999999999997e-07 2023-09-30T17:04:01.506 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.506 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.506 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.273678+0000", 2023-09-30T17:04:01.506 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6348999999999999e-05 2023-09-30T17:04:01.507 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.507 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.507 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.507 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.273685+0000", 2023-09-30T17:04:01.507 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3840000000000002e-06 2023-09-30T17:04:01.507 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.507 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.507 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.507 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.273689+0000", 2023-09-30T17:04:01.507 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1339999999999997e-06 2023-09-30T17:04:01.507 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.507 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.508 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:01.508 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.314812+0000", 2023-09-30T17:04:01.508 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.041123358999999998 2023-09-30T17:04:01.508 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.508 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.508 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:01.508 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.314915+0000", 2023-09-30T17:04:01.508 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000103041 2023-09-30T17:04:01.508 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.508 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.508 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.508 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.509 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.509 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:86310 4.38 4:1d13bf87:::100000001f8.00000030:head [write 565248~4096 in=4096b,write 589824~4096 in=4096b,write 798720~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-09-30T17:04:01.509 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.306574+0000", 2023-09-30T17:04:01.509 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.035463506999999998, 2023-09-30T17:04:01.509 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.037351265000000002, 2023-09-30T17:04:01.509 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.509 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:01.509 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:01.509 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:01.509 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:01.509 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 86310 2023-09-30T17:04:01.509 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.510 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.510 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.510 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.510 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.306574+0000", 2023-09-30T17:04:01.510 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.510 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.510 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.510 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.510 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.306574+0000", 2023-09-30T17:04:01.510 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.511 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.511 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.511 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.511 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.306574+0000", 2023-09-30T17:04:01.511 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0299999999999999e-07 2023-09-30T17:04:01.511 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.511 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.511 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.511 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.306585+0000", 2023-09-30T17:04:01.511 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0257e-05 2023-09-30T17:04:01.511 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.511 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.512 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.512 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.306594+0000", 2023-09-30T17:04:01.512 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1109999999999997e-06 2023-09-30T17:04:01.512 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.512 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.512 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.512 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.306598+0000", 2023-09-30T17:04:01.512 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6820000000000002e-06 2023-09-30T17:04:01.512 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.512 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.512 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:01.513 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.330562+0000", 2023-09-30T17:04:01.513 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.023963690999999999 2023-09-30T17:04:01.513 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.513 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.513 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:01.513 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.330679+0000", 2023-09-30T17:04:01.513 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011666 2023-09-30T17:04:01.513 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.513 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.513 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.513 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.513 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.514 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:86378 4.12 4:4be51a30:::100000001f8.0000000b:head [write 1032192~4096 in=4096b,write 1040384~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-09-30T17:04:01.514 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.337340+0000", 2023-09-30T17:04:01.514 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.004697456, 2023-09-30T17:04:01.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0066264280000000002, 2023-09-30T17:04:01.514 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.514 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:01.514 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:01.514 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:01.514 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:01.514 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 86378 2023-09-30T17:04:01.514 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.515 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.515 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.515 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.337340+0000", 2023-09-30T17:04:01.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.515 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.515 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.337340+0000", 2023-09-30T17:04:01.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.516 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.516 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.337341+0000", 2023-09-30T17:04:01.516 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5199999999999996e-07 2023-09-30T17:04:01.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.516 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.516 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.337351+0000", 2023-09-30T17:04:01.516 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0463e-05 2023-09-30T17:04:01.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.516 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.516 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.337364+0000", 2023-09-30T17:04:01.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3227000000000001e-05 2023-09-30T17:04:01.517 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.517 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.517 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.337372+0000", 2023-09-30T17:04:01.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6380000000000004e-06 2023-09-30T17:04:01.517 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.517 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:01.517 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.337420+0000", 2023-09-30T17:04:01.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7722999999999997e-05 2023-09-30T17:04:01.518 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.518 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.518 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:01.518 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.337472+0000", 2023-09-30T17:04:01.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2806000000000002e-05 2023-09-30T17:04:01.518 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.518 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.518 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:01.518 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.337581+0000", 2023-09-30T17:04:01.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010896 2023-09-30T17:04:01.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.519 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:01.519 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.341505+0000", 2023-09-30T17:04:01.519 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039238720000000001 2023-09-30T17:04:01.519 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.519 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.519 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.519 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:86154 4.2e e48/17 4:75be0f36:::100000001f8.0000003d:head v 48'1316, mlcod=48'1312)", 2023-09-30T17:04:01.519 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.297648+0000", 2023-09-30T17:04:01.520 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.044389553999999998, 2023-09-30T17:04:01.520 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.046362225, 2023-09-30T17:04:01.520 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.520 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:01.520 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.520 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.520 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.520 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.297648+0000", 2023-09-30T17:04:01.520 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.520 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.520 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.521 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.521 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.297648+0000", 2023-09-30T17:04:01.521 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.521 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.521 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.521 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.521 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.297648+0000", 2023-09-30T17:04:01.521 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7400000000000003e-07 2023-09-30T17:04:01.521 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.521 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.521 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.521 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.297668+0000", 2023-09-30T17:04:01.522 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9724e-05 2023-09-30T17:04:01.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.522 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.522 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.297715+0000", 2023-09-30T17:04:01.522 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7320000000000001e-05 2023-09-30T17:04:01.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.522 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.522 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.297722+0000", 2023-09-30T17:04:01.522 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5660000000000003e-06 2023-09-30T17:04:01.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.523 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:01.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.342060+0000", 2023-09-30T17:04:01.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044337964000000001 2023-09-30T17:04:01.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.523 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:01.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.342079+0000", 2023-09-30T17:04:01.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9505e-05 2023-09-30T17:04:01.523 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.523 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.524 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.524 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.524 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.524 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:86250 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 69632~4096 in=4096b,write 188416~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-09-30T17:04:01.524 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.285252+0000", 2023-09-30T17:04:01.524 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.056784951, 2023-09-30T17:04:01.524 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.058792628999999999, 2023-09-30T17:04:01.524 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.524 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:01.524 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:01.525 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:01.525 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:01.525 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 86250 2023-09-30T17:04:01.525 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.525 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.525 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.525 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.525 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.285252+0000", 2023-09-30T17:04:01.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.525 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.525 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.526 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.526 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.285252+0000", 2023-09-30T17:04:01.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.526 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.526 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.526 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.285253+0000", 2023-09-30T17:04:01.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4199999999999995e-07 2023-09-30T17:04:01.526 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.526 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.527 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.285262+0000", 2023-09-30T17:04:01.527 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5490000000000006e-06 2023-09-30T17:04:01.527 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.527 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.527 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.527 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.285270+0000", 2023-09-30T17:04:01.527 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0679999999999997e-06 2023-09-30T17:04:01.527 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.527 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.527 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.527 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.285276+0000", 2023-09-30T17:04:01.528 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1190000000000002e-06 2023-09-30T17:04:01.528 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.528 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.528 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:01.528 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.326619+0000", 2023-09-30T17:04:01.528 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.041343706000000001 2023-09-30T17:04:01.528 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.528 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.528 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:01.528 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.326693+0000", 2023-09-30T17:04:01.528 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3946e-05 2023-09-30T17:04:01.528 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.529 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.529 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.529 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.529 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.529 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:86158 4.6 e48/17 4:63e80496:::100000001f8.0000001e:head v 48'5309, mlcod=48'5298)", 2023-09-30T17:04:01.529 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.297810+0000", 2023-09-30T17:04:01.529 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.044227161000000001, 2023-09-30T17:04:01.529 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.046272175999999998, 2023-09-30T17:04:01.529 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.529 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:01.529 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.529 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.530 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.530 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.297810+0000", 2023-09-30T17:04:01.530 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.530 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.530 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.530 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.530 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.297810+0000", 2023-09-30T17:04:01.530 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.530 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.530 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.530 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.531 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.297811+0000", 2023-09-30T17:04:01.531 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7000000000000005e-07 2023-09-30T17:04:01.531 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.531 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.531 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.531 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.297825+0000", 2023-09-30T17:04:01.531 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4073000000000001e-05 2023-09-30T17:04:01.531 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.531 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.531 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.531 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.297834+0000", 2023-09-30T17:04:01.531 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7679999999999997e-06 2023-09-30T17:04:01.532 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.532 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.532 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.532 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.297840+0000", 2023-09-30T17:04:01.532 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3720000000000001e-06 2023-09-30T17:04:01.532 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.532 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.532 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:01.532 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.342139+0000", 2023-09-30T17:04:01.532 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044298636000000002 2023-09-30T17:04:01.532 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.533 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.533 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:01.533 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.342156+0000", 2023-09-30T17:04:01.533 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7136999999999999e-05 2023-09-30T17:04:01.533 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.533 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.533 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.533 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.533 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.533 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:86205 4.6 e48/17)", 2023-09-30T17:04:01.533 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.306886+0000", 2023-09-30T17:04:01.534 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.035151236000000002, 2023-09-30T17:04:01.534 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.037236282000000002, 2023-09-30T17:04:01.534 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.534 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:01.534 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.534 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.534 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.534 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.306886+0000", 2023-09-30T17:04:01.534 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.534 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.535 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.535 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.535 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.306886+0000", 2023-09-30T17:04:01.535 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.535 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.535 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.535 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.535 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.306886+0000", 2023-09-30T17:04:01.535 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7599999999999998e-07 2023-09-30T17:04:01.535 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.536 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.536 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.536 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.306903+0000", 2023-09-30T17:04:01.536 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6489000000000001e-05 2023-09-30T17:04:01.536 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.536 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.536 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.536 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.306911+0000", 2023-09-30T17:04:01.536 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8669999999999994e-06 2023-09-30T17:04:01.536 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.536 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.537 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.537 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.306914+0000", 2023-09-30T17:04:01.537 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.501e-06 2023-09-30T17:04:01.537 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.537 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.537 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.537 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.537 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.537 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:86076 4.6 e48/17 4:616d4c41:::100000001f8.00000034:head v 48'5306, mlcod=48'5297)", 2023-09-30T17:04:01.537 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.285584+0000", 2023-09-30T17:04:01.537 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.056453577999999997, 2023-09-30T17:04:01.538 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.058581818000000001, 2023-09-30T17:04:01.538 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.538 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:01.538 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.538 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.538 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.538 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.285584+0000", 2023-09-30T17:04:01.538 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.538 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.538 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.538 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.538 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.285584+0000", 2023-09-30T17:04:01.539 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.539 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.539 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.539 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.539 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.285584+0000", 2023-09-30T17:04:01.539 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5299999999999999e-07 2023-09-30T17:04:01.539 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.539 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.539 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.539 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.285596+0000", 2023-09-30T17:04:01.539 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.155e-05 2023-09-30T17:04:01.540 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.540 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.540 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.540 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.285604+0000", 2023-09-30T17:04:01.540 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0390000000000005e-06 2023-09-30T17:04:01.540 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.540 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.540 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.540 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.285609+0000", 2023-09-30T17:04:01.540 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6389999999999997e-06 2023-09-30T17:04:01.540 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.540 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.541 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:01.541 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.331819+0000", 2023-09-30T17:04:01.541 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.046209695000000002 2023-09-30T17:04:01.541 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.541 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.541 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:01.541 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.331838+0000", 2023-09-30T17:04:01.541 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8763999999999999e-05 2023-09-30T17:04:01.541 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.541 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.541 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.542 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.542 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.542 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:86285 4.28 e48/17 4:153ae410:::100000001f8.0000003b:head v 48'2677, mlcod=48'2671)", 2023-09-30T17:04:01.542 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.297882+0000", 2023-09-30T17:04:01.542 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.044155462999999999, 2023-09-30T17:04:01.542 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.046346265999999997, 2023-09-30T17:04:01.542 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.542 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:01.542 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.542 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.542 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.543 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.297882+0000", 2023-09-30T17:04:01.543 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.543 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.543 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.543 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.543 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.297882+0000", 2023-09-30T17:04:01.543 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.543 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.543 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.543 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.543 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.297882+0000", 2023-09-30T17:04:01.543 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1399999999999998e-07 2023-09-30T17:04:01.544 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.544 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.544 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.544 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.297913+0000", 2023-09-30T17:04:01.544 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1158000000000002e-05 2023-09-30T17:04:01.544 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.544 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.544 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.544 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.297926+0000", 2023-09-30T17:04:01.544 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2330000000000001e-05 2023-09-30T17:04:01.544 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.544 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.545 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.545 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.297931+0000", 2023-09-30T17:04:01.545 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0089999999999998e-06 2023-09-30T17:04:01.545 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.545 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.545 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:01.545 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.310699+0000", 2023-09-30T17:04:01.545 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012768055 2023-09-30T17:04:01.545 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.546 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.546 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:01.546 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.310718+0000", 2023-09-30T17:04:01.546 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9474e-05 2023-09-30T17:04:01.546 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.546 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.546 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.546 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.546 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.546 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:86379 4.3f e48/17 4:fde182c5:::100000001f8.00000039:head v 48'1319, mlcod=48'1316)", 2023-09-30T17:04:01.546 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.338123+0000", 2023-09-30T17:04:01.546 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0039138489999999996, 2023-09-30T17:04:01.547 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0061635730000000003, 2023-09-30T17:04:01.547 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.547 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:01.547 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.547 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.547 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.547 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.338123+0000", 2023-09-30T17:04:01.547 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.547 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.547 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.547 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.547 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.338123+0000", 2023-09-30T17:04:01.548 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.548 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.548 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.548 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.548 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.338124+0000", 2023-09-30T17:04:01.548 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6400000000000002e-07 2023-09-30T17:04:01.548 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.548 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.548 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.548 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.338135+0000", 2023-09-30T17:04:01.548 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0898e-05 2023-09-30T17:04:01.549 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.549 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.549 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.549 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.338150+0000", 2023-09-30T17:04:01.549 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5027e-05 2023-09-30T17:04:01.549 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.549 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.549 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.549 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.338158+0000", 2023-09-30T17:04:01.549 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7000000000000008e-06 2023-09-30T17:04:01.549 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.550 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.550 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:01.550 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.342159+0000", 2023-09-30T17:04:01.550 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0040016970000000002 2023-09-30T17:04:01.550 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.550 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.550 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:01.550 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.342175+0000", 2023-09-30T17:04:01.550 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.573e-05 2023-09-30T17:04:01.550 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.550 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.550 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.551 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.551 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.551 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:86077 4.2e e48/17 4:75be0f36:::100000001f8.0000003d:head v 48'1315, mlcod=48'1312)", 2023-09-30T17:04:01.551 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.287322+0000", 2023-09-30T17:04:01.551 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.054715527, 2023-09-30T17:04:01.551 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.057017984000000001, 2023-09-30T17:04:01.551 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.551 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:01.551 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.551 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.551 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.552 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.287322+0000", 2023-09-30T17:04:01.552 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.552 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.552 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.552 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.552 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.287322+0000", 2023-09-30T17:04:01.552 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.552 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.552 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.552 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.553 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.287323+0000", 2023-09-30T17:04:01.553 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5899999999999995e-07 2023-09-30T17:04:01.553 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.553 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.553 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.553 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.287339+0000", 2023-09-30T17:04:01.553 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5906999999999999e-05 2023-09-30T17:04:01.553 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.553 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.553 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.553 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.287352+0000", 2023-09-30T17:04:01.553 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3040999999999999e-05 2023-09-30T17:04:01.554 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.554 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.554 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.554 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.287359+0000", 2023-09-30T17:04:01.554 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9019999999999999e-06 2023-09-30T17:04:01.554 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.554 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.554 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:01.554 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.331853+0000", 2023-09-30T17:04:01.554 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044493692000000001 2023-09-30T17:04:01.554 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.555 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.555 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:01.555 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.331871+0000", 2023-09-30T17:04:01.555 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8094e-05 2023-09-30T17:04:01.555 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.555 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.555 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.555 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.555 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.555 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:86381 4.11 4:893be98d:::100000001f8.00000001:head [write 1114112~4096 in=4096b,write 1150976~4096 in=4096b,write 1331200~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-09-30T17:04:01.555 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.338383+0000", 2023-09-30T17:04:01.555 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.003654432, 2023-09-30T17:04:01.556 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060203749999999997, 2023-09-30T17:04:01.556 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.556 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:01.556 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:01.556 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:01.556 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:01.556 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 86381 2023-09-30T17:04:01.556 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.556 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.556 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.556 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.556 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.338383+0000", 2023-09-30T17:04:01.557 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.557 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.557 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.557 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.557 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.338383+0000", 2023-09-30T17:04:01.557 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.557 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.557 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.557 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.557 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.338384+0000", 2023-09-30T17:04:01.557 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9100000000000003e-07 2023-09-30T17:04:01.557 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.558 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.558 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.558 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.338394+0000", 2023-09-30T17:04:01.558 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0151e-05 2023-09-30T17:04:01.558 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.558 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.558 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.558 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.338404+0000", 2023-09-30T17:04:01.558 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9490000000000008e-06 2023-09-30T17:04:01.558 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.558 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.559 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.559 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.338410+0000", 2023-09-30T17:04:01.559 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8299999999999998e-06 2023-09-30T17:04:01.559 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.559 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.559 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:01.559 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.338467+0000", 2023-09-30T17:04:01.559 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6033999999999999e-05 2023-09-30T17:04:01.559 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.559 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.559 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:01.559 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.338567+0000", 2023-09-30T17:04:01.559 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010094000000000001 2023-09-30T17:04:01.560 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.560 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.560 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.560 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.560 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.560 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:86305 4.36 e48/17)", 2023-09-30T17:04:01.560 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.326345+0000", 2023-09-30T17:04:01.560 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.015692507000000001, 2023-09-30T17:04:01.560 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018124608, 2023-09-30T17:04:01.560 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.560 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:01.561 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.561 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.561 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.561 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.326345+0000", 2023-09-30T17:04:01.561 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.561 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.561 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.561 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.561 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.326345+0000", 2023-09-30T17:04:01.561 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.561 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.561 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.562 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.562 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.326345+0000", 2023-09-30T17:04:01.562 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7999999999999995e-07 2023-09-30T17:04:01.562 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.562 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.562 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.562 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.326360+0000", 2023-09-30T17:04:01.562 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4545000000000001e-05 2023-09-30T17:04:01.562 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.562 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.562 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.563 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.326369+0000", 2023-09-30T17:04:01.563 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7290000000000006e-06 2023-09-30T17:04:01.563 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.563 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.563 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.563 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.326375+0000", 2023-09-30T17:04:01.563 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9379999999999997e-06 2023-09-30T17:04:01.563 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.563 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.563 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.563 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.564 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.564 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:86383 4.11 4:893be98d:::100000001f8.00000001:head [write 65536~4096 in=4096b,write 339968~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-09-30T17:04:01.564 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.339047+0000", 2023-09-30T17:04:01.564 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0029898199999999998, 2023-09-30T17:04:01.564 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054843909999999999, 2023-09-30T17:04:01.564 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.564 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:01.564 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:01.564 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:01.564 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:01.564 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 86383 2023-09-30T17:04:01.564 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.565 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.565 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.565 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.565 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.339047+0000", 2023-09-30T17:04:01.565 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.565 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.565 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.565 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.565 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.339047+0000", 2023-09-30T17:04:01.565 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.565 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.565 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.566 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.566 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.339048+0000", 2023-09-30T17:04:01.566 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4600000000000004e-07 2023-09-30T17:04:01.566 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.566 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.566 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.566 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.339061+0000", 2023-09-30T17:04:01.566 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2481e-05 2023-09-30T17:04:01.566 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.566 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.566 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.567 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.339070+0000", 2023-09-30T17:04:01.567 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8480000000000007e-06 2023-09-30T17:04:01.567 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.567 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.567 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.567 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.339077+0000", 2023-09-30T17:04:01.567 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1409999999999999e-06 2023-09-30T17:04:01.567 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.567 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.567 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:01.567 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.343685+0000", 2023-09-30T17:04:01.567 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0046085559999999998 2023-09-30T17:04:01.568 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.568 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.568 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:01.568 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.343761+0000", 2023-09-30T17:04:01.568 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5599999999999994e-05 2023-09-30T17:04:01.568 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.568 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.568 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.568 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.568 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.568 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:86212 4.6 e48/17)", 2023-09-30T17:04:01.569 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.308947+0000", 2023-09-30T17:04:01.569 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.033089924999999999, 2023-09-30T17:04:01.569 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.035649110999999997, 2023-09-30T17:04:01.569 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.569 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:01.569 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.569 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.569 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.569 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.308947+0000", 2023-09-30T17:04:01.569 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.569 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.570 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.570 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.570 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.308947+0000", 2023-09-30T17:04:01.570 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.570 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.570 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.570 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.570 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.308948+0000", 2023-09-30T17:04:01.570 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8300000000000001e-07 2023-09-30T17:04:01.570 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.570 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.570 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.571 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.308955+0000", 2023-09-30T17:04:01.571 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1470000000000004e-06 2023-09-30T17:04:01.571 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.571 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.571 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.571 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.308962+0000", 2023-09-30T17:04:01.571 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6899999999999992e-06 2023-09-30T17:04:01.571 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.571 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.571 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.571 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.308965+0000", 2023-09-30T17:04:01.572 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8250000000000001e-06 2023-09-30T17:04:01.572 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.572 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.572 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.572 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.572 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.572 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:86384 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-09-30T17:04:01.572 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.340055+0000", 2023-09-30T17:04:01.572 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.001982419, 2023-09-30T17:04:01.572 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045929550000000001, 2023-09-30T17:04:01.572 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.572 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:01.573 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:01.573 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:01.573 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:01.573 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 86384 2023-09-30T17:04:01.573 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.573 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.573 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.573 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.573 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.340055+0000", 2023-09-30T17:04:01.573 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.573 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.574 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.574 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.574 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.340055+0000", 2023-09-30T17:04:01.574 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.574 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.574 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.574 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.574 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.340056+0000", 2023-09-30T17:04:01.574 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.85e-07 2023-09-30T17:04:01.575 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.575 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.575 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.575 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.340070+0000", 2023-09-30T17:04:01.575 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4278e-05 2023-09-30T17:04:01.575 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.575 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.575 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.575 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.340080+0000", 2023-09-30T17:04:01.575 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8030000000000008e-06 2023-09-30T17:04:01.576 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.576 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.576 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.576 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.340087+0000", 2023-09-30T17:04:01.576 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4359999999999996e-06 2023-09-30T17:04:01.576 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.576 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.576 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.576 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.576 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.576 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:86385 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-09-30T17:04:01.576 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.340099+0000", 2023-09-30T17:04:01.577 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0019378240000000001, 2023-09-30T17:04:01.577 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0046064599999999997, 2023-09-30T17:04:01.577 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.577 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:01.577 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:01.577 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:01.577 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:01.577 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 86385 2023-09-30T17:04:01.577 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.577 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.577 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.577 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.578 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.340099+0000", 2023-09-30T17:04:01.578 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.578 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.578 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.578 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.578 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.340099+0000", 2023-09-30T17:04:01.578 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.578 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.578 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.578 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.578 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.340100+0000", 2023-09-30T17:04:01.579 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5600000000000001e-07 2023-09-30T17:04:01.579 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.579 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.579 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.579 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.340109+0000", 2023-09-30T17:04:01.579 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2280000000000004e-06 2023-09-30T17:04:01.579 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.579 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.579 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.579 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.340116+0000", 2023-09-30T17:04:01.579 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3459999999999999e-06 2023-09-30T17:04:01.579 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.580 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.580 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.580 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.340120+0000", 2023-09-30T17:04:01.580 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9910000000000002e-06 2023-09-30T17:04:01.580 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.580 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.580 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.580 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.580 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.580 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:86320 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 2097152~8192 in=8192b,write 2224128~4096 in=4096b,write 2232320~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-09-30T17:04:01.580 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.310022+0000", 2023-09-30T17:04:01.580 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.032015414999999998, 2023-09-30T17:04:01.581 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.034742549999999997, 2023-09-30T17:04:01.581 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.581 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:01.581 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:01.581 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:01.581 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:01.581 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 86320 2023-09-30T17:04:01.581 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.581 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.581 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.581 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.581 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.310022+0000", 2023-09-30T17:04:01.582 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.582 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.582 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.582 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.582 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.310022+0000", 2023-09-30T17:04:01.582 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.582 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.582 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.582 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.582 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.310023+0000", 2023-09-30T17:04:01.582 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5600000000000004e-07 2023-09-30T17:04:01.583 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.583 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.583 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.583 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.310037+0000", 2023-09-30T17:04:01.583 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3706000000000001e-05 2023-09-30T17:04:01.583 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.583 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.583 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.583 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.310046+0000", 2023-09-30T17:04:01.583 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3510000000000008e-06 2023-09-30T17:04:01.583 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.583 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.584 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.584 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.310055+0000", 2023-09-30T17:04:01.584 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9500000000000007e-06 2023-09-30T17:04:01.584 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.584 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.584 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:01.584 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.329085+0000", 2023-09-30T17:04:01.584 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019029807999999999 2023-09-30T17:04:01.584 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.584 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.584 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:01.584 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.329167+0000", 2023-09-30T17:04:01.585 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2729e-05 2023-09-30T17:04:01.585 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.585 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.585 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.585 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.585 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.585 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:86347 4.6 e48/17)", 2023-09-30T17:04:01.585 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.340134+0000", 2023-09-30T17:04:01.585 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0019036599999999999, 2023-09-30T17:04:01.585 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0046983270000000004, 2023-09-30T17:04:01.585 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.586 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:01.586 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.586 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.586 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.586 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.340134+0000", 2023-09-30T17:04:01.586 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.586 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.586 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.586 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.586 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.340134+0000", 2023-09-30T17:04:01.586 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.586 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.587 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.587 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.587 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.340134+0000", 2023-09-30T17:04:01.587 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9100000000000004e-07 2023-09-30T17:04:01.587 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.587 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.587 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.587 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.340147+0000", 2023-09-30T17:04:01.587 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2764e-05 2023-09-30T17:04:01.587 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.587 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.588 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.588 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.340153+0000", 2023-09-30T17:04:01.588 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4840000000000001e-06 2023-09-30T17:04:01.588 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.588 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.588 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.588 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.340158+0000", 2023-09-30T17:04:01.588 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6430000000000003e-06 2023-09-30T17:04:01.588 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.588 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.588 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.588 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.589 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.589 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:86175 4.36 e48/17)", 2023-09-30T17:04:01.589 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.299202+0000", 2023-09-30T17:04:01.589 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.042835123000000003, 2023-09-30T17:04:01.589 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045671883000000003, 2023-09-30T17:04:01.589 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.589 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:01.589 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.589 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.589 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.589 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.299202+0000", 2023-09-30T17:04:01.589 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.590 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.590 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.590 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.590 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.299202+0000", 2023-09-30T17:04:01.590 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.590 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.590 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.590 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.590 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.299203+0000", 2023-09-30T17:04:01.590 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5999999999999999e-07 2023-09-30T17:04:01.590 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.590 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.591 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.591 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.299216+0000", 2023-09-30T17:04:01.591 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3728e-05 2023-09-30T17:04:01.591 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.591 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.591 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.591 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.299224+0000", 2023-09-30T17:04:01.591 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6979999999999998e-06 2023-09-30T17:04:01.591 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.591 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.591 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.591 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.299231+0000", 2023-09-30T17:04:01.592 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2660000000000004e-06 2023-09-30T17:04:01.592 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.592 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.592 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.592 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.592 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.592 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:86386 4.2d 4:b4aa06e9:::100000001f8.0000001d:head [write 2314240~4096 in=4096b,write 2416640~4096 in=4096b,write 2428928~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-09-30T17:04:01.592 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.340292+0000", 2023-09-30T17:04:01.592 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.001745082, 2023-09-30T17:04:01.592 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0046371219999999996, 2023-09-30T17:04:01.592 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.593 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:01.593 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:01.593 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:01.593 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:01.593 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 86386 2023-09-30T17:04:01.593 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.593 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.593 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.593 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.593 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.340292+0000", 2023-09-30T17:04:01.593 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.594 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.594 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.594 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.594 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.340292+0000", 2023-09-30T17:04:01.594 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.594 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.594 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.594 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.594 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.340293+0000", 2023-09-30T17:04:01.594 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5499999999999998e-07 2023-09-30T17:04:01.594 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.595 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.595 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.595 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.340310+0000", 2023-09-30T17:04:01.595 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6903999999999999e-05 2023-09-30T17:04:01.595 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.595 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.595 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.595 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.340318+0000", 2023-09-30T17:04:01.595 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1839999999999999e-06 2023-09-30T17:04:01.595 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.595 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.596 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.596 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.340326+0000", 2023-09-30T17:04:01.596 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8590000000000005e-06 2023-09-30T17:04:01.596 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.596 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.596 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:01.596 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.340361+0000", 2023-09-30T17:04:01.596 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5444999999999997e-05 2023-09-30T17:04:01.596 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.596 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.596 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:01.597 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.340408+0000", 2023-09-30T17:04:01.597 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6335999999999998e-05 2023-09-30T17:04:01.597 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.597 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.597 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:01.597 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.340491+0000", 2023-09-30T17:04:01.597 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3545000000000001e-05 2023-09-30T17:04:01.597 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.597 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.597 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:01.597 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.344470+0000", 2023-09-30T17:04:01.597 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039793959999999996 2023-09-30T17:04:01.598 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.598 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.598 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.598 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.598 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.598 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:86089 4.36 e48/17 4:6c9c34b1:::100000001f8.00000010:head v 48'4069, mlcod=48'4058)", 2023-09-30T17:04:01.598 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.288486+0000", 2023-09-30T17:04:01.598 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.053551135999999999, 2023-09-30T17:04:01.598 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.056527713, 2023-09-30T17:04:01.598 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.599 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:01.599 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.599 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.599 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.599 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.288486+0000", 2023-09-30T17:04:01.599 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.599 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.599 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.599 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.599 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.288486+0000", 2023-09-30T17:04:01.599 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.600 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.600 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.600 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.600 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.288487+0000", 2023-09-30T17:04:01.600 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3399999999999999e-07 2023-09-30T17:04:01.600 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.600 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.600 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.600 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.288499+0000", 2023-09-30T17:04:01.600 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2388999999999999e-05 2023-09-30T17:04:01.600 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.600 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.601 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.601 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.288519+0000", 2023-09-30T17:04:01.601 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0293e-05 2023-09-30T17:04:01.601 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.601 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.601 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.601 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.288527+0000", 2023-09-30T17:04:01.601 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2060000000000001e-06 2023-09-30T17:04:01.601 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.601 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.601 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:01.602 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.333389+0000", 2023-09-30T17:04:01.602 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044861831999999997 2023-09-30T17:04:01.602 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.602 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.602 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:01.602 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.333400+0000", 2023-09-30T17:04:01.602 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1133e-05 2023-09-30T17:04:01.602 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.602 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.602 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.602 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.603 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.603 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:86323 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 3543040~4096 in=4096b,write 3608576~4096 in=4096b,write 3792896~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-09-30T17:04:01.603 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.311684+0000", 2023-09-30T17:04:01.603 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.030353036999999999, 2023-09-30T17:04:01.603 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033397403999999999, 2023-09-30T17:04:01.603 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.603 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:01.603 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:01.603 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:01.603 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:01.603 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 86323 2023-09-30T17:04:01.603 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.604 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.604 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.604 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.604 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.311684+0000", 2023-09-30T17:04:01.604 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.604 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.604 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.604 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.604 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.311684+0000", 2023-09-30T17:04:01.604 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.604 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.604 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.605 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.605 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.311685+0000", 2023-09-30T17:04:01.605 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2399999999999996e-07 2023-09-30T17:04:01.605 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.605 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.605 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.605 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.311697+0000", 2023-09-30T17:04:01.605 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1438e-05 2023-09-30T17:04:01.605 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.605 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.605 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.606 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.311707+0000", 2023-09-30T17:04:01.606 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0433e-05 2023-09-30T17:04:01.606 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.606 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.606 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.606 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.311713+0000", 2023-09-30T17:04:01.606 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6740000000000002e-06 2023-09-30T17:04:01.606 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.606 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.606 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:01.606 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.330823+0000", 2023-09-30T17:04:01.606 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019109820999999999 2023-09-30T17:04:01.607 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.607 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.607 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:01.607 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.330895+0000", 2023-09-30T17:04:01.607 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2438e-05 2023-09-30T17:04:01.607 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.607 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.607 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.607 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.607 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.607 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:86306 4.36 e48/17)", 2023-09-30T17:04:01.608 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.329224+0000", 2023-09-30T17:04:01.608 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.012813150000000001, 2023-09-30T17:04:01.608 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015919256, 2023-09-30T17:04:01.608 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.608 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:01.608 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.608 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.608 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.608 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.329224+0000", 2023-09-30T17:04:01.608 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.608 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.608 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.609 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.609 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.329224+0000", 2023-09-30T17:04:01.609 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.609 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.609 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.609 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.609 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.329225+0000", 2023-09-30T17:04:01.609 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1900000000000003e-07 2023-09-30T17:04:01.609 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.609 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.609 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.609 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.329237+0000", 2023-09-30T17:04:01.610 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2401999999999999e-05 2023-09-30T17:04:01.610 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.610 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.610 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.610 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.329247+0000", 2023-09-30T17:04:01.610 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6020000000000006e-06 2023-09-30T17:04:01.610 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.610 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.610 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.610 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.329253+0000", 2023-09-30T17:04:01.610 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4969999999999998e-06 2023-09-30T17:04:01.611 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.611 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.611 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.611 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.611 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.611 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:86227 4.38 4:1fc350da:::100000001f8.0000002f:head [write 77824~4096 in=4096b,write 147456~4096 in=4096b,write 655360~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e48)", 2023-09-30T17:04:01.611 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.277646+0000", 2023-09-30T17:04:01.611 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.064391438999999995, 2023-09-30T17:04:01.611 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.067556448000000005, 2023-09-30T17:04:01.611 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.611 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:01.611 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:01.612 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:01.612 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:01.612 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 86227 2023-09-30T17:04:01.612 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.612 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.612 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.612 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.612 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.277646+0000", 2023-09-30T17:04:01.612 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.612 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.612 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.612 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.613 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.277646+0000", 2023-09-30T17:04:01.613 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.613 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.613 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.613 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.613 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.277646+0000", 2023-09-30T17:04:01.613 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3200000000000001e-07 2023-09-30T17:04:01.613 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.613 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.613 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.613 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.277655+0000", 2023-09-30T17:04:01.613 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3979999999999999e-06 2023-09-30T17:04:01.614 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.614 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.614 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.614 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.277659+0000", 2023-09-30T17:04:01.614 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.941e-06 2023-09-30T17:04:01.614 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.614 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.614 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.614 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.277662+0000", 2023-09-30T17:04:01.614 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.163e-06 2023-09-30T17:04:01.615 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.615 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.615 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:01.615 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.321968+0000", 2023-09-30T17:04:01.615 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044306643999999999 2023-09-30T17:04:01.615 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.615 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.615 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:01.615 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.322066+0000", 2023-09-30T17:04:01.615 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8152000000000005e-05 2023-09-30T17:04:01.615 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.616 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.616 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.616 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.616 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.616 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:86387 4.3f e48/17)", 2023-09-30T17:04:01.616 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.340996+0000", 2023-09-30T17:04:01.616 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.001041497, 2023-09-30T17:04:01.616 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042665819999999997, 2023-09-30T17:04:01.616 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.616 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:01.616 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.617 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.617 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.617 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.340996+0000", 2023-09-30T17:04:01.617 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.617 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.617 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.617 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.340996+0000", 2023-09-30T17:04:01.617 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.617 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.617 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.618 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.340996+0000", 2023-09-30T17:04:01.618 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8599999999999998e-07 2023-09-30T17:04:01.618 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.618 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.618 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.618 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.341008+0000", 2023-09-30T17:04:01.618 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2167000000000001e-05 2023-09-30T17:04:01.618 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.618 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.618 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.618 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.341019+0000", 2023-09-30T17:04:01.619 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0519999999999999e-05 2023-09-30T17:04:01.619 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.619 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.619 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.619 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.341024+0000", 2023-09-30T17:04:01.619 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7489999999999998e-06 2023-09-30T17:04:01.619 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.619 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.619 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.619 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.619 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.619 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:86254 4.36 e48/17)", 2023-09-30T17:04:01.620 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.312441+0000", 2023-09-30T17:04:01.620 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.029596451999999999, 2023-09-30T17:04:01.620 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.032847819, 2023-09-30T17:04:01.620 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.620 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:01.620 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.620 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.620 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.620 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.312441+0000", 2023-09-30T17:04:01.620 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.620 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.620 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.621 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.621 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.312441+0000", 2023-09-30T17:04:01.621 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.621 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.621 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.621 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.621 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.312441+0000", 2023-09-30T17:04:01.621 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.46e-07 2023-09-30T17:04:01.621 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.621 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.621 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.622 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.312451+0000", 2023-09-30T17:04:01.622 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3989999999999993e-06 2023-09-30T17:04:01.622 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.622 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.622 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.622 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.312455+0000", 2023-09-30T17:04:01.622 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7790000000000003e-06 2023-09-30T17:04:01.622 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.622 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.622 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.622 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.312459+0000", 2023-09-30T17:04:01.622 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7249999999999999e-06 2023-09-30T17:04:01.623 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.623 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.623 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.623 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.623 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.623 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:86110 4.6 e48/17 4:616d4c41:::100000001f8.00000034:head v 48'5307, mlcod=48'5297)", 2023-09-30T17:04:01.623 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.291224+0000", 2023-09-30T17:04:01.623 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.050813203000000001, 2023-09-30T17:04:01.623 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.054092335999999998, 2023-09-30T17:04:01.623 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.623 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:01.624 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.624 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.624 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.624 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.291224+0000", 2023-09-30T17:04:01.624 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.624 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.624 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.624 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.624 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.291224+0000", 2023-09-30T17:04:01.624 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.624 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.625 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.625 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.625 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.291225+0000", 2023-09-30T17:04:01.625 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9500000000000001e-07 2023-09-30T17:04:01.625 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.625 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.625 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.625 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.291239+0000", 2023-09-30T17:04:01.625 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4011e-05 2023-09-30T17:04:01.625 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.625 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.625 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.626 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.291250+0000", 2023-09-30T17:04:01.626 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1294999999999999e-05 2023-09-30T17:04:01.626 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.626 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.626 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.626 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.291258+0000", 2023-09-30T17:04:01.626 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.763e-06 2023-09-30T17:04:01.626 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.626 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.626 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:01.626 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.335508+0000", 2023-09-30T17:04:01.626 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044250502999999997 2023-09-30T17:04:01.627 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.627 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.627 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:01.627 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.335533+0000", 2023-09-30T17:04:01.627 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4487000000000001e-05 2023-09-30T17:04:01.627 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.627 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.627 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.627 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.627 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.627 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:86177 4.6 e48/17)", 2023-09-30T17:04:01.628 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.301447+0000", 2023-09-30T17:04:01.628 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.040590339000000003, 2023-09-30T17:04:01.628 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043917458999999999, 2023-09-30T17:04:01.628 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.628 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:01.628 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.628 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.628 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.628 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.301447+0000", 2023-09-30T17:04:01.628 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.628 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.629 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.301447+0000", 2023-09-30T17:04:01.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.629 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.301447+0000", 2023-09-30T17:04:01.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.79e-07 2023-09-30T17:04:01.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.630 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.301465+0000", 2023-09-30T17:04:01.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7989e-05 2023-09-30T17:04:01.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.630 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.301473+0000", 2023-09-30T17:04:01.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8679999999999999e-06 2023-09-30T17:04:01.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.630 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.631 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.301479+0000", 2023-09-30T17:04:01.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5310000000000001e-06 2023-09-30T17:04:01.631 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.631 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.631 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.631 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.631 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.631 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:86388 4.19 e48/17 4:9a4319fb:::100000001f8.0000002a:head v 48'2695, mlcod=48'2693)", 2023-09-30T17:04:01.631 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.341578+0000", 2023-09-30T17:04:01.631 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.00045886199999999999, 2023-09-30T17:04:01.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039039830000000002, 2023-09-30T17:04:01.631 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.632 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:01.632 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.632 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.632 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.632 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.341578+0000", 2023-09-30T17:04:01.632 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.632 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.632 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.632 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.632 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.341578+0000", 2023-09-30T17:04:01.632 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.633 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.633 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.633 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.633 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.341579+0000", 2023-09-30T17:04:01.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5499999999999998e-07 2023-09-30T17:04:01.633 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.633 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.633 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.633 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.341600+0000", 2023-09-30T17:04:01.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1495e-05 2023-09-30T17:04:01.633 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.634 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.634 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.341611+0000", 2023-09-30T17:04:01.634 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1008e-05 2023-09-30T17:04:01.634 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.634 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.634 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.341618+0000", 2023-09-30T17:04:01.634 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3400000000000003e-06 2023-09-30T17:04:01.634 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:01.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.342500+0000", 2023-09-30T17:04:01.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00088262900000000001 2023-09-30T17:04:01.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:01.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.342523+0000", 2023-09-30T17:04:01.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2894000000000001e-05 2023-09-30T17:04:01.635 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.635 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.635 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.636 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:86351 4.2e e48/17)", 2023-09-30T17:04:01.636 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:01.341987+0000", 2023-09-30T17:04:01.636 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 5.0096000000000003e-05, 2023-09-30T17:04:01.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0035662440000000001, 2023-09-30T17:04:01.636 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:01.636 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:01.636 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:01.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:01.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.341987+0000", 2023-09-30T17:04:01.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.637 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:01.637 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.341987+0000", 2023-09-30T17:04:01.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:01.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.637 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:01.637 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.341988+0000", 2023-09-30T17:04:01.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4099999999999999e-07 2023-09-30T17:04:01.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.638 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:01.638 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.342000+0000", 2023-09-30T17:04:01.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2536e-05 2023-09-30T17:04:01.638 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.638 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:01.638 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.342010+0000", 2023-09-30T17:04:01.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3670000000000003e-06 2023-09-30T17:04:01.638 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:01.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:01.638 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:01.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:01.342023+0000", 2023-09-30T17:04:01.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3577999999999999e-05 2023-09-30T17:04:01.639 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.639 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:01.639 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.639 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:01.639 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2023-09-30T17:04:01.639 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 66 2023-09-30T17:04:01.639 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:04:01.641 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:04:01.641 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:01.640+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:01.741 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:01.741+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:01.842 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:01.841+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:01.887 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:04:01.888 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:04:01.888 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2023-09-30T17:04:01.888 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2023-09-30T17:04:01.888 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:04:01.905 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:04:01.953 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:01.951+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:02.047 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:02.047+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:02.117 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:04:02.117 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2023-09-30T17:04:02.117 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2023-09-30T17:04:02.118 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2023-09-30T17:04:02.118 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.118 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:23704 4.14 e41/17 4:2b28d75f:::100000001f8.00000016:head v 41'381, mlcod=41'379)", 2023-09-30T17:04:02.118 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.711674+0000", 2023-09-30T17:04:02.118 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.403978534, 2023-09-30T17:04:02.118 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.225773745, 2023-09-30T17:04:02.118 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:02.118 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:02.118 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:02.118 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.118 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:02.119 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.711674+0000", 2023-09-30T17:04:02.119 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:02.119 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.119 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.119 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:02.119 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.711674+0000", 2023-09-30T17:04:02.119 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:02.119 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.119 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.119 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:02.119 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.711674+0000", 2023-09-30T17:04:02.119 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2000000000000001e-07 2023-09-30T17:04:02.120 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.120 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.120 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:02.120 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.711685+0000", 2023-09-30T17:04:02.120 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.117e-05 2023-09-30T17:04:02.120 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.120 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.120 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:02.120 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.711691+0000", 2023-09-30T17:04:02.120 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2129999999999996e-06 2023-09-30T17:04:02.120 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.121 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.121 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.121 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.711696+0000", 2023-09-30T17:04:02.121 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7339999999999999e-06 2023-09-30T17:04:02.121 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.121 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.121 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:02.121 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713583+0000", 2023-09-30T17:04:02.121 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0018866219999999999 2023-09-30T17:04:02.121 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.121 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.121 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:02.122 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713603+0000", 2023-09-30T17:04:02.122 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0142000000000001e-05 2023-09-30T17:04:02.122 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.122 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.122 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:02.122 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.937407+0000", 2023-09-30T17:04:02.122 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.223804165 2023-09-30T17:04:02.122 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.122 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.122 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:02.122 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.937447+0000", 2023-09-30T17:04:02.123 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0479000000000003e-05 2023-09-30T17:04:02.123 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:02.123 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:02.123 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:02.123 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.123 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.123 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:23708 4.14 e41/17 4:2b28d75f:::100000001f8.00000016:head v 41'382, mlcod=41'379)", 2023-09-30T17:04:02.124 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713552+0000", 2023-09-30T17:04:02.124 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.402099712999998, 2023-09-30T17:04:02.124 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.22392661999999999, 2023-09-30T17:04:02.124 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:02.124 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:02.124 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:02.124 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.124 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:02.124 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713552+0000", 2023-09-30T17:04:02.124 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:02.124 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.125 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.125 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:02.125 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713552+0000", 2023-09-30T17:04:02.125 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:02.125 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.125 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.125 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:02.125 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713553+0000", 2023-09-30T17:04:02.125 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0999999999999999e-07 2023-09-30T17:04:02.126 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.126 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.126 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:02.126 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713564+0000", 2023-09-30T17:04:02.126 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0851e-05 2023-09-30T17:04:02.126 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.126 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.126 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:02.126 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713570+0000", 2023-09-30T17:04:02.127 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1480000000000003e-06 2023-09-30T17:04:02.127 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.127 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.127 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.127 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713574+0000", 2023-09-30T17:04:02.127 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.464e-06 2023-09-30T17:04:02.127 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.127 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.127 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:02.127 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.714408+0000", 2023-09-30T17:04:02.128 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00083399400000000001 2023-09-30T17:04:02.128 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.128 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.128 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:02.128 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.714425+0000", 2023-09-30T17:04:02.128 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7234000000000001e-05 2023-09-30T17:04:02.128 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.128 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.129 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:02.129 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.937451+0000", 2023-09-30T17:04:02.129 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.22302575899999999 2023-09-30T17:04:02.129 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.129 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.129 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:02.129 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.937479+0000", 2023-09-30T17:04:02.129 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7759999999999998e-05 2023-09-30T17:04:02.129 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:02.130 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:02.130 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:02.130 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.130 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.130 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23700 4.30 4:0c89e311:::100000001f8.00000017:head [write 1548288~4096 in=4096b,write 1638400~4096 in=4096b,write 1814528~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:04:02.130 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713661+0000", 2023-09-30T17:04:02.130 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.401991577, 2023-09-30T17:04:02.130 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.21981082900000001, 2023-09-30T17:04:02.131 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:02.131 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:02.131 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:02.131 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:02.131 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.131 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23700 2023-09-30T17:04:02.131 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.131 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:02.131 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.131 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:02.132 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713661+0000", 2023-09-30T17:04:02.132 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:02.132 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.132 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.132 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:02.132 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713661+0000", 2023-09-30T17:04:02.132 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:02.132 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.133 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:02.133 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713661+0000", 2023-09-30T17:04:02.133 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6000000000000004e-07 2023-09-30T17:04:02.133 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.133 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:02.133 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713669+0000", 2023-09-30T17:04:02.133 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2039999999999997e-06 2023-09-30T17:04:02.134 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.134 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.134 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:02.134 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713679+0000", 2023-09-30T17:04:02.134 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5999999999999996e-06 2023-09-30T17:04:02.134 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.134 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.135 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.135 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713683+0000", 2023-09-30T17:04:02.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4390000000000002e-06 2023-09-30T17:04:02.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.135 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.135 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:02.135 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713722+0000", 2023-09-30T17:04:02.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8707000000000001e-05 2023-09-30T17:04:02.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.136 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.136 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:02.136 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713780+0000", 2023-09-30T17:04:02.136 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8242000000000002e-05 2023-09-30T17:04:02.136 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.136 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.136 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:02.136 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.933335+0000", 2023-09-30T17:04:02.137 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.21955456500000001 2023-09-30T17:04:02.137 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.137 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.137 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:02.137 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.933388+0000", 2023-09-30T17:04:02.137 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2843999999999998e-05 2023-09-30T17:04:02.137 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.137 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.137 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:02.137 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.933471+0000", 2023-09-30T17:04:02.137 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3667999999999999e-05 2023-09-30T17:04:02.138 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:02.138 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:02.138 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:02.138 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.138 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.138 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23703 4.38 4:1d13bf87:::100000001f8.00000030:head [write 839680~4096 in=4096b,write 1101824~4096 in=4096b,write 1155072~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:04:02.138 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713696+0000", 2023-09-30T17:04:02.138 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.401956498000001, 2023-09-30T17:04:02.138 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.23500357699999999, 2023-09-30T17:04:02.138 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:02.139 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:02.139 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:02.139 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:02.139 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.139 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23703 2023-09-30T17:04:02.139 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.139 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:02.139 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.139 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:02.139 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713696+0000", 2023-09-30T17:04:02.139 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:02.141 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.141 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.141 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:02.141 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713696+0000", 2023-09-30T17:04:02.141 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:02.141 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.141 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.141 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:02.142 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713696+0000", 2023-09-30T17:04:02.142 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9500000000000003e-07 2023-09-30T17:04:02.142 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.142 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.142 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:02.142 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713711+0000", 2023-09-30T17:04:02.142 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5251e-05 2023-09-30T17:04:02.142 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.142 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.142 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:02.142 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713718+0000", 2023-09-30T17:04:02.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9430000000000003e-06 2023-09-30T17:04:02.143 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.143 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.143 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.143 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713723+0000", 2023-09-30T17:04:02.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4240000000000003e-06 2023-09-30T17:04:02.143 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.143 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.143 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:02.143 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713757+0000", 2023-09-30T17:04:02.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4128999999999998e-05 2023-09-30T17:04:02.144 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.144 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.144 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:02.144 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713841+0000", 2023-09-30T17:04:02.144 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3845999999999996e-05 2023-09-30T17:04:02.144 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.144 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.144 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:02.144 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.948561+0000", 2023-09-30T17:04:02.144 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.234720286 2023-09-30T17:04:02.144 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.145 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.145 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:02.145 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.948624+0000", 2023-09-30T17:04:02.145 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2961999999999998e-05 2023-09-30T17:04:02.145 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.145 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.145 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:02.145 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.948699+0000", 2023-09-30T17:04:02.145 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5240999999999993e-05 2023-09-30T17:04:02.145 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:02.145 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:02.146 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:02.146 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.146 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.146 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23706 4.f 4:f0d983b2:::100000001f8.0000001f:head [write 1003520~4096 in=4096b,write 1146880~4096 in=4096b,write 1163264~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:04:02.146 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713730+0000", 2023-09-30T17:04:02.146 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.401922443, 2023-09-30T17:04:02.146 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.22546488100000001, 2023-09-30T17:04:02.146 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:02.146 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:02.146 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:02.146 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:02.147 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.147 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23706 2023-09-30T17:04:02.147 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.147 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:02.147 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.147 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:02.147 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713730+0000", 2023-09-30T17:04:02.147 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:02.147 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.147 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.147 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:02.147 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713730+0000", 2023-09-30T17:04:02.148 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:02.148 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.148 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.148 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:02.148 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713730+0000", 2023-09-30T17:04:02.148 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0900000000000001e-07 2023-09-30T17:04:02.148 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.148 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.148 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:02.148 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713740+0000", 2023-09-30T17:04:02.148 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0115999999999999e-05 2023-09-30T17:04:02.148 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.149 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.149 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:02.149 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713747+0000", 2023-09-30T17:04:02.149 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5429999999999999e-06 2023-09-30T17:04:02.149 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.149 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.149 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.149 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713752+0000", 2023-09-30T17:04:02.149 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1270000000000002e-06 2023-09-30T17:04:02.149 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.149 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.149 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:02.150 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713788+0000", 2023-09-30T17:04:02.150 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5762000000000001e-05 2023-09-30T17:04:02.150 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.150 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.150 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:02.150 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713835+0000", 2023-09-30T17:04:02.150 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6808000000000003e-05 2023-09-30T17:04:02.150 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.150 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.150 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:02.150 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713962+0000", 2023-09-30T17:04:02.150 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000127315 2023-09-30T17:04:02.151 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.151 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.151 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:02.151 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.923977+0000", 2023-09-30T17:04:02.151 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.21001473100000001 2023-09-30T17:04:02.151 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.151 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.151 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:02.151 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939118+0000", 2023-09-30T17:04:02.151 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015141297999999999 2023-09-30T17:04:02.151 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.151 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.152 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:02.152 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939161+0000", 2023-09-30T17:04:02.152 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3458999999999998e-05 2023-09-30T17:04:02.152 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.152 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.152 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:02.152 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939195+0000", 2023-09-30T17:04:02.152 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3113e-05 2023-09-30T17:04:02.152 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:02.152 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:02.152 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:02.152 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.153 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.153 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23707 4.2f 4:f59f865b:::100000001f8.00000007:head [write 3575808~4096 in=4096b,write 3932160~4096 in=4096b,write 4063232~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:04:02.153 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713764+0000", 2023-09-30T17:04:02.153 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.401888, 2023-09-30T17:04:02.153 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.225343612, 2023-09-30T17:04:02.153 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:02.153 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:02.153 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:02.153 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:02.153 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.154 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23707 2023-09-30T17:04:02.154 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.154 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:02.154 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.154 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:02.154 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713764+0000", 2023-09-30T17:04:02.154 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:02.154 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.154 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.154 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:02.154 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713764+0000", 2023-09-30T17:04:02.154 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:02.155 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.155 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.155 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:02.155 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713765+0000", 2023-09-30T17:04:02.155 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4099999999999999e-07 2023-09-30T17:04:02.155 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.155 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.155 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:02.155 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713775+0000", 2023-09-30T17:04:02.155 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0253e-05 2023-09-30T17:04:02.155 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.156 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.156 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:02.156 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713781+0000", 2023-09-30T17:04:02.156 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1770000000000003e-06 2023-09-30T17:04:02.156 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.156 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.156 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.156 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713787+0000", 2023-09-30T17:04:02.156 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.784e-06 2023-09-30T17:04:02.156 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.157 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.157 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:02.157 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713824+0000", 2023-09-30T17:04:02.157 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7258000000000001e-05 2023-09-30T17:04:02.157 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.157 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.157 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:02.157 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713897+0000", 2023-09-30T17:04:02.157 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3255000000000003e-05 2023-09-30T17:04:02.157 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.157 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.157 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:02.158 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.714035+0000", 2023-09-30T17:04:02.158 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013741799999999999 2023-09-30T17:04:02.158 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.158 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.158 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:02.158 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.924017+0000", 2023-09-30T17:04:02.158 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.20998277000000001 2023-09-30T17:04:02.158 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.158 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.158 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:02.158 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939013+0000", 2023-09-30T17:04:02.159 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014995432 2023-09-30T17:04:02.159 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.159 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.159 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:02.159 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939064+0000", 2023-09-30T17:04:02.159 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0784e-05 2023-09-30T17:04:02.159 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.159 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.159 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:02.159 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939108+0000", 2023-09-30T17:04:02.160 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4039999999999998e-05 2023-09-30T17:04:02.160 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:02.160 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:02.160 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:02.160 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.160 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.160 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23709 4.37 4:ef395e89:::100000001f8.00000020:head [write 4042752~4096 in=4096b,write 4124672~4096 in=4096b,write 4182016~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:04:02.160 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713796+0000", 2023-09-30T17:04:02.161 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.401855780999998, 2023-09-30T17:04:02.161 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.23291700700000001, 2023-09-30T17:04:02.161 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:02.161 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:02.161 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:02.161 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:02.161 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.161 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23709 2023-09-30T17:04:02.161 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.161 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:02.161 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.161 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:02.162 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713796+0000", 2023-09-30T17:04:02.162 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:02.162 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.162 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.162 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:02.162 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713796+0000", 2023-09-30T17:04:02.162 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:02.162 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.163 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.163 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:02.163 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713797+0000", 2023-09-30T17:04:02.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2200000000000004e-07 2023-09-30T17:04:02.163 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.163 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.163 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:02.163 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713807+0000", 2023-09-30T17:04:02.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.815e-06 2023-09-30T17:04:02.163 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.164 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:02.164 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713813+0000", 2023-09-30T17:04:02.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5899999999999996e-06 2023-09-30T17:04:02.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.164 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.164 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713818+0000", 2023-09-30T17:04:02.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2639999999999999e-06 2023-09-30T17:04:02.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.165 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.165 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:02.165 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.714818+0000", 2023-09-30T17:04:02.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00099973500000000008 2023-09-30T17:04:02.165 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.165 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.165 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:02.165 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.921155+0000", 2023-09-30T17:04:02.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.206336778 2023-09-30T17:04:02.165 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.165 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.166 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:02.166 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.921347+0000", 2023-09-30T17:04:02.166 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000191917 2023-09-30T17:04:02.166 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.166 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:02.166 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.944206+0000", 2023-09-30T17:04:02.166 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022859349000000001 2023-09-30T17:04:02.166 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.166 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:02.167 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.946622+0000", 2023-09-30T17:04:02.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0024161849999999999 2023-09-30T17:04:02.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.167 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:02.167 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.946673+0000", 2023-09-30T17:04:02.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0670000000000001e-05 2023-09-30T17:04:02.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:02.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.946713+0000", 2023-09-30T17:04:02.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0182000000000003e-05 2023-09-30T17:04:02.168 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:02.168 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:02.168 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:02.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.168 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23710 4.12 4:4be51a30:::100000001f8.0000000b:head [write 3772416~4096 in=4096b,write 3825664~4096 in=4096b,write 3833856~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:04:02.169 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713827+0000", 2023-09-30T17:04:02.169 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.401825295999998, 2023-09-30T17:04:02.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.214817016, 2023-09-30T17:04:02.169 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:02.169 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:02.169 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:02.169 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:02.169 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.170 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23710 2023-09-30T17:04:02.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.170 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:02.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.170 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:02.170 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713827+0000", 2023-09-30T17:04:02.170 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:02.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:02.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713827+0000", 2023-09-30T17:04:02.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:02.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:02.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713827+0000", 2023-09-30T17:04:02.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.51e-07 2023-09-30T17:04:02.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.172 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:02.172 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713837+0000", 2023-09-30T17:04:02.172 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8239999999999995e-06 2023-09-30T17:04:02.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.172 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:02.173 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713843+0000", 2023-09-30T17:04:02.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3729999999999998e-06 2023-09-30T17:04:02.173 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.173 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.173 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713849+0000", 2023-09-30T17:04:02.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3480000000000003e-06 2023-09-30T17:04:02.173 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:02.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713896+0000", 2023-09-30T17:04:02.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7426999999999998e-05 2023-09-30T17:04:02.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:02.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713969+0000", 2023-09-30T17:04:02.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2496000000000005e-05 2023-09-30T17:04:02.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.175 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:02.175 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.714114+0000", 2023-09-30T17:04:02.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014550699999999999 2023-09-30T17:04:02.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:02.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.922604+0000", 2023-09-30T17:04:02.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.20848978900000001 2023-09-30T17:04:02.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:02.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.928219+0000", 2023-09-30T17:04:02.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056147159999999996 2023-09-30T17:04:02.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.177 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:02.177 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.928268+0000", 2023-09-30T17:04:02.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9353e-05 2023-09-30T17:04:02.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.177 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:02.177 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.928644+0000", 2023-09-30T17:04:02.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00037573199999999999 2023-09-30T17:04:02.177 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:02.177 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:02.177 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:02.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.178 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.178 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23711 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 270336~4096 in=4096b,write 876544~4096 in=4096b,write 933888~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:04:02.178 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713868+0000", 2023-09-30T17:04:02.178 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.401784436, 2023-09-30T17:04:02.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.234682211, 2023-09-30T17:04:02.178 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:02.178 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:02.178 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:02.178 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:02.178 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.178 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23711 2023-09-30T17:04:02.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.179 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:02.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:02.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713868+0000", 2023-09-30T17:04:02.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:02.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:02.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713868+0000", 2023-09-30T17:04:02.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:02.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.180 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:02.180 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713868+0000", 2023-09-30T17:04:02.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.75e-07 2023-09-30T17:04:02.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.180 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:02.180 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713879+0000", 2023-09-30T17:04:02.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0494e-05 2023-09-30T17:04:02.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.180 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:02.181 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713886+0000", 2023-09-30T17:04:02.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3159999999999999e-06 2023-09-30T17:04:02.181 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.181 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.181 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.181 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713892+0000", 2023-09-30T17:04:02.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7200000000000003e-06 2023-09-30T17:04:02.181 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.181 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.181 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:02.181 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.714747+0000", 2023-09-30T17:04:02.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00085524699999999995 2023-09-30T17:04:02.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.182 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:02.182 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.714822+0000", 2023-09-30T17:04:02.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5444999999999993e-05 2023-09-30T17:04:02.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.182 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:02.182 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.947884+0000", 2023-09-30T17:04:02.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.233061449 2023-09-30T17:04:02.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:02.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.947942+0000", 2023-09-30T17:04:02.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7649999999999999e-05 2023-09-30T17:04:02.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:02.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.948550+0000", 2023-09-30T17:04:02.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00060831500000000001 2023-09-30T17:04:02.184 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:02.184 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:02.184 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:02.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.184 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23712 4.37 4:eff9002a:::100000001f8.00000003:head [write 3387392~8192,write 3452928~4096,write 3710976~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:04:02.184 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713901+0000", 2023-09-30T17:04:02.184 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.401751378, 2023-09-30T17:04:02.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.25525220700000001, 2023-09-30T17:04:02.184 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:02.184 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:02.185 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:02.185 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:02.185 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.185 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23712 2023-09-30T17:04:02.185 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.185 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:02.185 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.185 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:02.185 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713901+0000", 2023-09-30T17:04:02.185 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:02.185 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.186 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.186 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:02.186 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713901+0000", 2023-09-30T17:04:02.186 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:02.186 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.186 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.186 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:02.186 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713901+0000", 2023-09-30T17:04:02.186 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.96e-07 2023-09-30T17:04:02.186 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:02.187 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713912+0000", 2023-09-30T17:04:02.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0543999999999999e-05 2023-09-30T17:04:02.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:02.187 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713918+0000", 2023-09-30T17:04:02.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4420000000000003e-06 2023-09-30T17:04:02.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.188 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.188 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713923+0000", 2023-09-30T17:04:02.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3059999999999997e-06 2023-09-30T17:04:02.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.188 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:02.188 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.946744+0000", 2023-09-30T17:04:02.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.23282061100000001 2023-09-30T17:04:02.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.188 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:02.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.946818+0000", 2023-09-30T17:04:02.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3762000000000003e-05 2023-09-30T17:04:02.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:02.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.946949+0000", 2023-09-30T17:04:02.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013133900000000001 2023-09-30T17:04:02.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:02.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.951383+0000", 2023-09-30T17:04:02.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0044336999999999996 2023-09-30T17:04:02.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.190 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:02.190 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.969076+0000", 2023-09-30T17:04:02.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017693303000000001 2023-09-30T17:04:02.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.190 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:02.190 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.969119+0000", 2023-09-30T17:04:02.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3208999999999999e-05 2023-09-30T17:04:02.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.191 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:02.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.969153+0000", 2023-09-30T17:04:02.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3594999999999999e-05 2023-09-30T17:04:02.191 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:02.191 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:02.191 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:02.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.191 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:23713 4.33 e41/17 4:cf6d7a6c:::100000001f8.0000000a:head v 41'399, mlcod=41'397)", 2023-09-30T17:04:02.192 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.715224+0000", 2023-09-30T17:04:02.192 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.400428097999999, 2023-09-30T17:04:02.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.230022326, 2023-09-30T17:04:02.192 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:02.192 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:02.192 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:02.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:02.192 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.715224+0000", 2023-09-30T17:04:02.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:02.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:02.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.715224+0000", 2023-09-30T17:04:02.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:02.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:02.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.715228+0000", 2023-09-30T17:04:02.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4220000000000002e-06 2023-09-30T17:04:02.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:02.194 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.715239+0000", 2023-09-30T17:04:02.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0261999999999999e-05 2023-09-30T17:04:02.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:02.194 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.921195+0000", 2023-09-30T17:04:02.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.205955902 2023-09-30T17:04:02.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.195 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.921210+0000", 2023-09-30T17:04:02.195 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5109999999999999e-05 2023-09-30T17:04:02.195 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.195 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.195 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:02.195 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.921430+0000", 2023-09-30T17:04:02.195 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022019300000000001 2023-09-30T17:04:02.195 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.195 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.195 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:02.195 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.921454+0000", 2023-09-30T17:04:02.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4142e-05 2023-09-30T17:04:02.196 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.196 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.196 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:02.196 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.945208+0000", 2023-09-30T17:04:02.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.023753765999999999 2023-09-30T17:04:02.196 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.196 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.196 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:02.196 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.945246+0000", 2023-09-30T17:04:02.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8529000000000003e-05 2023-09-30T17:04:02.197 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:02.197 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:02.197 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:02.197 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.197 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24202 4.38 4:1dcf718c:::100000001f8.00000022:head [write 966656~4096,write 995328~4096,write 1007616~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:04:02.197 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.938506+0000", 2023-09-30T17:04:02.197 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.177146509, 2023-09-30T17:04:02.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.19404896199999999, 2023-09-30T17:04:02.197 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:02.198 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:02.198 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:02.198 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:02.198 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.198 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24202 2023-09-30T17:04:02.198 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.198 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:02.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:02.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938506+0000", 2023-09-30T17:04:02.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:02.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:02.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938506+0000", 2023-09-30T17:04:02.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:02.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:02.200 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938506+0000", 2023-09-30T17:04:02.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7899999999999999e-07 2023-09-30T17:04:02.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:02.200 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938539+0000", 2023-09-30T17:04:02.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2839999999999997e-05 2023-09-30T17:04:02.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.201 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:02.201 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938549+0000", 2023-09-30T17:04:02.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0202e-05 2023-09-30T17:04:02.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.201 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.201 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938554+0000", 2023-09-30T17:04:02.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1660000000000002e-06 2023-09-30T17:04:02.202 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.202 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:02.202 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.107092+0000", 2023-09-30T17:04:02.202 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.168537457 2023-09-30T17:04:02.202 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.202 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:02.203 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.107174+0000", 2023-09-30T17:04:02.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2380999999999996e-05 2023-09-30T17:04:02.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.203 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.203 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:02.203 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.132433+0000", 2023-09-30T17:04:02.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.025258939000000001 2023-09-30T17:04:02.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.203 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.203 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:02.204 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.132483+0000", 2023-09-30T17:04:02.204 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9951000000000003e-05 2023-09-30T17:04:02.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.204 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:02.204 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.132555+0000", 2023-09-30T17:04:02.204 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1647e-05 2023-09-30T17:04:02.204 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:02.204 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:02.205 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:02.205 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.205 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24207 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 2002944~4096,write 2060288~4096,write 2068480~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:04:02.205 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.938605+0000", 2023-09-30T17:04:02.205 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.177047242, 2023-09-30T17:04:02.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.19406049, 2023-09-30T17:04:02.205 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:02.205 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:02.206 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:02.206 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:02.206 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.206 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24207 2023-09-30T17:04:02.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.206 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:02.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.206 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:02.207 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938605+0000", 2023-09-30T17:04:02.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:02.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.207 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:02.207 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938605+0000", 2023-09-30T17:04:02.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:02.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.208 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:02.208 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938605+0000", 2023-09-30T17:04:02.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2899999999999999e-07 2023-09-30T17:04:02.208 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.208 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:02.208 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938621+0000", 2023-09-30T17:04:02.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5624000000000002e-05 2023-09-30T17:04:02.208 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.209 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:02.209 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938627+0000", 2023-09-30T17:04:02.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.925e-06 2023-09-30T17:04:02.209 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.209 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.209 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938630+0000", 2023-09-30T17:04:02.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4599999999999999e-06 2023-09-30T17:04:02.209 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:02.210 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.110850+0000", 2023-09-30T17:04:02.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.17221983699999999 2023-09-30T17:04:02.210 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:02.210 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.110930+0000", 2023-09-30T17:04:02.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0092999999999994e-05 2023-09-30T17:04:02.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:02.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.132561+0000", 2023-09-30T17:04:02.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021631371999999999 2023-09-30T17:04:02.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:02.212 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.132604+0000", 2023-09-30T17:04:02.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2818999999999998e-05 2023-09-30T17:04:02.212 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.212 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:02.212 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.132665+0000", 2023-09-30T17:04:02.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1030999999999999e-05 2023-09-30T17:04:02.212 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:02.212 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:02.212 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:02.212 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.213 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.213 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24210 4.30 4:0c89e311:::100000001f8.00000017:head [write 3231744~4096,write 3272704~4096,write 3346432~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:04:02.213 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.938660+0000", 2023-09-30T17:04:02.213 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.176992172999999, 2023-09-30T17:04:02.213 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.194937256, 2023-09-30T17:04:02.213 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:02.213 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:02.213 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:02.213 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:02.213 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.213 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24210 2023-09-30T17:04:02.213 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.214 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:02.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.214 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:02.214 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938660+0000", 2023-09-30T17:04:02.214 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:02.214 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.214 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:02.214 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938660+0000", 2023-09-30T17:04:02.214 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:02.215 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.215 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:02.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938660+0000", 2023-09-30T17:04:02.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5800000000000001e-07 2023-09-30T17:04:02.215 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.215 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:02.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938676+0000", 2023-09-30T17:04:02.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5650000000000001e-05 2023-09-30T17:04:02.215 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.216 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:02.216 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938685+0000", 2023-09-30T17:04:02.216 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9250000000000001e-06 2023-09-30T17:04:02.216 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.216 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.216 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.216 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938690+0000", 2023-09-30T17:04:02.216 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8160000000000001e-06 2023-09-30T17:04:02.216 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.216 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.216 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:02.217 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.110993+0000", 2023-09-30T17:04:02.217 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.172303714 2023-09-30T17:04:02.217 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.217 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:02.217 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.111072+0000", 2023-09-30T17:04:02.217 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8448999999999994e-05 2023-09-30T17:04:02.217 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.217 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:02.217 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.133463+0000", 2023-09-30T17:04:02.218 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022391297000000001 2023-09-30T17:04:02.218 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.218 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.218 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:02.218 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.133518+0000", 2023-09-30T17:04:02.218 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5278999999999997e-05 2023-09-30T17:04:02.218 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.218 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.218 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:02.218 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.133597+0000", 2023-09-30T17:04:02.218 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8868000000000005e-05 2023-09-30T17:04:02.219 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:02.219 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:02.219 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:02.219 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.219 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24218 4.30 4:0c89e311:::100000001f8.00000017:head [write 1191936~4096,write 1245184~4096,write 1261568~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:04:02.219 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.938815+0000", 2023-09-30T17:04:02.219 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.176836890000001, 2023-09-30T17:04:02.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.19788513899999999, 2023-09-30T17:04:02.219 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:02.220 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:02.220 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:02.220 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:02.220 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.220 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24218 2023-09-30T17:04:02.220 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.220 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:02.220 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.220 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:02.220 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938815+0000", 2023-09-30T17:04:02.220 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:02.220 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.221 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.221 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:02.221 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938815+0000", 2023-09-30T17:04:02.221 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:02.221 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.221 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.221 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:02.221 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938816+0000", 2023-09-30T17:04:02.221 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8699999999999995e-07 2023-09-30T17:04:02.221 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.221 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.222 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:02.222 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938837+0000", 2023-09-30T17:04:02.222 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1534000000000001e-05 2023-09-30T17:04:02.222 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.222 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.222 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:02.222 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938845+0000", 2023-09-30T17:04:02.222 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7190000000000001e-06 2023-09-30T17:04:02.222 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.222 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.222 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938850+0000", 2023-09-30T17:04:02.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1220000000000003e-06 2023-09-30T17:04:02.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.223 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:02.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.113486+0000", 2023-09-30T17:04:02.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.17463620299999999 2023-09-30T17:04:02.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.223 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:02.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.113626+0000", 2023-09-30T17:04:02.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013924799999999999 2023-09-30T17:04:02.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.224 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.224 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:02.224 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.136575+0000", 2023-09-30T17:04:02.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022949701999999999 2023-09-30T17:04:02.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.224 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.224 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:02.224 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.136623+0000", 2023-09-30T17:04:02.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7808e-05 2023-09-30T17:04:02.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.225 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.225 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:02.225 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.136700+0000", 2023-09-30T17:04:02.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7316000000000003e-05 2023-09-30T17:04:02.225 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:02.225 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:02.225 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:02.225 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.225 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.225 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24223 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 2449408~4096,write 2936832~4096,write 2973696~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:04:02.225 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.938922+0000", 2023-09-30T17:04:02.226 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.176730062000001, 2023-09-30T17:04:02.226 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.19909703600000001, 2023-09-30T17:04:02.226 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:02.226 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:02.226 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:02.226 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:02.226 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.226 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24223 2023-09-30T17:04:02.226 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.227 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:02.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:02.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938922+0000", 2023-09-30T17:04:02.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:02.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:02.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938922+0000", 2023-09-30T17:04:02.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:02.228 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.228 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.228 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:02.228 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938922+0000", 2023-09-30T17:04:02.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8599999999999999e-07 2023-09-30T17:04:02.228 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.228 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.228 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:02.228 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938943+0000", 2023-09-30T17:04:02.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0588999999999999e-05 2023-09-30T17:04:02.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.229 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:02.229 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938958+0000", 2023-09-30T17:04:02.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4915e-05 2023-09-30T17:04:02.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.229 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.229 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.938964+0000", 2023-09-30T17:04:02.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8329999999999999e-06 2023-09-30T17:04:02.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.230 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:02.230 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.114879+0000", 2023-09-30T17:04:02.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.17591552699999999 2023-09-30T17:04:02.230 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.230 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:02.230 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.114958+0000", 2023-09-30T17:04:02.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8666999999999997e-05 2023-09-30T17:04:02.230 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.231 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:02.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.137905+0000", 2023-09-30T17:04:02.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022947381999999999 2023-09-30T17:04:02.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.231 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:02.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.137948+0000", 2023-09-30T17:04:02.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2851e-05 2023-09-30T17:04:02.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.231 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:02.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.138019+0000", 2023-09-30T17:04:02.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0885999999999999e-05 2023-09-30T17:04:02.232 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:02.232 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:02.232 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:02.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.232 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24231 4.30 4:0c89e311:::100000001f8.00000017:head [write 3121152~4096,write 3174400~4096,write 3198976~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:04:02.232 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.939120+0000", 2023-09-30T17:04:02.232 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.176531723, 2023-09-30T17:04:02.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.199038715, 2023-09-30T17:04:02.232 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:02.233 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:02.233 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:02.233 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:02.233 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.233 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24231 2023-09-30T17:04:02.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.233 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:02.234 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.234 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:02.234 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939120+0000", 2023-09-30T17:04:02.234 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:02.234 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.234 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.234 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:02.234 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939120+0000", 2023-09-30T17:04:02.234 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:02.234 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.234 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.235 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:02.235 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939121+0000", 2023-09-30T17:04:02.235 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5799999999999999e-07 2023-09-30T17:04:02.235 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.235 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.235 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:02.235 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939138+0000", 2023-09-30T17:04:02.235 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6742e-05 2023-09-30T17:04:02.235 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.236 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.236 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:02.236 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939145+0000", 2023-09-30T17:04:02.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2230000000000001e-06 2023-09-30T17:04:02.236 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.236 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.236 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.236 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939155+0000", 2023-09-30T17:04:02.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.995e-06 2023-09-30T17:04:02.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:02.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.116318+0000", 2023-09-30T17:04:02.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.17716331799999999 2023-09-30T17:04:02.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:02.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.116392+0000", 2023-09-30T17:04:02.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3379000000000003e-05 2023-09-30T17:04:02.238 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:02.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.138027+0000", 2023-09-30T17:04:02.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021635318000000001 2023-09-30T17:04:02.238 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:02.239 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.138076+0000", 2023-09-30T17:04:02.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9055999999999999e-05 2023-09-30T17:04:02.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.239 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:02.239 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.138159+0000", 2023-09-30T17:04:02.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3126000000000003e-05 2023-09-30T17:04:02.239 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:02.239 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:02.239 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:02.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.240 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.240 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24247 4.30 4:0c89e311:::100000001f8.00000017:head [write 2134016~4096,write 2150400~4096,write 2207744~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:04:02.240 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.939330+0000", 2023-09-30T17:04:02.240 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.176322030000001, 2023-09-30T17:04:02.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.200392818, 2023-09-30T17:04:02.240 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:02.240 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:02.240 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:02.240 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:02.240 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.240 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24247 2023-09-30T17:04:02.240 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.241 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:02.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.241 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:02.241 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939330+0000", 2023-09-30T17:04:02.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:02.241 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.241 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:02.241 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939330+0000", 2023-09-30T17:04:02.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:02.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:02.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939330+0000", 2023-09-30T17:04:02.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7500000000000001e-07 2023-09-30T17:04:02.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:02.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939339+0000", 2023-09-30T17:04:02.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6719999999999993e-06 2023-09-30T17:04:02.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:02.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939342+0000", 2023-09-30T17:04:02.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4170000000000001e-06 2023-09-30T17:04:02.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939345+0000", 2023-09-30T17:04:02.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7190000000000001e-06 2023-09-30T17:04:02.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:02.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.126008+0000", 2023-09-30T17:04:02.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.18666300499999999 2023-09-30T17:04:02.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.245 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:02.245 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.126132+0000", 2023-09-30T17:04:02.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012387800000000001 2023-09-30T17:04:02.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.246 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:02.246 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.139635+0000", 2023-09-30T17:04:02.246 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013502739 2023-09-30T17:04:02.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.246 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:02.246 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.139669+0000", 2023-09-30T17:04:02.246 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3810000000000003e-05 2023-09-30T17:04:02.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:02.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.139723+0000", 2023-09-30T17:04:02.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4302999999999998e-05 2023-09-30T17:04:02.247 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:02.247 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:02.247 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:02.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.248 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24272 4.38 4:1fc350da:::100000001f8.0000002f:head [write 638976~4096,write 843776~4096,write 864256~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:04:02.248 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.939523+0000", 2023-09-30T17:04:02.248 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.176129121999999, 2023-09-30T17:04:02.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.19876761700000001, 2023-09-30T17:04:02.248 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:02.248 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:02.248 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:02.248 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:02.249 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.249 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24272 2023-09-30T17:04:02.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.249 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:02.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.249 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:02.249 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939523+0000", 2023-09-30T17:04:02.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:02.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.249 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:02.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939523+0000", 2023-09-30T17:04:02.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:02.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:02.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939523+0000", 2023-09-30T17:04:02.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6199999999999999e-07 2023-09-30T17:04:02.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:02.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939538+0000", 2023-09-30T17:04:02.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5122e-05 2023-09-30T17:04:02.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:02.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939544+0000", 2023-09-30T17:04:02.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.327e-06 2023-09-30T17:04:02.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939549+0000", 2023-09-30T17:04:02.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8130000000000003e-06 2023-09-30T17:04:02.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:02.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.123535+0000", 2023-09-30T17:04:02.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.18398595700000001 2023-09-30T17:04:02.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:02.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.123962+0000", 2023-09-30T17:04:02.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000427136 2023-09-30T17:04:02.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.253 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:02.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.138167+0000", 2023-09-30T17:04:02.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014205096 2023-09-30T17:04:02.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.253 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:02.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.138217+0000", 2023-09-30T17:04:02.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0241999999999998e-05 2023-09-30T17:04:02.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.254 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:02.254 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.138291+0000", 2023-09-30T17:04:02.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3561999999999998e-05 2023-09-30T17:04:02.254 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:02.254 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:02.254 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:02.254 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.254 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:24277 4.38 4:1fc350da:::100000001f8.0000002f:head [write 1036288~4096,write 1122304~4096,write 1220608~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:04:02.254 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.939581+0000", 2023-09-30T17:04:02.254 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 23.176071348000001, 2023-09-30T17:04:02.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.200284616, 2023-09-30T17:04:02.255 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:02.255 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:02.255 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:02.255 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:02.255 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.255 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 24277 2023-09-30T17:04:02.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.255 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:02.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:02.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939581+0000", 2023-09-30T17:04:02.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:02.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:02.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939581+0000", 2023-09-30T17:04:02.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:02.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:02.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939581+0000", 2023-09-30T17:04:02.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4499999999999998e-07 2023-09-30T17:04:02.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.257 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.257 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:02.257 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939596+0000", 2023-09-30T17:04:02.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5007999999999999e-05 2023-09-30T17:04:02.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.257 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.257 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:02.257 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939600+0000", 2023-09-30T17:04:02.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6859999999999999e-06 2023-09-30T17:04:02.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.258 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.939603+0000", 2023-09-30T17:04:02.258 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8700000000000001e-06 2023-09-30T17:04:02.258 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:02.258 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.129152+0000", 2023-09-30T17:04:02.258 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.18954922599999999 2023-09-30T17:04:02.258 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.259 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:02.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.129238+0000", 2023-09-30T17:04:02.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6446000000000005e-05 2023-09-30T17:04:02.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.259 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:02.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.139771+0000", 2023-09-30T17:04:02.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010532674000000001 2023-09-30T17:04:02.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:02.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.139819+0000", 2023-09-30T17:04:02.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7633999999999998e-05 2023-09-30T17:04:02.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:02.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:02.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:02.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:39.139865+0000", 2023-09-30T17:04:02.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6826999999999997e-05 2023-09-30T17:04:02.261 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:02.261 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:02.261 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:02.261 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:02.261 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:02.261 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:04:02.262 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:02.262+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:02.263 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:04:02.289 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is set 2023-09-30T17:04:02.364 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:02.363+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:02.457 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:04:02.457 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:04:02.457 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.457 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:89298 4.6 4:616d4c41:::100000001f8.00000034:head [write 3379200~4096 in=4096b,write 3481600~4096 in=4096b,write 3522560~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:02.457 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.374871+0000", 2023-09-30T17:04:02.458 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.077698933999999997, 2023-09-30T17:04:02.458 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.077727423000000004, 2023-09-30T17:04:02.458 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.458 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:02.458 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:02.458 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:02.458 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.458 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 89298 2023-09-30T17:04:02.458 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.458 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.459 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.459 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.459 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.374871+0000", 2023-09-30T17:04:02.459 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.459 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.459 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.459 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.459 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.374871+0000", 2023-09-30T17:04:02.459 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.459 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.459 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.459 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.460 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.374872+0000", 2023-09-30T17:04:02.460 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.6500000000000008e-07 2023-09-30T17:04:02.460 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.460 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.460 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.460 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.374884+0000", 2023-09-30T17:04:02.460 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1746000000000001e-05 2023-09-30T17:04:02.460 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.460 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.460 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.460 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.374894+0000", 2023-09-30T17:04:02.461 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0594999999999999e-05 2023-09-30T17:04:02.461 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.461 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.461 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.461 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.374903+0000", 2023-09-30T17:04:02.461 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2910000000000007e-06 2023-09-30T17:04:02.461 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.461 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.461 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:02.461 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.398370+0000", 2023-09-30T17:04:02.461 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023467100000000001 2023-09-30T17:04:02.461 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.462 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.462 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:02.462 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.398453+0000", 2023-09-30T17:04:02.462 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3394999999999997e-05 2023-09-30T17:04:02.462 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.462 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.462 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:02.462 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.398625+0000", 2023-09-30T17:04:02.462 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017215199999999999 2023-09-30T17:04:02.462 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.462 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.462 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:02.463 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.412045+0000", 2023-09-30T17:04:02.463 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.013419746999999999 2023-09-30T17:04:02.463 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.463 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.463 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.463 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.463 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.463 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:89333 4.6 4:63e80496:::100000001f8.0000001e:head [write 192512~4096 in=4096b,write 204800~4096 in=4096b,write 229376~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:02.463 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.385542+0000", 2023-09-30T17:04:02.463 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.067027448000000003, 2023-09-30T17:04:02.463 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.067110791000000003, 2023-09-30T17:04:02.464 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.464 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:02.464 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:02.464 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:02.464 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.464 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 89333 2023-09-30T17:04:02.464 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.464 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.464 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.464 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.465 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.385542+0000", 2023-09-30T17:04:02.465 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.465 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.465 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.465 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.465 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.385542+0000", 2023-09-30T17:04:02.465 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.465 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.465 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.465 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.465 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.385543+0000", 2023-09-30T17:04:02.465 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.6299999999999993e-07 2023-09-30T17:04:02.465 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.466 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.466 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.466 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.385555+0000", 2023-09-30T17:04:02.466 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1749000000000001e-05 2023-09-30T17:04:02.466 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.466 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.466 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.466 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.385569+0000", 2023-09-30T17:04:02.466 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3692999999999999e-05 2023-09-30T17:04:02.466 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.466 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.467 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.467 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.385577+0000", 2023-09-30T17:04:02.467 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7530000000000001e-06 2023-09-30T17:04:02.467 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.467 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.467 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:02.467 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.419790+0000", 2023-09-30T17:04:02.467 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.034213730999999997 2023-09-30T17:04:02.467 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.467 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.467 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:02.467 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.419866+0000", 2023-09-30T17:04:02.468 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5686999999999995e-05 2023-09-30T17:04:02.468 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.468 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.468 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:02.468 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.419992+0000", 2023-09-30T17:04:02.468 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00012615900000000001 2023-09-30T17:04:02.468 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.468 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.468 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.468 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.468 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.468 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:89417 4.28 4:153ae410:::100000001f8.0000003b:head [write 2723840~4096 in=4096b,write 2830336~4096 in=4096b,write 2871296~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:02.469 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.415389+0000", 2023-09-30T17:04:02.469 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.037181148999999997, 2023-09-30T17:04:02.469 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.037312926000000003, 2023-09-30T17:04:02.469 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.469 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:02.469 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:02.469 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:02.469 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.469 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 89417 2023-09-30T17:04:02.469 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.469 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.469 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.470 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.470 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.415389+0000", 2023-09-30T17:04:02.470 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.470 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.470 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.470 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.470 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.415389+0000", 2023-09-30T17:04:02.470 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.470 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.470 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.470 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.471 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.415389+0000", 2023-09-30T17:04:02.471 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6400000000000003e-07 2023-09-30T17:04:02.471 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.471 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.471 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.471 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.415401+0000", 2023-09-30T17:04:02.471 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1666e-05 2023-09-30T17:04:02.471 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.471 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.471 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.471 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.415426+0000", 2023-09-30T17:04:02.471 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.5270999999999999e-05 2023-09-30T17:04:02.472 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.472 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.472 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.472 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.415434+0000", 2023-09-30T17:04:02.472 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5159999999999997e-06 2023-09-30T17:04:02.472 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.472 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.472 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:02.472 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.415486+0000", 2023-09-30T17:04:02.472 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1839000000000003e-05 2023-09-30T17:04:02.472 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.472 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.473 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:02.473 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.415565+0000", 2023-09-30T17:04:02.473 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9511000000000005e-05 2023-09-30T17:04:02.473 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.473 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.473 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:02.473 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.415716+0000", 2023-09-30T17:04:02.473 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015066600000000001 2023-09-30T17:04:02.473 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.473 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.473 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.473 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.474 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.474 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:89226 4.f e49/17)", 2023-09-30T17:04:02.474 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.396677+0000", 2023-09-30T17:04:02.474 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.055892998999999999, 2023-09-30T17:04:02.474 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.056065614999999999, 2023-09-30T17:04:02.474 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.474 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:02.474 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.474 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.474 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.474 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.396677+0000", 2023-09-30T17:04:02.475 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.475 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.475 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.475 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.475 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.396677+0000", 2023-09-30T17:04:02.475 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.475 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.475 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.475 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.475 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.396677+0000", 2023-09-30T17:04:02.475 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.7099999999999998e-07 2023-09-30T17:04:02.475 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.475 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.476 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.476 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.396688+0000", 2023-09-30T17:04:02.476 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.039e-05 2023-09-30T17:04:02.476 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.476 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.476 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.476 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.396695+0000", 2023-09-30T17:04:02.476 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.029e-06 2023-09-30T17:04:02.476 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.476 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.476 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.476 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.396699+0000", 2023-09-30T17:04:02.477 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4159999999999997e-06 2023-09-30T17:04:02.477 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.477 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.477 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.477 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.477 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.477 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:89418 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 3878912~4096 in=4096b,write 3919872~4096 in=4096b,write 4038656~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:02.477 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.415451+0000", 2023-09-30T17:04:02.477 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.037118538999999999, 2023-09-30T17:04:02.477 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.037322449000000001, 2023-09-30T17:04:02.477 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.477 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:02.478 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:02.478 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:02.478 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.478 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 89418 2023-09-30T17:04:02.478 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.478 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.478 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.478 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.478 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.415451+0000", 2023-09-30T17:04:02.478 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.478 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.478 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.479 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.479 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.415451+0000", 2023-09-30T17:04:02.479 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.479 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.479 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.479 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.479 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.415452+0000", 2023-09-30T17:04:02.479 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4099999999999999e-07 2023-09-30T17:04:02.479 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.479 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.479 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.479 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.415472+0000", 2023-09-30T17:04:02.480 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.0129999999999999e-05 2023-09-30T17:04:02.480 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.480 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.480 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.480 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.415481+0000", 2023-09-30T17:04:02.480 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.6950000000000006e-06 2023-09-30T17:04:02.480 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.480 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.480 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.480 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.415490+0000", 2023-09-30T17:04:02.480 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9560000000000003e-06 2023-09-30T17:04:02.480 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.481 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.481 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:02.481 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.415557+0000", 2023-09-30T17:04:02.481 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7763999999999997e-05 2023-09-30T17:04:02.481 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.481 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.481 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:02.481 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.415666+0000", 2023-09-30T17:04:02.481 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010804800000000001 2023-09-30T17:04:02.481 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.481 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.481 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:02.482 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.415826+0000", 2023-09-30T17:04:02.482 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016086099999999999 2023-09-30T17:04:02.482 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.482 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.482 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.482 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.482 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.482 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:89249 4.27 4.df99e167 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:02.482 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.357571+0000", 2023-09-30T17:04:02.482 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.094998695999999994, 2023-09-30T17:04:02.482 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.095243676999999999, 2023-09-30T17:04:02.482 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.483 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:02.483 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:02.483 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:02.483 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.483 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 89249 2023-09-30T17:04:02.483 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.483 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.483 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.483 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.483 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.357571+0000", 2023-09-30T17:04:02.483 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.483 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.484 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.484 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.484 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.357571+0000", 2023-09-30T17:04:02.484 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.484 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.484 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.484 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.484 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.357572+0000", 2023-09-30T17:04:02.484 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3699999999999999e-07 2023-09-30T17:04:02.484 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.484 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.484 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.484 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.357584+0000", 2023-09-30T17:04:02.485 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1962e-05 2023-09-30T17:04:02.485 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.485 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.485 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.485 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.357594+0000", 2023-09-30T17:04:02.485 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8430000000000005e-06 2023-09-30T17:04:02.485 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.485 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.485 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.485 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.357602+0000", 2023-09-30T17:04:02.485 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6459999999999993e-06 2023-09-30T17:04:02.485 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.486 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.486 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.486 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.486 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.486 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:89419 4.8 4:11ee3b64:::100000001f8.0000003e:head [write 1990656~4096 in=4096b,write 2007040~4096 in=4096b,write 2121728~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:02.486 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.415506+0000", 2023-09-30T17:04:02.486 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.03706367, 2023-09-30T17:04:02.486 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.037342409, 2023-09-30T17:04:02.486 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.486 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:02.486 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:02.486 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:02.486 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.487 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 89419 2023-09-30T17:04:02.487 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.487 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.487 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.487 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.487 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.415506+0000", 2023-09-30T17:04:02.487 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.487 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.487 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.487 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.487 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.415506+0000", 2023-09-30T17:04:02.487 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.488 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.488 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.488 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.488 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.415507+0000", 2023-09-30T17:04:02.488 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1099999999999995e-07 2023-09-30T17:04:02.488 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.488 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.488 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.488 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.415519+0000", 2023-09-30T17:04:02.488 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1807000000000001e-05 2023-09-30T17:04:02.489 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.489 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.489 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.489 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.415527+0000", 2023-09-30T17:04:02.489 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2519999999999999e-06 2023-09-30T17:04:02.489 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.489 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.489 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.489 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.415534+0000", 2023-09-30T17:04:02.489 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5379999999999997e-06 2023-09-30T17:04:02.489 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.490 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.490 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:02.490 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.415653+0000", 2023-09-30T17:04:02.490 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00011828300000000001 2023-09-30T17:04:02.490 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.490 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.490 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:02.490 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.416263+0000", 2023-09-30T17:04:02.490 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00061023900000000005 2023-09-30T17:04:02.490 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.490 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.491 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.491 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.491 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.491 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:89303 4.36 4:6da220e6:::100000001f8.0000003f:head [write 28672~4096 in=4096b,write 135168~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:02.491 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.379653+0000", 2023-09-30T17:04:02.491 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.072916725000000002, 2023-09-30T17:04:02.491 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.073236156999999996, 2023-09-30T17:04:02.491 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.491 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:02.491 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:02.491 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:02.491 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.492 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 89303 2023-09-30T17:04:02.492 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.492 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.492 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.492 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.492 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.379653+0000", 2023-09-30T17:04:02.492 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.492 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.492 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.492 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.492 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.379653+0000", 2023-09-30T17:04:02.493 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.493 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.493 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.493 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.493 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.379654+0000", 2023-09-30T17:04:02.493 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.6400000000000001e-07 2023-09-30T17:04:02.493 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.493 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.493 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.493 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.379679+0000", 2023-09-30T17:04:02.493 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4763999999999999e-05 2023-09-30T17:04:02.493 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.494 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.494 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.494 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.379688+0000", 2023-09-30T17:04:02.494 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1309999999999995e-06 2023-09-30T17:04:02.494 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.494 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.494 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.494 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.379697+0000", 2023-09-30T17:04:02.494 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.6600000000000001e-06 2023-09-30T17:04:02.494 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.494 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.494 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:02.495 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.402364+0000", 2023-09-30T17:04:02.495 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.022667757 2023-09-30T17:04:02.495 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.495 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.495 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:02.495 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.402448+0000", 2023-09-30T17:04:02.495 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3608000000000003e-05 2023-09-30T17:04:02.495 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.495 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.495 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:02.495 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.402549+0000", 2023-09-30T17:04:02.496 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000100859 2023-09-30T17:04:02.496 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.496 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.496 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:02.496 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.412138+0000", 2023-09-30T17:04:02.496 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0095893590000000004 2023-09-30T17:04:02.496 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.496 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.496 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.496 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.496 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.496 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:89420 4.15 4:aada5e43:::100000001f8.00000028:head [write 872448~4096 in=4096b,write 950272~4096 in=4096b,write 958464~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:02.496 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.415550+0000", 2023-09-30T17:04:02.497 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.037020153, 2023-09-30T17:04:02.497 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.037386264000000002, 2023-09-30T17:04:02.497 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.497 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:02.497 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:02.497 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:02.497 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.497 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 89420 2023-09-30T17:04:02.497 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.497 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.497 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.497 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.498 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.415550+0000", 2023-09-30T17:04:02.498 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.498 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.498 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.498 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.498 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.415550+0000", 2023-09-30T17:04:02.498 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.498 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.498 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.498 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.498 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.415550+0000", 2023-09-30T17:04:02.499 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3099999999999998e-07 2023-09-30T17:04:02.499 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.499 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.499 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.499 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.415561+0000", 2023-09-30T17:04:02.499 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0397000000000001e-05 2023-09-30T17:04:02.499 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.499 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.499 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.499 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.415568+0000", 2023-09-30T17:04:02.499 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5530000000000004e-06 2023-09-30T17:04:02.499 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.500 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.500 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.500 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.415574+0000", 2023-09-30T17:04:02.500 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9039999999999997e-06 2023-09-30T17:04:02.500 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.500 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.500 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:02.500 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.420782+0000", 2023-09-30T17:04:02.500 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005208173 2023-09-30T17:04:02.500 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.500 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.500 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:02.501 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.420850+0000", 2023-09-30T17:04:02.501 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.758e-05 2023-09-30T17:04:02.501 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.501 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.501 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:02.501 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.420976+0000", 2023-09-30T17:04:02.501 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00012647600000000001 2023-09-30T17:04:02.501 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.501 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.501 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.501 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.501 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.502 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:89129 4.f e49/17 4:f2a80dfe:::100000001f8.00000019:head v 49'4260, mlcod=49'4251)", 2023-09-30T17:04:02.502 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.379661+0000", 2023-09-30T17:04:02.502 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.072908676000000006, 2023-09-30T17:04:02.502 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.073316252999999998, 2023-09-30T17:04:02.502 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.502 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:02.502 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.502 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.502 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.502 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.379661+0000", 2023-09-30T17:04:02.502 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.502 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.503 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.503 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.503 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.379661+0000", 2023-09-30T17:04:02.503 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.503 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.503 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.503 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.503 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.379662+0000", 2023-09-30T17:04:02.503 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6199999999999997e-07 2023-09-30T17:04:02.503 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.503 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.504 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.504 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.379678+0000", 2023-09-30T17:04:02.504 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5818999999999999e-05 2023-09-30T17:04:02.504 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.504 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.504 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.504 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.379689+0000", 2023-09-30T17:04:02.504 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.111e-05 2023-09-30T17:04:02.504 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.504 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.504 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.505 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.379697+0000", 2023-09-30T17:04:02.505 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1089999999999998e-06 2023-09-30T17:04:02.505 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.505 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.505 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:02.505 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.401808+0000", 2023-09-30T17:04:02.505 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.022110840999999999 2023-09-30T17:04:02.505 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.505 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.505 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:02.505 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.401821+0000", 2023-09-30T17:04:02.506 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2804e-05 2023-09-30T17:04:02.506 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.506 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.506 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.506 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.506 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.506 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:89185 4.f e49/17 4:f0d983b2:::100000001f8.0000001f:head v 49'4263, mlcod=49'4251)", 2023-09-30T17:04:02.506 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.386056+0000", 2023-09-30T17:04:02.506 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.066513786000000005, 2023-09-30T17:04:02.506 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.066955062999999995, 2023-09-30T17:04:02.506 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.506 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:02.507 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.507 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.507 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.507 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.386056+0000", 2023-09-30T17:04:02.507 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.507 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.507 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.507 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.507 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.386056+0000", 2023-09-30T17:04:02.507 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.507 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.507 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.508 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.508 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.386056+0000", 2023-09-30T17:04:02.508 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.8700000000000002e-07 2023-09-30T17:04:02.508 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.508 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.508 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.508 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.386067+0000", 2023-09-30T17:04:02.508 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0502999999999999e-05 2023-09-30T17:04:02.508 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.508 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.508 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.508 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.386073+0000", 2023-09-30T17:04:02.509 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9989999999999997e-06 2023-09-30T17:04:02.509 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.509 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.509 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.509 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.386077+0000", 2023-09-30T17:04:02.509 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2069999999999997e-06 2023-09-30T17:04:02.509 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.509 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.509 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:02.509 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.414554+0000", 2023-09-30T17:04:02.509 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.028476402000000001 2023-09-30T17:04:02.509 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.510 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.510 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:02.510 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.414574+0000", 2023-09-30T17:04:02.510 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.0098999999999998e-05 2023-09-30T17:04:02.510 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.510 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.510 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.510 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.510 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.510 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:89421 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 2940928~4096 in=4096b,write 3006464~4096 in=4096b,write 3121152~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:02.510 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.416086+0000", 2023-09-30T17:04:02.511 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.036484365999999997, 2023-09-30T17:04:02.511 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.036962165999999998, 2023-09-30T17:04:02.511 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.511 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:02.511 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:02.511 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:02.511 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.511 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 89421 2023-09-30T17:04:02.511 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.511 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.511 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.512 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.512 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.416086+0000", 2023-09-30T17:04:02.512 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.512 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.512 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.512 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.512 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.416086+0000", 2023-09-30T17:04:02.512 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.512 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.512 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.512 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.512 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.416086+0000", 2023-09-30T17:04:02.513 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5099999999999998e-07 2023-09-30T17:04:02.513 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.513 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.513 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.513 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.416098+0000", 2023-09-30T17:04:02.513 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1715999999999999e-05 2023-09-30T17:04:02.513 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.513 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.513 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.513 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.416109+0000", 2023-09-30T17:04:02.513 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1161999999999999e-05 2023-09-30T17:04:02.513 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.513 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.514 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.514 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.416117+0000", 2023-09-30T17:04:02.514 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5660000000000001e-06 2023-09-30T17:04:02.514 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.514 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.514 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:02.514 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.417829+0000", 2023-09-30T17:04:02.514 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0017124250000000001 2023-09-30T17:04:02.514 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.514 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.514 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:02.515 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.417907+0000", 2023-09-30T17:04:02.515 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8211e-05 2023-09-30T17:04:02.515 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.515 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.515 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:02.515 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.418055+0000", 2023-09-30T17:04:02.515 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014772799999999999 2023-09-30T17:04:02.515 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.515 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.515 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.515 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.515 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.516 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:89271 4.27 4.df99e167 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:02.516 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.367342+0000", 2023-09-30T17:04:02.516 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.085227619000000004, 2023-09-30T17:04:02.516 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.085745593999999994, 2023-09-30T17:04:02.516 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.516 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:02.516 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:02.516 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:02.516 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.516 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 89271 2023-09-30T17:04:02.516 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.516 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.517 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.517 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.517 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.367342+0000", 2023-09-30T17:04:02.517 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.517 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.517 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.517 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.517 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.367342+0000", 2023-09-30T17:04:02.517 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.517 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.517 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.517 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.517 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.367343+0000", 2023-09-30T17:04:02.518 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9399999999999995e-07 2023-09-30T17:04:02.518 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.518 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.518 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.518 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.367356+0000", 2023-09-30T17:04:02.518 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3407999999999999e-05 2023-09-30T17:04:02.518 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.518 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.518 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.518 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.367366+0000", 2023-09-30T17:04:02.518 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3300000000000005e-06 2023-09-30T17:04:02.518 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.519 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.519 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.519 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.367372+0000", 2023-09-30T17:04:02.519 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3999999999999997e-06 2023-09-30T17:04:02.519 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.519 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.519 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.519 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.519 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.519 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:89305 4.e 4:73e84e43:::100000001f8.00000004:head [write 3715072~4096 in=4096b,write 4005888~4096 in=4096b,write 4026368~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:02.519 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.379710+0000", 2023-09-30T17:04:02.519 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.072859726, 2023-09-30T17:04:02.520 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.073410972000000005, 2023-09-30T17:04:02.520 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.520 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:02.520 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:02.520 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:02.520 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.520 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 89305 2023-09-30T17:04:02.520 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.520 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.520 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.520 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.520 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.379710+0000", 2023-09-30T17:04:02.521 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.521 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.521 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.521 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.521 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.379710+0000", 2023-09-30T17:04:02.521 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.521 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.521 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.521 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.521 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.379711+0000", 2023-09-30T17:04:02.521 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8100000000000003e-07 2023-09-30T17:04:02.521 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.521 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.522 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.522 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.379725+0000", 2023-09-30T17:04:02.522 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4046000000000001e-05 2023-09-30T17:04:02.522 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.522 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.522 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.522 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.379733+0000", 2023-09-30T17:04:02.522 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2859999999999999e-06 2023-09-30T17:04:02.522 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.522 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.522 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.523 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.379740+0000", 2023-09-30T17:04:02.523 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5390000000000004e-06 2023-09-30T17:04:02.523 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.523 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.523 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:02.523 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.404744+0000", 2023-09-30T17:04:02.523 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.025004141000000001 2023-09-30T17:04:02.523 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.523 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.523 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:02.523 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.404823+0000", 2023-09-30T17:04:02.524 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9358999999999997e-05 2023-09-30T17:04:02.524 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.524 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.524 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.524 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.524 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.524 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:89335 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:02.524 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.388856+0000", 2023-09-30T17:04:02.524 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.063713633000000006, 2023-09-30T17:04:02.524 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.064311253999999998, 2023-09-30T17:04:02.524 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.525 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:02.525 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:02.525 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:02.525 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.525 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 89335 2023-09-30T17:04:02.525 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.525 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.525 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.525 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.525 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.388856+0000", 2023-09-30T17:04:02.525 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.526 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.526 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.526 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.526 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.388856+0000", 2023-09-30T17:04:02.526 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.526 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.526 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.526 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.526 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.388857+0000", 2023-09-30T17:04:02.526 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1179999999999999e-06 2023-09-30T17:04:02.526 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.527 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.527 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.527 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.388873+0000", 2023-09-30T17:04:02.527 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5614999999999999e-05 2023-09-30T17:04:02.527 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.527 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.527 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.527 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.388881+0000", 2023-09-30T17:04:02.527 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3909999999999998e-06 2023-09-30T17:04:02.527 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.527 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.527 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.528 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.388888+0000", 2023-09-30T17:04:02.528 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1530000000000002e-06 2023-09-30T17:04:02.528 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.528 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.528 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.528 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.528 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.528 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:89422 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 3194880~4096 in=4096b,write 3268608~4096 in=4096b,write 3293184~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:02.528 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.416137+0000", 2023-09-30T17:04:02.528 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.036433060000000003, 2023-09-30T17:04:02.528 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.037065010000000002, 2023-09-30T17:04:02.529 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.529 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:02.529 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:02.529 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:02.529 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.529 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 89422 2023-09-30T17:04:02.529 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.529 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.529 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.529 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.529 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.416137+0000", 2023-09-30T17:04:02.529 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.530 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.530 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.530 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.530 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.416137+0000", 2023-09-30T17:04:02.530 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.530 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.530 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.530 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.530 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.416138+0000", 2023-09-30T17:04:02.530 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8100000000000002e-07 2023-09-30T17:04:02.530 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.530 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.531 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.531 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.416147+0000", 2023-09-30T17:04:02.531 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.5589999999999994e-06 2023-09-30T17:04:02.531 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.531 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.531 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.531 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.416155+0000", 2023-09-30T17:04:02.531 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0989999999999999e-06 2023-09-30T17:04:02.531 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.531 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.531 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.531 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.416166+0000", 2023-09-30T17:04:02.532 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1233000000000001e-05 2023-09-30T17:04:02.532 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.532 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.532 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:02.532 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.420411+0000", 2023-09-30T17:04:02.532 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0042442460000000001 2023-09-30T17:04:02.532 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.532 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.532 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:02.532 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.420491+0000", 2023-09-30T17:04:02.532 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0489999999999997e-05 2023-09-30T17:04:02.532 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.533 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.533 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:02.533 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.420646+0000", 2023-09-30T17:04:02.533 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000155029 2023-09-30T17:04:02.533 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.533 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.533 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.533 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.533 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.533 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:89281 4.2f e49/17)", 2023-09-30T17:04:02.533 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.406270+0000", 2023-09-30T17:04:02.533 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.046299435, 2023-09-30T17:04:02.534 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.046970919999999999, 2023-09-30T17:04:02.534 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.534 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:02.534 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.534 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.534 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.534 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.406270+0000", 2023-09-30T17:04:02.534 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.534 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.534 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.534 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.535 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.406270+0000", 2023-09-30T17:04:02.535 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.535 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.535 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.535 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.535 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.406271+0000", 2023-09-30T17:04:02.535 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.91e-07 2023-09-30T17:04:02.535 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.535 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.535 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.536 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.406282+0000", 2023-09-30T17:04:02.536 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1678000000000001e-05 2023-09-30T17:04:02.536 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.536 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.536 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.536 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.406288+0000", 2023-09-30T17:04:02.536 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.558e-06 2023-09-30T17:04:02.536 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.536 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.536 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.536 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.406292+0000", 2023-09-30T17:04:02.537 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.189e-06 2023-09-30T17:04:02.537 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.537 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.537 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.537 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.537 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.537 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:89353 4.f e49/17)", 2023-09-30T17:04:02.537 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.417649+0000", 2023-09-30T17:04:02.537 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.034920817999999999, 2023-09-30T17:04:02.537 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.035617775999999997, 2023-09-30T17:04:02.537 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.537 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:02.538 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.538 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.538 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.538 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.417649+0000", 2023-09-30T17:04:02.538 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.538 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.538 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.538 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.538 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.417649+0000", 2023-09-30T17:04:02.538 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.538 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.539 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.539 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.539 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.417650+0000", 2023-09-30T17:04:02.539 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5499999999999997e-07 2023-09-30T17:04:02.539 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.539 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.539 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.539 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.417665+0000", 2023-09-30T17:04:02.539 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5288999999999999e-05 2023-09-30T17:04:02.539 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.539 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.540 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.540 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.417675+0000", 2023-09-30T17:04:02.540 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.6530000000000006e-06 2023-09-30T17:04:02.540 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.540 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.540 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.540 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.417682+0000", 2023-09-30T17:04:02.540 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.917e-06 2023-09-30T17:04:02.540 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.540 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.540 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.540 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.541 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.541 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:89151 4.3f 4.a34187bf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:02.541 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.325641+0000", 2023-09-30T17:04:02.541 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.12692868500000001, 2023-09-30T17:04:02.541 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.127654769, 2023-09-30T17:04:02.541 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.541 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:02.541 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:02.541 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:02.541 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.541 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 89151 2023-09-30T17:04:02.541 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.542 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.542 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.542 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.542 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.325641+0000", 2023-09-30T17:04:02.542 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.542 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.542 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.542 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.542 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.325641+0000", 2023-09-30T17:04:02.542 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.543 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.543 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.543 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.543 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.325642+0000", 2023-09-30T17:04:02.543 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3600000000000002e-07 2023-09-30T17:04:02.543 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.543 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.543 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.543 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.325655+0000", 2023-09-30T17:04:02.543 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2690999999999999e-05 2023-09-30T17:04:02.543 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.544 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.544 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.544 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.325667+0000", 2023-09-30T17:04:02.544 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.184e-05 2023-09-30T17:04:02.544 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.544 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.544 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.544 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.325674+0000", 2023-09-30T17:04:02.544 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7689999999999996e-06 2023-09-30T17:04:02.544 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.544 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.544 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.545 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.545 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.545 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:89308 4.36 4:6fa85f86:::100000001f8.00000013:head [write 1462272~4096 in=4096b,write 1482752~4096 in=4096b,write 1556480~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:02.545 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.379749+0000", 2023-09-30T17:04:02.545 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.072821146000000003, 2023-09-30T17:04:02.545 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.073580724, 2023-09-30T17:04:02.545 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.545 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:02.545 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:02.545 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:02.545 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.545 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 89308 2023-09-30T17:04:02.546 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.546 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.546 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.546 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.546 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.379749+0000", 2023-09-30T17:04:02.546 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.546 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.546 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.546 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.546 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.379749+0000", 2023-09-30T17:04:02.546 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.547 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.547 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.547 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.547 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.379749+0000", 2023-09-30T17:04:02.547 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9800000000000004e-07 2023-09-30T17:04:02.547 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.547 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.547 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.547 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.379763+0000", 2023-09-30T17:04:02.547 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3322999999999999e-05 2023-09-30T17:04:02.547 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.547 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.548 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.548 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.379770+0000", 2023-09-30T17:04:02.548 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2620000000000001e-06 2023-09-30T17:04:02.548 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.548 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.548 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.548 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.379776+0000", 2023-09-30T17:04:02.548 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0700000000000003e-06 2023-09-30T17:04:02.548 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.548 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.548 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:02.549 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.405416+0000", 2023-09-30T17:04:02.549 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.025639680000000001 2023-09-30T17:04:02.549 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.549 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.549 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:02.549 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.405485+0000", 2023-09-30T17:04:02.549 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9646000000000004e-05 2023-09-30T17:04:02.549 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.549 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.549 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:02.550 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.405898+0000", 2023-09-30T17:04:02.550 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00041227700000000001 2023-09-30T17:04:02.550 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.550 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.550 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:02.550 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.414210+0000", 2023-09-30T17:04:02.550 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0083125400000000002 2023-09-30T17:04:02.550 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.550 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.550 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.550 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.551 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.551 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:89255 4.37 e49/17)", 2023-09-30T17:04:02.551 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.399928+0000", 2023-09-30T17:04:02.551 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.052642086999999997, 2023-09-30T17:04:02.551 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.053444269000000003, 2023-09-30T17:04:02.551 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.551 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:02.551 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.551 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.551 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.553 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.399928+0000", 2023-09-30T17:04:02.554 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.554 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.554 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.554 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.554 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.399928+0000", 2023-09-30T17:04:02.554 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.554 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.554 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.554 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.554 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.399928+0000", 2023-09-30T17:04:02.554 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.1199999999999999e-07 2023-09-30T17:04:02.555 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.555 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.555 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.555 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.399937+0000", 2023-09-30T17:04:02.555 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3349999999999996e-06 2023-09-30T17:04:02.555 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.555 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.555 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.556 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.399942+0000", 2023-09-30T17:04:02.556 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5619999999999997e-06 2023-09-30T17:04:02.556 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.556 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.556 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.556 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.399945+0000", 2023-09-30T17:04:02.556 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.1879999999999998e-06 2023-09-30T17:04:02.556 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.556 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.556 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.556 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.556 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.557 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:89396 4.28 4:153ae410:::100000001f8.0000003b:head [write 2899968~4096 in=4096b,write 3739648~4096 in=4096b,write 3809280~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:02.557 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.406945+0000", 2023-09-30T17:04:02.557 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.045624524, 2023-09-30T17:04:02.557 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.046457061000000001, 2023-09-30T17:04:02.557 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.557 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:02.557 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:02.557 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:02.557 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.557 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 89396 2023-09-30T17:04:02.557 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.557 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.558 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.558 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.558 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.406945+0000", 2023-09-30T17:04:02.558 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.558 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.558 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.558 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.558 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.406945+0000", 2023-09-30T17:04:02.558 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.558 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.558 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.559 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.559 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.406946+0000", 2023-09-30T17:04:02.559 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4499999999999997e-07 2023-09-30T17:04:02.559 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.559 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.559 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.559 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.406981+0000", 2023-09-30T17:04:02.559 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5432000000000002e-05 2023-09-30T17:04:02.559 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.559 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.559 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.560 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.406990+0000", 2023-09-30T17:04:02.560 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4090000000000003e-06 2023-09-30T17:04:02.560 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.560 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.560 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.560 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.406995+0000", 2023-09-30T17:04:02.560 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5729999999999998e-06 2023-09-30T17:04:02.560 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.560 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.560 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:02.560 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.409088+0000", 2023-09-30T17:04:02.560 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0020924250000000002 2023-09-30T17:04:02.561 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.561 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.561 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:02.561 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.409183+0000", 2023-09-30T17:04:02.561 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.5587000000000005e-05 2023-09-30T17:04:02.561 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.561 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.561 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:02.561 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.409307+0000", 2023-09-30T17:04:02.561 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000123502 2023-09-30T17:04:02.561 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.561 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.561 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.562 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.562 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.562 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop_reply(client.4547.0:89316 4.6 e49/17)", 2023-09-30T17:04:02.562 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.419910+0000", 2023-09-30T17:04:02.562 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.032659945000000003, 2023-09-30T17:04:02.562 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.033532111000000003, 2023-09-30T17:04:02.562 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.562 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:02.562 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.562 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.562 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.563 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.419910+0000", 2023-09-30T17:04:02.563 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.563 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.563 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.563 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.563 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.419910+0000", 2023-09-30T17:04:02.563 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.563 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.563 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.563 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.563 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.419911+0000", 2023-09-30T17:04:02.563 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3900000000000004e-07 2023-09-30T17:04:02.564 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.564 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.564 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.564 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.419915+0000", 2023-09-30T17:04:02.564 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9260000000000002e-06 2023-09-30T17:04:02.564 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.564 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.564 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.564 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.419925+0000", 2023-09-30T17:04:02.564 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0499000000000001e-05 2023-09-30T17:04:02.564 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.564 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.565 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.565 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.419933+0000", 2023-09-30T17:04:02.565 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2490000000000001e-06 2023-09-30T17:04:02.565 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.565 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.565 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.565 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.565 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.565 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:89135 4.37 e49/17 4:ecbf0fb2:::100000001f8.00000038:head v 49'4177, mlcod=49'4168)", 2023-09-30T17:04:02.565 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.379754+0000", 2023-09-30T17:04:02.565 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.072815964999999996, 2023-09-30T17:04:02.565 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.073716451000000002, 2023-09-30T17:04:02.566 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.566 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:02.566 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.566 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.566 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.566 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.379754+0000", 2023-09-30T17:04:02.566 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.566 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.566 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.566 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.566 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.379754+0000", 2023-09-30T17:04:02.567 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.567 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.567 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.567 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.567 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.379754+0000", 2023-09-30T17:04:02.567 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1e-07 2023-09-30T17:04:02.567 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.567 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.567 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.567 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.379769+0000", 2023-09-30T17:04:02.567 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4591e-05 2023-09-30T17:04:02.567 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.567 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.568 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.568 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.379775+0000", 2023-09-30T17:04:02.568 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9560000000000002e-06 2023-09-30T17:04:02.568 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.568 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.568 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.568 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.379783+0000", 2023-09-30T17:04:02.568 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9729999999999997e-06 2023-09-30T17:04:02.568 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.568 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.568 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:02.568 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.403833+0000", 2023-09-30T17:04:02.569 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024050703 2023-09-30T17:04:02.569 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.569 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.569 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:02.569 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.403854+0000", 2023-09-30T17:04:02.569 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.0822000000000002e-05 2023-09-30T17:04:02.569 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.569 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.569 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.569 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.569 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.570 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:89397 4.36 4.670445b6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:02.570 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.407316+0000", 2023-09-30T17:04:02.570 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.045253453999999999, 2023-09-30T17:04:02.570 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.046187407999999999, 2023-09-30T17:04:02.570 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.570 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:02.570 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:02.570 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:02.570 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.570 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 89397 2023-09-30T17:04:02.570 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.571 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.571 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.571 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.571 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.407316+0000", 2023-09-30T17:04:02.571 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.571 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.571 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.571 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.571 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.407316+0000", 2023-09-30T17:04:02.571 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.571 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.571 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.572 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.572 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.407317+0000", 2023-09-30T17:04:02.572 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0100000000000005e-07 2023-09-30T17:04:02.572 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.572 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.572 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.572 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.407356+0000", 2023-09-30T17:04:02.572 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8781e-05 2023-09-30T17:04:02.572 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.572 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.572 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.572 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.407365+0000", 2023-09-30T17:04:02.573 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.4469999999999995e-06 2023-09-30T17:04:02.573 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.573 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.573 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.573 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.407370+0000", 2023-09-30T17:04:02.573 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5519999999999998e-06 2023-09-30T17:04:02.573 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.573 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.573 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.573 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.573 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.573 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop_reply(client.4547.0:89318 4.36 e49/17)", 2023-09-30T17:04:02.574 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.419946+0000", 2023-09-30T17:04:02.574 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.032624218000000003, 2023-09-30T17:04:02.574 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.033587380999999999, 2023-09-30T17:04:02.574 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.574 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:02.574 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.574 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.574 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.574 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.419946+0000", 2023-09-30T17:04:02.574 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.574 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.575 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.575 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.575 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.419946+0000", 2023-09-30T17:04:02.575 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.575 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.575 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.575 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.575 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.419946+0000", 2023-09-30T17:04:02.575 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.5499999999999999e-07 2023-09-30T17:04:02.575 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.575 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.575 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.576 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.419948+0000", 2023-09-30T17:04:02.576 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2350000000000002e-06 2023-09-30T17:04:02.576 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.576 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.576 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.576 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.419955+0000", 2023-09-30T17:04:02.576 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5239999999999997e-06 2023-09-30T17:04:02.576 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.576 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.576 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.576 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.419959+0000", 2023-09-30T17:04:02.577 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7389999999999999e-06 2023-09-30T17:04:02.577 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.577 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.577 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.577 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.577 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.577 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:89279 4.36 4:6da220e6:::100000001f8.0000003f:head [write 2916352~4096 in=4096b,write 3145728~4096 in=4096b,write 3702784~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:02.577 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.367485+0000", 2023-09-30T17:04:02.577 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.085084760999999995, 2023-09-30T17:04:02.577 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.086078386000000007, 2023-09-30T17:04:02.577 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.577 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:02.578 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:02.578 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:02.578 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.578 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 89279 2023-09-30T17:04:02.578 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.578 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.578 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.578 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.578 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.367485+0000", 2023-09-30T17:04:02.578 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.578 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.578 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.579 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.579 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.367485+0000", 2023-09-30T17:04:02.579 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.579 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.579 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.579 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.579 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.367486+0000", 2023-09-30T17:04:02.579 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8100000000000003e-07 2023-09-30T17:04:02.579 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.579 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.579 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.579 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.367496+0000", 2023-09-30T17:04:02.580 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0288999999999999e-05 2023-09-30T17:04:02.580 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.580 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.580 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.580 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.367504+0000", 2023-09-30T17:04:02.580 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9389999999999997e-06 2023-09-30T17:04:02.580 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.580 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.580 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.580 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.367510+0000", 2023-09-30T17:04:02.580 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6840000000000001e-06 2023-09-30T17:04:02.580 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.581 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.581 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:02.581 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.394841+0000", 2023-09-30T17:04:02.581 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.027331263000000001 2023-09-30T17:04:02.581 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.581 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.581 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:02.581 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.394915+0000", 2023-09-30T17:04:02.581 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3731000000000003e-05 2023-09-30T17:04:02.581 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.581 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.581 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:02.582 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.395064+0000", 2023-09-30T17:04:02.582 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000149295 2023-09-30T17:04:02.582 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.582 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.582 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:02.582 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.412087+0000", 2023-09-30T17:04:02.582 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.017023334000000001 2023-09-30T17:04:02.582 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.582 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.582 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.582 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.583 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.583 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:89374 4.f e49/17)", 2023-09-30T17:04:02.583 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.419966+0000", 2023-09-30T17:04:02.583 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.032603561000000003, 2023-09-30T17:04:02.583 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.033639642999999997, 2023-09-30T17:04:02.583 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.583 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:02.583 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.583 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.583 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.583 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.419966+0000", 2023-09-30T17:04:02.583 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.584 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.584 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.584 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.584 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.419966+0000", 2023-09-30T17:04:02.584 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.584 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.584 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.584 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.584 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.419967+0000", 2023-09-30T17:04:02.584 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2000000000000001e-07 2023-09-30T17:04:02.584 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.584 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.584 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.585 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.419981+0000", 2023-09-30T17:04:02.585 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.451e-05 2023-09-30T17:04:02.585 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.585 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.585 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.585 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.419988+0000", 2023-09-30T17:04:02.585 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.844e-06 2023-09-30T17:04:02.585 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.585 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.585 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.585 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.419995+0000", 2023-09-30T17:04:02.585 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1389999999999998e-06 2023-09-30T17:04:02.586 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.586 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.586 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.586 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.586 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.586 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:89389 4.2f e49/17)", 2023-09-30T17:04:02.586 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.420003+0000", 2023-09-30T17:04:02.586 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.032566497999999999, 2023-09-30T17:04:02.586 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.033628680000000001, 2023-09-30T17:04:02.586 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.586 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:02.587 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.587 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.587 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.587 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.420003+0000", 2023-09-30T17:04:02.587 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.587 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.587 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.587 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.587 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.420003+0000", 2023-09-30T17:04:02.587 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.587 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.587 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.588 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.588 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.420004+0000", 2023-09-30T17:04:02.588 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.16e-07 2023-09-30T17:04:02.588 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.588 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.588 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.588 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.420015+0000", 2023-09-30T17:04:02.588 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1265e-05 2023-09-30T17:04:02.588 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.588 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.588 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.588 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.420022+0000", 2023-09-30T17:04:02.589 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8730000000000001e-06 2023-09-30T17:04:02.589 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.589 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.589 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.589 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.420028+0000", 2023-09-30T17:04:02.589 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2589999999999997e-06 2023-09-30T17:04:02.589 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.589 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.589 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.589 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.589 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.589 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:89302 4.f e49/17)", 2023-09-30T17:04:02.590 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.407707+0000", 2023-09-30T17:04:02.590 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.044863195000000002, 2023-09-30T17:04:02.590 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.045951672999999998, 2023-09-30T17:04:02.590 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.590 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:02.590 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.590 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.590 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.590 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.407707+0000", 2023-09-30T17:04:02.590 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.590 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.590 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.591 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.591 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.407707+0000", 2023-09-30T17:04:02.591 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.591 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.591 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.591 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.591 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.407707+0000", 2023-09-30T17:04:02.591 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7800000000000002e-07 2023-09-30T17:04:02.591 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.591 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.591 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.591 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.407727+0000", 2023-09-30T17:04:02.592 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.959e-05 2023-09-30T17:04:02.592 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.592 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.592 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.592 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.407738+0000", 2023-09-30T17:04:02.592 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1348e-05 2023-09-30T17:04:02.592 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.592 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.592 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.592 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.407745+0000", 2023-09-30T17:04:02.592 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.657e-06 2023-09-30T17:04:02.592 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.593 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.593 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.593 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.593 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.593 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:89430 4.13 4.6028f753 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:02.593 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.420640+0000", 2023-09-30T17:04:02.593 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.031929974999999999, 2023-09-30T17:04:02.593 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.033051245999999999, 2023-09-30T17:04:02.593 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.593 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:02.593 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:02.593 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:02.594 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.594 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 89430 2023-09-30T17:04:02.594 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.594 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.594 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.594 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.594 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.420640+0000", 2023-09-30T17:04:02.594 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.594 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.594 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.594 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.595 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.420640+0000", 2023-09-30T17:04:02.595 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.595 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.595 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.595 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.595 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.420641+0000", 2023-09-30T17:04:02.595 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.257e-06 2023-09-30T17:04:02.595 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.595 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.595 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.595 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.420655+0000", 2023-09-30T17:04:02.595 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4222e-05 2023-09-30T17:04:02.596 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.596 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.596 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.596 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.420666+0000", 2023-09-30T17:04:02.596 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0441e-05 2023-09-30T17:04:02.596 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.596 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.596 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.596 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.420673+0000", 2023-09-30T17:04:02.597 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0670000000000003e-06 2023-09-30T17:04:02.597 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.597 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.597 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.597 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.597 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.597 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:89373 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:02.597 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.400307+0000", 2023-09-30T17:04:02.597 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.052263203000000001, 2023-09-30T17:04:02.597 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.053414682999999998, 2023-09-30T17:04:02.597 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.597 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:02.598 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:02.598 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:02.598 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.598 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 89373 2023-09-30T17:04:02.598 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.598 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.598 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.598 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.598 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.400307+0000", 2023-09-30T17:04:02.598 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.598 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.599 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.599 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.599 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.400307+0000", 2023-09-30T17:04:02.599 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.599 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.599 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.599 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.599 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.400307+0000", 2023-09-30T17:04:02.599 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1199999999999998e-07 2023-09-30T17:04:02.599 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.599 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.599 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.600 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.400316+0000", 2023-09-30T17:04:02.600 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9129999999999992e-06 2023-09-30T17:04:02.600 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.600 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.600 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.600 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.400322+0000", 2023-09-30T17:04:02.600 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9279999999999998e-06 2023-09-30T17:04:02.600 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.600 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.600 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.600 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.400327+0000", 2023-09-30T17:04:02.600 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.792e-06 2023-09-30T17:04:02.601 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.601 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.601 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.601 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.601 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.601 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:89307 4.37 e49/17)", 2023-09-30T17:04:02.601 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.407757+0000", 2023-09-30T17:04:02.601 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.044812510999999999, 2023-09-30T17:04:02.601 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.045992788, 2023-09-30T17:04:02.601 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.601 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:02.601 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.602 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.602 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.602 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.407757+0000", 2023-09-30T17:04:02.602 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.602 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.602 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.602 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.602 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.407757+0000", 2023-09-30T17:04:02.602 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.602 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.602 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.602 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.603 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.407758+0000", 2023-09-30T17:04:02.603 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8099999999999998e-07 2023-09-30T17:04:02.603 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.603 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.603 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.603 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.407771+0000", 2023-09-30T17:04:02.603 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2765000000000001e-05 2023-09-30T17:04:02.603 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.603 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.603 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.603 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.407781+0000", 2023-09-30T17:04:02.603 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0084999999999999e-05 2023-09-30T17:04:02.604 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.604 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.604 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.604 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.407786+0000", 2023-09-30T17:04:02.604 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8440000000000003e-06 2023-09-30T17:04:02.604 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.604 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.604 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.604 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.604 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.604 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:89433 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:02.604 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.420686+0000", 2023-09-30T17:04:02.605 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.031883764000000002, 2023-09-30T17:04:02.605 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.033091082000000001, 2023-09-30T17:04:02.605 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.605 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:02.605 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:02.605 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:02.605 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.605 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 89433 2023-09-30T17:04:02.605 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.605 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.605 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.605 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.606 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.420686+0000", 2023-09-30T17:04:02.606 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.606 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.606 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.606 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.606 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.420686+0000", 2023-09-30T17:04:02.606 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.606 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.606 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.606 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.606 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.420687+0000", 2023-09-30T17:04:02.607 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7700000000000005e-07 2023-09-30T17:04:02.607 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.607 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.607 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.607 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.420698+0000", 2023-09-30T17:04:02.607 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1622e-05 2023-09-30T17:04:02.607 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.607 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.607 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.607 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.420705+0000", 2023-09-30T17:04:02.607 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8519999999999998e-06 2023-09-30T17:04:02.608 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.608 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.608 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.608 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.420711+0000", 2023-09-30T17:04:02.608 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4480000000000002e-06 2023-09-30T17:04:02.608 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.608 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.608 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.608 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.608 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.608 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:89170 4.f e49/17 4:f2a80dfe:::100000001f8.00000019:head v 49'4261, mlcod=49'4251)", 2023-09-30T17:04:02.608 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.379850+0000", 2023-09-30T17:04:02.609 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.072719899000000005, 2023-09-30T17:04:02.609 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.073958449999999995, 2023-09-30T17:04:02.609 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.609 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:02.609 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.609 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.609 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.609 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.379850+0000", 2023-09-30T17:04:02.609 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.609 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.609 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.610 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.610 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.379850+0000", 2023-09-30T17:04:02.610 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.610 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.610 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.610 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.610 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.379850+0000", 2023-09-30T17:04:02.610 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2399999999999999e-07 2023-09-30T17:04:02.610 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.610 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.610 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.610 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.379861+0000", 2023-09-30T17:04:02.611 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1026000000000001e-05 2023-09-30T17:04:02.611 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.611 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.611 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.611 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.379867+0000", 2023-09-30T17:04:02.611 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.84e-06 2023-09-30T17:04:02.611 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.611 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.611 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.611 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.379871+0000", 2023-09-30T17:04:02.611 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3250000000000001e-06 2023-09-30T17:04:02.612 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.612 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.612 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:02.612 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.404290+0000", 2023-09-30T17:04:02.612 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024418386 2023-09-30T17:04:02.612 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.612 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.612 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:02.612 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.404307+0000", 2023-09-30T17:04:02.612 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7496e-05 2023-09-30T17:04:02.613 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.613 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.613 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.613 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.613 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.613 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:89399 4.d 4:b1164065:::100000001f8.00000035:head [write 2129920~4096 in=4096b,write 2142208~4096 in=4096b,write 2158592~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:02.613 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.407860+0000", 2023-09-30T17:04:02.613 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.044710267999999997, 2023-09-30T17:04:02.613 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.045985536, 2023-09-30T17:04:02.613 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.613 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:02.614 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:02.614 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:02.614 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.614 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 89399 2023-09-30T17:04:02.614 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.614 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.614 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.614 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.614 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.407860+0000", 2023-09-30T17:04:02.614 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.614 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.614 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.615 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.615 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.407860+0000", 2023-09-30T17:04:02.615 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.615 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.615 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.615 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.615 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.407860+0000", 2023-09-30T17:04:02.615 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9999999999999998e-07 2023-09-30T17:04:02.615 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.615 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.615 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.615 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.407945+0000", 2023-09-30T17:04:02.616 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4857000000000004e-05 2023-09-30T17:04:02.616 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.616 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.616 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.616 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.407956+0000", 2023-09-30T17:04:02.616 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0879999999999999e-05 2023-09-30T17:04:02.616 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.616 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.616 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.616 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.407963+0000", 2023-09-30T17:04:02.616 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9700000000000002e-06 2023-09-30T17:04:02.617 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.617 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.617 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:02.617 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.411930+0000", 2023-09-30T17:04:02.617 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.003967 2023-09-30T17:04:02.617 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.617 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.617 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:02.617 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.412015+0000", 2023-09-30T17:04:02.617 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4942000000000001e-05 2023-09-30T17:04:02.617 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.618 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.618 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.618 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.618 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.618 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:89434 4.8 4:11ee3b64:::100000001f8.0000003e:head [write 2138112~4096 in=4096b,write 2158592~4096 in=4096b,write 2691072~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:02.618 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.420719+0000", 2023-09-30T17:04:02.618 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.031851182999999998, 2023-09-30T17:04:02.618 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.033165923, 2023-09-30T17:04:02.618 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.618 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:02.618 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:02.619 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:02.619 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.619 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 89434 2023-09-30T17:04:02.619 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.619 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.619 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.619 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.619 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.420719+0000", 2023-09-30T17:04:02.619 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.619 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.619 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.619 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.620 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.420719+0000", 2023-09-30T17:04:02.620 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.620 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.620 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.620 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.620 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.420719+0000", 2023-09-30T17:04:02.620 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4499999999999997e-07 2023-09-30T17:04:02.620 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.620 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.620 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.621 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.420729+0000", 2023-09-30T17:04:02.621 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.6849999999999996e-06 2023-09-30T17:04:02.621 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.621 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.621 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.621 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.420736+0000", 2023-09-30T17:04:02.621 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.674e-06 2023-09-30T17:04:02.621 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.621 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.621 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.621 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.420740+0000", 2023-09-30T17:04:02.621 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.882e-06 2023-09-30T17:04:02.622 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.622 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.622 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:02.622 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.420987+0000", 2023-09-30T17:04:02.622 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00024643799999999997 2023-09-30T17:04:02.622 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.622 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.622 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:02.622 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.421071+0000", 2023-09-30T17:04:02.622 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4431999999999994e-05 2023-09-30T17:04:02.622 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.622 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.623 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.623 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.623 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.623 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:89062 4.3f 4.a34187bf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:02.623 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.294377+0000", 2023-09-30T17:04:02.623 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.158193045, 2023-09-30T17:04:02.623 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.15954416900000001, 2023-09-30T17:04:02.623 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.623 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:02.623 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:02.623 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:02.624 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.624 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 89062 2023-09-30T17:04:02.624 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.624 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.624 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.624 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.624 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.294377+0000", 2023-09-30T17:04:02.624 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.624 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.624 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.624 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.624 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.294377+0000", 2023-09-30T17:04:02.624 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.625 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.625 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.625 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.625 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.294378+0000", 2023-09-30T17:04:02.625 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1999999999999998e-07 2023-09-30T17:04:02.625 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.625 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.625 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.625 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.294394+0000", 2023-09-30T17:04:02.625 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6235e-05 2023-09-30T17:04:02.626 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.626 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.626 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.626 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.294403+0000", 2023-09-30T17:04:02.626 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.4949999999999997e-06 2023-09-30T17:04:02.626 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.626 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.626 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.626 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.294409+0000", 2023-09-30T17:04:02.626 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4469999999999997e-06 2023-09-30T17:04:02.626 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.626 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.627 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.627 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.627 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.627 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:89223 4.3f 4.a34187bf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:02.627 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.350317+0000", 2023-09-30T17:04:02.627 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.10225327300000001, 2023-09-30T17:04:02.627 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.10363462900000001, 2023-09-30T17:04:02.627 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.627 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:02.627 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:02.627 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:02.627 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.628 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 89223 2023-09-30T17:04:02.628 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.628 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.628 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.628 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.628 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.350317+0000", 2023-09-30T17:04:02.628 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.628 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.628 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.628 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.628 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.350317+0000", 2023-09-30T17:04:02.628 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.629 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.629 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.629 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.629 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.350317+0000", 2023-09-30T17:04:02.629 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.61e-07 2023-09-30T17:04:02.629 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.629 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.629 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.629 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.350326+0000", 2023-09-30T17:04:02.629 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.0480000000000004e-06 2023-09-30T17:04:02.629 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.629 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.630 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.630 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.350338+0000", 2023-09-30T17:04:02.630 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1484000000000001e-05 2023-09-30T17:04:02.630 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.630 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.630 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.630 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.350342+0000", 2023-09-30T17:04:02.630 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.07e-06 2023-09-30T17:04:02.630 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.630 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.630 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.631 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.631 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.631 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:89163 4.37 e49/17 4:ef395e89:::100000001f8.00000020:head v 49'4178, mlcod=49'4168)", 2023-09-30T17:04:02.631 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.379878+0000", 2023-09-30T17:04:02.631 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.072691978000000004, 2023-09-30T17:04:02.631 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.074103993000000007, 2023-09-30T17:04:02.631 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.631 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:02.631 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.631 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.631 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.631 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.379878+0000", 2023-09-30T17:04:02.631 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.632 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.632 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.632 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.632 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.379878+0000", 2023-09-30T17:04:02.632 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.632 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.632 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.632 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.632 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.379878+0000", 2023-09-30T17:04:02.632 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.22e-07 2023-09-30T17:04:02.632 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.632 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.633 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.633 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.379888+0000", 2023-09-30T17:04:02.633 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0305999999999999e-05 2023-09-30T17:04:02.633 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.633 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.633 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.633 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.379894+0000", 2023-09-30T17:04:02.633 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.339e-06 2023-09-30T17:04:02.633 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.633 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.633 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.633 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.379898+0000", 2023-09-30T17:04:02.634 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9620000000000004e-06 2023-09-30T17:04:02.634 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.634 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.634 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:02.634 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.408874+0000", 2023-09-30T17:04:02.634 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.028976357000000001 2023-09-30T17:04:02.634 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.634 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.634 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:02.634 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.408895+0000", 2023-09-30T17:04:02.634 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1124e-05 2023-09-30T17:04:02.634 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.635 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.635 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.635 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.635 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.635 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:89316 4.6 4:616d4c41:::100000001f8.00000034:head [write 65536~4096 in=4096b,write 98304~4096 in=4096b,write 143360~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:02.635 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.380503+0000", 2023-09-30T17:04:02.635 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.072066964999999997, 2023-09-30T17:04:02.635 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.073515570000000002, 2023-09-30T17:04:02.635 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.635 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:02.635 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:02.635 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:02.636 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.636 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 89316 2023-09-30T17:04:02.636 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.636 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.636 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.636 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.636 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.380503+0000", 2023-09-30T17:04:02.636 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.636 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.636 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.636 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.636 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.380503+0000", 2023-09-30T17:04:02.637 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.637 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.637 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.637 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.637 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.380504+0000", 2023-09-30T17:04:02.637 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1699999999999997e-07 2023-09-30T17:04:02.637 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.637 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.637 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.637 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.380515+0000", 2023-09-30T17:04:02.637 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.172e-05 2023-09-30T17:04:02.637 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.637 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.638 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.638 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.380530+0000", 2023-09-30T17:04:02.638 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4104000000000001e-05 2023-09-30T17:04:02.638 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.638 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.638 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.638 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.380537+0000", 2023-09-30T17:04:02.638 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6149999999999999e-06 2023-09-30T17:04:02.638 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.638 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.638 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:02.638 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.412182+0000", 2023-09-30T17:04:02.639 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.031644499999999999 2023-09-30T17:04:02.639 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.639 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.639 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:02.639 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.412258+0000", 2023-09-30T17:04:02.639 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6686000000000004e-05 2023-09-30T17:04:02.639 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.639 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.639 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:02.639 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.412399+0000", 2023-09-30T17:04:02.639 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014075399999999999 2023-09-30T17:04:02.639 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.639 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.640 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.640 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.640 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.640 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:89186 4.f e49/17 4:f0d983b2:::100000001f8.0000001f:head v 49'4264, mlcod=49'4254)", 2023-09-30T17:04:02.640 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.391241+0000", 2023-09-30T17:04:02.640 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.061328729999999998, 2023-09-30T17:04:02.640 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.062818214999999997, 2023-09-30T17:04:02.640 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.640 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:02.640 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.640 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.640 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.641 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.391241+0000", 2023-09-30T17:04:02.641 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.641 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.641 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.641 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.641 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.391241+0000", 2023-09-30T17:04:02.641 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.641 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.641 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.641 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.641 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.391241+0000", 2023-09-30T17:04:02.641 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.8000000000000002e-07 2023-09-30T17:04:02.642 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.642 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.642 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.642 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.391262+0000", 2023-09-30T17:04:02.642 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.0049999999999999e-05 2023-09-30T17:04:02.642 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.642 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.642 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.642 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.391268+0000", 2023-09-30T17:04:02.642 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8709999999999999e-06 2023-09-30T17:04:02.642 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.642 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.643 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.643 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.391274+0000", 2023-09-30T17:04:02.643 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0190000000000003e-06 2023-09-30T17:04:02.643 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.643 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.643 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:02.643 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.418469+0000", 2023-09-30T17:04:02.643 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.027195006000000001 2023-09-30T17:04:02.643 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.643 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.643 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:02.644 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.418490+0000", 2023-09-30T17:04:02.644 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.0296999999999999e-05 2023-09-30T17:04:02.644 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.644 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.644 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.644 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.644 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.644 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:89264 4.f e49/17)", 2023-09-30T17:04:02.644 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.401452+0000", 2023-09-30T17:04:02.644 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.051118416999999999, 2023-09-30T17:04:02.644 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.052640199999999998, 2023-09-30T17:04:02.644 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.645 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:02.645 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.645 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.645 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.645 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.401452+0000", 2023-09-30T17:04:02.645 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.645 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.645 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.645 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.645 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.401452+0000", 2023-09-30T17:04:02.645 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.645 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.646 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.646 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.646 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.401452+0000", 2023-09-30T17:04:02.646 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4700000000000002e-07 2023-09-30T17:04:02.646 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.646 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.646 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.646 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.401469+0000", 2023-09-30T17:04:02.646 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7019000000000001e-05 2023-09-30T17:04:02.646 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.646 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.646 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.647 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.401479+0000", 2023-09-30T17:04:02.647 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0349e-05 2023-09-30T17:04:02.647 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.647 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.647 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.647 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.401485+0000", 2023-09-30T17:04:02.647 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9059999999999999e-06 2023-09-30T17:04:02.647 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.647 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.647 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.647 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.647 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.648 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:89403 4.d 4:b1164065:::100000001f8.00000035:head [write 3256320~4096 in=4096b,write 3342336~4096 in=4096b,write 3481600~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:02.648 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.409114+0000", 2023-09-30T17:04:02.648 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.043455546999999997, 2023-09-30T17:04:02.648 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.04500763, 2023-09-30T17:04:02.648 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.648 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:02.648 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:02.648 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:02.648 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.648 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 89403 2023-09-30T17:04:02.648 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.648 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.649 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.649 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.649 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.409114+0000", 2023-09-30T17:04:02.649 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.649 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.649 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.649 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.649 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.409114+0000", 2023-09-30T17:04:02.649 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.649 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.649 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.649 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.649 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.409115+0000", 2023-09-30T17:04:02.650 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2200000000000003e-07 2023-09-30T17:04:02.650 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.650 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.650 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.650 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.409130+0000", 2023-09-30T17:04:02.650 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4717e-05 2023-09-30T17:04:02.650 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.650 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.650 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.650 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.409139+0000", 2023-09-30T17:04:02.650 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2289999999999992e-06 2023-09-30T17:04:02.650 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.651 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.651 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.651 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.409146+0000", 2023-09-30T17:04:02.651 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0890000000000002e-06 2023-09-30T17:04:02.651 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.651 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.651 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:02.651 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.418935+0000", 2023-09-30T17:04:02.651 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0097890679999999997 2023-09-30T17:04:02.651 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.651 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.651 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:02.651 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.420365+0000", 2023-09-30T17:04:02.652 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0014301839999999999 2023-09-30T17:04:02.652 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.652 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.652 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.652 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.652 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.652 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:89318 4.36 4:6fa85f86:::100000001f8.00000013:head [write 1347584~4096 in=4096b,write 1384448~4096 in=4096b,write 1404928~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:02.652 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.383096+0000", 2023-09-30T17:04:02.652 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.069474394999999994, 2023-09-30T17:04:02.652 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.071071649000000001, 2023-09-30T17:04:02.652 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.653 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:02.653 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:02.653 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:02.653 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.653 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 89318 2023-09-30T17:04:02.653 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.653 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.653 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.653 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.653 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.383096+0000", 2023-09-30T17:04:02.653 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.654 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.654 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.654 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.654 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.383096+0000", 2023-09-30T17:04:02.654 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.654 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.654 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.654 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.654 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.383097+0000", 2023-09-30T17:04:02.654 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0950000000000001e-06 2023-09-30T17:04:02.654 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.654 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.655 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.655 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.383109+0000", 2023-09-30T17:04:02.655 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2716e-05 2023-09-30T17:04:02.655 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.655 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.655 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.655 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.383119+0000", 2023-09-30T17:04:02.655 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.9080000000000007e-06 2023-09-30T17:04:02.655 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.655 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.655 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.655 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.383127+0000", 2023-09-30T17:04:02.656 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7640000000000005e-06 2023-09-30T17:04:02.656 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.656 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.656 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:02.656 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.414251+0000", 2023-09-30T17:04:02.656 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.031123795999999999 2023-09-30T17:04:02.656 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.656 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.656 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:02.656 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.414335+0000", 2023-09-30T17:04:02.656 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4662999999999999e-05 2023-09-30T17:04:02.657 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.657 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.657 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:02.657 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.414489+0000", 2023-09-30T17:04:02.657 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015328600000000001 2023-09-30T17:04:02.657 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.657 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.657 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.657 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.657 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.657 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:89406 4.27 4.df99e167 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:02.657 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.410092+0000", 2023-09-30T17:04:02.658 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.04247832, 2023-09-30T17:04:02.658 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.044116219999999998, 2023-09-30T17:04:02.658 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.658 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:02.658 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:02.658 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:02.658 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.658 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 89406 2023-09-30T17:04:02.658 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.658 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.658 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.659 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.659 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.410092+0000", 2023-09-30T17:04:02.659 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.659 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.659 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.659 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.659 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.410092+0000", 2023-09-30T17:04:02.659 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.659 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.659 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.659 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.660 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.410092+0000", 2023-09-30T17:04:02.660 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2600000000000001e-07 2023-09-30T17:04:02.660 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.660 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.660 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.660 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.410105+0000", 2023-09-30T17:04:02.660 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2122e-05 2023-09-30T17:04:02.660 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.660 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.660 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.660 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.410115+0000", 2023-09-30T17:04:02.660 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0491e-05 2023-09-30T17:04:02.661 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.661 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.661 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.661 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.410122+0000", 2023-09-30T17:04:02.661 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3270000000000003e-06 2023-09-30T17:04:02.661 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.661 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.661 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.661 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.661 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.661 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:89320 4.36 4:6da220e6:::100000001f8.0000003f:head [write 978944~4096 in=4096b,write 1003520~4096 in=4096b,write 1019904~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:02.662 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.383140+0000", 2023-09-30T17:04:02.662 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.069430367000000007, 2023-09-30T17:04:02.662 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.071101933000000006, 2023-09-30T17:04:02.662 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.662 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:02.662 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:02.662 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:02.662 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.662 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 89320 2023-09-30T17:04:02.662 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.662 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.662 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.663 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.663 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.383140+0000", 2023-09-30T17:04:02.663 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.663 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.663 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.663 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.663 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.383140+0000", 2023-09-30T17:04:02.663 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.663 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.663 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.663 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.664 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.383140+0000", 2023-09-30T17:04:02.664 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2099999999999997e-07 2023-09-30T17:04:02.664 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.664 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.664 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.664 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.383152+0000", 2023-09-30T17:04:02.664 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1691e-05 2023-09-30T17:04:02.664 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.664 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.664 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.664 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.383165+0000", 2023-09-30T17:04:02.664 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3354e-05 2023-09-30T17:04:02.664 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.665 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.665 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.665 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.383171+0000", 2023-09-30T17:04:02.665 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7359999999999998e-06 2023-09-30T17:04:02.665 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.665 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.665 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:02.665 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.419462+0000", 2023-09-30T17:04:02.665 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.036291060999999999 2023-09-30T17:04:02.665 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.665 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.666 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:02.666 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.419537+0000", 2023-09-30T17:04:02.666 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5158000000000001e-05 2023-09-30T17:04:02.666 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.666 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.666 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:02.666 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.419682+0000", 2023-09-30T17:04:02.666 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014513800000000001 2023-09-30T17:04:02.666 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.666 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.666 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.666 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.666 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.667 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:89293 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 389120~4096 in=4096b,write 466944~4096 in=4096b,write 557056~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:02.667 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.371800+0000", 2023-09-30T17:04:02.667 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.080770218000000005, 2023-09-30T17:04:02.667 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.082487275999999998, 2023-09-30T17:04:02.667 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.667 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:02.667 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:02.667 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:02.667 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.667 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 89293 2023-09-30T17:04:02.667 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.667 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.667 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.668 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.668 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.371800+0000", 2023-09-30T17:04:02.668 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.668 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.668 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.668 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.668 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.371800+0000", 2023-09-30T17:04:02.668 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.668 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.668 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.668 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.668 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.371800+0000", 2023-09-30T17:04:02.669 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.58e-07 2023-09-30T17:04:02.669 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.669 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.669 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.669 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.371811+0000", 2023-09-30T17:04:02.669 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0825000000000001e-05 2023-09-30T17:04:02.669 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.669 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.669 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.669 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.371818+0000", 2023-09-30T17:04:02.669 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0319999999999998e-06 2023-09-30T17:04:02.670 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.670 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.670 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.670 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.371824+0000", 2023-09-30T17:04:02.670 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8479999999999997e-06 2023-09-30T17:04:02.670 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.670 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.670 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:02.670 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.394830+0000", 2023-09-30T17:04:02.670 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023006061000000001 2023-09-30T17:04:02.670 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.670 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.670 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:02.671 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.394900+0000", 2023-09-30T17:04:02.671 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0341999999999998e-05 2023-09-30T17:04:02.671 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.671 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.671 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:02.671 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.394990+0000", 2023-09-30T17:04:02.671 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9306000000000002e-05 2023-09-30T17:04:02.671 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.671 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.671 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:02.671 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.411717+0000", 2023-09-30T17:04:02.671 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.016727903999999998 2023-09-30T17:04:02.672 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.672 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.672 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.672 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.672 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.672 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:89346 4.27 4.df99e167 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:02.672 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.392201+0000", 2023-09-30T17:04:02.672 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.060368527999999998, 2023-09-30T17:04:02.672 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.062129317000000003, 2023-09-30T17:04:02.672 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.672 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:02.672 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:02.673 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:02.673 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.673 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 89346 2023-09-30T17:04:02.673 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.673 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.673 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.673 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.673 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.392201+0000", 2023-09-30T17:04:02.673 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.673 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.673 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.673 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.674 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.392201+0000", 2023-09-30T17:04:02.674 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.674 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.674 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.674 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.674 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.392202+0000", 2023-09-30T17:04:02.674 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8699999999999995e-07 2023-09-30T17:04:02.674 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.674 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.674 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.674 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.392211+0000", 2023-09-30T17:04:02.675 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3070000000000008e-06 2023-09-30T17:04:02.675 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.675 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.675 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.675 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.392218+0000", 2023-09-30T17:04:02.675 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1380000000000001e-06 2023-09-30T17:04:02.675 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.675 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.675 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.675 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.392224+0000", 2023-09-30T17:04:02.675 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.468e-06 2023-09-30T17:04:02.675 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.675 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.676 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.676 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.676 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.676 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:89380 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:02.676 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.402119+0000", 2023-09-30T17:04:02.676 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.050450979999999999, 2023-09-30T17:04:02.676 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.052241897000000002, 2023-09-30T17:04:02.676 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.676 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:02.676 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:02.676 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:02.676 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.677 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 89380 2023-09-30T17:04:02.677 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.677 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.677 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.677 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.677 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.402119+0000", 2023-09-30T17:04:02.677 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.677 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.677 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.677 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.677 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.402119+0000", 2023-09-30T17:04:02.677 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.678 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.678 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.678 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.678 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.402120+0000", 2023-09-30T17:04:02.678 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1200000000000002e-07 2023-09-30T17:04:02.678 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.678 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.678 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.678 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.402133+0000", 2023-09-30T17:04:02.678 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3454e-05 2023-09-30T17:04:02.678 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.678 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.679 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.679 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.402149+0000", 2023-09-30T17:04:02.679 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5658000000000002e-05 2023-09-30T17:04:02.679 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.679 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.679 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.679 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.402161+0000", 2023-09-30T17:04:02.679 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.181e-05 2023-09-30T17:04:02.679 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.679 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.679 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.680 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.680 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.680 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:89324 4.2f e49/17)", 2023-09-30T17:04:02.680 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.411037+0000", 2023-09-30T17:04:02.680 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.041533283999999997, 2023-09-30T17:04:02.680 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.043353496999999998, 2023-09-30T17:04:02.680 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.680 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:02.680 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.680 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.680 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.680 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.411037+0000", 2023-09-30T17:04:02.681 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.681 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.681 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.681 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.681 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.411037+0000", 2023-09-30T17:04:02.681 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.681 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.681 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.681 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.681 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.411037+0000", 2023-09-30T17:04:02.681 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.7599999999999998e-07 2023-09-30T17:04:02.681 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.681 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.682 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.682 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.411050+0000", 2023-09-30T17:04:02.682 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3524e-05 2023-09-30T17:04:02.682 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.682 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.682 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.682 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.411070+0000", 2023-09-30T17:04:02.682 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9177999999999998e-05 2023-09-30T17:04:02.682 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.682 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.682 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.683 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.411078+0000", 2023-09-30T17:04:02.683 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.7120000000000006e-06 2023-09-30T17:04:02.683 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.683 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.683 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.683 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.683 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.683 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:89191 4.2f e49/17 4:f59f865b:::100000001f8.00000007:head v 49'1337, mlcod=49'1333)", 2023-09-30T17:04:02.683 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.392833+0000", 2023-09-30T17:04:02.683 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.059737411999999997, 2023-09-30T17:04:02.683 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.061585419000000002, 2023-09-30T17:04:02.683 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.684 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:02.684 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.684 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.684 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.684 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.392833+0000", 2023-09-30T17:04:02.684 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.684 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.684 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.684 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.684 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.392833+0000", 2023-09-30T17:04:02.684 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.684 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.684 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.685 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.685 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.392833+0000", 2023-09-30T17:04:02.685 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4199999999999995e-07 2023-09-30T17:04:02.685 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.685 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.685 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.685 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.392846+0000", 2023-09-30T17:04:02.685 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3144e-05 2023-09-30T17:04:02.685 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.685 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.685 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.685 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.392855+0000", 2023-09-30T17:04:02.685 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.6030000000000005e-06 2023-09-30T17:04:02.686 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.686 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.686 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.686 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.392861+0000", 2023-09-30T17:04:02.686 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.37e-06 2023-09-30T17:04:02.686 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.686 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.686 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:02.686 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.417304+0000", 2023-09-30T17:04:02.686 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024442317000000002 2023-09-30T17:04:02.686 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.686 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.687 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:02.687 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.417325+0000", 2023-09-30T17:04:02.687 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1886999999999999e-05 2023-09-30T17:04:02.687 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.687 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.687 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.687 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.687 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.687 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:89188 4.f e49/17 4:f2a80dfe:::100000001f8.00000019:head v 49'4265, mlcod=49'4254)", 2023-09-30T17:04:02.687 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.392878+0000", 2023-09-30T17:04:02.687 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.059691566000000001, 2023-09-30T17:04:02.687 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.061573231999999999, 2023-09-30T17:04:02.687 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.688 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:02.688 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.688 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.688 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.688 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.392878+0000", 2023-09-30T17:04:02.688 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.688 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.688 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.688 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.688 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.392878+0000", 2023-09-30T17:04:02.688 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.688 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.689 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.689 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.689 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.392879+0000", 2023-09-30T17:04:02.689 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.2500000000000001e-07 2023-09-30T17:04:02.689 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.689 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.689 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.689 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.392891+0000", 2023-09-30T17:04:02.689 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2238999999999999e-05 2023-09-30T17:04:02.689 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.689 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.689 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.689 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.392900+0000", 2023-09-30T17:04:02.690 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.6659999999999997e-06 2023-09-30T17:04:02.690 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.690 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.690 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.690 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.392905+0000", 2023-09-30T17:04:02.690 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4530000000000001e-06 2023-09-30T17:04:02.690 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.690 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.690 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:02.690 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.421058+0000", 2023-09-30T17:04:02.690 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.028152902 2023-09-30T17:04:02.690 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.691 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.691 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:02.691 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.421077+0000", 2023-09-30T17:04:02.691 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9368000000000002e-05 2023-09-30T17:04:02.691 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.691 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.691 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.691 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.691 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.691 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:89348 4.f e49/17)", 2023-09-30T17:04:02.691 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.412005+0000", 2023-09-30T17:04:02.691 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.040565226000000003, 2023-09-30T17:04:02.692 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.042478914, 2023-09-30T17:04:02.692 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.692 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:02.692 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.692 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.692 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.692 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.412005+0000", 2023-09-30T17:04:02.692 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.692 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.692 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.692 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.693 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.412005+0000", 2023-09-30T17:04:02.693 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.693 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.693 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.693 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.693 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.412005+0000", 2023-09-30T17:04:02.693 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1600000000000001e-07 2023-09-30T17:04:02.693 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.693 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.693 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.693 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.412018+0000", 2023-09-30T17:04:02.693 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3196e-05 2023-09-30T17:04:02.694 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.694 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.694 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.694 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.412030+0000", 2023-09-30T17:04:02.694 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1131000000000001e-05 2023-09-30T17:04:02.694 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.694 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.694 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.694 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.412036+0000", 2023-09-30T17:04:02.694 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.426e-06 2023-09-30T17:04:02.694 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.694 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.695 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.695 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.695 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.695 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:89172 4.37 e49/17 4:ef395e89:::100000001f8.00000020:head v 49'4179, mlcod=49'4170)", 2023-09-30T17:04:02.695 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.383345+0000", 2023-09-30T17:04:02.695 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.069224636000000006, 2023-09-30T17:04:02.695 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.071165897000000006, 2023-09-30T17:04:02.695 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.695 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:02.695 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.695 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.695 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.695 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.383345+0000", 2023-09-30T17:04:02.696 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.696 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.696 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.696 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.696 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.383345+0000", 2023-09-30T17:04:02.696 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.696 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.696 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.696 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.696 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.383345+0000", 2023-09-30T17:04:02.696 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.0699999999999999e-07 2023-09-30T17:04:02.696 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.696 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.697 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.697 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.383359+0000", 2023-09-30T17:04:02.697 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3232e-05 2023-09-30T17:04:02.697 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.697 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.697 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.697 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.383368+0000", 2023-09-30T17:04:02.697 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.7819999999999999e-06 2023-09-30T17:04:02.697 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.697 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.697 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.697 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.383372+0000", 2023-09-30T17:04:02.698 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1790000000000001e-06 2023-09-30T17:04:02.698 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.698 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.698 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:02.698 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.411827+0000", 2023-09-30T17:04:02.698 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.028454991999999998 2023-09-30T17:04:02.698 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.698 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.698 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:02.698 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.411846+0000", 2023-09-30T17:04:02.698 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9164000000000002e-05 2023-09-30T17:04:02.698 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.699 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.699 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.699 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.699 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.699 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:89351 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:02.699 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.392982+0000", 2023-09-30T17:04:02.699 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.059588217999999998, 2023-09-30T17:04:02.699 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.061562736, 2023-09-30T17:04:02.699 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.699 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:02.699 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:02.699 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:02.699 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.700 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 89351 2023-09-30T17:04:02.700 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.700 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.700 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.700 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.700 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.392982+0000", 2023-09-30T17:04:02.700 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.700 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.700 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.700 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.700 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.392982+0000", 2023-09-30T17:04:02.700 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.700 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.701 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.701 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.701 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.392982+0000", 2023-09-30T17:04:02.701 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6499999999999998e-07 2023-09-30T17:04:02.701 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.701 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.701 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.701 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.393023+0000", 2023-09-30T17:04:02.701 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0073000000000001e-05 2023-09-30T17:04:02.701 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.701 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.701 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.702 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.393032+0000", 2023-09-30T17:04:02.702 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2099999999999999e-06 2023-09-30T17:04:02.702 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.702 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.702 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.702 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.393039+0000", 2023-09-30T17:04:02.702 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7619999999999998e-06 2023-09-30T17:04:02.702 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.702 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.702 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.702 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.703 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.703 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:89383 4.36 4.670445b6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:02.703 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.402924+0000", 2023-09-30T17:04:02.703 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.049645715999999999, 2023-09-30T17:04:02.703 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.051650493999999998, 2023-09-30T17:04:02.703 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.703 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:02.703 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:02.703 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:02.703 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.703 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 89383 2023-09-30T17:04:02.703 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.704 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.704 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.704 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.704 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.402924+0000", 2023-09-30T17:04:02.704 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.704 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.704 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.704 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.704 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.402924+0000", 2023-09-30T17:04:02.704 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.704 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.704 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.705 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.705 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.402925+0000", 2023-09-30T17:04:02.705 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7899999999999997e-07 2023-09-30T17:04:02.705 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.705 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.705 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.705 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.402935+0000", 2023-09-30T17:04:02.705 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0318e-05 2023-09-30T17:04:02.705 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.705 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.705 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.706 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.402953+0000", 2023-09-30T17:04:02.706 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7223000000000001e-05 2023-09-30T17:04:02.706 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.706 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.706 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.706 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.402960+0000", 2023-09-30T17:04:02.706 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1169999999999998e-06 2023-09-30T17:04:02.706 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.706 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.706 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.706 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.707 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.707 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:89410 4.28 4:15eeb89b:::100000001f8.00000032:head [write 3706880~4096 in=4096b,write 3784704~4096 in=4096b,write 3825664~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:02.707 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.412306+0000", 2023-09-30T17:04:02.707 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.040263782999999997, 2023-09-30T17:04:02.707 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.042301668000000001, 2023-09-30T17:04:02.707 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.707 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:02.707 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:02.707 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:02.707 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.707 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 89410 2023-09-30T17:04:02.708 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.708 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.708 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.708 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.708 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.412306+0000", 2023-09-30T17:04:02.708 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.708 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.708 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.708 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.708 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.412306+0000", 2023-09-30T17:04:02.708 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.708 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.709 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.709 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.709 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.412307+0000", 2023-09-30T17:04:02.709 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.0999999999999997e-07 2023-09-30T17:04:02.709 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.709 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.709 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.709 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.412319+0000", 2023-09-30T17:04:02.709 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1571e-05 2023-09-30T17:04:02.709 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.709 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.709 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.710 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.412329+0000", 2023-09-30T17:04:02.710 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0166999999999999e-05 2023-09-30T17:04:02.710 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.710 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.710 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.710 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.412336+0000", 2023-09-30T17:04:02.710 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8329999999999996e-06 2023-09-30T17:04:02.710 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.710 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.710 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:02.710 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.413083+0000", 2023-09-30T17:04:02.710 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00074693600000000002 2023-09-30T17:04:02.711 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.711 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.711 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:02.711 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.413164+0000", 2023-09-30T17:04:02.711 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1110000000000001e-05 2023-09-30T17:04:02.711 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.711 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.711 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:02.711 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.413311+0000", 2023-09-30T17:04:02.711 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014716600000000001 2023-09-30T17:04:02.711 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.712 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.712 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.712 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.712 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.712 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:89178 4.f e49/17 4:f0d983b2:::100000001f8.0000001f:head v 49'4262, mlcod=49'4251)", 2023-09-30T17:04:02.712 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.383385+0000", 2023-09-30T17:04:02.712 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.069184688999999994, 2023-09-30T17:04:02.712 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.071263462999999999, 2023-09-30T17:04:02.712 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.712 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:02.712 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.712 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.713 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.713 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.383385+0000", 2023-09-30T17:04:02.713 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.713 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.713 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.713 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.713 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.383385+0000", 2023-09-30T17:04:02.713 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.713 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.713 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.713 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.713 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.383386+0000", 2023-09-30T17:04:02.714 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.6300000000000001e-07 2023-09-30T17:04:02.714 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.714 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.714 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.714 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.383396+0000", 2023-09-30T17:04:02.714 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0738e-05 2023-09-30T17:04:02.714 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.714 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.714 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.714 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.383402+0000", 2023-09-30T17:04:02.714 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6420000000000004e-06 2023-09-30T17:04:02.714 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.715 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.715 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.715 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.383406+0000", 2023-09-30T17:04:02.715 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1280000000000001e-06 2023-09-30T17:04:02.715 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.715 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.715 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:02.715 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.411817+0000", 2023-09-30T17:04:02.715 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.028411048000000001 2023-09-30T17:04:02.715 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.715 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.715 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:02.716 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.411836+0000", 2023-09-30T17:04:02.716 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9335999999999999e-05 2023-09-30T17:04:02.716 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.716 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.716 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.716 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.716 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.716 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:89355 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:02.716 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.394450+0000", 2023-09-30T17:04:02.716 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.058120405, 2023-09-30T17:04:02.716 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.060232426999999998, 2023-09-30T17:04:02.716 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.717 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:02.717 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:02.717 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:02.717 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.717 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 89355 2023-09-30T17:04:02.717 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.717 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.717 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.717 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.717 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.394450+0000", 2023-09-30T17:04:02.717 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.717 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.718 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.718 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.718 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.394450+0000", 2023-09-30T17:04:02.718 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.718 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.718 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.718 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.718 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.394450+0000", 2023-09-30T17:04:02.718 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8800000000000001e-07 2023-09-30T17:04:02.718 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.718 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.718 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.719 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.394462+0000", 2023-09-30T17:04:02.719 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1588e-05 2023-09-30T17:04:02.719 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.719 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.719 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.719 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.394476+0000", 2023-09-30T17:04:02.719 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4392e-05 2023-09-30T17:04:02.719 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.719 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.719 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.719 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.394484+0000", 2023-09-30T17:04:02.719 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0460000000000006e-06 2023-09-30T17:04:02.720 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.720 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.720 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.720 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.720 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.720 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:89386 4.8 4:11ee3b64:::100000001f8.0000003e:head [write 888832~4096 in=4096b,write 962560~4096 in=4096b,write 1011712~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:02.720 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.403863+0000", 2023-09-30T17:04:02.720 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.048706824000000003, 2023-09-30T17:04:02.720 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.050852150999999998, 2023-09-30T17:04:02.720 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.720 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:02.720 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:02.721 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:02.721 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.721 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 89386 2023-09-30T17:04:02.721 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.721 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.721 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.721 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.721 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.403863+0000", 2023-09-30T17:04:02.721 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.721 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.721 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.721 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.722 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.403863+0000", 2023-09-30T17:04:02.722 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.722 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.722 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.722 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.722 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.403864+0000", 2023-09-30T17:04:02.722 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8800000000000001e-07 2023-09-30T17:04:02.722 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.722 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.722 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.722 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.403877+0000", 2023-09-30T17:04:02.722 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2605e-05 2023-09-30T17:04:02.723 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.723 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.723 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.723 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.403887+0000", 2023-09-30T17:04:02.723 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0125e-05 2023-09-30T17:04:02.723 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.723 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.723 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.723 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.403897+0000", 2023-09-30T17:04:02.723 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7950000000000002e-06 2023-09-30T17:04:02.723 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.723 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.724 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:02.724 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.404197+0000", 2023-09-30T17:04:02.724 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00030050999999999998 2023-09-30T17:04:02.724 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.724 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.724 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:02.724 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.404275+0000", 2023-09-30T17:04:02.724 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7904000000000005e-05 2023-09-30T17:04:02.724 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.724 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.724 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.724 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.725 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.725 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:89411 4.15 4:aada5e43:::100000001f8.00000028:head [write 307200~4096 in=4096b,write 565248~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:02.725 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.412958+0000", 2023-09-30T17:04:02.725 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.039612000000000001, 2023-09-30T17:04:02.725 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.041808962999999998, 2023-09-30T17:04:02.725 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.725 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:02.725 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:02.725 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:02.725 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.725 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 89411 2023-09-30T17:04:02.725 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.726 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.726 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.726 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.726 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.412958+0000", 2023-09-30T17:04:02.726 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.726 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.726 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.726 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.726 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.412958+0000", 2023-09-30T17:04:02.726 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.726 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.727 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.727 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.727 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.412959+0000", 2023-09-30T17:04:02.727 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0999999999999997e-07 2023-09-30T17:04:02.727 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.727 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.727 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.727 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.412971+0000", 2023-09-30T17:04:02.727 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2029e-05 2023-09-30T17:04:02.727 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.727 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.727 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.728 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.412982+0000", 2023-09-30T17:04:02.728 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1066e-05 2023-09-30T17:04:02.728 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.728 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.728 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.728 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.412989+0000", 2023-09-30T17:04:02.728 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2010000000000002e-06 2023-09-30T17:04:02.728 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.728 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.728 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:02.728 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.417433+0000", 2023-09-30T17:04:02.728 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0044439989999999997 2023-09-30T17:04:02.729 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.729 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.729 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:02.729 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.417517+0000", 2023-09-30T17:04:02.729 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3534000000000004e-05 2023-09-30T17:04:02.729 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.729 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.729 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:02.729 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.417667+0000", 2023-09-30T17:04:02.729 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014999300000000001 2023-09-30T17:04:02.729 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.729 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.730 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.730 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.730 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.730 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:89412 4.13 4:caef1406:::100000001f8.00000031:head [write 2375680~8192 in=8192b,write 2416640~4096 in=4096b,write 2453504~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:02.730 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.413002+0000", 2023-09-30T17:04:02.730 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.039568072000000003, 2023-09-30T17:04:02.730 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.041810128000000002, 2023-09-30T17:04:02.730 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.730 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:02.730 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:02.730 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:02.730 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.731 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 89412 2023-09-30T17:04:02.731 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.731 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.731 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.731 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.731 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.413002+0000", 2023-09-30T17:04:02.731 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.731 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.731 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.731 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.732 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.413002+0000", 2023-09-30T17:04:02.732 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.732 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.732 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.732 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.732 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.413002+0000", 2023-09-30T17:04:02.732 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8100000000000003e-07 2023-09-30T17:04:02.732 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.732 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.732 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.732 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.413015+0000", 2023-09-30T17:04:02.732 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2989e-05 2023-09-30T17:04:02.733 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.733 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.733 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.733 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.413023+0000", 2023-09-30T17:04:02.733 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8010000000000004e-06 2023-09-30T17:04:02.733 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.733 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.733 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.733 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.413030+0000", 2023-09-30T17:04:02.733 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.708e-06 2023-09-30T17:04:02.733 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.734 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.734 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:02.734 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.417713+0000", 2023-09-30T17:04:02.734 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0046827420000000002 2023-09-30T17:04:02.734 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.734 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.734 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:02.734 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.417815+0000", 2023-09-30T17:04:02.734 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010241700000000001 2023-09-30T17:04:02.734 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.734 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.735 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.735 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.735 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.735 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:89221 4.37 e49/17)", 2023-09-30T17:04:02.735 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.394638+0000", 2023-09-30T17:04:02.735 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.057931455999999999, 2023-09-30T17:04:02.735 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.060209288, 2023-09-30T17:04:02.735 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.735 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:02.735 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.735 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.735 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.736 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.394638+0000", 2023-09-30T17:04:02.736 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.736 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.736 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.736 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.736 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.394638+0000", 2023-09-30T17:04:02.736 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.736 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.736 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.736 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.736 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.394639+0000", 2023-09-30T17:04:02.736 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2500000000000005e-07 2023-09-30T17:04:02.736 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.737 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.737 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.737 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.394652+0000", 2023-09-30T17:04:02.737 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3273e-05 2023-09-30T17:04:02.737 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.737 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.737 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.737 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.394662+0000", 2023-09-30T17:04:02.737 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3090000000000001e-06 2023-09-30T17:04:02.737 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.737 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.737 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.738 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.394668+0000", 2023-09-30T17:04:02.738 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4819999999999999e-06 2023-09-30T17:04:02.738 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.738 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.738 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.738 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.738 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.738 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:89350 4.2f e49/17)", 2023-09-30T17:04:02.738 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.413308+0000", 2023-09-30T17:04:02.738 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.039261602, 2023-09-30T17:04:02.738 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.041564881999999997, 2023-09-30T17:04:02.738 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.738 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:02.739 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.739 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.739 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.739 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.413308+0000", 2023-09-30T17:04:02.739 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.739 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.739 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.739 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.739 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.413308+0000", 2023-09-30T17:04:02.739 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.739 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.740 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.740 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.740 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.413309+0000", 2023-09-30T17:04:02.740 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8400000000000004e-07 2023-09-30T17:04:02.740 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.740 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.740 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.740 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.413322+0000", 2023-09-30T17:04:02.740 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2876e-05 2023-09-30T17:04:02.740 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.740 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.740 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.741 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.413331+0000", 2023-09-30T17:04:02.741 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9570000000000008e-06 2023-09-30T17:04:02.741 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.741 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.741 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.741 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.413337+0000", 2023-09-30T17:04:02.741 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.6769999999999998e-06 2023-09-30T17:04:02.741 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.741 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.741 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.741 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.741 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.742 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:89322 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 970752~4096 in=4096b,write 1089536~4096 in=4096b,write 1110016~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:02.742 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.383208+0000", 2023-09-30T17:04:02.742 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.069361668000000001, 2023-09-30T17:04:02.742 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.071695561000000005, 2023-09-30T17:04:02.742 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.742 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:02.742 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:02.742 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:02.742 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.742 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 89322 2023-09-30T17:04:02.742 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.743 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.743 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.743 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.743 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.383208+0000", 2023-09-30T17:04:02.743 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.743 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.743 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.743 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.743 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.383208+0000", 2023-09-30T17:04:02.743 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.743 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.744 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.744 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.744 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.383209+0000", 2023-09-30T17:04:02.744 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5100000000000001e-07 2023-09-30T17:04:02.744 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.744 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.744 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.744 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.383218+0000", 2023-09-30T17:04:02.744 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1519999999999998e-06 2023-09-30T17:04:02.744 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.744 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.744 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.745 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.383533+0000", 2023-09-30T17:04:02.745 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00031528200000000001 2023-09-30T17:04:02.745 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.745 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.745 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.745 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.383540+0000", 2023-09-30T17:04:02.745 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0809999999999996e-06 2023-09-30T17:04:02.745 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.745 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.745 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:02.745 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.417900+0000", 2023-09-30T17:04:02.746 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.034360123999999999 2023-09-30T17:04:02.746 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.746 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.746 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:02.746 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.417986+0000", 2023-09-30T17:04:02.746 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5536000000000002e-05 2023-09-30T17:04:02.746 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.746 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.746 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:02.746 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.418142+0000", 2023-09-30T17:04:02.746 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015580600000000001 2023-09-30T17:04:02.747 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.747 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.747 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.747 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.747 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.747 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:89358 4.3f 4.a34187bf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:02.747 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.395167+0000", 2023-09-30T17:04:02.747 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.057402870000000002, 2023-09-30T17:04:02.747 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.059777088999999999, 2023-09-30T17:04:02.747 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.747 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:02.747 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:02.748 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:02.748 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.748 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 89358 2023-09-30T17:04:02.748 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.748 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.748 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.748 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.748 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.395167+0000", 2023-09-30T17:04:02.748 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.748 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.748 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.748 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.749 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.395167+0000", 2023-09-30T17:04:02.749 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.749 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.749 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.749 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.749 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.395168+0000", 2023-09-30T17:04:02.749 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6400000000000001e-07 2023-09-30T17:04:02.749 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.749 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.749 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.749 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.395179+0000", 2023-09-30T17:04:02.749 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.077e-05 2023-09-30T17:04:02.750 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.750 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.750 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.750 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.395190+0000", 2023-09-30T17:04:02.750 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1579e-05 2023-09-30T17:04:02.750 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.750 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.750 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.750 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.395197+0000", 2023-09-30T17:04:02.750 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1720000000000001e-06 2023-09-30T17:04:02.750 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.751 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.751 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.751 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.751 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.751 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:89352 4.37 e49/17)", 2023-09-30T17:04:02.751 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.414734+0000", 2023-09-30T17:04:02.751 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.037836397000000001, 2023-09-30T17:04:02.751 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.040239456999999999, 2023-09-30T17:04:02.751 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.751 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:02.751 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.751 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.752 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.752 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.414734+0000", 2023-09-30T17:04:02.752 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.752 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.752 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.752 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.752 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.414734+0000", 2023-09-30T17:04:02.752 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.752 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.752 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.752 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.752 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.414734+0000", 2023-09-30T17:04:02.753 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7000000000000005e-07 2023-09-30T17:04:02.753 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.753 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.753 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.753 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.414746+0000", 2023-09-30T17:04:02.753 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2101e-05 2023-09-30T17:04:02.753 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.753 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.753 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.753 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.414757+0000", 2023-09-30T17:04:02.753 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0807e-05 2023-09-30T17:04:02.753 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.754 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.754 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.754 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.414764+0000", 2023-09-30T17:04:02.754 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4089999999999997e-06 2023-09-30T17:04:02.754 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.754 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.754 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.754 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.754 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.754 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:89118 4.2f e49/17 4:f59f865b:::100000001f8.00000007:head v 49'1336, mlcod=49'1330)", 2023-09-30T17:04:02.754 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.374024+0000", 2023-09-30T17:04:02.754 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.078545493999999993, 2023-09-30T17:04:02.755 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.080975933, 2023-09-30T17:04:02.755 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.755 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:02.755 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.755 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.755 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.755 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.374024+0000", 2023-09-30T17:04:02.755 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.755 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.755 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.755 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.755 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.374024+0000", 2023-09-30T17:04:02.756 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.756 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.756 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.756 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.756 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.374025+0000", 2023-09-30T17:04:02.756 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0399999999999996e-07 2023-09-30T17:04:02.756 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.756 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.756 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.756 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.374041+0000", 2023-09-30T17:04:02.756 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5645999999999999e-05 2023-09-30T17:04:02.757 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.757 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.757 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.757 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.374050+0000", 2023-09-30T17:04:02.757 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3340000000000008e-06 2023-09-30T17:04:02.757 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.757 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.757 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.757 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.374057+0000", 2023-09-30T17:04:02.757 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9970000000000001e-06 2023-09-30T17:04:02.757 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.757 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.758 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:02.758 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.394300+0000", 2023-09-30T17:04:02.758 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.020242870999999999 2023-09-30T17:04:02.758 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.758 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.758 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:02.758 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.394322+0000", 2023-09-30T17:04:02.758 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2337999999999999e-05 2023-09-30T17:04:02.758 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.758 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.758 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.759 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.759 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.759 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:89414 4.15 4:aada5e43:::100000001f8.00000028:head [write 4096000~4096 in=4096b,write 4108288~4096 in=4096b,write 4120576~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:02.759 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.415289+0000", 2023-09-30T17:04:02.759 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.037281201, 2023-09-30T17:04:02.759 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.039748009000000001, 2023-09-30T17:04:02.759 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.759 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:02.759 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:02.759 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:02.759 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.759 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 89414 2023-09-30T17:04:02.760 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.760 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.760 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.760 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.760 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.415289+0000", 2023-09-30T17:04:02.760 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.760 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.760 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.761 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.761 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.415289+0000", 2023-09-30T17:04:02.761 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.761 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.761 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.761 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.761 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.415290+0000", 2023-09-30T17:04:02.761 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2720000000000001e-06 2023-09-30T17:04:02.761 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.761 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.761 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.761 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.415308+0000", 2023-09-30T17:04:02.762 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7614000000000001e-05 2023-09-30T17:04:02.762 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.762 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.762 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.762 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.415324+0000", 2023-09-30T17:04:02.762 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6104999999999999e-05 2023-09-30T17:04:02.762 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.762 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.762 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.762 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.415332+0000", 2023-09-30T17:04:02.762 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3909999999999998e-06 2023-09-30T17:04:02.763 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.763 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.763 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:02.763 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.419013+0000", 2023-09-30T17:04:02.763 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0036805000000000002 2023-09-30T17:04:02.763 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.763 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.763 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:02.763 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.419087+0000", 2023-09-30T17:04:02.763 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4888999999999994e-05 2023-09-30T17:04:02.763 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.764 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.764 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:02.764 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.419236+0000", 2023-09-30T17:04:02.764 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014844899999999999 2023-09-30T17:04:02.764 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.764 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.764 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.764 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.764 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.764 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:89329 4.27 4.df99e167 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:02.764 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.384415+0000", 2023-09-30T17:04:02.764 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.068155352000000002, 2023-09-30T17:04:02.765 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.070662525000000004, 2023-09-30T17:04:02.765 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.765 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:02.765 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:02.765 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:02.765 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.765 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 89329 2023-09-30T17:04:02.765 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.765 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.765 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.765 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.766 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.384415+0000", 2023-09-30T17:04:02.766 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.766 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.766 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.766 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.766 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.384415+0000", 2023-09-30T17:04:02.766 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.766 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.766 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.767 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.767 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.384415+0000", 2023-09-30T17:04:02.767 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8100000000000002e-07 2023-09-30T17:04:02.767 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.767 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.767 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.767 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.384425+0000", 2023-09-30T17:04:02.767 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0118e-05 2023-09-30T17:04:02.767 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.768 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.768 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.768 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.384436+0000", 2023-09-30T17:04:02.768 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1018e-05 2023-09-30T17:04:02.768 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.768 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.768 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.768 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.384443+0000", 2023-09-30T17:04:02.768 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.285e-06 2023-09-30T17:04:02.768 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.768 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.769 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.769 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.769 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.769 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:89277 4.2f e49/17)", 2023-09-30T17:04:02.769 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.406129+0000", 2023-09-30T17:04:02.769 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.046441181999999998, 2023-09-30T17:04:02.769 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.048977043999999997, 2023-09-30T17:04:02.769 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.769 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:02.769 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.770 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.770 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.770 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.406129+0000", 2023-09-30T17:04:02.770 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.770 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.770 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.770 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.770 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.406129+0000", 2023-09-30T17:04:02.770 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.770 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.771 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.771 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.771 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.406129+0000", 2023-09-30T17:04:02.771 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4299999999999999e-07 2023-09-30T17:04:02.771 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.771 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.771 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.771 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.406142+0000", 2023-09-30T17:04:02.771 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2731999999999999e-05 2023-09-30T17:04:02.771 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.771 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.772 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.772 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.406148+0000", 2023-09-30T17:04:02.772 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2190000000000001e-06 2023-09-30T17:04:02.772 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.772 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.772 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.772 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.406152+0000", 2023-09-30T17:04:02.772 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.403e-06 2023-09-30T17:04:02.772 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.772 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.772 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.772 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.773 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.773 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:89415 4.13 4:cbf33e86:::100000001f8.00000026:head [write 3547136~4096 in=4096b,write 3837952~4096 in=4096b,write 3866624~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:02.773 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:02.415345+0000", 2023-09-30T17:04:02.773 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.037224447000000001, 2023-09-30T17:04:02.773 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.039790283000000003, 2023-09-30T17:04:02.773 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:02.773 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:02.773 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:02.773 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:02.774 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:02.774 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 89415 2023-09-30T17:04:02.774 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.774 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:02.774 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.774 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:02.774 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.415345+0000", 2023-09-30T17:04:02.774 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.774 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.774 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.774 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:02.775 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.415345+0000", 2023-09-30T17:04:02.775 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:02.775 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.775 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.775 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:02.775 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.415346+0000", 2023-09-30T17:04:02.775 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3200000000000005e-07 2023-09-30T17:04:02.775 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.775 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.775 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:02.776 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.415359+0000", 2023-09-30T17:04:02.776 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2699e-05 2023-09-30T17:04:02.776 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.776 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.776 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:02.776 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.415370+0000", 2023-09-30T17:04:02.776 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1270999999999999e-05 2023-09-30T17:04:02.776 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.776 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.776 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:02.776 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.415377+0000", 2023-09-30T17:04:02.776 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5479999999999998e-06 2023-09-30T17:04:02.777 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.777 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.777 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:02.777 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.420429+0000", 2023-09-30T17:04:02.777 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0050520440000000003 2023-09-30T17:04:02.777 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:02.777 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:02.777 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:02.777 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:02.420501+0000", 2023-09-30T17:04:02.777 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2407e-05 2023-09-30T17:04:02.777 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.778 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:02.778 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.778 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:02.778 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-09-30T17:04:02.778 INFO:teuthology.orchestra.run.smithi031.stdout: "num_ops": 73 2023-09-30T17:04:02.778 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:04:02.779 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-09-30T17:04:02.780 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:04:02.781 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:02.779+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:02.880 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:02.880+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:02.961 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:04:02.981 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:02.981+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:02.985 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:04:02.985 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-09-30T17:04:02.985 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-09-30T17:04:02.985 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:04:02.989 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:04:02.989 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:04:03.034 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:03.034 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:03.047 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:04:03.081 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:03.081+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:03.182 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:03.182+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:03.268 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:03.268 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:03.283 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:03.282+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:03.285 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:04:03.384 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:03.383+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:03.487 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:03.487 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:03.487 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:03.487+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:03.502 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:04:03.587 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:03.585+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:03.687 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:03.687+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:03.752 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:03.772 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:03.773 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:04:03.790 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:03.789+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:03.890 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~76s 2023-09-30T17:04:03.891 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:03.890+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:03.991 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:03.992+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:04.009 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:04.009 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:04.023 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:04:04.093 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:04.092+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:04.194 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:04.194+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:04.235 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:04.235 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:04.253 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:04:04.296 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:04.295+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:04.303 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-09-30T17:04:04.396 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:04.396+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:04.499 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:04.497+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:04.502 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:04.502 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:04.517 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:04:04.599 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:04.599+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:04.701 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:04.700+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:04.729 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:04.730 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:04.742 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:04:04.801 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:04.801+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:04.908 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:04.901+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:04.937 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:04.937 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:04.953 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:04:04.991 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-09-30T17:04:05.003 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:05.001+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:05.103 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:05.102+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:05.174 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:04:05.187 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:05.187 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:05.200 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:04:05.201 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-09-30T17:04:05.201 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-09-30T17:04:05.201 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:04:05.203 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:04:05.204 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:04:05.204 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:04:05.205 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:05.204+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:05.299 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is set 2023-09-30T17:04:05.305 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:05.304+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:05.406 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:05.405+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:05.414 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:04:05.414 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2023-09-30T17:04:05.415 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2023-09-30T17:04:05.415 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2023-09-30T17:04:05.415 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.415 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:23712 4.37 4:eff9002a:::100000001f8.00000003:head [write 3387392~8192,write 3452928~4096,write 3710976~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e41)", 2023-09-30T17:04:05.415 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:03:38.713901+0000", 2023-09-30T17:04:05.415 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 26.697030448, 2023-09-30T17:04:05.415 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.25525220700000001, 2023-09-30T17:04:05.415 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:05.415 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:05.415 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:05.415 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:05.415 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.416 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 23712 2023-09-30T17:04:05.416 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.416 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:05.416 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.416 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:05.416 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713901+0000", 2023-09-30T17:04:05.416 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:05.416 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.416 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.416 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:05.416 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713901+0000", 2023-09-30T17:04:05.417 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:05.417 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.417 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.417 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:05.417 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713901+0000", 2023-09-30T17:04:05.417 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.96e-07 2023-09-30T17:04:05.417 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.417 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.417 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:05.417 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713912+0000", 2023-09-30T17:04:05.417 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0543999999999999e-05 2023-09-30T17:04:05.417 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.418 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.418 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:05.418 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713918+0000", 2023-09-30T17:04:05.418 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4420000000000003e-06 2023-09-30T17:04:05.418 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.418 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.418 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.418 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.713923+0000", 2023-09-30T17:04:05.418 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3059999999999997e-06 2023-09-30T17:04:05.418 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.418 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.418 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:05.419 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.946744+0000", 2023-09-30T17:04:05.419 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.23282061100000001 2023-09-30T17:04:05.419 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.419 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.419 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:05.419 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.946818+0000", 2023-09-30T17:04:05.419 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3762000000000003e-05 2023-09-30T17:04:05.419 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.419 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.419 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:05.419 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.946949+0000", 2023-09-30T17:04:05.419 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013133900000000001 2023-09-30T17:04:05.420 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.420 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.420 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:05.420 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.951383+0000", 2023-09-30T17:04:05.420 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0044336999999999996 2023-09-30T17:04:05.420 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.420 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.420 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:05.420 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.969076+0000", 2023-09-30T17:04:05.420 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017693303000000001 2023-09-30T17:04:05.420 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.420 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.421 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:05.421 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.969119+0000", 2023-09-30T17:04:05.421 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3208999999999999e-05 2023-09-30T17:04:05.421 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.421 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.421 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:05.421 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:03:38.969153+0000", 2023-09-30T17:04:05.421 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3594999999999999e-05 2023-09-30T17:04:05.421 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:05.421 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:05.421 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:05.421 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.421 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.422 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:89353 4.f 4:f0d983b2:::100000001f8.0000001f:head [write 3448832~4096,write 3485696~4096,write 3555328~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:05.422 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:02.393603+0000", 2023-09-30T17:04:05.422 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.017328059, 2023-09-30T17:04:05.422 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.252173535, 2023-09-30T17:04:05.422 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:05.422 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:05.422 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:05.422 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:05.422 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.422 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 89353 2023-09-30T17:04:05.422 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.422 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:05.423 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.423 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:05.423 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.393603+0000", 2023-09-30T17:04:05.423 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:05.423 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.423 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.423 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:05.423 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.393603+0000", 2023-09-30T17:04:05.423 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:05.423 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.423 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.423 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:05.424 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.393604+0000", 2023-09-30T17:04:05.424 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0100000000000003e-07 2023-09-30T17:04:05.424 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.424 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.424 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:05.424 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.393616+0000", 2023-09-30T17:04:05.424 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2305e-05 2023-09-30T17:04:05.424 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.424 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.424 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:05.425 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.393630+0000", 2023-09-30T17:04:05.425 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4168999999999999e-05 2023-09-30T17:04:05.425 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.425 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.425 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.425 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.393638+0000", 2023-09-30T17:04:05.425 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9480000000000008e-06 2023-09-30T17:04:05.425 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.425 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.425 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:05.425 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.414454+0000", 2023-09-30T17:04:05.425 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020815750000000001 2023-09-30T17:04:05.426 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.426 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.426 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:05.426 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.414573+0000", 2023-09-30T17:04:05.426 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000119288 2023-09-30T17:04:05.426 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.426 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.426 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:05.426 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.414719+0000", 2023-09-30T17:04:05.426 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014575800000000001 2023-09-30T17:04:05.426 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.426 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.427 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:05.427 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.422025+0000", 2023-09-30T17:04:05.427 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0073054929999999997 2023-09-30T17:04:05.427 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.427 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.427 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:05.427 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.645712+0000", 2023-09-30T17:04:05.427 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.22368732199999999 2023-09-30T17:04:05.427 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.427 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.427 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:05.427 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.645754+0000", 2023-09-30T17:04:05.428 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2292000000000001e-05 2023-09-30T17:04:05.428 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.428 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.428 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:05.428 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.645777+0000", 2023-09-30T17:04:05.428 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2308999999999999e-05 2023-09-30T17:04:05.428 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:05.428 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:05.428 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:05.428 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.428 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.428 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:89751 4.37 4:ef395e89:::100000001f8.00000020:head [write 3080192~4096,write 3145728~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:05.429 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:02.517037+0000", 2023-09-30T17:04:05.429 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 2.8938937060000001, 2023-09-30T17:04:05.429 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.24943620899999999, 2023-09-30T17:04:05.429 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:05.429 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:05.429 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:05.429 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:05.429 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.429 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 89751 2023-09-30T17:04:05.429 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.429 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:05.430 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.430 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:05.430 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.517037+0000", 2023-09-30T17:04:05.430 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:05.430 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.430 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.430 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:05.430 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.517037+0000", 2023-09-30T17:04:05.430 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:05.430 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.430 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.430 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:05.431 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.517038+0000", 2023-09-30T17:04:05.431 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6499999999999999e-07 2023-09-30T17:04:05.431 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.431 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.431 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:05.431 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.517056+0000", 2023-09-30T17:04:05.431 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7921999999999999e-05 2023-09-30T17:04:05.431 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.431 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.431 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:05.431 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.517063+0000", 2023-09-30T17:04:05.432 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9179999999999997e-06 2023-09-30T17:04:05.432 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.432 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.432 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.432 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.517067+0000", 2023-09-30T17:04:05.432 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4279999999999998e-06 2023-09-30T17:04:05.432 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.432 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.432 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:05.434 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.517104+0000", 2023-09-30T17:04:05.434 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7063000000000001e-05 2023-09-30T17:04:05.434 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.434 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.434 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:05.435 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.517152+0000", 2023-09-30T17:04:05.435 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7209999999999997e-05 2023-09-30T17:04:05.435 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.435 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.435 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:05.435 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.517237+0000", 2023-09-30T17:04:05.435 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5086000000000005e-05 2023-09-30T17:04:05.435 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.435 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.435 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:05.435 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.526926+0000", 2023-09-30T17:04:05.435 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0096894579999999998 2023-09-30T17:04:05.436 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.436 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.436 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:05.436 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.766387+0000", 2023-09-30T17:04:05.436 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.23946086699999999 2023-09-30T17:04:05.436 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.436 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.436 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:05.436 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.766437+0000", 2023-09-30T17:04:05.436 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0170000000000002e-05 2023-09-30T17:04:05.436 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.437 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.437 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:05.437 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.766474+0000", 2023-09-30T17:04:05.437 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6522e-05 2023-09-30T17:04:05.437 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:05.437 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:05.437 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:05.437 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.437 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.438 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:89754 4.37 4:eff9002a:::100000001f8.00000003:head [write 3952640~4096,write 4001792~4096,write 4046848~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:05.438 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:02.517904+0000", 2023-09-30T17:04:05.438 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 2.8930272170000002, 2023-09-30T17:04:05.438 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.25558771200000002, 2023-09-30T17:04:05.438 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:05.438 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:05.438 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:05.438 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:05.438 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.439 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 89754 2023-09-30T17:04:05.439 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.439 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:05.439 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.439 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:05.439 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.517904+0000", 2023-09-30T17:04:05.439 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:05.439 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.440 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.440 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:05.440 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.517904+0000", 2023-09-30T17:04:05.440 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:05.440 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.440 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.440 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:05.440 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.517905+0000", 2023-09-30T17:04:05.440 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5499999999999997e-07 2023-09-30T17:04:05.441 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.441 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.441 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:05.441 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.517924+0000", 2023-09-30T17:04:05.441 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9198000000000002e-05 2023-09-30T17:04:05.441 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.441 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.441 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:05.441 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.517937+0000", 2023-09-30T17:04:05.442 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3519e-05 2023-09-30T17:04:05.442 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.442 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.442 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.442 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.517945+0000", 2023-09-30T17:04:05.442 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1450000000000002e-06 2023-09-30T17:04:05.442 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.442 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.442 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:05.443 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.519376+0000", 2023-09-30T17:04:05.443 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014316279999999999 2023-09-30T17:04:05.443 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.443 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:05.443 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.519473+0000", 2023-09-30T17:04:05.443 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6558999999999995e-05 2023-09-30T17:04:05.443 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.444 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:05.444 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.519651+0000", 2023-09-30T17:04:05.444 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017847499999999999 2023-09-30T17:04:05.444 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.444 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.444 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:05.444 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.526932+0000", 2023-09-30T17:04:05.444 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072812440000000001 2023-09-30T17:04:05.444 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.444 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.444 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:05.444 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.773433+0000", 2023-09-30T17:04:05.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.24650095999999999 2023-09-30T17:04:05.445 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.445 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.445 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:05.445 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.773469+0000", 2023-09-30T17:04:05.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5259000000000002e-05 2023-09-30T17:04:05.445 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.445 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.445 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:05.445 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.773492+0000", 2023-09-30T17:04:05.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2969999999999999e-05 2023-09-30T17:04:05.445 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:05.446 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:05.446 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:05.446 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.446 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.446 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:89762 4.f 4:f0d983b2:::100000001f8.0000001f:head [write 335872~4096,write 372736~4096,write 507904~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:05.446 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:02.520607+0000", 2023-09-30T17:04:05.446 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 2.8903236850000003, 2023-09-30T17:04:05.446 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.25801778199999997, 2023-09-30T17:04:05.446 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:05.446 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:05.446 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:05.447 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:05.447 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.447 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 89762 2023-09-30T17:04:05.447 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.447 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:05.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.447 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:05.447 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.520607+0000", 2023-09-30T17:04:05.447 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:05.447 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.447 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:05.447 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.520607+0000", 2023-09-30T17:04:05.448 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:05.448 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.448 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:05.448 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.520608+0000", 2023-09-30T17:04:05.448 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7700000000000004e-07 2023-09-30T17:04:05.448 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.448 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:05.448 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.520617+0000", 2023-09-30T17:04:05.448 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8000000000000004e-06 2023-09-30T17:04:05.448 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.449 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.449 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:05.449 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.520626+0000", 2023-09-30T17:04:05.449 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1579999999999994e-06 2023-09-30T17:04:05.449 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.449 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.449 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.449 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.520631+0000", 2023-09-30T17:04:05.449 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0529999999999997e-06 2023-09-30T17:04:05.449 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.449 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.449 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:05.450 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.520676+0000", 2023-09-30T17:04:05.450 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4950000000000002e-05 2023-09-30T17:04:05.450 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.450 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.450 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:05.450 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.520766+0000", 2023-09-30T17:04:05.450 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0140000000000001e-05 2023-09-30T17:04:05.450 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.450 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.450 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:05.450 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.520934+0000", 2023-09-30T17:04:05.450 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016729399999999999 2023-09-30T17:04:05.451 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.451 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.451 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:05.451 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.526935+0000", 2023-09-30T17:04:05.451 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060016979999999998 2023-09-30T17:04:05.451 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.451 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.451 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:05.451 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.778570+0000", 2023-09-30T17:04:05.451 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.25163438399999999 2023-09-30T17:04:05.451 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.451 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.452 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:05.452 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.778603+0000", 2023-09-30T17:04:05.452 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3569000000000003e-05 2023-09-30T17:04:05.452 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.452 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.452 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:05.452 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.778625+0000", 2023-09-30T17:04:05.452 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2059e-05 2023-09-30T17:04:05.452 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:05.452 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:05.452 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:05.452 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.453 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.453 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:89764 4.37 4:eff9002a:::100000001f8.00000003:head [write 1400832~4096,write 1433600~4096,write 1560576~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:05.453 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:02.521189+0000", 2023-09-30T17:04:05.453 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 2.8897421599999999, 2023-09-30T17:04:05.453 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.26147284599999998, 2023-09-30T17:04:05.453 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:05.453 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:05.453 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:05.453 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:05.453 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.453 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 89764 2023-09-30T17:04:05.453 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.454 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:05.454 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.454 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:05.454 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.521189+0000", 2023-09-30T17:04:05.454 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:05.454 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.454 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.454 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:05.454 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.521189+0000", 2023-09-30T17:04:05.454 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:05.454 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.455 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.455 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:05.455 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.521189+0000", 2023-09-30T17:04:05.455 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6300000000000001e-07 2023-09-30T17:04:05.455 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.455 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.455 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:05.455 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.521204+0000", 2023-09-30T17:04:05.455 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4319e-05 2023-09-30T17:04:05.455 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.455 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.455 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:05.456 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.521210+0000", 2023-09-30T17:04:05.456 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8079999999999999e-06 2023-09-30T17:04:05.456 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.456 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.456 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.456 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.521214+0000", 2023-09-30T17:04:05.456 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9140000000000001e-06 2023-09-30T17:04:05.456 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.456 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.456 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:05.456 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.522078+0000", 2023-09-30T17:04:05.456 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000863472 2023-09-30T17:04:05.457 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.457 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.457 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:05.457 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.522171+0000", 2023-09-30T17:04:05.457 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3410000000000002e-05 2023-09-30T17:04:05.457 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.457 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.457 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:05.457 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.522341+0000", 2023-09-30T17:04:05.457 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016986200000000001 2023-09-30T17:04:05.457 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.457 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.458 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:05.458 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.530401+0000", 2023-09-30T17:04:05.458 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080600099999999994 2023-09-30T17:04:05.458 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.458 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.458 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:05.458 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.782564+0000", 2023-09-30T17:04:05.458 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.25216280400000002 2023-09-30T17:04:05.458 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.458 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.458 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:05.458 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.782626+0000", 2023-09-30T17:04:05.459 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1779000000000006e-05 2023-09-30T17:04:05.459 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.459 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.459 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:05.459 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.782662+0000", 2023-09-30T17:04:05.459 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6105000000000001e-05 2023-09-30T17:04:05.459 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:05.459 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:05.459 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:05.459 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.459 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.459 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:89765 4.2f 4:f59f865b:::100000001f8.00000007:head [write 3600384~4096,write 3694592~4096,write 3895296~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:05.460 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:02.521446+0000", 2023-09-30T17:04:05.460 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 2.8894850509999999, 2023-09-30T17:04:05.460 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.257218683, 2023-09-30T17:04:05.460 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:05.460 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:05.460 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:05.460 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:05.460 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.460 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 89765 2023-09-30T17:04:05.460 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.460 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:05.460 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.460 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:05.461 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.521446+0000", 2023-09-30T17:04:05.461 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:05.461 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.461 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.461 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:05.461 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.521446+0000", 2023-09-30T17:04:05.461 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:05.461 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.461 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.461 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:05.461 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.521446+0000", 2023-09-30T17:04:05.461 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6699999999999999e-07 2023-09-30T17:04:05.462 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.462 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.462 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:05.462 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.521470+0000", 2023-09-30T17:04:05.462 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3447000000000001e-05 2023-09-30T17:04:05.462 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.462 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.462 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:05.462 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.521476+0000", 2023-09-30T17:04:05.462 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9320000000000001e-06 2023-09-30T17:04:05.462 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.462 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.463 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.463 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.521479+0000", 2023-09-30T17:04:05.463 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5319999999999998e-06 2023-09-30T17:04:05.463 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.463 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:05.463 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.523424+0000", 2023-09-30T17:04:05.463 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019444060000000001 2023-09-30T17:04:05.463 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.463 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:05.463 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.523513+0000", 2023-09-30T17:04:05.464 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8771999999999996e-05 2023-09-30T17:04:05.464 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.464 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.464 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:05.464 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.523665+0000", 2023-09-30T17:04:05.464 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000151979 2023-09-30T17:04:05.464 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.464 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.464 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:05.464 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.530939+0000", 2023-09-30T17:04:05.464 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072745040000000002 2023-09-30T17:04:05.464 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.465 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.465 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:05.465 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.778603+0000", 2023-09-30T17:04:05.465 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.247663941 2023-09-30T17:04:05.465 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.465 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.465 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:05.465 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.778639+0000", 2023-09-30T17:04:05.465 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6284e-05 2023-09-30T17:04:05.465 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.466 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.466 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:05.466 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.778665+0000", 2023-09-30T17:04:05.466 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5519000000000001e-05 2023-09-30T17:04:05.466 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:05.466 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:05.466 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:05.466 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.466 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.467 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:89797 4.f 4:f0d983b2:::100000001f8.0000001f:head [write 3002368~4096,write 3174400~4096,write 3203072~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:05.467 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:02.530942+0000", 2023-09-30T17:04:05.467 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 2.8799892730000001, 2023-09-30T17:04:05.467 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.25172215399999998, 2023-09-30T17:04:05.467 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:05.467 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:05.467 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:05.467 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:05.467 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.467 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 89797 2023-09-30T17:04:05.468 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.468 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:05.468 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.468 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:05.468 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.530942+0000", 2023-09-30T17:04:05.468 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:05.468 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.468 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.469 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:05.469 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.530942+0000", 2023-09-30T17:04:05.469 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:05.469 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.469 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.469 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:05.469 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.530942+0000", 2023-09-30T17:04:05.469 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0699999999999997e-07 2023-09-30T17:04:05.469 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.469 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.469 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:05.470 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.530959+0000", 2023-09-30T17:04:05.470 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6203000000000001e-05 2023-09-30T17:04:05.470 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.470 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.470 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:05.470 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.530964+0000", 2023-09-30T17:04:05.470 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8050000000000003e-06 2023-09-30T17:04:05.470 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.470 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.470 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.470 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.530969+0000", 2023-09-30T17:04:05.470 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5430000000000004e-06 2023-09-30T17:04:05.471 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.471 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.471 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:05.471 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.531013+0000", 2023-09-30T17:04:05.471 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3922999999999999e-05 2023-09-30T17:04:05.471 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.471 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.471 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:05.471 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.531092+0000", 2023-09-30T17:04:05.471 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9043999999999997e-05 2023-09-30T17:04:05.471 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.471 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.472 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:05.472 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.531222+0000", 2023-09-30T17:04:05.472 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013035100000000001 2023-09-30T17:04:05.472 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.472 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.472 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:05.472 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.543716+0000", 2023-09-30T17:04:05.472 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012494131 2023-09-30T17:04:05.472 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.472 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.473 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:05.473 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.782581+0000", 2023-09-30T17:04:05.473 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.23886469499999999 2023-09-30T17:04:05.473 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.473 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.473 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:05.473 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.782630+0000", 2023-09-30T17:04:05.473 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9209999999999998e-05 2023-09-30T17:04:05.473 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.473 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.474 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:05.474 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.782664+0000", 2023-09-30T17:04:05.474 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3642000000000001e-05 2023-09-30T17:04:05.474 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:05.474 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:05.474 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:05.474 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.474 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.474 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:89798 4.f 4:f2a80dfe:::100000001f8.00000019:head [write 1609728~4096,write 1626112~4096,write 1658880~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:05.475 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:02.531315+0000", 2023-09-30T17:04:05.475 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 2.8796158649999999, 2023-09-30T17:04:05.475 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.25149054700000001, 2023-09-30T17:04:05.475 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:05.475 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:05.475 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:05.475 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:05.475 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.475 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 89798 2023-09-30T17:04:05.475 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.476 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:05.476 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.476 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:05.476 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.531315+0000", 2023-09-30T17:04:05.476 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:05.476 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.476 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.476 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:05.476 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.531315+0000", 2023-09-30T17:04:05.476 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:05.477 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.477 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.477 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:05.477 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.531316+0000", 2023-09-30T17:04:05.477 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5099999999999999e-07 2023-09-30T17:04:05.477 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.477 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.477 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:05.477 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.531328+0000", 2023-09-30T17:04:05.478 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1739000000000001e-05 2023-09-30T17:04:05.478 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.478 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.478 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:05.478 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.531337+0000", 2023-09-30T17:04:05.478 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9120000000000004e-06 2023-09-30T17:04:05.478 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.478 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.479 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.479 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.531342+0000", 2023-09-30T17:04:05.479 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2329999999999997e-06 2023-09-30T17:04:05.479 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.479 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.479 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:05.479 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.533187+0000", 2023-09-30T17:04:05.479 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0018453110000000001 2023-09-30T17:04:05.479 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.480 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:05.480 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.533260+0000", 2023-09-30T17:04:05.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2669000000000005e-05 2023-09-30T17:04:05.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.480 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:05.480 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.533354+0000", 2023-09-30T17:04:05.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3846999999999998e-05 2023-09-30T17:04:05.481 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.481 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.481 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:05.481 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.549106+0000", 2023-09-30T17:04:05.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015751969000000001 2023-09-30T17:04:05.481 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.481 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.481 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:05.482 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.782706+0000", 2023-09-30T17:04:05.482 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.23360055399999999 2023-09-30T17:04:05.482 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.482 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.482 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:05.482 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.782767+0000", 2023-09-30T17:04:05.482 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0752999999999999e-05 2023-09-30T17:04:05.482 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.482 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.482 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:05.482 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.782806+0000", 2023-09-30T17:04:05.483 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8909000000000003e-05 2023-09-30T17:04:05.483 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:05.483 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:05.483 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:05.483 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.483 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.483 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:89803 4.2f 4:f59f865b:::100000001f8.00000007:head [write 270336~8192,write 319488~4096,write 335872~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:05.483 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:02.532923+0000", 2023-09-30T17:04:05.483 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 2.878007889, 2023-09-30T17:04:05.483 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.25084714899999999, 2023-09-30T17:04:05.484 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:05.484 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:05.484 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:05.484 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:05.484 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.484 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 89803 2023-09-30T17:04:05.484 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.484 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:05.484 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.484 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:05.484 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.532923+0000", 2023-09-30T17:04:05.484 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:05.485 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.485 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.485 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:05.485 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.532923+0000", 2023-09-30T17:04:05.485 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:05.485 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.485 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.485 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:05.485 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.532924+0000", 2023-09-30T17:04:05.485 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9500000000000001e-07 2023-09-30T17:04:05.486 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.486 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.486 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:05.486 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.532945+0000", 2023-09-30T17:04:05.486 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0839000000000002e-05 2023-09-30T17:04:05.486 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.486 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.486 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:05.486 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.532959+0000", 2023-09-30T17:04:05.486 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3861e-05 2023-09-30T17:04:05.486 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.486 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.487 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.487 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.532967+0000", 2023-09-30T17:04:05.487 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8429999999999993e-06 2023-09-30T17:04:05.487 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.487 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.487 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:05.487 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.533178+0000", 2023-09-30T17:04:05.487 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00021099399999999999 2023-09-30T17:04:05.487 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.487 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.487 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:05.487 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.533272+0000", 2023-09-30T17:04:05.488 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4648000000000006e-05 2023-09-30T17:04:05.488 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.488 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.488 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:05.488 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.533422+0000", 2023-09-30T17:04:05.488 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000149321 2023-09-30T17:04:05.488 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.488 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.488 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:05.488 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.549121+0000", 2023-09-30T17:04:05.488 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015699095 2023-09-30T17:04:05.488 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.489 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:05.489 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.783711+0000", 2023-09-30T17:04:05.489 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.234590623 2023-09-30T17:04:05.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.489 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:05.489 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.783747+0000", 2023-09-30T17:04:05.489 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5451000000000003e-05 2023-09-30T17:04:05.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.490 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:05.490 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.783770+0000", 2023-09-30T17:04:05.490 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3679000000000001e-05 2023-09-30T17:04:05.490 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:05.490 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:05.490 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:05.490 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.490 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.490 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:89807 4.37 4:eff9002a:::100000001f8.00000003:head [write 417792~4096,write 561152~4096,write 598016~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:05.490 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:02.534301+0000", 2023-09-30T17:04:05.490 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 2.8766304520000001, 2023-09-30T17:04:05.490 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.25233345499999998, 2023-09-30T17:04:05.491 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:05.491 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:05.491 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:05.491 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:05.491 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.491 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 89807 2023-09-30T17:04:05.491 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.491 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:05.491 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.491 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:05.491 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.534301+0000", 2023-09-30T17:04:05.492 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:05.492 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.492 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.492 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:05.492 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.534301+0000", 2023-09-30T17:04:05.492 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:05.492 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.492 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.492 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:05.492 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.534301+0000", 2023-09-30T17:04:05.492 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.51e-07 2023-09-30T17:04:05.492 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.493 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.493 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:05.493 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.534308+0000", 2023-09-30T17:04:05.493 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0060000000000003e-06 2023-09-30T17:04:05.493 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.493 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.493 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:05.493 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.534316+0000", 2023-09-30T17:04:05.493 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1349999999999992e-06 2023-09-30T17:04:05.493 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.493 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.493 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.494 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.534320+0000", 2023-09-30T17:04:05.494 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1010000000000002e-06 2023-09-30T17:04:05.494 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.494 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.494 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:05.494 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.534696+0000", 2023-09-30T17:04:05.494 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00037544 2023-09-30T17:04:05.494 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.494 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.495 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:05.495 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.534744+0000", 2023-09-30T17:04:05.495 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8072000000000003e-05 2023-09-30T17:04:05.495 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.495 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.495 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:05.495 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.534839+0000", 2023-09-30T17:04:05.495 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4856000000000001e-05 2023-09-30T17:04:05.495 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.495 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.495 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:05.496 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.549126+0000", 2023-09-30T17:04:05.496 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014287299999999999 2023-09-30T17:04:05.496 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.496 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.496 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:05.496 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.786579+0000", 2023-09-30T17:04:05.496 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.23745296499999999 2023-09-30T17:04:05.496 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.496 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.496 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:05.496 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.786612+0000", 2023-09-30T17:04:05.496 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3377999999999998e-05 2023-09-30T17:04:05.497 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.497 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.497 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:05.497 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.786634+0000", 2023-09-30T17:04:05.497 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1750999999999999e-05 2023-09-30T17:04:05.497 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:05.497 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:05.497 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:05.497 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.497 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.497 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:89822 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 1888256~4096,write 1961984~4096,write 2060288~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:05.498 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:02.538398+0000", 2023-09-30T17:04:05.498 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 2.8725327969999999, 2023-09-30T17:04:05.498 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.24833013700000001, 2023-09-30T17:04:05.498 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:05.498 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:05.498 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:05.498 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:05.498 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.498 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 89822 2023-09-30T17:04:05.498 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.498 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:05.499 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.499 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:05.499 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.538398+0000", 2023-09-30T17:04:05.499 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:05.499 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.499 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.499 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:05.499 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.538398+0000", 2023-09-30T17:04:05.499 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:05.499 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.499 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.500 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:05.500 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.538399+0000", 2023-09-30T17:04:05.500 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0100000000000004e-07 2023-09-30T17:04:05.500 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.500 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.500 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:05.500 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.538409+0000", 2023-09-30T17:04:05.500 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0241000000000001e-05 2023-09-30T17:04:05.500 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.500 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.500 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:05.500 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.538421+0000", 2023-09-30T17:04:05.501 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1948e-05 2023-09-30T17:04:05.501 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.501 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.501 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.501 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.538427+0000", 2023-09-30T17:04:05.501 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5729999999999998e-06 2023-09-30T17:04:05.501 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.501 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.501 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:05.501 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.539586+0000", 2023-09-30T17:04:05.501 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0011593980000000001 2023-09-30T17:04:05.502 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.502 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.502 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:05.502 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.539663+0000", 2023-09-30T17:04:05.502 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6837999999999999e-05 2023-09-30T17:04:05.502 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.502 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.502 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:05.502 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.539799+0000", 2023-09-30T17:04:05.502 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000136007 2023-09-30T17:04:05.502 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.503 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.503 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:05.503 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.551398+0000", 2023-09-30T17:04:05.503 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011598959000000001 2023-09-30T17:04:05.503 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.503 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.503 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:05.503 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.786671+0000", 2023-09-30T17:04:05.503 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.235272974 2023-09-30T17:04:05.503 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.503 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.503 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:05.504 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.786704+0000", 2023-09-30T17:04:05.504 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2774999999999997e-05 2023-09-30T17:04:05.504 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.504 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.504 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:05.504 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.786728+0000", 2023-09-30T17:04:05.504 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4623000000000001e-05 2023-09-30T17:04:05.504 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:05.504 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:05.504 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:05.504 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.504 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.505 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:89824 4.37 4:ef395e89:::100000001f8.00000020:head [write 2412544~4096,write 2453504~4096,write 2506752~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:05.505 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:02.538939+0000", 2023-09-30T17:04:05.505 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 2.8719916730000001, 2023-09-30T17:04:05.505 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.25535766700000001, 2023-09-30T17:04:05.505 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:05.505 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:05.505 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:05.505 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:05.505 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.505 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 89824 2023-09-30T17:04:05.505 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.506 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:05.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.506 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:05.506 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.538939+0000", 2023-09-30T17:04:05.506 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:05.506 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.506 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:05.506 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.538939+0000", 2023-09-30T17:04:05.506 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:05.506 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.507 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:05.507 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.538940+0000", 2023-09-30T17:04:05.507 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5499999999999997e-07 2023-09-30T17:04:05.507 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.507 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.507 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:05.507 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.538950+0000", 2023-09-30T17:04:05.507 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7599999999999997e-06 2023-09-30T17:04:05.507 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.507 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.507 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:05.507 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.538961+0000", 2023-09-30T17:04:05.508 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0743e-05 2023-09-30T17:04:05.508 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.508 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.508 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.508 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.538983+0000", 2023-09-30T17:04:05.508 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2714999999999999e-05 2023-09-30T17:04:05.508 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.508 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.508 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:05.508 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.541624+0000", 2023-09-30T17:04:05.508 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0026408830000000001 2023-09-30T17:04:05.508 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.509 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.509 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:05.509 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.541674+0000", 2023-09-30T17:04:05.509 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9985000000000003e-05 2023-09-30T17:04:05.509 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.509 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.509 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:05.509 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.541791+0000", 2023-09-30T17:04:05.509 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011629 2023-09-30T17:04:05.509 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.509 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.509 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:05.510 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.551405+0000", 2023-09-30T17:04:05.510 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.009614147 2023-09-30T17:04:05.510 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.510 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.510 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:05.510 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.794241+0000", 2023-09-30T17:04:05.510 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.24283601499999999 2023-09-30T17:04:05.510 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.510 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.510 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:05.511 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.794275+0000", 2023-09-30T17:04:05.511 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4344000000000002e-05 2023-09-30T17:04:05.511 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.511 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.511 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:05.511 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.794297+0000", 2023-09-30T17:04:05.511 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2030000000000001e-05 2023-09-30T17:04:05.511 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:05.511 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:05.511 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:05.511 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.511 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.512 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:89826 4.37 4:ef395e89:::100000001f8.00000020:head [write 1335296~8192,write 1945600~4096,write 2252800~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:05.512 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:02.539450+0000", 2023-09-30T17:04:05.512 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 2.87148096, 2023-09-30T17:04:05.512 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.254934418, 2023-09-30T17:04:05.512 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:05.512 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:05.512 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:05.512 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:05.512 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.512 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 89826 2023-09-30T17:04:05.512 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.512 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:05.513 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.513 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:05.513 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.539450+0000", 2023-09-30T17:04:05.513 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:05.513 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.513 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.513 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:05.513 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.539450+0000", 2023-09-30T17:04:05.513 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:05.513 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.513 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.513 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:05.514 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.539451+0000", 2023-09-30T17:04:05.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8999999999999996e-07 2023-09-30T17:04:05.514 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.514 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.514 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:05.514 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.539469+0000", 2023-09-30T17:04:05.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8141000000000001e-05 2023-09-30T17:04:05.514 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.514 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.514 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:05.514 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.539477+0000", 2023-09-30T17:04:05.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3729999999999993e-06 2023-09-30T17:04:05.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.515 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.515 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.539484+0000", 2023-09-30T17:04:05.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4269999999999996e-06 2023-09-30T17:04:05.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.515 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:05.515 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.543726+0000", 2023-09-30T17:04:05.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042425529999999996 2023-09-30T17:04:05.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.516 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:05.516 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.543773+0000", 2023-09-30T17:04:05.516 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6317999999999999e-05 2023-09-30T17:04:05.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.516 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:05.516 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.543873+0000", 2023-09-30T17:04:05.516 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100288 2023-09-30T17:04:05.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.516 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:05.516 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.551410+0000", 2023-09-30T17:04:05.516 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075370130000000004 2023-09-30T17:04:05.517 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.517 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:05.517 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.794328+0000", 2023-09-30T17:04:05.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.24291860000000001 2023-09-30T17:04:05.517 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.517 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:05.517 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.794363+0000", 2023-09-30T17:04:05.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4261000000000003e-05 2023-09-30T17:04:05.517 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.518 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:05.518 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.794385+0000", 2023-09-30T17:04:05.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1854000000000001e-05 2023-09-30T17:04:05.518 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:05.518 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:05.518 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:05.518 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.518 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.518 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:89836 4.37 4:eff9002a:::100000001f8.00000003:head [write 626688~4096,write 1679360~4096,write 1830912~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:05.518 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:02.542652+0000", 2023-09-30T17:04:05.518 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 2.8682795890000001, 2023-09-30T17:04:05.519 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.25957442600000002, 2023-09-30T17:04:05.519 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:05.519 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:05.519 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:05.519 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:05.519 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.519 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 89836 2023-09-30T17:04:05.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.519 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:05.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.519 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:05.519 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.542652+0000", 2023-09-30T17:04:05.520 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:05.520 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.520 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.520 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:05.520 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.542652+0000", 2023-09-30T17:04:05.520 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:05.520 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.520 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.520 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:05.520 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.542652+0000", 2023-09-30T17:04:05.520 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9100000000000003e-07 2023-09-30T17:04:05.520 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.521 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.521 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:05.521 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.542683+0000", 2023-09-30T17:04:05.521 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0397000000000001e-05 2023-09-30T17:04:05.521 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.521 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.521 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:05.521 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.542693+0000", 2023-09-30T17:04:05.521 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0145e-05 2023-09-30T17:04:05.521 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.521 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.521 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.522 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.542700+0000", 2023-09-30T17:04:05.522 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7179999999999999e-06 2023-09-30T17:04:05.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.522 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:05.522 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.546482+0000", 2023-09-30T17:04:05.522 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003782709 2023-09-30T17:04:05.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.522 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:05.522 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.546601+0000", 2023-09-30T17:04:05.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000118683 2023-09-30T17:04:05.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.523 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:05.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.546779+0000", 2023-09-30T17:04:05.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000177951 2023-09-30T17:04:05.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.523 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:05.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.551561+0000", 2023-09-30T17:04:05.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047825369999999999 2023-09-30T17:04:05.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.524 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:05.524 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.802129+0000", 2023-09-30T17:04:05.524 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.25056732799999998 2023-09-30T17:04:05.524 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.524 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.524 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:05.524 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.802185+0000", 2023-09-30T17:04:05.524 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5965999999999999e-05 2023-09-30T17:04:05.524 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.524 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.525 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:05.525 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.802226+0000", 2023-09-30T17:04:05.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1301000000000003e-05 2023-09-30T17:04:05.525 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:05.525 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:05.525 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:05.525 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.525 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.525 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:89847 4.f 4:f26fdfa9:::100000001f8.00000002:head [write 421888~4096,write 602112~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:05.525 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:02.546710+0000", 2023-09-30T17:04:05.525 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 2.8642206620000001, 2023-09-30T17:04:05.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.24973673900000001, 2023-09-30T17:04:05.526 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:05.526 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:05.526 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:05.526 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:05.526 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.526 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 89847 2023-09-30T17:04:05.526 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.526 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:05.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.526 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:05.526 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.546710+0000", 2023-09-30T17:04:05.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:05.527 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.527 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.527 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:05.527 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.546710+0000", 2023-09-30T17:04:05.527 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:05.527 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.527 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.527 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:05.527 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.546711+0000", 2023-09-30T17:04:05.527 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6400000000000002e-07 2023-09-30T17:04:05.527 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.527 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.528 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:05.528 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.546720+0000", 2023-09-30T17:04:05.528 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5499999999999995e-06 2023-09-30T17:04:05.528 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.528 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.528 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:05.528 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.546726+0000", 2023-09-30T17:04:05.528 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9830000000000001e-06 2023-09-30T17:04:05.528 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.528 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.528 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.528 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.546730+0000", 2023-09-30T17:04:05.529 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4020000000000004e-06 2023-09-30T17:04:05.529 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.529 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.529 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:05.529 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.546773+0000", 2023-09-30T17:04:05.529 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3115999999999999e-05 2023-09-30T17:04:05.529 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.529 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.529 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:05.529 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.546826+0000", 2023-09-30T17:04:05.529 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2768e-05 2023-09-30T17:04:05.529 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.530 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.530 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:05.530 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.546965+0000", 2023-09-30T17:04:05.530 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013908099999999999 2023-09-30T17:04:05.530 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.530 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.530 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:05.530 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.551747+0000", 2023-09-30T17:04:05.530 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047821649999999997 2023-09-30T17:04:05.530 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.530 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.530 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:05.531 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.796376+0000", 2023-09-30T17:04:05.531 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.24462867999999999 2023-09-30T17:04:05.531 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.531 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.531 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:05.531 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.796416+0000", 2023-09-30T17:04:05.531 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9817999999999997e-05 2023-09-30T17:04:05.531 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.531 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.531 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:05.531 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.796447+0000", 2023-09-30T17:04:05.532 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1511999999999999e-05 2023-09-30T17:04:05.532 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:05.532 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:05.532 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:05.532 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.532 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.532 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:89849 4.f 4:f2a80dfe:::100000001f8.00000019:head [write 4075520~4096,write 4104192~4096,write 4132864~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:05.532 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:02.547470+0000", 2023-09-30T17:04:05.532 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 2.8634610469999999, 2023-09-30T17:04:05.532 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.25843985899999999, 2023-09-30T17:04:05.532 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:05.532 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:05.533 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:05.533 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:05.533 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.533 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 89849 2023-09-30T17:04:05.533 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.533 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:05.533 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.533 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:05.533 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.547470+0000", 2023-09-30T17:04:05.533 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:05.533 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.533 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.534 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:05.534 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.547470+0000", 2023-09-30T17:04:05.534 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:05.534 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.534 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.534 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:05.534 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.547471+0000", 2023-09-30T17:04:05.534 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9400000000000005e-07 2023-09-30T17:04:05.534 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.534 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.534 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:05.535 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.547506+0000", 2023-09-30T17:04:05.535 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5101000000000002e-05 2023-09-30T17:04:05.535 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.535 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.535 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:05.535 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.547522+0000", 2023-09-30T17:04:05.535 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5792000000000001e-05 2023-09-30T17:04:05.535 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.535 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.535 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.535 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.547527+0000", 2023-09-30T17:04:05.535 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6380000000000001e-06 2023-09-30T17:04:05.536 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.536 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.536 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:05.536 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.549141+0000", 2023-09-30T17:04:05.536 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0016134529999999999 2023-09-30T17:04:05.536 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.536 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.536 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:05.536 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.549224+0000", 2023-09-30T17:04:05.536 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3015000000000004e-05 2023-09-30T17:04:05.536 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.536 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.537 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:05.537 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.549401+0000", 2023-09-30T17:04:05.537 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017741100000000001 2023-09-30T17:04:05.537 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.537 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.537 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:05.537 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.559005+0000", 2023-09-30T17:04:05.537 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0096038110000000003 2023-09-30T17:04:05.537 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.537 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.537 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:05.537 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.805813+0000", 2023-09-30T17:04:05.538 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.24680807799999999 2023-09-30T17:04:05.538 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.538 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.538 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:05.538 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.805867+0000", 2023-09-30T17:04:05.538 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3677999999999997e-05 2023-09-30T17:04:05.538 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.538 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.538 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:05.538 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.805910+0000", 2023-09-30T17:04:05.538 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3188000000000001e-05 2023-09-30T17:04:05.538 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:05.539 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:05.539 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:05.539 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.539 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.539 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:89853 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 2150400~4096,write 2158592~4096,write 2203648~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:05.539 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:02.548605+0000", 2023-09-30T17:04:05.539 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 2.8623257629999999, 2023-09-30T17:04:05.539 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.253745889, 2023-09-30T17:04:05.539 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:05.539 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:05.539 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:05.540 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:05.540 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.540 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 89853 2023-09-30T17:04:05.540 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.540 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:05.540 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.540 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:05.540 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.548605+0000", 2023-09-30T17:04:05.540 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:05.540 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.540 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.540 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:05.541 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.548605+0000", 2023-09-30T17:04:05.541 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:05.541 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.541 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.541 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:05.541 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.548606+0000", 2023-09-30T17:04:05.541 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3200000000000004e-07 2023-09-30T17:04:05.541 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.541 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.541 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:05.541 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.548636+0000", 2023-09-30T17:04:05.541 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9730000000000002e-05 2023-09-30T17:04:05.542 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.542 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.542 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:05.542 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.548650+0000", 2023-09-30T17:04:05.542 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3729e-05 2023-09-30T17:04:05.542 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.542 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.542 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.542 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.548657+0000", 2023-09-30T17:04:05.542 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5039999999999996e-06 2023-09-30T17:04:05.542 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.542 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.543 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:05.543 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.549147+0000", 2023-09-30T17:04:05.543 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00049002699999999998 2023-09-30T17:04:05.543 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.543 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.543 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:05.543 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.549197+0000", 2023-09-30T17:04:05.543 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9447999999999998e-05 2023-09-30T17:04:05.543 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.543 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.543 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:05.543 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.549290+0000", 2023-09-30T17:04:05.544 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.378e-05 2023-09-30T17:04:05.544 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.544 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.544 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:05.544 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.558996+0000", 2023-09-30T17:04:05.544 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0097054370000000008 2023-09-30T17:04:05.544 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.544 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.544 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:05.544 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.802281+0000", 2023-09-30T17:04:05.544 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.243285431 2023-09-30T17:04:05.544 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.545 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.545 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:05.545 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.802316+0000", 2023-09-30T17:04:05.545 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4820000000000002e-05 2023-09-30T17:04:05.545 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.545 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.545 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:05.545 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.802351+0000", 2023-09-30T17:04:05.545 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5151000000000003e-05 2023-09-30T17:04:05.545 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:05.545 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:05.545 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:05.546 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.546 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.546 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:89878 4.37 4:ef395e89:::100000001f8.00000020:head [write 2867200~4096,write 2945024~4096,write 3162112~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:05.546 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:02.556061+0000", 2023-09-30T17:04:05.546 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 2.8548705500000002, 2023-09-30T17:04:05.546 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.24981683599999999, 2023-09-30T17:04:05.546 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:05.546 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:05.546 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:05.546 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:05.546 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.547 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 89878 2023-09-30T17:04:05.547 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.547 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:05.547 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.547 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:05.547 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.556061+0000", 2023-09-30T17:04:05.547 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:05.547 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.547 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.547 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:05.547 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.556061+0000", 2023-09-30T17:04:05.547 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:05.548 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.548 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.548 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:05.548 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.556061+0000", 2023-09-30T17:04:05.548 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6700000000000003e-07 2023-09-30T17:04:05.548 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.548 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.548 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:05.548 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.556083+0000", 2023-09-30T17:04:05.548 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1919000000000001e-05 2023-09-30T17:04:05.548 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.548 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.548 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:05.549 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.556093+0000", 2023-09-30T17:04:05.549 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4839999999999993e-06 2023-09-30T17:04:05.549 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.549 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.549 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.549 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.556097+0000", 2023-09-30T17:04:05.549 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2830000000000003e-06 2023-09-30T17:04:05.549 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.549 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.549 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:05.549 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.556161+0000", 2023-09-30T17:04:05.549 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3899000000000006e-05 2023-09-30T17:04:05.550 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.550 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.550 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:05.550 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.556278+0000", 2023-09-30T17:04:05.551 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011723299999999999 2023-09-30T17:04:05.551 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.551 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.551 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:05.552 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.556466+0000", 2023-09-30T17:04:05.552 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00018789499999999999 2023-09-30T17:04:05.552 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.552 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.552 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:05.552 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.571892+0000", 2023-09-30T17:04:05.552 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015426103 2023-09-30T17:04:05.552 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.552 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.552 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:05.552 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.805826+0000", 2023-09-30T17:04:05.552 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.233933852 2023-09-30T17:04:05.553 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.553 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.553 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:05.553 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.805856+0000", 2023-09-30T17:04:05.553 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9794e-05 2023-09-30T17:04:05.553 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.553 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.553 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:05.553 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.805877+0000", 2023-09-30T17:04:05.553 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1807e-05 2023-09-30T17:04:05.553 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:05.553 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:05.554 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:05.554 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.554 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.554 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:89881 4.37 4:ef395e89:::100000001f8.00000020:head [write 778240~4096,write 1130496~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:05.554 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:02.556930+0000", 2023-09-30T17:04:05.554 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 2.8540007100000002, 2023-09-30T17:04:05.554 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.249031215, 2023-09-30T17:04:05.554 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:05.554 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:05.554 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:05.554 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:05.555 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.555 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 89881 2023-09-30T17:04:05.555 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.555 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:05.555 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.555 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:05.555 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.556930+0000", 2023-09-30T17:04:05.555 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:05.555 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.555 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.555 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:05.555 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.556930+0000", 2023-09-30T17:04:05.556 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:05.556 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.556 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.556 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:05.556 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.556931+0000", 2023-09-30T17:04:05.556 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7199999999999998e-07 2023-09-30T17:04:05.556 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.556 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.556 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:05.556 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.556943+0000", 2023-09-30T17:04:05.556 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2026e-05 2023-09-30T17:04:05.557 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.557 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.557 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:05.557 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.556953+0000", 2023-09-30T17:04:05.557 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0349e-05 2023-09-30T17:04:05.557 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.557 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.557 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.557 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.556961+0000", 2023-09-30T17:04:05.557 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.695e-06 2023-09-30T17:04:05.557 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.557 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.557 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:05.558 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.559024+0000", 2023-09-30T17:04:05.558 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0020625449999999998 2023-09-30T17:04:05.558 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.558 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.558 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:05.558 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.559092+0000", 2023-09-30T17:04:05.558 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8765999999999999e-05 2023-09-30T17:04:05.558 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.558 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.558 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:05.558 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.559233+0000", 2023-09-30T17:04:05.559 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014065 2023-09-30T17:04:05.559 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.559 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.559 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:05.559 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.577849+0000", 2023-09-30T17:04:05.559 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018615521999999999 2023-09-30T17:04:05.559 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.559 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.559 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:05.559 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.805900+0000", 2023-09-30T17:04:05.559 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.228051427 2023-09-30T17:04:05.559 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.559 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.560 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:05.560 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.805929+0000", 2023-09-30T17:04:05.560 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9142e-05 2023-09-30T17:04:05.560 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:05.560 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:05.560 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:05.560 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:02.805962+0000", 2023-09-30T17:04:05.560 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2421e-05 2023-09-30T17:04:05.560 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:05.560 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:05.560 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:05.560 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:05.561 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:05.561 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:04:05.561 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:04:05.562 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:05.553+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:05.652 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:05.651+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:05.753 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:05.753+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:05.792 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:04:05.793 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:04:05.793 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.793 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97615 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:05.793 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.330400+0000", 2023-09-30T17:04:05.793 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.44038797499999999, 2023-09-30T17:04:05.793 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.44041685800000002, 2023-09-30T17:04:05.793 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:05.793 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:05.793 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:05.793 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:05.794 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.794 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97615 2023-09-30T17:04:05.794 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.794 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:05.794 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.794 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:05.794 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.330400+0000", 2023-09-30T17:04:05.794 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.794 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.794 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.794 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:05.795 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.330400+0000", 2023-09-30T17:04:05.795 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.795 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.795 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.795 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:05.795 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.330401+0000", 2023-09-30T17:04:05.795 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3500000000000002e-07 2023-09-30T17:04:05.795 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.795 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.795 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:05.795 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.330412+0000", 2023-09-30T17:04:05.795 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.19e-05 2023-09-30T17:04:05.796 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.796 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.796 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:05.796 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.330418+0000", 2023-09-30T17:04:05.796 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8649999999999998e-06 2023-09-30T17:04:05.796 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.796 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.796 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.796 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.330422+0000", 2023-09-30T17:04:05.796 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5480000000000002e-06 2023-09-30T17:04:05.796 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.796 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:05.797 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.797 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.797 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.797 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98460 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:05.797 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.587883+0000", 2023-09-30T17:04:05.797 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.18290456399999999, 2023-09-30T17:04:05.797 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.183005641, 2023-09-30T17:04:05.797 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:05.797 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:05.797 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:05.797 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:05.798 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.798 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98460 2023-09-30T17:04:05.798 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.798 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:05.798 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.798 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:05.798 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.587883+0000", 2023-09-30T17:04:05.798 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.798 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.798 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.798 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:05.799 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.587883+0000", 2023-09-30T17:04:05.799 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.799 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.799 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.799 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:05.799 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.587884+0000", 2023-09-30T17:04:05.799 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4700000000000002e-07 2023-09-30T17:04:05.799 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.799 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.799 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:05.799 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.587898+0000", 2023-09-30T17:04:05.799 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3723999999999999e-05 2023-09-30T17:04:05.800 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.800 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.800 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:05.800 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.587906+0000", 2023-09-30T17:04:05.800 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1370000000000002e-06 2023-09-30T17:04:05.800 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.800 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.800 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.800 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.587912+0000", 2023-09-30T17:04:05.800 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.224e-06 2023-09-30T17:04:05.800 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.800 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:05.801 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.801 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.801 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.801 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98840 4.6 4.8232b686 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:05.801 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.704401+0000", 2023-09-30T17:04:05.801 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.066386824999999997, 2023-09-30T17:04:05.801 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.066557595999999997, 2023-09-30T17:04:05.801 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:05.801 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:05.801 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:05.801 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:05.801 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.802 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98840 2023-09-30T17:04:05.802 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.802 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:05.802 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.802 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:05.802 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.704401+0000", 2023-09-30T17:04:05.802 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.802 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.802 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.802 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:05.802 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.704401+0000", 2023-09-30T17:04:05.803 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.803 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.803 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.803 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:05.803 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.704402+0000", 2023-09-30T17:04:05.803 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9299999999999998e-07 2023-09-30T17:04:05.803 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.803 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.803 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:05.803 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.704410+0000", 2023-09-30T17:04:05.803 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5900000000000008e-06 2023-09-30T17:04:05.803 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.804 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.804 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:05.804 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.704417+0000", 2023-09-30T17:04:05.804 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2480000000000001e-06 2023-09-30T17:04:05.804 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.804 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.804 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.804 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.704422+0000", 2023-09-30T17:04:05.804 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0490000000000003e-06 2023-09-30T17:04:05.804 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.804 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:05.804 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.805 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.805 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.805 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98856 4.e 4.c27217ce (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:05.805 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.712255+0000", 2023-09-30T17:04:05.805 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.058533175999999999, 2023-09-30T17:04:05.805 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.058775836999999997, 2023-09-30T17:04:05.805 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:05.805 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:05.805 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:05.805 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:05.805 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.805 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98856 2023-09-30T17:04:05.806 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.806 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:05.806 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.806 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:05.806 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.712255+0000", 2023-09-30T17:04:05.806 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.806 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.806 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.806 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:05.806 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.712255+0000", 2023-09-30T17:04:05.806 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.806 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.807 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.807 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:05.807 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.712256+0000", 2023-09-30T17:04:05.807 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3200000000000004e-07 2023-09-30T17:04:05.807 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.807 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.807 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:05.807 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.712276+0000", 2023-09-30T17:04:05.807 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.0726000000000001e-05 2023-09-30T17:04:05.807 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.807 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.807 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:05.808 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.712289+0000", 2023-09-30T17:04:05.808 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2830000000000001e-05 2023-09-30T17:04:05.808 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.808 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.808 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.808 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.712296+0000", 2023-09-30T17:04:05.808 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.041e-06 2023-09-30T17:04:05.808 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.808 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:05.808 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.808 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.808 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.809 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:98424 4.f e50/17 4:f2a80dfe:::100000001f8.00000019:head v 50'4672, mlcod=50'4664)", 2023-09-30T17:04:05.809 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.755815+0000", 2023-09-30T17:04:05.809 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.01497272, 2023-09-30T17:04:05.809 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.015274920000000001, 2023-09-30T17:04:05.809 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:05.809 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:05.809 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:05.809 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.809 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:05.809 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.755815+0000", 2023-09-30T17:04:05.809 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.810 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.810 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.810 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:05.810 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.755815+0000", 2023-09-30T17:04:05.810 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.810 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.810 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.810 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:05.810 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.755816+0000", 2023-09-30T17:04:05.810 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8799999999999999e-07 2023-09-30T17:04:05.811 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.811 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.811 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:05.811 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.755827+0000", 2023-09-30T17:04:05.811 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1168e-05 2023-09-30T17:04:05.811 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.811 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.811 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:05.811 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.755831+0000", 2023-09-30T17:04:05.811 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1819999999999999e-06 2023-09-30T17:04:05.811 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.812 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.812 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.812 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.755834+0000", 2023-09-30T17:04:05.812 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.1049999999999999e-06 2023-09-30T17:04:05.812 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.812 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.812 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:05.812 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.757356+0000", 2023-09-30T17:04:05.812 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0015224539999999999 2023-09-30T17:04:05.812 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.812 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.812 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:05.813 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.757378+0000", 2023-09-30T17:04:05.813 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1121e-05 2023-09-30T17:04:05.813 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.813 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:05.813 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.813 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.813 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.813 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97756 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:05.813 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.376281+0000", 2023-09-30T17:04:05.813 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.39450660999999998, 2023-09-30T17:04:05.813 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39488000499999998, 2023-09-30T17:04:05.813 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:05.814 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:05.814 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:05.814 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:05.814 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.814 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97756 2023-09-30T17:04:05.814 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.814 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:05.814 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.814 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:05.814 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.376281+0000", 2023-09-30T17:04:05.815 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.815 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.815 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.815 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:05.815 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.376281+0000", 2023-09-30T17:04:05.815 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.815 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.815 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.815 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:05.815 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.376282+0000", 2023-09-30T17:04:05.815 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8800000000000003e-07 2023-09-30T17:04:05.815 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.816 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.816 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:05.816 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.376294+0000", 2023-09-30T17:04:05.816 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1780000000000001e-05 2023-09-30T17:04:05.816 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.816 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.816 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:05.816 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.376298+0000", 2023-09-30T17:04:05.816 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6330000000000004e-06 2023-09-30T17:04:05.816 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.816 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.816 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.816 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.376302+0000", 2023-09-30T17:04:05.817 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5429999999999998e-06 2023-09-30T17:04:05.817 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.817 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:05.817 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.817 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.817 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.817 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97808 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:05.817 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.387523+0000", 2023-09-30T17:04:05.817 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.38326526100000002, 2023-09-30T17:04:05.817 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.38372510500000001, 2023-09-30T17:04:05.817 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:05.817 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:05.818 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:05.818 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:05.818 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.818 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97808 2023-09-30T17:04:05.818 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.818 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:05.818 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.818 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:05.818 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.387523+0000", 2023-09-30T17:04:05.818 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.818 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.819 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.819 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:05.819 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.387523+0000", 2023-09-30T17:04:05.819 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.819 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.819 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.819 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:05.819 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.389277+0000", 2023-09-30T17:04:05.819 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001754622 2023-09-30T17:04:05.819 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.819 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.819 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:05.820 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.389297+0000", 2023-09-30T17:04:05.820 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9823e-05 2023-09-30T17:04:05.820 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.820 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.820 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:05.820 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.389307+0000", 2023-09-30T17:04:05.820 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.9129999999999998e-06 2023-09-30T17:04:05.820 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.820 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.820 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.820 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.389315+0000", 2023-09-30T17:04:05.820 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9969999999999998e-06 2023-09-30T17:04:05.821 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.821 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:05.821 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.821 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.821 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.821 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98041 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:05.821 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.456865+0000", 2023-09-30T17:04:05.821 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.31392288600000001, 2023-09-30T17:04:05.821 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.31444304099999998, 2023-09-30T17:04:05.821 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:05.821 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:05.821 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:05.822 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:05.822 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.822 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98041 2023-09-30T17:04:05.822 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.822 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:05.822 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.822 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:05.822 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.456865+0000", 2023-09-30T17:04:05.822 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.822 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.822 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.822 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:05.823 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.456865+0000", 2023-09-30T17:04:05.823 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.823 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.823 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.823 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:05.823 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.456866+0000", 2023-09-30T17:04:05.823 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7399999999999998e-07 2023-09-30T17:04:05.823 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.823 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.823 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:05.823 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.456877+0000", 2023-09-30T17:04:05.823 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1395e-05 2023-09-30T17:04:05.824 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.824 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.824 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:05.824 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.456886+0000", 2023-09-30T17:04:05.824 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5339999999999999e-06 2023-09-30T17:04:05.824 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.824 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.824 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.824 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.456892+0000", 2023-09-30T17:04:05.824 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0220000000000001e-06 2023-09-30T17:04:05.824 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.824 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:05.824 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.825 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.825 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.825 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98102 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:05.825 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.476583+0000", 2023-09-30T17:04:05.825 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.29420539299999998, 2023-09-30T17:04:05.825 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.29478649899999998, 2023-09-30T17:04:05.825 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:05.825 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:05.825 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:05.825 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:05.825 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.825 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98102 2023-09-30T17:04:05.826 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.826 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:05.826 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.826 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:05.826 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.476583+0000", 2023-09-30T17:04:05.826 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.826 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.826 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.826 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:05.826 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.476583+0000", 2023-09-30T17:04:05.826 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.827 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.827 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.827 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:05.827 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.476583+0000", 2023-09-30T17:04:05.827 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9200000000000001e-07 2023-09-30T17:04:05.827 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.827 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.827 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:05.827 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.476597+0000", 2023-09-30T17:04:05.827 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3349e-05 2023-09-30T17:04:05.828 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.828 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.828 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:05.828 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.476605+0000", 2023-09-30T17:04:05.828 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0760000000000003e-06 2023-09-30T17:04:05.828 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.828 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.828 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.828 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.476611+0000", 2023-09-30T17:04:05.828 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4230000000000002e-06 2023-09-30T17:04:05.828 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.829 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:05.829 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.829 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.829 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.829 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98149 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:05.829 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.502582+0000", 2023-09-30T17:04:05.829 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.26820568, 2023-09-30T17:04:05.829 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.26884567999999998, 2023-09-30T17:04:05.829 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:05.829 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:05.830 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:05.830 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:05.830 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.830 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98149 2023-09-30T17:04:05.830 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.830 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:05.830 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.830 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:05.830 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.502582+0000", 2023-09-30T17:04:05.830 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.831 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.831 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.831 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:05.831 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.502582+0000", 2023-09-30T17:04:05.831 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.831 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.831 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.831 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:05.831 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.503742+0000", 2023-09-30T17:04:05.831 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001159899 2023-09-30T17:04:05.831 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.832 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.832 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:05.832 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.503763+0000", 2023-09-30T17:04:05.832 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.0519000000000001e-05 2023-09-30T17:04:05.832 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.832 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.832 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:05.832 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.503775+0000", 2023-09-30T17:04:05.832 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1894e-05 2023-09-30T17:04:05.832 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.832 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.832 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.833 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.503783+0000", 2023-09-30T17:04:05.833 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2600000000000005e-06 2023-09-30T17:04:05.833 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.833 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:05.833 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.833 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.833 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.833 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98501 4.36 4.670445b6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:05.833 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.600421+0000", 2023-09-30T17:04:05.833 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.17036664200000001, 2023-09-30T17:04:05.833 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.17106144300000001, 2023-09-30T17:04:05.834 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:05.834 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:05.834 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:05.834 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:05.834 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.834 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98501 2023-09-30T17:04:05.834 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.834 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:05.834 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.834 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:05.834 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.600421+0000", 2023-09-30T17:04:05.834 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.835 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.835 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.835 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:05.835 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.600421+0000", 2023-09-30T17:04:05.835 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.835 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.835 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.835 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:05.835 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.601573+0000", 2023-09-30T17:04:05.835 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0011517400000000001 2023-09-30T17:04:05.835 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.835 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.835 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:05.836 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.601593+0000", 2023-09-30T17:04:05.836 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.0047999999999998e-05 2023-09-30T17:04:05.836 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.836 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.836 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:05.836 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.601606+0000", 2023-09-30T17:04:05.836 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2340999999999999e-05 2023-09-30T17:04:05.836 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.836 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.836 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.836 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.601613+0000", 2023-09-30T17:04:05.837 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3139999999999998e-06 2023-09-30T17:04:05.837 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.837 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:05.837 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.837 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.837 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.837 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98896 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:05.837 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.723921+0000", 2023-09-30T17:04:05.837 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.046867036000000001, 2023-09-30T17:04:05.837 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.047617317999999999, 2023-09-30T17:04:05.837 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:05.838 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:05.838 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:05.838 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:05.838 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.838 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98896 2023-09-30T17:04:05.838 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.838 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:05.838 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.838 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:05.838 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.723921+0000", 2023-09-30T17:04:05.838 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.838 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.841 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.841 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:05.841 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.723921+0000", 2023-09-30T17:04:05.841 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.841 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.841 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.841 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:05.842 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.723922+0000", 2023-09-30T17:04:05.842 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7199999999999998e-07 2023-09-30T17:04:05.842 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.842 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.842 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:05.842 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.723958+0000", 2023-09-30T17:04:05.842 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6186000000000002e-05 2023-09-30T17:04:05.842 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.842 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.842 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:05.842 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.723967+0000", 2023-09-30T17:04:05.842 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1449999999999997e-06 2023-09-30T17:04:05.843 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.843 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.843 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.843 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.723975+0000", 2023-09-30T17:04:05.843 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6480000000000003e-06 2023-09-30T17:04:05.843 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.843 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:05.843 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.843 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.843 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.843 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97586 4.36 4:6fa85f86:::100000001f8.00000013:head [write 4083712~4096 in=4096b,write 4096000~4096 in=4096b,write 4116480~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:05.844 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.321640+0000", 2023-09-30T17:04:05.844 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.44914792100000001, 2023-09-30T17:04:05.844 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.44998075999999998, 2023-09-30T17:04:05.844 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:05.844 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:05.844 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:05.844 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:05.844 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.844 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97586 2023-09-30T17:04:05.844 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.844 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:05.844 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.845 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:05.845 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.321640+0000", 2023-09-30T17:04:05.845 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.845 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.845 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.845 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:05.845 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.321640+0000", 2023-09-30T17:04:05.845 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.845 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.845 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.845 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:05.845 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.321641+0000", 2023-09-30T17:04:05.846 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0900000000000002e-07 2023-09-30T17:04:05.846 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.846 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.846 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:05.846 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.321654+0000", 2023-09-30T17:04:05.846 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3743e-05 2023-09-30T17:04:05.846 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.846 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.846 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:05.846 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.321663+0000", 2023-09-30T17:04:05.847 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2500000000000006e-06 2023-09-30T17:04:05.847 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.847 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.847 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.847 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.321670+0000", 2023-09-30T17:04:05.847 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1169999999999998e-06 2023-09-30T17:04:05.847 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.847 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.847 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:05.847 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.756838+0000", 2023-09-30T17:04:05.847 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.43516785200000002 2023-09-30T17:04:05.847 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.848 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.848 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:05.848 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.756916+0000", 2023-09-30T17:04:05.848 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8255000000000002e-05 2023-09-30T17:04:05.848 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.848 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.848 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:05.848 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.757094+0000", 2023-09-30T17:04:05.848 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017836600000000001 2023-09-30T17:04:05.848 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.848 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:05.848 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.849 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.849 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.849 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97761 4.e 4.c27217ce (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:05.849 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.376308+0000", 2023-09-30T17:04:05.849 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.39448045300000001, 2023-09-30T17:04:05.849 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39538773799999999, 2023-09-30T17:04:05.849 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:05.849 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:05.849 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:05.849 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:05.849 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.850 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97761 2023-09-30T17:04:05.850 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.850 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:05.850 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.850 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:05.850 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.376308+0000", 2023-09-30T17:04:05.850 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.850 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.850 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.850 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:05.850 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.376308+0000", 2023-09-30T17:04:05.850 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.851 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.851 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.851 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:05.851 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.376308+0000", 2023-09-30T17:04:05.851 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4999999999999998e-07 2023-09-30T17:04:05.851 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.851 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.851 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:05.851 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.376318+0000", 2023-09-30T17:04:05.851 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0095000000000001e-05 2023-09-30T17:04:05.851 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.851 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.852 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:05.852 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.376322+0000", 2023-09-30T17:04:05.852 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6899999999999998e-06 2023-09-30T17:04:05.852 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.852 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.852 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.852 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.376325+0000", 2023-09-30T17:04:05.852 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.9390000000000002e-06 2023-09-30T17:04:05.852 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.852 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:05.852 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.853 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.853 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.853 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97875 4.6 4.8232b686 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:05.853 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.407668+0000", 2023-09-30T17:04:05.853 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.36311986400000001, 2023-09-30T17:04:05.853 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.364085824, 2023-09-30T17:04:05.853 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:05.853 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:05.853 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:05.853 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:05.853 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.854 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97875 2023-09-30T17:04:05.854 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.854 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:05.854 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.854 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:05.854 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.407668+0000", 2023-09-30T17:04:05.854 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.854 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.854 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.854 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:05.854 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.407668+0000", 2023-09-30T17:04:05.854 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.855 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.855 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.855 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:05.855 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.410539+0000", 2023-09-30T17:04:05.855 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0028712590000000001 2023-09-30T17:04:05.855 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.855 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.855 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:05.855 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.410565+0000", 2023-09-30T17:04:05.855 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.5502000000000001e-05 2023-09-30T17:04:05.855 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.855 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.856 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:05.856 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.410577+0000", 2023-09-30T17:04:05.856 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1857e-05 2023-09-30T17:04:05.856 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.856 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.856 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.856 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.410586+0000", 2023-09-30T17:04:05.856 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.4469999999999995e-06 2023-09-30T17:04:05.856 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.856 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:05.856 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.857 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.857 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.857 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97967 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:05.857 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.440250+0000", 2023-09-30T17:04:05.857 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.33053781900000001, 2023-09-30T17:04:05.857 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.33156025900000002, 2023-09-30T17:04:05.857 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:05.857 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:05.857 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:05.857 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:05.857 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.858 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97967 2023-09-30T17:04:05.858 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.858 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:05.858 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.858 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:05.858 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.440250+0000", 2023-09-30T17:04:05.858 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.858 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.858 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.858 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:05.858 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.440250+0000", 2023-09-30T17:04:05.859 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.859 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.859 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.859 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:05.859 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.440788+0000", 2023-09-30T17:04:05.859 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00053823399999999996 2023-09-30T17:04:05.859 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.859 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.859 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:05.859 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.440808+0000", 2023-09-30T17:04:05.859 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9168999999999999e-05 2023-09-30T17:04:05.860 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.860 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.860 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:05.860 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.440819+0000", 2023-09-30T17:04:05.860 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1581e-05 2023-09-30T17:04:05.860 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.860 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.860 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.860 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.440826+0000", 2023-09-30T17:04:05.860 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0999999999999998e-06 2023-09-30T17:04:05.860 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.861 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:05.861 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.861 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.861 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.861 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98103 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:05.861 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.476620+0000", 2023-09-30T17:04:05.861 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.29416790999999998, 2023-09-30T17:04:05.861 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.29524502499999999, 2023-09-30T17:04:05.861 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:05.861 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:05.861 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:05.861 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:05.862 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.862 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98103 2023-09-30T17:04:05.862 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.862 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:05.862 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.862 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:05.862 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.476620+0000", 2023-09-30T17:04:05.862 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.862 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.862 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.862 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:05.862 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.476620+0000", 2023-09-30T17:04:05.863 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.863 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.863 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.863 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:05.863 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.476920+0000", 2023-09-30T17:04:05.863 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00029955200000000002 2023-09-30T17:04:05.863 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.863 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.863 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:05.863 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.476937+0000", 2023-09-30T17:04:05.863 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7683e-05 2023-09-30T17:04:05.864 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.864 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.864 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:05.864 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.476949+0000", 2023-09-30T17:04:05.864 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1793999999999999e-05 2023-09-30T17:04:05.864 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.864 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.864 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.864 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.476956+0000", 2023-09-30T17:04:05.864 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0829999999999998e-06 2023-09-30T17:04:05.864 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.864 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:05.865 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.865 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.865 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.865 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98264 4.e 4.c27217ce (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:05.865 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.529873+0000", 2023-09-30T17:04:05.865 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.240915398, 2023-09-30T17:04:05.865 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.24205007100000001, 2023-09-30T17:04:05.865 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:05.865 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:05.865 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:05.865 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:05.866 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.866 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98264 2023-09-30T17:04:05.866 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.866 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:05.866 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.866 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:05.866 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.529873+0000", 2023-09-30T17:04:05.866 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.866 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.866 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.866 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:05.867 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.529873+0000", 2023-09-30T17:04:05.867 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.867 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.867 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.867 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:05.867 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.529873+0000", 2023-09-30T17:04:05.867 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7100000000000002e-07 2023-09-30T17:04:05.867 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.867 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.867 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:05.867 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.529886+0000", 2023-09-30T17:04:05.867 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2588e-05 2023-09-30T17:04:05.868 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.868 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.868 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:05.868 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.529893+0000", 2023-09-30T17:04:05.868 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.537e-06 2023-09-30T17:04:05.868 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.868 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.868 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.868 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.529899+0000", 2023-09-30T17:04:05.868 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4190000000000001e-06 2023-09-30T17:04:05.868 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.868 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:05.869 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.869 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.869 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.869 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98350 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:05.869 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.559269+0000", 2023-09-30T17:04:05.869 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.21151927500000001, 2023-09-30T17:04:05.869 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.21271578099999999, 2023-09-30T17:04:05.869 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:05.869 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:05.869 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:05.869 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:05.870 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.870 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98350 2023-09-30T17:04:05.870 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.870 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:05.870 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.870 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:05.870 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.559269+0000", 2023-09-30T17:04:05.870 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.870 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.870 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.870 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:05.870 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.559269+0000", 2023-09-30T17:04:05.871 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.871 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.871 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.871 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:05.871 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.559269+0000", 2023-09-30T17:04:05.871 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9100000000000004e-07 2023-09-30T17:04:05.871 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.871 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.871 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:05.871 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.559283+0000", 2023-09-30T17:04:05.871 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3471e-05 2023-09-30T17:04:05.872 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.872 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.872 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:05.872 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.559291+0000", 2023-09-30T17:04:05.872 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8290000000000008e-06 2023-09-30T17:04:05.872 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.872 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.872 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.872 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.559297+0000", 2023-09-30T17:04:05.872 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3879999999999997e-06 2023-09-30T17:04:05.872 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.873 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:05.873 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.873 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.873 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.873 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98502 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:05.873 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.601625+0000", 2023-09-30T17:04:05.873 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.169163271, 2023-09-30T17:04:05.873 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.17041499199999999, 2023-09-30T17:04:05.873 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:05.873 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:05.873 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:05.874 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:05.874 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.874 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98502 2023-09-30T17:04:05.874 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.874 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:05.874 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.874 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:05.874 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.601625+0000", 2023-09-30T17:04:05.874 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.874 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.874 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.874 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:05.875 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.601625+0000", 2023-09-30T17:04:05.875 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.875 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.875 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.875 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:05.875 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.601805+0000", 2023-09-30T17:04:05.875 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00018002299999999999 2023-09-30T17:04:05.875 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.875 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.875 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:05.875 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.601824+0000", 2023-09-30T17:04:05.876 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9055999999999998e-05 2023-09-30T17:04:05.876 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.876 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.876 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:05.876 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.601833+0000", 2023-09-30T17:04:05.876 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.4860000000000003e-06 2023-09-30T17:04:05.876 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.876 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.876 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.876 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.601841+0000", 2023-09-30T17:04:05.877 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3719999999999999e-06 2023-09-30T17:04:05.877 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.877 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:05.877 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.877 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.877 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.877 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98797 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:05.877 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.695152+0000", 2023-09-30T17:04:05.877 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.075636148, 2023-09-30T17:04:05.878 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.076943903999999994, 2023-09-30T17:04:05.878 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:05.878 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:05.878 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:05.878 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:05.878 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.878 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98797 2023-09-30T17:04:05.878 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.878 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:05.878 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.878 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:05.879 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.695152+0000", 2023-09-30T17:04:05.879 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.879 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.879 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.879 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:05.879 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.695152+0000", 2023-09-30T17:04:05.879 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.879 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.879 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.879 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:05.880 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.697528+0000", 2023-09-30T17:04:05.880 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0023763719999999999 2023-09-30T17:04:05.880 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.880 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.880 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:05.880 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.697552+0000", 2023-09-30T17:04:05.880 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.3269e-05 2023-09-30T17:04:05.880 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.880 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.881 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:05.881 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.697563+0000", 2023-09-30T17:04:05.881 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1943999999999999e-05 2023-09-30T17:04:05.881 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.881 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.881 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.881 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.697572+0000", 2023-09-30T17:04:05.881 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3480000000000004e-06 2023-09-30T17:04:05.881 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.881 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:05.881 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.881 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.882 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.882 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98897 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:05.882 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.724204+0000", 2023-09-30T17:04:05.882 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.046584028, 2023-09-30T17:04:05.882 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.047971236, 2023-09-30T17:04:05.882 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:05.882 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:05.882 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:05.882 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:05.883 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.883 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98897 2023-09-30T17:04:05.883 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.883 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:05.883 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.883 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:05.883 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.724204+0000", 2023-09-30T17:04:05.883 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.883 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.883 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.883 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:05.884 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.724204+0000", 2023-09-30T17:04:05.884 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.884 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.884 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.884 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:05.884 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.724205+0000", 2023-09-30T17:04:05.884 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3900000000000004e-07 2023-09-30T17:04:05.884 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.884 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.884 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:05.884 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.724248+0000", 2023-09-30T17:04:05.885 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3380000000000001e-05 2023-09-30T17:04:05.885 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.885 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.885 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:05.885 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.724259+0000", 2023-09-30T17:04:05.885 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0479000000000001e-05 2023-09-30T17:04:05.885 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.885 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.885 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.885 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.724265+0000", 2023-09-30T17:04:05.885 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9149999999999999e-06 2023-09-30T17:04:05.885 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.886 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:05.886 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.886 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.886 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.886 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98956 4.27 4.df99e167 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:05.886 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.744183+0000", 2023-09-30T17:04:05.886 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.026604979000000001, 2023-09-30T17:04:05.886 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.028047287000000001, 2023-09-30T17:04:05.886 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:05.886 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:05.886 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:05.887 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:05.887 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.887 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98956 2023-09-30T17:04:05.887 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.887 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:05.887 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.887 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:05.887 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.744183+0000", 2023-09-30T17:04:05.887 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.887 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.887 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.887 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:05.888 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.744183+0000", 2023-09-30T17:04:05.888 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.888 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.888 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.888 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:05.888 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.744184+0000", 2023-09-30T17:04:05.888 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3600000000000002e-07 2023-09-30T17:04:05.888 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.888 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.888 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:05.888 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.744198+0000", 2023-09-30T17:04:05.888 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3804e-05 2023-09-30T17:04:05.889 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.889 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.889 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:05.889 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.744213+0000", 2023-09-30T17:04:05.889 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5661000000000001e-05 2023-09-30T17:04:05.889 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.889 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.889 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.889 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.744223+0000", 2023-09-30T17:04:05.889 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.5750000000000007e-06 2023-09-30T17:04:05.889 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.890 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:05.890 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.890 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.890 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.890 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97677 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:05.890 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.349980+0000", 2023-09-30T17:04:05.890 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.42080833099999998, 2023-09-30T17:04:05.890 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.42230448300000001, 2023-09-30T17:04:05.890 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:05.890 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:05.890 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:05.890 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:05.891 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.891 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97677 2023-09-30T17:04:05.891 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.891 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:05.891 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.891 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:05.891 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.349980+0000", 2023-09-30T17:04:05.891 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.891 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.891 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.892 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:05.892 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.349980+0000", 2023-09-30T17:04:05.892 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.892 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.892 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.892 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:05.892 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.351706+0000", 2023-09-30T17:04:05.892 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001725847 2023-09-30T17:04:05.892 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.892 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.892 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:05.892 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.351728+0000", 2023-09-30T17:04:05.892 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2099999999999998e-05 2023-09-30T17:04:05.893 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.893 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.893 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:05.893 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.351740+0000", 2023-09-30T17:04:05.893 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2115e-05 2023-09-30T17:04:05.893 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.893 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.893 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.893 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.351747+0000", 2023-09-30T17:04:05.893 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4059999999999999e-06 2023-09-30T17:04:05.893 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.894 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:05.894 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.894 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.894 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.894 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97968 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:05.894 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.440838+0000", 2023-09-30T17:04:05.894 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.32994994100000002, 2023-09-30T17:04:05.894 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.33149974900000001, 2023-09-30T17:04:05.894 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:05.894 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:05.894 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:05.894 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:05.895 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.895 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97968 2023-09-30T17:04:05.895 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.895 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:05.895 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.895 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:05.895 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.440838+0000", 2023-09-30T17:04:05.895 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.895 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.895 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.895 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:05.895 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.440838+0000", 2023-09-30T17:04:05.896 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.896 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.896 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.896 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:05.896 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.440839+0000", 2023-09-30T17:04:05.896 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2099999999999996e-07 2023-09-30T17:04:05.896 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.896 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.896 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:05.896 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.440851+0000", 2023-09-30T17:04:05.896 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2243e-05 2023-09-30T17:04:05.897 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.897 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.897 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:05.897 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.440858+0000", 2023-09-30T17:04:05.897 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8299999999999998e-06 2023-09-30T17:04:05.897 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.897 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.897 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.897 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.440863+0000", 2023-09-30T17:04:05.897 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1189999999999996e-06 2023-09-30T17:04:05.897 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.897 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:05.897 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.898 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.898 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.898 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98265 4.36 4.670445b6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:05.898 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.529907+0000", 2023-09-30T17:04:05.898 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.24088067699999999, 2023-09-30T17:04:05.898 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.24248593199999999, 2023-09-30T17:04:05.898 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:05.898 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:05.898 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:05.898 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:05.898 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.898 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98265 2023-09-30T17:04:05.899 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.899 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:05.899 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.899 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:05.899 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.529907+0000", 2023-09-30T17:04:05.899 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.899 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.899 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.899 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:05.899 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.529907+0000", 2023-09-30T17:04:05.899 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.899 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.900 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.900 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:05.900 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.529908+0000", 2023-09-30T17:04:05.900 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1600000000000001e-07 2023-09-30T17:04:05.900 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.900 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.900 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:05.900 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.529921+0000", 2023-09-30T17:04:05.900 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3312999999999999e-05 2023-09-30T17:04:05.900 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.900 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.900 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:05.901 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.529928+0000", 2023-09-30T17:04:05.901 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9890000000000003e-06 2023-09-30T17:04:05.901 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.901 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.901 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.901 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.529934+0000", 2023-09-30T17:04:05.901 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5160000000000002e-06 2023-09-30T17:04:05.901 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.901 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:05.901 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.901 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.902 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.902 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98688 4.27 4:e68799fb:::100000001f8.00000018:head [write 3260416~4096 in=4096b,write 3624960~4096 in=4096b,write 3657728~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:05.902 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.660903+0000", 2023-09-30T17:04:05.902 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.109885528, 2023-09-30T17:04:05.902 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.111552494, 2023-09-30T17:04:05.902 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:05.902 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:05.902 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:05.902 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:05.902 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.902 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98688 2023-09-30T17:04:05.902 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.903 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:05.903 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.903 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:05.903 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.660903+0000", 2023-09-30T17:04:05.903 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.903 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.903 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.903 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:05.903 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.660903+0000", 2023-09-30T17:04:05.903 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.903 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.903 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.904 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:05.904 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.662471+0000", 2023-09-30T17:04:05.904 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001568142 2023-09-30T17:04:05.904 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.904 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.904 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:05.904 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.662485+0000", 2023-09-30T17:04:05.904 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4623e-05 2023-09-30T17:04:05.904 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.904 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.904 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:05.904 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.662493+0000", 2023-09-30T17:04:05.905 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6210000000000004e-06 2023-09-30T17:04:05.905 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.905 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.905 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.905 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.662498+0000", 2023-09-30T17:04:05.905 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2830000000000001e-06 2023-09-30T17:04:05.905 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.905 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.905 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:05.905 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.751199+0000", 2023-09-30T17:04:05.905 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.088700972000000003 2023-09-30T17:04:05.905 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.906 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.906 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:05.906 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.751279+0000", 2023-09-30T17:04:05.906 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9429000000000001e-05 2023-09-30T17:04:05.906 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.906 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:05.906 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.906 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.906 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.906 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98957 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:05.907 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.744237+0000", 2023-09-30T17:04:05.907 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.026551548000000001, 2023-09-30T17:04:05.907 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.028311925000000002, 2023-09-30T17:04:05.907 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:05.907 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:05.907 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:05.907 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:05.907 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.907 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98957 2023-09-30T17:04:05.907 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.907 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:05.908 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.908 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:05.908 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.744237+0000", 2023-09-30T17:04:05.908 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.908 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.908 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.908 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:05.908 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.744237+0000", 2023-09-30T17:04:05.908 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.908 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.908 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.908 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:05.909 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.744237+0000", 2023-09-30T17:04:05.909 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2499999999999995e-07 2023-09-30T17:04:05.909 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.909 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.909 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:05.909 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.744250+0000", 2023-09-30T17:04:05.909 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2636999999999999e-05 2023-09-30T17:04:05.909 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.909 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.909 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:05.910 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.744353+0000", 2023-09-30T17:04:05.910 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000103545 2023-09-30T17:04:05.910 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.910 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.910 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.910 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.744366+0000", 2023-09-30T17:04:05.910 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2629000000000001e-05 2023-09-30T17:04:05.910 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.910 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:05.910 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.910 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.911 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.911 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97618 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:05.911 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.330427+0000", 2023-09-30T17:04:05.911 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.440361002, 2023-09-30T17:04:05.911 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.442192105, 2023-09-30T17:04:05.911 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:05.911 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:05.911 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:05.911 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:05.911 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.911 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97618 2023-09-30T17:04:05.911 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.912 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:05.912 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.912 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:05.912 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.330427+0000", 2023-09-30T17:04:05.912 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.912 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.912 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.912 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:05.912 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.330427+0000", 2023-09-30T17:04:05.912 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.912 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.912 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.912 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:05.913 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.332162+0000", 2023-09-30T17:04:05.913 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001735112 2023-09-30T17:04:05.913 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.913 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.913 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:05.913 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.332178+0000", 2023-09-30T17:04:05.913 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6274999999999999e-05 2023-09-30T17:04:05.913 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.913 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.913 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:05.913 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.332188+0000", 2023-09-30T17:04:05.913 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.4229999999999994e-06 2023-09-30T17:04:05.914 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.914 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.914 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.914 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.332195+0000", 2023-09-30T17:04:05.914 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1709999999999996e-06 2023-09-30T17:04:05.914 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.914 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:05.914 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.914 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.914 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.914 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97916 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:05.915 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.418824+0000", 2023-09-30T17:04:05.915 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.35196444500000001, 2023-09-30T17:04:05.915 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.35386100799999998, 2023-09-30T17:04:05.915 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:05.915 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:05.915 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:05.915 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:05.915 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.915 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97916 2023-09-30T17:04:05.915 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.915 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:05.915 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.916 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:05.916 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.418824+0000", 2023-09-30T17:04:05.916 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.916 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.916 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.916 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:05.916 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.418824+0000", 2023-09-30T17:04:05.916 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.916 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.916 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.916 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:05.917 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.418864+0000", 2023-09-30T17:04:05.917 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0346000000000003e-05 2023-09-30T17:04:05.917 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.917 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.917 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:05.917 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.418876+0000", 2023-09-30T17:04:05.917 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.223e-05 2023-09-30T17:04:05.917 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.917 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.917 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:05.917 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.418885+0000", 2023-09-30T17:04:05.917 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3739999999999998e-06 2023-09-30T17:04:05.918 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.918 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.918 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.918 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.418891+0000", 2023-09-30T17:04:05.918 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3260000000000001e-06 2023-09-30T17:04:05.918 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.918 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:05.918 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.918 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.918 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.918 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98129 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:05.918 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.491243+0000", 2023-09-30T17:04:05.919 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.27954521399999999, 2023-09-30T17:04:05.919 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.28150976599999999, 2023-09-30T17:04:05.919 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:05.919 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:05.919 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:05.919 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:05.919 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.919 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98129 2023-09-30T17:04:05.919 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.919 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:05.919 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.920 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:05.920 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.491243+0000", 2023-09-30T17:04:05.920 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.920 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.920 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.920 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:05.920 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.491243+0000", 2023-09-30T17:04:05.920 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.920 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.920 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.920 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:05.920 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.491985+0000", 2023-09-30T17:04:05.921 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00074238899999999998 2023-09-30T17:04:05.921 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.921 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.921 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:05.921 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.492005+0000", 2023-09-30T17:04:05.921 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9437e-05 2023-09-30T17:04:05.921 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.921 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.921 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:05.921 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.492017+0000", 2023-09-30T17:04:05.921 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2602999999999999e-05 2023-09-30T17:04:05.921 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.922 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.922 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.922 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.492025+0000", 2023-09-30T17:04:05.922 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3420000000000002e-06 2023-09-30T17:04:05.922 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.922 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:05.922 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.922 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.922 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.922 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98189 4.36 4.670445b6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:05.922 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.511319+0000", 2023-09-30T17:04:05.922 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.25946855499999999, 2023-09-30T17:04:05.923 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.26150187800000002, 2023-09-30T17:04:05.923 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:05.923 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:05.923 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:05.923 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:05.923 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.923 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98189 2023-09-30T17:04:05.923 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.923 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:05.923 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.923 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:05.924 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.511319+0000", 2023-09-30T17:04:05.924 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.924 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.924 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.924 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:05.924 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.511319+0000", 2023-09-30T17:04:05.924 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.924 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.924 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.924 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:05.924 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.511320+0000", 2023-09-30T17:04:05.925 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8500000000000001e-07 2023-09-30T17:04:05.925 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.925 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.925 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:05.925 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.511333+0000", 2023-09-30T17:04:05.925 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2544000000000001e-05 2023-09-30T17:04:05.925 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.925 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.925 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:05.925 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.511339+0000", 2023-09-30T17:04:05.925 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5150000000000003e-06 2023-09-30T17:04:05.925 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.926 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.926 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.926 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.511345+0000", 2023-09-30T17:04:05.926 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1959999999999996e-06 2023-09-30T17:04:05.926 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.926 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:05.926 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.926 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.926 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.926 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98206 4.e 4.c27217ce (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:05.926 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.513530+0000", 2023-09-30T17:04:05.926 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.25725785299999998, 2023-09-30T17:04:05.927 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.259400662, 2023-09-30T17:04:05.927 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:05.927 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:05.927 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:05.927 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:05.927 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.927 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98206 2023-09-30T17:04:05.927 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.927 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:05.927 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.927 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:05.927 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.513530+0000", 2023-09-30T17:04:05.928 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.928 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.928 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.928 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:05.928 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.513530+0000", 2023-09-30T17:04:05.928 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.928 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.928 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.928 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:05.928 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.517163+0000", 2023-09-30T17:04:05.928 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0036326729999999999 2023-09-30T17:04:05.929 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.929 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.929 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:05.929 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.517181+0000", 2023-09-30T17:04:05.929 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7893e-05 2023-09-30T17:04:05.929 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.929 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.929 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:05.929 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.517191+0000", 2023-09-30T17:04:05.929 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0631999999999999e-05 2023-09-30T17:04:05.929 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.929 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.930 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.930 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.517199+0000", 2023-09-30T17:04:05.930 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8879999999999997e-06 2023-09-30T17:04:05.930 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.930 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:05.930 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.930 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.930 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.930 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98351 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:05.930 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.559307+0000", 2023-09-30T17:04:05.930 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.21148134099999999, 2023-09-30T17:04:05.930 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.21369638899999999, 2023-09-30T17:04:05.931 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:05.931 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:05.931 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:05.931 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:05.931 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.931 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98351 2023-09-30T17:04:05.931 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.931 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:05.931 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.931 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:05.931 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.559307+0000", 2023-09-30T17:04:05.932 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.932 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.932 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.932 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:05.932 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.559307+0000", 2023-09-30T17:04:05.932 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.932 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.932 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.932 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:05.932 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.561165+0000", 2023-09-30T17:04:05.932 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001858557 2023-09-30T17:04:05.933 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.933 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.933 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:05.933 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.561182+0000", 2023-09-30T17:04:05.933 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7203000000000001e-05 2023-09-30T17:04:05.933 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.933 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.933 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:05.933 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.561194+0000", 2023-09-30T17:04:05.933 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1107000000000001e-05 2023-09-30T17:04:05.933 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.933 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.934 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.934 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.561201+0000", 2023-09-30T17:04:05.934 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4699999999999996e-06 2023-09-30T17:04:05.934 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.934 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:05.934 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.934 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.934 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.934 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98504 4.36 4.670445b6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:05.934 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.601916+0000", 2023-09-30T17:04:05.935 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.168871719, 2023-09-30T17:04:05.935 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.171174461, 2023-09-30T17:04:05.935 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:05.935 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:05.935 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:05.935 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:05.935 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.935 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98504 2023-09-30T17:04:05.935 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.935 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:05.935 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.935 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:05.936 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.601916+0000", 2023-09-30T17:04:05.936 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.936 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.936 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.936 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:05.936 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.601916+0000", 2023-09-30T17:04:05.936 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.936 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.936 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.936 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:05.936 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.602097+0000", 2023-09-30T17:04:05.937 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00018035800000000001 2023-09-30T17:04:05.937 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.937 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.937 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:05.937 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.602116+0000", 2023-09-30T17:04:05.937 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9066999999999999e-05 2023-09-30T17:04:05.937 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.937 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.937 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:05.937 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.602125+0000", 2023-09-30T17:04:05.937 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.6050000000000004e-06 2023-09-30T17:04:05.938 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.938 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.938 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.938 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.602133+0000", 2023-09-30T17:04:05.938 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2690000000000002e-06 2023-09-30T17:04:05.938 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.938 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:05.938 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.938 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.938 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.938 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98689 4.e 4.c27217ce (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:05.939 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.662510+0000", 2023-09-30T17:04:05.939 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.108277549, 2023-09-30T17:04:05.939 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.110652996, 2023-09-30T17:04:05.939 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:05.939 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:05.939 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:05.939 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:05.939 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.939 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98689 2023-09-30T17:04:05.939 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.939 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:05.940 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.940 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:05.940 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.662510+0000", 2023-09-30T17:04:05.940 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.940 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.940 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.940 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:05.940 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.662510+0000", 2023-09-30T17:04:05.940 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.940 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.940 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.940 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:05.941 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.664432+0000", 2023-09-30T17:04:05.941 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0019217609999999999 2023-09-30T17:04:05.941 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.941 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.941 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:05.941 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.664449+0000", 2023-09-30T17:04:05.941 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6860000000000001e-05 2023-09-30T17:04:05.941 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.941 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.941 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:05.941 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.664456+0000", 2023-09-30T17:04:05.942 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.362e-06 2023-09-30T17:04:05.942 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.942 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.942 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.942 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.664464+0000", 2023-09-30T17:04:05.942 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1749999999999999e-06 2023-09-30T17:04:05.942 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.942 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:05.942 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.942 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.942 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.943 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98799 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:05.943 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.697624+0000", 2023-09-30T17:04:05.943 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.073163592, 2023-09-30T17:04:05.943 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.075639860000000003, 2023-09-30T17:04:05.943 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:05.943 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:05.943 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:05.943 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:05.943 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.943 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98799 2023-09-30T17:04:05.943 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.943 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:05.943 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.944 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:05.944 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.697624+0000", 2023-09-30T17:04:05.944 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.944 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.944 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.944 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:05.944 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.697624+0000", 2023-09-30T17:04:05.944 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.944 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.944 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.945 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:05.945 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.697625+0000", 2023-09-30T17:04:05.945 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7300000000000001e-07 2023-09-30T17:04:05.945 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.945 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.945 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:05.945 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.697637+0000", 2023-09-30T17:04:05.945 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2532e-05 2023-09-30T17:04:05.945 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.945 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.945 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:05.945 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.697644+0000", 2023-09-30T17:04:05.946 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2750000000000001e-06 2023-09-30T17:04:05.946 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.946 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.946 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.946 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.697649+0000", 2023-09-30T17:04:05.946 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1379999999999998e-06 2023-09-30T17:04:05.946 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.946 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:05.946 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.946 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.946 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.946 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97646 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:05.947 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.342286+0000", 2023-09-30T17:04:05.947 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.42850200799999999, 2023-09-30T17:04:05.947 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.43104282999999999, 2023-09-30T17:04:05.947 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:05.947 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:05.947 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:05.947 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:05.947 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.947 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97646 2023-09-30T17:04:05.947 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.947 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:05.948 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.948 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:05.948 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.342286+0000", 2023-09-30T17:04:05.948 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.948 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.948 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.948 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:05.948 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.342286+0000", 2023-09-30T17:04:05.948 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.948 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.948 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.948 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:05.949 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.342286+0000", 2023-09-30T17:04:05.949 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.2500000000000001e-07 2023-09-30T17:04:05.949 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.949 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.949 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:05.949 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.342298+0000", 2023-09-30T17:04:05.949 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1435e-05 2023-09-30T17:04:05.949 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.949 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.949 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:05.949 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.342304+0000", 2023-09-30T17:04:05.949 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.959e-06 2023-09-30T17:04:05.950 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.950 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.950 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.950 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.342309+0000", 2023-09-30T17:04:05.950 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7709999999999997e-06 2023-09-30T17:04:05.950 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.950 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:05.950 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.950 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.950 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.950 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97970 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:05.951 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.440905+0000", 2023-09-30T17:04:05.951 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.32988257900000001, 2023-09-30T17:04:05.951 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.33249558499999998, 2023-09-30T17:04:05.951 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:05.951 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:05.951 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:05.951 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:05.951 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.951 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97970 2023-09-30T17:04:05.951 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.951 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:05.951 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.951 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:05.952 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.440905+0000", 2023-09-30T17:04:05.952 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.952 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.952 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.952 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:05.952 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.440905+0000", 2023-09-30T17:04:05.952 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.952 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.952 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.952 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:05.952 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.440927+0000", 2023-09-30T17:04:05.952 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1212999999999998e-05 2023-09-30T17:04:05.952 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.953 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.953 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:05.953 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.440939+0000", 2023-09-30T17:04:05.953 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2588999999999999e-05 2023-09-30T17:04:05.953 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.953 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.953 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:05.953 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.440946+0000", 2023-09-30T17:04:05.953 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.956e-06 2023-09-30T17:04:05.953 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.953 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.953 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.954 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.440952+0000", 2023-09-30T17:04:05.954 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9220000000000002e-06 2023-09-30T17:04:05.954 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.954 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:05.954 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.954 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.954 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.954 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98266 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:05.954 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.529943+0000", 2023-09-30T17:04:05.954 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.24084522799999999, 2023-09-30T17:04:05.955 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.243517653, 2023-09-30T17:04:05.955 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:05.955 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:05.955 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:05.955 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:05.955 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.955 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98266 2023-09-30T17:04:05.955 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.955 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:05.955 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.956 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:05.956 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.529943+0000", 2023-09-30T17:04:05.956 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.956 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.956 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.956 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:05.956 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.529943+0000", 2023-09-30T17:04:05.956 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.956 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.956 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.956 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:05.957 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.530162+0000", 2023-09-30T17:04:05.957 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000219037 2023-09-30T17:04:05.957 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.957 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.957 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:05.957 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.530173+0000", 2023-09-30T17:04:05.957 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.115e-05 2023-09-30T17:04:05.957 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.957 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.957 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:05.958 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.530184+0000", 2023-09-30T17:04:05.958 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1029000000000001e-05 2023-09-30T17:04:05.958 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.958 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.958 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.958 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.530191+0000", 2023-09-30T17:04:05.958 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0260000000000002e-06 2023-09-30T17:04:05.958 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.958 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:05.958 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.958 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.958 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.959 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98303 4.e 4.c27217ce (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:05.959 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.536483+0000", 2023-09-30T17:04:05.959 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.23430498199999999, 2023-09-30T17:04:05.959 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.237020172, 2023-09-30T17:04:05.959 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:05.959 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:05.959 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:05.959 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:05.959 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.959 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98303 2023-09-30T17:04:05.959 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.960 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:05.960 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.960 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:05.960 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.536483+0000", 2023-09-30T17:04:05.960 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.960 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.960 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.960 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:05.960 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.536483+0000", 2023-09-30T17:04:05.960 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.960 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.961 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.961 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:05.961 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.536484+0000", 2023-09-30T17:04:05.961 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6400000000000002e-07 2023-09-30T17:04:05.961 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.961 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.961 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:05.961 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.536496+0000", 2023-09-30T17:04:05.961 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.208e-05 2023-09-30T17:04:05.961 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.961 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.961 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:05.962 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.536502+0000", 2023-09-30T17:04:05.962 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5429999999999999e-06 2023-09-30T17:04:05.962 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.962 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.962 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.962 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.536508+0000", 2023-09-30T17:04:05.962 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4389999999999999e-06 2023-09-30T17:04:05.962 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.962 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:05.962 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.962 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.962 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.963 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98735 4.6 4.8232b686 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:05.963 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.673874+0000", 2023-09-30T17:04:05.963 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.096914067000000007, 2023-09-30T17:04:05.963 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.099689088999999995, 2023-09-30T17:04:05.963 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:05.963 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:05.963 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:05.963 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:05.963 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.963 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98735 2023-09-30T17:04:05.964 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.964 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:05.964 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.964 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:05.964 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.673874+0000", 2023-09-30T17:04:05.964 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.964 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.964 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.964 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:05.964 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.673874+0000", 2023-09-30T17:04:05.964 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.964 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.965 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.965 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:05.965 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.673875+0000", 2023-09-30T17:04:05.965 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6199999999999998e-07 2023-09-30T17:04:05.965 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.965 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.965 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:05.965 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.673887+0000", 2023-09-30T17:04:05.965 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2544000000000001e-05 2023-09-30T17:04:05.965 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.966 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.966 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:05.966 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.673894+0000", 2023-09-30T17:04:05.966 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3300000000000001e-06 2023-09-30T17:04:05.966 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.966 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.966 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.966 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.673900+0000", 2023-09-30T17:04:05.966 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6659999999999996e-06 2023-09-30T17:04:05.966 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.966 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:05.967 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.967 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.967 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.967 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98939 4.27 4.df99e167 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:05.967 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.737739+0000", 2023-09-30T17:04:05.967 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.033048912, 2023-09-30T17:04:05.967 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.035894822999999999, 2023-09-30T17:04:05.967 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:05.967 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:05.967 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:05.967 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:05.968 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.968 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98939 2023-09-30T17:04:05.968 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.968 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:05.968 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.968 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:05.968 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.737739+0000", 2023-09-30T17:04:05.968 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.968 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.968 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.968 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:05.969 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.737739+0000", 2023-09-30T17:04:05.969 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.969 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.969 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.969 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:05.969 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.737740+0000", 2023-09-30T17:04:05.969 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4099999999999999e-07 2023-09-30T17:04:05.969 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.969 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.969 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:05.969 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.737750+0000", 2023-09-30T17:04:05.970 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0581000000000001e-05 2023-09-30T17:04:05.970 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.970 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.970 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:05.970 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.737758+0000", 2023-09-30T17:04:05.970 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6599999999999995e-06 2023-09-30T17:04:05.970 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.970 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.970 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.970 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.737764+0000", 2023-09-30T17:04:05.970 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0959999999999997e-06 2023-09-30T17:04:05.970 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.971 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:05.971 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.971 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.971 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.971 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:98425 4.f e50/17 4:f2a80dfe:::100000001f8.00000019:head v 50'4673, mlcod=50'4664)", 2023-09-30T17:04:05.971 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.760181+0000", 2023-09-30T17:04:05.971 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.010606614, 2023-09-30T17:04:05.971 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.013519471, 2023-09-30T17:04:05.971 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:05.971 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:05.971 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:05.972 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.972 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:05.972 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.760181+0000", 2023-09-30T17:04:05.972 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.972 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.972 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.972 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:05.972 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.760181+0000", 2023-09-30T17:04:05.972 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.972 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.972 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.973 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:05.973 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.760182+0000", 2023-09-30T17:04:05.973 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2699999999999998e-07 2023-09-30T17:04:05.973 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.973 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.973 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:05.973 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.760197+0000", 2023-09-30T17:04:05.973 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4343e-05 2023-09-30T17:04:05.973 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.973 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.973 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:05.973 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.760206+0000", 2023-09-30T17:04:05.974 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.6590000000000002e-06 2023-09-30T17:04:05.974 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.974 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.974 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.974 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.760213+0000", 2023-09-30T17:04:05.974 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9890000000000003e-06 2023-09-30T17:04:05.974 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.974 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.974 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:05.974 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.761857+0000", 2023-09-30T17:04:05.975 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0016433000000000001 2023-09-30T17:04:05.975 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.975 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.975 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:05.975 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.761875+0000", 2023-09-30T17:04:05.975 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8213999999999999e-05 2023-09-30T17:04:05.975 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.975 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:05.975 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.975 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.975 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.975 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97682 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:05.976 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.351836+0000", 2023-09-30T17:04:05.976 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.41895168799999999, 2023-09-30T17:04:05.976 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.421934594, 2023-09-30T17:04:05.976 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:05.976 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:05.976 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:05.976 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:05.976 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.976 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97682 2023-09-30T17:04:05.976 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.977 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:05.977 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.977 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:05.977 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.351836+0000", 2023-09-30T17:04:05.977 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.977 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.977 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.977 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:05.977 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.351836+0000", 2023-09-30T17:04:05.977 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.977 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.978 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.978 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:05.978 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.351837+0000", 2023-09-30T17:04:05.978 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1200000000000003e-07 2023-09-30T17:04:05.978 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.978 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.978 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:05.978 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.351845+0000", 2023-09-30T17:04:05.978 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5619999999999998e-06 2023-09-30T17:04:05.978 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.978 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.979 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:05.979 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.351849+0000", 2023-09-30T17:04:05.979 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6e-06 2023-09-30T17:04:05.979 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.979 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.979 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.979 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.351852+0000", 2023-09-30T17:04:05.979 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.1499999999999999e-06 2023-09-30T17:04:05.979 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.979 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:05.979 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.979 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.980 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.980 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97725 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:05.980 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.366223+0000", 2023-09-30T17:04:05.980 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.40456492199999999, 2023-09-30T17:04:05.980 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.40760721, 2023-09-30T17:04:05.980 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:05.980 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:05.980 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:05.980 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:05.980 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.980 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97725 2023-09-30T17:04:05.980 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.981 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:05.981 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.981 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:05.981 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.366223+0000", 2023-09-30T17:04:05.981 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.981 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.981 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.981 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:05.981 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.366223+0000", 2023-09-30T17:04:05.981 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.981 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.981 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.982 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:05.982 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.366224+0000", 2023-09-30T17:04:05.982 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5499999999999998e-07 2023-09-30T17:04:05.982 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.982 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.982 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:05.982 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.366240+0000", 2023-09-30T17:04:05.982 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6073e-05 2023-09-30T17:04:05.982 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.982 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.982 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:05.983 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.366248+0000", 2023-09-30T17:04:05.983 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.507e-06 2023-09-30T17:04:05.983 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.983 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.983 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.983 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.366255+0000", 2023-09-30T17:04:05.983 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7209999999999997e-06 2023-09-30T17:04:05.983 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.983 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:05.983 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.983 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.983 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.984 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98190 4.6 4.2d31fac6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:05.984 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.511354+0000", 2023-09-30T17:04:05.984 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.25943397600000001, 2023-09-30T17:04:05.984 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.26252600300000001, 2023-09-30T17:04:05.984 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:05.984 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:05.984 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:05.984 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:05.984 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.984 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98190 2023-09-30T17:04:05.984 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.984 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:05.985 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.985 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:05.985 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.511354+0000", 2023-09-30T17:04:05.985 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.985 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.985 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.985 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:05.985 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.511354+0000", 2023-09-30T17:04:05.985 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.985 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.985 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.985 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:05.986 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.511355+0000", 2023-09-30T17:04:05.986 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3300000000000002e-07 2023-09-30T17:04:05.986 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.986 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.986 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:05.986 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.511369+0000", 2023-09-30T17:04:05.986 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4688999999999999e-05 2023-09-30T17:04:05.986 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.986 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.986 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:05.987 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.511376+0000", 2023-09-30T17:04:05.987 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7970000000000003e-06 2023-09-30T17:04:05.987 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.987 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.987 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.987 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.511381+0000", 2023-09-30T17:04:05.987 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2870000000000004e-06 2023-09-30T17:04:05.987 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.987 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:05.987 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.987 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.987 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.988 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98210 4.6 4.8232b686 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:05.988 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.517258+0000", 2023-09-30T17:04:05.988 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.253530115, 2023-09-30T17:04:05.988 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.25668522199999999, 2023-09-30T17:04:05.988 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:05.988 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:05.988 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:05.988 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:05.988 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.988 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98210 2023-09-30T17:04:05.988 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.989 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:05.989 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.989 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:05.989 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.517258+0000", 2023-09-30T17:04:05.989 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.989 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.989 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.989 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:05.989 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.517258+0000", 2023-09-30T17:04:05.989 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.989 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.989 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.990 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:05.990 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.517259+0000", 2023-09-30T17:04:05.990 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7299999999999996e-07 2023-09-30T17:04:05.990 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.990 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.990 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:05.990 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.517273+0000", 2023-09-30T17:04:05.990 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4355999999999999e-05 2023-09-30T17:04:05.990 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.990 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.990 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:05.991 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.517281+0000", 2023-09-30T17:04:05.991 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8879999999999997e-06 2023-09-30T17:04:05.991 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.991 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.991 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.991 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.517287+0000", 2023-09-30T17:04:05.991 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8030000000000002e-06 2023-09-30T17:04:05.991 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.991 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:05.991 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.991 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.991 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.991 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98252 4.6 4.2d31fac6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:05.992 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.523310+0000", 2023-09-30T17:04:05.992 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.24747799500000001, 2023-09-30T17:04:05.992 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.25069586700000002, 2023-09-30T17:04:05.992 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:05.992 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:05.992 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:05.992 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:05.992 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.992 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98252 2023-09-30T17:04:05.992 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.992 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:05.993 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.993 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:05.993 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.523310+0000", 2023-09-30T17:04:05.993 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.993 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.993 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.993 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:05.993 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.523310+0000", 2023-09-30T17:04:05.993 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.993 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.993 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.993 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:05.994 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.523310+0000", 2023-09-30T17:04:05.994 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1800000000000001e-07 2023-09-30T17:04:05.994 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.994 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.994 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:05.994 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.523322+0000", 2023-09-30T17:04:05.994 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1698e-05 2023-09-30T17:04:05.994 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.994 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.994 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:05.994 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.523338+0000", 2023-09-30T17:04:05.995 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5976000000000001e-05 2023-09-30T17:04:05.995 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.995 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.995 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.995 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.523344+0000", 2023-09-30T17:04:05.995 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3750000000000002e-06 2023-09-30T17:04:05.995 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.995 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:05.995 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.995 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.995 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.995 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98271 4.36 4.670445b6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:05.996 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.530205+0000", 2023-09-30T17:04:05.996 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.24058296300000001, 2023-09-30T17:04:05.996 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.24385973899999999, 2023-09-30T17:04:05.996 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:05.996 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:05.996 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:05.996 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:05.996 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:05.996 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98271 2023-09-30T17:04:05.996 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.996 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:05.997 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.997 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:05.997 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.530205+0000", 2023-09-30T17:04:05.997 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.997 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.997 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.997 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:05.997 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.530205+0000", 2023-09-30T17:04:05.997 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:05.997 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.997 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.998 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:05.998 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.530206+0000", 2023-09-30T17:04:05.998 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7599999999999997e-07 2023-09-30T17:04:05.998 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.998 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.998 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:05.998 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.530215+0000", 2023-09-30T17:04:05.998 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.4890000000000001e-06 2023-09-30T17:04:05.998 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.998 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.998 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:05.999 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.530222+0000", 2023-09-30T17:04:05.999 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5899999999999996e-06 2023-09-30T17:04:05.999 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:05.999 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:05.999 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:05.999 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.530225+0000", 2023-09-30T17:04:05.999 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.585e-06 2023-09-30T17:04:05.999 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.999 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:05.999 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:05.999 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.000 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.000 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98330 4.e 4.c27217ce (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.000 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.548415+0000", 2023-09-30T17:04:06.000 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.22237265000000001, 2023-09-30T17:04:06.000 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.225707082, 2023-09-30T17:04:06.000 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.000 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.000 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.000 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.000 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.000 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98330 2023-09-30T17:04:06.001 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.001 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.001 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.001 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.001 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.548415+0000", 2023-09-30T17:04:06.001 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.001 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.001 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.001 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.001 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.548415+0000", 2023-09-30T17:04:06.001 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.002 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.002 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.002 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.002 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.548416+0000", 2023-09-30T17:04:06.002 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2600000000000002e-07 2023-09-30T17:04:06.002 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.002 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.002 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.002 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.548432+0000", 2023-09-30T17:04:06.002 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5608e-05 2023-09-30T17:04:06.002 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.003 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.003 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.003 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.548439+0000", 2023-09-30T17:04:06.003 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3159999999999999e-06 2023-09-30T17:04:06.003 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.003 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.003 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.003 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.548446+0000", 2023-09-30T17:04:06.003 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0740000000000004e-06 2023-09-30T17:04:06.003 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.003 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.003 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.004 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.004 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.004 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98477 4.e 4.c27217ce (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.004 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.588096+0000", 2023-09-30T17:04:06.004 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.18269210799999999, 2023-09-30T17:04:06.004 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.18609763200000001, 2023-09-30T17:04:06.004 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.004 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.004 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.004 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.004 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.005 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98477 2023-09-30T17:04:06.005 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.005 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.005 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.005 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.005 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.588096+0000", 2023-09-30T17:04:06.005 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.005 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.005 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.005 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.005 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.588096+0000", 2023-09-30T17:04:06.005 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.006 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.006 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.006 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.006 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.588096+0000", 2023-09-30T17:04:06.006 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9299999999999999e-07 2023-09-30T17:04:06.006 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.006 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.006 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.006 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.588108+0000", 2023-09-30T17:04:06.006 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1698999999999999e-05 2023-09-30T17:04:06.006 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.007 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.007 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.007 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.588115+0000", 2023-09-30T17:04:06.007 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.204e-06 2023-09-30T17:04:06.007 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.007 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.007 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.007 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.588121+0000", 2023-09-30T17:04:06.007 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6529999999999999e-06 2023-09-30T17:04:06.007 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.007 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.007 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.008 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.008 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.008 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98611 4.6 4.8232b686 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.008 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.636284+0000", 2023-09-30T17:04:06.008 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.13450392999999999, 2023-09-30T17:04:06.008 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.137964161, 2023-09-30T17:04:06.008 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.008 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.008 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.008 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.008 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.008 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98611 2023-09-30T17:04:06.009 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.009 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.009 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.009 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.009 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.636284+0000", 2023-09-30T17:04:06.009 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.009 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.009 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.009 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.009 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.636284+0000", 2023-09-30T17:04:06.009 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.009 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.010 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.010 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.010 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.636285+0000", 2023-09-30T17:04:06.010 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5900000000000002e-07 2023-09-30T17:04:06.010 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.010 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.010 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.010 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.636298+0000", 2023-09-30T17:04:06.010 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3215e-05 2023-09-30T17:04:06.010 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.010 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.011 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.011 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.636304+0000", 2023-09-30T17:04:06.011 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1820000000000003e-06 2023-09-30T17:04:06.011 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.011 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.011 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.011 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.636309+0000", 2023-09-30T17:04:06.011 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8439999999999997e-06 2023-09-30T17:04:06.011 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.011 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.011 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.011 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.012 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.012 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98738 4.27 4:e68799fb:::100000001f8.00000018:head [write 1126400~4096 in=4096b,write 1363968~4096 in=4096b,write 1376256~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.012 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.673908+0000", 2023-09-30T17:04:06.012 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.096879587000000003, 2023-09-30T17:04:06.012 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.10037958600000001, 2023-09-30T17:04:06.012 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.012 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:06.012 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.012 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.012 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.012 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98738 2023-09-30T17:04:06.013 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.013 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.013 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.013 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.013 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.673908+0000", 2023-09-30T17:04:06.013 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.013 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.013 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.013 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.013 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.673908+0000", 2023-09-30T17:04:06.013 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.014 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.014 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.014 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.014 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.673909+0000", 2023-09-30T17:04:06.014 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0699999999999997e-07 2023-09-30T17:04:06.014 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.014 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.014 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.014 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.673922+0000", 2023-09-30T17:04:06.014 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2713e-05 2023-09-30T17:04:06.014 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.015 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.015 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.015 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.673929+0000", 2023-09-30T17:04:06.015 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2699999999999999e-06 2023-09-30T17:04:06.015 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.015 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.015 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.015 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.673935+0000", 2023-09-30T17:04:06.015 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7649999999999999e-06 2023-09-30T17:04:06.015 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.015 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.015 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:06.016 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.760027+0000", 2023-09-30T17:04:06.016 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.086092261000000003 2023-09-30T17:04:06.016 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.016 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.016 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:06.016 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.760132+0000", 2023-09-30T17:04:06.016 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000104899 2023-09-30T17:04:06.016 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.016 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.016 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.016 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.017 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.017 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98803 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.017 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.697693+0000", 2023-09-30T17:04:06.017 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.073095393999999994, 2023-09-30T17:04:06.017 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.076653164999999995, 2023-09-30T17:04:06.017 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.017 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.017 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.017 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.017 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.017 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98803 2023-09-30T17:04:06.017 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.018 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.018 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.018 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.018 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.697693+0000", 2023-09-30T17:04:06.018 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.018 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.018 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.018 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.018 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.697693+0000", 2023-09-30T17:04:06.018 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.018 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.018 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.019 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.019 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.697693+0000", 2023-09-30T17:04:06.019 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0999999999999999e-07 2023-09-30T17:04:06.019 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.019 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.019 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.019 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.697705+0000", 2023-09-30T17:04:06.019 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1616e-05 2023-09-30T17:04:06.019 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.019 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.019 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.019 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.697711+0000", 2023-09-30T17:04:06.020 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3210000000000001e-06 2023-09-30T17:04:06.020 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.020 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.020 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.020 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.697716+0000", 2023-09-30T17:04:06.020 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2399999999999998e-06 2023-09-30T17:04:06.020 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.020 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.020 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.020 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.020 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.020 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97620 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:06.021 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.332688+0000", 2023-09-30T17:04:06.021 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.43810028499999998, 2023-09-30T17:04:06.021 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.44169999599999998, 2023-09-30T17:04:06.021 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.021 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.021 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.021 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.021 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.021 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97620 2023-09-30T17:04:06.021 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.021 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.022 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.022 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.022 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.332688+0000", 2023-09-30T17:04:06.022 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.022 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.022 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.022 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.022 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.332688+0000", 2023-09-30T17:04:06.022 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.022 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.022 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.023 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.023 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.332688+0000", 2023-09-30T17:04:06.023 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5099999999999999e-07 2023-09-30T17:04:06.023 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.023 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.023 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.023 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.332703+0000", 2023-09-30T17:04:06.023 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4922999999999999e-05 2023-09-30T17:04:06.023 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.023 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.023 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.023 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.332709+0000", 2023-09-30T17:04:06.024 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5330000000000002e-06 2023-09-30T17:04:06.024 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.024 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.024 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.024 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.332713+0000", 2023-09-30T17:04:06.024 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.766e-06 2023-09-30T17:04:06.024 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.024 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.024 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.024 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.024 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.025 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98191 4.e 4.c27217ce (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.025 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.511388+0000", 2023-09-30T17:04:06.025 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.25939990600000001, 2023-09-30T17:04:06.025 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.26303157799999999, 2023-09-30T17:04:06.025 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.025 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.025 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.025 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.025 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.025 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98191 2023-09-30T17:04:06.025 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.025 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.026 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.026 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.026 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.511388+0000", 2023-09-30T17:04:06.026 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.026 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.026 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.026 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.026 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.511388+0000", 2023-09-30T17:04:06.026 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.026 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.026 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.027 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.027 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.511389+0000", 2023-09-30T17:04:06.027 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7599999999999997e-07 2023-09-30T17:04:06.027 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.027 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.027 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.027 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.511401+0000", 2023-09-30T17:04:06.027 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2678e-05 2023-09-30T17:04:06.027 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.027 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.027 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.028 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.511409+0000", 2023-09-30T17:04:06.028 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7610000000000007e-06 2023-09-30T17:04:06.028 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.028 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.028 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.028 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.511417+0000", 2023-09-30T17:04:06.028 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8529999999999992e-06 2023-09-30T17:04:06.028 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.028 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.028 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.028 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.029 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.029 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98478 4.6 4.8232b686 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.029 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.588128+0000", 2023-09-30T17:04:06.029 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.18265958800000001, 2023-09-30T17:04:06.029 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.18632546899999999, 2023-09-30T17:04:06.029 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.029 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.029 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.029 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.029 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.030 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98478 2023-09-30T17:04:06.030 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.030 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.030 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.030 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.030 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.588128+0000", 2023-09-30T17:04:06.030 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.030 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.030 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.030 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.030 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.588128+0000", 2023-09-30T17:04:06.031 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.031 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.031 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.031 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.031 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.588129+0000", 2023-09-30T17:04:06.031 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2100000000000002e-07 2023-09-30T17:04:06.031 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.031 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.031 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.031 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.588142+0000", 2023-09-30T17:04:06.031 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2897e-05 2023-09-30T17:04:06.031 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.032 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.032 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.032 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.588149+0000", 2023-09-30T17:04:06.032 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9210000000000003e-06 2023-09-30T17:04:06.032 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.032 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.032 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.032 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.588154+0000", 2023-09-30T17:04:06.032 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7599999999999999e-06 2023-09-30T17:04:06.032 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.032 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.033 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.033 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.033 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.033 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98806 4.27 4:e68799fb:::100000001f8.00000018:head [write 1982464~4096 in=4096b,write 1994752~4096 in=4096b,write 2039808~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.033 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.697723+0000", 2023-09-30T17:04:06.033 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.073065210000000005, 2023-09-30T17:04:06.033 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.076777731000000002, 2023-09-30T17:04:06.033 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.033 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:06.033 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.033 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.034 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.034 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98806 2023-09-30T17:04:06.034 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.034 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.060 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.060 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.060 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.697723+0000", 2023-09-30T17:04:06.061 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.061 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.061 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.061 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.061 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.697723+0000", 2023-09-30T17:04:06.061 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.061 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.061 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.061 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.061 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.698163+0000", 2023-09-30T17:04:06.061 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00044057999999999999 2023-09-30T17:04:06.061 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.062 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.062 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.062 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.698177+0000", 2023-09-30T17:04:06.062 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3168e-05 2023-09-30T17:04:06.062 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.062 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.062 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.062 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.698185+0000", 2023-09-30T17:04:06.062 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1950000000000003e-06 2023-09-30T17:04:06.062 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.062 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.063 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.063 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.698191+0000", 2023-09-30T17:04:06.063 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5440000000000004e-06 2023-09-30T17:04:06.063 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.063 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.063 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:06.063 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.767802+0000", 2023-09-30T17:04:06.063 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.069611170999999999 2023-09-30T17:04:06.063 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.063 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.064 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:06.064 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.767898+0000", 2023-09-30T17:04:06.064 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.5927999999999994e-05 2023-09-30T17:04:06.064 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.064 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.064 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.064 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.064 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.064 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98851 4.6 4.8232b686 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.064 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.710117+0000", 2023-09-30T17:04:06.064 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.060671444999999997, 2023-09-30T17:04:06.065 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.064436885999999999, 2023-09-30T17:04:06.065 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.065 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.065 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.065 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.065 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.065 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98851 2023-09-30T17:04:06.065 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.065 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.065 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.065 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.066 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.710117+0000", 2023-09-30T17:04:06.066 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.066 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.066 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.066 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.066 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.710117+0000", 2023-09-30T17:04:06.066 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.066 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.066 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.066 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.066 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.710118+0000", 2023-09-30T17:04:06.067 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1680000000000001e-06 2023-09-30T17:04:06.067 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.067 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.067 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.067 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.710133+0000", 2023-09-30T17:04:06.067 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5508000000000001e-05 2023-09-30T17:04:06.067 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.067 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.067 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.067 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.710145+0000", 2023-09-30T17:04:06.067 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.22e-05 2023-09-30T17:04:06.067 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.068 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.068 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.068 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.710155+0000", 2023-09-30T17:04:06.068 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.4350000000000003e-06 2023-09-30T17:04:06.068 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.068 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.068 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.068 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.068 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.068 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98868 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.068 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.715201+0000", 2023-09-30T17:04:06.069 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.055587167999999999, 2023-09-30T17:04:06.069 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.059417962999999997, 2023-09-30T17:04:06.069 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.069 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.069 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.069 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.069 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.069 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98868 2023-09-30T17:04:06.069 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.069 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.069 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.070 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.070 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.715201+0000", 2023-09-30T17:04:06.070 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.070 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.070 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.070 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.070 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.715201+0000", 2023-09-30T17:04:06.070 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.070 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.070 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.070 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.071 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.715201+0000", 2023-09-30T17:04:06.071 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.06e-07 2023-09-30T17:04:06.071 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.071 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.071 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.071 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.715214+0000", 2023-09-30T17:04:06.071 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2627e-05 2023-09-30T17:04:06.071 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.071 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.071 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.071 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.715223+0000", 2023-09-30T17:04:06.071 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.6729999999999998e-06 2023-09-30T17:04:06.072 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.072 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.072 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.072 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.715229+0000", 2023-09-30T17:04:06.072 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.353e-06 2023-09-30T17:04:06.072 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.072 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.072 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.072 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.072 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.072 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:99002 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.072 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.761196+0000", 2023-09-30T17:04:06.073 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0095919209999999998, 2023-09-30T17:04:06.073 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.013475674, 2023-09-30T17:04:06.073 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.073 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.073 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.073 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.073 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.073 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 99002 2023-09-30T17:04:06.073 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.073 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.073 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.073 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.074 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.761196+0000", 2023-09-30T17:04:06.074 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.074 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.074 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.074 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.074 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.761196+0000", 2023-09-30T17:04:06.074 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.074 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.074 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.074 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.074 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.761197+0000", 2023-09-30T17:04:06.075 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.9699999999999994e-07 2023-09-30T17:04:06.075 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.075 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.075 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.075 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.761212+0000", 2023-09-30T17:04:06.075 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5242000000000001e-05 2023-09-30T17:04:06.075 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.075 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.075 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.075 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.761223+0000", 2023-09-30T17:04:06.075 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1058e-05 2023-09-30T17:04:06.075 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.076 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.076 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.076 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.761231+0000", 2023-09-30T17:04:06.076 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1849999999999998e-06 2023-09-30T17:04:06.076 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.076 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.076 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.076 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.076 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.076 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97849 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.076 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.402895+0000", 2023-09-30T17:04:06.076 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.36789303000000001, 2023-09-30T17:04:06.077 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.37181244400000002, 2023-09-30T17:04:06.077 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.077 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.077 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.077 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.077 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.077 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97849 2023-09-30T17:04:06.077 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.077 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.077 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.077 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.077 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.402895+0000", 2023-09-30T17:04:06.078 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.078 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.078 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.078 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.078 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.402895+0000", 2023-09-30T17:04:06.078 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.078 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.078 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.078 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.078 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.403617+0000", 2023-09-30T17:04:06.078 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00072230099999999995 2023-09-30T17:04:06.079 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.079 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.079 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.079 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.403643+0000", 2023-09-30T17:04:06.079 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.5479000000000001e-05 2023-09-30T17:04:06.079 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.079 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.079 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.079 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.403657+0000", 2023-09-30T17:04:06.079 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3995000000000001e-05 2023-09-30T17:04:06.079 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.079 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.080 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.080 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.403665+0000", 2023-09-30T17:04:06.080 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5150000000000006e-06 2023-09-30T17:04:06.080 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.080 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.080 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.080 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.080 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.080 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98332 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.080 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.548500+0000", 2023-09-30T17:04:06.080 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.222287602, 2023-09-30T17:04:06.081 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.226240147, 2023-09-30T17:04:06.081 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.081 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.081 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.081 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.081 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.081 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98332 2023-09-30T17:04:06.081 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.081 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.081 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.081 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.082 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.548500+0000", 2023-09-30T17:04:06.082 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.082 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.082 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.082 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.082 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.548500+0000", 2023-09-30T17:04:06.082 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.082 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.082 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.082 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.082 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.548501+0000", 2023-09-30T17:04:06.082 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9500000000000002e-07 2023-09-30T17:04:06.083 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.083 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.083 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.083 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.548514+0000", 2023-09-30T17:04:06.083 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2687999999999999e-05 2023-09-30T17:04:06.083 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.083 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.083 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.083 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.548521+0000", 2023-09-30T17:04:06.083 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0679999999999999e-06 2023-09-30T17:04:06.083 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.084 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.084 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.084 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.548525+0000", 2023-09-30T17:04:06.084 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7799999999999998e-06 2023-09-30T17:04:06.084 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.084 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.084 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.084 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.084 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.084 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98614 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.084 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.636344+0000", 2023-09-30T17:04:06.085 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.13444357500000001, 2023-09-30T17:04:06.085 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.13843332, 2023-09-30T17:04:06.085 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.085 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.085 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.085 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.085 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.085 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98614 2023-09-30T17:04:06.085 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.085 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.085 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.086 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.086 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.636344+0000", 2023-09-30T17:04:06.086 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.086 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.086 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.086 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.086 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.636344+0000", 2023-09-30T17:04:06.086 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.086 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.086 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.086 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.087 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.636345+0000", 2023-09-30T17:04:06.087 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.75e-07 2023-09-30T17:04:06.087 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.087 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.087 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.087 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.636356+0000", 2023-09-30T17:04:06.087 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0817e-05 2023-09-30T17:04:06.087 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.087 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.087 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.087 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.636362+0000", 2023-09-30T17:04:06.088 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0299999999999999e-06 2023-09-30T17:04:06.088 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.088 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.088 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.088 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.636367+0000", 2023-09-30T17:04:06.088 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7190000000000001e-06 2023-09-30T17:04:06.088 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.088 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.088 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.088 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.088 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.089 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98766 4.e 4.c27217ce (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.089 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.685698+0000", 2023-09-30T17:04:06.089 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.085090216999999996, 2023-09-30T17:04:06.089 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.089121483000000001, 2023-09-30T17:04:06.089 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.089 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.089 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.089 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.089 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.089 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98766 2023-09-30T17:04:06.089 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.089 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.090 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.090 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.090 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.685698+0000", 2023-09-30T17:04:06.090 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.090 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.090 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.090 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.090 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.685698+0000", 2023-09-30T17:04:06.090 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.090 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.090 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.090 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.091 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.687086+0000", 2023-09-30T17:04:06.091 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0013882199999999999 2023-09-30T17:04:06.091 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.091 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.091 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.091 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.687101+0000", 2023-09-30T17:04:06.091 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5064e-05 2023-09-30T17:04:06.091 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.091 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.091 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.091 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.687111+0000", 2023-09-30T17:04:06.091 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3870000000000001e-06 2023-09-30T17:04:06.092 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.092 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.092 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.092 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.687116+0000", 2023-09-30T17:04:06.092 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7030000000000003e-06 2023-09-30T17:04:06.092 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.092 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.092 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.092 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.092 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.092 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:98395 4.f e50/17 4:f2a80dfe:::100000001f8.00000019:head v 50'4668, mlcod=50'4659)", 2023-09-30T17:04:06.093 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.738542+0000", 2023-09-30T17:04:06.093 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.032246221999999998, 2023-09-30T17:04:06.093 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.036318942, 2023-09-30T17:04:06.093 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.093 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:06.093 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.093 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.093 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.093 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.738542+0000", 2023-09-30T17:04:06.093 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.093 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.094 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.094 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.094 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.738542+0000", 2023-09-30T17:04:06.094 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.094 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.094 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.094 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.094 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.738542+0000", 2023-09-30T17:04:06.094 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9900000000000001e-07 2023-09-30T17:04:06.094 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.094 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.095 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.095 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.738556+0000", 2023-09-30T17:04:06.095 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3677e-05 2023-09-30T17:04:06.095 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.095 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.095 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.095 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.738562+0000", 2023-09-30T17:04:06.095 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2219999999999999e-06 2023-09-30T17:04:06.095 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.095 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.095 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.095 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.738567+0000", 2023-09-30T17:04:06.096 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5979999999999999e-06 2023-09-30T17:04:06.096 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.096 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.096 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:06.096 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.739988+0000", 2023-09-30T17:04:06.096 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0014215440000000001 2023-09-30T17:04:06.096 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.096 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.096 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:06.096 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.740008+0000", 2023-09-30T17:04:06.096 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9607999999999999e-05 2023-09-30T17:04:06.096 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.097 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.097 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.097 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.097 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.097 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:99003 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 118784~4096 in=4096b,write 180224~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.097 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.761243+0000", 2023-09-30T17:04:06.097 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0095449679999999992, 2023-09-30T17:04:06.097 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.013669837000000001, 2023-09-30T17:04:06.097 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.097 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:06.097 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.098 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.098 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.098 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 99003 2023-09-30T17:04:06.098 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.098 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.098 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.098 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.098 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.761243+0000", 2023-09-30T17:04:06.098 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.098 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.098 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.099 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.099 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.761243+0000", 2023-09-30T17:04:06.099 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.099 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.099 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.099 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.099 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.761244+0000", 2023-09-30T17:04:06.099 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.89e-07 2023-09-30T17:04:06.099 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.099 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.099 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.100 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.761253+0000", 2023-09-30T17:04:06.100 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.9089999999999995e-06 2023-09-30T17:04:06.100 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.100 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.100 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.100 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.761261+0000", 2023-09-30T17:04:06.100 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6380000000000004e-06 2023-09-30T17:04:06.100 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.100 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.100 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.101 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.761266+0000", 2023-09-30T17:04:06.101 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2379999999999997e-06 2023-09-30T17:04:06.101 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.101 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.101 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:06.101 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.761328+0000", 2023-09-30T17:04:06.101 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1258000000000002e-05 2023-09-30T17:04:06.101 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.101 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.101 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:06.101 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.761410+0000", 2023-09-30T17:04:06.101 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2569000000000002e-05 2023-09-30T17:04:06.102 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.102 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.102 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:06.102 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.761551+0000", 2023-09-30T17:04:06.102 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014127500000000001 2023-09-30T17:04:06.102 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.102 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.102 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:06.102 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.773130+0000", 2023-09-30T17:04:06.102 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011578507 2023-09-30T17:04:06.102 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.103 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.103 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.103 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.103 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.103 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97653 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:06.103 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.342461+0000", 2023-09-30T17:04:06.103 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.42832715799999999, 2023-09-30T17:04:06.103 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.43259870499999997, 2023-09-30T17:04:06.103 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.103 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.103 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.103 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.104 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.104 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97653 2023-09-30T17:04:06.104 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.104 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.104 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.104 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.104 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.342461+0000", 2023-09-30T17:04:06.104 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.104 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.104 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.104 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.104 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.342461+0000", 2023-09-30T17:04:06.105 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.105 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.105 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.105 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.105 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.342461+0000", 2023-09-30T17:04:06.105 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5400000000000002e-07 2023-09-30T17:04:06.105 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.105 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.105 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.105 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.342473+0000", 2023-09-30T17:04:06.105 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2101e-05 2023-09-30T17:04:06.105 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.106 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.106 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.106 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.342480+0000", 2023-09-30T17:04:06.106 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0719999999999996e-06 2023-09-30T17:04:06.106 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.106 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.106 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.106 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.342484+0000", 2023-09-30T17:04:06.106 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8210000000000001e-06 2023-09-30T17:04:06.106 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.106 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.107 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.107 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.107 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.107 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97920 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.107 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.420853+0000", 2023-09-30T17:04:06.107 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.34993507200000001, 2023-09-30T17:04:06.107 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.35424636199999998, 2023-09-30T17:04:06.107 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.107 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.107 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.107 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.108 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.108 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97920 2023-09-30T17:04:06.108 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.108 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.108 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.108 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.108 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.420853+0000", 2023-09-30T17:04:06.108 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.108 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.108 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.108 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.109 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.420853+0000", 2023-09-30T17:04:06.109 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.109 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.109 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.109 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.109 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.420875+0000", 2023-09-30T17:04:06.109 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2283999999999999e-05 2023-09-30T17:04:06.109 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.109 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.109 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.109 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.420888+0000", 2023-09-30T17:04:06.109 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3108999999999999e-05 2023-09-30T17:04:06.110 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.110 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.110 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.110 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.420896+0000", 2023-09-30T17:04:06.110 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9869999999999999e-06 2023-09-30T17:04:06.110 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.110 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.110 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.110 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.420904+0000", 2023-09-30T17:04:06.110 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8369999999999997e-06 2023-09-30T17:04:06.110 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.110 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.111 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.111 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.111 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.111 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98058 4.e 4.c27217ce (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.111 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.457168+0000", 2023-09-30T17:04:06.111 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.31362025700000001, 2023-09-30T17:04:06.111 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.31798628499999998, 2023-09-30T17:04:06.111 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.111 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.111 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.111 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.111 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.112 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98058 2023-09-30T17:04:06.112 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.112 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.112 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.112 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.112 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.457168+0000", 2023-09-30T17:04:06.112 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.112 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.112 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.112 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.112 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.457168+0000", 2023-09-30T17:04:06.113 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.113 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.113 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.113 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.113 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.457168+0000", 2023-09-30T17:04:06.113 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.6700000000000003e-07 2023-09-30T17:04:06.113 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.113 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.113 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.113 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.457183+0000", 2023-09-30T17:04:06.113 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4697e-05 2023-09-30T17:04:06.114 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.114 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.114 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.114 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.457191+0000", 2023-09-30T17:04:06.114 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9820000000000008e-06 2023-09-30T17:04:06.114 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.114 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.114 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.114 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.457197+0000", 2023-09-30T17:04:06.114 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0270000000000001e-06 2023-09-30T17:04:06.114 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.115 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.115 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.115 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.115 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.115 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98156 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.115 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.505730+0000", 2023-09-30T17:04:06.115 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.265057555, 2023-09-30T17:04:06.115 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.26949221200000001, 2023-09-30T17:04:06.115 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.115 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.115 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.116 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.116 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.116 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98156 2023-09-30T17:04:06.116 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.116 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.116 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.116 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.116 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.505730+0000", 2023-09-30T17:04:06.116 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.116 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.116 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.116 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.117 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.505730+0000", 2023-09-30T17:04:06.117 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.117 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.117 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.117 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.117 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.507164+0000", 2023-09-30T17:04:06.117 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001433808 2023-09-30T17:04:06.117 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.117 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.117 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.117 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.507181+0000", 2023-09-30T17:04:06.117 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6770999999999999e-05 2023-09-30T17:04:06.118 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.118 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.118 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.118 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.507192+0000", 2023-09-30T17:04:06.118 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1029999999999999e-05 2023-09-30T17:04:06.118 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.118 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.118 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.118 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.507200+0000", 2023-09-30T17:04:06.118 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0199999999999994e-06 2023-09-30T17:04:06.118 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.118 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.119 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.119 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.119 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.119 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98695 4.6 4.8232b686 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.119 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.665347+0000", 2023-09-30T17:04:06.119 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.10544055300000001, 2023-09-30T17:04:06.119 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.109943438, 2023-09-30T17:04:06.119 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.119 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.119 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.119 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.119 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.120 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98695 2023-09-30T17:04:06.120 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.120 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.120 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.120 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.120 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.665347+0000", 2023-09-30T17:04:06.120 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.120 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.120 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.120 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.120 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.665347+0000", 2023-09-30T17:04:06.120 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.121 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.121 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.121 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.121 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.665348+0000", 2023-09-30T17:04:06.121 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8299999999999998e-07 2023-09-30T17:04:06.121 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.121 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.121 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.121 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.665360+0000", 2023-09-30T17:04:06.121 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1807999999999999e-05 2023-09-30T17:04:06.121 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.121 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.122 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.122 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.665368+0000", 2023-09-30T17:04:06.122 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3319999999999992e-06 2023-09-30T17:04:06.122 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.122 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.122 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.122 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.665373+0000", 2023-09-30T17:04:06.122 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1270000000000002e-06 2023-09-30T17:04:06.122 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.122 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.122 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.122 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.123 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.123 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98742 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.123 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.674016+0000", 2023-09-30T17:04:06.123 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.096771799000000006, 2023-09-30T17:04:06.123 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.101339003, 2023-09-30T17:04:06.123 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.123 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.123 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.123 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.123 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.123 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98742 2023-09-30T17:04:06.123 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.124 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.124 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.124 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.124 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.674016+0000", 2023-09-30T17:04:06.124 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.124 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.124 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.124 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.124 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.674016+0000", 2023-09-30T17:04:06.124 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.124 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.124 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.125 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.125 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.674017+0000", 2023-09-30T17:04:06.125 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3500000000000002e-07 2023-09-30T17:04:06.125 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.125 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.125 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.125 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.674030+0000", 2023-09-30T17:04:06.125 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2916e-05 2023-09-30T17:04:06.125 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.125 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.125 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.125 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.674037+0000", 2023-09-30T17:04:06.125 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2010000000000002e-06 2023-09-30T17:04:06.126 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.126 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.126 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.126 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.674043+0000", 2023-09-30T17:04:06.126 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9730000000000002e-06 2023-09-30T17:04:06.126 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.126 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.126 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.126 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.126 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.126 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:98413 4.f e50/17 4:f0d983b2:::100000001f8.0000001f:head v 50'4670, mlcod=50'4663)", 2023-09-30T17:04:06.127 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.747119+0000", 2023-09-30T17:04:06.127 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.023669486999999999, 2023-09-30T17:04:06.127 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.028275125000000002, 2023-09-30T17:04:06.127 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.127 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:06.127 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.127 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.127 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.127 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.747119+0000", 2023-09-30T17:04:06.127 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.127 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.127 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.128 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.128 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.747119+0000", 2023-09-30T17:04:06.128 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.128 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.128 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.128 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.128 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.747119+0000", 2023-09-30T17:04:06.128 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4700000000000001e-07 2023-09-30T17:04:06.128 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.128 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.128 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.128 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.747133+0000", 2023-09-30T17:04:06.129 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3966e-05 2023-09-30T17:04:06.129 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.129 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.129 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.129 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.747144+0000", 2023-09-30T17:04:06.129 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1097000000000001e-05 2023-09-30T17:04:06.129 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.129 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.129 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.129 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.747155+0000", 2023-09-30T17:04:06.129 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1197e-05 2023-09-30T17:04:06.129 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.130 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.130 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:06.130 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.749390+0000", 2023-09-30T17:04:06.130 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0022348210000000001 2023-09-30T17:04:06.130 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.130 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.130 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:06.130 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.749410+0000", 2023-09-30T17:04:06.131 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.0258000000000002e-05 2023-09-30T17:04:06.131 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.131 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.131 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.131 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.131 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.131 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:99008 4.19 4:997b7129:::100000001f8.00000000:head [write 1028096~4096 in=4096b,write 1060864~4096 in=4096b,write 1138688~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.131 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.761971+0000", 2023-09-30T17:04:06.131 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0088170620000000005, 2023-09-30T17:04:06.131 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.013496654, 2023-09-30T17:04:06.131 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.132 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:06.132 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.132 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.132 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.132 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 99008 2023-09-30T17:04:06.132 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.132 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.132 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.132 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.132 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.761971+0000", 2023-09-30T17:04:06.132 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.132 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.133 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.133 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.133 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.761971+0000", 2023-09-30T17:04:06.133 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.133 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.133 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.133 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.133 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.761972+0000", 2023-09-30T17:04:06.133 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0400000000000005e-07 2023-09-30T17:04:06.133 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.133 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.133 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.134 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.761983+0000", 2023-09-30T17:04:06.134 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1163e-05 2023-09-30T17:04:06.134 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.134 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.134 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.134 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.761994+0000", 2023-09-30T17:04:06.134 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0832000000000001e-05 2023-09-30T17:04:06.134 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.134 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.134 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.134 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.762001+0000", 2023-09-30T17:04:06.135 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2599999999999999e-06 2023-09-30T17:04:06.135 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.135 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.135 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:06.135 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.766489+0000", 2023-09-30T17:04:06.135 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0044882350000000001 2023-09-30T17:04:06.135 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.135 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.135 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:06.135 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.766584+0000", 2023-09-30T17:04:06.135 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.4900000000000003e-05 2023-09-30T17:04:06.136 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.136 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.136 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:06.136 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.766676+0000", 2023-09-30T17:04:06.136 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1794999999999998e-05 2023-09-30T17:04:06.136 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.136 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.136 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:06.136 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.773136+0000", 2023-09-30T17:04:06.136 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0064600020000000003 2023-09-30T17:04:06.136 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.137 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.137 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.137 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.137 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.137 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97624 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:06.137 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.332741+0000", 2023-09-30T17:04:06.137 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.43804719399999997, 2023-09-30T17:04:06.137 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.44282421599999999, 2023-09-30T17:04:06.137 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.137 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.137 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.137 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.138 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.138 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97624 2023-09-30T17:04:06.138 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.138 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.138 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.138 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.138 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.332741+0000", 2023-09-30T17:04:06.138 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.138 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.138 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.138 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.139 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.332741+0000", 2023-09-30T17:04:06.139 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.139 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.139 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.139 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.139 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.334483+0000", 2023-09-30T17:04:06.139 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0017426099999999999 2023-09-30T17:04:06.139 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.139 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.139 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.139 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.334501+0000", 2023-09-30T17:04:06.139 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7728e-05 2023-09-30T17:04:06.140 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.140 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.140 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.140 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.334512+0000", 2023-09-30T17:04:06.140 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0349e-05 2023-09-30T17:04:06.140 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.140 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.140 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.140 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.334519+0000", 2023-09-30T17:04:06.140 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5009999999999998e-06 2023-09-30T17:04:06.140 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.141 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.141 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.141 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.141 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.141 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97770 4.36 4.670445b6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.141 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.380281+0000", 2023-09-30T17:04:06.141 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.39050713799999998, 2023-09-30T17:04:06.141 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39547745099999998, 2023-09-30T17:04:06.141 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.141 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.141 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.141 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.142 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.142 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97770 2023-09-30T17:04:06.142 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.142 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.142 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.142 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.142 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.380281+0000", 2023-09-30T17:04:06.142 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.142 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.142 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.143 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.143 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.380281+0000", 2023-09-30T17:04:06.143 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.143 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.143 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.143 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.143 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.380281+0000", 2023-09-30T17:04:06.143 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7199999999999999e-07 2023-09-30T17:04:06.143 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.143 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.143 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.143 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.380298+0000", 2023-09-30T17:04:06.144 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6507e-05 2023-09-30T17:04:06.144 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.144 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.144 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.144 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.380306+0000", 2023-09-30T17:04:06.144 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6930000000000007e-06 2023-09-30T17:04:06.144 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.144 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.144 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.144 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.380313+0000", 2023-09-30T17:04:06.144 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9179999999999997e-06 2023-09-30T17:04:06.144 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.144 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.145 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.145 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.145 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.145 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97816 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.145 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.390378+0000", 2023-09-30T17:04:06.145 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.38041042200000003, 2023-09-30T17:04:06.145 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.38542893099999997, 2023-09-30T17:04:06.145 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.145 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.145 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.145 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.145 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.146 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97816 2023-09-30T17:04:06.146 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.146 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.146 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.146 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.146 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.390378+0000", 2023-09-30T17:04:06.146 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.146 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.146 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.146 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.147 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.390378+0000", 2023-09-30T17:04:06.147 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.147 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.147 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.147 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.147 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.392871+0000", 2023-09-30T17:04:06.147 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0024931049999999998 2023-09-30T17:04:06.147 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.147 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.147 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.148 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.392895+0000", 2023-09-30T17:04:06.148 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.3862999999999998e-05 2023-09-30T17:04:06.148 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.148 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.148 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.148 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.392906+0000", 2023-09-30T17:04:06.148 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1229e-05 2023-09-30T17:04:06.148 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.148 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.148 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.148 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.392911+0000", 2023-09-30T17:04:06.149 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5339999999999999e-06 2023-09-30T17:04:06.149 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.149 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.149 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.149 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.149 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.149 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97921 4.6 4.8232b686 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.149 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.420915+0000", 2023-09-30T17:04:06.149 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.34987285800000001, 2023-09-30T17:04:06.150 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.35492266700000002, 2023-09-30T17:04:06.150 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.150 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.150 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.150 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.150 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.150 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97921 2023-09-30T17:04:06.150 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.150 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.150 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.150 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.151 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.420915+0000", 2023-09-30T17:04:06.151 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.151 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.151 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.151 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.151 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.420915+0000", 2023-09-30T17:04:06.151 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.151 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.151 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.151 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.151 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.421357+0000", 2023-09-30T17:04:06.151 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000441521 2023-09-30T17:04:06.152 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.152 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.152 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.152 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.421371+0000", 2023-09-30T17:04:06.152 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4232e-05 2023-09-30T17:04:06.152 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.152 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.152 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.152 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.421380+0000", 2023-09-30T17:04:06.152 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2960000000000004e-06 2023-09-30T17:04:06.152 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.153 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.153 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.153 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.421388+0000", 2023-09-30T17:04:06.153 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3930000000000002e-06 2023-09-30T17:04:06.153 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.153 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.153 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.153 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.153 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.153 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98059 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.153 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.457208+0000", 2023-09-30T17:04:06.153 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.31358007700000001, 2023-09-30T17:04:06.154 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.31866376299999999, 2023-09-30T17:04:06.154 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.154 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.154 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.154 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.154 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.154 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98059 2023-09-30T17:04:06.154 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.154 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.154 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.154 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.154 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.457208+0000", 2023-09-30T17:04:06.155 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.155 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.155 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.155 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.155 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.457208+0000", 2023-09-30T17:04:06.155 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.155 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.155 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.155 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.155 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.457208+0000", 2023-09-30T17:04:06.155 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4200000000000001e-07 2023-09-30T17:04:06.155 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.156 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.156 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.156 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.457221+0000", 2023-09-30T17:04:06.156 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2614e-05 2023-09-30T17:04:06.156 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.156 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.156 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.156 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.457229+0000", 2023-09-30T17:04:06.156 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7700000000000001e-06 2023-09-30T17:04:06.156 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.156 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.156 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.157 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.457235+0000", 2023-09-30T17:04:06.157 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7250000000000002e-06 2023-09-30T17:04:06.157 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.157 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.157 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.157 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.157 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.157 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98216 4.6 4.2d31fac6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.157 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.517414+0000", 2023-09-30T17:04:06.157 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.25337401799999998, 2023-09-30T17:04:06.157 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.25848953800000002, 2023-09-30T17:04:06.157 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.158 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.158 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.158 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.158 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.158 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98216 2023-09-30T17:04:06.158 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.158 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.158 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.158 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.158 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.517414+0000", 2023-09-30T17:04:06.158 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.158 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.159 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.159 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.159 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.517414+0000", 2023-09-30T17:04:06.159 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.159 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.159 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.159 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.159 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.517415+0000", 2023-09-30T17:04:06.159 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5700000000000002e-07 2023-09-30T17:04:06.159 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.159 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.159 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.160 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.517427+0000", 2023-09-30T17:04:06.160 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2897e-05 2023-09-30T17:04:06.160 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.160 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.160 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.160 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.517435+0000", 2023-09-30T17:04:06.160 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3710000000000002e-06 2023-09-30T17:04:06.160 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.160 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.160 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.160 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.517442+0000", 2023-09-30T17:04:06.160 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7739999999999999e-06 2023-09-30T17:04:06.161 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.161 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.161 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.161 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.161 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.161 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98335 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.161 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.548553+0000", 2023-09-30T17:04:06.161 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.22223505700000001, 2023-09-30T17:04:06.161 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22738329299999999, 2023-09-30T17:04:06.161 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.161 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.161 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.162 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.162 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.162 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98335 2023-09-30T17:04:06.162 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.162 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.162 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.162 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.162 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.548553+0000", 2023-09-30T17:04:06.162 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.162 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.162 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.163 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.163 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.548553+0000", 2023-09-30T17:04:06.163 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.163 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.163 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.163 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.163 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.548553+0000", 2023-09-30T17:04:06.163 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.35e-07 2023-09-30T17:04:06.163 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.163 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.163 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.163 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.548563+0000", 2023-09-30T17:04:06.164 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0173000000000001e-05 2023-09-30T17:04:06.164 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.164 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.164 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.164 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.548571+0000", 2023-09-30T17:04:06.164 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1969999999999999e-06 2023-09-30T17:04:06.164 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.164 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.164 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.164 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.548576+0000", 2023-09-30T17:04:06.164 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6749999999999999e-06 2023-09-30T17:04:06.165 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.165 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.165 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.165 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.165 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.165 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98362 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.165 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.561403+0000", 2023-09-30T17:04:06.165 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.20938547599999999, 2023-09-30T17:04:06.165 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.21456497399999999, 2023-09-30T17:04:06.165 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.166 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.166 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.166 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.166 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.166 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98362 2023-09-30T17:04:06.166 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.166 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.166 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.166 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.166 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.561403+0000", 2023-09-30T17:04:06.167 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.167 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.167 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.167 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.167 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.561403+0000", 2023-09-30T17:04:06.167 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.167 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.167 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.167 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.168 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.561403+0000", 2023-09-30T17:04:06.168 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4099999999999999e-07 2023-09-30T17:04:06.168 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.168 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.168 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.168 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.561420+0000", 2023-09-30T17:04:06.168 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7116999999999999e-05 2023-09-30T17:04:06.168 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.168 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.168 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.168 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.561428+0000", 2023-09-30T17:04:06.168 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3150000000000003e-06 2023-09-30T17:04:06.169 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.169 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.169 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.169 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.561434+0000", 2023-09-30T17:04:06.169 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.251e-06 2023-09-30T17:04:06.169 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.169 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.169 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.169 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.169 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.170 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98537 4.36 4.670445b6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.170 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.617243+0000", 2023-09-30T17:04:06.170 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.153544879, 2023-09-30T17:04:06.170 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.15875742200000001, 2023-09-30T17:04:06.170 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.170 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.170 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.170 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.170 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.170 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98537 2023-09-30T17:04:06.170 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.171 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.171 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.171 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.171 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.617243+0000", 2023-09-30T17:04:06.171 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.171 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.171 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.171 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.171 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.617243+0000", 2023-09-30T17:04:06.171 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.171 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.171 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.172 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.172 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.617244+0000", 2023-09-30T17:04:06.172 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4399999999999999e-07 2023-09-30T17:04:06.172 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.172 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.172 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.172 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.617258+0000", 2023-09-30T17:04:06.172 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3899e-05 2023-09-30T17:04:06.172 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.172 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.172 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.173 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.617265+0000", 2023-09-30T17:04:06.173 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.644e-06 2023-09-30T17:04:06.173 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.173 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.173 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.173 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.617273+0000", 2023-09-30T17:04:06.173 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6809999999999998e-06 2023-09-30T17:04:06.173 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.173 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.173 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.173 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.173 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.174 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97733 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.174 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.367387+0000", 2023-09-30T17:04:06.174 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.40340081, 2023-09-30T17:04:06.174 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.40864472299999999, 2023-09-30T17:04:06.174 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.174 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.174 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.174 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.174 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.174 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97733 2023-09-30T17:04:06.174 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.174 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.175 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.175 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.175 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.367387+0000", 2023-09-30T17:04:06.175 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.175 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.175 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.175 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.175 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.367387+0000", 2023-09-30T17:04:06.175 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.175 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.175 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.176 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.176 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.367388+0000", 2023-09-30T17:04:06.176 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3200000000000005e-07 2023-09-30T17:04:06.176 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.176 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.176 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.176 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.367400+0000", 2023-09-30T17:04:06.176 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1779e-05 2023-09-30T17:04:06.176 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.176 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.176 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.176 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.367407+0000", 2023-09-30T17:04:06.177 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.537e-06 2023-09-30T17:04:06.177 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.177 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.177 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.177 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.367413+0000", 2023-09-30T17:04:06.177 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0240000000000003e-06 2023-09-30T17:04:06.177 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.177 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.177 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.177 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.177 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.177 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97773 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.178 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.380322+0000", 2023-09-30T17:04:06.178 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.39046606499999997, 2023-09-30T17:04:06.178 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39575772799999998, 2023-09-30T17:04:06.178 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.178 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.178 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.178 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.178 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.178 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97773 2023-09-30T17:04:06.178 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.178 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.179 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.179 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.179 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.380322+0000", 2023-09-30T17:04:06.179 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.179 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.179 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.179 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.179 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.380322+0000", 2023-09-30T17:04:06.179 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.179 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.179 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.179 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.179 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.380322+0000", 2023-09-30T17:04:06.180 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3599999999999999e-07 2023-09-30T17:04:06.180 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.180 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.180 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.180 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.380334+0000", 2023-09-30T17:04:06.180 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1399e-05 2023-09-30T17:04:06.180 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.180 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.180 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.180 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.380342+0000", 2023-09-30T17:04:06.180 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7740000000000004e-06 2023-09-30T17:04:06.180 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.181 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.181 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.181 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.380347+0000", 2023-09-30T17:04:06.181 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8050000000000003e-06 2023-09-30T17:04:06.181 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.181 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.181 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.181 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.181 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.181 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97951 4.6 4.8232b686 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.181 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.436024+0000", 2023-09-30T17:04:06.181 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.33476440200000002, 2023-09-30T17:04:06.182 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.34012345599999999, 2023-09-30T17:04:06.182 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.182 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.182 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.182 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.182 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.182 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97951 2023-09-30T17:04:06.182 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.182 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.182 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.182 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.182 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.436024+0000", 2023-09-30T17:04:06.183 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.183 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.183 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.183 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.183 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.436024+0000", 2023-09-30T17:04:06.183 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.183 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.183 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.183 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.183 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.436024+0000", 2023-09-30T17:04:06.183 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4199999999999995e-07 2023-09-30T17:04:06.183 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.184 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.184 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.184 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.436038+0000", 2023-09-30T17:04:06.184 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3563e-05 2023-09-30T17:04:06.184 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.184 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.184 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.184 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.436046+0000", 2023-09-30T17:04:06.184 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5639999999999997e-06 2023-09-30T17:04:06.184 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.184 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.185 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.185 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.436053+0000", 2023-09-30T17:04:06.185 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3130000000000004e-06 2023-09-30T17:04:06.185 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.185 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.185 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.185 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.185 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.185 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98308 4.6 4.8232b686 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.185 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.539544+0000", 2023-09-30T17:04:06.186 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.23124445800000001, 2023-09-30T17:04:06.186 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23667495899999999, 2023-09-30T17:04:06.186 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.186 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.186 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.186 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.186 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.186 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98308 2023-09-30T17:04:06.186 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.186 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.186 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.186 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.187 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.539544+0000", 2023-09-30T17:04:06.187 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.187 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.187 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.187 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.187 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.539544+0000", 2023-09-30T17:04:06.187 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.187 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.187 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.187 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.187 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.539544+0000", 2023-09-30T17:04:06.188 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.06e-07 2023-09-30T17:04:06.188 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.188 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.188 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.188 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.539559+0000", 2023-09-30T17:04:06.188 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4800000000000001e-05 2023-09-30T17:04:06.188 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.188 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.188 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.188 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.539567+0000", 2023-09-30T17:04:06.188 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5900000000000002e-06 2023-09-30T17:04:06.189 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.189 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.189 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.189 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.539572+0000", 2023-09-30T17:04:06.189 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5459999999999999e-06 2023-09-30T17:04:06.189 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.189 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.189 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.189 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.189 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.189 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98336 4.36 4.670445b6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.189 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.548586+0000", 2023-09-30T17:04:06.190 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.222202287, 2023-09-30T17:04:06.190 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.227702449, 2023-09-30T17:04:06.190 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.190 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.190 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.190 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.190 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.190 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98336 2023-09-30T17:04:06.190 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.190 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.190 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.190 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.191 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.548586+0000", 2023-09-30T17:04:06.191 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.191 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.191 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.191 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.191 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.548586+0000", 2023-09-30T17:04:06.191 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.191 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.191 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.191 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.191 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.548586+0000", 2023-09-30T17:04:06.192 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6899999999999998e-07 2023-09-30T17:04:06.192 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.192 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.192 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.192 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.548599+0000", 2023-09-30T17:04:06.192 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2548000000000001e-05 2023-09-30T17:04:06.192 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.192 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.192 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.192 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.548605+0000", 2023-09-30T17:04:06.192 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5130000000000002e-06 2023-09-30T17:04:06.192 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.193 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.193 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.193 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.548611+0000", 2023-09-30T17:04:06.193 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4160000000000003e-06 2023-09-30T17:04:06.193 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.193 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.193 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.193 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.193 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.193 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98745 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.193 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.674084+0000", 2023-09-30T17:04:06.193 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.096704079999999998, 2023-09-30T17:04:06.194 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.102270351, 2023-09-30T17:04:06.194 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.194 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.194 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.194 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.194 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.194 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98745 2023-09-30T17:04:06.194 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.194 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.194 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.195 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.195 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.674084+0000", 2023-09-30T17:04:06.195 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.195 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.195 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.195 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.195 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.674084+0000", 2023-09-30T17:04:06.195 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.195 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.195 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.195 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.196 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.674893+0000", 2023-09-30T17:04:06.196 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00080902299999999997 2023-09-30T17:04:06.196 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.196 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.196 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.196 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.674911+0000", 2023-09-30T17:04:06.196 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8318e-05 2023-09-30T17:04:06.196 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.196 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.196 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.196 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.674923+0000", 2023-09-30T17:04:06.196 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1294000000000001e-05 2023-09-30T17:04:06.197 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.197 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.197 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.197 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.674932+0000", 2023-09-30T17:04:06.197 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9460000000000004e-06 2023-09-30T17:04:06.197 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.197 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.197 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.197 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.197 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.197 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98775 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.197 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.687204+0000", 2023-09-30T17:04:06.198 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.083583955000000001, 2023-09-30T17:04:06.198 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.089218869000000006, 2023-09-30T17:04:06.198 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.198 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.198 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.198 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.198 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.198 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98775 2023-09-30T17:04:06.198 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.198 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.198 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.199 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.199 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.687204+0000", 2023-09-30T17:04:06.199 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.199 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.199 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.199 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.199 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.687204+0000", 2023-09-30T17:04:06.199 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.199 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.199 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.199 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.199 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.687205+0000", 2023-09-30T17:04:06.200 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8800000000000002e-07 2023-09-30T17:04:06.200 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.200 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.200 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.200 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.687216+0000", 2023-09-30T17:04:06.200 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1771e-05 2023-09-30T17:04:06.200 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.200 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.200 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.200 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.687224+0000", 2023-09-30T17:04:06.200 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1679999999999998e-06 2023-09-30T17:04:06.200 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.201 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.201 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.201 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.687230+0000", 2023-09-30T17:04:06.201 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3219999999999998e-06 2023-09-30T17:04:06.201 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.201 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.201 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.201 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.201 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.201 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98968 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.201 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.747679+0000", 2023-09-30T17:04:06.201 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.023108619, 2023-09-30T17:04:06.202 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.028806207, 2023-09-30T17:04:06.202 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.202 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.202 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.202 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.202 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.202 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98968 2023-09-30T17:04:06.202 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.202 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.202 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.202 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.203 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.747679+0000", 2023-09-30T17:04:06.203 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.203 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.203 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.203 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.203 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.747679+0000", 2023-09-30T17:04:06.203 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.203 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.203 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.203 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.203 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.747680+0000", 2023-09-30T17:04:06.203 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9100000000000003e-07 2023-09-30T17:04:06.204 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.204 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.204 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.204 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.747694+0000", 2023-09-30T17:04:06.204 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3865e-05 2023-09-30T17:04:06.204 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.204 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.204 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.204 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.747713+0000", 2023-09-30T17:04:06.204 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8887999999999999e-05 2023-09-30T17:04:06.204 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.205 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.205 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.205 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.747724+0000", 2023-09-30T17:04:06.205 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0781000000000001e-05 2023-09-30T17:04:06.205 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.205 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.205 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.205 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.205 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.205 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:98427 4.f e50/17 4:f2a80dfe:::100000001f8.00000019:head v 50'4674, mlcod=50'4665)", 2023-09-30T17:04:06.205 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.762484+0000", 2023-09-30T17:04:06.205 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0083041469999999996, 2023-09-30T17:04:06.206 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.014069063999999999, 2023-09-30T17:04:06.206 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.206 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:06.206 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.206 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.206 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.206 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.762484+0000", 2023-09-30T17:04:06.206 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.206 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.206 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.206 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.207 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.762484+0000", 2023-09-30T17:04:06.207 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.207 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.207 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.207 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.207 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.762485+0000", 2023-09-30T17:04:06.207 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.37e-07 2023-09-30T17:04:06.207 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.207 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.207 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.207 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.762499+0000", 2023-09-30T17:04:06.208 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4569000000000001e-05 2023-09-30T17:04:06.208 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.208 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.208 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.208 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.762508+0000", 2023-09-30T17:04:06.208 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3810000000000005e-06 2023-09-30T17:04:06.208 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.208 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.208 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.208 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.762515+0000", 2023-09-30T17:04:06.208 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9779999999999999e-06 2023-09-30T17:04:06.208 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.209 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.209 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:06.209 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.764393+0000", 2023-09-30T17:04:06.209 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0018772629999999999 2023-09-30T17:04:06.209 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.209 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.209 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:06.209 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.764412+0000", 2023-09-30T17:04:06.209 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9249000000000002e-05 2023-09-30T17:04:06.209 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.209 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.210 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.210 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.210 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.210 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97593 4.6 4:63e80496:::100000001f8.0000001e:head [write 1363968~4096 in=4096b,write 1380352~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:06.210 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.326010+0000", 2023-09-30T17:04:06.210 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.44477840699999999, 2023-09-30T17:04:06.210 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.450629483, 2023-09-30T17:04:06.210 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.210 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:06.210 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.210 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.210 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.211 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97593 2023-09-30T17:04:06.211 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.211 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.211 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.211 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.211 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.326010+0000", 2023-09-30T17:04:06.211 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.211 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.211 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.211 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.211 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.326010+0000", 2023-09-30T17:04:06.211 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.212 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.212 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.212 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.212 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.326010+0000", 2023-09-30T17:04:06.212 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5999999999999999e-07 2023-09-30T17:04:06.212 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.212 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.212 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.212 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.326020+0000", 2023-09-30T17:04:06.212 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.9920000000000002e-06 2023-09-30T17:04:06.212 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.213 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.213 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.213 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.326024+0000", 2023-09-30T17:04:06.213 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2459999999999997e-06 2023-09-30T17:04:06.213 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.213 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.213 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.213 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.326028+0000", 2023-09-30T17:04:06.213 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.2799999999999999e-06 2023-09-30T17:04:06.213 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.213 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.213 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:06.214 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.761431+0000", 2023-09-30T17:04:06.214 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.43540393199999999 2023-09-30T17:04:06.214 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.214 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.214 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:06.214 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.761510+0000", 2023-09-30T17:04:06.214 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8621999999999994e-05 2023-09-30T17:04:06.214 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.214 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.214 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:06.214 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.761668+0000", 2023-09-30T17:04:06.214 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015813000000000001 2023-09-30T17:04:06.215 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.215 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.215 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:06.215 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.775328+0000", 2023-09-30T17:04:06.215 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.01365977 2023-09-30T17:04:06.215 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.215 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.215 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.215 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.215 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.215 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97953 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.215 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.436063+0000", 2023-09-30T17:04:06.216 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.33472497299999998, 2023-09-30T17:04:06.216 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.340671952, 2023-09-30T17:04:06.216 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.216 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.216 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.216 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.216 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.216 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97953 2023-09-30T17:04:06.216 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.216 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.216 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.217 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.217 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.436063+0000", 2023-09-30T17:04:06.217 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.217 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.217 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.217 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.217 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.436063+0000", 2023-09-30T17:04:06.217 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.217 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.217 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.217 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.217 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.436064+0000", 2023-09-30T17:04:06.218 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2300000000000001e-07 2023-09-30T17:04:06.218 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.218 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.218 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.218 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.436076+0000", 2023-09-30T17:04:06.218 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2371999999999999e-05 2023-09-30T17:04:06.218 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.218 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.218 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.218 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.436083+0000", 2023-09-30T17:04:06.218 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2049999999999996e-06 2023-09-30T17:04:06.218 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.219 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.219 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.219 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.436089+0000", 2023-09-30T17:04:06.219 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4060000000000004e-06 2023-09-30T17:04:06.219 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.219 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.219 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.219 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.219 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.219 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98278 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.220 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.533295+0000", 2023-09-30T17:04:06.220 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.23749298099999999, 2023-09-30T17:04:06.220 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.243500147, 2023-09-30T17:04:06.220 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.220 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.220 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.220 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.220 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.220 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98278 2023-09-30T17:04:06.220 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.220 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.221 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.221 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.221 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.533295+0000", 2023-09-30T17:04:06.221 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.221 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.221 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.221 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.221 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.533295+0000", 2023-09-30T17:04:06.221 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.221 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.221 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.221 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.222 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.533296+0000", 2023-09-30T17:04:06.222 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0999999999999999e-07 2023-09-30T17:04:06.222 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.222 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.222 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.222 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.533306+0000", 2023-09-30T17:04:06.222 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0314e-05 2023-09-30T17:04:06.222 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.222 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.222 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.222 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.533313+0000", 2023-09-30T17:04:06.223 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8959999999999997e-06 2023-09-30T17:04:06.223 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.223 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.223 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.223 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.533318+0000", 2023-09-30T17:04:06.223 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3040000000000004e-06 2023-09-30T17:04:06.223 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.223 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.223 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.223 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.223 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.224 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98571 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.224 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.625255+0000", 2023-09-30T17:04:06.224 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.14553313200000001, 2023-09-30T17:04:06.224 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.15159878299999999, 2023-09-30T17:04:06.224 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.224 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.224 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.224 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.224 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.224 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98571 2023-09-30T17:04:06.225 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.225 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.225 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.225 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.225 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.625255+0000", 2023-09-30T17:04:06.225 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.225 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.225 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.225 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.225 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.625255+0000", 2023-09-30T17:04:06.226 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.226 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.226 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.226 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.226 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.625255+0000", 2023-09-30T17:04:06.226 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5499999999999998e-07 2023-09-30T17:04:06.226 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.226 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.226 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.226 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.625268+0000", 2023-09-30T17:04:06.226 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2544000000000001e-05 2023-09-30T17:04:06.227 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.227 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.227 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.227 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.625275+0000", 2023-09-30T17:04:06.227 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.216e-06 2023-09-30T17:04:06.227 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.227 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.227 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.227 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.625281+0000", 2023-09-30T17:04:06.227 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8710000000000002e-06 2023-09-30T17:04:06.227 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.228 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.228 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.228 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.228 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.228 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98706 4.6 4.8232b686 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.228 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.666402+0000", 2023-09-30T17:04:06.228 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.104385725, 2023-09-30T17:04:06.228 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.110508967, 2023-09-30T17:04:06.228 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.229 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.229 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.229 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.229 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.229 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98706 2023-09-30T17:04:06.229 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.229 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.229 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.229 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.229 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.666402+0000", 2023-09-30T17:04:06.229 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.230 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.230 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.230 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.230 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.666402+0000", 2023-09-30T17:04:06.230 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.230 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.230 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.230 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.230 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.666403+0000", 2023-09-30T17:04:06.230 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1300000000000001e-07 2023-09-30T17:04:06.231 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.231 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.231 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.231 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.666412+0000", 2023-09-30T17:04:06.231 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.6239999999999997e-06 2023-09-30T17:04:06.231 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.231 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.231 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.231 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.666418+0000", 2023-09-30T17:04:06.231 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8930000000000002e-06 2023-09-30T17:04:06.232 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.232 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.232 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.232 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.666422+0000", 2023-09-30T17:04:06.232 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.428e-06 2023-09-30T17:04:06.232 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.232 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.232 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.232 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.232 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.232 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98808 4.36 4.670445b6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.233 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.698202+0000", 2023-09-30T17:04:06.233 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.072586541000000004, 2023-09-30T17:04:06.233 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.078771146, 2023-09-30T17:04:06.233 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.233 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.233 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.233 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.233 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.233 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98808 2023-09-30T17:04:06.233 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.233 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.234 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.234 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.234 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.698202+0000", 2023-09-30T17:04:06.234 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.234 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.234 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.234 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.234 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.698202+0000", 2023-09-30T17:04:06.234 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.234 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.234 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.234 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.235 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.699613+0000", 2023-09-30T17:04:06.235 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001411575 2023-09-30T17:04:06.235 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.235 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.235 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.235 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.699633+0000", 2023-09-30T17:04:06.235 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.0102000000000002e-05 2023-09-30T17:04:06.235 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.235 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.235 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.236 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.699642+0000", 2023-09-30T17:04:06.236 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5720000000000003e-06 2023-09-30T17:04:06.236 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.236 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.236 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.236 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.699647+0000", 2023-09-30T17:04:06.236 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2310000000000004e-06 2023-09-30T17:04:06.236 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.236 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.236 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.236 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.236 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.237 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98481 4.36 4.670445b6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.237 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.588171+0000", 2023-09-30T17:04:06.237 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.18261682900000001, 2023-09-30T17:04:06.237 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.18885728900000001, 2023-09-30T17:04:06.237 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.237 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.237 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.237 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.237 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.237 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98481 2023-09-30T17:04:06.237 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.238 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.238 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.238 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.238 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.588171+0000", 2023-09-30T17:04:06.238 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.238 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.238 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.238 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.238 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.588171+0000", 2023-09-30T17:04:06.238 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.238 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.238 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.239 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.239 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.594185+0000", 2023-09-30T17:04:06.239 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.006013984 2023-09-30T17:04:06.239 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.239 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.239 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.239 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.594207+0000", 2023-09-30T17:04:06.239 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1699999999999999e-05 2023-09-30T17:04:06.239 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.239 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.239 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.239 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.594218+0000", 2023-09-30T17:04:06.240 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0648999999999999e-05 2023-09-30T17:04:06.240 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.240 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.240 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.240 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.594225+0000", 2023-09-30T17:04:06.240 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6620000000000005e-06 2023-09-30T17:04:06.240 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.240 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.240 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.240 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.240 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.240 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97629 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:06.241 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.337057+0000", 2023-09-30T17:04:06.241 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.433731011, 2023-09-30T17:04:06.241 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.44003566300000002, 2023-09-30T17:04:06.241 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.241 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.241 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.241 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.241 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.241 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97629 2023-09-30T17:04:06.241 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.241 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.241 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.242 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.242 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.337057+0000", 2023-09-30T17:04:06.242 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.242 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.242 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.242 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.242 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.337057+0000", 2023-09-30T17:04:06.242 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.242 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.242 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.242 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.242 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.337057+0000", 2023-09-30T17:04:06.243 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.46e-07 2023-09-30T17:04:06.243 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.243 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.243 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.243 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.337067+0000", 2023-09-30T17:04:06.243 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2529999999999993e-06 2023-09-30T17:04:06.243 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.243 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.243 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.243 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.337073+0000", 2023-09-30T17:04:06.243 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0889999999999996e-06 2023-09-30T17:04:06.243 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.244 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.244 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.244 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.337076+0000", 2023-09-30T17:04:06.244 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5650000000000002e-06 2023-09-30T17:04:06.244 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.244 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.244 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.244 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.244 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.244 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97927 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.245 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.423115+0000", 2023-09-30T17:04:06.245 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.347673016, 2023-09-30T17:04:06.245 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.35408168400000001, 2023-09-30T17:04:06.245 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.245 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.245 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.245 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.245 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.245 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97927 2023-09-30T17:04:06.245 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.245 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.245 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.246 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.246 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.423115+0000", 2023-09-30T17:04:06.246 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.246 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.246 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.246 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.246 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.423115+0000", 2023-09-30T17:04:06.246 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.246 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.246 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.246 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.247 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.423116+0000", 2023-09-30T17:04:06.247 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7400000000000003e-07 2023-09-30T17:04:06.247 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.247 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.247 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.247 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.423129+0000", 2023-09-30T17:04:06.247 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3718e-05 2023-09-30T17:04:06.247 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.247 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.247 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.247 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.423137+0000", 2023-09-30T17:04:06.247 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8939999999999993e-06 2023-09-30T17:04:06.248 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.248 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.248 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.248 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.423143+0000", 2023-09-30T17:04:06.248 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1970000000000001e-06 2023-09-30T17:04:06.248 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.248 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.248 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.248 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.248 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.248 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97985 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.248 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.443712+0000", 2023-09-30T17:04:06.249 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.327076386, 2023-09-30T17:04:06.249 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.33355863499999999, 2023-09-30T17:04:06.249 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.249 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.249 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.249 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.249 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.249 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97985 2023-09-30T17:04:06.249 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.249 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.249 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.249 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.249 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.443712+0000", 2023-09-30T17:04:06.250 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.250 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.250 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.250 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.250 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.443712+0000", 2023-09-30T17:04:06.250 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.250 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.250 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.250 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.250 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.443712+0000", 2023-09-30T17:04:06.250 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3499999999999996e-07 2023-09-30T17:04:06.250 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.251 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.251 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.251 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.443725+0000", 2023-09-30T17:04:06.251 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2459999999999999e-05 2023-09-30T17:04:06.251 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.251 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.251 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.251 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.443732+0000", 2023-09-30T17:04:06.251 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9940000000000003e-06 2023-09-30T17:04:06.251 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.251 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.251 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.252 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.443737+0000", 2023-09-30T17:04:06.252 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2750000000000003e-06 2023-09-30T17:04:06.252 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.252 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.252 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.252 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.252 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.252 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98283 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.252 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.533358+0000", 2023-09-30T17:04:06.252 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.237430472, 2023-09-30T17:04:06.252 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.24397123700000001, 2023-09-30T17:04:06.252 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.252 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.253 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.253 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.253 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.253 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98283 2023-09-30T17:04:06.253 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.253 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.253 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.253 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.253 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.533358+0000", 2023-09-30T17:04:06.253 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.253 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.253 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.254 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.254 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.533358+0000", 2023-09-30T17:04:06.254 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.254 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.254 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.254 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.254 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.533358+0000", 2023-09-30T17:04:06.254 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2800000000000002e-07 2023-09-30T17:04:06.254 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.254 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.254 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.254 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.533370+0000", 2023-09-30T17:04:06.254 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1617000000000001e-05 2023-09-30T17:04:06.255 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.255 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.255 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.255 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.533376+0000", 2023-09-30T17:04:06.255 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0140000000000004e-06 2023-09-30T17:04:06.255 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.255 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.255 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.255 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.533381+0000", 2023-09-30T17:04:06.255 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9599999999999999e-06 2023-09-30T17:04:06.257 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.257 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.257 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.257 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.257 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.257 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98312 4.6 4.2d31fac6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.257 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.539726+0000", 2023-09-30T17:04:06.257 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.23106249000000001, 2023-09-30T17:04:06.257 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.237659707, 2023-09-30T17:04:06.257 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.258 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.258 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.258 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.258 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.258 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98312 2023-09-30T17:04:06.258 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.258 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.258 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.259 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.259 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.539726+0000", 2023-09-30T17:04:06.259 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.259 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.259 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.259 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.259 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.539726+0000", 2023-09-30T17:04:06.259 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.259 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.259 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.259 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.259 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.539726+0000", 2023-09-30T17:04:06.260 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.51e-07 2023-09-30T17:04:06.260 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.260 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.260 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.260 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.539788+0000", 2023-09-30T17:04:06.260 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2286999999999995e-05 2023-09-30T17:04:06.260 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.260 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.260 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.260 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.539795+0000", 2023-09-30T17:04:06.260 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1180000000000003e-06 2023-09-30T17:04:06.260 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.261 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.261 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.261 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.539801+0000", 2023-09-30T17:04:06.261 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1429999999999997e-06 2023-09-30T17:04:06.261 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.261 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.261 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.261 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.261 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.261 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98338 4.e 4.c27217ce (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.261 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.549254+0000", 2023-09-30T17:04:06.262 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.22153371699999999, 2023-09-30T17:04:06.262 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22819052200000001, 2023-09-30T17:04:06.262 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.262 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.262 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.262 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.262 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.262 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98338 2023-09-30T17:04:06.262 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.262 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.263 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.263 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.263 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.549254+0000", 2023-09-30T17:04:06.263 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.263 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.263 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.263 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.263 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.549254+0000", 2023-09-30T17:04:06.263 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.263 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.263 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.264 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.264 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.549255+0000", 2023-09-30T17:04:06.264 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3000000000000001e-07 2023-09-30T17:04:06.264 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.264 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.264 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.264 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.549267+0000", 2023-09-30T17:04:06.264 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2319e-05 2023-09-30T17:04:06.264 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.264 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.264 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.264 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.549275+0000", 2023-09-30T17:04:06.265 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9889999999999992e-06 2023-09-30T17:04:06.265 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.265 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.265 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.265 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.549281+0000", 2023-09-30T17:04:06.265 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5790000000000003e-06 2023-09-30T17:04:06.265 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.265 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.265 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.265 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.265 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.265 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98711 4.27 4:e68799fb:::100000001f8.00000018:head [write 2093056~4096 in=4096b,write 2125824~4096 in=4096b,write 2306048~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.266 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.666796+0000", 2023-09-30T17:04:06.266 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.103991968, 2023-09-30T17:04:06.266 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.110711774, 2023-09-30T17:04:06.266 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.266 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:06.266 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.266 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.266 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.266 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98711 2023-09-30T17:04:06.266 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.267 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.267 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.267 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.267 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.666796+0000", 2023-09-30T17:04:06.267 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.267 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.267 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.267 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.267 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.666796+0000", 2023-09-30T17:04:06.267 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.267 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.267 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.268 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.268 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.666797+0000", 2023-09-30T17:04:06.268 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.6400000000000002e-07 2023-09-30T17:04:06.268 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.268 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.268 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.268 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.666813+0000", 2023-09-30T17:04:06.268 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5874000000000001e-05 2023-09-30T17:04:06.268 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.268 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.268 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.268 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.666823+0000", 2023-09-30T17:04:06.269 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0462000000000001e-05 2023-09-30T17:04:06.269 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.269 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.269 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.269 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.666829+0000", 2023-09-30T17:04:06.269 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.387e-06 2023-09-30T17:04:06.269 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.269 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.269 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:06.269 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.754881+0000", 2023-09-30T17:04:06.269 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.088051830999999997 2023-09-30T17:04:06.269 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.270 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.270 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:06.270 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.754993+0000", 2023-09-30T17:04:06.270 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000111261 2023-09-30T17:04:06.270 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.270 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.270 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.270 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.270 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.270 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98874 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.270 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.716938+0000", 2023-09-30T17:04:06.270 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.053850477000000001, 2023-09-30T17:04:06.271 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.060644462000000003, 2023-09-30T17:04:06.271 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.271 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.271 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.271 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.271 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.271 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98874 2023-09-30T17:04:06.271 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.271 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.271 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.271 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.271 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.716938+0000", 2023-09-30T17:04:06.271 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.272 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.272 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.272 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.272 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.716938+0000", 2023-09-30T17:04:06.272 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.272 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.272 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.272 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.272 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.716938+0000", 2023-09-30T17:04:06.272 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4099999999999999e-07 2023-09-30T17:04:06.272 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.272 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.273 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.273 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.716947+0000", 2023-09-30T17:04:06.273 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3740000000000004e-06 2023-09-30T17:04:06.273 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.273 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.273 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.273 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.716954+0000", 2023-09-30T17:04:06.273 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0280000000000003e-06 2023-09-30T17:04:06.273 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.273 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.273 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.273 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.716959+0000", 2023-09-30T17:04:06.273 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.831e-06 2023-09-30T17:04:06.274 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.274 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.274 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.274 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.274 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.274 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97599 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 2433024~4096 in=4096b,write 2482176~4096 in=4096b,write 2543616~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:06.274 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.326073+0000", 2023-09-30T17:04:06.274 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.44471521899999999, 2023-09-30T17:04:06.274 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.451572849, 2023-09-30T17:04:06.274 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.274 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:06.274 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.275 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.275 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.275 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97599 2023-09-30T17:04:06.275 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.275 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.275 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.275 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.275 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.326073+0000", 2023-09-30T17:04:06.275 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.275 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.275 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.275 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.276 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.326073+0000", 2023-09-30T17:04:06.276 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.276 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.276 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.276 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.276 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.326073+0000", 2023-09-30T17:04:06.276 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.22e-07 2023-09-30T17:04:06.276 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.276 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.276 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.276 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.326081+0000", 2023-09-30T17:04:06.276 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7689999999999996e-06 2023-09-30T17:04:06.277 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.277 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.277 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.277 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.326084+0000", 2023-09-30T17:04:06.277 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.534e-06 2023-09-30T17:04:06.277 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.277 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.277 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.277 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.326087+0000", 2023-09-30T17:04:06.277 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0340000000000001e-06 2023-09-30T17:04:06.277 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.278 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.278 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:06.278 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.763712+0000", 2023-09-30T17:04:06.278 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.43762453699999998 2023-09-30T17:04:06.278 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.278 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.278 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:06.278 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.763797+0000", 2023-09-30T17:04:06.278 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4956000000000004e-05 2023-09-30T17:04:06.278 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.278 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.279 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:06.279 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.763949+0000", 2023-09-30T17:04:06.279 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015216900000000001 2023-09-30T17:04:06.279 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.279 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.279 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:06.279 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.776913+0000", 2023-09-30T17:04:06.279 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.012964402 2023-09-30T17:04:06.279 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.279 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.279 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.279 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.280 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.280 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98288 4.36 4.670445b6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.280 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.533387+0000", 2023-09-30T17:04:06.280 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.237401363, 2023-09-30T17:04:06.280 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.24434803799999999, 2023-09-30T17:04:06.280 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.280 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.280 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.280 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.280 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.280 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98288 2023-09-30T17:04:06.280 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.281 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.281 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.281 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.281 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.533387+0000", 2023-09-30T17:04:06.281 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.281 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.281 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.281 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.281 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.533387+0000", 2023-09-30T17:04:06.281 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.281 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.282 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.282 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.282 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.533387+0000", 2023-09-30T17:04:06.282 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.1100000000000002e-07 2023-09-30T17:04:06.282 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.282 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.282 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.282 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.533399+0000", 2023-09-30T17:04:06.282 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2334000000000001e-05 2023-09-30T17:04:06.282 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.282 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.282 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.283 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.533405+0000", 2023-09-30T17:04:06.283 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5849999999999999e-06 2023-09-30T17:04:06.283 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.326 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.326 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.326 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.533409+0000", 2023-09-30T17:04:06.327 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5739999999999997e-06 2023-09-30T17:04:06.327 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.327 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.327 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.327 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.327 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.327 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98313 4.36 4.670445b6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.327 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.539808+0000", 2023-09-30T17:04:06.327 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.230980304, 2023-09-30T17:04:06.327 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23799772799999999, 2023-09-30T17:04:06.328 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.328 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.328 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.328 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.328 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.328 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98313 2023-09-30T17:04:06.328 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.328 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.328 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.329 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.329 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.539808+0000", 2023-09-30T17:04:06.329 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.329 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.329 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.329 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.329 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.539808+0000", 2023-09-30T17:04:06.329 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.329 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.329 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.330 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.330 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.539808+0000", 2023-09-30T17:04:06.330 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2899999999999999e-07 2023-09-30T17:04:06.330 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.330 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.330 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.330 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.539821+0000", 2023-09-30T17:04:06.330 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3324e-05 2023-09-30T17:04:06.330 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.331 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.331 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.331 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.539828+0000", 2023-09-30T17:04:06.331 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0100000000000001e-06 2023-09-30T17:04:06.331 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.331 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.331 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.331 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.539832+0000", 2023-09-30T17:04:06.332 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7670000000000003e-06 2023-09-30T17:04:06.332 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.332 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.332 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.332 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.332 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.332 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98372 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.332 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.561601+0000", 2023-09-30T17:04:06.333 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.20918753400000001, 2023-09-30T17:04:06.333 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.216275154, 2023-09-30T17:04:06.333 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.333 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.333 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.333 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.333 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.333 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98372 2023-09-30T17:04:06.333 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.333 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.334 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.334 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.334 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.561601+0000", 2023-09-30T17:04:06.334 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.334 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.334 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.334 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.334 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.561601+0000", 2023-09-30T17:04:06.334 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.335 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.335 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.335 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.335 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.561601+0000", 2023-09-30T17:04:06.335 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3500000000000002e-07 2023-09-30T17:04:06.335 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.335 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.335 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.336 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.561613+0000", 2023-09-30T17:04:06.336 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1952e-05 2023-09-30T17:04:06.336 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.336 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.336 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.336 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.561619+0000", 2023-09-30T17:04:06.336 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2269999999999998e-06 2023-09-30T17:04:06.336 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.336 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.336 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.337 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.561624+0000", 2023-09-30T17:04:06.337 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3689999999999998e-06 2023-09-30T17:04:06.337 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.337 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.337 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.337 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.337 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.337 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98483 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.338 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.594279+0000", 2023-09-30T17:04:06.338 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.176508834, 2023-09-30T17:04:06.338 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.18366922599999999, 2023-09-30T17:04:06.338 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.338 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.338 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.338 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.338 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.338 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98483 2023-09-30T17:04:06.339 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.339 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.339 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.339 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.339 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.594279+0000", 2023-09-30T17:04:06.339 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.339 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.339 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.339 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.339 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.594279+0000", 2023-09-30T17:04:06.339 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.339 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.340 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.340 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.340 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.594280+0000", 2023-09-30T17:04:06.340 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6499999999999999e-07 2023-09-30T17:04:06.340 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.340 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.340 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.340 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.594292+0000", 2023-09-30T17:04:06.341 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2251e-05 2023-09-30T17:04:06.341 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.341 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.341 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.341 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.594299+0000", 2023-09-30T17:04:06.341 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.452e-06 2023-09-30T17:04:06.341 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.341 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.342 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.342 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.594305+0000", 2023-09-30T17:04:06.342 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6879999999999996e-06 2023-09-30T17:04:06.342 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.342 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.342 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.342 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.342 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.342 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98780 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.343 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.688434+0000", 2023-09-30T17:04:06.343 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.082353761999999997, 2023-09-30T17:04:06.343 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.089586009999999994, 2023-09-30T17:04:06.343 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.343 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.343 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.343 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.343 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.343 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98780 2023-09-30T17:04:06.343 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.344 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.344 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.344 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.344 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.688434+0000", 2023-09-30T17:04:06.344 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.344 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.344 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.344 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.344 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.688434+0000", 2023-09-30T17:04:06.344 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.344 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.345 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.345 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.345 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.688435+0000", 2023-09-30T17:04:06.345 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8299999999999996e-07 2023-09-30T17:04:06.345 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.345 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.345 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.345 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.688455+0000", 2023-09-30T17:04:06.345 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9534999999999998e-05 2023-09-30T17:04:06.345 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.345 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.346 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.346 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.688468+0000", 2023-09-30T17:04:06.346 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3648e-05 2023-09-30T17:04:06.346 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.346 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.346 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.346 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.688476+0000", 2023-09-30T17:04:06.346 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6620000000000005e-06 2023-09-30T17:04:06.347 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.347 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.347 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.347 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.347 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.347 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98814 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.347 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.699701+0000", 2023-09-30T17:04:06.347 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.071087096000000002, 2023-09-30T17:04:06.347 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.078387155, 2023-09-30T17:04:06.347 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.348 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.348 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.348 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.348 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.348 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98814 2023-09-30T17:04:06.348 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.348 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.348 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.348 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.348 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.699701+0000", 2023-09-30T17:04:06.348 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.349 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.349 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.349 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.349 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.699701+0000", 2023-09-30T17:04:06.349 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.349 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.349 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.349 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.350 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.699701+0000", 2023-09-30T17:04:06.350 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.3799999999999999e-07 2023-09-30T17:04:06.350 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.350 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.350 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.350 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.699712+0000", 2023-09-30T17:04:06.350 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0689999999999999e-05 2023-09-30T17:04:06.350 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.350 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.350 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.351 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.699719+0000", 2023-09-30T17:04:06.351 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7209999999999997e-06 2023-09-30T17:04:06.351 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.351 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.351 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.351 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.699724+0000", 2023-09-30T17:04:06.351 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.434e-06 2023-09-30T17:04:06.351 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.351 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.351 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.351 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.351 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.352 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:99016 4.14 4:2b28d75f:::100000001f8.00000016:head [write 1630208~4096 in=4096b,write 1716224~4096 in=4096b,write 1810432~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.352 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.765060+0000", 2023-09-30T17:04:06.352 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0057285269999999998, 2023-09-30T17:04:06.352 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.013113061000000001, 2023-09-30T17:04:06.352 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.352 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:06.352 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.352 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.352 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.352 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 99016 2023-09-30T17:04:06.352 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.352 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.353 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.353 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.353 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.765060+0000", 2023-09-30T17:04:06.353 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.353 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.353 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.353 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.353 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.765060+0000", 2023-09-30T17:04:06.353 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.353 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.354 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.354 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.354 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.765061+0000", 2023-09-30T17:04:06.354 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.094e-06 2023-09-30T17:04:06.354 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.354 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.354 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.354 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.765073+0000", 2023-09-30T17:04:06.354 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2527000000000001e-05 2023-09-30T17:04:06.354 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.355 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.355 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.355 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.765086+0000", 2023-09-30T17:04:06.355 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3237e-05 2023-09-30T17:04:06.355 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.355 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.355 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.355 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.765095+0000", 2023-09-30T17:04:06.355 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3829999999999992e-06 2023-09-30T17:04:06.355 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.355 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.356 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:06.356 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.765149+0000", 2023-09-30T17:04:06.356 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4540000000000003e-05 2023-09-30T17:04:06.356 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.356 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.356 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:06.356 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.765241+0000", 2023-09-30T17:04:06.356 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2031e-05 2023-09-30T17:04:06.356 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.356 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.356 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:06.357 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.765334+0000", 2023-09-30T17:04:06.357 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3026e-05 2023-09-30T17:04:06.357 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.357 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.357 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:06.357 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.771939+0000", 2023-09-30T17:04:06.357 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0066050370000000002 2023-09-30T17:04:06.357 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.357 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.357 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.357 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.357 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.358 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97602 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 1040384~4096 in=4096b,write 1208320~4096 in=4096b,write 1282048~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:06.358 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.326092+0000", 2023-09-30T17:04:06.358 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.44469648499999997, 2023-09-30T17:04:06.358 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.45218350800000001, 2023-09-30T17:04:06.358 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.358 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:06.358 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.358 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.358 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.358 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97602 2023-09-30T17:04:06.358 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.359 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.359 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.359 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.359 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.326092+0000", 2023-09-30T17:04:06.359 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.359 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.359 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.359 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.359 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.326092+0000", 2023-09-30T17:04:06.359 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.359 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.359 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.360 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.360 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.326109+0000", 2023-09-30T17:04:06.360 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7368e-05 2023-09-30T17:04:06.360 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.360 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.360 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.360 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.326118+0000", 2023-09-30T17:04:06.360 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1169999999999993e-06 2023-09-30T17:04:06.360 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.360 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.360 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.360 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.326123+0000", 2023-09-30T17:04:06.361 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6909999999999996e-06 2023-09-30T17:04:06.361 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.361 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.361 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.361 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.326126+0000", 2023-09-30T17:04:06.361 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3850000000000002e-06 2023-09-30T17:04:06.361 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.361 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.361 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:06.361 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.763806+0000", 2023-09-30T17:04:06.361 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.437679806 2023-09-30T17:04:06.361 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.362 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.362 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:06.362 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.763876+0000", 2023-09-30T17:04:06.362 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9777000000000006e-05 2023-09-30T17:04:06.362 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.362 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.362 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:06.362 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.764028+0000", 2023-09-30T17:04:06.362 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015216700000000001 2023-09-30T17:04:06.362 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.362 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.363 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:06.363 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.776921+0000", 2023-09-30T17:04:06.363 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.01289353 2023-09-30T17:04:06.363 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.363 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.363 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.363 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.363 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.363 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97666 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:06.363 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.342670+0000", 2023-09-30T17:04:06.363 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.42811812300000002, 2023-09-30T17:04:06.363 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.43568869399999999, 2023-09-30T17:04:06.364 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.364 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.364 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.364 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.364 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.364 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97666 2023-09-30T17:04:06.364 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.364 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.364 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.364 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.364 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.342670+0000", 2023-09-30T17:04:06.364 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.365 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.365 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.365 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.365 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.342670+0000", 2023-09-30T17:04:06.365 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.365 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.365 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.365 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.365 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.342670+0000", 2023-09-30T17:04:06.365 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5499999999999999e-07 2023-09-30T17:04:06.365 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.365 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.366 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.366 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.342681+0000", 2023-09-30T17:04:06.366 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.111e-05 2023-09-30T17:04:06.366 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.366 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.366 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.366 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.342688+0000", 2023-09-30T17:04:06.366 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.173e-06 2023-09-30T17:04:06.366 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.366 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.366 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.367 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.342692+0000", 2023-09-30T17:04:06.367 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.583e-06 2023-09-30T17:04:06.367 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.367 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.367 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.367 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.367 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.367 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97930 4.6 4.2d31fac6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.367 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.425155+0000", 2023-09-30T17:04:06.367 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.345633099, 2023-09-30T17:04:06.367 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.353268207, 2023-09-30T17:04:06.367 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.368 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.368 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.368 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.368 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.368 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97930 2023-09-30T17:04:06.368 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.368 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.368 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.368 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.368 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.425155+0000", 2023-09-30T17:04:06.368 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.368 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.369 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.369 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.369 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.425155+0000", 2023-09-30T17:04:06.369 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.369 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.369 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.369 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.369 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.425156+0000", 2023-09-30T17:04:06.369 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5400000000000001e-07 2023-09-30T17:04:06.369 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.370 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.370 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.370 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.425175+0000", 2023-09-30T17:04:06.370 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9338999999999999e-05 2023-09-30T17:04:06.370 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.370 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.370 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.370 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.425185+0000", 2023-09-30T17:04:06.370 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0380999999999999e-05 2023-09-30T17:04:06.370 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.371 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.371 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.371 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.425192+0000", 2023-09-30T17:04:06.371 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2990000000000002e-06 2023-09-30T17:04:06.371 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.371 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.371 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.371 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.371 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.371 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98016 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.371 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.450873+0000", 2023-09-30T17:04:06.372 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.31991512300000002, 2023-09-30T17:04:06.372 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.32760851499999999, 2023-09-30T17:04:06.372 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.372 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.372 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.372 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.372 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.372 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98016 2023-09-30T17:04:06.372 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.372 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.372 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.373 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.373 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.450873+0000", 2023-09-30T17:04:06.373 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.373 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.373 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.373 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.373 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.450873+0000", 2023-09-30T17:04:06.373 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.373 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.373 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.373 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.373 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.453257+0000", 2023-09-30T17:04:06.374 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.002384096 2023-09-30T17:04:06.374 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.374 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.374 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.374 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.453276+0000", 2023-09-30T17:04:06.374 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8525999999999998e-05 2023-09-30T17:04:06.374 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.374 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.374 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.374 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.453289+0000", 2023-09-30T17:04:06.374 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3053e-05 2023-09-30T17:04:06.375 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.375 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.375 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.375 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.453297+0000", 2023-09-30T17:04:06.375 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5320000000000006e-06 2023-09-30T17:04:06.375 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.375 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.375 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.375 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.375 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.375 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98075 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.375 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.460544+0000", 2023-09-30T17:04:06.376 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.31024444000000001, 2023-09-30T17:04:06.376 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.31819953000000001, 2023-09-30T17:04:06.376 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.376 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.376 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.376 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.376 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.376 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98075 2023-09-30T17:04:06.376 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.376 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.376 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.377 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.377 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.460544+0000", 2023-09-30T17:04:06.377 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.377 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.377 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.377 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.377 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.460544+0000", 2023-09-30T17:04:06.377 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.377 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.377 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.377 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.378 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.460544+0000", 2023-09-30T17:04:06.378 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2799999999999996e-07 2023-09-30T17:04:06.378 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.378 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.378 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.378 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.460559+0000", 2023-09-30T17:04:06.378 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4341999999999999e-05 2023-09-30T17:04:06.378 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.378 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.378 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.378 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.460567+0000", 2023-09-30T17:04:06.379 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4090000000000003e-06 2023-09-30T17:04:06.379 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.379 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.379 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.379 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.460573+0000", 2023-09-30T17:04:06.379 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2400000000000004e-06 2023-09-30T17:04:06.379 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.379 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.379 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.379 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.379 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.380 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97640 4.6 4.2d31fac6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:06.380 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.338135+0000", 2023-09-30T17:04:06.380 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.43265277200000002, 2023-09-30T17:04:06.380 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.44067363999999998, 2023-09-30T17:04:06.380 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.380 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.380 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.380 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.380 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.380 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97640 2023-09-30T17:04:06.380 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.380 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.381 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.381 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.381 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.338135+0000", 2023-09-30T17:04:06.381 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.381 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.381 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.381 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.381 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.338135+0000", 2023-09-30T17:04:06.381 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.381 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.381 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.381 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.382 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.339947+0000", 2023-09-30T17:04:06.382 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001811537 2023-09-30T17:04:06.382 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.382 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.382 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.382 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.339964+0000", 2023-09-30T17:04:06.382 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7232999999999999e-05 2023-09-30T17:04:06.382 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.382 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.382 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.382 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.339975+0000", 2023-09-30T17:04:06.382 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0797e-05 2023-09-30T17:04:06.383 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.383 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.383 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.383 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.339982+0000", 2023-09-30T17:04:06.383 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3119999999999996e-06 2023-09-30T17:04:06.383 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.383 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.383 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.383 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.383 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.383 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97740 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.384 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.369015+0000", 2023-09-30T17:04:06.384 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.40177305400000002, 2023-09-30T17:04:06.384 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.409856318, 2023-09-30T17:04:06.384 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.384 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.384 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.384 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.384 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.384 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97740 2023-09-30T17:04:06.384 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.384 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.384 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.385 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.385 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.369015+0000", 2023-09-30T17:04:06.385 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.385 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.385 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.385 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.385 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.369015+0000", 2023-09-30T17:04:06.385 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.385 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.385 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.385 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.385 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.369522+0000", 2023-09-30T17:04:06.386 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000506775 2023-09-30T17:04:06.386 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.386 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.386 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.386 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.369545+0000", 2023-09-30T17:04:06.386 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.3649e-05 2023-09-30T17:04:06.386 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.386 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.386 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.386 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.369556+0000", 2023-09-30T17:04:06.387 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1051e-05 2023-09-30T17:04:06.387 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.387 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.387 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.387 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.369564+0000", 2023-09-30T17:04:06.387 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1879999999999996e-06 2023-09-30T17:04:06.387 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.387 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.387 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.387 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.387 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.388 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97824 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.388 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.395973+0000", 2023-09-30T17:04:06.388 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.37481456000000002, 2023-09-30T17:04:06.388 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.38295328299999998, 2023-09-30T17:04:06.388 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.388 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.388 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.388 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.388 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.388 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97824 2023-09-30T17:04:06.388 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.388 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.389 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.389 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.389 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.395973+0000", 2023-09-30T17:04:06.389 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.389 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.389 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.389 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.389 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.395973+0000", 2023-09-30T17:04:06.389 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.389 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.389 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.389 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.390 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.396003+0000", 2023-09-30T17:04:06.390 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.9275999999999999e-05 2023-09-30T17:04:06.390 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.390 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.390 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.390 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.396017+0000", 2023-09-30T17:04:06.390 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4729000000000001e-05 2023-09-30T17:04:06.390 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.390 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.390 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.390 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.396026+0000", 2023-09-30T17:04:06.390 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5040000000000002e-06 2023-09-30T17:04:06.391 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.391 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.391 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.391 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.396033+0000", 2023-09-30T17:04:06.391 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.567e-06 2023-09-30T17:04:06.391 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.391 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.391 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.391 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.391 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.391 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98226 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.391 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.519512+0000", 2023-09-30T17:04:06.392 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.25127633100000002, 2023-09-30T17:04:06.392 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.25947850300000003, 2023-09-30T17:04:06.392 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.392 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.392 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.392 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.392 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.392 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98226 2023-09-30T17:04:06.392 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.392 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.392 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.392 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.393 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.519512+0000", 2023-09-30T17:04:06.393 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.393 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.393 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.393 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.393 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.519512+0000", 2023-09-30T17:04:06.393 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.393 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.393 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.393 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.393 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.519512+0000", 2023-09-30T17:04:06.393 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1200000000000003e-07 2023-09-30T17:04:06.394 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.394 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.394 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.394 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.519524+0000", 2023-09-30T17:04:06.394 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1905999999999999e-05 2023-09-30T17:04:06.394 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.394 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.394 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.394 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.519533+0000", 2023-09-30T17:04:06.394 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3839999999999997e-06 2023-09-30T17:04:06.394 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.395 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.395 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.395 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.519539+0000", 2023-09-30T17:04:06.395 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0290000000000002e-06 2023-09-30T17:04:06.395 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.395 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.395 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.395 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.395 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.395 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98574 4.36 4.670445b6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.395 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.625386+0000", 2023-09-30T17:04:06.395 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.145402002, 2023-09-30T17:04:06.396 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.153673955, 2023-09-30T17:04:06.396 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.396 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.396 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.396 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.396 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.396 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98574 2023-09-30T17:04:06.396 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.396 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.396 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.396 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.397 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.625386+0000", 2023-09-30T17:04:06.397 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.397 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.397 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.397 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.397 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.625386+0000", 2023-09-30T17:04:06.397 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.397 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.397 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.397 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.397 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.629318+0000", 2023-09-30T17:04:06.397 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0039320869999999999 2023-09-30T17:04:06.397 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.398 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.398 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.398 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.629334+0000", 2023-09-30T17:04:06.398 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6143000000000001e-05 2023-09-30T17:04:06.398 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.398 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.398 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.398 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.629344+0000", 2023-09-30T17:04:06.398 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0077e-05 2023-09-30T17:04:06.398 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.398 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.399 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.399 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.629352+0000", 2023-09-30T17:04:06.399 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9820000000000008e-06 2023-09-30T17:04:06.399 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.399 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.399 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.399 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.399 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.399 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98626 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.399 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.639515+0000", 2023-09-30T17:04:06.399 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.131272678, 2023-09-30T17:04:06.399 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.13960760799999999, 2023-09-30T17:04:06.400 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.400 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.400 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.400 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.400 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.400 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98626 2023-09-30T17:04:06.400 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.400 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.400 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.400 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.400 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.639515+0000", 2023-09-30T17:04:06.401 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.401 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.401 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.401 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.401 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.639515+0000", 2023-09-30T17:04:06.401 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.401 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.401 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.401 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.401 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.639516+0000", 2023-09-30T17:04:06.401 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2200000000000004e-07 2023-09-30T17:04:06.401 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.402 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.402 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.402 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.639529+0000", 2023-09-30T17:04:06.402 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2719e-05 2023-09-30T17:04:06.402 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.402 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.402 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.402 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.639536+0000", 2023-09-30T17:04:06.402 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1110000000000002e-06 2023-09-30T17:04:06.402 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.402 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.403 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.403 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.639542+0000", 2023-09-30T17:04:06.403 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8599999999999998e-06 2023-09-30T17:04:06.403 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.403 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.403 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.403 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.403 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.403 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98818 4.27 4:e68799fb:::100000001f8.00000018:head [write 1409024~8192 in=8192b,write 1482752~4096 in=4096b,write 1589248~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.403 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.699733+0000", 2023-09-30T17:04:06.403 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.071055354000000001, 2023-09-30T17:04:06.404 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.079472794999999999, 2023-09-30T17:04:06.404 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.404 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:06.404 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.404 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.404 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.404 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98818 2023-09-30T17:04:06.404 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.404 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.404 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.404 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.404 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.699733+0000", 2023-09-30T17:04:06.405 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.405 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.405 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.405 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.405 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.699733+0000", 2023-09-30T17:04:06.405 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.405 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.405 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.405 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.405 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.699733+0000", 2023-09-30T17:04:06.405 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7800000000000001e-07 2023-09-30T17:04:06.405 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.406 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.406 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.406 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.699746+0000", 2023-09-30T17:04:06.406 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2482e-05 2023-09-30T17:04:06.406 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.406 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.406 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.406 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.699755+0000", 2023-09-30T17:04:06.406 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.0250000000000008e-06 2023-09-30T17:04:06.406 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.406 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.406 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.407 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.699760+0000", 2023-09-30T17:04:06.407 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5119999999999999e-06 2023-09-30T17:04:06.407 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.407 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.407 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:06.407 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.772761+0000", 2023-09-30T17:04:06.407 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.073000816999999996 2023-09-30T17:04:06.407 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.407 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.407 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:06.407 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.772848+0000", 2023-09-30T17:04:06.407 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.7083999999999995e-05 2023-09-30T17:04:06.408 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.408 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.408 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.408 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.408 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.408 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:99019 4.3f 4.a34187bf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.408 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.765875+0000", 2023-09-30T17:04:06.408 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0049128690000000003, 2023-09-30T17:04:06.408 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.013406068, 2023-09-30T17:04:06.408 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.408 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.409 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.409 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.409 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.409 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 99019 2023-09-30T17:04:06.409 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.409 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.409 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.409 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.409 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.765875+0000", 2023-09-30T17:04:06.409 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.409 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.410 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.410 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.410 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.765875+0000", 2023-09-30T17:04:06.410 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.410 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.410 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.410 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.410 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.765876+0000", 2023-09-30T17:04:06.410 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.85e-07 2023-09-30T17:04:06.410 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.410 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.411 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.411 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.765892+0000", 2023-09-30T17:04:06.411 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5777000000000002e-05 2023-09-30T17:04:06.411 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.411 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.411 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.411 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.765903+0000", 2023-09-30T17:04:06.411 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0905e-05 2023-09-30T17:04:06.411 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.411 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.412 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.412 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.765910+0000", 2023-09-30T17:04:06.412 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7449999999999995e-06 2023-09-30T17:04:06.412 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.412 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.412 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.412 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.412 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.412 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97788 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.412 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.383694+0000", 2023-09-30T17:04:06.412 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.38709443399999999, 2023-09-30T17:04:06.412 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39565284899999997, 2023-09-30T17:04:06.413 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.413 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.413 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.413 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.413 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.413 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97788 2023-09-30T17:04:06.413 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.413 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.413 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.413 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.413 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.383694+0000", 2023-09-30T17:04:06.414 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.414 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.414 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.414 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.414 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.383694+0000", 2023-09-30T17:04:06.414 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.414 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.414 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.414 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.414 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.383694+0000", 2023-09-30T17:04:06.414 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4700000000000001e-07 2023-09-30T17:04:06.414 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.415 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.415 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.415 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.383717+0000", 2023-09-30T17:04:06.415 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2697999999999999e-05 2023-09-30T17:04:06.415 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.415 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.415 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.415 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.383728+0000", 2023-09-30T17:04:06.415 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1496e-05 2023-09-30T17:04:06.415 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.415 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.416 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.416 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.383748+0000", 2023-09-30T17:04:06.416 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9057999999999999e-05 2023-09-30T17:04:06.416 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.416 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.416 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.416 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.416 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.416 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98000 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.416 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.443850+0000", 2023-09-30T17:04:06.416 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.32693818000000002, 2023-09-30T17:04:06.417 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.33555769600000002, 2023-09-30T17:04:06.417 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.417 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.417 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.417 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.417 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.417 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98000 2023-09-30T17:04:06.417 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.417 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.417 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.417 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.417 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.443850+0000", 2023-09-30T17:04:06.418 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.418 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.418 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.418 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.418 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.443850+0000", 2023-09-30T17:04:06.418 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.418 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.418 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.418 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.418 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.443850+0000", 2023-09-30T17:04:06.418 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4000000000000002e-07 2023-09-30T17:04:06.418 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.419 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.419 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.419 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.443865+0000", 2023-09-30T17:04:06.419 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4851000000000001e-05 2023-09-30T17:04:06.419 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.419 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.419 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.419 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.443872+0000", 2023-09-30T17:04:06.419 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2409999999999998e-06 2023-09-30T17:04:06.419 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.419 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.420 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.420 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.443878+0000", 2023-09-30T17:04:06.420 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5940000000000001e-06 2023-09-30T17:04:06.420 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.420 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.420 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.420 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.420 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.420 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98021 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.420 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.453372+0000", 2023-09-30T17:04:06.420 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.317416052, 2023-09-30T17:04:06.420 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.32610158700000003, 2023-09-30T17:04:06.421 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.421 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.421 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.421 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.421 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.421 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98021 2023-09-30T17:04:06.421 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.421 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.421 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.421 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.421 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.453372+0000", 2023-09-30T17:04:06.422 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.422 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.422 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.422 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.422 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.453372+0000", 2023-09-30T17:04:06.422 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.422 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.422 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.422 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.422 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.453373+0000", 2023-09-30T17:04:06.423 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5199999999999997e-07 2023-09-30T17:04:06.423 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.423 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.423 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.423 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.453390+0000", 2023-09-30T17:04:06.423 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7507999999999999e-05 2023-09-30T17:04:06.423 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.423 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.423 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.423 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.453398+0000", 2023-09-30T17:04:06.424 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3620000000000006e-06 2023-09-30T17:04:06.424 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.424 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.424 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.424 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.453406+0000", 2023-09-30T17:04:06.424 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6699999999999994e-06 2023-09-30T17:04:06.424 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.424 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.424 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.424 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.424 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.424 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98136 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.425 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.496748+0000", 2023-09-30T17:04:06.425 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.27403957499999998, 2023-09-30T17:04:06.425 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.28278814099999999, 2023-09-30T17:04:06.425 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.425 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.425 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.425 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.425 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.425 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98136 2023-09-30T17:04:06.425 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.425 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.425 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.426 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.426 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.496748+0000", 2023-09-30T17:04:06.426 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.426 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.426 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.426 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.426 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.496748+0000", 2023-09-30T17:04:06.426 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.426 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.426 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.426 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.427 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.497396+0000", 2023-09-30T17:04:06.427 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00064712099999999996 2023-09-30T17:04:06.427 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.427 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.427 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.427 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.497420+0000", 2023-09-30T17:04:06.427 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.3978999999999999e-05 2023-09-30T17:04:06.427 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.427 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.427 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.427 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.497431+0000", 2023-09-30T17:04:06.428 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1039999999999999e-05 2023-09-30T17:04:06.428 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.428 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.428 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.428 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.497438+0000", 2023-09-30T17:04:06.428 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3540000000000002e-06 2023-09-30T17:04:06.428 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.428 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.428 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.428 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.429 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.429 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98229 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.429 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.519548+0000", 2023-09-30T17:04:06.429 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.25123975799999998, 2023-09-30T17:04:06.429 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.26009061, 2023-09-30T17:04:06.429 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.429 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.429 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.429 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.429 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.429 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98229 2023-09-30T17:04:06.430 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.430 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.430 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.430 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.430 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.519548+0000", 2023-09-30T17:04:06.430 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.430 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.430 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.430 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.430 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.519548+0000", 2023-09-30T17:04:06.431 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.431 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.431 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.431 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.431 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.519549+0000", 2023-09-30T17:04:06.431 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8699999999999995e-07 2023-09-30T17:04:06.431 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.431 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.431 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.431 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.519561+0000", 2023-09-30T17:04:06.432 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2492e-05 2023-09-30T17:04:06.432 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.432 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.432 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.432 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.519569+0000", 2023-09-30T17:04:06.432 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0160000000000008e-06 2023-09-30T17:04:06.432 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.432 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.432 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.432 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.519576+0000", 2023-09-30T17:04:06.433 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0330000000000003e-06 2023-09-30T17:04:06.433 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.433 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.433 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.433 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.433 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.433 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98576 4.e 4.c27217ce (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.433 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.629375+0000", 2023-09-30T17:04:06.433 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.141412752, 2023-09-30T17:04:06.433 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.15032683499999999, 2023-09-30T17:04:06.433 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.433 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.434 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.434 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.434 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.434 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98576 2023-09-30T17:04:06.434 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.434 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.434 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.434 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.434 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.629375+0000", 2023-09-30T17:04:06.434 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.435 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.435 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.435 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.435 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.629375+0000", 2023-09-30T17:04:06.435 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.435 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.435 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.435 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.435 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.629376+0000", 2023-09-30T17:04:06.435 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8800000000000002e-07 2023-09-30T17:04:06.435 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.435 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.436 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.436 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.629389+0000", 2023-09-30T17:04:06.436 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3219e-05 2023-09-30T17:04:06.436 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.436 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.436 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.436 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.629397+0000", 2023-09-30T17:04:06.436 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9400000000000002e-06 2023-09-30T17:04:06.436 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.436 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.436 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.437 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.629404+0000", 2023-09-30T17:04:06.437 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.6390000000000003e-06 2023-09-30T17:04:06.437 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.437 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.437 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.437 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.437 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.437 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98748 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.437 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.676864+0000", 2023-09-30T17:04:06.437 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.093923636000000005, 2023-09-30T17:04:06.437 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.102899545, 2023-09-30T17:04:06.438 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.438 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.438 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.438 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.438 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.438 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98748 2023-09-30T17:04:06.438 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.438 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.438 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.438 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.438 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.676864+0000", 2023-09-30T17:04:06.439 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.439 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.439 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.439 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.439 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.676864+0000", 2023-09-30T17:04:06.439 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.439 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.439 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.439 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.439 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.676865+0000", 2023-09-30T17:04:06.440 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1900000000000003e-07 2023-09-30T17:04:06.440 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.440 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.440 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.440 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.676877+0000", 2023-09-30T17:04:06.440 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1982e-05 2023-09-30T17:04:06.440 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.440 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.440 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.440 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.676884+0000", 2023-09-30T17:04:06.440 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2960000000000001e-06 2023-09-30T17:04:06.441 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.441 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.441 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.441 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.676890+0000", 2023-09-30T17:04:06.441 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8320000000000002e-06 2023-09-30T17:04:06.441 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.441 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.441 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.441 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.441 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.441 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98295 4.6 4.2d31fac6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.441 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.533524+0000", 2023-09-30T17:04:06.442 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.23726359899999999, 2023-09-30T17:04:06.442 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.24630295099999999, 2023-09-30T17:04:06.442 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.442 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.442 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.442 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.442 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.442 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98295 2023-09-30T17:04:06.442 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.442 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.442 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.442 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.443 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.533524+0000", 2023-09-30T17:04:06.443 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.443 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.443 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.443 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.443 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.533524+0000", 2023-09-30T17:04:06.443 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.443 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.443 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.443 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.443 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.533525+0000", 2023-09-30T17:04:06.443 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7899999999999999e-07 2023-09-30T17:04:06.444 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.444 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.444 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.444 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.533536+0000", 2023-09-30T17:04:06.444 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1144999999999999e-05 2023-09-30T17:04:06.444 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.444 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.444 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.444 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.533542+0000", 2023-09-30T17:04:06.444 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.694e-06 2023-09-30T17:04:06.444 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.444 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.445 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.445 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.533546+0000", 2023-09-30T17:04:06.445 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5109999999999997e-06 2023-09-30T17:04:06.445 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.445 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.445 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.445 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.445 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.445 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98581 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.445 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.629415+0000", 2023-09-30T17:04:06.445 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.141373317, 2023-09-30T17:04:06.446 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.150474575, 2023-09-30T17:04:06.446 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.446 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.446 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.446 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.446 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.446 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98581 2023-09-30T17:04:06.446 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.446 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.446 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.446 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.446 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.629415+0000", 2023-09-30T17:04:06.447 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.447 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.447 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.447 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.447 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.629415+0000", 2023-09-30T17:04:06.447 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.447 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.447 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.447 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.447 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.629621+0000", 2023-09-30T17:04:06.447 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00020606300000000001 2023-09-30T17:04:06.447 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.448 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.448 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.448 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.629639+0000", 2023-09-30T17:04:06.448 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7985000000000001e-05 2023-09-30T17:04:06.448 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.448 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.448 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.448 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.629650+0000", 2023-09-30T17:04:06.448 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0769e-05 2023-09-30T17:04:06.448 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.448 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.449 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.449 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.629657+0000", 2023-09-30T17:04:06.449 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2830000000000004e-06 2023-09-30T17:04:06.449 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.449 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.449 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.449 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.449 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.449 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98632 4.e 4.c27217ce (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.449 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.639588+0000", 2023-09-30T17:04:06.449 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.13119969300000001, 2023-09-30T17:04:06.450 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.140363036, 2023-09-30T17:04:06.450 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.450 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.450 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.450 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.450 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.450 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98632 2023-09-30T17:04:06.450 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.450 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.450 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.450 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.450 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.639588+0000", 2023-09-30T17:04:06.451 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.451 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.451 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.451 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.451 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.639588+0000", 2023-09-30T17:04:06.451 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.451 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.451 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.451 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.451 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.639589+0000", 2023-09-30T17:04:06.451 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9500000000000003e-07 2023-09-30T17:04:06.451 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.452 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.452 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.452 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.639601+0000", 2023-09-30T17:04:06.452 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2238e-05 2023-09-30T17:04:06.452 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.452 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.452 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.452 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.639608+0000", 2023-09-30T17:04:06.452 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.379e-06 2023-09-30T17:04:06.452 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.452 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.452 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.453 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.639614+0000", 2023-09-30T17:04:06.453 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0279999999999997e-06 2023-09-30T17:04:06.453 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.453 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.453 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.453 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.453 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.453 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98970 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.453 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.750216+0000", 2023-09-30T17:04:06.453 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.020572381000000001, 2023-09-30T17:04:06.453 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.029797590999999998, 2023-09-30T17:04:06.453 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.453 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.454 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.454 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.454 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.454 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98970 2023-09-30T17:04:06.454 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.454 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.454 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.454 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.454 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.750216+0000", 2023-09-30T17:04:06.454 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.454 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.454 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.455 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.455 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.750216+0000", 2023-09-30T17:04:06.455 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.455 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.455 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.455 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.455 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.750217+0000", 2023-09-30T17:04:06.455 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.125e-06 2023-09-30T17:04:06.455 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.455 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.455 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.456 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.750230+0000", 2023-09-30T17:04:06.456 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3652000000000001e-05 2023-09-30T17:04:06.456 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.456 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.456 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.456 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.750241+0000", 2023-09-30T17:04:06.456 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0409e-05 2023-09-30T17:04:06.456 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.456 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.456 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.456 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.750248+0000", 2023-09-30T17:04:06.456 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6260000000000003e-06 2023-09-30T17:04:06.457 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.457 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.457 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.457 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.457 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.457 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:99023 4.19 4:9a4319fb:::100000001f8.0000002a:head [write 1396736~4096 in=4096b,write 1458176~4096 in=4096b,write 1478656~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.457 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.767113+0000", 2023-09-30T17:04:06.457 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0036746180000000002, 2023-09-30T17:04:06.457 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.012972132000000001, 2023-09-30T17:04:06.457 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.457 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:06.457 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.458 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.458 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.458 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 99023 2023-09-30T17:04:06.458 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.458 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.458 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.458 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.458 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.767113+0000", 2023-09-30T17:04:06.458 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.458 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.458 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.459 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.459 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.767113+0000", 2023-09-30T17:04:06.459 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.459 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.459 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.459 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.459 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.767114+0000", 2023-09-30T17:04:06.459 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7900000000000007e-07 2023-09-30T17:04:06.459 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.459 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.459 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.459 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.767127+0000", 2023-09-30T17:04:06.459 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2404e-05 2023-09-30T17:04:06.460 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.460 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.460 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.460 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.767143+0000", 2023-09-30T17:04:06.460 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6164999999999999e-05 2023-09-30T17:04:06.460 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.460 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.460 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.460 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.767151+0000", 2023-09-30T17:04:06.460 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4400000000000005e-06 2023-09-30T17:04:06.460 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.460 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.461 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:06.461 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.768478+0000", 2023-09-30T17:04:06.461 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001326886 2023-09-30T17:04:06.461 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.461 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.461 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:06.461 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.768558+0000", 2023-09-30T17:04:06.461 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9615000000000003e-05 2023-09-30T17:04:06.461 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.461 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.462 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:06.462 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.768704+0000", 2023-09-30T17:04:06.462 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014590100000000001 2023-09-30T17:04:06.462 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.462 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.462 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:06.462 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.773141+0000", 2023-09-30T17:04:06.462 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0044372530000000004 2023-09-30T17:04:06.462 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.462 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.462 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.462 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.463 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.463 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98084 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.463 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.463086+0000", 2023-09-30T17:04:06.463 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.30770193200000001, 2023-09-30T17:04:06.463 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.31709393800000002, 2023-09-30T17:04:06.463 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.463 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.463 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.463 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.463 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.465 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98084 2023-09-30T17:04:06.465 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.465 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.465 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.465 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.465 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.463086+0000", 2023-09-30T17:04:06.465 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.465 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.465 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.466 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.466 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.463086+0000", 2023-09-30T17:04:06.466 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.466 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.466 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.466 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.466 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.463451+0000", 2023-09-30T17:04:06.466 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00036464499999999998 2023-09-30T17:04:06.466 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.466 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.466 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.467 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.463469+0000", 2023-09-30T17:04:06.467 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8720999999999999e-05 2023-09-30T17:04:06.467 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.467 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.467 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.467 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.463478+0000", 2023-09-30T17:04:06.467 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.7930000000000003e-06 2023-09-30T17:04:06.467 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.467 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.467 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.467 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.463483+0000", 2023-09-30T17:04:06.467 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1050000000000003e-06 2023-09-30T17:04:06.468 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.468 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.468 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.468 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.468 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.468 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98232 4.6 4.2d31fac6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.468 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.519619+0000", 2023-09-30T17:04:06.468 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.25116904099999998, 2023-09-30T17:04:06.468 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.26062336000000003, 2023-09-30T17:04:06.468 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.468 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.469 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.469 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.469 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.469 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98232 2023-09-30T17:04:06.469 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.469 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.469 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.469 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.469 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.519619+0000", 2023-09-30T17:04:06.469 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.469 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.469 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.470 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.470 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.519619+0000", 2023-09-30T17:04:06.470 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.470 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.470 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.470 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.470 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.519620+0000", 2023-09-30T17:04:06.470 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1900000000000003e-07 2023-09-30T17:04:06.470 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.470 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.470 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.471 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.519633+0000", 2023-09-30T17:04:06.471 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3149000000000001e-05 2023-09-30T17:04:06.471 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.471 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.471 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.471 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.519641+0000", 2023-09-30T17:04:06.471 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4870000000000002e-06 2023-09-30T17:04:06.471 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.471 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.471 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.471 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.519647+0000", 2023-09-30T17:04:06.472 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9270000000000002e-06 2023-09-30T17:04:06.472 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.472 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.472 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.472 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.472 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.472 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98258 4.6 4.2d31fac6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.472 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.528191+0000", 2023-09-30T17:04:06.472 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.242596754, 2023-09-30T17:04:06.472 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.252113329, 2023-09-30T17:04:06.472 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.473 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.473 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.473 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.473 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.473 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98258 2023-09-30T17:04:06.473 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.473 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.473 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.473 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.473 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.528191+0000", 2023-09-30T17:04:06.473 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.473 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.473 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.474 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.474 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.528191+0000", 2023-09-30T17:04:06.474 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.474 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.474 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.474 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.474 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.528192+0000", 2023-09-30T17:04:06.474 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8699999999999995e-07 2023-09-30T17:04:06.474 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.474 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.474 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.475 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.528210+0000", 2023-09-30T17:04:06.475 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8023999999999999e-05 2023-09-30T17:04:06.475 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.475 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.475 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.475 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.528220+0000", 2023-09-30T17:04:06.475 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0035e-05 2023-09-30T17:04:06.475 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.475 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.475 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.475 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.528226+0000", 2023-09-30T17:04:06.476 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.409e-06 2023-09-30T17:04:06.476 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.476 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.476 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.476 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.476 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.476 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98342 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.476 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.552401+0000", 2023-09-30T17:04:06.476 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.21838716799999999, 2023-09-30T17:04:06.476 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22796708500000001, 2023-09-30T17:04:06.476 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.477 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.477 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.477 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.477 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.477 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98342 2023-09-30T17:04:06.477 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.477 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.477 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.477 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.477 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.552401+0000", 2023-09-30T17:04:06.477 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.477 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.478 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.478 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.478 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.552401+0000", 2023-09-30T17:04:06.478 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.478 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.478 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.478 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.478 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.555172+0000", 2023-09-30T17:04:06.478 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0027709729999999999 2023-09-30T17:04:06.478 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.478 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.478 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.479 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.555196+0000", 2023-09-30T17:04:06.479 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.406e-05 2023-09-30T17:04:06.479 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.479 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.479 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.479 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.555208+0000", 2023-09-30T17:04:06.479 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1773000000000001e-05 2023-09-30T17:04:06.479 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.479 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.479 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.479 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.555217+0000", 2023-09-30T17:04:06.479 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.935e-06 2023-09-30T17:04:06.480 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.480 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.480 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.480 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.480 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.480 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98508 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.480 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.612571+0000", 2023-09-30T17:04:06.480 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.15821719100000001, 2023-09-30T17:04:06.480 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.16785881599999999, 2023-09-30T17:04:06.480 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.480 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.481 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.481 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.481 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.481 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98508 2023-09-30T17:04:06.481 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.481 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.481 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.481 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.481 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.612571+0000", 2023-09-30T17:04:06.481 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.481 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.481 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.482 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.482 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.612571+0000", 2023-09-30T17:04:06.482 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.482 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.482 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.482 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.482 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.612571+0000", 2023-09-30T17:04:06.482 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1099999999999996e-07 2023-09-30T17:04:06.482 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.482 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.482 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.482 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.612583+0000", 2023-09-30T17:04:06.483 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.118e-05 2023-09-30T17:04:06.483 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.483 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.483 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.483 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.612590+0000", 2023-09-30T17:04:06.483 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3170000000000004e-06 2023-09-30T17:04:06.483 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.483 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.483 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.483 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.612595+0000", 2023-09-30T17:04:06.483 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.463e-06 2023-09-30T17:04:06.483 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.484 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.484 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.484 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.484 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.484 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98636 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.484 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.639623+0000", 2023-09-30T17:04:06.484 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.131165277, 2023-09-30T17:04:06.484 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.14087116499999999, 2023-09-30T17:04:06.484 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.484 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.484 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.485 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.485 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.485 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98636 2023-09-30T17:04:06.485 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.485 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.485 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.485 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.485 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.639623+0000", 2023-09-30T17:04:06.485 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.485 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.485 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.485 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.486 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.639623+0000", 2023-09-30T17:04:06.486 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.486 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.486 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.486 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.486 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.639623+0000", 2023-09-30T17:04:06.486 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1600000000000002e-07 2023-09-30T17:04:06.486 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.486 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.486 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.486 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.639633+0000", 2023-09-30T17:04:06.486 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.5880000000000004e-06 2023-09-30T17:04:06.487 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.487 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.487 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.487 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.639639+0000", 2023-09-30T17:04:06.487 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.6730000000000003e-06 2023-09-30T17:04:06.487 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.487 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.487 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.487 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.639645+0000", 2023-09-30T17:04:06.487 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7400000000000001e-06 2023-09-30T17:04:06.487 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.487 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.488 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.488 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.488 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.488 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98668 4.e 4.c27217ce (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.488 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.653015+0000", 2023-09-30T17:04:06.488 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.117772855, 2023-09-30T17:04:06.488 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.12754426399999999, 2023-09-30T17:04:06.488 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.488 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.488 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.488 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.488 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.489 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98668 2023-09-30T17:04:06.489 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.489 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.489 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.489 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.489 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.653015+0000", 2023-09-30T17:04:06.489 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.489 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.489 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.489 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.489 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.653015+0000", 2023-09-30T17:04:06.489 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.490 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.490 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.490 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.490 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.656167+0000", 2023-09-30T17:04:06.490 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0031518230000000002 2023-09-30T17:04:06.490 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.490 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.490 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.490 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.656189+0000", 2023-09-30T17:04:06.490 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1670000000000001e-05 2023-09-30T17:04:06.490 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.490 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.491 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.491 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.656199+0000", 2023-09-30T17:04:06.491 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0271e-05 2023-09-30T17:04:06.491 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.491 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.491 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.491 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.656207+0000", 2023-09-30T17:04:06.491 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7400000000000004e-06 2023-09-30T17:04:06.491 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.491 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.491 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.491 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.492 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.492 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98714 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.492 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.667272+0000", 2023-09-30T17:04:06.492 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.103516447, 2023-09-30T17:04:06.492 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.113354857, 2023-09-30T17:04:06.492 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.492 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.492 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.492 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.492 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.492 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98714 2023-09-30T17:04:06.492 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.493 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.493 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.493 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.493 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.667272+0000", 2023-09-30T17:04:06.493 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.493 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.493 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.493 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.493 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.667272+0000", 2023-09-30T17:04:06.493 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.493 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.493 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.494 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.494 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.670455+0000", 2023-09-30T17:04:06.494 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0031831060000000002 2023-09-30T17:04:06.494 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.494 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.494 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.494 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.670473+0000", 2023-09-30T17:04:06.494 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8082999999999999e-05 2023-09-30T17:04:06.494 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.494 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.494 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.494 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.670490+0000", 2023-09-30T17:04:06.495 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7706999999999998e-05 2023-09-30T17:04:06.495 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.495 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.495 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.495 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.671928+0000", 2023-09-30T17:04:06.495 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0014379569999999999 2023-09-30T17:04:06.495 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.495 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.495 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.495 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.495 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.495 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98883 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.495 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.719869+0000", 2023-09-30T17:04:06.496 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.050919476999999998, 2023-09-30T17:04:06.496 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.060822006999999997, 2023-09-30T17:04:06.496 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.496 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.496 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.496 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.496 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.496 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98883 2023-09-30T17:04:06.496 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.496 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.497 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.497 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.497 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.719869+0000", 2023-09-30T17:04:06.497 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.497 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.497 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.497 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.497 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.719869+0000", 2023-09-30T17:04:06.497 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.497 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.498 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.498 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.498 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.719869+0000", 2023-09-30T17:04:06.498 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.0500000000000002e-07 2023-09-30T17:04:06.498 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.498 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.498 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.498 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.719883+0000", 2023-09-30T17:04:06.498 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3485e-05 2023-09-30T17:04:06.498 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.498 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.498 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.499 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.719894+0000", 2023-09-30T17:04:06.499 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1518000000000001e-05 2023-09-30T17:04:06.499 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.499 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.499 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.499 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.719902+0000", 2023-09-30T17:04:06.499 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9240000000000007e-06 2023-09-30T17:04:06.499 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.499 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.499 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.499 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.499 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.500 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98915 4.27 4:e68799fb:::100000001f8.00000018:head [write 1601536~4096 in=4096b,write 1712128~4096 in=4096b,write 1724416~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.500 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.730167+0000", 2023-09-30T17:04:06.500 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.040620585000000001, 2023-09-30T17:04:06.500 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.050593120999999998, 2023-09-30T17:04:06.500 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.500 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:06.500 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.500 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.500 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.500 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98915 2023-09-30T17:04:06.500 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.501 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.501 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.501 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.501 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.730167+0000", 2023-09-30T17:04:06.501 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.501 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.501 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.501 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.501 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.730167+0000", 2023-09-30T17:04:06.501 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.501 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.501 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.502 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.502 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.730168+0000", 2023-09-30T17:04:06.502 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9299999999999996e-07 2023-09-30T17:04:06.502 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.502 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.502 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.502 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.730181+0000", 2023-09-30T17:04:06.502 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2738000000000001e-05 2023-09-30T17:04:06.502 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.502 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.502 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.502 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.730193+0000", 2023-09-30T17:04:06.503 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1786e-05 2023-09-30T17:04:06.503 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.503 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.503 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.503 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.730201+0000", 2023-09-30T17:04:06.503 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.824e-06 2023-09-30T17:04:06.503 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.503 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.503 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:06.503 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.774962+0000", 2023-09-30T17:04:06.503 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.044761624999999999 2023-09-30T17:04:06.503 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.504 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.504 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:06.504 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.775030+0000", 2023-09-30T17:04:06.504 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8009999999999994e-05 2023-09-30T17:04:06.504 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.504 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.504 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.504 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.504 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.504 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98941 4.6 4.8232b686 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.504 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.739369+0000", 2023-09-30T17:04:06.505 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.031419527000000003, 2023-09-30T17:04:06.505 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.041478440999999998, 2023-09-30T17:04:06.505 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.505 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.505 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.505 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.505 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.505 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98941 2023-09-30T17:04:06.505 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.505 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.505 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.505 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.506 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.739369+0000", 2023-09-30T17:04:06.506 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.506 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.506 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.506 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.506 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.739369+0000", 2023-09-30T17:04:06.506 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.506 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.506 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.506 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.506 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.739370+0000", 2023-09-30T17:04:06.507 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0729999999999999e-06 2023-09-30T17:04:06.507 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.507 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.507 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.507 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.739383+0000", 2023-09-30T17:04:06.507 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3686000000000001e-05 2023-09-30T17:04:06.507 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.507 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.507 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.507 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.741661+0000", 2023-09-30T17:04:06.507 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0022774280000000002 2023-09-30T17:04:06.507 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.508 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.508 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.508 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.741671+0000", 2023-09-30T17:04:06.508 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.9219999999999992e-06 2023-09-30T17:04:06.508 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.508 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.508 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.508 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.508 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.508 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97795 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.508 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.383826+0000", 2023-09-30T17:04:06.509 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.38696248100000002, 2023-09-30T17:04:06.509 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.397090365, 2023-09-30T17:04:06.509 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.509 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.509 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.509 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.509 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.509 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97795 2023-09-30T17:04:06.509 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.509 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.509 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.509 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.510 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.383826+0000", 2023-09-30T17:04:06.510 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.510 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.510 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.510 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.510 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.383826+0000", 2023-09-30T17:04:06.510 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.510 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.510 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.510 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.510 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.384879+0000", 2023-09-30T17:04:06.511 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001053565 2023-09-30T17:04:06.511 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.511 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.511 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.511 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.384902+0000", 2023-09-30T17:04:06.511 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.3356000000000001e-05 2023-09-30T17:04:06.511 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.511 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.511 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.511 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.384911+0000", 2023-09-30T17:04:06.511 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5029999999999997e-06 2023-09-30T17:04:06.511 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.511 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.512 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.512 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.384916+0000", 2023-09-30T17:04:06.512 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9620000000000001e-06 2023-09-30T17:04:06.512 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.512 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.512 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.512 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.512 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.512 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98003 4.6 4.2d31fac6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.512 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.444207+0000", 2023-09-30T17:04:06.512 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.32658120800000001, 2023-09-30T17:04:06.512 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.33676553399999998, 2023-09-30T17:04:06.513 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.513 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.513 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.513 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.513 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.513 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98003 2023-09-30T17:04:06.513 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.513 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.513 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.513 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.514 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.444207+0000", 2023-09-30T17:04:06.514 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.514 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.514 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.514 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.514 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.444207+0000", 2023-09-30T17:04:06.514 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.514 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.514 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.514 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.514 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.444207+0000", 2023-09-30T17:04:06.514 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5900000000000002e-07 2023-09-30T17:04:06.515 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.515 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.515 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.515 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.444219+0000", 2023-09-30T17:04:06.515 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1986e-05 2023-09-30T17:04:06.515 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.515 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.515 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.515 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.444226+0000", 2023-09-30T17:04:06.515 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.917e-06 2023-09-30T17:04:06.516 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.516 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.516 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.516 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.444231+0000", 2023-09-30T17:04:06.516 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2900000000000002e-06 2023-09-30T17:04:06.516 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.516 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.516 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.516 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.516 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.517 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98166 4.e 4.c27217ce (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.517 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.507285+0000", 2023-09-30T17:04:06.517 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.26350337600000001, 2023-09-30T17:04:06.517 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.27374230100000002, 2023-09-30T17:04:06.517 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.517 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.517 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.517 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.517 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.517 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98166 2023-09-30T17:04:06.517 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.518 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.518 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.518 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.518 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.507285+0000", 2023-09-30T17:04:06.518 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.518 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.518 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.518 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.518 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.507285+0000", 2023-09-30T17:04:06.518 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.518 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.519 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.519 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.519 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.509163+0000", 2023-09-30T17:04:06.519 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001878184 2023-09-30T17:04:06.519 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.519 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.519 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.519 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.509180+0000", 2023-09-30T17:04:06.519 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6898999999999999e-05 2023-09-30T17:04:06.519 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.519 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.519 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.520 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.509190+0000", 2023-09-30T17:04:06.520 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0693000000000001e-05 2023-09-30T17:04:06.520 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.520 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.520 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.520 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.509196+0000", 2023-09-30T17:04:06.520 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3859999999999998e-06 2023-09-30T17:04:06.520 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.520 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.520 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.520 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.520 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.521 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98260 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.521 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.528237+0000", 2023-09-30T17:04:06.521 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.24255143700000001, 2023-09-30T17:04:06.521 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.25284437399999998, 2023-09-30T17:04:06.521 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.521 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.521 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.521 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.521 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.521 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98260 2023-09-30T17:04:06.521 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.522 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.522 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.522 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.522 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.528237+0000", 2023-09-30T17:04:06.522 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.522 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.522 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.522 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.522 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.528237+0000", 2023-09-30T17:04:06.522 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.522 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.522 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.523 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.523 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.528237+0000", 2023-09-30T17:04:06.523 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6300000000000005e-07 2023-09-30T17:04:06.523 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.523 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.523 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.523 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.528249+0000", 2023-09-30T17:04:06.523 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1817000000000001e-05 2023-09-30T17:04:06.523 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.523 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.523 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.523 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.528255+0000", 2023-09-30T17:04:06.524 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4540000000000004e-06 2023-09-30T17:04:06.524 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.524 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.524 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.524 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.528262+0000", 2023-09-30T17:04:06.524 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4180000000000002e-06 2023-09-30T17:04:06.524 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.524 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.524 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.524 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.524 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.524 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98298 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.525 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.533580+0000", 2023-09-30T17:04:06.525 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.23720802999999999, 2023-09-30T17:04:06.525 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.24755487400000001, 2023-09-30T17:04:06.525 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.525 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.525 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.525 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.525 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.525 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98298 2023-09-30T17:04:06.525 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.525 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.525 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.526 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.526 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.533580+0000", 2023-09-30T17:04:06.526 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.526 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.526 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.526 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.526 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.533580+0000", 2023-09-30T17:04:06.526 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.526 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.526 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.526 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.526 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.533580+0000", 2023-09-30T17:04:06.527 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.2899999999999999e-07 2023-09-30T17:04:06.527 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.527 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.527 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.527 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.533592+0000", 2023-09-30T17:04:06.527 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1766000000000001e-05 2023-09-30T17:04:06.527 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.527 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.527 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.527 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.533599+0000", 2023-09-30T17:04:06.527 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2980000000000003e-06 2023-09-30T17:04:06.527 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.528 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.528 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.528 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.533604+0000", 2023-09-30T17:04:06.528 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.967e-06 2023-09-30T17:04:06.528 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.528 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.528 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.528 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.528 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.528 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98548 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.528 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.621220+0000", 2023-09-30T17:04:06.528 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.14956781399999999, 2023-09-30T17:04:06.529 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.15997971499999999, 2023-09-30T17:04:06.529 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.529 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.529 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.529 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.529 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.529 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98548 2023-09-30T17:04:06.529 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.529 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.529 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.529 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.529 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.621220+0000", 2023-09-30T17:04:06.530 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.530 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.530 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.530 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.530 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.621220+0000", 2023-09-30T17:04:06.530 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.530 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.530 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.530 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.530 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.621221+0000", 2023-09-30T17:04:06.530 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2099999999999997e-07 2023-09-30T17:04:06.530 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.531 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.531 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.531 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.621235+0000", 2023-09-30T17:04:06.531 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3814e-05 2023-09-30T17:04:06.531 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.531 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.531 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.531 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.621242+0000", 2023-09-30T17:04:06.531 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1119999999999998e-06 2023-09-30T17:04:06.531 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.531 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.531 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.532 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.621247+0000", 2023-09-30T17:04:06.532 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.648e-06 2023-09-30T17:04:06.532 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.532 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.532 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.532 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.532 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.532 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98584 4.6 4.8232b686 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.532 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.629705+0000", 2023-09-30T17:04:06.532 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.14108256999999999, 2023-09-30T17:04:06.532 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.15155297200000001, 2023-09-30T17:04:06.532 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.533 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.533 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.533 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.533 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.533 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98584 2023-09-30T17:04:06.533 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.533 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.533 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.533 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.533 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.629705+0000", 2023-09-30T17:04:06.533 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.533 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.534 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.534 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.534 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.629705+0000", 2023-09-30T17:04:06.534 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.534 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.534 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.534 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.534 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.629706+0000", 2023-09-30T17:04:06.534 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4300000000000003e-07 2023-09-30T17:04:06.534 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.534 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.534 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.535 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.629719+0000", 2023-09-30T17:04:06.535 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2659e-05 2023-09-30T17:04:06.535 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.535 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.535 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.535 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.629726+0000", 2023-09-30T17:04:06.535 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1910000000000003e-06 2023-09-30T17:04:06.535 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.535 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.535 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.535 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.629732+0000", 2023-09-30T17:04:06.535 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.392e-06 2023-09-30T17:04:06.536 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.536 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.536 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.536 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.536 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.536 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98943 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.536 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.741686+0000", 2023-09-30T17:04:06.536 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.029102291999999998, 2023-09-30T17:04:06.536 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.039629068000000003, 2023-09-30T17:04:06.536 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.536 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.536 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.537 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.537 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.537 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98943 2023-09-30T17:04:06.537 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.537 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.537 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.537 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.537 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.741686+0000", 2023-09-30T17:04:06.537 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.537 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.537 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.537 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.538 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.741686+0000", 2023-09-30T17:04:06.538 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.538 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.538 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.538 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.538 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.741687+0000", 2023-09-30T17:04:06.538 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3519999999999999e-06 2023-09-30T17:04:06.538 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.538 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.538 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.538 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.741709+0000", 2023-09-30T17:04:06.539 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1967000000000002e-05 2023-09-30T17:04:06.539 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.539 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.539 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.539 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.741719+0000", 2023-09-30T17:04:06.539 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.6199999999999994e-06 2023-09-30T17:04:06.539 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.539 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.539 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.539 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.741726+0000", 2023-09-30T17:04:06.539 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0489999999999998e-06 2023-09-30T17:04:06.539 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.540 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.540 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.540 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.540 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.540 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98975 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.540 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.750305+0000", 2023-09-30T17:04:06.540 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.020483126000000001, 2023-09-30T17:04:06.540 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.031065788, 2023-09-30T17:04:06.540 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.540 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.540 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.541 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.541 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.541 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98975 2023-09-30T17:04:06.541 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.541 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.541 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.541 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.541 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.750305+0000", 2023-09-30T17:04:06.541 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.541 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.541 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.542 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.542 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.750305+0000", 2023-09-30T17:04:06.542 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.542 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.542 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.542 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.542 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.750305+0000", 2023-09-30T17:04:06.542 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8200000000000001e-07 2023-09-30T17:04:06.542 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.542 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.542 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.542 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.750315+0000", 2023-09-30T17:04:06.543 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.6229999999999992e-06 2023-09-30T17:04:06.543 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.543 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.543 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.543 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.750321+0000", 2023-09-30T17:04:06.543 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4479999999999999e-06 2023-09-30T17:04:06.543 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.543 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.543 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.543 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.750326+0000", 2023-09-30T17:04:06.543 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0470000000000001e-06 2023-09-30T17:04:06.543 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.543 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.544 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.544 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.544 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.544 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98086 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.544 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.466086+0000", 2023-09-30T17:04:06.544 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.30470165300000002, 2023-09-30T17:04:06.544 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.31533827800000003, 2023-09-30T17:04:06.544 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.544 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.544 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.544 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.544 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.545 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98086 2023-09-30T17:04:06.545 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.545 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.545 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.545 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.545 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.466086+0000", 2023-09-30T17:04:06.545 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.545 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.545 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.545 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.545 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.466086+0000", 2023-09-30T17:04:06.545 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.545 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.546 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.546 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.546 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.467324+0000", 2023-09-30T17:04:06.546 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001237141 2023-09-30T17:04:06.546 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.546 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.546 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.546 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.467345+0000", 2023-09-30T17:04:06.546 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1192e-05 2023-09-30T17:04:06.546 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.546 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.547 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.547 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.467355+0000", 2023-09-30T17:04:06.547 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.066e-05 2023-09-30T17:04:06.547 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.547 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.547 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.547 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.467363+0000", 2023-09-30T17:04:06.547 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.153e-06 2023-09-30T17:04:06.547 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.547 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.547 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.547 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.547 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.548 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98515 4.e 4.c27217ce (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.548 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.612634+0000", 2023-09-30T17:04:06.548 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.15815362899999999, 2023-09-30T17:04:06.548 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.16884263299999999, 2023-09-30T17:04:06.548 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.548 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.548 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.548 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.548 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.548 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98515 2023-09-30T17:04:06.549 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.549 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.549 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.549 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.549 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.612634+0000", 2023-09-30T17:04:06.549 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.549 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.549 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.549 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.549 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.612634+0000", 2023-09-30T17:04:06.550 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.550 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.550 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.550 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.550 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.612635+0000", 2023-09-30T17:04:06.550 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5400000000000001e-07 2023-09-30T17:04:06.550 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.550 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.550 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.550 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.612646+0000", 2023-09-30T17:04:06.551 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0937e-05 2023-09-30T17:04:06.551 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.551 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.551 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.551 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.612652+0000", 2023-09-30T17:04:06.551 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1959999999999996e-06 2023-09-30T17:04:06.551 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.551 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.551 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.551 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.612657+0000", 2023-09-30T17:04:06.552 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0900000000000004e-06 2023-09-30T17:04:06.552 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.552 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.552 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.552 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.552 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.552 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98918 4.36 4.670445b6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.552 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.732813+0000", 2023-09-30T17:04:06.552 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.037975301000000003, 2023-09-30T17:04:06.552 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.048717958999999998, 2023-09-30T17:04:06.553 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.553 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.553 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.553 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.553 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.553 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98918 2023-09-30T17:04:06.553 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.553 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.553 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.553 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.553 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.732813+0000", 2023-09-30T17:04:06.553 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.554 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.554 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.554 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.554 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.732813+0000", 2023-09-30T17:04:06.554 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.554 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.554 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.554 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.554 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.732813+0000", 2023-09-30T17:04:06.554 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2899999999999999e-07 2023-09-30T17:04:06.554 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.555 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.555 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.555 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.732825+0000", 2023-09-30T17:04:06.555 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1377e-05 2023-09-30T17:04:06.555 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.555 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.555 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.555 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.732832+0000", 2023-09-30T17:04:06.555 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0659999999999998e-06 2023-09-30T17:04:06.555 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.555 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.555 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.556 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.732837+0000", 2023-09-30T17:04:06.556 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1229999999999999e-06 2023-09-30T17:04:06.556 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.556 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.556 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.556 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.556 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.556 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97741 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.556 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.369576+0000", 2023-09-30T17:04:06.556 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.401212334, 2023-09-30T17:04:06.556 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.412008553, 2023-09-30T17:04:06.556 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.557 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.557 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.557 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.557 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.557 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97741 2023-09-30T17:04:06.557 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.557 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.557 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.557 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.557 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.369576+0000", 2023-09-30T17:04:06.557 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.557 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.558 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.558 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.558 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.369576+0000", 2023-09-30T17:04:06.558 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.558 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.558 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.558 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.558 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.373646+0000", 2023-09-30T17:04:06.558 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0040701310000000003 2023-09-30T17:04:06.558 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.558 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.558 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.559 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.373669+0000", 2023-09-30T17:04:06.559 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.3294000000000001e-05 2023-09-30T17:04:06.559 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.559 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.559 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.559 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.373704+0000", 2023-09-30T17:04:06.559 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4795000000000001e-05 2023-09-30T17:04:06.559 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.559 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.559 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.559 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.373713+0000", 2023-09-30T17:04:06.560 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8240000000000006e-06 2023-09-30T17:04:06.560 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.560 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.560 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.560 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.560 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.560 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97796 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.560 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.384926+0000", 2023-09-30T17:04:06.560 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.38586227499999998, 2023-09-30T17:04:06.560 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39671199000000001, 2023-09-30T17:04:06.560 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.560 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.561 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.561 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.561 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.561 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97796 2023-09-30T17:04:06.561 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.561 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.561 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.561 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.561 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.384926+0000", 2023-09-30T17:04:06.561 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.561 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.561 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.562 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.562 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.384926+0000", 2023-09-30T17:04:06.562 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.562 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.562 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.562 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.562 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.385554+0000", 2023-09-30T17:04:06.562 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000627864 2023-09-30T17:04:06.562 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.562 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.562 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.562 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.385573+0000", 2023-09-30T17:04:06.563 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9330999999999998e-05 2023-09-30T17:04:06.563 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.563 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.563 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.563 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.385582+0000", 2023-09-30T17:04:06.563 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1970000000000002e-06 2023-09-30T17:04:06.563 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.563 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.563 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.563 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.385590+0000", 2023-09-30T17:04:06.563 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.452e-06 2023-09-30T17:04:06.563 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.563 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.564 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.564 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.564 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.564 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98006 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.564 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.444345+0000", 2023-09-30T17:04:06.564 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.32644348099999998, 2023-09-30T17:04:06.564 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.33734644600000002, 2023-09-30T17:04:06.564 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.564 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.564 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.564 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.564 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.565 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98006 2023-09-30T17:04:06.565 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.565 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.565 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.565 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.565 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.444345+0000", 2023-09-30T17:04:06.565 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.565 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.565 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.565 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.565 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.444345+0000", 2023-09-30T17:04:06.565 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.566 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.566 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.566 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.566 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.444601+0000", 2023-09-30T17:04:06.566 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00025676900000000001 2023-09-30T17:04:06.566 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.566 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.566 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.566 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.444622+0000", 2023-09-30T17:04:06.566 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.0831000000000001e-05 2023-09-30T17:04:06.566 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.566 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.567 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.567 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.444635+0000", 2023-09-30T17:04:06.567 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3035e-05 2023-09-30T17:04:06.567 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.567 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.567 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.567 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.444642+0000", 2023-09-30T17:04:06.567 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.6869999999999997e-06 2023-09-30T17:04:06.567 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.567 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.567 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.567 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.568 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.568 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97958 4.e 4.c27217ce (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.568 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.436187+0000", 2023-09-30T17:04:06.568 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.334601015, 2023-09-30T17:04:06.568 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.34555713900000001, 2023-09-30T17:04:06.568 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.568 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.568 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.568 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.568 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.568 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97958 2023-09-30T17:04:06.568 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.569 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.569 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.569 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.569 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.436187+0000", 2023-09-30T17:04:06.569 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.569 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.569 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.569 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.569 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.436187+0000", 2023-09-30T17:04:06.569 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.569 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.569 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.570 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.570 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.439169+0000", 2023-09-30T17:04:06.570 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0029822889999999999 2023-09-30T17:04:06.570 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.570 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.570 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.570 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.439194+0000", 2023-09-30T17:04:06.570 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.5045000000000002e-05 2023-09-30T17:04:06.570 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.570 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.571 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.571 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.439206+0000", 2023-09-30T17:04:06.571 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1875999999999999e-05 2023-09-30T17:04:06.571 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.571 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.571 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.571 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.439222+0000", 2023-09-30T17:04:06.571 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5909999999999998e-05 2023-09-30T17:04:06.571 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.571 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.571 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.572 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.572 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.572 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98029 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.572 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.453619+0000", 2023-09-30T17:04:06.572 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.31716912000000003, 2023-09-30T17:04:06.572 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.32817859300000002, 2023-09-30T17:04:06.572 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.572 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.572 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.572 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.572 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.572 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98029 2023-09-30T17:04:06.573 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.573 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.573 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.573 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.573 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.453619+0000", 2023-09-30T17:04:06.573 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.573 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.573 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.573 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.573 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.453619+0000", 2023-09-30T17:04:06.573 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.573 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.574 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.574 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.574 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.453620+0000", 2023-09-30T17:04:06.574 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7800000000000001e-07 2023-09-30T17:04:06.574 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.574 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.574 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.574 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.453631+0000", 2023-09-30T17:04:06.574 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1952e-05 2023-09-30T17:04:06.574 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.574 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.574 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.575 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.453638+0000", 2023-09-30T17:04:06.575 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9879999999999998e-06 2023-09-30T17:04:06.575 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.575 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.575 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.575 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.453645+0000", 2023-09-30T17:04:06.575 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4690000000000002e-06 2023-09-30T17:04:06.575 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.575 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.575 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.575 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.575 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.576 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98316 4.36 4.2347a776 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.576 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.541907+0000", 2023-09-30T17:04:06.576 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.228881205, 2023-09-30T17:04:06.576 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23994376100000001, 2023-09-30T17:04:06.576 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.576 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.576 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.576 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.576 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.576 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98316 2023-09-30T17:04:06.576 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.576 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.577 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.577 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.577 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.541907+0000", 2023-09-30T17:04:06.577 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.577 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.577 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.577 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.577 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.541907+0000", 2023-09-30T17:04:06.577 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.577 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.577 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.578 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.578 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.541907+0000", 2023-09-30T17:04:06.578 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7e-07 2023-09-30T17:04:06.578 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.578 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.578 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.578 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.542779+0000", 2023-09-30T17:04:06.578 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00087202099999999995 2023-09-30T17:04:06.578 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.578 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.578 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.578 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.542795+0000", 2023-09-30T17:04:06.579 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6066000000000002e-05 2023-09-30T17:04:06.579 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.579 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.579 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.579 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.542803+0000", 2023-09-30T17:04:06.579 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.79e-06 2023-09-30T17:04:06.579 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.579 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.579 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.579 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.579 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.580 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98492 4.36 4.670445b6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.580 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.597162+0000", 2023-09-30T17:04:06.580 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.17362602999999999, 2023-09-30T17:04:06.580 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.184742194, 2023-09-30T17:04:06.580 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.580 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.580 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.580 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.580 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.580 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98492 2023-09-30T17:04:06.580 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.580 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.581 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.581 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.581 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.597162+0000", 2023-09-30T17:04:06.581 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.581 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.581 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.581 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.581 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.597162+0000", 2023-09-30T17:04:06.581 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.581 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.581 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.582 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.582 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.597163+0000", 2023-09-30T17:04:06.582 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4799999999999997e-07 2023-09-30T17:04:06.582 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.582 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.582 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.582 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.597175+0000", 2023-09-30T17:04:06.582 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.238e-05 2023-09-30T17:04:06.582 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.582 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.582 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.582 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.597183+0000", 2023-09-30T17:04:06.583 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2859999999999999e-06 2023-09-30T17:04:06.583 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.583 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.583 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.583 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.597190+0000", 2023-09-30T17:04:06.583 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1979999999999998e-06 2023-09-30T17:04:06.583 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.583 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.583 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.583 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.584 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.584 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98519 4.6 4.8232b686 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.584 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.612692+0000", 2023-09-30T17:04:06.584 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.15809619999999999, 2023-09-30T17:04:06.584 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.16926561000000001, 2023-09-30T17:04:06.584 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.584 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.584 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.584 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.584 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.584 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98519 2023-09-30T17:04:06.584 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.585 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.585 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.585 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.585 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.612692+0000", 2023-09-30T17:04:06.585 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.585 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.585 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.585 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.585 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.612692+0000", 2023-09-30T17:04:06.585 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.585 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.586 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.586 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.586 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.612692+0000", 2023-09-30T17:04:06.586 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7500000000000001e-07 2023-09-30T17:04:06.586 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.586 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.586 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.586 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.612703+0000", 2023-09-30T17:04:06.586 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0975000000000001e-05 2023-09-30T17:04:06.586 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.586 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.587 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.587 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.612709+0000", 2023-09-30T17:04:06.587 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8799999999999996e-06 2023-09-30T17:04:06.587 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.587 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.587 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.587 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.612714+0000", 2023-09-30T17:04:06.587 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8269999999999997e-06 2023-09-30T17:04:06.587 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.587 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.587 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.587 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.588 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.588 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98550 4.e 4.c27217ce (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.588 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.621286+0000", 2023-09-30T17:04:06.588 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.14950213000000001, 2023-09-30T17:04:06.588 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.160725119, 2023-09-30T17:04:06.588 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.588 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.588 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.588 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.588 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.588 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98550 2023-09-30T17:04:06.588 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.589 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.589 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.589 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.589 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.621286+0000", 2023-09-30T17:04:06.589 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.589 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.589 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.589 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.589 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.621286+0000", 2023-09-30T17:04:06.589 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.589 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.589 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.590 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.590 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.621286+0000", 2023-09-30T17:04:06.590 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7100000000000002e-07 2023-09-30T17:04:06.590 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.590 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.590 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.590 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.621299+0000", 2023-09-30T17:04:06.590 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2346e-05 2023-09-30T17:04:06.590 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.590 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.590 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.591 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.621305+0000", 2023-09-30T17:04:06.591 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.857e-06 2023-09-30T17:04:06.591 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.591 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.591 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.591 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.621309+0000", 2023-09-30T17:04:06.591 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6800000000000001e-06 2023-09-30T17:04:06.591 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.591 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.591 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.591 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.592 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.592 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98716 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.592 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.671945+0000", 2023-09-30T17:04:06.592 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.098842588999999995, 2023-09-30T17:04:06.592 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.110118826, 2023-09-30T17:04:06.592 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.592 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.592 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.592 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.592 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.592 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98716 2023-09-30T17:04:06.593 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.593 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.593 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.593 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.593 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.671945+0000", 2023-09-30T17:04:06.593 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.593 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.593 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.593 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.593 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.671945+0000", 2023-09-30T17:04:06.593 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.593 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.594 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.594 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.594 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.671946+0000", 2023-09-30T17:04:06.594 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.04e-06 2023-09-30T17:04:06.594 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.594 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.594 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.594 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.671969+0000", 2023-09-30T17:04:06.594 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2396999999999999e-05 2023-09-30T17:04:06.594 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.594 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.594 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.595 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.671980+0000", 2023-09-30T17:04:06.595 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0862999999999999e-05 2023-09-30T17:04:06.595 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.595 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.595 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.595 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.671988+0000", 2023-09-30T17:04:06.595 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7719999999999994e-06 2023-09-30T17:04:06.595 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.595 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.595 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.596 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.596 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.596 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98789 4.6 4.8232b686 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.596 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.690625+0000", 2023-09-30T17:04:06.596 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.080162633999999997, 2023-09-30T17:04:06.596 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.091492140999999999, 2023-09-30T17:04:06.596 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.596 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.596 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.596 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.596 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.597 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98789 2023-09-30T17:04:06.597 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.597 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.597 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.597 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.597 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.690625+0000", 2023-09-30T17:04:06.597 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.597 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.597 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.597 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.597 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.690625+0000", 2023-09-30T17:04:06.597 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.598 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.598 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.598 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.598 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.692111+0000", 2023-09-30T17:04:06.598 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001485608 2023-09-30T17:04:06.598 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.598 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.598 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.598 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.692131+0000", 2023-09-30T17:04:06.598 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.0230000000000001e-05 2023-09-30T17:04:06.599 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.599 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.599 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.599 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.692141+0000", 2023-09-30T17:04:06.599 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.448e-06 2023-09-30T17:04:06.599 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.599 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.599 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.599 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.692148+0000", 2023-09-30T17:04:06.599 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5449999999999998e-06 2023-09-30T17:04:06.600 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.600 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.600 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.600 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.600 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.600 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98824 4.36 4.670445b6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.600 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.704162+0000", 2023-09-30T17:04:06.600 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.066625900000000002, 2023-09-30T17:04:06.600 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.078013556999999997, 2023-09-30T17:04:06.600 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.600 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.600 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.601 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.601 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.601 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98824 2023-09-30T17:04:06.601 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.601 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.601 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.601 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.601 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.704162+0000", 2023-09-30T17:04:06.601 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.601 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.601 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.602 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.602 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.704162+0000", 2023-09-30T17:04:06.602 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.602 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.602 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.602 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.602 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.704163+0000", 2023-09-30T17:04:06.602 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7400000000000003e-07 2023-09-30T17:04:06.602 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.602 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.602 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.602 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.704177+0000", 2023-09-30T17:04:06.603 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3818999999999999e-05 2023-09-30T17:04:06.603 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.603 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.603 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.603 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.704185+0000", 2023-09-30T17:04:06.603 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3299999999999999e-06 2023-09-30T17:04:06.603 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.603 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.603 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.603 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.704191+0000", 2023-09-30T17:04:06.603 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.319e-06 2023-09-30T17:04:06.603 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.604 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.604 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.604 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.604 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.604 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97859 4.6 4.8232b686 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.604 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.407309+0000", 2023-09-30T17:04:06.604 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.36347869700000002, 2023-09-30T17:04:06.604 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.3749228, 2023-09-30T17:04:06.604 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.604 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.604 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.604 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.605 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.605 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97859 2023-09-30T17:04:06.605 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.605 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.605 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.605 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.605 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.407309+0000", 2023-09-30T17:04:06.605 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.605 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.605 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.605 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.605 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.407309+0000", 2023-09-30T17:04:06.606 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.606 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.606 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.606 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.606 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.407310+0000", 2023-09-30T17:04:06.606 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5199999999999997e-07 2023-09-30T17:04:06.606 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.606 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.606 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.606 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.407323+0000", 2023-09-30T17:04:06.606 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3159999999999999e-05 2023-09-30T17:04:06.606 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.607 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.607 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.607 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.407331+0000", 2023-09-30T17:04:06.607 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8480000000000001e-06 2023-09-30T17:04:06.607 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.607 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.607 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.607 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.407337+0000", 2023-09-30T17:04:06.607 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3389999999999998e-06 2023-09-30T17:04:06.607 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.607 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.608 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.608 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.608 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.608 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97959 4.e 4.c27217ce (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.608 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.439239+0000", 2023-09-30T17:04:06.608 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.33154899399999999, 2023-09-30T17:04:06.608 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.34304924999999997, 2023-09-30T17:04:06.608 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.608 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.608 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.608 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.608 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.609 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97959 2023-09-30T17:04:06.609 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.609 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.609 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.609 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.609 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.439239+0000", 2023-09-30T17:04:06.609 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.609 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.609 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.609 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.609 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.439239+0000", 2023-09-30T17:04:06.609 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.610 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.610 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.610 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.610 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.439240+0000", 2023-09-30T17:04:06.610 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2099999999999997e-07 2023-09-30T17:04:06.610 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.610 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.610 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.610 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.439253+0000", 2023-09-30T17:04:06.610 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.378e-05 2023-09-30T17:04:06.610 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.611 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.611 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.611 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.439261+0000", 2023-09-30T17:04:06.611 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3359999999999997e-06 2023-09-30T17:04:06.611 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.611 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.611 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.611 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.439267+0000", 2023-09-30T17:04:06.611 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8919999999999997e-06 2023-09-30T17:04:06.611 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.611 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.612 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.612 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.612 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.612 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98089 4.e 4.c27217ce (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.612 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.470240+0000", 2023-09-30T17:04:06.612 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.30054776900000002, 2023-09-30T17:04:06.612 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.31210332699999999, 2023-09-30T17:04:06.612 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.612 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.612 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.612 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.612 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.613 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98089 2023-09-30T17:04:06.613 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.613 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.613 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.613 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.613 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.470240+0000", 2023-09-30T17:04:06.613 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.613 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.613 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.613 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.613 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.470240+0000", 2023-09-30T17:04:06.613 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.614 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.614 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.614 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.614 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.470241+0000", 2023-09-30T17:04:06.614 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7400000000000003e-07 2023-09-30T17:04:06.614 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.614 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.614 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.614 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.470254+0000", 2023-09-30T17:04:06.614 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3216e-05 2023-09-30T17:04:06.614 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.614 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.615 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.615 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.470263+0000", 2023-09-30T17:04:06.615 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.4190000000000008e-06 2023-09-30T17:04:06.615 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.615 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.615 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.615 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.470271+0000", 2023-09-30T17:04:06.615 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0180000000000004e-06 2023-09-30T17:04:06.615 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.615 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.615 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.616 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.616 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.616 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98381 4.6 4.8232b686 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.616 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.566086+0000", 2023-09-30T17:04:06.616 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.20470249099999999, 2023-09-30T17:04:06.616 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.21631435600000001, 2023-09-30T17:04:06.616 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.616 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.616 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.616 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.616 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.616 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98381 2023-09-30T17:04:06.617 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.617 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.617 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.617 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.617 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.566086+0000", 2023-09-30T17:04:06.617 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.617 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.617 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.617 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.617 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.566086+0000", 2023-09-30T17:04:06.617 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.617 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.618 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.618 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.618 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.566086+0000", 2023-09-30T17:04:06.618 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0200000000000002e-07 2023-09-30T17:04:06.618 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.618 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.618 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.618 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.566099+0000", 2023-09-30T17:04:06.618 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2401e-05 2023-09-30T17:04:06.618 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.618 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.618 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.619 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.566106+0000", 2023-09-30T17:04:06.619 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3039999999999999e-06 2023-09-30T17:04:06.619 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.619 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.619 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.619 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.566112+0000", 2023-09-30T17:04:06.619 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7810000000000002e-06 2023-09-30T17:04:06.619 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.619 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.619 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.619 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.620 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.620 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98520 4.e 4.c27217ce (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.620 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.612720+0000", 2023-09-30T17:04:06.620 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.15806824899999999, 2023-09-30T17:04:06.620 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.169736796, 2023-09-30T17:04:06.620 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.620 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.620 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.620 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.620 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.620 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98520 2023-09-30T17:04:06.620 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.621 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.621 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.621 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.621 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.612720+0000", 2023-09-30T17:04:06.621 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.621 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.621 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.621 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.621 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.612720+0000", 2023-09-30T17:04:06.621 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.621 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.622 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.622 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.622 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.612720+0000", 2023-09-30T17:04:06.622 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.58e-07 2023-09-30T17:04:06.622 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.622 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.622 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.622 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.612732+0000", 2023-09-30T17:04:06.622 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2061e-05 2023-09-30T17:04:06.622 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.622 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.623 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.623 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.612738+0000", 2023-09-30T17:04:06.623 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6699999999999999e-06 2023-09-30T17:04:06.623 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.623 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.623 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.623 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.612744+0000", 2023-09-30T17:04:06.623 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5650000000000001e-06 2023-09-30T17:04:06.623 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.623 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.623 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.623 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.624 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.624 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98643 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.624 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.642099+0000", 2023-09-30T17:04:06.624 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.128689055, 2023-09-30T17:04:06.624 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.14041292899999999, 2023-09-30T17:04:06.624 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.624 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.624 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.624 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.624 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.624 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98643 2023-09-30T17:04:06.624 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.625 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.625 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.625 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.625 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.642099+0000", 2023-09-30T17:04:06.625 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.625 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.625 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.625 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.625 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.642099+0000", 2023-09-30T17:04:06.625 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.625 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.625 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.625 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.626 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.642798+0000", 2023-09-30T17:04:06.626 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00069928099999999995 2023-09-30T17:04:06.626 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.626 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.626 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.626 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.642822+0000", 2023-09-30T17:04:06.626 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4136999999999999e-05 2023-09-30T17:04:06.626 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.626 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.626 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.626 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.642837+0000", 2023-09-30T17:04:06.627 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4377e-05 2023-09-30T17:04:06.627 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.627 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.627 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.627 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.642846+0000", 2023-09-30T17:04:06.627 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.312e-06 2023-09-30T17:04:06.627 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.627 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.627 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.627 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.627 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.627 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98680 4.e 4.c27217ce (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.628 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.657314+0000", 2023-09-30T17:04:06.628 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.113473608, 2023-09-30T17:04:06.628 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.12525218199999999, 2023-09-30T17:04:06.628 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.628 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.628 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.628 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.628 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.628 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98680 2023-09-30T17:04:06.628 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.628 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.628 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.629 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.629 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.657314+0000", 2023-09-30T17:04:06.629 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.629 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.629 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.629 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.629 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.657314+0000", 2023-09-30T17:04:06.629 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.629 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.629 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.629 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.630 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.657315+0000", 2023-09-30T17:04:06.630 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0100000000000005e-07 2023-09-30T17:04:06.630 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.630 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.630 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.630 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.657330+0000", 2023-09-30T17:04:06.630 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5063e-05 2023-09-30T17:04:06.630 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.630 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.630 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.631 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.657337+0000", 2023-09-30T17:04:06.631 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0979999999999996e-06 2023-09-30T17:04:06.631 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.631 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.631 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.631 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.657343+0000", 2023-09-30T17:04:06.631 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8130000000000001e-06 2023-09-30T17:04:06.631 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.631 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.631 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.632 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.632 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.632 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98790 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.632 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.692166+0000", 2023-09-30T17:04:06.632 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.078621833000000002, 2023-09-30T17:04:06.632 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.090461245999999995, 2023-09-30T17:04:06.632 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.632 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.632 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.632 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.632 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.633 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98790 2023-09-30T17:04:06.633 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.633 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.633 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.633 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.633 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.692166+0000", 2023-09-30T17:04:06.633 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.633 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.633 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.633 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.633 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.692166+0000", 2023-09-30T17:04:06.634 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.634 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.634 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.634 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.634 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.692167+0000", 2023-09-30T17:04:06.634 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7700000000000004e-07 2023-09-30T17:04:06.634 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.634 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.634 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.634 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.692180+0000", 2023-09-30T17:04:06.634 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3560000000000001e-05 2023-09-30T17:04:06.635 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.635 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.635 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.635 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.692188+0000", 2023-09-30T17:04:06.635 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5220000000000001e-06 2023-09-30T17:04:06.635 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.635 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.635 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.635 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.692194+0000", 2023-09-30T17:04:06.635 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3289999999999999e-06 2023-09-30T17:04:06.635 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.636 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.636 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.636 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.636 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.636 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98948 4.e 4.c27217ce (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.636 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.741861+0000", 2023-09-30T17:04:06.636 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.028926615999999999, 2023-09-30T17:04:06.636 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.040824419000000001, 2023-09-30T17:04:06.636 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.636 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.637 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.637 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.637 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.637 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98948 2023-09-30T17:04:06.637 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.637 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.637 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.637 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.637 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.741861+0000", 2023-09-30T17:04:06.637 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.637 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.637 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.638 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.638 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.741861+0000", 2023-09-30T17:04:06.638 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.638 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.638 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.638 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.638 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.741862+0000", 2023-09-30T17:04:06.638 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5700000000000002e-07 2023-09-30T17:04:06.638 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.638 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.638 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.639 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.741874+0000", 2023-09-30T17:04:06.639 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2378000000000001e-05 2023-09-30T17:04:06.639 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.639 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.639 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.639 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.741880+0000", 2023-09-30T17:04:06.639 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3909999999999997e-06 2023-09-30T17:04:06.639 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.639 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.639 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.639 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.741884+0000", 2023-09-30T17:04:06.640 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8510000000000001e-06 2023-09-30T17:04:06.640 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.640 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.640 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.640 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.640 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.640 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97800 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.881 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.385700+0000", 2023-09-30T17:04:06.881 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.38508767300000002, 2023-09-30T17:04:06.881 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39704378600000001, 2023-09-30T17:04:06.881 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.881 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.881 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.881 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.881 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.882 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97800 2023-09-30T17:04:06.882 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.882 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.882 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.882 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.882 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.385700+0000", 2023-09-30T17:04:06.882 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.882 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.882 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.883 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.883 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.385700+0000", 2023-09-30T17:04:06.883 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.883 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.883 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.883 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.883 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.385701+0000", 2023-09-30T17:04:06.883 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4199999999999995e-07 2023-09-30T17:04:06.884 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.884 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.884 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.884 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.385717+0000", 2023-09-30T17:04:06.884 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6149000000000001e-05 2023-09-30T17:04:06.884 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.884 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.884 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.884 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.385726+0000", 2023-09-30T17:04:06.885 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.0189999999999995e-06 2023-09-30T17:04:06.885 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.885 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.885 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.885 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.385733+0000", 2023-09-30T17:04:06.885 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5119999999999997e-06 2023-09-30T17:04:06.885 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.885 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.885 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.885 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.886 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.886 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98007 4.36 4.670445b6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.886 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.444656+0000", 2023-09-30T17:04:06.886 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.32613226200000001, 2023-09-30T17:04:06.886 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.33814930900000001, 2023-09-30T17:04:06.886 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.886 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.886 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.886 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.887 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.887 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98007 2023-09-30T17:04:06.887 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.887 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.887 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.887 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.887 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.444656+0000", 2023-09-30T17:04:06.887 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.888 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.888 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.888 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.888 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.444656+0000", 2023-09-30T17:04:06.888 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.888 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.888 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.888 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.888 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.446499+0000", 2023-09-30T17:04:06.888 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0018429220000000001 2023-09-30T17:04:06.889 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.889 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.889 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.889 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.446520+0000", 2023-09-30T17:04:06.889 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1277e-05 2023-09-30T17:04:06.889 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.889 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.889 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.889 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.446529+0000", 2023-09-30T17:04:06.889 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2299999999999997e-06 2023-09-30T17:04:06.890 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.890 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.890 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.890 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.446537+0000", 2023-09-30T17:04:06.890 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7940000000000003e-06 2023-09-30T17:04:06.890 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.890 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.890 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.890 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.891 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.891 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98033 4.36 4.670445b6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.891 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.453691+0000", 2023-09-30T17:04:06.891 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.317097397, 2023-09-30T17:04:06.891 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.32918442599999997, 2023-09-30T17:04:06.891 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.891 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.891 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.891 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.891 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.892 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98033 2023-09-30T17:04:06.892 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.892 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.892 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.892 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.892 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.453691+0000", 2023-09-30T17:04:06.892 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.892 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.892 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.892 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.893 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.453691+0000", 2023-09-30T17:04:06.893 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.893 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.893 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.893 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.893 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.453691+0000", 2023-09-30T17:04:06.893 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9100000000000004e-07 2023-09-30T17:04:06.893 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.893 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.894 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.894 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.453704+0000", 2023-09-30T17:04:06.894 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2751e-05 2023-09-30T17:04:06.894 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.894 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.894 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.894 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.453711+0000", 2023-09-30T17:04:06.894 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8480000000000003e-06 2023-09-30T17:04:06.895 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.895 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.895 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.895 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.453717+0000", 2023-09-30T17:04:06.895 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3559999999999998e-06 2023-09-30T17:04:06.895 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.895 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.895 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.895 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.895 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.896 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98551 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.896 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.621315+0000", 2023-09-30T17:04:06.896 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.14947300999999999, 2023-09-30T17:04:06.896 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.16162895899999999, 2023-09-30T17:04:06.896 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.896 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.896 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.896 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.896 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.897 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98551 2023-09-30T17:04:06.897 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.897 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.897 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.897 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.897 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.621315+0000", 2023-09-30T17:04:06.897 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.897 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.897 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.898 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.898 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.621315+0000", 2023-09-30T17:04:06.898 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.898 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.898 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.898 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.898 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.621315+0000", 2023-09-30T17:04:06.898 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9099999999999999e-07 2023-09-30T17:04:06.898 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.898 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.899 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.899 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.621328+0000", 2023-09-30T17:04:06.899 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2510999999999999e-05 2023-09-30T17:04:06.899 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.899 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.899 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.899 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.621334+0000", 2023-09-30T17:04:06.899 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7729999999999996e-06 2023-09-30T17:04:06.899 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.900 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.900 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.900 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.621338+0000", 2023-09-30T17:04:06.900 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6959999999999996e-06 2023-09-30T17:04:06.900 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.900 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.900 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.900 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.900 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.901 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:99033 4.19 4:997b7129:::100000001f8.00000000:head [write 3178496~4096 in=4096b,write 3276800~4096 in=4096b,write 3338240~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.901 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.770786+0000", 2023-09-30T17:04:06.901 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 1.9199999999999998e-06, 2023-09-30T17:04:06.901 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.012227915000000001, 2023-09-30T17:04:06.901 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.901 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:06.901 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.901 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.901 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.902 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 99033 2023-09-30T17:04:06.902 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.902 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.941 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.942 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.942 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.770786+0000", 2023-09-30T17:04:06.942 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.942 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.942 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.942 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.943 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.770786+0000", 2023-09-30T17:04:06.943 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.943 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.943 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.943 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.944 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.770787+0000", 2023-09-30T17:04:06.944 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.95e-07 2023-09-30T17:04:06.944 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.944 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.944 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.944 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.770801+0000", 2023-09-30T17:04:06.944 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3506000000000001e-05 2023-09-30T17:04:06.944 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.944 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.944 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.945 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.770812+0000", 2023-09-30T17:04:06.945 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1187e-05 2023-09-30T17:04:06.945 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.945 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.945 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.945 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.770820+0000", 2023-09-30T17:04:06.945 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1659999999999994e-06 2023-09-30T17:04:06.945 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.945 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.945 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:06.946 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.770911+0000", 2023-09-30T17:04:06.946 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.0659000000000001e-05 2023-09-30T17:04:06.946 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.946 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.946 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:06.946 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.770983+0000", 2023-09-30T17:04:06.946 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1971999999999995e-05 2023-09-30T17:04:06.946 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.946 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.946 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:06.946 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.771144+0000", 2023-09-30T17:04:06.947 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016122900000000001 2023-09-30T17:04:06.947 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.947 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.947 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:06.947 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.777526+0000", 2023-09-30T17:04:06.947 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0063826209999999998 2023-09-30T17:04:06.947 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.947 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.947 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.947 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.948 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.948 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97706 4.6 4.8232b686 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.948 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.361604+0000", 2023-09-30T17:04:06.948 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.40918440900000003, 2023-09-30T17:04:06.948 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.42150457099999999, 2023-09-30T17:04:06.948 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.948 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.948 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.948 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.948 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.948 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97706 2023-09-30T17:04:06.949 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.949 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.949 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.949 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.949 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.361604+0000", 2023-09-30T17:04:06.949 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.949 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.949 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.949 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.949 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.361604+0000", 2023-09-30T17:04:06.949 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.950 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.950 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.950 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.950 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.362788+0000", 2023-09-30T17:04:06.950 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001184785 2023-09-30T17:04:06.950 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.950 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.950 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.950 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.362802+0000", 2023-09-30T17:04:06.950 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3876999999999999e-05 2023-09-30T17:04:06.950 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.951 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.951 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.951 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.362812+0000", 2023-09-30T17:04:06.951 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7529999999999996e-06 2023-09-30T17:04:06.951 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.951 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.951 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.951 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.362820+0000", 2023-09-30T17:04:06.951 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2570000000000007e-06 2023-09-30T17:04:06.951 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.952 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.952 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.952 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.952 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.952 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97748 4.e 4.c27217ce (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.952 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.373837+0000", 2023-09-30T17:04:06.952 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.39695103100000001, 2023-09-30T17:04:06.952 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.40934341099999999, 2023-09-30T17:04:06.952 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.952 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.952 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.953 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.953 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.953 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97748 2023-09-30T17:04:06.953 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.953 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.953 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.953 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.953 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.373837+0000", 2023-09-30T17:04:06.953 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.953 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.954 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.954 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.954 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.373837+0000", 2023-09-30T17:04:06.954 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.954 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.954 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.954 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.954 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.373838+0000", 2023-09-30T17:04:06.954 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1900000000000003e-07 2023-09-30T17:04:06.954 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.954 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.955 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.955 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.373849+0000", 2023-09-30T17:04:06.955 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1895999999999999e-05 2023-09-30T17:04:06.955 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.955 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.955 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.955 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.373856+0000", 2023-09-30T17:04:06.955 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1149999999999999e-06 2023-09-30T17:04:06.955 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.955 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.955 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.956 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.373860+0000", 2023-09-30T17:04:06.956 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9339999999999997e-06 2023-09-30T17:04:06.956 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.956 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.956 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.956 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.956 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.956 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97905 4.e 4.c27217ce (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.956 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.416853+0000", 2023-09-30T17:04:06.956 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.35393483599999997, 2023-09-30T17:04:06.957 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.36639346499999997, 2023-09-30T17:04:06.957 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.957 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.957 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.957 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.957 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.957 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97905 2023-09-30T17:04:06.957 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.957 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.957 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.958 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.958 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.416853+0000", 2023-09-30T17:04:06.958 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.958 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.958 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.958 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.958 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.416853+0000", 2023-09-30T17:04:06.958 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.958 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.958 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.958 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.959 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.416854+0000", 2023-09-30T17:04:06.959 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.27e-07 2023-09-30T17:04:06.959 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.959 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.959 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.959 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.416865+0000", 2023-09-30T17:04:06.959 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1053000000000001e-05 2023-09-30T17:04:06.959 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.959 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.960 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.960 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.416871+0000", 2023-09-30T17:04:06.960 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2049999999999999e-06 2023-09-30T17:04:06.960 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.960 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.960 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.960 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.416876+0000", 2023-09-30T17:04:06.960 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9139999999999999e-06 2023-09-30T17:04:06.960 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.960 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.960 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.961 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.961 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.961 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98496 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.961 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.597197+0000", 2023-09-30T17:04:06.961 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.17359073799999999, 2023-09-30T17:04:06.961 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.18611819700000001, 2023-09-30T17:04:06.961 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.961 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.961 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.961 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.961 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.962 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98496 2023-09-30T17:04:06.962 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.962 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.962 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.962 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.962 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.597197+0000", 2023-09-30T17:04:06.962 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.962 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.962 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.963 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.963 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.597197+0000", 2023-09-30T17:04:06.963 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.963 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.963 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.963 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.963 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.600321+0000", 2023-09-30T17:04:06.963 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.003123481 2023-09-30T17:04:06.963 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.963 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.963 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.964 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.600339+0000", 2023-09-30T17:04:06.964 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8442999999999999e-05 2023-09-30T17:04:06.964 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.964 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.964 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.964 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.600352+0000", 2023-09-30T17:04:06.964 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2913e-05 2023-09-30T17:04:06.964 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.964 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.964 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.964 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.600358+0000", 2023-09-30T17:04:06.965 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0639999999999999e-06 2023-09-30T17:04:06.965 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.965 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.965 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.965 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.965 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.965 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97608 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 393216~8192 in=8192b,write 462848~4096 in=4096b,write 581632~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:06.965 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.330264+0000", 2023-09-30T17:04:06.965 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.44052396500000002, 2023-09-30T17:04:06.965 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.45312634600000001, 2023-09-30T17:04:06.965 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.966 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:06.966 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.966 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.966 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.966 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97608 2023-09-30T17:04:06.966 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.966 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.966 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.966 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.966 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.330264+0000", 2023-09-30T17:04:06.966 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.967 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.967 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.967 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.967 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.330264+0000", 2023-09-30T17:04:06.967 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.967 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.967 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.967 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.967 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.330265+0000", 2023-09-30T17:04:06.967 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2e-07 2023-09-30T17:04:06.967 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.968 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.968 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.968 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.330279+0000", 2023-09-30T17:04:06.968 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4319e-05 2023-09-30T17:04:06.968 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.968 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.968 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.968 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.330287+0000", 2023-09-30T17:04:06.968 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0930000000000003e-06 2023-09-30T17:04:06.968 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.968 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.969 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.969 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.330294+0000", 2023-09-30T17:04:06.969 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0949999999999998e-06 2023-09-30T17:04:06.969 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.969 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.969 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:06.969 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.766563+0000", 2023-09-30T17:04:06.969 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.43626933299999998 2023-09-30T17:04:06.969 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.969 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.970 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:06.970 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.766613+0000", 2023-09-30T17:04:06.970 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9264999999999997e-05 2023-09-30T17:04:06.970 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.970 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.970 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:06.970 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.766699+0000", 2023-09-30T17:04:06.970 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.6652999999999999e-05 2023-09-30T17:04:06.970 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.970 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.970 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:06.971 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.778288+0000", 2023-09-30T17:04:06.971 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011588352 2023-09-30T17:04:06.971 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.971 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.971 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.971 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.971 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.971 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97866 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.971 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.407428+0000", 2023-09-30T17:04:06.971 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.36336016700000001, 2023-09-30T17:04:06.972 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.37606107700000002, 2023-09-30T17:04:06.972 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.972 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.972 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.972 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.972 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.972 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97866 2023-09-30T17:04:06.972 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.972 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.972 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.972 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.973 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.407428+0000", 2023-09-30T17:04:06.973 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.973 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.973 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.973 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.973 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.407428+0000", 2023-09-30T17:04:06.973 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.973 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.973 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.973 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.973 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.407428+0000", 2023-09-30T17:04:06.973 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8299999999999997e-07 2023-09-30T17:04:06.974 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.974 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.974 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.974 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.407443+0000", 2023-09-30T17:04:06.974 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4788e-05 2023-09-30T17:04:06.974 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.974 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.974 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.974 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.407451+0000", 2023-09-30T17:04:06.974 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3560000000000004e-06 2023-09-30T17:04:06.975 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.975 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.975 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.975 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.407458+0000", 2023-09-30T17:04:06.975 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1420000000000004e-06 2023-09-30T17:04:06.975 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.975 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.975 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.975 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.975 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.975 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98146 4.36 4.670445b6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.976 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.498510+0000", 2023-09-30T17:04:06.976 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.27227766599999997, 2023-09-30T17:04:06.976 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.28501866799999998, 2023-09-30T17:04:06.976 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.976 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.976 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.976 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.976 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.976 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98146 2023-09-30T17:04:06.976 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.976 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.977 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.977 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.977 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.498510+0000", 2023-09-30T17:04:06.977 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.977 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.977 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.977 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.977 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.498510+0000", 2023-09-30T17:04:06.977 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.977 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.977 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.978 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.978 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.502335+0000", 2023-09-30T17:04:06.978 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0038249040000000001 2023-09-30T17:04:06.978 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.978 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.978 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.978 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.502356+0000", 2023-09-30T17:04:06.978 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.0999999999999999e-05 2023-09-30T17:04:06.978 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.978 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.978 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.979 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.502368+0000", 2023-09-30T17:04:06.979 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1231e-05 2023-09-30T17:04:06.979 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.979 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.979 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.979 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.502376+0000", 2023-09-30T17:04:06.979 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0339999999999997e-06 2023-09-30T17:04:06.979 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.979 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.979 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.979 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.979 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.980 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98724 4.6 4.8232b686 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.980 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.672120+0000", 2023-09-30T17:04:06.980 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.098668451000000004, 2023-09-30T17:04:06.980 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.11145073899999999, 2023-09-30T17:04:06.980 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.980 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.980 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.980 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.980 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.980 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98724 2023-09-30T17:04:06.980 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.981 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.981 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.981 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.981 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.672120+0000", 2023-09-30T17:04:06.981 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.981 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.981 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.981 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.981 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.672120+0000", 2023-09-30T17:04:06.981 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.981 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.982 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.982 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.982 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.672120+0000", 2023-09-30T17:04:06.982 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6199999999999998e-07 2023-09-30T17:04:06.982 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.982 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.982 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.982 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.672133+0000", 2023-09-30T17:04:06.982 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.292e-05 2023-09-30T17:04:06.982 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.982 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.983 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.983 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.672141+0000", 2023-09-30T17:04:06.983 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9340000000000006e-06 2023-09-30T17:04:06.983 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.983 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.983 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.983 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.672147+0000", 2023-09-30T17:04:06.983 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8490000000000002e-06 2023-09-30T17:04:06.983 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.983 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.983 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.983 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.984 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.984 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98760 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.984 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.682763+0000", 2023-09-30T17:04:06.984 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.088024560000000002, 2023-09-30T17:04:06.984 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.10085303299999999, 2023-09-30T17:04:06.984 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.984 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.984 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.984 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.984 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.985 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98760 2023-09-30T17:04:06.985 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.985 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.985 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.985 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.985 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.682763+0000", 2023-09-30T17:04:06.985 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.985 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.985 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.985 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.985 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.682763+0000", 2023-09-30T17:04:06.985 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.986 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.986 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.986 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.986 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.683732+0000", 2023-09-30T17:04:06.986 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00096846400000000004 2023-09-30T17:04:06.986 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.986 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.986 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.986 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.683751+0000", 2023-09-30T17:04:06.986 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9307e-05 2023-09-30T17:04:06.986 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.987 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.987 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.987 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.683774+0000", 2023-09-30T17:04:06.987 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.3201999999999999e-05 2023-09-30T17:04:06.987 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.987 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.987 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.987 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.683782+0000", 2023-09-30T17:04:06.987 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0890000000000002e-06 2023-09-30T17:04:06.987 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.987 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.987 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.988 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.988 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.988 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98927 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.988 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.733841+0000", 2023-09-30T17:04:06.988 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.036946779999999999, 2023-09-30T17:04:06.988 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.049809158999999999, 2023-09-30T17:04:06.988 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.988 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.988 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.988 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.988 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.989 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98927 2023-09-30T17:04:06.989 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.989 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.989 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.989 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.989 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.733841+0000", 2023-09-30T17:04:06.989 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.989 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.989 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.989 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.989 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.733841+0000", 2023-09-30T17:04:06.989 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.990 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.990 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.990 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.990 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.733842+0000", 2023-09-30T17:04:06.990 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1200000000000001e-07 2023-09-30T17:04:06.990 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.990 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.990 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.990 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.733854+0000", 2023-09-30T17:04:06.990 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2140999999999999e-05 2023-09-30T17:04:06.990 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.991 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.991 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.991 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.733866+0000", 2023-09-30T17:04:06.991 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2038000000000001e-05 2023-09-30T17:04:06.991 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.991 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.991 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.991 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.733875+0000", 2023-09-30T17:04:06.991 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9719999999999998e-06 2023-09-30T17:04:06.991 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.991 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.991 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.992 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.992 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.992 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97609 4.36 4:6fa85f86:::100000001f8.00000013:head [write 4050944~4096 in=4096b,write 4153344~4096 in=4096b,write 4173824~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:06.992 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.330303+0000", 2023-09-30T17:04:06.992 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.44048522299999998, 2023-09-30T17:04:06.992 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.453391241, 2023-09-30T17:04:06.992 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.992 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:06.992 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.992 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.992 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.993 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97609 2023-09-30T17:04:06.993 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.993 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.993 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.993 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.993 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.330303+0000", 2023-09-30T17:04:06.993 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.993 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.993 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.993 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.993 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.330303+0000", 2023-09-30T17:04:06.994 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.994 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.994 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.994 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:06.994 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.330303+0000", 2023-09-30T17:04:06.994 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7299999999999996e-07 2023-09-30T17:04:06.994 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.994 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.994 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:06.994 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.330318+0000", 2023-09-30T17:04:06.994 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4440999999999999e-05 2023-09-30T17:04:06.995 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.995 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.995 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:06.995 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.330327+0000", 2023-09-30T17:04:06.995 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1039999999999996e-06 2023-09-30T17:04:06.995 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.995 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.995 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:06.995 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.330333+0000", 2023-09-30T17:04:06.995 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8270000000000003e-06 2023-09-30T17:04:06.995 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.996 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.996 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:06.996 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.767835+0000", 2023-09-30T17:04:06.996 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.43750267500000001 2023-09-30T17:04:06.996 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.996 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.996 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:06.996 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.767913+0000", 2023-09-30T17:04:06.996 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7568e-05 2023-09-30T17:04:06.996 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.996 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.997 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:06.997 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.768098+0000", 2023-09-30T17:04:06.997 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00018497899999999999 2023-09-30T17:04:06.997 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.997 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.997 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:06.997 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.778296+0000", 2023-09-30T17:04:06.997 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010197668 2023-09-30T17:04:06.997 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.997 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:06.997 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:06.998 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.998 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.998 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97841 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:06.998 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.401340+0000", 2023-09-30T17:04:06.998 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.36944825999999997, 2023-09-30T17:04:06.998 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.38241823200000002, 2023-09-30T17:04:06.998 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:06.998 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:06.998 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:06.998 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:06.998 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:06.999 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97841 2023-09-30T17:04:06.999 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.999 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:06.999 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.999 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:06.999 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.401340+0000", 2023-09-30T17:04:06.999 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:06.999 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:06.999 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:06.999 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:06.999 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.401340+0000", 2023-09-30T17:04:06.999 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:07.000 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.000 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.000 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:07.000 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.401340+0000", 2023-09-30T17:04:07.000 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9700000000000002e-07 2023-09-30T17:04:07.000 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.000 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.000 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:07.000 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.401351+0000", 2023-09-30T17:04:07.000 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0963e-05 2023-09-30T17:04:07.000 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.001 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.001 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:07.001 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.401358+0000", 2023-09-30T17:04:07.001 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4899999999999997e-06 2023-09-30T17:04:07.001 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.001 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.001 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:07.001 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.401363+0000", 2023-09-30T17:04:07.001 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8170000000000004e-06 2023-09-30T17:04:07.001 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:07.001 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:07.002 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:07.002 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.002 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.002 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98094 4.6 4.8232b686 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:07.002 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.473121+0000", 2023-09-30T17:04:07.002 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.297666969, 2023-09-30T17:04:07.002 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.31067129500000001, 2023-09-30T17:04:07.002 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:07.002 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:07.002 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:07.002 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:07.003 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:07.003 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98094 2023-09-30T17:04:07.003 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.003 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:07.003 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.003 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:07.003 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.473121+0000", 2023-09-30T17:04:07.003 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:07.003 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.003 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.003 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:07.004 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.473121+0000", 2023-09-30T17:04:07.004 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:07.004 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.004 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.004 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:07.004 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.473839+0000", 2023-09-30T17:04:07.004 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00071805800000000004 2023-09-30T17:04:07.004 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.004 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.004 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:07.004 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.473857+0000", 2023-09-30T17:04:07.004 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7807000000000001e-05 2023-09-30T17:04:07.005 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.005 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.005 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:07.005 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.473867+0000", 2023-09-30T17:04:07.005 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0550000000000001e-05 2023-09-30T17:04:07.005 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.005 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.005 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:07.005 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.473877+0000", 2023-09-30T17:04:07.005 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7240000000000004e-06 2023-09-30T17:04:07.005 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:07.005 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:07.006 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:07.006 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.006 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.006 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98558 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:07.006 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.621410+0000", 2023-09-30T17:04:07.006 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.14937794400000001, 2023-09-30T17:04:07.006 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.16241481499999999, 2023-09-30T17:04:07.006 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:07.006 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:07.006 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:07.006 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:07.007 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:07.007 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98558 2023-09-30T17:04:07.007 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.007 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:07.007 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.007 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:07.007 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.621410+0000", 2023-09-30T17:04:07.007 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:07.007 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.007 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.007 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:07.008 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.621410+0000", 2023-09-30T17:04:07.008 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:07.008 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.008 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.008 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:07.008 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.622434+0000", 2023-09-30T17:04:07.008 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0010235050000000001 2023-09-30T17:04:07.008 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.008 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.008 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:07.009 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.622455+0000", 2023-09-30T17:04:07.009 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.0899000000000001e-05 2023-09-30T17:04:07.009 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.009 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.009 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:07.009 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.622481+0000", 2023-09-30T17:04:07.009 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.6514999999999999e-05 2023-09-30T17:04:07.009 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.009 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.009 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:07.009 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.622489+0000", 2023-09-30T17:04:07.010 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9009999999999994e-06 2023-09-30T17:04:07.010 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:07.010 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:07.010 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:07.010 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.010 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.010 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98726 4.36 4.670445b6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:07.010 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.672156+0000", 2023-09-30T17:04:07.010 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.098632317999999997, 2023-09-30T17:04:07.010 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.11170195500000001, 2023-09-30T17:04:07.011 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:07.011 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:07.011 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:07.011 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:07.011 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:07.011 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98726 2023-09-30T17:04:07.011 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.011 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:07.011 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.011 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:07.011 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.672156+0000", 2023-09-30T17:04:07.012 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:07.012 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.012 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.012 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:07.012 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.672156+0000", 2023-09-30T17:04:07.012 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:07.012 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.012 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.012 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:07.012 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.672161+0000", 2023-09-30T17:04:07.012 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4519999999999996e-06 2023-09-30T17:04:07.012 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.013 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.013 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:07.013 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.672176+0000", 2023-09-30T17:04:07.013 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5175e-05 2023-09-30T17:04:07.013 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.013 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.013 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:07.013 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.672187+0000", 2023-09-30T17:04:07.013 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1019000000000001e-05 2023-09-30T17:04:07.013 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.013 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.014 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:07.014 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.672194+0000", 2023-09-30T17:04:07.014 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4450000000000001e-06 2023-09-30T17:04:07.014 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:07.014 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:07.014 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:07.014 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.014 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.014 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:99037 4.14 4:2b28d75f:::100000001f8.00000016:head [write 2355200~4096 in=4096b,write 2367488~4096 in=4096b,write 2400256~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:07.014 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.772633+0000", 2023-09-30T17:04:07.014 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.9981551, 2023-09-30T17:04:07.015 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011262332, 2023-09-30T17:04:07.015 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:07.015 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:07.015 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:07.015 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:07.015 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:07.015 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 99037 2023-09-30T17:04:07.015 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.015 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:07.015 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.015 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:07.016 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.772633+0000", 2023-09-30T17:04:07.016 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:07.016 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.016 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.016 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:07.016 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.772633+0000", 2023-09-30T17:04:07.016 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:07.016 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.016 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.016 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:07.016 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.772633+0000", 2023-09-30T17:04:07.016 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8899999999999999e-07 2023-09-30T17:04:07.017 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.017 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.017 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:07.017 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.772647+0000", 2023-09-30T17:04:07.017 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3563e-05 2023-09-30T17:04:07.017 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.017 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.017 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:07.017 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.772655+0000", 2023-09-30T17:04:07.017 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.191e-06 2023-09-30T17:04:07.017 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.017 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.018 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:07.018 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.772662+0000", 2023-09-30T17:04:07.018 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7279999999999998e-06 2023-09-30T17:04:07.018 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.018 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.018 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:07.018 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.772769+0000", 2023-09-30T17:04:07.018 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000106748 2023-09-30T17:04:07.018 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.018 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.018 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:07.019 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.772817+0000", 2023-09-30T17:04:07.019 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7929999999999997e-05 2023-09-30T17:04:07.019 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.019 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.019 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:07.019 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.772942+0000", 2023-09-30T17:04:07.019 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00012496799999999999 2023-09-30T17:04:07.019 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.019 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.019 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:07.019 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.775581+0000", 2023-09-30T17:04:07.019 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0026391280000000001 2023-09-30T17:04:07.020 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:07.020 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:07.020 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:07.020 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.020 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.020 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97611 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 704512~4096 in=4096b,write 761856~4096 in=4096b,write 770048~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:07.020 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.330342+0000", 2023-09-30T17:04:07.020 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.44044653700000003, 2023-09-30T17:04:07.020 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.45360201900000002, 2023-09-30T17:04:07.020 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:07.020 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:07.020 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:07.021 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:07.021 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:07.021 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97611 2023-09-30T17:04:07.021 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.021 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:07.021 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.021 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:07.021 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.330342+0000", 2023-09-30T17:04:07.021 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:07.021 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.021 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.021 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:07.021 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.330342+0000", 2023-09-30T17:04:07.022 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:07.022 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.022 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.022 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:07.022 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.330342+0000", 2023-09-30T17:04:07.022 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5300000000000004e-07 2023-09-30T17:04:07.022 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.022 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.022 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:07.022 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.330354+0000", 2023-09-30T17:04:07.022 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2308e-05 2023-09-30T17:04:07.023 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.023 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.023 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:07.023 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.330364+0000", 2023-09-30T17:04:07.023 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2909999999999996e-06 2023-09-30T17:04:07.023 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.023 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.023 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:07.023 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.330369+0000", 2023-09-30T17:04:07.023 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7989999999999999e-06 2023-09-30T17:04:07.023 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.023 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.024 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:07.024 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.770880+0000", 2023-09-30T17:04:07.024 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.44051019899999999 2023-09-30T17:04:07.024 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.024 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.024 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:07.024 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.770960+0000", 2023-09-30T17:04:07.024 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0516e-05 2023-09-30T17:04:07.024 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.024 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.024 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:07.024 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.771126+0000", 2023-09-30T17:04:07.025 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000165339 2023-09-30T17:04:07.025 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.025 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.025 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:07.025 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.782341+0000", 2023-09-30T17:04:07.025 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011215457999999999 2023-09-30T17:04:07.025 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:07.025 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:07.025 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:07.025 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.025 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.025 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97802 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:07.026 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.385745+0000", 2023-09-30T17:04:07.026 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.38504275700000001, 2023-09-30T17:04:07.026 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39824283100000002, 2023-09-30T17:04:07.026 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:07.026 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:07.026 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:07.026 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:07.026 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:07.026 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97802 2023-09-30T17:04:07.026 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.027 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:07.027 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.027 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:07.027 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.385745+0000", 2023-09-30T17:04:07.027 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:07.027 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.027 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.027 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:07.027 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.385745+0000", 2023-09-30T17:04:07.027 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:07.027 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.028 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.028 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:07.028 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.387412+0000", 2023-09-30T17:04:07.028 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0016668309999999999 2023-09-30T17:04:07.028 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.028 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.028 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:07.028 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.387433+0000", 2023-09-30T17:04:07.028 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1297999999999998e-05 2023-09-30T17:04:07.028 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.028 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.028 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:07.029 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.387445+0000", 2023-09-30T17:04:07.029 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1956e-05 2023-09-30T17:04:07.029 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.029 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.029 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:07.029 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.387453+0000", 2023-09-30T17:04:07.029 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7549999999999994e-06 2023-09-30T17:04:07.029 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:07.029 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:07.029 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:07.029 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.030 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.030 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97842 4.6 4.2d31fac6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:07.030 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.401372+0000", 2023-09-30T17:04:07.030 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.36941577199999998, 2023-09-30T17:04:07.030 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.38266312299999999, 2023-09-30T17:04:07.030 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:07.030 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:07.030 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:07.030 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:07.030 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:07.030 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97842 2023-09-30T17:04:07.030 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.031 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:07.031 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.031 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:07.031 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.401372+0000", 2023-09-30T17:04:07.031 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:07.031 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.031 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.031 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:07.031 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.401372+0000", 2023-09-30T17:04:07.031 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:07.031 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.032 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.032 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:07.032 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.401373+0000", 2023-09-30T17:04:07.032 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7999999999999996e-07 2023-09-30T17:04:07.032 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.032 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.032 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:07.032 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.401383+0000", 2023-09-30T17:04:07.032 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0530000000000001e-05 2023-09-30T17:04:07.032 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.032 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.033 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:07.033 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.401389+0000", 2023-09-30T17:04:07.033 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8579999999999996e-06 2023-09-30T17:04:07.033 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.033 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.033 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:07.033 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.401394+0000", 2023-09-30T17:04:07.033 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6349999999999997e-06 2023-09-30T17:04:07.033 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:07.033 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:07.033 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:07.033 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.034 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.034 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98038 4.6 4.2d31fac6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:07.034 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.453843+0000", 2023-09-30T17:04:07.034 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.316944697, 2023-09-30T17:04:07.034 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.33024699000000002, 2023-09-30T17:04:07.034 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:07.034 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:07.034 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:07.034 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:07.034 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:07.034 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98038 2023-09-30T17:04:07.035 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.035 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:07.035 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.035 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:07.037 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.453843+0000", 2023-09-30T17:04:07.037 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:07.037 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.037 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.037 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:07.037 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.453843+0000", 2023-09-30T17:04:07.037 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:07.037 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.038 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.038 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:07.038 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.453844+0000", 2023-09-30T17:04:07.038 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7999999999999995e-07 2023-09-30T17:04:07.038 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.038 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.038 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:07.038 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.453858+0000", 2023-09-30T17:04:07.038 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3621000000000001e-05 2023-09-30T17:04:07.038 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.038 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.039 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:07.039 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.453865+0000", 2023-09-30T17:04:07.039 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8210000000000002e-06 2023-09-30T17:04:07.039 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.039 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.039 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:07.039 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.453871+0000", 2023-09-30T17:04:07.039 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0009999999999998e-06 2023-09-30T17:04:07.039 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:07.039 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:07.039 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:07.040 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.040 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.040 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98559 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:07.040 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.622499+0000", 2023-09-30T17:04:07.040 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.148289067, 2023-09-30T17:04:07.040 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.161636945, 2023-09-30T17:04:07.040 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:07.040 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:07.040 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:07.040 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:07.040 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:07.041 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98559 2023-09-30T17:04:07.041 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.041 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:07.041 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.041 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:07.041 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.622499+0000", 2023-09-30T17:04:07.041 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:07.041 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.041 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.041 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:07.041 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.622499+0000", 2023-09-30T17:04:07.041 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:07.042 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.042 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.042 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:07.042 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.622499+0000", 2023-09-30T17:04:07.042 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.82e-07 2023-09-30T17:04:07.042 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.042 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.042 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:07.042 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.622510+0000", 2023-09-30T17:04:07.042 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0634e-05 2023-09-30T17:04:07.042 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.043 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.043 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:07.043 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.622518+0000", 2023-09-30T17:04:07.043 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6249999999999998e-06 2023-09-30T17:04:07.043 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.043 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.043 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:07.043 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.622521+0000", 2023-09-30T17:04:07.043 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5499999999999999e-06 2023-09-30T17:04:07.043 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:07.044 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:07.044 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:07.044 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.044 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.044 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98930 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:07.044 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.734812+0000", 2023-09-30T17:04:07.044 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.035976514000000001, 2023-09-30T17:04:07.044 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.049374835999999998, 2023-09-30T17:04:07.044 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:07.044 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:07.044 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:07.044 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:07.045 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:07.045 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98930 2023-09-30T17:04:07.045 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.045 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:07.045 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.045 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:07.045 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.734812+0000", 2023-09-30T17:04:07.045 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:07.045 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.045 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.045 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:07.045 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.734812+0000", 2023-09-30T17:04:07.046 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:07.046 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.046 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.046 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:07.046 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.734812+0000", 2023-09-30T17:04:07.046 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.6500000000000008e-07 2023-09-30T17:04:07.046 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.046 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.046 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:07.047 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.734826+0000", 2023-09-30T17:04:07.047 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3067999999999999e-05 2023-09-30T17:04:07.047 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.047 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.047 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:07.047 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.734838+0000", 2023-09-30T17:04:07.047 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1979e-05 2023-09-30T17:04:07.047 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.047 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.047 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:07.048 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.734846+0000", 2023-09-30T17:04:07.048 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3089999999999996e-06 2023-09-30T17:04:07.048 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:07.048 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:07.048 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:07.048 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.048 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.048 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:99038 4.13 4:cbf33e86:::100000001f8.00000026:head [write 2379776~4096 in=4096b,write 2826240~4096 in=4096b,write 4018176~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:07.048 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.772678+0000", 2023-09-30T17:04:07.048 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.9981103, 2023-09-30T17:04:07.048 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011578911000000001, 2023-09-30T17:04:07.049 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:07.049 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:07.049 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:07.049 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:07.049 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:07.049 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 99038 2023-09-30T17:04:07.049 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.049 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:07.049 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.049 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:07.049 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.772678+0000", 2023-09-30T17:04:07.050 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:07.050 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.050 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.050 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:07.050 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.772678+0000", 2023-09-30T17:04:07.050 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:07.050 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.050 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.050 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:07.050 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.772678+0000", 2023-09-30T17:04:07.050 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4099999999999999e-07 2023-09-30T17:04:07.051 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.051 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.051 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:07.051 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.772689+0000", 2023-09-30T17:04:07.051 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0987e-05 2023-09-30T17:04:07.051 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.051 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.051 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:07.051 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.772697+0000", 2023-09-30T17:04:07.051 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0299999999999994e-06 2023-09-30T17:04:07.051 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.052 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.052 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:07.052 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.772704+0000", 2023-09-30T17:04:07.052 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1099999999999997e-06 2023-09-30T17:04:07.052 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.052 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.052 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:07.052 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.774385+0000", 2023-09-30T17:04:07.052 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0016802469999999999 2023-09-30T17:04:07.052 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.052 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.052 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:07.053 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.774563+0000", 2023-09-30T17:04:07.053 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017798799999999999 2023-09-30T17:04:07.053 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:07.053 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:07.053 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:07.053 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.053 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.053 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97673 4.e 4.c27217ce (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e49)", 2023-09-30T17:04:07.053 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.348257+0000", 2023-09-30T17:04:07.053 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.42253152900000002, 2023-09-30T17:04:07.054 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.43607483200000002, 2023-09-30T17:04:07.054 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:07.054 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:07.054 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:07.054 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:07.054 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:07.054 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97673 2023-09-30T17:04:07.054 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.054 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:07.054 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.054 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:07.055 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.348257+0000", 2023-09-30T17:04:07.055 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:07.055 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.055 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.055 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:07.055 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.348257+0000", 2023-09-30T17:04:07.055 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:07.055 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.055 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.055 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:07.055 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.349890+0000", 2023-09-30T17:04:07.055 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00163353 2023-09-30T17:04:07.056 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.056 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.056 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:07.056 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.349912+0000", 2023-09-30T17:04:07.056 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2237000000000001e-05 2023-09-30T17:04:07.056 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.056 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.056 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:07.056 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.349921+0000", 2023-09-30T17:04:07.056 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8650000000000007e-06 2023-09-30T17:04:07.057 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.057 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.057 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:07.057 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.349930+0000", 2023-09-30T17:04:07.057 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9360000000000005e-06 2023-09-30T17:04:07.057 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:07.057 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:07.057 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:07.057 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.057 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.057 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97718 4.6 4.8232b686 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:07.057 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.362979+0000", 2023-09-30T17:04:07.058 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.40780952599999998, 2023-09-30T17:04:07.058 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.42140830200000001, 2023-09-30T17:04:07.058 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:07.058 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:07.058 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:07.058 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:07.058 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:07.058 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97718 2023-09-30T17:04:07.058 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.058 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:07.058 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.058 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:07.059 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.362979+0000", 2023-09-30T17:04:07.059 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:07.059 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.059 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.059 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:07.059 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.362979+0000", 2023-09-30T17:04:07.059 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:07.059 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.059 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.059 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:07.059 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.362979+0000", 2023-09-30T17:04:07.060 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5000000000000003e-07 2023-09-30T17:04:07.060 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.060 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.060 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:07.060 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.362993+0000", 2023-09-30T17:04:07.060 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3498e-05 2023-09-30T17:04:07.060 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.060 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.060 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:07.060 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.363001+0000", 2023-09-30T17:04:07.060 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2290000000000003e-06 2023-09-30T17:04:07.060 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.061 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.061 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:07.061 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.363009+0000", 2023-09-30T17:04:07.061 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8299999999999996e-06 2023-09-30T17:04:07.061 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:07.061 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:07.061 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:07.061 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.061 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.061 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:97870 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:07.061 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.407549+0000", 2023-09-30T17:04:07.061 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.363238599, 2023-09-30T17:04:07.062 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.376891737, 2023-09-30T17:04:07.062 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:07.062 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:07.062 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:07.062 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:07.062 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:07.062 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 97870 2023-09-30T17:04:07.062 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.062 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:07.062 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.062 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:07.063 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.407549+0000", 2023-09-30T17:04:07.063 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:07.063 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.063 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.063 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:07.063 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.407549+0000", 2023-09-30T17:04:07.063 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:07.063 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.063 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.063 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:07.063 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.407550+0000", 2023-09-30T17:04:07.064 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5199999999999997e-07 2023-09-30T17:04:07.064 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.064 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.064 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:07.064 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.407567+0000", 2023-09-30T17:04:07.064 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6608000000000001e-05 2023-09-30T17:04:07.064 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.064 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.064 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:07.064 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.407576+0000", 2023-09-30T17:04:07.064 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2229999999999996e-06 2023-09-30T17:04:07.064 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.065 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.065 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:07.065 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.407582+0000", 2023-09-30T17:04:07.065 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1959999999999996e-06 2023-09-30T17:04:07.065 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:07.065 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:07.065 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:07.065 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.065 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.065 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98408 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:07.065 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.576797+0000", 2023-09-30T17:04:07.066 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.19399106499999999, 2023-09-30T17:04:07.066 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.20769601700000001, 2023-09-30T17:04:07.066 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:07.066 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:07.066 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:07.066 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:07.066 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:07.066 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98408 2023-09-30T17:04:07.066 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.066 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:07.066 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.067 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:07.067 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.576797+0000", 2023-09-30T17:04:07.067 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:07.067 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.067 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.067 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:07.067 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.576797+0000", 2023-09-30T17:04:07.067 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:07.067 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.067 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.067 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:07.067 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.576797+0000", 2023-09-30T17:04:07.068 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3300000000000003e-07 2023-09-30T17:04:07.068 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.068 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.068 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:07.068 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.576810+0000", 2023-09-30T17:04:07.068 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2459999999999999e-05 2023-09-30T17:04:07.068 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.068 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.068 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:07.068 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.576817+0000", 2023-09-30T17:04:07.068 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1840000000000002e-06 2023-09-30T17:04:07.068 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.069 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.069 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:07.069 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.576823+0000", 2023-09-30T17:04:07.069 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5010000000000004e-06 2023-09-30T17:04:07.069 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:07.069 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:07.069 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:07.069 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.069 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.069 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98531 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:07.069 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.612904+0000", 2023-09-30T17:04:07.070 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.15788432799999999, 2023-09-30T17:04:07.070 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.17164190500000001, 2023-09-30T17:04:07.070 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:07.070 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:07.070 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:07.070 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:07.070 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:07.070 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98531 2023-09-30T17:04:07.070 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.070 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:07.070 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.071 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:07.071 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.612904+0000", 2023-09-30T17:04:07.071 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:07.071 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.071 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.071 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:07.071 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.612904+0000", 2023-09-30T17:04:07.071 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:07.071 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.071 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.072 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:07.072 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.614616+0000", 2023-09-30T17:04:07.072 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0017118299999999999 2023-09-30T17:04:07.072 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.072 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.072 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:07.072 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.614641+0000", 2023-09-30T17:04:07.072 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.5788000000000001e-05 2023-09-30T17:04:07.072 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.072 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.072 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:07.073 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.614652+0000", 2023-09-30T17:04:07.073 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1061e-05 2023-09-30T17:04:07.073 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.073 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.073 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:07.073 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.614661+0000", 2023-09-30T17:04:07.073 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1370000000000002e-06 2023-09-30T17:04:07.073 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:07.073 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:07.073 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:07.073 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.073 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.074 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98658 4.e 4.c27217ce (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:07.074 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.650896+0000", 2023-09-30T17:04:07.074 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.11989200899999999, 2023-09-30T17:04:07.074 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.13370222200000001, 2023-09-30T17:04:07.074 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:07.074 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:07.074 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:07.074 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:07.074 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:07.074 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98658 2023-09-30T17:04:07.074 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.075 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:07.075 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.075 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:07.075 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.650896+0000", 2023-09-30T17:04:07.075 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:07.075 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.075 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.075 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:07.075 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.650896+0000", 2023-09-30T17:04:07.075 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:07.075 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.075 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.075 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:07.076 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.650897+0000", 2023-09-30T17:04:07.076 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5799999999999999e-07 2023-09-30T17:04:07.076 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.076 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.076 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:07.076 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.650910+0000", 2023-09-30T17:04:07.076 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3851e-05 2023-09-30T17:04:07.076 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.076 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.076 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:07.076 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.650919+0000", 2023-09-30T17:04:07.077 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4509999999999992e-06 2023-09-30T17:04:07.077 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.077 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.077 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:07.077 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.650926+0000", 2023-09-30T17:04:07.077 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9330000000000004e-06 2023-09-30T17:04:07.077 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:07.077 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:07.077 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:07.077 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.077 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.077 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:98839 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:07.078 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.704373+0000", 2023-09-30T17:04:07.078 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.066415360000000007, 2023-09-30T17:04:07.078 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.080278883999999995, 2023-09-30T17:04:07.078 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:07.078 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:07.078 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:07.078 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:07.078 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:07.078 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 98839 2023-09-30T17:04:07.078 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.078 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:07.078 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.079 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:07.079 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.704373+0000", 2023-09-30T17:04:07.079 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:07.079 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.079 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.079 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:07.079 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.704373+0000", 2023-09-30T17:04:07.079 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:07.079 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.079 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.079 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:07.079 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.704373+0000", 2023-09-30T17:04:07.080 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1900000000000003e-07 2023-09-30T17:04:07.080 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.080 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.080 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:07.080 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.704383+0000", 2023-09-30T17:04:07.080 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.4269999999999997e-06 2023-09-30T17:04:07.080 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.080 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.080 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:07.080 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.704389+0000", 2023-09-30T17:04:07.081 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4799999999999998e-06 2023-09-30T17:04:07.081 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.081 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.081 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:07.081 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.704394+0000", 2023-09-30T17:04:07.081 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3399999999999997e-06 2023-09-30T17:04:07.081 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:07.081 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:07.081 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:07.081 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.082 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.082 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:99039 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:07.082 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:05.772852+0000", 2023-09-30T17:04:07.082 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.9979362, 2023-09-30T17:04:07.082 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011855443, 2023-09-30T17:04:07.082 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:07.082 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:07.082 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:07.082 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:07.082 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:07.083 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 99039 2023-09-30T17:04:07.083 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.083 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:07.083 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.083 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:07.083 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.772852+0000", 2023-09-30T17:04:07.083 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:07.083 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.083 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.083 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:07.083 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.772852+0000", 2023-09-30T17:04:07.084 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:07.084 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.084 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.084 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:07.084 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.772852+0000", 2023-09-30T17:04:07.084 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3399999999999998e-07 2023-09-30T17:04:07.084 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.084 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.084 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:07.084 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.772869+0000", 2023-09-30T17:04:07.084 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6167999999999998e-05 2023-09-30T17:04:07.085 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.085 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.085 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:07.085 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.772878+0000", 2023-09-30T17:04:07.085 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.893e-06 2023-09-30T17:04:07.085 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:07.085 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:07.085 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:07.085 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:05.772885+0000", 2023-09-30T17:04:07.085 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9879999999999998e-06 2023-09-30T17:04:07.085 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:07.086 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:07.086 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:07.086 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:07.086 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-09-30T17:04:07.086 INFO:teuthology.orchestra.run.smithi031.stdout: "num_ops": 222 2023-09-30T17:04:07.086 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:04:07.087 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:04:07.091 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:07.087+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:07.188 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:07.188+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:07.206 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-09-30T17:04:07.289 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:07.289+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:07.298 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:04:07.298 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:04:07.298 INFO:teuthology.orchestra.run.smithi031.stdout: "complaint_time": 30, 2023-09-30T17:04:07.299 INFO:teuthology.orchestra.run.smithi031.stdout: "num_blocked_ops": 0 2023-09-30T17:04:07.299 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:04:07.311 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:04:07.314 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-09-30T17:04:07.396 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:07.395+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:07.406 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:04:07.424 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:04:07.425 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-09-30T17:04:07.425 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-09-30T17:04:07.425 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:04:07.428 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:04:07.429 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:04:07.491 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:07.491+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:07.566 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:07.566 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:07.572 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:04:07.618 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:07.618+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:07.693 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:07.693+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:07.771 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:07.772 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:07.789 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:04:07.842 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:07.830+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:07.897 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:07.896+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:07.996 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:07.995+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:08.038 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:08.038 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:08.056 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:04:08.098 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:08.098+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:08.200 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:08.198+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:08.297 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:08.297 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:08.300 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:08.300+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:08.313 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:04:08.402 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:08.401+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:08.408 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is unset 2023-09-30T17:04:08.513 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:08.509+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:08.534 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:08.534 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:08.546 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:04:08.603 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:08.603+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:08.704 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:08.704+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:08.802 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:08.803 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:08.805 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:08.806+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:08.819 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:04:08.906 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:08.906+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:09.007 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:09.007+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:09.021 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:09.021 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:09.039 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:04:09.108 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:09.108+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:09.210 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:09.208+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:09.232 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:09.232 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:09.245 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:04:09.330 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:09.330+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:09.409 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:09.409+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:09.430 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-09-30T17:04:09.491 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:09.492 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:09.507 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:04:09.510 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:09.509+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:09.611 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:09.610+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:09.621 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:04:09.653 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:04:09.654 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-09-30T17:04:09.654 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-09-30T17:04:09.654 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:04:09.656 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:04:09.657 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:04:09.695 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~82s 2023-09-30T17:04:09.712 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:09.711+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:09.733 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:04:09.733 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2023-09-30T17:04:09.733 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2023-09-30T17:04:09.733 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2023-09-30T17:04:09.734 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.734 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:98677 4.37 4:eff9002a:::100000001f8.00000003:head [write 3088384~4096,write 3100672~4096,write 3141632~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:09.734 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:05.650813+0000", 2023-09-30T17:04:09.734 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.0807280019999999, 2023-09-30T17:04:09.734 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.29960922200000001, 2023-09-30T17:04:09.734 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:09.734 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:09.734 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:09.734 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:09.734 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:09.734 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 98677 2023-09-30T17:04:09.735 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.735 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:09.735 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.735 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:09.735 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.650813+0000", 2023-09-30T17:04:09.737 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:09.737 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.738 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.738 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:09.738 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.650813+0000", 2023-09-30T17:04:09.738 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:09.738 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.738 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.738 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:09.738 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.650814+0000", 2023-09-30T17:04:09.738 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6199999999999996e-07 2023-09-30T17:04:09.738 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.739 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.739 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:09.739 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.650825+0000", 2023-09-30T17:04:09.739 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0976e-05 2023-09-30T17:04:09.739 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.739 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.739 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:09.739 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.650836+0000", 2023-09-30T17:04:09.739 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0932e-05 2023-09-30T17:04:09.739 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.739 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.740 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:09.740 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.650843+0000", 2023-09-30T17:04:09.740 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1840000000000002e-06 2023-09-30T17:04:09.740 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.740 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.740 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:09.740 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.901877+0000", 2023-09-30T17:04:09.740 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.251033703 2023-09-30T17:04:09.740 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.740 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.740 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:09.740 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.901935+0000", 2023-09-30T17:04:09.741 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7646999999999999e-05 2023-09-30T17:04:09.741 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.741 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.741 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:09.741 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.902095+0000", 2023-09-30T17:04:09.741 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016035100000000001 2023-09-30T17:04:09.741 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.741 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.741 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:09.741 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.924791+0000", 2023-09-30T17:04:09.741 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022695934000000001 2023-09-30T17:04:09.742 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.742 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.742 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:09.742 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.950328+0000", 2023-09-30T17:04:09.742 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.025536611000000001 2023-09-30T17:04:09.742 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.742 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.742 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:09.742 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.950387+0000", 2023-09-30T17:04:09.742 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9502000000000001e-05 2023-09-30T17:04:09.742 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.743 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.743 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:09.743 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.950423+0000", 2023-09-30T17:04:09.743 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5519999999999999e-05 2023-09-30T17:04:09.743 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:09.743 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:09.743 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:09.743 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.743 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.743 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:98764 4.f 4:f26fdfa9:::100000001f8.00000002:head [write 2957312~4096,write 3170304~4096,write 3207168~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:09.743 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:05.677853+0000", 2023-09-30T17:04:09.744 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.0536882719999996, 2023-09-30T17:04:09.744 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.29496506099999997, 2023-09-30T17:04:09.744 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:09.744 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:09.744 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:09.744 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:09.744 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:09.744 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 98764 2023-09-30T17:04:09.744 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.744 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:09.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.745 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:09.745 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.677853+0000", 2023-09-30T17:04:09.745 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:09.745 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.745 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.745 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:09.745 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.677853+0000", 2023-09-30T17:04:09.745 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:09.745 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.745 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.745 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:09.746 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.677854+0000", 2023-09-30T17:04:09.746 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7000000000000003e-07 2023-09-30T17:04:09.746 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.746 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.746 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:09.746 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.677864+0000", 2023-09-30T17:04:09.746 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9089999999999995e-06 2023-09-30T17:04:09.746 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.746 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.746 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:09.746 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.677879+0000", 2023-09-30T17:04:09.747 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4686e-05 2023-09-30T17:04:09.747 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.747 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.747 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:09.747 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.677886+0000", 2023-09-30T17:04:09.747 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7100000000000007e-06 2023-09-30T17:04:09.747 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.747 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.747 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:09.747 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.925190+0000", 2023-09-30T17:04:09.747 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.247304045 2023-09-30T17:04:09.748 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.748 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.748 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:09.748 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.925270+0000", 2023-09-30T17:04:09.748 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9599999999999997e-05 2023-09-30T17:04:09.748 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.748 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.748 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:09.748 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.925446+0000", 2023-09-30T17:04:09.748 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000176319 2023-09-30T17:04:09.748 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.748 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.749 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:09.749 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.950583+0000", 2023-09-30T17:04:09.749 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.025137146999999999 2023-09-30T17:04:09.749 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.749 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.749 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:09.749 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.972709+0000", 2023-09-30T17:04:09.749 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022125190999999999 2023-09-30T17:04:09.749 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.749 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.750 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:09.750 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.972763+0000", 2023-09-30T17:04:09.750 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4456999999999997e-05 2023-09-30T17:04:09.750 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.750 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.750 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:09.750 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.972818+0000", 2023-09-30T17:04:09.750 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5127000000000003e-05 2023-09-30T17:04:09.750 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:09.750 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:09.751 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:09.751 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.751 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.751 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:98770 4.f 4:f0d983b2:::100000001f8.0000001f:head [write 3182592~4096,write 3321856~4096,write 3444736~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:09.751 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:05.679643+0000", 2023-09-30T17:04:09.751 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.0518984720000004, 2023-09-30T17:04:09.751 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.293297951, 2023-09-30T17:04:09.751 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:09.752 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:09.752 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:09.752 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:09.752 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:09.752 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 98770 2023-09-30T17:04:09.752 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.752 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:09.752 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.752 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:09.752 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.679643+0000", 2023-09-30T17:04:09.752 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:09.753 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.753 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.753 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:09.753 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.679643+0000", 2023-09-30T17:04:09.753 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:09.753 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.753 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.753 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:09.754 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.679643+0000", 2023-09-30T17:04:09.754 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1999999999999999e-07 2023-09-30T17:04:09.754 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.754 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.754 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:09.754 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.679653+0000", 2023-09-30T17:04:09.754 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4520000000000003e-06 2023-09-30T17:04:09.754 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.755 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.755 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:09.755 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.679663+0000", 2023-09-30T17:04:09.755 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0108999999999999e-05 2023-09-30T17:04:09.755 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.755 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.755 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:09.755 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.679669+0000", 2023-09-30T17:04:09.755 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9209999999999997e-06 2023-09-30T17:04:09.756 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.756 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.756 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:09.756 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.927730+0000", 2023-09-30T17:04:09.756 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.24806134199999999 2023-09-30T17:04:09.756 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.756 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.756 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:09.756 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.927809+0000", 2023-09-30T17:04:09.756 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8709999999999997e-05 2023-09-30T17:04:09.757 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.757 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.757 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:09.757 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.927952+0000", 2023-09-30T17:04:09.757 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014343799999999999 2023-09-30T17:04:09.757 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.757 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.757 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:09.758 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.950739+0000", 2023-09-30T17:04:09.758 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022786595 2023-09-30T17:04:09.758 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.758 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.758 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:09.758 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.972862+0000", 2023-09-30T17:04:09.758 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022122485000000001 2023-09-30T17:04:09.758 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.758 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.758 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:09.759 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.972910+0000", 2023-09-30T17:04:09.759 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7969000000000001e-05 2023-09-30T17:04:09.759 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.759 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.759 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:09.759 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.972941+0000", 2023-09-30T17:04:09.759 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1309999999999997e-05 2023-09-30T17:04:09.759 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:09.759 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:09.760 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:09.760 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.760 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.760 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:98776 4.f 4:f0d983b2:::100000001f8.0000001f:head [write 3346432~4096,write 3567616~4096,write 3604480~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:09.760 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:05.681417+0000", 2023-09-30T17:04:09.760 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.0501247249999999, 2023-09-30T17:04:09.760 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.291665122, 2023-09-30T17:04:09.760 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:09.760 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:09.761 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:09.761 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:09.761 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:09.761 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 98776 2023-09-30T17:04:09.761 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.761 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:09.761 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.761 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:09.762 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.681417+0000", 2023-09-30T17:04:09.762 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:09.762 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.762 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.762 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:09.762 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.681417+0000", 2023-09-30T17:04:09.762 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:09.762 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.763 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.763 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:09.763 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.681417+0000", 2023-09-30T17:04:09.763 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2399999999999999e-07 2023-09-30T17:04:09.763 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.763 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.763 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:09.763 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.681424+0000", 2023-09-30T17:04:09.764 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0149999999999998e-06 2023-09-30T17:04:09.764 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.764 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.764 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:09.764 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.681430+0000", 2023-09-30T17:04:09.764 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4330000000000001e-06 2023-09-30T17:04:09.764 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.764 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.765 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:09.765 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.681434+0000", 2023-09-30T17:04:09.765 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4060000000000001e-06 2023-09-30T17:04:09.765 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.765 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.765 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:09.765 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.935167+0000", 2023-09-30T17:04:09.765 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.25373364900000001 2023-09-30T17:04:09.765 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.766 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.766 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:09.766 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.935237+0000", 2023-09-30T17:04:09.766 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9794000000000003e-05 2023-09-30T17:04:09.766 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.766 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.766 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:09.766 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.935374+0000", 2023-09-30T17:04:09.766 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013709900000000001 2023-09-30T17:04:09.766 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.767 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.767 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:09.767 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.950745+0000", 2023-09-30T17:04:09.767 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015370498999999999 2023-09-30T17:04:09.767 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.767 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.767 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:09.767 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.972988+0000", 2023-09-30T17:04:09.767 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022243642000000001 2023-09-30T17:04:09.767 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.767 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.767 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:09.768 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.973044+0000", 2023-09-30T17:04:09.768 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5223000000000003e-05 2023-09-30T17:04:09.768 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.768 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.768 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:09.768 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.973082+0000", 2023-09-30T17:04:09.768 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8037999999999997e-05 2023-09-30T17:04:09.768 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:09.768 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:09.768 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:09.768 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.769 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.769 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:98822 4.f 4:f0d983b2:::100000001f8.0000001f:head [write 3112960~4096,write 3141632~4096,write 3649536~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:09.769 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:05.697948+0000", 2023-09-30T17:04:09.769 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.0335936820000002, 2023-09-30T17:04:09.769 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.29434561599999998, 2023-09-30T17:04:09.769 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:09.769 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:09.769 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:09.769 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:09.769 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:09.769 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 98822 2023-09-30T17:04:09.770 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.770 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:09.770 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.770 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:09.770 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.697948+0000", 2023-09-30T17:04:09.770 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:09.770 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.770 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.770 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:09.770 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.697948+0000", 2023-09-30T17:04:09.770 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:09.771 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.771 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.771 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:09.771 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.697948+0000", 2023-09-30T17:04:09.771 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0999999999999998e-07 2023-09-30T17:04:09.771 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.771 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.771 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:09.771 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.697959+0000", 2023-09-30T17:04:09.771 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0325e-05 2023-09-30T17:04:09.771 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.772 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.772 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:09.772 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.697973+0000", 2023-09-30T17:04:09.772 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4450999999999999e-05 2023-09-30T17:04:09.772 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.772 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.772 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:09.772 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.697980+0000", 2023-09-30T17:04:09.772 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4729999999999997e-06 2023-09-30T17:04:09.772 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.772 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.772 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:09.773 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.955790+0000", 2023-09-30T17:04:09.773 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.25781079299999998 2023-09-30T17:04:09.773 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.773 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.773 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:09.773 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.955878+0000", 2023-09-30T17:04:09.773 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7822e-05 2023-09-30T17:04:09.773 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.773 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.773 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:09.773 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.956076+0000", 2023-09-30T17:04:09.774 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000198097 2023-09-30T17:04:09.774 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.774 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.774 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:09.774 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.972667+0000", 2023-09-30T17:04:09.774 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016591079000000002 2023-09-30T17:04:09.774 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.774 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.774 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:09.774 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.992196+0000", 2023-09-30T17:04:09.774 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019528363999999999 2023-09-30T17:04:09.775 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.775 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.775 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:09.775 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.992254+0000", 2023-09-30T17:04:09.775 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8288999999999997e-05 2023-09-30T17:04:09.775 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.775 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.775 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:09.775 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.992293+0000", 2023-09-30T17:04:09.775 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9212999999999999e-05 2023-09-30T17:04:09.775 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:09.776 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:09.776 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:09.776 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.776 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.776 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:98829 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 1224704~4096,write 1769472~4096,write 1781760~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:09.776 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:05.700347+0000", 2023-09-30T17:04:09.776 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.0311948319999997, 2023-09-30T17:04:09.776 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.29190343000000002, 2023-09-30T17:04:09.776 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:09.776 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:09.776 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:09.777 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:09.777 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:09.777 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 98829 2023-09-30T17:04:09.777 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.777 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:09.777 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.777 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:09.777 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.700347+0000", 2023-09-30T17:04:09.777 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:09.777 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.778 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.778 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:09.778 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.700347+0000", 2023-09-30T17:04:09.778 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:09.778 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.778 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.778 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:09.778 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.700347+0000", 2023-09-30T17:04:09.778 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8899999999999998e-07 2023-09-30T17:04:09.778 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.778 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.779 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:09.779 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.700362+0000", 2023-09-30T17:04:09.779 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4725999999999999e-05 2023-09-30T17:04:09.779 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.779 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.779 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:09.779 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.700375+0000", 2023-09-30T17:04:09.779 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.296e-05 2023-09-30T17:04:09.779 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.779 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.779 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:09.780 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.700382+0000", 2023-09-30T17:04:09.780 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.418e-06 2023-09-30T17:04:09.780 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.780 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.780 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:09.780 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.956665+0000", 2023-09-30T17:04:09.780 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.25628237999999998 2023-09-30T17:04:09.780 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.780 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.780 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:09.780 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.956744+0000", 2023-09-30T17:04:09.780 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9144e-05 2023-09-30T17:04:09.781 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.781 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.781 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:09.781 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.956912+0000", 2023-09-30T17:04:09.781 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016769800000000001 2023-09-30T17:04:09.781 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.781 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.781 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:09.781 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.972833+0000", 2023-09-30T17:04:09.781 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015921826 2023-09-30T17:04:09.781 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.781 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.782 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:09.782 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.992172+0000", 2023-09-30T17:04:09.782 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019338933999999999 2023-09-30T17:04:09.782 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.782 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.782 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:09.782 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.992227+0000", 2023-09-30T17:04:09.782 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4956e-05 2023-09-30T17:04:09.782 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.783 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.783 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:09.783 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.992250+0000", 2023-09-30T17:04:09.783 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2599000000000002e-05 2023-09-30T17:04:09.783 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:09.783 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:09.783 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:09.783 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.783 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.784 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:99093 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 225280~4096,write 360448~4096,write 368640~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:09.784 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:05.790622+0000", 2023-09-30T17:04:09.784 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.9409189630000001, 2023-09-30T17:04:09.784 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.29989992500000001, 2023-09-30T17:04:09.784 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:09.784 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:09.784 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:09.784 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:09.784 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:09.784 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 99093 2023-09-30T17:04:09.784 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.785 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:09.785 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.785 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:09.785 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.790622+0000", 2023-09-30T17:04:09.786 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:09.786 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.786 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.786 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:09.786 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.790622+0000", 2023-09-30T17:04:09.786 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:09.786 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.786 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.787 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:09.787 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.790623+0000", 2023-09-30T17:04:09.787 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8899999999999998e-07 2023-09-30T17:04:09.787 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.787 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.787 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:09.787 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.790665+0000", 2023-09-30T17:04:09.788 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1529999999999997e-05 2023-09-30T17:04:09.788 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.788 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.788 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:09.788 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.790672+0000", 2023-09-30T17:04:09.788 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6650000000000003e-06 2023-09-30T17:04:09.788 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.788 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.788 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:09.789 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.790678+0000", 2023-09-30T17:04:09.789 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5829999999999997e-06 2023-09-30T17:04:09.789 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.789 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.789 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:09.789 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.053611+0000", 2023-09-30T17:04:09.789 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.262933521 2023-09-30T17:04:09.789 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.789 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.790 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:09.790 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.053687+0000", 2023-09-30T17:04:09.790 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5408999999999996e-05 2023-09-30T17:04:09.790 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.790 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.790 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:09.790 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.053856+0000", 2023-09-30T17:04:09.790 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016876099999999999 2023-09-30T17:04:09.791 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.791 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.791 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:09.791 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.062540+0000", 2023-09-30T17:04:09.791 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0086842780000000001 2023-09-30T17:04:09.791 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.791 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.791 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:09.792 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.090430+0000", 2023-09-30T17:04:09.792 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.027890531 2023-09-30T17:04:09.792 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.792 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.792 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:09.792 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.090480+0000", 2023-09-30T17:04:09.792 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0039e-05 2023-09-30T17:04:09.793 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.793 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.793 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:09.793 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.090522+0000", 2023-09-30T17:04:09.793 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1819000000000001e-05 2023-09-30T17:04:09.793 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:09.793 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:09.794 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:09.794 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.794 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.794 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:99094 4.f 4:f2a80dfe:::100000001f8.00000019:head [write 692224~4096,write 806912~4096,write 909312~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:09.794 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:05.790910+0000", 2023-09-30T17:04:09.794 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.9406308709999998, 2023-09-30T17:04:09.794 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.29883616200000002, 2023-09-30T17:04:09.794 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:09.794 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:09.795 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:09.795 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:09.795 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:09.795 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 99094 2023-09-30T17:04:09.795 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.795 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:09.795 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.795 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:09.795 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.790910+0000", 2023-09-30T17:04:09.795 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:09.796 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.796 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.796 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:09.796 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.790910+0000", 2023-09-30T17:04:09.796 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:09.796 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.796 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.796 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:09.796 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.790922+0000", 2023-09-30T17:04:09.796 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1939999999999999e-05 2023-09-30T17:04:09.796 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.797 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.797 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:09.797 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.790935+0000", 2023-09-30T17:04:09.797 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2996999999999999e-05 2023-09-30T17:04:09.797 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.797 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.797 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:09.797 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.790947+0000", 2023-09-30T17:04:09.797 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1299e-05 2023-09-30T17:04:09.797 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.797 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.797 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:09.798 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.790955+0000", 2023-09-30T17:04:09.798 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5229999999999995e-06 2023-09-30T17:04:09.798 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.798 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.798 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:09.798 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.057019+0000", 2023-09-30T17:04:09.798 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.26606350099999998 2023-09-30T17:04:09.799 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.799 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.799 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:09.799 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.057115+0000", 2023-09-30T17:04:09.799 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5828000000000005e-05 2023-09-30T17:04:09.799 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.799 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.799 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:09.800 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.057279+0000", 2023-09-30T17:04:09.800 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016455699999999999 2023-09-30T17:04:09.800 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.800 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.800 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:09.800 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.062738+0000", 2023-09-30T17:04:09.800 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054589740000000001 2023-09-30T17:04:09.800 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.801 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.801 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:09.801 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.089696+0000", 2023-09-30T17:04:09.801 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.026958355999999999 2023-09-30T17:04:09.801 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.801 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.801 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:09.801 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.089726+0000", 2023-09-30T17:04:09.801 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9569000000000001e-05 2023-09-30T17:04:09.802 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.802 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.802 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:09.802 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.089747+0000", 2023-09-30T17:04:09.802 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0618000000000001e-05 2023-09-30T17:04:09.802 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:09.802 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:09.802 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:09.802 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.803 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.803 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:99114 4.f 4:f2a80dfe:::100000001f8.00000019:head [write 2945024~4096,write 3031040~4096,write 3145728~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:09.803 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:05.797851+0000", 2023-09-30T17:04:09.803 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.9336903899999998, 2023-09-30T17:04:09.803 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.29196366299999998, 2023-09-30T17:04:09.803 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:09.803 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:09.803 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:09.803 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:09.803 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:09.803 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 99114 2023-09-30T17:04:09.804 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.804 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:09.804 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.804 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:09.804 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.797851+0000", 2023-09-30T17:04:09.804 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:09.804 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.804 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.804 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:09.804 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.797851+0000", 2023-09-30T17:04:09.805 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:09.805 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.805 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.805 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:09.805 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.797852+0000", 2023-09-30T17:04:09.805 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7499999999999999e-07 2023-09-30T17:04:09.805 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.805 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.805 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:09.805 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.797871+0000", 2023-09-30T17:04:09.805 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9542999999999999e-05 2023-09-30T17:04:09.806 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.806 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.806 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:09.806 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.797882+0000", 2023-09-30T17:04:09.806 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0882e-05 2023-09-30T17:04:09.806 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.806 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.806 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:09.806 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.797890+0000", 2023-09-30T17:04:09.806 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9880000000000004e-06 2023-09-30T17:04:09.807 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.807 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.807 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:09.807 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.059859+0000", 2023-09-30T17:04:09.807 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.26196924300000002 2023-09-30T17:04:09.807 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.807 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.807 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:09.807 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.059934+0000", 2023-09-30T17:04:09.807 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4550999999999998e-05 2023-09-30T17:04:09.807 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.807 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.808 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:09.808 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.060080+0000", 2023-09-30T17:04:09.808 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000145635 2023-09-30T17:04:09.808 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.808 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.808 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:09.808 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.079657+0000", 2023-09-30T17:04:09.808 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019577809000000002 2023-09-30T17:04:09.808 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.808 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.809 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:09.809 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.089769+0000", 2023-09-30T17:04:09.809 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010111079 2023-09-30T17:04:09.809 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.809 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.809 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:09.809 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.089795+0000", 2023-09-30T17:04:09.809 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6497000000000001e-05 2023-09-30T17:04:09.809 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.809 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.810 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:09.810 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.089815+0000", 2023-09-30T17:04:09.810 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9561000000000001e-05 2023-09-30T17:04:09.810 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:09.810 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:09.810 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:09.810 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.810 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.810 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:99115 4.f 4:f0d983b2:::100000001f8.0000001f:head [write 2535424~4096,write 2867200~4096,write 2945024~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:09.810 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:05.798272+0000", 2023-09-30T17:04:09.810 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.9332690809999997, 2023-09-30T17:04:09.811 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.29210238900000002, 2023-09-30T17:04:09.811 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:09.811 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:09.811 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:09.811 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:09.811 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:09.811 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 99115 2023-09-30T17:04:09.811 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.811 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:09.811 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.811 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:09.812 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.798272+0000", 2023-09-30T17:04:09.812 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:09.812 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.812 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.812 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:09.812 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.798272+0000", 2023-09-30T17:04:09.812 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:09.812 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.812 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.812 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:09.813 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.798273+0000", 2023-09-30T17:04:09.813 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6199999999999997e-07 2023-09-30T17:04:09.813 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.813 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:09.813 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.798302+0000", 2023-09-30T17:04:09.813 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9416000000000001e-05 2023-09-30T17:04:09.813 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.813 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:09.814 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.798312+0000", 2023-09-30T17:04:09.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5629999999999998e-06 2023-09-30T17:04:09.814 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.814 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.814 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:09.814 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.798320+0000", 2023-09-30T17:04:09.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8210000000000002e-06 2023-09-30T17:04:09.814 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.814 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.814 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:09.814 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.062831+0000", 2023-09-30T17:04:09.815 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.26451150299999998 2023-09-30T17:04:09.815 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.815 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.815 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:09.815 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.062951+0000", 2023-09-30T17:04:09.815 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000120254 2023-09-30T17:04:09.815 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.815 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.815 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:09.815 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.063111+0000", 2023-09-30T17:04:09.815 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015917000000000001 2023-09-30T17:04:09.816 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.816 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.816 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:09.816 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.082195+0000", 2023-09-30T17:04:09.816 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019084826999999999 2023-09-30T17:04:09.816 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.816 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.816 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:09.816 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.090287+0000", 2023-09-30T17:04:09.816 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080910500000000007 2023-09-30T17:04:09.816 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.816 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.817 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:09.817 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.090341+0000", 2023-09-30T17:04:09.817 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4277999999999998e-05 2023-09-30T17:04:09.817 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.817 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.817 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:09.817 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.090375+0000", 2023-09-30T17:04:09.817 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3844999999999999e-05 2023-09-30T17:04:09.817 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:09.817 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:09.818 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:09.818 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.818 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.818 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:99117 4.37 4:eff9002a:::100000001f8.00000003:head [write 2121728~4096,write 2281472~4096,write 2359296~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:09.818 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:05.799663+0000", 2023-09-30T17:04:09.818 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.9318784889999998, 2023-09-30T17:04:09.818 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.29248557600000002, 2023-09-30T17:04:09.818 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:09.818 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:09.818 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:09.818 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:09.819 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:09.819 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 99117 2023-09-30T17:04:09.819 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.819 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:09.819 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.819 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:09.819 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.799663+0000", 2023-09-30T17:04:09.819 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:09.819 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.819 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.820 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:09.820 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.799663+0000", 2023-09-30T17:04:09.820 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:09.820 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.820 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.820 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:09.820 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.799663+0000", 2023-09-30T17:04:09.820 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0999999999999998e-07 2023-09-30T17:04:09.820 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.820 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.820 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:09.821 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.799676+0000", 2023-09-30T17:04:09.821 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2394e-05 2023-09-30T17:04:09.821 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.821 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.821 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:09.821 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.799686+0000", 2023-09-30T17:04:09.821 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0094e-05 2023-09-30T17:04:09.821 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.821 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.821 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:09.821 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.799694+0000", 2023-09-30T17:04:09.821 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7889999999999995e-06 2023-09-30T17:04:09.822 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.822 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.822 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:09.822 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.068052+0000", 2023-09-30T17:04:09.822 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.26835840799999999 2023-09-30T17:04:09.822 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.822 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.822 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:09.822 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.068120+0000", 2023-09-30T17:04:09.823 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8171999999999997e-05 2023-09-30T17:04:09.823 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.823 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.823 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:09.823 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.068284+0000", 2023-09-30T17:04:09.823 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016326700000000001 2023-09-30T17:04:09.823 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.823 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.823 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:09.824 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.084021+0000", 2023-09-30T17:04:09.824 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015736917 2023-09-30T17:04:09.824 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.824 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.824 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:09.824 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.092054+0000", 2023-09-30T17:04:09.824 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080334859999999994 2023-09-30T17:04:09.824 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.824 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.824 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:09.825 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.092112+0000", 2023-09-30T17:04:09.825 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8301000000000003e-05 2023-09-30T17:04:09.825 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.825 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:09.825 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.092148+0000", 2023-09-30T17:04:09.825 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6137999999999999e-05 2023-09-30T17:04:09.825 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:09.826 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:09.826 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:09.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.826 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.826 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:99128 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 3842048~4096,write 3903488~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:09.826 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:05.803226+0000", 2023-09-30T17:04:09.826 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.9283151329999999, 2023-09-30T17:04:09.826 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.29899171800000002, 2023-09-30T17:04:09.826 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:09.826 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:09.826 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:09.827 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:09.827 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:09.827 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 99128 2023-09-30T17:04:09.827 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.827 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:09.827 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.827 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:09.827 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.803226+0000", 2023-09-30T17:04:09.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:09.828 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.828 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.828 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:09.828 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.803226+0000", 2023-09-30T17:04:09.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:09.828 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.828 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.828 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:09.828 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.803227+0000", 2023-09-30T17:04:09.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3399999999999997e-07 2023-09-30T17:04:09.829 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.829 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:09.829 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.803242+0000", 2023-09-30T17:04:09.829 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5255999999999999e-05 2023-09-30T17:04:09.829 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.829 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:09.830 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.803253+0000", 2023-09-30T17:04:09.830 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0397999999999999e-05 2023-09-30T17:04:09.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.830 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.830 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:09.830 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.803267+0000", 2023-09-30T17:04:09.830 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4535000000000001e-05 2023-09-30T17:04:09.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.830 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.830 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:09.831 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.072507+0000", 2023-09-30T17:04:09.831 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.269239701 2023-09-30T17:04:09.831 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.831 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.831 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:09.831 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.072593+0000", 2023-09-30T17:04:09.831 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6179000000000003e-05 2023-09-30T17:04:09.832 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.832 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.832 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:09.832 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.072724+0000", 2023-09-30T17:04:09.832 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013065799999999999 2023-09-30T17:04:09.832 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.833 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.833 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:09.833 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.090390+0000", 2023-09-30T17:04:09.833 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.01766655 2023-09-30T17:04:09.833 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.833 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.833 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:09.833 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.102147+0000", 2023-09-30T17:04:09.833 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.01175614 2023-09-30T17:04:09.834 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.834 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.834 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:09.834 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.102193+0000", 2023-09-30T17:04:09.834 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6316000000000002e-05 2023-09-30T17:04:09.834 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.834 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.835 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:09.835 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.102218+0000", 2023-09-30T17:04:09.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5051000000000001e-05 2023-09-30T17:04:09.835 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:09.835 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:09.835 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:09.835 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.835 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.836 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:99134 4.f 4:f26fdfa9:::100000001f8.00000002:head [write 1384448~4096,write 1392640~4096,write 1404928~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:09.836 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:05.806058+0000", 2023-09-30T17:04:09.836 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.9254838259999998, 2023-09-30T17:04:09.836 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.30070980400000002, 2023-09-30T17:04:09.836 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:09.836 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:09.836 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:09.836 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:09.836 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:09.836 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 99134 2023-09-30T17:04:09.837 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.837 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:09.837 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.837 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:09.837 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.806058+0000", 2023-09-30T17:04:09.837 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:09.837 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.837 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.837 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:09.837 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.806058+0000", 2023-09-30T17:04:09.837 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:09.837 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.838 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.838 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:09.838 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.806058+0000", 2023-09-30T17:04:09.838 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7000000000000003e-07 2023-09-30T17:04:09.838 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.838 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.838 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:09.838 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.806069+0000", 2023-09-30T17:04:09.838 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.11e-05 2023-09-30T17:04:09.838 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.838 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.838 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:09.839 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.806080+0000", 2023-09-30T17:04:09.839 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0477e-05 2023-09-30T17:04:09.839 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.839 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.839 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:09.839 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.806087+0000", 2023-09-30T17:04:09.839 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9290000000000001e-06 2023-09-30T17:04:09.839 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.839 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.839 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:09.839 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.072494+0000", 2023-09-30T17:04:09.839 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.266407269 2023-09-30T17:04:09.840 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.840 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.840 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:09.840 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.072593+0000", 2023-09-30T17:04:09.840 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9258000000000004e-05 2023-09-30T17:04:09.840 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.840 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.840 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:09.840 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.072746+0000", 2023-09-30T17:04:09.840 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015272300000000001 2023-09-30T17:04:09.840 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.840 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.841 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:09.841 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.084027+0000", 2023-09-30T17:04:09.841 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011281081 2023-09-30T17:04:09.841 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.841 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.841 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:09.841 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.106674+0000", 2023-09-30T17:04:09.841 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022647186 2023-09-30T17:04:09.841 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.841 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.841 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:09.841 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.106731+0000", 2023-09-30T17:04:09.842 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6353000000000001e-05 2023-09-30T17:04:09.842 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.842 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.842 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:09.842 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.106767+0000", 2023-09-30T17:04:09.842 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6557999999999998e-05 2023-09-30T17:04:09.842 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:09.842 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:09.842 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:09.843 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.843 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.843 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:99148 4.2f 4:f59f865b:::100000001f8.00000007:head [write 3796992~4096,write 3932160~4096,write 4108288~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:09.843 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:05.810874+0000", 2023-09-30T17:04:09.843 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.9206675479999999, 2023-09-30T17:04:09.843 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.29595408699999998, 2023-09-30T17:04:09.843 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:09.843 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:09.843 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:09.843 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:09.843 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:09.843 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 99148 2023-09-30T17:04:09.844 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.844 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:09.844 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.844 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:09.844 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.810874+0000", 2023-09-30T17:04:09.844 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:09.844 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.844 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.844 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:09.844 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.810874+0000", 2023-09-30T17:04:09.844 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:09.845 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.845 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.845 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:09.845 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.810874+0000", 2023-09-30T17:04:09.845 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.13e-07 2023-09-30T17:04:09.845 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.845 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.845 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:09.845 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.810885+0000", 2023-09-30T17:04:09.845 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0696999999999999e-05 2023-09-30T17:04:09.846 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.846 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.846 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:09.846 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.810897+0000", 2023-09-30T17:04:09.846 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1866e-05 2023-09-30T17:04:09.846 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.846 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.846 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:09.846 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.810902+0000", 2023-09-30T17:04:09.846 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5079999999999996e-06 2023-09-30T17:04:09.846 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.846 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.847 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:09.847 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.074925+0000", 2023-09-30T17:04:09.847 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.26402250599999999 2023-09-30T17:04:09.847 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.847 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.847 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:09.847 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.074999+0000", 2023-09-30T17:04:09.847 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.415e-05 2023-09-30T17:04:09.847 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.848 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.848 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:09.848 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.075136+0000", 2023-09-30T17:04:09.848 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013655199999999999 2023-09-30T17:04:09.848 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.848 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.848 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:09.848 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.090396+0000", 2023-09-30T17:04:09.848 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015260193999999999 2023-09-30T17:04:09.848 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.848 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.849 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:09.849 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.106760+0000", 2023-09-30T17:04:09.849 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016364462 2023-09-30T17:04:09.849 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.849 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.849 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:09.849 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.106799+0000", 2023-09-30T17:04:09.849 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8581000000000002e-05 2023-09-30T17:04:09.849 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.849 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.850 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:09.850 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.106828+0000", 2023-09-30T17:04:09.850 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9057999999999999e-05 2023-09-30T17:04:09.850 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:09.850 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:09.850 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:09.850 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.850 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.850 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:99155 4.2f 4:f59f865b:::100000001f8.00000007:head [write 352256~4096,write 454656~4096,write 622592~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:09.850 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:05.813662+0000", 2023-09-30T17:04:09.851 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.917878966, 2023-09-30T17:04:09.851 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.29330872299999999, 2023-09-30T17:04:09.851 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:09.851 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:09.851 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:09.851 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:09.851 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:09.851 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 99155 2023-09-30T17:04:09.851 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.851 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:09.851 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.852 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:09.852 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.813662+0000", 2023-09-30T17:04:09.852 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:09.852 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.852 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.852 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:09.852 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.813662+0000", 2023-09-30T17:04:09.852 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:09.852 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.852 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.852 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:09.853 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.813663+0000", 2023-09-30T17:04:09.853 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5400000000000002e-07 2023-09-30T17:04:09.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.853 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.853 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:09.853 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.813672+0000", 2023-09-30T17:04:09.853 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.628e-06 2023-09-30T17:04:09.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.853 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.853 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:09.853 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.813678+0000", 2023-09-30T17:04:09.853 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.117e-06 2023-09-30T17:04:09.854 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.854 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.854 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:09.854 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.813683+0000", 2023-09-30T17:04:09.854 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8629999999999999e-06 2023-09-30T17:04:09.854 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.854 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.854 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:09.854 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.077662+0000", 2023-09-30T17:04:09.854 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.26397839899999997 2023-09-30T17:04:09.855 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.855 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.855 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:09.855 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.077726+0000", 2023-09-30T17:04:09.855 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3813999999999996e-05 2023-09-30T17:04:09.855 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.855 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.855 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:09.855 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.077874+0000", 2023-09-30T17:04:09.855 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014801199999999999 2023-09-30T17:04:09.855 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.856 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.856 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:09.856 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.102106+0000", 2023-09-30T17:04:09.856 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.024232584000000001 2023-09-30T17:04:09.856 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.856 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.856 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:09.856 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.106892+0000", 2023-09-30T17:04:09.856 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047860089999999999 2023-09-30T17:04:09.856 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.856 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.857 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:09.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.106940+0000", 2023-09-30T17:04:09.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7698999999999999e-05 2023-09-30T17:04:09.857 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.857 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:09.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.106971+0000", 2023-09-30T17:04:09.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1244000000000001e-05 2023-09-30T17:04:09.858 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:09.858 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:09.858 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:09.858 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.858 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.858 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:99157 4.37 4:eff9002a:::100000001f8.00000003:head [write 856064~4096,write 901120~4096,write 1011712~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:09.858 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:05.814312+0000", 2023-09-30T17:04:09.858 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.9172294600000002, 2023-09-30T17:04:09.858 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.29241535699999999, 2023-09-30T17:04:09.858 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:09.859 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:09.859 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:09.859 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:09.859 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:09.859 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 99157 2023-09-30T17:04:09.859 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.859 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:09.859 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.859 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:09.860 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.814312+0000", 2023-09-30T17:04:09.860 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:09.860 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.860 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.860 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:09.860 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.814312+0000", 2023-09-30T17:04:09.860 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:09.860 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.860 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.860 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:09.861 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.814312+0000", 2023-09-30T17:04:09.861 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7199999999999999e-07 2023-09-30T17:04:09.861 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.861 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.861 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:09.861 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.814322+0000", 2023-09-30T17:04:09.861 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4890000000000001e-06 2023-09-30T17:04:09.861 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.861 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.861 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:09.862 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.814330+0000", 2023-09-30T17:04:09.862 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9540000000000004e-06 2023-09-30T17:04:09.862 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.862 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.862 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:09.862 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.814339+0000", 2023-09-30T17:04:09.862 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6740000000000003e-06 2023-09-30T17:04:09.862 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.863 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.863 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:09.863 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.076550+0000", 2023-09-30T17:04:09.863 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.26221143800000002 2023-09-30T17:04:09.863 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.863 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.863 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:09.863 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.076673+0000", 2023-09-30T17:04:09.863 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012311399999999999 2023-09-30T17:04:09.863 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.864 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:09.864 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.076817+0000", 2023-09-30T17:04:09.864 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014412499999999999 2023-09-30T17:04:09.864 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.864 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:09.864 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.096003+0000", 2023-09-30T17:04:09.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019185941000000001 2023-09-30T17:04:09.865 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.865 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.865 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:09.865 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.106660+0000", 2023-09-30T17:04:09.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010657231 2023-09-30T17:04:09.865 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.865 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.865 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:09.865 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.106693+0000", 2023-09-30T17:04:09.866 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2941999999999997e-05 2023-09-30T17:04:09.866 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.866 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.866 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:09.866 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.106727+0000", 2023-09-30T17:04:09.866 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3877000000000001e-05 2023-09-30T17:04:09.866 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:09.866 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:09.866 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:09.866 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.867 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.867 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:99220 4.37 4:eff9002a:::100000001f8.00000003:head [write 1769472~4096,write 2433024~4096,write 2461696~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:09.867 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:05.835062+0000", 2023-09-30T17:04:09.867 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.8964794700000001, 2023-09-30T17:04:09.867 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.30412015799999997, 2023-09-30T17:04:09.867 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:09.867 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:09.867 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:09.868 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:09.868 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:09.868 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 99220 2023-09-30T17:04:09.868 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.868 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:09.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:09.868 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.835062+0000", 2023-09-30T17:04:09.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:09.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.869 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:09.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.835062+0000", 2023-09-30T17:04:09.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:09.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.869 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:09.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.835063+0000", 2023-09-30T17:04:09.870 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2900000000000003e-07 2023-09-30T17:04:09.870 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.870 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:09.870 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.835073+0000", 2023-09-30T17:04:09.870 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0631999999999999e-05 2023-09-30T17:04:09.870 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.870 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:09.870 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.835081+0000", 2023-09-30T17:04:09.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3140000000000004e-06 2023-09-30T17:04:09.871 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.871 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.871 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:09.871 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.835086+0000", 2023-09-30T17:04:09.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.262e-06 2023-09-30T17:04:09.871 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.871 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.871 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:09.871 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.107437+0000", 2023-09-30T17:04:09.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.27235133700000003 2023-09-30T17:04:09.872 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:09.872 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.107520+0000", 2023-09-30T17:04:09.872 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2689999999999996e-05 2023-09-30T17:04:09.872 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:09.873 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.107684+0000", 2023-09-30T17:04:09.873 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016403899999999999 2023-09-30T17:04:09.873 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.873 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.873 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:09.873 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.124399+0000", 2023-09-30T17:04:09.873 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016715636999999998 2023-09-30T17:04:09.874 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.874 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.874 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:09.874 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.139109+0000", 2023-09-30T17:04:09.874 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014709173000000001 2023-09-30T17:04:09.874 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.874 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.874 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:09.874 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.139148+0000", 2023-09-30T17:04:09.874 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9879000000000002e-05 2023-09-30T17:04:09.875 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.875 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.875 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:09.875 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.139182+0000", 2023-09-30T17:04:09.875 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3565999999999997e-05 2023-09-30T17:04:09.875 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:09.875 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:09.875 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:09.875 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.875 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.875 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:99249 4.2f 4:f59f865b:::100000001f8.00000007:head [write 3481600~4096,write 3543040~4096,write 4120576~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:09.876 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:05.844616+0000", 2023-09-30T17:04:09.876 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.8869257639999999, 2023-09-30T17:04:09.876 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.29469211499999998, 2023-09-30T17:04:09.876 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:09.876 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:09.876 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:09.876 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:09.876 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:09.876 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 99249 2023-09-30T17:04:09.876 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.876 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:09.876 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.877 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:09.877 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.844616+0000", 2023-09-30T17:04:09.877 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:09.877 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.877 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.877 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:09.877 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.844616+0000", 2023-09-30T17:04:09.877 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:09.877 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.877 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.877 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:09.878 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.844616+0000", 2023-09-30T17:04:09.878 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4600000000000003e-07 2023-09-30T17:04:09.878 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.878 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.878 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:09.878 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.844626+0000", 2023-09-30T17:04:09.878 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9159999999999996e-06 2023-09-30T17:04:09.878 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.878 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.878 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:09.878 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.844635+0000", 2023-09-30T17:04:09.879 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1750000000000005e-06 2023-09-30T17:04:09.879 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.879 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.879 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:09.879 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.844640+0000", 2023-09-30T17:04:09.879 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8300000000000001e-06 2023-09-30T17:04:09.879 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.879 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.879 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:09.879 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.111314+0000", 2023-09-30T17:04:09.880 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.266673559 2023-09-30T17:04:09.880 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.880 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.880 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:09.880 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.111358+0000", 2023-09-30T17:04:09.880 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4379000000000003e-05 2023-09-30T17:04:09.880 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.880 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.880 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:09.880 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.111453+0000", 2023-09-30T17:04:09.880 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5138999999999998e-05 2023-09-30T17:04:09.881 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.881 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.881 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:09.881 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.124408+0000", 2023-09-30T17:04:09.881 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012954166 2023-09-30T17:04:09.881 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.881 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.881 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:09.881 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.139223+0000", 2023-09-30T17:04:09.881 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014815662 2023-09-30T17:04:09.881 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.881 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.882 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:09.882 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.139275+0000", 2023-09-30T17:04:09.882 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1894999999999997e-05 2023-09-30T17:04:09.882 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.882 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.882 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:09.882 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.139308+0000", 2023-09-30T17:04:09.882 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2548000000000001e-05 2023-09-30T17:04:09.882 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:09.882 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:09.882 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:09.882 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.883 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.883 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:99250 4.37 4:eff9002a:::100000001f8.00000003:head [write 3158016~4096,write 3211264~4096,write 3571712~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:09.883 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:05.844649+0000", 2023-09-30T17:04:09.883 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.8868922870000002, 2023-09-30T17:04:09.883 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.29470512700000001, 2023-09-30T17:04:09.883 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:09.883 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:09.883 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:09.883 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:09.883 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:09.883 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 99250 2023-09-30T17:04:09.884 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.884 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:09.884 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.884 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:09.884 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.844649+0000", 2023-09-30T17:04:09.884 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:09.884 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.884 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.884 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:09.884 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.844649+0000", 2023-09-30T17:04:09.885 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:09.885 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.885 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.885 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:09.885 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.844649+0000", 2023-09-30T17:04:09.885 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2399999999999999e-07 2023-09-30T17:04:09.885 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.885 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.885 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:09.885 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.844658+0000", 2023-09-30T17:04:09.885 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5399999999999996e-06 2023-09-30T17:04:09.885 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.886 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.886 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:09.886 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.844664+0000", 2023-09-30T17:04:09.886 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9660000000000001e-06 2023-09-30T17:04:09.886 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.886 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.886 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:09.886 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.844669+0000", 2023-09-30T17:04:09.886 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5600000000000004e-06 2023-09-30T17:04:09.886 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.887 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.887 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:09.887 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.111467+0000", 2023-09-30T17:04:09.887 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.26679892999999999 2023-09-30T17:04:09.887 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.887 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.887 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:09.887 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.111545+0000", 2023-09-30T17:04:09.887 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7367000000000007e-05 2023-09-30T17:04:09.887 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.887 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.887 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:09.888 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.111695+0000", 2023-09-30T17:04:09.888 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000149832 2023-09-30T17:04:09.888 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.888 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.888 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:09.888 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.139076+0000", 2023-09-30T17:04:09.888 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.027381339000000001 2023-09-30T17:04:09.888 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.888 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.888 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:09.888 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.139272+0000", 2023-09-30T17:04:09.889 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00019576899999999999 2023-09-30T17:04:09.889 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.889 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.889 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:09.889 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.139321+0000", 2023-09-30T17:04:09.889 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9598000000000002e-05 2023-09-30T17:04:09.889 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.889 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.889 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:09.889 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.139354+0000", 2023-09-30T17:04:09.889 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2802000000000002e-05 2023-09-30T17:04:09.890 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:09.890 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:09.890 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:09.890 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.890 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.890 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:99439 4.37 4:ef395e89:::100000001f8.00000020:head [write 3162112~4096,write 3174400~4096,write 3264512~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e50)", 2023-09-30T17:04:09.890 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:05.905610+0000", 2023-09-30T17:04:09.890 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 3.8259314799999999, 2023-09-30T17:04:09.890 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.29227703999999999, 2023-09-30T17:04:09.890 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:09.890 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:09.891 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:09.891 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:09.891 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:09.891 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 99439 2023-09-30T17:04:09.891 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.891 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:09.891 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.891 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:09.891 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.905610+0000", 2023-09-30T17:04:09.891 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:09.891 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.892 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.892 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:09.892 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.905610+0000", 2023-09-30T17:04:09.892 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:09.892 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.892 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.892 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:09.892 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.905610+0000", 2023-09-30T17:04:09.892 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9099999999999999e-07 2023-09-30T17:04:09.892 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.892 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.893 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:09.893 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.905629+0000", 2023-09-30T17:04:09.893 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9128e-05 2023-09-30T17:04:09.893 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.893 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.893 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:09.893 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.905637+0000", 2023-09-30T17:04:09.893 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4749999999999996e-06 2023-09-30T17:04:09.893 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.893 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.893 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:09.893 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:05.905641+0000", 2023-09-30T17:04:09.894 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.89e-06 2023-09-30T17:04:09.894 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.894 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.894 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:09.894 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.164922+0000", 2023-09-30T17:04:09.894 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.25928120999999998 2023-09-30T17:04:09.894 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.894 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.894 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:09.894 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.165007+0000", 2023-09-30T17:04:09.895 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4591000000000004e-05 2023-09-30T17:04:09.895 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.895 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.895 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:09.895 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.165165+0000", 2023-09-30T17:04:09.895 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158493 2023-09-30T17:04:09.895 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.895 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.896 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:09.896 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.178751+0000", 2023-09-30T17:04:09.896 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013585908000000001 2023-09-30T17:04:09.896 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.896 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.896 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:09.896 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.197795+0000", 2023-09-30T17:04:09.896 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019043905 2023-09-30T17:04:09.896 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.896 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.896 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:09.896 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.197851+0000", 2023-09-30T17:04:09.896 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6541e-05 2023-09-30T17:04:09.897 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:09.897 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:09.897 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:09.897 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:06.197887+0000", 2023-09-30T17:04:09.897 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5508e-05 2023-09-30T17:04:09.897 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:09.897 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:09.897 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:09.898 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:09.898 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:09.898 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:04:09.899 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:09.898+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:09.900 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:04:10.003 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:10.002+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:10.101 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:10.100+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:10.136 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:04:10.136 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:04:10.136 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.136 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109717 4.e 4:73e84e43:::100000001f8.00000004:head [write 3223552~4096 in=4096b,write 3256320~4096 in=4096b,write 3293184~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.136 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.715506+0000", 2023-09-30T17:04:10.136 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.40086812100000002, 2023-09-30T17:04:10.136 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.40090053799999997, 2023-09-30T17:04:10.136 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.136 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:10.137 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.137 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.137 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.137 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109717 2023-09-30T17:04:10.137 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.137 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.137 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.137 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.137 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.715506+0000", 2023-09-30T17:04:10.137 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.137 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.137 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.138 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.138 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.715506+0000", 2023-09-30T17:04:10.138 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.138 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.138 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.138 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.138 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.715507+0000", 2023-09-30T17:04:10.138 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.89e-07 2023-09-30T17:04:10.138 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.138 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.138 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.139 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.715522+0000", 2023-09-30T17:04:10.139 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5502000000000002e-05 2023-09-30T17:04:10.139 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.139 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.139 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.139 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.715530+0000", 2023-09-30T17:04:10.139 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4789999999999999e-06 2023-09-30T17:04:10.139 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.139 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.139 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.139 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.715536+0000", 2023-09-30T17:04:10.140 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7420000000000003e-06 2023-09-30T17:04:10.140 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.140 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.140 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.140 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.111338+0000", 2023-09-30T17:04:10.140 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39580222900000001 2023-09-30T17:04:10.140 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.140 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.140 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.140 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.111422+0000", 2023-09-30T17:04:10.140 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4579000000000005e-05 2023-09-30T17:04:10.140 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.140 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.141 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.141 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.141 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.141 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109821 4.6 4.8232b686 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.141 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.841222+0000", 2023-09-30T17:04:10.141 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.27515215100000001, 2023-09-30T17:04:10.141 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.27526708100000002, 2023-09-30T17:04:10.141 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.141 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.141 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.142 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.142 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.142 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109821 2023-09-30T17:04:10.142 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.142 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.142 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.142 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.142 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.841222+0000", 2023-09-30T17:04:10.142 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.143 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.143 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.143 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.143 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.841222+0000", 2023-09-30T17:04:10.143 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.143 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.143 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.143 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.143 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.843163+0000", 2023-09-30T17:04:10.143 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0019409309999999999 2023-09-30T17:04:10.143 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.143 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.144 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.144 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.843182+0000", 2023-09-30T17:04:10.145 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8734000000000001e-05 2023-09-30T17:04:10.145 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.145 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.145 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.145 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.843195+0000", 2023-09-30T17:04:10.145 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3267e-05 2023-09-30T17:04:10.146 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.146 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.146 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.146 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.843202+0000", 2023-09-30T17:04:10.146 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7020000000000004e-06 2023-09-30T17:04:10.146 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.146 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.146 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.146 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.146 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.146 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109878 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.147 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.865271+0000", 2023-09-30T17:04:10.147 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.25110333400000001, 2023-09-30T17:04:10.147 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.25126262900000002, 2023-09-30T17:04:10.147 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.147 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.147 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.147 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.147 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.147 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109878 2023-09-30T17:04:10.147 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.147 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.147 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.148 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.148 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.865271+0000", 2023-09-30T17:04:10.148 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.148 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.148 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.148 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.148 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.865271+0000", 2023-09-30T17:04:10.148 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.148 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.148 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.148 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.148 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.869167+0000", 2023-09-30T17:04:10.149 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0038962319999999999 2023-09-30T17:04:10.149 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.149 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.149 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.149 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.869185+0000", 2023-09-30T17:04:10.149 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7822e-05 2023-09-30T17:04:10.149 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.149 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.149 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.149 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.869197+0000", 2023-09-30T17:04:10.149 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1294999999999999e-05 2023-09-30T17:04:10.150 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.150 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.150 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.150 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.869204+0000", 2023-09-30T17:04:10.150 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4429999999999997e-06 2023-09-30T17:04:10.150 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.150 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.150 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.150 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.150 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.150 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109906 4.6 4.8232b686 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.151 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.883218+0000", 2023-09-30T17:04:10.151 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.23315704400000001, 2023-09-30T17:04:10.151 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.233379433, 2023-09-30T17:04:10.151 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.151 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.151 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.151 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.151 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.151 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109906 2023-09-30T17:04:10.151 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.152 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.152 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.152 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.152 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.883218+0000", 2023-09-30T17:04:10.152 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.152 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.152 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.152 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.152 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.883218+0000", 2023-09-30T17:04:10.152 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.152 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.152 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.153 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.153 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.883218+0000", 2023-09-30T17:04:10.153 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2699999999999999e-07 2023-09-30T17:04:10.153 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.153 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.153 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.153 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.883232+0000", 2023-09-30T17:04:10.153 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4446e-05 2023-09-30T17:04:10.153 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.153 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.153 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.153 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.883242+0000", 2023-09-30T17:04:10.154 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3640000000000005e-06 2023-09-30T17:04:10.154 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.154 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.154 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.154 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.883250+0000", 2023-09-30T17:04:10.154 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0050000000000004e-06 2023-09-30T17:04:10.154 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.154 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.154 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.154 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.154 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.155 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:110180 4.37 e51/17 4:ecbf0fb2:::100000001f8.00000038:head v 51'5184, mlcod=51'5177)", 2023-09-30T17:04:10.155 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.082941+0000", 2023-09-30T17:04:10.155 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.033433528999999997, 2023-09-30T17:04:10.155 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.033720567, 2023-09-30T17:04:10.155 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.155 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:10.155 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.155 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.155 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.155 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.082941+0000", 2023-09-30T17:04:10.155 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.155 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.156 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.156 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.156 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.082941+0000", 2023-09-30T17:04:10.156 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.156 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.156 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.156 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.156 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.082941+0000", 2023-09-30T17:04:10.156 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.58e-07 2023-09-30T17:04:10.156 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.156 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.157 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.157 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.082954+0000", 2023-09-30T17:04:10.157 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2481e-05 2023-09-30T17:04:10.157 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.157 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.157 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.157 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.082961+0000", 2023-09-30T17:04:10.157 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.396e-06 2023-09-30T17:04:10.157 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.157 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.157 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.157 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.082968+0000", 2023-09-30T17:04:10.158 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5749999999999997e-06 2023-09-30T17:04:10.158 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.158 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.158 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.158 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.087711+0000", 2023-09-30T17:04:10.158 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0047429400000000002 2023-09-30T17:04:10.158 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.158 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.158 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.158 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.087731+0000", 2023-09-30T17:04:10.158 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.0443999999999999e-05 2023-09-30T17:04:10.158 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.159 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.159 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.159 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.159 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.159 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110450 4.28 4:153ae410:::100000001f8.0000003b:head [write 3149824~4096 in=4096b,write 3260416~4096 in=4096b,write 3309568~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.159 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.108351+0000", 2023-09-30T17:04:10.159 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0080236470000000001, 2023-09-30T17:04:10.159 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0083815079999999993, 2023-09-30T17:04:10.159 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.159 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:10.159 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.160 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.160 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.160 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110450 2023-09-30T17:04:10.160 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.160 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.160 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.160 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.160 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108351+0000", 2023-09-30T17:04:10.160 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.160 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.160 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.161 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.161 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108351+0000", 2023-09-30T17:04:10.161 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.161 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.161 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.161 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.161 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108352+0000", 2023-09-30T17:04:10.161 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3399999999999998e-07 2023-09-30T17:04:10.161 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.161 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.161 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.162 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108363+0000", 2023-09-30T17:04:10.162 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1826e-05 2023-09-30T17:04:10.162 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.162 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.162 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.162 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108372+0000", 2023-09-30T17:04:10.162 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1440000000000003e-06 2023-09-30T17:04:10.162 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.162 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.162 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.162 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108378+0000", 2023-09-30T17:04:10.162 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4579999999999998e-06 2023-09-30T17:04:10.163 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.163 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.163 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.163 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108560+0000", 2023-09-30T17:04:10.163 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00018231599999999999 2023-09-30T17:04:10.163 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.163 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.163 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.163 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108639+0000", 2023-09-30T17:04:10.163 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8631e-05 2023-09-30T17:04:10.163 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.163 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.164 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:10.164 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108795+0000", 2023-09-30T17:04:10.164 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000156348 2023-09-30T17:04:10.164 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.164 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.164 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.164 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.164 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.164 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109766 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.164 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.745223+0000", 2023-09-30T17:04:10.164 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.371151495, 2023-09-30T17:04:10.164 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.37157275000000001, 2023-09-30T17:04:10.165 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.165 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.165 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.165 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.165 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.165 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109766 2023-09-30T17:04:10.165 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.165 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.165 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.165 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.165 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.745223+0000", 2023-09-30T17:04:10.165 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.166 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.166 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.166 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.166 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.745223+0000", 2023-09-30T17:04:10.166 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.166 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.166 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.166 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.166 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.747163+0000", 2023-09-30T17:04:10.166 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0019400890000000001 2023-09-30T17:04:10.166 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.167 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.167 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.167 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.747174+0000", 2023-09-30T17:04:10.167 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.117e-05 2023-09-30T17:04:10.167 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.167 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.167 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.167 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.747185+0000", 2023-09-30T17:04:10.167 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0397000000000001e-05 2023-09-30T17:04:10.167 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.167 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.168 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.168 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.747190+0000", 2023-09-30T17:04:10.168 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3700000000000003e-06 2023-09-30T17:04:10.168 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.168 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.168 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.168 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.168 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.168 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110095 4.36 4.670445b6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.168 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.963256+0000", 2023-09-30T17:04:10.168 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.15311809300000001, 2023-09-30T17:04:10.168 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.15359118399999999, 2023-09-30T17:04:10.169 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.169 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.169 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.169 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.169 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.169 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110095 2023-09-30T17:04:10.169 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.169 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.169 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.169 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.169 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.963256+0000", 2023-09-30T17:04:10.169 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.170 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.170 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.170 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.170 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.963256+0000", 2023-09-30T17:04:10.170 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.170 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.170 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.170 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.170 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.963257+0000", 2023-09-30T17:04:10.170 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7000000000000004e-07 2023-09-30T17:04:10.170 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.170 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.171 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.171 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.963272+0000", 2023-09-30T17:04:10.171 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4783000000000001e-05 2023-09-30T17:04:10.171 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.171 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.171 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.171 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.963288+0000", 2023-09-30T17:04:10.171 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5730999999999999e-05 2023-09-30T17:04:10.171 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.171 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.171 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.172 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.963295+0000", 2023-09-30T17:04:10.172 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.418e-06 2023-09-30T17:04:10.172 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.172 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.172 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.172 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.172 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.172 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110353 4.28 4:153ae410:::100000001f8.0000003b:head [write 212992~4096 in=4096b,write 241664~4096 in=4096b,write 274432~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.172 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.069382+0000", 2023-09-30T17:04:10.172 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.046992684, 2023-09-30T17:04:10.172 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.047504586000000001, 2023-09-30T17:04:10.172 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.173 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:10.173 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.173 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.173 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.173 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110353 2023-09-30T17:04:10.173 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.173 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.173 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.173 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.173 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.069382+0000", 2023-09-30T17:04:10.173 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.173 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.174 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.174 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.174 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.069382+0000", 2023-09-30T17:04:10.174 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.174 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.174 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.174 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.174 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.073164+0000", 2023-09-30T17:04:10.174 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0037826029999999998 2023-09-30T17:04:10.174 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.174 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.174 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.175 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.073183+0000", 2023-09-30T17:04:10.175 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.889e-05 2023-09-30T17:04:10.175 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.175 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.175 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.175 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.073194+0000", 2023-09-30T17:04:10.175 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.039e-05 2023-09-30T17:04:10.175 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.175 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.175 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.175 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.073202+0000", 2023-09-30T17:04:10.175 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5690000000000005e-06 2023-09-30T17:04:10.176 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.176 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.176 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.176 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.073249+0000", 2023-09-30T17:04:10.176 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6430000000000001e-05 2023-09-30T17:04:10.176 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.176 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.176 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.176 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.073303+0000", 2023-09-30T17:04:10.176 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3863000000000003e-05 2023-09-30T17:04:10.176 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.176 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.177 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:10.177 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.073427+0000", 2023-09-30T17:04:10.177 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000124406 2023-09-30T17:04:10.177 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.177 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.177 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:10.177 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.079338+0000", 2023-09-30T17:04:10.177 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0059107270000000002 2023-09-30T17:04:10.177 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.177 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.177 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.177 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.178 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.178 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110454 4.31 4:8fb8ba0c:::100000001f8.00000024:head [write 2039808~4096 in=4096b,write 2363392~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.178 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.108388+0000", 2023-09-30T17:04:10.178 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0079866390000000002, 2023-09-30T17:04:10.178 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.008581679, 2023-09-30T17:04:10.178 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.178 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:10.178 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.178 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.178 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.178 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110454 2023-09-30T17:04:10.179 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.179 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.179 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.179 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.179 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108388+0000", 2023-09-30T17:04:10.179 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.179 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.179 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.179 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.179 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108388+0000", 2023-09-30T17:04:10.179 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.179 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.180 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.180 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.180 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108388+0000", 2023-09-30T17:04:10.180 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7999999999999996e-07 2023-09-30T17:04:10.180 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.180 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.180 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.180 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108404+0000", 2023-09-30T17:04:10.180 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5872999999999999e-05 2023-09-30T17:04:10.180 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.180 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.180 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.181 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108412+0000", 2023-09-30T17:04:10.181 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4669999999999998e-06 2023-09-30T17:04:10.181 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.181 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.181 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.181 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108417+0000", 2023-09-30T17:04:10.181 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7389999999999996e-06 2023-09-30T17:04:10.181 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.181 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.181 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.181 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108469+0000", 2023-09-30T17:04:10.182 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1236000000000002e-05 2023-09-30T17:04:10.182 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.182 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.182 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.182 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108554+0000", 2023-09-30T17:04:10.182 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5501999999999996e-05 2023-09-30T17:04:10.182 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.182 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.182 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.182 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.182 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.182 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109719 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 3416064~4096 in=4096b,write 3436544~4096 in=4096b,write 3448832~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.183 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.719273+0000", 2023-09-30T17:04:10.183 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.39710198699999999, 2023-09-30T17:04:10.183 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.397842523, 2023-09-30T17:04:10.183 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.183 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:10.183 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.183 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.183 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.183 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109719 2023-09-30T17:04:10.183 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.183 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.184 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.184 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.184 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.719273+0000", 2023-09-30T17:04:10.184 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.184 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.184 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.184 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.184 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.719273+0000", 2023-09-30T17:04:10.184 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.184 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.184 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.185 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.185 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.719273+0000", 2023-09-30T17:04:10.185 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0399999999999996e-07 2023-09-30T17:04:10.185 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.185 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.185 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.185 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.719288+0000", 2023-09-30T17:04:10.185 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4516e-05 2023-09-30T17:04:10.185 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.185 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.185 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.185 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.719297+0000", 2023-09-30T17:04:10.186 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.6129999999999993e-06 2023-09-30T17:04:10.186 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.186 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.186 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.186 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.719305+0000", 2023-09-30T17:04:10.186 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.306e-06 2023-09-30T17:04:10.186 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.186 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.186 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.186 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.111467+0000", 2023-09-30T17:04:10.186 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.392162185 2023-09-30T17:04:10.186 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.187 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.187 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.187 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.111550+0000", 2023-09-30T17:04:10.187 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3410000000000003e-05 2023-09-30T17:04:10.187 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.187 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.187 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:10.187 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.111723+0000", 2023-09-30T17:04:10.187 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017283899999999999 2023-09-30T17:04:10.187 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.187 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.187 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.188 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.188 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.188 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109768 4.e 4.c27217ce (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.188 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.747199+0000", 2023-09-30T17:04:10.188 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.36917518999999999, 2023-09-30T17:04:10.188 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.37000791, 2023-09-30T17:04:10.188 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.188 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.188 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.188 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.188 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.189 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109768 2023-09-30T17:04:10.189 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.189 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.189 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.189 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.189 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.747199+0000", 2023-09-30T17:04:10.189 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.189 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.189 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.189 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.189 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.747199+0000", 2023-09-30T17:04:10.190 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.190 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.190 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.190 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.190 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.749163+0000", 2023-09-30T17:04:10.190 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0019637029999999998 2023-09-30T17:04:10.190 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.190 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.190 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.190 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.749179+0000", 2023-09-30T17:04:10.190 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5786000000000001e-05 2023-09-30T17:04:10.191 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.191 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.191 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.191 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.749198+0000", 2023-09-30T17:04:10.191 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9369e-05 2023-09-30T17:04:10.191 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.191 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.191 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.191 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.749207+0000", 2023-09-30T17:04:10.191 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.0000000000000002e-06 2023-09-30T17:04:10.191 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.191 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.192 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.192 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.192 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.192 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110356 4.28 4:15eeb89b:::100000001f8.00000032:head [write 3248128~4096 in=4096b,write 3276800~4096 in=4096b,write 3624960~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.192 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.073221+0000", 2023-09-30T17:04:10.192 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.04315397, 2023-09-30T17:04:10.192 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.044075968, 2023-09-30T17:04:10.192 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.192 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:10.192 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.192 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.192 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.193 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110356 2023-09-30T17:04:10.193 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.193 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.193 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.193 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.193 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.073221+0000", 2023-09-30T17:04:10.193 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.193 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.193 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.193 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.193 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.073221+0000", 2023-09-30T17:04:10.194 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.194 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.194 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.194 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.194 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.073221+0000", 2023-09-30T17:04:10.194 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3900000000000004e-07 2023-09-30T17:04:10.194 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.194 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.194 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.195 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.073238+0000", 2023-09-30T17:04:10.195 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6368e-05 2023-09-30T17:04:10.195 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.195 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.195 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.195 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.073245+0000", 2023-09-30T17:04:10.195 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4250000000000001e-06 2023-09-30T17:04:10.195 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.195 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.195 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.195 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.073250+0000", 2023-09-30T17:04:10.196 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4399999999999996e-06 2023-09-30T17:04:10.196 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.196 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.196 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.196 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.076903+0000", 2023-09-30T17:04:10.196 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0036523789999999999 2023-09-30T17:04:10.196 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.196 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.196 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.196 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.076956+0000", 2023-09-30T17:04:10.196 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3047000000000002e-05 2023-09-30T17:04:10.197 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.197 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.197 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:10.197 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.077063+0000", 2023-09-30T17:04:10.197 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00010684 2023-09-30T17:04:10.197 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.197 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.197 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:10.197 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.084489+0000", 2023-09-30T17:04:10.197 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0074265290000000003 2023-09-30T17:04:10.197 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.198 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.198 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:10.198 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.117212+0000", 2023-09-30T17:04:10.198 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.032722558999999998 2023-09-30T17:04:10.198 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.198 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.198 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:10.198 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.117264+0000", 2023-09-30T17:04:10.198 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2401999999999997e-05 2023-09-30T17:04:10.198 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.198 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.199 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:10.199 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.117297+0000", 2023-09-30T17:04:10.199 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.2339999999999999e-05 2023-09-30T17:04:10.199 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.199 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.199 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.199 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.199 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.199 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110455 4.3b 4:dcc0c15f:::100000001f8.0000001a:head [write 3940352~4096 in=4096b,write 4059136~4096 in=4096b,write 4128768~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.199 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.108432+0000", 2023-09-30T17:04:10.199 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0079424089999999992, 2023-09-30T17:04:10.199 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0090236410000000006, 2023-09-30T17:04:10.200 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.200 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:10.200 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.200 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.200 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.200 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110455 2023-09-30T17:04:10.200 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.200 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.200 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.200 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.200 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108432+0000", 2023-09-30T17:04:10.200 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.201 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.201 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.201 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.201 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108432+0000", 2023-09-30T17:04:10.201 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.201 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.201 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.201 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.201 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108433+0000", 2023-09-30T17:04:10.201 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6000000000000004e-07 2023-09-30T17:04:10.201 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.201 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.202 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.202 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108445+0000", 2023-09-30T17:04:10.202 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2279000000000001e-05 2023-09-30T17:04:10.202 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.202 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.202 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.202 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108453+0000", 2023-09-30T17:04:10.202 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7139999999999993e-06 2023-09-30T17:04:10.202 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.202 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.202 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.202 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108459+0000", 2023-09-30T17:04:10.203 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3169999999999998e-06 2023-09-30T17:04:10.203 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.203 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.203 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.203 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108632+0000", 2023-09-30T17:04:10.203 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000173408 2023-09-30T17:04:10.203 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.203 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.203 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.203 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108704+0000", 2023-09-30T17:04:10.203 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1600999999999994e-05 2023-09-30T17:04:10.203 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.204 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.204 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:10.204 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108839+0000", 2023-09-30T17:04:10.204 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00013505599999999999 2023-09-30T17:04:10.204 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.204 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.204 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:10.204 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.114320+0000", 2023-09-30T17:04:10.204 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005481194 2023-09-30T17:04:10.204 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.204 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.204 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.205 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.205 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.205 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109851 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.205 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.854337+0000", 2023-09-30T17:04:10.205 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.26203722899999998, 2023-09-30T17:04:10.205 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.26323953999999999, 2023-09-30T17:04:10.205 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.205 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.205 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.205 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.205 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.205 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109851 2023-09-30T17:04:10.206 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.206 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.206 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.206 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.206 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.854337+0000", 2023-09-30T17:04:10.206 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.206 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.206 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.206 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.206 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.854337+0000", 2023-09-30T17:04:10.206 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.207 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.207 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.207 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.207 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.854338+0000", 2023-09-30T17:04:10.207 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4900000000000001e-07 2023-09-30T17:04:10.207 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.207 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.207 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.207 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.854354+0000", 2023-09-30T17:04:10.207 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6640999999999999e-05 2023-09-30T17:04:10.207 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.207 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.207 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.208 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.854362+0000", 2023-09-30T17:04:10.208 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6669999999999996e-06 2023-09-30T17:04:10.208 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.208 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.208 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.208 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.854370+0000", 2023-09-30T17:04:10.208 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3289999999999994e-06 2023-09-30T17:04:10.208 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.208 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.208 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.208 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.208 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.209 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110357 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.209 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.073258+0000", 2023-09-30T17:04:10.209 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.043116193999999997, 2023-09-30T17:04:10.209 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.044401067000000002, 2023-09-30T17:04:10.209 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.209 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.209 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.209 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.209 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.209 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110357 2023-09-30T17:04:10.209 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.209 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.210 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.210 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.210 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.073258+0000", 2023-09-30T17:04:10.210 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.210 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.210 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.210 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.210 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.073258+0000", 2023-09-30T17:04:10.210 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.210 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.210 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.210 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.211 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.073259+0000", 2023-09-30T17:04:10.211 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0500000000000004e-07 2023-09-30T17:04:10.211 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.211 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.211 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.211 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.073270+0000", 2023-09-30T17:04:10.211 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0971e-05 2023-09-30T17:04:10.211 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.211 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.211 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.211 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.073276+0000", 2023-09-30T17:04:10.211 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1070000000000001e-06 2023-09-30T17:04:10.212 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.212 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.212 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.212 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.073281+0000", 2023-09-30T17:04:10.212 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.763e-06 2023-09-30T17:04:10.212 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.212 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.212 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.212 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.212 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.212 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110431 4.13 4:caef1406:::100000001f8.00000031:head [write 831488~4096 in=4096b,write 942080~4096 in=4096b,write 1126400~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.212 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.095620+0000", 2023-09-30T17:04:10.213 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.020754880999999999, 2023-09-30T17:04:10.213 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.022122558, 2023-09-30T17:04:10.213 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.213 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:10.213 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.213 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.213 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.213 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110431 2023-09-30T17:04:10.213 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.213 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.213 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.213 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.213 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.095620+0000", 2023-09-30T17:04:10.214 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.214 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.214 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.214 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.214 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.095620+0000", 2023-09-30T17:04:10.214 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.214 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.214 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.214 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.214 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.095620+0000", 2023-09-30T17:04:10.214 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2799999999999996e-07 2023-09-30T17:04:10.214 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.215 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.215 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.215 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.095636+0000", 2023-09-30T17:04:10.215 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5630000000000001e-05 2023-09-30T17:04:10.215 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.215 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.215 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.215 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.095644+0000", 2023-09-30T17:04:10.215 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8990000000000001e-06 2023-09-30T17:04:10.215 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.215 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.215 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.216 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.095652+0000", 2023-09-30T17:04:10.216 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3809999999999999e-06 2023-09-30T17:04:10.216 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.216 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.216 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.216 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.098663+0000", 2023-09-30T17:04:10.216 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.003011367 2023-09-30T17:04:10.216 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.216 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.216 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.216 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.098713+0000", 2023-09-30T17:04:10.216 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9509000000000003e-05 2023-09-30T17:04:10.217 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.217 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.217 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.217 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.217 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.217 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110467 4.28 4:15eeb89b:::100000001f8.00000032:head [write 8192~4096 in=4096b,write 20480~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.217 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.108472+0000", 2023-09-30T17:04:10.217 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0079023110000000004, 2023-09-30T17:04:10.217 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0093739300000000008, 2023-09-30T17:04:10.217 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.217 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "reached pg", 2023-09-30T17:04:10.217 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.218 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.218 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.218 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110467 2023-09-30T17:04:10.218 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.218 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.218 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.218 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.218 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108472+0000", 2023-09-30T17:04:10.218 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.218 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.219 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.219 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.219 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108472+0000", 2023-09-30T17:04:10.219 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.219 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.219 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.219 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.219 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108473+0000", 2023-09-30T17:04:10.219 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.82e-07 2023-09-30T17:04:10.219 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.219 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.219 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.220 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108494+0000", 2023-09-30T17:04:10.220 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1175e-05 2023-09-30T17:04:10.220 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.220 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.220 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.220 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108502+0000", 2023-09-30T17:04:10.220 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.909e-06 2023-09-30T17:04:10.220 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.220 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.220 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.220 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108508+0000", 2023-09-30T17:04:10.220 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1800000000000001e-06 2023-09-30T17:04:10.221 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.221 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.221 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.221 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.117777+0000", 2023-09-30T17:04:10.221 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0092694730000000003 2023-09-30T17:04:10.221 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.221 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.221 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.221 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.117851+0000", 2023-09-30T17:04:10.221 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3559000000000005e-05 2023-09-30T17:04:10.221 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.222 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.222 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.222 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.222 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.222 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109883 4.e 4.c27217ce (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.222 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.869320+0000", 2023-09-30T17:04:10.222 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.24705407300000001, 2023-09-30T17:04:10.222 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.248719669, 2023-09-30T17:04:10.222 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.222 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.222 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.222 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.223 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.223 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109883 2023-09-30T17:04:10.223 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.223 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.223 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.223 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.223 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.869320+0000", 2023-09-30T17:04:10.223 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.223 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.223 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.223 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.223 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.869320+0000", 2023-09-30T17:04:10.224 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.224 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.224 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.224 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.224 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.869321+0000", 2023-09-30T17:04:10.224 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7800000000000002e-07 2023-09-30T17:04:10.224 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.224 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.224 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.224 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.869333+0000", 2023-09-30T17:04:10.224 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2432999999999999e-05 2023-09-30T17:04:10.225 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.225 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.225 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.225 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.869341+0000", 2023-09-30T17:04:10.225 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9650000000000008e-06 2023-09-30T17:04:10.225 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.225 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.225 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.225 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.869346+0000", 2023-09-30T17:04:10.225 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.729e-06 2023-09-30T17:04:10.225 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.225 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.226 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.226 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.226 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.226 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110360 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.226 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.073287+0000", 2023-09-30T17:04:10.226 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.043087317999999999, 2023-09-30T17:04:10.226 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.044922110000000001, 2023-09-30T17:04:10.226 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.226 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.226 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.226 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.227 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.227 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110360 2023-09-30T17:04:10.227 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.227 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.227 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.227 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.227 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.073287+0000", 2023-09-30T17:04:10.227 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.227 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.227 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.227 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.227 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.073287+0000", 2023-09-30T17:04:10.228 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.228 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.228 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.228 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.228 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.073288+0000", 2023-09-30T17:04:10.228 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.58e-07 2023-09-30T17:04:10.228 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.228 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.228 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.228 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.073303+0000", 2023-09-30T17:04:10.228 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5058999999999999e-05 2023-09-30T17:04:10.228 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.229 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.229 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.229 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.073309+0000", 2023-09-30T17:04:10.229 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0100000000000001e-06 2023-09-30T17:04:10.229 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.229 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.229 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.229 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.073313+0000", 2023-09-30T17:04:10.229 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7530000000000001e-06 2023-09-30T17:04:10.229 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.229 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.230 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.230 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.230 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.230 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109910 4.6 4.8232b686 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.230 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.885297+0000", 2023-09-30T17:04:10.230 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.23107776499999999, 2023-09-30T17:04:10.230 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23295327299999999, 2023-09-30T17:04:10.230 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.230 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.230 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.230 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.230 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.231 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109910 2023-09-30T17:04:10.231 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.231 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.231 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.231 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.231 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.885297+0000", 2023-09-30T17:04:10.231 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.231 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.231 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.231 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.231 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.885297+0000", 2023-09-30T17:04:10.232 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.232 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.232 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.232 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.232 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.885297+0000", 2023-09-30T17:04:10.232 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8699999999999995e-07 2023-09-30T17:04:10.232 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.232 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.232 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.232 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.885311+0000", 2023-09-30T17:04:10.232 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3326000000000001e-05 2023-09-30T17:04:10.232 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.233 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.233 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.233 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.885318+0000", 2023-09-30T17:04:10.233 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7069999999999992e-06 2023-09-30T17:04:10.233 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.233 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.233 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.233 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.885324+0000", 2023-09-30T17:04:10.233 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9179999999999999e-06 2023-09-30T17:04:10.233 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.233 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.233 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.234 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.234 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.234 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110168 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.234 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.993063+0000", 2023-09-30T17:04:10.234 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.123311882, 2023-09-30T17:04:10.234 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.12524595599999999, 2023-09-30T17:04:10.234 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.234 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.234 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.234 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.234 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.234 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110168 2023-09-30T17:04:10.235 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.235 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.235 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.235 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.235 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.993063+0000", 2023-09-30T17:04:10.235 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.235 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.235 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.235 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.235 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.993063+0000", 2023-09-30T17:04:10.235 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.235 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.236 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.236 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.236 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.993063+0000", 2023-09-30T17:04:10.236 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7599999999999997e-07 2023-09-30T17:04:10.236 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.236 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.236 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.236 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.993081+0000", 2023-09-30T17:04:10.236 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7252e-05 2023-09-30T17:04:10.236 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.236 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.236 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.236 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.993089+0000", 2023-09-30T17:04:10.237 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.7499999999999992e-06 2023-09-30T17:04:10.237 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.237 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.237 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.237 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.993096+0000", 2023-09-30T17:04:10.237 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5370000000000003e-06 2023-09-30T17:04:10.237 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.237 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.237 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.237 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.237 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.237 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:110185 4.2f e51/17 4:f59f865b:::100000001f8.00000007:head v 51'1653, mlcod=51'1651)", 2023-09-30T17:04:10.238 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.083474+0000", 2023-09-30T17:04:10.238 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.032900960999999999, 2023-09-30T17:04:10.238 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.034869084000000002, 2023-09-30T17:04:10.238 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.238 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:10.238 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.238 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.238 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.238 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.083474+0000", 2023-09-30T17:04:10.238 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.238 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.238 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.239 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.239 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.083474+0000", 2023-09-30T17:04:10.239 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.239 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.239 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.239 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.239 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.083474+0000", 2023-09-30T17:04:10.239 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6100000000000001e-07 2023-09-30T17:04:10.239 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.239 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.239 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.239 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.083484+0000", 2023-09-30T17:04:10.240 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.5990000000000008e-06 2023-09-30T17:04:10.240 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.240 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.240 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.240 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.083495+0000", 2023-09-30T17:04:10.240 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1691e-05 2023-09-30T17:04:10.240 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.240 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.240 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.240 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.083500+0000", 2023-09-30T17:04:10.240 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6500000000000004e-06 2023-09-30T17:04:10.241 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.241 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.241 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.241 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.090091+0000", 2023-09-30T17:04:10.241 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0065908360000000001 2023-09-30T17:04:10.241 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.241 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.241 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.241 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.090112+0000", 2023-09-30T17:04:10.241 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.0721999999999999e-05 2023-09-30T17:04:10.241 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.242 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.242 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.242 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.242 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.242 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110471 4.13 4:caef1406:::100000001f8.00000031:head [write 3866624~4096 in=4096b,write 3944448~4096 in=4096b,write 3969024~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.242 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.108517+0000", 2023-09-30T17:04:10.242 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0078571749999999992, 2023-09-30T17:04:10.242 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0098635570000000002, 2023-09-30T17:04:10.242 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.242 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:10.242 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.242 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.243 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.243 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110471 2023-09-30T17:04:10.243 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.243 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.243 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.243 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.243 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108517+0000", 2023-09-30T17:04:10.243 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.243 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.243 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.243 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.244 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108517+0000", 2023-09-30T17:04:10.244 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.244 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.244 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.244 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.244 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.110167+0000", 2023-09-30T17:04:10.244 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001649771 2023-09-30T17:04:10.244 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.244 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.244 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.244 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.110187+0000", 2023-09-30T17:04:10.244 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9970999999999999e-05 2023-09-30T17:04:10.244 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.245 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.245 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.245 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.110197+0000", 2023-09-30T17:04:10.245 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.029e-05 2023-09-30T17:04:10.245 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.245 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.245 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.245 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.110205+0000", 2023-09-30T17:04:10.245 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8630000000000008e-06 2023-09-30T17:04:10.245 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.245 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.245 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.246 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.111288+0000", 2023-09-30T17:04:10.246 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0010831739999999999 2023-09-30T17:04:10.246 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.246 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.246 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.246 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.111362+0000", 2023-09-30T17:04:10.246 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3374000000000006e-05 2023-09-30T17:04:10.246 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.246 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.246 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.247 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.247 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.247 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109594 4.36 4:6da220e6:::100000001f8.0000003f:head [write 3932160~4096 in=4096b,write 4038656~4096 in=4096b,write 4177920~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.247 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.674301+0000", 2023-09-30T17:04:10.247 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.44207308299999998, 2023-09-30T17:04:10.247 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.44413339600000001, 2023-09-30T17:04:10.247 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.247 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:10.247 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.247 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.247 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.248 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109594 2023-09-30T17:04:10.248 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.248 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.248 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.248 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.248 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.674301+0000", 2023-09-30T17:04:10.248 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.248 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.248 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.248 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.248 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.674301+0000", 2023-09-30T17:04:10.248 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.249 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.249 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.249 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.249 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.674302+0000", 2023-09-30T17:04:10.249 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.46e-07 2023-09-30T17:04:10.249 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.249 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.249 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.249 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.674315+0000", 2023-09-30T17:04:10.249 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3213e-05 2023-09-30T17:04:10.249 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.250 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.250 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.250 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.674321+0000", 2023-09-30T17:04:10.250 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2400000000000004e-06 2023-09-30T17:04:10.250 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.250 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.250 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.250 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.674326+0000", 2023-09-30T17:04:10.250 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8670000000000002e-06 2023-09-30T17:04:10.250 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.250 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.250 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.251 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.059410+0000", 2023-09-30T17:04:10.251 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.38508374299999998 2023-09-30T17:04:10.251 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.251 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.251 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.251 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.059492+0000", 2023-09-30T17:04:10.251 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1868999999999998e-05 2023-09-30T17:04:10.251 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.251 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.251 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:10.251 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.059669+0000", 2023-09-30T17:04:10.252 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017732100000000001 2023-09-30T17:04:10.252 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.252 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.252 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:10.252 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.076933+0000", 2023-09-30T17:04:10.252 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.017263647 2023-09-30T17:04:10.252 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.252 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.252 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.252 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.252 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.252 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110301 4.6 4.2d31fac6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.253 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.055287+0000", 2023-09-30T17:04:10.253 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.061087188000000001, 2023-09-30T17:04:10.253 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.063238337000000006, 2023-09-30T17:04:10.253 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.253 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.253 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.253 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.253 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.253 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110301 2023-09-30T17:04:10.253 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.253 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.253 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.254 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.254 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.055287+0000", 2023-09-30T17:04:10.254 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.254 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.254 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.254 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.254 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.055287+0000", 2023-09-30T17:04:10.254 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.254 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.254 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.255 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.255 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.055288+0000", 2023-09-30T17:04:10.255 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.44e-07 2023-09-30T17:04:10.255 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.255 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.255 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.255 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.055303+0000", 2023-09-30T17:04:10.255 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4572999999999999e-05 2023-09-30T17:04:10.255 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.255 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.255 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.255 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.055311+0000", 2023-09-30T17:04:10.256 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8969999999999997e-06 2023-09-30T17:04:10.256 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.256 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.256 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.256 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.055318+0000", 2023-09-30T17:04:10.256 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8419999999999999e-06 2023-09-30T17:04:10.256 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.256 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.256 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.257 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.257 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.257 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110362 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.257 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.073351+0000", 2023-09-30T17:04:10.257 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.043023522000000002, 2023-09-30T17:04:10.257 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.045238171000000001, 2023-09-30T17:04:10.257 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.257 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.258 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.258 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.258 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.258 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110362 2023-09-30T17:04:10.258 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.258 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.258 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.258 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.258 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.073351+0000", 2023-09-30T17:04:10.258 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.259 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.259 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.259 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.259 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.073351+0000", 2023-09-30T17:04:10.259 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.259 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.259 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.259 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.259 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.073351+0000", 2023-09-30T17:04:10.259 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5999999999999999e-07 2023-09-30T17:04:10.260 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.260 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.260 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.260 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.073369+0000", 2023-09-30T17:04:10.260 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7142999999999998e-05 2023-09-30T17:04:10.260 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.260 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.260 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.260 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.073376+0000", 2023-09-30T17:04:10.260 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2080000000000003e-06 2023-09-30T17:04:10.260 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.261 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.261 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.261 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.073381+0000", 2023-09-30T17:04:10.261 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1749999999999996e-06 2023-09-30T17:04:10.261 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.261 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.261 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.261 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.261 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.261 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110474 4.3 4:c222b65c:::100000001f8.00000021:head [write 729088~4096 in=4096b,write 745472~4096 in=4096b,write 757760~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.262 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.110218+0000", 2023-09-30T17:04:10.262 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0061569049999999998, 2023-09-30T17:04:10.262 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0084430489999999993, 2023-09-30T17:04:10.262 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.262 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:10.262 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.262 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.262 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.262 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110474 2023-09-30T17:04:10.262 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.262 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.262 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.263 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.263 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.110218+0000", 2023-09-30T17:04:10.263 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.263 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.263 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.263 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.263 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.110218+0000", 2023-09-30T17:04:10.263 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.263 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.263 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.263 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.263 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.110218+0000", 2023-09-30T17:04:10.264 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3300000000000003e-07 2023-09-30T17:04:10.264 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.264 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.264 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.264 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.110228+0000", 2023-09-30T17:04:10.264 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0039e-05 2023-09-30T17:04:10.264 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.264 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.264 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.264 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.110233+0000", 2023-09-30T17:04:10.264 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3589999999999999e-06 2023-09-30T17:04:10.265 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.265 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.265 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.265 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.110237+0000", 2023-09-30T17:04:10.265 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6799999999999999e-06 2023-09-30T17:04:10.265 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.265 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.265 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.265 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.111408+0000", 2023-09-30T17:04:10.265 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001170684 2023-09-30T17:04:10.265 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.265 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.266 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.266 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.111486+0000", 2023-09-30T17:04:10.266 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7851999999999999e-05 2023-09-30T17:04:10.266 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.266 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.266 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.266 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.266 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.266 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109619 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 3727360~4096 in=4096b,write 4124672~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.266 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.684296+0000", 2023-09-30T17:04:10.266 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.43207894099999999, 2023-09-30T17:04:10.267 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.434471463, 2023-09-30T17:04:10.267 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.267 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:10.267 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.267 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.267 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.267 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109619 2023-09-30T17:04:10.267 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.267 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.267 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.268 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.268 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.684296+0000", 2023-09-30T17:04:10.268 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.268 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.268 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.268 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.268 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.684296+0000", 2023-09-30T17:04:10.268 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.268 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.269 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.269 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.269 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.684296+0000", 2023-09-30T17:04:10.269 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2099999999999997e-07 2023-09-30T17:04:10.269 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.269 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.269 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.269 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.684306+0000", 2023-09-30T17:04:10.269 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.4730000000000006e-06 2023-09-30T17:04:10.270 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.270 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.270 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.270 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.684311+0000", 2023-09-30T17:04:10.270 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8250000000000001e-06 2023-09-30T17:04:10.270 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.270 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.270 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.270 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.684315+0000", 2023-09-30T17:04:10.271 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8010000000000001e-06 2023-09-30T17:04:10.271 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.271 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.271 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.271 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.062040+0000", 2023-09-30T17:04:10.271 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.37772453900000003 2023-09-30T17:04:10.271 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.271 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.271 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.271 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.062086+0000", 2023-09-30T17:04:10.271 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6041000000000002e-05 2023-09-30T17:04:10.272 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.272 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.272 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:10.272 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.062170+0000", 2023-09-30T17:04:10.272 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4240999999999995e-05 2023-09-30T17:04:10.272 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.272 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.272 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:10.272 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.077280+0000", 2023-09-30T17:04:10.272 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.015110442 2023-09-30T17:04:10.272 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.273 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.273 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.273 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.273 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.273 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109658 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 3317760~4096 in=4096b,write 3338240~4096 in=4096b,write 3387392~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.273 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.698203+0000", 2023-09-30T17:04:10.273 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.41817191399999998, 2023-09-30T17:04:10.273 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.42067021999999998, 2023-09-30T17:04:10.273 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.273 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:10.274 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.274 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.274 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.274 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109658 2023-09-30T17:04:10.274 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.274 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.274 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.274 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.274 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.698203+0000", 2023-09-30T17:04:10.274 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.274 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.274 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.275 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.275 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.698203+0000", 2023-09-30T17:04:10.275 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.275 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.275 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.275 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.275 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.698203+0000", 2023-09-30T17:04:10.275 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5099999999999999e-07 2023-09-30T17:04:10.275 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.275 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.275 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.275 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.698217+0000", 2023-09-30T17:04:10.276 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3799e-05 2023-09-30T17:04:10.276 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.276 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.276 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.276 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.698225+0000", 2023-09-30T17:04:10.276 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7659999999999998e-06 2023-09-30T17:04:10.276 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.276 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.276 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.276 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.698233+0000", 2023-09-30T17:04:10.276 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9980000000000003e-06 2023-09-30T17:04:10.277 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.277 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.277 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.277 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.077467+0000", 2023-09-30T17:04:10.277 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.37923422800000001 2023-09-30T17:04:10.277 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.277 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.277 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.277 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.077551+0000", 2023-09-30T17:04:10.277 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3426999999999999e-05 2023-09-30T17:04:10.277 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.277 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.278 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:10.278 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.077726+0000", 2023-09-30T17:04:10.278 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017503199999999999 2023-09-30T17:04:10.278 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.278 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.278 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:10.278 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.098395+0000", 2023-09-30T17:04:10.278 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.020669782000000001 2023-09-30T17:04:10.278 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.278 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.278 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.278 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.279 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.279 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109692 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 2957312~4096 in=4096b,write 3039232~4096 in=4096b,write 3047424~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.279 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.707348+0000", 2023-09-30T17:04:10.279 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.40902667399999998, 2023-09-30T17:04:10.279 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.41162760300000001, 2023-09-30T17:04:10.279 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.279 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:10.279 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.279 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.279 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.279 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109692 2023-09-30T17:04:10.280 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.280 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.280 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.280 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.280 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.707348+0000", 2023-09-30T17:04:10.280 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.280 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.280 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.280 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.280 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.707348+0000", 2023-09-30T17:04:10.281 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.281 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.281 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.281 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.281 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.707348+0000", 2023-09-30T17:04:10.281 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8400000000000004e-07 2023-09-30T17:04:10.281 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.281 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.281 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.281 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.707362+0000", 2023-09-30T17:04:10.281 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3131e-05 2023-09-30T17:04:10.281 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.282 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.282 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.282 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.707369+0000", 2023-09-30T17:04:10.282 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.875e-06 2023-09-30T17:04:10.282 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.282 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.282 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.282 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.707375+0000", 2023-09-30T17:04:10.282 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7799999999999997e-06 2023-09-30T17:04:10.282 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.282 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.283 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.283 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.093520+0000", 2023-09-30T17:04:10.283 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.38614510299999999 2023-09-30T17:04:10.283 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.283 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.283 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.283 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.093592+0000", 2023-09-30T17:04:10.283 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1588999999999995e-05 2023-09-30T17:04:10.283 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.283 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.283 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:10.284 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.093734+0000", 2023-09-30T17:04:10.284 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014193800000000001 2023-09-30T17:04:10.284 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.284 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.284 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:10.284 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.111441+0000", 2023-09-30T17:04:10.284 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.017706676000000001 2023-09-30T17:04:10.284 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.284 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.284 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.284 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.284 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.285 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109951 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.285 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.899406+0000", 2023-09-30T17:04:10.285 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.21696847799999999, 2023-09-30T17:04:10.285 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.219670429, 2023-09-30T17:04:10.285 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.285 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.285 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.285 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.285 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.285 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109951 2023-09-30T17:04:10.285 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.285 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.286 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.286 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.286 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.899406+0000", 2023-09-30T17:04:10.286 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.286 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.286 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.286 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.286 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.899406+0000", 2023-09-30T17:04:10.286 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.286 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.286 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.287 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.287 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.901163+0000", 2023-09-30T17:04:10.287 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001757064 2023-09-30T17:04:10.287 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.287 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.287 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.287 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.901183+0000", 2023-09-30T17:04:10.287 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.0032999999999999e-05 2023-09-30T17:04:10.287 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.287 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.287 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.287 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.901197+0000", 2023-09-30T17:04:10.288 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3464e-05 2023-09-30T17:04:10.288 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.288 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.288 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.288 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.901205+0000", 2023-09-30T17:04:10.288 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1440000000000003e-06 2023-09-30T17:04:10.288 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.288 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.288 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.288 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.288 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.288 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110336 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.289 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.059533+0000", 2023-09-30T17:04:10.289 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.056841303000000003, 2023-09-30T17:04:10.289 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.059606344999999998, 2023-09-30T17:04:10.289 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.289 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.289 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.289 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.289 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.289 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110336 2023-09-30T17:04:10.289 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.289 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.289 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.290 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.290 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.059533+0000", 2023-09-30T17:04:10.290 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.290 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.290 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.290 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.290 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.059533+0000", 2023-09-30T17:04:10.290 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.290 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.290 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.290 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.290 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.065166+0000", 2023-09-30T17:04:10.291 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0056330299999999998 2023-09-30T17:04:10.291 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.291 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.291 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.291 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.065182+0000", 2023-09-30T17:04:10.291 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5829999999999999e-05 2023-09-30T17:04:10.291 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.291 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.291 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.291 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.065193+0000", 2023-09-30T17:04:10.291 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1161999999999999e-05 2023-09-30T17:04:10.291 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.292 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.292 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.292 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.065201+0000", 2023-09-30T17:04:10.292 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5970000000000003e-06 2023-09-30T17:04:10.292 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.292 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.292 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.292 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.292 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.292 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110475 4.6 4.2d31fac6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.292 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.110243+0000", 2023-09-30T17:04:10.292 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0061318989999999997, 2023-09-30T17:04:10.293 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0089671860000000003, 2023-09-30T17:04:10.293 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.293 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.293 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.293 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.293 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.293 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110475 2023-09-30T17:04:10.293 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.293 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.293 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.293 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.293 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.110243+0000", 2023-09-30T17:04:10.294 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.294 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.294 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.294 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.294 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.110243+0000", 2023-09-30T17:04:10.294 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.294 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.294 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.294 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.294 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.112583+0000", 2023-09-30T17:04:10.294 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0023402290000000001 2023-09-30T17:04:10.295 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.295 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.295 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.295 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.112611+0000", 2023-09-30T17:04:10.295 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.7710000000000001e-05 2023-09-30T17:04:10.295 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.295 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.295 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.295 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.112622+0000", 2023-09-30T17:04:10.295 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0913999999999999e-05 2023-09-30T17:04:10.295 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.295 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.296 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.296 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.112629+0000", 2023-09-30T17:04:10.296 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7100000000000007e-06 2023-09-30T17:04:10.296 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.296 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.296 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.296 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.296 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.296 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop_reply(client.4547.0:108784 4.36 e51/17)", 2023-09-30T17:04:10.296 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.118171+0000", 2023-09-30T17:04:10.296 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.9982033, 2023-09-30T17:04:10.296 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001101844, 2023-09-30T17:04:10.297 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.297 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.297 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.297 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.297 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.297 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.118171+0000", 2023-09-30T17:04:10.297 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.297 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.297 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.297 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.297 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.118171+0000", 2023-09-30T17:04:10.297 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.298 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.298 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.298 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.298 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.118172+0000", 2023-09-30T17:04:10.298 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.7000000000000001e-07 2023-09-30T17:04:10.298 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.298 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.298 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.298 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.118174+0000", 2023-09-30T17:04:10.298 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2050000000000001e-06 2023-09-30T17:04:10.298 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.298 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.299 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.299 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.118715+0000", 2023-09-30T17:04:10.299 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00054140000000000004 2023-09-30T17:04:10.299 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.299 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.299 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.299 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.118723+0000", 2023-09-30T17:04:10.299 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7200000000000006e-06 2023-09-30T17:04:10.299 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.299 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.299 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.300 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.300 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.300 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109554 4.6 4:616d4c41:::100000001f8.00000034:head [write 1323008~4096 in=4096b,write 1675264~4096 in=4096b,write 1695744~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.300 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.646316+0000", 2023-09-30T17:04:10.300 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.470058476, 2023-09-30T17:04:10.300 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.47301810100000002, 2023-09-30T17:04:10.300 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.300 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:10.300 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.300 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.300 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.300 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109554 2023-09-30T17:04:10.301 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.301 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.301 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.301 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.301 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646316+0000", 2023-09-30T17:04:10.301 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.301 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.301 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.301 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.301 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646316+0000", 2023-09-30T17:04:10.301 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.301 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.302 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.302 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.302 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646317+0000", 2023-09-30T17:04:10.302 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9100000000000004e-07 2023-09-30T17:04:10.302 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.302 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.302 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.302 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646328+0000", 2023-09-30T17:04:10.302 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1832e-05 2023-09-30T17:04:10.302 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.302 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.302 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.303 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646335+0000", 2023-09-30T17:04:10.303 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7299999999999999e-06 2023-09-30T17:04:10.303 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.303 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.303 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.303 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646342+0000", 2023-09-30T17:04:10.303 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5309999999999998e-06 2023-09-30T17:04:10.303 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.303 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.303 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.303 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.033952+0000", 2023-09-30T17:04:10.303 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.38760991099999997 2023-09-30T17:04:10.304 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.304 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.304 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.304 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.034037+0000", 2023-09-30T17:04:10.304 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5483999999999997e-05 2023-09-30T17:04:10.304 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.304 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.304 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:10.304 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.034208+0000", 2023-09-30T17:04:10.304 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000170946 2023-09-30T17:04:10.304 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.305 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.305 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:10.305 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.058968+0000", 2023-09-30T17:04:10.305 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024760305 2023-09-30T17:04:10.305 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.305 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.305 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.305 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.305 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.305 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109807 4.36 4.670445b6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.305 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.831205+0000", 2023-09-30T17:04:10.306 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.28516934300000002, 2023-09-30T17:04:10.306 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.28821918400000002, 2023-09-30T17:04:10.306 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.306 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.306 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.306 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.306 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.306 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109807 2023-09-30T17:04:10.307 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.307 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.307 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.307 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.307 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.831205+0000", 2023-09-30T17:04:10.307 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.307 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.307 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.307 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.307 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.831205+0000", 2023-09-30T17:04:10.308 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.308 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.308 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.308 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.308 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.833162+0000", 2023-09-30T17:04:10.308 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001956513 2023-09-30T17:04:10.308 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.308 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.308 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.308 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.833178+0000", 2023-09-30T17:04:10.309 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6120000000000002e-05 2023-09-30T17:04:10.309 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.309 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.309 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.309 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.833189+0000", 2023-09-30T17:04:10.309 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0743e-05 2023-09-30T17:04:10.309 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.309 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.309 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.309 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.833196+0000", 2023-09-30T17:04:10.309 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5719999999999997e-06 2023-09-30T17:04:10.309 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.310 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.310 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.310 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.310 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.310 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110193 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.310 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.999218+0000", 2023-09-30T17:04:10.310 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.11715661099999999, 2023-09-30T17:04:10.310 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.120269687, 2023-09-30T17:04:10.310 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.310 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.310 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.311 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.311 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.311 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110193 2023-09-30T17:04:10.311 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.311 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.311 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.311 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.311 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.999218+0000", 2023-09-30T17:04:10.311 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.311 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.311 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.311 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.312 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.999218+0000", 2023-09-30T17:04:10.312 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.312 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.312 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.312 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.312 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.001964+0000", 2023-09-30T17:04:10.312 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00274588 2023-09-30T17:04:10.312 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.312 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.312 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.312 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.001981+0000", 2023-09-30T17:04:10.312 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7065999999999999e-05 2023-09-30T17:04:10.313 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.313 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.313 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.313 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.001990+0000", 2023-09-30T17:04:10.313 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.5920000000000007e-06 2023-09-30T17:04:10.313 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.313 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.313 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.313 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.001999+0000", 2023-09-30T17:04:10.313 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2700000000000004e-06 2023-09-30T17:04:10.313 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.313 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.314 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.314 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.314 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.314 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110411 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.314 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.085223+0000", 2023-09-30T17:04:10.314 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.031152052999999999, 2023-09-30T17:04:10.314 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.034327419999999997, 2023-09-30T17:04:10.314 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.314 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.314 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.314 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.315 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.315 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110411 2023-09-30T17:04:10.315 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.315 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.315 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.315 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.315 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.085223+0000", 2023-09-30T17:04:10.315 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.315 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.315 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.315 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.315 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.085223+0000", 2023-09-30T17:04:10.316 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.316 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.316 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.316 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.316 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.087168+0000", 2023-09-30T17:04:10.316 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001945551 2023-09-30T17:04:10.316 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.316 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.316 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.316 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.087187+0000", 2023-09-30T17:04:10.316 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8981e-05 2023-09-30T17:04:10.316 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.317 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.317 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.317 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.087200+0000", 2023-09-30T17:04:10.317 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3431999999999999e-05 2023-09-30T17:04:10.317 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.317 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.317 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.317 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.087209+0000", 2023-09-30T17:04:10.317 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8449999999999992e-06 2023-09-30T17:04:10.317 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.317 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.318 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.318 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.318 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.318 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110477 4.13 4:cbf33e86:::100000001f8.00000026:head [write 4071424~4096 in=4096b,write 4124672~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.318 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.112642+0000", 2023-09-30T17:04:10.318 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.003732445, 2023-09-30T17:04:10.318 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0069792589999999998, 2023-09-30T17:04:10.318 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.318 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:10.318 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.318 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.318 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.319 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110477 2023-09-30T17:04:10.319 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.319 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.319 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.319 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.319 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.112642+0000", 2023-09-30T17:04:10.319 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.319 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.319 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.319 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.319 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.112642+0000", 2023-09-30T17:04:10.319 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.320 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.320 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.320 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.320 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.112643+0000", 2023-09-30T17:04:10.320 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7100000000000002e-07 2023-09-30T17:04:10.320 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.320 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.320 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.320 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.112653+0000", 2023-09-30T17:04:10.320 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0407e-05 2023-09-30T17:04:10.320 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.320 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.321 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.321 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.112660+0000", 2023-09-30T17:04:10.321 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3220000000000004e-06 2023-09-30T17:04:10.321 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.321 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.321 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.321 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.112666+0000", 2023-09-30T17:04:10.321 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2499999999999997e-06 2023-09-30T17:04:10.321 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.321 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.321 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.321 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.116850+0000", 2023-09-30T17:04:10.322 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0041840439999999996 2023-09-30T17:04:10.322 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.322 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.322 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.322 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.116934+0000", 2023-09-30T17:04:10.322 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4093999999999998e-05 2023-09-30T17:04:10.322 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.322 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.322 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.322 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.322 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.322 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop_reply(client.4547.0:108806 4.36 e51/17)", 2023-09-30T17:04:10.323 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.118733+0000", 2023-09-30T17:04:10.323 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.9976416, 2023-09-30T17:04:10.323 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000968826, 2023-09-30T17:04:10.323 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.323 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.323 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.323 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.323 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.323 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.118733+0000", 2023-09-30T17:04:10.323 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.323 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.324 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.324 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.324 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.118733+0000", 2023-09-30T17:04:10.324 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.324 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.324 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.324 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.324 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.118733+0000", 2023-09-30T17:04:10.324 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1699999999999999e-07 2023-09-30T17:04:10.324 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.324 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.325 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.325 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.118737+0000", 2023-09-30T17:04:10.325 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.14e-06 2023-09-30T17:04:10.325 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.325 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.325 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.325 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.118744+0000", 2023-09-30T17:04:10.325 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5279999999999998e-06 2023-09-30T17:04:10.325 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.325 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.325 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.325 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.118749+0000", 2023-09-30T17:04:10.326 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9620000000000001e-06 2023-09-30T17:04:10.326 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.326 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.326 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.326 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.326 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.326 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109559 4.36 4:6da220e6:::100000001f8.0000003f:head [write 2142208~4096 in=4096b,write 2183168~4096 in=4096b,write 2220032~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.326 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.646349+0000", 2023-09-30T17:04:10.326 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.47002603100000001, 2023-09-30T17:04:10.326 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.47341797800000002, 2023-09-30T17:04:10.327 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.327 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:10.327 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.327 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.327 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.327 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109559 2023-09-30T17:04:10.327 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.327 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.327 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.327 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.327 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646349+0000", 2023-09-30T17:04:10.327 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.328 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.328 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.328 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.328 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646349+0000", 2023-09-30T17:04:10.328 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.328 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.328 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.328 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.328 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646349+0000", 2023-09-30T17:04:10.328 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8500000000000002e-07 2023-09-30T17:04:10.328 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.328 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.328 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.329 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646360+0000", 2023-09-30T17:04:10.329 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1255e-05 2023-09-30T17:04:10.329 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.329 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.329 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.329 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646366+0000", 2023-09-30T17:04:10.329 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9959999999999999e-06 2023-09-30T17:04:10.329 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.329 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.329 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.329 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646371+0000", 2023-09-30T17:04:10.330 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9010000000000002e-06 2023-09-30T17:04:10.330 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.330 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.330 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.330 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.033938+0000", 2023-09-30T17:04:10.330 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.38756676699999998 2023-09-30T17:04:10.330 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.330 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.330 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.330 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.034023+0000", 2023-09-30T17:04:10.330 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5011000000000003e-05 2023-09-30T17:04:10.330 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.331 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.331 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:10.331 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.034178+0000", 2023-09-30T17:04:10.331 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000155267 2023-09-30T17:04:10.331 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.331 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.331 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:10.331 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.058961+0000", 2023-09-30T17:04:10.331 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024782786000000001 2023-09-30T17:04:10.331 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.331 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.331 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.332 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.332 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.332 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109779 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.332 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.779215+0000", 2023-09-30T17:04:10.332 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.33715980600000001, 2023-09-30T17:04:10.332 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.34064283699999998, 2023-09-30T17:04:10.332 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.332 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.332 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.332 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.332 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.332 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109779 2023-09-30T17:04:10.333 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.333 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.333 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.333 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.333 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.779215+0000", 2023-09-30T17:04:10.333 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.333 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.333 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.333 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.333 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.779215+0000", 2023-09-30T17:04:10.333 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.333 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.334 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.334 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.334 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.785163+0000", 2023-09-30T17:04:10.334 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0059481239999999999 2023-09-30T17:04:10.334 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.334 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.334 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.334 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.785183+0000", 2023-09-30T17:04:10.334 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9701999999999999e-05 2023-09-30T17:04:10.334 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.335 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.335 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.335 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.785196+0000", 2023-09-30T17:04:10.335 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3308e-05 2023-09-30T17:04:10.335 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.335 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.335 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.335 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.785205+0000", 2023-09-30T17:04:10.335 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.0189999999999995e-06 2023-09-30T17:04:10.335 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.335 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.335 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.336 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.336 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.336 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109808 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.336 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.833208+0000", 2023-09-30T17:04:10.336 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.283166523, 2023-09-30T17:04:10.336 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.28671432800000002, 2023-09-30T17:04:10.336 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.336 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.336 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.336 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.336 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.336 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109808 2023-09-30T17:04:10.337 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.337 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.337 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.337 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.337 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.833208+0000", 2023-09-30T17:04:10.337 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.337 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.337 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.337 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.337 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.833208+0000", 2023-09-30T17:04:10.337 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.337 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.338 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.338 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.338 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.833208+0000", 2023-09-30T17:04:10.338 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5999999999999999e-07 2023-09-30T17:04:10.338 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.338 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.338 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.338 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.833221+0000", 2023-09-30T17:04:10.338 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2676e-05 2023-09-30T17:04:10.338 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.338 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.338 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.339 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.833230+0000", 2023-09-30T17:04:10.339 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2820000000000002e-06 2023-09-30T17:04:10.339 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.339 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.339 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.339 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.833238+0000", 2023-09-30T17:04:10.339 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2490000000000004e-06 2023-09-30T17:04:10.339 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.339 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.339 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.339 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.339 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.340 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110111 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.340 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.967299+0000", 2023-09-30T17:04:10.340 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.14907604499999999, 2023-09-30T17:04:10.340 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.15268736999999999, 2023-09-30T17:04:10.340 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.340 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.340 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.340 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.340 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.340 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110111 2023-09-30T17:04:10.340 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.340 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.341 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.341 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.341 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.967299+0000", 2023-09-30T17:04:10.341 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.341 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.341 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.341 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.341 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.967299+0000", 2023-09-30T17:04:10.341 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.341 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.341 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.341 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.342 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.969163+0000", 2023-09-30T17:04:10.342 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0018643760000000001 2023-09-30T17:04:10.342 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.342 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.342 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.342 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.969182+0000", 2023-09-30T17:04:10.342 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.863e-05 2023-09-30T17:04:10.342 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.342 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.342 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.342 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.969195+0000", 2023-09-30T17:04:10.343 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.363e-05 2023-09-30T17:04:10.343 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.343 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.343 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.343 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.969204+0000", 2023-09-30T17:04:10.343 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5660000000000007e-06 2023-09-30T17:04:10.343 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.343 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.343 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.343 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.343 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.344 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110248 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.344 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.028290+0000", 2023-09-30T17:04:10.344 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.088084936000000003, 2023-09-30T17:04:10.344 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.091759523999999995, 2023-09-30T17:04:10.344 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.344 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.344 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.344 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.344 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.344 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110248 2023-09-30T17:04:10.344 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.344 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.345 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.345 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.345 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.028290+0000", 2023-09-30T17:04:10.345 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.345 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.345 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.345 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.345 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.028290+0000", 2023-09-30T17:04:10.345 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.345 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.345 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.346 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.346 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.028290+0000", 2023-09-30T17:04:10.346 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3099999999999998e-07 2023-09-30T17:04:10.346 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.346 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.346 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.346 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.028303+0000", 2023-09-30T17:04:10.346 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3233e-05 2023-09-30T17:04:10.346 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.346 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.346 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.347 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.028308+0000", 2023-09-30T17:04:10.347 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4789999999999998e-06 2023-09-30T17:04:10.347 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.347 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.349 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.349 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.028312+0000", 2023-09-30T17:04:10.349 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3769999999999998e-06 2023-09-30T17:04:10.349 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.349 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.349 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.349 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.349 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.350 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110340 4.36 4.670445b6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.350 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.065251+0000", 2023-09-30T17:04:10.350 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.051123093000000001, 2023-09-30T17:04:10.350 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.054860748000000001, 2023-09-30T17:04:10.350 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.350 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.350 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.350 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.350 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.350 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110340 2023-09-30T17:04:10.350 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.351 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.351 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.351 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.351 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.065251+0000", 2023-09-30T17:04:10.351 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.351 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.351 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.351 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.351 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.065251+0000", 2023-09-30T17:04:10.351 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.351 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.351 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.352 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.352 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.065252+0000", 2023-09-30T17:04:10.352 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1800000000000001e-07 2023-09-30T17:04:10.352 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.352 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.352 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.352 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.065263+0000", 2023-09-30T17:04:10.352 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1053000000000001e-05 2023-09-30T17:04:10.352 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.352 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.352 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.353 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.065269+0000", 2023-09-30T17:04:10.353 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5390000000000004e-06 2023-09-30T17:04:10.353 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.353 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.353 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.353 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.065275+0000", 2023-09-30T17:04:10.353 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0289999999999996e-06 2023-09-30T17:04:10.353 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.353 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.353 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.353 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.353 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.354 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110370 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.354 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.073461+0000", 2023-09-30T17:04:10.354 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.042913651999999997, 2023-09-30T17:04:10.354 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.046724828000000003, 2023-09-30T17:04:10.354 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.354 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.354 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.354 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.354 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.354 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110370 2023-09-30T17:04:10.354 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.354 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.355 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.355 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.355 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.073461+0000", 2023-09-30T17:04:10.355 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.355 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.355 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.355 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.355 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.073461+0000", 2023-09-30T17:04:10.355 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.355 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.355 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.355 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.356 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.073461+0000", 2023-09-30T17:04:10.356 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3500000000000002e-07 2023-09-30T17:04:10.356 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.356 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.356 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.356 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.073481+0000", 2023-09-30T17:04:10.356 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9987e-05 2023-09-30T17:04:10.356 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.356 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.356 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.356 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.073488+0000", 2023-09-30T17:04:10.356 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9979999999999997e-06 2023-09-30T17:04:10.357 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.357 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.357 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.357 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.073494+0000", 2023-09-30T17:04:10.357 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2660000000000001e-06 2023-09-30T17:04:10.357 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.357 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.357 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.357 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.357 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.357 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110413 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.358 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.087224+0000", 2023-09-30T17:04:10.358 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.029150514999999998, 2023-09-30T17:04:10.358 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.033027426999999998, 2023-09-30T17:04:10.358 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.358 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.358 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.358 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.358 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.358 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110413 2023-09-30T17:04:10.358 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.358 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.359 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.359 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.359 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.087224+0000", 2023-09-30T17:04:10.359 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.359 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.359 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.359 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.359 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.087224+0000", 2023-09-30T17:04:10.359 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.359 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.359 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.360 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.360 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.087225+0000", 2023-09-30T17:04:10.360 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8599999999999998e-07 2023-09-30T17:04:10.360 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.360 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.360 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.360 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.087239+0000", 2023-09-30T17:04:10.360 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4769e-05 2023-09-30T17:04:10.360 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.360 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.360 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.360 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.087248+0000", 2023-09-30T17:04:10.361 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.7909999999999993e-06 2023-09-30T17:04:10.361 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.361 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.361 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.361 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.087256+0000", 2023-09-30T17:04:10.361 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9349999999999994e-06 2023-09-30T17:04:10.361 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.361 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.361 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.361 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.361 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.361 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110436 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.362 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.100222+0000", 2023-09-30T17:04:10.362 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.016153016999999999, 2023-09-30T17:04:10.362 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.020106776, 2023-09-30T17:04:10.362 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.362 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.362 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.362 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.362 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.362 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110436 2023-09-30T17:04:10.362 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.362 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.363 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.363 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.363 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.100222+0000", 2023-09-30T17:04:10.363 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.363 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.363 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.363 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.363 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.100222+0000", 2023-09-30T17:04:10.363 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.363 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.364 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.364 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.364 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.100222+0000", 2023-09-30T17:04:10.364 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4900000000000001e-07 2023-09-30T17:04:10.364 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.364 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.364 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.364 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.100234+0000", 2023-09-30T17:04:10.364 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1522000000000001e-05 2023-09-30T17:04:10.364 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.364 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.364 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.365 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.100241+0000", 2023-09-30T17:04:10.365 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1849999999999998e-06 2023-09-30T17:04:10.365 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.365 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.365 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.365 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.100246+0000", 2023-09-30T17:04:10.365 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4920000000000001e-06 2023-09-30T17:04:10.365 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.365 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.365 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.365 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.365 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.366 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110480 4.27 4.df99e167 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.366 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.112673+0000", 2023-09-30T17:04:10.366 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0037014779999999998, 2023-09-30T17:04:10.366 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0077164169999999997, 2023-09-30T17:04:10.366 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.366 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.366 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.366 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.366 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.366 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110480 2023-09-30T17:04:10.366 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.367 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.367 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.367 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.367 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.112673+0000", 2023-09-30T17:04:10.367 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.367 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.367 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.367 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.367 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.112673+0000", 2023-09-30T17:04:10.367 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.367 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.367 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.368 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.368 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.112673+0000", 2023-09-30T17:04:10.368 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1300000000000001e-07 2023-09-30T17:04:10.368 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.368 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.368 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.368 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.112687+0000", 2023-09-30T17:04:10.368 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3089e-05 2023-09-30T17:04:10.368 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.368 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.368 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.368 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.112694+0000", 2023-09-30T17:04:10.368 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9589999999999998e-06 2023-09-30T17:04:10.369 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.369 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.369 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.369 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.112698+0000", 2023-09-30T17:04:10.369 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8790000000000002e-06 2023-09-30T17:04:10.369 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.369 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.369 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.369 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.369 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.370 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop_reply(client.4547.0:108820 4.6 e51/17)", 2023-09-30T17:04:10.370 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.118764+0000", 2023-09-30T17:04:10.370 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.9976101, 2023-09-30T17:04:10.370 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001688504, 2023-09-30T17:04:10.370 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.370 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.370 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.370 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.370 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.370 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.118764+0000", 2023-09-30T17:04:10.370 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.371 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.371 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.371 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.371 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.118764+0000", 2023-09-30T17:04:10.371 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.371 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.371 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.371 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.371 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.118765+0000", 2023-09-30T17:04:10.371 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3799999999999998e-07 2023-09-30T17:04:10.371 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.371 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.372 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.372 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.118767+0000", 2023-09-30T17:04:10.372 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2539999999999999e-06 2023-09-30T17:04:10.372 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.372 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.372 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.372 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.118774+0000", 2023-09-30T17:04:10.372 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.6769999999999998e-06 2023-09-30T17:04:10.372 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.372 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.372 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.372 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.118779+0000", 2023-09-30T17:04:10.373 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8890000000000001e-06 2023-09-30T17:04:10.373 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.373 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.373 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.373 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.373 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.373 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109628 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 2998272~4096 in=4096b,write 3293184~4096 in=4096b,write 3391488~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.373 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.684377+0000", 2023-09-30T17:04:10.373 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.43199766899999997, 2023-09-30T17:04:10.373 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.43611542800000003, 2023-09-30T17:04:10.373 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.373 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:10.373 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.374 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.374 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.374 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109628 2023-09-30T17:04:10.374 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.374 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.374 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.374 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.374 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.684377+0000", 2023-09-30T17:04:10.374 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.374 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.374 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.374 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.375 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.684377+0000", 2023-09-30T17:04:10.375 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.375 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.375 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.375 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.375 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.684377+0000", 2023-09-30T17:04:10.375 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.3099999999999999e-07 2023-09-30T17:04:10.375 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.375 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.375 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.376 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.684386+0000", 2023-09-30T17:04:10.376 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5960000000000004e-06 2023-09-30T17:04:10.376 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.376 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.376 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.376 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.684401+0000", 2023-09-30T17:04:10.376 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5707000000000001e-05 2023-09-30T17:04:10.376 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.376 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.376 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.376 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.684408+0000", 2023-09-30T17:04:10.376 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4860000000000002e-06 2023-09-30T17:04:10.377 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.377 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.377 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.377 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.064664+0000", 2023-09-30T17:04:10.377 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.38025568100000001 2023-09-30T17:04:10.377 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.377 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.377 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.377 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.064738+0000", 2023-09-30T17:04:10.377 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4271999999999996e-05 2023-09-30T17:04:10.377 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.378 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.378 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:10.378 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.064908+0000", 2023-09-30T17:04:10.378 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000170178 2023-09-30T17:04:10.378 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.378 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.378 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:10.378 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.088958+0000", 2023-09-30T17:04:10.378 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024049462000000001 2023-09-30T17:04:10.378 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.378 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.378 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.379 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.379 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.379 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110343 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.379 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.065281+0000", 2023-09-30T17:04:10.379 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.051093324000000002, 2023-09-30T17:04:10.379 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.055277041999999998, 2023-09-30T17:04:10.379 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.379 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.379 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.379 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.379 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.380 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110343 2023-09-30T17:04:10.380 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.380 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.380 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.380 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.380 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.065281+0000", 2023-09-30T17:04:10.380 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.380 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.380 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.380 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.380 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.065281+0000", 2023-09-30T17:04:10.380 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.381 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.381 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.381 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.381 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.065282+0000", 2023-09-30T17:04:10.381 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8000000000000001e-07 2023-09-30T17:04:10.381 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.381 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.381 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.381 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.065294+0000", 2023-09-30T17:04:10.381 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2662e-05 2023-09-30T17:04:10.381 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.381 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.382 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.382 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.065302+0000", 2023-09-30T17:04:10.382 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1370000000000002e-06 2023-09-30T17:04:10.382 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.382 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.382 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.382 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.065307+0000", 2023-09-30T17:04:10.382 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9370000000000003e-06 2023-09-30T17:04:10.382 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.382 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.382 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.383 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.383 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.383 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110482 4.24 4:27adda6e:::100000001f8.0000000f:head [write 3936256~4096 in=4096b,write 3981312~4096 in=4096b,write 4124672~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.383 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.112706+0000", 2023-09-30T17:04:10.383 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0036689969999999998, 2023-09-30T17:04:10.383 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0078990710000000006, 2023-09-30T17:04:10.383 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.383 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:10.383 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.383 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.383 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.383 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110482 2023-09-30T17:04:10.384 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.384 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.384 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.384 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.384 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.112706+0000", 2023-09-30T17:04:10.384 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.384 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.384 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.384 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.384 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.112706+0000", 2023-09-30T17:04:10.384 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.384 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.385 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.385 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.385 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.112706+0000", 2023-09-30T17:04:10.385 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.96e-07 2023-09-30T17:04:10.385 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.385 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.385 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.385 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.112720+0000", 2023-09-30T17:04:10.385 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.448e-05 2023-09-30T17:04:10.385 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.385 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.385 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.385 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.112735+0000", 2023-09-30T17:04:10.386 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4491000000000001e-05 2023-09-30T17:04:10.386 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.386 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.386 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.386 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.112740+0000", 2023-09-30T17:04:10.386 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4689999999999996e-06 2023-09-30T17:04:10.386 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.386 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.386 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.386 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.112794+0000", 2023-09-30T17:04:10.386 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3359000000000002e-05 2023-09-30T17:04:10.386 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.387 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.387 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.387 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.112893+0000", 2023-09-30T17:04:10.387 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8869999999999994e-05 2023-09-30T17:04:10.387 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.387 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.387 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.387 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.387 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.387 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop_reply(client.4547.0:108831 4.36 e51/17)", 2023-09-30T17:04:10.387 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.118787+0000", 2023-09-30T17:04:10.387 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.9975882, 2023-09-30T17:04:10.388 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0018570710000000001, 2023-09-30T17:04:10.388 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.388 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.388 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.388 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.388 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.388 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.118787+0000", 2023-09-30T17:04:10.388 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.388 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.388 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.388 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.389 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.118787+0000", 2023-09-30T17:04:10.389 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.389 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.389 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.389 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.389 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.118787+0000", 2023-09-30T17:04:10.389 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.7000000000000001e-07 2023-09-30T17:04:10.389 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.389 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.389 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.389 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.118789+0000", 2023-09-30T17:04:10.390 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9369999999999998e-06 2023-09-30T17:04:10.390 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.390 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.390 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.390 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.118795+0000", 2023-09-30T17:04:10.390 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2689999999999996e-06 2023-09-30T17:04:10.390 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.390 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.390 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.390 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.118800+0000", 2023-09-30T17:04:10.390 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5449999999999997e-06 2023-09-30T17:04:10.390 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.391 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.391 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.391 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.391 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.391 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109982 4.6 4.8232b686 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.391 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.914513+0000", 2023-09-30T17:04:10.391 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.201861558, 2023-09-30T17:04:10.391 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.206158072, 2023-09-30T17:04:10.391 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.391 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.391 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.391 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.392 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.392 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109982 2023-09-30T17:04:10.392 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.392 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.392 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.392 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.392 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.914513+0000", 2023-09-30T17:04:10.392 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.392 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.392 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.392 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.392 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.914513+0000", 2023-09-30T17:04:10.393 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.393 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.393 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.393 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.393 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.914514+0000", 2023-09-30T17:04:10.393 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4000000000000001e-07 2023-09-30T17:04:10.393 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.393 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.393 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.393 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.914532+0000", 2023-09-30T17:04:10.393 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8834e-05 2023-09-30T17:04:10.393 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.393 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.394 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.394 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.914541+0000", 2023-09-30T17:04:10.394 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.918e-06 2023-09-30T17:04:10.394 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.394 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.394 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.394 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.914547+0000", 2023-09-30T17:04:10.394 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0569999999999998e-06 2023-09-30T17:04:10.394 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.394 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.395 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.395 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.395 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.395 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110037 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.395 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.937348+0000", 2023-09-30T17:04:10.395 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.17902702700000001, 2023-09-30T17:04:10.395 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.18337553100000001, 2023-09-30T17:04:10.395 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.395 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.395 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.395 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.395 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.396 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110037 2023-09-30T17:04:10.396 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.396 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.396 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.396 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.396 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.937348+0000", 2023-09-30T17:04:10.396 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.396 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.396 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.396 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.396 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.937348+0000", 2023-09-30T17:04:10.396 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.397 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.397 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.397 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.397 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.941003+0000", 2023-09-30T17:04:10.397 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0036552619999999998 2023-09-30T17:04:10.397 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.397 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.397 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.397 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.941027+0000", 2023-09-30T17:04:10.398 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.3867e-05 2023-09-30T17:04:10.398 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.398 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.398 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.398 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.941040+0000", 2023-09-30T17:04:10.398 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3353000000000001e-05 2023-09-30T17:04:10.398 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.398 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.398 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.399 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.941053+0000", 2023-09-30T17:04:10.399 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.348e-05 2023-09-30T17:04:10.399 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.399 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.399 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.399 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.399 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.399 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110226 4.6 4.2d31fac6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.399 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.014573+0000", 2023-09-30T17:04:10.399 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.101801952, 2023-09-30T17:04:10.399 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.10618572499999999, 2023-09-30T17:04:10.399 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.400 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.400 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.400 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.400 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.400 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110226 2023-09-30T17:04:10.400 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.400 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.400 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.400 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.400 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.014573+0000", 2023-09-30T17:04:10.400 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.401 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.401 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.401 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.401 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.014573+0000", 2023-09-30T17:04:10.401 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.401 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.401 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.401 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.401 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.014573+0000", 2023-09-30T17:04:10.402 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6499999999999999e-07 2023-09-30T17:04:10.402 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.402 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.402 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.402 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.014585+0000", 2023-09-30T17:04:10.402 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1582e-05 2023-09-30T17:04:10.402 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.402 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.402 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.402 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.014592+0000", 2023-09-30T17:04:10.402 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2169999999999997e-06 2023-09-30T17:04:10.403 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.403 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.403 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.403 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.014597+0000", 2023-09-30T17:04:10.403 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2220000000000001e-06 2023-09-30T17:04:10.403 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.403 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.403 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.403 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.403 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.403 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:111460 4.2d e51/17 4:b4aa06e9:::100000001f8.0000001d:head v 51'3418, mlcod=51'3416)", 2023-09-30T17:04:10.403 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.101715+0000", 2023-09-30T17:04:10.404 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.014659592000000001, 2023-09-30T17:04:10.404 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.019096364000000001, 2023-09-30T17:04:10.404 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.404 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:10.404 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.404 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.404 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.404 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.101715+0000", 2023-09-30T17:04:10.404 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.404 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.404 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.405 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.405 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.101715+0000", 2023-09-30T17:04:10.405 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.405 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.405 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.405 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.405 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.101715+0000", 2023-09-30T17:04:10.405 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0400000000000002e-07 2023-09-30T17:04:10.405 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.405 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.406 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.406 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.101732+0000", 2023-09-30T17:04:10.406 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7136e-05 2023-09-30T17:04:10.406 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.406 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.406 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.406 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.101741+0000", 2023-09-30T17:04:10.406 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3690000000000007e-06 2023-09-30T17:04:10.406 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.406 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.406 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.406 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.101748+0000", 2023-09-30T17:04:10.407 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7510000000000002e-06 2023-09-30T17:04:10.407 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.407 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.407 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.407 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.101799+0000", 2023-09-30T17:04:10.407 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1950999999999998e-05 2023-09-30T17:04:10.407 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.407 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.407 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.407 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.101820+0000", 2023-09-30T17:04:10.407 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.0472999999999999e-05 2023-09-30T17:04:10.407 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.408 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.408 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.408 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.408 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.408 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110494 4.24 4.765bb5e4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.408 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.120390+0000", 2023-09-30T17:04:10.408 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.9959841, 2023-09-30T17:04:10.408 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00048818899999999998, 2023-09-30T17:04:10.408 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.408 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.408 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.408 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.409 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.409 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110494 2023-09-30T17:04:10.409 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.409 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.409 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.409 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.409 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.120390+0000", 2023-09-30T17:04:10.409 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.409 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.409 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.409 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.410 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.120390+0000", 2023-09-30T17:04:10.410 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.410 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.410 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.410 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.410 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.120391+0000", 2023-09-30T17:04:10.410 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5300000000000003e-07 2023-09-30T17:04:10.410 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.410 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.410 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.410 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.120408+0000", 2023-09-30T17:04:10.410 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6541e-05 2023-09-30T17:04:10.411 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.411 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.411 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.411 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.120417+0000", 2023-09-30T17:04:10.411 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3200000000000006e-06 2023-09-30T17:04:10.411 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.411 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.411 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.411 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.120423+0000", 2023-09-30T17:04:10.411 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.789e-06 2023-09-30T17:04:10.411 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.411 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.412 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.412 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.412 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.412 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109527 4.6 4:616d4c41:::100000001f8.00000034:head [write 122880~4096 in=4096b,write 143360~4096 in=4096b,write 151552~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.412 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.630262+0000", 2023-09-30T17:04:10.412 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.48611279099999999, 2023-09-30T17:04:10.412 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.49076545500000002, 2023-09-30T17:04:10.412 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.412 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:10.412 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.412 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.413 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.413 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109527 2023-09-30T17:04:10.413 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.413 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.413 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.413 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.413 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.630262+0000", 2023-09-30T17:04:10.413 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.413 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.413 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.413 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.413 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.630262+0000", 2023-09-30T17:04:10.414 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.414 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.414 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.414 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.414 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.632170+0000", 2023-09-30T17:04:10.414 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0019085529999999999 2023-09-30T17:04:10.414 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.414 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.414 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.414 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.632192+0000", 2023-09-30T17:04:10.414 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1243999999999999e-05 2023-09-30T17:04:10.414 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.415 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.415 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.415 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.632203+0000", 2023-09-30T17:04:10.415 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1389999999999999e-05 2023-09-30T17:04:10.415 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.415 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.415 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.415 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.632211+0000", 2023-09-30T17:04:10.415 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8939999999999993e-06 2023-09-30T17:04:10.415 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.415 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.416 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.416 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.031203+0000", 2023-09-30T17:04:10.416 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39899208800000002 2023-09-30T17:04:10.416 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.416 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.416 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.416 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.031278+0000", 2023-09-30T17:04:10.416 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4988999999999996e-05 2023-09-30T17:04:10.416 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.416 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.416 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:10.417 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.031432+0000", 2023-09-30T17:04:10.417 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000154396 2023-09-30T17:04:10.417 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.417 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.417 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:10.417 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.058953+0000", 2023-09-30T17:04:10.417 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.027520464000000001 2023-09-30T17:04:10.417 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.417 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.417 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.417 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.417 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.418 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109562 4.6 4:616d4c41:::100000001f8.00000034:head [write 4071424~4096 in=4096b,write 4161536~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.418 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.650213+0000", 2023-09-30T17:04:10.418 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.46616131900000002, 2023-09-30T17:04:10.418 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.47091375600000002, 2023-09-30T17:04:10.418 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.418 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:10.418 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.418 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.418 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.418 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109562 2023-09-30T17:04:10.418 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.419 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.419 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.419 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.419 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.650213+0000", 2023-09-30T17:04:10.419 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.419 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.419 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.419 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.419 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.650213+0000", 2023-09-30T17:04:10.419 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.419 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.420 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.420 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.420 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.650214+0000", 2023-09-30T17:04:10.420 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1200000000000003e-07 2023-09-30T17:04:10.420 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.420 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.420 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.420 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.650227+0000", 2023-09-30T17:04:10.420 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.287e-05 2023-09-30T17:04:10.420 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.420 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.420 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.421 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.650235+0000", 2023-09-30T17:04:10.421 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8189999999999992e-06 2023-09-30T17:04:10.421 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.421 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.421 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.421 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.650241+0000", 2023-09-30T17:04:10.421 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3749999999999999e-06 2023-09-30T17:04:10.421 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.421 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.421 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.421 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.042530+0000", 2023-09-30T17:04:10.421 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39228892399999998 2023-09-30T17:04:10.422 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.422 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.422 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.422 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.042619+0000", 2023-09-30T17:04:10.422 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8838999999999994e-05 2023-09-30T17:04:10.422 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.422 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.422 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:10.422 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.042773+0000", 2023-09-30T17:04:10.422 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000154456 2023-09-30T17:04:10.422 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.422 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.423 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:10.423 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.059137+0000", 2023-09-30T17:04:10.423 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.016363800000000001 2023-09-30T17:04:10.423 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.423 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.423 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.423 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.423 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.423 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110147 4.36 4.670445b6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.423 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.982305+0000", 2023-09-30T17:04:10.423 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.13406981800000001, 2023-09-30T17:04:10.423 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.138925514, 2023-09-30T17:04:10.424 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.424 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.424 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.424 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.424 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.424 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110147 2023-09-30T17:04:10.424 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.424 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.424 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.424 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.425 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.982305+0000", 2023-09-30T17:04:10.425 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.425 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.425 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.425 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.425 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.982305+0000", 2023-09-30T17:04:10.425 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.425 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.425 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.425 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.426 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.982305+0000", 2023-09-30T17:04:10.426 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7000000000000005e-07 2023-09-30T17:04:10.426 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.426 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.426 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.426 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.982324+0000", 2023-09-30T17:04:10.426 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9103999999999999e-05 2023-09-30T17:04:10.426 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.426 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.426 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.426 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.982335+0000", 2023-09-30T17:04:10.427 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0292000000000001e-05 2023-09-30T17:04:10.427 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.427 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.427 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.427 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.982342+0000", 2023-09-30T17:04:10.427 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1590000000000004e-06 2023-09-30T17:04:10.427 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.427 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.427 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.427 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.427 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.427 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110252 4.e 4.c27217ce (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.428 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.028389+0000", 2023-09-30T17:04:10.428 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.087985082000000006, 2023-09-30T17:04:10.428 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.092910899000000005, 2023-09-30T17:04:10.428 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.428 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.428 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.428 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.428 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.428 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110252 2023-09-30T17:04:10.428 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.429 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.429 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.429 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.429 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.028389+0000", 2023-09-30T17:04:10.429 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.429 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.429 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.429 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.429 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.028389+0000", 2023-09-30T17:04:10.429 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.429 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.429 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.430 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.430 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.030164+0000", 2023-09-30T17:04:10.430 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001774889 2023-09-30T17:04:10.430 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.430 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.430 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.430 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.030183+0000", 2023-09-30T17:04:10.430 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8715999999999998e-05 2023-09-30T17:04:10.430 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.430 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.430 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.430 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.030195+0000", 2023-09-30T17:04:10.431 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2394e-05 2023-09-30T17:04:10.431 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.431 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.431 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.431 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.030204+0000", 2023-09-30T17:04:10.431 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0660000000000004e-06 2023-09-30T17:04:10.431 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.431 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.431 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.431 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.431 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.432 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:110251 4.f e51/17 4:f2a80dfe:::100000001f8.00000019:head v 51'5233, mlcod=51'5229)", 2023-09-30T17:04:10.432 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.101829+0000", 2023-09-30T17:04:10.432 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.014545143, 2023-09-30T17:04:10.432 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.019549562999999999, 2023-09-30T17:04:10.432 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.432 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:10.432 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.432 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.432 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.432 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.101829+0000", 2023-09-30T17:04:10.432 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.432 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.433 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.433 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.433 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.101829+0000", 2023-09-30T17:04:10.433 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.433 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.433 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.433 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.433 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.101830+0000", 2023-09-30T17:04:10.433 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9800000000000004e-07 2023-09-30T17:04:10.433 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.433 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.433 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.434 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.101844+0000", 2023-09-30T17:04:10.434 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4389999999999999e-05 2023-09-30T17:04:10.434 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.434 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.434 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.434 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.101853+0000", 2023-09-30T17:04:10.434 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2300000000000008e-06 2023-09-30T17:04:10.434 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.434 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.434 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.434 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.101858+0000", 2023-09-30T17:04:10.435 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9259999999999997e-06 2023-09-30T17:04:10.435 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.435 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.435 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.435 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.106279+0000", 2023-09-30T17:04:10.435 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0044208959999999997 2023-09-30T17:04:10.435 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.435 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.435 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.435 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.106301+0000", 2023-09-30T17:04:10.435 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1437000000000002e-05 2023-09-30T17:04:10.435 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.436 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.436 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.436 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.436 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.436 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110495 4.1c 4.f7421d9c (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.436 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.120436+0000", 2023-09-30T17:04:10.436 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.9959388, 2023-09-30T17:04:10.436 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0010182559999999999, 2023-09-30T17:04:10.436 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.436 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.436 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.436 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.437 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.437 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110495 2023-09-30T17:04:10.437 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.437 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.437 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.437 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.437 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.120436+0000", 2023-09-30T17:04:10.437 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.437 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.437 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.437 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.438 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.120436+0000", 2023-09-30T17:04:10.438 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.438 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.438 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.438 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.438 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.120436+0000", 2023-09-30T17:04:10.438 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0200000000000002e-07 2023-09-30T17:04:10.438 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.438 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.438 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.438 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.120448+0000", 2023-09-30T17:04:10.439 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2241e-05 2023-09-30T17:04:10.439 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.439 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.439 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.439 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.120455+0000", 2023-09-30T17:04:10.439 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.6170000000000003e-06 2023-09-30T17:04:10.439 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.439 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.439 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.439 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.120460+0000", 2023-09-30T17:04:10.439 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2859999999999999e-06 2023-09-30T17:04:10.439 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.439 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.440 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.440 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.440 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.440 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109861 4.6 4.8232b686 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.440 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.857272+0000", 2023-09-30T17:04:10.440 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.25910256700000001, 2023-09-30T17:04:10.440 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.26425347999999999, 2023-09-30T17:04:10.440 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.440 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.440 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.440 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.440 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.441 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109861 2023-09-30T17:04:10.441 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.441 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.441 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.441 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.441 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.857272+0000", 2023-09-30T17:04:10.441 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.441 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.441 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.441 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.441 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.857272+0000", 2023-09-30T17:04:10.441 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.442 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.442 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.442 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.442 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.859162+0000", 2023-09-30T17:04:10.442 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001890091 2023-09-30T17:04:10.442 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.442 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.442 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.442 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.859175+0000", 2023-09-30T17:04:10.442 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2867000000000001e-05 2023-09-30T17:04:10.442 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.442 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.443 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.443 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.859186+0000", 2023-09-30T17:04:10.443 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0747999999999999e-05 2023-09-30T17:04:10.443 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.443 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.443 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.443 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.859191+0000", 2023-09-30T17:04:10.443 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7740000000000001e-06 2023-09-30T17:04:10.443 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.443 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.443 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.443 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.444 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.444 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109952 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.444 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.901218+0000", 2023-09-30T17:04:10.444 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.21515677999999999, 2023-09-30T17:04:10.444 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.22037432600000001, 2023-09-30T17:04:10.444 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.444 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.444 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.444 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.444 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.444 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109952 2023-09-30T17:04:10.444 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.445 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.445 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.445 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.445 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.901218+0000", 2023-09-30T17:04:10.445 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.445 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.445 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.445 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.445 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.901218+0000", 2023-09-30T17:04:10.445 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.445 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.445 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.446 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.446 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.905164+0000", 2023-09-30T17:04:10.446 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0039462220000000001 2023-09-30T17:04:10.446 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.446 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.446 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.446 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.905181+0000", 2023-09-30T17:04:10.446 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7441000000000001e-05 2023-09-30T17:04:10.446 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.446 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.446 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.447 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.905202+0000", 2023-09-30T17:04:10.447 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.0763000000000001e-05 2023-09-30T17:04:10.447 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.447 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.447 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.447 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.905210+0000", 2023-09-30T17:04:10.447 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9319999999999996e-06 2023-09-30T17:04:10.447 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.447 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.447 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.447 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.448 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.448 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110064 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.448 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.954231+0000", 2023-09-30T17:04:10.448 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.16214350799999999, 2023-09-30T17:04:10.448 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.167430932, 2023-09-30T17:04:10.448 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.448 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.448 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.448 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.448 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.448 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110064 2023-09-30T17:04:10.448 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.449 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.449 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.449 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.449 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.954231+0000", 2023-09-30T17:04:10.449 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.449 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.449 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.449 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.449 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.954231+0000", 2023-09-30T17:04:10.449 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.449 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.449 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.450 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.450 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.954232+0000", 2023-09-30T17:04:10.450 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0200000000000002e-07 2023-09-30T17:04:10.450 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.450 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.450 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.450 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.954248+0000", 2023-09-30T17:04:10.450 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6291999999999999e-05 2023-09-30T17:04:10.450 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.451 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.451 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.451 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.954256+0000", 2023-09-30T17:04:10.451 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3529999999999995e-06 2023-09-30T17:04:10.451 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.451 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.451 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.451 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.954263+0000", 2023-09-30T17:04:10.451 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7560000000000002e-06 2023-09-30T17:04:10.451 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.451 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.452 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.452 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.452 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.452 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110418 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.452 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.087313+0000", 2023-09-30T17:04:10.452 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.029061983, 2023-09-30T17:04:10.452 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.034413701999999997, 2023-09-30T17:04:10.452 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.452 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.452 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.452 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.453 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.453 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110418 2023-09-30T17:04:10.453 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.453 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.453 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.453 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.453 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.087313+0000", 2023-09-30T17:04:10.453 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.453 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.453 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.453 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.453 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.087313+0000", 2023-09-30T17:04:10.454 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.454 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.454 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.454 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.454 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.089164+0000", 2023-09-30T17:04:10.454 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001851852 2023-09-30T17:04:10.454 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.454 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.454 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.454 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.089182+0000", 2023-09-30T17:04:10.454 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.747e-05 2023-09-30T17:04:10.454 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.455 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.455 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.455 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.089194+0000", 2023-09-30T17:04:10.455 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.204e-05 2023-09-30T17:04:10.455 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.455 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.455 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.455 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.089202+0000", 2023-09-30T17:04:10.455 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4740000000000005e-06 2023-09-30T17:04:10.455 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.455 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.455 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.456 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.456 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.456 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110497 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.456 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.120467+0000", 2023-09-30T17:04:10.456 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.9959073, 2023-09-30T17:04:10.456 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001328542, 2023-09-30T17:04:10.456 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.456 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.456 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.456 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.456 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.456 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110497 2023-09-30T17:04:10.457 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.457 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.457 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.457 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.457 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.120467+0000", 2023-09-30T17:04:10.457 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.457 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.457 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.457 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.457 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.120467+0000", 2023-09-30T17:04:10.457 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.458 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.458 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.458 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.458 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.120468+0000", 2023-09-30T17:04:10.458 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2899999999999999e-07 2023-09-30T17:04:10.458 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.458 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.458 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.458 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.120493+0000", 2023-09-30T17:04:10.458 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.5156000000000001e-05 2023-09-30T17:04:10.458 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.458 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.459 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.459 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.120500+0000", 2023-09-30T17:04:10.459 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.452e-06 2023-09-30T17:04:10.459 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.459 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.459 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.459 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.120506+0000", 2023-09-30T17:04:10.459 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2299999999999999e-06 2023-09-30T17:04:10.459 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.459 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.459 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.460 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.460 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.460 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110065 4.36 4.670445b6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.460 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.954272+0000", 2023-09-30T17:04:10.460 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.162102305, 2023-09-30T17:04:10.460 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.16759263599999999, 2023-09-30T17:04:10.460 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.460 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.460 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.460 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.460 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.461 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110065 2023-09-30T17:04:10.461 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.461 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.461 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.461 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.461 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.954272+0000", 2023-09-30T17:04:10.461 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.461 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.461 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.461 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.461 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.954272+0000", 2023-09-30T17:04:10.461 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.462 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.462 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.462 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.462 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.954273+0000", 2023-09-30T17:04:10.462 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9900000000000001e-07 2023-09-30T17:04:10.462 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.462 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.462 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.462 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.954285+0000", 2023-09-30T17:04:10.462 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1946999999999999e-05 2023-09-30T17:04:10.462 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.463 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.463 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.463 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.954292+0000", 2023-09-30T17:04:10.463 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1609999999999997e-06 2023-09-30T17:04:10.463 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.463 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.463 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.463 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.954297+0000", 2023-09-30T17:04:10.463 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9930000000000003e-06 2023-09-30T17:04:10.463 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.463 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.464 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.464 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.464 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.464 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110440 4.34 4:2d2c9530:::100000001f8.00000036:head [write 1392640~4096 in=4096b,write 1585152~4096 in=4096b,write 1601536~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.464 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.102223+0000", 2023-09-30T17:04:10.464 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.014151555, 2023-09-30T17:04:10.464 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.019721513999999999, 2023-09-30T17:04:10.464 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.464 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:10.464 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.464 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.464 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.465 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110440 2023-09-30T17:04:10.465 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.465 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.465 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.465 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.465 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.102223+0000", 2023-09-30T17:04:10.465 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.465 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.465 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.465 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.465 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.102223+0000", 2023-09-30T17:04:10.466 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.466 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.466 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.466 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.466 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.104163+0000", 2023-09-30T17:04:10.466 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0019403809999999999 2023-09-30T17:04:10.466 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.466 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.466 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.466 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.104180+0000", 2023-09-30T17:04:10.466 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6988000000000001e-05 2023-09-30T17:04:10.466 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.467 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.467 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.467 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.104191+0000", 2023-09-30T17:04:10.467 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0889e-05 2023-09-30T17:04:10.467 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.467 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.467 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.467 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.104197+0000", 2023-09-30T17:04:10.467 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6489999999999996e-06 2023-09-30T17:04:10.467 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.467 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.468 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.468 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.106628+0000", 2023-09-30T17:04:10.468 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0024307780000000002 2023-09-30T17:04:10.468 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.468 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.468 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.468 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.106710+0000", 2023-09-30T17:04:10.468 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2235000000000001e-05 2023-09-30T17:04:10.468 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.469 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.469 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.469 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.469 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.469 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop_reply(client.4547.0:108762 4.36 e51/17 ondisk, result = 0)", 2023-09-30T17:04:10.469 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.113266+0000", 2023-09-30T17:04:10.469 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0031088079999999998, 2023-09-30T17:04:10.469 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0087609149999999993, 2023-09-30T17:04:10.469 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.469 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:10.469 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.470 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.470 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.470 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.113266+0000", 2023-09-30T17:04:10.470 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.470 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.470 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.470 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.470 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.113266+0000", 2023-09-30T17:04:10.470 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.470 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.470 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.471 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.471 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.113266+0000", 2023-09-30T17:04:10.471 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1300000000000001e-07 2023-09-30T17:04:10.471 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.471 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.471 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.471 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.113267+0000", 2023-09-30T17:04:10.471 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1090000000000001e-06 2023-09-30T17:04:10.471 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.471 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.471 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.471 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.113270+0000", 2023-09-30T17:04:10.472 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.9170000000000002e-06 2023-09-30T17:04:10.472 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.472 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.472 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.472 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.113272+0000", 2023-09-30T17:04:10.472 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.3089999999999998e-06 2023-09-30T17:04:10.472 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.472 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.472 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.472 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.119788+0000", 2023-09-30T17:04:10.472 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0065160519999999996 2023-09-30T17:04:10.472 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.473 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.473 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.473 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.119795+0000", 2023-09-30T17:04:10.473 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9500000000000004e-06 2023-09-30T17:04:10.473 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.473 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.473 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.473 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.473 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.473 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110501 4.3d 4.b9df5cbd (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.473 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.120513+0000", 2023-09-30T17:04:10.473 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.9958615, 2023-09-30T17:04:10.474 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0016039100000000001, 2023-09-30T17:04:10.474 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.474 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.474 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.474 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.474 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.474 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110501 2023-09-30T17:04:10.474 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.474 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.474 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.474 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.474 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.120513+0000", 2023-09-30T17:04:10.475 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.475 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.475 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.475 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.475 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.120513+0000", 2023-09-30T17:04:10.475 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.475 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.475 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.475 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.475 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.120514+0000", 2023-09-30T17:04:10.475 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3600000000000004e-07 2023-09-30T17:04:10.475 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.476 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.476 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.476 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.120529+0000", 2023-09-30T17:04:10.476 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4977000000000001e-05 2023-09-30T17:04:10.476 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.476 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.476 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.476 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.120535+0000", 2023-09-30T17:04:10.476 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2310000000000001e-06 2023-09-30T17:04:10.476 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.477 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.477 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.477 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.120540+0000", 2023-09-30T17:04:10.477 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8709999999999996e-06 2023-09-30T17:04:10.477 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.477 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.477 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.477 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.477 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.478 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109789 4.e 4.c27217ce (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.478 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.803215+0000", 2023-09-30T17:04:10.478 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.31315911400000002, 2023-09-30T17:04:10.478 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.318975856, 2023-09-30T17:04:10.478 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.478 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.478 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.478 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.478 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.478 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109789 2023-09-30T17:04:10.478 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.479 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.479 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.479 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.479 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.803215+0000", 2023-09-30T17:04:10.479 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.479 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.479 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.479 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.479 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.803215+0000", 2023-09-30T17:04:10.479 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.479 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.479 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.480 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.480 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.807162+0000", 2023-09-30T17:04:10.480 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0039465439999999997 2023-09-30T17:04:10.480 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.480 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.480 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.480 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.807185+0000", 2023-09-30T17:04:10.480 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2588000000000001e-05 2023-09-30T17:04:10.480 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.480 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.480 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.480 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.807194+0000", 2023-09-30T17:04:10.481 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.6819999999999998e-06 2023-09-30T17:04:10.481 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.481 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.481 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.481 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.807202+0000", 2023-09-30T17:04:10.481 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0909999999999993e-06 2023-09-30T17:04:10.481 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.481 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.481 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.481 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.481 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.482 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109837 4.e 4.c27217ce (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.482 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.850223+0000", 2023-09-30T17:04:10.482 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.26615174699999999, 2023-09-30T17:04:10.482 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.27204360399999999, 2023-09-30T17:04:10.482 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.482 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.482 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.482 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.482 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.482 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109837 2023-09-30T17:04:10.482 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.482 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.483 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.483 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.483 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.850223+0000", 2023-09-30T17:04:10.483 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.483 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.483 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.483 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.483 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.850223+0000", 2023-09-30T17:04:10.483 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.483 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.483 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.483 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.484 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.850223+0000", 2023-09-30T17:04:10.484 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6100000000000001e-07 2023-09-30T17:04:10.484 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.484 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.484 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.484 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.850236+0000", 2023-09-30T17:04:10.484 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2566e-05 2023-09-30T17:04:10.484 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.484 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.484 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.484 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.850243+0000", 2023-09-30T17:04:10.484 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2479999999999999e-06 2023-09-30T17:04:10.485 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.485 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.485 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.485 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.850249+0000", 2023-09-30T17:04:10.485 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5509999999999999e-06 2023-09-30T17:04:10.485 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.485 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.485 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.485 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.485 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.485 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110067 4.6 4.2d31fac6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.485 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.954304+0000", 2023-09-30T17:04:10.486 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.162071044, 2023-09-30T17:04:10.486 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.16803032500000001, 2023-09-30T17:04:10.486 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.486 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.486 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.486 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.486 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.486 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110067 2023-09-30T17:04:10.486 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.486 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.486 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.487 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.487 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.954304+0000", 2023-09-30T17:04:10.487 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.487 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.487 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.487 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.487 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.954304+0000", 2023-09-30T17:04:10.487 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.487 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.487 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.487 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.487 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.954304+0000", 2023-09-30T17:04:10.488 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.89e-07 2023-09-30T17:04:10.488 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.488 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.488 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.488 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.954317+0000", 2023-09-30T17:04:10.488 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3258000000000001e-05 2023-09-30T17:04:10.488 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.488 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.488 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.488 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.954323+0000", 2023-09-30T17:04:10.488 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8880000000000002e-06 2023-09-30T17:04:10.489 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.489 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.489 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.489 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.954328+0000", 2023-09-30T17:04:10.489 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7729999999999999e-06 2023-09-30T17:04:10.489 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.489 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.489 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.489 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.489 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.489 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110505 4.28 4.d91d77a8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.490 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.120546+0000", 2023-09-30T17:04:10.490 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.9958282, 2023-09-30T17:04:10.490 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001951796, 2023-09-30T17:04:10.490 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.490 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.490 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.490 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.490 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.490 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110505 2023-09-30T17:04:10.490 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.491 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.491 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.491 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.491 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.120546+0000", 2023-09-30T17:04:10.491 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.491 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.491 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.491 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.491 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.120546+0000", 2023-09-30T17:04:10.491 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.491 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.491 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.491 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.492 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.120547+0000", 2023-09-30T17:04:10.492 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.1100000000000002e-07 2023-09-30T17:04:10.492 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.492 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.492 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.492 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.120558+0000", 2023-09-30T17:04:10.492 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0875e-05 2023-09-30T17:04:10.492 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.492 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.492 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.492 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.120564+0000", 2023-09-30T17:04:10.492 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1519999999999997e-06 2023-09-30T17:04:10.493 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.493 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.493 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.493 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.120568+0000", 2023-09-30T17:04:10.493 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6670000000000004e-06 2023-09-30T17:04:10.493 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.493 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.493 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.493 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.493 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.493 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110042 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.493 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.943239+0000", 2023-09-30T17:04:10.494 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.17313569000000001, 2023-09-30T17:04:10.494 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.17932527200000001, 2023-09-30T17:04:10.494 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.494 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.494 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.494 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.494 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.494 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110042 2023-09-30T17:04:10.494 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.494 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.494 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.494 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.495 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.943239+0000", 2023-09-30T17:04:10.495 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.495 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.495 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.495 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.495 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.943239+0000", 2023-09-30T17:04:10.495 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.495 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.495 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.495 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.495 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.943239+0000", 2023-09-30T17:04:10.495 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0500000000000004e-07 2023-09-30T17:04:10.496 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.496 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.496 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.496 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.943255+0000", 2023-09-30T17:04:10.496 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5707000000000001e-05 2023-09-30T17:04:10.496 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.496 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.496 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.496 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.943262+0000", 2023-09-30T17:04:10.496 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0770000000000002e-06 2023-09-30T17:04:10.496 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.496 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.497 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.497 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.943267+0000", 2023-09-30T17:04:10.497 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3159999999999996e-06 2023-09-30T17:04:10.497 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.497 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.497 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.497 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.497 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.497 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110198 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.497 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.003221+0000", 2023-09-30T17:04:10.497 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.11315369, 2023-09-30T17:04:10.498 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.119406738, 2023-09-30T17:04:10.498 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.498 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.498 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.498 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.498 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.498 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110198 2023-09-30T17:04:10.498 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.498 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.498 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.498 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.499 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.003221+0000", 2023-09-30T17:04:10.499 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.499 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.499 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.499 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.499 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.003221+0000", 2023-09-30T17:04:10.499 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.499 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.499 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.499 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.499 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.007165+0000", 2023-09-30T17:04:10.499 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0039438529999999998 2023-09-30T17:04:10.500 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.500 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.500 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.500 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.007184+0000", 2023-09-30T17:04:10.500 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8926000000000001e-05 2023-09-30T17:04:10.500 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.500 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.500 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.500 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.007199+0000", 2023-09-30T17:04:10.500 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5375000000000001e-05 2023-09-30T17:04:10.500 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.500 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.500 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.501 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.007207+0000", 2023-09-30T17:04:10.501 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1899999999999995e-06 2023-09-30T17:04:10.501 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.501 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.501 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.501 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.501 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.501 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110228 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.501 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.018646+0000", 2023-09-30T17:04:10.501 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.097728616000000004, 2023-09-30T17:04:10.501 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.10405012299999999, 2023-09-30T17:04:10.501 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.502 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.502 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.502 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.502 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.502 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110228 2023-09-30T17:04:10.502 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.502 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.502 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.502 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.502 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.018646+0000", 2023-09-30T17:04:10.502 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.503 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.503 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.503 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.503 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.018646+0000", 2023-09-30T17:04:10.503 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.503 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.503 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.503 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.503 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.018646+0000", 2023-09-30T17:04:10.503 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6899999999999998e-07 2023-09-30T17:04:10.503 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.504 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.504 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.504 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.018660+0000", 2023-09-30T17:04:10.504 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3354e-05 2023-09-30T17:04:10.504 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.504 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.504 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.504 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.018667+0000", 2023-09-30T17:04:10.504 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2389999999999996e-06 2023-09-30T17:04:10.504 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.504 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.504 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.505 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.018673+0000", 2023-09-30T17:04:10.505 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6899999999999997e-06 2023-09-30T17:04:10.505 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.505 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.505 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.505 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.505 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.505 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110378 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.505 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.078626+0000", 2023-09-30T17:04:10.505 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.037748227000000002, 2023-09-30T17:04:10.506 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.044132387000000002, 2023-09-30T17:04:10.506 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.506 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.506 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.506 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.506 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.506 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110378 2023-09-30T17:04:10.506 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.506 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.506 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.506 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.506 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.078626+0000", 2023-09-30T17:04:10.507 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.507 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.507 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.507 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.507 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.078626+0000", 2023-09-30T17:04:10.507 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.507 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.507 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.507 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.507 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.078627+0000", 2023-09-30T17:04:10.507 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8599999999999996e-07 2023-09-30T17:04:10.508 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.508 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.508 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.508 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.078643+0000", 2023-09-30T17:04:10.508 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6171000000000002e-05 2023-09-30T17:04:10.508 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.508 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.508 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.508 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.078654+0000", 2023-09-30T17:04:10.508 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0142e-05 2023-09-30T17:04:10.508 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.508 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.509 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.509 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.078661+0000", 2023-09-30T17:04:10.509 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8010000000000004e-06 2023-09-30T17:04:10.509 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.509 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.509 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.509 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.509 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.509 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110506 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.509 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.120579+0000", 2023-09-30T17:04:10.509 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.9957952, 2023-09-30T17:04:10.510 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0022602239999999999, 2023-09-30T17:04:10.510 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.510 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.510 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.510 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.510 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.510 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110506 2023-09-30T17:04:10.510 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.510 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.510 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.510 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.510 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.120579+0000", 2023-09-30T17:04:10.511 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.511 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.511 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.511 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.511 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.120579+0000", 2023-09-30T17:04:10.511 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.511 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.511 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.511 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.511 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.120580+0000", 2023-09-30T17:04:10.511 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1300000000000001e-07 2023-09-30T17:04:10.511 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.512 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.512 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.512 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.120595+0000", 2023-09-30T17:04:10.512 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5356999999999999e-05 2023-09-30T17:04:10.512 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.512 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.512 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.512 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.120605+0000", 2023-09-30T17:04:10.512 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.9080000000000007e-06 2023-09-30T17:04:10.512 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.512 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.512 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.513 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.120611+0000", 2023-09-30T17:04:10.513 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5080000000000002e-06 2023-09-30T17:04:10.513 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.513 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.513 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.513 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.513 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.513 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109842 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.513 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.850297+0000", 2023-09-30T17:04:10.513 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.26607796, 2023-09-30T17:04:10.513 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.27257838899999998, 2023-09-30T17:04:10.513 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.514 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.514 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.514 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.514 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.514 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109842 2023-09-30T17:04:10.514 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.514 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.514 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.514 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.514 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.850297+0000", 2023-09-30T17:04:10.514 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.514 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.515 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.515 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.515 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.850297+0000", 2023-09-30T17:04:10.515 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.515 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.515 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.515 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.515 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.850297+0000", 2023-09-30T17:04:10.515 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5699999999999998e-07 2023-09-30T17:04:10.515 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.515 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.516 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.516 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.850312+0000", 2023-09-30T17:04:10.516 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4521999999999999e-05 2023-09-30T17:04:10.516 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.516 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.516 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.516 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.850318+0000", 2023-09-30T17:04:10.516 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8669999999999996e-06 2023-09-30T17:04:10.516 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.516 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.516 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.516 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.850325+0000", 2023-09-30T17:04:10.517 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.6510000000000004e-06 2023-09-30T17:04:10.517 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.517 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.517 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.517 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.517 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.517 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110151 4.6 4.2d31fac6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.517 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.982469+0000", 2023-09-30T17:04:10.517 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.13390528700000001, 2023-09-30T17:04:10.517 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.14044004299999999, 2023-09-30T17:04:10.517 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.517 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.517 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.518 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.518 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.518 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110151 2023-09-30T17:04:10.518 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.518 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.518 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.518 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.518 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.982469+0000", 2023-09-30T17:04:10.518 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.518 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.518 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.519 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.519 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.982469+0000", 2023-09-30T17:04:10.519 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.519 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.519 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.519 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.519 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.982470+0000", 2023-09-30T17:04:10.519 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4499999999999997e-07 2023-09-30T17:04:10.519 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.519 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.519 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.520 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.982491+0000", 2023-09-30T17:04:10.520 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1192e-05 2023-09-30T17:04:10.520 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.520 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.520 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.520 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.982500+0000", 2023-09-30T17:04:10.520 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3700000000000001e-06 2023-09-30T17:04:10.520 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.520 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.520 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.520 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.982506+0000", 2023-09-30T17:04:10.521 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9880000000000001e-06 2023-09-30T17:04:10.521 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.521 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.521 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.521 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.521 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.521 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110381 4.27 4.df99e167 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.521 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.078672+0000", 2023-09-30T17:04:10.521 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.037702698, 2023-09-30T17:04:10.521 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.044270911000000003, 2023-09-30T17:04:10.521 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.522 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.522 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.522 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.522 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.522 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110381 2023-09-30T17:04:10.522 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.522 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.522 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.522 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.522 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.078672+0000", 2023-09-30T17:04:10.522 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.522 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.523 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.523 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.523 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.078672+0000", 2023-09-30T17:04:10.523 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.523 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.523 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.523 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.523 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.078672+0000", 2023-09-30T17:04:10.523 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2799999999999996e-07 2023-09-30T17:04:10.523 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.523 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.523 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.523 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.078691+0000", 2023-09-30T17:04:10.524 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8385000000000001e-05 2023-09-30T17:04:10.524 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.524 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.524 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.524 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.078698+0000", 2023-09-30T17:04:10.524 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4229999999999999e-06 2023-09-30T17:04:10.524 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.524 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.524 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.524 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.078704+0000", 2023-09-30T17:04:10.525 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7010000000000001e-06 2023-09-30T17:04:10.525 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.525 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.525 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.525 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.525 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.525 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:110272 4.f e51/17)", 2023-09-30T17:04:10.525 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.113299+0000", 2023-09-30T17:04:10.525 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0030750899999999999, 2023-09-30T17:04:10.525 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0096753570000000007, 2023-09-30T17:04:10.526 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.526 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.526 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.526 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.526 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.526 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.113299+0000", 2023-09-30T17:04:10.526 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.526 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.526 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.526 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.526 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.113299+0000", 2023-09-30T17:04:10.526 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.527 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.527 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.527 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.527 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.113300+0000", 2023-09-30T17:04:10.527 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6299999999999999e-07 2023-09-30T17:04:10.527 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.527 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.527 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.527 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.113310+0000", 2023-09-30T17:04:10.527 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0012e-05 2023-09-30T17:04:10.527 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.527 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.527 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.528 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.113313+0000", 2023-09-30T17:04:10.528 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6200000000000001e-06 2023-09-30T17:04:10.528 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.528 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.528 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.528 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.113316+0000", 2023-09-30T17:04:10.528 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.948e-06 2023-09-30T17:04:10.528 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.528 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.528 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.528 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.529 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.529 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:111492 4.2d e51/17)", 2023-09-30T17:04:10.529 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.121105+0000", 2023-09-30T17:04:10.529 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.9952698, 2023-09-30T17:04:10.529 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0018967789999999999, 2023-09-30T17:04:10.529 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.529 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.529 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.529 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.529 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.529 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.121105+0000", 2023-09-30T17:04:10.529 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.530 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.530 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.530 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.530 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.121105+0000", 2023-09-30T17:04:10.530 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.530 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.530 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.530 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.530 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.121105+0000", 2023-09-30T17:04:10.530 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2099999999999996e-07 2023-09-30T17:04:10.531 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.531 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.531 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.531 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.121123+0000", 2023-09-30T17:04:10.531 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7921e-05 2023-09-30T17:04:10.531 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.531 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.531 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.531 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.121132+0000", 2023-09-30T17:04:10.531 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.901e-06 2023-09-30T17:04:10.531 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.532 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.532 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.532 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.121139+0000", 2023-09-30T17:04:10.532 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1919999999999999e-06 2023-09-30T17:04:10.532 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.532 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.532 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.532 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.532 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.532 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109578 4.36 4:6fa85f86:::100000001f8.00000013:head [write 749568~4096 in=4096b,write 970752~4096 in=4096b,write 1007616~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.532 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.650465+0000", 2023-09-30T17:04:10.532 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.46590947399999999, 2023-09-30T17:04:10.533 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.47257522699999999, 2023-09-30T17:04:10.533 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.533 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:10.533 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.533 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.533 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.533 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109578 2023-09-30T17:04:10.533 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.533 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.533 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.533 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.533 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.650465+0000", 2023-09-30T17:04:10.534 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.534 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.534 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.534 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.534 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.650465+0000", 2023-09-30T17:04:10.534 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.534 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.534 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.534 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.534 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.654163+0000", 2023-09-30T17:04:10.534 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00369798 2023-09-30T17:04:10.535 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.535 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.535 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.535 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.654176+0000", 2023-09-30T17:04:10.535 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2765000000000001e-05 2023-09-30T17:04:10.535 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.535 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.535 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.535 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.654187+0000", 2023-09-30T17:04:10.535 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.078e-05 2023-09-30T17:04:10.535 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.535 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.536 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.536 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.654192+0000", 2023-09-30T17:04:10.536 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8880000000000002e-06 2023-09-30T17:04:10.536 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.536 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.536 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.536 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.045826+0000", 2023-09-30T17:04:10.536 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39163316300000001 2023-09-30T17:04:10.536 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.536 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.536 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.537 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.045900+0000", 2023-09-30T17:04:10.537 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3905000000000005e-05 2023-09-30T17:04:10.537 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.537 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.537 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:10.537 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.046309+0000", 2023-09-30T17:04:10.537 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00040957400000000001 2023-09-30T17:04:10.537 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.537 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.537 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:10.537 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.076789+0000", 2023-09-30T17:04:10.537 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.030479506999999999 2023-09-30T17:04:10.538 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.538 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.538 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.538 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.538 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.538 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109739 4.6 4:616d4c41:::100000001f8.00000034:head [write 471040~4096 in=4096b,write 512000~4096 in=4096b,write 548864~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.538 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.729634+0000", 2023-09-30T17:04:10.538 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.38674049399999999, 2023-09-30T17:04:10.538 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.393529768, 2023-09-30T17:04:10.538 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.538 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:10.539 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.539 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.539 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.539 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109739 2023-09-30T17:04:10.539 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.539 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.539 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.539 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.539 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.729634+0000", 2023-09-30T17:04:10.539 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.539 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.539 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.540 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.540 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.729634+0000", 2023-09-30T17:04:10.540 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.540 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.540 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.540 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.540 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.731164+0000", 2023-09-30T17:04:10.540 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0015297399999999999 2023-09-30T17:04:10.540 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.540 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.540 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.540 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.731180+0000", 2023-09-30T17:04:10.541 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6288000000000001e-05 2023-09-30T17:04:10.541 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.541 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.541 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.541 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.731193+0000", 2023-09-30T17:04:10.541 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3362e-05 2023-09-30T17:04:10.541 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.541 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.541 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.541 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.731201+0000", 2023-09-30T17:04:10.541 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9310000000000008e-06 2023-09-30T17:04:10.541 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.541 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.542 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.542 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.117287+0000", 2023-09-30T17:04:10.542 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.38608599500000002 2023-09-30T17:04:10.542 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.542 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.542 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.542 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.117357+0000", 2023-09-30T17:04:10.542 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9683000000000004e-05 2023-09-30T17:04:10.542 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.542 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.543 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:10.543 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.117526+0000", 2023-09-30T17:04:10.543 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016906399999999999 2023-09-30T17:04:10.543 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.543 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.543 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.543 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.543 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.543 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109843 4.36 4.670445b6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.543 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.850333+0000", 2023-09-30T17:04:10.543 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.26604184800000003, 2023-09-30T17:04:10.543 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.27292645900000001, 2023-09-30T17:04:10.544 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.544 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.544 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.544 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.544 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.544 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109843 2023-09-30T17:04:10.544 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.544 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.544 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.544 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.544 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.850333+0000", 2023-09-30T17:04:10.544 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.545 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.545 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.545 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.545 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.850333+0000", 2023-09-30T17:04:10.545 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.545 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.545 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.545 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.545 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.850333+0000", 2023-09-30T17:04:10.545 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9900000000000001e-07 2023-09-30T17:04:10.545 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.545 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.546 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.546 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.850343+0000", 2023-09-30T17:04:10.546 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0329999999999999e-05 2023-09-30T17:04:10.546 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.546 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.546 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.546 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.850349+0000", 2023-09-30T17:04:10.546 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6450000000000002e-06 2023-09-30T17:04:10.546 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.546 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.546 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.547 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.850354+0000", 2023-09-30T17:04:10.547 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6639999999999997e-06 2023-09-30T17:04:10.547 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.547 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.547 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.547 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.547 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.547 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109924 4.6 4.8232b686 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.547 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.887218+0000", 2023-09-30T17:04:10.547 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.22915674899999999, 2023-09-30T17:04:10.547 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.236105379, 2023-09-30T17:04:10.547 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.548 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.548 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.548 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.548 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.548 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109924 2023-09-30T17:04:10.548 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.548 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.548 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.548 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.548 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.887218+0000", 2023-09-30T17:04:10.548 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.548 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.549 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.549 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.549 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.887218+0000", 2023-09-30T17:04:10.549 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.549 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.549 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.549 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.549 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.891162+0000", 2023-09-30T17:04:10.549 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0039443890000000004 2023-09-30T17:04:10.549 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.549 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.549 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.550 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.891179+0000", 2023-09-30T17:04:10.550 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6858999999999999e-05 2023-09-30T17:04:10.550 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.550 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.550 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.550 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.891192+0000", 2023-09-30T17:04:10.550 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3233e-05 2023-09-30T17:04:10.550 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.550 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.550 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.550 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.891202+0000", 2023-09-30T17:04:10.551 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0010000000000001e-05 2023-09-30T17:04:10.553 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.553 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.553 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.553 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.553 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.553 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110077 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.554 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.956016+0000", 2023-09-30T17:04:10.554 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.16035840900000001, 2023-09-30T17:04:10.554 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.16737486300000001, 2023-09-30T17:04:10.554 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.554 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.554 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.554 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.554 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.554 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110077 2023-09-30T17:04:10.555 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.555 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.555 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.555 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.555 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.956016+0000", 2023-09-30T17:04:10.555 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.555 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.555 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.555 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.555 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.956016+0000", 2023-09-30T17:04:10.556 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.556 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.556 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.556 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.556 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.956017+0000", 2023-09-30T17:04:10.556 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6000000000000004e-07 2023-09-30T17:04:10.556 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.556 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.556 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.556 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.956030+0000", 2023-09-30T17:04:10.557 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3165e-05 2023-09-30T17:04:10.557 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.557 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.557 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.557 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.956038+0000", 2023-09-30T17:04:10.557 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3089999999999996e-06 2023-09-30T17:04:10.557 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.557 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.557 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.557 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.956044+0000", 2023-09-30T17:04:10.557 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2349999999999996e-06 2023-09-30T17:04:10.557 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.557 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.558 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.558 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.558 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.558 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110383 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.558 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.078715+0000", 2023-09-30T17:04:10.558 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.037659858999999997, 2023-09-30T17:04:10.558 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.044740105000000002, 2023-09-30T17:04:10.558 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.558 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.558 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.558 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.559 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.559 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110383 2023-09-30T17:04:10.559 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.559 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.559 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.559 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.559 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.078715+0000", 2023-09-30T17:04:10.559 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.559 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.559 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.559 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.559 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.078715+0000", 2023-09-30T17:04:10.560 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.560 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.560 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.560 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.560 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.078715+0000", 2023-09-30T17:04:10.560 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8299999999999997e-07 2023-09-30T17:04:10.560 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.560 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.560 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.560 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.078730+0000", 2023-09-30T17:04:10.560 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5026e-05 2023-09-30T17:04:10.561 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.561 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.561 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.561 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.078738+0000", 2023-09-30T17:04:10.561 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7079999999999997e-06 2023-09-30T17:04:10.561 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.561 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.561 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.561 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.078744+0000", 2023-09-30T17:04:10.561 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0000000000000002e-06 2023-09-30T17:04:10.561 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.562 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.562 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.562 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.562 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.562 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110483 4.25 4:a76ff001:::100000001f8.0000002b:head [write 131072~4096 in=4096b,write 155648~4096 in=4096b,write 204800~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.562 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.112753+0000", 2023-09-30T17:04:10.562 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0036219799999999999, 2023-09-30T17:04:10.562 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010777939, 2023-09-30T17:04:10.562 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.562 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:10.562 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.563 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.563 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.563 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110483 2023-09-30T17:04:10.563 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.563 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.563 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.563 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.563 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.112753+0000", 2023-09-30T17:04:10.563 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.563 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.563 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.564 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.564 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.112753+0000", 2023-09-30T17:04:10.564 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.564 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.564 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.564 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.564 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.114163+0000", 2023-09-30T17:04:10.564 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001409984 2023-09-30T17:04:10.564 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.564 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.564 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.564 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.114178+0000", 2023-09-30T17:04:10.565 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5298000000000002e-05 2023-09-30T17:04:10.565 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.565 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.565 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.565 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.114189+0000", 2023-09-30T17:04:10.565 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.133e-05 2023-09-30T17:04:10.565 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.565 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.565 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.565 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.114197+0000", 2023-09-30T17:04:10.565 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3390000000000004e-06 2023-09-30T17:04:10.565 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.566 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.566 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.566 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.114257+0000", 2023-09-30T17:04:10.566 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0550999999999997e-05 2023-09-30T17:04:10.566 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.566 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.566 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.566 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.114347+0000", 2023-09-30T17:04:10.566 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.0373999999999999e-05 2023-09-30T17:04:10.566 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.566 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.567 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.567 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.567 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.567 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:110312 4.f e51/17)", 2023-09-30T17:04:10.567 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.121168+0000", 2023-09-30T17:04:10.567 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.9952064, 2023-09-30T17:04:10.567 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0024271060000000001, 2023-09-30T17:04:10.567 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.567 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.567 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.567 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.567 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.568 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.121168+0000", 2023-09-30T17:04:10.568 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.568 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.568 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.568 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.568 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.121168+0000", 2023-09-30T17:04:10.568 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.568 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.568 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.568 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.568 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.121169+0000", 2023-09-30T17:04:10.568 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.77e-07 2023-09-30T17:04:10.569 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.569 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.569 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.569 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.121182+0000", 2023-09-30T17:04:10.569 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3182e-05 2023-09-30T17:04:10.569 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.569 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.569 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.570 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.121191+0000", 2023-09-30T17:04:10.570 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.67e-06 2023-09-30T17:04:10.570 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.570 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.570 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.570 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.121197+0000", 2023-09-30T17:04:10.570 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2790000000000004e-06 2023-09-30T17:04:10.570 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.570 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.570 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.570 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.571 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.571 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109665 4.36 4:6fa85f86:::100000001f8.00000013:head [write 4001792~4096 in=4096b,write 4112384~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.571 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.698434+0000", 2023-09-30T17:04:10.571 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.41794017500000002, 2023-09-30T17:04:10.571 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.42522165200000001, 2023-09-30T17:04:10.571 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.571 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:10.571 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.571 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.571 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.571 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109665 2023-09-30T17:04:10.572 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.572 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.572 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.572 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.572 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.698434+0000", 2023-09-30T17:04:10.572 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.572 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.572 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.572 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.572 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.698434+0000", 2023-09-30T17:04:10.572 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.572 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.573 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.573 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.573 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.702162+0000", 2023-09-30T17:04:10.573 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0037276760000000001 2023-09-30T17:04:10.573 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.573 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.573 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.573 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.702175+0000", 2023-09-30T17:04:10.573 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2909e-05 2023-09-30T17:04:10.573 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.573 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.573 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.573 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.702184+0000", 2023-09-30T17:04:10.574 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5890000000000003e-06 2023-09-30T17:04:10.574 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.574 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.574 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.574 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.702191+0000", 2023-09-30T17:04:10.574 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6240000000000002e-06 2023-09-30T17:04:10.574 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.574 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.574 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.574 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.085951+0000", 2023-09-30T17:04:10.574 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.38375996200000001 2023-09-30T17:04:10.574 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.575 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.575 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.575 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.086029+0000", 2023-09-30T17:04:10.575 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7791000000000001e-05 2023-09-30T17:04:10.575 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.575 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.575 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:10.575 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.086176+0000", 2023-09-30T17:04:10.575 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014744000000000001 2023-09-30T17:04:10.575 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.575 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.575 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:10.576 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.098619+0000", 2023-09-30T17:04:10.576 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.012442814999999999 2023-09-30T17:04:10.576 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.576 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.576 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.576 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.576 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.576 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109986 4.6 4.2d31fac6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.576 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.916217+0000", 2023-09-30T17:04:10.576 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.20015724200000001, 2023-09-30T17:04:10.576 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.207526762, 2023-09-30T17:04:10.577 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.577 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.577 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.577 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.577 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.577 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109986 2023-09-30T17:04:10.577 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.577 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.577 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.577 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.577 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.916217+0000", 2023-09-30T17:04:10.577 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.578 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.578 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.578 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.578 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.916217+0000", 2023-09-30T17:04:10.578 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.578 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.578 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.578 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.578 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.918163+0000", 2023-09-30T17:04:10.578 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0019455620000000001 2023-09-30T17:04:10.578 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.579 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.579 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.579 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.918181+0000", 2023-09-30T17:04:10.579 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7742999999999999e-05 2023-09-30T17:04:10.579 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.579 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.579 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.579 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.918192+0000", 2023-09-30T17:04:10.579 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1388e-05 2023-09-30T17:04:10.579 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.579 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.579 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.580 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.918204+0000", 2023-09-30T17:04:10.580 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1613999999999999e-05 2023-09-30T17:04:10.580 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.580 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.580 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.580 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.580 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.580 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110014 4.6 4.8232b686 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.580 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.929289+0000", 2023-09-30T17:04:10.580 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.187085365, 2023-09-30T17:04:10.580 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.194516884, 2023-09-30T17:04:10.580 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.581 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.581 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.581 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.581 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.581 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110014 2023-09-30T17:04:10.581 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.581 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.581 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.581 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.581 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.929289+0000", 2023-09-30T17:04:10.581 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.581 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.582 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.582 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.582 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.929289+0000", 2023-09-30T17:04:10.582 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.582 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.582 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.582 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.582 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.931164+0000", 2023-09-30T17:04:10.582 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001874398 2023-09-30T17:04:10.582 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.582 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.582 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.583 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.931181+0000", 2023-09-30T17:04:10.583 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7682000000000001e-05 2023-09-30T17:04:10.583 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.583 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.583 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.583 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.931196+0000", 2023-09-30T17:04:10.583 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4379000000000001e-05 2023-09-30T17:04:10.583 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.583 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.583 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.583 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.931203+0000", 2023-09-30T17:04:10.583 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7039999999999994e-06 2023-09-30T17:04:10.584 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.584 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.584 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.584 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.584 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.584 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110305 4.3f 4:fde182c5:::100000001f8.00000039:head [write 135168~4096 in=4096b,write 208896~4096 in=4096b,write 249856~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.584 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.057262+0000", 2023-09-30T17:04:10.584 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.059112073000000001, 2023-09-30T17:04:10.584 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.066613391999999993, 2023-09-30T17:04:10.584 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.584 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:10.585 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.585 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.585 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.585 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110305 2023-09-30T17:04:10.585 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.585 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.585 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.585 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.585 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.057262+0000", 2023-09-30T17:04:10.585 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.585 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.585 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.586 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.586 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.057262+0000", 2023-09-30T17:04:10.586 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.586 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.586 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.586 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.586 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.057263+0000", 2023-09-30T17:04:10.586 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1399999999999997e-07 2023-09-30T17:04:10.586 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.586 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.586 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.587 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.057277+0000", 2023-09-30T17:04:10.587 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4229e-05 2023-09-30T17:04:10.587 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.587 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.587 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.587 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.057285+0000", 2023-09-30T17:04:10.587 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1680000000000004e-06 2023-09-30T17:04:10.587 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.587 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.587 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.587 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.057292+0000", 2023-09-30T17:04:10.588 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1809999999999998e-06 2023-09-30T17:04:10.588 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.588 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.588 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.588 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.093102+0000", 2023-09-30T17:04:10.588 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.035810887999999999 2023-09-30T17:04:10.588 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.588 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.588 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.588 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.093199+0000", 2023-09-30T17:04:10.588 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.6483000000000004e-05 2023-09-30T17:04:10.588 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.588 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.589 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:10.589 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.093334+0000", 2023-09-30T17:04:10.589 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00013482899999999999 2023-09-30T17:04:10.589 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.589 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.589 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:10.589 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.119278+0000", 2023-09-30T17:04:10.589 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.025943797000000001 2023-09-30T17:04:10.589 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.589 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.589 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.589 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.590 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.590 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110350 4.3f 4.a34187bf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.590 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.069267+0000", 2023-09-30T17:04:10.590 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.047107266000000002, 2023-09-30T17:04:10.590 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.054705806000000003, 2023-09-30T17:04:10.590 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.590 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.590 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.590 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.590 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.590 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110350 2023-09-30T17:04:10.591 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.591 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.591 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.591 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.591 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.069267+0000", 2023-09-30T17:04:10.591 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.591 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.591 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.591 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.591 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.069267+0000", 2023-09-30T17:04:10.591 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.592 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.592 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.592 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.592 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.069268+0000", 2023-09-30T17:04:10.592 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2599999999999998e-07 2023-09-30T17:04:10.592 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.592 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.592 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.592 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.069282+0000", 2023-09-30T17:04:10.592 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4575e-05 2023-09-30T17:04:10.592 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.593 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.593 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.593 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.069291+0000", 2023-09-30T17:04:10.593 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5480000000000002e-06 2023-09-30T17:04:10.593 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.593 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.593 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.593 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.069296+0000", 2023-09-30T17:04:10.593 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2399999999999998e-06 2023-09-30T17:04:10.593 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.593 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.593 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.594 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.594 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.594 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110385 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.594 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.078755+0000", 2023-09-30T17:04:10.594 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.037619903000000003, 2023-09-30T17:04:10.594 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.04528099, 2023-09-30T17:04:10.594 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.594 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.594 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.594 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.594 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.595 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110385 2023-09-30T17:04:10.595 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.595 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.595 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.595 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.595 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.078755+0000", 2023-09-30T17:04:10.595 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.595 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.595 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.595 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.595 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.078755+0000", 2023-09-30T17:04:10.595 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.596 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.596 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.596 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.596 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.078755+0000", 2023-09-30T17:04:10.596 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9699999999999996e-07 2023-09-30T17:04:10.596 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.596 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.596 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.596 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.078771+0000", 2023-09-30T17:04:10.596 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6104999999999999e-05 2023-09-30T17:04:10.596 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.597 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.597 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.597 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.078778+0000", 2023-09-30T17:04:10.597 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9580000000000001e-06 2023-09-30T17:04:10.597 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.597 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.597 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.597 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.078785+0000", 2023-09-30T17:04:10.597 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9820000000000002e-06 2023-09-30T17:04:10.597 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.597 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.597 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.598 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.598 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.598 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:110316 4.f e51/17)", 2023-09-30T17:04:10.598 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.122108+0000", 2023-09-30T17:04:10.598 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.9942665, 2023-09-30T17:04:10.598 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0019797700000000001, 2023-09-30T17:04:10.598 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.598 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.598 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.598 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.598 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.598 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122108+0000", 2023-09-30T17:04:10.599 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.599 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.599 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.599 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.599 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122108+0000", 2023-09-30T17:04:10.599 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.599 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.599 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.599 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.599 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122109+0000", 2023-09-30T17:04:10.599 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.75e-07 2023-09-30T17:04:10.600 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.600 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.600 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.600 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122132+0000", 2023-09-30T17:04:10.600 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.3217000000000001e-05 2023-09-30T17:04:10.600 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.600 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.600 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.600 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122144+0000", 2023-09-30T17:04:10.600 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1899000000000001e-05 2023-09-30T17:04:10.600 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.600 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.601 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.601 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122153+0000", 2023-09-30T17:04:10.601 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8359999999999998e-06 2023-09-30T17:04:10.601 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.601 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.601 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.601 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.601 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.601 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109602 4.6 4:616d4c41:::100000001f8.00000034:head [write 3518464~4096 in=4096b,write 3551232~4096 in=4096b,write 3563520~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.601 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.678286+0000", 2023-09-30T17:04:10.601 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.43808858099999998, 2023-09-30T17:04:10.602 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.44583469799999997, 2023-09-30T17:04:10.602 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.602 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:10.602 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.602 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.602 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.602 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109602 2023-09-30T17:04:10.602 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.602 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.602 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.602 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.603 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.678286+0000", 2023-09-30T17:04:10.603 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.603 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.603 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.603 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.603 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.678286+0000", 2023-09-30T17:04:10.603 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.603 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.603 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.603 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.603 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.678287+0000", 2023-09-30T17:04:10.603 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2399999999999998e-07 2023-09-30T17:04:10.604 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.604 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.604 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.604 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.678300+0000", 2023-09-30T17:04:10.604 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.324e-05 2023-09-30T17:04:10.604 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.604 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.604 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.604 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.678307+0000", 2023-09-30T17:04:10.604 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6499999999999996e-06 2023-09-30T17:04:10.604 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.604 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.605 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.605 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.678319+0000", 2023-09-30T17:04:10.605 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1299e-05 2023-09-30T17:04:10.605 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.605 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.605 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.605 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.061263+0000", 2023-09-30T17:04:10.605 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.382943743 2023-09-30T17:04:10.605 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.605 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.605 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.605 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.061340+0000", 2023-09-30T17:04:10.606 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7254000000000003e-05 2023-09-30T17:04:10.606 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.606 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.606 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:10.606 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.061491+0000", 2023-09-30T17:04:10.606 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015150799999999999 2023-09-30T17:04:10.606 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.606 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.606 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:10.606 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.077440+0000", 2023-09-30T17:04:10.606 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.015948721999999999 2023-09-30T17:04:10.607 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.607 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.607 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.607 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.607 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.607 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109636 4.36 4:6da220e6:::100000001f8.0000003f:head [write 2842624~4096 in=4096b,write 2887680~4096 in=4096b,write 3014656~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.607 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.690323+0000", 2023-09-30T17:04:10.607 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.42605110600000001, 2023-09-30T17:04:10.607 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.43385936899999999, 2023-09-30T17:04:10.607 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.607 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:10.607 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.608 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.608 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.608 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109636 2023-09-30T17:04:10.608 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.608 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.608 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.608 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.608 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.690323+0000", 2023-09-30T17:04:10.608 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.608 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.608 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.608 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.609 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.690323+0000", 2023-09-30T17:04:10.609 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.609 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.609 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.609 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.609 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.690324+0000", 2023-09-30T17:04:10.609 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5199999999999996e-07 2023-09-30T17:04:10.609 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.609 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.609 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.609 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.690342+0000", 2023-09-30T17:04:10.609 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7566000000000001e-05 2023-09-30T17:04:10.610 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.610 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.610 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.610 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.690352+0000", 2023-09-30T17:04:10.610 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0380999999999999e-05 2023-09-30T17:04:10.610 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.610 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.610 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.610 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.690359+0000", 2023-09-30T17:04:10.610 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7580000000000003e-06 2023-09-30T17:04:10.610 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.610 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.611 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.611 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.067820+0000", 2023-09-30T17:04:10.611 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.377460719 2023-09-30T17:04:10.611 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.611 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.611 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.611 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.067905+0000", 2023-09-30T17:04:10.611 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4994000000000007e-05 2023-09-30T17:04:10.611 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.611 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.611 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:10.611 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.068034+0000", 2023-09-30T17:04:10.612 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000129617 2023-09-30T17:04:10.612 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.612 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.612 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:10.612 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.090677+0000", 2023-09-30T17:04:10.612 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.022643309 2023-09-30T17:04:10.612 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.612 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.612 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.612 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.612 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.612 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109697 4.6 4:63e80496:::100000001f8.0000001e:head [write 1617920~4096 in=4096b,write 1830912~4096 in=4096b,write 1875968~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.613 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.711270+0000", 2023-09-30T17:04:10.613 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.405104301, 2023-09-30T17:04:10.613 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.41296361599999998, 2023-09-30T17:04:10.613 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.613 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:10.613 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.613 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.613 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.613 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109697 2023-09-30T17:04:10.613 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.613 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.613 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.613 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.614 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.711270+0000", 2023-09-30T17:04:10.614 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.614 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.614 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.614 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.614 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.711270+0000", 2023-09-30T17:04:10.614 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.614 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.614 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.614 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.614 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.711271+0000", 2023-09-30T17:04:10.614 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4400000000000001e-07 2023-09-30T17:04:10.615 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.615 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.615 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.615 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.711284+0000", 2023-09-30T17:04:10.615 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.342e-05 2023-09-30T17:04:10.615 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.615 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.615 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.615 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.711296+0000", 2023-09-30T17:04:10.615 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2309e-05 2023-09-30T17:04:10.615 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.615 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.616 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.616 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.711303+0000", 2023-09-30T17:04:10.616 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9789999999999996e-06 2023-09-30T17:04:10.616 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.616 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.616 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.616 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.098461+0000", 2023-09-30T17:04:10.616 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.38715737300000003 2023-09-30T17:04:10.616 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.616 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.616 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.616 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.098551+0000", 2023-09-30T17:04:10.616 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.0610000000000002e-05 2023-09-30T17:04:10.617 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.617 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.617 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:10.617 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.098728+0000", 2023-09-30T17:04:10.617 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017616499999999999 2023-09-30T17:04:10.617 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.617 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.617 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:10.617 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.123046+0000", 2023-09-30T17:04:10.617 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024318095000000001 2023-09-30T17:04:10.617 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.617 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.618 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.618 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.618 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.618 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110260 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.618 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.034385+0000", 2023-09-30T17:04:10.618 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.081989731999999996, 2023-09-30T17:04:10.618 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.089902770000000007, 2023-09-30T17:04:10.618 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.618 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.618 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.618 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.619 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.619 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110260 2023-09-30T17:04:10.619 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.619 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.619 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.619 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.619 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.034385+0000", 2023-09-30T17:04:10.619 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.619 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.619 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.620 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.620 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.034385+0000", 2023-09-30T17:04:10.620 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.620 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.620 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.620 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.620 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.034385+0000", 2023-09-30T17:04:10.620 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9100000000000004e-07 2023-09-30T17:04:10.620 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.620 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.620 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.620 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.034399+0000", 2023-09-30T17:04:10.621 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3638999999999999e-05 2023-09-30T17:04:10.621 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.621 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.621 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.621 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.034407+0000", 2023-09-30T17:04:10.621 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4880000000000001e-06 2023-09-30T17:04:10.621 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.621 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.621 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.621 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.034412+0000", 2023-09-30T17:04:10.621 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3850000000000001e-06 2023-09-30T17:04:10.621 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.622 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.622 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.622 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.622 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.622 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110507 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.622 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.120621+0000", 2023-09-30T17:04:10.622 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.9957538, 2023-09-30T17:04:10.622 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.003701855, 2023-09-30T17:04:10.622 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.622 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.622 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.622 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.623 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.623 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110507 2023-09-30T17:04:10.623 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.623 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.623 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.623 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.623 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.120621+0000", 2023-09-30T17:04:10.623 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.623 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.623 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.623 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.623 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.120621+0000", 2023-09-30T17:04:10.624 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.624 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.624 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.624 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.624 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122389+0000", 2023-09-30T17:04:10.624 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0017686259999999999 2023-09-30T17:04:10.624 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.624 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.624 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.624 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122419+0000", 2023-09-30T17:04:10.624 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.9748999999999999e-05 2023-09-30T17:04:10.624 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.625 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.625 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.625 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122430+0000", 2023-09-30T17:04:10.625 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0716e-05 2023-09-30T17:04:10.625 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.625 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.625 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.625 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122439+0000", 2023-09-30T17:04:10.625 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1800000000000002e-06 2023-09-30T17:04:10.625 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.625 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.625 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.626 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.626 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.626 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109582 4.6 4:616d4c41:::100000001f8.00000034:head [write 32768~4096 in=4096b,write 90112~4096 in=4096b,write 180224~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.626 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.654253+0000", 2023-09-30T17:04:10.626 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.46212122900000002, 2023-09-30T17:04:10.626 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.47010478, 2023-09-30T17:04:10.626 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.626 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:10.626 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.627 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.627 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.627 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109582 2023-09-30T17:04:10.627 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.627 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.627 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.627 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.627 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.654253+0000", 2023-09-30T17:04:10.627 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.627 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.627 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.627 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.627 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.654253+0000", 2023-09-30T17:04:10.628 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.628 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.628 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.628 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.628 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658162+0000", 2023-09-30T17:04:10.628 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0039091320000000001 2023-09-30T17:04:10.628 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.628 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.628 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.628 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658178+0000", 2023-09-30T17:04:10.628 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5719e-05 2023-09-30T17:04:10.628 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.629 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.629 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.629 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658189+0000", 2023-09-30T17:04:10.629 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1043000000000001e-05 2023-09-30T17:04:10.629 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.629 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.629 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.629 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658198+0000", 2023-09-30T17:04:10.629 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4090000000000003e-06 2023-09-30T17:04:10.629 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.629 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.629 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.630 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051307+0000", 2023-09-30T17:04:10.630 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39310928899999997 2023-09-30T17:04:10.630 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.630 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.630 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.630 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051392+0000", 2023-09-30T17:04:10.630 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4850000000000002e-05 2023-09-30T17:04:10.630 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.630 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.630 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:10.630 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051575+0000", 2023-09-30T17:04:10.631 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00018296999999999999 2023-09-30T17:04:10.631 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.631 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.631 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:10.631 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.076797+0000", 2023-09-30T17:04:10.631 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.025222616999999999 2023-09-30T17:04:10.631 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.631 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.631 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.631 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.631 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.632 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109743 4.36 4:6da220e6:::100000001f8.0000003f:head [write 73728~4096 in=4096b,write 90112~4096 in=4096b,write 475136~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.632 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.731305+0000", 2023-09-30T17:04:10.632 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.38506933799999998, 2023-09-30T17:04:10.632 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39310461800000002, 2023-09-30T17:04:10.632 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.632 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:10.632 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.632 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.632 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.632 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109743 2023-09-30T17:04:10.632 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.633 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.633 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.633 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.633 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.731305+0000", 2023-09-30T17:04:10.633 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.633 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.633 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.633 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.633 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.731305+0000", 2023-09-30T17:04:10.633 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.633 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.633 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.634 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.634 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.731306+0000", 2023-09-30T17:04:10.634 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4799999999999998e-07 2023-09-30T17:04:10.634 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.634 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.634 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.634 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.731319+0000", 2023-09-30T17:04:10.634 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2982999999999999e-05 2023-09-30T17:04:10.634 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.634 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.635 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.635 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.731327+0000", 2023-09-30T17:04:10.635 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6799999999999993e-06 2023-09-30T17:04:10.635 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.635 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.635 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.635 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.731333+0000", 2023-09-30T17:04:10.635 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.6490000000000002e-06 2023-09-30T17:04:10.635 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.635 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.635 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.635 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.121729+0000", 2023-09-30T17:04:10.636 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39039577199999997 2023-09-30T17:04:10.636 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.636 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.636 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.636 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.121811+0000", 2023-09-30T17:04:10.636 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1966999999999996e-05 2023-09-30T17:04:10.636 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.636 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.636 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:10.636 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.121982+0000", 2023-09-30T17:04:10.636 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017118499999999999 2023-09-30T17:04:10.637 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.637 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.637 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.637 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.637 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.637 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109953 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.637 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.905224+0000", 2023-09-30T17:04:10.637 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.21115070499999999, 2023-09-30T17:04:10.637 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.219232229, 2023-09-30T17:04:10.637 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.637 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.637 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.638 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.638 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.638 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109953 2023-09-30T17:04:10.638 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.638 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.638 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.638 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.638 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.905224+0000", 2023-09-30T17:04:10.638 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.638 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.638 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.639 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.639 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.905224+0000", 2023-09-30T17:04:10.639 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.639 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.639 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.639 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.639 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.909164+0000", 2023-09-30T17:04:10.639 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0039403199999999998 2023-09-30T17:04:10.639 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.639 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.639 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.639 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.909186+0000", 2023-09-30T17:04:10.640 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1713999999999999e-05 2023-09-30T17:04:10.640 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.640 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.640 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.640 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.909207+0000", 2023-09-30T17:04:10.640 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1259000000000001e-05 2023-09-30T17:04:10.640 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.640 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.640 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.640 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.909215+0000", 2023-09-30T17:04:10.640 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8499999999999994e-06 2023-09-30T17:04:10.640 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.641 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.641 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.641 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.641 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.641 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110387 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.641 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.079260+0000", 2023-09-30T17:04:10.641 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.03711441, 2023-09-30T17:04:10.641 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.045227941000000001, 2023-09-30T17:04:10.641 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.641 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.641 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.641 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.642 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.642 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110387 2023-09-30T17:04:10.642 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.642 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.642 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.642 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.642 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.079260+0000", 2023-09-30T17:04:10.642 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.642 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.642 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.642 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.643 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.079260+0000", 2023-09-30T17:04:10.643 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.643 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.643 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.643 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.643 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.079261+0000", 2023-09-30T17:04:10.643 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8100000000000002e-07 2023-09-30T17:04:10.643 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.643 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.643 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.643 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.079277+0000", 2023-09-30T17:04:10.643 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5937999999999999e-05 2023-09-30T17:04:10.644 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.644 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.644 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.644 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.079292+0000", 2023-09-30T17:04:10.644 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5073e-05 2023-09-30T17:04:10.644 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.644 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.644 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.644 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.079299+0000", 2023-09-30T17:04:10.644 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1969999999999999e-06 2023-09-30T17:04:10.644 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.644 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.644 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.645 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.645 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.645 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:110326 4.2f e51/17)", 2023-09-30T17:04:10.645 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.122427+0000", 2023-09-30T17:04:10.645 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.9939475, 2023-09-30T17:04:10.645 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0020946889999999998, 2023-09-30T17:04:10.645 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.645 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.645 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.645 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.645 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.645 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122427+0000", 2023-09-30T17:04:10.646 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.646 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.646 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.646 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.646 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122427+0000", 2023-09-30T17:04:10.646 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.646 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.646 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.646 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.646 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122427+0000", 2023-09-30T17:04:10.646 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5400000000000001e-07 2023-09-30T17:04:10.646 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.647 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.647 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.647 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122466+0000", 2023-09-30T17:04:10.647 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.841e-05 2023-09-30T17:04:10.647 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.647 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.647 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.647 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122476+0000", 2023-09-30T17:04:10.647 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7450000000000007e-06 2023-09-30T17:04:10.647 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.647 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.647 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.647 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122482+0000", 2023-09-30T17:04:10.648 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.421e-06 2023-09-30T17:04:10.648 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.648 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.648 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.648 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.648 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.648 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109583 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 1945600~8192 in=8192b,write 2285568~4096 in=4096b,write 2301952~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.648 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.658212+0000", 2023-09-30T17:04:10.648 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.45816255500000003, 2023-09-30T17:04:10.648 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.46633944599999999, 2023-09-30T17:04:10.648 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.648 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:10.649 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.649 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.649 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.649 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109583 2023-09-30T17:04:10.649 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.649 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.649 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.649 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.649 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658212+0000", 2023-09-30T17:04:10.649 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.649 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.649 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.649 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.650 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658212+0000", 2023-09-30T17:04:10.650 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.650 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.650 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.650 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.650 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658213+0000", 2023-09-30T17:04:10.650 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6000000000000004e-07 2023-09-30T17:04:10.650 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.650 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.650 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.650 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658225+0000", 2023-09-30T17:04:10.651 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2887e-05 2023-09-30T17:04:10.651 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.651 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.651 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.651 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658233+0000", 2023-09-30T17:04:10.651 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2620000000000001e-06 2023-09-30T17:04:10.651 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.651 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.651 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.651 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658239+0000", 2023-09-30T17:04:10.651 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4300000000000003e-06 2023-09-30T17:04:10.651 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.651 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.652 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.652 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.055877+0000", 2023-09-30T17:04:10.652 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39763770799999998 2023-09-30T17:04:10.652 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.652 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.652 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.652 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.055965+0000", 2023-09-30T17:04:10.652 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8125000000000001e-05 2023-09-30T17:04:10.652 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.652 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.652 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:10.653 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.056131+0000", 2023-09-30T17:04:10.653 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000165971 2023-09-30T17:04:10.653 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.653 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.653 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:10.653 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.077434+0000", 2023-09-30T17:04:10.653 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.021303441999999999 2023-09-30T17:04:10.653 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.653 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.653 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.653 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.653 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.653 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109793 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.654 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.807215+0000", 2023-09-30T17:04:10.654 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.30915968199999999, 2023-09-30T17:04:10.654 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.31738133400000001, 2023-09-30T17:04:10.654 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.654 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.654 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.654 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.654 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.654 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109793 2023-09-30T17:04:10.654 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.654 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.655 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.655 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.655 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.807215+0000", 2023-09-30T17:04:10.655 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.655 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.655 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.655 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.655 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.807215+0000", 2023-09-30T17:04:10.655 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.655 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.655 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.655 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.656 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.821162+0000", 2023-09-30T17:04:10.656 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.013947449000000001 2023-09-30T17:04:10.656 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.656 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.656 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.656 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.821176+0000", 2023-09-30T17:04:10.656 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3828999999999999e-05 2023-09-30T17:04:10.656 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.656 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.656 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.656 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.821187+0000", 2023-09-30T17:04:10.656 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1192999999999999e-05 2023-09-30T17:04:10.657 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.657 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.657 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.657 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.821195+0000", 2023-09-30T17:04:10.657 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1000000000000004e-06 2023-09-30T17:04:10.657 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.657 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.657 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.657 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.657 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.657 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109894 4.36 4.670445b6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.658 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.877249+0000", 2023-09-30T17:04:10.658 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.239125437, 2023-09-30T17:04:10.658 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.247376925, 2023-09-30T17:04:10.658 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.658 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.658 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.658 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.658 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.658 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109894 2023-09-30T17:04:10.658 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.658 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.658 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.659 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.659 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.877249+0000", 2023-09-30T17:04:10.659 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.659 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.659 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.659 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.659 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.877249+0000", 2023-09-30T17:04:10.659 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.659 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.659 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.659 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.659 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.877250+0000", 2023-09-30T17:04:10.660 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4799999999999998e-07 2023-09-30T17:04:10.660 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.660 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.660 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.660 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.877263+0000", 2023-09-30T17:04:10.660 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3108999999999999e-05 2023-09-30T17:04:10.660 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.660 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.660 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.660 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.877269+0000", 2023-09-30T17:04:10.660 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7000000000000002e-06 2023-09-30T17:04:10.660 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.661 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.661 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.661 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.877277+0000", 2023-09-30T17:04:10.661 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1679999999999998e-06 2023-09-30T17:04:10.661 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.661 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.661 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.661 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.661 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.661 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109932 4.6 4.8232b686 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.661 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.891345+0000", 2023-09-30T17:04:10.661 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.22503003999999999, 2023-09-30T17:04:10.662 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23331286100000001, 2023-09-30T17:04:10.662 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.662 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.662 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.662 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.662 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.662 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109932 2023-09-30T17:04:10.662 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.662 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.662 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.662 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.662 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.891345+0000", 2023-09-30T17:04:10.663 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.663 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.663 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.663 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.663 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.891345+0000", 2023-09-30T17:04:10.663 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.663 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.663 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.663 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.663 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.891345+0000", 2023-09-30T17:04:10.663 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2e-07 2023-09-30T17:04:10.663 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.664 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.664 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.664 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.891365+0000", 2023-09-30T17:04:10.664 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.0191e-05 2023-09-30T17:04:10.664 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.664 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.664 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.664 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.891373+0000", 2023-09-30T17:04:10.664 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9880000000000004e-06 2023-09-30T17:04:10.664 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.665 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.665 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.665 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.891379+0000", 2023-09-30T17:04:10.665 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8359999999999997e-06 2023-09-30T17:04:10.665 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.665 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.665 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.665 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.665 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.665 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110080 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.665 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.957231+0000", 2023-09-30T17:04:10.665 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.15914308299999999, 2023-09-30T17:04:10.666 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.167455621, 2023-09-30T17:04:10.666 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.666 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.666 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.666 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.666 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.666 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110080 2023-09-30T17:04:10.666 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.666 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.666 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.666 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.666 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.957231+0000", 2023-09-30T17:04:10.667 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.667 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.667 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.667 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.667 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.957231+0000", 2023-09-30T17:04:10.667 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.667 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.667 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.667 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.667 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.957232+0000", 2023-09-30T17:04:10.667 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0500000000000003e-07 2023-09-30T17:04:10.668 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.668 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.668 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.668 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.957248+0000", 2023-09-30T17:04:10.668 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5730999999999999e-05 2023-09-30T17:04:10.668 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.668 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.668 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.668 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.957256+0000", 2023-09-30T17:04:10.668 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7090000000000002e-06 2023-09-30T17:04:10.668 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.669 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.669 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.669 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.957262+0000", 2023-09-30T17:04:10.669 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1480000000000003e-06 2023-09-30T17:04:10.669 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.669 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.669 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.669 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.669 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.669 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:110255 4.2f e51/17 4:f59f865b:::100000001f8.00000007:head v 51'1656, mlcod=51'1651)", 2023-09-30T17:04:10.669 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.105062+0000", 2023-09-30T17:04:10.669 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.011312107, 2023-09-30T17:04:10.670 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.019657115999999999, 2023-09-30T17:04:10.670 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.670 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:10.670 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.670 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.670 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.670 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.105062+0000", 2023-09-30T17:04:10.670 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.670 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.670 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.670 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.670 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.105062+0000", 2023-09-30T17:04:10.671 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.671 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.671 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.671 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.671 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.105063+0000", 2023-09-30T17:04:10.671 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.67e-07 2023-09-30T17:04:10.671 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.671 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.671 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.671 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.105070+0000", 2023-09-30T17:04:10.671 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5120000000000002e-06 2023-09-30T17:04:10.672 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.672 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.672 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.672 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.105074+0000", 2023-09-30T17:04:10.672 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5990000000000002e-06 2023-09-30T17:04:10.672 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.672 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.672 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.672 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.105078+0000", 2023-09-30T17:04:10.672 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2189999999999998e-06 2023-09-30T17:04:10.672 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.673 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.673 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.673 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.107243+0000", 2023-09-30T17:04:10.673 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00216527 2023-09-30T17:04:10.673 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.673 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.673 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.673 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.107263+0000", 2023-09-30T17:04:10.673 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9406999999999999e-05 2023-09-30T17:04:10.673 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.673 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.673 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.674 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.674 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.674 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:111486 4.12 e51/17 4:48ab9bde:::100000001f8.00000015:head v 51'3482, mlcod=51'3480)", 2023-09-30T17:04:10.674 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.114697+0000", 2023-09-30T17:04:10.674 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.001677216, 2023-09-30T17:04:10.674 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010056361999999999, 2023-09-30T17:04:10.674 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.674 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:10.674 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.675 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.675 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.675 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.114697+0000", 2023-09-30T17:04:10.675 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.675 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.675 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.675 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.675 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.114697+0000", 2023-09-30T17:04:10.675 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.675 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.676 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.676 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.676 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.114698+0000", 2023-09-30T17:04:10.676 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8e-07 2023-09-30T17:04:10.676 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.676 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.676 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.676 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.114713+0000", 2023-09-30T17:04:10.676 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5917e-05 2023-09-30T17:04:10.676 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.677 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.677 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.677 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.114720+0000", 2023-09-30T17:04:10.677 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1449999999999996e-06 2023-09-30T17:04:10.677 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.677 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.677 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.677 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.114724+0000", 2023-09-30T17:04:10.677 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4739999999999999e-06 2023-09-30T17:04:10.677 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.677 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.677 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.678 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.114762+0000", 2023-09-30T17:04:10.678 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8154000000000001e-05 2023-09-30T17:04:10.678 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.678 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.678 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.678 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.114775+0000", 2023-09-30T17:04:10.678 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2456000000000001e-05 2023-09-30T17:04:10.678 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.678 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.678 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.678 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.679 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.679 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110509 4.1c 4:39b842ef:::100000001f8.00000029:head [write 3043328~4096 in=4096b,write 3125248~4096 in=4096b,write 3153920~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.679 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.122449+0000", 2023-09-30T17:04:10.679 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.9939256, 2023-09-30T17:04:10.679 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0023430399999999998, 2023-09-30T17:04:10.679 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.679 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:10.679 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.679 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.679 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.679 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110509 2023-09-30T17:04:10.679 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.680 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.680 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.680 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.680 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122449+0000", 2023-09-30T17:04:10.680 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.680 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.680 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.680 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.680 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122449+0000", 2023-09-30T17:04:10.680 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.680 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.680 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.681 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.681 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122449+0000", 2023-09-30T17:04:10.681 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3000000000000001e-07 2023-09-30T17:04:10.681 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.681 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.681 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.681 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122460+0000", 2023-09-30T17:04:10.681 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0574000000000001e-05 2023-09-30T17:04:10.681 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.681 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.681 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.681 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122476+0000", 2023-09-30T17:04:10.682 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.554e-05 2023-09-30T17:04:10.682 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.682 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.682 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.682 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122485+0000", 2023-09-30T17:04:10.682 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.0710000000000001e-06 2023-09-30T17:04:10.682 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.682 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.682 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.682 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.123705+0000", 2023-09-30T17:04:10.682 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0012204819999999999 2023-09-30T17:04:10.682 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.683 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.683 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.683 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.123784+0000", 2023-09-30T17:04:10.683 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8685999999999998e-05 2023-09-30T17:04:10.683 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.683 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.683 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:10.683 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.123885+0000", 2023-09-30T17:04:10.683 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000101068 2023-09-30T17:04:10.683 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.683 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.683 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.684 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.684 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.684 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110157 4.6 4.8232b686 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.684 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.986532+0000", 2023-09-30T17:04:10.684 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.129842601, 2023-09-30T17:04:10.684 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.13830147500000001, 2023-09-30T17:04:10.684 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.684 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.684 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.684 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.684 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.684 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110157 2023-09-30T17:04:10.685 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.685 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.685 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.685 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.685 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.986532+0000", 2023-09-30T17:04:10.685 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.685 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.685 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.685 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.685 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.986532+0000", 2023-09-30T17:04:10.685 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.685 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.686 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.686 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.686 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.988162+0000", 2023-09-30T17:04:10.686 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0016302269999999999 2023-09-30T17:04:10.686 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.686 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.686 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.686 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.988182+0000", 2023-09-30T17:04:10.686 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9755999999999999e-05 2023-09-30T17:04:10.686 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.687 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.687 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.687 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.988193+0000", 2023-09-30T17:04:10.687 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1374e-05 2023-09-30T17:04:10.687 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.687 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.687 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.687 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.988201+0000", 2023-09-30T17:04:10.687 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.14e-06 2023-09-30T17:04:10.687 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.687 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.687 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.688 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.688 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.688 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110261 4.6 4.2d31fac6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.688 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.034420+0000", 2023-09-30T17:04:10.688 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.081954700000000005, 2023-09-30T17:04:10.688 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.09064287, 2023-09-30T17:04:10.688 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.688 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.688 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.688 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.688 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.688 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110261 2023-09-30T17:04:10.689 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.689 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.689 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.689 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.689 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.034420+0000", 2023-09-30T17:04:10.689 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.689 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.689 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.689 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.689 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.034420+0000", 2023-09-30T17:04:10.689 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.689 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.689 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.690 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.690 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.036993+0000", 2023-09-30T17:04:10.690 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0025726830000000001 2023-09-30T17:04:10.690 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.690 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.690 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.690 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.037006+0000", 2023-09-30T17:04:10.690 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3726e-05 2023-09-30T17:04:10.690 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.690 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.690 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.691 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.037014+0000", 2023-09-30T17:04:10.691 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7400000000000004e-06 2023-09-30T17:04:10.691 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.691 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.691 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.691 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.037019+0000", 2023-09-30T17:04:10.691 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2129999999999999e-06 2023-09-30T17:04:10.691 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.691 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.691 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.691 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.691 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.691 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110282 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.692 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.045418+0000", 2023-09-30T17:04:10.692 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.070956467999999995, 2023-09-30T17:04:10.692 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.079676492000000002, 2023-09-30T17:04:10.692 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.692 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.692 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.692 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.692 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.692 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110282 2023-09-30T17:04:10.692 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.692 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.692 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.693 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.693 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.045418+0000", 2023-09-30T17:04:10.693 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.693 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.693 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.693 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.693 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.045418+0000", 2023-09-30T17:04:10.693 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.693 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.693 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.693 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.693 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051066+0000", 2023-09-30T17:04:10.694 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0056478479999999996 2023-09-30T17:04:10.694 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.694 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.694 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.694 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051083+0000", 2023-09-30T17:04:10.694 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6765e-05 2023-09-30T17:04:10.694 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.694 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.694 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.694 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051093+0000", 2023-09-30T17:04:10.694 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0766e-05 2023-09-30T17:04:10.694 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.695 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.695 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.695 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051103+0000", 2023-09-30T17:04:10.695 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3880000000000006e-06 2023-09-30T17:04:10.695 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.695 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.695 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.695 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.695 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.695 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110317 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.695 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.059207+0000", 2023-09-30T17:04:10.695 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.057167358000000001, 2023-09-30T17:04:10.696 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.065929237000000002, 2023-09-30T17:04:10.696 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.696 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.696 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.696 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.696 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.696 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110317 2023-09-30T17:04:10.696 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.696 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.696 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.696 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.697 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.059207+0000", 2023-09-30T17:04:10.697 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.697 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.697 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.697 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.697 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.059207+0000", 2023-09-30T17:04:10.697 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.697 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.697 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.697 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.697 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.059208+0000", 2023-09-30T17:04:10.697 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9200000000000002e-07 2023-09-30T17:04:10.697 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.698 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.698 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.698 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.059216+0000", 2023-09-30T17:04:10.698 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9699999999999999e-06 2023-09-30T17:04:10.698 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.698 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.698 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.698 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.059220+0000", 2023-09-30T17:04:10.698 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6990000000000002e-06 2023-09-30T17:04:10.698 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.698 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.698 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.699 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.059224+0000", 2023-09-30T17:04:10.699 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.2760000000000001e-06 2023-09-30T17:04:10.699 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.699 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.699 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.699 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.699 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.699 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110391 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.699 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.079363+0000", 2023-09-30T17:04:10.699 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.037011529000000001, 2023-09-30T17:04:10.699 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.045841152000000003, 2023-09-30T17:04:10.699 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.700 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.700 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.700 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.700 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.700 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110391 2023-09-30T17:04:10.700 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.700 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.700 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.700 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.700 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.079363+0000", 2023-09-30T17:04:10.700 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.700 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.701 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.701 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.701 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.079363+0000", 2023-09-30T17:04:10.701 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.701 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.701 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.701 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.701 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.079363+0000", 2023-09-30T17:04:10.701 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9999999999999998e-07 2023-09-30T17:04:10.701 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.701 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.701 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.702 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.079377+0000", 2023-09-30T17:04:10.702 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.359e-05 2023-09-30T17:04:10.702 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.702 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.702 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.702 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.079384+0000", 2023-09-30T17:04:10.702 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7839999999999998e-06 2023-09-30T17:04:10.702 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.702 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.702 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.702 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.079389+0000", 2023-09-30T17:04:10.702 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3890000000000004e-06 2023-09-30T17:04:10.703 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.703 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.703 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.703 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.703 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.703 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:110258 4.37 e51/17 4:ef395e89:::100000001f8.00000020:head v 51'5186, mlcod=51'5182)", 2023-09-30T17:04:10.703 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.105082+0000", 2023-09-30T17:04:10.703 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.01129207, 2023-09-30T17:04:10.703 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.020161122, 2023-09-30T17:04:10.703 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.703 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:10.703 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.704 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.704 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.704 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.105082+0000", 2023-09-30T17:04:10.704 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.704 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.704 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.704 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.704 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.105082+0000", 2023-09-30T17:04:10.704 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.704 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.704 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.705 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.705 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.105083+0000", 2023-09-30T17:04:10.705 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1899999999999999e-07 2023-09-30T17:04:10.705 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.705 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.705 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.705 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.105090+0000", 2023-09-30T17:04:10.705 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6320000000000008e-06 2023-09-30T17:04:10.705 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.705 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.705 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.705 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.105094+0000", 2023-09-30T17:04:10.706 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5130000000000001e-06 2023-09-30T17:04:10.706 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.706 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.706 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.706 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.105098+0000", 2023-09-30T17:04:10.706 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8179999999999997e-06 2023-09-30T17:04:10.706 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.706 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.706 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.706 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.114419+0000", 2023-09-30T17:04:10.706 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0093217879999999993 2023-09-30T17:04:10.706 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.707 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.707 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.707 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.114446+0000", 2023-09-30T17:04:10.707 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.6557999999999999e-05 2023-09-30T17:04:10.707 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.707 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.707 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.707 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.707 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.707 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:110273 4.f e51/17)", 2023-09-30T17:04:10.707 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.114737+0000", 2023-09-30T17:04:10.707 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.001637671, 2023-09-30T17:04:10.708 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010550608, 2023-09-30T17:04:10.708 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.708 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.708 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.708 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.708 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.708 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.114737+0000", 2023-09-30T17:04:10.708 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.708 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.708 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.708 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.709 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.114737+0000", 2023-09-30T17:04:10.709 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.709 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.709 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.709 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.709 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.114737+0000", 2023-09-30T17:04:10.709 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.3200000000000001e-07 2023-09-30T17:04:10.709 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.709 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.709 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.709 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.114747+0000", 2023-09-30T17:04:10.709 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0139999999999999e-05 2023-09-30T17:04:10.710 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.710 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.710 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.710 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.114753+0000", 2023-09-30T17:04:10.710 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8989999999999998e-06 2023-09-30T17:04:10.710 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.710 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.710 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.710 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.114759+0000", 2023-09-30T17:04:10.710 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.395e-06 2023-09-30T17:04:10.710 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.710 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.711 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.711 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.711 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.711 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110510 4.6 4.2d31fac6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.711 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.122496+0000", 2023-09-30T17:04:10.711 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.9938784, 2023-09-30T17:04:10.711 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0028439810000000002, 2023-09-30T17:04:10.711 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.711 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.711 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.711 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.711 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.712 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110510 2023-09-30T17:04:10.712 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.712 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.712 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.712 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.712 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122496+0000", 2023-09-30T17:04:10.712 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.712 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.712 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.712 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.712 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122496+0000", 2023-09-30T17:04:10.712 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.713 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.713 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.713 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.713 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122497+0000", 2023-09-30T17:04:10.713 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1099999999999995e-07 2023-09-30T17:04:10.713 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.713 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.713 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.713 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122512+0000", 2023-09-30T17:04:10.713 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4503e-05 2023-09-30T17:04:10.713 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.713 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.714 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.714 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122534+0000", 2023-09-30T17:04:10.714 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2739e-05 2023-09-30T17:04:10.714 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.714 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.714 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.714 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122541+0000", 2023-09-30T17:04:10.714 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1690000000000003e-06 2023-09-30T17:04:10.714 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.714 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.714 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.715 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.715 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.715 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109497 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 49152~4096 in=4096b,write 106496~4096 in=4096b,write 163840~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.715 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.624224+0000", 2023-09-30T17:04:10.715 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.49215102599999999, 2023-09-30T17:04:10.715 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.50119807299999997, 2023-09-30T17:04:10.715 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.715 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:10.715 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.715 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.715 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.715 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109497 2023-09-30T17:04:10.716 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.716 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.716 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.716 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.716 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624224+0000", 2023-09-30T17:04:10.716 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.716 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.716 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.716 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.716 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624224+0000", 2023-09-30T17:04:10.716 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.716 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.717 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.717 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.717 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624224+0000", 2023-09-30T17:04:10.717 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9299999999999998e-07 2023-09-30T17:04:10.717 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.717 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.717 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.717 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624238+0000", 2023-09-30T17:04:10.717 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4144999999999999e-05 2023-09-30T17:04:10.717 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.717 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.717 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.718 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624439+0000", 2023-09-30T17:04:10.718 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00020105200000000001 2023-09-30T17:04:10.718 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.718 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.718 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.718 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624447+0000", 2023-09-30T17:04:10.718 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0499999999999992e-06 2023-09-30T17:04:10.718 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.718 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.718 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.718 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.022040+0000", 2023-09-30T17:04:10.718 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39759262099999998 2023-09-30T17:04:10.719 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.719 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.719 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.719 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.022117+0000", 2023-09-30T17:04:10.719 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6834000000000003e-05 2023-09-30T17:04:10.719 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.719 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.719 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:10.719 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.022269+0000", 2023-09-30T17:04:10.719 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015254600000000001 2023-09-30T17:04:10.719 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.720 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.720 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:10.720 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.058505+0000", 2023-09-30T17:04:10.720 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.036235394999999997 2023-09-30T17:04:10.720 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.720 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.720 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.720 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.720 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.720 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109673 4.6 4:63e80496:::100000001f8.0000001e:head [write 1171456~4096 in=4096b,write 1191936~4096 in=4096b,write 1306624~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.720 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.702252+0000", 2023-09-30T17:04:10.720 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.41412220900000002, 2023-09-30T17:04:10.721 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.42327377500000002, 2023-09-30T17:04:10.721 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.721 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:10.721 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.721 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.721 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.721 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109673 2023-09-30T17:04:10.721 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.721 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.721 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.721 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.721 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.702252+0000", 2023-09-30T17:04:10.722 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.722 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.722 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.722 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.722 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.702252+0000", 2023-09-30T17:04:10.722 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.722 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.722 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.722 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.722 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.704165+0000", 2023-09-30T17:04:10.722 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0019122029999999999 2023-09-30T17:04:10.722 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.723 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.723 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.723 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.704186+0000", 2023-09-30T17:04:10.723 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1418999999999999e-05 2023-09-30T17:04:10.723 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.723 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.723 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.723 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.704201+0000", 2023-09-30T17:04:10.723 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4993e-05 2023-09-30T17:04:10.723 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.723 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.723 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.724 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.704209+0000", 2023-09-30T17:04:10.724 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.588e-06 2023-09-30T17:04:10.724 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.724 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.724 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.724 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.086167+0000", 2023-09-30T17:04:10.724 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.38195870999999998 2023-09-30T17:04:10.724 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.724 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.724 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.724 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.086224+0000", 2023-09-30T17:04:10.724 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6711e-05 2023-09-30T17:04:10.725 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.725 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.725 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:10.725 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.086332+0000", 2023-09-30T17:04:10.725 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000107865 2023-09-30T17:04:10.725 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.725 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.725 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:10.725 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.106480+0000", 2023-09-30T17:04:10.725 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.02014817 2023-09-30T17:04:10.725 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.725 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.726 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.726 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.726 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.726 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109845 4.6 4.2d31fac6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.726 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.850396+0000", 2023-09-30T17:04:10.726 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.26597895500000002, 2023-09-30T17:04:10.726 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.27522044899999998, 2023-09-30T17:04:10.726 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.726 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.726 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.726 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.726 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.727 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109845 2023-09-30T17:04:10.727 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.727 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.727 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.727 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.727 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.850396+0000", 2023-09-30T17:04:10.727 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.727 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.727 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.727 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.728 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.850396+0000", 2023-09-30T17:04:10.728 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.728 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.728 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.728 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.728 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.852301+0000", 2023-09-30T17:04:10.728 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0019051179999999999 2023-09-30T17:04:10.728 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.728 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.728 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.728 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.852322+0000", 2023-09-30T17:04:10.728 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1049000000000001e-05 2023-09-30T17:04:10.729 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.729 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.729 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.729 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.852333+0000", 2023-09-30T17:04:10.729 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1297e-05 2023-09-30T17:04:10.729 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.729 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.729 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.729 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.852341+0000", 2023-09-30T17:04:10.729 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9999999999999996e-06 2023-09-30T17:04:10.729 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.729 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.729 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.730 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.730 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.730 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109875 4.6 4.8232b686 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.730 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.863225+0000", 2023-09-30T17:04:10.730 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.25314972800000002, 2023-09-30T17:04:10.730 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.26246312199999999, 2023-09-30T17:04:10.730 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.730 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.730 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.730 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.730 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.730 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109875 2023-09-30T17:04:10.731 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.731 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.731 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.731 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.731 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.863225+0000", 2023-09-30T17:04:10.731 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.731 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.731 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.731 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.731 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.863225+0000", 2023-09-30T17:04:10.731 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.732 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.732 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.732 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.732 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.863225+0000", 2023-09-30T17:04:10.732 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3300000000000002e-07 2023-09-30T17:04:10.732 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.732 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.732 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.732 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.863239+0000", 2023-09-30T17:04:10.732 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3668e-05 2023-09-30T17:04:10.732 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.732 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.733 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.733 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.863251+0000", 2023-09-30T17:04:10.733 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2148e-05 2023-09-30T17:04:10.733 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.733 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.733 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.733 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.863259+0000", 2023-09-30T17:04:10.733 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4189999999999996e-06 2023-09-30T17:04:10.733 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.733 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.733 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.734 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.734 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.734 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109935 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.734 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.891437+0000", 2023-09-30T17:04:10.734 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.22493786399999999, 2023-09-30T17:04:10.734 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23431443099999999, 2023-09-30T17:04:10.734 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.734 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.734 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.734 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.734 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.734 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109935 2023-09-30T17:04:10.735 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.735 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.735 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.735 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.735 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.891437+0000", 2023-09-30T17:04:10.735 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.735 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.735 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.735 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.735 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.891437+0000", 2023-09-30T17:04:10.735 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.735 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.736 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.736 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.736 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.891437+0000", 2023-09-30T17:04:10.736 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7999999999999995e-07 2023-09-30T17:04:10.736 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.736 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.736 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.736 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.891453+0000", 2023-09-30T17:04:10.736 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5654999999999998e-05 2023-09-30T17:04:10.736 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.736 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.737 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.737 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.891461+0000", 2023-09-30T17:04:10.737 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9170000000000006e-06 2023-09-30T17:04:10.737 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.737 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.737 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.737 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.891467+0000", 2023-09-30T17:04:10.737 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0419999999999999e-06 2023-09-30T17:04:10.737 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.737 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.737 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.737 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.737 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.738 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110022 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.738 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.931284+0000", 2023-09-30T17:04:10.738 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.18509049299999999, 2023-09-30T17:04:10.738 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.194527855, 2023-09-30T17:04:10.738 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.738 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.738 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.738 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.738 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.738 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110022 2023-09-30T17:04:10.738 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.738 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.739 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.739 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.739 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.931284+0000", 2023-09-30T17:04:10.739 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.739 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.739 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.739 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.739 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.931284+0000", 2023-09-30T17:04:10.739 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.739 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.739 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.739 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.740 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.933165+0000", 2023-09-30T17:04:10.740 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001880449 2023-09-30T17:04:10.740 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.740 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.740 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.740 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.933187+0000", 2023-09-30T17:04:10.740 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.2399999999999999e-05 2023-09-30T17:04:10.740 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.740 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.740 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.740 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.933198+0000", 2023-09-30T17:04:10.740 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0847e-05 2023-09-30T17:04:10.741 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.741 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.741 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.741 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.933203+0000", 2023-09-30T17:04:10.741 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.575e-06 2023-09-30T17:04:10.741 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.741 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.741 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.741 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.741 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.741 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110283 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.741 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.051133+0000", 2023-09-30T17:04:10.742 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.065242023999999996, 2023-09-30T17:04:10.742 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.074733249000000002, 2023-09-30T17:04:10.742 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.742 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.742 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.742 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.742 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.742 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110283 2023-09-30T17:04:10.742 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.742 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.742 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.742 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.743 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051133+0000", 2023-09-30T17:04:10.743 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.743 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.743 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.743 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.743 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051133+0000", 2023-09-30T17:04:10.743 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.743 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.743 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.743 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.743 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051133+0000", 2023-09-30T17:04:10.743 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7400000000000003e-07 2023-09-30T17:04:10.744 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.744 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.744 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.744 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051153+0000", 2023-09-30T17:04:10.744 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9945999999999998e-05 2023-09-30T17:04:10.744 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.744 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.744 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.744 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051169+0000", 2023-09-30T17:04:10.744 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5461e-05 2023-09-30T17:04:10.744 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.744 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.745 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.745 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051175+0000", 2023-09-30T17:04:10.745 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0399999999999998e-06 2023-09-30T17:04:10.745 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.745 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.745 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.745 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.745 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.745 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110396 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.745 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.079396+0000", 2023-09-30T17:04:10.745 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.036978219, 2023-09-30T17:04:10.746 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.046525160000000003, 2023-09-30T17:04:10.746 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.746 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.746 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.746 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.746 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.746 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110396 2023-09-30T17:04:10.746 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.746 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.746 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.746 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.747 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.079396+0000", 2023-09-30T17:04:10.747 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.747 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.747 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.747 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.747 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.079396+0000", 2023-09-30T17:04:10.747 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.747 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.747 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.747 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.747 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.079397+0000", 2023-09-30T17:04:10.747 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6899999999999998e-07 2023-09-30T17:04:10.748 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.748 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.748 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.748 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.079417+0000", 2023-09-30T17:04:10.748 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9962999999999998e-05 2023-09-30T17:04:10.748 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.748 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.748 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.748 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.079423+0000", 2023-09-30T17:04:10.748 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5780000000000004e-06 2023-09-30T17:04:10.748 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.748 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.749 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.749 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.079428+0000", 2023-09-30T17:04:10.749 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9389999999999996e-06 2023-09-30T17:04:10.749 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.749 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.749 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.749 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.749 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.749 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:111470 4.2d e51/17 4:b4aa06e9:::100000001f8.0000001d:head v 51'3419, mlcod=51'3416)", 2023-09-30T17:04:10.749 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.105103+0000", 2023-09-30T17:04:10.749 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.011271562000000001, 2023-09-30T17:04:10.749 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.020872694000000001, 2023-09-30T17:04:10.750 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.750 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:10.750 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.750 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.750 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.750 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.105103+0000", 2023-09-30T17:04:10.750 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.750 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.750 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.750 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.750 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.105103+0000", 2023-09-30T17:04:10.750 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.751 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.751 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.751 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.751 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.105103+0000", 2023-09-30T17:04:10.751 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4000000000000001e-07 2023-09-30T17:04:10.751 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.751 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.751 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.751 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.105116+0000", 2023-09-30T17:04:10.751 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2696e-05 2023-09-30T17:04:10.751 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.751 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.752 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.752 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.105121+0000", 2023-09-30T17:04:10.752 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1359999999999996e-06 2023-09-30T17:04:10.752 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.752 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.752 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.752 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.105124+0000", 2023-09-30T17:04:10.752 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.473e-06 2023-09-30T17:04:10.752 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.752 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.752 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.752 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.110360+0000", 2023-09-30T17:04:10.753 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0052350890000000001 2023-09-30T17:04:10.753 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.753 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.753 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.753 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.110379+0000", 2023-09-30T17:04:10.753 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9919999999999999e-05 2023-09-30T17:04:10.753 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.753 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.753 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.753 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.753 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.754 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:110295 4.2f e51/17)", 2023-09-30T17:04:10.754 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.114998+0000", 2023-09-30T17:04:10.754 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0013766119999999999, 2023-09-30T17:04:10.754 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011035618000000001, 2023-09-30T17:04:10.754 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.754 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.754 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.754 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.754 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.754 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.114998+0000", 2023-09-30T17:04:10.754 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.755 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.755 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.755 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.755 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.114998+0000", 2023-09-30T17:04:10.755 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.755 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.755 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.755 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.755 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.114998+0000", 2023-09-30T17:04:10.755 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9299999999999999e-07 2023-09-30T17:04:10.755 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.755 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.756 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.756 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.115009+0000", 2023-09-30T17:04:10.756 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0587999999999999e-05 2023-09-30T17:04:10.756 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.756 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.756 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.756 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.115016+0000", 2023-09-30T17:04:10.756 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4669999999999998e-06 2023-09-30T17:04:10.756 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.756 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.756 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.756 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.115021+0000", 2023-09-30T17:04:10.757 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0459999999999996e-06 2023-09-30T17:04:10.757 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.757 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.757 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.757 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.757 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.757 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110511 4.3d 4.2235fffd (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.757 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.122554+0000", 2023-09-30T17:04:10.757 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.9938207, 2023-09-30T17:04:10.757 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0035281840000000002, 2023-09-30T17:04:10.757 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.757 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.758 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.758 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.758 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.758 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110511 2023-09-30T17:04:10.758 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.758 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.758 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.758 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.758 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122554+0000", 2023-09-30T17:04:10.758 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.758 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.758 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.759 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.759 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122554+0000", 2023-09-30T17:04:10.759 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.759 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.759 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.759 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.759 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122554+0000", 2023-09-30T17:04:10.759 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6400000000000002e-07 2023-09-30T17:04:10.759 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.759 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.759 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.759 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122570+0000", 2023-09-30T17:04:10.760 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5841e-05 2023-09-30T17:04:10.760 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.760 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.760 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.760 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122584+0000", 2023-09-30T17:04:10.760 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3371e-05 2023-09-30T17:04:10.760 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.760 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.760 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.760 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122590+0000", 2023-09-30T17:04:10.760 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.6370000000000002e-06 2023-09-30T17:04:10.760 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.761 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.761 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.761 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.761 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.761 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109643 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 2867200~4096 in=4096b,write 3014656~4096 in=4096b,write 3436544~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.761 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.692257+0000", 2023-09-30T17:04:10.761 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.424117782, 2023-09-30T17:04:10.761 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.433885931, 2023-09-30T17:04:10.761 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.761 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:10.761 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.762 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.762 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.762 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109643 2023-09-30T17:04:10.762 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.762 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.762 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.762 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.762 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.692257+0000", 2023-09-30T17:04:10.762 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.762 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.762 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.762 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.763 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.692257+0000", 2023-09-30T17:04:10.763 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.763 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.763 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.763 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.763 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.692257+0000", 2023-09-30T17:04:10.763 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.03e-07 2023-09-30T17:04:10.763 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.763 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.763 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.763 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.692269+0000", 2023-09-30T17:04:10.763 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1450999999999999e-05 2023-09-30T17:04:10.764 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.764 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.764 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.764 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.692277+0000", 2023-09-30T17:04:10.764 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.123e-06 2023-09-30T17:04:10.764 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.764 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.764 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.764 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.692282+0000", 2023-09-30T17:04:10.764 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1000000000000003e-06 2023-09-30T17:04:10.764 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.764 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.765 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.765 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.068325+0000", 2023-09-30T17:04:10.765 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.37604285599999998 2023-09-30T17:04:10.765 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.765 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.765 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.765 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.068444+0000", 2023-09-30T17:04:10.765 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00011953 2023-09-30T17:04:10.765 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.765 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.765 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:10.765 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.068602+0000", 2023-09-30T17:04:10.765 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000157806 2023-09-30T17:04:10.766 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.766 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.766 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:10.766 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.090671+0000", 2023-09-30T17:04:10.766 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.022068469 2023-09-30T17:04:10.766 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.766 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.766 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.766 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.766 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.766 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109676 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 2236416~4096 in=4096b,write 2338816~4096 in=4096b,write 2576384~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.767 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.704223+0000", 2023-09-30T17:04:10.767 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.41215177600000003, 2023-09-30T17:04:10.767 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.42201319300000001, 2023-09-30T17:04:10.767 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.767 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:10.767 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.767 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.767 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.767 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109676 2023-09-30T17:04:10.767 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.767 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.767 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.767 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.768 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.704223+0000", 2023-09-30T17:04:10.768 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.768 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.768 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.768 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.768 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.704223+0000", 2023-09-30T17:04:10.768 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.768 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.768 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.768 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.768 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.704223+0000", 2023-09-30T17:04:10.768 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2699999999999999e-07 2023-09-30T17:04:10.769 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.769 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.769 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.769 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.704236+0000", 2023-09-30T17:04:10.769 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2320999999999999e-05 2023-09-30T17:04:10.769 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.769 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.769 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.769 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.704245+0000", 2023-09-30T17:04:10.769 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.6479999999999998e-06 2023-09-30T17:04:10.769 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.770 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.770 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.770 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.704255+0000", 2023-09-30T17:04:10.770 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.9429999999999995e-06 2023-09-30T17:04:10.770 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.770 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.770 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.770 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.088808+0000", 2023-09-30T17:04:10.770 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.38455313200000002 2023-09-30T17:04:10.770 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.770 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.770 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.771 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.088902+0000", 2023-09-30T17:04:10.771 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3352999999999999e-05 2023-09-30T17:04:10.771 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.771 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.771 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:10.771 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.089069+0000", 2023-09-30T17:04:10.771 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016771099999999999 2023-09-30T17:04:10.771 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.771 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.771 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:10.771 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.106486+0000", 2023-09-30T17:04:10.771 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.017416742999999998 2023-09-30T17:04:10.772 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.772 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.772 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.772 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.772 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.772 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110284 4.3f 4:fde182c5:::100000001f8.00000039:head [write 3203072~4096 in=4096b,write 3211264~4096 in=4096b,write 3231744~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.772 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.051183+0000", 2023-09-30T17:04:10.772 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.065191279000000005, 2023-09-30T17:04:10.772 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.075141335000000004, 2023-09-30T17:04:10.772 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.772 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:10.772 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.773 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.773 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.773 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110284 2023-09-30T17:04:10.773 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.773 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.773 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.773 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.773 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051183+0000", 2023-09-30T17:04:10.773 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.773 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.773 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.774 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.774 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051183+0000", 2023-09-30T17:04:10.774 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.774 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.774 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.774 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.774 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051184+0000", 2023-09-30T17:04:10.774 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1500000000000005e-07 2023-09-30T17:04:10.774 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.774 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.774 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.774 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051197+0000", 2023-09-30T17:04:10.775 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2948999999999999e-05 2023-09-30T17:04:10.775 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.775 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.775 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.775 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051204+0000", 2023-09-30T17:04:10.775 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0129999999999996e-06 2023-09-30T17:04:10.775 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.775 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.775 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.775 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051209+0000", 2023-09-30T17:04:10.775 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9010000000000002e-06 2023-09-30T17:04:10.775 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.776 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.776 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.776 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.091480+0000", 2023-09-30T17:04:10.776 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.040270981999999997 2023-09-30T17:04:10.776 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.776 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.776 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.776 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.091551+0000", 2023-09-30T17:04:10.776 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1778000000000003e-05 2023-09-30T17:04:10.776 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.776 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.776 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:10.777 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.091681+0000", 2023-09-30T17:04:10.777 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00012943500000000001 2023-09-30T17:04:10.777 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.777 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.777 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:10.777 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.119262+0000", 2023-09-30T17:04:10.777 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.027581445999999999 2023-09-30T17:04:10.777 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.777 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.777 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.777 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.777 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.777 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110397 4.6 4.2d31fac6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.778 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.079435+0000", 2023-09-30T17:04:10.778 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.036939496000000002, 2023-09-30T17:04:10.778 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.046971642000000001, 2023-09-30T17:04:10.778 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.778 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.778 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.778 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.778 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.778 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110397 2023-09-30T17:04:10.778 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.778 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.778 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.779 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.779 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.079435+0000", 2023-09-30T17:04:10.779 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.779 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.779 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.779 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.779 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.079435+0000", 2023-09-30T17:04:10.779 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.779 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.779 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.779 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.780 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.079435+0000", 2023-09-30T17:04:10.780 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0699999999999998e-07 2023-09-30T17:04:10.780 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.780 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.780 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.780 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.079448+0000", 2023-09-30T17:04:10.780 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3009e-05 2023-09-30T17:04:10.780 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.780 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.780 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.780 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.079454+0000", 2023-09-30T17:04:10.780 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8119999999999996e-06 2023-09-30T17:04:10.781 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.781 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.781 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.781 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.079459+0000", 2023-09-30T17:04:10.781 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0180000000000001e-06 2023-09-30T17:04:10.781 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.781 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.781 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.781 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.781 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.781 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:110271 4.f e51/17 4:f26fdfa9:::100000001f8.00000002:head v 51'5234, mlcod=51'5229)", 2023-09-30T17:04:10.781 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.107258+0000", 2023-09-30T17:04:10.781 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0091162380000000005, 2023-09-30T17:04:10.782 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.019204692999999998, 2023-09-30T17:04:10.782 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.782 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:10.782 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.782 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.782 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.782 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.107258+0000", 2023-09-30T17:04:10.782 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.782 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.782 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.782 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.782 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.107258+0000", 2023-09-30T17:04:10.783 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.783 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.783 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.783 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.783 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.107259+0000", 2023-09-30T17:04:10.783 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.6199999999999997e-07 2023-09-30T17:04:10.783 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.783 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.783 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.783 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.107281+0000", 2023-09-30T17:04:10.783 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1804e-05 2023-09-30T17:04:10.783 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.784 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.784 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.784 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.107291+0000", 2023-09-30T17:04:10.784 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0404000000000001e-05 2023-09-30T17:04:10.784 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.784 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.784 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.784 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.107298+0000", 2023-09-30T17:04:10.784 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.148e-06 2023-09-30T17:04:10.784 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.784 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.785 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.785 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.119206+0000", 2023-09-30T17:04:10.785 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011907315999999999 2023-09-30T17:04:10.785 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.785 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.785 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.785 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.119225+0000", 2023-09-30T17:04:10.785 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8893999999999999e-05 2023-09-30T17:04:10.786 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.786 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.786 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.786 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.786 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.786 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110484 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.786 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.114217+0000", 2023-09-30T17:04:10.786 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0021576870000000001, 2023-09-30T17:04:10.786 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.012308196, 2023-09-30T17:04:10.786 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.786 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.787 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.787 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.787 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.787 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110484 2023-09-30T17:04:10.787 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.787 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.787 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.787 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.787 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.114217+0000", 2023-09-30T17:04:10.787 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.787 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.787 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.788 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.788 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.114217+0000", 2023-09-30T17:04:10.788 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.788 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.788 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.788 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.788 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.116163+0000", 2023-09-30T17:04:10.788 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001945757 2023-09-30T17:04:10.788 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.788 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.788 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.788 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.116181+0000", 2023-09-30T17:04:10.789 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8842e-05 2023-09-30T17:04:10.789 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.789 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.789 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.789 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.116196+0000", 2023-09-30T17:04:10.789 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4888e-05 2023-09-30T17:04:10.789 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.789 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.789 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.789 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.116205+0000", 2023-09-30T17:04:10.789 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3149999999999992e-06 2023-09-30T17:04:10.789 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.790 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.790 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.790 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.790 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.790 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110512 4.24 4.765bb5e4 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.790 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.122599+0000", 2023-09-30T17:04:10.790 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.9937749, 2023-09-30T17:04:10.790 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0039809529999999997, 2023-09-30T17:04:10.790 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.790 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.790 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.791 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.791 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.791 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110512 2023-09-30T17:04:10.791 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.791 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.791 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.791 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.791 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122599+0000", 2023-09-30T17:04:10.791 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.791 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.791 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.792 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.792 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122599+0000", 2023-09-30T17:04:10.792 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.792 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.792 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.792 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.792 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122600+0000", 2023-09-30T17:04:10.792 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1500000000000005e-07 2023-09-30T17:04:10.792 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.792 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.792 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.793 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122612+0000", 2023-09-30T17:04:10.793 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1972e-05 2023-09-30T17:04:10.793 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.793 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.793 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.793 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122622+0000", 2023-09-30T17:04:10.793 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.6730000000000004e-06 2023-09-30T17:04:10.793 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.793 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.793 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.793 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122628+0000", 2023-09-30T17:04:10.793 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3550000000000001e-06 2023-09-30T17:04:10.794 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.794 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.794 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.794 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.794 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.794 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109753 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.794 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.735275+0000", 2023-09-30T17:04:10.794 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.38109922600000001, 2023-09-30T17:04:10.794 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39137676700000001, 2023-09-30T17:04:10.794 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.794 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.795 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.795 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.795 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.795 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109753 2023-09-30T17:04:10.795 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.795 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.795 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.795 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.795 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.735275+0000", 2023-09-30T17:04:10.795 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.795 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.795 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.795 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.796 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.735275+0000", 2023-09-30T17:04:10.796 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.796 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.796 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.796 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.796 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.737163+0000", 2023-09-30T17:04:10.796 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0018874359999999999 2023-09-30T17:04:10.796 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.796 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.796 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.796 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.737179+0000", 2023-09-30T17:04:10.796 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6144999999999999e-05 2023-09-30T17:04:10.797 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.797 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.797 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.797 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.737190+0000", 2023-09-30T17:04:10.797 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0674e-05 2023-09-30T17:04:10.797 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.797 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.797 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.797 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.737201+0000", 2023-09-30T17:04:10.797 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1395e-05 2023-09-30T17:04:10.797 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.797 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.798 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.798 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.798 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.798 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110027 4.6 4.2d31fac6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.798 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.933250+0000", 2023-09-30T17:04:10.798 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.18312462400000001, 2023-09-30T17:04:10.798 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.193460627, 2023-09-30T17:04:10.798 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.798 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.798 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.798 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.799 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.799 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110027 2023-09-30T17:04:10.799 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.799 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.799 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.799 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.799 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.933250+0000", 2023-09-30T17:04:10.799 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.799 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.799 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.799 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.799 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.933250+0000", 2023-09-30T17:04:10.800 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.800 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.800 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.800 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.800 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.933250+0000", 2023-09-30T17:04:10.800 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3000000000000001e-07 2023-09-30T17:04:10.800 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.800 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.800 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.800 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.933274+0000", 2023-09-30T17:04:10.800 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.3417999999999998e-05 2023-09-30T17:04:10.801 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.801 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.801 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.801 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.933288+0000", 2023-09-30T17:04:10.801 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3738e-05 2023-09-30T17:04:10.801 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.801 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.801 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.801 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.933294+0000", 2023-09-30T17:04:10.801 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3960000000000003e-06 2023-09-30T17:04:10.801 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.801 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.802 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.802 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.802 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.802 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:110259 4.37 e51/17 4:eff9002a:::100000001f8.00000003:head v 51'5187, mlcod=51'5182)", 2023-09-30T17:04:10.802 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.107455+0000", 2023-09-30T17:04:10.802 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0089198809999999993, 2023-09-30T17:04:10.802 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.019323901000000001, 2023-09-30T17:04:10.802 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.802 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:10.802 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.802 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.803 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.803 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.107455+0000", 2023-09-30T17:04:10.803 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.803 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.803 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.803 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.803 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.107455+0000", 2023-09-30T17:04:10.803 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.803 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.803 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.803 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.804 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.107455+0000", 2023-09-30T17:04:10.804 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4000000000000002e-07 2023-09-30T17:04:10.804 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.804 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.804 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.804 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.107470+0000", 2023-09-30T17:04:10.804 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4445e-05 2023-09-30T17:04:10.804 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.804 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.804 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.805 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.107495+0000", 2023-09-30T17:04:10.805 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.5094999999999999e-05 2023-09-30T17:04:10.805 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.805 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.805 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.805 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.107502+0000", 2023-09-30T17:04:10.805 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8580000000000002e-06 2023-09-30T17:04:10.805 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.805 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.805 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.805 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.119305+0000", 2023-09-30T17:04:10.805 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011803431 2023-09-30T17:04:10.806 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.806 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.806 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.806 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.119322+0000", 2023-09-30T17:04:10.806 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7317999999999999e-05 2023-09-30T17:04:10.806 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.806 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.806 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.806 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.806 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.806 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop_reply(client.4547.0:110284 4.3f e51/17)", 2023-09-30T17:04:10.806 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.116182+0000", 2023-09-30T17:04:10.807 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.00019293199999999999, 2023-09-30T17:04:10.807 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010659528, 2023-09-30T17:04:10.807 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.807 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.807 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.807 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.807 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.807 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.116182+0000", 2023-09-30T17:04:10.807 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.807 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.807 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.807 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.808 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.116182+0000", 2023-09-30T17:04:10.808 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.808 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.808 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.808 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.808 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.116182+0000", 2023-09-30T17:04:10.808 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0999999999999998e-07 2023-09-30T17:04:10.808 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.808 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.808 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.808 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.116186+0000", 2023-09-30T17:04:10.808 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0419999999999996e-06 2023-09-30T17:04:10.809 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.809 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.809 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.809 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.116197+0000", 2023-09-30T17:04:10.809 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0488e-05 2023-09-30T17:04:10.809 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.809 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.809 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.809 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.116204+0000", 2023-09-30T17:04:10.809 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1130000000000003e-06 2023-09-30T17:04:10.809 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.809 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.810 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.810 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.810 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.810 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110513 4.36 4.61fa15f6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.810 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.122636+0000", 2023-09-30T17:04:10.810 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.9937387, 2023-09-30T17:04:10.810 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0042547180000000002, 2023-09-30T17:04:10.810 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.810 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.810 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.811 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.811 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.811 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110513 2023-09-30T17:04:10.811 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.811 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.811 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.811 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.811 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122636+0000", 2023-09-30T17:04:10.811 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.811 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.811 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.812 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.812 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122636+0000", 2023-09-30T17:04:10.812 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.812 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.812 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.812 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.812 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122636+0000", 2023-09-30T17:04:10.812 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0399999999999996e-07 2023-09-30T17:04:10.812 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.812 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.812 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.812 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122651+0000", 2023-09-30T17:04:10.813 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.449e-05 2023-09-30T17:04:10.813 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.813 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.813 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.813 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122661+0000", 2023-09-30T17:04:10.813 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0244000000000001e-05 2023-09-30T17:04:10.813 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.813 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.813 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.813 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122667+0000", 2023-09-30T17:04:10.813 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1630000000000001e-06 2023-09-30T17:04:10.813 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.814 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.814 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.814 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.814 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.814 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109508 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 2650112~4096 in=4096b,write 2723840~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.814 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.624554+0000", 2023-09-30T17:04:10.814 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.49182039, 2023-09-30T17:04:10.814 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.50240008899999999, 2023-09-30T17:04:10.814 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.814 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:10.814 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.815 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.815 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.815 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109508 2023-09-30T17:04:10.815 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.815 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.815 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.815 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.815 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624554+0000", 2023-09-30T17:04:10.815 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.815 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.815 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.815 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.816 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624554+0000", 2023-09-30T17:04:10.816 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.816 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.816 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.816 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.816 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624555+0000", 2023-09-30T17:04:10.816 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.51e-07 2023-09-30T17:04:10.816 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.816 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.816 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.816 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624573+0000", 2023-09-30T17:04:10.816 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8519e-05 2023-09-30T17:04:10.817 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.817 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.817 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.817 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624582+0000", 2023-09-30T17:04:10.817 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.6489999999999997e-06 2023-09-30T17:04:10.817 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.817 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.817 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.817 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624588+0000", 2023-09-30T17:04:10.817 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4980000000000003e-06 2023-09-30T17:04:10.817 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.817 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.817 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.818 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.028302+0000", 2023-09-30T17:04:10.818 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.40371393 2023-09-30T17:04:10.818 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.818 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.818 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.818 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.028383+0000", 2023-09-30T17:04:10.818 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1069000000000006e-05 2023-09-30T17:04:10.818 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.818 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.818 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:10.818 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.028546+0000", 2023-09-30T17:04:10.819 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000162256 2023-09-30T17:04:10.819 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.819 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.819 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:10.819 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.058510+0000", 2023-09-30T17:04:10.819 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.029964937000000001 2023-09-30T17:04:10.819 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.819 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.819 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.819 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.819 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.819 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109754 4.6 4:616d4c41:::100000001f8.00000034:head [write 2998272~4096 in=4096b,write 3006464~4096 in=4096b,write 3014656~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.820 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.737214+0000", 2023-09-30T17:04:10.820 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.37916061299999998, 2023-09-30T17:04:10.820 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.38982562999999998, 2023-09-30T17:04:10.820 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.820 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:10.820 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.820 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.820 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.820 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109754 2023-09-30T17:04:10.820 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.821 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.821 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.821 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.821 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.737214+0000", 2023-09-30T17:04:10.821 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.821 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.821 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.821 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.821 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.737214+0000", 2023-09-30T17:04:10.821 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.821 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.822 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.822 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.822 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.739164+0000", 2023-09-30T17:04:10.822 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001949943 2023-09-30T17:04:10.822 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.822 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.822 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.822 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.739180+0000", 2023-09-30T17:04:10.822 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5862000000000002e-05 2023-09-30T17:04:10.822 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.822 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.822 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.823 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.739190+0000", 2023-09-30T17:04:10.823 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8009999999999998e-06 2023-09-30T17:04:10.823 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.823 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.823 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.823 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.739195+0000", 2023-09-30T17:04:10.823 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5990000000000001e-06 2023-09-30T17:04:10.823 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.823 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.823 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.823 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.126921+0000", 2023-09-30T17:04:10.823 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.38772617799999998 2023-09-30T17:04:10.824 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.824 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.824 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.824 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.126995+0000", 2023-09-30T17:04:10.824 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3647999999999997e-05 2023-09-30T17:04:10.824 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.824 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.824 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.824 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.824 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.824 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109877 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.825 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.865224+0000", 2023-09-30T17:04:10.825 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.25115062700000002, 2023-09-30T17:04:10.825 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.261886271, 2023-09-30T17:04:10.825 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.825 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.825 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.825 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.825 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.825 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109877 2023-09-30T17:04:10.825 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.825 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.826 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.826 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.826 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.865224+0000", 2023-09-30T17:04:10.826 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.826 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.826 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.826 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.826 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.865224+0000", 2023-09-30T17:04:10.826 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.826 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.826 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.826 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.827 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.865224+0000", 2023-09-30T17:04:10.827 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6199999999999998e-07 2023-09-30T17:04:10.827 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.827 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.827 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.827 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.865244+0000", 2023-09-30T17:04:10.827 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9687999999999999e-05 2023-09-30T17:04:10.827 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.827 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.827 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.827 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.865253+0000", 2023-09-30T17:04:10.827 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2299999999999997e-06 2023-09-30T17:04:10.828 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.828 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.828 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.828 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.865260+0000", 2023-09-30T17:04:10.828 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0589999999999997e-06 2023-09-30T17:04:10.828 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.828 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.828 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.828 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.828 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.828 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110289 4.6 4.2d31fac6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.828 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.051256+0000", 2023-09-30T17:04:10.829 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.065118064000000003, 2023-09-30T17:04:10.829 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.075922076000000005, 2023-09-30T17:04:10.829 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.829 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.829 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.829 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.829 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.829 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110289 2023-09-30T17:04:10.829 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.829 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.830 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.830 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.830 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051256+0000", 2023-09-30T17:04:10.830 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.830 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.830 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.830 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.830 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051256+0000", 2023-09-30T17:04:10.830 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.830 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.830 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.830 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.831 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051257+0000", 2023-09-30T17:04:10.831 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1699999999999998e-07 2023-09-30T17:04:10.831 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.831 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.831 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.831 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051268+0000", 2023-09-30T17:04:10.831 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0627e-05 2023-09-30T17:04:10.831 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.831 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.831 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.832 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051274+0000", 2023-09-30T17:04:10.832 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3289999999999999e-06 2023-09-30T17:04:10.832 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.832 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.832 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.832 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051280+0000", 2023-09-30T17:04:10.832 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.489e-06 2023-09-30T17:04:10.832 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.832 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.832 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.832 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.833 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.833 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110327 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.833 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.059331+0000", 2023-09-30T17:04:10.833 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.057043516000000002, 2023-09-30T17:04:10.833 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.067905471999999995, 2023-09-30T17:04:10.833 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.833 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.833 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.833 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.833 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.834 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110327 2023-09-30T17:04:10.834 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.834 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.834 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.834 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.834 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.059331+0000", 2023-09-30T17:04:10.834 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.834 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.835 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.835 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.835 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.059331+0000", 2023-09-30T17:04:10.835 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.835 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.835 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.835 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.835 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.059332+0000", 2023-09-30T17:04:10.835 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3399999999999999e-07 2023-09-30T17:04:10.835 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.835 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.835 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.836 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.059343+0000", 2023-09-30T17:04:10.836 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1501000000000001e-05 2023-09-30T17:04:10.836 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.836 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.836 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.836 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.059351+0000", 2023-09-30T17:04:10.836 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9100000000000005e-06 2023-09-30T17:04:10.836 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.836 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.836 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.836 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.059358+0000", 2023-09-30T17:04:10.836 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9720000000000003e-06 2023-09-30T17:04:10.837 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.837 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.837 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.837 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.837 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.837 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop_reply(client.4547.0:110305 4.3f e51/17)", 2023-09-30T17:04:10.837 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.116219+0000", 2023-09-30T17:04:10.837 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.000155081, 2023-09-30T17:04:10.837 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011069284, 2023-09-30T17:04:10.837 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.837 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.838 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.838 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.838 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.838 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.116219+0000", 2023-09-30T17:04:10.838 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.838 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.838 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.838 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.838 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.116219+0000", 2023-09-30T17:04:10.838 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.839 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.839 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.839 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.839 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.116220+0000", 2023-09-30T17:04:10.839 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1199999999999998e-07 2023-09-30T17:04:10.839 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.839 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.839 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.839 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.116222+0000", 2023-09-30T17:04:10.839 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.587e-06 2023-09-30T17:04:10.839 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.839 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.840 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.840 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.116229+0000", 2023-09-30T17:04:10.840 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1120000000000001e-06 2023-09-30T17:04:10.840 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.840 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.840 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.840 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.116233+0000", 2023-09-30T17:04:10.840 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7999999999999998e-06 2023-09-30T17:04:10.840 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.840 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.840 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.841 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.841 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.841 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110514 4.3b 4:dcc0c15f:::100000001f8.0000001a:head [write 1122304~4096 in=4096b,write 1179648~4096 in=4096b,write 1298432~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.841 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.122677+0000", 2023-09-30T17:04:10.841 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.9936976, 2023-09-30T17:04:10.841 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0046760170000000002, 2023-09-30T17:04:10.841 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.841 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:10.841 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.841 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.841 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.842 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110514 2023-09-30T17:04:10.842 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.842 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.842 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.842 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.842 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122677+0000", 2023-09-30T17:04:10.842 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.842 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.842 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.842 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.842 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122677+0000", 2023-09-30T17:04:10.842 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.843 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.843 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.843 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.843 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122678+0000", 2023-09-30T17:04:10.843 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8500000000000001e-07 2023-09-30T17:04:10.843 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.843 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.843 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.843 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122690+0000", 2023-09-30T17:04:10.843 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2556e-05 2023-09-30T17:04:10.843 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.843 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.844 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.844 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122700+0000", 2023-09-30T17:04:10.844 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7140000000000005e-06 2023-09-30T17:04:10.844 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.844 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.844 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.844 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122708+0000", 2023-09-30T17:04:10.844 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1780000000000003e-06 2023-09-30T17:04:10.844 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.844 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.844 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.845 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122761+0000", 2023-09-30T17:04:10.845 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3285000000000002e-05 2023-09-30T17:04:10.845 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.845 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.845 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.845 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122851+0000", 2023-09-30T17:04:10.845 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9622000000000004e-05 2023-09-30T17:04:10.845 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.845 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.845 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:10.845 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.123024+0000", 2023-09-30T17:04:10.846 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000172948 2023-09-30T17:04:10.846 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.846 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.846 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.846 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.846 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.846 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109644 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 344064~4096 in=4096b,write 462848~4096 in=4096b,write 684032~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.846 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.692290+0000", 2023-09-30T17:04:10.846 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.42408496200000001, 2023-09-30T17:04:10.846 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.43515552000000002, 2023-09-30T17:04:10.847 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.847 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:10.847 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.847 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.847 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.847 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109644 2023-09-30T17:04:10.847 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.847 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.847 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.847 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.847 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.692290+0000", 2023-09-30T17:04:10.848 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.848 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.848 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.848 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.848 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.692290+0000", 2023-09-30T17:04:10.848 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.848 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.848 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.848 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.848 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.694172+0000", 2023-09-30T17:04:10.848 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001882627 2023-09-30T17:04:10.848 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.849 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.849 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.849 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.694187+0000", 2023-09-30T17:04:10.849 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4433000000000001e-05 2023-09-30T17:04:10.849 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.849 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.849 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.849 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.694197+0000", 2023-09-30T17:04:10.849 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0455000000000001e-05 2023-09-30T17:04:10.849 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.849 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.850 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.850 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.694205+0000", 2023-09-30T17:04:10.850 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9270000000000005e-06 2023-09-30T17:04:10.850 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.850 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.850 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.850 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.077234+0000", 2023-09-30T17:04:10.850 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.38302859099999997 2023-09-30T17:04:10.850 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.850 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.850 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.850 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.080507+0000", 2023-09-30T17:04:10.851 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0032735529999999998 2023-09-30T17:04:10.851 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.851 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.851 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:10.851 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.080672+0000", 2023-09-30T17:04:10.851 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016446700000000001 2023-09-30T17:04:10.851 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.851 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.851 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:10.851 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.098613+0000", 2023-09-30T17:04:10.851 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.017941722 2023-09-30T17:04:10.851 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.852 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.852 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.852 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.852 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.852 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109708 4.e 4:73e84e43:::100000001f8.00000004:head [write 3788800~4096 in=4096b,write 3895296~4096 in=4096b,write 3932160~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.852 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.715357+0000", 2023-09-30T17:04:10.852 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.40101784099999999, 2023-09-30T17:04:10.852 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.4121842, 2023-09-30T17:04:10.852 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.852 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:10.852 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.852 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.853 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.853 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109708 2023-09-30T17:04:10.853 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.853 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.853 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.853 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.853 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.715357+0000", 2023-09-30T17:04:10.853 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.853 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.853 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.853 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.853 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.715357+0000", 2023-09-30T17:04:10.854 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.854 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.854 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.854 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.854 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.715357+0000", 2023-09-30T17:04:10.854 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5400000000000001e-07 2023-09-30T17:04:10.854 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.854 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.854 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.854 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.715376+0000", 2023-09-30T17:04:10.854 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8422000000000001e-05 2023-09-30T17:04:10.855 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.855 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.855 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.855 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.715384+0000", 2023-09-30T17:04:10.855 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9279999999999993e-06 2023-09-30T17:04:10.855 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.855 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.855 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.855 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.715391+0000", 2023-09-30T17:04:10.855 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1110000000000002e-06 2023-09-30T17:04:10.856 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.856 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.856 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.856 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.107100+0000", 2023-09-30T17:04:10.856 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39170968099999998 2023-09-30T17:04:10.856 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.856 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.856 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.856 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.107149+0000", 2023-09-30T17:04:10.856 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8885999999999999e-05 2023-09-30T17:04:10.857 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.857 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.857 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.857 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.857 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.857 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109820 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.857 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.839222+0000", 2023-09-30T17:04:10.857 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.277152493, 2023-09-30T17:04:10.857 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.28839772699999999, 2023-09-30T17:04:10.857 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.857 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.857 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.858 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.858 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.858 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109820 2023-09-30T17:04:10.858 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.858 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.858 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.858 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.858 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.839222+0000", 2023-09-30T17:04:10.858 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.858 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.858 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.859 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.859 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.839222+0000", 2023-09-30T17:04:10.859 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.859 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.859 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.859 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.859 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.841164+0000", 2023-09-30T17:04:10.859 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001942112 2023-09-30T17:04:10.859 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.859 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.859 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.860 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.841181+0000", 2023-09-30T17:04:10.860 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6484e-05 2023-09-30T17:04:10.860 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.860 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.860 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.860 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.841193+0000", 2023-09-30T17:04:10.860 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2588999999999999e-05 2023-09-30T17:04:10.860 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.860 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.860 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.860 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.841208+0000", 2023-09-30T17:04:10.861 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.523e-05 2023-09-30T17:04:10.861 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.861 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.861 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.861 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.861 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.861 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110130 4.6 4.8232b686 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.861 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.977224+0000", 2023-09-30T17:04:10.861 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.13915023000000001, 2023-09-30T17:04:10.861 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.150457427, 2023-09-30T17:04:10.861 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.861 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.862 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.862 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.862 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.862 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110130 2023-09-30T17:04:10.862 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.862 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.862 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.862 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.862 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.977224+0000", 2023-09-30T17:04:10.862 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.862 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.862 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.863 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.863 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.977224+0000", 2023-09-30T17:04:10.863 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.863 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.863 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.863 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.863 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.977225+0000", 2023-09-30T17:04:10.863 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3499999999999996e-07 2023-09-30T17:04:10.863 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.863 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.863 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.864 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.977237+0000", 2023-09-30T17:04:10.864 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2500000000000001e-05 2023-09-30T17:04:10.864 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.864 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.864 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.864 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.977245+0000", 2023-09-30T17:04:10.864 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.418e-06 2023-09-30T17:04:10.864 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.864 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.864 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.864 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.977250+0000", 2023-09-30T17:04:10.865 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6049999999999997e-06 2023-09-30T17:04:10.865 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.865 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.865 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.865 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.865 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.865 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110290 4.6 4.2d31fac6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.865 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.051305+0000", 2023-09-30T17:04:10.865 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.065069452, 2023-09-30T17:04:10.865 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.076443764999999997, 2023-09-30T17:04:10.865 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.865 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.866 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.866 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.866 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.866 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110290 2023-09-30T17:04:10.866 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.866 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.866 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.866 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.866 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051305+0000", 2023-09-30T17:04:10.866 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.866 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.867 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.867 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.867 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051305+0000", 2023-09-30T17:04:10.867 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.867 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.867 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.867 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.867 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051306+0000", 2023-09-30T17:04:10.867 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9100000000000004e-07 2023-09-30T17:04:10.867 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.867 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.867 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.868 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051322+0000", 2023-09-30T17:04:10.868 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6504e-05 2023-09-30T17:04:10.868 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.868 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.868 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.868 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051329+0000", 2023-09-30T17:04:10.868 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4790000000000001e-06 2023-09-30T17:04:10.868 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.868 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.868 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.868 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051334+0000", 2023-09-30T17:04:10.869 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.096e-06 2023-09-30T17:04:10.869 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.869 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.869 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.869 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.869 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.869 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110329 4.3f 4:fde182c5:::100000001f8.00000039:head [write 626688~4096 in=4096b,write 1310720~4096 in=4096b,write 1511424~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.869 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.059367+0000", 2023-09-30T17:04:10.869 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.057008030000000001, 2023-09-30T17:04:10.869 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.068420745000000005, 2023-09-30T17:04:10.869 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.869 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:10.870 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.870 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.870 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.870 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110329 2023-09-30T17:04:10.870 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.870 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.870 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.870 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.870 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.059367+0000", 2023-09-30T17:04:10.870 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.870 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.870 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.871 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.871 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.059367+0000", 2023-09-30T17:04:10.871 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.871 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.871 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.871 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.871 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.059367+0000", 2023-09-30T17:04:10.871 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.08e-07 2023-09-30T17:04:10.871 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.871 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.871 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.872 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.059384+0000", 2023-09-30T17:04:10.872 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7002000000000001e-05 2023-09-30T17:04:10.872 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.872 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.872 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.872 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.059392+0000", 2023-09-30T17:04:10.872 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3170000000000002e-06 2023-09-30T17:04:10.872 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.872 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.872 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.872 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.059399+0000", 2023-09-30T17:04:10.873 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5930000000000002e-06 2023-09-30T17:04:10.873 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.873 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.873 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.873 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.094236+0000", 2023-09-30T17:04:10.873 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.034836917000000002 2023-09-30T17:04:10.873 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.873 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.873 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.873 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.094281+0000", 2023-09-30T17:04:10.873 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4821000000000003e-05 2023-09-30T17:04:10.874 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.874 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.874 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:10.874 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.094366+0000", 2023-09-30T17:04:10.874 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5655000000000006e-05 2023-09-30T17:04:10.874 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.874 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.874 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:10.874 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.121620+0000", 2023-09-30T17:04:10.874 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.027253932000000002 2023-09-30T17:04:10.875 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.875 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.875 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.875 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.875 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.875 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110403 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.875 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.079554+0000", 2023-09-30T17:04:10.875 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.036820863000000002, 2023-09-30T17:04:10.875 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.048281813, 2023-09-30T17:04:10.875 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.875 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.875 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.876 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.876 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.876 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110403 2023-09-30T17:04:10.876 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.876 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.876 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.876 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.876 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.079554+0000", 2023-09-30T17:04:10.876 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.876 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.877 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.877 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.877 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.079554+0000", 2023-09-30T17:04:10.877 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.877 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.877 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.877 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.877 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.079554+0000", 2023-09-30T17:04:10.877 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6100000000000001e-07 2023-09-30T17:04:10.877 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.877 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.877 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.878 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.079574+0000", 2023-09-30T17:04:10.878 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9477999999999999e-05 2023-09-30T17:04:10.878 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.878 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.878 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.878 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.079580+0000", 2023-09-30T17:04:10.878 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2040000000000002e-06 2023-09-30T17:04:10.878 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.878 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.878 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.878 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.079585+0000", 2023-09-30T17:04:10.878 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7480000000000001e-06 2023-09-30T17:04:10.879 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.879 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.879 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.879 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.879 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.879 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110441 4.27 4.df99e167 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.879 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.104207+0000", 2023-09-30T17:04:10.879 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.012167348, 2023-09-30T17:04:10.879 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023659527999999999, 2023-09-30T17:04:10.879 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.879 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.879 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.880 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.880 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.880 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110441 2023-09-30T17:04:10.880 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.880 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.880 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.880 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.880 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.104207+0000", 2023-09-30T17:04:10.880 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.880 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.880 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.881 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.881 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.104207+0000", 2023-09-30T17:04:10.881 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.881 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.881 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.881 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.881 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108164+0000", 2023-09-30T17:04:10.881 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0039572080000000003 2023-09-30T17:04:10.881 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.881 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.881 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.882 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108180+0000", 2023-09-30T17:04:10.882 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5705999999999998e-05 2023-09-30T17:04:10.882 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.882 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.882 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.882 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108191+0000", 2023-09-30T17:04:10.882 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1201e-05 2023-09-30T17:04:10.882 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.882 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.882 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.882 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108199+0000", 2023-09-30T17:04:10.883 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.14e-06 2023-09-30T17:04:10.883 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.883 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.883 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.883 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.883 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.883 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110485 4.3d 4:bd3afb9d:::100000001f8.00000009:head [write 3530752~8192 in=8192b,write 3579904~4096 in=4096b,write 3801088~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.883 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.116218+0000", 2023-09-30T17:04:10.883 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.00015688799999999999, 2023-09-30T17:04:10.883 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011686063, 2023-09-30T17:04:10.883 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.883 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:10.884 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.884 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.884 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.884 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110485 2023-09-30T17:04:10.884 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.884 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.884 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.884 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.884 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.116218+0000", 2023-09-30T17:04:10.884 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.884 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.885 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.885 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.885 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.116218+0000", 2023-09-30T17:04:10.885 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.885 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.885 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.885 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.885 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.116218+0000", 2023-09-30T17:04:10.885 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4099999999999999e-07 2023-09-30T17:04:10.885 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.885 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.886 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.886 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.116238+0000", 2023-09-30T17:04:10.886 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9599e-05 2023-09-30T17:04:10.886 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.886 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.886 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.886 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.116246+0000", 2023-09-30T17:04:10.886 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4810000000000006e-06 2023-09-30T17:04:10.886 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.887 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.887 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.887 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.116253+0000", 2023-09-30T17:04:10.887 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.6579999999999996e-06 2023-09-30T17:04:10.887 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.887 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.887 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.887 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.116307+0000", 2023-09-30T17:04:10.887 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4540000000000003e-05 2023-09-30T17:04:10.887 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.887 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.888 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.888 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.116429+0000", 2023-09-30T17:04:10.888 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000121777 2023-09-30T17:04:10.888 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.888 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.888 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.888 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.888 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.888 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110516 4.8 4:11ee3b64:::100000001f8.0000003e:head [write 3694592~4096 in=4096b,write 4087808~4096 in=4096b,write 4177920~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.889 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.122720+0000", 2023-09-30T17:04:10.889 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.9936543, 2023-09-30T17:04:10.889 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0052247409999999998, 2023-09-30T17:04:10.889 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.889 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:10.889 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.889 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.889 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.889 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110516 2023-09-30T17:04:10.889 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.889 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.889 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.890 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.890 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122720+0000", 2023-09-30T17:04:10.890 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.890 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.890 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.890 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.890 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122720+0000", 2023-09-30T17:04:10.890 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.890 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.891 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.891 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.891 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122721+0000", 2023-09-30T17:04:10.891 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3e-07 2023-09-30T17:04:10.891 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.891 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.891 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.891 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122733+0000", 2023-09-30T17:04:10.891 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2269000000000001e-05 2023-09-30T17:04:10.891 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.892 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.892 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.892 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122743+0000", 2023-09-30T17:04:10.892 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.312e-06 2023-09-30T17:04:10.892 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.892 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.892 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.892 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122749+0000", 2023-09-30T17:04:10.892 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4529999999999999e-06 2023-09-30T17:04:10.893 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.893 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.893 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.893 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.126424+0000", 2023-09-30T17:04:10.893 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0036752680000000002 2023-09-30T17:04:10.893 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.893 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.893 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.893 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.126513+0000", 2023-09-30T17:04:10.894 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8529999999999994e-05 2023-09-30T17:04:10.894 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.894 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.894 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.894 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.894 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.894 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109683 4.36 4:6fa85f86:::100000001f8.00000013:head [write 491520~4096 in=4096b,write 573440~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.894 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.704390+0000", 2023-09-30T17:04:10.895 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.41198492599999997, 2023-09-30T17:04:10.895 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.42359826499999997, 2023-09-30T17:04:10.895 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.895 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:10.895 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.895 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.895 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.895 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109683 2023-09-30T17:04:10.895 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.896 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.896 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.896 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.896 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.704390+0000", 2023-09-30T17:04:10.896 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.896 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.896 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.896 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.896 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.704390+0000", 2023-09-30T17:04:10.896 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.896 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.897 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.897 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.897 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.704390+0000", 2023-09-30T17:04:10.897 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1800000000000001e-07 2023-09-30T17:04:10.897 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.897 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.897 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.897 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.704412+0000", 2023-09-30T17:04:10.898 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1767999999999999e-05 2023-09-30T17:04:10.898 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.898 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.898 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.898 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.705174+0000", 2023-09-30T17:04:10.898 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00076232000000000003 2023-09-30T17:04:10.898 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.898 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.899 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.899 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.705184+0000", 2023-09-30T17:04:10.899 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0210000000000001e-05 2023-09-30T17:04:10.899 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.899 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.899 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.899 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.090705+0000", 2023-09-30T17:04:10.899 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.385520737 2023-09-30T17:04:10.899 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.900 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.900 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.900 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.090779+0000", 2023-09-30T17:04:10.900 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3716999999999999e-05 2023-09-30T17:04:10.900 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.900 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.900 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:10.900 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.090923+0000", 2023-09-30T17:04:10.900 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014392800000000001 2023-09-30T17:04:10.900 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.900 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.900 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:10.901 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.111435+0000", 2023-09-30T17:04:10.901 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.020512117999999999 2023-09-30T17:04:10.901 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.901 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.901 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.901 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.901 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.901 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110131 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.901 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.977258+0000", 2023-09-30T17:04:10.901 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.13911622700000001, 2023-09-30T17:04:10.901 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.15077759600000001, 2023-09-30T17:04:10.902 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.902 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.902 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.902 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.902 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.902 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110131 2023-09-30T17:04:10.902 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.902 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.902 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.902 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.902 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.977258+0000", 2023-09-30T17:04:10.903 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.903 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.903 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.903 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.903 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.977258+0000", 2023-09-30T17:04:10.903 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.903 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.903 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.903 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.903 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.977259+0000", 2023-09-30T17:04:10.903 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8000000000000001e-07 2023-09-30T17:04:10.904 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.904 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.904 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.904 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.977270+0000", 2023-09-30T17:04:10.904 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1219e-05 2023-09-30T17:04:10.904 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.904 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.904 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.904 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.977276+0000", 2023-09-30T17:04:10.904 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0290000000000002e-06 2023-09-30T17:04:10.904 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.904 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.905 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.905 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.977281+0000", 2023-09-30T17:04:10.905 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0869999999999997e-06 2023-09-30T17:04:10.905 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.905 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.905 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.905 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.905 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.905 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110190 4.6 4.692017c6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.905 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.997815+0000", 2023-09-30T17:04:10.905 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.118559124, 2023-09-30T17:04:10.905 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.130252797, 2023-09-30T17:04:10.906 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.906 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.906 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.906 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.906 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.906 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110190 2023-09-30T17:04:10.906 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.906 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.906 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.906 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.906 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.997815+0000", 2023-09-30T17:04:10.906 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.907 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.907 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.907 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.907 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.997815+0000", 2023-09-30T17:04:10.907 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.907 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.907 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.907 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.907 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.997816+0000", 2023-09-30T17:04:10.907 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2300000000000001e-07 2023-09-30T17:04:10.907 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.907 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.908 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.908 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.997830+0000", 2023-09-30T17:04:10.908 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4429e-05 2023-09-30T17:04:10.908 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.908 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.908 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.908 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.997838+0000", 2023-09-30T17:04:10.908 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0569999999999993e-06 2023-09-30T17:04:10.908 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.908 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.908 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.908 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.997844+0000", 2023-09-30T17:04:10.909 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9200000000000001e-06 2023-09-30T17:04:10.909 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.909 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.909 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.909 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.909 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.909 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110292 4.6 4.8232b686 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.909 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.051341+0000", 2023-09-30T17:04:10.909 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.065033365999999995, 2023-09-30T17:04:10.909 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.076761138000000007, 2023-09-30T17:04:10.909 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.910 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.910 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.910 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.910 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.910 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110292 2023-09-30T17:04:10.910 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.910 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.910 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.910 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.910 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051341+0000", 2023-09-30T17:04:10.910 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.911 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.911 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.911 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.911 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051341+0000", 2023-09-30T17:04:10.911 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.911 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.911 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.911 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.911 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051342+0000", 2023-09-30T17:04:10.911 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4999999999999998e-07 2023-09-30T17:04:10.911 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.911 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.912 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.912 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051357+0000", 2023-09-30T17:04:10.912 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5194000000000001e-05 2023-09-30T17:04:10.912 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.912 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.912 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.912 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051363+0000", 2023-09-30T17:04:10.912 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8359999999999997e-06 2023-09-30T17:04:10.912 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.912 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.912 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.913 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051367+0000", 2023-09-30T17:04:10.913 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7600000000000002e-06 2023-09-30T17:04:10.913 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.913 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.913 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.913 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.913 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.913 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110331 4.e 4.c27217ce (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.913 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.059408+0000", 2023-09-30T17:04:10.913 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.056966600999999999, 2023-09-30T17:04:10.913 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.068727440000000001, 2023-09-30T17:04:10.914 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.914 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.914 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.914 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.914 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.914 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110331 2023-09-30T17:04:10.914 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.914 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.914 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.914 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.915 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.059408+0000", 2023-09-30T17:04:10.915 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.915 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.915 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.915 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.915 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.059408+0000", 2023-09-30T17:04:10.915 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.915 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.915 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.915 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.915 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.059408+0000", 2023-09-30T17:04:10.916 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9299999999999998e-07 2023-09-30T17:04:10.916 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.916 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.916 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.916 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.059421+0000", 2023-09-30T17:04:10.916 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2266000000000001e-05 2023-09-30T17:04:10.916 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.916 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.916 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.916 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.059429+0000", 2023-09-30T17:04:10.916 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2490000000000001e-06 2023-09-30T17:04:10.916 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.917 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.917 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.917 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.059435+0000", 2023-09-30T17:04:10.917 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9209999999999997e-06 2023-09-30T17:04:10.917 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.917 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.917 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.917 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.917 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.917 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:110236 4.2f e51/17 4:f59f865b:::100000001f8.00000007:head v 51'1655, mlcod=51'1651)", 2023-09-30T17:04:10.917 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.095249+0000", 2023-09-30T17:04:10.917 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.021125718000000002, 2023-09-30T17:04:10.918 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.032935239999999998, 2023-09-30T17:04:10.918 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.918 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:10.918 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.918 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.918 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.918 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.095249+0000", 2023-09-30T17:04:10.918 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.918 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.918 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.918 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.919 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.095249+0000", 2023-09-30T17:04:10.919 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.919 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.919 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.919 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.919 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.095249+0000", 2023-09-30T17:04:10.919 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0800000000000005e-07 2023-09-30T17:04:10.919 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.919 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.919 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.919 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.095271+0000", 2023-09-30T17:04:10.920 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1316000000000001e-05 2023-09-30T17:04:10.920 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.920 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.920 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.920 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.095282+0000", 2023-09-30T17:04:10.920 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1090000000000001e-05 2023-09-30T17:04:10.920 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.920 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.920 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.920 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.095288+0000", 2023-09-30T17:04:10.920 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4640000000000003e-06 2023-09-30T17:04:10.920 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.921 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.921 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.921 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.101924+0000", 2023-09-30T17:04:10.921 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0066354730000000002 2023-09-30T17:04:10.921 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.921 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.921 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.921 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.101943+0000", 2023-09-30T17:04:10.921 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8915000000000001e-05 2023-09-30T17:04:10.921 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.921 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.921 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.922 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.922 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.922 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110442 4.8 4:11ee3b64:::100000001f8.0000003e:head [write 1318912~4096 in=4096b,write 1601536~4096 in=4096b,write 1740800~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.922 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.108213+0000", 2023-09-30T17:04:10.922 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0081614840000000001, 2023-09-30T17:04:10.922 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.020048531000000001, 2023-09-30T17:04:10.922 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.922 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:10.922 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.922 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.922 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.922 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110442 2023-09-30T17:04:10.923 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.923 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.923 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.923 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.923 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108213+0000", 2023-09-30T17:04:10.923 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.923 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.923 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.923 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.923 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108213+0000", 2023-09-30T17:04:10.923 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.924 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.924 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.924 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.924 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108214+0000", 2023-09-30T17:04:10.924 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3300000000000002e-07 2023-09-30T17:04:10.924 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.924 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.924 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.924 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108230+0000", 2023-09-30T17:04:10.924 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6776e-05 2023-09-30T17:04:10.924 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.924 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.925 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.925 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108240+0000", 2023-09-30T17:04:10.925 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.5799999999999998e-06 2023-09-30T17:04:10.925 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.925 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.925 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.925 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108247+0000", 2023-09-30T17:04:10.925 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4670000000000001e-06 2023-09-30T17:04:10.925 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.925 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.925 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.925 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108300+0000", 2023-09-30T17:04:10.926 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3539999999999999e-05 2023-09-30T17:04:10.926 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.926 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.926 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.926 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-09-30T17:04:10.928 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:10.927+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:10.929 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108391+0000", 2023-09-30T17:04:10.929 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.0880999999999999e-05 2023-09-30T17:04:10.929 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.929 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.929 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.929 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.929 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.929 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop_reply(client.4547.0:110329 4.3f e51/17)", 2023-09-30T17:04:10.930 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.116249+0000", 2023-09-30T17:04:10.930 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.000125971, 2023-09-30T17:04:10.930 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.012093738, 2023-09-30T17:04:10.930 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.930 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.930 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.930 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.930 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.930 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.116249+0000", 2023-09-30T17:04:10.930 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.930 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.931 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.931 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.931 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.116249+0000", 2023-09-30T17:04:10.931 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.931 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.931 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.931 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.931 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.116249+0000", 2023-09-30T17:04:10.931 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4499999999999998e-07 2023-09-30T17:04:10.931 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.931 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.931 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.932 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.116251+0000", 2023-09-30T17:04:10.932 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1890000000000001e-06 2023-09-30T17:04:10.932 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.932 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.932 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.932 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.116257+0000", 2023-09-30T17:04:10.932 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7769999999999999e-06 2023-09-30T17:04:10.932 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.932 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.932 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.932 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.116262+0000", 2023-09-30T17:04:10.933 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.95e-06 2023-09-30T17:04:10.933 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.933 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.933 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.933 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.933 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.933 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110517 4.2e 4.6cf07dae (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.933 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.122764+0000", 2023-09-30T17:04:10.933 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.9936109, 2023-09-30T17:04:10.933 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.005637469, 2023-09-30T17:04:10.933 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.934 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.934 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.934 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.934 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.934 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110517 2023-09-30T17:04:10.934 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.934 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.934 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.934 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.934 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122764+0000", 2023-09-30T17:04:10.935 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.935 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.935 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.935 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.935 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.122764+0000", 2023-09-30T17:04:10.935 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.935 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.935 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.935 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.935 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.124165+0000", 2023-09-30T17:04:10.935 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0014011570000000001 2023-09-30T17:04:10.935 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.936 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.936 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.936 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.124181+0000", 2023-09-30T17:04:10.936 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6120000000000002e-05 2023-09-30T17:04:10.936 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.936 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.936 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.936 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.124192+0000", 2023-09-30T17:04:10.936 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0710000000000001e-05 2023-09-30T17:04:10.936 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.936 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.936 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.937 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.124200+0000", 2023-09-30T17:04:10.937 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0690000000000002e-06 2023-09-30T17:04:10.937 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.937 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.937 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.937 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.937 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.937 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109943 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.937 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.894326+0000", 2023-09-30T17:04:10.937 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.22204870400000001, 2023-09-30T17:04:10.937 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23414359500000001, 2023-09-30T17:04:10.938 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.938 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.938 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.938 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.938 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.938 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109943 2023-09-30T17:04:10.938 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.938 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.938 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.938 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.938 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.894326+0000", 2023-09-30T17:04:10.939 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.939 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.939 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.939 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.939 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.894326+0000", 2023-09-30T17:04:10.939 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.939 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.939 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.939 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.939 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.894326+0000", 2023-09-30T17:04:10.939 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.2599999999999998e-07 2023-09-30T17:04:10.939 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.940 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.940 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.940 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.894337+0000", 2023-09-30T17:04:10.940 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.102e-05 2023-09-30T17:04:10.940 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.940 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.940 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.940 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.894342+0000", 2023-09-30T17:04:10.940 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8319999999999996e-06 2023-09-30T17:04:10.940 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.941 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.941 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.941 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.894346+0000", 2023-09-30T17:04:10.941 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6500000000000002e-06 2023-09-30T17:04:10.941 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.941 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.941 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.941 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.941 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.941 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110166 4.e 4.c27217ce (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.941 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.990328+0000", 2023-09-30T17:04:10.942 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.12604621799999999, 2023-09-30T17:04:10.942 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.13821827, 2023-09-30T17:04:10.942 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.942 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.942 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.942 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.942 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.942 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110166 2023-09-30T17:04:10.942 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.942 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.942 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.943 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.943 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.990328+0000", 2023-09-30T17:04:10.943 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.943 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.943 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.943 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.943 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.990328+0000", 2023-09-30T17:04:10.943 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.943 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.943 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.943 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.943 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.990329+0000", 2023-09-30T17:04:10.944 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6100000000000001e-07 2023-09-30T17:04:10.944 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.944 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.944 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.944 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.990340+0000", 2023-09-30T17:04:10.944 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1493e-05 2023-09-30T17:04:10.944 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.944 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.944 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.944 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.990346+0000", 2023-09-30T17:04:10.945 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9150000000000001e-06 2023-09-30T17:04:10.945 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.945 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.945 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.945 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.990351+0000", 2023-09-30T17:04:10.945 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6990000000000002e-06 2023-09-30T17:04:10.945 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.945 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.945 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.945 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.945 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.945 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110204 4.36 4.8d2c3936 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.946 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.012283+0000", 2023-09-30T17:04:10.946 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.104091893, 2023-09-30T17:04:10.946 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.116327876, 2023-09-30T17:04:10.946 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.946 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.946 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.946 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.946 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.946 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110204 2023-09-30T17:04:10.946 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.946 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.947 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.947 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.947 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.012283+0000", 2023-09-30T17:04:10.947 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.947 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.947 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.947 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.947 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.012283+0000", 2023-09-30T17:04:10.947 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.947 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.947 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.947 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.948 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.012283+0000", 2023-09-30T17:04:10.948 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.6400000000000002e-07 2023-09-30T17:04:10.948 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.948 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.948 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.948 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.012304+0000", 2023-09-30T17:04:10.948 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.0636999999999999e-05 2023-09-30T17:04:10.948 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.948 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.948 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.948 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.012314+0000", 2023-09-30T17:04:10.949 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0308e-05 2023-09-30T17:04:10.949 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.949 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.949 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.949 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.012321+0000", 2023-09-30T17:04:10.949 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9580000000000001e-06 2023-09-30T17:04:10.949 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.949 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.949 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.949 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.949 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.949 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110334 4.6 4.2d31fac6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.950 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.059443+0000", 2023-09-30T17:04:10.950 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.056931345000000001, 2023-09-30T17:04:10.950 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.069226779000000002, 2023-09-30T17:04:10.950 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.950 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.950 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.950 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.950 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.950 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110334 2023-09-30T17:04:10.950 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.950 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.951 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.951 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.951 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.059443+0000", 2023-09-30T17:04:10.951 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.951 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.951 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.951 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.951 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.059443+0000", 2023-09-30T17:04:10.951 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.951 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.951 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.951 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.952 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.059444+0000", 2023-09-30T17:04:10.952 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9500000000000003e-07 2023-09-30T17:04:10.952 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.952 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.952 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.952 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.059461+0000", 2023-09-30T17:04:10.952 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6841999999999999e-05 2023-09-30T17:04:10.952 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.952 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.952 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.952 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.059469+0000", 2023-09-30T17:04:10.952 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0770000000000008e-06 2023-09-30T17:04:10.953 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.953 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.953 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.953 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.059475+0000", 2023-09-30T17:04:10.953 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3219999999999998e-06 2023-09-30T17:04:10.953 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.953 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.953 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.953 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.953 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.953 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110407 4.3f 4.a34187bf (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.953 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.081226+0000", 2023-09-30T17:04:10.953 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.035148587000000002, 2023-09-30T17:04:10.954 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.047504354999999998, 2023-09-30T17:04:10.954 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.954 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.954 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.954 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.954 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.954 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110407 2023-09-30T17:04:10.954 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.954 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.954 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.954 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.954 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.081226+0000", 2023-09-30T17:04:10.955 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.955 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.955 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.955 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.955 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.081226+0000", 2023-09-30T17:04:10.955 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.955 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.955 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.955 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.955 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.081227+0000", 2023-09-30T17:04:10.955 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.6000000000000003e-07 2023-09-30T17:04:10.955 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.956 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.956 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.956 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.081247+0000", 2023-09-30T17:04:10.956 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.0083000000000001e-05 2023-09-30T17:04:10.956 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.956 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.956 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.956 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.081257+0000", 2023-09-30T17:04:10.956 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.961e-06 2023-09-30T17:04:10.956 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.956 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.956 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.957 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.081263+0000", 2023-09-30T17:04:10.957 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5209999999999999e-06 2023-09-30T17:04:10.957 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.957 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.957 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.957 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.957 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.957 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110447 4.3d 4:bfffac44:::100000001f8.0000000c:head [write 2854912~4096 in=4096b,write 2867200~4096 in=4096b,write 2928640~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.957 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.108265+0000", 2023-09-30T17:04:10.957 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.0081099129999999998, 2023-09-30T17:04:10.957 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.020536651999999999, 2023-09-30T17:04:10.957 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.958 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:10.958 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.958 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.958 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.958 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110447 2023-09-30T17:04:10.958 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.958 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.958 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.958 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.958 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108265+0000", 2023-09-30T17:04:10.958 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.959 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.959 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.959 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.959 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108265+0000", 2023-09-30T17:04:10.959 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.959 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.959 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.959 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.959 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108265+0000", 2023-09-30T17:04:10.959 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1900000000000003e-07 2023-09-30T17:04:10.959 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.961 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.961 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.961 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108278+0000", 2023-09-30T17:04:10.961 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3269e-05 2023-09-30T17:04:10.961 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.961 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.961 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.961 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108286+0000", 2023-09-30T17:04:10.962 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0639999999999994e-06 2023-09-30T17:04:10.962 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.962 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.962 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.962 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.108293+0000", 2023-09-30T17:04:10.962 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2339999999999999e-06 2023-09-30T17:04:10.962 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.962 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.962 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.962 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.110354+0000", 2023-09-30T17:04:10.962 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.002061621 2023-09-30T17:04:10.962 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.963 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.963 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.963 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.110441+0000", 2023-09-30T17:04:10.963 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.7058999999999994e-05 2023-09-30T17:04:10.963 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.963 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.963 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.963 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.963 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.963 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110486 4.8 4:11ee3b64:::100000001f8.0000003e:head [write 2674688~4096 in=4096b,write 2682880~4096 in=4096b,write 2691072~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.963 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.116267+0000", 2023-09-30T17:04:10.963 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.000107611, 2023-09-30T17:04:10.964 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.012623812999999999, 2023-09-30T17:04:10.964 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.964 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "started", 2023-09-30T17:04:10.964 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.964 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.964 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.964 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110486 2023-09-30T17:04:10.964 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.964 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.964 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.964 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.965 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.116267+0000", 2023-09-30T17:04:10.965 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.965 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.965 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.965 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.965 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.116267+0000", 2023-09-30T17:04:10.965 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.965 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.965 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.965 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.965 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.116267+0000", 2023-09-30T17:04:10.966 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2399999999999998e-07 2023-09-30T17:04:10.966 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.966 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.966 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.966 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.116286+0000", 2023-09-30T17:04:10.966 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8660000000000001e-05 2023-09-30T17:04:10.966 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.966 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.966 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.966 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.116295+0000", 2023-09-30T17:04:10.966 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1050000000000001e-06 2023-09-30T17:04:10.967 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.967 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.967 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.967 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.116302+0000", 2023-09-30T17:04:10.967 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4119999999999998e-06 2023-09-30T17:04:10.967 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.967 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.967 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:10.967 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.117771+0000", 2023-09-30T17:04:10.967 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0014690149999999999 2023-09-30T17:04:10.967 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.968 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.968 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:10.968 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.117859+0000", 2023-09-30T17:04:10.968 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8449000000000006e-05 2023-09-30T17:04:10.968 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.968 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.968 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.968 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.968 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.968 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:110328 4.37 e51/17)", 2023-09-30T17:04:10.968 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.126124+0000", 2023-09-30T17:04:10.969 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.9902506, 2023-09-30T17:04:10.969 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0028339659999999998, 2023-09-30T17:04:10.969 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.969 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.969 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.969 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.969 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.969 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.126124+0000", 2023-09-30T17:04:10.969 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.969 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.969 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.969 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.970 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.126124+0000", 2023-09-30T17:04:10.970 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.970 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.970 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.970 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.970 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.126125+0000", 2023-09-30T17:04:10.970 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.285e-06 2023-09-30T17:04:10.970 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.970 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.970 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.970 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.126139+0000", 2023-09-30T17:04:10.971 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4178999999999999e-05 2023-09-30T17:04:10.971 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.971 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.971 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.971 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.126155+0000", 2023-09-30T17:04:10.971 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5443000000000001e-05 2023-09-30T17:04:10.971 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.971 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.971 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.971 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.126167+0000", 2023-09-30T17:04:10.971 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2441e-05 2023-09-30T17:04:10.971 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.972 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.972 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.972 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.972 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.972 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109944 4.36 4.670445b6 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.972 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.894351+0000", 2023-09-30T17:04:10.972 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.222023366, 2023-09-30T17:04:10.972 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.234654206, 2023-09-30T17:04:10.972 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.972 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.972 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.972 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.973 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.973 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109944 2023-09-30T17:04:10.973 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.973 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.973 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.973 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.973 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.894351+0000", 2023-09-30T17:04:10.973 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.973 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.973 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.973 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.973 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.894351+0000", 2023-09-30T17:04:10.974 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.974 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.974 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.974 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.974 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.894351+0000", 2023-09-30T17:04:10.974 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0499999999999999e-07 2023-09-30T17:04:10.974 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.974 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.974 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.974 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.894361+0000", 2023-09-30T17:04:10.974 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8179999999999999e-06 2023-09-30T17:04:10.975 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.975 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.975 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.975 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.894365+0000", 2023-09-30T17:04:10.975 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8580000000000002e-06 2023-09-30T17:04:10.975 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.975 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.975 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.975 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.894368+0000", 2023-09-30T17:04:10.975 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.8210000000000002e-06 2023-09-30T17:04:10.975 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.975 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.976 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.976 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.976 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.976 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110133 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.976 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.977580+0000", 2023-09-30T17:04:10.976 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.13879426, 2023-09-30T17:04:10.976 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.15148135700000001, 2023-09-30T17:04:10.976 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.976 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.976 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.976 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.976 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.977 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110133 2023-09-30T17:04:10.977 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.977 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.977 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.977 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.977 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.977580+0000", 2023-09-30T17:04:10.977 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.977 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.977 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.977 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.977 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.977580+0000", 2023-09-30T17:04:10.977 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.978 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.978 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.978 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.978 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.977581+0000", 2023-09-30T17:04:10.978 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9500000000000001e-07 2023-09-30T17:04:10.978 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.978 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.978 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.978 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.977597+0000", 2023-09-30T17:04:10.978 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5970000000000001e-05 2023-09-30T17:04:10.978 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.979 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.979 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.979 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.977609+0000", 2023-09-30T17:04:10.979 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1928e-05 2023-09-30T17:04:10.979 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.979 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.979 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.979 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.977617+0000", 2023-09-30T17:04:10.979 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7910000000000005e-06 2023-09-30T17:04:10.979 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.979 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.979 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.980 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.980 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.980 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110192 4.6 4.8232b686 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.980 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.997885+0000", 2023-09-30T17:04:10.980 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.11848924600000001, 2023-09-30T17:04:10.980 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.13123360100000001, 2023-09-30T17:04:10.980 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.980 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.980 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.980 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.980 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.981 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110192 2023-09-30T17:04:10.981 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.981 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.981 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.981 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.981 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.997885+0000", 2023-09-30T17:04:10.981 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.981 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.981 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.981 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.981 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.997885+0000", 2023-09-30T17:04:10.982 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.982 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.982 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.982 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.982 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.999165+0000", 2023-09-30T17:04:10.982 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0012800120000000001 2023-09-30T17:04:10.982 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.982 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.982 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.982 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.999187+0000", 2023-09-30T17:04:10.982 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1288999999999999e-05 2023-09-30T17:04:10.982 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.983 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.983 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.983 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.999198+0000", 2023-09-30T17:04:10.983 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1804000000000001e-05 2023-09-30T17:04:10.983 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.983 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.983 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.983 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.999206+0000", 2023-09-30T17:04:10.983 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5680000000000002e-06 2023-09-30T17:04:10.983 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.983 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.984 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.984 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.984 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.984 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110205 4.6 4.13f6ab46 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.984 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.012333+0000", 2023-09-30T17:04:10.984 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 0.10404188, 2023-09-30T17:04:10.984 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.116847958, 2023-09-30T17:04:10.984 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.984 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.984 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.985 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.985 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.985 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110205 2023-09-30T17:04:10.985 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.985 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.985 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.985 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.985 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.012333+0000", 2023-09-30T17:04:10.985 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.985 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.985 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.985 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.986 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.012333+0000", 2023-09-30T17:04:10.986 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.986 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.986 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.986 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.986 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.012333+0000", 2023-09-30T17:04:10.986 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0999999999999999e-07 2023-09-30T17:04:10.986 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.986 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.986 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.986 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.012349+0000", 2023-09-30T17:04:10.987 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5353999999999999e-05 2023-09-30T17:04:10.987 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.987 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.987 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.987 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.012355+0000", 2023-09-30T17:04:10.987 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9210000000000003e-06 2023-09-30T17:04:10.987 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.987 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.987 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.987 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.012361+0000", 2023-09-30T17:04:10.987 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3279999999999996e-06 2023-09-30T17:04:10.988 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.988 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.988 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.988 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.988 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.988 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_repop(client.4547.0:110310 4.37 e51/17)", 2023-09-30T17:04:10.988 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.116521+0000", 2023-09-30T17:04:10.988 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.9998536, 2023-09-30T17:04:10.988 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.012715967999999999, 2023-09-30T17:04:10.988 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.988 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.989 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.989 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.989 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.989 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.116521+0000", 2023-09-30T17:04:10.989 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.989 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.989 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.989 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.989 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.116521+0000", 2023-09-30T17:04:10.989 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.989 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.989 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.990 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.990 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.116521+0000", 2023-09-30T17:04:10.990 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7700000000000004e-07 2023-09-30T17:04:10.990 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.990 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.990 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.990 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.116537+0000", 2023-09-30T17:04:10.990 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5803000000000001e-05 2023-09-30T17:04:10.990 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.990 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.990 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.991 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.116546+0000", 2023-09-30T17:04:10.991 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2189999999999993e-06 2023-09-30T17:04:10.991 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.991 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.991 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.991 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.116553+0000", 2023-09-30T17:04:10.991 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5359999999999998e-06 2023-09-30T17:04:10.991 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.991 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.991 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.991 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.992 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.992 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:110520 4.15 4.c27a5b55 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:10.992 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:10.124212+0000", 2023-09-30T17:04:10.992 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 4294967295.9921622, 2023-09-30T17:04:10.992 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0050793490000000004, 2023-09-30T17:04:10.992 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:10.992 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:10.992 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:10.992 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:10.992 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:10.992 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 110520 2023-09-30T17:04:10.993 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.993 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:10.993 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.993 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:10.993 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.124212+0000", 2023-09-30T17:04:10.993 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.993 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.993 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.993 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:10.993 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.124212+0000", 2023-09-30T17:04:10.994 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:10.994 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.994 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.994 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:10.994 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.126162+0000", 2023-09-30T17:04:10.994 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001950184 2023-09-30T17:04:10.994 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.994 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.994 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:10.994 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.126178+0000", 2023-09-30T17:04:10.995 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5841999999999998e-05 2023-09-30T17:04:10.995 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.995 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.995 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:10.995 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.126192+0000", 2023-09-30T17:04:10.995 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4080000000000001e-05 2023-09-30T17:04:10.995 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:10.995 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:10.995 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:10.995 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.126205+0000", 2023-09-30T17:04:10.995 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3027000000000001e-05 2023-09-30T17:04:10.995 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.996 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:10.996 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.996 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:10.996 INFO:teuthology.orchestra.run.smithi031.stdout: ], 2023-09-30T17:04:10.996 INFO:teuthology.orchestra.run.smithi031.stdout: "num_ops": 194 2023-09-30T17:04:10.996 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:04:10.996 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:04:11.027 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:11.028+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:11.128 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:11.128+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:11.205 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:04:11.205 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:04:11.206 INFO:teuthology.orchestra.run.smithi031.stdout: "complaint_time": 30, 2023-09-30T17:04:11.206 INFO:teuthology.orchestra.run.smithi031.stdout: "num_blocked_ops": 0 2023-09-30T17:04:11.206 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:04:11.222 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:04:11.277 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:11.277+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:11.330 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:11.330+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:11.416 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is unset 2023-09-30T17:04:11.431 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:11.431+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:11.440 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:04:11.440 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 20, 2023-09-30T17:04:11.440 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 600, 2023-09-30T17:04:11.440 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:04:11.440 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.440 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109497 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 49152~4096 in=4096b,write 106496~4096 in=4096b,write 163840~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:11.441 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.624224+0000", 2023-09-30T17:04:11.441 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 1.812567571, 2023-09-30T17:04:11.441 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.717345754, 2023-09-30T17:04:11.441 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:11.441 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:11.441 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:11.441 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:11.441 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:11.441 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109497 2023-09-30T17:04:11.441 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.441 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:11.442 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.442 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:11.442 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624224+0000", 2023-09-30T17:04:11.442 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:11.442 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.442 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.442 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:11.442 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624224+0000", 2023-09-30T17:04:11.442 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:11.442 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.443 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.443 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:11.443 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624224+0000", 2023-09-30T17:04:11.443 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9299999999999998e-07 2023-09-30T17:04:11.443 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.443 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.443 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:11.443 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624238+0000", 2023-09-30T17:04:11.443 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4144999999999999e-05 2023-09-30T17:04:11.443 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.443 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.443 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:11.444 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624439+0000", 2023-09-30T17:04:11.444 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00020105200000000001 2023-09-30T17:04:11.444 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.444 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.444 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.444 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624447+0000", 2023-09-30T17:04:11.444 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0499999999999992e-06 2023-09-30T17:04:11.444 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.444 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.444 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:11.444 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.022040+0000", 2023-09-30T17:04:11.444 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39759262099999998 2023-09-30T17:04:11.445 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.445 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.445 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:11.445 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.022117+0000", 2023-09-30T17:04:11.445 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6834000000000003e-05 2023-09-30T17:04:11.445 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.445 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.445 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:11.445 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.022269+0000", 2023-09-30T17:04:11.445 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015254600000000001 2023-09-30T17:04:11.445 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.445 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.446 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:11.446 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.058505+0000", 2023-09-30T17:04:11.446 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.036235394999999997 2023-09-30T17:04:11.446 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.446 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.446 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:11.446 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.341470+0000", 2023-09-30T17:04:11.446 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.28296523600000001 2023-09-30T17:04:11.446 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.446 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.446 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:11.447 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.341530+0000", 2023-09-30T17:04:11.447 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9939000000000003e-05 2023-09-30T17:04:11.447 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.447 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.447 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:11.447 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.341569+0000", 2023-09-30T17:04:11.447 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9342999999999999e-05 2023-09-30T17:04:11.447 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:11.447 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:11.447 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:11.447 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.447 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.447 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109508 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 2650112~4096 in=4096b,write 2723840~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:11.448 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.624554+0000", 2023-09-30T17:04:11.448 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 1.812236935, 2023-09-30T17:04:11.448 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.717264546, 2023-09-30T17:04:11.448 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:11.448 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:11.448 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:11.448 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:11.448 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:11.448 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109508 2023-09-30T17:04:11.448 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.448 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:11.448 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.449 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:11.449 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624554+0000", 2023-09-30T17:04:11.449 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:11.449 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.449 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.449 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:11.449 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624554+0000", 2023-09-30T17:04:11.449 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:11.449 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.449 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.449 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:11.449 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624555+0000", 2023-09-30T17:04:11.450 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.51e-07 2023-09-30T17:04:11.450 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.450 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.450 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:11.450 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624573+0000", 2023-09-30T17:04:11.450 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8519e-05 2023-09-30T17:04:11.450 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.450 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.450 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:11.450 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624582+0000", 2023-09-30T17:04:11.450 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.6489999999999997e-06 2023-09-30T17:04:11.451 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.451 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.451 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.451 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624588+0000", 2023-09-30T17:04:11.451 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4980000000000003e-06 2023-09-30T17:04:11.451 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.451 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.451 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:11.451 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.028302+0000", 2023-09-30T17:04:11.451 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.40371393 2023-09-30T17:04:11.451 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.451 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.452 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:11.452 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.028383+0000", 2023-09-30T17:04:11.452 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1069000000000006e-05 2023-09-30T17:04:11.452 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.452 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.452 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:11.452 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.028546+0000", 2023-09-30T17:04:11.452 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000162256 2023-09-30T17:04:11.452 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.452 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.452 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:11.452 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.058510+0000", 2023-09-30T17:04:11.453 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.029964937000000001 2023-09-30T17:04:11.453 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.453 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.453 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:11.453 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.341742+0000", 2023-09-30T17:04:11.453 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.28323117799999997 2023-09-30T17:04:11.453 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.453 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.453 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:11.453 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.341788+0000", 2023-09-30T17:04:11.453 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6118999999999997e-05 2023-09-30T17:04:11.454 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.454 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.454 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:11.454 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.341819+0000", 2023-09-30T17:04:11.454 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0939999999999999e-05 2023-09-30T17:04:11.454 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:11.454 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:11.454 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:11.454 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.454 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.454 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109527 4.6 4:616d4c41:::100000001f8.00000034:head [write 122880~4096 in=4096b,write 143360~4096 in=4096b,write 151552~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:11.454 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.630262+0000", 2023-09-30T17:04:11.455 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 1.8065293360000001, 2023-09-30T17:04:11.455 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.72988284299999995, 2023-09-30T17:04:11.455 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:11.455 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:11.455 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:11.455 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:11.455 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:11.455 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109527 2023-09-30T17:04:11.455 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.456 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:11.456 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.456 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:11.456 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.630262+0000", 2023-09-30T17:04:11.456 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:11.456 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.456 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.456 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:11.456 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.630262+0000", 2023-09-30T17:04:11.456 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:11.456 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.457 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.457 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:11.457 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.632170+0000", 2023-09-30T17:04:11.457 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0019085529999999999 2023-09-30T17:04:11.457 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.457 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.457 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:11.457 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.632192+0000", 2023-09-30T17:04:11.457 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1243999999999999e-05 2023-09-30T17:04:11.457 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.457 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.458 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:11.458 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.632203+0000", 2023-09-30T17:04:11.458 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1389999999999999e-05 2023-09-30T17:04:11.458 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.458 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.458 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.458 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.632211+0000", 2023-09-30T17:04:11.459 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8939999999999993e-06 2023-09-30T17:04:11.459 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.459 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.459 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:11.459 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.031203+0000", 2023-09-30T17:04:11.459 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39899208800000002 2023-09-30T17:04:11.459 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.459 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.459 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:11.460 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.031278+0000", 2023-09-30T17:04:11.460 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4988999999999996e-05 2023-09-30T17:04:11.460 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.460 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.460 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:11.460 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.031432+0000", 2023-09-30T17:04:11.460 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000154396 2023-09-30T17:04:11.460 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.460 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.460 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:11.461 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.058953+0000", 2023-09-30T17:04:11.461 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.027520464000000001 2023-09-30T17:04:11.461 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.461 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.461 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:11.461 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360042+0000", 2023-09-30T17:04:11.461 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.30108895699999999 2023-09-30T17:04:11.461 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.461 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.461 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:11.462 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360103+0000", 2023-09-30T17:04:11.462 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1364000000000004e-05 2023-09-30T17:04:11.462 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.462 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.462 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:11.462 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360145+0000", 2023-09-30T17:04:11.462 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1504000000000001e-05 2023-09-30T17:04:11.462 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:11.462 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:11.463 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:11.463 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.463 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.463 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109554 4.6 4:616d4c41:::100000001f8.00000034:head [write 1323008~4096 in=4096b,write 1675264~4096 in=4096b,write 1695744~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:11.463 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.646316+0000", 2023-09-30T17:04:11.463 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 1.790475021, 2023-09-30T17:04:11.463 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.71401674900000001, 2023-09-30T17:04:11.463 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:11.463 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:11.463 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:11.464 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:11.464 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:11.464 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109554 2023-09-30T17:04:11.464 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.464 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:11.464 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.464 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:11.464 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646316+0000", 2023-09-30T17:04:11.464 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:11.465 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.465 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.465 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:11.465 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646316+0000", 2023-09-30T17:04:11.465 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:11.465 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.465 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.465 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:11.465 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646317+0000", 2023-09-30T17:04:11.466 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9100000000000004e-07 2023-09-30T17:04:11.466 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.466 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.466 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:11.466 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646328+0000", 2023-09-30T17:04:11.466 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1832e-05 2023-09-30T17:04:11.466 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.466 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.467 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:11.467 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646335+0000", 2023-09-30T17:04:11.467 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7299999999999999e-06 2023-09-30T17:04:11.467 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.467 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.467 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.467 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646342+0000", 2023-09-30T17:04:11.467 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5309999999999998e-06 2023-09-30T17:04:11.467 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.467 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.468 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:11.468 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.033952+0000", 2023-09-30T17:04:11.468 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.38760991099999997 2023-09-30T17:04:11.468 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.468 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.468 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:11.468 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.034037+0000", 2023-09-30T17:04:11.468 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5483999999999997e-05 2023-09-30T17:04:11.468 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.469 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.469 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:11.469 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.034208+0000", 2023-09-30T17:04:11.469 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000170946 2023-09-30T17:04:11.469 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.469 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.469 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:11.470 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.058968+0000", 2023-09-30T17:04:11.470 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024760305 2023-09-30T17:04:11.470 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.470 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.470 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:11.470 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360244+0000", 2023-09-30T17:04:11.470 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.30127521699999998 2023-09-30T17:04:11.471 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.471 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.471 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:11.471 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360292+0000", 2023-09-30T17:04:11.471 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8689000000000001e-05 2023-09-30T17:04:11.471 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.471 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.471 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:11.471 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360333+0000", 2023-09-30T17:04:11.471 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0612999999999999e-05 2023-09-30T17:04:11.472 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:11.472 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:11.472 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:11.472 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.472 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.472 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109559 4.36 4:6da220e6:::100000001f8.0000003f:head [write 2142208~4096 in=4096b,write 2183168~4096 in=4096b,write 2220032~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:11.472 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.646349+0000", 2023-09-30T17:04:11.472 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 1.790442576, 2023-09-30T17:04:11.472 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.70604406399999997, 2023-09-30T17:04:11.472 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:11.472 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:11.472 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:11.473 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:11.473 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:11.473 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109559 2023-09-30T17:04:11.473 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.473 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:11.473 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.473 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:11.473 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646349+0000", 2023-09-30T17:04:11.473 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:11.473 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.473 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.474 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:11.474 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646349+0000", 2023-09-30T17:04:11.474 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:11.474 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.474 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.474 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:11.474 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646349+0000", 2023-09-30T17:04:11.474 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8500000000000002e-07 2023-09-30T17:04:11.474 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.474 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.475 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:11.475 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646360+0000", 2023-09-30T17:04:11.475 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1255e-05 2023-09-30T17:04:11.475 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.475 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.475 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:11.475 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646366+0000", 2023-09-30T17:04:11.475 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9959999999999999e-06 2023-09-30T17:04:11.475 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.475 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.475 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.475 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646371+0000", 2023-09-30T17:04:11.476 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9010000000000002e-06 2023-09-30T17:04:11.476 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.476 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.476 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:11.476 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.033938+0000", 2023-09-30T17:04:11.476 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.38756676699999998 2023-09-30T17:04:11.476 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.476 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.476 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:11.476 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.034023+0000", 2023-09-30T17:04:11.476 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5011000000000003e-05 2023-09-30T17:04:11.477 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.477 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.477 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:11.477 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.034178+0000", 2023-09-30T17:04:11.477 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000155267 2023-09-30T17:04:11.477 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.477 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.477 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:11.477 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.058961+0000", 2023-09-30T17:04:11.477 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024782786000000001 2023-09-30T17:04:11.478 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.478 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.478 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:11.478 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.352309+0000", 2023-09-30T17:04:11.478 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.29334778500000003 2023-09-30T17:04:11.478 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.478 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.478 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:11.478 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.352356+0000", 2023-09-30T17:04:11.478 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7153000000000001e-05 2023-09-30T17:04:11.479 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.479 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.479 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:11.479 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.352393+0000", 2023-09-30T17:04:11.479 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6658e-05 2023-09-30T17:04:11.479 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:11.479 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:11.479 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:11.479 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.479 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.479 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109562 4.6 4:616d4c41:::100000001f8.00000034:head [write 4071424~4096 in=4096b,write 4161536~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:11.479 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.650213+0000", 2023-09-30T17:04:11.480 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 1.7865778639999998, 2023-09-30T17:04:11.480 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.71023619199999999, 2023-09-30T17:04:11.480 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:11.480 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:11.480 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:11.480 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:11.480 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:11.480 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109562 2023-09-30T17:04:11.480 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.480 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:11.480 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.481 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:11.481 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.650213+0000", 2023-09-30T17:04:11.481 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:11.481 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.481 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.481 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:11.481 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.650213+0000", 2023-09-30T17:04:11.481 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:11.481 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.481 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.481 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:11.482 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.650214+0000", 2023-09-30T17:04:11.482 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1200000000000003e-07 2023-09-30T17:04:11.482 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.482 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.482 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:11.482 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.650227+0000", 2023-09-30T17:04:11.482 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.287e-05 2023-09-30T17:04:11.482 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.482 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.482 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:11.482 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.650235+0000", 2023-09-30T17:04:11.483 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8189999999999992e-06 2023-09-30T17:04:11.483 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.483 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.483 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.483 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.650241+0000", 2023-09-30T17:04:11.483 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3749999999999999e-06 2023-09-30T17:04:11.483 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.483 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.483 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:11.483 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.042530+0000", 2023-09-30T17:04:11.483 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39228892399999998 2023-09-30T17:04:11.483 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.484 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.484 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:11.484 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.042619+0000", 2023-09-30T17:04:11.484 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8838999999999994e-05 2023-09-30T17:04:11.484 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.484 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.484 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:11.484 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.042773+0000", 2023-09-30T17:04:11.484 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000154456 2023-09-30T17:04:11.484 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.484 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.485 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:11.485 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.059137+0000", 2023-09-30T17:04:11.485 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.016363800000000001 2023-09-30T17:04:11.485 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.485 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.485 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:11.485 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360385+0000", 2023-09-30T17:04:11.485 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.30124847199999999 2023-09-30T17:04:11.485 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.485 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.485 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:11.485 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360418+0000", 2023-09-30T17:04:11.486 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.2688000000000003e-05 2023-09-30T17:04:11.486 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.486 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.486 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:11.486 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360449+0000", 2023-09-30T17:04:11.486 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.1337000000000002e-05 2023-09-30T17:04:11.486 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:11.486 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:11.486 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:11.486 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.486 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.487 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109578 4.36 4:6fa85f86:::100000001f8.00000013:head [write 749568~4096 in=4096b,write 970752~4096 in=4096b,write 1007616~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:11.487 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.650465+0000", 2023-09-30T17:04:11.487 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 1.7863260190000001, 2023-09-30T17:04:11.487 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.70982843399999995, 2023-09-30T17:04:11.487 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:11.487 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:11.487 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:11.487 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:11.487 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:11.487 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109578 2023-09-30T17:04:11.487 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.487 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:11.488 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.488 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:11.488 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.650465+0000", 2023-09-30T17:04:11.488 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:11.488 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.488 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.488 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:11.488 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.650465+0000", 2023-09-30T17:04:11.488 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:11.488 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.488 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.489 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:11.489 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.654163+0000", 2023-09-30T17:04:11.489 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00369798 2023-09-30T17:04:11.489 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.489 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.489 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:11.489 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.654176+0000", 2023-09-30T17:04:11.489 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2765000000000001e-05 2023-09-30T17:04:11.489 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.489 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.489 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:11.489 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.654187+0000", 2023-09-30T17:04:11.490 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.078e-05 2023-09-30T17:04:11.490 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.490 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.490 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.490 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.654192+0000", 2023-09-30T17:04:11.490 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8880000000000002e-06 2023-09-30T17:04:11.490 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.490 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.490 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:11.490 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.045826+0000", 2023-09-30T17:04:11.491 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39163316300000001 2023-09-30T17:04:11.491 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.491 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.491 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:11.491 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.045900+0000", 2023-09-30T17:04:11.491 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3905000000000005e-05 2023-09-30T17:04:11.491 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.491 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.491 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:11.491 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.046309+0000", 2023-09-30T17:04:11.491 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00040957400000000001 2023-09-30T17:04:11.491 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.492 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.492 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:11.492 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.076789+0000", 2023-09-30T17:04:11.492 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.030479506999999999 2023-09-30T17:04:11.492 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.492 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.492 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:11.492 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360197+0000", 2023-09-30T17:04:11.492 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.28340816699999999 2023-09-30T17:04:11.493 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.493 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.493 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:11.493 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360254+0000", 2023-09-30T17:04:11.493 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7574000000000001e-05 2023-09-30T17:04:11.493 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.493 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.493 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:11.493 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360294+0000", 2023-09-30T17:04:11.493 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9131000000000002e-05 2023-09-30T17:04:11.494 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:11.494 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:11.494 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:11.494 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.494 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.494 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109582 4.6 4:616d4c41:::100000001f8.00000034:head [write 32768~4096 in=4096b,write 90112~4096 in=4096b,write 180224~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:11.494 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.654253+0000", 2023-09-30T17:04:11.494 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 1.7825377740000001, 2023-09-30T17:04:11.494 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.71919376800000001, 2023-09-30T17:04:11.494 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:11.494 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:11.495 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:11.495 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:11.495 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:11.495 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109582 2023-09-30T17:04:11.495 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.495 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:11.495 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.495 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:11.495 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.654253+0000", 2023-09-30T17:04:11.495 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:11.495 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.495 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.496 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:11.496 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.654253+0000", 2023-09-30T17:04:11.496 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:11.496 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.496 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.496 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:11.496 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658162+0000", 2023-09-30T17:04:11.496 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0039091320000000001 2023-09-30T17:04:11.496 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.497 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.497 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:11.497 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658178+0000", 2023-09-30T17:04:11.497 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5719e-05 2023-09-30T17:04:11.497 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.497 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.497 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:11.497 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658189+0000", 2023-09-30T17:04:11.497 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1043000000000001e-05 2023-09-30T17:04:11.498 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.498 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.498 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.498 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658198+0000", 2023-09-30T17:04:11.498 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4090000000000003e-06 2023-09-30T17:04:11.498 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.498 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.498 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:11.498 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051307+0000", 2023-09-30T17:04:11.498 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39310928899999997 2023-09-30T17:04:11.499 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.499 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.499 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:11.499 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051392+0000", 2023-09-30T17:04:11.499 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4850000000000002e-05 2023-09-30T17:04:11.499 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.499 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.499 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:11.500 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051575+0000", 2023-09-30T17:04:11.500 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00018296999999999999 2023-09-30T17:04:11.500 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.500 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.500 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:11.500 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.076797+0000", 2023-09-30T17:04:11.500 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.025222616999999999 2023-09-30T17:04:11.500 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.500 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.500 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:11.501 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.373335+0000", 2023-09-30T17:04:11.501 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.29653762299999997 2023-09-30T17:04:11.501 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.501 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.501 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:11.501 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.373404+0000", 2023-09-30T17:04:11.501 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8633999999999994e-05 2023-09-30T17:04:11.501 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.501 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.502 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:11.502 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.373447+0000", 2023-09-30T17:04:11.502 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3482000000000001e-05 2023-09-30T17:04:11.502 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:11.502 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:11.502 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:11.502 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.502 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.502 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109583 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 1945600~8192 in=8192b,write 2285568~4096 in=4096b,write 2301952~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:11.503 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.658212+0000", 2023-09-30T17:04:11.503 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 1.7785791, 2023-09-30T17:04:11.503 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.71553887199999999, 2023-09-30T17:04:11.503 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:11.503 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:11.503 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:11.503 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:11.503 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:11.503 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109583 2023-09-30T17:04:11.504 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.504 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:11.504 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.504 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:11.504 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658212+0000", 2023-09-30T17:04:11.504 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:11.504 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.504 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.505 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:11.505 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658212+0000", 2023-09-30T17:04:11.505 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:11.505 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.505 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.505 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:11.505 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658213+0000", 2023-09-30T17:04:11.505 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6000000000000004e-07 2023-09-30T17:04:11.506 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.506 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.506 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:11.506 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658225+0000", 2023-09-30T17:04:11.506 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2887e-05 2023-09-30T17:04:11.506 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.506 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.506 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:11.507 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658233+0000", 2023-09-30T17:04:11.507 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2620000000000001e-06 2023-09-30T17:04:11.507 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.507 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.507 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.507 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658239+0000", 2023-09-30T17:04:11.507 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4300000000000003e-06 2023-09-30T17:04:11.507 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.507 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.508 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:11.508 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.055877+0000", 2023-09-30T17:04:11.508 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39763770799999998 2023-09-30T17:04:11.508 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.508 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.508 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:11.508 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.055965+0000", 2023-09-30T17:04:11.508 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8125000000000001e-05 2023-09-30T17:04:11.508 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.508 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.508 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:11.509 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.056131+0000", 2023-09-30T17:04:11.509 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000165971 2023-09-30T17:04:11.509 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.509 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.509 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:11.509 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.077434+0000", 2023-09-30T17:04:11.509 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.021303441999999999 2023-09-30T17:04:11.509 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.509 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.509 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:11.509 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.373658+0000", 2023-09-30T17:04:11.509 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.29622356300000002 2023-09-30T17:04:11.510 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.510 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.510 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:11.510 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.373716+0000", 2023-09-30T17:04:11.510 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8161000000000001e-05 2023-09-30T17:04:11.510 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.510 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.510 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:11.510 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.373751+0000", 2023-09-30T17:04:11.510 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4762999999999999e-05 2023-09-30T17:04:11.510 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:11.510 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:11.511 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:11.511 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.511 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.511 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109594 4.36 4:6da220e6:::100000001f8.0000003f:head [write 3932160~4096 in=4096b,write 4038656~4096 in=4096b,write 4177920~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:11.511 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.674301+0000", 2023-09-30T17:04:11.511 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 1.762489628, 2023-09-30T17:04:11.511 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.69931127100000001, 2023-09-30T17:04:11.511 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:11.511 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:11.511 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:11.511 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:11.511 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:11.512 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109594 2023-09-30T17:04:11.512 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.512 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:11.512 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.512 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:11.512 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.674301+0000", 2023-09-30T17:04:11.512 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:11.512 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.512 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.512 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:11.512 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.674301+0000", 2023-09-30T17:04:11.513 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:11.513 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.513 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.513 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:11.513 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.674302+0000", 2023-09-30T17:04:11.513 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.46e-07 2023-09-30T17:04:11.513 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.513 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.513 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:11.513 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.674315+0000", 2023-09-30T17:04:11.513 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3213e-05 2023-09-30T17:04:11.513 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.514 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.514 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:11.514 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.674321+0000", 2023-09-30T17:04:11.514 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2400000000000004e-06 2023-09-30T17:04:11.514 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.514 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.514 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.514 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.674326+0000", 2023-09-30T17:04:11.514 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8670000000000002e-06 2023-09-30T17:04:11.514 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.514 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.515 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:11.515 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.059410+0000", 2023-09-30T17:04:11.515 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.38508374299999998 2023-09-30T17:04:11.515 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.515 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.515 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:11.515 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.059492+0000", 2023-09-30T17:04:11.515 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1868999999999998e-05 2023-09-30T17:04:11.515 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.515 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.515 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:11.516 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.059669+0000", 2023-09-30T17:04:11.516 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017732100000000001 2023-09-30T17:04:11.516 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.516 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.516 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:11.516 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.076933+0000", 2023-09-30T17:04:11.516 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.017263647 2023-09-30T17:04:11.516 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.516 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.516 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:11.516 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.373515+0000", 2023-09-30T17:04:11.517 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.29658226500000001 2023-09-30T17:04:11.517 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.517 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.517 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:11.517 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.373576+0000", 2023-09-30T17:04:11.517 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1245000000000001e-05 2023-09-30T17:04:11.517 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.517 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.517 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:11.517 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.373613+0000", 2023-09-30T17:04:11.517 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6415000000000003e-05 2023-09-30T17:04:11.518 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:11.518 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:11.518 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:11.518 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.518 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.518 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109602 4.6 4:616d4c41:::100000001f8.00000034:head [write 3518464~4096 in=4096b,write 3551232~4096 in=4096b,write 3563520~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:11.518 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.678286+0000", 2023-09-30T17:04:11.518 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 1.758505126, 2023-09-30T17:04:11.518 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.69560606300000005, 2023-09-30T17:04:11.518 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:11.518 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:11.518 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:11.519 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:11.519 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:11.519 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109602 2023-09-30T17:04:11.519 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.519 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:11.519 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.519 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:11.519 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.678286+0000", 2023-09-30T17:04:11.519 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:11.519 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.519 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.519 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:11.520 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.678286+0000", 2023-09-30T17:04:11.520 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:11.520 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.520 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.520 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:11.520 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.678287+0000", 2023-09-30T17:04:11.520 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2399999999999998e-07 2023-09-30T17:04:11.520 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.520 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.520 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:11.520 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.678300+0000", 2023-09-30T17:04:11.521 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.324e-05 2023-09-30T17:04:11.521 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.521 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.521 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:11.521 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.678307+0000", 2023-09-30T17:04:11.521 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6499999999999996e-06 2023-09-30T17:04:11.521 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.521 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.521 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.521 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.678319+0000", 2023-09-30T17:04:11.521 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1299e-05 2023-09-30T17:04:11.522 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.522 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.522 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:11.522 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.061263+0000", 2023-09-30T17:04:11.522 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.382943743 2023-09-30T17:04:11.522 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.522 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.522 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:11.522 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.061340+0000", 2023-09-30T17:04:11.522 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7254000000000003e-05 2023-09-30T17:04:11.522 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.523 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.523 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:11.523 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.061491+0000", 2023-09-30T17:04:11.523 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015150799999999999 2023-09-30T17:04:11.523 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.523 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.523 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:11.523 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.077440+0000", 2023-09-30T17:04:11.523 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.015948721999999999 2023-09-30T17:04:11.523 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.523 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.524 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:11.524 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.373804+0000", 2023-09-30T17:04:11.524 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.29636358499999998 2023-09-30T17:04:11.524 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.524 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.524 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:11.524 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.373858+0000", 2023-09-30T17:04:11.524 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4667999999999999e-05 2023-09-30T17:04:11.524 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.524 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.524 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:11.524 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.373892+0000", 2023-09-30T17:04:11.525 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3769999999999997e-05 2023-09-30T17:04:11.525 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:11.525 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:11.525 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:11.525 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.525 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.525 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109673 4.6 4:63e80496:::100000001f8.0000001e:head [write 1171456~4096 in=4096b,write 1191936~4096 in=4096b,write 1306624~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:11.525 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.702252+0000", 2023-09-30T17:04:11.525 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 1.7345387539999999, 2023-09-30T17:04:11.525 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.69650071899999999, 2023-09-30T17:04:11.525 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:11.525 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:11.526 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:11.526 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:11.526 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:11.526 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109673 2023-09-30T17:04:11.526 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.526 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:11.526 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.526 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:11.526 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.702252+0000", 2023-09-30T17:04:11.526 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:11.526 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.526 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.527 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:11.527 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.702252+0000", 2023-09-30T17:04:11.527 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:11.527 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.527 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.527 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:11.527 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.704165+0000", 2023-09-30T17:04:11.527 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0019122029999999999 2023-09-30T17:04:11.527 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.527 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.527 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:11.528 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.704186+0000", 2023-09-30T17:04:11.528 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1418999999999999e-05 2023-09-30T17:04:11.528 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.528 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.528 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:11.528 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.704201+0000", 2023-09-30T17:04:11.528 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4993e-05 2023-09-30T17:04:11.528 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.529 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.529 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.529 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.704209+0000", 2023-09-30T17:04:11.529 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.588e-06 2023-09-30T17:04:11.529 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.529 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.529 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:11.529 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.086167+0000", 2023-09-30T17:04:11.529 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.38195870999999998 2023-09-30T17:04:11.529 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.529 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.530 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:11.530 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.086224+0000", 2023-09-30T17:04:11.530 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6711e-05 2023-09-30T17:04:11.530 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.530 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.530 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:11.530 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.086332+0000", 2023-09-30T17:04:11.530 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000107865 2023-09-30T17:04:11.530 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.531 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.531 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:11.531 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.106480+0000", 2023-09-30T17:04:11.531 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.02014817 2023-09-30T17:04:11.531 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.531 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.531 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:11.531 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.398668+0000", 2023-09-30T17:04:11.531 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.29218772599999998 2023-09-30T17:04:11.531 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.532 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.532 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:11.532 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.398708+0000", 2023-09-30T17:04:11.532 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0176999999999998e-05 2023-09-30T17:04:11.532 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.532 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.532 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:11.532 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.398753+0000", 2023-09-30T17:04:11.532 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5157000000000002e-05 2023-09-30T17:04:11.532 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:11.533 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:11.533 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:11.533 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.533 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.533 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109683 4.36 4:6fa85f86:::100000001f8.00000013:head [write 491520~4096 in=4096b,write 573440~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:11.533 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.704390+0000", 2023-09-30T17:04:11.533 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 1.732401471, 2023-09-30T17:04:11.533 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.70242975500000004, 2023-09-30T17:04:11.533 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:11.533 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:11.534 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:11.534 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:11.534 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:11.534 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109683 2023-09-30T17:04:11.534 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.534 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:11.534 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.534 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:11.534 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.704390+0000", 2023-09-30T17:04:11.535 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:11.535 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.535 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.535 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:11.535 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.704390+0000", 2023-09-30T17:04:11.535 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:11.535 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.535 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.535 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:11.535 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.704390+0000", 2023-09-30T17:04:11.535 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1800000000000001e-07 2023-09-30T17:04:11.536 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.536 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.536 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:11.536 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.704412+0000", 2023-09-30T17:04:11.536 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1767999999999999e-05 2023-09-30T17:04:11.536 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.536 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.536 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:11.536 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.705174+0000", 2023-09-30T17:04:11.537 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00076232000000000003 2023-09-30T17:04:11.537 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.537 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.537 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.537 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.705184+0000", 2023-09-30T17:04:11.537 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0210000000000001e-05 2023-09-30T17:04:11.537 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.537 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.537 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:11.538 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.090705+0000", 2023-09-30T17:04:11.538 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.385520737 2023-09-30T17:04:11.538 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.538 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.538 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:11.538 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.090779+0000", 2023-09-30T17:04:11.538 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3716999999999999e-05 2023-09-30T17:04:11.538 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.538 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.538 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:11.539 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.090923+0000", 2023-09-30T17:04:11.539 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014392800000000001 2023-09-30T17:04:11.539 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.539 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.539 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:11.539 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.111435+0000", 2023-09-30T17:04:11.539 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.020512117999999999 2023-09-30T17:04:11.539 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.539 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.540 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:11.540 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.406730+0000", 2023-09-30T17:04:11.540 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.29529477999999998 2023-09-30T17:04:11.540 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.540 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.540 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:11.540 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.406786+0000", 2023-09-30T17:04:11.540 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6088999999999998e-05 2023-09-30T17:04:11.541 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.541 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.541 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:11.541 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.406819+0000", 2023-09-30T17:04:11.541 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3670000000000001e-05 2023-09-30T17:04:11.541 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:11.541 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:11.541 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:11.541 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.542 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.542 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109692 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 2957312~4096 in=4096b,write 3039232~4096 in=4096b,write 3047424~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:11.542 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.707348+0000", 2023-09-30T17:04:11.542 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 1.729443219, 2023-09-30T17:04:11.542 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.70916258899999995, 2023-09-30T17:04:11.542 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:11.542 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:11.542 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:11.542 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:11.542 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:11.542 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109692 2023-09-30T17:04:11.542 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.543 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:11.543 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.543 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:11.543 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.707348+0000", 2023-09-30T17:04:11.543 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:11.543 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.543 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.543 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:11.543 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.707348+0000", 2023-09-30T17:04:11.543 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:11.543 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.544 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.544 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:11.544 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.707348+0000", 2023-09-30T17:04:11.544 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8400000000000004e-07 2023-09-30T17:04:11.544 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.544 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.544 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:11.544 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.707362+0000", 2023-09-30T17:04:11.544 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3131e-05 2023-09-30T17:04:11.544 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.544 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.545 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:11.545 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.707369+0000", 2023-09-30T17:04:11.545 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.875e-06 2023-09-30T17:04:11.545 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.545 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.545 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.545 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.707375+0000", 2023-09-30T17:04:11.545 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7799999999999997e-06 2023-09-30T17:04:11.545 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.545 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.545 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:11.545 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.093520+0000", 2023-09-30T17:04:11.546 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.38614510299999999 2023-09-30T17:04:11.546 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.546 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.546 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:11.546 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.093592+0000", 2023-09-30T17:04:11.546 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1588999999999995e-05 2023-09-30T17:04:11.546 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.546 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.546 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:11.546 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.093734+0000", 2023-09-30T17:04:11.546 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014193800000000001 2023-09-30T17:04:11.546 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.547 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.547 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:11.547 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.111441+0000", 2023-09-30T17:04:11.547 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.017706676000000001 2023-09-30T17:04:11.547 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.547 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.547 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:11.547 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.416425+0000", 2023-09-30T17:04:11.547 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.30498444499999999 2023-09-30T17:04:11.547 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.547 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.547 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:11.548 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.416475+0000", 2023-09-30T17:04:11.548 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0427999999999999e-05 2023-09-30T17:04:11.548 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.548 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.548 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:11.548 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.416510+0000", 2023-09-30T17:04:11.548 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5040000000000003e-05 2023-09-30T17:04:11.548 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:11.548 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:11.548 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:11.548 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.548 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.549 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109697 4.6 4:63e80496:::100000001f8.0000001e:head [write 1617920~4096 in=4096b,write 1830912~4096 in=4096b,write 1875968~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:11.549 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.711270+0000", 2023-09-30T17:04:11.549 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 1.725520846, 2023-09-30T17:04:11.549 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.70601983400000001, 2023-09-30T17:04:11.549 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:11.549 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:11.549 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:11.549 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:11.549 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:11.549 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109697 2023-09-30T17:04:11.549 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.549 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:11.550 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.550 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:11.550 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.711270+0000", 2023-09-30T17:04:11.550 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:11.550 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.550 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.550 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:11.550 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.711270+0000", 2023-09-30T17:04:11.550 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:11.550 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.550 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.551 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:11.551 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.711271+0000", 2023-09-30T17:04:11.551 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4400000000000001e-07 2023-09-30T17:04:11.551 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.551 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.551 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:11.551 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.711284+0000", 2023-09-30T17:04:11.551 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.342e-05 2023-09-30T17:04:11.551 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.551 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.551 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:11.551 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.711296+0000", 2023-09-30T17:04:11.552 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2309e-05 2023-09-30T17:04:11.552 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.552 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.552 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.552 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.711303+0000", 2023-09-30T17:04:11.552 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9789999999999996e-06 2023-09-30T17:04:11.552 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.552 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.552 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:11.552 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.098461+0000", 2023-09-30T17:04:11.552 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.38715737300000003 2023-09-30T17:04:11.552 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.553 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.553 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:11.553 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.098551+0000", 2023-09-30T17:04:11.553 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.0610000000000002e-05 2023-09-30T17:04:11.553 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.553 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.553 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:11.553 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.098728+0000", 2023-09-30T17:04:11.553 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017616499999999999 2023-09-30T17:04:11.553 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.553 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.553 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:11.554 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.123046+0000", 2023-09-30T17:04:11.554 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024318095000000001 2023-09-30T17:04:11.554 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.554 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.554 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:11.554 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.417208+0000", 2023-09-30T17:04:11.554 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.29416202499999999 2023-09-30T17:04:11.554 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.554 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.554 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:11.555 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.417257+0000", 2023-09-30T17:04:11.555 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9249999999999998e-05 2023-09-30T17:04:11.555 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.555 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.555 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:11.555 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.417290+0000", 2023-09-30T17:04:11.555 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3164000000000003e-05 2023-09-30T17:04:11.555 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:11.555 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:11.555 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:11.555 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.556 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.556 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109719 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 3416064~4096 in=4096b,write 3436544~4096 in=4096b,write 3448832~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:11.556 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.719273+0000", 2023-09-30T17:04:11.556 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 1.7175185320000002, 2023-09-30T17:04:11.556 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.69986670399999995, 2023-09-30T17:04:11.556 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:11.556 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:11.556 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:11.556 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:11.556 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:11.556 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109719 2023-09-30T17:04:11.557 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.557 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:11.557 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.557 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:11.557 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.719273+0000", 2023-09-30T17:04:11.557 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:11.557 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.557 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.557 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:11.557 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.719273+0000", 2023-09-30T17:04:11.557 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:11.557 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.558 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.558 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:11.558 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.719273+0000", 2023-09-30T17:04:11.558 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0399999999999996e-07 2023-09-30T17:04:11.558 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.558 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.558 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:11.558 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.719288+0000", 2023-09-30T17:04:11.558 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4516e-05 2023-09-30T17:04:11.558 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.558 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.558 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:11.559 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.719297+0000", 2023-09-30T17:04:11.559 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.6129999999999993e-06 2023-09-30T17:04:11.559 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.559 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.559 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.559 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.719305+0000", 2023-09-30T17:04:11.559 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.306e-06 2023-09-30T17:04:11.559 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.559 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.559 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:11.559 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.111467+0000", 2023-09-30T17:04:11.559 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.392162185 2023-09-30T17:04:11.560 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.560 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.560 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:11.560 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.111550+0000", 2023-09-30T17:04:11.560 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3410000000000003e-05 2023-09-30T17:04:11.560 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.560 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.560 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:11.560 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.111723+0000", 2023-09-30T17:04:11.560 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017283899999999999 2023-09-30T17:04:11.560 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.560 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.561 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:11.561 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.146287+0000", 2023-09-30T17:04:11.561 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.034563582000000002 2023-09-30T17:04:11.561 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.561 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.561 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:11.561 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.419037+0000", 2023-09-30T17:04:11.561 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.272750206 2023-09-30T17:04:11.561 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.561 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.562 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:11.562 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.419100+0000", 2023-09-30T17:04:11.562 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2884000000000003e-05 2023-09-30T17:04:11.562 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.562 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.562 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:11.562 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.419139+0000", 2023-09-30T17:04:11.562 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9558999999999999e-05 2023-09-30T17:04:11.563 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:11.563 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:11.563 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:11.563 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.563 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.563 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109739 4.6 4:616d4c41:::100000001f8.00000034:head [write 471040~4096 in=4096b,write 512000~4096 in=4096b,write 548864~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:11.563 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.729634+0000", 2023-09-30T17:04:11.563 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 1.7071570390000002, 2023-09-30T17:04:11.563 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.69994692599999997, 2023-09-30T17:04:11.563 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:11.563 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:11.564 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:11.564 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:11.564 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:11.564 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109739 2023-09-30T17:04:11.564 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.564 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:11.564 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.564 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:11.564 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.729634+0000", 2023-09-30T17:04:11.565 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:11.565 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.565 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.565 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:11.565 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.729634+0000", 2023-09-30T17:04:11.565 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:11.565 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.565 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.565 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:11.565 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.731164+0000", 2023-09-30T17:04:11.565 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0015297399999999999 2023-09-30T17:04:11.566 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.566 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.566 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:11.566 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.731180+0000", 2023-09-30T17:04:11.566 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6288000000000001e-05 2023-09-30T17:04:11.566 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.566 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.566 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:11.566 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.731193+0000", 2023-09-30T17:04:11.566 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3362e-05 2023-09-30T17:04:11.566 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.566 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.567 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.567 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.731201+0000", 2023-09-30T17:04:11.567 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9310000000000008e-06 2023-09-30T17:04:11.567 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.567 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.567 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:11.567 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.117287+0000", 2023-09-30T17:04:11.567 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.38608599500000002 2023-09-30T17:04:11.567 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.567 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.567 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:11.567 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.117357+0000", 2023-09-30T17:04:11.568 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9683000000000004e-05 2023-09-30T17:04:11.568 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.568 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.568 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:11.568 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.117526+0000", 2023-09-30T17:04:11.568 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016906399999999999 2023-09-30T17:04:11.568 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.568 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.568 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:11.568 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.146293+0000", 2023-09-30T17:04:11.568 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.028767310000000001 2023-09-30T17:04:11.569 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.569 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.569 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:11.569 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.429490+0000", 2023-09-30T17:04:11.569 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.28319694400000001 2023-09-30T17:04:11.569 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.569 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.569 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:11.569 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.429544+0000", 2023-09-30T17:04:11.570 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3635999999999999e-05 2023-09-30T17:04:11.570 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.570 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.570 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:11.570 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.429581+0000", 2023-09-30T17:04:11.570 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6973e-05 2023-09-30T17:04:11.570 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:11.570 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:11.570 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:11.570 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.571 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.571 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109743 4.36 4:6da220e6:::100000001f8.0000003f:head [write 73728~4096 in=4096b,write 90112~4096 in=4096b,write 475136~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:11.571 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.731305+0000", 2023-09-30T17:04:11.571 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 1.7054858830000001, 2023-09-30T17:04:11.571 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.69236546499999996, 2023-09-30T17:04:11.571 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:11.571 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:11.571 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:11.571 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:11.572 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:11.572 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109743 2023-09-30T17:04:11.572 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.572 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:11.572 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.572 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:11.572 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.731305+0000", 2023-09-30T17:04:11.572 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:11.572 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.572 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.573 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:11.573 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.731305+0000", 2023-09-30T17:04:11.573 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:11.573 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.573 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.573 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:11.573 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.731306+0000", 2023-09-30T17:04:11.573 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4799999999999998e-07 2023-09-30T17:04:11.574 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.574 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.574 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:11.574 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.731319+0000", 2023-09-30T17:04:11.574 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2982999999999999e-05 2023-09-30T17:04:11.574 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.574 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.574 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:11.574 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.731327+0000", 2023-09-30T17:04:11.574 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6799999999999993e-06 2023-09-30T17:04:11.575 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.575 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.575 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.575 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.731333+0000", 2023-09-30T17:04:11.575 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.6490000000000002e-06 2023-09-30T17:04:11.575 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.575 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.575 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:11.575 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.121729+0000", 2023-09-30T17:04:11.576 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39039577199999997 2023-09-30T17:04:11.576 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.576 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.576 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:11.576 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.121811+0000", 2023-09-30T17:04:11.576 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1966999999999996e-05 2023-09-30T17:04:11.576 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.576 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.576 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:11.576 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.121982+0000", 2023-09-30T17:04:11.576 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017118499999999999 2023-09-30T17:04:11.576 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.577 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.577 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:11.577 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.158607+0000", 2023-09-30T17:04:11.577 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.036625090999999999 2023-09-30T17:04:11.577 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.577 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.577 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:11.577 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.423611+0000", 2023-09-30T17:04:11.577 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.26500405799999999 2023-09-30T17:04:11.577 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.578 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.578 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:11.578 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.423646+0000", 2023-09-30T17:04:11.578 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4511000000000002e-05 2023-09-30T17:04:11.578 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.578 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.578 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:11.578 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.423671+0000", 2023-09-30T17:04:11.578 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4921000000000001e-05 2023-09-30T17:04:11.578 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:11.579 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:11.579 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:11.579 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.579 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.579 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109753 4.36 4:6fa85f86:::100000001f8.00000013:head [write 323584~4096,write 372736~4096,write 405504~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:11.579 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.735275+0000", 2023-09-30T17:04:11.579 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 1.701515771, 2023-09-30T17:04:11.579 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.69442762599999996, 2023-09-30T17:04:11.580 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:11.580 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:11.580 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:11.580 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:11.580 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:11.580 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109753 2023-09-30T17:04:11.580 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.580 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:11.580 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.581 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:11.581 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.735275+0000", 2023-09-30T17:04:11.581 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:11.581 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.581 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.581 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:11.581 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.735275+0000", 2023-09-30T17:04:11.581 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:11.581 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.581 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.581 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:11.582 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.737163+0000", 2023-09-30T17:04:11.582 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0018874359999999999 2023-09-30T17:04:11.582 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.582 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.582 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:11.582 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.737179+0000", 2023-09-30T17:04:11.582 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6144999999999999e-05 2023-09-30T17:04:11.582 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.582 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.582 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:11.583 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.737190+0000", 2023-09-30T17:04:11.583 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0674e-05 2023-09-30T17:04:11.583 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.583 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.583 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.583 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.737201+0000", 2023-09-30T17:04:11.583 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1395e-05 2023-09-30T17:04:11.583 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.583 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.583 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:11.583 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.128199+0000", 2023-09-30T17:04:11.584 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39099774399999998 2023-09-30T17:04:11.584 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.584 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.584 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:11.584 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.128286+0000", 2023-09-30T17:04:11.584 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.6990000000000006e-05 2023-09-30T17:04:11.584 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.584 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.584 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:11.584 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.128457+0000", 2023-09-30T17:04:11.584 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000171535 2023-09-30T17:04:11.584 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.585 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.585 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:11.585 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.158751+0000", 2023-09-30T17:04:11.585 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.030294116999999999 2023-09-30T17:04:11.585 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.585 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.585 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:11.585 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.429622+0000", 2023-09-30T17:04:11.585 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.270870528 2023-09-30T17:04:11.585 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.585 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.585 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:11.586 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.429670+0000", 2023-09-30T17:04:11.586 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7997999999999997e-05 2023-09-30T17:04:11.586 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.586 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.586 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:11.586 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.429703+0000", 2023-09-30T17:04:11.586 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3064000000000001e-05 2023-09-30T17:04:11.586 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:11.586 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:11.586 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:11.586 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.586 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.587 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109754 4.6 4:616d4c41:::100000001f8.00000034:head [write 2998272~4096 in=4096b,write 3006464~4096 in=4096b,write 3014656~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:11.587 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.737214+0000", 2023-09-30T17:04:11.587 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 1.6995771579999999, 2023-09-30T17:04:11.587 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.69251004299999996, 2023-09-30T17:04:11.587 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:11.587 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:11.587 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:11.587 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:11.587 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:11.587 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109754 2023-09-30T17:04:11.587 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.588 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:11.588 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.588 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:11.588 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.737214+0000", 2023-09-30T17:04:11.588 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:11.588 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.588 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.588 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:11.588 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.737214+0000", 2023-09-30T17:04:11.588 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:11.588 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.589 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.589 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:11.589 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.739164+0000", 2023-09-30T17:04:11.589 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001949943 2023-09-30T17:04:11.589 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.589 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.589 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:11.589 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.739180+0000", 2023-09-30T17:04:11.589 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5862000000000002e-05 2023-09-30T17:04:11.589 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.589 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.589 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:11.590 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.739190+0000", 2023-09-30T17:04:11.590 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8009999999999998e-06 2023-09-30T17:04:11.590 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.590 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.590 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.590 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.739195+0000", 2023-09-30T17:04:11.590 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5990000000000001e-06 2023-09-30T17:04:11.590 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.590 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.590 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:11.590 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.126921+0000", 2023-09-30T17:04:11.590 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.38772617799999998 2023-09-30T17:04:11.590 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.591 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.591 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:11.591 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.126995+0000", 2023-09-30T17:04:11.591 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3647999999999997e-05 2023-09-30T17:04:11.591 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.591 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.591 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:11.591 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.127141+0000", 2023-09-30T17:04:11.591 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000145833 2023-09-30T17:04:11.591 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.591 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.592 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:11.592 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.158784+0000", 2023-09-30T17:04:11.592 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.031642925000000002 2023-09-30T17:04:11.592 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.592 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.592 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:11.592 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.429643+0000", 2023-09-30T17:04:11.592 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.270859395 2023-09-30T17:04:11.592 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.592 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.592 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:11.592 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.429691+0000", 2023-09-30T17:04:11.593 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7614999999999997e-05 2023-09-30T17:04:11.593 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:11.593 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:11.593 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:11.593 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.429724+0000", 2023-09-30T17:04:11.593 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3244000000000002e-05 2023-09-30T17:04:11.593 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:11.593 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:11.593 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:11.593 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:11.593 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:11.593 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:04:11.595 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:04:11.596 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:11.595+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:11.658 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-09-30T17:04:11.697 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:11.698+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:11.798 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:11.798+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:11.818 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:04:11.818 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2023-09-30T17:04:11.818 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.818 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:114577 4.37 4:eff9002a:::100000001f8.00000003:head [write 2101248~4096 in=4096b,write 2117632~4096 in=4096b,write 2211840~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:11.818 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.206711+0000", 2023-09-30T17:04:11.818 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.58652950599999998, 2023-09-30T17:04:11.818 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.58655911100000002, 2023-09-30T17:04:11.818 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:11.818 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:11.819 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:11.819 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:11.819 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:11.819 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 114577 2023-09-30T17:04:11.819 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.819 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:11.819 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.819 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:11.819 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.206711+0000", 2023-09-30T17:04:11.819 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.820 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.820 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.820 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:11.820 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.206711+0000", 2023-09-30T17:04:11.820 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.820 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.820 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.820 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:11.820 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.208515+0000", 2023-09-30T17:04:11.820 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001804702 2023-09-30T17:04:11.820 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.821 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.821 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:11.821 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.208536+0000", 2023-09-30T17:04:11.821 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0074000000000001e-05 2023-09-30T17:04:11.821 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.821 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.821 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:11.821 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.208548+0000", 2023-09-30T17:04:11.821 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1939e-05 2023-09-30T17:04:11.821 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.821 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.821 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.822 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.208555+0000", 2023-09-30T17:04:11.822 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4320000000000002e-06 2023-09-30T17:04:11.822 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.822 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.822 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:11.822 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.755801+0000", 2023-09-30T17:04:11.822 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.54724641299999999 2023-09-30T17:04:11.822 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.822 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.822 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:11.822 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.755870+0000", 2023-09-30T17:04:11.822 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8670000000000005e-05 2023-09-30T17:04:11.823 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.823 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.823 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:11.823 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.756708+0000", 2023-09-30T17:04:11.823 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00083757999999999999 2023-09-30T17:04:11.823 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.823 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.823 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:11.823 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.790557+0000", 2023-09-30T17:04:11.823 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033849168999999998 2023-09-30T17:04:11.823 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.824 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:11.824 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.824 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.824 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.824 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:114616 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 3989504~4096 in=4096b,write 4030464~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:11.824 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.222346+0000", 2023-09-30T17:04:11.824 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.57089413300000003, 2023-09-30T17:04:11.824 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.57101561099999998, 2023-09-30T17:04:11.824 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:11.824 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:11.824 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:11.824 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:11.825 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:11.825 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 114616 2023-09-30T17:04:11.825 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.825 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:11.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.825 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:11.825 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.222346+0000", 2023-09-30T17:04:11.825 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.825 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.825 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:11.825 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.222346+0000", 2023-09-30T17:04:11.826 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.826 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.826 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:11.826 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.222347+0000", 2023-09-30T17:04:11.826 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9900000000000001e-07 2023-09-30T17:04:11.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.826 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.826 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:11.826 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.222357+0000", 2023-09-30T17:04:11.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0312999999999999e-05 2023-09-30T17:04:11.827 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.827 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.827 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:11.827 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.222363+0000", 2023-09-30T17:04:11.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5780000000000004e-06 2023-09-30T17:04:11.827 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.827 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.827 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.827 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.222369+0000", 2023-09-30T17:04:11.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6409999999999999e-06 2023-09-30T17:04:11.827 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.828 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.828 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:11.828 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.776164+0000", 2023-09-30T17:04:11.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.55379476900000002 2023-09-30T17:04:11.828 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.828 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.828 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:11.828 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.776234+0000", 2023-09-30T17:04:11.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0511000000000003e-05 2023-09-30T17:04:11.828 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.828 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.828 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:11.829 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.776401+0000", 2023-09-30T17:04:11.829 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016642 2023-09-30T17:04:11.829 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.829 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:11.829 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.829 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.829 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:114760 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:11.829 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.262874+0000", 2023-09-30T17:04:11.829 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.53036638400000002, 2023-09-30T17:04:11.829 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.53056361699999999, 2023-09-30T17:04:11.829 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:11.830 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:11.830 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:11.830 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:11.830 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:11.830 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 114760 2023-09-30T17:04:11.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.830 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:11.830 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.830 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:11.830 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.262874+0000", 2023-09-30T17:04:11.830 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.831 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.831 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.831 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:11.831 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.262874+0000", 2023-09-30T17:04:11.831 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.831 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.831 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.831 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:11.831 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.262874+0000", 2023-09-30T17:04:11.831 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5900000000000003e-07 2023-09-30T17:04:11.831 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.831 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.832 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:11.832 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.262885+0000", 2023-09-30T17:04:11.832 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0587e-05 2023-09-30T17:04:11.832 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.832 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.832 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:11.832 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.262890+0000", 2023-09-30T17:04:11.832 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6180000000000003e-06 2023-09-30T17:04:11.832 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.832 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.832 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.832 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.262895+0000", 2023-09-30T17:04:11.833 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.651e-06 2023-09-30T17:04:11.833 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.833 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:11.833 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.833 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.833 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.833 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:114785 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:11.833 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.273657+0000", 2023-09-30T17:04:11.833 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.51958329000000003, 2023-09-30T17:04:11.833 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.51983414699999997, 2023-09-30T17:04:11.833 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:11.833 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:11.834 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:11.834 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:11.834 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:11.834 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 114785 2023-09-30T17:04:11.834 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.834 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:11.834 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.834 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:11.834 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.273657+0000", 2023-09-30T17:04:11.834 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.834 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.835 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.835 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:11.835 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.273657+0000", 2023-09-30T17:04:11.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.835 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.835 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.835 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:11.835 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.273657+0000", 2023-09-30T17:04:11.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6600000000000002e-07 2023-09-30T17:04:11.835 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.836 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.836 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:11.836 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.273670+0000", 2023-09-30T17:04:11.836 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2165e-05 2023-09-30T17:04:11.836 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.836 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.836 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:11.836 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.273675+0000", 2023-09-30T17:04:11.836 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.755e-06 2023-09-30T17:04:11.836 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.836 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.836 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.837 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.273681+0000", 2023-09-30T17:04:11.837 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9739999999999999e-06 2023-09-30T17:04:11.837 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.837 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:11.837 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.837 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.837 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.837 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115242 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:11.837 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.417644+0000", 2023-09-30T17:04:11.837 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.37559670899999997, 2023-09-30T17:04:11.837 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.37590788000000003, 2023-09-30T17:04:11.837 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:11.838 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:11.838 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:11.838 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:11.838 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:11.838 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115242 2023-09-30T17:04:11.838 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.838 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:11.838 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.838 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:11.838 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.417644+0000", 2023-09-30T17:04:11.838 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.839 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.839 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.839 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:11.839 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.417644+0000", 2023-09-30T17:04:11.839 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.839 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.839 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.839 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:11.839 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.417644+0000", 2023-09-30T17:04:11.839 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5900000000000003e-07 2023-09-30T17:04:11.839 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.840 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.840 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:11.840 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.417658+0000", 2023-09-30T17:04:11.840 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4133e-05 2023-09-30T17:04:11.840 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.840 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.840 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:11.840 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.417665+0000", 2023-09-30T17:04:11.840 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7220000000000002e-06 2023-09-30T17:04:11.840 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.840 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.840 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.841 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.417671+0000", 2023-09-30T17:04:11.841 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7849999999999997e-06 2023-09-30T17:04:11.841 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.841 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:11.841 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.841 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.841 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.841 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115267 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:11.841 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.430661+0000", 2023-09-30T17:04:11.841 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.36257977800000002, 2023-09-30T17:04:11.841 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.36294340400000003, 2023-09-30T17:04:11.841 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:11.842 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:11.842 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:11.842 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:11.842 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:11.842 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115267 2023-09-30T17:04:11.842 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.842 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:11.842 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.842 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:11.842 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.430661+0000", 2023-09-30T17:04:11.843 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.843 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.843 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.843 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:11.843 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.430661+0000", 2023-09-30T17:04:11.843 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.843 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.843 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.843 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:11.843 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.430661+0000", 2023-09-30T17:04:11.843 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3999999999999997e-07 2023-09-30T17:04:11.844 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.844 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.844 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:11.844 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.430670+0000", 2023-09-30T17:04:11.844 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5100000000000004e-06 2023-09-30T17:04:11.844 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.844 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.844 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:11.844 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.430676+0000", 2023-09-30T17:04:11.845 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7259999999999999e-06 2023-09-30T17:04:11.845 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.845 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.845 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.845 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.430681+0000", 2023-09-30T17:04:11.845 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1950000000000002e-06 2023-09-30T17:04:11.845 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.845 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:11.845 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.845 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.845 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.846 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115526 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:11.846 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.526574+0000", 2023-09-30T17:04:11.846 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.26666615500000002, 2023-09-30T17:04:11.846 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.267084761, 2023-09-30T17:04:11.846 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:11.846 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:11.846 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:11.846 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:11.847 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:11.847 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115526 2023-09-30T17:04:11.847 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.847 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:11.847 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.847 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:11.847 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.526574+0000", 2023-09-30T17:04:11.848 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.848 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.849 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.849 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:11.849 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.526574+0000", 2023-09-30T17:04:11.849 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.849 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.850 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.850 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:11.850 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.528516+0000", 2023-09-30T17:04:11.850 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001942186 2023-09-30T17:04:11.850 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.850 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.850 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:11.850 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.528529+0000", 2023-09-30T17:04:11.850 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2429000000000001e-05 2023-09-30T17:04:11.851 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.851 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.851 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:11.851 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.528565+0000", 2023-09-30T17:04:11.851 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5769999999999998e-05 2023-09-30T17:04:11.851 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.851 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.851 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.852 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.528572+0000", 2023-09-30T17:04:11.852 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8690000000000004e-06 2023-09-30T17:04:11.852 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.852 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:11.852 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.853 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.853 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115634 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:11.853 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.581990+0000", 2023-09-30T17:04:11.853 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.21125048599999999, 2023-09-30T17:04:11.853 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.21173713399999999, 2023-09-30T17:04:11.853 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:11.853 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:11.853 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:11.854 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:11.854 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:11.854 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115634 2023-09-30T17:04:11.854 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.854 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:11.854 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.854 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:11.854 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.581990+0000", 2023-09-30T17:04:11.854 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.854 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.854 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.855 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:11.855 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.581990+0000", 2023-09-30T17:04:11.855 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.855 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.855 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.855 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:11.855 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.581990+0000", 2023-09-30T17:04:11.855 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3700000000000001e-07 2023-09-30T17:04:11.855 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.855 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.855 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:11.855 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.582001+0000", 2023-09-30T17:04:11.856 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1046000000000001e-05 2023-09-30T17:04:11.856 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.856 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.856 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:11.856 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.582005+0000", 2023-09-30T17:04:11.856 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2350000000000001e-06 2023-09-30T17:04:11.856 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.856 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.856 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.856 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.582009+0000", 2023-09-30T17:04:11.856 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.258e-06 2023-09-30T17:04:11.857 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.857 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:11.857 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.857 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.857 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113512 4.6 e52/17 4:616d4c41:::100000001f8.00000034:head v 52'6966, mlcod=52'6942)", 2023-09-30T17:04:11.857 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.655180+0000", 2023-09-30T17:04:11.857 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.13805988699999999, 2023-09-30T17:04:11.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.13860948200000001, 2023-09-30T17:04:11.858 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:11.858 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:11.858 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:11.858 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.858 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:11.858 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.655180+0000", 2023-09-30T17:04:11.859 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.859 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.859 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.859 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:11.859 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.655180+0000", 2023-09-30T17:04:11.859 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.860 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.860 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.861 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:11.861 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.655181+0000", 2023-09-30T17:04:11.861 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3500000000000002e-07 2023-09-30T17:04:11.861 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.861 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.862 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:11.862 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.655192+0000", 2023-09-30T17:04:11.862 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1335000000000001e-05 2023-09-30T17:04:11.862 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.862 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.862 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:11.863 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.655198+0000", 2023-09-30T17:04:11.863 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0129999999999999e-06 2023-09-30T17:04:11.863 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.863 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.863 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.863 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.655203+0000", 2023-09-30T17:04:11.864 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5360000000000003e-06 2023-09-30T17:04:11.864 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.864 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:11.864 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.786565+0000", 2023-09-30T17:04:11.864 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.131362063 2023-09-30T17:04:11.865 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.865 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.865 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:11.865 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.786586+0000", 2023-09-30T17:04:11.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1083000000000001e-05 2023-09-30T17:04:11.865 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.865 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:11.866 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.866 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.866 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.866 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113624 4.2e e52/17)", 2023-09-30T17:04:11.866 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.669888+0000", 2023-09-30T17:04:11.866 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.12335273099999999, 2023-09-30T17:04:11.866 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.12396491699999999, 2023-09-30T17:04:11.866 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:11.866 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:11.866 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:11.866 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.867 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:11.867 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.669888+0000", 2023-09-30T17:04:11.867 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.867 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.867 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.867 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:11.867 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.669888+0000", 2023-09-30T17:04:11.867 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.867 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.867 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:11.868 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.669888+0000", 2023-09-30T17:04:11.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3900000000000001e-07 2023-09-30T17:04:11.868 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:11.868 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.669899+0000", 2023-09-30T17:04:11.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0964e-05 2023-09-30T17:04:11.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.869 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:11.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.669906+0000", 2023-09-30T17:04:11.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7649999999999996e-06 2023-09-30T17:04:11.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.869 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.870 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.669910+0000", 2023-09-30T17:04:11.870 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6600000000000003e-06 2023-09-30T17:04:11.870 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.870 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:11.870 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.871 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.871 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.871 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113736 4.6 e52/17)", 2023-09-30T17:04:11.871 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.703245+0000", 2023-09-30T17:04:11.871 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.089995398000000004, 2023-09-30T17:04:11.872 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.090657710000000002, 2023-09-30T17:04:11.872 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:11.872 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:11.872 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:11.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:11.873 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.703245+0000", 2023-09-30T17:04:11.873 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.873 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.873 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.873 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:11.873 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.703245+0000", 2023-09-30T17:04:11.873 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.874 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.874 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.874 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:11.874 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.703245+0000", 2023-09-30T17:04:11.874 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4099999999999999e-07 2023-09-30T17:04:11.875 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.875 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.875 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:11.875 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.703259+0000", 2023-09-30T17:04:11.875 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3366999999999999e-05 2023-09-30T17:04:11.875 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.876 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.876 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:11.876 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.703270+0000", 2023-09-30T17:04:11.876 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1025e-05 2023-09-30T17:04:11.876 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.876 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.877 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.877 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.703276+0000", 2023-09-30T17:04:11.877 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4840000000000001e-06 2023-09-30T17:04:11.877 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.877 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:11.877 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.877 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.877 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.878 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115995 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:11.878 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.718557+0000", 2023-09-30T17:04:11.878 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.074683771999999995, 2023-09-30T17:04:11.878 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.075399144000000001, 2023-09-30T17:04:11.878 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:11.878 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:11.878 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:11.878 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:11.878 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:11.878 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115995 2023-09-30T17:04:11.879 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.879 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:11.879 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.879 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:11.879 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.718557+0000", 2023-09-30T17:04:11.879 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.879 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.879 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.879 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:11.879 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.718557+0000", 2023-09-30T17:04:11.880 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.880 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.880 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.880 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:11.880 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.718557+0000", 2023-09-30T17:04:11.880 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9700000000000002e-07 2023-09-30T17:04:11.880 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.880 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.880 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:11.880 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.718572+0000", 2023-09-30T17:04:11.880 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5276000000000001e-05 2023-09-30T17:04:11.880 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.881 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.881 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:11.881 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.718583+0000", 2023-09-30T17:04:11.881 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0373999999999999e-05 2023-09-30T17:04:11.881 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.881 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.881 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.881 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.718803+0000", 2023-09-30T17:04:11.881 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022053700000000001 2023-09-30T17:04:11.881 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.881 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:11.882 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.882 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.882 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.882 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113803 4.6 e52/17)", 2023-09-30T17:04:11.882 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.731465+0000", 2023-09-30T17:04:11.882 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.061775069000000002, 2023-09-30T17:04:11.882 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.062548441999999996, 2023-09-30T17:04:11.882 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:11.882 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:11.882 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:11.882 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.882 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:11.883 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.731465+0000", 2023-09-30T17:04:11.883 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.883 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.883 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.883 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:11.883 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.731465+0000", 2023-09-30T17:04:11.883 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.883 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.883 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.883 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:11.883 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.731466+0000", 2023-09-30T17:04:11.884 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7099999999999998e-07 2023-09-30T17:04:11.884 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.884 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.884 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:11.884 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.731477+0000", 2023-09-30T17:04:11.884 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1948e-05 2023-09-30T17:04:11.884 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.884 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.884 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:11.884 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.731485+0000", 2023-09-30T17:04:11.884 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3390000000000004e-06 2023-09-30T17:04:11.885 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.885 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.885 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.885 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.731489+0000", 2023-09-30T17:04:11.885 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3239999999999996e-06 2023-09-30T17:04:11.885 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.885 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:11.885 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.885 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.885 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.885 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113956 4.6 e52/17)", 2023-09-30T17:04:11.886 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.774784+0000", 2023-09-30T17:04:11.886 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.018456424999999999, 2023-09-30T17:04:11.886 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019277947, 2023-09-30T17:04:11.886 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:11.886 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:11.886 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:11.886 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.886 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:11.886 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.774784+0000", 2023-09-30T17:04:11.886 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.887 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.887 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.887 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:11.887 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.774784+0000", 2023-09-30T17:04:11.887 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.887 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.887 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.887 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:11.887 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.774785+0000", 2023-09-30T17:04:11.887 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2099999999999996e-07 2023-09-30T17:04:11.887 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.888 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.888 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:11.888 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.774810+0000", 2023-09-30T17:04:11.888 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5663000000000001e-05 2023-09-30T17:04:11.888 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.888 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.888 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:11.888 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.774827+0000", 2023-09-30T17:04:11.888 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7116999999999999e-05 2023-09-30T17:04:11.888 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.888 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.888 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.889 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.774841+0000", 2023-09-30T17:04:11.889 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3719e-05 2023-09-30T17:04:11.889 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.889 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:11.889 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.889 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.889 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.889 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116199 4.18 4.31813858 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:11.889 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.791583+0000", 2023-09-30T17:04:11.889 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.001657635, 2023-09-30T17:04:11.889 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002510633, 2023-09-30T17:04:11.890 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:11.890 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:11.890 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:11.890 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:11.890 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:11.890 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116199 2023-09-30T17:04:11.890 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.890 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:11.890 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.890 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:11.890 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.791583+0000", 2023-09-30T17:04:11.891 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.891 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.891 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.891 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:11.891 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.791583+0000", 2023-09-30T17:04:11.891 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.891 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.891 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.891 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:11.891 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.791583+0000", 2023-09-30T17:04:11.891 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4799999999999998e-07 2023-09-30T17:04:11.891 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.892 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.892 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:11.892 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.791595+0000", 2023-09-30T17:04:11.892 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1484999999999999e-05 2023-09-30T17:04:11.892 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.892 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.892 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:11.892 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.791602+0000", 2023-09-30T17:04:11.892 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5390000000000002e-06 2023-09-30T17:04:11.892 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.893 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.893 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.893 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.791607+0000", 2023-09-30T17:04:11.893 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2449999999999998e-06 2023-09-30T17:04:11.893 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.893 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:11.893 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.893 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.893 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.893 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115137 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:11.894 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.375569+0000", 2023-09-30T17:04:11.894 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.41767116599999998, 2023-09-30T17:04:11.894 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.41855601599999998, 2023-09-30T17:04:11.894 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:11.894 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:11.894 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:11.894 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:11.894 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:11.894 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115137 2023-09-30T17:04:11.894 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.895 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:11.895 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.895 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:11.895 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.375569+0000", 2023-09-30T17:04:11.895 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.895 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.895 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.896 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:11.896 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.375569+0000", 2023-09-30T17:04:11.896 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.896 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.896 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.896 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:11.896 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.377517+0000", 2023-09-30T17:04:11.896 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001947772 2023-09-30T17:04:11.896 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.896 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.896 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:11.897 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.377536+0000", 2023-09-30T17:04:11.897 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9190000000000001e-05 2023-09-30T17:04:11.897 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.897 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.897 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:11.897 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.377548+0000", 2023-09-30T17:04:11.897 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1685000000000001e-05 2023-09-30T17:04:11.897 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.897 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.897 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.897 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.377556+0000", 2023-09-30T17:04:11.898 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1000000000000004e-06 2023-09-30T17:04:11.898 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.898 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:11.898 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.898 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.898 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.898 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115313 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:11.898 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.444570+0000", 2023-09-30T17:04:11.898 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.34867032399999998, 2023-09-30T17:04:11.898 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.34958600000000001, 2023-09-30T17:04:11.898 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:11.899 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:11.899 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:11.899 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:11.899 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:11.899 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115313 2023-09-30T17:04:11.899 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.899 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:11.899 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.899 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:11.899 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.444570+0000", 2023-09-30T17:04:11.899 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.900 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.900 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.900 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:11.900 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.444570+0000", 2023-09-30T17:04:11.900 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.900 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.900 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.900 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:11.900 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.444570+0000", 2023-09-30T17:04:11.901 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9599999999999999e-07 2023-09-30T17:04:11.901 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.901 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.901 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:11.901 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.444582+0000", 2023-09-30T17:04:11.901 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.15e-05 2023-09-30T17:04:11.901 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.901 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.902 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:11.902 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.444590+0000", 2023-09-30T17:04:11.902 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0050000000000004e-06 2023-09-30T17:04:11.902 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.902 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.903 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.903 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.444595+0000", 2023-09-30T17:04:11.903 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4399999999999996e-06 2023-09-30T17:04:11.903 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.903 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:11.904 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.904 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.904 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.904 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115695 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 991232~4096 in=4096b,write 1048576~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:11.904 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.589752+0000", 2023-09-30T17:04:11.904 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.20348830000000001, 2023-09-30T17:04:11.905 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.20444125499999999, 2023-09-30T17:04:11.905 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:11.905 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:11.905 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:11.905 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:11.906 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:11.906 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115695 2023-09-30T17:04:11.906 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.906 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:11.906 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.906 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:11.906 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.589752+0000", 2023-09-30T17:04:11.907 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.907 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.907 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.907 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:11.907 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.589752+0000", 2023-09-30T17:04:11.907 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.907 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.908 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.908 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:11.908 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.589753+0000", 2023-09-30T17:04:11.908 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7999999999999995e-07 2023-09-30T17:04:11.908 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.908 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.908 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:11.909 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.589764+0000", 2023-09-30T17:04:11.909 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1273e-05 2023-09-30T17:04:11.909 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.909 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.909 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:11.909 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.589771+0000", 2023-09-30T17:04:11.909 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8820000000000003e-06 2023-09-30T17:04:11.910 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.910 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.910 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.910 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.589777+0000", 2023-09-30T17:04:11.910 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.896e-06 2023-09-30T17:04:11.910 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.910 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.910 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:11.910 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.754567+0000", 2023-09-30T17:04:11.910 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.164789883 2023-09-30T17:04:11.910 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.911 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.911 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:11.911 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.754617+0000", 2023-09-30T17:04:11.911 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0158000000000003e-05 2023-09-30T17:04:11.911 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.911 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:11.911 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.911 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.912 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.912 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115720 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:11.912 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.599634+0000", 2023-09-30T17:04:11.912 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.19360665199999999, 2023-09-30T17:04:11.912 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.19459656, 2023-09-30T17:04:11.912 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:11.913 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:11.913 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:11.914 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:11.914 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:11.914 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115720 2023-09-30T17:04:11.914 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.914 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:11.914 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.914 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:11.915 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.599634+0000", 2023-09-30T17:04:11.915 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.915 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.915 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.915 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:11.915 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.599634+0000", 2023-09-30T17:04:11.915 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.915 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.915 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.915 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:11.915 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.599634+0000", 2023-09-30T17:04:11.916 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7399999999999999e-07 2023-09-30T17:04:11.916 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.916 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.916 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:11.916 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.599646+0000", 2023-09-30T17:04:11.916 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.198e-05 2023-09-30T17:04:11.916 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.916 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.916 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:11.916 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.599652+0000", 2023-09-30T17:04:11.916 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1109999999999996e-06 2023-09-30T17:04:11.916 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.917 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.917 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.917 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.599657+0000", 2023-09-30T17:04:11.917 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7480000000000001e-06 2023-09-30T17:04:11.917 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.917 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:11.917 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.917 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.917 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.917 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113800 4.36 e52/17)", 2023-09-30T17:04:11.917 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.731496+0000", 2023-09-30T17:04:11.918 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.061744581, 2023-09-30T17:04:11.918 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.062764027999999999, 2023-09-30T17:04:11.918 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:11.918 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:11.918 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:11.918 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.918 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:11.918 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.731496+0000", 2023-09-30T17:04:11.918 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.918 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.918 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.919 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:11.919 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.731496+0000", 2023-09-30T17:04:11.919 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.919 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.919 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.919 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:11.919 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.731496+0000", 2023-09-30T17:04:11.919 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3799999999999999e-07 2023-09-30T17:04:11.919 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.919 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.920 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:11.920 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.731506+0000", 2023-09-30T17:04:11.920 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0404000000000001e-05 2023-09-30T17:04:11.920 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.920 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.920 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:11.920 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.731518+0000", 2023-09-30T17:04:11.920 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1719000000000001e-05 2023-09-30T17:04:11.920 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.920 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.920 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.921 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.731522+0000", 2023-09-30T17:04:11.921 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4020000000000004e-06 2023-09-30T17:04:11.921 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.921 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:11.921 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.921 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.921 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.921 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113960 4.36 e52/17)", 2023-09-30T17:04:11.921 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.774861+0000", 2023-09-30T17:04:11.921 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.018379096000000001, 2023-09-30T17:04:11.921 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019424832999999999, 2023-09-30T17:04:11.922 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:11.922 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:11.922 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:11.922 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.922 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:11.922 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.774861+0000", 2023-09-30T17:04:11.922 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.922 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.922 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.922 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:11.923 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.774861+0000", 2023-09-30T17:04:11.923 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.923 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.923 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.923 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:11.923 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.774862+0000", 2023-09-30T17:04:11.923 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.34e-07 2023-09-30T17:04:11.923 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.923 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.924 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:11.924 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.774878+0000", 2023-09-30T17:04:11.924 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6778000000000001e-05 2023-09-30T17:04:11.924 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.924 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.924 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:11.924 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.774885+0000", 2023-09-30T17:04:11.924 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.968e-06 2023-09-30T17:04:11.924 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.924 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.924 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.924 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.774890+0000", 2023-09-30T17:04:11.925 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0379999999999999e-06 2023-09-30T17:04:11.925 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.925 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:11.925 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.925 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.925 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.925 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116201 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:11.925 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.791615+0000", 2023-09-30T17:04:11.925 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0016257089999999999, 2023-09-30T17:04:11.925 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0026988229999999999, 2023-09-30T17:04:11.926 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:11.926 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:11.926 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:11.926 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:11.926 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:11.926 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116201 2023-09-30T17:04:11.926 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.926 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:11.926 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.926 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:11.927 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.791615+0000", 2023-09-30T17:04:11.927 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.927 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.927 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.927 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:11.927 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.791615+0000", 2023-09-30T17:04:11.927 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.927 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.927 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.927 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:11.927 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.791615+0000", 2023-09-30T17:04:11.927 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5400000000000002e-07 2023-09-30T17:04:11.928 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.928 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.928 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:11.928 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.791627+0000", 2023-09-30T17:04:11.928 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2405999999999999e-05 2023-09-30T17:04:11.928 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.928 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.928 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:11.928 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.791634+0000", 2023-09-30T17:04:11.929 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2060000000000004e-06 2023-09-30T17:04:11.929 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.929 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.929 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.929 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.791638+0000", 2023-09-30T17:04:11.929 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.561e-06 2023-09-30T17:04:11.929 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.929 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:11.929 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.930 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.930 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.930 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:114619 4.f 4:f26fdfa9:::100000001f8.00000002:head [write 2404352~4096 in=4096b,write 2494464~4096 in=4096b,write 2555904~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:11.930 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.222407+0000", 2023-09-30T17:04:11.930 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.57083364700000006, 2023-09-30T17:04:11.931 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.57194254099999997, 2023-09-30T17:04:11.931 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:11.931 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:11.931 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:11.931 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:11.931 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:11.932 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 114619 2023-09-30T17:04:11.932 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.932 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:11.932 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.932 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:11.932 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.222407+0000", 2023-09-30T17:04:11.932 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.933 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.933 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.933 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:11.933 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.222407+0000", 2023-09-30T17:04:11.933 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.933 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.933 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.934 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:11.934 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.222407+0000", 2023-09-30T17:04:11.934 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1300000000000001e-07 2023-09-30T17:04:11.934 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.934 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.934 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:11.934 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.222419+0000", 2023-09-30T17:04:11.934 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1888999999999999e-05 2023-09-30T17:04:11.935 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.935 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.935 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:11.935 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.222425+0000", 2023-09-30T17:04:11.935 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.285e-06 2023-09-30T17:04:11.935 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.936 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.936 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.936 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.222431+0000", 2023-09-30T17:04:11.936 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6799999999999998e-06 2023-09-30T17:04:11.936 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.936 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.936 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:11.936 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.778711+0000", 2023-09-30T17:04:11.936 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.55628039100000004 2023-09-30T17:04:11.937 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.937 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.937 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:11.937 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.778935+0000", 2023-09-30T17:04:11.937 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00022416600000000001 2023-09-30T17:04:11.937 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.937 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.937 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:11.937 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.779102+0000", 2023-09-30T17:04:11.937 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016689999999999999 2023-09-30T17:04:11.937 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.937 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:11.938 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.938 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.938 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.938 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:114650 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 2449408~4096 in=4096b,write 2494464~4096 in=4096b,write 2568192~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:11.938 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.235954+0000", 2023-09-30T17:04:11.938 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.55728666699999996, 2023-09-30T17:04:11.938 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.55845811899999998, 2023-09-30T17:04:11.938 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:11.938 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:11.938 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:11.938 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:11.939 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:11.939 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 114650 2023-09-30T17:04:11.939 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.939 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:11.939 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.939 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:11.939 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.235954+0000", 2023-09-30T17:04:11.939 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.939 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.940 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.940 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:11.940 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.235954+0000", 2023-09-30T17:04:11.940 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.940 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.940 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.940 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:11.940 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.235954+0000", 2023-09-30T17:04:11.940 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5600000000000005e-07 2023-09-30T17:04:11.940 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.940 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.940 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:11.941 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.235972+0000", 2023-09-30T17:04:11.941 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7988000000000001e-05 2023-09-30T17:04:11.941 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.941 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.941 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:11.941 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.235981+0000", 2023-09-30T17:04:11.941 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8310000000000007e-06 2023-09-30T17:04:11.941 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.941 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.941 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.942 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.235988+0000", 2023-09-30T17:04:11.942 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8680000000000001e-06 2023-09-30T17:04:11.942 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.942 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.942 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:11.942 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.787658+0000", 2023-09-30T17:04:11.942 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.551670361 2023-09-30T17:04:11.942 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.942 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.942 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:11.942 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.787740+0000", 2023-09-30T17:04:11.943 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1762999999999996e-05 2023-09-30T17:04:11.943 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.943 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:11.943 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.943 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.943 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.943 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:114788 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:11.943 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.273724+0000", 2023-09-30T17:04:11.943 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.519516435, 2023-09-30T17:04:11.943 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.52075289499999999, 2023-09-30T17:04:11.943 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:11.944 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:11.944 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:11.944 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:11.944 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:11.944 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 114788 2023-09-30T17:04:11.944 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.944 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:11.944 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.944 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:11.944 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.273724+0000", 2023-09-30T17:04:11.945 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.945 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.945 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.945 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:11.945 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.273724+0000", 2023-09-30T17:04:11.945 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.945 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.945 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.945 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:11.946 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.273724+0000", 2023-09-30T17:04:11.946 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3300000000000003e-07 2023-09-30T17:04:11.946 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.946 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.946 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:11.946 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.273738+0000", 2023-09-30T17:04:11.946 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4018e-05 2023-09-30T17:04:11.946 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.947 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.947 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:11.947 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.273744+0000", 2023-09-30T17:04:11.947 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0929999999999999e-06 2023-09-30T17:04:11.947 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.947 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.947 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.947 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.273749+0000", 2023-09-30T17:04:11.947 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7339999999999999e-06 2023-09-30T17:04:11.947 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.947 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:11.948 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.948 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.948 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.948 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:114816 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:11.948 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.285750+0000", 2023-09-30T17:04:11.948 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.50749064099999996, 2023-09-30T17:04:11.948 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.50878800999999996, 2023-09-30T17:04:11.948 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:11.948 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:11.948 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:11.948 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:11.948 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:11.949 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 114816 2023-09-30T17:04:11.949 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.949 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:11.949 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.949 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:11.949 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.285750+0000", 2023-09-30T17:04:11.949 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.949 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.949 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.950 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:11.950 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.285750+0000", 2023-09-30T17:04:11.950 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.950 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.950 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.950 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:11.950 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.289517+0000", 2023-09-30T17:04:11.950 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0037673540000000001 2023-09-30T17:04:11.950 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.950 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.950 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:11.951 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.289532+0000", 2023-09-30T17:04:11.951 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5304000000000001e-05 2023-09-30T17:04:11.951 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.951 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.951 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:11.951 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.289541+0000", 2023-09-30T17:04:11.951 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8089999999999999e-06 2023-09-30T17:04:11.951 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.951 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.951 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.951 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.289547+0000", 2023-09-30T17:04:11.952 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9270000000000002e-06 2023-09-30T17:04:11.952 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.952 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:11.952 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.952 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.952 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.952 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115561 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:11.952 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.541550+0000", 2023-09-30T17:04:11.952 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.251690038, 2023-09-30T17:04:11.952 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.25304619499999997, 2023-09-30T17:04:11.952 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:11.953 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:11.953 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:11.953 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:11.953 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:11.953 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115561 2023-09-30T17:04:11.953 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.953 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:11.953 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.953 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:11.953 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.541550+0000", 2023-09-30T17:04:11.953 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.954 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.954 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.954 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:11.954 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.541550+0000", 2023-09-30T17:04:11.954 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.954 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.954 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.954 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:11.954 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.541551+0000", 2023-09-30T17:04:11.954 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8799999999999998e-07 2023-09-30T17:04:11.954 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.955 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.955 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:11.955 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.541560+0000", 2023-09-30T17:04:11.955 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8740000000000001e-06 2023-09-30T17:04:11.955 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.955 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.955 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:11.955 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.541565+0000", 2023-09-30T17:04:11.955 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4140000000000002e-06 2023-09-30T17:04:11.955 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.955 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.956 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.956 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.541568+0000", 2023-09-30T17:04:11.956 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.304e-06 2023-09-30T17:04:11.956 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.956 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:11.956 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.956 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.956 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.956 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115699 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:11.956 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.589785+0000", 2023-09-30T17:04:11.957 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.20345512599999999, 2023-09-30T17:04:11.957 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.204853062, 2023-09-30T17:04:11.957 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:11.957 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:11.957 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:11.957 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:11.957 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:11.957 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115699 2023-09-30T17:04:11.957 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.957 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:11.958 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.958 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:11.958 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.589785+0000", 2023-09-30T17:04:11.958 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.958 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.958 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.958 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:11.958 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.589785+0000", 2023-09-30T17:04:11.958 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.959 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.959 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.959 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:11.959 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.589786+0000", 2023-09-30T17:04:11.959 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9900000000000001e-07 2023-09-30T17:04:11.959 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.959 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.959 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:11.960 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.589800+0000", 2023-09-30T17:04:11.960 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4397e-05 2023-09-30T17:04:11.960 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.960 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.960 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:11.960 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.589808+0000", 2023-09-30T17:04:11.961 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7000000000000008e-06 2023-09-30T17:04:11.961 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.961 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.961 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.961 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.589813+0000", 2023-09-30T17:04:11.961 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4999999999999999e-06 2023-09-30T17:04:11.962 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.962 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:11.962 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.962 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.962 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.962 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115771 4.38 4.318ef3b8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:11.962 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.627704+0000", 2023-09-30T17:04:11.963 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.165535829, 2023-09-30T17:04:11.963 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.16698549500000001, 2023-09-30T17:04:11.963 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:11.963 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:11.963 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:11.963 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:11.963 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:11.963 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115771 2023-09-30T17:04:11.964 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.964 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:11.964 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.964 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:11.964 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.627704+0000", 2023-09-30T17:04:11.964 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.964 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.965 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.965 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:11.965 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.627704+0000", 2023-09-30T17:04:11.965 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.965 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.965 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.965 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:11.966 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.627705+0000", 2023-09-30T17:04:11.966 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9999999999999998e-07 2023-09-30T17:04:11.966 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.966 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.966 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:11.966 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.627717+0000", 2023-09-30T17:04:11.966 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1664999999999999e-05 2023-09-30T17:04:11.967 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.967 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.967 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:11.967 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.627723+0000", 2023-09-30T17:04:11.967 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5740000000000001e-06 2023-09-30T17:04:11.967 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.967 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.968 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.968 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.627729+0000", 2023-09-30T17:04:11.968 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4299999999999997e-06 2023-09-30T17:04:11.968 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.968 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:11.968 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.968 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.968 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.968 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115833 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:11.969 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.655255+0000", 2023-09-30T17:04:11.969 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.13798574399999999, 2023-09-30T17:04:11.969 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.13949452100000001, 2023-09-30T17:04:11.969 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:11.969 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:11.969 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:11.969 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:11.969 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:11.969 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115833 2023-09-30T17:04:11.969 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.969 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:11.969 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.970 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:11.970 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.655255+0000", 2023-09-30T17:04:11.970 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.970 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.970 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.970 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:11.970 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.655255+0000", 2023-09-30T17:04:11.970 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.970 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.970 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.970 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:11.971 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.655255+0000", 2023-09-30T17:04:11.971 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9099999999999999e-07 2023-09-30T17:04:11.971 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.971 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.971 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:11.971 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.655266+0000", 2023-09-30T17:04:11.971 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0657e-05 2023-09-30T17:04:11.971 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.972 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.972 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:11.972 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.655272+0000", 2023-09-30T17:04:11.972 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0719999999999996e-06 2023-09-30T17:04:11.972 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.972 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.972 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.972 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.655277+0000", 2023-09-30T17:04:11.972 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.541e-06 2023-09-30T17:04:11.972 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.973 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:11.973 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.973 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.973 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.973 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115955 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:11.973 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.700800+0000", 2023-09-30T17:04:11.973 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.092440791999999994, 2023-09-30T17:04:11.973 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.094008909000000002, 2023-09-30T17:04:11.973 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:11.973 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:11.973 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:11.973 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:11.974 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:11.974 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115955 2023-09-30T17:04:11.974 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.974 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:11.974 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.974 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:11.974 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.700800+0000", 2023-09-30T17:04:11.974 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.974 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.974 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.974 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:11.975 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.700800+0000", 2023-09-30T17:04:11.975 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.975 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.975 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.975 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:11.975 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.704556+0000", 2023-09-30T17:04:11.975 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0037566269999999998 2023-09-30T17:04:11.975 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.975 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.975 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:11.975 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.704571+0000", 2023-09-30T17:04:11.976 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5112e-05 2023-09-30T17:04:11.976 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.976 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.976 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:11.976 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.704579+0000", 2023-09-30T17:04:11.976 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4669999999999998e-06 2023-09-30T17:04:11.976 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.976 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.976 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.976 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.704585+0000", 2023-09-30T17:04:11.976 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4509999999999997e-06 2023-09-30T17:04:11.976 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.977 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:11.977 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.977 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.977 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.977 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:115041 4.28 e52/17 4:15eeb89b:::100000001f8.00000032:head v 52'3534, mlcod=52'3531)", 2023-09-30T17:04:11.977 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.761931+0000", 2023-09-30T17:04:11.977 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.031309518000000001, 2023-09-30T17:04:11.977 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.032939569000000002, 2023-09-30T17:04:11.977 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:11.977 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:11.977 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:11.977 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.978 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:11.978 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.761931+0000", 2023-09-30T17:04:11.978 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.978 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.978 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.978 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:11.978 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.761931+0000", 2023-09-30T17:04:11.978 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.978 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.978 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.979 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:11.979 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.761931+0000", 2023-09-30T17:04:11.979 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2800000000000003e-07 2023-09-30T17:04:11.979 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.979 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.979 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:11.979 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.761945+0000", 2023-09-30T17:04:11.979 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3947999999999999e-05 2023-09-30T17:04:11.979 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.979 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.979 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:11.979 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.761952+0000", 2023-09-30T17:04:11.980 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4489999999999996e-06 2023-09-30T17:04:11.980 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.980 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.980 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.980 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.761956+0000", 2023-09-30T17:04:11.980 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5909999999999998e-06 2023-09-30T17:04:11.981 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.981 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.981 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:11.981 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.762838+0000", 2023-09-30T17:04:11.981 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00088204699999999995 2023-09-30T17:04:11.981 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.981 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.981 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:11.981 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.762855+0000", 2023-09-30T17:04:11.981 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6597000000000001e-05 2023-09-30T17:04:11.982 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.982 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:11.982 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.982 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.982 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.982 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:115098 4.28 e52/17 4:153ae410:::100000001f8.0000003b:head v 52'3535, mlcod=52'3531)", 2023-09-30T17:04:11.982 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.774897+0000", 2023-09-30T17:04:11.982 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.018343037, 2023-09-30T17:04:11.982 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.02003709, 2023-09-30T17:04:11.982 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:11.983 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:11.983 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:11.983 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.983 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:11.983 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.774897+0000", 2023-09-30T17:04:11.983 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.983 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.983 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.983 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:11.983 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.774897+0000", 2023-09-30T17:04:11.983 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.984 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.985 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.985 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:11.985 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.774897+0000", 2023-09-30T17:04:11.985 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2100000000000001e-07 2023-09-30T17:04:11.985 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.985 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.986 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:11.986 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.774908+0000", 2023-09-30T17:04:11.986 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0308e-05 2023-09-30T17:04:11.986 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.986 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.986 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:11.986 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.774913+0000", 2023-09-30T17:04:11.986 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4589999999999997e-06 2023-09-30T17:04:11.986 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.987 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.987 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.987 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.774917+0000", 2023-09-30T17:04:11.987 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.019e-06 2023-09-30T17:04:11.987 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.987 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.987 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:11.987 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.779815+0000", 2023-09-30T17:04:11.987 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004898108 2023-09-30T17:04:11.987 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.987 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.988 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:11.988 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.779838+0000", 2023-09-30T17:04:11.988 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2928000000000001e-05 2023-09-30T17:04:11.988 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.988 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:11.988 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.988 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.988 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116204 4.11 4:893be98d:::100000001f8.00000001:head [write 3731456~4096 in=4096b,write 3747840~4096 in=4096b,write 3842048~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:11.989 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.791644+0000", 2023-09-30T17:04:11.989 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0015963259999999999, 2023-09-30T17:04:11.989 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0033613969999999999, 2023-09-30T17:04:11.989 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:11.989 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:11.989 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:11.990 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:11.990 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:11.990 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116204 2023-09-30T17:04:11.990 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.990 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:11.990 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.990 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:11.990 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.791644+0000", 2023-09-30T17:04:11.990 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.990 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.991 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.991 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:11.991 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.791644+0000", 2023-09-30T17:04:11.991 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.991 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.991 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.991 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:11.991 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.791644+0000", 2023-09-30T17:04:11.991 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4900000000000001e-07 2023-09-30T17:04:11.991 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.991 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:11.992 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.791655+0000", 2023-09-30T17:04:11.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0349999999999999e-05 2023-09-30T17:04:11.992 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:11.992 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.791663+0000", 2023-09-30T17:04:11.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8339999999999999e-06 2023-09-30T17:04:11.992 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.992 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.791667+0000", 2023-09-30T17:04:11.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6530000000000002e-06 2023-09-30T17:04:11.993 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.993 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.993 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:11.993 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.792878+0000", 2023-09-30T17:04:11.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0012108189999999999 2023-09-30T17:04:11.993 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.993 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.993 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:11.993 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.792963+0000", 2023-09-30T17:04:11.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4924000000000002e-05 2023-09-30T17:04:11.994 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.994 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:11.994 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.994 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.994 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.994 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115217 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:11.994 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.401901+0000", 2023-09-30T17:04:11.994 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.391339785, 2023-09-30T17:04:11.994 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.39318151400000001, 2023-09-30T17:04:11.994 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:11.994 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:11.995 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:11.995 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:11.995 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:11.995 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115217 2023-09-30T17:04:11.995 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.995 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:11.995 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.995 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:11.995 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.401901+0000", 2023-09-30T17:04:11.996 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.996 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.996 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:11.996 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.401901+0000", 2023-09-30T17:04:11.996 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:11.996 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.996 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:11.997 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.401901+0000", 2023-09-30T17:04:11.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7099999999999997e-07 2023-09-30T17:04:11.997 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.997 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:11.997 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.401917+0000", 2023-09-30T17:04:11.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6518e-05 2023-09-30T17:04:11.997 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.997 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:11.997 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.401923+0000", 2023-09-30T17:04:11.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0390000000000001e-06 2023-09-30T17:04:11.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:11.998 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:11.998 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.401929+0000", 2023-09-30T17:04:11.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2299999999999999e-06 2023-09-30T17:04:11.999 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.999 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:11.999 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:11.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:11.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.000 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115246 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.000 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.419627+0000", 2023-09-30T17:04:12.000 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.37361367299999998, 2023-09-30T17:04:12.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.37551057100000002, 2023-09-30T17:04:12.000 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.000 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.001 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.001 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.001 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.001 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115246 2023-09-30T17:04:12.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.001 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.002 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.002 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.419627+0000", 2023-09-30T17:04:12.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.002 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.002 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.002 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.419627+0000", 2023-09-30T17:04:12.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.003 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.003 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.003 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.419627+0000", 2023-09-30T17:04:12.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0999999999999999e-07 2023-09-30T17:04:12.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.419637+0000", 2023-09-30T17:04:12.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0287e-05 2023-09-30T17:04:12.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.005 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.419645+0000", 2023-09-30T17:04:12.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4580000000000004e-06 2023-09-30T17:04:12.005 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.005 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.005 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.419650+0000", 2023-09-30T17:04:12.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1630000000000004e-06 2023-09-30T17:04:12.005 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.005 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.005 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.006 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.006 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115269 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.006 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.430720+0000", 2023-09-30T17:04:12.006 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.362520177, 2023-09-30T17:04:12.006 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.36446932199999998, 2023-09-30T17:04:12.006 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.006 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.006 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.006 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.007 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.007 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115269 2023-09-30T17:04:12.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.007 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.007 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.430720+0000", 2023-09-30T17:04:12.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.007 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.430720+0000", 2023-09-30T17:04:12.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.008 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.008 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.432518+0000", 2023-09-30T17:04:12.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0017977959999999999 2023-09-30T17:04:12.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.008 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.008 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.432535+0000", 2023-09-30T17:04:12.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6767000000000001e-05 2023-09-30T17:04:12.009 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.009 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.009 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.432548+0000", 2023-09-30T17:04:12.009 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2994e-05 2023-09-30T17:04:12.009 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.009 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.009 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.432555+0000", 2023-09-30T17:04:12.009 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9210000000000003e-06 2023-09-30T17:04:12.009 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.010 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.010 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.010 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.010 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115410 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.010 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.485848+0000", 2023-09-30T17:04:12.010 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.30739254500000002, 2023-09-30T17:04:12.010 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.30939403300000001, 2023-09-30T17:04:12.010 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.011 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.011 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.011 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.011 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.011 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115410 2023-09-30T17:04:12.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.011 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.485848+0000", 2023-09-30T17:04:12.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.485848+0000", 2023-09-30T17:04:12.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.485848+0000", 2023-09-30T17:04:12.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7599999999999997e-07 2023-09-30T17:04:12.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.013 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.013 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.485862+0000", 2023-09-30T17:04:12.013 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3303e-05 2023-09-30T17:04:12.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.013 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.013 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.485868+0000", 2023-09-30T17:04:12.013 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6549999999999998e-06 2023-09-30T17:04:12.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.013 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.014 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.485874+0000", 2023-09-30T17:04:12.014 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3970000000000002e-06 2023-09-30T17:04:12.014 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.014 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.014 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.014 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.014 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.014 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115439 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.014 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.493565+0000", 2023-09-30T17:04:12.014 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.29967520399999997, 2023-09-30T17:04:12.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.30172904099999998, 2023-09-30T17:04:12.015 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.015 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.015 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.015 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.015 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.015 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115439 2023-09-30T17:04:12.015 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.015 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.493565+0000", 2023-09-30T17:04:12.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.493565+0000", 2023-09-30T17:04:12.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.497517+0000", 2023-09-30T17:04:12.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039514759999999998 2023-09-30T17:04:12.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.497542+0000", 2023-09-30T17:04:12.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5021e-05 2023-09-30T17:04:12.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.497552+0000", 2023-09-30T17:04:12.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.023e-05 2023-09-30T17:04:12.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.018 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.018 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.497559+0000", 2023-09-30T17:04:12.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3170000000000004e-06 2023-09-30T17:04:12.018 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.018 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.018 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.019 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115607 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.019 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.564612+0000", 2023-09-30T17:04:12.019 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.228628735, 2023-09-30T17:04:12.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.230734737, 2023-09-30T17:04:12.019 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.019 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.019 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.019 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.020 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.020 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115607 2023-09-30T17:04:12.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.020 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.564612+0000", 2023-09-30T17:04:12.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.021 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.564612+0000", 2023-09-30T17:04:12.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.021 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.021 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.566551+0000", 2023-09-30T17:04:12.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019394799999999999 2023-09-30T17:04:12.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.021 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.021 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.566563+0000", 2023-09-30T17:04:12.022 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1617000000000001e-05 2023-09-30T17:04:12.022 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.022 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.022 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.022 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.566572+0000", 2023-09-30T17:04:12.022 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4339999999999998e-06 2023-09-30T17:04:12.022 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.022 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.022 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.022 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.566581+0000", 2023-09-30T17:04:12.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1460000000000002e-06 2023-09-30T17:04:12.023 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.023 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.023 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.023 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.023 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.023 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115859 4.30 4.88c79130 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.023 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.669994+0000", 2023-09-30T17:04:12.023 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.123246525, 2023-09-30T17:04:12.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.12541055500000001, 2023-09-30T17:04:12.023 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.023 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.024 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.024 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.024 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.024 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115859 2023-09-30T17:04:12.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.024 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.024 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.024 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.669994+0000", 2023-09-30T17:04:12.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.025 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.025 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.669994+0000", 2023-09-30T17:04:12.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.025 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.025 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.025 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.025 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.669994+0000", 2023-09-30T17:04:12.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3200000000000005e-07 2023-09-30T17:04:12.025 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.025 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.025 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.026 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.670011+0000", 2023-09-30T17:04:12.026 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6507e-05 2023-09-30T17:04:12.026 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.026 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.026 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.670017+0000", 2023-09-30T17:04:12.026 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3049999999999998e-06 2023-09-30T17:04:12.026 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.026 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.026 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.670022+0000", 2023-09-30T17:04:12.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3199999999999999e-06 2023-09-30T17:04:12.027 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.027 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.027 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.027 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.027 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115896 4.30 4.88c79130 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.027 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.683650+0000", 2023-09-30T17:04:12.027 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.109590229, 2023-09-30T17:04:12.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.111805843, 2023-09-30T17:04:12.027 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.027 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.028 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.028 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.028 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.028 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115896 2023-09-30T17:04:12.028 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.028 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.028 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.028 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.028 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.683650+0000", 2023-09-30T17:04:12.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.028 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.029 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.029 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.683650+0000", 2023-09-30T17:04:12.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.029 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.029 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.029 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.683651+0000", 2023-09-30T17:04:12.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9999999999999998e-07 2023-09-30T17:04:12.029 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.030 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.030 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.683664+0000", 2023-09-30T17:04:12.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3013000000000001e-05 2023-09-30T17:04:12.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.030 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.030 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.683671+0000", 2023-09-30T17:04:12.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0419999999999997e-06 2023-09-30T17:04:12.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.683676+0000", 2023-09-30T17:04:12.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2279999999999998e-06 2023-09-30T17:04:12.031 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.031 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.031 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.031 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116000 4.18 4.31813858 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.031 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.718889+0000", 2023-09-30T17:04:12.031 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.074351720999999996, 2023-09-30T17:04:12.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.076627151000000004, 2023-09-30T17:04:12.032 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.032 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.032 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.032 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.032 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.032 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116000 2023-09-30T17:04:12.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.032 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.032 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.032 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.718889+0000", 2023-09-30T17:04:12.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.033 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.033 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.033 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.033 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.718889+0000", 2023-09-30T17:04:12.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.033 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.033 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.033 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.033 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.718889+0000", 2023-09-30T17:04:12.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6399999999999998e-07 2023-09-30T17:04:12.034 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.034 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.034 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.718901+0000", 2023-09-30T17:04:12.034 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2449000000000001e-05 2023-09-30T17:04:12.034 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.034 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.034 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.718907+0000", 2023-09-30T17:04:12.034 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.908e-06 2023-09-30T17:04:12.034 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.035 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.035 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.718912+0000", 2023-09-30T17:04:12.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6639999999999997e-06 2023-09-30T17:04:12.035 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.035 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.035 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.035 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.035 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.035 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113895 4.6 e52/17)", 2023-09-30T17:04:12.035 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.761962+0000", 2023-09-30T17:04:12.035 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.031277991999999998, 2023-09-30T17:04:12.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033610542, 2023-09-30T17:04:12.036 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.036 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.036 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.036 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.761962+0000", 2023-09-30T17:04:12.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.036 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.761962+0000", 2023-09-30T17:04:12.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.037 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.761963+0000", 2023-09-30T17:04:12.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0900000000000001e-07 2023-09-30T17:04:12.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.037 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.761976+0000", 2023-09-30T17:04:12.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3920999999999999e-05 2023-09-30T17:04:12.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.038 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.038 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.761982+0000", 2023-09-30T17:04:12.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6030000000000004e-06 2023-09-30T17:04:12.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.038 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.038 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.761988+0000", 2023-09-30T17:04:12.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6200000000000004e-06 2023-09-30T17:04:12.038 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.038 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.039 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.039 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.039 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116206 4.38 4.318ef3b8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.039 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.792846+0000", 2023-09-30T17:04:12.039 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.00039418899999999998, 2023-09-30T17:04:12.039 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0027756790000000001, 2023-09-30T17:04:12.039 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.039 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.039 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.039 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.039 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.040 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116206 2023-09-30T17:04:12.040 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.040 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.040 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.040 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.040 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.792846+0000", 2023-09-30T17:04:12.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.040 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.040 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.040 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.040 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.792846+0000", 2023-09-30T17:04:12.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.041 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.041 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.041 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.041 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.792847+0000", 2023-09-30T17:04:12.041 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3200000000000004e-07 2023-09-30T17:04:12.041 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.041 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.041 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.041 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.792863+0000", 2023-09-30T17:04:12.041 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6155e-05 2023-09-30T17:04:12.041 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.042 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.042 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.042 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.792874+0000", 2023-09-30T17:04:12.042 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1022999999999999e-05 2023-09-30T17:04:12.042 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.042 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.042 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.042 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.792881+0000", 2023-09-30T17:04:12.042 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2819999999999999e-06 2023-09-30T17:04:12.042 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.042 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.042 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.043 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.043 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.043 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:114581 4.37 4:eff9002a:::100000001f8.00000003:head [write 724992~4096 in=4096b,write 749568~4096 in=4096b,write 757760~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.043 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.210576+0000", 2023-09-30T17:04:12.043 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.58266424100000003, 2023-09-30T17:04:12.043 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.58510854000000001, 2023-09-30T17:04:12.043 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.043 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:12.043 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.043 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.043 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.043 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 114581 2023-09-30T17:04:12.044 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.044 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.044 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.044 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.044 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.210576+0000", 2023-09-30T17:04:12.044 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.044 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.044 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.044 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.044 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.210576+0000", 2023-09-30T17:04:12.044 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.045 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.045 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.045 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.045 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.210577+0000", 2023-09-30T17:04:12.045 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4199999999999996e-07 2023-09-30T17:04:12.045 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.045 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.045 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.045 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.210590+0000", 2023-09-30T17:04:12.045 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3507e-05 2023-09-30T17:04:12.045 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.045 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.046 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.046 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.210597+0000", 2023-09-30T17:04:12.046 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5150000000000003e-06 2023-09-30T17:04:12.046 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.046 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.046 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.046 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.210602+0000", 2023-09-30T17:04:12.046 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4260000000000002e-06 2023-09-30T17:04:12.046 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.046 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.046 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:12.046 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.759892+0000", 2023-09-30T17:04:12.047 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.54928953199999997 2023-09-30T17:04:12.047 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.047 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.047 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:12.047 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.760120+0000", 2023-09-30T17:04:12.047 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000228085 2023-09-30T17:04:12.047 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.047 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.047 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:12.047 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.760286+0000", 2023-09-30T17:04:12.047 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016638800000000001 2023-09-30T17:04:12.048 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.048 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.048 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:12.048 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.790562+0000", 2023-09-30T17:04:12.048 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.030275539000000001 2023-09-30T17:04:12.048 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.048 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.048 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.048 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.048 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.048 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:114662 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 2506752~4096 in=4096b,write 2740224~4096 in=4096b,write 2932736~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.048 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.236032+0000", 2023-09-30T17:04:12.049 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.55720857700000004, 2023-09-30T17:04:12.049 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.55974132099999996, 2023-09-30T17:04:12.049 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.049 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:12.049 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.049 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.049 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.049 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 114662 2023-09-30T17:04:12.049 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.049 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.049 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.050 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.050 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.236032+0000", 2023-09-30T17:04:12.050 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.050 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.050 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.050 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.050 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.236032+0000", 2023-09-30T17:04:12.050 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.050 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.050 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.050 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.051 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.236032+0000", 2023-09-30T17:04:12.051 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.03e-07 2023-09-30T17:04:12.051 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.051 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.051 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.051 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.236043+0000", 2023-09-30T17:04:12.051 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0968000000000001e-05 2023-09-30T17:04:12.051 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.051 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.051 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.052 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.236049+0000", 2023-09-30T17:04:12.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7919999999999998e-06 2023-09-30T17:04:12.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.052 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.052 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.236054+0000", 2023-09-30T17:04:12.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7859999999999996e-06 2023-09-30T17:04:12.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.052 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:12.052 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.790613+0000", 2023-09-30T17:04:12.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.55455980900000001 2023-09-30T17:04:12.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.053 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.053 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:12.053 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.790698+0000", 2023-09-30T17:04:12.053 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4845000000000005e-05 2023-09-30T17:04:12.053 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.053 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.053 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:12.053 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.790858+0000", 2023-09-30T17:04:12.053 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015937199999999999 2023-09-30T17:04:12.053 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.053 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.054 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.054 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.054 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.054 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115144 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.054 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.377652+0000", 2023-09-30T17:04:12.054 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.415588234, 2023-09-30T17:04:12.054 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.41819126699999998, 2023-09-30T17:04:12.054 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.054 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.054 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.054 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.054 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.055 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115144 2023-09-30T17:04:12.055 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.055 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.055 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.055 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.055 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.377652+0000", 2023-09-30T17:04:12.055 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.055 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.055 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.055 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.055 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.377652+0000", 2023-09-30T17:04:12.055 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.056 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.056 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.056 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.056 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.377653+0000", 2023-09-30T17:04:12.056 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7800000000000001e-07 2023-09-30T17:04:12.056 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.056 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.056 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.056 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.377670+0000", 2023-09-30T17:04:12.056 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7728999999999999e-05 2023-09-30T17:04:12.056 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.057 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.057 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.057 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.377676+0000", 2023-09-30T17:04:12.057 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2410000000000003e-06 2023-09-30T17:04:12.057 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.057 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.057 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.057 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.377679+0000", 2023-09-30T17:04:12.057 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4000000000000001e-06 2023-09-30T17:04:12.057 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.057 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.057 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.058 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.058 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.058 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115351 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.058 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.458595+0000", 2023-09-30T17:04:12.058 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.33464566800000001, 2023-09-30T17:04:12.058 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.33730213999999997, 2023-09-30T17:04:12.058 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.058 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.058 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.058 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.058 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.058 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115351 2023-09-30T17:04:12.059 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.059 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.059 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.059 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.059 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.458595+0000", 2023-09-30T17:04:12.059 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.059 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.059 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.059 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.059 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.458595+0000", 2023-09-30T17:04:12.059 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.060 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.060 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.060 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.060 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.462516+0000", 2023-09-30T17:04:12.060 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039209249999999996 2023-09-30T17:04:12.060 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.060 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.060 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.060 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.462526+0000", 2023-09-30T17:04:12.060 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0013999999999999e-05 2023-09-30T17:04:12.060 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.060 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.061 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.061 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.462539+0000", 2023-09-30T17:04:12.061 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3377000000000001e-05 2023-09-30T17:04:12.061 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.061 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.061 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.061 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.462544+0000", 2023-09-30T17:04:12.061 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1819999999999997e-06 2023-09-30T17:04:12.061 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.061 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.061 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.062 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.062 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.062 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115506 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.062 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.511644+0000", 2023-09-30T17:04:12.062 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.28159585199999998, 2023-09-30T17:04:12.062 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.28430349500000002, 2023-09-30T17:04:12.062 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.062 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.062 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.062 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.062 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.062 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115506 2023-09-30T17:04:12.063 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.063 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.063 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.063 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.063 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.511644+0000", 2023-09-30T17:04:12.063 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.063 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.063 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.063 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.063 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.511644+0000", 2023-09-30T17:04:12.063 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.064 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.064 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.064 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.064 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.514875+0000", 2023-09-30T17:04:12.064 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0032307630000000002 2023-09-30T17:04:12.064 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.064 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.064 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.064 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.514897+0000", 2023-09-30T17:04:12.064 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1466000000000001e-05 2023-09-30T17:04:12.064 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.064 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.065 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.065 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.514904+0000", 2023-09-30T17:04:12.065 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0700000000000001e-06 2023-09-30T17:04:12.065 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.065 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.065 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.065 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.514910+0000", 2023-09-30T17:04:12.065 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2929999999999997e-06 2023-09-30T17:04:12.065 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.065 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.065 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.066 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.066 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.066 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115703 4.38 4:1dcf718c:::100000001f8.00000022:head [write 2301952~4096 in=4096b,write 3956736~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.066 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.589821+0000", 2023-09-30T17:04:12.066 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.20341965100000001, 2023-09-30T17:04:12.066 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.20618574000000001, 2023-09-30T17:04:12.066 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.066 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:12.066 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.066 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.066 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.066 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115703 2023-09-30T17:04:12.067 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.067 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.067 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.067 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.067 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.589821+0000", 2023-09-30T17:04:12.067 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.067 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.067 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.067 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.067 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.589821+0000", 2023-09-30T17:04:12.067 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.067 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.068 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.068 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.068 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.591515+0000", 2023-09-30T17:04:12.068 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001694512 2023-09-30T17:04:12.068 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.068 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.068 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.068 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.591528+0000", 2023-09-30T17:04:12.068 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2914999999999999e-05 2023-09-30T17:04:12.068 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.068 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.069 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.069 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.591538+0000", 2023-09-30T17:04:12.069 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0040999999999999e-05 2023-09-30T17:04:12.069 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.069 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.069 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.069 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.591545+0000", 2023-09-30T17:04:12.069 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8580000000000002e-06 2023-09-30T17:04:12.069 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.069 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.069 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:12.069 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.757146+0000", 2023-09-30T17:04:12.070 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.165601255 2023-09-30T17:04:12.070 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.070 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.070 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:12.070 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.757218+0000", 2023-09-30T17:04:12.070 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1971000000000006e-05 2023-09-30T17:04:12.070 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.070 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.070 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.070 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.070 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.070 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115777 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.071 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.631614+0000", 2023-09-30T17:04:12.071 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.161626245, 2023-09-30T17:04:12.071 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.16445511500000001, 2023-09-30T17:04:12.071 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.071 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.071 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.071 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.071 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.071 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115777 2023-09-30T17:04:12.071 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.071 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.071 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.072 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.072 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.631614+0000", 2023-09-30T17:04:12.072 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.072 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.072 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.072 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.072 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.631614+0000", 2023-09-30T17:04:12.072 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.072 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.072 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.072 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.073 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.631615+0000", 2023-09-30T17:04:12.073 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1799999999999995e-07 2023-09-30T17:04:12.073 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.073 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.073 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.073 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.631637+0000", 2023-09-30T17:04:12.073 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1942000000000001e-05 2023-09-30T17:04:12.073 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.073 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.073 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.073 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.631648+0000", 2023-09-30T17:04:12.073 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1472e-05 2023-09-30T17:04:12.074 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.074 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.074 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.074 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.631653+0000", 2023-09-30T17:04:12.074 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3890000000000004e-06 2023-09-30T17:04:12.074 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.074 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.074 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.074 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.074 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.074 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113540 4.2e e52/17 4:75be0f36:::100000001f8.0000003d:head v 52'1751, mlcod=52'1743)", 2023-09-30T17:04:12.074 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.657154+0000", 2023-09-30T17:04:12.075 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.13608663900000001, 2023-09-30T17:04:12.075 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.138972137, 2023-09-30T17:04:12.075 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.075 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:12.075 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.075 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.075 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.075 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.657154+0000", 2023-09-30T17:04:12.075 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.075 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.075 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.076 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.076 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.657154+0000", 2023-09-30T17:04:12.076 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.076 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.076 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.076 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.076 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.657155+0000", 2023-09-30T17:04:12.076 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1800000000000004e-07 2023-09-30T17:04:12.076 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.076 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.076 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.076 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.657175+0000", 2023-09-30T17:04:12.077 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0316999999999999e-05 2023-09-30T17:04:12.077 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.077 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.077 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.077 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.657186+0000", 2023-09-30T17:04:12.077 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0849999999999999e-05 2023-09-30T17:04:12.077 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.077 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.077 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.077 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.657194+0000", 2023-09-30T17:04:12.077 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7309999999999999e-06 2023-09-30T17:04:12.078 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.078 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.078 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:12.078 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.789534+0000", 2023-09-30T17:04:12.078 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.13233962699999999 2023-09-30T17:04:12.078 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.078 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.078 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:12.078 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.789555+0000", 2023-09-30T17:04:12.078 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1203999999999999e-05 2023-09-30T17:04:12.078 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.078 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.079 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.079 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.079 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.079 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115860 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.079 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.670031+0000", 2023-09-30T17:04:12.079 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.123209271, 2023-09-30T17:04:12.079 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.12615251999999999, 2023-09-30T17:04:12.079 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.079 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.079 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.079 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.080 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.080 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115860 2023-09-30T17:04:12.080 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.080 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.080 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.080 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.080 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.670031+0000", 2023-09-30T17:04:12.080 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.080 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.080 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.080 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.080 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.670031+0000", 2023-09-30T17:04:12.081 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.081 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.081 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.081 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.081 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.670031+0000", 2023-09-30T17:04:12.081 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3300000000000003e-07 2023-09-30T17:04:12.081 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.081 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.081 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.081 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.670039+0000", 2023-09-30T17:04:12.081 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5089999999999996e-06 2023-09-30T17:04:12.081 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.082 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.082 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.082 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.670043+0000", 2023-09-30T17:04:12.082 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0380000000000001e-06 2023-09-30T17:04:12.082 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.082 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.082 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.082 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.670046+0000", 2023-09-30T17:04:12.082 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4369999999999999e-06 2023-09-30T17:04:12.082 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.082 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.082 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.083 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.083 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.083 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116001 4.38 4.5b0ac3f8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.083 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.718918+0000", 2023-09-30T17:04:12.083 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.074321889000000002, 2023-09-30T17:04:12.083 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.077317741999999995, 2023-09-30T17:04:12.083 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.083 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.083 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.083 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.083 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.083 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116001 2023-09-30T17:04:12.084 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.084 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.084 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.084 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.084 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.718918+0000", 2023-09-30T17:04:12.084 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.084 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.084 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.084 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.084 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.718918+0000", 2023-09-30T17:04:12.084 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.085 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.085 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.085 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.085 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.718919+0000", 2023-09-30T17:04:12.085 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6199999999999999e-07 2023-09-30T17:04:12.085 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.085 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.085 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.085 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.718930+0000", 2023-09-30T17:04:12.085 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1306e-05 2023-09-30T17:04:12.085 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.085 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.086 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.086 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.718936+0000", 2023-09-30T17:04:12.086 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8000000000000004e-06 2023-09-30T17:04:12.086 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.086 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.086 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.086 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.718940+0000", 2023-09-30T17:04:12.086 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5120000000000002e-06 2023-09-30T17:04:12.086 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.086 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.086 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.086 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.087 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.087 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113970 4.2e e52/17)", 2023-09-30T17:04:12.087 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.775655+0000", 2023-09-30T17:04:12.087 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.017585239999999999, 2023-09-30T17:04:12.087 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020631876, 2023-09-30T17:04:12.087 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.087 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.087 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.087 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.087 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.087 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.775655+0000", 2023-09-30T17:04:12.087 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.088 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.088 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.088 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.088 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.775655+0000", 2023-09-30T17:04:12.088 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.088 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.088 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.088 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.088 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.775655+0000", 2023-09-30T17:04:12.088 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1199999999999999e-07 2023-09-30T17:04:12.088 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.089 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.089 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.089 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.775669+0000", 2023-09-30T17:04:12.089 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3618000000000001e-05 2023-09-30T17:04:12.089 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.089 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.089 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.089 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.775677+0000", 2023-09-30T17:04:12.089 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3049999999999993e-06 2023-09-30T17:04:12.089 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.089 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.089 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.090 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.775683+0000", 2023-09-30T17:04:12.090 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3739999999999997e-06 2023-09-30T17:04:12.090 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.090 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.090 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.090 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.090 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.090 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116207 4.c 4:33b8095f:::100000001f8.0000003a:head [write 3993600~4096 in=4096b,write 4177920~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.090 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.792894+0000", 2023-09-30T17:04:12.090 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.00034665599999999998, 2023-09-30T17:04:12.091 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0034441039999999999, 2023-09-30T17:04:12.091 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.091 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:12.091 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.091 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.091 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.091 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116207 2023-09-30T17:04:12.091 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.091 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.091 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.091 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.091 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.792894+0000", 2023-09-30T17:04:12.092 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.092 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.092 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.092 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.092 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.792894+0000", 2023-09-30T17:04:12.092 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.092 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.092 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.092 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.092 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.792894+0000", 2023-09-30T17:04:12.092 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0299999999999999e-07 2023-09-30T17:04:12.092 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.093 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.093 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.093 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.792906+0000", 2023-09-30T17:04:12.093 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1764e-05 2023-09-30T17:04:12.093 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.093 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.093 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.093 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.792913+0000", 2023-09-30T17:04:12.093 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9879999999999998e-06 2023-09-30T17:04:12.093 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.093 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.094 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.094 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.792919+0000", 2023-09-30T17:04:12.094 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5520000000000004e-06 2023-09-30T17:04:12.094 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.094 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.094 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:12.094 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.792961+0000", 2023-09-30T17:04:12.094 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2435000000000003e-05 2023-09-30T17:04:12.094 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.094 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.094 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:12.095 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.793038+0000", 2023-09-30T17:04:12.095 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7064999999999995e-05 2023-09-30T17:04:12.095 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.095 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.095 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.095 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.095 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.095 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:114582 4.37 4:ef395e89:::100000001f8.00000020:head [write 2793472~4096 in=4096b,write 2822144~4096 in=4096b,write 3031040~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.095 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.210611+0000", 2023-09-30T17:04:12.095 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.58262923300000002, 2023-09-30T17:04:12.095 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.58579465600000002, 2023-09-30T17:04:12.096 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.096 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:12.096 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.096 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.096 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.096 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 114582 2023-09-30T17:04:12.096 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.096 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.096 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.096 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.096 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.210611+0000", 2023-09-30T17:04:12.096 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.097 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.097 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.097 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.097 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.210611+0000", 2023-09-30T17:04:12.097 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.097 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.097 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.097 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.097 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.210612+0000", 2023-09-30T17:04:12.097 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6000000000000004e-07 2023-09-30T17:04:12.097 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.098 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.098 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.098 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.210624+0000", 2023-09-30T17:04:12.098 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2139e-05 2023-09-30T17:04:12.098 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.098 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.098 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.098 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.210632+0000", 2023-09-30T17:04:12.098 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3240000000000003e-06 2023-09-30T17:04:12.098 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.098 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.099 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.099 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.210639+0000", 2023-09-30T17:04:12.099 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7020000000000004e-06 2023-09-30T17:04:12.099 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.099 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.099 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:12.099 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.768293+0000", 2023-09-30T17:04:12.099 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.55765384600000001 2023-09-30T17:04:12.099 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.099 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.099 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:12.099 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.768362+0000", 2023-09-30T17:04:12.100 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9171999999999994e-05 2023-09-30T17:04:12.100 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.100 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.100 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:12.100 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.768504+0000", 2023-09-30T17:04:12.100 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000142306 2023-09-30T17:04:12.100 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.100 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.100 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:12.100 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.790566+0000", 2023-09-30T17:04:12.100 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022061918 2023-09-30T17:04:12.101 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.101 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.101 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.101 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.101 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.101 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:114663 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.101 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.236068+0000", 2023-09-30T17:04:12.101 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.55717210699999997, 2023-09-30T17:04:12.101 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.56041148200000002, 2023-09-30T17:04:12.101 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.101 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.101 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.102 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.102 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.102 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 114663 2023-09-30T17:04:12.102 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.102 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.102 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.102 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.102 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.236068+0000", 2023-09-30T17:04:12.102 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.102 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.102 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.103 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.103 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.236068+0000", 2023-09-30T17:04:12.103 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.103 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.103 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.103 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.103 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.237515+0000", 2023-09-30T17:04:12.103 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001446644 2023-09-30T17:04:12.103 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.103 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.103 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.103 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.237531+0000", 2023-09-30T17:04:12.104 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6382e-05 2023-09-30T17:04:12.104 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.104 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.104 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.104 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.237541+0000", 2023-09-30T17:04:12.104 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5189999999999998e-06 2023-09-30T17:04:12.104 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.104 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.104 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.104 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.237548+0000", 2023-09-30T17:04:12.104 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6590000000000007e-06 2023-09-30T17:04:12.104 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.105 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.105 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.105 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.105 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.105 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:114903 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.105 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.313807+0000", 2023-09-30T17:04:12.105 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.47943365999999998, 2023-09-30T17:04:12.105 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.482730031, 2023-09-30T17:04:12.105 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.105 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.105 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.105 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.105 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.106 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 114903 2023-09-30T17:04:12.106 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.106 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.106 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.106 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.106 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.313807+0000", 2023-09-30T17:04:12.106 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.106 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.106 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.106 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.106 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.313807+0000", 2023-09-30T17:04:12.107 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.107 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.107 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.107 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.107 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.313807+0000", 2023-09-30T17:04:12.107 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2900000000000003e-07 2023-09-30T17:04:12.107 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.107 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.107 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.107 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.313824+0000", 2023-09-30T17:04:12.107 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6705e-05 2023-09-30T17:04:12.107 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.107 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.108 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.108 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.313834+0000", 2023-09-30T17:04:12.108 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9890000000000004e-06 2023-09-30T17:04:12.108 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.108 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.108 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.108 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.313839+0000", 2023-09-30T17:04:12.108 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3990000000000003e-06 2023-09-30T17:04:12.108 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.108 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.108 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.108 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.109 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.109 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:114962 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.109 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.332049+0000", 2023-09-30T17:04:12.109 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.46119133699999998, 2023-09-30T17:04:12.109 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.46453921799999998, 2023-09-30T17:04:12.109 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.109 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.109 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.109 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.109 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.109 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 114962 2023-09-30T17:04:12.109 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.110 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.110 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.110 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.110 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.332049+0000", 2023-09-30T17:04:12.110 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.110 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.110 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.110 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.110 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.332049+0000", 2023-09-30T17:04:12.110 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.110 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.111 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.111 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.111 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.337551+0000", 2023-09-30T17:04:12.111 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0055021769999999996 2023-09-30T17:04:12.111 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.111 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.111 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.111 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.337567+0000", 2023-09-30T17:04:12.111 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5557999999999999e-05 2023-09-30T17:04:12.111 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.111 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.111 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.112 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.337575+0000", 2023-09-30T17:04:12.112 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9740000000000002e-06 2023-09-30T17:04:12.112 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.112 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.112 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.112 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.337582+0000", 2023-09-30T17:04:12.112 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7139999999999993e-06 2023-09-30T17:04:12.112 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.112 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.112 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.112 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.113 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.113 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115609 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.113 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.566634+0000", 2023-09-30T17:04:12.113 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.22660634700000001, 2023-09-30T17:04:12.113 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.23002709900000001, 2023-09-30T17:04:12.113 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.113 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.113 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.113 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.113 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.113 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115609 2023-09-30T17:04:12.113 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.113 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.114 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.114 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.114 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.566634+0000", 2023-09-30T17:04:12.114 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.114 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.114 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.114 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.114 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.566634+0000", 2023-09-30T17:04:12.114 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.114 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.114 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.115 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.115 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.566634+0000", 2023-09-30T17:04:12.115 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.27e-07 2023-09-30T17:04:12.115 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.115 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.115 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.115 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.566644+0000", 2023-09-30T17:04:12.115 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2229999999999996e-06 2023-09-30T17:04:12.115 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.115 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.115 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.115 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.566650+0000", 2023-09-30T17:04:12.116 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.032e-06 2023-09-30T17:04:12.116 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.116 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.116 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.116 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.566655+0000", 2023-09-30T17:04:12.116 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7339999999999996e-06 2023-09-30T17:04:12.116 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.116 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.116 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.116 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.116 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.117 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115778 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.117 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.631661+0000", 2023-09-30T17:04:12.117 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.16157887900000001, 2023-09-30T17:04:12.117 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.16504081000000001, 2023-09-30T17:04:12.117 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.117 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.117 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.117 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.117 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.117 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115778 2023-09-30T17:04:12.117 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.118 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.118 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.118 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.118 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.631661+0000", 2023-09-30T17:04:12.118 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.118 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.118 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.118 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.118 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.631661+0000", 2023-09-30T17:04:12.118 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.119 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.119 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.119 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.119 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.631662+0000", 2023-09-30T17:04:12.119 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.34e-07 2023-09-30T17:04:12.119 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.119 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.119 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.119 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.631677+0000", 2023-09-30T17:04:12.119 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5197999999999999e-05 2023-09-30T17:04:12.119 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.119 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.120 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.120 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.631683+0000", 2023-09-30T17:04:12.120 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2210000000000002e-06 2023-09-30T17:04:12.120 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.120 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.120 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.120 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.631689+0000", 2023-09-30T17:04:12.120 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2660000000000001e-06 2023-09-30T17:04:12.120 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.120 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.120 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.120 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.121 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.121 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113741 4.2e e52/17)", 2023-09-30T17:04:12.121 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.705655+0000", 2023-09-30T17:04:12.121 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.087585527999999996, 2023-09-30T17:04:12.121 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.091078681999999994, 2023-09-30T17:04:12.121 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.121 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.121 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.121 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.121 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.121 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.705655+0000", 2023-09-30T17:04:12.121 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.122 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.122 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.122 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.122 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.705655+0000", 2023-09-30T17:04:12.122 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.122 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.122 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.122 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.122 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.705655+0000", 2023-09-30T17:04:12.122 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0100000000000005e-07 2023-09-30T17:04:12.122 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.122 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.123 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.123 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.705669+0000", 2023-09-30T17:04:12.123 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3309000000000001e-05 2023-09-30T17:04:12.123 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.123 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.123 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.123 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.705678+0000", 2023-09-30T17:04:12.123 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.628e-06 2023-09-30T17:04:12.123 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.123 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.123 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.123 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.705683+0000", 2023-09-30T17:04:12.124 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7639999999999996e-06 2023-09-30T17:04:12.124 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.124 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.124 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.124 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.124 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.124 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116070 4.38 4.9b7e3478 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.124 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.742690+0000", 2023-09-30T17:04:12.124 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.050549904, 2023-09-30T17:04:12.124 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.054075511, 2023-09-30T17:04:12.124 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.124 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.125 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.125 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.125 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.125 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116070 2023-09-30T17:04:12.125 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.125 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.125 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.125 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.125 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.742690+0000", 2023-09-30T17:04:12.125 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.125 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.125 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.126 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.126 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.742690+0000", 2023-09-30T17:04:12.126 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.126 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.126 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.126 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.126 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.742691+0000", 2023-09-30T17:04:12.126 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9100000000000004e-07 2023-09-30T17:04:12.126 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.126 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.126 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.126 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.742703+0000", 2023-09-30T17:04:12.126 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2424e-05 2023-09-30T17:04:12.127 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.127 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.127 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.127 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.742711+0000", 2023-09-30T17:04:12.127 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5079999999999999e-06 2023-09-30T17:04:12.127 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.127 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.127 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.127 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.742717+0000", 2023-09-30T17:04:12.127 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9100000000000002e-06 2023-09-30T17:04:12.127 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.127 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.128 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.128 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.128 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.128 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113976 4.36 e52/17)", 2023-09-30T17:04:12.128 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.775691+0000", 2023-09-30T17:04:12.128 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.017549728000000001, 2023-09-30T17:04:12.128 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021111311000000001, 2023-09-30T17:04:12.128 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.128 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.128 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.128 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.128 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.129 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.775691+0000", 2023-09-30T17:04:12.129 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.129 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.129 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.129 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.129 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.775691+0000", 2023-09-30T17:04:12.129 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.129 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.129 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.129 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.129 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.775691+0000", 2023-09-30T17:04:12.129 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6e-07 2023-09-30T17:04:12.130 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.130 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.130 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.130 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.775701+0000", 2023-09-30T17:04:12.130 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0299000000000001e-05 2023-09-30T17:04:12.130 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.130 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.130 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.130 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.775707+0000", 2023-09-30T17:04:12.130 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.105e-06 2023-09-30T17:04:12.130 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.130 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.131 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.131 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.775711+0000", 2023-09-30T17:04:12.131 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2100000000000003e-06 2023-09-30T17:04:12.131 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.131 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.131 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.131 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.131 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.131 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116212 4.1b 4:dbd503eb:::100000001f8.0000002e:head [write 589824~4096 in=4096b,write 634880~4096 in=4096b,write 704512~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.131 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.792929+0000", 2023-09-30T17:04:12.131 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.00031114000000000001, 2023-09-30T17:04:12.131 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0040636200000000004, 2023-09-30T17:04:12.132 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.132 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:12.132 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.132 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.132 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.132 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116212 2023-09-30T17:04:12.132 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.132 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.132 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.132 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.132 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.792929+0000", 2023-09-30T17:04:12.132 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.133 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.133 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.133 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.792929+0000", 2023-09-30T17:04:12.133 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.133 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.133 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.133 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.792930+0000", 2023-09-30T17:04:12.133 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9599999999999999e-07 2023-09-30T17:04:12.133 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.134 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.134 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.792941+0000", 2023-09-30T17:04:12.134 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1522000000000001e-05 2023-09-30T17:04:12.134 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.134 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.134 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.134 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.792948+0000", 2023-09-30T17:04:12.134 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7190000000000004e-06 2023-09-30T17:04:12.134 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.134 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.134 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.134 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.792954+0000", 2023-09-30T17:04:12.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7760000000000003e-06 2023-09-30T17:04:12.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.135 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.135 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:12.135 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.793252+0000", 2023-09-30T17:04:12.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00029816700000000001 2023-09-30T17:04:12.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.135 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.135 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:12.135 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.793304+0000", 2023-09-30T17:04:12.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2515000000000001e-05 2023-09-30T17:04:12.135 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.136 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.136 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.136 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.136 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.136 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:114666 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.136 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.237561+0000", 2023-09-30T17:04:12.136 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.55567926300000003, 2023-09-30T17:04:12.136 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.55950250700000004, 2023-09-30T17:04:12.136 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.136 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.136 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.136 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.137 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.137 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 114666 2023-09-30T17:04:12.137 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.137 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.137 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.137 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.137 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.237561+0000", 2023-09-30T17:04:12.137 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.137 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.137 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.137 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.137 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.237561+0000", 2023-09-30T17:04:12.138 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.138 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.138 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.138 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.138 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.237562+0000", 2023-09-30T17:04:12.138 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2600000000000002e-07 2023-09-30T17:04:12.138 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.138 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.138 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.138 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.237580+0000", 2023-09-30T17:04:12.138 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8600000000000001e-05 2023-09-30T17:04:12.138 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.139 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.139 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.139 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.237590+0000", 2023-09-30T17:04:12.139 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8819999999999996e-06 2023-09-30T17:04:12.139 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.139 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.139 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.139 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.237596+0000", 2023-09-30T17:04:12.139 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0480000000000004e-06 2023-09-30T17:04:12.139 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.139 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.139 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.140 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.140 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.140 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115444 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.140 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.497643+0000", 2023-09-30T17:04:12.140 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.295597783, 2023-09-30T17:04:12.140 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.29946481000000003, 2023-09-30T17:04:12.140 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.140 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.140 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.140 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.140 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.140 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115444 2023-09-30T17:04:12.141 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.141 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.141 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.141 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.141 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.497643+0000", 2023-09-30T17:04:12.141 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.141 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.141 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.141 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.141 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.497643+0000", 2023-09-30T17:04:12.141 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.141 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.142 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.142 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.142 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.497643+0000", 2023-09-30T17:04:12.142 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8299999999999997e-07 2023-09-30T17:04:12.142 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.142 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.142 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.142 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.497655+0000", 2023-09-30T17:04:12.142 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.163e-05 2023-09-30T17:04:12.142 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.142 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.143 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.143 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.497661+0000", 2023-09-30T17:04:12.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7479999999999996e-06 2023-09-30T17:04:12.143 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.143 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.143 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.143 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.497667+0000", 2023-09-30T17:04:12.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4399999999999996e-06 2023-09-30T17:04:12.143 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.143 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.143 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.143 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.144 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.144 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115472 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.144 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.505558+0000", 2023-09-30T17:04:12.144 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.28768258299999999, 2023-09-30T17:04:12.144 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.291597422, 2023-09-30T17:04:12.144 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.144 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.144 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.144 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.144 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.144 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115472 2023-09-30T17:04:12.144 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.145 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.145 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.145 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.145 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.505558+0000", 2023-09-30T17:04:12.145 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.145 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.145 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.145 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.145 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.505558+0000", 2023-09-30T17:04:12.145 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.145 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.145 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.145 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.146 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.505558+0000", 2023-09-30T17:04:12.146 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4799999999999998e-07 2023-09-30T17:04:12.146 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.146 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.146 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.146 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.505572+0000", 2023-09-30T17:04:12.146 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3380999999999999e-05 2023-09-30T17:04:12.146 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.146 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.146 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.146 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.505580+0000", 2023-09-30T17:04:12.146 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8609999999999998e-06 2023-09-30T17:04:12.147 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.147 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.147 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.147 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.505585+0000", 2023-09-30T17:04:12.147 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9580000000000004e-06 2023-09-30T17:04:12.147 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.147 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.147 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.147 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.147 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.147 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115536 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.147 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.530713+0000", 2023-09-30T17:04:12.148 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.26252769300000001, 2023-09-30T17:04:12.148 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.26650581899999998, 2023-09-30T17:04:12.148 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.148 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.148 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.148 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.148 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.148 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115536 2023-09-30T17:04:12.148 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.148 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.148 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.148 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.149 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.530713+0000", 2023-09-30T17:04:12.149 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.149 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.149 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.149 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.149 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.530713+0000", 2023-09-30T17:04:12.149 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.149 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.149 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.149 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.149 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.530713+0000", 2023-09-30T17:04:12.149 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6300000000000001e-07 2023-09-30T17:04:12.150 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.150 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.150 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.150 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.530727+0000", 2023-09-30T17:04:12.150 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.43e-05 2023-09-30T17:04:12.150 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.150 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.150 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.150 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.530731+0000", 2023-09-30T17:04:12.150 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.72e-06 2023-09-30T17:04:12.150 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.150 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.151 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.151 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.530734+0000", 2023-09-30T17:04:12.151 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1580000000000001e-06 2023-09-30T17:04:12.151 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.151 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.151 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.151 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.151 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.151 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115650 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.151 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.582179+0000", 2023-09-30T17:04:12.151 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.21106145600000001, 2023-09-30T17:04:12.151 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.21510736499999999, 2023-09-30T17:04:12.151 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.152 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.152 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.152 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.152 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.152 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115650 2023-09-30T17:04:12.152 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.152 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.152 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.152 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.152 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.582179+0000", 2023-09-30T17:04:12.152 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.152 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.153 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.153 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.153 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.582179+0000", 2023-09-30T17:04:12.153 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.153 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.153 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.153 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.153 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.582179+0000", 2023-09-30T17:04:12.153 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5600000000000001e-07 2023-09-30T17:04:12.153 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.153 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.153 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.154 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.582191+0000", 2023-09-30T17:04:12.154 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1416999999999999e-05 2023-09-30T17:04:12.154 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.154 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.154 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.154 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.582198+0000", 2023-09-30T17:04:12.154 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3520000000000001e-06 2023-09-30T17:04:12.154 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.154 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.154 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.154 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.582204+0000", 2023-09-30T17:04:12.154 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5110000000000003e-06 2023-09-30T17:04:12.155 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.155 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.155 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.155 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.155 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.155 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115779 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.155 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.631694+0000", 2023-09-30T17:04:12.155 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.16154589499999999, 2023-09-30T17:04:12.155 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.165655251, 2023-09-30T17:04:12.155 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.155 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.155 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.155 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.156 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.156 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115779 2023-09-30T17:04:12.156 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.156 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.156 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.156 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.156 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.631694+0000", 2023-09-30T17:04:12.156 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.156 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.156 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.156 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.156 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.631694+0000", 2023-09-30T17:04:12.157 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.157 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.157 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.157 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.157 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.631695+0000", 2023-09-30T17:04:12.157 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4799999999999999e-07 2023-09-30T17:04:12.157 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.157 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.157 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.157 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.631709+0000", 2023-09-30T17:04:12.157 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3873000000000001e-05 2023-09-30T17:04:12.157 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.158 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.158 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.158 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.631715+0000", 2023-09-30T17:04:12.158 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1340000000000001e-06 2023-09-30T17:04:12.158 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.158 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.158 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.158 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.631719+0000", 2023-09-30T17:04:12.158 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6630000000000001e-06 2023-09-30T17:04:12.158 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.158 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.158 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.159 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.159 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.159 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113626 4.36 e52/17)", 2023-09-30T17:04:12.159 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.671125+0000", 2023-09-30T17:04:12.159 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.12211507100000001, 2023-09-30T17:04:12.159 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.12628706200000001, 2023-09-30T17:04:12.159 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.159 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.159 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.159 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.159 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.159 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.671125+0000", 2023-09-30T17:04:12.160 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.160 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.160 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.160 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.160 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.671125+0000", 2023-09-30T17:04:12.160 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.160 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.160 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.160 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.160 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.671126+0000", 2023-09-30T17:04:12.160 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3900000000000003e-07 2023-09-30T17:04:12.160 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.161 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.161 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.161 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.671140+0000", 2023-09-30T17:04:12.161 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3743999999999999e-05 2023-09-30T17:04:12.161 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.161 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.161 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.161 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.671153+0000", 2023-09-30T17:04:12.161 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2672e-05 2023-09-30T17:04:12.161 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.161 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.161 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.162 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.671160+0000", 2023-09-30T17:04:12.162 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8359999999999992e-06 2023-09-30T17:04:12.162 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.162 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.162 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.162 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.162 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.162 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113742 4.36 e52/17)", 2023-09-30T17:04:12.162 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.705713+0000", 2023-09-30T17:04:12.162 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.087527015, 2023-09-30T17:04:12.162 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.091747810999999999, 2023-09-30T17:04:12.162 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.163 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.163 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.163 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.163 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.163 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.705713+0000", 2023-09-30T17:04:12.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.163 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.163 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.163 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.163 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.705713+0000", 2023-09-30T17:04:12.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.163 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.164 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.164 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.705714+0000", 2023-09-30T17:04:12.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7000000000000001e-07 2023-09-30T17:04:12.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.164 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.164 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.705721+0000", 2023-09-30T17:04:12.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7950000000000008e-06 2023-09-30T17:04:12.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.165 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.165 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.165 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.705727+0000", 2023-09-30T17:04:12.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3619999999999997e-06 2023-09-30T17:04:12.165 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.165 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.165 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.165 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.705730+0000", 2023-09-30T17:04:12.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2059999999999999e-06 2023-09-30T17:04:12.165 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.165 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.165 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.166 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.166 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116006 4.30 4.88c79130 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.166 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.718973+0000", 2023-09-30T17:04:12.166 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.074267438000000005, 2023-09-30T17:04:12.166 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.078551042000000001, 2023-09-30T17:04:12.166 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.166 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.166 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.166 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.166 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.167 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116006 2023-09-30T17:04:12.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.167 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.167 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.167 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.718973+0000", 2023-09-30T17:04:12.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.167 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.167 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.718973+0000", 2023-09-30T17:04:12.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.718973+0000", 2023-09-30T17:04:12.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2099999999999998e-07 2023-09-30T17:04:12.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.718984+0000", 2023-09-30T17:04:12.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0806e-05 2023-09-30T17:04:12.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.718990+0000", 2023-09-30T17:04:12.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6810000000000003e-06 2023-09-30T17:04:12.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.718995+0000", 2023-09-30T17:04:12.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.152e-06 2023-09-30T17:04:12.169 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.169 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.169 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.170 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116075 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.170 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.742725+0000", 2023-09-30T17:04:12.170 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.050514911000000003, 2023-09-30T17:04:12.170 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.054868740999999999, 2023-09-30T17:04:12.170 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.170 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.170 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.170 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.170 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.170 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116075 2023-09-30T17:04:12.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.171 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.742725+0000", 2023-09-30T17:04:12.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.742725+0000", 2023-09-30T17:04:12.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.172 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.172 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.742726+0000", 2023-09-30T17:04:12.172 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6699999999999999e-07 2023-09-30T17:04:12.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.172 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.172 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.742747+0000", 2023-09-30T17:04:12.172 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1132999999999999e-05 2023-09-30T17:04:12.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.172 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.172 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.742756+0000", 2023-09-30T17:04:12.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5939999999999994e-06 2023-09-30T17:04:12.173 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.173 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.173 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.742762+0000", 2023-09-30T17:04:12.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4659999999999996e-06 2023-09-30T17:04:12.173 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.173 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.173 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.173 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.173 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116213 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.174 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.792966+0000", 2023-09-30T17:04:12.174 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.00027403799999999999, 2023-09-30T17:04:12.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0046883159999999997, 2023-09-30T17:04:12.174 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.174 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.174 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.174 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.174 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.174 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116213 2023-09-30T17:04:12.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.174 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.175 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.175 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.792966+0000", 2023-09-30T17:04:12.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.175 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.175 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.792966+0000", 2023-09-30T17:04:12.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.175 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.175 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.792967+0000", 2023-09-30T17:04:12.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7399999999999998e-07 2023-09-30T17:04:12.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.792979+0000", 2023-09-30T17:04:12.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2119999999999999e-05 2023-09-30T17:04:12.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.792986+0000", 2023-09-30T17:04:12.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5700000000000004e-06 2023-09-30T17:04:12.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.177 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.177 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.792992+0000", 2023-09-30T17:04:12.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5960000000000003e-06 2023-09-30T17:04:12.177 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.177 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.177 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.177 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115182 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.177 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.391059+0000", 2023-09-30T17:04:12.177 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.40218145100000002, 2023-09-30T17:04:12.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.40665562100000002, 2023-09-30T17:04:12.178 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.178 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.178 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.178 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.178 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.178 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115182 2023-09-30T17:04:12.178 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.178 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.178 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.178 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.178 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.391059+0000", 2023-09-30T17:04:12.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.391059+0000", 2023-09-30T17:04:12.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.393378+0000", 2023-09-30T17:04:12.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0023188179999999998 2023-09-30T17:04:12.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.180 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.180 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.393392+0000", 2023-09-30T17:04:12.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4762e-05 2023-09-30T17:04:12.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.180 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.180 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.393401+0000", 2023-09-30T17:04:12.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6130000000000004e-06 2023-09-30T17:04:12.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.180 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.180 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.393407+0000", 2023-09-30T17:04:12.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5539999999999997e-06 2023-09-30T17:04:12.181 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.181 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.181 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.181 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.181 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.181 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115390 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.181 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.471769+0000", 2023-09-30T17:04:12.181 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.32147156100000002, 2023-09-30T17:04:12.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.32600251099999999, 2023-09-30T17:04:12.181 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.182 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.182 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.182 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.182 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.182 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115390 2023-09-30T17:04:12.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.182 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.182 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.182 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.471769+0000", 2023-09-30T17:04:12.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.471769+0000", 2023-09-30T17:04:12.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.475517+0000", 2023-09-30T17:04:12.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003747982 2023-09-30T17:04:12.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.184 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.475532+0000", 2023-09-30T17:04:12.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5580999999999999e-05 2023-09-30T17:04:12.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.184 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.184 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.475543+0000", 2023-09-30T17:04:12.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0648999999999999e-05 2023-09-30T17:04:12.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.184 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.184 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.475550+0000", 2023-09-30T17:04:12.185 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4869999999999996e-06 2023-09-30T17:04:12.185 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.185 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.185 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.185 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.185 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.185 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115651 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.185 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.582213+0000", 2023-09-30T17:04:12.185 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.21102763399999999, 2023-09-30T17:04:12.185 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.21562094100000001, 2023-09-30T17:04:12.186 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.186 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.186 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.186 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.186 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.186 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115651 2023-09-30T17:04:12.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.189 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.582213+0000", 2023-09-30T17:04:12.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.190 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.190 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.582213+0000", 2023-09-30T17:04:12.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.190 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.190 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.582213+0000", 2023-09-30T17:04:12.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5900000000000002e-07 2023-09-30T17:04:12.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.190 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.582224+0000", 2023-09-30T17:04:12.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0698e-05 2023-09-30T17:04:12.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.191 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.582231+0000", 2023-09-30T17:04:12.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9319999999999999e-06 2023-09-30T17:04:12.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.191 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.582236+0000", 2023-09-30T17:04:12.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2700000000000004e-06 2023-09-30T17:04:12.192 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.192 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.192 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.192 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115723 4.30 4:0c89e311:::100000001f8.00000017:head [write 2367488~4096 in=4096b,write 2379776~4096 in=4096b,write 2514944~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.192 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.603563+0000", 2023-09-30T17:04:12.192 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.189677294, 2023-09-30T17:04:12.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.19433484700000001, 2023-09-30T17:04:12.192 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.192 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:12.192 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.193 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.193 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.193 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115723 2023-09-30T17:04:12.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.193 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.603563+0000", 2023-09-30T17:04:12.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.194 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.603563+0000", 2023-09-30T17:04:12.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.194 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.603564+0000", 2023-09-30T17:04:12.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3000000000000001e-07 2023-09-30T17:04:12.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.194 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.603576+0000", 2023-09-30T17:04:12.195 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2794e-05 2023-09-30T17:04:12.195 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.195 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.195 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.195 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.603584+0000", 2023-09-30T17:04:12.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3180000000000001e-06 2023-09-30T17:04:12.196 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.196 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.196 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.196 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.603589+0000", 2023-09-30T17:04:12.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2530000000000004e-06 2023-09-30T17:04:12.196 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.196 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.196 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:12.196 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.759975+0000", 2023-09-30T17:04:12.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.15638654699999999 2023-09-30T17:04:12.196 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.197 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:12.197 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.760087+0000", 2023-09-30T17:04:12.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000111428 2023-09-30T17:04:12.197 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.197 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.197 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.197 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.197 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115746 4.38 4:1d13bf87:::100000001f8.00000030:head [write 229376~4096 in=4096b,write 262144~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.197 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.614582+0000", 2023-09-30T17:04:12.197 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.17865867199999999, 2023-09-30T17:04:12.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.183388459, 2023-09-30T17:04:12.198 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.198 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:12.198 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.198 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.198 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.198 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115746 2023-09-30T17:04:12.198 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.198 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.198 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.198 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.198 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.614582+0000", 2023-09-30T17:04:12.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.614582+0000", 2023-09-30T17:04:12.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.621518+0000", 2023-09-30T17:04:12.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0069362790000000001 2023-09-30T17:04:12.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.200 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.621537+0000", 2023-09-30T17:04:12.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9210000000000001e-05 2023-09-30T17:04:12.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.200 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.621548+0000", 2023-09-30T17:04:12.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0502999999999999e-05 2023-09-30T17:04:12.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.201 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.201 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.621555+0000", 2023-09-30T17:04:12.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3799999999999996e-06 2023-09-30T17:04:12.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.201 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:12.201 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.788919+0000", 2023-09-30T17:04:12.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.16736395700000001 2023-09-30T17:04:12.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.201 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:12.202 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.788992+0000", 2023-09-30T17:04:12.202 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3134999999999997e-05 2023-09-30T17:04:12.202 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.202 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.202 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.202 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.202 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113692 4.6 e52/17)", 2023-09-30T17:04:12.202 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.696675+0000", 2023-09-30T17:04:12.202 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.096565092000000005, 2023-09-30T17:04:12.202 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.101365123, 2023-09-30T17:04:12.202 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.203 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.203 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.203 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.203 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.203 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.696675+0000", 2023-09-30T17:04:12.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.203 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.203 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.203 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.696675+0000", 2023-09-30T17:04:12.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.204 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.204 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.696676+0000", 2023-09-30T17:04:12.204 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1e-07 2023-09-30T17:04:12.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.204 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.204 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.696693+0000", 2023-09-30T17:04:12.204 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7295e-05 2023-09-30T17:04:12.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.204 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.205 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.696710+0000", 2023-09-30T17:04:12.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6779999999999999e-05 2023-09-30T17:04:12.205 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.205 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.205 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.696719+0000", 2023-09-30T17:04:12.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0189999999999995e-06 2023-09-30T17:04:12.205 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.205 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.205 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.205 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.206 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113747 4.6 e52/17)", 2023-09-30T17:04:12.206 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.708187+0000", 2023-09-30T17:04:12.206 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.085053633000000003, 2023-09-30T17:04:12.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.089904435000000005, 2023-09-30T17:04:12.206 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.206 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.206 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.206 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.206 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.708187+0000", 2023-09-30T17:04:12.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.207 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.207 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.708187+0000", 2023-09-30T17:04:12.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.207 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.207 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.708188+0000", 2023-09-30T17:04:12.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1100000000000004e-07 2023-09-30T17:04:12.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.207 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.208 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.708201+0000", 2023-09-30T17:04:12.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.376e-05 2023-09-30T17:04:12.208 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.208 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.208 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.708211+0000", 2023-09-30T17:04:12.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6500000000000008e-06 2023-09-30T17:04:12.208 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.208 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.208 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.708218+0000", 2023-09-30T17:04:12.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8070000000000002e-06 2023-09-30T17:04:12.209 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.209 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.209 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.209 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.209 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113754 4.6 e52/17)", 2023-09-30T17:04:12.209 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.719529+0000", 2023-09-30T17:04:12.209 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.073711360000000004, 2023-09-30T17:04:12.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.078608188999999995, 2023-09-30T17:04:12.209 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.209 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.209 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.210 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.719529+0000", 2023-09-30T17:04:12.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.210 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.210 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.719529+0000", 2023-09-30T17:04:12.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.210 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.719530+0000", 2023-09-30T17:04:12.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5099999999999999e-07 2023-09-30T17:04:12.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.719543+0000", 2023-09-30T17:04:12.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3359e-05 2023-09-30T17:04:12.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.719552+0000", 2023-09-30T17:04:12.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0780000000000002e-06 2023-09-30T17:04:12.212 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.212 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.212 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.719558+0000", 2023-09-30T17:04:12.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2920000000000001e-06 2023-09-30T17:04:12.212 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.212 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.212 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.212 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.212 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113816 4.6 e52/17)", 2023-09-30T17:04:12.212 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.733439+0000", 2023-09-30T17:04:12.213 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.059801515, 2023-09-30T17:04:12.213 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.064746992000000003, 2023-09-30T17:04:12.213 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.213 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.213 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.213 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.213 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.213 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.733439+0000", 2023-09-30T17:04:12.213 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.213 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.213 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.213 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.214 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.733439+0000", 2023-09-30T17:04:12.214 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.214 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.214 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.214 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.733439+0000", 2023-09-30T17:04:12.214 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0200000000000001e-07 2023-09-30T17:04:12.214 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.214 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.214 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.733460+0000", 2023-09-30T17:04:12.214 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1314e-05 2023-09-30T17:04:12.215 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.215 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.733465+0000", 2023-09-30T17:04:12.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9150000000000004e-06 2023-09-30T17:04:12.215 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.215 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.733468+0000", 2023-09-30T17:04:12.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1609999999999999e-06 2023-09-30T17:04:12.215 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.216 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.216 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.216 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.216 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.216 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116166 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 737280~4096 in=4096b,write 884736~4096 in=4096b,write 921600~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.216 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.775756+0000", 2023-09-30T17:04:12.216 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.017484315, 2023-09-30T17:04:12.217 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022482344000000001, 2023-09-30T17:04:12.217 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.217 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:12.217 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.217 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.217 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.217 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116166 2023-09-30T17:04:12.217 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.217 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.217 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.218 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.775756+0000", 2023-09-30T17:04:12.218 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.218 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.218 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.218 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.218 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.775756+0000", 2023-09-30T17:04:12.218 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.218 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.218 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.218 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.218 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.775756+0000", 2023-09-30T17:04:12.218 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1199999999999998e-07 2023-09-30T17:04:12.219 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.219 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.219 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.775770+0000", 2023-09-30T17:04:12.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3441999999999999e-05 2023-09-30T17:04:12.219 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.219 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.219 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.775776+0000", 2023-09-30T17:04:12.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.879e-06 2023-09-30T17:04:12.220 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.220 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.220 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.220 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.775780+0000", 2023-09-30T17:04:12.220 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7389999999999999e-06 2023-09-30T17:04:12.220 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.220 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.220 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:12.220 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.776619+0000", 2023-09-30T17:04:12.220 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00083881500000000003 2023-09-30T17:04:12.220 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.220 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.221 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:12.221 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.776696+0000", 2023-09-30T17:04:12.221 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6519000000000004e-05 2023-09-30T17:04:12.221 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.221 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.221 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:12.221 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.776840+0000", 2023-09-30T17:04:12.221 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014399599999999999 2023-09-30T17:04:12.221 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.221 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.221 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:12.221 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.784517+0000", 2023-09-30T17:04:12.222 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0076768619999999996 2023-09-30T17:04:12.222 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.222 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.222 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.222 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.222 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.222 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116216 4.2c 4:35cbff5f:::100000001f8.00000033:head [write 315392~4096 in=4096b,write 389120~4096 in=4096b,write 397312~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.222 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.792999+0000", 2023-09-30T17:04:12.222 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.000241112, 2023-09-30T17:04:12.222 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053227910000000003, 2023-09-30T17:04:12.222 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.223 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:12.223 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.223 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.223 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.223 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116216 2023-09-30T17:04:12.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.223 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.223 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.792999+0000", 2023-09-30T17:04:12.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.224 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.224 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.224 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.792999+0000", 2023-09-30T17:04:12.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.224 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.224 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.224 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.793000+0000", 2023-09-30T17:04:12.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4700000000000001e-07 2023-09-30T17:04:12.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.224 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.224 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.225 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.793012+0000", 2023-09-30T17:04:12.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1993e-05 2023-09-30T17:04:12.225 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.225 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.225 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.225 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.793019+0000", 2023-09-30T17:04:12.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9199999999999998e-06 2023-09-30T17:04:12.225 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.225 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.225 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.225 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.793024+0000", 2023-09-30T17:04:12.226 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1019999999999996e-06 2023-09-30T17:04:12.226 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.226 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.226 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:12.226 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.797814+0000", 2023-09-30T17:04:12.226 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047902760000000004 2023-09-30T17:04:12.226 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:12.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.797892+0000", 2023-09-30T17:04:12.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7613000000000004e-05 2023-09-30T17:04:12.227 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.227 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.227 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.227 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:114676 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.227 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.237641+0000", 2023-09-30T17:04:12.227 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.555599646, 2023-09-30T17:04:12.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.56074543399999999, 2023-09-30T17:04:12.228 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.228 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.228 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.228 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.228 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.228 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 114676 2023-09-30T17:04:12.228 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.228 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.228 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.228 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.235 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.237641+0000", 2023-09-30T17:04:12.235 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.235 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.235 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.235 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.235 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.237641+0000", 2023-09-30T17:04:12.235 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.236 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.236 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.236 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.236 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.237641+0000", 2023-09-30T17:04:12.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4700000000000002e-07 2023-09-30T17:04:12.236 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.236 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.236 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.236 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.237652+0000", 2023-09-30T17:04:12.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1245e-05 2023-09-30T17:04:12.236 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.237659+0000", 2023-09-30T17:04:12.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4899999999999997e-06 2023-09-30T17:04:12.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.237665+0000", 2023-09-30T17:04:12.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0839999999999997e-06 2023-09-30T17:04:12.237 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.237 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.237 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.238 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.238 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:114938 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.238 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.325566+0000", 2023-09-30T17:04:12.238 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.467674592, 2023-09-30T17:04:12.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.47287507699999998, 2023-09-30T17:04:12.238 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.238 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.238 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.238 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.238 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.238 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 114938 2023-09-30T17:04:12.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.239 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.239 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.239 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.325566+0000", 2023-09-30T17:04:12.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.239 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.239 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.325566+0000", 2023-09-30T17:04:12.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.240 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.240 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.240 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.325566+0000", 2023-09-30T17:04:12.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6300000000000005e-07 2023-09-30T17:04:12.240 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.240 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.240 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.240 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.325577+0000", 2023-09-30T17:04:12.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0545e-05 2023-09-30T17:04:12.241 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.241 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.241 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.325592+0000", 2023-09-30T17:04:12.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5142e-05 2023-09-30T17:04:12.241 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.241 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.241 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.325603+0000", 2023-09-30T17:04:12.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0888e-05 2023-09-30T17:04:12.241 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.241 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.242 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.242 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115285 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.242 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.434633+0000", 2023-09-30T17:04:12.242 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.35860703100000002, 2023-09-30T17:04:12.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.363859667, 2023-09-30T17:04:12.242 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.242 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.242 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.242 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.243 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.243 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115285 2023-09-30T17:04:12.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.243 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.434633+0000", 2023-09-30T17:04:12.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.434633+0000", 2023-09-30T17:04:12.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.434634+0000", 2023-09-30T17:04:12.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3300000000000003e-07 2023-09-30T17:04:12.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.434644+0000", 2023-09-30T17:04:12.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0217999999999999e-05 2023-09-30T17:04:12.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.245 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.261 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.434650+0000", 2023-09-30T17:04:12.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8560000000000003e-06 2023-09-30T17:04:12.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.261 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.261 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.434654+0000", 2023-09-30T17:04:12.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7249999999999997e-06 2023-09-30T17:04:12.262 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.262 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.262 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.262 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115391 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.262 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.475564+0000", 2023-09-30T17:04:12.262 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.31767614, 2023-09-30T17:04:12.262 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.322993325, 2023-09-30T17:04:12.263 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.263 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.263 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.263 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.263 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.263 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115391 2023-09-30T17:04:12.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.263 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.475564+0000", 2023-09-30T17:04:12.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.475564+0000", 2023-09-30T17:04:12.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.475565+0000", 2023-09-30T17:04:12.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9200000000000001e-07 2023-09-30T17:04:12.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.475580+0000", 2023-09-30T17:04:12.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4788e-05 2023-09-30T17:04:12.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.475587+0000", 2023-09-30T17:04:12.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4189999999999996e-06 2023-09-30T17:04:12.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.266 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.266 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.266 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.475593+0000", 2023-09-30T17:04:12.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7459999999999997e-06 2023-09-30T17:04:12.266 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.266 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.266 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.266 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.266 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.266 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115447 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.266 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.497712+0000", 2023-09-30T17:04:12.267 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.295527806, 2023-09-30T17:04:12.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.300900367, 2023-09-30T17:04:12.267 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.267 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.267 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.267 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.267 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.267 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115447 2023-09-30T17:04:12.267 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.267 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.267 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.268 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.497712+0000", 2023-09-30T17:04:12.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.268 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.268 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.268 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.497712+0000", 2023-09-30T17:04:12.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.268 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.268 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.268 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.497713+0000", 2023-09-30T17:04:12.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5400000000000001e-07 2023-09-30T17:04:12.269 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.269 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.269 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.497729+0000", 2023-09-30T17:04:12.269 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5509999999999999e-05 2023-09-30T17:04:12.269 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.269 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.269 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.497736+0000", 2023-09-30T17:04:12.269 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6190000000000002e-06 2023-09-30T17:04:12.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.275 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.275 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.497742+0000", 2023-09-30T17:04:12.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5509999999999999e-06 2023-09-30T17:04:12.275 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.276 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.276 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.276 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115747 4.30 4:0c89e311:::100000001f8.00000017:head [write 2695168~4096 in=4096b,write 2834432~4096 in=4096b,write 3223552~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.276 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.621569+0000", 2023-09-30T17:04:12.276 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.17167162999999999, 2023-09-30T17:04:12.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.17711485399999999, 2023-09-30T17:04:12.276 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.276 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:12.277 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.277 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.277 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.277 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115747 2023-09-30T17:04:12.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.277 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.621569+0000", 2023-09-30T17:04:12.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.621569+0000", 2023-09-30T17:04:12.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.621569+0000", 2023-09-30T17:04:12.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.06e-07 2023-09-30T17:04:12.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.621583+0000", 2023-09-30T17:04:12.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3762e-05 2023-09-30T17:04:12.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.621595+0000", 2023-09-30T17:04:12.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1678999999999999e-05 2023-09-30T17:04:12.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.280 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.280 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.621600+0000", 2023-09-30T17:04:12.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4870000000000002e-06 2023-09-30T17:04:12.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.280 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:12.280 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.791207+0000", 2023-09-30T17:04:12.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.16960736900000001 2023-09-30T17:04:12.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:12.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.791288+0000", 2023-09-30T17:04:12.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0931000000000002e-05 2023-09-30T17:04:12.281 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.281 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.281 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.282 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113712 4.36 e52/17)", 2023-09-30T17:04:12.282 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.696733+0000", 2023-09-30T17:04:12.282 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.096507387, 2023-09-30T17:04:12.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.102025794, 2023-09-30T17:04:12.282 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.282 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.282 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.283 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.696733+0000", 2023-09-30T17:04:12.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.283 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.283 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.696733+0000", 2023-09-30T17:04:12.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.284 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.284 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.696733+0000", 2023-09-30T17:04:12.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3900000000000005e-07 2023-09-30T17:04:12.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.284 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.284 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.696750+0000", 2023-09-30T17:04:12.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6511000000000002e-05 2023-09-30T17:04:12.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.696764+0000", 2023-09-30T17:04:12.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3603e-05 2023-09-30T17:04:12.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.696770+0000", 2023-09-30T17:04:12.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9569999999999999e-06 2023-09-30T17:04:12.286 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.286 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.286 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.286 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116217 4.1b 4:dbd503eb:::100000001f8.0000002e:head [write 376832~4096 in=4096b,write 503808~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.286 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.793031+0000", 2023-09-30T17:04:12.286 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.00020911599999999999, 2023-09-30T17:04:12.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005786724, 2023-09-30T17:04:12.287 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.287 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:12.287 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.287 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.287 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.287 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116217 2023-09-30T17:04:12.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.288 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.793031+0000", 2023-09-30T17:04:12.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.793031+0000", 2023-09-30T17:04:12.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.289 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.289 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.289 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.793032+0000", 2023-09-30T17:04:12.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8699999999999995e-07 2023-09-30T17:04:12.289 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.289 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.289 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.793047+0000", 2023-09-30T17:04:12.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4894e-05 2023-09-30T17:04:12.290 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.290 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.793053+0000", 2023-09-30T17:04:12.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8109999999999997e-06 2023-09-30T17:04:12.290 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.793059+0000", 2023-09-30T17:04:12.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1290000000000004e-06 2023-09-30T17:04:12.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:12.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.797549+0000", 2023-09-30T17:04:12.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0044901630000000001 2023-09-30T17:04:12.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:12.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.797636+0000", 2023-09-30T17:04:12.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7089999999999995e-05 2023-09-30T17:04:12.292 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.292 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.292 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.293 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.293 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:114587 4.37 4:eff9002a:::100000001f8.00000003:head [write 1175552~4096 in=4096b,write 1232896~4096 in=4096b,write 1249280~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.293 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.214571+0000", 2023-09-30T17:04:12.293 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.57866976000000003, 2023-09-30T17:04:12.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.58432265000000005, 2023-09-30T17:04:12.329 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.329 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:12.329 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.330 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.330 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.330 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 114587 2023-09-30T17:04:12.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.330 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.330 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.331 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.214571+0000", 2023-09-30T17:04:12.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.331 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.331 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.331 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.331 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.214571+0000", 2023-09-30T17:04:12.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.214571+0000", 2023-09-30T17:04:12.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3300000000000002e-07 2023-09-30T17:04:12.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.214584+0000", 2023-09-30T17:04:12.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3183999999999999e-05 2023-09-30T17:04:12.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.214594+0000", 2023-09-30T17:04:12.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0059e-05 2023-09-30T17:04:12.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.214602+0000", 2023-09-30T17:04:12.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.537e-06 2023-09-30T17:04:12.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:12.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.773558+0000", 2023-09-30T17:04:12.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.55895605000000004 2023-09-30T17:04:12.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:12.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.773620+0000", 2023-09-30T17:04:12.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1778000000000004e-05 2023-09-30T17:04:12.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:12.335 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.773729+0000", 2023-09-30T17:04:12.335 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010943200000000001 2023-09-30T17:04:12.335 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.335 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.335 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:12.335 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.797126+0000", 2023-09-30T17:04:12.335 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.023397250000000001 2023-09-30T17:04:12.335 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.335 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.335 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.335 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.336 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.336 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:114678 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.336 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.237673+0000", 2023-09-30T17:04:12.336 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.55556736799999995, 2023-09-30T17:04:12.336 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.56130186100000001, 2023-09-30T17:04:12.336 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.336 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.336 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.336 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.336 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.336 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 114678 2023-09-30T17:04:12.337 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.337 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.337 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.337 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.337 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.237673+0000", 2023-09-30T17:04:12.337 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.337 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.337 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.337 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.337 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.237673+0000", 2023-09-30T17:04:12.337 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.337 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.338 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.338 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.338 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.237673+0000", 2023-09-30T17:04:12.338 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7100000000000002e-07 2023-09-30T17:04:12.338 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.338 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.338 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.338 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.237692+0000", 2023-09-30T17:04:12.338 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8283000000000001e-05 2023-09-30T17:04:12.338 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.338 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.339 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.339 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.237699+0000", 2023-09-30T17:04:12.339 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7989999999999994e-06 2023-09-30T17:04:12.339 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.339 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.339 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.360 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.237705+0000", 2023-09-30T17:04:12.361 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3489999999999999e-06 2023-09-30T17:04:12.361 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.361 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.361 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.361 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.362 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.362 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:114792 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.362 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.273755+0000", 2023-09-30T17:04:12.362 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.51948536099999998, 2023-09-30T17:04:12.363 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.52527712100000001, 2023-09-30T17:04:12.363 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.363 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.363 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.363 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.363 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.364 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 114792 2023-09-30T17:04:12.364 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.364 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.364 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.364 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.364 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.273755+0000", 2023-09-30T17:04:12.364 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.364 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.364 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.365 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.365 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.273755+0000", 2023-09-30T17:04:12.365 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.365 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.365 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.365 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.365 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.278093+0000", 2023-09-30T17:04:12.365 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0043378330000000001 2023-09-30T17:04:12.365 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.365 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.365 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.366 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.278109+0000", 2023-09-30T17:04:12.366 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6353000000000001e-05 2023-09-30T17:04:12.366 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.366 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.366 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.366 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.278516+0000", 2023-09-30T17:04:12.366 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00040669300000000002 2023-09-30T17:04:12.366 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.366 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.366 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.366 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.278523+0000", 2023-09-30T17:04:12.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9600000000000003e-06 2023-09-30T17:04:12.367 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.367 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.367 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.367 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.367 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115065 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.367 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.358027+0000", 2023-09-30T17:04:12.367 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.43521334099999998, 2023-09-30T17:04:12.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.44105655399999999, 2023-09-30T17:04:12.367 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.368 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.368 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.368 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.368 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.368 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115065 2023-09-30T17:04:12.368 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.368 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.358027+0000", 2023-09-30T17:04:12.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.368 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.369 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.369 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.369 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.358027+0000", 2023-09-30T17:04:12.369 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.369 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.369 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.369 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.369 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.358027+0000", 2023-09-30T17:04:12.369 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6800000000000001e-07 2023-09-30T17:04:12.369 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.369 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.370 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.370 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.358044+0000", 2023-09-30T17:04:12.370 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6509999999999999e-05 2023-09-30T17:04:12.370 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.370 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.370 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.370 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.358055+0000", 2023-09-30T17:04:12.381 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1097999999999999e-05 2023-09-30T17:04:12.381 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.381 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.381 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.382 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.358060+0000", 2023-09-30T17:04:12.382 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8770000000000001e-06 2023-09-30T17:04:12.382 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.382 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.382 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.382 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.382 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.382 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115358 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.382 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.464560+0000", 2023-09-30T17:04:12.382 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.32868046000000001, 2023-09-30T17:04:12.382 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.33457748799999998, 2023-09-30T17:04:12.383 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.383 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.383 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.383 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.383 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.383 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115358 2023-09-30T17:04:12.383 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.383 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.383 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.383 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.383 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.464560+0000", 2023-09-30T17:04:12.384 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.384 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.384 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.384 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.384 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.464560+0000", 2023-09-30T17:04:12.384 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.384 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.384 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.384 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.385 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.464560+0000", 2023-09-30T17:04:12.385 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7800000000000002e-07 2023-09-30T17:04:12.385 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.385 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.385 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.385 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.464570+0000", 2023-09-30T17:04:12.385 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5009999999999993e-06 2023-09-30T17:04:12.386 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.386 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.386 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.386 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.464577+0000", 2023-09-30T17:04:12.386 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7859999999999999e-06 2023-09-30T17:04:12.386 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.386 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.386 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.386 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.464581+0000", 2023-09-30T17:04:12.386 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1649999999999999e-06 2023-09-30T17:04:12.386 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.387 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.387 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.387 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.387 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.387 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115392 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.387 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.475601+0000", 2023-09-30T17:04:12.388 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.31763942299999998, 2023-09-30T17:04:12.388 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.32359199300000002, 2023-09-30T17:04:12.388 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.388 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.388 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.388 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.388 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.388 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115392 2023-09-30T17:04:12.388 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.388 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.388 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.389 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.389 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.475601+0000", 2023-09-30T17:04:12.389 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.389 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.389 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.389 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.389 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.475601+0000", 2023-09-30T17:04:12.390 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.390 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.390 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.390 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.390 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.475601+0000", 2023-09-30T17:04:12.390 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3499999999999996e-07 2023-09-30T17:04:12.390 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.390 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.391 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.391 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.475614+0000", 2023-09-30T17:04:12.391 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2449000000000001e-05 2023-09-30T17:04:12.391 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.393 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.393 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.393 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.475623+0000", 2023-09-30T17:04:12.393 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2350000000000005e-06 2023-09-30T17:04:12.393 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.394 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.394 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.394 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.475629+0000", 2023-09-30T17:04:12.394 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2840000000000003e-06 2023-09-30T17:04:12.394 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.394 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.394 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.394 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.394 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.394 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115582 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.394 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.557594+0000", 2023-09-30T17:04:12.395 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.235646732, 2023-09-30T17:04:12.395 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.24165262000000001, 2023-09-30T17:04:12.395 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.395 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.395 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.395 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.395 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.395 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115582 2023-09-30T17:04:12.395 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.395 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.395 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.396 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.396 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.557594+0000", 2023-09-30T17:04:12.396 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.396 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.396 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.396 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.396 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.557594+0000", 2023-09-30T17:04:12.396 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.396 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.397 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.397 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.397 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.557594+0000", 2023-09-30T17:04:12.397 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4799999999999999e-07 2023-09-30T17:04:12.397 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.397 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.397 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.397 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.557607+0000", 2023-09-30T17:04:12.398 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2999999999999999e-05 2023-09-30T17:04:12.398 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.398 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.398 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.398 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.557613+0000", 2023-09-30T17:04:12.398 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3369999999999996e-06 2023-09-30T17:04:12.398 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.398 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.398 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.399 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.557617+0000", 2023-09-30T17:04:12.399 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5319999999999998e-06 2023-09-30T17:04:12.399 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.399 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.399 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.399 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.399 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.399 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113545 4.6 e52/17 4:62d56fc8:::100000001f8.0000001c:head v 52'6967, mlcod=52'6943)", 2023-09-30T17:04:12.399 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.658710+0000", 2023-09-30T17:04:12.399 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.13453024899999999, 2023-09-30T17:04:12.399 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.14059408400000001, 2023-09-30T17:04:12.399 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.400 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:12.400 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.400 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.400 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.400 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.658710+0000", 2023-09-30T17:04:12.400 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.400 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.400 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.400 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.400 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.658710+0000", 2023-09-30T17:04:12.400 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.401 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.401 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.401 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.401 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.658710+0000", 2023-09-30T17:04:12.401 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.39e-07 2023-09-30T17:04:12.401 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.401 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.401 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.401 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.658726+0000", 2023-09-30T17:04:12.401 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5085999999999999e-05 2023-09-30T17:04:12.401 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.402 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.402 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.402 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.658732+0000", 2023-09-30T17:04:12.402 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7499999999999997e-06 2023-09-30T17:04:12.402 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.402 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.402 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.402 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.658738+0000", 2023-09-30T17:04:12.402 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3730000000000001e-06 2023-09-30T17:04:12.402 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.402 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.403 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:12.403 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.789934+0000", 2023-09-30T17:04:12.403 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.13119603099999999 2023-09-30T17:04:12.403 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.403 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.403 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:12.403 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.789950+0000", 2023-09-30T17:04:12.403 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6039999999999999e-05 2023-09-30T17:04:12.403 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.403 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.403 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.403 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.404 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.404 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113678 4.36 e52/17)", 2023-09-30T17:04:12.404 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.685284+0000", 2023-09-30T17:04:12.435 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.10795658800000001, 2023-09-30T17:04:12.435 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.11407766499999999, 2023-09-30T17:04:12.435 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.435 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.435 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.435 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.435 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.436 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.685284+0000", 2023-09-30T17:04:12.436 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.436 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.436 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.436 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.436 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.685284+0000", 2023-09-30T17:04:12.436 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.436 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.436 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.436 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.436 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.685284+0000", 2023-09-30T17:04:12.437 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9900000000000002e-07 2023-09-30T17:04:12.437 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.437 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.437 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.437 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.685299+0000", 2023-09-30T17:04:12.437 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4752e-05 2023-09-30T17:04:12.437 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.437 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.437 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.437 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.685305+0000", 2023-09-30T17:04:12.437 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1120000000000001e-06 2023-09-30T17:04:12.437 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.438 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.438 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.438 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.685310+0000", 2023-09-30T17:04:12.438 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0130000000000001e-06 2023-09-30T17:04:12.438 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.438 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.438 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.438 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.438 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.438 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115959 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.438 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.708583+0000", 2023-09-30T17:04:12.439 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.084657741999999994, 2023-09-30T17:04:12.439 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.090827682000000007, 2023-09-30T17:04:12.439 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.439 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.439 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.439 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.439 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.439 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115959 2023-09-30T17:04:12.439 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.439 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.439 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.439 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.440 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.708583+0000", 2023-09-30T17:04:12.440 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.440 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.440 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.440 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.440 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.708583+0000", 2023-09-30T17:04:12.440 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.440 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.440 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.440 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.440 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.708583+0000", 2023-09-30T17:04:12.440 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8899999999999999e-07 2023-09-30T17:04:12.441 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.441 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.441 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.441 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.708596+0000", 2023-09-30T17:04:12.441 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2670999999999999e-05 2023-09-30T17:04:12.441 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.441 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.441 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.441 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.708604+0000", 2023-09-30T17:04:12.441 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1629999999999996e-06 2023-09-30T17:04:12.441 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.442 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.442 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.442 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.708610+0000", 2023-09-30T17:04:12.442 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1179999999999997e-06 2023-09-30T17:04:12.442 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.442 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.442 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.442 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.442 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.442 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:115105 4.28 e52/17 4:153ae410:::100000001f8.0000003b:head v 52'3536, mlcod=52'3531)", 2023-09-30T17:04:12.442 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.779554+0000", 2023-09-30T17:04:12.443 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.013686524, 2023-09-30T17:04:12.443 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019909896999999999, 2023-09-30T17:04:12.443 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.443 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:12.443 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.443 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.443 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.779554+0000", 2023-09-30T17:04:12.443 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.443 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.443 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.444 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.779554+0000", 2023-09-30T17:04:12.444 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.444 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.444 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.444 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.444 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.779555+0000", 2023-09-30T17:04:12.444 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9599999999999998e-07 2023-09-30T17:04:12.444 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.444 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.444 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.444 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.779569+0000", 2023-09-30T17:04:12.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.438e-05 2023-09-30T17:04:12.445 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.445 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.445 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.445 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.779579+0000", 2023-09-30T17:04:12.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4949999999999997e-06 2023-09-30T17:04:12.445 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.445 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.445 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.445 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.779586+0000", 2023-09-30T17:04:12.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3390000000000004e-06 2023-09-30T17:04:12.446 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.446 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.446 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:12.446 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.781898+0000", 2023-09-30T17:04:12.446 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0023116970000000001 2023-09-30T17:04:12.446 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.446 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.446 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:12.446 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.781917+0000", 2023-09-30T17:04:12.446 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9507000000000001e-05 2023-09-30T17:04:12.446 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.447 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.447 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.447 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.447 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(client.4547.0:114577 4.37 e52/17)", 2023-09-30T17:04:12.447 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.793110+0000", 2023-09-30T17:04:12.447 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.000130154, 2023-09-30T17:04:12.447 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006414225, 2023-09-30T17:04:12.447 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.447 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.448 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.448 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.448 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.793110+0000", 2023-09-30T17:04:12.448 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.448 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.448 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.448 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.793110+0000", 2023-09-30T17:04:12.448 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.448 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.449 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.449 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.793111+0000", 2023-09-30T17:04:12.449 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.44e-07 2023-09-30T17:04:12.449 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.449 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.449 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.449 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.793114+0000", 2023-09-30T17:04:12.449 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3900000000000002e-06 2023-09-30T17:04:12.449 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.449 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.449 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.450 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.793122+0000", 2023-09-30T17:04:12.450 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5989999999999996e-06 2023-09-30T17:04:12.450 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.450 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.450 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.450 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.793128+0000", 2023-09-30T17:04:12.450 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.896e-06 2023-09-30T17:04:12.450 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.450 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.450 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.450 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.451 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.451 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:114635 4.f 4:f2a80dfe:::100000001f8.00000019:head [write 864256~4096 in=4096b,write 946176~4096 in=4096b,write 1118208~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.451 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.228575+0000", 2023-09-30T17:04:12.451 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.56466548000000005, 2023-09-30T17:04:12.451 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.57100121000000004, 2023-09-30T17:04:12.451 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.451 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:12.451 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.451 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.451 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.451 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 114635 2023-09-30T17:04:12.451 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.452 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.452 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.452 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.452 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.228575+0000", 2023-09-30T17:04:12.452 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.452 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.452 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.452 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.452 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.228575+0000", 2023-09-30T17:04:12.452 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.452 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.452 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.453 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.453 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.228575+0000", 2023-09-30T17:04:12.453 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.63e-07 2023-09-30T17:04:12.453 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.453 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.483 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.483 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.228588+0000", 2023-09-30T17:04:12.483 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3023000000000001e-05 2023-09-30T17:04:12.483 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.483 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.484 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.484 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.228595+0000", 2023-09-30T17:04:12.484 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9800000000000001e-06 2023-09-30T17:04:12.484 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.484 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.484 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.484 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.228601+0000", 2023-09-30T17:04:12.484 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9789999999999998e-06 2023-09-30T17:04:12.484 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.484 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.484 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:12.485 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.781845+0000", 2023-09-30T17:04:12.485 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.55324394799999999 2023-09-30T17:04:12.485 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.485 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.485 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:12.485 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.781919+0000", 2023-09-30T17:04:12.485 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3478000000000004e-05 2023-09-30T17:04:12.485 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.485 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.485 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:12.485 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.782072+0000", 2023-09-30T17:04:12.486 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000153265 2023-09-30T17:04:12.486 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.486 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.486 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.486 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.486 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.486 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:114979 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.486 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.337747+0000", 2023-09-30T17:04:12.486 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.45549282299999999, 2023-09-30T17:04:12.486 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.46189998700000001, 2023-09-30T17:04:12.486 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.487 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.487 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.487 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.487 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.487 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 114979 2023-09-30T17:04:12.487 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.487 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.487 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.487 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.487 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.337747+0000", 2023-09-30T17:04:12.487 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.488 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.488 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.488 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.488 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.337747+0000", 2023-09-30T17:04:12.488 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.488 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.488 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.488 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.488 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.337748+0000", 2023-09-30T17:04:12.488 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1800000000000001e-07 2023-09-30T17:04:12.488 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.488 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.489 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.489 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.337761+0000", 2023-09-30T17:04:12.489 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3101999999999999e-05 2023-09-30T17:04:12.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.489 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.489 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.337768+0000", 2023-09-30T17:04:12.489 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3769999999999998e-06 2023-09-30T17:04:12.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.489 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.490 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.337774+0000", 2023-09-30T17:04:12.490 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3349999999999997e-06 2023-09-30T17:04:12.490 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.490 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.490 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.490 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.490 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.490 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115066 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.490 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.358067+0000", 2023-09-30T17:04:12.490 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.43517340199999999, 2023-09-30T17:04:12.490 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.44163218599999998, 2023-09-30T17:04:12.491 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.491 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.491 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.511 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.511 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.511 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115066 2023-09-30T17:04:12.511 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.511 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.511 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.511 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.511 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.358067+0000", 2023-09-30T17:04:12.511 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.511 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.512 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.512 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.512 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.358067+0000", 2023-09-30T17:04:12.512 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.512 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.512 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.512 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.512 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.358067+0000", 2023-09-30T17:04:12.512 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3099999999999998e-07 2023-09-30T17:04:12.512 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.512 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.512 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.513 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.358078+0000", 2023-09-30T17:04:12.513 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.098e-05 2023-09-30T17:04:12.513 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.513 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.513 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.513 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.358085+0000", 2023-09-30T17:04:12.513 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.251e-06 2023-09-30T17:04:12.513 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.513 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.513 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.513 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.358103+0000", 2023-09-30T17:04:12.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8046999999999998e-05 2023-09-30T17:04:12.514 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.514 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.514 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.514 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.514 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.514 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115091 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.514 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.367567+0000", 2023-09-30T17:04:12.514 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.42567369199999999, 2023-09-30T17:04:12.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.43218694800000002, 2023-09-30T17:04:12.514 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.515 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.515 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.515 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.515 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.515 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115091 2023-09-30T17:04:12.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.515 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.515 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.515 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.367567+0000", 2023-09-30T17:04:12.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.516 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.516 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.367567+0000", 2023-09-30T17:04:12.516 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.516 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.516 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.371213+0000", 2023-09-30T17:04:12.516 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036465080000000001 2023-09-30T17:04:12.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.517 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.517 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.371236+0000", 2023-09-30T17:04:12.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3178000000000001e-05 2023-09-30T17:04:12.517 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.517 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.517 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.371243+0000", 2023-09-30T17:04:12.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1919999999999999e-06 2023-09-30T17:04:12.517 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.517 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.518 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.371248+0000", 2023-09-30T17:04:12.534 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6090000000000003e-06 2023-09-30T17:04:12.534 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.534 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.534 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.534 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.535 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.535 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115146 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.535 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.379567+0000", 2023-09-30T17:04:12.535 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.41367290099999998, 2023-09-30T17:04:12.535 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.42024502000000002, 2023-09-30T17:04:12.535 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.535 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.535 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.536 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.536 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.536 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115146 2023-09-30T17:04:12.536 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.536 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.536 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.536 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.536 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.379567+0000", 2023-09-30T17:04:12.536 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.536 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.536 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.537 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.537 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.379567+0000", 2023-09-30T17:04:12.537 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.537 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.537 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.537 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.537 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.379568+0000", 2023-09-30T17:04:12.537 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0100000000000005e-07 2023-09-30T17:04:12.537 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.537 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.538 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.538 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.379579+0000", 2023-09-30T17:04:12.538 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1032e-05 2023-09-30T17:04:12.538 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.538 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.538 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.538 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.379586+0000", 2023-09-30T17:04:12.538 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6259999999999997e-06 2023-09-30T17:04:12.538 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.538 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.538 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.539 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.379591+0000", 2023-09-30T17:04:12.539 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3990000000000003e-06 2023-09-30T17:04:12.539 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.539 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.539 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.539 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.539 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.539 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115184 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.539 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.396445+0000", 2023-09-30T17:04:12.539 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.39679568500000001, 2023-09-30T17:04:12.539 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.40343062899999999, 2023-09-30T17:04:12.539 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.540 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.540 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.540 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.540 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.540 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115184 2023-09-30T17:04:12.540 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.540 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.540 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.540 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.540 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.396445+0000", 2023-09-30T17:04:12.540 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.541 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.541 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.541 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.541 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.396445+0000", 2023-09-30T17:04:12.541 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.541 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.541 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.541 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.541 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.396445+0000", 2023-09-30T17:04:12.541 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8299999999999996e-07 2023-09-30T17:04:12.541 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.541 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.542 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.542 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.396459+0000", 2023-09-30T17:04:12.542 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.419e-05 2023-09-30T17:04:12.542 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.542 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.542 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.542 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.396470+0000", 2023-09-30T17:04:12.542 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0368e-05 2023-09-30T17:04:12.542 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.542 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.542 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.543 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.396477+0000", 2023-09-30T17:04:12.543 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6240000000000002e-06 2023-09-30T17:04:12.543 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.543 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.543 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.543 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.543 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.543 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115289 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.543 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.437237+0000", 2023-09-30T17:04:12.543 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.356003283, 2023-09-30T17:04:12.543 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.36269853000000002, 2023-09-30T17:04:12.544 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.544 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.544 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.544 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.544 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.544 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115289 2023-09-30T17:04:12.544 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.544 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.544 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.544 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.544 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.437237+0000", 2023-09-30T17:04:12.545 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.545 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.545 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.545 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.545 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.437237+0000", 2023-09-30T17:04:12.545 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.545 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.545 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.545 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.545 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.437238+0000", 2023-09-30T17:04:12.545 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2200000000000003e-07 2023-09-30T17:04:12.545 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.546 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.546 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.546 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.437249+0000", 2023-09-30T17:04:12.546 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1097000000000001e-05 2023-09-30T17:04:12.546 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.546 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.546 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.546 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.437257+0000", 2023-09-30T17:04:12.546 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9019999999999999e-06 2023-09-30T17:04:12.546 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.547 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.547 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.547 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.437263+0000", 2023-09-30T17:04:12.547 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5509999999999996e-06 2023-09-30T17:04:12.547 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.589 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.590 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.590 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.590 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.590 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115583 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.590 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.557621+0000", 2023-09-30T17:04:12.590 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.23561881800000001, 2023-09-30T17:04:12.590 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.242379076, 2023-09-30T17:04:12.590 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.590 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.591 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.591 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.591 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.591 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115583 2023-09-30T17:04:12.591 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.591 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.591 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.591 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.591 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.557621+0000", 2023-09-30T17:04:12.591 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.591 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.592 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.592 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.592 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.557621+0000", 2023-09-30T17:04:12.592 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.592 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.592 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.592 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.592 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.557622+0000", 2023-09-30T17:04:12.592 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5400000000000002e-07 2023-09-30T17:04:12.592 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.592 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.592 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.593 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.557634+0000", 2023-09-30T17:04:12.593 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.255e-05 2023-09-30T17:04:12.593 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.593 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.593 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.593 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.557638+0000", 2023-09-30T17:04:12.593 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9600000000000002e-06 2023-09-30T17:04:12.593 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.593 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.593 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.593 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.557641+0000", 2023-09-30T17:04:12.594 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0410000000000002e-06 2023-09-30T17:04:12.594 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.594 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.594 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.594 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.594 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.594 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113541 4.2e e52/17 4:75be0f36:::100000001f8.0000003d:head v 52'1752, mlcod=52'1743)", 2023-09-30T17:04:12.594 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.658748+0000", 2023-09-30T17:04:12.594 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.13449259599999999, 2023-09-30T17:04:12.594 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.141315421, 2023-09-30T17:04:12.594 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.594 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:12.595 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.595 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.595 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.595 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.658748+0000", 2023-09-30T17:04:12.595 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.595 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.595 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.595 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.595 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.658748+0000", 2023-09-30T17:04:12.595 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.595 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.595 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.597 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.597 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.658748+0000", 2023-09-30T17:04:12.597 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3500000000000002e-07 2023-09-30T17:04:12.597 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.597 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.597 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.597 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.658759+0000", 2023-09-30T17:04:12.597 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0808000000000001e-05 2023-09-30T17:04:12.598 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.598 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.598 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.598 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.658765+0000", 2023-09-30T17:04:12.598 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1009999999999997e-06 2023-09-30T17:04:12.598 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.598 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.598 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.599 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.658770+0000", 2023-09-30T17:04:12.599 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.826e-06 2023-09-30T17:04:12.599 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.599 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.599 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:12.599 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.794573+0000", 2023-09-30T17:04:12.599 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.13580273500000001 2023-09-30T17:04:12.599 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.599 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.599 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:12.599 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.794592+0000", 2023-09-30T17:04:12.600 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9981000000000001e-05 2023-09-30T17:04:12.600 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.600 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.600 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.600 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.600 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.600 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113661 4.6 e52/17)", 2023-09-30T17:04:12.600 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.685317+0000", 2023-09-30T17:04:12.600 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.107922951, 2023-09-30T17:04:12.600 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.114811767, 2023-09-30T17:04:12.600 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.601 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.601 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.601 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.601 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.601 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.685317+0000", 2023-09-30T17:04:12.601 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.601 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.601 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.601 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.601 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.685317+0000", 2023-09-30T17:04:12.601 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.601 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.602 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.602 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.602 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.685318+0000", 2023-09-30T17:04:12.602 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4499999999999998e-07 2023-09-30T17:04:12.602 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.638 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.638 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.685328+0000", 2023-09-30T17:04:12.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0716e-05 2023-09-30T17:04:12.638 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.638 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.638 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.685335+0000", 2023-09-30T17:04:12.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2489999999999998e-06 2023-09-30T17:04:12.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.685339+0000", 2023-09-30T17:04:12.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6349999999999997e-06 2023-09-30T17:04:12.639 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.639 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.640 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.640 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113719 4.6 e52/17)", 2023-09-30T17:04:12.640 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.696814+0000", 2023-09-30T17:04:12.640 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.096426469000000001, 2023-09-30T17:04:12.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.10336703699999999, 2023-09-30T17:04:12.640 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.641 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.641 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.641 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.696814+0000", 2023-09-30T17:04:12.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.642 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.696814+0000", 2023-09-30T17:04:12.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.642 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.642 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.642 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.642 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.696814+0000", 2023-09-30T17:04:12.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6199999999999999e-07 2023-09-30T17:04:12.642 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.643 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.643 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.696826+0000", 2023-09-30T17:04:12.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1997999999999999e-05 2023-09-30T17:04:12.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.643 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.643 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.696833+0000", 2023-09-30T17:04:12.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0940000000000002e-06 2023-09-30T17:04:12.644 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.644 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.696839+0000", 2023-09-30T17:04:12.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3000000000000001e-06 2023-09-30T17:04:12.644 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.644 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.644 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.645 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.645 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.645 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116104 4.38 4.318ef3b8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.645 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.742876+0000", 2023-09-30T17:04:12.645 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.050363916000000002, 2023-09-30T17:04:12.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.057360993999999998, 2023-09-30T17:04:12.645 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.645 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.646 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.646 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.646 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.646 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116104 2023-09-30T17:04:12.646 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.646 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.646 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.646 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.647 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.742876+0000", 2023-09-30T17:04:12.647 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.647 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.647 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.742876+0000", 2023-09-30T17:04:12.647 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.648 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.742877+0000", 2023-09-30T17:04:12.648 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8100000000000003e-07 2023-09-30T17:04:12.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.648 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.742893+0000", 2023-09-30T17:04:12.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6291e-05 2023-09-30T17:04:12.649 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.649 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.742900+0000", 2023-09-30T17:04:12.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.131e-06 2023-09-30T17:04:12.649 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.650 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.650 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.742906+0000", 2023-09-30T17:04:12.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3739999999999997e-06 2023-09-30T17:04:12.650 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.650 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.650 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.650 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.650 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.651 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113997 4.6 e52/17)", 2023-09-30T17:04:12.651 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.793145+0000", 2023-09-30T17:04:12.651 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.5513000000000005e-05, 2023-09-30T17:04:12.651 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071561589999999996, 2023-09-30T17:04:12.651 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.651 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.651 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.651 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.652 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.793145+0000", 2023-09-30T17:04:12.652 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.652 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.652 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.652 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.652 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.793145+0000", 2023-09-30T17:04:12.652 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.652 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.653 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.653 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.793145+0000", 2023-09-30T17:04:12.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1e-07 2023-09-30T17:04:12.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.653 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.653 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.793159+0000", 2023-09-30T17:04:12.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3976e-05 2023-09-30T17:04:12.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.654 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.793166+0000", 2023-09-30T17:04:12.654 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5209999999999999e-06 2023-09-30T17:04:12.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.655 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.655 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.793171+0000", 2023-09-30T17:04:12.655 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.028e-06 2023-09-30T17:04:12.655 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.655 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.655 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.655 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.655 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.656 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:114767 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.656 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.265585+0000", 2023-09-30T17:04:12.656 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.52765525199999996, 2023-09-30T17:04:12.656 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.53476598900000005, 2023-09-30T17:04:12.656 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.656 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.656 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.656 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.657 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.657 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 114767 2023-09-30T17:04:12.657 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.657 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.657 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.671 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.265585+0000", 2023-09-30T17:04:12.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.672 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.672 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.265585+0000", 2023-09-30T17:04:12.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.672 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.672 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.265585+0000", 2023-09-30T17:04:12.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4499999999999998e-07 2023-09-30T17:04:12.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.673 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.673 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.265602+0000", 2023-09-30T17:04:12.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6670000000000001e-05 2023-09-30T17:04:12.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.673 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.673 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.265613+0000", 2023-09-30T17:04:12.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0927000000000001e-05 2023-09-30T17:04:12.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.674 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.674 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.265618+0000", 2023-09-30T17:04:12.674 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0309999999999998e-06 2023-09-30T17:04:12.674 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.674 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.674 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.674 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115186 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.674 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.396490+0000", 2023-09-30T17:04:12.674 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.39675004600000002, 2023-09-30T17:04:12.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.40390099000000002, 2023-09-30T17:04:12.675 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.675 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.675 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.675 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.675 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.675 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115186 2023-09-30T17:04:12.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.675 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.675 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.675 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.396490+0000", 2023-09-30T17:04:12.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.396490+0000", 2023-09-30T17:04:12.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.396491+0000", 2023-09-30T17:04:12.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9399999999999995e-07 2023-09-30T17:04:12.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.677 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.677 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.396508+0000", 2023-09-30T17:04:12.677 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7319000000000001e-05 2023-09-30T17:04:12.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.677 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.677 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.396521+0000", 2023-09-30T17:04:12.677 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2859e-05 2023-09-30T17:04:12.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.677 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.678 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.396527+0000", 2023-09-30T17:04:12.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9730000000000002e-06 2023-09-30T17:04:12.678 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.678 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.678 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.678 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.678 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115422 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.678 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.489430+0000", 2023-09-30T17:04:12.678 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.30380985399999999, 2023-09-30T17:04:12.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.31099412300000001, 2023-09-30T17:04:12.679 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.679 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.679 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.679 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.679 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.679 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115422 2023-09-30T17:04:12.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.679 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.679 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.679 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.489430+0000", 2023-09-30T17:04:12.679 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.680 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.680 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.680 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.489430+0000", 2023-09-30T17:04:12.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.680 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.680 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.680 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.489431+0000", 2023-09-30T17:04:12.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7e-07 2023-09-30T17:04:12.680 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.681 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.681 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.489443+0000", 2023-09-30T17:04:12.681 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2038999999999999e-05 2023-09-30T17:04:12.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.681 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.681 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.489450+0000", 2023-09-30T17:04:12.681 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2010000000000002e-06 2023-09-30T17:04:12.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.681 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.682 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.489456+0000", 2023-09-30T17:04:12.682 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6219999999999997e-06 2023-09-30T17:04:12.682 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.682 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.682 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.682 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.682 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.682 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115621 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.682 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.566808+0000", 2023-09-30T17:04:12.682 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.226432087, 2023-09-30T17:04:12.682 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.23365540600000001, 2023-09-30T17:04:12.683 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.683 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.683 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.683 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.683 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.683 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115621 2023-09-30T17:04:12.683 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.683 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.683 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.683 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.566808+0000", 2023-09-30T17:04:12.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.684 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.684 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.684 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.566808+0000", 2023-09-30T17:04:12.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.684 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.684 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.684 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.568515+0000", 2023-09-30T17:04:12.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0017072750000000001 2023-09-30T17:04:12.685 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.685 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.685 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.568533+0000", 2023-09-30T17:04:12.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.774e-05 2023-09-30T17:04:12.685 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.685 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.685 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.568543+0000", 2023-09-30T17:04:12.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5210000000000008e-06 2023-09-30T17:04:12.685 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.686 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.686 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.686 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.568550+0000", 2023-09-30T17:04:12.686 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6380000000000004e-06 2023-09-30T17:04:12.689 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.689 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.690 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.690 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.690 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113628 4.36 e52/17)", 2023-09-30T17:04:12.690 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.676242+0000", 2023-09-30T17:04:12.690 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.116998586, 2023-09-30T17:04:12.690 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.124265349, 2023-09-30T17:04:12.690 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.690 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.690 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.691 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.691 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.676242+0000", 2023-09-30T17:04:12.691 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.691 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.691 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.691 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.691 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.676242+0000", 2023-09-30T17:04:12.691 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.691 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.691 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.691 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.691 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.676243+0000", 2023-09-30T17:04:12.692 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1179999999999999e-06 2023-09-30T17:04:12.692 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.692 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.692 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.692 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.676259+0000", 2023-09-30T17:04:12.692 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6402e-05 2023-09-30T17:04:12.692 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.692 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.692 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.692 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.676270+0000", 2023-09-30T17:04:12.692 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0489000000000001e-05 2023-09-30T17:04:12.692 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.693 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.693 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.693 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.676279+0000", 2023-09-30T17:04:12.693 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8939999999999999e-06 2023-09-30T17:04:12.693 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.693 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.693 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.693 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.693 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.693 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115973 4.38 4.9b7e3478 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.693 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.708653+0000", 2023-09-30T17:04:12.694 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.084587060000000006, 2023-09-30T17:04:12.694 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.091891902999999997, 2023-09-30T17:04:12.694 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.694 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.694 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.694 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.694 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.694 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115973 2023-09-30T17:04:12.694 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.694 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.694 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.695 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.695 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.708653+0000", 2023-09-30T17:04:12.695 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.695 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.695 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.695 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.695 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.708653+0000", 2023-09-30T17:04:12.695 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.695 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.695 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.695 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.695 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.708654+0000", 2023-09-30T17:04:12.696 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5699999999999998e-07 2023-09-30T17:04:12.696 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.696 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.696 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.696 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.708665+0000", 2023-09-30T17:04:12.696 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1331e-05 2023-09-30T17:04:12.696 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.696 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.696 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.696 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.708673+0000", 2023-09-30T17:04:12.696 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0209999999999999e-06 2023-09-30T17:04:12.696 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.697 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.697 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.697 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.708678+0000", 2023-09-30T17:04:12.697 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3900000000000001e-06 2023-09-30T17:04:12.697 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.697 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.697 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.697 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.697 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.697 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:114000 4.6 e52/17)", 2023-09-30T17:04:12.697 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.793181+0000", 2023-09-30T17:04:12.698 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 5.9083000000000003e-05, 2023-09-30T17:04:12.698 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0074010389999999999, 2023-09-30T17:04:12.698 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.698 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.698 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.698 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.698 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.698 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.793181+0000", 2023-09-30T17:04:12.698 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.699 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.699 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.793181+0000", 2023-09-30T17:04:12.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.699 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.699 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.793181+0000", 2023-09-30T17:04:12.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.67e-07 2023-09-30T17:04:12.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.700 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.700 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.700 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.793192+0000", 2023-09-30T17:04:12.700 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0307e-05 2023-09-30T17:04:12.700 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.700 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.700 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.700 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.793197+0000", 2023-09-30T17:04:12.700 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.446e-06 2023-09-30T17:04:12.700 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.700 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.700 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.701 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.793202+0000", 2023-09-30T17:04:12.701 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1950000000000002e-06 2023-09-30T17:04:12.701 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.701 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.701 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.701 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.701 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.701 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:114910 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.701 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.315556+0000", 2023-09-30T17:04:12.701 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.47768405899999999, 2023-09-30T17:04:12.701 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.48505530899999999, 2023-09-30T17:04:12.702 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.702 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.702 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.702 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.702 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.702 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 114910 2023-09-30T17:04:12.702 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.702 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.702 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.702 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.702 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.315556+0000", 2023-09-30T17:04:12.703 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.703 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.703 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.703 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.703 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.315556+0000", 2023-09-30T17:04:12.703 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.703 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.703 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.703 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.703 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.315557+0000", 2023-09-30T17:04:12.703 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6899999999999997e-07 2023-09-30T17:04:12.703 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.704 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.704 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.704 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.315572+0000", 2023-09-30T17:04:12.704 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5645e-05 2023-09-30T17:04:12.704 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.704 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.704 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.704 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.315581+0000", 2023-09-30T17:04:12.704 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5140000000000001e-06 2023-09-30T17:04:12.704 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.704 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.705 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.705 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.315588+0000", 2023-09-30T17:04:12.705 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9670000000000004e-06 2023-09-30T17:04:12.705 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.705 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.705 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.705 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.705 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.705 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115036 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.705 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.349628+0000", 2023-09-30T17:04:12.705 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.44361269199999998, 2023-09-30T17:04:12.705 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.45101996700000002, 2023-09-30T17:04:12.706 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.706 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.706 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.706 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.706 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.706 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115036 2023-09-30T17:04:12.706 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.706 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.706 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.706 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.706 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.349628+0000", 2023-09-30T17:04:12.706 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.707 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.707 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.707 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.707 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.349628+0000", 2023-09-30T17:04:12.707 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.707 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.707 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.707 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.707 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.349628+0000", 2023-09-30T17:04:12.707 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0100000000000005e-07 2023-09-30T17:04:12.707 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.708 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.708 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.708 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.349665+0000", 2023-09-30T17:04:12.708 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6986000000000001e-05 2023-09-30T17:04:12.708 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.708 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.708 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.708 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.349688+0000", 2023-09-30T17:04:12.708 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2824e-05 2023-09-30T17:04:12.708 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.708 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.708 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.709 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.349694+0000", 2023-09-30T17:04:12.709 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.46e-06 2023-09-30T17:04:12.709 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.709 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.709 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.709 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.709 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.709 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115758 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 3760128~8192 in=8192b,write 3821568~4096 in=4096b,write 3862528~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.709 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.621718+0000", 2023-09-30T17:04:12.725 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.17152245399999999, 2023-09-30T17:04:12.725 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.17898361800000001, 2023-09-30T17:04:12.725 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.725 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:12.725 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.725 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.725 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.725 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115758 2023-09-30T17:04:12.725 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.726 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.726 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.726 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.726 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.621718+0000", 2023-09-30T17:04:12.726 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.726 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.726 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.726 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.726 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.621718+0000", 2023-09-30T17:04:12.726 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.727 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.727 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.727 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.727 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.621718+0000", 2023-09-30T17:04:12.727 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1800000000000001e-07 2023-09-30T17:04:12.727 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.727 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.727 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.727 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.621731+0000", 2023-09-30T17:04:12.728 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2397e-05 2023-09-30T17:04:12.728 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.728 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.728 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.728 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.621736+0000", 2023-09-30T17:04:12.728 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4940000000000003e-06 2023-09-30T17:04:12.728 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.728 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.728 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.728 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.621741+0000", 2023-09-30T17:04:12.729 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.651e-06 2023-09-30T17:04:12.729 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.729 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.729 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:12.729 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.792866+0000", 2023-09-30T17:04:12.729 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.17112476400000001 2023-09-30T17:04:12.729 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.729 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.729 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:12.729 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.792921+0000", 2023-09-30T17:04:12.729 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5152999999999999e-05 2023-09-30T17:04:12.730 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.730 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.730 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.730 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.730 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.730 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115975 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.730 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.708687+0000", 2023-09-30T17:04:12.730 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.084553455, 2023-09-30T17:04:12.730 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.092065907000000002, 2023-09-30T17:04:12.730 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.730 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.730 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.731 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.731 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.731 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115975 2023-09-30T17:04:12.731 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.731 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.731 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.731 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.731 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.708687+0000", 2023-09-30T17:04:12.731 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.731 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.731 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.731 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.732 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.708687+0000", 2023-09-30T17:04:12.732 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.732 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.732 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.732 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.732 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.708687+0000", 2023-09-30T17:04:12.732 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5400000000000002e-07 2023-09-30T17:04:12.732 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.732 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.732 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.732 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.708700+0000", 2023-09-30T17:04:12.733 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2225000000000001e-05 2023-09-30T17:04:12.733 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.733 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.733 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.733 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.708706+0000", 2023-09-30T17:04:12.733 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5320000000000003e-06 2023-09-30T17:04:12.733 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.733 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.733 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.733 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.708711+0000", 2023-09-30T17:04:12.733 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9010000000000002e-06 2023-09-30T17:04:12.733 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.734 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.734 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.734 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.734 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.734 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116018 4.38 4.5b0ac3f8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.734 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.720776+0000", 2023-09-30T17:04:12.734 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.072464425999999998, 2023-09-30T17:04:12.734 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.080015093999999995, 2023-09-30T17:04:12.734 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.734 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.734 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.734 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.735 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.735 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116018 2023-09-30T17:04:12.735 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.735 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.735 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.735 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.735 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.720776+0000", 2023-09-30T17:04:12.735 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.735 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.735 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.735 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.736 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.720776+0000", 2023-09-30T17:04:12.736 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.736 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.736 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.736 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.736 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.720776+0000", 2023-09-30T17:04:12.736 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6199999999999998e-07 2023-09-30T17:04:12.736 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.736 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.736 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.736 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.720789+0000", 2023-09-30T17:04:12.736 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.275e-05 2023-09-30T17:04:12.737 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.737 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.742 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.742 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.720796+0000", 2023-09-30T17:04:12.742 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8809999999999998e-06 2023-09-30T17:04:12.742 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.742 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.742 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.742 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.720802+0000", 2023-09-30T17:04:12.742 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3539999999999996e-06 2023-09-30T17:04:12.742 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.743 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.743 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.743 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.743 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.743 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113819 4.6 e52/17)", 2023-09-30T17:04:12.743 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.736817+0000", 2023-09-30T17:04:12.743 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.056423541000000001, 2023-09-30T17:04:12.743 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.06413257, 2023-09-30T17:04:12.743 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.743 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.743 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.744 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.744 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.736817+0000", 2023-09-30T17:04:12.744 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.744 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.744 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.744 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.736817+0000", 2023-09-30T17:04:12.744 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.744 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.745 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.745 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.736817+0000", 2023-09-30T17:04:12.745 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5400000000000002e-07 2023-09-30T17:04:12.745 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.745 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.745 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.745 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.736831+0000", 2023-09-30T17:04:12.745 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4133e-05 2023-09-30T17:04:12.745 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.745 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.745 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.745 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.736838+0000", 2023-09-30T17:04:12.746 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9099999999999999e-06 2023-09-30T17:04:12.746 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.746 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.746 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.746 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.736842+0000", 2023-09-30T17:04:12.746 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7000000000000002e-06 2023-09-30T17:04:12.746 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.746 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.746 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.746 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.746 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.747 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116109 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.747 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.742947+0000", 2023-09-30T17:04:12.747 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.050293048, 2023-09-30T17:04:12.747 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.058047891999999997, 2023-09-30T17:04:12.747 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.747 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.747 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.747 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.747 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.747 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116109 2023-09-30T17:04:12.747 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.748 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.748 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.748 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.748 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.742947+0000", 2023-09-30T17:04:12.748 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.748 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.748 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.748 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.748 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.742947+0000", 2023-09-30T17:04:12.748 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.748 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.748 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.749 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.749 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.742948+0000", 2023-09-30T17:04:12.749 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4400000000000001e-07 2023-09-30T17:04:12.749 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.749 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.749 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.749 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.742960+0000", 2023-09-30T17:04:12.749 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1934e-05 2023-09-30T17:04:12.749 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.749 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.749 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.750 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.742967+0000", 2023-09-30T17:04:12.750 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8040000000000002e-06 2023-09-30T17:04:12.750 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.750 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.750 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.750 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.742973+0000", 2023-09-30T17:04:12.750 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.755e-06 2023-09-30T17:04:12.750 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.750 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.750 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.750 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.751 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.751 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116133 4.38 4.318ef3b8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.751 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.763675+0000", 2023-09-30T17:04:12.751 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.029565692000000001, 2023-09-30T17:04:12.751 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.037380169999999997, 2023-09-30T17:04:12.751 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.751 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.751 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.751 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.751 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.751 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116133 2023-09-30T17:04:12.751 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.752 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.752 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.752 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.752 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.763675+0000", 2023-09-30T17:04:12.752 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.752 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.752 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.752 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.752 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.763675+0000", 2023-09-30T17:04:12.752 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.752 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.753 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.753 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.753 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.763675+0000", 2023-09-30T17:04:12.753 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.23e-07 2023-09-30T17:04:12.753 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.753 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.753 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.753 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.763693+0000", 2023-09-30T17:04:12.753 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7173e-05 2023-09-30T17:04:12.753 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.753 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.753 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.754 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.763703+0000", 2023-09-30T17:04:12.754 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0266e-05 2023-09-30T17:04:12.754 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.754 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.754 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.754 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.763711+0000", 2023-09-30T17:04:12.754 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8290000000000008e-06 2023-09-30T17:04:12.754 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.754 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.754 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.754 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.754 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.755 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116171 4.38 4.5b0ac3f8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.755 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.779678+0000", 2023-09-30T17:04:12.755 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.013561995, 2023-09-30T17:04:12.755 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021430497999999999, 2023-09-30T17:04:12.755 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.755 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.755 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.755 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.755 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.755 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116171 2023-09-30T17:04:12.755 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.755 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.756 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.756 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.756 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.779678+0000", 2023-09-30T17:04:12.756 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.756 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.756 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.756 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.756 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.779678+0000", 2023-09-30T17:04:12.756 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.756 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.756 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.756 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.757 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.779679+0000", 2023-09-30T17:04:12.757 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7400000000000003e-07 2023-09-30T17:04:12.757 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.757 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.757 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.757 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.779694+0000", 2023-09-30T17:04:12.757 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5316e-05 2023-09-30T17:04:12.757 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.757 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.757 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.757 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.779701+0000", 2023-09-30T17:04:12.757 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2089999999999999e-06 2023-09-30T17:04:12.758 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.758 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.758 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.758 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.779707+0000", 2023-09-30T17:04:12.758 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5600000000000001e-06 2023-09-30T17:04:12.758 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.758 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.758 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.758 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.758 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.758 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(client.4547.0:114581 4.37 e52/17)", 2023-09-30T17:04:12.758 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.793552+0000", 2023-09-30T17:04:12.759 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9996881, 2023-09-30T17:04:12.759 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0076060290000000003, 2023-09-30T17:04:12.759 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.759 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.759 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.759 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.759 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.759 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.793552+0000", 2023-09-30T17:04:12.759 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.759 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.759 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.760 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.760 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.793552+0000", 2023-09-30T17:04:12.760 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.760 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.760 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.760 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.760 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.793553+0000", 2023-09-30T17:04:12.760 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4799999999999999e-07 2023-09-30T17:04:12.760 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.760 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.760 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.761 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.793556+0000", 2023-09-30T17:04:12.761 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.225e-06 2023-09-30T17:04:12.761 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.761 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.761 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.761 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.793575+0000", 2023-09-30T17:04:12.761 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8610999999999999e-05 2023-09-30T17:04:12.761 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.761 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.761 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.761 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.793581+0000", 2023-09-30T17:04:12.761 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4200000000000004e-06 2023-09-30T17:04:12.762 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.762 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.762 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.762 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.762 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.762 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115039 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.762 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.349713+0000", 2023-09-30T17:04:12.762 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.44352698499999998, 2023-09-30T17:04:12.762 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.45149834300000002, 2023-09-30T17:04:12.762 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.762 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.763 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.763 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.763 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.763 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115039 2023-09-30T17:04:12.763 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.763 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.763 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.763 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.763 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.349713+0000", 2023-09-30T17:04:12.763 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.763 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.763 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.764 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.764 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.349713+0000", 2023-09-30T17:04:12.764 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.764 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.764 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.764 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.764 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.349714+0000", 2023-09-30T17:04:12.764 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9500000000000003e-07 2023-09-30T17:04:12.764 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.764 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.764 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.764 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.349736+0000", 2023-09-30T17:04:12.765 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1950000000000002e-05 2023-09-30T17:04:12.765 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.765 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.765 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.765 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.349744+0000", 2023-09-30T17:04:12.765 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4060000000000005e-06 2023-09-30T17:04:12.765 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.765 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.765 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.765 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.349750+0000", 2023-09-30T17:04:12.765 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7980000000000002e-06 2023-09-30T17:04:12.766 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.766 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.766 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.766 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.766 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.766 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115426 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.766 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.489496+0000", 2023-09-30T17:04:12.766 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.30374443699999998, 2023-09-30T17:04:12.766 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.31176933899999998, 2023-09-30T17:04:12.766 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.766 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.767 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.767 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.767 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.767 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115426 2023-09-30T17:04:12.767 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.767 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.767 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.767 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.767 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.489496+0000", 2023-09-30T17:04:12.767 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.767 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.767 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.768 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.768 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.489496+0000", 2023-09-30T17:04:12.768 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.768 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.768 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.768 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.768 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.489496+0000", 2023-09-30T17:04:12.768 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3399999999999999e-07 2023-09-30T17:04:12.768 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.768 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.768 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.768 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.489509+0000", 2023-09-30T17:04:12.769 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2364000000000001e-05 2023-09-30T17:04:12.769 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.769 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.769 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.769 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.489529+0000", 2023-09-30T17:04:12.769 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0318000000000001e-05 2023-09-30T17:04:12.769 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.769 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.769 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.769 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.489543+0000", 2023-09-30T17:04:12.769 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4263e-05 2023-09-30T17:04:12.770 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.770 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.770 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.770 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.770 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.770 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115588 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.770 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.557665+0000", 2023-09-30T17:04:12.770 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.23557523799999999, 2023-09-30T17:04:12.770 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.24365795900000001, 2023-09-30T17:04:12.770 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.770 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.771 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.771 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.771 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.771 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115588 2023-09-30T17:04:12.771 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.771 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.771 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.771 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.771 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.557665+0000", 2023-09-30T17:04:12.771 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.771 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.772 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.772 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.772 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.557665+0000", 2023-09-30T17:04:12.772 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.772 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.772 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.772 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.772 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.560625+0000", 2023-09-30T17:04:12.772 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0029598340000000002 2023-09-30T17:04:12.772 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.772 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.772 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.773 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.560644+0000", 2023-09-30T17:04:12.773 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8660000000000001e-05 2023-09-30T17:04:12.773 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.773 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.773 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.773 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.560663+0000", 2023-09-30T17:04:12.773 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9253e-05 2023-09-30T17:04:12.773 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.773 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.773 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.773 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.560675+0000", 2023-09-30T17:04:12.774 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.226e-05 2023-09-30T17:04:12.774 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.774 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.774 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.774 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.774 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.774 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115726 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 1273856~4096 in=4096b,write 1372160~4096 in=4096b,write 1503232~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.774 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.603631+0000", 2023-09-30T17:04:12.774 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.18960898000000001, 2023-09-30T17:04:12.774 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.19775478799999999, 2023-09-30T17:04:12.775 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.775 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:12.775 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.775 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.775 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.775 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115726 2023-09-30T17:04:12.775 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.775 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.775 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.775 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.775 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.603631+0000", 2023-09-30T17:04:12.776 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.776 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.776 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.776 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.776 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.603631+0000", 2023-09-30T17:04:12.776 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.776 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.776 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.776 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.776 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.606665+0000", 2023-09-30T17:04:12.777 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003033708 2023-09-30T17:04:12.777 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.777 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.790 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.790 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.606676+0000", 2023-09-30T17:04:12.790 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0521e-05 2023-09-30T17:04:12.790 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.790 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.790 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.790 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.606681+0000", 2023-09-30T17:04:12.791 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7429999999999999e-06 2023-09-30T17:04:12.791 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.791 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.791 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.791 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.606685+0000", 2023-09-30T17:04:12.791 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8800000000000001e-06 2023-09-30T17:04:12.791 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.791 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.791 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:12.791 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.764282+0000", 2023-09-30T17:04:12.791 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.15759643000000001 2023-09-30T17:04:12.792 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.792 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.792 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:12.792 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.764361+0000", 2023-09-30T17:04:12.792 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9450999999999995e-05 2023-09-30T17:04:12.792 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.792 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.792 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.792 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.792 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.792 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113686 4.2e e52/17)", 2023-09-30T17:04:12.793 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.688906+0000", 2023-09-30T17:04:12.793 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.10433473, 2023-09-30T17:04:12.793 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.112558198, 2023-09-30T17:04:12.793 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.793 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.793 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.793 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.793 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.793 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.688906+0000", 2023-09-30T17:04:12.793 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.793 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.794 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.794 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.794 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.688906+0000", 2023-09-30T17:04:12.794 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.794 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.794 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.794 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.794 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.688906+0000", 2023-09-30T17:04:12.794 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6e-07 2023-09-30T17:04:12.794 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.794 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.794 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.795 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.688917+0000", 2023-09-30T17:04:12.795 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0699e-05 2023-09-30T17:04:12.795 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.795 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.795 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.795 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.688923+0000", 2023-09-30T17:04:12.795 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2910000000000004e-06 2023-09-30T17:04:12.795 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.795 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.795 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.795 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.688928+0000", 2023-09-30T17:04:12.796 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2140000000000004e-06 2023-09-30T17:04:12.796 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.796 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.796 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.796 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.796 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.796 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115978 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.796 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.708718+0000", 2023-09-30T17:04:12.796 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.084522274999999994, 2023-09-30T17:04:12.796 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.092787742000000006, 2023-09-30T17:04:12.796 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.797 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.797 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.797 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.797 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.797 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115978 2023-09-30T17:04:12.797 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.797 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.797 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.797 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.797 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.708718+0000", 2023-09-30T17:04:12.797 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.798 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.798 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.798 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.798 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.708718+0000", 2023-09-30T17:04:12.798 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.798 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.798 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.798 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.798 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.708719+0000", 2023-09-30T17:04:12.798 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7000000000000005e-07 2023-09-30T17:04:12.798 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.799 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.799 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.799 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.708728+0000", 2023-09-30T17:04:12.799 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5289999999999997e-06 2023-09-30T17:04:12.799 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.799 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.799 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.799 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.708735+0000", 2023-09-30T17:04:12.801 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1319999999999996e-06 2023-09-30T17:04:12.801 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.801 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.801 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.801 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.708741+0000", 2023-09-30T17:04:12.801 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8019999999999997e-06 2023-09-30T17:04:12.801 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.802 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.802 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.802 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.802 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.802 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113781 4.6 e52/17)", 2023-09-30T17:04:12.802 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.722379+0000", 2023-09-30T17:04:12.802 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.070861386999999998, 2023-09-30T17:04:12.802 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.079173025999999994, 2023-09-30T17:04:12.802 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.802 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.802 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.803 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.803 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.803 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.722379+0000", 2023-09-30T17:04:12.803 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.803 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.803 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.803 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.803 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.722379+0000", 2023-09-30T17:04:12.803 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.803 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.803 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.804 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.804 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.722380+0000", 2023-09-30T17:04:12.804 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4000000000000001e-07 2023-09-30T17:04:12.804 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.804 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.804 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.804 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.722392+0000", 2023-09-30T17:04:12.804 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2435e-05 2023-09-30T17:04:12.804 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.804 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.804 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.804 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.722401+0000", 2023-09-30T17:04:12.805 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3759999999999997e-06 2023-09-30T17:04:12.805 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.805 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.805 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.805 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.722408+0000", 2023-09-30T17:04:12.805 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9820000000000002e-06 2023-09-30T17:04:12.805 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.805 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.805 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.805 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.805 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.805 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116136 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.806 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.763724+0000", 2023-09-30T17:04:12.806 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.029516771000000001, 2023-09-30T17:04:12.806 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.037874492000000003, 2023-09-30T17:04:12.806 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.806 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.806 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.806 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.806 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.806 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116136 2023-09-30T17:04:12.806 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.806 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.807 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.807 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.807 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.763724+0000", 2023-09-30T17:04:12.807 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.807 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.807 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.807 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.807 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.763724+0000", 2023-09-30T17:04:12.807 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.807 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.807 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.807 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.808 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.763724+0000", 2023-09-30T17:04:12.808 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8100000000000002e-07 2023-09-30T17:04:12.808 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.808 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.808 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.808 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.763737+0000", 2023-09-30T17:04:12.808 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3196999999999999e-05 2023-09-30T17:04:12.808 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.808 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.808 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.808 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.763744+0000", 2023-09-30T17:04:12.808 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8159999999999996e-06 2023-09-30T17:04:12.809 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.809 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.809 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.809 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.763750+0000", 2023-09-30T17:04:12.809 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6160000000000001e-06 2023-09-30T17:04:12.809 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.809 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.809 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.809 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.820 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.820 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116172 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.820 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.779715+0000", 2023-09-30T17:04:12.820 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.013525407999999999, 2023-09-30T17:04:12.820 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021922168999999998, 2023-09-30T17:04:12.821 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.821 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.821 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.821 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.821 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.821 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116172 2023-09-30T17:04:12.821 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.821 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.821 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.821 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.821 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.779715+0000", 2023-09-30T17:04:12.821 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.822 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.822 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.822 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.822 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.779715+0000", 2023-09-30T17:04:12.822 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.822 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.822 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.822 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.822 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.779715+0000", 2023-09-30T17:04:12.822 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1699999999999998e-07 2023-09-30T17:04:12.822 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.823 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.823 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.823 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.779725+0000", 2023-09-30T17:04:12.823 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9250000000000007e-06 2023-09-30T17:04:12.823 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.823 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.823 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.823 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.779733+0000", 2023-09-30T17:04:12.823 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1170000000000004e-06 2023-09-30T17:04:12.823 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.823 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.823 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.824 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.779738+0000", 2023-09-30T17:04:12.824 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9570000000000001e-06 2023-09-30T17:04:12.824 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.824 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.824 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.824 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.824 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.824 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(client.4547.0:114613 4.f e52/17)", 2023-09-30T17:04:12.824 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.793600+0000", 2023-09-30T17:04:12.824 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.99964, 2023-09-30T17:04:12.824 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080694010000000004, 2023-09-30T17:04:12.824 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.825 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.825 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.825 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.825 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.793600+0000", 2023-09-30T17:04:12.825 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.825 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.825 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.825 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.793600+0000", 2023-09-30T17:04:12.825 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.825 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.826 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.826 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.793601+0000", 2023-09-30T17:04:12.826 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2800000000000003e-07 2023-09-30T17:04:12.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.826 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.826 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.826 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.793603+0000", 2023-09-30T17:04:12.826 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0999999999999998e-06 2023-09-30T17:04:12.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.826 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.826 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.826 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.793609+0000", 2023-09-30T17:04:12.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1809999999999998e-06 2023-09-30T17:04:12.827 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.827 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.827 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.827 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.793614+0000", 2023-09-30T17:04:12.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8840000000000002e-06 2023-09-30T17:04:12.827 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.827 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.827 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.827 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.827 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.827 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115295 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.828 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.437415+0000", 2023-09-30T17:04:12.828 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.355825477, 2023-09-30T17:04:12.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.36428279200000002, 2023-09-30T17:04:12.828 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.828 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.828 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.828 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.828 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.828 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115295 2023-09-30T17:04:12.828 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.828 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.828 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.828 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.829 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.437415+0000", 2023-09-30T17:04:12.829 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.829 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.829 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.829 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.437415+0000", 2023-09-30T17:04:12.829 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.829 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.829 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.829 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.438516+0000", 2023-09-30T17:04:12.829 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001101049 2023-09-30T17:04:12.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.830 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.830 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.830 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.438531+0000", 2023-09-30T17:04:12.830 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4891e-05 2023-09-30T17:04:12.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.830 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.830 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.830 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.438544+0000", 2023-09-30T17:04:12.830 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2842e-05 2023-09-30T17:04:12.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.830 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.831 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.831 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.438551+0000", 2023-09-30T17:04:12.831 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7190000000000001e-06 2023-09-30T17:04:12.831 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.831 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.831 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.831 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.831 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.831 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115398 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.831 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.477568+0000", 2023-09-30T17:04:12.831 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.31567213599999999, 2023-09-30T17:04:12.832 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.32416630499999999, 2023-09-30T17:04:12.832 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.832 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.832 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.832 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.832 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.832 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115398 2023-09-30T17:04:12.832 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.832 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.832 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.832 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.832 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.477568+0000", 2023-09-30T17:04:12.832 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.833 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.833 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.833 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.833 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.477568+0000", 2023-09-30T17:04:12.833 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.833 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.833 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.833 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.833 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.477569+0000", 2023-09-30T17:04:12.833 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4900000000000001e-07 2023-09-30T17:04:12.833 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.833 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.834 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.834 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.477580+0000", 2023-09-30T17:04:12.834 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937999999999999e-05 2023-09-30T17:04:12.834 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.834 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.834 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.834 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.477586+0000", 2023-09-30T17:04:12.834 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2319999999999998e-06 2023-09-30T17:04:12.834 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.834 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.834 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.834 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.477591+0000", 2023-09-30T17:04:12.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0769999999999998e-06 2023-09-30T17:04:12.835 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.835 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.835 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.835 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.835 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.835 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115427 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.835 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.489557+0000", 2023-09-30T17:04:12.835 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.30368309100000002, 2023-09-30T17:04:12.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.312208506, 2023-09-30T17:04:12.835 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.835 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.835 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.836 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.836 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.845 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115427 2023-09-30T17:04:12.845 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.845 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.845 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.845 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.845 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.489557+0000", 2023-09-30T17:04:12.845 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.846 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.846 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.846 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.847 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:12.846+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:12.848 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:04:12.848 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:04:12.849 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:04:12.850 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-09-30T17:04:12.850 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-09-30T17:04:12.850 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:04:12.851 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:04:12.853 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.489557+0000", 2023-09-30T17:04:12.853 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.853 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.853 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.853 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.489558+0000", 2023-09-30T17:04:12.853 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8199999999999999e-07 2023-09-30T17:04:12.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.853 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.854 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.854 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.489572+0000", 2023-09-30T17:04:12.854 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4409e-05 2023-09-30T17:04:12.854 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.854 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.854 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.854 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.489581+0000", 2023-09-30T17:04:12.854 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4940000000000003e-06 2023-09-30T17:04:12.854 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.854 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.854 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.855 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.489590+0000", 2023-09-30T17:04:12.855 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0569999999999999e-06 2023-09-30T17:04:12.855 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.855 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.855 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.855 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.855 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.855 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115727 4.38 4:1d13bf87:::100000001f8.00000030:head [write 348160~4096 in=4096b,write 675840~4096 in=4096b,write 917504~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.855 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.606692+0000", 2023-09-30T17:04:12.855 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.186547887, 2023-09-30T17:04:12.855 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.19511305800000001, 2023-09-30T17:04:12.856 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.856 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:12.856 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.856 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.856 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.856 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115727 2023-09-30T17:04:12.856 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.856 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.856 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.856 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.856 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.606692+0000", 2023-09-30T17:04:12.856 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.857 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.857 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.606692+0000", 2023-09-30T17:04:12.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.857 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.857 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.606693+0000", 2023-09-30T17:04:12.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1300000000000001e-07 2023-09-30T17:04:12.857 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.858 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.858 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.606704+0000", 2023-09-30T17:04:12.858 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1201e-05 2023-09-30T17:04:12.858 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.858 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.858 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.858 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.606708+0000", 2023-09-30T17:04:12.858 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.856e-06 2023-09-30T17:04:12.858 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.858 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.858 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.859 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.606711+0000", 2023-09-30T17:04:12.859 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2289999999999999e-06 2023-09-30T17:04:12.859 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.859 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.859 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:12.859 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.768384+0000", 2023-09-30T17:04:12.859 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.161672815 2023-09-30T17:04:12.859 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.859 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.859 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:12.859 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.768458+0000", 2023-09-30T17:04:12.859 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4071000000000003e-05 2023-09-30T17:04:12.859 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.860 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.860 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.860 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.860 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.860 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115979 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.860 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.708748+0000", 2023-09-30T17:04:12.860 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.084492167000000007, 2023-09-30T17:04:12.860 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.093094013000000003, 2023-09-30T17:04:12.860 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.860 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.860 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.860 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.861 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.861 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115979 2023-09-30T17:04:12.861 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.861 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.861 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.861 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.861 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.708748+0000", 2023-09-30T17:04:12.861 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.861 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.861 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.861 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.861 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.708748+0000", 2023-09-30T17:04:12.862 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.862 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.862 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.862 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.862 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.708749+0000", 2023-09-30T17:04:12.862 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5299999999999999e-07 2023-09-30T17:04:12.862 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.862 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.862 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.862 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.708761+0000", 2023-09-30T17:04:12.862 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2529e-05 2023-09-30T17:04:12.863 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.863 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.863 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.863 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.708768+0000", 2023-09-30T17:04:12.863 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8000000000000001e-06 2023-09-30T17:04:12.863 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.863 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.863 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.863 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.708773+0000", 2023-09-30T17:04:12.863 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5670000000000002e-06 2023-09-30T17:04:12.863 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.863 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.864 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.864 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.864 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113785 4.36 e52/17)", 2023-09-30T17:04:12.864 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.722480+0000", 2023-09-30T17:04:12.864 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.070760690000000001, 2023-09-30T17:04:12.864 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.079393065999999998, 2023-09-30T17:04:12.864 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.864 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.864 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.864 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.864 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.722480+0000", 2023-09-30T17:04:12.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.865 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.865 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.865 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.865 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.722480+0000", 2023-09-30T17:04:12.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.865 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.865 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.865 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.865 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.722480+0000", 2023-09-30T17:04:12.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1899999999999998e-07 2023-09-30T17:04:12.865 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.866 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.866 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.866 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.722503+0000", 2023-09-30T17:04:12.866 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3101000000000001e-05 2023-09-30T17:04:12.866 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.866 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.866 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.866 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.722517+0000", 2023-09-30T17:04:12.866 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4115e-05 2023-09-30T17:04:12.866 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.866 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.866 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.867 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.722523+0000", 2023-09-30T17:04:12.867 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8900000000000004e-06 2023-09-30T17:04:12.867 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.867 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.867 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.867 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.867 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.867 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113862 4.36 e52/17)", 2023-09-30T17:04:12.867 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.745343+0000", 2023-09-30T17:04:12.867 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.047897281, 2023-09-30T17:04:12.867 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.056554689999999998, 2023-09-30T17:04:12.867 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.868 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.868 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.868 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.745343+0000", 2023-09-30T17:04:12.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.868 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.868 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.745343+0000", 2023-09-30T17:04:12.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.868 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.869 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.745343+0000", 2023-09-30T17:04:12.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0400000000000002e-07 2023-09-30T17:04:12.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.869 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.745361+0000", 2023-09-30T17:04:12.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7674999999999999e-05 2023-09-30T17:04:12.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.869 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.870 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.745369+0000", 2023-09-30T17:04:12.870 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.525e-06 2023-09-30T17:04:12.870 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.870 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.870 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.745374+0000", 2023-09-30T17:04:12.870 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7039999999999999e-06 2023-09-30T17:04:12.870 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.870 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.870 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.870 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.871 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116218 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.871 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.793066+0000", 2023-09-30T17:04:12.871 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.000174709, 2023-09-30T17:04:12.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0088596000000000005, 2023-09-30T17:04:12.871 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.871 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.871 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.871 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.871 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.871 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116218 2023-09-30T17:04:12.871 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.871 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.872 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.793066+0000", 2023-09-30T17:04:12.872 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.872 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.872 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.793066+0000", 2023-09-30T17:04:12.872 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.872 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.891 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.891 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.794521+0000", 2023-09-30T17:04:12.891 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001455037 2023-09-30T17:04:12.891 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.891 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.891 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.891 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.794539+0000", 2023-09-30T17:04:12.892 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7878000000000001e-05 2023-09-30T17:04:12.892 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.892 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.892 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.892 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.794549+0000", 2023-09-30T17:04:12.892 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0689999999999999e-05 2023-09-30T17:04:12.892 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.892 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.892 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.892 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.794558+0000", 2023-09-30T17:04:12.892 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5150000000000006e-06 2023-09-30T17:04:12.893 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.893 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.893 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.893 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.893 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.893 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:114828 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.893 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.293625+0000", 2023-09-30T17:04:12.893 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.49961515099999998, 2023-09-30T17:04:12.893 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.50832999199999995, 2023-09-30T17:04:12.893 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.893 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.894 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.894 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.894 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.894 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 114828 2023-09-30T17:04:12.894 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.894 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.894 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.894 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.894 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.293625+0000", 2023-09-30T17:04:12.895 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.895 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.895 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.895 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.895 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.293625+0000", 2023-09-30T17:04:12.895 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.895 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.895 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.895 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.895 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.293626+0000", 2023-09-30T17:04:12.895 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5900000000000002e-07 2023-09-30T17:04:12.895 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.896 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.896 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.896 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.293637+0000", 2023-09-30T17:04:12.896 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1871e-05 2023-09-30T17:04:12.896 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.896 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.896 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.896 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.293644+0000", 2023-09-30T17:04:12.896 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5250000000000002e-06 2023-09-30T17:04:12.896 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.896 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.896 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.897 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.293649+0000", 2023-09-30T17:04:12.897 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.831e-06 2023-09-30T17:04:12.897 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.897 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.897 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.897 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.897 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.897 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:114948 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.897 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.329805+0000", 2023-09-30T17:04:12.897 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.46343506400000001, 2023-09-30T17:04:12.897 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.47218083100000002, 2023-09-30T17:04:12.900 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.900 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.900 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.900 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.900 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.900 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 114948 2023-09-30T17:04:12.900 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.900 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.901 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.901 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.901 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.329805+0000", 2023-09-30T17:04:12.901 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.901 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.901 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.901 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.908 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.329805+0000", 2023-09-30T17:04:12.908 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.908 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.908 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.908 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.908 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.331866+0000", 2023-09-30T17:04:12.908 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0020607109999999998 2023-09-30T17:04:12.908 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.908 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.908 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.908 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.331881+0000", 2023-09-30T17:04:12.909 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4691e-05 2023-09-30T17:04:12.909 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.909 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.909 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.909 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.331891+0000", 2023-09-30T17:04:12.909 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0349e-05 2023-09-30T17:04:12.909 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.909 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.909 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.909 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.331899+0000", 2023-09-30T17:04:12.909 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3389999999999993e-06 2023-09-30T17:04:12.910 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.910 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.910 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.910 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.910 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.910 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115104 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.910 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.371381+0000", 2023-09-30T17:04:12.910 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.42185975799999997, 2023-09-30T17:04:12.910 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.43063497099999998, 2023-09-30T17:04:12.910 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.910 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.910 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.911 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.911 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.911 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115104 2023-09-30T17:04:12.911 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.911 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.911 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.911 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.911 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.371381+0000", 2023-09-30T17:04:12.911 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.911 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.911 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.911 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.912 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.371381+0000", 2023-09-30T17:04:12.912 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.912 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.912 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.912 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.912 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.371381+0000", 2023-09-30T17:04:12.912 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7199999999999999e-07 2023-09-30T17:04:12.912 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.912 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.912 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.912 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.371408+0000", 2023-09-30T17:04:12.912 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7458999999999999e-05 2023-09-30T17:04:12.913 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.913 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.913 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.913 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.371415+0000", 2023-09-30T17:04:12.913 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8379999999999996e-06 2023-09-30T17:04:12.913 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.913 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.913 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.913 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.371422+0000", 2023-09-30T17:04:12.913 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2859999999999996e-06 2023-09-30T17:04:12.913 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.913 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.914 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.914 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.914 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.914 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115325 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.914 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.452554+0000", 2023-09-30T17:04:12.914 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.34068613199999997, 2023-09-30T17:04:12.914 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.34949101100000002, 2023-09-30T17:04:12.914 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.914 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.914 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.914 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.915 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.915 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115325 2023-09-30T17:04:12.915 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.915 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.915 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.915 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.915 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.452554+0000", 2023-09-30T17:04:12.915 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.915 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.915 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.915 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.915 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.452554+0000", 2023-09-30T17:04:12.916 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.916 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.916 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.916 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.916 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.452555+0000", 2023-09-30T17:04:12.916 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9200000000000001e-07 2023-09-30T17:04:12.916 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.916 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.916 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.916 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.452574+0000", 2023-09-30T17:04:12.916 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9666000000000001e-05 2023-09-30T17:04:12.916 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.917 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.917 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.917 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.452582+0000", 2023-09-30T17:04:12.917 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.52e-06 2023-09-30T17:04:12.917 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.917 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.917 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.917 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.452588+0000", 2023-09-30T17:04:12.917 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0499999999999997e-06 2023-09-30T17:04:12.917 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.917 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.918 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.918 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.918 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.918 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115729 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 450560~4096 in=4096b,write 479232~4096 in=4096b,write 520192~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.918 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.606715+0000", 2023-09-30T17:04:12.918 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.18652527399999999, 2023-09-30T17:04:12.918 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.195370557, 2023-09-30T17:04:12.918 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.918 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:12.918 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.918 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.918 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.919 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115729 2023-09-30T17:04:12.919 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.919 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.919 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.919 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.919 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.606715+0000", 2023-09-30T17:04:12.919 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.919 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.919 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.919 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.919 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.606715+0000", 2023-09-30T17:04:12.919 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.956 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.956 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.956 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.956 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.606715+0000", 2023-09-30T17:04:12.956 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9299999999999999e-07 2023-09-30T17:04:12.956 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.956 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.957 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.957 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.606724+0000", 2023-09-30T17:04:12.957 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7800000000000006e-06 2023-09-30T17:04:12.957 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.957 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.957 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.957 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.606728+0000", 2023-09-30T17:04:12.957 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.642e-06 2023-09-30T17:04:12.957 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.958 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.958 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.958 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.606731+0000", 2023-09-30T17:04:12.958 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8449999999999999e-06 2023-09-30T17:04:12.958 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.958 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.958 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:12.958 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.771379+0000", 2023-09-30T17:04:12.958 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.16464841599999999 2023-09-30T17:04:12.958 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.958 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.959 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:12.959 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.771459+0000", 2023-09-30T17:04:12.959 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0024999999999994e-05 2023-09-30T17:04:12.959 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.959 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.959 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.959 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.959 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.959 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113547 4.6 e52/17 4:616d4c41:::100000001f8.00000034:head v 52'6968, mlcod=52'6943)", 2023-09-30T17:04:12.959 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.662399+0000", 2023-09-30T17:04:12.959 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.13084161899999999, 2023-09-30T17:04:12.959 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.139724351, 2023-09-30T17:04:12.960 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.960 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:12.960 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.960 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.960 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.960 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.662399+0000", 2023-09-30T17:04:12.960 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.961 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.962 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.962 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.962 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.662399+0000", 2023-09-30T17:04:12.962 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.962 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.962 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.962 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.962 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.662399+0000", 2023-09-30T17:04:12.962 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5400000000000002e-07 2023-09-30T17:04:12.962 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.962 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.963 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.963 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.662418+0000", 2023-09-30T17:04:12.963 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9405000000000001e-05 2023-09-30T17:04:12.963 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.963 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.963 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.963 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.662425+0000", 2023-09-30T17:04:12.963 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0360000000000001e-06 2023-09-30T17:04:12.963 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.963 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.963 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.964 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.662431+0000", 2023-09-30T17:04:12.964 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9920000000000004e-06 2023-09-30T17:04:12.964 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.964 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.964 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:12.964 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.794560+0000", 2023-09-30T17:04:12.964 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.13212845100000001 2023-09-30T17:04:12.964 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.964 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.964 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:12.964 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.794640+0000", 2023-09-30T17:04:12.980 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0311999999999999e-05 2023-09-30T17:04:12.980 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.980 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.980 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.980 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.980 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.980 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113688 4.36 e52/17)", 2023-09-30T17:04:12.980 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.690375+0000", 2023-09-30T17:04:12.980 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.102865675, 2023-09-30T17:04:12.980 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.111779778, 2023-09-30T17:04:12.980 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.981 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.981 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.981 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.981 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.981 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.690375+0000", 2023-09-30T17:04:12.981 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.981 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.981 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.981 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.981 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.690375+0000", 2023-09-30T17:04:12.981 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.981 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.982 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.982 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.982 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.690375+0000", 2023-09-30T17:04:12.982 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0200000000000001e-07 2023-09-30T17:04:12.982 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.982 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.982 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.982 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.690389+0000", 2023-09-30T17:04:12.982 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3671e-05 2023-09-30T17:04:12.982 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.982 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.983 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.983 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.690397+0000", 2023-09-30T17:04:12.983 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0600000000000008e-06 2023-09-30T17:04:12.983 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.983 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.983 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.983 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.690403+0000", 2023-09-30T17:04:12.983 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1290000000000001e-06 2023-09-30T17:04:12.983 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.983 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.983 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.983 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.984 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.984 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115983 4.38 4.5b0ac3f8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.984 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.708781+0000", 2023-09-30T17:04:12.984 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.084459148999999997, 2023-09-30T17:04:12.984 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.093399784999999999, 2023-09-30T17:04:12.984 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.984 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.984 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.984 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.984 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.984 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115983 2023-09-30T17:04:12.985 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.985 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.985 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.985 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.985 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.708781+0000", 2023-09-30T17:04:12.985 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.985 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.985 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.985 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.985 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.708781+0000", 2023-09-30T17:04:12.985 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.985 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.986 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.986 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.986 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.708782+0000", 2023-09-30T17:04:12.986 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6199999999999998e-07 2023-09-30T17:04:12.986 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.986 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.986 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:12.986 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.708791+0000", 2023-09-30T17:04:12.986 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1419999999999999e-06 2023-09-30T17:04:12.987 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.987 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.987 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:12.987 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.708797+0000", 2023-09-30T17:04:12.987 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3199999999999996e-06 2023-09-30T17:04:12.987 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.987 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.987 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:12.987 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.708803+0000", 2023-09-30T17:04:12.987 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8710000000000002e-06 2023-09-30T17:04:12.987 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.988 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:12.988 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:12.988 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.988 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116021 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:12.988 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.720810+0000", 2023-09-30T17:04:12.988 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.072430375000000005, 2023-09-30T17:04:12.988 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.081402580000000002, 2023-09-30T17:04:12.988 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:12.988 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:12.988 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:12.989 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:12.989 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:12.989 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116021 2023-09-30T17:04:12.989 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.989 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:12.989 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.989 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:12.989 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.720810+0000", 2023-09-30T17:04:12.989 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.989 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.989 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.989 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:12.990 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.720810+0000", 2023-09-30T17:04:12.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:12.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:12.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:12.999 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:12.999 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.722535+0000", 2023-09-30T17:04:12.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001725044 2023-09-30T17:04:13.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.000 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.000 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.722548+0000", 2023-09-30T17:04:13.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3165e-05 2023-09-30T17:04:13.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.000 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.000 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.722556+0000", 2023-09-30T17:04:13.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5769999999999996e-06 2023-09-30T17:04:13.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.001 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.001 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.722561+0000", 2023-09-30T17:04:13.001 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3040000000000004e-06 2023-09-30T17:04:13.001 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.001 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.001 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.001 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113826 4.6 e52/17)", 2023-09-30T17:04:13.001 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.745383+0000", 2023-09-30T17:04:13.001 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.047857713000000003, 2023-09-30T17:04:13.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.056859209000000001, 2023-09-30T17:04:13.002 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.002 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.002 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.002 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.002 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.745383+0000", 2023-09-30T17:04:13.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.002 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.002 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.002 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.745383+0000", 2023-09-30T17:04:13.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.003 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.003 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.003 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.745383+0000", 2023-09-30T17:04:13.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1e-07 2023-09-30T17:04:13.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.003 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.003 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.003 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.745393+0000", 2023-09-30T17:04:13.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0487e-05 2023-09-30T17:04:13.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.745399+0000", 2023-09-30T17:04:13.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.998e-06 2023-09-30T17:04:13.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.745404+0000", 2023-09-30T17:04:13.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7319999999999998e-06 2023-09-30T17:04:13.005 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.005 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.005 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.005 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.005 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116220 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.005 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.794571+0000", 2023-09-30T17:04:13.005 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9986691, 2023-09-30T17:04:13.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0077000059999999997, 2023-09-30T17:04:13.005 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.005 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.006 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.006 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.006 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.006 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116220 2023-09-30T17:04:13.006 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.006 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.006 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.006 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.794571+0000", 2023-09-30T17:04:13.006 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.006 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.007 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.794571+0000", 2023-09-30T17:04:13.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.007 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.794572+0000", 2023-09-30T17:04:13.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8500000000000001e-07 2023-09-30T17:04:13.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.007 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.794589+0000", 2023-09-30T17:04:13.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.696e-05 2023-09-30T17:04:13.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.008 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.008 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.794597+0000", 2023-09-30T17:04:13.009 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1720000000000007e-06 2023-09-30T17:04:13.009 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.009 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.009 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.794603+0000", 2023-09-30T17:04:13.009 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0140000000000004e-06 2023-09-30T17:04:13.009 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.009 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.010 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.010 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.010 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:114680 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.010 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.237713+0000", 2023-09-30T17:04:13.010 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.55552755899999995, 2023-09-30T17:04:13.010 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.56459004000000002, 2023-09-30T17:04:13.010 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.010 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.010 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.010 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.011 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.011 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 114680 2023-09-30T17:04:13.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.011 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.237713+0000", 2023-09-30T17:04:13.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.237713+0000", 2023-09-30T17:04:13.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.240375+0000", 2023-09-30T17:04:13.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002662687 2023-09-30T17:04:13.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.240389+0000", 2023-09-30T17:04:13.013 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3842999999999999e-05 2023-09-30T17:04:13.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.013 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.013 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.240408+0000", 2023-09-30T17:04:13.013 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9091000000000001e-05 2023-09-30T17:04:13.014 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.014 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.014 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.014 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.240414+0000", 2023-09-30T17:04:13.014 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9669999999999998e-06 2023-09-30T17:04:13.014 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.014 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.014 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.014 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.014 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.014 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115001 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.014 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.340115+0000", 2023-09-30T17:04:13.015 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.45312510700000003, 2023-09-30T17:04:13.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.462221145, 2023-09-30T17:04:13.015 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.015 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.015 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.015 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.015 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.015 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115001 2023-09-30T17:04:13.015 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.015 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.340115+0000", 2023-09-30T17:04:13.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.340115+0000", 2023-09-30T17:04:13.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.340116+0000", 2023-09-30T17:04:13.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2799999999999996e-07 2023-09-30T17:04:13.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.340134+0000", 2023-09-30T17:04:13.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8223000000000002e-05 2023-09-30T17:04:13.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.340140+0000", 2023-09-30T17:04:13.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3350000000000003e-06 2023-09-30T17:04:13.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.018 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.018 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.340146+0000", 2023-09-30T17:04:13.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6509999999999998e-06 2023-09-30T17:04:13.018 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.018 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.018 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.018 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115327 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.018 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.452597+0000", 2023-09-30T17:04:13.019 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.34064341300000001, 2023-09-30T17:04:13.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.34977015500000003, 2023-09-30T17:04:13.019 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.019 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.019 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.019 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.019 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.019 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115327 2023-09-30T17:04:13.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.019 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.019 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.452597+0000", 2023-09-30T17:04:13.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.452597+0000", 2023-09-30T17:04:13.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.452597+0000", 2023-09-30T17:04:13.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3200000000000005e-07 2023-09-30T17:04:13.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.021 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.021 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.452612+0000", 2023-09-30T17:04:13.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4548e-05 2023-09-30T17:04:13.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.021 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.021 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.452619+0000", 2023-09-30T17:04:13.042 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7279999999999998e-06 2023-09-30T17:04:13.042 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.042 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.042 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.043 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.452624+0000", 2023-09-30T17:04:13.043 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5180000000000004e-06 2023-09-30T17:04:13.043 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.044 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.044 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.044 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.044 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.044 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115400 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.044 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.479566+0000", 2023-09-30T17:04:13.044 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.31367478100000001, 2023-09-30T17:04:13.044 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.32283368899999998, 2023-09-30T17:04:13.044 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.044 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.045 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.045 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.045 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.045 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115400 2023-09-30T17:04:13.045 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.045 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.045 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.045 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.045 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.479566+0000", 2023-09-30T17:04:13.045 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.045 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.045 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.046 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.046 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.479566+0000", 2023-09-30T17:04:13.046 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.046 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.046 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.046 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.046 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.479566+0000", 2023-09-30T17:04:13.046 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3099999999999998e-07 2023-09-30T17:04:13.046 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.046 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.046 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.047 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.479583+0000", 2023-09-30T17:04:13.047 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6996000000000001e-05 2023-09-30T17:04:13.047 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.047 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.047 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.047 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.479590+0000", 2023-09-30T17:04:13.047 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4549999999999998e-06 2023-09-30T17:04:13.047 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.047 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.047 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.047 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.479596+0000", 2023-09-30T17:04:13.047 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8039999999999998e-06 2023-09-30T17:04:13.048 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.048 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.048 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.048 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.048 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.048 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115731 4.38 4:1d13bf87:::100000001f8.00000030:head [write 2531328~4096 in=4096b,write 2613248~4096 in=4096b,write 2670592~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.048 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.606734+0000", 2023-09-30T17:04:13.048 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.18650587099999999, 2023-09-30T17:04:13.048 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.195707466, 2023-09-30T17:04:13.048 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.048 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:13.049 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.049 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.049 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.049 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115731 2023-09-30T17:04:13.049 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.049 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.049 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.049 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.049 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.606734+0000", 2023-09-30T17:04:13.049 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.049 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.049 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.050 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.050 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.606734+0000", 2023-09-30T17:04:13.050 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.050 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.050 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.050 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.050 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.606735+0000", 2023-09-30T17:04:13.050 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4299999999999999e-07 2023-09-30T17:04:13.050 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.050 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.050 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.051 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.606743+0000", 2023-09-30T17:04:13.051 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0479999999999999e-06 2023-09-30T17:04:13.051 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.051 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.051 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.051 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.606746+0000", 2023-09-30T17:04:13.051 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4759999999999998e-06 2023-09-30T17:04:13.051 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.051 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.051 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.051 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.606749+0000", 2023-09-30T17:04:13.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.756e-06 2023-09-30T17:04:13.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.052 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:13.052 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.774484+0000", 2023-09-30T17:04:13.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.16773527699999999 2023-09-30T17:04:13.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.052 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:13.052 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.774564+0000", 2023-09-30T17:04:13.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0152000000000001e-05 2023-09-30T17:04:13.053 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.053 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.053 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.053 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.053 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.053 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115762 4.38 4:1fc350da:::100000001f8.0000002f:head [write 2535424~4096 in=4096b,write 2596864~4096 in=4096b,write 2617344~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.053 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.621840+0000", 2023-09-30T17:04:13.053 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.171400468, 2023-09-30T17:04:13.053 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.180644427, 2023-09-30T17:04:13.053 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.053 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:13.054 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.054 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.054 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.054 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115762 2023-09-30T17:04:13.054 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.054 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.054 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.054 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.054 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.621840+0000", 2023-09-30T17:04:13.054 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.054 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.055 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.055 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.055 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.621840+0000", 2023-09-30T17:04:13.055 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.055 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.055 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.055 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.055 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.621840+0000", 2023-09-30T17:04:13.055 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3700000000000001e-07 2023-09-30T17:04:13.055 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.055 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.055 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.056 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.621851+0000", 2023-09-30T17:04:13.056 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1073000000000001e-05 2023-09-30T17:04:13.056 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.056 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.056 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.056 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.621857+0000", 2023-09-30T17:04:13.056 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5759999999999996e-06 2023-09-30T17:04:13.056 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.056 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.056 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.057 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.621861+0000", 2023-09-30T17:04:13.057 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6460000000000001e-06 2023-09-30T17:04:13.057 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.057 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.057 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:13.057 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.797740+0000", 2023-09-30T17:04:13.057 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.175878174 2023-09-30T17:04:13.057 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.057 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.057 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:13.057 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.797823+0000", 2023-09-30T17:04:13.058 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3327999999999999e-05 2023-09-30T17:04:13.058 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.058 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.058 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.058 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.058 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.058 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115848 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.058 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.660599+0000", 2023-09-30T17:04:13.058 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.13264147700000001, 2023-09-30T17:04:13.058 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.14192742, 2023-09-30T17:04:13.058 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.059 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.059 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.059 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.059 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.059 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115848 2023-09-30T17:04:13.059 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.059 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.059 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.059 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.059 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.660599+0000", 2023-09-30T17:04:13.059 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.060 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.060 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.060 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.060 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.660599+0000", 2023-09-30T17:04:13.060 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.060 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.060 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.060 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.060 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.662518+0000", 2023-09-30T17:04:13.060 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019187550000000001 2023-09-30T17:04:13.060 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.061 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.061 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.061 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.662533+0000", 2023-09-30T17:04:13.061 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5661000000000001e-05 2023-09-30T17:04:13.061 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.061 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.061 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.061 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.662541+0000", 2023-09-30T17:04:13.061 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2279999999999998e-06 2023-09-30T17:04:13.061 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.061 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.062 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.062 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.662549+0000", 2023-09-30T17:04:13.062 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0910000000000004e-06 2023-09-30T17:04:13.062 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.062 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.062 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.062 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.062 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.063 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116146 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.063 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.763828+0000", 2023-09-30T17:04:13.063 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.029412466000000002, 2023-09-30T17:04:13.063 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.038732412000000001, 2023-09-30T17:04:13.063 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.063 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.063 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.063 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.063 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.063 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116146 2023-09-30T17:04:13.063 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.064 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.064 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.064 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.064 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.763828+0000", 2023-09-30T17:04:13.064 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.064 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.064 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.064 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.064 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.763828+0000", 2023-09-30T17:04:13.064 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.064 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.065 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.065 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.065 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.763828+0000", 2023-09-30T17:04:13.065 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7999999999999996e-07 2023-09-30T17:04:13.065 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.065 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.065 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.065 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.763841+0000", 2023-09-30T17:04:13.065 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2627e-05 2023-09-30T17:04:13.065 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.065 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.066 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.066 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.763849+0000", 2023-09-30T17:04:13.066 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6320000000000008e-06 2023-09-30T17:04:13.066 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.066 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.066 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.066 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.763854+0000", 2023-09-30T17:04:13.066 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3789999999999997e-06 2023-09-30T17:04:13.066 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.066 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.066 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.067 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.067 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.067 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116222 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 102400~4096 in=4096b,write 135168~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.068 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.794611+0000", 2023-09-30T17:04:13.068 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9986296, 2023-09-30T17:04:13.068 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080155969999999993, 2023-09-30T17:04:13.068 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.068 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:13.068 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.068 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.068 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.068 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116222 2023-09-30T17:04:13.068 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.068 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.069 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.069 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.069 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.794611+0000", 2023-09-30T17:04:13.069 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.069 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.069 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.069 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.069 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.794611+0000", 2023-09-30T17:04:13.069 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.069 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.069 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.069 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.070 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.794611+0000", 2023-09-30T17:04:13.070 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4700000000000002e-07 2023-09-30T17:04:13.070 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.070 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.070 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.070 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.794621+0000", 2023-09-30T17:04:13.070 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0287e-05 2023-09-30T17:04:13.070 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.070 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.070 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.071 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.794628+0000", 2023-09-30T17:04:13.071 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6749999999999996e-06 2023-09-30T17:04:13.071 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.071 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.071 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.071 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.794633+0000", 2023-09-30T17:04:13.071 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1880000000000001e-06 2023-09-30T17:04:13.071 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.071 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.071 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:13.071 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.794682+0000", 2023-09-30T17:04:13.071 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8733999999999998e-05 2023-09-30T17:04:13.072 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.072 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.072 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:13.072 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.794766+0000", 2023-09-30T17:04:13.072 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4303999999999998e-05 2023-09-30T17:04:13.072 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.072 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.072 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:13.072 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.794907+0000", 2023-09-30T17:04:13.072 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014087299999999999 2023-09-30T17:04:13.072 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.073 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.073 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.073 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.073 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.073 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:114877 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.073 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.307647+0000", 2023-09-30T17:04:13.073 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.48559333300000002, 2023-09-30T17:04:13.073 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.49506811000000001, 2023-09-30T17:04:13.073 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.073 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.099 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.099 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.099 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.099 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 114877 2023-09-30T17:04:13.099 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.099 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.099 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.099 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.100 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.307647+0000", 2023-09-30T17:04:13.100 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.100 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.100 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.100 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.100 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.307647+0000", 2023-09-30T17:04:13.100 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.100 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.100 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.100 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.100 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.307648+0000", 2023-09-30T17:04:13.100 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7899999999999998e-07 2023-09-30T17:04:13.101 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.101 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.101 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.101 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.307660+0000", 2023-09-30T17:04:13.101 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2704999999999999e-05 2023-09-30T17:04:13.101 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.101 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.101 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.101 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.307667+0000", 2023-09-30T17:04:13.101 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2219999999999996e-06 2023-09-30T17:04:13.101 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.102 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.102 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.102 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.307674+0000", 2023-09-30T17:04:13.102 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2169999999999999e-06 2023-09-30T17:04:13.102 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.102 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.102 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.102 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.102 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.102 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:114951 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.103 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.331953+0000", 2023-09-30T17:04:13.103 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.46128756599999998, 2023-09-30T17:04:13.103 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.47082530099999997, 2023-09-30T17:04:13.103 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.103 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.103 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.103 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.103 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.103 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 114951 2023-09-30T17:04:13.104 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.104 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.104 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.104 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.104 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.331953+0000", 2023-09-30T17:04:13.104 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.104 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.104 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.104 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.104 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.331953+0000", 2023-09-30T17:04:13.104 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.105 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.105 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.105 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.105 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.331953+0000", 2023-09-30T17:04:13.105 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9399999999999995e-07 2023-09-30T17:04:13.105 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.105 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.105 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.105 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.331966+0000", 2023-09-30T17:04:13.105 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2815e-05 2023-09-30T17:04:13.105 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.106 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.106 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.106 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.331973+0000", 2023-09-30T17:04:13.106 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7410000000000003e-06 2023-09-30T17:04:13.125 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.125 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.125 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.125 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.331978+0000", 2023-09-30T17:04:13.125 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4709999999999998e-06 2023-09-30T17:04:13.125 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.125 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.125 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.125 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.125 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.126 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115004 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.126 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.340154+0000", 2023-09-30T17:04:13.126 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.45308588700000002, 2023-09-30T17:04:13.126 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.46269666399999998, 2023-09-30T17:04:13.126 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.126 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.126 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.126 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.126 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.127 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115004 2023-09-30T17:04:13.127 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.127 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.127 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.127 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.127 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.340154+0000", 2023-09-30T17:04:13.127 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.127 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.127 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.127 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.127 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.340154+0000", 2023-09-30T17:04:13.127 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.128 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.128 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.128 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.128 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.340155+0000", 2023-09-30T17:04:13.128 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9399999999999995e-07 2023-09-30T17:04:13.128 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.128 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.128 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.128 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.340175+0000", 2023-09-30T17:04:13.128 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9792e-05 2023-09-30T17:04:13.129 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.129 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.130 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.130 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.340182+0000", 2023-09-30T17:04:13.130 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0369999999999997e-06 2023-09-30T17:04:13.130 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.130 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.130 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.130 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.340189+0000", 2023-09-30T17:04:13.130 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1439999999999997e-06 2023-09-30T17:04:13.131 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.131 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.131 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.131 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.131 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.131 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115788 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.131 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.633568+0000", 2023-09-30T17:04:13.131 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.15967246900000001, 2023-09-30T17:04:13.131 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.16934566000000001, 2023-09-30T17:04:13.131 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.132 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.132 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.132 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.132 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.132 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115788 2023-09-30T17:04:13.132 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.132 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.132 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.137 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.138 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.633568+0000", 2023-09-30T17:04:13.138 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.138 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.138 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.138 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.138 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.633568+0000", 2023-09-30T17:04:13.138 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.139 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.139 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.139 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.139 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.633568+0000", 2023-09-30T17:04:13.139 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.44e-07 2023-09-30T17:04:13.139 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.139 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.139 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.139 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.633585+0000", 2023-09-30T17:04:13.139 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7071999999999998e-05 2023-09-30T17:04:13.139 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.140 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.140 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.140 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.633592+0000", 2023-09-30T17:04:13.140 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6969999999999996e-06 2023-09-30T17:04:13.140 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.140 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.140 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.140 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.633598+0000", 2023-09-30T17:04:13.140 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5149999999999997e-06 2023-09-30T17:04:13.140 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.141 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.141 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.141 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.141 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.141 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115875 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.141 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.676488+0000", 2023-09-30T17:04:13.141 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.11675187300000001, 2023-09-30T17:04:13.141 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.126493669, 2023-09-30T17:04:13.141 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.141 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.141 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.142 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.142 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.142 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115875 2023-09-30T17:04:13.142 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.142 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.142 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.142 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.142 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.676488+0000", 2023-09-30T17:04:13.142 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.142 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.142 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.143 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.143 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.676488+0000", 2023-09-30T17:04:13.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.143 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.143 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.143 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.143 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.676489+0000", 2023-09-30T17:04:13.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9399999999999995e-07 2023-09-30T17:04:13.143 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.143 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.144 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.144 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.676506+0000", 2023-09-30T17:04:13.144 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7527999999999999e-05 2023-09-30T17:04:13.144 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.144 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.144 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.144 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.676527+0000", 2023-09-30T17:04:13.144 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0568999999999999e-05 2023-09-30T17:04:13.144 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.144 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.144 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.145 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.676533+0000", 2023-09-30T17:04:13.145 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4339999999999997e-06 2023-09-30T17:04:13.145 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.145 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.145 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.145 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.145 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.145 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113748 4.6 e52/17)", 2023-09-30T17:04:13.145 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.712642+0000", 2023-09-30T17:04:13.145 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.08059798, 2023-09-30T17:04:13.145 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.090390439000000003, 2023-09-30T17:04:13.161 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.161 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.161 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.161 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.161 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.162 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.712642+0000", 2023-09-30T17:04:13.162 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.162 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.162 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.162 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.162 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.712642+0000", 2023-09-30T17:04:13.162 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.162 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.163 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.163 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.163 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.712644+0000", 2023-09-30T17:04:13.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2729999999999999e-06 2023-09-30T17:04:13.163 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.163 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.163 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.163 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.712661+0000", 2023-09-30T17:04:13.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7159999999999998e-05 2023-09-30T17:04:13.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.164 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.164 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.712669+0000", 2023-09-30T17:04:13.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1699999999999997e-06 2023-09-30T17:04:13.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.164 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.165 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.712676+0000", 2023-09-30T17:04:13.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8059999999999997e-06 2023-09-30T17:04:13.165 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.165 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.165 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.165 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.165 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.165 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116148 4.38 4.e1fdc8b8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.165 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.763862+0000", 2023-09-30T17:04:13.165 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.029378464, 2023-09-30T17:04:13.166 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039218724000000003, 2023-09-30T17:04:13.166 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.166 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.166 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.166 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.166 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.166 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116148 2023-09-30T17:04:13.166 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.166 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.167 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.167 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.763862+0000", 2023-09-30T17:04:13.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.763862+0000", 2023-09-30T17:04:13.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.763862+0000", 2023-09-30T17:04:13.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7399999999999998e-07 2023-09-30T17:04:13.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.763873+0000", 2023-09-30T17:04:13.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.057e-05 2023-09-30T17:04:13.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.763880+0000", 2023-09-30T17:04:13.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0759999999999997e-06 2023-09-30T17:04:13.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.170 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.170 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.763885+0000", 2023-09-30T17:04:13.170 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3040000000000004e-06 2023-09-30T17:04:13.170 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.170 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.170 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.170 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116184 4.18 4.31813858 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.171 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.781620+0000", 2023-09-30T17:04:13.171 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.011620227, 2023-09-30T17:04:13.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021512084000000001, 2023-09-30T17:04:13.171 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.171 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.184 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.185 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.185 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.185 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116184 2023-09-30T17:04:13.185 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.185 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.185 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.185 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.185 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.781620+0000", 2023-09-30T17:04:13.185 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.185 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.186 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.186 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.186 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.781620+0000", 2023-09-30T17:04:13.186 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.186 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.186 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.186 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.186 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.781621+0000", 2023-09-30T17:04:13.186 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4600000000000004e-07 2023-09-30T17:04:13.186 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.186 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.187 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.781635+0000", 2023-09-30T17:04:13.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3833e-05 2023-09-30T17:04:13.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.187 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.781644+0000", 2023-09-30T17:04:13.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4660000000000005e-06 2023-09-30T17:04:13.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.187 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.781651+0000", 2023-09-30T17:04:13.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6560000000000003e-06 2023-09-30T17:04:13.188 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.188 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.188 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.188 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116224 4.18 4.31813858 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.188 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.794650+0000", 2023-09-30T17:04:13.188 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9985905, 2023-09-30T17:04:13.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085345509999999996, 2023-09-30T17:04:13.188 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.189 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.189 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.189 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.189 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.189 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116224 2023-09-30T17:04:13.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.189 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.794650+0000", 2023-09-30T17:04:13.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.190 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.190 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.794650+0000", 2023-09-30T17:04:13.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.190 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.190 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.794650+0000", 2023-09-30T17:04:13.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2199999999999999e-07 2023-09-30T17:04:13.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.191 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.794665+0000", 2023-09-30T17:04:13.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4847e-05 2023-09-30T17:04:13.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.191 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.794670+0000", 2023-09-30T17:04:13.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0799999999999996e-06 2023-09-30T17:04:13.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.192 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.794674+0000", 2023-09-30T17:04:13.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5240000000000001e-06 2023-09-30T17:04:13.192 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.192 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.192 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.193 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:114952 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.193 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.331987+0000", 2023-09-30T17:04:13.193 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.46125330399999998, 2023-09-30T17:04:13.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.47125008800000001, 2023-09-30T17:04:13.193 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.193 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.193 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.193 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.193 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.194 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 114952 2023-09-30T17:04:13.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.194 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.194 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.331987+0000", 2023-09-30T17:04:13.204 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.205 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.205 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.331987+0000", 2023-09-30T17:04:13.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.205 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.205 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.205 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.331987+0000", 2023-09-30T17:04:13.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2599999999999998e-07 2023-09-30T17:04:13.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.206 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.206 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.331999+0000", 2023-09-30T17:04:13.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1127e-05 2023-09-30T17:04:13.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.207 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.207 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.332005+0000", 2023-09-30T17:04:13.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4439999999999996e-06 2023-09-30T17:04:13.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.207 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.207 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.332011+0000", 2023-09-30T17:04:13.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5110000000000003e-06 2023-09-30T17:04:13.207 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.207 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.207 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.208 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115112 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.208 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.371501+0000", 2023-09-30T17:04:13.208 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.42173884, 2023-09-30T17:04:13.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.431785904, 2023-09-30T17:04:13.208 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.208 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.208 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.208 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.208 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.208 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115112 2023-09-30T17:04:13.208 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.209 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.209 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.209 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.371501+0000", 2023-09-30T17:04:13.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.209 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.210 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.371501+0000", 2023-09-30T17:04:13.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.210 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.210 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.371502+0000", 2023-09-30T17:04:13.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8599999999999998e-07 2023-09-30T17:04:13.210 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.371522+0000", 2023-09-30T17:04:13.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9726999999999999e-05 2023-09-30T17:04:13.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.371528+0000", 2023-09-30T17:04:13.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4409999999999998e-06 2023-09-30T17:04:13.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.212 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.212 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.371534+0000", 2023-09-30T17:04:13.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1190000000000002e-06 2023-09-30T17:04:13.212 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.212 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.212 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.212 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.212 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115517 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.212 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.522654+0000", 2023-09-30T17:04:13.212 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.27058654799999998, 2023-09-30T17:04:13.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.28068567999999999, 2023-09-30T17:04:13.213 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.213 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.213 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.213 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.213 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.213 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115517 2023-09-30T17:04:13.213 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.213 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.213 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.213 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.213 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.522654+0000", 2023-09-30T17:04:13.213 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.214 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.214 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.214 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.522654+0000", 2023-09-30T17:04:13.214 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.214 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.214 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.214 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.522654+0000", 2023-09-30T17:04:13.214 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2799999999999996e-07 2023-09-30T17:04:13.214 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.215 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.522666+0000", 2023-09-30T17:04:13.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1678999999999999e-05 2023-09-30T17:04:13.215 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.215 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.522673+0000", 2023-09-30T17:04:13.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9450000000000004e-06 2023-09-30T17:04:13.215 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.215 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.216 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.522679+0000", 2023-09-30T17:04:13.216 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7880000000000003e-06 2023-09-30T17:04:13.216 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.216 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.216 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.216 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.216 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.216 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115670 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.216 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.583758+0000", 2023-09-30T17:04:13.216 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.20948219600000001, 2023-09-30T17:04:13.216 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.219631836, 2023-09-30T17:04:13.216 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.217 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.217 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.217 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.217 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.217 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115670 2023-09-30T17:04:13.217 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.217 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.217 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.217 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.583758+0000", 2023-09-30T17:04:13.218 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.218 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.218 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.218 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.218 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.583758+0000", 2023-09-30T17:04:13.218 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.218 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.218 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.218 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.218 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.583758+0000", 2023-09-30T17:04:13.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.89e-07 2023-09-30T17:04:13.219 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.219 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.219 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.583773+0000", 2023-09-30T17:04:13.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4786e-05 2023-09-30T17:04:13.219 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.219 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.219 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.583779+0000", 2023-09-30T17:04:13.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7570000000000001e-06 2023-09-30T17:04:13.220 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.220 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.220 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.220 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.583784+0000", 2023-09-30T17:04:13.220 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5290000000000002e-06 2023-09-30T17:04:13.220 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.220 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.220 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.220 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.220 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.221 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115790 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.221 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.633605+0000", 2023-09-30T17:04:13.221 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.15963533699999999, 2023-09-30T17:04:13.221 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.16983703999999999, 2023-09-30T17:04:13.221 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.221 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.221 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.221 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.221 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.221 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115790 2023-09-30T17:04:13.221 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.222 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.222 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.222 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.222 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.633605+0000", 2023-09-30T17:04:13.222 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.222 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.222 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.222 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.222 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.633605+0000", 2023-09-30T17:04:13.222 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.222 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.222 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.223 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.633605+0000", 2023-09-30T17:04:13.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4099999999999999e-07 2023-09-30T17:04:13.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.223 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.633616+0000", 2023-09-30T17:04:13.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0530000000000001e-05 2023-09-30T17:04:13.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.223 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.224 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.633622+0000", 2023-09-30T17:04:13.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6629999999999998e-06 2023-09-30T17:04:13.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.224 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.224 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.224 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.633626+0000", 2023-09-30T17:04:13.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5419999999999999e-06 2023-09-30T17:04:13.224 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.224 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.224 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.224 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.225 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115811 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.225 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.633821+0000", 2023-09-30T17:04:13.225 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.15941925400000001, 2023-09-30T17:04:13.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.16967422400000001, 2023-09-30T17:04:13.225 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.225 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.225 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.225 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.225 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.225 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115811 2023-09-30T17:04:13.225 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.225 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.226 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.226 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.226 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.633821+0000", 2023-09-30T17:04:13.226 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.226 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.226 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.226 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.226 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.633821+0000", 2023-09-30T17:04:13.226 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.253 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.649515+0000", 2023-09-30T17:04:13.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015694295 2023-09-30T17:04:13.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.253 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.649531+0000", 2023-09-30T17:04:13.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5931999999999999e-05 2023-09-30T17:04:13.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.254 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.254 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.649541+0000", 2023-09-30T17:04:13.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2769999999999994e-06 2023-09-30T17:04:13.254 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.254 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.254 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.649548+0000", 2023-09-30T17:04:13.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9789999999999996e-06 2023-09-30T17:04:13.254 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.254 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.254 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.255 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113799 4.36 e52/17)", 2023-09-30T17:04:13.255 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.725802+0000", 2023-09-30T17:04:13.255 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.067438762999999999, 2023-09-30T17:04:13.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.077754958999999998, 2023-09-30T17:04:13.255 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.255 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.255 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.725802+0000", 2023-09-30T17:04:13.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.725802+0000", 2023-09-30T17:04:13.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.257 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.725802+0000", 2023-09-30T17:04:13.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0900000000000002e-07 2023-09-30T17:04:13.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.257 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.257 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.257 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.725826+0000", 2023-09-30T17:04:13.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3652999999999999e-05 2023-09-30T17:04:13.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.257 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.257 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.258 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.725833+0000", 2023-09-30T17:04:13.258 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7800000000000001e-06 2023-09-30T17:04:13.258 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.258 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.725837+0000", 2023-09-30T17:04:13.258 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9430000000000002e-06 2023-09-30T17:04:13.258 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.258 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.258 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.258 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.259 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116042 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.259 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.731632+0000", 2023-09-30T17:04:13.259 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.061608501000000003, 2023-09-30T17:04:13.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.071972690000000006, 2023-09-30T17:04:13.259 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.259 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.259 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.259 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.259 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.259 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116042 2023-09-30T17:04:13.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.260 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.731632+0000", 2023-09-30T17:04:13.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.731632+0000", 2023-09-30T17:04:13.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.261 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.261 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.738655+0000", 2023-09-30T17:04:13.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070231579999999998 2023-09-30T17:04:13.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.261 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.261 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.738670+0000", 2023-09-30T17:04:13.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5339e-05 2023-09-30T17:04:13.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.261 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.262 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.738678+0000", 2023-09-30T17:04:13.262 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.61e-06 2023-09-30T17:04:13.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.738684+0000", 2023-09-30T17:04:13.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9059999999999999e-06 2023-09-30T17:04:13.279 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.279 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.279 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.279 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116113 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.279 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.745459+0000", 2023-09-30T17:04:13.280 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.047781657999999998, 2023-09-30T17:04:13.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.058202230000000001, 2023-09-30T17:04:13.280 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.280 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.280 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.280 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.280 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.280 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116113 2023-09-30T17:04:13.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.280 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.745459+0000", 2023-09-30T17:04:13.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.745459+0000", 2023-09-30T17:04:13.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.746516+0000", 2023-09-30T17:04:13.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0010569519999999999 2023-09-30T17:04:13.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.746529+0000", 2023-09-30T17:04:13.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3852000000000001e-05 2023-09-30T17:04:13.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.283 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.283 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.746539+0000", 2023-09-30T17:04:13.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7659999999999993e-06 2023-09-30T17:04:13.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.283 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.283 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.746546+0000", 2023-09-30T17:04:13.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6549999999999998e-06 2023-09-30T17:04:13.283 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.283 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.284 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.284 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113979 4.36 e52/17)", 2023-09-30T17:04:13.284 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.781972+0000", 2023-09-30T17:04:13.284 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.011268625000000001, 2023-09-30T17:04:13.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021740501999999998, 2023-09-30T17:04:13.284 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.284 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.284 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.284 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.781972+0000", 2023-09-30T17:04:13.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.781972+0000", 2023-09-30T17:04:13.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.781973+0000", 2023-09-30T17:04:13.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7499999999999999e-07 2023-09-30T17:04:13.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.781998+0000", 2023-09-30T17:04:13.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5539999999999999e-05 2023-09-30T17:04:13.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.782009+0000", 2023-09-30T17:04:13.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0706999999999999e-05 2023-09-30T17:04:13.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.287 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.782016+0000", 2023-09-30T17:04:13.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1890000000000001e-06 2023-09-30T17:04:13.287 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.287 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.287 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.287 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116227 4.38 4.e1fdc8b8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.287 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.794680+0000", 2023-09-30T17:04:13.288 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.99856, 2023-09-30T17:04:13.310 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0090808850000000003, 2023-09-30T17:04:13.310 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.310 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.310 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.311 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.311 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.311 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116227 2023-09-30T17:04:13.311 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.311 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.311 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.311 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.794680+0000", 2023-09-30T17:04:13.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.311 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.312 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.794680+0000", 2023-09-30T17:04:13.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.312 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.794680+0000", 2023-09-30T17:04:13.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6600000000000003e-07 2023-09-30T17:04:13.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.794688+0000", 2023-09-30T17:04:13.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9000000000000006e-06 2023-09-30T17:04:13.313 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.794692+0000", 2023-09-30T17:04:13.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7850000000000002e-06 2023-09-30T17:04:13.313 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.794696+0000", 2023-09-30T17:04:13.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3390000000000001e-06 2023-09-30T17:04:13.314 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.314 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.314 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.314 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:114641 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 1097728~4096 in=4096b,write 1679360~4096 in=4096b,write 1851392~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.314 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.228715+0000", 2023-09-30T17:04:13.314 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.56452566800000004, 2023-09-30T17:04:13.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.57511076299999997, 2023-09-30T17:04:13.315 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.315 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:13.315 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.315 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.315 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.315 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 114641 2023-09-30T17:04:13.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.315 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.315 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.315 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.228715+0000", 2023-09-30T17:04:13.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.228715+0000", 2023-09-30T17:04:13.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.230517+0000", 2023-09-30T17:04:13.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00180214 2023-09-30T17:04:13.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.317 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.317 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.230533+0000", 2023-09-30T17:04:13.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6560000000000001e-05 2023-09-30T17:04:13.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.317 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.317 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.230544+0000", 2023-09-30T17:04:13.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1114999999999999e-05 2023-09-30T17:04:13.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.317 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.230552+0000", 2023-09-30T17:04:13.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3799999999999996e-06 2023-09-30T17:04:13.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:13.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.784684+0000", 2023-09-30T17:04:13.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.55413223300000003 2023-09-30T17:04:13.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:13.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.784781+0000", 2023-09-30T17:04:13.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7005999999999999e-05 2023-09-30T17:04:13.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:13.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.784964+0000", 2023-09-30T17:04:13.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00018297499999999999 2023-09-30T17:04:13.319 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.319 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.319 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.319 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:114883 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.320 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.307727+0000", 2023-09-30T17:04:13.320 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.48551290899999999, 2023-09-30T17:04:13.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.496173802, 2023-09-30T17:04:13.320 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.320 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.320 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.320 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.320 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.320 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 114883 2023-09-30T17:04:13.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.320 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.321 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.321 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.307727+0000", 2023-09-30T17:04:13.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.321 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.321 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.321 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.307727+0000", 2023-09-30T17:04:13.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.321 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.321 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.307728+0000", 2023-09-30T17:04:13.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6899999999999998e-07 2023-09-30T17:04:13.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.307741+0000", 2023-09-30T17:04:13.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2986999999999999e-05 2023-09-30T17:04:13.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.307748+0000", 2023-09-30T17:04:13.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9979999999999997e-06 2023-09-30T17:04:13.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.307753+0000", 2023-09-30T17:04:13.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0610000000000003e-06 2023-09-30T17:04:13.324 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.324 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.324 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.325 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:114959 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.325 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.332017+0000", 2023-09-30T17:04:13.325 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.461222874, 2023-09-30T17:04:13.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.47193817300000002, 2023-09-30T17:04:13.325 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.325 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.325 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.325 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.325 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.325 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 114959 2023-09-30T17:04:13.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.326 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.326 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.326 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.332017+0000", 2023-09-30T17:04:13.326 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.326 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.326 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.326 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.332017+0000", 2023-09-30T17:04:13.326 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.326 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.327 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.327 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.332018+0000", 2023-09-30T17:04:13.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1699999999999998e-07 2023-09-30T17:04:13.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.327 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.327 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.332031+0000", 2023-09-30T17:04:13.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.256e-05 2023-09-30T17:04:13.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.327 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.332037+0000", 2023-09-30T17:04:13.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3239999999999999e-06 2023-09-30T17:04:13.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.332042+0000", 2023-09-30T17:04:13.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2750000000000003e-06 2023-09-30T17:04:13.328 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.328 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.328 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.329 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115043 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.329 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.349758+0000", 2023-09-30T17:04:13.329 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.443481815, 2023-09-30T17:04:13.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.45425117700000001, 2023-09-30T17:04:13.329 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.329 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.329 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.329 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.329 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.329 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115043 2023-09-30T17:04:13.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.329 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.330 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.330 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.349758+0000", 2023-09-30T17:04:13.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.330 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.330 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.349758+0000", 2023-09-30T17:04:13.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.331 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.331 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.351515+0000", 2023-09-30T17:04:13.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001756811 2023-09-30T17:04:13.331 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.331 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.331 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.331 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.351604+0000", 2023-09-30T17:04:13.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9116000000000005e-05 2023-09-30T17:04:13.331 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.331 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.351612+0000", 2023-09-30T17:04:13.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9999999999999996e-06 2023-09-30T17:04:13.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.351618+0000", 2023-09-30T17:04:13.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5999999999999997e-06 2023-09-30T17:04:13.333 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.333 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.333 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.333 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115486 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.333 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.505874+0000", 2023-09-30T17:04:13.333 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.28736610499999998, 2023-09-30T17:04:13.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.29819374599999998, 2023-09-30T17:04:13.333 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.334 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.334 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.334 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.334 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.334 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115486 2023-09-30T17:04:13.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.334 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.505874+0000", 2023-09-30T17:04:13.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.335 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.335 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.335 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.335 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.505874+0000", 2023-09-30T17:04:13.335 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.335 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.335 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.335 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.335 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.509516+0000", 2023-09-30T17:04:13.335 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036420799999999998 2023-09-30T17:04:13.335 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.335 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.336 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.336 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.509542+0000", 2023-09-30T17:04:13.336 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6016999999999998e-05 2023-09-30T17:04:13.336 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.336 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.336 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.336 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.509552+0000", 2023-09-30T17:04:13.336 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3379999999999994e-06 2023-09-30T17:04:13.336 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.336 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.336 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.337 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.509559+0000", 2023-09-30T17:04:13.337 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9500000000000004e-06 2023-09-30T17:04:13.337 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.337 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.337 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.337 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.337 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.337 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115671 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.338 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.583789+0000", 2023-09-30T17:04:13.338 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.20945087700000001, 2023-09-30T17:04:13.338 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.22033264599999999, 2023-09-30T17:04:13.338 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.338 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.338 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.338 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.338 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.338 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115671 2023-09-30T17:04:13.338 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.339 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.339 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.339 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.339 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.583789+0000", 2023-09-30T17:04:13.339 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.339 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.339 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.340 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.340 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.583789+0000", 2023-09-30T17:04:13.340 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.340 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.340 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.340 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.340 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.583790+0000", 2023-09-30T17:04:13.340 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.77e-07 2023-09-30T17:04:13.340 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.340 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.341 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.341 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.583800+0000", 2023-09-30T17:04:13.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0484e-05 2023-09-30T17:04:13.341 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.341 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.341 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.583807+0000", 2023-09-30T17:04:13.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6649999999999997e-06 2023-09-30T17:04:13.341 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.342 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.342 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.342 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.583812+0000", 2023-09-30T17:04:13.342 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5900000000000001e-06 2023-09-30T17:04:13.342 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.342 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.342 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.344 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.344 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.344 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115791 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.344 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.633632+0000", 2023-09-30T17:04:13.344 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.159608156, 2023-09-30T17:04:13.344 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.17054350200000001, 2023-09-30T17:04:13.344 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.344 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.345 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.345 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.345 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.345 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115791 2023-09-30T17:04:13.345 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.345 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.345 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.345 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.345 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.633632+0000", 2023-09-30T17:04:13.345 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.345 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.346 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.346 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.346 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.633632+0000", 2023-09-30T17:04:13.346 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.346 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.346 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.346 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.346 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.633632+0000", 2023-09-30T17:04:13.346 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1600000000000002e-07 2023-09-30T17:04:13.354 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.355 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.355 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.355 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.633647+0000", 2023-09-30T17:04:13.355 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4457000000000001e-05 2023-09-30T17:04:13.355 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.355 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.355 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.355 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.633653+0000", 2023-09-30T17:04:13.355 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6720000000000001e-06 2023-09-30T17:04:13.355 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.356 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.356 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.356 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.633657+0000", 2023-09-30T17:04:13.356 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6e-06 2023-09-30T17:04:13.356 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.356 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.356 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.356 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.356 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.356 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115813 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.356 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.649559+0000", 2023-09-30T17:04:13.356 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.14368081599999999, 2023-09-30T17:04:13.357 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.15466824700000001, 2023-09-30T17:04:13.357 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.357 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.357 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.357 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.357 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.357 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115813 2023-09-30T17:04:13.357 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.357 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.357 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.357 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.358 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.649559+0000", 2023-09-30T17:04:13.358 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.358 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.358 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.358 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.358 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.649559+0000", 2023-09-30T17:04:13.358 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.358 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.358 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.358 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.358 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.649560+0000", 2023-09-30T17:04:13.359 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5700000000000002e-07 2023-09-30T17:04:13.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.359 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.359 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.359 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.649573+0000", 2023-09-30T17:04:13.359 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3213999999999999e-05 2023-09-30T17:04:13.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.359 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.359 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.359 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.649580+0000", 2023-09-30T17:04:13.359 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9450000000000004e-06 2023-09-30T17:04:13.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.360 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.360 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.360 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.649586+0000", 2023-09-30T17:04:13.360 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4450000000000004e-06 2023-09-30T17:04:13.360 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.360 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.360 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.360 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.360 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.360 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115878 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.360 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.679920+0000", 2023-09-30T17:04:13.360 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.11332049700000001, 2023-09-30T17:04:13.361 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.12436472, 2023-09-30T17:04:13.361 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.361 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.361 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.361 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.361 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.361 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115878 2023-09-30T17:04:13.361 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.361 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.361 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.361 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.361 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.679920+0000", 2023-09-30T17:04:13.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.362 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.362 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.362 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.362 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.679920+0000", 2023-09-30T17:04:13.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.362 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.362 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.362 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.362 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.679921+0000", 2023-09-30T17:04:13.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.457e-06 2023-09-30T17:04:13.363 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.363 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.363 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.363 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.679967+0000", 2023-09-30T17:04:13.363 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5405999999999999e-05 2023-09-30T17:04:13.363 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.363 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.363 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.363 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.679993+0000", 2023-09-30T17:04:13.363 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6716e-05 2023-09-30T17:04:13.363 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.363 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.364 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.364 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.680005+0000", 2023-09-30T17:04:13.364 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1994000000000001e-05 2023-09-30T17:04:13.364 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.364 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.364 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.364 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.364 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.364 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113725 4.2e e52/17)", 2023-09-30T17:04:13.364 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.698888+0000", 2023-09-30T17:04:13.364 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.094352399000000003, 2023-09-30T17:04:13.364 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.105450392, 2023-09-30T17:04:13.364 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.365 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.365 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.365 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.365 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.365 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.698888+0000", 2023-09-30T17:04:13.365 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.365 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.365 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.365 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.365 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.698888+0000", 2023-09-30T17:04:13.365 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.366 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.366 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.366 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.366 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.698891+0000", 2023-09-30T17:04:13.366 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1049999999999999e-06 2023-09-30T17:04:13.366 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.366 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.366 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.366 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.698901+0000", 2023-09-30T17:04:13.366 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0389e-05 2023-09-30T17:04:13.366 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.367 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.367 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.698910+0000", 2023-09-30T17:04:13.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4160000000000004e-06 2023-09-30T17:04:13.367 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.367 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.367 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.698916+0000", 2023-09-30T17:04:13.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0700000000000003e-06 2023-09-30T17:04:13.367 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.368 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.368 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.368 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.368 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113796 4.6 e52/17)", 2023-09-30T17:04:13.368 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.725845+0000", 2023-09-30T17:04:13.368 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.067395264999999996, 2023-09-30T17:04:13.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.078546779999999997, 2023-09-30T17:04:13.368 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.368 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.368 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.369 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.369 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.725845+0000", 2023-09-30T17:04:13.369 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.369 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.369 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.369 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.369 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.725845+0000", 2023-09-30T17:04:13.369 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.369 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.369 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.369 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.370 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.725845+0000", 2023-09-30T17:04:13.370 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.03e-07 2023-09-30T17:04:13.370 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.370 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.370 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.370 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.725853+0000", 2023-09-30T17:04:13.370 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9470000000000003e-06 2023-09-30T17:04:13.370 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.370 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.370 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.370 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.725858+0000", 2023-09-30T17:04:13.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4830000000000001e-06 2023-09-30T17:04:13.371 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.371 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.371 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.725860+0000", 2023-09-30T17:04:13.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8119999999999999e-06 2023-09-30T17:04:13.371 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.371 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.371 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.371 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.371 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116044 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.372 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.738693+0000", 2023-09-30T17:04:13.372 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.054546985999999999, 2023-09-30T17:04:13.372 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.065747749999999994, 2023-09-30T17:04:13.372 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.372 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.372 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.372 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.372 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.372 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116044 2023-09-30T17:04:13.372 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.372 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.372 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.373 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.373 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.738693+0000", 2023-09-30T17:04:13.373 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.373 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.373 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.373 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.373 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.738693+0000", 2023-09-30T17:04:13.373 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.373 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.373 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.373 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.374 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.738694+0000", 2023-09-30T17:04:13.374 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3900000000000005e-07 2023-09-30T17:04:13.374 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.374 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.374 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.374 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.738705+0000", 2023-09-30T17:04:13.374 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1338000000000001e-05 2023-09-30T17:04:13.374 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.374 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.374 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.375 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.738711+0000", 2023-09-30T17:04:13.375 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2689999999999996e-06 2023-09-30T17:04:13.375 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.375 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.375 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.375 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.738718+0000", 2023-09-30T17:04:13.375 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4710000000000004e-06 2023-09-30T17:04:13.375 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.377 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.378 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.378 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.378 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.378 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113866 4.2e e52/17)", 2023-09-30T17:04:13.378 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.751281+0000", 2023-09-30T17:04:13.378 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.041959000000000003, 2023-09-30T17:04:13.378 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.053214246999999999, 2023-09-30T17:04:13.378 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.378 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.378 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.378 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.379 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.379 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.751281+0000", 2023-09-30T17:04:13.379 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.379 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.379 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.379 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.379 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.751281+0000", 2023-09-30T17:04:13.379 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.379 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.379 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.379 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.379 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.751282+0000", 2023-09-30T17:04:13.380 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0210000000000001e-06 2023-09-30T17:04:13.380 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.380 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.380 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.380 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.751299+0000", 2023-09-30T17:04:13.380 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6240999999999999e-05 2023-09-30T17:04:13.380 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.380 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.380 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.380 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.751309+0000", 2023-09-30T17:04:13.380 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0832999999999999e-05 2023-09-30T17:04:13.380 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.381 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.381 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.381 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.751319+0000", 2023-09-30T17:04:13.381 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2539999999999998e-06 2023-09-30T17:04:13.381 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.381 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.381 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.381 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.381 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.381 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116154 4.18 4.31813858 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.381 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.763931+0000", 2023-09-30T17:04:13.381 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.029309149999999999, 2023-09-30T17:04:13.382 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.040620797, 2023-09-30T17:04:13.382 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.382 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.382 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.382 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.382 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.382 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116154 2023-09-30T17:04:13.382 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.382 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.382 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.382 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.383 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.763931+0000", 2023-09-30T17:04:13.383 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.383 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.383 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.383 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.383 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.763931+0000", 2023-09-30T17:04:13.383 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.383 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.383 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.383 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.383 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.763932+0000", 2023-09-30T17:04:13.383 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4200000000000001e-07 2023-09-30T17:04:13.384 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.384 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.384 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.384 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.763944+0000", 2023-09-30T17:04:13.384 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2893e-05 2023-09-30T17:04:13.384 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.384 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.384 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.384 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.763951+0000", 2023-09-30T17:04:13.384 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7870000000000004e-06 2023-09-30T17:04:13.384 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.384 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.385 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.385 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.763957+0000", 2023-09-30T17:04:13.385 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4770000000000002e-06 2023-09-30T17:04:13.385 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.385 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.385 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.385 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.385 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.385 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:115154 4.19 e52/17 4:997b7129:::100000001f8.00000000:head v 52'3587, mlcod=52'3584)", 2023-09-30T17:04:13.385 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.794711+0000", 2023-09-30T17:04:13.385 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.998529, 2023-09-30T17:04:13.385 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0099010910000000008, 2023-09-30T17:04:13.386 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.386 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:13.386 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.386 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.386 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.386 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.794711+0000", 2023-09-30T17:04:13.386 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.386 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.386 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.386 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.386 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.794711+0000", 2023-09-30T17:04:13.387 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.387 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.387 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.387 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.387 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.794711+0000", 2023-09-30T17:04:13.387 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0100000000000001e-07 2023-09-30T17:04:13.387 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.387 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.387 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.387 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.794721+0000", 2023-09-30T17:04:13.387 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5009999999999993e-06 2023-09-30T17:04:13.388 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.388 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.388 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.388 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.794725+0000", 2023-09-30T17:04:13.388 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2599999999999999e-06 2023-09-30T17:04:13.388 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.388 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.388 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.388 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.794729+0000", 2023-09-30T17:04:13.388 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.45e-06 2023-09-30T17:04:13.388 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.388 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.389 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:13.389 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.794764+0000", 2023-09-30T17:04:13.389 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5741000000000002e-05 2023-09-30T17:04:13.389 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.389 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.389 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:13.389 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.794783+0000", 2023-09-30T17:04:13.389 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8978999999999999e-05 2023-09-30T17:04:13.389 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.389 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.389 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.389 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.390 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.390 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115116 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.390 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.371589+0000", 2023-09-30T17:04:13.390 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.421651312, 2023-09-30T17:04:13.390 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.433097118, 2023-09-30T17:04:13.390 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.390 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.390 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.390 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.390 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.390 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115116 2023-09-30T17:04:13.391 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.391 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.391 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.391 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.391 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.371589+0000", 2023-09-30T17:04:13.391 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.391 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.391 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.391 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.391 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.371589+0000", 2023-09-30T17:04:13.391 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.391 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.392 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.392 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.392 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.371590+0000", 2023-09-30T17:04:13.392 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4600000000000005e-07 2023-09-30T17:04:13.392 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.392 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.392 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.392 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.371601+0000", 2023-09-30T17:04:13.392 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.128e-05 2023-09-30T17:04:13.392 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.392 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.392 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.393 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.371608+0000", 2023-09-30T17:04:13.393 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1389999999999998e-06 2023-09-30T17:04:13.393 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.393 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.393 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.393 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.371613+0000", 2023-09-30T17:04:13.393 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3369999999999999e-06 2023-09-30T17:04:13.393 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.393 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.393 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.393 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.393 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.394 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115157 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.394 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.384671+0000", 2023-09-30T17:04:13.394 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.40856978100000002, 2023-09-30T17:04:13.394 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.42007721199999998, 2023-09-30T17:04:13.394 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.394 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.394 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.394 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.394 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.394 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115157 2023-09-30T17:04:13.394 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.395 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.395 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.395 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.395 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.384671+0000", 2023-09-30T17:04:13.395 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.395 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.395 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.395 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.395 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.384671+0000", 2023-09-30T17:04:13.395 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.395 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.395 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.396 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.396 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.387363+0000", 2023-09-30T17:04:13.396 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0026928329999999999 2023-09-30T17:04:13.396 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.396 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.396 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.396 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.387374+0000", 2023-09-30T17:04:13.396 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1039999999999999e-05 2023-09-30T17:04:13.396 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.396 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.396 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.396 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.387380+0000", 2023-09-30T17:04:13.397 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3380000000000004e-06 2023-09-30T17:04:13.397 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.397 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.397 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.397 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.387383+0000", 2023-09-30T17:04:13.397 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6789999999999998e-06 2023-09-30T17:04:13.397 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.397 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.397 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.397 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.397 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.397 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115431 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.398 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.491562+0000", 2023-09-30T17:04:13.398 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.30167793700000001, 2023-09-30T17:04:13.398 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.313248949, 2023-09-30T17:04:13.398 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.398 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.398 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.398 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.398 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.398 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115431 2023-09-30T17:04:13.398 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.398 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.399 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.399 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.399 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.491562+0000", 2023-09-30T17:04:13.399 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.399 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.399 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.399 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.399 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.491562+0000", 2023-09-30T17:04:13.399 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.399 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.399 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.399 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.400 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.491563+0000", 2023-09-30T17:04:13.400 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9800000000000004e-07 2023-09-30T17:04:13.400 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.400 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.400 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.400 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.491572+0000", 2023-09-30T17:04:13.400 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5019999999999998e-06 2023-09-30T17:04:13.400 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.400 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.400 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.400 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.491579+0000", 2023-09-30T17:04:13.400 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5690000000000001e-06 2023-09-30T17:04:13.401 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.401 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.401 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.401 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.491584+0000", 2023-09-30T17:04:13.401 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9529999999999998e-06 2023-09-30T17:04:13.401 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.401 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.401 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.401 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.401 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.401 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115489 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.401 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.509572+0000", 2023-09-30T17:04:13.402 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.28366837099999997, 2023-09-30T17:04:13.402 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.29530093099999999, 2023-09-30T17:04:13.402 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.402 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.402 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.402 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.402 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.402 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115489 2023-09-30T17:04:13.402 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.402 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.402 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.402 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.403 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.509572+0000", 2023-09-30T17:04:13.403 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.403 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.403 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.403 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.403 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.509572+0000", 2023-09-30T17:04:13.403 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.403 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.403 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.403 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.403 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.509573+0000", 2023-09-30T17:04:13.404 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8299999999999997e-07 2023-09-30T17:04:13.404 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.404 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.404 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.404 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.509588+0000", 2023-09-30T17:04:13.404 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5415999999999999e-05 2023-09-30T17:04:13.404 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.404 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.404 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.404 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.509595+0000", 2023-09-30T17:04:13.404 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7050000000000002e-06 2023-09-30T17:04:13.405 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.405 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.405 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.405 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.509600+0000", 2023-09-30T17:04:13.405 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2800000000000003e-06 2023-09-30T17:04:13.405 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.405 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.405 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.405 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.405 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.405 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115793 4.38 4.5b0ac3f8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.406 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.633663+0000", 2023-09-30T17:04:13.406 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.159577423, 2023-09-30T17:04:13.406 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.17127583699999999, 2023-09-30T17:04:13.406 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.406 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.406 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.406 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.406 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.406 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115793 2023-09-30T17:04:13.406 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.406 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.406 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.407 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.407 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.633663+0000", 2023-09-30T17:04:13.407 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.407 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.407 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.407 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.407 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.633663+0000", 2023-09-30T17:04:13.407 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.407 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.407 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.407 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.408 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.633663+0000", 2023-09-30T17:04:13.408 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6100000000000001e-07 2023-09-30T17:04:13.429 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.429 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.429 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.429 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.633674+0000", 2023-09-30T17:04:13.429 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0515e-05 2023-09-30T17:04:13.429 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.429 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.429 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.430 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.633679+0000", 2023-09-30T17:04:13.430 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4620000000000004e-06 2023-09-30T17:04:13.430 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.430 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.430 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.430 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.633684+0000", 2023-09-30T17:04:13.430 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4240000000000003e-06 2023-09-30T17:04:13.430 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.430 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.430 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.430 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.430 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.431 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115921 4.38 4.5b0ac3f8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.431 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.693629+0000", 2023-09-30T17:04:13.431 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.099610815000000005, 2023-09-30T17:04:13.431 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.11135170599999999, 2023-09-30T17:04:13.431 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.431 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.431 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.431 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.431 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.431 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115921 2023-09-30T17:04:13.431 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.432 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.432 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.432 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.432 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.693629+0000", 2023-09-30T17:04:13.432 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.432 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.432 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.432 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.432 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.693629+0000", 2023-09-30T17:04:13.432 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.432 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.432 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.433 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.433 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.693630+0000", 2023-09-30T17:04:13.433 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4400000000000001e-07 2023-09-30T17:04:13.433 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.433 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.433 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.433 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.693646+0000", 2023-09-30T17:04:13.433 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5676999999999999e-05 2023-09-30T17:04:13.433 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.433 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.433 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.433 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.693652+0000", 2023-09-30T17:04:13.433 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2570000000000004e-06 2023-09-30T17:04:13.434 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.434 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.434 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.434 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.693657+0000", 2023-09-30T17:04:13.434 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8670000000000002e-06 2023-09-30T17:04:13.434 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.434 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.434 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.434 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.434 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.434 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113731 4.36 e52/17)", 2023-09-30T17:04:13.434 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.699020+0000", 2023-09-30T17:04:13.435 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.094220317999999997, 2023-09-30T17:04:13.435 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.10599566000000001, 2023-09-30T17:04:13.435 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.435 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.435 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.435 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.435 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.435 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.699020+0000", 2023-09-30T17:04:13.435 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.435 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.435 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.435 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.436 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.699020+0000", 2023-09-30T17:04:13.436 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.436 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.436 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.436 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.436 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.699021+0000", 2023-09-30T17:04:13.436 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5599999999999995e-07 2023-09-30T17:04:13.436 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.436 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.436 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.436 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.699036+0000", 2023-09-30T17:04:13.436 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5841e-05 2023-09-30T17:04:13.437 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.437 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.437 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.437 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.699046+0000", 2023-09-30T17:04:13.437 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1419999999999999e-06 2023-09-30T17:04:13.437 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.437 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.437 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.437 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.699052+0000", 2023-09-30T17:04:13.437 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2879999999999998e-06 2023-09-30T17:04:13.437 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.437 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.438 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.438 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.438 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.438 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113873 4.36 e52/17)", 2023-09-30T17:04:13.438 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.751345+0000", 2023-09-30T17:04:13.438 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.041895764000000002, 2023-09-30T17:04:13.438 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.053698290000000003, 2023-09-30T17:04:13.438 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.438 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.438 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.438 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.438 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.439 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.751345+0000", 2023-09-30T17:04:13.439 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.439 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.439 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.439 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.439 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.751345+0000", 2023-09-30T17:04:13.439 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.439 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.439 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.439 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.439 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.751345+0000", 2023-09-30T17:04:13.439 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8299999999999998e-07 2023-09-30T17:04:13.439 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.440 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.440 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.440 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.751357+0000", 2023-09-30T17:04:13.440 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1802e-05 2023-09-30T17:04:13.440 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.440 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.440 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.440 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.751364+0000", 2023-09-30T17:04:13.440 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8689999999999998e-06 2023-09-30T17:04:13.440 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.440 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.440 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.441 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.751369+0000", 2023-09-30T17:04:13.441 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.84e-06 2023-09-30T17:04:13.441 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.441 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.441 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.441 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.441 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.441 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116156 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.441 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.763965+0000", 2023-09-30T17:04:13.441 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.029275756999999999, 2023-09-30T17:04:13.441 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.041111651999999999, 2023-09-30T17:04:13.441 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.442 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.442 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.442 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.442 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.442 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116156 2023-09-30T17:04:13.442 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.442 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.442 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.442 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.442 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.763965+0000", 2023-09-30T17:04:13.442 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.443 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.443 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.443 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.763965+0000", 2023-09-30T17:04:13.443 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.443 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.443 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.443 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.763965+0000", 2023-09-30T17:04:13.443 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9100000000000004e-07 2023-09-30T17:04:13.443 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.444 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.444 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.763982+0000", 2023-09-30T17:04:13.444 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7303999999999999e-05 2023-09-30T17:04:13.444 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.444 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.444 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.444 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.763993+0000", 2023-09-30T17:04:13.444 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0591000000000001e-05 2023-09-30T17:04:13.444 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.444 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.444 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.444 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.763998+0000", 2023-09-30T17:04:13.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9910000000000002e-06 2023-09-30T17:04:13.445 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.445 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.445 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.445 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.445 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.445 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116186 4.38 4.9b7e3478 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.445 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.781660+0000", 2023-09-30T17:04:13.445 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.011580604, 2023-09-30T17:04:13.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.023449845, 2023-09-30T17:04:13.445 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.445 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.446 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.446 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.446 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.446 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116186 2023-09-30T17:04:13.446 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.446 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.446 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.446 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.446 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.781660+0000", 2023-09-30T17:04:13.446 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.446 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.446 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.447 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.447 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.781660+0000", 2023-09-30T17:04:13.447 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.447 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.447 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.447 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.783572+0000", 2023-09-30T17:04:13.447 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019118690000000001 2023-09-30T17:04:13.447 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.448 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.448 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.783588+0000", 2023-09-30T17:04:13.448 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.658e-05 2023-09-30T17:04:13.448 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.448 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.448 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.783600+0000", 2023-09-30T17:04:13.448 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1590000000000001e-05 2023-09-30T17:04:13.449 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.449 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.449 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.449 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.783608+0000", 2023-09-30T17:04:13.449 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9719999999999992e-06 2023-09-30T17:04:13.449 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.449 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.449 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.449 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.449 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.449 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:114019 4.6 e52/17)", 2023-09-30T17:04:13.449 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.796572+0000", 2023-09-30T17:04:13.450 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9966679, 2023-09-30T17:04:13.450 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085774900000000001, 2023-09-30T17:04:13.450 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.450 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.450 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.450 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.450 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.450 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.796572+0000", 2023-09-30T17:04:13.450 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.450 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.450 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.451 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.451 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.796572+0000", 2023-09-30T17:04:13.451 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.451 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.451 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.451 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.451 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.796573+0000", 2023-09-30T17:04:13.451 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5799999999999999e-07 2023-09-30T17:04:13.451 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.451 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.451 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.451 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.796602+0000", 2023-09-30T17:04:13.452 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9008000000000001e-05 2023-09-30T17:04:13.452 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.452 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.452 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.452 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.796610+0000", 2023-09-30T17:04:13.452 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2959999999999999e-06 2023-09-30T17:04:13.452 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.452 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.452 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.452 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.796616+0000", 2023-09-30T17:04:13.452 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3249999999999998e-06 2023-09-30T17:04:13.452 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.453 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.453 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.453 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.453 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.453 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:114885 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.453 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.307794+0000", 2023-09-30T17:04:13.453 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.48544620700000002, 2023-09-30T17:04:13.453 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.49738654199999999, 2023-09-30T17:04:13.453 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.453 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.453 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.453 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.454 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.454 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 114885 2023-09-30T17:04:13.454 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.454 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.454 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.454 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.454 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.307794+0000", 2023-09-30T17:04:13.454 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.454 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.454 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.454 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.454 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.307794+0000", 2023-09-30T17:04:13.455 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.455 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.455 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.455 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.455 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.307795+0000", 2023-09-30T17:04:13.455 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.44e-07 2023-09-30T17:04:13.455 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.455 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.455 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.455 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.307819+0000", 2023-09-30T17:04:13.455 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4820999999999998e-05 2023-09-30T17:04:13.455 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.455 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.456 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.456 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.307835+0000", 2023-09-30T17:04:13.456 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5590000000000002e-05 2023-09-30T17:04:13.456 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.456 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.456 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.456 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.307848+0000", 2023-09-30T17:04:13.456 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2794e-05 2023-09-30T17:04:13.456 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.456 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.456 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.456 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.457 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.457 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115120 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.457 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.371621+0000", 2023-09-30T17:04:13.457 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.42161930600000003, 2023-09-30T17:04:13.457 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.43359269900000003, 2023-09-30T17:04:13.457 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.457 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.457 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.457 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.457 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.457 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115120 2023-09-30T17:04:13.457 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.458 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.458 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.458 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.458 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.371621+0000", 2023-09-30T17:04:13.458 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.458 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.458 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.458 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.458 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.371621+0000", 2023-09-30T17:04:13.458 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.458 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.458 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.459 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.459 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.371621+0000", 2023-09-30T17:04:13.459 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8500000000000002e-07 2023-09-30T17:04:13.459 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.459 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.459 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.459 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.371636+0000", 2023-09-30T17:04:13.459 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4233000000000001e-05 2023-09-30T17:04:13.459 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.459 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.459 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.460 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.371643+0000", 2023-09-30T17:04:13.460 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8410000000000002e-06 2023-09-30T17:04:13.460 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.460 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.460 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.460 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.371648+0000", 2023-09-30T17:04:13.460 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4360000000000001e-06 2023-09-30T17:04:13.460 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.460 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.460 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.460 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.460 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.461 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115205 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.461 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.398640+0000", 2023-09-30T17:04:13.461 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.39460014300000001, 2023-09-30T17:04:13.461 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.406608097, 2023-09-30T17:04:13.461 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.461 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.461 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.461 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.461 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.461 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115205 2023-09-30T17:04:13.461 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.461 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.461 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.462 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.462 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.398640+0000", 2023-09-30T17:04:13.462 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.462 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.462 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.462 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.462 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.398640+0000", 2023-09-30T17:04:13.462 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.462 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.462 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.462 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.463 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.398641+0000", 2023-09-30T17:04:13.463 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0800000000000005e-07 2023-09-30T17:04:13.463 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.463 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.463 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.398652+0000", 2023-09-30T17:04:13.463 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1392999999999999e-05 2023-09-30T17:04:13.463 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.463 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.463 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.398659+0000", 2023-09-30T17:04:13.463 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5289999999999997e-06 2023-09-30T17:04:13.464 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.464 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.464 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.464 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.398664+0000", 2023-09-30T17:04:13.464 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5040000000000002e-06 2023-09-30T17:04:13.464 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.464 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.464 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.464 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.464 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.464 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115305 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.464 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.438623+0000", 2023-09-30T17:04:13.464 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.35461710000000002, 2023-09-30T17:04:13.465 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.36666398300000003, 2023-09-30T17:04:13.465 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.465 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.465 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.465 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.465 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.465 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115305 2023-09-30T17:04:13.465 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.465 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.465 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.465 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.465 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.438623+0000", 2023-09-30T17:04:13.466 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.466 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.466 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.466 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.466 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.438623+0000", 2023-09-30T17:04:13.466 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.466 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.466 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.466 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.466 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.440516+0000", 2023-09-30T17:04:13.466 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00189295 2023-09-30T17:04:13.466 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.467 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.467 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.467 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.440537+0000", 2023-09-30T17:04:13.467 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0806e-05 2023-09-30T17:04:13.467 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.467 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.467 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.467 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.440546+0000", 2023-09-30T17:04:13.467 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4890000000000001e-06 2023-09-30T17:04:13.467 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.467 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.467 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.468 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.440556+0000", 2023-09-30T17:04:13.468 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3500000000000003e-06 2023-09-30T17:04:13.468 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.468 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.468 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.468 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.468 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.468 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115674 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.468 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.583843+0000", 2023-09-30T17:04:13.468 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.209396995, 2023-09-30T17:04:13.468 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.221491456, 2023-09-30T17:04:13.468 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.469 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.469 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.469 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.469 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.469 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115674 2023-09-30T17:04:13.469 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.469 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.469 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.469 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.469 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.583843+0000", 2023-09-30T17:04:13.469 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.469 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.470 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.470 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.470 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.583843+0000", 2023-09-30T17:04:13.470 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.470 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.470 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.470 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.470 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.583844+0000", 2023-09-30T17:04:13.470 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.41e-07 2023-09-30T17:04:13.470 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.470 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.470 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.471 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.583858+0000", 2023-09-30T17:04:13.471 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.465e-05 2023-09-30T17:04:13.471 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.471 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.471 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.471 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.583864+0000", 2023-09-30T17:04:13.471 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7910000000000001e-06 2023-09-30T17:04:13.471 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.471 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.471 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.471 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.583874+0000", 2023-09-30T17:04:13.471 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8079999999999999e-06 2023-09-30T17:04:13.472 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.472 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.472 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.472 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.472 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.472 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115794 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.472 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.633690+0000", 2023-09-30T17:04:13.472 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.15955039600000001, 2023-09-30T17:04:13.472 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.17171213099999999, 2023-09-30T17:04:13.472 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.472 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.472 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.473 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.473 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.473 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115794 2023-09-30T17:04:13.473 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.473 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.473 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.473 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.473 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.633690+0000", 2023-09-30T17:04:13.473 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.473 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.473 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.473 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.474 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.633690+0000", 2023-09-30T17:04:13.474 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.474 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.474 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.474 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.474 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.633690+0000", 2023-09-30T17:04:13.474 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5299999999999999e-07 2023-09-30T17:04:13.474 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.474 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.474 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.474 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.633701+0000", 2023-09-30T17:04:13.474 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0958000000000001e-05 2023-09-30T17:04:13.475 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.475 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.475 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.475 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.633707+0000", 2023-09-30T17:04:13.475 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1229999999999997e-06 2023-09-30T17:04:13.475 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.475 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.475 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.475 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.633712+0000", 2023-09-30T17:04:13.475 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9069999999999998e-06 2023-09-30T17:04:13.475 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.475 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.476 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.476 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.476 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.476 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115923 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.476 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.693664+0000", 2023-09-30T17:04:13.476 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.099575809000000001, 2023-09-30T17:04:13.476 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.11177342699999999, 2023-09-30T17:04:13.476 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.476 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.476 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.476 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.476 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.477 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115923 2023-09-30T17:04:13.477 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.477 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.477 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.477 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.477 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.693664+0000", 2023-09-30T17:04:13.477 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.477 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.477 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.477 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.477 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.693664+0000", 2023-09-30T17:04:13.478 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.478 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.478 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.478 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.478 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.693665+0000", 2023-09-30T17:04:13.478 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7800000000000002e-07 2023-09-30T17:04:13.478 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.478 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.478 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.478 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.693675+0000", 2023-09-30T17:04:13.478 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0335e-05 2023-09-30T17:04:13.478 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.479 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.479 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.479 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.693681+0000", 2023-09-30T17:04:13.479 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9540000000000001e-06 2023-09-30T17:04:13.479 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.479 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.479 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.479 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.693686+0000", 2023-09-30T17:04:13.479 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.566e-06 2023-09-30T17:04:13.479 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.479 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.479 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.480 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115986 4.18 4.31813858 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.480 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.712798+0000", 2023-09-30T17:04:13.480 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.080442171000000007, 2023-09-30T17:04:13.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.092671898000000003, 2023-09-30T17:04:13.480 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.480 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.480 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.480 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.480 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.480 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115986 2023-09-30T17:04:13.481 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.481 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.481 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.481 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.481 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.712798+0000", 2023-09-30T17:04:13.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.481 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.481 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.481 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.481 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.712798+0000", 2023-09-30T17:04:13.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.481 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.482 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.482 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.482 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.712799+0000", 2023-09-30T17:04:13.482 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8100000000000003e-07 2023-09-30T17:04:13.482 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.482 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.482 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.482 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.712816+0000", 2023-09-30T17:04:13.482 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7027000000000001e-05 2023-09-30T17:04:13.482 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.482 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.482 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.483 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.712822+0000", 2023-09-30T17:04:13.483 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2480000000000001e-06 2023-09-30T17:04:13.483 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.483 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.483 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.483 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.712827+0000", 2023-09-30T17:04:13.483 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9520000000000002e-06 2023-09-30T17:04:13.483 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.483 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.483 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.483 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.483 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.484 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116048 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.484 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.738757+0000", 2023-09-30T17:04:13.484 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.054483113999999999, 2023-09-30T17:04:13.484 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.066742483000000005, 2023-09-30T17:04:13.484 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.484 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.484 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.484 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.484 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.484 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116048 2023-09-30T17:04:13.484 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.484 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.484 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.485 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.485 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.738757+0000", 2023-09-30T17:04:13.485 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.485 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.485 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.485 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.485 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.738757+0000", 2023-09-30T17:04:13.485 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.485 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.485 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.485 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.485 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.738758+0000", 2023-09-30T17:04:13.486 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8699999999999995e-07 2023-09-30T17:04:13.486 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.486 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.486 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.486 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.738770+0000", 2023-09-30T17:04:13.486 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2363e-05 2023-09-30T17:04:13.486 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.486 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.486 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.486 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.738776+0000", 2023-09-30T17:04:13.486 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3130000000000004e-06 2023-09-30T17:04:13.486 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.487 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.487 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.487 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.738782+0000", 2023-09-30T17:04:13.487 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4890000000000003e-06 2023-09-30T17:04:13.487 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.487 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.487 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.487 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.487 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.487 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:115117 4.28 e52/17 4:153ae410:::100000001f8.0000003b:head v 52'3537, mlcod=52'3531)", 2023-09-30T17:04:13.487 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.784272+0000", 2023-09-30T17:04:13.487 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0089685860000000006, 2023-09-30T17:04:13.488 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021272124999999999, 2023-09-30T17:04:13.488 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.488 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:13.488 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.488 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.488 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.488 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.784272+0000", 2023-09-30T17:04:13.488 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.488 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.488 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.488 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.488 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.784272+0000", 2023-09-30T17:04:13.489 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.489 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.489 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.784272+0000", 2023-09-30T17:04:13.489 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0699999999999996e-07 2023-09-30T17:04:13.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.489 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.489 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.784288+0000", 2023-09-30T17:04:13.489 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5466999999999999e-05 2023-09-30T17:04:13.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.490 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.490 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.784300+0000", 2023-09-30T17:04:13.490 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1897e-05 2023-09-30T17:04:13.490 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.490 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.490 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.490 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.784307+0000", 2023-09-30T17:04:13.490 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1280000000000002e-06 2023-09-30T17:04:13.490 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.490 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.490 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:13.490 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.784395+0000", 2023-09-30T17:04:13.491 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8325999999999994e-05 2023-09-30T17:04:13.491 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.491 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.491 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:13.491 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.784415+0000", 2023-09-30T17:04:13.491 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9831e-05 2023-09-30T17:04:13.491 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.491 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.491 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.491 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.491 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.491 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:115164 4.3b e52/17 4:dcc0c15f:::100000001f8.0000001a:head v 52'1865, mlcod=52'1861)", 2023-09-30T17:04:13.492 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.796903+0000", 2023-09-30T17:04:13.492 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9963374, 2023-09-30T17:04:13.492 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0086778500000000008, 2023-09-30T17:04:13.492 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.492 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:13.492 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.492 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.492 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.492 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.796903+0000", 2023-09-30T17:04:13.492 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.492 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.492 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.493 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.493 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.796903+0000", 2023-09-30T17:04:13.493 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.493 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.493 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.493 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.493 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.796904+0000", 2023-09-30T17:04:13.493 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1500000000000004e-07 2023-09-30T17:04:13.493 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.493 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.493 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.493 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.796914+0000", 2023-09-30T17:04:13.494 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0757000000000001e-05 2023-09-30T17:04:13.494 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.494 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.494 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.494 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.796924+0000", 2023-09-30T17:04:13.494 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4010000000000003e-06 2023-09-30T17:04:13.494 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.494 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.494 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.494 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.796929+0000", 2023-09-30T17:04:13.494 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0159999999999999e-06 2023-09-30T17:04:13.494 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.495 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.495 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:13.495 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.797277+0000", 2023-09-30T17:04:13.495 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000348179 2023-09-30T17:04:13.495 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.495 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.495 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:13.495 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.797294+0000", 2023-09-30T17:04:13.495 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.715e-05 2023-09-30T17:04:13.495 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.495 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.495 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.496 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.496 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.496 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:114886 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.496 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.307865+0000", 2023-09-30T17:04:13.496 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.48537534100000002, 2023-09-30T17:04:13.496 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.49775271199999999, 2023-09-30T17:04:13.496 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.496 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.504 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.504 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.504 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.505 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 114886 2023-09-30T17:04:13.505 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.505 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.505 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.505 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.505 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.307865+0000", 2023-09-30T17:04:13.505 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.505 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.505 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.505 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.505 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.307865+0000", 2023-09-30T17:04:13.505 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.506 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.506 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.506 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.307865+0000", 2023-09-30T17:04:13.506 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.06e-07 2023-09-30T17:04:13.506 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.506 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.506 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.307892+0000", 2023-09-30T17:04:13.506 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.688e-05 2023-09-30T17:04:13.506 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.507 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.507 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.307911+0000", 2023-09-30T17:04:13.507 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8261999999999999e-05 2023-09-30T17:04:13.507 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.507 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.507 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.507 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.307918+0000", 2023-09-30T17:04:13.507 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.401e-06 2023-09-30T17:04:13.507 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.507 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.507 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.508 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.508 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.508 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115124 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.508 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.371656+0000", 2023-09-30T17:04:13.508 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.42158395100000001, 2023-09-30T17:04:13.508 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.43399104799999999, 2023-09-30T17:04:13.508 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.508 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.508 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.508 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.508 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.508 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115124 2023-09-30T17:04:13.508 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.509 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.509 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.509 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.509 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.371656+0000", 2023-09-30T17:04:13.509 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.509 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.509 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.509 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.509 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.371656+0000", 2023-09-30T17:04:13.509 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.509 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.509 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.510 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.510 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.371657+0000", 2023-09-30T17:04:13.510 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7899999999999998e-07 2023-09-30T17:04:13.510 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.510 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.510 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.510 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.371668+0000", 2023-09-30T17:04:13.510 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0614999999999999e-05 2023-09-30T17:04:13.510 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.510 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.510 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.511 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.371674+0000", 2023-09-30T17:04:13.511 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.088e-06 2023-09-30T17:04:13.511 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.511 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.511 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.511 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.371679+0000", 2023-09-30T17:04:13.511 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2959999999999998e-06 2023-09-30T17:04:13.511 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.511 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.511 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.512 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.512 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.512 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115736 4.38 4:1dcf718c:::100000001f8.00000022:head [write 512000~4096 in=4096b,write 708608~4096 in=4096b,write 1040384~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.512 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.610575+0000", 2023-09-30T17:04:13.513 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.18266542499999999, 2023-09-30T17:04:13.513 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.19510714200000001, 2023-09-30T17:04:13.513 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.513 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:13.513 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.513 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.513 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.513 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115736 2023-09-30T17:04:13.513 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.513 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.513 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.513 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.514 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.610575+0000", 2023-09-30T17:04:13.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.514 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.514 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.514 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.514 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.610575+0000", 2023-09-30T17:04:13.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.514 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.514 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.514 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.514 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.610575+0000", 2023-09-30T17:04:13.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1200000000000003e-07 2023-09-30T17:04:13.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.515 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.515 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.610587+0000", 2023-09-30T17:04:13.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1358e-05 2023-09-30T17:04:13.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.515 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.515 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.610595+0000", 2023-09-30T17:04:13.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1130000000000001e-06 2023-09-30T17:04:13.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.516 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.516 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.610600+0000", 2023-09-30T17:04:13.516 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1200000000000001e-06 2023-09-30T17:04:13.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.516 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:13.516 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.786081+0000", 2023-09-30T17:04:13.516 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.17548087400000001 2023-09-30T17:04:13.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.516 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:13.516 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.786154+0000", 2023-09-30T17:04:13.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3294000000000007e-05 2023-09-30T17:04:13.517 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.517 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.517 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.517 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.517 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115924 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.517 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.693692+0000", 2023-09-30T17:04:13.517 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.099547945999999998, 2023-09-30T17:04:13.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.112026063, 2023-09-30T17:04:13.517 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.517 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.517 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.518 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.518 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.518 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115924 2023-09-30T17:04:13.518 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.518 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.518 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.518 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.518 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.693692+0000", 2023-09-30T17:04:13.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.518 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.519 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.519 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.693692+0000", 2023-09-30T17:04:13.519 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.519 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.519 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.693693+0000", 2023-09-30T17:04:13.519 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4499999999999998e-07 2023-09-30T17:04:13.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.521 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.521 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.522 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.693745+0000", 2023-09-30T17:04:13.522 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2008000000000001e-05 2023-09-30T17:04:13.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.522 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.522 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.693762+0000", 2023-09-30T17:04:13.522 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7416000000000001e-05 2023-09-30T17:04:13.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.522 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.522 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.693776+0000", 2023-09-30T17:04:13.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3893999999999999e-05 2023-09-30T17:04:13.523 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.523 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.523 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.523 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115993 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.523 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.712836+0000", 2023-09-30T17:04:13.523 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.080404744, 2023-09-30T17:04:13.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.092914756000000001, 2023-09-30T17:04:13.523 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.523 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.524 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.524 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.524 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.524 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115993 2023-09-30T17:04:13.524 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.524 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.524 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.524 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.524 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.712836+0000", 2023-09-30T17:04:13.524 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.524 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.524 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.525 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.525 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.712836+0000", 2023-09-30T17:04:13.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.525 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.525 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.525 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.525 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.712836+0000", 2023-09-30T17:04:13.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8400000000000005e-07 2023-09-30T17:04:13.525 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.525 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.525 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.525 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.712848+0000", 2023-09-30T17:04:13.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2128e-05 2023-09-30T17:04:13.526 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.526 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.526 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.712854+0000", 2023-09-30T17:04:13.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9449999999999998e-06 2023-09-30T17:04:13.526 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.526 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.526 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.712859+0000", 2023-09-30T17:04:13.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2700000000000004e-06 2023-09-30T17:04:13.526 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.527 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.527 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.527 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.527 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.527 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116228 4.2c 4:36128e15:::100000001f8.00000008:head [write 2560000~4096 in=4096b,write 2588672~4096 in=4096b,write 2813952~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.527 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.794699+0000", 2023-09-30T17:04:13.527 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9985409, 2023-09-30T17:04:13.527 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011084689, 2023-09-30T17:04:13.527 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.527 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:13.561 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.561 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.561 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.561 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116228 2023-09-30T17:04:13.561 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.561 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.561 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.561 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.561 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.794699+0000", 2023-09-30T17:04:13.562 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.562 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.562 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.562 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.562 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.794699+0000", 2023-09-30T17:04:13.562 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.562 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.562 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.562 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.562 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.798519+0000", 2023-09-30T17:04:13.562 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038193189999999998 2023-09-30T17:04:13.562 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.563 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.563 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.563 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.798536+0000", 2023-09-30T17:04:13.563 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7147e-05 2023-09-30T17:04:13.563 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.563 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.563 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.563 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.798546+0000", 2023-09-30T17:04:13.563 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0161e-05 2023-09-30T17:04:13.563 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.563 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.563 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.564 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.798553+0000", 2023-09-30T17:04:13.564 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1949999999999997e-06 2023-09-30T17:04:13.564 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.564 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.564 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:13.564 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.800415+0000", 2023-09-30T17:04:13.564 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0018618860000000001 2023-09-30T17:04:13.564 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.564 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.564 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:13.564 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.800506+0000", 2023-09-30T17:04:13.564 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1328000000000004e-05 2023-09-30T17:04:13.565 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.565 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.565 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.565 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.565 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.565 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:114812 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.565 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.285676+0000", 2023-09-30T17:04:13.565 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.50756478500000002, 2023-09-30T17:04:13.565 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.52014734200000001, 2023-09-30T17:04:13.565 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.565 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.565 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.566 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.566 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.566 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 114812 2023-09-30T17:04:13.566 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.566 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.566 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.566 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.566 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.285676+0000", 2023-09-30T17:04:13.566 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.566 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.566 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.566 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.567 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.285676+0000", 2023-09-30T17:04:13.567 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.567 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.567 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.567 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.567 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.285676+0000", 2023-09-30T17:04:13.567 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9499999999999998e-07 2023-09-30T17:04:13.567 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.567 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.567 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.567 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.285689+0000", 2023-09-30T17:04:13.567 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3606e-05 2023-09-30T17:04:13.568 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.568 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.568 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.568 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.285697+0000", 2023-09-30T17:04:13.568 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3089999999999998e-06 2023-09-30T17:04:13.568 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.568 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.568 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.568 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.285700+0000", 2023-09-30T17:04:13.568 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.489e-06 2023-09-30T17:04:13.568 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.568 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.569 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.569 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.569 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.569 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115436 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.589 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.491663+0000", 2023-09-30T17:04:13.589 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.30157683000000002, 2023-09-30T17:04:13.590 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.31418965100000001, 2023-09-30T17:04:13.590 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.590 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.590 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.590 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.590 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.590 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115436 2023-09-30T17:04:13.590 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.590 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.590 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.591 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.591 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.491663+0000", 2023-09-30T17:04:13.591 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.591 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.591 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.591 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.591 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.491663+0000", 2023-09-30T17:04:13.591 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.591 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.591 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.591 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.592 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.491664+0000", 2023-09-30T17:04:13.592 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7e-07 2023-09-30T17:04:13.592 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.592 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.592 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.592 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.491679+0000", 2023-09-30T17:04:13.603 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5395000000000001e-05 2023-09-30T17:04:13.603 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.604 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.604 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.604 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.491689+0000", 2023-09-30T17:04:13.604 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4069999999999999e-06 2023-09-30T17:04:13.604 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.604 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.604 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.604 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.491694+0000", 2023-09-30T17:04:13.604 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4070000000000001e-06 2023-09-30T17:04:13.604 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.604 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.605 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.605 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.605 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.605 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115708 4.38 4:1fc350da:::100000001f8.0000002f:head [write 3698688~4096 in=4096b,write 3858432~4096 in=4096b,write 3989504~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.605 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.597560+0000", 2023-09-30T17:04:13.605 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.195680299, 2023-09-30T17:04:13.605 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.20832959300000001, 2023-09-30T17:04:13.606 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.606 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:13.606 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.606 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.606 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.606 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115708 2023-09-30T17:04:13.606 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.606 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.606 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.606 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.607 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.597560+0000", 2023-09-30T17:04:13.607 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.607 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.607 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.607 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.607 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.597560+0000", 2023-09-30T17:04:13.607 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.607 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.607 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.607 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.607 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.597561+0000", 2023-09-30T17:04:13.608 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0200000000000002e-07 2023-09-30T17:04:13.608 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.608 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.608 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.608 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.597572+0000", 2023-09-30T17:04:13.608 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1639e-05 2023-09-30T17:04:13.608 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.608 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.608 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.608 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.597580+0000", 2023-09-30T17:04:13.608 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6009999999999997e-06 2023-09-30T17:04:13.608 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.609 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.609 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.609 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.597585+0000", 2023-09-30T17:04:13.609 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5369999999999997e-06 2023-09-30T17:04:13.609 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.609 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.609 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:13.609 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.760166+0000", 2023-09-30T17:04:13.609 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.162581004 2023-09-30T17:04:13.609 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.609 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.627 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:13.628 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.760244+0000", 2023-09-30T17:04:13.628 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7309000000000001e-05 2023-09-30T17:04:13.629 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.629 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.630 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.631 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115737 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.631 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.610607+0000", 2023-09-30T17:04:13.632 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.182633085, 2023-09-30T17:04:13.632 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.19533076299999999, 2023-09-30T17:04:13.633 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.633 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.633 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.633 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.633 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.634 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115737 2023-09-30T17:04:13.634 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.634 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.634 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.634 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.610607+0000", 2023-09-30T17:04:13.634 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.634 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.610607+0000", 2023-09-30T17:04:13.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.610608+0000", 2023-09-30T17:04:13.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2199999999999999e-07 2023-09-30T17:04:13.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.650 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.650 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.610621+0000", 2023-09-30T17:04:13.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2981e-05 2023-09-30T17:04:13.650 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.650 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.650 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.650 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.610628+0000", 2023-09-30T17:04:13.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7200000000000006e-06 2023-09-30T17:04:13.651 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.651 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.651 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.610633+0000", 2023-09-30T17:04:13.651 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8160000000000001e-06 2023-09-30T17:04:13.651 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.651 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.651 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.651 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.652 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.652 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115803 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.652 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.633747+0000", 2023-09-30T17:04:13.652 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.159493048, 2023-09-30T17:04:13.652 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.172225138, 2023-09-30T17:04:13.652 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.652 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.652 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.652 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.653 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.653 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115803 2023-09-30T17:04:13.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.653 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.653 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.653 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.633747+0000", 2023-09-30T17:04:13.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.654 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.633747+0000", 2023-09-30T17:04:13.654 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.654 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.655 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.633748+0000", 2023-09-30T17:04:13.655 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7500000000000001e-07 2023-09-30T17:04:13.655 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.655 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.655 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.655 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.633765+0000", 2023-09-30T17:04:13.655 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7798000000000001e-05 2023-09-30T17:04:13.655 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.655 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.655 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.655 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.633771+0000", 2023-09-30T17:04:13.656 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7950000000000004e-06 2023-09-30T17:04:13.656 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.656 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.656 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.656 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.633776+0000", 2023-09-30T17:04:13.656 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6829999999999999e-06 2023-09-30T17:04:13.656 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.656 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.656 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.656 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.656 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.657 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113588 4.6 e52/17 4:635f8cb4:::100000001f8.0000003c:head v 52'6969, mlcod=52'6943)", 2023-09-30T17:04:13.657 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.665962+0000", 2023-09-30T17:04:13.657 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.127278422, 2023-09-30T17:04:13.657 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.14004206199999999, 2023-09-30T17:04:13.657 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.657 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:13.657 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.665962+0000", 2023-09-30T17:04:13.658 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.658 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.665962+0000", 2023-09-30T17:04:13.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.659 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.659 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.659 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.665962+0000", 2023-09-30T17:04:13.660 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4299999999999999e-07 2023-09-30T17:04:13.662 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.663 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.663 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.664 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.665977+0000", 2023-09-30T17:04:13.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5036e-05 2023-09-30T17:04:13.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.664 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.664 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.665983+0000", 2023-09-30T17:04:13.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2609999999999999e-06 2023-09-30T17:04:13.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.665988+0000", 2023-09-30T17:04:13.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5709999999999999e-06 2023-09-30T17:04:13.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:13.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.801361+0000", 2023-09-30T17:04:13.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.13537260000000001 2023-09-30T17:04:13.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:13.666 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.801375+0000", 2023-09-30T17:04:13.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3957e-05 2023-09-30T17:04:13.666 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.666 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.666 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.666 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.666 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115884 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.666 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.680155+0000", 2023-09-30T17:04:13.666 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.113085561, 2023-09-30T17:04:13.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.125886937, 2023-09-30T17:04:13.667 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.667 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.667 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.667 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.667 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.667 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115884 2023-09-30T17:04:13.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.667 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.680155+0000", 2023-09-30T17:04:13.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.668 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.668 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.680155+0000", 2023-09-30T17:04:13.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.668 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.668 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.680155+0000", 2023-09-30T17:04:13.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4000000000000002e-07 2023-09-30T17:04:13.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.669 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.669 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.669 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.680173+0000", 2023-09-30T17:04:13.669 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7819e-05 2023-09-30T17:04:13.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.669 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.669 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.669 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.680180+0000", 2023-09-30T17:04:13.669 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8929999999999999e-06 2023-09-30T17:04:13.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.669 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.670 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.670 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.680185+0000", 2023-09-30T17:04:13.670 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1270000000000002e-06 2023-09-30T17:04:13.670 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.670 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.670 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.670 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.670 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.670 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113749 4.6 e52/17)", 2023-09-30T17:04:13.670 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.712985+0000", 2023-09-30T17:04:13.670 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.080254874000000004, 2023-09-30T17:04:13.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.093087383999999995, 2023-09-30T17:04:13.671 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.671 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.671 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.671 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.671 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.671 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.712985+0000", 2023-09-30T17:04:13.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.671 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.671 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.671 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.671 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.712985+0000", 2023-09-30T17:04:13.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.672 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.672 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.712986+0000", 2023-09-30T17:04:13.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2699999999999999e-07 2023-09-30T17:04:13.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.672 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.672 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.712997+0000", 2023-09-30T17:04:13.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0563e-05 2023-09-30T17:04:13.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.673 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.673 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.713003+0000", 2023-09-30T17:04:13.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7399999999999998e-06 2023-09-30T17:04:13.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.673 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.673 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.713008+0000", 2023-09-30T17:04:13.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0549999999999999e-06 2023-09-30T17:04:13.673 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.673 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.673 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.674 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116030 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.674 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.726629+0000", 2023-09-30T17:04:13.674 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.066611643999999998, 2023-09-30T17:04:13.674 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.079475024000000005, 2023-09-30T17:04:13.674 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.674 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.674 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.675 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.675 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.675 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116030 2023-09-30T17:04:13.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.675 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.675 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.675 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.726629+0000", 2023-09-30T17:04:13.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.675 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.726629+0000", 2023-09-30T17:04:13.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.726629+0000", 2023-09-30T17:04:13.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9699999999999996e-07 2023-09-30T17:04:13.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.677 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.726640+0000", 2023-09-30T17:04:13.677 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0886999999999999e-05 2023-09-30T17:04:13.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.677 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.677 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.726647+0000", 2023-09-30T17:04:13.677 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6429999999999998e-06 2023-09-30T17:04:13.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.677 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.678 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.726652+0000", 2023-09-30T17:04:13.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5090000000000001e-06 2023-09-30T17:04:13.678 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.678 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.678 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.678 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.678 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116052 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.678 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.738820+0000", 2023-09-30T17:04:13.678 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.054419980999999999, 2023-09-30T17:04:13.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.067316648000000007, 2023-09-30T17:04:13.679 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.679 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.679 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.679 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.679 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.679 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116052 2023-09-30T17:04:13.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.679 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.679 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.679 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.738820+0000", 2023-09-30T17:04:13.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.680 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.680 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.680 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.738820+0000", 2023-09-30T17:04:13.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.680 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.680 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.680 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.738821+0000", 2023-09-30T17:04:13.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5200000000000002e-07 2023-09-30T17:04:13.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.681 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.681 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.738833+0000", 2023-09-30T17:04:13.681 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2245999999999999e-05 2023-09-30T17:04:13.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.681 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.681 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.738839+0000", 2023-09-30T17:04:13.681 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1670000000000004e-06 2023-09-30T17:04:13.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.682 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.682 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.682 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.738845+0000", 2023-09-30T17:04:13.682 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3979999999999998e-06 2023-09-30T17:04:13.682 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.682 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.682 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.682 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.682 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.682 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113919 4.36 e52/17)", 2023-09-30T17:04:13.682 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.767924+0000", 2023-09-30T17:04:13.682 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.025316620000000001, 2023-09-30T17:04:13.683 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.038250136999999997, 2023-09-30T17:04:13.683 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.683 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.683 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.683 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.683 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.767924+0000", 2023-09-30T17:04:13.683 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.683 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.683 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.684 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.767924+0000", 2023-09-30T17:04:13.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.684 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.684 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.684 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.767925+0000", 2023-09-30T17:04:13.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9800000000000002e-07 2023-09-30T17:04:13.684 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.685 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.685 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.767940+0000", 2023-09-30T17:04:13.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5085e-05 2023-09-30T17:04:13.685 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.685 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.685 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.767949+0000", 2023-09-30T17:04:13.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5659999999999996e-06 2023-09-30T17:04:13.685 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.685 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.685 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.767954+0000", 2023-09-30T17:04:13.686 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8779999999999997e-06 2023-09-30T17:04:13.686 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.686 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.686 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.686 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.686 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.686 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116238 4.11 4:8b544b63:::100000001f8.0000002c:head [write 3874816~4096 in=4096b,write 3964928~4096 in=4096b,write 3981312~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.686 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.798571+0000", 2023-09-30T17:04:13.686 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9946694, 2023-09-30T17:04:13.686 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0076609219999999997, 2023-09-30T17:04:13.686 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.687 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:13.687 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.687 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.687 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.687 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116238 2023-09-30T17:04:13.687 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.687 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.687 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.687 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.687 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.798571+0000", 2023-09-30T17:04:13.687 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.687 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.688 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.688 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.688 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.798571+0000", 2023-09-30T17:04:13.688 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.688 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.688 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.688 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.688 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.798572+0000", 2023-09-30T17:04:13.688 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9299999999999998e-07 2023-09-30T17:04:13.688 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.688 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.688 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.689 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.798598+0000", 2023-09-30T17:04:13.689 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6106999999999999e-05 2023-09-30T17:04:13.689 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.689 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.689 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.798607+0000", 2023-09-30T17:04:13.700 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3260000000000002e-06 2023-09-30T17:04:13.700 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.701 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.701 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.701 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.798613+0000", 2023-09-30T17:04:13.701 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7089999999999999e-06 2023-09-30T17:04:13.701 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.701 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.701 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:13.701 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.798700+0000", 2023-09-30T17:04:13.701 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7264999999999999e-05 2023-09-30T17:04:13.701 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.701 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.701 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:13.702 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.798793+0000", 2023-09-30T17:04:13.702 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3012999999999999e-05 2023-09-30T17:04:13.702 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.702 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.702 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.702 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.702 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.702 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:114687 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.702 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.243572+0000", 2023-09-30T17:04:13.702 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.54966833800000003, 2023-09-30T17:04:13.702 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.56273490100000001, 2023-09-30T17:04:13.703 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.703 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.703 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.703 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.703 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.703 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 114687 2023-09-30T17:04:13.703 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.703 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.703 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.703 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.703 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.243572+0000", 2023-09-30T17:04:13.704 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.704 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.704 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.704 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.704 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.243572+0000", 2023-09-30T17:04:13.704 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.704 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.704 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.704 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.704 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.243572+0000", 2023-09-30T17:04:13.704 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.89e-07 2023-09-30T17:04:13.704 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.705 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.705 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.705 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.243587+0000", 2023-09-30T17:04:13.705 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4141000000000001e-05 2023-09-30T17:04:13.705 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.705 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.705 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.705 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.243593+0000", 2023-09-30T17:04:13.705 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3500000000000002e-06 2023-09-30T17:04:13.705 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.705 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.705 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.705 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.243598+0000", 2023-09-30T17:04:13.706 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0150000000000003e-06 2023-09-30T17:04:13.706 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.706 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.706 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.706 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.706 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.706 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:114813 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.706 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.285706+0000", 2023-09-30T17:04:13.707 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.50753381099999995, 2023-09-30T17:04:13.707 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.52066286399999995, 2023-09-30T17:04:13.707 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.707 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.707 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.707 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.707 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.707 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 114813 2023-09-30T17:04:13.707 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.707 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.707 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.707 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.708 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.285706+0000", 2023-09-30T17:04:13.708 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.708 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.708 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.708 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.708 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.285706+0000", 2023-09-30T17:04:13.708 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.708 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.708 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.708 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.708 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.285707+0000", 2023-09-30T17:04:13.709 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3999999999999998e-07 2023-09-30T17:04:13.709 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.709 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.709 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.709 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.285717+0000", 2023-09-30T17:04:13.709 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9350000000000006e-06 2023-09-30T17:04:13.709 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.709 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.709 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.709 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.285722+0000", 2023-09-30T17:04:13.709 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6729999999999997e-06 2023-09-30T17:04:13.709 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.710 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.710 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.710 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.285725+0000", 2023-09-30T17:04:13.710 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1039999999999998e-06 2023-09-30T17:04:13.710 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.710 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.710 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.710 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.710 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.710 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115306 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.711 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.440568+0000", 2023-09-30T17:04:13.711 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.35267251100000002, 2023-09-30T17:04:13.711 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.36587418700000002, 2023-09-30T17:04:13.711 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.711 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.711 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.711 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.711 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.711 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115306 2023-09-30T17:04:13.711 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.711 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.711 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.712 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.712 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.440568+0000", 2023-09-30T17:04:13.712 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.712 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.712 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.712 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.712 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.440568+0000", 2023-09-30T17:04:13.712 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.712 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.712 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.712 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.712 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.442515+0000", 2023-09-30T17:04:13.713 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019473890000000001 2023-09-30T17:04:13.713 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.713 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.713 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.713 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.442537+0000", 2023-09-30T17:04:13.713 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1787e-05 2023-09-30T17:04:13.713 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.713 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.713 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.713 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.442552+0000", 2023-09-30T17:04:13.713 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5041999999999999e-05 2023-09-30T17:04:13.714 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.714 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.714 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.714 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.442559+0000", 2023-09-30T17:04:13.714 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.72e-06 2023-09-30T17:04:13.714 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.714 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.714 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.741 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.741 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.741 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115926 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.741 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.693864+0000", 2023-09-30T17:04:13.741 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.099376223999999999, 2023-09-30T17:04:13.741 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.112641558, 2023-09-30T17:04:13.741 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.742 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.742 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.742 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.742 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.742 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115926 2023-09-30T17:04:13.742 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.742 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.742 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.742 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.742 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.693864+0000", 2023-09-30T17:04:13.742 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.743 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.743 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.743 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.743 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.693864+0000", 2023-09-30T17:04:13.743 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.743 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.743 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.743 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.743 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.693865+0000", 2023-09-30T17:04:13.743 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7299999999999995e-07 2023-09-30T17:04:13.743 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.744 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.744 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.693897+0000", 2023-09-30T17:04:13.744 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1881999999999997e-05 2023-09-30T17:04:13.744 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.744 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.744 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.693903+0000", 2023-09-30T17:04:13.744 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5849999999999996e-06 2023-09-30T17:04:13.744 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.745 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.745 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.693908+0000", 2023-09-30T17:04:13.745 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0849999999999996e-06 2023-09-30T17:04:13.745 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.745 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.745 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.745 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.745 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.745 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116060 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.745 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.738851+0000", 2023-09-30T17:04:13.745 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.054389049000000002, 2023-09-30T17:04:13.746 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.067728722000000005, 2023-09-30T17:04:13.746 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.746 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.746 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.746 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.746 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.746 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116060 2023-09-30T17:04:13.746 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.746 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.746 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.746 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.747 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.738851+0000", 2023-09-30T17:04:13.747 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.747 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.747 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.747 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.747 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.738851+0000", 2023-09-30T17:04:13.747 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.747 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.747 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.747 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.747 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.738852+0000", 2023-09-30T17:04:13.747 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0900000000000002e-07 2023-09-30T17:04:13.748 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.748 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.748 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.748 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.738864+0000", 2023-09-30T17:04:13.748 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2231e-05 2023-09-30T17:04:13.748 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.748 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.748 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.748 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.738870+0000", 2023-09-30T17:04:13.748 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3690000000000003e-06 2023-09-30T17:04:13.748 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.749 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.749 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.749 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.738877+0000", 2023-09-30T17:04:13.749 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3029999999999996e-06 2023-09-30T17:04:13.749 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.749 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.749 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.749 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.749 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.749 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113874 4.6 e52/17)", 2023-09-30T17:04:13.749 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.754701+0000", 2023-09-30T17:04:13.750 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.038539233999999999, 2023-09-30T17:04:13.758 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051930951000000003, 2023-09-30T17:04:13.758 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.758 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.758 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.758 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.758 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.758 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.754701+0000", 2023-09-30T17:04:13.758 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.759 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.759 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.759 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.759 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.754701+0000", 2023-09-30T17:04:13.759 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.759 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.759 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.760 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.760 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.754701+0000", 2023-09-30T17:04:13.760 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1899999999999999e-07 2023-09-30T17:04:13.760 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.760 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.760 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.761 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.754715+0000", 2023-09-30T17:04:13.761 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3431999999999999e-05 2023-09-30T17:04:13.761 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.761 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.761 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.761 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.754721+0000", 2023-09-30T17:04:13.761 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8730000000000004e-06 2023-09-30T17:04:13.761 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.761 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.761 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.761 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.754725+0000", 2023-09-30T17:04:13.761 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3710000000000002e-06 2023-09-30T17:04:13.762 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.762 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.762 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.762 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.762 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.762 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113901 4.6 e52/17)", 2023-09-30T17:04:13.762 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.767963+0000", 2023-09-30T17:04:13.762 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.025277363000000001, 2023-09-30T17:04:13.762 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.038713102999999999, 2023-09-30T17:04:13.762 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.762 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.763 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.763 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.763 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.763 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.767963+0000", 2023-09-30T17:04:13.763 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.763 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.763 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.763 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.763 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.767963+0000", 2023-09-30T17:04:13.763 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.763 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.764 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.764 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.764 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.767963+0000", 2023-09-30T17:04:13.764 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0200000000000001e-07 2023-09-30T17:04:13.764 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.764 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.764 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.764 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.767974+0000", 2023-09-30T17:04:13.764 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0896e-05 2023-09-30T17:04:13.764 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.764 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.765 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.765 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.767979+0000", 2023-09-30T17:04:13.765 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4669999999999998e-06 2023-09-30T17:04:13.765 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.765 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.765 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.765 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.767982+0000", 2023-09-30T17:04:13.765 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.382e-06 2023-09-30T17:04:13.765 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.765 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.766 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.766 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.766 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.766 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116239 4.1b 4:dbd503eb:::100000001f8.0000002e:head [write 901120~4096 in=4096b,write 913408~4096 in=4096b,write 974848~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.766 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.798624+0000", 2023-09-30T17:04:13.766 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9946165, 2023-09-30T17:04:13.766 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0081062559999999992, 2023-09-30T17:04:13.766 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.766 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:13.766 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.767 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.767 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.767 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116239 2023-09-30T17:04:13.767 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.767 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.767 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.767 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.767 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.798624+0000", 2023-09-30T17:04:13.767 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.767 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.767 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.767 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.768 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.798624+0000", 2023-09-30T17:04:13.768 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.768 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.768 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.768 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.768 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.798624+0000", 2023-09-30T17:04:13.768 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4000000000000002e-07 2023-09-30T17:04:13.768 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.768 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.768 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.768 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.798635+0000", 2023-09-30T17:04:13.769 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1127e-05 2023-09-30T17:04:13.769 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.769 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.769 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.769 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.798643+0000", 2023-09-30T17:04:13.769 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4309999999999997e-06 2023-09-30T17:04:13.772 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.772 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.772 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.772 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.798648+0000", 2023-09-30T17:04:13.773 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.921e-06 2023-09-30T17:04:13.773 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.773 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.773 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:13.773 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.799120+0000", 2023-09-30T17:04:13.773 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000471908 2023-09-30T17:04:13.773 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.773 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.773 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:13.773 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.799198+0000", 2023-09-30T17:04:13.773 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8541999999999994e-05 2023-09-30T17:04:13.774 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.774 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.774 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.774 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.774 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.774 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:114689 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.774 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.243605+0000", 2023-09-30T17:04:13.774 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.549635647, 2023-09-30T17:04:13.774 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.56318945399999998, 2023-09-30T17:04:13.774 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.774 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.775 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.775 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.775 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.775 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 114689 2023-09-30T17:04:13.775 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.775 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.775 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.775 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.775 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.243605+0000", 2023-09-30T17:04:13.775 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.775 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.776 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.776 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.776 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.243605+0000", 2023-09-30T17:04:13.776 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.776 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.776 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.776 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.776 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.243605+0000", 2023-09-30T17:04:13.776 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7099999999999997e-07 2023-09-30T17:04:13.776 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.776 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.777 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.777 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.243617+0000", 2023-09-30T17:04:13.777 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2303999999999999e-05 2023-09-30T17:04:13.777 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.777 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.777 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.777 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.243623+0000", 2023-09-30T17:04:13.777 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0700000000000003e-06 2023-09-30T17:04:13.777 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.777 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.778 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.778 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.243628+0000", 2023-09-30T17:04:13.778 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7539999999999997e-06 2023-09-30T17:04:13.778 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.778 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.778 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.778 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.778 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.778 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:114815 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.778 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.285730+0000", 2023-09-30T17:04:13.778 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.50751021500000004, 2023-09-30T17:04:13.778 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.52111749600000001, 2023-09-30T17:04:13.779 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.779 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.779 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.779 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.779 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.779 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 114815 2023-09-30T17:04:13.779 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.779 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.779 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.779 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.779 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.285730+0000", 2023-09-30T17:04:13.780 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.780 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.780 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.780 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.780 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.285730+0000", 2023-09-30T17:04:13.780 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.780 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.780 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.780 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.780 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.285730+0000", 2023-09-30T17:04:13.780 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2600000000000001e-07 2023-09-30T17:04:13.780 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.781 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.781 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.781 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.285738+0000", 2023-09-30T17:04:13.793 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7859999999999997e-06 2023-09-30T17:04:13.793 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.793 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.793 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.793 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.285743+0000", 2023-09-30T17:04:13.793 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9300000000000002e-06 2023-09-30T17:04:13.794 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.794 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.794 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.794 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.285746+0000", 2023-09-30T17:04:13.794 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9679999999999998e-06 2023-09-30T17:04:13.794 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.794 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.794 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.794 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.794 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.794 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115077 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.795 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.363981+0000", 2023-09-30T17:04:13.795 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.42925903599999998, 2023-09-30T17:04:13.795 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.44291860999999999, 2023-09-30T17:04:13.795 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.795 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.795 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.795 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.795 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.795 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115077 2023-09-30T17:04:13.795 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.795 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.795 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.796 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.796 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.363981+0000", 2023-09-30T17:04:13.796 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.796 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.796 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.796 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.796 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.363981+0000", 2023-09-30T17:04:13.796 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.796 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.796 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.796 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.797 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.363982+0000", 2023-09-30T17:04:13.797 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3000000000000001e-07 2023-09-30T17:04:13.797 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.797 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.797 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.797 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.363993+0000", 2023-09-30T17:04:13.797 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1229999999999999e-05 2023-09-30T17:04:13.797 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.797 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.797 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.797 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.364000+0000", 2023-09-30T17:04:13.798 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3019999999999997e-06 2023-09-30T17:04:13.798 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.798 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.798 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.798 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.364006+0000", 2023-09-30T17:04:13.798 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3290000000000001e-06 2023-09-30T17:04:13.798 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.798 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.798 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.798 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.798 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.799 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115159 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.799 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.387411+0000", 2023-09-30T17:04:13.799 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.40582890100000002, 2023-09-30T17:04:13.799 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.41954228399999999, 2023-09-30T17:04:13.799 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.799 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.799 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.799 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.799 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.799 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115159 2023-09-30T17:04:13.799 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.800 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.800 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.800 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.800 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.387411+0000", 2023-09-30T17:04:13.800 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.800 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.800 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.800 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.800 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.387411+0000", 2023-09-30T17:04:13.800 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.801 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.801 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.801 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.801 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.390515+0000", 2023-09-30T17:04:13.801 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003103845 2023-09-30T17:04:13.801 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.801 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.801 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.801 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.390532+0000", 2023-09-30T17:04:13.801 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6293000000000001e-05 2023-09-30T17:04:13.801 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.802 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.802 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.802 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.390540+0000", 2023-09-30T17:04:13.802 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7560000000000005e-06 2023-09-30T17:04:13.802 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.802 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.802 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.802 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.390547+0000", 2023-09-30T17:04:13.802 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9269999999999999e-06 2023-09-30T17:04:13.802 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.803 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.803 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.803 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.803 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.803 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115308 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.803 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.442576+0000", 2023-09-30T17:04:13.803 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.35066456000000001, 2023-09-30T17:04:13.803 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.36443042799999997, 2023-09-30T17:04:13.803 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.803 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.803 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.803 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.815 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.815 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115308 2023-09-30T17:04:13.816 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.816 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.816 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.816 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.816 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.442576+0000", 2023-09-30T17:04:13.816 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.816 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.816 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.816 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.816 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.442576+0000", 2023-09-30T17:04:13.816 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.817 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.817 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.817 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.817 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.442576+0000", 2023-09-30T17:04:13.817 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8899999999999999e-07 2023-09-30T17:04:13.817 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.817 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.817 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.817 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.442601+0000", 2023-09-30T17:04:13.817 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4827000000000001e-05 2023-09-30T17:04:13.818 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.818 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.818 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.818 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.442630+0000", 2023-09-30T17:04:13.818 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9108e-05 2023-09-30T17:04:13.818 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.818 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.818 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.818 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.442645+0000", 2023-09-30T17:04:13.818 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4972e-05 2023-09-30T17:04:13.818 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.819 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.819 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.819 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.819 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.819 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115344 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.819 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.454571+0000", 2023-09-30T17:04:13.819 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.33866908400000001, 2023-09-30T17:04:13.819 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.35249140099999998, 2023-09-30T17:04:13.819 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.819 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.819 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.820 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.820 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.820 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115344 2023-09-30T17:04:13.820 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.820 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.820 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.820 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.820 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.454571+0000", 2023-09-30T17:04:13.820 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.820 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.820 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.820 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.820 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.454571+0000", 2023-09-30T17:04:13.821 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.821 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.821 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.821 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.821 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.456516+0000", 2023-09-30T17:04:13.821 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001944774 2023-09-30T17:04:13.821 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.821 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.821 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.821 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.456531+0000", 2023-09-30T17:04:13.821 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4759999999999999e-05 2023-09-30T17:04:13.822 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.822 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.822 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.822 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.456542+0000", 2023-09-30T17:04:13.822 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0892e-05 2023-09-30T17:04:13.822 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.822 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.822 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.822 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.456549+0000", 2023-09-30T17:04:13.822 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0060000000000003e-06 2023-09-30T17:04:13.822 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.823 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.825 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.825 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.825 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115370 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.825 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.471330+0000", 2023-09-30T17:04:13.826 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.32190991800000002, 2023-09-30T17:04:13.826 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.33578502700000001, 2023-09-30T17:04:13.826 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.826 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.826 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.826 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.826 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.826 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115370 2023-09-30T17:04:13.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.826 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.826 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.827 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.827 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.471330+0000", 2023-09-30T17:04:13.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.827 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.827 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.827 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.827 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.471330+0000", 2023-09-30T17:04:13.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.827 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.827 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.827 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.827 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.471331+0000", 2023-09-30T17:04:13.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3500000000000002e-07 2023-09-30T17:04:13.828 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.828 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.828 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.828 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.471341+0000", 2023-09-30T17:04:13.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0445000000000001e-05 2023-09-30T17:04:13.828 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.828 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.828 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.828 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.471348+0000", 2023-09-30T17:04:13.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8789999999999997e-06 2023-09-30T17:04:13.828 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.829 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.829 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.471353+0000", 2023-09-30T17:04:13.829 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7779999999999998e-06 2023-09-30T17:04:13.829 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.829 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.829 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.829 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.829 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115437 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.829 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.491703+0000", 2023-09-30T17:04:13.830 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.30153755100000001, 2023-09-30T17:04:13.830 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.31546742900000002, 2023-09-30T17:04:13.830 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.830 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.830 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.830 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.830 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.830 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115437 2023-09-30T17:04:13.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.830 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.830 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.831 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.831 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.491703+0000", 2023-09-30T17:04:13.831 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.831 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.831 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.831 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.831 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.491703+0000", 2023-09-30T17:04:13.831 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.831 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.831 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.831 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.831 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.493517+0000", 2023-09-30T17:04:13.832 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001814291 2023-09-30T17:04:13.832 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.832 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.832 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.832 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.493537+0000", 2023-09-30T17:04:13.832 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9474999999999999e-05 2023-09-30T17:04:13.832 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.832 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.832 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.832 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.493546+0000", 2023-09-30T17:04:13.832 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4930000000000004e-06 2023-09-30T17:04:13.833 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.833 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.833 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.833 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.493553+0000", 2023-09-30T17:04:13.833 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6359999999999997e-06 2023-09-30T17:04:13.833 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.833 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.833 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.833 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.833 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.833 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115463 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.834 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.500249+0000", 2023-09-30T17:04:13.834 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.29299111500000002, 2023-09-30T17:04:13.834 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.30697255299999998, 2023-09-30T17:04:13.834 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.834 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.834 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.834 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.834 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.834 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115463 2023-09-30T17:04:13.834 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.834 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.835 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.835 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.835 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.500249+0000", 2023-09-30T17:04:13.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.835 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.835 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.835 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.835 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.500249+0000", 2023-09-30T17:04:13.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.835 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.835 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.836 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.836 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.500250+0000", 2023-09-30T17:04:13.836 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1300000000000001e-07 2023-09-30T17:04:13.836 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.836 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.836 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.836 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.500261+0000", 2023-09-30T17:04:13.836 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1029999999999999e-05 2023-09-30T17:04:13.836 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.836 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.836 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.837 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.500266+0000", 2023-09-30T17:04:13.837 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7869999999999998e-06 2023-09-30T17:04:13.837 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.837 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.837 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.837 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.500272+0000", 2023-09-30T17:04:13.837 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.186e-06 2023-09-30T17:04:13.837 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.837 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.837 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.837 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.837 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.838 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116114 4.38 4.9b7e3478 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.838 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.746558+0000", 2023-09-30T17:04:13.838 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.046682424, 2023-09-30T17:04:13.838 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.060719977000000001, 2023-09-30T17:04:13.838 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.838 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.838 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.838 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.838 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.838 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116114 2023-09-30T17:04:13.839 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.839 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.839 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.839 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.839 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.746558+0000", 2023-09-30T17:04:13.839 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.839 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.839 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.839 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.839 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.746558+0000", 2023-09-30T17:04:13.839 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.839 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.840 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.840 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.840 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.754737+0000", 2023-09-30T17:04:13.840 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0081790509999999997 2023-09-30T17:04:13.840 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.840 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.840 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.840 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.754752+0000", 2023-09-30T17:04:13.840 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4983e-05 2023-09-30T17:04:13.840 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.840 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.841 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.841 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.754759+0000", 2023-09-30T17:04:13.841 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1040000000000001e-06 2023-09-30T17:04:13.841 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.841 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.841 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.841 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.754765+0000", 2023-09-30T17:04:13.841 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8919999999999997e-06 2023-09-30T17:04:13.841 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.841 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.841 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.841 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.842 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.842 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116240 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.842 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.798655+0000", 2023-09-30T17:04:13.842 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9945855, 2023-09-30T17:04:13.842 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0086838950000000005, 2023-09-30T17:04:13.842 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.842 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.842 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.842 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.842 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.842 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116240 2023-09-30T17:04:13.842 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.843 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.843 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.843 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.843 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.798655+0000", 2023-09-30T17:04:13.843 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.843 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.843 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.843 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.843 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.798655+0000", 2023-09-30T17:04:13.843 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.843 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.843 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.844 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.844 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.798655+0000", 2023-09-30T17:04:13.844 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5100000000000001e-07 2023-09-30T17:04:13.844 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.844 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.844 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.844 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.798677+0000", 2023-09-30T17:04:13.844 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1956000000000001e-05 2023-09-30T17:04:13.844 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.844 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.844 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.845 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.798683+0000", 2023-09-30T17:04:13.845 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3119999999999999e-06 2023-09-30T17:04:13.845 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.845 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.845 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.845 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.798690+0000", 2023-09-30T17:04:13.845 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.489e-06 2023-09-30T17:04:13.845 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.845 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.845 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.845 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.845 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.846 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:114690 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.846 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.243634+0000", 2023-09-30T17:04:13.846 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.54960636699999998, 2023-09-30T17:04:13.846 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.56375818099999997, 2023-09-30T17:04:13.846 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.846 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.846 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.846 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.846 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.846 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 114690 2023-09-30T17:04:13.846 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.847 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.847 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.847 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.847 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.243634+0000", 2023-09-30T17:04:13.847 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.847 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.847 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.847 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.847 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.243634+0000", 2023-09-30T17:04:13.847 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.847 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.848 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.848 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.848 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.243634+0000", 2023-09-30T17:04:13.848 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5499999999999999e-07 2023-09-30T17:04:13.848 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.848 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.848 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.848 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.243643+0000", 2023-09-30T17:04:13.848 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7199999999999995e-06 2023-09-30T17:04:13.848 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.848 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.848 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.849 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.243649+0000", 2023-09-30T17:04:13.849 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8000000000000004e-06 2023-09-30T17:04:13.849 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.849 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.849 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.849 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.243654+0000", 2023-09-30T17:04:13.849 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8380000000000001e-06 2023-09-30T17:04:13.849 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.849 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.849 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.849 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.850 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.850 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115346 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.850 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.456561+0000", 2023-09-30T17:04:13.850 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.33667975900000002, 2023-09-30T17:04:13.850 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.35121259599999999, 2023-09-30T17:04:13.850 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.850 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.850 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.850 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.850 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.850 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115346 2023-09-30T17:04:13.851 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.851 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.851 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.851 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.851 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.456561+0000", 2023-09-30T17:04:13.851 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.851 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.851 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.851 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.851 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.456561+0000", 2023-09-30T17:04:13.851 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.851 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.852 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.852 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.852 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.456561+0000", 2023-09-30T17:04:13.852 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8999999999999997e-07 2023-09-30T17:04:13.852 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.852 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.852 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.852 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.456572+0000", 2023-09-30T17:04:13.852 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0473e-05 2023-09-30T17:04:13.852 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.852 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.852 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.853 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.456578+0000", 2023-09-30T17:04:13.853 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6599999999999998e-06 2023-09-30T17:04:13.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.853 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.853 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.853 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.456583+0000", 2023-09-30T17:04:13.853 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0889999999999999e-06 2023-09-30T17:04:13.853 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.853 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.853 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.853 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.854 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115553 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.854 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.537837+0000", 2023-09-30T17:04:13.854 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.25540313799999997, 2023-09-30T17:04:13.854 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.26998828699999999, 2023-09-30T17:04:13.854 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.854 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.854 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.854 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.854 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.854 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115553 2023-09-30T17:04:13.854 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.855 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.855 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.855 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.855 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.537837+0000", 2023-09-30T17:04:13.855 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.855 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.855 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.855 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.855 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.537837+0000", 2023-09-30T17:04:13.855 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.855 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.856 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.856 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.856 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.539517+0000", 2023-09-30T17:04:13.856 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0016799009999999999 2023-09-30T17:04:13.856 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.856 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.856 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.856 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.539532+0000", 2023-09-30T17:04:13.856 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4585e-05 2023-09-30T17:04:13.856 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.856 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.856 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.539547+0000", 2023-09-30T17:04:13.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5333999999999999e-05 2023-09-30T17:04:13.857 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.857 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.539555+0000", 2023-09-30T17:04:13.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6539999999999999e-06 2023-09-30T17:04:13.857 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.857 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.857 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.857 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.858 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.858 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115826 4.38 4.9b7e3478 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.858 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.651605+0000", 2023-09-30T17:04:13.858 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.14163572399999999, 2023-09-30T17:04:13.858 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.156275109, 2023-09-30T17:04:13.858 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.858 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.858 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.858 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.858 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.858 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115826 2023-09-30T17:04:13.858 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.859 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.859 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.859 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.859 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.651605+0000", 2023-09-30T17:04:13.859 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.859 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.859 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.859 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.859 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.651605+0000", 2023-09-30T17:04:13.859 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.859 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.860 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.860 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.860 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.651605+0000", 2023-09-30T17:04:13.860 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2900000000000003e-07 2023-09-30T17:04:13.860 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.860 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.860 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.860 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.651617+0000", 2023-09-30T17:04:13.860 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1358e-05 2023-09-30T17:04:13.860 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.860 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.860 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.861 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.651623+0000", 2023-09-30T17:04:13.861 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.241e-06 2023-09-30T17:04:13.861 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.861 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.861 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.861 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.651628+0000", 2023-09-30T17:04:13.861 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8570000000000003e-06 2023-09-30T17:04:13.861 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.861 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.861 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.861 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.861 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.862 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113637 4.6 e52/17)", 2023-09-30T17:04:13.862 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.680590+0000", 2023-09-30T17:04:13.862 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.11265003799999999, 2023-09-30T17:04:13.862 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.12733988099999999, 2023-09-30T17:04:13.862 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.862 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.862 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.862 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.862 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.862 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.680590+0000", 2023-09-30T17:04:13.862 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.862 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.863 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.863 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.863 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.680590+0000", 2023-09-30T17:04:13.863 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.863 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.863 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.863 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.863 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.680591+0000", 2023-09-30T17:04:13.863 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1199999999999998e-07 2023-09-30T17:04:13.863 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.863 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.864 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.864 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.680614+0000", 2023-09-30T17:04:13.864 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3813000000000001e-05 2023-09-30T17:04:13.864 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.864 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.864 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.680623+0000", 2023-09-30T17:04:13.864 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1610000000000003e-06 2023-09-30T17:04:13.864 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.864 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.864 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.680628+0000", 2023-09-30T17:04:13.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0889999999999999e-06 2023-09-30T17:04:13.865 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.865 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.865 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.865 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.865 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.865 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113751 4.6 e52/17)", 2023-09-30T17:04:13.865 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.716331+0000", 2023-09-30T17:04:13.865 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.076908913999999995, 2023-09-30T17:04:13.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.091645573999999994, 2023-09-30T17:04:13.865 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.866 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.866 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.866 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.866 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.866 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.716331+0000", 2023-09-30T17:04:13.866 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.866 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.866 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.866 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.866 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.716331+0000", 2023-09-30T17:04:13.866 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.867 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.867 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.867 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.867 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.716332+0000", 2023-09-30T17:04:13.867 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8400000000000004e-07 2023-09-30T17:04:13.867 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.867 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.867 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.867 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.716345+0000", 2023-09-30T17:04:13.867 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3077e-05 2023-09-30T17:04:13.867 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.868 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.716395+0000", 2023-09-30T17:04:13.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0318000000000002e-05 2023-09-30T17:04:13.868 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.868 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.716403+0000", 2023-09-30T17:04:13.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.661e-06 2023-09-30T17:04:13.868 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.868 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.868 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.869 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116034 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.869 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.728594+0000", 2023-09-30T17:04:13.869 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.064646675000000001, 2023-09-30T17:04:13.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.079430438000000006, 2023-09-30T17:04:13.869 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.869 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.869 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.869 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.869 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.870 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116034 2023-09-30T17:04:13.870 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.870 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.870 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.870 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.728594+0000", 2023-09-30T17:04:13.870 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.870 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.870 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.870 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.728594+0000", 2023-09-30T17:04:13.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.871 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.871 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.871 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.871 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.728595+0000", 2023-09-30T17:04:13.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.403e-06 2023-09-30T17:04:13.871 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.871 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.871 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.871 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.728627+0000", 2023-09-30T17:04:13.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2048999999999998e-05 2023-09-30T17:04:13.871 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.872 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.728637+0000", 2023-09-30T17:04:13.872 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0081999999999999e-05 2023-09-30T17:04:13.872 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.872 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.728643+0000", 2023-09-30T17:04:13.872 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5450000000000003e-06 2023-09-30T17:04:13.872 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.872 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.872 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.873 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.873 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.873 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116062 4.38 4.9b7e3478 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.873 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.738920+0000", 2023-09-30T17:04:13.873 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.054320172, 2023-09-30T17:04:13.873 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.069159483999999993, 2023-09-30T17:04:13.873 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.873 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.873 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.873 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.873 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.874 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116062 2023-09-30T17:04:13.874 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.874 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.874 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.874 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.874 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.738920+0000", 2023-09-30T17:04:13.874 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.874 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.874 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.874 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.874 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.738920+0000", 2023-09-30T17:04:13.875 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.875 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.875 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.875 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.875 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.738921+0000", 2023-09-30T17:04:13.875 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0500000000000004e-07 2023-09-30T17:04:13.892 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.892 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.892 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.893 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.738933+0000", 2023-09-30T17:04:13.893 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2745000000000001e-05 2023-09-30T17:04:13.893 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.893 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.893 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.893 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.738940+0000", 2023-09-30T17:04:13.893 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7580000000000003e-06 2023-09-30T17:04:13.893 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.893 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.893 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.893 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.738945+0000", 2023-09-30T17:04:13.893 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9830000000000004e-06 2023-09-30T17:04:13.894 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.894 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.894 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.894 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.894 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.894 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:114743 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.894 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.260611+0000", 2023-09-30T17:04:13.894 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.53262884300000002, 2023-09-30T17:04:13.894 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.54752637999999998, 2023-09-30T17:04:13.894 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.894 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.895 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.895 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.895 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.895 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 114743 2023-09-30T17:04:13.895 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.895 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.895 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.895 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.895 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.260611+0000", 2023-09-30T17:04:13.895 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.896 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.896 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.896 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.896 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.260611+0000", 2023-09-30T17:04:13.896 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.896 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.896 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.896 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.896 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.260612+0000", 2023-09-30T17:04:13.896 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.72e-07 2023-09-30T17:04:13.896 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.897 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.897 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.897 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.260624+0000", 2023-09-30T17:04:13.897 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2653000000000001e-05 2023-09-30T17:04:13.897 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.897 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.897 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.897 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.260631+0000", 2023-09-30T17:04:13.897 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0249999999999999e-06 2023-09-30T17:04:13.897 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.897 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.897 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.898 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.262712+0000", 2023-09-30T17:04:13.898 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0020815579999999998 2023-09-30T17:04:13.898 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.898 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.898 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.898 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.898 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.898 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:114894 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.898 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.311566+0000", 2023-09-30T17:04:13.898 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.48167447499999999, 2023-09-30T17:04:13.898 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.496626024, 2023-09-30T17:04:13.899 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.899 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.899 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.899 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.899 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.899 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 114894 2023-09-30T17:04:13.899 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.899 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.899 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.899 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.899 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.311566+0000", 2023-09-30T17:04:13.900 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.900 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.900 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.900 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.900 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.311566+0000", 2023-09-30T17:04:13.900 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.900 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.900 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.900 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.900 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.311566+0000", 2023-09-30T17:04:13.900 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0200000000000002e-07 2023-09-30T17:04:13.900 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.901 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.901 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.901 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.311578+0000", 2023-09-30T17:04:13.901 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1821000000000001e-05 2023-09-30T17:04:13.901 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.901 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.901 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.901 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.311586+0000", 2023-09-30T17:04:13.901 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2849999999999995e-06 2023-09-30T17:04:13.901 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.901 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.901 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.902 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.311592+0000", 2023-09-30T17:04:13.902 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3639999999999998e-06 2023-09-30T17:04:13.902 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.902 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.902 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.902 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.902 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.902 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115025 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.902 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.340542+0000", 2023-09-30T17:04:13.902 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.45269837600000001, 2023-09-30T17:04:13.902 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.46770732599999998, 2023-09-30T17:04:13.903 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.903 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.903 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.903 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.903 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.903 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115025 2023-09-30T17:04:13.903 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.903 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.903 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.903 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.903 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.340542+0000", 2023-09-30T17:04:13.903 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.904 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.904 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.904 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.904 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.340542+0000", 2023-09-30T17:04:13.904 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.904 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.904 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.904 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.904 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.340542+0000", 2023-09-30T17:04:13.904 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3200000000000001e-07 2023-09-30T17:04:13.904 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.904 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.905 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.905 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.340553+0000", 2023-09-30T17:04:13.905 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0509999999999999e-05 2023-09-30T17:04:13.905 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.905 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.905 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.905 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.340558+0000", 2023-09-30T17:04:13.905 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.446e-06 2023-09-30T17:04:13.905 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.905 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.906 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.906 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.340563+0000", 2023-09-30T17:04:13.906 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5340000000000001e-06 2023-09-30T17:04:13.906 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.906 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.906 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.906 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.906 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.906 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115056 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.906 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.352082+0000", 2023-09-30T17:04:13.906 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.441158206, 2023-09-30T17:04:13.907 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.45622580000000001, 2023-09-30T17:04:13.907 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.907 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.907 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.907 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.907 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.907 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115056 2023-09-30T17:04:13.907 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.907 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.907 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.907 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.908 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.352082+0000", 2023-09-30T17:04:13.908 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.908 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.908 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.908 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.908 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.352082+0000", 2023-09-30T17:04:13.908 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.908 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.908 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.908 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.908 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.355516+0000", 2023-09-30T17:04:13.909 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0034336940000000002 2023-09-30T17:04:13.909 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.909 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.909 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.909 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.355537+0000", 2023-09-30T17:04:13.909 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1242000000000001e-05 2023-09-30T17:04:13.909 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.909 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.909 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.909 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.355547+0000", 2023-09-30T17:04:13.909 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0125999999999999e-05 2023-09-30T17:04:13.909 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.910 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.910 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.910 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.355555+0000", 2023-09-30T17:04:13.910 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6890000000000004e-06 2023-09-30T17:04:13.910 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.910 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.910 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.910 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.910 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.910 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115348 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.910 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.456590+0000", 2023-09-30T17:04:13.911 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.33665059899999999, 2023-09-30T17:04:13.911 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.35178119099999999, 2023-09-30T17:04:13.911 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.911 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.911 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.911 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.911 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.911 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115348 2023-09-30T17:04:13.911 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.911 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.911 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.911 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.911 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.456590+0000", 2023-09-30T17:04:13.912 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.912 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.912 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.912 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.912 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.456590+0000", 2023-09-30T17:04:13.912 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.912 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.912 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.912 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.912 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.456590+0000", 2023-09-30T17:04:13.912 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3099999999999999e-07 2023-09-30T17:04:13.912 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.913 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.913 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.913 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.456606+0000", 2023-09-30T17:04:13.913 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5855e-05 2023-09-30T17:04:13.913 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.913 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.913 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.913 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.456612+0000", 2023-09-30T17:04:13.913 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8329999999999999e-06 2023-09-30T17:04:13.913 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.913 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.913 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.914 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.456616+0000", 2023-09-30T17:04:13.914 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7330000000000003e-06 2023-09-30T17:04:13.914 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.914 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.914 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.914 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.914 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.914 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115375 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.914 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.471413+0000", 2023-09-30T17:04:13.914 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.32182734200000002, 2023-09-30T17:04:13.914 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.33701790999999998, 2023-09-30T17:04:13.915 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.915 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.915 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.915 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.915 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.915 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115375 2023-09-30T17:04:13.915 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.915 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.915 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.915 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.915 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.471413+0000", 2023-09-30T17:04:13.916 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.916 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.916 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.916 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.916 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.471413+0000", 2023-09-30T17:04:13.916 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.916 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.916 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.916 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.916 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.471414+0000", 2023-09-30T17:04:13.916 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5899999999999996e-07 2023-09-30T17:04:13.917 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.917 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.917 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.917 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.471427+0000", 2023-09-30T17:04:13.917 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3817e-05 2023-09-30T17:04:13.917 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.917 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.917 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.917 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.471434+0000", 2023-09-30T17:04:13.917 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5540000000000003e-06 2023-09-30T17:04:13.917 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.918 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.918 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.918 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.471439+0000", 2023-09-30T17:04:13.918 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8289999999999998e-06 2023-09-30T17:04:13.918 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.918 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.918 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.918 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.918 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.918 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115554 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.918 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.539567+0000", 2023-09-30T17:04:13.919 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.25367369299999998, 2023-09-30T17:04:13.919 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.268927939, 2023-09-30T17:04:13.919 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.919 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.919 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.919 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.919 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.919 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115554 2023-09-30T17:04:13.919 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.919 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.919 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.919 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.920 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.539567+0000", 2023-09-30T17:04:13.920 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.920 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.920 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.920 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.920 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.539567+0000", 2023-09-30T17:04:13.920 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.920 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.920 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.920 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.920 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.539567+0000", 2023-09-30T17:04:13.920 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2499999999999995e-07 2023-09-30T17:04:13.921 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.921 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.921 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.921 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.539580+0000", 2023-09-30T17:04:13.921 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.322e-05 2023-09-30T17:04:13.921 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.921 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.921 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.921 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.539589+0000", 2023-09-30T17:04:13.921 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0569999999999999e-06 2023-09-30T17:04:13.921 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.922 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.922 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.922 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.539596+0000", 2023-09-30T17:04:13.922 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9700000000000002e-06 2023-09-30T17:04:13.922 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.922 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.922 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.922 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.922 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.922 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115831 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.922 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.651634+0000", 2023-09-30T17:04:13.923 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.14160621400000001, 2023-09-30T17:04:13.923 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.15692837600000001, 2023-09-30T17:04:13.923 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.923 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.923 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.923 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.923 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.923 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115831 2023-09-30T17:04:13.923 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.923 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.923 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.923 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.924 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.651634+0000", 2023-09-30T17:04:13.924 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.924 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.924 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.924 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.924 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.651634+0000", 2023-09-30T17:04:13.924 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.924 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.924 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.924 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.924 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.651635+0000", 2023-09-30T17:04:13.924 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4799999999999998e-07 2023-09-30T17:04:13.925 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.925 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.925 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.925 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.651645+0000", 2023-09-30T17:04:13.925 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9170000000000001e-06 2023-09-30T17:04:13.925 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.925 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.925 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.925 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.651650+0000", 2023-09-30T17:04:13.925 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6829999999999996e-06 2023-09-30T17:04:13.926 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.926 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.926 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.926 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.651655+0000", 2023-09-30T17:04:13.926 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5800000000000002e-06 2023-09-30T17:04:13.926 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.926 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.926 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.926 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.926 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.926 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113635 4.36 e52/17)", 2023-09-30T17:04:13.927 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.680636+0000", 2023-09-30T17:04:13.927 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.112604683, 2023-09-30T17:04:13.927 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.12799148499999999, 2023-09-30T17:04:13.927 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.927 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.927 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.927 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.927 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.927 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.680636+0000", 2023-09-30T17:04:13.927 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.927 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.927 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.928 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.928 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.680636+0000", 2023-09-30T17:04:13.928 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.928 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.928 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.928 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.928 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.680636+0000", 2023-09-30T17:04:13.928 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5100000000000001e-07 2023-09-30T17:04:13.928 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.928 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.928 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.928 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.680649+0000", 2023-09-30T17:04:13.929 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2999e-05 2023-09-30T17:04:13.929 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.929 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.929 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.929 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.680655+0000", 2023-09-30T17:04:13.929 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.755e-06 2023-09-30T17:04:13.929 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.929 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.929 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.929 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.680660+0000", 2023-09-30T17:04:13.929 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3489999999999999e-06 2023-09-30T17:04:13.930 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.930 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.930 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.930 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.930 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.930 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115953 4.38 4.9b7e3478 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.930 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.700737+0000", 2023-09-30T17:04:13.930 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.092503035999999997, 2023-09-30T17:04:13.930 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.107920553, 2023-09-30T17:04:13.930 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.930 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.931 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.931 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.931 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.931 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115953 2023-09-30T17:04:13.931 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.931 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.931 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.931 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.931 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.700737+0000", 2023-09-30T17:04:13.931 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.931 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.932 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.932 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.932 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.700737+0000", 2023-09-30T17:04:13.932 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.932 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.932 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.932 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.932 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.700738+0000", 2023-09-30T17:04:13.932 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8000000000000001e-07 2023-09-30T17:04:13.932 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.932 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.933 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.933 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.700750+0000", 2023-09-30T17:04:13.933 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2683e-05 2023-09-30T17:04:13.933 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.933 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.933 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.933 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.700756+0000", 2023-09-30T17:04:13.933 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7379999999999999e-06 2023-09-30T17:04:13.933 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.933 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.933 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.934 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.700761+0000", 2023-09-30T17:04:13.934 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6700000000000002e-06 2023-09-30T17:04:13.934 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.934 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.934 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.934 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.934 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.934 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116035 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.934 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.728653+0000", 2023-09-30T17:04:13.934 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.064586916999999994, 2023-09-30T17:04:13.934 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.080050897999999995, 2023-09-30T17:04:13.935 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.935 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.935 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.935 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.935 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.935 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116035 2023-09-30T17:04:13.935 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.935 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.935 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.935 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.936 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.728653+0000", 2023-09-30T17:04:13.936 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.936 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.936 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.936 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.936 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.728653+0000", 2023-09-30T17:04:13.936 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.936 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.936 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.936 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.936 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.728654+0000", 2023-09-30T17:04:13.936 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8999999999999996e-07 2023-09-30T17:04:13.937 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.937 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.937 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.937 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.728667+0000", 2023-09-30T17:04:13.937 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3492999999999999e-05 2023-09-30T17:04:13.937 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.937 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.937 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.937 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.728675+0000", 2023-09-30T17:04:13.937 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7389999999999999e-06 2023-09-30T17:04:13.938 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.938 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.938 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.938 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.728681+0000", 2023-09-30T17:04:13.938 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4990000000000002e-06 2023-09-30T17:04:13.938 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.938 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.938 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.938 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.938 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.938 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116064 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.939 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.738953+0000", 2023-09-30T17:04:13.939 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.054287272999999997, 2023-09-30T17:04:13.939 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.069786309000000005, 2023-09-30T17:04:13.939 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.939 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.939 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.939 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.939 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.939 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116064 2023-09-30T17:04:13.939 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.939 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.940 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.940 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.940 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.738953+0000", 2023-09-30T17:04:13.940 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.940 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.940 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.940 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.940 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.738953+0000", 2023-09-30T17:04:13.940 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.940 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.940 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.941 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.941 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.738954+0000", 2023-09-30T17:04:13.941 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.75e-07 2023-09-30T17:04:13.941 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.941 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.941 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.941 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.738971+0000", 2023-09-30T17:04:13.941 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7127999999999999e-05 2023-09-30T17:04:13.941 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.941 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.941 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.941 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.738977+0000", 2023-09-30T17:04:13.942 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9869999999999996e-06 2023-09-30T17:04:13.942 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.942 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.942 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.942 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.738983+0000", 2023-09-30T17:04:13.942 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5899999999999996e-06 2023-09-30T17:04:13.942 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.942 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.942 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.942 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.943 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.943 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116120 4.38 4.5b0ac3f8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.943 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.754806+0000", 2023-09-30T17:04:13.943 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.038434446999999997, 2023-09-30T17:04:13.943 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.053967242999999998, 2023-09-30T17:04:13.943 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.943 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.943 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.943 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.943 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.943 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116120 2023-09-30T17:04:13.943 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.944 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.944 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.944 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.944 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.754806+0000", 2023-09-30T17:04:13.944 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.944 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.944 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.944 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.944 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.754806+0000", 2023-09-30T17:04:13.944 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.944 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.945 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.945 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.945 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.754806+0000", 2023-09-30T17:04:13.945 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6399999999999998e-07 2023-09-30T17:04:13.945 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.945 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.945 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.945 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.754824+0000", 2023-09-30T17:04:13.945 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7598999999999999e-05 2023-09-30T17:04:13.945 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.945 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.946 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.946 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.754830+0000", 2023-09-30T17:04:13.946 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4080000000000003e-06 2023-09-30T17:04:13.946 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.946 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.946 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.946 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.754835+0000", 2023-09-30T17:04:13.946 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7979999999999996e-06 2023-09-30T17:04:13.946 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.946 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.946 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.947 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.947 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.947 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113985 4.6 e52/17)", 2023-09-30T17:04:13.947 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.787468+0000", 2023-09-30T17:04:13.947 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0057726779999999998, 2023-09-30T17:04:13.947 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021339106, 2023-09-30T17:04:13.947 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.947 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.947 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.947 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.947 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.947 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.787468+0000", 2023-09-30T17:04:13.948 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.948 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.948 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.948 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.948 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.787468+0000", 2023-09-30T17:04:13.948 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.948 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.948 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.948 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.948 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.787468+0000", 2023-09-30T17:04:13.948 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9400000000000004e-07 2023-09-30T17:04:13.949 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.949 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.949 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.949 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.787487+0000", 2023-09-30T17:04:13.949 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8604999999999999e-05 2023-09-30T17:04:13.949 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.949 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.949 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.949 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.787495+0000", 2023-09-30T17:04:13.949 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9540000000000004e-06 2023-09-30T17:04:13.949 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.950 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.950 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.950 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.787501+0000", 2023-09-30T17:04:13.950 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.472e-06 2023-09-30T17:04:13.950 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.950 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.950 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.950 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.950 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.950 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115085 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.950 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.364082+0000", 2023-09-30T17:04:13.951 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.42915871900000002, 2023-09-30T17:04:13.951 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.44475628299999997, 2023-09-30T17:04:13.951 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.951 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.951 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.951 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.951 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.951 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115085 2023-09-30T17:04:13.951 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.951 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.951 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.952 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.952 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.364082+0000", 2023-09-30T17:04:13.952 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.952 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.952 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.952 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.952 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.364082+0000", 2023-09-30T17:04:13.952 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.952 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.952 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.952 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.953 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.364082+0000", 2023-09-30T17:04:13.953 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3599999999999999e-07 2023-09-30T17:04:13.953 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.953 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.953 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.953 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.364093+0000", 2023-09-30T17:04:13.953 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1277999999999999e-05 2023-09-30T17:04:13.953 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.953 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.953 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.953 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.364100+0000", 2023-09-30T17:04:13.953 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0809999999999996e-06 2023-09-30T17:04:13.954 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.954 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.954 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.954 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.364105+0000", 2023-09-30T17:04:13.954 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9869999999999999e-06 2023-09-30T17:04:13.954 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.954 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.954 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.954 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.954 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.954 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115168 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.955 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.390660+0000", 2023-09-30T17:04:13.955 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.40258002999999998, 2023-09-30T17:04:13.955 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.41821567300000001, 2023-09-30T17:04:13.955 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.955 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.955 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.955 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.955 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.955 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115168 2023-09-30T17:04:13.955 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.955 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.956 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.956 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.956 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.390660+0000", 2023-09-30T17:04:13.956 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.956 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.956 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.956 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.956 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.390660+0000", 2023-09-30T17:04:13.956 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.956 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.956 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.957 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.957 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.390661+0000", 2023-09-30T17:04:13.957 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9500000000000003e-07 2023-09-30T17:04:13.957 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.957 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.957 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.957 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.390673+0000", 2023-09-30T17:04:13.957 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2099999999999999e-05 2023-09-30T17:04:13.957 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.957 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.957 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.957 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.390680+0000", 2023-09-30T17:04:13.958 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5039999999999996e-06 2023-09-30T17:04:13.958 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.958 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.958 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.958 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.390686+0000", 2023-09-30T17:04:13.958 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8080000000000001e-06 2023-09-30T17:04:13.958 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.958 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.958 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.958 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.958 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.959 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115555 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.959 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.539604+0000", 2023-09-30T17:04:13.959 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.25363633099999999, 2023-09-30T17:04:13.959 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.26930665500000001, 2023-09-30T17:04:13.959 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.959 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.959 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.959 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.959 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.959 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115555 2023-09-30T17:04:13.960 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.960 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.960 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.960 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.960 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.539604+0000", 2023-09-30T17:04:13.960 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.960 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.960 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.960 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.960 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.539604+0000", 2023-09-30T17:04:13.960 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.960 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.961 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.961 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.961 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.539604+0000", 2023-09-30T17:04:13.961 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7100000000000002e-07 2023-09-30T17:04:13.961 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.961 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.961 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.961 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.539621+0000", 2023-09-30T17:04:13.961 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6767000000000001e-05 2023-09-30T17:04:13.961 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.961 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.962 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.962 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.539629+0000", 2023-09-30T17:04:13.962 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5830000000000001e-06 2023-09-30T17:04:13.962 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.962 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.962 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.962 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.539635+0000", 2023-09-30T17:04:13.962 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8760000000000002e-06 2023-09-30T17:04:13.962 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.962 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.962 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.962 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.963 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.963 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115739 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.963 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.610640+0000", 2023-09-30T17:04:13.963 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.182600332, 2023-09-30T17:04:13.963 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.198307556, 2023-09-30T17:04:13.963 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.963 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.963 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.963 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.963 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.963 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115739 2023-09-30T17:04:13.964 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.964 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.964 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.964 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.964 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.610640+0000", 2023-09-30T17:04:13.964 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.964 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.964 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.964 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.964 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.610640+0000", 2023-09-30T17:04:13.964 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.964 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.965 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.965 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.965 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.613046+0000", 2023-09-30T17:04:13.965 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00240595 2023-09-30T17:04:13.965 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.965 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.965 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.965 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.613057+0000", 2023-09-30T17:04:13.965 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0733999999999999e-05 2023-09-30T17:04:13.965 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.965 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.966 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.966 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.613063+0000", 2023-09-30T17:04:13.966 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6969999999999996e-06 2023-09-30T17:04:13.966 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.966 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.966 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.966 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.613067+0000", 2023-09-30T17:04:13.966 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.002e-06 2023-09-30T17:04:13.966 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.966 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.966 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.966 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.967 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.967 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115933 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.967 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.694003+0000", 2023-09-30T17:04:13.967 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.099237117, 2023-09-30T17:04:13.967 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.114977977, 2023-09-30T17:04:13.967 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.967 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.967 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.967 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.967 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.968 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115933 2023-09-30T17:04:13.968 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.968 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.968 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.968 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.968 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.694003+0000", 2023-09-30T17:04:13.968 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.968 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.968 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.968 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.968 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.694003+0000", 2023-09-30T17:04:13.969 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.969 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.969 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.969 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.969 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.694004+0000", 2023-09-30T17:04:13.969 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3599999999999999e-07 2023-09-30T17:04:13.969 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.969 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.969 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.969 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.694015+0000", 2023-09-30T17:04:13.969 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1326e-05 2023-09-30T17:04:13.969 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.970 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.970 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.970 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.694021+0000", 2023-09-30T17:04:13.970 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8039999999999998e-06 2023-09-30T17:04:13.970 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.970 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.970 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.970 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.694025+0000", 2023-09-30T17:04:13.970 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6829999999999999e-06 2023-09-30T17:04:13.970 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.970 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.971 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.971 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.971 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.971 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115954 4.18 4.31813858 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.971 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.700768+0000", 2023-09-30T17:04:13.971 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.092472385000000004, 2023-09-30T17:04:13.971 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.10824818, 2023-09-30T17:04:13.971 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.971 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.971 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.971 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.971 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.972 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115954 2023-09-30T17:04:13.972 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.972 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.972 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.972 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.972 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.700768+0000", 2023-09-30T17:04:13.972 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.972 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.972 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.972 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.973 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.700768+0000", 2023-09-30T17:04:13.973 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.973 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.973 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.973 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.973 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.700768+0000", 2023-09-30T17:04:13.973 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6100000000000002e-07 2023-09-30T17:04:13.973 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.973 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.973 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.973 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.700783+0000", 2023-09-30T17:04:13.973 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4473e-05 2023-09-30T17:04:13.974 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.974 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.974 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.974 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.700789+0000", 2023-09-30T17:04:13.974 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1750000000000002e-06 2023-09-30T17:04:13.974 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.974 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.974 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.974 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.700794+0000", 2023-09-30T17:04:13.974 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6539999999999998e-06 2023-09-30T17:04:13.974 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.975 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.975 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.975 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.975 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.975 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116036 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.975 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.728688+0000", 2023-09-30T17:04:13.975 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.064551874999999995, 2023-09-30T17:04:13.975 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.080359536999999995, 2023-09-30T17:04:13.975 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.975 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.975 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.976 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.976 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.976 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116036 2023-09-30T17:04:13.976 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.976 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.976 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.976 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.976 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.728688+0000", 2023-09-30T17:04:13.976 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.976 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.976 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.977 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.977 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.728688+0000", 2023-09-30T17:04:13.977 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.977 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.977 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.977 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.977 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.728689+0000", 2023-09-30T17:04:13.977 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4900000000000001e-07 2023-09-30T17:04:13.977 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.977 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.977 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.977 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.728705+0000", 2023-09-30T17:04:13.978 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6313000000000001e-05 2023-09-30T17:04:13.978 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.978 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.978 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.978 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.728713+0000", 2023-09-30T17:04:13.978 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4429999999999997e-06 2023-09-30T17:04:13.978 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.978 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.978 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.978 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.728719+0000", 2023-09-30T17:04:13.978 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9850000000000003e-06 2023-09-30T17:04:13.978 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.979 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.979 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.979 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.979 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.979 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116123 4.38 4.5b0ac3f8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.979 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.754841+0000", 2023-09-30T17:04:13.979 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.038398841000000003, 2023-09-30T17:04:13.979 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.054247538999999997, 2023-09-30T17:04:13.979 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.979 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.979 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.980 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.980 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.980 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116123 2023-09-30T17:04:13.980 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.980 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.980 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.980 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.980 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.754841+0000", 2023-09-30T17:04:13.980 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.980 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.980 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.980 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.981 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.754841+0000", 2023-09-30T17:04:13.981 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.981 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.981 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.981 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.981 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.754842+0000", 2023-09-30T17:04:13.981 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.27e-07 2023-09-30T17:04:13.981 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.981 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.981 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.981 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.754852+0000", 2023-09-30T17:04:13.981 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0339e-05 2023-09-30T17:04:13.981 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.982 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.982 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.982 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.754858+0000", 2023-09-30T17:04:13.982 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4009999999999996e-06 2023-09-30T17:04:13.982 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.982 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.982 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.982 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.754862+0000", 2023-09-30T17:04:13.982 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3970000000000004e-06 2023-09-30T17:04:13.982 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.983 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.983 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.983 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.983 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.983 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115235 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.983 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.415570+0000", 2023-09-30T17:04:13.983 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.37767063099999998, 2023-09-30T17:04:13.983 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.39359475999999999, 2023-09-30T17:04:13.983 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.983 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.983 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.983 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.984 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.984 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115235 2023-09-30T17:04:13.984 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.984 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.984 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.984 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.984 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.415570+0000", 2023-09-30T17:04:13.984 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.984 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.984 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.984 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.984 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.415570+0000", 2023-09-30T17:04:13.985 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.985 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.985 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.985 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.985 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.417517+0000", 2023-09-30T17:04:13.985 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019473349999999999 2023-09-30T17:04:13.985 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.985 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.985 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.985 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.417532+0000", 2023-09-30T17:04:13.985 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5248999999999999e-05 2023-09-30T17:04:13.986 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.986 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.986 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.986 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.417543+0000", 2023-09-30T17:04:13.986 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0975000000000001e-05 2023-09-30T17:04:13.986 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.986 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.986 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.986 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.417551+0000", 2023-09-30T17:04:13.986 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3159999999999999e-06 2023-09-30T17:04:13.986 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.987 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.987 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.987 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.987 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.987 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115742 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.987 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.613075+0000", 2023-09-30T17:04:13.987 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.18016513300000001, 2023-09-30T17:04:13.987 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.19615213000000001, 2023-09-30T17:04:13.987 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.987 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.987 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.988 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.988 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.988 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115742 2023-09-30T17:04:13.988 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.988 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.988 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.988 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.613075+0000", 2023-09-30T17:04:13.988 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.988 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.988 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.989 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.613075+0000", 2023-09-30T17:04:13.989 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.989 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.989 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.989 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.989 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.614517+0000", 2023-09-30T17:04:13.989 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001441536 2023-09-30T17:04:13.989 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.989 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.989 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.989 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.614533+0000", 2023-09-30T17:04:13.989 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6486000000000001e-05 2023-09-30T17:04:13.990 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.990 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.990 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.990 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.614541+0000", 2023-09-30T17:04:13.990 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.089e-06 2023-09-30T17:04:13.990 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.990 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.990 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.990 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.614547+0000", 2023-09-30T17:04:13.990 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8649999999999998e-06 2023-09-30T17:04:13.990 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.991 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.991 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.991 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.991 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.991 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113642 4.6 e52/17)", 2023-09-30T17:04:13.991 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.680768+0000", 2023-09-30T17:04:13.991 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.11247233199999999, 2023-09-30T17:04:13.991 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.12852148299999999, 2023-09-30T17:04:13.991 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.991 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.991 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.991 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.992 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.680768+0000", 2023-09-30T17:04:13.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.992 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:13.992 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.680768+0000", 2023-09-30T17:04:13.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:13.992 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:13.993 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.680768+0000", 2023-09-30T17:04:13.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8099999999999999e-07 2023-09-30T17:04:13.993 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.993 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.993 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:13.997 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.680785+0000", 2023-09-30T17:04:13.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7192000000000001e-05 2023-09-30T17:04:13.997 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.997 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:13.997 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.680792+0000", 2023-09-30T17:04:13.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2829999999999998e-06 2023-09-30T17:04:13.997 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.998 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:13.998 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.680798+0000", 2023-09-30T17:04:13.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1709999999999999e-06 2023-09-30T17:04:13.998 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.998 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:13.998 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:13.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.998 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115934 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:13.998 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.694031+0000", 2023-09-30T17:04:13.998 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.099209433, 2023-09-30T17:04:13.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.115317367, 2023-09-30T17:04:13.999 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:13.999 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:13.999 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:13.999 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:13.999 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:13.999 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115934 2023-09-30T17:04:13.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:13.999 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:13.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:13.999 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:13.999 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.694031+0000", 2023-09-30T17:04:14.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:14.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.000 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:14.000 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.694031+0000", 2023-09-30T17:04:14.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:14.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.000 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:14.000 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.694031+0000", 2023-09-30T17:04:14.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6899999999999998e-07 2023-09-30T17:04:14.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.001 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:14.001 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.694042+0000", 2023-09-30T17:04:14.001 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0406e-05 2023-09-30T17:04:14.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.001 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:14.001 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.694047+0000", 2023-09-30T17:04:14.001 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4330000000000003e-06 2023-09-30T17:04:14.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.002 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:14.002 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.694052+0000", 2023-09-30T17:04:14.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5700000000000003e-06 2023-09-30T17:04:14.002 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:14.002 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:14.002 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:14.002 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.002 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116124 4.38 4.e1fdc8b8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:14.002 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.754867+0000", 2023-09-30T17:04:14.002 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.038373372000000003, 2023-09-30T17:04:14.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.054526817999999998, 2023-09-30T17:04:14.003 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:14.003 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:14.003 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:14.003 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:14.003 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:14.003 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116124 2023-09-30T17:04:14.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.003 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:14.003 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.003 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:14.003 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.754867+0000", 2023-09-30T17:04:14.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:14.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:14.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.754867+0000", 2023-09-30T17:04:14.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:14.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:14.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.754867+0000", 2023-09-30T17:04:14.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.96e-07 2023-09-30T17:04:14.005 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.005 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:14.005 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.754881+0000", 2023-09-30T17:04:14.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3947999999999999e-05 2023-09-30T17:04:14.005 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.005 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:14.005 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.754887+0000", 2023-09-30T17:04:14.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4999999999999999e-06 2023-09-30T17:04:14.005 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.006 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:14.006 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.754892+0000", 2023-09-30T17:04:14.006 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0320000000000003e-06 2023-09-30T17:04:14.006 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:14.006 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:14.006 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:14.006 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.006 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113951 4.36 e52/17)", 2023-09-30T17:04:14.006 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.769570+0000", 2023-09-30T17:04:14.006 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.023670677000000001, 2023-09-30T17:04:14.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039853455000000003, 2023-09-30T17:04:14.007 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:14.007 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:14.007 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:14.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.007 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:14.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.769570+0000", 2023-09-30T17:04:14.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:14.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.007 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:14.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.769570+0000", 2023-09-30T17:04:14.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:14.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.008 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:14.008 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.769570+0000", 2023-09-30T17:04:14.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.99e-07 2023-09-30T17:04:14.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.008 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:14.008 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.769582+0000", 2023-09-30T17:04:14.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2145e-05 2023-09-30T17:04:14.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.009 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:14.009 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.769591+0000", 2023-09-30T17:04:14.009 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6850000000000007e-06 2023-09-30T17:04:14.009 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.009 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:14.009 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.769598+0000", 2023-09-30T17:04:14.009 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8329999999999996e-06 2023-09-30T17:04:14.009 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:14.009 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:14.010 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:14.010 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.010 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115060 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:14.010 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.355637+0000", 2023-09-30T17:04:14.010 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.437603205, 2023-09-30T17:04:14.010 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.45381525700000003, 2023-09-30T17:04:14.010 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:14.010 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:14.010 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:14.010 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:14.011 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:14.011 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115060 2023-09-30T17:04:14.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.011 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:14.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:14.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.355637+0000", 2023-09-30T17:04:14.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:14.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:14.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.355637+0000", 2023-09-30T17:04:14.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:14.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:14.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.355638+0000", 2023-09-30T17:04:14.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0100000000000005e-07 2023-09-30T17:04:14.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:14.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.355649+0000", 2023-09-30T17:04:14.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1652e-05 2023-09-30T17:04:14.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.013 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:14.013 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.355655+0000", 2023-09-30T17:04:14.013 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0360000000000003e-06 2023-09-30T17:04:14.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.013 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:14.013 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.355660+0000", 2023-09-30T17:04:14.013 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9579999999999998e-06 2023-09-30T17:04:14.013 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:14.013 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:14.014 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:14.014 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.014 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.014 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115135 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:14.014 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.374070+0000", 2023-09-30T17:04:14.014 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.41917059899999998, 2023-09-30T17:04:14.014 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.43542665400000002, 2023-09-30T17:04:14.014 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:14.014 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:14.014 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:14.014 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:14.015 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:14.015 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115135 2023-09-30T17:04:14.015 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.015 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:14.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:14.015 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.374070+0000", 2023-09-30T17:04:14.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:14.015 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:14.015 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.374070+0000", 2023-09-30T17:04:14.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:14.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:14.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.374070+0000", 2023-09-30T17:04:14.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9900000000000002e-07 2023-09-30T17:04:14.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:14.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.374079+0000", 2023-09-30T17:04:14.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3859999999999996e-06 2023-09-30T17:04:14.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:14.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.374090+0000", 2023-09-30T17:04:14.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0484e-05 2023-09-30T17:04:14.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:14.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.374097+0000", 2023-09-30T17:04:14.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2139999999999999e-06 2023-09-30T17:04:14.017 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:14.017 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:14.018 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:14.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.018 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115172 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:14.018 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.390743+0000", 2023-09-30T17:04:14.018 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.40249747600000002, 2023-09-30T17:04:14.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.41879623300000002, 2023-09-30T17:04:14.018 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:14.018 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:14.018 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:14.018 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:14.018 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:14.019 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115172 2023-09-30T17:04:14.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.019 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:14.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.019 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:14.019 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.390743+0000", 2023-09-30T17:04:14.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:14.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.019 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:14.019 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.390743+0000", 2023-09-30T17:04:14.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:14.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:14.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.390743+0000", 2023-09-30T17:04:14.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.68e-07 2023-09-30T17:04:14.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:14.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.390759+0000", 2023-09-30T17:04:14.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5616000000000001e-05 2023-09-30T17:04:14.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.021 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:14.021 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.390767+0000", 2023-09-30T17:04:14.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5900000000000002e-06 2023-09-30T17:04:14.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.021 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:14.021 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.390772+0000", 2023-09-30T17:04:14.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6749999999999999e-06 2023-09-30T17:04:14.021 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:14.021 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:14.021 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:14.022 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.022 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.022 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115716 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:14.022 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.597730+0000", 2023-09-30T17:04:14.022 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.19551015099999999, 2023-09-30T17:04:14.022 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.21184671399999999, 2023-09-30T17:04:14.022 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:14.022 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:14.022 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:14.022 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:14.022 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:14.023 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115716 2023-09-30T17:04:14.023 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.023 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:14.023 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.023 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:14.023 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.597730+0000", 2023-09-30T17:04:14.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:14.023 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.023 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.023 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:14.023 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.597730+0000", 2023-09-30T17:04:14.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:14.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.024 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:14.024 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.599517+0000", 2023-09-30T17:04:14.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0017864249999999999 2023-09-30T17:04:14.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.024 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:14.024 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.599533+0000", 2023-09-30T17:04:14.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6424000000000001e-05 2023-09-30T17:04:14.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.025 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.025 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:14.025 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.599543+0000", 2023-09-30T17:04:14.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8260000000000005e-06 2023-09-30T17:04:14.025 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.025 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.025 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:14.025 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.599550+0000", 2023-09-30T17:04:14.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5290000000000003e-06 2023-09-30T17:04:14.025 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:14.025 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:14.026 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:14.026 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.026 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113645 4.2e e52/17)", 2023-09-30T17:04:14.026 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.680823+0000", 2023-09-30T17:04:14.026 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.112417061, 2023-09-30T17:04:14.026 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.12879769499999999, 2023-09-30T17:04:14.026 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:14.026 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:14.026 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:14.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.027 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:14.027 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.680823+0000", 2023-09-30T17:04:14.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:14.027 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.027 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:14.027 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.680823+0000", 2023-09-30T17:04:14.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:14.027 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.027 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:14.027 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.680824+0000", 2023-09-30T17:04:14.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7700000000000001e-07 2023-09-30T17:04:14.028 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.028 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.028 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:14.028 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.680834+0000", 2023-09-30T17:04:14.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0373999999999999e-05 2023-09-30T17:04:14.028 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.028 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.028 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:14.028 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.680840+0000", 2023-09-30T17:04:14.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6350000000000003e-06 2023-09-30T17:04:14.028 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.029 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:14.029 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.680844+0000", 2023-09-30T17:04:14.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1030000000000004e-06 2023-09-30T17:04:14.029 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:14.029 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:14.029 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:14.029 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.029 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115936 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:14.029 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.694057+0000", 2023-09-30T17:04:14.030 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.099183093, 2023-09-30T17:04:14.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.11560725500000001, 2023-09-30T17:04:14.030 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:14.030 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:14.030 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:14.030 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:14.030 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:14.030 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115936 2023-09-30T17:04:14.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.030 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:14.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:14.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.694057+0000", 2023-09-30T17:04:14.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:14.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:14.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.694057+0000", 2023-09-30T17:04:14.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:14.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:14.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.694058+0000", 2023-09-30T17:04:14.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.58e-07 2023-09-30T17:04:14.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.032 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:14.032 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.694069+0000", 2023-09-30T17:04:14.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1379000000000001e-05 2023-09-30T17:04:14.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.032 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:14.032 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.694074+0000", 2023-09-30T17:04:14.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.429e-06 2023-09-30T17:04:14.033 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.033 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.033 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:14.033 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.694079+0000", 2023-09-30T17:04:14.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6779999999999999e-06 2023-09-30T17:04:14.033 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:14.033 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:14.033 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:14.033 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.033 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.033 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116128 4.38 4.e1fdc8b8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:14.033 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.754897+0000", 2023-09-30T17:04:14.034 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.038342964, 2023-09-30T17:04:14.034 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.054810311, 2023-09-30T17:04:14.034 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:14.034 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:14.034 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:14.034 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:14.034 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:14.034 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116128 2023-09-30T17:04:14.034 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.034 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:14.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.035 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:14.035 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.754897+0000", 2023-09-30T17:04:14.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:14.035 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.035 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.035 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:14.035 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.754897+0000", 2023-09-30T17:04:14.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:14.035 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.035 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.035 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:14.035 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.754898+0000", 2023-09-30T17:04:14.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3000000000000002e-07 2023-09-30T17:04:14.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:14.036 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.754921+0000", 2023-09-30T17:04:14.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3742000000000001e-05 2023-09-30T17:04:14.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:14.036 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.754928+0000", 2023-09-30T17:04:14.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.246e-06 2023-09-30T17:04:14.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:14.037 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.754934+0000", 2023-09-30T17:04:14.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3969999999999999e-06 2023-09-30T17:04:14.037 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:14.037 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:14.037 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:14.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.037 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:114784 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:14.037 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.273629+0000", 2023-09-30T17:04:14.038 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.51961133000000004, 2023-09-30T17:04:14.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.53612678999999996, 2023-09-30T17:04:14.038 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:14.038 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:14.038 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:14.038 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:14.038 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:14.038 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 114784 2023-09-30T17:04:14.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.038 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:14.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.039 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:14.039 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.273629+0000", 2023-09-30T17:04:14.039 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:14.039 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.039 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:14.039 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.273629+0000", 2023-09-30T17:04:14.039 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:14.039 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.039 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:14.039 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.273629+0000", 2023-09-30T17:04:14.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8599999999999998e-07 2023-09-30T17:04:14.040 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.040 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.040 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:14.040 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.273640+0000", 2023-09-30T17:04:14.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0691e-05 2023-09-30T17:04:14.040 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.040 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.040 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:14.040 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.273646+0000", 2023-09-30T17:04:14.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7939999999999999e-06 2023-09-30T17:04:14.040 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.041 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.041 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:14.041 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.273651+0000", 2023-09-30T17:04:14.041 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7600000000000002e-06 2023-09-30T17:04:14.041 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:14.041 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:14.041 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:14.041 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.041 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.041 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115349 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:14.041 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.456622+0000", 2023-09-30T17:04:14.041 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.33661804200000001, 2023-09-30T17:04:14.042 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.35318716999999999, 2023-09-30T17:04:14.042 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:14.042 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:14.042 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:14.042 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:14.042 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:14.042 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115349 2023-09-30T17:04:14.042 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.042 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:14.042 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.042 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:14.042 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.456622+0000", 2023-09-30T17:04:14.043 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:14.043 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.043 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.043 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:14.043 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.456622+0000", 2023-09-30T17:04:14.043 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:14.043 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.043 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.043 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:14.043 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.458515+0000", 2023-09-30T17:04:14.043 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001892976 2023-09-30T17:04:14.044 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.044 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.044 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:14.044 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.458531+0000", 2023-09-30T17:04:14.044 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5858999999999998e-05 2023-09-30T17:04:14.044 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.044 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.044 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:14.044 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.458540+0000", 2023-09-30T17:04:14.044 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1069999999999994e-06 2023-09-30T17:04:14.044 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.044 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.045 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:14.045 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.458546+0000", 2023-09-30T17:04:14.045 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0410000000000003e-06 2023-09-30T17:04:14.045 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:14.045 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:14.045 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:14.045 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.045 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.045 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113502 4.36 e52/17 4:6c9c34b1:::100000001f8.00000010:head v 52'5373, mlcod=52'5346)", 2023-09-30T17:04:14.045 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.655132+0000", 2023-09-30T17:04:14.045 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.138108553, 2023-09-30T17:04:14.045 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.15472468, 2023-09-30T17:04:14.046 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:14.046 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:14.046 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:14.046 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.046 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:14.046 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.655132+0000", 2023-09-30T17:04:14.046 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:14.046 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.046 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.046 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:14.046 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.655132+0000", 2023-09-30T17:04:14.047 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:14.047 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.047 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.047 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:14.047 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.655133+0000", 2023-09-30T17:04:14.047 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5300000000000002e-07 2023-09-30T17:04:14.047 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.047 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.047 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:14.047 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.655149+0000", 2023-09-30T17:04:14.047 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6342999999999999e-05 2023-09-30T17:04:14.047 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.048 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.048 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:14.048 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.655159+0000", 2023-09-30T17:04:14.048 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9750000000000002e-06 2023-09-30T17:04:14.048 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.048 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.048 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:14.048 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.655168+0000", 2023-09-30T17:04:14.048 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6100000000000006e-06 2023-09-30T17:04:14.048 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.048 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.049 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:14.049 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.787213+0000", 2023-09-30T17:04:14.049 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.132045737 2023-09-30T17:04:14.049 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.049 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.049 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:14.049 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.787233+0000", 2023-09-30T17:04:14.049 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0066999999999999e-05 2023-09-30T17:04:14.049 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:14.049 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:14.049 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:14.049 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.050 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.050 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113597 4.6 e52/17 4:635f8cb4:::100000001f8.0000003c:head v 52'6970, mlcod=52'6944)", 2023-09-30T17:04:14.050 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.669861+0000", 2023-09-30T17:04:14.050 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.123379581, 2023-09-30T17:04:14.050 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.140044479, 2023-09-30T17:04:14.050 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:14.050 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:14.050 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:14.050 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.050 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:14.050 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.669861+0000", 2023-09-30T17:04:14.051 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:14.051 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.051 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.051 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:14.051 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.669861+0000", 2023-09-30T17:04:14.051 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:14.051 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.051 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.051 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:14.051 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.669861+0000", 2023-09-30T17:04:14.051 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.17e-07 2023-09-30T17:04:14.051 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.052 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:14.052 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.669871+0000", 2023-09-30T17:04:14.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0295999999999999e-05 2023-09-30T17:04:14.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.052 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:14.052 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.669877+0000", 2023-09-30T17:04:14.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.02e-06 2023-09-30T17:04:14.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.052 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:14.053 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.669881+0000", 2023-09-30T17:04:14.053 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.377e-06 2023-09-30T17:04:14.053 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.053 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.053 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:14.053 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.804981+0000", 2023-09-30T17:04:14.053 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.13510069799999999 2023-09-30T17:04:14.053 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.053 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.053 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:14.053 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.805000+0000", 2023-09-30T17:04:14.054 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8182e-05 2023-09-30T17:04:14.054 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:14.054 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:14.054 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:14.054 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.054 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.054 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115888 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:14.054 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.680231+0000", 2023-09-30T17:04:14.054 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.11300903900000001, 2023-09-30T17:04:14.054 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.12972636400000001, 2023-09-30T17:04:14.054 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:14.054 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:14.055 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:14.055 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:14.055 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:14.055 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115888 2023-09-30T17:04:14.055 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.055 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:14.055 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.055 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:14.055 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.680231+0000", 2023-09-30T17:04:14.055 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:14.055 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.056 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.056 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:14.056 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.680231+0000", 2023-09-30T17:04:14.056 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:14.056 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.056 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.056 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:14.056 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.681522+0000", 2023-09-30T17:04:14.056 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00129082 2023-09-30T17:04:14.056 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.056 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.056 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:14.057 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.681536+0000", 2023-09-30T17:04:14.057 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3886000000000001e-05 2023-09-30T17:04:14.057 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.057 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.057 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:14.057 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.681547+0000", 2023-09-30T17:04:14.057 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0587999999999999e-05 2023-09-30T17:04:14.057 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.057 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.057 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:14.057 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.681554+0000", 2023-09-30T17:04:14.057 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1169999999999998e-06 2023-09-30T17:04:14.058 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:14.058 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:14.058 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:14.058 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.058 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.058 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:115994 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:14.058 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.712867+0000", 2023-09-30T17:04:14.058 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.080373068000000006, 2023-09-30T17:04:14.058 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.097131545, 2023-09-30T17:04:14.058 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:14.058 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:14.059 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:14.059 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:14.059 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:14.059 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 115994 2023-09-30T17:04:14.059 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.059 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:14.059 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.059 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:14.059 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.712867+0000", 2023-09-30T17:04:14.059 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:14.059 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.059 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.060 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:14.060 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.712867+0000", 2023-09-30T17:04:14.060 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:14.060 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.060 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.060 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:14.060 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.718515+0000", 2023-09-30T17:04:14.060 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056482290000000003 2023-09-30T17:04:14.060 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.060 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.060 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:14.060 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.718531+0000", 2023-09-30T17:04:14.061 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5863e-05 2023-09-30T17:04:14.061 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.061 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.061 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:14.061 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.718540+0000", 2023-09-30T17:04:14.061 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5769999999999994e-06 2023-09-30T17:04:14.061 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.061 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.061 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:14.061 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.718547+0000", 2023-09-30T17:04:14.061 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7390000000000002e-06 2023-09-30T17:04:14.062 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:14.062 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:14.062 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:14.062 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.062 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.062 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:113822 4.6 e52/17)", 2023-09-30T17:04:14.062 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.739421+0000", 2023-09-30T17:04:14.062 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.053819543999999997, 2023-09-30T17:04:14.062 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.070628558999999994, 2023-09-30T17:04:14.062 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:14.062 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:14.062 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:14.063 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.063 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:14.063 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.739421+0000", 2023-09-30T17:04:14.063 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:14.063 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.063 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.063 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:14.063 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.739421+0000", 2023-09-30T17:04:14.063 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:14.063 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.063 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.064 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:14.064 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.739421+0000", 2023-09-30T17:04:14.064 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3700000000000001e-07 2023-09-30T17:04:14.064 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.064 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.064 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:14.064 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.739438+0000", 2023-09-30T17:04:14.064 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6795000000000001e-05 2023-09-30T17:04:14.064 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.064 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.064 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:14.064 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.739448+0000", 2023-09-30T17:04:14.065 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0251000000000001e-05 2023-09-30T17:04:14.065 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.065 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.065 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:14.065 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.739454+0000", 2023-09-30T17:04:14.065 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2929999999999997e-06 2023-09-30T17:04:14.065 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:14.065 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:14.065 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:14.065 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.065 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.065 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:116161 4.38 4.5b0ac3f8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:14.066 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.767749+0000", 2023-09-30T17:04:14.066 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.025491039, 2023-09-30T17:04:14.066 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.042334265000000003, 2023-09-30T17:04:14.066 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:14.066 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:14.066 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:14.066 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:14.066 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:14.066 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 116161 2023-09-30T17:04:14.066 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.066 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:14.067 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.067 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:14.067 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.767749+0000", 2023-09-30T17:04:14.067 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:14.067 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.067 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.067 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:14.067 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.767749+0000", 2023-09-30T17:04:14.067 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:14.067 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.067 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.068 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:14.068 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.773517+0000", 2023-09-30T17:04:14.068 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057679089999999999 2023-09-30T17:04:14.068 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.068 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.068 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:14.068 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.773536+0000", 2023-09-30T17:04:14.068 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8440999999999998e-05 2023-09-30T17:04:14.068 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.068 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.068 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:14.068 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.773545+0000", 2023-09-30T17:04:14.069 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7059999999999999e-06 2023-09-30T17:04:14.069 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.069 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.069 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:14.069 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.773553+0000", 2023-09-30T17:04:14.069 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2023-09-30T17:04:14.069 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:14.069 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:14.069 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:14.069 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.069 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.069 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(client.4547.0:114619 4.f e52/17 ondisk, result = 0)", 2023-09-30T17:04:14.070 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:11.800219+0000", 2023-09-30T17:04:14.070 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.993021, 2023-09-30T17:04:14.070 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0098368190000000001, 2023-09-30T17:04:14.070 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:14.070 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:14.070 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:14.070 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.070 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:14.070 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.800219+0000", 2023-09-30T17:04:14.070 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:14.070 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.070 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.071 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:14.071 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.800219+0000", 2023-09-30T17:04:14.071 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:14.071 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.071 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.071 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:14.071 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.800219+0000", 2023-09-30T17:04:14.071 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2100000000000001e-07 2023-09-30T17:04:14.071 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.071 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.071 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:14.071 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.800221+0000", 2023-09-30T17:04:14.072 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.494e-06 2023-09-30T17:04:14.072 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.072 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.072 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:14.072 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.800225+0000", 2023-09-30T17:04:14.072 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6650000000000002e-06 2023-09-30T17:04:14.072 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.072 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.072 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:14.072 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.800229+0000", 2023-09-30T17:04:14.072 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.507e-06 2023-09-30T17:04:14.072 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.073 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.073 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:14.073 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.804564+0000", 2023-09-30T17:04:14.073 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0043352360000000001 2023-09-30T17:04:14.073 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.073 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.073 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:14.073 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.804571+0000", 2023-09-30T17:04:14.073 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1149999999999996e-06 2023-09-30T17:04:14.073 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:14.073 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:14.073 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:14.074 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:11.810056+0000", 2023-09-30T17:04:14.074 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054846809999999999 2023-09-30T17:04:14.074 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:14.074 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:14.074 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:14.074 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:14.074 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2023-09-30T17:04:14.074 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 323 2023-09-30T17:04:14.074 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:04:14.075 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:04:14.075 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-09-30T17:04:14.076 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:14.075+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:14.179 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:14.179+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:14.275 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:14.276 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:14.284 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:14.279+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:14.292 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:04:14.379 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:14.379+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:14.479 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:14.479+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:14.539 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:14.540 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:14.546 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is set 2023-09-30T17:04:14.554 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:04:14.596 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:14.596+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:14.682 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:14.682+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:14.782 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:14.783 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:14.798 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:04:14.853 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-09-30T17:04:14.884 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:14.883+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:14.961 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:14.962 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:14.974 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:04:14.976 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:14.783+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:14.984 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:14.984+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:15.050 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:04:15.074 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:04:15.074 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-09-30T17:04:15.074 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-09-30T17:04:15.075 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:04:15.077 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:04:15.078 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:04:15.086 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:15.085+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:15.189 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:15.187+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:15.227 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:04:15.228 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 20, 2023-09-30T17:04:15.228 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 600, 2023-09-30T17:04:15.228 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:04:15.228 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.228 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109497 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 49152~4096 in=4096b,write 106496~4096 in=4096b,write 163840~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:15.228 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.624224+0000", 2023-09-30T17:04:15.228 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.6012171200000003, 2023-09-30T17:04:15.228 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.717345754, 2023-09-30T17:04:15.228 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:15.228 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:15.229 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:15.229 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:15.229 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.229 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109497 2023-09-30T17:04:15.229 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.229 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:15.229 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.229 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:15.229 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624224+0000", 2023-09-30T17:04:15.229 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:15.229 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.230 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.230 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:15.230 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624224+0000", 2023-09-30T17:04:15.230 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:15.230 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.230 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.230 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:15.230 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624224+0000", 2023-09-30T17:04:15.230 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9299999999999998e-07 2023-09-30T17:04:15.230 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.230 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.231 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:15.231 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624238+0000", 2023-09-30T17:04:15.231 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4144999999999999e-05 2023-09-30T17:04:15.231 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.231 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.231 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:15.231 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624439+0000", 2023-09-30T17:04:15.231 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00020105200000000001 2023-09-30T17:04:15.231 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.231 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.231 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.232 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624447+0000", 2023-09-30T17:04:15.232 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0499999999999992e-06 2023-09-30T17:04:15.232 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.232 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.232 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:15.232 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.022040+0000", 2023-09-30T17:04:15.232 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39759262099999998 2023-09-30T17:04:15.232 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.232 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.232 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:15.232 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.022117+0000", 2023-09-30T17:04:15.233 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6834000000000003e-05 2023-09-30T17:04:15.233 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.233 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.233 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:15.233 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.022269+0000", 2023-09-30T17:04:15.233 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015254600000000001 2023-09-30T17:04:15.233 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.233 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.233 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:15.233 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.058505+0000", 2023-09-30T17:04:15.233 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.036235394999999997 2023-09-30T17:04:15.233 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.234 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.234 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:15.234 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.341470+0000", 2023-09-30T17:04:15.234 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.28296523600000001 2023-09-30T17:04:15.234 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.234 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.234 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:15.234 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.341530+0000", 2023-09-30T17:04:15.234 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9939000000000003e-05 2023-09-30T17:04:15.234 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.234 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.235 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:15.235 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.341569+0000", 2023-09-30T17:04:15.235 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9342999999999999e-05 2023-09-30T17:04:15.235 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:15.235 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:15.235 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:15.235 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.235 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.235 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109508 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 2650112~4096 in=4096b,write 2723840~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:15.235 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.624554+0000", 2023-09-30T17:04:15.235 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.6008864840000001, 2023-09-30T17:04:15.235 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.717264546, 2023-09-30T17:04:15.236 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:15.236 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:15.236 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:15.236 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:15.236 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.236 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109508 2023-09-30T17:04:15.236 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.236 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:15.236 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.236 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:15.236 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624554+0000", 2023-09-30T17:04:15.236 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:15.237 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.237 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.237 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:15.237 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624554+0000", 2023-09-30T17:04:15.237 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:15.237 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.237 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.237 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:15.237 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624555+0000", 2023-09-30T17:04:15.237 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.51e-07 2023-09-30T17:04:15.237 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.237 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.238 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:15.238 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624573+0000", 2023-09-30T17:04:15.238 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8519e-05 2023-09-30T17:04:15.238 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.238 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.238 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:15.238 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624582+0000", 2023-09-30T17:04:15.238 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.6489999999999997e-06 2023-09-30T17:04:15.238 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.238 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.238 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.238 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624588+0000", 2023-09-30T17:04:15.239 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4980000000000003e-06 2023-09-30T17:04:15.239 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.239 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.239 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:15.239 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.028302+0000", 2023-09-30T17:04:15.239 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.40371393 2023-09-30T17:04:15.239 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.239 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.239 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:15.239 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.028383+0000", 2023-09-30T17:04:15.239 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1069000000000006e-05 2023-09-30T17:04:15.239 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.240 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.240 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:15.240 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.028546+0000", 2023-09-30T17:04:15.240 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000162256 2023-09-30T17:04:15.240 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.240 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.240 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:15.240 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.058510+0000", 2023-09-30T17:04:15.240 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.029964937000000001 2023-09-30T17:04:15.240 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.240 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.240 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:15.241 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.341742+0000", 2023-09-30T17:04:15.241 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.28323117799999997 2023-09-30T17:04:15.241 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.241 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.241 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:15.241 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.341788+0000", 2023-09-30T17:04:15.241 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6118999999999997e-05 2023-09-30T17:04:15.241 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.241 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.241 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:15.241 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.341819+0000", 2023-09-30T17:04:15.241 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0939999999999999e-05 2023-09-30T17:04:15.242 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:15.242 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:15.242 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:15.242 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.242 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.242 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109527 4.6 4:616d4c41:::100000001f8.00000034:head [write 122880~4096 in=4096b,write 143360~4096 in=4096b,write 151552~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:15.242 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.630262+0000", 2023-09-30T17:04:15.242 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.5951788850000002, 2023-09-30T17:04:15.242 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.72988284299999995, 2023-09-30T17:04:15.242 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:15.242 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:15.243 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:15.243 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:15.243 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.243 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109527 2023-09-30T17:04:15.243 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.243 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:15.243 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.243 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:15.243 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.630262+0000", 2023-09-30T17:04:15.243 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:15.243 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.243 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.244 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:15.244 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.630262+0000", 2023-09-30T17:04:15.244 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:15.244 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.244 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.244 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:15.244 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.632170+0000", 2023-09-30T17:04:15.244 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0019085529999999999 2023-09-30T17:04:15.244 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.244 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.245 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:15.245 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.632192+0000", 2023-09-30T17:04:15.245 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1243999999999999e-05 2023-09-30T17:04:15.245 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.245 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.245 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:15.245 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.632203+0000", 2023-09-30T17:04:15.245 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1389999999999999e-05 2023-09-30T17:04:15.245 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.245 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.245 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.246 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.632211+0000", 2023-09-30T17:04:15.246 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8939999999999993e-06 2023-09-30T17:04:15.246 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.246 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.246 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:15.246 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.031203+0000", 2023-09-30T17:04:15.246 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39899208800000002 2023-09-30T17:04:15.246 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.246 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.246 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:15.246 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.031278+0000", 2023-09-30T17:04:15.247 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4988999999999996e-05 2023-09-30T17:04:15.247 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.247 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.247 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:15.247 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.031432+0000", 2023-09-30T17:04:15.247 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000154396 2023-09-30T17:04:15.247 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.247 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.247 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:15.247 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.058953+0000", 2023-09-30T17:04:15.247 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.027520464000000001 2023-09-30T17:04:15.248 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.248 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.248 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:15.248 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360042+0000", 2023-09-30T17:04:15.248 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.30108895699999999 2023-09-30T17:04:15.248 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.248 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.248 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:15.248 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360103+0000", 2023-09-30T17:04:15.248 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1364000000000004e-05 2023-09-30T17:04:15.248 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.248 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.249 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:15.249 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360145+0000", 2023-09-30T17:04:15.249 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1504000000000001e-05 2023-09-30T17:04:15.249 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:15.249 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:15.249 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:15.249 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.249 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.249 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109554 4.6 4:616d4c41:::100000001f8.00000034:head [write 1323008~4096 in=4096b,write 1675264~4096 in=4096b,write 1695744~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:15.249 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.646316+0000", 2023-09-30T17:04:15.249 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.5791245700000003, 2023-09-30T17:04:15.250 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.71401674900000001, 2023-09-30T17:04:15.250 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:15.250 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:15.250 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:15.250 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:15.250 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.250 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109554 2023-09-30T17:04:15.250 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.250 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:15.251 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.251 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:15.251 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646316+0000", 2023-09-30T17:04:15.251 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:15.251 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.251 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.251 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:15.251 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646316+0000", 2023-09-30T17:04:15.251 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:15.251 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.251 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.251 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:15.252 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646317+0000", 2023-09-30T17:04:15.252 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9100000000000004e-07 2023-09-30T17:04:15.252 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.252 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.252 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:15.252 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646328+0000", 2023-09-30T17:04:15.252 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1832e-05 2023-09-30T17:04:15.252 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.252 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.252 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:15.252 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646335+0000", 2023-09-30T17:04:15.252 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7299999999999999e-06 2023-09-30T17:04:15.253 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.253 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.253 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.253 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646342+0000", 2023-09-30T17:04:15.253 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5309999999999998e-06 2023-09-30T17:04:15.253 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.253 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.253 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:15.253 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.033952+0000", 2023-09-30T17:04:15.253 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.38760991099999997 2023-09-30T17:04:15.253 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.254 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.254 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:15.254 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.034037+0000", 2023-09-30T17:04:15.254 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5483999999999997e-05 2023-09-30T17:04:15.254 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.254 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.254 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:15.254 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.034208+0000", 2023-09-30T17:04:15.254 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000170946 2023-09-30T17:04:15.254 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.254 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.254 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:15.255 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.058968+0000", 2023-09-30T17:04:15.255 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024760305 2023-09-30T17:04:15.255 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.255 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.255 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:15.255 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360244+0000", 2023-09-30T17:04:15.255 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.30127521699999998 2023-09-30T17:04:15.255 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.255 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.255 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:15.255 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360292+0000", 2023-09-30T17:04:15.255 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8689000000000001e-05 2023-09-30T17:04:15.256 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.256 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.256 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:15.256 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360333+0000", 2023-09-30T17:04:15.256 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0612999999999999e-05 2023-09-30T17:04:15.256 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:15.256 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:15.256 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:15.256 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.256 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.256 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109559 4.36 4:6da220e6:::100000001f8.0000003f:head [write 2142208~4096 in=4096b,write 2183168~4096 in=4096b,write 2220032~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:15.256 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.646349+0000", 2023-09-30T17:04:15.257 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.5790921249999998, 2023-09-30T17:04:15.257 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.70604406399999997, 2023-09-30T17:04:15.257 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:15.257 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:15.257 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:15.257 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:15.257 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.257 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109559 2023-09-30T17:04:15.257 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.257 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:15.257 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.257 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:15.258 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646349+0000", 2023-09-30T17:04:15.258 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:15.258 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.258 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.258 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:15.258 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646349+0000", 2023-09-30T17:04:15.258 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:15.258 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.258 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.258 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:15.258 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646349+0000", 2023-09-30T17:04:15.258 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8500000000000002e-07 2023-09-30T17:04:15.259 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.259 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.259 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:15.259 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646360+0000", 2023-09-30T17:04:15.259 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1255e-05 2023-09-30T17:04:15.259 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.259 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.259 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:15.259 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646366+0000", 2023-09-30T17:04:15.259 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9959999999999999e-06 2023-09-30T17:04:15.259 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.259 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.260 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.260 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646371+0000", 2023-09-30T17:04:15.260 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9010000000000002e-06 2023-09-30T17:04:15.260 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.260 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.260 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:15.260 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.033938+0000", 2023-09-30T17:04:15.260 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.38756676699999998 2023-09-30T17:04:15.260 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.260 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.260 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:15.260 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.034023+0000", 2023-09-30T17:04:15.261 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5011000000000003e-05 2023-09-30T17:04:15.261 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.261 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.261 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:15.261 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.034178+0000", 2023-09-30T17:04:15.261 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000155267 2023-09-30T17:04:15.261 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.261 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.261 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:15.261 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.058961+0000", 2023-09-30T17:04:15.261 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024782786000000001 2023-09-30T17:04:15.262 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.262 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.262 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:15.262 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.352309+0000", 2023-09-30T17:04:15.262 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.29334778500000003 2023-09-30T17:04:15.262 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.262 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.262 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:15.262 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.352356+0000", 2023-09-30T17:04:15.262 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7153000000000001e-05 2023-09-30T17:04:15.262 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.262 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.263 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:15.263 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.352393+0000", 2023-09-30T17:04:15.263 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6658e-05 2023-09-30T17:04:15.263 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:15.263 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:15.263 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:15.263 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.263 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.263 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109562 4.6 4:616d4c41:::100000001f8.00000034:head [write 4071424~4096 in=4096b,write 4161536~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:15.263 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.650213+0000", 2023-09-30T17:04:15.263 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.5752274130000004, 2023-09-30T17:04:15.263 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.71023619199999999, 2023-09-30T17:04:15.264 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:15.264 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:15.264 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:15.264 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:15.264 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.264 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109562 2023-09-30T17:04:15.264 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.264 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:15.264 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.264 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:15.264 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.650213+0000", 2023-09-30T17:04:15.264 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:15.265 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.265 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.265 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:15.265 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.650213+0000", 2023-09-30T17:04:15.265 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:15.265 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.265 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.265 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:15.265 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.650214+0000", 2023-09-30T17:04:15.265 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1200000000000003e-07 2023-09-30T17:04:15.265 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.265 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.266 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:15.266 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.650227+0000", 2023-09-30T17:04:15.266 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.287e-05 2023-09-30T17:04:15.266 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.266 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.266 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:15.266 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.650235+0000", 2023-09-30T17:04:15.266 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8189999999999992e-06 2023-09-30T17:04:15.266 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.266 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.266 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.267 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.650241+0000", 2023-09-30T17:04:15.267 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3749999999999999e-06 2023-09-30T17:04:15.267 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.267 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.267 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:15.267 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.042530+0000", 2023-09-30T17:04:15.267 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39228892399999998 2023-09-30T17:04:15.267 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.267 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.267 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:15.267 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.042619+0000", 2023-09-30T17:04:15.267 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8838999999999994e-05 2023-09-30T17:04:15.267 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.268 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.268 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:15.268 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.042773+0000", 2023-09-30T17:04:15.268 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000154456 2023-09-30T17:04:15.268 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.268 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.268 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:15.268 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.059137+0000", 2023-09-30T17:04:15.268 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.016363800000000001 2023-09-30T17:04:15.268 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.268 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.268 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:15.269 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360385+0000", 2023-09-30T17:04:15.269 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.30124847199999999 2023-09-30T17:04:15.269 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.269 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.269 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:15.269 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360418+0000", 2023-09-30T17:04:15.269 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.2688000000000003e-05 2023-09-30T17:04:15.269 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.269 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.269 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:15.269 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360449+0000", 2023-09-30T17:04:15.269 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.1337000000000002e-05 2023-09-30T17:04:15.270 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:15.270 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:15.270 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:15.270 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.270 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.270 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109578 4.36 4:6fa85f86:::100000001f8.00000013:head [write 749568~4096 in=4096b,write 970752~4096 in=4096b,write 1007616~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:15.270 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.650465+0000", 2023-09-30T17:04:15.270 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.5749755680000002, 2023-09-30T17:04:15.270 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.70982843399999995, 2023-09-30T17:04:15.270 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:15.270 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:15.271 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:15.271 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:15.271 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.271 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109578 2023-09-30T17:04:15.271 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.271 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:15.271 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.271 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:15.271 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.650465+0000", 2023-09-30T17:04:15.271 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:15.271 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.271 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.272 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:15.272 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.650465+0000", 2023-09-30T17:04:15.272 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:15.272 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.272 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.272 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:15.272 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.654163+0000", 2023-09-30T17:04:15.272 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00369798 2023-09-30T17:04:15.272 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.272 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.272 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:15.272 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.654176+0000", 2023-09-30T17:04:15.273 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2765000000000001e-05 2023-09-30T17:04:15.273 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.273 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.273 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:15.273 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.654187+0000", 2023-09-30T17:04:15.273 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.078e-05 2023-09-30T17:04:15.273 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.273 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.273 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.273 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.654192+0000", 2023-09-30T17:04:15.273 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8880000000000002e-06 2023-09-30T17:04:15.273 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.274 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.274 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:15.274 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.045826+0000", 2023-09-30T17:04:15.274 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39163316300000001 2023-09-30T17:04:15.274 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.274 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.274 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:15.274 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.045900+0000", 2023-09-30T17:04:15.274 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3905000000000005e-05 2023-09-30T17:04:15.274 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.274 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.274 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:15.275 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.046309+0000", 2023-09-30T17:04:15.275 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00040957400000000001 2023-09-30T17:04:15.275 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.275 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.275 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:15.275 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.076789+0000", 2023-09-30T17:04:15.275 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.030479506999999999 2023-09-30T17:04:15.275 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.275 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.275 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:15.275 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360197+0000", 2023-09-30T17:04:15.275 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.28340816699999999 2023-09-30T17:04:15.276 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.276 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.276 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:15.276 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360254+0000", 2023-09-30T17:04:15.276 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7574000000000001e-05 2023-09-30T17:04:15.276 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.276 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.276 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:15.276 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360294+0000", 2023-09-30T17:04:15.276 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9131000000000002e-05 2023-09-30T17:04:15.276 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:15.276 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:15.277 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:15.277 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.277 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.277 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109582 4.6 4:616d4c41:::100000001f8.00000034:head [write 32768~4096 in=4096b,write 90112~4096 in=4096b,write 180224~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:15.277 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.654253+0000", 2023-09-30T17:04:15.277 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.5711873230000002, 2023-09-30T17:04:15.277 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.71919376800000001, 2023-09-30T17:04:15.277 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:15.277 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:15.277 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:15.277 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:15.277 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.278 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109582 2023-09-30T17:04:15.278 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.278 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:15.278 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.278 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:15.278 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.654253+0000", 2023-09-30T17:04:15.278 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:15.278 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.278 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.278 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:15.278 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.654253+0000", 2023-09-30T17:04:15.278 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:15.279 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.279 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.279 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:15.279 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658162+0000", 2023-09-30T17:04:15.279 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0039091320000000001 2023-09-30T17:04:15.279 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.279 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.279 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:15.279 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658178+0000", 2023-09-30T17:04:15.279 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5719e-05 2023-09-30T17:04:15.279 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.279 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.280 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:15.280 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658189+0000", 2023-09-30T17:04:15.280 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1043000000000001e-05 2023-09-30T17:04:15.280 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.280 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.280 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.280 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658198+0000", 2023-09-30T17:04:15.280 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4090000000000003e-06 2023-09-30T17:04:15.280 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.280 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.280 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:15.281 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051307+0000", 2023-09-30T17:04:15.281 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39310928899999997 2023-09-30T17:04:15.281 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.281 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.281 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:15.281 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051392+0000", 2023-09-30T17:04:15.281 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4850000000000002e-05 2023-09-30T17:04:15.281 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.281 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.281 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:15.281 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051575+0000", 2023-09-30T17:04:15.281 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00018296999999999999 2023-09-30T17:04:15.282 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.282 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.282 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:15.282 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.076797+0000", 2023-09-30T17:04:15.282 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.025222616999999999 2023-09-30T17:04:15.282 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.282 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.282 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:15.282 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.373335+0000", 2023-09-30T17:04:15.282 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.29653762299999997 2023-09-30T17:04:15.282 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.282 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.283 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:15.283 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.373404+0000", 2023-09-30T17:04:15.283 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8633999999999994e-05 2023-09-30T17:04:15.283 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.283 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.283 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:15.283 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.373447+0000", 2023-09-30T17:04:15.283 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3482000000000001e-05 2023-09-30T17:04:15.283 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:15.283 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:15.283 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:15.284 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.284 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.284 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109583 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 1945600~8192 in=8192b,write 2285568~4096 in=4096b,write 2301952~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:15.284 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.658212+0000", 2023-09-30T17:04:15.284 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.5672286490000005, 2023-09-30T17:04:15.284 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.71553887199999999, 2023-09-30T17:04:15.284 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:15.284 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:15.284 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:15.284 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:15.284 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.284 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109583 2023-09-30T17:04:15.285 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.285 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:15.285 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.285 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:15.285 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658212+0000", 2023-09-30T17:04:15.285 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:15.285 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.285 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.285 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:15.285 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658212+0000", 2023-09-30T17:04:15.285 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:15.285 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.286 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.286 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:15.286 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658213+0000", 2023-09-30T17:04:15.286 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6000000000000004e-07 2023-09-30T17:04:15.286 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.286 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.286 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:15.286 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658225+0000", 2023-09-30T17:04:15.286 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2887e-05 2023-09-30T17:04:15.286 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.286 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.287 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:15.287 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658233+0000", 2023-09-30T17:04:15.287 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2620000000000001e-06 2023-09-30T17:04:15.287 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.287 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.287 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.287 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658239+0000", 2023-09-30T17:04:15.287 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4300000000000003e-06 2023-09-30T17:04:15.287 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.287 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.287 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:15.287 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.055877+0000", 2023-09-30T17:04:15.288 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39763770799999998 2023-09-30T17:04:15.288 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.288 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.288 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:15.288 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.055965+0000", 2023-09-30T17:04:15.288 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8125000000000001e-05 2023-09-30T17:04:15.288 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.288 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.288 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:15.288 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.056131+0000", 2023-09-30T17:04:15.288 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000165971 2023-09-30T17:04:15.288 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.289 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.289 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:15.289 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.077434+0000", 2023-09-30T17:04:15.289 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.021303441999999999 2023-09-30T17:04:15.289 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.289 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.289 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:15.289 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.373658+0000", 2023-09-30T17:04:15.289 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.29622356300000002 2023-09-30T17:04:15.289 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.289 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.289 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:15.290 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.373716+0000", 2023-09-30T17:04:15.290 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8161000000000001e-05 2023-09-30T17:04:15.290 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.290 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.290 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:15.290 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.373751+0000", 2023-09-30T17:04:15.290 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4762999999999999e-05 2023-09-30T17:04:15.290 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:15.290 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:15.290 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:15.290 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.291 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.291 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109594 4.36 4:6da220e6:::100000001f8.0000003f:head [write 3932160~4096 in=4096b,write 4038656~4096 in=4096b,write 4177920~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:15.291 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.674301+0000", 2023-09-30T17:04:15.291 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.5511391769999996, 2023-09-30T17:04:15.291 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.69931127100000001, 2023-09-30T17:04:15.291 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:15.291 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:15.291 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:15.291 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:15.291 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.291 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109594 2023-09-30T17:04:15.291 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.292 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:15.292 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.292 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:15.292 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.674301+0000", 2023-09-30T17:04:15.292 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:15.292 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.292 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.292 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:15.292 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.674301+0000", 2023-09-30T17:04:15.292 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:15.292 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.293 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.293 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:15.293 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.674302+0000", 2023-09-30T17:04:15.293 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.46e-07 2023-09-30T17:04:15.293 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.293 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.293 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:15.293 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.674315+0000", 2023-09-30T17:04:15.293 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3213e-05 2023-09-30T17:04:15.293 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.293 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.293 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:15.294 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.674321+0000", 2023-09-30T17:04:15.294 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2400000000000004e-06 2023-09-30T17:04:15.294 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.294 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.294 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.294 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.674326+0000", 2023-09-30T17:04:15.294 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8670000000000002e-06 2023-09-30T17:04:15.294 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.294 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.294 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:15.294 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.059410+0000", 2023-09-30T17:04:15.295 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.38508374299999998 2023-09-30T17:04:15.295 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.295 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.295 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:15.295 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.059492+0000", 2023-09-30T17:04:15.295 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1868999999999998e-05 2023-09-30T17:04:15.295 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.295 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.295 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:15.296 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.059669+0000", 2023-09-30T17:04:15.296 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017732100000000001 2023-09-30T17:04:15.296 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.296 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.296 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:15.296 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.076933+0000", 2023-09-30T17:04:15.296 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.017263647 2023-09-30T17:04:15.296 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.296 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.296 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:15.297 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.373515+0000", 2023-09-30T17:04:15.297 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.29658226500000001 2023-09-30T17:04:15.297 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.297 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.297 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:15.297 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.373576+0000", 2023-09-30T17:04:15.297 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1245000000000001e-05 2023-09-30T17:04:15.297 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.297 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.297 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:15.298 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.373613+0000", 2023-09-30T17:04:15.298 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6415000000000003e-05 2023-09-30T17:04:15.298 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:15.298 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:15.298 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:15.298 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.298 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.298 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109602 4.6 4:616d4c41:::100000001f8.00000034:head [write 3518464~4096 in=4096b,write 3551232~4096 in=4096b,write 3563520~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:15.298 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.678286+0000", 2023-09-30T17:04:15.298 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.5471546749999998, 2023-09-30T17:04:15.298 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.69560606300000005, 2023-09-30T17:04:15.299 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:15.299 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:15.299 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:15.299 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:15.299 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.299 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109602 2023-09-30T17:04:15.299 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.299 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:15.299 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.300 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:15.300 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.678286+0000", 2023-09-30T17:04:15.300 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:15.300 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.300 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.300 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:15.300 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.678286+0000", 2023-09-30T17:04:15.300 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:15.300 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.300 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.300 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:15.301 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.678287+0000", 2023-09-30T17:04:15.301 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2399999999999998e-07 2023-09-30T17:04:15.301 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.301 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.301 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:15.301 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.678300+0000", 2023-09-30T17:04:15.301 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.324e-05 2023-09-30T17:04:15.301 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.301 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.301 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:15.301 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.678307+0000", 2023-09-30T17:04:15.302 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6499999999999996e-06 2023-09-30T17:04:15.302 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.302 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.302 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.302 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.678319+0000", 2023-09-30T17:04:15.302 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1299e-05 2023-09-30T17:04:15.302 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.302 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.302 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:15.302 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.061263+0000", 2023-09-30T17:04:15.303 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.382943743 2023-09-30T17:04:15.303 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.303 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.303 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:15.303 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.061340+0000", 2023-09-30T17:04:15.303 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7254000000000003e-05 2023-09-30T17:04:15.303 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.303 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.303 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:15.303 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.061491+0000", 2023-09-30T17:04:15.303 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015150799999999999 2023-09-30T17:04:15.304 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.304 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.304 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:15.304 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.077440+0000", 2023-09-30T17:04:15.304 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.015948721999999999 2023-09-30T17:04:15.304 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.304 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.304 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:15.304 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.373804+0000", 2023-09-30T17:04:15.304 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.29636358499999998 2023-09-30T17:04:15.304 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.305 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.305 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:15.305 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.373858+0000", 2023-09-30T17:04:15.305 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4667999999999999e-05 2023-09-30T17:04:15.305 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.305 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.305 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:15.305 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.373892+0000", 2023-09-30T17:04:15.305 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3769999999999997e-05 2023-09-30T17:04:15.305 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:15.305 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:15.305 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:15.306 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.306 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.306 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109673 4.6 4:63e80496:::100000001f8.0000001e:head [write 1171456~4096 in=4096b,write 1191936~4096 in=4096b,write 1306624~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:15.306 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.702252+0000", 2023-09-30T17:04:15.306 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.5231883029999995, 2023-09-30T17:04:15.306 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.69650071899999999, 2023-09-30T17:04:15.306 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:15.306 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:15.306 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:15.306 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:15.307 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.307 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109673 2023-09-30T17:04:15.307 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.307 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:15.307 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.307 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:15.307 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.702252+0000", 2023-09-30T17:04:15.307 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:15.307 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.307 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.307 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:15.307 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.702252+0000", 2023-09-30T17:04:15.308 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:15.308 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.308 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.308 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:15.308 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.704165+0000", 2023-09-30T17:04:15.308 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0019122029999999999 2023-09-30T17:04:15.308 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.308 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.308 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:15.308 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.704186+0000", 2023-09-30T17:04:15.308 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1418999999999999e-05 2023-09-30T17:04:15.308 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.309 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.309 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:15.309 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.704201+0000", 2023-09-30T17:04:15.309 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4993e-05 2023-09-30T17:04:15.309 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.309 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.309 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.309 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.704209+0000", 2023-09-30T17:04:15.309 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.588e-06 2023-09-30T17:04:15.309 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.309 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.309 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:15.310 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.086167+0000", 2023-09-30T17:04:15.310 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.38195870999999998 2023-09-30T17:04:15.310 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.310 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.310 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:15.310 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.086224+0000", 2023-09-30T17:04:15.310 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6711e-05 2023-09-30T17:04:15.310 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.310 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.310 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:15.310 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.086332+0000", 2023-09-30T17:04:15.311 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000107865 2023-09-30T17:04:15.311 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.311 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.311 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:15.311 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.106480+0000", 2023-09-30T17:04:15.311 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.02014817 2023-09-30T17:04:15.311 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.311 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.311 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:15.311 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.398668+0000", 2023-09-30T17:04:15.311 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.29218772599999998 2023-09-30T17:04:15.311 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.312 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.312 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:15.312 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.398708+0000", 2023-09-30T17:04:15.312 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0176999999999998e-05 2023-09-30T17:04:15.312 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.312 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.312 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:15.312 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.398753+0000", 2023-09-30T17:04:15.312 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5157000000000002e-05 2023-09-30T17:04:15.312 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:15.312 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:15.312 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:15.313 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.313 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.313 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109683 4.36 4:6fa85f86:::100000001f8.00000013:head [write 491520~4096 in=4096b,write 573440~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:15.313 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.704390+0000", 2023-09-30T17:04:15.313 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.5210510199999998, 2023-09-30T17:04:15.313 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.70242975500000004, 2023-09-30T17:04:15.313 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:15.313 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:15.313 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:15.313 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:15.313 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.314 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109683 2023-09-30T17:04:15.314 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.314 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:15.314 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.314 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:15.314 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.704390+0000", 2023-09-30T17:04:15.314 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:15.314 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.314 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.314 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:15.314 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.704390+0000", 2023-09-30T17:04:15.314 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:15.315 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.315 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.315 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:15.315 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.704390+0000", 2023-09-30T17:04:15.315 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1800000000000001e-07 2023-09-30T17:04:15.315 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.315 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.315 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:15.315 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.704412+0000", 2023-09-30T17:04:15.315 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1767999999999999e-05 2023-09-30T17:04:15.315 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.315 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.316 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:15.316 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.705174+0000", 2023-09-30T17:04:15.316 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00076232000000000003 2023-09-30T17:04:15.316 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.316 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.316 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.316 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.705184+0000", 2023-09-30T17:04:15.316 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0210000000000001e-05 2023-09-30T17:04:15.316 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.316 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.316 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:15.316 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.090705+0000", 2023-09-30T17:04:15.317 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.385520737 2023-09-30T17:04:15.317 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.317 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.317 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:15.317 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.090779+0000", 2023-09-30T17:04:15.317 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3716999999999999e-05 2023-09-30T17:04:15.317 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.317 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.317 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:15.317 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.090923+0000", 2023-09-30T17:04:15.317 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014392800000000001 2023-09-30T17:04:15.317 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.318 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.318 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:15.318 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.111435+0000", 2023-09-30T17:04:15.318 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.020512117999999999 2023-09-30T17:04:15.318 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.318 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.318 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:15.318 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.406730+0000", 2023-09-30T17:04:15.318 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.29529477999999998 2023-09-30T17:04:15.318 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.318 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.319 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:15.319 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.406786+0000", 2023-09-30T17:04:15.319 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6088999999999998e-05 2023-09-30T17:04:15.319 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.319 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.319 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:15.319 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.406819+0000", 2023-09-30T17:04:15.319 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3670000000000001e-05 2023-09-30T17:04:15.319 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:15.319 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:15.319 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:15.319 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.320 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.320 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109692 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 2957312~4096 in=4096b,write 3039232~4096 in=4096b,write 3047424~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:15.320 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.707348+0000", 2023-09-30T17:04:15.320 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.5180927679999998, 2023-09-30T17:04:15.320 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.70916258899999995, 2023-09-30T17:04:15.320 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:15.320 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:15.320 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:15.320 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:15.320 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.320 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109692 2023-09-30T17:04:15.320 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.321 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:15.321 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.321 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:15.321 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.707348+0000", 2023-09-30T17:04:15.321 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:15.321 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.321 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.321 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:15.321 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.707348+0000", 2023-09-30T17:04:15.321 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:15.321 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.321 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.322 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:15.322 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.707348+0000", 2023-09-30T17:04:15.322 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8400000000000004e-07 2023-09-30T17:04:15.322 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.322 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.322 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:15.322 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.707362+0000", 2023-09-30T17:04:15.322 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3131e-05 2023-09-30T17:04:15.322 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.322 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.322 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:15.323 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.707369+0000", 2023-09-30T17:04:15.323 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.875e-06 2023-09-30T17:04:15.323 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.323 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.323 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.323 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.707375+0000", 2023-09-30T17:04:15.323 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7799999999999997e-06 2023-09-30T17:04:15.323 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.323 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.323 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:15.323 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.093520+0000", 2023-09-30T17:04:15.323 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.38614510299999999 2023-09-30T17:04:15.324 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.324 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.324 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:15.324 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.093592+0000", 2023-09-30T17:04:15.324 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1588999999999995e-05 2023-09-30T17:04:15.324 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.324 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.324 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:15.324 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.093734+0000", 2023-09-30T17:04:15.324 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014193800000000001 2023-09-30T17:04:15.324 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.324 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.325 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:15.325 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.111441+0000", 2023-09-30T17:04:15.325 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.017706676000000001 2023-09-30T17:04:15.325 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.325 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.325 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:15.325 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.416425+0000", 2023-09-30T17:04:15.325 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.30498444499999999 2023-09-30T17:04:15.325 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.325 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.325 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:15.325 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.416475+0000", 2023-09-30T17:04:15.326 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0427999999999999e-05 2023-09-30T17:04:15.326 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.326 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.326 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:15.326 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.416510+0000", 2023-09-30T17:04:15.326 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5040000000000003e-05 2023-09-30T17:04:15.326 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:15.326 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:15.326 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:15.326 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.326 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.327 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109697 4.6 4:63e80496:::100000001f8.0000001e:head [write 1617920~4096 in=4096b,write 1830912~4096 in=4096b,write 1875968~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:15.327 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.711270+0000", 2023-09-30T17:04:15.327 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.5141703949999998, 2023-09-30T17:04:15.327 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.70601983400000001, 2023-09-30T17:04:15.327 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:15.327 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:15.327 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:15.327 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:15.327 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.327 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109697 2023-09-30T17:04:15.327 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.328 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:15.328 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.328 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:15.328 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.711270+0000", 2023-09-30T17:04:15.328 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:15.328 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.328 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.328 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:15.328 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.711270+0000", 2023-09-30T17:04:15.328 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:15.328 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.328 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.329 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:15.329 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.711271+0000", 2023-09-30T17:04:15.329 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4400000000000001e-07 2023-09-30T17:04:15.329 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.329 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.329 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:15.329 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.711284+0000", 2023-09-30T17:04:15.329 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.342e-05 2023-09-30T17:04:15.329 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.329 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.329 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:15.329 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.711296+0000", 2023-09-30T17:04:15.330 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2309e-05 2023-09-30T17:04:15.330 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.330 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.330 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.330 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.711303+0000", 2023-09-30T17:04:15.330 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9789999999999996e-06 2023-09-30T17:04:15.330 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.330 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.330 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:15.330 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.098461+0000", 2023-09-30T17:04:15.330 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.38715737300000003 2023-09-30T17:04:15.331 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.331 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.331 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:15.331 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.098551+0000", 2023-09-30T17:04:15.331 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.0610000000000002e-05 2023-09-30T17:04:15.331 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.331 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.331 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:15.331 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.098728+0000", 2023-09-30T17:04:15.331 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017616499999999999 2023-09-30T17:04:15.331 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.331 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.332 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:15.332 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.123046+0000", 2023-09-30T17:04:15.332 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024318095000000001 2023-09-30T17:04:15.332 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.332 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.332 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:15.332 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.417208+0000", 2023-09-30T17:04:15.332 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.29416202499999999 2023-09-30T17:04:15.332 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.332 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.332 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:15.332 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.417257+0000", 2023-09-30T17:04:15.333 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9249999999999998e-05 2023-09-30T17:04:15.333 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.333 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.333 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:15.333 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.417290+0000", 2023-09-30T17:04:15.333 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3164000000000003e-05 2023-09-30T17:04:15.333 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:15.333 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:15.333 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:15.333 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.333 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.334 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109719 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 3416064~4096 in=4096b,write 3436544~4096 in=4096b,write 3448832~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:15.334 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.719273+0000", 2023-09-30T17:04:15.334 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.5061680810000002, 2023-09-30T17:04:15.334 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.69986670399999995, 2023-09-30T17:04:15.334 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:15.334 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:15.334 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:15.334 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:15.334 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.334 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109719 2023-09-30T17:04:15.334 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.334 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:15.335 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.335 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:15.335 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.719273+0000", 2023-09-30T17:04:15.335 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:15.335 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.335 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.335 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:15.335 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.719273+0000", 2023-09-30T17:04:15.335 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:15.335 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.335 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.336 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:15.336 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.719273+0000", 2023-09-30T17:04:15.336 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0399999999999996e-07 2023-09-30T17:04:15.336 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.336 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.336 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:15.336 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.719288+0000", 2023-09-30T17:04:15.336 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4516e-05 2023-09-30T17:04:15.336 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.336 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.336 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:15.337 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.719297+0000", 2023-09-30T17:04:15.337 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.6129999999999993e-06 2023-09-30T17:04:15.337 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.337 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.337 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.337 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.719305+0000", 2023-09-30T17:04:15.337 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.306e-06 2023-09-30T17:04:15.337 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.337 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.337 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:15.337 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.111467+0000", 2023-09-30T17:04:15.337 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.392162185 2023-09-30T17:04:15.338 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.338 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.338 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:15.338 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.111550+0000", 2023-09-30T17:04:15.338 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3410000000000003e-05 2023-09-30T17:04:15.338 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.338 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.338 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:15.338 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.111723+0000", 2023-09-30T17:04:15.338 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017283899999999999 2023-09-30T17:04:15.338 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.339 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.339 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:15.339 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.146287+0000", 2023-09-30T17:04:15.339 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.034563582000000002 2023-09-30T17:04:15.339 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.339 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.339 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:15.339 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.419037+0000", 2023-09-30T17:04:15.339 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.272750206 2023-09-30T17:04:15.339 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.339 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.339 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:15.340 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.419100+0000", 2023-09-30T17:04:15.340 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2884000000000003e-05 2023-09-30T17:04:15.340 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.340 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.340 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:15.340 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.419139+0000", 2023-09-30T17:04:15.340 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9558999999999999e-05 2023-09-30T17:04:15.340 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:15.340 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:15.340 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:15.340 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.340 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.341 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109739 4.6 4:616d4c41:::100000001f8.00000034:head [write 471040~4096 in=4096b,write 512000~4096 in=4096b,write 548864~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:15.341 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.729634+0000", 2023-09-30T17:04:15.341 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.4958065879999998, 2023-09-30T17:04:15.341 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.69994692599999997, 2023-09-30T17:04:15.341 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:15.341 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:15.341 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:15.341 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:15.341 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.341 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109739 2023-09-30T17:04:15.341 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.341 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:15.342 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.342 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:15.342 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.729634+0000", 2023-09-30T17:04:15.342 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:15.342 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.342 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.342 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:15.342 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.729634+0000", 2023-09-30T17:04:15.342 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:15.342 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.342 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.343 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:15.343 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.731164+0000", 2023-09-30T17:04:15.343 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0015297399999999999 2023-09-30T17:04:15.343 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.343 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.343 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:15.343 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.731180+0000", 2023-09-30T17:04:15.343 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6288000000000001e-05 2023-09-30T17:04:15.343 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.343 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.343 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:15.343 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.731193+0000", 2023-09-30T17:04:15.344 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3362e-05 2023-09-30T17:04:15.344 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.344 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.344 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.344 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.731201+0000", 2023-09-30T17:04:15.344 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9310000000000008e-06 2023-09-30T17:04:15.344 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.344 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.344 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:15.344 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.117287+0000", 2023-09-30T17:04:15.344 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.38608599500000002 2023-09-30T17:04:15.345 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.345 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.345 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:15.345 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.117357+0000", 2023-09-30T17:04:15.345 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9683000000000004e-05 2023-09-30T17:04:15.345 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.345 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.345 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:15.345 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.117526+0000", 2023-09-30T17:04:15.345 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016906399999999999 2023-09-30T17:04:15.345 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.345 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.346 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:15.346 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.146293+0000", 2023-09-30T17:04:15.346 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.028767310000000001 2023-09-30T17:04:15.346 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.346 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.346 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:15.346 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.429490+0000", 2023-09-30T17:04:15.346 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.28319694400000001 2023-09-30T17:04:15.346 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.346 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.346 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:15.346 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.429544+0000", 2023-09-30T17:04:15.347 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3635999999999999e-05 2023-09-30T17:04:15.347 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.347 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.347 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:15.347 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.429581+0000", 2023-09-30T17:04:15.347 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6973e-05 2023-09-30T17:04:15.347 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:15.347 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:15.347 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:15.347 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.347 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.347 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109743 4.36 4:6da220e6:::100000001f8.0000003f:head [write 73728~4096 in=4096b,write 90112~4096 in=4096b,write 475136~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:15.348 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.731305+0000", 2023-09-30T17:04:15.348 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.4941354320000002, 2023-09-30T17:04:15.348 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.69236546499999996, 2023-09-30T17:04:15.348 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:15.348 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:15.348 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:15.348 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:15.348 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.348 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109743 2023-09-30T17:04:15.348 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.348 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:15.349 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.349 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:15.349 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.731305+0000", 2023-09-30T17:04:15.349 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:15.349 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.349 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.349 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:15.349 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.731305+0000", 2023-09-30T17:04:15.349 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:15.349 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.349 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.349 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:15.350 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.731306+0000", 2023-09-30T17:04:15.350 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4799999999999998e-07 2023-09-30T17:04:15.350 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.350 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.350 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:15.350 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.731319+0000", 2023-09-30T17:04:15.350 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2982999999999999e-05 2023-09-30T17:04:15.350 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.350 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.350 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:15.351 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.731327+0000", 2023-09-30T17:04:15.351 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6799999999999993e-06 2023-09-30T17:04:15.351 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.351 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.351 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.351 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.731333+0000", 2023-09-30T17:04:15.351 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.6490000000000002e-06 2023-09-30T17:04:15.351 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.351 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.351 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:15.351 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.121729+0000", 2023-09-30T17:04:15.352 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39039577199999997 2023-09-30T17:04:15.352 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.352 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.352 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:15.352 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.121811+0000", 2023-09-30T17:04:15.352 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1966999999999996e-05 2023-09-30T17:04:15.352 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.352 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.352 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:15.352 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.121982+0000", 2023-09-30T17:04:15.352 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017118499999999999 2023-09-30T17:04:15.352 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.353 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.353 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:15.353 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.158607+0000", 2023-09-30T17:04:15.353 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.036625090999999999 2023-09-30T17:04:15.353 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.353 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.353 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:15.353 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.423611+0000", 2023-09-30T17:04:15.353 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.26500405799999999 2023-09-30T17:04:15.353 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.353 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.354 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:15.354 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.423646+0000", 2023-09-30T17:04:15.354 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4511000000000002e-05 2023-09-30T17:04:15.354 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.354 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.354 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:15.354 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.423671+0000", 2023-09-30T17:04:15.354 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4921000000000001e-05 2023-09-30T17:04:15.354 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:15.354 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:15.354 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:15.354 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.355 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.355 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109753 4.36 4:6fa85f86:::100000001f8.00000013:head [write 323584~4096,write 372736~4096,write 405504~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:15.355 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.735275+0000", 2023-09-30T17:04:15.355 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.49016532, 2023-09-30T17:04:15.355 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.69442762599999996, 2023-09-30T17:04:15.355 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:15.355 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:15.355 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:15.355 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:15.355 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.355 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109753 2023-09-30T17:04:15.356 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.356 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:15.356 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.356 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:15.356 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.735275+0000", 2023-09-30T17:04:15.356 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:15.356 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.356 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.356 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:15.356 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.735275+0000", 2023-09-30T17:04:15.356 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:15.356 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.357 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.357 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:15.357 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.737163+0000", 2023-09-30T17:04:15.357 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0018874359999999999 2023-09-30T17:04:15.357 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.357 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.357 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:15.357 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.737179+0000", 2023-09-30T17:04:15.357 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6144999999999999e-05 2023-09-30T17:04:15.357 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.357 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.357 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:15.358 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.737190+0000", 2023-09-30T17:04:15.358 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0674e-05 2023-09-30T17:04:15.358 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.358 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.358 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.358 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.737201+0000", 2023-09-30T17:04:15.358 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1395e-05 2023-09-30T17:04:15.358 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.358 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.360 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:15.360 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.128199+0000", 2023-09-30T17:04:15.360 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39099774399999998 2023-09-30T17:04:15.360 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.360 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.360 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:15.360 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.128286+0000", 2023-09-30T17:04:15.360 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.6990000000000006e-05 2023-09-30T17:04:15.360 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.361 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.361 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:15.361 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.128457+0000", 2023-09-30T17:04:15.361 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000171535 2023-09-30T17:04:15.361 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.361 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.361 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:15.361 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.158751+0000", 2023-09-30T17:04:15.361 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.030294116999999999 2023-09-30T17:04:15.361 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.361 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.361 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:15.362 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.429622+0000", 2023-09-30T17:04:15.362 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.270870528 2023-09-30T17:04:15.362 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.362 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.362 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:15.362 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.429670+0000", 2023-09-30T17:04:15.362 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7997999999999997e-05 2023-09-30T17:04:15.362 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.362 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.362 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:15.362 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.429703+0000", 2023-09-30T17:04:15.363 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3064000000000001e-05 2023-09-30T17:04:15.363 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:15.363 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:15.363 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:15.363 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.363 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.363 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109754 4.6 4:616d4c41:::100000001f8.00000034:head [write 2998272~4096 in=4096b,write 3006464~4096 in=4096b,write 3014656~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:15.363 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.737214+0000", 2023-09-30T17:04:15.363 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.4882267069999999, 2023-09-30T17:04:15.363 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.69251004299999996, 2023-09-30T17:04:15.363 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:15.364 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:15.364 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:15.364 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:15.364 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.364 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109754 2023-09-30T17:04:15.364 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.364 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:15.364 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.364 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:15.364 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.737214+0000", 2023-09-30T17:04:15.364 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:15.364 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.365 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.365 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:15.365 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.737214+0000", 2023-09-30T17:04:15.365 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:15.365 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.365 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.365 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:15.365 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.739164+0000", 2023-09-30T17:04:15.365 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001949943 2023-09-30T17:04:15.365 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.365 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.365 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:15.366 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.739180+0000", 2023-09-30T17:04:15.366 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5862000000000002e-05 2023-09-30T17:04:15.366 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.366 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.366 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:15.366 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.739190+0000", 2023-09-30T17:04:15.366 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8009999999999998e-06 2023-09-30T17:04:15.366 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.366 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.366 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.366 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.739195+0000", 2023-09-30T17:04:15.366 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5990000000000001e-06 2023-09-30T17:04:15.367 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.367 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.367 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:15.367 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.126921+0000", 2023-09-30T17:04:15.367 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.38772617799999998 2023-09-30T17:04:15.367 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.367 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.367 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:15.367 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.126995+0000", 2023-09-30T17:04:15.367 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3647999999999997e-05 2023-09-30T17:04:15.367 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.367 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.368 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:15.368 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.127141+0000", 2023-09-30T17:04:15.368 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000145833 2023-09-30T17:04:15.368 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.368 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.368 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:15.368 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.158784+0000", 2023-09-30T17:04:15.368 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.031642925000000002 2023-09-30T17:04:15.368 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.368 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.368 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:15.369 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.429643+0000", 2023-09-30T17:04:15.369 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.270859395 2023-09-30T17:04:15.369 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.369 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.369 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:15.369 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.429691+0000", 2023-09-30T17:04:15.369 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7614999999999997e-05 2023-09-30T17:04:15.369 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:15.369 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:15.369 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:15.369 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.429724+0000", 2023-09-30T17:04:15.370 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3244000000000002e-05 2023-09-30T17:04:15.370 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:15.370 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:15.370 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:15.370 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:15.370 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:15.370 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:04:15.370 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:04:15.371 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:15.359+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:15.460 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:15.460+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:15.560 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~88s 2023-09-30T17:04:15.561 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:15.561+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:15.606 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:04:15.607 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2023-09-30T17:04:15.607 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.607 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124562 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.607 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.086800+0000", 2023-09-30T17:04:15.607 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.48455333299999997, 2023-09-30T17:04:15.607 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.48457974500000001, 2023-09-30T17:04:15.607 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.607 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.607 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.608 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.608 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.608 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124562 2023-09-30T17:04:15.608 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.608 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.608 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.608 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.608 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.086800+0000", 2023-09-30T17:04:15.608 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.608 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.608 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.609 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.609 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.086800+0000", 2023-09-30T17:04:15.609 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.609 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.609 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.609 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.609 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.086801+0000", 2023-09-30T17:04:15.609 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.96e-07 2023-09-30T17:04:15.609 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.609 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.609 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.609 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.086812+0000", 2023-09-30T17:04:15.610 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.172e-05 2023-09-30T17:04:15.610 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.610 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.610 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.610 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.086818+0000", 2023-09-30T17:04:15.610 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6370000000000004e-06 2023-09-30T17:04:15.610 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.610 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.610 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.610 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.086823+0000", 2023-09-30T17:04:15.611 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6190000000000002e-06 2023-09-30T17:04:15.611 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.611 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.611 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.611 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.611 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.611 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:123637 4.36 e53/17)", 2023-09-30T17:04:15.611 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.103565+0000", 2023-09-30T17:04:15.611 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.467788598, 2023-09-30T17:04:15.611 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.46788580699999999, 2023-09-30T17:04:15.611 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.611 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.612 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.612 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.612 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.612 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.103565+0000", 2023-09-30T17:04:15.612 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.612 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.612 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.612 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.612 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.103565+0000", 2023-09-30T17:04:15.612 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.612 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.613 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.613 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.613 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.103566+0000", 2023-09-30T17:04:15.613 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6599999999999995e-07 2023-09-30T17:04:15.613 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.613 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.613 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.613 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.103577+0000", 2023-09-30T17:04:15.613 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1599e-05 2023-09-30T17:04:15.613 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.613 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.614 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.614 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.103589+0000", 2023-09-30T17:04:15.614 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1542999999999999e-05 2023-09-30T17:04:15.614 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.614 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.614 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.614 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.103595+0000", 2023-09-30T17:04:15.614 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1e-06 2023-09-30T17:04:15.614 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.614 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.614 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.615 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.615 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.615 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:123685 4.36 e53/17)", 2023-09-30T17:04:15.615 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.151689+0000", 2023-09-30T17:04:15.615 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.41966430999999998, 2023-09-30T17:04:15.615 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.419811304, 2023-09-30T17:04:15.615 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.615 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.615 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.615 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.615 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.615 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.151689+0000", 2023-09-30T17:04:15.616 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.616 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.616 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.616 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.616 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.151689+0000", 2023-09-30T17:04:15.616 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.616 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.616 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.616 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.616 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.151690+0000", 2023-09-30T17:04:15.616 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7500000000000001e-07 2023-09-30T17:04:15.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.617 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.617 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.617 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.151698+0000", 2023-09-30T17:04:15.617 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0979999999999994e-06 2023-09-30T17:04:15.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.617 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.617 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.617 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.151703+0000", 2023-09-30T17:04:15.617 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0919999999999997e-06 2023-09-30T17:04:15.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.617 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.618 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.618 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.151713+0000", 2023-09-30T17:04:15.618 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0535e-05 2023-09-30T17:04:15.618 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.618 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.618 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.618 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.618 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.618 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124971 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.618 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.250646+0000", 2023-09-30T17:04:15.618 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.32070727199999999, 2023-09-30T17:04:15.619 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.32092945499999997, 2023-09-30T17:04:15.619 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.619 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.619 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.619 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.619 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.619 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124971 2023-09-30T17:04:15.619 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.619 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.620 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.620 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.620 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.250646+0000", 2023-09-30T17:04:15.620 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.620 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.620 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.620 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.620 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.250646+0000", 2023-09-30T17:04:15.620 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.620 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.620 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.621 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.621 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.252515+0000", 2023-09-30T17:04:15.621 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001869075 2023-09-30T17:04:15.621 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.621 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.621 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.621 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.252533+0000", 2023-09-30T17:04:15.621 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8017999999999999e-05 2023-09-30T17:04:15.621 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.621 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.621 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.621 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.252543+0000", 2023-09-30T17:04:15.622 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8630000000000003e-06 2023-09-30T17:04:15.622 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.622 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.622 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.622 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.252549+0000", 2023-09-30T17:04:15.622 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3680000000000001e-06 2023-09-30T17:04:15.622 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.622 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.622 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.622 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.622 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.623 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124068 4.6 e53/17)", 2023-09-30T17:04:15.623 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.334965+0000", 2023-09-30T17:04:15.623 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.23638868900000001, 2023-09-30T17:04:15.623 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.23666838000000001, 2023-09-30T17:04:15.623 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.623 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.623 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.623 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.623 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.623 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.334965+0000", 2023-09-30T17:04:15.623 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.623 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.624 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.624 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.624 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.334965+0000", 2023-09-30T17:04:15.624 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.624 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.624 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.624 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.624 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.334966+0000", 2023-09-30T17:04:15.624 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5600000000000005e-07 2023-09-30T17:04:15.624 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.624 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.625 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.625 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.334991+0000", 2023-09-30T17:04:15.625 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5819000000000001e-05 2023-09-30T17:04:15.625 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.625 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.625 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.625 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.335001+0000", 2023-09-30T17:04:15.625 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5009999999999993e-06 2023-09-30T17:04:15.625 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.625 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.625 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.626 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.335008+0000", 2023-09-30T17:04:15.626 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1400000000000002e-06 2023-09-30T17:04:15.626 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.626 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.626 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.626 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.626 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.626 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125418 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.626 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.405563+0000", 2023-09-30T17:04:15.626 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.16579099, 2023-09-30T17:04:15.626 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.16612165800000001, 2023-09-30T17:04:15.627 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.627 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.627 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.627 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.627 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.627 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125418 2023-09-30T17:04:15.627 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.627 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.627 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.627 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.627 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.405563+0000", 2023-09-30T17:04:15.627 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.628 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.628 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.628 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.628 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.405563+0000", 2023-09-30T17:04:15.628 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.628 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.628 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.628 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.629 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.407518+0000", 2023-09-30T17:04:15.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019550100000000001 2023-09-30T17:04:15.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.629 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.407535+0000", 2023-09-30T17:04:15.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6943999999999999e-05 2023-09-30T17:04:15.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.629 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.407548+0000", 2023-09-30T17:04:15.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3555e-05 2023-09-30T17:04:15.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.630 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.407557+0000", 2023-09-30T17:04:15.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5040000000000002e-06 2023-09-30T17:04:15.630 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.630 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.630 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.631 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124302 4.36 e53/17)", 2023-09-30T17:04:15.631 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.417896+0000", 2023-09-30T17:04:15.631 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.15345791, 2023-09-30T17:04:15.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.153841066, 2023-09-30T17:04:15.631 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.631 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.631 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.631 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.631 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.631 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.417896+0000", 2023-09-30T17:04:15.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.632 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.632 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.632 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.632 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.417896+0000", 2023-09-30T17:04:15.632 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.632 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.632 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.632 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.632 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.417896+0000", 2023-09-30T17:04:15.632 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8699999999999999e-07 2023-09-30T17:04:15.632 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.632 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.633 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.633 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.417914+0000", 2023-09-30T17:04:15.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7980000000000001e-05 2023-09-30T17:04:15.633 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.633 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.633 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.633 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.417922+0000", 2023-09-30T17:04:15.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0420000000000003e-06 2023-09-30T17:04:15.633 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.633 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.633 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.633 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.417927+0000", 2023-09-30T17:04:15.634 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.741e-06 2023-09-30T17:04:15.634 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.634 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.634 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.634 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.634 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124431 4.6 e53/17)", 2023-09-30T17:04:15.634 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.448343+0000", 2023-09-30T17:04:15.634 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.123010208, 2023-09-30T17:04:15.634 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.123439013, 2023-09-30T17:04:15.634 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.635 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.635 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.448343+0000", 2023-09-30T17:04:15.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.448343+0000", 2023-09-30T17:04:15.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.448344+0000", 2023-09-30T17:04:15.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9999999999999999e-07 2023-09-30T17:04:15.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.448359+0000", 2023-09-30T17:04:15.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5673999999999999e-05 2023-09-30T17:04:15.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.637 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.637 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.448366+0000", 2023-09-30T17:04:15.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2330000000000003e-06 2023-09-30T17:04:15.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.637 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.637 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.448370+0000", 2023-09-30T17:04:15.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8960000000000002e-06 2023-09-30T17:04:15.637 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.637 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.637 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.638 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.638 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125609 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.638 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.469554+0000", 2023-09-30T17:04:15.638 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.101799838, 2023-09-30T17:04:15.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.102276466, 2023-09-30T17:04:15.638 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.638 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.638 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.638 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.638 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.639 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125609 2023-09-30T17:04:15.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.639 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.469554+0000", 2023-09-30T17:04:15.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.469554+0000", 2023-09-30T17:04:15.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.469554+0000", 2023-09-30T17:04:15.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2199999999999999e-07 2023-09-30T17:04:15.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.469566+0000", 2023-09-30T17:04:15.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2223e-05 2023-09-30T17:04:15.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.641 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.469572+0000", 2023-09-30T17:04:15.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0129999999999999e-06 2023-09-30T17:04:15.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.641 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.469577+0000", 2023-09-30T17:04:15.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0860000000000001e-06 2023-09-30T17:04:15.641 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.641 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.641 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.642 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.642 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124556 4.6 e53/17)", 2023-09-30T17:04:15.642 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.486145+0000", 2023-09-30T17:04:15.642 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.085208405000000001, 2023-09-30T17:04:15.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.085736535000000003, 2023-09-30T17:04:15.642 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.642 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.642 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.642 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.642 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.642 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.486145+0000", 2023-09-30T17:04:15.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.643 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.643 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.486145+0000", 2023-09-30T17:04:15.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.643 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.643 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.486145+0000", 2023-09-30T17:04:15.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9999999999999999e-07 2023-09-30T17:04:15.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.644 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.486157+0000", 2023-09-30T17:04:15.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2046e-05 2023-09-30T17:04:15.644 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.644 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.486163+0000", 2023-09-30T17:04:15.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5289999999999999e-06 2023-09-30T17:04:15.644 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.645 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.486167+0000", 2023-09-30T17:04:15.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0980000000000004e-06 2023-09-30T17:04:15.645 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.645 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.645 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.645 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.645 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.645 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125766 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.645 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.538742+0000", 2023-09-30T17:04:15.645 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.032611824999999997, 2023-09-30T17:04:15.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033190361000000002, 2023-09-30T17:04:15.646 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.646 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.646 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.646 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.646 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.646 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125766 2023-09-30T17:04:15.646 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.646 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.646 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.646 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.646 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.538742+0000", 2023-09-30T17:04:15.646 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.647 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.647 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.538742+0000", 2023-09-30T17:04:15.647 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.647 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.647 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.538742+0000", 2023-09-30T17:04:15.647 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4700000000000002e-07 2023-09-30T17:04:15.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.648 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.538753+0000", 2023-09-30T17:04:15.648 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0922e-05 2023-09-30T17:04:15.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.648 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.538760+0000", 2023-09-30T17:04:15.648 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9999999999999999e-06 2023-09-30T17:04:15.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.538765+0000", 2023-09-30T17:04:15.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1329999999999998e-06 2023-09-30T17:04:15.649 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.649 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.649 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.649 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.649 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125826 4.23 4:c6f90462:::100000001f8.00000037:head [write 2519040~4096 in=4096b,write 3211264~4096 in=4096b,write 3239936~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.649 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.568750+0000", 2023-09-30T17:04:15.649 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0026031470000000001, 2023-09-30T17:04:15.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0032416580000000001, 2023-09-30T17:04:15.649 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.650 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:15.650 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.650 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.650 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.650 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125826 2023-09-30T17:04:15.650 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.650 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.650 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.650 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.650 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.568750+0000", 2023-09-30T17:04:15.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.651 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.651 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.651 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.568750+0000", 2023-09-30T17:04:15.651 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.651 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.651 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.652 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.568751+0000", 2023-09-30T17:04:15.652 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3900000000000005e-07 2023-09-30T17:04:15.652 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.652 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.652 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.653 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.568764+0000", 2023-09-30T17:04:15.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2833999999999999e-05 2023-09-30T17:04:15.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.653 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.653 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.568771+0000", 2023-09-30T17:04:15.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5000000000000002e-06 2023-09-30T17:04:15.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.653 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.653 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.568777+0000", 2023-09-30T17:04:15.654 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.998e-06 2023-09-30T17:04:15.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.654 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:15.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.569134+0000", 2023-09-30T17:04:15.654 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00035631999999999998 2023-09-30T17:04:15.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.654 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:15.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.569220+0000", 2023-09-30T17:04:15.654 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6859000000000003e-05 2023-09-30T17:04:15.655 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.655 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.655 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:15.655 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.569397+0000", 2023-09-30T17:04:15.655 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000176338 2023-09-30T17:04:15.655 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.655 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.655 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.655 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.655 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.656 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124656 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.656 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.121571+0000", 2023-09-30T17:04:15.656 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.44978259999999998, 2023-09-30T17:04:15.656 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.45049415900000001, 2023-09-30T17:04:15.656 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.656 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.656 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.656 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.656 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.656 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124656 2023-09-30T17:04:15.656 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.657 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.657 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.657 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.121571+0000", 2023-09-30T17:04:15.657 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.657 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.657 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.657 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.121571+0000", 2023-09-30T17:04:15.657 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.657 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.123515+0000", 2023-09-30T17:04:15.658 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00194436 2023-09-30T17:04:15.658 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.123538+0000", 2023-09-30T17:04:15.658 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2492000000000001e-05 2023-09-30T17:04:15.658 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.123550+0000", 2023-09-30T17:04:15.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1898e-05 2023-09-30T17:04:15.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.659 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.659 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.659 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.123559+0000", 2023-09-30T17:04:15.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6520000000000001e-06 2023-09-30T17:04:15.659 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.659 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.659 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.659 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.660 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124822 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.660 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.182651+0000", 2023-09-30T17:04:15.660 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.38870289600000002, 2023-09-30T17:04:15.660 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.38946932299999998, 2023-09-30T17:04:15.660 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.660 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.660 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.660 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.660 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.660 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124822 2023-09-30T17:04:15.660 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.661 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.661 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.661 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.661 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.182651+0000", 2023-09-30T17:04:15.661 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.661 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.661 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.661 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.661 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.182651+0000", 2023-09-30T17:04:15.661 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.661 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.662 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.662 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.662 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.182651+0000", 2023-09-30T17:04:15.662 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2799999999999996e-07 2023-09-30T17:04:15.662 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.662 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.662 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.662 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.182662+0000", 2023-09-30T17:04:15.662 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0771000000000001e-05 2023-09-30T17:04:15.662 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.662 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.663 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.663 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.182668+0000", 2023-09-30T17:04:15.663 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.959e-06 2023-09-30T17:04:15.663 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.663 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.663 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.663 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.182673+0000", 2023-09-30T17:04:15.663 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6929999999999998e-06 2023-09-30T17:04:15.663 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.663 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.663 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.664 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124976 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.664 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.252566+0000", 2023-09-30T17:04:15.664 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.31878731799999999, 2023-09-30T17:04:15.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.31960922400000003, 2023-09-30T17:04:15.664 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.664 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.664 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.664 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.664 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.664 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124976 2023-09-30T17:04:15.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.665 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.252566+0000", 2023-09-30T17:04:15.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.252566+0000", 2023-09-30T17:04:15.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.666 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.666 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.252567+0000", 2023-09-30T17:04:15.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9500000000000002e-07 2023-09-30T17:04:15.666 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.666 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.666 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.252583+0000", 2023-09-30T17:04:15.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.63e-05 2023-09-30T17:04:15.666 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.252597+0000", 2023-09-30T17:04:15.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.382e-05 2023-09-30T17:04:15.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.252603+0000", 2023-09-30T17:04:15.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3350000000000003e-06 2023-09-30T17:04:15.667 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.667 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.667 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.668 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125027 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.668 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.262337+0000", 2023-09-30T17:04:15.668 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.30901633899999997, 2023-09-30T17:04:15.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.30989381300000002, 2023-09-30T17:04:15.668 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.668 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.668 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.668 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.668 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.668 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125027 2023-09-30T17:04:15.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.669 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.669 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.669 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.669 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.262337+0000", 2023-09-30T17:04:15.669 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.669 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.669 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.669 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.262337+0000", 2023-09-30T17:04:15.669 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.670 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.670 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.670 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.262338+0000", 2023-09-30T17:04:15.670 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8599999999999999e-07 2023-09-30T17:04:15.670 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.670 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.670 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.670 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.262348+0000", 2023-09-30T17:04:15.670 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0633e-05 2023-09-30T17:04:15.670 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.670 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.670 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.671 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.262354+0000", 2023-09-30T17:04:15.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.993e-06 2023-09-30T17:04:15.671 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.671 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.671 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.671 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.262359+0000", 2023-09-30T17:04:15.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2229999999999998e-06 2023-09-30T17:04:15.671 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.671 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.671 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.671 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.671 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.672 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125167 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.672 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.321617+0000", 2023-09-30T17:04:15.672 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.249736137, 2023-09-30T17:04:15.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.25066902099999999, 2023-09-30T17:04:15.672 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.672 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.672 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.673 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.673 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.673 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125167 2023-09-30T17:04:15.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.673 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.674 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.674 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.321617+0000", 2023-09-30T17:04:15.674 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.674 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.674 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.321617+0000", 2023-09-30T17:04:15.674 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.674 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.675 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.321618+0000", 2023-09-30T17:04:15.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5199999999999998e-07 2023-09-30T17:04:15.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.675 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.675 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.321630+0000", 2023-09-30T17:04:15.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1977999999999999e-05 2023-09-30T17:04:15.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.675 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.675 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.321635+0000", 2023-09-30T17:04:15.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8369999999999996e-06 2023-09-30T17:04:15.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.321638+0000", 2023-09-30T17:04:15.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9960000000000002e-06 2023-09-30T17:04:15.676 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.676 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.676 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.676 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124072 4.2e e53/17)", 2023-09-30T17:04:15.676 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.335023+0000", 2023-09-30T17:04:15.677 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.236330978, 2023-09-30T17:04:15.677 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.23731771300000001, 2023-09-30T17:04:15.677 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.677 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.677 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.677 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.677 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.335023+0000", 2023-09-30T17:04:15.677 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.677 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.678 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.335023+0000", 2023-09-30T17:04:15.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.678 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.678 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.678 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.335023+0000", 2023-09-30T17:04:15.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8299999999999998e-07 2023-09-30T17:04:15.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.678 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.678 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.678 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.335036+0000", 2023-09-30T17:04:15.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2702e-05 2023-09-30T17:04:15.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.679 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.679 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.335042+0000", 2023-09-30T17:04:15.679 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6839999999999999e-06 2023-09-30T17:04:15.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.679 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.679 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.335047+0000", 2023-09-30T17:04:15.679 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8550000000000001e-06 2023-09-30T17:04:15.679 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.680 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.680 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.680 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.680 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125394 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.680 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.393563+0000", 2023-09-30T17:04:15.680 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.177790164, 2023-09-30T17:04:15.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.17882932000000001, 2023-09-30T17:04:15.680 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.680 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.680 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.681 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.681 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.681 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125394 2023-09-30T17:04:15.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.681 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.681 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.681 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.393563+0000", 2023-09-30T17:04:15.681 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.682 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.682 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.393563+0000", 2023-09-30T17:04:15.682 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.682 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.682 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.682 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.682 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.393564+0000", 2023-09-30T17:04:15.682 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6400000000000003e-07 2023-09-30T17:04:15.682 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.682 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.682 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.682 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.393579+0000", 2023-09-30T17:04:15.683 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5203e-05 2023-09-30T17:04:15.683 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.683 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.683 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.393586+0000", 2023-09-30T17:04:15.683 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5270000000000004e-06 2023-09-30T17:04:15.683 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.683 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.683 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.393591+0000", 2023-09-30T17:04:15.683 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1540000000000001e-06 2023-09-30T17:04:15.684 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.684 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.684 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.684 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.684 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125690 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.684 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.491318+0000", 2023-09-30T17:04:15.684 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.080035853000000004, 2023-09-30T17:04:15.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.081129987000000001, 2023-09-30T17:04:15.684 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.684 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.685 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.685 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.685 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.685 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125690 2023-09-30T17:04:15.685 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.685 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.685 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.685 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.491318+0000", 2023-09-30T17:04:15.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.685 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.686 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.686 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.491318+0000", 2023-09-30T17:04:15.686 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.686 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.686 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.686 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.686 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.491318+0000", 2023-09-30T17:04:15.686 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9900000000000002e-07 2023-09-30T17:04:15.686 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.686 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.686 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.686 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.491331+0000", 2023-09-30T17:04:15.687 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2751e-05 2023-09-30T17:04:15.687 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.687 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.687 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.687 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.491334+0000", 2023-09-30T17:04:15.687 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4149999999999999e-06 2023-09-30T17:04:15.687 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.687 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.687 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.687 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.491337+0000", 2023-09-30T17:04:15.687 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7870000000000002e-06 2023-09-30T17:04:15.688 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.688 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.688 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.688 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.688 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.688 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124614 4.36 e53/17)", 2023-09-30T17:04:15.688 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.504129+0000", 2023-09-30T17:04:15.688 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.067224163000000003, 2023-09-30T17:04:15.688 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.068371767999999999, 2023-09-30T17:04:15.688 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.688 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.688 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.689 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.689 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.504129+0000", 2023-09-30T17:04:15.689 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.689 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.689 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.689 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.504129+0000", 2023-09-30T17:04:15.689 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.689 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.690 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.690 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.504130+0000", 2023-09-30T17:04:15.690 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9699999999999996e-07 2023-09-30T17:04:15.690 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.690 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.690 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.504246+0000", 2023-09-30T17:04:15.690 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011613800000000001 2023-09-30T17:04:15.690 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.690 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.690 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.504255+0000", 2023-09-30T17:04:15.691 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4910000000000005e-06 2023-09-30T17:04:15.691 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.691 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.691 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.691 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.504261+0000", 2023-09-30T17:04:15.691 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3990000000000001e-06 2023-09-30T17:04:15.691 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.691 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.691 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.691 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.691 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.691 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124784 4.6 e53/17)", 2023-09-30T17:04:15.692 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.556385+0000", 2023-09-30T17:04:15.692 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.014968218, 2023-09-30T17:04:15.692 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016176795000000001, 2023-09-30T17:04:15.692 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.692 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.692 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.692 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.693 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.693 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.556385+0000", 2023-09-30T17:04:15.693 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.693 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.693 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.693 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.693 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.556385+0000", 2023-09-30T17:04:15.693 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.693 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.693 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.693 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.693 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.556386+0000", 2023-09-30T17:04:15.694 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2000000000000001e-07 2023-09-30T17:04:15.694 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.694 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.694 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.694 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.556399+0000", 2023-09-30T17:04:15.694 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2947e-05 2023-09-30T17:04:15.694 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.694 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.694 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.694 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.556407+0000", 2023-09-30T17:04:15.694 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0320000000000003e-06 2023-09-30T17:04:15.694 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.695 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.695 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.695 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.556411+0000", 2023-09-30T17:04:15.695 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.476e-06 2023-09-30T17:04:15.695 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.695 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.695 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.695 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.695 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.695 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125829 4.a 4:50194ce5:::100000001f8.00000027:head [write 331776~4096 in=4096b,write 380928~4096 in=4096b,write 442368~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.695 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.568792+0000", 2023-09-30T17:04:15.695 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.002561284, 2023-09-30T17:04:15.696 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003826346, 2023-09-30T17:04:15.696 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.696 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:15.696 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.696 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.696 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.696 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125829 2023-09-30T17:04:15.696 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.696 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.696 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.696 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.697 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.568792+0000", 2023-09-30T17:04:15.697 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.697 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.697 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.697 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.697 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.568792+0000", 2023-09-30T17:04:15.697 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.697 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.697 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.697 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.697 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.568793+0000", 2023-09-30T17:04:15.698 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5600000000000001e-07 2023-09-30T17:04:15.698 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.698 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.698 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.698 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.568811+0000", 2023-09-30T17:04:15.698 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8459999999999999e-05 2023-09-30T17:04:15.698 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.698 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.698 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.698 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.568838+0000", 2023-09-30T17:04:15.698 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7149999999999999e-05 2023-09-30T17:04:15.698 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.699 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.699 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.568847+0000", 2023-09-30T17:04:15.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6430000000000001e-06 2023-09-30T17:04:15.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.699 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:15.699 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.569673+0000", 2023-09-30T17:04:15.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00082613100000000002 2023-09-30T17:04:15.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.700 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:15.700 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.569755+0000", 2023-09-30T17:04:15.700 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2261000000000004e-05 2023-09-30T17:04:15.700 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.700 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.700 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.700 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.700 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.700 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124601 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.700 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.103661+0000", 2023-09-30T17:04:15.700 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.46769308500000001, 2023-09-30T17:04:15.700 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.46901864399999998, 2023-09-30T17:04:15.701 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.701 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.701 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.701 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.701 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.701 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124601 2023-09-30T17:04:15.701 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.701 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.701 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.701 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.701 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.103661+0000", 2023-09-30T17:04:15.701 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.702 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.702 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.702 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.702 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.103661+0000", 2023-09-30T17:04:15.702 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.702 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.702 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.702 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.702 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.103661+0000", 2023-09-30T17:04:15.702 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4300000000000003e-07 2023-09-30T17:04:15.702 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.702 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.703 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.703 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.103686+0000", 2023-09-30T17:04:15.703 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4652e-05 2023-09-30T17:04:15.703 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.703 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.703 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.703 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.103802+0000", 2023-09-30T17:04:15.703 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000116017 2023-09-30T17:04:15.703 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.703 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.703 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.703 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.103852+0000", 2023-09-30T17:04:15.704 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0120000000000001e-05 2023-09-30T17:04:15.704 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.704 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.704 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.704 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.704 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.704 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124917 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.704 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.226562+0000", 2023-09-30T17:04:15.704 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.34479128199999998, 2023-09-30T17:04:15.704 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.34618110800000002, 2023-09-30T17:04:15.704 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.704 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.705 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.705 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.705 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.705 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124917 2023-09-30T17:04:15.705 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.705 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.705 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.705 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.705 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.226562+0000", 2023-09-30T17:04:15.705 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.706 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.706 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.706 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.706 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.226562+0000", 2023-09-30T17:04:15.706 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.706 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.706 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.706 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.706 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.226563+0000", 2023-09-30T17:04:15.706 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0399999999999996e-07 2023-09-30T17:04:15.706 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.707 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.707 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.707 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.226574+0000", 2023-09-30T17:04:15.707 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0787e-05 2023-09-30T17:04:15.707 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.707 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.707 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.707 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.226580+0000", 2023-09-30T17:04:15.707 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4060000000000002e-06 2023-09-30T17:04:15.707 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.707 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.707 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.708 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.226586+0000", 2023-09-30T17:04:15.708 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5770000000000001e-06 2023-09-30T17:04:15.708 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.708 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.708 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.708 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.708 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.708 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125047 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.708 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.273566+0000", 2023-09-30T17:04:15.708 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.297787154, 2023-09-30T17:04:15.708 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.29923410900000003, 2023-09-30T17:04:15.709 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.709 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.709 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.709 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.709 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.709 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125047 2023-09-30T17:04:15.709 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.709 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.709 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.709 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.709 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.273566+0000", 2023-09-30T17:04:15.709 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.710 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.710 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.710 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.710 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.273566+0000", 2023-09-30T17:04:15.710 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.710 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.710 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.710 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.710 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.275515+0000", 2023-09-30T17:04:15.710 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019486289999999999 2023-09-30T17:04:15.710 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.710 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.711 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.711 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.275537+0000", 2023-09-30T17:04:15.711 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1520999999999999e-05 2023-09-30T17:04:15.711 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.711 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.711 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.711 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.275543+0000", 2023-09-30T17:04:15.711 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7750000000000004e-06 2023-09-30T17:04:15.711 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.711 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.711 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.711 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.275550+0000", 2023-09-30T17:04:15.712 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5420000000000002e-06 2023-09-30T17:04:15.712 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.712 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.712 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.712 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.712 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.712 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124045 4.6 e53/17)", 2023-09-30T17:04:15.712 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.322878+0000", 2023-09-30T17:04:15.712 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.24847590899999999, 2023-09-30T17:04:15.712 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.249978648, 2023-09-30T17:04:15.712 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.713 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.713 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.713 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.713 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.713 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.322878+0000", 2023-09-30T17:04:15.713 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.713 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.713 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.713 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.713 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.322878+0000", 2023-09-30T17:04:15.713 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.713 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.713 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.714 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.714 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.322878+0000", 2023-09-30T17:04:15.714 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4000000000000001e-07 2023-09-30T17:04:15.714 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.714 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.714 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.714 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.322898+0000", 2023-09-30T17:04:15.714 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9275000000000001e-05 2023-09-30T17:04:15.714 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.715 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.715 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.715 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.322910+0000", 2023-09-30T17:04:15.715 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2683e-05 2023-09-30T17:04:15.715 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.715 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.715 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.715 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.322917+0000", 2023-09-30T17:04:15.715 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7580000000000003e-06 2023-09-30T17:04:15.715 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.715 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.715 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.716 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.716 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.716 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124088 4.6 e53/17)", 2023-09-30T17:04:15.716 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.346617+0000", 2023-09-30T17:04:15.716 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.224736673, 2023-09-30T17:04:15.716 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.22628657099999999, 2023-09-30T17:04:15.716 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.716 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.716 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.716 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.716 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.716 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.346617+0000", 2023-09-30T17:04:15.717 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.717 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.717 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.717 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.717 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.346617+0000", 2023-09-30T17:04:15.717 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.717 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.717 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.717 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.717 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.346617+0000", 2023-09-30T17:04:15.717 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3799999999999999e-07 2023-09-30T17:04:15.717 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.718 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.718 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.718 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.346628+0000", 2023-09-30T17:04:15.718 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0495e-05 2023-09-30T17:04:15.718 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.718 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.718 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.718 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.346633+0000", 2023-09-30T17:04:15.718 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5500000000000002e-06 2023-09-30T17:04:15.718 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.718 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.718 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.719 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.346637+0000", 2023-09-30T17:04:15.719 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2339999999999996e-06 2023-09-30T17:04:15.719 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.719 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.719 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.719 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.719 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.719 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124120 4.36 e53/17)", 2023-09-30T17:04:15.719 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.371207+0000", 2023-09-30T17:04:15.719 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.20014680500000001, 2023-09-30T17:04:15.719 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.20174503699999999, 2023-09-30T17:04:15.719 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.720 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.720 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.720 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.720 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.720 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.371207+0000", 2023-09-30T17:04:15.720 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.720 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.720 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.720 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.720 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.371207+0000", 2023-09-30T17:04:15.720 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.721 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.721 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.721 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.721 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.371207+0000", 2023-09-30T17:04:15.721 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2499999999999999e-07 2023-09-30T17:04:15.721 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.721 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.721 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.721 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.371222+0000", 2023-09-30T17:04:15.721 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5041999999999999e-05 2023-09-30T17:04:15.721 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.721 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.722 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.722 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.371228+0000", 2023-09-30T17:04:15.722 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0140000000000004e-06 2023-09-30T17:04:15.722 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.722 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.722 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.722 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.371234+0000", 2023-09-30T17:04:15.722 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.801e-06 2023-09-30T17:04:15.722 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.722 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.722 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.722 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.723 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.723 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125570 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.723 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.455849+0000", 2023-09-30T17:04:15.723 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.11550498200000001, 2023-09-30T17:04:15.723 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.117151544, 2023-09-30T17:04:15.723 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.723 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.723 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.723 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.723 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.723 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125570 2023-09-30T17:04:15.723 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.724 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.724 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.724 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.724 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.455849+0000", 2023-09-30T17:04:15.724 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.724 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.724 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.724 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.724 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.455849+0000", 2023-09-30T17:04:15.724 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.724 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.724 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.725 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.725 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.455849+0000", 2023-09-30T17:04:15.725 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1900000000000003e-07 2023-09-30T17:04:15.725 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.725 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.725 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.725 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.455863+0000", 2023-09-30T17:04:15.725 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3555e-05 2023-09-30T17:04:15.725 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.725 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.725 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.725 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.455870+0000", 2023-09-30T17:04:15.725 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0450000000000003e-06 2023-09-30T17:04:15.726 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.726 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.726 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.726 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.455875+0000", 2023-09-30T17:04:15.726 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9309999999999999e-06 2023-09-30T17:04:15.726 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.726 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.726 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.726 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.726 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.726 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125691 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.727 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.491341+0000", 2023-09-30T17:04:15.727 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.080012824999999996, 2023-09-30T17:04:15.727 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.081716127999999999, 2023-09-30T17:04:15.727 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.727 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.727 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.727 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.727 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.727 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125691 2023-09-30T17:04:15.727 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.727 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.727 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.728 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.728 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.491341+0000", 2023-09-30T17:04:15.728 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.728 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.728 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.728 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.728 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.491341+0000", 2023-09-30T17:04:15.728 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.728 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.728 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.728 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.728 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.491341+0000", 2023-09-30T17:04:15.729 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2600000000000001e-07 2023-09-30T17:04:15.729 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.729 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.729 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.729 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.491349+0000", 2023-09-30T17:04:15.729 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1880000000000002e-06 2023-09-30T17:04:15.729 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.729 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.729 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.729 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.491352+0000", 2023-09-30T17:04:15.729 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2629999999999999e-06 2023-09-30T17:04:15.729 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.730 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.730 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.730 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.491355+0000", 2023-09-30T17:04:15.730 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7360000000000001e-06 2023-09-30T17:04:15.730 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.730 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.730 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.730 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.730 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.730 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125712 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.730 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.502600+0000", 2023-09-30T17:04:15.730 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.068753634999999994, 2023-09-30T17:04:15.731 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.070513714000000005, 2023-09-30T17:04:15.731 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.731 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.731 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.731 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.731 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.731 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125712 2023-09-30T17:04:15.731 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.731 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.731 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.731 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.732 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.502600+0000", 2023-09-30T17:04:15.732 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.732 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.732 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.732 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.732 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.502600+0000", 2023-09-30T17:04:15.732 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.732 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.732 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.732 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.733 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.504775+0000", 2023-09-30T17:04:15.733 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0021753139999999998 2023-09-30T17:04:15.733 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.733 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.733 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.733 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.504793+0000", 2023-09-30T17:04:15.733 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7625000000000002e-05 2023-09-30T17:04:15.733 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.733 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.733 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.733 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.504802+0000", 2023-09-30T17:04:15.733 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.577e-06 2023-09-30T17:04:15.734 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.734 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.734 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.734 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.504809+0000", 2023-09-30T17:04:15.734 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2389999999999999e-06 2023-09-30T17:04:15.734 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.734 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.734 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.734 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.734 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.734 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124744 4.6 e53/17)", 2023-09-30T17:04:15.735 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.542019+0000", 2023-09-30T17:04:15.735 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.029334263999999999, 2023-09-30T17:04:15.735 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.031146480000000001, 2023-09-30T17:04:15.735 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.735 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.735 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.735 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.735 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.735 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.542019+0000", 2023-09-30T17:04:15.735 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.735 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.735 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.735 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.736 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.542019+0000", 2023-09-30T17:04:15.736 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.736 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.736 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.736 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.736 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.542020+0000", 2023-09-30T17:04:15.736 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3999999999999997e-07 2023-09-30T17:04:15.736 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.736 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.736 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.736 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.542039+0000", 2023-09-30T17:04:15.736 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9536999999999999e-05 2023-09-30T17:04:15.737 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.737 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.737 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.737 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.542046+0000", 2023-09-30T17:04:15.737 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6200000000000001e-06 2023-09-30T17:04:15.737 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.737 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.737 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.737 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.542050+0000", 2023-09-30T17:04:15.737 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.72e-06 2023-09-30T17:04:15.737 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.737 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.738 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.738 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.738 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.738 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125831 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.738 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.568857+0000", 2023-09-30T17:04:15.738 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.00249651, 2023-09-30T17:04:15.738 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0043573070000000004, 2023-09-30T17:04:15.738 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.738 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.738 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.738 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.739 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.739 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125831 2023-09-30T17:04:15.739 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.739 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.739 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.739 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.739 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.568857+0000", 2023-09-30T17:04:15.739 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.739 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.739 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.739 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.739 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.568857+0000", 2023-09-30T17:04:15.739 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.740 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.740 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.740 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.740 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.568858+0000", 2023-09-30T17:04:15.740 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3099999999999998e-07 2023-09-30T17:04:15.740 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.740 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.740 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.740 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.568868+0000", 2023-09-30T17:04:15.740 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0577999999999999e-05 2023-09-30T17:04:15.740 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.741 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.741 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.741 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.568875+0000", 2023-09-30T17:04:15.741 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2989999999999999e-06 2023-09-30T17:04:15.741 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.741 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.741 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.741 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.568881+0000", 2023-09-30T17:04:15.741 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4990000000000002e-06 2023-09-30T17:04:15.741 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.741 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.741 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.742 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.742 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.742 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:123772 4.36 e53/17)", 2023-09-30T17:04:15.742 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.194162+0000", 2023-09-30T17:04:15.742 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.377191569, 2023-09-30T17:04:15.742 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.379105315, 2023-09-30T17:04:15.742 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.742 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.742 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.742 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.742 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.742 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.194162+0000", 2023-09-30T17:04:15.743 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.743 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.743 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.743 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.743 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.194162+0000", 2023-09-30T17:04:15.743 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.743 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.743 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.744 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.744 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.194162+0000", 2023-09-30T17:04:15.744 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.65e-07 2023-09-30T17:04:15.744 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.744 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.744 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.194172+0000", 2023-09-30T17:04:15.744 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3400000000000004e-06 2023-09-30T17:04:15.744 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.744 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.744 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.194177+0000", 2023-09-30T17:04:15.745 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3170000000000001e-06 2023-09-30T17:04:15.745 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.745 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.745 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.745 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.194181+0000", 2023-09-30T17:04:15.745 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3880000000000002e-06 2023-09-30T17:04:15.745 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.745 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.745 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.745 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.745 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.745 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:123807 4.36 e53/17)", 2023-09-30T17:04:15.746 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.209503+0000", 2023-09-30T17:04:15.746 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.36185040800000001, 2023-09-30T17:04:15.746 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.36380836799999999, 2023-09-30T17:04:15.746 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.746 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.746 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.746 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.746 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.746 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.209503+0000", 2023-09-30T17:04:15.746 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.746 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.746 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.747 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.747 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.209503+0000", 2023-09-30T17:04:15.747 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.747 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.747 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.747 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.747 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.209504+0000", 2023-09-30T17:04:15.747 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6899999999999998e-07 2023-09-30T17:04:15.747 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.747 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.747 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.747 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.209528+0000", 2023-09-30T17:04:15.748 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4719000000000002e-05 2023-09-30T17:04:15.748 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.748 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.748 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.748 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.209538+0000", 2023-09-30T17:04:15.748 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8009999999999998e-06 2023-09-30T17:04:15.748 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.748 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.748 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.748 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.209544+0000", 2023-09-30T17:04:15.748 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6899999999999997e-06 2023-09-30T17:04:15.748 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.749 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.749 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.749 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.749 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.749 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124979 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.749 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.252643+0000", 2023-09-30T17:04:15.749 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.318710259, 2023-09-30T17:04:15.749 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.32072661400000002, 2023-09-30T17:04:15.749 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.749 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.749 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.750 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.750 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.750 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124979 2023-09-30T17:04:15.750 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.750 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.750 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.750 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.750 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.252643+0000", 2023-09-30T17:04:15.750 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.750 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.750 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.751 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.751 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.252643+0000", 2023-09-30T17:04:15.751 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.751 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.751 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.751 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.751 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.252644+0000", 2023-09-30T17:04:15.751 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5100000000000001e-07 2023-09-30T17:04:15.751 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.751 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.751 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.751 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.252654+0000", 2023-09-30T17:04:15.752 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9399999999999997e-06 2023-09-30T17:04:15.752 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.752 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.752 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.752 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.252659+0000", 2023-09-30T17:04:15.752 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8749999999999997e-06 2023-09-30T17:04:15.752 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.752 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.752 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.752 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.252664+0000", 2023-09-30T17:04:15.752 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8910000000000003e-06 2023-09-30T17:04:15.752 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.752 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.753 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.753 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.753 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.753 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124016 4.36 e53/17)", 2023-09-30T17:04:15.753 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.308674+0000", 2023-09-30T17:04:15.753 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.26267960899999998, 2023-09-30T17:04:15.753 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.26475606099999999, 2023-09-30T17:04:15.753 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.753 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.753 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.753 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.754 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.754 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.308674+0000", 2023-09-30T17:04:15.754 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.754 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.754 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.754 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.754 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.308674+0000", 2023-09-30T17:04:15.754 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.754 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.754 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.754 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.754 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.308674+0000", 2023-09-30T17:04:15.755 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1199999999999999e-07 2023-09-30T17:04:15.755 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.755 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.755 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.755 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.308687+0000", 2023-09-30T17:04:15.755 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2848e-05 2023-09-30T17:04:15.755 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.755 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.755 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.755 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.308696+0000", 2023-09-30T17:04:15.755 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5779999999999999e-06 2023-09-30T17:04:15.755 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.756 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.756 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.756 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.308701+0000", 2023-09-30T17:04:15.756 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1290000000000004e-06 2023-09-30T17:04:15.756 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.756 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.756 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.756 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.756 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.756 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124089 4.2e e53/17)", 2023-09-30T17:04:15.756 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.346643+0000", 2023-09-30T17:04:15.756 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.224710246, 2023-09-30T17:04:15.757 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.226837126, 2023-09-30T17:04:15.757 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.757 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.757 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.757 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.757 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.757 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.346643+0000", 2023-09-30T17:04:15.757 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.757 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.757 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.757 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.757 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.346643+0000", 2023-09-30T17:04:15.758 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.758 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.758 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.758 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.758 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.346644+0000", 2023-09-30T17:04:15.758 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3099999999999999e-07 2023-09-30T17:04:15.758 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.758 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.758 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.758 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.346653+0000", 2023-09-30T17:04:15.758 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2720000000000003e-06 2023-09-30T17:04:15.759 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.759 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.759 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.759 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.346658+0000", 2023-09-30T17:04:15.759 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1610000000000002e-06 2023-09-30T17:04:15.759 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.759 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.759 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.759 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.346662+0000", 2023-09-30T17:04:15.759 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0749999999999999e-06 2023-09-30T17:04:15.759 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.759 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.760 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.760 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.760 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.760 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125299 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.760 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.356638+0000", 2023-09-30T17:04:15.760 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.21471560200000001, 2023-09-30T17:04:15.760 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.216887311, 2023-09-30T17:04:15.760 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.760 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.760 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.760 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.760 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.761 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125299 2023-09-30T17:04:15.761 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.761 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.761 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.761 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.761 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.356638+0000", 2023-09-30T17:04:15.761 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.761 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.761 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.761 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.761 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.356638+0000", 2023-09-30T17:04:15.761 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.762 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.762 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.762 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.762 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.359654+0000", 2023-09-30T17:04:15.762 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0030161440000000001 2023-09-30T17:04:15.762 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.762 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.762 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.762 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.359672+0000", 2023-09-30T17:04:15.762 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7713000000000001e-05 2023-09-30T17:04:15.762 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.762 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.763 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.763 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.359681+0000", 2023-09-30T17:04:15.763 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5859999999999994e-06 2023-09-30T17:04:15.763 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.763 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.763 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.763 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.359689+0000", 2023-09-30T17:04:15.763 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1439999999999997e-06 2023-09-30T17:04:15.763 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.763 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.763 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.763 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.764 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.764 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125622 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.764 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.471575+0000", 2023-09-30T17:04:15.764 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.099778666000000002, 2023-09-30T17:04:15.764 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.102002986, 2023-09-30T17:04:15.764 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.764 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.764 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.764 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.764 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.764 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125622 2023-09-30T17:04:15.764 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.765 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.765 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.765 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.765 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.471575+0000", 2023-09-30T17:04:15.765 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.765 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.765 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.765 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.765 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.471575+0000", 2023-09-30T17:04:15.765 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.765 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.766 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.766 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.766 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.471576+0000", 2023-09-30T17:04:15.766 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8400000000000004e-07 2023-09-30T17:04:15.766 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.766 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.766 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.766 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.471588+0000", 2023-09-30T17:04:15.766 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2666e-05 2023-09-30T17:04:15.766 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.766 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.767 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.767 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.471598+0000", 2023-09-30T17:04:15.767 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0037999999999999e-05 2023-09-30T17:04:15.767 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.767 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.767 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.767 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.471605+0000", 2023-09-30T17:04:15.767 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3770000000000001e-06 2023-09-30T17:04:15.767 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.767 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.767 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.767 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.767 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.768 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125692 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.768 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.491358+0000", 2023-09-30T17:04:15.768 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.079995104999999997, 2023-09-30T17:04:15.768 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.082281063000000002, 2023-09-30T17:04:15.768 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.768 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.768 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.768 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.768 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.768 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125692 2023-09-30T17:04:15.768 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.768 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.769 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.769 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.769 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.491358+0000", 2023-09-30T17:04:15.769 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.769 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.769 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.769 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.769 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.491358+0000", 2023-09-30T17:04:15.769 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.769 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.769 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.769 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.770 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.491359+0000", 2023-09-30T17:04:15.770 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.04e-07 2023-09-30T17:04:15.770 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.770 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.770 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.770 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.491370+0000", 2023-09-30T17:04:15.770 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1060000000000001e-05 2023-09-30T17:04:15.770 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.770 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.770 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.770 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.491373+0000", 2023-09-30T17:04:15.771 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2880000000000001e-06 2023-09-30T17:04:15.771 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.771 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.771 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.771 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.491376+0000", 2023-09-30T17:04:15.771 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8890000000000002e-06 2023-09-30T17:04:15.771 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.771 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.771 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.771 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.771 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.771 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125714 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.771 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.504821+0000", 2023-09-30T17:04:15.772 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.066532360999999998, 2023-09-30T17:04:15.772 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.068878648000000001, 2023-09-30T17:04:15.772 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.772 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.772 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.772 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.772 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.772 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125714 2023-09-30T17:04:15.772 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.772 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.772 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.773 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.773 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.504821+0000", 2023-09-30T17:04:15.773 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.773 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.773 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.773 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.773 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.504821+0000", 2023-09-30T17:04:15.773 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.773 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.773 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.773 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.774 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.504822+0000", 2023-09-30T17:04:15.774 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3500000000000002e-07 2023-09-30T17:04:15.774 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.774 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.774 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.774 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.504833+0000", 2023-09-30T17:04:15.774 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1025e-05 2023-09-30T17:04:15.774 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.774 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.774 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.774 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.504840+0000", 2023-09-30T17:04:15.774 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3390000000000004e-06 2023-09-30T17:04:15.775 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.775 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.775 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.775 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.504845+0000", 2023-09-30T17:04:15.775 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6099999999999999e-06 2023-09-30T17:04:15.775 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.775 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.775 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.775 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.775 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.775 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124745 4.36 e53/17)", 2023-09-30T17:04:15.776 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.542055+0000", 2023-09-30T17:04:15.776 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.029298109999999999, 2023-09-30T17:04:15.776 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.031704125, 2023-09-30T17:04:15.776 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.776 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.776 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.776 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.776 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.776 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.542055+0000", 2023-09-30T17:04:15.776 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.776 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.776 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.777 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.777 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.542055+0000", 2023-09-30T17:04:15.777 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.777 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.777 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.777 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.777 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.542056+0000", 2023-09-30T17:04:15.777 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8099999999999999e-07 2023-09-30T17:04:15.777 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.777 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.777 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.777 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.542066+0000", 2023-09-30T17:04:15.778 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0494e-05 2023-09-30T17:04:15.778 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.778 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.778 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.778 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.542071+0000", 2023-09-30T17:04:15.778 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8999999999999997e-06 2023-09-30T17:04:15.778 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.778 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.778 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.778 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.542074+0000", 2023-09-30T17:04:15.778 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.779e-06 2023-09-30T17:04:15.778 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.779 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.779 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.779 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.779 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.779 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125838 4.c 4:33b8095f:::100000001f8.0000003a:head [write 2846720~4096 in=4096b,write 3047424~4096 in=4096b,write 3133440~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.779 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.568888+0000", 2023-09-30T17:04:15.779 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0024655720000000001, 2023-09-30T17:04:15.779 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0049327520000000003, 2023-09-30T17:04:15.779 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.779 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:15.779 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.779 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.780 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.780 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125838 2023-09-30T17:04:15.780 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.780 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.780 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.780 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.780 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.568888+0000", 2023-09-30T17:04:15.780 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.780 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.780 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.780 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.780 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.568888+0000", 2023-09-30T17:04:15.780 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.781 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.781 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.781 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.781 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.568888+0000", 2023-09-30T17:04:15.781 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9999999999999998e-07 2023-09-30T17:04:15.781 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.781 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.781 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.781 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.568900+0000", 2023-09-30T17:04:15.781 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1732999999999999e-05 2023-09-30T17:04:15.781 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.782 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.782 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.782 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.568907+0000", 2023-09-30T17:04:15.782 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4489999999999996e-06 2023-09-30T17:04:15.782 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.782 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.782 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.782 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.568913+0000", 2023-09-30T17:04:15.782 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4999999999999996e-06 2023-09-30T17:04:15.782 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.782 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.782 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:15.783 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.568956+0000", 2023-09-30T17:04:15.783 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3371000000000002e-05 2023-09-30T17:04:15.783 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.783 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.783 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:15.783 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.569011+0000", 2023-09-30T17:04:15.783 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4268000000000003e-05 2023-09-30T17:04:15.783 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.783 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.783 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.783 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.784 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.784 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:123592 4.6 e53/17)", 2023-09-30T17:04:15.784 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.089782+0000", 2023-09-30T17:04:15.784 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.48157171399999998, 2023-09-30T17:04:15.784 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.48411405299999999, 2023-09-30T17:04:15.784 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.784 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.784 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.784 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.784 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.784 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.089782+0000", 2023-09-30T17:04:15.784 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.785 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.785 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.785 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.785 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.089782+0000", 2023-09-30T17:04:15.785 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.785 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.785 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.785 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.785 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.089782+0000", 2023-09-30T17:04:15.785 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0900000000000001e-07 2023-09-30T17:04:15.785 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.785 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.786 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.786 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.089797+0000", 2023-09-30T17:04:15.786 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4707e-05 2023-09-30T17:04:15.786 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.786 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.786 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.786 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.089805+0000", 2023-09-30T17:04:15.786 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9500000000000001e-06 2023-09-30T17:04:15.786 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.786 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.786 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.787 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.089812+0000", 2023-09-30T17:04:15.787 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4099999999999996e-06 2023-09-30T17:04:15.787 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.787 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.787 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.787 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.787 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.787 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124827 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.787 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.182735+0000", 2023-09-30T17:04:15.787 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.38861893600000003, 2023-09-30T17:04:15.787 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.39121720700000001, 2023-09-30T17:04:15.787 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.788 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.788 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.788 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.788 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.788 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124827 2023-09-30T17:04:15.788 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.788 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.788 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.788 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.788 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.182735+0000", 2023-09-30T17:04:15.788 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.788 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.788 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.789 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.789 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.182735+0000", 2023-09-30T17:04:15.789 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.789 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.789 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.789 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.789 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.182735+0000", 2023-09-30T17:04:15.789 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3500000000000002e-07 2023-09-30T17:04:15.789 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.789 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.789 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.789 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.182747+0000", 2023-09-30T17:04:15.790 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2432000000000001e-05 2023-09-30T17:04:15.790 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.790 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.790 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.790 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.182753+0000", 2023-09-30T17:04:15.790 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7379999999999999e-06 2023-09-30T17:04:15.790 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.790 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.790 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.790 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.182758+0000", 2023-09-30T17:04:15.790 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5530000000000003e-06 2023-09-30T17:04:15.790 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.791 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.791 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.791 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.791 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.791 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:123809 4.6 e53/17)", 2023-09-30T17:04:15.791 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.209561+0000", 2023-09-30T17:04:15.791 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.36179272000000001, 2023-09-30T17:04:15.791 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.36444989100000003, 2023-09-30T17:04:15.791 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.791 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.791 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.791 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.792 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.792 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.209561+0000", 2023-09-30T17:04:15.792 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.792 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.792 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.792 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.792 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.209561+0000", 2023-09-30T17:04:15.792 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.792 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.792 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.792 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.792 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.209561+0000", 2023-09-30T17:04:15.793 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1199999999999999e-07 2023-09-30T17:04:15.793 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.793 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.793 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.793 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.209572+0000", 2023-09-30T17:04:15.793 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0907000000000001e-05 2023-09-30T17:04:15.793 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.793 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.793 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.793 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.209580+0000", 2023-09-30T17:04:15.793 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9640000000000003e-06 2023-09-30T17:04:15.793 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.794 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.794 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.794 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.209585+0000", 2023-09-30T17:04:15.794 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5159999999999996e-06 2023-09-30T17:04:15.794 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.794 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.794 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.794 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.794 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.794 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124920 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.794 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.226629+0000", 2023-09-30T17:04:15.794 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.344724688, 2023-09-30T17:04:15.795 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.34743780200000002, 2023-09-30T17:04:15.795 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.795 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.795 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.795 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.795 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.795 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124920 2023-09-30T17:04:15.795 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.795 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.795 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.795 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.795 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.226629+0000", 2023-09-30T17:04:15.796 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.796 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.796 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.796 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.796 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.226629+0000", 2023-09-30T17:04:15.796 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.796 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.796 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.796 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.796 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.226629+0000", 2023-09-30T17:04:15.796 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.39e-07 2023-09-30T17:04:15.796 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.797 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.797 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.797 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.226641+0000", 2023-09-30T17:04:15.797 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1494e-05 2023-09-30T17:04:15.797 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.797 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.797 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.797 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.226646+0000", 2023-09-30T17:04:15.797 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.198e-06 2023-09-30T17:04:15.797 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.797 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.797 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.797 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.226651+0000", 2023-09-30T17:04:15.798 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2979999999999999e-06 2023-09-30T17:04:15.798 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.798 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.798 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.798 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.798 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.798 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124980 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.798 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.252671+0000", 2023-09-30T17:04:15.798 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.31868288900000002, 2023-09-30T17:04:15.798 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.32145862800000002, 2023-09-30T17:04:15.798 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.798 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.799 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.799 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.799 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.799 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124980 2023-09-30T17:04:15.799 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.799 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.799 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.799 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.799 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.252671+0000", 2023-09-30T17:04:15.799 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.799 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.799 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.800 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.800 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.252671+0000", 2023-09-30T17:04:15.800 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.800 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.800 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.800 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.800 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.252671+0000", 2023-09-30T17:04:15.800 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.34e-07 2023-09-30T17:04:15.800 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.800 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.800 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.801 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.252685+0000", 2023-09-30T17:04:15.801 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4249e-05 2023-09-30T17:04:15.801 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.801 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.801 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.801 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.252694+0000", 2023-09-30T17:04:15.801 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5609999999999999e-06 2023-09-30T17:04:15.801 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.801 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.801 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.801 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.252697+0000", 2023-09-30T17:04:15.801 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4520000000000002e-06 2023-09-30T17:04:15.802 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.802 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.802 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.802 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.802 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.802 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:123904 4.36 e53/17)", 2023-09-30T17:04:15.802 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.262441+0000", 2023-09-30T17:04:15.802 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.30891306000000002, 2023-09-30T17:04:15.802 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.31174813299999998, 2023-09-30T17:04:15.802 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.802 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.803 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.803 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.803 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.803 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.262441+0000", 2023-09-30T17:04:15.803 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.803 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.803 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.803 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.803 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.262441+0000", 2023-09-30T17:04:15.803 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.803 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.803 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.804 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.804 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.262441+0000", 2023-09-30T17:04:15.804 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.85e-07 2023-09-30T17:04:15.804 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.804 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.804 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.804 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.262451+0000", 2023-09-30T17:04:15.804 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0284e-05 2023-09-30T17:04:15.804 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.804 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.804 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.804 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.262456+0000", 2023-09-30T17:04:15.805 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4940000000000003e-06 2023-09-30T17:04:15.805 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.805 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.805 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.805 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.262461+0000", 2023-09-30T17:04:15.805 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1579999999999998e-06 2023-09-30T17:04:15.805 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.805 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.805 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.805 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.805 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.805 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:123915 4.6 e53/17)", 2023-09-30T17:04:15.806 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.275895+0000", 2023-09-30T17:04:15.806 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.295458736, 2023-09-30T17:04:15.806 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.29834602399999999, 2023-09-30T17:04:15.806 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.806 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.806 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.806 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.806 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.806 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.275895+0000", 2023-09-30T17:04:15.806 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.806 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.806 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.807 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.807 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.275895+0000", 2023-09-30T17:04:15.807 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.807 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.807 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.807 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.807 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.275895+0000", 2023-09-30T17:04:15.807 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1899999999999998e-07 2023-09-30T17:04:15.807 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.807 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.807 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.808 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.275905+0000", 2023-09-30T17:04:15.808 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7620000000000007e-06 2023-09-30T17:04:15.808 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.808 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.808 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.808 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.275912+0000", 2023-09-30T17:04:15.808 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6139999999999997e-06 2023-09-30T17:04:15.808 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.808 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.808 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.808 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.275917+0000", 2023-09-30T17:04:15.808 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1370000000000001e-06 2023-09-30T17:04:15.809 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.809 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.809 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.809 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.809 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.809 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124060 4.36 e53/17)", 2023-09-30T17:04:15.809 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.323316+0000", 2023-09-30T17:04:15.809 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.248037542, 2023-09-30T17:04:15.809 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.25097548200000003, 2023-09-30T17:04:15.809 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.809 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.809 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.810 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.810 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.810 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.323316+0000", 2023-09-30T17:04:15.810 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.810 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.810 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.810 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.810 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.323316+0000", 2023-09-30T17:04:15.810 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.810 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.810 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.810 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.811 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.323316+0000", 2023-09-30T17:04:15.811 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6100000000000002e-07 2023-09-30T17:04:15.811 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.811 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.811 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.811 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.323329+0000", 2023-09-30T17:04:15.811 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2823000000000001e-05 2023-09-30T17:04:15.811 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.811 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.811 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.811 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.323336+0000", 2023-09-30T17:04:15.811 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.058e-06 2023-09-30T17:04:15.812 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.812 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.812 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.812 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.323342+0000", 2023-09-30T17:04:15.812 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9950000000000002e-06 2023-09-30T17:04:15.812 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.812 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.812 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.812 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.812 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.812 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125231 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.812 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.335585+0000", 2023-09-30T17:04:15.813 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.23576878400000001, 2023-09-30T17:04:15.813 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.23876134399999999, 2023-09-30T17:04:15.813 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.813 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.813 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.813 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.813 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.813 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125231 2023-09-30T17:04:15.813 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.813 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.813 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.814 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.335585+0000", 2023-09-30T17:04:15.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.814 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.814 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.814 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.814 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.335585+0000", 2023-09-30T17:04:15.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.814 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.814 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.814 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.815 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.335585+0000", 2023-09-30T17:04:15.815 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8200000000000001e-07 2023-09-30T17:04:15.815 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.815 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.815 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.815 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.335595+0000", 2023-09-30T17:04:15.815 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0076e-05 2023-09-30T17:04:15.815 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.815 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.815 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.815 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.335599+0000", 2023-09-30T17:04:15.816 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6370000000000001e-06 2023-09-30T17:04:15.816 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.816 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.816 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.816 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.335602+0000", 2023-09-30T17:04:15.816 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8590000000000001e-06 2023-09-30T17:04:15.816 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.816 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.816 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.816 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.816 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.817 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125363 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.817 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.381817+0000", 2023-09-30T17:04:15.817 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.189536434, 2023-09-30T17:04:15.817 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.192590122, 2023-09-30T17:04:15.817 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.817 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.817 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.817 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.817 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.817 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125363 2023-09-30T17:04:15.817 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.818 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.818 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.818 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.818 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.381817+0000", 2023-09-30T17:04:15.818 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.818 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.818 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.818 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.818 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.381817+0000", 2023-09-30T17:04:15.818 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.818 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.818 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.819 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.819 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.381818+0000", 2023-09-30T17:04:15.819 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4000000000000002e-07 2023-09-30T17:04:15.819 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.819 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.819 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.819 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.381828+0000", 2023-09-30T17:04:15.819 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0699e-05 2023-09-30T17:04:15.819 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.819 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.820 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.820 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.381835+0000", 2023-09-30T17:04:15.820 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6510000000000004e-06 2023-09-30T17:04:15.820 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.820 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.820 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.820 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.381840+0000", 2023-09-30T17:04:15.820 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5619999999999997e-06 2023-09-30T17:04:15.820 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.820 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.820 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.820 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.821 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.821 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124307 4.6 e53/17)", 2023-09-30T17:04:15.821 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.418023+0000", 2023-09-30T17:04:15.821 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.15333069399999999, 2023-09-30T17:04:15.821 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.15644306099999999, 2023-09-30T17:04:15.821 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.821 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.821 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.821 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.821 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.821 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.418023+0000", 2023-09-30T17:04:15.822 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.822 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.822 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.822 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.822 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.418023+0000", 2023-09-30T17:04:15.822 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.822 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.822 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.822 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.822 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.418023+0000", 2023-09-30T17:04:15.822 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8099999999999999e-07 2023-09-30T17:04:15.822 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.823 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.823 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.823 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.418033+0000", 2023-09-30T17:04:15.823 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0067e-05 2023-09-30T17:04:15.823 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.823 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.823 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.823 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.418039+0000", 2023-09-30T17:04:15.823 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4589999999999997e-06 2023-09-30T17:04:15.823 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.823 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.823 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.824 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.418043+0000", 2023-09-30T17:04:15.824 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0060000000000003e-06 2023-09-30T17:04:15.824 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.824 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.824 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.824 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.824 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.824 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124415 4.6 e53/17)", 2023-09-30T17:04:15.824 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.441479+0000", 2023-09-30T17:04:15.824 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.12987425799999999, 2023-09-30T17:04:15.824 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.13303883999999999, 2023-09-30T17:04:15.824 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.825 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.825 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.825 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.825 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.441479+0000", 2023-09-30T17:04:15.825 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.825 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.825 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.825 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.441479+0000", 2023-09-30T17:04:15.825 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.826 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.826 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.826 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.441480+0000", 2023-09-30T17:04:15.826 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0599999999999999e-07 2023-09-30T17:04:15.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.826 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.826 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.826 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.441493+0000", 2023-09-30T17:04:15.826 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3562e-05 2023-09-30T17:04:15.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.826 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.827 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.827 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.441497+0000", 2023-09-30T17:04:15.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.658e-06 2023-09-30T17:04:15.827 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.827 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.827 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.827 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.441500+0000", 2023-09-30T17:04:15.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.993e-06 2023-09-30T17:04:15.827 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.827 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.827 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.827 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.828 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.828 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125527 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.828 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.444625+0000", 2023-09-30T17:04:15.828 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.126728392, 2023-09-30T17:04:15.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.129951493, 2023-09-30T17:04:15.828 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.828 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.828 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.828 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.828 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.828 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125527 2023-09-30T17:04:15.828 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.829 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.829 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.829 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.444625+0000", 2023-09-30T17:04:15.829 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.829 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.829 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.829 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.444625+0000", 2023-09-30T17:04:15.829 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.829 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.830 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.830 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.448515+0000", 2023-09-30T17:04:15.830 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038901410000000002 2023-09-30T17:04:15.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.830 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.830 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.830 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.448536+0000", 2023-09-30T17:04:15.830 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1047999999999999e-05 2023-09-30T17:04:15.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.830 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.830 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.830 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.448545+0000", 2023-09-30T17:04:15.831 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5860000000000005e-06 2023-09-30T17:04:15.831 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.831 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.831 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.831 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.448551+0000", 2023-09-30T17:04:15.831 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1229999999999997e-06 2023-09-30T17:04:15.831 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.831 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.831 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.831 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.831 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.831 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124532 4.2e e53/17)", 2023-09-30T17:04:15.832 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.471766+0000", 2023-09-30T17:04:15.832 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.099587241000000007, 2023-09-30T17:04:15.832 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.10286282400000001, 2023-09-30T17:04:15.832 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.832 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.832 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.832 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.832 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.832 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.471766+0000", 2023-09-30T17:04:15.832 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.832 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.832 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.833 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.833 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.471766+0000", 2023-09-30T17:04:15.833 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.833 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.833 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.833 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.833 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.471767+0000", 2023-09-30T17:04:15.833 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9299999999999998e-07 2023-09-30T17:04:15.833 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.833 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.833 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.834 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.471786+0000", 2023-09-30T17:04:15.834 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8731000000000001e-05 2023-09-30T17:04:15.834 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.834 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.834 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.834 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.471794+0000", 2023-09-30T17:04:15.834 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8860000000000004e-06 2023-09-30T17:04:15.834 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.834 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.834 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.834 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.471800+0000", 2023-09-30T17:04:15.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.703e-06 2023-09-30T17:04:15.835 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.835 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.835 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.835 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.835 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.835 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125797 4.30 4:0c89e311:::100000001f8.00000017:head [write 163840~4096 in=4096b,write 372736~4096 in=4096b,write 380928~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.835 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.554693+0000", 2023-09-30T17:04:15.835 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.016661055000000001, 2023-09-30T17:04:15.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019999823999999999, 2023-09-30T17:04:15.835 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.836 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:15.836 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.836 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.836 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.836 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125797 2023-09-30T17:04:15.836 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.836 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.836 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.836 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.836 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.554693+0000", 2023-09-30T17:04:15.836 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.836 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.837 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.837 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.837 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.554693+0000", 2023-09-30T17:04:15.837 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.837 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.837 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.837 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.837 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.557516+0000", 2023-09-30T17:04:15.837 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0028238109999999999 2023-09-30T17:04:15.837 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.837 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.837 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.838 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.557536+0000", 2023-09-30T17:04:15.838 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9811000000000001e-05 2023-09-30T17:04:15.838 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.838 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.838 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.838 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.557549+0000", 2023-09-30T17:04:15.838 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3176999999999999e-05 2023-09-30T17:04:15.838 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.838 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.838 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.838 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.557557+0000", 2023-09-30T17:04:15.839 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7710000000000006e-06 2023-09-30T17:04:15.839 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.839 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.839 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:15.839 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.558609+0000", 2023-09-30T17:04:15.839 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001052203 2023-09-30T17:04:15.839 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.839 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.839 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:15.839 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.558690+0000", 2023-09-30T17:04:15.839 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0464999999999996e-05 2023-09-30T17:04:15.839 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.840 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.840 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.840 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.840 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.840 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125839 4.38 4.318ef3b8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.840 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.568927+0000", 2023-09-30T17:04:15.840 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0024265929999999999, 2023-09-30T17:04:15.840 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0058401319999999996, 2023-09-30T17:04:15.840 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.840 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.840 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.840 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.841 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.841 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125839 2023-09-30T17:04:15.841 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.841 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.841 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.841 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.841 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.568927+0000", 2023-09-30T17:04:15.841 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.841 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.841 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.841 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.841 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.568927+0000", 2023-09-30T17:04:15.842 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.842 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.842 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.842 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.842 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.568927+0000", 2023-09-30T17:04:15.842 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.96e-07 2023-09-30T17:04:15.842 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.842 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.842 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.842 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.568945+0000", 2023-09-30T17:04:15.842 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7836999999999999e-05 2023-09-30T17:04:15.843 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.843 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.843 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.843 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.568953+0000", 2023-09-30T17:04:15.843 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4309999999999997e-06 2023-09-30T17:04:15.843 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.843 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.843 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.843 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.568958+0000", 2023-09-30T17:04:15.843 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7679999999999997e-06 2023-09-30T17:04:15.843 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.843 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.844 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.844 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.844 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.844 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124721 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.844 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.139698+0000", 2023-09-30T17:04:15.844 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.43165523500000003, 2023-09-30T17:04:15.844 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.43513766199999998, 2023-09-30T17:04:15.844 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.844 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.844 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.844 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.845 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.845 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124721 2023-09-30T17:04:15.845 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.845 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.845 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.845 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.845 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.139698+0000", 2023-09-30T17:04:15.845 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.845 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.845 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.845 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.845 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.139698+0000", 2023-09-30T17:04:15.846 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.846 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.846 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.846 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.846 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.141705+0000", 2023-09-30T17:04:15.846 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0020065690000000001 2023-09-30T17:04:15.846 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.846 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.846 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.846 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.141722+0000", 2023-09-30T17:04:15.846 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7459999999999999e-05 2023-09-30T17:04:15.847 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.847 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.847 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.847 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.141731+0000", 2023-09-30T17:04:15.847 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9369999999999993e-06 2023-09-30T17:04:15.847 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.847 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.847 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.847 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.141739+0000", 2023-09-30T17:04:15.847 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9999999999999996e-06 2023-09-30T17:04:15.847 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.848 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.848 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.848 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.848 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.848 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124861 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.848 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.194543+0000", 2023-09-30T17:04:15.848 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.37681014200000001, 2023-09-30T17:04:15.848 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.38035633699999999, 2023-09-30T17:04:15.848 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.848 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.848 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.848 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.849 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.849 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124861 2023-09-30T17:04:15.849 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.849 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.849 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.849 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.849 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.194543+0000", 2023-09-30T17:04:15.849 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.849 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.849 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.849 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.850 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.194543+0000", 2023-09-30T17:04:15.850 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.850 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.850 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.850 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.850 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.194544+0000", 2023-09-30T17:04:15.850 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4900000000000001e-07 2023-09-30T17:04:15.850 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.850 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.850 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.850 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.194552+0000", 2023-09-30T17:04:15.850 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.67e-06 2023-09-30T17:04:15.851 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.851 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.851 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.851 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.194556+0000", 2023-09-30T17:04:15.851 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7390000000000001e-06 2023-09-30T17:04:15.851 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.851 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.851 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.851 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.194559+0000", 2023-09-30T17:04:15.851 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8930000000000001e-06 2023-09-30T17:04:15.851 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.851 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.852 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.852 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.852 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.852 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124950 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.852 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.242578+0000", 2023-09-30T17:04:15.852 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.328775977, 2023-09-30T17:04:15.852 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.33238371100000003, 2023-09-30T17:04:15.852 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.852 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.852 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.853 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.853 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.853 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124950 2023-09-30T17:04:15.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.853 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.853 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.853 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.853 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.242578+0000", 2023-09-30T17:04:15.853 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.853 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.854 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.854 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.242578+0000", 2023-09-30T17:04:15.854 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.854 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.854 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.854 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.854 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.242578+0000", 2023-09-30T17:04:15.854 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2600000000000002e-07 2023-09-30T17:04:15.854 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.854 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.854 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.854 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.242590+0000", 2023-09-30T17:04:15.855 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2071e-05 2023-09-30T17:04:15.855 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.855 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.855 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.855 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.242601+0000", 2023-09-30T17:04:15.855 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1012000000000001e-05 2023-09-30T17:04:15.855 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.855 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.855 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.855 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.242608+0000", 2023-09-30T17:04:15.855 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3550000000000001e-06 2023-09-30T17:04:15.855 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.856 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.856 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.856 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.856 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.856 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124125 4.36 e53/17)", 2023-09-30T17:04:15.856 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.373912+0000", 2023-09-30T17:04:15.856 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.19744146200000001, 2023-09-30T17:04:15.856 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.20110805800000001, 2023-09-30T17:04:15.856 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.856 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.856 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.856 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.857 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.373912+0000", 2023-09-30T17:04:15.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.857 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.857 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.373912+0000", 2023-09-30T17:04:15.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.857 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.857 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.858 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.373912+0000", 2023-09-30T17:04:15.858 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.29e-07 2023-09-30T17:04:15.858 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.858 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.858 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.858 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.373929+0000", 2023-09-30T17:04:15.858 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6552e-05 2023-09-30T17:04:15.858 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.858 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.858 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.858 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.373936+0000", 2023-09-30T17:04:15.859 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0380000000000002e-06 2023-09-30T17:04:15.859 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.859 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.859 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.859 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.373941+0000", 2023-09-30T17:04:15.859 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4029999999999998e-06 2023-09-30T17:04:15.859 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.859 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.859 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.859 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.859 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.859 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125427 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.860 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.407724+0000", 2023-09-30T17:04:15.860 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.16362989999999999, 2023-09-30T17:04:15.860 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.16734961000000001, 2023-09-30T17:04:15.860 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.860 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.860 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.860 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.860 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.860 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125427 2023-09-30T17:04:15.860 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.860 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.860 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.861 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.861 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.407724+0000", 2023-09-30T17:04:15.861 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.861 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.861 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.861 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.861 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.407724+0000", 2023-09-30T17:04:15.861 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.861 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.861 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.861 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.861 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.407724+0000", 2023-09-30T17:04:15.862 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6600000000000002e-07 2023-09-30T17:04:15.862 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.862 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.862 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.862 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.407737+0000", 2023-09-30T17:04:15.862 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2379e-05 2023-09-30T17:04:15.862 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.862 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.862 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.862 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.407748+0000", 2023-09-30T17:04:15.862 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0997e-05 2023-09-30T17:04:15.862 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.863 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.863 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.863 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.407753+0000", 2023-09-30T17:04:15.863 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7209999999999999e-06 2023-09-30T17:04:15.863 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.863 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.863 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.863 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.863 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.863 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124311 4.36 e53/17)", 2023-09-30T17:04:15.863 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.419292+0000", 2023-09-30T17:04:15.863 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.15206133999999999, 2023-09-30T17:04:15.864 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.15584653400000001, 2023-09-30T17:04:15.864 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.864 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.864 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.864 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.864 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.419292+0000", 2023-09-30T17:04:15.864 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.864 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.864 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.865 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.419292+0000", 2023-09-30T17:04:15.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.865 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.865 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.865 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.865 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.419293+0000", 2023-09-30T17:04:15.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6099999999999999e-07 2023-09-30T17:04:15.865 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.865 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.865 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.865 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.419311+0000", 2023-09-30T17:04:15.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7583000000000001e-05 2023-09-30T17:04:15.866 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.866 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.866 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.866 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.419322+0000", 2023-09-30T17:04:15.866 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1107000000000001e-05 2023-09-30T17:04:15.866 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.866 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.866 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.866 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.419331+0000", 2023-09-30T17:04:15.866 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.02e-06 2023-09-30T17:04:15.866 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.867 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.867 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.867 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.867 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.867 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124366 4.36 e53/17)", 2023-09-30T17:04:15.867 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.430004+0000", 2023-09-30T17:04:15.867 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.14134930500000001, 2023-09-30T17:04:15.867 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.145186593, 2023-09-30T17:04:15.867 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.867 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.867 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.867 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.868 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.430004+0000", 2023-09-30T17:04:15.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.868 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.868 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.430004+0000", 2023-09-30T17:04:15.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.868 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.868 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.430005+0000", 2023-09-30T17:04:15.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9399999999999995e-07 2023-09-30T17:04:15.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.869 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.430017+0000", 2023-09-30T17:04:15.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1928e-05 2023-09-30T17:04:15.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.869 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.430025+0000", 2023-09-30T17:04:15.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.653e-06 2023-09-30T17:04:15.870 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.870 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.870 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.430032+0000", 2023-09-30T17:04:15.870 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2750000000000001e-06 2023-09-30T17:04:15.870 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.870 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.870 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.870 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.871 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124540 4.36 e53/17)", 2023-09-30T17:04:15.871 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.471977+0000", 2023-09-30T17:04:15.871 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.099376351000000002, 2023-09-30T17:04:15.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.103262303, 2023-09-30T17:04:15.871 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.871 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.871 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.871 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.871 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.871 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.471977+0000", 2023-09-30T17:04:15.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.871 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.872 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.471977+0000", 2023-09-30T17:04:15.872 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.872 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.872 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.471978+0000", 2023-09-30T17:04:15.872 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2800000000000002e-07 2023-09-30T17:04:15.872 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.873 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.471990+0000", 2023-09-30T17:04:15.873 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2153999999999999e-05 2023-09-30T17:04:15.873 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.873 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.873 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.873 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.471998+0000", 2023-09-30T17:04:15.873 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2870000000000004e-06 2023-09-30T17:04:15.873 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.873 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.873 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.873 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.472004+0000", 2023-09-30T17:04:15.873 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4410000000000001e-06 2023-09-30T17:04:15.874 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.874 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.874 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.874 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.874 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.874 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125694 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.877 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.491399+0000", 2023-09-30T17:04:15.877 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.079954415000000001, 2023-09-30T17:04:15.877 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.083886989999999995, 2023-09-30T17:04:15.877 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.877 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.877 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.878 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.878 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.878 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125694 2023-09-30T17:04:15.878 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.878 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.878 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.878 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.878 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.491399+0000", 2023-09-30T17:04:15.878 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.878 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.878 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.879 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.879 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.491399+0000", 2023-09-30T17:04:15.879 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.879 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.879 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.879 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.879 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.491399+0000", 2023-09-30T17:04:15.879 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2499999999999999e-07 2023-09-30T17:04:15.879 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.879 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.879 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.879 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.491409+0000", 2023-09-30T17:04:15.880 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6439999999999995e-06 2023-09-30T17:04:15.880 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.880 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.880 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.880 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.491412+0000", 2023-09-30T17:04:15.880 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3129999999999999e-06 2023-09-30T17:04:15.880 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.880 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.880 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.880 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.491415+0000", 2023-09-30T17:04:15.880 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9730000000000002e-06 2023-09-30T17:04:15.880 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.881 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.881 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.881 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.881 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.881 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125799 4.29 4:94178d8a:::100000001f8.00000006:head [write 2445312~4096 in=4096b,write 2482176~4096 in=4096b,write 2490368~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.881 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.557573+0000", 2023-09-30T17:04:15.881 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.013780564, 2023-09-30T17:04:15.881 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.01777538, 2023-09-30T17:04:15.881 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.881 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:15.881 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.881 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.882 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.882 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125799 2023-09-30T17:04:15.882 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.882 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.882 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.882 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.882 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.557573+0000", 2023-09-30T17:04:15.882 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.882 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.882 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.882 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.882 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.557573+0000", 2023-09-30T17:04:15.883 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.883 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.883 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.883 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.883 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.557574+0000", 2023-09-30T17:04:15.883 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7800000000000001e-07 2023-09-30T17:04:15.883 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.883 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.883 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.883 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.557586+0000", 2023-09-30T17:04:15.883 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2605e-05 2023-09-30T17:04:15.883 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.884 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.884 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.884 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.557596+0000", 2023-09-30T17:04:15.884 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0159e-05 2023-09-30T17:04:15.884 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.884 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.884 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.884 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.557603+0000", 2023-09-30T17:04:15.884 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9550000000000003e-06 2023-09-30T17:04:15.884 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.884 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.884 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:15.885 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.558821+0000", 2023-09-30T17:04:15.885 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001217976 2023-09-30T17:04:15.885 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.885 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.885 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:15.885 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.558907+0000", 2023-09-30T17:04:15.885 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5363000000000002e-05 2023-09-30T17:04:15.885 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.885 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.885 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.885 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.885 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.886 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124813 4.6 e53/17)", 2023-09-30T17:04:15.886 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.569034+0000", 2023-09-30T17:04:15.886 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0023195989999999999, 2023-09-30T17:04:15.886 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063716959999999996, 2023-09-30T17:04:15.886 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.886 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.886 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.886 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.886 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.886 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.569034+0000", 2023-09-30T17:04:15.886 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.887 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.887 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.887 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.887 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.569034+0000", 2023-09-30T17:04:15.887 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.887 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.887 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.887 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.887 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.569034+0000", 2023-09-30T17:04:15.887 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9000000000000002e-07 2023-09-30T17:04:15.887 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.887 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.888 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.888 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.569048+0000", 2023-09-30T17:04:15.888 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3305000000000001e-05 2023-09-30T17:04:15.888 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.888 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.888 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.888 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.569057+0000", 2023-09-30T17:04:15.888 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9849999999999995e-06 2023-09-30T17:04:15.888 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.888 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.888 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.889 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.569063+0000", 2023-09-30T17:04:15.889 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2859999999999996e-06 2023-09-30T17:04:15.889 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.889 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.889 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.889 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.889 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.889 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:123847 4.36 e53/17)", 2023-09-30T17:04:15.889 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.228231+0000", 2023-09-30T17:04:15.890 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.34312261700000002, 2023-09-30T17:04:15.890 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.34721052099999999, 2023-09-30T17:04:15.890 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.890 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.890 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.890 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.890 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.890 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.228231+0000", 2023-09-30T17:04:15.890 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.890 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.891 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.891 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.891 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.228231+0000", 2023-09-30T17:04:15.891 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.891 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.891 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.891 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.891 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.228232+0000", 2023-09-30T17:04:15.891 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2399999999999998e-07 2023-09-30T17:04:15.891 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.891 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.892 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.892 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.228253+0000", 2023-09-30T17:04:15.892 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1416e-05 2023-09-30T17:04:15.892 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.892 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.892 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.892 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.228279+0000", 2023-09-30T17:04:15.892 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6237999999999998e-05 2023-09-30T17:04:15.892 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.892 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.893 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.893 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.228287+0000", 2023-09-30T17:04:15.893 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.401e-06 2023-09-30T17:04:15.893 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.893 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.893 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.893 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.893 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.893 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:123903 4.6 e53/17)", 2023-09-30T17:04:15.893 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.262491+0000", 2023-09-30T17:04:15.893 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.30886222200000002, 2023-09-30T17:04:15.894 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.31304622399999998, 2023-09-30T17:04:15.894 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.894 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.894 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.894 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.894 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.894 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.262491+0000", 2023-09-30T17:04:15.894 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.894 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.894 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.895 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.895 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.262491+0000", 2023-09-30T17:04:15.895 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.895 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.895 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.895 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.895 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.262492+0000", 2023-09-30T17:04:15.895 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9399999999999999e-07 2023-09-30T17:04:15.895 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.895 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.896 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.896 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.262502+0000", 2023-09-30T17:04:15.896 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0451e-05 2023-09-30T17:04:15.896 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.896 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.896 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.896 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.262507+0000", 2023-09-30T17:04:15.896 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1080000000000001e-06 2023-09-30T17:04:15.896 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.896 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.896 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.897 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.262515+0000", 2023-09-30T17:04:15.897 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2369999999999992e-06 2023-09-30T17:04:15.897 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.897 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.897 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.897 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.897 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.897 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125112 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.897 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.300722+0000", 2023-09-30T17:04:15.897 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.27063162699999999, 2023-09-30T17:04:15.897 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.27486328799999998, 2023-09-30T17:04:15.898 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.898 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.898 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.898 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.898 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.898 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125112 2023-09-30T17:04:15.898 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.898 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.898 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.898 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.898 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.300722+0000", 2023-09-30T17:04:15.899 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.899 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.899 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.899 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.899 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.300722+0000", 2023-09-30T17:04:15.899 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.899 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.899 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.899 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.899 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.300722+0000", 2023-09-30T17:04:15.899 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0800000000000005e-07 2023-09-30T17:04:15.899 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.900 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.900 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.900 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.300740+0000", 2023-09-30T17:04:15.900 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7703e-05 2023-09-30T17:04:15.900 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.900 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.900 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.900 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.300747+0000", 2023-09-30T17:04:15.900 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6270000000000002e-06 2023-09-30T17:04:15.900 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.900 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.900 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.901 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.300753+0000", 2023-09-30T17:04:15.901 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7520000000000002e-06 2023-09-30T17:04:15.901 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.901 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.901 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.901 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.901 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.901 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124034 4.36 e53/17)", 2023-09-30T17:04:15.901 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.312669+0000", 2023-09-30T17:04:15.901 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.25868469599999999, 2023-09-30T17:04:15.901 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.262977876, 2023-09-30T17:04:15.901 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.902 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.902 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.902 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.902 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.902 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.312669+0000", 2023-09-30T17:04:15.902 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.902 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.902 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.902 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.902 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.312669+0000", 2023-09-30T17:04:15.902 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.903 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.903 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.903 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.903 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.312669+0000", 2023-09-30T17:04:15.903 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5400000000000002e-07 2023-09-30T17:04:15.903 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.903 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.903 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.903 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.312680+0000", 2023-09-30T17:04:15.903 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0395e-05 2023-09-30T17:04:15.903 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.903 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.904 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.904 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.312686+0000", 2023-09-30T17:04:15.904 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6409999999999996e-06 2023-09-30T17:04:15.904 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.904 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.904 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.904 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.312691+0000", 2023-09-30T17:04:15.904 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6600000000000003e-06 2023-09-30T17:04:15.904 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.904 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.904 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.904 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.904 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.905 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125449 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.905 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.417605+0000", 2023-09-30T17:04:15.905 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.15374900599999999, 2023-09-30T17:04:15.905 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.158098089, 2023-09-30T17:04:15.905 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.905 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.905 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.905 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.905 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.905 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125449 2023-09-30T17:04:15.905 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.905 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.906 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.906 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.906 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.417605+0000", 2023-09-30T17:04:15.906 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.906 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.906 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.906 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.906 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.417605+0000", 2023-09-30T17:04:15.906 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.906 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.907 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.907 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.907 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.419519+0000", 2023-09-30T17:04:15.907 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001914582 2023-09-30T17:04:15.907 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.907 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.907 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.907 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.419535+0000", 2023-09-30T17:04:15.907 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6161999999999999e-05 2023-09-30T17:04:15.907 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.907 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.907 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.908 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.419546+0000", 2023-09-30T17:04:15.908 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1107999999999999e-05 2023-09-30T17:04:15.908 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.908 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.908 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.908 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.419553+0000", 2023-09-30T17:04:15.908 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3980000000000004e-06 2023-09-30T17:04:15.908 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.908 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.908 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.908 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.909 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.909 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124372 4.2e e53/17)", 2023-09-30T17:04:15.909 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.430060+0000", 2023-09-30T17:04:15.909 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.14129371099999999, 2023-09-30T17:04:15.909 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.14570259799999999, 2023-09-30T17:04:15.909 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.909 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.909 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.909 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.909 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.909 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.430060+0000", 2023-09-30T17:04:15.909 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.910 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.910 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.910 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.910 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.430060+0000", 2023-09-30T17:04:15.910 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.910 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.910 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.910 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.910 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.430060+0000", 2023-09-30T17:04:15.910 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3000000000000002e-07 2023-09-30T17:04:15.910 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.910 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.911 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.911 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.430086+0000", 2023-09-30T17:04:15.911 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5344999999999999e-05 2023-09-30T17:04:15.911 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.911 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.911 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.911 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.430093+0000", 2023-09-30T17:04:15.911 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0419999999999997e-06 2023-09-30T17:04:15.911 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.911 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.911 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.911 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.430098+0000", 2023-09-30T17:04:15.912 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6919999999999999e-06 2023-09-30T17:04:15.912 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.912 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.912 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.912 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.912 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.912 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124569 4.6 e53/17)", 2023-09-30T17:04:15.912 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.490555+0000", 2023-09-30T17:04:15.912 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.080798312999999997, 2023-09-30T17:04:15.912 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.085237062000000002, 2023-09-30T17:04:15.912 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.912 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.913 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.913 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.913 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.913 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.490555+0000", 2023-09-30T17:04:15.913 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.913 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.913 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.913 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.913 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.490555+0000", 2023-09-30T17:04:15.913 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.913 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.913 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.914 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.914 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.490557+0000", 2023-09-30T17:04:15.914 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3170000000000001e-06 2023-09-30T17:04:15.914 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.914 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.914 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.914 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.490574+0000", 2023-09-30T17:04:15.914 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.768e-05 2023-09-30T17:04:15.914 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.914 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.914 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.914 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.490583+0000", 2023-09-30T17:04:15.915 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5390000000000007e-06 2023-09-30T17:04:15.915 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.915 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.915 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.915 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.490592+0000", 2023-09-30T17:04:15.915 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6709999999999994e-06 2023-09-30T17:04:15.915 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.915 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.915 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.915 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.915 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.915 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125800 4.35 4:af28909f:::100000001f8.0000001b:head [write 1470464~4096 in=4096b,write 1576960~4096 in=4096b,write 1658880~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.916 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.557614+0000", 2023-09-30T17:04:15.916 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.013739246, 2023-09-30T17:04:15.916 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018208467999999998, 2023-09-30T17:04:15.916 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.916 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:15.916 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.916 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.916 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.916 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125800 2023-09-30T17:04:15.916 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.916 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.916 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.917 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.917 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.557614+0000", 2023-09-30T17:04:15.917 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.917 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.917 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.917 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.917 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.557614+0000", 2023-09-30T17:04:15.917 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.917 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.917 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.917 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.917 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.557615+0000", 2023-09-30T17:04:15.918 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7399999999999998e-07 2023-09-30T17:04:15.918 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.918 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.918 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.918 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.557631+0000", 2023-09-30T17:04:15.918 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5891000000000001e-05 2023-09-30T17:04:15.918 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.918 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.918 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.918 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.557716+0000", 2023-09-30T17:04:15.918 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5526999999999996e-05 2023-09-30T17:04:15.918 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.919 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.919 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.919 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.557723+0000", 2023-09-30T17:04:15.919 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1779999999999997e-06 2023-09-30T17:04:15.919 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.919 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.919 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:15.919 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.557790+0000", 2023-09-30T17:04:15.919 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6191000000000004e-05 2023-09-30T17:04:15.919 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.919 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.919 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:15.920 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.557884+0000", 2023-09-30T17:04:15.920 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4506000000000006e-05 2023-09-30T17:04:15.920 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.920 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.920 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.920 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.920 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.920 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:125233 4.15 e53/17 4:aada5e43:::100000001f8.00000028:head v 53'1944, mlcod=53'1941)", 2023-09-30T17:04:15.920 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.570523+0000", 2023-09-30T17:04:15.920 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.00083026400000000005, 2023-09-30T17:04:15.920 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053379339999999999, 2023-09-30T17:04:15.920 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.921 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:15.921 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.921 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.921 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.921 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.570523+0000", 2023-09-30T17:04:15.921 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.921 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.921 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.921 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.921 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.570523+0000", 2023-09-30T17:04:15.921 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.921 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.922 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.922 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.922 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.570524+0000", 2023-09-30T17:04:15.922 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2399999999999997e-07 2023-09-30T17:04:15.922 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.922 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.922 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.922 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.570562+0000", 2023-09-30T17:04:15.922 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8207999999999997e-05 2023-09-30T17:04:15.922 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.922 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.922 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.923 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.570582+0000", 2023-09-30T17:04:15.923 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9504000000000002e-05 2023-09-30T17:04:15.923 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.923 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.923 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.923 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.570589+0000", 2023-09-30T17:04:15.923 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4250000000000001e-06 2023-09-30T17:04:15.923 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.923 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.923 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:15.923 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.571454+0000", 2023-09-30T17:04:15.923 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00086530799999999996 2023-09-30T17:04:15.924 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.924 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.924 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:15.924 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.571474+0000", 2023-09-30T17:04:15.924 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9388000000000001e-05 2023-09-30T17:04:15.924 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.924 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.924 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.924 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.924 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.924 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124675 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.925 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.123751+0000", 2023-09-30T17:04:15.925 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.44760304099999998, 2023-09-30T17:04:15.925 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.45214346799999999, 2023-09-30T17:04:15.925 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.925 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.925 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.925 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.925 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.925 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124675 2023-09-30T17:04:15.925 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.925 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.926 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.926 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.926 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.123751+0000", 2023-09-30T17:04:15.926 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.926 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.926 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.926 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.926 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.123751+0000", 2023-09-30T17:04:15.926 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.926 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.926 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.926 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.927 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.123751+0000", 2023-09-30T17:04:15.927 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3799999999999998e-07 2023-09-30T17:04:15.927 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.927 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.927 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.927 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.123771+0000", 2023-09-30T17:04:15.927 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0115e-05 2023-09-30T17:04:15.927 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.927 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.927 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.927 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.123781+0000", 2023-09-30T17:04:15.927 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5740000000000002e-06 2023-09-30T17:04:15.928 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.928 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.928 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.928 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.123786+0000", 2023-09-30T17:04:15.928 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9259999999999999e-06 2023-09-30T17:04:15.928 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.928 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.928 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.928 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.928 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.928 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124095 4.6 e53/17)", 2023-09-30T17:04:15.928 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.350910+0000", 2023-09-30T17:04:15.929 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.22044375499999999, 2023-09-30T17:04:15.929 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.22501406400000001, 2023-09-30T17:04:15.929 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.929 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.929 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.929 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.929 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.929 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.350910+0000", 2023-09-30T17:04:15.929 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.929 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.929 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.929 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.930 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.350910+0000", 2023-09-30T17:04:15.930 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.930 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.930 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.930 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.930 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.350911+0000", 2023-09-30T17:04:15.930 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7400000000000002e-07 2023-09-30T17:04:15.930 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.930 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.930 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.930 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.350925+0000", 2023-09-30T17:04:15.931 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3923999999999999e-05 2023-09-30T17:04:15.931 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.931 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.931 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.931 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.350939+0000", 2023-09-30T17:04:15.931 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4644000000000001e-05 2023-09-30T17:04:15.931 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.931 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.931 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.931 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.350947+0000", 2023-09-30T17:04:15.931 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7880000000000007e-06 2023-09-30T17:04:15.931 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.932 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.932 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.932 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.932 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.932 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124200 4.6 e53/17)", 2023-09-30T17:04:15.932 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.397540+0000", 2023-09-30T17:04:15.932 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.17381338399999999, 2023-09-30T17:04:15.932 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.17840867999999999, 2023-09-30T17:04:15.932 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.932 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.932 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.932 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.933 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.933 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.397540+0000", 2023-09-30T17:04:15.933 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.933 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.933 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.933 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.933 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.397540+0000", 2023-09-30T17:04:15.933 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.933 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.933 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.933 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.933 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.397541+0000", 2023-09-30T17:04:15.934 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3099999999999996e-07 2023-09-30T17:04:15.934 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.934 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.934 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.934 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.397564+0000", 2023-09-30T17:04:15.934 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2657999999999999e-05 2023-09-30T17:04:15.934 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.934 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.934 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.934 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.397573+0000", 2023-09-30T17:04:15.934 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3430000000000002e-06 2023-09-30T17:04:15.934 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.935 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.935 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.935 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.397581+0000", 2023-09-30T17:04:15.935 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0779999999999996e-06 2023-09-30T17:04:15.935 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.935 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.935 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.935 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.935 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.935 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124668 4.36 e53/17)", 2023-09-30T17:04:15.935 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.526598+0000", 2023-09-30T17:04:15.936 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.044755191999999999, 2023-09-30T17:04:15.936 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.049376749999999997, 2023-09-30T17:04:15.936 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.936 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.936 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.936 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.936 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.936 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.526598+0000", 2023-09-30T17:04:15.936 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.936 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.936 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.936 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.937 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.526598+0000", 2023-09-30T17:04:15.937 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.937 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.937 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.937 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.937 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.526599+0000", 2023-09-30T17:04:15.937 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0899999999999997e-07 2023-09-30T17:04:15.937 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.937 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.937 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.937 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.526611+0000", 2023-09-30T17:04:15.938 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2439000000000001e-05 2023-09-30T17:04:15.938 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.938 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.938 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.938 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.526618+0000", 2023-09-30T17:04:15.938 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4189999999999999e-06 2023-09-30T17:04:15.938 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.938 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.938 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.938 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.526623+0000", 2023-09-30T17:04:15.938 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0379999999999999e-06 2023-09-30T17:04:15.938 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.939 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.939 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.939 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.939 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.939 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125801 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.939 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.557741+0000", 2023-09-30T17:04:15.939 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.01361212, 2023-09-30T17:04:15.939 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018267403000000002, 2023-09-30T17:04:15.939 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.939 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.939 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.940 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.940 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.940 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125801 2023-09-30T17:04:15.940 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.940 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.940 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.940 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.940 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.557741+0000", 2023-09-30T17:04:15.940 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.940 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.940 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.940 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.941 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.557741+0000", 2023-09-30T17:04:15.941 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.941 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.941 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.941 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.941 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.557742+0000", 2023-09-30T17:04:15.941 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8100000000000002e-07 2023-09-30T17:04:15.941 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.941 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.941 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.941 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.557760+0000", 2023-09-30T17:04:15.941 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7601999999999999e-05 2023-09-30T17:04:15.942 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.942 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.942 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.942 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.557768+0000", 2023-09-30T17:04:15.942 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8310000000000001e-06 2023-09-30T17:04:15.942 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.942 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.942 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.942 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.557776+0000", 2023-09-30T17:04:15.942 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0809999999999994e-06 2023-09-30T17:04:15.943 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.943 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.943 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.943 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.943 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.943 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:125235 4.19 e53/17 4:997b7129:::100000001f8.00000000:head v 53'3894, mlcod=53'3890)", 2023-09-30T17:04:15.943 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.570614+0000", 2023-09-30T17:04:15.943 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.00073926600000000003, 2023-09-30T17:04:15.943 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0054498180000000004, 2023-09-30T17:04:15.943 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.943 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:15.943 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.944 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.944 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.944 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.570614+0000", 2023-09-30T17:04:15.944 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.944 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.944 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.944 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.944 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.570614+0000", 2023-09-30T17:04:15.944 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.944 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.944 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.944 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.944 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.570615+0000", 2023-09-30T17:04:15.945 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.03e-07 2023-09-30T17:04:15.945 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.945 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.945 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.945 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.570628+0000", 2023-09-30T17:04:15.945 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3390999999999999e-05 2023-09-30T17:04:15.945 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.945 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.945 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.945 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.570636+0000", 2023-09-30T17:04:15.945 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.259e-06 2023-09-30T17:04:15.946 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.946 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.946 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.946 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.570642+0000", 2023-09-30T17:04:15.946 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7370000000000003e-06 2023-09-30T17:04:15.946 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.946 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.946 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:15.946 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.571269+0000", 2023-09-30T17:04:15.946 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00062712800000000002 2023-09-30T17:04:15.946 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.946 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.947 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:15.947 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.571286+0000", 2023-09-30T17:04:15.947 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6942000000000001e-05 2023-09-30T17:04:15.947 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.947 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.947 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.947 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.947 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.947 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124520 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.947 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.078574+0000", 2023-09-30T17:04:15.947 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.49277967700000003, 2023-09-30T17:04:15.947 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.49753946900000001, 2023-09-30T17:04:15.948 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.948 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.948 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.948 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.948 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.948 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124520 2023-09-30T17:04:15.948 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.948 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.948 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.948 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.948 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.078574+0000", 2023-09-30T17:04:15.949 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.949 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.949 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.949 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.949 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.078574+0000", 2023-09-30T17:04:15.949 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.949 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.949 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.949 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.949 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.080974+0000", 2023-09-30T17:04:15.949 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0024005469999999998 2023-09-30T17:04:15.949 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.950 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.950 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.950 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.080990+0000", 2023-09-30T17:04:15.950 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5608999999999999e-05 2023-09-30T17:04:15.950 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.950 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.950 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.950 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.080998+0000", 2023-09-30T17:04:15.950 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8390000000000007e-06 2023-09-30T17:04:15.950 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.950 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.950 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.951 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.081005+0000", 2023-09-30T17:04:15.951 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0310000000000001e-06 2023-09-30T17:04:15.951 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.951 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.951 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.951 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.951 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.951 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124676 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.951 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.123793+0000", 2023-09-30T17:04:15.951 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.44756100300000001, 2023-09-30T17:04:15.951 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.452371464, 2023-09-30T17:04:15.951 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.952 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.952 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.952 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.952 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.952 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124676 2023-09-30T17:04:15.952 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.952 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.952 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.952 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.952 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.123793+0000", 2023-09-30T17:04:15.952 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.952 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.953 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.953 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.953 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.123793+0000", 2023-09-30T17:04:15.953 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.953 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.953 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.953 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.953 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.123793+0000", 2023-09-30T17:04:15.953 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3000000000000001e-07 2023-09-30T17:04:15.953 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.953 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.954 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.954 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.123804+0000", 2023-09-30T17:04:15.954 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0723999999999999e-05 2023-09-30T17:04:15.954 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.954 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.954 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.954 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.123810+0000", 2023-09-30T17:04:15.954 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6409999999999996e-06 2023-09-30T17:04:15.954 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.954 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.954 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.954 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.123826+0000", 2023-09-30T17:04:15.955 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5563999999999999e-05 2023-09-30T17:04:15.955 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.955 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.955 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.955 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.955 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.955 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124891 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.955 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.214552+0000", 2023-09-30T17:04:15.955 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.35680134499999999, 2023-09-30T17:04:15.955 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.361661448, 2023-09-30T17:04:15.955 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.955 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.956 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.956 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.956 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.956 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124891 2023-09-30T17:04:15.956 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.956 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.956 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.956 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.956 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.214552+0000", 2023-09-30T17:04:15.956 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.956 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.956 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.957 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.957 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.214552+0000", 2023-09-30T17:04:15.957 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.957 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.957 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.957 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.957 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.214553+0000", 2023-09-30T17:04:15.957 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0900000000000002e-07 2023-09-30T17:04:15.957 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.957 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.957 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.957 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.214569+0000", 2023-09-30T17:04:15.958 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6432000000000001e-05 2023-09-30T17:04:15.958 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.958 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.958 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.958 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.214576+0000", 2023-09-30T17:04:15.958 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6660000000000002e-06 2023-09-30T17:04:15.958 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.958 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.958 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.958 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.214581+0000", 2023-09-30T17:04:15.958 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.259e-06 2023-09-30T17:04:15.958 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.959 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.959 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.959 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.959 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.959 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125080 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.959 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.289576+0000", 2023-09-30T17:04:15.959 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.28177721500000003, 2023-09-30T17:04:15.959 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.28669559500000003, 2023-09-30T17:04:15.959 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.959 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.959 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.960 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.960 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.960 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125080 2023-09-30T17:04:15.960 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.960 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.960 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.960 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.960 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.289576+0000", 2023-09-30T17:04:15.960 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.960 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.960 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.961 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.961 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.289576+0000", 2023-09-30T17:04:15.961 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.961 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.961 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.961 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.961 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.291886+0000", 2023-09-30T17:04:15.961 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0023092189999999999 2023-09-30T17:04:15.961 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.961 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.961 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.961 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.291908+0000", 2023-09-30T17:04:15.962 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1929e-05 2023-09-30T17:04:15.962 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.962 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.962 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.962 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.291916+0000", 2023-09-30T17:04:15.962 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5760000000000006e-06 2023-09-30T17:04:15.962 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.962 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.962 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.962 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.291922+0000", 2023-09-30T17:04:15.962 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6899999999999997e-06 2023-09-30T17:04:15.963 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.963 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.963 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.963 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.963 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.963 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124432 4.2e e53/17)", 2023-09-30T17:04:15.963 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.449142+0000", 2023-09-30T17:04:15.963 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.12221164800000001, 2023-09-30T17:04:15.963 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.12718816399999999, 2023-09-30T17:04:15.963 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.963 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.963 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.964 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.964 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.964 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.449142+0000", 2023-09-30T17:04:15.964 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.964 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.964 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.964 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.964 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.449142+0000", 2023-09-30T17:04:15.964 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.964 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.964 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.964 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.965 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.449143+0000", 2023-09-30T17:04:15.965 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7999999999999995e-07 2023-09-30T17:04:15.965 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.965 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.965 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.965 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.449167+0000", 2023-09-30T17:04:15.965 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4808999999999999e-05 2023-09-30T17:04:15.965 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.965 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.965 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.965 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.449177+0000", 2023-09-30T17:04:15.965 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5880000000000004e-06 2023-09-30T17:04:15.966 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.966 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.966 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.966 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.449185+0000", 2023-09-30T17:04:15.966 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6729999999999992e-06 2023-09-30T17:04:15.966 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.966 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.966 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.966 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.966 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.966 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124576 4.2e e53/17)", 2023-09-30T17:04:15.967 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.492053+0000", 2023-09-30T17:04:15.967 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.079300226000000001, 2023-09-30T17:04:15.967 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.084327220999999994, 2023-09-30T17:04:15.967 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.967 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.967 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.967 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.967 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.967 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.492053+0000", 2023-09-30T17:04:15.967 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.967 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.967 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.968 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.968 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.492053+0000", 2023-09-30T17:04:15.968 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.968 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.968 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.968 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.968 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.492054+0000", 2023-09-30T17:04:15.968 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2399999999999999e-07 2023-09-30T17:04:15.968 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.968 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.968 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.969 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.492071+0000", 2023-09-30T17:04:15.969 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7428e-05 2023-09-30T17:04:15.969 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.969 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.969 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.969 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.492083+0000", 2023-09-30T17:04:15.969 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2058e-05 2023-09-30T17:04:15.969 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.969 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.969 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.969 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.492089+0000", 2023-09-30T17:04:15.969 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7080000000000002e-06 2023-09-30T17:04:15.970 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.970 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.970 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.970 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.970 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.970 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125774 4.11 4:893be98d:::100000001f8.00000001:head [write 221184~4096 in=4096b,write 372736~4096 in=4096b,write 520192~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.970 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.542697+0000", 2023-09-30T17:04:15.970 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.028656119000000001, 2023-09-30T17:04:15.970 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033753434999999998, 2023-09-30T17:04:15.970 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.970 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:15.971 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.971 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.971 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.971 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125774 2023-09-30T17:04:15.971 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.971 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.971 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.971 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.971 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.542697+0000", 2023-09-30T17:04:15.971 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.971 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.971 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.972 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.972 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.542697+0000", 2023-09-30T17:04:15.972 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.972 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.972 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.972 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.972 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.544516+0000", 2023-09-30T17:04:15.972 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001818264 2023-09-30T17:04:15.972 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.972 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.972 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.973 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.544532+0000", 2023-09-30T17:04:15.973 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.66e-05 2023-09-30T17:04:15.973 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.973 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.973 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.973 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.544543+0000", 2023-09-30T17:04:15.973 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0859000000000001e-05 2023-09-30T17:04:15.973 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.973 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.973 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.973 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.544550+0000", 2023-09-30T17:04:15.974 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2710000000000003e-06 2023-09-30T17:04:15.974 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.974 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.974 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:15.974 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.555464+0000", 2023-09-30T17:04:15.974 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010913361999999999 2023-09-30T17:04:15.974 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.974 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.974 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:15.974 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.555546+0000", 2023-09-30T17:04:15.974 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1975e-05 2023-09-30T17:04:15.975 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.975 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.975 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.975 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.975 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.975 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:125203 4.28 e53/17 4:153ae410:::100000001f8.0000003b:head v 53'3849, mlcod=53'3846)", 2023-09-30T17:04:15.975 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.558965+0000", 2023-09-30T17:04:15.975 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.012388862, 2023-09-30T17:04:15.975 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017568276000000001, 2023-09-30T17:04:15.975 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.975 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:15.975 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.975 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.976 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.976 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.558965+0000", 2023-09-30T17:04:15.976 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.976 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.976 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.976 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.976 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.558965+0000", 2023-09-30T17:04:15.976 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.976 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.976 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.976 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.977 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.558965+0000", 2023-09-30T17:04:15.977 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9999999999999997e-07 2023-09-30T17:04:15.977 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.977 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.977 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.977 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.558993+0000", 2023-09-30T17:04:15.977 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7372000000000002e-05 2023-09-30T17:04:15.977 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.977 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.977 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.977 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.559002+0000", 2023-09-30T17:04:15.978 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0180000000000007e-06 2023-09-30T17:04:15.978 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.978 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.978 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.978 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.559008+0000", 2023-09-30T17:04:15.978 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.365e-06 2023-09-30T17:04:15.978 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.978 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.978 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:15.978 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.560973+0000", 2023-09-30T17:04:15.978 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00196481 2023-09-30T17:04:15.978 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.979 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.979 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:15.979 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.560992+0000", 2023-09-30T17:04:15.979 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9037000000000001e-05 2023-09-30T17:04:15.979 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.979 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.979 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.979 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.979 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.979 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:125239 4.28 e53/17)", 2023-09-30T17:04:15.979 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.570709+0000", 2023-09-30T17:04:15.979 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.00064462600000000003, 2023-09-30T17:04:15.980 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0058941330000000002, 2023-09-30T17:04:15.980 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.980 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.980 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.980 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.980 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.980 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.570709+0000", 2023-09-30T17:04:15.980 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.980 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.980 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.980 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.981 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.570709+0000", 2023-09-30T17:04:15.981 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.981 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.981 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.981 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.981 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.570709+0000", 2023-09-30T17:04:15.981 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7899999999999999e-07 2023-09-30T17:04:15.981 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.981 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.981 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.981 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.570721+0000", 2023-09-30T17:04:15.982 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1864e-05 2023-09-30T17:04:15.982 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.982 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.982 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.982 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.570732+0000", 2023-09-30T17:04:15.982 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1085e-05 2023-09-30T17:04:15.982 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.982 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.982 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.982 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.570739+0000", 2023-09-30T17:04:15.982 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6810000000000001e-06 2023-09-30T17:04:15.982 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.983 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.983 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.983 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.983 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.983 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124521 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.983 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.081014+0000", 2023-09-30T17:04:15.983 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.49033954299999999, 2023-09-30T17:04:15.983 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.49564560400000002, 2023-09-30T17:04:15.983 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.983 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.983 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.984 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.984 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.984 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124521 2023-09-30T17:04:15.984 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.984 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.984 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.984 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.984 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.081014+0000", 2023-09-30T17:04:15.984 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.984 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.984 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.984 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.985 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.081014+0000", 2023-09-30T17:04:15.985 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.985 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.985 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.985 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.985 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.081014+0000", 2023-09-30T17:04:15.985 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4000000000000002e-07 2023-09-30T17:04:15.985 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.985 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.985 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.985 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.081027+0000", 2023-09-30T17:04:15.985 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2189e-05 2023-09-30T17:04:15.986 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.986 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.986 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.986 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.081038+0000", 2023-09-30T17:04:15.986 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1435e-05 2023-09-30T17:04:15.986 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.986 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.986 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.986 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.081043+0000", 2023-09-30T17:04:15.986 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2279999999999998e-06 2023-09-30T17:04:15.986 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.986 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.987 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.987 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.987 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.987 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124746 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.987 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.152648+0000", 2023-09-30T17:04:15.987 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.41870536200000003, 2023-09-30T17:04:15.987 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.42407234399999999, 2023-09-30T17:04:15.987 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.987 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.987 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.987 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.988 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.988 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124746 2023-09-30T17:04:15.988 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.988 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.988 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.988 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.152648+0000", 2023-09-30T17:04:15.988 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.988 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.988 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.988 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.152648+0000", 2023-09-30T17:04:15.989 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.989 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.989 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.989 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.989 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.158517+0000", 2023-09-30T17:04:15.989 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0058683839999999999 2023-09-30T17:04:15.989 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.989 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.989 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.989 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.158535+0000", 2023-09-30T17:04:15.989 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8223000000000002e-05 2023-09-30T17:04:15.990 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.990 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.990 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.990 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.158546+0000", 2023-09-30T17:04:15.990 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1314e-05 2023-09-30T17:04:15.990 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.990 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.990 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.990 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.158553+0000", 2023-09-30T17:04:15.990 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6710000000000002e-06 2023-09-30T17:04:15.990 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.990 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.991 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.991 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.991 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.991 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124863 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.991 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.198574+0000", 2023-09-30T17:04:15.991 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.37278003199999998, 2023-09-30T17:04:15.991 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.37820216299999998, 2023-09-30T17:04:15.991 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.991 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.991 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.991 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.991 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.992 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124863 2023-09-30T17:04:15.992 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.992 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.992 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.198574+0000", 2023-09-30T17:04:15.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.992 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.993 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.198574+0000", 2023-09-30T17:04:15.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.993 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.993 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.993 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.993 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.198574+0000", 2023-09-30T17:04:15.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4499999999999997e-07 2023-09-30T17:04:15.993 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.993 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.993 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.993 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.198585+0000", 2023-09-30T17:04:15.994 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0838e-05 2023-09-30T17:04:15.994 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.994 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.994 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.994 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.199302+0000", 2023-09-30T17:04:15.994 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00071652300000000005 2023-09-30T17:04:15.994 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.994 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.994 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.994 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.199312+0000", 2023-09-30T17:04:15.994 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0462000000000001e-05 2023-09-30T17:04:15.995 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.995 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.995 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.995 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.995 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.995 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124893 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:15.995 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.214590+0000", 2023-09-30T17:04:15.995 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.35676373500000003, 2023-09-30T17:04:15.995 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.36224618200000003, 2023-09-30T17:04:15.995 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.995 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.995 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:15.996 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:15.996 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:15.996 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124893 2023-09-30T17:04:15.996 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.996 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.996 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:15.996 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.214590+0000", 2023-09-30T17:04:15.996 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.996 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.996 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:15.997 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.214590+0000", 2023-09-30T17:04:15.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:15.997 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.997 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:15.997 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.214590+0000", 2023-09-30T17:04:15.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2499999999999995e-07 2023-09-30T17:04:15.997 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.997 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:15.997 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.214601+0000", 2023-09-30T17:04:15.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0812000000000001e-05 2023-09-30T17:04:15.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.998 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:15.998 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.214613+0000", 2023-09-30T17:04:15.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1712999999999999e-05 2023-09-30T17:04:15.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.998 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:15.998 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.214619+0000", 2023-09-30T17:04:15.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2570000000000004e-06 2023-09-30T17:04:15.998 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.999 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:15.999 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:15.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:15.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:15.999 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:123865 4.2e e53/17)", 2023-09-30T17:04:15.999 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.243545+0000", 2023-09-30T17:04:15.999 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.32780888000000002, 2023-09-30T17:04:15.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.33334765, 2023-09-30T17:04:15.999 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:15.999 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:15.999 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:15.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.000 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.000 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.243545+0000", 2023-09-30T17:04:16.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.000 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.000 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.243545+0000", 2023-09-30T17:04:16.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.000 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.000 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.243545+0000", 2023-09-30T17:04:16.001 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9900000000000001e-07 2023-09-30T17:04:16.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.001 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.001 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.243560+0000", 2023-09-30T17:04:16.001 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5013e-05 2023-09-30T17:04:16.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.001 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.001 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.243568+0000", 2023-09-30T17:04:16.001 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2810000000000008e-06 2023-09-30T17:04:16.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.002 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.002 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.243574+0000", 2023-09-30T17:04:16.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1080000000000001e-06 2023-09-30T17:04:16.002 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.002 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.002 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.002 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.002 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:123894 4.36 e53/17)", 2023-09-30T17:04:16.002 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.253710+0000", 2023-09-30T17:04:16.003 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.31764337399999998, 2023-09-30T17:04:16.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.32323116099999999, 2023-09-30T17:04:16.003 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.003 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.003 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.003 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.003 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.003 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.253710+0000", 2023-09-30T17:04:16.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.003 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.003 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.253710+0000", 2023-09-30T17:04:16.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.253710+0000", 2023-09-30T17:04:16.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4200000000000002e-07 2023-09-30T17:04:16.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.253722+0000", 2023-09-30T17:04:16.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1569000000000001e-05 2023-09-30T17:04:16.005 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.005 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.005 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.253728+0000", 2023-09-30T17:04:16.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7810000000000002e-06 2023-09-30T17:04:16.005 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.005 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.005 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.253733+0000", 2023-09-30T17:04:16.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8509999999999998e-06 2023-09-30T17:04:16.005 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.005 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.006 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.006 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.006 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:123950 4.6 e53/17)", 2023-09-30T17:04:16.006 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.278854+0000", 2023-09-30T17:04:16.006 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.29249982800000002, 2023-09-30T17:04:16.006 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.29814276299999998, 2023-09-30T17:04:16.006 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.006 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.006 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.006 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.278854+0000", 2023-09-30T17:04:16.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.007 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.278854+0000", 2023-09-30T17:04:16.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.007 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.278854+0000", 2023-09-30T17:04:16.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3000000000000001e-07 2023-09-30T17:04:16.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.008 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.008 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.278868+0000", 2023-09-30T17:04:16.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3518e-05 2023-09-30T17:04:16.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.008 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.008 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.278878+0000", 2023-09-30T17:04:16.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0108999999999999e-05 2023-09-30T17:04:16.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.009 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.009 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.278891+0000", 2023-09-30T17:04:16.009 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3393e-05 2023-09-30T17:04:16.009 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.009 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.009 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.009 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.009 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125087 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.009 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.291930+0000", 2023-09-30T17:04:16.009 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.27942354899999999, 2023-09-30T17:04:16.010 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.28512214200000002, 2023-09-30T17:04:16.010 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.010 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.010 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.010 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.010 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.010 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125087 2023-09-30T17:04:16.010 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.010 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.010 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.010 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.291930+0000", 2023-09-30T17:04:16.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.291930+0000", 2023-09-30T17:04:16.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.291930+0000", 2023-09-30T17:04:16.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4000000000000002e-07 2023-09-30T17:04:16.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.291941+0000", 2023-09-30T17:04:16.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0798999999999999e-05 2023-09-30T17:04:16.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.291949+0000", 2023-09-30T17:04:16.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1270000000000003e-06 2023-09-30T17:04:16.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.013 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.013 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.291955+0000", 2023-09-30T17:04:16.013 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6949999999999997e-06 2023-09-30T17:04:16.013 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.013 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.013 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.013 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125401 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.013 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.397642+0000", 2023-09-30T17:04:16.014 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.173711384, 2023-09-30T17:04:16.014 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.17947474499999999, 2023-09-30T17:04:16.014 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.014 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.014 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.014 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.014 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.014 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125401 2023-09-30T17:04:16.014 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.014 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.014 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.015 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.397642+0000", 2023-09-30T17:04:16.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.015 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.015 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.397642+0000", 2023-09-30T17:04:16.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.015 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.397643+0000", 2023-09-30T17:04:16.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1099999999999996e-07 2023-09-30T17:04:16.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.397655+0000", 2023-09-30T17:04:16.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.226e-05 2023-09-30T17:04:16.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.397662+0000", 2023-09-30T17:04:16.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5300000000000002e-06 2023-09-30T17:04:16.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.397667+0000", 2023-09-30T17:04:16.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2680000000000002e-06 2023-09-30T17:04:16.017 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.017 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.017 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.017 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124249 4.36 e53/17)", 2023-09-30T17:04:16.017 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.409484+0000", 2023-09-30T17:04:16.018 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.16186930199999999, 2023-09-30T17:04:16.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.167694647, 2023-09-30T17:04:16.018 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.018 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.018 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.018 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.018 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.409484+0000", 2023-09-30T17:04:16.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.019 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.019 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.409484+0000", 2023-09-30T17:04:16.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.019 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.019 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.409485+0000", 2023-09-30T17:04:16.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6199999999999999e-07 2023-09-30T17:04:16.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.019 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.019 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.409496+0000", 2023-09-30T17:04:16.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0976e-05 2023-09-30T17:04:16.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.409499+0000", 2023-09-30T17:04:16.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.631e-06 2023-09-30T17:04:16.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.409502+0000", 2023-09-30T17:04:16.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2150000000000001e-06 2023-09-30T17:04:16.020 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.021 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.021 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.021 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124318 4.2e e53/17)", 2023-09-30T17:04:16.021 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.421293+0000", 2023-09-30T17:04:16.021 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.15006098400000001, 2023-09-30T17:04:16.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.155942049, 2023-09-30T17:04:16.021 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.021 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.022 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.022 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.022 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.022 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.421293+0000", 2023-09-30T17:04:16.022 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.022 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.022 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.022 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.022 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.421293+0000", 2023-09-30T17:04:16.022 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.022 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.023 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.023 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.023 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.421294+0000", 2023-09-30T17:04:16.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3900000000000003e-07 2023-09-30T17:04:16.023 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.023 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.023 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.023 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.421311+0000", 2023-09-30T17:04:16.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7345000000000001e-05 2023-09-30T17:04:16.023 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.023 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.023 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.024 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.421320+0000", 2023-09-30T17:04:16.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1300000000000007e-06 2023-09-30T17:04:16.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.024 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.024 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.421327+0000", 2023-09-30T17:04:16.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4760000000000001e-06 2023-09-30T17:04:16.024 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.024 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.024 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.025 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124579 4.36 e53/17)", 2023-09-30T17:04:16.025 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.492105+0000", 2023-09-30T17:04:16.025 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.079248916000000003, 2023-09-30T17:04:16.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.085200305000000004, 2023-09-30T17:04:16.025 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.025 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.025 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.025 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.025 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.025 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.492105+0000", 2023-09-30T17:04:16.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.026 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.026 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.026 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.492105+0000", 2023-09-30T17:04:16.026 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.026 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.026 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.026 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.492105+0000", 2023-09-30T17:04:16.026 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5800000000000001e-07 2023-09-30T17:04:16.026 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.027 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.027 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.492118+0000", 2023-09-30T17:04:16.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3482999999999999e-05 2023-09-30T17:04:16.027 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.027 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.027 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.492135+0000", 2023-09-30T17:04:16.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6769000000000002e-05 2023-09-30T17:04:16.027 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.027 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.028 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.492140+0000", 2023-09-30T17:04:16.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6519999999999997e-06 2023-09-30T17:04:16.028 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.028 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.028 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.028 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.028 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.028 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124686 4.2e e53/17)", 2023-09-30T17:04:16.028 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.526659+0000", 2023-09-30T17:04:16.028 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.044694652000000001, 2023-09-30T17:04:16.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.050693833000000001, 2023-09-30T17:04:16.028 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.029 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.029 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.029 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.029 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.526659+0000", 2023-09-30T17:04:16.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.029 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.029 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.029 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.526659+0000", 2023-09-30T17:04:16.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.030 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.030 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.526659+0000", 2023-09-30T17:04:16.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0800000000000001e-07 2023-09-30T17:04:16.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.030 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.030 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.526671+0000", 2023-09-30T17:04:16.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1399999999999999e-05 2023-09-30T17:04:16.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.526676+0000", 2023-09-30T17:04:16.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7019999999999998e-06 2023-09-30T17:04:16.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.526681+0000", 2023-09-30T17:04:16.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1070000000000004e-06 2023-09-30T17:04:16.031 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.031 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.032 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.032 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124756 4.6 e53/17)", 2023-09-30T17:04:16.032 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.544683+0000", 2023-09-30T17:04:16.032 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.026670760000000002, 2023-09-30T17:04:16.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.032721017999999998, 2023-09-30T17:04:16.032 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.032 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.032 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.032 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.033 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.544683+0000", 2023-09-30T17:04:16.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.033 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.033 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.033 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.033 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.544683+0000", 2023-09-30T17:04:16.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.033 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.033 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.033 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.033 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.544683+0000", 2023-09-30T17:04:16.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0999999999999999e-07 2023-09-30T17:04:16.034 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.034 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.034 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.544712+0000", 2023-09-30T17:04:16.034 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8259000000000002e-05 2023-09-30T17:04:16.034 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.034 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.034 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.544719+0000", 2023-09-30T17:04:16.034 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5020000000000003e-06 2023-09-30T17:04:16.034 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.035 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.035 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.544725+0000", 2023-09-30T17:04:16.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6899999999999997e-06 2023-09-30T17:04:16.035 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.035 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.035 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.035 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.035 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.035 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124786 4.6 e53/17)", 2023-09-30T17:04:16.035 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.559021+0000", 2023-09-30T17:04:16.035 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.012332889, 2023-09-30T17:04:16.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018433728999999999, 2023-09-30T17:04:16.036 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.036 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.036 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.036 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.559021+0000", 2023-09-30T17:04:16.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.036 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.559021+0000", 2023-09-30T17:04:16.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.037 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.559021+0000", 2023-09-30T17:04:16.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.79e-07 2023-09-30T17:04:16.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.037 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.559035+0000", 2023-09-30T17:04:16.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3709999999999999e-05 2023-09-30T17:04:16.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.038 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.038 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.559041+0000", 2023-09-30T17:04:16.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.976e-06 2023-09-30T17:04:16.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.038 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.038 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.559045+0000", 2023-09-30T17:04:16.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5950000000000001e-06 2023-09-30T17:04:16.038 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.038 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.038 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.039 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124815 4.6 e53/17)", 2023-09-30T17:04:16.039 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.571565+0000", 2023-09-30T17:04:16.039 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9997892, 2023-09-30T17:04:16.039 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059273440000000002, 2023-09-30T17:04:16.039 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.039 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.039 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.039 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.039 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.571565+0000", 2023-09-30T17:04:16.039 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.040 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.040 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.040 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.040 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.571565+0000", 2023-09-30T17:04:16.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.040 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.040 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.040 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.040 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.571565+0000", 2023-09-30T17:04:16.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.82e-07 2023-09-30T17:04:16.040 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.040 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.041 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.041 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.571581+0000", 2023-09-30T17:04:16.041 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6303e-05 2023-09-30T17:04:16.041 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.041 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.041 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.041 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.571591+0000", 2023-09-30T17:04:16.041 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4620000000000002e-06 2023-09-30T17:04:16.041 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.041 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.041 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.041 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.571598+0000", 2023-09-30T17:04:16.042 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0419999999999997e-06 2023-09-30T17:04:16.042 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.042 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.042 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.042 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.042 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.042 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:123595 4.6 e53/17)", 2023-09-30T17:04:16.042 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.090849+0000", 2023-09-30T17:04:16.042 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.48050410500000001, 2023-09-30T17:04:16.042 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.486678371, 2023-09-30T17:04:16.042 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.042 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.043 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.043 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.043 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.043 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.090849+0000", 2023-09-30T17:04:16.043 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.043 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.043 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.043 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.043 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.090849+0000", 2023-09-30T17:04:16.043 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.043 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.043 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.044 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.044 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.090850+0000", 2023-09-30T17:04:16.044 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.67e-07 2023-09-30T17:04:16.044 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.044 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.044 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.044 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.090859+0000", 2023-09-30T17:04:16.044 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1919999999999994e-06 2023-09-30T17:04:16.044 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.044 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.044 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.045 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.090867+0000", 2023-09-30T17:04:16.045 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4209999999999995e-06 2023-09-30T17:04:16.045 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.045 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.045 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.045 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.090871+0000", 2023-09-30T17:04:16.045 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1069999999999998e-06 2023-09-30T17:04:16.045 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.045 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.045 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.045 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.045 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.046 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124680 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.046 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.129586+0000", 2023-09-30T17:04:16.046 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.441767258, 2023-09-30T17:04:16.046 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.447970441, 2023-09-30T17:04:16.046 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.046 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.046 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.046 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.046 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.046 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124680 2023-09-30T17:04:16.046 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.047 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.047 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.047 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.047 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.129586+0000", 2023-09-30T17:04:16.047 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.047 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.047 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.047 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.047 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.129586+0000", 2023-09-30T17:04:16.048 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.048 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.048 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.048 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.048 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.129587+0000", 2023-09-30T17:04:16.048 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3600000000000004e-07 2023-09-30T17:04:16.048 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.048 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.048 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.048 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.129598+0000", 2023-09-30T17:04:16.048 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1268e-05 2023-09-30T17:04:16.049 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.049 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.049 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.049 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.129605+0000", 2023-09-30T17:04:16.049 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.861e-06 2023-09-30T17:04:16.049 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.049 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.049 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.049 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.129610+0000", 2023-09-30T17:04:16.049 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3240000000000002e-06 2023-09-30T17:04:16.049 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.049 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.050 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.050 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.050 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.050 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:123858 4.6 e53/17)", 2023-09-30T17:04:16.050 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.243968+0000", 2023-09-30T17:04:16.050 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.327385276, 2023-09-30T17:04:16.050 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.33362175399999999, 2023-09-30T17:04:16.050 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.050 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.050 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.050 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.051 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.051 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.243968+0000", 2023-09-30T17:04:16.051 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.051 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.051 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.051 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.051 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.243968+0000", 2023-09-30T17:04:16.051 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.051 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.051 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.051 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.051 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.243969+0000", 2023-09-30T17:04:16.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3799999999999998e-07 2023-09-30T17:04:16.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.052 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.052 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.243993+0000", 2023-09-30T17:04:16.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3963000000000001e-05 2023-09-30T17:04:16.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.052 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.052 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.244001+0000", 2023-09-30T17:04:16.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1270000000000003e-06 2023-09-30T17:04:16.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.053 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.053 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.053 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.244007+0000", 2023-09-30T17:04:16.053 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.728e-06 2023-09-30T17:04:16.053 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.053 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.053 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.053 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.053 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.053 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:123906 4.6 e53/17)", 2023-09-30T17:04:16.053 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.267160+0000", 2023-09-30T17:04:16.053 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.30419322500000001, 2023-09-30T17:04:16.054 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.31045582999999999, 2023-09-30T17:04:16.054 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.054 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.054 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.054 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.054 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.054 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.267160+0000", 2023-09-30T17:04:16.054 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.054 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.054 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.054 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.054 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.267160+0000", 2023-09-30T17:04:16.055 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.055 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.055 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.055 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.055 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.267161+0000", 2023-09-30T17:04:16.055 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1299999999999998e-07 2023-09-30T17:04:16.055 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.055 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.055 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.055 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.267177+0000", 2023-09-30T17:04:16.055 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5304000000000001e-05 2023-09-30T17:04:16.055 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.056 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.056 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.056 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.267187+0000", 2023-09-30T17:04:16.056 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0429e-05 2023-09-30T17:04:16.056 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.056 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.056 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.056 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.267202+0000", 2023-09-30T17:04:16.056 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4909000000000001e-05 2023-09-30T17:04:16.056 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.056 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.056 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.057 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.057 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.057 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125052 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.057 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.277580+0000", 2023-09-30T17:04:16.057 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.293773809, 2023-09-30T17:04:16.057 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.30008003500000002, 2023-09-30T17:04:16.057 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.057 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.057 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.057 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.057 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.057 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125052 2023-09-30T17:04:16.058 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.058 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.058 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.058 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.058 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.277580+0000", 2023-09-30T17:04:16.058 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.058 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.058 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.058 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.058 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.277580+0000", 2023-09-30T17:04:16.058 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.058 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.059 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.059 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.059 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.279516+0000", 2023-09-30T17:04:16.059 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019357350000000001 2023-09-30T17:04:16.059 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.059 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.059 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.059 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.279529+0000", 2023-09-30T17:04:16.059 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3582e-05 2023-09-30T17:04:16.059 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.059 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.059 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.060 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.279540+0000", 2023-09-30T17:04:16.060 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1394e-05 2023-09-30T17:04:16.060 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.060 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.060 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.060 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.279547+0000", 2023-09-30T17:04:16.060 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4930000000000003e-06 2023-09-30T17:04:16.060 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.060 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.060 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.060 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.060 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.061 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125140 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.061 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.312743+0000", 2023-09-30T17:04:16.061 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.25861047399999998, 2023-09-30T17:04:16.061 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.26497156599999999, 2023-09-30T17:04:16.061 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.061 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.061 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.061 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.061 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.061 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125140 2023-09-30T17:04:16.061 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.061 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.062 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.062 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.062 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.312743+0000", 2023-09-30T17:04:16.062 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.062 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.062 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.062 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.062 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.312743+0000", 2023-09-30T17:04:16.062 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.062 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.062 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.062 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.063 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.314517+0000", 2023-09-30T17:04:16.063 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0017739769999999999 2023-09-30T17:04:16.063 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.063 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.063 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.063 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.314533+0000", 2023-09-30T17:04:16.063 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5758000000000001e-05 2023-09-30T17:04:16.063 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.063 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.063 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.063 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.314543+0000", 2023-09-30T17:04:16.063 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0599e-05 2023-09-30T17:04:16.064 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.064 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.064 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.064 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.314551+0000", 2023-09-30T17:04:16.064 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7449999999999995e-06 2023-09-30T17:04:16.064 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.064 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.064 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.064 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.064 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.064 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125277 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.065 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.349641+0000", 2023-09-30T17:04:16.065 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.221712838, 2023-09-30T17:04:16.065 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.228141173, 2023-09-30T17:04:16.065 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.065 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.065 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.065 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.065 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.065 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125277 2023-09-30T17:04:16.065 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.065 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.065 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.066 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.066 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.349641+0000", 2023-09-30T17:04:16.066 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.066 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.066 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.066 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.066 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.349641+0000", 2023-09-30T17:04:16.066 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.066 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.066 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.066 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.066 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.353515+0000", 2023-09-30T17:04:16.067 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038746420000000002 2023-09-30T17:04:16.067 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.067 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.067 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.067 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.353526+0000", 2023-09-30T17:04:16.067 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1053000000000001e-05 2023-09-30T17:04:16.067 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.067 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.067 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.067 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.353534+0000", 2023-09-30T17:04:16.067 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8169999999999999e-06 2023-09-30T17:04:16.067 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.068 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.068 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.068 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.353539+0000", 2023-09-30T17:04:16.068 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2910000000000001e-06 2023-09-30T17:04:16.068 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.068 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.068 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.068 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.068 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.068 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125403 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.068 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.397674+0000", 2023-09-30T17:04:16.068 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.17367943399999999, 2023-09-30T17:04:16.069 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.18017005799999999, 2023-09-30T17:04:16.069 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.069 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.069 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.069 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.069 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.069 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125403 2023-09-30T17:04:16.069 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.069 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.069 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.069 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.069 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.397674+0000", 2023-09-30T17:04:16.070 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.070 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.070 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.070 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.070 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.397674+0000", 2023-09-30T17:04:16.070 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.070 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.070 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.070 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.070 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.397675+0000", 2023-09-30T17:04:16.070 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8100000000000003e-07 2023-09-30T17:04:16.071 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.071 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.071 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.071 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.397686+0000", 2023-09-30T17:04:16.071 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1436e-05 2023-09-30T17:04:16.071 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.071 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.071 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.071 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.397692+0000", 2023-09-30T17:04:16.071 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.302e-06 2023-09-30T17:04:16.071 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.071 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.072 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.072 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.397698+0000", 2023-09-30T17:04:16.072 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0789999999999997e-06 2023-09-30T17:04:16.072 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.072 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.072 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.072 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.072 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.072 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124394 4.6 e53/17)", 2023-09-30T17:04:16.072 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.431609+0000", 2023-09-30T17:04:16.072 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.13974435900000001, 2023-09-30T17:04:16.072 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.14629297499999999, 2023-09-30T17:04:16.073 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.073 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.073 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.073 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.073 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.073 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.431609+0000", 2023-09-30T17:04:16.073 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.073 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.073 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.073 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.073 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.431609+0000", 2023-09-30T17:04:16.073 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.074 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.074 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.074 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.074 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.431610+0000", 2023-09-30T17:04:16.074 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.46e-07 2023-09-30T17:04:16.074 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.074 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.074 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.074 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.431624+0000", 2023-09-30T17:04:16.074 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4399999999999999e-05 2023-09-30T17:04:16.074 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.074 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.075 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.075 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.431634+0000", 2023-09-30T17:04:16.075 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8269999999999993e-06 2023-09-30T17:04:16.075 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.075 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.075 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.075 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.431641+0000", 2023-09-30T17:04:16.075 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6730000000000003e-06 2023-09-30T17:04:16.075 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.075 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.075 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.075 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.075 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.076 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124491 4.36 e53/17)", 2023-09-30T17:04:16.076 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.458833+0000", 2023-09-30T17:04:16.076 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.11252058099999999, 2023-09-30T17:04:16.076 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.11911888700000001, 2023-09-30T17:04:16.076 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.076 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.076 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.076 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.076 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.076 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.458833+0000", 2023-09-30T17:04:16.076 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.076 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.077 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.077 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.077 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.458833+0000", 2023-09-30T17:04:16.077 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.077 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.077 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.077 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.077 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.458834+0000", 2023-09-30T17:04:16.077 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2799999999999996e-07 2023-09-30T17:04:16.077 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.077 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.077 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.078 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.458856+0000", 2023-09-30T17:04:16.078 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2382999999999999e-05 2023-09-30T17:04:16.078 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.078 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.078 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.078 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.458867+0000", 2023-09-30T17:04:16.078 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0784999999999999e-05 2023-09-30T17:04:16.078 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.078 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.078 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.078 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.458873+0000", 2023-09-30T17:04:16.078 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4060000000000002e-06 2023-09-30T17:04:16.079 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.079 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.079 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.079 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.079 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.079 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125743 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.079 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.524621+0000", 2023-09-30T17:04:16.079 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.046732233999999997, 2023-09-30T17:04:16.079 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.053383598999999997, 2023-09-30T17:04:16.079 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.079 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.079 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.080 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.081 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.081 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125743 2023-09-30T17:04:16.081 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.081 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.081 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.081 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.081 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.524621+0000", 2023-09-30T17:04:16.082 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.082 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.082 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.082 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.082 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.524621+0000", 2023-09-30T17:04:16.082 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.082 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.082 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.082 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.082 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.526696+0000", 2023-09-30T17:04:16.083 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0020751369999999999 2023-09-30T17:04:16.083 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.083 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.083 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.083 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.526711+0000", 2023-09-30T17:04:16.083 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4171e-05 2023-09-30T17:04:16.083 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.083 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.083 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.083 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.526719+0000", 2023-09-30T17:04:16.083 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4679999999999992e-06 2023-09-30T17:04:16.084 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.084 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.084 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.084 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.526725+0000", 2023-09-30T17:04:16.084 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.083e-06 2023-09-30T17:04:16.084 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.084 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.084 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.084 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.084 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.084 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:125211 4.3f e53/17 4:fde182c5:::100000001f8.00000039:head v 53'1890, mlcod=53'1888)", 2023-09-30T17:04:16.084 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.559052+0000", 2023-09-30T17:04:16.085 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.012301638, 2023-09-30T17:04:16.085 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019003506, 2023-09-30T17:04:16.085 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.085 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:16.085 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.085 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.085 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.085 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.559052+0000", 2023-09-30T17:04:16.085 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.085 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.085 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.086 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.086 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.559052+0000", 2023-09-30T17:04:16.086 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.086 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.086 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.086 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.086 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.559052+0000", 2023-09-30T17:04:16.086 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6800000000000002e-07 2023-09-30T17:04:16.086 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.086 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.086 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.086 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.559063+0000", 2023-09-30T17:04:16.087 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0538e-05 2023-09-30T17:04:16.087 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.087 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.087 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.087 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.559068+0000", 2023-09-30T17:04:16.087 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3589999999999999e-06 2023-09-30T17:04:16.087 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.087 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.087 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.087 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.559072+0000", 2023-09-30T17:04:16.087 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9400000000000004e-06 2023-09-30T17:04:16.087 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.088 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.088 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:16.088 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.567552+0000", 2023-09-30T17:04:16.088 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.008479917 2023-09-30T17:04:16.088 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.088 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.088 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:16.088 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.567572+0000", 2023-09-30T17:04:16.088 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9888e-05 2023-09-30T17:04:16.088 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.088 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.089 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.089 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.089 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.089 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:125243 4.19 e53/17 4:997b7129:::100000001f8.00000000:head v 53'3895, mlcod=53'3890)", 2023-09-30T17:04:16.089 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.573553+0000", 2023-09-30T17:04:16.089 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9978008, 2023-09-30T17:04:16.089 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045838110000000001, 2023-09-30T17:04:16.089 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.089 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:16.089 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.089 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.090 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.090 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.573553+0000", 2023-09-30T17:04:16.090 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.090 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.090 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.090 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.090 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.573553+0000", 2023-09-30T17:04:16.090 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.090 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.090 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.090 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.090 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.573553+0000", 2023-09-30T17:04:16.091 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2099999999999996e-07 2023-09-30T17:04:16.091 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.091 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.091 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.091 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.573572+0000", 2023-09-30T17:04:16.091 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8777999999999999e-05 2023-09-30T17:04:16.091 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.091 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.091 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.091 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.573581+0000", 2023-09-30T17:04:16.091 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0890000000000006e-06 2023-09-30T17:04:16.091 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.092 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.092 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.092 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.573587+0000", 2023-09-30T17:04:16.092 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.959e-06 2023-09-30T17:04:16.092 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.092 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.092 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:16.092 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.573854+0000", 2023-09-30T17:04:16.092 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00026658999999999998 2023-09-30T17:04:16.092 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.092 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.093 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:16.093 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.573872+0000", 2023-09-30T17:04:16.093 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8457999999999998e-05 2023-09-30T17:04:16.093 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.093 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.093 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.093 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.093 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.093 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:123598 4.6 e53/17)", 2023-09-30T17:04:16.093 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.093588+0000", 2023-09-30T17:04:16.093 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.47776554100000002, 2023-09-30T17:04:16.093 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.48460058099999997, 2023-09-30T17:04:16.094 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.094 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.094 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.094 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.094 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.094 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.093588+0000", 2023-09-30T17:04:16.094 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.094 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.094 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.094 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.095 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.093588+0000", 2023-09-30T17:04:16.095 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.095 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.095 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.095 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.095 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.093589+0000", 2023-09-30T17:04:16.095 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7300000000000005e-07 2023-09-30T17:04:16.095 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.095 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.095 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.095 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.093609+0000", 2023-09-30T17:04:16.096 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0259e-05 2023-09-30T17:04:16.096 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.096 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.096 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.096 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.093619+0000", 2023-09-30T17:04:16.096 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0345e-05 2023-09-30T17:04:16.096 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.096 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.096 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.096 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.093627+0000", 2023-09-30T17:04:16.096 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4699999999999996e-06 2023-09-30T17:04:16.096 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.097 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.097 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.097 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.097 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.097 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:123668 4.6 e53/17)", 2023-09-30T17:04:16.097 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.142452+0000", 2023-09-30T17:04:16.097 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.428901374, 2023-09-30T17:04:16.097 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.43576393499999999, 2023-09-30T17:04:16.097 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.097 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.097 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.097 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.097 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.098 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.142452+0000", 2023-09-30T17:04:16.098 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.098 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.098 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.098 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.098 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.142452+0000", 2023-09-30T17:04:16.098 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.098 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.098 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.098 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.099 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.142452+0000", 2023-09-30T17:04:16.099 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0599999999999999e-07 2023-09-30T17:04:16.099 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.099 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.099 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.099 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.142467+0000", 2023-09-30T17:04:16.099 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4885000000000001e-05 2023-09-30T17:04:16.099 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.099 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.099 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.099 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.142473+0000", 2023-09-30T17:04:16.099 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0939999999999996e-06 2023-09-30T17:04:16.100 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.100 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.100 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.100 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.142478+0000", 2023-09-30T17:04:16.100 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5850000000000001e-06 2023-09-30T17:04:16.100 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.100 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.100 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.100 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.100 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.100 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124791 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.101 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.174563+0000", 2023-09-30T17:04:16.101 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.39679076600000002, 2023-09-30T17:04:16.101 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.40370625199999999, 2023-09-30T17:04:16.101 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.101 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.101 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.101 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.101 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.101 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124791 2023-09-30T17:04:16.101 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.101 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.101 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.102 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.102 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.174563+0000", 2023-09-30T17:04:16.102 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.102 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.102 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.102 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.102 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.174563+0000", 2023-09-30T17:04:16.102 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.102 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.102 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.102 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.103 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.174563+0000", 2023-09-30T17:04:16.103 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7899999999999999e-07 2023-09-30T17:04:16.103 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.103 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.103 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.103 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.174578+0000", 2023-09-30T17:04:16.103 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4313e-05 2023-09-30T17:04:16.103 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.103 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.103 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.103 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.174585+0000", 2023-09-30T17:04:16.103 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9290000000000001e-06 2023-09-30T17:04:16.104 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.104 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.104 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.104 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.174590+0000", 2023-09-30T17:04:16.104 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9989999999999999e-06 2023-09-30T17:04:16.104 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.104 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.104 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.104 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.104 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.104 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:123773 4.36 e53/17)", 2023-09-30T17:04:16.104 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.199396+0000", 2023-09-30T17:04:16.105 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.37195729399999999, 2023-09-30T17:04:16.105 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.378927562, 2023-09-30T17:04:16.105 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.105 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.105 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.105 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.105 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.105 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.199396+0000", 2023-09-30T17:04:16.105 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.105 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.105 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.105 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.106 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.199396+0000", 2023-09-30T17:04:16.106 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.106 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.106 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.106 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.106 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.199397+0000", 2023-09-30T17:04:16.106 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9499999999999998e-07 2023-09-30T17:04:16.106 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.106 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.106 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.106 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.199408+0000", 2023-09-30T17:04:16.107 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1042e-05 2023-09-30T17:04:16.107 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.107 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.107 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.107 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.199415+0000", 2023-09-30T17:04:16.107 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2289999999999997e-06 2023-09-30T17:04:16.107 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.107 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.107 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.107 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.199421+0000", 2023-09-30T17:04:16.107 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5849999999999999e-06 2023-09-30T17:04:16.107 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.108 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.108 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.108 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.108 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.108 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:123840 4.6 e53/17)", 2023-09-30T17:04:16.108 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.217301+0000", 2023-09-30T17:04:16.108 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.35405209500000001, 2023-09-30T17:04:16.108 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.36107133499999999, 2023-09-30T17:04:16.108 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.108 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.108 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.108 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.109 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.109 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.217301+0000", 2023-09-30T17:04:16.109 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.109 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.109 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.109 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.109 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.217301+0000", 2023-09-30T17:04:16.109 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.109 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.109 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.109 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.109 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.217302+0000", 2023-09-30T17:04:16.110 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3499999999999996e-07 2023-09-30T17:04:16.110 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.110 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.110 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.110 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.217312+0000", 2023-09-30T17:04:16.110 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0271e-05 2023-09-30T17:04:16.110 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.110 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.110 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.110 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.217323+0000", 2023-09-30T17:04:16.110 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1068e-05 2023-09-30T17:04:16.110 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.111 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.111 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.111 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.217329+0000", 2023-09-30T17:04:16.111 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1160000000000004e-06 2023-09-30T17:04:16.111 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.111 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.111 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.111 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.111 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.111 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:123895 4.6 e53/17)", 2023-09-30T17:04:16.111 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.253772+0000", 2023-09-30T17:04:16.111 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.31758206, 2023-09-30T17:04:16.111 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.32465139100000001, 2023-09-30T17:04:16.112 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.112 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.112 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.112 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.112 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.112 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.253772+0000", 2023-09-30T17:04:16.112 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.112 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.112 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.112 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.112 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.253772+0000", 2023-09-30T17:04:16.113 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.113 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.113 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.113 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.113 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.253772+0000", 2023-09-30T17:04:16.113 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2000000000000001e-07 2023-09-30T17:04:16.113 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.113 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.113 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.113 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.253782+0000", 2023-09-30T17:04:16.113 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0009e-05 2023-09-30T17:04:16.113 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.114 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.114 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.114 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.253787+0000", 2023-09-30T17:04:16.114 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4569999999999996e-06 2023-09-30T17:04:16.114 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.114 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.114 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.114 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.253792+0000", 2023-09-30T17:04:16.114 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5739999999999997e-06 2023-09-30T17:04:16.114 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.114 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.115 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.115 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.115 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.115 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125405 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.115 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.397706+0000", 2023-09-30T17:04:16.115 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.17364760500000001, 2023-09-30T17:04:16.115 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.180766753, 2023-09-30T17:04:16.115 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.115 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.115 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.115 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.115 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.116 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125405 2023-09-30T17:04:16.116 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.116 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.116 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.116 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.116 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.397706+0000", 2023-09-30T17:04:16.116 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.116 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.116 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.116 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.116 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.397706+0000", 2023-09-30T17:04:16.116 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.116 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.117 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.117 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.117 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.397706+0000", 2023-09-30T17:04:16.117 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6100000000000001e-07 2023-09-30T17:04:16.117 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.117 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.117 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.117 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.397720+0000", 2023-09-30T17:04:16.117 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3339999999999999e-05 2023-09-30T17:04:16.117 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.117 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.118 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.118 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.397727+0000", 2023-09-30T17:04:16.118 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7959999999999998e-06 2023-09-30T17:04:16.118 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.118 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.118 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.118 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.397732+0000", 2023-09-30T17:04:16.118 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5820000000000001e-06 2023-09-30T17:04:16.118 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.118 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.118 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.119 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.119 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.119 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124323 4.6 e53/17)", 2023-09-30T17:04:16.119 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.421438+0000", 2023-09-30T17:04:16.119 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.14991544100000001, 2023-09-30T17:04:16.119 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.157101405, 2023-09-30T17:04:16.119 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.119 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.119 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.119 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.119 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.119 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.421438+0000", 2023-09-30T17:04:16.120 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.120 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.120 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.120 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.120 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.421438+0000", 2023-09-30T17:04:16.120 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.120 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.120 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.120 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.120 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.421438+0000", 2023-09-30T17:04:16.120 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1199999999999999e-07 2023-09-30T17:04:16.121 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.121 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.121 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.121 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.421470+0000", 2023-09-30T17:04:16.121 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1267999999999999e-05 2023-09-30T17:04:16.121 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.121 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.121 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.121 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.421477+0000", 2023-09-30T17:04:16.121 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8419999999999999e-06 2023-09-30T17:04:16.121 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.121 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.122 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.122 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.421482+0000", 2023-09-30T17:04:16.122 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0200000000000002e-06 2023-09-30T17:04:16.122 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.122 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.122 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.122 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.122 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.122 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124416 4.6 e53/17)", 2023-09-30T17:04:16.122 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.441633+0000", 2023-09-30T17:04:16.122 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.12972059499999999, 2023-09-30T17:04:16.122 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.13710032, 2023-09-30T17:04:16.123 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.123 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.123 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.123 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.123 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.123 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.441633+0000", 2023-09-30T17:04:16.123 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.123 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.123 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.123 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.123 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.441633+0000", 2023-09-30T17:04:16.124 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.124 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.124 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.124 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.124 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.441633+0000", 2023-09-30T17:04:16.124 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.14e-07 2023-09-30T17:04:16.124 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.124 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.124 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.124 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.441642+0000", 2023-09-30T17:04:16.124 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6240000000000008e-06 2023-09-30T17:04:16.124 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.125 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.125 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.125 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.441655+0000", 2023-09-30T17:04:16.125 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2914999999999999e-05 2023-09-30T17:04:16.125 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.125 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.125 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.125 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.441658+0000", 2023-09-30T17:04:16.125 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0900000000000001e-06 2023-09-30T17:04:16.125 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.125 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.126 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.126 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.126 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.126 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124543 4.6 e53/17)", 2023-09-30T17:04:16.126 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.477554+0000", 2023-09-30T17:04:16.126 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.093799181999999995, 2023-09-30T17:04:16.126 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.101234901, 2023-09-30T17:04:16.126 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.126 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.126 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.126 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.127 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.127 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.477554+0000", 2023-09-30T17:04:16.127 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.127 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.127 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.127 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.127 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.477554+0000", 2023-09-30T17:04:16.127 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.127 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.127 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.127 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.127 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.477556+0000", 2023-09-30T17:04:16.128 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3769999999999999e-06 2023-09-30T17:04:16.128 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.128 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.128 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.128 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.477576+0000", 2023-09-30T17:04:16.128 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0038e-05 2023-09-30T17:04:16.128 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.128 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.128 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.128 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.477586+0000", 2023-09-30T17:04:16.128 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0441e-05 2023-09-30T17:04:16.128 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.129 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.129 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.129 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.477595+0000", 2023-09-30T17:04:16.129 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3839999999999997e-06 2023-09-30T17:04:16.129 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.129 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.129 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.129 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.129 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.129 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:125204 4.15 e53/17 4:aada5e43:::100000001f8.00000028:head v 53'1943, mlcod=53'1940)", 2023-09-30T17:04:16.129 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.559078+0000", 2023-09-30T17:04:16.129 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0122758, 2023-09-30T17:04:16.130 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019776777999999998, 2023-09-30T17:04:16.130 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.130 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:16.130 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.130 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.130 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.130 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.559078+0000", 2023-09-30T17:04:16.130 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.130 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.130 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.130 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.131 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.559078+0000", 2023-09-30T17:04:16.131 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.131 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.131 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.131 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.131 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.559078+0000", 2023-09-30T17:04:16.131 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8e-07 2023-09-30T17:04:16.131 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.131 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.131 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.131 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.559087+0000", 2023-09-30T17:04:16.131 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1609999999999992e-06 2023-09-30T17:04:16.132 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.132 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.132 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.132 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.559092+0000", 2023-09-30T17:04:16.132 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2070000000000003e-06 2023-09-30T17:04:16.132 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.132 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.132 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.132 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.559096+0000", 2023-09-30T17:04:16.132 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8469999999999998e-06 2023-09-30T17:04:16.132 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.132 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.133 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:16.133 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.559134+0000", 2023-09-30T17:04:16.133 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7632000000000002e-05 2023-09-30T17:04:16.133 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.133 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:16.133 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.559152+0000", 2023-09-30T17:04:16.133 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7739000000000001e-05 2023-09-30T17:04:16.133 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.133 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.133 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.133 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.134 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.134 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:123615 4.2e e53/17)", 2023-09-30T17:04:16.134 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.093641+0000", 2023-09-30T17:04:16.134 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.47771239199999999, 2023-09-30T17:04:16.134 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.48525312100000001, 2023-09-30T17:04:16.134 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.134 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.134 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.134 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.134 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.134 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.093641+0000", 2023-09-30T17:04:16.134 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.135 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.135 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.135 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.093641+0000", 2023-09-30T17:04:16.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.135 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.135 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.135 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.093642+0000", 2023-09-30T17:04:16.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.15e-07 2023-09-30T17:04:16.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.136 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.136 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.136 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.093653+0000", 2023-09-30T17:04:16.136 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1949e-05 2023-09-30T17:04:16.136 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.136 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.136 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.136 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.093661+0000", 2023-09-30T17:04:16.136 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4000000000000003e-06 2023-09-30T17:04:16.136 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.136 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.136 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.137 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.093666+0000", 2023-09-30T17:04:16.137 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1449999999999999e-06 2023-09-30T17:04:16.137 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.137 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.137 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.137 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.137 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.137 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124981 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.137 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.252702+0000", 2023-09-30T17:04:16.137 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.31865186400000001, 2023-09-30T17:04:16.137 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.32622386599999997, 2023-09-30T17:04:16.137 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.138 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.138 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.138 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.138 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.138 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124981 2023-09-30T17:04:16.138 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.138 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.138 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.138 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.138 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.252702+0000", 2023-09-30T17:04:16.138 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.138 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.139 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.139 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.139 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.252702+0000", 2023-09-30T17:04:16.139 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.139 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.139 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.139 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.139 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.256517+0000", 2023-09-30T17:04:16.139 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038157149999999999 2023-09-30T17:04:16.139 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.139 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.139 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.140 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.256539+0000", 2023-09-30T17:04:16.140 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1387e-05 2023-09-30T17:04:16.140 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.140 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.140 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.140 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.256549+0000", 2023-09-30T17:04:16.140 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0624e-05 2023-09-30T17:04:16.140 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.140 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.140 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.140 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.256558+0000", 2023-09-30T17:04:16.141 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.619e-06 2023-09-30T17:04:16.141 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.141 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.141 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.141 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.141 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.141 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125142 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.141 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.314598+0000", 2023-09-30T17:04:16.141 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.25675541000000002, 2023-09-30T17:04:16.141 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.26436005699999998, 2023-09-30T17:04:16.141 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.141 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.142 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.142 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.142 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.142 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125142 2023-09-30T17:04:16.142 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.142 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.142 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.142 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.142 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.314598+0000", 2023-09-30T17:04:16.142 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.143 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.143 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.143 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.143 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.314598+0000", 2023-09-30T17:04:16.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.143 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.143 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.143 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.143 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.314599+0000", 2023-09-30T17:04:16.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9800000000000004e-07 2023-09-30T17:04:16.143 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.143 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.144 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.144 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.314610+0000", 2023-09-30T17:04:16.144 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1229999999999999e-05 2023-09-30T17:04:16.144 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.144 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.144 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.144 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.314615+0000", 2023-09-30T17:04:16.144 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3369999999999999e-06 2023-09-30T17:04:16.144 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.144 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.144 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.144 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.314620+0000", 2023-09-30T17:04:16.145 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1819999999999997e-06 2023-09-30T17:04:16.145 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.145 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.145 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.145 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.145 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.145 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124103 4.36 e53/17)", 2023-09-30T17:04:16.145 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.364294+0000", 2023-09-30T17:04:16.145 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.20705992000000001, 2023-09-30T17:04:16.145 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.21473170899999999, 2023-09-30T17:04:16.145 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.146 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.146 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.146 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.146 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.146 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.364294+0000", 2023-09-30T17:04:16.146 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.146 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.146 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.146 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.146 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.364294+0000", 2023-09-30T17:04:16.146 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.147 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.147 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.147 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.147 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.364294+0000", 2023-09-30T17:04:16.147 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.31e-07 2023-09-30T17:04:16.147 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.147 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.147 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.147 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.364301+0000", 2023-09-30T17:04:16.147 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1099999999999997e-06 2023-09-30T17:04:16.147 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.147 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.148 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.148 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.364304+0000", 2023-09-30T17:04:16.148 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3869999999999999e-06 2023-09-30T17:04:16.148 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.148 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.148 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.148 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.364307+0000", 2023-09-30T17:04:16.148 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.463e-06 2023-09-30T17:04:16.148 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.148 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.149 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.149 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.149 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.149 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124445 4.36 e53/17)", 2023-09-30T17:04:16.149 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.451712+0000", 2023-09-30T17:04:16.149 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.119641513, 2023-09-30T17:04:16.149 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.127362422, 2023-09-30T17:04:16.149 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.149 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.149 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.149 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.149 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.150 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.451712+0000", 2023-09-30T17:04:16.150 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.150 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.150 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.150 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.150 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.451712+0000", 2023-09-30T17:04:16.150 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.150 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.150 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.150 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.150 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.451713+0000", 2023-09-30T17:04:16.151 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7800000000000001e-07 2023-09-30T17:04:16.151 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.151 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.151 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.151 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.451734+0000", 2023-09-30T17:04:16.151 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1229999999999998e-05 2023-09-30T17:04:16.151 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.151 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.151 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.151 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.451757+0000", 2023-09-30T17:04:16.151 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3078000000000002e-05 2023-09-30T17:04:16.151 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.152 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.152 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.152 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.451765+0000", 2023-09-30T17:04:16.152 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8089999999999993e-06 2023-09-30T17:04:16.152 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.152 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.152 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.152 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.152 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.152 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124623 4.6 e53/17)", 2023-09-30T17:04:16.152 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.508283+0000", 2023-09-30T17:04:16.152 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.063070531999999999, 2023-09-30T17:04:16.153 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.070844008999999999, 2023-09-30T17:04:16.153 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.153 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.153 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.153 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.153 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.153 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.508283+0000", 2023-09-30T17:04:16.153 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.153 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.153 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.153 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.154 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.508283+0000", 2023-09-30T17:04:16.154 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.154 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.154 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.154 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.154 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.508283+0000", 2023-09-30T17:04:16.154 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8000000000000001e-07 2023-09-30T17:04:16.154 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.154 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.154 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.154 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.508295+0000", 2023-09-30T17:04:16.155 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1548e-05 2023-09-30T17:04:16.155 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.155 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.155 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.155 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.508304+0000", 2023-09-30T17:04:16.155 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9390000000000003e-06 2023-09-30T17:04:16.155 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.155 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.155 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.155 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.508310+0000", 2023-09-30T17:04:16.155 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4969999999999998e-06 2023-09-30T17:04:16.155 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.156 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.156 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.156 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.156 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.156 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125803 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.156 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.557785+0000", 2023-09-30T17:04:16.156 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.013568946, 2023-09-30T17:04:16.156 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021399657999999998, 2023-09-30T17:04:16.156 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.156 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.156 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.156 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.157 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.157 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125803 2023-09-30T17:04:16.157 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.157 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.157 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.157 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.157 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.557785+0000", 2023-09-30T17:04:16.157 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.157 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.157 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.157 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.158 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.557785+0000", 2023-09-30T17:04:16.158 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.158 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.158 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.158 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.158 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.559519+0000", 2023-09-30T17:04:16.158 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0017339250000000001 2023-09-30T17:04:16.158 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.158 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.158 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.158 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.559534+0000", 2023-09-30T17:04:16.159 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5447999999999998e-05 2023-09-30T17:04:16.159 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.159 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.159 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.159 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.559545+0000", 2023-09-30T17:04:16.159 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0998e-05 2023-09-30T17:04:16.159 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.159 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.159 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.159 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.559553+0000", 2023-09-30T17:04:16.159 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5959999999999998e-06 2023-09-30T17:04:16.160 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.160 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.160 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.160 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.160 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.160 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124480 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.160 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.075772+0000", 2023-09-30T17:04:16.160 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.49558199800000002, 2023-09-30T17:04:16.160 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.50348682, 2023-09-30T17:04:16.160 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.160 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.160 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.161 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.161 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.161 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124480 2023-09-30T17:04:16.161 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.161 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.161 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.161 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.161 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.075772+0000", 2023-09-30T17:04:16.161 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.161 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.161 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.162 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.162 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.075772+0000", 2023-09-30T17:04:16.162 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.162 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.162 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.162 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.162 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.075772+0000", 2023-09-30T17:04:16.162 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3799999999999997e-07 2023-09-30T17:04:16.162 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.162 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.162 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.163 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.075792+0000", 2023-09-30T17:04:16.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9868999999999999e-05 2023-09-30T17:04:16.163 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.163 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.163 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.163 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.075800+0000", 2023-09-30T17:04:16.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0390000000000005e-06 2023-09-30T17:04:16.163 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.163 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.163 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.163 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.075806+0000", 2023-09-30T17:04:16.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7919999999999998e-06 2023-09-30T17:04:16.164 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.164 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.164 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.164 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124570 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.164 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.089687+0000", 2023-09-30T17:04:16.164 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.481667026, 2023-09-30T17:04:16.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.48963472699999999, 2023-09-30T17:04:16.164 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.164 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.165 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.165 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.165 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.165 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124570 2023-09-30T17:04:16.165 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.165 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.165 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.165 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.165 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.089687+0000", 2023-09-30T17:04:16.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.165 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.166 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.166 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.089687+0000", 2023-09-30T17:04:16.166 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.166 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.166 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.166 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.093678+0000", 2023-09-30T17:04:16.166 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039909469999999999 2023-09-30T17:04:16.166 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.167 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.167 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.093694+0000", 2023-09-30T17:04:16.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6407999999999999e-05 2023-09-30T17:04:16.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.167 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.167 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.093703+0000", 2023-09-30T17:04:16.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6090000000000001e-06 2023-09-30T17:04:16.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.167 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.167 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.093709+0000", 2023-09-30T17:04:16.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4570000000000002e-06 2023-09-30T17:04:16.168 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.168 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.168 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.168 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:123701 4.36 e53/17)", 2023-09-30T17:04:16.168 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.161352+0000", 2023-09-30T17:04:16.168 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.41000123100000002, 2023-09-30T17:04:16.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.418030399, 2023-09-30T17:04:16.168 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.168 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.169 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.161352+0000", 2023-09-30T17:04:16.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.161352+0000", 2023-09-30T17:04:16.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.170 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.170 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.161353+0000", 2023-09-30T17:04:16.170 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1900000000000001e-07 2023-09-30T17:04:16.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.170 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.170 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.161368+0000", 2023-09-30T17:04:16.170 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4944e-05 2023-09-30T17:04:16.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.170 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.170 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.161377+0000", 2023-09-30T17:04:16.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8459999999999997e-06 2023-09-30T17:04:16.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.161384+0000", 2023-09-30T17:04:16.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.601e-06 2023-09-30T17:04:16.171 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.171 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.171 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.172 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124838 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.172 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.182890+0000", 2023-09-30T17:04:16.172 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.38846371499999999, 2023-09-30T17:04:16.172 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.396674743, 2023-09-30T17:04:16.172 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.172 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.172 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.172 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.172 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.172 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124838 2023-09-30T17:04:16.173 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.173 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.173 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.173 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.182890+0000", 2023-09-30T17:04:16.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.173 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.173 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.173 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.182890+0000", 2023-09-30T17:04:16.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.185654+0000", 2023-09-30T17:04:16.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0027642080000000002 2023-09-30T17:04:16.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.175 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.185671+0000", 2023-09-30T17:04:16.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7218999999999999e-05 2023-09-30T17:04:16.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.175 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.175 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.185679+0000", 2023-09-30T17:04:16.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7400000000000004e-06 2023-09-30T17:04:16.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.185685+0000", 2023-09-30T17:04:16.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8699999999999997e-06 2023-09-30T17:04:16.176 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.176 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.176 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.176 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124866 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.176 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.199370+0000", 2023-09-30T17:04:16.176 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.37198370400000003, 2023-09-30T17:04:16.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.380248368, 2023-09-30T17:04:16.177 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.177 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.177 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.177 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.177 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.177 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124866 2023-09-30T17:04:16.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.177 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.177 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.177 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.199370+0000", 2023-09-30T17:04:16.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.178 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.178 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.178 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.178 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.199370+0000", 2023-09-30T17:04:16.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.178 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.178 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.178 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.178 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.200516+0000", 2023-09-30T17:04:16.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0011458729999999999 2023-09-30T17:04:16.178 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.200540+0000", 2023-09-30T17:04:16.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3833e-05 2023-09-30T17:04:16.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.200552+0000", 2023-09-30T17:04:16.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2636999999999999e-05 2023-09-30T17:04:16.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.180 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.200561+0000", 2023-09-30T17:04:16.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6139999999999992e-06 2023-09-30T17:04:16.180 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.180 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.180 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.180 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124923 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.180 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.230565+0000", 2023-09-30T17:04:16.180 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.34078907400000003, 2023-09-30T17:04:16.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.34910818199999999, 2023-09-30T17:04:16.180 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.181 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.181 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.181 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.181 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.181 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124923 2023-09-30T17:04:16.181 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.181 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.181 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.181 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.181 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.230565+0000", 2023-09-30T17:04:16.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.181 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.182 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.182 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.230565+0000", 2023-09-30T17:04:16.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.182 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.182 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.232565+0000", 2023-09-30T17:04:16.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0020002779999999999 2023-09-30T17:04:16.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.232577+0000", 2023-09-30T17:04:16.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1945e-05 2023-09-30T17:04:16.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.232585+0000", 2023-09-30T17:04:16.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9549999999999992e-06 2023-09-30T17:04:16.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.184 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.232591+0000", 2023-09-30T17:04:16.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2790000000000004e-06 2023-09-30T17:04:16.184 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.184 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.184 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.184 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124987 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.184 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.256572+0000", 2023-09-30T17:04:16.184 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.314782065, 2023-09-30T17:04:16.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.323152783, 2023-09-30T17:04:16.184 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.185 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.185 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.185 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.185 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.185 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124987 2023-09-30T17:04:16.185 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.185 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.185 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.185 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.185 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.256572+0000", 2023-09-30T17:04:16.185 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.186 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.186 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.186 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.186 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.256572+0000", 2023-09-30T17:04:16.186 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.186 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.186 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.186 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.186 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.256572+0000", 2023-09-30T17:04:16.186 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5599999999999995e-07 2023-09-30T17:04:16.186 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.187 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.256584+0000", 2023-09-30T17:04:16.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2152e-05 2023-09-30T17:04:16.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.187 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.256595+0000", 2023-09-30T17:04:16.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0423e-05 2023-09-30T17:04:16.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.188 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.256599+0000", 2023-09-30T17:04:16.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3800000000000004e-06 2023-09-30T17:04:16.188 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.188 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.188 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.188 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124063 4.36 e53/17)", 2023-09-30T17:04:16.188 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.328724+0000", 2023-09-30T17:04:16.188 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.242629659, 2023-09-30T17:04:16.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.25104995000000002, 2023-09-30T17:04:16.189 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.189 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.189 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.328724+0000", 2023-09-30T17:04:16.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.328724+0000", 2023-09-30T17:04:16.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.190 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.190 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.328725+0000", 2023-09-30T17:04:16.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7000000000000004e-07 2023-09-30T17:04:16.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.190 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.190 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.328741+0000", 2023-09-30T17:04:16.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6628000000000001e-05 2023-09-30T17:04:16.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.191 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.328753+0000", 2023-09-30T17:04:16.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1861e-05 2023-09-30T17:04:16.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.191 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.328760+0000", 2023-09-30T17:04:16.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2280000000000001e-06 2023-09-30T17:04:16.191 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.191 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.191 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.192 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124134 4.6 e53/17)", 2023-09-30T17:04:16.192 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.383848+0000", 2023-09-30T17:04:16.192 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.18750551900000001, 2023-09-30T17:04:16.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.195972121, 2023-09-30T17:04:16.192 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.192 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.192 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.383848+0000", 2023-09-30T17:04:16.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.383848+0000", 2023-09-30T17:04:16.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.383849+0000", 2023-09-30T17:04:16.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6499999999999998e-07 2023-09-30T17:04:16.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.194 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.383866+0000", 2023-09-30T17:04:16.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6991e-05 2023-09-30T17:04:16.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.194 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.383875+0000", 2023-09-30T17:04:16.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9889999999999998e-06 2023-09-30T17:04:16.195 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.195 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.195 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.195 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.383882+0000", 2023-09-30T17:04:16.195 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.844e-06 2023-09-30T17:04:16.195 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.195 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.195 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.195 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.195 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.195 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124250 4.6 e53/17)", 2023-09-30T17:04:16.195 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.410920+0000", 2023-09-30T17:04:16.196 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.160433151, 2023-09-30T17:04:16.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.168943064, 2023-09-30T17:04:16.196 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.196 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.196 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.196 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.196 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.196 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.410920+0000", 2023-09-30T17:04:16.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.196 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.196 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.196 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.197 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.410920+0000", 2023-09-30T17:04:16.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.197 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.197 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.197 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.410921+0000", 2023-09-30T17:04:16.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.64e-07 2023-09-30T17:04:16.197 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.197 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.197 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.410945+0000", 2023-09-30T17:04:16.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3760999999999998e-05 2023-09-30T17:04:16.198 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.198 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.198 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.198 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.410959+0000", 2023-09-30T17:04:16.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4184e-05 2023-09-30T17:04:16.198 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.198 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.198 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.198 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.410966+0000", 2023-09-30T17:04:16.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9140000000000002e-06 2023-09-30T17:04:16.198 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.198 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.199 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.199 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124455 4.6 e53/17)", 2023-09-30T17:04:16.199 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.451781+0000", 2023-09-30T17:04:16.199 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.119572444, 2023-09-30T17:04:16.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.128128142, 2023-09-30T17:04:16.199 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.199 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.199 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.200 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.451781+0000", 2023-09-30T17:04:16.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.200 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.451781+0000", 2023-09-30T17:04:16.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.200 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.451781+0000", 2023-09-30T17:04:16.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4900000000000001e-07 2023-09-30T17:04:16.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.201 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.201 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.451801+0000", 2023-09-30T17:04:16.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9097e-05 2023-09-30T17:04:16.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.201 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.201 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.451809+0000", 2023-09-30T17:04:16.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9929999999999995e-06 2023-09-30T17:04:16.202 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.202 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.202 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.451815+0000", 2023-09-30T17:04:16.202 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5200000000000003e-06 2023-09-30T17:04:16.202 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.202 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.202 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.202 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.202 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125584 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.202 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.459563+0000", 2023-09-30T17:04:16.203 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.111790264, 2023-09-30T17:04:16.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.12039258999999999, 2023-09-30T17:04:16.203 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.203 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.203 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.203 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.203 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.203 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125584 2023-09-30T17:04:16.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.203 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.204 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.204 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.459563+0000", 2023-09-30T17:04:16.204 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.204 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.204 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.459563+0000", 2023-09-30T17:04:16.204 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.205 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.205 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.459564+0000", 2023-09-30T17:04:16.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6100000000000001e-07 2023-09-30T17:04:16.205 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.205 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.205 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.459575+0000", 2023-09-30T17:04:16.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.082e-05 2023-09-30T17:04:16.205 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.205 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.205 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.459581+0000", 2023-09-30T17:04:16.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.55e-06 2023-09-30T17:04:16.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.206 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.206 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.459586+0000", 2023-09-30T17:04:16.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1549999999999998e-06 2023-09-30T17:04:16.206 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.206 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.206 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.206 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124759 4.36 e53/17)", 2023-09-30T17:04:16.207 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.547613+0000", 2023-09-30T17:04:16.207 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.023740963, 2023-09-30T17:04:16.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.032397329000000002, 2023-09-30T17:04:16.207 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.207 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.207 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.207 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.207 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.547613+0000", 2023-09-30T17:04:16.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.208 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.208 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.547613+0000", 2023-09-30T17:04:16.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.208 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.208 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.208 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.547613+0000", 2023-09-30T17:04:16.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.39e-07 2023-09-30T17:04:16.208 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.208 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.209 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.547628+0000", 2023-09-30T17:04:16.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4562999999999999e-05 2023-09-30T17:04:16.209 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.209 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.209 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.547641+0000", 2023-09-30T17:04:16.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3847e-05 2023-09-30T17:04:16.209 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.209 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.209 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.547649+0000", 2023-09-30T17:04:16.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8599999999999993e-06 2023-09-30T17:04:16.210 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.210 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.210 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.210 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.210 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125842 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.210 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.568967+0000", 2023-09-30T17:04:16.210 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.002387007, 2023-09-30T17:04:16.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011090717999999999, 2023-09-30T17:04:16.210 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.211 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.211 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.211 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.211 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.211 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125842 2023-09-30T17:04:16.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.211 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.568967+0000", 2023-09-30T17:04:16.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.212 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.212 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.212 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.568967+0000", 2023-09-30T17:04:16.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.212 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.212 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.212 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.574522+0000", 2023-09-30T17:04:16.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0055555589999999998 2023-09-30T17:04:16.212 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.213 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.213 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.213 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.574535+0000", 2023-09-30T17:04:16.213 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2972999999999999e-05 2023-09-30T17:04:16.213 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.213 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.213 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.213 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.574543+0000", 2023-09-30T17:04:16.213 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2190000000000004e-06 2023-09-30T17:04:16.213 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.213 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.213 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.214 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.574548+0000", 2023-09-30T17:04:16.214 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8770000000000001e-06 2023-09-30T17:04:16.214 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.214 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.214 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.214 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.214 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:123652 4.36 e53/17)", 2023-09-30T17:04:16.214 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.111731+0000", 2023-09-30T17:04:16.214 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.45962210199999998, 2023-09-30T17:04:16.214 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.46838221099999999, 2023-09-30T17:04:16.215 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.215 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.215 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.215 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.111731+0000", 2023-09-30T17:04:16.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.215 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.215 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.216 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.111731+0000", 2023-09-30T17:04:16.216 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.216 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.216 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.216 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.216 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.111732+0000", 2023-09-30T17:04:16.216 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1900000000000003e-07 2023-09-30T17:04:16.216 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.216 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.216 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.216 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.111747+0000", 2023-09-30T17:04:16.217 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5176e-05 2023-09-30T17:04:16.217 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.217 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.217 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.111757+0000", 2023-09-30T17:04:16.217 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5000000000000005e-06 2023-09-30T17:04:16.217 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.217 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.217 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.111763+0000", 2023-09-30T17:04:16.217 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2210000000000002e-06 2023-09-30T17:04:16.217 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.218 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.218 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.218 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.218 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.218 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:123703 4.6 e53/17)", 2023-09-30T17:04:16.218 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.161395+0000", 2023-09-30T17:04:16.218 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.40995880400000001, 2023-09-30T17:04:16.218 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.418765208, 2023-09-30T17:04:16.218 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.218 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.218 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.219 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.219 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.161395+0000", 2023-09-30T17:04:16.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.219 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.219 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.219 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.161395+0000", 2023-09-30T17:04:16.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.219 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.219 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.220 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.161395+0000", 2023-09-30T17:04:16.220 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.53e-07 2023-09-30T17:04:16.220 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.220 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.220 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.220 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.161407+0000", 2023-09-30T17:04:16.220 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1966e-05 2023-09-30T17:04:16.220 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.220 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.220 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.220 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.161412+0000", 2023-09-30T17:04:16.220 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4090000000000002e-06 2023-09-30T17:04:16.221 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.221 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.221 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.221 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.161416+0000", 2023-09-30T17:04:16.221 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1760000000000002e-06 2023-09-30T17:04:16.221 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.221 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.221 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.221 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.221 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.221 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124797 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.221 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.176577+0000", 2023-09-30T17:04:16.222 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.39477683899999999, 2023-09-30T17:04:16.222 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.40362835699999999, 2023-09-30T17:04:16.222 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.222 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.222 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.222 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.222 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.222 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124797 2023-09-30T17:04:16.222 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.222 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.222 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.222 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.176577+0000", 2023-09-30T17:04:16.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.223 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.176577+0000", 2023-09-30T17:04:16.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.223 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.176577+0000", 2023-09-30T17:04:16.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4799999999999998e-07 2023-09-30T17:04:16.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.224 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.224 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.224 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.176591+0000", 2023-09-30T17:04:16.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3179e-05 2023-09-30T17:04:16.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.224 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.224 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.224 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.176598+0000", 2023-09-30T17:04:16.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7680000000000008e-06 2023-09-30T17:04:16.225 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.225 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.225 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.225 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.176606+0000", 2023-09-30T17:04:16.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1629999999999999e-06 2023-09-30T17:04:16.225 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.225 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.225 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.225 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.225 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.225 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:123938 4.36 e53/17)", 2023-09-30T17:04:16.225 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.281353+0000", 2023-09-30T17:04:16.226 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.29000089600000001, 2023-09-30T17:04:16.226 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.29890362799999998, 2023-09-30T17:04:16.226 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.226 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.226 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.226 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.226 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.226 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.281353+0000", 2023-09-30T17:04:16.226 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.226 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.226 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.281353+0000", 2023-09-30T17:04:16.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.281353+0000", 2023-09-30T17:04:16.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1399999999999996e-07 2023-09-30T17:04:16.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.281375+0000", 2023-09-30T17:04:16.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2073e-05 2023-09-30T17:04:16.228 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.228 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.228 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.228 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.281385+0000", 2023-09-30T17:04:16.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5889999999999992e-06 2023-09-30T17:04:16.228 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.228 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.228 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.228 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.281392+0000", 2023-09-30T17:04:16.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3900000000000004e-06 2023-09-30T17:04:16.229 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.229 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.229 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.229 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124002 4.36 e53/17)", 2023-09-30T17:04:16.229 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.303322+0000", 2023-09-30T17:04:16.229 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.26803133699999998, 2023-09-30T17:04:16.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.27697741100000001, 2023-09-30T17:04:16.229 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.229 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.229 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.230 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.230 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.303322+0000", 2023-09-30T17:04:16.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.230 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.230 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.230 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.303322+0000", 2023-09-30T17:04:16.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.230 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.231 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.303323+0000", 2023-09-30T17:04:16.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1600000000000002e-07 2023-09-30T17:04:16.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.231 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.303336+0000", 2023-09-30T17:04:16.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3142999999999999e-05 2023-09-30T17:04:16.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.231 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.303342+0000", 2023-09-30T17:04:16.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3929999999999996e-06 2023-09-30T17:04:16.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.232 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.303347+0000", 2023-09-30T17:04:16.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7639999999999996e-06 2023-09-30T17:04:16.232 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.232 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.232 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.232 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125242 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.233 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.339624+0000", 2023-09-30T17:04:16.233 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.231729299, 2023-09-30T17:04:16.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.24072091100000001, 2023-09-30T17:04:16.233 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.233 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.233 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.233 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.233 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.233 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125242 2023-09-30T17:04:16.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.233 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.233 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.234 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.234 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.339624+0000", 2023-09-30T17:04:16.234 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.234 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.234 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.234 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.234 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.339624+0000", 2023-09-30T17:04:16.234 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.234 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.234 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.234 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.234 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.339625+0000", 2023-09-30T17:04:16.235 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.91e-07 2023-09-30T17:04:16.235 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.235 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.235 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.235 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.339639+0000", 2023-09-30T17:04:16.235 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3952e-05 2023-09-30T17:04:16.235 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.235 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.235 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.235 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.339665+0000", 2023-09-30T17:04:16.235 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6764e-05 2023-09-30T17:04:16.235 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.235 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.236 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.236 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.339671+0000", 2023-09-30T17:04:16.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9030000000000001e-06 2023-09-30T17:04:16.236 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.236 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.236 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.236 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.236 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.236 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124136 4.36 e53/17)", 2023-09-30T17:04:16.236 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.383935+0000", 2023-09-30T17:04:16.236 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.187418474, 2023-09-30T17:04:16.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.196463416, 2023-09-30T17:04:16.237 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.237 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.237 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.383935+0000", 2023-09-30T17:04:16.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.383935+0000", 2023-09-30T17:04:16.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.238 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.383936+0000", 2023-09-30T17:04:16.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1699999999999999e-07 2023-09-30T17:04:16.238 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.383957+0000", 2023-09-30T17:04:16.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1223999999999999e-05 2023-09-30T17:04:16.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.239 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.239 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.383964+0000", 2023-09-30T17:04:16.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0910000000000004e-06 2023-09-30T17:04:16.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.239 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.239 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.383969+0000", 2023-09-30T17:04:16.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4269999999999999e-06 2023-09-30T17:04:16.239 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.240 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.240 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.240 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.240 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.240 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124336 4.2e e53/17)", 2023-09-30T17:04:16.240 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.423738+0000", 2023-09-30T17:04:16.240 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.147615622, 2023-09-30T17:04:16.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.15670331000000001, 2023-09-30T17:04:16.240 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.240 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.240 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.241 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.241 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.423738+0000", 2023-09-30T17:04:16.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.241 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.241 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.241 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.423738+0000", 2023-09-30T17:04:16.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.241 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.241 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.423739+0000", 2023-09-30T17:04:16.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4600000000000005e-07 2023-09-30T17:04:16.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.423748+0000", 2023-09-30T17:04:16.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1719999999999996e-06 2023-09-30T17:04:16.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.423754+0000", 2023-09-30T17:04:16.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2040000000000002e-06 2023-09-30T17:04:16.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.423760+0000", 2023-09-30T17:04:16.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7610000000000004e-06 2023-09-30T17:04:16.243 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.243 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.243 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.243 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124546 4.6 e53/17)", 2023-09-30T17:04:16.244 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.477807+0000", 2023-09-30T17:04:16.244 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.093546130000000005, 2023-09-30T17:04:16.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.102679277, 2023-09-30T17:04:16.244 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.244 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.244 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.477807+0000", 2023-09-30T17:04:16.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.245 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.245 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.477807+0000", 2023-09-30T17:04:16.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.245 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.245 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.477808+0000", 2023-09-30T17:04:16.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3499999999999996e-07 2023-09-30T17:04:16.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.245 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.246 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.477819+0000", 2023-09-30T17:04:16.246 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1223000000000001e-05 2023-09-30T17:04:16.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.246 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.246 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.477826+0000", 2023-09-30T17:04:16.246 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.985e-06 2023-09-30T17:04:16.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.246 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.477837+0000", 2023-09-30T17:04:16.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0607e-05 2023-09-30T17:04:16.247 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.247 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.247 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.247 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124582 4.6 e53/17)", 2023-09-30T17:04:16.247 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.495029+0000", 2023-09-30T17:04:16.247 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.076324551000000004, 2023-09-30T17:04:16.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.085505827000000006, 2023-09-30T17:04:16.248 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.248 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.248 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.248 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.248 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.495029+0000", 2023-09-30T17:04:16.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.248 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.248 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.249 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.495029+0000", 2023-09-30T17:04:16.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.249 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.249 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.495030+0000", 2023-09-30T17:04:16.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3600000000000004e-07 2023-09-30T17:04:16.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.249 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.249 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.495055+0000", 2023-09-30T17:04:16.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5324999999999999e-05 2023-09-30T17:04:16.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.495069+0000", 2023-09-30T17:04:16.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4246999999999999e-05 2023-09-30T17:04:16.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.495075+0000", 2023-09-30T17:04:16.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9789999999999998e-06 2023-09-30T17:04:16.251 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.251 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.251 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.251 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124696 4.36 e53/17)", 2023-09-30T17:04:16.251 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.530094+0000", 2023-09-30T17:04:16.251 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.041259961999999997, 2023-09-30T17:04:16.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.050485662000000001, 2023-09-30T17:04:16.251 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.252 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.252 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.530094+0000", 2023-09-30T17:04:16.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.530094+0000", 2023-09-30T17:04:16.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.253 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.530094+0000", 2023-09-30T17:04:16.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6100000000000001e-07 2023-09-30T17:04:16.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.253 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.530107+0000", 2023-09-30T17:04:16.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3179999999999999e-05 2023-09-30T17:04:16.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.254 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.254 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.530116+0000", 2023-09-30T17:04:16.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8210000000000008e-06 2023-09-30T17:04:16.254 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.254 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.254 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.530123+0000", 2023-09-30T17:04:16.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4819999999999999e-06 2023-09-30T17:04:16.254 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.254 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.255 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.255 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125810 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.255 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.559608+0000", 2023-09-30T17:04:16.255 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.011745471, 2023-09-30T17:04:16.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021020580000000001, 2023-09-30T17:04:16.255 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.255 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.255 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.255 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.256 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.256 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125810 2023-09-30T17:04:16.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.256 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.559608+0000", 2023-09-30T17:04:16.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.257 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.257 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.559608+0000", 2023-09-30T17:04:16.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.257 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.257 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.257 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.559609+0000", 2023-09-30T17:04:16.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7100000000000002e-07 2023-09-30T17:04:16.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.257 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.258 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.559622+0000", 2023-09-30T17:04:16.258 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2967e-05 2023-09-30T17:04:16.258 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.258 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.559633+0000", 2023-09-30T17:04:16.258 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1770000000000001e-05 2023-09-30T17:04:16.258 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.559638+0000", 2023-09-30T17:04:16.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0540000000000002e-06 2023-09-30T17:04:16.259 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.259 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.259 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.259 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125843 4.35 4:af28909f:::100000001f8.0000001b:head [write 778240~4096 in=4096b,write 806912~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.259 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.574558+0000", 2023-09-30T17:04:16.259 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9967957, 2023-09-30T17:04:16.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0061300770000000003, 2023-09-30T17:04:16.260 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.260 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:16.260 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.260 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.260 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.260 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125843 2023-09-30T17:04:16.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.260 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.574558+0000", 2023-09-30T17:04:16.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.261 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.261 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.574558+0000", 2023-09-30T17:04:16.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.261 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.261 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.574558+0000", 2023-09-30T17:04:16.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4200000000000002e-07 2023-09-30T17:04:16.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.262 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.262 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.574567+0000", 2023-09-30T17:04:16.262 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3100000000000006e-06 2023-09-30T17:04:16.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.262 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.262 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.574572+0000", 2023-09-30T17:04:16.262 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.092e-06 2023-09-30T17:04:16.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.574575+0000", 2023-09-30T17:04:16.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.117e-06 2023-09-30T17:04:16.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:16.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.574634+0000", 2023-09-30T17:04:16.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9116000000000001e-05 2023-09-30T17:04:16.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:16.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.574717+0000", 2023-09-30T17:04:16.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3633000000000004e-05 2023-09-30T17:04:16.264 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.264 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.264 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.264 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:123655 4.6 e53/17)", 2023-09-30T17:04:16.264 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.111778+0000", 2023-09-30T17:04:16.264 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.45957578700000001, 2023-09-30T17:04:16.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.46897549999999999, 2023-09-30T17:04:16.265 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.265 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.265 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.111778+0000", 2023-09-30T17:04:16.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.111778+0000", 2023-09-30T17:04:16.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.266 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.266 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.266 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.266 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.111778+0000", 2023-09-30T17:04:16.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6699999999999999e-07 2023-09-30T17:04:16.266 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.266 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.266 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.266 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.111787+0000", 2023-09-30T17:04:16.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3309999999999993e-06 2023-09-30T17:04:16.267 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.267 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.267 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.111795+0000", 2023-09-30T17:04:16.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0400000000000004e-06 2023-09-30T17:04:16.267 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.267 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.267 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.111800+0000", 2023-09-30T17:04:16.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1900000000000003e-06 2023-09-30T17:04:16.267 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.268 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.268 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.268 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.268 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125033 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.268 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.269573+0000", 2023-09-30T17:04:16.268 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.301780255, 2023-09-30T17:04:16.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.31122659000000003, 2023-09-30T17:04:16.268 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.268 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.268 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.268 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.269 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.269 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125033 2023-09-30T17:04:16.269 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.269 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.269 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.269 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.269573+0000", 2023-09-30T17:04:16.269 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.269 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.269 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.269 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.269573+0000", 2023-09-30T17:04:16.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.270 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.269574+0000", 2023-09-30T17:04:16.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7899999999999999e-07 2023-09-30T17:04:16.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.270 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.269584+0000", 2023-09-30T17:04:16.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0711e-05 2023-09-30T17:04:16.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.269590+0000", 2023-09-30T17:04:16.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8730000000000004e-06 2023-09-30T17:04:16.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.269595+0000", 2023-09-30T17:04:16.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8949999999999997e-06 2023-09-30T17:04:16.271 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.271 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.271 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.272 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.272 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:123991 4.36 e53/17)", 2023-09-30T17:04:16.272 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.294366+0000", 2023-09-30T17:04:16.272 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.27698779499999998, 2023-09-30T17:04:16.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.28648790499999999, 2023-09-30T17:04:16.272 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.272 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.272 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.272 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.294366+0000", 2023-09-30T17:04:16.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.273 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.273 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.273 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.273 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.294366+0000", 2023-09-30T17:04:16.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.273 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.273 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.273 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.273 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.294366+0000", 2023-09-30T17:04:16.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9200000000000002e-07 2023-09-30T17:04:16.273 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.274 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.274 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.294379+0000", 2023-09-30T17:04:16.274 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.292e-05 2023-09-30T17:04:16.274 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.274 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.274 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.294385+0000", 2023-09-30T17:04:16.274 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3389999999999998e-06 2023-09-30T17:04:16.274 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.275 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.275 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.294390+0000", 2023-09-30T17:04:16.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7960000000000003e-06 2023-09-30T17:04:16.275 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.275 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.275 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.275 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.275 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125588 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.275 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.459627+0000", 2023-09-30T17:04:16.275 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.111726859, 2023-09-30T17:04:16.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.12127416000000001, 2023-09-30T17:04:16.276 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.276 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.276 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.276 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.276 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.276 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125588 2023-09-30T17:04:16.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.276 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.459627+0000", 2023-09-30T17:04:16.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.459627+0000", 2023-09-30T17:04:16.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.459627+0000", 2023-09-30T17:04:16.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2e-07 2023-09-30T17:04:16.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.459637+0000", 2023-09-30T17:04:16.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0010000000000001e-05 2023-09-30T17:04:16.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.459643+0000", 2023-09-30T17:04:16.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8510000000000004e-06 2023-09-30T17:04:16.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.459648+0000", 2023-09-30T17:04:16.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7439999999999998e-06 2023-09-30T17:04:16.279 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.279 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.279 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.279 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124643 4.36 e53/17)", 2023-09-30T17:04:16.279 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.512097+0000", 2023-09-30T17:04:16.279 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.059256463000000002, 2023-09-30T17:04:16.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.068859505000000001, 2023-09-30T17:04:16.280 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.280 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.280 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.280 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.280 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.512097+0000", 2023-09-30T17:04:16.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.280 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.280 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.512097+0000", 2023-09-30T17:04:16.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.512098+0000", 2023-09-30T17:04:16.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6499999999999999e-07 2023-09-30T17:04:16.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.512116+0000", 2023-09-30T17:04:16.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7963000000000001e-05 2023-09-30T17:04:16.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.512124+0000", 2023-09-30T17:04:16.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6070000000000008e-06 2023-09-30T17:04:16.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.512131+0000", 2023-09-30T17:04:16.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7309999999999996e-06 2023-09-30T17:04:16.282 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.282 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.283 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.283 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125747 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.283 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.526735+0000", 2023-09-30T17:04:16.283 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.044618972999999999, 2023-09-30T17:04:16.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.054269901000000002, 2023-09-30T17:04:16.283 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.283 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.283 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.283 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.284 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.284 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125747 2023-09-30T17:04:16.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.284 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.284 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.284 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.526735+0000", 2023-09-30T17:04:16.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.284 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.284 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.526735+0000", 2023-09-30T17:04:16.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.530518+0000", 2023-09-30T17:04:16.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0037834359999999998 2023-09-30T17:04:16.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.530532+0000", 2023-09-30T17:04:16.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3531e-05 2023-09-30T17:04:16.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.530541+0000", 2023-09-30T17:04:16.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2280000000000004e-06 2023-09-30T17:04:16.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.530549+0000", 2023-09-30T17:04:16.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0900000000000005e-06 2023-09-30T17:04:16.286 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.286 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.286 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.287 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125845 4.35 4:af28909f:::100000001f8.0000001b:head [write 229376~4096 in=4096b,write 307200~4096 in=4096b,write 323584~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.287 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.574584+0000", 2023-09-30T17:04:16.287 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9967699, 2023-09-30T17:04:16.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0064824219999999998, 2023-09-30T17:04:16.287 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.287 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:16.287 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.287 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.287 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.287 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125845 2023-09-30T17:04:16.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.288 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.574584+0000", 2023-09-30T17:04:16.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.574584+0000", 2023-09-30T17:04:16.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.289 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.289 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.574584+0000", 2023-09-30T17:04:16.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0699999999999998e-07 2023-09-30T17:04:16.289 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.289 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.289 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.574602+0000", 2023-09-30T17:04:16.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8165999999999999e-05 2023-09-30T17:04:16.289 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.290 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.574609+0000", 2023-09-30T17:04:16.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.516e-06 2023-09-30T17:04:16.290 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.290 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.574633+0000", 2023-09-30T17:04:16.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4338e-05 2023-09-30T17:04:16.290 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:16.290 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.579088+0000", 2023-09-30T17:04:16.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0044544540000000001 2023-09-30T17:04:16.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:16.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.579167+0000", 2023-09-30T17:04:16.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9740999999999994e-05 2023-09-30T17:04:16.291 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.291 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.291 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.291 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:123783 4.36 e53/17)", 2023-09-30T17:04:16.292 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.201583+0000", 2023-09-30T17:04:16.292 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.36977040799999999, 2023-09-30T17:04:16.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.379546985, 2023-09-30T17:04:16.292 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.292 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.292 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.201583+0000", 2023-09-30T17:04:16.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.293 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.293 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.201583+0000", 2023-09-30T17:04:16.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.293 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.293 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.293 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.201583+0000", 2023-09-30T17:04:16.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9700000000000003e-07 2023-09-30T17:04:16.294 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.294 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.294 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.201594+0000", 2023-09-30T17:04:16.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1004e-05 2023-09-30T17:04:16.294 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.294 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.294 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.201601+0000", 2023-09-30T17:04:16.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0900000000000001e-06 2023-09-30T17:04:16.294 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.201605+0000", 2023-09-30T17:04:16.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6909999999999996e-06 2023-09-30T17:04:16.295 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.295 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.295 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.295 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125114 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.295 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.300796+0000", 2023-09-30T17:04:16.295 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.27055747899999999, 2023-09-30T17:04:16.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.28038629500000001, 2023-09-30T17:04:16.296 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.296 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.296 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.296 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.296 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.296 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125114 2023-09-30T17:04:16.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.296 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.296 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.300796+0000", 2023-09-30T17:04:16.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.300796+0000", 2023-09-30T17:04:16.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.303394+0000", 2023-09-30T17:04:16.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0025982840000000002 2023-09-30T17:04:16.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.303415+0000", 2023-09-30T17:04:16.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0134000000000001e-05 2023-09-30T17:04:16.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.303423+0000", 2023-09-30T17:04:16.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4980000000000006e-06 2023-09-30T17:04:16.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.299 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.299 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.303430+0000", 2023-09-30T17:04:16.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5969999999999997e-06 2023-09-30T17:04:16.299 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.299 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.299 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.299 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.299 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124038 4.6 e53/17)", 2023-09-30T17:04:16.299 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.316533+0000", 2023-09-30T17:04:16.299 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.25482096700000001, 2023-09-30T17:04:16.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.264712689, 2023-09-30T17:04:16.300 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.300 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.300 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.300 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.300 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.316533+0000", 2023-09-30T17:04:16.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.300 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.300 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.316533+0000", 2023-09-30T17:04:16.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.301 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.316534+0000", 2023-09-30T17:04:16.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1500000000000003e-07 2023-09-30T17:04:16.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.301 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.316548+0000", 2023-09-30T17:04:16.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4394e-05 2023-09-30T17:04:16.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.302 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.316558+0000", 2023-09-30T17:04:16.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0254999999999999e-05 2023-09-30T17:04:16.302 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.302 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.316565+0000", 2023-09-30T17:04:16.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.221e-06 2023-09-30T17:04:16.302 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.302 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.302 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.303 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125310 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.303 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.365573+0000", 2023-09-30T17:04:16.303 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.20578048500000001, 2023-09-30T17:04:16.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.21572371700000001, 2023-09-30T17:04:16.303 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.303 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.303 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.303 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.303 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.304 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125310 2023-09-30T17:04:16.304 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.304 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.304 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.304 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.365573+0000", 2023-09-30T17:04:16.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.304 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.304 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.304 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.365573+0000", 2023-09-30T17:04:16.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.305 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.305 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.365574+0000", 2023-09-30T17:04:16.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5799999999999999e-07 2023-09-30T17:04:16.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.305 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.305 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.365584+0000", 2023-09-30T17:04:16.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.031e-05 2023-09-30T17:04:16.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.365591+0000", 2023-09-30T17:04:16.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9450000000000004e-06 2023-09-30T17:04:16.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.365596+0000", 2023-09-30T17:04:16.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5860000000000004e-06 2023-09-30T17:04:16.306 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.306 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.306 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.307 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124227 4.2e e53/17)", 2023-09-30T17:04:16.307 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.401540+0000", 2023-09-30T17:04:16.307 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.169813729, 2023-09-30T17:04:16.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.17981645299999999, 2023-09-30T17:04:16.307 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.307 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.307 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.401540+0000", 2023-09-30T17:04:16.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.308 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.308 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.401540+0000", 2023-09-30T17:04:16.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.308 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.308 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.401541+0000", 2023-09-30T17:04:16.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2780000000000001e-06 2023-09-30T17:04:16.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.401563+0000", 2023-09-30T17:04:16.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2223999999999999e-05 2023-09-30T17:04:16.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.401578+0000", 2023-09-30T17:04:16.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.452e-05 2023-09-30T17:04:16.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.310 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.401586+0000", 2023-09-30T17:04:16.310 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4179999999999997e-06 2023-09-30T17:04:16.310 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.310 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.310 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.310 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.310 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.310 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124339 4.6 e53/17)", 2023-09-30T17:04:16.310 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.425079+0000", 2023-09-30T17:04:16.310 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.14627501100000001, 2023-09-30T17:04:16.310 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.156327402, 2023-09-30T17:04:16.311 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.311 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.311 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.311 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.311 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.425079+0000", 2023-09-30T17:04:16.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.311 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.311 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.311 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.425079+0000", 2023-09-30T17:04:16.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.312 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.425079+0000", 2023-09-30T17:04:16.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0399999999999996e-07 2023-09-30T17:04:16.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.312 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.425098+0000", 2023-09-30T17:04:16.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9307e-05 2023-09-30T17:04:16.313 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.425122+0000", 2023-09-30T17:04:16.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3558e-05 2023-09-30T17:04:16.313 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.425129+0000", 2023-09-30T17:04:16.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9500000000000004e-06 2023-09-30T17:04:16.314 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.314 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.314 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.314 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125486 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.314 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.433751+0000", 2023-09-30T17:04:16.314 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.137602154, 2023-09-30T17:04:16.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.147709057, 2023-09-30T17:04:16.314 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.314 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.315 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.315 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.315 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.315 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125486 2023-09-30T17:04:16.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.315 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.315 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.315 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.433751+0000", 2023-09-30T17:04:16.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.433751+0000", 2023-09-30T17:04:16.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.433752+0000", 2023-09-30T17:04:16.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.84e-07 2023-09-30T17:04:16.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.433765+0000", 2023-09-30T17:04:16.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3586e-05 2023-09-30T17:04:16.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.317 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.317 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.433771+0000", 2023-09-30T17:04:16.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6679999999999998e-06 2023-09-30T17:04:16.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.317 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.317 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.433776+0000", 2023-09-30T17:04:16.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7199999999999997e-06 2023-09-30T17:04:16.317 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.318 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.318 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.318 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125660 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.318 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.490908+0000", 2023-09-30T17:04:16.318 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.080445531000000001, 2023-09-30T17:04:16.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.090616062999999997, 2023-09-30T17:04:16.318 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.318 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.318 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.319 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.319 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.319 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125660 2023-09-30T17:04:16.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.319 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.490908+0000", 2023-09-30T17:04:16.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.490908+0000", 2023-09-30T17:04:16.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.490909+0000", 2023-09-30T17:04:16.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5799999999999999e-07 2023-09-30T17:04:16.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.490920+0000", 2023-09-30T17:04:16.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.102e-05 2023-09-30T17:04:16.321 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.321 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.321 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.490926+0000", 2023-09-30T17:04:16.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1380000000000004e-06 2023-09-30T17:04:16.321 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.321 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.321 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.490931+0000", 2023-09-30T17:04:16.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9840000000000001e-06 2023-09-30T17:04:16.321 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.321 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.322 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.322 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124646 4.6 e53/17)", 2023-09-30T17:04:16.322 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.513317+0000", 2023-09-30T17:04:16.322 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.058036312999999999, 2023-09-30T17:04:16.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.068238061000000003, 2023-09-30T17:04:16.322 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.322 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.322 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.513317+0000", 2023-09-30T17:04:16.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.513317+0000", 2023-09-30T17:04:16.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.513318+0000", 2023-09-30T17:04:16.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9400000000000005e-07 2023-09-30T17:04:16.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.513335+0000", 2023-09-30T17:04:16.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6708999999999999e-05 2023-09-30T17:04:16.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.513343+0000", 2023-09-30T17:04:16.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8300000000000002e-06 2023-09-30T17:04:16.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.513350+0000", 2023-09-30T17:04:16.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5889999999999999e-06 2023-09-30T17:04:16.325 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.325 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.325 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.325 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124757 4.6 e53/17)", 2023-09-30T17:04:16.325 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.548509+0000", 2023-09-30T17:04:16.325 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.022844900000000001, 2023-09-30T17:04:16.326 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033075699, 2023-09-30T17:04:16.326 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.326 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.326 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.326 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.326 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.548509+0000", 2023-09-30T17:04:16.326 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.326 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.326 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.327 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.548509+0000", 2023-09-30T17:04:16.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.327 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.327 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.548509+0000", 2023-09-30T17:04:16.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3799999999999999e-07 2023-09-30T17:04:16.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.327 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.548528+0000", 2023-09-30T17:04:16.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9139000000000001e-05 2023-09-30T17:04:16.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.548534+0000", 2023-09-30T17:04:16.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.314e-06 2023-09-30T17:04:16.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.548539+0000", 2023-09-30T17:04:16.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9840000000000001e-06 2023-09-30T17:04:16.329 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.329 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.329 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.329 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125812 4.38 4:1dcf718c:::100000001f8.00000022:head [write 3960832~4096 in=4096b,write 3989504~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.329 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.559687+0000", 2023-09-30T17:04:16.329 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.011666373000000001, 2023-09-30T17:04:16.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021928588999999998, 2023-09-30T17:04:16.330 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.330 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:16.330 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.330 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.330 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.330 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125812 2023-09-30T17:04:16.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.330 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.331 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.331 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.559687+0000", 2023-09-30T17:04:16.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.331 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.331 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.331 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.331 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.559687+0000", 2023-09-30T17:04:16.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.559688+0000", 2023-09-30T17:04:16.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0299999999999999e-07 2023-09-30T17:04:16.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.559707+0000", 2023-09-30T17:04:16.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8913999999999999e-05 2023-09-30T17:04:16.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.559713+0000", 2023-09-30T17:04:16.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1879999999999999e-06 2023-09-30T17:04:16.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.559717+0000", 2023-09-30T17:04:16.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6500000000000004e-06 2023-09-30T17:04:16.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:16.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.564112+0000", 2023-09-30T17:04:16.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0043948329999999999 2023-09-30T17:04:16.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:16.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.564195+0000", 2023-09-30T17:04:16.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2513000000000001e-05 2023-09-30T17:04:16.334 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.334 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.334 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.335 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125850 4.a 4:50194ce5:::100000001f8.00000027:head [write 2408448~4096 in=4096b,write 2465792~4096 in=4096b,write 2625536~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.335 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.574643+0000", 2023-09-30T17:04:16.335 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9967103, 2023-09-30T17:04:16.335 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070649839999999998, 2023-09-30T17:04:16.335 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.335 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:16.335 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.335 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.335 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.335 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125850 2023-09-30T17:04:16.335 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.335 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.336 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.336 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.336 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.574643+0000", 2023-09-30T17:04:16.336 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.336 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.336 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.336 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.336 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.574643+0000", 2023-09-30T17:04:16.336 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.336 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.336 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.336 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.337 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.574644+0000", 2023-09-30T17:04:16.337 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7300000000000001e-07 2023-09-30T17:04:16.337 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.337 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.337 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.337 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.574663+0000", 2023-09-30T17:04:16.337 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8675e-05 2023-09-30T17:04:16.337 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.337 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.337 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.337 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.574670+0000", 2023-09-30T17:04:16.337 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1470000000000004e-06 2023-09-30T17:04:16.338 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.338 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.338 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.338 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.574675+0000", 2023-09-30T17:04:16.338 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6069999999999998e-06 2023-09-30T17:04:16.338 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.338 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.338 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:16.338 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.574834+0000", 2023-09-30T17:04:16.338 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158178 2023-09-30T17:04:16.338 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.338 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.339 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:16.339 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.574915+0000", 2023-09-30T17:04:16.339 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1656999999999994e-05 2023-09-30T17:04:16.339 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.339 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.339 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.339 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.339 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.339 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:123588 4.6 e53/17 4:635f8cb4:::100000001f8.0000003c:head v 53'7597, mlcod=53'7512)", 2023-09-30T17:04:16.339 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.084425+0000", 2023-09-30T17:04:16.339 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.48692887800000001, 2023-09-30T17:04:16.339 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.49735995100000002, 2023-09-30T17:04:16.339 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.340 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:16.340 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.340 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.340 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.340 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.084425+0000", 2023-09-30T17:04:16.340 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.340 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.340 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.340 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.340 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.084425+0000", 2023-09-30T17:04:16.340 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.341 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.341 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.341 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.084425+0000", 2023-09-30T17:04:16.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3999999999999998e-07 2023-09-30T17:04:16.341 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.341 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.341 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.084436+0000", 2023-09-30T17:04:16.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1354e-05 2023-09-30T17:04:16.341 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.342 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.342 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.084442+0000", 2023-09-30T17:04:16.342 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7180000000000001e-06 2023-09-30T17:04:16.342 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.342 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.342 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.342 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.084446+0000", 2023-09-30T17:04:16.342 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1810000000000003e-06 2023-09-30T17:04:16.342 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.342 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.342 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:16.342 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.571320+0000", 2023-09-30T17:04:16.343 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.48687380899999999 2023-09-30T17:04:16.343 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.343 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.343 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:16.343 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.571338+0000", 2023-09-30T17:04:16.343 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8218000000000001e-05 2023-09-30T17:04:16.343 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.343 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.343 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.343 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.343 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.343 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:123724 4.6 e53/17)", 2023-09-30T17:04:16.344 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.162456+0000", 2023-09-30T17:04:16.344 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.408897383, 2023-09-30T17:04:16.344 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.41939764299999999, 2023-09-30T17:04:16.344 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.344 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.344 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.344 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.344 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.344 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.162456+0000", 2023-09-30T17:04:16.344 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.344 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.345 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.345 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.345 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.162456+0000", 2023-09-30T17:04:16.345 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.345 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.345 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.345 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.345 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.162457+0000", 2023-09-30T17:04:16.345 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.51e-07 2023-09-30T17:04:16.345 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.345 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.345 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.346 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.162469+0000", 2023-09-30T17:04:16.346 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2522e-05 2023-09-30T17:04:16.346 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.346 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.346 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.346 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.162477+0000", 2023-09-30T17:04:16.346 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2009999999999999e-06 2023-09-30T17:04:16.346 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.346 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.346 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.346 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.162485+0000", 2023-09-30T17:04:16.346 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8029999999999997e-06 2023-09-30T17:04:16.347 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.347 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.347 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.347 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.347 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.347 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124869 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.347 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.200612+0000", 2023-09-30T17:04:16.347 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.37074144199999998, 2023-09-30T17:04:16.347 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.38127809200000001, 2023-09-30T17:04:16.347 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.347 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.348 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.348 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.348 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.348 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124869 2023-09-30T17:04:16.348 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.348 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.348 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.348 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.348 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.200612+0000", 2023-09-30T17:04:16.348 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.348 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.348 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.349 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.349 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.200612+0000", 2023-09-30T17:04:16.349 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.349 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.349 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.349 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.349 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.202516+0000", 2023-09-30T17:04:16.349 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019037170000000001 2023-09-30T17:04:16.349 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.349 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.349 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.349 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.202528+0000", 2023-09-30T17:04:16.350 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2146e-05 2023-09-30T17:04:16.350 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.350 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.350 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.350 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.202538+0000", 2023-09-30T17:04:16.350 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.594e-06 2023-09-30T17:04:16.350 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.350 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.350 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.350 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.202543+0000", 2023-09-30T17:04:16.350 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9459999999999997e-06 2023-09-30T17:04:16.350 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.351 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.351 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.351 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.351 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.351 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:123867 4.36 e53/17)", 2023-09-30T17:04:16.351 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.244837+0000", 2023-09-30T17:04:16.351 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.32651613299999999, 2023-09-30T17:04:16.351 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.337092428, 2023-09-30T17:04:16.351 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.351 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.351 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.351 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.352 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.352 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.244837+0000", 2023-09-30T17:04:16.352 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.352 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.352 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.352 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.352 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.244837+0000", 2023-09-30T17:04:16.352 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.352 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.352 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.352 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.353 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.244838+0000", 2023-09-30T17:04:16.353 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8299999999999997e-07 2023-09-30T17:04:16.353 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.353 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.353 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.353 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.244854+0000", 2023-09-30T17:04:16.353 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6228000000000001e-05 2023-09-30T17:04:16.353 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.353 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.353 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.353 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.244863+0000", 2023-09-30T17:04:16.353 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9779999999999994e-06 2023-09-30T17:04:16.354 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.354 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.354 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.354 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.244870+0000", 2023-09-30T17:04:16.354 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9020000000000002e-06 2023-09-30T17:04:16.354 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.354 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.354 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.354 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.354 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.354 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124994 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.354 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.256712+0000", 2023-09-30T17:04:16.355 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.31464123700000002, 2023-09-30T17:04:16.355 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.32525046699999999, 2023-09-30T17:04:16.355 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.355 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.355 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.355 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.355 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.355 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124994 2023-09-30T17:04:16.355 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.355 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.355 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.355 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.356 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.256712+0000", 2023-09-30T17:04:16.356 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.356 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.356 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.356 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.356 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.256712+0000", 2023-09-30T17:04:16.356 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.356 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.356 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.356 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.356 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.256713+0000", 2023-09-30T17:04:16.356 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5000000000000003e-07 2023-09-30T17:04:16.357 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.357 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.357 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.357 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.256731+0000", 2023-09-30T17:04:16.357 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7858000000000001e-05 2023-09-30T17:04:16.357 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.357 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.357 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.357 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.256738+0000", 2023-09-30T17:04:16.357 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7970000000000003e-06 2023-09-30T17:04:16.357 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.358 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.358 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.358 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.256743+0000", 2023-09-30T17:04:16.358 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.604e-06 2023-09-30T17:04:16.358 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.358 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.358 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.358 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.358 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.358 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125055 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.358 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.279557+0000", 2023-09-30T17:04:16.358 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.291796573, 2023-09-30T17:04:16.359 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.302468193, 2023-09-30T17:04:16.359 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.359 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.359 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.359 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.359 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.359 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125055 2023-09-30T17:04:16.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.359 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.359 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.359 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.359 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.279557+0000", 2023-09-30T17:04:16.360 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.360 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.360 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.360 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.360 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.279557+0000", 2023-09-30T17:04:16.360 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.360 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.360 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.360 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.360 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.281515+0000", 2023-09-30T17:04:16.360 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019583030000000002 2023-09-30T17:04:16.361 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.361 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.361 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.361 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.281532+0000", 2023-09-30T17:04:16.361 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6728e-05 2023-09-30T17:04:16.361 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.361 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.361 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.361 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.281541+0000", 2023-09-30T17:04:16.361 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6330000000000002e-06 2023-09-30T17:04:16.361 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.361 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.362 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.362 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.281547+0000", 2023-09-30T17:04:16.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9939999999999997e-06 2023-09-30T17:04:16.362 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.362 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.362 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.362 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.362 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.362 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124218 4.6 e53/17)", 2023-09-30T17:04:16.362 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.401603+0000", 2023-09-30T17:04:16.362 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.16975058300000001, 2023-09-30T17:04:16.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.18046566, 2023-09-30T17:04:16.363 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.363 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.363 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.363 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.363 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.363 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.401603+0000", 2023-09-30T17:04:16.363 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.363 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.363 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.363 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.363 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.401603+0000", 2023-09-30T17:04:16.363 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.364 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.364 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.364 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.364 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.401603+0000", 2023-09-30T17:04:16.364 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.22e-07 2023-09-30T17:04:16.364 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.364 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.364 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.364 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.401617+0000", 2023-09-30T17:04:16.364 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3567000000000001e-05 2023-09-30T17:04:16.364 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.364 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.365 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.365 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.401631+0000", 2023-09-30T17:04:16.365 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4296e-05 2023-09-30T17:04:16.365 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.365 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.365 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.365 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.401637+0000", 2023-09-30T17:04:16.365 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6149999999999996e-06 2023-09-30T17:04:16.365 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.365 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.365 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.366 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.366 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.366 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124349 4.2e e53/17)", 2023-09-30T17:04:16.366 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.425197+0000", 2023-09-30T17:04:16.366 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.14615618699999999, 2023-09-30T17:04:16.366 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.15691245600000001, 2023-09-30T17:04:16.366 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.366 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.366 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.366 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.366 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.366 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.425197+0000", 2023-09-30T17:04:16.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.367 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.367 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.367 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.425197+0000", 2023-09-30T17:04:16.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.367 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.367 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.367 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.425198+0000", 2023-09-30T17:04:16.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.13e-07 2023-09-30T17:04:16.367 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.425214+0000", 2023-09-30T17:04:16.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5743000000000002e-05 2023-09-30T17:04:16.368 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.425221+0000", 2023-09-30T17:04:16.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7400000000000004e-06 2023-09-30T17:04:16.368 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.369 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.425229+0000", 2023-09-30T17:04:16.369 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7810000000000005e-06 2023-09-30T17:04:16.369 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.369 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.369 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.369 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.369 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.369 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125487 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.369 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.433782+0000", 2023-09-30T17:04:16.369 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.137571582, 2023-09-30T17:04:16.369 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.14837852800000001, 2023-09-30T17:04:16.370 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.370 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.370 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.370 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.370 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.370 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125487 2023-09-30T17:04:16.370 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.370 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.370 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.370 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.370 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.433782+0000", 2023-09-30T17:04:16.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.371 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.371 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.371 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.433782+0000", 2023-09-30T17:04:16.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.371 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.371 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.371 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.433782+0000", 2023-09-30T17:04:16.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0999999999999999e-07 2023-09-30T17:04:16.371 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.372 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.372 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.372 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.433795+0000", 2023-09-30T17:04:16.372 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2585000000000001e-05 2023-09-30T17:04:16.372 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.372 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.372 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.372 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.433801+0000", 2023-09-30T17:04:16.372 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8440000000000003e-06 2023-09-30T17:04:16.372 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.372 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.372 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.373 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.433805+0000", 2023-09-30T17:04:16.373 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6319999999999999e-06 2023-09-30T17:04:16.373 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.373 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.373 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.373 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.373 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.373 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125661 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.373 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.490938+0000", 2023-09-30T17:04:16.373 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.080415674000000006, 2023-09-30T17:04:16.373 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.091264211999999997, 2023-09-30T17:04:16.373 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.374 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.374 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.374 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.374 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.374 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125661 2023-09-30T17:04:16.374 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.374 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.374 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.374 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.374 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.490938+0000", 2023-09-30T17:04:16.374 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.374 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.375 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.375 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.375 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.490938+0000", 2023-09-30T17:04:16.375 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.375 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.375 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.375 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.375 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.490938+0000", 2023-09-30T17:04:16.375 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4299999999999998e-07 2023-09-30T17:04:16.375 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.375 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.375 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.376 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.490951+0000", 2023-09-30T17:04:16.376 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3097e-05 2023-09-30T17:04:16.376 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.376 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.376 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.376 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.490958+0000", 2023-09-30T17:04:16.376 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3810000000000004e-06 2023-09-30T17:04:16.376 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.376 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.376 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.376 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.490963+0000", 2023-09-30T17:04:16.376 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1660000000000002e-06 2023-09-30T17:04:16.377 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.377 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.377 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.377 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.377 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.377 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125748 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.377 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.530561+0000", 2023-09-30T17:04:16.377 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.040792436000000001, 2023-09-30T17:04:16.377 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051701964000000003, 2023-09-30T17:04:16.377 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.377 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.377 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.378 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.378 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.378 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125748 2023-09-30T17:04:16.378 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.378 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.378 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.378 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.378 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.530561+0000", 2023-09-30T17:04:16.378 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.378 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.378 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.378 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.379 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.530561+0000", 2023-09-30T17:04:16.379 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.379 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.379 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.379 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.379 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.532518+0000", 2023-09-30T17:04:16.379 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019566290000000001 2023-09-30T17:04:16.379 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.379 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.379 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.379 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.532535+0000", 2023-09-30T17:04:16.380 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7401000000000002e-05 2023-09-30T17:04:16.380 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.380 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.380 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.380 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.532545+0000", 2023-09-30T17:04:16.380 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0202e-05 2023-09-30T17:04:16.380 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.380 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.380 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.380 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.532552+0000", 2023-09-30T17:04:16.380 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0380000000000002e-06 2023-09-30T17:04:16.381 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.381 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.381 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.381 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.381 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.381 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:125215 4.28 e53/17 4:15eeb89b:::100000001f8.00000032:head v 53'3850, mlcod=53'3847)", 2023-09-30T17:04:16.381 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.560601+0000", 2023-09-30T17:04:16.381 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.010752285, 2023-09-30T17:04:16.381 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021727610000000001, 2023-09-30T17:04:16.381 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.381 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:16.381 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.381 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.382 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.382 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.560601+0000", 2023-09-30T17:04:16.382 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.382 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.382 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.382 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.382 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.560601+0000", 2023-09-30T17:04:16.382 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.382 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.382 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.382 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.383 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.560602+0000", 2023-09-30T17:04:16.383 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8999999999999996e-07 2023-09-30T17:04:16.383 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.383 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.383 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.383 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.560614+0000", 2023-09-30T17:04:16.383 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1783999999999999e-05 2023-09-30T17:04:16.383 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.383 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.383 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.383 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.560623+0000", 2023-09-30T17:04:16.383 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7559999999999994e-06 2023-09-30T17:04:16.384 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.384 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.384 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.384 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.560630+0000", 2023-09-30T17:04:16.384 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8569999999999997e-06 2023-09-30T17:04:16.384 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.384 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.384 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:16.384 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.564129+0000", 2023-09-30T17:04:16.384 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0034986129999999998 2023-09-30T17:04:16.384 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.384 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.385 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:16.385 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.564150+0000", 2023-09-30T17:04:16.385 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1124e-05 2023-09-30T17:04:16.385 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.385 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.385 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.385 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.385 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.385 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:125244 4.28 e53/17)", 2023-09-30T17:04:16.385 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.576280+0000", 2023-09-30T17:04:16.385 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9950738, 2023-09-30T17:04:16.385 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0061163249999999997, 2023-09-30T17:04:16.386 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.386 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.386 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.386 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.386 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.386 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.576280+0000", 2023-09-30T17:04:16.386 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.386 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.386 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.386 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.386 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.576280+0000", 2023-09-30T17:04:16.386 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.387 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.387 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.387 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.387 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.576280+0000", 2023-09-30T17:04:16.387 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2699999999999999e-07 2023-09-30T17:04:16.387 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.387 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.387 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.387 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.576312+0000", 2023-09-30T17:04:16.387 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1337999999999997e-05 2023-09-30T17:04:16.387 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.387 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.388 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.388 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.576322+0000", 2023-09-30T17:04:16.388 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0003000000000001e-05 2023-09-30T17:04:16.388 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.388 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.388 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.388 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.576329+0000", 2023-09-30T17:04:16.388 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5329999999999997e-06 2023-09-30T17:04:16.388 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.388 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.388 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.388 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.389 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.389 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:123682 4.36 e53/17)", 2023-09-30T17:04:16.389 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.145298+0000", 2023-09-30T17:04:16.389 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.42605590500000001, 2023-09-30T17:04:16.389 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.437154286, 2023-09-30T17:04:16.389 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.389 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.389 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.389 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.389 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.389 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.145298+0000", 2023-09-30T17:04:16.389 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.390 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.390 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.390 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.390 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.145298+0000", 2023-09-30T17:04:16.390 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.390 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.390 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.390 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.390 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.145298+0000", 2023-09-30T17:04:16.390 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9200000000000001e-07 2023-09-30T17:04:16.391 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.391 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.391 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.391 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.145311+0000", 2023-09-30T17:04:16.391 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2808e-05 2023-09-30T17:04:16.391 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.391 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.391 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.391 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.145319+0000", 2023-09-30T17:04:16.391 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8280000000000003e-06 2023-09-30T17:04:16.391 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.391 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.392 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.392 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.145325+0000", 2023-09-30T17:04:16.392 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2550000000000003e-06 2023-09-30T17:04:16.392 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.392 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.392 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.392 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.392 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.392 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:123757 4.36 e53/17)", 2023-09-30T17:04:16.392 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.178256+0000", 2023-09-30T17:04:16.392 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.39309761199999999, 2023-09-30T17:04:16.392 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.404252157, 2023-09-30T17:04:16.393 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.393 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.393 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.393 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.393 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.393 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.178256+0000", 2023-09-30T17:04:16.393 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.393 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.393 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.393 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.393 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.178256+0000", 2023-09-30T17:04:16.393 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.393 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.394 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.394 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.394 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.178257+0000", 2023-09-30T17:04:16.394 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3799999999999996e-07 2023-09-30T17:04:16.394 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.394 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.394 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.394 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.178273+0000", 2023-09-30T17:04:16.394 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5838999999999999e-05 2023-09-30T17:04:16.394 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.394 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.394 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.395 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.178285+0000", 2023-09-30T17:04:16.395 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1958e-05 2023-09-30T17:04:16.395 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.395 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.395 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.395 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.178292+0000", 2023-09-30T17:04:16.395 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9460000000000001e-06 2023-09-30T17:04:16.395 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.395 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.395 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.395 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.395 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.396 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:123793 4.6 e53/17)", 2023-09-30T17:04:16.396 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.204077+0000", 2023-09-30T17:04:16.396 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.36727693500000003, 2023-09-30T17:04:16.396 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.378488045, 2023-09-30T17:04:16.396 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.396 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.396 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.396 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.396 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.396 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.204077+0000", 2023-09-30T17:04:16.396 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.396 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.397 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.397 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.397 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.204077+0000", 2023-09-30T17:04:16.397 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.397 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.397 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.397 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.397 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.204077+0000", 2023-09-30T17:04:16.397 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3900000000000005e-07 2023-09-30T17:04:16.397 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.397 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.398 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.398 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.204099+0000", 2023-09-30T17:04:16.398 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1937e-05 2023-09-30T17:04:16.398 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.398 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.398 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.398 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.204110+0000", 2023-09-30T17:04:16.398 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.096e-05 2023-09-30T17:04:16.398 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.398 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.398 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.399 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.204118+0000", 2023-09-30T17:04:16.399 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7589999999999997e-06 2023-09-30T17:04:16.399 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.399 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.399 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.399 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.399 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.399 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124899 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.399 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.220699+0000", 2023-09-30T17:04:16.399 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.35065437399999999, 2023-09-30T17:04:16.399 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.36194184899999998, 2023-09-30T17:04:16.400 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.400 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.400 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.400 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.400 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.400 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124899 2023-09-30T17:04:16.400 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.400 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.400 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.400 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.400 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.220699+0000", 2023-09-30T17:04:16.401 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.401 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.401 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.401 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.401 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.220699+0000", 2023-09-30T17:04:16.401 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.401 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.401 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.401 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.401 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.220700+0000", 2023-09-30T17:04:16.401 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5300000000000004e-07 2023-09-30T17:04:16.402 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.402 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.402 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.402 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.220716+0000", 2023-09-30T17:04:16.402 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5804999999999999e-05 2023-09-30T17:04:16.402 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.402 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.402 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.402 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.220724+0000", 2023-09-30T17:04:16.402 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2700000000000004e-06 2023-09-30T17:04:16.402 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.403 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.403 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.403 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.220730+0000", 2023-09-30T17:04:16.403 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9229999999999999e-06 2023-09-30T17:04:16.403 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.403 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.403 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.403 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.403 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.403 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124931 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.403 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.234556+0000", 2023-09-30T17:04:16.404 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.33679763800000001, 2023-09-30T17:04:16.404 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.34813158599999999, 2023-09-30T17:04:16.404 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.404 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.404 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.404 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.404 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.404 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124931 2023-09-30T17:04:16.404 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.404 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.404 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.404 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.405 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.234556+0000", 2023-09-30T17:04:16.405 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.405 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.405 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.405 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.405 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.234556+0000", 2023-09-30T17:04:16.405 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.405 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.405 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.405 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.405 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.234556+0000", 2023-09-30T17:04:16.405 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9000000000000002e-07 2023-09-30T17:04:16.406 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.406 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.406 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.406 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.234574+0000", 2023-09-30T17:04:16.406 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7901999999999999e-05 2023-09-30T17:04:16.406 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.406 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.406 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.406 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.234582+0000", 2023-09-30T17:04:16.406 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8669999999999994e-06 2023-09-30T17:04:16.406 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.406 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.407 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.407 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.234587+0000", 2023-09-30T17:04:16.407 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1039999999999998e-06 2023-09-30T17:04:16.407 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.407 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.407 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.407 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.407 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.407 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125036 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.407 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.269664+0000", 2023-09-30T17:04:16.407 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.30168937299999998, 2023-09-30T17:04:16.407 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.31305393300000001, 2023-09-30T17:04:16.408 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.408 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.408 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.408 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.408 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.408 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125036 2023-09-30T17:04:16.408 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.408 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.408 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.408 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.408 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.269664+0000", 2023-09-30T17:04:16.408 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.409 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.409 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.409 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.409 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.269664+0000", 2023-09-30T17:04:16.409 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.409 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.409 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.409 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.409 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.269665+0000", 2023-09-30T17:04:16.409 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5900000000000003e-07 2023-09-30T17:04:16.409 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.409 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.410 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.410 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.269677+0000", 2023-09-30T17:04:16.410 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2174999999999999e-05 2023-09-30T17:04:16.410 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.410 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.410 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.410 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.269684+0000", 2023-09-30T17:04:16.410 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1189999999999999e-06 2023-09-30T17:04:16.410 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.410 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.410 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.410 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.269689+0000", 2023-09-30T17:04:16.411 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.685e-06 2023-09-30T17:04:16.411 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.411 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.411 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.411 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.411 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.411 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125248 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.411 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.339914+0000", 2023-09-30T17:04:16.411 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.231440015, 2023-09-30T17:04:16.411 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.24283627199999999, 2023-09-30T17:04:16.411 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.411 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.412 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.412 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.412 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.412 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125248 2023-09-30T17:04:16.412 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.412 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.412 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.412 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.412 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.339914+0000", 2023-09-30T17:04:16.412 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.412 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.413 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.413 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.413 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.339914+0000", 2023-09-30T17:04:16.413 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.413 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.413 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.413 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.413 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.339914+0000", 2023-09-30T17:04:16.413 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4299999999999998e-07 2023-09-30T17:04:16.413 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.413 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.414 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.414 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.339930+0000", 2023-09-30T17:04:16.414 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6364000000000001e-05 2023-09-30T17:04:16.414 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.414 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.414 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.414 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.339937+0000", 2023-09-30T17:04:16.414 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3620000000000002e-06 2023-09-30T17:04:16.414 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.414 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.414 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.415 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.339943+0000", 2023-09-30T17:04:16.415 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.772e-06 2023-09-30T17:04:16.415 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.415 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.415 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.415 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.415 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.415 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125508 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.415 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.442405+0000", 2023-09-30T17:04:16.415 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.128948852, 2023-09-30T17:04:16.415 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.140374737, 2023-09-30T17:04:16.416 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.416 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.416 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.416 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.416 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.416 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125508 2023-09-30T17:04:16.416 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.416 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.416 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.416 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.416 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.442405+0000", 2023-09-30T17:04:16.416 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.417 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.417 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.417 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.417 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.442405+0000", 2023-09-30T17:04:16.417 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.417 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.417 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.417 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.417 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.442405+0000", 2023-09-30T17:04:16.417 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1600000000000002e-07 2023-09-30T17:04:16.417 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.417 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.418 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.418 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.442421+0000", 2023-09-30T17:04:16.418 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5696e-05 2023-09-30T17:04:16.418 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.418 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.418 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.418 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.442428+0000", 2023-09-30T17:04:16.418 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8410000000000002e-06 2023-09-30T17:04:16.418 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.418 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.418 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.419 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.442433+0000", 2023-09-30T17:04:16.419 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0869999999999997e-06 2023-09-30T17:04:16.419 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.419 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.419 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.419 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.419 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.419 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124477 4.6 e53/17)", 2023-09-30T17:04:16.419 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.455244+0000", 2023-09-30T17:04:16.419 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.116109401, 2023-09-30T17:04:16.419 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.12756571899999999, 2023-09-30T17:04:16.419 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.420 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.420 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.420 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.420 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.420 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.455244+0000", 2023-09-30T17:04:16.420 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.420 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.420 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.420 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.420 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.455244+0000", 2023-09-30T17:04:16.420 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.420 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.421 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.421 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.421 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.455244+0000", 2023-09-30T17:04:16.421 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0499999999999999e-07 2023-09-30T17:04:16.421 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.421 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.421 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.421 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.455261+0000", 2023-09-30T17:04:16.421 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6212999999999999e-05 2023-09-30T17:04:16.421 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.421 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.421 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.422 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.455270+0000", 2023-09-30T17:04:16.422 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0920000000000004e-06 2023-09-30T17:04:16.422 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.422 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.422 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.422 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.455275+0000", 2023-09-30T17:04:16.422 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3499999999999996e-06 2023-09-30T17:04:16.422 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.422 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.422 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.422 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.422 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.423 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124495 4.6 e53/17)", 2023-09-30T17:04:16.423 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.461134+0000", 2023-09-30T17:04:16.423 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.11021924600000001, 2023-09-30T17:04:16.423 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.121700748, 2023-09-30T17:04:16.423 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.423 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.423 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.423 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.423 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.423 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.461134+0000", 2023-09-30T17:04:16.423 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.423 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.424 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.424 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.424 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.461134+0000", 2023-09-30T17:04:16.424 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.424 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.424 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.424 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.424 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.461135+0000", 2023-09-30T17:04:16.424 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.004e-06 2023-09-30T17:04:16.424 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.424 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.424 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.425 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.461149+0000", 2023-09-30T17:04:16.425 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3334e-05 2023-09-30T17:04:16.425 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.425 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.425 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.425 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.461158+0000", 2023-09-30T17:04:16.425 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3319999999999998e-06 2023-09-30T17:04:16.425 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.425 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.425 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.425 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.461165+0000", 2023-09-30T17:04:16.425 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4499999999999998e-06 2023-09-30T17:04:16.426 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.426 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.426 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.426 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.426 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.426 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124795 4.6 e53/17)", 2023-09-30T17:04:16.426 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.562797+0000", 2023-09-30T17:04:16.426 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0085565399999999996, 2023-09-30T17:04:16.426 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020064403000000001, 2023-09-30T17:04:16.426 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.426 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.426 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.427 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.427 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.427 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.562797+0000", 2023-09-30T17:04:16.427 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.427 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.427 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.427 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.427 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.562797+0000", 2023-09-30T17:04:16.427 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.427 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.427 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.427 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.428 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.562798+0000", 2023-09-30T17:04:16.428 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4700000000000001e-07 2023-09-30T17:04:16.428 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.428 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.428 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.428 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.562826+0000", 2023-09-30T17:04:16.428 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7949999999999998e-05 2023-09-30T17:04:16.428 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.428 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.428 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.428 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.562835+0000", 2023-09-30T17:04:16.428 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3479999999999993e-06 2023-09-30T17:04:16.429 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.429 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.429 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.429 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.562842+0000", 2023-09-30T17:04:16.429 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.153e-06 2023-09-30T17:04:16.429 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.429 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.429 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.429 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.429 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.429 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:125251 4.1c e53/17 4:39b842ef:::100000001f8.00000029:head v 53'1970, mlcod=53'1968)", 2023-09-30T17:04:16.429 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.576345+0000", 2023-09-30T17:04:16.430 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.995008, 2023-09-30T17:04:16.430 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065447550000000002, 2023-09-30T17:04:16.430 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.430 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:16.430 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.430 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.430 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.430 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.576345+0000", 2023-09-30T17:04:16.430 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.430 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.430 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.430 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.431 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.576345+0000", 2023-09-30T17:04:16.431 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.431 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.431 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.431 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.431 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.576346+0000", 2023-09-30T17:04:16.431 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3500000000000002e-07 2023-09-30T17:04:16.431 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.431 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.431 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.431 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.576361+0000", 2023-09-30T17:04:16.431 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5228000000000001e-05 2023-09-30T17:04:16.432 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.432 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.432 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.432 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.576403+0000", 2023-09-30T17:04:16.432 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2292000000000001e-05 2023-09-30T17:04:16.432 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.432 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.432 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.432 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.576411+0000", 2023-09-30T17:04:16.432 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9740000000000002e-06 2023-09-30T17:04:16.432 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.432 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.433 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:16.433 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.576458+0000", 2023-09-30T17:04:16.433 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7144999999999997e-05 2023-09-30T17:04:16.433 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.433 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.433 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:16.433 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.576478+0000", 2023-09-30T17:04:16.433 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9945e-05 2023-09-30T17:04:16.433 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.433 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.433 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.433 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.433 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.434 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124524 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.434 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.081050+0000", 2023-09-30T17:04:16.434 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.49030382099999997, 2023-09-30T17:04:16.434 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.50187577299999997, 2023-09-30T17:04:16.434 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.434 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.434 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.434 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.434 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.434 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124524 2023-09-30T17:04:16.434 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.435 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.435 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.435 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.435 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.081050+0000", 2023-09-30T17:04:16.435 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.435 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.435 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.435 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.435 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.081050+0000", 2023-09-30T17:04:16.435 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.435 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.435 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.436 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.436 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.084516+0000", 2023-09-30T17:04:16.436 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0034664560000000001 2023-09-30T17:04:16.436 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.436 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.436 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.436 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.084530+0000", 2023-09-30T17:04:16.436 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3925e-05 2023-09-30T17:04:16.436 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.436 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.437 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.437 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.084539+0000", 2023-09-30T17:04:16.437 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5990000000000002e-06 2023-09-30T17:04:16.437 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.437 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.437 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.437 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.084545+0000", 2023-09-30T17:04:16.437 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3149999999999997e-06 2023-09-30T17:04:16.437 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.437 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.437 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.437 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.438 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.438 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124699 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.438 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.131618+0000", 2023-09-30T17:04:16.438 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.43973595799999998, 2023-09-30T17:04:16.438 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.45133993300000003, 2023-09-30T17:04:16.438 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.438 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.438 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.438 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.438 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.438 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124699 2023-09-30T17:04:16.438 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.439 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.439 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.439 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.439 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.131618+0000", 2023-09-30T17:04:16.439 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.439 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.439 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.439 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.439 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.131618+0000", 2023-09-30T17:04:16.439 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.439 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.439 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.440 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.440 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.131618+0000", 2023-09-30T17:04:16.440 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.75e-07 2023-09-30T17:04:16.440 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.440 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.440 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.440 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.131631+0000", 2023-09-30T17:04:16.440 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2551999999999999e-05 2023-09-30T17:04:16.440 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.440 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.440 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.440 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.131638+0000", 2023-09-30T17:04:16.441 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1640000000000004e-06 2023-09-30T17:04:16.441 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.441 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.441 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.441 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.131644+0000", 2023-09-30T17:04:16.441 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6209999999999998e-06 2023-09-30T17:04:16.441 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.441 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.441 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.441 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.441 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.441 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124730 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.442 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.144651+0000", 2023-09-30T17:04:16.442 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.42670275499999999, 2023-09-30T17:04:16.442 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.438336436, 2023-09-30T17:04:16.442 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.442 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.442 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.442 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.442 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.442 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124730 2023-09-30T17:04:16.442 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.442 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.442 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.443 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.443 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.144651+0000", 2023-09-30T17:04:16.443 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.443 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.443 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.443 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.144651+0000", 2023-09-30T17:04:16.443 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.443 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.443 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.443 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.147266+0000", 2023-09-30T17:04:16.444 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0026151350000000002 2023-09-30T17:04:16.444 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.444 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.444 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.444 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.147290+0000", 2023-09-30T17:04:16.444 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4315999999999999e-05 2023-09-30T17:04:16.444 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.444 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.444 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.444 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.147302+0000", 2023-09-30T17:04:16.444 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1420000000000001e-05 2023-09-30T17:04:16.444 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.444 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.445 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.445 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.147309+0000", 2023-09-30T17:04:16.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5719999999999997e-06 2023-09-30T17:04:16.445 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.445 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.445 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.445 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.445 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.445 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:123763 4.2e e53/17)", 2023-09-30T17:04:16.445 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.186321+0000", 2023-09-30T17:04:16.445 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.38503289499999999, 2023-09-30T17:04:16.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.39669627499999999, 2023-09-30T17:04:16.445 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.446 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.446 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.446 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.446 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.446 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.186321+0000", 2023-09-30T17:04:16.446 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.446 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.446 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.446 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.446 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.186321+0000", 2023-09-30T17:04:16.446 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.447 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.447 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.447 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.186321+0000", 2023-09-30T17:04:16.447 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3700000000000001e-07 2023-09-30T17:04:16.447 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.447 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.447 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.186334+0000", 2023-09-30T17:04:16.447 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2608e-05 2023-09-30T17:04:16.447 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.448 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.448 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.186341+0000", 2023-09-30T17:04:16.448 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1640000000000004e-06 2023-09-30T17:04:16.448 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.448 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.448 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.186346+0000", 2023-09-30T17:04:16.448 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2569999999999998e-06 2023-09-30T17:04:16.448 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.448 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.448 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.448 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.449 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.449 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:123804 4.36 e53/17)", 2023-09-30T17:04:16.449 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.204130+0000", 2023-09-30T17:04:16.449 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.36722356900000003, 2023-09-30T17:04:16.449 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.37891238300000002, 2023-09-30T17:04:16.449 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.449 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.449 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.449 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.449 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.449 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.204130+0000", 2023-09-30T17:04:16.449 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.450 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.450 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.450 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.450 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.204130+0000", 2023-09-30T17:04:16.450 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.450 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.450 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.450 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.450 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.204130+0000", 2023-09-30T17:04:16.450 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1899999999999998e-07 2023-09-30T17:04:16.450 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.450 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.451 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.451 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.204142+0000", 2023-09-30T17:04:16.451 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1514e-05 2023-09-30T17:04:16.451 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.451 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.451 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.451 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.204148+0000", 2023-09-30T17:04:16.451 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4989999999999999e-06 2023-09-30T17:04:16.451 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.451 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.451 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.451 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.204153+0000", 2023-09-30T17:04:16.452 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8019999999999999e-06 2023-09-30T17:04:16.452 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.452 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.452 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.452 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.452 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.452 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124932 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.452 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.234595+0000", 2023-09-30T17:04:16.452 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.33675825999999998, 2023-09-30T17:04:16.452 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.34847483000000001, 2023-09-30T17:04:16.452 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.452 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.453 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.453 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.453 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.453 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124932 2023-09-30T17:04:16.453 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.453 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.453 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.453 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.453 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.234595+0000", 2023-09-30T17:04:16.453 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.453 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.453 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.454 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.454 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.234595+0000", 2023-09-30T17:04:16.454 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.454 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.454 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.454 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.454 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.234596+0000", 2023-09-30T17:04:16.454 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7e-07 2023-09-30T17:04:16.454 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.454 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.454 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.454 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.234611+0000", 2023-09-30T17:04:16.455 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5191000000000001e-05 2023-09-30T17:04:16.455 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.455 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.455 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.455 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.234619+0000", 2023-09-30T17:04:16.455 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6320000000000008e-06 2023-09-30T17:04:16.455 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.455 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.455 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.455 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.234624+0000", 2023-09-30T17:04:16.455 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0900000000000004e-06 2023-09-30T17:04:16.456 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.456 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.456 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.456 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.456 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.456 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125037 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.456 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.269694+0000", 2023-09-30T17:04:16.456 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.30165931899999998, 2023-09-30T17:04:16.456 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.31340575900000001, 2023-09-30T17:04:16.456 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.456 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.456 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.456 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.457 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.457 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125037 2023-09-30T17:04:16.457 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.457 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.457 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.457 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.457 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.269694+0000", 2023-09-30T17:04:16.457 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.457 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.457 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.457 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.457 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.269694+0000", 2023-09-30T17:04:16.458 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.458 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.458 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.458 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.458 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.269695+0000", 2023-09-30T17:04:16.458 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.53e-07 2023-09-30T17:04:16.458 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.458 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.458 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.458 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.269710+0000", 2023-09-30T17:04:16.458 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5396999999999998e-05 2023-09-30T17:04:16.459 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.459 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.459 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.459 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.269719+0000", 2023-09-30T17:04:16.459 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4539999999999996e-06 2023-09-30T17:04:16.459 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.459 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.459 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.459 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.269724+0000", 2023-09-30T17:04:16.459 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8470000000000003e-06 2023-09-30T17:04:16.459 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.459 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.459 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.460 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.460 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.460 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125094 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.460 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.294505+0000", 2023-09-30T17:04:16.460 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.27684872700000002, 2023-09-30T17:04:16.460 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.28862665500000001, 2023-09-30T17:04:16.460 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.460 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.460 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.460 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.460 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.460 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125094 2023-09-30T17:04:16.461 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.461 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.461 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.461 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.461 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.294505+0000", 2023-09-30T17:04:16.461 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.461 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.461 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.461 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.461 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.294505+0000", 2023-09-30T17:04:16.461 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.461 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.462 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.462 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.462 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.294505+0000", 2023-09-30T17:04:16.462 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2800000000000002e-07 2023-09-30T17:04:16.462 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.462 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.462 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.462 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.294520+0000", 2023-09-30T17:04:16.462 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5208000000000001e-05 2023-09-30T17:04:16.462 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.462 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.462 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.463 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.294527+0000", 2023-09-30T17:04:16.463 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8279999999999997e-06 2023-09-30T17:04:16.463 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.463 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.463 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.294533+0000", 2023-09-30T17:04:16.463 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.22e-06 2023-09-30T17:04:16.463 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.463 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.463 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.463 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.464 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124042 4.36 e53/17)", 2023-09-30T17:04:16.464 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.319433+0000", 2023-09-30T17:04:16.464 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.25192058699999997, 2023-09-30T17:04:16.464 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.26372731700000002, 2023-09-30T17:04:16.464 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.464 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.464 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.464 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.464 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.464 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.319433+0000", 2023-09-30T17:04:16.464 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.465 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.465 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.465 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.465 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.319433+0000", 2023-09-30T17:04:16.465 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.465 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.465 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.465 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.465 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.319434+0000", 2023-09-30T17:04:16.465 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5899999999999995e-07 2023-09-30T17:04:16.465 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.465 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.466 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.466 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.319447+0000", 2023-09-30T17:04:16.466 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.364e-05 2023-09-30T17:04:16.466 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.466 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.466 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.466 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.319455+0000", 2023-09-30T17:04:16.466 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4150000000000002e-06 2023-09-30T17:04:16.466 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.466 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.466 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.467 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.319461+0000", 2023-09-30T17:04:16.467 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7450000000000001e-06 2023-09-30T17:04:16.467 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.467 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.467 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.467 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.467 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.467 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125258 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.467 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.339950+0000", 2023-09-30T17:04:16.467 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.231403262, 2023-09-30T17:04:16.467 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.24323640399999999, 2023-09-30T17:04:16.467 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.467 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.468 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.468 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.468 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.468 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125258 2023-09-30T17:04:16.468 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.468 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.468 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.468 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.468 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.339950+0000", 2023-09-30T17:04:16.468 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.468 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.469 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.469 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.469 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.339950+0000", 2023-09-30T17:04:16.469 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.469 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.469 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.469 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.469 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.339951+0000", 2023-09-30T17:04:16.469 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9299999999999998e-07 2023-09-30T17:04:16.469 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.469 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.469 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.470 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.339961+0000", 2023-09-30T17:04:16.470 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0570999999999999e-05 2023-09-30T17:04:16.470 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.470 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.470 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.470 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.339968+0000", 2023-09-30T17:04:16.470 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2609999999999999e-06 2023-09-30T17:04:16.470 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.470 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.470 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.470 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.339974+0000", 2023-09-30T17:04:16.470 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8980000000000001e-06 2023-09-30T17:04:16.471 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.471 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.471 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.471 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.471 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.471 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125456 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.471 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.425580+0000", 2023-09-30T17:04:16.471 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.14577326800000001, 2023-09-30T17:04:16.471 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.15763748699999999, 2023-09-30T17:04:16.471 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.471 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.471 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.472 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.472 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.472 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125456 2023-09-30T17:04:16.472 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.472 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.472 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.472 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.472 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.425580+0000", 2023-09-30T17:04:16.472 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.472 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.472 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.472 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.473 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.425580+0000", 2023-09-30T17:04:16.473 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.473 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.473 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.473 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.473 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.425581+0000", 2023-09-30T17:04:16.473 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0800000000000004e-07 2023-09-30T17:04:16.473 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.473 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.473 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.473 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.425596+0000", 2023-09-30T17:04:16.473 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5308999999999999e-05 2023-09-30T17:04:16.474 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.474 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.474 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.474 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.425603+0000", 2023-09-30T17:04:16.474 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2023-09-30T17:04:16.474 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.474 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.474 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.474 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.425609+0000", 2023-09-30T17:04:16.474 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6899999999999997e-06 2023-09-30T17:04:16.474 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.475 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.475 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.475 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.475 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.475 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125509 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.475 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.442440+0000", 2023-09-30T17:04:16.475 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.128913746, 2023-09-30T17:04:16.475 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.14080759400000001, 2023-09-30T17:04:16.475 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.475 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.475 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.475 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.476 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.476 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125509 2023-09-30T17:04:16.476 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.476 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.476 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.476 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.476 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.442440+0000", 2023-09-30T17:04:16.476 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.476 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.476 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.476 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.476 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.442440+0000", 2023-09-30T17:04:16.477 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.477 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.477 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.477 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.477 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.442440+0000", 2023-09-30T17:04:16.477 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3499999999999996e-07 2023-09-30T17:04:16.477 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.477 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.477 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.477 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.442450+0000", 2023-09-30T17:04:16.477 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6630000000000005e-06 2023-09-30T17:04:16.477 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.477 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.478 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.478 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.442456+0000", 2023-09-30T17:04:16.478 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3069999999999999e-06 2023-09-30T17:04:16.478 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.478 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.478 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.478 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.442461+0000", 2023-09-30T17:04:16.478 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8629999999999999e-06 2023-09-30T17:04:16.478 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.478 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.478 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.478 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.479 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.479 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124490 4.36 e53/17)", 2023-09-30T17:04:16.479 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.455283+0000", 2023-09-30T17:04:16.479 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.11607055099999999, 2023-09-30T17:04:16.479 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.12799453099999999, 2023-09-30T17:04:16.479 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.479 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.479 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.479 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.479 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.479 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.455283+0000", 2023-09-30T17:04:16.479 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.480 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.480 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.455283+0000", 2023-09-30T17:04:16.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.480 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.480 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.455283+0000", 2023-09-30T17:04:16.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3000000000000002e-07 2023-09-30T17:04:16.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.481 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.481 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.481 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.455296+0000", 2023-09-30T17:04:16.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2278e-05 2023-09-30T17:04:16.481 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.481 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.481 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.481 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.455302+0000", 2023-09-30T17:04:16.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2500000000000003e-06 2023-09-30T17:04:16.481 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.481 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.481 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.482 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.455306+0000", 2023-09-30T17:04:16.482 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.605e-06 2023-09-30T17:04:16.482 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.482 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.482 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.482 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.482 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.482 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125702 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.482 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.496579+0000", 2023-09-30T17:04:16.482 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.074774112000000004, 2023-09-30T17:04:16.482 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.086724991000000001, 2023-09-30T17:04:16.482 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.483 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.483 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.483 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.483 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.483 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125702 2023-09-30T17:04:16.483 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.483 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.483 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.483 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.483 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.496579+0000", 2023-09-30T17:04:16.483 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.483 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.484 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.484 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.484 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.496579+0000", 2023-09-30T17:04:16.484 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.484 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.484 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.484 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.484 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.498518+0000", 2023-09-30T17:04:16.484 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001939002 2023-09-30T17:04:16.484 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.484 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.485 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.485 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.498535+0000", 2023-09-30T17:04:16.485 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6050999999999999e-05 2023-09-30T17:04:16.485 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.485 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.485 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.485 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.498545+0000", 2023-09-30T17:04:16.485 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0088000000000001e-05 2023-09-30T17:04:16.485 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.485 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.485 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.486 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.498552+0000", 2023-09-30T17:04:16.486 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0339999999999999e-06 2023-09-30T17:04:16.486 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.486 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.486 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.486 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.486 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.486 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125726 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.486 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.514631+0000", 2023-09-30T17:04:16.486 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.056722881000000003, 2023-09-30T17:04:16.486 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.068704828999999995, 2023-09-30T17:04:16.487 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.487 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.487 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.487 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.487 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.487 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125726 2023-09-30T17:04:16.487 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.487 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.487 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.487 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.487 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.514631+0000", 2023-09-30T17:04:16.488 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.488 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.488 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.488 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.488 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.514631+0000", 2023-09-30T17:04:16.488 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.488 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.488 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.488 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.488 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.514631+0000", 2023-09-30T17:04:16.489 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1600000000000001e-07 2023-09-30T17:04:16.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.489 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.489 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.514644+0000", 2023-09-30T17:04:16.489 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2493e-05 2023-09-30T17:04:16.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.489 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.489 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.514652+0000", 2023-09-30T17:04:16.489 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9999999999999996e-06 2023-09-30T17:04:16.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.490 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.490 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.490 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.514658+0000", 2023-09-30T17:04:16.490 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9150000000000001e-06 2023-09-30T17:04:16.490 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.490 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.490 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.490 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.490 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.490 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125776 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.490 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.544563+0000", 2023-09-30T17:04:16.490 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.026790176999999998, 2023-09-30T17:04:16.491 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.038802151, 2023-09-30T17:04:16.491 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.491 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.491 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.491 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.491 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.491 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125776 2023-09-30T17:04:16.491 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.491 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.491 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.491 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.491 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.544563+0000", 2023-09-30T17:04:16.492 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.493 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.493 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.493 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.493 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.544563+0000", 2023-09-30T17:04:16.493 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.493 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.494 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.494 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.494 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.551134+0000", 2023-09-30T17:04:16.494 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065703300000000001 2023-09-30T17:04:16.494 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.494 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.494 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.494 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.551148+0000", 2023-09-30T17:04:16.494 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3944999999999999e-05 2023-09-30T17:04:16.494 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.494 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.495 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.495 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.551155+0000", 2023-09-30T17:04:16.495 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6120000000000001e-06 2023-09-30T17:04:16.495 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.495 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.495 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.495 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.551162+0000", 2023-09-30T17:04:16.495 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6649999999999997e-06 2023-09-30T17:04:16.495 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.495 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.495 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.495 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.496 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.496 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124831 4.36 e53/17)", 2023-09-30T17:04:16.496 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.576431+0000", 2023-09-30T17:04:16.496 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9949226, 2023-09-30T17:04:16.496 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0069651519999999996, 2023-09-30T17:04:16.496 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.496 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.496 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.496 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.496 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.496 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.576431+0000", 2023-09-30T17:04:16.496 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.496 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.497 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.497 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.497 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.576431+0000", 2023-09-30T17:04:16.497 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.497 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.497 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.497 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.497 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.576432+0000", 2023-09-30T17:04:16.497 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4200000000000001e-07 2023-09-30T17:04:16.497 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.497 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.497 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.498 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.576446+0000", 2023-09-30T17:04:16.498 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4541e-05 2023-09-30T17:04:16.498 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.498 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.498 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.498 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.576455+0000", 2023-09-30T17:04:16.498 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6340000000000007e-06 2023-09-30T17:04:16.498 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.498 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.498 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.498 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.576461+0000", 2023-09-30T17:04:16.498 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6170000000000003e-06 2023-09-30T17:04:16.499 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.499 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.499 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.499 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.499 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.499 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124077 4.6 e53/17)", 2023-09-30T17:04:16.499 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.342935+0000", 2023-09-30T17:04:16.499 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.22841831200000001, 2023-09-30T17:04:16.499 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.24048956499999999, 2023-09-30T17:04:16.499 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.499 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.499 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.500 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.500 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.500 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.342935+0000", 2023-09-30T17:04:16.500 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.500 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.500 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.500 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.500 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.342935+0000", 2023-09-30T17:04:16.500 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.500 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.500 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.501 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.501 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.342936+0000", 2023-09-30T17:04:16.501 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0470000000000001e-06 2023-09-30T17:04:16.501 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.501 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.501 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.501 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.342950+0000", 2023-09-30T17:04:16.501 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3410999999999999e-05 2023-09-30T17:04:16.501 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.501 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.501 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.501 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.342960+0000", 2023-09-30T17:04:16.501 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0254e-05 2023-09-30T17:04:16.502 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.502 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.502 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.502 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.342968+0000", 2023-09-30T17:04:16.502 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5179999999999998e-06 2023-09-30T17:04:16.502 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.502 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.502 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.502 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.502 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.502 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124517 4.2e e53/17)", 2023-09-30T17:04:16.503 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.463359+0000", 2023-09-30T17:04:16.503 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.107994309, 2023-09-30T17:04:16.503 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.12009130899999999, 2023-09-30T17:04:16.503 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.503 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.503 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.503 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.503 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.503 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.463359+0000", 2023-09-30T17:04:16.503 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.503 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.503 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.503 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.504 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.463359+0000", 2023-09-30T17:04:16.504 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.504 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.504 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.504 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.504 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.463360+0000", 2023-09-30T17:04:16.504 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3500000000000005e-07 2023-09-30T17:04:16.504 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.505 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.505 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.505 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.463382+0000", 2023-09-30T17:04:16.505 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1928000000000001e-05 2023-09-30T17:04:16.505 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.505 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.505 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.505 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.463397+0000", 2023-09-30T17:04:16.505 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4718e-05 2023-09-30T17:04:16.505 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.505 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.505 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.505 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.463405+0000", 2023-09-30T17:04:16.506 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2390000000000002e-06 2023-09-30T17:04:16.506 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.506 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.506 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.506 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.506 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124649 4.6 e53/17)", 2023-09-30T17:04:16.506 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.516281+0000", 2023-09-30T17:04:16.506 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.055072783, 2023-09-30T17:04:16.506 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.067197776000000001, 2023-09-30T17:04:16.506 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.507 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.507 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.507 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.507 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.507 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.516281+0000", 2023-09-30T17:04:16.507 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.507 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.507 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.507 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.507 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.516281+0000", 2023-09-30T17:04:16.507 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.507 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.508 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.508 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.508 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.516282+0000", 2023-09-30T17:04:16.508 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3699999999999999e-07 2023-09-30T17:04:16.508 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.508 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.508 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.508 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.516300+0000", 2023-09-30T17:04:16.508 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8328000000000001e-05 2023-09-30T17:04:16.508 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.508 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.508 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.509 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.516311+0000", 2023-09-30T17:04:16.509 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0835e-05 2023-09-30T17:04:16.509 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.509 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.509 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.509 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.516318+0000", 2023-09-30T17:04:16.509 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1840000000000002e-06 2023-09-30T17:04:16.509 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.509 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.509 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.510 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.510 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.510 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125779 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.510 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.551173+0000", 2023-09-30T17:04:16.510 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.020180904, 2023-09-30T17:04:16.510 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.032333220000000003, 2023-09-30T17:04:16.510 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.510 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.510 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.510 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.510 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.510 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125779 2023-09-30T17:04:16.511 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.511 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.511 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.511 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.511 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.551173+0000", 2023-09-30T17:04:16.511 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.511 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.511 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.511 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.511 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.551173+0000", 2023-09-30T17:04:16.511 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.512 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.512 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.512 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.512 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.551173+0000", 2023-09-30T17:04:16.512 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8299999999999997e-07 2023-09-30T17:04:16.512 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.512 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.512 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.512 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.551190+0000", 2023-09-30T17:04:16.512 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6532e-05 2023-09-30T17:04:16.512 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.512 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.513 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.513 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.551197+0000", 2023-09-30T17:04:16.513 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6709999999999999e-06 2023-09-30T17:04:16.513 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.513 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.513 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.513 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.551203+0000", 2023-09-30T17:04:16.513 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6389999999999997e-06 2023-09-30T17:04:16.513 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.513 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.513 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.514 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.514 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.514 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125814 4.38 4.318ef3b8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.514 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.563555+0000", 2023-09-30T17:04:16.514 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0077983979999999998, 2023-09-30T17:04:16.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019989389999999999, 2023-09-30T17:04:16.514 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.514 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.514 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.514 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.514 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.514 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125814 2023-09-30T17:04:16.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.515 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.515 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.515 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.563555+0000", 2023-09-30T17:04:16.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.515 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.515 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.563555+0000", 2023-09-30T17:04:16.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.516 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.516 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.563556+0000", 2023-09-30T17:04:16.516 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1899999999999998e-07 2023-09-30T17:04:16.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.516 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.516 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.563566+0000", 2023-09-30T17:04:16.516 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.042e-05 2023-09-30T17:04:16.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.517 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.517 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.563570+0000", 2023-09-30T17:04:16.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3039999999999998e-06 2023-09-30T17:04:16.517 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.517 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.517 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.563574+0000", 2023-09-30T17:04:16.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4240000000000002e-06 2023-09-30T17:04:16.517 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.517 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.517 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.517 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.518 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.518 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124830 4.6 e53/17)", 2023-09-30T17:04:16.518 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.576470+0000", 2023-09-30T17:04:16.518 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9948835, 2023-09-30T17:04:16.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071043579999999999, 2023-09-30T17:04:16.518 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.518 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.518 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.518 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.518 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.518 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.576470+0000", 2023-09-30T17:04:16.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.519 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.519 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.576470+0000", 2023-09-30T17:04:16.519 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.519 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.519 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.576470+0000", 2023-09-30T17:04:16.519 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1600000000000002e-07 2023-09-30T17:04:16.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.520 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.520 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.576481+0000", 2023-09-30T17:04:16.520 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0784e-05 2023-09-30T17:04:16.520 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.520 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.520 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.520 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.576486+0000", 2023-09-30T17:04:16.520 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7439999999999998e-06 2023-09-30T17:04:16.520 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.520 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.520 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.520 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.576490+0000", 2023-09-30T17:04:16.521 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0300000000000004e-06 2023-09-30T17:04:16.521 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.521 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.521 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.521 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.521 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.521 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124533 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.521 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.084599+0000", 2023-09-30T17:04:16.521 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.48675447199999999, 2023-09-30T17:04:16.521 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.49900671000000002, 2023-09-30T17:04:16.522 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.522 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.522 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.522 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.522 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.522 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124533 2023-09-30T17:04:16.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.522 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.522 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.522 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.084599+0000", 2023-09-30T17:04:16.522 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.523 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.084599+0000", 2023-09-30T17:04:16.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.523 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.084600+0000", 2023-09-30T17:04:16.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6499999999999999e-07 2023-09-30T17:04:16.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.524 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.524 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.084611+0000", 2023-09-30T17:04:16.524 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1838000000000001e-05 2023-09-30T17:04:16.524 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.524 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.524 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.524 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.084619+0000", 2023-09-30T17:04:16.524 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6190000000000002e-06 2023-09-30T17:04:16.524 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.524 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.524 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.524 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.084625+0000", 2023-09-30T17:04:16.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9410000000000004e-06 2023-09-30T17:04:16.525 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.525 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.525 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.525 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.525 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.525 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125148 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.525 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.314742+0000", 2023-09-30T17:04:16.525 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.256611329, 2023-09-30T17:04:16.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.26889394999999999, 2023-09-30T17:04:16.525 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.526 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.526 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.526 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.526 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.526 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125148 2023-09-30T17:04:16.526 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.526 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.526 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.526 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.314742+0000", 2023-09-30T17:04:16.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.527 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.527 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.527 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.527 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.314742+0000", 2023-09-30T17:04:16.527 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.527 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.527 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.527 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.527 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.319523+0000", 2023-09-30T17:04:16.527 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047808060000000003 2023-09-30T17:04:16.528 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.528 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.528 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.528 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.319539+0000", 2023-09-30T17:04:16.528 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6269999999999998e-05 2023-09-30T17:04:16.528 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.528 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.528 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.528 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.319549+0000", 2023-09-30T17:04:16.528 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5270000000000004e-06 2023-09-30T17:04:16.528 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.528 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.529 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.529 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.319556+0000", 2023-09-30T17:04:16.529 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7399999999999998e-06 2023-09-30T17:04:16.529 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.529 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.529 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.529 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.529 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.529 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124082 4.36 e53/17)", 2023-09-30T17:04:16.529 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.343130+0000", 2023-09-30T17:04:16.529 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.228223915, 2023-09-30T17:04:16.530 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.240534836, 2023-09-30T17:04:16.530 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.530 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.530 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.530 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.530 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.530 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.343130+0000", 2023-09-30T17:04:16.530 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.530 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.530 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.530 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.530 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.343130+0000", 2023-09-30T17:04:16.531 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.531 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.531 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.531 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.531 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.343130+0000", 2023-09-30T17:04:16.531 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3599999999999999e-07 2023-09-30T17:04:16.531 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.531 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.531 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.531 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.343144+0000", 2023-09-30T17:04:16.531 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3709999999999999e-05 2023-09-30T17:04:16.532 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.532 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.532 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.532 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.343153+0000", 2023-09-30T17:04:16.532 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8559999999999996e-06 2023-09-30T17:04:16.532 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.532 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.532 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.532 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.343159+0000", 2023-09-30T17:04:16.532 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4359999999999999e-06 2023-09-30T17:04:16.532 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.532 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.533 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.533 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.533 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.533 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125320 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.533 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.365769+0000", 2023-09-30T17:04:16.533 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.205584286, 2023-09-30T17:04:16.533 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.21792294500000001, 2023-09-30T17:04:16.533 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.533 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.533 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.533 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.533 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.534 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125320 2023-09-30T17:04:16.534 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.534 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.534 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.534 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.534 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.365769+0000", 2023-09-30T17:04:16.534 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.534 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.534 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.534 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.534 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.365769+0000", 2023-09-30T17:04:16.535 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.535 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.535 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.535 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.535 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.365770+0000", 2023-09-30T17:04:16.535 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5499999999999998e-07 2023-09-30T17:04:16.535 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.535 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.535 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.535 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.365785+0000", 2023-09-30T17:04:16.535 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.505e-05 2023-09-30T17:04:16.535 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.536 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.536 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.536 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.365791+0000", 2023-09-30T17:04:16.536 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8300000000000001e-06 2023-09-30T17:04:16.536 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.536 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.536 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.536 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.365796+0000", 2023-09-30T17:04:16.536 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.13e-06 2023-09-30T17:04:16.536 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.536 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.536 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.537 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.537 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.537 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125537 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.537 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.448660+0000", 2023-09-30T17:04:16.537 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.122693527, 2023-09-30T17:04:16.537 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.13506275200000001, 2023-09-30T17:04:16.537 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.537 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.537 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.537 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.537 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.537 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125537 2023-09-30T17:04:16.538 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.538 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.538 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.538 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.538 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.448660+0000", 2023-09-30T17:04:16.538 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.538 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.538 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.538 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.538 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.448660+0000", 2023-09-30T17:04:16.538 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.538 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.539 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.539 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.539 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.455340+0000", 2023-09-30T17:04:16.539 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0066803289999999996 2023-09-30T17:04:16.539 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.539 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.539 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.539 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.455355+0000", 2023-09-30T17:04:16.539 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4153e-05 2023-09-30T17:04:16.539 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.539 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.540 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.540 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.455363+0000", 2023-09-30T17:04:16.540 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4789999999999996e-06 2023-09-30T17:04:16.540 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.540 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.540 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.540 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.455371+0000", 2023-09-30T17:04:16.540 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7570000000000004e-06 2023-09-30T17:04:16.540 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.540 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.540 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.541 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.541 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.541 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124720 4.36 e53/17)", 2023-09-30T17:04:16.541 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.536656+0000", 2023-09-30T17:04:16.541 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.034697906000000001, 2023-09-30T17:04:16.541 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.04711108, 2023-09-30T17:04:16.541 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.541 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.541 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.541 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.541 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.541 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.536656+0000", 2023-09-30T17:04:16.542 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.542 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.542 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.542 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.542 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.536656+0000", 2023-09-30T17:04:16.542 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.542 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.542 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.542 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.542 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.536657+0000", 2023-09-30T17:04:16.542 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1599999999999999e-06 2023-09-30T17:04:16.543 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.543 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.543 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.543 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.536677+0000", 2023-09-30T17:04:16.543 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0557e-05 2023-09-30T17:04:16.543 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.543 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.543 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.543 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.536691+0000", 2023-09-30T17:04:16.543 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4095e-05 2023-09-30T17:04:16.543 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.543 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.544 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.544 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.536705+0000", 2023-09-30T17:04:16.544 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3190000000000001e-05 2023-09-30T17:04:16.544 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.544 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.544 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.544 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.544 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.544 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125781 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 675840~4096 in=4096b,write 1273856~4096 in=4096b,write 1372160~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.544 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.551212+0000", 2023-09-30T17:04:16.544 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.020141995999999999, 2023-09-30T17:04:16.545 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.032614609000000003, 2023-09-30T17:04:16.545 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.545 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:16.545 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.545 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.545 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.545 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125781 2023-09-30T17:04:16.545 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.545 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.545 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.545 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.545 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.551212+0000", 2023-09-30T17:04:16.546 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.546 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.546 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.546 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.546 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.551212+0000", 2023-09-30T17:04:16.546 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.546 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.546 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.546 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.546 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.551212+0000", 2023-09-30T17:04:16.546 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6199999999999998e-07 2023-09-30T17:04:16.547 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.547 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.547 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.547 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.551225+0000", 2023-09-30T17:04:16.547 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3203e-05 2023-09-30T17:04:16.547 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.547 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.547 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.547 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.551319+0000", 2023-09-30T17:04:16.547 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4099999999999997e-05 2023-09-30T17:04:16.547 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.547 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.548 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.548 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.551327+0000", 2023-09-30T17:04:16.548 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9440000000000005e-06 2023-09-30T17:04:16.548 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.548 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.548 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:16.548 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.555800+0000", 2023-09-30T17:04:16.548 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0044722060000000003 2023-09-30T17:04:16.548 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.548 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.548 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:16.548 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.555887+0000", 2023-09-30T17:04:16.549 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7348000000000005e-05 2023-09-30T17:04:16.549 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.549 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.549 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.549 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.549 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.549 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125815 4.11 4:8be3ecac:::100000001f8.00000005:head [write 1527808~8192 in=8192b,write 1826816~4096 in=4096b,write 1843200~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.549 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.563579+0000", 2023-09-30T17:04:16.549 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0077747349999999996, 2023-09-30T17:04:16.549 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020328249999999999, 2023-09-30T17:04:16.549 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.549 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:16.550 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.550 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.550 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.550 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125815 2023-09-30T17:04:16.550 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.550 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.550 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.550 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.550 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.563579+0000", 2023-09-30T17:04:16.550 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.550 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.551 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.551 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.551 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.563579+0000", 2023-09-30T17:04:16.551 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.551 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.551 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.551 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.551 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.563579+0000", 2023-09-30T17:04:16.551 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5400000000000002e-07 2023-09-30T17:04:16.551 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.551 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.551 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.552 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.563590+0000", 2023-09-30T17:04:16.552 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0764000000000001e-05 2023-09-30T17:04:16.552 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.552 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.552 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.552 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.563595+0000", 2023-09-30T17:04:16.552 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1359999999999996e-06 2023-09-30T17:04:16.552 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.552 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.552 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.552 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.563598+0000", 2023-09-30T17:04:16.552 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2890000000000002e-06 2023-09-30T17:04:16.553 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.553 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.553 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:16.553 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.567734+0000", 2023-09-30T17:04:16.553 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004135957 2023-09-30T17:04:16.553 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.553 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.553 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:16.553 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.567816+0000", 2023-09-30T17:04:16.553 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1724000000000006e-05 2023-09-30T17:04:16.553 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.553 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.554 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.554 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.554 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.554 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125853 4.38 4.9b7e3478 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.554 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.574689+0000", 2023-09-30T17:04:16.554 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.996664, 2023-09-30T17:04:16.554 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.009284268, 2023-09-30T17:04:16.554 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.554 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.554 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.554 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.554 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.555 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125853 2023-09-30T17:04:16.555 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.555 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.555 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.555 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.555 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.574689+0000", 2023-09-30T17:04:16.555 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.555 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.555 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.555 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.555 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.574689+0000", 2023-09-30T17:04:16.556 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.556 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.556 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.556 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.556 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.576517+0000", 2023-09-30T17:04:16.556 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001828005 2023-09-30T17:04:16.556 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.556 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.556 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.556 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.576534+0000", 2023-09-30T17:04:16.556 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6152999999999999e-05 2023-09-30T17:04:16.556 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.557 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.557 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.557 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.576541+0000", 2023-09-30T17:04:16.557 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2690000000000002e-06 2023-09-30T17:04:16.557 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.557 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.557 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.557 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.576549+0000", 2023-09-30T17:04:16.557 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.943e-06 2023-09-30T17:04:16.557 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.557 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.558 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.558 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.558 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.558 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124504 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.558 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.078339+0000", 2023-09-30T17:04:16.558 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.49301436100000001, 2023-09-30T17:04:16.558 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.50570157000000004, 2023-09-30T17:04:16.558 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.558 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.558 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.558 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.558 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.559 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124504 2023-09-30T17:04:16.559 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.559 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.559 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.559 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.559 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.078339+0000", 2023-09-30T17:04:16.559 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.559 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.559 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.559 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.559 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.078339+0000", 2023-09-30T17:04:16.559 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.560 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.560 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.560 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.560 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.078340+0000", 2023-09-30T17:04:16.560 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9399999999999995e-07 2023-09-30T17:04:16.560 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.560 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.560 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.560 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.078356+0000", 2023-09-30T17:04:16.560 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6175999999999999e-05 2023-09-30T17:04:16.560 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.561 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.561 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.561 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.078362+0000", 2023-09-30T17:04:16.561 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5679999999999996e-06 2023-09-30T17:04:16.561 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.561 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.561 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.561 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.078368+0000", 2023-09-30T17:04:16.561 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1839999999999998e-06 2023-09-30T17:04:16.561 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.561 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.561 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.562 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.562 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.562 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:123621 4.6 e53/17)", 2023-09-30T17:04:16.562 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.095889+0000", 2023-09-30T17:04:16.562 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.47546502299999999, 2023-09-30T17:04:16.562 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.48820530099999998, 2023-09-30T17:04:16.562 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.562 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.562 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.562 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.562 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.562 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.095889+0000", 2023-09-30T17:04:16.563 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.563 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.563 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.563 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.563 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.095889+0000", 2023-09-30T17:04:16.563 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.563 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.563 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.563 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.563 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.095889+0000", 2023-09-30T17:04:16.563 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4099999999999999e-07 2023-09-30T17:04:16.563 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.564 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.564 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.564 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.095901+0000", 2023-09-30T17:04:16.564 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1945e-05 2023-09-30T17:04:16.564 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.564 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.564 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.564 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.095909+0000", 2023-09-30T17:04:16.564 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6109999999999996e-06 2023-09-30T17:04:16.564 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.564 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.565 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.565 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.095914+0000", 2023-09-30T17:04:16.565 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2809999999999999e-06 2023-09-30T17:04:16.565 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.565 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.565 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.565 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.565 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.565 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124704 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.565 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.136055+0000", 2023-09-30T17:04:16.565 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.43529850599999997, 2023-09-30T17:04:16.565 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.44808801799999998, 2023-09-30T17:04:16.566 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.566 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.566 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.566 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.566 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.566 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124704 2023-09-30T17:04:16.566 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.566 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.566 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.566 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.566 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.136055+0000", 2023-09-30T17:04:16.566 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.567 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.567 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.567 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.567 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.136055+0000", 2023-09-30T17:04:16.567 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.567 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.567 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.567 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.567 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.136056+0000", 2023-09-30T17:04:16.567 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7499999999999999e-07 2023-09-30T17:04:16.567 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.567 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.568 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.568 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.136077+0000", 2023-09-30T17:04:16.568 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0885000000000001e-05 2023-09-30T17:04:16.568 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.568 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.568 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.568 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.136086+0000", 2023-09-30T17:04:16.568 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4690000000000003e-06 2023-09-30T17:04:16.568 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.568 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.568 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.569 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.136092+0000", 2023-09-30T17:04:16.569 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0959999999999997e-06 2023-09-30T17:04:16.569 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.569 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.569 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.569 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.569 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.569 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124001 4.36 e53/17)", 2023-09-30T17:04:16.569 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.297182+0000", 2023-09-30T17:04:16.569 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.27417144700000001, 2023-09-30T17:04:16.569 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.28701158900000001, 2023-09-30T17:04:16.569 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.570 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.570 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.570 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.570 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.570 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.297182+0000", 2023-09-30T17:04:16.570 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.570 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.570 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.570 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.570 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.297182+0000", 2023-09-30T17:04:16.570 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.570 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.571 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.571 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.571 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.297183+0000", 2023-09-30T17:04:16.571 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1600000000000001e-07 2023-09-30T17:04:16.571 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.571 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.571 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.571 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.297199+0000", 2023-09-30T17:04:16.571 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5919000000000001e-05 2023-09-30T17:04:16.571 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.571 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.571 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.572 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.297207+0000", 2023-09-30T17:04:16.572 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8079999999999994e-06 2023-09-30T17:04:16.572 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.572 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.572 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.572 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.297215+0000", 2023-09-30T17:04:16.572 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9899999999999997e-06 2023-09-30T17:04:16.572 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.572 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.572 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.572 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.572 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.573 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124139 4.36 e53/17)", 2023-09-30T17:04:16.573 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.389042+0000", 2023-09-30T17:04:16.573 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.18231109300000001, 2023-09-30T17:04:16.573 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.19519579500000001, 2023-09-30T17:04:16.573 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.573 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.573 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.573 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.573 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.573 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.389042+0000", 2023-09-30T17:04:16.573 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.573 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.574 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.574 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.574 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.389042+0000", 2023-09-30T17:04:16.574 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.574 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.574 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.574 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.574 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.389043+0000", 2023-09-30T17:04:16.574 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6300000000000001e-07 2023-09-30T17:04:16.574 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.574 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.575 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.575 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.389055+0000", 2023-09-30T17:04:16.575 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1771e-05 2023-09-30T17:04:16.575 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.575 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.575 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.575 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.389063+0000", 2023-09-30T17:04:16.575 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2190000000000004e-06 2023-09-30T17:04:16.575 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.575 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.575 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.575 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.389068+0000", 2023-09-30T17:04:16.576 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3809999999999998e-06 2023-09-30T17:04:16.576 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.576 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.576 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.576 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.576 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.576 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124553 4.6 e53/17)", 2023-09-30T17:04:16.576 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.481660+0000", 2023-09-30T17:04:16.576 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.089693266999999993, 2023-09-30T17:04:16.576 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.102628233, 2023-09-30T17:04:16.576 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.576 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.577 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.577 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.577 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.577 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.481660+0000", 2023-09-30T17:04:16.577 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.577 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.577 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.577 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.577 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.481660+0000", 2023-09-30T17:04:16.577 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.577 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.577 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.578 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.578 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.481661+0000", 2023-09-30T17:04:16.578 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8799999999999998e-07 2023-09-30T17:04:16.578 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.578 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.578 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.578 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.481670+0000", 2023-09-30T17:04:16.578 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6530000000000006e-06 2023-09-30T17:04:16.578 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.578 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.578 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.579 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.481676+0000", 2023-09-30T17:04:16.579 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0379999999999996e-06 2023-09-30T17:04:16.579 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.579 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.579 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.579 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.481680+0000", 2023-09-30T17:04:16.579 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0940000000000001e-06 2023-09-30T17:04:16.579 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.579 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.579 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.579 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.579 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.580 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124602 4.36 e53/17)", 2023-09-30T17:04:16.580 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.499517+0000", 2023-09-30T17:04:16.580 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.071836548, 2023-09-30T17:04:16.580 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.084821377000000003, 2023-09-30T17:04:16.580 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.580 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.580 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.580 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.580 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.580 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.499517+0000", 2023-09-30T17:04:16.580 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.580 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.581 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.581 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.581 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.499517+0000", 2023-09-30T17:04:16.581 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.581 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.581 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.581 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.581 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.499518+0000", 2023-09-30T17:04:16.581 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2200000000000004e-07 2023-09-30T17:04:16.581 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.581 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.582 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.582 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.499582+0000", 2023-09-30T17:04:16.582 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4068999999999999e-05 2023-09-30T17:04:16.582 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.582 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.582 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.582 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.499590+0000", 2023-09-30T17:04:16.582 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1899999999999995e-06 2023-09-30T17:04:16.582 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.582 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.582 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.583 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.499597+0000", 2023-09-30T17:04:16.583 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8499999999999996e-06 2023-09-30T17:04:16.583 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.583 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.583 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.583 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.583 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.583 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124729 4.6 e53/17)", 2023-09-30T17:04:16.583 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.537445+0000", 2023-09-30T17:04:16.583 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.033908305999999999, 2023-09-30T17:04:16.583 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.046945539000000001, 2023-09-30T17:04:16.584 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.584 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.584 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.584 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.584 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.584 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.537445+0000", 2023-09-30T17:04:16.584 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.584 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.584 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.584 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.584 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.537445+0000", 2023-09-30T17:04:16.584 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.585 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.585 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.585 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.585 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.537446+0000", 2023-09-30T17:04:16.585 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2600000000000002e-07 2023-09-30T17:04:16.585 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.585 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.585 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.585 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.537470+0000", 2023-09-30T17:04:16.585 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3781000000000002e-05 2023-09-30T17:04:16.585 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.586 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.586 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.586 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.537483+0000", 2023-09-30T17:04:16.586 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3378e-05 2023-09-30T17:04:16.586 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.586 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.586 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.586 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.537491+0000", 2023-09-30T17:04:16.586 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6899999999999992e-06 2023-09-30T17:04:16.586 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.586 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.587 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.587 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.587 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.587 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125786 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.587 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.551339+0000", 2023-09-30T17:04:16.587 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.020014845, 2023-09-30T17:04:16.587 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033103898999999999, 2023-09-30T17:04:16.587 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.587 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.587 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.587 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.587 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.588 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125786 2023-09-30T17:04:16.588 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.588 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.588 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.588 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.588 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.551339+0000", 2023-09-30T17:04:16.588 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.588 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.588 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.588 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.588 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.551339+0000", 2023-09-30T17:04:16.588 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.589 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.589 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.589 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.589 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.551339+0000", 2023-09-30T17:04:16.589 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4899999999999995e-07 2023-09-30T17:04:16.589 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.589 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.589 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.589 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.551357+0000", 2023-09-30T17:04:16.589 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7799999999999999e-05 2023-09-30T17:04:16.589 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.589 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.590 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.590 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.551365+0000", 2023-09-30T17:04:16.590 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1130000000000001e-06 2023-09-30T17:04:16.590 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.590 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.590 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.590 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.551371+0000", 2023-09-30T17:04:16.590 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5999999999999997e-06 2023-09-30T17:04:16.590 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.590 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.590 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.591 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.591 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.591 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:125249 4.19 e53/17 4:997b7129:::100000001f8.00000000:head v 53'3896, mlcod=53'3891)", 2023-09-30T17:04:16.591 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.576568+0000", 2023-09-30T17:04:16.591 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9947853, 2023-09-30T17:04:16.591 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0079388219999999999, 2023-09-30T17:04:16.591 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.591 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:16.591 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.591 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.591 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.592 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.576568+0000", 2023-09-30T17:04:16.592 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.592 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.592 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.592 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.592 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.576568+0000", 2023-09-30T17:04:16.592 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.592 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.592 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.592 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.592 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.576568+0000", 2023-09-30T17:04:16.592 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1199999999999999e-07 2023-09-30T17:04:16.593 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.593 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.593 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.593 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.576591+0000", 2023-09-30T17:04:16.593 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2391e-05 2023-09-30T17:04:16.593 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.593 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.593 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.593 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.576598+0000", 2023-09-30T17:04:16.593 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9589999999999998e-06 2023-09-30T17:04:16.593 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.593 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.594 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.594 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.576601+0000", 2023-09-30T17:04:16.594 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6239999999999999e-06 2023-09-30T17:04:16.594 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.594 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.594 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:16.594 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.577723+0000", 2023-09-30T17:04:16.594 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0011214739999999999 2023-09-30T17:04:16.594 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.594 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.594 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:16.594 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.577747+0000", 2023-09-30T17:04:16.595 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4541000000000001e-05 2023-09-30T17:04:16.595 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.595 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.595 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.595 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.595 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.595 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124505 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.595 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.078375+0000", 2023-09-30T17:04:16.595 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.49297844800000001, 2023-09-30T17:04:16.595 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.50621631099999997, 2023-09-30T17:04:16.595 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.596 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.596 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.596 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.596 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.596 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124505 2023-09-30T17:04:16.596 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.596 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.596 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.596 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.596 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.078375+0000", 2023-09-30T17:04:16.596 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.596 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.597 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.597 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.597 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.078375+0000", 2023-09-30T17:04:16.597 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.597 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.597 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.597 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.597 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.078376+0000", 2023-09-30T17:04:16.597 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6600000000000002e-07 2023-09-30T17:04:16.597 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.597 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.598 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.598 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.078393+0000", 2023-09-30T17:04:16.598 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7305000000000001e-05 2023-09-30T17:04:16.598 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.598 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.598 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.598 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.078400+0000", 2023-09-30T17:04:16.598 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6669999999999999e-06 2023-09-30T17:04:16.598 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.598 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.598 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.598 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.078405+0000", 2023-09-30T17:04:16.599 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5079999999999996e-06 2023-09-30T17:04:16.599 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.599 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.599 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.599 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.599 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.599 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:123630 4.36 e53/17)", 2023-09-30T17:04:16.599 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.095923+0000", 2023-09-30T17:04:16.599 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.47543104400000002, 2023-09-30T17:04:16.599 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.48872494700000002, 2023-09-30T17:04:16.599 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.599 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.600 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.600 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.600 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.600 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.095923+0000", 2023-09-30T17:04:16.600 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.600 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.600 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.600 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.600 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.095923+0000", 2023-09-30T17:04:16.600 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.600 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.600 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.601 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.601 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.095923+0000", 2023-09-30T17:04:16.601 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6800000000000002e-07 2023-09-30T17:04:16.601 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.601 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.601 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.601 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.095933+0000", 2023-09-30T17:04:16.601 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0219e-05 2023-09-30T17:04:16.601 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.601 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.601 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.602 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.095939+0000", 2023-09-30T17:04:16.602 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5720000000000002e-06 2023-09-30T17:04:16.602 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.602 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.602 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.602 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.095944+0000", 2023-09-30T17:04:16.602 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0429999999999998e-06 2023-09-30T17:04:16.602 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.602 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.602 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.602 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.602 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.603 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124764 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.603 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.164564+0000", 2023-09-30T17:04:16.603 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.40678911899999998, 2023-09-30T17:04:16.603 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.42013611499999998, 2023-09-30T17:04:16.603 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.603 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.603 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.603 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.603 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.603 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124764 2023-09-30T17:04:16.603 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.603 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.604 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.604 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.604 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.164564+0000", 2023-09-30T17:04:16.604 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.604 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.604 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.604 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.604 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.164564+0000", 2023-09-30T17:04:16.604 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.604 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.604 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.604 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.605 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.164565+0000", 2023-09-30T17:04:16.605 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7999999999999996e-07 2023-09-30T17:04:16.605 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.605 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.605 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.605 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.164577+0000", 2023-09-30T17:04:16.605 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2258e-05 2023-09-30T17:04:16.605 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.605 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.605 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.605 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.164584+0000", 2023-09-30T17:04:16.605 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6460000000000004e-06 2023-09-30T17:04:16.606 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.606 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.606 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.606 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.164589+0000", 2023-09-30T17:04:16.606 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1619999999999999e-06 2023-09-30T17:04:16.606 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.606 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.606 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.606 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.606 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.606 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:123767 4.6 e53/17)", 2023-09-30T17:04:16.606 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.190801+0000", 2023-09-30T17:04:16.607 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.38055305, 2023-09-30T17:04:16.607 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.39395802699999999, 2023-09-30T17:04:16.607 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.607 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.607 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.607 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.607 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.607 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.190801+0000", 2023-09-30T17:04:16.607 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.607 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.607 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.607 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.608 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.190801+0000", 2023-09-30T17:04:16.608 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.608 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.608 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.608 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.608 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.190802+0000", 2023-09-30T17:04:16.608 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.08e-06 2023-09-30T17:04:16.608 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.608 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.608 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.609 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.190815+0000", 2023-09-30T17:04:16.609 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.289e-05 2023-09-30T17:04:16.609 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.609 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.609 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.609 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.190823+0000", 2023-09-30T17:04:16.609 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0590000000000003e-06 2023-09-30T17:04:16.609 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.609 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.609 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.609 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.190828+0000", 2023-09-30T17:04:16.609 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8900000000000004e-06 2023-09-30T17:04:16.609 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.610 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.610 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.610 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.610 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.610 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124939 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.610 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.234695+0000", 2023-09-30T17:04:16.610 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.336658391, 2023-09-30T17:04:16.610 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.35011977500000002, 2023-09-30T17:04:16.610 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.610 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.610 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.611 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.611 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.611 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124939 2023-09-30T17:04:16.611 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.611 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.611 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.611 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.611 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.234695+0000", 2023-09-30T17:04:16.611 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.611 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.611 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.611 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.612 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.234695+0000", 2023-09-30T17:04:16.612 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.612 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.612 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.612 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.612 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.236516+0000", 2023-09-30T17:04:16.612 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001821009 2023-09-30T17:04:16.612 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.612 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.612 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.612 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.236531+0000", 2023-09-30T17:04:16.613 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.451e-05 2023-09-30T17:04:16.613 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.613 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.613 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.613 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.236540+0000", 2023-09-30T17:04:16.613 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2979999999999997e-06 2023-09-30T17:04:16.613 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.613 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.613 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.613 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.236545+0000", 2023-09-30T17:04:16.613 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9320000000000004e-06 2023-09-30T17:04:16.613 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.614 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.614 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.614 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.614 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.614 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125065 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.614 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.282087+0000", 2023-09-30T17:04:16.614 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.28926612899999998, 2023-09-30T17:04:16.614 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.30278894200000001, 2023-09-30T17:04:16.614 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.614 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.614 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.614 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.615 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.615 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125065 2023-09-30T17:04:16.615 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.615 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.615 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.615 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.615 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.282087+0000", 2023-09-30T17:04:16.615 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.615 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.615 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.615 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.616 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.282087+0000", 2023-09-30T17:04:16.616 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.616 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.616 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.616 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.616 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.282088+0000", 2023-09-30T17:04:16.616 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1899999999999998e-07 2023-09-30T17:04:16.616 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.616 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.616 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.616 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.282104+0000", 2023-09-30T17:04:16.616 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5724999999999999e-05 2023-09-30T17:04:16.616 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.617 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.617 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.617 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.282111+0000", 2023-09-30T17:04:16.617 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1289999999999998e-06 2023-09-30T17:04:16.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.617 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.617 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.617 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.282116+0000", 2023-09-30T17:04:16.617 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6010000000000002e-06 2023-09-30T17:04:16.617 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.617 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.618 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.618 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.618 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.618 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125153 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.618 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.319606+0000", 2023-09-30T17:04:16.618 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.25174764599999999, 2023-09-30T17:04:16.618 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.26534050799999997, 2023-09-30T17:04:16.618 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.618 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.618 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.618 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.618 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.619 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125153 2023-09-30T17:04:16.619 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.619 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.619 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.619 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.619 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.319606+0000", 2023-09-30T17:04:16.619 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.619 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.619 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.619 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.620 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.319606+0000", 2023-09-30T17:04:16.620 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.620 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.620 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.620 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.620 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.319606+0000", 2023-09-30T17:04:16.620 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1600000000000001e-07 2023-09-30T17:04:16.620 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.620 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.620 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.620 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.319620+0000", 2023-09-30T17:04:16.621 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3739e-05 2023-09-30T17:04:16.621 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.621 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.621 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.621 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.319627+0000", 2023-09-30T17:04:16.621 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6810000000000001e-06 2023-09-30T17:04:16.621 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.621 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.621 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.621 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.319632+0000", 2023-09-30T17:04:16.621 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.434e-06 2023-09-30T17:04:16.622 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.622 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.622 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.622 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.622 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.622 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125205 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.622 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.331754+0000", 2023-09-30T17:04:16.622 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.23959910300000001, 2023-09-30T17:04:16.622 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.25325209300000001, 2023-09-30T17:04:16.622 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.622 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.623 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.623 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.623 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.623 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125205 2023-09-30T17:04:16.623 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.623 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.623 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.623 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.623 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.331754+0000", 2023-09-30T17:04:16.623 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.623 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.624 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.624 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.624 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.331754+0000", 2023-09-30T17:04:16.624 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.624 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.624 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.624 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.624 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.331755+0000", 2023-09-30T17:04:16.624 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1500000000000004e-07 2023-09-30T17:04:16.624 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.624 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.624 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.624 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.331778+0000", 2023-09-30T17:04:16.625 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3129000000000002e-05 2023-09-30T17:04:16.625 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.625 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.625 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.625 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.331786+0000", 2023-09-30T17:04:16.625 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.323e-06 2023-09-30T17:04:16.625 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.625 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.625 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.625 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.331794+0000", 2023-09-30T17:04:16.625 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6629999999999999e-06 2023-09-30T17:04:16.626 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.626 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.626 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.626 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.626 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.626 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125262 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.626 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.343564+0000", 2023-09-30T17:04:16.626 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.22778990800000001, 2023-09-30T17:04:16.626 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.24150218100000001, 2023-09-30T17:04:16.626 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.626 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.627 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.627 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.627 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.627 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125262 2023-09-30T17:04:16.627 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.627 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.627 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.627 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.627 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.343564+0000", 2023-09-30T17:04:16.627 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.627 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.627 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.628 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.628 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.343564+0000", 2023-09-30T17:04:16.628 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.628 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.628 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.628 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.628 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.343564+0000", 2023-09-30T17:04:16.628 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0699999999999997e-07 2023-09-30T17:04:16.628 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.628 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.628 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.628 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.343576+0000", 2023-09-30T17:04:16.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2284e-05 2023-09-30T17:04:16.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.629 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.343583+0000", 2023-09-30T17:04:16.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7730000000000002e-06 2023-09-30T17:04:16.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.629 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.343589+0000", 2023-09-30T17:04:16.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4260000000000002e-06 2023-09-30T17:04:16.629 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.630 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.630 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.630 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124109 4.36 e53/17)", 2023-09-30T17:04:16.630 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.365838+0000", 2023-09-30T17:04:16.630 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.205515846, 2023-09-30T17:04:16.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.21927212800000001, 2023-09-30T17:04:16.630 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.630 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.631 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.631 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.631 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.631 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.365838+0000", 2023-09-30T17:04:16.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.631 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.631 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.631 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.631 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.365838+0000", 2023-09-30T17:04:16.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.631 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.631 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.632 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.632 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.365838+0000", 2023-09-30T17:04:16.632 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.67e-07 2023-09-30T17:04:16.632 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.632 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.632 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.632 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.365849+0000", 2023-09-30T17:04:16.632 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1181e-05 2023-09-30T17:04:16.632 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.632 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.633 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.633 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.365855+0000", 2023-09-30T17:04:16.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5010000000000004e-06 2023-09-30T17:04:16.633 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.633 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.633 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.633 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.365859+0000", 2023-09-30T17:04:16.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3479999999999997e-06 2023-09-30T17:04:16.633 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.633 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.633 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.634 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.634 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124127 4.6 e53/17)", 2023-09-30T17:04:16.634 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.378953+0000", 2023-09-30T17:04:16.634 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.19240048800000001, 2023-09-30T17:04:16.634 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.20621373600000001, 2023-09-30T17:04:16.634 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.634 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.634 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.378953+0000", 2023-09-30T17:04:16.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.378953+0000", 2023-09-30T17:04:16.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.378953+0000", 2023-09-30T17:04:16.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1e-07 2023-09-30T17:04:16.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.378969+0000", 2023-09-30T17:04:16.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6189999999999999e-05 2023-09-30T17:04:16.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.637 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.378982+0000", 2023-09-30T17:04:16.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2884999999999999e-05 2023-09-30T17:04:16.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.637 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.637 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.378988+0000", 2023-09-30T17:04:16.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5899999999999998e-06 2023-09-30T17:04:16.637 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.637 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.637 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.638 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124232 4.6 e53/17)", 2023-09-30T17:04:16.638 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.403158+0000", 2023-09-30T17:04:16.638 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.16819578099999999, 2023-09-30T17:04:16.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.182064211, 2023-09-30T17:04:16.638 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.638 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.638 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.638 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.638 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.403158+0000", 2023-09-30T17:04:16.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.403158+0000", 2023-09-30T17:04:16.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.403158+0000", 2023-09-30T17:04:16.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8199999999999999e-07 2023-09-30T17:04:16.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.403172+0000", 2023-09-30T17:04:16.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3546e-05 2023-09-30T17:04:16.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.403181+0000", 2023-09-30T17:04:16.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1390000000000001e-06 2023-09-30T17:04:16.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.641 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.403188+0000", 2023-09-30T17:04:16.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4150000000000004e-06 2023-09-30T17:04:16.641 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.641 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.641 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.641 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124296 4.2e e53/17)", 2023-09-30T17:04:16.641 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.414055+0000", 2023-09-30T17:04:16.641 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.15729817900000001, 2023-09-30T17:04:16.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.17121911000000001, 2023-09-30T17:04:16.642 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.642 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.642 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.642 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.642 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.642 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.414055+0000", 2023-09-30T17:04:16.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.642 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.642 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.642 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.642 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.414055+0000", 2023-09-30T17:04:16.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.643 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.643 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.414056+0000", 2023-09-30T17:04:16.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3900000000000004e-07 2023-09-30T17:04:16.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.643 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.643 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.414068+0000", 2023-09-30T17:04:16.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1572e-05 2023-09-30T17:04:16.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.644 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.414076+0000", 2023-09-30T17:04:16.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2460000000000003e-06 2023-09-30T17:04:16.644 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.644 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.414081+0000", 2023-09-30T17:04:16.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2000000000000002e-06 2023-09-30T17:04:16.644 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.644 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.645 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.645 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.645 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.645 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124722 4.36 e53/17)", 2023-09-30T17:04:16.645 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.537536+0000", 2023-09-30T17:04:16.645 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.033817364000000003, 2023-09-30T17:04:16.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.047793064000000003, 2023-09-30T17:04:16.645 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.645 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.645 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.645 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.645 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.645 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.537536+0000", 2023-09-30T17:04:16.646 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.646 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.646 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.646 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.646 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.537536+0000", 2023-09-30T17:04:16.646 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.646 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.646 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.646 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.646 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.537537+0000", 2023-09-30T17:04:16.646 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9499999999999998e-07 2023-09-30T17:04:16.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.647 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.647 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.537550+0000", 2023-09-30T17:04:16.647 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.306e-05 2023-09-30T17:04:16.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.647 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.647 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.537558+0000", 2023-09-30T17:04:16.647 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7269999999999996e-06 2023-09-30T17:04:16.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.648 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.537564+0000", 2023-09-30T17:04:16.648 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9519999999999999e-06 2023-09-30T17:04:16.648 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.648 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.648 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.648 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124774 4.36 e53/17)", 2023-09-30T17:04:16.648 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.551432+0000", 2023-09-30T17:04:16.648 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.019921666000000001, 2023-09-30T17:04:16.648 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033946122000000002, 2023-09-30T17:04:16.649 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.649 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.649 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.649 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.551432+0000", 2023-09-30T17:04:16.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.649 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.649 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.551432+0000", 2023-09-30T17:04:16.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.650 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.650 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.650 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.650 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.551432+0000", 2023-09-30T17:04:16.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1199999999999998e-07 2023-09-30T17:04:16.650 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.650 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.650 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.650 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.551444+0000", 2023-09-30T17:04:16.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1216999999999999e-05 2023-09-30T17:04:16.650 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.651 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.651 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.551468+0000", 2023-09-30T17:04:16.651 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4036000000000002e-05 2023-09-30T17:04:16.651 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.651 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.651 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.551475+0000", 2023-09-30T17:04:16.651 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2559999999999996e-06 2023-09-30T17:04:16.651 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.651 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.651 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.652 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.652 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.652 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125856 4.2d 4:b4aa06e9:::100000001f8.0000001d:head [write 602112~4096 in=4096b,write 651264~4096 in=4096b,write 847872~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.652 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.576557+0000", 2023-09-30T17:04:16.652 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9947963, 2023-09-30T17:04:16.652 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0088826329999999992, 2023-09-30T17:04:16.652 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.652 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:16.652 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.652 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.652 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.653 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125856 2023-09-30T17:04:16.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.653 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.653 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.653 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.576557+0000", 2023-09-30T17:04:16.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.653 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.653 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.576557+0000", 2023-09-30T17:04:16.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.654 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578516+0000", 2023-09-30T17:04:16.654 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019586819999999998 2023-09-30T17:04:16.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.654 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578532+0000", 2023-09-30T17:04:16.654 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6311e-05 2023-09-30T17:04:16.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.655 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.655 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.655 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578544+0000", 2023-09-30T17:04:16.655 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1919999999999999e-05 2023-09-30T17:04:16.655 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.655 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.655 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.655 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578551+0000", 2023-09-30T17:04:16.655 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4510000000000003e-06 2023-09-30T17:04:16.655 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.655 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.656 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:16.656 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.579072+0000", 2023-09-30T17:04:16.656 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00052040099999999998 2023-09-30T17:04:16.656 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.656 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.656 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:16.656 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.579154+0000", 2023-09-30T17:04:16.656 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2045000000000005e-05 2023-09-30T17:04:16.656 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.656 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.656 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:16.657 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.579301+0000", 2023-09-30T17:04:16.657 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000147539 2023-09-30T17:04:16.657 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.657 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.657 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.657 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.657 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124536 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.657 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.084831+0000", 2023-09-30T17:04:16.657 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.48652288199999999, 2023-09-30T17:04:16.657 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.500697473, 2023-09-30T17:04:16.657 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.658 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.658 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.658 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.658 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.658 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124536 2023-09-30T17:04:16.658 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.658 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.084831+0000", 2023-09-30T17:04:16.658 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.659 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.659 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.659 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.084831+0000", 2023-09-30T17:04:16.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.659 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.659 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.659 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.086516+0000", 2023-09-30T17:04:16.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0016848760000000001 2023-09-30T17:04:16.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.659 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.660 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.660 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.086529+0000", 2023-09-30T17:04:16.660 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3546999999999999e-05 2023-09-30T17:04:16.660 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.660 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.660 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.660 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.086541+0000", 2023-09-30T17:04:16.660 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2242000000000001e-05 2023-09-30T17:04:16.660 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.660 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.660 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.661 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.086549+0000", 2023-09-30T17:04:16.661 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8220000000000007e-06 2023-09-30T17:04:16.661 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.661 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.661 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.661 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.661 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.661 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124768 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.661 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.164596+0000", 2023-09-30T17:04:16.661 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.406757761, 2023-09-30T17:04:16.661 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.420991422, 2023-09-30T17:04:16.662 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.662 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.662 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.662 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.662 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.662 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124768 2023-09-30T17:04:16.662 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.662 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.662 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.662 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.662 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.164596+0000", 2023-09-30T17:04:16.663 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.663 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.663 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.663 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.663 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.164596+0000", 2023-09-30T17:04:16.663 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.663 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.663 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.663 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.663 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.164596+0000", 2023-09-30T17:04:16.663 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.39e-07 2023-09-30T17:04:16.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.664 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.664 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.164607+0000", 2023-09-30T17:04:16.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1049999999999999e-05 2023-09-30T17:04:16.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.664 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.664 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.164613+0000", 2023-09-30T17:04:16.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.891e-06 2023-09-30T17:04:16.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.164618+0000", 2023-09-30T17:04:16.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9450000000000001e-06 2023-09-30T17:04:16.665 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.665 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.665 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.665 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125066 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.666 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.282123+0000", 2023-09-30T17:04:16.666 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.289230284, 2023-09-30T17:04:16.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.30351809699999999, 2023-09-30T17:04:16.666 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.666 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.666 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.666 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.666 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.666 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125066 2023-09-30T17:04:16.666 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.666 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.282123+0000", 2023-09-30T17:04:16.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.282123+0000", 2023-09-30T17:04:16.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.668 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.282124+0000", 2023-09-30T17:04:16.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5200000000000002e-07 2023-09-30T17:04:16.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.668 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.668 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.282135+0000", 2023-09-30T17:04:16.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1657999999999999e-05 2023-09-30T17:04:16.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.668 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.668 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.282143+0000", 2023-09-30T17:04:16.669 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7970000000000001e-06 2023-09-30T17:04:16.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.669 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.669 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.669 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.282149+0000", 2023-09-30T17:04:16.669 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3159999999999996e-06 2023-09-30T17:04:16.669 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.669 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.669 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.669 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.669 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124014 4.6 e53/17)", 2023-09-30T17:04:16.670 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.306515+0000", 2023-09-30T17:04:16.670 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.26483820699999999, 2023-09-30T17:04:16.670 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.27918978, 2023-09-30T17:04:16.670 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.670 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.670 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.670 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.670 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.670 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.306515+0000", 2023-09-30T17:04:16.670 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.671 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.671 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.671 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.671 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.306515+0000", 2023-09-30T17:04:16.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.671 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.671 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.671 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.671 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.306516+0000", 2023-09-30T17:04:16.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.17e-07 2023-09-30T17:04:16.671 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.672 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.672 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.306526+0000", 2023-09-30T17:04:16.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0148e-05 2023-09-30T17:04:16.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.672 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.672 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.306532+0000", 2023-09-30T17:04:16.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3999999999999997e-06 2023-09-30T17:04:16.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.672 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.672 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.306537+0000", 2023-09-30T17:04:16.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6940000000000003e-06 2023-09-30T17:04:16.673 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.673 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.673 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.673 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124286 4.6 e53/17)", 2023-09-30T17:04:16.673 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.414104+0000", 2023-09-30T17:04:16.673 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.157249941, 2023-09-30T17:04:16.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.17165112799999999, 2023-09-30T17:04:16.673 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.674 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.674 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.674 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.674 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.414104+0000", 2023-09-30T17:04:16.674 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.674 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.674 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.414104+0000", 2023-09-30T17:04:16.674 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.675 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.675 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.414104+0000", 2023-09-30T17:04:16.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4900000000000002e-07 2023-09-30T17:04:16.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.675 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.675 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.414111+0000", 2023-09-30T17:04:16.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.52e-06 2023-09-30T17:04:16.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.414116+0000", 2023-09-30T17:04:16.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4100000000000001e-06 2023-09-30T17:04:16.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.414119+0000", 2023-09-30T17:04:16.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1650000000000002e-06 2023-09-30T17:04:16.676 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.676 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.676 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.677 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125519 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.677 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.442634+0000", 2023-09-30T17:04:16.677 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.128719104, 2023-09-30T17:04:16.677 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.14317724500000001, 2023-09-30T17:04:16.677 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.677 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.677 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.677 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.677 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.678 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125519 2023-09-30T17:04:16.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.678 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.678 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.678 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.678 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.442634+0000", 2023-09-30T17:04:16.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.678 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.678 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.678 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.442634+0000", 2023-09-30T17:04:16.679 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.679 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.679 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.442635+0000", 2023-09-30T17:04:16.679 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2399999999999998e-07 2023-09-30T17:04:16.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.679 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.679 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.442649+0000", 2023-09-30T17:04:16.679 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4219000000000001e-05 2023-09-30T17:04:16.680 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.680 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.680 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.442657+0000", 2023-09-30T17:04:16.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1939999999999998e-06 2023-09-30T17:04:16.680 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.680 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.680 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.442661+0000", 2023-09-30T17:04:16.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.49e-06 2023-09-30T17:04:16.680 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.680 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.681 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.681 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125677 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.681 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.491114+0000", 2023-09-30T17:04:16.681 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.080240079000000006, 2023-09-30T17:04:16.681 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.094765962999999995, 2023-09-30T17:04:16.681 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.681 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.681 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.682 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.682 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.682 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125677 2023-09-30T17:04:16.682 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.682 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.682 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.682 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.682 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.491114+0000", 2023-09-30T17:04:16.682 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.682 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.682 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.682 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.683 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.491114+0000", 2023-09-30T17:04:16.683 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.683 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.683 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.683 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.491114+0000", 2023-09-30T17:04:16.683 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5999999999999999e-07 2023-09-30T17:04:16.683 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.683 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.683 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.491129+0000", 2023-09-30T17:04:16.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5622000000000001e-05 2023-09-30T17:04:16.684 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.684 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.684 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.491133+0000", 2023-09-30T17:04:16.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.659e-06 2023-09-30T17:04:16.684 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.684 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.684 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.491136+0000", 2023-09-30T17:04:16.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7669999999999999e-06 2023-09-30T17:04:16.684 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.685 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.685 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.685 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.685 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124595 4.6 e53/17)", 2023-09-30T17:04:16.685 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.499978+0000", 2023-09-30T17:04:16.685 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.071375261999999995, 2023-09-30T17:04:16.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.085966644999999994, 2023-09-30T17:04:16.685 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.685 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.685 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.686 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.686 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.499978+0000", 2023-09-30T17:04:16.686 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.686 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.686 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.686 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.686 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.499978+0000", 2023-09-30T17:04:16.686 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.686 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.686 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.686 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.687 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.499979+0000", 2023-09-30T17:04:16.687 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7700000000000001e-07 2023-09-30T17:04:16.687 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.687 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.687 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.687 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.499988+0000", 2023-09-30T17:04:16.687 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9819999999999997e-06 2023-09-30T17:04:16.687 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.687 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.687 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.687 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.499993+0000", 2023-09-30T17:04:16.687 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9649999999999999e-06 2023-09-30T17:04:16.688 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.688 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.688 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.688 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.499996+0000", 2023-09-30T17:04:16.688 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6650000000000001e-06 2023-09-30T17:04:16.688 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.688 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.688 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.688 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.688 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.688 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:125218 4.28 e53/17 4:15eeb89b:::100000001f8.00000032:head v 53'3851, mlcod=53'3847)", 2023-09-30T17:04:16.688 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.564578+0000", 2023-09-30T17:04:16.689 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0067755380000000002, 2023-09-30T17:04:16.689 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021432349999999999, 2023-09-30T17:04:16.689 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.689 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:16.689 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.689 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.689 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.564578+0000", 2023-09-30T17:04:16.689 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.689 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.689 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.689 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.564578+0000", 2023-09-30T17:04:16.690 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.690 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.690 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.690 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.564578+0000", 2023-09-30T17:04:16.690 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7899999999999999e-07 2023-09-30T17:04:16.690 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.690 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.690 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.564588+0000", 2023-09-30T17:04:16.690 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8549999999999997e-06 2023-09-30T17:04:16.690 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.691 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.691 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.691 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.564595+0000", 2023-09-30T17:04:16.691 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9260000000000003e-06 2023-09-30T17:04:16.691 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.691 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.691 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.691 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.564601+0000", 2023-09-30T17:04:16.691 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7320000000000003e-06 2023-09-30T17:04:16.691 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.691 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.691 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:16.692 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.570361+0000", 2023-09-30T17:04:16.692 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057603100000000003 2023-09-30T17:04:16.692 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.692 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.692 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:16.692 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.570381+0000", 2023-09-30T17:04:16.692 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0017000000000002e-05 2023-09-30T17:04:16.692 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.692 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.692 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.692 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.692 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.693 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125857 4.1b 4:dbd503eb:::100000001f8.0000002e:head [write 2117632~4096 in=4096b,write 2207744~4096 in=4096b,write 2220032~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.693 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.578565+0000", 2023-09-30T17:04:16.693 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9927888, 2023-09-30T17:04:16.693 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075242629999999998, 2023-09-30T17:04:16.693 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.693 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:16.693 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.693 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.693 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.693 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125857 2023-09-30T17:04:16.693 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.693 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.694 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.694 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.694 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578565+0000", 2023-09-30T17:04:16.694 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.694 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.694 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.694 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.694 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578565+0000", 2023-09-30T17:04:16.694 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.694 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.694 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.694 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.695 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578565+0000", 2023-09-30T17:04:16.698 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2600000000000002e-07 2023-09-30T17:04:16.698 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.698 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.698 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.698 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578602+0000", 2023-09-30T17:04:16.698 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6489999999999998e-05 2023-09-30T17:04:16.698 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.698 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.698 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.698 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578609+0000", 2023-09-30T17:04:16.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.447e-06 2023-09-30T17:04:16.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.699 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.699 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578615+0000", 2023-09-30T17:04:16.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1120000000000001e-06 2023-09-30T17:04:16.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.699 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:16.699 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578655+0000", 2023-09-30T17:04:16.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9236000000000002e-05 2023-09-30T17:04:16.700 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.700 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.700 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:16.700 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578729+0000", 2023-09-30T17:04:16.700 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4414999999999998e-05 2023-09-30T17:04:16.700 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.700 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.700 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.700 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.700 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.700 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124732 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.700 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.147323+0000", 2023-09-30T17:04:16.701 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.42403030200000003, 2023-09-30T17:04:16.701 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.438843961, 2023-09-30T17:04:16.701 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.701 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.701 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.701 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.701 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.701 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124732 2023-09-30T17:04:16.701 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.701 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.701 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.701 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.702 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.147323+0000", 2023-09-30T17:04:16.702 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.702 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.702 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.702 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.702 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.147323+0000", 2023-09-30T17:04:16.702 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.702 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.702 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.702 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.702 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.148521+0000", 2023-09-30T17:04:16.702 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0011973520000000001 2023-09-30T17:04:16.703 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.703 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.703 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.703 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.148541+0000", 2023-09-30T17:04:16.703 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9936e-05 2023-09-30T17:04:16.703 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.703 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.703 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.703 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.148550+0000", 2023-09-30T17:04:16.703 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2890000000000003e-06 2023-09-30T17:04:16.703 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.703 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.704 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.704 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.148557+0000", 2023-09-30T17:04:16.704 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3610000000000003e-06 2023-09-30T17:04:16.704 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.704 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.704 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.704 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.704 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.704 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:123768 4.36 e53/17)", 2023-09-30T17:04:16.704 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.190863+0000", 2023-09-30T17:04:16.704 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.38049017699999998, 2023-09-30T17:04:16.704 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.39536126999999999, 2023-09-30T17:04:16.705 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.705 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.705 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.705 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.705 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.705 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.190863+0000", 2023-09-30T17:04:16.705 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.705 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.705 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.705 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.705 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.190863+0000", 2023-09-30T17:04:16.705 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.706 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.706 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.706 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.706 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.190864+0000", 2023-09-30T17:04:16.706 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.61e-07 2023-09-30T17:04:16.706 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.706 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.706 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.706 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.190871+0000", 2023-09-30T17:04:16.706 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.323e-06 2023-09-30T17:04:16.706 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.706 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.707 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.707 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.190874+0000", 2023-09-30T17:04:16.707 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4920000000000002e-06 2023-09-30T17:04:16.707 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.707 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.707 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.707 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.190877+0000", 2023-09-30T17:04:16.707 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5490000000000001e-06 2023-09-30T17:04:16.707 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.707 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.707 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.707 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.708 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.708 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:123872 4.6 e53/17)", 2023-09-30T17:04:16.708 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.248447+0000", 2023-09-30T17:04:16.708 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.32290613400000001, 2023-09-30T17:04:16.708 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.33780669400000002, 2023-09-30T17:04:16.708 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.708 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.708 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.708 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.708 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.708 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.248447+0000", 2023-09-30T17:04:16.708 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.709 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.709 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.709 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.709 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.248447+0000", 2023-09-30T17:04:16.709 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.709 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.709 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.709 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.709 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.248448+0000", 2023-09-30T17:04:16.709 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6e-07 2023-09-30T17:04:16.709 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.709 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.710 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.710 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.248467+0000", 2023-09-30T17:04:16.710 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8961999999999999e-05 2023-09-30T17:04:16.710 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.710 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.710 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.710 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.248475+0000", 2023-09-30T17:04:16.710 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7199999999999995e-06 2023-09-30T17:04:16.710 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.710 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.710 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.710 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.248481+0000", 2023-09-30T17:04:16.711 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3970000000000002e-06 2023-09-30T17:04:16.711 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.711 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.711 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.711 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.711 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.711 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125098 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.711 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.299195+0000", 2023-09-30T17:04:16.711 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.27215898900000002, 2023-09-30T17:04:16.711 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.287087125, 2023-09-30T17:04:16.711 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.711 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.712 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.712 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.712 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.712 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125098 2023-09-30T17:04:16.712 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.712 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.712 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.712 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.712 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.299195+0000", 2023-09-30T17:04:16.712 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.712 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.712 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.712 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.713 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.299195+0000", 2023-09-30T17:04:16.713 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.713 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.713 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.713 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.713 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.299195+0000", 2023-09-30T17:04:16.713 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1800000000000005e-07 2023-09-30T17:04:16.713 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.713 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.713 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.713 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.299214+0000", 2023-09-30T17:04:16.714 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8570999999999999e-05 2023-09-30T17:04:16.714 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.714 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.714 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.714 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.299224+0000", 2023-09-30T17:04:16.714 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0562e-05 2023-09-30T17:04:16.714 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.714 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.714 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.714 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.299231+0000", 2023-09-30T17:04:16.714 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2199999999999997e-06 2023-09-30T17:04:16.714 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.715 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.715 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.715 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.715 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.715 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124178 4.6 e53/17)", 2023-09-30T17:04:16.715 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.389562+0000", 2023-09-30T17:04:16.715 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.18179145799999999, 2023-09-30T17:04:16.715 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.19677049699999999, 2023-09-30T17:04:16.715 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.715 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.715 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.715 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.716 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.716 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.389562+0000", 2023-09-30T17:04:16.716 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.716 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.716 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.716 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.716 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.389562+0000", 2023-09-30T17:04:16.716 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.716 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.716 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.716 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.716 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.389563+0000", 2023-09-30T17:04:16.717 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9399999999999995e-07 2023-09-30T17:04:16.717 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.717 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.717 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.717 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.389585+0000", 2023-09-30T17:04:16.717 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2558999999999999e-05 2023-09-30T17:04:16.717 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.717 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.717 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.717 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.389593+0000", 2023-09-30T17:04:16.717 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4800000000000004e-06 2023-09-30T17:04:16.718 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.718 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.718 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.718 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.389599+0000", 2023-09-30T17:04:16.718 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9909999999999999e-06 2023-09-30T17:04:16.718 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.718 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.718 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.718 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.718 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.718 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125471 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.719 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.425800+0000", 2023-09-30T17:04:16.719 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.14555396400000001, 2023-09-30T17:04:16.719 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.16058871299999999, 2023-09-30T17:04:16.719 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.719 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.719 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.719 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.719 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.719 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125471 2023-09-30T17:04:16.719 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.719 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.719 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.720 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.720 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.425800+0000", 2023-09-30T17:04:16.720 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.720 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.720 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.720 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.720 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.425800+0000", 2023-09-30T17:04:16.720 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.720 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.720 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.720 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.720 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.425800+0000", 2023-09-30T17:04:16.721 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9100000000000004e-07 2023-09-30T17:04:16.721 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.721 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.721 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.721 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.425813+0000", 2023-09-30T17:04:16.721 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2729e-05 2023-09-30T17:04:16.721 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.721 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.721 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.721 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.425820+0000", 2023-09-30T17:04:16.721 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6590000000000001e-06 2023-09-30T17:04:16.721 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.722 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.722 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.722 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.425825+0000", 2023-09-30T17:04:16.722 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3090000000000003e-06 2023-09-30T17:04:16.722 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.722 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.722 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.722 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.722 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.722 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125546 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.722 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.455497+0000", 2023-09-30T17:04:16.722 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.115856136, 2023-09-30T17:04:16.723 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.130964732, 2023-09-30T17:04:16.723 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.723 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.723 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.723 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.723 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.723 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125546 2023-09-30T17:04:16.723 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.723 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.723 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.723 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.723 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.455497+0000", 2023-09-30T17:04:16.724 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.724 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.724 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.724 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.724 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.455497+0000", 2023-09-30T17:04:16.724 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.724 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.724 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.724 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.724 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.455498+0000", 2023-09-30T17:04:16.724 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4000000000000002e-07 2023-09-30T17:04:16.724 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.725 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.725 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.725 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.455517+0000", 2023-09-30T17:04:16.725 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9587000000000001e-05 2023-09-30T17:04:16.725 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.725 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.725 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.725 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.455525+0000", 2023-09-30T17:04:16.725 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9310000000000008e-06 2023-09-30T17:04:16.725 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.725 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.725 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.726 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.455532+0000", 2023-09-30T17:04:16.726 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1630000000000001e-06 2023-09-30T17:04:16.726 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.726 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.726 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.726 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.726 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.726 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124522 4.6 e53/17)", 2023-09-30T17:04:16.726 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.463809+0000", 2023-09-30T17:04:16.726 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.107545047, 2023-09-30T17:04:16.726 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.122717795, 2023-09-30T17:04:16.726 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.727 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.727 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.727 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.727 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.727 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.463809+0000", 2023-09-30T17:04:16.727 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.727 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.727 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.727 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.727 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.463809+0000", 2023-09-30T17:04:16.727 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.727 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.728 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.728 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.728 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.463809+0000", 2023-09-30T17:04:16.728 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7700000000000005e-07 2023-09-30T17:04:16.728 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.728 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.728 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.728 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.463827+0000", 2023-09-30T17:04:16.728 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8465999999999999e-05 2023-09-30T17:04:16.728 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.728 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.728 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.729 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.463845+0000", 2023-09-30T17:04:16.729 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7458000000000001e-05 2023-09-30T17:04:16.729 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.729 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.729 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.729 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.463851+0000", 2023-09-30T17:04:16.729 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0159999999999997e-06 2023-09-30T17:04:16.729 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.729 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.729 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.729 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.729 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.730 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125679 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.730 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.491140+0000", 2023-09-30T17:04:16.730 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.080213716000000004, 2023-09-30T17:04:16.730 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.095432722999999997, 2023-09-30T17:04:16.730 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.730 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.730 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.730 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.730 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.730 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125679 2023-09-30T17:04:16.730 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.730 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.731 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.731 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.731 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.491140+0000", 2023-09-30T17:04:16.731 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.731 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.731 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.731 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.731 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.491140+0000", 2023-09-30T17:04:16.731 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.731 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.731 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.731 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.732 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.491140+0000", 2023-09-30T17:04:16.732 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2600000000000001e-07 2023-09-30T17:04:16.732 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.732 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.732 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.732 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.491152+0000", 2023-09-30T17:04:16.732 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1732999999999999e-05 2023-09-30T17:04:16.732 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.732 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.732 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.732 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.491155+0000", 2023-09-30T17:04:16.732 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5329999999999999e-06 2023-09-30T17:04:16.733 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.733 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.733 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.733 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.491158+0000", 2023-09-30T17:04:16.733 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.977e-06 2023-09-30T17:04:16.733 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.733 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.733 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.733 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.733 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.733 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125858 4.18 4.31813858 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.734 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.578626+0000", 2023-09-30T17:04:16.734 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9927278, 2023-09-30T17:04:16.734 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080847249999999992, 2023-09-30T17:04:16.734 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.734 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.734 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.734 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.734 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.734 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125858 2023-09-30T17:04:16.734 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.734 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.734 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.735 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.735 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578626+0000", 2023-09-30T17:04:16.735 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.735 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.735 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.735 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.735 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578626+0000", 2023-09-30T17:04:16.735 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.735 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.735 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.735 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.735 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578627+0000", 2023-09-30T17:04:16.736 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8999999999999996e-07 2023-09-30T17:04:16.736 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.736 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.736 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.736 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578642+0000", 2023-09-30T17:04:16.736 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5284000000000001e-05 2023-09-30T17:04:16.736 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.736 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.736 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.736 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578648+0000", 2023-09-30T17:04:16.736 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4289999999999998e-06 2023-09-30T17:04:16.736 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.737 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.737 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.737 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578659+0000", 2023-09-30T17:04:16.737 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0488e-05 2023-09-30T17:04:16.737 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.737 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.737 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.737 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.737 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.737 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124878 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.737 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.204984+0000", 2023-09-30T17:04:16.738 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.36636979600000003, 2023-09-30T17:04:16.738 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.38178357400000001, 2023-09-30T17:04:16.738 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.738 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.738 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.738 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.738 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.738 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124878 2023-09-30T17:04:16.738 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.738 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.738 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.738 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.739 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.204984+0000", 2023-09-30T17:04:16.739 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.739 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.739 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.739 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.739 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.204984+0000", 2023-09-30T17:04:16.739 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.739 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.739 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.739 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.739 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.204984+0000", 2023-09-30T17:04:16.739 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1500000000000004e-07 2023-09-30T17:04:16.740 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.740 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.740 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.740 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.205008+0000", 2023-09-30T17:04:16.740 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3717999999999999e-05 2023-09-30T17:04:16.740 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.740 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.740 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.740 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.205015+0000", 2023-09-30T17:04:16.740 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6699999999999997e-06 2023-09-30T17:04:16.740 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.740 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.741 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.741 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.205021+0000", 2023-09-30T17:04:16.741 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2280000000000003e-06 2023-09-30T17:04:16.741 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.741 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.741 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.741 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.741 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.741 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125009 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.741 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.260610+0000", 2023-09-30T17:04:16.741 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.31074350099999998, 2023-09-30T17:04:16.741 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.32620948, 2023-09-30T17:04:16.742 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.742 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.742 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.742 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.742 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.742 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125009 2023-09-30T17:04:16.742 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.742 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.742 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.742 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.742 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.260610+0000", 2023-09-30T17:04:16.742 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.743 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.743 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.743 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.743 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.260610+0000", 2023-09-30T17:04:16.743 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.743 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.743 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.743 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.743 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.260611+0000", 2023-09-30T17:04:16.743 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4000000000000002e-07 2023-09-30T17:04:16.743 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.744 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.744 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.260624+0000", 2023-09-30T17:04:16.744 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2996000000000001e-05 2023-09-30T17:04:16.744 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.744 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.744 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.260630+0000", 2023-09-30T17:04:16.744 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5150000000000003e-06 2023-09-30T17:04:16.744 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.744 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.745 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.260635+0000", 2023-09-30T17:04:16.745 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0690000000000001e-06 2023-09-30T17:04:16.745 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.745 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.745 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.745 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.745 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.745 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:123914 4.6 e53/17)", 2023-09-30T17:04:16.745 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.272330+0000", 2023-09-30T17:04:16.745 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.29902363300000001, 2023-09-30T17:04:16.745 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.31453891499999997, 2023-09-30T17:04:16.745 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.745 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.746 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.746 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.746 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.746 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.272330+0000", 2023-09-30T17:04:16.746 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.746 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.746 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.746 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.746 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.272330+0000", 2023-09-30T17:04:16.746 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.746 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.746 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.747 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.747 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.272330+0000", 2023-09-30T17:04:16.747 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7599999999999999e-07 2023-09-30T17:04:16.747 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.747 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.747 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.747 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.272342+0000", 2023-09-30T17:04:16.747 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1753000000000001e-05 2023-09-30T17:04:16.747 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.747 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.747 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.748 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.272348+0000", 2023-09-30T17:04:16.748 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9100000000000002e-06 2023-09-30T17:04:16.748 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.748 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.748 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.748 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.272352+0000", 2023-09-30T17:04:16.748 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2860000000000001e-06 2023-09-30T17:04:16.748 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.748 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.748 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.748 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.748 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.749 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125074 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.749 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.282191+0000", 2023-09-30T17:04:16.749 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.28916273300000001, 2023-09-30T17:04:16.749 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.30472360900000001, 2023-09-30T17:04:16.749 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.749 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.749 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.749 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.749 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.749 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125074 2023-09-30T17:04:16.749 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.750 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.750 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.750 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.750 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.282191+0000", 2023-09-30T17:04:16.750 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.750 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.750 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.750 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.750 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.282191+0000", 2023-09-30T17:04:16.750 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.750 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.750 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.751 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.751 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.283515+0000", 2023-09-30T17:04:16.751 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0013240120000000001 2023-09-30T17:04:16.751 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.751 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.751 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.751 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.283533+0000", 2023-09-30T17:04:16.751 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8493999999999999e-05 2023-09-30T17:04:16.751 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.751 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.751 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.751 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.283543+0000", 2023-09-30T17:04:16.752 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0134e-05 2023-09-30T17:04:16.752 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.752 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.752 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.752 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.283550+0000", 2023-09-30T17:04:16.752 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9999999999999999e-06 2023-09-30T17:04:16.752 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.752 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.752 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.752 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.752 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.752 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125099 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.753 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.299242+0000", 2023-09-30T17:04:16.753 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.27211119700000003, 2023-09-30T17:04:16.753 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.28773619499999997, 2023-09-30T17:04:16.753 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.753 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.753 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.753 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.753 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.753 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125099 2023-09-30T17:04:16.753 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.753 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.753 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.753 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.754 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.299242+0000", 2023-09-30T17:04:16.754 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.754 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.754 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.754 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.754 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.299242+0000", 2023-09-30T17:04:16.754 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.754 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.754 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.754 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.754 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.299243+0000", 2023-09-30T17:04:16.754 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1100000000000001e-07 2023-09-30T17:04:16.755 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.755 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.755 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.755 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.299252+0000", 2023-09-30T17:04:16.755 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3689999999999996e-06 2023-09-30T17:04:16.755 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.755 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.755 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.755 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.299258+0000", 2023-09-30T17:04:16.755 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3890000000000004e-06 2023-09-30T17:04:16.755 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.755 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.755 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.756 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.299262+0000", 2023-09-30T17:04:16.756 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5210000000000004e-06 2023-09-30T17:04:16.756 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.756 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.756 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.756 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.756 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.756 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125497 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.756 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.433957+0000", 2023-09-30T17:04:16.756 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.13739668599999999, 2023-09-30T17:04:16.756 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.153075722, 2023-09-30T17:04:16.756 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.757 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.757 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.757 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.757 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.757 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125497 2023-09-30T17:04:16.757 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.757 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.757 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.757 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.757 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.433957+0000", 2023-09-30T17:04:16.757 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.757 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.757 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.758 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.758 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.433957+0000", 2023-09-30T17:04:16.758 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.758 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.758 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.758 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.758 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.435533+0000", 2023-09-30T17:04:16.758 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001576491 2023-09-30T17:04:16.758 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.758 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.758 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.759 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.435551+0000", 2023-09-30T17:04:16.759 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7435000000000002e-05 2023-09-30T17:04:16.759 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.759 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.759 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.759 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.435561+0000", 2023-09-30T17:04:16.759 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.044e-05 2023-09-30T17:04:16.759 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.759 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.759 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.759 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.435569+0000", 2023-09-30T17:04:16.759 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3289999999999996e-06 2023-09-30T17:04:16.760 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.760 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.760 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.760 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.760 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.760 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125547 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.760 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.455541+0000", 2023-09-30T17:04:16.760 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.11581306, 2023-09-30T17:04:16.760 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.13154502400000001, 2023-09-30T17:04:16.760 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.760 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.760 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.760 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.761 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.761 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125547 2023-09-30T17:04:16.761 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.761 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.761 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.761 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.761 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.455541+0000", 2023-09-30T17:04:16.761 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.761 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.761 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.761 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.761 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.455541+0000", 2023-09-30T17:04:16.762 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.762 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.762 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.762 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.762 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.455541+0000", 2023-09-30T17:04:16.762 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8899999999999999e-07 2023-09-30T17:04:16.762 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.762 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.762 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.762 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.455553+0000", 2023-09-30T17:04:16.762 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.185e-05 2023-09-30T17:04:16.762 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.763 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.763 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.763 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.455560+0000", 2023-09-30T17:04:16.763 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7599999999999997e-06 2023-09-30T17:04:16.763 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.763 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.763 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.763 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.455565+0000", 2023-09-30T17:04:16.763 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2689999999999999e-06 2023-09-30T17:04:16.763 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.763 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.763 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.764 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.764 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.775 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125680 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.775 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.491162+0000", 2023-09-30T17:04:16.775 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.080191517000000004, 2023-09-30T17:04:16.775 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.095975817000000005, 2023-09-30T17:04:16.775 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.776 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.776 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.776 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.776 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.776 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125680 2023-09-30T17:04:16.776 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.776 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.776 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.776 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.776 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.491162+0000", 2023-09-30T17:04:16.776 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.777 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.777 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.777 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.777 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.491162+0000", 2023-09-30T17:04:16.777 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.777 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.777 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.777 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.777 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.491162+0000", 2023-09-30T17:04:16.777 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.23e-07 2023-09-30T17:04:16.777 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.778 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.778 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.778 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.491173+0000", 2023-09-30T17:04:16.778 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0334e-05 2023-09-30T17:04:16.778 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.778 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.778 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.778 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.491176+0000", 2023-09-30T17:04:16.778 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4429999999999999e-06 2023-09-30T17:04:16.778 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.778 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.779 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.779 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.491179+0000", 2023-09-30T17:04:16.779 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7590000000000002e-06 2023-09-30T17:04:16.779 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.779 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.779 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.779 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.779 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.779 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124651 4.6 e53/17)", 2023-09-30T17:04:16.779 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.519631+0000", 2023-09-30T17:04:16.780 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.051722830999999997, 2023-09-30T17:04:16.780 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.067558352000000002, 2023-09-30T17:04:16.780 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.780 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.780 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.780 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.780 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.780 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.519631+0000", 2023-09-30T17:04:16.780 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.780 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.780 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.781 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.781 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.519631+0000", 2023-09-30T17:04:16.781 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.781 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.781 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.781 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.781 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.519631+0000", 2023-09-30T17:04:16.781 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.63e-07 2023-09-30T17:04:16.781 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.782 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.782 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.782 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.519655+0000", 2023-09-30T17:04:16.782 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3697999999999999e-05 2023-09-30T17:04:16.782 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.782 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.782 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.782 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.519661+0000", 2023-09-30T17:04:16.782 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6810000000000003e-06 2023-09-30T17:04:16.782 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.783 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.783 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.783 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.519664+0000", 2023-09-30T17:04:16.783 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8070000000000001e-06 2023-09-30T17:04:16.783 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.783 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.783 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.783 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.783 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.784 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125859 4.38 4.9b7e3478 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.784 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.578666+0000", 2023-09-30T17:04:16.784 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9926872, 2023-09-30T17:04:16.784 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0085707279999999997, 2023-09-30T17:04:16.784 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.784 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.784 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.784 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.784 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.784 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125859 2023-09-30T17:04:16.785 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.785 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.785 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.785 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.785 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578666+0000", 2023-09-30T17:04:16.785 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.785 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.785 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.785 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.785 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578666+0000", 2023-09-30T17:04:16.786 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.786 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.786 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.786 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.786 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578667+0000", 2023-09-30T17:04:16.786 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0800000000000005e-07 2023-09-30T17:04:16.786 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.786 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.786 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.787 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578680+0000", 2023-09-30T17:04:16.787 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2856e-05 2023-09-30T17:04:16.787 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.787 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.787 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.787 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578686+0000", 2023-09-30T17:04:16.787 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0909999999999998e-06 2023-09-30T17:04:16.787 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.787 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.787 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.788 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578691+0000", 2023-09-30T17:04:16.788 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8300000000000003e-06 2023-09-30T17:04:16.788 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.788 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.788 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.788 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.788 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.788 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124549 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.788 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.086624+0000", 2023-09-30T17:04:16.789 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.484729935, 2023-09-30T17:04:16.789 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.50066970300000002, 2023-09-30T17:04:16.789 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.789 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.789 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.789 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.789 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.790 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124549 2023-09-30T17:04:16.790 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.790 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.790 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.790 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.790 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.086624+0000", 2023-09-30T17:04:16.790 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.790 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.790 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.791 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.791 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.086624+0000", 2023-09-30T17:04:16.791 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.791 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.791 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.791 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.791 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.086624+0000", 2023-09-30T17:04:16.791 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5900000000000003e-07 2023-09-30T17:04:16.791 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.792 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.792 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.792 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.086634+0000", 2023-09-30T17:04:16.792 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.012e-05 2023-09-30T17:04:16.792 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.792 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.792 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.792 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.086640+0000", 2023-09-30T17:04:16.793 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6380000000000001e-06 2023-09-30T17:04:16.793 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.793 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.793 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.793 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.086645+0000", 2023-09-30T17:04:16.793 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1139999999999997e-06 2023-09-30T17:04:16.793 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.794 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.794 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.794 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.794 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.794 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:123650 4.6 e53/17)", 2023-09-30T17:04:16.794 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.100151+0000", 2023-09-30T17:04:16.794 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.47120234500000002, 2023-09-30T17:04:16.794 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.48719332199999998, 2023-09-30T17:04:16.795 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.795 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.795 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.795 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.795 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.795 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.100151+0000", 2023-09-30T17:04:16.795 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.795 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.795 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.795 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.795 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.100151+0000", 2023-09-30T17:04:16.796 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.796 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.796 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.796 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.796 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.100152+0000", 2023-09-30T17:04:16.796 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8099999999999999e-07 2023-09-30T17:04:16.796 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.796 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.796 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.796 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.100161+0000", 2023-09-30T17:04:16.796 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9550000000000004e-06 2023-09-30T17:04:16.796 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.797 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.797 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.797 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.100167+0000", 2023-09-30T17:04:16.797 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9750000000000004e-06 2023-09-30T17:04:16.797 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.797 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.797 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.797 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.100182+0000", 2023-09-30T17:04:16.797 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4600000000000001e-05 2023-09-30T17:04:16.797 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.797 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.797 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.798 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.798 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.798 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124771 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.798 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.164689+0000", 2023-09-30T17:04:16.798 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.40666506800000002, 2023-09-30T17:04:16.798 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.42270413400000001, 2023-09-30T17:04:16.798 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.798 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.798 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.798 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.799 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.799 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124771 2023-09-30T17:04:16.799 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.799 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.799 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.799 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.799 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.164689+0000", 2023-09-30T17:04:16.799 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.799 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.799 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.799 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.800 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.164689+0000", 2023-09-30T17:04:16.800 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.800 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.800 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.800 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.800 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.164689+0000", 2023-09-30T17:04:16.800 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5499999999999999e-07 2023-09-30T17:04:16.800 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.800 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.800 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.800 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.164700+0000", 2023-09-30T17:04:16.800 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0713999999999999e-05 2023-09-30T17:04:16.800 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.801 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.801 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.801 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.164705+0000", 2023-09-30T17:04:16.801 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7049999999999996e-06 2023-09-30T17:04:16.801 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.801 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.801 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.801 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.164710+0000", 2023-09-30T17:04:16.801 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6789999999999996e-06 2023-09-30T17:04:16.801 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.801 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.802 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.802 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.802 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.802 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124964 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.802 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.248569+0000", 2023-09-30T17:04:16.802 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.32278466500000003, 2023-09-30T17:04:16.802 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.33888378000000002, 2023-09-30T17:04:16.802 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.802 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.802 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.802 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.803 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.803 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124964 2023-09-30T17:04:16.803 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.803 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.803 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.803 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.803 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.248569+0000", 2023-09-30T17:04:16.803 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.803 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.803 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.803 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.803 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.248569+0000", 2023-09-30T17:04:16.804 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.804 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.804 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.804 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.804 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.248570+0000", 2023-09-30T17:04:16.804 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1200000000000003e-07 2023-09-30T17:04:16.804 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.804 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.804 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.804 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.248585+0000", 2023-09-30T17:04:16.804 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5421e-05 2023-09-30T17:04:16.805 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.805 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.805 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.805 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.248591+0000", 2023-09-30T17:04:16.805 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2550000000000003e-06 2023-09-30T17:04:16.805 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.805 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.805 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.805 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.248597+0000", 2023-09-30T17:04:16.805 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7590000000000003e-06 2023-09-30T17:04:16.806 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.806 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.806 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.806 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.806 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.806 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125122 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.806 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.306608+0000", 2023-09-30T17:04:16.806 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.26474530800000001, 2023-09-30T17:04:16.806 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.28091010500000002, 2023-09-30T17:04:16.806 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.806 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.807 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.807 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.807 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.807 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125122 2023-09-30T17:04:16.807 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.807 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.807 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.807 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.807 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.306608+0000", 2023-09-30T17:04:16.807 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.807 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.808 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.808 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.808 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.306608+0000", 2023-09-30T17:04:16.808 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.808 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.808 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.808 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.808 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.306609+0000", 2023-09-30T17:04:16.808 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4900000000000001e-07 2023-09-30T17:04:16.808 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.808 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.808 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.809 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.306627+0000", 2023-09-30T17:04:16.809 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7966e-05 2023-09-30T17:04:16.809 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.809 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.809 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.809 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.306633+0000", 2023-09-30T17:04:16.809 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0329999999999997e-06 2023-09-30T17:04:16.809 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.809 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.809 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.809 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.306638+0000", 2023-09-30T17:04:16.809 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8069999999999999e-06 2023-09-30T17:04:16.810 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.810 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.810 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.810 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.810 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.810 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124418 4.6 e53/17)", 2023-09-30T17:04:16.810 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.443348+0000", 2023-09-30T17:04:16.810 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.12800508699999999, 2023-09-30T17:04:16.810 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.144227402, 2023-09-30T17:04:16.810 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.810 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.811 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.811 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.811 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.811 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.443348+0000", 2023-09-30T17:04:16.811 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.811 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.811 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.811 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.811 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.443348+0000", 2023-09-30T17:04:16.811 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.811 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.811 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.812 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.812 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.443349+0000", 2023-09-30T17:04:16.812 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.44e-07 2023-09-30T17:04:16.812 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.812 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.812 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.812 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.443363+0000", 2023-09-30T17:04:16.812 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3786e-05 2023-09-30T17:04:16.812 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.812 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.812 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.812 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.443372+0000", 2023-09-30T17:04:16.813 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9840000000000007e-06 2023-09-30T17:04:16.813 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.813 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.813 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.443379+0000", 2023-09-30T17:04:16.813 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3050000000000004e-06 2023-09-30T17:04:16.813 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.813 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.813 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.813 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.813 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125548 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.814 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.455572+0000", 2023-09-30T17:04:16.814 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.11578168899999999, 2023-09-30T17:04:16.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.13205551500000001, 2023-09-30T17:04:16.814 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.814 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.814 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.814 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.814 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.814 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125548 2023-09-30T17:04:16.814 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.814 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.815 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.815 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.815 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.455572+0000", 2023-09-30T17:04:16.815 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.815 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.815 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.815 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.815 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.455572+0000", 2023-09-30T17:04:16.815 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.815 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.815 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.816 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.816 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.455572+0000", 2023-09-30T17:04:16.816 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6199999999999998e-07 2023-09-30T17:04:16.816 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.816 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.816 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.816 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.455582+0000", 2023-09-30T17:04:16.816 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6339999999999996e-06 2023-09-30T17:04:16.817 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.817 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.817 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.817 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.455589+0000", 2023-09-30T17:04:16.817 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6710000000000002e-06 2023-09-30T17:04:16.817 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.817 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.817 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.817 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.455594+0000", 2023-09-30T17:04:16.817 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1420000000000001e-06 2023-09-30T17:04:16.817 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.817 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.818 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.818 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.818 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.818 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124603 4.2e e53/17)", 2023-09-30T17:04:16.818 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.502238+0000", 2023-09-30T17:04:16.818 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.069115959000000005, 2023-09-30T17:04:16.818 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.085447674000000001, 2023-09-30T17:04:16.818 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.819 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.819 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.819 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.819 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.819 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.502238+0000", 2023-09-30T17:04:16.819 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.819 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.819 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.819 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.819 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.502238+0000", 2023-09-30T17:04:16.820 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.820 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.820 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.820 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.820 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.502238+0000", 2023-09-30T17:04:16.820 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4200000000000005e-07 2023-09-30T17:04:16.820 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.820 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.820 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.821 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.502334+0000", 2023-09-30T17:04:16.821 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5649999999999994e-05 2023-09-30T17:04:16.821 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.821 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.821 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.821 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.502343+0000", 2023-09-30T17:04:16.821 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0149999999999992e-06 2023-09-30T17:04:16.821 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.821 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.822 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.822 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.502348+0000", 2023-09-30T17:04:16.822 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3140000000000003e-06 2023-09-30T17:04:16.822 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.822 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.822 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.822 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.822 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.822 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125821 4.38 4.5b0ac3f8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.823 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.565563+0000", 2023-09-30T17:04:16.823 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.005791002, 2023-09-30T17:04:16.823 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022175751, 2023-09-30T17:04:16.823 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.823 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.823 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.823 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.823 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.823 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125821 2023-09-30T17:04:16.823 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.824 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.824 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.824 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.824 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.565563+0000", 2023-09-30T17:04:16.824 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.824 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.824 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.824 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.825 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.565563+0000", 2023-09-30T17:04:16.825 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.825 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.825 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.825 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.565563+0000", 2023-09-30T17:04:16.825 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8299999999999997e-07 2023-09-30T17:04:16.825 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.825 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.826 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.565575+0000", 2023-09-30T17:04:16.826 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2026e-05 2023-09-30T17:04:16.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.826 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.826 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.826 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.565583+0000", 2023-09-30T17:04:16.826 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1149999999999994e-06 2023-09-30T17:04:16.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.827 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.827 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.827 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.565589+0000", 2023-09-30T17:04:16.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.071e-06 2023-09-30T17:04:16.827 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.827 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.827 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.827 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.827 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.827 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125862 4.18 4.31813858 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.827 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.578697+0000", 2023-09-30T17:04:16.828 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9926567, 2023-09-30T17:04:16.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0091039669999999993, 2023-09-30T17:04:16.828 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.828 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.828 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.828 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.828 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.828 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125862 2023-09-30T17:04:16.828 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.828 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.828 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.829 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.829 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578697+0000", 2023-09-30T17:04:16.829 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.829 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.829 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.829 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578697+0000", 2023-09-30T17:04:16.829 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.829 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.829 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.829 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578697+0000", 2023-09-30T17:04:16.830 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2900000000000004e-07 2023-09-30T17:04:16.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.830 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.830 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.830 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578708+0000", 2023-09-30T17:04:16.830 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0387000000000001e-05 2023-09-30T17:04:16.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.830 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.831 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.831 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578715+0000", 2023-09-30T17:04:16.831 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9739999999999996e-06 2023-09-30T17:04:16.831 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.831 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.831 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.831 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578719+0000", 2023-09-30T17:04:16.831 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5469999999999998e-06 2023-09-30T17:04:16.832 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.832 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.832 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.832 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.832 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.832 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124849 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.832 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.187635+0000", 2023-09-30T17:04:16.832 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.38371887599999999, 2023-09-30T17:04:16.832 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.40022930299999998, 2023-09-30T17:04:16.832 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.832 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.833 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.833 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.833 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.833 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124849 2023-09-30T17:04:16.833 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.833 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.833 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.833 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.833 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.187635+0000", 2023-09-30T17:04:16.833 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.833 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.834 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.834 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.834 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.187635+0000", 2023-09-30T17:04:16.834 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.834 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.834 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.834 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.834 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.190918+0000", 2023-09-30T17:04:16.834 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0032830799999999999 2023-09-30T17:04:16.834 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.834 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.835 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.835 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.190932+0000", 2023-09-30T17:04:16.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4497e-05 2023-09-30T17:04:16.835 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.835 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.835 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.835 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.190940+0000", 2023-09-30T17:04:16.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8849999999999999e-06 2023-09-30T17:04:16.835 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.835 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.835 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.835 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.190946+0000", 2023-09-30T17:04:16.836 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9950000000000002e-06 2023-09-30T17:04:16.836 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.836 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.836 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.836 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.836 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.836 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:123851 4.6 e53/17)", 2023-09-30T17:04:16.836 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.238298+0000", 2023-09-30T17:04:16.836 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.33305591899999998, 2023-09-30T17:04:16.836 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.349624934, 2023-09-30T17:04:16.836 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.836 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.837 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.837 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.837 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.837 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.238298+0000", 2023-09-30T17:04:16.837 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.837 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.837 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.837 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.837 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.238298+0000", 2023-09-30T17:04:16.837 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.837 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.838 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.838 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.838 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.238298+0000", 2023-09-30T17:04:16.838 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3000000000000001e-07 2023-09-30T17:04:16.838 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.838 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.838 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.838 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.238315+0000", 2023-09-30T17:04:16.838 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6348e-05 2023-09-30T17:04:16.838 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.838 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.838 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.839 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.238322+0000", 2023-09-30T17:04:16.839 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6420000000000007e-06 2023-09-30T17:04:16.839 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.839 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.839 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.839 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.238331+0000", 2023-09-30T17:04:16.839 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.251e-06 2023-09-30T17:04:16.839 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.839 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.839 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.839 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.840 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.840 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:123957 4.6 e53/17)", 2023-09-30T17:04:16.840 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.286666+0000", 2023-09-30T17:04:16.840 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.28468748900000002, 2023-09-30T17:04:16.840 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.30130831899999999, 2023-09-30T17:04:16.840 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.840 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.840 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.840 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.840 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.840 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.286666+0000", 2023-09-30T17:04:16.840 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.841 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.841 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.841 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.841 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.286666+0000", 2023-09-30T17:04:16.841 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.841 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.841 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.841 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.841 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.286667+0000", 2023-09-30T17:04:16.841 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5000000000000001e-07 2023-09-30T17:04:16.841 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.841 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.842 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.842 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.286681+0000", 2023-09-30T17:04:16.842 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4361e-05 2023-09-30T17:04:16.842 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.842 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.842 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.842 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.286690+0000", 2023-09-30T17:04:16.842 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0189999999999995e-06 2023-09-30T17:04:16.842 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.842 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.842 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.842 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.286696+0000", 2023-09-30T17:04:16.842 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7359999999999998e-06 2023-09-30T17:04:16.843 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.843 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.843 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.843 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.843 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.843 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124097 4.36 e53/17)", 2023-09-30T17:04:16.843 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.359445+0000", 2023-09-30T17:04:16.843 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.21190901400000001, 2023-09-30T17:04:16.843 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.22857487200000001, 2023-09-30T17:04:16.843 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.843 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.843 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.844 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.844 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.844 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.359445+0000", 2023-09-30T17:04:16.844 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.844 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.844 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.844 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.844 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.359445+0000", 2023-09-30T17:04:16.844 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.844 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.844 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.844 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.845 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.359445+0000", 2023-09-30T17:04:16.845 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5699999999999999e-07 2023-09-30T17:04:16.845 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.845 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.845 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.845 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.359456+0000", 2023-09-30T17:04:16.845 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0861e-05 2023-09-30T17:04:16.845 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.845 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.845 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.845 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.359470+0000", 2023-09-30T17:04:16.845 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4132e-05 2023-09-30T17:04:16.846 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.846 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.846 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.846 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.359476+0000", 2023-09-30T17:04:16.846 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7729999999999996e-06 2023-09-30T17:04:16.846 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.846 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.846 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.846 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.847 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.847 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125347 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.847 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.377571+0000", 2023-09-30T17:04:16.847 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.193782396, 2023-09-30T17:04:16.847 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.210495929, 2023-09-30T17:04:16.847 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.847 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.847 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.847 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.847 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.847 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125347 2023-09-30T17:04:16.848 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.848 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.848 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.848 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.848 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.377571+0000", 2023-09-30T17:04:16.848 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.848 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.848 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.848 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.848 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.377571+0000", 2023-09-30T17:04:16.848 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.848 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.849 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.849 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.849 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.381520+0000", 2023-09-30T17:04:16.849 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039486770000000003 2023-09-30T17:04:16.849 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.849 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.849 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.849 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.381542+0000", 2023-09-30T17:04:16.849 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2249999999999999e-05 2023-09-30T17:04:16.849 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.849 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.849 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.850 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.381552+0000", 2023-09-30T17:04:16.850 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0193999999999999e-05 2023-09-30T17:04:16.850 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.850 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.850 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.850 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.381559+0000", 2023-09-30T17:04:16.850 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9260000000000003e-06 2023-09-30T17:04:16.850 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.850 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.850 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.850 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.850 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.851 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125417 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.851 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.401728+0000", 2023-09-30T17:04:16.851 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.169625634, 2023-09-30T17:04:16.851 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.18639376999999999, 2023-09-30T17:04:16.851 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.851 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.851 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.851 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.851 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.851 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125417 2023-09-30T17:04:16.851 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.852 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.852 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.852 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.852 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.401728+0000", 2023-09-30T17:04:16.852 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.852 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.852 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.852 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.852 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.401728+0000", 2023-09-30T17:04:16.852 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.852 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.853 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.853 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.853 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.405518+0000", 2023-09-30T17:04:16.853 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003789878 2023-09-30T17:04:16.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.853 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.853 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.854 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.405535+0000", 2023-09-30T17:04:16.854 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7614000000000001e-05 2023-09-30T17:04:16.854 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.854 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.854 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.854 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.405546+0000", 2023-09-30T17:04:16.854 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0645000000000001e-05 2023-09-30T17:04:16.854 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.854 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.854 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.854 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.405552+0000", 2023-09-30T17:04:16.855 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.268e-06 2023-09-30T17:04:16.855 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.855 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.855 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.855 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.855 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.855 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125602 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.855 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.467578+0000", 2023-09-30T17:04:16.855 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.10377603000000001, 2023-09-30T17:04:16.855 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.12059933, 2023-09-30T17:04:16.855 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.856 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.856 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.856 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.856 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.856 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125602 2023-09-30T17:04:16.856 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.856 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.856 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.856 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.467578+0000", 2023-09-30T17:04:16.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.857 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.857 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.467578+0000", 2023-09-30T17:04:16.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.857 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.857 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.858 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.467578+0000", 2023-09-30T17:04:16.858 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6300000000000005e-07 2023-09-30T17:04:16.858 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.858 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.858 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.858 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.467593+0000", 2023-09-30T17:04:16.858 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5119999999999999e-05 2023-09-30T17:04:16.858 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.858 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.859 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.859 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.467604+0000", 2023-09-30T17:04:16.859 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0807e-05 2023-09-30T17:04:16.859 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.859 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.859 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.859 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.467611+0000", 2023-09-30T17:04:16.859 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.939e-06 2023-09-30T17:04:16.859 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.859 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.860 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.860 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.860 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.860 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124663 4.6 e53/17)", 2023-09-30T17:04:16.860 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.522422+0000", 2023-09-30T17:04:16.860 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.048931784999999998, 2023-09-30T17:04:16.860 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.065806545999999994, 2023-09-30T17:04:16.860 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.860 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.861 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.861 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.861 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.861 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.522422+0000", 2023-09-30T17:04:16.861 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.861 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.861 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.861 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.861 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.522422+0000", 2023-09-30T17:04:16.862 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.862 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.862 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.862 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.862 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.522423+0000", 2023-09-30T17:04:16.862 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7499999999999998e-07 2023-09-30T17:04:16.862 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.862 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.862 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.863 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.522441+0000", 2023-09-30T17:04:16.863 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7869000000000001e-05 2023-09-30T17:04:16.863 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.863 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.863 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.863 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.522462+0000", 2023-09-30T17:04:16.863 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1223999999999999e-05 2023-09-30T17:04:16.863 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.863 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.864 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.864 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.522469+0000", 2023-09-30T17:04:16.864 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4250000000000001e-06 2023-09-30T17:04:16.864 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.864 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.864 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.864 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.865 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125792 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.865 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.552602+0000", 2023-09-30T17:04:16.865 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.018751259999999999, 2023-09-30T17:04:16.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.035672851999999998, 2023-09-30T17:04:16.865 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.865 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.865 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.865 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.866 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.866 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125792 2023-09-30T17:04:16.866 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.866 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.866 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.866 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.866 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.552602+0000", 2023-09-30T17:04:16.866 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.867 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.867 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.867 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.867 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.552602+0000", 2023-09-30T17:04:16.867 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.867 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.867 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.867 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.867 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.554515+0000", 2023-09-30T17:04:16.867 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019128719999999999 2023-09-30T17:04:16.867 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.868 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.554536+0000", 2023-09-30T17:04:16.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0794000000000001e-05 2023-09-30T17:04:16.868 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.868 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.554548+0000", 2023-09-30T17:04:16.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1622e-05 2023-09-30T17:04:16.868 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.869 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.554555+0000", 2023-09-30T17:04:16.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2069999999999998e-06 2023-09-30T17:04:16.869 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.869 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.869 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.869 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124798 4.6 e53/17)", 2023-09-30T17:04:16.869 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.566063+0000", 2023-09-30T17:04:16.869 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0052904340000000001, 2023-09-30T17:04:16.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022263535000000001, 2023-09-30T17:04:16.870 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.870 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.870 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.870 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.870 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.566063+0000", 2023-09-30T17:04:16.870 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.870 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.870 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.870 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.566063+0000", 2023-09-30T17:04:16.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.871 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.871 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.871 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.871 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.566064+0000", 2023-09-30T17:04:16.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1699999999999998e-07 2023-09-30T17:04:16.871 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.871 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.871 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.871 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.566083+0000", 2023-09-30T17:04:16.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8898000000000001e-05 2023-09-30T17:04:16.872 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.872 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.566094+0000", 2023-09-30T17:04:16.872 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1354e-05 2023-09-30T17:04:16.872 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.872 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.566101+0000", 2023-09-30T17:04:16.872 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6059999999999999e-06 2023-09-30T17:04:16.872 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.873 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.873 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.873 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.873 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.873 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125863 4.29 4:94178d8a:::100000001f8.00000006:head [write 2248704~4096 in=4096b,write 2502656~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.873 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.578726+0000", 2023-09-30T17:04:16.873 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9926276, 2023-09-30T17:04:16.873 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0096538790000000006, 2023-09-30T17:04:16.873 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.873 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:16.873 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.874 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.874 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.874 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125863 2023-09-30T17:04:16.874 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.874 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.874 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.874 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.874 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578726+0000", 2023-09-30T17:04:16.874 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.874 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.874 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.874 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.875 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578726+0000", 2023-09-30T17:04:16.875 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.875 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.875 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.875 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.875 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578726+0000", 2023-09-30T17:04:16.875 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4499999999999998e-07 2023-09-30T17:04:16.875 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.875 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.875 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.875 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578741+0000", 2023-09-30T17:04:16.876 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5313999999999999e-05 2023-09-30T17:04:16.876 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.876 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.876 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.876 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578747+0000", 2023-09-30T17:04:16.876 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8189999999999997e-06 2023-09-30T17:04:16.876 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.876 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.876 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.876 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578752+0000", 2023-09-30T17:04:16.877 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8060000000000002e-06 2023-09-30T17:04:16.877 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.877 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.877 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:16.877 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578878+0000", 2023-09-30T17:04:16.877 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012581800000000001 2023-09-30T17:04:16.877 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.877 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.877 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:16.877 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578953+0000", 2023-09-30T17:04:16.877 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4799e-05 2023-09-30T17:04:16.877 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.878 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.878 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.878 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.878 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.878 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:123560 4.36 e53/17 4:6fa85f86:::100000001f8.00000013:head v 53'5833, mlcod=53'5767)", 2023-09-30T17:04:16.878 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.078903+0000", 2023-09-30T17:04:16.878 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.49245081899999998, 2023-09-30T17:04:16.878 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.50955626899999995, 2023-09-30T17:04:16.878 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.878 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:16.879 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.879 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.879 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.879 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.078903+0000", 2023-09-30T17:04:16.879 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.879 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.879 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.879 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.879 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.078903+0000", 2023-09-30T17:04:16.879 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.879 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.879 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.880 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.880 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.078903+0000", 2023-09-30T17:04:16.890 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0699999999999999e-07 2023-09-30T17:04:16.890 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.890 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.890 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.890 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.078915+0000", 2023-09-30T17:04:16.891 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2485e-05 2023-09-30T17:04:16.891 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.891 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.891 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.891 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.078923+0000", 2023-09-30T17:04:16.891 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0929999999999997e-06 2023-09-30T17:04:16.891 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.891 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.891 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.891 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.078927+0000", 2023-09-30T17:04:16.892 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0509999999999998e-06 2023-09-30T17:04:16.892 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.892 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.892 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:16.892 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.566277+0000", 2023-09-30T17:04:16.892 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.48735067300000001 2023-09-30T17:04:16.892 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.892 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.892 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:16.893 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.566293+0000", 2023-09-30T17:04:16.893 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5812999999999999e-05 2023-09-30T17:04:16.893 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.893 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.893 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.893 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.893 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.893 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124639 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.893 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.117704+0000", 2023-09-30T17:04:16.893 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.453649523, 2023-09-30T17:04:16.893 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.47082835000000001, 2023-09-30T17:04:16.894 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.894 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.894 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.894 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.894 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.894 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124639 2023-09-30T17:04:16.894 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.895 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.895 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.895 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.895 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.117704+0000", 2023-09-30T17:04:16.895 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.895 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.895 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.895 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.895 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.117704+0000", 2023-09-30T17:04:16.896 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.896 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.896 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.896 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.896 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.117705+0000", 2023-09-30T17:04:16.896 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1200000000000003e-07 2023-09-30T17:04:16.896 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.896 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.896 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.896 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.117720+0000", 2023-09-30T17:04:16.897 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5603e-05 2023-09-30T17:04:16.897 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.897 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.897 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.897 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.117727+0000", 2023-09-30T17:04:16.897 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8109999999999997e-06 2023-09-30T17:04:16.897 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.897 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.898 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.898 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.117733+0000", 2023-09-30T17:04:16.898 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7649999999999999e-06 2023-09-30T17:04:16.898 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.898 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.898 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.898 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.899 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.899 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:123844 4.6 e53/17)", 2023-09-30T17:04:16.899 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.222621+0000", 2023-09-30T17:04:16.899 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.34873241599999999, 2023-09-30T17:04:16.899 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.36596462200000002, 2023-09-30T17:04:16.899 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.899 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.899 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.899 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.900 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.900 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.222621+0000", 2023-09-30T17:04:16.900 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.900 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.901 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.901 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.901 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.222621+0000", 2023-09-30T17:04:16.902 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.902 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.902 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.902 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.902 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.222622+0000", 2023-09-30T17:04:16.902 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1300000000000001e-07 2023-09-30T17:04:16.902 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.902 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.902 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.903 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.222633+0000", 2023-09-30T17:04:16.903 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1824999999999999e-05 2023-09-30T17:04:16.903 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.903 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.903 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.903 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.222641+0000", 2023-09-30T17:04:16.903 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7519999999999996e-06 2023-09-30T17:04:16.903 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.903 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.903 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.903 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.222647+0000", 2023-09-30T17:04:16.903 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.947e-06 2023-09-30T17:04:16.904 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.904 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.904 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.904 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.904 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.904 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125015 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.904 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.260712+0000", 2023-09-30T17:04:16.904 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.310641954, 2023-09-30T17:04:16.904 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.32792402199999998, 2023-09-30T17:04:16.904 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.905 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.905 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.905 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.905 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.905 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125015 2023-09-30T17:04:16.905 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.905 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.905 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.905 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.905 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.260712+0000", 2023-09-30T17:04:16.905 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.905 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.906 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.906 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.906 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.260712+0000", 2023-09-30T17:04:16.906 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.906 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.906 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.906 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.906 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.260712+0000", 2023-09-30T17:04:16.906 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5699999999999998e-07 2023-09-30T17:04:16.906 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.906 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.907 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.907 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.260726+0000", 2023-09-30T17:04:16.907 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4154e-05 2023-09-30T17:04:16.907 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.907 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.907 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.907 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.260733+0000", 2023-09-30T17:04:16.907 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6839999999999999e-06 2023-09-30T17:04:16.907 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.907 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.907 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.908 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.260739+0000", 2023-09-30T17:04:16.908 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3219999999999998e-06 2023-09-30T17:04:16.908 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.908 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.908 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.908 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.908 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.908 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:123974 4.36 e53/17)", 2023-09-30T17:04:16.908 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.286765+0000", 2023-09-30T17:04:16.909 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.28458824199999999, 2023-09-30T17:04:16.909 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.301922735, 2023-09-30T17:04:16.909 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.909 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.909 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.909 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.909 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.909 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.286765+0000", 2023-09-30T17:04:16.909 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.909 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.909 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.910 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.910 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.286765+0000", 2023-09-30T17:04:16.910 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.910 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.910 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.910 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.910 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.286766+0000", 2023-09-30T17:04:16.910 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6899999999999998e-07 2023-09-30T17:04:16.910 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.910 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.911 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.911 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.286782+0000", 2023-09-30T17:04:16.911 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6294e-05 2023-09-30T17:04:16.911 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.911 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.911 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.911 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.286793+0000", 2023-09-30T17:04:16.916 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1368e-05 2023-09-30T17:04:16.916 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.916 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.916 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.916 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.286801+0000", 2023-09-30T17:04:16.917 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3769999999999998e-06 2023-09-30T17:04:16.917 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.917 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.917 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.917 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.917 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.917 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125220 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.917 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.331985+0000", 2023-09-30T17:04:16.917 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.23936822299999999, 2023-09-30T17:04:16.917 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.25675440199999999, 2023-09-30T17:04:16.918 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.918 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.918 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.918 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.918 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.918 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125220 2023-09-30T17:04:16.918 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.918 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.918 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.918 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.919 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.331985+0000", 2023-09-30T17:04:16.919 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.919 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.919 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.919 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.919 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.331985+0000", 2023-09-30T17:04:16.919 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.919 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.919 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.919 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.919 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.331986+0000", 2023-09-30T17:04:16.919 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4000000000000002e-07 2023-09-30T17:04:16.920 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.920 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.920 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.920 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.332001+0000", 2023-09-30T17:04:16.920 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5692000000000002e-05 2023-09-30T17:04:16.920 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.920 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.920 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.920 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.332008+0000", 2023-09-30T17:04:16.920 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7689999999999999e-06 2023-09-30T17:04:16.921 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.921 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.921 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.921 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.332014+0000", 2023-09-30T17:04:16.921 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5310000000000001e-06 2023-09-30T17:04:16.921 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.921 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.921 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.921 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.922 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.922 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125350 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.922 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.381571+0000", 2023-09-30T17:04:16.922 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.189782908, 2023-09-30T17:04:16.922 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.20722550000000001, 2023-09-30T17:04:16.922 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.922 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.922 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.922 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.922 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.922 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125350 2023-09-30T17:04:16.923 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.923 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.923 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.923 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.923 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.381571+0000", 2023-09-30T17:04:16.923 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.923 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.923 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.923 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.923 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.381571+0000", 2023-09-30T17:04:16.923 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.924 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.924 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.924 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.924 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.381571+0000", 2023-09-30T17:04:16.924 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1099999999999996e-07 2023-09-30T17:04:16.924 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.924 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.924 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.924 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.381583+0000", 2023-09-30T17:04:16.924 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1335000000000001e-05 2023-09-30T17:04:16.924 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.924 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.924 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.925 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.381589+0000", 2023-09-30T17:04:16.925 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1909999999999997e-06 2023-09-30T17:04:16.925 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.925 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.925 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.925 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.381594+0000", 2023-09-30T17:04:16.925 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7999999999999998e-06 2023-09-30T17:04:16.925 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.925 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.925 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.925 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.926 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.926 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124235 4.6 e53/17)", 2023-09-30T17:04:16.926 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.405930+0000", 2023-09-30T17:04:16.926 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.16542358600000001, 2023-09-30T17:04:16.926 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.18291675600000001, 2023-09-30T17:04:16.926 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.926 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.926 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.927 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.927 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.927 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.405930+0000", 2023-09-30T17:04:16.927 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.927 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.927 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.927 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.927 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.405930+0000", 2023-09-30T17:04:16.927 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.927 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.927 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.928 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.928 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.405930+0000", 2023-09-30T17:04:16.928 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7100000000000002e-07 2023-09-30T17:04:16.928 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.928 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.928 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.928 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.405945+0000", 2023-09-30T17:04:16.928 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4211e-05 2023-09-30T17:04:16.928 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.929 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.929 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.929 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.405953+0000", 2023-09-30T17:04:16.929 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.439e-06 2023-09-30T17:04:16.929 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.929 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.929 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.929 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.405959+0000", 2023-09-30T17:04:16.930 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0650000000000004e-06 2023-09-30T17:04:16.930 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.930 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.930 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.930 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.930 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.930 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124402 4.2e e53/17)", 2023-09-30T17:04:16.930 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.441258+0000", 2023-09-30T17:04:16.930 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.13009567599999999, 2023-09-30T17:04:16.930 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.14763807600000001, 2023-09-30T17:04:16.931 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.931 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.931 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.931 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.931 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.931 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.441258+0000", 2023-09-30T17:04:16.931 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.931 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.931 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.932 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.932 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.441258+0000", 2023-09-30T17:04:16.932 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.932 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.932 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.932 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.932 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.441259+0000", 2023-09-30T17:04:16.932 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4130000000000001e-06 2023-09-30T17:04:16.932 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.933 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.933 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.933 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.441279+0000", 2023-09-30T17:04:16.933 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0125000000000001e-05 2023-09-30T17:04:16.933 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.933 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.933 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.933 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.441287+0000", 2023-09-30T17:04:16.933 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6179999999999997e-06 2023-09-30T17:04:16.934 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.934 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.934 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.934 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.441294+0000", 2023-09-30T17:04:16.934 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8199999999999999e-06 2023-09-30T17:04:16.934 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.934 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.934 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.935 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.935 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.935 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125554 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.935 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.455663+0000", 2023-09-30T17:04:16.935 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.11569064, 2023-09-30T17:04:16.935 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.13328905599999999, 2023-09-30T17:04:16.935 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.935 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.936 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.936 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.936 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.936 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125554 2023-09-30T17:04:16.936 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.936 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.936 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.936 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.937 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.455663+0000", 2023-09-30T17:04:16.937 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.937 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.937 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.937 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.937 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.455663+0000", 2023-09-30T17:04:16.937 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.938 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.938 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.938 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.938 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.455664+0000", 2023-09-30T17:04:16.938 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1699999999999997e-07 2023-09-30T17:04:16.938 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.938 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.938 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.939 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.455691+0000", 2023-09-30T17:04:16.939 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7353999999999999e-05 2023-09-30T17:04:16.939 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.939 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.939 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.939 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.455700+0000", 2023-09-30T17:04:16.939 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7390000000000005e-06 2023-09-30T17:04:16.939 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.939 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.939 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.940 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.455706+0000", 2023-09-30T17:04:16.940 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5889999999999999e-06 2023-09-30T17:04:16.940 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.940 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.940 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.940 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.940 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.940 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124527 4.6 e53/17)", 2023-09-30T17:04:16.940 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.469264+0000", 2023-09-30T17:04:16.940 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.10208961900000001, 2023-09-30T17:04:16.940 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.119760566, 2023-09-30T17:04:16.941 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.941 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.941 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.941 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.941 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.941 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.469264+0000", 2023-09-30T17:04:16.941 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.941 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.941 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.941 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.941 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.469264+0000", 2023-09-30T17:04:16.942 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.942 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.942 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.942 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.942 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.469265+0000", 2023-09-30T17:04:16.942 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4000000000000001e-07 2023-09-30T17:04:16.942 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.942 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.942 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.942 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.469282+0000", 2023-09-30T17:04:16.942 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7306999999999999e-05 2023-09-30T17:04:16.942 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.943 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.943 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.943 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.469294+0000", 2023-09-30T17:04:16.943 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2130000000000001e-05 2023-09-30T17:04:16.943 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.943 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.943 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.943 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.469301+0000", 2023-09-30T17:04:16.943 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8580000000000002e-06 2023-09-30T17:04:16.944 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.944 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.944 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.944 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.944 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.944 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124667 4.36 e53/17)", 2023-09-30T17:04:16.944 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.522514+0000", 2023-09-30T17:04:16.944 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.048839117000000001, 2023-09-30T17:04:16.944 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.066567676000000006, 2023-09-30T17:04:16.944 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.944 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.945 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.945 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.945 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.945 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.522514+0000", 2023-09-30T17:04:16.945 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.945 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.945 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.945 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.945 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.522514+0000", 2023-09-30T17:04:16.945 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.945 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.946 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.946 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.946 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.522515+0000", 2023-09-30T17:04:16.946 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0500000000000004e-07 2023-09-30T17:04:16.946 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.946 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.946 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.946 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.522530+0000", 2023-09-30T17:04:16.946 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5515e-05 2023-09-30T17:04:16.946 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.946 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.946 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.947 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.522539+0000", 2023-09-30T17:04:16.947 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8799999999999997e-06 2023-09-30T17:04:16.947 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.947 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.947 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.947 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.522545+0000", 2023-09-30T17:04:16.947 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1429999999999997e-06 2023-09-30T17:04:16.947 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.947 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.948 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.948 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.948 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.948 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125793 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.948 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.554568+0000", 2023-09-30T17:04:16.948 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.016785897000000001, 2023-09-30T17:04:16.948 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.034567922000000001, 2023-09-30T17:04:16.948 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.948 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.948 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.949 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.949 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.949 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125793 2023-09-30T17:04:16.949 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.949 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.949 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.949 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.949 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.554568+0000", 2023-09-30T17:04:16.949 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.949 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.949 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.950 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.950 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.554568+0000", 2023-09-30T17:04:16.950 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.950 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.950 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.950 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.950 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.554568+0000", 2023-09-30T17:04:16.950 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2699999999999999e-07 2023-09-30T17:04:16.950 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.950 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.950 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.951 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.554587+0000", 2023-09-30T17:04:16.951 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9131e-05 2023-09-30T17:04:16.951 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.951 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.951 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.951 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.554603+0000", 2023-09-30T17:04:16.951 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5673999999999999e-05 2023-09-30T17:04:16.951 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.951 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.952 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.952 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.554610+0000", 2023-09-30T17:04:16.952 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2080000000000003e-06 2023-09-30T17:04:16.952 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.952 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.952 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.952 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.952 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.952 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125864 4.12 4:48ab9bde:::100000001f8.00000015:head [write 1568768~4096 in=4096b,write 1589248~4096 in=4096b,write 2613248~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.952 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.578762+0000", 2023-09-30T17:04:16.953 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9925919, 2023-09-30T17:04:16.953 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010447602, 2023-09-30T17:04:16.953 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.953 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:16.953 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.953 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.953 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.953 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125864 2023-09-30T17:04:16.953 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.953 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.953 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.954 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.954 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578762+0000", 2023-09-30T17:04:16.954 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.954 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.954 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.954 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.954 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578762+0000", 2023-09-30T17:04:16.954 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.954 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.954 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.955 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.955 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578762+0000", 2023-09-30T17:04:16.955 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1199999999999998e-07 2023-09-30T17:04:16.955 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.955 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.955 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.955 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578775+0000", 2023-09-30T17:04:16.955 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2986000000000001e-05 2023-09-30T17:04:16.955 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.955 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.955 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.955 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578781+0000", 2023-09-30T17:04:16.956 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2439999999999998e-06 2023-09-30T17:04:16.956 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.956 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.956 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.956 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578786+0000", 2023-09-30T17:04:16.956 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6800000000000001e-06 2023-09-30T17:04:16.956 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.956 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.956 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:16.956 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578831+0000", 2023-09-30T17:04:16.956 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5284999999999998e-05 2023-09-30T17:04:16.957 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.957 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.957 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:16.957 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578900+0000", 2023-09-30T17:04:16.957 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8361000000000005e-05 2023-09-30T17:04:16.957 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.957 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.957 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:16.957 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.579033+0000", 2023-09-30T17:04:16.957 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000133466 2023-09-30T17:04:16.957 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.958 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.958 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.958 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.958 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.958 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124968 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.958 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.250561+0000", 2023-09-30T17:04:16.958 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.32079244099999998, 2023-09-30T17:04:16.958 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.33873386500000002, 2023-09-30T17:04:16.958 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.958 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.958 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.958 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.959 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.959 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124968 2023-09-30T17:04:16.959 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.959 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.959 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.959 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.959 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.250561+0000", 2023-09-30T17:04:16.959 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.959 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.959 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.960 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.960 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.250561+0000", 2023-09-30T17:04:16.960 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.960 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.960 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.960 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.960 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.250562+0000", 2023-09-30T17:04:16.960 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1799999999999995e-07 2023-09-30T17:04:16.960 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.960 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.961 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.961 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.250581+0000", 2023-09-30T17:04:16.961 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9578000000000001e-05 2023-09-30T17:04:16.961 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.961 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.961 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.961 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.250592+0000", 2023-09-30T17:04:16.961 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0361e-05 2023-09-30T17:04:16.962 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.962 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.962 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.962 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.250598+0000", 2023-09-30T17:04:16.962 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0009999999999998e-06 2023-09-30T17:04:16.962 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.962 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.962 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.962 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.962 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.962 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124185 4.36 e53/17)", 2023-09-30T17:04:16.963 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.392171+0000", 2023-09-30T17:04:16.963 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.179182393, 2023-09-30T17:04:16.963 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.19718306399999999, 2023-09-30T17:04:16.963 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.963 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.963 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.963 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.963 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.963 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.392171+0000", 2023-09-30T17:04:16.963 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.964 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.964 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.964 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.964 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.392171+0000", 2023-09-30T17:04:16.964 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.964 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.964 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.964 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.964 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.392172+0000", 2023-09-30T17:04:16.965 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.82e-07 2023-09-30T17:04:16.965 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.965 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.965 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.965 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.392184+0000", 2023-09-30T17:04:16.965 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2317000000000001e-05 2023-09-30T17:04:16.965 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.965 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.965 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.965 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.392193+0000", 2023-09-30T17:04:16.966 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2820000000000002e-06 2023-09-30T17:04:16.966 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.966 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.966 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.966 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.392198+0000", 2023-09-30T17:04:16.966 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6940000000000003e-06 2023-09-30T17:04:16.966 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.966 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.966 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.967 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.967 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.967 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124398 4.6 e53/17)", 2023-09-30T17:04:16.967 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.441311+0000", 2023-09-30T17:04:16.967 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.13004209, 2023-09-30T17:04:16.967 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.14810193099999999, 2023-09-30T17:04:16.967 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.967 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.967 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.968 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.968 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.968 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.441311+0000", 2023-09-30T17:04:16.968 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.968 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.968 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.968 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.968 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.441311+0000", 2023-09-30T17:04:16.968 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.969 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.969 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.969 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.969 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.441312+0000", 2023-09-30T17:04:16.969 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3299999999999998e-07 2023-09-30T17:04:16.969 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.969 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.969 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.970 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.441326+0000", 2023-09-30T17:04:16.970 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4633e-05 2023-09-30T17:04:16.970 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.970 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.970 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.970 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.441335+0000", 2023-09-30T17:04:16.970 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.089e-06 2023-09-30T17:04:16.970 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.971 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.971 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.971 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.441339+0000", 2023-09-30T17:04:16.971 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3970000000000004e-06 2023-09-30T17:04:16.971 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.971 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.971 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.971 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.971 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.972 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124530 4.36 e53/17)", 2023-09-30T17:04:16.972 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.469316+0000", 2023-09-30T17:04:16.972 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.10203781100000001, 2023-09-30T17:04:16.972 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.120150881, 2023-09-30T17:04:16.972 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.972 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.972 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.973 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.973 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.973 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.469316+0000", 2023-09-30T17:04:16.973 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.973 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.973 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.973 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.973 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.469316+0000", 2023-09-30T17:04:16.974 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.974 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.974 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.974 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.974 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.469316+0000", 2023-09-30T17:04:16.974 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.03e-07 2023-09-30T17:04:16.974 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.974 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.974 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.975 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.469331+0000", 2023-09-30T17:04:16.975 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4732999999999999e-05 2023-09-30T17:04:16.975 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.975 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.975 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.975 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.469337+0000", 2023-09-30T17:04:16.975 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3029999999999996e-06 2023-09-30T17:04:16.975 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.975 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.975 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.975 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.469342+0000", 2023-09-30T17:04:16.976 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4880000000000001e-06 2023-09-30T17:04:16.976 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.976 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.976 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.976 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.976 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.976 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125730 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.976 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.518569+0000", 2023-09-30T17:04:16.976 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.052784154, 2023-09-30T17:04:16.976 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.070954473000000004, 2023-09-30T17:04:16.976 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.976 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.977 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.977 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.977 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.977 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125730 2023-09-30T17:04:16.977 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.977 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.977 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.977 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.977 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.518569+0000", 2023-09-30T17:04:16.977 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.978 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.978 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.978 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.978 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.518569+0000", 2023-09-30T17:04:16.978 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.978 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.978 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.978 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.978 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.522556+0000", 2023-09-30T17:04:16.978 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039870499999999998 2023-09-30T17:04:16.979 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.979 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.979 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.979 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.522571+0000", 2023-09-30T17:04:16.979 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4640999999999999e-05 2023-09-30T17:04:16.979 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.979 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.979 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.979 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.522579+0000", 2023-09-30T17:04:16.979 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7370000000000006e-06 2023-09-30T17:04:16.979 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.980 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.980 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.980 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.522584+0000", 2023-09-30T17:04:16.980 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3800000000000002e-06 2023-09-30T17:04:16.980 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.980 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.980 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.980 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.980 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.980 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:125221 4.28 e53/17 4:15eeb89b:::100000001f8.00000032:head v 53'3852, mlcod=53'3847)", 2023-09-30T17:04:16.980 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.568655+0000", 2023-09-30T17:04:16.981 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0026984069999999999, 2023-09-30T17:04:16.981 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020901691, 2023-09-30T17:04:16.981 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.981 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:16.981 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.981 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.981 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.981 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.568655+0000", 2023-09-30T17:04:16.981 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.982 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.982 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.982 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.982 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.568655+0000", 2023-09-30T17:04:16.982 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.982 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.982 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.982 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.982 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.568656+0000", 2023-09-30T17:04:16.982 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8099999999999998e-07 2023-09-30T17:04:16.983 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.983 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.983 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.983 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.568669+0000", 2023-09-30T17:04:16.983 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3876999999999999e-05 2023-09-30T17:04:16.983 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.983 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.983 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.983 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.568678+0000", 2023-09-30T17:04:16.983 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1419999999999993e-06 2023-09-30T17:04:16.983 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.984 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.984 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.984 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.568683+0000", 2023-09-30T17:04:16.984 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.682e-06 2023-09-30T17:04:16.984 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.984 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.984 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:16.984 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.575608+0000", 2023-09-30T17:04:16.984 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0069243969999999997 2023-09-30T17:04:16.984 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.985 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.985 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:16.985 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.575626+0000", 2023-09-30T17:04:16.985 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8023e-05 2023-09-30T17:04:16.985 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.985 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.985 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.985 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.985 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.985 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:125252 4.28 e53/17 4:15eeb89b:::100000001f8.00000032:head v 53'3855, mlcod=53'3847)", 2023-09-30T17:04:16.986 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.578838+0000", 2023-09-30T17:04:16.986 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9925151, 2023-09-30T17:04:16.986 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010753741000000001, 2023-09-30T17:04:16.986 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.986 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:16.986 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.986 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.986 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.986 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578838+0000", 2023-09-30T17:04:16.986 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.986 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.987 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.987 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.987 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578838+0000", 2023-09-30T17:04:16.987 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.987 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.987 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.987 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.987 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578839+0000", 2023-09-30T17:04:16.987 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.75e-07 2023-09-30T17:04:16.987 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.987 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.988 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.988 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578852+0000", 2023-09-30T17:04:16.988 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.275e-05 2023-09-30T17:04:16.988 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.988 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.988 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578859+0000", 2023-09-30T17:04:16.988 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3969999999999997e-06 2023-09-30T17:04:16.988 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.988 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.988 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578865+0000", 2023-09-30T17:04:16.989 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5520000000000004e-06 2023-09-30T17:04:16.989 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.989 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.989 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:16.989 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.586118+0000", 2023-09-30T17:04:16.989 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072531119999999999 2023-09-30T17:04:16.989 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.989 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.989 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:16.989 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.586141+0000", 2023-09-30T17:04:16.989 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2955e-05 2023-09-30T17:04:16.990 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.990 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.990 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.990 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.990 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.990 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:123581 4.6 e53/17 4:635f8cb4:::100000001f8.0000003c:head v 53'7596, mlcod=53'7510)", 2023-09-30T17:04:16.990 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.078959+0000", 2023-09-30T17:04:16.990 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.49239414199999998, 2023-09-30T17:04:16.990 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.51068080599999999, 2023-09-30T17:04:16.990 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.990 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:16.990 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.991 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.991 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.991 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.078959+0000", 2023-09-30T17:04:16.991 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.991 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.991 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.991 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.991 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.078959+0000", 2023-09-30T17:04:16.991 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.991 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.991 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.991 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.992 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.078960+0000", 2023-09-30T17:04:16.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.99e-07 2023-09-30T17:04:16.992 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.992 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.078971+0000", 2023-09-30T17:04:16.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0981999999999999e-05 2023-09-30T17:04:16.992 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.992 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.078977+0000", 2023-09-30T17:04:16.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7390000000000002e-06 2023-09-30T17:04:16.993 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.993 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.993 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.993 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.078981+0000", 2023-09-30T17:04:16.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0910000000000003e-06 2023-09-30T17:04:16.993 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.993 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.993 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:16.993 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.566270+0000", 2023-09-30T17:04:16.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.48728809499999998 2023-09-30T17:04:16.993 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.994 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.994 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:16.994 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.566288+0000", 2023-09-30T17:04:16.994 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8036000000000001e-05 2023-09-30T17:04:16.994 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.994 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.994 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.994 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.994 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.994 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124561 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:16.994 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.086761+0000", 2023-09-30T17:04:16.995 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.48459256299999998, 2023-09-30T17:04:16.995 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.50294854899999997, 2023-09-30T17:04:16.995 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.995 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.995 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:16.995 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:16.995 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:16.995 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124561 2023-09-30T17:04:16.995 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.995 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.995 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.996 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:16.996 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.086761+0000", 2023-09-30T17:04:16.996 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.996 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.996 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:16.996 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.086761+0000", 2023-09-30T17:04:16.996 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:16.996 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.997 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:16.997 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.086761+0000", 2023-09-30T17:04:16.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.65e-07 2023-09-30T17:04:16.997 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.997 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:16.997 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.086781+0000", 2023-09-30T17:04:16.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9979999999999998e-05 2023-09-30T17:04:16.997 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.998 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:16.998 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.086788+0000", 2023-09-30T17:04:16.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4899999999999997e-06 2023-09-30T17:04:16.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.998 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:16.998 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.086793+0000", 2023-09-30T17:04:16.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.955e-06 2023-09-30T17:04:16.998 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.998 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:16.998 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:16.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:16.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.999 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:123700 4.2e e53/17)", 2023-09-30T17:04:16.999 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.151604+0000", 2023-09-30T17:04:16.999 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.41974963799999998, 2023-09-30T17:04:16.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.43816675100000002, 2023-09-30T17:04:16.999 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:16.999 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:16.999 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:16.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:16.999 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:17.000 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.151604+0000", 2023-09-30T17:04:17.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:17.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.000 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:17.000 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.151604+0000", 2023-09-30T17:04:17.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:17.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.001 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:17.001 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.151604+0000", 2023-09-30T17:04:17.001 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4600000000000005e-07 2023-09-30T17:04:17.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.001 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:17.001 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.151655+0000", 2023-09-30T17:04:17.001 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0862000000000002e-05 2023-09-30T17:04:17.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.002 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:17.002 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.151665+0000", 2023-09-30T17:04:17.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2909999999999996e-06 2023-09-30T17:04:17.002 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.002 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:17.002 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.151671+0000", 2023-09-30T17:04:17.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4130000000000003e-06 2023-09-30T17:04:17.003 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:17.003 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:17.003 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:17.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.003 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.003 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:124859 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:17.003 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.191018+0000", 2023-09-30T17:04:17.003 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.38033586000000003, 2023-09-30T17:04:17.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.398801299, 2023-09-30T17:04:17.003 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:17.004 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:17.004 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:17.004 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:17.004 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:17.004 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 124859 2023-09-30T17:04:17.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.004 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:17.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:17.005 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.191018+0000", 2023-09-30T17:04:17.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:17.005 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.005 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:17.005 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.191018+0000", 2023-09-30T17:04:17.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:17.005 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.006 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:17.006 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.192514+0000", 2023-09-30T17:04:17.006 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001496491 2023-09-30T17:04:17.006 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.006 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:17.006 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.192530+0000", 2023-09-30T17:04:17.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5461999999999999e-05 2023-09-30T17:04:17.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.007 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:17.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.192543+0000", 2023-09-30T17:04:17.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3162e-05 2023-09-30T17:04:17.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.007 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:17.008 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.192551+0000", 2023-09-30T17:04:17.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8359999999999992e-06 2023-09-30T17:04:17.008 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:17.008 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:17.008 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:17.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.008 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125077 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:17.008 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.283563+0000", 2023-09-30T17:04:17.009 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.28779089800000002, 2023-09-30T17:04:17.009 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.30630878700000003, 2023-09-30T17:04:17.009 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:17.009 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:17.009 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:17.009 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:17.009 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:17.010 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125077 2023-09-30T17:04:17.010 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.010 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:17.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.010 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:17.010 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.283563+0000", 2023-09-30T17:04:17.010 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:17.010 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:17.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.283563+0000", 2023-09-30T17:04:17.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:17.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:17.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.287519+0000", 2023-09-30T17:04:17.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039563319999999999 2023-09-30T17:04:17.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:17.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.287535+0000", 2023-09-30T17:04:17.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5631e-05 2023-09-30T17:04:17.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:17.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.287544+0000", 2023-09-30T17:04:17.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3759999999999997e-06 2023-09-30T17:04:17.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.013 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:17.013 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.287556+0000", 2023-09-30T17:04:17.013 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1524e-05 2023-09-30T17:04:17.013 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:17.013 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:17.013 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:17.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.013 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124098 4.36 e53/17)", 2023-09-30T17:04:17.014 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.359553+0000", 2023-09-30T17:04:17.014 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.211800666, 2023-09-30T17:04:17.014 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.23036795299999999, 2023-09-30T17:04:17.014 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:17.014 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:17.014 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:17.014 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.014 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:17.014 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.359553+0000", 2023-09-30T17:04:17.014 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:17.014 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:17.015 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.359553+0000", 2023-09-30T17:04:17.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:17.015 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:17.015 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.359553+0000", 2023-09-30T17:04:17.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2499999999999999e-07 2023-09-30T17:04:17.015 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:17.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.359565+0000", 2023-09-30T17:04:17.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1681e-05 2023-09-30T17:04:17.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:17.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.359570+0000", 2023-09-30T17:04:17.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3109999999999996e-06 2023-09-30T17:04:17.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:17.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.359574+0000", 2023-09-30T17:04:17.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1280000000000001e-06 2023-09-30T17:04:17.017 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:17.017 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:17.017 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:17.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.017 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125338 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:17.017 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.368785+0000", 2023-09-30T17:04:17.017 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.20256814300000001, 2023-09-30T17:04:17.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.22118069000000001, 2023-09-30T17:04:17.017 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:17.018 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:17.018 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:17.018 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:17.018 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:17.018 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125338 2023-09-30T17:04:17.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.018 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:17.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.018 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:17.018 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.368785+0000", 2023-09-30T17:04:17.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:17.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.019 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:17.019 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.368785+0000", 2023-09-30T17:04:17.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:17.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.019 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:17.019 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.370516+0000", 2023-09-30T17:04:17.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001731011 2023-09-30T17:04:17.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:17.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.370530+0000", 2023-09-30T17:04:17.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3633e-05 2023-09-30T17:04:17.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:17.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.370538+0000", 2023-09-30T17:04:17.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8399999999999995e-06 2023-09-30T17:04:17.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:17.021 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.370543+0000", 2023-09-30T17:04:17.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5600000000000001e-06 2023-09-30T17:04:17.021 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:17.021 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:17.021 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:17.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.021 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125352 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:17.021 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.381636+0000", 2023-09-30T17:04:17.021 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.18971798300000001, 2023-09-30T17:04:17.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.208381344, 2023-09-30T17:04:17.022 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:17.022 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:17.022 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:17.022 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:17.022 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:17.022 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125352 2023-09-30T17:04:17.022 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.022 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:17.022 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.022 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:17.022 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.381636+0000", 2023-09-30T17:04:17.022 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:17.023 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.023 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.023 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:17.023 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.381636+0000", 2023-09-30T17:04:17.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:17.023 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.023 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.023 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:17.023 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.381636+0000", 2023-09-30T17:04:17.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.39e-07 2023-09-30T17:04:17.023 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.024 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:17.024 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.381651+0000", 2023-09-30T17:04:17.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5321000000000001e-05 2023-09-30T17:04:17.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.024 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:17.024 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.381658+0000", 2023-09-30T17:04:17.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2260000000000002e-06 2023-09-30T17:04:17.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.025 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:17.025 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.381662+0000", 2023-09-30T17:04:17.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.746e-06 2023-09-30T17:04:17.025 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:17.025 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:17.025 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:17.025 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.025 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.025 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124199 4.6 e53/17)", 2023-09-30T17:04:17.025 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.392777+0000", 2023-09-30T17:04:17.025 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.17857626200000001, 2023-09-30T17:04:17.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.19729554199999999, 2023-09-30T17:04:17.026 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:17.026 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:17.026 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:17.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.026 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:17.026 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.392777+0000", 2023-09-30T17:04:17.026 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:17.026 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.026 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:17.027 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.392777+0000", 2023-09-30T17:04:17.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:17.027 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.027 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:17.027 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.392778+0000", 2023-09-30T17:04:17.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4700000000000001e-07 2023-09-30T17:04:17.027 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.027 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:17.027 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.392791+0000", 2023-09-30T17:04:17.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3431000000000001e-05 2023-09-30T17:04:17.028 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.028 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.028 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:17.028 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.392800+0000", 2023-09-30T17:04:17.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4230000000000005e-06 2023-09-30T17:04:17.028 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.028 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.028 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:17.028 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.392808+0000", 2023-09-30T17:04:17.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8380000000000002e-06 2023-09-30T17:04:17.029 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:17.029 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:17.029 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:17.029 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.029 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124365 4.36 e53/17)", 2023-09-30T17:04:17.029 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.427616+0000", 2023-09-30T17:04:17.029 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.14373724600000001, 2023-09-30T17:04:17.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.16249918099999999, 2023-09-30T17:04:17.029 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:17.029 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:17.029 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:17.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.030 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:17.030 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.427616+0000", 2023-09-30T17:04:17.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:17.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.030 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:17.030 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.427616+0000", 2023-09-30T17:04:17.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:17.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:17.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.427617+0000", 2023-09-30T17:04:17.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2099999999999997e-07 2023-09-30T17:04:17.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:17.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.427629+0000", 2023-09-30T17:04:17.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2591e-05 2023-09-30T17:04:17.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:17.032 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.427639+0000", 2023-09-30T17:04:17.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2650000000000002e-06 2023-09-30T17:04:17.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.032 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:17.032 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.427646+0000", 2023-09-30T17:04:17.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9739999999999996e-06 2023-09-30T17:04:17.032 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:17.032 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:17.032 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:17.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.033 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.033 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124430 4.36 e53/17)", 2023-09-30T17:04:17.033 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.448287+0000", 2023-09-30T17:04:17.033 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.12306614, 2023-09-30T17:04:17.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.14187049700000001, 2023-09-30T17:04:17.033 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:17.033 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:17.033 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:17.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.034 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:17.034 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.448287+0000", 2023-09-30T17:04:17.034 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:17.034 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.034 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:17.034 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.448287+0000", 2023-09-30T17:04:17.034 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:17.034 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.035 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.035 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:17.035 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.448289+0000", 2023-09-30T17:04:17.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.111e-06 2023-09-30T17:04:17.035 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.035 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.035 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:17.035 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.448308+0000", 2023-09-30T17:04:17.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9466999999999998e-05 2023-09-30T17:04:17.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:17.036 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.448318+0000", 2023-09-30T17:04:17.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8619999999999998e-06 2023-09-30T17:04:17.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:17.036 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.448327+0000", 2023-09-30T17:04:17.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9209999999999998e-06 2023-09-30T17:04:17.037 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:17.037 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:17.037 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:17.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.037 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124605 4.6 e53/17)", 2023-09-30T17:04:17.037 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.502748+0000", 2023-09-30T17:04:17.037 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.068605607999999998, 2023-09-30T17:04:17.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.087452109, 2023-09-30T17:04:17.038 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:17.038 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:17.038 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:17.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.038 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:17.038 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.502748+0000", 2023-09-30T17:04:17.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:17.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.039 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:17.039 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.502748+0000", 2023-09-30T17:04:17.039 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:17.048 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.048 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.048 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:17.048 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.502749+0000", 2023-09-30T17:04:17.048 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7899999999999998e-07 2023-09-30T17:04:17.048 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.049 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.049 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:17.049 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.502844+0000", 2023-09-30T17:04:17.049 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5136999999999994e-05 2023-09-30T17:04:17.049 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.049 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.049 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:17.049 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.502853+0000", 2023-09-30T17:04:17.049 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0229999999999998e-06 2023-09-30T17:04:17.049 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.049 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.049 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:17.050 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.502859+0000", 2023-09-30T17:04:17.050 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2979999999999997e-06 2023-09-30T17:04:17.050 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:17.050 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:17.050 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:17.050 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.050 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.050 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:125823 4.38 4.e1fdc8b8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e52)", 2023-09-30T17:04:17.050 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.565598+0000", 2023-09-30T17:04:17.050 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0057553279999999997, 2023-09-30T17:04:17.050 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.024647273000000001, 2023-09-30T17:04:17.051 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:17.051 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:17.051 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:17.051 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:17.051 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:17.051 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 125823 2023-09-30T17:04:17.051 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.051 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:17.051 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.051 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:17.051 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.565598+0000", 2023-09-30T17:04:17.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:17.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.052 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:17.052 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.565598+0000", 2023-09-30T17:04:17.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:17.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.052 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:17.052 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.568697+0000", 2023-09-30T17:04:17.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0030991489999999998 2023-09-30T17:04:17.053 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.053 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.053 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:17.053 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.568723+0000", 2023-09-30T17:04:17.053 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5134e-05 2023-09-30T17:04:17.053 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.053 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.053 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:17.053 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.568732+0000", 2023-09-30T17:04:17.053 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6749999999999997e-06 2023-09-30T17:04:17.053 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.053 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.054 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:17.054 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.568740+0000", 2023-09-30T17:04:17.054 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.525e-06 2023-09-30T17:04:17.054 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:17.054 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:17.054 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:17.054 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.054 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.054 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:124833 4.36 e53/17)", 2023-09-30T17:04:17.054 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:15.578875+0000", 2023-09-30T17:04:17.054 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9924784, 2023-09-30T17:04:17.055 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011420461, 2023-09-30T17:04:17.055 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:17.055 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:17.055 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:17.055 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.055 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:17.055 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578875+0000", 2023-09-30T17:04:17.055 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:17.055 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.055 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.055 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:17.056 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578875+0000", 2023-09-30T17:04:17.056 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:17.056 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.056 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.056 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:17.056 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578876+0000", 2023-09-30T17:04:17.056 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5699999999999999e-07 2023-09-30T17:04:17.056 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.056 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.056 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:17.056 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578886+0000", 2023-09-30T17:04:17.057 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0019e-05 2023-09-30T17:04:17.057 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.057 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.057 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:17.057 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578891+0000", 2023-09-30T17:04:17.057 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6280000000000002e-06 2023-09-30T17:04:17.057 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:17.057 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:17.057 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:17.057 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:15.578896+0000", 2023-09-30T17:04:17.057 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0050000000000004e-06 2023-09-30T17:04:17.058 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:17.058 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:17.058 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:17.058 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:17.058 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2023-09-30T17:04:17.058 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 358 2023-09-30T17:04:17.058 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:04:17.059 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-09-30T17:04:17.060 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:04:17.061 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:17.059+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:17.079 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-09-30T17:04:17.160 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:17.159+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:17.261 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:17.261+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:17.295 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:04:17.297 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:04:17.297 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:04:17.298 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2023-09-30T17:04:17.298 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2023-09-30T17:04:17.298 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:04:17.313 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:04:17.326 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:04:17.326 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-09-30T17:04:17.326 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-09-30T17:04:17.327 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:04:17.330 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:04:17.331 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:04:17.399 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:17.397+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:17.464 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:17.462+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:17.557 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:17.557 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:17.566 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:17.565+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:17.573 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:04:17.664 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:17.664+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:17.771 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:17.769+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:17.786 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:17.786 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:17.804 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:04:17.887 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:17.887+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:17.970 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:17.967+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:18.067 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:18.068 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:18.071 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:18.069+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:18.077 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:04:18.169 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:18.168+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:18.270 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:18.270+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:18.280 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is set 2023-09-30T17:04:18.334 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:18.334 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:18.350 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:04:18.390 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:18.390+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:18.473 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:18.472+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:18.543 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:18.543 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:18.559 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:04:18.572 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:18.571+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:18.676 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:18.676+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:18.774 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:18.773+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:18.798 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:18.799 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:18.816 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:04:18.905 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:18.905+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:18.975 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:18.975+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:19.059 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:19.059 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:19.075 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:04:19.080 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:19.079+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:19.180 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:19.177+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:19.279 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:19.278+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:19.289 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:19.289 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:19.308 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:04:19.333 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-09-30T17:04:19.380 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:19.378+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:19.481 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:19.480+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:19.518 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:04:19.525 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:04:19.525 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:04:19.525 INFO:teuthology.orchestra.run.smithi031.stdout: "complaint_time": 30, 2023-09-30T17:04:19.525 INFO:teuthology.orchestra.run.smithi031.stdout: "num_blocked_ops": 0 2023-09-30T17:04:19.526 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:04:19.542 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:04:19.580 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:04:19.581 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:19.581+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:19.581 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-09-30T17:04:19.581 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-09-30T17:04:19.581 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:04:19.583 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:04:19.584 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:04:19.682 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:19.682+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:19.782 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:19.782+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:19.805 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:04:19.805 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 20, 2023-09-30T17:04:19.805 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 600, 2023-09-30T17:04:19.805 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:04:19.805 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.805 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109497 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 49152~4096 in=4096b,write 106496~4096 in=4096b,write 163840~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:19.805 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.624224+0000", 2023-09-30T17:04:19.805 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 10.177349456, 2023-09-30T17:04:19.806 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.717345754, 2023-09-30T17:04:19.806 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:19.806 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:19.806 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:19.806 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:19.806 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:19.806 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109497 2023-09-30T17:04:19.806 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.806 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:19.806 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.806 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:19.807 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624224+0000", 2023-09-30T17:04:19.807 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:19.807 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.807 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.807 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:19.807 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624224+0000", 2023-09-30T17:04:19.807 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:19.807 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.807 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.807 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:19.808 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624224+0000", 2023-09-30T17:04:19.808 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9299999999999998e-07 2023-09-30T17:04:19.808 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.808 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.808 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:19.808 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624238+0000", 2023-09-30T17:04:19.808 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4144999999999999e-05 2023-09-30T17:04:19.808 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.808 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.808 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:19.808 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624439+0000", 2023-09-30T17:04:19.809 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00020105200000000001 2023-09-30T17:04:19.809 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.809 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.809 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:19.809 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624447+0000", 2023-09-30T17:04:19.809 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0499999999999992e-06 2023-09-30T17:04:19.809 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.809 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.809 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:19.809 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.022040+0000", 2023-09-30T17:04:19.809 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39759262099999998 2023-09-30T17:04:19.809 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.810 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.810 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:19.810 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.022117+0000", 2023-09-30T17:04:19.810 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6834000000000003e-05 2023-09-30T17:04:19.810 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.810 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.810 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:19.810 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.022269+0000", 2023-09-30T17:04:19.810 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015254600000000001 2023-09-30T17:04:19.810 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.810 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.811 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:19.811 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.058505+0000", 2023-09-30T17:04:19.811 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.036235394999999997 2023-09-30T17:04:19.811 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.811 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.811 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:19.811 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.341470+0000", 2023-09-30T17:04:19.811 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.28296523600000001 2023-09-30T17:04:19.811 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.811 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.812 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:19.812 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.341530+0000", 2023-09-30T17:04:19.812 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9939000000000003e-05 2023-09-30T17:04:19.812 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.812 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.812 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:19.812 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.341569+0000", 2023-09-30T17:04:19.812 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9342999999999999e-05 2023-09-30T17:04:19.812 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:19.812 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:19.812 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:19.813 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.813 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.813 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109508 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 2650112~4096 in=4096b,write 2723840~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:19.813 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.624554+0000", 2023-09-30T17:04:19.813 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 10.177018820000001, 2023-09-30T17:04:19.813 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.717264546, 2023-09-30T17:04:19.813 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:19.813 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:19.813 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:19.813 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:19.813 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:19.814 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109508 2023-09-30T17:04:19.814 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.814 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:19.814 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.814 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:19.814 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624554+0000", 2023-09-30T17:04:19.814 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:19.814 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.814 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.814 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:19.814 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624554+0000", 2023-09-30T17:04:19.814 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:19.815 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.815 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.815 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:19.815 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624555+0000", 2023-09-30T17:04:19.815 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.51e-07 2023-09-30T17:04:19.815 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.815 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.815 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:19.815 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624573+0000", 2023-09-30T17:04:19.815 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8519e-05 2023-09-30T17:04:19.816 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.816 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.816 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:19.816 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624582+0000", 2023-09-30T17:04:19.816 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.6489999999999997e-06 2023-09-30T17:04:19.816 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.816 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.816 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:19.816 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624588+0000", 2023-09-30T17:04:19.816 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4980000000000003e-06 2023-09-30T17:04:19.816 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.816 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.817 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:19.817 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.028302+0000", 2023-09-30T17:04:19.817 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.40371393 2023-09-30T17:04:19.817 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.817 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.817 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:19.817 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.028383+0000", 2023-09-30T17:04:19.817 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1069000000000006e-05 2023-09-30T17:04:19.818 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.818 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.818 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:19.818 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.028546+0000", 2023-09-30T17:04:19.818 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000162256 2023-09-30T17:04:19.818 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.818 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.818 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:19.818 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.058510+0000", 2023-09-30T17:04:19.818 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.029964937000000001 2023-09-30T17:04:19.819 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.819 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.819 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:19.819 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.341742+0000", 2023-09-30T17:04:19.819 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.28323117799999997 2023-09-30T17:04:19.819 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.819 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.819 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:19.819 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.341788+0000", 2023-09-30T17:04:19.819 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6118999999999997e-05 2023-09-30T17:04:19.820 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.820 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.820 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:19.820 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.341819+0000", 2023-09-30T17:04:19.820 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0939999999999999e-05 2023-09-30T17:04:19.820 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:19.820 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:19.820 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:19.821 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.821 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.821 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109527 4.6 4:616d4c41:::100000001f8.00000034:head [write 122880~4096 in=4096b,write 143360~4096 in=4096b,write 151552~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:19.821 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.630262+0000", 2023-09-30T17:04:19.821 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 10.171311221, 2023-09-30T17:04:19.821 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.72988284299999995, 2023-09-30T17:04:19.821 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:19.821 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:19.821 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:19.821 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:19.822 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:19.822 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109527 2023-09-30T17:04:19.822 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.822 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:19.822 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.822 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:19.822 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.630262+0000", 2023-09-30T17:04:19.822 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:19.822 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.823 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.823 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:19.823 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.630262+0000", 2023-09-30T17:04:19.823 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:19.823 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.823 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.823 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:19.823 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.632170+0000", 2023-09-30T17:04:19.823 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0019085529999999999 2023-09-30T17:04:19.823 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.824 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.824 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:19.824 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.632192+0000", 2023-09-30T17:04:19.824 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1243999999999999e-05 2023-09-30T17:04:19.824 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.824 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.824 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:19.824 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.632203+0000", 2023-09-30T17:04:19.824 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1389999999999999e-05 2023-09-30T17:04:19.825 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.825 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.825 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:19.825 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.632211+0000", 2023-09-30T17:04:19.825 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8939999999999993e-06 2023-09-30T17:04:19.825 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.825 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.825 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:19.825 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.031203+0000", 2023-09-30T17:04:19.826 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39899208800000002 2023-09-30T17:04:19.826 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.826 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.826 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:19.826 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.031278+0000", 2023-09-30T17:04:19.826 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4988999999999996e-05 2023-09-30T17:04:19.826 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.826 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.827 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:19.827 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.031432+0000", 2023-09-30T17:04:19.827 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000154396 2023-09-30T17:04:19.827 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.827 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.827 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:19.827 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.058953+0000", 2023-09-30T17:04:19.827 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.027520464000000001 2023-09-30T17:04:19.828 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.828 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.828 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:19.828 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360042+0000", 2023-09-30T17:04:19.828 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.30108895699999999 2023-09-30T17:04:19.828 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.828 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.828 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:19.829 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360103+0000", 2023-09-30T17:04:19.829 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1364000000000004e-05 2023-09-30T17:04:19.829 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.829 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.829 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:19.829 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360145+0000", 2023-09-30T17:04:19.829 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1504000000000001e-05 2023-09-30T17:04:19.829 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:19.829 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:19.829 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:19.829 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.830 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.830 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109554 4.6 4:616d4c41:::100000001f8.00000034:head [write 1323008~4096 in=4096b,write 1675264~4096 in=4096b,write 1695744~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:19.830 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.646316+0000", 2023-09-30T17:04:19.830 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 10.155256906, 2023-09-30T17:04:19.830 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.71401674900000001, 2023-09-30T17:04:19.830 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:19.830 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:19.830 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:19.830 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:19.830 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:19.831 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109554 2023-09-30T17:04:19.831 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.831 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:19.831 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.831 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:19.831 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646316+0000", 2023-09-30T17:04:19.831 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:19.832 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.832 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.832 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:19.832 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646316+0000", 2023-09-30T17:04:19.832 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:19.832 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.833 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.833 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:19.833 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646317+0000", 2023-09-30T17:04:19.833 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9100000000000004e-07 2023-09-30T17:04:19.833 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.833 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.833 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:19.833 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646328+0000", 2023-09-30T17:04:19.833 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1832e-05 2023-09-30T17:04:19.833 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.834 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.834 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:19.834 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646335+0000", 2023-09-30T17:04:19.834 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7299999999999999e-06 2023-09-30T17:04:19.834 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.834 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.834 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:19.834 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646342+0000", 2023-09-30T17:04:19.834 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5309999999999998e-06 2023-09-30T17:04:19.834 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.834 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.835 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:19.835 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.033952+0000", 2023-09-30T17:04:19.835 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.38760991099999997 2023-09-30T17:04:19.835 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.835 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.835 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:19.835 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.034037+0000", 2023-09-30T17:04:19.835 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5483999999999997e-05 2023-09-30T17:04:19.835 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.835 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.836 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:19.836 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.034208+0000", 2023-09-30T17:04:19.836 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000170946 2023-09-30T17:04:19.836 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.836 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.836 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:19.836 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.058968+0000", 2023-09-30T17:04:19.836 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024760305 2023-09-30T17:04:19.836 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.836 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.836 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:19.837 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360244+0000", 2023-09-30T17:04:19.837 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.30127521699999998 2023-09-30T17:04:19.837 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.837 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.837 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:19.837 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360292+0000", 2023-09-30T17:04:19.837 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8689000000000001e-05 2023-09-30T17:04:19.837 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.837 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.837 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:19.837 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360333+0000", 2023-09-30T17:04:19.838 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0612999999999999e-05 2023-09-30T17:04:19.838 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:19.838 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:19.838 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:19.838 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.838 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.838 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109559 4.36 4:6da220e6:::100000001f8.0000003f:head [write 2142208~4096 in=4096b,write 2183168~4096 in=4096b,write 2220032~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:19.838 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.646349+0000", 2023-09-30T17:04:19.838 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 10.155224461, 2023-09-30T17:04:19.838 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.70604406399999997, 2023-09-30T17:04:19.838 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:19.839 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:19.839 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:19.839 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:19.839 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:19.839 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109559 2023-09-30T17:04:19.839 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.839 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:19.839 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.839 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:19.839 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646349+0000", 2023-09-30T17:04:19.839 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:19.839 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.840 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.840 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:19.840 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646349+0000", 2023-09-30T17:04:19.840 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:19.840 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.840 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.840 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:19.840 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646349+0000", 2023-09-30T17:04:19.840 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8500000000000002e-07 2023-09-30T17:04:19.840 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.840 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.841 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:19.841 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646360+0000", 2023-09-30T17:04:19.841 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1255e-05 2023-09-30T17:04:19.841 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.841 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.841 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:19.841 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646366+0000", 2023-09-30T17:04:19.841 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9959999999999999e-06 2023-09-30T17:04:19.841 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.841 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.841 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:19.842 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646371+0000", 2023-09-30T17:04:19.842 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9010000000000002e-06 2023-09-30T17:04:19.842 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.842 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.842 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:19.842 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.033938+0000", 2023-09-30T17:04:19.842 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.38756676699999998 2023-09-30T17:04:19.842 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.842 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.842 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:19.842 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.034023+0000", 2023-09-30T17:04:19.843 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5011000000000003e-05 2023-09-30T17:04:19.843 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.843 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.843 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:19.843 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.034178+0000", 2023-09-30T17:04:19.843 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000155267 2023-09-30T17:04:19.843 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.843 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.843 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:19.843 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.058961+0000", 2023-09-30T17:04:19.843 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024782786000000001 2023-09-30T17:04:19.843 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.844 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.844 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:19.844 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.352309+0000", 2023-09-30T17:04:19.844 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.29334778500000003 2023-09-30T17:04:19.844 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.844 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.844 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:19.844 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.352356+0000", 2023-09-30T17:04:19.844 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7153000000000001e-05 2023-09-30T17:04:19.844 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.845 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.845 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:19.845 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.352393+0000", 2023-09-30T17:04:19.845 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6658e-05 2023-09-30T17:04:19.845 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:19.845 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:19.845 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:19.845 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.845 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.845 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109562 4.6 4:616d4c41:::100000001f8.00000034:head [write 4071424~4096 in=4096b,write 4161536~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:19.845 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.650213+0000", 2023-09-30T17:04:19.846 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 10.151359748999999, 2023-09-30T17:04:19.846 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.71023619199999999, 2023-09-30T17:04:19.846 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:19.846 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:19.846 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:19.846 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:19.846 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:19.846 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109562 2023-09-30T17:04:19.846 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.846 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:19.847 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.847 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:19.847 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.650213+0000", 2023-09-30T17:04:19.847 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:19.847 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.847 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.847 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:19.847 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.650213+0000", 2023-09-30T17:04:19.847 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:19.847 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.847 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.848 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:19.848 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.650214+0000", 2023-09-30T17:04:19.848 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1200000000000003e-07 2023-09-30T17:04:19.848 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.848 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.848 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:19.848 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.650227+0000", 2023-09-30T17:04:19.848 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.287e-05 2023-09-30T17:04:19.848 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.848 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.849 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:19.849 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.650235+0000", 2023-09-30T17:04:19.849 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8189999999999992e-06 2023-09-30T17:04:19.849 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.849 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.849 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:19.849 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.650241+0000", 2023-09-30T17:04:19.849 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3749999999999999e-06 2023-09-30T17:04:19.849 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.849 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.849 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:19.849 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.042530+0000", 2023-09-30T17:04:19.850 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39228892399999998 2023-09-30T17:04:19.850 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.850 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.850 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:19.850 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.042619+0000", 2023-09-30T17:04:19.850 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8838999999999994e-05 2023-09-30T17:04:19.850 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.850 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.850 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:19.850 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.042773+0000", 2023-09-30T17:04:19.850 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000154456 2023-09-30T17:04:19.851 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.851 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.851 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:19.851 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.059137+0000", 2023-09-30T17:04:19.851 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.016363800000000001 2023-09-30T17:04:19.851 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.851 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.851 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:19.851 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360385+0000", 2023-09-30T17:04:19.851 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.30124847199999999 2023-09-30T17:04:19.851 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.852 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.852 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:19.852 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360418+0000", 2023-09-30T17:04:19.852 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.2688000000000003e-05 2023-09-30T17:04:19.852 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.852 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.852 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:19.852 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360449+0000", 2023-09-30T17:04:19.852 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.1337000000000002e-05 2023-09-30T17:04:19.852 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:19.852 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:19.853 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:19.853 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.853 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.853 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109578 4.36 4:6fa85f86:::100000001f8.00000013:head [write 749568~4096 in=4096b,write 970752~4096 in=4096b,write 1007616~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:19.853 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.650465+0000", 2023-09-30T17:04:19.853 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 10.151107904, 2023-09-30T17:04:19.853 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.70982843399999995, 2023-09-30T17:04:19.853 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:19.854 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:19.854 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:19.854 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:19.854 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:19.854 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109578 2023-09-30T17:04:19.854 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.854 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:19.854 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.854 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:19.855 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.650465+0000", 2023-09-30T17:04:19.855 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:19.855 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.855 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.855 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:19.855 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.650465+0000", 2023-09-30T17:04:19.855 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:19.855 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.855 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.855 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:19.855 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.654163+0000", 2023-09-30T17:04:19.856 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00369798 2023-09-30T17:04:19.856 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.856 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.856 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:19.856 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.654176+0000", 2023-09-30T17:04:19.856 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2765000000000001e-05 2023-09-30T17:04:19.856 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.856 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.856 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:19.857 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.654187+0000", 2023-09-30T17:04:19.857 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.078e-05 2023-09-30T17:04:19.857 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.857 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.857 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:19.857 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.654192+0000", 2023-09-30T17:04:19.857 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8880000000000002e-06 2023-09-30T17:04:19.857 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.857 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.857 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:19.858 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.045826+0000", 2023-09-30T17:04:19.858 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39163316300000001 2023-09-30T17:04:19.858 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.858 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.858 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:19.858 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.045900+0000", 2023-09-30T17:04:19.858 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3905000000000005e-05 2023-09-30T17:04:19.858 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.858 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.859 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:19.859 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.046309+0000", 2023-09-30T17:04:19.859 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00040957400000000001 2023-09-30T17:04:19.859 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.859 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.859 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:19.859 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.076789+0000", 2023-09-30T17:04:19.859 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.030479506999999999 2023-09-30T17:04:19.859 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.859 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.860 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:19.860 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360197+0000", 2023-09-30T17:04:19.860 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.28340816699999999 2023-09-30T17:04:19.860 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.860 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.860 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:19.860 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360254+0000", 2023-09-30T17:04:19.860 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7574000000000001e-05 2023-09-30T17:04:19.860 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.861 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.861 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:19.861 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360294+0000", 2023-09-30T17:04:19.861 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9131000000000002e-05 2023-09-30T17:04:19.861 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:19.861 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:19.861 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:19.861 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.861 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.862 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109582 4.6 4:616d4c41:::100000001f8.00000034:head [write 32768~4096 in=4096b,write 90112~4096 in=4096b,write 180224~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:19.862 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.654253+0000", 2023-09-30T17:04:19.862 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 10.147319659000001, 2023-09-30T17:04:19.862 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.71919376800000001, 2023-09-30T17:04:19.862 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:19.862 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:19.862 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:19.862 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:19.862 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:19.863 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109582 2023-09-30T17:04:19.863 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.863 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:19.863 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.863 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:19.863 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.654253+0000", 2023-09-30T17:04:19.863 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:19.863 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.864 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.864 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:19.864 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.654253+0000", 2023-09-30T17:04:19.864 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:19.864 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.864 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.864 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:19.864 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658162+0000", 2023-09-30T17:04:19.865 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0039091320000000001 2023-09-30T17:04:19.865 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.865 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.865 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:19.865 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658178+0000", 2023-09-30T17:04:19.865 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5719e-05 2023-09-30T17:04:19.865 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.865 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.865 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:19.866 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658189+0000", 2023-09-30T17:04:19.866 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1043000000000001e-05 2023-09-30T17:04:19.866 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.866 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.866 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:19.866 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658198+0000", 2023-09-30T17:04:19.866 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4090000000000003e-06 2023-09-30T17:04:19.866 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.867 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.867 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:19.867 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051307+0000", 2023-09-30T17:04:19.867 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39310928899999997 2023-09-30T17:04:19.867 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.867 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.867 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:19.867 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051392+0000", 2023-09-30T17:04:19.867 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4850000000000002e-05 2023-09-30T17:04:19.867 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.867 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.868 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:19.868 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051575+0000", 2023-09-30T17:04:19.868 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00018296999999999999 2023-09-30T17:04:19.868 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.868 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.868 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:19.868 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.076797+0000", 2023-09-30T17:04:19.868 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.025222616999999999 2023-09-30T17:04:19.868 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.868 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.868 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:19.869 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.373335+0000", 2023-09-30T17:04:19.869 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.29653762299999997 2023-09-30T17:04:19.869 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.869 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.869 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:19.869 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.373404+0000", 2023-09-30T17:04:19.869 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8633999999999994e-05 2023-09-30T17:04:19.869 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.869 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.869 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:19.869 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.373447+0000", 2023-09-30T17:04:19.870 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3482000000000001e-05 2023-09-30T17:04:19.870 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:19.870 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:19.870 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:19.870 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.870 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.870 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109583 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 1945600~8192 in=8192b,write 2285568~4096 in=4096b,write 2301952~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:19.870 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.658212+0000", 2023-09-30T17:04:19.870 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 10.143360984999999, 2023-09-30T17:04:19.870 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.71553887199999999, 2023-09-30T17:04:19.871 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:19.871 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:19.871 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:19.871 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:19.871 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:19.871 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109583 2023-09-30T17:04:19.871 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.871 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:19.871 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.871 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:19.872 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658212+0000", 2023-09-30T17:04:19.872 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:19.872 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.872 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.872 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:19.872 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658212+0000", 2023-09-30T17:04:19.872 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:19.872 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.872 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.872 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:19.873 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658213+0000", 2023-09-30T17:04:19.873 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6000000000000004e-07 2023-09-30T17:04:19.873 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.873 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.873 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:19.873 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658225+0000", 2023-09-30T17:04:19.873 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2887e-05 2023-09-30T17:04:19.873 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.873 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.873 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:19.873 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658233+0000", 2023-09-30T17:04:19.874 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2620000000000001e-06 2023-09-30T17:04:19.874 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.874 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.874 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:19.874 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658239+0000", 2023-09-30T17:04:19.874 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4300000000000003e-06 2023-09-30T17:04:19.874 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.874 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.874 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:19.874 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.055877+0000", 2023-09-30T17:04:19.874 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39763770799999998 2023-09-30T17:04:19.874 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.875 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.875 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:19.875 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.055965+0000", 2023-09-30T17:04:19.875 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8125000000000001e-05 2023-09-30T17:04:19.875 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.875 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.875 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:19.875 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.056131+0000", 2023-09-30T17:04:19.875 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000165971 2023-09-30T17:04:19.875 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.876 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.876 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:19.876 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.077434+0000", 2023-09-30T17:04:19.876 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.021303441999999999 2023-09-30T17:04:19.876 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.876 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.876 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:19.876 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.373658+0000", 2023-09-30T17:04:19.876 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.29622356300000002 2023-09-30T17:04:19.876 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.876 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.877 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:19.877 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.373716+0000", 2023-09-30T17:04:19.877 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8161000000000001e-05 2023-09-30T17:04:19.877 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.877 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.877 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:19.877 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.373751+0000", 2023-09-30T17:04:19.877 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4762999999999999e-05 2023-09-30T17:04:19.877 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:19.877 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:19.877 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:19.878 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.878 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.878 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109594 4.36 4:6da220e6:::100000001f8.0000003f:head [write 3932160~4096 in=4096b,write 4038656~4096 in=4096b,write 4177920~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:19.878 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.674301+0000", 2023-09-30T17:04:19.878 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 10.127271513, 2023-09-30T17:04:19.878 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.69931127100000001, 2023-09-30T17:04:19.878 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:19.878 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:19.878 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:19.878 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:19.878 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:19.879 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109594 2023-09-30T17:04:19.879 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.879 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:19.879 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.879 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:19.879 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.674301+0000", 2023-09-30T17:04:19.879 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:19.879 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.879 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.879 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:19.879 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.674301+0000", 2023-09-30T17:04:19.880 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:19.880 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.880 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.880 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:19.880 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.674302+0000", 2023-09-30T17:04:19.880 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.46e-07 2023-09-30T17:04:19.880 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.880 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.881 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:19.881 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.674315+0000", 2023-09-30T17:04:19.881 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3213e-05 2023-09-30T17:04:19.881 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.881 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.881 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:19.881 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.674321+0000", 2023-09-30T17:04:19.882 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2400000000000004e-06 2023-09-30T17:04:19.882 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.882 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.882 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:19.882 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.674326+0000", 2023-09-30T17:04:19.882 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8670000000000002e-06 2023-09-30T17:04:19.882 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.882 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.882 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:19.882 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.059410+0000", 2023-09-30T17:04:19.882 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.38508374299999998 2023-09-30T17:04:19.883 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.883 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.883 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:19.883 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.059492+0000", 2023-09-30T17:04:19.883 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1868999999999998e-05 2023-09-30T17:04:19.883 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.883 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.883 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:19.883 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.059669+0000", 2023-09-30T17:04:19.883 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017732100000000001 2023-09-30T17:04:19.883 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.884 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.884 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:19.884 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.076933+0000", 2023-09-30T17:04:19.884 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.017263647 2023-09-30T17:04:19.884 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.884 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.884 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:19.884 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.373515+0000", 2023-09-30T17:04:19.884 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.29658226500000001 2023-09-30T17:04:19.884 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.884 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.885 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:19.885 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.373576+0000", 2023-09-30T17:04:19.885 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1245000000000001e-05 2023-09-30T17:04:19.885 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.885 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.885 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:19.885 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.373613+0000", 2023-09-30T17:04:19.885 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6415000000000003e-05 2023-09-30T17:04:19.885 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:19.885 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:19.886 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:19.886 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.886 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.886 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109683 4.36 4:6fa85f86:::100000001f8.00000013:head [write 491520~4096 in=4096b,write 573440~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:19.886 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.704390+0000", 2023-09-30T17:04:19.886 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 10.097183356, 2023-09-30T17:04:19.886 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.70242975500000004, 2023-09-30T17:04:19.886 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:19.886 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:19.886 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:19.886 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:19.887 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:19.887 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109683 2023-09-30T17:04:19.887 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.887 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:19.887 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.887 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:19.887 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.704390+0000", 2023-09-30T17:04:19.887 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:19.887 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.888 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.888 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:19.888 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.704390+0000", 2023-09-30T17:04:19.888 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:19.888 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.888 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.888 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:19.888 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.704390+0000", 2023-09-30T17:04:19.888 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1800000000000001e-07 2023-09-30T17:04:19.888 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.889 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.889 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:19.889 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.704412+0000", 2023-09-30T17:04:19.889 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1767999999999999e-05 2023-09-30T17:04:19.889 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.889 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.889 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:19.889 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.705174+0000", 2023-09-30T17:04:19.889 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00076232000000000003 2023-09-30T17:04:19.890 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.890 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.890 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:19.890 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.705184+0000", 2023-09-30T17:04:19.890 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0210000000000001e-05 2023-09-30T17:04:19.890 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.890 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.890 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:19.890 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.090705+0000", 2023-09-30T17:04:19.890 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.385520737 2023-09-30T17:04:19.891 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.891 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.891 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:19.891 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.090779+0000", 2023-09-30T17:04:19.891 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3716999999999999e-05 2023-09-30T17:04:19.891 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.891 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.892 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:19.892 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.090923+0000", 2023-09-30T17:04:19.892 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014392800000000001 2023-09-30T17:04:19.892 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.892 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.892 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:19.892 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.111435+0000", 2023-09-30T17:04:19.892 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.020512117999999999 2023-09-30T17:04:19.892 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.893 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.893 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:19.893 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.406730+0000", 2023-09-30T17:04:19.893 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.29529477999999998 2023-09-30T17:04:19.893 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.893 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.893 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:19.893 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.406786+0000", 2023-09-30T17:04:19.893 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6088999999999998e-05 2023-09-30T17:04:19.893 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.894 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.894 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:19.894 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.406819+0000", 2023-09-30T17:04:19.894 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3670000000000001e-05 2023-09-30T17:04:19.894 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:19.894 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:19.894 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:19.894 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.894 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.895 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109692 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 2957312~4096 in=4096b,write 3039232~4096 in=4096b,write 3047424~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:19.895 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.707348+0000", 2023-09-30T17:04:19.895 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 10.094225104, 2023-09-30T17:04:19.895 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.70916258899999995, 2023-09-30T17:04:19.895 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:19.895 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:19.895 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:19.895 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:19.896 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:19.896 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109692 2023-09-30T17:04:19.896 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.896 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:19.896 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.896 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:19.896 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.707348+0000", 2023-09-30T17:04:19.896 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:19.896 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.897 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.897 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:19.897 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.707348+0000", 2023-09-30T17:04:19.897 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:19.897 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.897 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.897 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:19.897 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.707348+0000", 2023-09-30T17:04:19.898 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8400000000000004e-07 2023-09-30T17:04:19.898 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.898 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.898 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:19.898 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.707362+0000", 2023-09-30T17:04:19.898 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3131e-05 2023-09-30T17:04:19.898 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.898 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.899 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:19.899 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.707369+0000", 2023-09-30T17:04:19.899 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.875e-06 2023-09-30T17:04:19.899 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.899 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.899 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:19.899 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.707375+0000", 2023-09-30T17:04:19.900 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7799999999999997e-06 2023-09-30T17:04:19.900 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.900 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.900 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:19.900 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.093520+0000", 2023-09-30T17:04:19.900 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.38614510299999999 2023-09-30T17:04:19.900 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.900 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.900 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:19.901 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.093592+0000", 2023-09-30T17:04:19.901 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1588999999999995e-05 2023-09-30T17:04:19.901 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.901 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.901 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:19.901 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.093734+0000", 2023-09-30T17:04:19.901 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014193800000000001 2023-09-30T17:04:19.901 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.901 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.901 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:19.901 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.111441+0000", 2023-09-30T17:04:19.902 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.017706676000000001 2023-09-30T17:04:19.902 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.902 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.902 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:19.902 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.416425+0000", 2023-09-30T17:04:19.902 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.30498444499999999 2023-09-30T17:04:19.902 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.902 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.902 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:19.902 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.416475+0000", 2023-09-30T17:04:19.902 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0427999999999999e-05 2023-09-30T17:04:19.903 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.903 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.903 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:19.903 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.416510+0000", 2023-09-30T17:04:19.903 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5040000000000003e-05 2023-09-30T17:04:19.903 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:19.903 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:19.903 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:19.903 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.903 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.903 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109697 4.6 4:63e80496:::100000001f8.0000001e:head [write 1617920~4096 in=4096b,write 1830912~4096 in=4096b,write 1875968~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:19.904 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.711270+0000", 2023-09-30T17:04:19.904 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 10.090302731, 2023-09-30T17:04:19.904 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.70601983400000001, 2023-09-30T17:04:19.904 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:19.904 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:19.904 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:19.904 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:19.904 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:19.904 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109697 2023-09-30T17:04:19.904 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.904 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:19.905 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.905 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:19.905 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.711270+0000", 2023-09-30T17:04:19.905 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:19.905 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.905 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.905 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:19.905 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.711270+0000", 2023-09-30T17:04:19.905 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:19.905 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.905 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.906 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:19.906 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.711271+0000", 2023-09-30T17:04:19.906 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4400000000000001e-07 2023-09-30T17:04:19.906 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.906 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.906 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:19.906 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.711284+0000", 2023-09-30T17:04:19.906 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.342e-05 2023-09-30T17:04:19.906 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.906 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.907 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:19.907 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.711296+0000", 2023-09-30T17:04:19.907 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2309e-05 2023-09-30T17:04:19.907 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.907 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.907 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:19.907 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.711303+0000", 2023-09-30T17:04:19.907 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9789999999999996e-06 2023-09-30T17:04:19.907 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.907 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.907 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:19.908 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.098461+0000", 2023-09-30T17:04:19.908 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.38715737300000003 2023-09-30T17:04:19.908 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.908 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.908 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:19.908 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.098551+0000", 2023-09-30T17:04:19.908 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.0610000000000002e-05 2023-09-30T17:04:19.908 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.908 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.908 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:19.908 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.098728+0000", 2023-09-30T17:04:19.909 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017616499999999999 2023-09-30T17:04:19.909 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.909 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.909 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:19.909 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.123046+0000", 2023-09-30T17:04:19.909 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024318095000000001 2023-09-30T17:04:19.909 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.909 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.909 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:19.909 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.417208+0000", 2023-09-30T17:04:19.909 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.29416202499999999 2023-09-30T17:04:19.910 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.910 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.910 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:19.910 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.417257+0000", 2023-09-30T17:04:19.910 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9249999999999998e-05 2023-09-30T17:04:19.910 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.910 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.910 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:19.910 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.417290+0000", 2023-09-30T17:04:19.910 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3164000000000003e-05 2023-09-30T17:04:19.910 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:19.911 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:19.911 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:19.911 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.911 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.911 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109719 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 3416064~4096 in=4096b,write 3436544~4096 in=4096b,write 3448832~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:19.911 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.719273+0000", 2023-09-30T17:04:19.911 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 10.082300417000001, 2023-09-30T17:04:19.911 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.69986670399999995, 2023-09-30T17:04:19.911 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:19.911 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:19.911 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:19.912 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:19.912 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:19.912 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109719 2023-09-30T17:04:19.912 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.912 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:19.912 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.912 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:19.912 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.719273+0000", 2023-09-30T17:04:19.912 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:19.912 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.912 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.912 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:19.913 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.719273+0000", 2023-09-30T17:04:19.913 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:19.913 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.913 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.913 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:19.913 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.719273+0000", 2023-09-30T17:04:19.913 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0399999999999996e-07 2023-09-30T17:04:19.913 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.913 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.913 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:19.913 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.719288+0000", 2023-09-30T17:04:19.914 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4516e-05 2023-09-30T17:04:19.914 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.914 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.914 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:19.914 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.719297+0000", 2023-09-30T17:04:19.914 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.6129999999999993e-06 2023-09-30T17:04:19.914 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.914 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.914 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:19.914 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.719305+0000", 2023-09-30T17:04:19.914 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.306e-06 2023-09-30T17:04:19.915 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.915 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.915 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:19.915 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.111467+0000", 2023-09-30T17:04:19.915 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.392162185 2023-09-30T17:04:19.915 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.915 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.915 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:19.915 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.111550+0000", 2023-09-30T17:04:19.915 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3410000000000003e-05 2023-09-30T17:04:19.915 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.916 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.916 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:19.916 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.111723+0000", 2023-09-30T17:04:19.916 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017283899999999999 2023-09-30T17:04:19.916 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.916 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.916 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:19.916 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.146287+0000", 2023-09-30T17:04:19.916 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.034563582000000002 2023-09-30T17:04:19.916 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.916 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.917 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:19.917 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.419037+0000", 2023-09-30T17:04:19.917 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.272750206 2023-09-30T17:04:19.917 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.917 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.917 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:19.917 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.419100+0000", 2023-09-30T17:04:19.917 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2884000000000003e-05 2023-09-30T17:04:19.917 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.917 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.918 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:19.918 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.419139+0000", 2023-09-30T17:04:19.918 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9558999999999999e-05 2023-09-30T17:04:19.918 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:19.918 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:19.918 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:19.918 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.918 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.918 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109739 4.6 4:616d4c41:::100000001f8.00000034:head [write 471040~4096 in=4096b,write 512000~4096 in=4096b,write 548864~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:19.918 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.729634+0000", 2023-09-30T17:04:19.918 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 10.071938923999999, 2023-09-30T17:04:19.919 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.69994692599999997, 2023-09-30T17:04:19.919 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:19.919 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:19.919 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:19.919 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:19.919 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:19.919 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109739 2023-09-30T17:04:19.919 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.919 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:19.919 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.919 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:19.920 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.729634+0000", 2023-09-30T17:04:19.920 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:19.920 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.920 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.920 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:19.920 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.729634+0000", 2023-09-30T17:04:19.920 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:19.920 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.920 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.920 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:19.920 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.731164+0000", 2023-09-30T17:04:19.920 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0015297399999999999 2023-09-30T17:04:19.921 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.921 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.921 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:19.921 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.731180+0000", 2023-09-30T17:04:19.921 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6288000000000001e-05 2023-09-30T17:04:19.921 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.921 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.921 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:19.921 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.731193+0000", 2023-09-30T17:04:19.921 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3362e-05 2023-09-30T17:04:19.921 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.922 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.922 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:19.922 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.731201+0000", 2023-09-30T17:04:19.922 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9310000000000008e-06 2023-09-30T17:04:19.922 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.922 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.922 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:19.922 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.117287+0000", 2023-09-30T17:04:19.922 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.38608599500000002 2023-09-30T17:04:19.922 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.922 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.923 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:19.923 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.117357+0000", 2023-09-30T17:04:19.923 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9683000000000004e-05 2023-09-30T17:04:19.923 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.923 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.924 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:19.924 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.117526+0000", 2023-09-30T17:04:19.924 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016906399999999999 2023-09-30T17:04:19.924 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.924 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.924 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:19.924 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.146293+0000", 2023-09-30T17:04:19.924 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.028767310000000001 2023-09-30T17:04:19.924 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.925 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.925 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:19.925 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.429490+0000", 2023-09-30T17:04:19.925 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.28319694400000001 2023-09-30T17:04:19.925 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.925 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.925 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:19.925 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.429544+0000", 2023-09-30T17:04:19.926 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3635999999999999e-05 2023-09-30T17:04:19.926 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.926 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.926 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:19.926 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.429581+0000", 2023-09-30T17:04:19.926 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6973e-05 2023-09-30T17:04:19.926 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:19.926 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:19.926 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:19.927 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.927 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.927 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:127932 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 839680~4096,write 868352~4096,write 909312~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:19.927 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:16.548588+0000", 2023-09-30T17:04:19.927 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 3.2529850929999999, 2023-09-30T17:04:19.927 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.69903077599999996, 2023-09-30T17:04:19.927 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:19.927 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:19.928 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:19.928 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:19.928 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:19.928 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 127932 2023-09-30T17:04:19.928 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.928 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:19.928 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.928 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:19.928 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:16.548588+0000", 2023-09-30T17:04:19.929 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:19.929 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.929 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.929 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:19.929 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:16.548588+0000", 2023-09-30T17:04:19.929 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:19.929 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.929 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.930 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:19.930 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:16.548588+0000", 2023-09-30T17:04:19.930 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3300000000000003e-07 2023-09-30T17:04:19.930 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.930 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.930 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:19.930 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:16.548604+0000", 2023-09-30T17:04:19.930 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5372000000000001e-05 2023-09-30T17:04:19.931 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.931 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.931 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:19.931 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:16.548611+0000", 2023-09-30T17:04:19.931 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7479999999999993e-06 2023-09-30T17:04:19.931 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.931 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.931 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:19.932 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:16.548617+0000", 2023-09-30T17:04:19.932 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7130000000000002e-06 2023-09-30T17:04:19.932 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.932 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.932 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:19.932 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:16.742290+0000", 2023-09-30T17:04:19.932 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.193672913 2023-09-30T17:04:19.932 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.932 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.933 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:19.933 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:16.742378+0000", 2023-09-30T17:04:19.933 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8391000000000001e-05 2023-09-30T17:04:19.933 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.933 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.933 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:19.933 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:16.742550+0000", 2023-09-30T17:04:19.933 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000171566 2023-09-30T17:04:19.934 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.934 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.934 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:19.934 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:16.761260+0000", 2023-09-30T17:04:19.934 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.018710352999999999 2023-09-30T17:04:19.934 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.934 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.934 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:19.934 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:17.247509+0000", 2023-09-30T17:04:19.935 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.48624862699999999 2023-09-30T17:04:19.935 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.935 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.935 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:19.935 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:17.247578+0000", 2023-09-30T17:04:19.935 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8576000000000002e-05 2023-09-30T17:04:19.935 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.935 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.936 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:19.936 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:17.247619+0000", 2023-09-30T17:04:19.936 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1084000000000002e-05 2023-09-30T17:04:19.936 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:19.936 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:19.936 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:19.936 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.936 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.936 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:127953 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 2555904~4096,write 2637824~4096,write 2707456~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:19.936 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:16.556378+0000", 2023-09-30T17:04:19.936 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 3.2451948119999998, 2023-09-30T17:04:19.937 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.70334597499999996, 2023-09-30T17:04:19.937 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:19.937 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:19.937 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:19.937 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:19.937 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:19.937 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 127953 2023-09-30T17:04:19.937 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.937 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:19.937 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.937 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:19.937 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:16.556378+0000", 2023-09-30T17:04:19.938 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:19.938 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.938 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.938 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:19.938 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:16.556378+0000", 2023-09-30T17:04:19.938 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:19.938 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.938 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.938 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:19.938 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:16.560163+0000", 2023-09-30T17:04:19.939 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0037847480000000001 2023-09-30T17:04:19.939 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.939 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.939 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:19.939 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:16.560180+0000", 2023-09-30T17:04:19.939 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7422999999999999e-05 2023-09-30T17:04:19.939 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.939 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.939 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:19.939 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:16.560193+0000", 2023-09-30T17:04:19.939 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2584e-05 2023-09-30T17:04:19.940 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.940 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.940 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:19.940 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:16.560200+0000", 2023-09-30T17:04:19.940 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2439999999999996e-06 2023-09-30T17:04:19.940 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.940 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.940 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:19.940 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:16.752854+0000", 2023-09-30T17:04:19.940 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.192653933 2023-09-30T17:04:19.941 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.941 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.941 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:19.941 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:16.752936+0000", 2023-09-30T17:04:19.941 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1432000000000002e-05 2023-09-30T17:04:19.941 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.941 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.941 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:19.941 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:16.753082+0000", 2023-09-30T17:04:19.941 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014687700000000001 2023-09-30T17:04:19.941 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.942 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.942 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:19.942 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:16.764728+0000", 2023-09-30T17:04:19.942 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011645190999999999 2023-09-30T17:04:19.942 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.942 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.942 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:19.942 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:17.259605+0000", 2023-09-30T17:04:19.942 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.49487766999999999 2023-09-30T17:04:19.942 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.942 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.943 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:19.943 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:17.259677+0000", 2023-09-30T17:04:19.943 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1898999999999997e-05 2023-09-30T17:04:19.943 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.943 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.943 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:19.943 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:17.259724+0000", 2023-09-30T17:04:19.943 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6974000000000001e-05 2023-09-30T17:04:19.943 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:19.943 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:19.943 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:19.944 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.944 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.944 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:127963 4.36 4:6fa85f86:::100000001f8.00000013:head [write 2854912~4096,write 2908160~4096,write 3162112~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:19.944 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:16.560324+0000", 2023-09-30T17:04:19.944 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 3.2412489070000001, 2023-09-30T17:04:19.944 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.70205945599999997, 2023-09-30T17:04:19.944 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:19.944 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:19.944 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:19.944 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:19.944 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:19.945 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 127963 2023-09-30T17:04:19.945 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.945 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:19.945 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.945 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:19.945 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:16.560324+0000", 2023-09-30T17:04:19.945 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:19.945 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.945 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.945 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:19.945 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:16.560324+0000", 2023-09-30T17:04:19.945 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:19.946 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.946 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.946 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:19.946 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:16.560324+0000", 2023-09-30T17:04:19.946 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.72e-07 2023-09-30T17:04:19.946 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.946 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.946 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:19.946 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:16.560336+0000", 2023-09-30T17:04:19.946 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1773000000000001e-05 2023-09-30T17:04:19.946 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.947 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.947 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:19.947 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:16.560342+0000", 2023-09-30T17:04:19.947 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.195e-06 2023-09-30T17:04:19.947 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.947 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.947 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:19.947 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:16.560347+0000", 2023-09-30T17:04:19.947 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9030000000000003e-06 2023-09-30T17:04:19.947 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.947 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.948 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:19.948 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:16.756557+0000", 2023-09-30T17:04:19.948 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.1962093 2023-09-30T17:04:19.948 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.948 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.948 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:19.948 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:16.756603+0000", 2023-09-30T17:04:19.948 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6675000000000003e-05 2023-09-30T17:04:19.948 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.948 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.948 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:19.948 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:16.756697+0000", 2023-09-30T17:04:19.949 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3714000000000004e-05 2023-09-30T17:04:19.949 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.949 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.949 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:19.949 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:16.764904+0000", 2023-09-30T17:04:19.949 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0082073279999999998 2023-09-30T17:04:19.949 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.949 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.949 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:19.949 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:17.262293+0000", 2023-09-30T17:04:19.949 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.49738914400000001 2023-09-30T17:04:19.950 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.950 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.950 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:19.950 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:17.262349+0000", 2023-09-30T17:04:19.950 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5158000000000003e-05 2023-09-30T17:04:19.950 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.950 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.950 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:19.950 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:17.262384+0000", 2023-09-30T17:04:19.950 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4894000000000002e-05 2023-09-30T17:04:19.950 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:19.951 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:19.951 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:19.951 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.951 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.951 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:127967 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 520192~4096,write 618496~4096,write 626688~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:19.951 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:16.560388+0000", 2023-09-30T17:04:19.951 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 3.2411851779999998, 2023-09-30T17:04:19.951 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.69951028800000004, 2023-09-30T17:04:19.951 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:19.951 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:19.951 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:19.951 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:19.952 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:19.952 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 127967 2023-09-30T17:04:19.952 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.952 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:19.952 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.952 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:19.952 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:16.560388+0000", 2023-09-30T17:04:19.952 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:19.952 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.952 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.952 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:19.953 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:16.560388+0000", 2023-09-30T17:04:19.953 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:19.953 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.953 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.953 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:19.953 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:16.562163+0000", 2023-09-30T17:04:19.953 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0017750400000000001 2023-09-30T17:04:19.953 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.953 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.953 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:19.953 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:16.562179+0000", 2023-09-30T17:04:19.953 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6235e-05 2023-09-30T17:04:19.954 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.954 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.954 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:19.954 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:16.562192+0000", 2023-09-30T17:04:19.954 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.243e-05 2023-09-30T17:04:19.954 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.954 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.954 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:19.954 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:16.562199+0000", 2023-09-30T17:04:19.954 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3270000000000003e-06 2023-09-30T17:04:19.954 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.955 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.955 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:19.955 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:16.758376+0000", 2023-09-30T17:04:19.955 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.19617704899999999 2023-09-30T17:04:19.955 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.955 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.955 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:19.955 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:16.758475+0000", 2023-09-30T17:04:19.955 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8859999999999999e-05 2023-09-30T17:04:19.955 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.956 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.956 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:19.956 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:16.758644+0000", 2023-09-30T17:04:19.956 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016898999999999999 2023-09-30T17:04:19.956 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.956 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.956 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:19.956 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:16.773053+0000", 2023-09-30T17:04:19.956 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.014408799 2023-09-30T17:04:19.957 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.957 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.957 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:19.957 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:17.259777+0000", 2023-09-30T17:04:19.957 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.48672471 2023-09-30T17:04:19.957 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.957 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.957 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:19.957 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:17.259850+0000", 2023-09-30T17:04:19.957 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3025e-05 2023-09-30T17:04:19.957 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.958 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.958 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:19.958 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:17.259898+0000", 2023-09-30T17:04:19.958 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7822999999999999e-05 2023-09-30T17:04:19.958 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:19.958 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:19.958 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:19.958 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.958 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.959 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:127976 4.6 4:63e80496:::100000001f8.0000001e:head [write 286720~4096,write 331776~4096,write 385024~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:19.959 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:16.564257+0000", 2023-09-30T17:04:19.959 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 3.2373155549999999, 2023-09-30T17:04:19.959 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.69826018999999995, 2023-09-30T17:04:19.959 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:19.959 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:19.959 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:19.959 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:19.959 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:19.959 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 127976 2023-09-30T17:04:19.960 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.960 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:19.960 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.960 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:19.960 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:16.564257+0000", 2023-09-30T17:04:19.960 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:19.960 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.960 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.960 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:19.961 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:16.564257+0000", 2023-09-30T17:04:19.961 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:19.961 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.961 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.961 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:19.961 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:16.564258+0000", 2023-09-30T17:04:19.961 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4700000000000002e-07 2023-09-30T17:04:19.961 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.961 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.961 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:19.962 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:16.564270+0000", 2023-09-30T17:04:19.962 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2194e-05 2023-09-30T17:04:19.962 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.962 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.962 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:19.962 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:16.564277+0000", 2023-09-30T17:04:19.962 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4500000000000001e-06 2023-09-30T17:04:19.962 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.962 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.963 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:19.963 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:16.564282+0000", 2023-09-30T17:04:19.963 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4589999999999997e-06 2023-09-30T17:04:19.963 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.963 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.963 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:19.963 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:16.761552+0000", 2023-09-30T17:04:19.963 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.19727007899999999 2023-09-30T17:04:19.963 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.964 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.964 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:19.964 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:16.761626+0000", 2023-09-30T17:04:19.964 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3844999999999995e-05 2023-09-30T17:04:19.964 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.964 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.964 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:19.964 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:16.761770+0000", 2023-09-30T17:04:19.964 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014448900000000001 2023-09-30T17:04:19.964 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.965 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.965 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:19.965 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:16.773058+0000", 2023-09-30T17:04:19.965 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011287804 2023-09-30T17:04:19.965 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.965 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.965 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:19.965 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:17.262433+0000", 2023-09-30T17:04:19.965 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.489374688 2023-09-30T17:04:19.966 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.966 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.966 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:19.966 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:17.262483+0000", 2023-09-30T17:04:19.966 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0414000000000002e-05 2023-09-30T17:04:19.966 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:19.966 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:19.966 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:19.967 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:17.262518+0000", 2023-09-30T17:04:19.967 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4320999999999999e-05 2023-09-30T17:04:19.967 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:19.967 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:19.967 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:19.967 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:19.967 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:19.967 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:04:19.969 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:04:19.972 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:19.971+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:20.072 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:20.070+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:20.171 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:20.171+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:20.202 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:04:20.202 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2023-09-30T17:04:20.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.202 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136830 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.202 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.770564+0000", 2023-09-30T17:04:20.202 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.39954000299999998, 2023-09-30T17:04:20.202 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.39956509499999998, 2023-09-30T17:04:20.202 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.202 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.203 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.203 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.203 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.203 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136830 2023-09-30T17:04:20.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.203 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.203 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.203 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.203 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.770564+0000", 2023-09-30T17:04:20.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.204 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.204 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.770564+0000", 2023-09-30T17:04:20.204 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.204 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.204 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.772576+0000", 2023-09-30T17:04:20.204 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002011961 2023-09-30T17:04:20.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.205 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.205 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.772606+0000", 2023-09-30T17:04:20.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9899e-05 2023-09-30T17:04:20.205 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.205 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.205 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.772616+0000", 2023-09-30T17:04:20.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0491e-05 2023-09-30T17:04:20.205 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.206 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.206 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.772624+0000", 2023-09-30T17:04:20.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5290000000000003e-06 2023-09-30T17:04:20.206 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.206 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.206 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.207 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136957 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.207 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.824972+0000", 2023-09-30T17:04:20.207 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.34513183200000003, 2023-09-30T17:04:20.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.34521648799999999, 2023-09-30T17:04:20.207 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.207 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.207 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.207 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.207 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.207 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136957 2023-09-30T17:04:20.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.207 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.208 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.208 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.824972+0000", 2023-09-30T17:04:20.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.208 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.208 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.208 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.824972+0000", 2023-09-30T17:04:20.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.208 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.209 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.209 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.824972+0000", 2023-09-30T17:04:20.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8500000000000002e-07 2023-09-30T17:04:20.209 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.209 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.209 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.824985+0000", 2023-09-30T17:04:20.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2557e-05 2023-09-30T17:04:20.209 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.210 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.824993+0000", 2023-09-30T17:04:20.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8820000000000001e-06 2023-09-30T17:04:20.210 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.210 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.824998+0000", 2023-09-30T17:04:20.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.429e-06 2023-09-30T17:04:20.210 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.210 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.210 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.211 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:135890 4.36 e54/17)", 2023-09-30T17:04:20.211 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.890399+0000", 2023-09-30T17:04:20.211 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.27970440499999999, 2023-09-30T17:04:20.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.27983809999999998, 2023-09-30T17:04:20.211 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.211 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.211 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.212 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.212 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.890399+0000", 2023-09-30T17:04:20.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.212 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.212 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.212 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.890399+0000", 2023-09-30T17:04:20.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.212 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.212 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.212 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.890400+0000", 2023-09-30T17:04:20.213 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3999999999999998e-07 2023-09-30T17:04:20.213 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.213 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.213 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.213 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.890410+0000", 2023-09-30T17:04:20.213 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0395e-05 2023-09-30T17:04:20.213 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.213 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.213 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.213 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.890417+0000", 2023-09-30T17:04:20.213 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.652e-06 2023-09-30T17:04:20.214 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.214 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.214 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.890422+0000", 2023-09-30T17:04:20.214 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9280000000000001e-06 2023-09-30T17:04:20.214 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.214 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.214 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.214 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.215 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:135994 4.36 e54/17)", 2023-09-30T17:04:20.215 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.943201+0000", 2023-09-30T17:04:20.215 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.226903096, 2023-09-30T17:04:20.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.227080702, 2023-09-30T17:04:20.215 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.215 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.215 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.215 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.943201+0000", 2023-09-30T17:04:20.216 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.216 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.216 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.216 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.216 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.943201+0000", 2023-09-30T17:04:20.216 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.216 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.216 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.216 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.216 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.943201+0000", 2023-09-30T17:04:20.216 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.06e-07 2023-09-30T17:04:20.217 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.217 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.217 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.943215+0000", 2023-09-30T17:04:20.217 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3509000000000001e-05 2023-09-30T17:04:20.217 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.217 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.217 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.943224+0000", 2023-09-30T17:04:20.217 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7960000000000001e-06 2023-09-30T17:04:20.217 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.218 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.218 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.943230+0000", 2023-09-30T17:04:20.218 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3099999999999997e-06 2023-09-30T17:04:20.218 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.218 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.218 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.218 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.218 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.218 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136073 4.2e e54/17)", 2023-09-30T17:04:20.218 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.974677+0000", 2023-09-30T17:04:20.218 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.195426445, 2023-09-30T17:04:20.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.195646452, 2023-09-30T17:04:20.219 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.219 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.219 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.219 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.219 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.974677+0000", 2023-09-30T17:04:20.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.219 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.219 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.219 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.974677+0000", 2023-09-30T17:04:20.220 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.220 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.220 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.220 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.220 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.974678+0000", 2023-09-30T17:04:20.220 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8999999999999995e-07 2023-09-30T17:04:20.220 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.220 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.220 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.220 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.974697+0000", 2023-09-30T17:04:20.220 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9233e-05 2023-09-30T17:04:20.220 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.221 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.221 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.221 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.974706+0000", 2023-09-30T17:04:20.221 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3459999999999994e-06 2023-09-30T17:04:20.221 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.221 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.221 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.221 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.974712+0000", 2023-09-30T17:04:20.221 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2790000000000004e-06 2023-09-30T17:04:20.221 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.221 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.222 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.222 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.222 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.222 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136140 4.6 e54/17)", 2023-09-30T17:04:20.222 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.004363+0000", 2023-09-30T17:04:20.222 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.16574112899999999, 2023-09-30T17:04:20.222 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.16600485700000001, 2023-09-30T17:04:20.222 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.222 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.222 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.222 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.222 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.004363+0000", 2023-09-30T17:04:20.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.223 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.004363+0000", 2023-09-30T17:04:20.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.223 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.004363+0000", 2023-09-30T17:04:20.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.79e-07 2023-09-30T17:04:20.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.224 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.224 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.224 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.004377+0000", 2023-09-30T17:04:20.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4289e-05 2023-09-30T17:04:20.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.224 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.224 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.224 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.004384+0000", 2023-09-30T17:04:20.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.289e-06 2023-09-30T17:04:20.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.224 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.225 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.225 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.004390+0000", 2023-09-30T17:04:20.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.553e-06 2023-09-30T17:04:20.225 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.225 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.225 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.225 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.225 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.225 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137653 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.225 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.088753+0000", 2023-09-30T17:04:20.225 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.081350465999999996, 2023-09-30T17:04:20.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.081659899999999994, 2023-09-30T17:04:20.226 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.226 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.226 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.226 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.226 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.226 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137653 2023-09-30T17:04:20.226 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.226 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.226 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.226 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.226 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.088753+0000", 2023-09-30T17:04:20.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.088753+0000", 2023-09-30T17:04:20.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.092517+0000", 2023-09-30T17:04:20.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0037641089999999999 2023-09-30T17:04:20.228 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.228 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.228 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.228 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.092533+0000", 2023-09-30T17:04:20.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5679e-05 2023-09-30T17:04:20.228 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.228 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.228 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.228 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.092543+0000", 2023-09-30T17:04:20.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5249999999999994e-06 2023-09-30T17:04:20.228 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.229 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.229 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.092549+0000", 2023-09-30T17:04:20.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3260000000000001e-06 2023-09-30T17:04:20.229 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.229 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.229 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.229 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137687 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.229 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.101948+0000", 2023-09-30T17:04:20.229 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.068155747000000003, 2023-09-30T17:04:20.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.068518020999999998, 2023-09-30T17:04:20.230 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.230 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.230 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.230 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.230 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.230 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137687 2023-09-30T17:04:20.230 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.230 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.230 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.101948+0000", 2023-09-30T17:04:20.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.231 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.101948+0000", 2023-09-30T17:04:20.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.231 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.101948+0000", 2023-09-30T17:04:20.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9900000000000001e-07 2023-09-30T17:04:20.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.232 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.101960+0000", 2023-09-30T17:04:20.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1472e-05 2023-09-30T17:04:20.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.232 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.101966+0000", 2023-09-30T17:04:20.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9349999999999999e-06 2023-09-30T17:04:20.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.233 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.233 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.101971+0000", 2023-09-30T17:04:20.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8180000000000003e-06 2023-09-30T17:04:20.233 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.233 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.233 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.233 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.233 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137775 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.233 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.138674+0000", 2023-09-30T17:04:20.233 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.031430201999999997, 2023-09-30T17:04:20.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.031851085000000001, 2023-09-30T17:04:20.234 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.234 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.234 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.234 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.234 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.234 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137775 2023-09-30T17:04:20.234 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.234 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.234 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.234 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.234 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.138674+0000", 2023-09-30T17:04:20.235 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.235 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.235 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.235 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.235 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.138674+0000", 2023-09-30T17:04:20.235 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.235 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.235 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.235 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.235 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.138674+0000", 2023-09-30T17:04:20.235 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4e-07 2023-09-30T17:04:20.235 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.236 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.236 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.236 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.138686+0000", 2023-09-30T17:04:20.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1783999999999999e-05 2023-09-30T17:04:20.236 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.236 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.236 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.236 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.138692+0000", 2023-09-30T17:04:20.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3859999999999998e-06 2023-09-30T17:04:20.236 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.236 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.236 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.138696+0000", 2023-09-30T17:04:20.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3950000000000003e-06 2023-09-30T17:04:20.237 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.237 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.237 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.237 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136549 4.36 e54/17)", 2023-09-30T17:04:20.237 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.154545+0000", 2023-09-30T17:04:20.237 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.015558809, 2023-09-30T17:04:20.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016032711000000002, 2023-09-30T17:04:20.237 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.238 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.238 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.154545+0000", 2023-09-30T17:04:20.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.238 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.154545+0000", 2023-09-30T17:04:20.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.239 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.239 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.154545+0000", 2023-09-30T17:04:20.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3500000000000002e-07 2023-09-30T17:04:20.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.239 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.239 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.154558+0000", 2023-09-30T17:04:20.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3154e-05 2023-09-30T17:04:20.240 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.240 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.240 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.240 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.154567+0000", 2023-09-30T17:04:20.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3960000000000006e-06 2023-09-30T17:04:20.240 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.240 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.240 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.240 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.154572+0000", 2023-09-30T17:04:20.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6520000000000003e-06 2023-09-30T17:04:20.240 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.241 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.241 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.241 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.241 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137833 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.241 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.169569+0000", 2023-09-30T17:04:20.241 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.00053469699999999999, 2023-09-30T17:04:20.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00105708, 2023-09-30T17:04:20.241 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.241 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.241 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.242 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.242 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.242 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137833 2023-09-30T17:04:20.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.242 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.169569+0000", 2023-09-30T17:04:20.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.169569+0000", 2023-09-30T17:04:20.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.169570+0000", 2023-09-30T17:04:20.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8899999999999999e-07 2023-09-30T17:04:20.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.169587+0000", 2023-09-30T17:04:20.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7847999999999999e-05 2023-09-30T17:04:20.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.169602+0000", 2023-09-30T17:04:20.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4389999999999999e-05 2023-09-30T17:04:20.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.169607+0000", 2023-09-30T17:04:20.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3369999999999999e-06 2023-09-30T17:04:20.244 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.245 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.245 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.245 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136797 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.245 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.760675+0000", 2023-09-30T17:04:20.245 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.409429133, 2023-09-30T17:04:20.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.41000320099999998, 2023-09-30T17:04:20.245 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.245 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.246 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.246 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.246 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.246 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136797 2023-09-30T17:04:20.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.246 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.246 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.246 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.760675+0000", 2023-09-30T17:04:20.246 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.760675+0000", 2023-09-30T17:04:20.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.760675+0000", 2023-09-30T17:04:20.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2500000000000001e-07 2023-09-30T17:04:20.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.248 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.760692+0000", 2023-09-30T17:04:20.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6670000000000001e-05 2023-09-30T17:04:20.248 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.248 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.248 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.760701+0000", 2023-09-30T17:04:20.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6749999999999997e-06 2023-09-30T17:04:20.248 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.248 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.248 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.760706+0000", 2023-09-30T17:04:20.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9490000000000004e-06 2023-09-30T17:04:20.249 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.249 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.249 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.249 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136865 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.249 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.782629+0000", 2023-09-30T17:04:20.249 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.38747523299999997, 2023-09-30T17:04:20.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.38810192900000001, 2023-09-30T17:04:20.249 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.249 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.250 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.250 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.250 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.250 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136865 2023-09-30T17:04:20.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.250 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.782629+0000", 2023-09-30T17:04:20.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.782629+0000", 2023-09-30T17:04:20.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.786516+0000", 2023-09-30T17:04:20.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038870480000000002 2023-09-30T17:04:20.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.786529+0000", 2023-09-30T17:04:20.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3604000000000001e-05 2023-09-30T17:04:20.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.786538+0000", 2023-09-30T17:04:20.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.422e-06 2023-09-30T17:04:20.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.786544+0000", 2023-09-30T17:04:20.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0599999999999996e-06 2023-09-30T17:04:20.253 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.253 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.253 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.253 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136959 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.253 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.825005+0000", 2023-09-30T17:04:20.253 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.345098668, 2023-09-30T17:04:20.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.34577591600000002, 2023-09-30T17:04:20.253 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.254 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.254 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.254 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.254 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.254 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136959 2023-09-30T17:04:20.254 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.254 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.254 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.254 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.825005+0000", 2023-09-30T17:04:20.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.254 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.825005+0000", 2023-09-30T17:04:20.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.825036+0000", 2023-09-30T17:04:20.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1019999999999998e-05 2023-09-30T17:04:20.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.825047+0000", 2023-09-30T17:04:20.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1375999999999999e-05 2023-09-30T17:04:20.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.825054+0000", 2023-09-30T17:04:20.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8109999999999997e-06 2023-09-30T17:04:20.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.825061+0000", 2023-09-30T17:04:20.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5490000000000003e-06 2023-09-30T17:04:20.257 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.257 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.257 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.257 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.257 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136989 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.257 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.834719+0000", 2023-09-30T17:04:20.257 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.33538483299999999, 2023-09-30T17:04:20.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.33611372099999998, 2023-09-30T17:04:20.257 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.257 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.257 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.258 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.258 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.258 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136989 2023-09-30T17:04:20.258 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.258 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.258 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.834719+0000", 2023-09-30T17:04:20.258 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.258 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.259 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.834719+0000", 2023-09-30T17:04:20.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.259 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.834719+0000", 2023-09-30T17:04:20.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4999999999999998e-07 2023-09-30T17:04:20.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.259 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.834739+0000", 2023-09-30T17:04:20.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0196000000000001e-05 2023-09-30T17:04:20.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.834746+0000", 2023-09-30T17:04:20.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4180000000000002e-06 2023-09-30T17:04:20.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.834751+0000", 2023-09-30T17:04:20.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0189999999999997e-06 2023-09-30T17:04:20.260 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.261 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.261 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.261 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:135907 4.6 e54/17)", 2023-09-30T17:04:20.261 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.906329+0000", 2023-09-30T17:04:20.261 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.26377523899999999, 2023-09-30T17:04:20.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.26455869399999998, 2023-09-30T17:04:20.261 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.261 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.261 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.262 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.262 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.906329+0000", 2023-09-30T17:04:20.262 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.262 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.262 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.906329+0000", 2023-09-30T17:04:20.262 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.262 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.906329+0000", 2023-09-30T17:04:20.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9500000000000001e-07 2023-09-30T17:04:20.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.906346+0000", 2023-09-30T17:04:20.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6163000000000001e-05 2023-09-30T17:04:20.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.906354+0000", 2023-09-30T17:04:20.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1009999999999992e-06 2023-09-30T17:04:20.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.906360+0000", 2023-09-30T17:04:20.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4110000000000001e-06 2023-09-30T17:04:20.264 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.264 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.264 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.264 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136003 4.2e e54/17)", 2023-09-30T17:04:20.264 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.943247+0000", 2023-09-30T17:04:20.265 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.226856476, 2023-09-30T17:04:20.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.22768596799999999, 2023-09-30T17:04:20.265 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.265 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.265 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.943247+0000", 2023-09-30T17:04:20.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.266 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.943247+0000", 2023-09-30T17:04:20.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.266 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.266 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.266 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.266 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.943248+0000", 2023-09-30T17:04:20.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2099999999999998e-07 2023-09-30T17:04:20.266 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.266 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.266 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.266 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.943259+0000", 2023-09-30T17:04:20.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1729000000000001e-05 2023-09-30T17:04:20.267 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.267 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.267 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.943265+0000", 2023-09-30T17:04:20.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0050000000000001e-06 2023-09-30T17:04:20.267 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.267 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.267 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.943270+0000", 2023-09-30T17:04:20.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4039999999999997e-06 2023-09-30T17:04:20.267 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.267 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.268 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.268 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.268 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137436 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.268 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.986619+0000", 2023-09-30T17:04:20.268 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.18348457200000001, 2023-09-30T17:04:20.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.18436417499999999, 2023-09-30T17:04:20.268 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.268 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.268 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.268 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.268 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.269 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137436 2023-09-30T17:04:20.269 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.269 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.269 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.269 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.986619+0000", 2023-09-30T17:04:20.269 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.269 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.269 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.269 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.986619+0000", 2023-09-30T17:04:20.269 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.270 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.988534+0000", 2023-09-30T17:04:20.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001915082 2023-09-30T17:04:20.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.270 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.988554+0000", 2023-09-30T17:04:20.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.931e-05 2023-09-30T17:04:20.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.988565+0000", 2023-09-30T17:04:20.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1854e-05 2023-09-30T17:04:20.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.988575+0000", 2023-09-30T17:04:20.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3740000000000004e-06 2023-09-30T17:04:20.271 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.271 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.271 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.272 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136499 4.6 e54/17)", 2023-09-30T17:04:20.272 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.129572+0000", 2023-09-30T17:04:20.272 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.040531863000000001, 2023-09-30T17:04:20.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.041471223000000002, 2023-09-30T17:04:20.272 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.272 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.272 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.272 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.129572+0000", 2023-09-30T17:04:20.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.273 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.273 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.273 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.273 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.129572+0000", 2023-09-30T17:04:20.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.273 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.273 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.273 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.273 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.129573+0000", 2023-09-30T17:04:20.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0400000000000005e-07 2023-09-30T17:04:20.273 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.274 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.274 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.129588+0000", 2023-09-30T17:04:20.274 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4854999999999999e-05 2023-09-30T17:04:20.274 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.274 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.274 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.129600+0000", 2023-09-30T17:04:20.274 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2508e-05 2023-09-30T17:04:20.274 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.275 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.275 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.129608+0000", 2023-09-30T17:04:20.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8800000000000008e-06 2023-09-30T17:04:20.275 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.275 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.275 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.275 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.275 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(client.4547.0:137772 4.12 e54/17)", 2023-09-30T17:04:20.275 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.154581+0000", 2023-09-30T17:04:20.275 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.015522803999999999, 2023-09-30T17:04:20.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016517938999999999, 2023-09-30T17:04:20.276 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.276 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.276 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.154581+0000", 2023-09-30T17:04:20.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.154581+0000", 2023-09-30T17:04:20.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.154581+0000", 2023-09-30T17:04:20.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1800000000000002e-07 2023-09-30T17:04:20.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.154584+0000", 2023-09-30T17:04:20.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5620000000000002e-06 2023-09-30T17:04:20.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.154591+0000", 2023-09-30T17:04:20.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7309999999999996e-06 2023-09-30T17:04:20.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.154596+0000", 2023-09-30T17:04:20.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1719999999999998e-06 2023-09-30T17:04:20.279 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.279 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.279 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.279 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:137449 4.28 e54/17)", 2023-09-30T17:04:20.279 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.169697+0000", 2023-09-30T17:04:20.279 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.00040705, 2023-09-30T17:04:20.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014540919999999999, 2023-09-30T17:04:20.280 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.280 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.280 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.280 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.280 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.169697+0000", 2023-09-30T17:04:20.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.280 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.280 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.169697+0000", 2023-09-30T17:04:20.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.169697+0000", 2023-09-30T17:04:20.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9999999999999997e-07 2023-09-30T17:04:20.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.169711+0000", 2023-09-30T17:04:20.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3251000000000001e-05 2023-09-30T17:04:20.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.169718+0000", 2023-09-30T17:04:20.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3769999999999998e-06 2023-09-30T17:04:20.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.169723+0000", 2023-09-30T17:04:20.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4720000000000003e-06 2023-09-30T17:04:20.282 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.282 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.282 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.283 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136621 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.283 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.683585+0000", 2023-09-30T17:04:20.283 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.486519019, 2023-09-30T17:04:20.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.487622361, 2023-09-30T17:04:20.283 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.283 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.283 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.283 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.283 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.284 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136621 2023-09-30T17:04:20.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.284 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.284 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.284 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.683585+0000", 2023-09-30T17:04:20.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.284 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.284 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.683585+0000", 2023-09-30T17:04:20.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.683585+0000", 2023-09-30T17:04:20.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.51e-07 2023-09-30T17:04:20.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.683595+0000", 2023-09-30T17:04:20.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0146000000000001e-05 2023-09-30T17:04:20.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.683602+0000", 2023-09-30T17:04:20.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.64e-06 2023-09-30T17:04:20.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.683607+0000", 2023-09-30T17:04:20.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3669999999999996e-06 2023-09-30T17:04:20.286 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.286 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.286 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.287 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136991 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.287 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.834757+0000", 2023-09-30T17:04:20.287 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.33534656499999999, 2023-09-30T17:04:20.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.33652068400000001, 2023-09-30T17:04:20.287 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.287 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.287 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.287 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.288 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.288 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136991 2023-09-30T17:04:20.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.288 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.834757+0000", 2023-09-30T17:04:20.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.289 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.289 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.834757+0000", 2023-09-30T17:04:20.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.289 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.289 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.289 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.834758+0000", 2023-09-30T17:04:20.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8700000000000001e-07 2023-09-30T17:04:20.289 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.289 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.289 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.834774+0000", 2023-09-30T17:04:20.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6222000000000002e-05 2023-09-30T17:04:20.290 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.290 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.834780+0000", 2023-09-30T17:04:20.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.212e-06 2023-09-30T17:04:20.290 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.290 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.834785+0000", 2023-09-30T17:04:20.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6569999999999996e-06 2023-09-30T17:04:20.290 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.291 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.291 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.291 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:135912 4.36 e54/17)", 2023-09-30T17:04:20.291 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.906377+0000", 2023-09-30T17:04:20.291 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.26372709799999999, 2023-09-30T17:04:20.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.26496678400000001, 2023-09-30T17:04:20.291 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.291 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.291 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.906377+0000", 2023-09-30T17:04:20.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.906377+0000", 2023-09-30T17:04:20.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.293 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.906377+0000", 2023-09-30T17:04:20.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3900000000000001e-07 2023-09-30T17:04:20.293 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.293 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.293 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.906385+0000", 2023-09-30T17:04:20.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2069999999999995e-06 2023-09-30T17:04:20.293 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.293 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.293 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.906389+0000", 2023-09-30T17:04:20.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8419999999999998e-06 2023-09-30T17:04:20.294 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.294 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.294 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.906392+0000", 2023-09-30T17:04:20.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8679999999999999e-06 2023-09-30T17:04:20.294 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.294 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.294 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.294 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.294 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136372 4.36 e54/17)", 2023-09-30T17:04:20.295 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.077119+0000", 2023-09-30T17:04:20.295 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.092984555999999996, 2023-09-30T17:04:20.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.094281024000000005, 2023-09-30T17:04:20.295 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.295 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.295 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.077119+0000", 2023-09-30T17:04:20.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.296 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.296 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.077119+0000", 2023-09-30T17:04:20.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.296 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.296 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.077119+0000", 2023-09-30T17:04:20.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.28e-07 2023-09-30T17:04:20.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.296 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.077130+0000", 2023-09-30T17:04:20.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0132999999999999e-05 2023-09-30T17:04:20.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.077134+0000", 2023-09-30T17:04:20.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5199999999999999e-06 2023-09-30T17:04:20.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.297 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.077137+0000", 2023-09-30T17:04:20.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.92e-06 2023-09-30T17:04:20.298 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.298 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.298 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.298 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136519 4.6 e54/17)", 2023-09-30T17:04:20.298 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.141212+0000", 2023-09-30T17:04:20.298 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.028891910999999999, 2023-09-30T17:04:20.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.030239015000000001, 2023-09-30T17:04:20.298 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.299 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.299 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.299 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.299 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.141212+0000", 2023-09-30T17:04:20.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.299 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.299 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.299 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.141212+0000", 2023-09-30T17:04:20.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.300 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.300 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.141212+0000", 2023-09-30T17:04:20.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6499999999999999e-07 2023-09-30T17:04:20.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.300 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.300 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.141227+0000", 2023-09-30T17:04:20.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4946000000000001e-05 2023-09-30T17:04:20.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.301 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.141234+0000", 2023-09-30T17:04:20.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5529999999999998e-06 2023-09-30T17:04:20.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.301 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.141240+0000", 2023-09-30T17:04:20.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1859999999999997e-06 2023-09-30T17:04:20.301 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.301 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.301 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.302 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.302 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137802 4.29 4:94178d8a:::100000001f8.00000006:head [write 1884160~4096 in=4096b,write 2199552~4096 in=4096b,write 2269184~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.302 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.154390+0000", 2023-09-30T17:04:20.302 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.015713557, 2023-09-30T17:04:20.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017117374000000001, 2023-09-30T17:04:20.302 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.302 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:20.302 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.302 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.302 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.302 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137802 2023-09-30T17:04:20.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.303 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.303 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.303 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.154390+0000", 2023-09-30T17:04:20.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.303 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.303 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.154390+0000", 2023-09-30T17:04:20.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.304 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.304 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.157517+0000", 2023-09-30T17:04:20.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0031265590000000001 2023-09-30T17:04:20.304 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.304 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.304 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.157539+0000", 2023-09-30T17:04:20.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2555999999999999e-05 2023-09-30T17:04:20.304 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.304 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.305 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.157550+0000", 2023-09-30T17:04:20.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0934000000000001e-05 2023-09-30T17:04:20.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.305 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.305 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.157559+0000", 2023-09-30T17:04:20.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4120000000000001e-06 2023-09-30T17:04:20.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.305 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:20.305 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.158603+0000", 2023-09-30T17:04:20.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0010441700000000001 2023-09-30T17:04:20.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:20.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.158703+0000", 2023-09-30T17:04:20.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010005699999999999 2023-09-30T17:04:20.306 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.306 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.306 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.306 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136692 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.306 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.714582+0000", 2023-09-30T17:04:20.307 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.45552210900000001, 2023-09-30T17:04:20.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.45700760899999998, 2023-09-30T17:04:20.307 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.307 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.307 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.307 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.307 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.307 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136692 2023-09-30T17:04:20.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.307 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.308 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.308 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.714582+0000", 2023-09-30T17:04:20.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.308 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.308 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.714582+0000", 2023-09-30T17:04:20.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.308 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.719564+0000", 2023-09-30T17:04:20.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004982106 2023-09-30T17:04:20.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.719579+0000", 2023-09-30T17:04:20.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5438e-05 2023-09-30T17:04:20.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.719587+0000", 2023-09-30T17:04:20.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9529999999999999e-06 2023-09-30T17:04:20.310 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.310 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.310 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.310 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.719594+0000", 2023-09-30T17:04:20.310 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8800000000000002e-06 2023-09-30T17:04:20.310 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.310 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.310 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.310 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.310 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.310 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136730 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.310 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.731808+0000", 2023-09-30T17:04:20.311 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.43829542199999999, 2023-09-30T17:04:20.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.43981580300000001, 2023-09-30T17:04:20.311 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.311 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.311 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.311 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.311 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.311 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136730 2023-09-30T17:04:20.311 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.311 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.311 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.312 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.731808+0000", 2023-09-30T17:04:20.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.312 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.731808+0000", 2023-09-30T17:04:20.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.312 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.731841+0000", 2023-09-30T17:04:20.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2305999999999999e-05 2023-09-30T17:04:20.313 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.731850+0000", 2023-09-30T17:04:20.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6870000000000006e-06 2023-09-30T17:04:20.313 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.731856+0000", 2023-09-30T17:04:20.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7039999999999999e-06 2023-09-30T17:04:20.313 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.314 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.731860+0000", 2023-09-30T17:04:20.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2010000000000001e-06 2023-09-30T17:04:20.314 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.314 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.314 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.314 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136800 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.314 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.760773+0000", 2023-09-30T17:04:20.314 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.409330415, 2023-09-30T17:04:20.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.41090884300000002, 2023-09-30T17:04:20.315 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.315 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.315 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.315 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.315 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.315 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136800 2023-09-30T17:04:20.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.315 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.315 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.760773+0000", 2023-09-30T17:04:20.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.760773+0000", 2023-09-30T17:04:20.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.760774+0000", 2023-09-30T17:04:20.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5900000000000002e-07 2023-09-30T17:04:20.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.317 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.317 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.760809+0000", 2023-09-30T17:04:20.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5568000000000002e-05 2023-09-30T17:04:20.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.317 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.317 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.760816+0000", 2023-09-30T17:04:20.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8990000000000004e-06 2023-09-30T17:04:20.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.760829+0000", 2023-09-30T17:04:20.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2481e-05 2023-09-30T17:04:20.318 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.318 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.318 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.318 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137043 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.318 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.852627+0000", 2023-09-30T17:04:20.319 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.31747720600000001, 2023-09-30T17:04:20.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.31910834999999999, 2023-09-30T17:04:20.319 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.319 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.319 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.319 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.319 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.319 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137043 2023-09-30T17:04:20.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.319 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.852627+0000", 2023-09-30T17:04:20.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.852627+0000", 2023-09-30T17:04:20.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.321 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.852627+0000", 2023-09-30T17:04:20.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2e-07 2023-09-30T17:04:20.321 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.321 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.321 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.852637+0000", 2023-09-30T17:04:20.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0226e-05 2023-09-30T17:04:20.321 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.852643+0000", 2023-09-30T17:04:20.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6149999999999996e-06 2023-09-30T17:04:20.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.852647+0000", 2023-09-30T17:04:20.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.374e-06 2023-09-30T17:04:20.323 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.323 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.323 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.323 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137100 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.323 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.863105+0000", 2023-09-30T17:04:20.323 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.30699911699999999, 2023-09-30T17:04:20.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.30868940900000003, 2023-09-30T17:04:20.323 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.323 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.323 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.324 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.324 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.324 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137100 2023-09-30T17:04:20.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.324 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.863105+0000", 2023-09-30T17:04:20.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.863105+0000", 2023-09-30T17:04:20.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.863105+0000", 2023-09-30T17:04:20.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1899999999999998e-07 2023-09-30T17:04:20.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.863119+0000", 2023-09-30T17:04:20.326 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3869000000000001e-05 2023-09-30T17:04:20.326 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.326 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.326 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.863127+0000", 2023-09-30T17:04:20.326 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3520000000000007e-06 2023-09-30T17:04:20.326 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.326 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.326 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.863132+0000", 2023-09-30T17:04:20.326 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8010000000000003e-06 2023-09-30T17:04:20.327 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.327 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.327 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.327 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137183 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.327 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.891579+0000", 2023-09-30T17:04:20.327 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.27852448000000002, 2023-09-30T17:04:20.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.28027474899999999, 2023-09-30T17:04:20.327 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.327 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.327 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.328 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.328 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.328 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137183 2023-09-30T17:04:20.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.328 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.891579+0000", 2023-09-30T17:04:20.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.891579+0000", 2023-09-30T17:04:20.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.329 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.891580+0000", 2023-09-30T17:04:20.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0900000000000001e-07 2023-09-30T17:04:20.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.329 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.891594+0000", 2023-09-30T17:04:20.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3723000000000001e-05 2023-09-30T17:04:20.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.330 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.330 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.891602+0000", 2023-09-30T17:04:20.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1179999999999992e-06 2023-09-30T17:04:20.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.330 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.330 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.891607+0000", 2023-09-30T17:04:20.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5910000000000003e-06 2023-09-30T17:04:20.331 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.331 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.331 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.331 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.331 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.331 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137372 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.331 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.958565+0000", 2023-09-30T17:04:20.331 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.211538744, 2023-09-30T17:04:20.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.213348274, 2023-09-30T17:04:20.331 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.331 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.332 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.332 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.332 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.332 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137372 2023-09-30T17:04:20.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.332 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.958565+0000", 2023-09-30T17:04:20.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.958565+0000", 2023-09-30T17:04:20.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.958566+0000", 2023-09-30T17:04:20.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5599999999999995e-07 2023-09-30T17:04:20.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.958577+0000", 2023-09-30T17:04:20.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1552999999999999e-05 2023-09-30T17:04:20.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.958585+0000", 2023-09-30T17:04:20.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6450000000000005e-06 2023-09-30T17:04:20.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.958591+0000", 2023-09-30T17:04:20.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8690000000000001e-06 2023-09-30T17:04:20.334 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.335 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.335 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.335 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.335 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.335 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137443 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.335 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.988636+0000", 2023-09-30T17:04:20.335 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.181467828, 2023-09-30T17:04:20.335 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.183343802, 2023-09-30T17:04:20.335 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.335 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.335 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.336 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.336 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.336 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137443 2023-09-30T17:04:20.336 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.336 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.336 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.336 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.336 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.988636+0000", 2023-09-30T17:04:20.336 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.336 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.336 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.336 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.337 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.988636+0000", 2023-09-30T17:04:20.337 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.337 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.337 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.337 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.337 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.988636+0000", 2023-09-30T17:04:20.337 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9699999999999996e-07 2023-09-30T17:04:20.337 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.337 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.337 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.337 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.988650+0000", 2023-09-30T17:04:20.337 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3182e-05 2023-09-30T17:04:20.337 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.338 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.338 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.338 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.988657+0000", 2023-09-30T17:04:20.338 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0709999999999997e-06 2023-09-30T17:04:20.338 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.338 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.338 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.338 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.988662+0000", 2023-09-30T17:04:20.338 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5979999999999996e-06 2023-09-30T17:04:20.338 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.338 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.339 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.339 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.339 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.339 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137462 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.339 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.004565+0000", 2023-09-30T17:04:20.339 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.16553915, 2023-09-30T17:04:20.339 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.16747963399999999, 2023-09-30T17:04:20.339 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.339 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.339 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.339 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.340 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.340 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137462 2023-09-30T17:04:20.340 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.340 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.340 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.340 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.340 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.004565+0000", 2023-09-30T17:04:20.340 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.340 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.340 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.341 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.341 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.004565+0000", 2023-09-30T17:04:20.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.341 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.341 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.341 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.004565+0000", 2023-09-30T17:04:20.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5899999999999996e-07 2023-09-30T17:04:20.341 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.342 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.342 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.004577+0000", 2023-09-30T17:04:20.342 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2317000000000001e-05 2023-09-30T17:04:20.342 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.342 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.342 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.342 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.004585+0000", 2023-09-30T17:04:20.342 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1879999999999996e-06 2023-09-30T17:04:20.343 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.343 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.343 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.343 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.004590+0000", 2023-09-30T17:04:20.343 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.361e-06 2023-09-30T17:04:20.343 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.343 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.343 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.343 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.343 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.343 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137555 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.343 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.040565+0000", 2023-09-30T17:04:20.344 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.129538872, 2023-09-30T17:04:20.344 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.13154062499999999, 2023-09-30T17:04:20.344 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.344 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.344 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.344 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.344 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.344 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137555 2023-09-30T17:04:20.345 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.345 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.345 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.345 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.345 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.040565+0000", 2023-09-30T17:04:20.345 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.345 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.345 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.345 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.345 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.040565+0000", 2023-09-30T17:04:20.346 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.346 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.346 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.346 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.346 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.046519+0000", 2023-09-30T17:04:20.346 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059536859999999997 2023-09-30T17:04:20.346 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.346 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.347 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.347 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.046535+0000", 2023-09-30T17:04:20.347 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6920999999999999e-05 2023-09-30T17:04:20.347 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.347 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.347 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.347 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.046551+0000", 2023-09-30T17:04:20.347 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5279999999999999e-05 2023-09-30T17:04:20.347 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.347 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.347 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.348 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.046558+0000", 2023-09-30T17:04:20.348 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2509999999999997e-06 2023-09-30T17:04:20.348 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.348 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.348 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.348 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.348 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.348 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136330 4.36 e54/17)", 2023-09-30T17:04:20.348 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.059224+0000", 2023-09-30T17:04:20.349 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.110880035, 2023-09-30T17:04:20.349 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.112947901, 2023-09-30T17:04:20.349 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.349 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.349 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.349 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.349 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.349 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.059224+0000", 2023-09-30T17:04:20.350 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.350 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.350 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.350 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.350 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.059224+0000", 2023-09-30T17:04:20.350 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.350 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.350 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.350 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.351 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.059224+0000", 2023-09-30T17:04:20.351 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6199999999999998e-07 2023-09-30T17:04:20.351 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.351 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.351 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.351 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.059235+0000", 2023-09-30T17:04:20.351 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.101e-05 2023-09-30T17:04:20.351 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.352 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.352 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.352 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.059245+0000", 2023-09-30T17:04:20.352 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3470000000000005e-06 2023-09-30T17:04:20.352 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.352 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.352 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.352 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.059250+0000", 2023-09-30T17:04:20.352 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.967e-06 2023-09-30T17:04:20.353 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.353 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.353 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.353 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.353 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.353 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136361 4.6 e54/17)", 2023-09-30T17:04:20.353 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.077142+0000", 2023-09-30T17:04:20.353 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.092962236000000004, 2023-09-30T17:04:20.353 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.095081635999999997, 2023-09-30T17:04:20.353 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.353 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.354 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.354 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.354 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.354 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.077142+0000", 2023-09-30T17:04:20.354 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.354 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.354 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.354 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.354 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.077142+0000", 2023-09-30T17:04:20.354 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.354 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.354 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.355 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.355 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.077142+0000", 2023-09-30T17:04:20.355 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.43e-07 2023-09-30T17:04:20.355 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.355 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.355 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.355 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.077151+0000", 2023-09-30T17:04:20.355 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9770000000000006e-06 2023-09-30T17:04:20.355 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.355 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.355 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.355 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.077154+0000", 2023-09-30T17:04:20.356 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.416e-06 2023-09-30T17:04:20.356 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.356 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.356 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.356 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.077158+0000", 2023-09-30T17:04:20.356 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.963e-06 2023-09-30T17:04:20.356 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.356 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.356 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.356 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.356 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.356 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136436 4.6 e54/17)", 2023-09-30T17:04:20.357 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.094058+0000", 2023-09-30T17:04:20.357 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.076045282000000006, 2023-09-30T17:04:20.357 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.078216591000000002, 2023-09-30T17:04:20.357 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.357 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.357 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.357 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.357 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.357 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.094058+0000", 2023-09-30T17:04:20.357 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.357 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.357 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.357 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.358 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.094058+0000", 2023-09-30T17:04:20.358 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.358 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.358 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.358 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.358 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.094059+0000", 2023-09-30T17:04:20.358 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1899999999999999e-07 2023-09-30T17:04:20.358 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.358 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.358 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.358 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.094069+0000", 2023-09-30T17:04:20.358 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0560999999999999e-05 2023-09-30T17:04:20.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.359 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.359 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.359 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.094075+0000", 2023-09-30T17:04:20.359 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6930000000000004e-06 2023-09-30T17:04:20.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.359 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.359 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.359 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.094079+0000", 2023-09-30T17:04:20.359 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5000000000000001e-06 2023-09-30T17:04:20.359 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.359 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.360 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.360 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.360 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.360 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137807 4.1b 4:dbd503eb:::100000001f8.0000002e:head [write 2801664~4096 in=4096b,write 2838528~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.360 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.157574+0000", 2023-09-30T17:04:20.360 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.012529642000000001, 2023-09-30T17:04:20.360 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014767963, 2023-09-30T17:04:20.360 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.360 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:20.360 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.360 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.360 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.361 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137807 2023-09-30T17:04:20.361 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.361 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.361 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.361 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.361 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.157574+0000", 2023-09-30T17:04:20.361 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.361 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.361 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.361 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.361 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.157574+0000", 2023-09-30T17:04:20.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.362 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.362 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.362 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.362 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.157575+0000", 2023-09-30T17:04:20.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3099999999999998e-07 2023-09-30T17:04:20.362 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.362 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.362 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.362 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.157588+0000", 2023-09-30T17:04:20.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3294e-05 2023-09-30T17:04:20.362 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.363 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.363 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.363 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.157594+0000", 2023-09-30T17:04:20.363 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3470000000000004e-06 2023-09-30T17:04:20.363 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.363 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.363 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.363 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.157599+0000", 2023-09-30T17:04:20.363 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1030000000000001e-06 2023-09-30T17:04:20.363 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.364 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.364 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:20.364 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.157645+0000", 2023-09-30T17:04:20.364 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5597999999999999e-05 2023-09-30T17:04:20.364 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.364 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.364 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:20.364 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.157721+0000", 2023-09-30T17:04:20.364 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6370000000000002e-05 2023-09-30T17:04:20.364 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.364 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.364 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.365 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.365 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.365 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:137465 4.3b e54/17 4:dcc0c15f:::100000001f8.0000001a:head v 54'2240, mlcod=54'2237)", 2023-09-30T17:04:20.365 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.169752+0000", 2023-09-30T17:04:20.365 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.00035198, 2023-09-30T17:04:20.365 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0026661710000000002, 2023-09-30T17:04:20.365 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.365 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:20.365 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.365 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.365 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.365 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.169752+0000", 2023-09-30T17:04:20.366 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.366 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.366 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.366 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.366 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.169752+0000", 2023-09-30T17:04:20.366 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.366 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.366 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.366 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.366 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.169752+0000", 2023-09-30T17:04:20.366 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1500000000000001e-07 2023-09-30T17:04:20.367 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.367 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.367 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.169766+0000", 2023-09-30T17:04:20.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3905e-05 2023-09-30T17:04:20.367 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.367 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.367 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.169771+0000", 2023-09-30T17:04:20.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5550000000000002e-06 2023-09-30T17:04:20.367 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.169777+0000", 2023-09-30T17:04:20.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0599999999999998e-06 2023-09-30T17:04:20.368 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:20.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.169824+0000", 2023-09-30T17:04:20.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7543999999999997e-05 2023-09-30T17:04:20.368 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:20.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.169846+0000", 2023-09-30T17:04:20.369 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1505000000000002e-05 2023-09-30T17:04:20.369 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.369 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.369 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.369 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.369 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.369 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136444 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.369 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.614580+0000", 2023-09-30T17:04:20.369 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.55552393, 2023-09-30T17:04:20.369 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.55790282800000002, 2023-09-30T17:04:20.369 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.369 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.370 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.370 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.370 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.370 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136444 2023-09-30T17:04:20.370 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.370 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.370 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.370 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.370 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.614580+0000", 2023-09-30T17:04:20.370 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.370 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.370 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.371 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.371 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.614580+0000", 2023-09-30T17:04:20.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.371 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.371 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.371 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.614580+0000", 2023-09-30T17:04:20.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9900000000000001e-07 2023-09-30T17:04:20.371 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.371 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.371 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.614592+0000", 2023-09-30T17:04:20.372 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2143e-05 2023-09-30T17:04:20.372 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.372 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.372 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.372 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.614598+0000", 2023-09-30T17:04:20.372 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9190000000000004e-06 2023-09-30T17:04:20.372 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.372 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.372 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.372 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.614602+0000", 2023-09-30T17:04:20.372 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6389999999999998e-06 2023-09-30T17:04:20.372 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.373 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.373 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.373 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.373 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.373 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136693 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.373 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.719605+0000", 2023-09-30T17:04:20.373 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.45049904400000002, 2023-09-30T17:04:20.373 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.45294846100000002, 2023-09-30T17:04:20.373 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.373 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.373 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.373 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.374 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.374 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136693 2023-09-30T17:04:20.374 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.374 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.374 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.374 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.374 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.719605+0000", 2023-09-30T17:04:20.374 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.374 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.374 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.374 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.374 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.719605+0000", 2023-09-30T17:04:20.375 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.375 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.375 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.375 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.375 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.719605+0000", 2023-09-30T17:04:20.375 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6000000000000004e-07 2023-09-30T17:04:20.375 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.375 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.376 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.376 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.719621+0000", 2023-09-30T17:04:20.376 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5914e-05 2023-09-30T17:04:20.376 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.376 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.376 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.376 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.719628+0000", 2023-09-30T17:04:20.376 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8190000000000003e-06 2023-09-30T17:04:20.376 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.376 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.377 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.377 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.719634+0000", 2023-09-30T17:04:20.377 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1469999999999998e-06 2023-09-30T17:04:20.377 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.377 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.377 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.377 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.377 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.377 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137261 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.377 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.918714+0000", 2023-09-30T17:04:20.377 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.25138941399999998, 2023-09-30T17:04:20.378 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.25389465700000002, 2023-09-30T17:04:20.378 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.378 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.378 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.378 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.378 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.378 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137261 2023-09-30T17:04:20.378 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.378 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.378 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.378 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.379 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.918714+0000", 2023-09-30T17:04:20.379 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.379 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.379 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.379 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.379 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.918714+0000", 2023-09-30T17:04:20.379 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.379 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.379 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.379 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.379 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.918715+0000", 2023-09-30T17:04:20.379 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0999999999999999e-07 2023-09-30T17:04:20.379 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.380 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.380 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.380 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.918730+0000", 2023-09-30T17:04:20.380 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4922999999999999e-05 2023-09-30T17:04:20.380 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.380 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.380 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.380 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.918736+0000", 2023-09-30T17:04:20.380 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4609999999999996e-06 2023-09-30T17:04:20.380 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.380 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.380 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.381 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.918740+0000", 2023-09-30T17:04:20.381 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6090000000000001e-06 2023-09-30T17:04:20.381 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.381 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.381 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.381 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.381 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.381 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136018 4.2e e54/17)", 2023-09-30T17:04:20.381 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.943336+0000", 2023-09-30T17:04:20.381 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.22676782400000001, 2023-09-30T17:04:20.381 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.22932091600000001, 2023-09-30T17:04:20.381 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.382 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.382 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.382 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.382 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.382 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.943336+0000", 2023-09-30T17:04:20.382 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.382 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.382 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.382 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.382 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.943336+0000", 2023-09-30T17:04:20.382 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.383 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.383 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.383 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.383 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.943336+0000", 2023-09-30T17:04:20.383 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9500000000000001e-07 2023-09-30T17:04:20.383 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.383 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.383 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.383 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.943348+0000", 2023-09-30T17:04:20.383 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1802e-05 2023-09-30T17:04:20.383 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.384 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.384 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.384 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.943354+0000", 2023-09-30T17:04:20.384 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3389999999999998e-06 2023-09-30T17:04:20.384 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.384 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.384 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.384 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.943358+0000", 2023-09-30T17:04:20.384 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0489999999999997e-06 2023-09-30T17:04:20.384 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.384 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.384 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.385 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.385 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.385 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137505 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.385 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.012959+0000", 2023-09-30T17:04:20.385 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.15714508199999999, 2023-09-30T17:04:20.385 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.15974511999999999, 2023-09-30T17:04:20.385 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.385 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.385 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.385 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.385 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.386 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137505 2023-09-30T17:04:20.386 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.386 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.386 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.386 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.386 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.012959+0000", 2023-09-30T17:04:20.386 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.386 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.387 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.387 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.387 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.012959+0000", 2023-09-30T17:04:20.387 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.387 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.387 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.387 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.387 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.014522+0000", 2023-09-30T17:04:20.388 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0015629120000000001 2023-09-30T17:04:20.388 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.388 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.388 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.388 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.014542+0000", 2023-09-30T17:04:20.388 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9976999999999999e-05 2023-09-30T17:04:20.388 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.388 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.388 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.388 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.014551+0000", 2023-09-30T17:04:20.388 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6930000000000002e-06 2023-09-30T17:04:20.389 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.389 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.389 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.389 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.014558+0000", 2023-09-30T17:04:20.389 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1740000000000003e-06 2023-09-30T17:04:20.389 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.389 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.389 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.389 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.389 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.389 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137544 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.389 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.031155+0000", 2023-09-30T17:04:20.390 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.138948294, 2023-09-30T17:04:20.390 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.141606238, 2023-09-30T17:04:20.390 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.390 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.390 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.390 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.390 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.390 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137544 2023-09-30T17:04:20.390 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.390 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.390 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.390 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.391 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.031155+0000", 2023-09-30T17:04:20.391 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.391 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.391 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.391 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.391 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.031155+0000", 2023-09-30T17:04:20.391 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.391 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.391 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.391 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.391 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.031156+0000", 2023-09-30T17:04:20.391 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1300000000000001e-07 2023-09-30T17:04:20.392 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.392 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.392 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.392 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.031167+0000", 2023-09-30T17:04:20.392 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1367e-05 2023-09-30T17:04:20.392 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.392 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.392 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.392 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.031176+0000", 2023-09-30T17:04:20.392 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3019999999999995e-06 2023-09-30T17:04:20.392 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.392 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.393 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.393 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.031182+0000", 2023-09-30T17:04:20.393 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6610000000000003e-06 2023-09-30T17:04:20.393 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.393 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.393 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.393 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.393 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.393 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137558 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.393 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.046571+0000", 2023-09-30T17:04:20.393 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.123532615, 2023-09-30T17:04:20.394 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.12624643699999999, 2023-09-30T17:04:20.394 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.394 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.394 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.394 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.394 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.394 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137558 2023-09-30T17:04:20.394 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.394 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.394 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.394 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.395 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.046571+0000", 2023-09-30T17:04:20.395 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.395 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.395 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.395 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.395 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.046571+0000", 2023-09-30T17:04:20.395 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.395 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.395 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.395 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.395 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.046572+0000", 2023-09-30T17:04:20.395 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4000000000000002e-07 2023-09-30T17:04:20.396 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.396 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.396 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.396 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.046587+0000", 2023-09-30T17:04:20.396 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5071e-05 2023-09-30T17:04:20.396 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.396 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.396 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.396 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.046594+0000", 2023-09-30T17:04:20.396 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7769999999999997e-06 2023-09-30T17:04:20.396 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.396 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.397 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.397 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.046600+0000", 2023-09-30T17:04:20.397 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3489999999999997e-06 2023-09-30T17:04:20.397 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.397 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.397 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.397 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.397 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.397 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136474 4.6 e54/17)", 2023-09-30T17:04:20.397 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.112430+0000", 2023-09-30T17:04:20.397 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.057674248999999997, 2023-09-30T17:04:20.397 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.060440348999999997, 2023-09-30T17:04:20.398 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.398 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.398 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.398 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.398 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.398 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.112430+0000", 2023-09-30T17:04:20.398 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.398 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.398 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.398 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.398 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.112430+0000", 2023-09-30T17:04:20.398 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.399 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.399 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.399 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.399 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.112430+0000", 2023-09-30T17:04:20.399 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1799999999999999e-07 2023-09-30T17:04:20.399 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.399 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.399 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.399 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.112447+0000", 2023-09-30T17:04:20.399 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7309999999999999e-05 2023-09-30T17:04:20.400 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.400 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.400 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.400 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.112457+0000", 2023-09-30T17:04:20.400 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0349e-05 2023-09-30T17:04:20.400 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.400 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.400 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.400 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.112462+0000", 2023-09-30T17:04:20.400 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8590000000000004e-06 2023-09-30T17:04:20.400 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.400 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.401 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.401 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.401 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.401 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137808 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.401 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.157611+0000", 2023-09-30T17:04:20.401 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.012493000000000001, 2023-09-30T17:04:20.401 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015308699, 2023-09-30T17:04:20.401 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.401 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.401 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.401 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.402 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.402 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137808 2023-09-30T17:04:20.402 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.402 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.402 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.402 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.402 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.157611+0000", 2023-09-30T17:04:20.402 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.402 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.402 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.402 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.402 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.157611+0000", 2023-09-30T17:04:20.403 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.403 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.403 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.403 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.403 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.157611+0000", 2023-09-30T17:04:20.403 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9999999999999998e-07 2023-09-30T17:04:20.403 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.403 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.403 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.403 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.157623+0000", 2023-09-30T17:04:20.403 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1908e-05 2023-09-30T17:04:20.403 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.404 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.404 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.404 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.157629+0000", 2023-09-30T17:04:20.404 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.015e-06 2023-09-30T17:04:20.404 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.404 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.404 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.404 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.157634+0000", 2023-09-30T17:04:20.404 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8829999999999997e-06 2023-09-30T17:04:20.404 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.404 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.405 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.405 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.405 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.405 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136610 4.36 e54/17)", 2023-09-30T17:04:20.405 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.169789+0000", 2023-09-30T17:04:20.405 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.00031521099999999997, 2023-09-30T17:04:20.405 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0031859980000000002, 2023-09-30T17:04:20.405 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.405 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.405 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.406 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.406 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.406 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.169789+0000", 2023-09-30T17:04:20.406 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.406 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.406 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.406 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.406 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.169789+0000", 2023-09-30T17:04:20.406 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.406 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.406 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.407 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.407 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.169789+0000", 2023-09-30T17:04:20.407 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4900000000000002e-07 2023-09-30T17:04:20.407 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.407 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.407 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.407 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.169800+0000", 2023-09-30T17:04:20.407 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1231e-05 2023-09-30T17:04:20.407 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.408 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.408 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.408 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.169806+0000", 2023-09-30T17:04:20.408 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6860000000000003e-06 2023-09-30T17:04:20.408 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.408 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.408 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.408 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.169810+0000", 2023-09-30T17:04:20.408 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2139999999999998e-06 2023-09-30T17:04:20.408 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.408 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.408 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.409 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.409 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.409 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136445 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.409 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.614608+0000", 2023-09-30T17:04:20.409 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.55549544299999998, 2023-09-30T17:04:20.409 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.55842715499999995, 2023-09-30T17:04:20.409 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.409 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.409 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.410 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.410 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.410 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136445 2023-09-30T17:04:20.410 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.410 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.410 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.410 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.410 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.614608+0000", 2023-09-30T17:04:20.410 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.411 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.411 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.411 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.411 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.614608+0000", 2023-09-30T17:04:20.411 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.411 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.411 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.411 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.411 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.614609+0000", 2023-09-30T17:04:20.412 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8299999999999998e-07 2023-09-30T17:04:20.412 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.412 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.412 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.412 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.614618+0000", 2023-09-30T17:04:20.412 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.516e-06 2023-09-30T17:04:20.412 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.412 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.412 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.412 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.614626+0000", 2023-09-30T17:04:20.412 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4359999999999996e-06 2023-09-30T17:04:20.412 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.413 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.413 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.413 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.614629+0000", 2023-09-30T17:04:20.413 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6040000000000001e-06 2023-09-30T17:04:20.413 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.413 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.413 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.413 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.413 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.413 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:135660 4.6 e54/17 4:62d56fc8:::100000001f8.0000001c:head v 54'8354, mlcod=54'8293)", 2023-09-30T17:04:20.414 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.842069+0000", 2023-09-30T17:04:20.414 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.328034557, 2023-09-30T17:04:20.414 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.33102694999999999, 2023-09-30T17:04:20.414 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.414 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:20.414 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.414 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.414 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.414 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.842069+0000", 2023-09-30T17:04:20.414 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.414 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.414 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.415 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.415 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.842069+0000", 2023-09-30T17:04:20.415 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.415 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.415 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.415 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.415 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.842069+0000", 2023-09-30T17:04:20.415 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3799999999999999e-07 2023-09-30T17:04:20.415 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.415 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.415 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.415 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.842082+0000", 2023-09-30T17:04:20.416 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2114e-05 2023-09-30T17:04:20.416 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.416 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.416 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.416 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.842088+0000", 2023-09-30T17:04:20.416 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.319e-06 2023-09-30T17:04:20.416 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.416 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.416 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.416 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.842093+0000", 2023-09-30T17:04:20.416 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5430000000000001e-06 2023-09-30T17:04:20.416 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.417 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.417 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:20.417 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.146557+0000", 2023-09-30T17:04:20.417 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.304463282 2023-09-30T17:04:20.417 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.417 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.417 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:20.417 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.146577+0000", 2023-09-30T17:04:20.418 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0579999999999999e-05 2023-09-30T17:04:20.418 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.418 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.418 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.418 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.418 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.418 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:135877 4.2e e54/17)", 2023-09-30T17:04:20.418 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.878107+0000", 2023-09-30T17:04:20.418 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.29199678000000001, 2023-09-30T17:04:20.419 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.29505089600000001, 2023-09-30T17:04:20.419 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.419 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.419 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.419 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.419 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.419 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.878107+0000", 2023-09-30T17:04:20.419 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.419 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.419 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.420 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.420 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.878107+0000", 2023-09-30T17:04:20.420 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.420 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.420 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.420 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.420 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.878107+0000", 2023-09-30T17:04:20.420 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.75e-07 2023-09-30T17:04:20.420 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.420 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.420 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.420 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.878118+0000", 2023-09-30T17:04:20.421 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.042e-05 2023-09-30T17:04:20.421 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.421 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.421 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.421 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.878125+0000", 2023-09-30T17:04:20.421 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0809999999999996e-06 2023-09-30T17:04:20.421 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.421 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.421 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.421 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.878129+0000", 2023-09-30T17:04:20.421 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.532e-06 2023-09-30T17:04:20.422 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.422 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.422 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.422 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.422 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.422 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137189 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.422 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.891659+0000", 2023-09-30T17:04:20.422 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.27844427399999999, 2023-09-30T17:04:20.422 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.28155090300000002, 2023-09-30T17:04:20.422 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.422 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.423 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.423 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.423 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.423 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137189 2023-09-30T17:04:20.423 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.423 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.423 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.423 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.423 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.891659+0000", 2023-09-30T17:04:20.424 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.424 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.424 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.424 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.425 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.891659+0000", 2023-09-30T17:04:20.425 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.425 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.425 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.425 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.425 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.891660+0000", 2023-09-30T17:04:20.425 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.99e-07 2023-09-30T17:04:20.426 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.426 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.426 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.426 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.891672+0000", 2023-09-30T17:04:20.426 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.145e-05 2023-09-30T17:04:20.426 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.427 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.427 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.427 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.891679+0000", 2023-09-30T17:04:20.427 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2150000000000004e-06 2023-09-30T17:04:20.427 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.428 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.428 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.428 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.891684+0000", 2023-09-30T17:04:20.428 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0069999999999997e-06 2023-09-30T17:04:20.428 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.428 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.429 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.429 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.429 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.429 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137376 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.429 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.958645+0000", 2023-09-30T17:04:20.429 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.211459061, 2023-09-30T17:04:20.429 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.214625385, 2023-09-30T17:04:20.429 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.429 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.429 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.430 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.430 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.430 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137376 2023-09-30T17:04:20.430 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.430 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.430 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.430 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.430 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.958645+0000", 2023-09-30T17:04:20.430 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.430 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.430 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.431 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.431 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.958645+0000", 2023-09-30T17:04:20.431 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.431 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.431 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.431 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.431 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.960516+0000", 2023-09-30T17:04:20.431 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0018711349999999999 2023-09-30T17:04:20.431 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.431 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.431 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.431 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.960530+0000", 2023-09-30T17:04:20.432 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4075e-05 2023-09-30T17:04:20.432 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.432 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.432 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.432 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.960543+0000", 2023-09-30T17:04:20.432 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3314e-05 2023-09-30T17:04:20.432 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.432 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.432 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.432 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.960551+0000", 2023-09-30T17:04:20.432 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5449999999999998e-06 2023-09-30T17:04:20.432 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.432 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.433 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.433 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.433 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.433 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137630 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.433 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.070598+0000", 2023-09-30T17:04:20.433 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.099505618000000004, 2023-09-30T17:04:20.433 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.10273125800000001, 2023-09-30T17:04:20.433 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.433 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.433 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.433 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.434 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.434 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137630 2023-09-30T17:04:20.434 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.434 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.434 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.434 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.434 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.070598+0000", 2023-09-30T17:04:20.434 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.434 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.434 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.434 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.435 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.070598+0000", 2023-09-30T17:04:20.435 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.435 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.435 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.435 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.435 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.077192+0000", 2023-09-30T17:04:20.435 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065940230000000001 2023-09-30T17:04:20.435 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.435 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.435 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.435 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.077208+0000", 2023-09-30T17:04:20.435 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6336000000000001e-05 2023-09-30T17:04:20.436 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.436 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.436 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.436 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.077218+0000", 2023-09-30T17:04:20.436 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6709999999999994e-06 2023-09-30T17:04:20.436 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.436 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.436 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.436 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.077225+0000", 2023-09-30T17:04:20.436 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5180000000000001e-06 2023-09-30T17:04:20.436 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.436 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.437 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.437 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.437 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.437 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137809 4.35 4:ad9a5eb7:::100000001f8.00000023:head [write 319488~4096 in=4096b,write 679936~4096 in=4096b,write 860160~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.437 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.157641+0000", 2023-09-30T17:04:20.437 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.012463182999999999, 2023-09-30T17:04:20.437 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015751613000000001, 2023-09-30T17:04:20.437 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.437 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:20.437 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.437 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.437 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.438 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137809 2023-09-30T17:04:20.438 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.438 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.438 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.438 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.438 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.157641+0000", 2023-09-30T17:04:20.438 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.438 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.438 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.438 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.438 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.157641+0000", 2023-09-30T17:04:20.439 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.439 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.439 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.439 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.439 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.157641+0000", 2023-09-30T17:04:20.439 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9499999999999998e-07 2023-09-30T17:04:20.439 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.439 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.439 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.439 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.157651+0000", 2023-09-30T17:04:20.439 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0393e-05 2023-09-30T17:04:20.440 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.440 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.440 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.440 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.157657+0000", 2023-09-30T17:04:20.440 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5960000000000003e-06 2023-09-30T17:04:20.440 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.440 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.440 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.440 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.157661+0000", 2023-09-30T17:04:20.440 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.464e-06 2023-09-30T17:04:20.440 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.440 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.441 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:20.441 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.159189+0000", 2023-09-30T17:04:20.441 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0015273870000000001 2023-09-30T17:04:20.441 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.441 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.441 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:20.441 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.159349+0000", 2023-09-30T17:04:20.441 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000160011 2023-09-30T17:04:20.441 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.441 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.441 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.442 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.442 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.442 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136603 4.6 e54/17)", 2023-09-30T17:04:20.442 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.169816+0000", 2023-09-30T17:04:20.442 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.00028797099999999998, 2023-09-30T17:04:20.442 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036502280000000002, 2023-09-30T17:04:20.442 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.442 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.442 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.442 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.443 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.443 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.169816+0000", 2023-09-30T17:04:20.443 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.443 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.443 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.443 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.169816+0000", 2023-09-30T17:04:20.443 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.443 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.443 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.443 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.169816+0000", 2023-09-30T17:04:20.444 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9500000000000001e-07 2023-09-30T17:04:20.444 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.444 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.444 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.444 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.169827+0000", 2023-09-30T17:04:20.444 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1471000000000001e-05 2023-09-30T17:04:20.444 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.444 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.444 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.444 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.169833+0000", 2023-09-30T17:04:20.444 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.032e-06 2023-09-30T17:04:20.444 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.445 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.445 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.445 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.169838+0000", 2023-09-30T17:04:20.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4909999999999999e-06 2023-09-30T17:04:20.445 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.445 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.445 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.445 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.445 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.445 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136446 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.445 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.614633+0000", 2023-09-30T17:04:20.445 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.55547042999999996, 2023-09-30T17:04:20.446 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.55889559799999999, 2023-09-30T17:04:20.446 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.446 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.446 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.446 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.446 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.446 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136446 2023-09-30T17:04:20.446 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.446 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.446 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.446 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.446 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.614633+0000", 2023-09-30T17:04:20.447 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.447 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.447 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.447 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.614633+0000", 2023-09-30T17:04:20.447 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.447 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.447 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.447 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.614634+0000", 2023-09-30T17:04:20.447 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6100000000000002e-07 2023-09-30T17:04:20.448 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.448 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.448 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.614642+0000", 2023-09-30T17:04:20.448 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7770000000000008e-06 2023-09-30T17:04:20.448 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.448 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.448 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.614646+0000", 2023-09-30T17:04:20.448 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6710000000000001e-06 2023-09-30T17:04:20.448 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.448 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.449 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.614649+0000", 2023-09-30T17:04:20.449 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8100000000000002e-06 2023-09-30T17:04:20.449 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.449 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.449 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.449 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.449 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.449 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136886 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.449 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.796634+0000", 2023-09-30T17:04:20.449 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.373469467, 2023-09-30T17:04:20.449 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.37695753399999998, 2023-09-30T17:04:20.449 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.450 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.450 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.450 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.450 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.450 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136886 2023-09-30T17:04:20.450 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.450 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.450 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.450 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.450 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.796634+0000", 2023-09-30T17:04:20.450 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.450 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.451 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.451 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.451 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.796634+0000", 2023-09-30T17:04:20.451 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.451 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.451 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.451 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.451 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.804516+0000", 2023-09-30T17:04:20.451 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0078817239999999997 2023-09-30T17:04:20.451 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.451 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.451 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.452 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.804554+0000", 2023-09-30T17:04:20.452 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7669999999999997e-05 2023-09-30T17:04:20.452 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.452 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.452 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.452 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.804565+0000", 2023-09-30T17:04:20.452 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1243999999999999e-05 2023-09-30T17:04:20.452 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.452 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.452 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.452 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.804575+0000", 2023-09-30T17:04:20.452 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0278999999999999e-05 2023-09-30T17:04:20.452 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.453 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.453 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.453 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.453 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.453 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:135884 4.36 e54/17)", 2023-09-30T17:04:20.453 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.878138+0000", 2023-09-30T17:04:20.453 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.29196559, 2023-09-30T17:04:20.453 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.29551590500000002, 2023-09-30T17:04:20.453 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.453 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.453 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.453 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.454 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.454 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.878138+0000", 2023-09-30T17:04:20.454 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.454 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.454 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.454 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.454 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.878138+0000", 2023-09-30T17:04:20.454 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.454 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.454 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.454 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.454 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.878138+0000", 2023-09-30T17:04:20.455 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4999999999999999e-07 2023-09-30T17:04:20.455 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.455 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.455 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.455 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.878145+0000", 2023-09-30T17:04:20.455 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8839999999999997e-06 2023-09-30T17:04:20.455 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.455 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.455 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.455 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.878149+0000", 2023-09-30T17:04:20.455 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5650000000000002e-06 2023-09-30T17:04:20.456 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.456 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.456 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.456 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.878152+0000", 2023-09-30T17:04:20.456 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1310000000000002e-06 2023-09-30T17:04:20.456 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.456 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.456 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.456 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.456 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.456 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137266 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.456 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.918772+0000", 2023-09-30T17:04:20.457 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.25133181599999999, 2023-09-30T17:04:20.457 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.25493695900000002, 2023-09-30T17:04:20.457 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.457 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.457 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.457 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.457 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.457 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137266 2023-09-30T17:04:20.457 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.457 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.457 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.457 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.457 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.918772+0000", 2023-09-30T17:04:20.458 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.458 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.458 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.458 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.458 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.918772+0000", 2023-09-30T17:04:20.458 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.458 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.458 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.458 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.458 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.918772+0000", 2023-09-30T17:04:20.458 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5699999999999998e-07 2023-09-30T17:04:20.458 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.459 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.459 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.459 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.918787+0000", 2023-09-30T17:04:20.459 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4973999999999999e-05 2023-09-30T17:04:20.459 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.459 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.459 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.459 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.918795+0000", 2023-09-30T17:04:20.459 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5480000000000004e-06 2023-09-30T17:04:20.459 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.459 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.460 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.460 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.918800+0000", 2023-09-30T17:04:20.460 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.091e-06 2023-09-30T17:04:20.460 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.460 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.460 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.460 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.460 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.460 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137337 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.460 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.940550+0000", 2023-09-30T17:04:20.460 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.22955356099999999, 2023-09-30T17:04:20.460 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.23322336299999999, 2023-09-30T17:04:20.461 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.461 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.461 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.461 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.461 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.461 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137337 2023-09-30T17:04:20.461 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.461 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.461 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.461 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.461 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.940550+0000", 2023-09-30T17:04:20.461 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.462 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.462 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.462 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.462 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.940550+0000", 2023-09-30T17:04:20.462 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.462 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.462 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.462 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.462 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.944603+0000", 2023-09-30T17:04:20.462 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004052852 2023-09-30T17:04:20.463 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.463 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.463 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.944628+0000", 2023-09-30T17:04:20.463 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5131e-05 2023-09-30T17:04:20.463 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.463 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.463 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.944639+0000", 2023-09-30T17:04:20.463 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1163e-05 2023-09-30T17:04:20.463 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.464 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.464 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.464 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.944647+0000", 2023-09-30T17:04:20.464 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.357e-06 2023-09-30T17:04:20.464 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.464 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.464 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.464 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.464 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.464 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136039 4.36 e54/17)", 2023-09-30T17:04:20.464 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.960582+0000", 2023-09-30T17:04:20.464 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.20952135299999999, 2023-09-30T17:04:20.465 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.213251315, 2023-09-30T17:04:20.465 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.465 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.465 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.465 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.465 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.465 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.960582+0000", 2023-09-30T17:04:20.465 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.465 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.465 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.465 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.465 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.960582+0000", 2023-09-30T17:04:20.465 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.466 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.466 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.466 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.466 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.960583+0000", 2023-09-30T17:04:20.466 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0800000000000004e-07 2023-09-30T17:04:20.466 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.466 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.466 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.466 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.960595+0000", 2023-09-30T17:04:20.466 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2132e-05 2023-09-30T17:04:20.466 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.466 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.467 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.467 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.960605+0000", 2023-09-30T17:04:20.467 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5880000000000004e-06 2023-09-30T17:04:20.467 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.467 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.467 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.467 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.960612+0000", 2023-09-30T17:04:20.467 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8689999999999998e-06 2023-09-30T17:04:20.467 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.467 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.467 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.467 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.468 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.468 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137469 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.468 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.004679+0000", 2023-09-30T17:04:20.468 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.16542443200000001, 2023-09-30T17:04:20.468 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.16920784, 2023-09-30T17:04:20.468 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.468 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.468 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.468 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.468 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.468 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137469 2023-09-30T17:04:20.469 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.469 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.469 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.469 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.469 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.004679+0000", 2023-09-30T17:04:20.469 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.469 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.469 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.469 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.469 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.004679+0000", 2023-09-30T17:04:20.469 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.469 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.470 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.470 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.470 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.004680+0000", 2023-09-30T17:04:20.470 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0299999999999999e-07 2023-09-30T17:04:20.470 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.470 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.470 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.470 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.004695+0000", 2023-09-30T17:04:20.470 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5285e-05 2023-09-30T17:04:20.470 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.470 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.470 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.471 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.004702+0000", 2023-09-30T17:04:20.471 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7920000000000004e-06 2023-09-30T17:04:20.471 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.471 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.471 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.471 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.004708+0000", 2023-09-30T17:04:20.471 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8839999999999999e-06 2023-09-30T17:04:20.471 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.471 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.471 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.471 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.471 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.472 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137560 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.472 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.046639+0000", 2023-09-30T17:04:20.472 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.12346459899999999, 2023-09-30T17:04:20.472 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.127310124, 2023-09-30T17:04:20.472 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.472 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.472 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.472 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.472 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.472 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137560 2023-09-30T17:04:20.473 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.473 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.473 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.473 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.473 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.046639+0000", 2023-09-30T17:04:20.473 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.473 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.473 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.473 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.473 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.046639+0000", 2023-09-30T17:04:20.473 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.473 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.474 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.474 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.474 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.046640+0000", 2023-09-30T17:04:20.474 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0400000000000002e-07 2023-09-30T17:04:20.474 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.474 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.474 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.474 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.046651+0000", 2023-09-30T17:04:20.474 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1807999999999999e-05 2023-09-30T17:04:20.474 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.474 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.474 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.475 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.046658+0000", 2023-09-30T17:04:20.475 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1879999999999999e-06 2023-09-30T17:04:20.475 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.475 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.475 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.475 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.046663+0000", 2023-09-30T17:04:20.475 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9609999999999996e-06 2023-09-30T17:04:20.475 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.475 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.475 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.475 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.475 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.476 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136513 4.6 e54/17)", 2023-09-30T17:04:20.476 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.132488+0000", 2023-09-30T17:04:20.476 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.037616245, 2023-09-30T17:04:20.476 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.041522763999999997, 2023-09-30T17:04:20.476 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.476 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.476 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.476 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.476 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.476 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.132488+0000", 2023-09-30T17:04:20.476 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.476 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.477 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.477 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.477 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.132488+0000", 2023-09-30T17:04:20.477 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.477 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.477 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.477 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.477 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.132488+0000", 2023-09-30T17:04:20.477 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.41e-07 2023-09-30T17:04:20.477 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.477 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.477 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.478 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.132501+0000", 2023-09-30T17:04:20.478 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3351e-05 2023-09-30T17:04:20.478 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.478 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.478 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.478 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.132508+0000", 2023-09-30T17:04:20.478 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4629999999999998e-06 2023-09-30T17:04:20.478 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.478 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.478 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.478 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.132519+0000", 2023-09-30T17:04:20.478 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.129e-05 2023-09-30T17:04:20.479 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.479 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.479 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.479 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.479 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.479 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136527 4.36 e54/17)", 2023-09-30T17:04:20.479 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.146612+0000", 2023-09-30T17:04:20.479 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.02349213, 2023-09-30T17:04:20.479 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.027451504000000002, 2023-09-30T17:04:20.479 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.479 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.479 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.480 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.480 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.146612+0000", 2023-09-30T17:04:20.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.480 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.480 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.146612+0000", 2023-09-30T17:04:20.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.480 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.480 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.146612+0000", 2023-09-30T17:04:20.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0299999999999999e-07 2023-09-30T17:04:20.481 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.481 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.481 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.481 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.146625+0000", 2023-09-30T17:04:20.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2753e-05 2023-09-30T17:04:20.481 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.481 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.481 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.481 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.146633+0000", 2023-09-30T17:04:20.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7700000000000001e-06 2023-09-30T17:04:20.482 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.482 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.482 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.482 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.146639+0000", 2023-09-30T17:04:20.482 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6309999999999997e-06 2023-09-30T17:04:20.482 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.482 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.482 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.482 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.482 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.482 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137810 4.12 4.c58a7d2 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.483 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.157672+0000", 2023-09-30T17:04:20.483 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.012432089, 2023-09-30T17:04:20.483 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016473373999999999, 2023-09-30T17:04:20.483 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.483 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.483 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.483 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.483 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.483 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137810 2023-09-30T17:04:20.483 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.483 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.483 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.484 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.484 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.157672+0000", 2023-09-30T17:04:20.484 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.484 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.484 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.484 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.484 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.157672+0000", 2023-09-30T17:04:20.484 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.484 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.484 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.484 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.484 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.157672+0000", 2023-09-30T17:04:20.485 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9399999999999995e-07 2023-09-30T17:04:20.485 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.485 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.485 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.485 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.157686+0000", 2023-09-30T17:04:20.485 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4082e-05 2023-09-30T17:04:20.485 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.485 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.485 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.485 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.157692+0000", 2023-09-30T17:04:20.485 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0310000000000004e-06 2023-09-30T17:04:20.485 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.486 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.486 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.486 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.157697+0000", 2023-09-30T17:04:20.486 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4730000000000002e-06 2023-09-30T17:04:20.486 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.486 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.486 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.486 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.486 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.486 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:137466 4.15 e54/17)", 2023-09-30T17:04:20.486 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.173335+0000", 2023-09-30T17:04:20.487 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.996769, 2023-09-30T17:04:20.487 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00084363899999999998, 2023-09-30T17:04:20.487 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.487 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.487 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.487 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.487 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.487 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.173335+0000", 2023-09-30T17:04:20.487 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.487 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.487 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.487 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.488 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.173335+0000", 2023-09-30T17:04:20.488 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.488 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.488 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.488 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.488 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.173336+0000", 2023-09-30T17:04:20.488 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.204e-06 2023-09-30T17:04:20.488 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.488 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.488 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.488 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.173353+0000", 2023-09-30T17:04:20.489 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7232999999999999e-05 2023-09-30T17:04:20.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.489 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.489 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.173363+0000", 2023-09-30T17:04:20.489 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9490000000000008e-06 2023-09-30T17:04:20.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.489 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.489 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.173371+0000", 2023-09-30T17:04:20.489 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8839999999999994e-06 2023-09-30T17:04:20.490 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.490 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.490 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.490 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.490 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.490 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136577 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.490 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.668579+0000", 2023-09-30T17:04:20.490 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.50152507300000004, 2023-09-30T17:04:20.490 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.50564459500000003, 2023-09-30T17:04:20.490 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.491 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.491 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.491 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.491 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.491 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136577 2023-09-30T17:04:20.491 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.491 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.491 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.491 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.491 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.668579+0000", 2023-09-30T17:04:20.491 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.492 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.492 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.492 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.492 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.668579+0000", 2023-09-30T17:04:20.492 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.492 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.492 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.492 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.492 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.670515+0000", 2023-09-30T17:04:20.492 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019364989999999999 2023-09-30T17:04:20.492 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.492 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.493 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.493 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.670530+0000", 2023-09-30T17:04:20.493 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4613999999999999e-05 2023-09-30T17:04:20.493 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.493 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.493 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.493 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.670538+0000", 2023-09-30T17:04:20.493 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6750000000000008e-06 2023-09-30T17:04:20.493 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.493 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.493 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.494 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.670545+0000", 2023-09-30T17:04:20.494 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.268e-06 2023-09-30T17:04:20.494 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.494 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.494 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.494 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.494 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.494 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136836 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.494 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.772845+0000", 2023-09-30T17:04:20.494 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.39725860800000001, 2023-09-30T17:04:20.495 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.40141144000000001, 2023-09-30T17:04:20.495 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.495 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.495 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.495 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.495 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.495 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136836 2023-09-30T17:04:20.495 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.495 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.495 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.495 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.495 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.772845+0000", 2023-09-30T17:04:20.496 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.496 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.496 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.496 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.496 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.772845+0000", 2023-09-30T17:04:20.496 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.496 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.496 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.496 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.496 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.774892+0000", 2023-09-30T17:04:20.496 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0020467800000000002 2023-09-30T17:04:20.496 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.497 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.497 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.497 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.774905+0000", 2023-09-30T17:04:20.497 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2850000000000001e-05 2023-09-30T17:04:20.497 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.497 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.497 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.497 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.774916+0000", 2023-09-30T17:04:20.497 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1188e-05 2023-09-30T17:04:20.497 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.497 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.497 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.498 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.774924+0000", 2023-09-30T17:04:20.498 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7440000000000007e-06 2023-09-30T17:04:20.498 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.498 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.498 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.498 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.498 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.498 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137028 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.498 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.842574+0000", 2023-09-30T17:04:20.498 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.32752948900000001, 2023-09-30T17:04:20.498 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.33173042200000002, 2023-09-30T17:04:20.498 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.499 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.499 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.499 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.499 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.499 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137028 2023-09-30T17:04:20.499 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.499 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.499 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.499 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.499 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.842574+0000", 2023-09-30T17:04:20.499 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.499 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.500 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.500 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.500 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.842574+0000", 2023-09-30T17:04:20.500 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.500 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.500 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.500 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.500 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.842575+0000", 2023-09-30T17:04:20.500 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2300000000000001e-07 2023-09-30T17:04:20.500 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.500 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.500 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.500 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.842591+0000", 2023-09-30T17:04:20.501 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6333000000000001e-05 2023-09-30T17:04:20.501 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.501 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.501 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.501 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.842598+0000", 2023-09-30T17:04:20.501 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1250000000000004e-06 2023-09-30T17:04:20.501 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.501 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.501 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.501 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.842604+0000", 2023-09-30T17:04:20.501 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6350000000000003e-06 2023-09-30T17:04:20.501 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.502 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.502 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.502 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.502 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.502 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:135917 4.36 e54/17)", 2023-09-30T17:04:20.502 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.908191+0000", 2023-09-30T17:04:20.502 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.26191275800000002, 2023-09-30T17:04:20.502 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.26617180600000001, 2023-09-30T17:04:20.502 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.502 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.502 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.502 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.503 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.503 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.908191+0000", 2023-09-30T17:04:20.503 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.503 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.503 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.503 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.503 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.908191+0000", 2023-09-30T17:04:20.503 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.503 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.503 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.503 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.503 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.908192+0000", 2023-09-30T17:04:20.504 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4799999999999997e-07 2023-09-30T17:04:20.504 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.504 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.504 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.504 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.908208+0000", 2023-09-30T17:04:20.504 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5787e-05 2023-09-30T17:04:20.504 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.504 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.504 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.504 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.908217+0000", 2023-09-30T17:04:20.504 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5689999999999994e-06 2023-09-30T17:04:20.504 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.505 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.505 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.505 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.908224+0000", 2023-09-30T17:04:20.505 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6089999999999997e-06 2023-09-30T17:04:20.505 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.505 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.505 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.505 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.505 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.505 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136451 4.36 e54/17)", 2023-09-30T17:04:20.505 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.096962+0000", 2023-09-30T17:04:20.505 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.073141583999999996, 2023-09-30T17:04:20.505 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.077451294000000004, 2023-09-30T17:04:20.506 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.506 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.506 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.506 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.506 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.096962+0000", 2023-09-30T17:04:20.506 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.506 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.506 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.506 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.096962+0000", 2023-09-30T17:04:20.506 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.507 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.507 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.507 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.507 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.096962+0000", 2023-09-30T17:04:20.507 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4999999999999999e-07 2023-09-30T17:04:20.507 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.507 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.507 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.507 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.096975+0000", 2023-09-30T17:04:20.507 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2527000000000001e-05 2023-09-30T17:04:20.508 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.508 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.508 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.508 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.097291+0000", 2023-09-30T17:04:20.508 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000315629 2023-09-30T17:04:20.508 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.508 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.508 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.508 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.097297+0000", 2023-09-30T17:04:20.508 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6939999999999998e-06 2023-09-30T17:04:20.508 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.508 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.509 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.509 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.509 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.509 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136524 4.6 e54/17)", 2023-09-30T17:04:20.509 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.146650+0000", 2023-09-30T17:04:20.509 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.023453541000000001, 2023-09-30T17:04:20.509 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.027816607, 2023-09-30T17:04:20.509 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.509 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.509 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.509 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.510 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.510 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.146650+0000", 2023-09-30T17:04:20.510 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.510 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.510 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.510 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.510 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.146650+0000", 2023-09-30T17:04:20.510 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.510 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.510 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.510 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.510 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.146651+0000", 2023-09-30T17:04:20.511 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8900000000000001e-07 2023-09-30T17:04:20.511 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.511 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.511 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.511 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.146662+0000", 2023-09-30T17:04:20.511 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1404e-05 2023-09-30T17:04:20.511 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.511 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.511 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.511 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.146669+0000", 2023-09-30T17:04:20.511 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5329999999999997e-06 2023-09-30T17:04:20.511 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.512 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.512 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.512 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.146674+0000", 2023-09-30T17:04:20.512 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7650000000000001e-06 2023-09-30T17:04:20.512 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.512 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.512 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.512 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.512 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.512 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:137430 4.3b e54/17 4:dcc0c15f:::100000001f8.0000001a:head v 54'2239, mlcod=54'2236)", 2023-09-30T17:04:20.512 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.158238+0000", 2023-09-30T17:04:20.512 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.011865771000000001, 2023-09-30T17:04:20.513 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016290829, 2023-09-30T17:04:20.513 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.513 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:20.513 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.513 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.513 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.513 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.158238+0000", 2023-09-30T17:04:20.513 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.513 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.513 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.513 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.513 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.158238+0000", 2023-09-30T17:04:20.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.514 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.514 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.514 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.514 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.158239+0000", 2023-09-30T17:04:20.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4600000000000004e-07 2023-09-30T17:04:20.514 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.514 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.514 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.514 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.158255+0000", 2023-09-30T17:04:20.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6404000000000001e-05 2023-09-30T17:04:20.514 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.515 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.515 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.158263+0000", 2023-09-30T17:04:20.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.106e-06 2023-09-30T17:04:20.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.515 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.515 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.158269+0000", 2023-09-30T17:04:20.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6550000000000001e-06 2023-09-30T17:04:20.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.515 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:20.516 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.161961+0000", 2023-09-30T17:04:20.516 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003692014 2023-09-30T17:04:20.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.516 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:20.516 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.161980+0000", 2023-09-30T17:04:20.516 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9102000000000001e-05 2023-09-30T17:04:20.516 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.516 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.516 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.517 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.517 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(client.4547.0:137779 4.12 e54/17)", 2023-09-30T17:04:20.517 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.173384+0000", 2023-09-30T17:04:20.517 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9967198, 2023-09-30T17:04:20.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0012124379999999999, 2023-09-30T17:04:20.517 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.517 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.517 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.517 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.517 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.173384+0000", 2023-09-30T17:04:20.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.518 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.518 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.518 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.518 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.173384+0000", 2023-09-30T17:04:20.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.518 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.518 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.518 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.518 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.173384+0000", 2023-09-30T17:04:20.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0100000000000001e-07 2023-09-30T17:04:20.518 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.519 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.519 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.173387+0000", 2023-09-30T17:04:20.519 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5450000000000002e-06 2023-09-30T17:04:20.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.519 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.519 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.173393+0000", 2023-09-30T17:04:20.519 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1349999999999997e-06 2023-09-30T17:04:20.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.519 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.520 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.173398+0000", 2023-09-30T17:04:20.520 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1479999999999997e-06 2023-09-30T17:04:20.520 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.520 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.520 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.520 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.520 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.520 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136512 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.520 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.643651+0000", 2023-09-30T17:04:20.520 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.52645307299999999, 2023-09-30T17:04:20.520 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.53101326400000004, 2023-09-30T17:04:20.520 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.521 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.521 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.521 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.521 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.521 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136512 2023-09-30T17:04:20.521 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.521 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.521 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.521 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.521 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.643651+0000", 2023-09-30T17:04:20.521 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.521 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.522 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.522 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.643651+0000", 2023-09-30T17:04:20.522 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.522 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.522 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.643651+0000", 2023-09-30T17:04:20.522 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2e-07 2023-09-30T17:04:20.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.522 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.643662+0000", 2023-09-30T17:04:20.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0944999999999999e-05 2023-09-30T17:04:20.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.523 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.643668+0000", 2023-09-30T17:04:20.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2550000000000003e-06 2023-09-30T17:04:20.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.523 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.643673+0000", 2023-09-30T17:04:20.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8169999999999998e-06 2023-09-30T17:04:20.523 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.524 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.524 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.524 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.524 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.524 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136839 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.524 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.774938+0000", 2023-09-30T17:04:20.524 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.39516546000000002, 2023-09-30T17:04:20.524 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.399785591, 2023-09-30T17:04:20.524 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.524 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.525 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.525 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.525 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.525 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136839 2023-09-30T17:04:20.525 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.525 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.525 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.525 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.525 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.774938+0000", 2023-09-30T17:04:20.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.525 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.525 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.526 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.526 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.774938+0000", 2023-09-30T17:04:20.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.526 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.526 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.526 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.774939+0000", 2023-09-30T17:04:20.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.51e-07 2023-09-30T17:04:20.526 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.526 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.526 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.774954+0000", 2023-09-30T17:04:20.527 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5145e-05 2023-09-30T17:04:20.527 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.527 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.527 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.527 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.774960+0000", 2023-09-30T17:04:20.527 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4280000000000001e-06 2023-09-30T17:04:20.527 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.527 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.527 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.527 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.774966+0000", 2023-09-30T17:04:20.527 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8409999999999996e-06 2023-09-30T17:04:20.527 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.527 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.528 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.528 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.528 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.528 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:135764 4.36 e54/17)", 2023-09-30T17:04:20.528 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.854891+0000", 2023-09-30T17:04:20.528 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.31521302000000001, 2023-09-30T17:04:20.528 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.31988512099999999, 2023-09-30T17:04:20.528 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.528 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.528 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.528 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.528 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.529 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.854891+0000", 2023-09-30T17:04:20.529 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.529 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.529 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.529 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.529 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.854891+0000", 2023-09-30T17:04:20.529 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.529 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.529 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.529 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.529 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.854892+0000", 2023-09-30T17:04:20.529 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8899999999999998e-07 2023-09-30T17:04:20.530 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.530 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.530 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.530 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.854907+0000", 2023-09-30T17:04:20.530 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5749000000000001e-05 2023-09-30T17:04:20.530 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.530 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.530 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.530 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.854920+0000", 2023-09-30T17:04:20.530 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2709e-05 2023-09-30T17:04:20.530 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.530 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.531 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.531 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.854928+0000", 2023-09-30T17:04:20.531 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1030000000000002e-06 2023-09-30T17:04:20.531 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.531 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.531 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.531 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.531 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.531 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137115 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.531 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.863263+0000", 2023-09-30T17:04:20.532 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.306840432, 2023-09-30T17:04:20.532 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.31155904499999998, 2023-09-30T17:04:20.532 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.532 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.532 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.532 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.532 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.532 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137115 2023-09-30T17:04:20.532 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.532 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.532 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.532 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.532 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.863263+0000", 2023-09-30T17:04:20.533 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.533 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.533 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.533 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.533 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.863263+0000", 2023-09-30T17:04:20.533 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.533 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.533 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.533 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.533 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.863264+0000", 2023-09-30T17:04:20.533 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2399999999999998e-07 2023-09-30T17:04:20.534 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.534 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.534 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.534 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.863279+0000", 2023-09-30T17:04:20.534 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5136e-05 2023-09-30T17:04:20.534 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.534 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.534 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.534 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.863285+0000", 2023-09-30T17:04:20.534 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7010000000000001e-06 2023-09-30T17:04:20.534 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.534 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.535 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.535 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.863289+0000", 2023-09-30T17:04:20.535 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6870000000000002e-06 2023-09-30T17:04:20.535 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.535 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.535 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.535 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.535 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.535 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:135922 4.6 e54/17)", 2023-09-30T17:04:20.535 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.908250+0000", 2023-09-30T17:04:20.535 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.26185333100000002, 2023-09-30T17:04:20.536 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.266622939, 2023-09-30T17:04:20.536 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.536 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.536 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.536 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.536 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.536 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.908250+0000", 2023-09-30T17:04:20.536 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.536 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.536 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.536 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.536 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.908250+0000", 2023-09-30T17:04:20.537 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.537 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.537 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.537 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.537 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.908251+0000", 2023-09-30T17:04:20.537 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5499999999999999e-07 2023-09-30T17:04:20.537 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.537 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.537 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.537 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.908261+0000", 2023-09-30T17:04:20.537 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8579999999999995e-06 2023-09-30T17:04:20.537 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.538 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.538 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.538 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.908269+0000", 2023-09-30T17:04:20.538 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3429999999999996e-06 2023-09-30T17:04:20.538 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.538 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.538 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.538 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.908274+0000", 2023-09-30T17:04:20.538 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.729e-06 2023-09-30T17:04:20.538 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.538 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.539 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.539 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.539 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.539 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:135988 4.6 e54/17)", 2023-09-30T17:04:20.539 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.931229+0000", 2023-09-30T17:04:20.539 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.238874842, 2023-09-30T17:04:20.539 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.243689139, 2023-09-30T17:04:20.539 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.539 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.539 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.539 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.539 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.540 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.931229+0000", 2023-09-30T17:04:20.540 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.540 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.540 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.540 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.540 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.931229+0000", 2023-09-30T17:04:20.540 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.540 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.540 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.540 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.541 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.931229+0000", 2023-09-30T17:04:20.541 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5499999999999999e-07 2023-09-30T17:04:20.541 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.541 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.541 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.541 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.931240+0000", 2023-09-30T17:04:20.541 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0898e-05 2023-09-30T17:04:20.541 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.541 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.541 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.541 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.931249+0000", 2023-09-30T17:04:20.542 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4710000000000007e-06 2023-09-30T17:04:20.542 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.542 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.542 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.542 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.931253+0000", 2023-09-30T17:04:20.542 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5600000000000004e-06 2023-09-30T17:04:20.542 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.542 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.542 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.542 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.542 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.543 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137403 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.543 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.974586+0000", 2023-09-30T17:04:20.543 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.195517633, 2023-09-30T17:04:20.543 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.200378259, 2023-09-30T17:04:20.543 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.543 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.543 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.543 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.543 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.543 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137403 2023-09-30T17:04:20.543 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.544 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.544 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.544 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.544 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.974586+0000", 2023-09-30T17:04:20.544 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.544 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.544 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.544 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.544 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.974586+0000", 2023-09-30T17:04:20.544 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.544 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.544 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.545 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.545 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.978516+0000", 2023-09-30T17:04:20.545 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039302340000000003 2023-09-30T17:04:20.545 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.545 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.545 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.545 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.978530+0000", 2023-09-30T17:04:20.545 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4131000000000001e-05 2023-09-30T17:04:20.545 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.545 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.545 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.545 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.978541+0000", 2023-09-30T17:04:20.546 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0438000000000001e-05 2023-09-30T17:04:20.546 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.546 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.546 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.546 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.978549+0000", 2023-09-30T17:04:20.546 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6720000000000004e-06 2023-09-30T17:04:20.546 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.546 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.546 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.546 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.546 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.546 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136348 4.36 e54/17)", 2023-09-30T17:04:20.547 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.061439+0000", 2023-09-30T17:04:20.547 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.10866445600000001, 2023-09-30T17:04:20.547 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.11357595500000001, 2023-09-30T17:04:20.547 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.547 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.547 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.547 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.547 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.547 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.061439+0000", 2023-09-30T17:04:20.547 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.547 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.548 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.548 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.548 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.061439+0000", 2023-09-30T17:04:20.548 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.548 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.548 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.548 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.548 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.061440+0000", 2023-09-30T17:04:20.548 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9599999999999999e-07 2023-09-30T17:04:20.548 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.548 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.548 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.549 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.061456+0000", 2023-09-30T17:04:20.549 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6543999999999999e-05 2023-09-30T17:04:20.549 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.549 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.549 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.549 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.061465+0000", 2023-09-30T17:04:20.549 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1489999999999994e-06 2023-09-30T17:04:20.549 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.549 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.549 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.549 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.061473+0000", 2023-09-30T17:04:20.549 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.072e-06 2023-09-30T17:04:20.550 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.550 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.550 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.550 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.550 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.550 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136378 4.6 e54/17)", 2023-09-30T17:04:20.550 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.077972+0000", 2023-09-30T17:04:20.550 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.092131488999999997, 2023-09-30T17:04:20.550 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.097088269000000005, 2023-09-30T17:04:20.550 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.550 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.551 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.551 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.551 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.551 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.077972+0000", 2023-09-30T17:04:20.551 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.551 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.551 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.551 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.551 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.077972+0000", 2023-09-30T17:04:20.551 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.551 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.551 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.552 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.552 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.077973+0000", 2023-09-30T17:04:20.552 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2e-07 2023-09-30T17:04:20.552 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.552 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.552 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.552 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.077989+0000", 2023-09-30T17:04:20.552 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6178e-05 2023-09-30T17:04:20.552 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.552 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.552 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.552 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.077998+0000", 2023-09-30T17:04:20.552 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0950000000000002e-06 2023-09-30T17:04:20.553 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.553 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.553 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.553 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.078003+0000", 2023-09-30T17:04:20.553 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2730000000000002e-06 2023-09-30T17:04:20.553 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.553 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.553 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.553 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.553 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.553 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136450 4.6 e54/17)", 2023-09-30T17:04:20.554 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.097310+0000", 2023-09-30T17:04:20.554 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.072793352000000006, 2023-09-30T17:04:20.554 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.077795426000000001, 2023-09-30T17:04:20.554 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.554 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.554 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.554 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.554 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.554 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.097310+0000", 2023-09-30T17:04:20.554 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.555 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.555 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.555 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.555 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.097310+0000", 2023-09-30T17:04:20.555 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.555 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.555 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.555 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.555 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.097311+0000", 2023-09-30T17:04:20.555 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0699999999999997e-07 2023-09-30T17:04:20.555 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.555 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.555 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.556 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.097328+0000", 2023-09-30T17:04:20.556 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6676000000000001e-05 2023-09-30T17:04:20.556 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.556 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.556 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.556 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.097335+0000", 2023-09-30T17:04:20.556 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5460000000000003e-06 2023-09-30T17:04:20.556 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.556 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.556 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.556 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.097341+0000", 2023-09-30T17:04:20.556 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6720000000000001e-06 2023-09-30T17:04:20.557 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.557 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.557 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.557 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.557 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.557 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137710 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.557 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.110840+0000", 2023-09-30T17:04:20.557 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.059263528000000003, 2023-09-30T17:04:20.557 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.064312315999999994, 2023-09-30T17:04:20.557 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.557 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.558 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.558 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.558 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.558 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137710 2023-09-30T17:04:20.558 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.558 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.558 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.558 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.558 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.110840+0000", 2023-09-30T17:04:20.558 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.558 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.559 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.559 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.559 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.110840+0000", 2023-09-30T17:04:20.559 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.559 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.559 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.559 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.559 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.114519+0000", 2023-09-30T17:04:20.559 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036789090000000002 2023-09-30T17:04:20.559 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.559 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.560 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.560 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.114545+0000", 2023-09-30T17:04:20.560 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5999e-05 2023-09-30T17:04:20.560 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.560 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.560 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.560 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.114555+0000", 2023-09-30T17:04:20.560 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6979999999999993e-06 2023-09-30T17:04:20.560 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.560 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.560 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.560 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.114567+0000", 2023-09-30T17:04:20.561 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2609000000000001e-05 2023-09-30T17:04:20.561 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.561 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.561 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.561 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.561 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.561 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136550 4.36 e54/17)", 2023-09-30T17:04:20.561 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.158290+0000", 2023-09-30T17:04:20.561 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.011814035000000001, 2023-09-30T17:04:20.561 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016914386999999999, 2023-09-30T17:04:20.561 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.562 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.562 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.562 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.562 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.562 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.158290+0000", 2023-09-30T17:04:20.562 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.562 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.562 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.562 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.562 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.158290+0000", 2023-09-30T17:04:20.563 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.563 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.563 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.563 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.563 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.158290+0000", 2023-09-30T17:04:20.563 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6300000000000001e-07 2023-09-30T17:04:20.563 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.563 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.563 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.563 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.158303+0000", 2023-09-30T17:04:20.564 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3488e-05 2023-09-30T17:04:20.564 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.564 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.564 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.564 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.158311+0000", 2023-09-30T17:04:20.564 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0419999999999997e-06 2023-09-30T17:04:20.564 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.564 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.564 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.564 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.158315+0000", 2023-09-30T17:04:20.564 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5109999999999997e-06 2023-09-30T17:04:20.564 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.565 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.565 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.565 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.565 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.565 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(client.4547.0:137822 4.2d e54/17)", 2023-09-30T17:04:20.565 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.173407+0000", 2023-09-30T17:04:20.565 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9966969, 2023-09-30T17:04:20.565 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0018436119999999999, 2023-09-30T17:04:20.565 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.565 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.565 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.566 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.566 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.566 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.173407+0000", 2023-09-30T17:04:20.566 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.566 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.566 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.566 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.566 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.173407+0000", 2023-09-30T17:04:20.566 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.566 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.566 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.567 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.567 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.173407+0000", 2023-09-30T17:04:20.567 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0800000000000001e-07 2023-09-30T17:04:20.567 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.567 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.567 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.567 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.173409+0000", 2023-09-30T17:04:20.567 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.108e-06 2023-09-30T17:04:20.567 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.567 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.567 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.567 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.173415+0000", 2023-09-30T17:04:20.568 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6319999999999996e-06 2023-09-30T17:04:20.568 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.568 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.568 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.568 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.173419+0000", 2023-09-30T17:04:20.568 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5630000000000002e-06 2023-09-30T17:04:20.568 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.568 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.568 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.568 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.568 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.569 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136555 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.569 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.655993+0000", 2023-09-30T17:04:20.569 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.51411054, 2023-09-30T17:04:20.569 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.51930449599999995, 2023-09-30T17:04:20.569 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.569 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.569 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.569 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.569 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.569 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136555 2023-09-30T17:04:20.569 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.570 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.570 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.570 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.570 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.655993+0000", 2023-09-30T17:04:20.570 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.570 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.570 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.570 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.570 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.655993+0000", 2023-09-30T17:04:20.570 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.570 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.570 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.571 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.571 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.655994+0000", 2023-09-30T17:04:20.571 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5700000000000002e-07 2023-09-30T17:04:20.571 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.571 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.571 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.571 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.656011+0000", 2023-09-30T17:04:20.571 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6841999999999999e-05 2023-09-30T17:04:20.571 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.571 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.571 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.572 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.656021+0000", 2023-09-30T17:04:20.572 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0169e-05 2023-09-30T17:04:20.572 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.572 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.572 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.572 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.656027+0000", 2023-09-30T17:04:20.572 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8900000000000004e-06 2023-09-30T17:04:20.572 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.572 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.572 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.572 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.572 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.572 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136926 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.573 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.812598+0000", 2023-09-30T17:04:20.573 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.35750618299999998, 2023-09-30T17:04:20.573 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.36275337299999999, 2023-09-30T17:04:20.573 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.573 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.573 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.573 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.573 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.573 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136926 2023-09-30T17:04:20.573 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.573 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.574 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.574 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.574 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.812598+0000", 2023-09-30T17:04:20.574 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.574 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.574 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.574 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.574 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.812598+0000", 2023-09-30T17:04:20.574 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.574 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.575 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.575 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.575 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.812598+0000", 2023-09-30T17:04:20.575 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2899999999999999e-07 2023-09-30T17:04:20.575 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.575 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.575 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.575 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.812609+0000", 2023-09-30T17:04:20.575 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0898e-05 2023-09-30T17:04:20.575 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.575 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.576 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.576 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.812616+0000", 2023-09-30T17:04:20.576 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4030000000000001e-06 2023-09-30T17:04:20.576 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.576 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.576 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.576 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.812621+0000", 2023-09-30T17:04:20.576 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7010000000000004e-06 2023-09-30T17:04:20.576 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.576 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.576 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.576 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.577 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.577 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:135769 4.2e e54/17)", 2023-09-30T17:04:20.577 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.856518+0000", 2023-09-30T17:04:20.577 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.31358548200000003, 2023-09-30T17:04:20.577 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.31888324000000001, 2023-09-30T17:04:20.577 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.577 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.577 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.577 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.577 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.577 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.856518+0000", 2023-09-30T17:04:20.577 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.578 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.578 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.578 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.578 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.856518+0000", 2023-09-30T17:04:20.578 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.578 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.578 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.578 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.578 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.856519+0000", 2023-09-30T17:04:20.578 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1399999999999996e-07 2023-09-30T17:04:20.578 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.579 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.579 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.579 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.856532+0000", 2023-09-30T17:04:20.579 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2543e-05 2023-09-30T17:04:20.579 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.579 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.579 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.579 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.856541+0000", 2023-09-30T17:04:20.579 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6420000000000002e-06 2023-09-30T17:04:20.579 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.579 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.579 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.580 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.856548+0000", 2023-09-30T17:04:20.580 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6900000000000003e-06 2023-09-30T17:04:20.580 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.580 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.580 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.580 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.580 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.580 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137144 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.580 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.877551+0000", 2023-09-30T17:04:20.580 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.29255319099999999, 2023-09-30T17:04:20.580 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.29789737999999999, 2023-09-30T17:04:20.580 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.581 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.581 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.581 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.581 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.581 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137144 2023-09-30T17:04:20.581 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.581 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.581 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.581 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.581 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.877551+0000", 2023-09-30T17:04:20.581 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.581 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.582 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.582 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.582 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.877551+0000", 2023-09-30T17:04:20.582 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.582 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.582 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.582 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.582 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.879515+0000", 2023-09-30T17:04:20.582 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001964492 2023-09-30T17:04:20.582 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.582 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.583 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.583 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.879529+0000", 2023-09-30T17:04:20.583 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3709e-05 2023-09-30T17:04:20.583 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.583 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.583 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.583 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.879538+0000", 2023-09-30T17:04:20.583 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.73e-06 2023-09-30T17:04:20.583 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.583 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.583 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.583 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.879546+0000", 2023-09-30T17:04:20.584 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0790000000000003e-06 2023-09-30T17:04:20.584 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.584 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.584 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.584 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.584 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.584 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137343 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.584 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.944742+0000", 2023-09-30T17:04:20.584 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.225361281, 2023-09-30T17:04:20.584 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.23075871100000001, 2023-09-30T17:04:20.585 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.585 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.585 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.585 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.585 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.585 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137343 2023-09-30T17:04:20.585 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.585 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.585 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.585 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.586 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.944742+0000", 2023-09-30T17:04:20.586 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.586 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.586 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.586 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.586 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.944742+0000", 2023-09-30T17:04:20.586 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.586 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.586 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.587 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.587 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.944743+0000", 2023-09-30T17:04:20.587 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2e-07 2023-09-30T17:04:20.587 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.587 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.587 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.587 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.944755+0000", 2023-09-30T17:04:20.587 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1725999999999999e-05 2023-09-30T17:04:20.587 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.587 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.587 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.588 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.944761+0000", 2023-09-30T17:04:20.588 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1e-06 2023-09-30T17:04:20.588 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.588 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.588 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.588 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.944766+0000", 2023-09-30T17:04:20.588 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8899999999999998e-06 2023-09-30T17:04:20.588 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.589 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.589 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.589 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.589 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.589 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137379 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.589 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.964555+0000", 2023-09-30T17:04:20.589 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.20554845099999999, 2023-09-30T17:04:20.589 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.21100760599999999, 2023-09-30T17:04:20.589 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.589 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.589 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.589 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.590 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.590 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137379 2023-09-30T17:04:20.590 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.590 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.590 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.590 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.590 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.964555+0000", 2023-09-30T17:04:20.590 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.590 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.590 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.590 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.591 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.964555+0000", 2023-09-30T17:04:20.591 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.591 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.591 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.591 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.591 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.964556+0000", 2023-09-30T17:04:20.591 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4099999999999999e-07 2023-09-30T17:04:20.591 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.591 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.591 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.592 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.964567+0000", 2023-09-30T17:04:20.592 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1272e-05 2023-09-30T17:04:20.592 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.592 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.592 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.592 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.964574+0000", 2023-09-30T17:04:20.592 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.878e-06 2023-09-30T17:04:20.592 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.593 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.593 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.593 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.964579+0000", 2023-09-30T17:04:20.593 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6779999999999999e-06 2023-09-30T17:04:20.593 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.593 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.593 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.593 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.593 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.594 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136177 4.36 e54/17)", 2023-09-30T17:04:20.594 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.019765+0000", 2023-09-30T17:04:20.594 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.15033878000000001, 2023-09-30T17:04:20.594 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.155848758, 2023-09-30T17:04:20.594 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.594 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.594 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.594 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.594 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.595 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.019765+0000", 2023-09-30T17:04:20.595 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.595 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.595 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.595 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.595 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.019765+0000", 2023-09-30T17:04:20.595 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.595 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.596 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.596 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.596 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.019770+0000", 2023-09-30T17:04:20.596 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4299999999999997e-06 2023-09-30T17:04:20.596 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.596 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.596 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.596 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.019788+0000", 2023-09-30T17:04:20.596 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7334e-05 2023-09-30T17:04:20.596 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.596 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.597 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.597 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.019800+0000", 2023-09-30T17:04:20.597 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1776e-05 2023-09-30T17:04:20.597 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.597 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.597 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.597 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.019806+0000", 2023-09-30T17:04:20.597 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8190000000000003e-06 2023-09-30T17:04:20.597 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.597 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.597 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.598 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.598 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.598 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136384 4.6 e54/17)", 2023-09-30T17:04:20.598 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.081869+0000", 2023-09-30T17:04:20.598 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.08823462, 2023-09-30T17:04:20.598 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.093788177, 2023-09-30T17:04:20.598 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.598 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.598 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.598 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.598 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.599 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.081869+0000", 2023-09-30T17:04:20.599 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.599 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.599 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.599 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.599 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.081869+0000", 2023-09-30T17:04:20.599 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.599 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.599 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.599 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.599 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.081870+0000", 2023-09-30T17:04:20.599 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6000000000000003e-07 2023-09-30T17:04:20.600 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.600 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.600 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.600 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.081893+0000", 2023-09-30T17:04:20.600 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2843000000000001e-05 2023-09-30T17:04:20.600 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.600 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.600 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.600 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.081903+0000", 2023-09-30T17:04:20.600 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0166999999999999e-05 2023-09-30T17:04:20.600 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.601 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.601 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.601 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.081911+0000", 2023-09-30T17:04:20.601 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1040000000000007e-06 2023-09-30T17:04:20.601 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.601 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.601 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.601 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.601 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.601 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137655 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.601 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.092560+0000", 2023-09-30T17:04:20.601 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.077543926999999999, 2023-09-30T17:04:20.602 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.083144201000000001, 2023-09-30T17:04:20.602 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.602 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.602 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.602 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.602 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.602 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137655 2023-09-30T17:04:20.602 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.602 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.602 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.602 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.603 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.092560+0000", 2023-09-30T17:04:20.603 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.603 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.603 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.603 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.603 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.092560+0000", 2023-09-30T17:04:20.603 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.603 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.603 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.603 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.603 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.097362+0000", 2023-09-30T17:04:20.603 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0048023379999999997 2023-09-30T17:04:20.604 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.604 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.604 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.604 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.097379+0000", 2023-09-30T17:04:20.604 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6918e-05 2023-09-30T17:04:20.604 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.604 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.604 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.604 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.097387+0000", 2023-09-30T17:04:20.604 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7090000000000002e-06 2023-09-30T17:04:20.604 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.604 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.605 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.605 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.097392+0000", 2023-09-30T17:04:20.605 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4199999999999998e-06 2023-09-30T17:04:20.605 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.605 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.605 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.605 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.605 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.605 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137737 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.605 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.132655+0000", 2023-09-30T17:04:20.605 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.037448532, 2023-09-30T17:04:20.605 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043100988, 2023-09-30T17:04:20.606 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.606 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.606 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.606 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.606 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.606 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137737 2023-09-30T17:04:20.606 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.606 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.606 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.606 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.606 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.132655+0000", 2023-09-30T17:04:20.607 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.607 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.607 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.607 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.607 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.132655+0000", 2023-09-30T17:04:20.607 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.607 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.607 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.607 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.607 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.132656+0000", 2023-09-30T17:04:20.607 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3799999999999997e-07 2023-09-30T17:04:20.608 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.608 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.608 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.608 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.132670+0000", 2023-09-30T17:04:20.608 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3747999999999999e-05 2023-09-30T17:04:20.608 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.608 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.608 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.608 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.132688+0000", 2023-09-30T17:04:20.608 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8754e-05 2023-09-30T17:04:20.608 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.608 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.608 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.609 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.132698+0000", 2023-09-30T17:04:20.609 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0117e-05 2023-09-30T17:04:20.609 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.609 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.609 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.609 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.609 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.609 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:137437 4.28 e54/17 4:153ae410:::100000001f8.0000003b:head v 54'4228, mlcod=54'4223)", 2023-09-30T17:04:20.609 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.158322+0000", 2023-09-30T17:04:20.609 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.011781880999999999, 2023-09-30T17:04:20.609 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017486834, 2023-09-30T17:04:20.609 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.610 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:20.610 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.610 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.610 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.610 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.158322+0000", 2023-09-30T17:04:20.610 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.610 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.610 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.610 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.610 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.158322+0000", 2023-09-30T17:04:20.610 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.610 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.611 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.611 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.611 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.158322+0000", 2023-09-30T17:04:20.611 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4400000000000001e-07 2023-09-30T17:04:20.611 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.611 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.611 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.611 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.158331+0000", 2023-09-30T17:04:20.611 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3710000000000006e-06 2023-09-30T17:04:20.611 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.611 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.611 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.612 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.158341+0000", 2023-09-30T17:04:20.612 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1579999999999994e-06 2023-09-30T17:04:20.612 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.612 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.612 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.612 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.158345+0000", 2023-09-30T17:04:20.612 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.172e-06 2023-09-30T17:04:20.612 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.612 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.612 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:20.612 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.159524+0000", 2023-09-30T17:04:20.613 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001179221 2023-09-30T17:04:20.613 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.613 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.613 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:20.613 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.159542+0000", 2023-09-30T17:04:20.613 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8383999999999999e-05 2023-09-30T17:04:20.613 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.613 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.613 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.613 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.613 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.613 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137837 4.2c 4:35cbff5f:::100000001f8.00000033:head [write 774144~4096 in=4096b,write 811008~4096 in=4096b,write 884736~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.614 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.169615+0000", 2023-09-30T17:04:20.614 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.00048913199999999998, 2023-09-30T17:04:20.614 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0062565729999999996, 2023-09-30T17:04:20.614 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.614 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:20.614 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.614 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.614 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.614 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137837 2023-09-30T17:04:20.614 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.615 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.615 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.615 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.615 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.169615+0000", 2023-09-30T17:04:20.615 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.615 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.615 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.615 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.615 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.169615+0000", 2023-09-30T17:04:20.615 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.615 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.615 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.616 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.616 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.173431+0000", 2023-09-30T17:04:20.616 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038160630000000002 2023-09-30T17:04:20.616 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.616 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.616 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.616 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.173444+0000", 2023-09-30T17:04:20.616 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3608000000000001e-05 2023-09-30T17:04:20.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.617 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.617 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.617 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.173452+0000", 2023-09-30T17:04:20.617 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8490000000000006e-06 2023-09-30T17:04:20.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.617 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.617 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.617 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.173458+0000", 2023-09-30T17:04:20.617 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9800000000000003e-06 2023-09-30T17:04:20.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.618 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.618 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:20.618 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.174321+0000", 2023-09-30T17:04:20.618 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000862563 2023-09-30T17:04:20.618 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.618 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.618 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:20.618 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.174410+0000", 2023-09-30T17:04:20.618 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9561999999999994e-05 2023-09-30T17:04:20.618 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.619 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.619 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.619 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.619 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.619 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136475 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.619 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.631562+0000", 2023-09-30T17:04:20.619 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.53854132499999996, 2023-09-30T17:04:20.619 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.54437447800000005, 2023-09-30T17:04:20.619 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.619 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.620 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.620 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.620 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.620 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136475 2023-09-30T17:04:20.620 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.620 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.620 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.620 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.620 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.631562+0000", 2023-09-30T17:04:20.620 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.621 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.621 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.621 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.621 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.631562+0000", 2023-09-30T17:04:20.621 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.621 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.621 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.621 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.621 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.631563+0000", 2023-09-30T17:04:20.621 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7100000000000002e-07 2023-09-30T17:04:20.622 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.622 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.622 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.622 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.631576+0000", 2023-09-30T17:04:20.622 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3207000000000001e-05 2023-09-30T17:04:20.622 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.622 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.622 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.622 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.631584+0000", 2023-09-30T17:04:20.623 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6799999999999993e-06 2023-09-30T17:04:20.623 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.623 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.623 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.623 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.631589+0000", 2023-09-30T17:04:20.623 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3249999999999998e-06 2023-09-30T17:04:20.623 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.623 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.623 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.624 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.624 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.624 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136517 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.624 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.643722+0000", 2023-09-30T17:04:20.624 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.52638215799999999, 2023-09-30T17:04:20.624 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.53228114800000004, 2023-09-30T17:04:20.624 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.624 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.624 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.625 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.625 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.625 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136517 2023-09-30T17:04:20.625 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.625 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.625 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.625 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.625 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.643722+0000", 2023-09-30T17:04:20.625 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.626 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.626 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.626 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.626 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.643722+0000", 2023-09-30T17:04:20.626 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.626 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.626 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.626 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.627 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.643722+0000", 2023-09-30T17:04:20.627 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0400000000000002e-07 2023-09-30T17:04:20.627 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.627 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.627 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.627 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.643734+0000", 2023-09-30T17:04:20.627 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2257e-05 2023-09-30T17:04:20.627 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.627 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.628 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.628 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.643740+0000", 2023-09-30T17:04:20.628 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.835e-06 2023-09-30T17:04:20.628 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.628 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.628 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.628 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.643745+0000", 2023-09-30T17:04:20.628 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.955e-06 2023-09-30T17:04:20.628 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.629 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.629 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.629 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136622 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.629 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.683615+0000", 2023-09-30T17:04:20.629 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.48648898600000001, 2023-09-30T17:04:20.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.49242325100000001, 2023-09-30T17:04:20.629 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.629 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.629 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.629 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.630 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.630 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136622 2023-09-30T17:04:20.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.630 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.630 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.683615+0000", 2023-09-30T17:04:20.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.630 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.631 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.683615+0000", 2023-09-30T17:04:20.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.631 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.631 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.631 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.631 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.685515+0000", 2023-09-30T17:04:20.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001900454 2023-09-30T17:04:20.631 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.631 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.631 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.631 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.685530+0000", 2023-09-30T17:04:20.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4997000000000001e-05 2023-09-30T17:04:20.632 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.632 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.632 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.632 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.685540+0000", 2023-09-30T17:04:20.632 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3829999999999998e-06 2023-09-30T17:04:20.632 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.632 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.632 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.632 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.685548+0000", 2023-09-30T17:04:20.632 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7280000000000001e-06 2023-09-30T17:04:20.632 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.632 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.633 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.633 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.633 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.633 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136732 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.633 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.737194+0000", 2023-09-30T17:04:20.633 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.43290947499999999, 2023-09-30T17:04:20.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.43887462999999999, 2023-09-30T17:04:20.633 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.633 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.633 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.633 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.633 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.634 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136732 2023-09-30T17:04:20.634 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.634 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.634 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.634 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.737194+0000", 2023-09-30T17:04:20.634 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.634 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.634 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.634 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.737194+0000", 2023-09-30T17:04:20.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.737195+0000", 2023-09-30T17:04:20.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.89e-07 2023-09-30T17:04:20.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.737203+0000", 2023-09-30T17:04:20.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6179999999999995e-06 2023-09-30T17:04:20.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.737207+0000", 2023-09-30T17:04:20.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.681e-06 2023-09-30T17:04:20.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.737210+0000", 2023-09-30T17:04:20.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9270000000000001e-06 2023-09-30T17:04:20.636 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.636 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.636 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.637 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:135632 4.36 e54/17 4:6fa85f86:::100000001f8.00000013:head v 54'6425, mlcod=54'6380)", 2023-09-30T17:04:20.637 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.828884+0000", 2023-09-30T17:04:20.637 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.34121967199999997, 2023-09-30T17:04:20.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.34722105599999997, 2023-09-30T17:04:20.637 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.637 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:20.637 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.637 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.637 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.828884+0000", 2023-09-30T17:04:20.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.638 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.638 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.638 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.828884+0000", 2023-09-30T17:04:20.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.638 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.638 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.638 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.828884+0000", 2023-09-30T17:04:20.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.48e-07 2023-09-30T17:04:20.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.828897+0000", 2023-09-30T17:04:20.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2999999999999999e-05 2023-09-30T17:04:20.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.828904+0000", 2023-09-30T17:04:20.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8279999999999997e-06 2023-09-30T17:04:20.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.828909+0000", 2023-09-30T17:04:20.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7840000000000003e-06 2023-09-30T17:04:20.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:20.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.120294+0000", 2023-09-30T17:04:20.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.29138494199999998 2023-09-30T17:04:20.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:20.641 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.120309+0000", 2023-09-30T17:04:20.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5231999999999999e-05 2023-09-30T17:04:20.641 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.641 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.641 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.641 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137030 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.641 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.844558+0000", 2023-09-30T17:04:20.641 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.32554608000000002, 2023-09-30T17:04:20.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.33158152499999999, 2023-09-30T17:04:20.641 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.642 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.642 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.642 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.642 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.642 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137030 2023-09-30T17:04:20.642 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.642 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.642 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.642 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.642 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.844558+0000", 2023-09-30T17:04:20.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.642 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.643 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.643 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.844558+0000", 2023-09-30T17:04:20.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.643 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.643 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.844558+0000", 2023-09-30T17:04:20.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3000000000000001e-07 2023-09-30T17:04:20.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.644 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.844568+0000", 2023-09-30T17:04:20.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5359999999999998e-06 2023-09-30T17:04:20.644 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.644 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.844574+0000", 2023-09-30T17:04:20.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.942e-06 2023-09-30T17:04:20.644 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.645 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.844577+0000", 2023-09-30T17:04:20.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2590000000000001e-06 2023-09-30T17:04:20.645 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.645 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.645 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.645 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.645 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.645 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137050 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.645 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.852788+0000", 2023-09-30T17:04:20.645 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.31731530800000002, 2023-09-30T17:04:20.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.32338067999999998, 2023-09-30T17:04:20.645 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.646 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.646 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.646 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.646 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.646 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137050 2023-09-30T17:04:20.646 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.646 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.646 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.646 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.646 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.852788+0000", 2023-09-30T17:04:20.646 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.647 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.647 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.852788+0000", 2023-09-30T17:04:20.647 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.647 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.647 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.856564+0000", 2023-09-30T17:04:20.647 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0037759040000000001 2023-09-30T17:04:20.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.648 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.856581+0000", 2023-09-30T17:04:20.648 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6277999999999999e-05 2023-09-30T17:04:20.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.648 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.856590+0000", 2023-09-30T17:04:20.648 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9800000000000004e-06 2023-09-30T17:04:20.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.856596+0000", 2023-09-30T17:04:20.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5810000000000002e-06 2023-09-30T17:04:20.649 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.649 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.649 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.649 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.649 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137119 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.650 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.863323+0000", 2023-09-30T17:04:20.650 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.30678100400000002, 2023-09-30T17:04:20.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.31287615000000002, 2023-09-30T17:04:20.650 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.650 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.650 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.650 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.650 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.650 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137119 2023-09-30T17:04:20.650 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.650 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.651 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.651 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.863323+0000", 2023-09-30T17:04:20.651 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.651 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.651 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.651 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.863323+0000", 2023-09-30T17:04:20.651 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.652 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.652 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.652 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.652 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.863323+0000", 2023-09-30T17:04:20.652 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.72e-07 2023-09-30T17:04:20.652 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.653 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.653 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.863334+0000", 2023-09-30T17:04:20.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0474e-05 2023-09-30T17:04:20.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.653 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.653 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.863339+0000", 2023-09-30T17:04:20.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.366e-06 2023-09-30T17:04:20.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.654 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.863343+0000", 2023-09-30T17:04:20.654 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3200000000000001e-06 2023-09-30T17:04:20.654 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.654 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.654 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.654 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137147 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.655 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.879557+0000", 2023-09-30T17:04:20.655 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.29054690999999999, 2023-09-30T17:04:20.655 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.29667131299999999, 2023-09-30T17:04:20.655 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.655 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.655 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.655 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.655 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.655 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137147 2023-09-30T17:04:20.656 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.656 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.656 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.656 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.656 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.879557+0000", 2023-09-30T17:04:20.656 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.656 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.656 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.656 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.656 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.879557+0000", 2023-09-30T17:04:20.656 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.657 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.657 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.657 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.879557+0000", 2023-09-30T17:04:20.657 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5999999999999999e-07 2023-09-30T17:04:20.657 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.657 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.879569+0000", 2023-09-30T17:04:20.658 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1653e-05 2023-09-30T17:04:20.658 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.879576+0000", 2023-09-30T17:04:20.658 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.635e-06 2023-09-30T17:04:20.658 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.659 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.659 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.879581+0000", 2023-09-30T17:04:20.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7379999999999999e-06 2023-09-30T17:04:20.659 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.659 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.659 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.659 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.659 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137238 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.659 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.908571+0000", 2023-09-30T17:04:20.660 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.26153262199999999, 2023-09-30T17:04:20.660 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.26768629399999999, 2023-09-30T17:04:20.660 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.660 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.660 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.660 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.660 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.660 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137238 2023-09-30T17:04:20.660 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.660 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.660 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.661 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.661 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.908571+0000", 2023-09-30T17:04:20.661 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.661 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.661 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.661 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.661 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.908571+0000", 2023-09-30T17:04:20.661 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.661 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.661 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.661 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.661 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.908572+0000", 2023-09-30T17:04:20.662 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6499999999999999e-07 2023-09-30T17:04:20.662 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.662 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.662 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.662 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.908583+0000", 2023-09-30T17:04:20.662 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0983e-05 2023-09-30T17:04:20.662 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.662 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.662 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.662 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.908589+0000", 2023-09-30T17:04:20.662 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3890000000000002e-06 2023-09-30T17:04:20.663 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.663 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.663 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.663 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.908595+0000", 2023-09-30T17:04:20.663 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3040000000000001e-06 2023-09-30T17:04:20.663 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.663 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.663 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.663 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.664 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137344 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.664 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.944773+0000", 2023-09-30T17:04:20.664 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.22533120100000001, 2023-09-30T17:04:20.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.23151509300000001, 2023-09-30T17:04:20.664 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.664 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.664 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.665 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.665 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.665 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137344 2023-09-30T17:04:20.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.665 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.944773+0000", 2023-09-30T17:04:20.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.666 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.666 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.944773+0000", 2023-09-30T17:04:20.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.666 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.666 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.666 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.944773+0000", 2023-09-30T17:04:20.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8599999999999999e-07 2023-09-30T17:04:20.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.944790+0000", 2023-09-30T17:04:20.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7588000000000002e-05 2023-09-30T17:04:20.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.944797+0000", 2023-09-30T17:04:20.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1890000000000004e-06 2023-09-30T17:04:20.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.668 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.668 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.944801+0000", 2023-09-30T17:04:20.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8369999999999996e-06 2023-09-30T17:04:20.668 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.668 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.668 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.668 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137380 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.669 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.964585+0000", 2023-09-30T17:04:20.669 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.205519023, 2023-09-30T17:04:20.669 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.21173325300000001, 2023-09-30T17:04:20.669 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.669 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.669 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.669 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.669 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.669 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137380 2023-09-30T17:04:20.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.669 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.670 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.670 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.670 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.964585+0000", 2023-09-30T17:04:20.670 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.670 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.670 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.670 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.670 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.964585+0000", 2023-09-30T17:04:20.670 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.670 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.670 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.671 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.671 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.964585+0000", 2023-09-30T17:04:20.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0100000000000001e-07 2023-09-30T17:04:20.671 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.671 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.671 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.671 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.964595+0000", 2023-09-30T17:04:20.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8900000000000002e-06 2023-09-30T17:04:20.671 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.672 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.672 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.964599+0000", 2023-09-30T17:04:20.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8130000000000002e-06 2023-09-30T17:04:20.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.672 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.672 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.964602+0000", 2023-09-30T17:04:20.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0860000000000002e-06 2023-09-30T17:04:20.672 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.672 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.673 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.673 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137656 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.673 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.097401+0000", 2023-09-30T17:04:20.673 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.072702433999999996, 2023-09-30T17:04:20.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.078947787000000005, 2023-09-30T17:04:20.673 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.673 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.673 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.673 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.674 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.674 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137656 2023-09-30T17:04:20.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.674 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.674 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.674 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.097401+0000", 2023-09-30T17:04:20.674 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.675 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.675 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.097401+0000", 2023-09-30T17:04:20.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.675 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.675 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.097402+0000", 2023-09-30T17:04:20.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2199999999999999e-07 2023-09-30T17:04:20.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.097413+0000", 2023-09-30T17:04:20.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1112e-05 2023-09-30T17:04:20.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.097419+0000", 2023-09-30T17:04:20.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1290000000000001e-06 2023-09-30T17:04:20.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.677 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.677 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.097424+0000", 2023-09-30T17:04:20.677 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3190000000000002e-06 2023-09-30T17:04:20.677 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.677 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.677 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.677 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136459 4.6 e54/17)", 2023-09-30T17:04:20.677 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.103964+0000", 2023-09-30T17:04:20.678 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.066139568999999995, 2023-09-30T17:04:20.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.072414679999999995, 2023-09-30T17:04:20.678 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.678 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.678 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.678 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.678 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.678 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.103964+0000", 2023-09-30T17:04:20.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.679 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.679 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.103964+0000", 2023-09-30T17:04:20.679 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.679 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.679 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.103964+0000", 2023-09-30T17:04:20.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9399999999999999e-07 2023-09-30T17:04:20.680 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.680 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.680 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.103974+0000", 2023-09-30T17:04:20.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0000000000000001e-05 2023-09-30T17:04:20.680 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.680 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.680 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.103991+0000", 2023-09-30T17:04:20.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6205000000000002e-05 2023-09-30T17:04:20.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.681 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.681 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.103995+0000", 2023-09-30T17:04:20.681 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7180000000000004e-06 2023-09-30T17:04:20.681 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.681 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.681 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.682 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137713 4.30 4:0c89e311:::100000001f8.00000017:head [write 2711552~4096 in=4096b,write 2752512~4096 in=4096b,write 2797568~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.682 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.114618+0000", 2023-09-30T17:04:20.682 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.055485472000000001, 2023-09-30T17:04:20.682 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.061791950999999998, 2023-09-30T17:04:20.682 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.682 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:20.682 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.682 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.682 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.682 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137713 2023-09-30T17:04:20.682 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.683 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.683 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.683 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.114618+0000", 2023-09-30T17:04:20.683 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.683 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.683 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.683 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.114618+0000", 2023-09-30T17:04:20.683 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.683 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.684 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.684 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.114619+0000", 2023-09-30T17:04:20.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9100000000000004e-07 2023-09-30T17:04:20.684 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.684 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.684 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.114631+0000", 2023-09-30T17:04:20.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.258e-05 2023-09-30T17:04:20.684 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.685 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.685 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.114639+0000", 2023-09-30T17:04:20.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6620000000000005e-06 2023-09-30T17:04:20.685 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.685 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.685 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.114644+0000", 2023-09-30T17:04:20.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3480000000000003e-06 2023-09-30T17:04:20.685 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.686 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:20.686 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.162779+0000", 2023-09-30T17:04:20.686 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.048134185000000003 2023-09-30T17:04:20.686 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.686 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.686 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:20.686 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.162856+0000", 2023-09-30T17:04:20.686 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7478999999999995e-05 2023-09-30T17:04:20.686 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.687 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.687 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.687 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.687 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.687 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137738 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 3067904~4096 in=4096b,write 3117056~4096 in=4096b,write 3158016~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.687 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.132712+0000", 2023-09-30T17:04:20.687 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.037392112999999998, 2023-09-30T17:04:20.687 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043739426999999997, 2023-09-30T17:04:20.687 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.687 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:20.687 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.688 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.688 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.688 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137738 2023-09-30T17:04:20.688 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.688 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.688 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.688 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.688 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.132712+0000", 2023-09-30T17:04:20.688 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.688 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.688 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.689 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.689 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.132712+0000", 2023-09-30T17:04:20.689 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.689 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.689 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.689 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.132713+0000", 2023-09-30T17:04:20.689 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6440000000000001e-06 2023-09-30T17:04:20.689 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.690 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.690 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.132730+0000", 2023-09-30T17:04:20.690 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6554000000000001e-05 2023-09-30T17:04:20.690 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.690 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.690 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.132738+0000", 2023-09-30T17:04:20.690 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3599999999999996e-06 2023-09-30T17:04:20.690 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.690 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.691 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.132744+0000", 2023-09-30T17:04:20.691 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6409999999999999e-06 2023-09-30T17:04:20.691 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.691 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.691 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:20.691 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.162826+0000", 2023-09-30T17:04:20.691 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.030082437 2023-09-30T17:04:20.691 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.691 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.691 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:20.692 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.162911+0000", 2023-09-30T17:04:20.692 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4944999999999994e-05 2023-09-30T17:04:20.692 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.692 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.692 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.692 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.692 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.692 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136529 4.6 e54/17)", 2023-09-30T17:04:20.692 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.146726+0000", 2023-09-30T17:04:20.692 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.023378205999999999, 2023-09-30T17:04:20.693 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.029762356, 2023-09-30T17:04:20.693 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.693 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.693 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.693 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.693 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.693 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.146726+0000", 2023-09-30T17:04:20.693 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.693 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.693 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.693 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.694 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.146726+0000", 2023-09-30T17:04:20.694 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.694 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.694 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.694 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.694 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.146726+0000", 2023-09-30T17:04:20.694 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4499999999999999e-07 2023-09-30T17:04:20.694 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.694 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.695 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.695 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.146738+0000", 2023-09-30T17:04:20.695 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1895999999999999e-05 2023-09-30T17:04:20.695 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.695 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.695 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.695 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.146741+0000", 2023-09-30T17:04:20.695 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7440000000000001e-06 2023-09-30T17:04:20.695 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.695 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.696 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.696 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.146744+0000", 2023-09-30T17:04:20.696 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9550000000000001e-06 2023-09-30T17:04:20.696 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.696 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.696 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.696 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.696 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.696 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137816 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.697 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.157703+0000", 2023-09-30T17:04:20.697 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.012400810999999999, 2023-09-30T17:04:20.697 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018838541, 2023-09-30T17:04:20.697 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.697 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.697 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.697 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.697 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.697 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137816 2023-09-30T17:04:20.698 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.698 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.698 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.698 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.698 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.157703+0000", 2023-09-30T17:04:20.698 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.698 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.698 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.698 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.698 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.157703+0000", 2023-09-30T17:04:20.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.699 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.699 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.159849+0000", 2023-09-30T17:04:20.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0021463710000000002 2023-09-30T17:04:20.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.699 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.699 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.159872+0000", 2023-09-30T17:04:20.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3153999999999999e-05 2023-09-30T17:04:20.700 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.700 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.700 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.700 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.159883+0000", 2023-09-30T17:04:20.700 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0216e-05 2023-09-30T17:04:20.700 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.700 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.700 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.700 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.159890+0000", 2023-09-30T17:04:20.700 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6240000000000002e-06 2023-09-30T17:04:20.700 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.700 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.701 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.701 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.701 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.701 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137839 4.2c 4.faffd3ac (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.701 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.174090+0000", 2023-09-30T17:04:20.701 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9960136, 2023-09-30T17:04:20.701 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002510745, 2023-09-30T17:04:20.701 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.701 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.701 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.701 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.702 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.702 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137839 2023-09-30T17:04:20.702 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.702 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.702 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.702 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.702 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.174090+0000", 2023-09-30T17:04:20.702 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.702 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.702 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.703 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.703 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.174090+0000", 2023-09-30T17:04:20.703 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.703 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.703 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.703 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.703 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.174091+0000", 2023-09-30T17:04:20.703 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6700000000000003e-07 2023-09-30T17:04:20.703 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.703 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.703 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.703 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.174106+0000", 2023-09-30T17:04:20.704 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5681000000000001e-05 2023-09-30T17:04:20.704 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.704 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.704 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.704 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.174116+0000", 2023-09-30T17:04:20.704 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9499999999999996e-06 2023-09-30T17:04:20.704 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.704 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.704 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.704 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.174123+0000", 2023-09-30T17:04:20.705 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1110000000000002e-06 2023-09-30T17:04:20.705 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.705 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.705 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.705 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.705 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.705 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136478 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.705 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.631596+0000", 2023-09-30T17:04:20.705 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.53850766299999997, 2023-09-30T17:04:20.705 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.54506365899999998, 2023-09-30T17:04:20.705 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.706 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.706 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.706 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.706 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.706 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136478 2023-09-30T17:04:20.706 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.706 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.706 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.706 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.707 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.631596+0000", 2023-09-30T17:04:20.707 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.707 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.707 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.707 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.707 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.631596+0000", 2023-09-30T17:04:20.707 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.707 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.707 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.707 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.707 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.631597+0000", 2023-09-30T17:04:20.707 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2500000000000001e-07 2023-09-30T17:04:20.708 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.708 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.708 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.708 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.631608+0000", 2023-09-30T17:04:20.708 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1001e-05 2023-09-30T17:04:20.708 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.708 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.708 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.708 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.631613+0000", 2023-09-30T17:04:20.708 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9030000000000001e-06 2023-09-30T17:04:20.708 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.708 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.709 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.709 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.631618+0000", 2023-09-30T17:04:20.709 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5990000000000004e-06 2023-09-30T17:04:20.709 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.709 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.709 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.709 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.709 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.709 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:135676 4.6 e54/17 4:635f8cb4:::100000001f8.0000003c:head v 54'8355, mlcod=54'8294)", 2023-09-30T17:04:20.709 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.846537+0000", 2023-09-30T17:04:20.709 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.323566611, 2023-09-30T17:04:20.709 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.33018343900000002, 2023-09-30T17:04:20.710 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.710 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:20.710 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.710 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.710 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.710 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.846537+0000", 2023-09-30T17:04:20.710 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.710 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.710 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.710 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.710 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.846537+0000", 2023-09-30T17:04:20.711 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.711 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.711 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.711 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.711 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.846538+0000", 2023-09-30T17:04:20.711 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.051e-06 2023-09-30T17:04:20.711 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.711 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.711 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.711 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.846550+0000", 2023-09-30T17:04:20.712 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1685000000000001e-05 2023-09-30T17:04:20.712 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.712 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.712 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.712 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.846556+0000", 2023-09-30T17:04:20.712 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.677e-06 2023-09-30T17:04:20.712 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.712 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.712 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.712 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.846561+0000", 2023-09-30T17:04:20.713 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3360000000000002e-06 2023-09-30T17:04:20.713 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.713 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.713 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:20.713 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.160618+0000", 2023-09-30T17:04:20.713 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.31405750599999999 2023-09-30T17:04:20.713 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.713 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.713 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:20.713 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.160639+0000", 2023-09-30T17:04:20.713 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.067e-05 2023-09-30T17:04:20.714 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.714 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.714 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.714 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.714 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.714 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137122 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.714 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.863350+0000", 2023-09-30T17:04:20.714 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.30675370299999999, 2023-09-30T17:04:20.714 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.313437994, 2023-09-30T17:04:20.714 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.715 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.715 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.715 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.715 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.715 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137122 2023-09-30T17:04:20.715 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.715 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.715 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.715 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.715 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.863350+0000", 2023-09-30T17:04:20.715 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.716 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.716 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.716 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.716 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.863350+0000", 2023-09-30T17:04:20.716 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.716 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.716 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.716 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.716 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.863350+0000", 2023-09-30T17:04:20.716 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9200000000000002e-07 2023-09-30T17:04:20.716 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.717 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.717 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.717 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.863362+0000", 2023-09-30T17:04:20.717 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1999e-05 2023-09-30T17:04:20.717 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.717 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.717 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.717 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.863373+0000", 2023-09-30T17:04:20.717 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0343000000000001e-05 2023-09-30T17:04:20.717 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.717 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.717 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.718 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.863377+0000", 2023-09-30T17:04:20.718 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8029999999999996e-06 2023-09-30T17:04:20.718 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.718 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.718 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.718 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.718 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.718 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137239 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.719 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.908602+0000", 2023-09-30T17:04:20.719 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.26150193700000002, 2023-09-30T17:04:20.719 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.26824726999999998, 2023-09-30T17:04:20.719 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.719 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.719 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.719 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.719 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.719 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137239 2023-09-30T17:04:20.719 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.719 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.720 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.720 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.720 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.908602+0000", 2023-09-30T17:04:20.720 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.720 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.720 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.720 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.720 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.908602+0000", 2023-09-30T17:04:20.720 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.721 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.721 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.721 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.721 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.910515+0000", 2023-09-30T17:04:20.721 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001913178 2023-09-30T17:04:20.721 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.721 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.721 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.721 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.910539+0000", 2023-09-30T17:04:20.721 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3598e-05 2023-09-30T17:04:20.722 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.722 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.722 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.722 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.910548+0000", 2023-09-30T17:04:20.722 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0869999999999996e-06 2023-09-30T17:04:20.722 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.722 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.722 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.722 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.910555+0000", 2023-09-30T17:04:20.723 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6860000000000006e-06 2023-09-30T17:04:20.723 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.723 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.723 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.723 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.723 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.723 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137345 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.723 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.944808+0000", 2023-09-30T17:04:20.723 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.22529612399999999, 2023-09-30T17:04:20.723 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.23208411600000001, 2023-09-30T17:04:20.724 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.724 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.724 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.724 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.724 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.724 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137345 2023-09-30T17:04:20.724 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.724 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.725 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.725 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.725 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.944808+0000", 2023-09-30T17:04:20.725 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.725 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.725 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.725 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.725 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.944808+0000", 2023-09-30T17:04:20.725 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.726 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.726 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.726 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.726 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.944808+0000", 2023-09-30T17:04:20.726 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2600000000000002e-07 2023-09-30T17:04:20.726 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.726 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.726 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.726 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.944822+0000", 2023-09-30T17:04:20.727 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3566e-05 2023-09-30T17:04:20.727 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.727 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.727 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.727 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.944828+0000", 2023-09-30T17:04:20.727 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9009999999999999e-06 2023-09-30T17:04:20.727 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.727 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.727 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.727 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.944832+0000", 2023-09-30T17:04:20.728 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6879999999999998e-06 2023-09-30T17:04:20.728 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.728 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.728 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.728 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.728 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.728 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136060 4.6 e54/17)", 2023-09-30T17:04:20.728 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.965586+0000", 2023-09-30T17:04:20.728 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.204518057, 2023-09-30T17:04:20.729 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.21133544900000001, 2023-09-30T17:04:20.729 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.729 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.729 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.729 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.729 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.729 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.965586+0000", 2023-09-30T17:04:20.729 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.729 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.730 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.730 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.730 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.965586+0000", 2023-09-30T17:04:20.730 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.730 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.730 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.730 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.730 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.965586+0000", 2023-09-30T17:04:20.730 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3799999999999997e-07 2023-09-30T17:04:20.730 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.730 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.731 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.731 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.965606+0000", 2023-09-30T17:04:20.731 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9589000000000002e-05 2023-09-30T17:04:20.731 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.731 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.731 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.731 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.965615+0000", 2023-09-30T17:04:20.731 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7779999999999996e-06 2023-09-30T17:04:20.731 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.731 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.732 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.732 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.965621+0000", 2023-09-30T17:04:20.732 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.263e-06 2023-09-30T17:04:20.732 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.732 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.732 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.732 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.732 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.732 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136232 4.6 e54/17)", 2023-09-30T17:04:20.733 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.033714+0000", 2023-09-30T17:04:20.733 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.136389592, 2023-09-30T17:04:20.733 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.14323314500000001, 2023-09-30T17:04:20.733 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.733 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.733 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.733 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.733 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.733 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.033714+0000", 2023-09-30T17:04:20.734 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.734 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.734 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.734 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.734 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.033714+0000", 2023-09-30T17:04:20.734 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.734 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.734 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.734 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.734 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.033714+0000", 2023-09-30T17:04:20.734 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.65e-07 2023-09-30T17:04:20.734 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.735 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.735 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.735 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.033728+0000", 2023-09-30T17:04:20.735 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3355e-05 2023-09-30T17:04:20.735 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.735 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.735 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.735 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.033735+0000", 2023-09-30T17:04:20.735 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3950000000000003e-06 2023-09-30T17:04:20.735 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.736 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.736 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.736 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.033741+0000", 2023-09-30T17:04:20.736 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4569999999999996e-06 2023-09-30T17:04:20.736 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.736 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.736 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.736 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.736 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.736 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137578 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.736 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.046839+0000", 2023-09-30T17:04:20.737 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.12326502, 2023-09-30T17:04:20.737 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.13014005100000001, 2023-09-30T17:04:20.737 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.737 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.737 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.737 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.737 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.737 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137578 2023-09-30T17:04:20.737 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.737 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.737 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.738 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.738 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.046839+0000", 2023-09-30T17:04:20.738 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.738 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.738 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.738 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.738 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.046839+0000", 2023-09-30T17:04:20.738 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.738 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.738 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.738 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.738 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.046839+0000", 2023-09-30T17:04:20.739 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7400000000000003e-07 2023-09-30T17:04:20.739 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.739 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.739 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.739 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.046859+0000", 2023-09-30T17:04:20.739 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9808000000000001e-05 2023-09-30T17:04:20.739 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.739 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.739 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.739 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.046867+0000", 2023-09-30T17:04:20.739 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9009999999999994e-06 2023-09-30T17:04:20.739 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.740 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.740 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.740 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.046874+0000", 2023-09-30T17:04:20.740 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2309999999999999e-06 2023-09-30T17:04:20.740 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.740 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.740 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.740 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.740 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.740 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137657 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.740 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.097431+0000", 2023-09-30T17:04:20.740 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.072672544000000006, 2023-09-30T17:04:20.741 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.079578609999999994, 2023-09-30T17:04:20.741 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.741 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.741 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.741 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.741 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.741 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137657 2023-09-30T17:04:20.741 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.741 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.741 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.741 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.742 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.097431+0000", 2023-09-30T17:04:20.742 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.742 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.742 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.742 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.742 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.097431+0000", 2023-09-30T17:04:20.742 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.742 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.742 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.742 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.742 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.097432+0000", 2023-09-30T17:04:20.743 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1100000000000001e-07 2023-09-30T17:04:20.743 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.743 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.743 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.743 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.097446+0000", 2023-09-30T17:04:20.743 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4071e-05 2023-09-30T17:04:20.743 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.743 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.743 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.743 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.097453+0000", 2023-09-30T17:04:20.743 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4560000000000003e-06 2023-09-30T17:04:20.744 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.744 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.744 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.097458+0000", 2023-09-30T17:04:20.744 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0529999999999997e-06 2023-09-30T17:04:20.744 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.744 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.744 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.744 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.744 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137741 4.38 4:1fc350da:::100000001f8.0000002f:head [write 253952~4096 in=4096b,write 266240~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.744 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.132755+0000", 2023-09-30T17:04:20.744 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.037348797000000003, 2023-09-30T17:04:20.745 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044294884, 2023-09-30T17:04:20.745 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.745 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:20.745 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.745 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.745 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.745 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137741 2023-09-30T17:04:20.745 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.745 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.745 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.745 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.745 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.132755+0000", 2023-09-30T17:04:20.746 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.746 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.746 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.746 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.746 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.132755+0000", 2023-09-30T17:04:20.746 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.746 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.746 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.746 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.746 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.132756+0000", 2023-09-30T17:04:20.746 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9699999999999996e-07 2023-09-30T17:04:20.746 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.747 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.747 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.747 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.132767+0000", 2023-09-30T17:04:20.747 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1423999999999999e-05 2023-09-30T17:04:20.747 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.747 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.747 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.747 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.132774+0000", 2023-09-30T17:04:20.747 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3089999999999998e-06 2023-09-30T17:04:20.747 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.747 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.747 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.748 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.132780+0000", 2023-09-30T17:04:20.748 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6300000000000003e-06 2023-09-30T17:04:20.748 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.748 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.748 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:20.748 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.169641+0000", 2023-09-30T17:04:20.748 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.036861485999999999 2023-09-30T17:04:20.748 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.748 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.748 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:20.749 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.169718+0000", 2023-09-30T17:04:20.749 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7032000000000004e-05 2023-09-30T17:04:20.749 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.749 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.749 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.749 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.749 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.749 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137840 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.749 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.174135+0000", 2023-09-30T17:04:20.749 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9959688, 2023-09-30T17:04:20.749 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0029544419999999998, 2023-09-30T17:04:20.749 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.750 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.750 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.750 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.750 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.750 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137840 2023-09-30T17:04:20.750 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.750 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.750 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.750 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.750 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.174135+0000", 2023-09-30T17:04:20.750 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.751 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.751 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.751 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.751 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.174135+0000", 2023-09-30T17:04:20.751 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.751 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.751 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.751 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.751 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.174136+0000", 2023-09-30T17:04:20.751 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9100000000000004e-07 2023-09-30T17:04:20.751 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.752 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.752 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.752 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.174147+0000", 2023-09-30T17:04:20.752 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1762e-05 2023-09-30T17:04:20.752 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.752 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.752 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.752 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.174154+0000", 2023-09-30T17:04:20.752 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5810000000000002e-06 2023-09-30T17:04:20.753 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.753 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.753 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.753 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.174159+0000", 2023-09-30T17:04:20.753 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0370000000000002e-06 2023-09-30T17:04:20.753 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.753 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.753 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.753 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.753 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.754 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136561 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.754 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.656138+0000", 2023-09-30T17:04:20.754 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.51396563200000001, 2023-09-30T17:04:20.754 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.52098276099999996, 2023-09-30T17:04:20.754 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.754 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.754 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.754 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.755 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.755 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136561 2023-09-30T17:04:20.755 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.755 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.755 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.755 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.755 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.656138+0000", 2023-09-30T17:04:20.755 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.755 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.755 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.755 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.756 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.656138+0000", 2023-09-30T17:04:20.756 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.756 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.756 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.756 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.756 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.656139+0000", 2023-09-30T17:04:20.756 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0200000000000002e-07 2023-09-30T17:04:20.756 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.757 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.757 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.757 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.656158+0000", 2023-09-30T17:04:20.757 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9176000000000001e-05 2023-09-30T17:04:20.757 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.757 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.757 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.757 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.656167+0000", 2023-09-30T17:04:20.757 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4399999999999994e-06 2023-09-30T17:04:20.757 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.758 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.758 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.758 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.656174+0000", 2023-09-30T17:04:20.758 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3550000000000001e-06 2023-09-30T17:04:20.758 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.758 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.758 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.758 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.759 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.759 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136583 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.759 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.672564+0000", 2023-09-30T17:04:20.759 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.49753977500000002, 2023-09-30T17:04:20.759 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.50458958899999995, 2023-09-30T17:04:20.759 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.759 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.759 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.759 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.759 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.760 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136583 2023-09-30T17:04:20.760 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.760 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.760 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.760 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.760 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.672564+0000", 2023-09-30T17:04:20.760 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.760 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.760 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.760 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.761 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.672564+0000", 2023-09-30T17:04:20.761 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.761 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.761 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.761 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.761 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.672565+0000", 2023-09-30T17:04:20.761 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9299999999999998e-07 2023-09-30T17:04:20.761 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.761 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.761 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.762 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.672585+0000", 2023-09-30T17:04:20.762 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0177e-05 2023-09-30T17:04:20.762 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.762 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.762 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.762 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.672592+0000", 2023-09-30T17:04:20.762 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8000000000000001e-06 2023-09-30T17:04:20.762 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.763 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.763 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.763 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.672597+0000", 2023-09-30T17:04:20.763 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5119999999999999e-06 2023-09-30T17:04:20.763 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.763 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.763 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.763 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.763 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.764 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136872 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.764 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.790554+0000", 2023-09-30T17:04:20.764 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.37954933800000001, 2023-09-30T17:04:20.764 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.386629206, 2023-09-30T17:04:20.764 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.764 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.764 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.764 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.764 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.765 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136872 2023-09-30T17:04:20.765 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.765 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.765 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.765 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.765 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.790554+0000", 2023-09-30T17:04:20.765 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.766 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.766 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.766 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.766 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.790554+0000", 2023-09-30T17:04:20.766 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.766 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.766 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.766 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.766 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.790555+0000", 2023-09-30T17:04:20.767 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7e-07 2023-09-30T17:04:20.767 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.767 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.767 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.767 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.790566+0000", 2023-09-30T17:04:20.767 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0895e-05 2023-09-30T17:04:20.767 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.767 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.767 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.767 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.790572+0000", 2023-09-30T17:04:20.767 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1859999999999997e-06 2023-09-30T17:04:20.768 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.768 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.768 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.768 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.790578+0000", 2023-09-30T17:04:20.768 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8629999999999996e-06 2023-09-30T17:04:20.768 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.768 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.768 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.768 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.768 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.768 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:135686 4.2e e54/17 4:75be0f36:::100000001f8.0000003d:head v 54'2113, mlcod=54'2095)", 2023-09-30T17:04:20.768 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.846573+0000", 2023-09-30T17:04:20.769 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.32353092500000002, 2023-09-30T17:04:20.769 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.33064208699999997, 2023-09-30T17:04:20.769 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.769 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:20.769 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.769 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.769 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.769 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.846573+0000", 2023-09-30T17:04:20.769 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.769 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.769 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.770 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.770 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.846573+0000", 2023-09-30T17:04:20.770 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.770 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.770 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.770 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.770 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.846573+0000", 2023-09-30T17:04:20.770 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.36e-07 2023-09-30T17:04:20.770 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.770 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.770 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.771 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.846583+0000", 2023-09-30T17:04:20.771 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6749999999999997e-06 2023-09-30T17:04:20.771 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.771 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.771 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.771 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.846594+0000", 2023-09-30T17:04:20.771 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1194e-05 2023-09-30T17:04:20.771 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.771 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.771 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.771 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.846602+0000", 2023-09-30T17:04:20.772 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0290000000000005e-06 2023-09-30T17:04:20.772 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.772 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.772 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:20.772 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.159458+0000", 2023-09-30T17:04:20.772 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.312855773 2023-09-30T17:04:20.772 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.772 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.772 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:20.772 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.159476+0000", 2023-09-30T17:04:20.772 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8345000000000001e-05 2023-09-30T17:04:20.772 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.772 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.773 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.773 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.773 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.773 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137150 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.773 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.879623+0000", 2023-09-30T17:04:20.773 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.29048101300000001, 2023-09-30T17:04:20.773 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.297625735, 2023-09-30T17:04:20.773 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.773 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.773 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.773 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.774 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.774 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137150 2023-09-30T17:04:20.774 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.774 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.774 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.774 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.774 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.879623+0000", 2023-09-30T17:04:20.774 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.774 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.774 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.774 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.774 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.879623+0000", 2023-09-30T17:04:20.775 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.775 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.775 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.775 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.775 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.879623+0000", 2023-09-30T17:04:20.775 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.89e-07 2023-09-30T17:04:20.775 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.775 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.775 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.775 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.879638+0000", 2023-09-30T17:04:20.775 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4523e-05 2023-09-30T17:04:20.776 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.776 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.776 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.776 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.879644+0000", 2023-09-30T17:04:20.776 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3489999999999997e-06 2023-09-30T17:04:20.776 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.776 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.776 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.776 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.879649+0000", 2023-09-30T17:04:20.776 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8729999999999998e-06 2023-09-30T17:04:20.776 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.776 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.777 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.777 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.777 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.777 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137241 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.777 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.910569+0000", 2023-09-30T17:04:20.777 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.25953492099999997, 2023-09-30T17:04:20.777 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.26670914600000001, 2023-09-30T17:04:20.777 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.777 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.777 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.777 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.777 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.778 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137241 2023-09-30T17:04:20.778 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.778 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.778 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.778 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.778 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.910569+0000", 2023-09-30T17:04:20.778 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.778 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.778 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.778 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.778 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.910569+0000", 2023-09-30T17:04:20.779 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.779 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.779 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.779 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.779 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.910569+0000", 2023-09-30T17:04:20.779 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3799999999999997e-07 2023-09-30T17:04:20.779 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.779 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.779 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.779 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.910582+0000", 2023-09-30T17:04:20.780 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2653000000000001e-05 2023-09-30T17:04:20.780 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.780 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.780 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.780 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.910589+0000", 2023-09-30T17:04:20.780 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.131e-06 2023-09-30T17:04:20.780 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.780 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.780 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.780 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.910595+0000", 2023-09-30T17:04:20.780 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3280000000000002e-06 2023-09-30T17:04:20.780 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.781 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.781 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.781 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.781 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.781 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137267 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.781 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.918808+0000", 2023-09-30T17:04:20.781 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.25129624699999997, 2023-09-30T17:04:20.781 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.25850126099999998, 2023-09-30T17:04:20.781 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.781 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.781 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.781 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.782 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.782 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137267 2023-09-30T17:04:20.782 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.782 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.782 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.782 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.782 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.918808+0000", 2023-09-30T17:04:20.782 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.782 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.782 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.782 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.782 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.918808+0000", 2023-09-30T17:04:20.783 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.783 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.783 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.783 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.783 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.922517+0000", 2023-09-30T17:04:20.783 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0037099770000000002 2023-09-30T17:04:20.783 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.783 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.783 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.783 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.922533+0000", 2023-09-30T17:04:20.783 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5914e-05 2023-09-30T17:04:20.783 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.784 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.784 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.784 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.922546+0000", 2023-09-30T17:04:20.784 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2356e-05 2023-09-30T17:04:20.784 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.784 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.784 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.784 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.922553+0000", 2023-09-30T17:04:20.784 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5190000000000003e-06 2023-09-30T17:04:20.784 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.784 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.784 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.785 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.785 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.785 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137409 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.785 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.978689+0000", 2023-09-30T17:04:20.785 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.19141517899999999, 2023-09-30T17:04:20.785 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.19864985900000001, 2023-09-30T17:04:20.785 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.785 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.785 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.785 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.785 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.785 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137409 2023-09-30T17:04:20.786 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.786 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.786 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.786 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.786 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.978689+0000", 2023-09-30T17:04:20.786 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.786 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.786 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.786 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.786 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.978689+0000", 2023-09-30T17:04:20.786 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.787 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.787 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.787 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.787 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.978689+0000", 2023-09-30T17:04:20.787 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.82e-07 2023-09-30T17:04:20.787 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.787 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.787 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.787 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.978701+0000", 2023-09-30T17:04:20.787 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2114e-05 2023-09-30T17:04:20.787 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.787 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.788 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.788 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.978708+0000", 2023-09-30T17:04:20.788 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5950000000000004e-06 2023-09-30T17:04:20.788 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.788 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.788 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.788 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.978713+0000", 2023-09-30T17:04:20.788 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5650000000000001e-06 2023-09-30T17:04:20.788 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.788 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.788 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.788 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.789 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.789 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136186 4.6 e54/17)", 2023-09-30T17:04:20.789 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.022607+0000", 2023-09-30T17:04:20.789 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.147496397, 2023-09-30T17:04:20.789 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.154935136, 2023-09-30T17:04:20.789 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.789 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.789 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.789 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.789 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.789 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.022607+0000", 2023-09-30T17:04:20.789 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.790 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.790 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.790 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.790 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.022607+0000", 2023-09-30T17:04:20.790 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.790 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.790 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.790 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.790 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.022608+0000", 2023-09-30T17:04:20.790 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1900000000000003e-07 2023-09-30T17:04:20.790 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.791 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.791 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.791 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.022622+0000", 2023-09-30T17:04:20.791 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4457999999999999e-05 2023-09-30T17:04:20.791 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.791 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.791 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.791 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.022630+0000", 2023-09-30T17:04:20.791 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2559999999999996e-06 2023-09-30T17:04:20.791 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.791 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.792 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.792 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.022635+0000", 2023-09-30T17:04:20.792 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2839999999999997e-06 2023-09-30T17:04:20.792 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.792 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.792 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.792 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.792 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.792 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137579 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.792 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.046884+0000", 2023-09-30T17:04:20.792 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.123220002, 2023-09-30T17:04:20.793 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.13068634800000001, 2023-09-30T17:04:20.793 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.793 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.793 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.793 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.793 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.793 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137579 2023-09-30T17:04:20.793 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.793 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.793 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.793 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.793 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.046884+0000", 2023-09-30T17:04:20.793 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.794 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.794 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.794 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.794 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.046884+0000", 2023-09-30T17:04:20.794 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.794 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.794 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.794 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.794 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.046884+0000", 2023-09-30T17:04:20.794 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6499999999999999e-07 2023-09-30T17:04:20.794 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.795 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.795 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.795 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.046904+0000", 2023-09-30T17:04:20.795 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9828000000000001e-05 2023-09-30T17:04:20.795 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.795 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.795 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.795 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.046913+0000", 2023-09-30T17:04:20.795 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.568e-06 2023-09-30T17:04:20.795 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.795 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.795 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.796 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.046920+0000", 2023-09-30T17:04:20.796 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5039999999999996e-06 2023-09-30T17:04:20.796 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.796 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.796 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.796 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.796 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.796 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137633 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.796 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.082583+0000", 2023-09-30T17:04:20.796 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.087520489000000007, 2023-09-30T17:04:20.796 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.095019211000000006, 2023-09-30T17:04:20.796 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.797 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.797 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.797 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.797 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.797 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137633 2023-09-30T17:04:20.797 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.797 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.797 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.797 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.797 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.082583+0000", 2023-09-30T17:04:20.797 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.797 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.798 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.798 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.798 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.082583+0000", 2023-09-30T17:04:20.798 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.798 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.798 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.798 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.798 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.082584+0000", 2023-09-30T17:04:20.798 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9999999999999998e-07 2023-09-30T17:04:20.798 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.798 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.799 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.799 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.082601+0000", 2023-09-30T17:04:20.799 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7617000000000001e-05 2023-09-30T17:04:20.799 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.799 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.799 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.799 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.082612+0000", 2023-09-30T17:04:20.799 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0669000000000001e-05 2023-09-30T17:04:20.799 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.799 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.799 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.800 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.082618+0000", 2023-09-30T17:04:20.800 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7490000000000004e-06 2023-09-30T17:04:20.800 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.800 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.800 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.800 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.800 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.800 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136472 4.36 e54/17)", 2023-09-30T17:04:20.800 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.104308+0000", 2023-09-30T17:04:20.800 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.065795848000000004, 2023-09-30T17:04:20.800 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.073323371999999998, 2023-09-30T17:04:20.800 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.801 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.801 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.801 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.801 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.801 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.104308+0000", 2023-09-30T17:04:20.801 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.801 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.801 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.801 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.801 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.104308+0000", 2023-09-30T17:04:20.801 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.802 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.802 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.802 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.802 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.104308+0000", 2023-09-30T17:04:20.802 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8400000000000004e-07 2023-09-30T17:04:20.802 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.802 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.802 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.802 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.104322+0000", 2023-09-30T17:04:20.802 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3348e-05 2023-09-30T17:04:20.802 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.802 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.803 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.803 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.104331+0000", 2023-09-30T17:04:20.803 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3149999999999998e-06 2023-09-30T17:04:20.803 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.803 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.803 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.803 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.104338+0000", 2023-09-30T17:04:20.803 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5490000000000003e-06 2023-09-30T17:04:20.803 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.803 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.803 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.803 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.804 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.804 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137744 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.804 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.132789+0000", 2023-09-30T17:04:20.804 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.037315000000000001, 2023-09-30T17:04:20.804 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044870008000000003, 2023-09-30T17:04:20.804 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.804 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.804 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.804 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.804 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.805 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137744 2023-09-30T17:04:20.805 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.805 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.805 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.805 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.805 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.132789+0000", 2023-09-30T17:04:20.805 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.805 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.805 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.805 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.805 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.132789+0000", 2023-09-30T17:04:20.805 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.806 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.806 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.806 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.806 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.134518+0000", 2023-09-30T17:04:20.806 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001729277 2023-09-30T17:04:20.806 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.806 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.806 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.806 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.134535+0000", 2023-09-30T17:04:20.806 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7390000000000001e-05 2023-09-30T17:04:20.806 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.806 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.807 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.807 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.134545+0000", 2023-09-30T17:04:20.807 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5340000000000005e-06 2023-09-30T17:04:20.807 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.807 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.807 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.807 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.134552+0000", 2023-09-30T17:04:20.807 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1770000000000001e-06 2023-09-30T17:04:20.807 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.807 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.807 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.808 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.808 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.808 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136538 4.2e e54/17)", 2023-09-30T17:04:20.808 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.146760+0000", 2023-09-30T17:04:20.808 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.023343752999999998, 2023-09-30T17:04:20.808 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.030927390999999999, 2023-09-30T17:04:20.808 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.808 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.808 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.808 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.808 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.808 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.146760+0000", 2023-09-30T17:04:20.808 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.809 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.809 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.809 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.809 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.146760+0000", 2023-09-30T17:04:20.809 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.809 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.809 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.809 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.809 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.146760+0000", 2023-09-30T17:04:20.809 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.12e-07 2023-09-30T17:04:20.809 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.809 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.810 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.810 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.146768+0000", 2023-09-30T17:04:20.810 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4760000000000001e-06 2023-09-30T17:04:20.810 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.810 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.810 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.810 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.146771+0000", 2023-09-30T17:04:20.810 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2990000000000001e-06 2023-09-30T17:04:20.810 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.810 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.810 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.811 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.146774+0000", 2023-09-30T17:04:20.811 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0340000000000001e-06 2023-09-30T17:04:20.811 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.811 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.811 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.811 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.811 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.811 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136568 4.36 e54/17)", 2023-09-30T17:04:20.811 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.161242+0000", 2023-09-30T17:04:20.811 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0088622509999999998, 2023-09-30T17:04:20.811 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016472945999999999, 2023-09-30T17:04:20.811 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.852 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.852 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.852 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.852 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.852 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.161242+0000", 2023-09-30T17:04:20.852 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.852 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.852 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.853 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.853 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.161242+0000", 2023-09-30T17:04:20.853 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.853 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.853 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.853 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.161242+0000", 2023-09-30T17:04:20.853 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.23e-07 2023-09-30T17:04:20.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.853 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.853 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.854 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.161255+0000", 2023-09-30T17:04:20.854 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2991e-05 2023-09-30T17:04:20.854 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.854 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.854 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.854 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.161261+0000", 2023-09-30T17:04:20.854 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2430000000000002e-06 2023-09-30T17:04:20.854 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.855 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.855 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.855 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.161264+0000", 2023-09-30T17:04:20.855 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3349999999999998e-06 2023-09-30T17:04:20.855 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.855 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.855 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.855 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.855 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.855 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137848 4.2c 4.faffd3ac (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.855 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.174168+0000", 2023-09-30T17:04:20.856 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9959359, 2023-09-30T17:04:20.856 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036000329999999999, 2023-09-30T17:04:20.856 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.856 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.856 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.856 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.856 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.856 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137848 2023-09-30T17:04:20.856 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.857 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.857 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.174168+0000", 2023-09-30T17:04:20.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.857 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.857 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.174168+0000", 2023-09-30T17:04:20.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.857 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.858 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.858 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.174168+0000", 2023-09-30T17:04:20.858 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.84e-07 2023-09-30T17:04:20.858 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.858 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.858 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.858 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.174181+0000", 2023-09-30T17:04:20.858 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2819999999999999e-05 2023-09-30T17:04:20.858 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.858 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.858 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.859 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.174189+0000", 2023-09-30T17:04:20.859 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5989999999999996e-06 2023-09-30T17:04:20.859 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.859 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.859 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.859 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.174194+0000", 2023-09-30T17:04:20.859 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9590000000000003e-06 2023-09-30T17:04:20.859 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.859 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.859 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.860 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.860 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.860 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136383 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.860 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.587567+0000", 2023-09-30T17:04:20.860 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.58253665399999999, 2023-09-30T17:04:20.860 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.59026153800000003, 2023-09-30T17:04:20.860 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.860 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.860 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.861 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.861 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.861 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136383 2023-09-30T17:04:20.861 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.861 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.861 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.861 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.861 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.587567+0000", 2023-09-30T17:04:20.861 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.861 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.861 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.861 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.862 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.587567+0000", 2023-09-30T17:04:20.862 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.862 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.862 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.862 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.862 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.587568+0000", 2023-09-30T17:04:20.862 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9100000000000004e-07 2023-09-30T17:04:20.862 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.862 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.862 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.862 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.587581+0000", 2023-09-30T17:04:20.863 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3264999999999999e-05 2023-09-30T17:04:20.863 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.863 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.863 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.863 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.587589+0000", 2023-09-30T17:04:20.863 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1890000000000007e-06 2023-09-30T17:04:20.863 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.863 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.863 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.863 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.587596+0000", 2023-09-30T17:04:20.863 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6900000000000003e-06 2023-09-30T17:04:20.864 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.864 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.864 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.864 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.864 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136420 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.864 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.603558+0000", 2023-09-30T17:04:20.864 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.56654592199999998, 2023-09-30T17:04:20.864 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.57433116799999995, 2023-09-30T17:04:20.865 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.865 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.865 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.865 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.865 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.865 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136420 2023-09-30T17:04:20.865 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.865 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.865 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.865 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.866 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.603558+0000", 2023-09-30T17:04:20.866 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.866 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.866 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.866 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.866 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.603558+0000", 2023-09-30T17:04:20.866 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.866 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.866 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.867 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.867 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.603558+0000", 2023-09-30T17:04:20.867 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9299999999999998e-07 2023-09-30T17:04:20.867 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.867 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.867 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.867 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.603573+0000", 2023-09-30T17:04:20.867 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4357e-05 2023-09-30T17:04:20.867 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.867 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.868 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.603581+0000", 2023-09-30T17:04:20.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.568e-06 2023-09-30T17:04:20.868 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.868 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.603586+0000", 2023-09-30T17:04:20.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0529999999999997e-06 2023-09-30T17:04:20.868 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.868 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.868 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.868 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.869 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136853 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.869 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.775115+0000", 2023-09-30T17:04:20.869 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.394988491, 2023-09-30T17:04:20.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.40282597399999998, 2023-09-30T17:04:20.869 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.869 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.869 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.869 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.869 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.870 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136853 2023-09-30T17:04:20.870 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.870 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.870 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.870 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.775115+0000", 2023-09-30T17:04:20.870 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.870 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.870 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.870 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.775115+0000", 2023-09-30T17:04:20.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.871 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.871 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.871 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.871 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.775116+0000", 2023-09-30T17:04:20.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0900000000000002e-07 2023-09-30T17:04:20.871 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.871 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.871 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.871 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.775128+0000", 2023-09-30T17:04:20.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1973999999999999e-05 2023-09-30T17:04:20.872 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.872 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.775132+0000", 2023-09-30T17:04:20.872 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6700000000000002e-06 2023-09-30T17:04:20.872 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.872 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.775138+0000", 2023-09-30T17:04:20.872 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2970000000000003e-06 2023-09-30T17:04:20.873 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.873 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.873 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.873 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.873 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.873 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137242 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.873 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.910604+0000", 2023-09-30T17:04:20.873 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.25950014999999998, 2023-09-30T17:04:20.873 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.26739196399999998, 2023-09-30T17:04:20.873 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.873 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.874 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.874 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.874 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.874 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137242 2023-09-30T17:04:20.874 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.874 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.874 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.874 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.874 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.910604+0000", 2023-09-30T17:04:20.874 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.874 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.874 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.875 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.875 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.910604+0000", 2023-09-30T17:04:20.875 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.875 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.875 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.875 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.875 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.910604+0000", 2023-09-30T17:04:20.875 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5999999999999999e-07 2023-09-30T17:04:20.875 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.875 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.875 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.876 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.910620+0000", 2023-09-30T17:04:20.876 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5441e-05 2023-09-30T17:04:20.876 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.876 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.876 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.876 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.910625+0000", 2023-09-30T17:04:20.876 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6570000000000002e-06 2023-09-30T17:04:20.876 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.876 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.876 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.876 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.910629+0000", 2023-09-30T17:04:20.876 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4920000000000002e-06 2023-09-30T17:04:20.877 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.877 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.877 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.877 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.877 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.877 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136024 4.6 e54/17)", 2023-09-30T17:04:20.877 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.945031+0000", 2023-09-30T17:04:20.877 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.225072987, 2023-09-30T17:04:20.877 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.23301430000000001, 2023-09-30T17:04:20.877 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.877 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.877 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.878 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.878 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.878 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.945031+0000", 2023-09-30T17:04:20.878 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.878 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.878 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.878 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.878 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.945031+0000", 2023-09-30T17:04:20.878 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.878 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.878 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.878 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.879 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.945031+0000", 2023-09-30T17:04:20.879 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7599999999999998e-07 2023-09-30T17:04:20.879 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.879 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.879 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.879 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.945050+0000", 2023-09-30T17:04:20.879 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8663000000000001e-05 2023-09-30T17:04:20.879 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.879 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.879 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.879 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.945063+0000", 2023-09-30T17:04:20.880 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3414999999999999e-05 2023-09-30T17:04:20.880 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.880 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.880 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.880 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.945069+0000", 2023-09-30T17:04:20.880 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6899999999999997e-06 2023-09-30T17:04:20.880 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.880 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.880 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.880 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.880 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.881 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136079 4.2e e54/17)", 2023-09-30T17:04:20.881 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.979487+0000", 2023-09-30T17:04:20.881 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.19061714199999999, 2023-09-30T17:04:20.881 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.19860181800000001, 2023-09-30T17:04:20.881 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.881 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.881 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.881 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.881 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.881 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.979487+0000", 2023-09-30T17:04:20.881 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.882 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.882 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.882 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.882 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.979487+0000", 2023-09-30T17:04:20.882 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.882 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.882 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.882 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.882 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.979487+0000", 2023-09-30T17:04:20.882 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2500000000000005e-07 2023-09-30T17:04:20.882 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.883 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.883 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.883 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.979517+0000", 2023-09-30T17:04:20.883 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9978999999999999e-05 2023-09-30T17:04:20.883 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.883 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.883 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.883 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.979532+0000", 2023-09-30T17:04:20.884 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5121e-05 2023-09-30T17:04:20.884 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.884 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.884 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.884 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.979540+0000", 2023-09-30T17:04:20.884 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5619999999999998e-06 2023-09-30T17:04:20.884 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.884 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.884 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.884 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.885 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.885 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137447 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.885 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.988670+0000", 2023-09-30T17:04:20.885 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.18143330799999999, 2023-09-30T17:04:20.885 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.18946564399999999, 2023-09-30T17:04:20.885 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.885 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.885 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.885 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.885 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.885 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137447 2023-09-30T17:04:20.886 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.886 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.886 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.886 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.886 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.988670+0000", 2023-09-30T17:04:20.886 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.886 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.886 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.886 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.887 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.988670+0000", 2023-09-30T17:04:20.887 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.887 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.887 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.887 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.887 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.990530+0000", 2023-09-30T17:04:20.887 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001859919 2023-09-30T17:04:20.887 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.887 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.887 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.887 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.990544+0000", 2023-09-30T17:04:20.888 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3390999999999999e-05 2023-09-30T17:04:20.888 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.888 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.888 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.888 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.990552+0000", 2023-09-30T17:04:20.888 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9729999999999997e-06 2023-09-30T17:04:20.888 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.888 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.888 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.889 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.990557+0000", 2023-09-30T17:04:20.889 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3689999999999998e-06 2023-09-30T17:04:20.889 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.889 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.889 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.889 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.889 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.889 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136155 4.36 e54/17)", 2023-09-30T17:04:20.889 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.007289+0000", 2023-09-30T17:04:20.889 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.16281427300000001, 2023-09-30T17:04:20.890 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.17089728100000001, 2023-09-30T17:04:20.890 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.890 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.890 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.905 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.905 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.905 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.007289+0000", 2023-09-30T17:04:20.905 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.906 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.906 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.906 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.906 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.007289+0000", 2023-09-30T17:04:20.906 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.906 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.906 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.906 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.906 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.007290+0000", 2023-09-30T17:04:20.906 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6999999999999999e-07 2023-09-30T17:04:20.906 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.907 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.907 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.907 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.007298+0000", 2023-09-30T17:04:20.907 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3289999999999994e-06 2023-09-30T17:04:20.907 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.907 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.907 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.907 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.007303+0000", 2023-09-30T17:04:20.907 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2900000000000002e-06 2023-09-30T17:04:20.907 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.907 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.907 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.908 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.007308+0000", 2023-09-30T17:04:20.908 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4920000000000004e-06 2023-09-30T17:04:20.908 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.908 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.908 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.908 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.908 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.908 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137661 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.908 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.097494+0000", 2023-09-30T17:04:20.908 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.072609836999999997, 2023-09-30T17:04:20.908 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.080741151999999997, 2023-09-30T17:04:20.909 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.909 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.909 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.909 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.909 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.909 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137661 2023-09-30T17:04:20.909 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.909 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.909 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.909 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.909 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.097494+0000", 2023-09-30T17:04:20.910 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.910 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.910 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.910 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.910 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.097494+0000", 2023-09-30T17:04:20.910 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.910 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.910 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.910 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.910 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.097494+0000", 2023-09-30T17:04:20.910 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4099999999999999e-07 2023-09-30T17:04:20.910 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.911 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.911 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.911 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.097519+0000", 2023-09-30T17:04:20.911 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4950999999999999e-05 2023-09-30T17:04:20.911 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.911 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.911 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.911 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.097528+0000", 2023-09-30T17:04:20.911 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2579999999999995e-06 2023-09-30T17:04:20.911 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.911 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.911 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.912 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.097533+0000", 2023-09-30T17:04:20.912 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3319999999999999e-06 2023-09-30T17:04:20.912 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.912 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.912 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.912 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.912 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.912 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137717 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.912 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.114719+0000", 2023-09-30T17:04:20.912 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.055384441, 2023-09-30T17:04:20.912 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.063567116000000007, 2023-09-30T17:04:20.912 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.913 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.913 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.913 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.926 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.926 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137717 2023-09-30T17:04:20.926 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.926 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.926 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.926 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.927 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.114719+0000", 2023-09-30T17:04:20.927 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.927 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.927 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.927 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.927 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.114719+0000", 2023-09-30T17:04:20.927 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.927 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.927 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.927 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.928 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.114720+0000", 2023-09-30T17:04:20.928 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4999999999999998e-07 2023-09-30T17:04:20.928 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.928 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.928 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.928 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.114731+0000", 2023-09-30T17:04:20.928 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0845e-05 2023-09-30T17:04:20.928 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.928 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.928 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.928 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.114737+0000", 2023-09-30T17:04:20.929 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6699999999999997e-06 2023-09-30T17:04:20.929 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.929 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.929 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.929 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.114743+0000", 2023-09-30T17:04:20.929 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6319999999999996e-06 2023-09-30T17:04:20.929 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.929 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.929 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.929 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.929 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.930 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137748 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.930 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.134566+0000", 2023-09-30T17:04:20.930 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.035537964999999998, 2023-09-30T17:04:20.930 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043776098999999999, 2023-09-30T17:04:20.930 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.930 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:20.930 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.930 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.930 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.930 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137748 2023-09-30T17:04:20.931 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.931 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.931 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.931 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.931 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.134566+0000", 2023-09-30T17:04:20.931 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.931 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.931 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.932 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.932 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.134566+0000", 2023-09-30T17:04:20.932 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.932 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.932 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.932 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.932 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.134566+0000", 2023-09-30T17:04:20.933 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0999999999999998e-07 2023-09-30T17:04:20.933 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.933 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.933 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.933 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.134579+0000", 2023-09-30T17:04:20.933 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2841e-05 2023-09-30T17:04:20.933 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.934 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.934 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.934 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.134586+0000", 2023-09-30T17:04:20.934 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8349999999999998e-06 2023-09-30T17:04:20.934 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.934 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.934 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:20.934 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.134590+0000", 2023-09-30T17:04:20.935 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8e-06 2023-09-30T17:04:20.935 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.935 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:20.935 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:20.935 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.935 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.935 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137776 4.12 4:4be51a30:::100000001f8.0000000b:head [write 2125824~4096 in=4096b,write 2154496~4096 in=4096b,write 2166784~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:20.935 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.138702+0000", 2023-09-30T17:04:20.936 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.031401668000000001, 2023-09-30T17:04:20.936 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039699243000000002, 2023-09-30T17:04:20.936 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:20.936 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:20.936 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:20.936 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:20.936 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:20.937 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137776 2023-09-30T17:04:20.937 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.937 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:20.937 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.937 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:20.937 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.138702+0000", 2023-09-30T17:04:20.937 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.938 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.938 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.938 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:20.938 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.138702+0000", 2023-09-30T17:04:20.938 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:20.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.998 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:20.998 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.146783+0000", 2023-09-30T17:04:20.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0080808549999999996 2023-09-30T17:04:20.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.999 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:20.999 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.146793+0000", 2023-09-30T17:04:20.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0318e-05 2023-09-30T17:04:20.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:20.999 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:20.999 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.146798+0000", 2023-09-30T17:04:20.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9409999999999998e-06 2023-09-30T17:04:20.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:20.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.000 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.000 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.146802+0000", 2023-09-30T17:04:21.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5300000000000001e-06 2023-09-30T17:04:21.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.001 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:21.001 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.151073+0000", 2023-09-30T17:04:21.001 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042716250000000002 2023-09-30T17:04:21.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.002 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:21.002 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.151150+0000", 2023-09-30T17:04:21.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7129e-05 2023-09-30T17:04:21.002 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.002 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:21.002 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.151295+0000", 2023-09-30T17:04:21.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014421099999999999 2023-09-30T17:04:21.002 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.002 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:21.002 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.172139+0000", 2023-09-30T17:04:21.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020844194 2023-09-30T17:04:21.003 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.003 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.003 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.003 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.003 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136570 4.2e e54/17)", 2023-09-30T17:04:21.003 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.161270+0000", 2023-09-30T17:04:21.003 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0088341080000000002, 2023-09-30T17:04:21.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017206282, 2023-09-30T17:04:21.003 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.004 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.004 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.161270+0000", 2023-09-30T17:04:21.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.161270+0000", 2023-09-30T17:04:21.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.005 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.005 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.005 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.161270+0000", 2023-09-30T17:04:21.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8699999999999999e-07 2023-09-30T17:04:21.005 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.005 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.005 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.161277+0000", 2023-09-30T17:04:21.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3339999999999996e-06 2023-09-30T17:04:21.006 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.161283+0000", 2023-09-30T17:04:21.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8930000000000002e-06 2023-09-30T17:04:21.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.161286+0000", 2023-09-30T17:04:21.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9840000000000001e-06 2023-09-30T17:04:21.017 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.018 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.018 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.018 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137849 4.12 4.7bd9d512 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.018 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.174200+0000", 2023-09-30T17:04:21.018 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.995904, 2023-09-30T17:04:21.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0043293710000000003, 2023-09-30T17:04:21.018 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.019 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.019 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.019 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.019 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.019 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137849 2023-09-30T17:04:21.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.019 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.019 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.019 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.174200+0000", 2023-09-30T17:04:21.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.174200+0000", 2023-09-30T17:04:21.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.174200+0000", 2023-09-30T17:04:21.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6199999999999999e-07 2023-09-30T17:04:21.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.021 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.174216+0000", 2023-09-30T17:04:21.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6002e-05 2023-09-30T17:04:21.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.021 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.021 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.174224+0000", 2023-09-30T17:04:21.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.559e-06 2023-09-30T17:04:21.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.022 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.022 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.174229+0000", 2023-09-30T17:04:21.022 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9699999999999998e-06 2023-09-30T17:04:21.022 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.023 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.023 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.023 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.023 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.023 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136486 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.023 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.631685+0000", 2023-09-30T17:04:21.023 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.53841849399999997, 2023-09-30T17:04:21.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.54689856699999995, 2023-09-30T17:04:21.023 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.023 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.024 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.024 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.024 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.024 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136486 2023-09-30T17:04:21.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.024 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.024 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.024 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.631685+0000", 2023-09-30T17:04:21.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.025 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.025 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.631685+0000", 2023-09-30T17:04:21.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.025 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.025 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.025 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.025 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.631686+0000", 2023-09-30T17:04:21.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9000000000000002e-07 2023-09-30T17:04:21.025 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.025 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.025 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.026 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.631699+0000", 2023-09-30T17:04:21.026 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3464e-05 2023-09-30T17:04:21.026 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.026 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.026 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.631708+0000", 2023-09-30T17:04:21.026 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6330000000000002e-06 2023-09-30T17:04:21.026 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.026 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.026 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.631713+0000", 2023-09-30T17:04:21.026 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7709999999999997e-06 2023-09-30T17:04:21.027 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.027 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.027 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.027 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.027 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136630 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.027 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.687573+0000", 2023-09-30T17:04:21.027 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.48253034, 2023-09-30T17:04:21.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.49106206000000002, 2023-09-30T17:04:21.027 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.027 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.027 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.028 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.028 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.028 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136630 2023-09-30T17:04:21.028 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.028 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.028 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.028 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.028 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.687573+0000", 2023-09-30T17:04:21.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.028 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.028 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.029 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.029 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.687573+0000", 2023-09-30T17:04:21.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.029 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.029 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.029 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.687574+0000", 2023-09-30T17:04:21.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8599999999999998e-07 2023-09-30T17:04:21.029 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.029 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.029 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.687587+0000", 2023-09-30T17:04:21.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2931999999999999e-05 2023-09-30T17:04:21.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.030 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.030 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.687593+0000", 2023-09-30T17:04:21.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5830000000000003e-06 2023-09-30T17:04:21.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.030 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.030 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.687599+0000", 2023-09-30T17:04:21.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7710000000000003e-06 2023-09-30T17:04:21.030 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.031 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.031 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.031 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:135646 4.36 e54/17 4:6fa85f86:::100000001f8.00000013:head v 54'6428, mlcod=54'6381)", 2023-09-30T17:04:21.031 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.836355+0000", 2023-09-30T17:04:21.031 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.33374828099999998, 2023-09-30T17:04:21.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.34233509200000001, 2023-09-30T17:04:21.031 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.031 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:21.031 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.032 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.032 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.836355+0000", 2023-09-30T17:04:21.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.032 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.032 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.836355+0000", 2023-09-30T17:04:21.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.032 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.033 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.836356+0000", 2023-09-30T17:04:21.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8599999999999999e-07 2023-09-30T17:04:21.033 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.033 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.033 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.033 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.836367+0000", 2023-09-30T17:04:21.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.131e-05 2023-09-30T17:04:21.033 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.033 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.033 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.033 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.836373+0000", 2023-09-30T17:04:21.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0959999999999997e-06 2023-09-30T17:04:21.034 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.034 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.034 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.836378+0000", 2023-09-30T17:04:21.034 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4329999999999997e-06 2023-09-30T17:04:21.034 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.034 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:21.034 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.130657+0000", 2023-09-30T17:04:21.034 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.294278918 2023-09-30T17:04:21.034 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.035 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.035 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:21.035 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.130676+0000", 2023-09-30T17:04:21.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9222999999999999e-05 2023-09-30T17:04:21.035 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.035 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.035 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.035 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.035 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.035 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137273 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.036 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.922609+0000", 2023-09-30T17:04:21.036 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.247494874, 2023-09-30T17:04:21.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.256138162, 2023-09-30T17:04:21.036 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.036 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.036 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.036 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.036 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.036 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137273 2023-09-30T17:04:21.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.036 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.037 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.922609+0000", 2023-09-30T17:04:21.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.037 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.922609+0000", 2023-09-30T17:04:21.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.038 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.922609+0000", 2023-09-30T17:04:21.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.15e-07 2023-09-30T17:04:21.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.038 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.038 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.922622+0000", 2023-09-30T17:04:21.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3078000000000001e-05 2023-09-30T17:04:21.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.038 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.038 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.922630+0000", 2023-09-30T17:04:21.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.622e-06 2023-09-30T17:04:21.039 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.039 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.039 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.922654+0000", 2023-09-30T17:04:21.039 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3672999999999998e-05 2023-09-30T17:04:21.039 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.039 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.039 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.039 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.039 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136085 4.6 e54/17)", 2023-09-30T17:04:21.040 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.979622+0000", 2023-09-30T17:04:21.040 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.19048176, 2023-09-30T17:04:21.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.199177254, 2023-09-30T17:04:21.040 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.040 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.040 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.040 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.040 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.040 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.979622+0000", 2023-09-30T17:04:21.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.040 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.041 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.041 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.072 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.979622+0000", 2023-09-30T17:04:21.072 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.072 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.073 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.073 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.073 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.979622+0000", 2023-09-30T17:04:21.073 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8599999999999998e-07 2023-09-30T17:04:21.073 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.073 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.073 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.073 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.979638+0000", 2023-09-30T17:04:21.073 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5203e-05 2023-09-30T17:04:21.073 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.074 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.074 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.074 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.979651+0000", 2023-09-30T17:04:21.074 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3672000000000001e-05 2023-09-30T17:04:21.074 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.074 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.074 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.074 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.979658+0000", 2023-09-30T17:04:21.074 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6800000000000004e-06 2023-09-30T17:04:21.074 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.075 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.075 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.075 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.075 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.075 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136144 4.6 e54/17)", 2023-09-30T17:04:21.075 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.008175+0000", 2023-09-30T17:04:21.075 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.16192836899999999, 2023-09-30T17:04:21.075 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.17066836199999999, 2023-09-30T17:04:21.075 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.075 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.075 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.076 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.076 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.076 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.008175+0000", 2023-09-30T17:04:21.076 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.076 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.076 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.076 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.076 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.008175+0000", 2023-09-30T17:04:21.076 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.076 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.076 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.077 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.077 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.008176+0000", 2023-09-30T17:04:21.077 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8899999999999999e-07 2023-09-30T17:04:21.077 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.077 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.077 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.077 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.008196+0000", 2023-09-30T17:04:21.077 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9507000000000001e-05 2023-09-30T17:04:21.077 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.077 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.077 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.078 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.008208+0000", 2023-09-30T17:04:21.078 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2683999999999999e-05 2023-09-30T17:04:21.078 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.078 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.078 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.078 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.008215+0000", 2023-09-30T17:04:21.078 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6980000000000001e-06 2023-09-30T17:04:21.078 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.078 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.078 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.078 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.079 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.079 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137508 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.079 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.018872+0000", 2023-09-30T17:04:21.079 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.15123160599999999, 2023-09-30T17:04:21.079 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.16002068, 2023-09-30T17:04:21.079 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.079 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.079 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.079 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.079 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.079 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137508 2023-09-30T17:04:21.079 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.080 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.080 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.080 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.080 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.018872+0000", 2023-09-30T17:04:21.080 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.080 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.080 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.080 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.080 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.018872+0000", 2023-09-30T17:04:21.080 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.080 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.081 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.081 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.081 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.024550+0000", 2023-09-30T17:04:21.081 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056778009999999997 2023-09-30T17:04:21.081 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.081 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.081 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.081 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.024568+0000", 2023-09-30T17:04:21.081 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8012999999999998e-05 2023-09-30T17:04:21.081 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.081 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.152 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.152 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.024579+0000", 2023-09-30T17:04:21.152 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1139e-05 2023-09-30T17:04:21.152 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.152 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.153 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.153 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.024586+0000", 2023-09-30T17:04:21.153 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.396e-06 2023-09-30T17:04:21.153 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.153 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.153 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.153 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.153 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.153 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137697 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.153 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.103605+0000", 2023-09-30T17:04:21.153 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.066498774999999996, 2023-09-30T17:04:21.154 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.075351088999999996, 2023-09-30T17:04:21.154 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.154 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.154 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.154 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.154 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.154 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137697 2023-09-30T17:04:21.154 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.154 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.154 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.154 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.155 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.103605+0000", 2023-09-30T17:04:21.155 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.155 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.155 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.155 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.155 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.103605+0000", 2023-09-30T17:04:21.155 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.155 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.155 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.155 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.155 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.107202+0000", 2023-09-30T17:04:21.156 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0035972640000000002 2023-09-30T17:04:21.156 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.156 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.156 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.156 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.107217+0000", 2023-09-30T17:04:21.156 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5041e-05 2023-09-30T17:04:21.156 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.156 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.156 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.156 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.107226+0000", 2023-09-30T17:04:21.156 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6009999999999995e-06 2023-09-30T17:04:21.156 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.157 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.157 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.157 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.107232+0000", 2023-09-30T17:04:21.157 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9909999999999999e-06 2023-09-30T17:04:21.157 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.157 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.157 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.157 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.157 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.157 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136476 4.6 e54/17)", 2023-09-30T17:04:21.157 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.114770+0000", 2023-09-30T17:04:21.158 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.055333801000000002, 2023-09-30T17:04:21.158 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.06424349, 2023-09-30T17:04:21.158 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.158 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.158 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.158 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.158 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.158 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.114770+0000", 2023-09-30T17:04:21.158 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.158 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.158 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.159 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.159 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.114770+0000", 2023-09-30T17:04:21.159 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.159 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.159 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.159 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.159 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.114770+0000", 2023-09-30T17:04:21.159 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2899999999999999e-07 2023-09-30T17:04:21.159 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.159 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.159 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.159 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.114783+0000", 2023-09-30T17:04:21.160 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3149000000000001e-05 2023-09-30T17:04:21.160 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.160 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.160 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.160 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.114790+0000", 2023-09-30T17:04:21.160 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6050000000000003e-06 2023-09-30T17:04:21.160 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.160 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.160 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.160 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.114796+0000", 2023-09-30T17:04:21.161 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2539999999999998e-06 2023-09-30T17:04:21.161 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.161 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.161 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.161 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.161 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.161 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137749 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 1011712~4096 in=4096b,write 1069056~4096 in=4096b,write 1081344~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.161 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.134596+0000", 2023-09-30T17:04:21.161 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.035507489000000003, 2023-09-30T17:04:21.162 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044479126000000001, 2023-09-30T17:04:21.162 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.162 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:21.162 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.162 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.162 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.162 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137749 2023-09-30T17:04:21.162 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.162 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.162 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.163 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.163 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.134596+0000", 2023-09-30T17:04:21.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.163 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.163 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.163 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.163 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.134596+0000", 2023-09-30T17:04:21.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.163 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.163 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.163 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.164 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.134597+0000", 2023-09-30T17:04:21.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3000000000000002e-07 2023-09-30T17:04:21.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.164 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.164 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.134607+0000", 2023-09-30T17:04:21.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0219e-05 2023-09-30T17:04:21.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.164 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.165 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.134611+0000", 2023-09-30T17:04:21.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8210000000000003e-06 2023-09-30T17:04:21.165 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.165 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.165 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.165 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.134614+0000", 2023-09-30T17:04:21.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.96e-06 2023-09-30T17:04:21.165 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.165 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.165 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:21.165 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.169721+0000", 2023-09-30T17:04:21.166 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.035106963999999997 2023-09-30T17:04:21.166 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.166 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:21.166 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.169825+0000", 2023-09-30T17:04:21.166 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000104858 2023-09-30T17:04:21.166 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.166 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.166 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.166 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.167 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137850 4.11 4:893be98d:::100000001f8.00000001:head [write 2342912~4096 in=4096b,write 2781184~4096 in=4096b,write 2813952~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.167 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.174235+0000", 2023-09-30T17:04:21.167 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9958687, 2023-09-30T17:04:21.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0049210499999999997, 2023-09-30T17:04:21.167 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.167 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:21.167 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.167 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.167 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.167 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137850 2023-09-30T17:04:21.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.168 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.174235+0000", 2023-09-30T17:04:21.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.174235+0000", 2023-09-30T17:04:21.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.174236+0000", 2023-09-30T17:04:21.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9900000000000001e-07 2023-09-30T17:04:21.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.174245+0000", 2023-09-30T17:04:21.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9199999999999999e-06 2023-09-30T17:04:21.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.170 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.170 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.174253+0000", 2023-09-30T17:04:21.170 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4800000000000004e-06 2023-09-30T17:04:21.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.170 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.170 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.174259+0000", 2023-09-30T17:04:21.170 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.353e-06 2023-09-30T17:04:21.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:21.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.174317+0000", 2023-09-30T17:04:21.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.728e-05 2023-09-30T17:04:21.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:21.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.174419+0000", 2023-09-30T17:04:21.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000102316 2023-09-30T17:04:21.171 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.171 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.171 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.172 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136388 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.172 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.587643+0000", 2023-09-30T17:04:21.172 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.58246070400000005, 2023-09-30T17:04:21.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.59158817100000005, 2023-09-30T17:04:21.175 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.176 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.176 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.176 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.176 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.176 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136388 2023-09-30T17:04:21.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.176 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.177 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.177 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.587643+0000", 2023-09-30T17:04:21.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.177 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.177 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.587643+0000", 2023-09-30T17:04:21.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.178 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.178 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.178 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.587643+0000", 2023-09-30T17:04:21.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.58e-07 2023-09-30T17:04:21.178 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.178 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.178 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.178 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.587658+0000", 2023-09-30T17:04:21.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4756000000000001e-05 2023-09-30T17:04:21.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.587664+0000", 2023-09-30T17:04:21.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.066e-06 2023-09-30T17:04:21.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.587669+0000", 2023-09-30T17:04:21.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8300000000000003e-06 2023-09-30T17:04:21.179 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.180 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.180 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.180 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136423 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.180 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.603627+0000", 2023-09-30T17:04:21.180 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.56647632000000003, 2023-09-30T17:04:21.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.57566306, 2023-09-30T17:04:21.180 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.180 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.180 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.181 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.181 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.181 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136423 2023-09-30T17:04:21.181 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.181 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.181 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.181 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.181 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.603627+0000", 2023-09-30T17:04:21.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.181 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.181 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.182 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.182 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.603627+0000", 2023-09-30T17:04:21.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.182 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.182 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.603628+0000", 2023-09-30T17:04:21.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7899999999999999e-07 2023-09-30T17:04:21.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.603643+0000", 2023-09-30T17:04:21.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5107e-05 2023-09-30T17:04:21.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.603649+0000", 2023-09-30T17:04:21.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3729999999999998e-06 2023-09-30T17:04:21.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.603654+0000", 2023-09-30T17:04:21.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9479999999999999e-06 2023-09-30T17:04:21.184 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.184 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.184 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.184 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136741 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.184 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.737339+0000", 2023-09-30T17:04:21.184 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.43276488200000002, 2023-09-30T17:04:21.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.44199978699999998, 2023-09-30T17:04:21.185 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.185 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.185 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.185 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.185 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.185 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136741 2023-09-30T17:04:21.185 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.185 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.185 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.185 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.185 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.737339+0000", 2023-09-30T17:04:21.186 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.186 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.186 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.186 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.186 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.737339+0000", 2023-09-30T17:04:21.186 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.186 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.186 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.186 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.186 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.737339+0000", 2023-09-30T17:04:21.186 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2300000000000001e-07 2023-09-30T17:04:21.186 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.187 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.737352+0000", 2023-09-30T17:04:21.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2136999999999999e-05 2023-09-30T17:04:21.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.187 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.737358+0000", 2023-09-30T17:04:21.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2820000000000002e-06 2023-09-30T17:04:21.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.188 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.188 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.737363+0000", 2023-09-30T17:04:21.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2209999999999996e-06 2023-09-30T17:04:21.188 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.188 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.188 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.188 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137315 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.188 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.930561+0000", 2023-09-30T17:04:21.188 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.23954322, 2023-09-30T17:04:21.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.248808956, 2023-09-30T17:04:21.189 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.189 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.189 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.189 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.189 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.190 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137315 2023-09-30T17:04:21.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.190 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.190 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.190 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.930561+0000", 2023-09-30T17:04:21.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.190 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.190 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.930561+0000", 2023-09-30T17:04:21.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.191 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.934517+0000", 2023-09-30T17:04:21.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039566389999999996 2023-09-30T17:04:21.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.191 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.192 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.934532+0000", 2023-09-30T17:04:21.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4789e-05 2023-09-30T17:04:21.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.204 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.205 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.934542+0000", 2023-09-30T17:04:21.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7119999999999995e-06 2023-09-30T17:04:21.205 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.205 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.205 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.934550+0000", 2023-09-30T17:04:21.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2209999999999997e-06 2023-09-30T17:04:21.205 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.205 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.205 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.205 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.206 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136106 4.6 e54/17)", 2023-09-30T17:04:21.206 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.991501+0000", 2023-09-30T17:04:21.206 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.17860284800000001, 2023-09-30T17:04:21.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.187900069, 2023-09-30T17:04:21.206 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.206 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.206 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.206 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.206 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.991501+0000", 2023-09-30T17:04:21.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.207 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.207 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.991501+0000", 2023-09-30T17:04:21.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.207 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.207 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.991502+0000", 2023-09-30T17:04:21.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9400000000000004e-07 2023-09-30T17:04:21.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.208 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.208 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.991539+0000", 2023-09-30T17:04:21.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7045999999999997e-05 2023-09-30T17:04:21.208 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.208 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.208 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.991549+0000", 2023-09-30T17:04:21.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.011e-05 2023-09-30T17:04:21.208 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.208 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.208 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.991556+0000", 2023-09-30T17:04:21.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2529999999999998e-06 2023-09-30T17:04:21.209 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.209 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.209 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.209 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.209 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137698 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.209 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.107242+0000", 2023-09-30T17:04:21.209 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.062862207000000003, 2023-09-30T17:04:21.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.072187089999999995, 2023-09-30T17:04:21.209 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.210 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.210 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.210 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.210 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.210 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137698 2023-09-30T17:04:21.210 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.210 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.210 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.107242+0000", 2023-09-30T17:04:21.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.107242+0000", 2023-09-30T17:04:21.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.107242+0000", 2023-09-30T17:04:21.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7e-07 2023-09-30T17:04:21.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.212 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.212 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.107254+0000", 2023-09-30T17:04:21.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1854e-05 2023-09-30T17:04:21.212 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.212 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.212 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.107260+0000", 2023-09-30T17:04:21.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8699999999999997e-06 2023-09-30T17:04:21.212 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.212 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.213 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.107264+0000", 2023-09-30T17:04:21.213 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6149999999999999e-06 2023-09-30T17:04:21.213 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.213 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.213 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.213 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.213 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.213 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136477 4.6 e54/17)", 2023-09-30T17:04:21.213 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.117670+0000", 2023-09-30T17:04:21.213 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.052433291999999999, 2023-09-30T17:04:21.214 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.061789504000000002, 2023-09-30T17:04:21.214 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.214 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.214 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.214 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.214 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.117670+0000", 2023-09-30T17:04:21.214 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.214 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.214 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.117670+0000", 2023-09-30T17:04:21.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.215 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.215 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.117671+0000", 2023-09-30T17:04:21.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.85e-07 2023-09-30T17:04:21.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.229 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.229 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.117690+0000", 2023-09-30T17:04:21.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8161000000000001e-05 2023-09-30T17:04:21.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.230 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.230 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.117700+0000", 2023-09-30T17:04:21.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0033e-05 2023-09-30T17:04:21.230 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.230 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.230 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.117709+0000", 2023-09-30T17:04:21.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.815e-06 2023-09-30T17:04:21.230 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.230 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.230 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.231 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136539 4.36 e54/17)", 2023-09-30T17:04:21.231 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.147295+0000", 2023-09-30T17:04:21.231 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.022808292000000001, 2023-09-30T17:04:21.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.032190837, 2023-09-30T17:04:21.231 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.231 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.231 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.231 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.232 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.147295+0000", 2023-09-30T17:04:21.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.232 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.147295+0000", 2023-09-30T17:04:21.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.232 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.147296+0000", 2023-09-30T17:04:21.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0699999999999998e-07 2023-09-30T17:04:21.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.233 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.233 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.233 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.147309+0000", 2023-09-30T17:04:21.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2984e-05 2023-09-30T17:04:21.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.233 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.233 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.233 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.147315+0000", 2023-09-30T17:04:21.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1500000000000004e-06 2023-09-30T17:04:21.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.234 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.234 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.234 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.147319+0000", 2023-09-30T17:04:21.234 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5469999999999998e-06 2023-09-30T17:04:21.234 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.234 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.234 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.234 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.234 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.234 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137852 4.2d 4.ac5990ed (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.234 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.174270+0000", 2023-09-30T17:04:21.235 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9958334, 2023-09-30T17:04:21.235 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0052516289999999998, 2023-09-30T17:04:21.235 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.235 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.235 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.235 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.235 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.235 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137852 2023-09-30T17:04:21.235 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.235 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.235 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.235 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.236 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.174270+0000", 2023-09-30T17:04:21.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.236 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.236 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.236 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.236 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.174270+0000", 2023-09-30T17:04:21.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.236 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.236 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.236 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.236 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.174271+0000", 2023-09-30T17:04:21.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3799999999999998e-07 2023-09-30T17:04:21.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.174285+0000", 2023-09-30T17:04:21.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4311000000000001e-05 2023-09-30T17:04:21.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.174299+0000", 2023-09-30T17:04:21.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4166e-05 2023-09-30T17:04:21.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.174310+0000", 2023-09-30T17:04:21.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0651e-05 2023-09-30T17:04:21.260 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.260 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.261 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.261 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136425 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.261 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.603661+0000", 2023-09-30T17:04:21.261 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.56644237099999994, 2023-09-30T17:04:21.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.57590171899999998, 2023-09-30T17:04:21.261 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.261 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.261 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.261 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.262 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.262 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136425 2023-09-30T17:04:21.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.262 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.262 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.262 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.603661+0000", 2023-09-30T17:04:21.262 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.262 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.603661+0000", 2023-09-30T17:04:21.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.603662+0000", 2023-09-30T17:04:21.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0200000000000003e-07 2023-09-30T17:04:21.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.603674+0000", 2023-09-30T17:04:21.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1868000000000001e-05 2023-09-30T17:04:21.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.603681+0000", 2023-09-30T17:04:21.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5170000000000002e-06 2023-09-30T17:04:21.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.603686+0000", 2023-09-30T17:04:21.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7010000000000004e-06 2023-09-30T17:04:21.264 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.264 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.265 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.265 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136744 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.265 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.737370+0000", 2023-09-30T17:04:21.265 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.43273356800000001, 2023-09-30T17:04:21.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.44222905099999998, 2023-09-30T17:04:21.265 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.265 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.265 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.265 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.265 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.266 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136744 2023-09-30T17:04:21.266 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.266 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.266 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.266 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.266 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.737370+0000", 2023-09-30T17:04:21.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.266 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.266 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.266 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.266 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.737370+0000", 2023-09-30T17:04:21.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.267 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.267 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.267 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.737371+0000", 2023-09-30T17:04:21.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3099999999999998e-07 2023-09-30T17:04:21.267 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.267 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.267 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.737384+0000", 2023-09-30T17:04:21.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3104e-05 2023-09-30T17:04:21.268 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.268 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.268 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.737390+0000", 2023-09-30T17:04:21.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3049999999999998e-06 2023-09-30T17:04:21.268 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.268 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.268 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.737395+0000", 2023-09-30T17:04:21.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4210000000000003e-06 2023-09-30T17:04:21.268 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.268 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.269 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.269 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.269 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:135638 4.36 e54/17 4:6da220e6:::100000001f8.0000003f:head v 54'6426, mlcod=54'6381)", 2023-09-30T17:04:21.269 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.829972+0000", 2023-09-30T17:04:21.269 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.34013193899999999, 2023-09-30T17:04:21.269 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.34966236000000001, 2023-09-30T17:04:21.269 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.269 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:21.269 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.269 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.829972+0000", 2023-09-30T17:04:21.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.270 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.829972+0000", 2023-09-30T17:04:21.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.270 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.829972+0000", 2023-09-30T17:04:21.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.41e-07 2023-09-30T17:04:21.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.829982+0000", 2023-09-30T17:04:21.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0152e-05 2023-09-30T17:04:21.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.829988+0000", 2023-09-30T17:04:21.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7169999999999996e-06 2023-09-30T17:04:21.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.272 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.829992+0000", 2023-09-30T17:04:21.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2729999999999996e-06 2023-09-30T17:04:21.272 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.272 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:21.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.122095+0000", 2023-09-30T17:04:21.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.29210321099999997 2023-09-30T17:04:21.272 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.272 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:21.273 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.122112+0000", 2023-09-30T17:04:21.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6419e-05 2023-09-30T17:04:21.314 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.314 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.314 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.315 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137248 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.315 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.910842+0000", 2023-09-30T17:04:21.315 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.25926143899999998, 2023-09-30T17:04:21.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.268825596, 2023-09-30T17:04:21.315 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.315 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.315 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.315 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.315 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.315 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137248 2023-09-30T17:04:21.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.316 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.910842+0000", 2023-09-30T17:04:21.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.910842+0000", 2023-09-30T17:04:21.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.317 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.317 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.910843+0000", 2023-09-30T17:04:21.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7899999999999998e-07 2023-09-30T17:04:21.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.317 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.317 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.910872+0000", 2023-09-30T17:04:21.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9130000000000001e-05 2023-09-30T17:04:21.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.317 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.910894+0000", 2023-09-30T17:04:21.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2272e-05 2023-09-30T17:04:21.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.910909+0000", 2023-09-30T17:04:21.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4513e-05 2023-09-30T17:04:21.318 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.318 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.318 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.319 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136197 4.36 e54/17)", 2023-09-30T17:04:21.319 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.024797+0000", 2023-09-30T17:04:21.319 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.14530707600000001, 2023-09-30T17:04:21.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.154903915, 2023-09-30T17:04:21.319 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.319 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.319 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.024797+0000", 2023-09-30T17:04:21.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.024797+0000", 2023-09-30T17:04:21.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.024797+0000", 2023-09-30T17:04:21.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1399999999999997e-07 2023-09-30T17:04:21.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.321 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.321 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.024811+0000", 2023-09-30T17:04:21.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.346e-05 2023-09-30T17:04:21.321 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.321 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.321 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.024820+0000", 2023-09-30T17:04:21.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9630000000000004e-06 2023-09-30T17:04:21.321 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.321 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.024826+0000", 2023-09-30T17:04:21.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6359999999999997e-06 2023-09-30T17:04:21.322 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.322 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.322 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.322 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136246 4.36 e54/17)", 2023-09-30T17:04:21.322 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.037275+0000", 2023-09-30T17:04:21.322 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.13282849599999999, 2023-09-30T17:04:21.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.142453512, 2023-09-30T17:04:21.323 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.323 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.323 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.037275+0000", 2023-09-30T17:04:21.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.037275+0000", 2023-09-30T17:04:21.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.037276+0000", 2023-09-30T17:04:21.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4000000000000001e-07 2023-09-30T17:04:21.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.037292+0000", 2023-09-30T17:04:21.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5522000000000001e-05 2023-09-30T17:04:21.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.037301+0000", 2023-09-30T17:04:21.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2459999999999992e-06 2023-09-30T17:04:21.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.037308+0000", 2023-09-30T17:04:21.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4510000000000003e-06 2023-09-30T17:04:21.325 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.326 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.326 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.326 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.326 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137638 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.326 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.082833+0000", 2023-09-30T17:04:21.326 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.087270974000000001, 2023-09-30T17:04:21.326 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.096926151000000002, 2023-09-30T17:04:21.326 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.326 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.326 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.327 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.327 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.327 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137638 2023-09-30T17:04:21.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.327 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.327 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.327 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.082833+0000", 2023-09-30T17:04:21.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.327 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.082833+0000", 2023-09-30T17:04:21.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.082833+0000", 2023-09-30T17:04:21.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4199999999999996e-07 2023-09-30T17:04:21.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.082869+0000", 2023-09-30T17:04:21.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5923999999999997e-05 2023-09-30T17:04:21.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.329 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.082877+0000", 2023-09-30T17:04:21.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3139999999999998e-06 2023-09-30T17:04:21.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.330 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.330 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.082882+0000", 2023-09-30T17:04:21.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8560000000000003e-06 2023-09-30T17:04:21.330 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.330 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.330 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.331 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137753 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 1003520~4096 in=4096b,write 1105920~4096 in=4096b,write 1302528~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.331 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.134641+0000", 2023-09-30T17:04:21.331 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.035462861999999998, 2023-09-30T17:04:21.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045154119999999999, 2023-09-30T17:04:21.331 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.331 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:21.331 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.331 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.331 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.331 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137753 2023-09-30T17:04:21.331 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.332 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.134641+0000", 2023-09-30T17:04:21.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.134641+0000", 2023-09-30T17:04:21.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.134641+0000", 2023-09-30T17:04:21.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8700000000000001e-07 2023-09-30T17:04:21.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.134653+0000", 2023-09-30T17:04:21.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1664999999999999e-05 2023-09-30T17:04:21.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.134660+0000", 2023-09-30T17:04:21.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.34e-06 2023-09-30T17:04:21.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.134666+0000", 2023-09-30T17:04:21.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0970000000000002e-06 2023-09-30T17:04:21.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:21.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.173823+0000", 2023-09-30T17:04:21.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.039156752000000003 2023-09-30T17:04:21.335 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.335 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.335 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:21.335 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.173909+0000", 2023-09-30T17:04:21.335 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5412000000000001e-05 2023-09-30T17:04:21.335 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.335 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.335 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.335 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.335 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.335 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137779 4.12 4:4be51a30:::100000001f8.0000000b:head [write 1441792~4096 in=4096b,write 1519616~4096 in=4096b,write 1581056~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.335 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.146810+0000", 2023-09-30T17:04:21.336 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.023293705000000001, 2023-09-30T17:04:21.336 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033028439, 2023-09-30T17:04:21.336 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.336 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:21.336 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.336 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.336 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.336 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137779 2023-09-30T17:04:21.336 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.336 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.336 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.336 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.337 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.146810+0000", 2023-09-30T17:04:21.337 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.337 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.337 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.337 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.337 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.146810+0000", 2023-09-30T17:04:21.337 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.337 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.337 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.337 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.338 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.148518+0000", 2023-09-30T17:04:21.338 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001707826 2023-09-30T17:04:21.338 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.338 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.338 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.338 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.148535+0000", 2023-09-30T17:04:21.338 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7258999999999999e-05 2023-09-30T17:04:21.338 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.338 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.338 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.339 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.148546+0000", 2023-09-30T17:04:21.339 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0906e-05 2023-09-30T17:04:21.339 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.339 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.339 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.339 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.148554+0000", 2023-09-30T17:04:21.339 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.746e-06 2023-09-30T17:04:21.339 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.339 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.339 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:21.339 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.162994+0000", 2023-09-30T17:04:21.340 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014440473000000001 2023-09-30T17:04:21.340 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.340 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.340 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:21.340 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.163072+0000", 2023-09-30T17:04:21.340 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8219000000000004e-05 2023-09-30T17:04:21.340 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.340 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.340 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:21.340 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.163236+0000", 2023-09-30T17:04:21.340 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000163859 2023-09-30T17:04:21.340 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.341 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.341 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.341 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.341 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136426 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.341 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.603692+0000", 2023-09-30T17:04:21.341 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.56641210600000003, 2023-09-30T17:04:21.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.57619058899999998, 2023-09-30T17:04:21.341 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.341 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.341 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.342 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.342 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.342 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136426 2023-09-30T17:04:21.342 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.342 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.342 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.342 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.342 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.603692+0000", 2023-09-30T17:04:21.342 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.342 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.342 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.343 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.343 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.603692+0000", 2023-09-30T17:04:21.343 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.343 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.343 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.343 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.343 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.603692+0000", 2023-09-30T17:04:21.343 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5699999999999998e-07 2023-09-30T17:04:21.343 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.343 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.343 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.343 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.603703+0000", 2023-09-30T17:04:21.344 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0550000000000001e-05 2023-09-30T17:04:21.344 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.344 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.344 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.344 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.603708+0000", 2023-09-30T17:04:21.344 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5799999999999999e-06 2023-09-30T17:04:21.344 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.344 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.344 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.344 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.603713+0000", 2023-09-30T17:04:21.344 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5050000000000001e-06 2023-09-30T17:04:21.345 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.345 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.345 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.345 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.345 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.345 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136449 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.345 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.616544+0000", 2023-09-30T17:04:21.345 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.55355979799999999, 2023-09-30T17:04:21.345 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.56337137599999998, 2023-09-30T17:04:21.345 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.345 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.345 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.346 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.346 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.346 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136449 2023-09-30T17:04:21.346 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.346 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.346 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.346 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.346 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.616544+0000", 2023-09-30T17:04:21.346 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.346 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.346 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.347 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.347 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.616544+0000", 2023-09-30T17:04:21.347 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.347 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.347 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.347 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.347 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.618589+0000", 2023-09-30T17:04:21.347 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0020450429999999999 2023-09-30T17:04:21.347 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.347 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.347 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.347 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.618605+0000", 2023-09-30T17:04:21.348 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5942000000000001e-05 2023-09-30T17:04:21.348 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.348 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.348 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.348 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.618614+0000", 2023-09-30T17:04:21.348 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1970000000000002e-06 2023-09-30T17:04:21.348 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.348 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.348 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.348 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.618620+0000", 2023-09-30T17:04:21.348 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.117e-06 2023-09-30T17:04:21.348 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.349 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.349 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.349 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.349 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.349 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136493 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.349 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.631791+0000", 2023-09-30T17:04:21.349 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.53831295000000001, 2023-09-30T17:04:21.349 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.54815558499999995, 2023-09-30T17:04:21.349 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.349 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.349 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.350 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.350 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.350 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136493 2023-09-30T17:04:21.350 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.350 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.350 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.350 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.350 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.631791+0000", 2023-09-30T17:04:21.350 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.350 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.350 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.350 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.351 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.631791+0000", 2023-09-30T17:04:21.351 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.351 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.351 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.351 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.351 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.631791+0000", 2023-09-30T17:04:21.351 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8799999999999998e-07 2023-09-30T17:04:21.351 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.351 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.351 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.351 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.631808+0000", 2023-09-30T17:04:21.352 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6980999999999999e-05 2023-09-30T17:04:21.352 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.352 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.352 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.352 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.631815+0000", 2023-09-30T17:04:21.352 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7229999999999998e-06 2023-09-30T17:04:21.352 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.352 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.352 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.352 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.631820+0000", 2023-09-30T17:04:21.352 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.31e-06 2023-09-30T17:04:21.352 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.353 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.353 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.353 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.353 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.353 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136634 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.353 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.689557+0000", 2023-09-30T17:04:21.353 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.480546686, 2023-09-30T17:04:21.353 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.49042105200000002, 2023-09-30T17:04:21.353 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.353 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.353 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.353 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.354 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.354 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136634 2023-09-30T17:04:21.354 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.354 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.354 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.354 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.354 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.689557+0000", 2023-09-30T17:04:21.354 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.354 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.354 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.354 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.355 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.689557+0000", 2023-09-30T17:04:21.355 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.355 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.355 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.355 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.355 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.689557+0000", 2023-09-30T17:04:21.355 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1399999999999997e-07 2023-09-30T17:04:21.355 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.355 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.355 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.355 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.689567+0000", 2023-09-30T17:04:21.355 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6860000000000001e-06 2023-09-30T17:04:21.356 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.356 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.356 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.356 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.689573+0000", 2023-09-30T17:04:21.356 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6559999999999997e-06 2023-09-30T17:04:21.356 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.356 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.356 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.356 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.689576+0000", 2023-09-30T17:04:21.356 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4089999999999999e-06 2023-09-30T17:04:21.356 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.357 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.357 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.357 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.357 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.357 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136653 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.357 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.699595+0000", 2023-09-30T17:04:21.357 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.47050906100000001, 2023-09-30T17:04:21.357 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.48041420200000001, 2023-09-30T17:04:21.357 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.357 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.357 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.357 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.358 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.358 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136653 2023-09-30T17:04:21.358 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.358 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.358 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.358 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.358 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.699595+0000", 2023-09-30T17:04:21.358 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.358 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.358 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.358 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.359 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.699595+0000", 2023-09-30T17:04:21.359 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.359 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.359 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.359 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.699595+0000", 2023-09-30T17:04:21.359 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.23e-07 2023-09-30T17:04:21.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.359 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.359 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.359 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.699603+0000", 2023-09-30T17:04:21.359 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6869999999999994e-06 2023-09-30T17:04:21.360 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.360 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.360 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.360 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.699606+0000", 2023-09-30T17:04:21.360 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.473e-06 2023-09-30T17:04:21.360 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.360 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.360 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.360 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.699609+0000", 2023-09-30T17:04:21.360 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9239999999999999e-06 2023-09-30T17:04:21.360 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.361 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.361 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.361 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.361 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.361 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:135614 4.6 e54/17 4:635f8cb4:::100000001f8.0000003c:head v 54'8352, mlcod=54'8292)", 2023-09-30T17:04:21.361 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.819333+0000", 2023-09-30T17:04:21.361 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.35077055200000001, 2023-09-30T17:04:21.361 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.360709063, 2023-09-30T17:04:21.361 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.361 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:21.361 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.361 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.362 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.362 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.819333+0000", 2023-09-30T17:04:21.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.362 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.362 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.362 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.362 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.819333+0000", 2023-09-30T17:04:21.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.362 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.362 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.362 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.363 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.819333+0000", 2023-09-30T17:04:21.363 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9700000000000003e-07 2023-09-30T17:04:21.363 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.363 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.363 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.363 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.819345+0000", 2023-09-30T17:04:21.363 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1224e-05 2023-09-30T17:04:21.363 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.363 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.363 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.363 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.819352+0000", 2023-09-30T17:04:21.363 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2139999999999999e-06 2023-09-30T17:04:21.364 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.364 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.364 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.364 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.819357+0000", 2023-09-30T17:04:21.364 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8960000000000002e-06 2023-09-30T17:04:21.364 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.364 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.364 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:21.364 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.111350+0000", 2023-09-30T17:04:21.364 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.29199324999999998 2023-09-30T17:04:21.364 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.364 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.365 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:21.365 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.111367+0000", 2023-09-30T17:04:21.365 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6850999999999998e-05 2023-09-30T17:04:21.365 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.365 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.365 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.365 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.365 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.365 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:135812 4.6 e54/17)", 2023-09-30T17:04:21.365 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.866048+0000", 2023-09-30T17:04:21.365 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.304056206, 2023-09-30T17:04:21.365 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.31403023499999999, 2023-09-30T17:04:21.366 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.366 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.366 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.366 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.366 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.366 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.866048+0000", 2023-09-30T17:04:21.366 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.366 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.366 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.366 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.366 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.866048+0000", 2023-09-30T17:04:21.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.367 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.367 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.367 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.866048+0000", 2023-09-30T17:04:21.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4999999999999999e-07 2023-09-30T17:04:21.367 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.367 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.367 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.866058+0000", 2023-09-30T17:04:21.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0183999999999999e-05 2023-09-30T17:04:21.367 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.866063+0000", 2023-09-30T17:04:21.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4809999999999997e-06 2023-09-30T17:04:21.368 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.866068+0000", 2023-09-30T17:04:21.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0679999999999998e-06 2023-09-30T17:04:21.368 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.368 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.368 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.369 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.369 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.369 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137202 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.369 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.893653+0000", 2023-09-30T17:04:21.369 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.27645073199999998, 2023-09-30T17:04:21.369 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.28645219199999999, 2023-09-30T17:04:21.369 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.369 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.369 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.369 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.369 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.369 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137202 2023-09-30T17:04:21.370 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.370 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.370 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.370 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.370 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.893653+0000", 2023-09-30T17:04:21.370 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.370 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.370 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.370 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.370 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.893653+0000", 2023-09-30T17:04:21.370 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.370 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.371 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.371 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.893654+0000", 2023-09-30T17:04:21.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4499999999999997e-07 2023-09-30T17:04:21.371 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.371 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.371 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.893667+0000", 2023-09-30T17:04:21.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2989e-05 2023-09-30T17:04:21.371 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.371 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.372 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.893674+0000", 2023-09-30T17:04:21.372 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9460000000000001e-06 2023-09-30T17:04:21.372 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.372 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.372 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.372 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.893679+0000", 2023-09-30T17:04:21.372 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5559999999999998e-06 2023-09-30T17:04:21.372 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.372 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.372 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.372 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.372 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.373 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137320 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.373 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.934597+0000", 2023-09-30T17:04:21.373 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.23550648900000001, 2023-09-30T17:04:21.373 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.24554000200000001, 2023-09-30T17:04:21.373 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.373 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.373 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.373 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.373 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.373 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137320 2023-09-30T17:04:21.373 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.373 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.374 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.374 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.374 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.934597+0000", 2023-09-30T17:04:21.374 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.374 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.374 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.374 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.374 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.934597+0000", 2023-09-30T17:04:21.374 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.374 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.374 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.374 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.375 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.934598+0000", 2023-09-30T17:04:21.375 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2100000000000002e-07 2023-09-30T17:04:21.375 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.375 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.375 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.375 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.934616+0000", 2023-09-30T17:04:21.375 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8457e-05 2023-09-30T17:04:21.375 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.375 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.375 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.375 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.934623+0000", 2023-09-30T17:04:21.375 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8539999999999999e-06 2023-09-30T17:04:21.376 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.376 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.376 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.376 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.934629+0000", 2023-09-30T17:04:21.376 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9050000000000002e-06 2023-09-30T17:04:21.376 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.376 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.376 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.376 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.376 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.376 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136188 4.6 e54/17)", 2023-09-30T17:04:21.376 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.024841+0000", 2023-09-30T17:04:21.377 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.14526277200000001, 2023-09-30T17:04:21.377 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.155325714, 2023-09-30T17:04:21.377 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.377 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.377 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.377 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.377 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.377 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.024841+0000", 2023-09-30T17:04:21.377 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.377 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.377 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.377 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.378 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.024841+0000", 2023-09-30T17:04:21.378 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.378 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.378 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.378 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.378 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.024841+0000", 2023-09-30T17:04:21.378 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7399999999999999e-07 2023-09-30T17:04:21.378 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.378 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.378 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.378 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.024856+0000", 2023-09-30T17:04:21.379 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4721e-05 2023-09-30T17:04:21.388 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.388 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.388 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.388 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.024863+0000", 2023-09-30T17:04:21.388 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9480000000000002e-06 2023-09-30T17:04:21.389 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.389 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.389 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.389 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.024868+0000", 2023-09-30T17:04:21.389 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3070000000000002e-06 2023-09-30T17:04:21.389 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.389 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.389 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.389 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.389 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.389 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136255 4.6 e54/17)", 2023-09-30T17:04:21.390 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.037320+0000", 2023-09-30T17:04:21.390 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.13278336600000001, 2023-09-30T17:04:21.390 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.14287361200000001, 2023-09-30T17:04:21.390 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.390 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.390 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.390 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.390 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.390 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.037320+0000", 2023-09-30T17:04:21.390 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.390 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.390 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.391 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.391 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.037320+0000", 2023-09-30T17:04:21.391 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.391 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.391 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.391 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.391 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.037321+0000", 2023-09-30T17:04:21.391 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0100000000000001e-07 2023-09-30T17:04:21.391 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.391 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.391 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.392 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.037331+0000", 2023-09-30T17:04:21.392 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0691e-05 2023-09-30T17:04:21.392 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.392 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.392 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.392 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.037351+0000", 2023-09-30T17:04:21.392 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0086999999999999e-05 2023-09-30T17:04:21.392 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.392 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.392 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.392 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.037357+0000", 2023-09-30T17:04:21.392 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0390000000000004e-06 2023-09-30T17:04:21.393 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.393 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.393 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.393 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.393 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.393 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136300 4.6 e54/17)", 2023-09-30T17:04:21.393 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.047903+0000", 2023-09-30T17:04:21.393 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.122200553, 2023-09-30T17:04:21.393 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.13231652799999999, 2023-09-30T17:04:21.393 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.393 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.393 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.394 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.394 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.394 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.047903+0000", 2023-09-30T17:04:21.394 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.394 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.394 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.394 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.394 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.047903+0000", 2023-09-30T17:04:21.394 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.394 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.394 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.395 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.395 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.047904+0000", 2023-09-30T17:04:21.395 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.82e-07 2023-09-30T17:04:21.395 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.395 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.395 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.395 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.047920+0000", 2023-09-30T17:04:21.395 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6714999999999998e-05 2023-09-30T17:04:21.395 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.395 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.395 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.395 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.047931+0000", 2023-09-30T17:04:21.396 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0108999999999999e-05 2023-09-30T17:04:21.396 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.396 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.396 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.396 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.047937+0000", 2023-09-30T17:04:21.396 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2040000000000002e-06 2023-09-30T17:04:21.396 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.396 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.396 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.396 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.396 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.396 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136349 4.6 e54/17)", 2023-09-30T17:04:21.397 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.066610+0000", 2023-09-30T17:04:21.397 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.10349412199999999, 2023-09-30T17:04:21.397 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.113636468, 2023-09-30T17:04:21.397 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.397 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.397 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.397 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.397 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.397 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.066610+0000", 2023-09-30T17:04:21.397 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.397 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.397 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.398 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.398 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.066610+0000", 2023-09-30T17:04:21.398 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.398 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.398 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.398 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.398 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.066610+0000", 2023-09-30T17:04:21.398 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9400000000000001e-07 2023-09-30T17:04:21.398 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.398 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.398 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.398 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.066623+0000", 2023-09-30T17:04:21.399 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2724e-05 2023-09-30T17:04:21.399 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.399 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.399 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.399 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.066630+0000", 2023-09-30T17:04:21.399 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9410000000000001e-06 2023-09-30T17:04:21.399 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.399 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.399 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.399 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.066635+0000", 2023-09-30T17:04:21.399 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9269999999999996e-06 2023-09-30T17:04:21.399 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.400 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.400 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.400 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.400 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.400 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137667 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.400 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.097652+0000", 2023-09-30T17:04:21.400 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.072451997000000004, 2023-09-30T17:04:21.400 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.082620751000000006, 2023-09-30T17:04:21.400 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.400 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.400 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.400 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.401 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.401 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137667 2023-09-30T17:04:21.401 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.401 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.401 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.401 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.401 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.097652+0000", 2023-09-30T17:04:21.401 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.401 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.401 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.401 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.401 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.097652+0000", 2023-09-30T17:04:21.402 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.402 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.402 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.402 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.402 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.097652+0000", 2023-09-30T17:04:21.402 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2300000000000002e-07 2023-09-30T17:04:21.402 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.402 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.402 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.402 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.097668+0000", 2023-09-30T17:04:21.402 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5879000000000002e-05 2023-09-30T17:04:21.402 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.402 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.403 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.403 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.097675+0000", 2023-09-30T17:04:21.403 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5390000000000004e-06 2023-09-30T17:04:21.403 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.403 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.403 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.403 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.097680+0000", 2023-09-30T17:04:21.403 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0300000000000001e-06 2023-09-30T17:04:21.403 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.403 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.403 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.403 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.403 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.404 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137754 4.38 4:1d13bf87:::100000001f8.00000030:head [write 663552~4096 in=4096b,write 684032~4096 in=4096b,write 716800~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.404 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.134673+0000", 2023-09-30T17:04:21.404 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.035430332000000002, 2023-09-30T17:04:21.404 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045632487999999999, 2023-09-30T17:04:21.404 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.404 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:21.404 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.404 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.404 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.404 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137754 2023-09-30T17:04:21.404 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.405 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.405 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.405 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.405 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.134673+0000", 2023-09-30T17:04:21.405 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.405 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.405 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.405 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.405 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.134673+0000", 2023-09-30T17:04:21.405 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.405 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.405 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.406 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.406 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.134674+0000", 2023-09-30T17:04:21.406 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.08e-07 2023-09-30T17:04:21.406 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.406 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.406 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.406 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.134686+0000", 2023-09-30T17:04:21.406 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2479e-05 2023-09-30T17:04:21.406 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.406 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.406 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.406 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.134693+0000", 2023-09-30T17:04:21.407 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3319999999999997e-06 2023-09-30T17:04:21.407 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.407 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.407 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.407 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.134698+0000", 2023-09-30T17:04:21.407 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1080000000000001e-06 2023-09-30T17:04:21.407 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.407 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.407 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:21.407 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.175869+0000", 2023-09-30T17:04:21.407 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.041171256000000003 2023-09-30T17:04:21.407 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.407 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.407 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:21.408 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.175926+0000", 2023-09-30T17:04:21.408 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6691000000000003e-05 2023-09-30T17:04:21.408 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.408 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.408 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.408 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.408 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.408 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137782 4.38 4.9b7e3478 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.460 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.148567+0000", 2023-09-30T17:04:21.460 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.021537242000000002, 2023-09-30T17:04:21.461 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.031776816999999999, 2023-09-30T17:04:21.461 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.461 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.461 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.461 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.461 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.461 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137782 2023-09-30T17:04:21.461 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.461 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.461 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.461 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.462 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.148567+0000", 2023-09-30T17:04:21.462 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.462 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.462 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.462 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.462 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.148567+0000", 2023-09-30T17:04:21.462 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.462 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.462 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.462 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.462 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.148567+0000", 2023-09-30T17:04:21.463 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7999999999999996e-07 2023-09-30T17:04:21.463 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.463 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.463 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.148577+0000", 2023-09-30T17:04:21.463 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0383999999999999e-05 2023-09-30T17:04:21.463 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.463 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.463 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.148584+0000", 2023-09-30T17:04:21.463 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5130000000000002e-06 2023-09-30T17:04:21.463 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.464 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.464 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.464 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.148589+0000", 2023-09-30T17:04:21.464 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2429999999999996e-06 2023-09-30T17:04:21.464 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.464 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.464 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.464 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.464 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.464 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136633 4.6 e54/17)", 2023-09-30T17:04:21.464 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.174494+0000", 2023-09-30T17:04:21.464 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9956098, 2023-09-30T17:04:21.465 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005879446, 2023-09-30T17:04:21.465 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.465 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.465 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.465 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.465 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.465 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.174494+0000", 2023-09-30T17:04:21.465 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.465 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.465 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.465 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.465 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.174494+0000", 2023-09-30T17:04:21.466 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.466 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.466 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.466 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.466 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.174494+0000", 2023-09-30T17:04:21.466 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4200000000000002e-07 2023-09-30T17:04:21.466 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.466 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.466 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.466 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.174507+0000", 2023-09-30T17:04:21.466 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2765999999999999e-05 2023-09-30T17:04:21.467 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.467 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.467 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.467 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.174520+0000", 2023-09-30T17:04:21.467 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2873e-05 2023-09-30T17:04:21.467 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.467 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.468 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.468 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.174526+0000", 2023-09-30T17:04:21.468 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5589999999999996e-06 2023-09-30T17:04:21.468 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.468 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.468 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.468 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.468 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.468 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136881 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.468 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.790686+0000", 2023-09-30T17:04:21.468 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.37941731299999998, 2023-09-30T17:04:21.468 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.38971588499999998, 2023-09-30T17:04:21.468 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.469 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.469 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.469 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.469 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.469 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136881 2023-09-30T17:04:21.469 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.469 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.469 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.469 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.469 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.790686+0000", 2023-09-30T17:04:21.469 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.470 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.470 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.470 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.470 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.790686+0000", 2023-09-30T17:04:21.470 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.470 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.470 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.470 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.470 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.792612+0000", 2023-09-30T17:04:21.470 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001925363 2023-09-30T17:04:21.471 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.471 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.471 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.471 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.792624+0000", 2023-09-30T17:04:21.471 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2445e-05 2023-09-30T17:04:21.471 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.471 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.471 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.471 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.792631+0000", 2023-09-30T17:04:21.471 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2089999999999999e-06 2023-09-30T17:04:21.471 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.472 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.472 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.472 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.792638+0000", 2023-09-30T17:04:21.472 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8000000000000001e-06 2023-09-30T17:04:21.472 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.472 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.472 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.472 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.472 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.472 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137126 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.472 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.863486+0000", 2023-09-30T17:04:21.472 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.30661817299999999, 2023-09-30T17:04:21.473 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.31694944899999999, 2023-09-30T17:04:21.473 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.473 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.473 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.473 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.473 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.473 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137126 2023-09-30T17:04:21.473 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.473 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.473 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.473 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.473 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.863486+0000", 2023-09-30T17:04:21.474 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.474 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.474 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.474 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.474 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.863486+0000", 2023-09-30T17:04:21.474 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.474 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.474 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.474 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.474 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.869323+0000", 2023-09-30T17:04:21.475 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0058371660000000004 2023-09-30T17:04:21.475 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.475 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.475 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.475 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.869346+0000", 2023-09-30T17:04:21.475 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3108e-05 2023-09-30T17:04:21.475 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.475 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.475 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.475 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.870044+0000", 2023-09-30T17:04:21.475 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00069830000000000001 2023-09-30T17:04:21.475 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.476 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.476 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.476 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.870056+0000", 2023-09-30T17:04:21.476 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1749000000000001e-05 2023-09-30T17:04:21.476 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.476 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.476 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.476 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.476 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.476 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136288 4.36 e54/17)", 2023-09-30T17:04:21.476 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.047951+0000", 2023-09-30T17:04:21.476 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.122152474, 2023-09-30T17:04:21.477 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.13251700799999999, 2023-09-30T17:04:21.477 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.477 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.477 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.477 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.477 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.477 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.047951+0000", 2023-09-30T17:04:21.477 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.477 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.477 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.477 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.478 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.047951+0000", 2023-09-30T17:04:21.478 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.478 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.478 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.478 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.478 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.047952+0000", 2023-09-30T17:04:21.478 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8200000000000001e-07 2023-09-30T17:04:21.478 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.478 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.478 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.478 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.047969+0000", 2023-09-30T17:04:21.478 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7178999999999999e-05 2023-09-30T17:04:21.479 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.479 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.479 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.479 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.047975+0000", 2023-09-30T17:04:21.479 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5590000000000002e-06 2023-09-30T17:04:21.479 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.479 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.479 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.479 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.047980+0000", 2023-09-30T17:04:21.479 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4819999999999996e-06 2023-09-30T17:04:21.479 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.480 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.480 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.480 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136385 4.6 e54/17)", 2023-09-30T17:04:21.480 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.086166+0000", 2023-09-30T17:04:21.480 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.083937838000000001, 2023-09-30T17:04:21.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.094330208999999998, 2023-09-30T17:04:21.480 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.480 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.480 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.481 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.481 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.086166+0000", 2023-09-30T17:04:21.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.481 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.481 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.481 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.481 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.086166+0000", 2023-09-30T17:04:21.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.481 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.481 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.481 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.482 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.086167+0000", 2023-09-30T17:04:21.482 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6599999999999996e-07 2023-09-30T17:04:21.482 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.482 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.482 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.482 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.086178+0000", 2023-09-30T17:04:21.482 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1895999999999999e-05 2023-09-30T17:04:21.482 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.482 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.482 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.482 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.086188+0000", 2023-09-30T17:04:21.483 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4229999999999994e-06 2023-09-30T17:04:21.483 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.483 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.483 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.483 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.086195+0000", 2023-09-30T17:04:21.483 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8349999999999998e-06 2023-09-30T17:04:21.483 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.483 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.483 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.483 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.483 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.483 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137784 4.12 4:4be51a30:::100000001f8.0000000b:head [write 614400~4096 in=4096b,write 696320~4096 in=4096b,write 819200~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.484 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.148596+0000", 2023-09-30T17:04:21.484 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.021507430000000001, 2023-09-30T17:04:21.484 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.03193754, 2023-09-30T17:04:21.484 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.484 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:21.484 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.484 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.484 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.484 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137784 2023-09-30T17:04:21.484 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.484 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.485 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.485 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.485 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.148596+0000", 2023-09-30T17:04:21.485 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.485 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.485 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.485 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.485 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.148596+0000", 2023-09-30T17:04:21.485 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.485 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.485 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.485 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.486 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.148597+0000", 2023-09-30T17:04:21.486 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5999999999999999e-07 2023-09-30T17:04:21.486 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.486 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.486 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.486 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.148611+0000", 2023-09-30T17:04:21.486 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4618e-05 2023-09-30T17:04:21.486 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.486 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.486 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.486 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.148617+0000", 2023-09-30T17:04:21.486 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1709999999999999e-06 2023-09-30T17:04:21.487 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.487 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.487 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.487 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.148623+0000", 2023-09-30T17:04:21.487 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3029999999999999e-06 2023-09-30T17:04:21.487 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.487 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.487 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:21.487 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.172176+0000", 2023-09-30T17:04:21.487 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.023552743000000001 2023-09-30T17:04:21.487 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.487 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.488 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:21.488 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.172264+0000", 2023-09-30T17:04:21.488 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8002000000000002e-05 2023-09-30T17:04:21.488 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.488 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.488 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:21.488 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.172438+0000", 2023-09-30T17:04:21.488 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000174272 2023-09-30T17:04:21.488 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.488 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.488 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.488 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.489 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:137480 4.33 e54/17 4:cf6d7a6c:::100000001f8.0000000a:head v 54'2153, mlcod=54'2151)", 2023-09-30T17:04:21.489 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.177664+0000", 2023-09-30T17:04:21.489 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9924393, 2023-09-30T17:04:21.489 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0029171169999999999, 2023-09-30T17:04:21.489 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.489 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:21.489 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.489 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.489 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.177664+0000", 2023-09-30T17:04:21.490 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.490 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.490 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.490 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.490 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.177664+0000", 2023-09-30T17:04:21.490 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.490 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.490 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.490 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.490 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.177665+0000", 2023-09-30T17:04:21.490 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3300000000000001e-07 2023-09-30T17:04:21.490 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.491 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.491 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.491 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.177681+0000", 2023-09-30T17:04:21.491 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5739e-05 2023-09-30T17:04:21.491 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.491 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.491 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.491 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.177691+0000", 2023-09-30T17:04:21.491 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0248000000000001e-05 2023-09-30T17:04:21.491 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.491 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.492 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.492 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.177700+0000", 2023-09-30T17:04:21.492 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5820000000000002e-06 2023-09-30T17:04:21.492 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.492 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.492 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:21.492 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.177755+0000", 2023-09-30T17:04:21.492 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5365999999999998e-05 2023-09-30T17:04:21.492 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.492 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.492 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:21.492 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.177779+0000", 2023-09-30T17:04:21.493 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4043e-05 2023-09-30T17:04:21.493 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.493 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.493 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.493 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.493 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.493 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136454 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.493 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.620572+0000", 2023-09-30T17:04:21.493 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.54953170399999995, 2023-09-30T17:04:21.493 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.56006164700000005, 2023-09-30T17:04:21.493 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.494 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.494 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.494 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.494 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.494 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136454 2023-09-30T17:04:21.494 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.494 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.494 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.494 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.494 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.620572+0000", 2023-09-30T17:04:21.494 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.494 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.495 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.495 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.495 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.620572+0000", 2023-09-30T17:04:21.495 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.495 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.495 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.495 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.495 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.620573+0000", 2023-09-30T17:04:21.495 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8999999999999996e-07 2023-09-30T17:04:21.495 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.495 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.496 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.496 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.620592+0000", 2023-09-30T17:04:21.496 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9111999999999999e-05 2023-09-30T17:04:21.496 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.496 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.496 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.496 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.620599+0000", 2023-09-30T17:04:21.496 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7160000000000003e-06 2023-09-30T17:04:21.496 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.496 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.496 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.496 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.620606+0000", 2023-09-30T17:04:21.496 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8340000000000001e-06 2023-09-30T17:04:21.497 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.497 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.497 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.497 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.497 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.497 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136563 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.497 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.656229+0000", 2023-09-30T17:04:21.497 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.51387503599999995, 2023-09-30T17:04:21.497 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.524466349, 2023-09-30T17:04:21.497 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.497 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.498 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.498 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.498 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.498 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136563 2023-09-30T17:04:21.498 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.498 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.498 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.498 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.498 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.656229+0000", 2023-09-30T17:04:21.498 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.498 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.498 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.499 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.499 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.656229+0000", 2023-09-30T17:04:21.499 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.499 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.499 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.499 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.499 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.660517+0000", 2023-09-30T17:04:21.499 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0042882889999999998 2023-09-30T17:04:21.499 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.499 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.499 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.500 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.660533+0000", 2023-09-30T17:04:21.500 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6138999999999999e-05 2023-09-30T17:04:21.500 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.500 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.500 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.500 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.660543+0000", 2023-09-30T17:04:21.500 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.55e-06 2023-09-30T17:04:21.500 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.500 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.500 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.500 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.660551+0000", 2023-09-30T17:04:21.500 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2290000000000003e-06 2023-09-30T17:04:21.501 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.501 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.501 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.501 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.501 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.501 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136595 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.501 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.673670+0000", 2023-09-30T17:04:21.501 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.49643379399999998, 2023-09-30T17:04:21.501 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.50708723300000003, 2023-09-30T17:04:21.501 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.501 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.501 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.502 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.502 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.502 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136595 2023-09-30T17:04:21.502 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.502 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.502 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.502 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.502 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.673670+0000", 2023-09-30T17:04:21.502 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.502 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.503 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.503 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.503 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.673670+0000", 2023-09-30T17:04:21.503 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.503 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.503 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.503 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.503 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.673670+0000", 2023-09-30T17:04:21.503 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3799999999999998e-07 2023-09-30T17:04:21.503 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.503 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.503 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.504 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.673683+0000", 2023-09-30T17:04:21.504 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2140999999999999e-05 2023-09-30T17:04:21.504 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.504 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.504 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.504 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.673690+0000", 2023-09-30T17:04:21.504 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9650000000000002e-06 2023-09-30T17:04:21.504 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.504 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.504 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.504 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.673696+0000", 2023-09-30T17:04:21.504 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3110000000000002e-06 2023-09-30T17:04:21.505 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.505 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.505 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.505 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.505 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.505 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136707 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.505 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.725612+0000", 2023-09-30T17:04:21.505 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.44449154299999999, 2023-09-30T17:04:21.505 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.455205317, 2023-09-30T17:04:21.505 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.505 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.505 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.506 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.506 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.506 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136707 2023-09-30T17:04:21.506 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.506 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.506 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.506 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.725612+0000", 2023-09-30T17:04:21.506 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.506 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.507 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.507 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.725612+0000", 2023-09-30T17:04:21.507 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.507 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.507 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.507 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.507 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.725613+0000", 2023-09-30T17:04:21.507 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.53e-07 2023-09-30T17:04:21.507 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.507 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.507 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.507 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.725621+0000", 2023-09-30T17:04:21.508 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5339999999999999e-06 2023-09-30T17:04:21.508 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.508 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.508 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.508 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.725626+0000", 2023-09-30T17:04:21.508 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8160000000000001e-06 2023-09-30T17:04:21.508 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.508 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.508 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.508 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.725629+0000", 2023-09-30T17:04:21.508 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0110000000000001e-06 2023-09-30T17:04:21.508 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.509 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.509 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.509 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.509 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.509 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137165 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.509 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.881609+0000", 2023-09-30T17:04:21.509 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.28849523999999999, 2023-09-30T17:04:21.509 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.29927320800000001, 2023-09-30T17:04:21.509 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.509 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.509 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.510 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.510 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.510 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137165 2023-09-30T17:04:21.510 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.510 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.510 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.510 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.510 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.881609+0000", 2023-09-30T17:04:21.510 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.510 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.510 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.510 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.511 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.881609+0000", 2023-09-30T17:04:21.511 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.511 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.511 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.511 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.511 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.883516+0000", 2023-09-30T17:04:21.511 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019073759999999999 2023-09-30T17:04:21.511 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.511 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.511 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.511 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.883536+0000", 2023-09-30T17:04:21.511 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0455e-05 2023-09-30T17:04:21.512 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.512 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.512 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.512 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.883547+0000", 2023-09-30T17:04:21.512 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0393e-05 2023-09-30T17:04:21.512 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.512 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.512 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.512 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.883554+0000", 2023-09-30T17:04:21.512 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6569999999999997e-06 2023-09-30T17:04:21.512 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.512 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.513 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.513 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.513 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.513 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137210 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.513 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.895564+0000", 2023-09-30T17:04:21.513 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.27453994700000001, 2023-09-30T17:04:21.513 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.28537776799999998, 2023-09-30T17:04:21.513 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.513 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.513 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.513 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.513 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.514 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137210 2023-09-30T17:04:21.514 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.514 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.514 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.514 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.514 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.895564+0000", 2023-09-30T17:04:21.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.514 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.514 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.514 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.514 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.895564+0000", 2023-09-30T17:04:21.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.515 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.515 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.895564+0000", 2023-09-30T17:04:21.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2900000000000004e-07 2023-09-30T17:04:21.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.515 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.515 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.895585+0000", 2023-09-30T17:04:21.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0208e-05 2023-09-30T17:04:21.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.516 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.516 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.895592+0000", 2023-09-30T17:04:21.516 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4850000000000003e-06 2023-09-30T17:04:21.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.516 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.516 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.895599+0000", 2023-09-30T17:04:21.516 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6699999999999997e-06 2023-09-30T17:04:21.516 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.516 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.517 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.517 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.517 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137249 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.517 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.910919+0000", 2023-09-30T17:04:21.517 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.25918496899999999, 2023-09-30T17:04:21.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.27008246400000002, 2023-09-30T17:04:21.517 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.517 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.517 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.517 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.517 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.518 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137249 2023-09-30T17:04:21.518 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.518 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.518 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.518 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.518 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.910919+0000", 2023-09-30T17:04:21.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.518 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.518 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.518 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.518 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.910919+0000", 2023-09-30T17:04:21.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.519 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.519 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.912516+0000", 2023-09-30T17:04:21.519 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001596872 2023-09-30T17:04:21.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.519 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.519 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.912538+0000", 2023-09-30T17:04:21.519 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2529000000000001e-05 2023-09-30T17:04:21.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.520 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.520 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.520 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.912547+0000", 2023-09-30T17:04:21.520 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.619e-06 2023-09-30T17:04:21.520 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.520 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.520 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.520 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.912553+0000", 2023-09-30T17:04:21.520 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.331e-06 2023-09-30T17:04:21.520 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.520 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.520 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.521 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.521 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.521 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136394 4.36 e54/17)", 2023-09-30T17:04:21.521 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.086238+0000", 2023-09-30T17:04:21.521 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.083866083999999994, 2023-09-30T17:04:21.521 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.094824978000000004, 2023-09-30T17:04:21.521 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.521 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.521 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.521 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.521 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.522 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.086238+0000", 2023-09-30T17:04:21.522 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.522 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.522 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.086238+0000", 2023-09-30T17:04:21.522 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.522 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.522 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.086238+0000", 2023-09-30T17:04:21.522 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.96e-07 2023-09-30T17:04:21.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.523 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.086258+0000", 2023-09-30T17:04:21.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9961000000000001e-05 2023-09-30T17:04:21.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.523 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.086265+0000", 2023-09-30T17:04:21.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3100000000000003e-06 2023-09-30T17:04:21.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.524 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.524 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.086271+0000", 2023-09-30T17:04:21.524 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5249999999999996e-06 2023-09-30T17:04:21.524 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.524 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.524 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.524 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.524 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.524 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137763 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.524 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.134740+0000", 2023-09-30T17:04:21.524 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.035363586000000002, 2023-09-30T17:04:21.524 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.046373909999999997, 2023-09-30T17:04:21.525 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.525 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.525 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.525 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.525 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.525 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137763 2023-09-30T17:04:21.525 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.525 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.526 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.526 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.134740+0000", 2023-09-30T17:04:21.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.526 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.526 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.526 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.134740+0000", 2023-09-30T17:04:21.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.527 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.527 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.527 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.527 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.134741+0000", 2023-09-30T17:04:21.527 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0999999999999999e-07 2023-09-30T17:04:21.527 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.527 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.527 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.527 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.134753+0000", 2023-09-30T17:04:21.527 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2279000000000001e-05 2023-09-30T17:04:21.527 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.528 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.528 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.528 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.134760+0000", 2023-09-30T17:04:21.528 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5719999999999999e-06 2023-09-30T17:04:21.528 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.528 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.528 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.528 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.134765+0000", 2023-09-30T17:04:21.528 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6620000000000002e-06 2023-09-30T17:04:21.528 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.528 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.528 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.529 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.529 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.529 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136584 4.6 e54/17)", 2023-09-30T17:04:21.529 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.163427+0000", 2023-09-30T17:04:21.529 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0066763839999999996, 2023-09-30T17:04:21.529 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017746986999999999, 2023-09-30T17:04:21.529 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.529 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.529 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.529 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.529 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.529 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.163427+0000", 2023-09-30T17:04:21.530 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.530 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.530 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.530 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.530 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.163427+0000", 2023-09-30T17:04:21.530 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.530 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.530 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.530 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.530 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.163428+0000", 2023-09-30T17:04:21.530 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9299999999999999e-07 2023-09-30T17:04:21.530 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.531 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.531 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.531 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.163445+0000", 2023-09-30T17:04:21.531 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7555999999999999e-05 2023-09-30T17:04:21.531 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.531 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.531 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.531 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.163452+0000", 2023-09-30T17:04:21.531 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6669999999999999e-06 2023-09-30T17:04:21.531 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.531 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.531 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.532 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.163458+0000", 2023-09-30T17:04:21.532 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8669999999999999e-06 2023-09-30T17:04:21.532 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.532 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.532 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.532 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.532 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.532 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:137482 4.3f e54/17 4:fde182c5:::100000001f8.00000039:head v 54'2082, mlcod=54'2079)", 2023-09-30T17:04:21.532 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.177718+0000", 2023-09-30T17:04:21.532 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9923854, 2023-09-30T17:04:21.532 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0035119830000000002, 2023-09-30T17:04:21.532 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.533 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:21.533 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.533 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.533 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.533 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.177718+0000", 2023-09-30T17:04:21.533 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.533 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.533 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.533 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.533 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.177718+0000", 2023-09-30T17:04:21.533 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.534 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.534 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.534 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.534 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.177719+0000", 2023-09-30T17:04:21.534 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2800000000000003e-07 2023-09-30T17:04:21.534 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.534 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.534 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.534 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.177732+0000", 2023-09-30T17:04:21.534 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3912e-05 2023-09-30T17:04:21.534 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.534 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.535 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.535 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.177739+0000", 2023-09-30T17:04:21.535 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2129999999999996e-06 2023-09-30T17:04:21.535 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.535 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.535 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.535 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.177744+0000", 2023-09-30T17:04:21.535 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2390000000000002e-06 2023-09-30T17:04:21.535 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.535 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.535 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:21.535 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.178320+0000", 2023-09-30T17:04:21.536 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00057607899999999996 2023-09-30T17:04:21.536 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.536 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.536 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:21.536 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.178337+0000", 2023-09-30T17:04:21.536 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7248000000000002e-05 2023-09-30T17:04:21.536 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.536 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.536 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.536 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.536 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.536 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136596 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.537 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.673704+0000", 2023-09-30T17:04:21.537 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.49640006800000003, 2023-09-30T17:04:21.537 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.50759127500000001, 2023-09-30T17:04:21.537 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.537 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.537 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.537 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.537 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.537 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136596 2023-09-30T17:04:21.537 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.537 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.537 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.538 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.538 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.673704+0000", 2023-09-30T17:04:21.538 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.538 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.538 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.538 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.538 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.673704+0000", 2023-09-30T17:04:21.538 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.538 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.538 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.538 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.539 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.673704+0000", 2023-09-30T17:04:21.539 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.34e-07 2023-09-30T17:04:21.539 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.539 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.539 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.539 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.673721+0000", 2023-09-30T17:04:21.539 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6532999999999999e-05 2023-09-30T17:04:21.539 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.539 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.539 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.539 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.673728+0000", 2023-09-30T17:04:21.539 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6639999999999998e-06 2023-09-30T17:04:21.540 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.540 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.540 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.540 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.673733+0000", 2023-09-30T17:04:21.540 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0309999999999998e-06 2023-09-30T17:04:21.540 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.540 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.540 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.540 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.540 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.540 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136709 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.540 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.725633+0000", 2023-09-30T17:04:21.540 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.44447103900000001, 2023-09-30T17:04:21.541 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.45572172900000002, 2023-09-30T17:04:21.541 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.541 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.541 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.541 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.541 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.541 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136709 2023-09-30T17:04:21.541 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.541 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.541 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.541 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.542 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.725633+0000", 2023-09-30T17:04:21.542 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.542 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.542 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.542 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.542 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.725633+0000", 2023-09-30T17:04:21.542 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.542 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.542 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.542 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.542 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.725633+0000", 2023-09-30T17:04:21.542 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4200000000000002e-07 2023-09-30T17:04:21.543 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.543 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.543 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.543 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.725641+0000", 2023-09-30T17:04:21.543 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9689999999999994e-06 2023-09-30T17:04:21.543 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.543 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.543 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.543 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.725646+0000", 2023-09-30T17:04:21.543 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6199999999999998e-06 2023-09-30T17:04:21.543 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.544 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.544 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.544 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.725648+0000", 2023-09-30T17:04:21.544 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.818e-06 2023-09-30T17:04:21.544 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.544 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.544 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.544 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.544 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.544 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136816 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.544 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.766721+0000", 2023-09-30T17:04:21.544 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.40338307600000001, 2023-09-30T17:04:21.545 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.41469743799999997, 2023-09-30T17:04:21.545 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.545 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.545 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.545 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.545 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.545 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136816 2023-09-30T17:04:21.545 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.545 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.545 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.545 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.545 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.766721+0000", 2023-09-30T17:04:21.546 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.546 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.546 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.546 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.546 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.766721+0000", 2023-09-30T17:04:21.546 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.546 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.546 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.546 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.546 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.766721+0000", 2023-09-30T17:04:21.546 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.44e-07 2023-09-30T17:04:21.546 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.547 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.547 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.547 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.766732+0000", 2023-09-30T17:04:21.547 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0648999999999999e-05 2023-09-30T17:04:21.547 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.547 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.547 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.547 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.766738+0000", 2023-09-30T17:04:21.547 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8119999999999996e-06 2023-09-30T17:04:21.547 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.547 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.548 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.548 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.766743+0000", 2023-09-30T17:04:21.548 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3680000000000001e-06 2023-09-30T17:04:21.548 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.548 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.548 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.548 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.548 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.548 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137005 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.548 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.836656+0000", 2023-09-30T17:04:21.548 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.33344764500000001, 2023-09-30T17:04:21.548 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.34482153700000001, 2023-09-30T17:04:21.549 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.549 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.549 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.549 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.549 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.549 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137005 2023-09-30T17:04:21.549 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.549 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.549 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.549 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.549 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.836656+0000", 2023-09-30T17:04:21.549 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.550 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.550 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.550 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.550 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.836656+0000", 2023-09-30T17:04:21.550 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.550 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.550 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.550 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.550 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.836657+0000", 2023-09-30T17:04:21.550 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2200000000000004e-07 2023-09-30T17:04:21.550 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.550 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.551 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.551 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.836666+0000", 2023-09-30T17:04:21.551 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4259999999999992e-06 2023-09-30T17:04:21.551 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.551 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.551 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.551 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.836673+0000", 2023-09-30T17:04:21.551 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.477e-06 2023-09-30T17:04:21.551 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.551 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.551 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.551 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.836677+0000", 2023-09-30T17:04:21.552 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8099999999999997e-06 2023-09-30T17:04:21.552 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.552 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.552 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.552 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.552 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.552 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:135731 4.2e e54/17 4:75be0f36:::100000001f8.0000003d:head v 54'2114, mlcod=54'2095)", 2023-09-30T17:04:21.552 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.848578+0000", 2023-09-30T17:04:21.552 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.32152533799999999, 2023-09-30T17:04:21.552 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.33297032300000001, 2023-09-30T17:04:21.552 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.552 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:21.553 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.553 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.553 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.553 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.848578+0000", 2023-09-30T17:04:21.553 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.553 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.553 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.553 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.553 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.848578+0000", 2023-09-30T17:04:21.553 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.553 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.554 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.554 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.554 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.848579+0000", 2023-09-30T17:04:21.554 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5699999999999998e-07 2023-09-30T17:04:21.554 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.554 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.554 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.554 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.848593+0000", 2023-09-30T17:04:21.554 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4117000000000001e-05 2023-09-30T17:04:21.554 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.554 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.554 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.555 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.848600+0000", 2023-09-30T17:04:21.555 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7499999999999997e-06 2023-09-30T17:04:21.555 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.555 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.555 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.555 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.848605+0000", 2023-09-30T17:04:21.555 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1869999999999996e-06 2023-09-30T17:04:21.555 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.555 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.555 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:21.555 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.164485+0000", 2023-09-30T17:04:21.556 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.31588035599999997 2023-09-30T17:04:21.556 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.556 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.556 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:21.556 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.164506+0000", 2023-09-30T17:04:21.556 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0372000000000001e-05 2023-09-30T17:04:21.556 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.556 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.556 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.556 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.556 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.556 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136114 4.6 e54/17)", 2023-09-30T17:04:21.557 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.994492+0000", 2023-09-30T17:04:21.557 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.17561162299999999, 2023-09-30T17:04:21.557 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.18712166799999999, 2023-09-30T17:04:21.557 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.557 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.557 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.557 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.557 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.557 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.994492+0000", 2023-09-30T17:04:21.557 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.557 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.557 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.558 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.558 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.994492+0000", 2023-09-30T17:04:21.558 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.558 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.558 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.558 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.558 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.994493+0000", 2023-09-30T17:04:21.558 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7e-07 2023-09-30T17:04:21.558 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.558 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.558 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.558 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.994523+0000", 2023-09-30T17:04:21.559 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0241000000000001e-05 2023-09-30T17:04:21.559 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.559 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.559 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.559 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.994534+0000", 2023-09-30T17:04:21.559 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1087000000000001e-05 2023-09-30T17:04:21.559 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.559 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.559 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.559 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.994540+0000", 2023-09-30T17:04:21.559 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0650000000000004e-06 2023-09-30T17:04:21.560 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.560 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.560 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.560 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.560 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.560 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136482 4.6 e54/17)", 2023-09-30T17:04:21.560 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.121478+0000", 2023-09-30T17:04:21.560 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.048625851999999997, 2023-09-30T17:04:21.560 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.060183740999999999, 2023-09-30T17:04:21.560 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.560 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.561 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.561 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.561 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.561 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.121478+0000", 2023-09-30T17:04:21.561 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.561 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.561 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.561 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.561 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.121478+0000", 2023-09-30T17:04:21.561 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.561 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.561 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.562 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.562 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.121478+0000", 2023-09-30T17:04:21.562 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2700000000000001e-07 2023-09-30T17:04:21.562 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.562 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.562 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.562 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.121485+0000", 2023-09-30T17:04:21.562 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6810000000000001e-06 2023-09-30T17:04:21.562 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.562 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.562 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.563 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.121488+0000", 2023-09-30T17:04:21.563 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3629999999999998e-06 2023-09-30T17:04:21.563 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.563 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.563 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.563 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.121498+0000", 2023-09-30T17:04:21.563 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0210000000000001e-05 2023-09-30T17:04:21.563 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.563 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.563 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.563 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.563 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.564 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:137445 4.28 e54/17 4:153ae410:::100000001f8.0000003b:head v 54'4229, mlcod=54'4223)", 2023-09-30T17:04:21.564 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.163465+0000", 2023-09-30T17:04:21.564 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0066384419999999996, 2023-09-30T17:04:21.564 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018246638999999999, 2023-09-30T17:04:21.564 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.564 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:21.564 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.564 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.564 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.564 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.163465+0000", 2023-09-30T17:04:21.564 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.564 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.565 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.565 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.565 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.163465+0000", 2023-09-30T17:04:21.565 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.565 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.565 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.565 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.565 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.163466+0000", 2023-09-30T17:04:21.565 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4699999999999998e-07 2023-09-30T17:04:21.565 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.565 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.565 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.566 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.163476+0000", 2023-09-30T17:04:21.566 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0229e-05 2023-09-30T17:04:21.566 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.566 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.566 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.566 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.163483+0000", 2023-09-30T17:04:21.566 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5170000000000002e-06 2023-09-30T17:04:21.566 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.566 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.566 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.566 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.163488+0000", 2023-09-30T17:04:21.567 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3080000000000001e-06 2023-09-30T17:04:21.567 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.567 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.567 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:21.567 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.166801+0000", 2023-09-30T17:04:21.567 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0033131240000000002 2023-09-30T17:04:21.567 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.567 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.567 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:21.567 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.166821+0000", 2023-09-30T17:04:21.567 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0214e-05 2023-09-30T17:04:21.567 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.568 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.568 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.568 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.568 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.568 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:137481 4.19 e54/17 4:9a4319fb:::100000001f8.0000002a:head v 54'4301, mlcod=54'4299)", 2023-09-30T17:04:21.568 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.177751+0000", 2023-09-30T17:04:21.568 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9923525, 2023-09-30T17:04:21.568 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0040192049999999997, 2023-09-30T17:04:21.568 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.568 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:21.568 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.568 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.569 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.569 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.177751+0000", 2023-09-30T17:04:21.569 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.569 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.569 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.569 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.569 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.177751+0000", 2023-09-30T17:04:21.569 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.569 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.569 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.569 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.570 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.177752+0000", 2023-09-30T17:04:21.570 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0900000000000001e-07 2023-09-30T17:04:21.570 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.570 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.570 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.570 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.177762+0000", 2023-09-30T17:04:21.570 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0508e-05 2023-09-30T17:04:21.570 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.570 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.570 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.570 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.177768+0000", 2023-09-30T17:04:21.570 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.604e-06 2023-09-30T17:04:21.571 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.571 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.571 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.571 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.177772+0000", 2023-09-30T17:04:21.571 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1749999999999998e-06 2023-09-30T17:04:21.571 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.571 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.571 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:21.571 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.177828+0000", 2023-09-30T17:04:21.571 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5677999999999998e-05 2023-09-30T17:04:21.571 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.571 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.572 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:21.572 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.177851+0000", 2023-09-30T17:04:21.572 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2874000000000002e-05 2023-09-30T17:04:21.572 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.572 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.572 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.572 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.572 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.572 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136402 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.572 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.590266+0000", 2023-09-30T17:04:21.572 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.57983795900000001, 2023-09-30T17:04:21.573 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.59156431899999995, 2023-09-30T17:04:21.573 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.573 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.573 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.573 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.573 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.573 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136402 2023-09-30T17:04:21.573 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.573 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.573 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.573 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.573 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.590266+0000", 2023-09-30T17:04:21.574 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.574 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.574 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.574 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.574 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.590266+0000", 2023-09-30T17:04:21.574 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.574 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.574 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.574 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.574 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.590266+0000", 2023-09-30T17:04:21.574 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0500000000000004e-07 2023-09-30T17:04:21.574 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.575 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.575 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.575 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.590279+0000", 2023-09-30T17:04:21.575 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2765999999999999e-05 2023-09-30T17:04:21.575 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.575 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.575 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.575 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.590296+0000", 2023-09-30T17:04:21.575 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6898e-05 2023-09-30T17:04:21.575 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.575 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.576 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.576 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.590302+0000", 2023-09-30T17:04:21.576 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9689999999999999e-06 2023-09-30T17:04:21.576 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.576 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.576 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.576 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.576 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.576 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136679 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.576 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.712562+0000", 2023-09-30T17:04:21.576 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.45754139500000002, 2023-09-30T17:04:21.576 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.469319759, 2023-09-30T17:04:21.577 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.577 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.577 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.577 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.577 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.577 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136679 2023-09-30T17:04:21.577 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.577 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.577 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.577 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.577 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.712562+0000", 2023-09-30T17:04:21.578 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.578 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.578 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.578 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.578 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.712562+0000", 2023-09-30T17:04:21.578 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.578 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.578 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.578 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.578 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.712563+0000", 2023-09-30T17:04:21.578 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2e-07 2023-09-30T17:04:21.578 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.579 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.579 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.579 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.712573+0000", 2023-09-30T17:04:21.579 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0395e-05 2023-09-30T17:04:21.579 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.579 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.579 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.579 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.712580+0000", 2023-09-30T17:04:21.579 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7089999999999996e-06 2023-09-30T17:04:21.579 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.579 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.579 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.580 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.712586+0000", 2023-09-30T17:04:21.580 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6960000000000002e-06 2023-09-30T17:04:21.580 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.580 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.580 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.580 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.580 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.580 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:135708 4.6 e54/17 4:62d56fc8:::100000001f8.0000001c:head v 54'8356, mlcod=54'8294)", 2023-09-30T17:04:21.580 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.848613+0000", 2023-09-30T17:04:21.580 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.32149064700000002, 2023-09-30T17:04:21.580 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.33332340599999999, 2023-09-30T17:04:21.580 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.581 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:21.581 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.581 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.581 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.581 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.848613+0000", 2023-09-30T17:04:21.581 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.581 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.581 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.581 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.581 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.848613+0000", 2023-09-30T17:04:21.581 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.581 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.582 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.582 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.582 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.848613+0000", 2023-09-30T17:04:21.582 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.16e-07 2023-09-30T17:04:21.582 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.582 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.582 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.582 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.848625+0000", 2023-09-30T17:04:21.582 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1317e-05 2023-09-30T17:04:21.582 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.582 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.583 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.583 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.848631+0000", 2023-09-30T17:04:21.583 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3899999999999998e-06 2023-09-30T17:04:21.583 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.583 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.583 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.583 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.848636+0000", 2023-09-30T17:04:21.583 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6619999999999996e-06 2023-09-30T17:04:21.583 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.583 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.583 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:21.583 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.171745+0000", 2023-09-30T17:04:21.584 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.32310955000000002 2023-09-30T17:04:21.584 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.584 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.584 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:21.584 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.171764+0000", 2023-09-30T17:04:21.584 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9079000000000001e-05 2023-09-30T17:04:21.584 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.584 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.584 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.584 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.584 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.584 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137071 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.585 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.858686+0000", 2023-09-30T17:04:21.585 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.31141796100000002, 2023-09-30T17:04:21.585 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.32330931899999998, 2023-09-30T17:04:21.585 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.585 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.585 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.585 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.585 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.585 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137071 2023-09-30T17:04:21.585 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.585 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.585 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.586 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.586 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.858686+0000", 2023-09-30T17:04:21.586 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.586 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.586 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.586 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.586 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.858686+0000", 2023-09-30T17:04:21.586 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.586 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.586 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.586 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.587 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.858686+0000", 2023-09-30T17:04:21.587 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6699999999999999e-07 2023-09-30T17:04:21.587 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.587 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.587 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.587 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.858697+0000", 2023-09-30T17:04:21.587 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1147e-05 2023-09-30T17:04:21.587 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.587 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.587 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.587 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.858705+0000", 2023-09-30T17:04:21.587 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3649999999999998e-06 2023-09-30T17:04:21.588 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.588 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.588 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.588 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.858710+0000", 2023-09-30T17:04:21.588 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5550000000000002e-06 2023-09-30T17:04:21.588 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.588 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.588 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.588 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.588 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.588 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137357 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.588 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.948637+0000", 2023-09-30T17:04:21.589 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.22146663599999999, 2023-09-30T17:04:21.589 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.23341289100000001, 2023-09-30T17:04:21.589 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.589 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.589 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.589 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.589 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.589 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137357 2023-09-30T17:04:21.589 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.589 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.589 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.589 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.590 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.948637+0000", 2023-09-30T17:04:21.590 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.590 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.590 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.590 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.590 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.948637+0000", 2023-09-30T17:04:21.590 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.590 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.590 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.590 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.590 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.948638+0000", 2023-09-30T17:04:21.591 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8100000000000003e-07 2023-09-30T17:04:21.591 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.591 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.591 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.591 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.948649+0000", 2023-09-30T17:04:21.591 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0915e-05 2023-09-30T17:04:21.591 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.591 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.591 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.591 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.948654+0000", 2023-09-30T17:04:21.591 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8100000000000003e-06 2023-09-30T17:04:21.591 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.592 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.592 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.592 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.948659+0000", 2023-09-30T17:04:21.592 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6530000000000002e-06 2023-09-30T17:04:21.592 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.592 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.592 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.592 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.592 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.592 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136161 4.2e e54/17)", 2023-09-30T17:04:21.592 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.010418+0000", 2023-09-30T17:04:21.592 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.159686034, 2023-09-30T17:04:21.593 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.171683638, 2023-09-30T17:04:21.593 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.593 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.593 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.593 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.593 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.593 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.010418+0000", 2023-09-30T17:04:21.593 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.593 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.593 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.593 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.593 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.010418+0000", 2023-09-30T17:04:21.594 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.594 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.594 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.594 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.594 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.010418+0000", 2023-09-30T17:04:21.594 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4600000000000004e-07 2023-09-30T17:04:21.594 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.594 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.594 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.594 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.010435+0000", 2023-09-30T17:04:21.594 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6226e-05 2023-09-30T17:04:21.595 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.595 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.595 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.595 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.010445+0000", 2023-09-30T17:04:21.595 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0587e-05 2023-09-30T17:04:21.595 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.595 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.595 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.595 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.010452+0000", 2023-09-30T17:04:21.595 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.187e-06 2023-09-30T17:04:21.595 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.595 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.596 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.596 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.596 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.596 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137588 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.596 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.048557+0000", 2023-09-30T17:04:21.596 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.12154720400000001, 2023-09-30T17:04:21.596 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.13359322500000001, 2023-09-30T17:04:21.596 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.596 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.596 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.596 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.597 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.597 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137588 2023-09-30T17:04:21.597 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.597 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.597 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.597 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.597 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.048557+0000", 2023-09-30T17:04:21.597 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.597 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.597 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.597 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.597 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.048557+0000", 2023-09-30T17:04:21.598 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.598 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.598 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.598 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.598 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.052022+0000", 2023-09-30T17:04:21.598 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0034656050000000001 2023-09-30T17:04:21.598 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.598 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.598 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.598 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.052041+0000", 2023-09-30T17:04:21.598 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8788e-05 2023-09-30T17:04:21.598 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.599 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.599 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.599 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.052541+0000", 2023-09-30T17:04:21.599 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00049978499999999999 2023-09-30T17:04:21.599 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.599 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.599 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.599 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.052551+0000", 2023-09-30T17:04:21.599 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0006999999999999e-05 2023-09-30T17:04:21.599 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.599 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.599 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.600 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.600 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.600 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137819 4.a 4:50194ce5:::100000001f8.00000027:head [write 1245184~4096 in=4096b,write 1253376~4096 in=4096b,write 1429504~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.600 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.159903+0000", 2023-09-30T17:04:21.600 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.010200364, 2023-09-30T17:04:21.600 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022305578, 2023-09-30T17:04:21.600 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.600 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:21.600 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.600 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.600 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.600 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137819 2023-09-30T17:04:21.601 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.601 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.601 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.601 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.601 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.159903+0000", 2023-09-30T17:04:21.601 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.601 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.601 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.601 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.601 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.159903+0000", 2023-09-30T17:04:21.601 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.602 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.602 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.602 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.602 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.163550+0000", 2023-09-30T17:04:21.602 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00364614 2023-09-30T17:04:21.602 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.602 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.602 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.602 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.163564+0000", 2023-09-30T17:04:21.617 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4122e-05 2023-09-30T17:04:21.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.617 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.617 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.618 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.163576+0000", 2023-09-30T17:04:21.618 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2088e-05 2023-09-30T17:04:21.618 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.618 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.618 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.618 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.163582+0000", 2023-09-30T17:04:21.618 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.161e-06 2023-09-30T17:04:21.618 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.618 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.618 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:21.618 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.181145+0000", 2023-09-30T17:04:21.619 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017562773 2023-09-30T17:04:21.619 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.619 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.619 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:21.619 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.181215+0000", 2023-09-30T17:04:21.619 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0578000000000001e-05 2023-09-30T17:04:21.619 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.619 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.619 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.619 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.619 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.620 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136403 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.620 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.590311+0000", 2023-09-30T17:04:21.620 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.579792576, 2023-09-30T17:04:21.620 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.59196107799999997, 2023-09-30T17:04:21.620 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.620 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.620 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.620 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.620 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.620 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136403 2023-09-30T17:04:21.620 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.620 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.621 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.621 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.621 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.590311+0000", 2023-09-30T17:04:21.621 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.621 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.621 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.621 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.621 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.590311+0000", 2023-09-30T17:04:21.621 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.621 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.621 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.621 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.622 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.590312+0000", 2023-09-30T17:04:21.622 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7899999999999998e-07 2023-09-30T17:04:21.622 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.622 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.622 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.622 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.590325+0000", 2023-09-30T17:04:21.622 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3236e-05 2023-09-30T17:04:21.622 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.622 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.622 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.622 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.590332+0000", 2023-09-30T17:04:21.623 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5560000000000004e-06 2023-09-30T17:04:21.623 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.623 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.623 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.623 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.590337+0000", 2023-09-30T17:04:21.623 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6540000000000004e-06 2023-09-30T17:04:21.623 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.623 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.623 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.623 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.623 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.623 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136639 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.624 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.693559+0000", 2023-09-30T17:04:21.624 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.47654498699999998, 2023-09-30T17:04:21.624 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.48876490900000003, 2023-09-30T17:04:21.624 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.624 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.624 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.624 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.624 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.624 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136639 2023-09-30T17:04:21.624 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.624 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.624 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.625 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.625 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.693559+0000", 2023-09-30T17:04:21.625 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.625 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.625 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.625 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.625 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.693559+0000", 2023-09-30T17:04:21.625 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.625 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.625 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.625 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.626 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.693559+0000", 2023-09-30T17:04:21.626 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.65e-07 2023-09-30T17:04:21.626 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.626 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.626 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.626 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.693568+0000", 2023-09-30T17:04:21.626 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8939999999999999e-06 2023-09-30T17:04:21.626 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.626 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.626 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.626 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.693572+0000", 2023-09-30T17:04:21.626 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4429999999999996e-06 2023-09-30T17:04:21.627 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.627 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.627 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.627 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.693576+0000", 2023-09-30T17:04:21.627 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3270000000000001e-06 2023-09-30T17:04:21.627 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.627 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.627 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.627 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.627 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.627 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136939 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.628 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.819483+0000", 2023-09-30T17:04:21.628 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.350620498, 2023-09-30T17:04:21.628 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.36289691499999999, 2023-09-30T17:04:21.628 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.628 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.628 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.628 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.628 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.628 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136939 2023-09-30T17:04:21.628 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.628 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.629 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.819483+0000", 2023-09-30T17:04:21.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.629 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.819483+0000", 2023-09-30T17:04:21.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.820516+0000", 2023-09-30T17:04:21.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001032909 2023-09-30T17:04:21.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.630 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.820534+0000", 2023-09-30T17:04:21.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7761000000000002e-05 2023-09-30T17:04:21.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.630 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.820543+0000", 2023-09-30T17:04:21.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8990000000000007e-06 2023-09-30T17:04:21.631 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.631 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.631 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.631 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.820550+0000", 2023-09-30T17:04:21.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1400000000000002e-06 2023-09-30T17:04:21.631 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.631 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.631 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.631 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.631 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.632 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:135822 4.36 e54/17)", 2023-09-30T17:04:21.632 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.870265+0000", 2023-09-30T17:04:21.632 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.29983848600000002, 2023-09-30T17:04:21.632 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.31216874, 2023-09-30T17:04:21.632 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.632 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.632 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.632 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.632 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.632 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.870265+0000", 2023-09-30T17:04:21.632 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.632 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.633 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.633 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.633 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.870265+0000", 2023-09-30T17:04:21.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.633 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.633 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.633 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.633 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.870266+0000", 2023-09-30T17:04:21.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9900000000000002e-07 2023-09-30T17:04:21.633 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.633 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.633 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.634 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.870281+0000", 2023-09-30T17:04:21.634 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.554e-05 2023-09-30T17:04:21.634 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.634 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.634 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.870288+0000", 2023-09-30T17:04:21.634 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9160000000000004e-06 2023-09-30T17:04:21.634 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.634 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.634 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.870294+0000", 2023-09-30T17:04:21.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1580000000000002e-06 2023-09-30T17:04:21.635 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.635 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.635 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.635 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:135885 4.2e e54/17)", 2023-09-30T17:04:21.635 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.885460+0000", 2023-09-30T17:04:21.635 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.28464326499999998, 2023-09-30T17:04:21.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.29701999899999998, 2023-09-30T17:04:21.635 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.635 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.636 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.885460+0000", 2023-09-30T17:04:21.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.885460+0000", 2023-09-30T17:04:21.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.637 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.637 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.885461+0000", 2023-09-30T17:04:21.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7000000000000003e-07 2023-09-30T17:04:21.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.637 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.637 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.885475+0000", 2023-09-30T17:04:21.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3543999999999999e-05 2023-09-30T17:04:21.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.637 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.637 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.885486+0000", 2023-09-30T17:04:21.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1345999999999999e-05 2023-09-30T17:04:21.638 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.638 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.638 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.885494+0000", 2023-09-30T17:04:21.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8849999999999999e-06 2023-09-30T17:04:21.638 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.638 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.638 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.638 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.639 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:135924 4.6 e54/17)", 2023-09-30T17:04:21.639 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.914432+0000", 2023-09-30T17:04:21.639 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.25567137200000001, 2023-09-30T17:04:21.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.26810060400000002, 2023-09-30T17:04:21.639 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.639 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.639 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.914432+0000", 2023-09-30T17:04:21.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.914432+0000", 2023-09-30T17:04:21.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.914433+0000", 2023-09-30T17:04:21.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4799999999999997e-07 2023-09-30T17:04:21.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.641 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.914448+0000", 2023-09-30T17:04:21.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4411e-05 2023-09-30T17:04:21.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.641 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.914457+0000", 2023-09-30T17:04:21.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4089999999999992e-06 2023-09-30T17:04:21.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.641 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.914464+0000", 2023-09-30T17:04:21.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8689999999999998e-06 2023-09-30T17:04:21.642 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.642 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.642 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.642 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.642 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.642 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137295 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.642 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.926610+0000", 2023-09-30T17:04:21.642 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.243494087, 2023-09-30T17:04:21.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.255970592, 2023-09-30T17:04:21.642 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.643 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.643 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.643 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.643 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.643 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137295 2023-09-30T17:04:21.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.643 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.643 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.643 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.926610+0000", 2023-09-30T17:04:21.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.644 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.926610+0000", 2023-09-30T17:04:21.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.644 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.644 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.926610+0000", 2023-09-30T17:04:21.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0699999999999998e-07 2023-09-30T17:04:21.644 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.645 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.645 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.926621+0000", 2023-09-30T17:04:21.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1085e-05 2023-09-30T17:04:21.645 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.645 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.645 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.645 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.926627+0000", 2023-09-30T17:04:21.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2500000000000003e-06 2023-09-30T17:04:21.645 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.645 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.645 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.645 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.926632+0000", 2023-09-30T17:04:21.646 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8459999999999999e-06 2023-09-30T17:04:21.646 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.646 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.646 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.646 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.646 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.646 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136101 4.6 e54/17)", 2023-09-30T17:04:21.646 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.984470+0000", 2023-09-30T17:04:21.646 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.18563349200000001, 2023-09-30T17:04:21.646 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.198164113, 2023-09-30T17:04:21.646 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.647 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.647 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.647 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.647 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.984470+0000", 2023-09-30T17:04:21.647 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.647 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.647 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.984470+0000", 2023-09-30T17:04:21.647 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.648 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.984471+0000", 2023-09-30T17:04:21.648 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1900000000000001e-07 2023-09-30T17:04:21.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.648 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.984498+0000", 2023-09-30T17:04:21.648 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6565999999999999e-05 2023-09-30T17:04:21.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.649 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.984508+0000", 2023-09-30T17:04:21.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9930000000000007e-06 2023-09-30T17:04:21.649 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.649 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.984520+0000", 2023-09-30T17:04:21.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2323999999999999e-05 2023-09-30T17:04:21.649 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.649 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.649 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.650 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.650 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.650 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136304 4.36 e54/17)", 2023-09-30T17:04:21.650 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.052585+0000", 2023-09-30T17:04:21.650 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.117518569, 2023-09-30T17:04:21.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.13009243400000001, 2023-09-30T17:04:21.650 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.650 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.650 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.650 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.650 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.650 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.052585+0000", 2023-09-30T17:04:21.651 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.651 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.651 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.651 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.052585+0000", 2023-09-30T17:04:21.651 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.651 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.651 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.651 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.052586+0000", 2023-09-30T17:04:21.651 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9100000000000004e-07 2023-09-30T17:04:21.652 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.652 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.652 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.652 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.052599+0000", 2023-09-30T17:04:21.652 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3517e-05 2023-09-30T17:04:21.652 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.652 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.652 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.652 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.052606+0000", 2023-09-30T17:04:21.652 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2309999999999999e-06 2023-09-30T17:04:21.652 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.652 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.653 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.653 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.052612+0000", 2023-09-30T17:04:21.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4670000000000003e-06 2023-09-30T17:04:21.653 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.653 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.653 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.653 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137820 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.653 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.163599+0000", 2023-09-30T17:04:21.653 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0065050710000000003, 2023-09-30T17:04:21.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019126632000000001, 2023-09-30T17:04:21.654 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.654 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.654 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.654 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.654 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.654 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137820 2023-09-30T17:04:21.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.654 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.654 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.163599+0000", 2023-09-30T17:04:21.655 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.655 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.655 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.655 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.655 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.163599+0000", 2023-09-30T17:04:21.655 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.655 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.655 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.655 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.655 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.163599+0000", 2023-09-30T17:04:21.655 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6499999999999999e-07 2023-09-30T17:04:21.656 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.656 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.656 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.656 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.163613+0000", 2023-09-30T17:04:21.656 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4134000000000001e-05 2023-09-30T17:04:21.656 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.656 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.656 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.656 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.163621+0000", 2023-09-30T17:04:21.656 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1370000000000002e-06 2023-09-30T17:04:21.656 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.657 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.657 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.163627+0000", 2023-09-30T17:04:21.657 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2510000000000002e-06 2023-09-30T17:04:21.657 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.657 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.657 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.657 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.657 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136599 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.657 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.673818+0000", 2023-09-30T17:04:21.657 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.496286071, 2023-09-30T17:04:21.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.50895975699999996, 2023-09-30T17:04:21.665 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.665 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.665 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.666 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.666 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.666 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136599 2023-09-30T17:04:21.666 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.666 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.666 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.673818+0000", 2023-09-30T17:04:21.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.673818+0000", 2023-09-30T17:04:21.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.668 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.668 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.673818+0000", 2023-09-30T17:04:21.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5999999999999999e-07 2023-09-30T17:04:21.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.669 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.669 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.669 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.673830+0000", 2023-09-30T17:04:21.669 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.17e-05 2023-09-30T17:04:21.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.669 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.669 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.669 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.673836+0000", 2023-09-30T17:04:21.669 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5320000000000003e-06 2023-09-30T17:04:21.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.669 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.670 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.670 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.673842+0000", 2023-09-30T17:04:21.670 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.327e-06 2023-09-30T17:04:21.670 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.670 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.670 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.670 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.670 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.671 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136819 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.671 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.766784+0000", 2023-09-30T17:04:21.671 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.40332010299999999, 2023-09-30T17:04:21.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.41604613099999999, 2023-09-30T17:04:21.671 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.671 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.671 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.672 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.672 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.672 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136819 2023-09-30T17:04:21.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.672 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.672 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.672 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.766784+0000", 2023-09-30T17:04:21.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.673 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.673 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.766784+0000", 2023-09-30T17:04:21.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.674 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.674 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.768602+0000", 2023-09-30T17:04:21.674 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001817894 2023-09-30T17:04:21.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.675 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.675 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.768620+0000", 2023-09-30T17:04:21.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8244999999999999e-05 2023-09-30T17:04:21.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.675 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.768629+0000", 2023-09-30T17:04:21.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4709999999999996e-06 2023-09-30T17:04:21.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.768636+0000", 2023-09-30T17:04:21.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1760000000000004e-06 2023-09-30T17:04:21.677 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.677 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.677 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.677 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137214 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.677 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.897924+0000", 2023-09-30T17:04:21.677 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.27218012200000002, 2023-09-30T17:04:21.677 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.28496178900000002, 2023-09-30T17:04:21.678 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.678 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.678 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.678 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.678 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.678 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137214 2023-09-30T17:04:21.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.679 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.679 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.679 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.897924+0000", 2023-09-30T17:04:21.679 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.679 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.679 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.897924+0000", 2023-09-30T17:04:21.679 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.680 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.680 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.897924+0000", 2023-09-30T17:04:21.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.75e-07 2023-09-30T17:04:21.680 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.680 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.681 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.897934+0000", 2023-09-30T17:04:21.681 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7229999999999999e-06 2023-09-30T17:04:21.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.681 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.681 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.897940+0000", 2023-09-30T17:04:21.681 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1999999999999999e-06 2023-09-30T17:04:21.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.681 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.682 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.897945+0000", 2023-09-30T17:04:21.682 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4090000000000002e-06 2023-09-30T17:04:21.682 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.682 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.682 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.682 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.682 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.682 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136469 4.6 e54/17)", 2023-09-30T17:04:21.682 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.108576+0000", 2023-09-30T17:04:21.683 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.061527519000000003, 2023-09-30T17:04:21.683 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.074359758999999997, 2023-09-30T17:04:21.683 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.683 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.683 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.683 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.684 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.108576+0000", 2023-09-30T17:04:21.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.684 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.684 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.684 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.108576+0000", 2023-09-30T17:04:21.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.684 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.685 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.685 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.108576+0000", 2023-09-30T17:04:21.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8199999999999999e-07 2023-09-30T17:04:21.685 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.685 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.685 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.108594+0000", 2023-09-30T17:04:21.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7737999999999999e-05 2023-09-30T17:04:21.685 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.686 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.686 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.108659+0000", 2023-09-30T17:04:21.686 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4523000000000005e-05 2023-09-30T17:04:21.686 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.686 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.686 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.686 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.108664+0000", 2023-09-30T17:04:21.686 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3260000000000003e-06 2023-09-30T17:04:21.686 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.686 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.686 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.687 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.687 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.687 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136490 4.6 e54/17)", 2023-09-30T17:04:21.687 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.123712+0000", 2023-09-30T17:04:21.687 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.046392045, 2023-09-30T17:04:21.687 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.059270080000000003, 2023-09-30T17:04:21.687 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.687 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.687 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.688 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.688 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.688 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.123712+0000", 2023-09-30T17:04:21.688 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.688 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.688 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.688 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.689 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.123712+0000", 2023-09-30T17:04:21.689 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.689 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.689 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.689 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.123712+0000", 2023-09-30T17:04:21.689 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3900000000000004e-07 2023-09-30T17:04:21.689 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.690 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.690 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.123730+0000", 2023-09-30T17:04:21.690 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7475000000000001e-05 2023-09-30T17:04:21.690 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.690 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.690 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.123738+0000", 2023-09-30T17:04:21.690 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5560000000000008e-06 2023-09-30T17:04:21.690 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.691 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.691 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.123745+0000", 2023-09-30T17:04:21.691 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3929999999999996e-06 2023-09-30T17:04:21.691 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.691 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.691 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.691 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.691 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.691 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136546 4.36 e54/17)", 2023-09-30T17:04:21.692 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.150395+0000", 2023-09-30T17:04:21.692 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.019709174999999999, 2023-09-30T17:04:21.692 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.032631408000000001, 2023-09-30T17:04:21.692 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.692 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.692 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.692 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.692 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.692 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.150395+0000", 2023-09-30T17:04:21.693 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.693 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.693 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.693 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.693 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.150395+0000", 2023-09-30T17:04:21.693 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.693 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.694 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.694 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.694 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.150395+0000", 2023-09-30T17:04:21.694 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7999999999999996e-07 2023-09-30T17:04:21.694 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.694 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.694 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.695 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.150406+0000", 2023-09-30T17:04:21.695 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0738e-05 2023-09-30T17:04:21.695 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.695 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.695 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.695 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.150413+0000", 2023-09-30T17:04:21.695 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.866e-06 2023-09-30T17:04:21.695 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.696 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.696 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.696 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.150417+0000", 2023-09-30T17:04:21.696 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6369999999999998e-06 2023-09-30T17:04:21.696 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.696 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.696 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.697 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.697 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.697 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137822 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 1568768~4096 in=4096b,write 1613824~4096 in=4096b,write 1691648~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.697 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.163633+0000", 2023-09-30T17:04:21.697 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0064707159999999996, 2023-09-30T17:04:21.697 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019447974, 2023-09-30T17:04:21.697 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.698 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:21.698 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.698 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.698 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.698 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137822 2023-09-30T17:04:21.698 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.699 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.699 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.699 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.163633+0000", 2023-09-30T17:04:21.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.700 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.700 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.700 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.700 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.163633+0000", 2023-09-30T17:04:21.700 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.700 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.700 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.701 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.701 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.163633+0000", 2023-09-30T17:04:21.701 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8200000000000001e-07 2023-09-30T17:04:21.701 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.701 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.701 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.701 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.163651+0000", 2023-09-30T17:04:21.701 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7978999999999998e-05 2023-09-30T17:04:21.702 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.702 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.702 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.702 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.163660+0000", 2023-09-30T17:04:21.702 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5110000000000003e-06 2023-09-30T17:04:21.702 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.702 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.703 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.703 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.163665+0000", 2023-09-30T17:04:21.703 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1760000000000001e-06 2023-09-30T17:04:21.703 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.703 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.703 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:21.704 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.163717+0000", 2023-09-30T17:04:21.704 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2262000000000002e-05 2023-09-30T17:04:21.704 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.704 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.704 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:21.704 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.163798+0000", 2023-09-30T17:04:21.705 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0267999999999998e-05 2023-09-30T17:04:21.705 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.705 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.705 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:21.705 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.163956+0000", 2023-09-30T17:04:21.705 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158703 2023-09-30T17:04:21.706 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.706 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.706 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.706 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.706 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.706 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136652 4.36 e54/17)", 2023-09-30T17:04:21.707 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.177917+0000", 2023-09-30T17:04:21.707 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.992187, 2023-09-30T17:04:21.707 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.005233695, 2023-09-30T17:04:21.707 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.707 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.707 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.707 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.708 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.708 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.177917+0000", 2023-09-30T17:04:21.708 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.708 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.708 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.708 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.709 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.177917+0000", 2023-09-30T17:04:21.709 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.709 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.709 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.709 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.709 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.177917+0000", 2023-09-30T17:04:21.710 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8299999999999998e-07 2023-09-30T17:04:21.710 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.710 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.710 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.710 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.177938+0000", 2023-09-30T17:04:21.710 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0366000000000001e-05 2023-09-30T17:04:21.711 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.711 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.711 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.711 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.177946+0000", 2023-09-30T17:04:21.711 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9330000000000001e-06 2023-09-30T17:04:21.711 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.712 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.712 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.712 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.177951+0000", 2023-09-30T17:04:21.712 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.242e-06 2023-09-30T17:04:21.712 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.712 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.713 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.713 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.713 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.713 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136537 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.713 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.652643+0000", 2023-09-30T17:04:21.713 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.51746107500000005, 2023-09-30T17:04:21.713 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.53055711900000002, 2023-09-30T17:04:21.713 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.713 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.714 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.714 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.714 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.714 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136537 2023-09-30T17:04:21.714 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.714 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.714 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.714 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.715 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.652643+0000", 2023-09-30T17:04:21.715 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.715 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.715 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.715 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.715 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.652643+0000", 2023-09-30T17:04:21.715 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.715 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.716 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.716 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.716 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.652644+0000", 2023-09-30T17:04:21.716 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1119999999999999e-06 2023-09-30T17:04:21.716 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.716 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.716 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.716 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.652663+0000", 2023-09-30T17:04:21.716 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.942e-05 2023-09-30T17:04:21.717 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.717 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.717 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.717 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.652673+0000", 2023-09-30T17:04:21.717 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3940000000000002e-06 2023-09-30T17:04:21.717 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.717 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.717 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.717 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.652680+0000", 2023-09-30T17:04:21.718 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7049999999999999e-06 2023-09-30T17:04:21.718 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.718 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.718 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.718 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.718 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.718 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136567 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.718 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.660615+0000", 2023-09-30T17:04:21.718 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.50948925099999998, 2023-09-30T17:04:21.718 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.52263824299999995, 2023-09-30T17:04:21.719 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.719 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.719 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.719 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.719 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.719 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136567 2023-09-30T17:04:21.719 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.719 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.719 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.719 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.720 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.660615+0000", 2023-09-30T17:04:21.720 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.720 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.720 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.720 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.720 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.660615+0000", 2023-09-30T17:04:21.720 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.721 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.721 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.721 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.721 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.662787+0000", 2023-09-30T17:04:21.721 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0021723440000000001 2023-09-30T17:04:21.721 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.721 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.721 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.721 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.662803+0000", 2023-09-30T17:04:21.721 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.588e-05 2023-09-30T17:04:21.722 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.722 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.722 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.722 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.662813+0000", 2023-09-30T17:04:21.722 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8190000000000003e-06 2023-09-30T17:04:21.722 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.722 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.723 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.723 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.662819+0000", 2023-09-30T17:04:21.723 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9850000000000003e-06 2023-09-30T17:04:21.723 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.723 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.723 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.723 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.724 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.724 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136755 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.724 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.740600+0000", 2023-09-30T17:04:21.724 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.42950348300000002, 2023-09-30T17:04:21.724 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.44270666400000003, 2023-09-30T17:04:21.724 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.724 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.725 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.725 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.725 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.725 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136755 2023-09-30T17:04:21.725 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.725 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.725 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.726 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.726 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.740600+0000", 2023-09-30T17:04:21.726 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.726 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.726 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.726 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.726 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.740600+0000", 2023-09-30T17:04:21.727 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.727 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.727 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.727 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.727 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.740601+0000", 2023-09-30T17:04:21.727 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2800000000000002e-07 2023-09-30T17:04:21.727 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.727 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.727 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.728 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.740618+0000", 2023-09-30T17:04:21.728 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6806000000000001e-05 2023-09-30T17:04:21.728 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.728 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.728 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.728 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.740624+0000", 2023-09-30T17:04:21.728 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4899999999999997e-06 2023-09-30T17:04:21.729 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.729 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.729 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.729 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.740630+0000", 2023-09-30T17:04:21.729 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7860000000000002e-06 2023-09-30T17:04:21.729 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.729 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.729 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.730 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.730 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.730 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136946 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.730 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.820595+0000", 2023-09-30T17:04:21.730 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.34950893799999999, 2023-09-30T17:04:21.730 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.36276512599999999, 2023-09-30T17:04:21.731 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.731 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.731 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.731 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.731 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.732 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136946 2023-09-30T17:04:21.732 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.732 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.732 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.732 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.732 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.820595+0000", 2023-09-30T17:04:21.733 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.733 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.733 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.733 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.733 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.820595+0000", 2023-09-30T17:04:21.734 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.734 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.734 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.734 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.734 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.820595+0000", 2023-09-30T17:04:21.735 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0200000000000002e-07 2023-09-30T17:04:21.735 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.735 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.735 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.735 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.820611+0000", 2023-09-30T17:04:21.735 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5982e-05 2023-09-30T17:04:21.736 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.736 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.736 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.736 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.820619+0000", 2023-09-30T17:04:21.736 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6380000000000004e-06 2023-09-30T17:04:21.737 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.737 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.737 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.737 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.820624+0000", 2023-09-30T17:04:21.737 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2290000000000002e-06 2023-09-30T17:04:21.737 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.738 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.738 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.738 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.738 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.738 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137014 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.739 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.836770+0000", 2023-09-30T17:04:21.739 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.333333622, 2023-09-30T17:04:21.739 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.34664167800000001, 2023-09-30T17:04:21.739 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.739 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.740 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.740 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.740 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.740 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137014 2023-09-30T17:04:21.740 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.740 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.741 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.741 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.741 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.836770+0000", 2023-09-30T17:04:21.741 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.741 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.742 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.742 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.742 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.836770+0000", 2023-09-30T17:04:21.742 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.742 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.743 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.743 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.743 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.836771+0000", 2023-09-30T17:04:21.743 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5000000000000003e-07 2023-09-30T17:04:21.743 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.743 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.744 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.744 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.836788+0000", 2023-09-30T17:04:21.744 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6852999999999999e-05 2023-09-30T17:04:21.744 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.745 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.745 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.836793+0000", 2023-09-30T17:04:21.745 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7910000000000001e-06 2023-09-30T17:04:21.745 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.745 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.745 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.746 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.836798+0000", 2023-09-30T17:04:21.746 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7219999999999999e-06 2023-09-30T17:04:21.746 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.746 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.746 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.747 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.747 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.747 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:135801 4.6 e54/17)", 2023-09-30T17:04:21.747 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.862721+0000", 2023-09-30T17:04:21.747 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.30738253900000001, 2023-09-30T17:04:21.748 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.32074302799999999, 2023-09-30T17:04:21.748 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.748 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.748 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.748 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.748 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.749 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.862721+0000", 2023-09-30T17:04:21.749 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.749 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.749 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.749 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.750 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.862721+0000", 2023-09-30T17:04:21.750 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.750 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.750 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.750 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.750 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.862721+0000", 2023-09-30T17:04:21.751 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5800000000000001e-07 2023-09-30T17:04:21.751 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.751 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.751 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.751 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.862738+0000", 2023-09-30T17:04:21.752 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.626e-05 2023-09-30T17:04:21.752 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.752 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.752 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.752 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.862751+0000", 2023-09-30T17:04:21.753 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3132999999999999e-05 2023-09-30T17:04:21.753 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.753 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.753 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.753 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.862756+0000", 2023-09-30T17:04:21.753 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4190000000000001e-06 2023-09-30T17:04:21.754 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.754 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.754 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.754 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.754 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.755 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137252 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.755 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.914558+0000", 2023-09-30T17:04:21.755 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.25554528500000001, 2023-09-30T17:04:21.755 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.26895833200000002, 2023-09-30T17:04:21.755 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.756 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.756 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.756 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.756 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.756 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137252 2023-09-30T17:04:21.756 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.757 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.757 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.757 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.757 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.914558+0000", 2023-09-30T17:04:21.757 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.758 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.758 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.758 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.758 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.914558+0000", 2023-09-30T17:04:21.758 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.758 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.759 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.759 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.759 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.914559+0000", 2023-09-30T17:04:21.759 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6100000000000001e-07 2023-09-30T17:04:21.759 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.759 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.760 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.760 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.914572+0000", 2023-09-30T17:04:21.760 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2965999999999999e-05 2023-09-30T17:04:21.760 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.760 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.760 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.760 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.914578+0000", 2023-09-30T17:04:21.761 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0290000000000002e-06 2023-09-30T17:04:21.761 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.761 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.761 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.761 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.914583+0000", 2023-09-30T17:04:21.761 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1800000000000004e-06 2023-09-30T17:04:21.761 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.761 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.762 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.762 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.762 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.762 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136162 4.6 e54/17)", 2023-09-30T17:04:21.762 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.011121+0000", 2023-09-30T17:04:21.762 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.15898253800000001, 2023-09-30T17:04:21.762 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.172456253, 2023-09-30T17:04:21.763 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.763 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.763 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.763 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.763 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.763 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.011121+0000", 2023-09-30T17:04:21.763 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.763 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.764 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.764 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.764 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.011121+0000", 2023-09-30T17:04:21.764 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.764 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.764 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.764 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.765 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.011122+0000", 2023-09-30T17:04:21.765 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3600000000000004e-07 2023-09-30T17:04:21.765 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.765 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.765 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.765 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.011136+0000", 2023-09-30T17:04:21.765 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3771000000000001e-05 2023-09-30T17:04:21.765 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.766 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.766 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.766 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.011147+0000", 2023-09-30T17:04:21.766 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1630999999999999e-05 2023-09-30T17:04:21.766 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.766 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.766 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.766 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.011154+0000", 2023-09-30T17:04:21.766 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4989999999999999e-06 2023-09-30T17:04:21.767 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.767 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.767 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.767 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.767 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.767 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137533 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.767 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.026700+0000", 2023-09-30T17:04:21.767 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.143403524, 2023-09-30T17:04:21.767 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.156928859, 2023-09-30T17:04:21.767 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.767 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.768 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.768 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.768 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.768 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137533 2023-09-30T17:04:21.768 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.768 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.768 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.768 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.768 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.026700+0000", 2023-09-30T17:04:21.772 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.772 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.773 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.773 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.773 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.026700+0000", 2023-09-30T17:04:21.773 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.773 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.774 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.774 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.774 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.026701+0000", 2023-09-30T17:04:21.774 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4900000000000001e-07 2023-09-30T17:04:21.774 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.774 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.774 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.774 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.026713+0000", 2023-09-30T17:04:21.774 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2700999999999999e-05 2023-09-30T17:04:21.774 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.774 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.775 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.775 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.026720+0000", 2023-09-30T17:04:21.775 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1800000000000001e-06 2023-09-30T17:04:21.775 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.775 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.775 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.775 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.026725+0000", 2023-09-30T17:04:21.775 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2669999999999997e-06 2023-09-30T17:04:21.775 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.775 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.775 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.776 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.776 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.776 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137590 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.776 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.052566+0000", 2023-09-30T17:04:21.776 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.117537472, 2023-09-30T17:04:21.776 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.13112473499999999, 2023-09-30T17:04:21.776 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.776 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.776 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.776 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.776 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.777 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137590 2023-09-30T17:04:21.777 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.777 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.777 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.777 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.777 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.052566+0000", 2023-09-30T17:04:21.777 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.777 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.777 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.777 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.777 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.052566+0000", 2023-09-30T17:04:21.777 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.778 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.778 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.778 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.778 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.054518+0000", 2023-09-30T17:04:21.778 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001951377 2023-09-30T17:04:21.778 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.778 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.778 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.778 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.054535+0000", 2023-09-30T17:04:21.778 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7586000000000001e-05 2023-09-30T17:04:21.778 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.779 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.779 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.779 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.054547+0000", 2023-09-30T17:04:21.779 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.19e-05 2023-09-30T17:04:21.779 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.779 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.779 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.779 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.054556+0000", 2023-09-30T17:04:21.779 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4740000000000005e-06 2023-09-30T17:04:21.779 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.779 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.779 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.780 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.780 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.780 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136518 4.6 e54/17)", 2023-09-30T17:04:21.780 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.137759+0000", 2023-09-30T17:04:21.780 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.032344850000000001, 2023-09-30T17:04:21.780 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045989529000000001, 2023-09-30T17:04:21.780 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.780 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.780 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.780 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.780 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.780 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.137759+0000", 2023-09-30T17:04:21.781 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.781 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.781 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.781 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.781 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.137759+0000", 2023-09-30T17:04:21.781 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.781 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.781 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.781 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.781 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.137759+0000", 2023-09-30T17:04:21.781 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8999999999999998e-07 2023-09-30T17:04:21.782 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.782 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.782 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.782 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.137777+0000", 2023-09-30T17:04:21.782 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7737999999999999e-05 2023-09-30T17:04:21.782 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.782 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.782 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.782 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.137784+0000", 2023-09-30T17:04:21.782 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7970000000000003e-06 2023-09-30T17:04:21.782 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.782 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.783 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.783 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.137789+0000", 2023-09-30T17:04:21.783 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.694e-06 2023-09-30T17:04:21.783 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.784 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.784 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.784 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.784 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.784 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:137421 4.28 e54/17 4:15eeb89b:::100000001f8.00000032:head v 54'4227, mlcod=54'4223)", 2023-09-30T17:04:21.784 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.152539+0000", 2023-09-30T17:04:21.784 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.017565252, 2023-09-30T17:04:21.784 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.031264609999999998, 2023-09-30T17:04:21.784 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.784 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:21.785 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.785 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.785 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.785 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.152539+0000", 2023-09-30T17:04:21.785 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.785 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.785 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.785 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.785 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.152539+0000", 2023-09-30T17:04:21.785 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.785 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.785 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.786 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.786 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.152539+0000", 2023-09-30T17:04:21.786 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3500000000000005e-07 2023-09-30T17:04:21.786 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.786 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.786 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.786 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.152553+0000", 2023-09-30T17:04:21.786 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3794999999999999e-05 2023-09-30T17:04:21.786 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.786 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.786 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.787 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.152562+0000", 2023-09-30T17:04:21.787 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2599999999999994e-06 2023-09-30T17:04:21.787 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.787 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.787 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.787 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.152570+0000", 2023-09-30T17:04:21.787 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.148e-06 2023-09-30T17:04:21.787 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.787 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.787 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:21.787 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.152969+0000", 2023-09-30T17:04:21.787 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00039925900000000001 2023-09-30T17:04:21.788 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.788 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.788 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:21.788 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.152990+0000", 2023-09-30T17:04:21.788 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0764999999999999e-05 2023-09-30T17:04:21.788 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.788 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.788 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.788 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.788 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.788 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136587 4.6 e54/17)", 2023-09-30T17:04:21.789 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.165919+0000", 2023-09-30T17:04:21.789 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0041851509999999998, 2023-09-30T17:04:21.789 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017944983000000001, 2023-09-30T17:04:21.789 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.789 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.789 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.789 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.789 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.790 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.165919+0000", 2023-09-30T17:04:21.790 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.790 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.790 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.790 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.790 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.165919+0000", 2023-09-30T17:04:21.790 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.790 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.790 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.791 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.791 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.165919+0000", 2023-09-30T17:04:21.791 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3499999999999995e-07 2023-09-30T17:04:21.791 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.791 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.791 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.791 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.165930+0000", 2023-09-30T17:04:21.791 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1144e-05 2023-09-30T17:04:21.791 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.791 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.791 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.792 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.165937+0000", 2023-09-30T17:04:21.792 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3899999999999998e-06 2023-09-30T17:04:21.792 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.792 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.792 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.792 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.165942+0000", 2023-09-30T17:04:21.792 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2209999999999996e-06 2023-09-30T17:04:21.792 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.792 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.792 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.792 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.792 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.793 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:137485 4.15 e54/17)", 2023-09-30T17:04:21.793 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.179552+0000", 2023-09-30T17:04:21.793 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9905519, 2023-09-30T17:04:21.793 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0043509610000000004, 2023-09-30T17:04:21.793 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.793 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.793 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.793 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.793 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.793 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.179552+0000", 2023-09-30T17:04:21.793 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.794 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.794 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.794 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.794 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.179552+0000", 2023-09-30T17:04:21.794 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.794 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.794 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.794 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.794 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.179552+0000", 2023-09-30T17:04:21.794 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1699999999999999e-07 2023-09-30T17:04:21.794 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.795 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.795 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.795 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.179563+0000", 2023-09-30T17:04:21.795 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1231e-05 2023-09-30T17:04:21.795 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.795 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.795 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.795 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.179569+0000", 2023-09-30T17:04:21.795 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7529999999999998e-06 2023-09-30T17:04:21.795 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.795 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.795 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.796 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.179574+0000", 2023-09-30T17:04:21.796 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0810000000000001e-06 2023-09-30T17:04:21.796 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.796 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.796 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.796 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.796 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.796 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136859 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.796 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.780572+0000", 2023-09-30T17:04:21.796 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.38953180100000001, 2023-09-30T17:04:21.796 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.40336013199999998, 2023-09-30T17:04:21.796 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.797 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.797 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.797 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.797 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.797 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136859 2023-09-30T17:04:21.797 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.797 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.797 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.797 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.797 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.780572+0000", 2023-09-30T17:04:21.797 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.798 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.798 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.798 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.798 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.780572+0000", 2023-09-30T17:04:21.798 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.798 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.798 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.798 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.798 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.782515+0000", 2023-09-30T17:04:21.798 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019426720000000001 2023-09-30T17:04:21.798 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.798 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.799 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.799 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.782527+0000", 2023-09-30T17:04:21.799 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2396e-05 2023-09-30T17:04:21.799 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.799 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.799 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.799 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.782538+0000", 2023-09-30T17:04:21.799 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0549e-05 2023-09-30T17:04:21.799 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.799 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.799 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.800 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.782543+0000", 2023-09-30T17:04:21.800 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6949999999999997e-06 2023-09-30T17:04:21.800 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.800 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.800 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.800 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.800 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.800 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:135798 4.36 e54/17)", 2023-09-30T17:04:21.800 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.862764+0000", 2023-09-30T17:04:21.800 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.30733964200000002, 2023-09-30T17:04:21.800 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.32119801999999997, 2023-09-30T17:04:21.801 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.801 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.801 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.801 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.801 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.801 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.862764+0000", 2023-09-30T17:04:21.801 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.801 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.801 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.801 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.801 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.862764+0000", 2023-09-30T17:04:21.801 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.802 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.802 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.802 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.802 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.862764+0000", 2023-09-30T17:04:21.802 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.41e-07 2023-09-30T17:04:21.802 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.802 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.802 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.802 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.862777+0000", 2023-09-30T17:04:21.802 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2397e-05 2023-09-30T17:04:21.802 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.803 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.803 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.803 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.862785+0000", 2023-09-30T17:04:21.803 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1699999999999997e-06 2023-09-30T17:04:21.803 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.803 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.803 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.803 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.862790+0000", 2023-09-30T17:04:21.803 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4940000000000003e-06 2023-09-30T17:04:21.803 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.803 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.804 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.804 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.804 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.804 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:135888 4.36 e54/17)", 2023-09-30T17:04:21.804 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.885663+0000", 2023-09-30T17:04:21.804 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.28444040900000001, 2023-09-30T17:04:21.804 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.29832604699999998, 2023-09-30T17:04:21.804 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.804 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.804 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.804 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.805 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.805 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.885663+0000", 2023-09-30T17:04:21.805 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.805 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.805 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.805 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.805 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.885663+0000", 2023-09-30T17:04:21.805 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.805 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.805 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.805 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.805 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.885664+0000", 2023-09-30T17:04:21.806 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8299999999999998e-07 2023-09-30T17:04:21.806 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.806 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.806 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.806 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.885675+0000", 2023-09-30T17:04:21.806 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.097e-05 2023-09-30T17:04:21.806 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.806 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.806 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.806 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.885682+0000", 2023-09-30T17:04:21.806 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9890000000000003e-06 2023-09-30T17:04:21.807 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.807 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.807 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.807 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.885688+0000", 2023-09-30T17:04:21.807 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0990000000000004e-06 2023-09-30T17:04:21.807 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.807 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.807 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.807 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.807 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.807 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137218 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.807 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.897994+0000", 2023-09-30T17:04:21.808 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.2721093, 2023-09-30T17:04:21.808 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.286021464, 2023-09-30T17:04:21.808 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.808 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.808 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.808 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.808 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.808 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137218 2023-09-30T17:04:21.808 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.808 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.808 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.809 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.809 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.897994+0000", 2023-09-30T17:04:21.809 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.809 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.809 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.809 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.809 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.897994+0000", 2023-09-30T17:04:21.809 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.809 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.809 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.809 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.809 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.897995+0000", 2023-09-30T17:04:21.810 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9500000000000003e-07 2023-09-30T17:04:21.810 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.810 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.810 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.810 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.898007+0000", 2023-09-30T17:04:21.810 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1704e-05 2023-09-30T17:04:21.810 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.810 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.810 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.810 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.898013+0000", 2023-09-30T17:04:21.810 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6370000000000002e-06 2023-09-30T17:04:21.811 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.811 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.811 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.811 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.898023+0000", 2023-09-30T17:04:21.811 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6220000000000004e-06 2023-09-30T17:04:21.811 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.811 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.811 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.811 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.811 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.811 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137591 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.811 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.054569+0000", 2023-09-30T17:04:21.812 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.115534569, 2023-09-30T17:04:21.812 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.12947766799999999, 2023-09-30T17:04:21.812 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.812 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.812 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.812 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.812 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.812 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137591 2023-09-30T17:04:21.812 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.812 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.812 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.813 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.813 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.054569+0000", 2023-09-30T17:04:21.813 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.813 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.813 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.813 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.054569+0000", 2023-09-30T17:04:21.813 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.813 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.813 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.813 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.054570+0000", 2023-09-30T17:04:21.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0900000000000001e-07 2023-09-30T17:04:21.814 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.814 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.814 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.814 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.054585+0000", 2023-09-30T17:04:21.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5305e-05 2023-09-30T17:04:21.814 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.814 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.814 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.814 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.054593+0000", 2023-09-30T17:04:21.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6860000000000006e-06 2023-09-30T17:04:21.815 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.815 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.815 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.815 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.054599+0000", 2023-09-30T17:04:21.815 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9889999999999997e-06 2023-09-30T17:04:21.815 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.815 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.815 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.815 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.815 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.815 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136594 4.2e e54/17)", 2023-09-30T17:04:21.815 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.165951+0000", 2023-09-30T17:04:21.816 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.004152279, 2023-09-30T17:04:21.816 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018124066000000001, 2023-09-30T17:04:21.816 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.816 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.816 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.816 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.816 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.816 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.165951+0000", 2023-09-30T17:04:21.816 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.816 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.816 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.817 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.817 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.165951+0000", 2023-09-30T17:04:21.817 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.817 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.817 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.817 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.817 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.165952+0000", 2023-09-30T17:04:21.817 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2600000000000001e-07 2023-09-30T17:04:21.817 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.817 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.817 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.817 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.165960+0000", 2023-09-30T17:04:21.818 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8129999999999996e-06 2023-09-30T17:04:21.818 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.818 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.818 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.818 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.165963+0000", 2023-09-30T17:04:21.818 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8410000000000002e-06 2023-09-30T17:04:21.818 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.818 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.818 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.818 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.165966+0000", 2023-09-30T17:04:21.818 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.932e-06 2023-09-30T17:04:21.818 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.819 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.819 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.819 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.819 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.819 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136670 4.6 e54/17)", 2023-09-30T17:04:21.819 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.181076+0000", 2023-09-30T17:04:21.819 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.989028, 2023-09-30T17:04:21.819 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0030259290000000001, 2023-09-30T17:04:21.819 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.819 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.819 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.821 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.821 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.821 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.181076+0000", 2023-09-30T17:04:21.821 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.821 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.821 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.821 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.821 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.181076+0000", 2023-09-30T17:04:21.821 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.821 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.822 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.822 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.822 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.181076+0000", 2023-09-30T17:04:21.822 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5400000000000001e-07 2023-09-30T17:04:21.822 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.822 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.822 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.822 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.181091+0000", 2023-09-30T17:04:21.822 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4365000000000001e-05 2023-09-30T17:04:21.822 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.823 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.823 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.823 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.181100+0000", 2023-09-30T17:04:21.823 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2399999999999996e-06 2023-09-30T17:04:21.823 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.823 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.823 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.823 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.181106+0000", 2023-09-30T17:04:21.823 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6200000000000001e-06 2023-09-30T17:04:21.823 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.823 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.823 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.824 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.824 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.824 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136433 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.824 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.607731+0000", 2023-09-30T17:04:21.824 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.56237238199999995, 2023-09-30T17:04:21.824 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.57663858800000001, 2023-09-30T17:04:21.824 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.824 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.824 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.824 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.824 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.825 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136433 2023-09-30T17:04:21.825 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.825 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.825 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.825 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.607731+0000", 2023-09-30T17:04:21.825 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.825 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.825 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.825 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.607731+0000", 2023-09-30T17:04:21.826 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.826 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.826 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.826 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.607732+0000", 2023-09-30T17:04:21.826 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9999999999999998e-07 2023-09-30T17:04:21.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.826 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.826 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.826 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.607745+0000", 2023-09-30T17:04:21.826 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2635e-05 2023-09-30T17:04:21.827 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.827 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.827 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.827 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.607751+0000", 2023-09-30T17:04:21.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2099999999999998e-06 2023-09-30T17:04:21.827 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.827 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.827 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.827 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.607756+0000", 2023-09-30T17:04:21.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5439999999999998e-06 2023-09-30T17:04:21.827 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.828 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.828 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.828 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.828 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.828 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136061 4.6 e54/17)", 2023-09-30T17:04:21.828 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.971206+0000", 2023-09-30T17:04:21.828 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.19889790700000001, 2023-09-30T17:04:21.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.213193719, 2023-09-30T17:04:21.828 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.828 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.828 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.828 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.829 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.829 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.971206+0000", 2023-09-30T17:04:21.829 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.829 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.829 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.829 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.971206+0000", 2023-09-30T17:04:21.829 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.829 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.829 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.830 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.971206+0000", 2023-09-30T17:04:21.830 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2799999999999996e-07 2023-09-30T17:04:21.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.830 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.830 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.830 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.971222+0000", 2023-09-30T17:04:21.830 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5804999999999999e-05 2023-09-30T17:04:21.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.830 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.830 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.831 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.971230+0000", 2023-09-30T17:04:21.831 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1850000000000004e-06 2023-09-30T17:04:21.831 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.831 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.831 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.831 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.971236+0000", 2023-09-30T17:04:21.831 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9000000000000003e-06 2023-09-30T17:04:21.831 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.831 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.831 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.831 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.831 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.832 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136136 4.6 e54/17)", 2023-09-30T17:04:21.832 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.997675+0000", 2023-09-30T17:04:21.832 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.172428952, 2023-09-30T17:04:21.832 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.18675127699999999, 2023-09-30T17:04:21.832 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.832 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.832 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.832 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.832 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.832 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.997675+0000", 2023-09-30T17:04:21.832 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.833 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.833 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.833 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.833 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.997675+0000", 2023-09-30T17:04:21.833 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.833 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.833 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.833 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.833 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.997675+0000", 2023-09-30T17:04:21.833 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.51e-07 2023-09-30T17:04:21.833 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.834 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.834 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.834 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.997690+0000", 2023-09-30T17:04:21.834 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4725e-05 2023-09-30T17:04:21.834 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.834 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.834 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.834 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.997698+0000", 2023-09-30T17:04:21.834 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3450000000000006e-06 2023-09-30T17:04:21.834 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.834 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.835 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.835 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.997705+0000", 2023-09-30T17:04:21.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5860000000000001e-06 2023-09-30T17:04:21.835 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.835 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.835 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.835 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.835 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.835 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136261 4.36 e54/17)", 2023-09-30T17:04:21.835 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.040054+0000", 2023-09-30T17:04:21.835 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.130049889, 2023-09-30T17:04:21.836 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.14439749800000001, 2023-09-30T17:04:21.836 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.836 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.836 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.836 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.836 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.836 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.040054+0000", 2023-09-30T17:04:21.836 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.836 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.836 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.836 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.836 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.040054+0000", 2023-09-30T17:04:21.837 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.837 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.837 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.837 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.837 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.040054+0000", 2023-09-30T17:04:21.837 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3099999999999999e-07 2023-09-30T17:04:21.837 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.837 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.837 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.837 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.040066+0000", 2023-09-30T17:04:21.837 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1939999999999999e-05 2023-09-30T17:04:21.838 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.838 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.838 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.838 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.040072+0000", 2023-09-30T17:04:21.838 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5890000000000002e-06 2023-09-30T17:04:21.838 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.838 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.838 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.838 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.040076+0000", 2023-09-30T17:04:21.838 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4170000000000002e-06 2023-09-30T17:04:21.838 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.839 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.839 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.839 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.839 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.839 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137647 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.839 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.088651+0000", 2023-09-30T17:04:21.839 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.081452478999999994, 2023-09-30T17:04:21.839 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.095826766999999993, 2023-09-30T17:04:21.839 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.839 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.839 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.840 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.840 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.840 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137647 2023-09-30T17:04:21.840 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.840 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.840 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.840 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.840 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.088651+0000", 2023-09-30T17:04:21.840 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.840 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.840 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.840 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.841 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.088651+0000", 2023-09-30T17:04:21.841 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.841 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.841 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.841 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.841 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.088652+0000", 2023-09-30T17:04:21.841 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.75e-07 2023-09-30T17:04:21.841 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.841 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.841 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.841 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.088667+0000", 2023-09-30T17:04:21.842 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4790000000000001e-05 2023-09-30T17:04:21.842 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.842 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.842 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.842 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.088673+0000", 2023-09-30T17:04:21.842 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4740000000000002e-06 2023-09-30T17:04:21.842 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.842 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.842 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.842 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.088678+0000", 2023-09-30T17:04:21.842 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3700000000000003e-06 2023-09-30T17:04:21.843 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.843 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.843 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.843 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.843 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.843 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137791 4.c 4:33b8095f:::100000001f8.0000003a:head [write 3399680~4096 in=4096b,write 3461120~4096 in=4096b,write 3510272~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.843 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.152638+0000", 2023-09-30T17:04:21.843 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.017465943000000001, 2023-09-30T17:04:21.843 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.031885471999999998, 2023-09-30T17:04:21.843 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.843 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:21.843 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.844 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.844 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.844 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137791 2023-09-30T17:04:21.844 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.844 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.844 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.844 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.844 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.152638+0000", 2023-09-30T17:04:21.844 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.844 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.844 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.845 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.845 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.152638+0000", 2023-09-30T17:04:21.845 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.845 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.845 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.845 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.845 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.152638+0000", 2023-09-30T17:04:21.845 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5600000000000001e-07 2023-09-30T17:04:21.845 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.845 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.845 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.846 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.152650+0000", 2023-09-30T17:04:21.846 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1253000000000001e-05 2023-09-30T17:04:21.846 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.846 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.846 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.846 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.152656+0000", 2023-09-30T17:04:21.846 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9850000000000003e-06 2023-09-30T17:04:21.846 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.846 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.846 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.846 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.152660+0000", 2023-09-30T17:04:21.847 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5589999999999999e-06 2023-09-30T17:04:21.847 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.847 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.847 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:21.847 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.159644+0000", 2023-09-30T17:04:21.847 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.006983703 2023-09-30T17:04:21.847 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.847 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.847 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:21.847 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.159713+0000", 2023-09-30T17:04:21.847 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9288999999999993e-05 2023-09-30T17:04:21.848 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.848 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.848 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.848 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.848 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.848 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137823 4.2d 4:b4aa06e9:::100000001f8.0000001d:head [write 4042752~4096 in=4096b,write 4067328~4096 in=4096b,write 4149248~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.848 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.163679+0000", 2023-09-30T17:04:21.848 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0064252190000000002, 2023-09-30T17:04:21.848 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020934211000000001, 2023-09-30T17:04:21.848 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.848 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:21.849 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.849 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.849 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.849 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137823 2023-09-30T17:04:21.849 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.849 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.849 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.849 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.849 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.163679+0000", 2023-09-30T17:04:21.849 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.849 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.850 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.850 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.850 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.163679+0000", 2023-09-30T17:04:21.850 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.850 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.850 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.850 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.850 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.165974+0000", 2023-09-30T17:04:21.850 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022951970000000001 2023-09-30T17:04:21.850 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.850 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.850 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.851 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.165983+0000", 2023-09-30T17:04:21.851 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.414e-06 2023-09-30T17:04:21.851 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.851 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.851 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.851 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.165988+0000", 2023-09-30T17:04:21.851 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0549999999999999e-06 2023-09-30T17:04:21.851 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.851 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.851 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.851 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.165992+0000", 2023-09-30T17:04:21.852 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7239999999999998e-06 2023-09-30T17:04:21.852 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.852 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.852 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:21.852 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.171183+0000", 2023-09-30T17:04:21.852 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0051910480000000002 2023-09-30T17:04:21.852 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.852 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.852 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:21.852 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.171260+0000", 2023-09-30T17:04:21.852 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7387999999999998e-05 2023-09-30T17:04:21.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.853 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.853 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:21.853 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.171416+0000", 2023-09-30T17:04:21.853 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015599900000000001 2023-09-30T17:04:21.853 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.853 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.853 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.853 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.853 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:137488 4.3f e54/17 4:fde182c5:::100000001f8.00000039:head v 54'2083, mlcod=54'2079)", 2023-09-30T17:04:21.853 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.181483+0000", 2023-09-30T17:04:21.854 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9886212, 2023-09-30T17:04:21.854 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0032162789999999998, 2023-09-30T17:04:21.854 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.854 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:21.854 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.854 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.854 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.854 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.181483+0000", 2023-09-30T17:04:21.854 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.854 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.854 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.854 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.855 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.181483+0000", 2023-09-30T17:04:21.855 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.855 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.855 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.855 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.855 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.181483+0000", 2023-09-30T17:04:21.855 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8500000000000002e-07 2023-09-30T17:04:21.855 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.855 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.855 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.855 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.181494+0000", 2023-09-30T17:04:21.856 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0665999999999999e-05 2023-09-30T17:04:21.856 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.856 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.856 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.856 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.181501+0000", 2023-09-30T17:04:21.856 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1239999999999999e-06 2023-09-30T17:04:21.856 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.856 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.856 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.856 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.181506+0000", 2023-09-30T17:04:21.856 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0030000000000002e-06 2023-09-30T17:04:21.857 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.857 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:21.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.182391+0000", 2023-09-30T17:04:21.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00088564899999999996 2023-09-30T17:04:21.857 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.857 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:21.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.182409+0000", 2023-09-30T17:04:21.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7918999999999999e-05 2023-09-30T17:04:21.857 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.858 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.858 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.858 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.858 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.858 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136407 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.858 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.590376+0000", 2023-09-30T17:04:21.858 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.57972789899999999, 2023-09-30T17:04:21.858 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.59440092, 2023-09-30T17:04:21.858 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.858 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.858 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.859 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.859 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.859 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136407 2023-09-30T17:04:21.859 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.859 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.859 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.859 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.859 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.590376+0000", 2023-09-30T17:04:21.859 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.859 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.859 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.860 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.860 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.590376+0000", 2023-09-30T17:04:21.860 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.860 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.860 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.860 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.860 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.591637+0000", 2023-09-30T17:04:21.860 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001261056 2023-09-30T17:04:21.860 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.860 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.860 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.861 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.591649+0000", 2023-09-30T17:04:21.861 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1612e-05 2023-09-30T17:04:21.861 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.861 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.861 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.861 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.591656+0000", 2023-09-30T17:04:21.861 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4309999999999997e-06 2023-09-30T17:04:21.861 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.861 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.861 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.861 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.591661+0000", 2023-09-30T17:04:21.861 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3480000000000003e-06 2023-09-30T17:04:21.862 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.862 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.862 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.862 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.862 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.862 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136863 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.862 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.782583+0000", 2023-09-30T17:04:21.862 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.38752028599999999, 2023-09-30T17:04:21.862 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.40226089900000001, 2023-09-30T17:04:21.862 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.863 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.863 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.863 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.863 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.863 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136863 2023-09-30T17:04:21.863 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.863 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.863 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.863 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.863 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.782583+0000", 2023-09-30T17:04:21.864 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.864 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.864 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.864 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.782583+0000", 2023-09-30T17:04:21.864 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.864 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.864 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.864 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.782584+0000", 2023-09-30T17:04:21.864 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.72e-07 2023-09-30T17:04:21.865 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.865 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.865 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.865 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.782593+0000", 2023-09-30T17:04:21.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8319999999999995e-06 2023-09-30T17:04:21.865 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.865 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.865 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.865 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.782598+0000", 2023-09-30T17:04:21.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0730000000000004e-06 2023-09-30T17:04:21.865 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.866 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.866 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.866 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.782601+0000", 2023-09-30T17:04:21.866 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9900000000000002e-06 2023-09-30T17:04:21.866 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.866 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.866 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.866 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.866 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.866 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:135763 4.6 e54/17)", 2023-09-30T17:04:21.866 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.851405+0000", 2023-09-30T17:04:21.867 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.31869830199999999, 2023-09-30T17:04:21.867 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.33350016399999999, 2023-09-30T17:04:21.867 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.867 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.867 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.867 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.867 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.867 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.851405+0000", 2023-09-30T17:04:21.867 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.867 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.867 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.868 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.851405+0000", 2023-09-30T17:04:21.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.868 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.868 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.851406+0000", 2023-09-30T17:04:21.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8100000000000003e-07 2023-09-30T17:04:21.868 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.851417+0000", 2023-09-30T17:04:21.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1413999999999999e-05 2023-09-30T17:04:21.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.869 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.851424+0000", 2023-09-30T17:04:21.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5429999999999999e-06 2023-09-30T17:04:21.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.869 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.851429+0000", 2023-09-30T17:04:21.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5669999999999996e-06 2023-09-30T17:04:21.870 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.870 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.870 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.870 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.870 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:135906 4.6 e54/17)", 2023-09-30T17:04:21.870 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.898165+0000", 2023-09-30T17:04:21.870 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.27193838599999998, 2023-09-30T17:04:21.870 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.28679302200000001, 2023-09-30T17:04:21.870 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.870 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.871 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.871 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.871 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.871 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.898165+0000", 2023-09-30T17:04:21.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.871 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.871 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.871 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.871 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.898165+0000", 2023-09-30T17:04:21.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.871 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.871 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.872 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.898166+0000", 2023-09-30T17:04:21.872 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9100000000000003e-07 2023-09-30T17:04:21.872 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.872 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.898182+0000", 2023-09-30T17:04:21.872 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6303e-05 2023-09-30T17:04:21.872 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.873 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.898190+0000", 2023-09-30T17:04:21.873 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8150000000000006e-06 2023-09-30T17:04:21.873 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.873 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.873 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.873 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.898196+0000", 2023-09-30T17:04:21.873 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.998e-06 2023-09-30T17:04:21.873 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.873 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.873 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.873 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.874 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.874 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:135951 4.36 e54/17)", 2023-09-30T17:04:21.874 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.917723+0000", 2023-09-30T17:04:21.874 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.25238037099999999, 2023-09-30T17:04:21.874 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.26728415, 2023-09-30T17:04:21.874 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.874 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.874 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.874 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.874 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.874 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.917723+0000", 2023-09-30T17:04:21.875 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.875 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.875 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.875 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.875 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.917723+0000", 2023-09-30T17:04:21.875 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.875 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.875 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.875 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.875 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.917724+0000", 2023-09-30T17:04:21.875 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4499999999999998e-07 2023-09-30T17:04:21.876 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.876 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.876 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.876 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.917742+0000", 2023-09-30T17:04:21.876 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8447000000000001e-05 2023-09-30T17:04:21.876 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.876 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.876 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.876 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.917750+0000", 2023-09-30T17:04:21.876 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8429999999999993e-06 2023-09-30T17:04:21.876 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.877 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.877 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.877 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.917756+0000", 2023-09-30T17:04:21.877 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5269999999999998e-06 2023-09-30T17:04:21.877 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.877 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.877 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.877 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.877 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.877 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136215 4.36 e54/17)", 2023-09-30T17:04:21.877 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.030734+0000", 2023-09-30T17:04:21.877 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.13937014, 2023-09-30T17:04:21.878 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.154325715, 2023-09-30T17:04:21.878 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.878 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.878 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.878 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.878 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.878 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.030734+0000", 2023-09-30T17:04:21.878 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.878 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.878 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.878 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.879 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.030734+0000", 2023-09-30T17:04:21.879 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.879 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.879 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.879 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.879 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.030734+0000", 2023-09-30T17:04:21.879 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5899999999999998e-07 2023-09-30T17:04:21.879 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.879 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.879 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.879 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.030748+0000", 2023-09-30T17:04:21.880 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3807e-05 2023-09-30T17:04:21.880 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.880 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.880 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.880 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.030754+0000", 2023-09-30T17:04:21.880 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5100000000000004e-06 2023-09-30T17:04:21.880 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.880 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.880 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.880 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.030759+0000", 2023-09-30T17:04:21.880 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9309999999999999e-06 2023-09-30T17:04:21.881 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.881 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.881 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.881 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.881 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.881 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137594 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.881 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.054647+0000", 2023-09-30T17:04:21.881 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.115456826, 2023-09-30T17:04:21.881 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.13046548799999999, 2023-09-30T17:04:21.881 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.881 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.882 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.882 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.882 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.882 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137594 2023-09-30T17:04:21.882 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.882 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.882 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.882 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.882 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.054647+0000", 2023-09-30T17:04:21.882 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.882 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.883 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.883 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.883 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.054647+0000", 2023-09-30T17:04:21.883 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.883 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.883 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.883 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.883 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.054648+0000", 2023-09-30T17:04:21.883 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1900000000000002e-07 2023-09-30T17:04:21.883 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.883 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.884 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.884 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.054661+0000", 2023-09-30T17:04:21.884 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3210999999999999e-05 2023-09-30T17:04:21.884 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.884 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.884 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.884 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.054668+0000", 2023-09-30T17:04:21.884 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4000000000000003e-06 2023-09-30T17:04:21.884 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.884 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.884 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.884 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.054674+0000", 2023-09-30T17:04:21.885 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4190000000000001e-06 2023-09-30T17:04:21.885 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.885 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.885 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.885 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.885 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.885 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137648 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.885 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.088687+0000", 2023-09-30T17:04:21.885 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.081416794000000001, 2023-09-30T17:04:21.885 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.096487398000000002, 2023-09-30T17:04:21.885 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.886 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.886 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.886 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.886 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.886 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137648 2023-09-30T17:04:21.886 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.886 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.886 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.886 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.886 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.088687+0000", 2023-09-30T17:04:21.887 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.887 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.887 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.887 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.887 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.088687+0000", 2023-09-30T17:04:21.887 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.887 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.887 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.887 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.887 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.088687+0000", 2023-09-30T17:04:21.887 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5999999999999999e-07 2023-09-30T17:04:21.887 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.888 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.888 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.888 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.088701+0000", 2023-09-30T17:04:21.888 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3124e-05 2023-09-30T17:04:21.888 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.888 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.888 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.888 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.088707+0000", 2023-09-30T17:04:21.888 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3419999999999996e-06 2023-09-30T17:04:21.888 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.888 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.889 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.889 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.088712+0000", 2023-09-30T17:04:21.889 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3419999999999998e-06 2023-09-30T17:04:21.889 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.889 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.889 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.889 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.889 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.889 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137792 4.2d 4:b4aa06e9:::100000001f8.0000001d:head [write 3158016~4096 in=4096b,write 3350528~4096 in=4096b,write 3452928~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.889 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.152666+0000", 2023-09-30T17:04:21.889 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.017437265, 2023-09-30T17:04:21.890 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.032579729000000002, 2023-09-30T17:04:21.890 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.890 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:21.890 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.890 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.890 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.890 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137792 2023-09-30T17:04:21.890 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.890 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.890 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.890 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.891 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.152666+0000", 2023-09-30T17:04:21.891 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.891 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.891 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.926 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.926 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.152666+0000", 2023-09-30T17:04:21.927 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.927 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.927 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.927 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.927 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.152667+0000", 2023-09-30T17:04:21.927 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8700000000000001e-07 2023-09-30T17:04:21.927 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.927 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.927 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.927 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.152679+0000", 2023-09-30T17:04:21.927 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2119e-05 2023-09-30T17:04:21.928 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.928 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.928 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.928 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.152685+0000", 2023-09-30T17:04:21.928 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8649999999999998e-06 2023-09-30T17:04:21.928 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.928 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.928 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.928 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.152689+0000", 2023-09-30T17:04:21.928 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4909999999999999e-06 2023-09-30T17:04:21.928 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.929 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.929 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:21.929 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.154259+0000", 2023-09-30T17:04:21.929 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001569616 2023-09-30T17:04:21.929 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.929 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.929 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:21.929 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.154334+0000", 2023-09-30T17:04:21.929 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4779999999999999e-05 2023-09-30T17:04:21.929 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.929 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.930 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:21.930 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.154476+0000", 2023-09-30T17:04:21.930 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014259799999999999 2023-09-30T17:04:21.930 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.930 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.930 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:21.930 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.163457+0000", 2023-09-30T17:04:21.930 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0089806780000000006 2023-09-30T17:04:21.931 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.931 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.931 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.931 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.931 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.931 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137824 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.931 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.166001+0000", 2023-09-30T17:04:21.931 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0041025380000000002, 2023-09-30T17:04:21.931 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019326702000000001, 2023-09-30T17:04:21.931 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.931 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.932 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.932 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.932 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.932 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137824 2023-09-30T17:04:21.932 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.932 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.933 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.933 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.933 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.166001+0000", 2023-09-30T17:04:21.933 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.933 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.933 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.933 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.933 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.166001+0000", 2023-09-30T17:04:21.933 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.933 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.933 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.934 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.934 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.166002+0000", 2023-09-30T17:04:21.934 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.91e-07 2023-09-30T17:04:21.934 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.934 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.934 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.934 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.166017+0000", 2023-09-30T17:04:21.934 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4995e-05 2023-09-30T17:04:21.934 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.934 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.934 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.935 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.166020+0000", 2023-09-30T17:04:21.935 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9299999999999996e-06 2023-09-30T17:04:21.935 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.935 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.935 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.935 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.166024+0000", 2023-09-30T17:04:21.935 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1690000000000001e-06 2023-09-30T17:04:21.935 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.935 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.935 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.935 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.936 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.936 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137854 4.30 4.88c79130 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.936 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.174325+0000", 2023-09-30T17:04:21.936 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.995779, 2023-09-30T17:04:21.936 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011059459000000001, 2023-09-30T17:04:21.936 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.936 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.936 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.936 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.936 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.936 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137854 2023-09-30T17:04:21.937 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.937 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.937 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.937 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.937 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.174325+0000", 2023-09-30T17:04:21.937 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.937 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.937 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.937 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.937 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.174325+0000", 2023-09-30T17:04:21.937 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.937 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.938 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.938 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.938 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.181522+0000", 2023-09-30T17:04:21.938 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071973519999999997 2023-09-30T17:04:21.938 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.938 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.938 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.938 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.181539+0000", 2023-09-30T17:04:21.938 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6701000000000002e-05 2023-09-30T17:04:21.938 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.938 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.939 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.939 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.181546+0000", 2023-09-30T17:04:21.939 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6899999999999992e-06 2023-09-30T17:04:21.939 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.939 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.939 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.939 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.181552+0000", 2023-09-30T17:04:21.939 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6119999999999998e-06 2023-09-30T17:04:21.939 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.939 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.939 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.940 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.940 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.940 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136608 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.940 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.679568+0000", 2023-09-30T17:04:21.940 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.49053555599999998, 2023-09-30T17:04:21.940 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.50587501400000001, 2023-09-30T17:04:21.940 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.940 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.940 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.940 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.940 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.941 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136608 2023-09-30T17:04:21.941 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.941 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.941 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.941 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.941 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.679568+0000", 2023-09-30T17:04:21.941 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.941 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.941 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.941 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.941 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.679568+0000", 2023-09-30T17:04:21.942 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.942 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.942 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.942 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.942 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.679569+0000", 2023-09-30T17:04:21.942 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8599999999999998e-07 2023-09-30T17:04:21.942 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.942 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.942 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.942 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.679586+0000", 2023-09-30T17:04:21.942 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7578999999999999e-05 2023-09-30T17:04:21.942 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.943 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.943 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.943 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.679593+0000", 2023-09-30T17:04:21.943 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7379999999999997e-06 2023-09-30T17:04:21.943 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.943 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.943 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.943 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.679598+0000", 2023-09-30T17:04:21.943 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3040000000000004e-06 2023-09-30T17:04:21.943 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.943 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.944 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.944 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.944 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.944 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136719 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.944 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.729554+0000", 2023-09-30T17:04:21.944 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.44054985099999999, 2023-09-30T17:04:21.944 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.45594586199999998, 2023-09-30T17:04:21.944 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.944 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.944 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.944 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.945 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.945 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136719 2023-09-30T17:04:21.945 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.945 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.945 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.945 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.945 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.729554+0000", 2023-09-30T17:04:21.945 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.945 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.945 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.945 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.945 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.729554+0000", 2023-09-30T17:04:21.946 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.946 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.946 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.946 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.946 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.729554+0000", 2023-09-30T17:04:21.946 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1200000000000003e-07 2023-09-30T17:04:21.946 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.946 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.946 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.946 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.729575+0000", 2023-09-30T17:04:21.946 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0183999999999999e-05 2023-09-30T17:04:21.947 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.947 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.947 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.947 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.729581+0000", 2023-09-30T17:04:21.947 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8310000000000003e-06 2023-09-30T17:04:21.947 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.947 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.947 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.947 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.729586+0000", 2023-09-30T17:04:21.947 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3680000000000004e-06 2023-09-30T17:04:21.948 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.948 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.948 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.948 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.948 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.948 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136826 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.948 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.768828+0000", 2023-09-30T17:04:21.948 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.40127614299999997, 2023-09-30T17:04:21.948 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.41674690199999997, 2023-09-30T17:04:21.948 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.948 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.949 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.949 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.949 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.949 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136826 2023-09-30T17:04:21.949 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.949 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.949 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.949 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.949 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.768828+0000", 2023-09-30T17:04:21.949 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.949 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.949 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.950 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.950 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.768828+0000", 2023-09-30T17:04:21.950 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.950 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.950 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.950 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.950 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.768828+0000", 2023-09-30T17:04:21.950 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8599999999999998e-07 2023-09-30T17:04:21.950 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.950 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.950 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.951 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.768843+0000", 2023-09-30T17:04:21.951 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5367999999999999e-05 2023-09-30T17:04:21.951 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.951 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.951 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.951 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.768852+0000", 2023-09-30T17:04:21.951 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2910000000000007e-06 2023-09-30T17:04:21.951 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.951 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.951 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.951 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.768858+0000", 2023-09-30T17:04:21.952 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8189999999999997e-06 2023-09-30T17:04:21.952 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.952 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.952 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.952 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.952 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.952 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136920 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.952 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.808948+0000", 2023-09-30T17:04:21.952 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.36115591800000002, 2023-09-30T17:04:21.952 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.37668275400000001, 2023-09-30T17:04:21.952 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.953 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.953 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.953 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.953 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.953 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136920 2023-09-30T17:04:21.953 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.953 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.953 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.953 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.953 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.808948+0000", 2023-09-30T17:04:21.953 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.953 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.954 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.954 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.954 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.808948+0000", 2023-09-30T17:04:21.954 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.954 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.954 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.954 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.954 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.808948+0000", 2023-09-30T17:04:21.955 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5100000000000001e-07 2023-09-30T17:04:21.955 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.955 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.955 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.955 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.808957+0000", 2023-09-30T17:04:21.955 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5450000000000003e-06 2023-09-30T17:04:21.955 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.955 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.955 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.955 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.808962+0000", 2023-09-30T17:04:21.955 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4229999999999996e-06 2023-09-30T17:04:21.956 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.956 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.956 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.956 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.808965+0000", 2023-09-30T17:04:21.956 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0070000000000002e-06 2023-09-30T17:04:21.956 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.956 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.956 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.956 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.956 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.956 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:135758 4.36 e54/17 4:6c9c34b1:::100000001f8.00000010:head v 54'6430, mlcod=54'6383)", 2023-09-30T17:04:21.957 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.851438+0000", 2023-09-30T17:04:21.957 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.318665902, 2023-09-30T17:04:21.957 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.33425185499999999, 2023-09-30T17:04:21.957 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.957 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:21.957 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.957 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.957 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.957 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.851438+0000", 2023-09-30T17:04:21.957 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.957 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.958 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.958 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.958 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.851438+0000", 2023-09-30T17:04:21.958 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.958 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.958 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.958 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.958 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.851438+0000", 2023-09-30T17:04:21.958 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2399999999999999e-07 2023-09-30T17:04:21.958 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.958 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.959 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.959 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.851446+0000", 2023-09-30T17:04:21.959 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.337e-06 2023-09-30T17:04:21.959 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.959 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.959 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.959 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.851455+0000", 2023-09-30T17:04:21.959 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5730000000000008e-06 2023-09-30T17:04:21.959 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.959 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.959 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.960 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.851459+0000", 2023-09-30T17:04:21.960 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0119999999999999e-06 2023-09-30T17:04:21.960 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.960 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.960 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:21.960 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.180899+0000", 2023-09-30T17:04:21.960 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.32944035900000002 2023-09-30T17:04:21.960 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.960 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.960 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:21.960 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.180916+0000", 2023-09-30T17:04:21.961 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6833e-05 2023-09-30T17:04:21.961 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.961 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.961 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.961 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.961 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.961 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:135959 4.6 e54/17)", 2023-09-30T17:04:21.961 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.917766+0000", 2023-09-30T17:04:21.961 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.25233809800000001, 2023-09-30T17:04:21.961 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.267984322, 2023-09-30T17:04:21.961 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.961 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.962 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.962 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.962 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.962 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.917766+0000", 2023-09-30T17:04:21.962 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.962 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.962 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.962 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.962 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.917766+0000", 2023-09-30T17:04:21.962 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.962 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.963 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.963 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.963 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.917766+0000", 2023-09-30T17:04:21.963 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8999999999999998e-07 2023-09-30T17:04:21.963 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.963 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.963 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.963 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.917777+0000", 2023-09-30T17:04:21.963 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0930999999999999e-05 2023-09-30T17:04:21.963 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.963 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.963 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.964 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.917784+0000", 2023-09-30T17:04:21.964 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1890000000000001e-06 2023-09-30T17:04:21.964 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.964 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.964 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.964 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.917789+0000", 2023-09-30T17:04:21.964 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8400000000000002e-06 2023-09-30T17:04:21.964 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.964 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.964 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.964 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.964 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.965 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137332 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.965 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.938596+0000", 2023-09-30T17:04:21.965 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.231508253, 2023-09-30T17:04:21.965 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.24721638800000001, 2023-09-30T17:04:21.965 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.965 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.965 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.965 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.965 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.965 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137332 2023-09-30T17:04:21.965 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.966 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.966 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.966 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.966 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.938596+0000", 2023-09-30T17:04:21.966 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.966 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.966 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.966 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.966 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.938596+0000", 2023-09-30T17:04:21.966 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.966 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.967 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.967 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.967 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.938596+0000", 2023-09-30T17:04:21.967 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3000000000000001e-07 2023-09-30T17:04:21.967 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.967 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.967 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.967 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.938610+0000", 2023-09-30T17:04:21.967 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3923999999999999e-05 2023-09-30T17:04:21.967 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.967 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.967 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.968 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.938616+0000", 2023-09-30T17:04:21.968 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1959999999999996e-06 2023-09-30T17:04:21.968 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.968 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.968 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.968 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.938621+0000", 2023-09-30T17:04:21.968 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7770000000000002e-06 2023-09-30T17:04:21.968 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.968 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.968 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.968 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.969 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.969 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137553 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.969 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.036573+0000", 2023-09-30T17:04:21.969 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.133530551, 2023-09-30T17:04:21.969 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.149300509, 2023-09-30T17:04:21.969 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.969 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.969 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.969 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.969 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.969 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137553 2023-09-30T17:04:21.970 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.970 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.970 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.970 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.970 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.036573+0000", 2023-09-30T17:04:21.970 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.970 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.970 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.970 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.970 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.036573+0000", 2023-09-30T17:04:21.970 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.971 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.971 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.971 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.971 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.040519+0000", 2023-09-30T17:04:21.971 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003945619 2023-09-30T17:04:21.971 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.971 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.971 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.971 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.040535+0000", 2023-09-30T17:04:21.971 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5837000000000001e-05 2023-09-30T17:04:21.971 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.971 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.972 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.972 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.040547+0000", 2023-09-30T17:04:21.972 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1884e-05 2023-09-30T17:04:21.972 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.972 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.972 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.972 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.040554+0000", 2023-09-30T17:04:21.972 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2300000000000002e-06 2023-09-30T17:04:21.972 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.973 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.973 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.973 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.973 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.973 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136353 4.6 e54/17)", 2023-09-30T17:04:21.973 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.069130+0000", 2023-09-30T17:04:21.973 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.100973806, 2023-09-30T17:04:21.973 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.11679819299999999, 2023-09-30T17:04:21.973 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.973 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.973 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.973 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.974 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.974 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.069130+0000", 2023-09-30T17:04:21.974 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.974 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.974 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.974 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.974 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.069130+0000", 2023-09-30T17:04:21.974 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.974 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.974 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.975 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.975 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.069130+0000", 2023-09-30T17:04:21.975 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8999999999999997e-07 2023-09-30T17:04:21.975 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.975 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.975 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.975 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.069150+0000", 2023-09-30T17:04:21.975 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9279999999999998e-05 2023-09-30T17:04:21.975 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.975 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.975 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.975 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.069158+0000", 2023-09-30T17:04:21.976 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0690000000000002e-06 2023-09-30T17:04:21.976 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.976 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.976 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.976 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.069164+0000", 2023-09-30T17:04:21.976 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4219999999999997e-06 2023-09-30T17:04:21.976 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.976 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.976 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.976 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.976 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.977 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137706 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.977 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.110746+0000", 2023-09-30T17:04:21.977 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.059357498000000002, 2023-09-30T17:04:21.977 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.075231333999999997, 2023-09-30T17:04:21.977 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.977 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.977 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.977 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.977 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.977 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137706 2023-09-30T17:04:21.977 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.978 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.978 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.978 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.978 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.110746+0000", 2023-09-30T17:04:21.978 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.978 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.978 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.978 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.978 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.110746+0000", 2023-09-30T17:04:21.978 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.978 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.979 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.979 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.979 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.110747+0000", 2023-09-30T17:04:21.979 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3300000000000003e-07 2023-09-30T17:04:21.979 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.979 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.979 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.979 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.110758+0000", 2023-09-30T17:04:21.979 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1201e-05 2023-09-30T17:04:21.979 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.979 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.979 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.980 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.110766+0000", 2023-09-30T17:04:21.980 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6650000000000003e-06 2023-09-30T17:04:21.980 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.980 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.980 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.980 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.110772+0000", 2023-09-30T17:04:21.980 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.472e-06 2023-09-30T17:04:21.980 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.980 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.980 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.980 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.981 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.981 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137765 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.981 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.134810+0000", 2023-09-30T17:04:21.981 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.035293573000000002, 2023-09-30T17:04:21.981 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051223520000000002, 2023-09-30T17:04:21.981 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.981 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.981 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.981 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.981 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.981 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137765 2023-09-30T17:04:21.982 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.982 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.982 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.982 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.982 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.134810+0000", 2023-09-30T17:04:21.982 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.982 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.982 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.982 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.982 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.134810+0000", 2023-09-30T17:04:21.982 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.983 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.983 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.983 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.983 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.138519+0000", 2023-09-30T17:04:21.983 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0037088300000000002 2023-09-30T17:04:21.983 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.983 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.983 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.983 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.138538+0000", 2023-09-30T17:04:21.983 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8759000000000001e-05 2023-09-30T17:04:21.983 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.984 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.984 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.984 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.138548+0000", 2023-09-30T17:04:21.984 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0397999999999999e-05 2023-09-30T17:04:21.984 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.984 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.984 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.984 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.138555+0000", 2023-09-30T17:04:21.984 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0790000000000003e-06 2023-09-30T17:04:21.984 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.984 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.984 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.985 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.985 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.985 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137793 4.38 4.e1fdc8b8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.985 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.154229+0000", 2023-09-30T17:04:21.985 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.015875025000000001, 2023-09-30T17:04:21.985 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.031861637999999998, 2023-09-30T17:04:21.985 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.985 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.985 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.985 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.985 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.986 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137793 2023-09-30T17:04:21.986 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.986 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.986 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.986 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.986 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.154229+0000", 2023-09-30T17:04:21.986 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.986 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.986 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.986 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.986 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.154229+0000", 2023-09-30T17:04:21.986 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.987 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.987 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.987 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.987 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.154230+0000", 2023-09-30T17:04:21.987 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7600000000000006e-07 2023-09-30T17:04:21.987 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.987 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.987 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.987 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.154254+0000", 2023-09-30T17:04:21.987 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4791e-05 2023-09-30T17:04:21.987 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.988 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.988 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.154269+0000", 2023-09-30T17:04:21.988 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4345000000000001e-05 2023-09-30T17:04:21.988 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.988 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.988 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.154278+0000", 2023-09-30T17:04:21.988 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1279999999999997e-06 2023-09-30T17:04:21.988 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.988 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.988 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.989 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.989 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.989 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137825 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.989 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.166028+0000", 2023-09-30T17:04:21.989 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0040755080000000003, 2023-09-30T17:04:21.989 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020113681000000001, 2023-09-30T17:04:21.989 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.989 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.989 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.989 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.989 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.990 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137825 2023-09-30T17:04:21.990 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.990 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.990 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.990 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.990 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.166028+0000", 2023-09-30T17:04:21.990 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.990 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.990 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.990 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.990 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.166028+0000", 2023-09-30T17:04:21.990 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.991 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.991 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.991 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.991 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.166029+0000", 2023-09-30T17:04:21.991 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5600000000000002e-07 2023-09-30T17:04:21.991 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.991 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.991 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.991 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.166037+0000", 2023-09-30T17:04:21.991 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3720000000000005e-06 2023-09-30T17:04:21.991 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.992 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.166040+0000", 2023-09-30T17:04:21.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6009999999999999e-06 2023-09-30T17:04:21.992 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.992 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.166044+0000", 2023-09-30T17:04:21.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0359999999999998e-06 2023-09-30T17:04:21.992 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.992 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.992 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.993 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.993 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.993 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:137486 4.15 e54/17)", 2023-09-30T17:04:21.993 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.181878+0000", 2023-09-30T17:04:21.993 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9882264, 2023-09-30T17:04:21.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0043168820000000002, 2023-09-30T17:04:21.993 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.993 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.993 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.993 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.993 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.993 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.181878+0000", 2023-09-30T17:04:21.994 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.994 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.994 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.994 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.994 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.181878+0000", 2023-09-30T17:04:21.994 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.994 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.994 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.994 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.994 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.181878+0000", 2023-09-30T17:04:21.994 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.84e-07 2023-09-30T17:04:21.995 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.995 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.995 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.995 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.181891+0000", 2023-09-30T17:04:21.995 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2595999999999999e-05 2023-09-30T17:04:21.995 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.995 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.995 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.995 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.181899+0000", 2023-09-30T17:04:21.995 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8340000000000005e-06 2023-09-30T17:04:21.995 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.995 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.996 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:21.996 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.181905+0000", 2023-09-30T17:04:21.996 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5969999999999999e-06 2023-09-30T17:04:21.996 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.996 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:21.996 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:21.996 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.996 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136502 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:21.996 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.638592+0000", 2023-09-30T17:04:21.996 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.53151144699999997, 2023-09-30T17:04:21.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.54764817399999999, 2023-09-30T17:04:21.997 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:21.997 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:21.997 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:21.997 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:21.997 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:21.997 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136502 2023-09-30T17:04:21.997 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.997 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:21.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.997 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:21.998 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.638592+0000", 2023-09-30T17:04:21.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.998 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:21.998 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.638592+0000", 2023-09-30T17:04:21.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:21.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.998 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:21.998 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.638593+0000", 2023-09-30T17:04:21.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2799999999999996e-07 2023-09-30T17:04:21.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.999 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:21.999 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.638606+0000", 2023-09-30T17:04:21.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3529e-05 2023-09-30T17:04:21.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:21.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:21.999 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:21.999 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.638613+0000", 2023-09-30T17:04:21.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.759e-06 2023-09-30T17:04:22.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.000 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:22.000 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.638618+0000", 2023-09-30T17:04:22.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1259999999999997e-06 2023-09-30T17:04:22.000 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.000 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:22.000 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.000 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136548 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:22.001 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.652844+0000", 2023-09-30T17:04:22.001 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.51725995700000005, 2023-09-30T17:04:22.001 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.53344983800000001, 2023-09-30T17:04:22.001 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:22.001 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:22.001 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:22.001 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:22.001 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:22.001 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136548 2023-09-30T17:04:22.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.001 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:22.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.002 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:22.002 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.652844+0000", 2023-09-30T17:04:22.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.002 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.002 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:22.002 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.652844+0000", 2023-09-30T17:04:22.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.002 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.003 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:22.003 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.652844+0000", 2023-09-30T17:04:22.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6599999999999996e-07 2023-09-30T17:04:22.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.003 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.003 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:22.003 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.652857+0000", 2023-09-30T17:04:22.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2901000000000001e-05 2023-09-30T17:04:22.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.003 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.003 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:22.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.652865+0000", 2023-09-30T17:04:22.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0430000000000008e-06 2023-09-30T17:04:22.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:22.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.652871+0000", 2023-09-30T17:04:22.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8379999999999998e-06 2023-09-30T17:04:22.004 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.004 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:22.004 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.005 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136983 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:22.005 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.834594+0000", 2023-09-30T17:04:22.005 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.33551007300000002, 2023-09-30T17:04:22.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.35175161199999999, 2023-09-30T17:04:22.005 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:22.005 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:22.005 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:22.005 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:22.005 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:22.005 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136983 2023-09-30T17:04:22.006 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.006 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:22.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.006 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:22.006 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.834594+0000", 2023-09-30T17:04:22.006 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.006 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.006 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:22.006 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.834594+0000", 2023-09-30T17:04:22.006 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.007 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:22.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.834594+0000", 2023-09-30T17:04:22.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7300000000000002e-07 2023-09-30T17:04:22.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.007 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:22.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.834606+0000", 2023-09-30T17:04:22.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1598e-05 2023-09-30T17:04:22.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.008 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:22.008 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.834613+0000", 2023-09-30T17:04:22.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9949999999999999e-06 2023-09-30T17:04:22.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.008 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:22.008 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.834618+0000", 2023-09-30T17:04:22.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.972e-06 2023-09-30T17:04:22.008 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.008 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:22.008 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.009 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.009 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:135960 4.36 e54/17)", 2023-09-30T17:04:22.009 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.927046+0000", 2023-09-30T17:04:22.009 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.243057367, 2023-09-30T17:04:22.009 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.25934820400000003, 2023-09-30T17:04:22.009 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:22.009 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:22.009 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:22.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.009 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:22.009 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.927046+0000", 2023-09-30T17:04:22.010 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.010 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.010 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:22.010 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.927046+0000", 2023-09-30T17:04:22.010 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.010 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.010 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:22.010 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.927047+0000", 2023-09-30T17:04:22.010 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8899999999999999e-07 2023-09-30T17:04:22.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:22.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.927069+0000", 2023-09-30T17:04:22.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1883e-05 2023-09-30T17:04:22.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:22.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.927084+0000", 2023-09-30T17:04:22.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4652e-05 2023-09-30T17:04:22.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:22.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.927089+0000", 2023-09-30T17:04:22.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8690000000000001e-06 2023-09-30T17:04:22.012 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.012 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:22.012 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.012 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137493 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:22.012 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.012719+0000", 2023-09-30T17:04:22.013 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.15738501499999999, 2023-09-30T17:04:22.013 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.173724026, 2023-09-30T17:04:22.013 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:22.013 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:22.013 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:22.013 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:22.013 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:22.013 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137493 2023-09-30T17:04:22.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.013 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:22.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.014 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:22.014 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.012719+0000", 2023-09-30T17:04:22.014 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.014 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.014 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.014 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:22.014 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.012719+0000", 2023-09-30T17:04:22.014 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.014 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.014 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.014 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:22.015 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.012719+0000", 2023-09-30T17:04:22.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0699999999999997e-07 2023-09-30T17:04:22.015 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:22.015 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.012739+0000", 2023-09-30T17:04:22.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9639e-05 2023-09-30T17:04:22.015 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:22.015 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.012746+0000", 2023-09-30T17:04:22.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.888e-06 2023-09-30T17:04:22.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:22.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.012753+0000", 2023-09-30T17:04:22.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3810000000000001e-06 2023-09-30T17:04:22.016 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.016 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:22.016 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.016 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137603 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:22.017 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.054730+0000", 2023-09-30T17:04:22.017 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.115373513, 2023-09-30T17:04:22.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.13176349500000001, 2023-09-30T17:04:22.017 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:22.017 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:22.017 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:22.017 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:22.017 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:22.017 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137603 2023-09-30T17:04:22.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.017 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:22.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.018 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:22.018 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.054730+0000", 2023-09-30T17:04:22.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.018 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:22.018 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.054730+0000", 2023-09-30T17:04:22.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.019 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:22.019 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.057013+0000", 2023-09-30T17:04:22.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022824080000000001 2023-09-30T17:04:22.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.019 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:22.019 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.057042+0000", 2023-09-30T17:04:22.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9094999999999998e-05 2023-09-30T17:04:22.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.019 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:22.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.057050+0000", 2023-09-30T17:04:22.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3399999999999998e-06 2023-09-30T17:04:22.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:22.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.057056+0000", 2023-09-30T17:04:22.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3280000000000002e-06 2023-09-30T17:04:22.020 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.020 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:22.020 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.021 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137625 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:22.021 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.066897+0000", 2023-09-30T17:04:22.021 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.10320646, 2023-09-30T17:04:22.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.119657019, 2023-09-30T17:04:22.021 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:22.021 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:22.021 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:22.021 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:22.021 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:22.021 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137625 2023-09-30T17:04:22.022 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.022 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:22.022 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.022 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:22.022 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.066897+0000", 2023-09-30T17:04:22.022 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.022 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.022 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.022 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:22.022 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.066897+0000", 2023-09-30T17:04:22.022 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.023 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.023 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.023 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:22.023 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.070519+0000", 2023-09-30T17:04:22.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036213790000000001 2023-09-30T17:04:22.023 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.023 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.023 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:22.023 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.070534+0000", 2023-09-30T17:04:22.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5369000000000001e-05 2023-09-30T17:04:22.023 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.024 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:22.024 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.070544+0000", 2023-09-30T17:04:22.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0152999999999999e-05 2023-09-30T17:04:22.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.024 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:22.024 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.070551+0000", 2023-09-30T17:04:22.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0049999999999998e-06 2023-09-30T17:04:22.024 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.024 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:22.025 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.025 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.025 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.025 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136398 4.6 e54/17)", 2023-09-30T17:04:22.025 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.089697+0000", 2023-09-30T17:04:22.025 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.080406485999999999, 2023-09-30T17:04:22.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.096906829, 2023-09-30T17:04:22.025 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:22.025 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:22.025 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:22.025 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.026 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:22.026 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.089697+0000", 2023-09-30T17:04:22.026 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.026 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.026 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:22.026 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.089697+0000", 2023-09-30T17:04:22.026 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.026 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.026 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:22.026 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.089698+0000", 2023-09-30T17:04:22.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1799999999999995e-07 2023-09-30T17:04:22.027 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.027 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:22.027 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.089719+0000", 2023-09-30T17:04:22.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0922000000000001e-05 2023-09-30T17:04:22.027 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.027 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:22.027 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.089726+0000", 2023-09-30T17:04:22.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8920000000000003e-06 2023-09-30T17:04:22.027 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.028 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.028 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:22.028 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.089731+0000", 2023-09-30T17:04:22.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9139999999999999e-06 2023-09-30T17:04:22.028 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.028 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:22.028 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.028 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.028 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.028 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137681 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:22.028 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.101824+0000", 2023-09-30T17:04:22.028 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.068279459000000001, 2023-09-30T17:04:22.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.084827557999999997, 2023-09-30T17:04:22.029 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:22.029 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:22.029 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:22.029 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:22.029 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:22.029 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137681 2023-09-30T17:04:22.029 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.029 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:22.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.030 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:22.030 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.101824+0000", 2023-09-30T17:04:22.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.030 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:22.030 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.101824+0000", 2023-09-30T17:04:22.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.030 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:22.030 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.101825+0000", 2023-09-30T17:04:22.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0200000000000002e-07 2023-09-30T17:04:22.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:22.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.101837+0000", 2023-09-30T17:04:22.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1606999999999999e-05 2023-09-30T17:04:22.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:22.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.101844+0000", 2023-09-30T17:04:22.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0350000000000004e-06 2023-09-30T17:04:22.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.032 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:22.032 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.101848+0000", 2023-09-30T17:04:22.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8980000000000004e-06 2023-09-30T17:04:22.032 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.032 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:22.032 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.032 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137708 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:22.032 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.110779+0000", 2023-09-30T17:04:22.033 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.05932453, 2023-09-30T17:04:22.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.075925475000000006, 2023-09-30T17:04:22.033 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:22.033 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:22.033 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:22.033 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:22.033 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:22.033 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137708 2023-09-30T17:04:22.033 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.033 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:22.033 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.034 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:22.034 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.110779+0000", 2023-09-30T17:04:22.034 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.034 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.034 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:22.034 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.110779+0000", 2023-09-30T17:04:22.034 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.034 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.034 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:22.035 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.110780+0000", 2023-09-30T17:04:22.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7399999999999999e-07 2023-09-30T17:04:22.035 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.035 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.035 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:22.035 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.110792+0000", 2023-09-30T17:04:22.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1936999999999999e-05 2023-09-30T17:04:22.035 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.035 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.035 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:22.035 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.110798+0000", 2023-09-30T17:04:22.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2140000000000001e-06 2023-09-30T17:04:22.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:22.036 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.110803+0000", 2023-09-30T17:04:22.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1569999999999999e-06 2023-09-30T17:04:22.036 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.036 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:22.036 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.036 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136494 4.6 e54/17)", 2023-09-30T17:04:22.037 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.128044+0000", 2023-09-30T17:04:22.037 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.042059906000000001, 2023-09-30T17:04:22.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.058713407000000002, 2023-09-30T17:04:22.037 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:22.037 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:22.037 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:22.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:22.037 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.128044+0000", 2023-09-30T17:04:22.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.038 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:22.038 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.128044+0000", 2023-09-30T17:04:22.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.038 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:22.038 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.128044+0000", 2023-09-30T17:04:22.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9999999999999998e-07 2023-09-30T17:04:22.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.038 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:22.039 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.128060+0000", 2023-09-30T17:04:22.039 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5486999999999999e-05 2023-09-30T17:04:22.039 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.039 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:22.039 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.128067+0000", 2023-09-30T17:04:22.039 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2819999999999999e-06 2023-09-30T17:04:22.039 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.039 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:22.039 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.128074+0000", 2023-09-30T17:04:22.039 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.99e-06 2023-09-30T17:04:22.040 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.040 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:22.040 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.040 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.040 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.040 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137798 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:22.040 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.154294+0000", 2023-09-30T17:04:22.040 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.015809999000000002, 2023-09-30T17:04:22.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.032510359000000003, 2023-09-30T17:04:22.040 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:22.040 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:22.041 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:22.041 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:22.041 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:22.041 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137798 2023-09-30T17:04:22.041 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.041 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:22.041 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.041 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:22.041 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.154294+0000", 2023-09-30T17:04:22.041 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.041 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.041 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.042 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:22.042 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.154294+0000", 2023-09-30T17:04:22.042 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.042 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.042 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.042 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:22.042 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.154294+0000", 2023-09-30T17:04:22.042 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4899999999999995e-07 2023-09-30T17:04:22.042 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.042 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.042 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:22.043 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.154319+0000", 2023-09-30T17:04:22.043 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.493e-05 2023-09-30T17:04:22.043 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.043 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.043 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:22.043 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.154328+0000", 2023-09-30T17:04:22.043 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6330000000000002e-06 2023-09-30T17:04:22.043 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.043 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.043 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:22.043 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.154336+0000", 2023-09-30T17:04:22.044 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5920000000000003e-06 2023-09-30T17:04:22.044 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.044 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:22.044 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.044 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.044 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.044 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137826 4.2d 4:b4aa06e9:::100000001f8.0000001d:head [write 1884160~4096 in=4096b,write 2285568~4096 in=4096b,write 2375680~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:22.044 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.166047+0000", 2023-09-30T17:04:22.044 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0040565590000000004, 2023-09-30T17:04:22.044 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020815929, 2023-09-30T17:04:22.044 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:22.044 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:22.045 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:22.045 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:22.045 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:22.045 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137826 2023-09-30T17:04:22.045 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.045 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:22.045 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.045 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:22.045 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.166047+0000", 2023-09-30T17:04:22.045 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.045 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.045 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.046 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:22.046 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.166047+0000", 2023-09-30T17:04:22.046 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.046 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.046 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.046 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:22.046 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.166047+0000", 2023-09-30T17:04:22.046 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1899999999999999e-07 2023-09-30T17:04:22.046 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.046 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.046 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:22.047 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.166057+0000", 2023-09-30T17:04:22.047 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9960000000000005e-06 2023-09-30T17:04:22.047 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.047 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.047 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:22.047 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.166061+0000", 2023-09-30T17:04:22.047 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4350000000000001e-06 2023-09-30T17:04:22.047 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.047 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.047 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:22.047 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.166064+0000", 2023-09-30T17:04:22.047 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.864e-06 2023-09-30T17:04:22.048 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.048 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.048 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:22.048 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.180387+0000", 2023-09-30T17:04:22.048 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014323433 2023-09-30T17:04:22.048 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.048 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.048 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:22.048 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.180438+0000", 2023-09-30T17:04:22.048 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1039999999999999e-05 2023-09-30T17:04:22.048 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.049 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.049 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:22.049 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.180540+0000", 2023-09-30T17:04:22.049 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010139700000000001 2023-09-30T17:04:22.049 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.049 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:22.049 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.049 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.049 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.049 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136664 4.36 e54/17)", 2023-09-30T17:04:22.049 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.182529+0000", 2023-09-30T17:04:22.049 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9875751, 2023-09-30T17:04:22.050 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0044056099999999999, 2023-09-30T17:04:22.050 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:22.050 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:22.050 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:22.050 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.050 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:22.050 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.182529+0000", 2023-09-30T17:04:22.050 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.050 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.050 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.050 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:22.051 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.182529+0000", 2023-09-30T17:04:22.051 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.051 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.051 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.051 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:22.051 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.182529+0000", 2023-09-30T17:04:22.051 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3499999999999996e-07 2023-09-30T17:04:22.051 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.051 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.051 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:22.051 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.182542+0000", 2023-09-30T17:04:22.051 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.221e-05 2023-09-30T17:04:22.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.052 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:22.052 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.182555+0000", 2023-09-30T17:04:22.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3419e-05 2023-09-30T17:04:22.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.052 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:22.052 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.182562+0000", 2023-09-30T17:04:22.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.109e-06 2023-09-30T17:04:22.052 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.053 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:22.053 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.053 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.053 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.053 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136504 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:22.053 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.638626+0000", 2023-09-30T17:04:22.053 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.53147808699999999, 2023-09-30T17:04:22.053 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.54835544999999997, 2023-09-30T17:04:22.053 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:22.053 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:22.053 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:22.053 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:22.054 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:22.054 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136504 2023-09-30T17:04:22.054 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.054 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:22.054 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.054 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:22.054 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.638626+0000", 2023-09-30T17:04:22.054 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.054 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.054 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.054 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:22.055 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.638626+0000", 2023-09-30T17:04:22.055 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.055 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.055 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.055 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:22.055 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.638626+0000", 2023-09-30T17:04:22.055 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2e-07 2023-09-30T17:04:22.055 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.055 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.055 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:22.055 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.638646+0000", 2023-09-30T17:04:22.056 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9551e-05 2023-09-30T17:04:22.056 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.056 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.056 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:22.056 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.638652+0000", 2023-09-30T17:04:22.056 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1210000000000003e-06 2023-09-30T17:04:22.056 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.056 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.056 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:22.056 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.638658+0000", 2023-09-30T17:04:22.056 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3879999999999997e-06 2023-09-30T17:04:22.057 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.057 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:22.057 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.057 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.057 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.057 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136789 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:22.057 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.758592+0000", 2023-09-30T17:04:22.057 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.41151220199999999, 2023-09-30T17:04:22.057 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.42844469400000001, 2023-09-30T17:04:22.057 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:22.057 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:22.057 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:22.058 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:22.058 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:22.058 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136789 2023-09-30T17:04:22.058 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.058 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:22.058 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.058 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:22.058 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.758592+0000", 2023-09-30T17:04:22.058 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.058 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.058 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.059 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:22.059 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.758592+0000", 2023-09-30T17:04:22.059 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.059 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.059 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.059 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:22.059 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.760548+0000", 2023-09-30T17:04:22.059 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019561869999999999 2023-09-30T17:04:22.059 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.059 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.059 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:22.060 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.760567+0000", 2023-09-30T17:04:22.060 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8831999999999999e-05 2023-09-30T17:04:22.060 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.060 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.060 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:22.060 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.760577+0000", 2023-09-30T17:04:22.060 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0394000000000001e-05 2023-09-30T17:04:22.060 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.060 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.060 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:22.060 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.760584+0000", 2023-09-30T17:04:22.061 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5039999999999996e-06 2023-09-30T17:04:22.061 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.061 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:22.061 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.061 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.061 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.061 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:135834 4.6 e54/17)", 2023-09-30T17:04:22.061 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.873899+0000", 2023-09-30T17:04:22.061 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.29620508899999998, 2023-09-30T17:04:22.061 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.31318931900000002, 2023-09-30T17:04:22.061 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:22.062 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:22.062 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:22.062 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.062 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:22.062 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.873899+0000", 2023-09-30T17:04:22.062 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.062 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.062 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.062 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:22.062 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.873899+0000", 2023-09-30T17:04:22.062 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.062 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.063 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.063 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:22.063 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.873899+0000", 2023-09-30T17:04:22.063 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9799999999999999e-07 2023-09-30T17:04:22.063 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.063 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.063 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:22.063 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.873912+0000", 2023-09-30T17:04:22.063 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3407000000000001e-05 2023-09-30T17:04:22.063 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.064 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.064 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:22.064 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.873920+0000", 2023-09-30T17:04:22.064 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.34e-06 2023-09-30T17:04:22.064 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.064 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.064 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:22.064 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.873925+0000", 2023-09-30T17:04:22.064 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.259e-06 2023-09-30T17:04:22.064 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.064 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:22.065 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.065 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.065 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.065 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:135889 4.6 e54/17)", 2023-09-30T17:04:22.065 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.890316+0000", 2023-09-30T17:04:22.065 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.27978745399999999, 2023-09-30T17:04:22.065 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.29681791099999999, 2023-09-30T17:04:22.065 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:22.065 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:22.065 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:22.065 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.066 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:22.066 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.890316+0000", 2023-09-30T17:04:22.066 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.066 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.066 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.066 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:22.066 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.890316+0000", 2023-09-30T17:04:22.066 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.066 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.066 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.066 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:22.067 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.890317+0000", 2023-09-30T17:04:22.067 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8500000000000001e-07 2023-09-30T17:04:22.067 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.067 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.067 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:22.067 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.890332+0000", 2023-09-30T17:04:22.067 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4973e-05 2023-09-30T17:04:22.067 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.067 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.067 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:22.067 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.890341+0000", 2023-09-30T17:04:22.068 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4609999999999997e-06 2023-09-30T17:04:22.068 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.068 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.068 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:22.068 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.890348+0000", 2023-09-30T17:04:22.068 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4409999999999998e-06 2023-09-30T17:04:22.068 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.068 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:22.068 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.068 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.068 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.069 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137368 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:22.069 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.956612+0000", 2023-09-30T17:04:22.069 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.21349189900000001, 2023-09-30T17:04:22.069 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.23057191599999999, 2023-09-30T17:04:22.069 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:22.069 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:22.069 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:22.069 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:22.069 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:22.069 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137368 2023-09-30T17:04:22.069 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.069 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:22.070 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.070 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:22.070 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.956612+0000", 2023-09-30T17:04:22.070 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.070 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.070 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.070 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:22.070 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.956612+0000", 2023-09-30T17:04:22.070 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.070 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.070 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.071 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:22.071 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.956612+0000", 2023-09-30T17:04:22.071 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0200000000000002e-07 2023-09-30T17:04:22.071 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.071 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.071 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:22.071 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.956626+0000", 2023-09-30T17:04:22.071 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3256e-05 2023-09-30T17:04:22.071 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.071 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.071 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:22.072 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.956636+0000", 2023-09-30T17:04:22.072 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9000000000000001e-06 2023-09-30T17:04:22.072 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.072 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.072 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:22.072 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.956641+0000", 2023-09-30T17:04:22.072 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7540000000000003e-06 2023-09-30T17:04:22.072 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.072 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:22.072 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.072 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.073 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.073 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137536 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:22.073 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.030843+0000", 2023-09-30T17:04:22.073 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.13926048799999999, 2023-09-30T17:04:22.073 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.15639717, 2023-09-30T17:04:22.073 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:22.073 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:22.073 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:22.073 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:22.073 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:22.073 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137536 2023-09-30T17:04:22.074 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.074 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:22.074 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.074 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:22.074 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.030843+0000", 2023-09-30T17:04:22.074 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.074 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.074 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.074 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:22.074 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.030843+0000", 2023-09-30T17:04:22.074 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.075 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.075 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.075 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:22.075 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.030844+0000", 2023-09-30T17:04:22.075 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2199999999999999e-07 2023-09-30T17:04:22.075 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.075 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.075 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:22.075 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.030855+0000", 2023-09-30T17:04:22.075 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1382e-05 2023-09-30T17:04:22.075 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.075 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.076 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:22.076 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.030861+0000", 2023-09-30T17:04:22.076 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8309999999999997e-06 2023-09-30T17:04:22.076 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.076 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.076 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:22.076 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.030866+0000", 2023-09-30T17:04:22.076 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8389999999999997e-06 2023-09-30T17:04:22.076 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.076 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:22.076 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.077 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.077 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.077 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136267 4.36 e54/17)", 2023-09-30T17:04:22.077 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.043349+0000", 2023-09-30T17:04:22.077 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.126754746, 2023-09-30T17:04:22.077 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.14394791300000001, 2023-09-30T17:04:22.077 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:22.077 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:22.077 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:22.077 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.077 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:22.078 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.043349+0000", 2023-09-30T17:04:22.078 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.078 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.078 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.078 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:22.078 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.043349+0000", 2023-09-30T17:04:22.078 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.078 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.078 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.078 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:22.078 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.043349+0000", 2023-09-30T17:04:22.079 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2000000000000001e-07 2023-09-30T17:04:22.079 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.079 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.079 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:22.079 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.043365+0000", 2023-09-30T17:04:22.079 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5611999999999999e-05 2023-09-30T17:04:22.079 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.079 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.079 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:22.079 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.043372+0000", 2023-09-30T17:04:22.079 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8940000000000004e-06 2023-09-30T17:04:22.079 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.080 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.080 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:22.080 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.043377+0000", 2023-09-30T17:04:22.080 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7550000000000002e-06 2023-09-30T17:04:22.080 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.080 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:22.080 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.080 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.080 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.080 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136311 4.36 e54/17)", 2023-09-30T17:04:22.081 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.057082+0000", 2023-09-30T17:04:22.081 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.11302208499999999, 2023-09-30T17:04:22.081 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.130266466, 2023-09-30T17:04:22.081 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:22.081 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:22.081 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:22.081 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.081 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:22.081 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.057082+0000", 2023-09-30T17:04:22.081 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.081 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.082 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.082 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:22.082 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.057082+0000", 2023-09-30T17:04:22.082 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.082 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.082 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.082 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:22.082 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.057082+0000", 2023-09-30T17:04:22.082 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5900000000000002e-07 2023-09-30T17:04:22.082 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.082 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.083 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:22.083 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.057094+0000", 2023-09-30T17:04:22.083 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2099999999999999e-05 2023-09-30T17:04:22.083 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.083 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.083 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:22.083 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.057099+0000", 2023-09-30T17:04:22.083 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4279999999999998e-06 2023-09-30T17:04:22.083 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.083 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.083 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:22.083 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.057102+0000", 2023-09-30T17:04:22.084 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5130000000000001e-06 2023-09-30T17:04:22.084 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.084 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:22.084 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.084 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.084 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.084 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136418 4.36 e54/17)", 2023-09-30T17:04:22.084 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.089740+0000", 2023-09-30T17:04:22.084 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.080363895000000005, 2023-09-30T17:04:22.084 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.097664995000000004, 2023-09-30T17:04:22.084 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:22.085 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:22.085 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:22.085 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.085 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:22.085 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.089740+0000", 2023-09-30T17:04:22.085 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.085 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.085 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.085 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:22.085 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.089740+0000", 2023-09-30T17:04:22.085 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.085 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.086 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.086 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:22.086 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.089740+0000", 2023-09-30T17:04:22.086 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2100000000000001e-07 2023-09-30T17:04:22.086 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.086 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.086 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:22.086 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.089748+0000", 2023-09-30T17:04:22.086 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7880000000000007e-06 2023-09-30T17:04:22.086 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.086 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.087 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:22.087 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.089752+0000", 2023-09-30T17:04:22.087 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7189999999999999e-06 2023-09-30T17:04:22.087 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.087 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.087 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:22.087 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.089754+0000", 2023-09-30T17:04:22.087 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5799999999999999e-06 2023-09-30T17:04:22.087 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.087 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:22.087 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.087 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.088 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.088 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137682 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:22.088 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.101868+0000", 2023-09-30T17:04:22.088 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.068235938999999995, 2023-09-30T17:04:22.088 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.085590998000000001, 2023-09-30T17:04:22.088 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:22.088 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:22.088 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:22.088 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:22.088 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:22.088 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137682 2023-09-30T17:04:22.089 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.089 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:22.089 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.089 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:22.089 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.101868+0000", 2023-09-30T17:04:22.089 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.089 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.089 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.089 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:22.089 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.101868+0000", 2023-09-30T17:04:22.089 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.090 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.090 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.090 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:22.090 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.101868+0000", 2023-09-30T17:04:22.090 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1799999999999995e-07 2023-09-30T17:04:22.090 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.090 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.090 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:22.091 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.101887+0000", 2023-09-30T17:04:22.091 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8830000000000001e-05 2023-09-30T17:04:22.091 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.091 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.091 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:22.091 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.101897+0000", 2023-09-30T17:04:22.091 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2429999999999994e-06 2023-09-30T17:04:22.091 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.091 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.091 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:22.091 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.101903+0000", 2023-09-30T17:04:22.092 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6200000000000001e-06 2023-09-30T17:04:22.092 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.092 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:22.092 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.092 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.092 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.092 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137800 4.12 4:4be51a30:::100000001f8.0000000b:head [write 1830912~4096 in=4096b,write 1904640~4096 in=4096b,write 1912832~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:22.092 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.154347+0000", 2023-09-30T17:04:22.092 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.015757196000000001, 2023-09-30T17:04:22.092 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033188507999999999, 2023-09-30T17:04:22.092 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:22.093 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:22.093 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:22.093 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:22.093 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:22.093 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137800 2023-09-30T17:04:22.093 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.093 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:22.093 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.093 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:22.093 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.154347+0000", 2023-09-30T17:04:22.093 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.094 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.094 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.094 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:22.094 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.154347+0000", 2023-09-30T17:04:22.094 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.094 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.094 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.094 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:22.094 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.154347+0000", 2023-09-30T17:04:22.094 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0999999999999998e-07 2023-09-30T17:04:22.094 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.095 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.095 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:22.095 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.154367+0000", 2023-09-30T17:04:22.095 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9468999999999999e-05 2023-09-30T17:04:22.095 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.095 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.095 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:22.095 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.154375+0000", 2023-09-30T17:04:22.095 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0399999999999993e-06 2023-09-30T17:04:22.095 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.095 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.096 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:22.096 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.154381+0000", 2023-09-30T17:04:22.096 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9959999999999999e-06 2023-09-30T17:04:22.096 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.096 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.096 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:22.096 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.178385+0000", 2023-09-30T17:04:22.096 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.024004305 2023-09-30T17:04:22.096 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.096 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.096 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:22.096 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.178459+0000", 2023-09-30T17:04:22.097 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3681000000000001e-05 2023-09-30T17:04:22.097 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.097 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.097 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:22.097 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.178611+0000", 2023-09-30T17:04:22.097 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015187499999999999 2023-09-30T17:04:22.097 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.097 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:22.097 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.097 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.097 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.098 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137830 4.12 4:48ab9bde:::100000001f8.00000015:head [write 2584576~4096 in=4096b,write 2748416~4096 in=4096b,write 2781184~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:22.098 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.166068+0000", 2023-09-30T17:04:22.098 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0040361040000000004, 2023-09-30T17:04:22.098 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021555148999999999, 2023-09-30T17:04:22.098 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:22.098 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:22.098 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:22.098 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:22.098 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:22.098 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137830 2023-09-30T17:04:22.098 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.099 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:22.099 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.099 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:22.099 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.166068+0000", 2023-09-30T17:04:22.099 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.099 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.099 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.099 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:22.099 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.166068+0000", 2023-09-30T17:04:22.099 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.099 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.100 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.100 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:22.100 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.167515+0000", 2023-09-30T17:04:22.100 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014476549999999999 2023-09-30T17:04:22.100 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.100 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.100 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:22.100 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.167535+0000", 2023-09-30T17:04:22.100 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9446e-05 2023-09-30T17:04:22.100 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.100 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.100 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:22.101 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.167547+0000", 2023-09-30T17:04:22.101 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2119999999999999e-05 2023-09-30T17:04:22.101 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.101 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.101 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:22.101 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.167554+0000", 2023-09-30T17:04:22.101 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1620000000000002e-06 2023-09-30T17:04:22.101 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.101 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.101 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:22.101 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.185269+0000", 2023-09-30T17:04:22.101 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017714549999999999 2023-09-30T17:04:22.102 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.102 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.102 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:22.102 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.185342+0000", 2023-09-30T17:04:22.102 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3312999999999994e-05 2023-09-30T17:04:22.102 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.102 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.102 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:22.102 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.185493+0000", 2023-09-30T17:04:22.102 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015074399999999999 2023-09-30T17:04:22.102 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.103 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:22.103 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.103 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.103 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.103 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136923 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:22.103 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.809019+0000", 2023-09-30T17:04:22.103 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.36108446399999999, 2023-09-30T17:04:22.103 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.37868864000000002, 2023-09-30T17:04:22.103 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:22.103 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:22.103 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:22.104 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:22.104 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:22.104 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136923 2023-09-30T17:04:22.104 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.104 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:22.104 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.104 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:22.104 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.809019+0000", 2023-09-30T17:04:22.104 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.104 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.104 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.105 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:22.105 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.809019+0000", 2023-09-30T17:04:22.105 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.105 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.105 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.105 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:22.105 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.809020+0000", 2023-09-30T17:04:22.105 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1799999999999999e-07 2023-09-30T17:04:22.105 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.105 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.105 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:22.105 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.809028+0000", 2023-09-30T17:04:22.106 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6459999999999999e-06 2023-09-30T17:04:22.106 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.106 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.106 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:22.106 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.809033+0000", 2023-09-30T17:04:22.106 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6859999999999997e-06 2023-09-30T17:04:22.106 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.106 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.106 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:22.106 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.809036+0000", 2023-09-30T17:04:22.106 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9380000000000001e-06 2023-09-30T17:04:22.107 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.107 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:22.107 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.107 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.107 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.107 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:136987 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:22.107 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.834652+0000", 2023-09-30T17:04:22.107 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.33545126800000002, 2023-09-30T17:04:22.107 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.353118349, 2023-09-30T17:04:22.107 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:22.107 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:22.108 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:22.108 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:22.108 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:22.108 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 136987 2023-09-30T17:04:22.108 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.108 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:22.108 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.108 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:22.108 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.834652+0000", 2023-09-30T17:04:22.108 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.108 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.109 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.109 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:22.109 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.834652+0000", 2023-09-30T17:04:22.109 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.109 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.109 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.109 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:22.109 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.834653+0000", 2023-09-30T17:04:22.109 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3700000000000001e-07 2023-09-30T17:04:22.109 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.109 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.109 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:22.110 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.834670+0000", 2023-09-30T17:04:22.110 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7632e-05 2023-09-30T17:04:22.110 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.110 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.110 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:22.110 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.834677+0000", 2023-09-30T17:04:22.110 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4030000000000004e-06 2023-09-30T17:04:22.110 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.110 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.110 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:22.110 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.834682+0000", 2023-09-30T17:04:22.111 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.78e-06 2023-09-30T17:04:22.111 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.111 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:22.111 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.111 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.111 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.111 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:135841 4.6 e54/17)", 2023-09-30T17:04:22.111 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.874394+0000", 2023-09-30T17:04:22.111 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.29571003099999998, 2023-09-30T17:04:22.111 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.31342082500000001, 2023-09-30T17:04:22.111 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:22.112 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:22.112 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:22.112 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.112 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:22.112 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.874394+0000", 2023-09-30T17:04:22.112 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.112 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.112 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.112 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:22.112 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.874394+0000", 2023-09-30T17:04:22.112 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.112 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.113 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.113 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:22.113 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.874394+0000", 2023-09-30T17:04:22.113 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.77e-07 2023-09-30T17:04:22.113 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.113 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.113 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:22.113 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.874408+0000", 2023-09-30T17:04:22.113 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3923e-05 2023-09-30T17:04:22.113 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.113 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.114 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:22.114 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.874416+0000", 2023-09-30T17:04:22.114 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7200000000000006e-06 2023-09-30T17:04:22.114 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.114 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.114 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:22.114 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.874422+0000", 2023-09-30T17:04:22.114 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5470000000000002e-06 2023-09-30T17:04:22.114 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.114 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:22.114 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.115 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.115 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.115 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137255 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:22.115 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.914589+0000", 2023-09-30T17:04:22.115 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.25551428500000001, 2023-09-30T17:04:22.115 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.27325685799999999, 2023-09-30T17:04:22.115 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:22.115 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:22.115 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:22.115 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:22.115 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:22.115 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137255 2023-09-30T17:04:22.116 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.116 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:22.116 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.116 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:22.116 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.914589+0000", 2023-09-30T17:04:22.116 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.116 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.116 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.116 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:22.116 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.914589+0000", 2023-09-30T17:04:22.116 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.116 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.117 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.117 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:22.117 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.918516+0000", 2023-09-30T17:04:22.117 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039268230000000003 2023-09-30T17:04:22.117 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.117 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.117 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:22.117 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.918531+0000", 2023-09-30T17:04:22.117 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4465e-05 2023-09-30T17:04:22.117 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.117 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.118 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:22.118 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.918540+0000", 2023-09-30T17:04:22.118 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5419999999999994e-06 2023-09-30T17:04:22.118 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.118 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.118 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:22.118 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.918547+0000", 2023-09-30T17:04:22.118 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2639999999999997e-06 2023-09-30T17:04:22.118 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.118 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:22.118 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.119 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.119 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.119 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:135964 4.6 e54/17)", 2023-09-30T17:04:22.119 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.927138+0000", 2023-09-30T17:04:22.119 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.242966184, 2023-09-30T17:04:22.119 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.26075222300000001, 2023-09-30T17:04:22.119 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:22.119 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:22.119 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:22.119 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.119 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:22.119 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.927138+0000", 2023-09-30T17:04:22.120 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.120 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.120 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.120 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:22.120 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.927138+0000", 2023-09-30T17:04:22.120 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.120 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.120 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.120 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:22.120 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.927138+0000", 2023-09-30T17:04:22.120 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4600000000000001e-07 2023-09-30T17:04:22.121 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.121 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.121 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:22.121 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.927146+0000", 2023-09-30T17:04:22.121 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2190000000000004e-06 2023-09-30T17:04:22.121 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.121 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.121 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:22.121 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.927151+0000", 2023-09-30T17:04:22.121 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3929999999999999e-06 2023-09-30T17:04:22.121 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.121 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.122 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:22.122 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.927155+0000", 2023-09-30T17:04:22.122 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9659999999999998e-06 2023-09-30T17:04:22.122 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.122 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:22.122 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.122 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.122 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.122 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136030 4.36 e54/17)", 2023-09-30T17:04:22.122 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:19.956708+0000", 2023-09-30T17:04:22.122 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.21339564799999999, 2023-09-30T17:04:22.123 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.23123081700000001, 2023-09-30T17:04:22.123 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:22.123 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:22.123 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:22.123 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.123 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:22.123 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.956708+0000", 2023-09-30T17:04:22.123 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.123 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.123 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.123 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:22.124 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.956708+0000", 2023-09-30T17:04:22.124 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.124 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.124 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.124 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:22.124 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.956709+0000", 2023-09-30T17:04:22.124 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2900000000000003e-07 2023-09-30T17:04:22.124 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.124 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.124 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:22.124 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.956725+0000", 2023-09-30T17:04:22.125 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6019e-05 2023-09-30T17:04:22.125 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.125 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.125 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:22.125 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.956735+0000", 2023-09-30T17:04:22.125 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0002e-05 2023-09-30T17:04:22.125 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.125 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.125 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:22.125 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:19.956742+0000", 2023-09-30T17:04:22.125 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1629999999999999e-06 2023-09-30T17:04:22.126 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.126 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:22.126 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.126 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.126 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.126 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:136280 4.6 e54/17)", 2023-09-30T17:04:22.126 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.043384+0000", 2023-09-30T17:04:22.126 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.12671978, 2023-09-30T17:04:22.126 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.144609082, 2023-09-30T17:04:22.126 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:22.126 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:22.126 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:22.127 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.127 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:22.127 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.043384+0000", 2023-09-30T17:04:22.127 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.127 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.127 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.127 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:22.127 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.043384+0000", 2023-09-30T17:04:22.127 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.127 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.127 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.128 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:22.128 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.043384+0000", 2023-09-30T17:04:22.128 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5400000000000002e-07 2023-09-30T17:04:22.128 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.128 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.128 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:22.128 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.043395+0000", 2023-09-30T17:04:22.128 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0312000000000001e-05 2023-09-30T17:04:22.128 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.128 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.128 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:22.129 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.043400+0000", 2023-09-30T17:04:22.129 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5210000000000002e-06 2023-09-30T17:04:22.129 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.129 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.129 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:22.129 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.043404+0000", 2023-09-30T17:04:22.129 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9060000000000004e-06 2023-09-30T17:04:22.129 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.129 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:22.129 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.129 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.129 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.130 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137832 4.38 4.e1fdc8b8 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:22.130 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.167572+0000", 2023-09-30T17:04:22.130 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0025320780000000001, 2023-09-30T17:04:22.130 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020472297, 2023-09-30T17:04:22.130 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:22.130 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:22.130 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:22.130 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:22.130 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:22.130 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137832 2023-09-30T17:04:22.130 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.131 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:22.131 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.131 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:22.131 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.167572+0000", 2023-09-30T17:04:22.131 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.131 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.131 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.131 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:22.131 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.167572+0000", 2023-09-30T17:04:22.131 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.131 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.132 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.132 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:22.132 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.169517+0000", 2023-09-30T17:04:22.132 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019449300000000001 2023-09-30T17:04:22.132 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.132 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.132 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:22.132 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.169539+0000", 2023-09-30T17:04:22.132 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2127e-05 2023-09-30T17:04:22.132 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.132 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.132 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:22.133 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.169549+0000", 2023-09-30T17:04:22.133 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.041e-05 2023-09-30T17:04:22.133 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.133 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:22.133 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.169556+0000", 2023-09-30T17:04:22.133 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9500000000000004e-06 2023-09-30T17:04:22.133 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.133 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:22.133 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.133 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.134 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:137857 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e53)", 2023-09-30T17:04:22.134 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:20.181561+0000", 2023-09-30T17:04:22.134 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9885426, 2023-09-30T17:04:22.134 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0065407199999999999, 2023-09-30T17:04:22.134 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:22.134 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:22.134 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:22.134 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:22.134 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:22.134 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 137857 2023-09-30T17:04:22.134 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.135 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:22.135 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.135 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:22.135 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.181561+0000", 2023-09-30T17:04:22.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.135 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.135 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:22.135 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.181561+0000", 2023-09-30T17:04:22.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:22.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.136 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.136 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:22.136 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.183516+0000", 2023-09-30T17:04:22.136 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019550330000000001 2023-09-30T17:04:22.136 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.136 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.136 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:22.136 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.183532+0000", 2023-09-30T17:04:22.136 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5970000000000001e-05 2023-09-30T17:04:22.136 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.136 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.137 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:22.137 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.183543+0000", 2023-09-30T17:04:22.137 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1035e-05 2023-09-30T17:04:22.137 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:22.137 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:22.137 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:22.137 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:20.183550+0000", 2023-09-30T17:04:22.137 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0910000000000004e-06 2023-09-30T17:04:22.137 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.137 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:22.137 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.138 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:22.138 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2023-09-30T17:04:22.138 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 352 2023-09-30T17:04:22.138 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:04:22.138 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-09-30T17:04:22.139 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-09-30T17:04:22.140 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:22.139+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:22.141 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:04:22.241 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:22.240+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:22.320 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:04:22.334 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:04:22.334 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:04:22.335 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2023-09-30T17:04:22.335 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2023-09-30T17:04:22.335 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:04:22.341 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:22.341+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:22.348 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:04:22.360 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:04:22.360 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-09-30T17:04:22.361 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-09-30T17:04:22.361 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:04:22.364 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:04:22.364 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:04:22.442 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:22.442+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:22.543 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:22.543+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:22.591 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:22.592 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:22.604 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:04:22.649 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:22.648+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:22.745 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:22.745+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:22.821 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:22.852 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:22.853 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:04:22.853 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:22.852+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:22.954 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~96s 2023-09-30T17:04:22.954 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:22.954+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:23.056 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:23.056+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:23.105 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:23.156 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:23.158 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:04:23.159 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:23.157+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:23.261 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:23.258+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:23.360 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:23.360+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:23.410 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is unset 2023-09-30T17:04:23.410 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:23.411 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:23.426 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:04:23.462 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:23.460+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:23.561 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:23.560+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:23.570 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:23.571 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:23.587 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:04:23.663 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:23.662+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:23.763 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:23.762+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:23.787 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:23.788 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:23.798 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:04:23.925 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:23.926 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:23.935 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:04:23.957 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:23.864+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:23.965 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:23.965+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:24.067 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:24.066+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:24.133 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:24.133 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:24.150 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:04:24.193 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:24.192+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:24.268 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:24.268+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:24.365 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-09-30T17:04:24.370 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:24.370+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:24.411 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:24.411 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:24.426 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:04:24.472 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:24.472+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:24.573 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:24.572+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:24.574 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:04:24.615 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:04:24.616 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-09-30T17:04:24.616 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-09-30T17:04:24.616 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:04:24.619 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:04:24.619 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:04:24.641 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:04:24.641 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 20, 2023-09-30T17:04:24.641 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 600, 2023-09-30T17:04:24.641 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:04:24.641 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.641 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109497 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 49152~4096 in=4096b,write 106496~4096 in=4096b,write 163840~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:24.641 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.624224+0000", 2023-09-30T17:04:24.641 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 15.014091182, 2023-09-30T17:04:24.642 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.717345754, 2023-09-30T17:04:24.642 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:24.642 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:24.642 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:24.643 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:24.643 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:24.643 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109497 2023-09-30T17:04:24.643 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.643 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:24.643 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.643 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:24.643 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624224+0000", 2023-09-30T17:04:24.643 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:24.643 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.644 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.644 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:24.644 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624224+0000", 2023-09-30T17:04:24.644 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:24.644 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.644 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.644 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:24.644 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624224+0000", 2023-09-30T17:04:24.644 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9299999999999998e-07 2023-09-30T17:04:24.644 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.644 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.645 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:24.645 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624238+0000", 2023-09-30T17:04:24.645 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4144999999999999e-05 2023-09-30T17:04:24.645 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.645 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.645 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:24.645 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624439+0000", 2023-09-30T17:04:24.645 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00020105200000000001 2023-09-30T17:04:24.645 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.645 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.645 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:24.645 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624447+0000", 2023-09-30T17:04:24.646 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0499999999999992e-06 2023-09-30T17:04:24.646 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.646 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.646 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:24.646 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.022040+0000", 2023-09-30T17:04:24.646 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39759262099999998 2023-09-30T17:04:24.646 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.646 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.646 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:24.646 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.022117+0000", 2023-09-30T17:04:24.647 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6834000000000003e-05 2023-09-30T17:04:24.647 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.647 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.647 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:24.647 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.022269+0000", 2023-09-30T17:04:24.647 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015254600000000001 2023-09-30T17:04:24.647 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.647 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.647 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:24.648 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.058505+0000", 2023-09-30T17:04:24.648 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.036235394999999997 2023-09-30T17:04:24.648 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.648 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.648 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:24.648 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.341470+0000", 2023-09-30T17:04:24.648 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.28296523600000001 2023-09-30T17:04:24.648 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.648 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.648 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:24.649 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.341530+0000", 2023-09-30T17:04:24.649 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9939000000000003e-05 2023-09-30T17:04:24.649 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.649 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.649 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:24.649 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.341569+0000", 2023-09-30T17:04:24.649 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9342999999999999e-05 2023-09-30T17:04:24.649 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:24.649 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:24.649 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:24.649 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.650 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.650 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109508 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 2650112~4096 in=4096b,write 2723840~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:24.650 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.624554+0000", 2023-09-30T17:04:24.650 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 15.013760546, 2023-09-30T17:04:24.650 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.717264546, 2023-09-30T17:04:24.650 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:24.650 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:24.650 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:24.650 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:24.650 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:24.650 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109508 2023-09-30T17:04:24.651 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.651 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:24.651 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.651 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:24.651 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624554+0000", 2023-09-30T17:04:24.651 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:24.651 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.651 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.651 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:24.651 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624554+0000", 2023-09-30T17:04:24.651 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:24.651 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.651 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.652 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:24.652 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624555+0000", 2023-09-30T17:04:24.652 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.51e-07 2023-09-30T17:04:24.652 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.652 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.652 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:24.652 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624573+0000", 2023-09-30T17:04:24.652 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8519e-05 2023-09-30T17:04:24.652 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.652 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.653 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:24.653 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624582+0000", 2023-09-30T17:04:24.653 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.6489999999999997e-06 2023-09-30T17:04:24.653 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.653 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.653 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:24.653 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624588+0000", 2023-09-30T17:04:24.653 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4980000000000003e-06 2023-09-30T17:04:24.653 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.653 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.653 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:24.654 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.028302+0000", 2023-09-30T17:04:24.654 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.40371393 2023-09-30T17:04:24.654 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.654 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.654 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:24.654 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.028383+0000", 2023-09-30T17:04:24.654 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1069000000000006e-05 2023-09-30T17:04:24.654 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.654 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.654 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:24.655 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.028546+0000", 2023-09-30T17:04:24.655 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000162256 2023-09-30T17:04:24.655 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.655 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.655 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:24.655 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.058510+0000", 2023-09-30T17:04:24.655 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.029964937000000001 2023-09-30T17:04:24.655 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.655 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.655 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:24.656 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.341742+0000", 2023-09-30T17:04:24.656 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.28323117799999997 2023-09-30T17:04:24.656 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.656 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.656 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:24.656 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.341788+0000", 2023-09-30T17:04:24.656 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6118999999999997e-05 2023-09-30T17:04:24.656 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.656 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.656 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:24.656 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.341819+0000", 2023-09-30T17:04:24.656 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0939999999999999e-05 2023-09-30T17:04:24.657 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:24.657 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:24.657 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:24.657 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.657 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.657 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109527 4.6 4:616d4c41:::100000001f8.00000034:head [write 122880~4096 in=4096b,write 143360~4096 in=4096b,write 151552~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:24.657 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.630262+0000", 2023-09-30T17:04:24.657 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 15.008052946999999, 2023-09-30T17:04:24.657 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.72988284299999995, 2023-09-30T17:04:24.657 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:24.657 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:24.658 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:24.658 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:24.658 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:24.658 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109527 2023-09-30T17:04:24.658 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.658 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:24.658 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.658 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:24.658 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.630262+0000", 2023-09-30T17:04:24.658 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:24.658 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.658 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.659 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:24.659 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.630262+0000", 2023-09-30T17:04:24.659 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:24.659 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.659 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.659 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:24.659 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.632170+0000", 2023-09-30T17:04:24.659 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0019085529999999999 2023-09-30T17:04:24.659 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.659 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.660 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:24.660 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.632192+0000", 2023-09-30T17:04:24.660 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1243999999999999e-05 2023-09-30T17:04:24.660 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.660 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.660 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:24.660 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.632203+0000", 2023-09-30T17:04:24.660 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1389999999999999e-05 2023-09-30T17:04:24.660 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.660 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.660 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:24.661 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.632211+0000", 2023-09-30T17:04:24.661 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8939999999999993e-06 2023-09-30T17:04:24.661 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.661 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.661 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:24.661 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.031203+0000", 2023-09-30T17:04:24.661 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39899208800000002 2023-09-30T17:04:24.661 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.661 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.661 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:24.661 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.031278+0000", 2023-09-30T17:04:24.661 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4988999999999996e-05 2023-09-30T17:04:24.662 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.662 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.662 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:24.662 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.031432+0000", 2023-09-30T17:04:24.662 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000154396 2023-09-30T17:04:24.662 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.662 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.662 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:24.662 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.058953+0000", 2023-09-30T17:04:24.662 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.027520464000000001 2023-09-30T17:04:24.662 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.663 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.663 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:24.663 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360042+0000", 2023-09-30T17:04:24.663 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.30108895699999999 2023-09-30T17:04:24.663 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.663 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.663 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:24.663 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360103+0000", 2023-09-30T17:04:24.663 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1364000000000004e-05 2023-09-30T17:04:24.663 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.663 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.663 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:24.664 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360145+0000", 2023-09-30T17:04:24.664 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1504000000000001e-05 2023-09-30T17:04:24.664 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:24.664 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:24.664 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:24.664 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.664 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.664 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109554 4.6 4:616d4c41:::100000001f8.00000034:head [write 1323008~4096 in=4096b,write 1675264~4096 in=4096b,write 1695744~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:24.664 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.646316+0000", 2023-09-30T17:04:24.664 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 14.991998632, 2023-09-30T17:04:24.664 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.71401674900000001, 2023-09-30T17:04:24.664 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:24.665 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:24.665 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:24.665 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:24.665 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:24.665 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109554 2023-09-30T17:04:24.665 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.665 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:24.665 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.665 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:24.665 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646316+0000", 2023-09-30T17:04:24.665 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:24.666 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.666 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.666 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:24.666 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646316+0000", 2023-09-30T17:04:24.666 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:24.666 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.666 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.666 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:24.666 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646317+0000", 2023-09-30T17:04:24.666 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9100000000000004e-07 2023-09-30T17:04:24.666 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.666 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.667 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:24.667 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646328+0000", 2023-09-30T17:04:24.667 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1832e-05 2023-09-30T17:04:24.667 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.667 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.667 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:24.667 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646335+0000", 2023-09-30T17:04:24.667 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7299999999999999e-06 2023-09-30T17:04:24.667 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.667 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.667 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:24.667 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646342+0000", 2023-09-30T17:04:24.668 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5309999999999998e-06 2023-09-30T17:04:24.668 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.668 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.668 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:24.668 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.033952+0000", 2023-09-30T17:04:24.668 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.38760991099999997 2023-09-30T17:04:24.668 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.668 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.668 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:24.668 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.034037+0000", 2023-09-30T17:04:24.668 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5483999999999997e-05 2023-09-30T17:04:24.669 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.669 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.669 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:24.669 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.034208+0000", 2023-09-30T17:04:24.669 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000170946 2023-09-30T17:04:24.669 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.669 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.669 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:24.669 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.058968+0000", 2023-09-30T17:04:24.669 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024760305 2023-09-30T17:04:24.669 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.669 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.670 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:24.670 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360244+0000", 2023-09-30T17:04:24.670 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.30127521699999998 2023-09-30T17:04:24.670 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.670 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.670 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:24.670 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360292+0000", 2023-09-30T17:04:24.670 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8689000000000001e-05 2023-09-30T17:04:24.670 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.670 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.670 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:24.670 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360333+0000", 2023-09-30T17:04:24.671 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0612999999999999e-05 2023-09-30T17:04:24.671 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:24.671 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:24.671 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:24.671 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.671 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.671 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109559 4.36 4:6da220e6:::100000001f8.0000003f:head [write 2142208~4096 in=4096b,write 2183168~4096 in=4096b,write 2220032~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:24.671 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.646349+0000", 2023-09-30T17:04:24.671 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 14.991966186999999, 2023-09-30T17:04:24.671 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.70604406399999997, 2023-09-30T17:04:24.671 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:24.671 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:24.672 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:24.672 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:24.672 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:24.672 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109559 2023-09-30T17:04:24.672 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.672 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:24.672 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.672 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:24.672 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646349+0000", 2023-09-30T17:04:24.672 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:24.672 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.673 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.673 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:24.673 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646349+0000", 2023-09-30T17:04:24.673 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:24.673 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.673 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.673 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:24.673 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646349+0000", 2023-09-30T17:04:24.673 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8500000000000002e-07 2023-09-30T17:04:24.673 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.673 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.673 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:24.674 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646360+0000", 2023-09-30T17:04:24.674 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1255e-05 2023-09-30T17:04:24.674 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.674 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.674 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:24.674 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646366+0000", 2023-09-30T17:04:24.674 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9959999999999999e-06 2023-09-30T17:04:24.674 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.674 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.674 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:24.674 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646371+0000", 2023-09-30T17:04:24.674 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9010000000000002e-06 2023-09-30T17:04:24.675 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.675 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.675 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:24.675 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.033938+0000", 2023-09-30T17:04:24.675 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.38756676699999998 2023-09-30T17:04:24.675 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.675 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.675 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:24.675 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.034023+0000", 2023-09-30T17:04:24.675 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5011000000000003e-05 2023-09-30T17:04:24.675 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.676 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.676 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:24.676 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.034178+0000", 2023-09-30T17:04:24.676 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000155267 2023-09-30T17:04:24.676 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.676 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.676 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:24.676 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.058961+0000", 2023-09-30T17:04:24.676 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024782786000000001 2023-09-30T17:04:24.676 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.676 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.676 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:24.676 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.352309+0000", 2023-09-30T17:04:24.677 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.29334778500000003 2023-09-30T17:04:24.677 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.677 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.677 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:24.677 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.352356+0000", 2023-09-30T17:04:24.677 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7153000000000001e-05 2023-09-30T17:04:24.677 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.677 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.677 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:24.677 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.352393+0000", 2023-09-30T17:04:24.677 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6658e-05 2023-09-30T17:04:24.678 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:24.678 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:24.678 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:24.678 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.678 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.678 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109562 4.6 4:616d4c41:::100000001f8.00000034:head [write 4071424~4096 in=4096b,write 4161536~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:24.678 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.650213+0000", 2023-09-30T17:04:24.678 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 14.988101475000001, 2023-09-30T17:04:24.678 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.71023619199999999, 2023-09-30T17:04:24.678 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:24.678 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:24.679 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:24.679 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:24.679 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:24.679 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109562 2023-09-30T17:04:24.679 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.679 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:24.679 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.679 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:24.679 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.650213+0000", 2023-09-30T17:04:24.679 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:24.679 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.679 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.680 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:24.680 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.650213+0000", 2023-09-30T17:04:24.680 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:24.680 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.680 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.680 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:24.680 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.650214+0000", 2023-09-30T17:04:24.680 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1200000000000003e-07 2023-09-30T17:04:24.680 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.680 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.680 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:24.681 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.650227+0000", 2023-09-30T17:04:24.681 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.287e-05 2023-09-30T17:04:24.681 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.681 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.681 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:24.681 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.650235+0000", 2023-09-30T17:04:24.681 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8189999999999992e-06 2023-09-30T17:04:24.681 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.681 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.681 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:24.681 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.650241+0000", 2023-09-30T17:04:24.681 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3749999999999999e-06 2023-09-30T17:04:24.682 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.682 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.682 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:24.682 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.042530+0000", 2023-09-30T17:04:24.682 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39228892399999998 2023-09-30T17:04:24.682 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.682 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.682 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:24.682 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.042619+0000", 2023-09-30T17:04:24.682 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8838999999999994e-05 2023-09-30T17:04:24.682 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.682 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.683 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:24.683 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.042773+0000", 2023-09-30T17:04:24.683 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000154456 2023-09-30T17:04:24.683 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.683 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.683 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:24.683 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.059137+0000", 2023-09-30T17:04:24.683 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.016363800000000001 2023-09-30T17:04:24.683 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.683 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.683 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:24.684 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360385+0000", 2023-09-30T17:04:24.684 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.30124847199999999 2023-09-30T17:04:24.684 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.684 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.684 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:24.684 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360418+0000", 2023-09-30T17:04:24.684 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.2688000000000003e-05 2023-09-30T17:04:24.684 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.684 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.684 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:24.684 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360449+0000", 2023-09-30T17:04:24.684 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.1337000000000002e-05 2023-09-30T17:04:24.685 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:24.685 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:24.685 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:24.685 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.685 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.685 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109578 4.36 4:6fa85f86:::100000001f8.00000013:head [write 749568~4096 in=4096b,write 970752~4096 in=4096b,write 1007616~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:24.685 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.650465+0000", 2023-09-30T17:04:24.685 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 14.987849629999999, 2023-09-30T17:04:24.685 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.70982843399999995, 2023-09-30T17:04:24.685 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:24.686 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:24.686 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:24.686 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:24.686 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:24.686 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109578 2023-09-30T17:04:24.686 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.686 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:24.686 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.686 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:24.686 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.650465+0000", 2023-09-30T17:04:24.686 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:24.686 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.687 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.687 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:24.687 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.650465+0000", 2023-09-30T17:04:24.687 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:24.687 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.687 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.687 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:24.687 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.654163+0000", 2023-09-30T17:04:24.687 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00369798 2023-09-30T17:04:24.687 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.687 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.687 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:24.688 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.654176+0000", 2023-09-30T17:04:24.688 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2765000000000001e-05 2023-09-30T17:04:24.688 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.688 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.688 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:24.689 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.654187+0000", 2023-09-30T17:04:24.689 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.078e-05 2023-09-30T17:04:24.689 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.689 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.689 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:24.689 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.654192+0000", 2023-09-30T17:04:24.690 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8880000000000002e-06 2023-09-30T17:04:24.690 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.690 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.690 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:24.690 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.045826+0000", 2023-09-30T17:04:24.690 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39163316300000001 2023-09-30T17:04:24.690 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.690 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.690 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:24.690 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.045900+0000", 2023-09-30T17:04:24.690 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3905000000000005e-05 2023-09-30T17:04:24.691 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.691 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.691 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:24.691 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.046309+0000", 2023-09-30T17:04:24.691 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00040957400000000001 2023-09-30T17:04:24.691 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.691 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.691 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:24.691 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.076789+0000", 2023-09-30T17:04:24.691 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.030479506999999999 2023-09-30T17:04:24.691 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.692 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.692 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:24.692 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360197+0000", 2023-09-30T17:04:24.692 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.28340816699999999 2023-09-30T17:04:24.692 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.692 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.692 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:24.692 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360254+0000", 2023-09-30T17:04:24.692 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7574000000000001e-05 2023-09-30T17:04:24.692 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.692 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.693 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:24.693 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360294+0000", 2023-09-30T17:04:24.693 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9131000000000002e-05 2023-09-30T17:04:24.693 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:24.693 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:24.693 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:24.693 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.693 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.693 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109582 4.6 4:616d4c41:::100000001f8.00000034:head [write 32768~4096 in=4096b,write 90112~4096 in=4096b,write 180224~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:24.693 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.654253+0000", 2023-09-30T17:04:24.693 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 14.984061385, 2023-09-30T17:04:24.693 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.71919376800000001, 2023-09-30T17:04:24.694 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:24.694 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:24.694 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:24.694 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:24.694 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:24.694 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109582 2023-09-30T17:04:24.694 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.694 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:24.694 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.694 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:24.694 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.654253+0000", 2023-09-30T17:04:24.695 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:24.695 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.695 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.695 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:24.695 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.654253+0000", 2023-09-30T17:04:24.695 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:24.695 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.695 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.695 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:24.695 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658162+0000", 2023-09-30T17:04:24.695 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0039091320000000001 2023-09-30T17:04:24.695 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.696 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.696 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:24.696 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658178+0000", 2023-09-30T17:04:24.696 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5719e-05 2023-09-30T17:04:24.696 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.696 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.696 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:24.696 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658189+0000", 2023-09-30T17:04:24.696 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1043000000000001e-05 2023-09-30T17:04:24.696 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.696 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.697 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:24.697 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658198+0000", 2023-09-30T17:04:24.697 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4090000000000003e-06 2023-09-30T17:04:24.697 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.697 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.697 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:24.697 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051307+0000", 2023-09-30T17:04:24.697 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39310928899999997 2023-09-30T17:04:24.697 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.697 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.697 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:24.697 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051392+0000", 2023-09-30T17:04:24.698 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4850000000000002e-05 2023-09-30T17:04:24.698 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.698 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.698 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:24.698 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051575+0000", 2023-09-30T17:04:24.698 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00018296999999999999 2023-09-30T17:04:24.698 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.698 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.698 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:24.698 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.076797+0000", 2023-09-30T17:04:24.698 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.025222616999999999 2023-09-30T17:04:24.698 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.699 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.699 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:24.699 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.373335+0000", 2023-09-30T17:04:24.699 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.29653762299999997 2023-09-30T17:04:24.699 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.699 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.699 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:24.699 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.373404+0000", 2023-09-30T17:04:24.699 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8633999999999994e-05 2023-09-30T17:04:24.699 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.699 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.700 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:24.700 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.373447+0000", 2023-09-30T17:04:24.700 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3482000000000001e-05 2023-09-30T17:04:24.700 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:24.700 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:24.700 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:24.700 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.700 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.700 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109583 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 1945600~8192 in=8192b,write 2285568~4096 in=4096b,write 2301952~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:24.700 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.658212+0000", 2023-09-30T17:04:24.700 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 14.980102711000001, 2023-09-30T17:04:24.701 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.71553887199999999, 2023-09-30T17:04:24.701 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:24.701 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:24.701 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:24.701 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:24.701 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:24.701 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109583 2023-09-30T17:04:24.701 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.701 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:24.701 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.701 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:24.701 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658212+0000", 2023-09-30T17:04:24.702 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:24.702 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.702 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.702 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:24.702 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658212+0000", 2023-09-30T17:04:24.702 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:24.702 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.702 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.702 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:24.702 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658213+0000", 2023-09-30T17:04:24.702 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6000000000000004e-07 2023-09-30T17:04:24.703 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.703 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.703 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:24.703 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658225+0000", 2023-09-30T17:04:24.703 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2887e-05 2023-09-30T17:04:24.703 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.703 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.703 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:24.703 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658233+0000", 2023-09-30T17:04:24.703 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2620000000000001e-06 2023-09-30T17:04:24.703 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.703 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.704 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:24.704 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658239+0000", 2023-09-30T17:04:24.704 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4300000000000003e-06 2023-09-30T17:04:24.704 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.704 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.704 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:24.704 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.055877+0000", 2023-09-30T17:04:24.704 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39763770799999998 2023-09-30T17:04:24.704 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.704 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.705 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:24.705 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.055965+0000", 2023-09-30T17:04:24.705 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8125000000000001e-05 2023-09-30T17:04:24.705 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.705 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.705 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:24.705 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.056131+0000", 2023-09-30T17:04:24.705 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000165971 2023-09-30T17:04:24.705 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.705 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.705 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:24.705 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.077434+0000", 2023-09-30T17:04:24.706 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.021303441999999999 2023-09-30T17:04:24.706 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.706 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.706 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:24.706 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.373658+0000", 2023-09-30T17:04:24.706 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.29622356300000002 2023-09-30T17:04:24.706 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.706 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.706 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:24.706 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.373716+0000", 2023-09-30T17:04:24.706 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8161000000000001e-05 2023-09-30T17:04:24.707 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.707 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.707 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:24.707 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.373751+0000", 2023-09-30T17:04:24.707 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4762999999999999e-05 2023-09-30T17:04:24.707 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:24.707 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:24.707 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:24.707 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.707 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.707 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109692 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 2957312~4096 in=4096b,write 3039232~4096 in=4096b,write 3047424~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:24.707 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.707348+0000", 2023-09-30T17:04:24.708 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 14.930966829999999, 2023-09-30T17:04:24.708 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.70916258899999995, 2023-09-30T17:04:24.708 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:24.708 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:24.708 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:24.708 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:24.708 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:24.708 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109692 2023-09-30T17:04:24.708 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.708 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:24.708 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.709 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:24.709 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.707348+0000", 2023-09-30T17:04:24.709 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:24.709 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.709 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.709 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:24.709 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.707348+0000", 2023-09-30T17:04:24.709 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:24.709 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.709 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.709 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:24.710 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.707348+0000", 2023-09-30T17:04:24.710 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8400000000000004e-07 2023-09-30T17:04:24.710 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.710 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.710 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:24.711 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.707362+0000", 2023-09-30T17:04:24.711 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3131e-05 2023-09-30T17:04:24.711 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.711 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.711 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:24.711 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.707369+0000", 2023-09-30T17:04:24.711 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.875e-06 2023-09-30T17:04:24.711 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.711 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.711 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:24.711 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.707375+0000", 2023-09-30T17:04:24.712 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7799999999999997e-06 2023-09-30T17:04:24.712 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.712 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.712 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:24.712 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.093520+0000", 2023-09-30T17:04:24.712 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.38614510299999999 2023-09-30T17:04:24.712 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.712 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.712 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:24.712 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.093592+0000", 2023-09-30T17:04:24.712 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1588999999999995e-05 2023-09-30T17:04:24.712 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.713 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.713 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:24.713 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.093734+0000", 2023-09-30T17:04:24.713 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014193800000000001 2023-09-30T17:04:24.713 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.713 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.713 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:24.713 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.111441+0000", 2023-09-30T17:04:24.713 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.017706676000000001 2023-09-30T17:04:24.713 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.713 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.714 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:24.714 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.416425+0000", 2023-09-30T17:04:24.714 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.30498444499999999 2023-09-30T17:04:24.714 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.714 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.714 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:24.714 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.416475+0000", 2023-09-30T17:04:24.714 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0427999999999999e-05 2023-09-30T17:04:24.714 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.714 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.714 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:24.714 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.416510+0000", 2023-09-30T17:04:24.715 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5040000000000003e-05 2023-09-30T17:04:24.715 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:24.715 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:24.715 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:24.715 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.715 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.715 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109697 4.6 4:63e80496:::100000001f8.0000001e:head [write 1617920~4096 in=4096b,write 1830912~4096 in=4096b,write 1875968~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:24.715 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.711270+0000", 2023-09-30T17:04:24.715 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 14.927044457000001, 2023-09-30T17:04:24.715 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.70601983400000001, 2023-09-30T17:04:24.715 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:24.715 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:24.716 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:24.716 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:24.716 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:24.716 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109697 2023-09-30T17:04:24.716 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.716 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:24.716 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.716 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:24.716 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.711270+0000", 2023-09-30T17:04:24.716 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:24.716 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.717 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.717 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:24.717 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.711270+0000", 2023-09-30T17:04:24.717 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:24.717 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.717 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.717 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:24.717 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.711271+0000", 2023-09-30T17:04:24.717 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4400000000000001e-07 2023-09-30T17:04:24.717 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.717 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.717 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:24.718 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.711284+0000", 2023-09-30T17:04:24.718 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.342e-05 2023-09-30T17:04:24.718 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.718 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.718 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:24.718 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.711296+0000", 2023-09-30T17:04:24.718 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2309e-05 2023-09-30T17:04:24.718 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.718 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.718 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:24.718 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.711303+0000", 2023-09-30T17:04:24.718 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9789999999999996e-06 2023-09-30T17:04:24.719 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:24.719 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:24.719 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:24.719 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.098461+0000", 2023-09-30T17:04:24.719 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.38715737300000003 2023-09-30T17:04:25.418 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:25.419 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:25.419 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:25.419 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.098551+0000", 2023-09-30T17:04:25.419 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.0610000000000002e-05 2023-09-30T17:04:25.419 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:25.419 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:25.424 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:25.425 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.098728+0000", 2023-09-30T17:04:25.425 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017616499999999999 2023-09-30T17:04:25.425 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:25.425 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:25.425 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:25.425 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.123046+0000", 2023-09-30T17:04:25.425 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024318095000000001 2023-09-30T17:04:25.425 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:25.425 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:25.426 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:25.426 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.417208+0000", 2023-09-30T17:04:25.427 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.29416202499999999 2023-09-30T17:04:25.427 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:25.427 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:25.427 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:25.427 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.417257+0000", 2023-09-30T17:04:25.427 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9249999999999998e-05 2023-09-30T17:04:25.427 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:25.427 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:25.427 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:25.428 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.417290+0000", 2023-09-30T17:04:25.428 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.3164000000000003e-05 2023-09-30T17:04:25.428 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:25.428 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:25.428 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:25.428 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:25.428 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:25.428 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:141180 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 3731456~4096,write 3870720~4096,write 3878912~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:25.428 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:21.530290+0000", 2023-09-30T17:04:25.428 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 3.1080243529999998, 2023-09-30T17:04:25.429 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.71324517200000004, 2023-09-30T17:04:25.429 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:25.429 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:25.429 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:25.429 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:25.429 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:25.429 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 141180 2023-09-30T17:04:25.429 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:25.429 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:25.429 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:25.429 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:25.430 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.530290+0000", 2023-09-30T17:04:25.430 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:25.430 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:25.430 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:25.430 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:25.430 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.530290+0000", 2023-09-30T17:04:25.430 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:25.430 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:25.430 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:25.430 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:25.430 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.532163+0000", 2023-09-30T17:04:25.431 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0018726050000000001 2023-09-30T17:04:25.431 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:25.431 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:25.431 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:25.431 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.532178+0000", 2023-09-30T17:04:25.431 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5318000000000001e-05 2023-09-30T17:04:25.431 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:25.431 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:25.431 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:25.431 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.532187+0000", 2023-09-30T17:04:25.432 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8370000000000003e-06 2023-09-30T17:04:25.432 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:25.432 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:25.432 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:25.432 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.532192+0000", 2023-09-30T17:04:25.432 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2499999999999997e-06 2023-09-30T17:04:25.432 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:25.432 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:25.432 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:25.432 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.974315+0000", 2023-09-30T17:04:25.432 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.442122923 2023-09-30T17:04:25.433 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:25.433 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:25.433 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:25.433 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.974378+0000", 2023-09-30T17:04:25.433 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2890000000000003e-05 2023-09-30T17:04:25.433 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:25.433 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:25.433 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:25.433 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.974477+0000", 2023-09-30T17:04:25.433 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8448000000000003e-05 2023-09-30T17:04:25.433 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:25.434 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:25.434 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:25.434 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.997333+0000", 2023-09-30T17:04:25.434 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.022856383000000001 2023-09-30T17:04:25.434 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:25.434 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:25.434 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:25.434 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.243461+0000", 2023-09-30T17:04:25.434 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.24612841699999999 2023-09-30T17:04:25.435 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:25.435 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:25.435 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:25.435 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.243511+0000", 2023-09-30T17:04:25.435 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9719999999999998e-05 2023-09-30T17:04:25.435 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:25.435 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:25.435 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:25.435 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.243536+0000", 2023-09-30T17:04:25.435 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4380999999999999e-05 2023-09-30T17:04:25.435 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:25.436 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:25.436 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:25.436 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:25.436 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:25.436 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:141188 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 860160~4096,write 905216~4096,write 946176~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:25.436 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:21.538221+0000", 2023-09-30T17:04:25.436 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 3.1000940159999999, 2023-09-30T17:04:25.436 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.70549808800000002, 2023-09-30T17:04:25.436 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:25.436 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:25.436 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:25.437 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:25.437 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:25.437 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 141188 2023-09-30T17:04:25.437 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:25.437 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:25.437 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:25.437 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:25.437 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538221+0000", 2023-09-30T17:04:25.437 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:25.437 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:25.437 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:25.438 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:25.438 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538221+0000", 2023-09-30T17:04:25.438 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:25.438 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:25.883 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:25.883 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:25.883 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538221+0000", 2023-09-30T17:04:25.883 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6400000000000002e-07 2023-09-30T17:04:25.883 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:25.883 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:25.883 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:25.883 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538239+0000", 2023-09-30T17:04:25.884 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7504e-05 2023-09-30T17:04:25.884 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:25.884 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:25.884 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:25.884 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538246+0000", 2023-09-30T17:04:25.884 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2509999999999997e-06 2023-09-30T17:04:25.884 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:25.884 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:25.884 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:25.884 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538253+0000", 2023-09-30T17:04:25.885 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0849999999999999e-06 2023-09-30T17:04:25.885 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:25.885 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:25.885 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:25.885 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.976868+0000", 2023-09-30T17:04:25.885 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.43861486900000002 2023-09-30T17:04:25.885 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:25.885 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:25.885 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:25.885 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.976954+0000", 2023-09-30T17:04:25.885 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5958999999999995e-05 2023-09-30T17:04:25.886 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:25.886 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:25.886 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:25.886 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.977121+0000", 2023-09-30T17:04:25.886 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016687000000000001 2023-09-30T17:04:25.886 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:25.886 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:25.886 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:25.886 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.997338+0000", 2023-09-30T17:04:25.886 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.020217244999999998 2023-09-30T17:04:25.886 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:25.887 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:25.887 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:25.887 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.243601+0000", 2023-09-30T17:04:25.887 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.24626245599999999 2023-09-30T17:04:25.887 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:25.887 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:25.887 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:25.887 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.243666+0000", 2023-09-30T17:04:25.887 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5209999999999994e-05 2023-09-30T17:04:25.887 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:25.888 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:25.888 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:25.888 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.243719+0000", 2023-09-30T17:04:25.888 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3075000000000003e-05 2023-09-30T17:04:25.888 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:25.888 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:25.888 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:25.888 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:25.888 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:25.888 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:141192 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 241664~4096,write 294912~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:25.888 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:21.538409+0000", 2023-09-30T17:04:25.889 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 3.0999061330000002, 2023-09-30T17:04:25.889 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.70542575399999996, 2023-09-30T17:04:25.889 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:25.889 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:25.889 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:25.889 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:25.889 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:25.889 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 141192 2023-09-30T17:04:25.889 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:25.889 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:25.890 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:25.890 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:25.890 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538409+0000", 2023-09-30T17:04:25.890 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:25.890 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:25.890 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:25.890 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:25.890 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538409+0000", 2023-09-30T17:04:25.891 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:25.891 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:25.891 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:25.891 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:25.891 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538409+0000", 2023-09-30T17:04:25.891 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0999999999999999e-07 2023-09-30T17:04:25.891 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:25.891 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:25.891 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:25.891 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538430+0000", 2023-09-30T17:04:25.892 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.0763000000000001e-05 2023-09-30T17:04:25.892 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:25.892 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:25.892 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:25.892 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538437+0000", 2023-09-30T17:04:25.892 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0099999999999998e-06 2023-09-30T17:04:25.892 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.039 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.039 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.040 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538442+0000", 2023-09-30T17:04:26.040 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1749999999999996e-06 2023-09-30T17:04:26.040 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.040 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.040 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:26.040 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.986793+0000", 2023-09-30T17:04:26.040 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.44835079799999999 2023-09-30T17:04:26.042 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.042 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.042 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:26.042 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.986912+0000", 2023-09-30T17:04:26.043 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00011949 2023-09-30T17:04:26.043 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.043 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.043 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:26.043 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.987038+0000", 2023-09-30T17:04:26.044 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00012536000000000001 2023-09-30T17:04:26.044 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.044 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.044 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:26.045 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.015011+0000", 2023-09-30T17:04:26.045 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.027973207999999999 2023-09-30T17:04:26.045 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.045 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.046 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:26.046 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.243764+0000", 2023-09-30T17:04:26.047 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.228753122 2023-09-30T17:04:26.047 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.047 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.048 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:26.049 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.243808+0000", 2023-09-30T17:04:26.050 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4388999999999998e-05 2023-09-30T17:04:26.050 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.050 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.050 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:26.052 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.243834+0000", 2023-09-30T17:04:26.052 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.5928999999999999e-05 2023-09-30T17:04:26.052 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:26.052 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:26.052 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:26.052 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.052 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.052 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:141198 4.36 4:6da220e6:::100000001f8.0000003f:head [write 2576384~4096,write 2854912~4096,write 2985984~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.052 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:21.538523+0000", 2023-09-30T17:04:26.052 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 3.0997913549999998, 2023-09-30T17:04:26.053 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.71183603399999995, 2023-09-30T17:04:26.053 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:26.053 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:26.053 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:26.053 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:26.053 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.053 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 141198 2023-09-30T17:04:26.053 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.053 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:26.053 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.054 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:26.054 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538523+0000", 2023-09-30T17:04:26.054 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:26.054 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.054 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.054 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:26.054 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538523+0000", 2023-09-30T17:04:26.054 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:26.054 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.054 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.054 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:26.055 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538524+0000", 2023-09-30T17:04:26.055 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.51e-07 2023-09-30T17:04:26.055 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.055 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.055 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:26.055 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538535+0000", 2023-09-30T17:04:26.055 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1620999999999999e-05 2023-09-30T17:04:26.055 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.055 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.055 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:26.056 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538542+0000", 2023-09-30T17:04:26.056 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1430000000000003e-06 2023-09-30T17:04:26.056 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.057 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.057 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.057 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538547+0000", 2023-09-30T17:04:26.057 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7649999999999999e-06 2023-09-30T17:04:26.058 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.058 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.058 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:26.058 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.989582+0000", 2023-09-30T17:04:26.058 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.45103486500000001 2023-09-30T17:04:26.058 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.058 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.058 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:26.058 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.989668+0000", 2023-09-30T17:04:26.058 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.6063999999999995e-05 2023-09-30T17:04:26.059 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.059 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.059 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:26.059 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.989829+0000", 2023-09-30T17:04:26.059 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016024299999999999 2023-09-30T17:04:26.059 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.059 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.059 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:26.059 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.015017+0000", 2023-09-30T17:04:26.062 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.025188043 2023-09-30T17:04:26.062 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.062 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.062 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:26.062 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.250275+0000", 2023-09-30T17:04:26.062 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23525855000000001 2023-09-30T17:04:26.062 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.062 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.062 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:26.062 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.250325+0000", 2023-09-30T17:04:26.063 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9429999999999999e-05 2023-09-30T17:04:26.063 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.063 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.063 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:26.063 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.250359+0000", 2023-09-30T17:04:26.064 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4858999999999999e-05 2023-09-30T17:04:26.064 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:26.064 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:26.064 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:26.064 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.064 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.064 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:141203 4.6 4:616d4c41:::100000001f8.00000034:head [write 1753088~4096,write 1773568~4096,write 1912832~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.064 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:21.538615+0000", 2023-09-30T17:04:26.065 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 3.099699754, 2023-09-30T17:04:26.065 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.71145826700000003, 2023-09-30T17:04:26.065 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:26.065 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:26.065 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:26.065 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:26.066 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.066 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 141203 2023-09-30T17:04:26.066 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.066 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:26.066 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.066 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:26.067 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538615+0000", 2023-09-30T17:04:26.067 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:26.067 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.067 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.068 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:26.068 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538615+0000", 2023-09-30T17:04:26.068 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:26.068 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.068 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.068 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:26.068 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538615+0000", 2023-09-30T17:04:26.068 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.89e-07 2023-09-30T17:04:26.069 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.069 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.069 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:26.069 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538627+0000", 2023-09-30T17:04:26.069 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1639e-05 2023-09-30T17:04:26.069 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.070 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.070 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:26.070 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538633+0000", 2023-09-30T17:04:26.070 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8540000000000002e-06 2023-09-30T17:04:26.070 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.071 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.071 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.071 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538638+0000", 2023-09-30T17:04:26.071 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7280000000000003e-06 2023-09-30T17:04:26.071 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.072 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.072 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:26.072 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.997432+0000", 2023-09-30T17:04:26.072 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.45879420399999998 2023-09-30T17:04:26.072 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.072 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.073 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:26.073 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.997483+0000", 2023-09-30T17:04:26.073 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1261000000000003e-05 2023-09-30T17:04:26.073 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.073 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.073 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:26.073 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.997574+0000", 2023-09-30T17:04:26.073 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.145e-05 2023-09-30T17:04:26.074 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.074 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.074 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:26.074 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.015021+0000", 2023-09-30T17:04:26.074 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.017446804999999999 2023-09-30T17:04:26.074 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.075 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.075 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:26.075 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.249978+0000", 2023-09-30T17:04:26.075 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23495672200000001 2023-09-30T17:04:26.075 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.076 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.076 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:26.076 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.250032+0000", 2023-09-30T17:04:26.076 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4342000000000002e-05 2023-09-30T17:04:26.076 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.076 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.077 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:26.077 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.250073+0000", 2023-09-30T17:04:26.077 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0873e-05 2023-09-30T17:04:26.077 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:26.077 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:26.077 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:26.077 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.077 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.078 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:141205 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 999424~4096,write 1056768~4096,write 1073152~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.078 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:21.538677+0000", 2023-09-30T17:04:26.078 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 3.0996376849999998, 2023-09-30T17:04:26.078 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.71155133500000001, 2023-09-30T17:04:26.078 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:26.078 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:26.079 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:26.079 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:26.079 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.079 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 141205 2023-09-30T17:04:26.079 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.079 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:26.079 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.079 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:26.079 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538677+0000", 2023-09-30T17:04:26.079 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:26.079 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.080 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.080 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:26.080 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538677+0000", 2023-09-30T17:04:26.080 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:26.080 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.080 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.080 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:26.080 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538678+0000", 2023-09-30T17:04:26.080 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1099999999999996e-07 2023-09-30T17:04:26.080 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.081 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.081 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:26.081 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538691+0000", 2023-09-30T17:04:26.081 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3621999999999999e-05 2023-09-30T17:04:26.081 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.081 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.081 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:26.081 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538698+0000", 2023-09-30T17:04:26.082 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9670000000000004e-06 2023-09-30T17:04:26.082 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.082 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.082 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.082 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538705+0000", 2023-09-30T17:04:26.082 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8399999999999997e-06 2023-09-30T17:04:26.083 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.083 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.083 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:26.083 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.000125+0000", 2023-09-30T17:04:26.083 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.46141995800000002 2023-09-30T17:04:26.083 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.084 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.084 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:26.084 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.000207+0000", 2023-09-30T17:04:26.084 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2566999999999997e-05 2023-09-30T17:04:26.084 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.084 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.084 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:26.084 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.000366+0000", 2023-09-30T17:04:26.085 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015829200000000001 2023-09-30T17:04:26.085 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.085 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.085 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:26.085 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.015024+0000", 2023-09-30T17:04:26.085 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.014658582 2023-09-30T17:04:26.085 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.085 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.085 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:26.086 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.250132+0000", 2023-09-30T17:04:26.086 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23510737800000001 2023-09-30T17:04:26.086 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.087 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.087 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:26.088 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.250192+0000", 2023-09-30T17:04:26.088 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0609000000000002e-05 2023-09-30T17:04:26.088 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.088 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.088 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:26.088 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.250228+0000", 2023-09-30T17:04:26.088 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6009e-05 2023-09-30T17:04:26.088 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:26.088 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:26.089 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:26.089 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.089 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.089 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:141206 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 2277376~8192,write 2301952~4096,write 2334720~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.089 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:21.538714+0000", 2023-09-30T17:04:26.089 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 3.0996008239999999, 2023-09-30T17:04:26.089 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.71165632199999995, 2023-09-30T17:04:26.089 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:26.089 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:26.090 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:26.090 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:26.090 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.090 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 141206 2023-09-30T17:04:26.090 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.090 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:26.090 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.091 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:26.091 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538714+0000", 2023-09-30T17:04:26.091 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:26.091 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.091 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.091 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:26.091 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538714+0000", 2023-09-30T17:04:26.091 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:26.091 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.091 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.091 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:26.092 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538714+0000", 2023-09-30T17:04:26.092 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1699999999999999e-07 2023-09-30T17:04:26.092 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.092 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.092 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:26.092 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538729+0000", 2023-09-30T17:04:26.092 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4541e-05 2023-09-30T17:04:26.092 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.092 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.092 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:26.092 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538736+0000", 2023-09-30T17:04:26.092 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2919999999999998e-06 2023-09-30T17:04:26.093 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.093 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.093 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.093 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538742+0000", 2023-09-30T17:04:26.093 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9649999999999996e-06 2023-09-30T17:04:26.093 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.093 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.093 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:26.093 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.003294+0000", 2023-09-30T17:04:26.093 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.464551875 2023-09-30T17:04:26.093 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.093 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.094 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:26.094 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.003365+0000", 2023-09-30T17:04:26.094 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0932000000000005e-05 2023-09-30T17:04:26.094 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.094 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.094 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:26.094 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.003513+0000", 2023-09-30T17:04:26.094 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000148207 2023-09-30T17:04:26.094 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.094 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.094 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:26.095 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.019413+0000", 2023-09-30T17:04:26.095 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.015899809000000001 2023-09-30T17:04:26.095 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.095 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.095 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:26.095 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.250288+0000", 2023-09-30T17:04:26.095 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.230874999 2023-09-30T17:04:26.095 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.095 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.095 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:26.096 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.250336+0000", 2023-09-30T17:04:26.096 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7923999999999997e-05 2023-09-30T17:04:26.096 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.096 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.096 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:26.096 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.250370+0000", 2023-09-30T17:04:26.096 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4360999999999998e-05 2023-09-30T17:04:26.096 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:26.096 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:26.097 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:26.097 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.097 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.097 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:141208 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 1875968~4096,write 1892352~4096,write 1916928~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.097 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:21.538750+0000", 2023-09-30T17:04:26.097 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 3.099564848, 2023-09-30T17:04:26.097 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.71174180200000003, 2023-09-30T17:04:26.097 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:26.098 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:26.098 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:26.098 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:26.098 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.098 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 141208 2023-09-30T17:04:26.098 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.098 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:26.099 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.099 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:26.099 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538750+0000", 2023-09-30T17:04:26.099 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:26.099 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.099 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.099 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:26.099 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538750+0000", 2023-09-30T17:04:26.100 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:26.100 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.100 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.100 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:26.100 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538750+0000", 2023-09-30T17:04:26.100 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4000000000000002e-07 2023-09-30T17:04:26.100 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.101 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.101 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:26.101 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538762+0000", 2023-09-30T17:04:26.101 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1345000000000001e-05 2023-09-30T17:04:26.101 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.101 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.101 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:26.101 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538769+0000", 2023-09-30T17:04:26.101 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0890000000000002e-06 2023-09-30T17:04:26.102 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.102 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.102 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.102 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538774+0000", 2023-09-30T17:04:26.102 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4890000000000003e-06 2023-09-30T17:04:26.102 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.102 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.102 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:26.102 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.008045+0000", 2023-09-30T17:04:26.102 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.46927121500000002 2023-09-30T17:04:26.103 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.103 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.103 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:26.103 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.008212+0000", 2023-09-30T17:04:26.103 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016702500000000001 2023-09-30T17:04:26.103 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.103 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.103 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:26.104 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.008367+0000", 2023-09-30T17:04:26.104 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015413699999999999 2023-09-30T17:04:26.104 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.104 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.104 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:26.104 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.019882+0000", 2023-09-30T17:04:26.104 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011515143 2023-09-30T17:04:26.104 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.104 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.104 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:26.105 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.250416+0000", 2023-09-30T17:04:26.105 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23053458299999999 2023-09-30T17:04:26.105 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.105 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.105 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:26.105 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.250460+0000", 2023-09-30T17:04:26.105 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4081e-05 2023-09-30T17:04:26.105 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.106 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.106 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:26.106 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.250492+0000", 2023-09-30T17:04:26.106 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.1254999999999998e-05 2023-09-30T17:04:26.106 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:26.106 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:26.106 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:26.106 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.107 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.107 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:141339 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 655360~4096,write 667648~4096,write 684032~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.107 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:21.596355+0000", 2023-09-30T17:04:26.107 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 3.0419596740000001, 2023-09-30T17:04:26.107 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.70536611000000005, 2023-09-30T17:04:26.107 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:26.107 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:26.108 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:26.108 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:26.108 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.108 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 141339 2023-09-30T17:04:26.108 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.108 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:26.108 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.108 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:26.108 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.596355+0000", 2023-09-30T17:04:26.109 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:26.109 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.109 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.109 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:26.109 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.596355+0000", 2023-09-30T17:04:26.109 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:26.109 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.109 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.110 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:26.110 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.596356+0000", 2023-09-30T17:04:26.110 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7199999999999999e-07 2023-09-30T17:04:26.110 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.110 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.110 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:26.110 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.596368+0000", 2023-09-30T17:04:26.110 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2717999999999999e-05 2023-09-30T17:04:26.110 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.110 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.110 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:26.111 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.596375+0000", 2023-09-30T17:04:26.111 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0700000000000001e-06 2023-09-30T17:04:26.111 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.111 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.111 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.111 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.596381+0000", 2023-09-30T17:04:26.111 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5180000000000004e-06 2023-09-30T17:04:26.111 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.111 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.111 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:26.111 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.044250+0000", 2023-09-30T17:04:26.111 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.447868934 2023-09-30T17:04:26.112 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.112 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.112 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:26.112 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.044340+0000", 2023-09-30T17:04:26.112 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.0694999999999998e-05 2023-09-30T17:04:26.112 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.112 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.112 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:26.112 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.044522+0000", 2023-09-30T17:04:26.112 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000181521 2023-09-30T17:04:26.112 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.112 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.113 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:26.113 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.063305+0000", 2023-09-30T17:04:26.113 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.018783416000000001 2023-09-30T17:04:26.113 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.113 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.113 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:26.113 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.301622+0000", 2023-09-30T17:04:26.113 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23831677000000001 2023-09-30T17:04:26.113 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.113 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.113 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:26.113 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.301678+0000", 2023-09-30T17:04:26.114 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5744e-05 2023-09-30T17:04:26.114 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:26.114 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:26.114 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:26.114 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.301721+0000", 2023-09-30T17:04:26.114 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3251999999999999e-05 2023-09-30T17:04:26.114 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:26.114 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:26.114 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:26.114 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:26.114 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:26.114 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:04:26.117 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-09-30T17:04:26.119 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:04:26.119 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:26.117+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:26.222 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:26.219+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:26.322 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:26.321+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:26.356 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:04:26.356 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2023-09-30T17:04:26.356 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.356 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151204 4.f 4:f0d983b2:::100000001f8.0000001f:head [write 3833856~4096 in=4096b,write 3887104~4096 in=4096b,write 3964928~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.356 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.581675+0000", 2023-09-30T17:04:26.356 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.74410648199999996, 2023-09-30T17:04:26.356 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.74413251999999996, 2023-09-30T17:04:26.357 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.357 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:26.357 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.357 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.357 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.357 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151204 2023-09-30T17:04:26.357 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.357 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.357 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.357 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.357 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.581675+0000", 2023-09-30T17:04:26.358 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.358 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.358 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.358 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.358 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.581675+0000", 2023-09-30T17:04:26.358 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.359 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.359 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.359 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.581676+0000", 2023-09-30T17:04:26.359 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1900000000000003e-07 2023-09-30T17:04:26.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.359 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.359 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.359 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.581689+0000", 2023-09-30T17:04:26.359 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3804e-05 2023-09-30T17:04:26.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.360 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.360 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.360 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.581696+0000", 2023-09-30T17:04:26.360 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1019999999999999e-06 2023-09-30T17:04:26.360 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.360 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.360 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.361 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.581703+0000", 2023-09-30T17:04:26.361 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1589999999999998e-06 2023-09-30T17:04:26.361 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.361 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.361 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:26.361 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.284321+0000", 2023-09-30T17:04:26.361 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.70261829799999997 2023-09-30T17:04:26.361 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.362 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.362 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:26.362 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.284369+0000", 2023-09-30T17:04:26.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7673999999999998e-05 2023-09-30T17:04:26.362 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.362 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.362 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:26.362 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.284462+0000", 2023-09-30T17:04:26.363 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3426999999999998e-05 2023-09-30T17:04:26.363 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.363 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.363 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:26.363 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.302616+0000", 2023-09-30T17:04:26.363 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018153837999999999 2023-09-30T17:04:26.363 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.363 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.363 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.364 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.364 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.364 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151241 4.f 4:f26fdfa9:::100000001f8.00000002:head [write 2744320~4096 in=4096b,write 2838528~4096 in=4096b,write 2883584~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.364 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.594013+0000", 2023-09-30T17:04:26.364 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.73176851399999998, 2023-09-30T17:04:26.364 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.73185354899999999, 2023-09-30T17:04:26.364 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.365 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:26.365 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.365 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.365 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.365 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151241 2023-09-30T17:04:26.366 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.366 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.366 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.366 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.367 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.594013+0000", 2023-09-30T17:04:26.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.367 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.594013+0000", 2023-09-30T17:04:26.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.368 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.594013+0000", 2023-09-30T17:04:26.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9200000000000002e-07 2023-09-30T17:04:26.369 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.369 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.369 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.369 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.594024+0000", 2023-09-30T17:04:26.369 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0728e-05 2023-09-30T17:04:26.369 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.369 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.369 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.369 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.594028+0000", 2023-09-30T17:04:26.369 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6780000000000002e-06 2023-09-30T17:04:26.369 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.370 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.370 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.370 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.594031+0000", 2023-09-30T17:04:26.370 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0939999999999999e-06 2023-09-30T17:04:26.370 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.370 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.370 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:26.370 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.306737+0000", 2023-09-30T17:04:26.370 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.71270669399999997 2023-09-30T17:04:26.370 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.371 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:26.371 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.306820+0000", 2023-09-30T17:04:26.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2375999999999999e-05 2023-09-30T17:04:26.371 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.371 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:26.371 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.306983+0000", 2023-09-30T17:04:26.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000163525 2023-09-30T17:04:26.371 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.371 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:26.372 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.320287+0000", 2023-09-30T17:04:26.372 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013303410999999999 2023-09-30T17:04:26.372 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.372 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.372 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.372 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.372 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.372 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151493 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.372 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.694668+0000", 2023-09-30T17:04:26.372 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.63111383200000004, 2023-09-30T17:04:26.372 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.63125147599999998, 2023-09-30T17:04:26.373 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.373 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.373 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.373 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.373 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.373 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151493 2023-09-30T17:04:26.373 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.373 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.373 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.373 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.373 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.694668+0000", 2023-09-30T17:04:26.374 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.374 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.374 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.374 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.374 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.694668+0000", 2023-09-30T17:04:26.374 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.374 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.374 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.374 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.374 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.694668+0000", 2023-09-30T17:04:26.374 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7700000000000004e-07 2023-09-30T17:04:26.375 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.375 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.375 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.375 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.694683+0000", 2023-09-30T17:04:26.375 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4389999999999999e-05 2023-09-30T17:04:26.375 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.375 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.375 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.375 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.694690+0000", 2023-09-30T17:04:26.375 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9999999999999999e-06 2023-09-30T17:04:26.376 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.376 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.376 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.376 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.694696+0000", 2023-09-30T17:04:26.376 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8070000000000002e-06 2023-09-30T17:04:26.376 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.376 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.376 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.376 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.376 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.376 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151832 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.376 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.817467+0000", 2023-09-30T17:04:26.377 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.50831490599999996, 2023-09-30T17:04:26.377 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.50848858200000002, 2023-09-30T17:04:26.377 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.377 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.377 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.377 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.377 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.377 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151832 2023-09-30T17:04:26.377 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.377 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.378 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.378 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.378 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.817467+0000", 2023-09-30T17:04:26.378 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.378 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.378 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.378 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.378 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.817467+0000", 2023-09-30T17:04:26.378 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.378 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.379 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.379 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.379 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.817467+0000", 2023-09-30T17:04:26.379 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0900000000000002e-07 2023-09-30T17:04:26.379 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.379 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.379 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.379 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.817478+0000", 2023-09-30T17:04:26.379 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0753e-05 2023-09-30T17:04:26.379 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.380 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.380 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.380 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.817484+0000", 2023-09-30T17:04:26.380 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8109999999999999e-06 2023-09-30T17:04:26.380 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.380 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.380 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.380 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.817488+0000", 2023-09-30T17:04:26.380 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4279999999999998e-06 2023-09-30T17:04:26.380 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.380 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.381 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.381 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.381 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.381 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152543 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.381 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.093226+0000", 2023-09-30T17:04:26.381 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.23255578299999999, 2023-09-30T17:04:26.381 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.232761089, 2023-09-30T17:04:26.381 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.381 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.381 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.381 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.382 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.382 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152543 2023-09-30T17:04:26.382 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.382 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.382 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.382 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.382 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.093226+0000", 2023-09-30T17:04:26.382 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.382 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.383 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.383 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.383 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.093226+0000", 2023-09-30T17:04:26.383 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.383 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.383 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.383 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.383 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.093226+0000", 2023-09-30T17:04:26.383 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8299999999999998e-07 2023-09-30T17:04:26.383 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.383 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.383 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.384 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.093233+0000", 2023-09-30T17:04:26.384 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0700000000000001e-06 2023-09-30T17:04:26.384 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.384 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.384 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.384 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.093237+0000", 2023-09-30T17:04:26.384 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6519999999999999e-06 2023-09-30T17:04:26.384 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.384 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.385 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.385 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.093240+0000", 2023-09-30T17:04:26.385 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1080000000000001e-06 2023-09-30T17:04:26.385 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.385 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.385 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.385 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.385 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.385 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152650 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.385 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.132567+0000", 2023-09-30T17:04:26.385 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.193214619, 2023-09-30T17:04:26.386 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.19345098199999999, 2023-09-30T17:04:26.386 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.386 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.386 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.387 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.388 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.388 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152650 2023-09-30T17:04:26.389 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.389 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.389 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.389 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.391 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.132567+0000", 2023-09-30T17:04:26.391 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.391 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.391 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.391 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.391 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.132567+0000", 2023-09-30T17:04:26.392 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.392 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.392 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.392 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.392 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.132567+0000", 2023-09-30T17:04:26.392 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3600000000000004e-07 2023-09-30T17:04:26.392 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.392 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.392 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.392 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.132579+0000", 2023-09-30T17:04:26.393 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1936000000000001e-05 2023-09-30T17:04:26.393 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.393 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.393 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.393 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.132586+0000", 2023-09-30T17:04:26.393 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.596e-06 2023-09-30T17:04:26.393 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.393 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.393 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.393 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.132591+0000", 2023-09-30T17:04:26.393 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3109999999999996e-06 2023-09-30T17:04:26.394 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.394 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.394 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.394 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.394 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.394 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152728 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.394 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.174569+0000", 2023-09-30T17:04:26.394 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.15121204899999999, 2023-09-30T17:04:26.394 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.15147966299999999, 2023-09-30T17:04:26.394 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.394 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.394 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.395 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.395 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.395 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152728 2023-09-30T17:04:26.395 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.395 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.395 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.395 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.395 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.174569+0000", 2023-09-30T17:04:26.395 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.395 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.396 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.396 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.396 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.174569+0000", 2023-09-30T17:04:26.396 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.396 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.396 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.396 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.396 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.176538+0000", 2023-09-30T17:04:26.396 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019684020000000002 2023-09-30T17:04:26.396 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.396 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.396 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.397 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.176549+0000", 2023-09-30T17:04:26.397 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0838e-05 2023-09-30T17:04:26.397 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.397 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.397 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.397 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.176556+0000", 2023-09-30T17:04:26.397 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1740000000000003e-06 2023-09-30T17:04:26.397 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.397 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.397 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.397 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.176561+0000", 2023-09-30T17:04:26.397 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.887e-06 2023-09-30T17:04:26.398 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.398 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.398 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.398 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.398 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.398 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152782 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.398 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.204687+0000", 2023-09-30T17:04:26.398 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.12109465799999999, 2023-09-30T17:04:26.398 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.121393478, 2023-09-30T17:04:26.398 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.399 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.399 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.399 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.399 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.399 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152782 2023-09-30T17:04:26.399 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.399 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.399 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.399 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.399 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.204687+0000", 2023-09-30T17:04:26.399 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.399 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.400 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.400 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.400 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.204687+0000", 2023-09-30T17:04:26.400 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.400 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.400 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.400 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.400 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.204687+0000", 2023-09-30T17:04:26.400 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6100000000000001e-07 2023-09-30T17:04:26.400 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.401 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.401 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.401 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.204700+0000", 2023-09-30T17:04:26.401 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.226e-05 2023-09-30T17:04:26.401 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.401 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.401 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.401 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.204705+0000", 2023-09-30T17:04:26.401 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8749999999999997e-06 2023-09-30T17:04:26.401 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.401 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.401 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.402 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.204711+0000", 2023-09-30T17:04:26.406 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3480000000000003e-06 2023-09-30T17:04:26.406 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.406 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.406 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.406 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.406 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.407 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152817 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.407 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.224626+0000", 2023-09-30T17:04:26.407 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.10115505800000001, 2023-09-30T17:04:26.407 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.10148676, 2023-09-30T17:04:26.407 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.407 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.407 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.407 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.407 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.407 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152817 2023-09-30T17:04:26.407 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.407 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.408 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.408 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.408 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.224626+0000", 2023-09-30T17:04:26.408 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.408 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.408 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.408 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.408 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.224626+0000", 2023-09-30T17:04:26.408 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.408 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.408 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.409 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.409 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.228517+0000", 2023-09-30T17:04:26.409 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038905300000000001 2023-09-30T17:04:26.409 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.409 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.409 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.409 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.228533+0000", 2023-09-30T17:04:26.409 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5661000000000001e-05 2023-09-30T17:04:26.409 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.409 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.409 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.410 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.228541+0000", 2023-09-30T17:04:26.410 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2770000000000005e-06 2023-09-30T17:04:26.410 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.410 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.410 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.410 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.228546+0000", 2023-09-30T17:04:26.410 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.507e-06 2023-09-30T17:04:26.410 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.410 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.410 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.410 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.411 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.411 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152954 4.2d 4:b4aa06e9:::100000001f8.0000001d:head [write 3371008~4096 in=4096b,write 3489792~4096 in=4096b,write 3715072~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.411 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.298703+0000", 2023-09-30T17:04:26.411 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.027078746000000001, 2023-09-30T17:04:26.411 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.027446405, 2023-09-30T17:04:26.411 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.411 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:26.411 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.411 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.411 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.411 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152954 2023-09-30T17:04:26.411 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.412 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.412 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.412 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.412 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.298703+0000", 2023-09-30T17:04:26.412 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.412 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.412 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.412 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.412 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.298703+0000", 2023-09-30T17:04:26.412 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.412 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.412 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.413 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.413 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.298703+0000", 2023-09-30T17:04:26.413 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4200000000000001e-07 2023-09-30T17:04:26.413 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.413 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.413 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.413 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.298719+0000", 2023-09-30T17:04:26.413 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5967000000000001e-05 2023-09-30T17:04:26.413 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.413 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.413 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.413 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.298726+0000", 2023-09-30T17:04:26.414 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8419999999999999e-06 2023-09-30T17:04:26.414 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.414 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.414 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.414 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.298731+0000", 2023-09-30T17:04:26.414 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4389999999999999e-06 2023-09-30T17:04:26.414 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.414 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.414 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:26.414 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.305565+0000", 2023-09-30T17:04:26.414 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068333609999999996 2023-09-30T17:04:26.415 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.415 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.415 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:26.415 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.305654+0000", 2023-09-30T17:04:26.415 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9145000000000001e-05 2023-09-30T17:04:26.415 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.415 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.415 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:26.415 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.305813+0000", 2023-09-30T17:04:26.415 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015897799999999999 2023-09-30T17:04:26.415 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.415 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.416 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.416 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.416 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.416 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:153170 4.28 e55/17 4:15eeb89b:::100000001f8.00000032:head v 55'4705, mlcod=55'4700)", 2023-09-30T17:04:26.416 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.312229+0000", 2023-09-30T17:04:26.416 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.013552755999999999, 2023-09-30T17:04:26.416 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013978993, 2023-09-30T17:04:26.416 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.416 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:26.416 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.416 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.416 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.416 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.312229+0000", 2023-09-30T17:04:26.417 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.417 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.417 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.417 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.417 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.312229+0000", 2023-09-30T17:04:26.417 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.417 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.417 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.417 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.417 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.312229+0000", 2023-09-30T17:04:26.417 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9100000000000004e-07 2023-09-30T17:04:26.417 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.418 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.418 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.418 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.312248+0000", 2023-09-30T17:04:26.418 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8471999999999999e-05 2023-09-30T17:04:26.418 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.418 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.418 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.418 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.312256+0000", 2023-09-30T17:04:26.418 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0460000000000006e-06 2023-09-30T17:04:26.418 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.418 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.418 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.419 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.312261+0000", 2023-09-30T17:04:26.419 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9830000000000004e-06 2023-09-30T17:04:26.419 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.419 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.419 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:26.419 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.312301+0000", 2023-09-30T17:04:26.419 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9969999999999998e-05 2023-09-30T17:04:26.419 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.419 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.419 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:26.419 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.312319+0000", 2023-09-30T17:04:26.419 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8558000000000001e-05 2023-09-30T17:04:26.420 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.420 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.420 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.420 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.420 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.420 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:153181 4.3b e55/17 4:dcc0c15f:::100000001f8.0000001a:head v 55'2481, mlcod=55'2478)", 2023-09-30T17:04:26.420 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.323567+0000", 2023-09-30T17:04:26.420 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.002214087, 2023-09-30T17:04:26.420 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0026906640000000002, 2023-09-30T17:04:26.420 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.420 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:26.420 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.421 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.421 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.421 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.323567+0000", 2023-09-30T17:04:26.421 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.421 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.421 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.421 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.421 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.323567+0000", 2023-09-30T17:04:26.421 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.421 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.421 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.422 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.422 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.323568+0000", 2023-09-30T17:04:26.422 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8500000000000001e-07 2023-09-30T17:04:26.422 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.422 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.422 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.422 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.323583+0000", 2023-09-30T17:04:26.422 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5241e-05 2023-09-30T17:04:26.422 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.422 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.422 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.423 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.323593+0000", 2023-09-30T17:04:26.423 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3160000000000003e-06 2023-09-30T17:04:26.423 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.423 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.423 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.423 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.323600+0000", 2023-09-30T17:04:26.423 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3440000000000003e-06 2023-09-30T17:04:26.423 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.423 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.423 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:26.423 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.325048+0000", 2023-09-30T17:04:26.423 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00144779 2023-09-30T17:04:26.424 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.424 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.424 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:26.424 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.325061+0000", 2023-09-30T17:04:26.424 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3057999999999999e-05 2023-09-30T17:04:26.424 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.424 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.424 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.424 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.424 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.424 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151242 4.37 4:ef395e89:::100000001f8.00000020:head [write 3416064~4096 in=4096b,write 3497984~4096 in=4096b,write 3563520~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.424 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.594036+0000", 2023-09-30T17:04:26.425 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.731745443, 2023-09-30T17:04:26.425 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.73229353799999997, 2023-09-30T17:04:26.425 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.425 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:26.425 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.425 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.425 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.425 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151242 2023-09-30T17:04:26.425 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.425 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.425 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.426 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.426 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.594036+0000", 2023-09-30T17:04:26.426 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.426 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.426 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.426 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.426 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.594036+0000", 2023-09-30T17:04:26.426 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.426 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.426 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.426 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.427 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.594036+0000", 2023-09-30T17:04:26.427 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.77e-07 2023-09-30T17:04:26.427 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.427 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.427 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.427 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.594052+0000", 2023-09-30T17:04:26.427 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5277e-05 2023-09-30T17:04:26.427 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.427 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.427 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.427 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.594058+0000", 2023-09-30T17:04:26.427 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0939999999999996e-06 2023-09-30T17:04:26.428 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.428 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.428 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.428 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.594061+0000", 2023-09-30T17:04:26.428 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3969999999999998e-06 2023-09-30T17:04:26.428 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.428 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.428 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:26.428 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.311280+0000", 2023-09-30T17:04:26.428 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.71721878500000003 2023-09-30T17:04:26.428 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.428 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.429 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:26.429 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.311366+0000", 2023-09-30T17:04:26.429 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5741000000000005e-05 2023-09-30T17:04:26.429 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.429 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.429 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:26.429 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.311550+0000", 2023-09-30T17:04:26.429 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00018477399999999999 2023-09-30T17:04:26.429 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.429 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.429 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.429 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.430 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.430 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151461 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.430 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.677559+0000", 2023-09-30T17:04:26.430 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.64822207499999995, 2023-09-30T17:04:26.430 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.64881389, 2023-09-30T17:04:26.430 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.430 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.430 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.430 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.430 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.431 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151461 2023-09-30T17:04:26.431 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.431 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.431 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.431 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.431 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.677559+0000", 2023-09-30T17:04:26.431 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.431 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.431 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.431 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.431 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.677559+0000", 2023-09-30T17:04:26.431 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.432 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.432 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.432 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.432 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.677560+0000", 2023-09-30T17:04:26.432 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.75e-07 2023-09-30T17:04:26.432 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.432 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.432 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.432 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.677578+0000", 2023-09-30T17:04:26.432 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7762999999999999e-05 2023-09-30T17:04:26.432 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.433 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.433 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.433 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.677586+0000", 2023-09-30T17:04:26.433 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5969999999999992e-06 2023-09-30T17:04:26.433 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.433 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.433 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.433 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.677592+0000", 2023-09-30T17:04:26.433 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4720000000000003e-06 2023-09-30T17:04:26.433 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.433 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.433 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.434 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.434 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.434 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151547 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.434 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.704571+0000", 2023-09-30T17:04:26.434 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.62121089200000001, 2023-09-30T17:04:26.434 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.62183228599999996, 2023-09-30T17:04:26.434 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.434 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.434 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.434 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.434 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.434 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151547 2023-09-30T17:04:26.435 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.435 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.435 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.435 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.435 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.704571+0000", 2023-09-30T17:04:26.435 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.435 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.435 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.435 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.435 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.704571+0000", 2023-09-30T17:04:26.435 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.435 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.436 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.436 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.436 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.706529+0000", 2023-09-30T17:04:26.436 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019586959999999998 2023-09-30T17:04:26.436 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.436 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.436 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.436 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.706549+0000", 2023-09-30T17:04:26.436 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9596e-05 2023-09-30T17:04:26.436 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.436 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.436 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.437 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.706562+0000", 2023-09-30T17:04:26.437 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3360000000000001e-05 2023-09-30T17:04:26.437 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.437 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.437 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.437 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.706577+0000", 2023-09-30T17:04:26.437 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5191000000000001e-05 2023-09-30T17:04:26.437 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.437 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.437 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.437 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.437 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.438 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151799 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.438 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.808598+0000", 2023-09-30T17:04:26.438 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.51718381800000002, 2023-09-30T17:04:26.438 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.51783504300000005, 2023-09-30T17:04:26.438 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.438 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.438 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.438 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.438 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.438 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151799 2023-09-30T17:04:26.439 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.439 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.439 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.439 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.439 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.808598+0000", 2023-09-30T17:04:26.439 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.439 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.439 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.439 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.439 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.808598+0000", 2023-09-30T17:04:26.439 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.440 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.440 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.440 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.440 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.810532+0000", 2023-09-30T17:04:26.440 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019347139999999999 2023-09-30T17:04:26.440 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.440 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.440 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.440 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.810554+0000", 2023-09-30T17:04:26.440 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2101999999999999e-05 2023-09-30T17:04:26.440 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.440 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.441 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.441 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.810564+0000", 2023-09-30T17:04:26.441 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8030000000000008e-06 2023-09-30T17:04:26.441 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.441 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.441 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.441 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.810570+0000", 2023-09-30T17:04:26.441 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6459999999999998e-06 2023-09-30T17:04:26.441 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.441 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.441 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.441 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.442 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.442 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152154 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.442 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.943920+0000", 2023-09-30T17:04:26.442 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.38186163099999998, 2023-09-30T17:04:26.442 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.38254593100000001, 2023-09-30T17:04:26.442 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.442 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.442 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.442 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.442 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.442 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152154 2023-09-30T17:04:26.443 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.443 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.443 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.443 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.943920+0000", 2023-09-30T17:04:26.443 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.443 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.443 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.443 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.943920+0000", 2023-09-30T17:04:26.443 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.443 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.444 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.444 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.444 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.943920+0000", 2023-09-30T17:04:26.444 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.34e-07 2023-09-30T17:04:26.444 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.444 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.444 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.444 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.943954+0000", 2023-09-30T17:04:26.444 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3871000000000001e-05 2023-09-30T17:04:26.444 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.444 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.444 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.445 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.943961+0000", 2023-09-30T17:04:26.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.669e-06 2023-09-30T17:04:26.445 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.445 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.445 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.445 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.943966+0000", 2023-09-30T17:04:26.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4389999999999999e-06 2023-09-30T17:04:26.445 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.445 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.445 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.445 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.445 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.446 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152187 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.446 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.957662+0000", 2023-09-30T17:04:26.446 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.36811993500000001, 2023-09-30T17:04:26.446 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.36883379799999999, 2023-09-30T17:04:26.446 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.446 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.446 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.446 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.446 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.446 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152187 2023-09-30T17:04:26.446 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.446 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.447 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.447 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.957662+0000", 2023-09-30T17:04:26.447 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.447 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.447 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.447 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.957662+0000", 2023-09-30T17:04:26.447 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.447 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.448 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.448 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.957662+0000", 2023-09-30T17:04:26.448 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4499999999999997e-07 2023-09-30T17:04:26.448 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.448 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.448 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.957679+0000", 2023-09-30T17:04:26.448 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6892e-05 2023-09-30T17:04:26.448 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.448 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.448 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.957686+0000", 2023-09-30T17:04:26.448 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9480000000000002e-06 2023-09-30T17:04:26.449 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.449 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.449 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.449 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.957691+0000", 2023-09-30T17:04:26.449 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5509999999999999e-06 2023-09-30T17:04:26.449 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.449 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.449 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.449 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.449 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.450 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152417 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.450 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.043841+0000", 2023-09-30T17:04:26.450 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.28194004900000003, 2023-09-30T17:04:26.450 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.28270525899999999, 2023-09-30T17:04:26.450 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.450 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.450 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.450 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.450 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.450 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152417 2023-09-30T17:04:26.450 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.450 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.451 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.451 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.451 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.043841+0000", 2023-09-30T17:04:26.451 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.451 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.451 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.451 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.451 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.043841+0000", 2023-09-30T17:04:26.451 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.451 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.451 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.451 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.452 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.043842+0000", 2023-09-30T17:04:26.452 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3699999999999999e-07 2023-09-30T17:04:26.452 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.452 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.452 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.452 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.043854+0000", 2023-09-30T17:04:26.452 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1931e-05 2023-09-30T17:04:26.452 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.452 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.452 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.452 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.043857+0000", 2023-09-30T17:04:26.452 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5820000000000002e-06 2023-09-30T17:04:26.453 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.453 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.453 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.453 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.043860+0000", 2023-09-30T17:04:26.453 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.942e-06 2023-09-30T17:04:26.453 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.453 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.453 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.453 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.453 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.453 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152651 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.453 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.132598+0000", 2023-09-30T17:04:26.454 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.19318338299999999, 2023-09-30T17:04:26.454 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.19399972300000001, 2023-09-30T17:04:26.454 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.454 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.454 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.454 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.454 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.454 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152651 2023-09-30T17:04:26.454 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.454 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.454 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.454 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.455 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.132598+0000", 2023-09-30T17:04:26.455 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.455 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.455 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.455 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.455 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.132598+0000", 2023-09-30T17:04:26.455 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.455 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.455 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.455 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.455 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.132599+0000", 2023-09-30T17:04:26.456 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9900000000000001e-07 2023-09-30T17:04:26.456 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.456 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.456 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.456 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.132610+0000", 2023-09-30T17:04:26.456 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.165e-05 2023-09-30T17:04:26.456 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.456 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.456 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.456 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.132616+0000", 2023-09-30T17:04:26.456 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0020000000000003e-06 2023-09-30T17:04:26.456 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.457 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.457 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.457 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.132621+0000", 2023-09-30T17:04:26.457 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1080000000000001e-06 2023-09-30T17:04:26.457 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.457 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.457 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.457 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.457 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.457 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152729 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.457 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.176570+0000", 2023-09-30T17:04:26.457 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.14921103599999999, 2023-09-30T17:04:26.458 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.15007978399999999, 2023-09-30T17:04:26.458 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.458 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.458 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.458 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.458 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.458 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152729 2023-09-30T17:04:26.458 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.458 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.458 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.458 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.458 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.176570+0000", 2023-09-30T17:04:26.459 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.459 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.459 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.459 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.459 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.176570+0000", 2023-09-30T17:04:26.459 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.459 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.459 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.459 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.459 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.176571+0000", 2023-09-30T17:04:26.459 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5600000000000001e-07 2023-09-30T17:04:26.459 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.460 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.460 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.460 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.176585+0000", 2023-09-30T17:04:26.460 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4138000000000001e-05 2023-09-30T17:04:26.460 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.460 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.460 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.460 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.176590+0000", 2023-09-30T17:04:26.460 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5929999999999999e-06 2023-09-30T17:04:26.460 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.460 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.461 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.461 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.176593+0000", 2023-09-30T17:04:26.461 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3569999999999998e-06 2023-09-30T17:04:26.461 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.461 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.461 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.461 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.461 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.461 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152955 4.12 4:4be51a30:::100000001f8.0000000b:head [write 3223552~4096 in=4096b,write 3248128~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.461 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.298740+0000", 2023-09-30T17:04:26.461 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.027041880000000001, 2023-09-30T17:04:26.461 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.027984766000000001, 2023-09-30T17:04:26.461 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.462 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:26.462 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.462 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.462 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.462 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152955 2023-09-30T17:04:26.462 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.462 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.462 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.462 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.462 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.298740+0000", 2023-09-30T17:04:26.462 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.462 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.463 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.463 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.298740+0000", 2023-09-30T17:04:26.463 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.463 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.463 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.463 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.301141+0000", 2023-09-30T17:04:26.463 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0024011670000000001 2023-09-30T17:04:26.463 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.463 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.464 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.301173+0000", 2023-09-30T17:04:26.464 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2608999999999999e-05 2023-09-30T17:04:26.464 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.464 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.464 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.464 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.301186+0000", 2023-09-30T17:04:26.464 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2478e-05 2023-09-30T17:04:26.464 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.464 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.464 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.464 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.301195+0000", 2023-09-30T17:04:26.464 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4909999999999994e-06 2023-09-30T17:04:26.465 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.465 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.465 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:26.465 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.301650+0000", 2023-09-30T17:04:26.465 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00045488000000000001 2023-09-30T17:04:26.465 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.465 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.465 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:26.465 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.301727+0000", 2023-09-30T17:04:26.465 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6834000000000003e-05 2023-09-30T17:04:26.465 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.465 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.466 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:26.466 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.301869+0000", 2023-09-30T17:04:26.466 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014149099999999999 2023-09-30T17:04:26.466 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.466 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.466 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.466 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.466 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.466 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:153177 4.19 e55/17 4:997b7129:::100000001f8.00000000:head v 55'4794, mlcod=55'4790)", 2023-09-30T17:04:26.466 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.312273+0000", 2023-09-30T17:04:26.466 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.013508315999999999, 2023-09-30T17:04:26.467 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014526311, 2023-09-30T17:04:26.467 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.467 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:26.467 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.467 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.467 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.467 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.312273+0000", 2023-09-30T17:04:26.467 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.467 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.467 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.467 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.468 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.312273+0000", 2023-09-30T17:04:26.468 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.468 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.468 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.468 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.468 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.312273+0000", 2023-09-30T17:04:26.468 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4999999999999999e-07 2023-09-30T17:04:26.468 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.468 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.468 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.468 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.312286+0000", 2023-09-30T17:04:26.468 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2943e-05 2023-09-30T17:04:26.469 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.469 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.469 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.469 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.312292+0000", 2023-09-30T17:04:26.469 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0360000000000003e-06 2023-09-30T17:04:26.469 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.469 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.469 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.469 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.312298+0000", 2023-09-30T17:04:26.469 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4210000000000003e-06 2023-09-30T17:04:26.469 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.469 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.470 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:26.470 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.312717+0000", 2023-09-30T17:04:26.470 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00041914300000000002 2023-09-30T17:04:26.470 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.470 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.470 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:26.470 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.312736+0000", 2023-09-30T17:04:26.470 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9471999999999999e-05 2023-09-30T17:04:26.470 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.470 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.470 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.470 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.471 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.471 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:152079 4.36 e55/17)", 2023-09-30T17:04:26.471 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.324769+0000", 2023-09-30T17:04:26.471 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.001012315, 2023-09-30T17:04:26.471 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002073643, 2023-09-30T17:04:26.471 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.471 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.471 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.471 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.471 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.471 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.324769+0000", 2023-09-30T17:04:26.471 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.471 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.472 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.472 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.472 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.324769+0000", 2023-09-30T17:04:26.472 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.472 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.472 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.472 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.472 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.324770+0000", 2023-09-30T17:04:26.472 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6899999999999997e-07 2023-09-30T17:04:26.472 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.473 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.473 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.473 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.324782+0000", 2023-09-30T17:04:26.473 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2622999999999999e-05 2023-09-30T17:04:26.473 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.473 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.473 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.473 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.324792+0000", 2023-09-30T17:04:26.473 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2960000000000004e-06 2023-09-30T17:04:26.473 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.473 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.473 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.474 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.324796+0000", 2023-09-30T17:04:26.474 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.685e-06 2023-09-30T17:04:26.474 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.474 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.474 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.474 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.474 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.474 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151838 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.474 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.817528+0000", 2023-09-30T17:04:26.474 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.50825353600000001, 2023-09-30T17:04:26.474 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.50934325499999999, 2023-09-30T17:04:26.475 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.475 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.475 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.475 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.475 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.475 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151838 2023-09-30T17:04:26.475 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.475 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.475 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.475 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.475 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.817528+0000", 2023-09-30T17:04:26.475 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.476 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.476 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.476 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.476 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.817528+0000", 2023-09-30T17:04:26.476 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.476 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.476 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.476 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.476 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.817528+0000", 2023-09-30T17:04:26.476 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9299999999999999e-07 2023-09-30T17:04:26.476 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.476 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.477 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.477 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.817546+0000", 2023-09-30T17:04:26.477 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7949e-05 2023-09-30T17:04:26.477 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.477 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.477 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.477 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.817552+0000", 2023-09-30T17:04:26.477 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1059999999999996e-06 2023-09-30T17:04:26.477 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.477 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.477 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.477 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.817557+0000", 2023-09-30T17:04:26.478 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5449999999999997e-06 2023-09-30T17:04:26.478 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.478 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.478 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.478 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.478 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.478 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152155 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.478 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.943981+0000", 2023-09-30T17:04:26.478 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.38180015499999997, 2023-09-30T17:04:26.478 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.38292219999999999, 2023-09-30T17:04:26.478 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.479 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.479 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.479 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.479 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.479 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152155 2023-09-30T17:04:26.479 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.479 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.479 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.479 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.479 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.943981+0000", 2023-09-30T17:04:26.479 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.479 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.479 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.480 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.480 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.943981+0000", 2023-09-30T17:04:26.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.480 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.480 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.943982+0000", 2023-09-30T17:04:26.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2899999999999999e-07 2023-09-30T17:04:26.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.480 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.480 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.943995+0000", 2023-09-30T17:04:26.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3122000000000001e-05 2023-09-30T17:04:26.481 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.481 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.481 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.481 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.944014+0000", 2023-09-30T17:04:26.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8715e-05 2023-09-30T17:04:26.481 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.481 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.481 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.481 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.944018+0000", 2023-09-30T17:04:26.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8459999999999999e-06 2023-09-30T17:04:26.481 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.482 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.482 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.482 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.482 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.482 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152419 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.482 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.043864+0000", 2023-09-30T17:04:26.482 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.281917417, 2023-09-30T17:04:26.482 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.28308900399999998, 2023-09-30T17:04:26.482 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.482 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.482 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.482 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.483 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.483 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152419 2023-09-30T17:04:26.483 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.483 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.483 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.483 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.483 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.043864+0000", 2023-09-30T17:04:26.483 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.483 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.483 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.483 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.483 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.043864+0000", 2023-09-30T17:04:26.484 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.484 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.484 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.484 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.484 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.043864+0000", 2023-09-30T17:04:26.484 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3799999999999999e-07 2023-09-30T17:04:26.484 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.484 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.484 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.484 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.043873+0000", 2023-09-30T17:04:26.484 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2090000000000005e-06 2023-09-30T17:04:26.484 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.485 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.485 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.485 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.043876+0000", 2023-09-30T17:04:26.485 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5429999999999998e-06 2023-09-30T17:04:26.485 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.485 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.485 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.485 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.043879+0000", 2023-09-30T17:04:26.485 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3900000000000002e-06 2023-09-30T17:04:26.485 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.485 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.485 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.486 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.486 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.486 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:152024 4.6 e55/17)", 2023-09-30T17:04:26.486 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.301233+0000", 2023-09-30T17:04:26.486 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.024548932999999998, 2023-09-30T17:04:26.486 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.025774426999999999, 2023-09-30T17:04:26.486 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.486 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.486 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.486 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.486 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.486 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.301233+0000", 2023-09-30T17:04:26.487 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.487 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.487 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.487 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.487 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.301233+0000", 2023-09-30T17:04:26.487 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.487 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.487 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.487 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.488 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.301233+0000", 2023-09-30T17:04:26.488 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1699999999999998e-07 2023-09-30T17:04:26.488 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.488 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.488 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.488 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.301248+0000", 2023-09-30T17:04:26.488 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4944e-05 2023-09-30T17:04:26.488 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.488 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.488 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.488 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.301256+0000", 2023-09-30T17:04:26.488 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2050000000000002e-06 2023-09-30T17:04:26.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.489 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.489 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.301263+0000", 2023-09-30T17:04:26.489 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9779999999999999e-06 2023-09-30T17:04:26.489 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.489 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.489 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.489 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:152058 4.2e e55/17)", 2023-09-30T17:04:26.490 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.312383+0000", 2023-09-30T17:04:26.490 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.013398616, 2023-09-30T17:04:26.490 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014651327, 2023-09-30T17:04:26.490 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.490 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.490 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.490 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.490 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.490 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.312383+0000", 2023-09-30T17:04:26.490 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.490 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.491 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.491 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.491 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.312383+0000", 2023-09-30T17:04:26.491 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.491 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.491 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.491 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.491 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.312383+0000", 2023-09-30T17:04:26.491 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3799999999999998e-07 2023-09-30T17:04:26.491 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.491 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.491 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.492 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.312397+0000", 2023-09-30T17:04:26.492 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3502999999999999e-05 2023-09-30T17:04:26.492 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.492 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.492 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.492 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.312406+0000", 2023-09-30T17:04:26.492 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6050000000000004e-06 2023-09-30T17:04:26.492 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.492 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.492 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.492 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.312412+0000", 2023-09-30T17:04:26.492 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2349999999999999e-06 2023-09-30T17:04:26.493 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.493 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.493 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.493 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.493 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.493 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:153190 4.33 e55/17)", 2023-09-30T17:04:26.493 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.325371+0000", 2023-09-30T17:04:26.493 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.00041035300000000002, 2023-09-30T17:04:26.493 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001714005, 2023-09-30T17:04:26.493 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.493 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.493 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.494 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.494 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.494 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.325371+0000", 2023-09-30T17:04:26.494 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.494 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.494 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.494 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.494 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.325371+0000", 2023-09-30T17:04:26.494 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.494 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.494 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.494 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.495 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.325371+0000", 2023-09-30T17:04:26.495 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0499999999999999e-07 2023-09-30T17:04:26.495 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.495 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.495 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.495 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.325387+0000", 2023-09-30T17:04:26.495 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5356e-05 2023-09-30T17:04:26.495 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.495 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.495 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.495 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.325393+0000", 2023-09-30T17:04:26.495 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.567e-06 2023-09-30T17:04:26.496 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.496 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.496 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.496 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.325397+0000", 2023-09-30T17:04:26.496 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.777e-06 2023-09-30T17:04:26.496 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.496 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.496 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.496 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.496 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.496 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151356 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.496 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.628772+0000", 2023-09-30T17:04:26.497 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.69700979600000001, 2023-09-30T17:04:26.497 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.69837294999999999, 2023-09-30T17:04:26.497 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.497 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.497 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.497 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.497 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.497 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151356 2023-09-30T17:04:26.497 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.497 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.497 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.497 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.498 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.628772+0000", 2023-09-30T17:04:26.498 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.498 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.498 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.498 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.498 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.628772+0000", 2023-09-30T17:04:26.498 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.498 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.498 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.498 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.498 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.628830+0000", 2023-09-30T17:04:26.498 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8214999999999997e-05 2023-09-30T17:04:26.499 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.499 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.499 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.499 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.628852+0000", 2023-09-30T17:04:26.499 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.179e-05 2023-09-30T17:04:26.499 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.499 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.499 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.499 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.628862+0000", 2023-09-30T17:04:26.499 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0242e-05 2023-09-30T17:04:26.499 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.499 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.500 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.500 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.628869+0000", 2023-09-30T17:04:26.500 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9519999999999997e-06 2023-09-30T17:04:26.500 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.500 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.500 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.500 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.500 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.500 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151383 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.500 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.644572+0000", 2023-09-30T17:04:26.500 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.68120939599999997, 2023-09-30T17:04:26.500 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.68263537699999999, 2023-09-30T17:04:26.501 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.501 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.501 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.501 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.501 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.501 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151383 2023-09-30T17:04:26.501 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.501 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.501 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.501 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.501 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.644572+0000", 2023-09-30T17:04:26.501 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.501 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.502 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.502 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.502 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.644572+0000", 2023-09-30T17:04:26.502 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.502 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.502 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.502 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.502 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.644573+0000", 2023-09-30T17:04:26.502 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6700000000000003e-07 2023-09-30T17:04:26.502 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.502 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.502 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.503 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.644619+0000", 2023-09-30T17:04:26.503 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6196000000000003e-05 2023-09-30T17:04:26.503 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.503 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.503 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.503 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.644636+0000", 2023-09-30T17:04:26.503 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.698e-05 2023-09-30T17:04:26.503 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.503 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.503 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.503 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.644642+0000", 2023-09-30T17:04:26.503 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9950000000000002e-06 2023-09-30T17:04:26.504 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.504 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.504 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.504 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.504 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.504 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151463 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.504 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.677630+0000", 2023-09-30T17:04:26.504 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.64815131000000004, 2023-09-30T17:04:26.504 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.64963891699999998, 2023-09-30T17:04:26.504 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.504 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.504 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.505 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.505 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.505 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151463 2023-09-30T17:04:26.505 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.505 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.505 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.505 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.505 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.677630+0000", 2023-09-30T17:04:26.505 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.505 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.505 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.505 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.506 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.677630+0000", 2023-09-30T17:04:26.506 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.506 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.506 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.506 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.677631+0000", 2023-09-30T17:04:26.506 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8500000000000002e-07 2023-09-30T17:04:26.506 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.506 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.506 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.677648+0000", 2023-09-30T17:04:26.507 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7229000000000001e-05 2023-09-30T17:04:26.507 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.507 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.507 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.507 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.677654+0000", 2023-09-30T17:04:26.507 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3180000000000003e-06 2023-09-30T17:04:26.507 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.507 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.507 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.507 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.677659+0000", 2023-09-30T17:04:26.507 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9490000000000004e-06 2023-09-30T17:04:26.508 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.508 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.508 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.508 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.508 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.508 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151659 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.508 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.750887+0000", 2023-09-30T17:04:26.508 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.57489471400000003, 2023-09-30T17:04:26.508 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.57645075300000004, 2023-09-30T17:04:26.508 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.508 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.508 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.508 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.509 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.509 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151659 2023-09-30T17:04:26.509 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.509 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.509 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.509 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.509 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.750887+0000", 2023-09-30T17:04:26.509 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.509 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.509 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.509 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.509 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.750887+0000", 2023-09-30T17:04:26.510 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.510 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.510 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.510 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.510 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.756517+0000", 2023-09-30T17:04:26.510 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056297600000000001 2023-09-30T17:04:26.510 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.510 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.510 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.510 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.756531+0000", 2023-09-30T17:04:26.510 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4188999999999999e-05 2023-09-30T17:04:26.510 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.511 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.511 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.511 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.756540+0000", 2023-09-30T17:04:26.511 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6989999999999998e-06 2023-09-30T17:04:26.511 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.511 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.511 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.511 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.756546+0000", 2023-09-30T17:04:26.511 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3959999999999997e-06 2023-09-30T17:04:26.511 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.511 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.511 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.512 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.512 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.512 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151739 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.512 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.782564+0000", 2023-09-30T17:04:26.512 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.54321709600000001, 2023-09-30T17:04:26.512 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.54483537299999996, 2023-09-30T17:04:26.512 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.512 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.512 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.512 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.512 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.512 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151739 2023-09-30T17:04:26.513 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.513 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.513 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.513 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.513 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.782564+0000", 2023-09-30T17:04:26.513 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.513 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.513 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.513 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.513 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.782564+0000", 2023-09-30T17:04:26.513 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.513 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.514 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.514 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.514 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.782565+0000", 2023-09-30T17:04:26.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2399999999999999e-07 2023-09-30T17:04:26.514 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.514 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.514 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.514 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.782577+0000", 2023-09-30T17:04:26.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2092999999999999e-05 2023-09-30T17:04:26.514 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.514 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.514 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.515 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.782585+0000", 2023-09-30T17:04:26.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5499999999999995e-06 2023-09-30T17:04:26.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.515 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.515 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.782591+0000", 2023-09-30T17:04:26.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.322e-06 2023-09-30T17:04:26.515 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.515 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.515 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.516 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152572 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.516 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.107736+0000", 2023-09-30T17:04:26.516 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.21804544300000001, 2023-09-30T17:04:26.516 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.21972971999999999, 2023-09-30T17:04:26.516 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.516 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.516 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.516 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.516 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.516 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152572 2023-09-30T17:04:26.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.516 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.517 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.517 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.107736+0000", 2023-09-30T17:04:26.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.517 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.517 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.517 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.107736+0000", 2023-09-30T17:04:26.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.517 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.517 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.518 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.107736+0000", 2023-09-30T17:04:26.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2300000000000002e-07 2023-09-30T17:04:26.518 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.518 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.518 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.518 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.107746+0000", 2023-09-30T17:04:26.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0016e-05 2023-09-30T17:04:26.518 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.518 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.518 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.518 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.107755+0000", 2023-09-30T17:04:26.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6430000000000001e-06 2023-09-30T17:04:26.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.519 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.519 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.107759+0000", 2023-09-30T17:04:26.519 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3549999999999998e-06 2023-09-30T17:04:26.519 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.519 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.519 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.519 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152753 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.520 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.194608+0000", 2023-09-30T17:04:26.520 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.13117399499999999, 2023-09-30T17:04:26.520 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.13292543900000001, 2023-09-30T17:04:26.520 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.520 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.520 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.520 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.520 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.520 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152753 2023-09-30T17:04:26.520 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.520 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.520 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.520 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.521 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.194608+0000", 2023-09-30T17:04:26.521 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.521 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.521 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.521 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.521 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.194608+0000", 2023-09-30T17:04:26.521 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.521 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.521 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.521 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.521 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.194608+0000", 2023-09-30T17:04:26.521 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3099999999999998e-07 2023-09-30T17:04:26.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.522 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.522 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.194629+0000", 2023-09-30T17:04:26.522 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1458e-05 2023-09-30T17:04:26.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.522 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.522 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.194637+0000", 2023-09-30T17:04:26.522 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1629999999999999e-06 2023-09-30T17:04:26.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.523 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.194642+0000", 2023-09-30T17:04:26.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4179999999999996e-06 2023-09-30T17:04:26.523 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.523 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.523 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.523 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152923 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.523 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.282227+0000", 2023-09-30T17:04:26.523 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.043554114999999997, 2023-09-30T17:04:26.524 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045370681000000003, 2023-09-30T17:04:26.524 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.524 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.524 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.526 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.526 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.526 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152923 2023-09-30T17:04:26.526 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.526 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.526 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.526 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.282227+0000", 2023-09-30T17:04:26.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.526 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.527 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.527 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.282227+0000", 2023-09-30T17:04:26.527 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.527 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.527 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.527 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.527 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.282228+0000", 2023-09-30T17:04:26.527 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8000000000000001e-07 2023-09-30T17:04:26.527 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.527 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.527 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.527 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.282238+0000", 2023-09-30T17:04:26.528 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0035e-05 2023-09-30T17:04:26.528 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.528 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.528 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.528 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.282255+0000", 2023-09-30T17:04:26.528 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7436e-05 2023-09-30T17:04:26.528 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.528 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.528 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.528 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.282266+0000", 2023-09-30T17:04:26.528 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0699999999999999e-05 2023-09-30T17:04:26.528 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.529 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.529 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.529 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.529 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.529 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:152030 4.36 e55/17)", 2023-09-30T17:04:26.529 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.301275+0000", 2023-09-30T17:04:26.529 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.024506749000000001, 2023-09-30T17:04:26.529 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.026380759, 2023-09-30T17:04:26.529 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.529 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.529 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.529 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.530 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.530 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.301275+0000", 2023-09-30T17:04:26.530 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.530 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.530 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.530 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.530 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.301275+0000", 2023-09-30T17:04:26.530 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.530 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.530 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.530 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.530 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.301275+0000", 2023-09-30T17:04:26.531 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4400000000000001e-07 2023-09-30T17:04:26.531 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.531 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.531 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.531 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.301287+0000", 2023-09-30T17:04:26.531 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.219e-05 2023-09-30T17:04:26.531 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.531 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.531 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.531 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.301295+0000", 2023-09-30T17:04:26.531 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9379999999999992e-06 2023-09-30T17:04:26.532 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.532 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.532 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.532 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.301301+0000", 2023-09-30T17:04:26.532 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3140000000000003e-06 2023-09-30T17:04:26.532 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.532 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.532 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.532 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.532 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.532 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152972 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.532 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.305708+0000", 2023-09-30T17:04:26.533 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.020073843000000001, 2023-09-30T17:04:26.533 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022001843, 2023-09-30T17:04:26.533 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.533 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.533 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.533 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.533 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.533 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152972 2023-09-30T17:04:26.533 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.533 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.533 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.533 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.534 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.305708+0000", 2023-09-30T17:04:26.534 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.534 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.534 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.534 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.534 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.305708+0000", 2023-09-30T17:04:26.534 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.534 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.534 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.534 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.534 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.312516+0000", 2023-09-30T17:04:26.534 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068078699999999997 2023-09-30T17:04:26.535 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.535 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.535 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.535 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.312535+0000", 2023-09-30T17:04:26.535 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9451000000000001e-05 2023-09-30T17:04:26.535 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.535 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.535 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.535 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.312546+0000", 2023-09-30T17:04:26.535 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1171e-05 2023-09-30T17:04:26.535 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.535 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.536 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.536 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.312554+0000", 2023-09-30T17:04:26.536 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4139999999999997e-06 2023-09-30T17:04:26.536 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.536 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.536 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.536 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.536 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.536 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:153010 4.30 4:0c89e311:::100000001f8.00000017:head [write 2240512~4096 in=4096b,write 2490368~4096 in=4096b,write 2523136~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.536 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.321582+0000", 2023-09-30T17:04:26.536 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0041996840000000004, 2023-09-30T17:04:26.536 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0061881360000000003, 2023-09-30T17:04:26.537 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.537 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:26.537 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.537 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.537 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.537 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 153010 2023-09-30T17:04:26.537 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.537 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.537 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.537 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.537 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.321582+0000", 2023-09-30T17:04:26.537 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.538 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.538 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.538 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.538 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.321582+0000", 2023-09-30T17:04:26.538 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.538 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.538 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.538 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.538 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.325515+0000", 2023-09-30T17:04:26.538 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003933293 2023-09-30T17:04:26.538 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.538 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.539 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.539 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.325528+0000", 2023-09-30T17:04:26.539 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2680000000000001e-05 2023-09-30T17:04:26.539 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.539 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.539 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.539 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.325538+0000", 2023-09-30T17:04:26.539 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0189e-05 2023-09-30T17:04:26.539 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.539 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.539 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.539 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.325542+0000", 2023-09-30T17:04:26.540 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4750000000000004e-06 2023-09-30T17:04:26.540 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.540 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.540 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:26.540 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.325592+0000", 2023-09-30T17:04:26.540 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9725000000000002e-05 2023-09-30T17:04:26.540 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.540 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.540 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:26.540 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.325688+0000", 2023-09-30T17:04:26.540 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6059999999999998e-05 2023-09-30T17:04:26.540 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.540 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.541 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.541 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.541 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.541 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151279 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.541 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.599968+0000", 2023-09-30T17:04:26.541 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.72581322800000003, 2023-09-30T17:04:26.541 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.72786422399999995, 2023-09-30T17:04:26.541 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.541 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.541 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.541 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.542 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.542 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151279 2023-09-30T17:04:26.542 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.542 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.542 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.542 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.542 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.599968+0000", 2023-09-30T17:04:26.542 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.542 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.542 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.542 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.542 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.599968+0000", 2023-09-30T17:04:26.543 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.543 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.543 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.543 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.543 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.607516+0000", 2023-09-30T17:04:26.543 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0075473179999999999 2023-09-30T17:04:26.543 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.543 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.543 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.543 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.607536+0000", 2023-09-30T17:04:26.543 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0420000000000001e-05 2023-09-30T17:04:26.543 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.544 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.544 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.544 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.607549+0000", 2023-09-30T17:04:26.544 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2503999999999999e-05 2023-09-30T17:04:26.544 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.544 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.544 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.544 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.607557+0000", 2023-09-30T17:04:26.544 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5110000000000003e-06 2023-09-30T17:04:26.544 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.544 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.544 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.545 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.545 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.545 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151465 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.545 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.677666+0000", 2023-09-30T17:04:26.545 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.64811574999999999, 2023-09-30T17:04:26.545 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.65022212400000001, 2023-09-30T17:04:26.545 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.545 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.545 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.545 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.545 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.545 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151465 2023-09-30T17:04:26.546 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.546 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.546 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.546 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.546 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.677666+0000", 2023-09-30T17:04:26.546 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.546 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.546 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.546 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.546 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.677666+0000", 2023-09-30T17:04:26.546 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.546 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.547 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.547 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.547 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.677666+0000", 2023-09-30T17:04:26.547 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1199999999999998e-07 2023-09-30T17:04:26.547 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.547 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.547 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.547 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.677684+0000", 2023-09-30T17:04:26.547 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7731e-05 2023-09-30T17:04:26.547 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.547 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.547 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.547 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.677691+0000", 2023-09-30T17:04:26.548 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7490000000000001e-06 2023-09-30T17:04:26.548 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.548 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.548 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.548 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.677696+0000", 2023-09-30T17:04:26.548 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.95e-06 2023-09-30T17:04:26.548 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.548 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.548 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.548 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.548 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.548 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151840 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.549 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.819570+0000", 2023-09-30T17:04:26.549 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.506211101, 2023-09-30T17:04:26.549 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.50837685799999999, 2023-09-30T17:04:26.549 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.549 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.549 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.549 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.549 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.549 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151840 2023-09-30T17:04:26.549 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.549 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.549 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.550 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.550 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.819570+0000", 2023-09-30T17:04:26.550 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.550 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.550 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.550 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.550 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.819570+0000", 2023-09-30T17:04:26.550 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.550 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.550 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.550 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.550 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.819571+0000", 2023-09-30T17:04:26.550 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9299999999999998e-07 2023-09-30T17:04:26.551 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.551 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.551 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.551 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.819585+0000", 2023-09-30T17:04:26.551 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3832000000000001e-05 2023-09-30T17:04:26.551 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.551 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.551 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.551 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.819592+0000", 2023-09-30T17:04:26.551 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8739999999999997e-06 2023-09-30T17:04:26.551 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.552 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.552 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.552 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.819597+0000", 2023-09-30T17:04:26.552 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.276e-06 2023-09-30T17:04:26.552 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.552 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.552 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.552 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.552 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.552 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152159 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.552 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.944075+0000", 2023-09-30T17:04:26.553 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.381706249, 2023-09-30T17:04:26.553 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.38392565400000001, 2023-09-30T17:04:26.553 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.553 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.554 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.554 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.554 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.554 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152159 2023-09-30T17:04:26.554 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.554 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.554 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.554 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.554 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.944075+0000", 2023-09-30T17:04:26.554 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.554 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.554 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.555 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.555 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.944075+0000", 2023-09-30T17:04:26.555 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.555 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.555 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.555 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.555 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.944076+0000", 2023-09-30T17:04:26.555 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0400000000000002e-07 2023-09-30T17:04:26.555 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.555 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.555 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.555 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.944091+0000", 2023-09-30T17:04:26.556 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5614999999999999e-05 2023-09-30T17:04:26.556 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.556 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.556 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.556 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.944098+0000", 2023-09-30T17:04:26.556 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2389999999999999e-06 2023-09-30T17:04:26.556 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.556 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.556 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.556 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.944102+0000", 2023-09-30T17:04:26.556 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5900000000000001e-06 2023-09-30T17:04:26.556 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.556 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.557 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.557 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.557 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.557 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152503 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.557 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.078604+0000", 2023-09-30T17:04:26.557 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.247177642, 2023-09-30T17:04:26.557 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.24944829700000001, 2023-09-30T17:04:26.557 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.557 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.557 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.557 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.557 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.558 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152503 2023-09-30T17:04:26.558 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.558 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.558 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.558 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.558 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.078604+0000", 2023-09-30T17:04:26.558 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.558 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.558 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.558 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.558 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.078604+0000", 2023-09-30T17:04:26.559 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.559 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.559 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.559 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.559 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.082539+0000", 2023-09-30T17:04:26.559 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039353080000000002 2023-09-30T17:04:26.559 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.559 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.559 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.559 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.082558+0000", 2023-09-30T17:04:26.559 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.925e-05 2023-09-30T17:04:26.560 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.560 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.560 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.560 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.082568+0000", 2023-09-30T17:04:26.560 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4560000000000006e-06 2023-09-30T17:04:26.560 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.560 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.560 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.560 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.082574+0000", 2023-09-30T17:04:26.560 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5889999999999999e-06 2023-09-30T17:04:26.560 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.560 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.561 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.561 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.561 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.561 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:151724 4.36 e55/17 4:6fa85f86:::100000001f8.00000013:head v 55'7153, mlcod=55'7141)", 2023-09-30T17:04:26.561 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.179649+0000", 2023-09-30T17:04:26.561 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.146132401, 2023-09-30T17:04:26.561 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.14845541200000001, 2023-09-30T17:04:26.561 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.561 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:26.561 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.561 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.562 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.562 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.179649+0000", 2023-09-30T17:04:26.562 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.562 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.562 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.562 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.562 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.179649+0000", 2023-09-30T17:04:26.562 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.562 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.562 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.563 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.563 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.179649+0000", 2023-09-30T17:04:26.563 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4299999999999999e-07 2023-09-30T17:04:26.563 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.563 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.563 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.563 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.179661+0000", 2023-09-30T17:04:26.563 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1573000000000001e-05 2023-09-30T17:04:26.563 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.563 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.563 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.563 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.179668+0000", 2023-09-30T17:04:26.564 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.08e-06 2023-09-30T17:04:26.564 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.564 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.564 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.564 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.179673+0000", 2023-09-30T17:04:26.564 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1749999999999996e-06 2023-09-30T17:04:26.564 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.564 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.564 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:26.564 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.313603+0000", 2023-09-30T17:04:26.564 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.13392932900000001 2023-09-30T17:04:26.564 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.565 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.565 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:26.565 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.313620+0000", 2023-09-30T17:04:26.565 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7872000000000001e-05 2023-09-30T17:04:26.565 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.565 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.565 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.565 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.565 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.565 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:151793 4.2e e55/17)", 2023-09-30T17:04:26.565 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.207670+0000", 2023-09-30T17:04:26.565 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.118111545, 2023-09-30T17:04:26.566 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.120488633, 2023-09-30T17:04:26.566 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.566 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.566 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.566 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.566 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.566 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.207670+0000", 2023-09-30T17:04:26.566 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.566 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.566 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.566 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.566 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.207670+0000", 2023-09-30T17:04:26.567 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.567 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.567 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.567 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.567 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.207671+0000", 2023-09-30T17:04:26.567 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2600000000000002e-07 2023-09-30T17:04:26.567 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.567 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.567 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.567 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.207686+0000", 2023-09-30T17:04:26.567 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5164000000000001e-05 2023-09-30T17:04:26.567 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.568 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.568 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.568 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.207694+0000", 2023-09-30T17:04:26.568 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8089999999999993e-06 2023-09-30T17:04:26.568 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.568 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.568 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.568 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.207700+0000", 2023-09-30T17:04:26.568 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0549999999999996e-06 2023-09-30T17:04:26.568 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.568 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.568 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.568 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.569 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.569 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152973 4.1b 4:dbd503eb:::100000001f8.0000002e:head [write 2318336~4096 in=4096b,write 2453504~4096 in=4096b,write 2527232~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.569 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.312564+0000", 2023-09-30T17:04:26.569 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.013217758, 2023-09-30T17:04:26.569 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015645900000000001, 2023-09-30T17:04:26.569 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.569 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:26.569 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.569 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.569 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.569 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152973 2023-09-30T17:04:26.569 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.570 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.570 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.570 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.570 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.312564+0000", 2023-09-30T17:04:26.570 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.570 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.570 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.570 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.570 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.312564+0000", 2023-09-30T17:04:26.570 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.570 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.571 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.571 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.571 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.315166+0000", 2023-09-30T17:04:26.571 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002601978 2023-09-30T17:04:26.571 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.571 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.571 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.571 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.315203+0000", 2023-09-30T17:04:26.571 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7709000000000001e-05 2023-09-30T17:04:26.571 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.571 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.571 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.572 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.315220+0000", 2023-09-30T17:04:26.572 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6192e-05 2023-09-30T17:04:26.572 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.572 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.572 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.572 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.315230+0000", 2023-09-30T17:04:26.572 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9089999999999995e-06 2023-09-30T17:04:26.572 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.572 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.572 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:26.572 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.315295+0000", 2023-09-30T17:04:26.572 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5188e-05 2023-09-30T17:04:26.573 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.573 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.573 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:26.573 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.315381+0000", 2023-09-30T17:04:26.573 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6316999999999994e-05 2023-09-30T17:04:26.573 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.573 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.573 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.573 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.573 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.573 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:153012 4.30 4:0c89e311:::100000001f8.00000017:head [write 2613248~4096 in=4096b,write 2641920~4096 in=4096b,write 2715648~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.574 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.325552+0000", 2023-09-30T17:04:26.574 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.00022959900000000001, 2023-09-30T17:04:26.574 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002724176, 2023-09-30T17:04:26.574 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.574 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:26.574 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.574 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.574 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.574 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 153012 2023-09-30T17:04:26.574 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.574 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.574 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.575 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.575 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.325552+0000", 2023-09-30T17:04:26.575 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.575 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.575 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.575 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.575 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.325552+0000", 2023-09-30T17:04:26.575 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.575 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.575 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.575 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.576 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.325552+0000", 2023-09-30T17:04:26.576 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9000000000000002e-07 2023-09-30T17:04:26.576 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.576 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.576 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.576 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.325561+0000", 2023-09-30T17:04:26.576 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7010000000000002e-06 2023-09-30T17:04:26.576 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.576 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.576 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.576 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.325566+0000", 2023-09-30T17:04:26.576 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5759999999999999e-06 2023-09-30T17:04:26.577 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.577 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.577 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.577 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.325569+0000", 2023-09-30T17:04:26.577 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1999999999999999e-06 2023-09-30T17:04:26.577 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.577 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.577 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:26.577 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.327647+0000", 2023-09-30T17:04:26.577 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0020780569999999999 2023-09-30T17:04:26.577 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.577 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.578 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:26.578 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.327742+0000", 2023-09-30T17:04:26.578 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4764000000000003e-05 2023-09-30T17:04:26.578 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.578 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.578 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.578 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.578 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.578 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151700 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.578 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.772634+0000", 2023-09-30T17:04:26.578 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.55314759099999999, 2023-09-30T17:04:26.578 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.55570348999999997, 2023-09-30T17:04:26.579 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.579 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.579 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.579 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.579 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.579 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151700 2023-09-30T17:04:26.579 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.579 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.579 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.579 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.579 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.772634+0000", 2023-09-30T17:04:26.579 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.580 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.580 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.580 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.580 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.772634+0000", 2023-09-30T17:04:26.580 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.580 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.580 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.580 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.580 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.772634+0000", 2023-09-30T17:04:26.580 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.82e-07 2023-09-30T17:04:26.580 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.580 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.581 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.581 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.772649+0000", 2023-09-30T17:04:26.581 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4747e-05 2023-09-30T17:04:26.581 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.581 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.581 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.581 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.772665+0000", 2023-09-30T17:04:26.581 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5769000000000001e-05 2023-09-30T17:04:26.581 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.581 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.581 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.581 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.772672+0000", 2023-09-30T17:04:26.581 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2520000000000002e-06 2023-09-30T17:04:26.582 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.582 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.582 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.582 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.582 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.582 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151870 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.582 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.827842+0000", 2023-09-30T17:04:26.582 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.497939034, 2023-09-30T17:04:26.582 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.50054581799999998, 2023-09-30T17:04:26.582 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.582 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.583 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.583 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.583 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.583 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151870 2023-09-30T17:04:26.583 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.583 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.583 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.583 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.583 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.827842+0000", 2023-09-30T17:04:26.583 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.583 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.583 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.584 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.584 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.827842+0000", 2023-09-30T17:04:26.584 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.584 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.584 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.584 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.584 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.831518+0000", 2023-09-30T17:04:26.584 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00367541 2023-09-30T17:04:26.584 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.584 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.584 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.584 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.831534+0000", 2023-09-30T17:04:26.585 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5630000000000001e-05 2023-09-30T17:04:26.585 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.585 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.585 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.585 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.831545+0000", 2023-09-30T17:04:26.585 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1038e-05 2023-09-30T17:04:26.585 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.585 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.585 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.585 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.831551+0000", 2023-09-30T17:04:26.585 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.776e-06 2023-09-30T17:04:26.585 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.586 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.586 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.586 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.586 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.586 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152320 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.586 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.009610+0000", 2023-09-30T17:04:26.586 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.31617113899999999, 2023-09-30T17:04:26.586 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.31882909700000001, 2023-09-30T17:04:26.586 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.586 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.586 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.586 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.587 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.587 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152320 2023-09-30T17:04:26.587 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.587 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.587 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.587 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.587 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.009610+0000", 2023-09-30T17:04:26.587 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.587 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.587 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.587 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.587 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.009610+0000", 2023-09-30T17:04:26.588 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.588 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.588 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.588 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.588 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.009611+0000", 2023-09-30T17:04:26.588 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7199999999999999e-07 2023-09-30T17:04:26.588 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.588 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.588 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.588 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.009631+0000", 2023-09-30T17:04:26.588 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9720000000000001e-05 2023-09-30T17:04:26.588 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.589 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.589 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.589 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.009638+0000", 2023-09-30T17:04:26.589 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.272e-06 2023-09-30T17:04:26.589 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.589 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.589 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.589 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.009644+0000", 2023-09-30T17:04:26.589 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8000000000000004e-06 2023-09-30T17:04:26.589 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.589 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.589 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.590 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.590 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.590 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152356 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.590 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.022609+0000", 2023-09-30T17:04:26.590 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.30317249800000001, 2023-09-30T17:04:26.590 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.30588131600000001, 2023-09-30T17:04:26.590 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.590 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.590 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.590 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.590 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.590 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152356 2023-09-30T17:04:26.591 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.591 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.591 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.591 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.591 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.022609+0000", 2023-09-30T17:04:26.591 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.591 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.591 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.591 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.591 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.022609+0000", 2023-09-30T17:04:26.591 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.591 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.592 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.592 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.592 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.022609+0000", 2023-09-30T17:04:26.592 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.46e-07 2023-09-30T17:04:26.592 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.592 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.592 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.592 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.022623+0000", 2023-09-30T17:04:26.592 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3687e-05 2023-09-30T17:04:26.592 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.593 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.593 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.593 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.022630+0000", 2023-09-30T17:04:26.593 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5400000000000001e-06 2023-09-30T17:04:26.593 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.593 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.593 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.593 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.022633+0000", 2023-09-30T17:04:26.593 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4829999999999999e-06 2023-09-30T17:04:26.593 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.593 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.593 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.593 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.594 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.594 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152652 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.594 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.132627+0000", 2023-09-30T17:04:26.594 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.19315417100000001, 2023-09-30T17:04:26.594 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.195920972, 2023-09-30T17:04:26.594 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.594 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.594 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.594 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.594 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.594 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152652 2023-09-30T17:04:26.595 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.595 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.595 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.595 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.595 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.132627+0000", 2023-09-30T17:04:26.595 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.595 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.595 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.595 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.595 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.132627+0000", 2023-09-30T17:04:26.595 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.595 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.596 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.596 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.596 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.134525+0000", 2023-09-30T17:04:26.596 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001897354 2023-09-30T17:04:26.596 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.596 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.596 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.596 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.134539+0000", 2023-09-30T17:04:26.596 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3878e-05 2023-09-30T17:04:26.596 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.596 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.596 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.597 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.134548+0000", 2023-09-30T17:04:26.597 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4919999999999999e-06 2023-09-30T17:04:26.597 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.597 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.597 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.597 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.134555+0000", 2023-09-30T17:04:26.597 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2880000000000004e-06 2023-09-30T17:04:26.597 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.597 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.597 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.597 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.597 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.597 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152755 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.598 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.194681+0000", 2023-09-30T17:04:26.598 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.13110034800000001, 2023-09-30T17:04:26.598 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.13391808099999999, 2023-09-30T17:04:26.598 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.598 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.598 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.598 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.598 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.598 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152755 2023-09-30T17:04:26.598 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.598 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.599 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.599 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.599 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.194681+0000", 2023-09-30T17:04:26.599 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.599 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.599 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.599 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.599 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.194681+0000", 2023-09-30T17:04:26.599 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.599 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.599 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.599 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.599 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.194682+0000", 2023-09-30T17:04:26.600 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2600000000000002e-07 2023-09-30T17:04:26.600 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.600 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.600 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.600 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.194701+0000", 2023-09-30T17:04:26.600 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9031000000000001e-05 2023-09-30T17:04:26.600 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.600 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.600 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.600 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.194708+0000", 2023-09-30T17:04:26.600 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9789999999999996e-06 2023-09-30T17:04:26.600 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.601 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.601 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.601 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.194713+0000", 2023-09-30T17:04:26.601 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5389999999999998e-06 2023-09-30T17:04:26.601 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.601 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.601 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.601 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.601 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.601 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152890 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.601 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.263609+0000", 2023-09-30T17:04:26.601 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.062172627000000001, 2023-09-30T17:04:26.602 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.065042549000000005, 2023-09-30T17:04:26.602 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.602 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.602 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.602 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.602 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.602 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152890 2023-09-30T17:04:26.602 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.602 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.602 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.602 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.602 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.263609+0000", 2023-09-30T17:04:26.603 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.603 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.603 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.603 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.603 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.263609+0000", 2023-09-30T17:04:26.603 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.603 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.603 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.603 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.603 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.263609+0000", 2023-09-30T17:04:26.603 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0900000000000002e-07 2023-09-30T17:04:26.603 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.603 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.604 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.604 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.263624+0000", 2023-09-30T17:04:26.604 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4161e-05 2023-09-30T17:04:26.604 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.604 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.604 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.604 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.263630+0000", 2023-09-30T17:04:26.604 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4180000000000002e-06 2023-09-30T17:04:26.604 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.604 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.604 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.604 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.263636+0000", 2023-09-30T17:04:26.604 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0009999999999998e-06 2023-09-30T17:04:26.605 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.605 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.605 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.605 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.605 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.605 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152975 4.2d 4:b4aa06e9:::100000001f8.0000001d:head [write 2887680~4096 in=4096b,write 3350528~4096 in=4096b,write 3727360~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.605 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.315257+0000", 2023-09-30T17:04:26.605 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.010524212999999999, 2023-09-30T17:04:26.605 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013452057, 2023-09-30T17:04:26.605 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.605 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:26.605 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.606 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.606 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.606 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152975 2023-09-30T17:04:26.606 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.606 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.606 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.606 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.606 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.315257+0000", 2023-09-30T17:04:26.606 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.606 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.606 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.606 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.607 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.315257+0000", 2023-09-30T17:04:26.607 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.607 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.607 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.607 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.607 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.315258+0000", 2023-09-30T17:04:26.607 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2799999999999996e-07 2023-09-30T17:04:26.607 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.607 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.607 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.607 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.315272+0000", 2023-09-30T17:04:26.607 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4175000000000001e-05 2023-09-30T17:04:26.608 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.608 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.608 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.608 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.315281+0000", 2023-09-30T17:04:26.608 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9469999999999992e-06 2023-09-30T17:04:26.608 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.608 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.608 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.608 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.315288+0000", 2023-09-30T17:04:26.608 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5989999999999998e-06 2023-09-30T17:04:26.608 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.609 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.609 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:26.609 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.315332+0000", 2023-09-30T17:04:26.609 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4768000000000002e-05 2023-09-30T17:04:26.609 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.609 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.609 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:26.609 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.315418+0000", 2023-09-30T17:04:26.609 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5339000000000004e-05 2023-09-30T17:04:26.609 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.609 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.609 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:26.610 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.315549+0000", 2023-09-30T17:04:26.610 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013085000000000001 2023-09-30T17:04:26.610 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.610 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.610 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.610 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.610 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.610 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:153210 4.1c e55/17 4:39b842ef:::100000001f8.00000029:head v 55'2387, mlcod=55'2385)", 2023-09-30T17:04:26.610 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.326209+0000", 2023-09-30T17:04:26.610 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9995728, 2023-09-30T17:04:26.610 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0025717209999999999, 2023-09-30T17:04:26.610 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.611 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:26.611 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.611 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.611 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.611 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.326209+0000", 2023-09-30T17:04:26.611 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.611 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.611 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.611 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.611 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.326209+0000", 2023-09-30T17:04:26.611 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.611 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.612 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.612 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.612 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.326209+0000", 2023-09-30T17:04:26.612 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7700000000000001e-07 2023-09-30T17:04:26.612 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.612 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.612 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.612 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.326218+0000", 2023-09-30T17:04:26.612 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0510000000000002e-06 2023-09-30T17:04:26.612 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.612 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.612 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.613 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.326228+0000", 2023-09-30T17:04:26.613 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0233e-05 2023-09-30T17:04:26.613 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.613 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.613 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.613 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.326237+0000", 2023-09-30T17:04:26.613 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8959999999999992e-06 2023-09-30T17:04:26.613 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.613 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.613 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:26.613 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.326282+0000", 2023-09-30T17:04:26.613 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5002e-05 2023-09-30T17:04:26.614 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.614 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.614 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:26.614 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.326296+0000", 2023-09-30T17:04:26.614 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3747999999999999e-05 2023-09-30T17:04:26.614 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.614 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.614 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.614 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.614 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.614 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151208 4.f 4:f0d983b2:::100000001f8.0000001f:head [write 1105920~4096 in=4096b,write 1146880~4096 in=4096b,write 1396736~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.614 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.583744+0000", 2023-09-30T17:04:26.615 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.74203707799999996, 2023-09-30T17:04:26.615 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.74509914899999996, 2023-09-30T17:04:26.615 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.615 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:26.615 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.615 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.615 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.615 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151208 2023-09-30T17:04:26.615 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.615 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.615 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.615 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.616 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.583744+0000", 2023-09-30T17:04:26.616 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.616 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.616 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.616 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.616 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.583744+0000", 2023-09-30T17:04:26.616 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.616 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.616 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.616 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.616 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.583745+0000", 2023-09-30T17:04:26.616 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2199999999999999e-07 2023-09-30T17:04:26.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.617 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.617 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.617 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.583757+0000", 2023-09-30T17:04:26.617 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2204999999999999e-05 2023-09-30T17:04:26.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.617 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.617 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.617 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.583765+0000", 2023-09-30T17:04:26.617 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9379999999999992e-06 2023-09-30T17:04:26.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.617 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.618 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.618 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.583771+0000", 2023-09-30T17:04:26.618 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5310000000000001e-06 2023-09-30T17:04:26.618 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.618 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.618 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:26.618 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.288552+0000", 2023-09-30T17:04:26.618 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.70478125700000005 2023-09-30T17:04:26.618 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.618 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.618 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:26.619 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.288624+0000", 2023-09-30T17:04:26.619 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2674000000000002e-05 2023-09-30T17:04:26.619 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.619 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.619 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:26.619 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.288772+0000", 2023-09-30T17:04:26.619 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014737499999999999 2023-09-30T17:04:26.619 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.619 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.619 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:26.619 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.302636+0000", 2023-09-30T17:04:26.619 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013863818 2023-09-30T17:04:26.620 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.620 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.620 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.620 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.620 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.620 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151364 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.620 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.629040+0000", 2023-09-30T17:04:26.620 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.69674159999999996, 2023-09-30T17:04:26.620 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.69987891499999999, 2023-09-30T17:04:26.620 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.620 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.620 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.621 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.621 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.621 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151364 2023-09-30T17:04:26.621 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.621 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.621 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.621 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.621 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.629040+0000", 2023-09-30T17:04:26.621 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.621 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.621 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.621 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.622 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.629040+0000", 2023-09-30T17:04:26.622 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.622 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.622 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.622 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.622 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.630527+0000", 2023-09-30T17:04:26.622 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014869620000000001 2023-09-30T17:04:26.622 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.622 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.622 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.623 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.630552+0000", 2023-09-30T17:04:26.623 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4683000000000001e-05 2023-09-30T17:04:26.623 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.623 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.623 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.623 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.630565+0000", 2023-09-30T17:04:26.623 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.349e-05 2023-09-30T17:04:26.623 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.623 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.623 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.623 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.630572+0000", 2023-09-30T17:04:26.624 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3640000000000001e-06 2023-09-30T17:04:26.624 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.624 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.624 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.624 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.624 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.624 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151388 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.624 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.644812+0000", 2023-09-30T17:04:26.624 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.68096970300000004, 2023-09-30T17:04:26.624 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.68415928199999998, 2023-09-30T17:04:26.624 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.625 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.625 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.625 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.625 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.625 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151388 2023-09-30T17:04:26.625 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.625 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.625 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.625 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.626 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.644812+0000", 2023-09-30T17:04:26.626 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.626 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.626 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.626 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.626 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.644812+0000", 2023-09-30T17:04:26.626 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.626 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.626 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.626 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.626 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.644812+0000", 2023-09-30T17:04:26.627 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.58e-07 2023-09-30T17:04:26.627 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.627 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.627 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.627 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.644835+0000", 2023-09-30T17:04:26.627 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2408e-05 2023-09-30T17:04:26.627 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.627 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.627 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.627 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.644841+0000", 2023-09-30T17:04:26.627 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.426e-06 2023-09-30T17:04:26.628 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.628 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.628 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.628 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.644846+0000", 2023-09-30T17:04:26.628 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7940000000000002e-06 2023-09-30T17:04:26.628 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.628 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.628 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.628 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.628 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.628 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151466 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.629 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.677702+0000", 2023-09-30T17:04:26.629 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.64807933299999998, 2023-09-30T17:04:26.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.65132086600000005, 2023-09-30T17:04:26.629 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.629 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.629 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.629 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.629 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.629 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151466 2023-09-30T17:04:26.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.629 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.630 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.677702+0000", 2023-09-30T17:04:26.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.630 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.677702+0000", 2023-09-30T17:04:26.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.631 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.631 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.681514+0000", 2023-09-30T17:04:26.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003812167 2023-09-30T17:04:26.631 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.631 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.631 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.631 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.681526+0000", 2023-09-30T17:04:26.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2136e-05 2023-09-30T17:04:26.631 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.631 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.631 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.631 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.681537+0000", 2023-09-30T17:04:26.632 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0248000000000001e-05 2023-09-30T17:04:26.632 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.632 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.632 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.632 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.681542+0000", 2023-09-30T17:04:26.632 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.587e-06 2023-09-30T17:04:26.632 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.632 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.632 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.632 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.632 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.633 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151634 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.633 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.742563+0000", 2023-09-30T17:04:26.633 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.58321840300000005, 2023-09-30T17:04:26.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.586511106, 2023-09-30T17:04:26.633 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.633 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.633 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.633 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.633 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.633 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151634 2023-09-30T17:04:26.634 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.634 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.634 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.634 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.742563+0000", 2023-09-30T17:04:26.634 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.634 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.634 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.634 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.742563+0000", 2023-09-30T17:04:26.634 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.744522+0000", 2023-09-30T17:04:26.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019591320000000001 2023-09-30T17:04:26.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.744536+0000", 2023-09-30T17:04:26.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3389e-05 2023-09-30T17:04:26.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.744547+0000", 2023-09-30T17:04:26.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1148000000000001e-05 2023-09-30T17:04:26.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.744554+0000", 2023-09-30T17:04:26.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2289999999999997e-06 2023-09-30T17:04:26.636 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.636 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.637 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.637 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152468 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.637 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.060576+0000", 2023-09-30T17:04:26.637 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.265205566, 2023-09-30T17:04:26.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.268548597, 2023-09-30T17:04:26.637 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.637 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.637 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.637 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.638 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.638 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152468 2023-09-30T17:04:26.638 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.638 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.638 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.638 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.060576+0000", 2023-09-30T17:04:26.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.638 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.638 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.060576+0000", 2023-09-30T17:04:26.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.060577+0000", 2023-09-30T17:04:26.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2399999999999998e-07 2023-09-30T17:04:26.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.060589+0000", 2023-09-30T17:04:26.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2754e-05 2023-09-30T17:04:26.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.060597+0000", 2023-09-30T17:04:26.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0180000000000001e-06 2023-09-30T17:04:26.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.060604+0000", 2023-09-30T17:04:26.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3600000000000001e-06 2023-09-30T17:04:26.641 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.641 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.641 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.641 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152733 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.641 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.179731+0000", 2023-09-30T17:04:26.641 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.14605005700000001, 2023-09-30T17:04:26.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.14944455300000001, 2023-09-30T17:04:26.641 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.641 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.642 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.642 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.642 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.642 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152733 2023-09-30T17:04:26.642 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.642 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.642 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.642 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.642 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.179731+0000", 2023-09-30T17:04:26.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.642 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.643 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.643 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.179731+0000", 2023-09-30T17:04:26.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.643 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.643 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.179732+0000", 2023-09-30T17:04:26.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5400000000000001e-07 2023-09-30T17:04:26.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.644 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.179750+0000", 2023-09-30T17:04:26.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8484000000000001e-05 2023-09-30T17:04:26.644 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.644 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.179758+0000", 2023-09-30T17:04:26.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3880000000000002e-06 2023-09-30T17:04:26.644 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.645 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.645 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.179764+0000", 2023-09-30T17:04:26.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5440000000000004e-06 2023-09-30T17:04:26.645 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.645 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.645 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.645 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.645 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.645 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152858 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.645 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.247607+0000", 2023-09-30T17:04:26.645 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.078174130999999994, 2023-09-30T17:04:26.646 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.081692498000000002, 2023-09-30T17:04:26.646 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.646 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.646 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.646 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.646 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.646 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152858 2023-09-30T17:04:26.646 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.646 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.646 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.647 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.647 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.247607+0000", 2023-09-30T17:04:26.647 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.647 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.647 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.247607+0000", 2023-09-30T17:04:26.647 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.647 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.648 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.249520+0000", 2023-09-30T17:04:26.648 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001912422 2023-09-30T17:04:26.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.648 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.249531+0000", 2023-09-30T17:04:26.648 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1556000000000001e-05 2023-09-30T17:04:26.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.648 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.249540+0000", 2023-09-30T17:04:26.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3359999999999995e-06 2023-09-30T17:04:26.649 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.649 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.249549+0000", 2023-09-30T17:04:26.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6379999999999999e-06 2023-09-30T17:04:26.649 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.649 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.649 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.649 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.650 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:151997 4.36 e55/17)", 2023-09-30T17:04:26.650 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.284636+0000", 2023-09-30T17:04:26.650 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.041145892000000003, 2023-09-30T17:04:26.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044719593000000002, 2023-09-30T17:04:26.650 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.650 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.650 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.650 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.650 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.650 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.284636+0000", 2023-09-30T17:04:26.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.651 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.651 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.651 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.284636+0000", 2023-09-30T17:04:26.651 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.651 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.651 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.651 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.284636+0000", 2023-09-30T17:04:26.651 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0200000000000002e-07 2023-09-30T17:04:26.651 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.652 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.652 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.652 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.284652+0000", 2023-09-30T17:04:26.652 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6133999999999998e-05 2023-09-30T17:04:26.652 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.652 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.652 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.652 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.284661+0000", 2023-09-30T17:04:26.652 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9199999999999993e-06 2023-09-30T17:04:26.652 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.653 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.653 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.284666+0000", 2023-09-30T17:04:26.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8300000000000003e-06 2023-09-30T17:04:26.653 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.653 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.653 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.653 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152976 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.653 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.315302+0000", 2023-09-30T17:04:26.653 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.010479855, 2023-09-30T17:04:26.654 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014104571, 2023-09-30T17:04:26.654 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.654 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.654 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.654 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.654 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.654 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152976 2023-09-30T17:04:26.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.654 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.654 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.655 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.315302+0000", 2023-09-30T17:04:26.655 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.655 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.655 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.655 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.655 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.315302+0000", 2023-09-30T17:04:26.655 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.655 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.655 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.655 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.655 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.315302+0000", 2023-09-30T17:04:26.656 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4799999999999998e-07 2023-09-30T17:04:26.656 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.656 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.656 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.656 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.315320+0000", 2023-09-30T17:04:26.656 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7431999999999998e-05 2023-09-30T17:04:26.656 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.656 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.656 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.656 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.315328+0000", 2023-09-30T17:04:26.656 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0430000000000008e-06 2023-09-30T17:04:26.657 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.657 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.657 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.315333+0000", 2023-09-30T17:04:26.657 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8270000000000003e-06 2023-09-30T17:04:26.657 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.657 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.657 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.657 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.657 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(client.4547.0:151181 4.f e55/17)", 2023-09-30T17:04:26.657 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.326715+0000", 2023-09-30T17:04:26.658 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9990664, 2023-09-30T17:04:26.658 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002743536, 2023-09-30T17:04:26.658 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.658 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.658 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.326715+0000", 2023-09-30T17:04:26.658 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.658 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.659 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.659 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.326715+0000", 2023-09-30T17:04:26.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.659 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.659 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.659 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.326716+0000", 2023-09-30T17:04:26.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9400000000000005e-07 2023-09-30T17:04:26.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.659 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.659 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.660 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.326719+0000", 2023-09-30T17:04:26.660 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5820000000000002e-06 2023-09-30T17:04:26.660 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.660 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.660 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.660 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.326736+0000", 2023-09-30T17:04:26.660 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6419e-05 2023-09-30T17:04:26.660 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.660 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.660 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.660 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.326742+0000", 2023-09-30T17:04:26.661 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3589999999999996e-06 2023-09-30T17:04:26.661 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.661 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.661 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.661 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.661 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.661 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151575 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.661 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.725608+0000", 2023-09-30T17:04:26.661 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.60017358200000004, 2023-09-30T17:04:26.661 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.603899941, 2023-09-30T17:04:26.661 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.661 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.662 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.662 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.662 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.662 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151575 2023-09-30T17:04:26.662 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.662 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.662 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.662 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.662 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.725608+0000", 2023-09-30T17:04:26.662 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.663 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.663 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.663 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.663 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.725608+0000", 2023-09-30T17:04:26.663 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.663 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.663 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.663 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.663 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.725608+0000", 2023-09-30T17:04:26.663 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8700000000000001e-07 2023-09-30T17:04:26.663 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.663 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.664 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.664 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.725621+0000", 2023-09-30T17:04:26.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.242e-05 2023-09-30T17:04:26.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.664 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.664 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.725627+0000", 2023-09-30T17:04:26.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4980000000000003e-06 2023-09-30T17:04:26.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.664 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.725632+0000", 2023-09-30T17:04:26.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0350000000000001e-06 2023-09-30T17:04:26.665 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.665 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.665 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.665 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151704 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.665 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.772726+0000", 2023-09-30T17:04:26.665 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.55305528900000001, 2023-09-30T17:04:26.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.556843211, 2023-09-30T17:04:26.666 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.666 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.666 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.666 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.666 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.666 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151704 2023-09-30T17:04:26.666 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.666 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.772726+0000", 2023-09-30T17:04:26.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.772726+0000", 2023-09-30T17:04:26.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.772727+0000", 2023-09-30T17:04:26.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7700000000000005e-07 2023-09-30T17:04:26.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.668 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.668 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.772740+0000", 2023-09-30T17:04:26.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3166999999999999e-05 2023-09-30T17:04:26.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.668 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.668 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.772746+0000", 2023-09-30T17:04:26.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4250000000000003e-06 2023-09-30T17:04:26.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.669 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.669 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.669 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.772752+0000", 2023-09-30T17:04:26.669 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0850000000000002e-06 2023-09-30T17:04:26.669 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.669 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.669 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.669 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.669 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152257 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.670 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.987653+0000", 2023-09-30T17:04:26.670 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.338128549, 2023-09-30T17:04:26.670 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.34197752999999997, 2023-09-30T17:04:26.670 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.670 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.670 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.670 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.670 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.670 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152257 2023-09-30T17:04:26.670 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.671 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.671 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.671 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.671 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.987653+0000", 2023-09-30T17:04:26.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.671 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.671 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.671 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.671 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.987653+0000", 2023-09-30T17:04:26.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.671 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.671 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.672 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.672 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.987653+0000", 2023-09-30T17:04:26.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8100000000000003e-07 2023-09-30T17:04:26.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.672 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.672 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.987665+0000", 2023-09-30T17:04:26.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2021000000000001e-05 2023-09-30T17:04:26.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.673 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.673 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.987675+0000", 2023-09-30T17:04:26.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8160000000000005e-06 2023-09-30T17:04:26.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.673 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.673 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.987680+0000", 2023-09-30T17:04:26.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2209999999999996e-06 2023-09-30T17:04:26.673 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.673 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.673 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.674 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152357 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.674 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.022638+0000", 2023-09-30T17:04:26.674 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.30314335799999997, 2023-09-30T17:04:26.674 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.30706447399999998, 2023-09-30T17:04:26.674 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.674 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.674 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.674 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.674 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.674 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152357 2023-09-30T17:04:26.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.675 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.675 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.675 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.022638+0000", 2023-09-30T17:04:26.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.675 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.675 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.022638+0000", 2023-09-30T17:04:26.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.024669+0000", 2023-09-30T17:04:26.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0020308819999999999 2023-09-30T17:04:26.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.024689+0000", 2023-09-30T17:04:26.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0445000000000002e-05 2023-09-30T17:04:26.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.677 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.677 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.024702+0000", 2023-09-30T17:04:26.677 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2293000000000001e-05 2023-09-30T17:04:26.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.677 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.677 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.024707+0000", 2023-09-30T17:04:26.677 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5840000000000002e-06 2023-09-30T17:04:26.677 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.677 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.677 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.678 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.678 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152425 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.678 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.046546+0000", 2023-09-30T17:04:26.678 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.27923546100000002, 2023-09-30T17:04:26.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.28322412899999999, 2023-09-30T17:04:26.678 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.678 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.678 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.678 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.678 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.678 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152425 2023-09-30T17:04:26.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.679 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.679 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.679 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.046546+0000", 2023-09-30T17:04:26.679 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.679 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.679 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.046546+0000", 2023-09-30T17:04:26.679 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.680 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.680 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.680 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.046547+0000", 2023-09-30T17:04:26.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1699999999999998e-07 2023-09-30T17:04:26.680 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.680 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.680 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.046558+0000", 2023-09-30T17:04:26.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1939999999999999e-05 2023-09-30T17:04:26.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.681 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.681 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.046565+0000", 2023-09-30T17:04:26.681 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8539999999999999e-06 2023-09-30T17:04:26.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.681 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.681 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.046571+0000", 2023-09-30T17:04:26.681 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3789999999999997e-06 2023-09-30T17:04:26.681 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.682 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.682 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.682 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.682 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.682 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152762 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.682 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.194756+0000", 2023-09-30T17:04:26.682 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.131025853, 2023-09-30T17:04:26.682 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.135081652, 2023-09-30T17:04:26.682 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.682 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.682 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.683 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.683 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.683 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152762 2023-09-30T17:04:26.683 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.683 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.683 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.683 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.194756+0000", 2023-09-30T17:04:26.683 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.683 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.684 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.684 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.194756+0000", 2023-09-30T17:04:26.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.684 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.684 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.684 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.194756+0000", 2023-09-30T17:04:26.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5600000000000001e-07 2023-09-30T17:04:26.684 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.685 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.685 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.194778+0000", 2023-09-30T17:04:26.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2334e-05 2023-09-30T17:04:26.685 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.685 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.685 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.194872+0000", 2023-09-30T17:04:26.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3904000000000001e-05 2023-09-30T17:04:26.685 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.685 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.686 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.194881+0000", 2023-09-30T17:04:26.686 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2600000000000005e-06 2023-09-30T17:04:26.686 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.686 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.686 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.686 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.686 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.686 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152832 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.686 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.230561+0000", 2023-09-30T17:04:26.686 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.095220588999999994, 2023-09-30T17:04:26.687 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.099337654999999997, 2023-09-30T17:04:26.687 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.687 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.687 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.687 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.687 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.687 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152832 2023-09-30T17:04:26.687 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.687 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.687 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.687 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.687 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.230561+0000", 2023-09-30T17:04:26.688 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.688 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.688 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.688 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.688 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.230561+0000", 2023-09-30T17:04:26.688 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.688 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.688 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.688 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.688 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.230561+0000", 2023-09-30T17:04:26.688 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1399999999999998e-07 2023-09-30T17:04:26.689 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.689 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.689 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.230571+0000", 2023-09-30T17:04:26.689 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7079999999999992e-06 2023-09-30T17:04:26.689 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.689 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.689 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.230577+0000", 2023-09-30T17:04:26.689 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.66e-06 2023-09-30T17:04:26.689 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.690 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.690 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.230580+0000", 2023-09-30T17:04:26.690 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.078e-06 2023-09-30T17:04:26.690 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.690 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.690 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.690 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.690 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152864 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.690 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.249562+0000", 2023-09-30T17:04:26.691 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.076219837999999998, 2023-09-30T17:04:26.691 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.080399233000000001, 2023-09-30T17:04:26.691 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.691 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.691 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.691 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.691 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.691 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152864 2023-09-30T17:04:26.691 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.691 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.691 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.691 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.692 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.249562+0000", 2023-09-30T17:04:26.692 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.692 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.692 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.692 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.692 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.249562+0000", 2023-09-30T17:04:26.692 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.692 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.692 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.692 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.692 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.249562+0000", 2023-09-30T17:04:26.693 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3099999999999998e-07 2023-09-30T17:04:26.693 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.693 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.693 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.693 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.249571+0000", 2023-09-30T17:04:26.693 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0990000000000005e-06 2023-09-30T17:04:26.693 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.693 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.693 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.693 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.249576+0000", 2023-09-30T17:04:26.693 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.215e-06 2023-09-30T17:04:26.694 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.694 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.694 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.694 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.249580+0000", 2023-09-30T17:04:26.694 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4130000000000002e-06 2023-09-30T17:04:26.694 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.694 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.694 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.694 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.694 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.694 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(client.4547.0:152925 4.12 e55/17)", 2023-09-30T17:04:26.694 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.327359+0000", 2023-09-30T17:04:26.695 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9984226, 2023-09-30T17:04:26.695 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0026619439999999999, 2023-09-30T17:04:26.695 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.695 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.695 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.695 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.695 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.695 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.327359+0000", 2023-09-30T17:04:26.695 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.695 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.695 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.696 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.696 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.327359+0000", 2023-09-30T17:04:26.696 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.696 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.696 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.696 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.696 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.327359+0000", 2023-09-30T17:04:26.696 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3599999999999999e-07 2023-09-30T17:04:26.696 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.696 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.696 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.697 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.327362+0000", 2023-09-30T17:04:26.697 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1080000000000001e-06 2023-09-30T17:04:26.697 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.697 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.697 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.697 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.327370+0000", 2023-09-30T17:04:26.697 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9480000000000008e-06 2023-09-30T17:04:26.697 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.697 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.697 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.697 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.327383+0000", 2023-09-30T17:04:26.698 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2748999999999999e-05 2023-09-30T17:04:26.698 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.698 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.698 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.698 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.698 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.698 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151470 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.698 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.681586+0000", 2023-09-30T17:04:26.698 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.64419588299999997, 2023-09-30T17:04:26.698 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.64849619800000002, 2023-09-30T17:04:26.699 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.699 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.699 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.699 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.699 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.699 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151470 2023-09-30T17:04:26.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.699 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.699 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.699 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.681586+0000", 2023-09-30T17:04:26.700 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.700 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.700 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.700 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.700 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.681586+0000", 2023-09-30T17:04:26.700 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.700 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.700 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.700 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.700 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.681586+0000", 2023-09-30T17:04:26.700 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7000000000000001e-07 2023-09-30T17:04:26.701 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.701 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.701 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.701 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.681596+0000", 2023-09-30T17:04:26.701 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0105999999999999e-05 2023-09-30T17:04:26.701 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.701 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.701 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.701 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.681602+0000", 2023-09-30T17:04:26.701 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7089999999999999e-06 2023-09-30T17:04:26.701 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.702 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.702 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.702 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.681605+0000", 2023-09-30T17:04:26.702 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1310000000000002e-06 2023-09-30T17:04:26.702 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.702 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.702 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.702 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.702 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.702 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151956 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.702 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.868616+0000", 2023-09-30T17:04:26.703 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.45716551, 2023-09-30T17:04:26.703 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.46153011999999999, 2023-09-30T17:04:26.703 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.703 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.703 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.703 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.703 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.703 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151956 2023-09-30T17:04:26.703 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.703 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.703 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.704 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.704 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.868616+0000", 2023-09-30T17:04:26.704 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.704 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.704 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.704 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.704 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.868616+0000", 2023-09-30T17:04:26.704 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.704 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.704 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.704 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.705 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.868616+0000", 2023-09-30T17:04:26.705 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1200000000000003e-07 2023-09-30T17:04:26.705 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.705 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.705 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.705 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.868628+0000", 2023-09-30T17:04:26.705 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1688999999999999e-05 2023-09-30T17:04:26.705 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.705 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.705 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.706 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.868635+0000", 2023-09-30T17:04:26.706 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9419999999999998e-06 2023-09-30T17:04:26.706 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.706 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.706 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.706 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.868641+0000", 2023-09-30T17:04:26.706 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4670000000000003e-06 2023-09-30T17:04:26.706 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.706 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.706 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.707 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.707 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.707 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152222 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.707 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.971556+0000", 2023-09-30T17:04:26.707 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.35422584000000001, 2023-09-30T17:04:26.707 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.35865247900000002, 2023-09-30T17:04:26.707 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.707 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.707 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.707 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.707 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.707 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152222 2023-09-30T17:04:26.708 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.708 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.708 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.708 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.708 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.971556+0000", 2023-09-30T17:04:26.708 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.708 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.708 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.708 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.708 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.971556+0000", 2023-09-30T17:04:26.708 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.709 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.709 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.709 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.709 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.973515+0000", 2023-09-30T17:04:26.709 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019595400000000001 2023-09-30T17:04:26.709 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.709 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.709 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.709 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.973528+0000", 2023-09-30T17:04:26.709 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2564e-05 2023-09-30T17:04:26.710 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.710 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.710 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.710 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.973536+0000", 2023-09-30T17:04:26.710 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.909e-06 2023-09-30T17:04:26.710 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.710 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.710 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.710 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.973541+0000", 2023-09-30T17:04:26.710 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.66e-06 2023-09-30T17:04:26.710 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.711 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.711 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.711 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.711 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.711 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152509 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.711 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.082701+0000", 2023-09-30T17:04:26.711 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.24308033000000001, 2023-09-30T17:04:26.711 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.247569282, 2023-09-30T17:04:26.711 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.711 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.711 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.712 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.712 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.712 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152509 2023-09-30T17:04:26.712 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.712 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.712 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.712 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.712 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.082701+0000", 2023-09-30T17:04:26.712 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.712 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.712 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.713 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.713 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.082701+0000", 2023-09-30T17:04:26.713 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.713 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.713 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.713 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.713 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.082702+0000", 2023-09-30T17:04:26.713 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4799999999999998e-07 2023-09-30T17:04:26.713 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.713 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.713 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.713 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.082717+0000", 2023-09-30T17:04:26.714 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5370999999999999e-05 2023-09-30T17:04:26.714 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.714 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.714 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.714 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.082723+0000", 2023-09-30T17:04:26.714 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8529999999999997e-06 2023-09-30T17:04:26.714 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.714 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.714 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.714 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.082728+0000", 2023-09-30T17:04:26.715 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6700000000000002e-06 2023-09-30T17:04:26.715 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.715 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.715 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.715 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.715 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.715 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152617 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.715 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.125624+0000", 2023-09-30T17:04:26.715 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.200157476, 2023-09-30T17:04:26.715 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.20470741000000001, 2023-09-30T17:04:26.715 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.716 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.716 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.716 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.716 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.716 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152617 2023-09-30T17:04:26.716 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.716 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.716 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.716 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.716 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.125624+0000", 2023-09-30T17:04:26.717 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.717 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.717 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.717 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.717 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.125624+0000", 2023-09-30T17:04:26.717 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.717 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.717 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.717 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.717 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.125624+0000", 2023-09-30T17:04:26.717 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3900000000000001e-07 2023-09-30T17:04:26.718 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.718 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.718 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.718 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.125633+0000", 2023-09-30T17:04:26.718 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0610000000000002e-06 2023-09-30T17:04:26.718 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.718 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.718 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.718 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.125637+0000", 2023-09-30T17:04:26.718 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7299999999999999e-06 2023-09-30T17:04:26.718 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.719 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.719 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.719 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.125640+0000", 2023-09-30T17:04:26.719 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.931e-06 2023-09-30T17:04:26.719 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.719 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.719 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.719 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.719 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.719 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:151883 4.6 e55/17)", 2023-09-30T17:04:26.719 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.249601+0000", 2023-09-30T17:04:26.720 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.076180434000000005, 2023-09-30T17:04:26.720 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.080786355000000004, 2023-09-30T17:04:26.720 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.720 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.720 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.720 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.720 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.720 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.249601+0000", 2023-09-30T17:04:26.720 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.720 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.720 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.720 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.721 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.249601+0000", 2023-09-30T17:04:26.721 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.721 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.721 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.721 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.721 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.249601+0000", 2023-09-30T17:04:26.721 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.11e-07 2023-09-30T17:04:26.721 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.721 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.721 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.721 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.249608+0000", 2023-09-30T17:04:26.722 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0829999999999998e-06 2023-09-30T17:04:26.722 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.722 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.722 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.722 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.249613+0000", 2023-09-30T17:04:26.722 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4109999999999998e-06 2023-09-30T17:04:26.722 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.722 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.722 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.722 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.249616+0000", 2023-09-30T17:04:26.722 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.298e-06 2023-09-30T17:04:26.722 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.723 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.723 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.723 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.723 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.723 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:151938 4.2e e55/17)", 2023-09-30T17:04:26.723 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.266573+0000", 2023-09-30T17:04:26.723 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.059208254000000002, 2023-09-30T17:04:26.723 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.063860353999999994, 2023-09-30T17:04:26.723 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.723 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.723 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.724 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.724 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.724 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.266573+0000", 2023-09-30T17:04:26.724 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.724 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.724 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.724 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.724 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.266573+0000", 2023-09-30T17:04:26.724 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.724 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.724 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.725 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.725 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.266574+0000", 2023-09-30T17:04:26.725 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7800000000000002e-07 2023-09-30T17:04:26.725 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.725 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.725 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.725 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.266589+0000", 2023-09-30T17:04:26.725 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5480000000000001e-05 2023-09-30T17:04:26.725 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.725 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.726 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.726 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.266597+0000", 2023-09-30T17:04:26.726 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7889999999999995e-06 2023-09-30T17:04:26.726 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.726 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.726 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.726 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.266602+0000", 2023-09-30T17:04:26.726 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0189999999999997e-06 2023-09-30T17:04:26.726 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.726 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.727 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.727 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.727 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.727 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152925 4.12 4:4be51a30:::100000001f8.0000000b:head [write 3289088~4096 in=4096b,write 3309568~4096 in=4096b,write 3420160~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.727 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.285558+0000", 2023-09-30T17:04:26.727 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.040223203999999999, 2023-09-30T17:04:26.727 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044929555000000003, 2023-09-30T17:04:26.727 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.727 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:26.727 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.727 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.728 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.728 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152925 2023-09-30T17:04:26.728 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.728 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.728 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.728 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.728 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.285558+0000", 2023-09-30T17:04:26.728 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.728 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.728 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.728 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.729 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.285558+0000", 2023-09-30T17:04:26.729 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.729 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.729 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.729 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.729 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.285559+0000", 2023-09-30T17:04:26.729 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3599999999999999e-07 2023-09-30T17:04:26.729 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.729 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.729 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.729 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.285567+0000", 2023-09-30T17:04:26.730 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6899999999999998e-06 2023-09-30T17:04:26.730 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.730 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.730 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.730 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.285571+0000", 2023-09-30T17:04:26.730 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1779999999999996e-06 2023-09-30T17:04:26.730 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.730 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.730 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.730 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.285575+0000", 2023-09-30T17:04:26.730 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6009999999999999e-06 2023-09-30T17:04:26.730 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.731 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.731 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:26.731 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.285624+0000", 2023-09-30T17:04:26.731 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8442000000000001e-05 2023-09-30T17:04:26.731 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.731 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.731 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:26.731 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.285697+0000", 2023-09-30T17:04:26.731 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3090999999999995e-05 2023-09-30T17:04:26.731 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.731 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.731 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:26.731 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.285843+0000", 2023-09-30T17:04:26.733 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014613500000000001 2023-09-30T17:04:26.733 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.733 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.733 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:26.733 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.296780+0000", 2023-09-30T17:04:26.733 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010937273000000001 2023-09-30T17:04:26.733 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.733 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.734 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:26.734 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.330401+0000", 2023-09-30T17:04:26.734 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033621150000000002 2023-09-30T17:04:26.734 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.734 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.734 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:26.734 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.330456+0000", 2023-09-30T17:04:26.734 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4413999999999998e-05 2023-09-30T17:04:26.734 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.734 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.734 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:26.735 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.330496+0000", 2023-09-30T17:04:26.735 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0191999999999997e-05 2023-09-30T17:04:26.735 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.735 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.735 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.735 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.735 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.735 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152983 4.12 4:4be51a30:::100000001f8.0000000b:head [write 3264512~4096 in=4096b,write 3440640~4096 in=4096b,write 4108288~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.735 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.315384+0000", 2023-09-30T17:04:26.735 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.010397244, 2023-09-30T17:04:26.736 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015208823, 2023-09-30T17:04:26.736 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.736 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:26.736 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.736 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.736 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.736 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152983 2023-09-30T17:04:26.736 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.736 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.736 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.736 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.737 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.315384+0000", 2023-09-30T17:04:26.737 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.737 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.737 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.737 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.737 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.315384+0000", 2023-09-30T17:04:26.737 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.737 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.737 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.737 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.737 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.315385+0000", 2023-09-30T17:04:26.738 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.58e-07 2023-09-30T17:04:26.738 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.738 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.738 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.738 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.315396+0000", 2023-09-30T17:04:26.738 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1681999999999999e-05 2023-09-30T17:04:26.738 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.738 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.738 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.738 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.315404+0000", 2023-09-30T17:04:26.738 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3900000000000004e-06 2023-09-30T17:04:26.739 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.739 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.739 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.739 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.315409+0000", 2023-09-30T17:04:26.739 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5609999999999998e-06 2023-09-30T17:04:26.739 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.739 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.739 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:26.739 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.317549+0000", 2023-09-30T17:04:26.739 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002139958 2023-09-30T17:04:26.739 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.740 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.740 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:26.740 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.317638+0000", 2023-09-30T17:04:26.740 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8770000000000006e-05 2023-09-30T17:04:26.740 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.740 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.740 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:26.740 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.317805+0000", 2023-09-30T17:04:26.740 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016675699999999999 2023-09-30T17:04:26.740 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.740 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.741 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.741 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.741 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.741 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(client.4547.0:152949 4.12 e55/17)", 2023-09-30T17:04:26.741 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.327399+0000", 2023-09-30T17:04:26.741 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9983826, 2023-09-30T17:04:26.741 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0032618959999999998, 2023-09-30T17:04:26.741 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.741 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.741 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.741 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.742 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.742 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.327399+0000", 2023-09-30T17:04:26.742 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.742 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.742 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.742 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.742 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.327399+0000", 2023-09-30T17:04:26.742 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.742 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.742 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.742 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.743 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.327399+0000", 2023-09-30T17:04:26.743 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4699999999999998e-07 2023-09-30T17:04:26.743 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.743 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.743 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.743 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.327402+0000", 2023-09-30T17:04:26.743 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3410000000000001e-06 2023-09-30T17:04:26.743 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.743 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.743 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.743 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.327409+0000", 2023-09-30T17:04:26.744 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3810000000000001e-06 2023-09-30T17:04:26.744 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.744 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.744 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.327415+0000", 2023-09-30T17:04:26.744 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4700000000000001e-06 2023-09-30T17:04:26.744 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.744 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.744 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.744 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.745 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151211 4.2f 4:f59f865b:::100000001f8.00000007:head [write 1306624~4096 in=4096b,write 1478656~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.745 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.583845+0000", 2023-09-30T17:04:26.745 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.74193656299999999, 2023-09-30T17:04:26.745 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.74687932300000004, 2023-09-30T17:04:26.745 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.745 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:26.745 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.745 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.745 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.745 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151211 2023-09-30T17:04:26.746 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.746 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.746 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.746 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.746 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.583845+0000", 2023-09-30T17:04:26.746 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.746 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.746 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.746 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.746 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.583845+0000", 2023-09-30T17:04:26.746 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.747 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.747 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.747 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.747 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.583845+0000", 2023-09-30T17:04:26.747 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0100000000000005e-07 2023-09-30T17:04:26.747 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.747 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.747 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.747 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.583858+0000", 2023-09-30T17:04:26.747 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2860000000000001e-05 2023-09-30T17:04:26.747 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.747 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.748 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.748 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.583865+0000", 2023-09-30T17:04:26.748 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5579999999999997e-06 2023-09-30T17:04:26.748 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.748 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.748 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.748 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.583870+0000", 2023-09-30T17:04:26.748 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9910000000000002e-06 2023-09-30T17:04:26.748 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.748 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.748 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:26.749 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.288540+0000", 2023-09-30T17:04:26.749 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.70467024300000003 2023-09-30T17:04:26.749 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.749 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.749 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:26.749 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.288611+0000", 2023-09-30T17:04:26.749 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0973e-05 2023-09-30T17:04:26.749 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.749 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.749 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:26.749 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.288736+0000", 2023-09-30T17:04:26.750 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012464299999999999 2023-09-30T17:04:26.750 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.750 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.750 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:26.750 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.302621+0000", 2023-09-30T17:04:26.750 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013885694000000001 2023-09-30T17:04:26.750 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.750 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.750 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.750 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.750 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.751 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151254 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 1888256~8192 in=8192b,write 1921024~4096 in=4096b,write 2072576~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.751 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.595556+0000", 2023-09-30T17:04:26.751 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.73022531300000004, 2023-09-30T17:04:26.751 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.73525138099999998, 2023-09-30T17:04:26.751 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.751 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:26.751 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.751 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.751 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.751 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151254 2023-09-30T17:04:26.751 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.752 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.752 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.752 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.752 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.595556+0000", 2023-09-30T17:04:26.752 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.752 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.752 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.752 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.752 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.595556+0000", 2023-09-30T17:04:26.752 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.752 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.753 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.753 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.753 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.595557+0000", 2023-09-30T17:04:26.753 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7800000000000002e-07 2023-09-30T17:04:26.753 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.753 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.753 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.753 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.595570+0000", 2023-09-30T17:04:26.753 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.312e-05 2023-09-30T17:04:26.753 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.754 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.754 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.754 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.595576+0000", 2023-09-30T17:04:26.754 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1179999999999997e-06 2023-09-30T17:04:26.754 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.754 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.754 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.754 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.595581+0000", 2023-09-30T17:04:26.754 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4600000000000002e-06 2023-09-30T17:04:26.754 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.754 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.755 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:26.755 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.318054+0000", 2023-09-30T17:04:26.755 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.72247263799999994 2023-09-30T17:04:26.755 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.755 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.755 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:26.755 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.318128+0000", 2023-09-30T17:04:26.755 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3683000000000006e-05 2023-09-30T17:04:26.755 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.755 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.755 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:26.756 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.318220+0000", 2023-09-30T17:04:26.756 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1977000000000004e-05 2023-09-30T17:04:26.756 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.756 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.756 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.756 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.756 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.756 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151389 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.756 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.644852+0000", 2023-09-30T17:04:26.756 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.68092904200000004, 2023-09-30T17:04:26.756 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.68602794899999997, 2023-09-30T17:04:26.757 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.757 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.757 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.757 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.757 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.757 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151389 2023-09-30T17:04:26.757 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.757 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.757 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.757 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.757 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.644852+0000", 2023-09-30T17:04:26.758 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.758 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.758 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.758 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.758 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.644852+0000", 2023-09-30T17:04:26.758 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.758 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.758 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.758 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.758 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.648519+0000", 2023-09-30T17:04:26.758 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00366651 2023-09-30T17:04:26.759 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.759 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.759 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.759 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.648537+0000", 2023-09-30T17:04:26.759 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8219e-05 2023-09-30T17:04:26.759 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.759 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.759 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.759 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.648547+0000", 2023-09-30T17:04:26.759 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9869999999999994e-06 2023-09-30T17:04:26.759 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.760 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.760 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.760 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.648554+0000", 2023-09-30T17:04:26.760 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.951e-06 2023-09-30T17:04:26.760 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.760 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.760 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.760 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.760 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.760 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151638 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.760 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.744646+0000", 2023-09-30T17:04:26.761 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.58113589899999996, 2023-09-30T17:04:26.761 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.58628860599999999, 2023-09-30T17:04:26.761 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.761 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.761 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.761 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.761 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.761 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151638 2023-09-30T17:04:26.761 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.761 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.761 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.762 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.762 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.744646+0000", 2023-09-30T17:04:26.762 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.762 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.762 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.762 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.762 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.744646+0000", 2023-09-30T17:04:26.762 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.762 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.762 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.762 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.763 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.744646+0000", 2023-09-30T17:04:26.763 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8100000000000003e-07 2023-09-30T17:04:26.763 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.763 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.763 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.763 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.744659+0000", 2023-09-30T17:04:26.763 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2971e-05 2023-09-30T17:04:26.763 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.763 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.763 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.763 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.744665+0000", 2023-09-30T17:04:26.764 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4219999999999997e-06 2023-09-30T17:04:26.764 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.764 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.764 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.764 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.744671+0000", 2023-09-30T17:04:26.764 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2669999999999997e-06 2023-09-30T17:04:26.764 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.764 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.764 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.764 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.764 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.765 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151741 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.765 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.784645+0000", 2023-09-30T17:04:26.765 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.54113615599999998, 2023-09-30T17:04:26.765 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.54634537100000002, 2023-09-30T17:04:26.765 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.765 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.765 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.765 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.765 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.765 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151741 2023-09-30T17:04:26.765 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.766 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.766 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.766 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.766 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.784645+0000", 2023-09-30T17:04:26.766 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.766 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.766 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.766 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.766 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.784645+0000", 2023-09-30T17:04:26.766 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.767 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.767 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.767 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.767 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.784646+0000", 2023-09-30T17:04:26.767 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.68e-07 2023-09-30T17:04:26.767 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.767 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.767 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.767 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.784659+0000", 2023-09-30T17:04:26.767 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2821e-05 2023-09-30T17:04:26.767 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.768 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.768 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.768 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.784663+0000", 2023-09-30T17:04:26.768 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7650000000000001e-06 2023-09-30T17:04:26.768 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.768 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.768 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.768 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.784667+0000", 2023-09-30T17:04:26.768 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4709999999999999e-06 2023-09-30T17:04:26.768 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.768 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.769 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.769 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.769 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.769 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151878 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.769 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.833604+0000", 2023-09-30T17:04:26.769 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.49217747499999998, 2023-09-30T17:04:26.769 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.49744101499999999, 2023-09-30T17:04:26.769 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.769 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.769 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.769 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.770 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.770 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151878 2023-09-30T17:04:26.770 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.770 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.770 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.770 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.770 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.833604+0000", 2023-09-30T17:04:26.770 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.770 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.770 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.770 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.771 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.833604+0000", 2023-09-30T17:04:26.771 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.771 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.771 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.771 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.771 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.833604+0000", 2023-09-30T17:04:26.771 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3000000000000001e-07 2023-09-30T17:04:26.771 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.771 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.771 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.772 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.833614+0000", 2023-09-30T17:04:26.772 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2750000000000001e-06 2023-09-30T17:04:26.772 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.772 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.772 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.772 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.833618+0000", 2023-09-30T17:04:26.772 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4100000000000001e-06 2023-09-30T17:04:26.772 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.772 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.772 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.772 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.833621+0000", 2023-09-30T17:04:26.773 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1990000000000002e-06 2023-09-30T17:04:26.773 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.773 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.773 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.773 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.773 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.773 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151957 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.773 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.868649+0000", 2023-09-30T17:04:26.773 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.45713274999999998, 2023-09-30T17:04:26.773 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.46245261199999999, 2023-09-30T17:04:26.773 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.774 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.774 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.774 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.774 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.774 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151957 2023-09-30T17:04:26.774 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.774 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.774 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.774 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.774 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.868649+0000", 2023-09-30T17:04:26.775 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.775 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.775 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.775 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.775 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.868649+0000", 2023-09-30T17:04:26.775 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.775 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.775 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.775 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.775 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.868649+0000", 2023-09-30T17:04:26.775 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3e-07 2023-09-30T17:04:26.776 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.776 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.776 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.776 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.868665+0000", 2023-09-30T17:04:26.776 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6087e-05 2023-09-30T17:04:26.776 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.776 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.776 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.776 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.868672+0000", 2023-09-30T17:04:26.776 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.754e-06 2023-09-30T17:04:26.776 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.777 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.777 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.777 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.868678+0000", 2023-09-30T17:04:26.777 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4750000000000001e-06 2023-09-30T17:04:26.777 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.777 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.777 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.777 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.777 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.777 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152287 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.777 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.000296+0000", 2023-09-30T17:04:26.778 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.32548527799999999, 2023-09-30T17:04:26.778 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.330860135, 2023-09-30T17:04:26.778 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.778 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.778 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.778 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.778 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.778 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152287 2023-09-30T17:04:26.778 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.778 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.778 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.778 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.779 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.000296+0000", 2023-09-30T17:04:26.779 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.779 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.779 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.779 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.779 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.000296+0000", 2023-09-30T17:04:26.779 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.779 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.779 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.779 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.779 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.000297+0000", 2023-09-30T17:04:26.780 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2699999999999999e-07 2023-09-30T17:04:26.780 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.780 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.780 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.780 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.000309+0000", 2023-09-30T17:04:26.780 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1844e-05 2023-09-30T17:04:26.780 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.780 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.780 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.780 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.000316+0000", 2023-09-30T17:04:26.780 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8689999999999998e-06 2023-09-30T17:04:26.780 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.781 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.781 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.781 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.000322+0000", 2023-09-30T17:04:26.781 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9769999999999997e-06 2023-09-30T17:04:26.781 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.781 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.781 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.781 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.781 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.781 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152619 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.781 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.125644+0000", 2023-09-30T17:04:26.782 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.200137115, 2023-09-30T17:04:26.782 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.20556613700000001, 2023-09-30T17:04:26.782 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.782 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.782 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.782 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.782 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.782 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152619 2023-09-30T17:04:26.782 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.782 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.782 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.782 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.783 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.125644+0000", 2023-09-30T17:04:26.783 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.783 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.783 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.783 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.783 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.125644+0000", 2023-09-30T17:04:26.783 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.783 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.783 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.783 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.783 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.125645+0000", 2023-09-30T17:04:26.784 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1899999999999999e-07 2023-09-30T17:04:26.784 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.784 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.784 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.784 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.125654+0000", 2023-09-30T17:04:26.784 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2399999999999996e-06 2023-09-30T17:04:26.784 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.784 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.784 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.784 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.125659+0000", 2023-09-30T17:04:26.784 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5269999999999998e-06 2023-09-30T17:04:26.784 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.785 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.785 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.785 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.125663+0000", 2023-09-30T17:04:26.785 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3239999999999999e-06 2023-09-30T17:04:26.785 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.785 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.785 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.785 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.785 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.785 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:151801 4.6 e55/17)", 2023-09-30T17:04:26.785 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.211266+0000", 2023-09-30T17:04:26.786 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.11451554799999999, 2023-09-30T17:04:26.786 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.11999607900000001, 2023-09-30T17:04:26.786 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.786 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.786 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.786 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.786 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.786 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.211266+0000", 2023-09-30T17:04:26.786 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.786 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.787 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.787 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.787 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.211266+0000", 2023-09-30T17:04:26.787 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.787 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.787 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.787 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.787 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.211267+0000", 2023-09-30T17:04:26.787 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4499999999999997e-07 2023-09-30T17:04:26.787 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.787 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.787 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.788 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.211283+0000", 2023-09-30T17:04:26.788 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6220000000000001e-05 2023-09-30T17:04:26.788 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.788 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.788 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.788 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.211293+0000", 2023-09-30T17:04:26.788 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0271e-05 2023-09-30T17:04:26.788 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.788 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.788 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.788 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.211300+0000", 2023-09-30T17:04:26.788 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4189999999999999e-06 2023-09-30T17:04:26.789 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.789 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.789 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.789 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.789 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.789 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:151943 4.6 e55/17)", 2023-09-30T17:04:26.789 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.266611+0000", 2023-09-30T17:04:26.789 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.059170304999999999, 2023-09-30T17:04:26.789 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.064699513, 2023-09-30T17:04:26.789 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.790 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.790 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.790 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.790 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.790 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.266611+0000", 2023-09-30T17:04:26.790 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.790 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.790 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.790 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.791 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.266611+0000", 2023-09-30T17:04:26.791 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.791 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.791 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.791 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.791 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.266611+0000", 2023-09-30T17:04:26.791 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.91e-07 2023-09-30T17:04:26.791 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.791 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.791 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.792 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.266623+0000", 2023-09-30T17:04:26.792 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1379999999999999e-05 2023-09-30T17:04:26.792 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.792 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.792 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.792 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.266630+0000", 2023-09-30T17:04:26.792 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8179999999999998e-06 2023-09-30T17:04:26.792 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.792 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.793 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.793 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.266635+0000", 2023-09-30T17:04:26.793 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8539999999999996e-06 2023-09-30T17:04:26.793 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.793 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.793 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.793 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.793 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.794 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:152056 4.6 e55/17)", 2023-09-30T17:04:26.794 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.315433+0000", 2023-09-30T17:04:26.794 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.010348679, 2023-09-30T17:04:26.794 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015925287, 2023-09-30T17:04:26.794 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.794 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.794 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.794 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.794 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.795 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.315433+0000", 2023-09-30T17:04:26.795 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.795 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.795 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.795 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.795 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.315433+0000", 2023-09-30T17:04:26.795 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.795 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.795 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.795 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.796 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.315433+0000", 2023-09-30T17:04:26.796 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2300000000000001e-07 2023-09-30T17:04:26.796 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.796 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.796 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.796 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.315455+0000", 2023-09-30T17:04:26.796 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2008e-05 2023-09-30T17:04:26.796 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.796 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.796 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.796 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.315464+0000", 2023-09-30T17:04:26.796 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4330000000000004e-06 2023-09-30T17:04:26.797 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.797 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.797 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.797 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.315470+0000", 2023-09-30T17:04:26.797 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2600000000000002e-06 2023-09-30T17:04:26.797 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.797 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.797 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.797 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.797 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.797 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(client.4547.0:152955 4.12 e55/17 ondisk, result = 0)", 2023-09-30T17:04:26.798 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.327421+0000", 2023-09-30T17:04:26.798 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9983602, 2023-09-30T17:04:26.798 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003609873, 2023-09-30T17:04:26.798 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.798 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:26.798 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.798 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.798 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.798 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.327421+0000", 2023-09-30T17:04:26.798 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.799 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.799 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.799 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.799 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.327421+0000", 2023-09-30T17:04:26.799 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.799 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.799 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.799 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.799 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.327422+0000", 2023-09-30T17:04:26.800 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2000000000000001e-07 2023-09-30T17:04:26.800 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.800 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.800 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.800 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.327424+0000", 2023-09-30T17:04:26.800 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.872e-06 2023-09-30T17:04:26.800 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.800 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.800 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.800 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.327429+0000", 2023-09-30T17:04:26.801 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7880000000000003e-06 2023-09-30T17:04:26.801 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.801 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.801 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.801 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.327434+0000", 2023-09-30T17:04:26.801 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3819999999999997e-06 2023-09-30T17:04:26.801 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.801 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.801 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:26.801 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.330905+0000", 2023-09-30T17:04:26.801 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0034708989999999999 2023-09-30T17:04:26.802 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.802 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.802 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:26.802 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.330912+0000", 2023-09-30T17:04:26.802 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9840000000000004e-06 2023-09-30T17:04:26.802 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.802 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.802 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:26.802 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.331031+0000", 2023-09-30T17:04:26.802 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000119728 2023-09-30T17:04:26.802 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.803 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.803 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.803 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.803 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.803 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151496 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.803 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.694704+0000", 2023-09-30T17:04:26.803 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.63107716700000005, 2023-09-30T17:04:26.803 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.63678209799999996, 2023-09-30T17:04:26.803 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.803 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.804 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.804 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.804 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.804 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151496 2023-09-30T17:04:26.804 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.804 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.804 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.804 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.804 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.694704+0000", 2023-09-30T17:04:26.804 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.804 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.805 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.805 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.805 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.694704+0000", 2023-09-30T17:04:26.805 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.805 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.805 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.805 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.805 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.696515+0000", 2023-09-30T17:04:26.805 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0018110649999999999 2023-09-30T17:04:26.805 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.806 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.806 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.806 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.696527+0000", 2023-09-30T17:04:26.806 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1405e-05 2023-09-30T17:04:26.806 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.806 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.806 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.806 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.696533+0000", 2023-09-30T17:04:26.806 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2190000000000001e-06 2023-09-30T17:04:26.806 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.806 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.807 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.807 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.696537+0000", 2023-09-30T17:04:26.807 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0119999999999999e-06 2023-09-30T17:04:26.807 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.807 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.807 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.807 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.807 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.807 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151579 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.807 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.725713+0000", 2023-09-30T17:04:26.807 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.60006816399999996, 2023-09-30T17:04:26.807 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.60583213199999997, 2023-09-30T17:04:26.808 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.808 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.808 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.808 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.808 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.808 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151579 2023-09-30T17:04:26.808 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.808 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.808 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.808 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.808 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.725713+0000", 2023-09-30T17:04:26.809 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.809 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.809 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.809 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.809 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.725713+0000", 2023-09-30T17:04:26.809 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.809 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.809 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.810 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.810 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.725714+0000", 2023-09-30T17:04:26.810 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2100000000000002e-07 2023-09-30T17:04:26.810 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.810 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.810 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.810 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.725726+0000", 2023-09-30T17:04:26.810 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2408e-05 2023-09-30T17:04:26.810 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.810 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.810 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.811 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.725733+0000", 2023-09-30T17:04:26.811 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4919999999999998e-06 2023-09-30T17:04:26.811 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.811 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.811 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.811 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.725738+0000", 2023-09-30T17:04:26.811 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4349999999999996e-06 2023-09-30T17:04:26.811 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.811 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.811 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.811 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.812 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.812 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151742 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.812 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.784673+0000", 2023-09-30T17:04:26.812 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.54110865799999996, 2023-09-30T17:04:26.812 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.54692808299999995, 2023-09-30T17:04:26.812 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.812 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.812 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.812 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.812 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.812 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151742 2023-09-30T17:04:26.812 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.813 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.813 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.813 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.784673+0000", 2023-09-30T17:04:26.813 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.813 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.813 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.813 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.784673+0000", 2023-09-30T17:04:26.813 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.813 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.814 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.814 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.814 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.784673+0000", 2023-09-30T17:04:26.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0499999999999999e-07 2023-09-30T17:04:26.814 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.814 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.814 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.814 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.784683+0000", 2023-09-30T17:04:26.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0125999999999999e-05 2023-09-30T17:04:26.814 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.814 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.815 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.815 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.784687+0000", 2023-09-30T17:04:26.815 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7680000000000002e-06 2023-09-30T17:04:26.815 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.815 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.815 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.815 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.784691+0000", 2023-09-30T17:04:26.815 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8210000000000003e-06 2023-09-30T17:04:26.815 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.815 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.815 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.816 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.816 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.816 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151848 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.816 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.821562+0000", 2023-09-30T17:04:26.816 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.50421904399999995, 2023-09-30T17:04:26.816 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.51009010200000005, 2023-09-30T17:04:26.816 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.816 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.816 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.816 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.816 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.817 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151848 2023-09-30T17:04:26.817 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.817 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.817 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.817 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.817 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.821562+0000", 2023-09-30T17:04:26.817 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.817 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.817 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.817 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.817 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.821562+0000", 2023-09-30T17:04:26.817 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.818 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.818 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.818 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.818 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.821563+0000", 2023-09-30T17:04:26.818 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.82e-07 2023-09-30T17:04:26.818 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.818 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.818 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.818 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.821575+0000", 2023-09-30T17:04:26.818 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2116999999999999e-05 2023-09-30T17:04:26.818 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.819 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.819 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.819 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.821583+0000", 2023-09-30T17:04:26.819 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8599999999999993e-06 2023-09-30T17:04:26.819 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.819 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.819 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.819 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.821588+0000", 2023-09-30T17:04:26.819 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9509999999999997e-06 2023-09-30T17:04:26.819 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.819 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.820 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.820 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.820 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.820 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152023 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.820 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.906578+0000", 2023-09-30T17:04:26.820 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.41920343300000001, 2023-09-30T17:04:26.820 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.42513021400000001, 2023-09-30T17:04:26.820 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.820 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.820 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.820 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.820 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.821 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152023 2023-09-30T17:04:26.821 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.821 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.821 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.821 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.821 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.906578+0000", 2023-09-30T17:04:26.821 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.821 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.821 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.821 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.821 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.906578+0000", 2023-09-30T17:04:26.822 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.822 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.822 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.822 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.822 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.906579+0000", 2023-09-30T17:04:26.822 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0699999999999997e-07 2023-09-30T17:04:26.822 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.822 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.822 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.822 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.906597+0000", 2023-09-30T17:04:26.822 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8525999999999998e-05 2023-09-30T17:04:26.823 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.823 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.823 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.823 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.906605+0000", 2023-09-30T17:04:26.823 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6930000000000007e-06 2023-09-30T17:04:26.823 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.823 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.823 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.823 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.906611+0000", 2023-09-30T17:04:26.823 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3169999999999998e-06 2023-09-30T17:04:26.823 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.823 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.824 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.824 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.824 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.824 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152288 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.824 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.000330+0000", 2023-09-30T17:04:26.824 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.32545151100000003, 2023-09-30T17:04:26.824 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.33143050099999999, 2023-09-30T17:04:26.824 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.824 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.824 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.824 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.825 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.825 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152288 2023-09-30T17:04:26.825 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.825 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.825 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.825 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.000330+0000", 2023-09-30T17:04:26.825 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.825 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.825 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.826 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.000330+0000", 2023-09-30T17:04:26.826 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.826 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.826 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.826 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.000330+0000", 2023-09-30T17:04:26.826 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3099999999999998e-07 2023-09-30T17:04:26.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.826 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.826 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.826 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.000343+0000", 2023-09-30T17:04:26.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2617e-05 2023-09-30T17:04:26.827 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.827 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.827 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.827 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.000349+0000", 2023-09-30T17:04:26.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4420000000000003e-06 2023-09-30T17:04:26.827 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.827 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.827 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.827 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.000355+0000", 2023-09-30T17:04:26.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2179999999999998e-06 2023-09-30T17:04:26.828 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.828 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.828 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.828 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.828 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.828 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152511 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.828 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.082767+0000", 2023-09-30T17:04:26.828 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.243014653, 2023-09-30T17:04:26.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.24904820599999999, 2023-09-30T17:04:26.828 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.829 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.829 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.829 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.829 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.829 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152511 2023-09-30T17:04:26.829 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.829 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.829 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.829 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.082767+0000", 2023-09-30T17:04:26.829 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.830 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.830 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.830 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.082767+0000", 2023-09-30T17:04:26.830 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.830 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.830 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.830 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.082767+0000", 2023-09-30T17:04:26.830 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9900000000000002e-07 2023-09-30T17:04:26.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.831 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.831 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.831 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.082783+0000", 2023-09-30T17:04:26.831 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5934e-05 2023-09-30T17:04:26.831 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.831 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.831 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.831 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.082789+0000", 2023-09-30T17:04:26.831 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2709999999999998e-06 2023-09-30T17:04:26.831 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.831 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.831 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.832 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.082795+0000", 2023-09-30T17:04:26.832 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2209999999999996e-06 2023-09-30T17:04:26.832 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.832 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.832 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.832 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.832 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.833 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:151802 4.2e e55/17)", 2023-09-30T17:04:26.833 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.211315+0000", 2023-09-30T17:04:26.833 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.114466234, 2023-09-30T17:04:26.833 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.120549324, 2023-09-30T17:04:26.833 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.833 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.833 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.834 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.834 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.834 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.211315+0000", 2023-09-30T17:04:26.834 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.834 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.834 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.834 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.834 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.211315+0000", 2023-09-30T17:04:26.834 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.834 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.834 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.835 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.835 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.211316+0000", 2023-09-30T17:04:26.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1100000000000002e-07 2023-09-30T17:04:26.835 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.835 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.835 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.835 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.211333+0000", 2023-09-30T17:04:26.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7859e-05 2023-09-30T17:04:26.835 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.835 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.835 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.836 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.211340+0000", 2023-09-30T17:04:26.836 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0530000000000001e-06 2023-09-30T17:04:26.836 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.836 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.836 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.836 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.211346+0000", 2023-09-30T17:04:26.836 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4299999999999997e-06 2023-09-30T17:04:26.836 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.836 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.836 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.836 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.837 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.837 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(client.4547.0:152941 4.2d e55/17 ondisk, result = 0)", 2023-09-30T17:04:26.837 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.315491+0000", 2023-09-30T17:04:26.837 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.010290308, 2023-09-30T17:04:26.837 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016417781999999999, 2023-09-30T17:04:26.837 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.837 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:26.837 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.837 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.837 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.837 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.315491+0000", 2023-09-30T17:04:26.837 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.838 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.838 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.838 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.838 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.315491+0000", 2023-09-30T17:04:26.838 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.838 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.838 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.838 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.838 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.315492+0000", 2023-09-30T17:04:26.838 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7300000000000002e-07 2023-09-30T17:04:26.839 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.839 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.839 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.839 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.315494+0000", 2023-09-30T17:04:26.839 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.717e-06 2023-09-30T17:04:26.839 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.839 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.839 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.839 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.315501+0000", 2023-09-30T17:04:26.839 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.024e-06 2023-09-30T17:04:26.839 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.839 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.840 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.840 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.315506+0000", 2023-09-30T17:04:26.840 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9189999999999998e-06 2023-09-30T17:04:26.840 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.840 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.840 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:26.840 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.322548+0000", 2023-09-30T17:04:26.840 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070420750000000001 2023-09-30T17:04:26.840 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.840 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.840 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:26.841 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.322557+0000", 2023-09-30T17:04:26.841 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5269999999999998e-06 2023-09-30T17:04:26.841 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.841 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.841 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.841 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.841 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.841 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151476 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.841 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.683571+0000", 2023-09-30T17:04:26.841 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.64221046999999998, 2023-09-30T17:04:26.841 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.648397322, 2023-09-30T17:04:26.842 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.842 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.842 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.842 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.842 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.842 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151476 2023-09-30T17:04:26.842 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.842 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.842 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.842 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.842 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.683571+0000", 2023-09-30T17:04:26.843 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.843 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.843 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.843 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.843 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.683571+0000", 2023-09-30T17:04:26.843 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.843 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.843 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.843 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.843 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.683572+0000", 2023-09-30T17:04:26.843 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7800000000000002e-07 2023-09-30T17:04:26.844 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.844 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.844 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.844 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.683584+0000", 2023-09-30T17:04:26.844 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2542e-05 2023-09-30T17:04:26.844 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.844 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.844 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.844 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.683591+0000", 2023-09-30T17:04:26.844 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5270000000000004e-06 2023-09-30T17:04:26.844 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.844 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.845 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.845 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.683596+0000", 2023-09-30T17:04:26.845 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8930000000000002e-06 2023-09-30T17:04:26.845 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.845 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.845 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.845 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.845 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.845 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151500 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.845 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.696544+0000", 2023-09-30T17:04:26.846 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.62923770800000001, 2023-09-30T17:04:26.846 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.63547754400000001, 2023-09-30T17:04:26.846 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.846 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.846 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.846 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.846 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.846 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151500 2023-09-30T17:04:26.846 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.846 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.847 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.847 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.847 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.696544+0000", 2023-09-30T17:04:26.847 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.847 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.847 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.847 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.847 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.696544+0000", 2023-09-30T17:04:26.847 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.847 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.847 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.848 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.848 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.696544+0000", 2023-09-30T17:04:26.848 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5100000000000001e-07 2023-09-30T17:04:26.848 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.848 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.848 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.848 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.696558+0000", 2023-09-30T17:04:26.848 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3881e-05 2023-09-30T17:04:26.848 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.848 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.848 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.848 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.696563+0000", 2023-09-30T17:04:26.849 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.006e-06 2023-09-30T17:04:26.849 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.849 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.849 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.849 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.696566+0000", 2023-09-30T17:04:26.849 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0979999999999998e-06 2023-09-30T17:04:26.849 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.849 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.849 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.849 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.849 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.850 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151581 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.850 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.725746+0000", 2023-09-30T17:04:26.850 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.60003585699999995, 2023-09-30T17:04:26.850 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.606329954, 2023-09-30T17:04:26.850 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.850 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.850 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.850 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.850 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.850 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151581 2023-09-30T17:04:26.850 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.851 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.851 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.851 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.851 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.725746+0000", 2023-09-30T17:04:26.851 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.851 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.851 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.851 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.851 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.725746+0000", 2023-09-30T17:04:26.851 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.851 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.851 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.852 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.852 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.725746+0000", 2023-09-30T17:04:26.852 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9400000000000005e-07 2023-09-30T17:04:26.852 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.852 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.852 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.852 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.725756+0000", 2023-09-30T17:04:26.852 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5999999999999996e-06 2023-09-30T17:04:26.852 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.852 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.852 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.853 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.725762+0000", 2023-09-30T17:04:26.853 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6089999999999997e-06 2023-09-30T17:04:26.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.853 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.853 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.853 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.725768+0000", 2023-09-30T17:04:26.853 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3469999999999998e-06 2023-09-30T17:04:26.853 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.853 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.853 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.854 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.854 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151776 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.854 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.800723+0000", 2023-09-30T17:04:26.854 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.525058994, 2023-09-30T17:04:26.854 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.53140558299999996, 2023-09-30T17:04:26.854 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.854 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.854 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.854 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.854 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.854 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151776 2023-09-30T17:04:26.855 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.855 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.855 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.855 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.855 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.800723+0000", 2023-09-30T17:04:26.855 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.855 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.855 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.855 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.855 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.800723+0000", 2023-09-30T17:04:26.855 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.855 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.856 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.856 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.856 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.800723+0000", 2023-09-30T17:04:26.856 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3099999999999998e-07 2023-09-30T17:04:26.856 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.856 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.856 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.856 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.800745+0000", 2023-09-30T17:04:26.856 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2099e-05 2023-09-30T17:04:26.856 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.856 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.857 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.800757+0000", 2023-09-30T17:04:26.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1990999999999999e-05 2023-09-30T17:04:26.857 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.857 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.800763+0000", 2023-09-30T17:04:26.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9059999999999999e-06 2023-09-30T17:04:26.857 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.857 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.857 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.857 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.858 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.858 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152029 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.858 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.906621+0000", 2023-09-30T17:04:26.858 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.41916068099999998, 2023-09-30T17:04:26.858 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.42556210700000002, 2023-09-30T17:04:26.858 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.858 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.858 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.858 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.858 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.858 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152029 2023-09-30T17:04:26.859 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.859 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.859 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.859 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.859 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.906621+0000", 2023-09-30T17:04:26.859 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.859 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.859 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.859 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.859 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.906621+0000", 2023-09-30T17:04:26.859 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.860 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.860 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.860 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.860 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.906621+0000", 2023-09-30T17:04:26.860 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2799999999999996e-07 2023-09-30T17:04:26.860 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.860 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.860 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.860 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.906638+0000", 2023-09-30T17:04:26.860 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6959000000000001e-05 2023-09-30T17:04:26.860 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.860 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.861 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.861 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.906646+0000", 2023-09-30T17:04:26.861 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3669999999999999e-06 2023-09-30T17:04:26.861 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.861 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.861 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.861 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.906652+0000", 2023-09-30T17:04:26.861 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8050000000000003e-06 2023-09-30T17:04:26.861 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.861 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.861 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.862 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.862 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.862 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152290 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.862 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.000363+0000", 2023-09-30T17:04:26.862 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.32541802800000003, 2023-09-30T17:04:26.862 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.33187197499999999, 2023-09-30T17:04:26.862 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.862 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.862 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.862 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.862 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.863 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152290 2023-09-30T17:04:26.863 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.863 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.863 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.863 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.863 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.000363+0000", 2023-09-30T17:04:26.863 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.863 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.863 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.863 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.863 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.000363+0000", 2023-09-30T17:04:26.864 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.864 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.864 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.864 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.000364+0000", 2023-09-30T17:04:26.864 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5999999999999999e-07 2023-09-30T17:04:26.864 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.864 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.864 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.000375+0000", 2023-09-30T17:04:26.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1134999999999999e-05 2023-09-30T17:04:26.865 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.865 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.865 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.865 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.000382+0000", 2023-09-30T17:04:26.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5309999999999998e-06 2023-09-30T17:04:26.865 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.865 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.865 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.865 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.000387+0000", 2023-09-30T17:04:26.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3510000000000001e-06 2023-09-30T17:04:26.866 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.866 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.866 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.866 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.866 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.866 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152363 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.866 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.024820+0000", 2023-09-30T17:04:26.866 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.30096171500000002, 2023-09-30T17:04:26.866 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.30747344100000001, 2023-09-30T17:04:26.866 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.866 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.867 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.867 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.867 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.867 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152363 2023-09-30T17:04:26.867 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.867 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.867 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.867 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.867 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.024820+0000", 2023-09-30T17:04:26.867 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.867 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.867 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.868 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.024820+0000", 2023-09-30T17:04:26.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.868 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.868 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.024820+0000", 2023-09-30T17:04:26.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8799999999999998e-07 2023-09-30T17:04:26.868 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.024841+0000", 2023-09-30T17:04:26.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0772999999999999e-05 2023-09-30T17:04:26.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.869 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.024847+0000", 2023-09-30T17:04:26.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0340000000000002e-06 2023-09-30T17:04:26.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.869 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.024852+0000", 2023-09-30T17:04:26.870 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.826e-06 2023-09-30T17:04:26.870 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.870 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.870 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.870 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.870 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:152014 4.6 e55/17)", 2023-09-30T17:04:26.870 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.287201+0000", 2023-09-30T17:04:26.870 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.038580828999999997, 2023-09-30T17:04:26.870 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045149402999999998, 2023-09-30T17:04:26.870 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.871 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.871 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.871 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.871 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.871 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.287201+0000", 2023-09-30T17:04:26.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.871 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.871 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.871 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.871 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.287201+0000", 2023-09-30T17:04:26.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.872 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.872 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.287201+0000", 2023-09-30T17:04:26.872 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9900000000000001e-07 2023-09-30T17:04:26.872 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.872 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.287219+0000", 2023-09-30T17:04:26.872 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8179999999999999e-05 2023-09-30T17:04:26.872 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.873 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.873 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.873 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.287229+0000", 2023-09-30T17:04:26.873 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0215e-05 2023-09-30T17:04:26.873 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.873 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.873 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.873 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.287236+0000", 2023-09-30T17:04:26.873 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4749999999999998e-06 2023-09-30T17:04:26.873 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.873 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.873 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.874 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.874 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.874 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:153015 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.874 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.325578+0000", 2023-09-30T17:04:26.874 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.000203582, 2023-09-30T17:04:26.874 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0068262799999999997, 2023-09-30T17:04:26.874 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.874 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.874 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.874 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.875 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.875 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 153015 2023-09-30T17:04:26.875 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.875 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.875 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.875 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.875 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.325578+0000", 2023-09-30T17:04:26.875 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.875 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.875 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.875 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.876 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.325578+0000", 2023-09-30T17:04:26.876 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.876 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.876 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.876 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.876 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.327530+0000", 2023-09-30T17:04:26.876 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001951857 2023-09-30T17:04:26.876 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.876 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.876 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.876 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.327545+0000", 2023-09-30T17:04:26.877 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4885999999999999e-05 2023-09-30T17:04:26.877 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.877 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.877 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.877 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.327553+0000", 2023-09-30T17:04:26.877 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4959999999999996e-06 2023-09-30T17:04:26.877 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.877 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.877 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.877 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.327559+0000", 2023-09-30T17:04:26.877 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3430000000000001e-06 2023-09-30T17:04:26.877 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.878 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.878 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.878 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.878 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.878 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151551 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.878 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.710607+0000", 2023-09-30T17:04:26.878 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.61517429999999995, 2023-09-30T17:04:26.878 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.62185690199999999, 2023-09-30T17:04:26.878 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.879 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.879 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.879 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.879 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.879 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151551 2023-09-30T17:04:26.879 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.879 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.879 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.879 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.879 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.710607+0000", 2023-09-30T17:04:26.879 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.880 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.880 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.880 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.880 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.710607+0000", 2023-09-30T17:04:26.880 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.880 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.880 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.880 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.880 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.710608+0000", 2023-09-30T17:04:26.880 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7300000000000001e-07 2023-09-30T17:04:26.880 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.881 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.881 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.881 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.710621+0000", 2023-09-30T17:04:26.881 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3653e-05 2023-09-30T17:04:26.881 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.881 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.881 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.881 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.710628+0000", 2023-09-30T17:04:26.881 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3249999999999996e-06 2023-09-30T17:04:26.881 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.881 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.881 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.882 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.710633+0000", 2023-09-30T17:04:26.882 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2480000000000004e-06 2023-09-30T17:04:26.882 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.882 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.882 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.882 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.882 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.882 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152033 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.882 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.906660+0000", 2023-09-30T17:04:26.882 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.419121523, 2023-09-30T17:04:26.883 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.42586874400000002, 2023-09-30T17:04:26.883 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.883 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.883 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.883 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.883 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.883 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152033 2023-09-30T17:04:26.883 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.883 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.883 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.883 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.884 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.906660+0000", 2023-09-30T17:04:26.884 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.884 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.884 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.884 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.884 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.906660+0000", 2023-09-30T17:04:26.884 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.884 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.884 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.884 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.884 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.906661+0000", 2023-09-30T17:04:26.885 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.68e-07 2023-09-30T17:04:26.885 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.885 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.885 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.885 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.906672+0000", 2023-09-30T17:04:26.885 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1841999999999999e-05 2023-09-30T17:04:26.885 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.885 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.885 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.885 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.906679+0000", 2023-09-30T17:04:26.885 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3300000000000004e-06 2023-09-30T17:04:26.886 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.886 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.886 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.886 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.906684+0000", 2023-09-30T17:04:26.886 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0000000000000004e-06 2023-09-30T17:04:26.886 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.886 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.886 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.886 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.886 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.887 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152071 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.887 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.918568+0000", 2023-09-30T17:04:26.887 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.40721331399999999, 2023-09-30T17:04:26.887 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.41401996200000002, 2023-09-30T17:04:26.887 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.887 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.887 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.887 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.887 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.887 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152071 2023-09-30T17:04:26.887 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.888 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.888 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.888 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.888 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.918568+0000", 2023-09-30T17:04:26.888 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.888 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.888 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.888 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.888 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.918568+0000", 2023-09-30T17:04:26.888 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.888 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.889 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.889 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.889 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.920515+0000", 2023-09-30T17:04:26.889 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019468280000000001 2023-09-30T17:04:26.889 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.889 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.889 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.889 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.920527+0000", 2023-09-30T17:04:26.889 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1916000000000001e-05 2023-09-30T17:04:26.889 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.889 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.889 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.890 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.920536+0000", 2023-09-30T17:04:26.890 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3549999999999994e-06 2023-09-30T17:04:26.890 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.890 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.890 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.890 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.920542+0000", 2023-09-30T17:04:26.890 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4090000000000002e-06 2023-09-30T17:04:26.890 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.890 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.890 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.890 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.891 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.891 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152194 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.891 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.959164+0000", 2023-09-30T17:04:26.891 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.36661760300000001, 2023-09-30T17:04:26.891 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.37348424099999999, 2023-09-30T17:04:26.891 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.891 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.891 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.891 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.891 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.891 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152194 2023-09-30T17:04:26.892 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.892 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.892 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.892 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.892 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.959164+0000", 2023-09-30T17:04:26.892 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.892 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.892 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.892 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.892 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.959164+0000", 2023-09-30T17:04:26.892 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.893 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.893 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.893 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.893 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.963516+0000", 2023-09-30T17:04:26.893 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0043522179999999997 2023-09-30T17:04:26.893 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.893 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.893 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.893 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.963535+0000", 2023-09-30T17:04:26.893 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8797999999999999e-05 2023-09-30T17:04:26.893 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.893 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.894 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.894 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.963548+0000", 2023-09-30T17:04:26.894 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3545e-05 2023-09-30T17:04:26.894 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.894 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.894 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.894 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.963557+0000", 2023-09-30T17:04:26.894 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6759999999999996e-06 2023-09-30T17:04:26.894 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.894 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.894 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.895 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.895 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.895 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:151728 4.6 e55/17 4:62d56fc8:::100000001f8.0000001c:head v 55'9355, mlcod=55'9327)", 2023-09-30T17:04:26.895 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.183739+0000", 2023-09-30T17:04:26.895 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.142042165, 2023-09-30T17:04:26.895 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.148972523, 2023-09-30T17:04:26.895 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.895 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:26.895 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.895 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.895 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.896 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.183739+0000", 2023-09-30T17:04:26.896 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.896 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.896 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.896 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.896 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.183739+0000", 2023-09-30T17:04:26.896 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.896 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.896 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.896 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.897 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.183740+0000", 2023-09-30T17:04:26.897 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1800000000000002e-07 2023-09-30T17:04:26.897 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.897 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.897 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.897 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.183757+0000", 2023-09-30T17:04:26.897 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7348999999999999e-05 2023-09-30T17:04:26.897 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.897 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.897 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.897 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.183768+0000", 2023-09-30T17:04:26.898 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1228e-05 2023-09-30T17:04:26.898 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.898 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.898 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.898 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.183774+0000", 2023-09-30T17:04:26.898 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4210000000000003e-06 2023-09-30T17:04:26.898 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.898 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.898 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:26.898 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.313679+0000", 2023-09-30T17:04:26.898 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.129904939 2023-09-30T17:04:26.899 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.899 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.899 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:26.899 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.313697+0000", 2023-09-30T17:04:26.899 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8229000000000001e-05 2023-09-30T17:04:26.899 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.899 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.899 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.899 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.899 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.899 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:151845 4.6 e55/17)", 2023-09-30T17:04:26.899 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.232614+0000", 2023-09-30T17:04:26.900 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.093167289, 2023-09-30T17:04:26.900 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.10015711300000001, 2023-09-30T17:04:26.900 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.900 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.900 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.900 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.900 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.900 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.232614+0000", 2023-09-30T17:04:26.900 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.900 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.901 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.901 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.901 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.232614+0000", 2023-09-30T17:04:26.901 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.901 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.901 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.901 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.901 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.232614+0000", 2023-09-30T17:04:26.901 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6899999999999999e-07 2023-09-30T17:04:26.901 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.901 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.902 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.902 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.232660+0000", 2023-09-30T17:04:26.902 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5890999999999998e-05 2023-09-30T17:04:26.902 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.902 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.902 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.902 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.232666+0000", 2023-09-30T17:04:26.902 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2979999999999999e-06 2023-09-30T17:04:26.902 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.902 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.902 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.903 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.232669+0000", 2023-09-30T17:04:26.903 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5719999999999999e-06 2023-09-30T17:04:26.903 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.903 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.903 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.903 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.903 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.903 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152899 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.903 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.268574+0000", 2023-09-30T17:04:26.903 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.057207994999999998, 2023-09-30T17:04:26.903 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.064228029000000006, 2023-09-30T17:04:26.904 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.904 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.904 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.904 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.904 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.904 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152899 2023-09-30T17:04:26.904 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.904 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.904 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.904 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.904 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.268574+0000", 2023-09-30T17:04:26.905 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.905 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.905 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.905 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.905 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.268574+0000", 2023-09-30T17:04:26.905 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.905 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.905 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.962 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.962 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.268574+0000", 2023-09-30T17:04:26.962 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7599999999999997e-07 2023-09-30T17:04:26.962 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.962 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.963 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.963 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.268585+0000", 2023-09-30T17:04:26.963 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0876999999999999e-05 2023-09-30T17:04:26.963 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.964 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.965 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.965 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.268592+0000", 2023-09-30T17:04:26.965 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7780000000000002e-06 2023-09-30T17:04:26.965 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.965 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.965 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.965 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.268597+0000", 2023-09-30T17:04:26.965 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9679999999999997e-06 2023-09-30T17:04:26.965 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.966 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.966 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.966 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.966 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.966 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151318 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.966 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.622619+0000", 2023-09-30T17:04:26.966 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.70316250800000002, 2023-09-30T17:04:26.966 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.71026401800000005, 2023-09-30T17:04:26.966 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.966 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.966 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.966 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.966 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.967 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151318 2023-09-30T17:04:26.967 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.967 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.967 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.970 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.970 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.622619+0000", 2023-09-30T17:04:26.970 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.970 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.971 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.971 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.971 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.622619+0000", 2023-09-30T17:04:26.971 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.971 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.971 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.972 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.972 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.624523+0000", 2023-09-30T17:04:26.972 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001903884 2023-09-30T17:04:26.972 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.972 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.972 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.972 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.624539+0000", 2023-09-30T17:04:26.973 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6594000000000001e-05 2023-09-30T17:04:26.973 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.973 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.973 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.973 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.624552+0000", 2023-09-30T17:04:26.973 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2339e-05 2023-09-30T17:04:26.973 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.974 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.974 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.974 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.624560+0000", 2023-09-30T17:04:26.974 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9850000000000006e-06 2023-09-30T17:04:26.974 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.974 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.975 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.975 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.975 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.975 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151926 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.975 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.861244+0000", 2023-09-30T17:04:26.975 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.46453780099999997, 2023-09-30T17:04:26.975 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.47169366499999998, 2023-09-30T17:04:26.975 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.975 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.976 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.976 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.976 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.976 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151926 2023-09-30T17:04:26.976 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.976 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.977 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.977 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.977 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.861244+0000", 2023-09-30T17:04:26.977 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.978 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.979 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.979 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.979 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.861244+0000", 2023-09-30T17:04:26.980 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.980 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.980 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.980 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.981 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.861244+0000", 2023-09-30T17:04:26.981 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7300000000000002e-07 2023-09-30T17:04:26.981 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.981 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.981 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.981 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.861255+0000", 2023-09-30T17:04:26.981 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1257000000000001e-05 2023-09-30T17:04:26.981 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.981 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.982 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.982 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.861261+0000", 2023-09-30T17:04:26.982 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7429999999999999e-06 2023-09-30T17:04:26.982 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.982 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.982 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.983 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.861266+0000", 2023-09-30T17:04:26.983 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5170000000000001e-06 2023-09-30T17:04:26.983 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.983 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.983 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.984 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.984 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.984 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152075 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.984 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.920550+0000", 2023-09-30T17:04:26.984 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.40523139800000002, 2023-09-30T17:04:26.985 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.41243719600000001, 2023-09-30T17:04:26.985 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.985 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.985 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.986 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.986 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.986 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152075 2023-09-30T17:04:26.986 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.987 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.988 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.988 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.920550+0000", 2023-09-30T17:04:26.989 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.989 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.989 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.990 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.990 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.920550+0000", 2023-09-30T17:04:26.990 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.990 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.990 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.990 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.990 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.920550+0000", 2023-09-30T17:04:26.990 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4900000000000001e-07 2023-09-30T17:04:26.990 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.991 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.991 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.991 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.920567+0000", 2023-09-30T17:04:26.991 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6351999999999999e-05 2023-09-30T17:04:26.991 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.991 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.991 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.991 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.920573+0000", 2023-09-30T17:04:26.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.818e-06 2023-09-30T17:04:26.992 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.992 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.920576+0000", 2023-09-30T17:04:26.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3289999999999998e-06 2023-09-30T17:04:26.992 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.992 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.992 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.992 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.993 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152198 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.993 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.963572+0000", 2023-09-30T17:04:26.993 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.362209907, 2023-09-30T17:04:26.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.36948054600000002, 2023-09-30T17:04:26.993 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.993 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.993 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.993 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.994 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.994 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152198 2023-09-30T17:04:26.994 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.994 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.994 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.994 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.994 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.963572+0000", 2023-09-30T17:04:26.994 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.994 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.994 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.995 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:26.995 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.963572+0000", 2023-09-30T17:04:26.995 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.995 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.995 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.995 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:26.995 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.963572+0000", 2023-09-30T17:04:26.995 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3000000000000001e-07 2023-09-30T17:04:26.995 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.996 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:26.996 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.963587+0000", 2023-09-30T17:04:26.996 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4481000000000001e-05 2023-09-30T17:04:26.996 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.996 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:26.996 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.963595+0000", 2023-09-30T17:04:26.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4260000000000003e-06 2023-09-30T17:04:26.997 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.997 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:26.997 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.963600+0000", 2023-09-30T17:04:26.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.322e-06 2023-09-30T17:04:26.997 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.997 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:26.997 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:26.997 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.998 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152437 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:26.998 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.048605+0000", 2023-09-30T17:04:26.998 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.27717603200000002, 2023-09-30T17:04:26.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.28449571000000001, 2023-09-30T17:04:26.998 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:26.998 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:26.998 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:26.998 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:26.998 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:26.999 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152437 2023-09-30T17:04:26.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.999 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:26.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:26.999 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:26.999 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.048605+0000", 2023-09-30T17:04:26.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:26.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:26.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.000 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.000 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.048605+0000", 2023-09-30T17:04:27.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.000 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.000 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.048606+0000", 2023-09-30T17:04:27.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4000000000000002e-07 2023-09-30T17:04:27.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.001 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.001 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.048618+0000", 2023-09-30T17:04:27.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2488e-05 2023-09-30T17:04:27.002 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.002 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.002 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.048625+0000", 2023-09-30T17:04:27.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6030000000000001e-06 2023-09-30T17:04:27.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.048630+0000", 2023-09-30T17:04:27.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2170000000000002e-06 2023-09-30T17:04:27.004 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.004 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.005 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.005 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.005 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152901 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.005 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.268604+0000", 2023-09-30T17:04:27.005 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.057177783000000003, 2023-09-30T17:04:27.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.064572259000000007, 2023-09-30T17:04:27.005 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.005 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.005 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.005 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.006 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.006 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152901 2023-09-30T17:04:27.006 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.006 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.006 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.006 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.268604+0000", 2023-09-30T17:04:27.006 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.006 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.006 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.268604+0000", 2023-09-30T17:04:27.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.007 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.268604+0000", 2023-09-30T17:04:27.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9299999999999999e-07 2023-09-30T17:04:27.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.007 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.268617+0000", 2023-09-30T17:04:27.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.296e-05 2023-09-30T17:04:27.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.008 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.008 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.268624+0000", 2023-09-30T17:04:27.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6479999999999997e-06 2023-09-30T17:04:27.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.008 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.008 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.268629+0000", 2023-09-30T17:04:27.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9169999999999997e-06 2023-09-30T17:04:27.009 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.009 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.009 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.009 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.009 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:153154 4.15 e55/17 4:aada5e43:::100000001f8.00000028:head v 55'2390, mlcod=55'2387)", 2023-09-30T17:04:27.009 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.302035+0000", 2023-09-30T17:04:27.009 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.023746152, 2023-09-30T17:04:27.009 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.031178279999999999, 2023-09-30T17:04:27.009 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.010 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:27.010 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.010 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.010 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.302035+0000", 2023-09-30T17:04:27.010 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.010 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.010 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.010 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.302035+0000", 2023-09-30T17:04:27.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.302036+0000", 2023-09-30T17:04:27.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5800000000000001e-07 2023-09-30T17:04:27.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.302045+0000", 2023-09-30T17:04:27.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1160000000000005e-06 2023-09-30T17:04:27.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.302050+0000", 2023-09-30T17:04:27.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4700000000000001e-06 2023-09-30T17:04:27.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.302054+0000", 2023-09-30T17:04:27.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9559999999999999e-06 2023-09-30T17:04:27.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.013 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:27.013 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.303961+0000", 2023-09-30T17:04:27.013 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019067769999999999 2023-09-30T17:04:27.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.013 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:27.013 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.303978+0000", 2023-09-30T17:04:27.013 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6915e-05 2023-09-30T17:04:27.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.014 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:27.014 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.333099+0000", 2023-09-30T17:04:27.014 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.029120884 2023-09-30T17:04:27.014 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.014 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.014 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.014 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.014 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.014 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(client.4547.0:152954 4.2d e55/17 ondisk, result = 0)", 2023-09-30T17:04:27.014 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.329484+0000", 2023-09-30T17:04:27.015 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9962974, 2023-09-30T17:04:27.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003812897, 2023-09-30T17:04:27.015 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.015 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:27.015 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.015 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.329484+0000", 2023-09-30T17:04:27.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.015 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.329484+0000", 2023-09-30T17:04:27.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.329484+0000", 2023-09-30T17:04:27.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.03e-07 2023-09-30T17:04:27.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.329487+0000", 2023-09-30T17:04:27.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3649999999999998e-06 2023-09-30T17:04:27.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.329498+0000", 2023-09-30T17:04:27.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0861e-05 2023-09-30T17:04:27.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.018 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.329503+0000", 2023-09-30T17:04:27.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0629999999999996e-06 2023-09-30T17:04:27.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.018 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:27.018 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.333256+0000", 2023-09-30T17:04:27.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0037530789999999999 2023-09-30T17:04:27.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.018 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:27.019 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.333281+0000", 2023-09-30T17:04:27.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5060000000000001e-05 2023-09-30T17:04:27.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.019 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:27.019 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.333297+0000", 2023-09-30T17:04:27.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6166000000000001e-05 2023-09-30T17:04:27.019 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.019 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.019 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.020 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151368 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.020 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.632579+0000", 2023-09-30T17:04:27.020 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.69320282200000005, 2023-09-30T17:04:27.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.70101239999999998, 2023-09-30T17:04:27.020 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.020 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.020 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.021 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.021 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.021 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151368 2023-09-30T17:04:27.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.021 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.021 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.021 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.632579+0000", 2023-09-30T17:04:27.022 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.022 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.022 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.022 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.022 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.632579+0000", 2023-09-30T17:04:27.022 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.022 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.022 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.023 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.023 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.637048+0000", 2023-09-30T17:04:27.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0044697679999999998 2023-09-30T17:04:27.023 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.023 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.023 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.023 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.637068+0000", 2023-09-30T17:04:27.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9766999999999999e-05 2023-09-30T17:04:27.023 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.023 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.024 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.024 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.637086+0000", 2023-09-30T17:04:27.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7433999999999999e-05 2023-09-30T17:04:27.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.024 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.024 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.637094+0000", 2023-09-30T17:04:27.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9589999999999995e-06 2023-09-30T17:04:27.024 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.024 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.024 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.025 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.025 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.025 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151445 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.025 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.671569+0000", 2023-09-30T17:04:27.025 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.65421267299999997, 2023-09-30T17:04:27.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.66207094899999996, 2023-09-30T17:04:27.025 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.025 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.025 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.025 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.025 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.026 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151445 2023-09-30T17:04:27.026 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.026 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.026 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.026 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.671569+0000", 2023-09-30T17:04:27.026 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.026 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.026 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.027 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.671569+0000", 2023-09-30T17:04:27.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.027 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.027 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.027 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.671569+0000", 2023-09-30T17:04:27.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2200000000000004e-07 2023-09-30T17:04:27.027 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.027 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.027 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.671584+0000", 2023-09-30T17:04:27.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5064e-05 2023-09-30T17:04:27.028 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.028 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.028 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.028 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.671591+0000", 2023-09-30T17:04:27.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8770000000000004e-06 2023-09-30T17:04:27.028 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.028 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.028 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.028 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.671597+0000", 2023-09-30T17:04:27.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0249999999999999e-06 2023-09-30T17:04:27.029 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.029 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.029 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.029 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.029 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152076 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.029 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.920581+0000", 2023-09-30T17:04:27.029 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.40520073200000001, 2023-09-30T17:04:27.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.41309335200000002, 2023-09-30T17:04:27.029 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.030 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.030 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.030 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.030 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.030 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152076 2023-09-30T17:04:27.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.030 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.030 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.030 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.920581+0000", 2023-09-30T17:04:27.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.920581+0000", 2023-09-30T17:04:27.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.922514+0000", 2023-09-30T17:04:27.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001933096 2023-09-30T17:04:27.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.032 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.032 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.922539+0000", 2023-09-30T17:04:27.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4651000000000002e-05 2023-09-30T17:04:27.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.032 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.032 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.922550+0000", 2023-09-30T17:04:27.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1576999999999999e-05 2023-09-30T17:04:27.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.032 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.033 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.922558+0000", 2023-09-30T17:04:27.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8809999999999996e-06 2023-09-30T17:04:27.033 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.033 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.033 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.033 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.033 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.033 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152112 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.033 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.937486+0000", 2023-09-30T17:04:27.033 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.38829538299999999, 2023-09-30T17:04:27.034 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.39624363499999998, 2023-09-30T17:04:27.034 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.034 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.034 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.034 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.034 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.034 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152112 2023-09-30T17:04:27.034 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.034 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.034 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.035 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.937486+0000", 2023-09-30T17:04:27.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.035 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.035 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.035 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.035 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.937486+0000", 2023-09-30T17:04:27.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.035 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.035 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.035 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.035 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.937487+0000", 2023-09-30T17:04:27.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4900000000000001e-07 2023-09-30T17:04:27.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.036 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.937498+0000", 2023-09-30T17:04:27.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1161999999999999e-05 2023-09-30T17:04:27.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.036 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.937504+0000", 2023-09-30T17:04:27.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8710000000000002e-06 2023-09-30T17:04:27.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.037 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.937508+0000", 2023-09-30T17:04:27.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5870000000000003e-06 2023-09-30T17:04:27.037 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.037 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.037 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.038 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152292 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.038 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.000429+0000", 2023-09-30T17:04:27.038 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.32535262199999998, 2023-09-30T17:04:27.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.33334282500000001, 2023-09-30T17:04:27.038 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.038 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.038 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.038 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.038 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.038 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152292 2023-09-30T17:04:27.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.038 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.117 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.117 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.000429+0000", 2023-09-30T17:04:27.117 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.117 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.117 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.117 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.119 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.000429+0000", 2023-09-30T17:04:27.119 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.119 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.119 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.119 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.120 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.003518+0000", 2023-09-30T17:04:27.120 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0030886289999999999 2023-09-30T17:04:27.120 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.120 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.120 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.120 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.003538+0000", 2023-09-30T17:04:27.120 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0489999999999999e-05 2023-09-30T17:04:27.120 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.120 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.121 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.121 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.003549+0000", 2023-09-30T17:04:27.121 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0861e-05 2023-09-30T17:04:27.121 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.121 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.121 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.121 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.003557+0000", 2023-09-30T17:04:27.122 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8229999999999995e-06 2023-09-30T17:04:27.122 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.122 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.122 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.122 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.122 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.122 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152475 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.122 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.068573+0000", 2023-09-30T17:04:27.122 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.25720800700000002, 2023-09-30T17:04:27.123 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.26524415299999998, 2023-09-30T17:04:27.123 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.123 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.123 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.123 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.123 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.123 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152475 2023-09-30T17:04:27.123 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.123 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.123 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.123 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.124 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.068573+0000", 2023-09-30T17:04:27.124 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.124 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.124 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.124 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.124 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.068573+0000", 2023-09-30T17:04:27.124 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.124 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.124 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.124 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.124 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.068574+0000", 2023-09-30T17:04:27.125 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6700000000000003e-07 2023-09-30T17:04:27.125 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.125 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.125 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.125 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.068592+0000", 2023-09-30T17:04:27.125 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7677999999999999e-05 2023-09-30T17:04:27.125 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.125 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.125 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.125 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.068601+0000", 2023-09-30T17:04:27.125 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2220000000000008e-06 2023-09-30T17:04:27.126 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.126 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.126 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.126 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.068606+0000", 2023-09-30T17:04:27.126 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4559999999999999e-06 2023-09-30T17:04:27.126 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.126 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.126 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.126 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.126 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.126 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152628 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.127 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.127563+0000", 2023-09-30T17:04:27.127 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.19821867300000001, 2023-09-30T17:04:27.127 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.20628759699999999, 2023-09-30T17:04:27.127 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.127 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.127 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.127 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.127 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.127 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152628 2023-09-30T17:04:27.128 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.128 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.128 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.128 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.128 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.127563+0000", 2023-09-30T17:04:27.128 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.128 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.129 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.129 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.129 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.127563+0000", 2023-09-30T17:04:27.129 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.129 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.129 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.129 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.129 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.127563+0000", 2023-09-30T17:04:27.129 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4799999999999999e-07 2023-09-30T17:04:27.129 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.130 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.130 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.130 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.127574+0000", 2023-09-30T17:04:27.130 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0693000000000001e-05 2023-09-30T17:04:27.130 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.130 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.130 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.130 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.127578+0000", 2023-09-30T17:04:27.130 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.386e-06 2023-09-30T17:04:27.130 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.130 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.131 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.131 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.127581+0000", 2023-09-30T17:04:27.131 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1709999999999998e-06 2023-09-30T17:04:27.131 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.131 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.131 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.131 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.131 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.131 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:151769 4.36 e55/17 4:6fa85f86:::100000001f8.00000013:head v 55'7154, mlcod=55'7141)", 2023-09-30T17:04:27.131 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.195768+0000", 2023-09-30T17:04:27.131 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.13001384399999999, 2023-09-30T17:04:27.131 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.13811567, 2023-09-30T17:04:27.132 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.132 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:27.132 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.132 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.132 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.132 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.195768+0000", 2023-09-30T17:04:27.132 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.132 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.132 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.132 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.133 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.195768+0000", 2023-09-30T17:04:27.133 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.133 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.133 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.133 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.195768+0000", 2023-09-30T17:04:27.133 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2700000000000001e-07 2023-09-30T17:04:27.133 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.133 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.134 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.195779+0000", 2023-09-30T17:04:27.134 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0910999999999999e-05 2023-09-30T17:04:27.134 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.134 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.134 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.134 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.195785+0000", 2023-09-30T17:04:27.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9290000000000003e-06 2023-09-30T17:04:27.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.135 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.135 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.135 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.195789+0000", 2023-09-30T17:04:27.136 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7180000000000004e-06 2023-09-30T17:04:27.136 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.136 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.136 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:27.136 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.327418+0000", 2023-09-30T17:04:27.136 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.131628774 2023-09-30T17:04:27.136 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.136 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.136 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:27.136 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.327437+0000", 2023-09-30T17:04:27.137 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9059000000000002e-05 2023-09-30T17:04:27.137 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.137 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.137 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.137 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.137 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.137 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152902 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.137 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.268635+0000", 2023-09-30T17:04:27.137 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.057146534999999998, 2023-09-30T17:04:27.137 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.065286917, 2023-09-30T17:04:27.138 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.138 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.138 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.138 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.138 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.138 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152902 2023-09-30T17:04:27.138 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.138 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.138 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.138 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.139 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.268635+0000", 2023-09-30T17:04:27.139 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.139 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.139 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.139 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.139 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.268635+0000", 2023-09-30T17:04:27.139 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.139 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.142 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.142 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.142 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.268635+0000", 2023-09-30T17:04:27.142 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4299999999999999e-07 2023-09-30T17:04:27.142 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.142 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.142 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.143 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.268647+0000", 2023-09-30T17:04:27.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1260999999999999e-05 2023-09-30T17:04:27.143 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.143 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.143 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.143 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.268652+0000", 2023-09-30T17:04:27.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7139999999999998e-06 2023-09-30T17:04:27.144 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.144 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.144 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.144 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.268657+0000", 2023-09-30T17:04:27.144 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5499999999999996e-06 2023-09-30T17:04:27.144 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.144 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.144 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.145 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.145 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.145 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152934 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.145 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.287572+0000", 2023-09-30T17:04:27.146 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.038209571999999997, 2023-09-30T17:04:27.146 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.046382512000000001, 2023-09-30T17:04:27.147 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.147 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.147 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.147 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.147 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.148 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152934 2023-09-30T17:04:27.148 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.148 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.148 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.148 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.148 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.287572+0000", 2023-09-30T17:04:27.148 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.148 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.148 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.149 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.149 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.287572+0000", 2023-09-30T17:04:27.149 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.149 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.149 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.149 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.149 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.290423+0000", 2023-09-30T17:04:27.149 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0028515039999999999 2023-09-30T17:04:27.149 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.149 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.150 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.150 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.290440+0000", 2023-09-30T17:04:27.150 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.641e-05 2023-09-30T17:04:27.150 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.150 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.150 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.150 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.290448+0000", 2023-09-30T17:04:27.150 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2320000000000001e-06 2023-09-30T17:04:27.150 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.150 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.150 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.151 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.290454+0000", 2023-09-30T17:04:27.151 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3260000000000001e-06 2023-09-30T17:04:27.151 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.151 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.151 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.151 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.151 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.151 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:153178 4.3b e55/17 4:dcc0c15f:::100000001f8.0000001a:head v 55'2480, mlcod=55'2478)", 2023-09-30T17:04:27.151 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.315579+0000", 2023-09-30T17:04:27.151 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.010202156, 2023-09-30T17:04:27.151 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018409964000000001, 2023-09-30T17:04:27.152 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.152 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:27.152 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.152 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.152 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.153 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.315579+0000", 2023-09-30T17:04:27.153 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.153 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.153 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.153 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.153 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.315579+0000", 2023-09-30T17:04:27.153 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.153 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.154 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.154 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.155 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.315580+0000", 2023-09-30T17:04:27.155 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.84e-07 2023-09-30T17:04:27.155 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.155 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.155 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.155 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.315593+0000", 2023-09-30T17:04:27.155 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3264999999999999e-05 2023-09-30T17:04:27.155 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.155 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.155 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.156 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.315600+0000", 2023-09-30T17:04:27.156 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6390000000000003e-06 2023-09-30T17:04:27.156 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.156 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.156 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.156 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.315604+0000", 2023-09-30T17:04:27.156 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8620000000000002e-06 2023-09-30T17:04:27.156 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.156 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.156 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:27.157 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.317882+0000", 2023-09-30T17:04:27.157 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0022776570000000002 2023-09-30T17:04:27.157 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.157 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.157 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:27.157 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.317904+0000", 2023-09-30T17:04:27.157 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1523e-05 2023-09-30T17:04:27.157 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.157 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.157 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.157 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.157 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.158 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop_reply(client.4547.0:152975 4.2d e55/17 ondisk, result = 0)", 2023-09-30T17:04:27.158 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.329515+0000", 2023-09-30T17:04:27.158 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9962664, 2023-09-30T17:04:27.158 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.004225159, 2023-09-30T17:04:27.162 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.162 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:27.162 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.162 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.162 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.162 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.329515+0000", 2023-09-30T17:04:27.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.163 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.163 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.163 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.163 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.329515+0000", 2023-09-30T17:04:27.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.164 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.164 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.329515+0000", 2023-09-30T17:04:27.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6600000000000003e-07 2023-09-30T17:04:27.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.165 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.165 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.329518+0000", 2023-09-30T17:04:27.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.481e-06 2023-09-30T17:04:27.165 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.165 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.165 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.165 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.329524+0000", 2023-09-30T17:04:27.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0800000000000002e-06 2023-09-30T17:04:27.165 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.165 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.165 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.166 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.329528+0000", 2023-09-30T17:04:27.166 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.284e-06 2023-09-30T17:04:27.166 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.166 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:27.166 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.333716+0000", 2023-09-30T17:04:27.166 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041878360000000003 2023-09-30T17:04:27.166 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.166 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:27.166 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.333724+0000", 2023-09-30T17:04:27.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3499999999999997e-06 2023-09-30T17:04:27.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.167 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:27.167 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.333740+0000", 2023-09-30T17:04:27.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5862000000000002e-05 2023-09-30T17:04:27.167 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.167 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.167 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.168 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151586 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.168 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.725873+0000", 2023-09-30T17:04:27.168 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.59990841900000003, 2023-09-30T17:04:27.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.60819317100000003, 2023-09-30T17:04:27.168 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.168 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.168 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.168 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.168 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.169 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151586 2023-09-30T17:04:27.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.169 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.725873+0000", 2023-09-30T17:04:27.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.170 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.725873+0000", 2023-09-30T17:04:27.170 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.170 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.170 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.725874+0000", 2023-09-30T17:04:27.170 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5299999999999999e-07 2023-09-30T17:04:27.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.170 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.170 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.725895+0000", 2023-09-30T17:04:27.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1145000000000002e-05 2023-09-30T17:04:27.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.725901+0000", 2023-09-30T17:04:27.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7889999999999997e-06 2023-09-30T17:04:27.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.725907+0000", 2023-09-30T17:04:27.172 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5029999999999997e-06 2023-09-30T17:04:27.172 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.172 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.172 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.172 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151639 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.172 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.744678+0000", 2023-09-30T17:04:27.172 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.58110331500000001, 2023-09-30T17:04:27.172 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.58944874599999997, 2023-09-30T17:04:27.172 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.172 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.173 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.173 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.173 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.173 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151639 2023-09-30T17:04:27.173 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.173 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.173 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.173 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.744678+0000", 2023-09-30T17:04:27.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.173 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.744678+0000", 2023-09-30T17:04:27.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.175 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.175 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.748538+0000", 2023-09-30T17:04:27.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038599929999999999 2023-09-30T17:04:27.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.748557+0000", 2023-09-30T17:04:27.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9031000000000001e-05 2023-09-30T17:04:27.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.177 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.177 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.748567+0000", 2023-09-30T17:04:27.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.577e-06 2023-09-30T17:04:27.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.178 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.178 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.178 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.748574+0000", 2023-09-30T17:04:27.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6140000000000003e-06 2023-09-30T17:04:27.178 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.179 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.179 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.179 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151668 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.180 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.762593+0000", 2023-09-30T17:04:27.180 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.56318806899999996, 2023-09-30T17:04:27.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.57159663699999996, 2023-09-30T17:04:27.180 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.180 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.181 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.181 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.181 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.181 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151668 2023-09-30T17:04:27.181 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.181 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.182 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.182 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.762593+0000", 2023-09-30T17:04:27.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.762593+0000", 2023-09-30T17:04:27.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.184 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.184 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.762594+0000", 2023-09-30T17:04:27.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.51e-07 2023-09-30T17:04:27.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.185 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.185 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.762609+0000", 2023-09-30T17:04:27.185 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5458999999999999e-05 2023-09-30T17:04:27.185 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.185 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.186 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.186 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.762616+0000", 2023-09-30T17:04:27.186 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9369999999999998e-06 2023-09-30T17:04:27.186 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.186 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.186 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.187 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.762622+0000", 2023-09-30T17:04:27.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4310000000000002e-06 2023-09-30T17:04:27.187 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.187 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.187 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.188 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152036 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.188 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.908575+0000", 2023-09-30T17:04:27.188 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.41720630399999997, 2023-09-30T17:04:27.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.42567475300000002, 2023-09-30T17:04:27.189 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.189 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.189 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.189 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.189 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.190 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152036 2023-09-30T17:04:27.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.190 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.190 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.190 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.908575+0000", 2023-09-30T17:04:27.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.191 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.908575+0000", 2023-09-30T17:04:27.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.192 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.908576+0000", 2023-09-30T17:04:27.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7400000000000003e-07 2023-09-30T17:04:27.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.908590+0000", 2023-09-30T17:04:27.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4664999999999999e-05 2023-09-30T17:04:27.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.908598+0000", 2023-09-30T17:04:27.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0150000000000003e-06 2023-09-30T17:04:27.272 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.272 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.908604+0000", 2023-09-30T17:04:27.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9719999999999997e-06 2023-09-30T17:04:27.273 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.273 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.273 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.273 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.273 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.273 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152113 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.274 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.937520+0000", 2023-09-30T17:04:27.274 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.38826158100000002, 2023-09-30T17:04:27.274 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.39679448699999997, 2023-09-30T17:04:27.274 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.274 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.275 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.275 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.275 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.275 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152113 2023-09-30T17:04:27.275 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.275 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.937520+0000", 2023-09-30T17:04:27.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.937520+0000", 2023-09-30T17:04:27.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.939516+0000", 2023-09-30T17:04:27.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019956499999999999 2023-09-30T17:04:27.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.939537+0000", 2023-09-30T17:04:27.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1433e-05 2023-09-30T17:04:27.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.939548+0000", 2023-09-30T17:04:27.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0689999999999999e-05 2023-09-30T17:04:27.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.939556+0000", 2023-09-30T17:04:27.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4570000000000005e-06 2023-09-30T17:04:27.279 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.279 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.279 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.279 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152295 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.279 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.003570+0000", 2023-09-30T17:04:27.279 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.32221170100000002, 2023-09-30T17:04:27.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.330816202, 2023-09-30T17:04:27.280 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.280 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.280 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.280 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.280 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.280 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152295 2023-09-30T17:04:27.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.280 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.003570+0000", 2023-09-30T17:04:27.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.003570+0000", 2023-09-30T17:04:27.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.003570+0000", 2023-09-30T17:04:27.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1099999999999996e-07 2023-09-30T17:04:27.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.283 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.283 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.003582+0000", 2023-09-30T17:04:27.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1960000000000001e-05 2023-09-30T17:04:27.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.284 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.284 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.003589+0000", 2023-09-30T17:04:27.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2770000000000002e-06 2023-09-30T17:04:27.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.287 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.003593+0000", 2023-09-30T17:04:27.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7990000000000001e-06 2023-09-30T17:04:27.287 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.287 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.287 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.288 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152331 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.288 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.009804+0000", 2023-09-30T17:04:27.288 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.31597776799999999, 2023-09-30T17:04:27.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.32473468500000002, 2023-09-30T17:04:27.288 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.289 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.289 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.289 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.289 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.289 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152331 2023-09-30T17:04:27.289 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.290 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.290 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.009804+0000", 2023-09-30T17:04:27.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.290 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.009804+0000", 2023-09-30T17:04:27.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.014580+0000", 2023-09-30T17:04:27.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047762789999999996 2023-09-30T17:04:27.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.293 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.014597+0000", 2023-09-30T17:04:27.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6588000000000001e-05 2023-09-30T17:04:27.293 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.293 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.293 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.014605+0000", 2023-09-30T17:04:27.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3599999999999996e-06 2023-09-30T17:04:27.294 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.294 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.294 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.014611+0000", 2023-09-30T17:04:27.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.392e-06 2023-09-30T17:04:27.295 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.295 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.295 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.295 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152368 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.296 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.025251+0000", 2023-09-30T17:04:27.296 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.30053000299999999, 2023-09-30T17:04:27.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.30937878099999999, 2023-09-30T17:04:27.296 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.296 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.296 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.297 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.297 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.297 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152368 2023-09-30T17:04:27.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.297 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.025251+0000", 2023-09-30T17:04:27.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.299 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.025251+0000", 2023-09-30T17:04:27.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.299 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.299 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.299 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.025252+0000", 2023-09-30T17:04:27.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1699999999999997e-07 2023-09-30T17:04:27.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.300 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.300 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.025264+0000", 2023-09-30T17:04:27.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1724e-05 2023-09-30T17:04:27.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.301 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.025271+0000", 2023-09-30T17:04:27.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8399999999999997e-06 2023-09-30T17:04:27.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.302 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.025277+0000", 2023-09-30T17:04:27.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9449999999999998e-06 2023-09-30T17:04:27.302 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.302 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.303 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.303 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152630 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.303 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.127587+0000", 2023-09-30T17:04:27.303 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.19819488499999999, 2023-09-30T17:04:27.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.20710741399999999, 2023-09-30T17:04:27.303 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.303 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.304 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.304 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.304 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.304 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152630 2023-09-30T17:04:27.304 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.304 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.304 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.304 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.127587+0000", 2023-09-30T17:04:27.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.304 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.305 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.305 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.127587+0000", 2023-09-30T17:04:27.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.305 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.305 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.127587+0000", 2023-09-30T17:04:27.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.36e-07 2023-09-30T17:04:27.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.305 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.305 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.127596+0000", 2023-09-30T17:04:27.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5999999999999996e-06 2023-09-30T17:04:27.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.127600+0000", 2023-09-30T17:04:27.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.737e-06 2023-09-30T17:04:27.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.127603+0000", 2023-09-30T17:04:27.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9450000000000002e-06 2023-09-30T17:04:27.307 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.307 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.307 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.307 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:151712 4.6 e55/17 4:635f8cb4:::100000001f8.0000003c:head v 55'9353, mlcod=55'9324)", 2023-09-30T17:04:27.307 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.169613+0000", 2023-09-30T17:04:27.307 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.156168575, 2023-09-30T17:04:27.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.16514563800000001, 2023-09-30T17:04:27.307 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.320 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:27.320 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.169613+0000", 2023-09-30T17:04:27.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.321 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.321 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.321 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.169613+0000", 2023-09-30T17:04:27.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.169613+0000", 2023-09-30T17:04:27.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0499999999999999e-07 2023-09-30T17:04:27.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.169628+0000", 2023-09-30T17:04:27.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4331999999999999e-05 2023-09-30T17:04:27.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.169636+0000", 2023-09-30T17:04:27.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5210000000000002e-06 2023-09-30T17:04:27.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.169642+0000", 2023-09-30T17:04:27.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5520000000000004e-06 2023-09-30T17:04:27.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:27.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.295499+0000", 2023-09-30T17:04:27.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.12585723700000001 2023-09-30T17:04:27.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:27.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.295526+0000", 2023-09-30T17:04:27.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6648e-05 2023-09-30T17:04:27.324 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.324 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.324 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.325 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:151729 4.6 e55/17 4:635f8cb4:::100000001f8.0000003c:head v 55'9356, mlcod=55'9327)", 2023-09-30T17:04:27.325 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.186096+0000", 2023-09-30T17:04:27.325 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.1396858, 2023-09-30T17:04:27.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.148731585, 2023-09-30T17:04:27.325 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.325 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:27.325 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.186096+0000", 2023-09-30T17:04:27.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.326 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.326 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.326 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.186096+0000", 2023-09-30T17:04:27.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.342 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.342 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.342 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.342 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.186096+0000", 2023-09-30T17:04:27.342 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7599999999999998e-07 2023-09-30T17:04:27.342 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.342 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.342 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.342 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.186109+0000", 2023-09-30T17:04:27.342 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3286e-05 2023-09-30T17:04:27.342 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.343 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.343 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.343 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.186115+0000", 2023-09-30T17:04:27.343 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4349999999999996e-06 2023-09-30T17:04:27.343 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.343 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.343 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.343 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.186120+0000", 2023-09-30T17:04:27.343 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1549999999999998e-06 2023-09-30T17:04:27.343 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.343 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.343 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:27.345 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.320255+0000", 2023-09-30T17:04:27.345 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.13413557800000001 2023-09-30T17:04:27.346 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.346 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.346 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:27.346 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.320283+0000", 2023-09-30T17:04:27.346 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7583999999999999e-05 2023-09-30T17:04:27.346 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.346 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.346 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.346 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.346 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.347 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:151765 4.6 e55/17)", 2023-09-30T17:04:27.347 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.195796+0000", 2023-09-30T17:04:27.347 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.12998554300000001, 2023-09-30T17:04:27.347 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.13909846300000001, 2023-09-30T17:04:27.347 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.347 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.347 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.347 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.347 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.347 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.195796+0000", 2023-09-30T17:04:27.348 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.348 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.348 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.348 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.348 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.195796+0000", 2023-09-30T17:04:27.348 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.348 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.348 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.348 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.348 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.195796+0000", 2023-09-30T17:04:27.348 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8900000000000001e-07 2023-09-30T17:04:27.349 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.349 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.349 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.349 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.195808+0000", 2023-09-30T17:04:27.349 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.199e-05 2023-09-30T17:04:27.349 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.349 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.349 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.349 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.195814+0000", 2023-09-30T17:04:27.349 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0689999999999998e-06 2023-09-30T17:04:27.350 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.350 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.350 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.350 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.195819+0000", 2023-09-30T17:04:27.350 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5519999999999998e-06 2023-09-30T17:04:27.350 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.350 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.350 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.351 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.351 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.351 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:151851 4.36 e55/17)", 2023-09-30T17:04:27.351 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.235585+0000", 2023-09-30T17:04:27.352 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.090196681000000001, 2023-09-30T17:04:27.352 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.099362619999999999, 2023-09-30T17:04:27.352 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.352 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.352 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.352 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.353 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.353 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.235585+0000", 2023-09-30T17:04:27.353 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.353 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.353 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.354 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.354 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.235585+0000", 2023-09-30T17:04:27.354 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.354 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.354 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.354 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.355 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.235585+0000", 2023-09-30T17:04:27.355 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6400000000000003e-07 2023-09-30T17:04:27.355 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.355 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.355 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.356 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.235607+0000", 2023-09-30T17:04:27.356 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1865000000000002e-05 2023-09-30T17:04:27.356 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.356 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.357 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.357 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.235617+0000", 2023-09-30T17:04:27.357 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4499999999999993e-06 2023-09-30T17:04:27.357 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.357 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.358 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.358 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.235623+0000", 2023-09-30T17:04:27.358 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4300000000000003e-06 2023-09-30T17:04:27.358 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.358 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.358 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.359 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.359 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152959 4.12 4:4be51a30:::100000001f8.0000000b:head [write 3764224~4096 in=4096b,write 3821568~4096 in=4096b,write 3883008~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.359 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.301215+0000", 2023-09-30T17:04:27.359 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.024566985, 2023-09-30T17:04:27.359 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033796220000000002, 2023-09-30T17:04:27.359 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.359 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:27.359 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.359 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.359 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.360 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152959 2023-09-30T17:04:27.360 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.360 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.360 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.360 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.360 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.301215+0000", 2023-09-30T17:04:27.360 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.360 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.360 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.360 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.360 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.301215+0000", 2023-09-30T17:04:27.361 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.361 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.361 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.361 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.361 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.303517+0000", 2023-09-30T17:04:27.361 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0023029470000000001 2023-09-30T17:04:27.361 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.361 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.361 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.361 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.303533+0000", 2023-09-30T17:04:27.427 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5322e-05 2023-09-30T17:04:27.427 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.429 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.429 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.429 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.303544+0000", 2023-09-30T17:04:27.429 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1184e-05 2023-09-30T17:04:27.429 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.430 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.430 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.430 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.303550+0000", 2023-09-30T17:04:27.430 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3029999999999996e-06 2023-09-30T17:04:27.430 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.431 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.431 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:27.431 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.311187+0000", 2023-09-30T17:04:27.431 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.007636884 2023-09-30T17:04:27.431 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.432 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.432 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:27.432 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.311264+0000", 2023-09-30T17:04:27.432 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7317999999999994e-05 2023-09-30T17:04:27.432 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.432 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.433 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:27.433 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.311411+0000", 2023-09-30T17:04:27.433 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014647 2023-09-30T17:04:27.433 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.433 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.433 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:27.433 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.331063+0000", 2023-09-30T17:04:27.433 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019651865000000001 2023-09-30T17:04:27.433 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.433 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.434 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.434 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.434 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.434 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:153214 4.1c e55/17 4:39b842ef:::100000001f8.00000029:head v 55'2388, mlcod=55'2385)", 2023-09-30T17:04:27.434 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.329535+0000", 2023-09-30T17:04:27.434 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9962463, 2023-09-30T17:04:27.434 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0055774300000000004, 2023-09-30T17:04:27.435 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.435 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:27.435 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.435 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.435 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.436 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.329535+0000", 2023-09-30T17:04:27.436 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.436 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.436 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.436 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.436 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.329535+0000", 2023-09-30T17:04:27.436 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.437 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.437 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.437 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.437 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.329536+0000", 2023-09-30T17:04:27.437 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8099999999999999e-07 2023-09-30T17:04:27.437 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.437 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.437 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.438 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.329553+0000", 2023-09-30T17:04:27.438 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7238e-05 2023-09-30T17:04:27.438 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.438 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.438 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.438 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.329568+0000", 2023-09-30T17:04:27.438 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5033e-05 2023-09-30T17:04:27.439 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.439 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.439 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.439 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.329573+0000", 2023-09-30T17:04:27.439 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0629999999999996e-06 2023-09-30T17:04:27.439 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.439 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.439 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:27.439 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.329620+0000", 2023-09-30T17:04:27.440 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6655e-05 2023-09-30T17:04:27.440 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.440 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.440 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:27.440 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.329634+0000", 2023-09-30T17:04:27.440 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4307999999999999e-05 2023-09-30T17:04:27.440 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.440 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.441 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.441 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.441 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.442 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151640 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.442 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.748588+0000", 2023-09-30T17:04:27.442 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.57719354099999998, 2023-09-30T17:04:27.442 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.58659628799999997, 2023-09-30T17:04:27.442 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.442 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.443 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.443 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.443 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.443 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151640 2023-09-30T17:04:27.443 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.443 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.444 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.444 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.748588+0000", 2023-09-30T17:04:27.444 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.444 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.444 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.444 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.444 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.748588+0000", 2023-09-30T17:04:27.444 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.444 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.444 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.444 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.445 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.748588+0000", 2023-09-30T17:04:27.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7999999999999996e-07 2023-09-30T17:04:27.445 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.445 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.445 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.445 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.748600+0000", 2023-09-30T17:04:27.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1759e-05 2023-09-30T17:04:27.445 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.445 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.445 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.445 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.748608+0000", 2023-09-30T17:04:27.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7530000000000001e-06 2023-09-30T17:04:27.446 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.446 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.446 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.446 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.748613+0000", 2023-09-30T17:04:27.446 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9649999999999999e-06 2023-09-30T17:04:27.446 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.446 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.446 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.446 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.446 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.447 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151781 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.447 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.804696+0000", 2023-09-30T17:04:27.447 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.52108514299999997, 2023-09-30T17:04:27.447 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.53055758099999994, 2023-09-30T17:04:27.447 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.447 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.447 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.447 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.447 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.447 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151781 2023-09-30T17:04:27.447 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.447 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.448 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.448 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.804696+0000", 2023-09-30T17:04:27.448 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.448 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.448 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.448 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.804696+0000", 2023-09-30T17:04:27.448 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.448 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.448 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.449 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.804697+0000", 2023-09-30T17:04:27.449 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5999999999999999e-07 2023-09-30T17:04:27.449 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.449 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.449 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.449 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.804711+0000", 2023-09-30T17:04:27.449 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.428e-05 2023-09-30T17:04:27.449 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.449 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.449 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.450 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.804717+0000", 2023-09-30T17:04:27.450 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4409999999999998e-06 2023-09-30T17:04:27.450 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.450 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.450 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.450 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.804723+0000", 2023-09-30T17:04:27.450 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7270000000000004e-06 2023-09-30T17:04:27.450 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.450 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.450 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.450 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.451 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.451 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151960 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.451 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.868725+0000", 2023-09-30T17:04:27.451 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.457056503, 2023-09-30T17:04:27.451 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.46659917699999998, 2023-09-30T17:04:27.451 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.451 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.451 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.451 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.451 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.451 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151960 2023-09-30T17:04:27.452 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.452 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.452 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.452 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.452 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.868725+0000", 2023-09-30T17:04:27.452 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.452 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.452 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.452 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.452 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.868725+0000", 2023-09-30T17:04:27.452 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.453 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.453 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.453 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.453 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.871974+0000", 2023-09-30T17:04:27.453 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0032492630000000001 2023-09-30T17:04:27.453 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.453 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.453 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.454 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.871994+0000", 2023-09-30T17:04:27.454 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9573e-05 2023-09-30T17:04:27.454 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.454 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.454 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.454 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.872001+0000", 2023-09-30T17:04:27.454 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1760000000000004e-06 2023-09-30T17:04:27.454 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.454 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.454 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.455 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.872007+0000", 2023-09-30T17:04:27.455 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0140000000000004e-06 2023-09-30T17:04:27.455 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.455 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.455 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.456 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.456 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.456 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152228 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.456 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.975575+0000", 2023-09-30T17:04:27.456 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.35020691500000001, 2023-09-30T17:04:27.456 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.35981857, 2023-09-30T17:04:27.456 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.456 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.456 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.456 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.457 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.457 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152228 2023-09-30T17:04:27.457 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.457 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.457 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.457 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.457 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.975575+0000", 2023-09-30T17:04:27.457 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.458 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.458 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.458 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.458 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.975575+0000", 2023-09-30T17:04:27.458 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.458 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.458 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.458 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.458 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.977515+0000", 2023-09-30T17:04:27.458 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019405410000000001 2023-09-30T17:04:27.459 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.459 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.459 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.459 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.977532+0000", 2023-09-30T17:04:27.459 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6676000000000001e-05 2023-09-30T17:04:27.459 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.459 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.459 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.460 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.977541+0000", 2023-09-30T17:04:27.460 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1740000000000006e-06 2023-09-30T17:04:27.460 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.460 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.460 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.460 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.977548+0000", 2023-09-30T17:04:27.460 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.528e-06 2023-09-30T17:04:27.460 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.460 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.461 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.461 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.461 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.461 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152270 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.461 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.989635+0000", 2023-09-30T17:04:27.461 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.33614671800000001, 2023-09-30T17:04:27.461 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.34581182300000002, 2023-09-30T17:04:27.461 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.461 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.462 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.462 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.462 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.462 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152270 2023-09-30T17:04:27.462 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.462 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.462 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.462 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.463 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.989635+0000", 2023-09-30T17:04:27.463 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.463 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.463 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.463 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.989635+0000", 2023-09-30T17:04:27.463 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.463 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.463 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.464 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.989635+0000", 2023-09-30T17:04:27.464 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8500000000000002e-07 2023-09-30T17:04:27.464 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.464 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.464 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.464 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.989646+0000", 2023-09-30T17:04:27.464 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0556e-05 2023-09-30T17:04:27.464 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.464 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.464 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.464 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.989652+0000", 2023-09-30T17:04:27.464 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0530000000000003e-06 2023-09-30T17:04:27.465 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.465 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.465 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.465 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.989657+0000", 2023-09-30T17:04:27.465 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3689999999999998e-06 2023-09-30T17:04:27.465 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.465 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.465 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.465 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.465 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.465 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152631 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.465 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.127607+0000", 2023-09-30T17:04:27.466 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.198174406, 2023-09-30T17:04:27.466 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.20789115399999999, 2023-09-30T17:04:27.466 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.466 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.466 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.466 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.466 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.467 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152631 2023-09-30T17:04:27.467 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.467 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.467 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.467 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.467 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.127607+0000", 2023-09-30T17:04:27.467 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.467 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.468 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.468 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.468 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.127607+0000", 2023-09-30T17:04:27.468 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.468 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.468 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.468 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.468 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.127607+0000", 2023-09-30T17:04:27.469 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3999999999999997e-07 2023-09-30T17:04:27.469 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.469 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.469 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.469 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.127619+0000", 2023-09-30T17:04:27.469 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1389999999999999e-05 2023-09-30T17:04:27.469 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.469 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.469 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.469 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.127626+0000", 2023-09-30T17:04:27.469 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0870000000000001e-06 2023-09-30T17:04:27.469 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.470 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.470 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.470 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.127629+0000", 2023-09-30T17:04:27.470 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.055e-06 2023-09-30T17:04:27.470 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.470 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.470 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.470 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.470 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.470 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:151894 4.6 e55/17)", 2023-09-30T17:04:27.470 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.254009+0000", 2023-09-30T17:04:27.471 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.071772534999999998, 2023-09-30T17:04:27.471 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.081547247000000003, 2023-09-30T17:04:27.471 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.471 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.471 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.471 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.471 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.471 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.254009+0000", 2023-09-30T17:04:27.471 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.471 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.471 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.472 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.472 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.254009+0000", 2023-09-30T17:04:27.472 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.472 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.472 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.472 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.472 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.254010+0000", 2023-09-30T17:04:27.472 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9699999999999994e-07 2023-09-30T17:04:27.472 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.472 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.473 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.473 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.254025+0000", 2023-09-30T17:04:27.473 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5160999999999999e-05 2023-09-30T17:04:27.473 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.473 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.473 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.473 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.254037+0000", 2023-09-30T17:04:27.473 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2361000000000001e-05 2023-09-30T17:04:27.473 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.473 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.474 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.474 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.254046+0000", 2023-09-30T17:04:27.474 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4989999999999994e-06 2023-09-30T17:04:27.474 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.474 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.474 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.474 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.474 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.474 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152960 4.35 4:ad9a5eb7:::100000001f8.00000023:head [write 1302528~4096 in=4096b,write 1314816~4096 in=4096b,write 1556480~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.474 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.303564+0000", 2023-09-30T17:04:27.474 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.022217400000000002, 2023-09-30T17:04:27.475 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.032047417000000002, 2023-09-30T17:04:27.475 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.475 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:27.475 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.475 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.475 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.475 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152960 2023-09-30T17:04:27.475 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.475 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.475 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.475 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.475 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.303564+0000", 2023-09-30T17:04:27.476 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.476 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.476 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.476 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.476 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.303564+0000", 2023-09-30T17:04:27.476 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.476 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.476 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.476 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.476 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.303565+0000", 2023-09-30T17:04:27.476 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6700000000000003e-07 2023-09-30T17:04:27.476 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.477 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.477 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.477 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.303578+0000", 2023-09-30T17:04:27.477 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2911000000000001e-05 2023-09-30T17:04:27.477 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.477 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.477 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.477 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.303584+0000", 2023-09-30T17:04:27.477 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4729999999999997e-06 2023-09-30T17:04:27.477 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.478 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.478 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.478 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.303589+0000", 2023-09-30T17:04:27.478 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1710000000000001e-06 2023-09-30T17:04:27.478 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.478 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.478 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:27.478 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.313686+0000", 2023-09-30T17:04:27.478 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010096645 2023-09-30T17:04:27.478 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.478 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.479 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:27.479 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.313777+0000", 2023-09-30T17:04:27.479 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1588999999999993e-05 2023-09-30T17:04:27.479 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.479 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.479 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.479 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.479 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.479 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:152061 4.36 e55/17)", 2023-09-30T17:04:27.479 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.317946+0000", 2023-09-30T17:04:27.479 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0078355170000000002, 2023-09-30T17:04:27.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017729014000000001, 2023-09-30T17:04:27.480 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.480 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.480 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.480 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.480 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.317946+0000", 2023-09-30T17:04:27.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.480 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.480 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.317946+0000", 2023-09-30T17:04:27.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.481 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.481 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.481 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.481 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.317947+0000", 2023-09-30T17:04:27.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7300000000000005e-07 2023-09-30T17:04:27.481 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.481 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.481 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.481 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.317963+0000", 2023-09-30T17:04:27.482 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6402999999999999e-05 2023-09-30T17:04:27.482 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.482 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.482 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.482 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.317972+0000", 2023-09-30T17:04:27.482 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0070000000000003e-06 2023-09-30T17:04:27.482 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.482 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.482 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.482 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.317979+0000", 2023-09-30T17:04:27.482 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1269999999999997e-06 2023-09-30T17:04:27.483 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.483 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.483 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.483 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.483 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.483 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:153016 4.38 4:1dcf718c:::100000001f8.00000022:head [write 1212416~4096 in=4096b,write 1257472~4096 in=4096b,write 1282048~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.483 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.327569+0000", 2023-09-30T17:04:27.483 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9982128, 2023-09-30T17:04:27.483 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0081577460000000004, 2023-09-30T17:04:27.483 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.483 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:27.484 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.484 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.484 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.484 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 153016 2023-09-30T17:04:27.484 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.484 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.484 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.484 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.484 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.327569+0000", 2023-09-30T17:04:27.484 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.484 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.484 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.485 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.485 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.327569+0000", 2023-09-30T17:04:27.485 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.485 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.485 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.485 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.485 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.329589+0000", 2023-09-30T17:04:27.485 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0020199660000000002 2023-09-30T17:04:27.485 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.485 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.485 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.486 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.329608+0000", 2023-09-30T17:04:27.486 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8995999999999999e-05 2023-09-30T17:04:27.486 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.486 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.486 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.486 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.329616+0000", 2023-09-30T17:04:27.486 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3170000000000002e-06 2023-09-30T17:04:27.486 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.486 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.486 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.486 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.329623+0000", 2023-09-30T17:04:27.486 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.635e-06 2023-09-30T17:04:27.487 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.487 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.487 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:27.487 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.329666+0000", 2023-09-30T17:04:27.487 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3649999999999997e-05 2023-09-30T17:04:27.487 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.487 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.487 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:27.487 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.329754+0000", 2023-09-30T17:04:27.487 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7832999999999997e-05 2023-09-30T17:04:27.488 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.488 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.488 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.488 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.488 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.488 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151391 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.488 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.648605+0000", 2023-09-30T17:04:27.488 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.67717671599999996, 2023-09-30T17:04:27.488 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.687185461, 2023-09-30T17:04:27.489 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.489 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.489 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.489 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.489 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.489 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151391 2023-09-30T17:04:27.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.489 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.490 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.490 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.648605+0000", 2023-09-30T17:04:27.490 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.490 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.490 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.490 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.490 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.648605+0000", 2023-09-30T17:04:27.490 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.490 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.491 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.491 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.491 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.652516+0000", 2023-09-30T17:04:27.491 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003911192 2023-09-30T17:04:27.491 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.491 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.492 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.492 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.652531+0000", 2023-09-30T17:04:27.492 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4562000000000001e-05 2023-09-30T17:04:27.492 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.492 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.492 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.492 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.652539+0000", 2023-09-30T17:04:27.492 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5199999999999997e-06 2023-09-30T17:04:27.492 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.492 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.492 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.493 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.652545+0000", 2023-09-30T17:04:27.493 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9030000000000001e-06 2023-09-30T17:04:27.493 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.493 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.493 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.493 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.493 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.493 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151670 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.494 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.762673+0000", 2023-09-30T17:04:27.494 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.56310864299999996, 2023-09-30T17:04:27.494 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.57316840899999999, 2023-09-30T17:04:27.494 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.494 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.494 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.494 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.494 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.494 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151670 2023-09-30T17:04:27.495 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.495 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.495 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.495 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.495 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.762673+0000", 2023-09-30T17:04:27.495 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.495 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.495 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.495 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.496 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.762673+0000", 2023-09-30T17:04:27.496 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.496 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.496 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.496 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.496 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.762673+0000", 2023-09-30T17:04:27.496 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6100000000000001e-07 2023-09-30T17:04:27.496 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.497 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.497 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.497 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.762691+0000", 2023-09-30T17:04:27.497 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7353000000000001e-05 2023-09-30T17:04:27.497 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.497 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.497 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.497 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.762698+0000", 2023-09-30T17:04:27.497 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8820000000000003e-06 2023-09-30T17:04:27.497 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.498 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.498 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.498 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.762703+0000", 2023-09-30T17:04:27.498 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6529999999999999e-06 2023-09-30T17:04:27.498 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.498 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.498 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.499 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.499 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.499 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151782 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.499 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.804730+0000", 2023-09-30T17:04:27.499 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.521051441, 2023-09-30T17:04:27.499 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.53116412400000002, 2023-09-30T17:04:27.499 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.499 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.500 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.500 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.500 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.500 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151782 2023-09-30T17:04:27.500 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.500 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.500 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.500 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.501 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.804730+0000", 2023-09-30T17:04:27.501 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.501 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.501 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.501 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.501 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.804730+0000", 2023-09-30T17:04:27.501 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.502 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.502 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.502 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.502 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.804730+0000", 2023-09-30T17:04:27.502 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.89e-07 2023-09-30T17:04:27.502 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.502 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.502 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.502 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.804749+0000", 2023-09-30T17:04:27.502 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8692e-05 2023-09-30T17:04:27.502 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.503 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.503 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.503 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.804756+0000", 2023-09-30T17:04:27.503 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8560000000000001e-06 2023-09-30T17:04:27.503 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.503 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.503 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.503 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.804762+0000", 2023-09-30T17:04:27.503 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7529999999999998e-06 2023-09-30T17:04:27.503 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.503 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.503 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.504 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.504 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.504 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151812 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.504 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.812679+0000", 2023-09-30T17:04:27.504 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.513102061, 2023-09-30T17:04:27.504 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.52326581800000005, 2023-09-30T17:04:27.504 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.504 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.504 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.504 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.504 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.504 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151812 2023-09-30T17:04:27.505 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.505 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.505 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.505 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.505 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.812679+0000", 2023-09-30T17:04:27.505 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.505 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.505 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.505 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.505 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.812679+0000", 2023-09-30T17:04:27.505 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.506 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.506 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.506 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.812680+0000", 2023-09-30T17:04:27.506 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7100000000000002e-07 2023-09-30T17:04:27.506 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.506 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.506 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.812692+0000", 2023-09-30T17:04:27.506 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2424e-05 2023-09-30T17:04:27.507 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.507 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.507 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.507 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.812699+0000", 2023-09-30T17:04:27.507 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3029999999999996e-06 2023-09-30T17:04:27.507 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.507 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.507 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.507 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.812704+0000", 2023-09-30T17:04:27.507 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2000000000000002e-06 2023-09-30T17:04:27.507 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.508 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.508 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.508 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.508 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.508 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152038 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.508 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.908664+0000", 2023-09-30T17:04:27.508 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.41711721299999999, 2023-09-30T17:04:27.508 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.42733414600000003, 2023-09-30T17:04:27.508 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.508 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.508 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.509 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.509 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.509 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152038 2023-09-30T17:04:27.509 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.509 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.509 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.509 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.509 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.908664+0000", 2023-09-30T17:04:27.509 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.509 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.509 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.509 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.510 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.908664+0000", 2023-09-30T17:04:27.510 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.510 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.510 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.510 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.510 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.908665+0000", 2023-09-30T17:04:27.510 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8400000000000005e-07 2023-09-30T17:04:27.510 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.510 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.510 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.510 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.908684+0000", 2023-09-30T17:04:27.511 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9718999999999999e-05 2023-09-30T17:04:27.511 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.511 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.511 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.511 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.908692+0000", 2023-09-30T17:04:27.511 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0539999999999997e-06 2023-09-30T17:04:27.511 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.511 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.511 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.511 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.908698+0000", 2023-09-30T17:04:27.511 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4659999999999996e-06 2023-09-30T17:04:27.511 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.512 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.512 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.512 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.512 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.512 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152166 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.512 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.950760+0000", 2023-09-30T17:04:27.512 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.37502114199999997, 2023-09-30T17:04:27.512 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.38528947299999999, 2023-09-30T17:04:27.513 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.513 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.513 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.513 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.513 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.513 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152166 2023-09-30T17:04:27.513 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.513 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.513 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.513 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.514 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.950760+0000", 2023-09-30T17:04:27.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.514 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.514 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.514 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.514 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.950760+0000", 2023-09-30T17:04:27.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.514 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.514 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.514 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.514 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.950761+0000", 2023-09-30T17:04:27.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5499999999999998e-07 2023-09-30T17:04:27.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.515 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.515 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.950781+0000", 2023-09-30T17:04:27.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9967999999999999e-05 2023-09-30T17:04:27.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.515 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.515 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.950788+0000", 2023-09-30T17:04:27.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3139999999999998e-06 2023-09-30T17:04:27.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.516 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.516 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.950795+0000", 2023-09-30T17:04:27.516 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6030000000000001e-06 2023-09-30T17:04:27.516 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.516 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.516 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.516 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152338 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.516 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.014658+0000", 2023-09-30T17:04:27.517 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.311123865, 2023-09-30T17:04:27.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.321446238, 2023-09-30T17:04:27.517 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.517 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.517 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.517 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.517 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.517 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152338 2023-09-30T17:04:27.517 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.517 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.518 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.518 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.014658+0000", 2023-09-30T17:04:27.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.518 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.518 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.518 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.518 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.014658+0000", 2023-09-30T17:04:27.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.518 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.518 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.518 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.519 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.014658+0000", 2023-09-30T17:04:27.519 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4999999999999998e-07 2023-09-30T17:04:27.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.519 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.519 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.014670+0000", 2023-09-30T17:04:27.519 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2041999999999999e-05 2023-09-30T17:04:27.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.519 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.519 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.014677+0000", 2023-09-30T17:04:27.519 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8190000000000003e-06 2023-09-30T17:04:27.520 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.520 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.520 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.520 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.014682+0000", 2023-09-30T17:04:27.520 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2870000000000004e-06 2023-09-30T17:04:27.520 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.520 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.520 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.520 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.520 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.520 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152662 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.521 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.138838+0000", 2023-09-30T17:04:27.521 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.18694353999999999, 2023-09-30T17:04:27.521 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.19731875900000001, 2023-09-30T17:04:27.521 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.521 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.521 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.521 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.521 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.521 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152662 2023-09-30T17:04:27.521 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.522 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.522 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.522 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.138838+0000", 2023-09-30T17:04:27.522 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.523 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.138838+0000", 2023-09-30T17:04:27.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.523 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.138838+0000", 2023-09-30T17:04:27.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8100000000000003e-07 2023-09-30T17:04:27.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.524 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.524 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.524 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.138850+0000", 2023-09-30T17:04:27.524 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1596e-05 2023-09-30T17:04:27.524 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.524 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.524 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.524 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.138856+0000", 2023-09-30T17:04:27.524 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2609999999999999e-06 2023-09-30T17:04:27.524 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.525 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.525 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.525 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.138861+0000", 2023-09-30T17:04:27.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1800000000000004e-06 2023-09-30T17:04:27.525 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.525 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.525 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.526 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.526 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152905 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.526 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.268663+0000", 2023-09-30T17:04:27.526 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.057118408000000002, 2023-09-30T17:04:27.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.067547995999999999, 2023-09-30T17:04:27.526 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.526 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.526 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.526 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.527 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.527 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152905 2023-09-30T17:04:27.527 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.527 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.527 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.527 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.527 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.268663+0000", 2023-09-30T17:04:27.527 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.528 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.528 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.528 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.528 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.268663+0000", 2023-09-30T17:04:27.528 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.528 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.528 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.528 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.528 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.272980+0000", 2023-09-30T17:04:27.528 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0043168490000000002 2023-09-30T17:04:27.529 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.529 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.529 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.529 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.272994+0000", 2023-09-30T17:04:27.529 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3638999999999999e-05 2023-09-30T17:04:27.529 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.529 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.529 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.529 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.273003+0000", 2023-09-30T17:04:27.530 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3670000000000003e-06 2023-09-30T17:04:27.530 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.530 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.530 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.579 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.273009+0000", 2023-09-30T17:04:27.579 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1149999999999999e-06 2023-09-30T17:04:27.580 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.580 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.580 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.580 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.580 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.580 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152936 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.580 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.290507+0000", 2023-09-30T17:04:27.580 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.035274232000000003, 2023-09-30T17:04:27.580 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045756458999999999, 2023-09-30T17:04:27.581 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.581 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.581 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.581 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.581 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.581 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152936 2023-09-30T17:04:27.582 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.582 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.582 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.582 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.582 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.290507+0000", 2023-09-30T17:04:27.582 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.582 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.582 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.582 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.582 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.290507+0000", 2023-09-30T17:04:27.583 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.583 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.583 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.583 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.583 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.292516+0000", 2023-09-30T17:04:27.583 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0020086259999999999 2023-09-30T17:04:27.583 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.583 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.583 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.584 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.292530+0000", 2023-09-30T17:04:27.584 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4518000000000001e-05 2023-09-30T17:04:27.584 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.584 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.584 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.584 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.292541+0000", 2023-09-30T17:04:27.584 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0969e-05 2023-09-30T17:04:27.584 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.584 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.584 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.584 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.292550+0000", 2023-09-30T17:04:27.584 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5809999999999997e-06 2023-09-30T17:04:27.585 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.585 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.585 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.585 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.585 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.587 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:153017 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.587 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.329638+0000", 2023-09-30T17:04:27.587 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9961438, 2023-09-30T17:04:27.587 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0066799149999999998, 2023-09-30T17:04:27.587 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.587 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.587 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.587 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.587 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.588 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 153017 2023-09-30T17:04:27.588 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.588 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.588 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.588 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.588 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.329638+0000", 2023-09-30T17:04:27.588 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.588 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.588 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.588 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.588 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.329638+0000", 2023-09-30T17:04:27.588 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.589 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.589 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.589 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.589 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.331515+0000", 2023-09-30T17:04:27.589 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0018772789999999999 2023-09-30T17:04:27.589 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.589 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.589 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.589 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.331531+0000", 2023-09-30T17:04:27.589 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5815999999999999e-05 2023-09-30T17:04:27.589 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.590 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.590 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.590 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.331548+0000", 2023-09-30T17:04:27.590 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6931000000000001e-05 2023-09-30T17:04:27.590 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.590 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.590 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.590 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.331556+0000", 2023-09-30T17:04:27.590 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0730000000000005e-06 2023-09-30T17:04:27.590 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.590 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.590 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.591 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.591 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.591 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151219 4.f 4:f0d983b2:::100000001f8.0000001f:head [write 544768~4096 in=4096b,write 733184~4096 in=4096b,write 741376~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.591 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.585769+0000", 2023-09-30T17:04:27.592 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.74001258599999997, 2023-09-30T17:04:27.592 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.75060890800000002, 2023-09-30T17:04:27.592 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.592 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:27.592 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.592 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.592 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.592 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151219 2023-09-30T17:04:27.592 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.592 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.592 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.592 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.593 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.585769+0000", 2023-09-30T17:04:27.593 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.593 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.593 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.593 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.593 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.585769+0000", 2023-09-30T17:04:27.593 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.593 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.593 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.593 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.593 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.591516+0000", 2023-09-30T17:04:27.593 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0057468689999999999 2023-09-30T17:04:27.594 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.594 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.594 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.594 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.591532+0000", 2023-09-30T17:04:27.594 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6626e-05 2023-09-30T17:04:27.594 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.594 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.594 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.594 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.591541+0000", 2023-09-30T17:04:27.594 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7420000000000003e-06 2023-09-30T17:04:27.594 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.595 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.595 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.595 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.591547+0000", 2023-09-30T17:04:27.595 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1639999999999998e-06 2023-09-30T17:04:27.595 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.595 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.595 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:27.595 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.292993+0000", 2023-09-30T17:04:27.595 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.70144563800000004 2023-09-30T17:04:27.595 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.595 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.596 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:27.596 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.293181+0000", 2023-09-30T17:04:27.596 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00018806899999999999 2023-09-30T17:04:27.596 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.596 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.596 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:27.596 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.293354+0000", 2023-09-30T17:04:27.596 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000173 2023-09-30T17:04:27.596 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.596 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.596 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:27.597 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.302641+0000", 2023-09-30T17:04:27.597 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0092870550000000007 2023-09-30T17:04:27.597 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.597 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.597 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.597 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.597 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.597 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151258 4.37 4:ef395e89:::100000001f8.00000020:head [write 1961984~4096 in=4096b,write 2002944~4096 in=4096b,write 2023424~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.597 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.597755+0000", 2023-09-30T17:04:27.597 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.72802635599999999, 2023-09-30T17:04:27.598 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.73873388699999998, 2023-09-30T17:04:27.598 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.598 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:27.598 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.598 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.598 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.598 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151258 2023-09-30T17:04:27.598 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.598 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.599 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.599 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.599 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.597755+0000", 2023-09-30T17:04:27.600 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.600 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.600 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.600 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.600 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.597755+0000", 2023-09-30T17:04:27.600 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.600 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.600 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.600 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.600 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.597756+0000", 2023-09-30T17:04:27.600 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7999999999999995e-07 2023-09-30T17:04:27.600 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.601 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.601 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.601 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.597768+0000", 2023-09-30T17:04:27.601 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2449000000000001e-05 2023-09-30T17:04:27.601 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.601 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.601 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.601 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.597775+0000", 2023-09-30T17:04:27.601 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2699999999999999e-06 2023-09-30T17:04:27.601 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.601 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.602 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.602 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.597781+0000", 2023-09-30T17:04:27.602 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4739999999999996e-06 2023-09-30T17:04:27.602 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.602 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.602 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:27.602 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.320875+0000", 2023-09-30T17:04:27.602 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.72309375399999998 2023-09-30T17:04:27.602 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.602 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.602 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:27.603 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.320956+0000", 2023-09-30T17:04:27.603 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1034999999999999e-05 2023-09-30T17:04:27.603 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.603 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.603 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:27.603 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.321124+0000", 2023-09-30T17:04:27.603 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016819599999999999 2023-09-30T17:04:27.603 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.603 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.603 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.603 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.604 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.604 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151392 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.604 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.652555+0000", 2023-09-30T17:04:27.604 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.67322631300000002, 2023-09-30T17:04:27.604 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.68402576800000003, 2023-09-30T17:04:27.604 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.604 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.604 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.604 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.604 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.604 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151392 2023-09-30T17:04:27.604 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.605 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.605 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.605 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.605 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.652555+0000", 2023-09-30T17:04:27.605 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.605 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.605 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.605 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.605 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.652555+0000", 2023-09-30T17:04:27.605 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.606 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.606 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.606 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.606 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.652556+0000", 2023-09-30T17:04:27.606 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2199999999999999e-07 2023-09-30T17:04:27.606 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.606 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.606 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.606 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.652567+0000", 2023-09-30T17:04:27.606 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1467e-05 2023-09-30T17:04:27.606 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.607 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.607 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.607 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.652574+0000", 2023-09-30T17:04:27.607 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2200000000000003e-06 2023-09-30T17:04:27.607 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.607 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.607 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.607 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.652580+0000", 2023-09-30T17:04:27.607 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3319999999999999e-06 2023-09-30T17:04:27.607 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.607 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.607 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.608 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.608 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.608 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151555 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.608 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.714576+0000", 2023-09-30T17:04:27.608 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.61120584099999997, 2023-09-30T17:04:27.608 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.62207062400000002, 2023-09-30T17:04:27.608 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.608 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.608 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.609 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.609 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.610 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151555 2023-09-30T17:04:27.610 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.610 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.610 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.611 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.611 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.714576+0000", 2023-09-30T17:04:27.611 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.611 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.611 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.611 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.611 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.714576+0000", 2023-09-30T17:04:27.611 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.611 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.611 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.611 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.612 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.714576+0000", 2023-09-30T17:04:27.612 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7599999999999997e-07 2023-09-30T17:04:27.612 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.612 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.612 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.612 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.714592+0000", 2023-09-30T17:04:27.612 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5542000000000001e-05 2023-09-30T17:04:27.612 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.612 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.612 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.612 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.714598+0000", 2023-09-30T17:04:27.613 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5379999999999999e-06 2023-09-30T17:04:27.613 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.613 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.613 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.613 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.714604+0000", 2023-09-30T17:04:27.613 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.22e-06 2023-09-30T17:04:27.613 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.613 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.613 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.613 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.613 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.613 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151642 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.614 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.748620+0000", 2023-09-30T17:04:27.614 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.57716134900000005, 2023-09-30T17:04:27.614 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.58808709400000003, 2023-09-30T17:04:27.614 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.614 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.614 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.614 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.614 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.614 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151642 2023-09-30T17:04:27.614 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.614 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.615 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.615 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.615 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.748620+0000", 2023-09-30T17:04:27.615 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.615 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.615 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.615 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.615 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.748620+0000", 2023-09-30T17:04:27.615 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.615 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.615 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.616 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.616 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.750517+0000", 2023-09-30T17:04:27.616 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001896832 2023-09-30T17:04:27.616 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.616 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.616 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.616 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.750535+0000", 2023-09-30T17:04:27.616 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7728999999999999e-05 2023-09-30T17:04:27.616 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.616 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.616 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.617 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.750547+0000", 2023-09-30T17:04:27.617 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.183e-05 2023-09-30T17:04:27.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.617 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.617 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.617 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.750553+0000", 2023-09-30T17:04:27.617 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9589999999999998e-06 2023-09-30T17:04:27.617 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.617 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.617 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.618 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.618 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151785 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.618 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.804768+0000", 2023-09-30T17:04:27.618 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.52101344900000002, 2023-09-30T17:04:27.618 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.53200277900000004, 2023-09-30T17:04:27.618 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.618 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.618 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.618 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.618 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.619 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151785 2023-09-30T17:04:27.619 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.619 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.619 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.619 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.619 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.804768+0000", 2023-09-30T17:04:27.619 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.619 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.619 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.619 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.619 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.804768+0000", 2023-09-30T17:04:27.619 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.620 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.620 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.620 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.620 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.804769+0000", 2023-09-30T17:04:27.620 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0999999999999999e-07 2023-09-30T17:04:27.620 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.620 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.620 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.620 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.804782+0000", 2023-09-30T17:04:27.620 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3723999999999999e-05 2023-09-30T17:04:27.620 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.621 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.621 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.621 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.804788+0000", 2023-09-30T17:04:27.621 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9190000000000004e-06 2023-09-30T17:04:27.621 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.621 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.621 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.621 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.804794+0000", 2023-09-30T17:04:27.621 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9869999999999996e-06 2023-09-30T17:04:27.621 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.621 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.622 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.622 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.622 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.622 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151910 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.622 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.850023+0000", 2023-09-30T17:04:27.622 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.47575867399999999, 2023-09-30T17:04:27.622 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.48680749899999998, 2023-09-30T17:04:27.622 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.622 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.623 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.623 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.623 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.623 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151910 2023-09-30T17:04:27.623 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.623 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.623 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.623 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.624 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.850023+0000", 2023-09-30T17:04:27.624 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.624 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.624 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.624 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.624 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.850023+0000", 2023-09-30T17:04:27.624 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.624 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.624 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.624 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.625 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.851882+0000", 2023-09-30T17:04:27.625 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0018595040000000001 2023-09-30T17:04:27.626 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.626 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.626 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.626 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.851900+0000", 2023-09-30T17:04:27.627 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7580000000000001e-05 2023-09-30T17:04:27.627 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.627 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.627 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.627 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.851911+0000", 2023-09-30T17:04:27.627 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1367e-05 2023-09-30T17:04:27.627 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.627 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.627 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.627 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.851919+0000", 2023-09-30T17:04:27.627 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7519999999999996e-06 2023-09-30T17:04:27.627 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.628 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.628 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.628 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.628 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.628 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152167 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.628 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.950803+0000", 2023-09-30T17:04:27.628 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.37497827900000003, 2023-09-30T17:04:27.628 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.38609289299999999, 2023-09-30T17:04:27.628 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.628 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.628 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.629 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.629 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.629 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152167 2023-09-30T17:04:27.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.629 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.629 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.950803+0000", 2023-09-30T17:04:27.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.950803+0000", 2023-09-30T17:04:27.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.630 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.950804+0000", 2023-09-30T17:04:27.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4700000000000001e-07 2023-09-30T17:04:27.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.630 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.631 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.950818+0000", 2023-09-30T17:04:27.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4503e-05 2023-09-30T17:04:27.631 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.631 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.631 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.631 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.950824+0000", 2023-09-30T17:04:27.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2140000000000001e-06 2023-09-30T17:04:27.631 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.631 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.631 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.631 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.950830+0000", 2023-09-30T17:04:27.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5489999999999997e-06 2023-09-30T17:04:27.632 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.632 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.632 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.632 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.632 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.632 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152340 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.632 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.014690+0000", 2023-09-30T17:04:27.632 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.311091903, 2023-09-30T17:04:27.632 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.32226547799999999, 2023-09-30T17:04:27.632 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.632 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.632 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.633 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.633 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.633 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152340 2023-09-30T17:04:27.633 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.633 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.633 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.633 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.633 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.014690+0000", 2023-09-30T17:04:27.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.633 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.633 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.633 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.634 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.014690+0000", 2023-09-30T17:04:27.634 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.634 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.014690+0000", 2023-09-30T17:04:27.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3799999999999997e-07 2023-09-30T17:04:27.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.014702+0000", 2023-09-30T17:04:27.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.188e-05 2023-09-30T17:04:27.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.014709+0000", 2023-09-30T17:04:27.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4949999999999996e-06 2023-09-30T17:04:27.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.014714+0000", 2023-09-30T17:04:27.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5060000000000003e-06 2023-09-30T17:04:27.636 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.636 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.636 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.637 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152986 4.2d 4:b4aa06e9:::100000001f8.0000001d:head [write 1658880~4096 in=4096b,write 1671168~4096 in=4096b,write 1748992~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.637 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.315417+0000", 2023-09-30T17:04:27.637 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.010364427000000001, 2023-09-30T17:04:27.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021608879000000001, 2023-09-30T17:04:27.637 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.637 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:27.637 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.637 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.637 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.638 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152986 2023-09-30T17:04:27.638 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.638 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.638 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.638 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.315417+0000", 2023-09-30T17:04:27.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.638 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.638 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.638 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.315417+0000", 2023-09-30T17:04:27.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319517+0000", 2023-09-30T17:04:27.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041002219999999997 2023-09-30T17:04:27.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319537+0000", 2023-09-30T17:04:27.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9928e-05 2023-09-30T17:04:27.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319553+0000", 2023-09-30T17:04:27.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5483000000000001e-05 2023-09-30T17:04:27.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319562+0000", 2023-09-30T17:04:27.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3030000000000005e-06 2023-09-30T17:04:27.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:27.641 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.322610+0000", 2023-09-30T17:04:27.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0030477289999999999 2023-09-30T17:04:27.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:27.641 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.322690+0000", 2023-09-30T17:04:27.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0098999999999993e-05 2023-09-30T17:04:27.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:27.641 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.322862+0000", 2023-09-30T17:04:27.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017243900000000001 2023-09-30T17:04:27.642 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.642 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.642 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.642 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.642 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.642 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:153018 4.1b 4:dbd503eb:::100000001f8.0000002e:head [write 3510272~4096 in=4096b,write 3588096~4096 in=4096b,write 3674112~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.642 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.331569+0000", 2023-09-30T17:04:27.642 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9942122, 2023-09-30T17:04:27.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0055482470000000001, 2023-09-30T17:04:27.642 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.642 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:27.643 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.643 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.643 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.643 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 153018 2023-09-30T17:04:27.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.643 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.643 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.643 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.331569+0000", 2023-09-30T17:04:27.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.644 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.331569+0000", 2023-09-30T17:04:27.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.644 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.644 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.331570+0000", 2023-09-30T17:04:27.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8100000000000003e-07 2023-09-30T17:04:27.644 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.645 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.331588+0000", 2023-09-30T17:04:27.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8530999999999999e-05 2023-09-30T17:04:27.645 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.645 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.645 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.645 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.331602+0000", 2023-09-30T17:04:27.646 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3295000000000001e-05 2023-09-30T17:04:27.646 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.646 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.646 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.646 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.331608+0000", 2023-09-30T17:04:27.646 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.489e-06 2023-09-30T17:04:27.646 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.646 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.646 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:27.646 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.335069+0000", 2023-09-30T17:04:27.646 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0034605159999999999 2023-09-30T17:04:27.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.647 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:27.647 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.335151+0000", 2023-09-30T17:04:27.647 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2150000000000005e-05 2023-09-30T17:04:27.647 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.647 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.647 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.647 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151221 4.37 4:ef395e89:::100000001f8.00000020:head [write 901120~4096 in=4096b,write 929792~4096 in=4096b,write 1122304~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.647 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.591559+0000", 2023-09-30T17:04:27.648 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.73422238799999995, 2023-09-30T17:04:27.648 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.74564056000000001, 2023-09-30T17:04:27.648 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.648 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:27.648 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.648 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.648 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.648 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151221 2023-09-30T17:04:27.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.648 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.591559+0000", 2023-09-30T17:04:27.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.649 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.649 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.591559+0000", 2023-09-30T17:04:27.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.649 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.649 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.591559+0000", 2023-09-30T17:04:27.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.39e-07 2023-09-30T17:04:27.650 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.650 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.650 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.650 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.591570+0000", 2023-09-30T17:04:27.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0738e-05 2023-09-30T17:04:27.650 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.650 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.650 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.650 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.591575+0000", 2023-09-30T17:04:27.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4209999999999997e-06 2023-09-30T17:04:27.650 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.651 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.651 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.591578+0000", 2023-09-30T17:04:27.651 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.915e-06 2023-09-30T17:04:27.651 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.651 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:27.651 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.292928+0000", 2023-09-30T17:04:27.651 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.70135017600000005 2023-09-30T17:04:27.651 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.651 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:27.652 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.292999+0000", 2023-09-30T17:04:27.652 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1019999999999994e-05 2023-09-30T17:04:27.652 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.652 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.652 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:27.652 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.293172+0000", 2023-09-30T17:04:27.652 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000172838 2023-09-30T17:04:27.652 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.652 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.652 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:27.652 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.317788+0000", 2023-09-30T17:04:27.652 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.024616259000000001 2023-09-30T17:04:27.653 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.653 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.653 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.653 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151261 4.37 4:ef395e89:::100000001f8.00000020:head [write 2711552~4096 in=4096b,write 3031040~4096 in=4096b,write 3080192~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.653 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.597790+0000", 2023-09-30T17:04:27.653 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.72799188500000001, 2023-09-30T17:04:27.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.73949241099999996, 2023-09-30T17:04:27.653 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.653 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:27.654 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.654 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.654 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.654 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151261 2023-09-30T17:04:27.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.654 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.654 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.597790+0000", 2023-09-30T17:04:27.654 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.655 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.655 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.655 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.597790+0000", 2023-09-30T17:04:27.655 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.655 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.655 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.655 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.656 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.597790+0000", 2023-09-30T17:04:27.656 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0399999999999996e-07 2023-09-30T17:04:27.656 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.656 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.656 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.656 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.597810+0000", 2023-09-30T17:04:27.656 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9624e-05 2023-09-30T17:04:27.656 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.656 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.656 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.656 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.597816+0000", 2023-09-30T17:04:27.657 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.336e-06 2023-09-30T17:04:27.657 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.657 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.657 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.597821+0000", 2023-09-30T17:04:27.657 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2669999999999997e-06 2023-09-30T17:04:27.657 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.657 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:27.657 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.329943+0000", 2023-09-30T17:04:27.657 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.73212116100000002 2023-09-30T17:04:27.657 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:27.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.330042+0000", 2023-09-30T17:04:27.658 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9545999999999999e-05 2023-09-30T17:04:27.658 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:27.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.330210+0000", 2023-09-30T17:04:27.658 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000168407 2023-09-30T17:04:27.658 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.658 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.659 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.659 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.659 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151393 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.659 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.652586+0000", 2023-09-30T17:04:27.659 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.67319567400000002, 2023-09-30T17:04:27.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.68476546999999999, 2023-09-30T17:04:27.659 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.659 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.659 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.659 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.659 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.660 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151393 2023-09-30T17:04:27.660 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.660 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.660 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.660 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.660 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.652586+0000", 2023-09-30T17:04:27.660 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.660 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.660 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.660 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.660 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.652586+0000", 2023-09-30T17:04:27.660 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.661 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.661 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.661 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.661 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.652586+0000", 2023-09-30T17:04:27.661 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7199999999999999e-07 2023-09-30T17:04:27.661 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.661 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.661 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.661 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.652595+0000", 2023-09-30T17:04:27.661 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4589999999999998e-06 2023-09-30T17:04:27.661 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.661 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.662 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.662 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.652603+0000", 2023-09-30T17:04:27.662 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7540000000000006e-06 2023-09-30T17:04:27.662 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.662 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.662 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.662 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.652607+0000", 2023-09-30T17:04:27.662 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7890000000000002e-06 2023-09-30T17:04:27.662 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.662 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.662 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.663 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.663 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.663 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151721 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.663 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.776992+0000", 2023-09-30T17:04:27.663 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.54878901599999996, 2023-09-30T17:04:27.663 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.56041284800000002, 2023-09-30T17:04:27.663 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.663 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.663 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.663 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.663 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.663 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151721 2023-09-30T17:04:27.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.664 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.664 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.664 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.776992+0000", 2023-09-30T17:04:27.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.664 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.664 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.776992+0000", 2023-09-30T17:04:27.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.776993+0000", 2023-09-30T17:04:27.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5199999999999998e-07 2023-09-30T17:04:27.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.777007+0000", 2023-09-30T17:04:27.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4613999999999999e-05 2023-09-30T17:04:27.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.666 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.666 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.777016+0000", 2023-09-30T17:04:27.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5769999999999994e-06 2023-09-30T17:04:27.666 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.666 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.777021+0000", 2023-09-30T17:04:27.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9359999999999998e-06 2023-09-30T17:04:27.667 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.667 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.667 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.667 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151786 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.667 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.804800+0000", 2023-09-30T17:04:27.667 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.52098119899999995, 2023-09-30T17:04:27.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.53265549599999995, 2023-09-30T17:04:27.667 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.668 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.668 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.668 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.668 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.668 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151786 2023-09-30T17:04:27.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.668 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.668 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.668 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.804800+0000", 2023-09-30T17:04:27.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.669 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.669 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.669 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.804800+0000", 2023-09-30T17:04:27.669 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.669 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.669 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.669 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.804801+0000", 2023-09-30T17:04:27.669 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2500000000000001e-07 2023-09-30T17:04:27.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.669 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.670 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.670 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.804813+0000", 2023-09-30T17:04:27.670 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2048000000000001e-05 2023-09-30T17:04:27.670 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.670 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.670 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.670 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.804818+0000", 2023-09-30T17:04:27.670 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7030000000000003e-06 2023-09-30T17:04:27.670 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.670 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.670 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.670 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.804823+0000", 2023-09-30T17:04:27.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6519999999999997e-06 2023-09-30T17:04:27.671 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.671 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.671 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.671 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.671 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.671 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151944 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.671 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.861451+0000", 2023-09-30T17:04:27.671 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.46433083600000002, 2023-09-30T17:04:27.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.476057228, 2023-09-30T17:04:27.671 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.672 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.672 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.672 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.672 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.672 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151944 2023-09-30T17:04:27.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.672 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.672 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.672 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.861451+0000", 2023-09-30T17:04:27.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.673 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.673 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.861451+0000", 2023-09-30T17:04:27.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.673 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.673 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.861451+0000", 2023-09-30T17:04:27.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4000000000000002e-07 2023-09-30T17:04:27.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.674 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.674 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.861474+0000", 2023-09-30T17:04:27.674 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2781000000000001e-05 2023-09-30T17:04:27.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.674 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.674 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.861480+0000", 2023-09-30T17:04:27.674 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4049999999999997e-06 2023-09-30T17:04:27.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.674 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.675 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.861486+0000", 2023-09-30T17:04:27.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1880000000000001e-06 2023-09-30T17:04:27.675 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.675 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.675 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.675 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151964 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.675 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.872082+0000", 2023-09-30T17:04:27.675 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.45369983800000002, 2023-09-30T17:04:27.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.46548656700000002, 2023-09-30T17:04:27.676 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.676 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.676 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.676 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.677 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.677 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151964 2023-09-30T17:04:27.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.677 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.677 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.677 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.872082+0000", 2023-09-30T17:04:27.677 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.678 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.678 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.678 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.872082+0000", 2023-09-30T17:04:27.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.678 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.678 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.678 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.872082+0000", 2023-09-30T17:04:27.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8200000000000001e-07 2023-09-30T17:04:27.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.678 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.679 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.679 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.872102+0000", 2023-09-30T17:04:27.679 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0329000000000001e-05 2023-09-30T17:04:27.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.679 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.679 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.872109+0000", 2023-09-30T17:04:27.679 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8120000000000002e-06 2023-09-30T17:04:27.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.679 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.680 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.872114+0000", 2023-09-30T17:04:27.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1719999999999998e-06 2023-09-30T17:04:27.680 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.680 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.680 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.680 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.680 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152600 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.680 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.111648+0000", 2023-09-30T17:04:27.680 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.21413314, 2023-09-30T17:04:27.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.22597066299999999, 2023-09-30T17:04:27.680 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.681 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.681 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.681 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.681 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.681 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152600 2023-09-30T17:04:27.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.681 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.681 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.681 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.111648+0000", 2023-09-30T17:04:27.681 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.682 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.682 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.682 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.111648+0000", 2023-09-30T17:04:27.682 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.682 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.682 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.682 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.682 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.113515+0000", 2023-09-30T17:04:27.682 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0018670239999999999 2023-09-30T17:04:27.682 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.682 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.682 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.683 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.113531+0000", 2023-09-30T17:04:27.683 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5642e-05 2023-09-30T17:04:27.683 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.735 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.748 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.749 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.113543+0000", 2023-09-30T17:04:27.749 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2386e-05 2023-09-30T17:04:27.749 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.749 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.749 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.749 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.113552+0000", 2023-09-30T17:04:27.749 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8030000000000003e-06 2023-09-30T17:04:27.749 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.749 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.749 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.750 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.750 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.750 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152665 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.750 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.138911+0000", 2023-09-30T17:04:27.750 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.18687061299999999, 2023-09-30T17:04:27.750 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.19876269299999999, 2023-09-30T17:04:27.750 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.750 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.750 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.750 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.750 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.750 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152665 2023-09-30T17:04:27.751 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.751 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.751 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.751 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.751 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.138911+0000", 2023-09-30T17:04:27.751 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.751 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.751 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.751 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.751 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.138911+0000", 2023-09-30T17:04:27.751 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.751 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.751 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.753 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.753 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.138911+0000", 2023-09-30T17:04:27.753 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4400000000000001e-07 2023-09-30T17:04:27.753 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.753 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.753 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.753 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.138923+0000", 2023-09-30T17:04:27.753 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2145e-05 2023-09-30T17:04:27.754 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.754 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.754 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.754 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.138947+0000", 2023-09-30T17:04:27.754 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3374999999999999e-05 2023-09-30T17:04:27.754 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.754 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.754 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.754 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.138962+0000", 2023-09-30T17:04:27.754 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4686e-05 2023-09-30T17:04:27.754 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.755 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.755 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.755 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.755 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.755 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:151770 4.6 e55/17)", 2023-09-30T17:04:27.755 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.199125+0000", 2023-09-30T17:04:27.756 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.12665663599999999, 2023-09-30T17:04:27.756 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.13860867399999999, 2023-09-30T17:04:27.756 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.756 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.756 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.757 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.757 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.757 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.199125+0000", 2023-09-30T17:04:27.757 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.757 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.757 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.757 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.757 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.199125+0000", 2023-09-30T17:04:27.757 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.757 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.758 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.758 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.758 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.199126+0000", 2023-09-30T17:04:27.758 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.091e-06 2023-09-30T17:04:27.758 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.758 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.758 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.758 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.199140+0000", 2023-09-30T17:04:27.758 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4256e-05 2023-09-30T17:04:27.758 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.758 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.759 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.759 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.199151+0000", 2023-09-30T17:04:27.759 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1121000000000001e-05 2023-09-30T17:04:27.759 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.759 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.759 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.759 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.199158+0000", 2023-09-30T17:04:27.759 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3589999999999996e-06 2023-09-30T17:04:27.759 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.759 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.759 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.760 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.761 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.762 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152874 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.762 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.255875+0000", 2023-09-30T17:04:27.762 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.069906312999999998, 2023-09-30T17:04:27.762 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.081912413000000003, 2023-09-30T17:04:27.762 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.763 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.763 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.763 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.763 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.763 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152874 2023-09-30T17:04:27.764 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.764 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.764 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.764 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.764 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.255875+0000", 2023-09-30T17:04:27.765 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.765 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.765 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.766 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.766 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.255875+0000", 2023-09-30T17:04:27.766 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.766 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.766 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.767 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.767 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.255876+0000", 2023-09-30T17:04:27.767 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7899999999999999e-07 2023-09-30T17:04:27.767 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.767 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.767 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.767 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.255894+0000", 2023-09-30T17:04:27.767 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7997000000000001e-05 2023-09-30T17:04:27.767 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.767 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.768 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.768 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.255901+0000", 2023-09-30T17:04:27.768 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9129999999999997e-06 2023-09-30T17:04:27.768 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.768 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.768 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.768 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.255906+0000", 2023-09-30T17:04:27.768 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2850000000000002e-06 2023-09-30T17:04:27.768 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.768 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.769 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.769 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.769 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.769 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:151985 4.6 e55/17)", 2023-09-30T17:04:27.769 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.275055+0000", 2023-09-30T17:04:27.769 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.050726984000000003, 2023-09-30T17:04:27.769 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.062785251, 2023-09-30T17:04:27.769 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.769 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.770 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.770 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.770 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.770 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.275055+0000", 2023-09-30T17:04:27.770 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.770 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.770 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.770 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.770 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.275055+0000", 2023-09-30T17:04:27.770 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.771 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.771 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.771 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.771 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.275055+0000", 2023-09-30T17:04:27.779 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3000000000000002e-07 2023-09-30T17:04:27.779 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.779 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.780 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.780 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.275067+0000", 2023-09-30T17:04:27.780 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1894e-05 2023-09-30T17:04:27.780 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.780 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.781 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.781 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.275074+0000", 2023-09-30T17:04:27.781 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3250000000000002e-06 2023-09-30T17:04:27.781 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.781 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.782 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.782 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.275079+0000", 2023-09-30T17:04:27.782 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5700000000000003e-06 2023-09-30T17:04:27.782 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.782 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.782 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.782 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.782 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.783 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:152018 4.6 e55/17)", 2023-09-30T17:04:27.783 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.293565+0000", 2023-09-30T17:04:27.783 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.032216135999999999, 2023-09-30T17:04:27.783 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044321105999999999, 2023-09-30T17:04:27.783 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.783 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.783 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.783 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.784 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.784 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.293565+0000", 2023-09-30T17:04:27.784 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.784 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.784 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.784 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.784 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.293565+0000", 2023-09-30T17:04:27.784 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.784 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.785 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.785 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.785 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.293566+0000", 2023-09-30T17:04:27.786 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8899999999999999e-07 2023-09-30T17:04:27.786 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.786 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.786 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.786 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.293587+0000", 2023-09-30T17:04:27.786 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.141e-05 2023-09-30T17:04:27.787 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.787 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.787 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.787 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.293596+0000", 2023-09-30T17:04:27.787 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6959999999999994e-06 2023-09-30T17:04:27.788 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.788 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.788 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.788 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.293602+0000", 2023-09-30T17:04:27.788 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1680000000000001e-06 2023-09-30T17:04:27.788 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.788 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.789 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.789 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.789 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.789 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152988 4.35 4:af28909f:::100000001f8.0000001b:head [write 512000~4096 in=4096b,write 557056~4096 in=4096b,write 581632~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.789 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.319577+0000", 2023-09-30T17:04:27.789 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0062043280000000003, 2023-09-30T17:04:27.790 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018361903999999998, 2023-09-30T17:04:27.790 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.790 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:27.791 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.791 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.791 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.803 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152988 2023-09-30T17:04:27.803 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.803 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.803 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.803 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.803 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319577+0000", 2023-09-30T17:04:27.803 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.803 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.804 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.804 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.804 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319577+0000", 2023-09-30T17:04:27.804 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.804 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.804 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.804 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.804 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319578+0000", 2023-09-30T17:04:27.804 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6000000000000004e-07 2023-09-30T17:04:27.804 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.804 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.805 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.805 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319591+0000", 2023-09-30T17:04:27.805 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3703000000000001e-05 2023-09-30T17:04:27.805 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.805 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.805 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.805 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319602+0000", 2023-09-30T17:04:27.805 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0317e-05 2023-09-30T17:04:27.805 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.805 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.805 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.806 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319610+0000", 2023-09-30T17:04:27.806 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8890000000000002e-06 2023-09-30T17:04:27.806 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.806 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.806 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:27.806 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.334092+0000", 2023-09-30T17:04:27.806 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014482729 2023-09-30T17:04:27.806 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.806 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.806 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:27.806 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.334193+0000", 2023-09-30T17:04:27.807 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000100314 2023-09-30T17:04:27.807 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.807 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.807 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.807 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.807 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.807 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:153022 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.807 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.331620+0000", 2023-09-30T17:04:27.807 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9941616, 2023-09-30T17:04:27.807 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063904419999999997, 2023-09-30T17:04:27.807 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.807 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.808 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.808 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.808 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.808 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 153022 2023-09-30T17:04:27.808 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.808 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.808 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.808 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.808 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.331620+0000", 2023-09-30T17:04:27.808 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.808 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.808 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.809 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.809 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.331620+0000", 2023-09-30T17:04:27.809 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.809 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.809 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.809 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.809 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.331620+0000", 2023-09-30T17:04:27.809 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4499999999999997e-07 2023-09-30T17:04:27.809 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.809 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.809 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.810 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.331635+0000", 2023-09-30T17:04:27.810 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4782e-05 2023-09-30T17:04:27.810 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.810 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.810 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.810 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.331645+0000", 2023-09-30T17:04:27.810 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8269999999999993e-06 2023-09-30T17:04:27.810 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.810 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.810 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.811 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.331652+0000", 2023-09-30T17:04:27.811 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1019999999999999e-06 2023-09-30T17:04:27.811 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.811 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.811 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.811 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.811 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.811 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151187 4.2f 4:f59f865b:::100000001f8.00000007:head [write 2543616~4096 in=4096b,write 2646016~4096 in=4096b,write 2789376~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.811 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.575620+0000", 2023-09-30T17:04:27.811 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.75016124799999995, 2023-09-30T17:04:27.811 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.76245082900000005, 2023-09-30T17:04:27.812 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.812 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:27.812 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.812 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.812 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.812 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151187 2023-09-30T17:04:27.812 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.812 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.812 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.812 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.812 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.575620+0000", 2023-09-30T17:04:27.813 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.813 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.813 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.813 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.575620+0000", 2023-09-30T17:04:27.813 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.813 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.813 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.813 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.577516+0000", 2023-09-30T17:04:27.813 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001896116 2023-09-30T17:04:27.813 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.814 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.814 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.814 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.577532+0000", 2023-09-30T17:04:27.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5951e-05 2023-09-30T17:04:27.814 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.814 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.814 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.814 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.577543+0000", 2023-09-30T17:04:27.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0278999999999999e-05 2023-09-30T17:04:27.814 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.814 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.815 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.815 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.577547+0000", 2023-09-30T17:04:27.815 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8810000000000004e-06 2023-09-30T17:04:27.815 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.815 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.815 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:27.815 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.280381+0000", 2023-09-30T17:04:27.815 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.70283355700000005 2023-09-30T17:04:27.815 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.815 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.815 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:27.815 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.280505+0000", 2023-09-30T17:04:27.816 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012379099999999999 2023-09-30T17:04:27.816 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.816 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.816 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:27.816 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.280677+0000", 2023-09-30T17:04:27.816 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017206099999999999 2023-09-30T17:04:27.816 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.816 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.816 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:27.816 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.302443+0000", 2023-09-30T17:04:27.816 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021766204000000001 2023-09-30T17:04:27.816 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.817 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.817 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.817 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.817 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.817 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151396 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.817 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.652613+0000", 2023-09-30T17:04:27.817 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.67316844399999998, 2023-09-30T17:04:27.817 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.68553848699999997, 2023-09-30T17:04:27.817 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.817 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.817 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.817 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.818 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.818 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151396 2023-09-30T17:04:27.818 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.818 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.818 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.818 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.818 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.652613+0000", 2023-09-30T17:04:27.818 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.818 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.818 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.818 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.819 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.652613+0000", 2023-09-30T17:04:27.819 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.819 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.819 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.819 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.819 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.652613+0000", 2023-09-30T17:04:27.819 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9200000000000002e-07 2023-09-30T17:04:27.819 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.819 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.819 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.819 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.652625+0000", 2023-09-30T17:04:27.819 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1449e-05 2023-09-30T17:04:27.820 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.820 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.820 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.820 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.652632+0000", 2023-09-30T17:04:27.820 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6830000000000008e-06 2023-09-30T17:04:27.820 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.820 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.820 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.820 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.652637+0000", 2023-09-30T17:04:27.820 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9339999999999997e-06 2023-09-30T17:04:27.820 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.820 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.821 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.821 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.821 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.821 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151523 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.821 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.699060+0000", 2023-09-30T17:04:27.821 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.62672112000000002, 2023-09-30T17:04:27.821 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.639146832, 2023-09-30T17:04:27.821 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.821 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.821 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.821 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.825 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.889 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151523 2023-09-30T17:04:27.889 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.889 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.890 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.890 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.890 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.699060+0000", 2023-09-30T17:04:27.890 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.891 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.891 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.891 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.891 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.699060+0000", 2023-09-30T17:04:27.891 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.892 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.892 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.892 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.892 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.699061+0000", 2023-09-30T17:04:27.892 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.89e-07 2023-09-30T17:04:27.892 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.892 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.893 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.893 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.699075+0000", 2023-09-30T17:04:27.893 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3871e-05 2023-09-30T17:04:27.893 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.894 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.894 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.894 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.699081+0000", 2023-09-30T17:04:27.894 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8229999999999997e-06 2023-09-30T17:04:27.894 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.894 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.894 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.894 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.699087+0000", 2023-09-30T17:04:27.894 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9529999999999996e-06 2023-09-30T17:04:27.895 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.895 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.895 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.895 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.895 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.895 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151646 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.895 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.750604+0000", 2023-09-30T17:04:27.895 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.57517745099999995, 2023-09-30T17:04:27.895 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.58766467099999997, 2023-09-30T17:04:27.895 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.895 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.896 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.896 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.896 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.896 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151646 2023-09-30T17:04:27.896 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.896 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.896 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.896 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.896 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.750604+0000", 2023-09-30T17:04:27.897 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.897 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.897 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.897 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.897 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.750604+0000", 2023-09-30T17:04:27.897 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.897 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.897 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.897 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.897 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.750605+0000", 2023-09-30T17:04:27.898 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5900000000000002e-07 2023-09-30T17:04:27.898 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.898 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.898 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.898 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.750623+0000", 2023-09-30T17:04:27.898 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8321e-05 2023-09-30T17:04:27.898 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.898 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.898 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.898 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.750629+0000", 2023-09-30T17:04:27.899 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3820000000000001e-06 2023-09-30T17:04:27.899 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.899 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.899 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.899 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.750634+0000", 2023-09-30T17:04:27.899 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9089999999999999e-06 2023-09-30T17:04:27.899 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.899 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.899 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.899 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.899 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.899 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152231 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.900 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.977598+0000", 2023-09-30T17:04:27.900 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.34818354600000001, 2023-09-30T17:04:27.900 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.36073087700000001, 2023-09-30T17:04:27.900 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.900 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.900 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.900 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.900 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.900 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152231 2023-09-30T17:04:27.900 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.901 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.901 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.901 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.901 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.977598+0000", 2023-09-30T17:04:27.901 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.901 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.901 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.901 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.901 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.977598+0000", 2023-09-30T17:04:27.901 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.901 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.902 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.902 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.902 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.979594+0000", 2023-09-30T17:04:27.902 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001996374 2023-09-30T17:04:27.902 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.902 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.902 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.903 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.979610+0000", 2023-09-30T17:04:27.903 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6135000000000001e-05 2023-09-30T17:04:27.903 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.903 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.903 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.903 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.979624+0000", 2023-09-30T17:04:27.903 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3735e-05 2023-09-30T17:04:27.903 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.903 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.903 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.904 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.979637+0000", 2023-09-30T17:04:27.904 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2455e-05 2023-09-30T17:04:27.904 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.904 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.904 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.904 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.904 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.904 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152390 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.904 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.037717+0000", 2023-09-30T17:04:27.904 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.28806443900000001, 2023-09-30T17:04:27.904 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.30067437600000002, 2023-09-30T17:04:27.905 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.905 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.905 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.905 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.905 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.905 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152390 2023-09-30T17:04:27.905 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.905 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.905 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.905 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.906 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.037717+0000", 2023-09-30T17:04:27.906 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.906 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.906 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.906 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.906 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.037717+0000", 2023-09-30T17:04:27.906 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.906 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.906 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.906 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.906 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.037718+0000", 2023-09-30T17:04:27.907 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4799999999999999e-07 2023-09-30T17:04:27.907 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.907 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.907 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.907 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.037732+0000", 2023-09-30T17:04:27.907 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4649e-05 2023-09-30T17:04:27.907 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.907 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.907 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.907 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.037743+0000", 2023-09-30T17:04:27.907 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0648e-05 2023-09-30T17:04:27.908 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.908 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.908 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.908 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.037749+0000", 2023-09-30T17:04:27.908 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.049e-06 2023-09-30T17:04:27.908 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.908 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.908 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.908 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.908 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.908 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:151755 4.6 e55/17 4:635f8cb4:::100000001f8.0000003c:head v 55'9357, mlcod=55'9330)", 2023-09-30T17:04:27.909 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.188737+0000", 2023-09-30T17:04:27.909 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.13704442999999999, 2023-09-30T17:04:27.909 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.14971659400000001, 2023-09-30T17:04:27.909 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.909 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:27.909 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.909 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.909 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.910 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.188737+0000", 2023-09-30T17:04:27.910 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.910 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.910 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.910 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.910 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.188737+0000", 2023-09-30T17:04:27.910 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.910 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.910 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.910 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.910 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.188737+0000", 2023-09-30T17:04:27.911 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1199999999999999e-07 2023-09-30T17:04:27.911 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.911 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.911 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.911 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.188758+0000", 2023-09-30T17:04:27.911 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1154000000000001e-05 2023-09-30T17:04:27.911 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.911 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.911 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.911 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.188772+0000", 2023-09-30T17:04:27.911 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3859999999999999e-05 2023-09-30T17:04:27.912 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.912 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.912 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.912 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.188778+0000", 2023-09-30T17:04:27.912 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5650000000000001e-06 2023-09-30T17:04:27.912 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.912 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.912 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:27.912 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.327432+0000", 2023-09-30T17:04:27.912 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.13865438099999999 2023-09-30T17:04:27.912 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.913 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.913 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:27.913 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.327453+0000", 2023-09-30T17:04:27.913 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1073e-05 2023-09-30T17:04:27.913 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.913 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.913 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.913 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.913 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.913 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:151780 4.36 e55/17)", 2023-09-30T17:04:27.913 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.199171+0000", 2023-09-30T17:04:27.914 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.126610321, 2023-09-30T17:04:27.914 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.139355223, 2023-09-30T17:04:27.914 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.914 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:27.914 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.914 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.914 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.914 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.199171+0000", 2023-09-30T17:04:27.914 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.914 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.914 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.915 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.915 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.199171+0000", 2023-09-30T17:04:27.924 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.924 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.924 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.925 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.925 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.199172+0000", 2023-09-30T17:04:27.925 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5900000000000003e-07 2023-09-30T17:04:27.925 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.925 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.926 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.926 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.199186+0000", 2023-09-30T17:04:27.926 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4363e-05 2023-09-30T17:04:27.931 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.931 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.931 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.931 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.199192+0000", 2023-09-30T17:04:27.932 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1090000000000003e-06 2023-09-30T17:04:27.932 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.932 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.932 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.932 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.199198+0000", 2023-09-30T17:04:27.932 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7219999999999996e-06 2023-09-30T17:04:27.932 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.933 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.933 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.933 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.933 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.933 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152990 4.35 4:af28909f:::100000001f8.0000001b:head [write 2670592~4096 in=4096b,write 2859008~4096 in=4096b,write 2895872~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.934 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.319620+0000", 2023-09-30T17:04:27.934 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0061610190000000002, 2023-09-30T17:04:27.934 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018967444999999999, 2023-09-30T17:04:27.934 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.934 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:27.934 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.935 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.935 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.936 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152990 2023-09-30T17:04:27.936 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.936 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.936 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.936 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.937 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319620+0000", 2023-09-30T17:04:27.937 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.937 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.937 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.937 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.937 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319620+0000", 2023-09-30T17:04:27.937 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.938 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.938 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.938 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.938 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319621+0000", 2023-09-30T17:04:27.938 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9100000000000004e-07 2023-09-30T17:04:27.938 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.939 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.939 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.939 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319634+0000", 2023-09-30T17:04:27.939 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3254999999999999e-05 2023-09-30T17:04:27.939 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.939 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.940 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.940 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319644+0000", 2023-09-30T17:04:27.940 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2769999999999994e-06 2023-09-30T17:04:27.940 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.940 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.940 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:27.941 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319649+0000", 2023-09-30T17:04:27.941 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9710000000000001e-06 2023-09-30T17:04:27.941 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.941 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.941 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:27.942 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.337967+0000", 2023-09-30T17:04:27.942 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018317218 2023-09-30T17:04:27.942 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.942 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.942 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:27.942 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.338045+0000", 2023-09-30T17:04:27.942 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8547999999999994e-05 2023-09-30T17:04:27.943 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.943 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:27.943 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:27.943 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.943 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.944 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:153024 4.12 4:48ab9bde:::100000001f8.00000015:head [write 761856~4096 in=4096b,write 806912~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:27.944 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.331662+0000", 2023-09-30T17:04:27.944 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9941196, 2023-09-30T17:04:27.944 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0070103179999999998, 2023-09-30T17:04:27.944 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:27.945 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:27.945 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:27.945 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:27.945 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:27.945 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 153024 2023-09-30T17:04:27.946 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.947 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:27.947 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.947 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:27.947 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.331662+0000", 2023-09-30T17:04:27.948 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.948 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.948 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.948 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:27.948 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.331662+0000", 2023-09-30T17:04:27.949 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:27.949 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.949 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.949 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:27.949 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.331662+0000", 2023-09-30T17:04:27.949 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.13e-07 2023-09-30T17:04:27.950 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.950 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.950 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:27.950 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.331673+0000", 2023-09-30T17:04:27.950 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1182999999999999e-05 2023-09-30T17:04:27.951 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:27.951 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:27.951 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:27.951 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.331683+0000", 2023-09-30T17:04:27.951 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5699999999999999e-06 2023-09-30T17:04:27.952 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.032 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.032 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.331689+0000", 2023-09-30T17:04:28.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8300000000000001e-06 2023-09-30T17:04:28.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.033 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:28.033 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.332860+0000", 2023-09-30T17:04:28.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001171489 2023-09-30T17:04:28.033 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.033 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.034 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:28.034 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.332940+0000", 2023-09-30T17:04:28.034 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9252000000000006e-05 2023-09-30T17:04:28.034 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.035 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.035 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:28.035 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.333088+0000", 2023-09-30T17:04:28.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014793900000000001 2023-09-30T17:04:28.035 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.035 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.035 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.035 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.035 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.035 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151398 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.035 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.652645+0000", 2023-09-30T17:04:28.036 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.67313680200000003, 2023-09-30T17:04:28.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.68609914500000002, 2023-09-30T17:04:28.036 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.036 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.036 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.036 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.036 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.036 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151398 2023-09-30T17:04:28.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.036 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.037 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.652645+0000", 2023-09-30T17:04:28.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.037 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.652645+0000", 2023-09-30T17:04:28.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.038 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.038 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.652645+0000", 2023-09-30T17:04:28.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1899999999999998e-07 2023-09-30T17:04:28.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.038 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.038 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.652655+0000", 2023-09-30T17:04:28.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0302000000000001e-05 2023-09-30T17:04:28.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.039 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.039 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.652663+0000", 2023-09-30T17:04:28.039 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4460000000000004e-06 2023-09-30T17:04:28.039 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.039 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.039 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.652667+0000", 2023-09-30T17:04:28.039 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6750000000000001e-06 2023-09-30T17:04:28.039 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.040 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.040 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.040 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.040 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.040 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151455 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.040 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.675690+0000", 2023-09-30T17:04:28.040 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.650091639, 2023-09-30T17:04:28.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.66311016099999998, 2023-09-30T17:04:28.040 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.040 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.040 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.041 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.041 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.041 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151455 2023-09-30T17:04:28.041 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.041 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.048 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.049 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.049 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.675690+0000", 2023-09-30T17:04:28.049 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.050 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.054 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.054 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.054 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.675690+0000", 2023-09-30T17:04:28.054 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.054 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.054 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.054 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.054 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.675690+0000", 2023-09-30T17:04:28.054 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3099999999999999e-07 2023-09-30T17:04:28.054 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.055 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.055 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.055 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.675700+0000", 2023-09-30T17:04:28.055 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6250000000000002e-06 2023-09-30T17:04:28.055 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.055 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.055 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.055 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.675707+0000", 2023-09-30T17:04:28.055 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.481e-06 2023-09-30T17:04:28.055 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.056 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.056 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.056 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.675712+0000", 2023-09-30T17:04:28.056 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.882e-06 2023-09-30T17:04:28.056 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.056 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.056 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.056 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.056 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.056 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151649 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.056 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.750641+0000", 2023-09-30T17:04:28.057 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.57514046900000004, 2023-09-30T17:04:28.057 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.58821255699999997, 2023-09-30T17:04:28.057 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.057 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.057 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.057 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.057 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.057 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151649 2023-09-30T17:04:28.057 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.057 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.058 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.058 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.058 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.750641+0000", 2023-09-30T17:04:28.058 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.058 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.058 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.058 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.058 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.750641+0000", 2023-09-30T17:04:28.058 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.058 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.058 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.059 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.059 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.750642+0000", 2023-09-30T17:04:28.059 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1699999999999998e-07 2023-09-30T17:04:28.059 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.059 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.059 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.059 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.750652+0000", 2023-09-30T17:04:28.059 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0403e-05 2023-09-30T17:04:28.059 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.059 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.060 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.060 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.750658+0000", 2023-09-30T17:04:28.060 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6250000000000004e-06 2023-09-30T17:04:28.060 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.060 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.060 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.060 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.750662+0000", 2023-09-30T17:04:28.060 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5050000000000001e-06 2023-09-30T17:04:28.060 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.060 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.061 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.061 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.061 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.061 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151820 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.061 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.812826+0000", 2023-09-30T17:04:28.061 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.51295545300000001, 2023-09-30T17:04:28.061 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.52608291200000001, 2023-09-30T17:04:28.061 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.061 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.061 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.062 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.062 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.062 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151820 2023-09-30T17:04:28.062 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.062 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.062 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.062 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.064 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.812826+0000", 2023-09-30T17:04:28.064 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.064 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.064 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.064 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.064 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.812826+0000", 2023-09-30T17:04:28.064 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.064 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.065 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.065 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.065 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.812826+0000", 2023-09-30T17:04:28.065 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2599999999999998e-07 2023-09-30T17:04:28.065 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.065 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.066 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.066 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.812838+0000", 2023-09-30T17:04:28.066 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1809e-05 2023-09-30T17:04:28.066 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.066 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.066 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.066 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.812846+0000", 2023-09-30T17:04:28.066 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2880000000000004e-06 2023-09-30T17:04:28.066 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.066 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.067 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.067 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.812851+0000", 2023-09-30T17:04:28.067 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0209999999999999e-06 2023-09-30T17:04:28.067 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.067 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.067 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.067 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.067 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.068 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152176 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.068 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.950919+0000", 2023-09-30T17:04:28.068 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.37486239799999999, 2023-09-30T17:04:28.068 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.38804467500000001, 2023-09-30T17:04:28.068 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.068 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.068 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.068 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.069 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.069 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152176 2023-09-30T17:04:28.069 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.069 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.069 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.069 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.069 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.950919+0000", 2023-09-30T17:04:28.069 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.069 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.070 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.070 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.070 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.950919+0000", 2023-09-30T17:04:28.070 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.070 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.070 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.070 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.071 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.950920+0000", 2023-09-30T17:04:28.071 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5899999999999996e-07 2023-09-30T17:04:28.071 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.071 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.071 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.071 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.950932+0000", 2023-09-30T17:04:28.071 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2007999999999999e-05 2023-09-30T17:04:28.071 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.071 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.071 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.071 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.950938+0000", 2023-09-30T17:04:28.072 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7129999999999999e-06 2023-09-30T17:04:28.072 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.072 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.072 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.072 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.950945+0000", 2023-09-30T17:04:28.072 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9299999999999997e-06 2023-09-30T17:04:28.072 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.072 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.072 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.072 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.072 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.073 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:151855 4.36 e55/17)", 2023-09-30T17:04:28.073 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.240378+0000", 2023-09-30T17:04:28.073 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.085403907000000001, 2023-09-30T17:04:28.073 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.098642590000000002, 2023-09-30T17:04:28.073 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.073 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.073 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.074 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.074 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.074 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.240378+0000", 2023-09-30T17:04:28.074 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.074 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.074 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.074 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.074 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.240378+0000", 2023-09-30T17:04:28.074 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.075 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.075 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.075 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.075 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.240378+0000", 2023-09-30T17:04:28.075 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8100000000000003e-07 2023-09-30T17:04:28.075 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.075 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.075 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.075 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.240393+0000", 2023-09-30T17:04:28.075 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4990999999999999e-05 2023-09-30T17:04:28.075 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.076 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.076 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.076 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.240401+0000", 2023-09-30T17:04:28.076 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5079999999999999e-06 2023-09-30T17:04:28.076 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.076 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.076 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.076 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.240406+0000", 2023-09-30T17:04:28.076 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.711e-06 2023-09-30T17:04:28.077 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.077 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.077 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.077 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.077 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.077 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:151901 4.6 e55/17)", 2023-09-30T17:04:28.077 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.259303+0000", 2023-09-30T17:04:28.077 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.066478067000000002, 2023-09-30T17:04:28.077 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.079760538000000006, 2023-09-30T17:04:28.077 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.078 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.078 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.078 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.078 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.078 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.259303+0000", 2023-09-30T17:04:28.078 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.078 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.079 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.079 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.079 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.259303+0000", 2023-09-30T17:04:28.079 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.079 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.079 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.079 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.079 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.259304+0000", 2023-09-30T17:04:28.079 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9499999999999998e-07 2023-09-30T17:04:28.080 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.080 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.080 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.080 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.259339+0000", 2023-09-30T17:04:28.080 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5633999999999998e-05 2023-09-30T17:04:28.080 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.080 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.080 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.081 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.259346+0000", 2023-09-30T17:04:28.081 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7839999999999998e-06 2023-09-30T17:04:28.081 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.081 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.081 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.081 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.259352+0000", 2023-09-30T17:04:28.081 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5879999999999997e-06 2023-09-30T17:04:28.081 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.081 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.081 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.082 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.082 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.082 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152994 4.2d 4.9760552d (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.082 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.319659+0000", 2023-09-30T17:04:28.082 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0061221460000000002, 2023-09-30T17:04:28.082 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019450821, 2023-09-30T17:04:28.082 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.082 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.082 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.082 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.083 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.083 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152994 2023-09-30T17:04:28.083 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.083 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.083 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.083 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.083 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319659+0000", 2023-09-30T17:04:28.083 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.083 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.089 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.089 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.089 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319659+0000", 2023-09-30T17:04:28.089 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.089 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.089 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.089 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.089 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319660+0000", 2023-09-30T17:04:28.089 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7e-07 2023-09-30T17:04:28.090 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.090 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.090 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.090 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319672+0000", 2023-09-30T17:04:28.090 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2639999999999999e-05 2023-09-30T17:04:28.090 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.090 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.090 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.090 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319680+0000", 2023-09-30T17:04:28.090 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6290000000000001e-06 2023-09-30T17:04:28.090 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.091 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.091 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.091 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319686+0000", 2023-09-30T17:04:28.091 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9619999999999998e-06 2023-09-30T17:04:28.091 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.091 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.091 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.091 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.091 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.091 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:153220 4.33 e55/17 4:cf6d7a6c:::100000001f8.0000000a:head v 55'2408, mlcod=55'2405)", 2023-09-30T17:04:28.092 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.331716+0000", 2023-09-30T17:04:28.092 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9940658, 2023-09-30T17:04:28.092 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0074509850000000002, 2023-09-30T17:04:28.092 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.092 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:28.092 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.092 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.092 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.092 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.331716+0000", 2023-09-30T17:04:28.092 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.092 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.093 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.093 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.093 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.331716+0000", 2023-09-30T17:04:28.093 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.093 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.093 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.094 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.106 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.331716+0000", 2023-09-30T17:04:28.106 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2899999999999999e-07 2023-09-30T17:04:28.106 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.106 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.107 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.107 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.331727+0000", 2023-09-30T17:04:28.107 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0815000000000001e-05 2023-09-30T17:04:28.107 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.107 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.107 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.107 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.331736+0000", 2023-09-30T17:04:28.107 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.431e-06 2023-09-30T17:04:28.107 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.107 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.108 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.108 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.331742+0000", 2023-09-30T17:04:28.108 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.519e-06 2023-09-30T17:04:28.108 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.108 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.108 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:28.108 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.335071+0000", 2023-09-30T17:04:28.108 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0033288580000000001 2023-09-30T17:04:28.108 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.108 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.109 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:28.109 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.335084+0000", 2023-09-30T17:04:28.109 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.384e-05 2023-09-30T17:04:28.109 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.109 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.109 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.109 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.109 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.109 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151617 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.110 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.736703+0000", 2023-09-30T17:04:28.110 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.58907892299999998, 2023-09-30T17:04:28.110 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.60252084500000003, 2023-09-30T17:04:28.110 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.110 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.110 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.110 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.110 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.110 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151617 2023-09-30T17:04:28.110 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.110 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.110 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.111 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.111 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.736703+0000", 2023-09-30T17:04:28.111 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.111 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.111 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.111 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.111 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.736703+0000", 2023-09-30T17:04:28.111 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.111 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.112 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.112 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.112 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.738686+0000", 2023-09-30T17:04:28.112 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019829370000000002 2023-09-30T17:04:28.112 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.112 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.112 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.112 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.738707+0000", 2023-09-30T17:04:28.112 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1591999999999999e-05 2023-09-30T17:04:28.112 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.113 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.113 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.113 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.738717+0000", 2023-09-30T17:04:28.113 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6719999999999999e-06 2023-09-30T17:04:28.113 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.113 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.113 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.114 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.738724+0000", 2023-09-30T17:04:28.114 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6399999999999997e-06 2023-09-30T17:04:28.114 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.114 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.114 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.114 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.114 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.114 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151860 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.114 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.826250+0000", 2023-09-30T17:04:28.114 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.49953150899999998, 2023-09-30T17:04:28.114 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.51302753800000001, 2023-09-30T17:04:28.115 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.115 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.115 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.115 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.115 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.115 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151860 2023-09-30T17:04:28.115 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.115 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.115 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.115 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.115 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.826250+0000", 2023-09-30T17:04:28.116 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.116 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.116 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.116 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.116 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.826250+0000", 2023-09-30T17:04:28.116 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.116 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.116 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.116 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.116 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.827516+0000", 2023-09-30T17:04:28.116 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00126622 2023-09-30T17:04:28.117 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.117 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.827531+0000", 2023-09-30T17:04:28.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4856e-05 2023-09-30T17:04:28.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.200 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.827544+0000", 2023-09-30T17:04:28.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3158e-05 2023-09-30T17:04:28.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.201 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.201 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.827555+0000", 2023-09-30T17:04:28.202 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0638999999999999e-05 2023-09-30T17:04:28.202 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.202 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.202 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.202 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.203 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.203 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152000 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.203 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.890563+0000", 2023-09-30T17:04:28.203 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.43521851, 2023-09-30T17:04:28.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.44876566000000001, 2023-09-30T17:04:28.204 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.204 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.204 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.204 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.204 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.205 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152000 2023-09-30T17:04:28.205 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.205 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.205 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.206 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.890563+0000", 2023-09-30T17:04:28.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.207 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.207 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.890563+0000", 2023-09-30T17:04:28.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.207 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.207 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.892516+0000", 2023-09-30T17:04:28.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001952854 2023-09-30T17:04:28.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.207 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.208 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.892532+0000", 2023-09-30T17:04:28.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6407999999999999e-05 2023-09-30T17:04:28.208 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.208 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.208 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.892544+0000", 2023-09-30T17:04:28.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2213e-05 2023-09-30T17:04:28.209 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.209 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.209 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.892552+0000", 2023-09-30T17:04:28.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8089999999999993e-06 2023-09-30T17:04:28.221 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.221 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.221 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.223 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152558 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.223 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.103566+0000", 2023-09-30T17:04:28.223 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.222215576, 2023-09-30T17:04:28.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.235816254, 2023-09-30T17:04:28.223 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.223 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.223 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.224 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.224 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.224 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152558 2023-09-30T17:04:28.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.224 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.224 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.225 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.225 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.103566+0000", 2023-09-30T17:04:28.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.225 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.225 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.225 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.225 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.103566+0000", 2023-09-30T17:04:28.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.226 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.226 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.226 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.226 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.103567+0000", 2023-09-30T17:04:28.226 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6499999999999999e-07 2023-09-30T17:04:28.226 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.226 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.226 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.226 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.103589+0000", 2023-09-30T17:04:28.226 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2157000000000001e-05 2023-09-30T17:04:28.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.103596+0000", 2023-09-30T17:04:28.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2189999999999998e-06 2023-09-30T17:04:28.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.103603+0000", 2023-09-30T17:04:28.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1690000000000003e-06 2023-09-30T17:04:28.228 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.228 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.228 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.228 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.228 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.228 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152845 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.228 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.237570+0000", 2023-09-30T17:04:28.229 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.088211769999999995, 2023-09-30T17:04:28.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.101864263, 2023-09-30T17:04:28.229 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.229 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.229 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.229 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.229 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.230 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152845 2023-09-30T17:04:28.230 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.230 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.230 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.230 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.237570+0000", 2023-09-30T17:04:28.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.231 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.237570+0000", 2023-09-30T17:04:28.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.232 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.241518+0000", 2023-09-30T17:04:28.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039479950000000002 2023-09-30T17:04:28.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.233 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.233 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.233 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.241536+0000", 2023-09-30T17:04:28.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8084000000000002e-05 2023-09-30T17:04:28.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.233 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.233 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.233 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.241544+0000", 2023-09-30T17:04:28.234 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6149999999999997e-06 2023-09-30T17:04:28.234 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.234 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.234 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.234 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.241550+0000", 2023-09-30T17:04:28.234 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4280000000000004e-06 2023-09-30T17:04:28.234 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.234 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.234 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.234 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.235 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.235 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152906 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.235 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.273022+0000", 2023-09-30T17:04:28.236 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.052759174999999998, 2023-09-30T17:04:28.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.066465213999999995, 2023-09-30T17:04:28.236 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.236 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.236 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.237 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.237 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.237 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152906 2023-09-30T17:04:28.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.237 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.273022+0000", 2023-09-30T17:04:28.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.273022+0000", 2023-09-30T17:04:28.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.238 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.239 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.276521+0000", 2023-09-30T17:04:28.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0034983990000000001 2023-09-30T17:04:28.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.239 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.239 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.276536+0000", 2023-09-30T17:04:28.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.524e-05 2023-09-30T17:04:28.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.239 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.239 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.276545+0000", 2023-09-30T17:04:28.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4630000000000007e-06 2023-09-30T17:04:28.240 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.240 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.240 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.240 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.276553+0000", 2023-09-30T17:04:28.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5920000000000003e-06 2023-09-30T17:04:28.240 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.240 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.240 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.240 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.241 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152996 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.241 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.319697+0000", 2023-09-30T17:04:28.241 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.006084997, 2023-09-30T17:04:28.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019847627999999999, 2023-09-30T17:04:28.241 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.241 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.241 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.241 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.242 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.242 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152996 2023-09-30T17:04:28.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.242 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319697+0000", 2023-09-30T17:04:28.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319697+0000", 2023-09-30T17:04:28.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319697+0000", 2023-09-30T17:04:28.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4300000000000003e-07 2023-09-30T17:04:28.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319711+0000", 2023-09-30T17:04:28.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3604000000000001e-05 2023-09-30T17:04:28.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.245 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.245 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319723+0000", 2023-09-30T17:04:28.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.271e-05 2023-09-30T17:04:28.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.245 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.245 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319731+0000", 2023-09-30T17:04:28.246 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0660000000000004e-06 2023-09-30T17:04:28.246 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.246 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.246 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.246 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:152085 4.36 e55/17)", 2023-09-30T17:04:28.247 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.331763+0000", 2023-09-30T17:04:28.247 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9940181, 2023-09-30T17:04:28.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0078420060000000003, 2023-09-30T17:04:28.248 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.248 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.248 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.248 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.248 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.331763+0000", 2023-09-30T17:04:28.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.248 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.249 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.249 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.331763+0000", 2023-09-30T17:04:28.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.249 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.249 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.331764+0000", 2023-09-30T17:04:28.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3000000000000002e-07 2023-09-30T17:04:28.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.249 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.331776+0000", 2023-09-30T17:04:28.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2864000000000001e-05 2023-09-30T17:04:28.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.331783+0000", 2023-09-30T17:04:28.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7159999999999997e-06 2023-09-30T17:04:28.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.331788+0000", 2023-09-30T17:04:28.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.164e-06 2023-09-30T17:04:28.251 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.251 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.251 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.251 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151267 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 12288~4096 in=4096b,write 90112~4096 in=4096b,write 139264~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.251 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.599787+0000", 2023-09-30T17:04:28.251 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.72599474600000002, 2023-09-30T17:04:28.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.73987668699999998, 2023-09-30T17:04:28.252 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.252 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:28.252 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.252 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.252 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.252 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151267 2023-09-30T17:04:28.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.252 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.599787+0000", 2023-09-30T17:04:28.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.253 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.599787+0000", 2023-09-30T17:04:28.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.253 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.599787+0000", 2023-09-30T17:04:28.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1999999999999999e-07 2023-09-30T17:04:28.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.254 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.254 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.599803+0000", 2023-09-30T17:04:28.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5294e-05 2023-09-30T17:04:28.254 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.254 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.254 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.599809+0000", 2023-09-30T17:04:28.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6680000000000004e-06 2023-09-30T17:04:28.254 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.599815+0000", 2023-09-30T17:04:28.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6980000000000003e-06 2023-09-30T17:04:28.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:28.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.329863+0000", 2023-09-30T17:04:28.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.73004775399999999 2023-09-30T17:04:28.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:28.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.329952+0000", 2023-09-30T17:04:28.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9257000000000003e-05 2023-09-30T17:04:28.256 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.256 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.257 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.257 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.257 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151401 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.257 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.652709+0000", 2023-09-30T17:04:28.257 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.67307289699999995, 2023-09-30T17:04:28.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.68703051000000004, 2023-09-30T17:04:28.257 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.257 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.258 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.258 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.258 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.258 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151401 2023-09-30T17:04:28.258 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.258 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.258 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.652709+0000", 2023-09-30T17:04:28.258 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.258 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.259 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.652709+0000", 2023-09-30T17:04:28.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.652709+0000", 2023-09-30T17:04:28.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.77e-07 2023-09-30T17:04:28.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.652719+0000", 2023-09-30T17:04:28.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0387000000000001e-05 2023-09-30T17:04:28.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.261 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.261 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.652726+0000", 2023-09-30T17:04:28.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4590000000000003e-06 2023-09-30T17:04:28.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.261 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.261 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.652731+0000", 2023-09-30T17:04:28.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8029999999999996e-06 2023-09-30T17:04:28.261 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.261 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.261 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.262 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151485 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.262 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.687635+0000", 2023-09-30T17:04:28.262 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.638146659, 2023-09-30T17:04:28.262 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.65216630900000006, 2023-09-30T17:04:28.262 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.262 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.262 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.262 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.263 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.263 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151485 2023-09-30T17:04:28.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.263 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.687635+0000", 2023-09-30T17:04:28.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.687635+0000", 2023-09-30T17:04:28.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.689516+0000", 2023-09-30T17:04:28.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0018806999999999999 2023-09-30T17:04:28.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.689527+0000", 2023-09-30T17:04:28.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1095e-05 2023-09-30T17:04:28.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.689536+0000", 2023-09-30T17:04:28.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7319999999999993e-06 2023-09-30T17:04:28.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.266 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.689543+0000", 2023-09-30T17:04:28.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4439999999999996e-06 2023-09-30T17:04:28.266 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.266 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.266 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.266 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.266 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.267 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151862 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.267 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.827567+0000", 2023-09-30T17:04:28.267 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.49821421300000002, 2023-09-30T17:04:28.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.51231017899999998, 2023-09-30T17:04:28.267 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.267 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.267 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.267 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.267 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.267 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151862 2023-09-30T17:04:28.267 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.267 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.268 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.268 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.827567+0000", 2023-09-30T17:04:28.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.268 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.268 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.268 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.827567+0000", 2023-09-30T17:04:28.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.268 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.269 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.269 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.827568+0000", 2023-09-30T17:04:28.269 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.44e-07 2023-09-30T17:04:28.269 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.269 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.269 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.827580+0000", 2023-09-30T17:04:28.269 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2123999999999999e-05 2023-09-30T17:04:28.269 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.270 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.827587+0000", 2023-09-30T17:04:28.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6470000000000001e-06 2023-09-30T17:04:28.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.270 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.827592+0000", 2023-09-30T17:04:28.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4500000000000003e-06 2023-09-30T17:04:28.270 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.270 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.271 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.271 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152122 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.271 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.939657+0000", 2023-09-30T17:04:28.271 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.38612470500000001, 2023-09-30T17:04:28.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.40028329899999998, 2023-09-30T17:04:28.271 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.271 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.271 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.272 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.272 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.272 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152122 2023-09-30T17:04:28.272 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.272 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.272 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.939657+0000", 2023-09-30T17:04:28.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.272 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.273 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.273 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.939657+0000", 2023-09-30T17:04:28.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.273 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.273 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.273 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.273 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.943516+0000", 2023-09-30T17:04:28.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038592660000000001 2023-09-30T17:04:28.273 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.274 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.274 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.943538+0000", 2023-09-30T17:04:28.274 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2084999999999999e-05 2023-09-30T17:04:28.274 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.274 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.274 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.943548+0000", 2023-09-30T17:04:28.274 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0188e-05 2023-09-30T17:04:28.274 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.275 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.275 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.943556+0000", 2023-09-30T17:04:28.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5000000000000002e-06 2023-09-30T17:04:28.275 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.275 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.275 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.275 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.275 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152525 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.275 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.090568+0000", 2023-09-30T17:04:28.275 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.23521378200000001, 2023-09-30T17:04:28.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.249434087, 2023-09-30T17:04:28.276 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.276 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.276 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.276 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.276 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.276 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152525 2023-09-30T17:04:28.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.276 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.090568+0000", 2023-09-30T17:04:28.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.090568+0000", 2023-09-30T17:04:28.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.090568+0000", 2023-09-30T17:04:28.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5199999999999997e-07 2023-09-30T17:04:28.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.090580+0000", 2023-09-30T17:04:28.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1537e-05 2023-09-30T17:04:28.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.090587+0000", 2023-09-30T17:04:28.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2099999999999996e-06 2023-09-30T17:04:28.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.090593+0000", 2023-09-30T17:04:28.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.976e-06 2023-09-30T17:04:28.280 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.280 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.280 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.280 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152748 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.280 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.191623+0000", 2023-09-30T17:04:28.280 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.134157999, 2023-09-30T17:04:28.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.14844344500000001, 2023-09-30T17:04:28.280 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.280 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.281 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.281 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.281 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.281 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152748 2023-09-30T17:04:28.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.281 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.191623+0000", 2023-09-30T17:04:28.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.191623+0000", 2023-09-30T17:04:28.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.191624+0000", 2023-09-30T17:04:28.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9499999999999998e-07 2023-09-30T17:04:28.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.283 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.283 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.191640+0000", 2023-09-30T17:04:28.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.641e-05 2023-09-30T17:04:28.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.283 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.283 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.191647+0000", 2023-09-30T17:04:28.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.08e-06 2023-09-30T17:04:28.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.283 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.284 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.191653+0000", 2023-09-30T17:04:28.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8660000000000002e-06 2023-09-30T17:04:28.284 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.284 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.284 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.284 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152907 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.284 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.276567+0000", 2023-09-30T17:04:28.284 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.049214987000000002, 2023-09-30T17:04:28.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.063560933, 2023-09-30T17:04:28.285 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.285 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.285 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.285 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.285 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.285 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152907 2023-09-30T17:04:28.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.285 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.276567+0000", 2023-09-30T17:04:28.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.276567+0000", 2023-09-30T17:04:28.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.276567+0000", 2023-09-30T17:04:28.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5000000000000003e-07 2023-09-30T17:04:28.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.276587+0000", 2023-09-30T17:04:28.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0171999999999999e-05 2023-09-30T17:04:28.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.289 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.289 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.276595+0000", 2023-09-30T17:04:28.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9519999999999994e-06 2023-09-30T17:04:28.289 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.289 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.289 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.276602+0000", 2023-09-30T17:04:28.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0870000000000001e-06 2023-09-30T17:04:28.289 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.289 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.289 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.290 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.290 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:152025 4.2e e55/17)", 2023-09-30T17:04:28.290 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.296313+0000", 2023-09-30T17:04:28.290 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.029468331, 2023-09-30T17:04:28.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043877012, 2023-09-30T17:04:28.290 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.290 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.290 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.296313+0000", 2023-09-30T17:04:28.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.296313+0000", 2023-09-30T17:04:28.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.296313+0000", 2023-09-30T17:04:28.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8099999999999999e-07 2023-09-30T17:04:28.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.296329+0000", 2023-09-30T17:04:28.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5407e-05 2023-09-30T17:04:28.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.293 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.296339+0000", 2023-09-30T17:04:28.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0232e-05 2023-09-30T17:04:28.293 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.293 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.293 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.296345+0000", 2023-09-30T17:04:28.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0079999999999999e-06 2023-09-30T17:04:28.293 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.293 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.293 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.293 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.294 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:153223 4.15 e55/17 4:aada5e43:::100000001f8.00000028:head v 55'2391, mlcod=55'2388)", 2023-09-30T17:04:28.294 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.332595+0000", 2023-09-30T17:04:28.294 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.993186, 2023-09-30T17:04:28.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0076567939999999998, 2023-09-30T17:04:28.294 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.294 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:28.294 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.294 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.294 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.332595+0000", 2023-09-30T17:04:28.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.332595+0000", 2023-09-30T17:04:28.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.340 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.332596+0000", 2023-09-30T17:04:28.340 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7899999999999998e-07 2023-09-30T17:04:28.340 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.340 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.340 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.340 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.332610+0000", 2023-09-30T17:04:28.340 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4542000000000001e-05 2023-09-30T17:04:28.340 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.341 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.341 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.332618+0000", 2023-09-30T17:04:28.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9130000000000003e-06 2023-09-30T17:04:28.341 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.341 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.341 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.341 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.332627+0000", 2023-09-30T17:04:28.341 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1259999999999998e-06 2023-09-30T17:04:28.342 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.342 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.342 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:28.342 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.333867+0000", 2023-09-30T17:04:28.342 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001240021 2023-09-30T17:04:28.342 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.342 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.342 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:28.342 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.333886+0000", 2023-09-30T17:04:28.342 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9928999999999998e-05 2023-09-30T17:04:28.343 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.343 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.343 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.343 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.343 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.343 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151620 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.343 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.738781+0000", 2023-09-30T17:04:28.343 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.58700046100000003, 2023-09-30T17:04:28.343 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.60154580800000002, 2023-09-30T17:04:28.343 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.343 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.344 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.344 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.344 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.344 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151620 2023-09-30T17:04:28.344 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.344 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.344 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.344 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.345 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.738781+0000", 2023-09-30T17:04:28.345 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.345 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.345 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.345 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.345 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.738781+0000", 2023-09-30T17:04:28.345 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.345 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.345 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.345 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.346 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.738781+0000", 2023-09-30T17:04:28.346 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1699999999999999e-07 2023-09-30T17:04:28.346 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.346 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.346 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.346 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.738809+0000", 2023-09-30T17:04:28.346 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7821999999999999e-05 2023-09-30T17:04:28.346 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.346 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.347 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.347 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.738833+0000", 2023-09-30T17:04:28.347 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4046e-05 2023-09-30T17:04:28.347 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.347 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.347 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.347 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.738840+0000", 2023-09-30T17:04:28.347 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3130000000000004e-06 2023-09-30T17:04:28.347 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.347 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.348 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.348 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.348 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.348 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152527 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.353 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.090603+0000", 2023-09-30T17:04:28.354 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.23517887700000001, 2023-09-30T17:04:28.354 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.24977094699999999, 2023-09-30T17:04:28.354 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.354 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.355 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.355 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.355 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.355 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152527 2023-09-30T17:04:28.355 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.355 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.355 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.355 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.355 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.090603+0000", 2023-09-30T17:04:28.355 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.355 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.355 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.356 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.356 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.090603+0000", 2023-09-30T17:04:28.356 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.356 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.356 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.356 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.356 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.090603+0000", 2023-09-30T17:04:28.356 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9699999999999996e-07 2023-09-30T17:04:28.356 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.356 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.356 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.356 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.090616+0000", 2023-09-30T17:04:28.357 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2626000000000001e-05 2023-09-30T17:04:28.357 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.357 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.357 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.357 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.090622+0000", 2023-09-30T17:04:28.357 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7120000000000003e-06 2023-09-30T17:04:28.357 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.357 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.357 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.357 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.090628+0000", 2023-09-30T17:04:28.358 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3129999999999998e-06 2023-09-30T17:04:28.358 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.358 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.358 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.358 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.358 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.358 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:151824 4.6 e55/17)", 2023-09-30T17:04:28.358 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.222492+0000", 2023-09-30T17:04:28.358 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.103289011, 2023-09-30T17:04:28.358 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.117913133, 2023-09-30T17:04:28.358 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.358 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.359 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.359 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.359 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.359 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.222492+0000", 2023-09-30T17:04:28.359 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.359 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.360 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.360 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.222492+0000", 2023-09-30T17:04:28.360 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.360 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.360 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.360 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.360 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.222494+0000", 2023-09-30T17:04:28.360 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5379999999999999e-06 2023-09-30T17:04:28.361 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.361 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.361 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.361 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.222523+0000", 2023-09-30T17:04:28.361 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9054999999999999e-05 2023-09-30T17:04:28.361 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.361 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.361 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.361 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.222533+0000", 2023-09-30T17:04:28.361 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7059999999999999e-06 2023-09-30T17:04:28.361 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.361 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.362 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.362 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.222542+0000", 2023-09-30T17:04:28.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0990000000000005e-06 2023-09-30T17:04:28.362 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.362 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.362 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.362 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.362 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.363 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152908 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.363 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.276611+0000", 2023-09-30T17:04:28.363 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.049170628000000001, 2023-09-30T17:04:28.363 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.063822467999999993, 2023-09-30T17:04:28.363 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.363 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.363 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.363 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.363 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.363 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152908 2023-09-30T17:04:28.363 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.364 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.364 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.364 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.364 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.276611+0000", 2023-09-30T17:04:28.364 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.364 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.364 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.364 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.364 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.276611+0000", 2023-09-30T17:04:28.365 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.365 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.365 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.366 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.366 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.276611+0000", 2023-09-30T17:04:28.366 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8999999999999996e-07 2023-09-30T17:04:28.366 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.366 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.366 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.366 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.276626+0000", 2023-09-30T17:04:28.366 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4574e-05 2023-09-30T17:04:28.367 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.367 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.367 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.276633+0000", 2023-09-30T17:04:28.382 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9210000000000003e-06 2023-09-30T17:04:28.382 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.383 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.383 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.383 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.276640+0000", 2023-09-30T17:04:28.383 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1099999999999997e-06 2023-09-30T17:04:28.383 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.383 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.384 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.384 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.385 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.385 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:153000 4.12 4:4be51a30:::100000001f8.0000000b:head [write 937984~4096 in=4096b,write 978944~4096 in=4096b,write 1110016~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.385 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.319786+0000", 2023-09-30T17:04:28.385 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0059952970000000001, 2023-09-30T17:04:28.385 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020683731, 2023-09-30T17:04:28.386 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.386 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:28.386 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.386 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.386 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.387 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 153000 2023-09-30T17:04:28.387 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.387 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.387 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.387 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.387 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319786+0000", 2023-09-30T17:04:28.388 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.388 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.388 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.388 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.388 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319786+0000", 2023-09-30T17:04:28.388 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.389 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.389 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.389 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.389 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319787+0000", 2023-09-30T17:04:28.389 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5700000000000002e-07 2023-09-30T17:04:28.390 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.390 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.390 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.390 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319802+0000", 2023-09-30T17:04:28.390 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5071e-05 2023-09-30T17:04:28.390 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.391 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.391 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.391 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319810+0000", 2023-09-30T17:04:28.391 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7360000000000001e-06 2023-09-30T17:04:28.391 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.391 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.391 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.391 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319815+0000", 2023-09-30T17:04:28.392 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8510000000000004e-06 2023-09-30T17:04:28.392 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.392 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.392 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:28.392 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.327224+0000", 2023-09-30T17:04:28.392 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0074084210000000001 2023-09-30T17:04:28.392 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.392 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.392 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:28.393 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.327333+0000", 2023-09-30T17:04:28.393 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000109418 2023-09-30T17:04:28.393 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.393 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.393 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:28.393 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.327518+0000", 2023-09-30T17:04:28.393 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00018502899999999999 2023-09-30T17:04:28.393 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.394 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.394 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.394 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.394 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.394 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:153025 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.394 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.331697+0000", 2023-09-30T17:04:28.395 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9940844, 2023-09-30T17:04:28.395 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0088241190000000001, 2023-09-30T17:04:28.395 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.395 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.395 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.396 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.396 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.396 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 153025 2023-09-30T17:04:28.396 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.396 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.396 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.397 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.397 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.331697+0000", 2023-09-30T17:04:28.397 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.397 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.397 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.397 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.398 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.331697+0000", 2023-09-30T17:04:28.398 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.398 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.398 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.398 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.398 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.333518+0000", 2023-09-30T17:04:28.399 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0018206940000000001 2023-09-30T17:04:28.399 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.399 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.399 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.399 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.333536+0000", 2023-09-30T17:04:28.399 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.806e-05 2023-09-30T17:04:28.400 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.400 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.400 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.400 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.333548+0000", 2023-09-30T17:04:28.400 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1994000000000001e-05 2023-09-30T17:04:28.401 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.401 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.401 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.401 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.333555+0000", 2023-09-30T17:04:28.401 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1749999999999999e-06 2023-09-30T17:04:28.401 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.401 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.402 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.402 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.402 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.402 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151269 4.37 4:eff9002a:::100000001f8.00000003:head [write 638976~4096 in=4096b,write 647168~4096 in=4096b,write 847872~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.402 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.599859+0000", 2023-09-30T17:04:28.402 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.72592283499999999, 2023-09-30T17:04:28.402 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.74069922300000002, 2023-09-30T17:04:28.403 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.403 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:28.403 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.403 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.403 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.403 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151269 2023-09-30T17:04:28.403 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.403 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.404 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.404 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.404 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.599859+0000", 2023-09-30T17:04:28.404 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.404 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.404 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.404 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.404 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.599859+0000", 2023-09-30T17:04:28.404 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.405 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.405 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.405 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.405 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.599859+0000", 2023-09-30T17:04:28.405 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0200000000000003e-07 2023-09-30T17:04:28.405 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.405 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.405 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.405 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.599871+0000", 2023-09-30T17:04:28.406 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2207e-05 2023-09-30T17:04:28.406 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.406 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.406 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.406 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.599878+0000", 2023-09-30T17:04:28.406 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3600000000000001e-06 2023-09-30T17:04:28.406 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.407 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.407 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.407 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.599882+0000", 2023-09-30T17:04:28.407 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7380000000000002e-06 2023-09-30T17:04:28.407 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.407 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.407 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:28.407 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.337546+0000", 2023-09-30T17:04:28.407 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.73766379800000004 2023-09-30T17:04:28.407 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.408 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.408 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:28.408 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.337639+0000", 2023-09-30T17:04:28.408 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2429000000000006e-05 2023-09-30T17:04:28.409 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.409 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.409 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:28.409 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.337840+0000", 2023-09-30T17:04:28.409 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00020137700000000001 2023-09-30T17:04:28.410 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.410 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.410 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.410 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.410 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.411 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151655 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.411 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.750783+0000", 2023-09-30T17:04:28.411 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.57499869100000001, 2023-09-30T17:04:28.411 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.58981595499999995, 2023-09-30T17:04:28.411 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.411 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.412 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.412 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.412 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.412 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151655 2023-09-30T17:04:28.412 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.413 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.413 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.413 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.413 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.750783+0000", 2023-09-30T17:04:28.413 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.413 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.414 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.414 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.414 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.750783+0000", 2023-09-30T17:04:28.414 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.414 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.414 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.415 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.415 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.750783+0000", 2023-09-30T17:04:28.415 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.51e-07 2023-09-30T17:04:28.415 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.415 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.416 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.416 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.750796+0000", 2023-09-30T17:04:28.416 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2747e-05 2023-09-30T17:04:28.416 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.416 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.417 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.417 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.750802+0000", 2023-09-30T17:04:28.417 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6699999999999999e-06 2023-09-30T17:04:28.417 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.417 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.417 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.417 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.750807+0000", 2023-09-30T17:04:28.418 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2100000000000001e-06 2023-09-30T17:04:28.418 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.418 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.418 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.418 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.418 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.419 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152129 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.419 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.943611+0000", 2023-09-30T17:04:28.419 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.38217050499999999, 2023-09-30T17:04:28.419 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.397019646, 2023-09-30T17:04:28.419 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.419 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.420 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.420 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.420 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.420 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152129 2023-09-30T17:04:28.420 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.421 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.421 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.421 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.421 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.943611+0000", 2023-09-30T17:04:28.421 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.421 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.421 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.421 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.421 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.943611+0000", 2023-09-30T17:04:28.422 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.422 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.422 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.422 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.422 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.943611+0000", 2023-09-30T17:04:28.422 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3500000000000002e-07 2023-09-30T17:04:28.422 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.422 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.422 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.423 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.943622+0000", 2023-09-30T17:04:28.423 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0862e-05 2023-09-30T17:04:28.423 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.423 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.423 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.423 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.943628+0000", 2023-09-30T17:04:28.423 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0970000000000002e-06 2023-09-30T17:04:28.423 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.423 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.424 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.424 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.943633+0000", 2023-09-30T17:04:28.424 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9509999999999997e-06 2023-09-30T17:04:28.424 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.424 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.424 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.424 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.424 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.425 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152178 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.425 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.952571+0000", 2023-09-30T17:04:28.425 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.37321073199999999, 2023-09-30T17:04:28.425 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.38809142499999999, 2023-09-30T17:04:28.425 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.426 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.426 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.426 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.427 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.427 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152178 2023-09-30T17:04:28.427 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.427 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.427 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.427 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.427 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.952571+0000", 2023-09-30T17:04:28.427 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.427 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.428 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.428 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.428 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.952571+0000", 2023-09-30T17:04:28.428 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.428 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.428 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.428 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.428 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.952571+0000", 2023-09-30T17:04:28.428 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8299999999999997e-07 2023-09-30T17:04:28.429 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.429 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.429 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.429 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.952585+0000", 2023-09-30T17:04:28.429 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.382e-05 2023-09-30T17:04:28.429 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.429 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.430 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.430 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.952593+0000", 2023-09-30T17:04:28.430 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1880000000000002e-06 2023-09-30T17:04:28.430 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.430 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.430 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.430 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.952600+0000", 2023-09-30T17:04:28.430 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4500000000000001e-06 2023-09-30T17:04:28.430 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.430 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.431 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.431 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.431 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.431 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152604 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.431 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.113566+0000", 2023-09-30T17:04:28.431 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.212215288, 2023-09-30T17:04:28.431 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.227130842, 2023-09-30T17:04:28.431 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.431 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.432 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.432 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.432 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.432 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152604 2023-09-30T17:04:28.432 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.432 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.432 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.432 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.432 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.113566+0000", 2023-09-30T17:04:28.432 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.432 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.432 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.433 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.433 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.113566+0000", 2023-09-30T17:04:28.433 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.433 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.433 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.433 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.433 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.117516+0000", 2023-09-30T17:04:28.433 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039493360000000003 2023-09-30T17:04:28.433 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.433 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.433 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.434 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.117536+0000", 2023-09-30T17:04:28.434 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0699999999999998e-05 2023-09-30T17:04:28.434 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.434 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.434 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.434 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.117546+0000", 2023-09-30T17:04:28.434 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0138e-05 2023-09-30T17:04:28.434 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.435 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.435 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.435 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.117552+0000", 2023-09-30T17:04:28.435 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0000000000000002e-06 2023-09-30T17:04:28.435 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.435 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.435 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.435 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.436 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.436 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152675 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.436 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.143716+0000", 2023-09-30T17:04:28.436 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.182065383, 2023-09-30T17:04:28.436 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.197014044, 2023-09-30T17:04:28.436 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.436 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.437 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.437 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.437 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.437 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152675 2023-09-30T17:04:28.437 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.437 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.437 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.437 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.438 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.143716+0000", 2023-09-30T17:04:28.438 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.438 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.438 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.438 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.439 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.143716+0000", 2023-09-30T17:04:28.439 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.439 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.439 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.439 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.439 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.143716+0000", 2023-09-30T17:04:28.440 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5900000000000003e-07 2023-09-30T17:04:28.440 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.440 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.440 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.440 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.143727+0000", 2023-09-30T17:04:28.440 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0971999999999999e-05 2023-09-30T17:04:28.441 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.441 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.441 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.441 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.143733+0000", 2023-09-30T17:04:28.441 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.896e-06 2023-09-30T17:04:28.441 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.441 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.442 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.442 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.143738+0000", 2023-09-30T17:04:28.442 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8849999999999998e-06 2023-09-30T17:04:28.442 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.442 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.442 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.443 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.443 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:153001 4.23 4:c6f90462:::100000001f8.00000037:head [write 724992~4096 in=4096b,write 901120~4096 in=4096b,write 917504~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.443 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.319824+0000", 2023-09-30T17:04:28.443 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0059573200000000003, 2023-09-30T17:04:28.443 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020947750000000001, 2023-09-30T17:04:28.444 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.444 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:28.444 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.444 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.444 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.444 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 153001 2023-09-30T17:04:28.445 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.445 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.445 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.445 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.445 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319824+0000", 2023-09-30T17:04:28.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.445 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.446 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.446 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.446 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319824+0000", 2023-09-30T17:04:28.446 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.446 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.446 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.447 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.447 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319825+0000", 2023-09-30T17:04:28.447 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7399999999999998e-07 2023-09-30T17:04:28.447 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.447 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.448 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319837+0000", 2023-09-30T17:04:28.448 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2228e-05 2023-09-30T17:04:28.448 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.448 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.448 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319844+0000", 2023-09-30T17:04:28.449 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3560000000000004e-06 2023-09-30T17:04:28.449 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.449 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.449 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.449 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319850+0000", 2023-09-30T17:04:28.449 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0000000000000002e-06 2023-09-30T17:04:28.449 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.450 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.450 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:28.450 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.320618+0000", 2023-09-30T17:04:28.450 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00076813399999999996 2023-09-30T17:04:28.450 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.450 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.451 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:28.451 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.320693+0000", 2023-09-30T17:04:28.451 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4380000000000003e-05 2023-09-30T17:04:28.451 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.451 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.451 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:28.452 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.320841+0000", 2023-09-30T17:04:28.452 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014859000000000001 2023-09-30T17:04:28.452 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.452 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.452 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:28.452 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.340313+0000", 2023-09-30T17:04:28.453 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019472099 2023-09-30T17:04:28.453 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.453 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.453 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.453 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.453 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.453 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:153026 4.30 4:0c89e311:::100000001f8.00000017:head [write 3358720~4096 in=4096b,write 3407872~4096 in=4096b,write 3502080~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.453 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.333569+0000", 2023-09-30T17:04:28.453 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9922128, 2023-09-30T17:04:28.453 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072765989999999999, 2023-09-30T17:04:28.454 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.454 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:28.454 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.454 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.454 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.454 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 153026 2023-09-30T17:04:28.454 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.454 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.455 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.455 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.455 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.333569+0000", 2023-09-30T17:04:28.455 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.455 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.455 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.455 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.455 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.333569+0000", 2023-09-30T17:04:28.455 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.455 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.456 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.456 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.456 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.333569+0000", 2023-09-30T17:04:28.456 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6499999999999999e-07 2023-09-30T17:04:28.456 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.456 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.456 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.457 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.333584+0000", 2023-09-30T17:04:28.457 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4697e-05 2023-09-30T17:04:28.457 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.457 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.457 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.457 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.333591+0000", 2023-09-30T17:04:28.457 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7900000000000002e-06 2023-09-30T17:04:28.458 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.458 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.458 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.458 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.333596+0000", 2023-09-30T17:04:28.458 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3009999999999997e-06 2023-09-30T17:04:28.458 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.458 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.458 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:28.459 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.333629+0000", 2023-09-30T17:04:28.459 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2681000000000001e-05 2023-09-30T17:04:28.459 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.459 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.459 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:28.459 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.333680+0000", 2023-09-30T17:04:28.459 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1032000000000002e-05 2023-09-30T17:04:28.459 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.459 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.459 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.460 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.460 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.460 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151231 4.37 4:eff9002a:::100000001f8.00000003:head [write 1445888~4096 in=4096b,write 1495040~4096 in=4096b,write 1511424~16384 in=16384b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.460 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.593760+0000", 2023-09-30T17:04:28.460 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.73202163799999997, 2023-09-30T17:04:28.460 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.74713672399999997, 2023-09-30T17:04:28.460 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.460 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:28.461 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.461 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.461 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.461 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151231 2023-09-30T17:04:28.461 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.461 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.461 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.461 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.461 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.593760+0000", 2023-09-30T17:04:28.461 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.462 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.462 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.462 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.462 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.593760+0000", 2023-09-30T17:04:28.462 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.462 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.462 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.462 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.462 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.593760+0000", 2023-09-30T17:04:28.462 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7999999999999995e-07 2023-09-30T17:04:28.463 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.463 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.463 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.593782+0000", 2023-09-30T17:04:28.463 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2056e-05 2023-09-30T17:04:28.463 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.463 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.463 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.593790+0000", 2023-09-30T17:04:28.463 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7389999999999999e-06 2023-09-30T17:04:28.463 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.464 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.464 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.593795+0000", 2023-09-30T17:04:28.464 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3089999999999997e-06 2023-09-30T17:04:28.464 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.464 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.464 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:28.464 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.297656+0000", 2023-09-30T17:04:28.464 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.70386184500000004 2023-09-30T17:04:28.464 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.464 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.464 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:28.465 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.297732+0000", 2023-09-30T17:04:28.465 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5191999999999994e-05 2023-09-30T17:04:28.465 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.465 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.465 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:28.465 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.297906+0000", 2023-09-30T17:04:28.465 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017425900000000001 2023-09-30T17:04:28.465 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.465 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.465 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:28.465 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.317793+0000", 2023-09-30T17:04:28.466 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019887649 2023-09-30T17:04:28.466 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.466 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.466 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.466 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.466 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.466 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151428 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.466 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.665651+0000", 2023-09-30T17:04:28.466 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.66013054800000004, 2023-09-30T17:04:28.467 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.67529888699999996, 2023-09-30T17:04:28.467 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.467 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.467 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.467 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.467 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.467 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151428 2023-09-30T17:04:28.467 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.467 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.467 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.468 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.468 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.665651+0000", 2023-09-30T17:04:28.468 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.468 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.468 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.468 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.468 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.665651+0000", 2023-09-30T17:04:28.469 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.469 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.469 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.469 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.469 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.665652+0000", 2023-09-30T17:04:28.469 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.99e-07 2023-09-30T17:04:28.469 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.469 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.469 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.469 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.665665+0000", 2023-09-30T17:04:28.469 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3609e-05 2023-09-30T17:04:28.469 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.470 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.470 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.470 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.665673+0000", 2023-09-30T17:04:28.470 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4909999999999999e-06 2023-09-30T17:04:28.471 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.471 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.471 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.471 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.665679+0000", 2023-09-30T17:04:28.471 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4509999999999997e-06 2023-09-30T17:04:28.471 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.471 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.471 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.471 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.471 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.472 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151531 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.472 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.702581+0000", 2023-09-30T17:04:28.472 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.62320058499999997, 2023-09-30T17:04:28.472 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.63840284000000003, 2023-09-30T17:04:28.472 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.472 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.472 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.473 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.473 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.473 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151531 2023-09-30T17:04:28.473 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.473 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.473 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.473 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.473 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.702581+0000", 2023-09-30T17:04:28.473 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.473 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.473 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.474 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.474 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.702581+0000", 2023-09-30T17:04:28.474 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.474 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.474 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.474 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.474 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.702581+0000", 2023-09-30T17:04:28.474 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.68e-07 2023-09-30T17:04:28.474 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.474 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.474 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.475 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.702601+0000", 2023-09-30T17:04:28.475 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9060999999999999e-05 2023-09-30T17:04:28.475 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.475 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.475 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.475 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.702608+0000", 2023-09-30T17:04:28.475 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8299999999999996e-06 2023-09-30T17:04:28.475 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.475 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.475 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.476 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.702614+0000", 2023-09-30T17:04:28.476 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7089999999999999e-06 2023-09-30T17:04:28.476 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.476 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.476 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.476 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.476 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.476 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151867 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.476 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.827695+0000", 2023-09-30T17:04:28.476 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.49808688299999998, 2023-09-30T17:04:28.476 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.51332093000000001, 2023-09-30T17:04:28.477 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.477 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.477 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.477 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.477 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.477 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151867 2023-09-30T17:04:28.477 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.477 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.477 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.477 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.478 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.827695+0000", 2023-09-30T17:04:28.478 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.478 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.478 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.478 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.478 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.827695+0000", 2023-09-30T17:04:28.478 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.478 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.478 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.478 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.479 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.827695+0000", 2023-09-30T17:04:28.479 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7700000000000001e-07 2023-09-30T17:04:28.479 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.479 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.479 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.479 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.827706+0000", 2023-09-30T17:04:28.479 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1466e-05 2023-09-30T17:04:28.479 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.479 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.479 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.479 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.827719+0000", 2023-09-30T17:04:28.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2629999999999999e-05 2023-09-30T17:04:28.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.480 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.480 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.827722+0000", 2023-09-30T17:04:28.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3170000000000002e-06 2023-09-30T17:04:28.480 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.480 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.480 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.481 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.481 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151886 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.481 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.839652+0000", 2023-09-30T17:04:28.481 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.48612902499999999, 2023-09-30T17:04:28.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.50139929000000005, 2023-09-30T17:04:28.481 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.495 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.495 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.495 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.495 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.495 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151886 2023-09-30T17:04:28.495 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.496 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.496 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.496 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.496 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.839652+0000", 2023-09-30T17:04:28.496 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.496 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.496 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.496 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.496 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.839652+0000", 2023-09-30T17:04:28.496 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.496 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.497 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.497 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.497 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.843516+0000", 2023-09-30T17:04:28.497 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038630930000000002 2023-09-30T17:04:28.497 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.497 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.497 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.497 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.843531+0000", 2023-09-30T17:04:28.497 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5104e-05 2023-09-30T17:04:28.497 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.497 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.497 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.498 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.843538+0000", 2023-09-30T17:04:28.498 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5390000000000002e-06 2023-09-30T17:04:28.498 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.498 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.498 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.498 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.843545+0000", 2023-09-30T17:04:28.498 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.63e-06 2023-09-30T17:04:28.498 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.498 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.498 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.499 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.499 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.499 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152090 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.499 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.926599+0000", 2023-09-30T17:04:28.499 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.39918269299999998, 2023-09-30T17:04:28.499 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.41449049599999999, 2023-09-30T17:04:28.499 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.500 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.500 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.500 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.500 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.500 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152090 2023-09-30T17:04:28.500 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.500 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.500 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.500 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.500 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.926599+0000", 2023-09-30T17:04:28.500 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.500 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.501 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.501 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.501 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.926599+0000", 2023-09-30T17:04:28.501 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.501 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.501 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.501 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.501 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.926599+0000", 2023-09-30T17:04:28.501 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4499999999999997e-07 2023-09-30T17:04:28.501 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.502 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.502 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.502 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.926615+0000", 2023-09-30T17:04:28.502 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5387e-05 2023-09-30T17:04:28.502 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.502 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.502 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.503 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.926622+0000", 2023-09-30T17:04:28.503 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9469999999999997e-06 2023-09-30T17:04:28.503 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.503 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.503 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.503 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.926627+0000", 2023-09-30T17:04:28.503 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2560000000000002e-06 2023-09-30T17:04:28.503 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.503 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.503 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.503 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.504 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.504 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152214 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.504 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.966956+0000", 2023-09-30T17:04:28.504 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.35882510400000001, 2023-09-30T17:04:28.504 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.37441440100000001, 2023-09-30T17:04:28.504 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.504 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.504 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.504 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.504 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.504 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152214 2023-09-30T17:04:28.505 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.505 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.505 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.505 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.505 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.966956+0000", 2023-09-30T17:04:28.505 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.505 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.505 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.505 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.505 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.966956+0000", 2023-09-30T17:04:28.505 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.506 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.506 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.506 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.966957+0000", 2023-09-30T17:04:28.506 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6699999999999999e-07 2023-09-30T17:04:28.506 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.506 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.506 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.966972+0000", 2023-09-30T17:04:28.506 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4790000000000001e-05 2023-09-30T17:04:28.507 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.507 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.507 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.507 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.966979+0000", 2023-09-30T17:04:28.507 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0260000000000002e-06 2023-09-30T17:04:28.507 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.507 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.507 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.508 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.966984+0000", 2023-09-30T17:04:28.508 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2299999999999999e-06 2023-09-30T17:04:28.508 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.508 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.508 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.508 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.508 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.509 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:152044 4.2e e55/17)", 2023-09-30T17:04:28.509 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.305769+0000", 2023-09-30T17:04:28.509 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.020012123, 2023-09-30T17:04:28.509 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.035631969999999999, 2023-09-30T17:04:28.509 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.509 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.509 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.509 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.509 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.509 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.305769+0000", 2023-09-30T17:04:28.509 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.509 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.510 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.510 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.510 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.305769+0000", 2023-09-30T17:04:28.510 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.510 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.510 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.510 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.510 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.305770+0000", 2023-09-30T17:04:28.510 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7399999999999998e-07 2023-09-30T17:04:28.510 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.511 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.511 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.511 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.305782+0000", 2023-09-30T17:04:28.511 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1758e-05 2023-09-30T17:04:28.511 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.511 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.511 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.511 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.305789+0000", 2023-09-30T17:04:28.511 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3810000000000001e-06 2023-09-30T17:04:28.512 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.512 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.512 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.512 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.305795+0000", 2023-09-30T17:04:28.512 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8100000000000003e-06 2023-09-30T17:04:28.512 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.512 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.512 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.512 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.512 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.513 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:153004 4.a 4:50194ce5:::100000001f8.00000027:head [write 274432~4096 in=4096b,write 409600~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.513 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.319860+0000", 2023-09-30T17:04:28.513 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0059212969999999998, 2023-09-30T17:04:28.513 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021572219, 2023-09-30T17:04:28.513 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.513 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:28.514 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.514 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.514 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.514 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 153004 2023-09-30T17:04:28.514 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.514 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.514 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.514 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.514 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319860+0000", 2023-09-30T17:04:28.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.515 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.515 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319860+0000", 2023-09-30T17:04:28.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.515 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.515 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319861+0000", 2023-09-30T17:04:28.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.75e-07 2023-09-30T17:04:28.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.516 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.516 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319873+0000", 2023-09-30T17:04:28.516 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1815e-05 2023-09-30T17:04:28.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.516 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.516 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319884+0000", 2023-09-30T17:04:28.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1286e-05 2023-09-30T17:04:28.517 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.517 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.517 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319890+0000", 2023-09-30T17:04:28.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9719999999999997e-06 2023-09-30T17:04:28.517 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.518 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:28.518 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.331135+0000", 2023-09-30T17:04:28.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011245375 2023-09-30T17:04:28.518 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.518 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.518 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:28.518 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.331228+0000", 2023-09-30T17:04:28.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.302e-05 2023-09-30T17:04:28.518 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.518 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.518 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.519 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:152094 4.36 e55/17)", 2023-09-30T17:04:28.519 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.334219+0000", 2023-09-30T17:04:28.519 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9915628, 2023-09-30T17:04:28.519 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072499729999999998, 2023-09-30T17:04:28.519 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.519 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.519 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.519 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.520 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.334219+0000", 2023-09-30T17:04:28.520 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.520 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.520 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.520 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.521 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.334219+0000", 2023-09-30T17:04:28.521 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.521 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.521 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.521 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.521 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.334219+0000", 2023-09-30T17:04:28.522 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9399999999999995e-07 2023-09-30T17:04:28.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.522 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.522 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.334229+0000", 2023-09-30T17:04:28.522 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8260000000000005e-06 2023-09-30T17:04:28.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.522 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.334237+0000", 2023-09-30T17:04:28.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3399999999999998e-06 2023-09-30T17:04:28.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.523 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.334243+0000", 2023-09-30T17:04:28.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.857e-06 2023-09-30T17:04:28.523 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.524 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.524 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.524 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.524 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.524 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151275 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.524 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.599939+0000", 2023-09-30T17:04:28.525 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.72584289599999996, 2023-09-30T17:04:28.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.74156633199999999, 2023-09-30T17:04:28.525 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.525 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.525 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.525 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.525 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.525 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151275 2023-09-30T17:04:28.525 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.525 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.525 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.526 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.526 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.599939+0000", 2023-09-30T17:04:28.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.526 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.526 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.526 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.599939+0000", 2023-09-30T17:04:28.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.526 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.526 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.527 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.599939+0000", 2023-09-30T17:04:28.527 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0600000000000001e-07 2023-09-30T17:04:28.527 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.527 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.527 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.527 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.599950+0000", 2023-09-30T17:04:28.527 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1413999999999999e-05 2023-09-30T17:04:28.527 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.528 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.528 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.528 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.599957+0000", 2023-09-30T17:04:28.528 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.229e-06 2023-09-30T17:04:28.528 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.528 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.537 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.537 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.599961+0000", 2023-09-30T17:04:28.537 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.775e-06 2023-09-30T17:04:28.537 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.537 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.538 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.538 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.538 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.538 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151349 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.538 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.626653+0000", 2023-09-30T17:04:28.538 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.69912859599999999, 2023-09-30T17:04:28.538 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.714900761, 2023-09-30T17:04:28.538 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.538 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.539 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.539 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.539 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.539 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151349 2023-09-30T17:04:28.539 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.539 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.539 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.539 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.539 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.626653+0000", 2023-09-30T17:04:28.539 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.539 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.539 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.540 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.540 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.626653+0000", 2023-09-30T17:04:28.540 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.540 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.540 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.540 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.540 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.626654+0000", 2023-09-30T17:04:28.540 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5499999999999997e-07 2023-09-30T17:04:28.540 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.540 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.540 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.540 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.626669+0000", 2023-09-30T17:04:28.541 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5140000000000001e-05 2023-09-30T17:04:28.541 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.541 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.541 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.541 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.626678+0000", 2023-09-30T17:04:28.541 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4939999999999992e-06 2023-09-30T17:04:28.541 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.541 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.541 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.541 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.626684+0000", 2023-09-30T17:04:28.541 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1279999999999996e-06 2023-09-30T17:04:28.542 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.542 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.542 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.542 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.542 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.542 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151628 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.542 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.739023+0000", 2023-09-30T17:04:28.542 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.58675826200000003, 2023-09-30T17:04:28.542 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.60259113500000006, 2023-09-30T17:04:28.543 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.543 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.543 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.543 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.543 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.543 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151628 2023-09-30T17:04:28.543 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.543 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.543 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.543 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.543 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.739023+0000", 2023-09-30T17:04:28.544 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.544 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.544 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.544 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.544 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.739023+0000", 2023-09-30T17:04:28.544 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.544 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.544 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.544 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.544 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.739024+0000", 2023-09-30T17:04:28.544 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6199999999999998e-07 2023-09-30T17:04:28.544 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.544 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.545 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.545 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.739036+0000", 2023-09-30T17:04:28.545 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2421e-05 2023-09-30T17:04:28.545 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.545 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.545 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.545 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.739043+0000", 2023-09-30T17:04:28.545 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9770000000000003e-06 2023-09-30T17:04:28.545 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.546 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.546 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.546 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.739049+0000", 2023-09-30T17:04:28.546 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4539999999999998e-06 2023-09-30T17:04:28.546 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.546 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.546 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.546 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.546 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.546 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151915 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.547 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.853599+0000", 2023-09-30T17:04:28.547 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.47218231599999999, 2023-09-30T17:04:28.547 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.488076012, 2023-09-30T17:04:28.547 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.547 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.547 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.547 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.547 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.547 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151915 2023-09-30T17:04:28.547 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.547 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.548 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.548 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.548 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.853599+0000", 2023-09-30T17:04:28.548 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.548 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.548 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.548 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.548 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.853599+0000", 2023-09-30T17:04:28.548 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.548 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.548 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.549 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.549 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.857517+0000", 2023-09-30T17:04:28.549 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039179210000000004 2023-09-30T17:04:28.549 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.549 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.549 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.550 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.857539+0000", 2023-09-30T17:04:28.550 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1494000000000001e-05 2023-09-30T17:04:28.550 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.550 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.550 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.550 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.857549+0000", 2023-09-30T17:04:28.551 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.084e-05 2023-09-30T17:04:28.551 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.551 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.551 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.551 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.857557+0000", 2023-09-30T17:04:28.552 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9859999999999994e-06 2023-09-30T17:04:28.552 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.552 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.552 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.552 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.552 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.552 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151980 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.553 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.872433+0000", 2023-09-30T17:04:28.553 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.45334806999999999, 2023-09-30T17:04:28.553 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.46930846399999998, 2023-09-30T17:04:28.553 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.553 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.553 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.553 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.554 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.554 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151980 2023-09-30T17:04:28.554 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.554 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.554 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.554 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.554 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.872433+0000", 2023-09-30T17:04:28.554 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.555 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.555 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.555 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.555 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.872433+0000", 2023-09-30T17:04:28.555 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.555 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.555 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.556 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.556 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.874385+0000", 2023-09-30T17:04:28.556 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019516519999999999 2023-09-30T17:04:28.556 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.556 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.556 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.556 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.874408+0000", 2023-09-30T17:04:28.556 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2626e-05 2023-09-30T17:04:28.557 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.557 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.557 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.557 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.874429+0000", 2023-09-30T17:04:28.557 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1489999999999999e-05 2023-09-30T17:04:28.557 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.557 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.557 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.557 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.874439+0000", 2023-09-30T17:04:28.557 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7510000000000003e-06 2023-09-30T17:04:28.557 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.558 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.558 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.558 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.558 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.558 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152277 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.558 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.993590+0000", 2023-09-30T17:04:28.558 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.33219194099999999, 2023-09-30T17:04:28.558 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.34821770000000002, 2023-09-30T17:04:28.558 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.558 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.558 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.559 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.559 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.559 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152277 2023-09-30T17:04:28.559 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.559 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.559 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.559 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.559 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.993590+0000", 2023-09-30T17:04:28.559 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.559 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.559 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.559 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.560 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.993590+0000", 2023-09-30T17:04:28.560 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.560 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.560 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.560 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.560 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.993590+0000", 2023-09-30T17:04:28.560 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.72e-07 2023-09-30T17:04:28.560 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.560 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.560 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.560 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.993602+0000", 2023-09-30T17:04:28.561 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1656e-05 2023-09-30T17:04:28.561 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.561 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.561 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.561 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.993608+0000", 2023-09-30T17:04:28.561 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9379999999999997e-06 2023-09-30T17:04:28.561 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.561 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.561 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.562 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.993613+0000", 2023-09-30T17:04:28.562 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8699999999999997e-06 2023-09-30T17:04:28.562 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.562 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.562 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.562 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.562 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.562 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152700 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.563 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.165208+0000", 2023-09-30T17:04:28.563 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.160573719, 2023-09-30T17:04:28.563 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.17665951699999999, 2023-09-30T17:04:28.563 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.563 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.563 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.563 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.564 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.564 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152700 2023-09-30T17:04:28.564 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.564 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.564 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.564 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.564 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.165208+0000", 2023-09-30T17:04:28.564 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.564 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.565 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.565 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.565 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.165208+0000", 2023-09-30T17:04:28.565 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.565 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.565 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.565 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.565 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.165209+0000", 2023-09-30T17:04:28.565 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.257e-06 2023-09-30T17:04:28.565 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.565 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.565 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.566 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.165230+0000", 2023-09-30T17:04:28.566 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0761e-05 2023-09-30T17:04:28.566 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.566 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.566 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.566 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.165241+0000", 2023-09-30T17:04:28.566 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1041e-05 2023-09-30T17:04:28.566 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.566 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.566 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.566 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.165250+0000", 2023-09-30T17:04:28.566 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9369999999999993e-06 2023-09-30T17:04:28.567 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.567 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.567 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.567 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.567 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.567 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:153005 4.2d 4.ac5990ed (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.567 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.319898+0000", 2023-09-30T17:04:28.567 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0058837120000000001, 2023-09-30T17:04:28.567 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022032038, 2023-09-30T17:04:28.567 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.567 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.568 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.568 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.568 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.568 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 153005 2023-09-30T17:04:28.568 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.568 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.568 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.568 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.568 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319898+0000", 2023-09-30T17:04:28.568 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.568 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.568 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.569 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.569 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319898+0000", 2023-09-30T17:04:28.569 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.569 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.569 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.569 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.569 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319898+0000", 2023-09-30T17:04:28.569 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9999999999999998e-07 2023-09-30T17:04:28.569 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.569 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.569 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.569 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319910+0000", 2023-09-30T17:04:28.570 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1268e-05 2023-09-30T17:04:28.570 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.570 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.570 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.570 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319916+0000", 2023-09-30T17:04:28.570 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7050000000000002e-06 2023-09-30T17:04:28.570 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.570 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.570 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.570 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319923+0000", 2023-09-30T17:04:28.570 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.409e-06 2023-09-30T17:04:28.571 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.571 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.571 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.571 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.571 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.571 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:153029 4.23 4:c6f90462:::100000001f8.00000037:head [write 69632~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.571 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.333609+0000", 2023-09-30T17:04:28.571 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9921727, 2023-09-30T17:04:28.571 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0084914039999999993, 2023-09-30T17:04:28.572 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.572 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:28.572 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.572 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.572 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.572 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 153029 2023-09-30T17:04:28.572 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.572 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.572 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.572 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.572 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.333609+0000", 2023-09-30T17:04:28.573 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.573 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.573 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.573 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.573 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.333609+0000", 2023-09-30T17:04:28.573 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.573 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.573 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.573 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.574 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.335517+0000", 2023-09-30T17:04:28.574 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019080919999999999 2023-09-30T17:04:28.574 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.574 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.574 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.574 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.335531+0000", 2023-09-30T17:04:28.575 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4368e-05 2023-09-30T17:04:28.575 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.575 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.575 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.575 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.335544+0000", 2023-09-30T17:04:28.575 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2799999999999999e-05 2023-09-30T17:04:28.576 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.576 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.578 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.578 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.335552+0000", 2023-09-30T17:04:28.578 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6739999999999997e-06 2023-09-30T17:04:28.578 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.578 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.579 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:28.579 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.336343+0000", 2023-09-30T17:04:28.579 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00079152300000000003 2023-09-30T17:04:28.579 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.579 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.579 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:28.579 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.336393+0000", 2023-09-30T17:04:28.580 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9883999999999999e-05 2023-09-30T17:04:28.580 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.580 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.580 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:28.580 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.336519+0000", 2023-09-30T17:04:28.580 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00012647900000000001 2023-09-30T17:04:28.580 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.580 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.580 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.581 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.581 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.581 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151589 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.581 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.727564+0000", 2023-09-30T17:04:28.581 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.59821771099999999, 2023-09-30T17:04:28.581 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.61463864400000001, 2023-09-30T17:04:28.581 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.582 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.582 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.582 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.582 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.582 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151589 2023-09-30T17:04:28.582 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.582 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.582 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.582 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.583 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.727564+0000", 2023-09-30T17:04:28.583 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.583 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.583 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.583 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.583 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.727564+0000", 2023-09-30T17:04:28.583 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.583 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.583 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.584 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.584 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.729772+0000", 2023-09-30T17:04:28.584 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002208589 2023-09-30T17:04:28.584 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.584 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.584 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.584 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.729789+0000", 2023-09-30T17:04:28.584 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6886999999999999e-05 2023-09-30T17:04:28.584 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.585 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.585 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.585 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.729796+0000", 2023-09-30T17:04:28.585 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1219999999999997e-06 2023-09-30T17:04:28.585 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.585 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.585 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.585 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.729802+0000", 2023-09-30T17:04:28.585 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2499999999999997e-06 2023-09-30T17:04:28.585 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.586 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.586 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.586 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.586 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.586 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151791 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.586 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.806633+0000", 2023-09-30T17:04:28.586 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.51914820900000003, 2023-09-30T17:04:28.586 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.53567097299999999, 2023-09-30T17:04:28.587 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.587 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.587 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.587 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.587 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.587 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151791 2023-09-30T17:04:28.587 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.587 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.588 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.588 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.588 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.806633+0000", 2023-09-30T17:04:28.588 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.588 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.588 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.588 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.588 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.806633+0000", 2023-09-30T17:04:28.589 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.589 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.589 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.589 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.589 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.808516+0000", 2023-09-30T17:04:28.590 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0018826330000000001 2023-09-30T17:04:28.590 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.590 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.590 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.590 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.808530+0000", 2023-09-30T17:04:28.590 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3953e-05 2023-09-30T17:04:28.591 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.591 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.591 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.591 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.808540+0000", 2023-09-30T17:04:28.591 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8079999999999999e-06 2023-09-30T17:04:28.592 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.592 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.592 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.592 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.808544+0000", 2023-09-30T17:04:28.592 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4819999999999996e-06 2023-09-30T17:04:28.592 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.592 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.592 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.592 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.592 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.592 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152007 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.593 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.896589+0000", 2023-09-30T17:04:28.593 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.429192242, 2023-09-30T17:04:28.593 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.44577345200000001, 2023-09-30T17:04:28.593 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.593 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.593 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.593 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.593 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.593 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152007 2023-09-30T17:04:28.593 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.593 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.594 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.594 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.594 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.896589+0000", 2023-09-30T17:04:28.594 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.594 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.594 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.594 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.594 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.896589+0000", 2023-09-30T17:04:28.594 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.594 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.595 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.595 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.595 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.896590+0000", 2023-09-30T17:04:28.595 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8099999999999999e-07 2023-09-30T17:04:28.595 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.595 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.595 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.596 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.896598+0000", 2023-09-30T17:04:28.596 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1599999999999998e-06 2023-09-30T17:04:28.596 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.596 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.596 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.596 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.896602+0000", 2023-09-30T17:04:28.596 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7609999999999998e-06 2023-09-30T17:04:28.596 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.597 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.597 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.597 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.896606+0000", 2023-09-30T17:04:28.597 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0970000000000002e-06 2023-09-30T17:04:28.597 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.597 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.597 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.597 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.598 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.598 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152045 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.598 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.912564+0000", 2023-09-30T17:04:28.598 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.41321787900000001, 2023-09-30T17:04:28.598 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.429855019, 2023-09-30T17:04:28.598 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.598 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.598 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.598 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.598 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.599 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152045 2023-09-30T17:04:28.599 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.599 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.599 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.599 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.599 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.912564+0000", 2023-09-30T17:04:28.599 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.600 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.600 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.600 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.600 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.912564+0000", 2023-09-30T17:04:28.600 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.600 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.600 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.601 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.601 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.912564+0000", 2023-09-30T17:04:28.601 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9299999999999998e-07 2023-09-30T17:04:28.601 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.601 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.601 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.601 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.912577+0000", 2023-09-30T17:04:28.601 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2891000000000001e-05 2023-09-30T17:04:28.601 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.602 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.602 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.602 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.912584+0000", 2023-09-30T17:04:28.602 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0570000000000004e-06 2023-09-30T17:04:28.602 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.602 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.602 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.603 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.912590+0000", 2023-09-30T17:04:28.603 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7520000000000002e-06 2023-09-30T17:04:28.603 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.603 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.603 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.603 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.603 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.603 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152457 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.604 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.054607+0000", 2023-09-30T17:04:28.604 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.271174417, 2023-09-30T17:04:28.604 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.28786630200000002, 2023-09-30T17:04:28.604 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.604 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.604 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.604 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.604 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.605 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152457 2023-09-30T17:04:28.605 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.605 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.605 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.605 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.605 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.054607+0000", 2023-09-30T17:04:28.605 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.606 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.606 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.606 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.606 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.054607+0000", 2023-09-30T17:04:28.606 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.606 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.606 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.607 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.607 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.056518+0000", 2023-09-30T17:04:28.607 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001910943 2023-09-30T17:04:28.607 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.607 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.607 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.607 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.056536+0000", 2023-09-30T17:04:28.607 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7799999999999999e-05 2023-09-30T17:04:28.608 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.608 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.608 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.608 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.056551+0000", 2023-09-30T17:04:28.608 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5515999999999998e-05 2023-09-30T17:04:28.608 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.608 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.609 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.609 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.056560+0000", 2023-09-30T17:04:28.609 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7069999999999998e-06 2023-09-30T17:04:28.609 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.609 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.609 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.609 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.609 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.610 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152702 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.610 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.165266+0000", 2023-09-30T17:04:28.610 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.160515781, 2023-09-30T17:04:28.610 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.177266545, 2023-09-30T17:04:28.610 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.610 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.610 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.610 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.610 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.610 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152702 2023-09-30T17:04:28.611 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.611 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.611 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.611 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.611 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.165266+0000", 2023-09-30T17:04:28.611 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.611 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.611 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.612 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.612 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.165266+0000", 2023-09-30T17:04:28.612 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.612 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.612 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.612 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.612 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.165266+0000", 2023-09-30T17:04:28.613 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7000000000000004e-07 2023-09-30T17:04:28.613 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.613 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.613 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.613 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.165281+0000", 2023-09-30T17:04:28.613 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4218e-05 2023-09-30T17:04:28.613 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.613 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.613 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.614 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.165288+0000", 2023-09-30T17:04:28.614 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3119999999999996e-06 2023-09-30T17:04:28.614 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.614 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.614 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.614 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.165294+0000", 2023-09-30T17:04:28.614 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9739999999999999e-06 2023-09-30T17:04:28.614 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.615 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.615 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.615 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.615 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.615 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152773 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.615 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.200566+0000", 2023-09-30T17:04:28.615 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.12521502300000001, 2023-09-30T17:04:28.615 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.142020536, 2023-09-30T17:04:28.615 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.615 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.616 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.616 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.616 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.616 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152773 2023-09-30T17:04:28.616 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.616 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.616 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.616 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.617 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.200566+0000", 2023-09-30T17:04:28.617 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.617 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.617 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.617 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.200566+0000", 2023-09-30T17:04:28.617 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.618 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.618 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.618 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.204516+0000", 2023-09-30T17:04:28.618 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003949602 2023-09-30T17:04:28.618 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.618 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.618 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.619 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.204533+0000", 2023-09-30T17:04:28.619 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6982000000000001e-05 2023-09-30T17:04:28.619 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.619 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.619 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.619 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.204543+0000", 2023-09-30T17:04:28.619 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6059999999999992e-06 2023-09-30T17:04:28.619 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.619 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.620 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.620 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.204556+0000", 2023-09-30T17:04:28.620 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3203e-05 2023-09-30T17:04:28.620 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.620 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.620 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.620 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.620 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.620 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:153007 4.35 4.ed7a59b5 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.620 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.319930+0000", 2023-09-30T17:04:28.620 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0058514049999999996, 2023-09-30T17:04:28.621 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022708618999999999, 2023-09-30T17:04:28.621 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.621 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.621 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.621 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.621 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.621 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 153007 2023-09-30T17:04:28.622 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.622 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.622 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.622 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.622 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319930+0000", 2023-09-30T17:04:28.622 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.622 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.622 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.622 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.622 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319930+0000", 2023-09-30T17:04:28.623 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.623 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.623 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.623 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.623 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319930+0000", 2023-09-30T17:04:28.623 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9299999999999999e-07 2023-09-30T17:04:28.623 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.623 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.623 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.623 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319942+0000", 2023-09-30T17:04:28.624 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1568e-05 2023-09-30T17:04:28.624 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.624 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.624 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.624 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319949+0000", 2023-09-30T17:04:28.624 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5030000000000002e-06 2023-09-30T17:04:28.625 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.625 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.625 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.625 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.319954+0000", 2023-09-30T17:04:28.625 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3000000000000001e-06 2023-09-30T17:04:28.625 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.625 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.626 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.626 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.626 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.626 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:153030 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.626 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.335565+0000", 2023-09-30T17:04:28.626 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9902167, 2023-09-30T17:04:28.626 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0071357479999999999, 2023-09-30T17:04:28.627 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.627 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.627 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.627 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.627 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.627 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 153030 2023-09-30T17:04:28.628 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.628 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.628 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.628 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.628 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.335565+0000", 2023-09-30T17:04:28.628 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.628 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.629 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.335565+0000", 2023-09-30T17:04:28.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.335565+0000", 2023-09-30T17:04:28.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1099999999999996e-07 2023-09-30T17:04:28.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.630 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.335577+0000", 2023-09-30T17:04:28.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1622e-05 2023-09-30T17:04:28.631 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.631 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.631 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.631 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.335587+0000", 2023-09-30T17:04:28.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.798e-06 2023-09-30T17:04:28.631 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.631 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.631 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.631 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.335594+0000", 2023-09-30T17:04:28.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0650000000000001e-06 2023-09-30T17:04:28.632 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.632 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.632 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.632 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.632 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.632 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151433 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.632 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.665763+0000", 2023-09-30T17:04:28.632 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.66001858099999999, 2023-09-30T17:04:28.632 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.67698951699999999, 2023-09-30T17:04:28.632 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.632 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.633 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.633 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.633 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.633 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151433 2023-09-30T17:04:28.633 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.633 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.633 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.633 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.633 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.665763+0000", 2023-09-30T17:04:28.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.633 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.633 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.634 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.634 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.665763+0000", 2023-09-30T17:04:28.634 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.634 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.634 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.634 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.665763+0000", 2023-09-30T17:04:28.634 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2599999999999998e-07 2023-09-30T17:04:28.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.665783+0000", 2023-09-30T17:04:28.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9542999999999999e-05 2023-09-30T17:04:28.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.665790+0000", 2023-09-30T17:04:28.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4379999999999998e-06 2023-09-30T17:04:28.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.665797+0000", 2023-09-30T17:04:28.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5320000000000003e-06 2023-09-30T17:04:28.636 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.636 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.636 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.637 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151536 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.637 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.702704+0000", 2023-09-30T17:04:28.637 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.62307794800000005, 2023-09-30T17:04:28.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.64010179099999998, 2023-09-30T17:04:28.637 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.637 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.637 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.637 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.637 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.637 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151536 2023-09-30T17:04:28.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.637 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.638 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.638 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.702704+0000", 2023-09-30T17:04:28.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.638 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.638 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.638 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.702704+0000", 2023-09-30T17:04:28.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.702704+0000", 2023-09-30T17:04:28.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9799999999999999e-07 2023-09-30T17:04:28.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.702719+0000", 2023-09-30T17:04:28.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4912000000000001e-05 2023-09-30T17:04:28.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.702726+0000", 2023-09-30T17:04:28.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5920000000000003e-06 2023-09-30T17:04:28.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.702732+0000", 2023-09-30T17:04:28.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8660000000000002e-06 2023-09-30T17:04:28.640 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.641 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.641 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.641 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151590 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.641 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.729810+0000", 2023-09-30T17:04:28.660 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.595971735, 2023-09-30T17:04:28.660 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.61304644699999999, 2023-09-30T17:04:28.660 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.660 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.660 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.660 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.660 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.661 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151590 2023-09-30T17:04:28.661 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.661 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.661 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.661 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.661 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.729810+0000", 2023-09-30T17:04:28.661 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.662 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.662 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.662 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.662 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.729810+0000", 2023-09-30T17:04:28.662 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.662 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.662 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.663 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.663 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.729810+0000", 2023-09-30T17:04:28.663 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2500000000000001e-07 2023-09-30T17:04:28.663 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.663 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.664 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.664 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.729821+0000", 2023-09-30T17:04:28.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0937e-05 2023-09-30T17:04:28.664 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.729829+0000", 2023-09-30T17:04:28.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7409999999999992e-06 2023-09-30T17:04:28.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.666 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.729834+0000", 2023-09-30T17:04:28.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8049999999999997e-06 2023-09-30T17:04:28.666 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.666 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.666 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.666 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.667 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151794 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.667 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.808552+0000", 2023-09-30T17:04:28.667 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.51722950599999995, 2023-09-30T17:04:28.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.53435523500000004, 2023-09-30T17:04:28.667 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.668 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.668 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-09-30T17:04:28.672 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is unset 2023-09-30T17:04:28.673 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.673 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.673 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.673 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151794 2023-09-30T17:04:28.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.674 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.674 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.674 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.808552+0000", 2023-09-30T17:04:28.674 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.675 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.675 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.808552+0000", 2023-09-30T17:04:28.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.808552+0000", 2023-09-30T17:04:28.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3799999999999998e-07 2023-09-30T17:04:28.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.677 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.677 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.808561+0000", 2023-09-30T17:04:28.677 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1339999999999993e-06 2023-09-30T17:04:28.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.677 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.678 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.808566+0000", 2023-09-30T17:04:28.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3510000000000004e-06 2023-09-30T17:04:28.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.678 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.678 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.678 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.808569+0000", 2023-09-30T17:04:28.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0309999999999999e-06 2023-09-30T17:04:28.679 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.679 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.679 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.679 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152139 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.679 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.943745+0000", 2023-09-30T17:04:28.679 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.38203692099999997, 2023-09-30T17:04:28.679 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.39921624900000002, 2023-09-30T17:04:28.680 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.680 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.680 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.680 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.680 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.680 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152139 2023-09-30T17:04:28.680 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.680 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.681 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.681 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.943745+0000", 2023-09-30T17:04:28.681 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.681 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.682 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.943745+0000", 2023-09-30T17:04:28.682 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.682 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.682 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.682 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.682 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.943745+0000", 2023-09-30T17:04:28.682 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7899999999999999e-07 2023-09-30T17:04:28.683 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.683 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.683 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.943755+0000", 2023-09-30T17:04:28.683 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5419999999999994e-06 2023-09-30T17:04:28.683 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.684 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.684 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.943761+0000", 2023-09-30T17:04:28.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7020000000000004e-06 2023-09-30T17:04:28.684 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.684 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.684 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.943766+0000", 2023-09-30T17:04:28.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5329999999999996e-06 2023-09-30T17:04:28.684 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.684 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.685 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.685 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.685 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152244 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.685 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.981641+0000", 2023-09-30T17:04:28.685 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.34414054999999999, 2023-09-30T17:04:28.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.36137079799999999, 2023-09-30T17:04:28.685 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.686 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.686 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.686 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.686 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.686 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152244 2023-09-30T17:04:28.686 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.686 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.686 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.687 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.687 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.981641+0000", 2023-09-30T17:04:28.687 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.687 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.687 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.687 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.687 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.981641+0000", 2023-09-30T17:04:28.687 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.687 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.687 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.687 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.688 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.981641+0000", 2023-09-30T17:04:28.688 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0900000000000002e-07 2023-09-30T17:04:28.688 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.688 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.688 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.688 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.981652+0000", 2023-09-30T17:04:28.688 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0958000000000001e-05 2023-09-30T17:04:28.688 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.688 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.688 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.688 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.981659+0000", 2023-09-30T17:04:28.689 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1210000000000001e-06 2023-09-30T17:04:28.689 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.689 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.689 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.981665+0000", 2023-09-30T17:04:28.689 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0480000000000004e-06 2023-09-30T17:04:28.689 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.689 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.689 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.689 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.689 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152560 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.690 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.103751+0000", 2023-09-30T17:04:28.690 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.22203023799999999, 2023-09-30T17:04:28.690 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.23931335200000001, 2023-09-30T17:04:28.690 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.690 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.690 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.690 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.690 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.690 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152560 2023-09-30T17:04:28.690 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.690 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.691 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.691 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.691 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.103751+0000", 2023-09-30T17:04:28.691 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.691 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.691 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.691 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.691 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.103751+0000", 2023-09-30T17:04:28.691 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.691 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.691 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.692 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.692 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.107539+0000", 2023-09-30T17:04:28.692 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003787257 2023-09-30T17:04:28.692 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.692 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.692 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.692 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.107551+0000", 2023-09-30T17:04:28.692 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2636999999999999e-05 2023-09-30T17:04:28.692 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.692 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.692 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.693 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.107560+0000", 2023-09-30T17:04:28.693 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6889999999999993e-06 2023-09-30T17:04:28.693 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.693 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.693 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.693 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.107567+0000", 2023-09-30T17:04:28.693 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7619999999999998e-06 2023-09-30T17:04:28.693 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.693 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.693 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.693 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.694 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.694 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152774 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.694 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.204569+0000", 2023-09-30T17:04:28.694 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.12121228100000001, 2023-09-30T17:04:28.694 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.13854668000000001, 2023-09-30T17:04:28.694 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.694 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.694 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.694 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.694 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.694 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152774 2023-09-30T17:04:28.694 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.695 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.695 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.695 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.695 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.204569+0000", 2023-09-30T17:04:28.695 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.695 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.695 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.695 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.695 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.204569+0000", 2023-09-30T17:04:28.695 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.696 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.696 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.696 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.696 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.204570+0000", 2023-09-30T17:04:28.696 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0800000000000004e-07 2023-09-30T17:04:28.696 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.696 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.696 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.696 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.204584+0000", 2023-09-30T17:04:28.696 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.401e-05 2023-09-30T17:04:28.696 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.697 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.697 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.697 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.204591+0000", 2023-09-30T17:04:28.697 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2899999999999997e-06 2023-09-30T17:04:28.697 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.697 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.697 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.697 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.204597+0000", 2023-09-30T17:04:28.697 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.772e-06 2023-09-30T17:04:28.697 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.697 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.698 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.698 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.698 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.698 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152815 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.698 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.224560+0000", 2023-09-30T17:04:28.698 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.101221725, 2023-09-30T17:04:28.698 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.118609807, 2023-09-30T17:04:28.698 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.698 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.698 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.698 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.699 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.699 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152815 2023-09-30T17:04:28.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.699 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.699 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.699 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.224560+0000", 2023-09-30T17:04:28.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.699 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.700 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.224560+0000", 2023-09-30T17:04:28.700 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.700 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.700 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.700 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.700 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.224560+0000", 2023-09-30T17:04:28.700 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5200000000000002e-07 2023-09-30T17:04:28.700 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.700 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.700 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.700 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.224573+0000", 2023-09-30T17:04:28.701 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2707e-05 2023-09-30T17:04:28.701 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.701 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.701 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.701 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.224580+0000", 2023-09-30T17:04:28.701 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0330000000000003e-06 2023-09-30T17:04:28.701 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.701 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.701 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.701 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.224585+0000", 2023-09-30T17:04:28.701 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9490000000000004e-06 2023-09-30T17:04:28.702 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.702 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.702 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.702 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.702 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.702 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:153035 4.23 4:c6f90462:::100000001f8.00000037:head [write 1503232~4096 in=4096b,write 1798144~4096 in=4096b,write 1822720~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.702 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.335603+0000", 2023-09-30T17:04:28.702 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9901786, 2023-09-30T17:04:28.702 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0076250479999999997, 2023-09-30T17:04:28.702 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.703 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:28.703 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.703 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.703 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.703 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 153035 2023-09-30T17:04:28.703 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.703 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.703 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.704 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.704 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.335603+0000", 2023-09-30T17:04:28.704 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.704 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.704 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.704 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.704 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.335603+0000", 2023-09-30T17:04:28.705 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.705 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.705 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.705 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.705 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.335603+0000", 2023-09-30T17:04:28.705 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3599999999999999e-07 2023-09-30T17:04:28.705 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.705 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.705 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.705 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.335617+0000", 2023-09-30T17:04:28.705 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3794e-05 2023-09-30T17:04:28.706 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.706 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.706 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.706 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.335625+0000", 2023-09-30T17:04:28.706 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8129999999999996e-06 2023-09-30T17:04:28.706 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.706 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.706 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.706 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.335632+0000", 2023-09-30T17:04:28.706 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5560000000000004e-06 2023-09-30T17:04:28.706 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.707 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.707 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:28.707 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.338000+0000", 2023-09-30T17:04:28.707 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0023681510000000002 2023-09-30T17:04:28.707 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.707 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.707 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:28.707 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.338066+0000", 2023-09-30T17:04:28.707 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6668999999999995e-05 2023-09-30T17:04:28.707 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.707 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.708 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:28.708 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.338202+0000", 2023-09-30T17:04:28.708 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000135902 2023-09-30T17:04:28.708 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.708 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.708 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.708 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.708 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.708 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151491 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.708 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.689582+0000", 2023-09-30T17:04:28.708 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.63619953500000004, 2023-09-30T17:04:28.708 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.65371707599999995, 2023-09-30T17:04:28.709 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.709 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.709 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.709 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.709 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.709 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151491 2023-09-30T17:04:28.709 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.709 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.709 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.709 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.709 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.689582+0000", 2023-09-30T17:04:28.710 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.710 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.710 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.710 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.710 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.689582+0000", 2023-09-30T17:04:28.710 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.710 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.710 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.710 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.710 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.691935+0000", 2023-09-30T17:04:28.710 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0023531860000000002 2023-09-30T17:04:28.710 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.711 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.711 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.711 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.691962+0000", 2023-09-30T17:04:28.711 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6834000000000001e-05 2023-09-30T17:04:28.711 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.711 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.711 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.711 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.691970+0000", 2023-09-30T17:04:28.711 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0989999999999999e-06 2023-09-30T17:04:28.711 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.711 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.712 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.712 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.691978+0000", 2023-09-30T17:04:28.712 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0150000000000003e-06 2023-09-30T17:04:28.712 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.712 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.712 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.712 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.712 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.712 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151540 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.712 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.702768+0000", 2023-09-30T17:04:28.712 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.62301366499999999, 2023-09-30T17:04:28.712 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.64058948800000004, 2023-09-30T17:04:28.713 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.713 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.713 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.713 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.713 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.713 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151540 2023-09-30T17:04:28.713 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.713 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.713 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.713 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.713 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.702768+0000", 2023-09-30T17:04:28.714 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.714 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.714 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.714 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.714 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.702768+0000", 2023-09-30T17:04:28.714 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.714 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.714 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.714 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.714 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.702768+0000", 2023-09-30T17:04:28.714 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8500000000000002e-07 2023-09-30T17:04:28.715 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.715 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.715 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.715 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.702791+0000", 2023-09-30T17:04:28.715 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2478000000000001e-05 2023-09-30T17:04:28.715 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.715 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.715 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.715 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.702799+0000", 2023-09-30T17:04:28.715 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5920000000000001e-06 2023-09-30T17:04:28.715 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.715 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.716 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.716 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.702805+0000", 2023-09-30T17:04:28.716 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5690000000000004e-06 2023-09-30T17:04:28.716 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.716 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.716 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.716 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.716 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.716 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152182 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.716 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.954553+0000", 2023-09-30T17:04:28.716 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.37122829099999999, 2023-09-30T17:04:28.717 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.38886634199999998, 2023-09-30T17:04:28.717 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.717 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.717 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.717 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.717 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.717 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152182 2023-09-30T17:04:28.717 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.717 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.717 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.717 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.718 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.954553+0000", 2023-09-30T17:04:28.718 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.718 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.718 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.718 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.718 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.954553+0000", 2023-09-30T17:04:28.718 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.718 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.718 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.718 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.718 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.954554+0000", 2023-09-30T17:04:28.718 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3599999999999999e-07 2023-09-30T17:04:28.719 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.719 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.719 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.719 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.954564+0000", 2023-09-30T17:04:28.719 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0199e-05 2023-09-30T17:04:28.719 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.719 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.719 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.719 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.954570+0000", 2023-09-30T17:04:28.719 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4609999999999996e-06 2023-09-30T17:04:28.719 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.720 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.720 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.720 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.954574+0000", 2023-09-30T17:04:28.720 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.569e-06 2023-09-30T17:04:28.720 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.720 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.720 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.720 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.720 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.720 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152408 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.720 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.040822+0000", 2023-09-30T17:04:28.720 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.28495938300000001, 2023-09-30T17:04:28.721 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.30265654199999997, 2023-09-30T17:04:28.721 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.721 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.721 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.721 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.721 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.721 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152408 2023-09-30T17:04:28.721 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.721 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.721 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.721 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.721 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.040822+0000", 2023-09-30T17:04:28.722 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.722 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.722 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.722 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.722 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.040822+0000", 2023-09-30T17:04:28.722 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.722 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.722 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.722 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.722 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.043769+0000", 2023-09-30T17:04:28.722 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0029466259999999999 2023-09-30T17:04:28.723 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.723 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.723 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.723 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.043781+0000", 2023-09-30T17:04:28.723 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.261e-05 2023-09-30T17:04:28.723 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.723 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.723 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.723 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.043786+0000", 2023-09-30T17:04:28.723 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1290000000000004e-06 2023-09-30T17:04:28.723 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.723 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.724 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.724 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.043790+0000", 2023-09-30T17:04:28.724 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.377e-06 2023-09-30T17:04:28.724 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.724 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.724 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.724 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.724 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.724 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152532 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.724 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.093177+0000", 2023-09-30T17:04:28.724 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.232604319, 2023-09-30T17:04:28.725 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.25037254599999997, 2023-09-30T17:04:28.725 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.725 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.725 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.725 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.725 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.725 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152532 2023-09-30T17:04:28.725 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.725 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.725 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.725 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.725 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.093177+0000", 2023-09-30T17:04:28.726 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.726 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.726 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.726 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.726 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.093177+0000", 2023-09-30T17:04:28.726 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.726 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.726 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.726 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.726 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.093177+0000", 2023-09-30T17:04:28.726 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4200000000000002e-07 2023-09-30T17:04:28.727 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.727 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.727 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.727 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.093187+0000", 2023-09-30T17:04:28.727 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0009e-05 2023-09-30T17:04:28.727 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.727 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.727 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.727 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.093191+0000", 2023-09-30T17:04:28.727 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5080000000000001e-06 2023-09-30T17:04:28.727 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.727 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.728 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.728 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.093194+0000", 2023-09-30T17:04:28.728 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.033e-06 2023-09-30T17:04:28.728 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.728 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.728 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.728 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.728 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.728 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:151857 4.6 e55/17)", 2023-09-30T17:04:28.728 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.245974+0000", 2023-09-30T17:04:28.728 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.079807822, 2023-09-30T17:04:28.728 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.097635848999999997, 2023-09-30T17:04:28.729 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.729 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.729 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.729 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.729 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.729 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.245974+0000", 2023-09-30T17:04:28.729 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.729 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.729 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.729 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.729 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.245974+0000", 2023-09-30T17:04:28.730 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.730 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.730 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.730 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.730 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.245975+0000", 2023-09-30T17:04:28.730 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8899999999999998e-07 2023-09-30T17:04:28.730 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.730 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.730 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.730 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.245988+0000", 2023-09-30T17:04:28.730 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3930999999999999e-05 2023-09-30T17:04:28.731 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.731 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.731 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.731 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.245997+0000", 2023-09-30T17:04:28.731 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4710000000000007e-06 2023-09-30T17:04:28.731 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.731 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.731 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.731 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.246002+0000", 2023-09-30T17:04:28.731 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4269999999999999e-06 2023-09-30T17:04:28.731 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.731 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.732 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.732 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.732 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.732 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:151993 4.36 e55/17)", 2023-09-30T17:04:28.732 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.279582+0000", 2023-09-30T17:04:28.732 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.046199072000000001, 2023-09-30T17:04:28.732 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.064086821000000002, 2023-09-30T17:04:28.732 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.732 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.732 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.732 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.733 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.733 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.279582+0000", 2023-09-30T17:04:28.733 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.733 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.733 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.733 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.733 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.279582+0000", 2023-09-30T17:04:28.733 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.733 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.733 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.733 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.733 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.279584+0000", 2023-09-30T17:04:28.734 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.083e-06 2023-09-30T17:04:28.734 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.734 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.734 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.734 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.279602+0000", 2023-09-30T17:04:28.734 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8966000000000001e-05 2023-09-30T17:04:28.734 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.734 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.734 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.734 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.279613+0000", 2023-09-30T17:04:28.734 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0682999999999999e-05 2023-09-30T17:04:28.735 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.735 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.735 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.735 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.279623+0000", 2023-09-30T17:04:28.735 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6399999999999992e-06 2023-09-30T17:04:28.735 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.735 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.735 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.735 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.735 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.735 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:152055 4.6 e55/17)", 2023-09-30T17:04:28.736 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.309043+0000", 2023-09-30T17:04:28.736 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.016738506, 2023-09-30T17:04:28.736 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.034678692999999997, 2023-09-30T17:04:28.736 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.736 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.736 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.736 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.736 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.736 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.309043+0000", 2023-09-30T17:04:28.736 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.736 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.736 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.737 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.737 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.309043+0000", 2023-09-30T17:04:28.737 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.737 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.737 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.737 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.737 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.309043+0000", 2023-09-30T17:04:28.737 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9999999999999999e-07 2023-09-30T17:04:28.737 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.737 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.737 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.738 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.309052+0000", 2023-09-30T17:04:28.738 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6810000000000004e-06 2023-09-30T17:04:28.738 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.738 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.738 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.738 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.309060+0000", 2023-09-30T17:04:28.738 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1920000000000005e-06 2023-09-30T17:04:28.738 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.738 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.738 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.738 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.309064+0000", 2023-09-30T17:04:28.738 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3379999999999998e-06 2023-09-30T17:04:28.739 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.739 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.739 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.739 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.739 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.739 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:153209 4.19 e55/17 4:9a4319fb:::100000001f8.0000002a:head v 55'4795, mlcod=55'4792)", 2023-09-30T17:04:28.739 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.321242+0000", 2023-09-30T17:04:28.739 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0045398180000000002, 2023-09-30T17:04:28.739 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022535184999999999, 2023-09-30T17:04:28.739 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.739 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:28.740 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.740 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.740 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.740 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.321242+0000", 2023-09-30T17:04:28.740 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.740 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.740 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.740 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.740 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.321242+0000", 2023-09-30T17:04:28.740 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.741 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.741 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.741 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.741 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.321242+0000", 2023-09-30T17:04:28.741 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4799999999999997e-07 2023-09-30T17:04:28.741 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.741 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.741 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.741 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.321263+0000", 2023-09-30T17:04:28.741 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0893000000000001e-05 2023-09-30T17:04:28.741 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.741 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.742 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.742 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.321279+0000", 2023-09-30T17:04:28.742 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5636000000000001e-05 2023-09-30T17:04:28.742 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.742 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.742 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.742 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.321288+0000", 2023-09-30T17:04:28.742 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2949999999999999e-06 2023-09-30T17:04:28.742 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.742 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.742 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:28.743 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.321624+0000", 2023-09-30T17:04:28.743 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00033590900000000001 2023-09-30T17:04:28.743 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.743 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.743 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:28.743 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.321644+0000", 2023-09-30T17:04:28.743 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9669000000000001e-05 2023-09-30T17:04:28.743 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.743 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.743 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.743 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.743 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.744 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:153232 4.28 e55/17 4:15eeb89b:::100000001f8.00000032:head v 55'4707, mlcod=55'4704)", 2023-09-30T17:04:28.744 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.336406+0000", 2023-09-30T17:04:28.744 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9893756, 2023-09-30T17:04:28.744 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0074489639999999998, 2023-09-30T17:04:28.744 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.744 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:28.744 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.744 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.744 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.336406+0000", 2023-09-30T17:04:28.744 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.745 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.745 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.745 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.745 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.336406+0000", 2023-09-30T17:04:28.745 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.745 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.745 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.745 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.745 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.336407+0000", 2023-09-30T17:04:28.745 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4600000000000004e-07 2023-09-30T17:04:28.745 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.745 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.746 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.746 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.336424+0000", 2023-09-30T17:04:28.746 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7197000000000002e-05 2023-09-30T17:04:28.746 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.746 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.746 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.746 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.336433+0000", 2023-09-30T17:04:28.746 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6740000000000003e-06 2023-09-30T17:04:28.746 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.746 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.746 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.747 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.336439+0000", 2023-09-30T17:04:28.747 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8199999999999999e-06 2023-09-30T17:04:28.747 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.747 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.747 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:28.747 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.336477+0000", 2023-09-30T17:04:28.747 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7625e-05 2023-09-30T17:04:28.747 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.747 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.747 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:28.748 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.336489+0000", 2023-09-30T17:04:28.748 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2388999999999999e-05 2023-09-30T17:04:28.748 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.748 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.748 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.748 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.748 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.748 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151437 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.748 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.665841+0000", 2023-09-30T17:04:28.748 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.659940886, 2023-09-30T17:04:28.748 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.67808280499999996, 2023-09-30T17:04:28.749 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.749 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.749 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.749 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.749 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.749 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151437 2023-09-30T17:04:28.749 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.749 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.749 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.749 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.749 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.665841+0000", 2023-09-30T17:04:28.750 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.750 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.750 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.750 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.750 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.665841+0000", 2023-09-30T17:04:28.750 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.750 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.750 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.750 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.750 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.665841+0000", 2023-09-30T17:04:28.750 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5400000000000002e-07 2023-09-30T17:04:28.751 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.751 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.751 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.751 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.665864+0000", 2023-09-30T17:04:28.751 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2707000000000001e-05 2023-09-30T17:04:28.751 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.751 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.751 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.751 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.665870+0000", 2023-09-30T17:04:28.751 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6239999999999996e-06 2023-09-30T17:04:28.751 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.752 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.752 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.752 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.665876+0000", 2023-09-30T17:04:28.752 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4099999999999999e-06 2023-09-30T17:04:28.752 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.752 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.752 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.752 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.752 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.752 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:151492 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.752 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.691988+0000", 2023-09-30T17:04:28.752 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.63379338500000004, 2023-09-30T17:04:28.753 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.65200147399999997, 2023-09-30T17:04:28.753 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.753 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.753 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.753 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.753 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.753 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 151492 2023-09-30T17:04:28.753 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.753 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.753 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.753 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.754 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.691988+0000", 2023-09-30T17:04:28.754 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.754 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.754 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.754 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.754 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.691988+0000", 2023-09-30T17:04:28.754 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.754 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.754 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.754 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.754 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.694594+0000", 2023-09-30T17:04:28.754 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0026061529999999999 2023-09-30T17:04:28.755 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.755 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.755 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.755 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.694632+0000", 2023-09-30T17:04:28.755 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7982000000000003e-05 2023-09-30T17:04:28.755 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.755 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.755 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.755 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.694643+0000", 2023-09-30T17:04:28.755 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0898e-05 2023-09-30T17:04:28.755 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.756 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.756 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.756 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.694652+0000", 2023-09-30T17:04:28.756 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7309999999999999e-06 2023-09-30T17:04:28.756 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.756 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.756 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.756 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.756 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.756 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152150 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.756 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.943813+0000", 2023-09-30T17:04:28.756 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.38196857899999997, 2023-09-30T17:04:28.757 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.400239609, 2023-09-30T17:04:28.757 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.757 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.757 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.757 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.757 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.757 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152150 2023-09-30T17:04:28.757 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.757 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.757 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.757 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.757 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.943813+0000", 2023-09-30T17:04:28.758 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.758 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.758 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.758 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.758 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.943813+0000", 2023-09-30T17:04:28.758 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.758 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.758 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.758 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.758 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.943813+0000", 2023-09-30T17:04:28.758 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.08e-07 2023-09-30T17:04:28.810 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.810 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.810 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.810 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.943825+0000", 2023-09-30T17:04:28.810 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1367e-05 2023-09-30T17:04:28.810 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.810 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.810 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.810 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.943830+0000", 2023-09-30T17:04:28.811 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6330000000000001e-06 2023-09-30T17:04:28.811 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.811 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.811 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.811 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.943835+0000", 2023-09-30T17:04:28.811 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5959999999999997e-06 2023-09-30T17:04:28.811 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.811 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.811 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.811 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.811 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.812 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152185 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.812 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:25.954581+0000", 2023-09-30T17:04:28.812 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.37120038900000002, 2023-09-30T17:04:28.812 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.38953606699999999, 2023-09-30T17:04:28.812 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.812 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.812 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.812 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.812 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.812 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152185 2023-09-30T17:04:28.812 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.812 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.813 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.813 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.954581+0000", 2023-09-30T17:04:28.813 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.813 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.813 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.813 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.954581+0000", 2023-09-30T17:04:28.813 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.813 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.814 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.814 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.957550+0000", 2023-09-30T17:04:28.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0029687519999999998 2023-09-30T17:04:28.814 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.814 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.814 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.814 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.957569+0000", 2023-09-30T17:04:28.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9049999999999999e-05 2023-09-30T17:04:28.814 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.814 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.815 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.815 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.957582+0000", 2023-09-30T17:04:28.815 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3098999999999999e-05 2023-09-30T17:04:28.815 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.815 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.815 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.815 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:25.957590+0000", 2023-09-30T17:04:28.815 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3729999999999993e-06 2023-09-30T17:04:28.815 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.815 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.815 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.816 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.816 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.816 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152613 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.816 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.119678+0000", 2023-09-30T17:04:28.816 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.20610382399999999, 2023-09-30T17:04:28.816 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.22448192, 2023-09-30T17:04:28.816 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.816 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.816 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.816 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.817 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.817 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152613 2023-09-30T17:04:28.817 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.817 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.817 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.817 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.817 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.119678+0000", 2023-09-30T17:04:28.817 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.817 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.818 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.818 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.818 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.119678+0000", 2023-09-30T17:04:28.818 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.818 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.818 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.818 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.818 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.119678+0000", 2023-09-30T17:04:28.818 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.27e-07 2023-09-30T17:04:28.818 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.818 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.819 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.819 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.119689+0000", 2023-09-30T17:04:28.819 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1291000000000001e-05 2023-09-30T17:04:28.819 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.819 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.819 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.819 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.119696+0000", 2023-09-30T17:04:28.819 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3539999999999996e-06 2023-09-30T17:04:28.819 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.819 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.820 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.820 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.119702+0000", 2023-09-30T17:04:28.820 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8540000000000002e-06 2023-09-30T17:04:28.820 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.820 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.820 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.820 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.820 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.820 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:152649 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:28.820 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.130713+0000", 2023-09-30T17:04:28.820 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.19506881700000001, 2023-09-30T17:04:28.821 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.21348294000000001, 2023-09-30T17:04:28.821 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.821 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.821 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:28.821 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:28.821 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:28.821 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 152649 2023-09-30T17:04:28.821 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.821 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.821 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.821 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.821 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.130713+0000", 2023-09-30T17:04:28.822 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.822 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.822 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.822 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.822 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.130713+0000", 2023-09-30T17:04:28.822 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.822 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.822 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.822 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.822 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.132516+0000", 2023-09-30T17:04:28.822 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001803771 2023-09-30T17:04:28.823 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.823 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.823 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.823 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.132535+0000", 2023-09-30T17:04:28.823 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8457e-05 2023-09-30T17:04:28.823 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.823 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.823 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.823 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.132546+0000", 2023-09-30T17:04:28.823 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1201e-05 2023-09-30T17:04:28.824 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.824 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.824 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.824 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.132553+0000", 2023-09-30T17:04:28.824 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3669999999999999e-06 2023-09-30T17:04:28.824 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.824 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.824 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.824 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.824 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.824 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:151830 4.6 e55/17)", 2023-09-30T17:04:28.825 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.226559+0000", 2023-09-30T17:04:28.825 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.099222618999999998, 2023-09-30T17:04:28.825 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.117670236, 2023-09-30T17:04:28.825 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.825 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.825 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.825 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.825 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.226559+0000", 2023-09-30T17:04:28.825 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.825 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.826 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.826 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.826 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.226559+0000", 2023-09-30T17:04:28.826 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.826 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.826 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.826 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.226560+0000", 2023-09-30T17:04:28.826 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8400000000000003e-07 2023-09-30T17:04:28.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.826 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.827 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.827 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.226573+0000", 2023-09-30T17:04:28.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3382e-05 2023-09-30T17:04:28.827 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.827 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.827 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.827 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.226583+0000", 2023-09-30T17:04:28.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0339999999999999e-05 2023-09-30T17:04:28.827 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.827 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.827 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.828 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.226591+0000", 2023-09-30T17:04:28.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1339999999999998e-06 2023-09-30T17:04:28.828 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.828 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.828 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.828 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.828 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.828 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:151928 4.6 e55/17)", 2023-09-30T17:04:28.828 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.263152+0000", 2023-09-30T17:04:28.828 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.062629460999999997, 2023-09-30T17:04:28.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.081105917999999999, 2023-09-30T17:04:28.828 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.829 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:28.829 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.829 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.829 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.263152+0000", 2023-09-30T17:04:28.829 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.829 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.829 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.829 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.263152+0000", 2023-09-30T17:04:28.829 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.830 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.830 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.830 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.263153+0000", 2023-09-30T17:04:28.854 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.85e-07 2023-09-30T17:04:28.854 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.854 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.854 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.854 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.263170+0000", 2023-09-30T17:04:28.855 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.702e-05 2023-09-30T17:04:28.855 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.855 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.855 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.855 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.263181+0000", 2023-09-30T17:04:28.855 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0769e-05 2023-09-30T17:04:28.855 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.855 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.855 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.855 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.263189+0000", 2023-09-30T17:04:28.855 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8290000000000008e-06 2023-09-30T17:04:28.856 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.856 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.856 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.856 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.856 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.856 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:153233 4.1c e55/17 4:39b842ef:::100000001f8.00000029:head v 55'2389, mlcod=55'2385)", 2023-09-30T17:04:28.856 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:26.336455+0000", 2023-09-30T17:04:28.856 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9893265, 2023-09-30T17:04:28.856 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0078330259999999999, 2023-09-30T17:04:28.856 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:28.856 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:28.856 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:28.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.857 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:28.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.336455+0000", 2023-09-30T17:04:28.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.857 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.857 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:28.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.336455+0000", 2023-09-30T17:04:28.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:28.857 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.858 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:28.858 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.336455+0000", 2023-09-30T17:04:28.858 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6600000000000002e-07 2023-09-30T17:04:28.858 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.858 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.858 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:28.858 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.336471+0000", 2023-09-30T17:04:28.858 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5809999999999999e-05 2023-09-30T17:04:28.858 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.858 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.858 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:28.859 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.336478+0000", 2023-09-30T17:04:28.859 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5699999999999998e-06 2023-09-30T17:04:28.859 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.859 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.859 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:28.859 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.336483+0000", 2023-09-30T17:04:28.859 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.446e-06 2023-09-30T17:04:28.859 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.859 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.859 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:28.859 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.336991+0000", 2023-09-30T17:04:28.859 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00050794399999999997 2023-09-30T17:04:28.860 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:28.860 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:28.860 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:28.860 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:26.337008+0000", 2023-09-30T17:04:28.860 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6818999999999999e-05 2023-09-30T17:04:28.860 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.860 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:28.860 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.860 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:28.860 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2023-09-30T17:04:28.860 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 317 2023-09-30T17:04:28.860 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:04:28.861 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:04:28.861 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:28.668+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:28.902 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:04:28.964 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:28.963+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:28.986 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:28.863+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:29.024 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:04:29.024 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-09-30T17:04:29.025 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-09-30T17:04:29.025 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:04:29.027 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:04:29.028 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:04:29.061 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:29.061 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:29.065 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:29.064+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:29.121 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:04:29.168 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:29.167+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:29.268 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:29.266+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:29.368 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:29.368+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:29.370 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:29.370 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:29.381 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:04:29.473 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:29.471+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:29.568 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~102s 2023-09-30T17:04:29.571 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:29.568+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:29.594 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:29.594 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:29.611 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:04:29.674 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:29.671+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:29.774 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:29.772+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:29.858 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:29.858 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:29.872 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:29.871+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:29.875 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:04:29.972 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:29.971+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:30.073 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:30.072+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:30.128 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:30.129 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:30.144 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:04:30.175 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:30.174+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:30.275 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:30.274+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:30.345 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:30.346 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:30.361 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:04:30.405 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:30.402+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:30.477 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:30.476+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:30.579 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:30.577+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:30.596 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:30.596 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:30.615 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:04:30.673 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-09-30T17:04:30.700 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:30.699+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:30.780 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:30.779+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:30.859 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:30.859 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:30.877 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:04:30.882 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:30.881+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:30.981 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:30.980+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:31.028 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-09-30T17:04:31.085 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:31.083+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:31.092 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:31.093 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:31.109 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:04:31.186 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:31.181+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:31.208 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:04:31.233 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:04:31.233 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-09-30T17:04:31.233 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-09-30T17:04:31.233 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:04:31.236 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:04:31.236 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:04:31.286 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:31.283+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:31.290 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is set 2023-09-30T17:04:31.317 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:04:31.317 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:04:31.317 INFO:teuthology.orchestra.run.smithi031.stdout: "complaint_time": 30, 2023-09-30T17:04:31.317 INFO:teuthology.orchestra.run.smithi031.stdout: "num_blocked_ops": 0 2023-09-30T17:04:31.318 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:04:31.335 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:04:31.384 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:31.383+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:31.484 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:31.484+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:31.548 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:04:31.548 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 20, 2023-09-30T17:04:31.548 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 600, 2023-09-30T17:04:31.548 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:04:31.548 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.548 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109497 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 49152~4096 in=4096b,write 106496~4096 in=4096b,write 163840~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:31.549 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.624224+0000", 2023-09-30T17:04:31.549 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 21.921717919999999, 2023-09-30T17:04:31.549 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.717345754, 2023-09-30T17:04:31.549 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:31.549 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:31.549 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:31.549 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:31.549 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:31.549 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109497 2023-09-30T17:04:31.550 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.550 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:31.550 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.550 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:31.550 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624224+0000", 2023-09-30T17:04:31.550 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:31.550 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.550 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.551 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:31.551 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624224+0000", 2023-09-30T17:04:31.551 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:31.551 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.551 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.551 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:31.551 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624224+0000", 2023-09-30T17:04:31.551 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9299999999999998e-07 2023-09-30T17:04:31.552 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.552 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.552 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:31.552 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624238+0000", 2023-09-30T17:04:31.552 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4144999999999999e-05 2023-09-30T17:04:31.552 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.552 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.552 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:31.552 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624439+0000", 2023-09-30T17:04:31.553 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00020105200000000001 2023-09-30T17:04:31.553 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.553 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.553 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:31.553 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624447+0000", 2023-09-30T17:04:31.553 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.0499999999999992e-06 2023-09-30T17:04:31.553 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.553 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.553 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:31.553 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.022040+0000", 2023-09-30T17:04:31.554 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39759262099999998 2023-09-30T17:04:31.554 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.554 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.554 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:31.554 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.022117+0000", 2023-09-30T17:04:31.554 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6834000000000003e-05 2023-09-30T17:04:31.554 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.554 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.555 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:31.555 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.022269+0000", 2023-09-30T17:04:31.555 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015254600000000001 2023-09-30T17:04:31.555 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.555 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.555 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:31.555 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.058505+0000", 2023-09-30T17:04:31.555 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.036235394999999997 2023-09-30T17:04:31.555 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.555 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.556 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:31.556 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.341470+0000", 2023-09-30T17:04:31.556 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.28296523600000001 2023-09-30T17:04:31.556 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.556 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.556 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:31.556 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.341530+0000", 2023-09-30T17:04:31.556 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9939000000000003e-05 2023-09-30T17:04:31.556 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.556 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.556 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:31.557 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.341569+0000", 2023-09-30T17:04:31.557 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9342999999999999e-05 2023-09-30T17:04:31.557 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:31.557 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:31.557 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:31.557 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.557 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.557 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109508 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 2650112~4096 in=4096b,write 2723840~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:31.558 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.624554+0000", 2023-09-30T17:04:31.558 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 21.921387284000001, 2023-09-30T17:04:31.558 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.717264546, 2023-09-30T17:04:31.558 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:31.558 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:31.558 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:31.558 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:31.559 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:31.559 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109508 2023-09-30T17:04:31.559 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.559 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:31.559 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.559 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:31.559 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624554+0000", 2023-09-30T17:04:31.559 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:31.559 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.559 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.560 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:31.560 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624554+0000", 2023-09-30T17:04:31.560 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:31.560 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.560 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.560 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:31.561 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624555+0000", 2023-09-30T17:04:31.561 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.51e-07 2023-09-30T17:04:31.561 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.561 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.561 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:31.561 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624573+0000", 2023-09-30T17:04:31.562 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8519e-05 2023-09-30T17:04:31.562 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.562 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.562 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:31.562 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624582+0000", 2023-09-30T17:04:31.562 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.6489999999999997e-06 2023-09-30T17:04:31.563 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.563 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.563 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:31.563 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.624588+0000", 2023-09-30T17:04:31.563 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4980000000000003e-06 2023-09-30T17:04:31.563 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.564 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.564 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:31.564 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.028302+0000", 2023-09-30T17:04:31.564 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.40371393 2023-09-30T17:04:31.564 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.565 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.565 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:31.565 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.028383+0000", 2023-09-30T17:04:31.565 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1069000000000006e-05 2023-09-30T17:04:31.565 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.565 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.565 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:31.565 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.028546+0000", 2023-09-30T17:04:31.565 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000162256 2023-09-30T17:04:31.565 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.565 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.565 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:31.566 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.058510+0000", 2023-09-30T17:04:31.566 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.029964937000000001 2023-09-30T17:04:31.566 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.566 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.566 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:31.566 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.341742+0000", 2023-09-30T17:04:31.566 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.28323117799999997 2023-09-30T17:04:31.566 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.566 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.566 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:31.566 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.341788+0000", 2023-09-30T17:04:31.567 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6118999999999997e-05 2023-09-30T17:04:31.567 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.567 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.567 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:31.567 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.341819+0000", 2023-09-30T17:04:31.567 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.0939999999999999e-05 2023-09-30T17:04:31.567 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:31.567 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:31.567 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:31.567 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.567 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.567 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109527 4.6 4:616d4c41:::100000001f8.00000034:head [write 122880~4096 in=4096b,write 143360~4096 in=4096b,write 151552~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:31.568 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.630262+0000", 2023-09-30T17:04:31.568 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 21.915679685000001, 2023-09-30T17:04:31.568 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.72988284299999995, 2023-09-30T17:04:31.568 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:31.568 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:31.568 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:31.568 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:31.568 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:31.568 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109527 2023-09-30T17:04:31.568 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.568 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:31.568 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.569 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:31.569 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.630262+0000", 2023-09-30T17:04:31.569 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:31.569 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.569 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.569 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:31.569 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.630262+0000", 2023-09-30T17:04:31.569 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:31.569 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.569 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.569 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:31.569 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.632170+0000", 2023-09-30T17:04:31.570 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0019085529999999999 2023-09-30T17:04:31.570 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.570 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.570 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:31.570 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.632192+0000", 2023-09-30T17:04:31.570 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1243999999999999e-05 2023-09-30T17:04:31.570 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.570 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.570 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:31.570 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.632203+0000", 2023-09-30T17:04:31.570 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1389999999999999e-05 2023-09-30T17:04:31.571 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.571 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.571 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:31.571 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.632211+0000", 2023-09-30T17:04:31.571 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8939999999999993e-06 2023-09-30T17:04:31.571 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.571 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.571 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:31.571 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.031203+0000", 2023-09-30T17:04:31.571 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39899208800000002 2023-09-30T17:04:31.571 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.571 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.572 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:31.572 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.031278+0000", 2023-09-30T17:04:31.572 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4988999999999996e-05 2023-09-30T17:04:31.572 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.572 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.572 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:31.572 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.031432+0000", 2023-09-30T17:04:31.572 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000154396 2023-09-30T17:04:31.572 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.572 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.572 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:31.573 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.058953+0000", 2023-09-30T17:04:31.573 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.027520464000000001 2023-09-30T17:04:31.573 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.573 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.573 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:31.573 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360042+0000", 2023-09-30T17:04:31.573 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.30108895699999999 2023-09-30T17:04:31.573 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.574 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.574 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:31.574 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360103+0000", 2023-09-30T17:04:31.574 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1364000000000004e-05 2023-09-30T17:04:31.574 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.574 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.574 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:31.574 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360145+0000", 2023-09-30T17:04:31.574 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1504000000000001e-05 2023-09-30T17:04:31.574 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:31.574 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:31.575 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:31.575 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.575 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.575 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109554 4.6 4:616d4c41:::100000001f8.00000034:head [write 1323008~4096 in=4096b,write 1675264~4096 in=4096b,write 1695744~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:31.575 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.646316+0000", 2023-09-30T17:04:31.575 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 21.899625369999999, 2023-09-30T17:04:31.575 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.71401674900000001, 2023-09-30T17:04:31.575 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:31.575 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:31.575 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:31.575 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:31.575 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:31.576 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109554 2023-09-30T17:04:31.576 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.576 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:31.576 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.576 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:31.576 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646316+0000", 2023-09-30T17:04:31.576 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:31.576 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.576 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.577 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:31.577 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646316+0000", 2023-09-30T17:04:31.577 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:31.577 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.577 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.577 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:31.577 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646317+0000", 2023-09-30T17:04:31.577 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9100000000000004e-07 2023-09-30T17:04:31.577 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.577 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.578 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:31.578 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646328+0000", 2023-09-30T17:04:31.578 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1832e-05 2023-09-30T17:04:31.578 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.578 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.578 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:31.578 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646335+0000", 2023-09-30T17:04:31.578 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.7299999999999999e-06 2023-09-30T17:04:31.578 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.578 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.579 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:31.579 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.646342+0000", 2023-09-30T17:04:31.579 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5309999999999998e-06 2023-09-30T17:04:31.579 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.579 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.579 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:31.579 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.033952+0000", 2023-09-30T17:04:31.579 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.38760991099999997 2023-09-30T17:04:31.579 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.580 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.580 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:31.580 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.034037+0000", 2023-09-30T17:04:31.580 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5483999999999997e-05 2023-09-30T17:04:31.580 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.580 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.580 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:31.581 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.034208+0000", 2023-09-30T17:04:31.581 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000170946 2023-09-30T17:04:31.581 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.581 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.581 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:31.581 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.058968+0000", 2023-09-30T17:04:31.581 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.024760305 2023-09-30T17:04:31.582 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.582 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.582 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:31.582 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360244+0000", 2023-09-30T17:04:31.582 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.30127521699999998 2023-09-30T17:04:31.582 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.582 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.582 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:31.582 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360292+0000", 2023-09-30T17:04:31.582 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8689000000000001e-05 2023-09-30T17:04:31.582 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.583 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.583 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:31.583 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360333+0000", 2023-09-30T17:04:31.583 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0612999999999999e-05 2023-09-30T17:04:31.583 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:31.583 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:31.583 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:31.583 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.583 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.583 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109562 4.6 4:616d4c41:::100000001f8.00000034:head [write 4071424~4096 in=4096b,write 4161536~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:31.583 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.650213+0000", 2023-09-30T17:04:31.583 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 21.895728213000002, 2023-09-30T17:04:31.584 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.71023619199999999, 2023-09-30T17:04:31.584 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:31.584 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:31.584 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:31.584 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:31.584 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:31.584 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109562 2023-09-30T17:04:31.584 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.584 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:31.584 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.584 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:31.584 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.650213+0000", 2023-09-30T17:04:31.585 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:31.585 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.585 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.585 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:31.585 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.650213+0000", 2023-09-30T17:04:31.585 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:31.585 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.585 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.585 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:31.585 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.650214+0000", 2023-09-30T17:04:31.585 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1200000000000003e-07 2023-09-30T17:04:31.585 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.586 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.586 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:31.586 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.650227+0000", 2023-09-30T17:04:31.586 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.287e-05 2023-09-30T17:04:31.586 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.586 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.586 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:31.586 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.650235+0000", 2023-09-30T17:04:31.586 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8189999999999992e-06 2023-09-30T17:04:31.586 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.586 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.586 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:31.587 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.650241+0000", 2023-09-30T17:04:31.587 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3749999999999999e-06 2023-09-30T17:04:31.587 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.587 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.587 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:31.587 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.042530+0000", 2023-09-30T17:04:31.587 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39228892399999998 2023-09-30T17:04:31.587 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.587 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.587 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:31.587 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.042619+0000", 2023-09-30T17:04:31.588 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8838999999999994e-05 2023-09-30T17:04:31.588 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.588 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.588 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:31.588 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.042773+0000", 2023-09-30T17:04:31.588 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000154456 2023-09-30T17:04:31.588 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.588 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.588 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:31.588 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.059137+0000", 2023-09-30T17:04:31.588 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.016363800000000001 2023-09-30T17:04:31.588 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.589 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.589 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:31.589 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360385+0000", 2023-09-30T17:04:31.589 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.30124847199999999 2023-09-30T17:04:31.589 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.589 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.589 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:31.589 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360418+0000", 2023-09-30T17:04:31.589 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.2688000000000003e-05 2023-09-30T17:04:31.589 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.589 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.590 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:31.590 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.360449+0000", 2023-09-30T17:04:31.590 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.1337000000000002e-05 2023-09-30T17:04:31.590 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:31.590 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:31.590 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:31.590 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.590 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.590 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109582 4.6 4:616d4c41:::100000001f8.00000034:head [write 32768~4096 in=4096b,write 90112~4096 in=4096b,write 180224~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:31.590 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.654253+0000", 2023-09-30T17:04:31.590 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 21.891688123000002, 2023-09-30T17:04:31.590 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.71919376800000001, 2023-09-30T17:04:31.591 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:31.591 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:31.591 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:31.591 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:31.591 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:31.591 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109582 2023-09-30T17:04:31.591 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.591 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:31.591 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.591 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:31.591 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.654253+0000", 2023-09-30T17:04:31.592 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:31.592 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.592 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.592 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:31.592 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.654253+0000", 2023-09-30T17:04:31.592 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:31.592 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.592 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.592 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:31.592 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658162+0000", 2023-09-30T17:04:31.592 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0039091320000000001 2023-09-30T17:04:31.592 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.593 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.593 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:31.593 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658178+0000", 2023-09-30T17:04:31.593 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5719e-05 2023-09-30T17:04:31.593 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.593 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.593 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:31.593 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658189+0000", 2023-09-30T17:04:31.593 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1043000000000001e-05 2023-09-30T17:04:31.593 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.593 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.594 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:31.594 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658198+0000", 2023-09-30T17:04:31.594 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4090000000000003e-06 2023-09-30T17:04:31.594 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.594 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.594 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:31.594 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051307+0000", 2023-09-30T17:04:31.594 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39310928899999997 2023-09-30T17:04:31.594 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.594 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.595 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:31.595 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051392+0000", 2023-09-30T17:04:31.595 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4850000000000002e-05 2023-09-30T17:04:31.595 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.595 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.595 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:31.595 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.051575+0000", 2023-09-30T17:04:31.595 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00018296999999999999 2023-09-30T17:04:31.595 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.595 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.595 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:31.595 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.076797+0000", 2023-09-30T17:04:31.596 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.025222616999999999 2023-09-30T17:04:31.596 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.596 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.596 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:31.596 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.373335+0000", 2023-09-30T17:04:31.596 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.29653762299999997 2023-09-30T17:04:31.596 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.596 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.596 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:31.596 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.373404+0000", 2023-09-30T17:04:31.596 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8633999999999994e-05 2023-09-30T17:04:31.596 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.597 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.597 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:31.597 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.373447+0000", 2023-09-30T17:04:31.597 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3482000000000001e-05 2023-09-30T17:04:31.597 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:31.597 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:31.597 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:31.597 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.597 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.597 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:109583 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 1945600~8192 in=8192b,write 2285568~4096 in=4096b,write 2301952~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e51)", 2023-09-30T17:04:31.597 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:09.658212+0000", 2023-09-30T17:04:31.597 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 21.887729448999998, 2023-09-30T17:04:31.598 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.71553887199999999, 2023-09-30T17:04:31.598 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:31.598 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:31.598 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:31.598 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:31.598 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:31.598 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 109583 2023-09-30T17:04:31.598 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.598 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:31.599 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.599 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:31.599 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658212+0000", 2023-09-30T17:04:31.599 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:31.599 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.599 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.599 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:31.599 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658212+0000", 2023-09-30T17:04:31.599 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:31.599 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.600 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.600 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:31.600 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658213+0000", 2023-09-30T17:04:31.600 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6000000000000004e-07 2023-09-30T17:04:31.600 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.600 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.600 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:31.600 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658225+0000", 2023-09-30T17:04:31.600 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2887e-05 2023-09-30T17:04:31.600 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.600 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.601 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:31.601 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658233+0000", 2023-09-30T17:04:31.601 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2620000000000001e-06 2023-09-30T17:04:31.601 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.601 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.601 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:31.601 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:09.658239+0000", 2023-09-30T17:04:31.601 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4300000000000003e-06 2023-09-30T17:04:31.601 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.601 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.601 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:31.601 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.055877+0000", 2023-09-30T17:04:31.602 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.39763770799999998 2023-09-30T17:04:31.602 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.602 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.602 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:31.602 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.055965+0000", 2023-09-30T17:04:31.602 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8125000000000001e-05 2023-09-30T17:04:31.602 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.602 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.602 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:31.602 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.056131+0000", 2023-09-30T17:04:31.602 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000165971 2023-09-30T17:04:31.602 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.603 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.603 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:31.603 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.077434+0000", 2023-09-30T17:04:31.603 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.021303441999999999 2023-09-30T17:04:31.603 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.603 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.603 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:31.603 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.373658+0000", 2023-09-30T17:04:31.603 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.29622356300000002 2023-09-30T17:04:31.603 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.603 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.604 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:31.604 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.373716+0000", 2023-09-30T17:04:31.604 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8161000000000001e-05 2023-09-30T17:04:31.604 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.604 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.604 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:31.604 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:10.373751+0000", 2023-09-30T17:04:31.604 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4762999999999999e-05 2023-09-30T17:04:31.604 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:31.604 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:31.604 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:31.604 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.605 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.605 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:141180 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 3731456~4096,write 3870720~4096,write 3878912~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:31.605 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:21.530290+0000", 2023-09-30T17:04:31.605 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 10.015651091000001, 2023-09-30T17:04:31.605 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.71324517200000004, 2023-09-30T17:04:31.605 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:31.605 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:31.605 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:31.605 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:31.605 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:31.605 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 141180 2023-09-30T17:04:31.606 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.606 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:31.606 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.606 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:31.606 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.530290+0000", 2023-09-30T17:04:31.606 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:31.606 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.606 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.606 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:31.606 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.530290+0000", 2023-09-30T17:04:31.606 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:31.606 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.607 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.607 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:31.607 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.532163+0000", 2023-09-30T17:04:31.607 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0018726050000000001 2023-09-30T17:04:31.607 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.607 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.607 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:31.607 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.532178+0000", 2023-09-30T17:04:31.607 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5318000000000001e-05 2023-09-30T17:04:31.607 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.607 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.607 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:31.608 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.532187+0000", 2023-09-30T17:04:31.608 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8370000000000003e-06 2023-09-30T17:04:31.608 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.608 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.608 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:31.608 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.532192+0000", 2023-09-30T17:04:31.608 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2499999999999997e-06 2023-09-30T17:04:31.608 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.608 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.608 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:31.608 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.974315+0000", 2023-09-30T17:04:31.608 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.442122923 2023-09-30T17:04:31.609 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.609 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.609 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:31.609 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.974378+0000", 2023-09-30T17:04:31.609 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.2890000000000003e-05 2023-09-30T17:04:31.609 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.609 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.609 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:31.609 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.974477+0000", 2023-09-30T17:04:31.609 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.8448000000000003e-05 2023-09-30T17:04:31.609 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.610 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.610 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:31.610 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.997333+0000", 2023-09-30T17:04:31.610 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.022856383000000001 2023-09-30T17:04:31.610 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.610 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.610 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:31.610 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.243461+0000", 2023-09-30T17:04:31.610 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.24612841699999999 2023-09-30T17:04:31.610 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.610 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.610 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:31.611 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.243511+0000", 2023-09-30T17:04:31.611 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9719999999999998e-05 2023-09-30T17:04:31.611 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.611 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.611 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:31.611 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.243536+0000", 2023-09-30T17:04:31.611 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4380999999999999e-05 2023-09-30T17:04:31.611 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:31.611 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:31.611 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:31.611 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.612 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.612 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:141198 4.36 4:6da220e6:::100000001f8.0000003f:head [write 2576384~4096,write 2854912~4096,write 2985984~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:31.612 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:21.538523+0000", 2023-09-30T17:04:31.612 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 10.007418093, 2023-09-30T17:04:31.612 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.71183603399999995, 2023-09-30T17:04:31.612 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:31.612 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:31.612 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:31.612 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:31.612 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:31.612 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 141198 2023-09-30T17:04:31.613 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.613 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:31.613 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.613 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:31.613 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538523+0000", 2023-09-30T17:04:31.613 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:31.613 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.613 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.613 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:31.613 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538523+0000", 2023-09-30T17:04:31.613 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:31.613 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.614 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.614 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:31.614 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538524+0000", 2023-09-30T17:04:31.614 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.51e-07 2023-09-30T17:04:31.614 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.614 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.614 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:31.614 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538535+0000", 2023-09-30T17:04:31.614 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1620999999999999e-05 2023-09-30T17:04:31.614 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.614 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.615 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:31.615 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538542+0000", 2023-09-30T17:04:31.615 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1430000000000003e-06 2023-09-30T17:04:31.615 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.615 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.615 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:31.615 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538547+0000", 2023-09-30T17:04:31.615 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7649999999999999e-06 2023-09-30T17:04:31.615 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.615 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.615 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:31.615 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.989582+0000", 2023-09-30T17:04:31.616 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.45103486500000001 2023-09-30T17:04:31.616 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.616 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.616 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:31.616 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.989668+0000", 2023-09-30T17:04:31.616 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.6063999999999995e-05 2023-09-30T17:04:31.616 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.616 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.616 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:31.616 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.989829+0000", 2023-09-30T17:04:31.616 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016024299999999999 2023-09-30T17:04:31.617 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.617 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.617 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:31.617 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.015017+0000", 2023-09-30T17:04:31.617 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.025188043 2023-09-30T17:04:31.617 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.617 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.617 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:31.617 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.250275+0000", 2023-09-30T17:04:31.617 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23525855000000001 2023-09-30T17:04:31.617 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.617 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.618 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:31.618 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.250325+0000", 2023-09-30T17:04:31.618 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9429999999999999e-05 2023-09-30T17:04:31.618 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.618 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.618 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:31.618 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.250359+0000", 2023-09-30T17:04:31.618 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4858999999999999e-05 2023-09-30T17:04:31.618 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:31.618 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:31.618 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:31.619 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.619 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.619 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:141203 4.6 4:616d4c41:::100000001f8.00000034:head [write 1753088~4096,write 1773568~4096,write 1912832~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:31.619 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:21.538615+0000", 2023-09-30T17:04:31.619 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 10.007326492000001, 2023-09-30T17:04:31.619 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.71145826700000003, 2023-09-30T17:04:31.619 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:31.619 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:31.619 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:31.619 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:31.619 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:31.619 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 141203 2023-09-30T17:04:31.620 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.620 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:31.620 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.620 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:31.620 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538615+0000", 2023-09-30T17:04:31.620 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:31.620 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.620 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.620 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:31.620 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538615+0000", 2023-09-30T17:04:31.620 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:31.620 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.621 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.621 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:31.621 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538615+0000", 2023-09-30T17:04:31.621 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.89e-07 2023-09-30T17:04:31.621 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.621 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.621 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:31.621 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538627+0000", 2023-09-30T17:04:31.621 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1639e-05 2023-09-30T17:04:31.621 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.621 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.621 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:31.622 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538633+0000", 2023-09-30T17:04:31.622 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8540000000000002e-06 2023-09-30T17:04:31.622 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.622 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.622 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:31.622 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538638+0000", 2023-09-30T17:04:31.622 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7280000000000003e-06 2023-09-30T17:04:31.622 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.622 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.622 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:31.622 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.997432+0000", 2023-09-30T17:04:31.622 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.45879420399999998 2023-09-30T17:04:31.623 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.623 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.623 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:31.623 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.997483+0000", 2023-09-30T17:04:31.623 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1261000000000003e-05 2023-09-30T17:04:31.623 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.623 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.623 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:31.623 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.997574+0000", 2023-09-30T17:04:31.623 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.145e-05 2023-09-30T17:04:31.623 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.623 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.624 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:31.624 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.015021+0000", 2023-09-30T17:04:31.624 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.017446804999999999 2023-09-30T17:04:31.624 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.624 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.624 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:31.624 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.249978+0000", 2023-09-30T17:04:31.624 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23495672200000001 2023-09-30T17:04:31.624 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.624 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.624 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:31.625 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.250032+0000", 2023-09-30T17:04:31.625 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4342000000000002e-05 2023-09-30T17:04:31.625 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.625 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.625 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:31.625 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.250073+0000", 2023-09-30T17:04:31.625 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0873e-05 2023-09-30T17:04:31.625 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:31.625 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:31.625 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:31.625 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.625 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.625 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:141205 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 999424~4096,write 1056768~4096,write 1073152~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:31.626 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:21.538677+0000", 2023-09-30T17:04:31.626 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 10.007264423000001, 2023-09-30T17:04:31.626 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.71155133500000001, 2023-09-30T17:04:31.626 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:31.626 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:31.626 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:31.626 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:31.626 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:31.626 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 141205 2023-09-30T17:04:31.626 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.626 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:31.627 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.627 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:31.627 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538677+0000", 2023-09-30T17:04:31.627 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:31.627 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.627 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.627 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:31.627 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538677+0000", 2023-09-30T17:04:31.627 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:31.627 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.627 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.628 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:31.628 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538678+0000", 2023-09-30T17:04:31.628 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1099999999999996e-07 2023-09-30T17:04:31.628 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.628 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.628 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:31.628 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538691+0000", 2023-09-30T17:04:31.628 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3621999999999999e-05 2023-09-30T17:04:31.628 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.628 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.628 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:31.628 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538698+0000", 2023-09-30T17:04:31.628 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9670000000000004e-06 2023-09-30T17:04:31.629 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.629 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.629 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:31.629 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538705+0000", 2023-09-30T17:04:31.629 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8399999999999997e-06 2023-09-30T17:04:31.629 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.629 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.629 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:31.629 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.000125+0000", 2023-09-30T17:04:31.629 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.46141995800000002 2023-09-30T17:04:31.629 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.629 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.630 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:31.630 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.000207+0000", 2023-09-30T17:04:31.630 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2566999999999997e-05 2023-09-30T17:04:31.630 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.630 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.630 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:31.630 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.000366+0000", 2023-09-30T17:04:31.630 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015829200000000001 2023-09-30T17:04:31.630 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.630 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.630 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:31.631 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.015024+0000", 2023-09-30T17:04:31.631 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.014658582 2023-09-30T17:04:31.631 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.631 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.631 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:31.631 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.250132+0000", 2023-09-30T17:04:31.631 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23510737800000001 2023-09-30T17:04:31.631 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.631 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.631 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:31.631 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.250192+0000", 2023-09-30T17:04:31.631 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0609000000000002e-05 2023-09-30T17:04:31.632 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.632 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.632 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:31.632 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.250228+0000", 2023-09-30T17:04:31.632 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6009e-05 2023-09-30T17:04:31.632 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:31.632 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:31.632 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:31.632 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.632 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.632 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:141206 4.6 4:635f8cb4:::100000001f8.0000003c:head [write 2277376~8192,write 2301952~4096,write 2334720~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:31.632 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:21.538714+0000", 2023-09-30T17:04:31.633 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 10.007227562000001, 2023-09-30T17:04:31.633 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.71165632199999995, 2023-09-30T17:04:31.633 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:31.633 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:31.633 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:31.633 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:31.633 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:31.633 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 141206 2023-09-30T17:04:31.633 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.633 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:31.633 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.633 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:31.634 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538714+0000", 2023-09-30T17:04:31.634 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:31.634 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.634 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.634 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:31.634 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538714+0000", 2023-09-30T17:04:31.634 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:31.634 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.634 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.634 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:31.634 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538714+0000", 2023-09-30T17:04:31.634 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1699999999999999e-07 2023-09-30T17:04:31.635 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.635 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.635 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:31.635 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538729+0000", 2023-09-30T17:04:31.635 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4541e-05 2023-09-30T17:04:31.635 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.635 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.635 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:31.635 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538736+0000", 2023-09-30T17:04:31.635 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2919999999999998e-06 2023-09-30T17:04:31.635 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.635 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.636 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:31.636 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538742+0000", 2023-09-30T17:04:31.636 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9649999999999996e-06 2023-09-30T17:04:31.636 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.636 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.636 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:31.636 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.003294+0000", 2023-09-30T17:04:31.636 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.464551875 2023-09-30T17:04:31.636 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.636 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.636 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:31.636 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.003365+0000", 2023-09-30T17:04:31.637 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0932000000000005e-05 2023-09-30T17:04:31.637 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.637 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.637 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:31.637 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.003513+0000", 2023-09-30T17:04:31.637 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000148207 2023-09-30T17:04:31.637 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.637 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.637 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:31.637 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.019413+0000", 2023-09-30T17:04:31.637 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.015899809000000001 2023-09-30T17:04:31.637 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.637 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.638 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:31.638 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.250288+0000", 2023-09-30T17:04:31.638 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.230874999 2023-09-30T17:04:31.638 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.638 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.638 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:31.638 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.250336+0000", 2023-09-30T17:04:31.638 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7923999999999997e-05 2023-09-30T17:04:31.638 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.638 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.638 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:31.639 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.250370+0000", 2023-09-30T17:04:31.639 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.4360999999999998e-05 2023-09-30T17:04:31.639 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:31.639 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:31.639 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:31.639 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.639 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.639 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:141208 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 1875968~4096,write 1892352~4096,write 1916928~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e54)", 2023-09-30T17:04:31.639 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:21.538750+0000", 2023-09-30T17:04:31.639 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 10.007191585999999, 2023-09-30T17:04:31.639 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.71174180200000003, 2023-09-30T17:04:31.639 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:31.640 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:31.640 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:31.640 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:31.640 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:31.640 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 141208 2023-09-30T17:04:31.640 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.640 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:31.640 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.640 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:31.640 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538750+0000", 2023-09-30T17:04:31.640 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:31.640 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.641 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.641 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:31.641 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538750+0000", 2023-09-30T17:04:31.641 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:31.641 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.641 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.641 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:31.641 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538750+0000", 2023-09-30T17:04:31.641 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4000000000000002e-07 2023-09-30T17:04:31.641 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.641 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.641 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:31.642 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538762+0000", 2023-09-30T17:04:31.642 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1345000000000001e-05 2023-09-30T17:04:31.642 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.642 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.642 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:31.642 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538769+0000", 2023-09-30T17:04:31.642 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0890000000000002e-06 2023-09-30T17:04:31.642 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.642 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.642 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:31.642 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:21.538774+0000", 2023-09-30T17:04:31.642 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4890000000000003e-06 2023-09-30T17:04:31.643 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.643 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.643 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:31.643 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.008045+0000", 2023-09-30T17:04:31.643 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.46927121500000002 2023-09-30T17:04:31.643 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.643 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.643 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:31.643 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.008212+0000", 2023-09-30T17:04:31.643 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016702500000000001 2023-09-30T17:04:31.643 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.644 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.644 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:31.644 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.008367+0000", 2023-09-30T17:04:31.644 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015413699999999999 2023-09-30T17:04:31.644 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.644 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.644 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:31.644 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.019882+0000", 2023-09-30T17:04:31.644 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.011515143 2023-09-30T17:04:31.644 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.644 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.644 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:31.645 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.250416+0000", 2023-09-30T17:04:31.645 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.23053458299999999 2023-09-30T17:04:31.645 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.645 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.645 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:31.645 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.250460+0000", 2023-09-30T17:04:31.645 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.4081e-05 2023-09-30T17:04:31.645 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.645 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.645 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:31.645 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:22.250492+0000", 2023-09-30T17:04:31.646 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.1254999999999998e-05 2023-09-30T17:04:31.646 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:31.646 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:31.646 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:31.646 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.646 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.646 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:156646 4.6 4:63e80496:::100000001f8.0000001e:head [write 1134592~4096,write 1507328~4096,write 2908160~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-09-30T17:04:31.646 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:27.586551+0000", 2023-09-30T17:04:31.646 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 3.9593904040000001, 2023-09-30T17:04:31.646 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.71534716099999995, 2023-09-30T17:04:31.646 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:31.646 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:31.647 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:31.647 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:31.647 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:31.647 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 156646 2023-09-30T17:04:31.647 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.647 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:31.647 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.647 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:31.647 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:27.586551+0000", 2023-09-30T17:04:31.647 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:31.647 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.648 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.648 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:31.648 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:27.586551+0000", 2023-09-30T17:04:31.648 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:31.648 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.648 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.648 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:31.648 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:27.586551+0000", 2023-09-30T17:04:31.648 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5600000000000001e-07 2023-09-30T17:04:31.648 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.648 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.648 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:31.649 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:27.586562+0000", 2023-09-30T17:04:31.649 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0753e-05 2023-09-30T17:04:31.649 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.649 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.649 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:31.649 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:27.586568+0000", 2023-09-30T17:04:31.649 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9089999999999997e-06 2023-09-30T17:04:31.649 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.649 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.649 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:31.649 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:27.586573+0000", 2023-09-30T17:04:31.649 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6789999999999996e-06 2023-09-30T17:04:31.650 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.650 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.650 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:31.650 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:28.236307+0000", 2023-09-30T17:04:31.650 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.64973425600000001 2023-09-30T17:04:31.650 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.650 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.650 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:31.650 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:28.236375+0000", 2023-09-30T17:04:31.650 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8398999999999993e-05 2023-09-30T17:04:31.650 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.650 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.650 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:31.651 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:28.236540+0000", 2023-09-30T17:04:31.651 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016438100000000001 2023-09-30T17:04:31.651 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.651 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.651 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:31.651 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:28.257073+0000", 2023-09-30T17:04:31.651 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.020533310999999999 2023-09-30T17:04:31.651 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.651 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.651 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:31.651 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:28.301837+0000", 2023-09-30T17:04:31.651 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.044763987999999998 2023-09-30T17:04:31.651 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.652 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.652 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:31.652 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:28.301873+0000", 2023-09-30T17:04:31.652 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6137000000000003e-05 2023-09-30T17:04:31.652 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.652 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.652 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:31.652 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:28.301898+0000", 2023-09-30T17:04:31.652 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.4992000000000001e-05 2023-09-30T17:04:31.652 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:31.652 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:31.654 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:31.654 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.654 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.654 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:156869 4.6 4:616d4c41:::100000001f8.00000034:head [write 311296~4096,write 385024~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-09-30T17:04:31.654 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:27.664311+0000", 2023-09-30T17:04:31.654 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 3.8816305509999998, 2023-09-30T17:04:31.654 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.71550317900000004, 2023-09-30T17:04:31.654 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:31.654 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:31.654 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:31.654 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:31.655 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:31.655 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 156869 2023-09-30T17:04:31.655 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.655 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:31.655 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.655 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:31.655 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:27.664311+0000", 2023-09-30T17:04:31.655 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:31.655 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.655 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.656 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:31.656 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:27.664311+0000", 2023-09-30T17:04:31.656 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:31.656 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.656 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.656 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:31.656 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:27.664311+0000", 2023-09-30T17:04:31.656 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9500000000000003e-07 2023-09-30T17:04:31.656 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.656 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.656 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:31.657 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:27.664327+0000", 2023-09-30T17:04:31.657 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5722999999999998e-05 2023-09-30T17:04:31.657 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.657 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.657 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:31.657 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:27.664335+0000", 2023-09-30T17:04:31.657 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.7670000000000003e-06 2023-09-30T17:04:31.657 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.657 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.657 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:31.657 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:27.664341+0000", 2023-09-30T17:04:31.657 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0630000000000002e-06 2023-09-30T17:04:31.658 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.658 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.658 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:31.658 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:28.324026+0000", 2023-09-30T17:04:31.658 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.65968490000000002 2023-09-30T17:04:31.658 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.658 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.658 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:31.658 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:28.324107+0000", 2023-09-30T17:04:31.658 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1291999999999993e-05 2023-09-30T17:04:31.658 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.659 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.659 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:31.659 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:28.324279+0000", 2023-09-30T17:04:31.659 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017173700000000001 2023-09-30T17:04:31.659 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.659 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.659 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:31.659 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:28.341565+0000", 2023-09-30T17:04:31.659 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.017286299000000001 2023-09-30T17:04:31.659 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.659 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.660 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:31.660 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:28.379713+0000", 2023-09-30T17:04:31.660 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.038148143000000002 2023-09-30T17:04:31.660 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.660 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.660 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:31.660 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:28.379773+0000", 2023-09-30T17:04:31.660 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9616e-05 2023-09-30T17:04:31.660 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.660 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.660 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:31.660 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:28.379814+0000", 2023-09-30T17:04:31.661 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1143999999999998e-05 2023-09-30T17:04:31.661 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:31.661 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:31.661 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:31.661 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.661 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.661 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:156873 4.6 4:616d4c41:::100000001f8.00000034:head [write 2486272~4096,write 2555904~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-09-30T17:04:31.661 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:27.664391+0000", 2023-09-30T17:04:31.661 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 3.8815501139999999, 2023-09-30T17:04:31.661 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.71557449500000003, 2023-09-30T17:04:31.661 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:31.661 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:31.662 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:31.662 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:31.662 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:31.662 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 156873 2023-09-30T17:04:31.662 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.662 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:31.662 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.662 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:31.662 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:27.664391+0000", 2023-09-30T17:04:31.662 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:31.662 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.663 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.663 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:31.663 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:27.664391+0000", 2023-09-30T17:04:31.663 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:31.663 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.663 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.663 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:31.663 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:27.666163+0000", 2023-09-30T17:04:31.663 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001771941 2023-09-30T17:04:31.663 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.663 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.663 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:31.664 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:27.666179+0000", 2023-09-30T17:04:31.664 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5543999999999999e-05 2023-09-30T17:04:31.664 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.664 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.664 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:31.664 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:27.666190+0000", 2023-09-30T17:04:31.664 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0696000000000001e-05 2023-09-30T17:04:31.664 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.664 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.664 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:31.664 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:27.666198+0000", 2023-09-30T17:04:31.664 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2349999999999999e-06 2023-09-30T17:04:31.665 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.665 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.665 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:31.665 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:28.330880+0000", 2023-09-30T17:04:31.665 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.66468188900000003 2023-09-30T17:04:31.665 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.665 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.665 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:31.665 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:28.331084+0000", 2023-09-30T17:04:31.665 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00020466500000000001 2023-09-30T17:04:31.665 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.665 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.666 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:31.666 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:28.331226+0000", 2023-09-30T17:04:31.666 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014212 2023-09-30T17:04:31.666 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.666 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.666 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:31.666 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:28.360386+0000", 2023-09-30T17:04:31.666 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.029159398999999999 2023-09-30T17:04:31.666 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.666 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.666 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:31.666 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:28.379868+0000", 2023-09-30T17:04:31.667 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.019482626999999999 2023-09-30T17:04:31.667 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.667 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.667 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:31.667 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:28.379929+0000", 2023-09-30T17:04:31.667 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0613999999999999e-05 2023-09-30T17:04:31.667 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.667 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.667 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:31.667 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:28.379966+0000", 2023-09-30T17:04:31.667 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6764999999999998e-05 2023-09-30T17:04:31.667 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:31.668 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:31.668 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:31.668 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.668 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.668 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:156883 4.36 4:6fa85f86:::100000001f8.00000013:head [write 57344~8192,write 159744~4096,write 196608~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-09-30T17:04:31.668 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:27.666343+0000", 2023-09-30T17:04:31.668 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 3.8795986920000001, 2023-09-30T17:04:31.668 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.71347093500000003, 2023-09-30T17:04:31.668 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:31.668 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:31.668 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:31.668 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:31.669 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:31.669 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 156883 2023-09-30T17:04:31.669 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.669 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:31.669 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.669 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:31.669 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:27.666343+0000", 2023-09-30T17:04:31.669 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:31.669 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.669 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.669 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:31.669 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:27.666343+0000", 2023-09-30T17:04:31.670 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:31.670 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.670 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.670 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:31.670 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:27.666343+0000", 2023-09-30T17:04:31.670 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6100000000000002e-07 2023-09-30T17:04:31.670 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.670 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.670 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:31.670 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:27.666358+0000", 2023-09-30T17:04:31.670 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4647000000000001e-05 2023-09-30T17:04:31.671 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.671 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.671 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:31.671 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:27.666367+0000", 2023-09-30T17:04:31.671 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.799e-06 2023-09-30T17:04:31.671 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.671 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.671 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:31.671 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:27.666372+0000", 2023-09-30T17:04:31.672 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.1410000000000004e-06 2023-09-30T17:04:31.672 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.672 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.672 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:31.672 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:28.334625+0000", 2023-09-30T17:04:31.672 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.66825316800000001 2023-09-30T17:04:31.672 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.672 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.672 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:31.672 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:28.334710+0000", 2023-09-30T17:04:31.672 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4833000000000006e-05 2023-09-30T17:04:31.672 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.673 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.673 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:31.673 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:28.334880+0000", 2023-09-30T17:04:31.673 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016998800000000001 2023-09-30T17:04:31.673 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.673 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.673 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:31.673 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:28.360395+0000", 2023-09-30T17:04:31.673 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.025514933 2023-09-30T17:04:31.673 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.673 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.673 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:31.674 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:28.379701+0000", 2023-09-30T17:04:31.674 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.019306150000000001 2023-09-30T17:04:31.674 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.674 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.674 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:31.674 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:28.379771+0000", 2023-09-30T17:04:31.674 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0295000000000004e-05 2023-09-30T17:04:31.674 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.674 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.674 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:31.675 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:28.379814+0000", 2023-09-30T17:04:31.675 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.2620000000000002e-05 2023-09-30T17:04:31.675 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:31.675 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:31.675 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:31.675 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.675 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.675 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:156923 4.36 4:6ee5e2c4:::100000001f9.00000000:head [write 0~655360] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-09-30T17:04:31.675 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:27.682214+0000", 2023-09-30T17:04:31.675 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 3.8637279009999999, 2023-09-30T17:04:31.675 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.71609085299999997, 2023-09-30T17:04:31.675 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:31.676 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:31.676 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:31.676 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:31.676 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:31.676 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 156923 2023-09-30T17:04:31.676 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.676 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:31.676 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.676 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:31.676 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:27.682214+0000", 2023-09-30T17:04:31.676 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:31.677 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.677 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.677 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:31.677 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:27.682214+0000", 2023-09-30T17:04:31.677 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:31.677 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.677 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.677 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:31.677 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:27.682214+0000", 2023-09-30T17:04:31.677 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1099999999999995e-07 2023-09-30T17:04:31.677 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.678 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.678 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:31.678 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:27.682781+0000", 2023-09-30T17:04:31.678 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00056718299999999997 2023-09-30T17:04:31.678 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.678 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.678 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:31.678 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:27.682797+0000", 2023-09-30T17:04:31.678 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5435e-05 2023-09-30T17:04:31.678 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.678 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.678 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:31.679 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:27.682804+0000", 2023-09-30T17:04:31.679 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.695e-06 2023-09-30T17:04:31.679 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.679 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.679 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:31.679 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:28.344914+0000", 2023-09-30T17:04:31.679 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.662109583 2023-09-30T17:04:31.679 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.679 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.679 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:31.679 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:28.344999+0000", 2023-09-30T17:04:31.679 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4862000000000002e-05 2023-09-30T17:04:31.680 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.680 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.680 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:31.680 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:28.345132+0000", 2023-09-30T17:04:31.680 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00013316599999999999 2023-09-30T17:04:31.680 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.680 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.680 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:31.680 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:28.360495+0000", 2023-09-30T17:04:31.680 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.015362822 2023-09-30T17:04:31.680 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.680 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.681 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:31.681 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:28.398212+0000", 2023-09-30T17:04:31.681 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.037717444000000003 2023-09-30T17:04:31.681 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.681 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.681 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:31.681 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:28.398268+0000", 2023-09-30T17:04:31.681 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5498000000000003e-05 2023-09-30T17:04:31.681 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.681 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.681 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:31.681 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:28.398304+0000", 2023-09-30T17:04:31.682 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6554000000000003e-05 2023-09-30T17:04:31.682 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:31.682 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:31.682 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:31.682 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.682 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.682 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:156926 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 2183168~4096,write 2191360~4096,write 2297856~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-09-30T17:04:31.682 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:27.682818+0000", 2023-09-30T17:04:31.682 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 3.8631231779999999, 2023-09-30T17:04:31.682 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.71833658700000003, 2023-09-30T17:04:31.682 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:31.682 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:31.683 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:31.683 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:31.683 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:31.683 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 156926 2023-09-30T17:04:31.683 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.683 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:31.683 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.683 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:31.683 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:27.682818+0000", 2023-09-30T17:04:31.683 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:31.683 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.683 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.684 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:31.684 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:27.682818+0000", 2023-09-30T17:04:31.684 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:31.684 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.684 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.684 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:31.684 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:27.682819+0000", 2023-09-30T17:04:31.684 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.75e-07 2023-09-30T17:04:31.684 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.684 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.684 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:31.684 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:27.682836+0000", 2023-09-30T17:04:31.685 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.6781000000000001e-05 2023-09-30T17:04:31.685 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.685 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.685 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:31.685 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:27.682847+0000", 2023-09-30T17:04:31.685 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1372999999999999e-05 2023-09-30T17:04:31.685 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.685 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.685 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:31.685 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:27.682854+0000", 2023-09-30T17:04:31.685 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.6900000000000003e-06 2023-09-30T17:04:31.685 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.686 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.686 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:31.686 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:28.353982+0000", 2023-09-30T17:04:31.686 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.671128324 2023-09-30T17:04:31.686 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.686 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.686 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:31.686 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:28.354073+0000", 2023-09-30T17:04:31.686 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.0431000000000002e-05 2023-09-30T17:04:31.686 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.686 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.686 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:31.687 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:28.354231+0000", 2023-09-30T17:04:31.687 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000158407 2023-09-30T17:04:31.687 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.687 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.687 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:31.687 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:28.373188+0000", 2023-09-30T17:04:31.687 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.018957338000000001 2023-09-30T17:04:31.687 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.687 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.687 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:31.687 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:28.401038+0000", 2023-09-30T17:04:31.687 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.027850038000000001 2023-09-30T17:04:31.688 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.688 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.688 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:31.688 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:28.401109+0000", 2023-09-30T17:04:31.688 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1087000000000006e-05 2023-09-30T17:04:31.688 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.688 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.688 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:31.688 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:28.401155+0000", 2023-09-30T17:04:31.688 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5442999999999998e-05 2023-09-30T17:04:31.688 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:31.688 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:31.689 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:31.689 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.689 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.689 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:156933 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 2584576~8192,write 2736128~4096,write 3031040~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-09-30T17:04:31.689 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:27.683074+0000", 2023-09-30T17:04:31.689 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 3.8628671529999998, 2023-09-30T17:04:31.689 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.72262725400000005, 2023-09-30T17:04:31.689 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:31.689 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:31.689 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:31.689 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:31.689 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:31.690 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 156933 2023-09-30T17:04:31.690 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.690 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:31.690 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.690 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:31.690 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:27.683074+0000", 2023-09-30T17:04:31.690 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:31.690 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.690 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.690 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:31.690 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:27.683074+0000", 2023-09-30T17:04:31.690 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:31.691 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.691 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.691 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:31.691 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:27.683075+0000", 2023-09-30T17:04:31.691 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9100000000000003e-07 2023-09-30T17:04:31.691 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.691 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.691 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:31.691 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:27.683097+0000", 2023-09-30T17:04:31.691 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.1520000000000001e-05 2023-09-30T17:04:31.691 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.692 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.692 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:31.692 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:27.683106+0000", 2023-09-30T17:04:31.692 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.3610000000000007e-06 2023-09-30T17:04:31.692 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.692 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.692 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:31.692 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:27.683113+0000", 2023-09-30T17:04:31.692 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8480000000000003e-06 2023-09-30T17:04:31.692 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.692 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.692 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:31.693 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:28.354115+0000", 2023-09-30T17:04:31.693 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67100227099999998 2023-09-30T17:04:31.693 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.693 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.693 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:31.693 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:28.354203+0000", 2023-09-30T17:04:31.693 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8158000000000005e-05 2023-09-30T17:04:31.693 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.693 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.693 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:31.693 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:28.354369+0000", 2023-09-30T17:04:31.693 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016596800000000001 2023-09-30T17:04:31.694 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.694 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.694 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:31.694 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:28.370072+0000", 2023-09-30T17:04:31.694 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.015702392999999999 2023-09-30T17:04:31.694 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.694 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.694 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:31.694 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:28.405566+0000", 2023-09-30T17:04:31.694 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.035494255000000002 2023-09-30T17:04:31.694 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.694 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.695 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:31.695 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:28.405663+0000", 2023-09-30T17:04:31.695 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.7536999999999998e-05 2023-09-30T17:04:31.695 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:31.695 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:31.695 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:31.695 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:28.405702+0000", 2023-09-30T17:04:31.695 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8251999999999999e-05 2023-09-30T17:04:31.695 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:31.695 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:31.695 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:31.695 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:31.695 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:31.696 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:04:31.697 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:04:31.698 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:31.696+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:31.800 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:31.798+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:31.901 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:31.900+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:31.921 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:04:31.921 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2023-09-30T17:04:31.922 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.922 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:164991 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:31.922 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.245912+0000", 2023-09-30T17:04:31.922 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.65411768199999998, 2023-09-30T17:04:31.922 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.654143209, 2023-09-30T17:04:31.922 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:31.922 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:31.922 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:31.922 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:31.922 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:31.922 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 164991 2023-09-30T17:04:31.923 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.923 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:31.923 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.923 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:31.923 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.245912+0000", 2023-09-30T17:04:31.923 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:31.923 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.923 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.923 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:31.923 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.245912+0000", 2023-09-30T17:04:31.923 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:31.923 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.924 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.924 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:31.924 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.245912+0000", 2023-09-30T17:04:31.924 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7899999999999999e-07 2023-09-30T17:04:31.924 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.924 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.924 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:31.924 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.245923+0000", 2023-09-30T17:04:31.924 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1088e-05 2023-09-30T17:04:31.924 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.925 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.925 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:31.925 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.245929+0000", 2023-09-30T17:04:31.925 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6409999999999999e-06 2023-09-30T17:04:31.925 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.925 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.925 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:31.925 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.245934+0000", 2023-09-30T17:04:31.925 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5800000000000002e-06 2023-09-30T17:04:31.926 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:31.926 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:31.926 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:31.926 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.926 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.926 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165227 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:31.926 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.328679+0000", 2023-09-30T17:04:31.926 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.57135045399999995, 2023-09-30T17:04:31.926 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.571445808, 2023-09-30T17:04:31.926 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:31.927 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:31.927 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:31.927 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:31.927 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:31.927 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165227 2023-09-30T17:04:31.927 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.927 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:31.927 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.927 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:31.927 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.328679+0000", 2023-09-30T17:04:31.928 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:31.928 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.928 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.928 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:31.928 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.328679+0000", 2023-09-30T17:04:31.928 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:31.928 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.928 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.928 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:31.929 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.332515+0000", 2023-09-30T17:04:31.929 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038357310000000002 2023-09-30T17:04:31.929 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.929 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.929 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:31.929 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.332536+0000", 2023-09-30T17:04:31.929 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1140000000000001e-05 2023-09-30T17:04:31.929 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.929 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.929 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:31.929 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.332547+0000", 2023-09-30T17:04:31.929 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0886e-05 2023-09-30T17:04:31.930 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.930 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.930 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:31.930 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.332555+0000", 2023-09-30T17:04:31.930 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1899999999999995e-06 2023-09-30T17:04:31.930 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:31.930 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:31.930 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:31.930 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.930 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.931 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165457 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:31.931 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.396557+0000", 2023-09-30T17:04:31.931 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.50347234399999996, 2023-09-30T17:04:31.931 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.50363124599999998, 2023-09-30T17:04:31.931 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:31.931 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:31.931 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:31.931 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:31.931 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:31.931 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165457 2023-09-30T17:04:31.931 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.932 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:31.932 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.932 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:31.932 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.396557+0000", 2023-09-30T17:04:31.932 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:31.932 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.932 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.932 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:31.932 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.396557+0000", 2023-09-30T17:04:31.932 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:31.933 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.933 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.933 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:31.933 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.396558+0000", 2023-09-30T17:04:31.933 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8599999999999999e-07 2023-09-30T17:04:31.933 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.933 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.933 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:31.933 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.396570+0000", 2023-09-30T17:04:31.933 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2291e-05 2023-09-30T17:04:31.933 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.934 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.934 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:31.934 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.396574+0000", 2023-09-30T17:04:31.934 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1690000000000002e-06 2023-09-30T17:04:31.934 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.934 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.934 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:31.934 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.396578+0000", 2023-09-30T17:04:31.934 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.54e-06 2023-09-30T17:04:31.934 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:31.935 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:31.935 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:31.935 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.935 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.935 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165566 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:31.935 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.438570+0000", 2023-09-30T17:04:31.935 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.46145928600000002, 2023-09-30T17:04:31.935 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.46168674599999998, 2023-09-30T17:04:31.935 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:31.935 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:31.935 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:31.936 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:31.936 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:31.936 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165566 2023-09-30T17:04:31.936 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.936 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:31.936 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.936 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:31.936 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.438570+0000", 2023-09-30T17:04:31.936 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:31.936 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.936 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.936 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:31.937 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.438570+0000", 2023-09-30T17:04:31.937 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:31.937 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.937 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.937 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:31.937 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.438571+0000", 2023-09-30T17:04:31.937 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9900000000000001e-07 2023-09-30T17:04:31.937 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.937 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.937 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:31.937 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.438590+0000", 2023-09-30T17:04:31.937 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9193000000000001e-05 2023-09-30T17:04:31.938 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.938 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.938 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:31.938 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.438602+0000", 2023-09-30T17:04:31.938 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.239e-05 2023-09-30T17:04:31.938 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.938 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.938 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:31.938 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.438609+0000", 2023-09-30T17:04:31.938 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2929999999999997e-06 2023-09-30T17:04:31.938 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:31.939 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:31.939 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:31.939 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.939 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.939 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166013 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:31.939 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.592645+0000", 2023-09-30T17:04:31.939 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.30738464500000001, 2023-09-30T17:04:31.939 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.30767257599999998, 2023-09-30T17:04:31.939 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:31.939 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:31.939 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:31.939 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:31.940 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:31.940 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166013 2023-09-30T17:04:31.940 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.940 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:31.940 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.940 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:31.940 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.592645+0000", 2023-09-30T17:04:31.940 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:31.940 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.940 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.940 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:31.941 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.592645+0000", 2023-09-30T17:04:31.941 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:31.941 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.941 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.941 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:31.941 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.594515+0000", 2023-09-30T17:04:31.941 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0018704889999999999 2023-09-30T17:04:31.941 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.941 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.941 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:31.941 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.594527+0000", 2023-09-30T17:04:31.941 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1746000000000001e-05 2023-09-30T17:04:31.942 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.942 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.942 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:31.942 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.594538+0000", 2023-09-30T17:04:31.942 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0431999999999999e-05 2023-09-30T17:04:31.942 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.942 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.942 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:31.942 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.594545+0000", 2023-09-30T17:04:31.942 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9779999999999999e-06 2023-09-30T17:04:31.942 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:31.943 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:31.943 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:31.943 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.943 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.943 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166044 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:31.943 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.609565+0000", 2023-09-30T17:04:31.943 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.29046464300000002, 2023-09-30T17:04:31.943 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.290807023, 2023-09-30T17:04:31.943 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:31.943 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:31.943 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:31.943 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:31.944 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:31.944 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166044 2023-09-30T17:04:31.944 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.944 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:31.944 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.944 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:31.944 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.609565+0000", 2023-09-30T17:04:31.944 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:31.944 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.944 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.945 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:31.945 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.609565+0000", 2023-09-30T17:04:31.945 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:31.945 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.945 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.945 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:31.945 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.609565+0000", 2023-09-30T17:04:31.945 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1399999999999997e-07 2023-09-30T17:04:31.945 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.945 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.945 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:31.946 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.609578+0000", 2023-09-30T17:04:31.946 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2665e-05 2023-09-30T17:04:31.946 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.946 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.946 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:31.946 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.609587+0000", 2023-09-30T17:04:31.946 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.918e-06 2023-09-30T17:04:31.946 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.946 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.946 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:31.946 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.609593+0000", 2023-09-30T17:04:31.946 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5099999999999998e-06 2023-09-30T17:04:31.947 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:31.947 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:31.947 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:31.947 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.947 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.947 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166233 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:31.947 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.665578+0000", 2023-09-30T17:04:31.947 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.23445143600000001, 2023-09-30T17:04:31.947 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.23482523799999999, 2023-09-30T17:04:31.947 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:31.948 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:31.948 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:31.948 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:31.948 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:31.948 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166233 2023-09-30T17:04:31.948 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.948 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:31.948 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.948 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:31.948 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.665578+0000", 2023-09-30T17:04:31.948 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:31.949 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.949 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.949 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:31.949 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.665578+0000", 2023-09-30T17:04:31.949 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:31.949 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.949 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.949 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:31.949 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.665579+0000", 2023-09-30T17:04:31.949 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0900000000000002e-07 2023-09-30T17:04:31.949 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.949 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.950 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:31.950 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.665590+0000", 2023-09-30T17:04:31.950 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1595e-05 2023-09-30T17:04:31.950 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.950 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.950 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:31.950 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.665598+0000", 2023-09-30T17:04:31.950 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7500000000000003e-06 2023-09-30T17:04:31.950 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.950 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.950 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:31.950 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.665603+0000", 2023-09-30T17:04:31.951 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1540000000000001e-06 2023-09-30T17:04:31.951 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:31.951 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:31.951 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:31.951 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.951 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.951 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166293 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:31.952 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.684647+0000", 2023-09-30T17:04:31.952 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.21538251899999999, 2023-09-30T17:04:31.952 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.21578708899999999, 2023-09-30T17:04:31.952 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:31.952 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:31.952 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:31.952 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:31.952 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:31.952 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166293 2023-09-30T17:04:31.952 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.952 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:31.952 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.953 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:31.953 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.684647+0000", 2023-09-30T17:04:31.953 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:31.953 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.953 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.953 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:31.953 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.684647+0000", 2023-09-30T17:04:31.953 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:31.953 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.953 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.953 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:31.953 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.684647+0000", 2023-09-30T17:04:31.954 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5499999999999999e-07 2023-09-30T17:04:31.954 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.954 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.954 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:31.954 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.684659+0000", 2023-09-30T17:04:31.954 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1105e-05 2023-09-30T17:04:31.954 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.954 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.954 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:31.954 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.684664+0000", 2023-09-30T17:04:31.955 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5090000000000001e-06 2023-09-30T17:04:31.955 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.955 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.955 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:31.955 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.684669+0000", 2023-09-30T17:04:31.955 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4719999999999997e-06 2023-09-30T17:04:31.955 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:31.955 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:31.955 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:31.955 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.955 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.956 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166532 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:31.956 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.804651+0000", 2023-09-30T17:04:31.956 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.095379066999999998, 2023-09-30T17:04:31.956 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.095813817999999995, 2023-09-30T17:04:31.956 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:31.956 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:31.956 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:31.956 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:31.956 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:31.956 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166532 2023-09-30T17:04:31.956 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.956 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:31.957 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.957 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:31.957 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.804651+0000", 2023-09-30T17:04:31.957 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:31.957 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.957 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.957 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:31.957 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.804651+0000", 2023-09-30T17:04:31.957 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:31.957 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.958 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.958 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:31.958 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.804651+0000", 2023-09-30T17:04:31.958 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9900000000000001e-07 2023-09-30T17:04:31.958 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.958 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.958 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:31.958 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.804668+0000", 2023-09-30T17:04:31.958 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6795000000000001e-05 2023-09-30T17:04:31.958 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.959 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.959 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:31.959 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.804674+0000", 2023-09-30T17:04:31.959 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5309999999999998e-06 2023-09-30T17:04:31.959 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.959 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.959 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:31.959 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.804679+0000", 2023-09-30T17:04:31.959 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0370000000000002e-06 2023-09-30T17:04:31.959 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:31.959 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:31.960 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:31.960 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.960 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.960 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166714 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:31.960 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.869750+0000", 2023-09-30T17:04:31.960 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.030279773999999999, 2023-09-30T17:04:31.960 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.030746563000000001, 2023-09-30T17:04:31.960 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:31.960 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:31.960 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:31.960 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:31.960 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:31.961 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166714 2023-09-30T17:04:31.961 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.961 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:31.961 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.961 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:31.961 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.869750+0000", 2023-09-30T17:04:31.961 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:31.961 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.961 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.961 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:31.961 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.869750+0000", 2023-09-30T17:04:31.961 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:31.962 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.962 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.962 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:31.962 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.869750+0000", 2023-09-30T17:04:31.962 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2100000000000002e-07 2023-09-30T17:04:31.962 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.962 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.962 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:31.962 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.869770+0000", 2023-09-30T17:04:31.962 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9854e-05 2023-09-30T17:04:31.962 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.962 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.963 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:31.963 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.869780+0000", 2023-09-30T17:04:31.963 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0105999999999999e-05 2023-09-30T17:04:31.963 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.963 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.963 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:31.963 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.869786+0000", 2023-09-30T17:04:31.963 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9699999999999996e-06 2023-09-30T17:04:31.963 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:31.963 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:31.963 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:31.964 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.964 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.964 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:167240 4.19 e57/17 4:9a4319fb:::100000001f8.0000002a:head v 57'5245, mlcod=57'5242)", 2023-09-30T17:04:31.964 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.885054+0000", 2023-09-30T17:04:31.964 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.014975485, 2023-09-30T17:04:31.964 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015483735, 2023-09-30T17:04:31.964 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:31.964 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:31.964 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:31.964 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.964 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:31.965 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885054+0000", 2023-09-30T17:04:31.965 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:31.965 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.965 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.965 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:31.965 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885054+0000", 2023-09-30T17:04:31.965 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:31.965 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.965 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.965 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:31.965 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885054+0000", 2023-09-30T17:04:31.965 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5699999999999999e-07 2023-09-30T17:04:31.966 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.966 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.966 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:31.966 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885065+0000", 2023-09-30T17:04:31.966 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1019000000000001e-05 2023-09-30T17:04:31.966 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.966 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.966 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:31.966 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885072+0000", 2023-09-30T17:04:31.966 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1639999999999998e-06 2023-09-30T17:04:31.966 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.966 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.967 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:31.967 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885076+0000", 2023-09-30T17:04:31.967 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5029999999999999e-06 2023-09-30T17:04:31.967 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.967 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.967 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:31.967 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.890450+0000", 2023-09-30T17:04:31.967 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053743430000000002 2023-09-30T17:04:31.967 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.967 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.967 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:31.967 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.890473+0000", 2023-09-30T17:04:31.968 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2306e-05 2023-09-30T17:04:31.968 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:31.968 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:31.968 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:31.968 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.968 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.968 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165066 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:31.968 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.266379+0000", 2023-09-30T17:04:31.968 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.63365090400000001, 2023-09-30T17:04:31.968 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.63419465100000005, 2023-09-30T17:04:31.969 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:31.969 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:31.969 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:31.969 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:31.969 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:31.969 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165066 2023-09-30T17:04:31.969 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.969 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:31.969 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.969 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:31.969 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.266379+0000", 2023-09-30T17:04:31.970 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:31.970 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.970 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.970 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:31.970 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.266379+0000", 2023-09-30T17:04:31.970 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:31.970 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.970 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.970 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:31.970 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.269569+0000", 2023-09-30T17:04:31.970 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0031905800000000002 2023-09-30T17:04:31.971 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.971 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.971 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:31.971 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.269585+0000", 2023-09-30T17:04:31.971 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6018000000000001e-05 2023-09-30T17:04:31.971 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.971 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.971 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:31.971 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.269591+0000", 2023-09-30T17:04:31.971 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6210000000000001e-06 2023-09-30T17:04:31.971 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.971 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.972 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:31.972 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.269594+0000", 2023-09-30T17:04:31.972 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5410000000000001e-06 2023-09-30T17:04:31.972 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:31.972 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:31.972 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:31.972 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.972 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.972 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165112 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:31.972 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.276042+0000", 2023-09-30T17:04:31.972 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.62398745200000005, 2023-09-30T17:04:31.972 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.62456235000000004, 2023-09-30T17:04:31.973 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:31.973 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:31.973 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:31.973 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:31.973 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:31.973 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165112 2023-09-30T17:04:31.973 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.973 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:31.973 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.973 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:31.973 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.276042+0000", 2023-09-30T17:04:31.974 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:31.974 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.974 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.974 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:31.974 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.276042+0000", 2023-09-30T17:04:31.974 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:31.974 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.974 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.974 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:31.974 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.279517+0000", 2023-09-30T17:04:31.975 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003474703 2023-09-30T17:04:31.975 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.975 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.975 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:31.975 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.279541+0000", 2023-09-30T17:04:31.975 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3790000000000001e-05 2023-09-30T17:04:31.975 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.975 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.975 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:31.975 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.279550+0000", 2023-09-30T17:04:31.975 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5049999999999996e-06 2023-09-30T17:04:31.975 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.976 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.976 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:31.976 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.279559+0000", 2023-09-30T17:04:31.976 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6570000000000003e-06 2023-09-30T17:04:31.976 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:31.976 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:31.976 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:31.976 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.976 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.976 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165145 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:31.977 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.295653+0000", 2023-09-30T17:04:31.977 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.60437675999999996, 2023-09-30T17:04:31.977 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.60498244700000003, 2023-09-30T17:04:31.977 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:31.977 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:31.977 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:31.977 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:31.977 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:31.977 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165145 2023-09-30T17:04:31.977 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.977 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:31.977 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.978 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:31.978 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.295653+0000", 2023-09-30T17:04:31.978 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:31.978 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.978 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.978 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:31.978 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.295653+0000", 2023-09-30T17:04:31.978 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:31.978 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.978 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.978 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:31.979 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.295876+0000", 2023-09-30T17:04:31.979 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000222692 2023-09-30T17:04:31.979 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.979 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.979 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:31.979 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.295888+0000", 2023-09-30T17:04:31.979 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2549e-05 2023-09-30T17:04:31.979 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.979 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.979 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:31.979 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.295896+0000", 2023-09-30T17:04:31.980 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0409999999999998e-06 2023-09-30T17:04:31.980 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.980 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.980 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:31.980 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.295903+0000", 2023-09-30T17:04:31.980 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5080000000000002e-06 2023-09-30T17:04:31.980 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:31.980 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:31.980 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:31.980 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.980 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.981 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165277 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:31.981 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.342039+0000", 2023-09-30T17:04:31.981 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.55799041999999999, 2023-09-30T17:04:31.981 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.55862715500000004, 2023-09-30T17:04:31.981 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:31.981 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:31.981 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:31.981 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:31.981 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:31.981 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165277 2023-09-30T17:04:31.981 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.982 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:31.982 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.982 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:31.982 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.342039+0000", 2023-09-30T17:04:31.982 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:31.982 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.982 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.982 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:31.983 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.342039+0000", 2023-09-30T17:04:31.983 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:31.983 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.983 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.983 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:31.983 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.343525+0000", 2023-09-30T17:04:31.983 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001486156 2023-09-30T17:04:31.983 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.983 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.983 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:31.983 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.343545+0000", 2023-09-30T17:04:31.983 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9210000000000001e-05 2023-09-30T17:04:31.984 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.984 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.984 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:31.984 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.343552+0000", 2023-09-30T17:04:31.984 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9160000000000001e-06 2023-09-30T17:04:31.984 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.984 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.984 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:31.984 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.343559+0000", 2023-09-30T17:04:31.984 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5309999999999998e-06 2023-09-30T17:04:31.984 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:31.985 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:31.985 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:31.985 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.985 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.985 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165397 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:31.985 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.385442+0000", 2023-09-30T17:04:31.985 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.51458750600000003, 2023-09-30T17:04:31.985 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.5152544, 2023-09-30T17:04:31.985 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:31.985 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:31.986 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:31.986 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:31.986 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:31.986 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165397 2023-09-30T17:04:31.986 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.986 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:31.986 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.986 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:31.986 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.385442+0000", 2023-09-30T17:04:31.986 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:31.986 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.986 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.987 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:31.987 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.385442+0000", 2023-09-30T17:04:31.987 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:31.987 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.987 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.987 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:31.987 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.385443+0000", 2023-09-30T17:04:31.987 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8100000000000002e-07 2023-09-30T17:04:31.987 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.987 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.987 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:31.988 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.385463+0000", 2023-09-30T17:04:31.988 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0081e-05 2023-09-30T17:04:31.988 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.988 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:31.988 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.385475+0000", 2023-09-30T17:04:31.988 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2397e-05 2023-09-30T17:04:31.988 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.988 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:31.988 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.385483+0000", 2023-09-30T17:04:31.988 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6140000000000003e-06 2023-09-30T17:04:31.989 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:31.989 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:31.989 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:31.989 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.989 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.989 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165567 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:31.989 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.438619+0000", 2023-09-30T17:04:31.989 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.46141024800000002, 2023-09-30T17:04:31.989 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.46210701399999998, 2023-09-30T17:04:31.989 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:31.989 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:31.989 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:31.990 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:31.990 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:31.990 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165567 2023-09-30T17:04:31.990 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.990 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:31.990 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.990 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:31.990 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.438619+0000", 2023-09-30T17:04:31.990 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:31.990 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.990 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.991 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:31.991 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.438619+0000", 2023-09-30T17:04:31.991 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:31.991 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.991 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.991 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:31.991 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.438620+0000", 2023-09-30T17:04:31.991 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5200000000000002e-07 2023-09-30T17:04:31.991 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.991 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.991 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:31.992 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.438635+0000", 2023-09-30T17:04:31.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5498999999999998e-05 2023-09-30T17:04:31.992 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:31.992 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.438643+0000", 2023-09-30T17:04:31.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5179999999999998e-06 2023-09-30T17:04:31.992 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:31.992 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.438655+0000", 2023-09-30T17:04:31.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2213e-05 2023-09-30T17:04:31.993 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:31.993 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:31.993 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:31.993 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.993 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.993 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165678 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:31.993 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.482722+0000", 2023-09-30T17:04:31.993 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.41730796599999997, 2023-09-30T17:04:31.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.41803488300000002, 2023-09-30T17:04:31.993 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:31.994 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:31.994 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:31.994 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:31.994 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:31.994 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165678 2023-09-30T17:04:31.994 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.994 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:31.994 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.994 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:31.994 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.482722+0000", 2023-09-30T17:04:31.994 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:31.995 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.995 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.995 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:31.995 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.482722+0000", 2023-09-30T17:04:31.995 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:31.995 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.995 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.995 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:31.995 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.482722+0000", 2023-09-30T17:04:31.995 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5799999999999999e-07 2023-09-30T17:04:31.995 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.996 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:31.996 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.482734+0000", 2023-09-30T17:04:31.996 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1337e-05 2023-09-30T17:04:31.996 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.996 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:31.996 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.482740+0000", 2023-09-30T17:04:31.996 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.438e-06 2023-09-30T17:04:31.996 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.997 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:31.997 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.482745+0000", 2023-09-30T17:04:31.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0810000000000001e-06 2023-09-30T17:04:31.997 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:31.997 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:31.997 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:31.997 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.997 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166389 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:31.997 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.722778+0000", 2023-09-30T17:04:31.997 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.17725162699999999, 2023-09-30T17:04:31.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.17805404599999999, 2023-09-30T17:04:31.998 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:31.998 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:31.998 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:31.998 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:31.998 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:31.998 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166389 2023-09-30T17:04:31.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.998 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:31.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.998 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:31.998 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.722778+0000", 2023-09-30T17:04:31.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:31.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.999 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:31.999 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.722778+0000", 2023-09-30T17:04:31.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:31.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:31.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:31.999 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:31.999 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.726525+0000", 2023-09-30T17:04:31.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0037467680000000001 2023-09-30T17:04:32.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.000 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.000 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.726544+0000", 2023-09-30T17:04:32.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9143999999999998e-05 2023-09-30T17:04:32.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.000 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.000 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.726559+0000", 2023-09-30T17:04:32.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5415000000000001e-05 2023-09-30T17:04:32.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.001 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.001 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.726569+0000", 2023-09-30T17:04:32.001 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5599999999999999e-06 2023-09-30T17:04:32.001 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.001 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.001 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.001 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166422 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.001 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.744655+0000", 2023-09-30T17:04:32.002 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.15537443400000001, 2023-09-30T17:04:32.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.15624284299999999, 2023-09-30T17:04:32.002 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.002 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.002 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.002 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.002 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.002 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166422 2023-09-30T17:04:32.002 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.002 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.003 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.003 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.744655+0000", 2023-09-30T17:04:32.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.003 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.003 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.003 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.744655+0000", 2023-09-30T17:04:32.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.003 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.003 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.003 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.744656+0000", 2023-09-30T17:04:32.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4299999999999998e-07 2023-09-30T17:04:32.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.744668+0000", 2023-09-30T17:04:32.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1986e-05 2023-09-30T17:04:32.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.005 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.744674+0000", 2023-09-30T17:04:32.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4760000000000003e-06 2023-09-30T17:04:32.005 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.005 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.005 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.744681+0000", 2023-09-30T17:04:32.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0049999999999998e-06 2023-09-30T17:04:32.005 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.005 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.005 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.005 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.006 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166533 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.006 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.804686+0000", 2023-09-30T17:04:32.006 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.095343232999999999, 2023-09-30T17:04:32.006 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.096269581000000007, 2023-09-30T17:04:32.006 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.006 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.006 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.006 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.006 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.006 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166533 2023-09-30T17:04:32.006 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.007 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.007 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.804686+0000", 2023-09-30T17:04:32.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.007 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.804686+0000", 2023-09-30T17:04:32.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.008 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.008 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.804687+0000", 2023-09-30T17:04:32.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4700000000000002e-07 2023-09-30T17:04:32.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.008 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.008 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.804698+0000", 2023-09-30T17:04:32.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1667e-05 2023-09-30T17:04:32.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.009 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.009 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.804705+0000", 2023-09-30T17:04:32.009 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0809999999999999e-06 2023-09-30T17:04:32.009 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.009 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.009 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.804710+0000", 2023-09-30T17:04:32.009 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4140000000000002e-06 2023-09-30T17:04:32.009 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.009 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.009 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.009 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.010 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166669 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.010 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.857701+0000", 2023-09-30T17:04:32.010 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.042329064999999999, 2023-09-30T17:04:32.010 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043319024999999997, 2023-09-30T17:04:32.010 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.010 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.010 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.010 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.010 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.010 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166669 2023-09-30T17:04:32.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.011 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.857701+0000", 2023-09-30T17:04:32.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.857701+0000", 2023-09-30T17:04:32.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.857701+0000", 2023-09-30T17:04:32.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7999999999999996e-07 2023-09-30T17:04:32.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.857712+0000", 2023-09-30T17:04:32.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1175000000000001e-05 2023-09-30T17:04:32.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.013 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.013 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.857718+0000", 2023-09-30T17:04:32.013 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2219999999999999e-06 2023-09-30T17:04:32.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.013 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.013 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.857724+0000", 2023-09-30T17:04:32.013 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8619999999999999e-06 2023-09-30T17:04:32.013 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.013 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.014 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.014 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.014 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.014 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166746 4.2d 4:b4aa06e9:::100000001f8.0000001d:head [write 1544192~4096 in=4096b,write 1708032~4096 in=4096b,write 1748992~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.014 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.884052+0000", 2023-09-30T17:04:32.014 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.015978068000000002, 2023-09-30T17:04:32.014 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017036563000000001, 2023-09-30T17:04:32.014 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.014 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:32.014 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.014 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.015 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.015 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166746 2023-09-30T17:04:32.015 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.015 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.015 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.884052+0000", 2023-09-30T17:04:32.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.015 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.015 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.884052+0000", 2023-09-30T17:04:32.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885516+0000", 2023-09-30T17:04:32.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001464131 2023-09-30T17:04:32.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885531+0000", 2023-09-30T17:04:32.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5800000000000001e-05 2023-09-30T17:04:32.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885541+0000", 2023-09-30T17:04:32.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7270000000000002e-06 2023-09-30T17:04:32.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885549+0000", 2023-09-30T17:04:32.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9810000000000003e-06 2023-09-30T17:04:32.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.018 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:32.018 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885732+0000", 2023-09-30T17:04:32.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00018243799999999999 2023-09-30T17:04:32.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.018 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:32.018 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885813+0000", 2023-09-30T17:04:32.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1217999999999994e-05 2023-09-30T17:04:32.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.018 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:32.018 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885978+0000", 2023-09-30T17:04:32.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000165389 2023-09-30T17:04:32.019 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.019 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.019 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.019 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:164995 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.019 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.245974+0000", 2023-09-30T17:04:32.019 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.65405540699999998, 2023-09-30T17:04:32.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.65519092599999995, 2023-09-30T17:04:32.019 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.020 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.020 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.020 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.020 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.020 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 164995 2023-09-30T17:04:32.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.020 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.245974+0000", 2023-09-30T17:04:32.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.021 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.021 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.245974+0000", 2023-09-30T17:04:32.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.021 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.021 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.245975+0000", 2023-09-30T17:04:32.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1699999999999999e-07 2023-09-30T17:04:32.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.022 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.022 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.245986+0000", 2023-09-30T17:04:32.022 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0971e-05 2023-09-30T17:04:32.022 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.022 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.022 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.022 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.245992+0000", 2023-09-30T17:04:32.022 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9390000000000002e-06 2023-09-30T17:04:32.022 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.022 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.022 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.023 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.245996+0000", 2023-09-30T17:04:32.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6750000000000001e-06 2023-09-30T17:04:32.023 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.023 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.023 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.023 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.023 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.023 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165610 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.023 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.452570+0000", 2023-09-30T17:04:32.023 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.44745966500000001, 2023-09-30T17:04:32.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.44865458600000002, 2023-09-30T17:04:32.024 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.024 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.024 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.024 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.024 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.024 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165610 2023-09-30T17:04:32.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.024 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.024 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.024 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.452570+0000", 2023-09-30T17:04:32.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.025 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.025 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.025 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.025 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.452570+0000", 2023-09-30T17:04:32.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.025 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.025 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.025 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.025 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.454514+0000", 2023-09-30T17:04:32.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001944044 2023-09-30T17:04:32.025 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.026 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.026 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.454525+0000", 2023-09-30T17:04:32.026 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.083e-05 2023-09-30T17:04:32.026 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.026 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.026 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.454531+0000", 2023-09-30T17:04:32.026 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.392e-06 2023-09-30T17:04:32.026 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.027 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.027 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.454536+0000", 2023-09-30T17:04:32.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5140000000000003e-06 2023-09-30T17:04:32.027 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.027 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.027 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.027 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.027 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165801 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.027 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.523598+0000", 2023-09-30T17:04:32.027 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.37643128599999998, 2023-09-30T17:04:32.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.37768608199999998, 2023-09-30T17:04:32.028 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.028 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.028 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.028 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.028 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.028 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165801 2023-09-30T17:04:32.028 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.028 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.028 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.028 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.028 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.523598+0000", 2023-09-30T17:04:32.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.029 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.029 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.029 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.523598+0000", 2023-09-30T17:04:32.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.029 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.029 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.029 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.523599+0000", 2023-09-30T17:04:32.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9499999999999998e-07 2023-09-30T17:04:32.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.030 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.030 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.523619+0000", 2023-09-30T17:04:32.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9860999999999998e-05 2023-09-30T17:04:32.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.030 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.030 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.523625+0000", 2023-09-30T17:04:32.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7490000000000001e-06 2023-09-30T17:04:32.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.523631+0000", 2023-09-30T17:04:32.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.801e-06 2023-09-30T17:04:32.031 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.031 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.031 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.031 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165915 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.031 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.552966+0000", 2023-09-30T17:04:32.031 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.34706375, 2023-09-30T17:04:32.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.34837738200000001, 2023-09-30T17:04:32.032 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.032 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.032 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.032 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.032 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.032 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165915 2023-09-30T17:04:32.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.032 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.032 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.032 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.552966+0000", 2023-09-30T17:04:32.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.033 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.033 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.033 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.033 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.552966+0000", 2023-09-30T17:04:32.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.033 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.033 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.033 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.033 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.556676+0000", 2023-09-30T17:04:32.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0037104780000000001 2023-09-30T17:04:32.034 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.034 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.034 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.556699+0000", 2023-09-30T17:04:32.034 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2286e-05 2023-09-30T17:04:32.034 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.034 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.034 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.556708+0000", 2023-09-30T17:04:32.034 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1689999999999998e-06 2023-09-30T17:04:32.034 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.035 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.035 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.556716+0000", 2023-09-30T17:04:32.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8550000000000002e-06 2023-09-30T17:04:32.035 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.035 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.035 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.035 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.035 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.035 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166390 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.035 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.726585+0000", 2023-09-30T17:04:32.035 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.17344495400000001, 2023-09-30T17:04:32.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.174820315, 2023-09-30T17:04:32.036 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.036 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.036 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.036 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.036 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.036 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166390 2023-09-30T17:04:32.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.036 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.036 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.726585+0000", 2023-09-30T17:04:32.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.037 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.726585+0000", 2023-09-30T17:04:32.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.037 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.726585+0000", 2023-09-30T17:04:32.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5400000000000001e-07 2023-09-30T17:04:32.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.038 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.038 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.726599+0000", 2023-09-30T17:04:32.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3896e-05 2023-09-30T17:04:32.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.038 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.038 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.726607+0000", 2023-09-30T17:04:32.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7279999999999995e-06 2023-09-30T17:04:32.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.038 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.039 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.726613+0000", 2023-09-30T17:04:32.039 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4389999999999997e-06 2023-09-30T17:04:32.039 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.039 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.039 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.039 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.039 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166423 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.039 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.744689+0000", 2023-09-30T17:04:32.039 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.155340853, 2023-09-30T17:04:32.039 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.15677680399999999, 2023-09-30T17:04:32.040 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.040 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.040 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.040 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.040 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.040 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166423 2023-09-30T17:04:32.040 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.040 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.040 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.040 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.040 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.744689+0000", 2023-09-30T17:04:32.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.041 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.041 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.041 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.041 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.744689+0000", 2023-09-30T17:04:32.041 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.041 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.041 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.041 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.041 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.744689+0000", 2023-09-30T17:04:32.041 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0699999999999998e-07 2023-09-30T17:04:32.041 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.041 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.042 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.042 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.744714+0000", 2023-09-30T17:04:32.042 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4422000000000001e-05 2023-09-30T17:04:32.042 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.042 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.042 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.042 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.744721+0000", 2023-09-30T17:04:32.042 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9589999999999998e-06 2023-09-30T17:04:32.042 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.042 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.042 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.042 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.744726+0000", 2023-09-30T17:04:32.043 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7910000000000001e-06 2023-09-30T17:04:32.043 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.043 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.043 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.043 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.043 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.043 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166445 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.043 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.754621+0000", 2023-09-30T17:04:32.043 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.14540826000000001, 2023-09-30T17:04:32.043 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.146906759, 2023-09-30T17:04:32.043 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.044 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.044 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.044 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.044 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.044 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166445 2023-09-30T17:04:32.044 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.044 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.044 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.044 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.044 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.754621+0000", 2023-09-30T17:04:32.044 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.045 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.045 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.045 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.045 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.754621+0000", 2023-09-30T17:04:32.045 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.045 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.045 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.045 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.045 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.756545+0000", 2023-09-30T17:04:32.045 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019232990000000001 2023-09-30T17:04:32.045 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.045 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.046 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.046 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.756560+0000", 2023-09-30T17:04:32.046 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5156e-05 2023-09-30T17:04:32.046 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.046 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.046 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.046 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.756568+0000", 2023-09-30T17:04:32.046 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8550000000000002e-06 2023-09-30T17:04:32.046 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.046 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.047 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.047 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.756573+0000", 2023-09-30T17:04:32.047 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5779999999999998e-06 2023-09-30T17:04:32.047 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.047 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.047 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.047 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.047 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.047 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166670 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.047 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.857733+0000", 2023-09-30T17:04:32.047 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.042297043999999999, 2023-09-30T17:04:32.047 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043857314000000001, 2023-09-30T17:04:32.048 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.048 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.048 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.048 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.048 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.048 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166670 2023-09-30T17:04:32.048 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.048 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.048 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.048 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.048 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.857733+0000", 2023-09-30T17:04:32.048 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.049 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.049 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.049 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.049 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.857733+0000", 2023-09-30T17:04:32.049 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.049 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.049 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.049 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.049 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.860528+0000", 2023-09-30T17:04:32.049 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0027957730000000001 2023-09-30T17:04:32.049 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.050 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.050 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.050 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.860567+0000", 2023-09-30T17:04:32.050 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8408000000000002e-05 2023-09-30T17:04:32.050 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.050 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.050 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.050 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.860576+0000", 2023-09-30T17:04:32.050 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3090000000000001e-06 2023-09-30T17:04:32.050 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.050 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.051 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.051 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.860584+0000", 2023-09-30T17:04:32.051 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0860000000000002e-06 2023-09-30T17:04:32.051 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.051 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.051 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.051 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.051 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.051 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166751 4.11 4.3537c7d1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.051 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.885565+0000", 2023-09-30T17:04:32.052 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.014464276999999999, 2023-09-30T17:04:32.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016087731000000001, 2023-09-30T17:04:32.052 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.052 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.052 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.052 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.052 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.052 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166751 2023-09-30T17:04:32.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.052 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.053 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.053 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885565+0000", 2023-09-30T17:04:32.053 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.053 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.053 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.053 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.053 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885565+0000", 2023-09-30T17:04:32.053 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.053 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.053 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.053 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.054 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885566+0000", 2023-09-30T17:04:32.054 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4900000000000001e-07 2023-09-30T17:04:32.054 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.054 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.054 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.054 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885577+0000", 2023-09-30T17:04:32.054 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.114e-05 2023-09-30T17:04:32.054 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.054 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.054 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.054 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885584+0000", 2023-09-30T17:04:32.054 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7669999999999998e-06 2023-09-30T17:04:32.055 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.055 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.055 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.055 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885589+0000", 2023-09-30T17:04:32.055 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0719999999999999e-06 2023-09-30T17:04:32.055 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.055 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.055 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.055 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.055 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.055 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:164997 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.055 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.246002+0000", 2023-09-30T17:04:32.056 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.65402726899999997, 2023-09-30T17:04:32.056 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.65571559199999996, 2023-09-30T17:04:32.056 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.056 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.056 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.056 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.056 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.056 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 164997 2023-09-30T17:04:32.056 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.056 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.056 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.056 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.057 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.246002+0000", 2023-09-30T17:04:32.057 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.057 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.057 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.057 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.057 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.246002+0000", 2023-09-30T17:04:32.057 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.057 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.057 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.057 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.057 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.246003+0000", 2023-09-30T17:04:32.058 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6100000000000002e-07 2023-09-30T17:04:32.058 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.058 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.058 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.058 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.246024+0000", 2023-09-30T17:04:32.058 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1514000000000001e-05 2023-09-30T17:04:32.058 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.058 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.058 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.058 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.246030+0000", 2023-09-30T17:04:32.058 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0070000000000003e-06 2023-09-30T17:04:32.058 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.059 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.059 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.059 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.246036+0000", 2023-09-30T17:04:32.059 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6890000000000001e-06 2023-09-30T17:04:32.059 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.059 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.059 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.059 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.059 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.059 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165069 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.059 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.269624+0000", 2023-09-30T17:04:32.060 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.63040602000000001, 2023-09-30T17:04:32.061 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.63216367699999998, 2023-09-30T17:04:32.061 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.061 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.061 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.061 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.061 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.061 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165069 2023-09-30T17:04:32.061 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.061 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.061 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.062 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.062 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.269624+0000", 2023-09-30T17:04:32.062 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.062 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.062 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.062 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.062 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.269624+0000", 2023-09-30T17:04:32.062 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.062 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.062 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.062 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.063 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.269624+0000", 2023-09-30T17:04:32.063 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9400000000000001e-07 2023-09-30T17:04:32.063 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.063 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.063 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.063 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.269635+0000", 2023-09-30T17:04:32.063 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1347e-05 2023-09-30T17:04:32.063 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.063 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.063 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.063 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.269639+0000", 2023-09-30T17:04:32.063 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.189e-06 2023-09-30T17:04:32.064 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.064 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.064 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.064 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.269643+0000", 2023-09-30T17:04:32.064 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0060000000000001e-06 2023-09-30T17:04:32.064 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.064 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.064 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.064 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.064 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.064 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165309 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.065 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.355834+0000", 2023-09-30T17:04:32.065 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.54419538899999997, 2023-09-30T17:04:32.065 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.54601707799999999, 2023-09-30T17:04:32.065 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.065 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.065 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.065 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.065 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.065 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165309 2023-09-30T17:04:32.065 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.066 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.066 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.066 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.066 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.355834+0000", 2023-09-30T17:04:32.066 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.066 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.066 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.066 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.066 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.355834+0000", 2023-09-30T17:04:32.066 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.066 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.067 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.067 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.067 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.358341+0000", 2023-09-30T17:04:32.067 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0025065030000000002 2023-09-30T17:04:32.067 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.067 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.067 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.067 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.358353+0000", 2023-09-30T17:04:32.067 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2687999999999999e-05 2023-09-30T17:04:32.067 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.067 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.068 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.068 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.358365+0000", 2023-09-30T17:04:32.068 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1949e-05 2023-09-30T17:04:32.068 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.068 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.068 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.068 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.358374+0000", 2023-09-30T17:04:32.068 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0589999999999992e-06 2023-09-30T17:04:32.068 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.068 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.068 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.069 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.069 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.069 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165401 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.069 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.385549+0000", 2023-09-30T17:04:32.069 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.51448070000000001, 2023-09-30T17:04:32.069 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.51639520999999999, 2023-09-30T17:04:32.069 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.069 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.069 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.069 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.069 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.069 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165401 2023-09-30T17:04:32.070 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.070 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.070 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.070 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.070 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.385549+0000", 2023-09-30T17:04:32.070 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.070 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.070 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.070 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.070 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.385549+0000", 2023-09-30T17:04:32.070 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.070 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.071 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.071 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.071 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.385549+0000", 2023-09-30T17:04:32.071 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3099999999999998e-07 2023-09-30T17:04:32.071 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.071 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.071 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.071 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.385562+0000", 2023-09-30T17:04:32.071 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2904999999999999e-05 2023-09-30T17:04:32.071 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.071 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.072 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.072 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.385567+0000", 2023-09-30T17:04:32.072 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5260000000000004e-06 2023-09-30T17:04:32.072 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.072 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.072 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.072 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.385570+0000", 2023-09-30T17:04:32.072 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5499999999999999e-06 2023-09-30T17:04:32.072 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.072 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.072 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.072 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.073 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.073 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165492 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.073 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.408563+0000", 2023-09-30T17:04:32.073 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.49146635500000002, 2023-09-30T17:04:32.073 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.49346115200000001, 2023-09-30T17:04:32.073 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.073 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.073 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.073 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.073 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.073 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165492 2023-09-30T17:04:32.073 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.074 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.074 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.074 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.074 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.408563+0000", 2023-09-30T17:04:32.074 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.074 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.074 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.074 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.074 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.408563+0000", 2023-09-30T17:04:32.074 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.074 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.075 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.075 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.075 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.408564+0000", 2023-09-30T17:04:32.075 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0800000000000005e-07 2023-09-30T17:04:32.075 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.075 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.075 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.075 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.408575+0000", 2023-09-30T17:04:32.075 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0779e-05 2023-09-30T17:04:32.075 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.075 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.075 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.076 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.408581+0000", 2023-09-30T17:04:32.076 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3339999999999998e-06 2023-09-30T17:04:32.076 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.076 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.076 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.076 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.408587+0000", 2023-09-30T17:04:32.076 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6810000000000003e-06 2023-09-30T17:04:32.076 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.076 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.076 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.076 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.077 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.077 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165570 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.077 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.438770+0000", 2023-09-30T17:04:32.077 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.461259272, 2023-09-30T17:04:32.077 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.46331464700000002, 2023-09-30T17:04:32.077 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.077 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.077 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.077 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.077 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.077 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165570 2023-09-30T17:04:32.077 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.078 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.078 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.078 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.078 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.438770+0000", 2023-09-30T17:04:32.078 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.078 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.078 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.078 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.078 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.438770+0000", 2023-09-30T17:04:32.078 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.078 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.079 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.079 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.079 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.440515+0000", 2023-09-30T17:04:32.079 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001744556 2023-09-30T17:04:32.079 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.079 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.079 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.079 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.440529+0000", 2023-09-30T17:04:32.079 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4338999999999999e-05 2023-09-30T17:04:32.079 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.079 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.079 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.080 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.440537+0000", 2023-09-30T17:04:32.080 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9899999999999997e-06 2023-09-30T17:04:32.080 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.080 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.080 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.080 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.440543+0000", 2023-09-30T17:04:32.080 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4299999999999997e-06 2023-09-30T17:04:32.080 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.080 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.080 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.080 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.080 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.081 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165634 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.081 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.468586+0000", 2023-09-30T17:04:32.081 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.43144387099999998, 2023-09-30T17:04:32.081 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.43354222100000001, 2023-09-30T17:04:32.081 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.081 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.081 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.081 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.081 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.081 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165634 2023-09-30T17:04:32.081 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.082 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.082 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.082 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.082 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.468586+0000", 2023-09-30T17:04:32.082 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.082 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.082 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.082 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.082 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.468586+0000", 2023-09-30T17:04:32.082 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.082 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.083 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.083 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.083 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.468586+0000", 2023-09-30T17:04:32.083 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9799999999999999e-07 2023-09-30T17:04:32.083 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.083 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.083 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.083 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.468597+0000", 2023-09-30T17:04:32.083 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1219999999999999e-05 2023-09-30T17:04:32.083 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.083 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.083 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.084 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.468602+0000", 2023-09-30T17:04:32.084 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4329999999999997e-06 2023-09-30T17:04:32.084 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.084 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.084 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.084 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.468607+0000", 2023-09-30T17:04:32.084 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.933e-06 2023-09-30T17:04:32.084 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.084 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.084 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.084 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.084 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.085 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165757 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.085 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.507784+0000", 2023-09-30T17:04:32.085 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.39224572600000002, 2023-09-30T17:04:32.085 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.394374004, 2023-09-30T17:04:32.085 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.085 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.085 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.085 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.085 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.085 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165757 2023-09-30T17:04:32.085 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.086 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.086 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.086 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.086 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.507784+0000", 2023-09-30T17:04:32.086 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.086 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.086 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.086 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.086 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.507784+0000", 2023-09-30T17:04:32.086 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.086 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.086 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.087 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.087 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.507784+0000", 2023-09-30T17:04:32.087 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7e-07 2023-09-30T17:04:32.087 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.087 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.087 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.087 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.507798+0000", 2023-09-30T17:04:32.087 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3322000000000001e-05 2023-09-30T17:04:32.087 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.087 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.087 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.087 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.507804+0000", 2023-09-30T17:04:32.088 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0700000000000003e-06 2023-09-30T17:04:32.088 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.088 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.088 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.088 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.507809+0000", 2023-09-30T17:04:32.088 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.524e-06 2023-09-30T17:04:32.088 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.088 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.088 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.088 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.088 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.088 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165802 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.089 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.523640+0000", 2023-09-30T17:04:32.089 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.376389961, 2023-09-30T17:04:32.089 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.37854770700000001, 2023-09-30T17:04:32.089 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.089 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.089 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.089 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.089 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.089 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165802 2023-09-30T17:04:32.089 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.089 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.089 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.090 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.090 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.523640+0000", 2023-09-30T17:04:32.090 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.090 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.090 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.090 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.090 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.523640+0000", 2023-09-30T17:04:32.090 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.090 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.090 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.090 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.091 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.523640+0000", 2023-09-30T17:04:32.091 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6100000000000001e-07 2023-09-30T17:04:32.091 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.091 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.091 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.091 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.523653+0000", 2023-09-30T17:04:32.091 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2839e-05 2023-09-30T17:04:32.091 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.091 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.091 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.091 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.523660+0000", 2023-09-30T17:04:32.091 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6379999999999998e-06 2023-09-30T17:04:32.092 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.092 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.092 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.092 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.523665+0000", 2023-09-30T17:04:32.092 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2410000000000003e-06 2023-09-30T17:04:32.092 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.092 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.092 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.092 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.092 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.092 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166081 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.092 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.620570+0000", 2023-09-30T17:04:32.093 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.27945947900000001, 2023-09-30T17:04:32.093 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.28164667500000001, 2023-09-30T17:04:32.093 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.093 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.093 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.093 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.093 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.093 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166081 2023-09-30T17:04:32.093 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.093 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.093 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.093 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.094 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.620570+0000", 2023-09-30T17:04:32.094 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.094 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.094 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.094 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.094 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.620570+0000", 2023-09-30T17:04:32.094 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.094 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.094 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.094 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.094 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.620571+0000", 2023-09-30T17:04:32.095 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5200000000000002e-07 2023-09-30T17:04:32.095 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.095 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.095 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.095 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.620584+0000", 2023-09-30T17:04:32.095 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2999e-05 2023-09-30T17:04:32.095 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.095 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.095 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.095 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.620590+0000", 2023-09-30T17:04:32.095 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8589999999999999e-06 2023-09-30T17:04:32.096 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.096 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.096 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.096 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.620596+0000", 2023-09-30T17:04:32.096 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5559999999999998e-06 2023-09-30T17:04:32.096 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.096 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.096 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.096 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.096 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.096 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166424 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.097 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.744734+0000", 2023-09-30T17:04:32.097 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.15529548000000001, 2023-09-30T17:04:32.097 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.15751551499999999, 2023-09-30T17:04:32.097 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.097 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.097 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.097 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.097 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.097 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166424 2023-09-30T17:04:32.097 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.097 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.098 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.098 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.098 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.744734+0000", 2023-09-30T17:04:32.098 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.098 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.098 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.098 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.098 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.744734+0000", 2023-09-30T17:04:32.098 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.098 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.098 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.099 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.099 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.744735+0000", 2023-09-30T17:04:32.099 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8299999999999997e-07 2023-09-30T17:04:32.099 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.099 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.099 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.099 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.744745+0000", 2023-09-30T17:04:32.099 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0076e-05 2023-09-30T17:04:32.099 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.099 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.099 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.099 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.744751+0000", 2023-09-30T17:04:32.100 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7290000000000003e-06 2023-09-30T17:04:32.100 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.100 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.100 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.100 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.744757+0000", 2023-09-30T17:04:32.100 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3959999999999997e-06 2023-09-30T17:04:32.100 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.100 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.100 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.100 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.101 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.101 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166594 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.101 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.812135+0000", 2023-09-30T17:04:32.101 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.087894707000000002, 2023-09-30T17:04:32.101 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.090144373999999999, 2023-09-30T17:04:32.101 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.101 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.101 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.101 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.101 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.101 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166594 2023-09-30T17:04:32.102 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.102 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.102 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.102 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.102 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.812135+0000", 2023-09-30T17:04:32.102 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.102 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.102 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.102 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.102 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.812135+0000", 2023-09-30T17:04:32.102 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.103 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.103 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.103 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.103 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.816518+0000", 2023-09-30T17:04:32.103 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0043834649999999996 2023-09-30T17:04:32.103 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.103 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.103 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.103 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.816537+0000", 2023-09-30T17:04:32.103 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8618e-05 2023-09-30T17:04:32.103 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.104 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.104 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.104 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.816555+0000", 2023-09-30T17:04:32.104 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8371000000000001e-05 2023-09-30T17:04:32.104 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.104 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.104 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.104 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.816563+0000", 2023-09-30T17:04:32.104 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0209999999999999e-06 2023-09-30T17:04:32.104 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.104 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.104 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.105 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.105 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.105 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:165594 4.6 e57/17 4:63e80496:::100000001f8.0000001e:head v 57'10202, mlcod=57'10190)", 2023-09-30T17:04:32.105 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.870591+0000", 2023-09-30T17:04:32.105 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.029438534999999998, 2023-09-30T17:04:32.105 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.031719936999999997, 2023-09-30T17:04:32.105 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.105 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:32.105 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.105 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.105 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.105 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.870591+0000", 2023-09-30T17:04:32.106 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.106 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.106 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.106 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.106 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.870591+0000", 2023-09-30T17:04:32.106 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.106 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.106 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.106 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.106 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.870591+0000", 2023-09-30T17:04:32.106 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7000000000000001e-07 2023-09-30T17:04:32.107 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.107 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.107 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.107 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.870605+0000", 2023-09-30T17:04:32.107 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3834e-05 2023-09-30T17:04:32.107 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.107 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.107 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.107 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.870612+0000", 2023-09-30T17:04:32.107 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3879999999999997e-06 2023-09-30T17:04:32.107 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.107 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.108 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.108 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.870616+0000", 2023-09-30T17:04:32.108 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5580000000000002e-06 2023-09-30T17:04:32.108 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.108 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.108 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:32.108 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.890602+0000", 2023-09-30T17:04:32.108 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019985833000000001 2023-09-30T17:04:32.108 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.108 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.108 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:32.109 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.890615+0000", 2023-09-30T17:04:32.109 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3525e-05 2023-09-30T17:04:32.109 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.109 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.109 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.109 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.109 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.109 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166752 4.18 4:1a1c818c:::100000001f8.0000000d:head [write 3747840~4096 in=4096b,write 4018176~4096 in=4096b,write 4030464~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.109 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.885596+0000", 2023-09-30T17:04:32.109 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.014433901000000001, 2023-09-30T17:04:32.109 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016752230999999999, 2023-09-30T17:04:32.109 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.110 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:32.110 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.110 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.110 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.110 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166752 2023-09-30T17:04:32.110 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.110 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.110 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.110 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.110 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885596+0000", 2023-09-30T17:04:32.110 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.111 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.111 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.111 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.111 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885596+0000", 2023-09-30T17:04:32.111 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.111 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.111 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.111 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.111 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885596+0000", 2023-09-30T17:04:32.111 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1600000000000002e-07 2023-09-30T17:04:32.111 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.112 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.112 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.112 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885607+0000", 2023-09-30T17:04:32.112 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0587e-05 2023-09-30T17:04:32.112 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.112 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.112 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.112 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885613+0000", 2023-09-30T17:04:32.112 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2029999999999997e-06 2023-09-30T17:04:32.112 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.112 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.112 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.113 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885618+0000", 2023-09-30T17:04:32.113 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6959999999999996e-06 2023-09-30T17:04:32.113 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.113 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.113 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:32.113 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.886687+0000", 2023-09-30T17:04:32.113 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001069391 2023-09-30T17:04:32.113 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.113 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.113 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:32.113 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.886758+0000", 2023-09-30T17:04:32.113 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1500000000000003e-05 2023-09-30T17:04:32.114 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.114 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.114 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.114 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.114 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.114 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165357 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.114 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.373743+0000", 2023-09-30T17:04:32.114 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.52628669100000003, 2023-09-30T17:04:32.114 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.52864271500000004, 2023-09-30T17:04:32.114 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.114 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.115 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.115 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.115 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.115 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165357 2023-09-30T17:04:32.115 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.115 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.115 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.115 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.115 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.373743+0000", 2023-09-30T17:04:32.115 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.115 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.115 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.116 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.116 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.373743+0000", 2023-09-30T17:04:32.116 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.116 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.116 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.116 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.116 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.373743+0000", 2023-09-30T17:04:32.116 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1099999999999996e-07 2023-09-30T17:04:32.116 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.116 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.116 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.116 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.373757+0000", 2023-09-30T17:04:32.117 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3275000000000001e-05 2023-09-30T17:04:32.117 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.117 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.117 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.117 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.373762+0000", 2023-09-30T17:04:32.117 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1109999999999999e-06 2023-09-30T17:04:32.117 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.117 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.117 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.117 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.373766+0000", 2023-09-30T17:04:32.117 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0439999999999997e-06 2023-09-30T17:04:32.118 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.118 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.118 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.118 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.118 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.118 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165572 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.118 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.440553+0000", 2023-09-30T17:04:32.118 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.45947653799999999, 2023-09-30T17:04:32.118 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.46188206999999998, 2023-09-30T17:04:32.118 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.118 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.119 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.119 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.119 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.119 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165572 2023-09-30T17:04:32.119 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.119 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.119 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.119 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.119 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.440553+0000", 2023-09-30T17:04:32.119 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.119 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.119 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.120 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.120 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.440553+0000", 2023-09-30T17:04:32.120 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.120 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.120 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.120 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.120 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.440553+0000", 2023-09-30T17:04:32.120 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.89e-07 2023-09-30T17:04:32.120 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.120 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.120 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.120 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.440565+0000", 2023-09-30T17:04:32.121 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1241e-05 2023-09-30T17:04:32.121 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.121 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.121 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.121 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.440570+0000", 2023-09-30T17:04:32.121 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4419999999999997e-06 2023-09-30T17:04:32.121 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.121 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.121 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.121 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.440574+0000", 2023-09-30T17:04:32.121 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.49e-06 2023-09-30T17:04:32.121 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.122 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.122 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.122 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.122 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.122 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165952 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.122 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.569019+0000", 2023-09-30T17:04:32.122 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.33101019300000001, 2023-09-30T17:04:32.122 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.33347092, 2023-09-30T17:04:32.122 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.122 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.122 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.123 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.123 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.123 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165952 2023-09-30T17:04:32.123 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.123 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.123 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.123 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.123 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.569019+0000", 2023-09-30T17:04:32.123 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.123 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.123 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.123 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.124 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.569019+0000", 2023-09-30T17:04:32.124 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.124 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.124 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.124 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.124 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.569020+0000", 2023-09-30T17:04:32.124 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5900000000000002e-07 2023-09-30T17:04:32.124 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.124 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.125 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.125 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.569033+0000", 2023-09-30T17:04:32.125 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2661e-05 2023-09-30T17:04:32.125 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.125 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.125 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.125 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.569039+0000", 2023-09-30T17:04:32.125 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5169999999999996e-06 2023-09-30T17:04:32.125 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.125 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.125 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.125 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.569045+0000", 2023-09-30T17:04:32.126 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8479999999999997e-06 2023-09-30T17:04:32.126 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.126 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.126 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.126 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.126 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.126 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166715 4.35 4:af28909f:::100000001f8.0000001b:head [write 2674688~4096 in=4096b,write 2711552~4096 in=4096b,write 2813952~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.126 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.869794+0000", 2023-09-30T17:04:32.126 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.030235125000000002, 2023-09-30T17:04:32.126 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.032764055, 2023-09-30T17:04:32.126 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.127 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:32.127 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.127 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.127 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.127 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166715 2023-09-30T17:04:32.127 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.127 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.127 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.127 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.127 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.869794+0000", 2023-09-30T17:04:32.127 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.127 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.128 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.128 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.128 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.869794+0000", 2023-09-30T17:04:32.128 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.128 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.128 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.128 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.128 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.871518+0000", 2023-09-30T17:04:32.128 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001723046 2023-09-30T17:04:32.128 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.128 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.129 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.129 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.871533+0000", 2023-09-30T17:04:32.129 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5099999999999999e-05 2023-09-30T17:04:32.129 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.129 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.129 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.129 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.871543+0000", 2023-09-30T17:04:32.129 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0806e-05 2023-09-30T17:04:32.129 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.129 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.129 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.130 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.871551+0000", 2023-09-30T17:04:32.130 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2339999999999997e-06 2023-09-30T17:04:32.130 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.130 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.130 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:32.130 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.875695+0000", 2023-09-30T17:04:32.130 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0041442509999999998 2023-09-30T17:04:32.130 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.130 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.130 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:32.130 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.875781+0000", 2023-09-30T17:04:32.130 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6564000000000007e-05 2023-09-30T17:04:32.131 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.131 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.131 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.131 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.131 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.131 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166754 4.c 4:33b8095f:::100000001f8.0000003a:head [write 2928640~4096 in=4096b,write 2940928~4096 in=4096b,write 2957312~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.131 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.885624+0000", 2023-09-30T17:04:32.131 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.014405217999999999, 2023-09-30T17:04:32.131 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017010856000000001, 2023-09-30T17:04:32.131 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.131 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:32.132 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.132 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.132 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.132 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166754 2023-09-30T17:04:32.132 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.132 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.132 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.132 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.132 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885624+0000", 2023-09-30T17:04:32.132 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.132 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.133 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.133 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885624+0000", 2023-09-30T17:04:32.133 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.133 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.133 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.133 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885625+0000", 2023-09-30T17:04:32.133 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4900000000000001e-07 2023-09-30T17:04:32.133 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.133 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.134 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885643+0000", 2023-09-30T17:04:32.134 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7898999999999999e-05 2023-09-30T17:04:32.134 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.134 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.134 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.134 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885649+0000", 2023-09-30T17:04:32.134 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1600000000000003e-06 2023-09-30T17:04:32.134 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.134 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.134 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.134 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885654+0000", 2023-09-30T17:04:32.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2129999999999999e-06 2023-09-30T17:04:32.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.135 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.135 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:32.135 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.898540+0000", 2023-09-30T17:04:32.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012886432999999999 2023-09-30T17:04:32.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.135 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.135 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:32.135 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.898638+0000", 2023-09-30T17:04:32.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7089999999999994e-05 2023-09-30T17:04:32.136 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.136 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.136 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.136 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.136 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.136 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:164959 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 3719168~4096 in=4096b,write 3870720~4096 in=4096b,write 3973120~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.136 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.235578+0000", 2023-09-30T17:04:32.136 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.66445165100000003, 2023-09-30T17:04:32.136 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.66712371999999998, 2023-09-30T17:04:32.136 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.136 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:32.137 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.137 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.137 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.137 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 164959 2023-09-30T17:04:32.137 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.137 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.137 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.137 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.137 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.235578+0000", 2023-09-30T17:04:32.137 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.137 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.137 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.138 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.138 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.235578+0000", 2023-09-30T17:04:32.138 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.138 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.138 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.138 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.138 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.237517+0000", 2023-09-30T17:04:32.138 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001938808 2023-09-30T17:04:32.138 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.138 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.138 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.139 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.237537+0000", 2023-09-30T17:04:32.139 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0635000000000001e-05 2023-09-30T17:04:32.139 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.139 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.139 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.139 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.237547+0000", 2023-09-30T17:04:32.139 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2490000000000007e-06 2023-09-30T17:04:32.139 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.139 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.139 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.139 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.237553+0000", 2023-09-30T17:04:32.139 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4130000000000003e-06 2023-09-30T17:04:32.140 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.140 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.140 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:32.140 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.879784+0000", 2023-09-30T17:04:32.140 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.64223124899999995 2023-09-30T17:04:32.140 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.140 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.140 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:32.140 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.879854+0000", 2023-09-30T17:04:32.140 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0151e-05 2023-09-30T17:04:32.140 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.141 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.141 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:32.141 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.880651+0000", 2023-09-30T17:04:32.141 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00079613100000000005 2023-09-30T17:04:32.141 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.141 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.141 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:32.141 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.901840+0000", 2023-09-30T17:04:32.141 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021189547 2023-09-30T17:04:32.141 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.141 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.141 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.142 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.142 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.142 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165043 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.142 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.261573+0000", 2023-09-30T17:04:32.142 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.63845656200000001, 2023-09-30T17:04:32.142 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.64118294499999995, 2023-09-30T17:04:32.142 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.142 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.142 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.142 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.142 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.143 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165043 2023-09-30T17:04:32.143 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.143 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.143 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.143 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.143 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.261573+0000", 2023-09-30T17:04:32.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.143 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.143 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.143 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.143 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.261573+0000", 2023-09-30T17:04:32.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.144 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.144 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.144 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.144 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.261574+0000", 2023-09-30T17:04:32.144 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9699999999999996e-07 2023-09-30T17:04:32.144 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.144 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.144 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.144 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.261584+0000", 2023-09-30T17:04:32.144 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0278999999999999e-05 2023-09-30T17:04:32.144 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.145 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.145 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.145 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.261591+0000", 2023-09-30T17:04:32.145 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0840000000000003e-06 2023-09-30T17:04:32.145 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.145 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.145 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.145 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.261596+0000", 2023-09-30T17:04:32.145 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.831e-06 2023-09-30T17:04:32.145 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.145 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.145 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.146 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.146 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.146 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165279 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.146 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.343600+0000", 2023-09-30T17:04:32.146 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.55642970999999997, 2023-09-30T17:04:32.146 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.55918759600000001, 2023-09-30T17:04:32.146 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.146 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.146 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.146 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.146 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.147 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165279 2023-09-30T17:04:32.147 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.147 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.147 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.147 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.147 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.343600+0000", 2023-09-30T17:04:32.147 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.147 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.147 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.147 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.147 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.343600+0000", 2023-09-30T17:04:32.147 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.148 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.148 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.148 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.148 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.346295+0000", 2023-09-30T17:04:32.148 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0026949610000000001 2023-09-30T17:04:32.148 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.148 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.148 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.148 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.346308+0000", 2023-09-30T17:04:32.148 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.295e-05 2023-09-30T17:04:32.148 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.148 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.149 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.149 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.346316+0000", 2023-09-30T17:04:32.149 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8830000000000006e-06 2023-09-30T17:04:32.149 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.149 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.149 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.149 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.346322+0000", 2023-09-30T17:04:32.149 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.669e-06 2023-09-30T17:04:32.149 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.149 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.149 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.149 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.150 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.150 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165534 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.150 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.418653+0000", 2023-09-30T17:04:32.150 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.481376629, 2023-09-30T17:04:32.150 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.48416593899999999, 2023-09-30T17:04:32.150 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.150 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.150 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.150 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.150 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.150 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165534 2023-09-30T17:04:32.151 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.151 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.151 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.151 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.151 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.418653+0000", 2023-09-30T17:04:32.151 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.151 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.151 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.151 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.151 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.418653+0000", 2023-09-30T17:04:32.151 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.152 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.152 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.152 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.152 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.418653+0000", 2023-09-30T17:04:32.152 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0200000000000002e-07 2023-09-30T17:04:32.152 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.152 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.152 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.152 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.418674+0000", 2023-09-30T17:04:32.152 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0766000000000001e-05 2023-09-30T17:04:32.152 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.152 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.153 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.153 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.418681+0000", 2023-09-30T17:04:32.153 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1690000000000003e-06 2023-09-30T17:04:32.153 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.153 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.153 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.153 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.418687+0000", 2023-09-30T17:04:32.153 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6559999999999997e-06 2023-09-30T17:04:32.153 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.153 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.153 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.153 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.154 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.154 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165925 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.154 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.556806+0000", 2023-09-30T17:04:32.154 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.34322399999999997, 2023-09-30T17:04:32.154 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.346044711, 2023-09-30T17:04:32.154 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.154 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.154 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.154 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.154 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.154 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165925 2023-09-30T17:04:32.155 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.155 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.155 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.155 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.155 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.556806+0000", 2023-09-30T17:04:32.155 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.155 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.155 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.155 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.155 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.556806+0000", 2023-09-30T17:04:32.155 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.155 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.156 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.156 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.156 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.556806+0000", 2023-09-30T17:04:32.156 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9699999999999996e-07 2023-09-30T17:04:32.156 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.156 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.156 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.156 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.556819+0000", 2023-09-30T17:04:32.156 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3355e-05 2023-09-30T17:04:32.156 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.156 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.156 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.157 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.556826+0000", 2023-09-30T17:04:32.157 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7179999999999999e-06 2023-09-30T17:04:32.157 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.157 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.157 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.157 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.556832+0000", 2023-09-30T17:04:32.157 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3680000000000001e-06 2023-09-30T17:04:32.157 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.157 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.157 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.157 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.157 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.158 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166427 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.158 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.745477+0000", 2023-09-30T17:04:32.158 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.154552628, 2023-09-30T17:04:32.158 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.15740472899999999, 2023-09-30T17:04:32.158 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.158 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.158 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.158 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.158 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.158 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166427 2023-09-30T17:04:32.158 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.159 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.159 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.159 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.159 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.745477+0000", 2023-09-30T17:04:32.159 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.159 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.159 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.159 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.159 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.745477+0000", 2023-09-30T17:04:32.159 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.159 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.159 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.160 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.160 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.745478+0000", 2023-09-30T17:04:32.160 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1200000000000003e-07 2023-09-30T17:04:32.160 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.160 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.160 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.160 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.745490+0000", 2023-09-30T17:04:32.160 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2748000000000001e-05 2023-09-30T17:04:32.160 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.160 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.160 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.160 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.745496+0000", 2023-09-30T17:04:32.161 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1229999999999997e-06 2023-09-30T17:04:32.161 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.161 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.161 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.161 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.745502+0000", 2023-09-30T17:04:32.161 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0460000000000002e-06 2023-09-30T17:04:32.161 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.161 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.161 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.161 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.161 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.162 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166756 4.35 4:af28909f:::100000001f8.0000001b:head [write 3760128~4096 in=4096b,write 3784704~4096 in=4096b,write 3878912~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.162 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.885663+0000", 2023-09-30T17:04:32.162 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.014366159, 2023-09-30T17:04:32.162 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017258023000000001, 2023-09-30T17:04:32.162 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.162 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:32.162 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.162 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.162 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.162 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166756 2023-09-30T17:04:32.162 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.162 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.163 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.163 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.163 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885663+0000", 2023-09-30T17:04:32.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.163 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.163 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.163 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.163 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885663+0000", 2023-09-30T17:04:32.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.163 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.163 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.164 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.164 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885664+0000", 2023-09-30T17:04:32.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7000000000000005e-07 2023-09-30T17:04:32.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.164 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.164 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885675+0000", 2023-09-30T17:04:32.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0638e-05 2023-09-30T17:04:32.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.164 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.164 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885681+0000", 2023-09-30T17:04:32.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0140000000000004e-06 2023-09-30T17:04:32.165 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.165 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.165 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.165 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885685+0000", 2023-09-30T17:04:32.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6249999999999998e-06 2023-09-30T17:04:32.165 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.165 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.165 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:32.165 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885861+0000", 2023-09-30T17:04:32.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000175792 2023-09-30T17:04:32.165 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.166 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:32.166 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885938+0000", 2023-09-30T17:04:32.166 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7062000000000002e-05 2023-09-30T17:04:32.166 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.166 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.166 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.166 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.166 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165497 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.166 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.408628+0000", 2023-09-30T17:04:32.167 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.49140168899999997, 2023-09-30T17:04:32.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.49434313200000002, 2023-09-30T17:04:32.167 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.167 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.167 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.167 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.167 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.167 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165497 2023-09-30T17:04:32.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.167 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.408628+0000", 2023-09-30T17:04:32.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.408628+0000", 2023-09-30T17:04:32.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.410517+0000", 2023-09-30T17:04:32.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001889476 2023-09-30T17:04:32.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.410530+0000", 2023-09-30T17:04:32.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2126999999999999e-05 2023-09-30T17:04:32.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.410538+0000", 2023-09-30T17:04:32.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5439999999999999e-06 2023-09-30T17:04:32.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.170 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.170 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.410544+0000", 2023-09-30T17:04:32.170 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5949999999999998e-06 2023-09-30T17:04:32.170 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.170 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.170 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.170 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165536 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.171 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.418698+0000", 2023-09-30T17:04:32.171 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.48133136900000001, 2023-09-30T17:04:32.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.48431770099999999, 2023-09-30T17:04:32.171 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.171 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.171 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.171 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.171 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.171 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165536 2023-09-30T17:04:32.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.171 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.172 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.172 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.418698+0000", 2023-09-30T17:04:32.172 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.172 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.172 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.418698+0000", 2023-09-30T17:04:32.172 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.173 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.173 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.418699+0000", 2023-09-30T17:04:32.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4899999999999995e-07 2023-09-30T17:04:32.173 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.173 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.173 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.418715+0000", 2023-09-30T17:04:32.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5928000000000001e-05 2023-09-30T17:04:32.173 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.173 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.173 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.418722+0000", 2023-09-30T17:04:32.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5190000000000003e-06 2023-09-30T17:04:32.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.418728+0000", 2023-09-30T17:04:32.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8340000000000004e-06 2023-09-30T17:04:32.174 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.174 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.174 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.175 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165638 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.175 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.468692+0000", 2023-09-30T17:04:32.175 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.43133774400000002, 2023-09-30T17:04:32.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.43435895499999999, 2023-09-30T17:04:32.175 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.175 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.175 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.175 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.175 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.175 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165638 2023-09-30T17:04:32.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.175 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.468692+0000", 2023-09-30T17:04:32.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.468692+0000", 2023-09-30T17:04:32.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.177 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.468692+0000", 2023-09-30T17:04:32.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6400000000000002e-07 2023-09-30T17:04:32.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.177 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.177 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.468705+0000", 2023-09-30T17:04:32.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2186e-05 2023-09-30T17:04:32.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.177 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.177 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.468733+0000", 2023-09-30T17:04:32.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8759e-05 2023-09-30T17:04:32.178 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.178 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.178 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.178 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.468746+0000", 2023-09-30T17:04:32.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2386e-05 2023-09-30T17:04:32.178 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.178 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.178 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.178 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.178 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.178 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165810 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.179 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.525596+0000", 2023-09-30T17:04:32.179 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.37443346500000002, 2023-09-30T17:04:32.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.377485776, 2023-09-30T17:04:32.179 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.179 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.179 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.179 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.179 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.179 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165810 2023-09-30T17:04:32.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.179 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.180 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.180 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.525596+0000", 2023-09-30T17:04:32.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.180 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.180 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.525596+0000", 2023-09-30T17:04:32.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.180 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.180 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.525597+0000", 2023-09-30T17:04:32.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.51e-07 2023-09-30T17:04:32.181 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.181 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.181 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.181 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.525610+0000", 2023-09-30T17:04:32.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3356999999999999e-05 2023-09-30T17:04:32.181 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.181 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.181 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.181 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.525619+0000", 2023-09-30T17:04:32.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3279999999999995e-06 2023-09-30T17:04:32.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.182 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.182 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.525625+0000", 2023-09-30T17:04:32.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9850000000000003e-06 2023-09-30T17:04:32.182 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.182 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.182 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.182 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166160 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.182 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.644503+0000", 2023-09-30T17:04:32.183 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.25552641100000001, 2023-09-30T17:04:32.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.258616819, 2023-09-30T17:04:32.183 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.183 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.183 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.183 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.183 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.183 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166160 2023-09-30T17:04:32.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.183 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.184 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.184 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.644503+0000", 2023-09-30T17:04:32.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.184 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.184 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.644503+0000", 2023-09-30T17:04:32.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.184 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.184 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.644504+0000", 2023-09-30T17:04:32.185 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7800000000000002e-07 2023-09-30T17:04:32.185 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.185 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.185 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.185 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.644518+0000", 2023-09-30T17:04:32.185 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4318000000000001e-05 2023-09-30T17:04:32.185 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.185 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.185 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.185 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.644525+0000", 2023-09-30T17:04:32.185 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8299999999999998e-06 2023-09-30T17:04:32.186 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.186 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.186 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.186 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.644530+0000", 2023-09-30T17:04:32.186 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4700000000000001e-06 2023-09-30T17:04:32.186 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.186 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.186 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.186 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.186 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.186 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166455 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.186 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.756668+0000", 2023-09-30T17:04:32.187 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.143361197, 2023-09-30T17:04:32.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.146507411, 2023-09-30T17:04:32.187 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.187 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.187 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.187 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.187 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.187 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166455 2023-09-30T17:04:32.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.187 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.188 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.188 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.756668+0000", 2023-09-30T17:04:32.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.188 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.188 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.756668+0000", 2023-09-30T17:04:32.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.188 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.188 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.756669+0000", 2023-09-30T17:04:32.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5400000000000002e-07 2023-09-30T17:04:32.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.756681+0000", 2023-09-30T17:04:32.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2243e-05 2023-09-30T17:04:32.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.756687+0000", 2023-09-30T17:04:32.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9109999999999998e-06 2023-09-30T17:04:32.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.190 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.190 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.756691+0000", 2023-09-30T17:04:32.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5249999999999999e-06 2023-09-30T17:04:32.190 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.190 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.190 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.190 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166757 4.29 4.51b1e829 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.190 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.885691+0000", 2023-09-30T17:04:32.191 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.014338251999999999, 2023-09-30T17:04:32.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017518889999999999, 2023-09-30T17:04:32.191 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.191 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.191 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.191 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.191 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.191 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166757 2023-09-30T17:04:32.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.191 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.191 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.192 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885691+0000", 2023-09-30T17:04:32.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.192 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885691+0000", 2023-09-30T17:04:32.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.192 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885692+0000", 2023-09-30T17:04:32.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1100000000000001e-07 2023-09-30T17:04:32.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885705+0000", 2023-09-30T17:04:32.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3237999999999999e-05 2023-09-30T17:04:32.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885711+0000", 2023-09-30T17:04:32.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.976e-06 2023-09-30T17:04:32.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.194 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885716+0000", 2023-09-30T17:04:32.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7380000000000002e-06 2023-09-30T17:04:32.194 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.194 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.194 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.194 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:164964 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 2502656~4096 in=4096b,write 2547712~4096 in=4096b,write 2576384~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.194 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.237602+0000", 2023-09-30T17:04:32.195 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.66242729499999997, 2023-09-30T17:04:32.195 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.66564330299999996, 2023-09-30T17:04:32.195 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.195 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:32.195 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.195 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.195 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.195 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 164964 2023-09-30T17:04:32.195 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.195 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.195 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.195 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.196 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.237602+0000", 2023-09-30T17:04:32.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.196 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.196 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.196 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.196 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.237602+0000", 2023-09-30T17:04:32.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.196 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.196 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.196 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.196 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.237603+0000", 2023-09-30T17:04:32.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1600000000000002e-07 2023-09-30T17:04:32.197 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.197 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.197 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.237617+0000", 2023-09-30T17:04:32.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4450000000000001e-05 2023-09-30T17:04:32.197 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.197 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.197 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.237623+0000", 2023-09-30T17:04:32.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3339999999999998e-06 2023-09-30T17:04:32.197 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.198 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.198 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.237628+0000", 2023-09-30T17:04:32.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8110000000000002e-06 2023-09-30T17:04:32.198 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.198 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.198 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:32.198 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885672+0000", 2023-09-30T17:04:32.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.64804384299999995 2023-09-30T17:04:32.198 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.198 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.198 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:32.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885746+0000", 2023-09-30T17:04:32.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3757000000000006e-05 2023-09-30T17:04:32.199 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.199 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.199 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.199 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165811 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.199 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.525635+0000", 2023-09-30T17:04:32.199 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.37439476700000002, 2023-09-30T17:04:32.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.37764767999999999, 2023-09-30T17:04:32.199 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.200 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.200 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.200 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.200 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.200 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165811 2023-09-30T17:04:32.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.200 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.200 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.525635+0000", 2023-09-30T17:04:32.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.201 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.201 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.525635+0000", 2023-09-30T17:04:32.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.201 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.201 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.525635+0000", 2023-09-30T17:04:32.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2099999999999997e-07 2023-09-30T17:04:32.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.202 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.202 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.525650+0000", 2023-09-30T17:04:32.202 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4708999999999999e-05 2023-09-30T17:04:32.202 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.202 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.202 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.525657+0000", 2023-09-30T17:04:32.202 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1019999999999999e-06 2023-09-30T17:04:32.202 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.202 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.203 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.525663+0000", 2023-09-30T17:04:32.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6409999999999999e-06 2023-09-30T17:04:32.203 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.203 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.203 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.203 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.203 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166163 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.203 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.644538+0000", 2023-09-30T17:04:32.203 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.255491631, 2023-09-30T17:04:32.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.25882893600000001, 2023-09-30T17:04:32.204 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.204 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.204 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.204 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.204 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.204 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166163 2023-09-30T17:04:32.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.204 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.204 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.204 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.644538+0000", 2023-09-30T17:04:32.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.205 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.205 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.205 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.644538+0000", 2023-09-30T17:04:32.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.205 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.205 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.205 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.644538+0000", 2023-09-30T17:04:32.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4999999999999998e-07 2023-09-30T17:04:32.205 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.206 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.206 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.644555+0000", 2023-09-30T17:04:32.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6634e-05 2023-09-30T17:04:32.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.206 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.206 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.644561+0000", 2023-09-30T17:04:32.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2299999999999996e-06 2023-09-30T17:04:32.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.207 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.207 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.644566+0000", 2023-09-30T17:04:32.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0669999999999999e-06 2023-09-30T17:04:32.207 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.207 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.207 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.207 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166393 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.207 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.728557+0000", 2023-09-30T17:04:32.207 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.171472227, 2023-09-30T17:04:32.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.17484976299999999, 2023-09-30T17:04:32.208 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.208 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.208 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.208 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.208 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.208 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166393 2023-09-30T17:04:32.208 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.208 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.208 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.208 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.728557+0000", 2023-09-30T17:04:32.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.209 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.209 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.209 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.728557+0000", 2023-09-30T17:04:32.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.209 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.209 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.209 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.728558+0000", 2023-09-30T17:04:32.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5499999999999998e-07 2023-09-30T17:04:32.209 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.210 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.728576+0000", 2023-09-30T17:04:32.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7904e-05 2023-09-30T17:04:32.210 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.210 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.728583+0000", 2023-09-30T17:04:32.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.153e-06 2023-09-30T17:04:32.210 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.728589+0000", 2023-09-30T17:04:32.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7019999999999998e-06 2023-09-30T17:04:32.211 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.211 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.211 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.211 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:167171 4.3f e57/17 4:fde182c5:::100000001f8.00000039:head v 57'2548, mlcod=57'2544)", 2023-09-30T17:04:32.211 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.874466+0000", 2023-09-30T17:04:32.211 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.025564013, 2023-09-30T17:04:32.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.028974506000000001, 2023-09-30T17:04:32.211 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.212 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:32.212 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.212 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.212 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.874466+0000", 2023-09-30T17:04:32.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.212 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.212 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.212 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.874466+0000", 2023-09-30T17:04:32.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.212 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.213 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.213 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.213 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.874467+0000", 2023-09-30T17:04:32.213 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.19e-06 2023-09-30T17:04:32.213 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.213 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.213 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.213 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.874487+0000", 2023-09-30T17:04:32.213 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0494000000000001e-05 2023-09-30T17:04:32.213 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.213 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.214 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.214 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.874498+0000", 2023-09-30T17:04:32.214 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0726e-05 2023-09-30T17:04:32.214 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.214 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.214 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.874508+0000", 2023-09-30T17:04:32.214 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.025e-05 2023-09-30T17:04:32.214 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.214 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:32.214 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.876881+0000", 2023-09-30T17:04:32.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0023727549999999998 2023-09-30T17:04:32.215 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.215 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:32.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.876900+0000", 2023-09-30T17:04:32.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9025000000000002e-05 2023-09-30T17:04:32.215 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.215 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.215 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.215 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.216 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166758 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.216 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.885722+0000", 2023-09-30T17:04:32.216 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.014307973999999999, 2023-09-30T17:04:32.216 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017752199, 2023-09-30T17:04:32.216 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.216 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.216 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.216 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.216 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.216 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166758 2023-09-30T17:04:32.216 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.216 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.217 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.217 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885722+0000", 2023-09-30T17:04:32.217 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.217 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.217 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.217 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885722+0000", 2023-09-30T17:04:32.217 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.217 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.217 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.218 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885722+0000", 2023-09-30T17:04:32.218 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5400000000000001e-07 2023-09-30T17:04:32.218 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.218 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.218 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.218 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885735+0000", 2023-09-30T17:04:32.218 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2748000000000001e-05 2023-09-30T17:04:32.218 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.218 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.218 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.218 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885741+0000", 2023-09-30T17:04:32.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0020000000000003e-06 2023-09-30T17:04:32.219 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.219 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.219 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885747+0000", 2023-09-30T17:04:32.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1070000000000001e-06 2023-09-30T17:04:32.219 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.219 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.219 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.219 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.220 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165158 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.220 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.299750+0000", 2023-09-30T17:04:32.220 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.60027957200000004, 2023-09-30T17:04:32.220 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.603764089, 2023-09-30T17:04:32.220 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.220 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.220 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.220 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.220 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.220 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165158 2023-09-30T17:04:32.220 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.220 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.221 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.221 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.221 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.299750+0000", 2023-09-30T17:04:32.221 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.221 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.221 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.221 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.221 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.299750+0000", 2023-09-30T17:04:32.221 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.221 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.221 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.221 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.222 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.299751+0000", 2023-09-30T17:04:32.222 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4799999999999998e-07 2023-09-30T17:04:32.222 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.222 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.222 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.222 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.299762+0000", 2023-09-30T17:04:32.222 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1181e-05 2023-09-30T17:04:32.222 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.222 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.222 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.222 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.299769+0000", 2023-09-30T17:04:32.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2089999999999999e-06 2023-09-30T17:04:32.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.223 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.299775+0000", 2023-09-30T17:04:32.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.614e-06 2023-09-30T17:04:32.223 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.223 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.223 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.223 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165466 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.224 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.398561+0000", 2023-09-30T17:04:32.224 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.50146838400000004, 2023-09-30T17:04:32.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.504985087, 2023-09-30T17:04:32.224 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.224 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.224 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.224 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.224 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.224 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165466 2023-09-30T17:04:32.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.224 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.225 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.225 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.225 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.398561+0000", 2023-09-30T17:04:32.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.225 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.225 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.225 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.225 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.398561+0000", 2023-09-30T17:04:32.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.225 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.225 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.225 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.226 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.398562+0000", 2023-09-30T17:04:32.226 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0100000000000005e-07 2023-09-30T17:04:32.226 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.226 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.226 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.226 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.398576+0000", 2023-09-30T17:04:32.226 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3706000000000001e-05 2023-09-30T17:04:32.226 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.226 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.226 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.226 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.398582+0000", 2023-09-30T17:04:32.226 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.754e-06 2023-09-30T17:04:32.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.398588+0000", 2023-09-30T17:04:32.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.626e-06 2023-09-30T17:04:32.227 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.227 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.227 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.227 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165640 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.227 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.468836+0000", 2023-09-30T17:04:32.228 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.43119348299999999, 2023-09-30T17:04:32.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.43473977400000002, 2023-09-30T17:04:32.228 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.228 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.228 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.228 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.228 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.228 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165640 2023-09-30T17:04:32.228 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.228 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.228 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.229 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.229 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.468836+0000", 2023-09-30T17:04:32.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.229 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.229 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.468836+0000", 2023-09-30T17:04:32.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.229 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.229 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.468837+0000", 2023-09-30T17:04:32.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1900000000000003e-07 2023-09-30T17:04:32.230 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.230 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.230 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.468864+0000", 2023-09-30T17:04:32.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7622000000000001e-05 2023-09-30T17:04:32.230 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.230 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.230 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.468885+0000", 2023-09-30T17:04:32.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0505000000000001e-05 2023-09-30T17:04:32.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.231 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.468891+0000", 2023-09-30T17:04:32.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1709999999999999e-06 2023-09-30T17:04:32.231 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.231 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.231 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.231 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165717 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.231 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.497597+0000", 2023-09-30T17:04:32.232 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.40243289500000001, 2023-09-30T17:04:32.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.40601012199999997, 2023-09-30T17:04:32.232 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.232 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.232 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.232 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.232 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.232 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165717 2023-09-30T17:04:32.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.232 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.233 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.497597+0000", 2023-09-30T17:04:32.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.233 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.233 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.233 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.497597+0000", 2023-09-30T17:04:32.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.233 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.233 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.233 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.497597+0000", 2023-09-30T17:04:32.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2300000000000001e-07 2023-09-30T17:04:32.234 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.234 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.234 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.234 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.497606+0000", 2023-09-30T17:04:32.234 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6510000000000007e-06 2023-09-30T17:04:32.234 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.234 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.234 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.234 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.497612+0000", 2023-09-30T17:04:32.234 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7660000000000004e-06 2023-09-30T17:04:32.234 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.235 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.235 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.235 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.497617+0000", 2023-09-30T17:04:32.235 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8890000000000001e-06 2023-09-30T17:04:32.235 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.235 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.235 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.235 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.235 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.235 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165953 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.235 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.569052+0000", 2023-09-30T17:04:32.235 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.33097751399999997, 2023-09-30T17:04:32.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.33458466399999998, 2023-09-30T17:04:32.236 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.236 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.236 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.236 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.236 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.236 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165953 2023-09-30T17:04:32.236 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.236 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.236 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.236 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.236 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.569052+0000", 2023-09-30T17:04:32.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.569052+0000", 2023-09-30T17:04:32.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.572515+0000", 2023-09-30T17:04:32.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0034633239999999998 2023-09-30T17:04:32.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.572532+0000", 2023-09-30T17:04:32.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6447999999999999e-05 2023-09-30T17:04:32.238 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.572545+0000", 2023-09-30T17:04:32.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2972999999999999e-05 2023-09-30T17:04:32.238 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.239 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.572552+0000", 2023-09-30T17:04:32.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4800000000000004e-06 2023-09-30T17:04:32.239 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.239 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.239 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.239 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166023 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.239 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.600048+0000", 2023-09-30T17:04:32.239 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.29998201200000002, 2023-09-30T17:04:32.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.30362096100000002, 2023-09-30T17:04:32.239 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.240 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.240 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.240 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.240 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.240 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166023 2023-09-30T17:04:32.240 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.240 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.240 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.240 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.240 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.600048+0000", 2023-09-30T17:04:32.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.241 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.241 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.241 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.600048+0000", 2023-09-30T17:04:32.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.241 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.241 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.241 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.600048+0000", 2023-09-30T17:04:32.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.23e-07 2023-09-30T17:04:32.241 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.600067+0000", 2023-09-30T17:04:32.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8553e-05 2023-09-30T17:04:32.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.600108+0000", 2023-09-30T17:04:32.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0818999999999997e-05 2023-09-30T17:04:32.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.600116+0000", 2023-09-30T17:04:32.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8979999999999996e-06 2023-09-30T17:04:32.243 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.243 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.243 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.243 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166253 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.243 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.675549+0000", 2023-09-30T17:04:32.243 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.224480443, 2023-09-30T17:04:32.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.22815010199999999, 2023-09-30T17:04:32.244 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.244 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.244 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.244 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.244 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.244 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166253 2023-09-30T17:04:32.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.244 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.675549+0000", 2023-09-30T17:04:32.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.245 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.245 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.675549+0000", 2023-09-30T17:04:32.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.245 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.245 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.677516+0000", 2023-09-30T17:04:32.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019666699999999998 2023-09-30T17:04:32.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.246 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.246 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.677533+0000", 2023-09-30T17:04:32.246 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6841e-05 2023-09-30T17:04:32.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.246 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.246 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.677544+0000", 2023-09-30T17:04:32.246 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.153e-05 2023-09-30T17:04:32.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.246 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.677551+0000", 2023-09-30T17:04:32.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6919999999999996e-06 2023-09-30T17:04:32.247 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.247 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.247 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.247 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:165581 4.6 e57/17 4:62d56fc8:::100000001f8.0000001c:head v 57'10200, mlcod=57'10188)", 2023-09-30T17:04:32.247 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.862710+0000", 2023-09-30T17:04:32.247 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.037319544000000003, 2023-09-30T17:04:32.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.041022698000000003, 2023-09-30T17:04:32.248 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.248 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:32.248 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.248 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.248 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.862710+0000", 2023-09-30T17:04:32.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.248 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.248 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.249 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.862710+0000", 2023-09-30T17:04:32.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.862710+0000", 2023-09-30T17:04:32.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5599999999999999e-07 2023-09-30T17:04:32.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.862727+0000", 2023-09-30T17:04:32.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6847999999999999e-05 2023-09-30T17:04:32.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.862731+0000", 2023-09-30T17:04:32.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6969999999999999e-06 2023-09-30T17:04:32.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.862734+0000", 2023-09-30T17:04:32.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.858e-06 2023-09-30T17:04:32.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:32.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.884136+0000", 2023-09-30T17:04:32.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021402667 2023-09-30T17:04:32.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:32.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.884163+0000", 2023-09-30T17:04:32.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6274e-05 2023-09-30T17:04:32.252 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.252 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.252 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.253 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:165602 4.2e e57/17)", 2023-09-30T17:04:32.253 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.874525+0000", 2023-09-30T17:04:32.253 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.025504289999999999, 2023-09-30T17:04:32.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.029240542000000001, 2023-09-30T17:04:32.253 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.253 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.253 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.253 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.254 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.874525+0000", 2023-09-30T17:04:32.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.254 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.254 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.254 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.874525+0000", 2023-09-30T17:04:32.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.254 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.254 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.874526+0000", 2023-09-30T17:04:32.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2599999999999998e-07 2023-09-30T17:04:32.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.874537+0000", 2023-09-30T17:04:32.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1566000000000001e-05 2023-09-30T17:04:32.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.874545+0000", 2023-09-30T17:04:32.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.481e-06 2023-09-30T17:04:32.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.874559+0000", 2023-09-30T17:04:32.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3956e-05 2023-09-30T17:04:32.256 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.256 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.256 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.256 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166759 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.257 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.885753+0000", 2023-09-30T17:04:32.257 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.014276558999999999, 2023-09-30T17:04:32.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018041725000000002, 2023-09-30T17:04:32.257 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.257 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.257 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.257 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.257 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.257 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166759 2023-09-30T17:04:32.258 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.258 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.258 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885753+0000", 2023-09-30T17:04:32.258 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.258 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.258 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885753+0000", 2023-09-30T17:04:32.258 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.258 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.259 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885753+0000", 2023-09-30T17:04:32.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4700000000000002e-07 2023-09-30T17:04:32.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.259 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885764+0000", 2023-09-30T17:04:32.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0244000000000001e-05 2023-09-30T17:04:32.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885769+0000", 2023-09-30T17:04:32.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6559999999999997e-06 2023-09-30T17:04:32.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885774+0000", 2023-09-30T17:04:32.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6670000000000004e-06 2023-09-30T17:04:32.260 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.261 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.261 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.261 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165619 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.261 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.456630+0000", 2023-09-30T17:04:32.261 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.44339909100000002, 2023-09-30T17:04:32.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.44719787500000002, 2023-09-30T17:04:32.261 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.262 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.262 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.262 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.262 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.262 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165619 2023-09-30T17:04:32.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.262 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.262 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.262 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.456630+0000", 2023-09-30T17:04:32.262 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.456630+0000", 2023-09-30T17:04:32.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.456631+0000", 2023-09-30T17:04:32.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9900000000000001e-07 2023-09-30T17:04:32.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.456643+0000", 2023-09-30T17:04:32.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2237e-05 2023-09-30T17:04:32.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.456650+0000", 2023-09-30T17:04:32.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.17e-06 2023-09-30T17:04:32.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.266 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.456655+0000", 2023-09-30T17:04:32.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9699999999999998e-06 2023-09-30T17:04:32.266 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.266 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.266 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.266 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.266 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.266 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165641 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.266 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.468904+0000", 2023-09-30T17:04:32.266 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.43112585799999997, 2023-09-30T17:04:32.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.434966358, 2023-09-30T17:04:32.267 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.267 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.267 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.267 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.267 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.267 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165641 2023-09-30T17:04:32.267 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.267 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.267 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.267 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.468904+0000", 2023-09-30T17:04:32.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.268 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.268 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.268 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.468904+0000", 2023-09-30T17:04:32.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.268 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.268 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.268 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.468904+0000", 2023-09-30T17:04:32.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5599999999999995e-07 2023-09-30T17:04:32.268 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.269 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.269 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.468920+0000", 2023-09-30T17:04:32.269 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5783000000000001e-05 2023-09-30T17:04:32.269 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.269 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.269 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.468928+0000", 2023-09-30T17:04:32.269 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6699999999999994e-06 2023-09-30T17:04:32.269 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.270 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.468932+0000", 2023-09-30T17:04:32.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7689999999999998e-06 2023-09-30T17:04:32.270 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.270 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.270 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.270 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165763 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.270 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.514563+0000", 2023-09-30T17:04:32.270 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.38546650700000001, 2023-09-30T17:04:32.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.38935925900000001, 2023-09-30T17:04:32.271 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.271 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.271 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.271 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.271 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.271 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165763 2023-09-30T17:04:32.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.271 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.514563+0000", 2023-09-30T17:04:32.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.272 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.272 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.514563+0000", 2023-09-30T17:04:32.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.272 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.272 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.514563+0000", 2023-09-30T17:04:32.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3799999999999998e-07 2023-09-30T17:04:32.273 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.273 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.273 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.273 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.514580+0000", 2023-09-30T17:04:32.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6969e-05 2023-09-30T17:04:32.273 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.273 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.273 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.273 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.514585+0000", 2023-09-30T17:04:32.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4059999999999998e-06 2023-09-30T17:04:32.273 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.274 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.274 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.514588+0000", 2023-09-30T17:04:32.274 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5449999999999999e-06 2023-09-30T17:04:32.274 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.274 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.274 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.274 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.274 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165955 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.274 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.572567+0000", 2023-09-30T17:04:32.275 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.32746276800000002, 2023-09-30T17:04:32.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.33138746299999999, 2023-09-30T17:04:32.275 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.275 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.275 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.275 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.275 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.275 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165955 2023-09-30T17:04:32.275 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.275 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.572567+0000", 2023-09-30T17:04:32.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.572567+0000", 2023-09-30T17:04:32.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.572567+0000", 2023-09-30T17:04:32.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8599999999999998e-07 2023-09-30T17:04:32.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.572587+0000", 2023-09-30T17:04:32.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9958000000000001e-05 2023-09-30T17:04:32.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.572596+0000", 2023-09-30T17:04:32.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4689999999999997e-06 2023-09-30T17:04:32.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.572601+0000", 2023-09-30T17:04:32.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5300000000000004e-06 2023-09-30T17:04:32.278 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.278 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.279 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.279 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166169 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.279 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.645837+0000", 2023-09-30T17:04:32.279 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.25419265099999999, 2023-09-30T17:04:32.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.25816370599999999, 2023-09-30T17:04:32.279 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.279 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.279 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.280 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.280 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.280 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166169 2023-09-30T17:04:32.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.280 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.280 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.280 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.645837+0000", 2023-09-30T17:04:32.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.645837+0000", 2023-09-30T17:04:32.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.645838+0000", 2023-09-30T17:04:32.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9199999999999999e-07 2023-09-30T17:04:32.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.645857+0000", 2023-09-30T17:04:32.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8766999999999998e-05 2023-09-30T17:04:32.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.645867+0000", 2023-09-30T17:04:32.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8940000000000005e-06 2023-09-30T17:04:32.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.283 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.283 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.645875+0000", 2023-09-30T17:04:32.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8429999999999999e-06 2023-09-30T17:04:32.283 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.283 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.283 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.284 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166200 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.284 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.657525+0000", 2023-09-30T17:04:32.284 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.24250469199999999, 2023-09-30T17:04:32.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.24652948999999999, 2023-09-30T17:04:32.284 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.284 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.284 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.284 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.285 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.285 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166200 2023-09-30T17:04:32.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.285 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.657525+0000", 2023-09-30T17:04:32.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.657525+0000", 2023-09-30T17:04:32.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.657525+0000", 2023-09-30T17:04:32.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7899999999999999e-07 2023-09-30T17:04:32.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.287 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.657540+0000", 2023-09-30T17:04:32.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4283e-05 2023-09-30T17:04:32.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.287 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.657547+0000", 2023-09-30T17:04:32.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3950000000000003e-06 2023-09-30T17:04:32.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.657552+0000", 2023-09-30T17:04:32.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.305e-06 2023-09-30T17:04:32.288 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.288 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.288 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.288 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:165600 4.6 e57/17)", 2023-09-30T17:04:32.289 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.875581+0000", 2023-09-30T17:04:32.289 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.024448949000000001, 2023-09-30T17:04:32.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.028527112, 2023-09-30T17:04:32.289 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.289 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.289 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.289 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.289 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.875581+0000", 2023-09-30T17:04:32.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.289 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.290 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.875581+0000", 2023-09-30T17:04:32.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.290 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.290 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.875581+0000", 2023-09-30T17:04:32.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8899999999999999e-07 2023-09-30T17:04:32.290 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.875597+0000", 2023-09-30T17:04:32.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5455e-05 2023-09-30T17:04:32.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.875609+0000", 2023-09-30T17:04:32.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2121e-05 2023-09-30T17:04:32.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.875615+0000", 2023-09-30T17:04:32.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6359999999999997e-06 2023-09-30T17:04:32.292 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.292 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.292 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.292 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:165612 4.2e e57/17)", 2023-09-30T17:04:32.292 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.888586+0000", 2023-09-30T17:04:32.293 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.011443972, 2023-09-30T17:04:32.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015567592999999999, 2023-09-30T17:04:32.293 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.293 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.293 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.293 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.293 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.888586+0000", 2023-09-30T17:04:32.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.294 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.294 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.294 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.888586+0000", 2023-09-30T17:04:32.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.294 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.294 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.294 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.888587+0000", 2023-09-30T17:04:32.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4759999999999999e-06 2023-09-30T17:04:32.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.888602+0000", 2023-09-30T17:04:32.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5392000000000001e-05 2023-09-30T17:04:32.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.888613+0000", 2023-09-30T17:04:32.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0448999999999999e-05 2023-09-30T17:04:32.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.296 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.296 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.888622+0000", 2023-09-30T17:04:32.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7900000000000005e-06 2023-09-30T17:04:32.296 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.296 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.296 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.297 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165164 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.297 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.299818+0000", 2023-09-30T17:04:32.297 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.600211516, 2023-09-30T17:04:32.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.60437417199999999, 2023-09-30T17:04:32.297 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.297 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.297 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.297 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.297 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.297 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165164 2023-09-30T17:04:32.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.298 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.299818+0000", 2023-09-30T17:04:32.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.299818+0000", 2023-09-30T17:04:32.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.299 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.299 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.299 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.299819+0000", 2023-09-30T17:04:32.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8699999999999995e-07 2023-09-30T17:04:32.299 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.299 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.299 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.299830+0000", 2023-09-30T17:04:32.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1477999999999999e-05 2023-09-30T17:04:32.299 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.300 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.300 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.299836+0000", 2023-09-30T17:04:32.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2199999999999997e-06 2023-09-30T17:04:32.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.300 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.300 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.299842+0000", 2023-09-30T17:04:32.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.344e-06 2023-09-30T17:04:32.300 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.300 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.301 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.301 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165838 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.301 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.536588+0000", 2023-09-30T17:04:32.301 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.36344141400000002, 2023-09-30T17:04:32.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.36765856899999999, 2023-09-30T17:04:32.301 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.301 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.301 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.301 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.302 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.302 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165838 2023-09-30T17:04:32.302 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.302 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.302 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.536588+0000", 2023-09-30T17:04:32.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.302 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.303 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.536588+0000", 2023-09-30T17:04:32.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.303 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.303 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.536589+0000", 2023-09-30T17:04:32.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1900000000000003e-07 2023-09-30T17:04:32.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.303 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.303 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.536602+0000", 2023-09-30T17:04:32.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3312999999999999e-05 2023-09-30T17:04:32.304 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.304 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.304 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.536610+0000", 2023-09-30T17:04:32.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4290000000000001e-06 2023-09-30T17:04:32.304 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.304 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.304 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.536616+0000", 2023-09-30T17:04:32.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.344e-06 2023-09-30T17:04:32.305 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.305 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.305 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.305 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166599 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.305 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.816697+0000", 2023-09-30T17:04:32.305 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.083332802999999997, 2023-09-30T17:04:32.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.087609875000000004, 2023-09-30T17:04:32.305 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.305 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.305 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.306 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.306 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.306 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166599 2023-09-30T17:04:32.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.306 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.816697+0000", 2023-09-30T17:04:32.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.816697+0000", 2023-09-30T17:04:32.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.820642+0000", 2023-09-30T17:04:32.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039449660000000003 2023-09-30T17:04:32.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.308 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.820662+0000", 2023-09-30T17:04:32.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0023000000000001e-05 2023-09-30T17:04:32.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.308 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.308 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.820670+0000", 2023-09-30T17:04:32.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9370000000000004e-06 2023-09-30T17:04:32.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.308 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.308 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.820675+0000", 2023-09-30T17:04:32.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7060000000000001e-06 2023-09-30T17:04:32.309 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.309 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.309 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.309 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166724 4.12 4:48ab9bde:::100000001f8.00000015:head [write 3915776~4096 in=4096b,write 3928064~4096 in=4096b,write 4014080~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.309 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.871649+0000", 2023-09-30T17:04:32.309 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.028380203999999999, 2023-09-30T17:04:32.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.032724098, 2023-09-30T17:04:32.309 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.309 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:32.310 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.310 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.310 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.310 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166724 2023-09-30T17:04:32.310 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.310 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.310 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.310 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.310 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.871649+0000", 2023-09-30T17:04:32.310 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.310 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.311 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.311 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.871649+0000", 2023-09-30T17:04:32.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.311 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.311 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.311 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.876517+0000", 2023-09-30T17:04:32.311 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0048677989999999999 2023-09-30T17:04:32.311 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.311 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.312 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.876535+0000", 2023-09-30T17:04:32.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8011000000000001e-05 2023-09-30T17:04:32.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.312 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.876553+0000", 2023-09-30T17:04:32.312 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7416999999999999e-05 2023-09-30T17:04:32.312 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.312 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.312 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.876560+0000", 2023-09-30T17:04:32.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8320000000000006e-06 2023-09-30T17:04:32.313 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:32.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878145+0000", 2023-09-30T17:04:32.313 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0015841360000000001 2023-09-30T17:04:32.313 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.313 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.313 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:32.313 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878219+0000", 2023-09-30T17:04:32.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4695000000000002e-05 2023-09-30T17:04:32.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.314 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.314 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:32.314 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878373+0000", 2023-09-30T17:04:32.314 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015332599999999999 2023-09-30T17:04:32.314 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.314 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.314 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.314 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.315 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.315 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166760 4.11 4.3537c7d1 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.315 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.885779+0000", 2023-09-30T17:04:32.315 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.014250148000000001, 2023-09-30T17:04:32.315 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018685080999999999, 2023-09-30T17:04:32.315 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.315 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.315 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.315 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.315 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.315 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166760 2023-09-30T17:04:32.315 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.316 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885779+0000", 2023-09-30T17:04:32.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885779+0000", 2023-09-30T17:04:32.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.317 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.317 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.890515+0000", 2023-09-30T17:04:32.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0047360450000000004 2023-09-30T17:04:32.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.317 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.317 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.890535+0000", 2023-09-30T17:04:32.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9843e-05 2023-09-30T17:04:32.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.317 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.890548+0000", 2023-09-30T17:04:32.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2391e-05 2023-09-30T17:04:32.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.890556+0000", 2023-09-30T17:04:32.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2369999999999992e-06 2023-09-30T17:04:32.318 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.318 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.318 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.319 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165322 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.319 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.360793+0000", 2023-09-30T17:04:32.319 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.53923613100000001, 2023-09-30T17:04:32.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.54373285100000002, 2023-09-30T17:04:32.319 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.319 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.319 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.319 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.320 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.320 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165322 2023-09-30T17:04:32.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.320 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.360793+0000", 2023-09-30T17:04:32.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.360793+0000", 2023-09-30T17:04:32.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.321 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.321 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.321 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.360794+0000", 2023-09-30T17:04:32.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8800000000000003e-07 2023-09-30T17:04:32.321 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.321 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.321 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.360811+0000", 2023-09-30T17:04:32.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7218e-05 2023-09-30T17:04:32.321 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.360818+0000", 2023-09-30T17:04:32.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0859999999999996e-06 2023-09-30T17:04:32.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.360824+0000", 2023-09-30T17:04:32.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5770000000000001e-06 2023-09-30T17:04:32.322 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.322 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.323 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.323 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165427 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.323 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.385914+0000", 2023-09-30T17:04:32.323 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.51411555600000003, 2023-09-30T17:04:32.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.51866916799999996, 2023-09-30T17:04:32.323 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.323 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.323 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.323 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.323 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.324 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165427 2023-09-30T17:04:32.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.324 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.385914+0000", 2023-09-30T17:04:32.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.385914+0000", 2023-09-30T17:04:32.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.385915+0000", 2023-09-30T17:04:32.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.61e-07 2023-09-30T17:04:32.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.385933+0000", 2023-09-30T17:04:32.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8224e-05 2023-09-30T17:04:32.326 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.326 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.326 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.385942+0000", 2023-09-30T17:04:32.326 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6950000000000006e-06 2023-09-30T17:04:32.326 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.326 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.326 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.385948+0000", 2023-09-30T17:04:32.326 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9030000000000001e-06 2023-09-30T17:04:32.327 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.327 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.327 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.327 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165469 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.327 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.398650+0000", 2023-09-30T17:04:32.327 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.50137938699999995, 2023-09-30T17:04:32.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.50598676399999998, 2023-09-30T17:04:32.327 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.327 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.327 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.328 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.328 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.328 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165469 2023-09-30T17:04:32.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.328 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.398650+0000", 2023-09-30T17:04:32.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.329 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.398650+0000", 2023-09-30T17:04:32.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.329 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.398650+0000", 2023-09-30T17:04:32.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.79e-07 2023-09-30T17:04:32.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.329 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.398661+0000", 2023-09-30T17:04:32.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0828e-05 2023-09-30T17:04:32.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.330 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.330 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.398667+0000", 2023-09-30T17:04:32.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9270000000000002e-06 2023-09-30T17:04:32.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.330 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.330 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.398672+0000", 2023-09-30T17:04:32.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6859999999999997e-06 2023-09-30T17:04:32.331 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.331 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.331 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.331 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.331 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.331 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165643 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.331 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.468972+0000", 2023-09-30T17:04:32.331 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.43105787899999998, 2023-09-30T17:04:32.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.43572163800000002, 2023-09-30T17:04:32.331 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.331 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.332 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.332 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.332 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.332 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165643 2023-09-30T17:04:32.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.332 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.468972+0000", 2023-09-30T17:04:32.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.468972+0000", 2023-09-30T17:04:32.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.468972+0000", 2023-09-30T17:04:32.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6100000000000001e-07 2023-09-30T17:04:32.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.349 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.350 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.468984+0000", 2023-09-30T17:04:32.350 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2126999999999999e-05 2023-09-30T17:04:32.350 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.350 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.350 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.350 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.468991+0000", 2023-09-30T17:04:32.350 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1520000000000003e-06 2023-09-30T17:04:32.350 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.350 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.350 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.350 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.468997+0000", 2023-09-30T17:04:32.351 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4820000000000002e-06 2023-09-30T17:04:32.351 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.351 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.351 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.351 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.351 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.351 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166027 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.351 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.600198+0000", 2023-09-30T17:04:32.351 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.29983121499999998, 2023-09-30T17:04:32.351 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.30454848499999998, 2023-09-30T17:04:32.351 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.352 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.352 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.352 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.352 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.352 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166027 2023-09-30T17:04:32.352 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.352 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.352 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.352 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.352 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.600198+0000", 2023-09-30T17:04:32.352 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.353 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.353 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.353 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.353 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.600198+0000", 2023-09-30T17:04:32.353 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.353 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.353 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.353 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.353 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.600199+0000", 2023-09-30T17:04:32.353 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6699999999999999e-07 2023-09-30T17:04:32.353 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.353 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.354 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.354 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.600216+0000", 2023-09-30T17:04:32.354 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7229000000000001e-05 2023-09-30T17:04:32.354 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.354 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.354 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.354 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.600222+0000", 2023-09-30T17:04:32.354 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3319999999999997e-06 2023-09-30T17:04:32.354 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.354 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.354 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.355 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.600227+0000", 2023-09-30T17:04:32.355 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8219999999999997e-06 2023-09-30T17:04:32.355 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.355 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.355 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.355 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.355 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.355 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166332 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.356 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.699755+0000", 2023-09-30T17:04:32.356 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.200274174, 2023-09-30T17:04:32.356 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.205044754, 2023-09-30T17:04:32.356 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.356 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.356 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.356 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.356 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.356 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166332 2023-09-30T17:04:32.356 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.356 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.357 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.357 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.357 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.699755+0000", 2023-09-30T17:04:32.357 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.357 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.357 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.357 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.357 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.699755+0000", 2023-09-30T17:04:32.357 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.357 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.357 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.357 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.358 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.699756+0000", 2023-09-30T17:04:32.358 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6699999999999999e-07 2023-09-30T17:04:32.358 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.358 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.358 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.358 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.699767+0000", 2023-09-30T17:04:32.358 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1208e-05 2023-09-30T17:04:32.358 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.358 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.358 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.358 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.699773+0000", 2023-09-30T17:04:32.359 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0959999999999997e-06 2023-09-30T17:04:32.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.359 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.359 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.359 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.699788+0000", 2023-09-30T17:04:32.359 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5105e-05 2023-09-30T17:04:32.359 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.359 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.359 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.359 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.365 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166492 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.365 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.775644+0000", 2023-09-30T17:04:32.365 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.12438556000000001, 2023-09-30T17:04:32.365 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.129210293, 2023-09-30T17:04:32.365 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.365 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.365 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.365 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.366 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.366 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166492 2023-09-30T17:04:32.366 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.366 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.366 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.366 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.366 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.775644+0000", 2023-09-30T17:04:32.366 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.366 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.366 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.366 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.366 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.775644+0000", 2023-09-30T17:04:32.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.367 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.367 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.367 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.775644+0000", 2023-09-30T17:04:32.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2500000000000001e-07 2023-09-30T17:04:32.367 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.367 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.367 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.775662+0000", 2023-09-30T17:04:32.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7132000000000001e-05 2023-09-30T17:04:32.368 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.775669+0000", 2023-09-30T17:04:32.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5989999999999996e-06 2023-09-30T17:04:32.368 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.775676+0000", 2023-09-30T17:04:32.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3899999999999998e-06 2023-09-30T17:04:32.368 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.369 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.369 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.369 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.369 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.369 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166542 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.369 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.809674+0000", 2023-09-30T17:04:32.369 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.090356061000000001, 2023-09-30T17:04:32.369 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.095232817999999997, 2023-09-30T17:04:32.369 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.369 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.369 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.369 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.370 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.370 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166542 2023-09-30T17:04:32.370 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.370 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.370 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.370 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.370 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.809674+0000", 2023-09-30T17:04:32.370 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.370 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.370 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.371 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.371 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.809674+0000", 2023-09-30T17:04:32.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.371 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.371 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.371 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.809674+0000", 2023-09-30T17:04:32.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7199999999999999e-07 2023-09-30T17:04:32.371 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.371 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.371 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.809688+0000", 2023-09-30T17:04:32.372 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3594000000000001e-05 2023-09-30T17:04:32.372 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.372 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.372 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.372 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.809695+0000", 2023-09-30T17:04:32.372 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.401e-06 2023-09-30T17:04:32.372 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.372 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.372 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.372 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.809700+0000", 2023-09-30T17:04:32.372 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.87e-06 2023-09-30T17:04:32.373 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.373 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.373 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.373 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.373 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.373 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166725 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.373 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.877981+0000", 2023-09-30T17:04:32.373 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.022048558999999999, 2023-09-30T17:04:32.373 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.026980199, 2023-09-30T17:04:32.373 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.373 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.373 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.374 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.374 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.374 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166725 2023-09-30T17:04:32.374 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.374 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.374 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.374 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.374 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.877981+0000", 2023-09-30T17:04:32.374 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.374 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.374 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.375 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.375 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.877981+0000", 2023-09-30T17:04:32.375 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.375 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.375 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.375 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.375 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.877982+0000", 2023-09-30T17:04:32.375 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7399999999999991e-07 2023-09-30T17:04:32.375 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.375 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.375 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.376 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878002+0000", 2023-09-30T17:04:32.376 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9772e-05 2023-09-30T17:04:32.376 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.376 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.376 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.376 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878014+0000", 2023-09-30T17:04:32.376 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2028000000000001e-05 2023-09-30T17:04:32.384 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.384 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.384 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.385 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878022+0000", 2023-09-30T17:04:32.385 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2509999999999994e-06 2023-09-30T17:04:32.385 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.385 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.385 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.385 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.385 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.385 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166764 4.38 4:1e2c7ed9:::100000001f8.0000002d:head [write 45056~4096 in=4096b,write 143360~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.385 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.890571+0000", 2023-09-30T17:04:32.385 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0094586640000000003, 2023-09-30T17:04:32.386 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014448605999999999, 2023-09-30T17:04:32.386 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.386 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:32.386 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.386 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.386 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.386 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166764 2023-09-30T17:04:32.386 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.386 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.386 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.386 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.386 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.890571+0000", 2023-09-30T17:04:32.387 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.387 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.387 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.387 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.387 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.890571+0000", 2023-09-30T17:04:32.387 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.387 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.387 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.387 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.387 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.892516+0000", 2023-09-30T17:04:32.387 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001945352 2023-09-30T17:04:32.387 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.388 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.388 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.388 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.892534+0000", 2023-09-30T17:04:32.388 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7895000000000001e-05 2023-09-30T17:04:32.388 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.388 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.388 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.388 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.892545+0000", 2023-09-30T17:04:32.388 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0428000000000001e-05 2023-09-30T17:04:32.388 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.388 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.389 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.389 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.892552+0000", 2023-09-30T17:04:32.389 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8720000000000002e-06 2023-09-30T17:04:32.389 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.389 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.389 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:32.389 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.898534+0000", 2023-09-30T17:04:32.389 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059819850000000004 2023-09-30T17:04:32.389 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.389 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.389 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:32.390 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.898624+0000", 2023-09-30T17:04:32.390 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9816999999999997e-05 2023-09-30T17:04:32.390 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.390 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.390 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.390 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.390 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.390 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165241 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.390 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.336629+0000", 2023-09-30T17:04:32.390 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.56340066700000002, 2023-09-30T17:04:32.390 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.56845773799999999, 2023-09-30T17:04:32.391 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.391 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.391 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.391 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.391 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.391 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165241 2023-09-30T17:04:32.391 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.391 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.391 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.391 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.392 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.336629+0000", 2023-09-30T17:04:32.392 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.392 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.392 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.392 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.392 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.336629+0000", 2023-09-30T17:04:32.392 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.392 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.392 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.392 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.392 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.336629+0000", 2023-09-30T17:04:32.392 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8500000000000002e-07 2023-09-30T17:04:32.393 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.393 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.393 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.393 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.336641+0000", 2023-09-30T17:04:32.393 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2057e-05 2023-09-30T17:04:32.393 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.393 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.393 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.393 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.336648+0000", 2023-09-30T17:04:32.393 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3629999999999999e-06 2023-09-30T17:04:32.393 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.393 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.394 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.394 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.336653+0000", 2023-09-30T17:04:32.394 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.826e-06 2023-09-30T17:04:32.394 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.394 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.394 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.394 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.394 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.394 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165470 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.394 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.398677+0000", 2023-09-30T17:04:32.394 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.50135225699999997, 2023-09-30T17:04:32.395 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.50646305700000005, 2023-09-30T17:04:32.395 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.395 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.395 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.395 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.395 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.395 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165470 2023-09-30T17:04:32.395 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.395 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.395 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.395 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.395 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.398677+0000", 2023-09-30T17:04:32.396 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.396 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.396 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.396 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.396 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.398677+0000", 2023-09-30T17:04:32.396 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.396 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.396 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.396 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.397 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.398678+0000", 2023-09-30T17:04:32.397 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8200000000000001e-07 2023-09-30T17:04:32.397 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.397 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.397 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.397 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.398686+0000", 2023-09-30T17:04:32.397 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5900000000000008e-06 2023-09-30T17:04:32.397 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.397 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.397 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.398 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.398690+0000", 2023-09-30T17:04:32.398 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7969999999999998e-06 2023-09-30T17:04:32.398 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.398 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.398 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.398 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.398693+0000", 2023-09-30T17:04:32.398 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9100000000000001e-06 2023-09-30T17:04:32.398 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.398 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.398 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.398 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.399 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.399 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166726 4.12 4:48ab9bde:::100000001f8.00000015:head [write 1716224~4096 in=4096b,write 2019328~4096 in=4096b,write 2031616~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.399 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.878036+0000", 2023-09-30T17:04:32.399 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.021993591, 2023-09-30T17:04:32.399 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.027168498999999999, 2023-09-30T17:04:32.399 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.399 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:32.399 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.399 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.399 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.400 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166726 2023-09-30T17:04:32.400 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.400 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.400 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.400 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.400 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878036+0000", 2023-09-30T17:04:32.400 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.400 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.400 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.400 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.400 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878036+0000", 2023-09-30T17:04:32.400 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.401 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.401 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.401 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.401 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878036+0000", 2023-09-30T17:04:32.401 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9800000000000004e-07 2023-09-30T17:04:32.401 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.401 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.401 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.401 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878051+0000", 2023-09-30T17:04:32.401 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4355000000000001e-05 2023-09-30T17:04:32.401 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.401 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.402 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.402 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878059+0000", 2023-09-30T17:04:32.402 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5739999999999996e-06 2023-09-30T17:04:32.402 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.402 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.402 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.402 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878067+0000", 2023-09-30T17:04:32.402 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4800000000000004e-06 2023-09-30T17:04:32.402 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.402 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.402 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:32.402 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885286+0000", 2023-09-30T17:04:32.403 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0072186100000000003 2023-09-30T17:04:32.403 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.403 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.403 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:32.403 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885355+0000", 2023-09-30T17:04:32.403 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9558e-05 2023-09-30T17:04:32.403 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.403 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.403 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:32.403 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885495+0000", 2023-09-30T17:04:32.403 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000140228 2023-09-30T17:04:32.403 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.404 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.404 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.404 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.404 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.404 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:167250 4.19 e57/17 4:997b7129:::100000001f8.00000000:head v 57'5246, mlcod=57'5242)", 2023-09-30T17:04:32.404 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.893705+0000", 2023-09-30T17:04:32.404 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0063250490000000001, 2023-09-30T17:04:32.404 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011574483, 2023-09-30T17:04:32.404 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.404 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:32.404 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.404 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.405 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.405 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.893705+0000", 2023-09-30T17:04:32.405 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.405 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.405 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.405 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.405 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.893705+0000", 2023-09-30T17:04:32.405 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.405 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.405 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.405 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.406 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.893705+0000", 2023-09-30T17:04:32.406 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5499999999999997e-07 2023-09-30T17:04:32.407 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.407 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.407 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.407 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.893717+0000", 2023-09-30T17:04:32.407 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.199e-05 2023-09-30T17:04:32.407 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.407 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.407 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.407 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.893727+0000", 2023-09-30T17:04:32.407 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.961e-06 2023-09-30T17:04:32.408 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.408 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.408 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.408 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.893732+0000", 2023-09-30T17:04:32.408 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0139999999999998e-06 2023-09-30T17:04:32.408 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.408 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.408 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:32.408 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.904521+0000", 2023-09-30T17:04:32.408 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010789137000000001 2023-09-30T17:04:32.408 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.409 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.409 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:32.409 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.904541+0000", 2023-09-30T17:04:32.409 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9894999999999998e-05 2023-09-30T17:04:32.409 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.409 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.409 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.409 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.409 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.409 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165013 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.409 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.249717+0000", 2023-09-30T17:04:32.410 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.65031239399999996, 2023-09-30T17:04:32.410 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.65562365300000003, 2023-09-30T17:04:32.410 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.410 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.410 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.410 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.410 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.410 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165013 2023-09-30T17:04:32.410 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.410 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.410 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.410 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.411 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.249717+0000", 2023-09-30T17:04:32.411 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.411 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.411 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.411 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.411 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.249717+0000", 2023-09-30T17:04:32.411 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.411 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.411 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.411 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.411 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.249717+0000", 2023-09-30T17:04:32.412 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9400000000000001e-07 2023-09-30T17:04:32.412 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.412 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.412 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.412 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.249732+0000", 2023-09-30T17:04:32.412 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4148000000000001e-05 2023-09-30T17:04:32.412 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.412 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.412 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.412 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.249738+0000", 2023-09-30T17:04:32.412 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7449999999999998e-06 2023-09-30T17:04:32.412 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.413 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.413 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.413 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.249744+0000", 2023-09-30T17:04:32.413 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5960000000000003e-06 2023-09-30T17:04:32.413 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.413 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.413 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.413 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.413 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.413 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165648 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.413 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.469036+0000", 2023-09-30T17:04:32.413 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.43099398100000003, 2023-09-30T17:04:32.414 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.43635741500000003, 2023-09-30T17:04:32.414 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.414 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.414 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.414 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.414 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.414 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165648 2023-09-30T17:04:32.414 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.414 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.414 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.414 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.415 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.469036+0000", 2023-09-30T17:04:32.415 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.415 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.415 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.415 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.415 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.469036+0000", 2023-09-30T17:04:32.415 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.415 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.415 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.415 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.415 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.469036+0000", 2023-09-30T17:04:32.416 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.15e-07 2023-09-30T17:04:32.416 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.416 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.416 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.416 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.469048+0000", 2023-09-30T17:04:32.416 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2251e-05 2023-09-30T17:04:32.416 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.416 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.416 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.416 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.469054+0000", 2023-09-30T17:04:32.416 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1090000000000003e-06 2023-09-30T17:04:32.416 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.416 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.417 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.417 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.469060+0000", 2023-09-30T17:04:32.417 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8880000000000002e-06 2023-09-30T17:04:32.417 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.417 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.417 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.417 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.417 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.417 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165931 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.417 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.556904+0000", 2023-09-30T17:04:32.417 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.34312606099999998, 2023-09-30T17:04:32.418 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.34854253099999999, 2023-09-30T17:04:32.418 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.418 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.418 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.418 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.418 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.418 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165931 2023-09-30T17:04:32.418 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.418 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.418 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.418 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.418 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.556904+0000", 2023-09-30T17:04:32.419 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.419 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.419 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.419 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.419 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.556904+0000", 2023-09-30T17:04:32.419 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.419 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.419 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.419 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.419 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.558515+0000", 2023-09-30T17:04:32.419 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0016117060000000001 2023-09-30T17:04:32.420 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.420 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.420 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.420 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.558529+0000", 2023-09-30T17:04:32.420 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4211e-05 2023-09-30T17:04:32.420 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.420 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.420 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.420 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.560547+0000", 2023-09-30T17:04:32.420 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0020173719999999999 2023-09-30T17:04:32.420 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.420 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.421 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.421 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.560556+0000", 2023-09-30T17:04:32.421 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7930000000000003e-06 2023-09-30T17:04:32.421 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.421 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.421 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.421 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.421 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.421 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166175 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.421 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.648255+0000", 2023-09-30T17:04:32.421 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.25177498100000001, 2023-09-30T17:04:32.422 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.25724369600000002, 2023-09-30T17:04:32.422 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.422 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.422 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.422 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.422 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.422 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166175 2023-09-30T17:04:32.422 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.422 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.422 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.422 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.422 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.648255+0000", 2023-09-30T17:04:32.423 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.423 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.423 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.423 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.423 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.648255+0000", 2023-09-30T17:04:32.423 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.423 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.423 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.423 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.423 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.648256+0000", 2023-09-30T17:04:32.423 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.263e-06 2023-09-30T17:04:32.424 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.424 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.424 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.424 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.648288+0000", 2023-09-30T17:04:32.424 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2095999999999999e-05 2023-09-30T17:04:32.424 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.424 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.424 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.424 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.648297+0000", 2023-09-30T17:04:32.424 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8259999999999999e-06 2023-09-30T17:04:32.424 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.424 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.425 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.425 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.648304+0000", 2023-09-30T17:04:32.425 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6909999999999997e-06 2023-09-30T17:04:32.425 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.425 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.425 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.425 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.425 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.425 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166460 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.425 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.760713+0000", 2023-09-30T17:04:32.425 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.13931661000000001, 2023-09-30T17:04:32.425 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.14485964000000001, 2023-09-30T17:04:32.426 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.426 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.426 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.426 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.426 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.426 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166460 2023-09-30T17:04:32.426 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.426 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.426 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.426 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.426 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.760713+0000", 2023-09-30T17:04:32.427 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.427 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.427 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.427 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.427 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.760713+0000", 2023-09-30T17:04:32.427 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.427 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.427 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.427 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.427 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.760713+0000", 2023-09-30T17:04:32.427 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.03e-07 2023-09-30T17:04:32.427 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.428 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.428 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.428 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.760724+0000", 2023-09-30T17:04:32.428 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0546e-05 2023-09-30T17:04:32.428 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.428 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.428 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.428 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.760730+0000", 2023-09-30T17:04:32.428 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3759999999999996e-06 2023-09-30T17:04:32.428 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.429 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.429 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.429 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.760736+0000", 2023-09-30T17:04:32.429 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0979999999999999e-06 2023-09-30T17:04:32.429 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.429 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.429 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.429 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.429 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.429 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166727 4.11 4:893be98d:::100000001f8.00000001:head [write 1269760~4096 in=4096b,write 1409024~4096 in=4096b,write 1626112~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.429 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.878076+0000", 2023-09-30T17:04:32.429 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.021953455, 2023-09-30T17:04:32.430 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.027555423999999999, 2023-09-30T17:04:32.430 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.430 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:32.430 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.430 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.430 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.430 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166727 2023-09-30T17:04:32.430 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.430 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.430 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.430 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.431 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878076+0000", 2023-09-30T17:04:32.431 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.431 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.431 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.431 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.431 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878076+0000", 2023-09-30T17:04:32.431 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.431 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.431 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.431 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.431 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878077+0000", 2023-09-30T17:04:32.432 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0200000000000002e-07 2023-09-30T17:04:32.432 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.432 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.432 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.432 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878090+0000", 2023-09-30T17:04:32.432 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2996000000000001e-05 2023-09-30T17:04:32.432 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.432 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.432 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.432 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878099+0000", 2023-09-30T17:04:32.432 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1190000000000003e-06 2023-09-30T17:04:32.433 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.433 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.433 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.433 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878105+0000", 2023-09-30T17:04:32.433 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3419999999999996e-06 2023-09-30T17:04:32.433 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.433 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.433 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:32.433 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878258+0000", 2023-09-30T17:04:32.433 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000152781 2023-09-30T17:04:32.433 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.433 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.434 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:32.434 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878343+0000", 2023-09-30T17:04:32.434 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4822999999999997e-05 2023-09-30T17:04:32.434 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.434 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.434 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.434 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.434 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.434 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:165636 4.6 e57/17)", 2023-09-30T17:04:32.434 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.893802+0000", 2023-09-30T17:04:32.434 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0062279659999999997, 2023-09-30T17:04:32.434 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011910581, 2023-09-30T17:04:32.435 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.435 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.435 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.435 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.435 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.435 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.893802+0000", 2023-09-30T17:04:32.435 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.435 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.435 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.435 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.435 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.893802+0000", 2023-09-30T17:04:32.435 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.436 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.436 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.436 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.436 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.893802+0000", 2023-09-30T17:04:32.436 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7799999999999997e-07 2023-09-30T17:04:32.436 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.436 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.436 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.436 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.893820+0000", 2023-09-30T17:04:32.436 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7623000000000001e-05 2023-09-30T17:04:32.436 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.437 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.437 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.437 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.893826+0000", 2023-09-30T17:04:32.437 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4590000000000003e-06 2023-09-30T17:04:32.437 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.437 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.437 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.437 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.893830+0000", 2023-09-30T17:04:32.437 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4109999999999998e-06 2023-09-30T17:04:32.437 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.437 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.437 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.438 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.438 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.438 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165055 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.438 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.266093+0000", 2023-09-30T17:04:32.438 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.63393687200000004, 2023-09-30T17:04:32.438 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.63966808100000005, 2023-09-30T17:04:32.438 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.438 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.438 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.438 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.438 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.438 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165055 2023-09-30T17:04:32.439 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.439 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.439 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.439 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.439 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.266093+0000", 2023-09-30T17:04:32.439 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.439 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.439 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.439 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.439 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.266093+0000", 2023-09-30T17:04:32.439 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.439 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.440 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.440 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.440 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.266093+0000", 2023-09-30T17:04:32.440 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7599999999999997e-07 2023-09-30T17:04:32.440 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.440 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.440 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.440 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.266117+0000", 2023-09-30T17:04:32.440 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3479e-05 2023-09-30T17:04:32.440 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.440 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.440 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.441 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.266124+0000", 2023-09-30T17:04:32.441 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9330000000000004e-06 2023-09-30T17:04:32.441 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.441 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.441 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.441 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.266130+0000", 2023-09-30T17:04:32.441 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8250000000000001e-06 2023-09-30T17:04:32.441 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.441 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.441 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.441 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.441 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.442 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165472 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.442 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.398722+0000", 2023-09-30T17:04:32.442 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.50130717599999997, 2023-09-30T17:04:32.442 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.50710132100000005, 2023-09-30T17:04:32.442 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.442 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.442 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.442 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.442 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.442 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165472 2023-09-30T17:04:32.442 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.443 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.443 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.443 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.398722+0000", 2023-09-30T17:04:32.443 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.443 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.443 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.443 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.398722+0000", 2023-09-30T17:04:32.443 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.443 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.444 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.444 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.398723+0000", 2023-09-30T17:04:32.444 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9999999999999998e-07 2023-09-30T17:04:32.444 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.444 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.444 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.444 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.398733+0000", 2023-09-30T17:04:32.444 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0525e-05 2023-09-30T17:04:32.444 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.444 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.444 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.445 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.398740+0000", 2023-09-30T17:04:32.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.319e-06 2023-09-30T17:04:32.445 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.445 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.445 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.445 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.398745+0000", 2023-09-30T17:04:32.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9540000000000003e-06 2023-09-30T17:04:32.445 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.445 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.445 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.445 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.446 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.446 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165596 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.446 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.442632+0000", 2023-09-30T17:04:32.446 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.45739717099999999, 2023-09-30T17:04:32.446 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.46324452399999999, 2023-09-30T17:04:32.446 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.446 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.446 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.446 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.446 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.446 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165596 2023-09-30T17:04:32.447 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.447 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.447 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.447 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.442632+0000", 2023-09-30T17:04:32.447 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.447 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.447 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.447 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.442632+0000", 2023-09-30T17:04:32.447 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.447 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.513 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.513 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.442633+0000", 2023-09-30T17:04:32.513 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1999999999999999e-07 2023-09-30T17:04:32.513 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.514 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.514 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.514 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.442647+0000", 2023-09-30T17:04:32.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3658e-05 2023-09-30T17:04:32.514 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.514 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.514 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.514 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.442653+0000", 2023-09-30T17:04:32.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5309999999999998e-06 2023-09-30T17:04:32.514 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.515 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.515 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.442659+0000", 2023-09-30T17:04:32.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6300000000000003e-06 2023-09-30T17:04:32.515 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.515 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.515 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.515 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165778 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.515 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.514748+0000", 2023-09-30T17:04:32.516 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.38528127200000001, 2023-09-30T17:04:32.516 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.39118299899999998, 2023-09-30T17:04:32.516 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.516 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.516 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.516 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.516 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.516 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165778 2023-09-30T17:04:32.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.516 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.517 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.517 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.514748+0000", 2023-09-30T17:04:32.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.517 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.517 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.517 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.514748+0000", 2023-09-30T17:04:32.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.517 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.517 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.517 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.514749+0000", 2023-09-30T17:04:32.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9299999999999998e-07 2023-09-30T17:04:32.518 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.518 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.518 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.518 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.514764+0000", 2023-09-30T17:04:32.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4788e-05 2023-09-30T17:04:32.518 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.518 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.518 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.518 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.514770+0000", 2023-09-30T17:04:32.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5690000000000001e-06 2023-09-30T17:04:32.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.519 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.519 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.514776+0000", 2023-09-30T17:04:32.519 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3630000000000002e-06 2023-09-30T17:04:32.519 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.519 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.519 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.519 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166067 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.519 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.613688+0000", 2023-09-30T17:04:32.520 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.28634171400000002, 2023-09-30T17:04:32.520 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.29229545800000001, 2023-09-30T17:04:32.520 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.520 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.520 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.520 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.520 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.520 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166067 2023-09-30T17:04:32.520 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.520 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.520 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.521 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.521 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.613688+0000", 2023-09-30T17:04:32.521 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.521 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.521 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.521 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.521 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.613688+0000", 2023-09-30T17:04:32.521 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.521 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.521 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.521 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.521 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.613688+0000", 2023-09-30T17:04:32.522 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.46e-07 2023-09-30T17:04:32.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.522 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.522 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.613712+0000", 2023-09-30T17:04:32.522 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3969e-05 2023-09-30T17:04:32.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.522 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.522 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.613719+0000", 2023-09-30T17:04:32.522 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9550000000000003e-06 2023-09-30T17:04:32.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.523 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.613725+0000", 2023-09-30T17:04:32.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5820000000000001e-06 2023-09-30T17:04:32.523 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.523 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.523 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.523 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166428 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.523 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.745516+0000", 2023-09-30T17:04:32.523 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.15451380100000001, 2023-09-30T17:04:32.524 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.16052346200000001, 2023-09-30T17:04:32.524 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.524 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.524 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.524 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.524 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.524 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166428 2023-09-30T17:04:32.524 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.524 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.524 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.524 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.525 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.745516+0000", 2023-09-30T17:04:32.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.525 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.525 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.525 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.525 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.745516+0000", 2023-09-30T17:04:32.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.525 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.525 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.525 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.525 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.748728+0000", 2023-09-30T17:04:32.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0032119610000000002 2023-09-30T17:04:32.525 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.526 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.526 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.748744+0000", 2023-09-30T17:04:32.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5957e-05 2023-09-30T17:04:32.526 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.526 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.526 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.748754+0000", 2023-09-30T17:04:32.526 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0473e-05 2023-09-30T17:04:32.526 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.526 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.526 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.527 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.748762+0000", 2023-09-30T17:04:32.527 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7719999999999994e-06 2023-09-30T17:04:32.527 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.527 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.527 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.527 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.527 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.527 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166730 4.c 4:33b8095f:::100000001f8.0000003a:head [write 3600384~4096 in=4096b,write 3657728~4096 in=4096b,write 3907584~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.527 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.878114+0000", 2023-09-30T17:04:32.527 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.021915094, 2023-09-30T17:04:32.527 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.027982745, 2023-09-30T17:04:32.527 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.528 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:32.528 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.528 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.528 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.528 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166730 2023-09-30T17:04:32.528 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.528 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.528 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.528 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.528 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878114+0000", 2023-09-30T17:04:32.528 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.529 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.529 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.529 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.529 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878114+0000", 2023-09-30T17:04:32.529 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.529 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.529 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.529 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.529 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878115+0000", 2023-09-30T17:04:32.529 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2e-07 2023-09-30T17:04:32.529 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.529 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.530 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.530 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878134+0000", 2023-09-30T17:04:32.530 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8890999999999999e-05 2023-09-30T17:04:32.530 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.530 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.530 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.530 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878142+0000", 2023-09-30T17:04:32.530 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2390000000000002e-06 2023-09-30T17:04:32.530 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.530 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.530 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.530 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878148+0000", 2023-09-30T17:04:32.531 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6720000000000001e-06 2023-09-30T17:04:32.531 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.531 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.531 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:32.531 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878579+0000", 2023-09-30T17:04:32.531 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00043142899999999999 2023-09-30T17:04:32.531 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.531 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.531 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:32.531 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878654+0000", 2023-09-30T17:04:32.532 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5030000000000005e-05 2023-09-30T17:04:32.532 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.532 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.532 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.532 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.532 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.532 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:165644 4.36 e57/17)", 2023-09-30T17:04:32.532 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.894461+0000", 2023-09-30T17:04:32.532 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0055681029999999996, 2023-09-30T17:04:32.532 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011699675, 2023-09-30T17:04:32.532 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.532 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.533 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.533 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.533 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.533 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.894461+0000", 2023-09-30T17:04:32.533 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.533 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.533 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.533 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.533 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.894461+0000", 2023-09-30T17:04:32.533 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.533 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.533 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.534 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.534 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.894462+0000", 2023-09-30T17:04:32.534 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9999999999999999e-07 2023-09-30T17:04:32.534 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.534 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.534 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.534 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.894477+0000", 2023-09-30T17:04:32.534 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5426000000000001e-05 2023-09-30T17:04:32.534 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.534 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.534 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.535 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.894483+0000", 2023-09-30T17:04:32.535 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8619999999999999e-06 2023-09-30T17:04:32.535 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.535 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.535 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.535 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.894486+0000", 2023-09-30T17:04:32.535 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1159999999999999e-06 2023-09-30T17:04:32.535 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.535 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.535 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.535 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.535 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.536 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165056 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.536 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.266138+0000", 2023-09-30T17:04:32.536 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.63389182099999997, 2023-09-30T17:04:32.536 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.64007024400000001, 2023-09-30T17:04:32.536 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.536 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.536 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.536 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.536 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.536 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165056 2023-09-30T17:04:32.536 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.536 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.537 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.537 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.537 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.266138+0000", 2023-09-30T17:04:32.537 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.537 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.537 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.537 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.537 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.266138+0000", 2023-09-30T17:04:32.537 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.537 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.537 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.537 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.538 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.266138+0000", 2023-09-30T17:04:32.538 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2399999999999998e-07 2023-09-30T17:04:32.538 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.538 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.538 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.538 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.266154+0000", 2023-09-30T17:04:32.538 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5704000000000001e-05 2023-09-30T17:04:32.538 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.538 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.538 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.538 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.266161+0000", 2023-09-30T17:04:32.538 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6340000000000003e-06 2023-09-30T17:04:32.539 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.539 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.539 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.539 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.266166+0000", 2023-09-30T17:04:32.539 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7490000000000004e-06 2023-09-30T17:04:32.539 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.539 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.539 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.539 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.539 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.539 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165289 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.539 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.346451+0000", 2023-09-30T17:04:32.540 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.55357881799999997, 2023-09-30T17:04:32.540 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.55981121599999994, 2023-09-30T17:04:32.540 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.540 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.540 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.540 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.540 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.540 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165289 2023-09-30T17:04:32.540 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.540 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.540 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.540 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.541 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.346451+0000", 2023-09-30T17:04:32.541 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.541 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.541 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.541 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.541 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.346451+0000", 2023-09-30T17:04:32.541 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.541 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.541 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.541 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.541 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.349515+0000", 2023-09-30T17:04:32.541 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0030646200000000001 2023-09-30T17:04:32.542 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.542 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.542 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.542 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.349537+0000", 2023-09-30T17:04:32.542 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1996000000000001e-05 2023-09-30T17:04:32.542 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.542 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.542 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.542 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.349548+0000", 2023-09-30T17:04:32.542 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0703999999999999e-05 2023-09-30T17:04:32.542 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.543 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.543 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.543 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.349557+0000", 2023-09-30T17:04:32.543 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4169999999999992e-06 2023-09-30T17:04:32.543 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.543 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.543 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.543 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.543 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.543 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165433 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.543 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.385986+0000", 2023-09-30T17:04:32.543 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.51404367799999995, 2023-09-30T17:04:32.544 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.52032869400000004, 2023-09-30T17:04:32.544 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.544 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.544 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.544 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.544 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.544 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165433 2023-09-30T17:04:32.544 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.544 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.544 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.544 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.544 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.385986+0000", 2023-09-30T17:04:32.545 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.545 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.545 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.545 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.545 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.385986+0000", 2023-09-30T17:04:32.545 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.545 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.545 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.545 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.545 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.387516+0000", 2023-09-30T17:04:32.545 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001529994 2023-09-30T17:04:32.546 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.546 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.546 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.546 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.387530+0000", 2023-09-30T17:04:32.546 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3913e-05 2023-09-30T17:04:32.546 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.546 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.546 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.546 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.387546+0000", 2023-09-30T17:04:32.546 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6277e-05 2023-09-30T17:04:32.546 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.546 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.547 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.547 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.387554+0000", 2023-09-30T17:04:32.547 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9570000000000002e-06 2023-09-30T17:04:32.547 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.547 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.547 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.547 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.547 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.547 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165473 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.547 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.398762+0000", 2023-09-30T17:04:32.547 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.501267609, 2023-09-30T17:04:32.547 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.50760578899999997, 2023-09-30T17:04:32.548 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.548 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.548 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.548 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.548 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.548 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165473 2023-09-30T17:04:32.548 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.548 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.548 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.548 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.548 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.398762+0000", 2023-09-30T17:04:32.549 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.549 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.549 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.549 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.549 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.398762+0000", 2023-09-30T17:04:32.549 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.549 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.549 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.549 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.549 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.398762+0000", 2023-09-30T17:04:32.549 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5299999999999999e-07 2023-09-30T17:04:32.549 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.550 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.550 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.550 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.398775+0000", 2023-09-30T17:04:32.550 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2374999999999999e-05 2023-09-30T17:04:32.550 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.550 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.550 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.550 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.398781+0000", 2023-09-30T17:04:32.550 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5699999999999998e-06 2023-09-30T17:04:32.550 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.550 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.551 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.551 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.398786+0000", 2023-09-30T17:04:32.551 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0350000000000001e-06 2023-09-30T17:04:32.551 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.551 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.551 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.551 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.551 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.551 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165597 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.551 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.442667+0000", 2023-09-30T17:04:32.551 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.45736278600000002, 2023-09-30T17:04:32.551 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.46375684499999997, 2023-09-30T17:04:32.551 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.552 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.552 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.552 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.552 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.552 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165597 2023-09-30T17:04:32.552 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.552 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.552 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.552 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.552 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.442667+0000", 2023-09-30T17:04:32.552 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.552 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.553 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.553 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.553 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.442667+0000", 2023-09-30T17:04:32.553 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.553 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.553 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.553 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.553 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.442667+0000", 2023-09-30T17:04:32.553 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1199999999999999e-07 2023-09-30T17:04:32.553 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.553 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.553 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.554 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.442677+0000", 2023-09-30T17:04:32.554 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0135999999999999e-05 2023-09-30T17:04:32.554 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.554 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.554 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.554 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.442682+0000", 2023-09-30T17:04:32.554 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2599999999999999e-06 2023-09-30T17:04:32.554 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.554 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.554 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.554 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.442685+0000", 2023-09-30T17:04:32.554 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.749e-06 2023-09-30T17:04:32.555 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.555 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.555 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.555 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.555 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.555 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165622 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.555 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.458568+0000", 2023-09-30T17:04:32.555 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.44146114199999997, 2023-09-30T17:04:32.555 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.44790797399999999, 2023-09-30T17:04:32.555 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.555 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.555 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.556 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.556 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.556 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165622 2023-09-30T17:04:32.556 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.556 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.556 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.556 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.556 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.458568+0000", 2023-09-30T17:04:32.556 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.556 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.556 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.557 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.557 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.458568+0000", 2023-09-30T17:04:32.557 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.557 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.557 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.557 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.557 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.458569+0000", 2023-09-30T17:04:32.557 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6300000000000005e-07 2023-09-30T17:04:32.557 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.557 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.557 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.557 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.458588+0000", 2023-09-30T17:04:32.558 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8573999999999999e-05 2023-09-30T17:04:32.558 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.558 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.558 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.558 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.458598+0000", 2023-09-30T17:04:32.558 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0091999999999999e-05 2023-09-30T17:04:32.558 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.558 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.558 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.558 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.458605+0000", 2023-09-30T17:04:32.558 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0910000000000004e-06 2023-09-30T17:04:32.558 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.559 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.559 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.559 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.559 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.559 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165889 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.559 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.547181+0000", 2023-09-30T17:04:32.559 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.35284905599999999, 2023-09-30T17:04:32.559 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.35935642699999998, 2023-09-30T17:04:32.559 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.559 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.559 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.559 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.560 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.560 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165889 2023-09-30T17:04:32.560 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.560 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.560 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.560 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.560 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.547181+0000", 2023-09-30T17:04:32.560 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.560 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.560 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.560 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.561 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.547181+0000", 2023-09-30T17:04:32.561 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.561 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.561 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.561 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.561 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.552517+0000", 2023-09-30T17:04:32.561 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0053368449999999998 2023-09-30T17:04:32.561 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.561 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.561 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.561 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.552533+0000", 2023-09-30T17:04:32.561 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5480000000000001e-05 2023-09-30T17:04:32.562 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.562 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.562 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.562 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.552542+0000", 2023-09-30T17:04:32.562 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9619999999999999e-06 2023-09-30T17:04:32.562 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.562 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.562 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.562 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.552549+0000", 2023-09-30T17:04:32.562 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.041e-06 2023-09-30T17:04:32.562 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.563 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.563 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.563 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.563 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.563 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166696 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.563 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.862885+0000", 2023-09-30T17:04:32.563 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.037144827999999998, 2023-09-30T17:04:32.563 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043713448000000002, 2023-09-30T17:04:32.563 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.563 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.563 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.563 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.564 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.564 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166696 2023-09-30T17:04:32.564 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.564 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.564 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.564 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.564 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.862885+0000", 2023-09-30T17:04:32.564 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.564 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.564 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.564 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.564 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.862885+0000", 2023-09-30T17:04:32.565 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.565 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.565 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.565 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.565 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.862885+0000", 2023-09-30T17:04:32.565 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7300000000000001e-07 2023-09-30T17:04:32.565 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.565 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.565 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.565 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.862905+0000", 2023-09-30T17:04:32.565 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0203e-05 2023-09-30T17:04:32.566 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.566 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.566 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.566 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.862912+0000", 2023-09-30T17:04:32.566 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4760000000000003e-06 2023-09-30T17:04:32.566 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.566 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.566 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.566 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.862917+0000", 2023-09-30T17:04:32.566 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4890000000000003e-06 2023-09-30T17:04:32.566 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.567 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.567 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.567 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.567 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.567 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166732 4.11 4:8b544b63:::100000001f8.0000002c:head [write 3108864~4096 in=4096b,write 3121152~4096 in=4096b,write 3211264~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.567 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.878548+0000", 2023-09-30T17:04:32.567 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.021481454000000001, 2023-09-30T17:04:32.567 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.028124720999999998, 2023-09-30T17:04:32.567 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.567 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:32.567 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.568 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.568 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.568 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166732 2023-09-30T17:04:32.568 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.568 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.568 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.568 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.568 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878548+0000", 2023-09-30T17:04:32.568 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.568 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.568 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.568 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.569 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878548+0000", 2023-09-30T17:04:32.569 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.569 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.569 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.569 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.569 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878563+0000", 2023-09-30T17:04:32.569 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5112e-05 2023-09-30T17:04:32.569 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.569 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.569 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.569 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878581+0000", 2023-09-30T17:04:32.569 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7368999999999999e-05 2023-09-30T17:04:32.570 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.570 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.570 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.570 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878592+0000", 2023-09-30T17:04:32.570 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1109e-05 2023-09-30T17:04:32.570 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.570 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.570 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.570 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878599+0000", 2023-09-30T17:04:32.570 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3989999999999998e-06 2023-09-30T17:04:32.570 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.570 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.571 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:32.571 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.884878+0000", 2023-09-30T17:04:32.571 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0062789300000000003 2023-09-30T17:04:32.571 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.571 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.571 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:32.571 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.884971+0000", 2023-09-30T17:04:32.571 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2520000000000002e-05 2023-09-30T17:04:32.571 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.571 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.571 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.571 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.572 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.572 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165094 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.572 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.275719+0000", 2023-09-30T17:04:32.572 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.62431087100000004, 2023-09-30T17:04:32.572 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.631033968, 2023-09-30T17:04:32.572 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.572 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.572 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.572 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.572 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.572 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165094 2023-09-30T17:04:32.572 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.573 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.573 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.573 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.573 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.275719+0000", 2023-09-30T17:04:32.573 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.573 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.573 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.573 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.573 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.275719+0000", 2023-09-30T17:04:32.573 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.573 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.573 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.574 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.574 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.275719+0000", 2023-09-30T17:04:32.574 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1099999999999995e-07 2023-09-30T17:04:32.574 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.574 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.574 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.574 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.275741+0000", 2023-09-30T17:04:32.574 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2116999999999998e-05 2023-09-30T17:04:32.574 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.574 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.574 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.575 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.275749+0000", 2023-09-30T17:04:32.575 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.469e-06 2023-09-30T17:04:32.575 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.575 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.575 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.575 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.275754+0000", 2023-09-30T17:04:32.575 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3510000000000001e-06 2023-09-30T17:04:32.575 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.575 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.575 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.575 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.575 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.576 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165290 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.576 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.349571+0000", 2023-09-30T17:04:32.576 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.55045908200000004, 2023-09-30T17:04:32.576 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.55724831799999996, 2023-09-30T17:04:32.576 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.576 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.576 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.576 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.576 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.576 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165290 2023-09-30T17:04:32.576 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.576 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.577 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.577 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.577 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.349571+0000", 2023-09-30T17:04:32.577 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.577 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.577 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.577 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.577 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.349571+0000", 2023-09-30T17:04:32.577 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.577 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.577 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.577 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.578 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.349571+0000", 2023-09-30T17:04:32.578 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5099999999999999e-07 2023-09-30T17:04:32.578 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.578 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.578 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.578 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.349588+0000", 2023-09-30T17:04:32.578 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6691e-05 2023-09-30T17:04:32.578 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.578 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.578 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.578 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.349595+0000", 2023-09-30T17:04:32.578 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0990000000000001e-06 2023-09-30T17:04:32.579 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.579 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.579 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.579 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.349601+0000", 2023-09-30T17:04:32.579 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6520000000000003e-06 2023-09-30T17:04:32.579 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.579 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.579 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.579 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.579 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.579 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165434 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.580 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.387571+0000", 2023-09-30T17:04:32.580 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.51245895299999999, 2023-09-30T17:04:32.580 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.51931373199999997, 2023-09-30T17:04:32.580 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.580 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.580 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.580 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.580 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.580 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165434 2023-09-30T17:04:32.580 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.580 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.580 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.581 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.581 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.387571+0000", 2023-09-30T17:04:32.581 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.581 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.581 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.581 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.581 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.387571+0000", 2023-09-30T17:04:32.581 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.581 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.581 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.581 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.581 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.387571+0000", 2023-09-30T17:04:32.582 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4799999999999998e-07 2023-09-30T17:04:32.582 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.582 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.582 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.582 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.387586+0000", 2023-09-30T17:04:32.582 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4321999999999999e-05 2023-09-30T17:04:32.582 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.582 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.582 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.582 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.387596+0000", 2023-09-30T17:04:32.582 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0366e-05 2023-09-30T17:04:32.583 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.583 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.583 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.583 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.387602+0000", 2023-09-30T17:04:32.583 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2430000000000002e-06 2023-09-30T17:04:32.583 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.583 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.583 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.583 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.583 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.583 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165781 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.583 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.514819+0000", 2023-09-30T17:04:32.584 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.38521024199999998, 2023-09-30T17:04:32.584 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.392165553, 2023-09-30T17:04:32.584 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.584 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.584 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.584 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.584 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.584 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165781 2023-09-30T17:04:32.584 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.584 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.584 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.585 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.585 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.514819+0000", 2023-09-30T17:04:32.585 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.585 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.585 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.585 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.585 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.514819+0000", 2023-09-30T17:04:32.585 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.585 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.585 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.585 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.585 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.514820+0000", 2023-09-30T17:04:32.586 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6000000000000004e-07 2023-09-30T17:04:32.586 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.586 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.586 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.586 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.514832+0000", 2023-09-30T17:04:32.586 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2262999999999999e-05 2023-09-30T17:04:32.586 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.586 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.586 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.586 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.514839+0000", 2023-09-30T17:04:32.586 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5969999999999997e-06 2023-09-30T17:04:32.586 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.587 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.587 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.587 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.514845+0000", 2023-09-30T17:04:32.587 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3929999999999996e-06 2023-09-30T17:04:32.587 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.587 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.587 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.587 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.587 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.587 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165891 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.587 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.552571+0000", 2023-09-30T17:04:32.587 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.34745814000000003, 2023-09-30T17:04:32.588 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.35447448500000001, 2023-09-30T17:04:32.588 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.588 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.588 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.588 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.588 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.588 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165891 2023-09-30T17:04:32.588 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.588 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.588 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.588 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.588 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.552571+0000", 2023-09-30T17:04:32.589 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.589 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.589 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.589 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.589 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.552571+0000", 2023-09-30T17:04:32.589 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.589 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.589 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.589 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.589 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.552572+0000", 2023-09-30T17:04:32.589 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0100000000000005e-07 2023-09-30T17:04:32.590 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.590 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.590 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.590 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.552584+0000", 2023-09-30T17:04:32.590 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1592e-05 2023-09-30T17:04:32.590 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.590 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.590 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.590 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.552590+0000", 2023-09-30T17:04:32.590 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6460000000000004e-06 2023-09-30T17:04:32.590 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.591 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.591 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.591 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.552595+0000", 2023-09-30T17:04:32.591 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2469999999999999e-06 2023-09-30T17:04:32.591 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.591 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.591 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.591 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.591 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.591 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166697 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.591 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.862926+0000", 2023-09-30T17:04:32.591 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.037103254000000002, 2023-09-30T17:04:32.592 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.044176084999999997, 2023-09-30T17:04:32.592 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.592 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.592 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.592 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.592 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.592 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166697 2023-09-30T17:04:32.592 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.592 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.592 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.592 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.592 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.862926+0000", 2023-09-30T17:04:32.593 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.593 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.593 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.593 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.593 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.862926+0000", 2023-09-30T17:04:32.593 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.593 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.593 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.593 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.593 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.862927+0000", 2023-09-30T17:04:32.593 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2900000000000003e-07 2023-09-30T17:04:32.594 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.594 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.594 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.594 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.862943+0000", 2023-09-30T17:04:32.594 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6439999999999998e-05 2023-09-30T17:04:32.594 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.594 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.594 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.594 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.862950+0000", 2023-09-30T17:04:32.594 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2349999999999996e-06 2023-09-30T17:04:32.594 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.595 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.595 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.595 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.862956+0000", 2023-09-30T17:04:32.595 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.976e-06 2023-09-30T17:04:32.595 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.595 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.595 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.595 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.595 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.595 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165058 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.595 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.266252+0000", 2023-09-30T17:04:32.595 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.63377803600000004, 2023-09-30T17:04:32.596 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.64091011499999995, 2023-09-30T17:04:32.596 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.596 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.596 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.596 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.596 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.596 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165058 2023-09-30T17:04:32.596 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.596 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.596 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.596 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.596 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.266252+0000", 2023-09-30T17:04:32.597 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.597 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.597 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.597 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.597 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.266252+0000", 2023-09-30T17:04:32.597 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.597 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.597 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.597 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.597 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.266252+0000", 2023-09-30T17:04:32.597 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2200000000000003e-07 2023-09-30T17:04:32.598 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.598 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.598 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.598 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.266269+0000", 2023-09-30T17:04:32.598 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6359999999999999e-05 2023-09-30T17:04:32.598 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.598 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.598 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.598 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.266279+0000", 2023-09-30T17:04:32.598 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0154e-05 2023-09-30T17:04:32.598 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.599 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.599 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.599 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.266285+0000", 2023-09-30T17:04:32.599 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2949999999999999e-06 2023-09-30T17:04:32.599 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.599 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.599 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.599 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.599 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.599 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165123 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.599 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.289561+0000", 2023-09-30T17:04:32.599 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.61046884000000001, 2023-09-30T17:04:32.600 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.61765858699999998, 2023-09-30T17:04:32.600 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.600 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.600 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.600 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.600 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.600 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165123 2023-09-30T17:04:32.600 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.600 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.600 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.600 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.600 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.289561+0000", 2023-09-30T17:04:32.601 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.601 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.601 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.601 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.601 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.289561+0000", 2023-09-30T17:04:32.601 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.601 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.601 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.601 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.601 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.289561+0000", 2023-09-30T17:04:32.601 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4900000000000001e-07 2023-09-30T17:04:32.602 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.602 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.602 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.602 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.289572+0000", 2023-09-30T17:04:32.602 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0813e-05 2023-09-30T17:04:32.602 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.602 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.602 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.602 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.289578+0000", 2023-09-30T17:04:32.602 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6999999999999996e-06 2023-09-30T17:04:32.602 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.603 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.603 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.603 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.289582+0000", 2023-09-30T17:04:32.603 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8010000000000003e-06 2023-09-30T17:04:32.603 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.603 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.603 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.603 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.603 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.603 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165626 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.603 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.458657+0000", 2023-09-30T17:04:32.604 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.44137256400000002, 2023-09-30T17:04:32.604 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.44862000899999999, 2023-09-30T17:04:32.604 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.604 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.604 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.604 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.604 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.604 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165626 2023-09-30T17:04:32.604 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.604 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.604 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.604 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.605 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.458657+0000", 2023-09-30T17:04:32.605 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.605 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.605 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.605 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.605 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.458657+0000", 2023-09-30T17:04:32.605 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.605 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.605 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.605 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.605 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.462515+0000", 2023-09-30T17:04:32.605 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038575290000000002 2023-09-30T17:04:32.606 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.606 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.606 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.606 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.462529+0000", 2023-09-30T17:04:32.606 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4823e-05 2023-09-30T17:04:32.606 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.606 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.606 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.606 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.462553+0000", 2023-09-30T17:04:32.606 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3319000000000002e-05 2023-09-30T17:04:32.606 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.606 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.607 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.607 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.462562+0000", 2023-09-30T17:04:32.607 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6379999999999999e-06 2023-09-30T17:04:32.607 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.607 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.607 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.607 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.607 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.607 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165849 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.607 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.536824+0000", 2023-09-30T17:04:32.607 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.36320555799999998, 2023-09-30T17:04:32.607 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.37051334499999999, 2023-09-30T17:04:32.608 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.608 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.608 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.608 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.608 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.608 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165849 2023-09-30T17:04:32.608 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.608 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.608 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.608 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.608 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.536824+0000", 2023-09-30T17:04:32.609 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.609 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.609 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.609 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.609 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.536824+0000", 2023-09-30T17:04:32.609 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.609 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.609 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.609 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.609 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.538601+0000", 2023-09-30T17:04:32.609 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001776541 2023-09-30T17:04:32.609 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.610 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.610 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.610 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.538617+0000", 2023-09-30T17:04:32.610 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6249999999999999e-05 2023-09-30T17:04:32.610 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.610 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.610 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.610 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.538625+0000", 2023-09-30T17:04:32.610 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3790000000000006e-06 2023-09-30T17:04:32.610 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.610 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.610 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.611 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.538632+0000", 2023-09-30T17:04:32.611 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8000000000000001e-06 2023-09-30T17:04:32.611 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.611 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.611 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.611 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.611 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.611 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165894 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.611 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.552602+0000", 2023-09-30T17:04:32.611 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.34742726299999999, 2023-09-30T17:04:32.611 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.35480903000000003, 2023-09-30T17:04:32.612 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.612 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.612 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.612 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.612 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.612 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165894 2023-09-30T17:04:32.612 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.612 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.612 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.612 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.612 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.552602+0000", 2023-09-30T17:04:32.612 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.613 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.613 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.613 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.613 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.552602+0000", 2023-09-30T17:04:32.613 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.613 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.613 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.613 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.613 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.552603+0000", 2023-09-30T17:04:32.613 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8000000000000001e-07 2023-09-30T17:04:32.613 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.613 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.614 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.614 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.552614+0000", 2023-09-30T17:04:32.614 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1623999999999999e-05 2023-09-30T17:04:32.614 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.614 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.614 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.614 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.552621+0000", 2023-09-30T17:04:32.614 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.178e-06 2023-09-30T17:04:32.614 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.614 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.614 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.614 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.552625+0000", 2023-09-30T17:04:32.615 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8810000000000004e-06 2023-09-30T17:04:32.615 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.615 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.615 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.615 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.615 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.615 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165960 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.615 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.572645+0000", 2023-09-30T17:04:32.615 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.32738492299999999, 2023-09-30T17:04:32.615 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.33482840800000002, 2023-09-30T17:04:32.615 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.616 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.616 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.616 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.616 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.616 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165960 2023-09-30T17:04:32.616 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.616 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.616 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.616 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.616 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.572645+0000", 2023-09-30T17:04:32.616 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.616 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.617 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.617 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.617 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.572645+0000", 2023-09-30T17:04:32.617 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.617 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.617 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.617 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.574517+0000", 2023-09-30T17:04:32.617 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0018728239999999999 2023-09-30T17:04:32.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.617 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.618 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.618 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.574532+0000", 2023-09-30T17:04:32.618 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4287999999999999e-05 2023-09-30T17:04:32.618 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.618 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.618 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.618 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.574541+0000", 2023-09-30T17:04:32.618 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8489999999999995e-06 2023-09-30T17:04:32.618 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.618 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.618 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.619 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.574557+0000", 2023-09-30T17:04:32.619 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6824e-05 2023-09-30T17:04:32.619 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.619 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.619 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.619 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.619 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.619 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166212 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.619 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.661686+0000", 2023-09-30T17:04:32.619 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.23834335400000001, 2023-09-30T17:04:32.619 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.24587218399999999, 2023-09-30T17:04:32.620 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.620 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.620 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.620 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.620 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.620 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166212 2023-09-30T17:04:32.620 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.620 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.620 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.620 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.620 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.661686+0000", 2023-09-30T17:04:32.620 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.621 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.621 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.621 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.621 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.661686+0000", 2023-09-30T17:04:32.621 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.621 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.621 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.621 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.621 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.661687+0000", 2023-09-30T17:04:32.621 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9999999999999998e-07 2023-09-30T17:04:32.621 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.621 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.622 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.622 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.661700+0000", 2023-09-30T17:04:32.622 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3275000000000001e-05 2023-09-30T17:04:32.622 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.622 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.622 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.622 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.661707+0000", 2023-09-30T17:04:32.622 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.737e-06 2023-09-30T17:04:32.622 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.622 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.622 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.623 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.661712+0000", 2023-09-30T17:04:32.623 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6409999999999999e-06 2023-09-30T17:04:32.623 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.623 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.623 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.623 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.623 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.623 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166302 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.623 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.684727+0000", 2023-09-30T17:04:32.623 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.21530211699999999, 2023-09-30T17:04:32.623 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.222877241, 2023-09-30T17:04:32.623 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.624 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.624 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.624 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.624 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.624 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166302 2023-09-30T17:04:32.624 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.624 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.624 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.624 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.624 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.684727+0000", 2023-09-30T17:04:32.624 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.624 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.625 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.625 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.625 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.684727+0000", 2023-09-30T17:04:32.625 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.625 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.625 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.625 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.625 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.687040+0000", 2023-09-30T17:04:32.625 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002312307 2023-09-30T17:04:32.625 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.625 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.626 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.626 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.687050+0000", 2023-09-30T17:04:32.626 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0243e-05 2023-09-30T17:04:32.626 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.626 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.626 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.626 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.687055+0000", 2023-09-30T17:04:32.626 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9049999999999996e-06 2023-09-30T17:04:32.626 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.626 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.626 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.626 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.687059+0000", 2023-09-30T17:04:32.627 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6959999999999998e-06 2023-09-30T17:04:32.627 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.627 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.627 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.627 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.627 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.627 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166502 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.627 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.779015+0000", 2023-09-30T17:04:32.627 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.12101478, 2023-09-30T17:04:32.627 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.12863925300000001, 2023-09-30T17:04:32.627 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.627 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.628 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.628 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.628 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.628 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166502 2023-09-30T17:04:32.628 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.628 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.628 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.628 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.628 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.779015+0000", 2023-09-30T17:04:32.628 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.628 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.629 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.779015+0000", 2023-09-30T17:04:32.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.629 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.780516+0000", 2023-09-30T17:04:32.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001500794 2023-09-30T17:04:32.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.780531+0000", 2023-09-30T17:04:32.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5662e-05 2023-09-30T17:04:32.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.630 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.780546+0000", 2023-09-30T17:04:32.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4528999999999999e-05 2023-09-30T17:04:32.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.630 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.780553+0000", 2023-09-30T17:04:32.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.126e-06 2023-09-30T17:04:32.631 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.631 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.631 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.631 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.631 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.631 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166734 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.631 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.878652+0000", 2023-09-30T17:04:32.631 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.021377746, 2023-09-30T17:04:32.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.029057229, 2023-09-30T17:04:32.631 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.631 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.631 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.632 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.632 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.632 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166734 2023-09-30T17:04:32.632 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.632 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.632 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.632 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.632 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878652+0000", 2023-09-30T17:04:32.632 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.632 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.632 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.632 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.633 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878652+0000", 2023-09-30T17:04:32.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.633 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.633 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.633 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.633 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878652+0000", 2023-09-30T17:04:32.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4700000000000002e-07 2023-09-30T17:04:32.633 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.633 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.633 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.633 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878665+0000", 2023-09-30T17:04:32.634 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3142000000000001e-05 2023-09-30T17:04:32.634 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.634 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.634 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878673+0000", 2023-09-30T17:04:32.634 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.311e-06 2023-09-30T17:04:32.634 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.634 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.634 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878679+0000", 2023-09-30T17:04:32.634 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8490000000000002e-06 2023-09-30T17:04:32.635 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.635 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.635 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.635 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:167227 4.15 e57/17 4:aada5e43:::100000001f8.00000028:head v 57'2612, mlcod=57'2610)", 2023-09-30T17:04:32.635 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.896627+0000", 2023-09-30T17:04:32.635 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0034028399999999999, 2023-09-30T17:04:32.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011141451, 2023-09-30T17:04:32.635 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.635 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:32.635 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.896627+0000", 2023-09-30T17:04:32.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.896627+0000", 2023-09-30T17:04:32.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.637 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.896627+0000", 2023-09-30T17:04:32.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1300000000000001e-07 2023-09-30T17:04:32.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.637 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.637 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.896636+0000", 2023-09-30T17:04:32.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1290000000000002e-06 2023-09-30T17:04:32.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.637 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.637 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.896643+0000", 2023-09-30T17:04:32.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0899999999999999e-06 2023-09-30T17:04:32.638 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.638 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.638 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.896649+0000", 2023-09-30T17:04:32.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8819999999999998e-06 2023-09-30T17:04:32.638 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.638 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:32.638 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.896819+0000", 2023-09-30T17:04:32.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000170194 2023-09-30T17:04:32.638 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:32.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.896831+0000", 2023-09-30T17:04:32.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1147e-05 2023-09-30T17:04:32.639 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.639 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.639 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.639 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165062 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.639 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.266295+0000", 2023-09-30T17:04:32.639 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.63373414699999997, 2023-09-30T17:04:32.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.64153364700000004, 2023-09-30T17:04:32.640 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.640 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.640 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.640 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.640 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.640 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165062 2023-09-30T17:04:32.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.640 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.266295+0000", 2023-09-30T17:04:32.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.641 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.266295+0000", 2023-09-30T17:04:32.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.641 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.266296+0000", 2023-09-30T17:04:32.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6000000000000004e-07 2023-09-30T17:04:32.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.642 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.642 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.266318+0000", 2023-09-30T17:04:32.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2089000000000001e-05 2023-09-30T17:04:32.642 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.642 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.642 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.642 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.266325+0000", 2023-09-30T17:04:32.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.204e-06 2023-09-30T17:04:32.642 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.642 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.642 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.642 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.266331+0000", 2023-09-30T17:04:32.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6799999999999998e-06 2023-09-30T17:04:32.643 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.643 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.643 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.643 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165167 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.643 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.299850+0000", 2023-09-30T17:04:32.643 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.60017998299999997, 2023-09-30T17:04:32.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.60803499100000002, 2023-09-30T17:04:32.643 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.643 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.643 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.644 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.644 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.644 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165167 2023-09-30T17:04:32.644 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.644 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.644 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.299850+0000", 2023-09-30T17:04:32.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.644 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.645 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.299850+0000", 2023-09-30T17:04:32.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.645 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.645 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.645 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.645 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.306612+0000", 2023-09-30T17:04:32.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0067620329999999998 2023-09-30T17:04:32.645 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.645 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.645 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.645 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.306634+0000", 2023-09-30T17:04:32.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2785e-05 2023-09-30T17:04:32.646 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.646 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.646 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.646 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.306644+0000", 2023-09-30T17:04:32.646 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7729999999999994e-06 2023-09-30T17:04:32.646 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.646 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.646 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.646 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.306651+0000", 2023-09-30T17:04:32.646 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2459999999999997e-06 2023-09-30T17:04:32.646 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.647 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.647 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.647 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165211 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.647 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.320972+0000", 2023-09-30T17:04:32.647 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.57905800299999999, 2023-09-30T17:04:32.647 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.58696716800000004, 2023-09-30T17:04:32.647 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.647 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.647 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.647 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.648 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.648 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165211 2023-09-30T17:04:32.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.648 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.648 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.320972+0000", 2023-09-30T17:04:32.648 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.320972+0000", 2023-09-30T17:04:32.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.649 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.649 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.322516+0000", 2023-09-30T17:04:32.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0015446660000000001 2023-09-30T17:04:32.649 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.649 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.322532+0000", 2023-09-30T17:04:32.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5882000000000001e-05 2023-09-30T17:04:32.650 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.650 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.650 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.650 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.322542+0000", 2023-09-30T17:04:32.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4460000000000007e-06 2023-09-30T17:04:32.650 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.650 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.650 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.650 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.322548+0000", 2023-09-30T17:04:32.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7410000000000003e-06 2023-09-30T17:04:32.650 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.651 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.651 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.651 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.651 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165374 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.651 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.379610+0000", 2023-09-30T17:04:32.651 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.52041995600000002, 2023-09-30T17:04:32.651 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.52838940000000001, 2023-09-30T17:04:32.651 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.651 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.651 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.651 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.652 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.652 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165374 2023-09-30T17:04:32.652 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.652 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.652 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.652 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.652 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.379610+0000", 2023-09-30T17:04:32.652 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.652 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.652 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.652 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.652 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.379610+0000", 2023-09-30T17:04:32.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.653 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.653 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.379610+0000", 2023-09-30T17:04:32.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7100000000000002e-07 2023-09-30T17:04:32.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.653 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.653 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.379624+0000", 2023-09-30T17:04:32.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4132e-05 2023-09-30T17:04:32.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.654 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.379631+0000", 2023-09-30T17:04:32.654 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8580000000000002e-06 2023-09-30T17:04:32.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.654 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.379637+0000", 2023-09-30T17:04:32.654 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4790000000000004e-06 2023-09-30T17:04:32.654 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.654 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.655 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.655 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.655 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.655 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165481 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.672 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.400573+0000", 2023-09-30T17:04:32.672 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.49945659199999998, 2023-09-30T17:04:32.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.50748418299999998, 2023-09-30T17:04:32.672 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.672 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.672 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.673 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.673 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.673 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165481 2023-09-30T17:04:32.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.673 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.673 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.673 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.400573+0000", 2023-09-30T17:04:32.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.674 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.674 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.400573+0000", 2023-09-30T17:04:32.674 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.674 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.674 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.400574+0000", 2023-09-30T17:04:32.674 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2099999999999996e-07 2023-09-30T17:04:32.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.674 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.675 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.400587+0000", 2023-09-30T17:04:32.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3464e-05 2023-09-30T17:04:32.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.675 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.675 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.400595+0000", 2023-09-30T17:04:32.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4830000000000002e-06 2023-09-30T17:04:32.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.675 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.677 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.400600+0000", 2023-09-30T17:04:32.677 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8340000000000004e-06 2023-09-30T17:04:32.677 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.677 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.677 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.677 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165699 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.678 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.489579+0000", 2023-09-30T17:04:32.678 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.41045105900000001, 2023-09-30T17:04:32.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.41853676299999998, 2023-09-30T17:04:32.678 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.678 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.678 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.678 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.678 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.678 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165699 2023-09-30T17:04:32.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.678 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.678 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.679 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.679 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.489579+0000", 2023-09-30T17:04:32.679 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.679 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.679 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.489579+0000", 2023-09-30T17:04:32.679 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.679 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.679 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.489579+0000", 2023-09-30T17:04:32.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8800000000000003e-07 2023-09-30T17:04:32.680 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.680 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.680 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.489598+0000", 2023-09-30T17:04:32.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9262999999999998e-05 2023-09-30T17:04:32.680 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.680 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.680 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.489605+0000", 2023-09-30T17:04:32.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7989999999999996e-06 2023-09-30T17:04:32.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.681 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.681 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.489610+0000", 2023-09-30T17:04:32.681 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1760000000000001e-06 2023-09-30T17:04:32.681 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.681 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.681 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.681 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165726 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.681 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.499661+0000", 2023-09-30T17:04:32.682 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.40036821900000003, 2023-09-30T17:04:32.682 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.40851038899999997, 2023-09-30T17:04:32.682 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.682 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.682 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.682 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.682 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.682 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165726 2023-09-30T17:04:32.682 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.682 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.682 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.683 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.683 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.499661+0000", 2023-09-30T17:04:32.683 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.683 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.683 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.683 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.499661+0000", 2023-09-30T17:04:32.683 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.683 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.683 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.683 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.501515+0000", 2023-09-30T17:04:32.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001853255 2023-09-30T17:04:32.684 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.684 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.684 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.501531+0000", 2023-09-30T17:04:32.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6087e-05 2023-09-30T17:04:32.684 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.684 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.684 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.501541+0000", 2023-09-30T17:04:32.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0659000000000001e-05 2023-09-30T17:04:32.684 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.685 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.685 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.501548+0000", 2023-09-30T17:04:32.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.489e-06 2023-09-30T17:04:32.685 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.685 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.685 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.685 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.685 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166261 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.685 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.679690+0000", 2023-09-30T17:04:32.686 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.220339914, 2023-09-30T17:04:32.686 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.22853985099999999, 2023-09-30T17:04:32.686 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.686 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.686 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.686 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.686 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.686 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166261 2023-09-30T17:04:32.686 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.686 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.686 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.687 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.687 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.679690+0000", 2023-09-30T17:04:32.687 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.687 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.687 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.687 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.687 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.679690+0000", 2023-09-30T17:04:32.687 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.687 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.687 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.687 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.688 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.679690+0000", 2023-09-30T17:04:32.688 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4700000000000001e-07 2023-09-30T17:04:32.688 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.688 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.688 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.688 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.679707+0000", 2023-09-30T17:04:32.688 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6294e-05 2023-09-30T17:04:32.688 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.688 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.688 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.689 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.679714+0000", 2023-09-30T17:04:32.689 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6660000000000008e-06 2023-09-30T17:04:32.689 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.689 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.689 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.679720+0000", 2023-09-30T17:04:32.689 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4129999999999997e-06 2023-09-30T17:04:32.689 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.689 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.689 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.689 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.690 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166639 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.690 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.850571+0000", 2023-09-30T17:04:32.690 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.049459003000000001, 2023-09-30T17:04:32.690 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.057713702999999998, 2023-09-30T17:04:32.690 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.690 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.690 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.690 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.690 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.690 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166639 2023-09-30T17:04:32.690 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.691 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.691 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.691 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.691 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.850571+0000", 2023-09-30T17:04:32.691 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.691 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.691 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.691 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.691 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.850571+0000", 2023-09-30T17:04:32.691 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.691 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.692 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.692 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.692 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.850571+0000", 2023-09-30T17:04:32.692 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5400000000000001e-07 2023-09-30T17:04:32.692 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.692 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.692 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.692 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.850585+0000", 2023-09-30T17:04:32.692 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4028e-05 2023-09-30T17:04:32.692 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.692 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.692 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.693 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.850596+0000", 2023-09-30T17:04:32.693 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1242e-05 2023-09-30T17:04:32.693 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.693 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.693 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.693 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.850604+0000", 2023-09-30T17:04:32.693 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0150000000000003e-06 2023-09-30T17:04:32.693 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.693 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.693 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.693 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.693 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.694 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166701 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.694 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.863002+0000", 2023-09-30T17:04:32.694 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.037028054999999997, 2023-09-30T17:04:32.694 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045337906999999997, 2023-09-30T17:04:32.694 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.694 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.694 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.694 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.694 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.694 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166701 2023-09-30T17:04:32.694 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.695 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.695 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.695 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.695 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.863002+0000", 2023-09-30T17:04:32.695 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.695 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.695 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.695 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.695 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.863002+0000", 2023-09-30T17:04:32.695 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.695 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.696 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.696 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.696 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.863002+0000", 2023-09-30T17:04:32.696 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6400000000000002e-07 2023-09-30T17:04:32.696 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.696 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.696 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.696 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.863016+0000", 2023-09-30T17:04:32.696 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3742e-05 2023-09-30T17:04:32.696 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.696 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.696 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.697 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.863022+0000", 2023-09-30T17:04:32.697 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6510000000000004e-06 2023-09-30T17:04:32.697 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.697 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.697 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.697 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.863028+0000", 2023-09-30T17:04:32.697 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5720000000000002e-06 2023-09-30T17:04:32.697 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.697 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.697 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.697 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.698 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.698 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165100 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.698 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.275840+0000", 2023-09-30T17:04:32.698 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.62418966200000003, 2023-09-30T17:04:32.698 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.63256190599999995, 2023-09-30T17:04:32.698 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.698 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.698 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.698 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.698 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.698 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165100 2023-09-30T17:04:32.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.699 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.699 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.699 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.275840+0000", 2023-09-30T17:04:32.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.699 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.699 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.275840+0000", 2023-09-30T17:04:32.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.700 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.700 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.700 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.700 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.275840+0000", 2023-09-30T17:04:32.700 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6600000000000002e-07 2023-09-30T17:04:32.700 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.700 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.700 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.700 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.275852+0000", 2023-09-30T17:04:32.708 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1697e-05 2023-09-30T17:04:32.709 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.709 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.709 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.709 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.275858+0000", 2023-09-30T17:04:32.709 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0859999999999998e-06 2023-09-30T17:04:32.709 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.709 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.709 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.709 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.275863+0000", 2023-09-30T17:04:32.709 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.578e-06 2023-09-30T17:04:32.709 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.710 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.710 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.710 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.710 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.710 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165258 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.710 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.336893+0000", 2023-09-30T17:04:32.710 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.56313693300000001, 2023-09-30T17:04:32.710 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.57156339, 2023-09-30T17:04:32.710 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.710 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.710 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.711 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.711 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.711 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165258 2023-09-30T17:04:32.711 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.711 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.711 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.711 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.711 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.336893+0000", 2023-09-30T17:04:32.711 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.711 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.711 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.712 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.712 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.336893+0000", 2023-09-30T17:04:32.712 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.712 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.712 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.712 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.712 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.336893+0000", 2023-09-30T17:04:32.712 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.03e-07 2023-09-30T17:04:32.712 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.712 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.713 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.713 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.336908+0000", 2023-09-30T17:04:32.713 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4742e-05 2023-09-30T17:04:32.713 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.713 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.717 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.717 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.336915+0000", 2023-09-30T17:04:32.717 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5680000000000002e-06 2023-09-30T17:04:32.717 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.717 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.717 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.717 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.336921+0000", 2023-09-30T17:04:32.717 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6980000000000003e-06 2023-09-30T17:04:32.717 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.717 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.717 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.718 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.718 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.718 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165727 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.718 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.501558+0000", 2023-09-30T17:04:32.718 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.39847144899999998, 2023-09-30T17:04:32.718 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.40695680200000001, 2023-09-30T17:04:32.718 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.718 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.718 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.718 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.718 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.719 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165727 2023-09-30T17:04:32.719 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.719 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.719 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.719 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.719 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.501558+0000", 2023-09-30T17:04:32.719 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.719 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.719 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.719 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.719 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.501558+0000", 2023-09-30T17:04:32.720 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.720 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.720 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.720 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.720 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.501559+0000", 2023-09-30T17:04:32.720 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0900000000000002e-07 2023-09-30T17:04:32.720 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.720 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.720 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.720 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.501575+0000", 2023-09-30T17:04:32.720 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6608000000000001e-05 2023-09-30T17:04:32.721 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.721 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.721 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.721 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.501586+0000", 2023-09-30T17:04:32.721 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0814e-05 2023-09-30T17:04:32.721 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.721 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.721 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.721 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.501592+0000", 2023-09-30T17:04:32.721 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9800000000000003e-06 2023-09-30T17:04:32.721 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.721 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.722 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.722 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.722 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.722 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165852 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.722 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.538884+0000", 2023-09-30T17:04:32.722 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.36114536600000002, 2023-09-30T17:04:32.722 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.36969219199999998, 2023-09-30T17:04:32.722 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.722 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.722 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.722 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.723 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.723 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165852 2023-09-30T17:04:32.723 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.723 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.723 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.723 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.723 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.538884+0000", 2023-09-30T17:04:32.723 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.723 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.723 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.723 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.723 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.538884+0000", 2023-09-30T17:04:32.724 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.724 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.724 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.724 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.724 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.538885+0000", 2023-09-30T17:04:32.724 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8400000000000004e-07 2023-09-30T17:04:32.724 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.724 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.724 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.724 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.538902+0000", 2023-09-30T17:04:32.724 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7518999999999999e-05 2023-09-30T17:04:32.724 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.725 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.725 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.725 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.538912+0000", 2023-09-30T17:04:32.725 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5710000000000004e-06 2023-09-30T17:04:32.725 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.725 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.725 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.725 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.538919+0000", 2023-09-30T17:04:32.725 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.153e-06 2023-09-30T17:04:32.725 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.725 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.726 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.726 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.726 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.726 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166109 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.726 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.621063+0000", 2023-09-30T17:04:32.726 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.278966989, 2023-09-30T17:04:32.726 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.28755000200000003, 2023-09-30T17:04:32.726 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.726 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.726 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.726 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.727 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.727 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166109 2023-09-30T17:04:32.727 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.727 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.727 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.727 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.727 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.621063+0000", 2023-09-30T17:04:32.727 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.727 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.727 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.727 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.727 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.621063+0000", 2023-09-30T17:04:32.728 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.728 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.728 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.728 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.728 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.623372+0000", 2023-09-30T17:04:32.728 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002308966 2023-09-30T17:04:32.728 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.728 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.728 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.728 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.623390+0000", 2023-09-30T17:04:32.728 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8025000000000001e-05 2023-09-30T17:04:32.728 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.729 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.729 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.729 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.623394+0000", 2023-09-30T17:04:32.729 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8199999999999996e-06 2023-09-30T17:04:32.729 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.729 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.729 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.729 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.623398+0000", 2023-09-30T17:04:32.729 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3680000000000002e-06 2023-09-30T17:04:32.729 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.729 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.730 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.730 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.730 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.730 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166561 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.730 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.811722+0000", 2023-09-30T17:04:32.730 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.088307383000000003, 2023-09-30T17:04:32.730 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.096924087000000006, 2023-09-30T17:04:32.730 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.730 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.730 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.730 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.730 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.731 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166561 2023-09-30T17:04:32.731 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.731 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.731 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.731 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.731 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.811722+0000", 2023-09-30T17:04:32.731 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.731 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.731 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.731 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.731 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.811722+0000", 2023-09-30T17:04:32.731 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.732 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.732 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.732 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.732 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.811723+0000", 2023-09-30T17:04:32.732 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4299999999999998e-07 2023-09-30T17:04:32.732 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.732 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.732 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.732 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.811747+0000", 2023-09-30T17:04:32.732 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3901e-05 2023-09-30T17:04:32.732 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.733 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.733 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.733 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.811754+0000", 2023-09-30T17:04:32.733 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9890000000000003e-06 2023-09-30T17:04:32.733 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.733 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.733 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.733 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.811760+0000", 2023-09-30T17:04:32.733 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9780000000000002e-06 2023-09-30T17:04:32.733 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.733 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.734 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.734 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.734 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.734 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166740 4.12 4:4be51a30:::100000001f8.0000000b:head [write 3035136~4096 in=4096b,write 3072000~4096 in=4096b,write 3092480~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.734 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.878722+0000", 2023-09-30T17:04:32.734 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.02130758, 2023-09-30T17:04:32.734 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.029961924000000001, 2023-09-30T17:04:32.734 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.734 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:32.734 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.734 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.735 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.735 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166740 2023-09-30T17:04:32.735 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.735 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.735 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.735 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.735 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878722+0000", 2023-09-30T17:04:32.735 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.735 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.735 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.735 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.736 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878722+0000", 2023-09-30T17:04:32.736 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.736 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.736 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.736 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.736 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878723+0000", 2023-09-30T17:04:32.736 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6400000000000002e-07 2023-09-30T17:04:32.736 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.736 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.736 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.736 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878752+0000", 2023-09-30T17:04:32.736 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8949999999999999e-05 2023-09-30T17:04:32.737 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.737 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.737 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.737 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878759+0000", 2023-09-30T17:04:32.737 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6820000000000003e-06 2023-09-30T17:04:32.737 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.737 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.737 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.737 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878765+0000", 2023-09-30T17:04:32.737 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2530000000000001e-06 2023-09-30T17:04:32.737 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.738 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.738 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:32.738 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.898530+0000", 2023-09-30T17:04:32.738 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019764460000000001 2023-09-30T17:04:32.738 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.738 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.738 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:32.738 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.898614+0000", 2023-09-30T17:04:32.738 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4398000000000001e-05 2023-09-30T17:04:32.738 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.738 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.738 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:32.739 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.898779+0000", 2023-09-30T17:04:32.739 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000164907 2023-09-30T17:04:32.739 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.739 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.739 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.739 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.739 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.739 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165101 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.739 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.275869+0000", 2023-09-30T17:04:32.739 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.62416077299999995, 2023-09-30T17:04:32.739 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.63286234200000002, 2023-09-30T17:04:32.740 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.740 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.740 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.740 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.740 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.740 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165101 2023-09-30T17:04:32.740 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.740 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.740 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.740 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.740 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.275869+0000", 2023-09-30T17:04:32.740 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.741 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.741 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.741 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.741 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.275869+0000", 2023-09-30T17:04:32.741 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.741 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.741 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.741 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.741 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.275869+0000", 2023-09-30T17:04:32.741 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6800000000000001e-07 2023-09-30T17:04:32.741 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.741 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.742 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.742 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.275880+0000", 2023-09-30T17:04:32.742 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0927000000000001e-05 2023-09-30T17:04:32.742 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.742 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.742 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.742 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.275886+0000", 2023-09-30T17:04:32.742 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5300000000000004e-06 2023-09-30T17:04:32.742 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.742 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.742 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.743 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.275890+0000", 2023-09-30T17:04:32.743 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6430000000000003e-06 2023-09-30T17:04:32.743 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.743 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.743 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.743 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.743 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.743 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165214 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.743 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.322561+0000", 2023-09-30T17:04:32.743 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.57746839599999999, 2023-09-30T17:04:32.743 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.58621234499999997, 2023-09-30T17:04:32.743 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.744 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.744 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.744 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.744 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.744 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165214 2023-09-30T17:04:32.744 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.744 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.744 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.744 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.322561+0000", 2023-09-30T17:04:32.744 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.745 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.745 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.745 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.745 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.322561+0000", 2023-09-30T17:04:32.745 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.745 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.745 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.745 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.745 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.324515+0000", 2023-09-30T17:04:32.745 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001953682 2023-09-30T17:04:32.745 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.745 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.746 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.746 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.324529+0000", 2023-09-30T17:04:32.746 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4243999999999999e-05 2023-09-30T17:04:32.746 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.746 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.746 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.746 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.324540+0000", 2023-09-30T17:04:32.746 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0443e-05 2023-09-30T17:04:32.746 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.746 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.746 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.747 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.324546+0000", 2023-09-30T17:04:32.747 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6599999999999998e-06 2023-09-30T17:04:32.747 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.747 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.747 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.747 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.812 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.812 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165553 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.812 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.427626+0000", 2023-09-30T17:04:32.812 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.472403511, 2023-09-30T17:04:32.812 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.48118067399999997, 2023-09-30T17:04:32.812 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.812 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.812 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.813 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.813 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.813 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165553 2023-09-30T17:04:32.813 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.813 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.813 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.813 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.427626+0000", 2023-09-30T17:04:32.813 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.813 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.814 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.814 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.814 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.427626+0000", 2023-09-30T17:04:32.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.814 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.814 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.814 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.814 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.432601+0000", 2023-09-30T17:04:32.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0049751350000000003 2023-09-30T17:04:32.814 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.814 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.815 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.815 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.432619+0000", 2023-09-30T17:04:32.815 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7329e-05 2023-09-30T17:04:32.815 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.815 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.815 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.815 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.432626+0000", 2023-09-30T17:04:32.815 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5900000000000002e-06 2023-09-30T17:04:32.815 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.815 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.815 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.816 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.432632+0000", 2023-09-30T17:04:32.816 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4729999999999999e-06 2023-09-30T17:04:32.816 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.816 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.816 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.816 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.816 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.816 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165730 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.816 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.501601+0000", 2023-09-30T17:04:32.816 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.39842856999999998, 2023-09-30T17:04:32.817 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.40723558199999998, 2023-09-30T17:04:32.817 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.817 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.817 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.817 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.817 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.817 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165730 2023-09-30T17:04:32.817 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.817 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.817 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.817 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.817 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.501601+0000", 2023-09-30T17:04:32.818 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.818 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.818 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.818 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.818 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.501601+0000", 2023-09-30T17:04:32.818 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.818 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.818 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.818 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.818 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.501602+0000", 2023-09-30T17:04:32.818 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0100000000000005e-07 2023-09-30T17:04:32.819 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.819 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.819 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.819 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.501612+0000", 2023-09-30T17:04:32.819 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0511e-05 2023-09-30T17:04:32.819 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.819 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.828 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.829 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.501620+0000", 2023-09-30T17:04:32.829 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6520000000000006e-06 2023-09-30T17:04:32.829 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.829 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.829 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.501626+0000", 2023-09-30T17:04:32.829 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9649999999999996e-06 2023-09-30T17:04:32.829 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.830 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.830 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.831 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.831 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.831 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165856 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.831 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.538931+0000", 2023-09-30T17:04:32.831 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.36109890100000003, 2023-09-30T17:04:32.831 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.369936398, 2023-09-30T17:04:32.831 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.831 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.832 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.832 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.832 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.832 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165856 2023-09-30T17:04:32.832 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.832 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.832 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.832 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.832 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.538931+0000", 2023-09-30T17:04:32.832 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.832 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.832 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.833 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.833 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.538931+0000", 2023-09-30T17:04:32.842 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.842 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.842 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.842 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.842 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.538931+0000", 2023-09-30T17:04:32.842 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0900000000000001e-07 2023-09-30T17:04:32.842 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.842 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.842 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.843 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.538944+0000", 2023-09-30T17:04:32.843 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2319e-05 2023-09-30T17:04:32.843 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.843 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.843 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.843 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.538951+0000", 2023-09-30T17:04:32.843 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1319999999999996e-06 2023-09-30T17:04:32.843 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.843 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.843 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.843 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.538957+0000", 2023-09-30T17:04:32.844 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8490000000000002e-06 2023-09-30T17:04:32.844 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.844 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.844 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.844 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.844 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.844 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165996 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.844 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.586762+0000", 2023-09-30T17:04:32.844 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.31326758300000002, 2023-09-30T17:04:32.844 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.32213561299999999, 2023-09-30T17:04:32.844 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.845 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.845 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.845 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.845 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.845 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165996 2023-09-30T17:04:32.845 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.845 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.845 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.846 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.846 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.586762+0000", 2023-09-30T17:04:32.846 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.846 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.846 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.846 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.847 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.586762+0000", 2023-09-30T17:04:32.847 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.847 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.847 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.847 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.847 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.590516+0000", 2023-09-30T17:04:32.847 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00375435 2023-09-30T17:04:32.847 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.847 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.847 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.847 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.590532+0000", 2023-09-30T17:04:32.848 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5150999999999999e-05 2023-09-30T17:04:32.848 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.848 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.848 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.848 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.590540+0000", 2023-09-30T17:04:32.848 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5250000000000005e-06 2023-09-30T17:04:32.848 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.848 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.855 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.855 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.590546+0000", 2023-09-30T17:04:32.855 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9859999999999999e-06 2023-09-30T17:04:32.855 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.855 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.855 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.856 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.856 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.856 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166141 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.856 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.638265+0000", 2023-09-30T17:04:32.856 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.26176412100000002, 2023-09-30T17:04:32.856 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.27066219699999999, 2023-09-30T17:04:32.856 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.856 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.856 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.856 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.856 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.857 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166141 2023-09-30T17:04:32.857 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.857 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.857 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.638265+0000", 2023-09-30T17:04:32.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.857 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.857 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.638265+0000", 2023-09-30T17:04:32.858 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.858 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.858 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.858 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.858 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.639514+0000", 2023-09-30T17:04:32.858 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0012488600000000001 2023-09-30T17:04:32.858 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.858 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.858 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.858 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.639531+0000", 2023-09-30T17:04:32.858 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6875999999999999e-05 2023-09-30T17:04:32.858 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.859 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.859 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.859 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.639541+0000", 2023-09-30T17:04:32.859 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5699999999999999e-06 2023-09-30T17:04:32.859 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.859 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.859 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.859 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.639545+0000", 2023-09-30T17:04:32.859 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2799999999999997e-06 2023-09-30T17:04:32.859 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.859 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.860 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.860 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.860 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.860 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166216 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.860 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.661810+0000", 2023-09-30T17:04:32.860 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.23821963900000001, 2023-09-30T17:04:32.860 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.24714829799999999, 2023-09-30T17:04:32.860 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.860 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.860 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.860 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.861 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.861 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166216 2023-09-30T17:04:32.861 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.861 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.861 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.861 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.861 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.661810+0000", 2023-09-30T17:04:32.861 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.872 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.872 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.661810+0000", 2023-09-30T17:04:32.873 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.873 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.873 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.873 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.873 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.661810+0000", 2023-09-30T17:04:32.873 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.39e-07 2023-09-30T17:04:32.873 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.873 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.873 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.873 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.661834+0000", 2023-09-30T17:04:32.873 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3164999999999999e-05 2023-09-30T17:04:32.874 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.874 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.874 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.874 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.661840+0000", 2023-09-30T17:04:32.874 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9319999999999999e-06 2023-09-30T17:04:32.874 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.874 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.874 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.874 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.661846+0000", 2023-09-30T17:04:32.874 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2599999999999996e-06 2023-09-30T17:04:32.874 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.875 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.875 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.875 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.875 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.875 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166405 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.876 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.738571+0000", 2023-09-30T17:04:32.876 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.16145901400000001, 2023-09-30T17:04:32.876 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.170420182, 2023-09-30T17:04:32.876 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.876 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.876 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.876 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.876 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.876 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166405 2023-09-30T17:04:32.876 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.877 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.877 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.877 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.877 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.738571+0000", 2023-09-30T17:04:32.877 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.877 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.877 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.877 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.877 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.738571+0000", 2023-09-30T17:04:32.877 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.877 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.878 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.878 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.878 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.738571+0000", 2023-09-30T17:04:32.878 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1099999999999996e-07 2023-09-30T17:04:32.878 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.878 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.878 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.878 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.738584+0000", 2023-09-30T17:04:32.878 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2941e-05 2023-09-30T17:04:32.878 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.878 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.878 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.878 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.738591+0000", 2023-09-30T17:04:32.879 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5039999999999999e-06 2023-09-30T17:04:32.879 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.879 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.879 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.879 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.738596+0000", 2023-09-30T17:04:32.879 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0749999999999997e-06 2023-09-30T17:04:32.879 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.879 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.879 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.879 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.879 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.881 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166438 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.881 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.750605+0000", 2023-09-30T17:04:32.881 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.14942409800000001, 2023-09-30T17:04:32.881 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.158416062, 2023-09-30T17:04:32.881 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.881 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.881 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.881 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.881 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.882 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166438 2023-09-30T17:04:32.882 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.882 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.882 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.882 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.882 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.750605+0000", 2023-09-30T17:04:32.882 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.882 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.882 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.882 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.882 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.750605+0000", 2023-09-30T17:04:32.883 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.883 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.894 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.894 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.894 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.750606+0000", 2023-09-30T17:04:32.894 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1099999999999995e-07 2023-09-30T17:04:32.894 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.895 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.895 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.895 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.750620+0000", 2023-09-30T17:04:32.895 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3494e-05 2023-09-30T17:04:32.895 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.895 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.895 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.895 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.750627+0000", 2023-09-30T17:04:32.895 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4880000000000001e-06 2023-09-30T17:04:32.895 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.895 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.895 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.896 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.750633+0000", 2023-09-30T17:04:32.896 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9200000000000001e-06 2023-09-30T17:04:32.896 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.896 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.896 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.896 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.896 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.896 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166622 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.896 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.834622+0000", 2023-09-30T17:04:32.896 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.065407277999999999, 2023-09-30T17:04:32.896 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.074429443999999997, 2023-09-30T17:04:32.897 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.897 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.897 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.897 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.897 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.897 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166622 2023-09-30T17:04:32.897 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.897 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.897 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.897 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.897 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.834622+0000", 2023-09-30T17:04:32.897 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.898 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.898 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.898 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.898 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.834622+0000", 2023-09-30T17:04:32.898 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.898 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.898 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.898 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.898 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.834623+0000", 2023-09-30T17:04:32.898 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4900000000000001e-07 2023-09-30T17:04:32.898 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.898 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.899 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.899 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.834633+0000", 2023-09-30T17:04:32.899 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0618999999999999e-05 2023-09-30T17:04:32.899 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.899 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.899 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.899 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.834639+0000", 2023-09-30T17:04:32.899 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6659999999999996e-06 2023-09-30T17:04:32.899 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.899 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.899 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.899 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.834643+0000", 2023-09-30T17:04:32.900 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4309999999999996e-06 2023-09-30T17:04:32.900 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.900 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.900 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.900 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.900 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.900 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:165651 4.6 e57/17)", 2023-09-30T17:04:32.900 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.897126+0000", 2023-09-30T17:04:32.900 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.002903966, 2023-09-30T17:04:32.900 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011955343, 2023-09-30T17:04:32.900 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.901 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.901 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.901 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.901 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.901 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.897126+0000", 2023-09-30T17:04:32.901 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.901 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.901 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.901 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.901 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.897126+0000", 2023-09-30T17:04:32.901 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.901 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.902 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.902 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.902 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.897126+0000", 2023-09-30T17:04:32.902 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2700000000000001e-07 2023-09-30T17:04:32.902 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.902 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.902 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.902 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.897140+0000", 2023-09-30T17:04:32.902 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4209000000000001e-05 2023-09-30T17:04:32.902 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.902 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.903 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.903 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.897148+0000", 2023-09-30T17:04:32.903 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7640000000000005e-06 2023-09-30T17:04:32.903 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.903 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.903 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.903 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.897152+0000", 2023-09-30T17:04:32.903 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4050000000000002e-06 2023-09-30T17:04:32.903 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.903 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.903 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.903 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.904 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.904 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165443 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.904 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.387651+0000", 2023-09-30T17:04:32.904 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.51237867599999998, 2023-09-30T17:04:32.904 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.52145757699999995, 2023-09-30T17:04:32.904 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.904 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.904 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.904 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.973 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.973 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165443 2023-09-30T17:04:32.973 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.973 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.973 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.973 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.973 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.387651+0000", 2023-09-30T17:04:32.973 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.973 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.974 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.974 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.974 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.387651+0000", 2023-09-30T17:04:32.974 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.974 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.974 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.974 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.974 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.390889+0000", 2023-09-30T17:04:32.974 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0032385370000000001 2023-09-30T17:04:32.974 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.974 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.974 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.975 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.390907+0000", 2023-09-30T17:04:32.975 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7359000000000001e-05 2023-09-30T17:04:32.975 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.975 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.975 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.975 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.390914+0000", 2023-09-30T17:04:32.975 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4619999999999999e-06 2023-09-30T17:04:32.975 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.975 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.975 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.975 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.390920+0000", 2023-09-30T17:04:32.975 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2809999999999999e-06 2023-09-30T17:04:32.976 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.976 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.976 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.976 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.976 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.976 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165554 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.976 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.432640+0000", 2023-09-30T17:04:32.976 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.46738931099999997, 2023-09-30T17:04:32.976 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.47649825699999998, 2023-09-30T17:04:32.976 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.976 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.976 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.977 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.977 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.977 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165554 2023-09-30T17:04:32.977 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.977 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.977 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.977 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.977 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.432640+0000", 2023-09-30T17:04:32.977 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.977 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.977 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.977 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.978 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.432640+0000", 2023-09-30T17:04:32.978 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.978 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.978 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.978 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.978 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.432641+0000", 2023-09-30T17:04:32.978 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.68e-07 2023-09-30T17:04:32.978 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.978 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.978 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.978 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.432652+0000", 2023-09-30T17:04:32.978 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1138000000000001e-05 2023-09-30T17:04:32.979 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.979 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.979 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.979 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.432658+0000", 2023-09-30T17:04:32.979 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8640000000000001e-06 2023-09-30T17:04:32.979 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.981 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.981 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.981 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.432663+0000", 2023-09-30T17:04:32.982 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5459999999999999e-06 2023-09-30T17:04:32.982 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.982 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.982 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.982 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.982 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.982 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165655 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.982 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.472564+0000", 2023-09-30T17:04:32.982 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.42746591699999997, 2023-09-30T17:04:32.982 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.43660611300000002, 2023-09-30T17:04:32.982 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.983 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.983 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.983 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.983 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.983 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165655 2023-09-30T17:04:32.983 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.983 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.983 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.983 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.983 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.472564+0000", 2023-09-30T17:04:32.983 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.984 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.984 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.984 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.984 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.472564+0000", 2023-09-30T17:04:32.984 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.984 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.984 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.984 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.984 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.472564+0000", 2023-09-30T17:04:32.984 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7e-07 2023-09-30T17:04:32.984 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.984 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.985 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.985 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.472574+0000", 2023-09-30T17:04:32.985 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7839999999999998e-06 2023-09-30T17:04:32.985 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.985 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.985 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.985 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.472581+0000", 2023-09-30T17:04:32.985 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9269999999999999e-06 2023-09-30T17:04:32.985 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.985 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.985 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.985 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.472585+0000", 2023-09-30T17:04:32.986 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1409999999999998e-06 2023-09-30T17:04:32.986 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.986 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.986 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.986 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.986 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.986 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165821 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.986 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.527602+0000", 2023-09-30T17:04:32.986 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.37242784499999998, 2023-09-30T17:04:32.986 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.38159853999999999, 2023-09-30T17:04:32.986 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.987 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.987 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.987 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.987 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.987 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165821 2023-09-30T17:04:32.987 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.987 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:32.987 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.987 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:32.987 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.527602+0000", 2023-09-30T17:04:32.987 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.987 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.996 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:32.996 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.527602+0000", 2023-09-30T17:04:32.996 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:32.996 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.997 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:32.997 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.529518+0000", 2023-09-30T17:04:32.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001915883 2023-09-30T17:04:32.997 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.997 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:32.997 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.529530+0000", 2023-09-30T17:04:32.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.252e-05 2023-09-30T17:04:32.997 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.997 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:32.997 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.529539+0000", 2023-09-30T17:04:32.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8899999999999996e-06 2023-09-30T17:04:32.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.998 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:32.998 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.529545+0000", 2023-09-30T17:04:32.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2999999999999998e-06 2023-09-30T17:04:32.998 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.998 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:32.998 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:32.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:32.999 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165904 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:32.999 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.552724+0000", 2023-09-30T17:04:32.999 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.34730563399999997, 2023-09-30T17:04:32.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.356507662, 2023-09-30T17:04:32.999 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:32.999 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:32.999 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:32.999 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:32.999 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:32.999 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165904 2023-09-30T17:04:32.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:32.999 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.000 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.000 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.552724+0000", 2023-09-30T17:04:33.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.000 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.000 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.552724+0000", 2023-09-30T17:04:33.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.000 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.001 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.552724+0000", 2023-09-30T17:04:33.001 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6400000000000003e-07 2023-09-30T17:04:33.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.001 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.001 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.552740+0000", 2023-09-30T17:04:33.001 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5270000000000001e-05 2023-09-30T17:04:33.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.001 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.001 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.552746+0000", 2023-09-30T17:04:33.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9989999999999997e-06 2023-09-30T17:04:33.002 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.002 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.002 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.552751+0000", 2023-09-30T17:04:33.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6160000000000001e-06 2023-09-30T17:04:33.002 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.002 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.002 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.002 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.002 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165997 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.003 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.590557+0000", 2023-09-30T17:04:33.018 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.30947241399999997, 2023-09-30T17:04:33.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.31870602599999998, 2023-09-30T17:04:33.018 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.019 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.019 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.019 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.019 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.019 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165997 2023-09-30T17:04:33.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.019 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.019 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.019 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.590557+0000", 2023-09-30T17:04:33.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.590557+0000", 2023-09-30T17:04:33.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.590558+0000", 2023-09-30T17:04:33.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.72e-07 2023-09-30T17:04:33.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.021 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.021 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.590572+0000", 2023-09-30T17:04:33.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4474000000000001e-05 2023-09-30T17:04:33.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.021 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.021 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.590577+0000", 2023-09-30T17:04:33.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.69e-06 2023-09-30T17:04:33.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.022 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.022 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.590580+0000", 2023-09-30T17:04:33.022 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.597e-06 2023-09-30T17:04:33.022 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.022 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.022 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.022 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.022 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.022 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:165577 4.6 e57/17 4:63e80496:::100000001f8.0000001e:head v 57'10198, mlcod=57'10188)", 2023-09-30T17:04:33.022 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.853397+0000", 2023-09-30T17:04:33.022 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.046632561000000003, 2023-09-30T17:04:33.022 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.055897009999999997, 2023-09-30T17:04:33.023 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.023 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:33.023 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.023 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.023 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.023 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.853397+0000", 2023-09-30T17:04:33.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.023 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.023 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.023 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.023 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.853397+0000", 2023-09-30T17:04:33.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.024 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.024 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.853397+0000", 2023-09-30T17:04:33.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9999999999999999e-07 2023-09-30T17:04:33.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.024 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.853413+0000", 2023-09-30T17:04:33.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6013000000000001e-05 2023-09-30T17:04:33.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.853420+0000", 2023-09-30T17:04:33.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.153e-06 2023-09-30T17:04:33.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.032 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.032 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.853426+0000", 2023-09-30T17:04:33.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2610000000000001e-06 2023-09-30T17:04:33.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.032 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:33.032 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.877073+0000", 2023-09-30T17:04:33.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.023647471 2023-09-30T17:04:33.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.033 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.033 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:33.033 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.877087+0000", 2023-09-30T17:04:33.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4259e-05 2023-09-30T17:04:33.033 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.033 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.033 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.033 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.033 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.033 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166743 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.033 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.878817+0000", 2023-09-30T17:04:33.033 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.021212226000000001, 2023-09-30T17:04:33.034 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.030510211999999998, 2023-09-30T17:04:33.034 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.034 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.034 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.034 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.034 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.034 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166743 2023-09-30T17:04:33.034 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.034 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.034 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.035 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878817+0000", 2023-09-30T17:04:33.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.035 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.035 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.035 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.035 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878817+0000", 2023-09-30T17:04:33.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.035 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.035 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.035 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.035 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878818+0000", 2023-09-30T17:04:33.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6899999999999998e-07 2023-09-30T17:04:33.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.036 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878844+0000", 2023-09-30T17:04:33.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5905999999999999e-05 2023-09-30T17:04:33.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.036 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878853+0000", 2023-09-30T17:04:33.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7589999999999992e-06 2023-09-30T17:04:33.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.037 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878860+0000", 2023-09-30T17:04:33.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0109999999999997e-06 2023-09-30T17:04:33.037 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.037 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.037 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.037 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165105 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.037 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.275932+0000", 2023-09-30T17:04:33.038 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.62409775700000003, 2023-09-30T17:04:33.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.63342574299999999, 2023-09-30T17:04:33.039 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.039 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.039 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.039 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.039 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.039 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165105 2023-09-30T17:04:33.039 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.039 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.040 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.040 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.275932+0000", 2023-09-30T17:04:33.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.040 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.040 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.040 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.040 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.275932+0000", 2023-09-30T17:04:33.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.040 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.040 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.041 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.041 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.275932+0000", 2023-09-30T17:04:33.041 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9200000000000002e-07 2023-09-30T17:04:33.041 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.041 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.041 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.041 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.275945+0000", 2023-09-30T17:04:33.041 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.256e-05 2023-09-30T17:04:33.041 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.041 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.074 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.074 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.275951+0000", 2023-09-30T17:04:33.074 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0780000000000001e-06 2023-09-30T17:04:33.075 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.075 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.075 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.075 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.275955+0000", 2023-09-30T17:04:33.075 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5770000000000004e-06 2023-09-30T17:04:33.075 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.075 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.075 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.075 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.075 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.075 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165444 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.076 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.390928+0000", 2023-09-30T17:04:33.076 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.50910121900000005, 2023-09-30T17:04:33.076 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.51846004999999995, 2023-09-30T17:04:33.076 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.076 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.076 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.076 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.076 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.076 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165444 2023-09-30T17:04:33.076 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.076 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.077 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.077 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.077 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.390928+0000", 2023-09-30T17:04:33.077 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.077 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.077 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.077 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.077 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.390928+0000", 2023-09-30T17:04:33.077 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.078 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.078 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.078 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.078 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.390929+0000", 2023-09-30T17:04:33.078 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7899999999999999e-07 2023-09-30T17:04:33.078 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.078 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.078 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.078 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.390941+0000", 2023-09-30T17:04:33.078 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1759999999999999e-05 2023-09-30T17:04:33.078 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.079 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.079 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.079 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.390947+0000", 2023-09-30T17:04:33.079 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5490000000000003e-06 2023-09-30T17:04:33.079 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.079 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.079 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.079 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.390952+0000", 2023-09-30T17:04:33.079 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1209999999999998e-06 2023-09-30T17:04:33.079 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.079 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.079 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.082 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.082 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.082 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165504 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.082 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.412772+0000", 2023-09-30T17:04:33.082 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.48725786500000001, 2023-09-30T17:04:33.082 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.496647695, 2023-09-30T17:04:33.082 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.082 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.082 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.082 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.082 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.083 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165504 2023-09-30T17:04:33.083 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.083 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.130 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.131 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.131 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.412772+0000", 2023-09-30T17:04:33.131 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.131 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.131 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.131 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.131 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.412772+0000", 2023-09-30T17:04:33.131 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.131 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.131 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.131 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.131 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.414518+0000", 2023-09-30T17:04:33.132 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0017461429999999999 2023-09-30T17:04:33.132 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.132 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.132 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.132 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.414531+0000", 2023-09-30T17:04:33.132 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2751e-05 2023-09-30T17:04:33.132 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.132 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.132 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.132 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.414537+0000", 2023-09-30T17:04:33.132 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4999999999999996e-06 2023-09-30T17:04:33.133 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.133 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.133 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.414542+0000", 2023-09-30T17:04:33.133 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.442e-06 2023-09-30T17:04:33.133 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.133 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.133 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.133 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.133 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165736 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.134 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.501684+0000", 2023-09-30T17:04:33.134 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.398345422, 2023-09-30T17:04:33.134 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.407766142, 2023-09-30T17:04:33.134 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.134 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.134 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.134 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.134 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.134 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165736 2023-09-30T17:04:33.134 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.134 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.135 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.135 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.135 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.501684+0000", 2023-09-30T17:04:33.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.135 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.135 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.135 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.501684+0000", 2023-09-30T17:04:33.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.135 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.135 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.136 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.501685+0000", 2023-09-30T17:04:33.136 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1399999999999997e-07 2023-09-30T17:04:33.136 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.136 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.136 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.136 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.501703+0000", 2023-09-30T17:04:33.136 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8731000000000001e-05 2023-09-30T17:04:33.136 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.136 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.136 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.136 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.501710+0000", 2023-09-30T17:04:33.136 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7839999999999998e-06 2023-09-30T17:04:33.137 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.137 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.137 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.137 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.501716+0000", 2023-09-30T17:04:33.137 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.229e-06 2023-09-30T17:04:33.137 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.137 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.137 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.137 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.137 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.137 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165858 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.137 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.538996+0000", 2023-09-30T17:04:33.142 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.36103342300000002, 2023-09-30T17:04:33.142 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.370485222, 2023-09-30T17:04:33.142 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.142 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.142 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.142 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.142 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.143 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165858 2023-09-30T17:04:33.143 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.143 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.143 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.143 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.143 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.538996+0000", 2023-09-30T17:04:33.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.143 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.143 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.143 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.143 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.538996+0000", 2023-09-30T17:04:33.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.144 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.144 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.144 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.144 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.538997+0000", 2023-09-30T17:04:33.144 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4900000000000001e-07 2023-09-30T17:04:33.144 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.144 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.144 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.144 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.539006+0000", 2023-09-30T17:04:33.145 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8109999999999997e-06 2023-09-30T17:04:33.145 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.145 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.145 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.145 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.539013+0000", 2023-09-30T17:04:33.145 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0789999999999997e-06 2023-09-30T17:04:33.145 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.145 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.145 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.145 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.539017+0000", 2023-09-30T17:04:33.145 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9819999999999999e-06 2023-09-30T17:04:33.145 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.146 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.146 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.146 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.146 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.146 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166000 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.146 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.590586+0000", 2023-09-30T17:04:33.146 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.30944408400000001, 2023-09-30T17:04:33.146 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.31893386200000001, 2023-09-30T17:04:33.146 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.146 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.146 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.146 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.147 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.147 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166000 2023-09-30T17:04:33.147 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.147 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.147 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.147 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.147 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.590586+0000", 2023-09-30T17:04:33.147 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.147 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.147 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.147 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.147 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.590586+0000", 2023-09-30T17:04:33.148 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.148 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.148 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.148 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.148 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.590586+0000", 2023-09-30T17:04:33.148 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0100000000000001e-07 2023-09-30T17:04:33.148 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.148 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.148 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.148 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.590596+0000", 2023-09-30T17:04:33.148 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.781e-06 2023-09-30T17:04:33.148 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.149 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.149 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.149 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.590599+0000", 2023-09-30T17:04:33.149 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.41e-06 2023-09-30T17:04:33.149 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.149 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.149 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.149 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.590602+0000", 2023-09-30T17:04:33.149 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9469999999999999e-06 2023-09-30T17:04:33.149 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.149 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.162 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.162 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.162 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.162 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166370 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.162 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.718632+0000", 2023-09-30T17:04:33.162 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.181397207, 2023-09-30T17:04:33.162 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.19091747000000001, 2023-09-30T17:04:33.162 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.162 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.162 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.163 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.163 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.163 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166370 2023-09-30T17:04:33.163 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.163 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.163 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.163 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.163 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.718632+0000", 2023-09-30T17:04:33.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.163 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.163 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.163 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.164 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.718632+0000", 2023-09-30T17:04:33.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.164 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.164 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.722527+0000", 2023-09-30T17:04:33.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038950439999999999 2023-09-30T17:04:33.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.164 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.164 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.722543+0000", 2023-09-30T17:04:33.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5959000000000001e-05 2023-09-30T17:04:33.165 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.165 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.165 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.165 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.722554+0000", 2023-09-30T17:04:33.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0251000000000001e-05 2023-09-30T17:04:33.165 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.165 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.165 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.165 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.722561+0000", 2023-09-30T17:04:33.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0330000000000003e-06 2023-09-30T17:04:33.165 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.165 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.166 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.166 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.166 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166571 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.166 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.811852+0000", 2023-09-30T17:04:33.166 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.088177304999999997, 2023-09-30T17:04:33.166 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.097727929000000005, 2023-09-30T17:04:33.166 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.166 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.166 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.166 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.167 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.167 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166571 2023-09-30T17:04:33.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.167 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.167 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.167 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.811852+0000", 2023-09-30T17:04:33.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.167 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.167 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.811852+0000", 2023-09-30T17:04:33.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.811853+0000", 2023-09-30T17:04:33.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6600000000000002e-07 2023-09-30T17:04:33.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.811871+0000", 2023-09-30T17:04:33.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8666000000000001e-05 2023-09-30T17:04:33.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.811878+0000", 2023-09-30T17:04:33.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9779999999999999e-06 2023-09-30T17:04:33.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.173 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.811884+0000", 2023-09-30T17:04:33.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4550000000000003e-06 2023-09-30T17:04:33.174 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.174 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.174 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.174 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166644 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.174 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.850655+0000", 2023-09-30T17:04:33.174 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.049374595, 2023-09-30T17:04:33.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.058954887999999997, 2023-09-30T17:04:33.175 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.175 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.175 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.175 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.175 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.175 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166644 2023-09-30T17:04:33.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.175 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.175 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.175 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.850655+0000", 2023-09-30T17:04:33.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.850655+0000", 2023-09-30T17:04:33.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.854519+0000", 2023-09-30T17:04:33.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038635470000000002 2023-09-30T17:04:33.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.177 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.177 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.854535+0000", 2023-09-30T17:04:33.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6430999999999999e-05 2023-09-30T17:04:33.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.177 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.177 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.854545+0000", 2023-09-30T17:04:33.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9499999999999996e-06 2023-09-30T17:04:33.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.178 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.178 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.178 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.854553+0000", 2023-09-30T17:04:33.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8019999999999992e-06 2023-09-30T17:04:33.178 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.178 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.178 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.178 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.178 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.178 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:167213 4.19 e57/17 4:9a4319fb:::100000001f8.0000002a:head v 57'5244, mlcod=57'5240)", 2023-09-30T17:04:33.178 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.879001+0000", 2023-09-30T17:04:33.178 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.021028436000000001, 2023-09-30T17:04:33.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.030657288000000001, 2023-09-30T17:04:33.179 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.179 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:33.179 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.879001+0000", 2023-09-30T17:04:33.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.879001+0000", 2023-09-30T17:04:33.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.180 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.180 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.879002+0000", 2023-09-30T17:04:33.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3499999999999996e-07 2023-09-30T17:04:33.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.180 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.180 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.879017+0000", 2023-09-30T17:04:33.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5285999999999999e-05 2023-09-30T17:04:33.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.879026+0000", 2023-09-30T17:04:33.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0510000000000002e-06 2023-09-30T17:04:33.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.190 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.190 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.879032+0000", 2023-09-30T17:04:33.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2310000000000001e-06 2023-09-30T17:04:33.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.190 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:33.190 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.880552+0000", 2023-09-30T17:04:33.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001520069 2023-09-30T17:04:33.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.191 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:33.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.880573+0000", 2023-09-30T17:04:33.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0261000000000001e-05 2023-09-30T17:04:33.191 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.191 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.191 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.191 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165299 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.191 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.353676+0000", 2023-09-30T17:04:33.192 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.54635339599999999, 2023-09-30T17:04:33.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.55604277599999996, 2023-09-30T17:04:33.192 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.192 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.192 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.192 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.192 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.192 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165299 2023-09-30T17:04:33.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.192 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.353676+0000", 2023-09-30T17:04:33.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.353676+0000", 2023-09-30T17:04:33.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.353677+0000", 2023-09-30T17:04:33.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.58e-07 2023-09-30T17:04:33.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.194 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.353687+0000", 2023-09-30T17:04:33.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0609e-05 2023-09-30T17:04:33.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.194 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.353693+0000", 2023-09-30T17:04:33.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5620000000000003e-06 2023-09-30T17:04:33.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.195 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.195 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.353697+0000", 2023-09-30T17:04:33.195 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.515e-06 2023-09-30T17:04:33.195 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.195 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.195 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.195 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.195 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.195 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165506 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.195 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.414551+0000", 2023-09-30T17:04:33.196 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.48547895000000002, 2023-09-30T17:04:33.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.49522389500000003, 2023-09-30T17:04:33.196 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.196 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.196 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.196 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.196 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.196 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165506 2023-09-30T17:04:33.196 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.196 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.197 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.197 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.414551+0000", 2023-09-30T17:04:33.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.197 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.197 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.197 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.414551+0000", 2023-09-30T17:04:33.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.197 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.197 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.198 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.414551+0000", 2023-09-30T17:04:33.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9299999999999999e-07 2023-09-30T17:04:33.198 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.198 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.198 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.198 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.414565+0000", 2023-09-30T17:04:33.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3964999999999999e-05 2023-09-30T17:04:33.198 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.198 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.198 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.414574+0000", 2023-09-30T17:04:33.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.918e-06 2023-09-30T17:04:33.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.414578+0000", 2023-09-30T17:04:33.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6969999999999999e-06 2023-09-30T17:04:33.199 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.199 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.199 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.200 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165939 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.200 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.564606+0000", 2023-09-30T17:04:33.200 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.335423676, 2023-09-30T17:04:33.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.34522336399999998, 2023-09-30T17:04:33.200 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.200 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.200 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.200 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.200 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.200 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165939 2023-09-30T17:04:33.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.201 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.201 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.201 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.564606+0000", 2023-09-30T17:04:33.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.201 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.201 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.564606+0000", 2023-09-30T17:04:33.202 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.202 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.202 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.202 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.564606+0000", 2023-09-30T17:04:33.202 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0900000000000002e-07 2023-09-30T17:04:33.202 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.202 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.202 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.564637+0000", 2023-09-30T17:04:33.202 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0994000000000002e-05 2023-09-30T17:04:33.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.203 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.203 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.203 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.564653+0000", 2023-09-30T17:04:33.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6004000000000001e-05 2023-09-30T17:04:33.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.203 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.203 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.203 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.564659+0000", 2023-09-30T17:04:33.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5809999999999996e-06 2023-09-30T17:04:33.204 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.204 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.204 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.204 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166142 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.204 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.639552+0000", 2023-09-30T17:04:33.204 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.26047735100000002, 2023-09-30T17:04:33.204 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.27033177800000002, 2023-09-30T17:04:33.204 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.205 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.205 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.205 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.205 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.205 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166142 2023-09-30T17:04:33.205 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.205 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.205 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.205 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.639552+0000", 2023-09-30T17:04:33.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.206 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.206 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.639552+0000", 2023-09-30T17:04:33.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.206 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.206 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.641516+0000", 2023-09-30T17:04:33.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001963935 2023-09-30T17:04:33.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.207 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.207 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.641530+0000", 2023-09-30T17:04:33.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4297999999999999e-05 2023-09-30T17:04:33.228 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.228 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.229 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.229 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.641540+0000", 2023-09-30T17:04:33.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1050000000000001e-06 2023-09-30T17:04:33.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.229 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.229 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.641546+0000", 2023-09-30T17:04:33.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5749999999999997e-06 2023-09-30T17:04:33.229 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.229 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.229 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.230 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166277 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.230 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.684318+0000", 2023-09-30T17:04:33.230 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.21571142099999999, 2023-09-30T17:04:33.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.22562105700000001, 2023-09-30T17:04:33.230 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.230 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.230 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.231 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.231 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.231 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166277 2023-09-30T17:04:33.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.231 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.231 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.684318+0000", 2023-09-30T17:04:33.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.232 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.684318+0000", 2023-09-30T17:04:33.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.232 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.684319+0000", 2023-09-30T17:04:33.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6599999999999996e-07 2023-09-30T17:04:33.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.233 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.233 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.233 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.684332+0000", 2023-09-30T17:04:33.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3213999999999999e-05 2023-09-30T17:04:33.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.233 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.233 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.234 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.684339+0000", 2023-09-30T17:04:33.234 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6270000000000002e-06 2023-09-30T17:04:33.234 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.234 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.234 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.234 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.684344+0000", 2023-09-30T17:04:33.234 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1200000000000001e-06 2023-09-30T17:04:33.234 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.234 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.234 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.234 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.234 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.235 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166523 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.235 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.798769+0000", 2023-09-30T17:04:33.235 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.10126089000000001, 2023-09-30T17:04:33.235 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.11122520900000001, 2023-09-30T17:04:33.235 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.235 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.235 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.235 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.235 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.235 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166523 2023-09-30T17:04:33.236 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.236 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.236 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.236 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.236 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.798769+0000", 2023-09-30T17:04:33.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.236 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.236 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.236 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.236 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.798769+0000", 2023-09-30T17:04:33.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.798769+0000", 2023-09-30T17:04:33.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5999999999999999e-07 2023-09-30T17:04:33.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.798780+0000", 2023-09-30T17:04:33.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0727000000000001e-05 2023-09-30T17:04:33.238 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.798786+0000", 2023-09-30T17:04:33.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0220000000000001e-06 2023-09-30T17:04:33.238 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.798791+0000", 2023-09-30T17:04:33.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7480000000000001e-06 2023-09-30T17:04:33.238 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.284 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.285 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.285 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166646 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.285 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.854566+0000", 2023-09-30T17:04:33.285 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.045463376, 2023-09-30T17:04:33.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.055484473999999999, 2023-09-30T17:04:33.285 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.285 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.285 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.285 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.286 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.286 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166646 2023-09-30T17:04:33.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.286 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.854566+0000", 2023-09-30T17:04:33.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.854566+0000", 2023-09-30T17:04:33.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.287 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.854567+0000", 2023-09-30T17:04:33.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8999999999999997e-07 2023-09-30T17:04:33.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.287 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.854581+0000", 2023-09-30T17:04:33.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4018e-05 2023-09-30T17:04:33.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.854588+0000", 2023-09-30T17:04:33.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.328e-06 2023-09-30T17:04:33.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.854594+0000", 2023-09-30T17:04:33.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1959999999999996e-06 2023-09-30T17:04:33.288 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.289 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.289 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.289 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.289 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165174 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.289 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.306765+0000", 2023-09-30T17:04:33.289 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.59326426700000001, 2023-09-30T17:04:33.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.60335513200000002, 2023-09-30T17:04:33.289 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.289 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.290 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.290 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.290 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.290 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165174 2023-09-30T17:04:33.290 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.290 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.290 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.306765+0000", 2023-09-30T17:04:33.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.290 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.306765+0000", 2023-09-30T17:04:33.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.308515+0000", 2023-09-30T17:04:33.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0017500020000000001 2023-09-30T17:04:33.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.308536+0000", 2023-09-30T17:04:33.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0236000000000001e-05 2023-09-30T17:04:33.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.308546+0000", 2023-09-30T17:04:33.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0868e-05 2023-09-30T17:04:33.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.308555+0000", 2023-09-30T17:04:33.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4589999999999998e-06 2023-09-30T17:04:33.293 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.293 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.293 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.293 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.293 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165488 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.293 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.403375+0000", 2023-09-30T17:04:33.293 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.49665426699999998, 2023-09-30T17:04:33.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.50680469900000003, 2023-09-30T17:04:33.293 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.294 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.294 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.294 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.294 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.294 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165488 2023-09-30T17:04:33.294 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.294 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.294 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.294 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.403375+0000", 2023-09-30T17:04:33.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.294 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.403375+0000", 2023-09-30T17:04:33.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.403376+0000", 2023-09-30T17:04:33.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9700000000000002e-07 2023-09-30T17:04:33.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.403387+0000", 2023-09-30T17:04:33.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1337e-05 2023-09-30T17:04:33.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.299 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.299 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.403393+0000", 2023-09-30T17:04:33.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8889999999999999e-06 2023-09-30T17:04:33.299 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.299 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.299 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.403398+0000", 2023-09-30T17:04:33.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.78e-06 2023-09-30T17:04:33.299 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.299 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.299 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.299 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.300 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165907 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.300 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.552836+0000", 2023-09-30T17:04:33.300 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.34719339599999999, 2023-09-30T17:04:33.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.35740256799999998, 2023-09-30T17:04:33.300 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.300 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.300 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.300 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.300 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.300 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165907 2023-09-30T17:04:33.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.301 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.301 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.552836+0000", 2023-09-30T17:04:33.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.301 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.552836+0000", 2023-09-30T17:04:33.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.302 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.552837+0000", 2023-09-30T17:04:33.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3000000000000001e-07 2023-09-30T17:04:33.302 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.302 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.552851+0000", 2023-09-30T17:04:33.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4628e-05 2023-09-30T17:04:33.302 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.302 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.552857+0000", 2023-09-30T17:04:33.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9020000000000004e-06 2023-09-30T17:04:33.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.303 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.303 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.552862+0000", 2023-09-30T17:04:33.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6779999999999999e-06 2023-09-30T17:04:33.303 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.303 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.303 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.303 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165940 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.304 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.564676+0000", 2023-09-30T17:04:33.304 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.33535316100000001, 2023-09-30T17:04:33.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.34561862599999998, 2023-09-30T17:04:33.304 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.304 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.304 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.304 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.304 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.304 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165940 2023-09-30T17:04:33.304 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.304 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.305 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.305 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.564676+0000", 2023-09-30T17:04:33.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.305 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.305 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.564676+0000", 2023-09-30T17:04:33.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.564677+0000", 2023-09-30T17:04:33.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6700000000000003e-07 2023-09-30T17:04:33.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.564699+0000", 2023-09-30T17:04:33.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1733e-05 2023-09-30T17:04:33.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.564715+0000", 2023-09-30T17:04:33.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6531000000000001e-05 2023-09-30T17:04:33.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.564720+0000", 2023-09-30T17:04:33.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0860000000000001e-06 2023-09-30T17:04:33.307 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.307 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.307 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.308 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166110 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.308 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.623404+0000", 2023-09-30T17:04:33.308 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.27662548799999997, 2023-09-30T17:04:33.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.28694542099999998, 2023-09-30T17:04:33.308 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.308 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.308 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.308 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.308 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.308 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166110 2023-09-30T17:04:33.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.309 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.623404+0000", 2023-09-30T17:04:33.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.623404+0000", 2023-09-30T17:04:33.316 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.316 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.316 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.316 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.626538+0000", 2023-09-30T17:04:33.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003133631 2023-09-30T17:04:33.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.317 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.317 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.626557+0000", 2023-09-30T17:04:33.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9094999999999999e-05 2023-09-30T17:04:33.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.317 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.317 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.317 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.626568+0000", 2023-09-30T17:04:33.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.147e-05 2023-09-30T17:04:33.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.626576+0000", 2023-09-30T17:04:33.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5650000000000004e-06 2023-09-30T17:04:33.318 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.318 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.318 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.319 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166406 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.319 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.738603+0000", 2023-09-30T17:04:33.319 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.16142696400000001, 2023-09-30T17:04:33.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.17179979200000001, 2023-09-30T17:04:33.319 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.319 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.319 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.319 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.319 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.319 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166406 2023-09-30T17:04:33.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.320 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.738603+0000", 2023-09-30T17:04:33.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.738603+0000", 2023-09-30T17:04:33.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.321 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.321 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.321 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.740666+0000", 2023-09-30T17:04:33.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002063507 2023-09-30T17:04:33.321 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.321 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.321 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.740679+0000", 2023-09-30T17:04:33.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3335e-05 2023-09-30T17:04:33.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.740687+0000", 2023-09-30T17:04:33.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7179999999999996e-06 2023-09-30T17:04:33.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.740693+0000", 2023-09-30T17:04:33.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5280000000000003e-06 2023-09-30T17:04:33.322 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.322 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.322 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.323 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:165593 4.6 e57/17 4:63e80496:::100000001f8.0000001e:head v 57'10201, mlcod=57'10190)", 2023-09-30T17:04:33.323 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.867092+0000", 2023-09-30T17:04:33.323 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.032937358999999999, 2023-09-30T17:04:33.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043364934000000001, 2023-09-30T17:04:33.323 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.323 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:33.323 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.867092+0000", 2023-09-30T17:04:33.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.867092+0000", 2023-09-30T17:04:33.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.867093+0000", 2023-09-30T17:04:33.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4400000000000001e-07 2023-09-30T17:04:33.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.867103+0000", 2023-09-30T17:04:33.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0868e-05 2023-09-30T17:04:33.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.867112+0000", 2023-09-30T17:04:33.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8079999999999994e-06 2023-09-30T17:04:33.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.326 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.326 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.867117+0000", 2023-09-30T17:04:33.326 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.673e-06 2023-09-30T17:04:33.326 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.326 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:33.326 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.887574+0000", 2023-09-30T17:04:33.326 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020457329 2023-09-30T17:04:33.326 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.326 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:33.326 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.887592+0000", 2023-09-30T17:04:33.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7569999999999999e-05 2023-09-30T17:04:33.327 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.327 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.327 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.327 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.327 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.327 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165381 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.327 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.382054+0000", 2023-09-30T17:04:33.327 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.51797517900000001, 2023-09-30T17:04:33.327 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.52846780800000004, 2023-09-30T17:04:33.327 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.327 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.328 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.328 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.328 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.328 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165381 2023-09-30T17:04:33.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.328 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.328 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.382054+0000", 2023-09-30T17:04:33.328 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.328 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.328 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.328 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.382054+0000", 2023-09-30T17:04:33.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.329 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.382055+0000", 2023-09-30T17:04:33.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1600000000000002e-07 2023-09-30T17:04:33.329 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.329 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.329 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.329 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.382066+0000", 2023-09-30T17:04:33.329 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1732999999999999e-05 2023-09-30T17:04:33.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.330 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.330 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.382072+0000", 2023-09-30T17:04:33.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4299999999999997e-06 2023-09-30T17:04:33.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.330 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.330 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.382075+0000", 2023-09-30T17:04:33.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.971e-06 2023-09-30T17:04:33.330 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.330 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.331 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.331 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.331 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.331 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165448 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.331 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.392570+0000", 2023-09-30T17:04:33.331 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.50745975399999999, 2023-09-30T17:04:33.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.51801110699999997, 2023-09-30T17:04:33.331 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.332 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.332 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.332 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.332 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.332 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165448 2023-09-30T17:04:33.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.332 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.332 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.332 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.392570+0000", 2023-09-30T17:04:33.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.392570+0000", 2023-09-30T17:04:33.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.392570+0000", 2023-09-30T17:04:33.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2099999999999997e-07 2023-09-30T17:04:33.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.392584+0000", 2023-09-30T17:04:33.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3266e-05 2023-09-30T17:04:33.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.392591+0000", 2023-09-30T17:04:33.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5390000000000002e-06 2023-09-30T17:04:33.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.335 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.392597+0000", 2023-09-30T17:04:33.335 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3480000000000003e-06 2023-09-30T17:04:33.335 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.335 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.335 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.335 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.335 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.335 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166112 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.335 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.626587+0000", 2023-09-30T17:04:33.335 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.27344227799999998, 2023-09-30T17:04:33.335 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.28403817999999997, 2023-09-30T17:04:33.336 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.336 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.336 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.336 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.336 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.336 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166112 2023-09-30T17:04:33.336 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.336 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.336 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.336 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.336 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.626587+0000", 2023-09-30T17:04:33.336 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.337 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.337 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.337 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.337 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.626587+0000", 2023-09-30T17:04:33.337 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.337 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.337 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.342 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.342 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.626588+0000", 2023-09-30T17:04:33.342 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0900000000000001e-07 2023-09-30T17:04:33.342 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.342 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.342 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.342 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.626603+0000", 2023-09-30T17:04:33.342 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5364000000000001e-05 2023-09-30T17:04:33.343 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.343 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.343 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.343 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.626611+0000", 2023-09-30T17:04:33.343 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3350000000000001e-06 2023-09-30T17:04:33.343 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.343 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.343 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.343 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.626617+0000", 2023-09-30T17:04:33.343 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8850000000000004e-06 2023-09-30T17:04:33.343 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.344 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.344 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.344 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.344 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.344 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166145 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.344 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.641605+0000", 2023-09-30T17:04:33.344 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.258424455, 2023-09-30T17:04:33.344 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.26905593799999999, 2023-09-30T17:04:33.344 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.344 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.344 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.344 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.345 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.345 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166145 2023-09-30T17:04:33.345 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.345 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.345 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.345 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.345 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.641605+0000", 2023-09-30T17:04:33.345 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.345 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.345 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.345 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.346 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.641605+0000", 2023-09-30T17:04:33.346 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.346 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.346 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.346 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.346 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.641606+0000", 2023-09-30T17:04:33.346 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3399999999999999e-07 2023-09-30T17:04:33.346 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.346 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.346 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.346 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.641620+0000", 2023-09-30T17:04:33.347 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3855e-05 2023-09-30T17:04:33.347 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.347 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.347 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.347 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.641626+0000", 2023-09-30T17:04:33.347 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4649999999999999e-06 2023-09-30T17:04:33.347 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.347 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.347 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.347 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.641631+0000", 2023-09-30T17:04:33.347 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9370000000000003e-06 2023-09-30T17:04:33.348 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.348 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.348 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.348 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.348 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.348 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166412 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.348 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.740702+0000", 2023-09-30T17:04:33.348 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.15932801999999999, 2023-09-30T17:04:33.348 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.169990956, 2023-09-30T17:04:33.348 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.348 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.348 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.349 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.349 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.349 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166412 2023-09-30T17:04:33.349 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.349 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.349 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.349 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.349 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.740702+0000", 2023-09-30T17:04:33.349 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.349 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.349 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.349 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.350 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.740702+0000", 2023-09-30T17:04:33.350 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.350 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.350 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.350 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.350 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.740702+0000", 2023-09-30T17:04:33.350 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8999999999999997e-07 2023-09-30T17:04:33.350 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.350 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.350 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.350 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.740712+0000", 2023-09-30T17:04:33.350 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.4739999999999994e-06 2023-09-30T17:04:33.351 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.351 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.351 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.351 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.740717+0000", 2023-09-30T17:04:33.351 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9379999999999997e-06 2023-09-30T17:04:33.351 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.351 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.351 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.351 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.740722+0000", 2023-09-30T17:04:33.351 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7600000000000002e-06 2023-09-30T17:04:33.352 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.352 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.352 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.352 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.352 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.352 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166470 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.352 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.765568+0000", 2023-09-30T17:04:33.352 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.13446191299999999, 2023-09-30T17:04:33.352 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.145155743, 2023-09-30T17:04:33.352 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.352 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.352 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.353 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.353 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.353 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166470 2023-09-30T17:04:33.353 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.353 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.353 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.353 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.353 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.765568+0000", 2023-09-30T17:04:33.353 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.353 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.353 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.353 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.354 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.765568+0000", 2023-09-30T17:04:33.354 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.354 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.354 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.354 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.354 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.770028+0000", 2023-09-30T17:04:33.354 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0044598370000000003 2023-09-30T17:04:33.354 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.354 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.354 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.354 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.770041+0000", 2023-09-30T17:04:33.355 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3311e-05 2023-09-30T17:04:33.355 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.355 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.355 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.355 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.770048+0000", 2023-09-30T17:04:33.355 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3699999999999997e-06 2023-09-30T17:04:33.355 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.355 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.355 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.355 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.770054+0000", 2023-09-30T17:04:33.355 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5380000000000002e-06 2023-09-30T17:04:33.356 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.356 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.356 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.356 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.356 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.356 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166577 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.356 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.811956+0000", 2023-09-30T17:04:33.356 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.088073464000000004, 2023-09-30T17:04:33.356 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.098797833000000002, 2023-09-30T17:04:33.356 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.356 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.356 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.357 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.357 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.357 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166577 2023-09-30T17:04:33.357 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.357 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.357 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.357 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.357 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.811956+0000", 2023-09-30T17:04:33.358 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.358 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.358 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.358 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.358 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.811956+0000", 2023-09-30T17:04:33.358 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.358 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.358 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.358 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.358 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.811957+0000", 2023-09-30T17:04:33.358 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2599999999999998e-07 2023-09-30T17:04:33.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.359 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.359 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.359 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.811968+0000", 2023-09-30T17:04:33.359 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.134e-05 2023-09-30T17:04:33.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.359 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.359 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.359 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.811974+0000", 2023-09-30T17:04:33.359 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.392e-06 2023-09-30T17:04:33.359 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.359 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.360 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.360 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.811979+0000", 2023-09-30T17:04:33.360 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9400000000000001e-06 2023-09-30T17:04:33.360 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.360 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.360 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.360 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.360 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.360 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:165586 4.36 e57/17 4:6c9c34b1:::100000001f8.00000010:head v 57'7808, mlcod=57'7803)", 2023-09-30T17:04:33.360 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.867124+0000", 2023-09-30T17:04:33.360 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.032905512999999997, 2023-09-30T17:04:33.361 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.043665833000000001, 2023-09-30T17:04:33.361 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.361 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:33.361 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.361 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.361 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.361 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.867124+0000", 2023-09-30T17:04:33.361 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.361 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.361 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.361 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.361 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.867124+0000", 2023-09-30T17:04:33.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.362 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.362 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.362 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.362 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.867124+0000", 2023-09-30T17:04:33.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.36e-07 2023-09-30T17:04:33.362 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.362 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.362 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.362 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.867134+0000", 2023-09-30T17:04:33.362 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0169e-05 2023-09-30T17:04:33.363 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.363 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.363 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.363 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.867140+0000", 2023-09-30T17:04:33.363 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4009999999999996e-06 2023-09-30T17:04:33.363 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.363 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.363 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.363 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.867144+0000", 2023-09-30T17:04:33.363 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.799e-06 2023-09-30T17:04:33.363 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.363 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.364 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:33.364 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.886858+0000", 2023-09-30T17:04:33.364 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019714239000000001 2023-09-30T17:04:33.364 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.364 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.364 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:33.364 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.886876+0000", 2023-09-30T17:04:33.364 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8556999999999999e-05 2023-09-30T17:04:33.364 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.364 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.364 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.365 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.365 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.365 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:165604 4.6 e57/17 4:635f8cb4:::100000001f8.0000003c:head v 57'10204, mlcod=57'10191)", 2023-09-30T17:04:33.365 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.881976+0000", 2023-09-30T17:04:33.365 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.018053547, 2023-09-30T17:04:33.365 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.028848206000000001, 2023-09-30T17:04:33.365 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.365 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:33.365 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.365 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.365 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.365 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.881976+0000", 2023-09-30T17:04:33.366 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.366 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.366 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.366 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.366 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.881976+0000", 2023-09-30T17:04:33.366 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.366 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.366 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.366 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.366 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.881976+0000", 2023-09-30T17:04:33.366 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0699999999999998e-07 2023-09-30T17:04:33.366 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.367 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.367 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.881993+0000", 2023-09-30T17:04:33.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7003e-05 2023-09-30T17:04:33.367 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.367 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.367 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.882001+0000", 2023-09-30T17:04:33.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7700000000000001e-06 2023-09-30T17:04:33.367 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.367 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.882007+0000", 2023-09-30T17:04:33.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3409999999999999e-06 2023-09-30T17:04:33.368 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:33.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.909995+0000", 2023-09-30T17:04:33.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.027987503 2023-09-30T17:04:33.368 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.368 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.368 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:33.368 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.910015+0000", 2023-09-30T17:04:33.368 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0182000000000001e-05 2023-09-30T17:04:33.369 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.369 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.369 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.369 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.369 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.369 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165912 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.369 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.552900+0000", 2023-09-30T17:04:33.369 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.347129246, 2023-09-30T17:04:33.369 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.35795721699999999, 2023-09-30T17:04:33.369 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.369 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.369 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.370 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.370 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.370 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165912 2023-09-30T17:04:33.370 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.370 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.370 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.370 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.370 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.552900+0000", 2023-09-30T17:04:33.370 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.370 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.370 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.370 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.371 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.552900+0000", 2023-09-30T17:04:33.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.371 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.371 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.371 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.552901+0000", 2023-09-30T17:04:33.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9900000000000001e-07 2023-09-30T17:04:33.371 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.371 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.371 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.552914+0000", 2023-09-30T17:04:33.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3577000000000001e-05 2023-09-30T17:04:33.372 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.372 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.372 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.372 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.552920+0000", 2023-09-30T17:04:33.372 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7960000000000001e-06 2023-09-30T17:04:33.372 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.372 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.372 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.372 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.552925+0000", 2023-09-30T17:04:33.372 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6380000000000003e-06 2023-09-30T17:04:33.372 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.372 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.373 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.373 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.373 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.373 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166350 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.373 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.708697+0000", 2023-09-30T17:04:33.373 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.19133303500000001, 2023-09-30T17:04:33.373 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.202191342, 2023-09-30T17:04:33.373 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.373 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.373 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.373 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.373 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.374 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166350 2023-09-30T17:04:33.374 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.374 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.374 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.374 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.374 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.708697+0000", 2023-09-30T17:04:33.374 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.374 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.374 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.374 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.374 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.708697+0000", 2023-09-30T17:04:33.374 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.375 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.375 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.375 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.375 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.708900+0000", 2023-09-30T17:04:33.375 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000203697 2023-09-30T17:04:33.375 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.375 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.375 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.375 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.708920+0000", 2023-09-30T17:04:33.375 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0078e-05 2023-09-30T17:04:33.375 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.375 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.376 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.376 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.708929+0000", 2023-09-30T17:04:33.376 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3100000000000001e-06 2023-09-30T17:04:33.376 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.376 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.376 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.376 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.708937+0000", 2023-09-30T17:04:33.376 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8289999999999997e-06 2023-09-30T17:04:33.376 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.376 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.376 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.376 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.377 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.377 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166386 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.377 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.722667+0000", 2023-09-30T17:04:33.377 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.17736274399999999, 2023-09-30T17:04:33.377 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.188251906, 2023-09-30T17:04:33.377 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.377 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.377 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.377 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.377 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.377 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166386 2023-09-30T17:04:33.377 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.378 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.378 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.378 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.378 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.722667+0000", 2023-09-30T17:04:33.378 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.378 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.378 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.378 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.378 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.722667+0000", 2023-09-30T17:04:33.378 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.378 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.379 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.379 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.379 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.722667+0000", 2023-09-30T17:04:33.379 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0900000000000002e-07 2023-09-30T17:04:33.379 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.379 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.379 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.379 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.722684+0000", 2023-09-30T17:04:33.379 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6381000000000001e-05 2023-09-30T17:04:33.379 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.379 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.379 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.380 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.722690+0000", 2023-09-30T17:04:33.380 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3029999999999996e-06 2023-09-30T17:04:33.380 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.380 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.380 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.380 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.722696+0000", 2023-09-30T17:04:33.380 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3509999999999998e-06 2023-09-30T17:04:33.380 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.380 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.380 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.380 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.380 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.381 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166579 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.381 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.811985+0000", 2023-09-30T17:04:33.381 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.088044251000000004, 2023-09-30T17:04:33.381 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.098964838999999999, 2023-09-30T17:04:33.381 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.381 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.381 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.381 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.381 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.381 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166579 2023-09-30T17:04:33.381 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.382 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.382 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.382 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.382 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.811985+0000", 2023-09-30T17:04:33.382 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.382 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.382 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.382 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.382 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.811985+0000", 2023-09-30T17:04:33.382 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.382 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.382 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.383 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.383 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.811986+0000", 2023-09-30T17:04:33.383 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.65e-07 2023-09-30T17:04:33.383 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.383 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.383 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.383 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.811997+0000", 2023-09-30T17:04:33.383 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1228e-05 2023-09-30T17:04:33.383 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.383 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.383 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.384 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.812003+0000", 2023-09-30T17:04:33.384 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.801e-06 2023-09-30T17:04:33.384 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.384 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.384 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.384 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.812007+0000", 2023-09-30T17:04:33.384 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5419999999999999e-06 2023-09-30T17:04:33.384 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.384 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.384 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.384 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.384 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.385 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:164984 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 798720~4096 in=4096b,write 905216~4096 in=4096b,write 1097728~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.385 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.243709+0000", 2023-09-30T17:04:33.385 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.65632014599999999, 2023-09-30T17:04:33.385 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.66727446599999996, 2023-09-30T17:04:33.385 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.385 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:33.385 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.385 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.385 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.385 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 164984 2023-09-30T17:04:33.385 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.385 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.386 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.386 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.386 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.243709+0000", 2023-09-30T17:04:33.386 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.386 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.386 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.386 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.386 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.243709+0000", 2023-09-30T17:04:33.386 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.386 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.386 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.387 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.387 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.243710+0000", 2023-09-30T17:04:33.387 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7300000000000001e-07 2023-09-30T17:04:33.387 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.387 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.387 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.387 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.243722+0000", 2023-09-30T17:04:33.387 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1751e-05 2023-09-30T17:04:33.387 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.387 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.387 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.387 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.243728+0000", 2023-09-30T17:04:33.388 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9950000000000002e-06 2023-09-30T17:04:33.388 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.388 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.388 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.388 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.243732+0000", 2023-09-30T17:04:33.388 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.617e-06 2023-09-30T17:04:33.388 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.388 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.388 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:33.388 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.898527+0000", 2023-09-30T17:04:33.388 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.65479516599999998 2023-09-30T17:04:33.388 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.389 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.389 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:33.389 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.898615+0000", 2023-09-30T17:04:33.389 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7219999999999995e-05 2023-09-30T17:04:33.389 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.389 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.389 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.389 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.389 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.389 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165339 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.389 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.366616+0000", 2023-09-30T17:04:33.390 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.53341398299999998, 2023-09-30T17:04:33.390 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.54440400700000002, 2023-09-30T17:04:33.390 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.390 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.390 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.390 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.390 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.390 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165339 2023-09-30T17:04:33.390 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.390 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.390 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.390 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.391 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.366616+0000", 2023-09-30T17:04:33.391 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.391 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.391 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.391 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.391 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.366616+0000", 2023-09-30T17:04:33.391 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.391 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.391 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.391 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.391 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.368595+0000", 2023-09-30T17:04:33.392 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001979012 2023-09-30T17:04:33.392 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.392 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.392 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.392 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.368607+0000", 2023-09-30T17:04:33.392 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2678e-05 2023-09-30T17:04:33.392 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.392 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.392 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.392 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.368615+0000", 2023-09-30T17:04:33.392 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8560000000000007e-06 2023-09-30T17:04:33.392 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.393 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.393 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.393 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.368621+0000", 2023-09-30T17:04:33.393 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0449999999999997e-06 2023-09-30T17:04:33.393 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.393 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.393 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.393 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.393 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.393 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165514 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.393 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.414708+0000", 2023-09-30T17:04:33.394 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.48532156199999998, 2023-09-30T17:04:33.394 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.49634112000000002, 2023-09-30T17:04:33.394 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.394 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.394 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.394 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.394 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.394 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165514 2023-09-30T17:04:33.394 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.394 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.394 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.394 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.395 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.414708+0000", 2023-09-30T17:04:33.395 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.395 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.395 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.395 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.395 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.414708+0000", 2023-09-30T17:04:33.395 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.395 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.395 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.395 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.395 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.414708+0000", 2023-09-30T17:04:33.396 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9200000000000002e-07 2023-09-30T17:04:33.396 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.396 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.396 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.396 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.414724+0000", 2023-09-30T17:04:33.396 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5794000000000002e-05 2023-09-30T17:04:33.396 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.396 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.396 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.396 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.414734+0000", 2023-09-30T17:04:33.396 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0030000000000001e-05 2023-09-30T17:04:33.396 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.397 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.397 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.397 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.414740+0000", 2023-09-30T17:04:33.397 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6439999999999997e-06 2023-09-30T17:04:33.397 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.397 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.397 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.397 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.397 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.397 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165670 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.397 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.476592+0000", 2023-09-30T17:04:33.398 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.42343783899999998, 2023-09-30T17:04:33.398 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.43450697599999999, 2023-09-30T17:04:33.398 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.398 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.398 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.398 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.398 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.398 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165670 2023-09-30T17:04:33.398 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.398 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.398 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.398 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.399 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.476592+0000", 2023-09-30T17:04:33.399 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.399 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.399 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.399 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.399 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.476592+0000", 2023-09-30T17:04:33.399 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.399 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.399 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.399 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.399 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.476592+0000", 2023-09-30T17:04:33.400 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2e-07 2023-09-30T17:04:33.400 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.400 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.400 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.400 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.476605+0000", 2023-09-30T17:04:33.400 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2609000000000001e-05 2023-09-30T17:04:33.400 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.400 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.400 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.400 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.476609+0000", 2023-09-30T17:04:33.435 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6260000000000003e-06 2023-09-30T17:04:33.435 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.435 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.435 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.435 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.476615+0000", 2023-09-30T17:04:33.435 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1109999999999999e-06 2023-09-30T17:04:33.435 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.435 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.435 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.436 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.436 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.436 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165976 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.436 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.578574+0000", 2023-09-30T17:04:33.436 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.32145549899999998, 2023-09-30T17:04:33.436 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.33257374699999998, 2023-09-30T17:04:33.436 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.436 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.436 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.436 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.436 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.437 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165976 2023-09-30T17:04:33.437 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.437 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.437 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.437 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.437 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.578574+0000", 2023-09-30T17:04:33.437 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.437 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.437 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.437 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.437 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.578574+0000", 2023-09-30T17:04:33.438 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.438 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.438 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.438 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.438 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.578575+0000", 2023-09-30T17:04:33.438 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.82e-07 2023-09-30T17:04:33.438 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.438 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.438 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.438 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.578586+0000", 2023-09-30T17:04:33.438 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1783999999999999e-05 2023-09-30T17:04:33.438 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.439 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.439 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.439 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.578593+0000", 2023-09-30T17:04:33.439 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7479999999999996e-06 2023-09-30T17:04:33.439 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.439 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.439 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.439 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.578598+0000", 2023-09-30T17:04:33.439 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3179999999999997e-06 2023-09-30T17:04:33.439 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.439 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.440 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.440 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.440 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.440 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166117 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.440 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.626661+0000", 2023-09-30T17:04:33.440 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.27336826199999997, 2023-09-30T17:04:33.440 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.284517513, 2023-09-30T17:04:33.440 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.440 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.440 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.440 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.441 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.441 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166117 2023-09-30T17:04:33.441 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.441 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.441 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.441 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.441 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.626661+0000", 2023-09-30T17:04:33.441 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.441 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.441 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.441 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.441 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.626661+0000", 2023-09-30T17:04:33.442 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.442 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.442 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.442 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.442 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.626662+0000", 2023-09-30T17:04:33.442 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9800000000000003e-07 2023-09-30T17:04:33.442 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.442 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.442 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.442 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.626679+0000", 2023-09-30T17:04:33.442 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7410000000000001e-05 2023-09-30T17:04:33.443 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.443 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.443 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.626686+0000", 2023-09-30T17:04:33.443 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1350000000000003e-06 2023-09-30T17:04:33.443 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.445 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.445 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.626692+0000", 2023-09-30T17:04:33.446 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5169999999999999e-06 2023-09-30T17:04:33.446 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.446 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.446 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.446 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.446 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.446 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166250 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.446 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.673549+0000", 2023-09-30T17:04:33.446 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.226480823, 2023-09-30T17:04:33.446 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.23765963900000001, 2023-09-30T17:04:33.446 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.447 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.447 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.447 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.447 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.447 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166250 2023-09-30T17:04:33.447 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.447 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.447 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.447 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.673549+0000", 2023-09-30T17:04:33.447 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.448 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.448 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.448 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.673549+0000", 2023-09-30T17:04:33.448 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.448 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.448 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.448 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.673549+0000", 2023-09-30T17:04:33.448 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1399999999999998e-07 2023-09-30T17:04:33.448 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.449 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.449 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.673559+0000", 2023-09-30T17:04:33.449 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0053e-05 2023-09-30T17:04:33.449 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.449 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.449 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.449 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.673564+0000", 2023-09-30T17:04:33.449 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2220000000000001e-06 2023-09-30T17:04:33.449 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.449 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.449 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.449 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.673567+0000", 2023-09-30T17:04:33.450 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.067e-06 2023-09-30T17:04:33.450 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.450 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.450 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.450 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.450 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.450 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166441 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.450 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.750642+0000", 2023-09-30T17:04:33.450 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.149387507, 2023-09-30T17:04:33.450 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.16059614899999999, 2023-09-30T17:04:33.450 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.451 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.451 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.451 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.451 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.451 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166441 2023-09-30T17:04:33.451 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.451 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.451 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.451 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.451 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.750642+0000", 2023-09-30T17:04:33.451 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.451 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.452 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.452 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.452 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.750642+0000", 2023-09-30T17:04:33.452 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.452 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.452 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.452 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.452 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.754516+0000", 2023-09-30T17:04:33.452 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038740239999999998 2023-09-30T17:04:33.452 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.452 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.453 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.453 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.754539+0000", 2023-09-30T17:04:33.453 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3163000000000002e-05 2023-09-30T17:04:33.453 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.453 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.453 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.453 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.754554+0000", 2023-09-30T17:04:33.453 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4267000000000001e-05 2023-09-30T17:04:33.453 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.453 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.453 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.453 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.754562+0000", 2023-09-30T17:04:33.454 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2919999999999996e-06 2023-09-30T17:04:33.454 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.454 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.454 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.454 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.454 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.454 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166526 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.454 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.798797+0000", 2023-09-30T17:04:33.454 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.101232192, 2023-09-30T17:04:33.454 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.112474017, 2023-09-30T17:04:33.455 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.455 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.455 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.455 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.455 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.455 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166526 2023-09-30T17:04:33.455 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.455 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.455 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.455 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.455 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.798797+0000", 2023-09-30T17:04:33.455 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.456 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.456 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.456 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.456 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.798797+0000", 2023-09-30T17:04:33.456 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.456 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.456 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.456 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.456 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.800543+0000", 2023-09-30T17:04:33.456 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0017453460000000001 2023-09-30T17:04:33.456 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.457 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.457 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.457 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.800563+0000", 2023-09-30T17:04:33.457 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0398e-05 2023-09-30T17:04:33.457 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.457 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.457 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.457 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.800572+0000", 2023-09-30T17:04:33.457 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8510000000000005e-06 2023-09-30T17:04:33.457 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.457 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.457 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.458 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.800579+0000", 2023-09-30T17:04:33.458 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8920000000000003e-06 2023-09-30T17:04:33.458 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.458 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.458 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.458 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.458 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.458 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166661 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.458 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.854708+0000", 2023-09-30T17:04:33.458 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.045321640000000003, 2023-09-30T17:04:33.458 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.05659339, 2023-09-30T17:04:33.459 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.459 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.459 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.459 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.459 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.459 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166661 2023-09-30T17:04:33.459 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.459 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.459 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.459 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.459 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.854708+0000", 2023-09-30T17:04:33.460 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.460 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.460 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.460 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.460 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.854708+0000", 2023-09-30T17:04:33.460 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.460 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.460 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.460 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.460 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.854708+0000", 2023-09-30T17:04:33.460 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4000000000000002e-07 2023-09-30T17:04:33.460 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.461 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.461 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.461 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.854721+0000", 2023-09-30T17:04:33.461 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2191000000000001e-05 2023-09-30T17:04:33.461 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.461 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.461 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.461 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.854727+0000", 2023-09-30T17:04:33.461 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4729999999999997e-06 2023-09-30T17:04:33.461 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.461 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.461 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.462 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.854732+0000", 2023-09-30T17:04:33.462 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9259999999999999e-06 2023-09-30T17:04:33.462 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.462 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.462 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.462 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.462 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.462 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:167219 4.28 e57/17 4:15eeb89b:::100000001f8.00000032:head v 57'5113, mlcod=57'5111)", 2023-09-30T17:04:33.462 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.882067+0000", 2023-09-30T17:04:33.462 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.017962779000000002, 2023-09-30T17:04:33.462 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.029265698, 2023-09-30T17:04:33.463 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.463 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:33.463 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.463 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.463 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.882067+0000", 2023-09-30T17:04:33.463 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.463 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.463 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.463 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.463 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.882067+0000", 2023-09-30T17:04:33.464 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.464 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.464 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.464 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.464 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.882067+0000", 2023-09-30T17:04:33.464 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0199999999999998e-07 2023-09-30T17:04:33.464 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.464 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.464 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.464 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.882079+0000", 2023-09-30T17:04:33.464 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2235000000000001e-05 2023-09-30T17:04:33.465 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.465 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.465 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.465 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.882087+0000", 2023-09-30T17:04:33.465 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1519999999999992e-06 2023-09-30T17:04:33.465 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.465 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.465 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.465 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.882093+0000", 2023-09-30T17:04:33.465 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3959999999999997e-06 2023-09-30T17:04:33.465 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.465 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.466 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:33.466 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.883996+0000", 2023-09-30T17:04:33.466 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019029660000000001 2023-09-30T17:04:33.466 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.466 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.466 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:33.466 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.884017+0000", 2023-09-30T17:04:33.466 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0808000000000001e-05 2023-09-30T17:04:33.466 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.466 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.466 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.467 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.467 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.467 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:164985 4.37 4:eff9002a:::100000001f8.00000003:head [write 409600~4096 in=4096b,write 491520~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.467 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.243739+0000", 2023-09-30T17:04:33.467 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.65629101499999998, 2023-09-30T17:04:33.467 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.66763074700000002, 2023-09-30T17:04:33.467 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.467 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:33.467 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.467 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.467 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.468 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 164985 2023-09-30T17:04:33.468 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.468 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.468 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.468 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.468 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.243739+0000", 2023-09-30T17:04:33.468 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.468 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.468 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.468 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.468 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.243739+0000", 2023-09-30T17:04:33.468 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.469 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.469 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.469 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.469 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.243739+0000", 2023-09-30T17:04:33.469 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.84e-07 2023-09-30T17:04:33.475 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.475 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.475 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.475 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.243748+0000", 2023-09-30T17:04:33.475 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7790000000000001e-06 2023-09-30T17:04:33.476 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.476 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.476 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.476 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.243753+0000", 2023-09-30T17:04:33.476 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.446e-06 2023-09-30T17:04:33.476 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.476 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.476 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.476 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.243758+0000", 2023-09-30T17:04:33.476 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4909999999999999e-06 2023-09-30T17:04:33.476 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.477 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.477 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:33.477 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.898969+0000", 2023-09-30T17:04:33.477 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.65521112599999998 2023-09-30T17:04:33.477 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.477 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.477 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:33.477 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.899039+0000", 2023-09-30T17:04:33.477 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9913000000000006e-05 2023-09-30T17:04:33.477 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.477 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.477 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:33.478 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.899167+0000", 2023-09-30T17:04:33.478 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000128529 2023-09-30T17:04:33.478 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.478 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.478 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.478 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.478 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.478 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165025 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.478 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.253559+0000", 2023-09-30T17:04:33.478 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.646470514, 2023-09-30T17:04:33.478 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.657851301, 2023-09-30T17:04:33.479 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.479 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.479 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.479 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.479 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.479 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165025 2023-09-30T17:04:33.479 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.479 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.479 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.479 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.479 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.253559+0000", 2023-09-30T17:04:33.479 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.480 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.480 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.253559+0000", 2023-09-30T17:04:33.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.480 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.480 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.253560+0000", 2023-09-30T17:04:33.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6600000000000002e-07 2023-09-30T17:04:33.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.485 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.485 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.253573+0000", 2023-09-30T17:04:33.485 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3378e-05 2023-09-30T17:04:33.485 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.485 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.486 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.486 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.253579+0000", 2023-09-30T17:04:33.486 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9279999999999998e-06 2023-09-30T17:04:33.486 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.486 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.486 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.486 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.253584+0000", 2023-09-30T17:04:33.486 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7419999999999997e-06 2023-09-30T17:04:33.486 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.486 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.486 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.487 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.487 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.487 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165226 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.487 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.328637+0000", 2023-09-30T17:04:33.487 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.57139231199999996, 2023-09-30T17:04:33.487 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.582803819, 2023-09-30T17:04:33.487 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.487 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.487 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.487 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.487 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.488 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165226 2023-09-30T17:04:33.488 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.488 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.488 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.488 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.488 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.328637+0000", 2023-09-30T17:04:33.488 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.488 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.488 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.488 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.488 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.328637+0000", 2023-09-30T17:04:33.488 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.489 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.489 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.328638+0000", 2023-09-30T17:04:33.489 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.39e-07 2023-09-30T17:04:33.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.489 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.489 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.328661+0000", 2023-09-30T17:04:33.489 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2928000000000001e-05 2023-09-30T17:04:33.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.490 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.490 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.490 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.328667+0000", 2023-09-30T17:04:33.490 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.353e-06 2023-09-30T17:04:33.490 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.490 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.490 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.490 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.328672+0000", 2023-09-30T17:04:33.490 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0479999999999998e-06 2023-09-30T17:04:33.490 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.490 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.491 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.491 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.491 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.491 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165977 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.491 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.578606+0000", 2023-09-30T17:04:33.491 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.32142330899999999, 2023-09-30T17:04:33.491 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.33286545099999998, 2023-09-30T17:04:33.491 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.491 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.493 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.493 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.493 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.493 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165977 2023-09-30T17:04:33.493 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.493 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.493 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.493 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.493 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.578606+0000", 2023-09-30T17:04:33.493 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.494 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.494 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.494 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.494 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.578606+0000", 2023-09-30T17:04:33.494 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.494 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.494 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.494 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.494 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.578607+0000", 2023-09-30T17:04:33.494 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.65e-07 2023-09-30T17:04:33.494 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.495 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.495 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.495 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.578622+0000", 2023-09-30T17:04:33.495 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4955e-05 2023-09-30T17:04:33.495 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.495 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.495 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.495 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.578628+0000", 2023-09-30T17:04:33.495 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1689999999999997e-06 2023-09-30T17:04:33.495 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.495 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.496 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.496 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.578633+0000", 2023-09-30T17:04:33.496 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.853e-06 2023-09-30T17:04:33.496 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.496 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.496 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.496 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.496 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.496 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166251 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.496 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.673572+0000", 2023-09-30T17:04:33.496 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.226457665, 2023-09-30T17:04:33.497 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.23793024199999999, 2023-09-30T17:04:33.497 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.497 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.497 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.497 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.497 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.497 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166251 2023-09-30T17:04:33.497 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.497 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.497 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.497 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.497 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.673572+0000", 2023-09-30T17:04:33.498 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.498 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.498 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.498 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.498 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.673572+0000", 2023-09-30T17:04:33.498 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.498 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.498 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.498 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.498 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.673572+0000", 2023-09-30T17:04:33.498 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5600000000000002e-07 2023-09-30T17:04:33.499 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.499 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.499 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.499 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.673579+0000", 2023-09-30T17:04:33.499 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2119999999999997e-06 2023-09-30T17:04:33.499 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.499 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.499 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.499 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.673585+0000", 2023-09-30T17:04:33.499 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2680000000000002e-06 2023-09-30T17:04:33.499 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.500 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.500 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.500 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.673588+0000", 2023-09-30T17:04:33.500 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2789999999999999e-06 2023-09-30T17:04:33.500 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.500 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.500 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.500 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.500 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.500 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166283 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.500 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.684520+0000", 2023-09-30T17:04:33.500 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.21550976899999999, 2023-09-30T17:04:33.501 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.22702177300000001, 2023-09-30T17:04:33.501 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.501 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.501 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.501 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.501 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.501 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166283 2023-09-30T17:04:33.501 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.501 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.501 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.501 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.502 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.684520+0000", 2023-09-30T17:04:33.502 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.502 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.502 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.502 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.502 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.684520+0000", 2023-09-30T17:04:33.502 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.502 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.502 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.502 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.502 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.684520+0000", 2023-09-30T17:04:33.503 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6499999999999999e-07 2023-09-30T17:04:33.503 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.503 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.503 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.503 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.684536+0000", 2023-09-30T17:04:33.503 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5327000000000001e-05 2023-09-30T17:04:33.503 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.503 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.503 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.503 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.684542+0000", 2023-09-30T17:04:33.503 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0240000000000003e-06 2023-09-30T17:04:33.504 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.504 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.504 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.504 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.684547+0000", 2023-09-30T17:04:33.504 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.49e-06 2023-09-30T17:04:33.504 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.504 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.504 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.504 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.504 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.504 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166708 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.504 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.865732+0000", 2023-09-30T17:04:33.505 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.034297473000000002, 2023-09-30T17:04:33.505 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.045840450999999997, 2023-09-30T17:04:33.505 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.505 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.505 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.505 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.505 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.505 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166708 2023-09-30T17:04:33.505 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.505 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.505 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.506 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.506 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.865732+0000", 2023-09-30T17:04:33.506 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.506 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.506 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.506 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.865732+0000", 2023-09-30T17:04:33.506 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.506 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.506 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.506 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.507 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.869516+0000", 2023-09-30T17:04:33.507 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0037840790000000001 2023-09-30T17:04:33.507 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.507 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.507 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.507 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.869545+0000", 2023-09-30T17:04:33.507 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9159999999999999e-05 2023-09-30T17:04:33.507 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.507 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.507 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.507 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.869584+0000", 2023-09-30T17:04:33.507 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8828999999999997e-05 2023-09-30T17:04:33.508 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.508 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.508 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.508 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.869594+0000", 2023-09-30T17:04:33.508 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5959999999999993e-06 2023-09-30T17:04:33.508 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.508 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.508 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.508 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.508 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.508 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166745 4.29 4:94178d8a:::100000001f8.00000006:head [write 2686976~4096 in=4096b,write 2772992~4096 in=4096b,write 2953216~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.509 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.878868+0000", 2023-09-30T17:04:33.509 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.021161651, 2023-09-30T17:04:33.509 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.032738817000000003, 2023-09-30T17:04:33.509 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.509 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:33.509 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.509 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.509 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.509 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166745 2023-09-30T17:04:33.509 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.509 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.510 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.510 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.510 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878868+0000", 2023-09-30T17:04:33.510 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.510 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.510 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.510 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.510 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.878868+0000", 2023-09-30T17:04:33.510 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.510 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.511 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.511 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.511 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.883985+0000", 2023-09-30T17:04:33.511 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0051174519999999998 2023-09-30T17:04:33.511 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.511 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.511 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.511 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.884015+0000", 2023-09-30T17:04:33.511 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9811999999999998e-05 2023-09-30T17:04:33.511 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.511 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.512 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.512 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.884028+0000", 2023-09-30T17:04:33.512 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3118e-05 2023-09-30T17:04:33.512 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.512 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.512 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.512 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.884036+0000", 2023-09-30T17:04:33.512 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1210000000000007e-06 2023-09-30T17:04:33.512 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.512 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.512 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:33.512 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.898524+0000", 2023-09-30T17:04:33.513 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014488035999999999 2023-09-30T17:04:33.513 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.513 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.513 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:33.513 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.898591+0000", 2023-09-30T17:04:33.513 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6124999999999995e-05 2023-09-30T17:04:33.513 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.513 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.513 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.513 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.513 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.514 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:167260 4.19 e57/17 4:997b7129:::100000001f8.00000000:head v 57'5247, mlcod=57'5242)", 2023-09-30T17:04:33.514 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.898721+0000", 2023-09-30T17:04:33.514 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0013081099999999999, 2023-09-30T17:04:33.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012924176000000001, 2023-09-30T17:04:33.514 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.514 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:33.514 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.514 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.514 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.514 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.898721+0000", 2023-09-30T17:04:33.514 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.514 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.515 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.515 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.898721+0000", 2023-09-30T17:04:33.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.515 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.515 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.898722+0000", 2023-09-30T17:04:33.515 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3799999999999997e-07 2023-09-30T17:04:33.515 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.515 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.516 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.516 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.898740+0000", 2023-09-30T17:04:33.516 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.753e-05 2023-09-30T17:04:33.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.516 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.516 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.898748+0000", 2023-09-30T17:04:33.516 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3420000000000008e-06 2023-09-30T17:04:33.516 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.516 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.516 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.516 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.898754+0000", 2023-09-30T17:04:33.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4880000000000004e-06 2023-09-30T17:04:33.517 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.517 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:33.517 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.910080+0000", 2023-09-30T17:04:33.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011325684000000001 2023-09-30T17:04:33.517 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.517 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:33.517 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.910099+0000", 2023-09-30T17:04:33.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9042000000000002e-05 2023-09-30T17:04:33.518 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.518 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.518 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.518 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.518 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.518 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165031 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.518 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.253590+0000", 2023-09-30T17:04:33.518 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.64643960199999995, 2023-09-30T17:04:33.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.65808931299999995, 2023-09-30T17:04:33.518 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.518 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.519 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.519 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.519 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.519 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165031 2023-09-30T17:04:33.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.519 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.519 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.519 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.253590+0000", 2023-09-30T17:04:33.519 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.520 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.520 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.253590+0000", 2023-09-30T17:04:33.520 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.520 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.520 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.520 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.520 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.253590+0000", 2023-09-30T17:04:33.520 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7800000000000002e-07 2023-09-30T17:04:33.520 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.520 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.520 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.520 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.253601+0000", 2023-09-30T17:04:33.521 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0652999999999999e-05 2023-09-30T17:04:33.521 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.521 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.521 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.521 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.253606+0000", 2023-09-30T17:04:33.521 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4809999999999997e-06 2023-09-30T17:04:33.521 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.521 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.521 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.521 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.253612+0000", 2023-09-30T17:04:33.521 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7590000000000003e-06 2023-09-30T17:04:33.522 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.522 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.522 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.522 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165138 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.522 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.295519+0000", 2023-09-30T17:04:33.522 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.60451010100000002, 2023-09-30T17:04:33.522 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.61618990399999995, 2023-09-30T17:04:33.522 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.522 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.523 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.523 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.523 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.523 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165138 2023-09-30T17:04:33.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.523 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.523 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.295519+0000", 2023-09-30T17:04:33.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.524 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.524 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.295519+0000", 2023-09-30T17:04:33.538 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.538 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.538 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.538 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.538 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.295520+0000", 2023-09-30T17:04:33.538 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4900000000000005e-07 2023-09-30T17:04:33.538 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.538 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.538 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.539 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.295538+0000", 2023-09-30T17:04:33.539 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7402999999999999e-05 2023-09-30T17:04:33.539 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.539 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.539 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.539 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.295550+0000", 2023-09-30T17:04:33.539 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1891e-05 2023-09-30T17:04:33.539 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.539 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.539 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.539 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.295557+0000", 2023-09-30T17:04:33.540 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3969999999999997e-06 2023-09-30T17:04:33.540 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.540 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.540 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.540 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.540 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.540 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165672 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.540 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.482573+0000", 2023-09-30T17:04:33.540 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.41745698999999997, 2023-09-30T17:04:33.540 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.429166202, 2023-09-30T17:04:33.540 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.541 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.541 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.541 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.541 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.541 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165672 2023-09-30T17:04:33.541 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.541 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.541 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.541 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.541 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.482573+0000", 2023-09-30T17:04:33.541 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.542 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.542 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.542 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.542 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.482573+0000", 2023-09-30T17:04:33.542 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.542 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.542 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.542 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.542 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.482573+0000", 2023-09-30T17:04:33.542 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4700000000000001e-07 2023-09-30T17:04:33.542 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.543 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.543 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.543 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.482587+0000", 2023-09-30T17:04:33.543 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3546999999999999e-05 2023-09-30T17:04:33.543 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.543 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.543 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.543 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.482595+0000", 2023-09-30T17:04:33.543 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4020000000000002e-06 2023-09-30T17:04:33.543 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.543 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.543 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.544 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.482603+0000", 2023-09-30T17:04:33.544 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3640000000000001e-06 2023-09-30T17:04:33.544 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.544 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.544 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.544 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.544 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.544 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165828 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.544 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.531632+0000", 2023-09-30T17:04:33.544 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.36839775299999999, 2023-09-30T17:04:33.544 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.38013669700000002, 2023-09-30T17:04:33.545 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.545 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.545 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.545 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.545 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.545 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165828 2023-09-30T17:04:33.545 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.545 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.545 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.545 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.545 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.531632+0000", 2023-09-30T17:04:33.545 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.546 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.546 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.546 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.546 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.531632+0000", 2023-09-30T17:04:33.546 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.546 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.546 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.546 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.546 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.531633+0000", 2023-09-30T17:04:33.546 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3799999999999996e-07 2023-09-30T17:04:33.546 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.547 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.547 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.547 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.531654+0000", 2023-09-30T17:04:33.547 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1186e-05 2023-09-30T17:04:33.547 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.547 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.547 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.547 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.531660+0000", 2023-09-30T17:04:33.547 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5379999999999999e-06 2023-09-30T17:04:33.547 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.547 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.547 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.548 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.531666+0000", 2023-09-30T17:04:33.548 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7370000000000003e-06 2023-09-30T17:04:33.548 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.548 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.548 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.548 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.548 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.548 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165944 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.548 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.566648+0000", 2023-09-30T17:04:33.548 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.33338180000000001, 2023-09-30T17:04:33.548 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.34515068100000001, 2023-09-30T17:04:33.548 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.549 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.549 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.549 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.549 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.549 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165944 2023-09-30T17:04:33.549 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.549 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.549 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.549 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.549 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.566648+0000", 2023-09-30T17:04:33.549 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.550 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.550 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.550 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.550 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.566648+0000", 2023-09-30T17:04:33.550 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.550 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.550 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.550 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.550 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.566648+0000", 2023-09-30T17:04:33.550 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4499999999999997e-07 2023-09-30T17:04:33.550 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.551 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.551 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.593 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.566660+0000", 2023-09-30T17:04:33.593 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2119e-05 2023-09-30T17:04:33.593 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.593 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.593 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.593 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.566666+0000", 2023-09-30T17:04:33.593 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9660000000000001e-06 2023-09-30T17:04:33.593 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.594 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.594 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.594 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.566671+0000", 2023-09-30T17:04:33.594 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7439999999999998e-06 2023-09-30T17:04:33.594 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.594 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.594 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.594 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.594 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.594 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166009 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.594 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.592566+0000", 2023-09-30T17:04:33.594 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.307464075, 2023-09-30T17:04:33.595 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.31926460400000001, 2023-09-30T17:04:33.595 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.595 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.595 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.595 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.595 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.595 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166009 2023-09-30T17:04:33.595 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.595 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.595 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.595 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.596 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.592566+0000", 2023-09-30T17:04:33.596 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.596 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.596 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.596 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.596 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.592566+0000", 2023-09-30T17:04:33.596 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.596 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.596 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.596 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.596 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.592566+0000", 2023-09-30T17:04:33.597 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2200000000000004e-07 2023-09-30T17:04:33.597 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.597 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.597 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.597 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.592582+0000", 2023-09-30T17:04:33.597 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6393e-05 2023-09-30T17:04:33.597 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.597 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.597 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.597 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.592589+0000", 2023-09-30T17:04:33.597 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4829999999999996e-06 2023-09-30T17:04:33.597 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.598 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.598 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.598 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.592595+0000", 2023-09-30T17:04:33.598 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8669999999999999e-06 2023-09-30T17:04:33.598 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.598 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.598 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.598 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.598 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.598 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166528 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.598 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.804570+0000", 2023-09-30T17:04:33.599 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.095459701999999994, 2023-09-30T17:04:33.599 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.107290972, 2023-09-30T17:04:33.599 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.599 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.599 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.599 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.599 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.599 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166528 2023-09-30T17:04:33.599 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.599 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.599 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.600 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.600 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.804570+0000", 2023-09-30T17:04:33.600 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.600 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.600 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.600 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.600 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.804570+0000", 2023-09-30T17:04:33.600 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.600 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.600 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.600 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.600 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.804570+0000", 2023-09-30T17:04:33.601 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4700000000000001e-07 2023-09-30T17:04:33.601 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.601 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.601 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.601 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.804587+0000", 2023-09-30T17:04:33.601 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6529999999999999e-05 2023-09-30T17:04:33.601 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.601 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.601 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.601 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.804593+0000", 2023-09-30T17:04:33.601 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4880000000000004e-06 2023-09-30T17:04:33.602 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.602 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.602 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.602 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.804598+0000", 2023-09-30T17:04:33.602 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.656e-06 2023-09-30T17:04:33.602 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.602 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.602 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.602 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.602 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.602 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166611 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.603 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.828564+0000", 2023-09-30T17:04:33.611 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.071465499000000002, 2023-09-30T17:04:33.611 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.083327558999999995, 2023-09-30T17:04:33.611 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.611 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.611 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.611 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.612 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.612 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166611 2023-09-30T17:04:33.612 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.612 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.612 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.612 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.612 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.828564+0000", 2023-09-30T17:04:33.612 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.612 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.612 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.612 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.612 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.828564+0000", 2023-09-30T17:04:33.613 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.613 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.613 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.613 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.613 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.828565+0000", 2023-09-30T17:04:33.613 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5799999999999999e-07 2023-09-30T17:04:33.613 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.613 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.613 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.613 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.828578+0000", 2023-09-30T17:04:33.613 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.327e-05 2023-09-30T17:04:33.614 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.614 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.614 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.614 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.828585+0000", 2023-09-30T17:04:33.614 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1319999999999996e-06 2023-09-30T17:04:33.614 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.614 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.614 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.615 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.828591+0000", 2023-09-30T17:04:33.615 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2049999999999999e-06 2023-09-30T17:04:33.615 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.615 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.615 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.615 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.615 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.615 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:164988 4.f 4:f0d983b2:::100000001f8.0000001f:head [write 3268608~4096 in=4096b,write 3391488~4096 in=4096b,write 3399680~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.615 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.245840+0000", 2023-09-30T17:04:33.615 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.65418995999999996, 2023-09-30T17:04:33.616 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.66608729899999997, 2023-09-30T17:04:33.616 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.616 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:33.616 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.616 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.616 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.616 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 164988 2023-09-30T17:04:33.616 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.617 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.617 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.617 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.617 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.245840+0000", 2023-09-30T17:04:33.617 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.617 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.617 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.617 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.245840+0000", 2023-09-30T17:04:33.617 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.618 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.618 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.618 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.618 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.245840+0000", 2023-09-30T17:04:33.618 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7899999999999998e-07 2023-09-30T17:04:33.618 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.618 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.618 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.618 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.245855+0000", 2023-09-30T17:04:33.618 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4610000000000001e-05 2023-09-30T17:04:33.618 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.619 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.619 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.619 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.245864+0000", 2023-09-30T17:04:33.619 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5640000000000002e-06 2023-09-30T17:04:33.619 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.619 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.619 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.619 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.245870+0000", 2023-09-30T17:04:33.619 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9100000000000002e-06 2023-09-30T17:04:33.619 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.619 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.620 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:33.620 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.901857+0000", 2023-09-30T17:04:33.620 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.65598697900000003 2023-09-30T17:04:33.620 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.620 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.620 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:33.620 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.901905+0000", 2023-09-30T17:04:33.620 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7443e-05 2023-09-30T17:04:33.620 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.620 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.620 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:33.620 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.902001+0000", 2023-09-30T17:04:33.621 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6618000000000002e-05 2023-09-30T17:04:33.621 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.621 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.621 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.621 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.621 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.621 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165139 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.621 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.295569+0000", 2023-09-30T17:04:33.621 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.60446060999999995, 2023-09-30T17:04:33.621 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.61640134800000002, 2023-09-30T17:04:33.621 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.622 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.622 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.622 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.624 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.624 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165139 2023-09-30T17:04:33.624 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.624 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.624 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.625 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.625 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.295569+0000", 2023-09-30T17:04:33.625 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.625 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.625 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.625 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.625 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.295569+0000", 2023-09-30T17:04:33.625 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.625 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.625 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.625 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.625 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.295570+0000", 2023-09-30T17:04:33.626 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7800000000000001e-07 2023-09-30T17:04:33.626 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.626 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.626 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.626 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.295586+0000", 2023-09-30T17:04:33.626 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6813e-05 2023-09-30T17:04:33.626 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.626 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.626 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.626 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.295595+0000", 2023-09-30T17:04:33.626 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2989999999999997e-06 2023-09-30T17:04:33.627 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.627 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.627 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.627 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.295600+0000", 2023-09-30T17:04:33.627 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7069999999999997e-06 2023-09-30T17:04:33.627 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.627 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.627 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.627 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.627 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.627 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165184 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.628 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.312599+0000", 2023-09-30T17:04:33.628 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.58743036299999996, 2023-09-30T17:04:33.628 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.59940275200000004, 2023-09-30T17:04:33.628 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.628 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.628 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.628 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.628 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.628 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165184 2023-09-30T17:04:33.628 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.628 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.629 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.312599+0000", 2023-09-30T17:04:33.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.629 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.629 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.312599+0000", 2023-09-30T17:04:33.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.630 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.315046+0000", 2023-09-30T17:04:33.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0024470270000000001 2023-09-30T17:04:33.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.630 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.315079+0000", 2023-09-30T17:04:33.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2292000000000002e-05 2023-09-30T17:04:33.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.630 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.631 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.315089+0000", 2023-09-30T17:04:33.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.059e-05 2023-09-30T17:04:33.631 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.631 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.631 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.631 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.315097+0000", 2023-09-30T17:04:33.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2029999999999992e-06 2023-09-30T17:04:33.631 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.631 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.631 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.631 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.631 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.632 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165272 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.632 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.341973+0000", 2023-09-30T17:04:33.632 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.55805655499999995, 2023-09-30T17:04:33.632 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.57005978400000001, 2023-09-30T17:04:33.632 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.632 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.632 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.632 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.632 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.632 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165272 2023-09-30T17:04:33.632 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.633 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.633 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.633 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.633 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.341973+0000", 2023-09-30T17:04:33.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.633 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.633 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.633 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.633 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.341973+0000", 2023-09-30T17:04:33.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.633 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.634 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.634 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.341974+0000", 2023-09-30T17:04:33.634 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2799999999999996e-07 2023-09-30T17:04:33.634 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.634 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.634 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.341990+0000", 2023-09-30T17:04:33.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6551000000000001e-05 2023-09-30T17:04:33.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.341999+0000", 2023-09-30T17:04:33.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9600000000000006e-06 2023-09-30T17:04:33.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.342004+0000", 2023-09-30T17:04:33.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.118e-06 2023-09-30T17:04:33.637 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.637 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.637 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.637 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165345 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.637 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.368928+0000", 2023-09-30T17:04:33.637 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.53110151299999997, 2023-09-30T17:04:33.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.54313562100000001, 2023-09-30T17:04:33.637 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.638 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.638 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.638 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.638 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.638 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165345 2023-09-30T17:04:33.638 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.638 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.638 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.638 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.368928+0000", 2023-09-30T17:04:33.638 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.368928+0000", 2023-09-30T17:04:33.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.368929+0000", 2023-09-30T17:04:33.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8500000000000002e-07 2023-09-30T17:04:33.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.368945+0000", 2023-09-30T17:04:33.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6614999999999999e-05 2023-09-30T17:04:33.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.368952+0000", 2023-09-30T17:04:33.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7120000000000003e-06 2023-09-30T17:04:33.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.641 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.368957+0000", 2023-09-30T17:04:33.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1630000000000004e-06 2023-09-30T17:04:33.641 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.641 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.641 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.641 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165705 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.641 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.491783+0000", 2023-09-30T17:04:33.641 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.40824654399999999, 2023-09-30T17:04:33.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.42031205999999999, 2023-09-30T17:04:33.642 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.642 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.642 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.642 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.642 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.642 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165705 2023-09-30T17:04:33.642 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.642 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.642 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.642 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.642 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.491783+0000", 2023-09-30T17:04:33.642 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.643 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.643 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.491783+0000", 2023-09-30T17:04:33.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.643 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.643 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.643 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.494265+0000", 2023-09-30T17:04:33.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0024815779999999999 2023-09-30T17:04:33.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.653 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.653 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.494278+0000", 2023-09-30T17:04:33.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3535e-05 2023-09-30T17:04:33.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.653 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.494286+0000", 2023-09-30T17:04:33.654 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0530000000000007e-06 2023-09-30T17:04:33.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.654 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.494292+0000", 2023-09-30T17:04:33.654 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0349999999999998e-06 2023-09-30T17:04:33.654 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.654 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.654 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.655 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.655 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165790 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.655 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.518647+0000", 2023-09-30T17:04:33.655 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.38138295700000002, 2023-09-30T17:04:33.655 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.39349891300000001, 2023-09-30T17:04:33.655 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.655 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.655 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.655 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.655 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.655 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165790 2023-09-30T17:04:33.656 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.656 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.656 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.656 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.656 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.518647+0000", 2023-09-30T17:04:33.656 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.656 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.656 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.656 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.656 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.518647+0000", 2023-09-30T17:04:33.656 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.656 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.657 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.657 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.521649+0000", 2023-09-30T17:04:33.657 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0030019690000000002 2023-09-30T17:04:33.657 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.657 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.657 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.521665+0000", 2023-09-30T17:04:33.657 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6239000000000002e-05 2023-09-30T17:04:33.657 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.657 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.521673+0000", 2023-09-30T17:04:33.658 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9410000000000007e-06 2023-09-30T17:04:33.658 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.669 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.669 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.521678+0000", 2023-09-30T17:04:33.669 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2660000000000001e-06 2023-09-30T17:04:33.669 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.669 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.669 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.670 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.670 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.672 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165867 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.672 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.540576+0000", 2023-09-30T17:04:33.672 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.35945329799999998, 2023-09-30T17:04:33.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.37163130300000002, 2023-09-30T17:04:33.672 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.672 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.672 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.673 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.673 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.673 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165867 2023-09-30T17:04:33.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.673 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.673 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.673 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.540576+0000", 2023-09-30T17:04:33.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.674 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.674 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.540576+0000", 2023-09-30T17:04:33.674 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.674 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.674 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.544515+0000", 2023-09-30T17:04:33.674 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039389589999999997 2023-09-30T17:04:33.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.675 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.675 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.544532+0000", 2023-09-30T17:04:33.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6595e-05 2023-09-30T17:04:33.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.675 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.675 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.544542+0000", 2023-09-30T17:04:33.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0457e-05 2023-09-30T17:04:33.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.675 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.544548+0000", 2023-09-30T17:04:33.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9429999999999997e-06 2023-09-30T17:04:33.676 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.676 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.676 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.676 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166193 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.676 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.651683+0000", 2023-09-30T17:04:33.676 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.24834673299999999, 2023-09-30T17:04:33.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.26058099499999998, 2023-09-30T17:04:33.676 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.677 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.677 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.677 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.677 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.677 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166193 2023-09-30T17:04:33.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.677 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.677 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.677 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.651683+0000", 2023-09-30T17:04:33.677 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.678 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.678 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.678 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.651683+0000", 2023-09-30T17:04:33.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.678 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.678 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.678 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.651683+0000", 2023-09-30T17:04:33.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.06e-07 2023-09-30T17:04:33.678 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.679 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.679 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.651696+0000", 2023-09-30T17:04:33.679 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2595999999999999e-05 2023-09-30T17:04:33.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.679 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.679 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.651702+0000", 2023-09-30T17:04:33.679 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2929999999999997e-06 2023-09-30T17:04:33.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.679 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.680 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.651708+0000", 2023-09-30T17:04:33.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7559999999999996e-06 2023-09-30T17:04:33.680 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.680 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.680 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.680 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.680 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166229 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.680 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.663835+0000", 2023-09-30T17:04:33.680 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.236194654, 2023-09-30T17:04:33.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.248483966, 2023-09-30T17:04:33.681 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.681 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.681 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.681 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.681 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.681 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166229 2023-09-30T17:04:33.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.681 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.681 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.681 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.663835+0000", 2023-09-30T17:04:33.681 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.682 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.682 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.682 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.682 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.663835+0000", 2023-09-30T17:04:33.682 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.682 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.682 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.682 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.682 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.663835+0000", 2023-09-30T17:04:33.682 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1500000000000001e-07 2023-09-30T17:04:33.682 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.683 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.683 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.663844+0000", 2023-09-30T17:04:33.683 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0000000000000002e-06 2023-09-30T17:04:33.683 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.683 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.683 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.663848+0000", 2023-09-30T17:04:33.683 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4249999999999998e-06 2023-09-30T17:04:33.744 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.744 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.745 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.663850+0000", 2023-09-30T17:04:33.745 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.881e-06 2023-09-30T17:04:33.745 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.745 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.745 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.745 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.746 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.746 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166530 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.746 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.804604+0000", 2023-09-30T17:04:33.746 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.095425271000000006, 2023-09-30T17:04:33.746 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.107768974, 2023-09-30T17:04:33.746 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.746 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.746 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.746 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.746 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.746 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166530 2023-09-30T17:04:33.747 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.747 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.747 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.747 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.747 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.804604+0000", 2023-09-30T17:04:33.747 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.747 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.747 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.747 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.747 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.804604+0000", 2023-09-30T17:04:33.747 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.747 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.748 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.748 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.748 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.804605+0000", 2023-09-30T17:04:33.748 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1800000000000002e-07 2023-09-30T17:04:33.748 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.748 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.748 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.748 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.804616+0000", 2023-09-30T17:04:33.748 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1379000000000001e-05 2023-09-30T17:04:33.748 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.748 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.748 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.749 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.804620+0000", 2023-09-30T17:04:33.749 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9600000000000002e-06 2023-09-30T17:04:33.749 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.749 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.749 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.749 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.804623+0000", 2023-09-30T17:04:33.749 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.061e-06 2023-09-30T17:04:33.749 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.749 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.749 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.749 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.749 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.750 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166589 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.750 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.812103+0000", 2023-09-30T17:04:33.750 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.087926134000000003, 2023-09-30T17:04:33.750 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.10032469300000001, 2023-09-30T17:04:33.750 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.750 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.750 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.750 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.750 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.750 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166589 2023-09-30T17:04:33.751 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.751 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.751 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.751 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.751 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.812103+0000", 2023-09-30T17:04:33.751 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.751 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.751 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.751 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.751 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.812103+0000", 2023-09-30T17:04:33.751 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.752 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.752 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.752 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.752 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.812104+0000", 2023-09-30T17:04:33.752 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.39e-07 2023-09-30T17:04:33.752 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.752 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.752 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.752 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.812116+0000", 2023-09-30T17:04:33.752 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2264e-05 2023-09-30T17:04:33.752 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.752 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.753 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.753 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.812123+0000", 2023-09-30T17:04:33.753 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5740000000000001e-06 2023-09-30T17:04:33.753 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.753 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.753 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.753 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.812128+0000", 2023-09-30T17:04:33.753 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3709999999999999e-06 2023-09-30T17:04:33.753 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.753 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.753 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.753 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.754 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.754 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:165579 4.6 e57/17 4:62d56fc8:::100000001f8.0000001c:head v 57'10199, mlcod=57'10188)", 2023-09-30T17:04:33.754 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.857573+0000", 2023-09-30T17:04:33.754 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.042456885999999999, 2023-09-30T17:04:33.754 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.054911665999999998, 2023-09-30T17:04:33.754 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.754 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:33.754 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.754 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.754 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.754 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.857573+0000", 2023-09-30T17:04:33.755 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.755 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.755 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.755 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.755 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.857573+0000", 2023-09-30T17:04:33.755 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.755 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.755 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.755 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.755 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.857573+0000", 2023-09-30T17:04:33.755 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.46e-07 2023-09-30T17:04:33.756 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.756 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.756 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.756 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.857584+0000", 2023-09-30T17:04:33.756 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0885e-05 2023-09-30T17:04:33.756 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.756 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.756 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.756 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.857591+0000", 2023-09-30T17:04:33.756 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8870000000000003e-06 2023-09-30T17:04:33.756 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.756 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.757 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.757 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.857597+0000", 2023-09-30T17:04:33.757 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1449999999999996e-06 2023-09-30T17:04:33.757 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.757 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.757 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:33.757 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.879583+0000", 2023-09-30T17:04:33.757 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021986347 2023-09-30T17:04:33.757 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.757 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.757 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:33.757 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.879606+0000", 2023-09-30T17:04:33.758 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2331999999999999e-05 2023-09-30T17:04:33.758 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.758 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.758 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.758 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.758 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.758 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:165611 4.36 e57/17)", 2023-09-30T17:04:33.758 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.884982+0000", 2023-09-30T17:04:33.758 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.015047199000000001, 2023-09-30T17:04:33.758 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.027565264999999999, 2023-09-30T17:04:33.758 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.759 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.759 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.759 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.759 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.759 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.884982+0000", 2023-09-30T17:04:33.759 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.759 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.759 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.759 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.759 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.884982+0000", 2023-09-30T17:04:33.759 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.760 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.760 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.760 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.760 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.884983+0000", 2023-09-30T17:04:33.760 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4299999999999999e-07 2023-09-30T17:04:33.760 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.760 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.760 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.760 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885000+0000", 2023-09-30T17:04:33.760 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7102e-05 2023-09-30T17:04:33.760 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.760 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.761 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.761 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885007+0000", 2023-09-30T17:04:33.761 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9759999999999998e-06 2023-09-30T17:04:33.761 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.761 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.761 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.761 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885012+0000", 2023-09-30T17:04:33.761 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4149999999999998e-06 2023-09-30T17:04:33.761 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.761 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.761 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.761 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.762 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.762 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166765 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.762 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.892571+0000", 2023-09-30T17:04:33.762 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0074582529999999998, 2023-09-30T17:04:33.762 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.020024239999999999, 2023-09-30T17:04:33.762 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.762 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.762 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.762 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.762 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.762 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166765 2023-09-30T17:04:33.762 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.763 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.763 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.763 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.763 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.892571+0000", 2023-09-30T17:04:33.763 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.763 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.763 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.763 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.763 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.892571+0000", 2023-09-30T17:04:33.763 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.763 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.763 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.764 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.764 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.898798+0000", 2023-09-30T17:04:33.764 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0062268610000000002 2023-09-30T17:04:33.764 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.764 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.764 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.764 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.898816+0000", 2023-09-30T17:04:33.764 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7552999999999999e-05 2023-09-30T17:04:33.764 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.764 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.764 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.764 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.898823+0000", 2023-09-30T17:04:33.765 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2869999999999999e-06 2023-09-30T17:04:33.765 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.765 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.765 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.765 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.898829+0000", 2023-09-30T17:04:33.765 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3389999999999998e-06 2023-09-30T17:04:33.765 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.765 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.765 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.765 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.765 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.765 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:164990 4.2f 4:f59f865b:::100000001f8.00000007:head [write 2736128~4096 in=4096b,write 2760704~12288 in=12288b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.766 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.245880+0000", 2023-09-30T17:04:33.766 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.65414956400000002, 2023-09-30T17:04:33.766 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.66677287900000004, 2023-09-30T17:04:33.766 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.766 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:33.766 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.766 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.766 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.766 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 164990 2023-09-30T17:04:33.766 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.766 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.766 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.767 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.767 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.245880+0000", 2023-09-30T17:04:33.767 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.767 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.767 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.767 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.767 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.245880+0000", 2023-09-30T17:04:33.767 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.767 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.767 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.767 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.768 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.245881+0000", 2023-09-30T17:04:33.768 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1200000000000003e-07 2023-09-30T17:04:33.768 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.768 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.768 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.768 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.245894+0000", 2023-09-30T17:04:33.768 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3920999999999999e-05 2023-09-30T17:04:33.768 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.768 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.768 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.768 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.245901+0000", 2023-09-30T17:04:33.768 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0669999999999997e-06 2023-09-30T17:04:33.769 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.769 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.769 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.769 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.245906+0000", 2023-09-30T17:04:33.769 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0919999999999997e-06 2023-09-30T17:04:33.769 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.769 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.769 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:33.769 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.904927+0000", 2023-09-30T17:04:33.769 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.65902166299999998 2023-09-30T17:04:33.769 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.769 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.769 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:33.770 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.905000+0000", 2023-09-30T17:04:33.770 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2784e-05 2023-09-30T17:04:33.770 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.770 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.770 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:33.770 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.905136+0000", 2023-09-30T17:04:33.770 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000136017 2023-09-30T17:04:33.770 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.770 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.770 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.770 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.770 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.771 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:165273 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.771 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.342011+0000", 2023-09-30T17:04:33.771 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.55801842700000004, 2023-09-30T17:04:33.771 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.57071096499999996, 2023-09-30T17:04:33.771 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.771 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:33.771 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.771 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.771 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.771 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 165273 2023-09-30T17:04:33.771 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.772 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.772 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.772 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.772 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.342011+0000", 2023-09-30T17:04:33.772 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.772 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.772 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.772 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.772 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.342011+0000", 2023-09-30T17:04:33.772 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.772 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.772 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.773 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.773 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.342012+0000", 2023-09-30T17:04:33.773 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.58e-07 2023-09-30T17:04:33.773 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.773 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.773 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.773 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.342023+0000", 2023-09-30T17:04:33.773 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1571e-05 2023-09-30T17:04:33.773 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.773 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.773 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.773 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.342029+0000", 2023-09-30T17:04:33.774 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8629999999999996e-06 2023-09-30T17:04:33.774 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.774 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.774 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.774 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.342033+0000", 2023-09-30T17:04:33.774 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3109999999999999e-06 2023-09-30T17:04:33.774 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.774 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.774 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.774 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.774 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.774 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:167236 4.28 e57/17 4:153ae410:::100000001f8.0000003b:head v 57'5114, mlcod=57'5111)", 2023-09-30T17:04:33.775 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.885021+0000", 2023-09-30T17:04:33.775 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.015008366, 2023-09-30T17:04:33.775 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.027753677000000001, 2023-09-30T17:04:33.775 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.775 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:33.775 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.775 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.775 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.775 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885021+0000", 2023-09-30T17:04:33.775 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.775 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.775 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.776 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.776 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885021+0000", 2023-09-30T17:04:33.776 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.776 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.776 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.776 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.776 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885022+0000", 2023-09-30T17:04:33.776 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9200000000000002e-07 2023-09-30T17:04:33.776 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.776 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.777 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.777 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885033+0000", 2023-09-30T17:04:33.777 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1304000000000001e-05 2023-09-30T17:04:33.777 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.777 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.777 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.777 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885039+0000", 2023-09-30T17:04:33.777 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8749999999999997e-06 2023-09-30T17:04:33.777 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.777 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.777 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.777 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.885043+0000", 2023-09-30T17:04:33.778 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4780000000000002e-06 2023-09-30T17:04:33.778 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.778 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.778 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:33.778 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.888245+0000", 2023-09-30T17:04:33.778 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0032013290000000002 2023-09-30T17:04:33.778 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.778 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.778 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:33.778 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.888257+0000", 2023-09-30T17:04:33.778 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2626000000000001e-05 2023-09-30T17:04:33.778 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.779 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.779 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.779 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.779 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.779 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:166766 4.2d 4:b7099a35:::100000001f8.0000000e:head [write 1826816~4096 in=4096b,write 2007040~4096 in=4096b,write 2252800~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:33.779 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:31.898840+0000", 2023-09-30T17:04:33.779 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0011895110000000001, 2023-09-30T17:04:33.779 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013999675, 2023-09-30T17:04:33.779 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:33.779 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:33.779 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:33.779 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:33.780 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:33.780 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 166766 2023-09-30T17:04:33.780 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.780 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:33.786 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.786 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:33.787 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.898840+0000", 2023-09-30T17:04:33.787 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.787 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.787 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.787 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:33.787 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.898840+0000", 2023-09-30T17:04:33.787 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:33.787 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.787 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.787 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:33.787 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.898841+0000", 2023-09-30T17:04:33.788 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7800000000000001e-07 2023-09-30T17:04:33.788 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.788 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.788 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:33.788 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.898853+0000", 2023-09-30T17:04:33.788 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.221e-05 2023-09-30T17:04:33.788 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.788 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.788 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:33.788 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.898861+0000", 2023-09-30T17:04:33.788 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7109999999999995e-06 2023-09-30T17:04:33.788 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.789 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.789 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:33.789 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.898867+0000", 2023-09-30T17:04:33.789 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2890000000000003e-06 2023-09-30T17:04:33.789 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.789 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.789 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:33.789 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.899794+0000", 2023-09-30T17:04:33.789 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00092727599999999999 2023-09-30T17:04:33.789 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.789 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.789 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:33.790 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.899862+0000", 2023-09-30T17:04:33.790 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8186000000000001e-05 2023-09-30T17:04:33.790 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:33.790 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:33.790 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:33.790 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:31.900002+0000", 2023-09-30T17:04:33.790 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013980700000000001 2023-09-30T17:04:33.790 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.790 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:33.790 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.790 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:33.791 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2023-09-30T17:04:33.791 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 270 2023-09-30T17:04:33.791 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:04:33.791 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-09-30T17:04:33.792 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-09-30T17:04:33.793 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:04:33.797 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:33.792+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:33.895 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:33.892+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:33.968 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:04:33.994 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:33.993+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:34.005 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:04:34.006 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-09-30T17:04:34.006 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-09-30T17:04:34.006 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:04:34.010 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:04:34.010 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:04:34.032 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:34.032 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:34.049 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:04:34.135 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:34.134+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:34.196 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:34.195+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:34.287 INFO:tasks.workunit.client.0.smithi007.stdout:setting up random write file 2023-09-30T17:04:34.288 INFO:tasks.workunit.client.0.smithi007.stdout:done setting up random write file 2023-09-30T17:04:34.288 INFO:tasks.workunit.client.0.smithi007.stdout:starting fsync run 2023-09-30T17:04:34.288 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0058s fsync time: 0.0057s 2023-09-30T17:04:34.288 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0011s fsync time: 0.0175s 2023-09-30T17:04:34.288 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0013s fsync time: 0.0124s 2023-09-30T17:04:34.288 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0013s fsync time: 0.0154s 2023-09-30T17:04:34.288 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0012s fsync time: 0.0115s 2023-09-30T17:04:34.288 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0013s fsync time: 0.0136s 2023-09-30T17:04:34.288 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0011s fsync time: 0.0105s 2023-09-30T17:04:34.288 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0013s fsync time: 0.0160s 2023-09-30T17:04:34.289 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0021s fsync time: 0.0094s 2023-09-30T17:04:34.289 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0010s fsync time: 0.2257s 2023-09-30T17:04:34.289 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0013s fsync time: 0.0169s 2023-09-30T17:04:34.289 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0015s fsync time: 0.0117s 2023-09-30T17:04:34.289 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0012s fsync time: 0.2521s 2023-09-30T17:04:34.289 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0012s fsync time: 0.0160s 2023-09-30T17:04:34.289 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0014s fsync time: 0.0161s 2023-09-30T17:04:34.289 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0011s fsync time: 0.0197s 2023-09-30T17:04:34.289 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0012s fsync time: 0.0263s 2023-09-30T17:04:34.289 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0012s fsync time: 0.0126s 2023-09-30T17:04:34.289 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0013s fsync time: 0.0187s 2023-09-30T17:04:34.290 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0012s fsync time: 0.0186s 2023-09-30T17:04:34.290 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0011s fsync time: 0.0146s 2023-09-30T17:04:34.290 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0011s fsync time: 0.0156s 2023-09-30T17:04:34.290 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0018s fsync time: 0.0168s 2023-09-30T17:04:34.290 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0011s fsync time: 0.0122s 2023-09-30T17:04:34.290 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0016s fsync time: 0.0434s 2023-09-30T17:04:34.290 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0014s fsync time: 0.0139s 2023-09-30T17:04:34.290 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0015s fsync time: 0.0162s 2023-09-30T17:04:34.290 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0013s fsync time: 0.0428s 2023-09-30T17:04:34.290 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0014s fsync time: 0.0137s 2023-09-30T17:04:34.290 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0014s fsync time: 0.0244s 2023-09-30T17:04:34.291 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0011s fsync time: 0.0345s 2023-09-30T17:04:34.291 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0010s fsync time: 0.0226s 2023-09-30T17:04:34.291 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0010s fsync time: 0.3641s 2023-09-30T17:04:34.291 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0013s fsync time: 0.3681s 2023-09-30T17:04:34.291 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0011s fsync time: 0.5905s 2023-09-30T17:04:34.291 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0011s fsync time: 0.7622s 2023-09-30T17:04:34.291 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0012s fsync time: 1.1214s 2023-09-30T17:04:34.291 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0013s fsync time: 1.4227s 2023-09-30T17:04:34.291 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0013s fsync time: 1.8024s 2023-09-30T17:04:34.291 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0013s fsync time: 2.4082s 2023-09-30T17:04:34.291 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.0014s fsync time: 3.1806s 2023-09-30T17:04:34.292 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.7129s fsync time: 3.9660s 2023-09-30T17:04:34.292 INFO:tasks.workunit.client.0.smithi007.stdout:write time: 0.6467s fsync time: 4.1675s 2023-09-30T17:04:34.292 INFO:tasks.workunit.client.0.smithi007.stdout:run done 43 fsyncs total, killing random writer 2023-09-30T17:04:34.293 INFO:tasks.workunit.client.0.smithi007.stderr:+ echo /home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2023-09-30T17:04:34.293 INFO:tasks.workunit.client.0.smithi007.stdout:/home/ubuntu/.local/bin:/home/ubuntu/bin:/usr/local/bin:/usr/bin:/usr/local/sbin:/usr/sbin:/usr/sbin 2023-09-30T17:04:34.294 INFO:tasks.workunit.client.0.smithi007.stderr:+ whereis lsof 2023-09-30T17:04:34.296 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:34.296+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:34.309 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:34.309 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:34.318 INFO:tasks.workunit.client.0.smithi007.stdout:lsof: /usr/bin/lsof /usr/share/man/man1/lsof.1.gz 2023-09-30T17:04:34.319 INFO:tasks.workunit.client.0.smithi007.stderr:+ lsof 2023-09-30T17:04:34.326 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:04:34.377 INFO:tasks.workunit.client.0.smithi007.stdout:COMMAND PID TID TASKCMD USER FD TYPE DEVICE SIZE/OFF NODE NAME 2023-09-30T17:04:34.377 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1 root cwd unknown /proc/1/cwd (readlink: Permission denied) 2023-09-30T17:04:34.377 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1 root rtd unknown /proc/1/root (readlink: Permission denied) 2023-09-30T17:04:34.377 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1 root txt unknown /proc/1/exe (readlink: Permission denied) 2023-09-30T17:04:34.377 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1 root NOFD /proc/1/fd (opendir: Permission denied) 2023-09-30T17:04:34.377 INFO:tasks.workunit.client.0.smithi007.stdout:kthreadd 2 root cwd unknown /proc/2/cwd (readlink: Permission denied) 2023-09-30T17:04:34.377 INFO:tasks.workunit.client.0.smithi007.stdout:kthreadd 2 root rtd unknown /proc/2/root (readlink: Permission denied) 2023-09-30T17:04:34.378 INFO:tasks.workunit.client.0.smithi007.stdout:kthreadd 2 root txt unknown /proc/2/exe (readlink: Permission denied) 2023-09-30T17:04:34.378 INFO:tasks.workunit.client.0.smithi007.stdout:kthreadd 2 root NOFD /proc/2/fd (opendir: Permission denied) 2023-09-30T17:04:34.378 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_gp 3 root cwd unknown /proc/3/cwd (readlink: Permission denied) 2023-09-30T17:04:34.378 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_gp 3 root rtd unknown /proc/3/root (readlink: Permission denied) 2023-09-30T17:04:34.378 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_gp 3 root txt unknown /proc/3/exe (readlink: Permission denied) 2023-09-30T17:04:34.378 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_gp 3 root NOFD /proc/3/fd (opendir: Permission denied) 2023-09-30T17:04:34.378 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_par_g 4 root cwd unknown /proc/4/cwd (readlink: Permission denied) 2023-09-30T17:04:34.378 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_par_g 4 root rtd unknown /proc/4/root (readlink: Permission denied) 2023-09-30T17:04:34.378 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_par_g 4 root txt unknown /proc/4/exe (readlink: Permission denied) 2023-09-30T17:04:34.378 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_par_g 4 root NOFD /proc/4/fd (opendir: Permission denied) 2023-09-30T17:04:34.378 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 6 root cwd unknown /proc/6/cwd (readlink: Permission denied) 2023-09-30T17:04:34.378 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 6 root rtd unknown /proc/6/root (readlink: Permission denied) 2023-09-30T17:04:34.379 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 6 root txt unknown /proc/6/exe (readlink: Permission denied) 2023-09-30T17:04:34.379 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 6 root NOFD /proc/6/fd (opendir: Permission denied) 2023-09-30T17:04:34.379 INFO:tasks.workunit.client.0.smithi007.stdout:mm_percpu 9 root cwd unknown /proc/9/cwd (readlink: Permission denied) 2023-09-30T17:04:34.379 INFO:tasks.workunit.client.0.smithi007.stdout:mm_percpu 9 root rtd unknown /proc/9/root (readlink: Permission denied) 2023-09-30T17:04:34.379 INFO:tasks.workunit.client.0.smithi007.stdout:mm_percpu 9 root txt unknown /proc/9/exe (readlink: Permission denied) 2023-09-30T17:04:34.379 INFO:tasks.workunit.client.0.smithi007.stdout:mm_percpu 9 root NOFD /proc/9/fd (opendir: Permission denied) 2023-09-30T17:04:34.379 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_tasks 10 root cwd unknown /proc/10/cwd (readlink: Permission denied) 2023-09-30T17:04:34.380 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_tasks 10 root rtd unknown /proc/10/root (readlink: Permission denied) 2023-09-30T17:04:34.380 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_tasks 10 root txt unknown /proc/10/exe (readlink: Permission denied) 2023-09-30T17:04:34.380 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_tasks 10 root NOFD /proc/10/fd (opendir: Permission denied) 2023-09-30T17:04:34.380 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_tasks 11 root cwd unknown /proc/11/cwd (readlink: Permission denied) 2023-09-30T17:04:34.380 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_tasks 11 root rtd unknown /proc/11/root (readlink: Permission denied) 2023-09-30T17:04:34.380 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_tasks 11 root txt unknown /proc/11/exe (readlink: Permission denied) 2023-09-30T17:04:34.380 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_tasks 11 root NOFD /proc/11/fd (opendir: Permission denied) 2023-09-30T17:04:34.380 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 12 root cwd unknown /proc/12/cwd (readlink: Permission denied) 2023-09-30T17:04:34.380 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 12 root rtd unknown /proc/12/root (readlink: Permission denied) 2023-09-30T17:04:34.380 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 12 root txt unknown /proc/12/exe (readlink: Permission denied) 2023-09-30T17:04:34.380 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 12 root NOFD /proc/12/fd (opendir: Permission denied) 2023-09-30T17:04:34.380 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_sched 13 root cwd unknown /proc/13/cwd (readlink: Permission denied) 2023-09-30T17:04:34.381 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_sched 13 root rtd unknown /proc/13/root (readlink: Permission denied) 2023-09-30T17:04:34.381 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_sched 13 root txt unknown /proc/13/exe (readlink: Permission denied) 2023-09-30T17:04:34.381 INFO:tasks.workunit.client.0.smithi007.stdout:rcu_sched 13 root NOFD /proc/13/fd (opendir: Permission denied) 2023-09-30T17:04:34.381 INFO:tasks.workunit.client.0.smithi007.stdout:migration 14 root cwd unknown /proc/14/cwd (readlink: Permission denied) 2023-09-30T17:04:34.381 INFO:tasks.workunit.client.0.smithi007.stdout:migration 14 root rtd unknown /proc/14/root (readlink: Permission denied) 2023-09-30T17:04:34.381 INFO:tasks.workunit.client.0.smithi007.stdout:migration 14 root txt unknown /proc/14/exe (readlink: Permission denied) 2023-09-30T17:04:34.381 INFO:tasks.workunit.client.0.smithi007.stdout:migration 14 root NOFD /proc/14/fd (opendir: Permission denied) 2023-09-30T17:04:34.381 INFO:tasks.workunit.client.0.smithi007.stdout:watchdog/ 15 root cwd unknown /proc/15/cwd (readlink: Permission denied) 2023-09-30T17:04:34.381 INFO:tasks.workunit.client.0.smithi007.stdout:watchdog/ 15 root rtd unknown /proc/15/root (readlink: Permission denied) 2023-09-30T17:04:34.381 INFO:tasks.workunit.client.0.smithi007.stdout:watchdog/ 15 root txt unknown /proc/15/exe (readlink: Permission denied) 2023-09-30T17:04:34.381 INFO:tasks.workunit.client.0.smithi007.stdout:watchdog/ 15 root NOFD /proc/15/fd (opendir: Permission denied) 2023-09-30T17:04:34.381 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/0 16 root cwd unknown /proc/16/cwd (readlink: Permission denied) 2023-09-30T17:04:34.382 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/0 16 root rtd unknown /proc/16/root (readlink: Permission denied) 2023-09-30T17:04:34.382 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/0 16 root txt unknown /proc/16/exe (readlink: Permission denied) 2023-09-30T17:04:34.382 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/0 16 root NOFD /proc/16/fd (opendir: Permission denied) 2023-09-30T17:04:34.382 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/1 17 root cwd unknown /proc/17/cwd (readlink: Permission denied) 2023-09-30T17:04:34.382 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/1 17 root rtd unknown /proc/17/root (readlink: Permission denied) 2023-09-30T17:04:34.382 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/1 17 root txt unknown /proc/17/exe (readlink: Permission denied) 2023-09-30T17:04:34.382 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/1 17 root NOFD /proc/17/fd (opendir: Permission denied) 2023-09-30T17:04:34.382 INFO:tasks.workunit.client.0.smithi007.stdout:watchdog/ 18 root cwd unknown /proc/18/cwd (readlink: Permission denied) 2023-09-30T17:04:34.382 INFO:tasks.workunit.client.0.smithi007.stdout:watchdog/ 18 root rtd unknown /proc/18/root (readlink: Permission denied) 2023-09-30T17:04:34.382 INFO:tasks.workunit.client.0.smithi007.stdout:watchdog/ 18 root txt unknown /proc/18/exe (readlink: Permission denied) 2023-09-30T17:04:34.382 INFO:tasks.workunit.client.0.smithi007.stdout:watchdog/ 18 root NOFD /proc/18/fd (opendir: Permission denied) 2023-09-30T17:04:34.383 INFO:tasks.workunit.client.0.smithi007.stdout:migration 19 root cwd unknown /proc/19/cwd (readlink: Permission denied) 2023-09-30T17:04:34.383 INFO:tasks.workunit.client.0.smithi007.stdout:migration 19 root rtd unknown /proc/19/root (readlink: Permission denied) 2023-09-30T17:04:34.383 INFO:tasks.workunit.client.0.smithi007.stdout:migration 19 root txt unknown /proc/19/exe (readlink: Permission denied) 2023-09-30T17:04:34.383 INFO:tasks.workunit.client.0.smithi007.stdout:migration 19 root NOFD /proc/19/fd (opendir: Permission denied) 2023-09-30T17:04:34.383 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 20 root cwd unknown /proc/20/cwd (readlink: Permission denied) 2023-09-30T17:04:34.383 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 20 root rtd unknown /proc/20/root (readlink: Permission denied) 2023-09-30T17:04:34.383 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 20 root txt unknown /proc/20/exe (readlink: Permission denied) 2023-09-30T17:04:34.383 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 20 root NOFD /proc/20/fd (opendir: Permission denied) 2023-09-30T17:04:34.383 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 22 root cwd unknown /proc/22/cwd (readlink: Permission denied) 2023-09-30T17:04:34.383 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 22 root rtd unknown /proc/22/root (readlink: Permission denied) 2023-09-30T17:04:34.383 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 22 root txt unknown /proc/22/exe (readlink: Permission denied) 2023-09-30T17:04:34.384 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 22 root NOFD /proc/22/fd (opendir: Permission denied) 2023-09-30T17:04:34.384 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/2 23 root cwd unknown /proc/23/cwd (readlink: Permission denied) 2023-09-30T17:04:34.384 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/2 23 root rtd unknown /proc/23/root (readlink: Permission denied) 2023-09-30T17:04:34.384 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/2 23 root txt unknown /proc/23/exe (readlink: Permission denied) 2023-09-30T17:04:34.384 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/2 23 root NOFD /proc/23/fd (opendir: Permission denied) 2023-09-30T17:04:34.384 INFO:tasks.workunit.client.0.smithi007.stdout:watchdog/ 24 root cwd unknown /proc/24/cwd (readlink: Permission denied) 2023-09-30T17:04:34.384 INFO:tasks.workunit.client.0.smithi007.stdout:watchdog/ 24 root rtd unknown /proc/24/root (readlink: Permission denied) 2023-09-30T17:04:34.384 INFO:tasks.workunit.client.0.smithi007.stdout:watchdog/ 24 root txt unknown /proc/24/exe (readlink: Permission denied) 2023-09-30T17:04:34.384 INFO:tasks.workunit.client.0.smithi007.stdout:watchdog/ 24 root NOFD /proc/24/fd (opendir: Permission denied) 2023-09-30T17:04:34.384 INFO:tasks.workunit.client.0.smithi007.stdout:migration 25 root cwd unknown /proc/25/cwd (readlink: Permission denied) 2023-09-30T17:04:34.384 INFO:tasks.workunit.client.0.smithi007.stdout:migration 25 root rtd unknown /proc/25/root (readlink: Permission denied) 2023-09-30T17:04:34.384 INFO:tasks.workunit.client.0.smithi007.stdout:migration 25 root txt unknown /proc/25/exe (readlink: Permission denied) 2023-09-30T17:04:34.385 INFO:tasks.workunit.client.0.smithi007.stdout:migration 25 root NOFD /proc/25/fd (opendir: Permission denied) 2023-09-30T17:04:34.385 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 26 root cwd unknown /proc/26/cwd (readlink: Permission denied) 2023-09-30T17:04:34.385 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 26 root rtd unknown /proc/26/root (readlink: Permission denied) 2023-09-30T17:04:34.385 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 26 root txt unknown /proc/26/exe (readlink: Permission denied) 2023-09-30T17:04:34.385 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 26 root NOFD /proc/26/fd (opendir: Permission denied) 2023-09-30T17:04:34.385 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 28 root cwd unknown /proc/28/cwd (readlink: Permission denied) 2023-09-30T17:04:34.385 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 28 root rtd unknown /proc/28/root (readlink: Permission denied) 2023-09-30T17:04:34.385 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 28 root txt unknown /proc/28/exe (readlink: Permission denied) 2023-09-30T17:04:34.385 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 28 root NOFD /proc/28/fd (opendir: Permission denied) 2023-09-30T17:04:34.385 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/3 29 root cwd unknown /proc/29/cwd (readlink: Permission denied) 2023-09-30T17:04:34.385 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/3 29 root rtd unknown /proc/29/root (readlink: Permission denied) 2023-09-30T17:04:34.386 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/3 29 root txt unknown /proc/29/exe (readlink: Permission denied) 2023-09-30T17:04:34.386 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/3 29 root NOFD /proc/29/fd (opendir: Permission denied) 2023-09-30T17:04:34.386 INFO:tasks.workunit.client.0.smithi007.stdout:watchdog/ 30 root cwd unknown /proc/30/cwd (readlink: Permission denied) 2023-09-30T17:04:34.386 INFO:tasks.workunit.client.0.smithi007.stdout:watchdog/ 30 root rtd unknown /proc/30/root (readlink: Permission denied) 2023-09-30T17:04:34.386 INFO:tasks.workunit.client.0.smithi007.stdout:watchdog/ 30 root txt unknown /proc/30/exe (readlink: Permission denied) 2023-09-30T17:04:34.386 INFO:tasks.workunit.client.0.smithi007.stdout:watchdog/ 30 root NOFD /proc/30/fd (opendir: Permission denied) 2023-09-30T17:04:34.386 INFO:tasks.workunit.client.0.smithi007.stdout:migration 31 root cwd unknown /proc/31/cwd (readlink: Permission denied) 2023-09-30T17:04:34.386 INFO:tasks.workunit.client.0.smithi007.stdout:migration 31 root rtd unknown /proc/31/root (readlink: Permission denied) 2023-09-30T17:04:34.386 INFO:tasks.workunit.client.0.smithi007.stdout:migration 31 root txt unknown /proc/31/exe (readlink: Permission denied) 2023-09-30T17:04:34.386 INFO:tasks.workunit.client.0.smithi007.stdout:migration 31 root NOFD /proc/31/fd (opendir: Permission denied) 2023-09-30T17:04:34.386 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 32 root cwd unknown /proc/32/cwd (readlink: Permission denied) 2023-09-30T17:04:34.387 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 32 root rtd unknown /proc/32/root (readlink: Permission denied) 2023-09-30T17:04:34.387 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 32 root txt unknown /proc/32/exe (readlink: Permission denied) 2023-09-30T17:04:34.387 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 32 root NOFD /proc/32/fd (opendir: Permission denied) 2023-09-30T17:04:34.387 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 34 root cwd unknown /proc/34/cwd (readlink: Permission denied) 2023-09-30T17:04:34.387 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 34 root rtd unknown /proc/34/root (readlink: Permission denied) 2023-09-30T17:04:34.387 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 34 root txt unknown /proc/34/exe (readlink: Permission denied) 2023-09-30T17:04:34.387 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 34 root NOFD /proc/34/fd (opendir: Permission denied) 2023-09-30T17:04:34.387 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/4 35 root cwd unknown /proc/35/cwd (readlink: Permission denied) 2023-09-30T17:04:34.387 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/4 35 root rtd unknown /proc/35/root (readlink: Permission denied) 2023-09-30T17:04:34.387 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/4 35 root txt unknown /proc/35/exe (readlink: Permission denied) 2023-09-30T17:04:34.387 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/4 35 root NOFD /proc/35/fd (opendir: Permission denied) 2023-09-30T17:04:34.388 INFO:tasks.workunit.client.0.smithi007.stdout:watchdog/ 36 root cwd unknown /proc/36/cwd (readlink: Permission denied) 2023-09-30T17:04:34.388 INFO:tasks.workunit.client.0.smithi007.stdout:watchdog/ 36 root rtd unknown /proc/36/root (readlink: Permission denied) 2023-09-30T17:04:34.388 INFO:tasks.workunit.client.0.smithi007.stdout:watchdog/ 36 root txt unknown /proc/36/exe (readlink: Permission denied) 2023-09-30T17:04:34.388 INFO:tasks.workunit.client.0.smithi007.stdout:watchdog/ 36 root NOFD /proc/36/fd (opendir: Permission denied) 2023-09-30T17:04:34.388 INFO:tasks.workunit.client.0.smithi007.stdout:migration 37 root cwd unknown /proc/37/cwd (readlink: Permission denied) 2023-09-30T17:04:34.388 INFO:tasks.workunit.client.0.smithi007.stdout:migration 37 root rtd unknown /proc/37/root (readlink: Permission denied) 2023-09-30T17:04:34.388 INFO:tasks.workunit.client.0.smithi007.stdout:migration 37 root txt unknown /proc/37/exe (readlink: Permission denied) 2023-09-30T17:04:34.388 INFO:tasks.workunit.client.0.smithi007.stdout:migration 37 root NOFD /proc/37/fd (opendir: Permission denied) 2023-09-30T17:04:34.388 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 38 root cwd unknown /proc/38/cwd (readlink: Permission denied) 2023-09-30T17:04:34.388 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 38 root rtd unknown /proc/38/root (readlink: Permission denied) 2023-09-30T17:04:34.388 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 38 root txt unknown /proc/38/exe (readlink: Permission denied) 2023-09-30T17:04:34.388 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 38 root NOFD /proc/38/fd (opendir: Permission denied) 2023-09-30T17:04:34.389 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 39 root cwd unknown /proc/39/cwd (readlink: Permission denied) 2023-09-30T17:04:34.389 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 39 root rtd unknown /proc/39/root (readlink: Permission denied) 2023-09-30T17:04:34.389 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 39 root txt unknown /proc/39/exe (readlink: Permission denied) 2023-09-30T17:04:34.389 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 39 root NOFD /proc/39/fd (opendir: Permission denied) 2023-09-30T17:04:34.389 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 40 root cwd unknown /proc/40/cwd (readlink: Permission denied) 2023-09-30T17:04:34.389 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 40 root rtd unknown /proc/40/root (readlink: Permission denied) 2023-09-30T17:04:34.389 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 40 root txt unknown /proc/40/exe (readlink: Permission denied) 2023-09-30T17:04:34.389 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 40 root NOFD /proc/40/fd (opendir: Permission denied) 2023-09-30T17:04:34.389 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/5 41 root cwd unknown /proc/41/cwd (readlink: Permission denied) 2023-09-30T17:04:34.389 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/5 41 root rtd unknown /proc/41/root (readlink: Permission denied) 2023-09-30T17:04:34.389 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/5 41 root txt unknown /proc/41/exe (readlink: Permission denied) 2023-09-30T17:04:34.389 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/5 41 root NOFD /proc/41/fd (opendir: Permission denied) 2023-09-30T17:04:34.390 INFO:tasks.workunit.client.0.smithi007.stdout:watchdog/ 42 root cwd unknown /proc/42/cwd (readlink: Permission denied) 2023-09-30T17:04:34.390 INFO:tasks.workunit.client.0.smithi007.stdout:watchdog/ 42 root rtd unknown /proc/42/root (readlink: Permission denied) 2023-09-30T17:04:34.390 INFO:tasks.workunit.client.0.smithi007.stdout:watchdog/ 42 root txt unknown /proc/42/exe (readlink: Permission denied) 2023-09-30T17:04:34.390 INFO:tasks.workunit.client.0.smithi007.stdout:watchdog/ 42 root NOFD /proc/42/fd (opendir: Permission denied) 2023-09-30T17:04:34.390 INFO:tasks.workunit.client.0.smithi007.stdout:migration 43 root cwd unknown /proc/43/cwd (readlink: Permission denied) 2023-09-30T17:04:34.390 INFO:tasks.workunit.client.0.smithi007.stdout:migration 43 root rtd unknown /proc/43/root (readlink: Permission denied) 2023-09-30T17:04:34.390 INFO:tasks.workunit.client.0.smithi007.stdout:migration 43 root txt unknown /proc/43/exe (readlink: Permission denied) 2023-09-30T17:04:34.390 INFO:tasks.workunit.client.0.smithi007.stdout:migration 43 root NOFD /proc/43/fd (opendir: Permission denied) 2023-09-30T17:04:34.390 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 44 root cwd unknown /proc/44/cwd (readlink: Permission denied) 2023-09-30T17:04:34.390 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 44 root rtd unknown /proc/44/root (readlink: Permission denied) 2023-09-30T17:04:34.390 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 44 root txt unknown /proc/44/exe (readlink: Permission denied) 2023-09-30T17:04:34.391 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 44 root NOFD /proc/44/fd (opendir: Permission denied) 2023-09-30T17:04:34.391 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 46 root cwd unknown /proc/46/cwd (readlink: Permission denied) 2023-09-30T17:04:34.391 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 46 root rtd unknown /proc/46/root (readlink: Permission denied) 2023-09-30T17:04:34.391 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 46 root txt unknown /proc/46/exe (readlink: Permission denied) 2023-09-30T17:04:34.391 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 46 root NOFD /proc/46/fd (opendir: Permission denied) 2023-09-30T17:04:34.391 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/6 47 root cwd unknown /proc/47/cwd (readlink: Permission denied) 2023-09-30T17:04:34.391 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/6 47 root rtd unknown /proc/47/root (readlink: Permission denied) 2023-09-30T17:04:34.391 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/6 47 root txt unknown /proc/47/exe (readlink: Permission denied) 2023-09-30T17:04:34.391 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/6 47 root NOFD /proc/47/fd (opendir: Permission denied) 2023-09-30T17:04:34.391 INFO:tasks.workunit.client.0.smithi007.stdout:watchdog/ 48 root cwd unknown /proc/48/cwd (readlink: Permission denied) 2023-09-30T17:04:34.391 INFO:tasks.workunit.client.0.smithi007.stdout:watchdog/ 48 root rtd unknown /proc/48/root (readlink: Permission denied) 2023-09-30T17:04:34.392 INFO:tasks.workunit.client.0.smithi007.stdout:watchdog/ 48 root txt unknown /proc/48/exe (readlink: Permission denied) 2023-09-30T17:04:34.392 INFO:tasks.workunit.client.0.smithi007.stdout:watchdog/ 48 root NOFD /proc/48/fd (opendir: Permission denied) 2023-09-30T17:04:34.392 INFO:tasks.workunit.client.0.smithi007.stdout:migration 49 root cwd unknown /proc/49/cwd (readlink: Permission denied) 2023-09-30T17:04:34.392 INFO:tasks.workunit.client.0.smithi007.stdout:migration 49 root rtd unknown /proc/49/root (readlink: Permission denied) 2023-09-30T17:04:34.392 INFO:tasks.workunit.client.0.smithi007.stdout:migration 49 root txt unknown /proc/49/exe (readlink: Permission denied) 2023-09-30T17:04:34.392 INFO:tasks.workunit.client.0.smithi007.stdout:migration 49 root NOFD /proc/49/fd (opendir: Permission denied) 2023-09-30T17:04:34.392 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 50 root cwd unknown /proc/50/cwd (readlink: Permission denied) 2023-09-30T17:04:34.392 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 50 root rtd unknown /proc/50/root (readlink: Permission denied) 2023-09-30T17:04:34.392 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 50 root txt unknown /proc/50/exe (readlink: Permission denied) 2023-09-30T17:04:34.392 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 50 root NOFD /proc/50/fd (opendir: Permission denied) 2023-09-30T17:04:34.392 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 52 root cwd unknown /proc/52/cwd (readlink: Permission denied) 2023-09-30T17:04:34.393 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 52 root rtd unknown /proc/52/root (readlink: Permission denied) 2023-09-30T17:04:34.393 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 52 root txt unknown /proc/52/exe (readlink: Permission denied) 2023-09-30T17:04:34.393 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 52 root NOFD /proc/52/fd (opendir: Permission denied) 2023-09-30T17:04:34.393 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/7 53 root cwd unknown /proc/53/cwd (readlink: Permission denied) 2023-09-30T17:04:34.393 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/7 53 root rtd unknown /proc/53/root (readlink: Permission denied) 2023-09-30T17:04:34.393 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/7 53 root txt unknown /proc/53/exe (readlink: Permission denied) 2023-09-30T17:04:34.393 INFO:tasks.workunit.client.0.smithi007.stdout:cpuhp/7 53 root NOFD /proc/53/fd (opendir: Permission denied) 2023-09-30T17:04:34.393 INFO:tasks.workunit.client.0.smithi007.stdout:watchdog/ 54 root cwd unknown /proc/54/cwd (readlink: Permission denied) 2023-09-30T17:04:34.393 INFO:tasks.workunit.client.0.smithi007.stdout:watchdog/ 54 root rtd unknown /proc/54/root (readlink: Permission denied) 2023-09-30T17:04:34.393 INFO:tasks.workunit.client.0.smithi007.stdout:watchdog/ 54 root txt unknown /proc/54/exe (readlink: Permission denied) 2023-09-30T17:04:34.393 INFO:tasks.workunit.client.0.smithi007.stdout:watchdog/ 54 root NOFD /proc/54/fd (opendir: Permission denied) 2023-09-30T17:04:34.393 INFO:tasks.workunit.client.0.smithi007.stdout:migration 55 root cwd unknown /proc/55/cwd (readlink: Permission denied) 2023-09-30T17:04:34.394 INFO:tasks.workunit.client.0.smithi007.stdout:migration 55 root rtd unknown /proc/55/root (readlink: Permission denied) 2023-09-30T17:04:34.394 INFO:tasks.workunit.client.0.smithi007.stdout:migration 55 root txt unknown /proc/55/exe (readlink: Permission denied) 2023-09-30T17:04:34.394 INFO:tasks.workunit.client.0.smithi007.stdout:migration 55 root NOFD /proc/55/fd (opendir: Permission denied) 2023-09-30T17:04:34.394 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 56 root cwd unknown /proc/56/cwd (readlink: Permission denied) 2023-09-30T17:04:34.394 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 56 root rtd unknown /proc/56/root (readlink: Permission denied) 2023-09-30T17:04:34.394 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 56 root txt unknown /proc/56/exe (readlink: Permission denied) 2023-09-30T17:04:34.394 INFO:tasks.workunit.client.0.smithi007.stdout:ksoftirqd 56 root NOFD /proc/56/fd (opendir: Permission denied) 2023-09-30T17:04:34.394 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 58 root cwd unknown /proc/58/cwd (readlink: Permission denied) 2023-09-30T17:04:34.394 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 58 root rtd unknown /proc/58/root (readlink: Permission denied) 2023-09-30T17:04:34.394 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 58 root txt unknown /proc/58/exe (readlink: Permission denied) 2023-09-30T17:04:34.394 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 58 root NOFD /proc/58/fd (opendir: Permission denied) 2023-09-30T17:04:34.395 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 66 root cwd unknown /proc/66/cwd (readlink: Permission denied) 2023-09-30T17:04:34.395 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 66 root rtd unknown /proc/66/root (readlink: Permission denied) 2023-09-30T17:04:34.395 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 66 root txt unknown /proc/66/exe (readlink: Permission denied) 2023-09-30T17:04:34.395 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 66 root NOFD /proc/66/fd (opendir: Permission denied) 2023-09-30T17:04:34.395 INFO:tasks.workunit.client.0.smithi007.stdout:kdevtmpfs 67 root cwd unknown /proc/67/cwd (readlink: Permission denied) 2023-09-30T17:04:34.395 INFO:tasks.workunit.client.0.smithi007.stdout:kdevtmpfs 67 root rtd unknown /proc/67/root (readlink: Permission denied) 2023-09-30T17:04:34.395 INFO:tasks.workunit.client.0.smithi007.stdout:kdevtmpfs 67 root txt unknown /proc/67/exe (readlink: Permission denied) 2023-09-30T17:04:34.395 INFO:tasks.workunit.client.0.smithi007.stdout:kdevtmpfs 67 root NOFD /proc/67/fd (opendir: Permission denied) 2023-09-30T17:04:34.395 INFO:tasks.workunit.client.0.smithi007.stdout:netns 68 root cwd unknown /proc/68/cwd (readlink: Permission denied) 2023-09-30T17:04:34.395 INFO:tasks.workunit.client.0.smithi007.stdout:netns 68 root rtd unknown /proc/68/root (readlink: Permission denied) 2023-09-30T17:04:34.395 INFO:tasks.workunit.client.0.smithi007.stdout:netns 68 root txt unknown /proc/68/exe (readlink: Permission denied) 2023-09-30T17:04:34.395 INFO:tasks.workunit.client.0.smithi007.stdout:netns 68 root NOFD /proc/68/fd (opendir: Permission denied) 2023-09-30T17:04:34.396 INFO:tasks.workunit.client.0.smithi007.stdout:kauditd 69 root cwd unknown /proc/69/cwd (readlink: Permission denied) 2023-09-30T17:04:34.396 INFO:tasks.workunit.client.0.smithi007.stdout:kauditd 69 root rtd unknown /proc/69/root (readlink: Permission denied) 2023-09-30T17:04:34.396 INFO:tasks.workunit.client.0.smithi007.stdout:kauditd 69 root txt unknown /proc/69/exe (readlink: Permission denied) 2023-09-30T17:04:34.396 INFO:tasks.workunit.client.0.smithi007.stdout:kauditd 69 root NOFD /proc/69/fd (opendir: Permission denied) 2023-09-30T17:04:34.396 INFO:tasks.workunit.client.0.smithi007.stdout:khungtask 70 root cwd unknown /proc/70/cwd (readlink: Permission denied) 2023-09-30T17:04:34.396 INFO:tasks.workunit.client.0.smithi007.stdout:khungtask 70 root rtd unknown /proc/70/root (readlink: Permission denied) 2023-09-30T17:04:34.396 INFO:tasks.workunit.client.0.smithi007.stdout:khungtask 70 root txt unknown /proc/70/exe (readlink: Permission denied) 2023-09-30T17:04:34.396 INFO:tasks.workunit.client.0.smithi007.stdout:khungtask 70 root NOFD /proc/70/fd (opendir: Permission denied) 2023-09-30T17:04:34.396 INFO:tasks.workunit.client.0.smithi007.stdout:oom_reape 71 root cwd unknown /proc/71/cwd (readlink: Permission denied) 2023-09-30T17:04:34.396 INFO:tasks.workunit.client.0.smithi007.stdout:oom_reape 71 root rtd unknown /proc/71/root (readlink: Permission denied) 2023-09-30T17:04:34.396 INFO:tasks.workunit.client.0.smithi007.stdout:oom_reape 71 root txt unknown /proc/71/exe (readlink: Permission denied) 2023-09-30T17:04:34.397 INFO:tasks.workunit.client.0.smithi007.stdout:oom_reape 71 root NOFD /proc/71/fd (opendir: Permission denied) 2023-09-30T17:04:34.397 INFO:tasks.workunit.client.0.smithi007.stdout:writeback 72 root cwd unknown /proc/72/cwd (readlink: Permission denied) 2023-09-30T17:04:34.397 INFO:tasks.workunit.client.0.smithi007.stdout:writeback 72 root rtd unknown /proc/72/root (readlink: Permission denied) 2023-09-30T17:04:34.397 INFO:tasks.workunit.client.0.smithi007.stdout:writeback 72 root txt unknown /proc/72/exe (readlink: Permission denied) 2023-09-30T17:04:34.397 INFO:tasks.workunit.client.0.smithi007.stdout:writeback 72 root NOFD /proc/72/fd (opendir: Permission denied) 2023-09-30T17:04:34.397 INFO:tasks.workunit.client.0.smithi007.stdout:kcompactd 73 root cwd unknown /proc/73/cwd (readlink: Permission denied) 2023-09-30T17:04:34.397 INFO:tasks.workunit.client.0.smithi007.stdout:kcompactd 73 root rtd unknown /proc/73/root (readlink: Permission denied) 2023-09-30T17:04:34.397 INFO:tasks.workunit.client.0.smithi007.stdout:kcompactd 73 root txt unknown /proc/73/exe (readlink: Permission denied) 2023-09-30T17:04:34.397 INFO:tasks.workunit.client.0.smithi007.stdout:kcompactd 73 root NOFD /proc/73/fd (opendir: Permission denied) 2023-09-30T17:04:34.397 INFO:tasks.workunit.client.0.smithi007.stdout:ksmd 74 root cwd unknown /proc/74/cwd (readlink: Permission denied) 2023-09-30T17:04:34.397 INFO:tasks.workunit.client.0.smithi007.stdout:ksmd 74 root rtd unknown /proc/74/root (readlink: Permission denied) 2023-09-30T17:04:34.397 INFO:tasks.workunit.client.0.smithi007.stdout:ksmd 74 root txt unknown /proc/74/exe (readlink: Permission denied) 2023-09-30T17:04:34.397 INFO:tasks.workunit.client.0.smithi007.stdout:ksmd 74 root NOFD /proc/74/fd (opendir: Permission denied) 2023-09-30T17:04:34.398 INFO:tasks.workunit.client.0.smithi007.stdout:khugepage 75 root cwd unknown /proc/75/cwd (readlink: Permission denied) 2023-09-30T17:04:34.398 INFO:tasks.workunit.client.0.smithi007.stdout:khugepage 75 root rtd unknown /proc/75/root (readlink: Permission denied) 2023-09-30T17:04:34.398 INFO:tasks.workunit.client.0.smithi007.stdout:khugepage 75 root txt unknown /proc/75/exe (readlink: Permission denied) 2023-09-30T17:04:34.398 INFO:tasks.workunit.client.0.smithi007.stdout:khugepage 75 root NOFD /proc/75/fd (opendir: Permission denied) 2023-09-30T17:04:34.398 INFO:tasks.workunit.client.0.smithi007.stdout:crypto 76 root cwd unknown /proc/76/cwd (readlink: Permission denied) 2023-09-30T17:04:34.398 INFO:tasks.workunit.client.0.smithi007.stdout:crypto 76 root rtd unknown /proc/76/root (readlink: Permission denied) 2023-09-30T17:04:34.398 INFO:tasks.workunit.client.0.smithi007.stdout:crypto 76 root txt unknown /proc/76/exe (readlink: Permission denied) 2023-09-30T17:04:34.398 INFO:tasks.workunit.client.0.smithi007.stdout:crypto 76 root NOFD /proc/76/fd (opendir: Permission denied) 2023-09-30T17:04:34.398 INFO:tasks.workunit.client.0.smithi007.stdout:kintegrit 77 root cwd unknown /proc/77/cwd (readlink: Permission denied) 2023-09-30T17:04:34.398 INFO:tasks.workunit.client.0.smithi007.stdout:kintegrit 77 root rtd unknown /proc/77/root (readlink: Permission denied) 2023-09-30T17:04:34.398 INFO:tasks.workunit.client.0.smithi007.stdout:kintegrit 77 root txt unknown /proc/77/exe (readlink: Permission denied) 2023-09-30T17:04:34.399 INFO:tasks.workunit.client.0.smithi007.stdout:kintegrit 77 root NOFD /proc/77/fd (opendir: Permission denied) 2023-09-30T17:04:34.399 INFO:tasks.workunit.client.0.smithi007.stdout:kblockd 78 root cwd unknown /proc/78/cwd (readlink: Permission denied) 2023-09-30T17:04:34.399 INFO:tasks.workunit.client.0.smithi007.stdout:kblockd 78 root rtd unknown /proc/78/root (readlink: Permission denied) 2023-09-30T17:04:34.399 INFO:tasks.workunit.client.0.smithi007.stdout:kblockd 78 root txt unknown /proc/78/exe (readlink: Permission denied) 2023-09-30T17:04:34.399 INFO:tasks.workunit.client.0.smithi007.stdout:kblockd 78 root NOFD /proc/78/fd (opendir: Permission denied) 2023-09-30T17:04:34.399 INFO:tasks.workunit.client.0.smithi007.stdout:blkcg_pun 79 root cwd unknown /proc/79/cwd (readlink: Permission denied) 2023-09-30T17:04:34.399 INFO:tasks.workunit.client.0.smithi007.stdout:blkcg_pun 79 root rtd unknown /proc/79/root (readlink: Permission denied) 2023-09-30T17:04:34.399 INFO:tasks.workunit.client.0.smithi007.stdout:blkcg_pun 79 root txt unknown /proc/79/exe (readlink: Permission denied) 2023-09-30T17:04:34.399 INFO:tasks.workunit.client.0.smithi007.stdout:blkcg_pun 79 root NOFD /proc/79/fd (opendir: Permission denied) 2023-09-30T17:04:34.399 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 80 root cwd unknown /proc/80/cwd (readlink: Permission denied) 2023-09-30T17:04:34.399 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 80 root rtd unknown /proc/80/root (readlink: Permission denied) 2023-09-30T17:04:34.399 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 80 root txt unknown /proc/80/exe (readlink: Permission denied) 2023-09-30T17:04:34.400 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 80 root NOFD /proc/80/fd (opendir: Permission denied) 2023-09-30T17:04:34.400 INFO:tasks.workunit.client.0.smithi007.stdout:tpm_dev_w 81 root cwd unknown /proc/81/cwd (readlink: Permission denied) 2023-09-30T17:04:34.400 INFO:tasks.workunit.client.0.smithi007.stdout:tpm_dev_w 81 root rtd unknown /proc/81/root (readlink: Permission denied) 2023-09-30T17:04:34.400 INFO:tasks.workunit.client.0.smithi007.stdout:tpm_dev_w 81 root txt unknown /proc/81/exe (readlink: Permission denied) 2023-09-30T17:04:34.400 INFO:tasks.workunit.client.0.smithi007.stdout:tpm_dev_w 81 root NOFD /proc/81/fd (opendir: Permission denied) 2023-09-30T17:04:34.400 INFO:tasks.workunit.client.0.smithi007.stdout:md 82 root cwd unknown /proc/82/cwd (readlink: Permission denied) 2023-09-30T17:04:34.400 INFO:tasks.workunit.client.0.smithi007.stdout:md 82 root rtd unknown /proc/82/root (readlink: Permission denied) 2023-09-30T17:04:34.400 INFO:tasks.workunit.client.0.smithi007.stdout:md 82 root txt unknown /proc/82/exe (readlink: Permission denied) 2023-09-30T17:04:34.400 INFO:tasks.workunit.client.0.smithi007.stdout:md 82 root NOFD /proc/82/fd (opendir: Permission denied) 2023-09-30T17:04:34.400 INFO:tasks.workunit.client.0.smithi007.stdout:edac-poll 83 root cwd unknown /proc/83/cwd (readlink: Permission denied) 2023-09-30T17:04:34.400 INFO:tasks.workunit.client.0.smithi007.stdout:edac-poll 83 root rtd unknown /proc/83/root (readlink: Permission denied) 2023-09-30T17:04:34.400 INFO:tasks.workunit.client.0.smithi007.stdout:edac-poll 83 root txt unknown /proc/83/exe (readlink: Permission denied) 2023-09-30T17:04:34.401 INFO:tasks.workunit.client.0.smithi007.stdout:edac-poll 83 root NOFD /proc/83/fd (opendir: Permission denied) 2023-09-30T17:04:34.401 INFO:tasks.workunit.client.0.smithi007.stdout:watchdogd 84 root cwd unknown /proc/84/cwd (readlink: Permission denied) 2023-09-30T17:04:34.401 INFO:tasks.workunit.client.0.smithi007.stdout:watchdogd 84 root rtd unknown /proc/84/root (readlink: Permission denied) 2023-09-30T17:04:34.401 INFO:tasks.workunit.client.0.smithi007.stdout:watchdogd 84 root txt unknown /proc/84/exe (readlink: Permission denied) 2023-09-30T17:04:34.401 INFO:tasks.workunit.client.0.smithi007.stdout:watchdogd 84 root NOFD /proc/84/fd (opendir: Permission denied) 2023-09-30T17:04:34.401 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 85 root cwd unknown /proc/85/cwd (readlink: Permission denied) 2023-09-30T17:04:34.401 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 85 root rtd unknown /proc/85/root (readlink: Permission denied) 2023-09-30T17:04:34.401 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 85 root txt unknown /proc/85/exe (readlink: Permission denied) 2023-09-30T17:04:34.401 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 85 root NOFD /proc/85/fd (opendir: Permission denied) 2023-09-30T17:04:34.401 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 91 root cwd unknown /proc/91/cwd (readlink: Permission denied) 2023-09-30T17:04:34.401 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 91 root rtd unknown /proc/91/root (readlink: Permission denied) 2023-09-30T17:04:34.402 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 91 root txt unknown /proc/91/exe (readlink: Permission denied) 2023-09-30T17:04:34.402 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 91 root NOFD /proc/91/fd (opendir: Permission denied) 2023-09-30T17:04:34.402 INFO:tasks.workunit.client.0.smithi007.stdout:kswapd0 121 root cwd unknown /proc/121/cwd (readlink: Permission denied) 2023-09-30T17:04:34.402 INFO:tasks.workunit.client.0.smithi007.stdout:kswapd0 121 root rtd unknown /proc/121/root (readlink: Permission denied) 2023-09-30T17:04:34.402 INFO:tasks.workunit.client.0.smithi007.stdout:kswapd0 121 root txt unknown /proc/121/exe (readlink: Permission denied) 2023-09-30T17:04:34.402 INFO:tasks.workunit.client.0.smithi007.stdout:kswapd0 121 root NOFD /proc/121/fd (opendir: Permission denied) 2023-09-30T17:04:34.402 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 189 root cwd unknown /proc/189/cwd (readlink: Permission denied) 2023-09-30T17:04:34.402 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 189 root rtd unknown /proc/189/root (readlink: Permission denied) 2023-09-30T17:04:34.402 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 189 root txt unknown /proc/189/exe (readlink: Permission denied) 2023-09-30T17:04:34.402 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 189 root NOFD /proc/189/fd (opendir: Permission denied) 2023-09-30T17:04:34.402 INFO:tasks.workunit.client.0.smithi007.stdout:kthrotld 224 root cwd unknown /proc/224/cwd (readlink: Permission denied) 2023-09-30T17:04:34.402 INFO:tasks.workunit.client.0.smithi007.stdout:kthrotld 224 root rtd unknown /proc/224/root (readlink: Permission denied) 2023-09-30T17:04:34.403 INFO:tasks.workunit.client.0.smithi007.stdout:kthrotld 224 root txt unknown /proc/224/exe (readlink: Permission denied) 2023-09-30T17:04:34.403 INFO:tasks.workunit.client.0.smithi007.stdout:kthrotld 224 root NOFD /proc/224/fd (opendir: Permission denied) 2023-09-30T17:04:34.403 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 226 root cwd unknown /proc/226/cwd (readlink: Permission denied) 2023-09-30T17:04:34.403 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 226 root rtd unknown /proc/226/root (readlink: Permission denied) 2023-09-30T17:04:34.403 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 226 root txt unknown /proc/226/exe (readlink: Permission denied) 2023-09-30T17:04:34.403 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 226 root NOFD /proc/226/fd (opendir: Permission denied) 2023-09-30T17:04:34.403 INFO:tasks.workunit.client.0.smithi007.stdout:acpi_ther 227 root cwd unknown /proc/227/cwd (readlink: Permission denied) 2023-09-30T17:04:34.403 INFO:tasks.workunit.client.0.smithi007.stdout:acpi_ther 227 root rtd unknown /proc/227/root (readlink: Permission denied) 2023-09-30T17:04:34.403 INFO:tasks.workunit.client.0.smithi007.stdout:acpi_ther 227 root txt unknown /proc/227/exe (readlink: Permission denied) 2023-09-30T17:04:34.403 INFO:tasks.workunit.client.0.smithi007.stdout:acpi_ther 227 root NOFD /proc/227/fd (opendir: Permission denied) 2023-09-30T17:04:34.403 INFO:tasks.workunit.client.0.smithi007.stdout:kmpath_rd 229 root cwd unknown /proc/229/cwd (readlink: Permission denied) 2023-09-30T17:04:34.404 INFO:tasks.workunit.client.0.smithi007.stdout:kmpath_rd 229 root rtd unknown /proc/229/root (readlink: Permission denied) 2023-09-30T17:04:34.404 INFO:tasks.workunit.client.0.smithi007.stdout:kmpath_rd 229 root txt unknown /proc/229/exe (readlink: Permission denied) 2023-09-30T17:04:34.404 INFO:tasks.workunit.client.0.smithi007.stdout:kmpath_rd 229 root NOFD /proc/229/fd (opendir: Permission denied) 2023-09-30T17:04:34.404 INFO:tasks.workunit.client.0.smithi007.stdout:kaluad 230 root cwd unknown /proc/230/cwd (readlink: Permission denied) 2023-09-30T17:04:34.404 INFO:tasks.workunit.client.0.smithi007.stdout:kaluad 230 root rtd unknown /proc/230/root (readlink: Permission denied) 2023-09-30T17:04:34.404 INFO:tasks.workunit.client.0.smithi007.stdout:kaluad 230 root txt unknown /proc/230/exe (readlink: Permission denied) 2023-09-30T17:04:34.404 INFO:tasks.workunit.client.0.smithi007.stdout:kaluad 230 root NOFD /proc/230/fd (opendir: Permission denied) 2023-09-30T17:04:34.404 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 232 root cwd unknown /proc/232/cwd (readlink: Permission denied) 2023-09-30T17:04:34.404 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 232 root rtd unknown /proc/232/root (readlink: Permission denied) 2023-09-30T17:04:34.404 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 232 root txt unknown /proc/232/exe (readlink: Permission denied) 2023-09-30T17:04:34.404 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 232 root NOFD /proc/232/fd (opendir: Permission denied) 2023-09-30T17:04:34.404 INFO:tasks.workunit.client.0.smithi007.stdout:ipv6_addr 233 root cwd unknown /proc/233/cwd (readlink: Permission denied) 2023-09-30T17:04:34.405 INFO:tasks.workunit.client.0.smithi007.stdout:ipv6_addr 233 root rtd unknown /proc/233/root (readlink: Permission denied) 2023-09-30T17:04:34.405 INFO:tasks.workunit.client.0.smithi007.stdout:ipv6_addr 233 root txt unknown /proc/233/exe (readlink: Permission denied) 2023-09-30T17:04:34.405 INFO:tasks.workunit.client.0.smithi007.stdout:ipv6_addr 233 root NOFD /proc/233/fd (opendir: Permission denied) 2023-09-30T17:04:34.405 INFO:tasks.workunit.client.0.smithi007.stdout:kstrp 234 root cwd unknown /proc/234/cwd (readlink: Permission denied) 2023-09-30T17:04:34.405 INFO:tasks.workunit.client.0.smithi007.stdout:kstrp 234 root rtd unknown /proc/234/root (readlink: Permission denied) 2023-09-30T17:04:34.405 INFO:tasks.workunit.client.0.smithi007.stdout:kstrp 234 root txt unknown /proc/234/exe (readlink: Permission denied) 2023-09-30T17:04:34.405 INFO:tasks.workunit.client.0.smithi007.stdout:kstrp 234 root NOFD /proc/234/fd (opendir: Permission denied) 2023-09-30T17:04:34.405 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 316 root cwd unknown /proc/316/cwd (readlink: Permission denied) 2023-09-30T17:04:34.405 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 316 root rtd unknown /proc/316/root (readlink: Permission denied) 2023-09-30T17:04:34.405 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 316 root txt unknown /proc/316/exe (readlink: Permission denied) 2023-09-30T17:04:34.405 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 316 root NOFD /proc/316/fd (opendir: Permission denied) 2023-09-30T17:04:34.405 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 322 root cwd unknown /proc/322/cwd (readlink: Permission denied) 2023-09-30T17:04:34.406 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 322 root rtd unknown /proc/322/root (readlink: Permission denied) 2023-09-30T17:04:34.406 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 322 root txt unknown /proc/322/exe (readlink: Permission denied) 2023-09-30T17:04:34.406 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 322 root NOFD /proc/322/fd (opendir: Permission denied) 2023-09-30T17:04:34.406 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 350 root cwd unknown /proc/350/cwd (readlink: Permission denied) 2023-09-30T17:04:34.406 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 350 root rtd unknown /proc/350/root (readlink: Permission denied) 2023-09-30T17:04:34.406 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 350 root txt unknown /proc/350/exe (readlink: Permission denied) 2023-09-30T17:04:34.406 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 350 root NOFD /proc/350/fd (opendir: Permission denied) 2023-09-30T17:04:34.406 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 354 root cwd unknown /proc/354/cwd (readlink: Permission denied) 2023-09-30T17:04:34.406 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 354 root rtd unknown /proc/354/root (readlink: Permission denied) 2023-09-30T17:04:34.406 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 354 root txt unknown /proc/354/exe (readlink: Permission denied) 2023-09-30T17:04:34.406 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 354 root NOFD /proc/354/fd (opendir: Permission denied) 2023-09-30T17:04:34.407 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 387 root cwd unknown /proc/387/cwd (readlink: Permission denied) 2023-09-30T17:04:34.407 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 387 root rtd unknown /proc/387/root (readlink: Permission denied) 2023-09-30T17:04:34.407 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 387 root txt unknown /proc/387/exe (readlink: Permission denied) 2023-09-30T17:04:34.407 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 387 root NOFD /proc/387/fd (opendir: Permission denied) 2023-09-30T17:04:34.407 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 454 root cwd unknown /proc/454/cwd (readlink: Permission denied) 2023-09-30T17:04:34.407 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 454 root rtd unknown /proc/454/root (readlink: Permission denied) 2023-09-30T17:04:34.407 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 454 root txt unknown /proc/454/exe (readlink: Permission denied) 2023-09-30T17:04:34.407 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 454 root NOFD /proc/454/fd (opendir: Permission denied) 2023-09-30T17:04:34.407 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 464 root cwd unknown /proc/464/cwd (readlink: Permission denied) 2023-09-30T17:04:34.407 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 464 root rtd unknown /proc/464/root (readlink: Permission denied) 2023-09-30T17:04:34.407 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 464 root txt unknown /proc/464/exe (readlink: Permission denied) 2023-09-30T17:04:34.407 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 464 root NOFD /proc/464/fd (opendir: Permission denied) 2023-09-30T17:04:34.408 INFO:tasks.workunit.client.0.smithi007.stdout:nvme-wq 493 root cwd unknown /proc/493/cwd (readlink: Permission denied) 2023-09-30T17:04:34.408 INFO:tasks.workunit.client.0.smithi007.stdout:nvme-wq 493 root rtd unknown /proc/493/root (readlink: Permission denied) 2023-09-30T17:04:34.408 INFO:tasks.workunit.client.0.smithi007.stdout:nvme-wq 493 root txt unknown /proc/493/exe (readlink: Permission denied) 2023-09-30T17:04:34.408 INFO:tasks.workunit.client.0.smithi007.stdout:nvme-wq 493 root NOFD /proc/493/fd (opendir: Permission denied) 2023-09-30T17:04:34.408 INFO:tasks.workunit.client.0.smithi007.stdout:nvme-rese 494 root cwd unknown /proc/494/cwd (readlink: Permission denied) 2023-09-30T17:04:34.408 INFO:tasks.workunit.client.0.smithi007.stdout:nvme-rese 494 root rtd unknown /proc/494/root (readlink: Permission denied) 2023-09-30T17:04:34.408 INFO:tasks.workunit.client.0.smithi007.stdout:nvme-rese 494 root txt unknown /proc/494/exe (readlink: Permission denied) 2023-09-30T17:04:34.408 INFO:tasks.workunit.client.0.smithi007.stdout:nvme-rese 494 root NOFD /proc/494/fd (opendir: Permission denied) 2023-09-30T17:04:34.408 INFO:tasks.workunit.client.0.smithi007.stdout:nvme-dele 495 root cwd unknown /proc/495/cwd (readlink: Permission denied) 2023-09-30T17:04:34.408 INFO:tasks.workunit.client.0.smithi007.stdout:nvme-dele 495 root rtd unknown /proc/495/root (readlink: Permission denied) 2023-09-30T17:04:34.408 INFO:tasks.workunit.client.0.smithi007.stdout:nvme-dele 495 root txt unknown /proc/495/exe (readlink: Permission denied) 2023-09-30T17:04:34.408 INFO:tasks.workunit.client.0.smithi007.stdout:nvme-dele 495 root NOFD /proc/495/fd (opendir: Permission denied) 2023-09-30T17:04:34.409 INFO:tasks.workunit.client.0.smithi007.stdout:ata_sff 496 root cwd unknown /proc/496/cwd (readlink: Permission denied) 2023-09-30T17:04:34.409 INFO:tasks.workunit.client.0.smithi007.stdout:ata_sff 496 root rtd unknown /proc/496/root (readlink: Permission denied) 2023-09-30T17:04:34.409 INFO:tasks.workunit.client.0.smithi007.stdout:ata_sff 496 root txt unknown /proc/496/exe (readlink: Permission denied) 2023-09-30T17:04:34.409 INFO:tasks.workunit.client.0.smithi007.stdout:ata_sff 496 root NOFD /proc/496/fd (opendir: Permission denied) 2023-09-30T17:04:34.409 INFO:tasks.workunit.client.0.smithi007.stdout:ixgbe 508 root cwd unknown /proc/508/cwd (readlink: Permission denied) 2023-09-30T17:04:34.409 INFO:tasks.workunit.client.0.smithi007.stdout:ixgbe 508 root rtd unknown /proc/508/root (readlink: Permission denied) 2023-09-30T17:04:34.409 INFO:tasks.workunit.client.0.smithi007.stdout:ixgbe 508 root txt unknown /proc/508/exe (readlink: Permission denied) 2023-09-30T17:04:34.409 INFO:tasks.workunit.client.0.smithi007.stdout:ixgbe 508 root NOFD /proc/508/fd (opendir: Permission denied) 2023-09-30T17:04:34.409 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_0 511 root cwd unknown /proc/511/cwd (readlink: Permission denied) 2023-09-30T17:04:34.409 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_0 511 root rtd unknown /proc/511/root (readlink: Permission denied) 2023-09-30T17:04:34.409 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_0 511 root txt unknown /proc/511/exe (readlink: Permission denied) 2023-09-30T17:04:34.409 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_0 511 root NOFD /proc/511/fd (opendir: Permission denied) 2023-09-30T17:04:34.410 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_tmf_ 512 root cwd unknown /proc/512/cwd (readlink: Permission denied) 2023-09-30T17:04:34.410 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_tmf_ 512 root rtd unknown /proc/512/root (readlink: Permission denied) 2023-09-30T17:04:34.410 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_tmf_ 512 root txt unknown /proc/512/exe (readlink: Permission denied) 2023-09-30T17:04:34.410 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_tmf_ 512 root NOFD /proc/512/fd (opendir: Permission denied) 2023-09-30T17:04:34.410 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_1 514 root cwd unknown /proc/514/cwd (readlink: Permission denied) 2023-09-30T17:04:34.410 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_1 514 root rtd unknown /proc/514/root (readlink: Permission denied) 2023-09-30T17:04:34.410 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_1 514 root txt unknown /proc/514/exe (readlink: Permission denied) 2023-09-30T17:04:34.410 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_1 514 root NOFD /proc/514/fd (opendir: Permission denied) 2023-09-30T17:04:34.410 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_tmf_ 515 root cwd unknown /proc/515/cwd (readlink: Permission denied) 2023-09-30T17:04:34.410 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_tmf_ 515 root rtd unknown /proc/515/root (readlink: Permission denied) 2023-09-30T17:04:34.410 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_tmf_ 515 root txt unknown /proc/515/exe (readlink: Permission denied) 2023-09-30T17:04:34.410 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_tmf_ 515 root NOFD /proc/515/fd (opendir: Permission denied) 2023-09-30T17:04:34.411 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_2 516 root cwd unknown /proc/516/cwd (readlink: Permission denied) 2023-09-30T17:04:34.411 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_2 516 root rtd unknown /proc/516/root (readlink: Permission denied) 2023-09-30T17:04:34.411 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_2 516 root txt unknown /proc/516/exe (readlink: Permission denied) 2023-09-30T17:04:34.411 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_2 516 root NOFD /proc/516/fd (opendir: Permission denied) 2023-09-30T17:04:34.411 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_tmf_ 517 root cwd unknown /proc/517/cwd (readlink: Permission denied) 2023-09-30T17:04:34.411 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_tmf_ 517 root rtd unknown /proc/517/root (readlink: Permission denied) 2023-09-30T17:04:34.411 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_tmf_ 517 root txt unknown /proc/517/exe (readlink: Permission denied) 2023-09-30T17:04:34.411 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_tmf_ 517 root NOFD /proc/517/fd (opendir: Permission denied) 2023-09-30T17:04:34.411 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_3 518 root cwd unknown /proc/518/cwd (readlink: Permission denied) 2023-09-30T17:04:34.411 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_3 518 root rtd unknown /proc/518/root (readlink: Permission denied) 2023-09-30T17:04:34.411 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_3 518 root txt unknown /proc/518/exe (readlink: Permission denied) 2023-09-30T17:04:34.411 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_3 518 root NOFD /proc/518/fd (opendir: Permission denied) 2023-09-30T17:04:34.412 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_tmf_ 519 root cwd unknown /proc/519/cwd (readlink: Permission denied) 2023-09-30T17:04:34.412 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_tmf_ 519 root rtd unknown /proc/519/root (readlink: Permission denied) 2023-09-30T17:04:34.412 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_tmf_ 519 root txt unknown /proc/519/exe (readlink: Permission denied) 2023-09-30T17:04:34.412 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_tmf_ 519 root NOFD /proc/519/fd (opendir: Permission denied) 2023-09-30T17:04:34.412 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_4 522 root cwd unknown /proc/522/cwd (readlink: Permission denied) 2023-09-30T17:04:34.412 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_4 522 root rtd unknown /proc/522/root (readlink: Permission denied) 2023-09-30T17:04:34.412 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_4 522 root txt unknown /proc/522/exe (readlink: Permission denied) 2023-09-30T17:04:34.412 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_4 522 root NOFD /proc/522/fd (opendir: Permission denied) 2023-09-30T17:04:34.412 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_tmf_ 523 root cwd unknown /proc/523/cwd (readlink: Permission denied) 2023-09-30T17:04:34.412 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_tmf_ 523 root rtd unknown /proc/523/root (readlink: Permission denied) 2023-09-30T17:04:34.412 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_tmf_ 523 root txt unknown /proc/523/exe (readlink: Permission denied) 2023-09-30T17:04:34.412 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_tmf_ 523 root NOFD /proc/523/fd (opendir: Permission denied) 2023-09-30T17:04:34.413 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_5 524 root cwd unknown /proc/524/cwd (readlink: Permission denied) 2023-09-30T17:04:34.413 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_5 524 root rtd unknown /proc/524/root (readlink: Permission denied) 2023-09-30T17:04:34.413 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_5 524 root txt unknown /proc/524/exe (readlink: Permission denied) 2023-09-30T17:04:34.413 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_5 524 root NOFD /proc/524/fd (opendir: Permission denied) 2023-09-30T17:04:34.413 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_tmf_ 525 root cwd unknown /proc/525/cwd (readlink: Permission denied) 2023-09-30T17:04:34.413 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_tmf_ 525 root rtd unknown /proc/525/root (readlink: Permission denied) 2023-09-30T17:04:34.413 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_tmf_ 525 root txt unknown /proc/525/exe (readlink: Permission denied) 2023-09-30T17:04:34.413 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_tmf_ 525 root NOFD /proc/525/fd (opendir: Permission denied) 2023-09-30T17:04:34.413 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_6 526 root cwd unknown /proc/526/cwd (readlink: Permission denied) 2023-09-30T17:04:34.413 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_6 526 root rtd unknown /proc/526/root (readlink: Permission denied) 2023-09-30T17:04:34.413 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_6 526 root txt unknown /proc/526/exe (readlink: Permission denied) 2023-09-30T17:04:34.413 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_6 526 root NOFD /proc/526/fd (opendir: Permission denied) 2023-09-30T17:04:34.414 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_tmf_ 527 root cwd unknown /proc/527/cwd (readlink: Permission denied) 2023-09-30T17:04:34.414 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_tmf_ 527 root rtd unknown /proc/527/root (readlink: Permission denied) 2023-09-30T17:04:34.414 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_tmf_ 527 root txt unknown /proc/527/exe (readlink: Permission denied) 2023-09-30T17:04:34.414 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_tmf_ 527 root NOFD /proc/527/fd (opendir: Permission denied) 2023-09-30T17:04:34.414 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_7 528 root cwd unknown /proc/528/cwd (readlink: Permission denied) 2023-09-30T17:04:34.414 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_7 528 root rtd unknown /proc/528/root (readlink: Permission denied) 2023-09-30T17:04:34.414 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_7 528 root txt unknown /proc/528/exe (readlink: Permission denied) 2023-09-30T17:04:34.414 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_7 528 root NOFD /proc/528/fd (opendir: Permission denied) 2023-09-30T17:04:34.414 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_tmf_ 529 root cwd unknown /proc/529/cwd (readlink: Permission denied) 2023-09-30T17:04:34.414 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_tmf_ 529 root rtd unknown /proc/529/root (readlink: Permission denied) 2023-09-30T17:04:34.414 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_tmf_ 529 root txt unknown /proc/529/exe (readlink: Permission denied) 2023-09-30T17:04:34.414 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_tmf_ 529 root NOFD /proc/529/fd (opendir: Permission denied) 2023-09-30T17:04:34.415 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_8 530 root cwd unknown /proc/530/cwd (readlink: Permission denied) 2023-09-30T17:04:34.415 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_8 530 root rtd unknown /proc/530/root (readlink: Permission denied) 2023-09-30T17:04:34.415 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_8 530 root txt unknown /proc/530/exe (readlink: Permission denied) 2023-09-30T17:04:34.415 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_8 530 root NOFD /proc/530/fd (opendir: Permission denied) 2023-09-30T17:04:34.415 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_tmf_ 531 root cwd unknown /proc/531/cwd (readlink: Permission denied) 2023-09-30T17:04:34.415 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_tmf_ 531 root rtd unknown /proc/531/root (readlink: Permission denied) 2023-09-30T17:04:34.415 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_tmf_ 531 root txt unknown /proc/531/exe (readlink: Permission denied) 2023-09-30T17:04:34.415 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_tmf_ 531 root NOFD /proc/531/fd (opendir: Permission denied) 2023-09-30T17:04:34.415 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_9 532 root cwd unknown /proc/532/cwd (readlink: Permission denied) 2023-09-30T17:04:34.415 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_9 532 root rtd unknown /proc/532/root (readlink: Permission denied) 2023-09-30T17:04:34.415 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_9 532 root txt unknown /proc/532/exe (readlink: Permission denied) 2023-09-30T17:04:34.416 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_eh_9 532 root NOFD /proc/532/fd (opendir: Permission denied) 2023-09-30T17:04:34.416 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_tmf_ 533 root cwd unknown /proc/533/cwd (readlink: Permission denied) 2023-09-30T17:04:34.416 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_tmf_ 533 root rtd unknown /proc/533/root (readlink: Permission denied) 2023-09-30T17:04:34.416 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_tmf_ 533 root txt unknown /proc/533/exe (readlink: Permission denied) 2023-09-30T17:04:34.416 INFO:tasks.workunit.client.0.smithi007.stdout:scsi_tmf_ 533 root NOFD /proc/533/fd (opendir: Permission denied) 2023-09-30T17:04:34.416 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 534 root cwd unknown /proc/534/cwd (readlink: Permission denied) 2023-09-30T17:04:34.416 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 534 root rtd unknown /proc/534/root (readlink: Permission denied) 2023-09-30T17:04:34.416 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 534 root txt unknown /proc/534/exe (readlink: Permission denied) 2023-09-30T17:04:34.416 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 534 root NOFD /proc/534/fd (opendir: Permission denied) 2023-09-30T17:04:34.416 INFO:tasks.workunit.client.0.smithi007.stdout:jbd2/sda1 564 root cwd unknown /proc/564/cwd (readlink: Permission denied) 2023-09-30T17:04:34.416 INFO:tasks.workunit.client.0.smithi007.stdout:jbd2/sda1 564 root rtd unknown /proc/564/root (readlink: Permission denied) 2023-09-30T17:04:34.416 INFO:tasks.workunit.client.0.smithi007.stdout:jbd2/sda1 564 root txt unknown /proc/564/exe (readlink: Permission denied) 2023-09-30T17:04:34.417 INFO:tasks.workunit.client.0.smithi007.stdout:jbd2/sda1 564 root NOFD /proc/564/fd (opendir: Permission denied) 2023-09-30T17:04:34.417 INFO:tasks.workunit.client.0.smithi007.stdout:ext4-rsv- 565 root cwd unknown /proc/565/cwd (readlink: Permission denied) 2023-09-30T17:04:34.417 INFO:tasks.workunit.client.0.smithi007.stdout:ext4-rsv- 565 root rtd unknown /proc/565/root (readlink: Permission denied) 2023-09-30T17:04:34.417 INFO:tasks.workunit.client.0.smithi007.stdout:ext4-rsv- 565 root txt unknown /proc/565/exe (readlink: Permission denied) 2023-09-30T17:04:34.417 INFO:tasks.workunit.client.0.smithi007.stdout:ext4-rsv- 565 root NOFD /proc/565/fd (opendir: Permission denied) 2023-09-30T17:04:34.417 INFO:tasks.workunit.client.0.smithi007.stdout:systemd-j 659 root cwd unknown /proc/659/cwd (readlink: Permission denied) 2023-09-30T17:04:34.417 INFO:tasks.workunit.client.0.smithi007.stdout:systemd-j 659 root rtd unknown /proc/659/root (readlink: Permission denied) 2023-09-30T17:04:34.417 INFO:tasks.workunit.client.0.smithi007.stdout:systemd-j 659 root txt unknown /proc/659/exe (readlink: Permission denied) 2023-09-30T17:04:34.417 INFO:tasks.workunit.client.0.smithi007.stdout:systemd-j 659 root NOFD /proc/659/fd (opendir: Permission denied) 2023-09-30T17:04:34.417 INFO:tasks.workunit.client.0.smithi007.stdout:ext4lazyi 675 root cwd unknown /proc/675/cwd (readlink: Permission denied) 2023-09-30T17:04:34.417 INFO:tasks.workunit.client.0.smithi007.stdout:ext4lazyi 675 root rtd unknown /proc/675/root (readlink: Permission denied) 2023-09-30T17:04:34.417 INFO:tasks.workunit.client.0.smithi007.stdout:ext4lazyi 675 root txt unknown /proc/675/exe (readlink: Permission denied) 2023-09-30T17:04:34.418 INFO:tasks.workunit.client.0.smithi007.stdout:ext4lazyi 675 root NOFD /proc/675/fd (opendir: Permission denied) 2023-09-30T17:04:34.418 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 695 root cwd unknown /proc/695/cwd (readlink: Permission denied) 2023-09-30T17:04:34.418 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 695 root rtd unknown /proc/695/root (readlink: Permission denied) 2023-09-30T17:04:34.418 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 695 root txt unknown /proc/695/exe (readlink: Permission denied) 2023-09-30T17:04:34.418 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 695 root NOFD /proc/695/fd (opendir: Permission denied) 2023-09-30T17:04:34.418 INFO:tasks.workunit.client.0.smithi007.stdout:systemd-u 700 root cwd unknown /proc/700/cwd (readlink: Permission denied) 2023-09-30T17:04:34.418 INFO:tasks.workunit.client.0.smithi007.stdout:systemd-u 700 root rtd unknown /proc/700/root (readlink: Permission denied) 2023-09-30T17:04:34.418 INFO:tasks.workunit.client.0.smithi007.stdout:systemd-u 700 root txt unknown /proc/700/exe (readlink: Permission denied) 2023-09-30T17:04:34.418 INFO:tasks.workunit.client.0.smithi007.stdout:systemd-u 700 root NOFD /proc/700/fd (opendir: Permission denied) 2023-09-30T17:04:34.418 INFO:tasks.workunit.client.0.smithi007.stdout:rpcbind 724 rpc cwd unknown /proc/724/cwd (readlink: Permission denied) 2023-09-30T17:04:34.418 INFO:tasks.workunit.client.0.smithi007.stdout:rpcbind 724 rpc rtd unknown /proc/724/root (readlink: Permission denied) 2023-09-30T17:04:34.418 INFO:tasks.workunit.client.0.smithi007.stdout:rpcbind 724 rpc txt unknown /proc/724/exe (readlink: Permission denied) 2023-09-30T17:04:34.419 INFO:tasks.workunit.client.0.smithi007.stdout:rpcbind 724 rpc NOFD /proc/724/fd (opendir: Permission denied) 2023-09-30T17:04:34.419 INFO:tasks.workunit.client.0.smithi007.stdout:auditd 725 root cwd unknown /proc/725/cwd (readlink: Permission denied) 2023-09-30T17:04:34.419 INFO:tasks.workunit.client.0.smithi007.stdout:auditd 725 root rtd unknown /proc/725/root (readlink: Permission denied) 2023-09-30T17:04:34.419 INFO:tasks.workunit.client.0.smithi007.stdout:auditd 725 root txt unknown /proc/725/exe (readlink: Permission denied) 2023-09-30T17:04:34.419 INFO:tasks.workunit.client.0.smithi007.stdout:auditd 725 root NOFD /proc/725/fd (opendir: Permission denied) 2023-09-30T17:04:34.419 INFO:tasks.workunit.client.0.smithi007.stdout:auditd 725 727 auditd root cwd unknown /proc/725/task/727/cwd (readlink: Permission denied) 2023-09-30T17:04:34.419 INFO:tasks.workunit.client.0.smithi007.stdout:auditd 725 727 auditd root rtd unknown /proc/725/task/727/root (readlink: Permission denied) 2023-09-30T17:04:34.419 INFO:tasks.workunit.client.0.smithi007.stdout:auditd 725 727 auditd root txt unknown /proc/725/task/727/exe (readlink: Permission denied) 2023-09-30T17:04:34.419 INFO:tasks.workunit.client.0.smithi007.stdout:auditd 725 727 auditd root NOFD /proc/725/task/727/fd (opendir: Permission denied) 2023-09-30T17:04:34.419 INFO:tasks.workunit.client.0.smithi007.stdout:auditd 725 739 auditd root cwd unknown /proc/725/task/739/cwd (readlink: Permission denied) 2023-09-30T17:04:34.419 INFO:tasks.workunit.client.0.smithi007.stdout:auditd 725 739 auditd root rtd unknown /proc/725/task/739/root (readlink: Permission denied) 2023-09-30T17:04:34.420 INFO:tasks.workunit.client.0.smithi007.stdout:auditd 725 739 auditd root txt unknown /proc/725/task/739/exe (readlink: Permission denied) 2023-09-30T17:04:34.420 INFO:tasks.workunit.client.0.smithi007.stdout:auditd 725 739 auditd root NOFD /proc/725/task/739/fd (opendir: Permission denied) 2023-09-30T17:04:34.420 INFO:tasks.workunit.client.0.smithi007.stdout:sedispatc 738 root cwd unknown /proc/738/cwd (readlink: Permission denied) 2023-09-30T17:04:34.420 INFO:tasks.workunit.client.0.smithi007.stdout:sedispatc 738 root rtd unknown /proc/738/root (readlink: Permission denied) 2023-09-30T17:04:34.420 INFO:tasks.workunit.client.0.smithi007.stdout:sedispatc 738 root txt unknown /proc/738/exe (readlink: Permission denied) 2023-09-30T17:04:34.420 INFO:tasks.workunit.client.0.smithi007.stdout:sedispatc 738 root NOFD /proc/738/fd (opendir: Permission denied) 2023-09-30T17:04:34.420 INFO:tasks.workunit.client.0.smithi007.stdout:rpciod 744 root cwd unknown /proc/744/cwd (readlink: Permission denied) 2023-09-30T17:04:34.420 INFO:tasks.workunit.client.0.smithi007.stdout:rpciod 744 root rtd unknown /proc/744/root (readlink: Permission denied) 2023-09-30T17:04:34.420 INFO:tasks.workunit.client.0.smithi007.stdout:rpciod 744 root txt unknown /proc/744/exe (readlink: Permission denied) 2023-09-30T17:04:34.420 INFO:tasks.workunit.client.0.smithi007.stdout:rpciod 744 root NOFD /proc/744/fd (opendir: Permission denied) 2023-09-30T17:04:34.420 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 745 root cwd unknown /proc/745/cwd (readlink: Permission denied) 2023-09-30T17:04:34.420 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 745 root rtd unknown /proc/745/root (readlink: Permission denied) 2023-09-30T17:04:34.421 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 745 root txt unknown /proc/745/exe (readlink: Permission denied) 2023-09-30T17:04:34.421 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 745 root NOFD /proc/745/fd (opendir: Permission denied) 2023-09-30T17:04:34.421 INFO:tasks.workunit.client.0.smithi007.stdout:xprtiod 746 root cwd unknown /proc/746/cwd (readlink: Permission denied) 2023-09-30T17:04:34.421 INFO:tasks.workunit.client.0.smithi007.stdout:xprtiod 746 root rtd unknown /proc/746/root (readlink: Permission denied) 2023-09-30T17:04:34.421 INFO:tasks.workunit.client.0.smithi007.stdout:xprtiod 746 root txt unknown /proc/746/exe (readlink: Permission denied) 2023-09-30T17:04:34.421 INFO:tasks.workunit.client.0.smithi007.stdout:xprtiod 746 root NOFD /proc/746/fd (opendir: Permission denied) 2023-09-30T17:04:34.421 INFO:tasks.workunit.client.0.smithi007.stdout:irqbalanc 777 root cwd unknown /proc/777/cwd (readlink: Permission denied) 2023-09-30T17:04:34.421 INFO:tasks.workunit.client.0.smithi007.stdout:irqbalanc 777 root rtd unknown /proc/777/root (readlink: Permission denied) 2023-09-30T17:04:34.421 INFO:tasks.workunit.client.0.smithi007.stdout:irqbalanc 777 root txt unknown /proc/777/exe (readlink: Permission denied) 2023-09-30T17:04:34.421 INFO:tasks.workunit.client.0.smithi007.stdout:irqbalanc 777 root NOFD /proc/777/fd (opendir: Permission denied) 2023-09-30T17:04:34.421 INFO:tasks.workunit.client.0.smithi007.stdout:irqbalanc 777 840 gmain root cwd unknown /proc/777/task/840/cwd (readlink: Permission denied) 2023-09-30T17:04:34.421 INFO:tasks.workunit.client.0.smithi007.stdout:irqbalanc 777 840 gmain root rtd unknown /proc/777/task/840/root (readlink: Permission denied) 2023-09-30T17:04:34.422 INFO:tasks.workunit.client.0.smithi007.stdout:irqbalanc 777 840 gmain root txt unknown /proc/777/task/840/exe (readlink: Permission denied) 2023-09-30T17:04:34.422 INFO:tasks.workunit.client.0.smithi007.stdout:irqbalanc 777 840 gmain root NOFD /proc/777/task/840/fd (opendir: Permission denied) 2023-09-30T17:04:34.422 INFO:tasks.workunit.client.0.smithi007.stdout:lsmd 780 libstoragemgmt cwd unknown /proc/780/cwd (readlink: Permission denied) 2023-09-30T17:04:34.422 INFO:tasks.workunit.client.0.smithi007.stdout:lsmd 780 libstoragemgmt rtd unknown /proc/780/root (readlink: Permission denied) 2023-09-30T17:04:34.422 INFO:tasks.workunit.client.0.smithi007.stdout:lsmd 780 libstoragemgmt txt unknown /proc/780/exe (readlink: Permission denied) 2023-09-30T17:04:34.422 INFO:tasks.workunit.client.0.smithi007.stdout:lsmd 780 libstoragemgmt NOFD /proc/780/fd (opendir: Permission denied) 2023-09-30T17:04:34.422 INFO:tasks.workunit.client.0.smithi007.stdout:mcelog 781 root cwd unknown /proc/781/cwd (readlink: Permission denied) 2023-09-30T17:04:34.422 INFO:tasks.workunit.client.0.smithi007.stdout:mcelog 781 root rtd unknown /proc/781/root (readlink: Permission denied) 2023-09-30T17:04:34.422 INFO:tasks.workunit.client.0.smithi007.stdout:mcelog 781 root txt unknown /proc/781/exe (readlink: Permission denied) 2023-09-30T17:04:34.422 INFO:tasks.workunit.client.0.smithi007.stdout:mcelog 781 root NOFD /proc/781/fd (opendir: Permission denied) 2023-09-30T17:04:34.422 INFO:tasks.workunit.client.0.smithi007.stdout:avahi-dae 782 avahi cwd unknown /proc/782/cwd (readlink: Permission denied) 2023-09-30T17:04:34.422 INFO:tasks.workunit.client.0.smithi007.stdout:avahi-dae 782 avahi rtd unknown /proc/782/root (readlink: Permission denied) 2023-09-30T17:04:34.423 INFO:tasks.workunit.client.0.smithi007.stdout:avahi-dae 782 avahi txt unknown /proc/782/exe (readlink: Permission denied) 2023-09-30T17:04:34.423 INFO:tasks.workunit.client.0.smithi007.stdout:avahi-dae 782 avahi NOFD /proc/782/fd (opendir: Permission denied) 2023-09-30T17:04:34.423 INFO:tasks.workunit.client.0.smithi007.stdout:sssd 784 root cwd unknown /proc/784/cwd (readlink: Permission denied) 2023-09-30T17:04:34.423 INFO:tasks.workunit.client.0.smithi007.stdout:sssd 784 root rtd unknown /proc/784/root (readlink: Permission denied) 2023-09-30T17:04:34.423 INFO:tasks.workunit.client.0.smithi007.stdout:sssd 784 root txt unknown /proc/784/exe (readlink: Permission denied) 2023-09-30T17:04:34.423 INFO:tasks.workunit.client.0.smithi007.stdout:sssd 784 root NOFD /proc/784/fd (opendir: Permission denied) 2023-09-30T17:04:34.423 INFO:tasks.workunit.client.0.smithi007.stdout:dbus-daem 786 dbus cwd unknown /proc/786/cwd (readlink: Permission denied) 2023-09-30T17:04:34.423 INFO:tasks.workunit.client.0.smithi007.stdout:dbus-daem 786 dbus rtd unknown /proc/786/root (readlink: Permission denied) 2023-09-30T17:04:34.423 INFO:tasks.workunit.client.0.smithi007.stdout:dbus-daem 786 dbus txt unknown /proc/786/exe (readlink: Permission denied) 2023-09-30T17:04:34.423 INFO:tasks.workunit.client.0.smithi007.stdout:dbus-daem 786 dbus NOFD /proc/786/fd (opendir: Permission denied) 2023-09-30T17:04:34.423 INFO:tasks.workunit.client.0.smithi007.stdout:dbus-daem 786 855 dbus-daem dbus cwd unknown /proc/786/task/855/cwd (readlink: Permission denied) 2023-09-30T17:04:34.423 INFO:tasks.workunit.client.0.smithi007.stdout:dbus-daem 786 855 dbus-daem dbus rtd unknown /proc/786/task/855/root (readlink: Permission denied) 2023-09-30T17:04:34.424 INFO:tasks.workunit.client.0.smithi007.stdout:dbus-daem 786 855 dbus-daem dbus txt unknown /proc/786/task/855/exe (readlink: Permission denied) 2023-09-30T17:04:34.424 INFO:tasks.workunit.client.0.smithi007.stdout:dbus-daem 786 855 dbus-daem dbus NOFD /proc/786/task/855/fd (opendir: Permission denied) 2023-09-30T17:04:34.424 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 787 polkitd cwd unknown /proc/787/cwd (readlink: Permission denied) 2023-09-30T17:04:34.424 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 787 polkitd rtd unknown /proc/787/root (readlink: Permission denied) 2023-09-30T17:04:34.424 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 787 polkitd txt unknown /proc/787/exe (readlink: Permission denied) 2023-09-30T17:04:34.424 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 787 polkitd NOFD /proc/787/fd (opendir: Permission denied) 2023-09-30T17:04:34.424 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 787 868 gmain polkitd cwd unknown /proc/787/task/868/cwd (readlink: Permission denied) 2023-09-30T17:04:34.424 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 787 868 gmain polkitd rtd unknown /proc/787/task/868/root (readlink: Permission denied) 2023-09-30T17:04:34.424 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 787 868 gmain polkitd txt unknown /proc/787/task/868/exe (readlink: Permission denied) 2023-09-30T17:04:34.424 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 787 868 gmain polkitd NOFD /proc/787/task/868/fd (opendir: Permission denied) 2023-09-30T17:04:34.424 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 787 870 gdbus polkitd cwd unknown /proc/787/task/870/cwd (readlink: Permission denied) 2023-09-30T17:04:34.425 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 787 870 gdbus polkitd rtd unknown /proc/787/task/870/root (readlink: Permission denied) 2023-09-30T17:04:34.425 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 787 870 gdbus polkitd txt unknown /proc/787/task/870/exe (readlink: Permission denied) 2023-09-30T17:04:34.425 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 787 870 gdbus polkitd NOFD /proc/787/task/870/fd (opendir: Permission denied) 2023-09-30T17:04:34.425 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 787 875 JS\x20Hel polkitd cwd unknown /proc/787/task/875/cwd (readlink: Permission denied) 2023-09-30T17:04:34.425 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 787 875 JS\x20Hel polkitd rtd unknown /proc/787/task/875/root (readlink: Permission denied) 2023-09-30T17:04:34.425 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 787 875 JS\x20Hel polkitd txt unknown /proc/787/task/875/exe (readlink: Permission denied) 2023-09-30T17:04:34.425 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 787 875 JS\x20Hel polkitd NOFD /proc/787/task/875/fd (opendir: Permission denied) 2023-09-30T17:04:34.425 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 787 876 JS\x20Hel polkitd cwd unknown /proc/787/task/876/cwd (readlink: Permission denied) 2023-09-30T17:04:34.425 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 787 876 JS\x20Hel polkitd rtd unknown /proc/787/task/876/root (readlink: Permission denied) 2023-09-30T17:04:34.425 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 787 876 JS\x20Hel polkitd txt unknown /proc/787/task/876/exe (readlink: Permission denied) 2023-09-30T17:04:34.425 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 787 876 JS\x20Hel polkitd NOFD /proc/787/task/876/fd (opendir: Permission denied) 2023-09-30T17:04:34.425 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 787 877 JS\x20Hel polkitd cwd unknown /proc/787/task/877/cwd (readlink: Permission denied) 2023-09-30T17:04:34.426 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 787 877 JS\x20Hel polkitd rtd unknown /proc/787/task/877/root (readlink: Permission denied) 2023-09-30T17:04:34.426 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 787 877 JS\x20Hel polkitd txt unknown /proc/787/task/877/exe (readlink: Permission denied) 2023-09-30T17:04:34.426 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 787 877 JS\x20Hel polkitd NOFD /proc/787/task/877/fd (opendir: Permission denied) 2023-09-30T17:04:34.426 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 787 878 JS\x20Hel polkitd cwd unknown /proc/787/task/878/cwd (readlink: Permission denied) 2023-09-30T17:04:34.426 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 787 878 JS\x20Hel polkitd rtd unknown /proc/787/task/878/root (readlink: Permission denied) 2023-09-30T17:04:34.426 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 787 878 JS\x20Hel polkitd txt unknown /proc/787/task/878/exe (readlink: Permission denied) 2023-09-30T17:04:34.426 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 787 878 JS\x20Hel polkitd NOFD /proc/787/task/878/fd (opendir: Permission denied) 2023-09-30T17:04:34.426 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 787 879 JS\x20Hel polkitd cwd unknown /proc/787/task/879/cwd (readlink: Permission denied) 2023-09-30T17:04:34.426 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 787 879 JS\x20Hel polkitd rtd unknown /proc/787/task/879/root (readlink: Permission denied) 2023-09-30T17:04:34.426 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 787 879 JS\x20Hel polkitd txt unknown /proc/787/task/879/exe (readlink: Permission denied) 2023-09-30T17:04:34.426 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 787 879 JS\x20Hel polkitd NOFD /proc/787/task/879/fd (opendir: Permission denied) 2023-09-30T17:04:34.427 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 787 880 JS\x20Hel polkitd cwd unknown /proc/787/task/880/cwd (readlink: Permission denied) 2023-09-30T17:04:34.427 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 787 880 JS\x20Hel polkitd rtd unknown /proc/787/task/880/root (readlink: Permission denied) 2023-09-30T17:04:34.427 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 787 880 JS\x20Hel polkitd txt unknown /proc/787/task/880/exe (readlink: Permission denied) 2023-09-30T17:04:34.427 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 787 880 JS\x20Hel polkitd NOFD /proc/787/task/880/fd (opendir: Permission denied) 2023-09-30T17:04:34.427 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 787 881 JS\x20Hel polkitd cwd unknown /proc/787/task/881/cwd (readlink: Permission denied) 2023-09-30T17:04:34.427 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 787 881 JS\x20Hel polkitd rtd unknown /proc/787/task/881/root (readlink: Permission denied) 2023-09-30T17:04:34.427 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 787 881 JS\x20Hel polkitd txt unknown /proc/787/task/881/exe (readlink: Permission denied) 2023-09-30T17:04:34.427 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 787 881 JS\x20Hel polkitd NOFD /proc/787/task/881/fd (opendir: Permission denied) 2023-09-30T17:04:34.427 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 787 882 JS\x20Hel polkitd cwd unknown /proc/787/task/882/cwd (readlink: Permission denied) 2023-09-30T17:04:34.427 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 787 882 JS\x20Hel polkitd rtd unknown /proc/787/task/882/root (readlink: Permission denied) 2023-09-30T17:04:34.427 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 787 882 JS\x20Hel polkitd txt unknown /proc/787/task/882/exe (readlink: Permission denied) 2023-09-30T17:04:34.428 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 787 882 JS\x20Hel polkitd NOFD /proc/787/task/882/fd (opendir: Permission denied) 2023-09-30T17:04:34.428 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 787 890 polkitd polkitd cwd unknown /proc/787/task/890/cwd (readlink: Permission denied) 2023-09-30T17:04:34.428 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 787 890 polkitd polkitd rtd unknown /proc/787/task/890/root (readlink: Permission denied) 2023-09-30T17:04:34.428 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 787 890 polkitd polkitd txt unknown /proc/787/task/890/exe (readlink: Permission denied) 2023-09-30T17:04:34.428 INFO:tasks.workunit.client.0.smithi007.stdout:polkitd 787 890 polkitd polkitd NOFD /proc/787/task/890/fd (opendir: Permission denied) 2023-09-30T17:04:34.428 INFO:tasks.workunit.client.0.smithi007.stdout:NetworkMa 788 root cwd unknown /proc/788/cwd (readlink: Permission denied) 2023-09-30T17:04:34.428 INFO:tasks.workunit.client.0.smithi007.stdout:NetworkMa 788 root rtd unknown /proc/788/root (readlink: Permission denied) 2023-09-30T17:04:34.428 INFO:tasks.workunit.client.0.smithi007.stdout:NetworkMa 788 root txt unknown /proc/788/exe (readlink: Permission denied) 2023-09-30T17:04:34.428 INFO:tasks.workunit.client.0.smithi007.stdout:NetworkMa 788 root NOFD /proc/788/fd (opendir: Permission denied) 2023-09-30T17:04:34.428 INFO:tasks.workunit.client.0.smithi007.stdout:NetworkMa 788 860 gmain root cwd unknown /proc/788/task/860/cwd (readlink: Permission denied) 2023-09-30T17:04:34.428 INFO:tasks.workunit.client.0.smithi007.stdout:NetworkMa 788 860 gmain root rtd unknown /proc/788/task/860/root (readlink: Permission denied) 2023-09-30T17:04:34.428 INFO:tasks.workunit.client.0.smithi007.stdout:NetworkMa 788 860 gmain root txt unknown /proc/788/task/860/exe (readlink: Permission denied) 2023-09-30T17:04:34.429 INFO:tasks.workunit.client.0.smithi007.stdout:NetworkMa 788 860 gmain root NOFD /proc/788/task/860/fd (opendir: Permission denied) 2023-09-30T17:04:34.429 INFO:tasks.workunit.client.0.smithi007.stdout:NetworkMa 788 861 gdbus root cwd unknown /proc/788/task/861/cwd (readlink: Permission denied) 2023-09-30T17:04:34.429 INFO:tasks.workunit.client.0.smithi007.stdout:NetworkMa 788 861 gdbus root rtd unknown /proc/788/task/861/root (readlink: Permission denied) 2023-09-30T17:04:34.429 INFO:tasks.workunit.client.0.smithi007.stdout:NetworkMa 788 861 gdbus root txt unknown /proc/788/task/861/exe (readlink: Permission denied) 2023-09-30T17:04:34.429 INFO:tasks.workunit.client.0.smithi007.stdout:NetworkMa 788 861 gdbus root NOFD /proc/788/task/861/fd (opendir: Permission denied) 2023-09-30T17:04:34.429 INFO:tasks.workunit.client.0.smithi007.stdout:smartd 791 root cwd unknown /proc/791/cwd (readlink: Permission denied) 2023-09-30T17:04:34.429 INFO:tasks.workunit.client.0.smithi007.stdout:smartd 791 root rtd unknown /proc/791/root (readlink: Permission denied) 2023-09-30T17:04:34.429 INFO:tasks.workunit.client.0.smithi007.stdout:smartd 791 root txt unknown /proc/791/exe (readlink: Permission denied) 2023-09-30T17:04:34.429 INFO:tasks.workunit.client.0.smithi007.stdout:smartd 791 root NOFD /proc/791/fd (opendir: Permission denied) 2023-09-30T17:04:34.429 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 797 root cwd unknown /proc/797/cwd (readlink: Permission denied) 2023-09-30T17:04:34.429 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 797 root rtd unknown /proc/797/root (readlink: Permission denied) 2023-09-30T17:04:34.430 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 797 root txt unknown /proc/797/exe (readlink: Permission denied) 2023-09-30T17:04:34.430 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 797 root NOFD /proc/797/fd (opendir: Permission denied) 2023-09-30T17:04:34.430 INFO:tasks.workunit.client.0.smithi007.stdout:ksmtuned 798 root cwd unknown /proc/798/cwd (readlink: Permission denied) 2023-09-30T17:04:34.430 INFO:tasks.workunit.client.0.smithi007.stdout:ksmtuned 798 root rtd unknown /proc/798/root (readlink: Permission denied) 2023-09-30T17:04:34.430 INFO:tasks.workunit.client.0.smithi007.stdout:ksmtuned 798 root txt unknown /proc/798/exe (readlink: Permission denied) 2023-09-30T17:04:34.430 INFO:tasks.workunit.client.0.smithi007.stdout:ksmtuned 798 root NOFD /proc/798/fd (opendir: Permission denied) 2023-09-30T17:04:34.430 INFO:tasks.workunit.client.0.smithi007.stdout:avahi-dae 857 avahi cwd unknown /proc/857/cwd (readlink: Permission denied) 2023-09-30T17:04:34.430 INFO:tasks.workunit.client.0.smithi007.stdout:avahi-dae 857 avahi rtd unknown /proc/857/root (readlink: Permission denied) 2023-09-30T17:04:34.430 INFO:tasks.workunit.client.0.smithi007.stdout:avahi-dae 857 avahi txt unknown /proc/857/exe (readlink: Permission denied) 2023-09-30T17:04:34.430 INFO:tasks.workunit.client.0.smithi007.stdout:avahi-dae 857 avahi NOFD /proc/857/fd (opendir: Permission denied) 2023-09-30T17:04:34.430 INFO:tasks.workunit.client.0.smithi007.stdout:tuned 863 root cwd unknown /proc/863/cwd (readlink: Permission denied) 2023-09-30T17:04:34.430 INFO:tasks.workunit.client.0.smithi007.stdout:tuned 863 root rtd unknown /proc/863/root (readlink: Permission denied) 2023-09-30T17:04:34.431 INFO:tasks.workunit.client.0.smithi007.stdout:tuned 863 root txt unknown /proc/863/exe (readlink: Permission denied) 2023-09-30T17:04:34.431 INFO:tasks.workunit.client.0.smithi007.stdout:tuned 863 root NOFD /proc/863/fd (opendir: Permission denied) 2023-09-30T17:04:34.431 INFO:tasks.workunit.client.0.smithi007.stdout:tuned 863 1126 tuned root cwd unknown /proc/863/task/1126/cwd (readlink: Permission denied) 2023-09-30T17:04:34.431 INFO:tasks.workunit.client.0.smithi007.stdout:tuned 863 1126 tuned root rtd unknown /proc/863/task/1126/root (readlink: Permission denied) 2023-09-30T17:04:34.431 INFO:tasks.workunit.client.0.smithi007.stdout:tuned 863 1126 tuned root txt unknown /proc/863/task/1126/exe (readlink: Permission denied) 2023-09-30T17:04:34.431 INFO:tasks.workunit.client.0.smithi007.stdout:tuned 863 1126 tuned root NOFD /proc/863/task/1126/fd (opendir: Permission denied) 2023-09-30T17:04:34.431 INFO:tasks.workunit.client.0.smithi007.stdout:tuned 863 1132 tuned root cwd unknown /proc/863/task/1132/cwd (readlink: Permission denied) 2023-09-30T17:04:34.431 INFO:tasks.workunit.client.0.smithi007.stdout:tuned 863 1132 tuned root rtd unknown /proc/863/task/1132/root (readlink: Permission denied) 2023-09-30T17:04:34.431 INFO:tasks.workunit.client.0.smithi007.stdout:tuned 863 1132 tuned root txt unknown /proc/863/task/1132/exe (readlink: Permission denied) 2023-09-30T17:04:34.431 INFO:tasks.workunit.client.0.smithi007.stdout:tuned 863 1132 tuned root NOFD /proc/863/task/1132/fd (opendir: Permission denied) 2023-09-30T17:04:34.431 INFO:tasks.workunit.client.0.smithi007.stdout:tuned 863 1154 tuned root cwd unknown /proc/863/task/1154/cwd (readlink: Permission denied) 2023-09-30T17:04:34.431 INFO:tasks.workunit.client.0.smithi007.stdout:tuned 863 1154 tuned root rtd unknown /proc/863/task/1154/root (readlink: Permission denied) 2023-09-30T17:04:34.432 INFO:tasks.workunit.client.0.smithi007.stdout:tuned 863 1154 tuned root txt unknown /proc/863/task/1154/exe (readlink: Permission denied) 2023-09-30T17:04:34.432 INFO:tasks.workunit.client.0.smithi007.stdout:tuned 863 1154 tuned root NOFD /proc/863/task/1154/fd (opendir: Permission denied) 2023-09-30T17:04:34.432 INFO:tasks.workunit.client.0.smithi007.stdout:tuned 863 1155 tuned root cwd unknown /proc/863/task/1155/cwd (readlink: Permission denied) 2023-09-30T17:04:34.432 INFO:tasks.workunit.client.0.smithi007.stdout:tuned 863 1155 tuned root rtd unknown /proc/863/task/1155/root (readlink: Permission denied) 2023-09-30T17:04:34.432 INFO:tasks.workunit.client.0.smithi007.stdout:tuned 863 1155 tuned root txt unknown /proc/863/task/1155/exe (readlink: Permission denied) 2023-09-30T17:04:34.432 INFO:tasks.workunit.client.0.smithi007.stdout:tuned 863 1155 tuned root NOFD /proc/863/task/1155/fd (opendir: Permission denied) 2023-09-30T17:04:34.432 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 864 root cwd unknown /proc/864/cwd (readlink: Permission denied) 2023-09-30T17:04:34.432 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 864 root rtd unknown /proc/864/root (readlink: Permission denied) 2023-09-30T17:04:34.432 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 864 root txt unknown /proc/864/exe (readlink: Permission denied) 2023-09-30T17:04:34.432 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 864 root NOFD /proc/864/fd (opendir: Permission denied) 2023-09-30T17:04:34.432 INFO:tasks.workunit.client.0.smithi007.stdout:rhsmcertd 867 root cwd unknown /proc/867/cwd (readlink: Permission denied) 2023-09-30T17:04:34.433 INFO:tasks.workunit.client.0.smithi007.stdout:rhsmcertd 867 root rtd unknown /proc/867/root (readlink: Permission denied) 2023-09-30T17:04:34.433 INFO:tasks.workunit.client.0.smithi007.stdout:rhsmcertd 867 root txt unknown /proc/867/exe (readlink: Permission denied) 2023-09-30T17:04:34.433 INFO:tasks.workunit.client.0.smithi007.stdout:rhsmcertd 867 root NOFD /proc/867/fd (opendir: Permission denied) 2023-09-30T17:04:34.433 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 883 root cwd unknown /proc/883/cwd (readlink: Permission denied) 2023-09-30T17:04:34.433 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 883 root rtd unknown /proc/883/root (readlink: Permission denied) 2023-09-30T17:04:34.433 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 883 root txt unknown /proc/883/exe (readlink: Permission denied) 2023-09-30T17:04:34.433 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 883 root NOFD /proc/883/fd (opendir: Permission denied) 2023-09-30T17:04:34.433 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 883 885 gssproxy root cwd unknown /proc/883/task/885/cwd (readlink: Permission denied) 2023-09-30T17:04:34.433 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 883 885 gssproxy root rtd unknown /proc/883/task/885/root (readlink: Permission denied) 2023-09-30T17:04:34.433 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 883 885 gssproxy root txt unknown /proc/883/task/885/exe (readlink: Permission denied) 2023-09-30T17:04:34.433 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 883 885 gssproxy root NOFD /proc/883/task/885/fd (opendir: Permission denied) 2023-09-30T17:04:34.434 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 883 886 gssproxy root cwd unknown /proc/883/task/886/cwd (readlink: Permission denied) 2023-09-30T17:04:34.434 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 883 886 gssproxy root rtd unknown /proc/883/task/886/root (readlink: Permission denied) 2023-09-30T17:04:34.434 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 883 886 gssproxy root txt unknown /proc/883/task/886/exe (readlink: Permission denied) 2023-09-30T17:04:34.434 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 883 886 gssproxy root NOFD /proc/883/task/886/fd (opendir: Permission denied) 2023-09-30T17:04:34.434 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 883 887 gssproxy root cwd unknown /proc/883/task/887/cwd (readlink: Permission denied) 2023-09-30T17:04:34.434 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 883 887 gssproxy root rtd unknown /proc/883/task/887/root (readlink: Permission denied) 2023-09-30T17:04:34.434 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 883 887 gssproxy root txt unknown /proc/883/task/887/exe (readlink: Permission denied) 2023-09-30T17:04:34.434 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 883 887 gssproxy root NOFD /proc/883/task/887/fd (opendir: Permission denied) 2023-09-30T17:04:34.434 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 883 888 gssproxy root cwd unknown /proc/883/task/888/cwd (readlink: Permission denied) 2023-09-30T17:04:34.434 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 883 888 gssproxy root rtd unknown /proc/883/task/888/root (readlink: Permission denied) 2023-09-30T17:04:34.434 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 883 888 gssproxy root txt unknown /proc/883/task/888/exe (readlink: Permission denied) 2023-09-30T17:04:34.434 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 883 888 gssproxy root NOFD /proc/883/task/888/fd (opendir: Permission denied) 2023-09-30T17:04:34.435 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 883 889 gssproxy root cwd unknown /proc/883/task/889/cwd (readlink: Permission denied) 2023-09-30T17:04:34.435 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 883 889 gssproxy root rtd unknown /proc/883/task/889/root (readlink: Permission denied) 2023-09-30T17:04:34.435 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 883 889 gssproxy root txt unknown /proc/883/task/889/exe (readlink: Permission denied) 2023-09-30T17:04:34.435 INFO:tasks.workunit.client.0.smithi007.stdout:gssproxy 883 889 gssproxy root NOFD /proc/883/task/889/fd (opendir: Permission denied) 2023-09-30T17:04:34.435 INFO:tasks.workunit.client.0.smithi007.stdout:sssd_be 898 root cwd unknown /proc/898/cwd (readlink: Permission denied) 2023-09-30T17:04:34.435 INFO:tasks.workunit.client.0.smithi007.stdout:sssd_be 898 root rtd unknown /proc/898/root (readlink: Permission denied) 2023-09-30T17:04:34.435 INFO:tasks.workunit.client.0.smithi007.stdout:sssd_be 898 root txt unknown /proc/898/exe (readlink: Permission denied) 2023-09-30T17:04:34.435 INFO:tasks.workunit.client.0.smithi007.stdout:sssd_be 898 root NOFD /proc/898/fd (opendir: Permission denied) 2023-09-30T17:04:34.435 INFO:tasks.workunit.client.0.smithi007.stdout:sssd_nss 899 root cwd unknown /proc/899/cwd (readlink: Permission denied) 2023-09-30T17:04:34.435 INFO:tasks.workunit.client.0.smithi007.stdout:sssd_nss 899 root rtd unknown /proc/899/root (readlink: Permission denied) 2023-09-30T17:04:34.435 INFO:tasks.workunit.client.0.smithi007.stdout:sssd_nss 899 root txt unknown /proc/899/exe (readlink: Permission denied) 2023-09-30T17:04:34.436 INFO:tasks.workunit.client.0.smithi007.stdout:sssd_nss 899 root NOFD /proc/899/fd (opendir: Permission denied) 2023-09-30T17:04:34.436 INFO:tasks.workunit.client.0.smithi007.stdout:kipmi0 901 root cwd unknown /proc/901/cwd (readlink: Permission denied) 2023-09-30T17:04:34.436 INFO:tasks.workunit.client.0.smithi007.stdout:kipmi0 901 root rtd unknown /proc/901/root (readlink: Permission denied) 2023-09-30T17:04:34.436 INFO:tasks.workunit.client.0.smithi007.stdout:kipmi0 901 root txt unknown /proc/901/exe (readlink: Permission denied) 2023-09-30T17:04:34.436 INFO:tasks.workunit.client.0.smithi007.stdout:kipmi0 901 root NOFD /proc/901/fd (opendir: Permission denied) 2023-09-30T17:04:34.436 INFO:tasks.workunit.client.0.smithi007.stdout:cupsd 916 root cwd unknown /proc/916/cwd (readlink: Permission denied) 2023-09-30T17:04:34.436 INFO:tasks.workunit.client.0.smithi007.stdout:cupsd 916 root rtd unknown /proc/916/root (readlink: Permission denied) 2023-09-30T17:04:34.436 INFO:tasks.workunit.client.0.smithi007.stdout:cupsd 916 root txt unknown /proc/916/exe (readlink: Permission denied) 2023-09-30T17:04:34.436 INFO:tasks.workunit.client.0.smithi007.stdout:cupsd 916 root NOFD /proc/916/fd (opendir: Permission denied) 2023-09-30T17:04:34.436 INFO:tasks.workunit.client.0.smithi007.stdout:systemd-l 917 root cwd unknown /proc/917/cwd (readlink: Permission denied) 2023-09-30T17:04:34.436 INFO:tasks.workunit.client.0.smithi007.stdout:systemd-l 917 root rtd unknown /proc/917/root (readlink: Permission denied) 2023-09-30T17:04:34.436 INFO:tasks.workunit.client.0.smithi007.stdout:systemd-l 917 root txt unknown /proc/917/exe (readlink: Permission denied) 2023-09-30T17:04:34.437 INFO:tasks.workunit.client.0.smithi007.stdout:systemd-l 917 root NOFD /proc/917/fd (opendir: Permission denied) 2023-09-30T17:04:34.437 INFO:tasks.workunit.client.0.smithi007.stdout:atd 924 root cwd unknown /proc/924/cwd (readlink: Permission denied) 2023-09-30T17:04:34.437 INFO:tasks.workunit.client.0.smithi007.stdout:atd 924 root rtd unknown /proc/924/root (readlink: Permission denied) 2023-09-30T17:04:34.437 INFO:tasks.workunit.client.0.smithi007.stdout:atd 924 root txt unknown /proc/924/exe (readlink: Permission denied) 2023-09-30T17:04:34.437 INFO:tasks.workunit.client.0.smithi007.stdout:atd 924 root NOFD /proc/924/fd (opendir: Permission denied) 2023-09-30T17:04:34.437 INFO:tasks.workunit.client.0.smithi007.stdout:crond 928 root cwd unknown /proc/928/cwd (readlink: Permission denied) 2023-09-30T17:04:34.437 INFO:tasks.workunit.client.0.smithi007.stdout:crond 928 root rtd unknown /proc/928/root (readlink: Permission denied) 2023-09-30T17:04:34.437 INFO:tasks.workunit.client.0.smithi007.stdout:crond 928 root txt unknown /proc/928/exe (readlink: Permission denied) 2023-09-30T17:04:34.437 INFO:tasks.workunit.client.0.smithi007.stdout:crond 928 root NOFD /proc/928/fd (opendir: Permission denied) 2023-09-30T17:04:34.437 INFO:tasks.workunit.client.0.smithi007.stdout:nrpe 1196 nrpe cwd unknown /proc/1196/cwd (readlink: Permission denied) 2023-09-30T17:04:34.437 INFO:tasks.workunit.client.0.smithi007.stdout:nrpe 1196 nrpe rtd unknown /proc/1196/root (readlink: Permission denied) 2023-09-30T17:04:34.438 INFO:tasks.workunit.client.0.smithi007.stdout:nrpe 1196 nrpe txt unknown /proc/1196/exe (readlink: Permission denied) 2023-09-30T17:04:34.438 INFO:tasks.workunit.client.0.smithi007.stdout:nrpe 1196 nrpe NOFD /proc/1196/fd (opendir: Permission denied) 2023-09-30T17:04:34.438 INFO:tasks.workunit.client.0.smithi007.stdout:agetty 1587 root cwd unknown /proc/1587/cwd (readlink: Permission denied) 2023-09-30T17:04:34.438 INFO:tasks.workunit.client.0.smithi007.stdout:agetty 1587 root rtd unknown /proc/1587/root (readlink: Permission denied) 2023-09-30T17:04:34.438 INFO:tasks.workunit.client.0.smithi007.stdout:agetty 1587 root txt unknown /proc/1587/exe (readlink: Permission denied) 2023-09-30T17:04:34.438 INFO:tasks.workunit.client.0.smithi007.stdout:agetty 1587 root NOFD /proc/1587/fd (opendir: Permission denied) 2023-09-30T17:04:34.438 INFO:tasks.workunit.client.0.smithi007.stdout:agetty 1588 root cwd unknown /proc/1588/cwd (readlink: Permission denied) 2023-09-30T17:04:34.438 INFO:tasks.workunit.client.0.smithi007.stdout:agetty 1588 root rtd unknown /proc/1588/root (readlink: Permission denied) 2023-09-30T17:04:34.438 INFO:tasks.workunit.client.0.smithi007.stdout:agetty 1588 root txt unknown /proc/1588/exe (readlink: Permission denied) 2023-09-30T17:04:34.438 INFO:tasks.workunit.client.0.smithi007.stdout:agetty 1588 root NOFD /proc/1588/fd (opendir: Permission denied) 2023-09-30T17:04:34.438 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 1590 root cwd unknown /proc/1590/cwd (readlink: Permission denied) 2023-09-30T17:04:34.439 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 1590 root rtd unknown /proc/1590/root (readlink: Permission denied) 2023-09-30T17:04:34.439 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 1590 root txt unknown /proc/1590/exe (readlink: Permission denied) 2023-09-30T17:04:34.439 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 1590 root NOFD /proc/1590/fd (opendir: Permission denied) 2023-09-30T17:04:34.439 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu cwd DIR 8,1 4096 2 / 2023-09-30T17:04:34.439 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu rtd DIR 8,1 4096 2 / 2023-09-30T17:04:34.439 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu txt REG 8,1 1601312 8116 /usr/lib/systemd/systemd 2023-09-30T17:04:34.439 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu mem REG 8,1 1598808 4990 /usr/lib64/libm-2.28.so 2023-09-30T17:04:34.439 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu mem REG 8,1 636728 7241 /usr/lib64/libudev.so.1.6.11 2023-09-30T17:04:34.439 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu mem REG 8,1 735192 5135 /usr/lib64/libsepol.so.1 2023-09-30T17:04:34.439 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu mem REG 8,1 1760264 5233 /usr/lib64/libunistring.so.2.1.0 2023-09-30T17:04:34.439 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu mem REG 8,1 144392 5211 /usr/lib64/libgpg-error.so.0.24.2 2023-09-30T17:04:34.439 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu mem REG 8,1 66912 5393 /usr/lib64/libjson-c.so.4.0.0 2023-09-30T17:04:34.440 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu mem REG 8,1 371240 32501 /usr/lib64/libdevmapper.so.1.02 2023-09-30T17:04:34.440 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu mem REG 8,1 26192 5300 /usr/lib64/libattr.so.1.1.2448 2023-09-30T17:04:34.440 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-09-30T17:04:34.440 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu mem REG 8,1 615704 7319 /usr/lib64/libssl.so.1.1.1k 2023-09-30T17:04:34.440 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-09-30T17:04:34.440 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu mem REG 8,1 24928 5395 /usr/lib64/libcap-ng.so.0.0.0 2023-09-30T17:04:34.440 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu mem REG 8,1 33464 5201 /usr/lib64/libuuid.so.1.3.0 2023-09-30T17:04:34.440 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-09-30T17:04:34.440 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-09-30T17:04:34.440 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu mem REG 8,1 343600 7310 /usr/lib64/libblkid.so.1.1.0 2023-09-30T17:04:34.440 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu mem REG 8,1 119760 5600 /usr/lib64/liblz4.so.1.8.3 2023-09-30T17:04:34.440 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu mem REG 8,1 192016 5178 /usr/lib64/liblzma.so.5.2.4 2023-09-30T17:04:34.441 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu mem REG 8,1 162224 5403 /usr/lib64/libidn2.so.0.3.6 2023-09-30T17:04:34.441 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu mem REG 8,1 1187328 5434 /usr/lib64/libgcrypt.so.20.2.5 2023-09-30T17:04:34.441 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu mem REG 8,1 526360 7346 /usr/lib64/libcryptsetup.so.12.6.0 2023-09-30T17:04:34.441 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu mem REG 8,1 54816 5302 /usr/lib64/libacl.so.1.1.2253 2023-09-30T17:04:34.441 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu mem REG 8,1 33752 5190 /usr/lib64/libcap.so.2.48 2023-09-30T17:04:34.441 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-09-30T17:04:34.441 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-09-30T17:04:34.441 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu mem REG 8,1 99672 6510 /usr/lib64/libgcc_s-8-20210514.so.1 2023-09-30T17:04:34.441 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu mem REG 8,1 100200 7343 /usr/lib64/libkmod.so.2.3.3 2023-09-30T17:04:34.441 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu mem REG 8,1 135792 5397 /usr/lib64/libaudit.so.1.0.0 2023-09-30T17:04:34.441 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu mem REG 8,1 66504 7485 /usr/lib64/libpam.so.0.84.2 2023-09-30T17:04:34.441 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu mem REG 8,1 371408 7117 /usr/lib64/libmount.so.1.1.0 2023-09-30T17:04:34.441 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-09-30T17:04:34.442 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu mem REG 8,1 128784 5906 /usr/lib64/libseccomp.so.2.5.2 2023-09-30T17:04:34.442 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-09-30T17:04:34.442 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu mem REG 8,1 2740672 8111 /usr/lib/systemd/libsystemd-shared-239.so 2023-09-30T17:04:34.442 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-09-30T17:04:34.442 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu 0r CHR 1,3 0t0 2051 /dev/null 2023-09-30T17:04:34.442 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu 1u unix 0x0000000000000000 0t0 27521 type=STREAM 2023-09-30T17:04:34.442 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu 2u unix 0x0000000000000000 0t0 27521 type=STREAM 2023-09-30T17:04:34.442 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu 3u unix 0x0000000000000000 0t0 27538 type=DGRAM 2023-09-30T17:04:34.442 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu 4u a_inode 0,14 0 11463 [eventpoll] 2023-09-30T17:04:34.442 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu 5u a_inode 0,14 0 11463 [signalfd] 2023-09-30T17:04:34.442 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu 6r DIR 0,26 0 888 /sys/fs/cgroup/systemd/user.slice/user-1000.slice/user@1000.service 2023-09-30T17:04:34.443 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu 7u a_inode 0,14 0 11463 [timerfd] 2023-09-30T17:04:34.443 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu 8u netlink 0t0 27545 KOBJECT_UEVENT 2023-09-30T17:04:34.443 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu 9u a_inode 0,14 0 11463 [eventpoll] 2023-09-30T17:04:34.443 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu 10r a_inode 0,14 0 11463 inotify 2023-09-30T17:04:34.443 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu 11u unix 0x0000000000000000 0t0 27563 /run/user/1000/bus type=STREAM 2023-09-30T17:04:34.443 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu 12r REG 0,5 0 27550 /proc/1839/mountinfo 2023-09-30T17:04:34.443 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu 13r a_inode 0,14 0 11463 inotify 2023-09-30T17:04:34.443 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu 14r REG 0,5 0 4026532074 /proc/swaps 2023-09-30T17:04:34.443 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu 15u unix 0x0000000000000000 0t0 27551 /run/user/1000/systemd/notify type=DGRAM 2023-09-30T17:04:34.443 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu 16u unix 0x0000000000000000 0t0 27553 type=DGRAM 2023-09-30T17:04:34.443 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu 17u unix 0x0000000000000000 0t0 27554 type=DGRAM 2023-09-30T17:04:34.444 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu 18u unix 0x0000000000000000 0t0 27555 /run/user/1000/systemd/private type=STREAM 2023-09-30T17:04:34.444 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu 19u unix 0x0000000000000000 0t0 27557 type=STREAM 2023-09-30T17:04:34.444 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu 20u a_inode 0,14 0 11463 [timerfd] 2023-09-30T17:04:34.444 INFO:tasks.workunit.client.0.smithi007.stdout:systemd 1839 ubuntu 26u netlink 0t0 27566 SELINUX 2023-09-30T17:04:34.444 INFO:tasks.workunit.client.0.smithi007.stdout:(sd-pam) 1842 ubuntu cwd unknown /proc/1842/cwd (readlink: Permission denied) 2023-09-30T17:04:34.444 INFO:tasks.workunit.client.0.smithi007.stdout:(sd-pam) 1842 ubuntu rtd unknown /proc/1842/root (readlink: Permission denied) 2023-09-30T17:04:34.444 INFO:tasks.workunit.client.0.smithi007.stdout:(sd-pam) 1842 ubuntu txt unknown /proc/1842/exe (readlink: Permission denied) 2023-09-30T17:04:34.444 INFO:tasks.workunit.client.0.smithi007.stdout:(sd-pam) 1842 ubuntu NOFD /proc/1842/fd (opendir: Permission denied) 2023-09-30T17:04:34.444 INFO:tasks.workunit.client.0.smithi007.stdout:rsyslogd 2391 root cwd unknown /proc/2391/cwd (readlink: Permission denied) 2023-09-30T17:04:34.444 INFO:tasks.workunit.client.0.smithi007.stdout:rsyslogd 2391 root rtd unknown /proc/2391/root (readlink: Permission denied) 2023-09-30T17:04:34.444 INFO:tasks.workunit.client.0.smithi007.stdout:rsyslogd 2391 root txt unknown /proc/2391/exe (readlink: Permission denied) 2023-09-30T17:04:34.444 INFO:tasks.workunit.client.0.smithi007.stdout:rsyslogd 2391 root NOFD /proc/2391/fd (opendir: Permission denied) 2023-09-30T17:04:34.445 INFO:tasks.workunit.client.0.smithi007.stdout:rsyslogd 2391 2393 in:imjour root cwd unknown /proc/2391/task/2393/cwd (readlink: Permission denied) 2023-09-30T17:04:34.445 INFO:tasks.workunit.client.0.smithi007.stdout:rsyslogd 2391 2393 in:imjour root rtd unknown /proc/2391/task/2393/root (readlink: Permission denied) 2023-09-30T17:04:34.445 INFO:tasks.workunit.client.0.smithi007.stdout:rsyslogd 2391 2393 in:imjour root txt unknown /proc/2391/task/2393/exe (readlink: Permission denied) 2023-09-30T17:04:34.445 INFO:tasks.workunit.client.0.smithi007.stdout:rsyslogd 2391 2393 in:imjour root NOFD /proc/2391/task/2393/fd (opendir: Permission denied) 2023-09-30T17:04:34.445 INFO:tasks.workunit.client.0.smithi007.stdout:rsyslogd 2391 2394 rs:main root cwd unknown /proc/2391/task/2394/cwd (readlink: Permission denied) 2023-09-30T17:04:34.445 INFO:tasks.workunit.client.0.smithi007.stdout:rsyslogd 2391 2394 rs:main root rtd unknown /proc/2391/task/2394/root (readlink: Permission denied) 2023-09-30T17:04:34.445 INFO:tasks.workunit.client.0.smithi007.stdout:rsyslogd 2391 2394 rs:main root txt unknown /proc/2391/task/2394/exe (readlink: Permission denied) 2023-09-30T17:04:34.445 INFO:tasks.workunit.client.0.smithi007.stdout:rsyslogd 2391 2394 rs:main root NOFD /proc/2391/task/2394/fd (opendir: Permission denied) 2023-09-30T17:04:34.445 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 69982 root cwd unknown /proc/69982/cwd (readlink: Permission denied) 2023-09-30T17:04:34.445 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 69982 root rtd unknown /proc/69982/root (readlink: Permission denied) 2023-09-30T17:04:34.445 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 69982 root txt unknown /proc/69982/exe (readlink: Permission denied) 2023-09-30T17:04:34.445 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 69982 root NOFD /proc/69982/fd (opendir: Permission denied) 2023-09-30T17:04:34.446 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 69987 root cwd unknown /proc/69987/cwd (readlink: Permission denied) 2023-09-30T17:04:34.446 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 69987 root rtd unknown /proc/69987/root (readlink: Permission denied) 2023-09-30T17:04:34.446 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 69987 root txt unknown /proc/69987/exe (readlink: Permission denied) 2023-09-30T17:04:34.446 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 69987 root NOFD /proc/69987/fd (opendir: Permission denied) 2023-09-30T17:04:34.446 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 79760 root cwd unknown /proc/79760/cwd (readlink: Permission denied) 2023-09-30T17:04:34.446 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 79760 root rtd unknown /proc/79760/root (readlink: Permission denied) 2023-09-30T17:04:34.446 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 79760 root txt unknown /proc/79760/exe (readlink: Permission denied) 2023-09-30T17:04:34.446 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/4 79760 root NOFD /proc/79760/fd (opendir: Permission denied) 2023-09-30T17:04:34.446 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 80408 root cwd unknown /proc/80408/cwd (readlink: Permission denied) 2023-09-30T17:04:34.446 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 80408 root rtd unknown /proc/80408/root (readlink: Permission denied) 2023-09-30T17:04:34.446 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 80408 root txt unknown /proc/80408/exe (readlink: Permission denied) 2023-09-30T17:04:34.447 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/6 80408 root NOFD /proc/80408/fd (opendir: Permission denied) 2023-09-30T17:04:34.447 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 81556 root cwd unknown /proc/81556/cwd (readlink: Permission denied) 2023-09-30T17:04:34.447 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 81556 root rtd unknown /proc/81556/root (readlink: Permission denied) 2023-09-30T17:04:34.447 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 81556 root txt unknown /proc/81556/exe (readlink: Permission denied) 2023-09-30T17:04:34.447 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 81556 root NOFD /proc/81556/fd (opendir: Permission denied) 2023-09-30T17:04:34.447 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 81701 root cwd unknown /proc/81701/cwd (readlink: Permission denied) 2023-09-30T17:04:34.447 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 81701 root rtd unknown /proc/81701/root (readlink: Permission denied) 2023-09-30T17:04:34.447 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 81701 root txt unknown /proc/81701/exe (readlink: Permission denied) 2023-09-30T17:04:34.447 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/2 81701 root NOFD /proc/81701/fd (opendir: Permission denied) 2023-09-30T17:04:34.447 INFO:tasks.workunit.client.0.smithi007.stdout:kdmflush/ 83778 root cwd unknown /proc/83778/cwd (readlink: Permission denied) 2023-09-30T17:04:34.447 INFO:tasks.workunit.client.0.smithi007.stdout:kdmflush/ 83778 root rtd unknown /proc/83778/root (readlink: Permission denied) 2023-09-30T17:04:34.447 INFO:tasks.workunit.client.0.smithi007.stdout:kdmflush/ 83778 root txt unknown /proc/83778/exe (readlink: Permission denied) 2023-09-30T17:04:34.448 INFO:tasks.workunit.client.0.smithi007.stdout:kdmflush/ 83778 root NOFD /proc/83778/fd (opendir: Permission denied) 2023-09-30T17:04:34.448 INFO:tasks.workunit.client.0.smithi007.stdout:kdmflush/ 83923 root cwd unknown /proc/83923/cwd (readlink: Permission denied) 2023-09-30T17:04:34.448 INFO:tasks.workunit.client.0.smithi007.stdout:kdmflush/ 83923 root rtd unknown /proc/83923/root (readlink: Permission denied) 2023-09-30T17:04:34.448 INFO:tasks.workunit.client.0.smithi007.stdout:kdmflush/ 83923 root txt unknown /proc/83923/exe (readlink: Permission denied) 2023-09-30T17:04:34.448 INFO:tasks.workunit.client.0.smithi007.stdout:kdmflush/ 83923 root NOFD /proc/83923/fd (opendir: Permission denied) 2023-09-30T17:04:34.448 INFO:tasks.workunit.client.0.smithi007.stdout:kdmflush/ 84069 root cwd unknown /proc/84069/cwd (readlink: Permission denied) 2023-09-30T17:04:34.448 INFO:tasks.workunit.client.0.smithi007.stdout:kdmflush/ 84069 root rtd unknown /proc/84069/root (readlink: Permission denied) 2023-09-30T17:04:34.448 INFO:tasks.workunit.client.0.smithi007.stdout:kdmflush/ 84069 root txt unknown /proc/84069/exe (readlink: Permission denied) 2023-09-30T17:04:34.448 INFO:tasks.workunit.client.0.smithi007.stdout:kdmflush/ 84069 root NOFD /proc/84069/fd (opendir: Permission denied) 2023-09-30T17:04:34.448 INFO:tasks.workunit.client.0.smithi007.stdout:kdmflush/ 84215 root cwd unknown /proc/84215/cwd (readlink: Permission denied) 2023-09-30T17:04:34.448 INFO:tasks.workunit.client.0.smithi007.stdout:kdmflush/ 84215 root rtd unknown /proc/84215/root (readlink: Permission denied) 2023-09-30T17:04:34.449 INFO:tasks.workunit.client.0.smithi007.stdout:kdmflush/ 84215 root txt unknown /proc/84215/exe (readlink: Permission denied) 2023-09-30T17:04:34.449 INFO:tasks.workunit.client.0.smithi007.stdout:kdmflush/ 84215 root NOFD /proc/84215/fd (opendir: Permission denied) 2023-09-30T17:04:34.449 INFO:tasks.workunit.client.0.smithi007.stdout:kdmflush/ 84361 root cwd unknown /proc/84361/cwd (readlink: Permission denied) 2023-09-30T17:04:34.449 INFO:tasks.workunit.client.0.smithi007.stdout:kdmflush/ 84361 root rtd unknown /proc/84361/root (readlink: Permission denied) 2023-09-30T17:04:34.449 INFO:tasks.workunit.client.0.smithi007.stdout:kdmflush/ 84361 root txt unknown /proc/84361/exe (readlink: Permission denied) 2023-09-30T17:04:34.449 INFO:tasks.workunit.client.0.smithi007.stdout:kdmflush/ 84361 root NOFD /proc/84361/fd (opendir: Permission denied) 2023-09-30T17:04:34.449 INFO:tasks.workunit.client.0.smithi007.stdout:xfsalloc 85446 root cwd unknown /proc/85446/cwd (readlink: Permission denied) 2023-09-30T17:04:34.449 INFO:tasks.workunit.client.0.smithi007.stdout:xfsalloc 85446 root rtd unknown /proc/85446/root (readlink: Permission denied) 2023-09-30T17:04:34.449 INFO:tasks.workunit.client.0.smithi007.stdout:xfsalloc 85446 root txt unknown /proc/85446/exe (readlink: Permission denied) 2023-09-30T17:04:34.449 INFO:tasks.workunit.client.0.smithi007.stdout:xfsalloc 85446 root NOFD /proc/85446/fd (opendir: Permission denied) 2023-09-30T17:04:34.449 INFO:tasks.workunit.client.0.smithi007.stdout:xfs_mru_c 85447 root cwd unknown /proc/85447/cwd (readlink: Permission denied) 2023-09-30T17:04:34.449 INFO:tasks.workunit.client.0.smithi007.stdout:xfs_mru_c 85447 root rtd unknown /proc/85447/root (readlink: Permission denied) 2023-09-30T17:04:34.450 INFO:tasks.workunit.client.0.smithi007.stdout:xfs_mru_c 85447 root txt unknown /proc/85447/exe (readlink: Permission denied) 2023-09-30T17:04:34.450 INFO:tasks.workunit.client.0.smithi007.stdout:xfs_mru_c 85447 root NOFD /proc/85447/fd (opendir: Permission denied) 2023-09-30T17:04:34.450 INFO:tasks.workunit.client.0.smithi007.stdout:xfs-buf/d 85448 root cwd unknown /proc/85448/cwd (readlink: Permission denied) 2023-09-30T17:04:34.450 INFO:tasks.workunit.client.0.smithi007.stdout:xfs-buf/d 85448 root rtd unknown /proc/85448/root (readlink: Permission denied) 2023-09-30T17:04:34.450 INFO:tasks.workunit.client.0.smithi007.stdout:xfs-buf/d 85448 root txt unknown /proc/85448/exe (readlink: Permission denied) 2023-09-30T17:04:34.450 INFO:tasks.workunit.client.0.smithi007.stdout:xfs-buf/d 85448 root NOFD /proc/85448/fd (opendir: Permission denied) 2023-09-30T17:04:34.450 INFO:tasks.workunit.client.0.smithi007.stdout:xfs-conv/ 85449 root cwd unknown /proc/85449/cwd (readlink: Permission denied) 2023-09-30T17:04:34.450 INFO:tasks.workunit.client.0.smithi007.stdout:xfs-conv/ 85449 root rtd unknown /proc/85449/root (readlink: Permission denied) 2023-09-30T17:04:34.450 INFO:tasks.workunit.client.0.smithi007.stdout:xfs-conv/ 85449 root txt unknown /proc/85449/exe (readlink: Permission denied) 2023-09-30T17:04:34.450 INFO:tasks.workunit.client.0.smithi007.stdout:xfs-conv/ 85449 root NOFD /proc/85449/fd (opendir: Permission denied) 2023-09-30T17:04:34.450 INFO:tasks.workunit.client.0.smithi007.stdout:xfs-cil/d 85450 root cwd unknown /proc/85450/cwd (readlink: Permission denied) 2023-09-30T17:04:34.451 INFO:tasks.workunit.client.0.smithi007.stdout:xfs-cil/d 85450 root rtd unknown /proc/85450/root (readlink: Permission denied) 2023-09-30T17:04:34.451 INFO:tasks.workunit.client.0.smithi007.stdout:xfs-cil/d 85450 root txt unknown /proc/85450/exe (readlink: Permission denied) 2023-09-30T17:04:34.451 INFO:tasks.workunit.client.0.smithi007.stdout:xfs-cil/d 85450 root NOFD /proc/85450/fd (opendir: Permission denied) 2023-09-30T17:04:34.451 INFO:tasks.workunit.client.0.smithi007.stdout:xfs-recla 85451 root cwd unknown /proc/85451/cwd (readlink: Permission denied) 2023-09-30T17:04:34.451 INFO:tasks.workunit.client.0.smithi007.stdout:xfs-recla 85451 root rtd unknown /proc/85451/root (readlink: Permission denied) 2023-09-30T17:04:34.451 INFO:tasks.workunit.client.0.smithi007.stdout:xfs-recla 85451 root txt unknown /proc/85451/exe (readlink: Permission denied) 2023-09-30T17:04:34.451 INFO:tasks.workunit.client.0.smithi007.stdout:xfs-recla 85451 root NOFD /proc/85451/fd (opendir: Permission denied) 2023-09-30T17:04:34.451 INFO:tasks.workunit.client.0.smithi007.stdout:xfs-block 85452 root cwd unknown /proc/85452/cwd (readlink: Permission denied) 2023-09-30T17:04:34.451 INFO:tasks.workunit.client.0.smithi007.stdout:xfs-block 85452 root rtd unknown /proc/85452/root (readlink: Permission denied) 2023-09-30T17:04:34.451 INFO:tasks.workunit.client.0.smithi007.stdout:xfs-block 85452 root txt unknown /proc/85452/exe (readlink: Permission denied) 2023-09-30T17:04:34.451 INFO:tasks.workunit.client.0.smithi007.stdout:xfs-block 85452 root NOFD /proc/85452/fd (opendir: Permission denied) 2023-09-30T17:04:34.451 INFO:tasks.workunit.client.0.smithi007.stdout:xfs-log/d 85454 root cwd unknown /proc/85454/cwd (readlink: Permission denied) 2023-09-30T17:04:34.452 INFO:tasks.workunit.client.0.smithi007.stdout:xfs-log/d 85454 root rtd unknown /proc/85454/root (readlink: Permission denied) 2023-09-30T17:04:34.452 INFO:tasks.workunit.client.0.smithi007.stdout:xfs-log/d 85454 root txt unknown /proc/85454/exe (readlink: Permission denied) 2023-09-30T17:04:34.452 INFO:tasks.workunit.client.0.smithi007.stdout:xfs-log/d 85454 root NOFD /proc/85454/fd (opendir: Permission denied) 2023-09-30T17:04:34.452 INFO:tasks.workunit.client.0.smithi007.stdout:xfsaild/d 85455 root cwd unknown /proc/85455/cwd (readlink: Permission denied) 2023-09-30T17:04:34.452 INFO:tasks.workunit.client.0.smithi007.stdout:xfsaild/d 85455 root rtd unknown /proc/85455/root (readlink: Permission denied) 2023-09-30T17:04:34.452 INFO:tasks.workunit.client.0.smithi007.stdout:xfsaild/d 85455 root txt unknown /proc/85455/exe (readlink: Permission denied) 2023-09-30T17:04:34.452 INFO:tasks.workunit.client.0.smithi007.stdout:xfsaild/d 85455 root NOFD /proc/85455/fd (opendir: Permission denied) 2023-09-30T17:04:34.452 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 87401 root cwd unknown /proc/87401/cwd (readlink: Permission denied) 2023-09-30T17:04:34.452 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 87401 root rtd unknown /proc/87401/root (readlink: Permission denied) 2023-09-30T17:04:34.452 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 87401 root txt unknown /proc/87401/exe (readlink: Permission denied) 2023-09-30T17:04:34.452 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/1 87401 root NOFD /proc/87401/fd (opendir: Permission denied) 2023-09-30T17:04:34.452 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 89252 root cwd unknown /proc/89252/cwd (readlink: Permission denied) 2023-09-30T17:04:34.453 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 89252 root rtd unknown /proc/89252/root (readlink: Permission denied) 2023-09-30T17:04:34.453 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 89252 root txt unknown /proc/89252/exe (readlink: Permission denied) 2023-09-30T17:04:34.453 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 89252 root NOFD /proc/89252/fd (opendir: Permission denied) 2023-09-30T17:04:34.453 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 89254 root cwd unknown /proc/89254/cwd (readlink: Permission denied) 2023-09-30T17:04:34.453 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 89254 root rtd unknown /proc/89254/root (readlink: Permission denied) 2023-09-30T17:04:34.453 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 89254 root txt unknown /proc/89254/exe (readlink: Permission denied) 2023-09-30T17:04:34.453 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/5 89254 root NOFD /proc/89254/fd (opendir: Permission denied) 2023-09-30T17:04:34.453 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 89257 ubuntu cwd unknown /proc/89257/cwd (readlink: Permission denied) 2023-09-30T17:04:34.453 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 89257 ubuntu rtd unknown /proc/89257/root (readlink: Permission denied) 2023-09-30T17:04:34.453 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 89257 ubuntu txt unknown /proc/89257/exe (readlink: Permission denied) 2023-09-30T17:04:34.453 INFO:tasks.workunit.client.0.smithi007.stdout:sshd 89257 ubuntu NOFD /proc/89257/fd (opendir: Permission denied) 2023-09-30T17:04:34.454 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 89318 root cwd unknown /proc/89318/cwd (readlink: Permission denied) 2023-09-30T17:04:34.454 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 89318 root rtd unknown /proc/89318/root (readlink: Permission denied) 2023-09-30T17:04:34.454 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 89318 root txt unknown /proc/89318/exe (readlink: Permission denied) 2023-09-30T17:04:34.454 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/7 89318 root NOFD /proc/89318/fd (opendir: Permission denied) 2023-09-30T17:04:34.454 INFO:tasks.workunit.client.0.smithi007.stdout:chronyd 89328 chrony cwd unknown /proc/89328/cwd (readlink: Permission denied) 2023-09-30T17:04:34.454 INFO:tasks.workunit.client.0.smithi007.stdout:chronyd 89328 chrony rtd unknown /proc/89328/root (readlink: Permission denied) 2023-09-30T17:04:34.454 INFO:tasks.workunit.client.0.smithi007.stdout:chronyd 89328 chrony txt unknown /proc/89328/exe (readlink: Permission denied) 2023-09-30T17:04:34.454 INFO:tasks.workunit.client.0.smithi007.stdout:chronyd 89328 chrony NOFD /proc/89328/fd (opendir: Permission denied) 2023-09-30T17:04:34.454 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 89587 root cwd unknown /proc/89587/cwd (readlink: Permission denied) 2023-09-30T17:04:34.454 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 89587 root rtd unknown /proc/89587/root (readlink: Permission denied) 2023-09-30T17:04:34.454 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 89587 root txt unknown /proc/89587/exe (readlink: Permission denied) 2023-09-30T17:04:34.454 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/0 89587 root NOFD /proc/89587/fd (opendir: Permission denied) 2023-09-30T17:04:34.455 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-cras 89610 ceph cwd unknown /proc/89610/cwd (readlink: Permission denied) 2023-09-30T17:04:34.455 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-cras 89610 ceph rtd unknown /proc/89610/root (readlink: Permission denied) 2023-09-30T17:04:34.455 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-cras 89610 ceph txt unknown /proc/89610/exe (readlink: Permission denied) 2023-09-30T17:04:34.455 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-cras 89610 ceph NOFD /proc/89610/fd (opendir: Permission denied) 2023-09-30T17:04:34.455 INFO:tasks.workunit.client.0.smithi007.stdout:anacron 90409 root cwd unknown /proc/90409/cwd (readlink: Permission denied) 2023-09-30T17:04:34.455 INFO:tasks.workunit.client.0.smithi007.stdout:anacron 90409 root rtd unknown /proc/90409/root (readlink: Permission denied) 2023-09-30T17:04:34.455 INFO:tasks.workunit.client.0.smithi007.stdout:anacron 90409 root txt unknown /proc/90409/exe (readlink: Permission denied) 2023-09-30T17:04:34.455 INFO:tasks.workunit.client.0.smithi007.stdout:anacron 90409 root NOFD /proc/90409/fd (opendir: Permission denied) 2023-09-30T17:04:34.455 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 94801 root cwd unknown /proc/94801/cwd (readlink: Permission denied) 2023-09-30T17:04:34.455 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 94801 root rtd unknown /proc/94801/root (readlink: Permission denied) 2023-09-30T17:04:34.455 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 94801 root txt unknown /proc/94801/exe (readlink: Permission denied) 2023-09-30T17:04:34.456 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 94801 root NOFD /proc/94801/fd (opendir: Permission denied) 2023-09-30T17:04:34.456 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 96024 root cwd unknown /proc/96024/cwd (readlink: Permission denied) 2023-09-30T17:04:34.456 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 96024 root rtd unknown /proc/96024/root (readlink: Permission denied) 2023-09-30T17:04:34.456 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 96024 root txt unknown /proc/96024/exe (readlink: Permission denied) 2023-09-30T17:04:34.456 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 96024 root NOFD /proc/96024/fd (opendir: Permission denied) 2023-09-30T17:04:34.456 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 96027 root cwd unknown /proc/96027/cwd (readlink: Permission denied) 2023-09-30T17:04:34.456 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 96027 root rtd unknown /proc/96027/root (readlink: Permission denied) 2023-09-30T17:04:34.456 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 96027 root txt unknown /proc/96027/exe (readlink: Permission denied) 2023-09-30T17:04:34.456 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 96027 root NOFD /proc/96027/fd (opendir: Permission denied) 2023-09-30T17:04:34.456 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 96033 root cwd unknown /proc/96033/cwd (readlink: Permission denied) 2023-09-30T17:04:34.456 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 96033 root rtd unknown /proc/96033/root (readlink: Permission denied) 2023-09-30T17:04:34.456 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 96033 root txt unknown /proc/96033/exe (readlink: Permission denied) 2023-09-30T17:04:34.457 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 96033 root NOFD /proc/96033/fd (opendir: Permission denied) 2023-09-30T17:04:34.457 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 96043 root cwd unknown /proc/96043/cwd (readlink: Permission denied) 2023-09-30T17:04:34.457 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 96043 root rtd unknown /proc/96043/root (readlink: Permission denied) 2023-09-30T17:04:34.457 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 96043 root txt unknown /proc/96043/exe (readlink: Permission denied) 2023-09-30T17:04:34.457 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 96043 root NOFD /proc/96043/fd (opendir: Permission denied) 2023-09-30T17:04:34.457 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 96055 root cwd unknown /proc/96055/cwd (readlink: Permission denied) 2023-09-30T17:04:34.457 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 96055 root rtd unknown /proc/96055/root (readlink: Permission denied) 2023-09-30T17:04:34.457 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 96055 root txt unknown /proc/96055/exe (readlink: Permission denied) 2023-09-30T17:04:34.457 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 96055 root NOFD /proc/96055/fd (opendir: Permission denied) 2023-09-30T17:04:34.457 INFO:tasks.workunit.client.0.smithi007.stdout:daemon-he 96141 root cwd unknown /proc/96141/cwd (readlink: Permission denied) 2023-09-30T17:04:34.457 INFO:tasks.workunit.client.0.smithi007.stdout:daemon-he 96141 root rtd unknown /proc/96141/root (readlink: Permission denied) 2023-09-30T17:04:34.458 INFO:tasks.workunit.client.0.smithi007.stdout:daemon-he 96141 root txt unknown /proc/96141/exe (readlink: Permission denied) 2023-09-30T17:04:34.458 INFO:tasks.workunit.client.0.smithi007.stdout:daemon-he 96141 root NOFD /proc/96141/fd (opendir: Permission denied) 2023-09-30T17:04:34.458 INFO:tasks.workunit.client.0.smithi007.stdout:daemon-he 96142 root cwd unknown /proc/96142/cwd (readlink: Permission denied) 2023-09-30T17:04:34.458 INFO:tasks.workunit.client.0.smithi007.stdout:daemon-he 96142 root rtd unknown /proc/96142/root (readlink: Permission denied) 2023-09-30T17:04:34.458 INFO:tasks.workunit.client.0.smithi007.stdout:daemon-he 96142 root txt unknown /proc/96142/exe (readlink: Permission denied) 2023-09-30T17:04:34.458 INFO:tasks.workunit.client.0.smithi007.stdout:daemon-he 96142 root NOFD /proc/96142/fd (opendir: Permission denied) 2023-09-30T17:04:34.458 INFO:tasks.workunit.client.0.smithi007.stdout:daemon-he 96145 root cwd unknown /proc/96145/cwd (readlink: Permission denied) 2023-09-30T17:04:34.458 INFO:tasks.workunit.client.0.smithi007.stdout:daemon-he 96145 root rtd unknown /proc/96145/root (readlink: Permission denied) 2023-09-30T17:04:34.458 INFO:tasks.workunit.client.0.smithi007.stdout:daemon-he 96145 root txt unknown /proc/96145/exe (readlink: Permission denied) 2023-09-30T17:04:34.458 INFO:tasks.workunit.client.0.smithi007.stdout:daemon-he 96145 root NOFD /proc/96145/fd (opendir: Permission denied) 2023-09-30T17:04:34.458 INFO:tasks.workunit.client.0.smithi007.stdout:daemon-he 96150 root cwd unknown /proc/96150/cwd (readlink: Permission denied) 2023-09-30T17:04:34.459 INFO:tasks.workunit.client.0.smithi007.stdout:daemon-he 96150 root rtd unknown /proc/96150/root (readlink: Permission denied) 2023-09-30T17:04:34.459 INFO:tasks.workunit.client.0.smithi007.stdout:daemon-he 96150 root txt unknown /proc/96150/exe (readlink: Permission denied) 2023-09-30T17:04:34.459 INFO:tasks.workunit.client.0.smithi007.stdout:daemon-he 96150 root NOFD /proc/96150/fd (opendir: Permission denied) 2023-09-30T17:04:34.459 INFO:tasks.workunit.client.0.smithi007.stdout:daemon-he 96151 root cwd unknown /proc/96151/cwd (readlink: Permission denied) 2023-09-30T17:04:34.459 INFO:tasks.workunit.client.0.smithi007.stdout:daemon-he 96151 root rtd unknown /proc/96151/root (readlink: Permission denied) 2023-09-30T17:04:34.459 INFO:tasks.workunit.client.0.smithi007.stdout:daemon-he 96151 root txt unknown /proc/96151/exe (readlink: Permission denied) 2023-09-30T17:04:34.459 INFO:tasks.workunit.client.0.smithi007.stdout:daemon-he 96151 root NOFD /proc/96151/fd (opendir: Permission denied) 2023-09-30T17:04:34.459 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 root cwd unknown /proc/96155/cwd (readlink: Permission denied) 2023-09-30T17:04:34.459 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 root rtd unknown /proc/96155/root (readlink: Permission denied) 2023-09-30T17:04:34.459 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 root txt unknown /proc/96155/exe (readlink: Permission denied) 2023-09-30T17:04:34.459 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 root NOFD /proc/96155/fd (opendir: Permission denied) 2023-09-30T17:04:34.459 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96160 log root cwd unknown /proc/96155/task/96160/cwd (readlink: Permission denied) 2023-09-30T17:04:34.460 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96160 log root rtd unknown /proc/96155/task/96160/root (readlink: Permission denied) 2023-09-30T17:04:34.460 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96160 log root txt unknown /proc/96155/task/96160/exe (readlink: Permission denied) 2023-09-30T17:04:34.460 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96160 log root NOFD /proc/96155/task/96160/fd (opendir: Permission denied) 2023-09-30T17:04:34.460 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96162 msgr-work root cwd unknown /proc/96155/task/96162/cwd (readlink: Permission denied) 2023-09-30T17:04:34.460 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96162 msgr-work root rtd unknown /proc/96155/task/96162/root (readlink: Permission denied) 2023-09-30T17:04:34.460 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96162 msgr-work root txt unknown /proc/96155/task/96162/exe (readlink: Permission denied) 2023-09-30T17:04:34.460 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96162 msgr-work root NOFD /proc/96155/task/96162/fd (opendir: Permission denied) 2023-09-30T17:04:34.460 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96163 msgr-work root cwd unknown /proc/96155/task/96163/cwd (readlink: Permission denied) 2023-09-30T17:04:34.460 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96163 msgr-work root rtd unknown /proc/96155/task/96163/root (readlink: Permission denied) 2023-09-30T17:04:34.460 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96163 msgr-work root txt unknown /proc/96155/task/96163/exe (readlink: Permission denied) 2023-09-30T17:04:34.460 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96163 msgr-work root NOFD /proc/96155/task/96163/fd (opendir: Permission denied) 2023-09-30T17:04:34.460 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96164 msgr-work root cwd unknown /proc/96155/task/96164/cwd (readlink: Permission denied) 2023-09-30T17:04:34.461 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96164 msgr-work root rtd unknown /proc/96155/task/96164/root (readlink: Permission denied) 2023-09-30T17:04:34.461 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96164 msgr-work root txt unknown /proc/96155/task/96164/exe (readlink: Permission denied) 2023-09-30T17:04:34.461 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96164 msgr-work root NOFD /proc/96155/task/96164/fd (opendir: Permission denied) 2023-09-30T17:04:34.461 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96302 service root cwd unknown /proc/96155/task/96302/cwd (readlink: Permission denied) 2023-09-30T17:04:34.461 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96302 service root rtd unknown /proc/96155/task/96302/root (readlink: Permission denied) 2023-09-30T17:04:34.461 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96302 service root txt unknown /proc/96155/task/96302/exe (readlink: Permission denied) 2023-09-30T17:04:34.461 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96302 service root NOFD /proc/96155/task/96302/fd (opendir: Permission denied) 2023-09-30T17:04:34.461 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96305 admin_soc root cwd unknown /proc/96155/task/96305/cwd (readlink: Permission denied) 2023-09-30T17:04:34.461 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96305 admin_soc root rtd unknown /proc/96155/task/96305/root (readlink: Permission denied) 2023-09-30T17:04:34.461 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96305 admin_soc root txt unknown /proc/96155/task/96305/exe (readlink: Permission denied) 2023-09-30T17:04:34.461 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96305 admin_soc root NOFD /proc/96155/task/96305/fd (opendir: Permission denied) 2023-09-30T17:04:34.462 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96308 ceph_time root cwd unknown /proc/96155/task/96308/cwd (readlink: Permission denied) 2023-09-30T17:04:34.462 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96308 ceph_time root rtd unknown /proc/96155/task/96308/root (readlink: Permission denied) 2023-09-30T17:04:34.462 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96308 ceph_time root txt unknown /proc/96155/task/96308/exe (readlink: Permission denied) 2023-09-30T17:04:34.462 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96308 ceph_time root NOFD /proc/96155/task/96308/fd (opendir: Permission denied) 2023-09-30T17:04:34.462 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96312 fn_anonym root cwd unknown /proc/96155/task/96312/cwd (readlink: Permission denied) 2023-09-30T17:04:34.462 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96312 fn_anonym root rtd unknown /proc/96155/task/96312/root (readlink: Permission denied) 2023-09-30T17:04:34.462 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96312 fn_anonym root txt unknown /proc/96155/task/96312/exe (readlink: Permission denied) 2023-09-30T17:04:34.462 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96312 fn_anonym root NOFD /proc/96155/task/96312/fd (opendir: Permission denied) 2023-09-30T17:04:34.462 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96315 signal_ha root cwd unknown /proc/96155/task/96315/cwd (readlink: Permission denied) 2023-09-30T17:04:34.462 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96315 signal_ha root rtd unknown /proc/96155/task/96315/root (readlink: Permission denied) 2023-09-30T17:04:34.462 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96315 signal_ha root txt unknown /proc/96155/task/96315/exe (readlink: Permission denied) 2023-09-30T17:04:34.462 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96315 signal_ha root NOFD /proc/96155/task/96315/fd (opendir: Permission denied) 2023-09-30T17:04:34.463 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96316 mgrsb-fin root cwd unknown /proc/96155/task/96316/cwd (readlink: Permission denied) 2023-09-30T17:04:34.463 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96316 mgrsb-fin root rtd unknown /proc/96155/task/96316/root (readlink: Permission denied) 2023-09-30T17:04:34.463 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96316 mgrsb-fin root txt unknown /proc/96155/task/96316/exe (readlink: Permission denied) 2023-09-30T17:04:34.463 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96316 mgrsb-fin root NOFD /proc/96155/task/96316/fd (opendir: Permission denied) 2023-09-30T17:04:34.463 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96317 ms_dispat root cwd unknown /proc/96155/task/96317/cwd (readlink: Permission denied) 2023-09-30T17:04:34.463 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96317 ms_dispat root rtd unknown /proc/96155/task/96317/root (readlink: Permission denied) 2023-09-30T17:04:34.463 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96317 ms_dispat root txt unknown /proc/96155/task/96317/exe (readlink: Permission denied) 2023-09-30T17:04:34.463 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96317 ms_dispat root NOFD /proc/96155/task/96317/fd (opendir: Permission denied) 2023-09-30T17:04:34.463 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96319 ms_local root cwd unknown /proc/96155/task/96319/cwd (readlink: Permission denied) 2023-09-30T17:04:34.463 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96319 ms_local root rtd unknown /proc/96155/task/96319/root (readlink: Permission denied) 2023-09-30T17:04:34.463 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96319 ms_local root txt unknown /proc/96155/task/96319/exe (readlink: Permission denied) 2023-09-30T17:04:34.463 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96319 ms_local root NOFD /proc/96155/task/96319/fd (opendir: Permission denied) 2023-09-30T17:04:34.464 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96321 io_contex root cwd unknown /proc/96155/task/96321/cwd (readlink: Permission denied) 2023-09-30T17:04:34.464 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96321 io_contex root rtd unknown /proc/96155/task/96321/root (readlink: Permission denied) 2023-09-30T17:04:34.464 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96321 io_contex root txt unknown /proc/96155/task/96321/exe (readlink: Permission denied) 2023-09-30T17:04:34.464 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96321 io_contex root NOFD /proc/96155/task/96321/fd (opendir: Permission denied) 2023-09-30T17:04:34.464 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96322 io_contex root cwd unknown /proc/96155/task/96322/cwd (readlink: Permission denied) 2023-09-30T17:04:34.464 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96322 io_contex root rtd unknown /proc/96155/task/96322/root (readlink: Permission denied) 2023-09-30T17:04:34.464 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96322 io_contex root txt unknown /proc/96155/task/96322/exe (readlink: Permission denied) 2023-09-30T17:04:34.464 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96322 io_contex root NOFD /proc/96155/task/96322/fd (opendir: Permission denied) 2023-09-30T17:04:34.464 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96323 safe_time root cwd unknown /proc/96155/task/96323/cwd (readlink: Permission denied) 2023-09-30T17:04:34.464 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96323 safe_time root rtd unknown /proc/96155/task/96323/root (readlink: Permission denied) 2023-09-30T17:04:34.464 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96323 safe_time root txt unknown /proc/96155/task/96323/exe (readlink: Permission denied) 2023-09-30T17:04:34.464 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96323 safe_time root NOFD /proc/96155/task/96323/fd (opendir: Permission denied) 2023-09-30T17:04:34.465 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96324 safe_time root cwd unknown /proc/96155/task/96324/cwd (readlink: Permission denied) 2023-09-30T17:04:34.465 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96324 safe_time root rtd unknown /proc/96155/task/96324/root (readlink: Permission denied) 2023-09-30T17:04:34.465 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96324 safe_time root txt unknown /proc/96155/task/96324/exe (readlink: Permission denied) 2023-09-30T17:04:34.465 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96324 safe_time root NOFD /proc/96155/task/96324/fd (opendir: Permission denied) 2023-09-30T17:04:34.465 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96329 safe_time root cwd unknown /proc/96155/task/96329/cwd (readlink: Permission denied) 2023-09-30T17:04:34.465 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96329 safe_time root rtd unknown /proc/96155/task/96329/root (readlink: Permission denied) 2023-09-30T17:04:34.465 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96329 safe_time root txt unknown /proc/96155/task/96329/exe (readlink: Permission denied) 2023-09-30T17:04:34.465 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96329 safe_time root NOFD /proc/96155/task/96329/fd (opendir: Permission denied) 2023-09-30T17:04:34.465 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96330 fn_anonym root cwd unknown /proc/96155/task/96330/cwd (readlink: Permission denied) 2023-09-30T17:04:34.465 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96330 fn_anonym root rtd unknown /proc/96155/task/96330/root (readlink: Permission denied) 2023-09-30T17:04:34.465 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96330 fn_anonym root txt unknown /proc/96155/task/96330/exe (readlink: Permission denied) 2023-09-30T17:04:34.465 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96330 fn_anonym root NOFD /proc/96155/task/96330/fd (opendir: Permission denied) 2023-09-30T17:04:34.466 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96331 flusher root cwd unknown /proc/96155/task/96331/cwd (readlink: Permission denied) 2023-09-30T17:04:34.466 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96331 flusher root rtd unknown /proc/96155/task/96331/root (readlink: Permission denied) 2023-09-30T17:04:34.466 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96331 flusher root txt unknown /proc/96155/task/96331/exe (readlink: Permission denied) 2023-09-30T17:04:34.466 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96331 flusher root NOFD /proc/96155/task/96331/fd (opendir: Permission denied) 2023-09-30T17:04:34.466 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96332 safe_time root cwd unknown /proc/96155/task/96332/cwd (readlink: Permission denied) 2023-09-30T17:04:34.466 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96332 safe_time root rtd unknown /proc/96155/task/96332/root (readlink: Permission denied) 2023-09-30T17:04:34.466 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96332 safe_time root txt unknown /proc/96155/task/96332/exe (readlink: Permission denied) 2023-09-30T17:04:34.466 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96332 safe_time root NOFD /proc/96155/task/96332/fd (opendir: Permission denied) 2023-09-30T17:04:34.466 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96556 mgr-fin root cwd unknown /proc/96155/task/96556/cwd (readlink: Permission denied) 2023-09-30T17:04:34.466 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96556 mgr-fin root rtd unknown /proc/96155/task/96556/root (readlink: Permission denied) 2023-09-30T17:04:34.466 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96556 mgr-fin root txt unknown /proc/96155/task/96556/exe (readlink: Permission denied) 2023-09-30T17:04:34.467 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96556 mgr-fin root NOFD /proc/96155/task/96556/fd (opendir: Permission denied) 2023-09-30T17:04:34.467 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96557 ms_dispat root cwd unknown /proc/96155/task/96557/cwd (readlink: Permission denied) 2023-09-30T17:04:34.467 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96557 ms_dispat root rtd unknown /proc/96155/task/96557/root (readlink: Permission denied) 2023-09-30T17:04:34.467 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96557 ms_dispat root txt unknown /proc/96155/task/96557/exe (readlink: Permission denied) 2023-09-30T17:04:34.467 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96557 ms_dispat root NOFD /proc/96155/task/96557/fd (opendir: Permission denied) 2023-09-30T17:04:34.467 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96558 ms_local root cwd unknown /proc/96155/task/96558/cwd (readlink: Permission denied) 2023-09-30T17:04:34.467 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96558 ms_local root rtd unknown /proc/96155/task/96558/root (readlink: Permission denied) 2023-09-30T17:04:34.467 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96558 ms_local root txt unknown /proc/96155/task/96558/exe (readlink: Permission denied) 2023-09-30T17:04:34.467 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96558 ms_local root NOFD /proc/96155/task/96558/fd (opendir: Permission denied) 2023-09-30T17:04:34.467 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96559 safe_time root cwd unknown /proc/96155/task/96559/cwd (readlink: Permission denied) 2023-09-30T17:04:34.467 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96559 safe_time root rtd unknown /proc/96155/task/96559/root (readlink: Permission denied) 2023-09-30T17:04:34.467 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96559 safe_time root txt unknown /proc/96155/task/96559/exe (readlink: Permission denied) 2023-09-30T17:04:34.468 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96559 safe_time root NOFD /proc/96155/task/96559/fd (opendir: Permission denied) 2023-09-30T17:04:34.468 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96560 cmdfin root cwd unknown /proc/96155/task/96560/cwd (readlink: Permission denied) 2023-09-30T17:04:34.468 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96560 cmdfin root rtd unknown /proc/96155/task/96560/root (readlink: Permission denied) 2023-09-30T17:04:34.468 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96560 cmdfin root txt unknown /proc/96155/task/96560/exe (readlink: Permission denied) 2023-09-30T17:04:34.468 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96560 cmdfin root NOFD /proc/96155/task/96560/fd (opendir: Permission denied) 2023-09-30T17:04:34.468 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96564 io_contex root cwd unknown /proc/96155/task/96564/cwd (readlink: Permission denied) 2023-09-30T17:04:34.468 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96564 io_contex root rtd unknown /proc/96155/task/96564/root (readlink: Permission denied) 2023-09-30T17:04:34.468 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96564 io_contex root txt unknown /proc/96155/task/96564/exe (readlink: Permission denied) 2023-09-30T17:04:34.468 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96564 io_contex root NOFD /proc/96155/task/96564/fd (opendir: Permission denied) 2023-09-30T17:04:34.468 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96565 io_contex root cwd unknown /proc/96155/task/96565/cwd (readlink: Permission denied) 2023-09-30T17:04:34.468 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96565 io_contex root rtd unknown /proc/96155/task/96565/root (readlink: Permission denied) 2023-09-30T17:04:34.469 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96565 io_contex root txt unknown /proc/96155/task/96565/exe (readlink: Permission denied) 2023-09-30T17:04:34.469 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96565 io_contex root NOFD /proc/96155/task/96565/fd (opendir: Permission denied) 2023-09-30T17:04:34.469 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96566 ceph_time root cwd unknown /proc/96155/task/96566/cwd (readlink: Permission denied) 2023-09-30T17:04:34.469 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96566 ceph_time root rtd unknown /proc/96155/task/96566/root (readlink: Permission denied) 2023-09-30T17:04:34.469 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96566 ceph_time root txt unknown /proc/96155/task/96566/exe (readlink: Permission denied) 2023-09-30T17:04:34.469 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96566 ceph_time root NOFD /proc/96155/task/96566/fd (opendir: Permission denied) 2023-09-30T17:04:34.469 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96567 ms_dispat root cwd unknown /proc/96155/task/96567/cwd (readlink: Permission denied) 2023-09-30T17:04:34.469 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96567 ms_dispat root rtd unknown /proc/96155/task/96567/root (readlink: Permission denied) 2023-09-30T17:04:34.469 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96567 ms_dispat root txt unknown /proc/96155/task/96567/exe (readlink: Permission denied) 2023-09-30T17:04:34.469 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96567 ms_dispat root NOFD /proc/96155/task/96567/fd (opendir: Permission denied) 2023-09-30T17:04:34.469 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96568 ms_local root cwd unknown /proc/96155/task/96568/cwd (readlink: Permission denied) 2023-09-30T17:04:34.469 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96568 ms_local root rtd unknown /proc/96155/task/96568/root (readlink: Permission denied) 2023-09-30T17:04:34.470 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96568 ms_local root txt unknown /proc/96155/task/96568/exe (readlink: Permission denied) 2023-09-30T17:04:34.470 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96568 ms_local root NOFD /proc/96155/task/96568/fd (opendir: Permission denied) 2023-09-30T17:04:34.470 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96569 safe_time root cwd unknown /proc/96155/task/96569/cwd (readlink: Permission denied) 2023-09-30T17:04:34.470 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96569 safe_time root rtd unknown /proc/96155/task/96569/root (readlink: Permission denied) 2023-09-30T17:04:34.470 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96569 safe_time root txt unknown /proc/96155/task/96569/exe (readlink: Permission denied) 2023-09-30T17:04:34.470 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96569 safe_time root NOFD /proc/96155/task/96569/fd (opendir: Permission denied) 2023-09-30T17:04:34.470 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96570 safe_time root cwd unknown /proc/96155/task/96570/cwd (readlink: Permission denied) 2023-09-30T17:04:34.470 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96570 safe_time root rtd unknown /proc/96155/task/96570/root (readlink: Permission denied) 2023-09-30T17:04:34.470 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96570 safe_time root txt unknown /proc/96155/task/96570/exe (readlink: Permission denied) 2023-09-30T17:04:34.470 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96570 safe_time root NOFD /proc/96155/task/96570/fd (opendir: Permission denied) 2023-09-30T17:04:34.470 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96571 balancer root cwd unknown /proc/96155/task/96571/cwd (readlink: Permission denied) 2023-09-30T17:04:34.471 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96571 balancer root rtd unknown /proc/96155/task/96571/root (readlink: Permission denied) 2023-09-30T17:04:34.471 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96571 balancer root txt unknown /proc/96155/task/96571/exe (readlink: Permission denied) 2023-09-30T17:04:34.471 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96571 balancer root NOFD /proc/96155/task/96571/fd (opendir: Permission denied) 2023-09-30T17:04:34.471 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96572 m-fin-bal root cwd unknown /proc/96155/task/96572/cwd (readlink: Permission denied) 2023-09-30T17:04:34.471 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96572 m-fin-bal root rtd unknown /proc/96155/task/96572/root (readlink: Permission denied) 2023-09-30T17:04:34.471 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96572 m-fin-bal root txt unknown /proc/96155/task/96572/exe (readlink: Permission denied) 2023-09-30T17:04:34.471 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96572 m-fin-bal root NOFD /proc/96155/task/96572/fd (opendir: Permission denied) 2023-09-30T17:04:34.471 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96573 crash root cwd unknown /proc/96155/task/96573/cwd (readlink: Permission denied) 2023-09-30T17:04:34.471 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96573 crash root rtd unknown /proc/96155/task/96573/root (readlink: Permission denied) 2023-09-30T17:04:34.471 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96573 crash root txt unknown /proc/96155/task/96573/exe (readlink: Permission denied) 2023-09-30T17:04:34.471 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96573 crash root NOFD /proc/96155/task/96573/fd (opendir: Permission denied) 2023-09-30T17:04:34.471 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96574 m-fin-cra root cwd unknown /proc/96155/task/96574/cwd (readlink: Permission denied) 2023-09-30T17:04:34.472 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96574 m-fin-cra root rtd unknown /proc/96155/task/96574/root (readlink: Permission denied) 2023-09-30T17:04:34.472 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96574 m-fin-cra root txt unknown /proc/96155/task/96574/exe (readlink: Permission denied) 2023-09-30T17:04:34.472 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96574 m-fin-cra root NOFD /proc/96155/task/96574/fd (opendir: Permission denied) 2023-09-30T17:04:34.472 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96575 devicehea root cwd unknown /proc/96155/task/96575/cwd (readlink: Permission denied) 2023-09-30T17:04:34.472 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96575 devicehea root rtd unknown /proc/96155/task/96575/root (readlink: Permission denied) 2023-09-30T17:04:34.472 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96575 devicehea root txt unknown /proc/96155/task/96575/exe (readlink: Permission denied) 2023-09-30T17:04:34.472 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96575 devicehea root NOFD /proc/96155/task/96575/fd (opendir: Permission denied) 2023-09-30T17:04:34.472 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96576 m-fin-dev root cwd unknown /proc/96155/task/96576/cwd (readlink: Permission denied) 2023-09-30T17:04:34.472 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96576 m-fin-dev root rtd unknown /proc/96155/task/96576/root (readlink: Permission denied) 2023-09-30T17:04:34.472 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96576 m-fin-dev root txt unknown /proc/96155/task/96576/exe (readlink: Permission denied) 2023-09-30T17:04:34.472 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96576 m-fin-dev root NOFD /proc/96155/task/96576/fd (opendir: Permission denied) 2023-09-30T17:04:34.472 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96578 m-fin-ios root cwd unknown /proc/96155/task/96578/cwd (readlink: Permission denied) 2023-09-30T17:04:34.473 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96578 m-fin-ios root rtd unknown /proc/96155/task/96578/root (readlink: Permission denied) 2023-09-30T17:04:34.473 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96578 m-fin-ios root txt unknown /proc/96155/task/96578/exe (readlink: Permission denied) 2023-09-30T17:04:34.473 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96578 m-fin-ios root NOFD /proc/96155/task/96578/fd (opendir: Permission denied) 2023-09-30T17:04:34.473 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96580 m-fin-nfs root cwd unknown /proc/96155/task/96580/cwd (readlink: Permission denied) 2023-09-30T17:04:34.473 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96580 m-fin-nfs root rtd unknown /proc/96155/task/96580/root (readlink: Permission denied) 2023-09-30T17:04:34.473 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96580 m-fin-nfs root txt unknown /proc/96155/task/96580/exe (readlink: Permission denied) 2023-09-30T17:04:34.473 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96580 m-fin-nfs root NOFD /proc/96155/task/96580/fd (opendir: Permission denied) 2023-09-30T17:04:34.473 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96582 m-fin-orc root cwd unknown /proc/96155/task/96582/cwd (readlink: Permission denied) 2023-09-30T17:04:34.473 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96582 m-fin-orc root rtd unknown /proc/96155/task/96582/root (readlink: Permission denied) 2023-09-30T17:04:34.473 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96582 m-fin-orc root txt unknown /proc/96155/task/96582/exe (readlink: Permission denied) 2023-09-30T17:04:34.473 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96582 m-fin-orc root NOFD /proc/96155/task/96582/fd (opendir: Permission denied) 2023-09-30T17:04:34.474 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96583 pg_autosc root cwd unknown /proc/96155/task/96583/cwd (readlink: Permission denied) 2023-09-30T17:04:34.474 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96583 pg_autosc root rtd unknown /proc/96155/task/96583/root (readlink: Permission denied) 2023-09-30T17:04:34.474 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96583 pg_autosc root txt unknown /proc/96155/task/96583/exe (readlink: Permission denied) 2023-09-30T17:04:34.474 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96583 pg_autosc root NOFD /proc/96155/task/96583/fd (opendir: Permission denied) 2023-09-30T17:04:34.474 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96584 m-fin-pg_ root cwd unknown /proc/96155/task/96584/cwd (readlink: Permission denied) 2023-09-30T17:04:34.474 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96584 m-fin-pg_ root rtd unknown /proc/96155/task/96584/root (readlink: Permission denied) 2023-09-30T17:04:34.474 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96584 m-fin-pg_ root txt unknown /proc/96155/task/96584/exe (readlink: Permission denied) 2023-09-30T17:04:34.474 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96584 m-fin-pg_ root NOFD /proc/96155/task/96584/fd (opendir: Permission denied) 2023-09-30T17:04:34.474 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96585 progress root cwd unknown /proc/96155/task/96585/cwd (readlink: Permission denied) 2023-09-30T17:04:34.474 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96585 progress root rtd unknown /proc/96155/task/96585/root (readlink: Permission denied) 2023-09-30T17:04:34.474 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96585 progress root txt unknown /proc/96155/task/96585/exe (readlink: Permission denied) 2023-09-30T17:04:34.475 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96585 progress root NOFD /proc/96155/task/96585/fd (opendir: Permission denied) 2023-09-30T17:04:34.475 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96586 m-fin-pro root cwd unknown /proc/96155/task/96586/cwd (readlink: Permission denied) 2023-09-30T17:04:34.475 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96586 m-fin-pro root rtd unknown /proc/96155/task/96586/root (readlink: Permission denied) 2023-09-30T17:04:34.475 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96586 m-fin-pro root txt unknown /proc/96155/task/96586/exe (readlink: Permission denied) 2023-09-30T17:04:34.475 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96586 m-fin-pro root NOFD /proc/96155/task/96586/fd (opendir: Permission denied) 2023-09-30T17:04:34.475 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96590 io_contex root cwd unknown /proc/96155/task/96590/cwd (readlink: Permission denied) 2023-09-30T17:04:34.475 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96590 io_contex root rtd unknown /proc/96155/task/96590/root (readlink: Permission denied) 2023-09-30T17:04:34.475 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96590 io_contex root txt unknown /proc/96155/task/96590/exe (readlink: Permission denied) 2023-09-30T17:04:34.475 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96590 io_contex root NOFD /proc/96155/task/96590/fd (opendir: Permission denied) 2023-09-30T17:04:34.475 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96591 io_contex root cwd unknown /proc/96155/task/96591/cwd (readlink: Permission denied) 2023-09-30T17:04:34.475 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96591 io_contex root rtd unknown /proc/96155/task/96591/root (readlink: Permission denied) 2023-09-30T17:04:34.475 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96591 io_contex root txt unknown /proc/96155/task/96591/exe (readlink: Permission denied) 2023-09-30T17:04:34.476 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96591 io_contex root NOFD /proc/96155/task/96591/fd (opendir: Permission denied) 2023-09-30T17:04:34.476 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96592 ceph_time root cwd unknown /proc/96155/task/96592/cwd (readlink: Permission denied) 2023-09-30T17:04:34.476 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96592 ceph_time root rtd unknown /proc/96155/task/96592/root (readlink: Permission denied) 2023-09-30T17:04:34.476 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96592 ceph_time root txt unknown /proc/96155/task/96592/exe (readlink: Permission denied) 2023-09-30T17:04:34.476 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96592 ceph_time root NOFD /proc/96155/task/96592/fd (opendir: Permission denied) 2023-09-30T17:04:34.476 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96593 ms_dispat root cwd unknown /proc/96155/task/96593/cwd (readlink: Permission denied) 2023-09-30T17:04:34.476 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96593 ms_dispat root rtd unknown /proc/96155/task/96593/root (readlink: Permission denied) 2023-09-30T17:04:34.476 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96593 ms_dispat root txt unknown /proc/96155/task/96593/exe (readlink: Permission denied) 2023-09-30T17:04:34.476 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96593 ms_dispat root NOFD /proc/96155/task/96593/fd (opendir: Permission denied) 2023-09-30T17:04:34.476 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96594 ms_local root cwd unknown /proc/96155/task/96594/cwd (readlink: Permission denied) 2023-09-30T17:04:34.476 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96594 ms_local root rtd unknown /proc/96155/task/96594/root (readlink: Permission denied) 2023-09-30T17:04:34.477 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96594 ms_local root txt unknown /proc/96155/task/96594/exe (readlink: Permission denied) 2023-09-30T17:04:34.477 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96594 ms_local root NOFD /proc/96155/task/96594/fd (opendir: Permission denied) 2023-09-30T17:04:34.477 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96595 safe_time root cwd unknown /proc/96155/task/96595/cwd (readlink: Permission denied) 2023-09-30T17:04:34.477 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96595 safe_time root rtd unknown /proc/96155/task/96595/root (readlink: Permission denied) 2023-09-30T17:04:34.477 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96595 safe_time root txt unknown /proc/96155/task/96595/exe (readlink: Permission denied) 2023-09-30T17:04:34.477 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96595 safe_time root NOFD /proc/96155/task/96595/fd (opendir: Permission denied) 2023-09-30T17:04:34.477 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96596 safe_time root cwd unknown /proc/96155/task/96596/cwd (readlink: Permission denied) 2023-09-30T17:04:34.477 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96596 safe_time root rtd unknown /proc/96155/task/96596/root (readlink: Permission denied) 2023-09-30T17:04:34.477 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96596 safe_time root txt unknown /proc/96155/task/96596/exe (readlink: Permission denied) 2023-09-30T17:04:34.477 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96596 safe_time root NOFD /proc/96155/task/96596/fd (opendir: Permission denied) 2023-09-30T17:04:34.477 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96597 mgr-fin root cwd unknown /proc/96155/task/96597/cwd (readlink: Permission denied) 2023-09-30T17:04:34.477 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96597 mgr-fin root rtd unknown /proc/96155/task/96597/root (readlink: Permission denied) 2023-09-30T17:04:34.478 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96597 mgr-fin root txt unknown /proc/96155/task/96597/exe (readlink: Permission denied) 2023-09-30T17:04:34.478 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96597 mgr-fin root NOFD /proc/96155/task/96597/fd (opendir: Permission denied) 2023-09-30T17:04:34.478 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96599 m-fin-rbd root cwd unknown /proc/96155/task/96599/cwd (readlink: Permission denied) 2023-09-30T17:04:34.478 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96599 m-fin-rbd root rtd unknown /proc/96155/task/96599/root (readlink: Permission denied) 2023-09-30T17:04:34.478 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96599 m-fin-rbd root txt unknown /proc/96155/task/96599/exe (readlink: Permission denied) 2023-09-30T17:04:34.478 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96599 m-fin-rbd root NOFD /proc/96155/task/96599/fd (opendir: Permission denied) 2023-09-30T17:04:34.478 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96600 restful root cwd unknown /proc/96155/task/96600/cwd (readlink: Permission denied) 2023-09-30T17:04:34.478 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96600 restful root rtd unknown /proc/96155/task/96600/root (readlink: Permission denied) 2023-09-30T17:04:34.478 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96600 restful root txt unknown /proc/96155/task/96600/exe (readlink: Permission denied) 2023-09-30T17:04:34.478 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96600 restful root NOFD /proc/96155/task/96600/fd (opendir: Permission denied) 2023-09-30T17:04:34.478 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96601 m-fin-res root cwd unknown /proc/96155/task/96601/cwd (readlink: Permission denied) 2023-09-30T17:04:34.478 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96601 m-fin-res root rtd unknown /proc/96155/task/96601/root (readlink: Permission denied) 2023-09-30T17:04:34.479 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96601 m-fin-res root txt unknown /proc/96155/task/96601/exe (readlink: Permission denied) 2023-09-30T17:04:34.479 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96601 m-fin-res root NOFD /proc/96155/task/96601/fd (opendir: Permission denied) 2023-09-30T17:04:34.479 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96603 m-fin-sta root cwd unknown /proc/96155/task/96603/cwd (readlink: Permission denied) 2023-09-30T17:04:34.479 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96603 m-fin-sta root rtd unknown /proc/96155/task/96603/root (readlink: Permission denied) 2023-09-30T17:04:34.479 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96603 m-fin-sta root txt unknown /proc/96155/task/96603/exe (readlink: Permission denied) 2023-09-30T17:04:34.479 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96603 m-fin-sta root NOFD /proc/96155/task/96603/fd (opendir: Permission denied) 2023-09-30T17:04:34.479 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96604 mgr-fin root cwd unknown /proc/96155/task/96604/cwd (readlink: Permission denied) 2023-09-30T17:04:34.479 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96604 mgr-fin root rtd unknown /proc/96155/task/96604/root (readlink: Permission denied) 2023-09-30T17:04:34.479 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96604 mgr-fin root txt unknown /proc/96155/task/96604/exe (readlink: Permission denied) 2023-09-30T17:04:34.479 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96604 mgr-fin root NOFD /proc/96155/task/96604/fd (opendir: Permission denied) 2023-09-30T17:04:34.479 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96605 mgr-fin root cwd unknown /proc/96155/task/96605/cwd (readlink: Permission denied) 2023-09-30T17:04:34.480 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96605 mgr-fin root rtd unknown /proc/96155/task/96605/root (readlink: Permission denied) 2023-09-30T17:04:34.480 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96605 mgr-fin root txt unknown /proc/96155/task/96605/exe (readlink: Permission denied) 2023-09-30T17:04:34.480 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96605 mgr-fin root NOFD /proc/96155/task/96605/fd (opendir: Permission denied) 2023-09-30T17:04:34.480 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96606 mgr-fin root cwd unknown /proc/96155/task/96606/cwd (readlink: Permission denied) 2023-09-30T17:04:34.480 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96606 mgr-fin root rtd unknown /proc/96155/task/96606/root (readlink: Permission denied) 2023-09-30T17:04:34.480 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96606 mgr-fin root txt unknown /proc/96155/task/96606/exe (readlink: Permission denied) 2023-09-30T17:04:34.480 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96606 mgr-fin root NOFD /proc/96155/task/96606/fd (opendir: Permission denied) 2023-09-30T17:04:34.480 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96607 telemetry root cwd unknown /proc/96155/task/96607/cwd (readlink: Permission denied) 2023-09-30T17:04:34.480 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96607 telemetry root rtd unknown /proc/96155/task/96607/root (readlink: Permission denied) 2023-09-30T17:04:34.480 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96607 telemetry root txt unknown /proc/96155/task/96607/exe (readlink: Permission denied) 2023-09-30T17:04:34.480 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96607 telemetry root NOFD /proc/96155/task/96607/fd (opendir: Permission denied) 2023-09-30T17:04:34.480 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96608 m-fin-tel root cwd unknown /proc/96155/task/96608/cwd (readlink: Permission denied) 2023-09-30T17:04:34.481 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96608 m-fin-tel root rtd unknown /proc/96155/task/96608/root (readlink: Permission denied) 2023-09-30T17:04:34.481 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96608 m-fin-tel root txt unknown /proc/96155/task/96608/exe (readlink: Permission denied) 2023-09-30T17:04:34.481 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96608 m-fin-tel root NOFD /proc/96155/task/96608/fd (opendir: Permission denied) 2023-09-30T17:04:34.481 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96609 mgr-fin root cwd unknown /proc/96155/task/96609/cwd (readlink: Permission denied) 2023-09-30T17:04:34.481 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96609 mgr-fin root rtd unknown /proc/96155/task/96609/root (readlink: Permission denied) 2023-09-30T17:04:34.481 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96609 mgr-fin root txt unknown /proc/96155/task/96609/exe (readlink: Permission denied) 2023-09-30T17:04:34.481 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96609 mgr-fin root NOFD /proc/96155/task/96609/fd (opendir: Permission denied) 2023-09-30T17:04:34.481 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96610 mgr-fin root cwd unknown /proc/96155/task/96610/cwd (readlink: Permission denied) 2023-09-30T17:04:34.481 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96610 mgr-fin root rtd unknown /proc/96155/task/96610/root (readlink: Permission denied) 2023-09-30T17:04:34.481 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96610 mgr-fin root txt unknown /proc/96155/task/96610/exe (readlink: Permission denied) 2023-09-30T17:04:34.481 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96610 mgr-fin root NOFD /proc/96155/task/96610/fd (opendir: Permission denied) 2023-09-30T17:04:34.481 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96614 io_contex root cwd unknown /proc/96155/task/96614/cwd (readlink: Permission denied) 2023-09-30T17:04:34.482 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96614 io_contex root rtd unknown /proc/96155/task/96614/root (readlink: Permission denied) 2023-09-30T17:04:34.482 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96614 io_contex root txt unknown /proc/96155/task/96614/exe (readlink: Permission denied) 2023-09-30T17:04:34.482 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96614 io_contex root NOFD /proc/96155/task/96614/fd (opendir: Permission denied) 2023-09-30T17:04:34.482 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96615 io_contex root cwd unknown /proc/96155/task/96615/cwd (readlink: Permission denied) 2023-09-30T17:04:34.482 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96615 io_contex root rtd unknown /proc/96155/task/96615/root (readlink: Permission denied) 2023-09-30T17:04:34.482 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96615 io_contex root txt unknown /proc/96155/task/96615/exe (readlink: Permission denied) 2023-09-30T17:04:34.482 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96615 io_contex root NOFD /proc/96155/task/96615/fd (opendir: Permission denied) 2023-09-30T17:04:34.482 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96616 ceph_time root cwd unknown /proc/96155/task/96616/cwd (readlink: Permission denied) 2023-09-30T17:04:34.482 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96616 ceph_time root rtd unknown /proc/96155/task/96616/root (readlink: Permission denied) 2023-09-30T17:04:34.482 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96616 ceph_time root txt unknown /proc/96155/task/96616/exe (readlink: Permission denied) 2023-09-30T17:04:34.482 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96616 ceph_time root NOFD /proc/96155/task/96616/fd (opendir: Permission denied) 2023-09-30T17:04:34.483 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96617 ms_dispat root cwd unknown /proc/96155/task/96617/cwd (readlink: Permission denied) 2023-09-30T17:04:34.483 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96617 ms_dispat root rtd unknown /proc/96155/task/96617/root (readlink: Permission denied) 2023-09-30T17:04:34.483 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96617 ms_dispat root txt unknown /proc/96155/task/96617/exe (readlink: Permission denied) 2023-09-30T17:04:34.483 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96617 ms_dispat root NOFD /proc/96155/task/96617/fd (opendir: Permission denied) 2023-09-30T17:04:34.483 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96618 ms_local root cwd unknown /proc/96155/task/96618/cwd (readlink: Permission denied) 2023-09-30T17:04:34.483 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96618 ms_local root rtd unknown /proc/96155/task/96618/root (readlink: Permission denied) 2023-09-30T17:04:34.483 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96618 ms_local root txt unknown /proc/96155/task/96618/exe (readlink: Permission denied) 2023-09-30T17:04:34.483 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96618 ms_local root NOFD /proc/96155/task/96618/fd (opendir: Permission denied) 2023-09-30T17:04:34.483 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96619 safe_time root cwd unknown /proc/96155/task/96619/cwd (readlink: Permission denied) 2023-09-30T17:04:34.483 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96619 safe_time root rtd unknown /proc/96155/task/96619/root (readlink: Permission denied) 2023-09-30T17:04:34.483 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96619 safe_time root txt unknown /proc/96155/task/96619/exe (readlink: Permission denied) 2023-09-30T17:04:34.483 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96619 safe_time root NOFD /proc/96155/task/96619/fd (opendir: Permission denied) 2023-09-30T17:04:34.484 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96620 safe_time root cwd unknown /proc/96155/task/96620/cwd (readlink: Permission denied) 2023-09-30T17:04:34.484 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96620 safe_time root rtd unknown /proc/96155/task/96620/root (readlink: Permission denied) 2023-09-30T17:04:34.484 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96620 safe_time root txt unknown /proc/96155/task/96620/exe (readlink: Permission denied) 2023-09-30T17:04:34.484 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96620 safe_time root NOFD /proc/96155/task/96620/fd (opendir: Permission denied) 2023-09-30T17:04:34.484 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96621 mgr-fin root cwd unknown /proc/96155/task/96621/cwd (readlink: Permission denied) 2023-09-30T17:04:34.484 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96621 mgr-fin root rtd unknown /proc/96155/task/96621/root (readlink: Permission denied) 2023-09-30T17:04:34.484 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96621 mgr-fin root txt unknown /proc/96155/task/96621/exe (readlink: Permission denied) 2023-09-30T17:04:34.484 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96621 mgr-fin root NOFD /proc/96155/task/96621/fd (opendir: Permission denied) 2023-09-30T17:04:34.484 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96622 mgr-fin root cwd unknown /proc/96155/task/96622/cwd (readlink: Permission denied) 2023-09-30T17:04:34.484 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96622 mgr-fin root rtd unknown /proc/96155/task/96622/root (readlink: Permission denied) 2023-09-30T17:04:34.484 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96622 mgr-fin root txt unknown /proc/96155/task/96622/exe (readlink: Permission denied) 2023-09-30T17:04:34.484 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96622 mgr-fin root NOFD /proc/96155/task/96622/fd (opendir: Permission denied) 2023-09-30T17:04:34.485 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96623 mgr-fin root cwd unknown /proc/96155/task/96623/cwd (readlink: Permission denied) 2023-09-30T17:04:34.485 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96623 mgr-fin root rtd unknown /proc/96155/task/96623/root (readlink: Permission denied) 2023-09-30T17:04:34.485 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96623 mgr-fin root txt unknown /proc/96155/task/96623/exe (readlink: Permission denied) 2023-09-30T17:04:34.485 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96623 mgr-fin root NOFD /proc/96155/task/96623/fd (opendir: Permission denied) 2023-09-30T17:04:34.485 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96624 mgr-fin root cwd unknown /proc/96155/task/96624/cwd (readlink: Permission denied) 2023-09-30T17:04:34.485 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96624 mgr-fin root rtd unknown /proc/96155/task/96624/root (readlink: Permission denied) 2023-09-30T17:04:34.485 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96624 mgr-fin root txt unknown /proc/96155/task/96624/exe (readlink: Permission denied) 2023-09-30T17:04:34.485 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96624 mgr-fin root NOFD /proc/96155/task/96624/fd (opendir: Permission denied) 2023-09-30T17:04:34.485 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96625 mgr-fin root cwd unknown /proc/96155/task/96625/cwd (readlink: Permission denied) 2023-09-30T17:04:34.485 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96625 mgr-fin root rtd unknown /proc/96155/task/96625/root (readlink: Permission denied) 2023-09-30T17:04:34.485 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96625 mgr-fin root txt unknown /proc/96155/task/96625/exe (readlink: Permission denied) 2023-09-30T17:04:34.486 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96625 mgr-fin root NOFD /proc/96155/task/96625/fd (opendir: Permission denied) 2023-09-30T17:04:34.486 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96626 mgr-fin root cwd unknown /proc/96155/task/96626/cwd (readlink: Permission denied) 2023-09-30T17:04:34.486 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96626 mgr-fin root rtd unknown /proc/96155/task/96626/root (readlink: Permission denied) 2023-09-30T17:04:34.486 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96626 mgr-fin root txt unknown /proc/96155/task/96626/exe (readlink: Permission denied) 2023-09-30T17:04:34.486 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96626 mgr-fin root NOFD /proc/96155/task/96626/fd (opendir: Permission denied) 2023-09-30T17:04:34.486 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96627 mgr-fin root cwd unknown /proc/96155/task/96627/cwd (readlink: Permission denied) 2023-09-30T17:04:34.486 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96627 mgr-fin root rtd unknown /proc/96155/task/96627/root (readlink: Permission denied) 2023-09-30T17:04:34.486 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96627 mgr-fin root txt unknown /proc/96155/task/96627/exe (readlink: Permission denied) 2023-09-30T17:04:34.486 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96627 mgr-fin root NOFD /proc/96155/task/96627/fd (opendir: Permission denied) 2023-09-30T17:04:34.486 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96628 mgr-fin root cwd unknown /proc/96155/task/96628/cwd (readlink: Permission denied) 2023-09-30T17:04:34.486 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96628 mgr-fin root rtd unknown /proc/96155/task/96628/root (readlink: Permission denied) 2023-09-30T17:04:34.487 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96628 mgr-fin root txt unknown /proc/96155/task/96628/exe (readlink: Permission denied) 2023-09-30T17:04:34.487 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96628 mgr-fin root NOFD /proc/96155/task/96628/fd (opendir: Permission denied) 2023-09-30T17:04:34.487 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96629 mgr-fin root cwd unknown /proc/96155/task/96629/cwd (readlink: Permission denied) 2023-09-30T17:04:34.487 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96629 mgr-fin root rtd unknown /proc/96155/task/96629/root (readlink: Permission denied) 2023-09-30T17:04:34.487 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96629 mgr-fin root txt unknown /proc/96155/task/96629/exe (readlink: Permission denied) 2023-09-30T17:04:34.487 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96629 mgr-fin root NOFD /proc/96155/task/96629/fd (opendir: Permission denied) 2023-09-30T17:04:34.487 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96630 mgr-fin root cwd unknown /proc/96155/task/96630/cwd (readlink: Permission denied) 2023-09-30T17:04:34.487 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96630 mgr-fin root rtd unknown /proc/96155/task/96630/root (readlink: Permission denied) 2023-09-30T17:04:34.487 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96630 mgr-fin root txt unknown /proc/96155/task/96630/exe (readlink: Permission denied) 2023-09-30T17:04:34.487 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96630 mgr-fin root NOFD /proc/96155/task/96630/fd (opendir: Permission denied) 2023-09-30T17:04:34.487 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96631 mgr-fin root cwd unknown /proc/96155/task/96631/cwd (readlink: Permission denied) 2023-09-30T17:04:34.487 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96631 mgr-fin root rtd unknown /proc/96155/task/96631/root (readlink: Permission denied) 2023-09-30T17:04:34.488 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96631 mgr-fin root txt unknown /proc/96155/task/96631/exe (readlink: Permission denied) 2023-09-30T17:04:34.488 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96631 mgr-fin root NOFD /proc/96155/task/96631/fd (opendir: Permission denied) 2023-09-30T17:04:34.488 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96632 mgr-fin root cwd unknown /proc/96155/task/96632/cwd (readlink: Permission denied) 2023-09-30T17:04:34.488 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96632 mgr-fin root rtd unknown /proc/96155/task/96632/root (readlink: Permission denied) 2023-09-30T17:04:34.488 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96632 mgr-fin root txt unknown /proc/96155/task/96632/exe (readlink: Permission denied) 2023-09-30T17:04:34.488 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96632 mgr-fin root NOFD /proc/96155/task/96632/fd (opendir: Permission denied) 2023-09-30T17:04:34.488 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96634 m-fin-vol root cwd unknown /proc/96155/task/96634/cwd (readlink: Permission denied) 2023-09-30T17:04:34.488 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96634 m-fin-vol root rtd unknown /proc/96155/task/96634/root (readlink: Permission denied) 2023-09-30T17:04:34.488 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96634 m-fin-vol root txt unknown /proc/96155/task/96634/exe (readlink: Permission denied) 2023-09-30T17:04:34.488 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96634 m-fin-vol root NOFD /proc/96155/task/96634/fd (opendir: Permission denied) 2023-09-30T17:04:34.488 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96680 devicehea root cwd unknown /proc/96155/task/96680/cwd (readlink: Permission denied) 2023-09-30T17:04:34.489 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96680 devicehea root rtd unknown /proc/96155/task/96680/root (readlink: Permission denied) 2023-09-30T17:04:34.489 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96680 devicehea root txt unknown /proc/96155/task/96680/exe (readlink: Permission denied) 2023-09-30T17:04:34.489 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96680 devicehea root NOFD /proc/96155/task/96680/fd (opendir: Permission denied) 2023-09-30T17:04:34.489 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96684 io_contex root cwd unknown /proc/96155/task/96684/cwd (readlink: Permission denied) 2023-09-30T17:04:34.489 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96684 io_contex root rtd unknown /proc/96155/task/96684/root (readlink: Permission denied) 2023-09-30T17:04:34.489 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96684 io_contex root txt unknown /proc/96155/task/96684/exe (readlink: Permission denied) 2023-09-30T17:04:34.489 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96684 io_contex root NOFD /proc/96155/task/96684/fd (opendir: Permission denied) 2023-09-30T17:04:34.489 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96685 io_contex root cwd unknown /proc/96155/task/96685/cwd (readlink: Permission denied) 2023-09-30T17:04:34.489 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96685 io_contex root rtd unknown /proc/96155/task/96685/root (readlink: Permission denied) 2023-09-30T17:04:34.489 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96685 io_contex root txt unknown /proc/96155/task/96685/exe (readlink: Permission denied) 2023-09-30T17:04:34.489 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96685 io_contex root NOFD /proc/96155/task/96685/fd (opendir: Permission denied) 2023-09-30T17:04:34.489 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96686 ceph_time root cwd unknown /proc/96155/task/96686/cwd (readlink: Permission denied) 2023-09-30T17:04:34.490 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96686 ceph_time root rtd unknown /proc/96155/task/96686/root (readlink: Permission denied) 2023-09-30T17:04:34.490 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96686 ceph_time root txt unknown /proc/96155/task/96686/exe (readlink: Permission denied) 2023-09-30T17:04:34.490 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96686 ceph_time root NOFD /proc/96155/task/96686/fd (opendir: Permission denied) 2023-09-30T17:04:34.490 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96687 ms_dispat root cwd unknown /proc/96155/task/96687/cwd (readlink: Permission denied) 2023-09-30T17:04:34.490 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96687 ms_dispat root rtd unknown /proc/96155/task/96687/root (readlink: Permission denied) 2023-09-30T17:04:34.490 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96687 ms_dispat root txt unknown /proc/96155/task/96687/exe (readlink: Permission denied) 2023-09-30T17:04:34.490 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96687 ms_dispat root NOFD /proc/96155/task/96687/fd (opendir: Permission denied) 2023-09-30T17:04:34.490 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96688 ms_local root cwd unknown /proc/96155/task/96688/cwd (readlink: Permission denied) 2023-09-30T17:04:34.490 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96688 ms_local root rtd unknown /proc/96155/task/96688/root (readlink: Permission denied) 2023-09-30T17:04:34.490 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96688 ms_local root txt unknown /proc/96155/task/96688/exe (readlink: Permission denied) 2023-09-30T17:04:34.490 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96688 ms_local root NOFD /proc/96155/task/96688/fd (opendir: Permission denied) 2023-09-30T17:04:34.490 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96689 safe_time root cwd unknown /proc/96155/task/96689/cwd (readlink: Permission denied) 2023-09-30T17:04:34.491 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96689 safe_time root rtd unknown /proc/96155/task/96689/root (readlink: Permission denied) 2023-09-30T17:04:34.491 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96689 safe_time root txt unknown /proc/96155/task/96689/exe (readlink: Permission denied) 2023-09-30T17:04:34.491 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96689 safe_time root NOFD /proc/96155/task/96689/fd (opendir: Permission denied) 2023-09-30T17:04:34.491 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96690 safe_time root cwd unknown /proc/96155/task/96690/cwd (readlink: Permission denied) 2023-09-30T17:04:34.491 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96690 safe_time root rtd unknown /proc/96155/task/96690/root (readlink: Permission denied) 2023-09-30T17:04:34.491 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96690 safe_time root txt unknown /proc/96155/task/96690/exe (readlink: Permission denied) 2023-09-30T17:04:34.491 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96155 96690 safe_time root NOFD /proc/96155/task/96690/fd (opendir: Permission denied) 2023-09-30T17:04:34.491 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 root cwd unknown /proc/96156/cwd (readlink: Permission denied) 2023-09-30T17:04:34.491 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 root rtd unknown /proc/96156/root (readlink: Permission denied) 2023-09-30T17:04:34.491 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 root txt unknown /proc/96156/exe (readlink: Permission denied) 2023-09-30T17:04:34.491 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 root NOFD /proc/96156/fd (opendir: Permission denied) 2023-09-30T17:04:34.491 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96170 log root cwd unknown /proc/96156/task/96170/cwd (readlink: Permission denied) 2023-09-30T17:04:34.492 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96170 log root rtd unknown /proc/96156/task/96170/root (readlink: Permission denied) 2023-09-30T17:04:34.492 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96170 log root txt unknown /proc/96156/task/96170/exe (readlink: Permission denied) 2023-09-30T17:04:34.492 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96170 log root NOFD /proc/96156/task/96170/fd (opendir: Permission denied) 2023-09-30T17:04:34.492 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96172 service root cwd unknown /proc/96156/task/96172/cwd (readlink: Permission denied) 2023-09-30T17:04:34.492 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96172 service root rtd unknown /proc/96156/task/96172/root (readlink: Permission denied) 2023-09-30T17:04:34.492 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96172 service root txt unknown /proc/96156/task/96172/exe (readlink: Permission denied) 2023-09-30T17:04:34.492 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96172 service root NOFD /proc/96156/task/96172/fd (opendir: Permission denied) 2023-09-30T17:04:34.492 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96173 admin_soc root cwd unknown /proc/96156/task/96173/cwd (readlink: Permission denied) 2023-09-30T17:04:34.492 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96173 admin_soc root rtd unknown /proc/96156/task/96173/root (readlink: Permission denied) 2023-09-30T17:04:34.492 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96173 admin_soc root txt unknown /proc/96156/task/96173/exe (readlink: Permission denied) 2023-09-30T17:04:34.492 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96173 admin_soc root NOFD /proc/96156/task/96173/fd (opendir: Permission denied) 2023-09-30T17:04:34.493 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96178 signal_ha root cwd unknown /proc/96156/task/96178/cwd (readlink: Permission denied) 2023-09-30T17:04:34.493 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96178 signal_ha root rtd unknown /proc/96156/task/96178/root (readlink: Permission denied) 2023-09-30T17:04:34.493 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96178 signal_ha root txt unknown /proc/96156/task/96178/exe (readlink: Permission denied) 2023-09-30T17:04:34.493 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96178 signal_ha root NOFD /proc/96156/task/96178/fd (opendir: Permission denied) 2023-09-30T17:04:34.493 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96180 rocksdb:l root cwd unknown /proc/96156/task/96180/cwd (readlink: Permission denied) 2023-09-30T17:04:34.493 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96180 rocksdb:l root rtd unknown /proc/96156/task/96180/root (readlink: Permission denied) 2023-09-30T17:04:34.493 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96180 rocksdb:l root txt unknown /proc/96156/task/96180/exe (readlink: Permission denied) 2023-09-30T17:04:34.493 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96180 rocksdb:l root NOFD /proc/96156/task/96180/fd (opendir: Permission denied) 2023-09-30T17:04:34.493 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96181 rocksdb:h root cwd unknown /proc/96156/task/96181/cwd (readlink: Permission denied) 2023-09-30T17:04:34.493 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96181 rocksdb:h root rtd unknown /proc/96156/task/96181/root (readlink: Permission denied) 2023-09-30T17:04:34.493 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96181 rocksdb:h root txt unknown /proc/96156/task/96181/exe (readlink: Permission denied) 2023-09-30T17:04:34.493 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96181 rocksdb:h root NOFD /proc/96156/task/96181/fd (opendir: Permission denied) 2023-09-30T17:04:34.494 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96213 ceph-mon root cwd unknown /proc/96156/task/96213/cwd (readlink: Permission denied) 2023-09-30T17:04:34.494 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96213 ceph-mon root rtd unknown /proc/96156/task/96213/root (readlink: Permission denied) 2023-09-30T17:04:34.494 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96213 ceph-mon root txt unknown /proc/96156/task/96213/exe (readlink: Permission denied) 2023-09-30T17:04:34.494 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96213 ceph-mon root NOFD /proc/96156/task/96213/fd (opendir: Permission denied) 2023-09-30T17:04:34.494 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96215 fn_monsto root cwd unknown /proc/96156/task/96215/cwd (readlink: Permission denied) 2023-09-30T17:04:34.495 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96215 fn_monsto root rtd unknown /proc/96156/task/96215/root (readlink: Permission denied) 2023-09-30T17:04:34.495 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96215 fn_monsto root txt unknown /proc/96156/task/96215/exe (readlink: Permission denied) 2023-09-30T17:04:34.495 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96215 fn_monsto root NOFD /proc/96156/task/96215/fd (opendir: Permission denied) 2023-09-30T17:04:34.496 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96217 msgr-work root cwd unknown /proc/96156/task/96217/cwd (readlink: Permission denied) 2023-09-30T17:04:34.496 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96217 msgr-work root rtd unknown /proc/96156/task/96217/root (readlink: Permission denied) 2023-09-30T17:04:34.496 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96217 msgr-work root txt unknown /proc/96156/task/96217/exe (readlink: Permission denied) 2023-09-30T17:04:34.496 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96217 msgr-work root NOFD /proc/96156/task/96217/fd (opendir: Permission denied) 2023-09-30T17:04:34.496 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96219 msgr-work root cwd unknown /proc/96156/task/96219/cwd (readlink: Permission denied) 2023-09-30T17:04:34.496 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96219 msgr-work root rtd unknown /proc/96156/task/96219/root (readlink: Permission denied) 2023-09-30T17:04:34.496 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96219 msgr-work root txt unknown /proc/96156/task/96219/exe (readlink: Permission denied) 2023-09-30T17:04:34.496 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96219 msgr-work root NOFD /proc/96156/task/96219/fd (opendir: Permission denied) 2023-09-30T17:04:34.496 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96222 msgr-work root cwd unknown /proc/96156/task/96222/cwd (readlink: Permission denied) 2023-09-30T17:04:34.496 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96222 msgr-work root rtd unknown /proc/96156/task/96222/root (readlink: Permission denied) 2023-09-30T17:04:34.496 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96222 msgr-work root txt unknown /proc/96156/task/96222/exe (readlink: Permission denied) 2023-09-30T17:04:34.496 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96222 msgr-work root NOFD /proc/96156/task/96222/fd (opendir: Permission denied) 2023-09-30T17:04:34.497 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96224 OpHistory root cwd unknown /proc/96156/task/96224/cwd (readlink: Permission denied) 2023-09-30T17:04:34.497 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96224 OpHistory root rtd unknown /proc/96156/task/96224/root (readlink: Permission denied) 2023-09-30T17:04:34.497 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96224 OpHistory root txt unknown /proc/96156/task/96224/exe (readlink: Permission denied) 2023-09-30T17:04:34.497 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96224 OpHistory root NOFD /proc/96156/task/96224/fd (opendir: Permission denied) 2023-09-30T17:04:34.497 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96243 fin root cwd unknown /proc/96156/task/96243/cwd (readlink: Permission denied) 2023-09-30T17:04:34.497 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96243 fin root rtd unknown /proc/96156/task/96243/root (readlink: Permission denied) 2023-09-30T17:04:34.497 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96243 fin root txt unknown /proc/96156/task/96243/exe (readlink: Permission denied) 2023-09-30T17:04:34.497 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96243 fin root NOFD /proc/96156/task/96243/fd (opendir: Permission denied) 2023-09-30T17:04:34.497 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96245 safe_time root cwd unknown /proc/96156/task/96245/cwd (readlink: Permission denied) 2023-09-30T17:04:34.497 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96245 safe_time root rtd unknown /proc/96156/task/96245/root (readlink: Permission denied) 2023-09-30T17:04:34.497 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96245 safe_time root txt unknown /proc/96156/task/96245/exe (readlink: Permission denied) 2023-09-30T17:04:34.498 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96245 safe_time root NOFD /proc/96156/task/96245/fd (opendir: Permission denied) 2023-09-30T17:04:34.498 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96247 cpu_tp root cwd unknown /proc/96156/task/96247/cwd (readlink: Permission denied) 2023-09-30T17:04:34.498 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96247 cpu_tp root rtd unknown /proc/96156/task/96247/root (readlink: Permission denied) 2023-09-30T17:04:34.498 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96247 cpu_tp root txt unknown /proc/96156/task/96247/exe (readlink: Permission denied) 2023-09-30T17:04:34.498 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96247 cpu_tp root NOFD /proc/96156/task/96247/fd (opendir: Permission denied) 2023-09-30T17:04:34.498 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96249 cpu_tp root cwd unknown /proc/96156/task/96249/cwd (readlink: Permission denied) 2023-09-30T17:04:34.498 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96249 cpu_tp root rtd unknown /proc/96156/task/96249/root (readlink: Permission denied) 2023-09-30T17:04:34.498 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96249 cpu_tp root txt unknown /proc/96156/task/96249/exe (readlink: Permission denied) 2023-09-30T17:04:34.498 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96249 cpu_tp root NOFD /proc/96156/task/96249/fd (opendir: Permission denied) 2023-09-30T17:04:34.498 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96251 cpu_tp root cwd unknown /proc/96156/task/96251/cwd (readlink: Permission denied) 2023-09-30T17:04:34.498 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96251 cpu_tp root rtd unknown /proc/96156/task/96251/root (readlink: Permission denied) 2023-09-30T17:04:34.498 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96251 cpu_tp root txt unknown /proc/96156/task/96251/exe (readlink: Permission denied) 2023-09-30T17:04:34.499 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96251 cpu_tp root NOFD /proc/96156/task/96251/fd (opendir: Permission denied) 2023-09-30T17:04:34.499 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96252 cpu_tp root cwd unknown /proc/96156/task/96252/cwd (readlink: Permission denied) 2023-09-30T17:04:34.499 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96252 cpu_tp root rtd unknown /proc/96156/task/96252/root (readlink: Permission denied) 2023-09-30T17:04:34.499 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96252 cpu_tp root txt unknown /proc/96156/task/96252/exe (readlink: Permission denied) 2023-09-30T17:04:34.499 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96252 cpu_tp root NOFD /proc/96156/task/96252/fd (opendir: Permission denied) 2023-09-30T17:04:34.499 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96255 ms_dispat root cwd unknown /proc/96156/task/96255/cwd (readlink: Permission denied) 2023-09-30T17:04:34.499 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96255 ms_dispat root rtd unknown /proc/96156/task/96255/root (readlink: Permission denied) 2023-09-30T17:04:34.499 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96255 ms_dispat root txt unknown /proc/96156/task/96255/exe (readlink: Permission denied) 2023-09-30T17:04:34.499 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96255 ms_dispat root NOFD /proc/96156/task/96255/fd (opendir: Permission denied) 2023-09-30T17:04:34.499 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96257 ms_local root cwd unknown /proc/96156/task/96257/cwd (readlink: Permission denied) 2023-09-30T17:04:34.499 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96257 ms_local root rtd unknown /proc/96156/task/96257/root (readlink: Permission denied) 2023-09-30T17:04:34.499 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96257 ms_local root txt unknown /proc/96156/task/96257/exe (readlink: Permission denied) 2023-09-30T17:04:34.500 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96257 ms_local root NOFD /proc/96156/task/96257/fd (opendir: Permission denied) 2023-09-30T17:04:34.500 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96259 safe_time root cwd unknown /proc/96156/task/96259/cwd (readlink: Permission denied) 2023-09-30T17:04:34.500 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96259 safe_time root rtd unknown /proc/96156/task/96259/root (readlink: Permission denied) 2023-09-30T17:04:34.500 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96259 safe_time root txt unknown /proc/96156/task/96259/exe (readlink: Permission denied) 2023-09-30T17:04:34.500 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96259 safe_time root NOFD /proc/96156/task/96259/fd (opendir: Permission denied) 2023-09-30T17:04:34.500 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96262 ms_dispat root cwd unknown /proc/96156/task/96262/cwd (readlink: Permission denied) 2023-09-30T17:04:34.500 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96262 ms_dispat root rtd unknown /proc/96156/task/96262/root (readlink: Permission denied) 2023-09-30T17:04:34.500 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96262 ms_dispat root txt unknown /proc/96156/task/96262/exe (readlink: Permission denied) 2023-09-30T17:04:34.500 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96262 ms_dispat root NOFD /proc/96156/task/96262/fd (opendir: Permission denied) 2023-09-30T17:04:34.500 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96264 ms_local root cwd unknown /proc/96156/task/96264/cwd (readlink: Permission denied) 2023-09-30T17:04:34.500 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96264 ms_local root rtd unknown /proc/96156/task/96264/root (readlink: Permission denied) 2023-09-30T17:04:34.500 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96264 ms_local root txt unknown /proc/96156/task/96264/exe (readlink: Permission denied) 2023-09-30T17:04:34.501 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96156 96264 ms_local root NOFD /proc/96156/task/96264/fd (opendir: Permission denied) 2023-09-30T17:04:34.501 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 root cwd unknown /proc/96157/cwd (readlink: Permission denied) 2023-09-30T17:04:34.501 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 root rtd unknown /proc/96157/root (readlink: Permission denied) 2023-09-30T17:04:34.501 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 root txt unknown /proc/96157/exe (readlink: Permission denied) 2023-09-30T17:04:34.501 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 root NOFD /proc/96157/fd (opendir: Permission denied) 2023-09-30T17:04:34.501 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96168 log root cwd unknown /proc/96157/task/96168/cwd (readlink: Permission denied) 2023-09-30T17:04:34.501 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96168 log root rtd unknown /proc/96157/task/96168/root (readlink: Permission denied) 2023-09-30T17:04:34.501 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96168 log root txt unknown /proc/96157/task/96168/exe (readlink: Permission denied) 2023-09-30T17:04:34.501 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96168 log root NOFD /proc/96157/task/96168/fd (opendir: Permission denied) 2023-09-30T17:04:34.501 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96169 service root cwd unknown /proc/96157/task/96169/cwd (readlink: Permission denied) 2023-09-30T17:04:34.501 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96169 service root rtd unknown /proc/96157/task/96169/root (readlink: Permission denied) 2023-09-30T17:04:34.502 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96169 service root txt unknown /proc/96157/task/96169/exe (readlink: Permission denied) 2023-09-30T17:04:34.502 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96169 service root NOFD /proc/96157/task/96169/fd (opendir: Permission denied) 2023-09-30T17:04:34.502 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96171 admin_soc root cwd unknown /proc/96157/task/96171/cwd (readlink: Permission denied) 2023-09-30T17:04:34.502 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96171 admin_soc root rtd unknown /proc/96157/task/96171/root (readlink: Permission denied) 2023-09-30T17:04:34.502 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96171 admin_soc root txt unknown /proc/96157/task/96171/exe (readlink: Permission denied) 2023-09-30T17:04:34.502 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96171 admin_soc root NOFD /proc/96157/task/96171/fd (opendir: Permission denied) 2023-09-30T17:04:34.502 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96177 signal_ha root cwd unknown /proc/96157/task/96177/cwd (readlink: Permission denied) 2023-09-30T17:04:34.502 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96177 signal_ha root rtd unknown /proc/96157/task/96177/root (readlink: Permission denied) 2023-09-30T17:04:34.502 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96177 signal_ha root txt unknown /proc/96157/task/96177/exe (readlink: Permission denied) 2023-09-30T17:04:34.502 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96177 signal_ha root NOFD /proc/96157/task/96177/fd (opendir: Permission denied) 2023-09-30T17:04:34.502 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96179 rocksdb:l root cwd unknown /proc/96157/task/96179/cwd (readlink: Permission denied) 2023-09-30T17:04:34.502 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96179 rocksdb:l root rtd unknown /proc/96157/task/96179/root (readlink: Permission denied) 2023-09-30T17:04:34.503 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96179 rocksdb:l root txt unknown /proc/96157/task/96179/exe (readlink: Permission denied) 2023-09-30T17:04:34.503 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96179 rocksdb:l root NOFD /proc/96157/task/96179/fd (opendir: Permission denied) 2023-09-30T17:04:34.503 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96182 rocksdb:h root cwd unknown /proc/96157/task/96182/cwd (readlink: Permission denied) 2023-09-30T17:04:34.503 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96182 rocksdb:h root rtd unknown /proc/96157/task/96182/root (readlink: Permission denied) 2023-09-30T17:04:34.503 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96182 rocksdb:h root txt unknown /proc/96157/task/96182/exe (readlink: Permission denied) 2023-09-30T17:04:34.503 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96182 rocksdb:h root NOFD /proc/96157/task/96182/fd (opendir: Permission denied) 2023-09-30T17:04:34.503 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96214 ceph-mon root cwd unknown /proc/96157/task/96214/cwd (readlink: Permission denied) 2023-09-30T17:04:34.503 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96214 ceph-mon root rtd unknown /proc/96157/task/96214/root (readlink: Permission denied) 2023-09-30T17:04:34.503 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96214 ceph-mon root txt unknown /proc/96157/task/96214/exe (readlink: Permission denied) 2023-09-30T17:04:34.503 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96214 ceph-mon root NOFD /proc/96157/task/96214/fd (opendir: Permission denied) 2023-09-30T17:04:34.503 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96216 fn_monsto root cwd unknown /proc/96157/task/96216/cwd (readlink: Permission denied) 2023-09-30T17:04:34.503 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96216 fn_monsto root rtd unknown /proc/96157/task/96216/root (readlink: Permission denied) 2023-09-30T17:04:34.504 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96216 fn_monsto root txt unknown /proc/96157/task/96216/exe (readlink: Permission denied) 2023-09-30T17:04:34.504 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96216 fn_monsto root NOFD /proc/96157/task/96216/fd (opendir: Permission denied) 2023-09-30T17:04:34.504 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96218 msgr-work root cwd unknown /proc/96157/task/96218/cwd (readlink: Permission denied) 2023-09-30T17:04:34.504 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96218 msgr-work root rtd unknown /proc/96157/task/96218/root (readlink: Permission denied) 2023-09-30T17:04:34.504 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96218 msgr-work root txt unknown /proc/96157/task/96218/exe (readlink: Permission denied) 2023-09-30T17:04:34.504 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96218 msgr-work root NOFD /proc/96157/task/96218/fd (opendir: Permission denied) 2023-09-30T17:04:34.504 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96220 msgr-work root cwd unknown /proc/96157/task/96220/cwd (readlink: Permission denied) 2023-09-30T17:04:34.504 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96220 msgr-work root rtd unknown /proc/96157/task/96220/root (readlink: Permission denied) 2023-09-30T17:04:34.504 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96220 msgr-work root txt unknown /proc/96157/task/96220/exe (readlink: Permission denied) 2023-09-30T17:04:34.504 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96220 msgr-work root NOFD /proc/96157/task/96220/fd (opendir: Permission denied) 2023-09-30T17:04:34.504 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96221 msgr-work root cwd unknown /proc/96157/task/96221/cwd (readlink: Permission denied) 2023-09-30T17:04:34.504 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96221 msgr-work root rtd unknown /proc/96157/task/96221/root (readlink: Permission denied) 2023-09-30T17:04:34.505 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96221 msgr-work root txt unknown /proc/96157/task/96221/exe (readlink: Permission denied) 2023-09-30T17:04:34.505 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96221 msgr-work root NOFD /proc/96157/task/96221/fd (opendir: Permission denied) 2023-09-30T17:04:34.505 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96223 OpHistory root cwd unknown /proc/96157/task/96223/cwd (readlink: Permission denied) 2023-09-30T17:04:34.505 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96223 OpHistory root rtd unknown /proc/96157/task/96223/root (readlink: Permission denied) 2023-09-30T17:04:34.505 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96223 OpHistory root txt unknown /proc/96157/task/96223/exe (readlink: Permission denied) 2023-09-30T17:04:34.505 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96223 OpHistory root NOFD /proc/96157/task/96223/fd (opendir: Permission denied) 2023-09-30T17:04:34.505 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96244 fin root cwd unknown /proc/96157/task/96244/cwd (readlink: Permission denied) 2023-09-30T17:04:34.505 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96244 fin root rtd unknown /proc/96157/task/96244/root (readlink: Permission denied) 2023-09-30T17:04:34.505 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96244 fin root txt unknown /proc/96157/task/96244/exe (readlink: Permission denied) 2023-09-30T17:04:34.505 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96244 fin root NOFD /proc/96157/task/96244/fd (opendir: Permission denied) 2023-09-30T17:04:34.505 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96246 safe_time root cwd unknown /proc/96157/task/96246/cwd (readlink: Permission denied) 2023-09-30T17:04:34.505 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96246 safe_time root rtd unknown /proc/96157/task/96246/root (readlink: Permission denied) 2023-09-30T17:04:34.506 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96246 safe_time root txt unknown /proc/96157/task/96246/exe (readlink: Permission denied) 2023-09-30T17:04:34.506 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96246 safe_time root NOFD /proc/96157/task/96246/fd (opendir: Permission denied) 2023-09-30T17:04:34.506 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96248 cpu_tp root cwd unknown /proc/96157/task/96248/cwd (readlink: Permission denied) 2023-09-30T17:04:34.506 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96248 cpu_tp root rtd unknown /proc/96157/task/96248/root (readlink: Permission denied) 2023-09-30T17:04:34.506 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96248 cpu_tp root txt unknown /proc/96157/task/96248/exe (readlink: Permission denied) 2023-09-30T17:04:34.506 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96248 cpu_tp root NOFD /proc/96157/task/96248/fd (opendir: Permission denied) 2023-09-30T17:04:34.506 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96250 cpu_tp root cwd unknown /proc/96157/task/96250/cwd (readlink: Permission denied) 2023-09-30T17:04:34.506 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96250 cpu_tp root rtd unknown /proc/96157/task/96250/root (readlink: Permission denied) 2023-09-30T17:04:34.506 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96250 cpu_tp root txt unknown /proc/96157/task/96250/exe (readlink: Permission denied) 2023-09-30T17:04:34.506 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96250 cpu_tp root NOFD /proc/96157/task/96250/fd (opendir: Permission denied) 2023-09-30T17:04:34.506 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96253 cpu_tp root cwd unknown /proc/96157/task/96253/cwd (readlink: Permission denied) 2023-09-30T17:04:34.507 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96253 cpu_tp root rtd unknown /proc/96157/task/96253/root (readlink: Permission denied) 2023-09-30T17:04:34.507 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96253 cpu_tp root txt unknown /proc/96157/task/96253/exe (readlink: Permission denied) 2023-09-30T17:04:34.507 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96253 cpu_tp root NOFD /proc/96157/task/96253/fd (opendir: Permission denied) 2023-09-30T17:04:34.507 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96254 cpu_tp root cwd unknown /proc/96157/task/96254/cwd (readlink: Permission denied) 2023-09-30T17:04:34.507 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96254 cpu_tp root rtd unknown /proc/96157/task/96254/root (readlink: Permission denied) 2023-09-30T17:04:34.507 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96254 cpu_tp root txt unknown /proc/96157/task/96254/exe (readlink: Permission denied) 2023-09-30T17:04:34.507 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96254 cpu_tp root NOFD /proc/96157/task/96254/fd (opendir: Permission denied) 2023-09-30T17:04:34.507 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96256 ms_dispat root cwd unknown /proc/96157/task/96256/cwd (readlink: Permission denied) 2023-09-30T17:04:34.507 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96256 ms_dispat root rtd unknown /proc/96157/task/96256/root (readlink: Permission denied) 2023-09-30T17:04:34.507 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96256 ms_dispat root txt unknown /proc/96157/task/96256/exe (readlink: Permission denied) 2023-09-30T17:04:34.507 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96256 ms_dispat root NOFD /proc/96157/task/96256/fd (opendir: Permission denied) 2023-09-30T17:04:34.507 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96258 ms_local root cwd unknown /proc/96157/task/96258/cwd (readlink: Permission denied) 2023-09-30T17:04:34.508 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96258 ms_local root rtd unknown /proc/96157/task/96258/root (readlink: Permission denied) 2023-09-30T17:04:34.508 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96258 ms_local root txt unknown /proc/96157/task/96258/exe (readlink: Permission denied) 2023-09-30T17:04:34.508 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96258 ms_local root NOFD /proc/96157/task/96258/fd (opendir: Permission denied) 2023-09-30T17:04:34.508 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96260 safe_time root cwd unknown /proc/96157/task/96260/cwd (readlink: Permission denied) 2023-09-30T17:04:34.508 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96260 safe_time root rtd unknown /proc/96157/task/96260/root (readlink: Permission denied) 2023-09-30T17:04:34.508 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96260 safe_time root txt unknown /proc/96157/task/96260/exe (readlink: Permission denied) 2023-09-30T17:04:34.508 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96260 safe_time root NOFD /proc/96157/task/96260/fd (opendir: Permission denied) 2023-09-30T17:04:34.508 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96261 ms_dispat root cwd unknown /proc/96157/task/96261/cwd (readlink: Permission denied) 2023-09-30T17:04:34.508 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96261 ms_dispat root rtd unknown /proc/96157/task/96261/root (readlink: Permission denied) 2023-09-30T17:04:34.508 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96261 ms_dispat root txt unknown /proc/96157/task/96261/exe (readlink: Permission denied) 2023-09-30T17:04:34.508 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96261 ms_dispat root NOFD /proc/96157/task/96261/fd (opendir: Permission denied) 2023-09-30T17:04:34.508 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96263 ms_local root cwd unknown /proc/96157/task/96263/cwd (readlink: Permission denied) 2023-09-30T17:04:34.509 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96263 ms_local root rtd unknown /proc/96157/task/96263/root (readlink: Permission denied) 2023-09-30T17:04:34.509 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96263 ms_local root txt unknown /proc/96157/task/96263/exe (readlink: Permission denied) 2023-09-30T17:04:34.509 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96157 96263 ms_local root NOFD /proc/96157/task/96263/fd (opendir: Permission denied) 2023-09-30T17:04:34.509 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 root cwd unknown /proc/96158/cwd (readlink: Permission denied) 2023-09-30T17:04:34.509 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 root rtd unknown /proc/96158/root (readlink: Permission denied) 2023-09-30T17:04:34.509 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 root txt unknown /proc/96158/exe (readlink: Permission denied) 2023-09-30T17:04:34.509 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 root NOFD /proc/96158/fd (opendir: Permission denied) 2023-09-30T17:04:34.509 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96174 log root cwd unknown /proc/96158/task/96174/cwd (readlink: Permission denied) 2023-09-30T17:04:34.509 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96174 log root rtd unknown /proc/96158/task/96174/root (readlink: Permission denied) 2023-09-30T17:04:34.509 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96174 log root txt unknown /proc/96158/task/96174/exe (readlink: Permission denied) 2023-09-30T17:04:34.509 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96174 log root NOFD /proc/96158/task/96174/fd (opendir: Permission denied) 2023-09-30T17:04:34.509 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96175 service root cwd unknown /proc/96158/task/96175/cwd (readlink: Permission denied) 2023-09-30T17:04:34.510 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96175 service root rtd unknown /proc/96158/task/96175/root (readlink: Permission denied) 2023-09-30T17:04:34.510 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96175 service root txt unknown /proc/96158/task/96175/exe (readlink: Permission denied) 2023-09-30T17:04:34.510 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96175 service root NOFD /proc/96158/task/96175/fd (opendir: Permission denied) 2023-09-30T17:04:34.510 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96176 admin_soc root cwd unknown /proc/96158/task/96176/cwd (readlink: Permission denied) 2023-09-30T17:04:34.510 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96176 admin_soc root rtd unknown /proc/96158/task/96176/root (readlink: Permission denied) 2023-09-30T17:04:34.510 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96176 admin_soc root txt unknown /proc/96158/task/96176/exe (readlink: Permission denied) 2023-09-30T17:04:34.510 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96176 admin_soc root NOFD /proc/96158/task/96176/fd (opendir: Permission denied) 2023-09-30T17:04:34.510 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96225 signal_ha root cwd unknown /proc/96158/task/96225/cwd (readlink: Permission denied) 2023-09-30T17:04:34.510 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96225 signal_ha root rtd unknown /proc/96158/task/96225/root (readlink: Permission denied) 2023-09-30T17:04:34.510 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96225 signal_ha root txt unknown /proc/96158/task/96225/exe (readlink: Permission denied) 2023-09-30T17:04:34.510 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96225 signal_ha root NOFD /proc/96158/task/96225/fd (opendir: Permission denied) 2023-09-30T17:04:34.511 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96226 rocksdb:l root cwd unknown /proc/96158/task/96226/cwd (readlink: Permission denied) 2023-09-30T17:04:34.511 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96226 rocksdb:l root rtd unknown /proc/96158/task/96226/root (readlink: Permission denied) 2023-09-30T17:04:34.511 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96226 rocksdb:l root txt unknown /proc/96158/task/96226/exe (readlink: Permission denied) 2023-09-30T17:04:34.511 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96226 rocksdb:l root NOFD /proc/96158/task/96226/fd (opendir: Permission denied) 2023-09-30T17:04:34.511 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96227 rocksdb:h root cwd unknown /proc/96158/task/96227/cwd (readlink: Permission denied) 2023-09-30T17:04:34.511 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96227 rocksdb:h root rtd unknown /proc/96158/task/96227/root (readlink: Permission denied) 2023-09-30T17:04:34.511 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96227 rocksdb:h root txt unknown /proc/96158/task/96227/exe (readlink: Permission denied) 2023-09-30T17:04:34.511 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96227 rocksdb:h root NOFD /proc/96158/task/96227/fd (opendir: Permission denied) 2023-09-30T17:04:34.511 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96274 ceph-mon root cwd unknown /proc/96158/task/96274/cwd (readlink: Permission denied) 2023-09-30T17:04:34.511 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96274 ceph-mon root rtd unknown /proc/96158/task/96274/root (readlink: Permission denied) 2023-09-30T17:04:34.511 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96274 ceph-mon root txt unknown /proc/96158/task/96274/exe (readlink: Permission denied) 2023-09-30T17:04:34.511 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96274 ceph-mon root NOFD /proc/96158/task/96274/fd (opendir: Permission denied) 2023-09-30T17:04:34.512 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96275 fn_monsto root cwd unknown /proc/96158/task/96275/cwd (readlink: Permission denied) 2023-09-30T17:04:34.512 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96275 fn_monsto root rtd unknown /proc/96158/task/96275/root (readlink: Permission denied) 2023-09-30T17:04:34.512 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96275 fn_monsto root txt unknown /proc/96158/task/96275/exe (readlink: Permission denied) 2023-09-30T17:04:34.512 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96275 fn_monsto root NOFD /proc/96158/task/96275/fd (opendir: Permission denied) 2023-09-30T17:04:34.512 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96276 msgr-work root cwd unknown /proc/96158/task/96276/cwd (readlink: Permission denied) 2023-09-30T17:04:34.512 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96276 msgr-work root rtd unknown /proc/96158/task/96276/root (readlink: Permission denied) 2023-09-30T17:04:34.512 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96276 msgr-work root txt unknown /proc/96158/task/96276/exe (readlink: Permission denied) 2023-09-30T17:04:34.512 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96276 msgr-work root NOFD /proc/96158/task/96276/fd (opendir: Permission denied) 2023-09-30T17:04:34.512 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96277 msgr-work root cwd unknown /proc/96158/task/96277/cwd (readlink: Permission denied) 2023-09-30T17:04:34.512 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96277 msgr-work root rtd unknown /proc/96158/task/96277/root (readlink: Permission denied) 2023-09-30T17:04:34.512 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96277 msgr-work root txt unknown /proc/96158/task/96277/exe (readlink: Permission denied) 2023-09-30T17:04:34.512 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96277 msgr-work root NOFD /proc/96158/task/96277/fd (opendir: Permission denied) 2023-09-30T17:04:34.513 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96278 msgr-work root cwd unknown /proc/96158/task/96278/cwd (readlink: Permission denied) 2023-09-30T17:04:34.513 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96278 msgr-work root rtd unknown /proc/96158/task/96278/root (readlink: Permission denied) 2023-09-30T17:04:34.513 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96278 msgr-work root txt unknown /proc/96158/task/96278/exe (readlink: Permission denied) 2023-09-30T17:04:34.513 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96278 msgr-work root NOFD /proc/96158/task/96278/fd (opendir: Permission denied) 2023-09-30T17:04:34.513 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96279 OpHistory root cwd unknown /proc/96158/task/96279/cwd (readlink: Permission denied) 2023-09-30T17:04:34.513 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96279 OpHistory root rtd unknown /proc/96158/task/96279/root (readlink: Permission denied) 2023-09-30T17:04:34.513 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96279 OpHistory root txt unknown /proc/96158/task/96279/exe (readlink: Permission denied) 2023-09-30T17:04:34.513 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96279 OpHistory root NOFD /proc/96158/task/96279/fd (opendir: Permission denied) 2023-09-30T17:04:34.513 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96280 fin root cwd unknown /proc/96158/task/96280/cwd (readlink: Permission denied) 2023-09-30T17:04:34.513 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96280 fin root rtd unknown /proc/96158/task/96280/root (readlink: Permission denied) 2023-09-30T17:04:34.513 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96280 fin root txt unknown /proc/96158/task/96280/exe (readlink: Permission denied) 2023-09-30T17:04:34.514 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96280 fin root NOFD /proc/96158/task/96280/fd (opendir: Permission denied) 2023-09-30T17:04:34.514 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96281 safe_time root cwd unknown /proc/96158/task/96281/cwd (readlink: Permission denied) 2023-09-30T17:04:34.514 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96281 safe_time root rtd unknown /proc/96158/task/96281/root (readlink: Permission denied) 2023-09-30T17:04:34.514 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96281 safe_time root txt unknown /proc/96158/task/96281/exe (readlink: Permission denied) 2023-09-30T17:04:34.514 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96281 safe_time root NOFD /proc/96158/task/96281/fd (opendir: Permission denied) 2023-09-30T17:04:34.514 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96282 cpu_tp root cwd unknown /proc/96158/task/96282/cwd (readlink: Permission denied) 2023-09-30T17:04:34.514 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96282 cpu_tp root rtd unknown /proc/96158/task/96282/root (readlink: Permission denied) 2023-09-30T17:04:34.514 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96282 cpu_tp root txt unknown /proc/96158/task/96282/exe (readlink: Permission denied) 2023-09-30T17:04:34.514 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96282 cpu_tp root NOFD /proc/96158/task/96282/fd (opendir: Permission denied) 2023-09-30T17:04:34.514 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96283 cpu_tp root cwd unknown /proc/96158/task/96283/cwd (readlink: Permission denied) 2023-09-30T17:04:34.514 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96283 cpu_tp root rtd unknown /proc/96158/task/96283/root (readlink: Permission denied) 2023-09-30T17:04:34.514 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96283 cpu_tp root txt unknown /proc/96158/task/96283/exe (readlink: Permission denied) 2023-09-30T17:04:34.515 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96283 cpu_tp root NOFD /proc/96158/task/96283/fd (opendir: Permission denied) 2023-09-30T17:04:34.515 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96284 cpu_tp root cwd unknown /proc/96158/task/96284/cwd (readlink: Permission denied) 2023-09-30T17:04:34.515 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96284 cpu_tp root rtd unknown /proc/96158/task/96284/root (readlink: Permission denied) 2023-09-30T17:04:34.515 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96284 cpu_tp root txt unknown /proc/96158/task/96284/exe (readlink: Permission denied) 2023-09-30T17:04:34.515 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96284 cpu_tp root NOFD /proc/96158/task/96284/fd (opendir: Permission denied) 2023-09-30T17:04:34.515 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96285 cpu_tp root cwd unknown /proc/96158/task/96285/cwd (readlink: Permission denied) 2023-09-30T17:04:34.515 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96285 cpu_tp root rtd unknown /proc/96158/task/96285/root (readlink: Permission denied) 2023-09-30T17:04:34.515 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96285 cpu_tp root txt unknown /proc/96158/task/96285/exe (readlink: Permission denied) 2023-09-30T17:04:34.515 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96285 cpu_tp root NOFD /proc/96158/task/96285/fd (opendir: Permission denied) 2023-09-30T17:04:34.515 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96286 ms_dispat root cwd unknown /proc/96158/task/96286/cwd (readlink: Permission denied) 2023-09-30T17:04:34.515 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96286 ms_dispat root rtd unknown /proc/96158/task/96286/root (readlink: Permission denied) 2023-09-30T17:04:34.515 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96286 ms_dispat root txt unknown /proc/96158/task/96286/exe (readlink: Permission denied) 2023-09-30T17:04:34.516 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96286 ms_dispat root NOFD /proc/96158/task/96286/fd (opendir: Permission denied) 2023-09-30T17:04:34.516 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96287 ms_local root cwd unknown /proc/96158/task/96287/cwd (readlink: Permission denied) 2023-09-30T17:04:34.516 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96287 ms_local root rtd unknown /proc/96158/task/96287/root (readlink: Permission denied) 2023-09-30T17:04:34.516 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96287 ms_local root txt unknown /proc/96158/task/96287/exe (readlink: Permission denied) 2023-09-30T17:04:34.516 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96287 ms_local root NOFD /proc/96158/task/96287/fd (opendir: Permission denied) 2023-09-30T17:04:34.516 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96288 safe_time root cwd unknown /proc/96158/task/96288/cwd (readlink: Permission denied) 2023-09-30T17:04:34.516 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96288 safe_time root rtd unknown /proc/96158/task/96288/root (readlink: Permission denied) 2023-09-30T17:04:34.516 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96288 safe_time root txt unknown /proc/96158/task/96288/exe (readlink: Permission denied) 2023-09-30T17:04:34.516 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96288 safe_time root NOFD /proc/96158/task/96288/fd (opendir: Permission denied) 2023-09-30T17:04:34.516 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96289 ms_dispat root cwd unknown /proc/96158/task/96289/cwd (readlink: Permission denied) 2023-09-30T17:04:34.516 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96289 ms_dispat root rtd unknown /proc/96158/task/96289/root (readlink: Permission denied) 2023-09-30T17:04:34.517 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96289 ms_dispat root txt unknown /proc/96158/task/96289/exe (readlink: Permission denied) 2023-09-30T17:04:34.517 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96289 ms_dispat root NOFD /proc/96158/task/96289/fd (opendir: Permission denied) 2023-09-30T17:04:34.517 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96290 ms_local root cwd unknown /proc/96158/task/96290/cwd (readlink: Permission denied) 2023-09-30T17:04:34.517 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96290 ms_local root rtd unknown /proc/96158/task/96290/root (readlink: Permission denied) 2023-09-30T17:04:34.517 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96290 ms_local root txt unknown /proc/96158/task/96290/exe (readlink: Permission denied) 2023-09-30T17:04:34.517 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mon 96158 96290 ms_local root NOFD /proc/96158/task/96290/fd (opendir: Permission denied) 2023-09-30T17:04:34.517 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 root cwd unknown /proc/96159/cwd (readlink: Permission denied) 2023-09-30T17:04:34.517 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 root rtd unknown /proc/96159/root (readlink: Permission denied) 2023-09-30T17:04:34.517 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 root txt unknown /proc/96159/exe (readlink: Permission denied) 2023-09-30T17:04:34.517 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 root NOFD /proc/96159/fd (opendir: Permission denied) 2023-09-30T17:04:34.517 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96266 log root cwd unknown /proc/96159/task/96266/cwd (readlink: Permission denied) 2023-09-30T17:04:34.517 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96266 log root rtd unknown /proc/96159/task/96266/root (readlink: Permission denied) 2023-09-30T17:04:34.518 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96266 log root txt unknown /proc/96159/task/96266/exe (readlink: Permission denied) 2023-09-30T17:04:34.518 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96266 log root NOFD /proc/96159/task/96266/fd (opendir: Permission denied) 2023-09-30T17:04:34.518 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96268 msgr-work root cwd unknown /proc/96159/task/96268/cwd (readlink: Permission denied) 2023-09-30T17:04:34.518 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96268 msgr-work root rtd unknown /proc/96159/task/96268/root (readlink: Permission denied) 2023-09-30T17:04:34.518 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96268 msgr-work root txt unknown /proc/96159/task/96268/exe (readlink: Permission denied) 2023-09-30T17:04:34.518 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96268 msgr-work root NOFD /proc/96159/task/96268/fd (opendir: Permission denied) 2023-09-30T17:04:34.518 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96269 msgr-work root cwd unknown /proc/96159/task/96269/cwd (readlink: Permission denied) 2023-09-30T17:04:34.518 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96269 msgr-work root rtd unknown /proc/96159/task/96269/root (readlink: Permission denied) 2023-09-30T17:04:34.518 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96269 msgr-work root txt unknown /proc/96159/task/96269/exe (readlink: Permission denied) 2023-09-30T17:04:34.518 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96269 msgr-work root NOFD /proc/96159/task/96269/fd (opendir: Permission denied) 2023-09-30T17:04:34.518 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96270 msgr-work root cwd unknown /proc/96159/task/96270/cwd (readlink: Permission denied) 2023-09-30T17:04:34.518 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96270 msgr-work root rtd unknown /proc/96159/task/96270/root (readlink: Permission denied) 2023-09-30T17:04:34.519 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96270 msgr-work root txt unknown /proc/96159/task/96270/exe (readlink: Permission denied) 2023-09-30T17:04:34.519 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96270 msgr-work root NOFD /proc/96159/task/96270/fd (opendir: Permission denied) 2023-09-30T17:04:34.519 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96301 service root cwd unknown /proc/96159/task/96301/cwd (readlink: Permission denied) 2023-09-30T17:04:34.519 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96301 service root rtd unknown /proc/96159/task/96301/root (readlink: Permission denied) 2023-09-30T17:04:34.519 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96301 service root txt unknown /proc/96159/task/96301/exe (readlink: Permission denied) 2023-09-30T17:04:34.519 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96301 service root NOFD /proc/96159/task/96301/fd (opendir: Permission denied) 2023-09-30T17:04:34.519 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96303 admin_soc root cwd unknown /proc/96159/task/96303/cwd (readlink: Permission denied) 2023-09-30T17:04:34.519 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96303 admin_soc root rtd unknown /proc/96159/task/96303/root (readlink: Permission denied) 2023-09-30T17:04:34.519 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96303 admin_soc root txt unknown /proc/96159/task/96303/exe (readlink: Permission denied) 2023-09-30T17:04:34.519 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96303 admin_soc root NOFD /proc/96159/task/96303/fd (opendir: Permission denied) 2023-09-30T17:04:34.519 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96304 ceph_time root cwd unknown /proc/96159/task/96304/cwd (readlink: Permission denied) 2023-09-30T17:04:34.520 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96304 ceph_time root rtd unknown /proc/96159/task/96304/root (readlink: Permission denied) 2023-09-30T17:04:34.520 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96304 ceph_time root txt unknown /proc/96159/task/96304/exe (readlink: Permission denied) 2023-09-30T17:04:34.520 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96304 ceph_time root NOFD /proc/96159/task/96304/fd (opendir: Permission denied) 2023-09-30T17:04:34.520 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96306 fn_anonym root cwd unknown /proc/96159/task/96306/cwd (readlink: Permission denied) 2023-09-30T17:04:34.520 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96306 fn_anonym root rtd unknown /proc/96159/task/96306/root (readlink: Permission denied) 2023-09-30T17:04:34.520 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96306 fn_anonym root txt unknown /proc/96159/task/96306/exe (readlink: Permission denied) 2023-09-30T17:04:34.520 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96306 fn_anonym root NOFD /proc/96159/task/96306/fd (opendir: Permission denied) 2023-09-30T17:04:34.520 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96307 signal_ha root cwd unknown /proc/96159/task/96307/cwd (readlink: Permission denied) 2023-09-30T17:04:34.520 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96307 signal_ha root rtd unknown /proc/96159/task/96307/root (readlink: Permission denied) 2023-09-30T17:04:34.520 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96307 signal_ha root txt unknown /proc/96159/task/96307/exe (readlink: Permission denied) 2023-09-30T17:04:34.520 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96307 signal_ha root NOFD /proc/96159/task/96307/fd (opendir: Permission denied) 2023-09-30T17:04:34.520 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96309 mgrsb-fin root cwd unknown /proc/96159/task/96309/cwd (readlink: Permission denied) 2023-09-30T17:04:34.521 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96309 mgrsb-fin root rtd unknown /proc/96159/task/96309/root (readlink: Permission denied) 2023-09-30T17:04:34.521 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96309 mgrsb-fin root txt unknown /proc/96159/task/96309/exe (readlink: Permission denied) 2023-09-30T17:04:34.521 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96309 mgrsb-fin root NOFD /proc/96159/task/96309/fd (opendir: Permission denied) 2023-09-30T17:04:34.521 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96310 ms_dispat root cwd unknown /proc/96159/task/96310/cwd (readlink: Permission denied) 2023-09-30T17:04:34.521 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96310 ms_dispat root rtd unknown /proc/96159/task/96310/root (readlink: Permission denied) 2023-09-30T17:04:34.521 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96310 ms_dispat root txt unknown /proc/96159/task/96310/exe (readlink: Permission denied) 2023-09-30T17:04:34.521 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96310 ms_dispat root NOFD /proc/96159/task/96310/fd (opendir: Permission denied) 2023-09-30T17:04:34.521 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96311 ms_local root cwd unknown /proc/96159/task/96311/cwd (readlink: Permission denied) 2023-09-30T17:04:34.521 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96311 ms_local root rtd unknown /proc/96159/task/96311/root (readlink: Permission denied) 2023-09-30T17:04:34.521 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96311 ms_local root txt unknown /proc/96159/task/96311/exe (readlink: Permission denied) 2023-09-30T17:04:34.521 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96311 ms_local root NOFD /proc/96159/task/96311/fd (opendir: Permission denied) 2023-09-30T17:04:34.521 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96313 io_contex root cwd unknown /proc/96159/task/96313/cwd (readlink: Permission denied) 2023-09-30T17:04:34.522 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96313 io_contex root rtd unknown /proc/96159/task/96313/root (readlink: Permission denied) 2023-09-30T17:04:34.522 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96313 io_contex root txt unknown /proc/96159/task/96313/exe (readlink: Permission denied) 2023-09-30T17:04:34.522 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96313 io_contex root NOFD /proc/96159/task/96313/fd (opendir: Permission denied) 2023-09-30T17:04:34.522 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96314 io_contex root cwd unknown /proc/96159/task/96314/cwd (readlink: Permission denied) 2023-09-30T17:04:34.522 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96314 io_contex root rtd unknown /proc/96159/task/96314/root (readlink: Permission denied) 2023-09-30T17:04:34.522 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96314 io_contex root txt unknown /proc/96159/task/96314/exe (readlink: Permission denied) 2023-09-30T17:04:34.522 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96314 io_contex root NOFD /proc/96159/task/96314/fd (opendir: Permission denied) 2023-09-30T17:04:34.522 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96318 safe_time root cwd unknown /proc/96159/task/96318/cwd (readlink: Permission denied) 2023-09-30T17:04:34.522 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96318 safe_time root rtd unknown /proc/96159/task/96318/root (readlink: Permission denied) 2023-09-30T17:04:34.522 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96318 safe_time root txt unknown /proc/96159/task/96318/exe (readlink: Permission denied) 2023-09-30T17:04:34.522 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96318 safe_time root NOFD /proc/96159/task/96318/fd (opendir: Permission denied) 2023-09-30T17:04:34.522 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96320 safe_time root cwd unknown /proc/96159/task/96320/cwd (readlink: Permission denied) 2023-09-30T17:04:34.522 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96320 safe_time root rtd unknown /proc/96159/task/96320/root (readlink: Permission denied) 2023-09-30T17:04:34.523 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96320 safe_time root txt unknown /proc/96159/task/96320/exe (readlink: Permission denied) 2023-09-30T17:04:34.523 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96320 safe_time root NOFD /proc/96159/task/96320/fd (opendir: Permission denied) 2023-09-30T17:04:34.523 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96325 safe_time root cwd unknown /proc/96159/task/96325/cwd (readlink: Permission denied) 2023-09-30T17:04:34.523 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96325 safe_time root rtd unknown /proc/96159/task/96325/root (readlink: Permission denied) 2023-09-30T17:04:34.523 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96325 safe_time root txt unknown /proc/96159/task/96325/exe (readlink: Permission denied) 2023-09-30T17:04:34.523 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96325 safe_time root NOFD /proc/96159/task/96325/fd (opendir: Permission denied) 2023-09-30T17:04:34.523 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96326 fn_anonym root cwd unknown /proc/96159/task/96326/cwd (readlink: Permission denied) 2023-09-30T17:04:34.523 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96326 fn_anonym root rtd unknown /proc/96159/task/96326/root (readlink: Permission denied) 2023-09-30T17:04:34.523 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96326 fn_anonym root txt unknown /proc/96159/task/96326/exe (readlink: Permission denied) 2023-09-30T17:04:34.523 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96326 fn_anonym root NOFD /proc/96159/task/96326/fd (opendir: Permission denied) 2023-09-30T17:04:34.523 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96327 flusher root cwd unknown /proc/96159/task/96327/cwd (readlink: Permission denied) 2023-09-30T17:04:34.523 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96327 flusher root rtd unknown /proc/96159/task/96327/root (readlink: Permission denied) 2023-09-30T17:04:34.523 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96327 flusher root txt unknown /proc/96159/task/96327/exe (readlink: Permission denied) 2023-09-30T17:04:34.524 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96327 flusher root NOFD /proc/96159/task/96327/fd (opendir: Permission denied) 2023-09-30T17:04:34.524 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96328 safe_time root cwd unknown /proc/96159/task/96328/cwd (readlink: Permission denied) 2023-09-30T17:04:34.524 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96328 safe_time root rtd unknown /proc/96159/task/96328/root (readlink: Permission denied) 2023-09-30T17:04:34.524 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96328 safe_time root txt unknown /proc/96159/task/96328/exe (readlink: Permission denied) 2023-09-30T17:04:34.524 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mgr 96159 96328 safe_time root NOFD /proc/96159/task/96328/fd (opendir: Permission denied) 2023-09-30T17:04:34.524 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 96848 root cwd unknown /proc/96848/cwd (readlink: Permission denied) 2023-09-30T17:04:34.524 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 96848 root rtd unknown /proc/96848/root (readlink: Permission denied) 2023-09-30T17:04:34.524 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 96848 root txt unknown /proc/96848/exe (readlink: Permission denied) 2023-09-30T17:04:34.524 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 96848 root NOFD /proc/96848/fd (opendir: Permission denied) 2023-09-30T17:04:34.524 INFO:tasks.workunit.client.0.smithi007.stdout:daemon-he 96888 root cwd unknown /proc/96888/cwd (readlink: Permission denied) 2023-09-30T17:04:34.524 INFO:tasks.workunit.client.0.smithi007.stdout:daemon-he 96888 root rtd unknown /proc/96888/root (readlink: Permission denied) 2023-09-30T17:04:34.524 INFO:tasks.workunit.client.0.smithi007.stdout:daemon-he 96888 root txt unknown /proc/96888/exe (readlink: Permission denied) 2023-09-30T17:04:34.524 INFO:tasks.workunit.client.0.smithi007.stdout:daemon-he 96888 root NOFD /proc/96888/fd (opendir: Permission denied) 2023-09-30T17:04:34.525 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 root cwd unknown /proc/96893/cwd (readlink: Permission denied) 2023-09-30T17:04:34.525 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 root rtd unknown /proc/96893/root (readlink: Permission denied) 2023-09-30T17:04:34.525 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 root txt unknown /proc/96893/exe (readlink: Permission denied) 2023-09-30T17:04:34.525 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 root NOFD /proc/96893/fd (opendir: Permission denied) 2023-09-30T17:04:34.525 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96894 log root cwd unknown /proc/96893/task/96894/cwd (readlink: Permission denied) 2023-09-30T17:04:34.525 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96894 log root rtd unknown /proc/96893/task/96894/root (readlink: Permission denied) 2023-09-30T17:04:34.525 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96894 log root txt unknown /proc/96893/task/96894/exe (readlink: Permission denied) 2023-09-30T17:04:34.525 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96894 log root NOFD /proc/96893/task/96894/fd (opendir: Permission denied) 2023-09-30T17:04:34.525 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96896 msgr-work root cwd unknown /proc/96893/task/96896/cwd (readlink: Permission denied) 2023-09-30T17:04:34.525 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96896 msgr-work root rtd unknown /proc/96893/task/96896/root (readlink: Permission denied) 2023-09-30T17:04:34.525 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96896 msgr-work root txt unknown /proc/96893/task/96896/exe (readlink: Permission denied) 2023-09-30T17:04:34.525 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96896 msgr-work root NOFD /proc/96893/task/96896/fd (opendir: Permission denied) 2023-09-30T17:04:34.526 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96897 msgr-work root cwd unknown /proc/96893/task/96897/cwd (readlink: Permission denied) 2023-09-30T17:04:34.526 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96897 msgr-work root rtd unknown /proc/96893/task/96897/root (readlink: Permission denied) 2023-09-30T17:04:34.526 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96897 msgr-work root txt unknown /proc/96893/task/96897/exe (readlink: Permission denied) 2023-09-30T17:04:34.526 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96897 msgr-work root NOFD /proc/96893/task/96897/fd (opendir: Permission denied) 2023-09-30T17:04:34.526 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96898 msgr-work root cwd unknown /proc/96893/task/96898/cwd (readlink: Permission denied) 2023-09-30T17:04:34.526 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96898 msgr-work root rtd unknown /proc/96893/task/96898/root (readlink: Permission denied) 2023-09-30T17:04:34.526 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96898 msgr-work root txt unknown /proc/96893/task/96898/exe (readlink: Permission denied) 2023-09-30T17:04:34.526 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96898 msgr-work root NOFD /proc/96893/task/96898/fd (opendir: Permission denied) 2023-09-30T17:04:34.526 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96902 service root cwd unknown /proc/96893/task/96902/cwd (readlink: Permission denied) 2023-09-30T17:04:34.526 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96902 service root rtd unknown /proc/96893/task/96902/root (readlink: Permission denied) 2023-09-30T17:04:34.526 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96902 service root txt unknown /proc/96893/task/96902/exe (readlink: Permission denied) 2023-09-30T17:04:34.526 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96902 service root NOFD /proc/96893/task/96902/fd (opendir: Permission denied) 2023-09-30T17:04:34.527 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96903 admin_soc root cwd unknown /proc/96893/task/96903/cwd (readlink: Permission denied) 2023-09-30T17:04:34.527 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96903 admin_soc root rtd unknown /proc/96893/task/96903/root (readlink: Permission denied) 2023-09-30T17:04:34.527 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96903 admin_soc root txt unknown /proc/96893/task/96903/exe (readlink: Permission denied) 2023-09-30T17:04:34.527 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96903 admin_soc root NOFD /proc/96893/task/96903/fd (opendir: Permission denied) 2023-09-30T17:04:34.527 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96904 signal_ha root cwd unknown /proc/96893/task/96904/cwd (readlink: Permission denied) 2023-09-30T17:04:34.527 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96904 signal_ha root rtd unknown /proc/96893/task/96904/root (readlink: Permission denied) 2023-09-30T17:04:34.527 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96904 signal_ha root txt unknown /proc/96893/task/96904/exe (readlink: Permission denied) 2023-09-30T17:04:34.527 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96904 signal_ha root NOFD /proc/96893/task/96904/fd (opendir: Permission denied) 2023-09-30T17:04:34.527 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96905 io_contex root cwd unknown /proc/96893/task/96905/cwd (readlink: Permission denied) 2023-09-30T17:04:34.527 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96905 io_contex root rtd unknown /proc/96893/task/96905/root (readlink: Permission denied) 2023-09-30T17:04:34.527 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96905 io_contex root txt unknown /proc/96893/task/96905/exe (readlink: Permission denied) 2023-09-30T17:04:34.527 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96905 io_contex root NOFD /proc/96893/task/96905/fd (opendir: Permission denied) 2023-09-30T17:04:34.528 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96906 io_contex root cwd unknown /proc/96893/task/96906/cwd (readlink: Permission denied) 2023-09-30T17:04:34.528 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96906 io_contex root rtd unknown /proc/96893/task/96906/root (readlink: Permission denied) 2023-09-30T17:04:34.528 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96906 io_contex root txt unknown /proc/96893/task/96906/exe (readlink: Permission denied) 2023-09-30T17:04:34.528 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96906 io_contex root NOFD /proc/96893/task/96906/fd (opendir: Permission denied) 2023-09-30T17:04:34.528 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96907 ms_dispat root cwd unknown /proc/96893/task/96907/cwd (readlink: Permission denied) 2023-09-30T17:04:34.528 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96907 ms_dispat root rtd unknown /proc/96893/task/96907/root (readlink: Permission denied) 2023-09-30T17:04:34.528 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96907 ms_dispat root txt unknown /proc/96893/task/96907/exe (readlink: Permission denied) 2023-09-30T17:04:34.528 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96907 ms_dispat root NOFD /proc/96893/task/96907/fd (opendir: Permission denied) 2023-09-30T17:04:34.528 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96908 ms_local root cwd unknown /proc/96893/task/96908/cwd (readlink: Permission denied) 2023-09-30T17:04:34.528 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96908 ms_local root rtd unknown /proc/96893/task/96908/root (readlink: Permission denied) 2023-09-30T17:04:34.528 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96908 ms_local root txt unknown /proc/96893/task/96908/exe (readlink: Permission denied) 2023-09-30T17:04:34.528 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96908 ms_local root NOFD /proc/96893/task/96908/fd (opendir: Permission denied) 2023-09-30T17:04:34.529 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96909 safe_time root cwd unknown /proc/96893/task/96909/cwd (readlink: Permission denied) 2023-09-30T17:04:34.529 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96909 safe_time root rtd unknown /proc/96893/task/96909/root (readlink: Permission denied) 2023-09-30T17:04:34.529 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96909 safe_time root txt unknown /proc/96893/task/96909/exe (readlink: Permission denied) 2023-09-30T17:04:34.529 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96909 safe_time root NOFD /proc/96893/task/96909/fd (opendir: Permission denied) 2023-09-30T17:04:34.529 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96910 safe_time root cwd unknown /proc/96893/task/96910/cwd (readlink: Permission denied) 2023-09-30T17:04:34.529 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96910 safe_time root rtd unknown /proc/96893/task/96910/root (readlink: Permission denied) 2023-09-30T17:04:34.529 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96910 safe_time root txt unknown /proc/96893/task/96910/exe (readlink: Permission denied) 2023-09-30T17:04:34.529 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96910 safe_time root NOFD /proc/96893/task/96910/fd (opendir: Permission denied) 2023-09-30T17:04:34.529 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96911 ceph-mds root cwd unknown /proc/96893/task/96911/cwd (readlink: Permission denied) 2023-09-30T17:04:34.529 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96911 ceph-mds root rtd unknown /proc/96893/task/96911/root (readlink: Permission denied) 2023-09-30T17:04:34.529 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96911 ceph-mds root txt unknown /proc/96893/task/96911/exe (readlink: Permission denied) 2023-09-30T17:04:34.530 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96911 ceph-mds root NOFD /proc/96893/task/96911/fd (opendir: Permission denied) 2023-09-30T17:04:34.530 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96912 safe_time root cwd unknown /proc/96893/task/96912/cwd (readlink: Permission denied) 2023-09-30T17:04:34.530 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96912 safe_time root rtd unknown /proc/96893/task/96912/root (readlink: Permission denied) 2023-09-30T17:04:34.530 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96912 safe_time root txt unknown /proc/96893/task/96912/exe (readlink: Permission denied) 2023-09-30T17:04:34.530 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 96912 safe_time root NOFD /proc/96893/task/96912/fd (opendir: Permission denied) 2023-09-30T17:04:34.530 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 97399 ceph_time root cwd unknown /proc/96893/task/97399/cwd (readlink: Permission denied) 2023-09-30T17:04:34.530 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 97399 ceph_time root rtd unknown /proc/96893/task/97399/root (readlink: Permission denied) 2023-09-30T17:04:34.530 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 97399 ceph_time root txt unknown /proc/96893/task/97399/exe (readlink: Permission denied) 2023-09-30T17:04:34.530 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 97399 ceph_time root NOFD /proc/96893/task/97399/fd (opendir: Permission denied) 2023-09-30T17:04:34.530 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 97400 OpHistory root cwd unknown /proc/96893/task/97400/cwd (readlink: Permission denied) 2023-09-30T17:04:34.530 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 97400 OpHistory root rtd unknown /proc/96893/task/97400/root (readlink: Permission denied) 2023-09-30T17:04:34.530 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 97400 OpHistory root txt unknown /proc/96893/task/97400/exe (readlink: Permission denied) 2023-09-30T17:04:34.531 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 97400 OpHistory root NOFD /proc/96893/task/97400/fd (opendir: Permission denied) 2023-09-30T17:04:34.531 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 97401 ms_dispat root cwd unknown /proc/96893/task/97401/cwd (readlink: Permission denied) 2023-09-30T17:04:34.531 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 97401 ms_dispat root rtd unknown /proc/96893/task/97401/root (readlink: Permission denied) 2023-09-30T17:04:34.531 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 97401 ms_dispat root txt unknown /proc/96893/task/97401/exe (readlink: Permission denied) 2023-09-30T17:04:34.531 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 97401 ms_dispat root NOFD /proc/96893/task/97401/fd (opendir: Permission denied) 2023-09-30T17:04:34.531 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 97402 mds_rank_ root cwd unknown /proc/96893/task/97402/cwd (readlink: Permission denied) 2023-09-30T17:04:34.531 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 97402 mds_rank_ root rtd unknown /proc/96893/task/97402/root (readlink: Permission denied) 2023-09-30T17:04:34.531 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 97402 mds_rank_ root txt unknown /proc/96893/task/97402/exe (readlink: Permission denied) 2023-09-30T17:04:34.531 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 97402 mds_rank_ root NOFD /proc/96893/task/97402/fd (opendir: Permission denied) 2023-09-30T17:04:34.531 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 97403 PQ_Finish root cwd unknown /proc/96893/task/97403/cwd (readlink: Permission denied) 2023-09-30T17:04:34.531 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 97403 PQ_Finish root rtd unknown /proc/96893/task/97403/root (readlink: Permission denied) 2023-09-30T17:04:34.532 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 97403 PQ_Finish root txt unknown /proc/96893/task/97403/exe (readlink: Permission denied) 2023-09-30T17:04:34.532 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 97403 PQ_Finish root NOFD /proc/96893/task/97403/fd (opendir: Permission denied) 2023-09-30T17:04:34.532 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 97404 safe_time root cwd unknown /proc/96893/task/97404/cwd (readlink: Permission denied) 2023-09-30T17:04:34.532 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 97404 safe_time root rtd unknown /proc/96893/task/97404/root (readlink: Permission denied) 2023-09-30T17:04:34.532 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 97404 safe_time root txt unknown /proc/96893/task/97404/exe (readlink: Permission denied) 2023-09-30T17:04:34.532 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 97404 safe_time root NOFD /proc/96893/task/97404/fd (opendir: Permission denied) 2023-09-30T17:04:34.532 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 97405 MR_Finish root cwd unknown /proc/96893/task/97405/cwd (readlink: Permission denied) 2023-09-30T17:04:34.532 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 97405 MR_Finish root rtd unknown /proc/96893/task/97405/root (readlink: Permission denied) 2023-09-30T17:04:34.532 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 97405 MR_Finish root txt unknown /proc/96893/task/97405/exe (readlink: Permission denied) 2023-09-30T17:04:34.532 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 97405 MR_Finish root NOFD /proc/96893/task/97405/fd (opendir: Permission denied) 2023-09-30T17:04:34.532 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 97406 md_submit root cwd unknown /proc/96893/task/97406/cwd (readlink: Permission denied) 2023-09-30T17:04:34.532 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 97406 md_submit root rtd unknown /proc/96893/task/97406/root (readlink: Permission denied) 2023-09-30T17:04:34.533 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 97406 md_submit root txt unknown /proc/96893/task/97406/exe (readlink: Permission denied) 2023-09-30T17:04:34.533 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 97406 md_submit root NOFD /proc/96893/task/97406/fd (opendir: Permission denied) 2023-09-30T17:04:34.533 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 97544 ms_dispat root cwd unknown /proc/96893/task/97544/cwd (readlink: Permission denied) 2023-09-30T17:04:34.533 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 97544 ms_dispat root rtd unknown /proc/96893/task/97544/root (readlink: Permission denied) 2023-09-30T17:04:34.533 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 97544 ms_dispat root txt unknown /proc/96893/task/97544/exe (readlink: Permission denied) 2023-09-30T17:04:34.533 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 97544 ms_dispat root NOFD /proc/96893/task/97544/fd (opendir: Permission denied) 2023-09-30T17:04:34.533 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 97545 ms_dispat root cwd unknown /proc/96893/task/97545/cwd (readlink: Permission denied) 2023-09-30T17:04:34.533 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 97545 ms_dispat root rtd unknown /proc/96893/task/97545/root (readlink: Permission denied) 2023-09-30T17:04:34.533 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 97545 ms_dispat root txt unknown /proc/96893/task/97545/exe (readlink: Permission denied) 2023-09-30T17:04:34.533 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-mds 96893 97545 ms_dispat root NOFD /proc/96893/task/97545/fd (opendir: Permission denied) 2023-09-30T17:04:34.533 INFO:tasks.workunit.client.0.smithi007.stdout:bash 100333 ubuntu cwd DIR 8,1 4096 1010 /home/ubuntu 2023-09-30T17:04:34.533 INFO:tasks.workunit.client.0.smithi007.stdout:bash 100333 ubuntu rtd DIR 8,1 4096 2 / 2023-09-30T17:04:34.534 INFO:tasks.workunit.client.0.smithi007.stdout:bash 100333 ubuntu txt REG 8,1 1150584 5025 /usr/bin/bash 2023-09-30T17:04:34.534 INFO:tasks.workunit.client.0.smithi007.stdout:bash 100333 ubuntu mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-09-30T17:04:34.534 INFO:tasks.workunit.client.0.smithi007.stdout:bash 100333 ubuntu mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-09-30T17:04:34.534 INFO:tasks.workunit.client.0.smithi007.stdout:bash 100333 ubuntu mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-09-30T17:04:34.534 INFO:tasks.workunit.client.0.smithi007.stdout:bash 100333 ubuntu mem REG 8,1 187496 4713 /usr/lib64/libtinfo.so.6.1 2023-09-30T17:04:34.534 INFO:tasks.workunit.client.0.smithi007.stdout:bash 100333 ubuntu mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-09-30T17:04:34.534 INFO:tasks.workunit.client.0.smithi007.stdout:bash 100333 ubuntu mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-09-30T17:04:34.534 INFO:tasks.workunit.client.0.smithi007.stdout:bash 100333 ubuntu mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-09-30T17:04:34.534 INFO:tasks.workunit.client.0.smithi007.stdout:bash 100333 ubuntu mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-09-30T17:04:34.534 INFO:tasks.workunit.client.0.smithi007.stdout:bash 100333 ubuntu mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-09-30T17:04:34.534 INFO:tasks.workunit.client.0.smithi007.stdout:bash 100333 ubuntu mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-09-30T17:04:34.535 INFO:tasks.workunit.client.0.smithi007.stdout:bash 100333 ubuntu mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-09-30T17:04:34.535 INFO:tasks.workunit.client.0.smithi007.stdout:bash 100333 ubuntu mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-09-30T17:04:34.535 INFO:tasks.workunit.client.0.smithi007.stdout:bash 100333 ubuntu mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-09-30T17:04:34.535 INFO:tasks.workunit.client.0.smithi007.stdout:bash 100333 ubuntu mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-09-30T17:04:34.535 INFO:tasks.workunit.client.0.smithi007.stdout:bash 100333 ubuntu mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-09-30T17:04:34.535 INFO:tasks.workunit.client.0.smithi007.stdout:bash 100333 ubuntu mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-09-30T17:04:34.535 INFO:tasks.workunit.client.0.smithi007.stdout:bash 100333 ubuntu mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-09-30T17:04:34.535 INFO:tasks.workunit.client.0.smithi007.stdout:bash 100333 ubuntu 0r FIFO 0,13 0t0 467975 pipe 2023-09-30T17:04:34.535 INFO:tasks.workunit.client.0.smithi007.stdout:bash 100333 ubuntu 1w FIFO 0,13 0t0 467976 pipe 2023-09-30T17:04:34.535 INFO:tasks.workunit.client.0.smithi007.stdout:bash 100333 ubuntu 2w FIFO 0,13 0t0 467977 pipe 2023-09-30T17:04:34.535 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 100367 root cwd unknown /proc/100367/cwd (readlink: Permission denied) 2023-09-30T17:04:34.536 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 100367 root rtd unknown /proc/100367/root (readlink: Permission denied) 2023-09-30T17:04:34.536 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 100367 root txt unknown /proc/100367/exe (readlink: Permission denied) 2023-09-30T17:04:34.536 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 100367 root NOFD /proc/100367/fd (opendir: Permission denied) 2023-09-30T17:04:34.536 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 100374 root cwd unknown /proc/100374/cwd (readlink: Permission denied) 2023-09-30T17:04:34.536 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 100374 root rtd unknown /proc/100374/root (readlink: Permission denied) 2023-09-30T17:04:34.536 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 100374 root txt unknown /proc/100374/exe (readlink: Permission denied) 2023-09-30T17:04:34.536 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 100374 root NOFD /proc/100374/fd (opendir: Permission denied) 2023-09-30T17:04:34.536 INFO:tasks.workunit.client.0.smithi007.stdout:daemon-he 100377 root cwd unknown /proc/100377/cwd (readlink: Permission denied) 2023-09-30T17:04:34.536 INFO:tasks.workunit.client.0.smithi007.stdout:daemon-he 100377 root rtd unknown /proc/100377/root (readlink: Permission denied) 2023-09-30T17:04:34.536 INFO:tasks.workunit.client.0.smithi007.stdout:daemon-he 100377 root txt unknown /proc/100377/exe (readlink: Permission denied) 2023-09-30T17:04:34.536 INFO:tasks.workunit.client.0.smithi007.stdout:daemon-he 100377 root NOFD /proc/100377/fd (opendir: Permission denied) 2023-09-30T17:04:34.536 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 root cwd unknown /proc/100400/cwd (readlink: Permission denied) 2023-09-30T17:04:34.537 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 root rtd unknown /proc/100400/root (readlink: Permission denied) 2023-09-30T17:04:34.537 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 root txt unknown /proc/100400/exe (readlink: Permission denied) 2023-09-30T17:04:34.537 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 root NOFD /proc/100400/fd (opendir: Permission denied) 2023-09-30T17:04:34.537 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100401 log root cwd unknown /proc/100400/task/100401/cwd (readlink: Permission denied) 2023-09-30T17:04:34.537 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100401 log root rtd unknown /proc/100400/task/100401/root (readlink: Permission denied) 2023-09-30T17:04:34.537 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100401 log root txt unknown /proc/100400/task/100401/exe (readlink: Permission denied) 2023-09-30T17:04:34.537 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100401 log root NOFD /proc/100400/task/100401/fd (opendir: Permission denied) 2023-09-30T17:04:34.537 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100403 msgr-work root cwd unknown /proc/100400/task/100403/cwd (readlink: Permission denied) 2023-09-30T17:04:34.537 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100403 msgr-work root rtd unknown /proc/100400/task/100403/root (readlink: Permission denied) 2023-09-30T17:04:34.537 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100403 msgr-work root txt unknown /proc/100400/task/100403/exe (readlink: Permission denied) 2023-09-30T17:04:34.537 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100403 msgr-work root NOFD /proc/100400/task/100403/fd (opendir: Permission denied) 2023-09-30T17:04:34.537 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100404 msgr-work root cwd unknown /proc/100400/task/100404/cwd (readlink: Permission denied) 2023-09-30T17:04:34.538 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100404 msgr-work root rtd unknown /proc/100400/task/100404/root (readlink: Permission denied) 2023-09-30T17:04:34.538 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100404 msgr-work root txt unknown /proc/100400/task/100404/exe (readlink: Permission denied) 2023-09-30T17:04:34.538 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100404 msgr-work root NOFD /proc/100400/task/100404/fd (opendir: Permission denied) 2023-09-30T17:04:34.538 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100405 msgr-work root cwd unknown /proc/100400/task/100405/cwd (readlink: Permission denied) 2023-09-30T17:04:34.538 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100405 msgr-work root rtd unknown /proc/100400/task/100405/root (readlink: Permission denied) 2023-09-30T17:04:34.538 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100405 msgr-work root txt unknown /proc/100400/task/100405/exe (readlink: Permission denied) 2023-09-30T17:04:34.538 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100405 msgr-work root NOFD /proc/100400/task/100405/fd (opendir: Permission denied) 2023-09-30T17:04:34.538 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100409 service root cwd unknown /proc/100400/task/100409/cwd (readlink: Permission denied) 2023-09-30T17:04:34.538 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100409 service root rtd unknown /proc/100400/task/100409/root (readlink: Permission denied) 2023-09-30T17:04:34.538 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100409 service root txt unknown /proc/100400/task/100409/exe (readlink: Permission denied) 2023-09-30T17:04:34.538 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100409 service root NOFD /proc/100400/task/100409/fd (opendir: Permission denied) 2023-09-30T17:04:34.539 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100410 admin_soc root cwd unknown /proc/100400/task/100410/cwd (readlink: Permission denied) 2023-09-30T17:04:34.539 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100410 admin_soc root rtd unknown /proc/100400/task/100410/root (readlink: Permission denied) 2023-09-30T17:04:34.539 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100410 admin_soc root txt unknown /proc/100400/task/100410/exe (readlink: Permission denied) 2023-09-30T17:04:34.539 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100410 admin_soc root NOFD /proc/100400/task/100410/fd (opendir: Permission denied) 2023-09-30T17:04:34.539 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100411 signal_ha root cwd unknown /proc/100400/task/100411/cwd (readlink: Permission denied) 2023-09-30T17:04:34.539 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100411 signal_ha root rtd unknown /proc/100400/task/100411/root (readlink: Permission denied) 2023-09-30T17:04:34.539 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100411 signal_ha root txt unknown /proc/100400/task/100411/exe (readlink: Permission denied) 2023-09-30T17:04:34.539 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100411 signal_ha root NOFD /proc/100400/task/100411/fd (opendir: Permission denied) 2023-09-30T17:04:34.539 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100412 io_contex root cwd unknown /proc/100400/task/100412/cwd (readlink: Permission denied) 2023-09-30T17:04:34.539 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100412 io_contex root rtd unknown /proc/100400/task/100412/root (readlink: Permission denied) 2023-09-30T17:04:34.539 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100412 io_contex root txt unknown /proc/100400/task/100412/exe (readlink: Permission denied) 2023-09-30T17:04:34.539 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100412 io_contex root NOFD /proc/100400/task/100412/fd (opendir: Permission denied) 2023-09-30T17:04:34.540 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100413 io_contex root cwd unknown /proc/100400/task/100413/cwd (readlink: Permission denied) 2023-09-30T17:04:34.540 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100413 io_contex root rtd unknown /proc/100400/task/100413/root (readlink: Permission denied) 2023-09-30T17:04:34.540 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100413 io_contex root txt unknown /proc/100400/task/100413/exe (readlink: Permission denied) 2023-09-30T17:04:34.540 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100413 io_contex root NOFD /proc/100400/task/100413/fd (opendir: Permission denied) 2023-09-30T17:04:34.540 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100414 ceph_time root cwd unknown /proc/100400/task/100414/cwd (readlink: Permission denied) 2023-09-30T17:04:34.540 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100414 ceph_time root rtd unknown /proc/100400/task/100414/root (readlink: Permission denied) 2023-09-30T17:04:34.540 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100414 ceph_time root txt unknown /proc/100400/task/100414/exe (readlink: Permission denied) 2023-09-30T17:04:34.540 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100414 ceph_time root NOFD /proc/100400/task/100414/fd (opendir: Permission denied) 2023-09-30T17:04:34.540 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100415 fn_anonym root cwd unknown /proc/100400/task/100415/cwd (readlink: Permission denied) 2023-09-30T17:04:34.540 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100415 fn_anonym root rtd unknown /proc/100400/task/100415/root (readlink: Permission denied) 2023-09-30T17:04:34.540 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100415 fn_anonym root txt unknown /proc/100400/task/100415/exe (readlink: Permission denied) 2023-09-30T17:04:34.541 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100415 fn_anonym root NOFD /proc/100400/task/100415/fd (opendir: Permission denied) 2023-09-30T17:04:34.541 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100416 fn_anonym root cwd unknown /proc/100400/task/100416/cwd (readlink: Permission denied) 2023-09-30T17:04:34.541 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100416 fn_anonym root rtd unknown /proc/100400/task/100416/root (readlink: Permission denied) 2023-09-30T17:04:34.541 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100416 fn_anonym root txt unknown /proc/100400/task/100416/exe (readlink: Permission denied) 2023-09-30T17:04:34.541 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100416 fn_anonym root NOFD /proc/100400/task/100416/fd (opendir: Permission denied) 2023-09-30T17:04:34.541 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100417 fn_anonym root cwd unknown /proc/100400/task/100417/cwd (readlink: Permission denied) 2023-09-30T17:04:34.541 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100417 fn_anonym root rtd unknown /proc/100400/task/100417/root (readlink: Permission denied) 2023-09-30T17:04:34.541 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100417 fn_anonym root txt unknown /proc/100400/task/100417/exe (readlink: Permission denied) 2023-09-30T17:04:34.541 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100417 fn_anonym root NOFD /proc/100400/task/100417/fd (opendir: Permission denied) 2023-09-30T17:04:34.541 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100418 fn_anonym root cwd unknown /proc/100400/task/100418/cwd (readlink: Permission denied) 2023-09-30T17:04:34.541 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100418 fn_anonym root rtd unknown /proc/100400/task/100418/root (readlink: Permission denied) 2023-09-30T17:04:34.541 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100418 fn_anonym root txt unknown /proc/100400/task/100418/exe (readlink: Permission denied) 2023-09-30T17:04:34.542 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100418 fn_anonym root NOFD /proc/100400/task/100418/fd (opendir: Permission denied) 2023-09-30T17:04:34.542 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100419 fn_anonym root cwd unknown /proc/100400/task/100419/cwd (readlink: Permission denied) 2023-09-30T17:04:34.542 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100419 fn_anonym root rtd unknown /proc/100400/task/100419/root (readlink: Permission denied) 2023-09-30T17:04:34.542 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100419 fn_anonym root txt unknown /proc/100400/task/100419/exe (readlink: Permission denied) 2023-09-30T17:04:34.542 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100419 fn_anonym root NOFD /proc/100400/task/100419/fd (opendir: Permission denied) 2023-09-30T17:04:34.542 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100420 safe_time root cwd unknown /proc/100400/task/100420/cwd (readlink: Permission denied) 2023-09-30T17:04:34.542 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100420 safe_time root rtd unknown /proc/100400/task/100420/root (readlink: Permission denied) 2023-09-30T17:04:34.542 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100420 safe_time root txt unknown /proc/100400/task/100420/exe (readlink: Permission denied) 2023-09-30T17:04:34.542 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100420 safe_time root NOFD /proc/100400/task/100420/fd (opendir: Permission denied) 2023-09-30T17:04:34.542 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100421 fn_anonym root cwd unknown /proc/100400/task/100421/cwd (readlink: Permission denied) 2023-09-30T17:04:34.542 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100421 fn_anonym root rtd unknown /proc/100400/task/100421/root (readlink: Permission denied) 2023-09-30T17:04:34.542 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100421 fn_anonym root txt unknown /proc/100400/task/100421/exe (readlink: Permission denied) 2023-09-30T17:04:34.543 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100421 fn_anonym root NOFD /proc/100400/task/100421/fd (opendir: Permission denied) 2023-09-30T17:04:34.543 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100422 flusher root cwd unknown /proc/100400/task/100422/cwd (readlink: Permission denied) 2023-09-30T17:04:34.543 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100422 flusher root rtd unknown /proc/100400/task/100422/root (readlink: Permission denied) 2023-09-30T17:04:34.543 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100422 flusher root txt unknown /proc/100400/task/100422/exe (readlink: Permission denied) 2023-09-30T17:04:34.543 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100422 flusher root NOFD /proc/100400/task/100422/fd (opendir: Permission denied) 2023-09-30T17:04:34.543 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100423 ms_dispat root cwd unknown /proc/100400/task/100423/cwd (readlink: Permission denied) 2023-09-30T17:04:34.543 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100423 ms_dispat root rtd unknown /proc/100400/task/100423/root (readlink: Permission denied) 2023-09-30T17:04:34.543 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100423 ms_dispat root txt unknown /proc/100400/task/100423/exe (readlink: Permission denied) 2023-09-30T17:04:34.543 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100423 ms_dispat root NOFD /proc/100400/task/100423/fd (opendir: Permission denied) 2023-09-30T17:04:34.543 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100424 ms_local root cwd unknown /proc/100400/task/100424/cwd (readlink: Permission denied) 2023-09-30T17:04:34.543 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100424 ms_local root rtd unknown /proc/100400/task/100424/root (readlink: Permission denied) 2023-09-30T17:04:34.544 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100424 ms_local root txt unknown /proc/100400/task/100424/exe (readlink: Permission denied) 2023-09-30T17:04:34.544 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100424 ms_local root NOFD /proc/100400/task/100424/fd (opendir: Permission denied) 2023-09-30T17:04:34.544 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100425 safe_time root cwd unknown /proc/100400/task/100425/cwd (readlink: Permission denied) 2023-09-30T17:04:34.544 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100425 safe_time root rtd unknown /proc/100400/task/100425/root (readlink: Permission denied) 2023-09-30T17:04:34.544 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100425 safe_time root txt unknown /proc/100400/task/100425/exe (readlink: Permission denied) 2023-09-30T17:04:34.544 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100425 safe_time root NOFD /proc/100400/task/100425/fd (opendir: Permission denied) 2023-09-30T17:04:34.544 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100426 ceph-fuse root cwd unknown /proc/100400/task/100426/cwd (readlink: Permission denied) 2023-09-30T17:04:34.544 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100426 ceph-fuse root rtd unknown /proc/100400/task/100426/root (readlink: Permission denied) 2023-09-30T17:04:34.544 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100426 ceph-fuse root txt unknown /proc/100400/task/100426/exe (readlink: Permission denied) 2023-09-30T17:04:34.544 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100426 ceph-fuse root NOFD /proc/100400/task/100426/fd (opendir: Permission denied) 2023-09-30T17:04:34.544 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100433 ceph-fuse root cwd unknown /proc/100400/task/100433/cwd (readlink: Permission denied) 2023-09-30T17:04:34.544 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100433 ceph-fuse root rtd unknown /proc/100400/task/100433/root (readlink: Permission denied) 2023-09-30T17:04:34.545 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100433 ceph-fuse root txt unknown /proc/100400/task/100433/exe (readlink: Permission denied) 2023-09-30T17:04:34.545 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100433 ceph-fuse root NOFD /proc/100400/task/100433/fd (opendir: Permission denied) 2023-09-30T17:04:34.545 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100436 ceph-fuse root cwd unknown /proc/100400/task/100436/cwd (readlink: Permission denied) 2023-09-30T17:04:34.545 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100436 ceph-fuse root rtd unknown /proc/100400/task/100436/root (readlink: Permission denied) 2023-09-30T17:04:34.545 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100436 ceph-fuse root txt unknown /proc/100400/task/100436/exe (readlink: Permission denied) 2023-09-30T17:04:34.545 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 100436 ceph-fuse root NOFD /proc/100400/task/100436/fd (opendir: Permission denied) 2023-09-30T17:04:34.545 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 102416 ceph-fuse root cwd unknown /proc/100400/task/102416/cwd (readlink: Permission denied) 2023-09-30T17:04:34.545 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 102416 ceph-fuse root rtd unknown /proc/100400/task/102416/root (readlink: Permission denied) 2023-09-30T17:04:34.545 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 102416 ceph-fuse root txt unknown /proc/100400/task/102416/exe (readlink: Permission denied) 2023-09-30T17:04:34.545 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 102416 ceph-fuse root NOFD /proc/100400/task/102416/fd (opendir: Permission denied) 2023-09-30T17:04:34.545 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 102671 ceph-fuse root cwd unknown /proc/100400/task/102671/cwd (readlink: Permission denied) 2023-09-30T17:04:34.545 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 102671 ceph-fuse root rtd unknown /proc/100400/task/102671/root (readlink: Permission denied) 2023-09-30T17:04:34.546 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 102671 ceph-fuse root txt unknown /proc/100400/task/102671/exe (readlink: Permission denied) 2023-09-30T17:04:34.546 INFO:tasks.workunit.client.0.smithi007.stdout:ceph-fuse 100400 102671 ceph-fuse root NOFD /proc/100400/task/102671/fd (opendir: Permission denied) 2023-09-30T17:04:34.546 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 102070 root cwd unknown /proc/102070/cwd (readlink: Permission denied) 2023-09-30T17:04:34.546 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 102070 root rtd unknown /proc/102070/root (readlink: Permission denied) 2023-09-30T17:04:34.546 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 102070 root txt unknown /proc/102070/exe (readlink: Permission denied) 2023-09-30T17:04:34.546 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/3 102070 root NOFD /proc/102070/fd (opendir: Permission denied) 2023-09-30T17:04:34.546 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 102393 ubuntu cwd DIR 0,47 194249448 1099511627777 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-09-30T17:04:34.546 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 102393 ubuntu rtd DIR 8,1 4096 2 / 2023-09-30T17:04:34.546 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 102393 ubuntu txt REG 8,1 42840 7217 /usr/bin/timeout 2023-09-30T17:04:34.546 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 102393 ubuntu mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-09-30T17:04:34.546 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 102393 ubuntu mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-09-30T17:04:34.547 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 102393 ubuntu mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-09-30T17:04:34.547 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 102393 ubuntu mem REG 8,1 42744 5004 /usr/lib64/librt-2.28.so 2023-09-30T17:04:34.547 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 102393 ubuntu mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-09-30T17:04:34.547 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 102393 ubuntu mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-09-30T17:04:34.547 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 102393 ubuntu mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-09-30T17:04:34.547 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 102393 ubuntu mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-09-30T17:04:34.547 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 102393 ubuntu mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-09-30T17:04:34.547 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 102393 ubuntu mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-09-30T17:04:34.547 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 102393 ubuntu mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-09-30T17:04:34.547 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 102393 ubuntu mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-09-30T17:04:34.547 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 102393 ubuntu mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-09-30T17:04:34.547 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 102393 ubuntu mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-09-30T17:04:34.548 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 102393 ubuntu mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-09-30T17:04:34.548 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 102393 ubuntu mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-09-30T17:04:34.548 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 102393 ubuntu mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-09-30T17:04:34.548 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 102393 ubuntu 0r FIFO 0,13 0t0 475010 pipe 2023-09-30T17:04:34.548 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 102393 ubuntu 1w FIFO 0,13 0t0 475011 pipe 2023-09-30T17:04:34.548 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 102393 ubuntu 2w FIFO 0,13 0t0 475012 pipe 2023-09-30T17:04:34.548 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 102414 ubuntu cwd DIR 0,47 194249448 1099511627777 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-09-30T17:04:34.548 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 102414 ubuntu rtd DIR 8,1 4096 2 / 2023-09-30T17:04:34.548 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 102414 ubuntu txt REG 8,1 1150584 5025 /usr/bin/bash 2023-09-30T17:04:34.548 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 102414 ubuntu mem REG 8,1 2586930 17584 /usr/lib/locale/en_US.utf8/LC_COLLATE 2023-09-30T17:04:34.548 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 102414 ubuntu mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-09-30T17:04:34.548 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 102414 ubuntu mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-09-30T17:04:34.549 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 102414 ubuntu mem REG 8,1 187496 4713 /usr/lib64/libtinfo.so.6.1 2023-09-30T17:04:34.549 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 102414 ubuntu mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-09-30T17:04:34.549 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 102414 ubuntu mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-09-30T17:04:34.549 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 102414 ubuntu mem REG 8,1 54 17589 /usr/lib/locale/en_US.utf8/LC_NUMERIC 2023-09-30T17:04:34.549 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 102414 ubuntu mem REG 8,1 3316 17539 /usr/lib/locale/en_US.utf8/LC_TIME 2023-09-30T17:04:34.549 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 102414 ubuntu mem REG 8,1 286 17623 /usr/lib/locale/en_US.utf8/LC_MONETARY 2023-09-30T17:04:34.549 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 102414 ubuntu mem REG 8,1 57 17587 /usr/lib/locale/en_US.utf8/LC_MESSAGES/SYS_LC_MESSAGES 2023-09-30T17:04:34.549 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 102414 ubuntu mem REG 8,1 34 17604 /usr/lib/locale/en_US.utf8/LC_PAPER 2023-09-30T17:04:34.549 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 102414 ubuntu mem REG 8,1 77 17588 /usr/lib/locale/en_US.utf8/LC_NAME 2023-09-30T17:04:34.549 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 102414 ubuntu mem REG 8,1 167 17620 /usr/lib/locale/en_US.utf8/LC_ADDRESS 2023-09-30T17:04:34.549 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 102414 ubuntu mem REG 8,1 59 17624 /usr/lib/locale/en_US.utf8/LC_TELEPHONE 2023-09-30T17:04:34.549 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 102414 ubuntu mem REG 8,1 23 17622 /usr/lib/locale/en_US.utf8/LC_MEASUREMENT 2023-09-30T17:04:34.550 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 102414 ubuntu mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-09-30T17:04:34.550 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 102414 ubuntu mem REG 8,1 368 17621 /usr/lib/locale/en_US.utf8/LC_IDENTIFICATION 2023-09-30T17:04:34.550 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 102414 ubuntu 0r FIFO 0,13 0t0 475010 pipe 2023-09-30T17:04:34.550 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 102414 ubuntu 1w FIFO 0,13 0t0 475011 pipe 2023-09-30T17:04:34.550 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 102414 ubuntu 2w FIFO 0,13 0t0 475012 pipe 2023-09-30T17:04:34.550 INFO:tasks.workunit.client.0.smithi007.stdout:fsync-tes 102414 ubuntu 255r REG 8,1 207 918593 /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsync-tester.sh 2023-09-30T17:04:34.550 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 103579 root cwd unknown /proc/103579/cwd (readlink: Permission denied) 2023-09-30T17:04:34.550 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 103579 root rtd unknown /proc/103579/root (readlink: Permission denied) 2023-09-30T17:04:34.550 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 103579 root txt unknown /proc/103579/exe (readlink: Permission denied) 2023-09-30T17:04:34.550 INFO:tasks.workunit.client.0.smithi007.stdout:kworker/u 103579 root NOFD /proc/103579/fd (opendir: Permission denied) 2023-09-30T17:04:34.550 INFO:tasks.workunit.client.0.smithi007.stdout:sleep 104638 root cwd unknown /proc/104638/cwd (readlink: Permission denied) 2023-09-30T17:04:34.550 INFO:tasks.workunit.client.0.smithi007.stdout:sleep 104638 root rtd unknown /proc/104638/root (readlink: Permission denied) 2023-09-30T17:04:34.551 INFO:tasks.workunit.client.0.smithi007.stdout:sleep 104638 root txt unknown /proc/104638/exe (readlink: Permission denied) 2023-09-30T17:04:34.551 INFO:tasks.workunit.client.0.smithi007.stdout:sleep 104638 root NOFD /proc/104638/fd (opendir: Permission denied) 2023-09-30T17:04:34.551 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 104830 root cwd unknown /proc/104830/cwd (readlink: Permission denied) 2023-09-30T17:04:34.551 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 104830 root rtd unknown /proc/104830/root (readlink: Permission denied) 2023-09-30T17:04:34.551 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 104830 root txt unknown /proc/104830/exe (readlink: Permission denied) 2023-09-30T17:04:34.551 INFO:tasks.workunit.client.0.smithi007.stdout:sudo 104830 root NOFD /proc/104830/fd (opendir: Permission denied) 2023-09-30T17:04:34.551 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 104870 root cwd unknown /proc/104870/cwd (readlink: Permission denied) 2023-09-30T17:04:34.551 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 104870 root rtd unknown /proc/104870/root (readlink: Permission denied) 2023-09-30T17:04:34.551 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 104870 root txt unknown /proc/104870/exe (readlink: Permission denied) 2023-09-30T17:04:34.551 INFO:tasks.workunit.client.0.smithi007.stdout:timeout 104870 root NOFD /proc/104870/fd (opendir: Permission denied) 2023-09-30T17:04:34.551 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 root cwd unknown /proc/104873/cwd (readlink: Permission denied) 2023-09-30T17:04:34.551 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 root rtd unknown /proc/104873/root (readlink: Permission denied) 2023-09-30T17:04:34.552 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 root txt unknown /proc/104873/exe (readlink: Permission denied) 2023-09-30T17:04:34.552 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 root NOFD /proc/104873/fd (opendir: Permission denied) 2023-09-30T17:04:34.552 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104899 log root cwd unknown /proc/104873/task/104899/cwd (readlink: Permission denied) 2023-09-30T17:04:34.552 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104899 log root rtd unknown /proc/104873/task/104899/root (readlink: Permission denied) 2023-09-30T17:04:34.552 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104899 log root txt unknown /proc/104873/task/104899/exe (readlink: Permission denied) 2023-09-30T17:04:34.552 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104899 log root NOFD /proc/104873/task/104899/fd (opendir: Permission denied) 2023-09-30T17:04:34.552 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104900 msgr-work root cwd unknown /proc/104873/task/104900/cwd (readlink: Permission denied) 2023-09-30T17:04:34.552 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104900 msgr-work root rtd unknown /proc/104873/task/104900/root (readlink: Permission denied) 2023-09-30T17:04:34.552 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104900 msgr-work root txt unknown /proc/104873/task/104900/exe (readlink: Permission denied) 2023-09-30T17:04:34.552 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104900 msgr-work root NOFD /proc/104873/task/104900/fd (opendir: Permission denied) 2023-09-30T17:04:34.552 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104901 msgr-work root cwd unknown /proc/104873/task/104901/cwd (readlink: Permission denied) 2023-09-30T17:04:34.552 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104901 msgr-work root rtd unknown /proc/104873/task/104901/root (readlink: Permission denied) 2023-09-30T17:04:34.553 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104901 msgr-work root txt unknown /proc/104873/task/104901/exe (readlink: Permission denied) 2023-09-30T17:04:34.553 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104901 msgr-work root NOFD /proc/104873/task/104901/fd (opendir: Permission denied) 2023-09-30T17:04:34.553 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104902 msgr-work root cwd unknown /proc/104873/task/104902/cwd (readlink: Permission denied) 2023-09-30T17:04:34.553 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104902 msgr-work root rtd unknown /proc/104873/task/104902/root (readlink: Permission denied) 2023-09-30T17:04:34.553 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104902 msgr-work root txt unknown /proc/104873/task/104902/exe (readlink: Permission denied) 2023-09-30T17:04:34.553 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104902 msgr-work root NOFD /proc/104873/task/104902/fd (opendir: Permission denied) 2023-09-30T17:04:34.553 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104908 service root cwd unknown /proc/104873/task/104908/cwd (readlink: Permission denied) 2023-09-30T17:04:34.553 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104908 service root rtd unknown /proc/104873/task/104908/root (readlink: Permission denied) 2023-09-30T17:04:34.553 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104908 service root txt unknown /proc/104873/task/104908/exe (readlink: Permission denied) 2023-09-30T17:04:34.553 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104908 service root NOFD /proc/104873/task/104908/fd (opendir: Permission denied) 2023-09-30T17:04:34.553 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104909 io_contex root cwd unknown /proc/104873/task/104909/cwd (readlink: Permission denied) 2023-09-30T17:04:34.553 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104909 io_contex root rtd unknown /proc/104873/task/104909/root (readlink: Permission denied) 2023-09-30T17:04:34.553 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104909 io_contex root txt unknown /proc/104873/task/104909/exe (readlink: Permission denied) 2023-09-30T17:04:34.554 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104909 io_contex root NOFD /proc/104873/task/104909/fd (opendir: Permission denied) 2023-09-30T17:04:34.554 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104910 io_contex root cwd unknown /proc/104873/task/104910/cwd (readlink: Permission denied) 2023-09-30T17:04:34.554 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104910 io_contex root rtd unknown /proc/104873/task/104910/root (readlink: Permission denied) 2023-09-30T17:04:34.554 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104910 io_contex root txt unknown /proc/104873/task/104910/exe (readlink: Permission denied) 2023-09-30T17:04:34.554 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104910 io_contex root NOFD /proc/104873/task/104910/fd (opendir: Permission denied) 2023-09-30T17:04:34.554 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104911 admin_soc root cwd unknown /proc/104873/task/104911/cwd (readlink: Permission denied) 2023-09-30T17:04:34.554 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104911 admin_soc root rtd unknown /proc/104873/task/104911/root (readlink: Permission denied) 2023-09-30T17:04:34.554 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104911 admin_soc root txt unknown /proc/104873/task/104911/exe (readlink: Permission denied) 2023-09-30T17:04:34.554 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104911 admin_soc root NOFD /proc/104873/task/104911/fd (opendir: Permission denied) 2023-09-30T17:04:34.554 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104912 ceph_time root cwd unknown /proc/104873/task/104912/cwd (readlink: Permission denied) 2023-09-30T17:04:34.554 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104912 ceph_time root rtd unknown /proc/104873/task/104912/root (readlink: Permission denied) 2023-09-30T17:04:34.555 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104912 ceph_time root txt unknown /proc/104873/task/104912/exe (readlink: Permission denied) 2023-09-30T17:04:34.555 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104912 ceph_time root NOFD /proc/104873/task/104912/fd (opendir: Permission denied) 2023-09-30T17:04:34.555 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104913 ms_dispat root cwd unknown /proc/104873/task/104913/cwd (readlink: Permission denied) 2023-09-30T17:04:34.555 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104913 ms_dispat root rtd unknown /proc/104873/task/104913/root (readlink: Permission denied) 2023-09-30T17:04:34.555 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104913 ms_dispat root txt unknown /proc/104873/task/104913/exe (readlink: Permission denied) 2023-09-30T17:04:34.555 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104913 ms_dispat root NOFD /proc/104873/task/104913/fd (opendir: Permission denied) 2023-09-30T17:04:34.555 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104914 ms_local root cwd unknown /proc/104873/task/104914/cwd (readlink: Permission denied) 2023-09-30T17:04:34.555 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104914 ms_local root rtd unknown /proc/104873/task/104914/root (readlink: Permission denied) 2023-09-30T17:04:34.555 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104914 ms_local root txt unknown /proc/104873/task/104914/exe (readlink: Permission denied) 2023-09-30T17:04:34.555 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104914 ms_local root NOFD /proc/104873/task/104914/fd (opendir: Permission denied) 2023-09-30T17:04:34.555 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104915 safe_time root cwd unknown /proc/104873/task/104915/cwd (readlink: Permission denied) 2023-09-30T17:04:34.555 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104915 safe_time root rtd unknown /proc/104873/task/104915/root (readlink: Permission denied) 2023-09-30T17:04:34.555 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104915 safe_time root txt unknown /proc/104873/task/104915/exe (readlink: Permission denied) 2023-09-30T17:04:34.556 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104915 safe_time root NOFD /proc/104873/task/104915/fd (opendir: Permission denied) 2023-09-30T17:04:34.556 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104916 safe_time root cwd unknown /proc/104873/task/104916/cwd (readlink: Permission denied) 2023-09-30T17:04:34.556 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104916 safe_time root rtd unknown /proc/104873/task/104916/root (readlink: Permission denied) 2023-09-30T17:04:34.556 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104916 safe_time root txt unknown /proc/104873/task/104916/exe (readlink: Permission denied) 2023-09-30T17:04:34.556 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104916 safe_time root NOFD /proc/104873/task/104916/fd (opendir: Permission denied) 2023-09-30T17:04:34.556 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104922 ceph root cwd unknown /proc/104873/task/104922/cwd (readlink: Permission denied) 2023-09-30T17:04:34.556 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104922 ceph root rtd unknown /proc/104873/task/104922/root (readlink: Permission denied) 2023-09-30T17:04:34.556 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104922 ceph root txt unknown /proc/104873/task/104922/exe (readlink: Permission denied) 2023-09-30T17:04:34.556 INFO:tasks.workunit.client.0.smithi007.stdout:ceph 104873 104922 ceph root NOFD /proc/104873/task/104922/fd (opendir: Permission denied) 2023-09-30T17:04:34.556 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 104924 ubuntu cwd DIR 0,47 194249448 1099511627777 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-09-30T17:04:34.556 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 104924 ubuntu rtd DIR 8,1 4096 2 / 2023-09-30T17:04:34.556 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 104924 ubuntu txt REG 8,1 179672 11398 /usr/bin/lsof 2023-09-30T17:04:34.557 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 104924 ubuntu mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-09-30T17:04:34.557 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 104924 ubuntu mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-09-30T17:04:34.557 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 104924 ubuntu mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-09-30T17:04:34.557 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 104924 ubuntu mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-09-30T17:04:34.557 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 104924 ubuntu mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-09-30T17:04:34.557 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 104924 ubuntu mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-09-30T17:04:34.557 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 104924 ubuntu mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-09-30T17:04:34.557 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 104924 ubuntu mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-09-30T17:04:34.557 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 104924 ubuntu mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-09-30T17:04:34.557 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 104924 ubuntu mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-09-30T17:04:34.557 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 104924 ubuntu mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-09-30T17:04:34.557 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 104924 ubuntu mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-09-30T17:04:34.558 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 104924 ubuntu mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-09-30T17:04:34.558 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 104924 ubuntu mem REG 8,1 213592 7033 /usr/lib64/libtirpc.so.3.0.0 2023-09-30T17:04:34.558 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 104924 ubuntu mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-09-30T17:04:34.558 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 104924 ubuntu mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-09-30T17:04:34.558 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 104924 ubuntu mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-09-30T17:04:34.558 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 104924 ubuntu mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-09-30T17:04:34.558 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 104924 ubuntu 0r FIFO 0,13 0t0 475010 pipe 2023-09-30T17:04:34.558 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 104924 ubuntu 1w FIFO 0,13 0t0 475011 pipe 2023-09-30T17:04:34.558 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 104924 ubuntu 2w FIFO 0,13 0t0 475012 pipe 2023-09-30T17:04:34.558 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 104924 ubuntu 3r DIR 0,5 0 1 /proc 2023-09-30T17:04:34.558 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 104924 ubuntu 4r DIR 0,5 0 486140 /proc/104924/fd 2023-09-30T17:04:34.558 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 104924 ubuntu 5w FIFO 0,13 0t0 486145 pipe 2023-09-30T17:04:34.559 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 104924 ubuntu 6r FIFO 0,13 0t0 486146 pipe 2023-09-30T17:04:34.559 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 104925 ubuntu cwd DIR 0,47 194249448 1099511627777 /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-09-30T17:04:34.559 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 104925 ubuntu rtd DIR 8,1 4096 2 / 2023-09-30T17:04:34.559 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 104925 ubuntu txt REG 8,1 179672 11398 /usr/bin/lsof 2023-09-30T17:04:34.559 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 104925 ubuntu mem REG 8,1 99600 5137 /usr/lib64/libz.so.1.2.11 2023-09-30T17:04:34.559 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 104925 ubuntu mem REG 8,1 88824 5002 /usr/lib64/libresolv-2.28.so 2023-09-30T17:04:34.559 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 104925 ubuntu mem REG 8,1 3079520 7317 /usr/lib64/libcrypto.so.1.1.1k 2023-09-30T17:04:34.559 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 104925 ubuntu mem REG 8,1 16192 5428 /usr/lib64/libkeyutils.so.1.6 2023-09-30T17:04:34.559 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 104925 ubuntu mem REG 8,1 71480 7024 /usr/lib64/libkrb5support.so.0.1 2023-09-30T17:04:34.559 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 104925 ubuntu mem REG 8,1 149976 5000 /usr/lib64/libpthread-2.28.so 2023-09-30T17:04:34.559 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 104925 ubuntu mem REG 8,1 16792 5139 /usr/lib64/libcom_err.so.2.1 2023-09-30T17:04:34.559 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 104925 ubuntu mem REG 8,1 96216 7016 /usr/lib64/libk5crypto.so.3.1 2023-09-30T17:04:34.560 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 104925 ubuntu mem REG 8,1 971456 7022 /usr/lib64/libkrb5.so.3.3 2023-09-30T17:04:34.560 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 104925 ubuntu mem REG 8,1 355920 7012 /usr/lib64/libgssapi_krb5.so.2.2 2023-09-30T17:04:34.560 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 104925 ubuntu mem REG 8,1 19584 4988 /usr/lib64/libdl-2.28.so 2023-09-30T17:04:34.560 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 104925 ubuntu mem REG 8,1 543160 4689 /usr/lib64/libpcre2-8.so.0.7.1 2023-09-30T17:04:34.560 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 104925 ubuntu mem REG 8,1 2088960 4986 /usr/lib64/libc-2.28.so 2023-09-30T17:04:34.560 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 104925 ubuntu mem REG 8,1 213592 7033 /usr/lib64/libtirpc.so.3.0.0 2023-09-30T17:04:34.560 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 104925 ubuntu mem REG 8,1 168536 4693 /usr/lib64/libselinux.so.1 2023-09-30T17:04:34.560 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 104925 ubuntu mem REG 8,1 1105744 4979 /usr/lib64/ld-2.28.so 2023-09-30T17:04:34.560 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 104925 ubuntu mem REG 8,1 337024 17585 /usr/lib/locale/en_US.utf8/LC_CTYPE 2023-09-30T17:04:34.560 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 104925 ubuntu mem REG 8,1 26998 5024 /usr/lib64/gconv/gconv-modules.cache 2023-09-30T17:04:34.560 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 104925 ubuntu 4r FIFO 0,13 0t0 486145 pipe 2023-09-30T17:04:34.560 INFO:tasks.workunit.client.0.smithi007.stdout:lsof 104925 ubuntu 7w FIFO 0,13 0t0 486146 pipe 2023-09-30T17:04:34.561 INFO:teuthology.orchestra.run:Running command with timeout 3600 2023-09-30T17:04:34.561 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2023-09-30T17:04:34.563 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is set 2023-09-30T17:04:34.563 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:34.563 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:34.563 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:04:34.565 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:34.563+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:34.660 INFO:tasks.workunit:Stopping ['suites/fsync-tester.sh'] on client.0... 2023-09-30T17:04:34.661 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2023-09-30T17:04:34.665 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:34.664+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:34.765 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:34.764+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:34.777 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:34.777 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:34.793 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:04:34.941 DEBUG:teuthology.parallel:result is None 2023-09-30T17:04:34.942 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2023-09-30T17:04:34.944 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:34.881+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:34.966 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:34.965+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:34.995 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2023-09-30T17:04:34.996 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-09-30T17:04:35.005 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-09-30T17:04:35.005 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-09-30T17:04:35.005 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T17:04:35.023 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-09-30T17:04:35.023 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T17:04:35.024 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:35.024 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:35.039 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:04:35.066 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:35.065+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:35.083 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T17:04:35.167 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:35.166+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:35.233 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:35.233 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:35.249 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:04:35.291 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:35.290+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:35.368 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:35.367+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:35.375 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~108s 2023-09-30T17:04:35.469 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:35.468+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:35.471 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:04:35.472 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":58,"fsid":"68daccc3-6ea9-4db7-9771-3803ff202df8","created":"2023-09-30T17:01:55.306262+0000","modified":"2023-09-30T17:04:34.403321+0000","last_up_change":"2023-09-30T17:02:47.254915+0000","last_in_change":"2023-09-30T17:01:56.571968+0000","flags":"noscrub,nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5806080,"flags_set":["nodeep-scrub","noscrub","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T17:02:05.343048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":3.0299999713897705,"score_stable":3.0299999713897705,"optimal_score":0.33000001311302185,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T17:02:11.033979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.8700000047683716,"score_stable":1.8700000047683716,"optimal_score":0.67000001668930054,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T17:02:15.583451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.7799999713897705,"score_stable":1.7799999713897705,"optimal_score":0.67000001668930054,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T17:02:16.734427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.4900000095367432,"score_stable":1.4900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9d1653a-8830-4fad-911b-8e7221ee8697","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6801","nonce":2212861041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6803","nonce":2212861041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6807","nonce":2212861041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6805","nonce":2212861041}]},"public_addr":"172.21.15.31:6801/2212861041","cluster_addr":"172.21.15.31:6803/2212861041","heartbeat_back_addr":"172.21.15.31:6807/2212861041","heartbeat_front_addr":"172.21.15.31:6805/2212861041","state":["exists","up"]},{"osd":1,"uuid":"7123aa56-aa1a-43a4-b154-a40b4c70d169","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6801","nonce":1680420094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6803","nonce":1680420094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6807","nonce":1680420094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6805","nonce":1680420094}]},"public_addr":"172.21.15.72:6801/1680420094","cluster_addr":"172.21.15.72:6803/1680420094","heartbeat_back_addr":"172.21.15.72:6807/1680420094","heartbeat_front_addr":"172.21.15.72:6805/1680420094","state":["exists","up"]},{"osd":2,"uuid":"f40ee0d7-7bc3-4a46-bdac-9c134c55c907","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6801","nonce":1018866543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6803","nonce":1018866543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6807","nonce":1018866543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6805","nonce":1018866543}]},"public_addr":"172.21.15.134:6801/1018866543","cluster_addr":"172.21.15.134:6803/1018866543","heartbeat_back_addr":"172.21.15.134:6807/1018866543","heartbeat_front_addr":"172.21.15.134:6805/1018866543","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T17:02:01.702754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T17:02:01.688791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T17:02:01.667971+0000","dead_epoch":22}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T17:04:35.487 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T17:02:05.343048+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 3.0299999713897705, 'score_stable': 3.0299999713897705, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T17:02:11.033979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.8700000047683716, 'score_stable': 1.8700000047683716, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T17:02:15.583451+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.7799999713897705, 'score_stable': 1.7799999713897705, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.190000057220459, 'raw_score_stable': 1.190000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T17:02:16.734427+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.4900000095367432, 'score_stable': 1.4900000095367432, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T17:04:35.487 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T17:04:35.514 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:35.515 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:35.531 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:04:35.571 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:35.570+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:35.671 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:35.670+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:35.774 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:35.774 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:35.774 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:35.773+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:35.790 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:04:35.836 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2023-09-30T17:04:35.851 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T17:04:35.873 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:35.872+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:35.980 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:35.974+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:36.010 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:36.010 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:36.011 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-09-30T17:04:36.026 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:04:36.111 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:36.111+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:36.172 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:04:36.175 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:36.175+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:36.195 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:04:36.196 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-09-30T17:04:36.196 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-09-30T17:04:36.196 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:04:36.199 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:04:36.199 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:04:36.200 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 8 2023-09-30T17:04:36.215 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T17:04:36.277 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:04:36.277 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:04:36.277 INFO:teuthology.orchestra.run.smithi031.stdout: "complaint_time": 30, 2023-09-30T17:04:36.277 INFO:teuthology.orchestra.run.smithi031.stdout: "num_blocked_ops": 0 2023-09-30T17:04:36.277 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:04:36.279 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:36.276+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:36.293 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:04:36.378 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:36.377+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:36.479 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:36.478+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:36.553 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:04:36.553 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 20, 2023-09-30T17:04:36.553 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 600, 2023-09-30T17:04:36.554 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:04:36.554 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.554 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165665 4.6 4:63e80496:::100000001f8.0000001e:head [write 1212416~4096,write 1318912~4096,write 1462272~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:36.554 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.209892+0000", 2023-09-30T17:04:36.554 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.3410901729999996, 2023-09-30T17:04:36.554 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.76500929900000003, 2023-09-30T17:04:36.554 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:36.554 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:36.554 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:36.554 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:36.554 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:36.555 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165665 2023-09-30T17:04:36.555 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.555 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:36.555 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.555 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:36.555 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.209892+0000", 2023-09-30T17:04:36.555 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:36.555 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.555 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.555 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:36.555 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.209892+0000", 2023-09-30T17:04:36.555 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:36.556 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.556 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.556 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:36.556 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.209893+0000", 2023-09-30T17:04:36.556 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5099999999999999e-07 2023-09-30T17:04:36.556 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.556 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.556 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:36.556 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.209908+0000", 2023-09-30T17:04:36.556 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4754e-05 2023-09-30T17:04:36.556 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.556 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.557 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:36.557 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.209916+0000", 2023-09-30T17:04:36.557 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.7940000000000008e-06 2023-09-30T17:04:36.557 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.557 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.557 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:36.557 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.209923+0000", 2023-09-30T17:04:36.557 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5429999999999999e-06 2023-09-30T17:04:36.557 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.557 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.557 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:36.557 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.899390+0000", 2023-09-30T17:04:36.558 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.689467371 2023-09-30T17:04:36.558 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.558 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.558 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:36.558 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.899462+0000", 2023-09-30T17:04:36.558 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1273999999999996e-05 2023-09-30T17:04:36.558 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.558 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.558 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:36.558 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.899610+0000", 2023-09-30T17:04:36.558 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014818599999999999 2023-09-30T17:04:36.559 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.559 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.559 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:36.559 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.919587+0000", 2023-09-30T17:04:36.559 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.019977042 2023-09-30T17:04:36.559 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.559 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.559 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:36.559 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.974802+0000", 2023-09-30T17:04:36.559 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.055214764 2023-09-30T17:04:36.559 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.559 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.560 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:36.560 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.974863+0000", 2023-09-30T17:04:36.560 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1377000000000005e-05 2023-09-30T17:04:36.560 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.560 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.560 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:36.560 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.974901+0000", 2023-09-30T17:04:36.560 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8543e-05 2023-09-30T17:04:36.560 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:36.560 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:36.560 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:36.560 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.561 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.561 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165673 4.6 4:63e80496:::100000001f8.0000001e:head [write 516096~4096,write 524288~4096,write 532480~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:36.561 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.210099+0000", 2023-09-30T17:04:36.561 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.3408833019999999, 2023-09-30T17:04:36.561 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.76494798200000003, 2023-09-30T17:04:36.561 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:36.561 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:36.561 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:36.561 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:36.561 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:36.562 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165673 2023-09-30T17:04:36.562 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.562 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:36.562 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.562 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:36.562 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.210099+0000", 2023-09-30T17:04:36.562 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:36.563 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.563 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.563 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:36.563 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.210099+0000", 2023-09-30T17:04:36.563 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:36.563 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.563 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.563 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:36.563 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.210100+0000", 2023-09-30T17:04:36.563 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0699999999999997e-07 2023-09-30T17:04:36.563 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.563 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.563 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:36.565 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.210117+0000", 2023-09-30T17:04:36.565 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7501000000000001e-05 2023-09-30T17:04:36.565 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.565 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.565 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:36.565 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.210126+0000", 2023-09-30T17:04:36.565 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2629999999999992e-06 2023-09-30T17:04:36.565 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.566 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.566 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:36.566 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.210133+0000", 2023-09-30T17:04:36.566 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8079999999999999e-06 2023-09-30T17:04:36.566 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.566 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.566 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:36.566 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.902650+0000", 2023-09-30T17:04:36.566 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.69251684800000002 2023-09-30T17:04:36.566 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.566 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.567 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:36.567 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.902724+0000", 2023-09-30T17:04:36.567 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4376999999999996e-05 2023-09-30T17:04:36.567 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.567 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.567 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:36.567 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.902881+0000", 2023-09-30T17:04:36.567 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000156269 2023-09-30T17:04:36.567 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.567 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.567 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:36.567 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.925614+0000", 2023-09-30T17:04:36.568 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.022732937000000002 2023-09-30T17:04:36.568 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.568 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.568 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:36.568 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.974955+0000", 2023-09-30T17:04:36.568 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.04934115 2023-09-30T17:04:36.568 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.568 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.568 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:36.568 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.975012+0000", 2023-09-30T17:04:36.568 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6949e-05 2023-09-30T17:04:36.568 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.568 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.569 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:36.569 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.975047+0000", 2023-09-30T17:04:36.569 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5373000000000002e-05 2023-09-30T17:04:36.569 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:36.569 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:36.569 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:36.569 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.569 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.569 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165689 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 188416~4096,write 229376~4096,write 299008~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:36.569 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.217300+0000", 2023-09-30T17:04:36.569 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.3336827280000003, 2023-09-30T17:04:36.570 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75814632500000001, 2023-09-30T17:04:36.570 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:36.570 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:36.570 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:36.570 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:36.570 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:36.570 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165689 2023-09-30T17:04:36.570 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.570 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:36.570 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.570 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:36.570 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.217300+0000", 2023-09-30T17:04:36.571 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:36.571 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.571 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.571 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:36.571 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.217300+0000", 2023-09-30T17:04:36.571 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:36.571 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.571 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.571 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:36.571 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.217300+0000", 2023-09-30T17:04:36.571 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3000000000000001e-07 2023-09-30T17:04:36.571 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.572 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.572 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:36.572 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.217314+0000", 2023-09-30T17:04:36.572 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3901e-05 2023-09-30T17:04:36.572 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.572 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.572 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:36.572 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.217321+0000", 2023-09-30T17:04:36.572 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5869999999999998e-06 2023-09-30T17:04:36.572 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.572 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.573 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:36.573 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.217326+0000", 2023-09-30T17:04:36.573 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7740000000000001e-06 2023-09-30T17:04:36.573 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.573 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.573 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:36.573 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.907842+0000", 2023-09-30T17:04:36.573 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.69051533600000004 2023-09-30T17:04:36.573 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.573 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.573 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:36.574 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.907927+0000", 2023-09-30T17:04:36.574 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5619999999999997e-05 2023-09-30T17:04:36.574 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.574 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.574 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:36.574 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.908097+0000", 2023-09-30T17:04:36.574 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016991400000000001 2023-09-30T17:04:36.574 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.574 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.574 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:36.574 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.925623+0000", 2023-09-30T17:04:36.574 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.017525888999999999 2023-09-30T17:04:36.575 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.575 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.575 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:36.575 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.975110+0000", 2023-09-30T17:04:36.575 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.049486789000000003 2023-09-30T17:04:36.575 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.575 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.575 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:36.575 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.975170+0000", 2023-09-30T17:04:36.575 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9960000000000002e-05 2023-09-30T17:04:36.575 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.575 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.576 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:36.576 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.975446+0000", 2023-09-30T17:04:36.576 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000276125 2023-09-30T17:04:36.576 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:36.576 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:36.576 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:36.576 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.576 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.576 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165875 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 458752~4096,write 1454080~4096,write 1634304~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:36.576 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.295916+0000", 2023-09-30T17:04:36.576 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.2550660779999996, 2023-09-30T17:04:36.576 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.76379055500000004, 2023-09-30T17:04:36.577 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:36.577 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:36.577 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:36.577 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:36.577 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:36.577 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165875 2023-09-30T17:04:36.577 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.577 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:36.577 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.577 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:36.577 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.295916+0000", 2023-09-30T17:04:36.577 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:36.578 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.578 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.578 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:36.578 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.295916+0000", 2023-09-30T17:04:36.578 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:36.578 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.578 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.578 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:36.578 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.295917+0000", 2023-09-30T17:04:36.578 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9500000000000002e-07 2023-09-30T17:04:36.578 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.579 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.579 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:36.579 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.295932+0000", 2023-09-30T17:04:36.579 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4803999999999999e-05 2023-09-30T17:04:36.579 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.579 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.579 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:36.579 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.295941+0000", 2023-09-30T17:04:36.579 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.448e-06 2023-09-30T17:04:36.579 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.579 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.579 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:36.580 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.295948+0000", 2023-09-30T17:04:36.580 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9199999999999998e-06 2023-09-30T17:04:36.580 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.580 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.580 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:36.580 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.971359+0000", 2023-09-30T17:04:36.580 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67541110500000001 2023-09-30T17:04:36.580 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.580 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.580 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:36.580 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.971433+0000", 2023-09-30T17:04:36.580 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3388999999999998e-05 2023-09-30T17:04:36.581 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.581 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.581 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:36.581 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.971583+0000", 2023-09-30T17:04:36.581 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015035999999999999 2023-09-30T17:04:36.581 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.581 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.581 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:36.581 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.982409+0000", 2023-09-30T17:04:36.581 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010826242999999999 2023-09-30T17:04:36.581 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.582 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.582 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:36.582 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.059610+0000", 2023-09-30T17:04:36.582 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.077201160000000005 2023-09-30T17:04:36.582 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.582 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.582 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:36.582 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.059669+0000", 2023-09-30T17:04:36.582 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8965999999999998e-05 2023-09-30T17:04:36.582 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.582 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.583 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:36.583 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.059707+0000", 2023-09-30T17:04:36.583 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7564999999999997e-05 2023-09-30T17:04:36.583 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:36.583 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:36.583 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:36.583 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.583 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.583 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165878 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 2277376~4096,write 2371584~4096,write 4050944~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:36.583 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.299610+0000", 2023-09-30T17:04:36.583 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.2513719989999998, 2023-09-30T17:04:36.584 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75525803300000005, 2023-09-30T17:04:36.584 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:36.584 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:36.584 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:36.584 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:36.584 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:36.584 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165878 2023-09-30T17:04:36.584 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.584 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:36.584 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.584 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:36.584 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299610+0000", 2023-09-30T17:04:36.585 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:36.585 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.585 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.585 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:36.585 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299610+0000", 2023-09-30T17:04:36.585 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:36.585 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.585 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.585 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:36.585 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299611+0000", 2023-09-30T17:04:36.585 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7299999999999996e-07 2023-09-30T17:04:36.585 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.586 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.586 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:36.586 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299623+0000", 2023-09-30T17:04:36.586 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2513e-05 2023-09-30T17:04:36.586 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.586 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.586 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:36.586 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299630+0000", 2023-09-30T17:04:36.586 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0090000000000001e-06 2023-09-30T17:04:36.586 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.586 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.586 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:36.587 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299638+0000", 2023-09-30T17:04:36.587 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1210000000000001e-06 2023-09-30T17:04:36.587 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.587 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.587 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:36.587 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.971347+0000", 2023-09-30T17:04:36.587 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67170925699999995 2023-09-30T17:04:36.587 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.587 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.587 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:36.587 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.971419+0000", 2023-09-30T17:04:36.588 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2495000000000003e-05 2023-09-30T17:04:36.588 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.588 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.588 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:36.588 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.971567+0000", 2023-09-30T17:04:36.588 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014805499999999999 2023-09-30T17:04:36.588 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.588 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.588 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:36.588 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.982312+0000", 2023-09-30T17:04:36.588 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010744584 2023-09-30T17:04:36.588 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.589 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.589 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:36.589 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.054770+0000", 2023-09-30T17:04:36.589 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.072457683999999994 2023-09-30T17:04:36.589 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.589 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.589 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:36.589 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.054825+0000", 2023-09-30T17:04:36.589 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5210000000000002e-05 2023-09-30T17:04:36.589 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.589 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.590 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:36.590 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.054868+0000", 2023-09-30T17:04:36.590 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3532000000000003e-05 2023-09-30T17:04:36.590 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:36.590 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:36.590 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:36.590 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.590 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.590 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165890 4.36 4:6da220e6:::100000001f8.0000003f:head [write 3395584~4096,write 3436544~4096,write 3444736~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:36.590 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.299835+0000", 2023-09-30T17:04:36.590 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.251147316, 2023-09-30T17:04:36.590 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.76012937700000005, 2023-09-30T17:04:36.591 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:36.591 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:36.591 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:36.591 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:36.591 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:36.591 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165890 2023-09-30T17:04:36.591 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.591 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:36.591 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.591 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:36.591 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299835+0000", 2023-09-30T17:04:36.591 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:36.592 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.592 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.592 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:36.592 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299835+0000", 2023-09-30T17:04:36.592 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:36.592 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.592 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.592 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:36.592 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299835+0000", 2023-09-30T17:04:36.592 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5699999999999998e-07 2023-09-30T17:04:36.592 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.592 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.593 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:36.593 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299905+0000", 2023-09-30T17:04:36.593 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9908999999999998e-05 2023-09-30T17:04:36.593 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.593 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.593 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:36.593 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299914+0000", 2023-09-30T17:04:36.593 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9630000000000004e-06 2023-09-30T17:04:36.593 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.593 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.593 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:36.593 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299921+0000", 2023-09-30T17:04:36.594 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8079999999999999e-06 2023-09-30T17:04:36.594 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.594 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.594 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:36.594 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.975617+0000", 2023-09-30T17:04:36.594 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67569579099999999 2023-09-30T17:04:36.594 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.594 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.594 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:36.594 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.975700+0000", 2023-09-30T17:04:36.594 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3462999999999997e-05 2023-09-30T17:04:36.594 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.595 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.595 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:36.595 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.975871+0000", 2023-09-30T17:04:36.595 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017027399999999999 2023-09-30T17:04:36.595 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.595 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.595 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:36.595 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.001290+0000", 2023-09-30T17:04:36.595 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.025419576999999999 2023-09-30T17:04:36.595 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.595 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.595 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:36.596 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.059876+0000", 2023-09-30T17:04:36.596 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.058585849000000002 2023-09-30T17:04:36.596 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.596 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.596 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:36.596 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.059929+0000", 2023-09-30T17:04:36.596 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3053000000000002e-05 2023-09-30T17:04:36.596 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.596 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.596 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:36.596 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.059964+0000", 2023-09-30T17:04:36.596 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5233e-05 2023-09-30T17:04:36.597 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:36.597 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:36.597 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:36.597 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.597 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.597 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165893 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 2748416~4096,write 2764800~4096,write 3031040~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:36.597 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.299965+0000", 2023-09-30T17:04:36.597 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.2510170399999998, 2023-09-30T17:04:36.597 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75987149300000001, 2023-09-30T17:04:36.597 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:36.597 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:36.597 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:36.598 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:36.598 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:36.598 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165893 2023-09-30T17:04:36.598 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.598 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:36.598 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.598 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:36.598 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299965+0000", 2023-09-30T17:04:36.598 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:36.599 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.599 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.599 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:36.599 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299965+0000", 2023-09-30T17:04:36.599 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:36.599 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.599 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.600 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:36.600 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.301184+0000", 2023-09-30T17:04:36.600 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0012189779999999999 2023-09-30T17:04:36.600 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.600 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.600 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:36.600 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.301199+0000", 2023-09-30T17:04:36.600 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4626e-05 2023-09-30T17:04:36.600 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.600 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.600 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:36.600 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.301209+0000", 2023-09-30T17:04:36.601 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.042e-05 2023-09-30T17:04:36.601 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.601 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.601 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:36.601 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.301217+0000", 2023-09-30T17:04:36.601 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4000000000000003e-06 2023-09-30T17:04:36.601 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.601 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.601 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:36.601 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.975800+0000", 2023-09-30T17:04:36.601 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67458368700000004 2023-09-30T17:04:36.602 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.602 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.602 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:36.602 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.975886+0000", 2023-09-30T17:04:36.602 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5722000000000004e-05 2023-09-30T17:04:36.602 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.602 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.602 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:36.602 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.976065+0000", 2023-09-30T17:04:36.602 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000178705 2023-09-30T17:04:36.602 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.602 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.603 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:36.603 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.998244+0000", 2023-09-30T17:04:36.603 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.022178788000000001 2023-09-30T17:04:36.603 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.603 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.603 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:36.603 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.059746+0000", 2023-09-30T17:04:36.603 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.061501950999999999 2023-09-30T17:04:36.603 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.603 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.603 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:36.603 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.059802+0000", 2023-09-30T17:04:36.604 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6128000000000002e-05 2023-09-30T17:04:36.604 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.604 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.604 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:36.604 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.059837+0000", 2023-09-30T17:04:36.604 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5088e-05 2023-09-30T17:04:36.604 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:36.604 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:36.604 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:36.604 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.604 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.605 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165908 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 2269184~4096,write 4112384~4096,write 4136960~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:36.605 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.309255+0000", 2023-09-30T17:04:36.605 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.2417272710000002, 2023-09-30T17:04:36.605 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.76105314999999996, 2023-09-30T17:04:36.605 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:36.605 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:36.605 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:36.605 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:36.605 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:36.605 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165908 2023-09-30T17:04:36.605 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.605 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:36.606 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.606 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:36.606 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.309255+0000", 2023-09-30T17:04:36.606 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:36.606 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.606 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.606 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:36.606 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.309255+0000", 2023-09-30T17:04:36.606 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:36.606 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.607 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.607 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:36.607 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.311162+0000", 2023-09-30T17:04:36.607 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001906886 2023-09-30T17:04:36.607 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.607 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.607 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:36.607 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.311177+0000", 2023-09-30T17:04:36.607 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5193e-05 2023-09-30T17:04:36.607 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.607 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.608 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:36.608 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.311188+0000", 2023-09-30T17:04:36.608 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0805000000000001e-05 2023-09-30T17:04:36.608 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.608 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.608 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:36.608 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.311196+0000", 2023-09-30T17:04:36.608 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.627e-06 2023-09-30T17:04:36.608 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.608 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.608 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:36.609 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.982808+0000", 2023-09-30T17:04:36.609 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67161246100000005 2023-09-30T17:04:36.609 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.609 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.609 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:36.609 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.982872+0000", 2023-09-30T17:04:36.609 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3646999999999996e-05 2023-09-30T17:04:36.609 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.609 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.609 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:36.609 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.983017+0000", 2023-09-30T17:04:36.609 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000144964 2023-09-30T17:04:36.610 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.610 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.610 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:36.610 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.010841+0000", 2023-09-30T17:04:36.610 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.027824637999999999 2023-09-30T17:04:36.610 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.610 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.610 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:36.610 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.070218+0000", 2023-09-30T17:04:36.610 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.059376421999999998 2023-09-30T17:04:36.610 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.611 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.611 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:36.611 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.070272+0000", 2023-09-30T17:04:36.611 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4407000000000003e-05 2023-09-30T17:04:36.611 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.611 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.611 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:36.611 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.070308+0000", 2023-09-30T17:04:36.611 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6100000000000003e-05 2023-09-30T17:04:36.611 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:36.611 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:36.612 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:36.612 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.612 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.612 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165910 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 1191936~4096,write 1277952~4096,write 1613824~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:36.612 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.311262+0000", 2023-09-30T17:04:36.612 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.2397207019999996, 2023-09-30T17:04:36.612 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75916103300000004, 2023-09-30T17:04:36.612 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:36.612 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:36.612 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:36.612 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:36.612 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:36.613 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165910 2023-09-30T17:04:36.613 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.613 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:36.613 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.613 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:36.613 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.311262+0000", 2023-09-30T17:04:36.613 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:36.613 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.613 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.613 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:36.613 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.311262+0000", 2023-09-30T17:04:36.613 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:36.614 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.614 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.614 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:36.614 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.313172+0000", 2023-09-30T17:04:36.614 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001910847 2023-09-30T17:04:36.614 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.614 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.614 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:36.614 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.313191+0000", 2023-09-30T17:04:36.614 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8416000000000001e-05 2023-09-30T17:04:36.614 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.615 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.615 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:36.615 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.313204+0000", 2023-09-30T17:04:36.615 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.271e-05 2023-09-30T17:04:36.615 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.615 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.615 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:36.615 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.313211+0000", 2023-09-30T17:04:36.615 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3529999999999997e-06 2023-09-30T17:04:36.615 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.615 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.616 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:36.616 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.990896+0000", 2023-09-30T17:04:36.616 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67768552500000001 2023-09-30T17:04:36.616 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.616 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.616 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:36.616 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.990972+0000", 2023-09-30T17:04:36.616 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5658e-05 2023-09-30T17:04:36.616 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.616 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.616 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:36.616 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.991072+0000", 2023-09-30T17:04:36.617 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.9636000000000006e-05 2023-09-30T17:04:36.617 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.617 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.617 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:36.617 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.010847+0000", 2023-09-30T17:04:36.617 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.019774908000000001 2023-09-30T17:04:36.617 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.617 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.617 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:36.617 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.070345+0000", 2023-09-30T17:04:36.617 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.059497983999999997 2023-09-30T17:04:36.617 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.618 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.618 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:36.618 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.070392+0000", 2023-09-30T17:04:36.618 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6851999999999998e-05 2023-09-30T17:04:36.618 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.618 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.618 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:36.618 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.070423+0000", 2023-09-30T17:04:36.618 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.1143999999999999e-05 2023-09-30T17:04:36.618 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:36.619 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:36.619 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:36.619 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.619 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.619 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165918 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 2666496~4096,write 2760704~4096,write 3031040~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:36.619 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.315883+0000", 2023-09-30T17:04:36.619 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.2350988750000003, 2023-09-30T17:04:36.619 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75903742100000005, 2023-09-30T17:04:36.619 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:36.619 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:36.619 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:36.619 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:36.620 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:36.620 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165918 2023-09-30T17:04:36.620 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.620 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:36.620 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.620 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:36.620 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315883+0000", 2023-09-30T17:04:36.620 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:36.620 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.620 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.620 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:36.620 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315883+0000", 2023-09-30T17:04:36.621 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:36.621 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.621 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.621 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:36.621 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315884+0000", 2023-09-30T17:04:36.621 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8199999999999999e-07 2023-09-30T17:04:36.621 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.621 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.621 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:36.621 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315903+0000", 2023-09-30T17:04:36.621 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9089e-05 2023-09-30T17:04:36.622 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.622 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.622 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:36.622 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315916+0000", 2023-09-30T17:04:36.622 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2636999999999999e-05 2023-09-30T17:04:36.622 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.622 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.622 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:36.622 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315923+0000", 2023-09-30T17:04:36.622 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2259999999999999e-06 2023-09-30T17:04:36.622 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.622 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.623 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:36.623 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.993661+0000", 2023-09-30T17:04:36.623 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67773771500000002 2023-09-30T17:04:36.623 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.623 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.623 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:36.623 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.993749+0000", 2023-09-30T17:04:36.623 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.7721999999999998e-05 2023-09-30T17:04:36.623 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.623 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.623 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:36.624 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.996215+0000", 2023-09-30T17:04:36.624 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0024667360000000002 2023-09-30T17:04:36.624 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.624 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.624 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:36.624 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.010996+0000", 2023-09-30T17:04:36.624 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.014780873 2023-09-30T17:04:36.624 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.624 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.624 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:36.624 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.074853+0000", 2023-09-30T17:04:36.625 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.063857133999999996 2023-09-30T17:04:36.625 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.625 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.625 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:36.625 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.074888+0000", 2023-09-30T17:04:36.625 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5067000000000002e-05 2023-09-30T17:04:36.625 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.625 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.625 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:36.625 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.074921+0000", 2023-09-30T17:04:36.625 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.2539999999999997e-05 2023-09-30T17:04:36.626 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:36.626 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:36.626 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:36.626 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.626 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.626 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165921 4.6 4:63e80496:::100000001f8.0000001e:head [write 679936~4096,write 1089536~4096,write 1138688~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:36.626 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.315973+0000", 2023-09-30T17:04:36.626 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.2350089400000002, 2023-09-30T17:04:36.626 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75610897399999999, 2023-09-30T17:04:36.626 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:36.626 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:36.627 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:36.627 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:36.627 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:36.627 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165921 2023-09-30T17:04:36.627 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.627 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:36.627 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.627 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:36.627 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315973+0000", 2023-09-30T17:04:36.627 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:36.627 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.628 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.628 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:36.628 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315973+0000", 2023-09-30T17:04:36.628 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:36.628 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.628 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.628 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:36.628 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315974+0000", 2023-09-30T17:04:36.628 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1100000000000001e-07 2023-09-30T17:04:36.628 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.628 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.628 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:36.629 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315986+0000", 2023-09-30T17:04:36.629 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2673e-05 2023-09-30T17:04:36.629 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.629 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.629 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:36.629 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315995+0000", 2023-09-30T17:04:36.629 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1689999999999992e-06 2023-09-30T17:04:36.629 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.629 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.629 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:36.630 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.316000+0000", 2023-09-30T17:04:36.630 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9849999999999997e-06 2023-09-30T17:04:36.630 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.630 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.630 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:36.630 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.994495+0000", 2023-09-30T17:04:36.630 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67849566800000005 2023-09-30T17:04:36.630 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.630 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.630 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:36.630 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.994579+0000", 2023-09-30T17:04:36.631 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4089000000000001e-05 2023-09-30T17:04:36.631 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.631 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.631 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:36.631 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.994744+0000", 2023-09-30T17:04:36.631 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000164327 2023-09-30T17:04:36.631 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.631 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.631 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:36.631 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.010988+0000", 2023-09-30T17:04:36.631 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.016244705000000002 2023-09-30T17:04:36.631 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.632 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.632 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:36.632 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.071979+0000", 2023-09-30T17:04:36.632 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.060990111 2023-09-30T17:04:36.632 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.632 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.632 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:36.632 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.072035+0000", 2023-09-30T17:04:36.632 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6320000000000003e-05 2023-09-30T17:04:36.632 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.632 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.633 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:36.633 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.072082+0000", 2023-09-30T17:04:36.633 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7515999999999997e-05 2023-09-30T17:04:36.633 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:36.633 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:36.633 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:36.633 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.633 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.633 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165949 4.6 4:616d4c41:::100000001f8.00000034:head [write 409600~4096,write 618496~4096,write 659456~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:36.633 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.326340+0000", 2023-09-30T17:04:36.634 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.2246428260000002, 2023-09-30T17:04:36.634 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75612495899999999, 2023-09-30T17:04:36.634 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:36.634 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:36.634 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:36.634 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:36.634 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:36.634 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165949 2023-09-30T17:04:36.634 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.634 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:36.634 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.635 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:36.635 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.326340+0000", 2023-09-30T17:04:36.635 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:36.635 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.635 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.635 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:36.635 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.326340+0000", 2023-09-30T17:04:36.635 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:36.635 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.635 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.635 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:36.635 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.326340+0000", 2023-09-30T17:04:36.636 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0200000000000002e-07 2023-09-30T17:04:36.636 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.636 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.636 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:36.636 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.326352+0000", 2023-09-30T17:04:36.636 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1715e-05 2023-09-30T17:04:36.636 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.636 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.636 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:36.636 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.326358+0000", 2023-09-30T17:04:36.636 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3679999999999998e-06 2023-09-30T17:04:36.637 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.637 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.637 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:36.637 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.326363+0000", 2023-09-30T17:04:36.637 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9629999999999997e-06 2023-09-30T17:04:36.637 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.637 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.637 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:36.637 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.006610+0000", 2023-09-30T17:04:36.637 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.68024690499999996 2023-09-30T17:04:36.637 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.637 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.638 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:36.638 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.006692+0000", 2023-09-30T17:04:36.638 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2274000000000005e-05 2023-09-30T17:04:36.638 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.638 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.638 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:36.638 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.006845+0000", 2023-09-30T17:04:36.638 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000152817 2023-09-30T17:04:36.638 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.638 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.639 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:36.639 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.023168+0000", 2023-09-30T17:04:36.639 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.016322962999999999 2023-09-30T17:04:36.639 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.639 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.639 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:36.639 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.082373+0000", 2023-09-30T17:04:36.639 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.059204869 2023-09-30T17:04:36.639 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.639 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.640 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:36.640 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.082429+0000", 2023-09-30T17:04:36.640 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5671000000000003e-05 2023-09-30T17:04:36.640 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.640 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.640 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:36.640 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.082464+0000", 2023-09-30T17:04:36.640 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5911999999999998e-05 2023-09-30T17:04:36.640 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:36.640 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:36.640 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:36.640 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.640 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.641 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165988 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 2596864~4096,write 3084288~4096,write 3141632~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:36.641 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.342979+0000", 2023-09-30T17:04:36.641 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.2080038340000003, 2023-09-30T17:04:36.641 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75803858099999999, 2023-09-30T17:04:36.641 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:36.641 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:36.641 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:36.641 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:36.641 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:36.641 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165988 2023-09-30T17:04:36.641 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.641 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:36.642 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.642 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:36.642 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.342979+0000", 2023-09-30T17:04:36.642 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:36.642 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.642 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.642 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:36.642 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.342979+0000", 2023-09-30T17:04:36.642 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:36.642 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.642 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.643 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:36.643 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.342980+0000", 2023-09-30T17:04:36.643 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.018e-06 2023-09-30T17:04:36.643 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.643 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.643 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:36.643 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.342994+0000", 2023-09-30T17:04:36.643 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4819e-05 2023-09-30T17:04:36.643 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.643 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.643 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:36.643 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.343005+0000", 2023-09-30T17:04:36.644 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0552e-05 2023-09-30T17:04:36.644 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.644 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.644 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:36.644 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.343012+0000", 2023-09-30T17:04:36.644 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.888e-06 2023-09-30T17:04:36.644 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.644 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.644 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:36.644 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.018485+0000", 2023-09-30T17:04:36.644 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67547272199999997 2023-09-30T17:04:36.645 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.645 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.645 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:36.645 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.018573+0000", 2023-09-30T17:04:36.645 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8243000000000002e-05 2023-09-30T17:04:36.645 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.645 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.645 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:36.645 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.018779+0000", 2023-09-30T17:04:36.645 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00020640599999999999 2023-09-30T17:04:36.646 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.646 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.646 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:36.646 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.034608+0000", 2023-09-30T17:04:36.646 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.015828519999999999 2023-09-30T17:04:36.646 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.646 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.646 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:36.646 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.100930+0000", 2023-09-30T17:04:36.646 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.066322504000000004 2023-09-30T17:04:36.647 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.647 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.647 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:36.647 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.100981+0000", 2023-09-30T17:04:36.647 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0946000000000003e-05 2023-09-30T17:04:36.647 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.647 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.647 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:36.647 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.101017+0000", 2023-09-30T17:04:36.647 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5963000000000001e-05 2023-09-30T17:04:36.648 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:36.648 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:36.648 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:36.648 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.648 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.648 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165998 4.36 4:6fa85f86:::100000001f8.00000013:head [write 1470464~4096,write 1576960~4096,write 1806336~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:36.648 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.343107+0000", 2023-09-30T17:04:36.648 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.2078754180000004, 2023-09-30T17:04:36.648 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75779366699999995, 2023-09-30T17:04:36.648 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:36.648 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:36.648 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:36.649 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:36.649 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:36.649 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165998 2023-09-30T17:04:36.649 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.649 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:36.649 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.649 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:36.649 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.343107+0000", 2023-09-30T17:04:36.649 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:36.649 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.649 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.649 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:36.650 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.343107+0000", 2023-09-30T17:04:36.650 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:36.650 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.650 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.650 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:36.650 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.346167+0000", 2023-09-30T17:04:36.650 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.003060349 2023-09-30T17:04:36.650 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.650 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.650 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:36.651 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.346188+0000", 2023-09-30T17:04:36.651 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.0894e-05 2023-09-30T17:04:36.651 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.651 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.651 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:36.651 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.346201+0000", 2023-09-30T17:04:36.651 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2424e-05 2023-09-30T17:04:36.651 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.651 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.651 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:36.651 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.346209+0000", 2023-09-30T17:04:36.651 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1980000000000001e-06 2023-09-30T17:04:36.652 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.652 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.652 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:36.652 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.018506+0000", 2023-09-30T17:04:36.652 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67229752899999995 2023-09-30T17:04:36.652 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.652 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.652 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:36.652 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.018582+0000", 2023-09-30T17:04:36.652 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.538e-05 2023-09-30T17:04:36.652 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.653 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.653 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:36.653 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.018756+0000", 2023-09-30T17:04:36.653 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000174611 2023-09-30T17:04:36.653 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.653 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.653 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:36.653 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.034599+0000", 2023-09-30T17:04:36.653 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.015843166999999998 2023-09-30T17:04:36.653 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.653 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.654 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:36.654 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.100806+0000", 2023-09-30T17:04:36.654 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.066206047000000004 2023-09-30T17:04:36.654 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.654 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.654 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:36.654 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.100863+0000", 2023-09-30T17:04:36.654 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7843999999999997e-05 2023-09-30T17:04:36.654 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.654 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.655 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:36.655 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.100901+0000", 2023-09-30T17:04:36.655 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7224000000000001e-05 2023-09-30T17:04:36.655 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:36.655 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:36.655 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:36.655 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.655 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.655 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:166011 4.6 4:63e80496:::100000001f8.0000001e:head [write 561152~8192,write 663552~4096,write 851968~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:36.655 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.350327+0000", 2023-09-30T17:04:36.655 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.2006553699999998, 2023-09-30T17:04:36.656 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75701292499999995, 2023-09-30T17:04:36.656 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:36.656 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:36.656 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:36.656 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:36.656 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:36.656 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 166011 2023-09-30T17:04:36.656 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.656 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:36.656 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.656 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:36.656 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.350327+0000", 2023-09-30T17:04:36.657 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:36.657 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.657 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.657 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:36.657 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.350327+0000", 2023-09-30T17:04:36.657 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:36.657 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.657 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.657 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:36.658 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.350327+0000", 2023-09-30T17:04:36.658 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9799999999999999e-07 2023-09-30T17:04:36.658 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.658 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.658 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:36.658 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.350345+0000", 2023-09-30T17:04:36.658 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7237000000000001e-05 2023-09-30T17:04:36.658 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.659 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.659 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:36.659 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.350351+0000", 2023-09-30T17:04:36.659 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.489e-06 2023-09-30T17:04:36.659 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.659 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.659 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:36.659 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.350357+0000", 2023-09-30T17:04:36.659 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7300000000000002e-06 2023-09-30T17:04:36.659 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.659 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.660 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:36.660 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.026726+0000", 2023-09-30T17:04:36.660 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.676369636 2023-09-30T17:04:36.660 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.660 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.660 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:36.660 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.026803+0000", 2023-09-30T17:04:36.660 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6885999999999995e-05 2023-09-30T17:04:36.660 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.661 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.661 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:36.661 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.026961+0000", 2023-09-30T17:04:36.661 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015803799999999999 2023-09-30T17:04:36.661 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.661 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.661 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:36.661 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.037169+0000", 2023-09-30T17:04:36.661 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010207748000000001 2023-09-30T17:04:36.661 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.661 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.662 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:36.662 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.107238+0000", 2023-09-30T17:04:36.662 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.070069305999999998 2023-09-30T17:04:36.662 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.662 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.662 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:36.662 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.107299+0000", 2023-09-30T17:04:36.662 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0757999999999997e-05 2023-09-30T17:04:36.662 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.662 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.662 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:36.663 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.107340+0000", 2023-09-30T17:04:36.663 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0698999999999998e-05 2023-09-30T17:04:36.663 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:36.663 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:36.663 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:36.663 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.663 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.663 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:166057 4.6 4:63e80496:::100000001f8.0000001e:head [write 3416064~4096,write 3485696~4096,write 3571712~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:36.663 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.366264+0000", 2023-09-30T17:04:36.663 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.184718535, 2023-09-30T17:04:36.663 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.76104848700000005, 2023-09-30T17:04:36.664 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:36.664 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:36.664 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:36.664 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:36.664 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:36.664 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 166057 2023-09-30T17:04:36.664 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.664 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:36.664 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.664 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:36.664 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.366264+0000", 2023-09-30T17:04:36.664 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:36.665 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.665 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.665 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:36.665 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.366264+0000", 2023-09-30T17:04:36.665 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:36.665 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.665 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.665 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:36.665 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.366264+0000", 2023-09-30T17:04:36.665 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.03e-07 2023-09-30T17:04:36.665 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.666 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.666 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:36.666 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.366276+0000", 2023-09-30T17:04:36.666 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1712999999999999e-05 2023-09-30T17:04:36.666 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.666 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.666 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:36.666 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.366282+0000", 2023-09-30T17:04:36.666 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3049999999999998e-06 2023-09-30T17:04:36.666 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.667 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.667 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:36.667 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.366287+0000", 2023-09-30T17:04:36.667 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7589999999999997e-06 2023-09-30T17:04:36.667 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.667 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.667 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:36.667 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.042061+0000", 2023-09-30T17:04:36.667 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67577395500000004 2023-09-30T17:04:36.667 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.667 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.668 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:36.668 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.042141+0000", 2023-09-30T17:04:36.668 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9777999999999994e-05 2023-09-30T17:04:36.668 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.668 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.668 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:36.668 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.042323+0000", 2023-09-30T17:04:36.668 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000181783 2023-09-30T17:04:36.668 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.668 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.668 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:36.669 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.072114+0000", 2023-09-30T17:04:36.669 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.029791108 2023-09-30T17:04:36.669 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.669 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.669 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:36.669 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.127224+0000", 2023-09-30T17:04:36.669 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.055110065 2023-09-30T17:04:36.669 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.669 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.669 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:36.669 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.127276+0000", 2023-09-30T17:04:36.670 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2574999999999997e-05 2023-09-30T17:04:36.670 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.670 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.670 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:36.670 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.127312+0000", 2023-09-30T17:04:36.670 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6043e-05 2023-09-30T17:04:36.670 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:36.670 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:36.670 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:36.670 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.670 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.671 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:166062 4.36 4:6fa85f86:::100000001f8.00000013:head [write 1110016~4096,write 1118208~4096,write 1155072~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:36.671 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.370231+0000", 2023-09-30T17:04:36.671 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.180751377, 2023-09-30T17:04:36.671 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75721686499999996, 2023-09-30T17:04:36.671 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:36.671 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:36.671 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:36.671 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:36.671 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:36.671 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 166062 2023-09-30T17:04:36.671 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.672 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:36.672 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.672 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:36.672 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.370231+0000", 2023-09-30T17:04:36.672 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:36.672 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.672 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.672 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:36.672 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.370231+0000", 2023-09-30T17:04:36.672 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:36.672 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.672 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.673 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:36.673 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.370232+0000", 2023-09-30T17:04:36.673 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.68e-07 2023-09-30T17:04:36.673 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.673 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.673 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:36.673 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.370247+0000", 2023-09-30T17:04:36.673 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5440000000000001e-05 2023-09-30T17:04:36.673 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.673 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.673 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:36.673 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.370262+0000", 2023-09-30T17:04:36.674 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4976e-05 2023-09-30T17:04:36.674 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.674 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.674 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:36.674 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.370268+0000", 2023-09-30T17:04:36.674 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4930000000000003e-06 2023-09-30T17:04:36.674 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.674 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.674 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:36.675 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.042052+0000", 2023-09-30T17:04:36.675 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67178386199999995 2023-09-30T17:04:36.675 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.675 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.675 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:36.675 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.042140+0000", 2023-09-30T17:04:36.675 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.7874000000000006e-05 2023-09-30T17:04:36.675 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.675 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.675 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:36.676 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.042321+0000", 2023-09-30T17:04:36.676 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00018131500000000001 2023-09-30T17:04:36.676 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.676 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.676 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:36.676 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.054880+0000", 2023-09-30T17:04:36.676 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.012558625 2023-09-30T17:04:36.676 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.676 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.676 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:36.676 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.127361+0000", 2023-09-30T17:04:36.676 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.072481183000000005 2023-09-30T17:04:36.677 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.677 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.677 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:36.677 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.127412+0000", 2023-09-30T17:04:36.677 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0861e-05 2023-09-30T17:04:36.677 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.677 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.677 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:36.677 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.127448+0000", 2023-09-30T17:04:36.677 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5667999999999998e-05 2023-09-30T17:04:36.677 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:36.677 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:36.678 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:36.678 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.678 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.678 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:166063 4.36 4:6da220e6:::100000001f8.0000003f:head [write 2469888~4096,write 2543616~4096,write 2551808~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:36.678 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.370278+0000", 2023-09-30T17:04:36.678 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.1807039399999999, 2023-09-30T17:04:36.678 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75730261499999996, 2023-09-30T17:04:36.678 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:36.678 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:36.679 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:36.679 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:36.679 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:36.679 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 166063 2023-09-30T17:04:36.679 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.679 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:36.679 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.679 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:36.679 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.370278+0000", 2023-09-30T17:04:36.679 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:36.679 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.680 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.680 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:36.680 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.370278+0000", 2023-09-30T17:04:36.680 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:36.680 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.680 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.680 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:36.680 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.374164+0000", 2023-09-30T17:04:36.680 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0038854319999999999 2023-09-30T17:04:36.680 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.680 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.681 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:36.681 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.374182+0000", 2023-09-30T17:04:36.681 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8363999999999999e-05 2023-09-30T17:04:36.681 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.681 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.681 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:36.681 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.374195+0000", 2023-09-30T17:04:36.681 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2328e-05 2023-09-30T17:04:36.681 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.681 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.681 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:36.682 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.374202+0000", 2023-09-30T17:04:36.682 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4189999999999996e-06 2023-09-30T17:04:36.682 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.682 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.682 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:36.682 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.045487+0000", 2023-09-30T17:04:36.682 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67128463800000004 2023-09-30T17:04:36.682 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.682 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.682 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:36.682 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.045558+0000", 2023-09-30T17:04:36.683 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1408999999999993e-05 2023-09-30T17:04:36.683 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.683 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.683 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:36.683 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.045711+0000", 2023-09-30T17:04:36.683 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015323299999999999 2023-09-30T17:04:36.683 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.683 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.683 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:36.683 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.072119+0000", 2023-09-30T17:04:36.683 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.026407824 2023-09-30T17:04:36.684 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.684 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.684 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:36.684 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.127486+0000", 2023-09-30T17:04:36.684 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.055366591999999999 2023-09-30T17:04:36.684 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.684 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.684 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:36.684 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.127543+0000", 2023-09-30T17:04:36.684 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7685000000000001e-05 2023-09-30T17:04:36.684 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.684 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.685 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:36.685 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.127581+0000", 2023-09-30T17:04:36.685 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7691000000000002e-05 2023-09-30T17:04:36.685 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:36.685 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:36.685 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:36.685 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.685 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.685 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:166072 4.36 4:6da220e6:::100000001f8.0000003f:head [write 1822720~4096,write 2002944~4096,write 2072576~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:36.685 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.376908+0000", 2023-09-30T17:04:36.685 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.1740739270000002, 2023-09-30T17:04:36.686 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75774445099999999, 2023-09-30T17:04:36.686 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:36.686 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:36.686 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:36.686 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:36.686 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:36.686 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 166072 2023-09-30T17:04:36.686 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.686 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:36.686 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.686 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:36.687 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.376908+0000", 2023-09-30T17:04:36.687 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:36.687 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.687 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.687 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:36.687 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.376908+0000", 2023-09-30T17:04:36.687 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:36.687 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.687 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.687 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:36.687 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.376909+0000", 2023-09-30T17:04:36.688 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3900000000000004e-07 2023-09-30T17:04:36.688 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.688 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.688 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:36.688 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.376927+0000", 2023-09-30T17:04:36.688 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7503000000000002e-05 2023-09-30T17:04:36.688 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.688 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.688 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:36.689 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.376936+0000", 2023-09-30T17:04:36.689 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1209999999999996e-06 2023-09-30T17:04:36.689 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.689 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.689 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:36.689 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.376943+0000", 2023-09-30T17:04:36.689 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0979999999999996e-06 2023-09-30T17:04:36.689 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.689 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.689 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:36.689 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.048561+0000", 2023-09-30T17:04:36.689 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67161849299999998 2023-09-30T17:04:36.690 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.690 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.690 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:36.690 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.048634+0000", 2023-09-30T17:04:36.690 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3085999999999998e-05 2023-09-30T17:04:36.690 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.690 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.690 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:36.690 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.048777+0000", 2023-09-30T17:04:36.691 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000143067 2023-09-30T17:04:36.691 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.691 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.691 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:36.691 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.072125+0000", 2023-09-30T17:04:36.691 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023347178999999999 2023-09-30T17:04:36.691 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.691 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.691 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:36.691 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.134554+0000", 2023-09-30T17:04:36.691 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.062429739999999997 2023-09-30T17:04:36.692 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.692 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.692 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:36.692 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.134605+0000", 2023-09-30T17:04:36.692 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0278000000000002e-05 2023-09-30T17:04:36.692 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.692 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.692 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:36.692 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.134653+0000", 2023-09-30T17:04:36.692 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8247000000000001e-05 2023-09-30T17:04:36.692 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:36.693 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:36.693 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:36.693 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.693 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.693 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:166086 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 1073152~4096,write 1261568~4096,write 1273856~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:36.693 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.387018+0000", 2023-09-30T17:04:36.693 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 5.1639643819999996, 2023-09-30T17:04:36.693 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75505913000000002, 2023-09-30T17:04:36.693 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:36.693 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:36.694 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:36.694 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:36.694 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:36.694 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 166086 2023-09-30T17:04:36.694 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.694 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:36.694 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.694 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:36.695 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.387018+0000", 2023-09-30T17:04:36.695 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:36.695 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.695 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.695 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:36.695 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.387018+0000", 2023-09-30T17:04:36.695 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:36.695 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.695 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.695 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:36.695 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.387018+0000", 2023-09-30T17:04:36.696 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.13e-07 2023-09-30T17:04:36.696 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.696 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.696 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:36.696 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.387033+0000", 2023-09-30T17:04:36.696 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4718999999999999e-05 2023-09-30T17:04:36.696 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.696 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.696 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:36.696 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.387041+0000", 2023-09-30T17:04:36.696 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8779999999999998e-06 2023-09-30T17:04:36.696 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.697 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.697 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:36.697 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.387047+0000", 2023-09-30T17:04:36.697 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9689999999999999e-06 2023-09-30T17:04:36.697 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.697 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.697 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:36.697 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.056572+0000", 2023-09-30T17:04:36.697 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.66952481200000002 2023-09-30T17:04:36.697 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.697 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.697 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:36.698 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.056644+0000", 2023-09-30T17:04:36.698 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1695999999999999e-05 2023-09-30T17:04:36.698 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.698 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.698 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:36.698 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.056746+0000", 2023-09-30T17:04:36.698 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000102864 2023-09-30T17:04:36.698 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.698 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.698 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:36.699 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.085374+0000", 2023-09-30T17:04:36.699 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.028627717 2023-09-30T17:04:36.699 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.699 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.699 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:36.699 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.141996+0000", 2023-09-30T17:04:36.699 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.056622290999999998 2023-09-30T17:04:36.699 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.699 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.699 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:36.699 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.142044+0000", 2023-09-30T17:04:36.699 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7939000000000003e-05 2023-09-30T17:04:36.700 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:36.700 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:36.700 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:36.700 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.142077+0000", 2023-09-30T17:04:36.700 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.2731999999999998e-05 2023-09-30T17:04:36.700 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:36.700 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:36.700 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:36.700 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:36.700 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:36.700 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:04:36.701 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-09-30T17:04:36.703 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2023-09-30T17:04:36.704 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:04:36.704 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:36.701+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:36.704 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T17:04:36.804 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:36.803+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:36.904 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:36.903+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:36.936 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:04:36.936 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2023-09-30T17:04:36.936 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.936 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:177821 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:36.937 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.276613+0000", 2023-09-30T17:04:36.937 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.63420131599999996, 2023-09-30T17:04:36.937 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.63422855600000005, 2023-09-30T17:04:36.937 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:36.937 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:36.937 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:36.937 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:36.937 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:36.937 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 177821 2023-09-30T17:04:36.937 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.937 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:36.938 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.938 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:36.938 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.276613+0000", 2023-09-30T17:04:36.938 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:36.938 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.938 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.938 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:36.938 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.276613+0000", 2023-09-30T17:04:36.938 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:36.938 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.938 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.938 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:36.939 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.276614+0000", 2023-09-30T17:04:36.939 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4000000000000002e-07 2023-09-30T17:04:36.939 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.939 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.939 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:36.939 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.276625+0000", 2023-09-30T17:04:36.939 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1379000000000001e-05 2023-09-30T17:04:36.939 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.939 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.940 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:36.940 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.276632+0000", 2023-09-30T17:04:36.940 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6309999999999997e-06 2023-09-30T17:04:36.940 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.940 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.940 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:36.940 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.276637+0000", 2023-09-30T17:04:36.940 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8389999999999997e-06 2023-09-30T17:04:36.940 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:36.940 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:36.941 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:36.941 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.941 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.941 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178116 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:36.941 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.372569+0000", 2023-09-30T17:04:36.941 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.53824545599999996, 2023-09-30T17:04:36.941 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.53833464399999997, 2023-09-30T17:04:36.941 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:36.941 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:36.941 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:36.941 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:36.942 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:36.942 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178116 2023-09-30T17:04:36.942 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.942 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:36.942 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.942 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:36.942 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.372569+0000", 2023-09-30T17:04:36.942 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:36.942 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.942 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.942 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:36.943 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.372569+0000", 2023-09-30T17:04:36.943 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:36.943 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.943 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.943 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:36.943 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.372570+0000", 2023-09-30T17:04:36.943 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0800000000000005e-07 2023-09-30T17:04:36.943 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.943 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.944 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:36.944 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.372583+0000", 2023-09-30T17:04:36.944 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3580999999999999e-05 2023-09-30T17:04:36.944 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.944 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.944 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:36.944 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.372591+0000", 2023-09-30T17:04:36.944 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9990000000000008e-06 2023-09-30T17:04:36.944 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.944 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.944 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:36.944 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.372597+0000", 2023-09-30T17:04:36.945 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6860000000000003e-06 2023-09-30T17:04:36.945 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:36.945 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:36.945 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:36.945 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.945 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.945 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178644 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:36.945 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.605598+0000", 2023-09-30T17:04:36.945 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.30521698000000003, 2023-09-30T17:04:36.945 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.30536085499999999, 2023-09-30T17:04:36.946 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:36.946 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:36.946 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:36.946 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:36.946 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:36.946 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178644 2023-09-30T17:04:36.946 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.946 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:36.946 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.946 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:36.946 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.605598+0000", 2023-09-30T17:04:36.947 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:36.947 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.947 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.947 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:36.947 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.605598+0000", 2023-09-30T17:04:36.947 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:36.947 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.947 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.947 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:36.947 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.605598+0000", 2023-09-30T17:04:36.947 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9499999999999998e-07 2023-09-30T17:04:36.948 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.948 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.948 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:36.948 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.605609+0000", 2023-09-30T17:04:36.948 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1198e-05 2023-09-30T17:04:36.948 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.948 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.948 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:36.948 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.605615+0000", 2023-09-30T17:04:36.949 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2519999999999996e-06 2023-09-30T17:04:36.949 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.949 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.949 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:36.949 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.605621+0000", 2023-09-30T17:04:36.949 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3170000000000001e-06 2023-09-30T17:04:36.949 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:36.949 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:36.949 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:36.949 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.949 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.949 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178674 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:36.950 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.616301+0000", 2023-09-30T17:04:36.950 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.294513262, 2023-09-30T17:04:36.950 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.29471263399999997, 2023-09-30T17:04:36.950 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:36.950 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:36.950 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:36.950 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:36.950 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:36.950 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178674 2023-09-30T17:04:36.950 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.950 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:36.951 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.951 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:36.951 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.616301+0000", 2023-09-30T17:04:36.951 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:36.951 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.951 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.951 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:36.951 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.616301+0000", 2023-09-30T17:04:36.951 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:36.951 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.951 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.952 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:36.952 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.616302+0000", 2023-09-30T17:04:36.952 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6000000000000004e-07 2023-09-30T17:04:36.952 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.952 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.952 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:36.952 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.616317+0000", 2023-09-30T17:04:36.952 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4778e-05 2023-09-30T17:04:36.952 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.952 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.952 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:36.953 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.616324+0000", 2023-09-30T17:04:36.953 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7389999999999999e-06 2023-09-30T17:04:36.953 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.953 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.953 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:36.953 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.616330+0000", 2023-09-30T17:04:36.953 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5199999999999997e-06 2023-09-30T17:04:36.953 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:36.953 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:36.953 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:36.953 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.953 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.954 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179187 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:36.954 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.790567+0000", 2023-09-30T17:04:36.954 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.120247195, 2023-09-30T17:04:36.954 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.12050021499999999, 2023-09-30T17:04:36.954 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:36.954 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:36.954 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:36.954 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:36.954 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:36.954 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179187 2023-09-30T17:04:36.954 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.955 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:36.955 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.955 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:36.955 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.790567+0000", 2023-09-30T17:04:36.955 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:36.955 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.955 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.955 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:36.955 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.790567+0000", 2023-09-30T17:04:36.955 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:36.955 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.956 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.956 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:36.956 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.790568+0000", 2023-09-30T17:04:36.956 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4199999999999995e-07 2023-09-30T17:04:36.956 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.956 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.956 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:36.956 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.790582+0000", 2023-09-30T17:04:36.956 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4447000000000001e-05 2023-09-30T17:04:36.956 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.957 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.957 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:36.957 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.790591+0000", 2023-09-30T17:04:36.957 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4689999999999997e-06 2023-09-30T17:04:36.957 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.957 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.957 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:36.957 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.790597+0000", 2023-09-30T17:04:36.957 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1240000000000002e-06 2023-09-30T17:04:36.957 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:36.957 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:36.958 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:36.958 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.958 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.958 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179356 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:36.958 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.857578+0000", 2023-09-30T17:04:36.958 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.053236609999999997, 2023-09-30T17:04:36.958 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.053545189999999999, 2023-09-30T17:04:36.958 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:36.958 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:36.958 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:36.958 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:36.959 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:36.959 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179356 2023-09-30T17:04:36.959 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.959 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:36.959 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.959 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:36.959 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.857578+0000", 2023-09-30T17:04:36.959 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:36.959 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.959 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.959 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:36.959 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.857578+0000", 2023-09-30T17:04:36.959 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:36.960 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.960 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.960 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:36.960 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.857578+0000", 2023-09-30T17:04:36.960 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9100000000000004e-07 2023-09-30T17:04:36.960 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.960 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.960 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:36.960 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.857600+0000", 2023-09-30T17:04:36.960 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.154e-05 2023-09-30T17:04:36.960 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.961 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.961 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:36.961 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.857607+0000", 2023-09-30T17:04:36.961 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.579e-06 2023-09-30T17:04:36.961 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.961 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.961 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:36.961 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.857612+0000", 2023-09-30T17:04:36.961 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3890000000000004e-06 2023-09-30T17:04:36.961 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:36.961 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:36.961 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:36.962 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.962 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.963 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179415 4.35 4:af28909f:::100000001f8.0000001b:head [write 3022848~4096 in=4096b,write 3039232~4096 in=4096b,write 3190784~4096 in=4096b,write 3297280~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:36.963 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.893318+0000", 2023-09-30T17:04:36.963 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.017496214, 2023-09-30T17:04:36.963 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017876761000000001, 2023-09-30T17:04:36.963 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:36.963 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:36.963 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:36.963 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:36.963 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:36.963 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179415 2023-09-30T17:04:36.963 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.963 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:36.964 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.964 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:36.964 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.893318+0000", 2023-09-30T17:04:36.964 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:36.964 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.964 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.964 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:36.964 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.893318+0000", 2023-09-30T17:04:36.964 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:36.964 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.964 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.965 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:36.965 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.893319+0000", 2023-09-30T17:04:36.965 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.89e-07 2023-09-30T17:04:36.965 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.965 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.965 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:36.965 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.893333+0000", 2023-09-30T17:04:36.965 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4409e-05 2023-09-30T17:04:36.965 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.965 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.965 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:36.965 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.893340+0000", 2023-09-30T17:04:36.966 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7510000000000002e-06 2023-09-30T17:04:36.966 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.966 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.966 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:36.966 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.893345+0000", 2023-09-30T17:04:36.966 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2900000000000002e-06 2023-09-30T17:04:36.966 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.966 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.966 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:36.966 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.905024+0000", 2023-09-30T17:04:36.966 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011679192 2023-09-30T17:04:36.966 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.967 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.967 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:36.967 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.905107+0000", 2023-09-30T17:04:36.967 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2397000000000004e-05 2023-09-30T17:04:36.967 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:36.967 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:36.967 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:36.967 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.967 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.967 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:177887 4.36 e58/17)", 2023-09-30T17:04:36.967 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.910163+0000", 2023-09-30T17:04:36.968 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.00065174099999999995, 2023-09-30T17:04:36.968 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001097078, 2023-09-30T17:04:36.968 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:36.968 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:36.968 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:36.968 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.968 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:36.968 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.910163+0000", 2023-09-30T17:04:36.968 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:36.968 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.968 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.968 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:36.968 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.910163+0000", 2023-09-30T17:04:36.969 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:36.969 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.969 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.969 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:36.969 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.910164+0000", 2023-09-30T17:04:36.969 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9999999999999996e-07 2023-09-30T17:04:36.969 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.969 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.969 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:36.969 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.910183+0000", 2023-09-30T17:04:36.969 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8774e-05 2023-09-30T17:04:36.969 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.970 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.970 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:36.970 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.910196+0000", 2023-09-30T17:04:36.970 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3407000000000001e-05 2023-09-30T17:04:36.970 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.970 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.970 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:36.970 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.910203+0000", 2023-09-30T17:04:36.970 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1010000000000003e-06 2023-09-30T17:04:36.970 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:36.970 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:36.970 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:36.971 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.971 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.971 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:177615 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:36.971 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.221569+0000", 2023-09-30T17:04:36.971 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.68924605800000005, 2023-09-30T17:04:36.971 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.68973974500000002, 2023-09-30T17:04:36.973 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:36.973 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:36.973 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:36.973 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:36.974 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:36.974 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 177615 2023-09-30T17:04:36.974 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.974 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:36.974 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.974 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:36.974 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.221569+0000", 2023-09-30T17:04:36.974 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:36.974 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.974 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.974 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:36.975 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.221569+0000", 2023-09-30T17:04:36.975 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:36.975 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.975 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.975 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:36.975 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.221569+0000", 2023-09-30T17:04:36.975 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6899999999999997e-07 2023-09-30T17:04:36.975 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.975 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.975 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:36.976 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.221587+0000", 2023-09-30T17:04:36.976 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8329e-05 2023-09-30T17:04:36.976 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.976 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.976 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:36.976 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.221595+0000", 2023-09-30T17:04:36.976 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4259999999999997e-06 2023-09-30T17:04:36.976 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.976 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.976 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:36.976 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.221601+0000", 2023-09-30T17:04:36.976 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9089999999999997e-06 2023-09-30T17:04:36.977 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:36.977 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:36.977 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:36.977 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.977 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.977 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178118 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:36.977 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.372605+0000", 2023-09-30T17:04:36.977 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.538209355, 2023-09-30T17:04:36.977 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.53876104899999999, 2023-09-30T17:04:36.977 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:36.977 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:36.977 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:36.978 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:36.978 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:36.978 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178118 2023-09-30T17:04:36.978 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.979 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:36.979 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.979 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:36.979 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.372605+0000", 2023-09-30T17:04:36.979 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:36.979 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.979 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.979 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:36.979 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.372605+0000", 2023-09-30T17:04:36.979 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:36.979 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.980 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.980 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:36.980 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.372606+0000", 2023-09-30T17:04:36.980 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8700000000000001e-07 2023-09-30T17:04:36.980 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.980 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.980 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:36.980 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.372616+0000", 2023-09-30T17:04:36.980 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0166999999999999e-05 2023-09-30T17:04:36.980 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.980 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.980 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:36.981 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.372623+0000", 2023-09-30T17:04:36.981 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.294e-06 2023-09-30T17:04:36.981 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.981 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.981 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:36.981 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.372629+0000", 2023-09-30T17:04:36.981 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1449999999999996e-06 2023-09-30T17:04:36.981 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:36.981 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:36.981 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:36.981 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.982 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.982 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178141 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:36.982 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.387669+0000", 2023-09-30T17:04:36.982 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.52314592500000001, 2023-09-30T17:04:36.982 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.52375481000000002, 2023-09-30T17:04:36.982 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:36.982 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:36.982 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:36.982 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:36.982 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:36.982 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178141 2023-09-30T17:04:36.983 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.983 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:36.983 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.983 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:36.983 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.387669+0000", 2023-09-30T17:04:36.983 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:36.983 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.983 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.983 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:36.983 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.387669+0000", 2023-09-30T17:04:36.983 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:36.984 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.984 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.984 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:36.984 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.387669+0000", 2023-09-30T17:04:36.984 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4700000000000002e-07 2023-09-30T17:04:36.984 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.984 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.984 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:36.984 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.387686+0000", 2023-09-30T17:04:36.984 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7214000000000002e-05 2023-09-30T17:04:36.984 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.984 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.985 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:36.985 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.387693+0000", 2023-09-30T17:04:36.985 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5969999999999997e-06 2023-09-30T17:04:36.985 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.985 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.985 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:36.985 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.387698+0000", 2023-09-30T17:04:36.985 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9169999999999997e-06 2023-09-30T17:04:36.985 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:36.985 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:36.985 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:36.985 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.986 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.986 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178234 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:36.986 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.433735+0000", 2023-09-30T17:04:36.986 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.47707949199999999, 2023-09-30T17:04:36.986 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.47774602999999999, 2023-09-30T17:04:36.986 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:36.986 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:36.986 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:36.986 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:36.986 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:36.986 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178234 2023-09-30T17:04:36.987 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.987 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:36.987 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.987 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:36.987 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.433735+0000", 2023-09-30T17:04:36.987 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:36.987 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.987 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.987 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:36.987 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.433735+0000", 2023-09-30T17:04:36.987 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:36.987 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.988 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:36.988 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.433736+0000", 2023-09-30T17:04:36.988 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7399999999999998e-07 2023-09-30T17:04:36.988 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.988 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:36.988 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.433748+0000", 2023-09-30T17:04:36.988 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2259000000000001e-05 2023-09-30T17:04:36.988 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.989 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:36.989 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.433755+0000", 2023-09-30T17:04:36.989 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5190000000000003e-06 2023-09-30T17:04:36.989 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.989 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.989 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:36.989 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.433761+0000", 2023-09-30T17:04:36.989 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2580000000000003e-06 2023-09-30T17:04:36.989 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:36.989 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:36.989 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:36.989 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.990 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.990 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178548 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:36.990 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.564401+0000", 2023-09-30T17:04:36.990 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.34641376800000001, 2023-09-30T17:04:36.990 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.34714136400000001, 2023-09-30T17:04:36.990 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:36.990 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:36.990 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:36.990 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:36.990 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:36.990 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178548 2023-09-30T17:04:36.991 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.991 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:36.991 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.991 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:36.991 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.564401+0000", 2023-09-30T17:04:36.991 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:36.991 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.991 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.991 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:36.991 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.564401+0000", 2023-09-30T17:04:36.991 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:36.992 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:36.992 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.564401+0000", 2023-09-30T17:04:36.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1200000000000003e-07 2023-09-30T17:04:36.992 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:36.992 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.564424+0000", 2023-09-30T17:04:36.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2787000000000001e-05 2023-09-30T17:04:36.992 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.993 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:36.993 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.564431+0000", 2023-09-30T17:04:36.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9430000000000003e-06 2023-09-30T17:04:36.993 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.993 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.993 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:36.993 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.564436+0000", 2023-09-30T17:04:36.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2410000000000003e-06 2023-09-30T17:04:36.993 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:36.993 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:36.994 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:36.994 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.994 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.994 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178647 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:36.994 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.605628+0000", 2023-09-30T17:04:36.994 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.30518673499999999, 2023-09-30T17:04:36.994 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.30597549099999999, 2023-09-30T17:04:36.994 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:36.994 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:36.994 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:36.994 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:36.994 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:36.995 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178647 2023-09-30T17:04:36.995 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.995 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:36.995 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.995 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:36.995 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.605628+0000", 2023-09-30T17:04:36.995 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:36.995 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.995 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.995 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:36.995 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.605628+0000", 2023-09-30T17:04:36.996 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:36.996 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.996 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:36.996 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.605628+0000", 2023-09-30T17:04:36.996 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.63e-07 2023-09-30T17:04:36.996 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.996 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:36.996 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.605641+0000", 2023-09-30T17:04:36.996 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2561000000000001e-05 2023-09-30T17:04:36.996 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.997 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:36.997 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.605647+0000", 2023-09-30T17:04:36.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8409999999999996e-06 2023-09-30T17:04:36.997 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.997 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:36.997 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.605652+0000", 2023-09-30T17:04:36.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1189999999999996e-06 2023-09-30T17:04:36.997 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:36.998 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:36.998 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:36.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.998 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178682 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:36.998 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.616338+0000", 2023-09-30T17:04:36.998 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.29447705600000001, 2023-09-30T17:04:36.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.29532767900000001, 2023-09-30T17:04:36.998 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:36.998 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:36.998 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:36.999 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:36.999 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:36.999 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178682 2023-09-30T17:04:36.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.999 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:36.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.999 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:36.999 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.616338+0000", 2023-09-30T17:04:36.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:36.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:36.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:36.999 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.000 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.616338+0000", 2023-09-30T17:04:37.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.000 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.000 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.616338+0000", 2023-09-30T17:04:37.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9999999999999998e-07 2023-09-30T17:04:37.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.000 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.000 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.616350+0000", 2023-09-30T17:04:37.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1640999999999999e-05 2023-09-30T17:04:37.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.001 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.001 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.616356+0000", 2023-09-30T17:04:37.001 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3790000000000003e-06 2023-09-30T17:04:37.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.001 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.001 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.616361+0000", 2023-09-30T17:04:37.001 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4149999999999998e-06 2023-09-30T17:04:37.001 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.001 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.002 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.002 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.002 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179162 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.002 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.776663+0000", 2023-09-30T17:04:37.002 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.13415153099999999, 2023-09-30T17:04:37.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.13506256899999999, 2023-09-30T17:04:37.002 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.002 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.002 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.002 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.002 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.003 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179162 2023-09-30T17:04:37.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.003 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.003 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.003 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.003 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.776663+0000", 2023-09-30T17:04:37.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.003 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.003 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.003 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.776663+0000", 2023-09-30T17:04:37.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.778516+0000", 2023-09-30T17:04:37.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0018530269999999999 2023-09-30T17:04:37.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.778531+0000", 2023-09-30T17:04:37.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5126999999999999e-05 2023-09-30T17:04:37.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.005 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.005 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.778544+0000", 2023-09-30T17:04:37.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2583e-05 2023-09-30T17:04:37.005 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.005 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.005 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.778551+0000", 2023-09-30T17:04:37.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5800000000000003e-06 2023-09-30T17:04:37.005 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.005 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.005 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.006 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.006 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179274 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.006 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.818572+0000", 2023-09-30T17:04:37.006 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.092242419000000006, 2023-09-30T17:04:37.006 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.093223447000000001, 2023-09-30T17:04:37.006 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.006 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.006 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.006 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.006 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.006 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179274 2023-09-30T17:04:37.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.007 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.007 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.818572+0000", 2023-09-30T17:04:37.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.007 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.818572+0000", 2023-09-30T17:04:37.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.008 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.008 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.818573+0000", 2023-09-30T17:04:37.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1399999999999997e-07 2023-09-30T17:04:37.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.008 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.008 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.818596+0000", 2023-09-30T17:04:37.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2804999999999999e-05 2023-09-30T17:04:37.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.009 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.009 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.818604+0000", 2023-09-30T17:04:37.009 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1580000000000005e-06 2023-09-30T17:04:37.009 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.009 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.009 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.818610+0000", 2023-09-30T17:04:37.009 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0249999999999999e-06 2023-09-30T17:04:37.009 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.009 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.009 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.009 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.010 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:177705 4.6 e58/17 4:635f8cb4:::100000001f8.0000003c:head v 58'10961, mlcod=58'10950)", 2023-09-30T17:04:37.010 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.831797+0000", 2023-09-30T17:04:37.010 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.079017724999999997, 2023-09-30T17:04:37.010 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.080058026000000004, 2023-09-30T17:04:37.010 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.010 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:37.010 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.010 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.010 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.831797+0000", 2023-09-30T17:04:37.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.831797+0000", 2023-09-30T17:04:37.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.831797+0000", 2023-09-30T17:04:37.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2699999999999999e-07 2023-09-30T17:04:37.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.831812+0000", 2023-09-30T17:04:37.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4184e-05 2023-09-30T17:04:37.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.831821+0000", 2023-09-30T17:04:37.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0270000000000001e-06 2023-09-30T17:04:37.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.013 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.013 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.831826+0000", 2023-09-30T17:04:37.013 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5280000000000003e-06 2023-09-30T17:04:37.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.013 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:37.013 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.892633+0000", 2023-09-30T17:04:37.013 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.060806764999999999 2023-09-30T17:04:37.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.013 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:37.013 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.892650+0000", 2023-09-30T17:04:37.014 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7238999999999999e-05 2023-09-30T17:04:37.014 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.014 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.014 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.014 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.014 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.014 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179336 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.014 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.846585+0000", 2023-09-30T17:04:37.014 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.064229599999999998, 2023-09-30T17:04:37.014 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.065324144000000001, 2023-09-30T17:04:37.014 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.014 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.015 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.015 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.015 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.015 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179336 2023-09-30T17:04:37.015 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.015 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.015 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.846585+0000", 2023-09-30T17:04:37.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.015 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.846585+0000", 2023-09-30T17:04:37.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.846585+0000", 2023-09-30T17:04:37.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5699999999999999e-07 2023-09-30T17:04:37.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.846595+0000", 2023-09-30T17:04:37.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8500000000000006e-06 2023-09-30T17:04:37.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.846601+0000", 2023-09-30T17:04:37.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0299999999999999e-06 2023-09-30T17:04:37.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.846604+0000", 2023-09-30T17:04:37.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.315e-06 2023-09-30T17:04:37.018 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.018 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.018 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.018 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:177762 4.6 e58/17)", 2023-09-30T17:04:37.018 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.857637+0000", 2023-09-30T17:04:37.018 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.053177291000000002, 2023-09-30T17:04:37.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.054301795, 2023-09-30T17:04:37.018 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.018 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.019 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.019 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.019 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.857637+0000", 2023-09-30T17:04:37.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.019 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.019 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.857637+0000", 2023-09-30T17:04:37.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.857638+0000", 2023-09-30T17:04:37.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0699999999999997e-07 2023-09-30T17:04:37.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.857651+0000", 2023-09-30T17:04:37.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3570999999999999e-05 2023-09-30T17:04:37.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.857665+0000", 2023-09-30T17:04:37.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3893999999999999e-05 2023-09-30T17:04:37.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.021 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.021 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.857672+0000", 2023-09-30T17:04:37.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5939999999999999e-06 2023-09-30T17:04:37.021 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.021 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.021 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.021 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:177832 4.2e e58/17)", 2023-09-30T17:04:37.022 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.893478+0000", 2023-09-30T17:04:37.022 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.017336698000000001, 2023-09-30T17:04:37.022 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018486691999999999, 2023-09-30T17:04:37.022 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.022 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.022 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.022 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.022 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.022 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.893478+0000", 2023-09-30T17:04:37.022 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.022 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.022 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.023 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.023 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.893478+0000", 2023-09-30T17:04:37.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.023 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.023 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.023 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.023 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.893479+0000", 2023-09-30T17:04:37.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7599999999999996e-07 2023-09-30T17:04:37.023 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.023 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.023 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.023 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.893498+0000", 2023-09-30T17:04:37.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9239999999999999e-05 2023-09-30T17:04:37.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.024 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.024 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.893507+0000", 2023-09-30T17:04:37.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9290000000000004e-06 2023-09-30T17:04:37.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.024 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.024 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.893518+0000", 2023-09-30T17:04:37.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1464000000000001e-05 2023-09-30T17:04:37.025 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.025 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.025 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.025 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.025 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.025 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:177880 4.6 e58/17)", 2023-09-30T17:04:37.025 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.910224+0000", 2023-09-30T17:04:37.025 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.00059039300000000004, 2023-09-30T17:04:37.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0017658000000000001, 2023-09-30T17:04:37.025 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.025 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.025 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.026 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.026 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.910224+0000", 2023-09-30T17:04:37.026 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.026 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.026 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.026 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.910224+0000", 2023-09-30T17:04:37.026 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.026 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.026 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.027 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.910225+0000", 2023-09-30T17:04:37.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2399999999999999e-07 2023-09-30T17:04:37.027 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.027 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.027 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.910242+0000", 2023-09-30T17:04:37.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7169000000000001e-05 2023-09-30T17:04:37.027 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.027 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.027 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.910248+0000", 2023-09-30T17:04:37.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.37e-06 2023-09-30T17:04:37.028 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.028 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.028 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.028 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.910253+0000", 2023-09-30T17:04:37.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.481e-06 2023-09-30T17:04:37.028 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.028 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.028 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.028 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.028 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.028 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:177900 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.029 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.298879+0000", 2023-09-30T17:04:37.029 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.61193599099999996, 2023-09-30T17:04:37.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.61313962799999999, 2023-09-30T17:04:37.029 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.029 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.029 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.029 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.029 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.029 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 177900 2023-09-30T17:04:37.029 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.029 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.030 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.030 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.298879+0000", 2023-09-30T17:04:37.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.030 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.030 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.298879+0000", 2023-09-30T17:04:37.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.030 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.298879+0000", 2023-09-30T17:04:37.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2399999999999999e-07 2023-09-30T17:04:37.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.298890+0000", 2023-09-30T17:04:37.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0793e-05 2023-09-30T17:04:37.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.298895+0000", 2023-09-30T17:04:37.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6529999999999999e-06 2023-09-30T17:04:37.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.032 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.032 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.298900+0000", 2023-09-30T17:04:37.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.527e-06 2023-09-30T17:04:37.032 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.032 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.032 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.032 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:177928 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.032 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.315584+0000", 2023-09-30T17:04:37.033 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.59523019799999999, 2023-09-30T17:04:37.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.59647127899999997, 2023-09-30T17:04:37.033 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.033 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.033 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.033 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.033 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.033 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 177928 2023-09-30T17:04:37.033 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.033 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.033 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.033 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.034 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.315584+0000", 2023-09-30T17:04:37.034 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.034 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.034 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.034 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.315584+0000", 2023-09-30T17:04:37.034 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.034 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.034 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.034 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.315585+0000", 2023-09-30T17:04:37.034 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3099999999999998e-07 2023-09-30T17:04:37.035 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.035 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.035 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.035 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.315604+0000", 2023-09-30T17:04:37.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9043e-05 2023-09-30T17:04:37.035 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.035 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.035 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.035 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.315612+0000", 2023-09-30T17:04:37.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3850000000000002e-06 2023-09-30T17:04:37.035 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.035 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.036 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.315618+0000", 2023-09-30T17:04:37.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3750000000000002e-06 2023-09-30T17:04:37.036 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.036 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.036 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.036 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178075 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.036 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.360716+0000", 2023-09-30T17:04:37.036 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.55009874000000003, 2023-09-30T17:04:37.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.55137212499999999, 2023-09-30T17:04:37.037 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.037 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.037 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.037 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.037 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.037 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178075 2023-09-30T17:04:37.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.037 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.037 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.360716+0000", 2023-09-30T17:04:37.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.038 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.038 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.360716+0000", 2023-09-30T17:04:37.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.038 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.038 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.360716+0000", 2023-09-30T17:04:37.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4999999999999998e-07 2023-09-30T17:04:37.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.039 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.039 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.360735+0000", 2023-09-30T17:04:37.039 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8287e-05 2023-09-30T17:04:37.039 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.039 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.039 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.360741+0000", 2023-09-30T17:04:37.039 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0290000000000002e-06 2023-09-30T17:04:37.039 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.039 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.040 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.360747+0000", 2023-09-30T17:04:37.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2020000000000001e-06 2023-09-30T17:04:37.040 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.040 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.040 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.040 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.040 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.040 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178235 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.040 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.433768+0000", 2023-09-30T17:04:37.040 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.47704695000000003, 2023-09-30T17:04:37.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.47835011599999999, 2023-09-30T17:04:37.040 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.041 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.041 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.041 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.041 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.041 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178235 2023-09-30T17:04:37.041 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.041 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.041 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.041 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.041 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.433768+0000", 2023-09-30T17:04:37.041 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.041 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.042 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.042 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.042 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.433768+0000", 2023-09-30T17:04:37.042 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.042 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.042 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.042 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.042 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.435516+0000", 2023-09-30T17:04:37.042 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0017488549999999999 2023-09-30T17:04:37.042 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.042 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.042 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.043 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.435535+0000", 2023-09-30T17:04:37.043 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8529000000000002e-05 2023-09-30T17:04:37.043 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.043 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.043 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.043 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.435546+0000", 2023-09-30T17:04:37.043 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1348999999999999e-05 2023-09-30T17:04:37.043 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.043 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.043 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.043 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.435554+0000", 2023-09-30T17:04:37.043 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8189999999999992e-06 2023-09-30T17:04:37.044 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.044 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.044 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.044 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.044 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.044 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178440 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.044 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.522647+0000", 2023-09-30T17:04:37.044 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.38816751599999999, 2023-09-30T17:04:37.044 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.38950078599999999, 2023-09-30T17:04:37.044 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.044 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.045 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.045 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.045 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.045 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178440 2023-09-30T17:04:37.045 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.045 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.045 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.045 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.045 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.522647+0000", 2023-09-30T17:04:37.045 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.045 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.045 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.046 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.046 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.522647+0000", 2023-09-30T17:04:37.046 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.046 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.046 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.046 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.046 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.522647+0000", 2023-09-30T17:04:37.046 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9299999999999999e-07 2023-09-30T17:04:37.046 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.046 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.046 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.046 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.522662+0000", 2023-09-30T17:04:37.047 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4745e-05 2023-09-30T17:04:37.047 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.047 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.047 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.047 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.522669+0000", 2023-09-30T17:04:37.047 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5699999999999998e-06 2023-09-30T17:04:37.047 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.047 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.048 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.048 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.522674+0000", 2023-09-30T17:04:37.048 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7530000000000001e-06 2023-09-30T17:04:37.048 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.048 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.048 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.048 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.049 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.049 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178471 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.049 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.532679+0000", 2023-09-30T17:04:37.049 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.378135842, 2023-09-30T17:04:37.049 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.379498793, 2023-09-30T17:04:37.049 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.049 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.049 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.049 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.049 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.049 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178471 2023-09-30T17:04:37.049 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.050 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.050 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.050 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.050 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.532679+0000", 2023-09-30T17:04:37.050 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.050 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.050 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.050 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.050 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.532679+0000", 2023-09-30T17:04:37.050 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.050 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.050 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.051 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.051 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.535677+0000", 2023-09-30T17:04:37.051 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002998246 2023-09-30T17:04:37.051 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.051 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.051 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.051 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.535691+0000", 2023-09-30T17:04:37.051 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4008999999999999e-05 2023-09-30T17:04:37.051 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.051 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.051 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.051 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.535698+0000", 2023-09-30T17:04:37.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.379e-06 2023-09-30T17:04:37.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.052 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.052 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.535705+0000", 2023-09-30T17:04:37.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0990000000000001e-06 2023-09-30T17:04:37.052 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.052 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.052 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.052 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178683 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.053 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.616369+0000", 2023-09-30T17:04:37.053 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.29444604299999999, 2023-09-30T17:04:37.053 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.29583862300000002, 2023-09-30T17:04:37.053 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.053 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.053 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.053 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.053 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.053 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178683 2023-09-30T17:04:37.053 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.053 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.053 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.054 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.054 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.616369+0000", 2023-09-30T17:04:37.054 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.054 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.054 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.054 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.054 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.616369+0000", 2023-09-30T17:04:37.054 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.054 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.054 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.054 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.054 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.616369+0000", 2023-09-30T17:04:37.055 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.06e-07 2023-09-30T17:04:37.055 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.055 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.055 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.055 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.616385+0000", 2023-09-30T17:04:37.055 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5614e-05 2023-09-30T17:04:37.055 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.055 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.055 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.055 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.616391+0000", 2023-09-30T17:04:37.055 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5420000000000002e-06 2023-09-30T17:04:37.055 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.056 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.056 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.056 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.616397+0000", 2023-09-30T17:04:37.056 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4079999999999997e-06 2023-09-30T17:04:37.056 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.056 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.056 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.056 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.056 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.056 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179163 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.056 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.778564+0000", 2023-09-30T17:04:37.056 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.132250433, 2023-09-30T17:04:37.057 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.133672442, 2023-09-30T17:04:37.057 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.057 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.057 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.057 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.057 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.057 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179163 2023-09-30T17:04:37.057 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.057 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.057 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.057 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.057 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.778564+0000", 2023-09-30T17:04:37.058 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.058 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.058 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.058 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.058 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.778564+0000", 2023-09-30T17:04:37.058 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.058 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.058 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.058 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.058 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.778565+0000", 2023-09-30T17:04:37.058 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1099999999999996e-07 2023-09-30T17:04:37.058 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.059 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.059 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.059 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.778579+0000", 2023-09-30T17:04:37.059 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4545000000000001e-05 2023-09-30T17:04:37.059 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.059 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.059 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.059 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.778588+0000", 2023-09-30T17:04:37.059 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4500000000000004e-06 2023-09-30T17:04:37.059 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.059 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.059 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.060 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.778593+0000", 2023-09-30T17:04:37.060 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0579999999999997e-06 2023-09-30T17:04:37.060 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.060 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.060 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.060 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.060 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.060 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179223 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.060 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.804730+0000", 2023-09-30T17:04:37.060 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.106084761, 2023-09-30T17:04:37.060 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.107536452, 2023-09-30T17:04:37.060 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.061 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.061 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.061 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.061 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.061 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179223 2023-09-30T17:04:37.061 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.061 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.061 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.061 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.061 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.804730+0000", 2023-09-30T17:04:37.061 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.061 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.062 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.062 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.062 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.804730+0000", 2023-09-30T17:04:37.062 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.062 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.062 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.062 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.062 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.804730+0000", 2023-09-30T17:04:37.062 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4099999999999999e-07 2023-09-30T17:04:37.062 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.063 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.063 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.063 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.804750+0000", 2023-09-30T17:04:37.063 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9551999999999998e-05 2023-09-30T17:04:37.063 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.063 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.063 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.063 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.804756+0000", 2023-09-30T17:04:37.063 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0769999999999996e-06 2023-09-30T17:04:37.063 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.063 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.063 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.063 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.804760+0000", 2023-09-30T17:04:37.064 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6009999999999997e-06 2023-09-30T17:04:37.064 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.064 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.064 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.064 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.064 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.064 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179275 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.064 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.818619+0000", 2023-09-30T17:04:37.064 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.092195497000000001, 2023-09-30T17:04:37.064 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.093683145999999995, 2023-09-30T17:04:37.064 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.065 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.065 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.065 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.065 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.065 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179275 2023-09-30T17:04:37.065 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.065 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.065 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.065 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.065 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.818619+0000", 2023-09-30T17:04:37.065 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.065 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.065 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.066 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.066 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.818619+0000", 2023-09-30T17:04:37.066 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.066 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.066 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.066 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.066 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.818620+0000", 2023-09-30T17:04:37.066 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6100000000000001e-07 2023-09-30T17:04:37.066 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.066 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.066 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.066 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.818637+0000", 2023-09-30T17:04:37.067 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7206000000000001e-05 2023-09-30T17:04:37.067 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.067 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.067 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.067 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.818643+0000", 2023-09-30T17:04:37.067 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.703e-06 2023-09-30T17:04:37.067 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.067 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.067 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.067 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.818648+0000", 2023-09-30T17:04:37.067 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9459999999999997e-06 2023-09-30T17:04:37.067 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.068 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.068 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.068 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.068 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.068 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179340 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.068 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.846610+0000", 2023-09-30T17:04:37.068 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.064204611999999994, 2023-09-30T17:04:37.068 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.065722378999999997, 2023-09-30T17:04:37.068 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.068 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.068 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.068 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.069 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.069 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179340 2023-09-30T17:04:37.069 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.069 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.069 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.069 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.069 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.846610+0000", 2023-09-30T17:04:37.069 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.069 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.069 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.069 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.069 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.846610+0000", 2023-09-30T17:04:37.070 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.070 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.070 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.070 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.070 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.846610+0000", 2023-09-30T17:04:37.070 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3999999999999998e-07 2023-09-30T17:04:37.070 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.070 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.070 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.070 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.846622+0000", 2023-09-30T17:04:37.070 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1939999999999999e-05 2023-09-30T17:04:37.070 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.071 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.071 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.071 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.846626+0000", 2023-09-30T17:04:37.071 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8089999999999999e-06 2023-09-30T17:04:37.071 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.071 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.071 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.071 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.846629+0000", 2023-09-30T17:04:37.071 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2009999999999999e-06 2023-09-30T17:04:37.071 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.071 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.071 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.072 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.072 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.072 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:177774 4.36 e58/17)", 2023-09-30T17:04:37.072 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.857685+0000", 2023-09-30T17:04:37.072 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.053129661000000002, 2023-09-30T17:04:37.072 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.054676831000000002, 2023-09-30T17:04:37.072 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.072 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.072 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.072 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.072 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.072 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.857685+0000", 2023-09-30T17:04:37.073 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.073 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.073 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.073 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.073 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.857685+0000", 2023-09-30T17:04:37.073 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.073 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.073 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.073 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.073 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.857685+0000", 2023-09-30T17:04:37.073 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8599999999999999e-07 2023-09-30T17:04:37.073 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.074 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.074 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.074 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.857695+0000", 2023-09-30T17:04:37.074 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8239999999999995e-06 2023-09-30T17:04:37.074 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.074 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.074 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.074 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.857702+0000", 2023-09-30T17:04:37.074 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1149999999999996e-06 2023-09-30T17:04:37.074 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.074 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.074 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.075 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.857706+0000", 2023-09-30T17:04:37.075 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3499999999999999e-06 2023-09-30T17:04:37.075 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.075 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.075 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.075 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.075 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.075 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:177829 4.6 e58/17)", 2023-09-30T17:04:37.075 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.893539+0000", 2023-09-30T17:04:37.075 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.017275604, 2023-09-30T17:04:37.075 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018848328000000001, 2023-09-30T17:04:37.076 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.076 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.076 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.076 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.076 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.076 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.893539+0000", 2023-09-30T17:04:37.076 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.076 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.076 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.076 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.076 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.893539+0000", 2023-09-30T17:04:37.076 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.077 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.077 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.077 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.077 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.893539+0000", 2023-09-30T17:04:37.077 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.77e-07 2023-09-30T17:04:37.077 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.077 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.077 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.077 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.893554+0000", 2023-09-30T17:04:37.077 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4584e-05 2023-09-30T17:04:37.077 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.077 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.078 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.078 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.893562+0000", 2023-09-30T17:04:37.078 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6389999999999992e-06 2023-09-30T17:04:37.078 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.078 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.078 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.078 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.893567+0000", 2023-09-30T17:04:37.078 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6339999999999998e-06 2023-09-30T17:04:37.078 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.079 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.079 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.079 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.079 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.079 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:179229 4.3f e58/17)", 2023-09-30T17:04:37.079 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.910259+0000", 2023-09-30T17:04:37.079 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.00055577800000000004, 2023-09-30T17:04:37.079 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0021597880000000002, 2023-09-30T17:04:37.079 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.079 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.079 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.080 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.080 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.080 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.910259+0000", 2023-09-30T17:04:37.080 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.080 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.080 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.080 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.080 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.910259+0000", 2023-09-30T17:04:37.080 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.080 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.080 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.080 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.081 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.910259+0000", 2023-09-30T17:04:37.081 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1e-07 2023-09-30T17:04:37.081 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.081 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.081 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.081 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.910269+0000", 2023-09-30T17:04:37.081 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9289999999999993e-06 2023-09-30T17:04:37.081 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.081 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.081 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.081 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.910274+0000", 2023-09-30T17:04:37.081 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1769999999999997e-06 2023-09-30T17:04:37.082 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.082 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.082 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.082 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.910278+0000", 2023-09-30T17:04:37.082 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7780000000000001e-06 2023-09-30T17:04:37.082 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.082 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.082 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.082 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.082 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.082 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:177648 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.083 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.233547+0000", 2023-09-30T17:04:37.083 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.677267748, 2023-09-30T17:04:37.083 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.67889875099999997, 2023-09-30T17:04:37.083 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.083 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.083 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.083 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.083 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.083 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 177648 2023-09-30T17:04:37.083 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.083 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.083 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.084 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.084 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.233547+0000", 2023-09-30T17:04:37.084 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.084 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.084 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.084 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.084 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.233547+0000", 2023-09-30T17:04:37.084 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.084 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.084 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.084 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.084 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.235549+0000", 2023-09-30T17:04:37.085 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0020017009999999998 2023-09-30T17:04:37.085 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.085 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.085 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.085 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.235570+0000", 2023-09-30T17:04:37.085 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1583999999999999e-05 2023-09-30T17:04:37.085 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.085 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.085 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.085 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.235581+0000", 2023-09-30T17:04:37.085 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0479000000000001e-05 2023-09-30T17:04:37.085 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.086 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.086 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.086 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.235590+0000", 2023-09-30T17:04:37.086 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9150000000000002e-06 2023-09-30T17:04:37.086 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.086 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.086 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.086 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.086 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.086 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:177715 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.086 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.256600+0000", 2023-09-30T17:04:37.087 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.65421411699999998, 2023-09-30T17:04:37.087 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.65587499199999999, 2023-09-30T17:04:37.087 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.087 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.087 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.087 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.087 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.087 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 177715 2023-09-30T17:04:37.087 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.087 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.087 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.087 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.087 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.256600+0000", 2023-09-30T17:04:37.088 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.088 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.088 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.088 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.088 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.256600+0000", 2023-09-30T17:04:37.088 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.088 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.088 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.088 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.088 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.258517+0000", 2023-09-30T17:04:37.088 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001916287 2023-09-30T17:04:37.088 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.089 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.089 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.089 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.258533+0000", 2023-09-30T17:04:37.089 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6001000000000001e-05 2023-09-30T17:04:37.089 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.089 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.089 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.089 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.258544+0000", 2023-09-30T17:04:37.089 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0781000000000001e-05 2023-09-30T17:04:37.089 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.089 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.090 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.090 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.258551+0000", 2023-09-30T17:04:37.090 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5510000000000002e-06 2023-09-30T17:04:37.090 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.090 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.090 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.090 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.090 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.090 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:177857 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.090 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.288636+0000", 2023-09-30T17:04:37.090 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.62217899899999995, 2023-09-30T17:04:37.090 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.62386960599999997, 2023-09-30T17:04:37.091 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.091 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.091 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.091 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.091 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.091 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 177857 2023-09-30T17:04:37.091 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.091 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.091 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.091 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.091 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.288636+0000", 2023-09-30T17:04:37.091 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.092 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.092 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.092 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.092 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.288636+0000", 2023-09-30T17:04:37.092 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.092 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.092 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.092 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.092 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.288636+0000", 2023-09-30T17:04:37.092 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3000000000000001e-07 2023-09-30T17:04:37.092 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.093 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.093 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.093 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.288650+0000", 2023-09-30T17:04:37.093 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4348000000000001e-05 2023-09-30T17:04:37.093 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.093 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.093 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.093 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.288658+0000", 2023-09-30T17:04:37.093 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6249999999999998e-06 2023-09-30T17:04:37.093 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.093 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.093 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.094 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.288665+0000", 2023-09-30T17:04:37.094 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5200000000000003e-06 2023-09-30T17:04:37.094 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.094 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.094 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.094 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.094 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.094 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178120 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.094 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.376565+0000", 2023-09-30T17:04:37.094 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.53424986299999999, 2023-09-30T17:04:37.094 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.53598101899999995, 2023-09-30T17:04:37.094 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.095 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.095 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.095 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.095 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.095 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178120 2023-09-30T17:04:37.095 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.095 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.095 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.095 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.095 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.376565+0000", 2023-09-30T17:04:37.095 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.095 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.096 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.096 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.096 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.376565+0000", 2023-09-30T17:04:37.096 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.096 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.096 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.096 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.096 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.376565+0000", 2023-09-30T17:04:37.096 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3200000000000005e-07 2023-09-30T17:04:37.096 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.097 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.097 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.097 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.376581+0000", 2023-09-30T17:04:37.097 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5398000000000001e-05 2023-09-30T17:04:37.097 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.097 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.097 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.097 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.376588+0000", 2023-09-30T17:04:37.097 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2690000000000002e-06 2023-09-30T17:04:37.097 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.097 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.098 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.098 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.376611+0000", 2023-09-30T17:04:37.098 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3187e-05 2023-09-30T17:04:37.098 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.098 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.098 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.098 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.098 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.098 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178553 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.098 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.564479+0000", 2023-09-30T17:04:37.098 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.34633587900000001, 2023-09-30T17:04:37.098 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.34810062000000003, 2023-09-30T17:04:37.099 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.099 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.099 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.099 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.099 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.099 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178553 2023-09-30T17:04:37.099 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.099 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.099 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.099 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.099 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.564479+0000", 2023-09-30T17:04:37.100 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.100 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.100 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.100 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.100 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.564479+0000", 2023-09-30T17:04:37.100 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.100 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.100 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.100 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.100 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.564479+0000", 2023-09-30T17:04:37.100 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1800000000000001e-07 2023-09-30T17:04:37.100 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.101 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.101 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.101 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.564500+0000", 2023-09-30T17:04:37.101 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0774000000000001e-05 2023-09-30T17:04:37.101 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.101 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.101 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.101 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.564508+0000", 2023-09-30T17:04:37.101 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2460000000000003e-06 2023-09-30T17:04:37.101 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.101 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.102 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.102 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.564517+0000", 2023-09-30T17:04:37.102 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7709999999999995e-06 2023-09-30T17:04:37.102 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.102 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.102 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.102 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.102 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.102 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178650 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.102 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.605705+0000", 2023-09-30T17:04:37.102 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.305109941, 2023-09-30T17:04:37.102 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.306924005, 2023-09-30T17:04:37.103 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.103 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.103 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.103 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.103 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.103 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178650 2023-09-30T17:04:37.103 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.103 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.103 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.103 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.103 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.605705+0000", 2023-09-30T17:04:37.103 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.104 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.104 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.104 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.104 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.605705+0000", 2023-09-30T17:04:37.104 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.104 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.104 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.104 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.104 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.607903+0000", 2023-09-30T17:04:37.104 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0021981100000000001 2023-09-30T17:04:37.104 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.104 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.105 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.105 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.607921+0000", 2023-09-30T17:04:37.105 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8346e-05 2023-09-30T17:04:37.105 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.105 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.105 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.105 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.607931+0000", 2023-09-30T17:04:37.105 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5659999999999996e-06 2023-09-30T17:04:37.105 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.105 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.105 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.106 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.607939+0000", 2023-09-30T17:04:37.106 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9640000000000003e-06 2023-09-30T17:04:37.106 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.106 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.106 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.106 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.106 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.106 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178684 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.106 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.616404+0000", 2023-09-30T17:04:37.106 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.29441081699999999, 2023-09-30T17:04:37.106 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.296281976, 2023-09-30T17:04:37.107 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.107 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.107 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.107 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.107 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.107 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178684 2023-09-30T17:04:37.107 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.107 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.107 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.107 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.107 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.616404+0000", 2023-09-30T17:04:37.108 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.108 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.108 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.108 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.108 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.616404+0000", 2023-09-30T17:04:37.108 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.108 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.108 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.108 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.108 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.616404+0000", 2023-09-30T17:04:37.108 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4999999999999998e-07 2023-09-30T17:04:37.108 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.109 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.109 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.109 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.616414+0000", 2023-09-30T17:04:37.109 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0283e-05 2023-09-30T17:04:37.109 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.109 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.109 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.109 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.616422+0000", 2023-09-30T17:04:37.109 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1199999999999996e-06 2023-09-30T17:04:37.109 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.109 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.110 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.110 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.616427+0000", 2023-09-30T17:04:37.110 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4779999999999999e-06 2023-09-30T17:04:37.110 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.110 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.110 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.110 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.110 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.110 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178924 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.110 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.693700+0000", 2023-09-30T17:04:37.110 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.21711471800000001, 2023-09-30T17:04:37.111 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.219028838, 2023-09-30T17:04:37.111 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.111 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.111 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.111 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.111 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.111 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178924 2023-09-30T17:04:37.111 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.111 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.111 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.111 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.111 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.693700+0000", 2023-09-30T17:04:37.112 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.112 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.112 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.112 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.112 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.693700+0000", 2023-09-30T17:04:37.112 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.112 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.112 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.112 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.112 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.697515+0000", 2023-09-30T17:04:37.112 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038147770000000001 2023-09-30T17:04:37.112 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.113 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.113 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.113 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.697529+0000", 2023-09-30T17:04:37.113 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4848000000000001e-05 2023-09-30T17:04:37.113 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.113 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.113 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.113 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.697536+0000", 2023-09-30T17:04:37.113 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2249999999999997e-06 2023-09-30T17:04:37.113 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.113 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.114 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.114 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.697540+0000", 2023-09-30T17:04:37.114 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.454e-06 2023-09-30T17:04:37.114 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.114 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.114 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.114 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.114 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.114 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178980 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.114 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.706473+0000", 2023-09-30T17:04:37.114 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.204341305, 2023-09-30T17:04:37.115 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.20628861600000001, 2023-09-30T17:04:37.115 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.115 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.115 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.115 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.115 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.115 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178980 2023-09-30T17:04:37.115 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.115 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.115 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.115 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.115 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.706473+0000", 2023-09-30T17:04:37.116 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.116 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.116 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.116 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.116 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.706473+0000", 2023-09-30T17:04:37.116 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.116 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.116 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.116 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.116 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.706474+0000", 2023-09-30T17:04:37.116 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.13e-07 2023-09-30T17:04:37.116 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.117 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.117 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.117 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.706487+0000", 2023-09-30T17:04:37.117 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.295e-05 2023-09-30T17:04:37.117 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.117 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.117 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.117 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.706494+0000", 2023-09-30T17:04:37.117 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9120000000000001e-06 2023-09-30T17:04:37.117 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.117 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.117 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.118 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.706500+0000", 2023-09-30T17:04:37.118 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2999999999999998e-06 2023-09-30T17:04:37.118 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.118 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.118 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.118 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.118 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.118 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179166 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.118 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.778600+0000", 2023-09-30T17:04:37.118 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.132214477, 2023-09-30T17:04:37.118 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.134208618, 2023-09-30T17:04:37.118 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.119 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.119 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.119 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.119 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.119 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179166 2023-09-30T17:04:37.119 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.119 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.119 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.119 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.119 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.778600+0000", 2023-09-30T17:04:37.119 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.120 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.120 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.120 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.120 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.778600+0000", 2023-09-30T17:04:37.120 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.120 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.120 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.120 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.120 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.778601+0000", 2023-09-30T17:04:37.120 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9200000000000001e-07 2023-09-30T17:04:37.120 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.120 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.120 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.121 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.778612+0000", 2023-09-30T17:04:37.121 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.134e-05 2023-09-30T17:04:37.121 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.121 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.121 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.121 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.778619+0000", 2023-09-30T17:04:37.121 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4220000000000003e-06 2023-09-30T17:04:37.121 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.121 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.121 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.121 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.778624+0000", 2023-09-30T17:04:37.121 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6530000000000002e-06 2023-09-30T17:04:37.122 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.122 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.122 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.122 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.122 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.122 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179224 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.122 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.804767+0000", 2023-09-30T17:04:37.122 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.106047455, 2023-09-30T17:04:37.122 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.108095571, 2023-09-30T17:04:37.122 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.122 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.122 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.123 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.123 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.123 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179224 2023-09-30T17:04:37.123 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.123 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.123 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.123 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.123 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.804767+0000", 2023-09-30T17:04:37.123 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.123 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.123 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.124 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.124 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.804767+0000", 2023-09-30T17:04:37.124 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.124 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.124 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.124 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.124 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.804768+0000", 2023-09-30T17:04:37.124 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.01e-07 2023-09-30T17:04:37.124 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.124 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.124 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.124 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.804778+0000", 2023-09-30T17:04:37.125 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0505e-05 2023-09-30T17:04:37.125 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.125 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.125 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.125 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.804784+0000", 2023-09-30T17:04:37.125 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5539999999999997e-06 2023-09-30T17:04:37.125 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.125 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.125 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.125 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.804788+0000", 2023-09-30T17:04:37.125 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3560000000000003e-06 2023-09-30T17:04:37.125 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.126 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.126 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.126 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.126 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.126 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179278 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.126 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.818656+0000", 2023-09-30T17:04:37.126 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.092158765000000004, 2023-09-30T17:04:37.126 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.094251429999999997, 2023-09-30T17:04:37.126 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.126 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.126 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.126 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.127 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.127 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179278 2023-09-30T17:04:37.127 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.127 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.127 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.127 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.127 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.818656+0000", 2023-09-30T17:04:37.127 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.127 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.127 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.127 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.127 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.818656+0000", 2023-09-30T17:04:37.128 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.128 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.128 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.128 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.128 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.818656+0000", 2023-09-30T17:04:37.128 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8299999999999997e-07 2023-09-30T17:04:37.128 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.128 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.128 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.128 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.818676+0000", 2023-09-30T17:04:37.128 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9494e-05 2023-09-30T17:04:37.128 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.129 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.129 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.129 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.818682+0000", 2023-09-30T17:04:37.129 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4060000000000002e-06 2023-09-30T17:04:37.129 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.129 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.129 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.129 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.818688+0000", 2023-09-30T17:04:37.129 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6110000000000001e-06 2023-09-30T17:04:37.129 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.129 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.129 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.130 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.130 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.130 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179305 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.130 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.828740+0000", 2023-09-30T17:04:37.130 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.082074126999999997, 2023-09-30T17:04:37.130 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.084209845000000005, 2023-09-30T17:04:37.130 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.130 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.130 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.130 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.130 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.131 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179305 2023-09-30T17:04:37.131 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.131 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.131 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.131 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.131 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.828740+0000", 2023-09-30T17:04:37.131 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.131 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.131 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.131 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.131 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.828740+0000", 2023-09-30T17:04:37.131 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.132 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.132 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.132 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.132 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.833568+0000", 2023-09-30T17:04:37.132 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0048272089999999998 2023-09-30T17:04:37.132 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.132 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.132 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.132 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.833586+0000", 2023-09-30T17:04:37.132 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8328000000000001e-05 2023-09-30T17:04:37.132 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.132 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.133 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.133 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.833596+0000", 2023-09-30T17:04:37.133 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0431999999999999e-05 2023-09-30T17:04:37.133 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.133 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.133 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.833603+0000", 2023-09-30T17:04:37.133 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.229e-06 2023-09-30T17:04:37.133 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.133 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.133 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.133 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.134 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.134 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:179195 4.3b e58/17 4:dcc0c15f:::100000001f8.0000001a:head v 58'2879, mlcod=58'2877)", 2023-09-30T17:04:37.134 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.893575+0000", 2023-09-30T17:04:37.134 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.017239550999999999, 2023-09-30T17:04:37.134 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019414047, 2023-09-30T17:04:37.134 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.134 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:37.134 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.134 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.134 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.134 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.893575+0000", 2023-09-30T17:04:37.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.135 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.135 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.135 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.893575+0000", 2023-09-30T17:04:37.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.135 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.135 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.135 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.893575+0000", 2023-09-30T17:04:37.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3799999999999998e-07 2023-09-30T17:04:37.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.136 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.136 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.136 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.893587+0000", 2023-09-30T17:04:37.136 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2029e-05 2023-09-30T17:04:37.136 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.136 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.136 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.136 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.893594+0000", 2023-09-30T17:04:37.136 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5409999999999997e-06 2023-09-30T17:04:37.136 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.136 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.136 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.137 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.893599+0000", 2023-09-30T17:04:37.137 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3079999999999998e-06 2023-09-30T17:04:37.137 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.137 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.137 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:37.137 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.894501+0000", 2023-09-30T17:04:37.137 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00090204800000000002 2023-09-30T17:04:37.137 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.137 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.137 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:37.137 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.894525+0000", 2023-09-30T17:04:37.137 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3297000000000001e-05 2023-09-30T17:04:37.138 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.138 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.138 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.138 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.138 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.138 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:179236 4.28 e58/17)", 2023-09-30T17:04:37.138 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.912017+0000", 2023-09-30T17:04:37.138 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4294967295.9987979, 2023-09-30T17:04:37.138 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0010404909999999999, 2023-09-30T17:04:37.138 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.138 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.138 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.139 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.139 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.139 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.912017+0000", 2023-09-30T17:04:37.139 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.139 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.139 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.139 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.139 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.912017+0000", 2023-09-30T17:04:37.139 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.139 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.139 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.139 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.140 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.912017+0000", 2023-09-30T17:04:37.140 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2399999999999998e-07 2023-09-30T17:04:37.140 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.140 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.140 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.140 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.912031+0000", 2023-09-30T17:04:37.140 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3750999999999999e-05 2023-09-30T17:04:37.140 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.140 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.140 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.140 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.912040+0000", 2023-09-30T17:04:37.140 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9949999999999994e-06 2023-09-30T17:04:37.141 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.141 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.141 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.141 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.912045+0000", 2023-09-30T17:04:37.141 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4310000000000002e-06 2023-09-30T17:04:37.141 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.141 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.141 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.141 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.141 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.141 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178342 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.141 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.465689+0000", 2023-09-30T17:04:37.142 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.44512558499999999, 2023-09-30T17:04:37.142 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.44742060099999997, 2023-09-30T17:04:37.142 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.142 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.142 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.142 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.142 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.142 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178342 2023-09-30T17:04:37.142 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.142 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.142 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.142 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.143 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.465689+0000", 2023-09-30T17:04:37.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.143 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.143 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.143 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.143 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.465689+0000", 2023-09-30T17:04:37.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.143 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.143 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.143 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.143 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.466518+0000", 2023-09-30T17:04:37.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00082866899999999998 2023-09-30T17:04:37.144 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.144 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.144 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.144 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.466532+0000", 2023-09-30T17:04:37.144 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4833e-05 2023-09-30T17:04:37.144 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.144 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.144 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.144 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.466542+0000", 2023-09-30T17:04:37.144 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2939999999999994e-06 2023-09-30T17:04:37.144 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.144 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.145 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.145 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.466548+0000", 2023-09-30T17:04:37.145 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3910000000000003e-06 2023-09-30T17:04:37.145 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.145 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.145 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.145 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.145 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.145 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178444 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.145 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.522714+0000", 2023-09-30T17:04:37.145 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.38810069400000002, 2023-09-30T17:04:37.146 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.39046606900000003, 2023-09-30T17:04:37.146 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.146 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.146 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.146 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.146 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.146 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178444 2023-09-30T17:04:37.146 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.146 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.146 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.146 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.146 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.522714+0000", 2023-09-30T17:04:37.147 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.147 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.147 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.147 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.147 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.522714+0000", 2023-09-30T17:04:37.147 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.147 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.147 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.147 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.147 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.522714+0000", 2023-09-30T17:04:37.147 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9000000000000002e-07 2023-09-30T17:04:37.148 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.148 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.148 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.148 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.522727+0000", 2023-09-30T17:04:37.148 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3164e-05 2023-09-30T17:04:37.148 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.148 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.148 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.149 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.522733+0000", 2023-09-30T17:04:37.149 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9519999999999999e-06 2023-09-30T17:04:37.149 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.149 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.149 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.149 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.522739+0000", 2023-09-30T17:04:37.149 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3800000000000002e-06 2023-09-30T17:04:37.149 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.149 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.149 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.149 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.149 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.150 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178554 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.150 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.564524+0000", 2023-09-30T17:04:37.150 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.34629056000000003, 2023-09-30T17:04:37.150 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.34871614000000001, 2023-09-30T17:04:37.150 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.150 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.150 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.150 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.150 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.150 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178554 2023-09-30T17:04:37.150 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.151 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.151 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.151 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.151 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.564524+0000", 2023-09-30T17:04:37.151 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.151 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.151 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.151 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.151 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.564524+0000", 2023-09-30T17:04:37.151 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.151 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.151 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.152 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.152 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.564524+0000", 2023-09-30T17:04:37.152 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2300000000000002e-07 2023-09-30T17:04:37.152 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.152 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.152 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.152 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.564541+0000", 2023-09-30T17:04:37.152 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6750000000000001e-05 2023-09-30T17:04:37.152 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.152 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.152 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.153 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.564549+0000", 2023-09-30T17:04:37.153 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5480000000000004e-06 2023-09-30T17:04:37.153 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.153 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.153 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.153 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.564554+0000", 2023-09-30T17:04:37.153 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.78e-06 2023-09-30T17:04:37.153 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.153 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.153 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.153 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.154 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.154 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178686 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.154 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.616435+0000", 2023-09-30T17:04:37.154 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.29438001200000002, 2023-09-30T17:04:37.154 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.296860342, 2023-09-30T17:04:37.154 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.154 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.154 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.154 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.154 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.154 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178686 2023-09-30T17:04:37.154 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.155 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.155 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.155 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.155 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.616435+0000", 2023-09-30T17:04:37.155 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.155 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.155 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.155 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.155 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.616435+0000", 2023-09-30T17:04:37.155 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.155 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.156 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.156 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.156 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.616435+0000", 2023-09-30T17:04:37.156 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.46e-07 2023-09-30T17:04:37.156 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.156 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.156 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.156 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.616451+0000", 2023-09-30T17:04:37.156 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5727999999999999e-05 2023-09-30T17:04:37.156 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.156 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.156 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.157 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.616457+0000", 2023-09-30T17:04:37.157 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3300000000000004e-06 2023-09-30T17:04:37.157 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.157 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.157 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.157 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.616462+0000", 2023-09-30T17:04:37.157 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2190000000000003e-06 2023-09-30T17:04:37.157 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.157 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.157 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.157 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.157 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.158 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178729 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.158 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.624690+0000", 2023-09-30T17:04:37.158 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.28612421399999999, 2023-09-30T17:04:37.158 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.28867114300000002, 2023-09-30T17:04:37.158 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.158 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.158 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.158 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.158 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.158 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178729 2023-09-30T17:04:37.158 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.159 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.159 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.159 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.159 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.624690+0000", 2023-09-30T17:04:37.159 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.159 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.159 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.159 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.159 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.624690+0000", 2023-09-30T17:04:37.159 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.159 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.159 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.160 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.160 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.626516+0000", 2023-09-30T17:04:37.160 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001825812 2023-09-30T17:04:37.160 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.160 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.160 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.160 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.626533+0000", 2023-09-30T17:04:37.160 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7031e-05 2023-09-30T17:04:37.160 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.160 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.160 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.160 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.626543+0000", 2023-09-30T17:04:37.161 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0045e-05 2023-09-30T17:04:37.161 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.161 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.161 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.161 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.626550+0000", 2023-09-30T17:04:37.161 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8889999999999996e-06 2023-09-30T17:04:37.161 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.161 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.161 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.161 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.161 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.161 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178085 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.162 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.360839+0000", 2023-09-30T17:04:37.162 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.54997563000000005, 2023-09-30T17:04:37.162 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.55257749499999997, 2023-09-30T17:04:37.162 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.162 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.162 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.162 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.162 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.162 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178085 2023-09-30T17:04:37.162 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.162 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.162 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.163 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.163 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.360839+0000", 2023-09-30T17:04:37.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.163 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.163 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.163 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.163 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.360839+0000", 2023-09-30T17:04:37.163 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.163 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.163 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.163 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.163 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.360839+0000", 2023-09-30T17:04:37.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6800000000000001e-07 2023-09-30T17:04:37.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.164 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.164 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.360858+0000", 2023-09-30T17:04:37.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9057999999999999e-05 2023-09-30T17:04:37.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.164 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.164 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.360865+0000", 2023-09-30T17:04:37.164 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6340000000000003e-06 2023-09-30T17:04:37.164 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.164 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.165 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.165 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.360889+0000", 2023-09-30T17:04:37.165 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4309000000000001e-05 2023-09-30T17:04:37.165 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.165 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.165 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.165 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.165 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.165 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178412 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.165 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.506604+0000", 2023-09-30T17:04:37.166 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.40421076, 2023-09-30T17:04:37.166 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.40687061000000002, 2023-09-30T17:04:37.166 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.166 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.166 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.166 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.166 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.166 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178412 2023-09-30T17:04:37.166 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.166 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.166 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.166 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.167 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.506604+0000", 2023-09-30T17:04:37.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.167 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.167 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.506604+0000", 2023-09-30T17:04:37.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.167 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.167 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.510539+0000", 2023-09-30T17:04:37.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039352390000000001 2023-09-30T17:04:37.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.510559+0000", 2023-09-30T17:04:37.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9959999999999999e-05 2023-09-30T17:04:37.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.168 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.168 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.510575+0000", 2023-09-30T17:04:37.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6254999999999999e-05 2023-09-30T17:04:37.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.510592+0000", 2023-09-30T17:04:37.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6583e-05 2023-09-30T17:04:37.169 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.169 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.169 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.169 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178765 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.169 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.640634+0000", 2023-09-30T17:04:37.169 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.27018052799999998, 2023-09-30T17:04:37.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.27289813699999999, 2023-09-30T17:04:37.170 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.170 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.170 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.170 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.170 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.170 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178765 2023-09-30T17:04:37.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.170 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.170 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.640634+0000", 2023-09-30T17:04:37.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.640634+0000", 2023-09-30T17:04:37.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.640635+0000", 2023-09-30T17:04:37.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7899999999999998e-07 2023-09-30T17:04:37.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.172 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.172 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.640651+0000", 2023-09-30T17:04:37.172 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6705999999999999e-05 2023-09-30T17:04:37.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.172 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.172 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.640661+0000", 2023-09-30T17:04:37.172 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9320000000000008e-06 2023-09-30T17:04:37.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.173 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.173 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.640668+0000", 2023-09-30T17:04:37.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9639999999999997e-06 2023-09-30T17:04:37.173 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.173 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.173 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.173 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.173 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178898 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.173 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.679605+0000", 2023-09-30T17:04:37.173 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.23120997700000001, 2023-09-30T17:04:37.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.23397805899999999, 2023-09-30T17:04:37.174 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.174 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.174 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.174 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.174 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.174 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178898 2023-09-30T17:04:37.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.174 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.679605+0000", 2023-09-30T17:04:37.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.175 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.175 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.679605+0000", 2023-09-30T17:04:37.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.175 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.175 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.685635+0000", 2023-09-30T17:04:37.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060305530000000001 2023-09-30T17:04:37.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.685647+0000", 2023-09-30T17:04:37.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1773999999999999e-05 2023-09-30T17:04:37.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.685656+0000", 2023-09-30T17:04:37.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9160000000000007e-06 2023-09-30T17:04:37.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.177 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.685663+0000", 2023-09-30T17:04:37.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7440000000000001e-06 2023-09-30T17:04:37.177 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.177 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.177 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.177 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178927 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.177 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.697575+0000", 2023-09-30T17:04:37.177 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.21323992, 2023-09-30T17:04:37.177 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.21605812599999999, 2023-09-30T17:04:37.177 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.178 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.178 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.178 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.178 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.178 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178927 2023-09-30T17:04:37.178 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.178 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.178 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.178 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.181 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.697575+0000", 2023-09-30T17:04:37.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.181 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.181 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.181 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.181 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.697575+0000", 2023-09-30T17:04:37.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.182 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.182 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.697575+0000", 2023-09-30T17:04:37.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7899999999999998e-07 2023-09-30T17:04:37.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.182 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.182 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.697585+0000", 2023-09-30T17:04:37.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8409999999999995e-06 2023-09-30T17:04:37.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.697592+0000", 2023-09-30T17:04:37.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2459999999999997e-06 2023-09-30T17:04:37.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.697598+0000", 2023-09-30T17:04:37.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2129999999999999e-06 2023-09-30T17:04:37.183 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.183 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.183 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.184 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179077 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.184 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.747679+0000", 2023-09-30T17:04:37.184 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.16313578100000001, 2023-09-30T17:04:37.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.16600495100000001, 2023-09-30T17:04:37.184 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.184 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.184 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.184 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.184 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.185 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179077 2023-09-30T17:04:37.185 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.185 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.185 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.185 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.185 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.747679+0000", 2023-09-30T17:04:37.185 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.185 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.185 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.185 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.185 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.747679+0000", 2023-09-30T17:04:37.186 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.186 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.186 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.186 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.186 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.751516+0000", 2023-09-30T17:04:37.186 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038368230000000001 2023-09-30T17:04:37.186 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.186 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.186 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.186 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.751536+0000", 2023-09-30T17:04:37.186 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0268999999999999e-05 2023-09-30T17:04:37.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.187 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.751549+0000", 2023-09-30T17:04:37.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2991e-05 2023-09-30T17:04:37.187 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.187 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.187 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.187 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.751559+0000", 2023-09-30T17:04:37.187 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0271999999999999e-05 2023-09-30T17:04:37.187 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.187 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.188 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.188 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.188 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.188 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179237 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.188 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.804825+0000", 2023-09-30T17:04:37.188 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.105989307, 2023-09-30T17:04:37.188 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.108909482, 2023-09-30T17:04:37.188 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.188 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.188 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.188 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.188 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.189 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179237 2023-09-30T17:04:37.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.189 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.804825+0000", 2023-09-30T17:04:37.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.189 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.189 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.189 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.189 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.804825+0000", 2023-09-30T17:04:37.189 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.190 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.190 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.804826+0000", 2023-09-30T17:04:37.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2500000000000001e-07 2023-09-30T17:04:37.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.190 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.190 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.804836+0000", 2023-09-30T17:04:37.190 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0562e-05 2023-09-30T17:04:37.190 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.190 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.191 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.804842+0000", 2023-09-30T17:04:37.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5180000000000004e-06 2023-09-30T17:04:37.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.191 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.191 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.191 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.804846+0000", 2023-09-30T17:04:37.191 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5759999999999999e-06 2023-09-30T17:04:37.191 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.191 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.191 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.191 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.192 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:177579 4.f 4:f2a80dfe:::100000001f8.00000019:head [write 77824~4096 in=4096b,write 167936~4096 in=4096b,write 266240~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.192 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.209602+0000", 2023-09-30T17:04:37.192 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.70121297400000004, 2023-09-30T17:04:37.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.70419134699999997, 2023-09-30T17:04:37.192 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.192 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:37.192 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.192 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.192 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.192 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 177579 2023-09-30T17:04:37.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.193 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.209602+0000", 2023-09-30T17:04:37.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.209602+0000", 2023-09-30T17:04:37.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.194 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.209602+0000", 2023-09-30T17:04:37.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1899999999999998e-07 2023-09-30T17:04:37.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.194 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.209615+0000", 2023-09-30T17:04:37.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2505e-05 2023-09-30T17:04:37.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.194 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.194 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.209622+0000", 2023-09-30T17:04:37.195 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.277e-06 2023-09-30T17:04:37.195 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.195 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.195 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.195 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.209627+0000", 2023-09-30T17:04:37.195 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8330000000000001e-06 2023-09-30T17:04:37.195 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.195 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.195 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:37.195 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.908575+0000", 2023-09-30T17:04:37.195 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.69894852299999999 2023-09-30T17:04:37.195 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.196 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.196 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:37.196 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.908645+0000", 2023-09-30T17:04:37.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0309999999999996e-05 2023-09-30T17:04:37.196 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.196 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.196 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:37.196 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.908800+0000", 2023-09-30T17:04:37.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015457200000000001 2023-09-30T17:04:37.196 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.196 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.196 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.197 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.197 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178011 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.197 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.338598+0000", 2023-09-30T17:04:37.197 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.57221635699999995, 2023-09-30T17:04:37.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.57526283300000003, 2023-09-30T17:04:37.197 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.197 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.197 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.197 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.197 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.197 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178011 2023-09-30T17:04:37.198 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.198 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.198 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.198 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.198 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.338598+0000", 2023-09-30T17:04:37.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.198 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.198 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.198 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.198 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.338598+0000", 2023-09-30T17:04:37.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.198 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.338599+0000", 2023-09-30T17:04:37.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6699999999999999e-07 2023-09-30T17:04:37.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.338610+0000", 2023-09-30T17:04:37.199 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1021e-05 2023-09-30T17:04:37.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.200 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.338619+0000", 2023-09-30T17:04:37.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7030000000000001e-06 2023-09-30T17:04:37.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.200 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.200 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.338625+0000", 2023-09-30T17:04:37.200 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.339e-06 2023-09-30T17:04:37.200 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.200 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.200 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.200 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.200 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.200 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178089 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.201 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.360900+0000", 2023-09-30T17:04:37.201 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.54991495700000004, 2023-09-30T17:04:37.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.55301287899999996, 2023-09-30T17:04:37.201 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.201 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.201 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.201 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.201 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.201 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178089 2023-09-30T17:04:37.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.201 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.202 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.202 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.360900+0000", 2023-09-30T17:04:37.202 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.202 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.202 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.202 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.360900+0000", 2023-09-30T17:04:37.202 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.202 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.202 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.203 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.360900+0000", 2023-09-30T17:04:37.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7999999999999996e-07 2023-09-30T17:04:37.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.203 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.203 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.203 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.360922+0000", 2023-09-30T17:04:37.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2014999999999998e-05 2023-09-30T17:04:37.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.203 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.203 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.203 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.360930+0000", 2023-09-30T17:04:37.204 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5279999999999998e-06 2023-09-30T17:04:37.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.204 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.204 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.360935+0000", 2023-09-30T17:04:37.204 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6069999999999998e-06 2023-09-30T17:04:37.204 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.204 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.204 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.204 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.204 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.204 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178298 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.205 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.464529+0000", 2023-09-30T17:04:37.205 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.44628584999999998, 2023-09-30T17:04:37.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.44943489800000003, 2023-09-30T17:04:37.205 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.205 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.205 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.205 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.205 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.205 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178298 2023-09-30T17:04:37.205 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.205 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.206 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.206 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.464529+0000", 2023-09-30T17:04:37.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.206 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.206 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.464529+0000", 2023-09-30T17:04:37.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.206 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.206 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.464530+0000", 2023-09-30T17:04:37.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7599999999999996e-07 2023-09-30T17:04:37.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.207 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.207 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.464559+0000", 2023-09-30T17:04:37.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9913e-05 2023-09-30T17:04:37.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.207 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.207 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.464571+0000", 2023-09-30T17:04:37.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.112e-05 2023-09-30T17:04:37.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.208 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.208 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.464578+0000", 2023-09-30T17:04:37.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0280000000000003e-06 2023-09-30T17:04:37.208 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.208 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.208 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.208 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.208 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178367 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.208 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.492641+0000", 2023-09-30T17:04:37.208 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.418174043, 2023-09-30T17:04:37.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.421374266, 2023-09-30T17:04:37.209 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.209 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.209 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.209 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.209 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.209 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178367 2023-09-30T17:04:37.209 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.209 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.209 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.209 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.492641+0000", 2023-09-30T17:04:37.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.210 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.210 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.492641+0000", 2023-09-30T17:04:37.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.210 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.210 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.492641+0000", 2023-09-30T17:04:37.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5499999999999998e-07 2023-09-30T17:04:37.210 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.492660+0000", 2023-09-30T17:04:37.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8777e-05 2023-09-30T17:04:37.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.492666+0000", 2023-09-30T17:04:37.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3559999999999998e-06 2023-09-30T17:04:37.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.212 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.492672+0000", 2023-09-30T17:04:37.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4160000000000003e-06 2023-09-30T17:04:37.212 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.212 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.212 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.212 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.212 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178899 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.212 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.685672+0000", 2023-09-30T17:04:37.212 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.22514238, 2023-09-30T17:04:37.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.22839403599999999, 2023-09-30T17:04:37.212 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.212 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.213 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.213 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.213 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.213 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178899 2023-09-30T17:04:37.213 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.213 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.213 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.213 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.213 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.685672+0000", 2023-09-30T17:04:37.213 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.213 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.213 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.214 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.214 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.685672+0000", 2023-09-30T17:04:37.214 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.214 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.214 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.214 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.685673+0000", 2023-09-30T17:04:37.214 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0999999999999999e-07 2023-09-30T17:04:37.214 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.214 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.214 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.685686+0000", 2023-09-30T17:04:37.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3579e-05 2023-09-30T17:04:37.215 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.215 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.685694+0000", 2023-09-30T17:04:37.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5449999999999998e-06 2023-09-30T17:04:37.215 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.215 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.685699+0000", 2023-09-30T17:04:37.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6130000000000003e-06 2023-09-30T17:04:37.215 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.216 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.216 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.216 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.216 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.216 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178929 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.216 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.697605+0000", 2023-09-30T17:04:37.216 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.213209231, 2023-09-30T17:04:37.216 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.21651262900000001, 2023-09-30T17:04:37.216 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.216 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.216 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.216 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.217 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.217 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178929 2023-09-30T17:04:37.217 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.217 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.217 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.217 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.697605+0000", 2023-09-30T17:04:37.217 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.217 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.217 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.217 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.697605+0000", 2023-09-30T17:04:37.218 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.218 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.218 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.218 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.218 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.697606+0000", 2023-09-30T17:04:37.218 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.39e-07 2023-09-30T17:04:37.218 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.218 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.218 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.218 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.697623+0000", 2023-09-30T17:04:37.218 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6855999999999999e-05 2023-09-30T17:04:37.219 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.219 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.219 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.697629+0000", 2023-09-30T17:04:37.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1020000000000002e-06 2023-09-30T17:04:37.219 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.219 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.219 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.697634+0000", 2023-09-30T17:04:37.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3979999999999998e-06 2023-09-30T17:04:37.219 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.219 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.220 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.220 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.220 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.220 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178990 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.220 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.706595+0000", 2023-09-30T17:04:37.220 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.204219236, 2023-09-30T17:04:37.220 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.20763843900000001, 2023-09-30T17:04:37.220 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.220 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.220 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.220 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.221 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.221 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178990 2023-09-30T17:04:37.221 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.221 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.221 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.221 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.221 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.706595+0000", 2023-09-30T17:04:37.221 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.221 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.221 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.221 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.221 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.706595+0000", 2023-09-30T17:04:37.222 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.222 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.222 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.222 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.222 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.706596+0000", 2023-09-30T17:04:37.222 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4999999999999998e-07 2023-09-30T17:04:37.222 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.222 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.222 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.222 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.706610+0000", 2023-09-30T17:04:37.222 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4014e-05 2023-09-30T17:04:37.222 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.223 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.706617+0000", 2023-09-30T17:04:37.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8929999999999999e-06 2023-09-30T17:04:37.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.223 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.706622+0000", 2023-09-30T17:04:37.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5860000000000004e-06 2023-09-30T17:04:37.223 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.223 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.223 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.224 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.224 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179081 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.224 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.751575+0000", 2023-09-30T17:04:37.224 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.15923936, 2023-09-30T17:04:37.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.16271024100000001, 2023-09-30T17:04:37.224 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.224 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.224 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.224 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.224 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.224 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179081 2023-09-30T17:04:37.225 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.225 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.225 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.225 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.225 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.751575+0000", 2023-09-30T17:04:37.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.225 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.225 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.225 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.225 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.751575+0000", 2023-09-30T17:04:37.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.225 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.225 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.226 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.226 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.751576+0000", 2023-09-30T17:04:37.226 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0399999999999996e-07 2023-09-30T17:04:37.226 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.226 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.226 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.226 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.751588+0000", 2023-09-30T17:04:37.226 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2208999999999999e-05 2023-09-30T17:04:37.226 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.226 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.226 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.226 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.751595+0000", 2023-09-30T17:04:37.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7220000000000002e-06 2023-09-30T17:04:37.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.751600+0000", 2023-09-30T17:04:37.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3079999999999998e-06 2023-09-30T17:04:37.227 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.227 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.227 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.227 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:177784 4.36 e58/17)", 2023-09-30T17:04:37.228 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.860337+0000", 2023-09-30T17:04:37.228 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.050477764000000001, 2023-09-30T17:04:37.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.054000740999999998, 2023-09-30T17:04:37.228 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.228 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.228 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.228 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.228 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.228 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.860337+0000", 2023-09-30T17:04:37.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.228 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.229 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.229 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.860337+0000", 2023-09-30T17:04:37.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.229 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.229 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.860337+0000", 2023-09-30T17:04:37.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.99e-07 2023-09-30T17:04:37.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.229 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.229 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.860345+0000", 2023-09-30T17:04:37.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3890000000000005e-06 2023-09-30T17:04:37.230 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.230 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.230 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.860355+0000", 2023-09-30T17:04:37.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0062e-05 2023-09-30T17:04:37.230 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.230 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.230 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.860360+0000", 2023-09-30T17:04:37.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.651e-06 2023-09-30T17:04:37.230 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.231 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.231 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.231 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:177811 4.6 e58/17)", 2023-09-30T17:04:37.231 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.880693+0000", 2023-09-30T17:04:37.231 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.030121938000000001, 2023-09-30T17:04:37.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.033688806000000002, 2023-09-30T17:04:37.231 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.231 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.231 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.232 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.880693+0000", 2023-09-30T17:04:37.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.232 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.880693+0000", 2023-09-30T17:04:37.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.232 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.880693+0000", 2023-09-30T17:04:37.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8699999999999999e-07 2023-09-30T17:04:37.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.233 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.233 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.233 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.880712+0000", 2023-09-30T17:04:37.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9170000000000001e-05 2023-09-30T17:04:37.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.233 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.233 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.233 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.880719+0000", 2023-09-30T17:04:37.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8059999999999997e-06 2023-09-30T17:04:37.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.234 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.234 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.234 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.880724+0000", 2023-09-30T17:04:37.234 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3480000000000003e-06 2023-09-30T17:04:37.234 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.234 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.234 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.234 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.234 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.234 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:177764 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.234 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.270613+0000", 2023-09-30T17:04:37.234 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.64020179399999999, 2023-09-30T17:04:37.235 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.64381505000000006, 2023-09-30T17:04:37.235 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.235 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.235 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.235 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.235 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.235 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 177764 2023-09-30T17:04:37.235 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.235 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.235 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.235 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.236 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.270613+0000", 2023-09-30T17:04:37.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.236 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.236 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.236 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.236 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.270613+0000", 2023-09-30T17:04:37.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.236 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.236 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.236 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.236 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.270613+0000", 2023-09-30T17:04:37.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0200000000000002e-07 2023-09-30T17:04:37.236 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.270624+0000", 2023-09-30T17:04:37.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0910000000000001e-05 2023-09-30T17:04:37.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.237 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.270631+0000", 2023-09-30T17:04:37.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8689999999999998e-06 2023-09-30T17:04:37.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.237 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.270636+0000", 2023-09-30T17:04:37.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8840000000000002e-06 2023-09-30T17:04:37.238 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.238 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.238 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.238 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.238 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:177860 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.238 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.292575+0000", 2023-09-30T17:04:37.238 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.61823955500000005, 2023-09-30T17:04:37.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.62190846899999996, 2023-09-30T17:04:37.239 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.239 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.239 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.239 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.239 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.239 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 177860 2023-09-30T17:04:37.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.239 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.239 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.239 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.292575+0000", 2023-09-30T17:04:37.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.240 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.240 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.240 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.292575+0000", 2023-09-30T17:04:37.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.240 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.240 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.240 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.240 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.292576+0000", 2023-09-30T17:04:37.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7100000000000002e-07 2023-09-30T17:04:37.240 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.240 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.240 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.241 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.292589+0000", 2023-09-30T17:04:37.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3360000000000001e-05 2023-09-30T17:04:37.241 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.241 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.241 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.292596+0000", 2023-09-30T17:04:37.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7889999999999997e-06 2023-09-30T17:04:37.241 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.241 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.241 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.292602+0000", 2023-09-30T17:04:37.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8799999999999996e-06 2023-09-30T17:04:37.242 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.242 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.242 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.242 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178126 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.242 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.376703+0000", 2023-09-30T17:04:37.242 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.53411163900000003, 2023-09-30T17:04:37.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.53784208200000005, 2023-09-30T17:04:37.242 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.242 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.242 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.243 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.243 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.243 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178126 2023-09-30T17:04:37.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.243 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.376703+0000", 2023-09-30T17:04:37.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.376703+0000", 2023-09-30T17:04:37.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.376703+0000", 2023-09-30T17:04:37.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3000000000000002e-07 2023-09-30T17:04:37.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.376716+0000", 2023-09-30T17:04:37.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2809999999999999e-05 2023-09-30T17:04:37.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.245 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.245 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.376720+0000", 2023-09-30T17:04:37.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5480000000000002e-06 2023-09-30T17:04:37.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.245 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.245 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.376723+0000", 2023-09-30T17:04:37.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.732e-06 2023-09-30T17:04:37.245 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.246 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.246 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.246 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178585 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.246 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.579566+0000", 2023-09-30T17:04:37.246 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.33124858499999998, 2023-09-30T17:04:37.246 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.33504083800000001, 2023-09-30T17:04:37.246 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.246 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.246 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.247 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.247 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.247 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178585 2023-09-30T17:04:37.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.247 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.579566+0000", 2023-09-30T17:04:37.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.248 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.579566+0000", 2023-09-30T17:04:37.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.248 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.248 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.248 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.579567+0000", 2023-09-30T17:04:37.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7700000000000004e-07 2023-09-30T17:04:37.248 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.248 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.248 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.579580+0000", 2023-09-30T17:04:37.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3879e-05 2023-09-30T17:04:37.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.249 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.249 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.579586+0000", 2023-09-30T17:04:37.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0830000000000003e-06 2023-09-30T17:04:37.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.249 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.249 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.579589+0000", 2023-09-30T17:04:37.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.929e-06 2023-09-30T17:04:37.249 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.250 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.250 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.250 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178702 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.250 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.616548+0000", 2023-09-30T17:04:37.250 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.29426704599999998, 2023-09-30T17:04:37.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.298119829, 2023-09-30T17:04:37.250 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.250 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.250 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.250 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.251 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.251 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178702 2023-09-30T17:04:37.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.251 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.616548+0000", 2023-09-30T17:04:37.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.616548+0000", 2023-09-30T17:04:37.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.616548+0000", 2023-09-30T17:04:37.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7000000000000005e-07 2023-09-30T17:04:37.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.616565+0000", 2023-09-30T17:04:37.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7229000000000001e-05 2023-09-30T17:04:37.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.253 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.616572+0000", 2023-09-30T17:04:37.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7120000000000003e-06 2023-09-30T17:04:37.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.253 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.253 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.616579+0000", 2023-09-30T17:04:37.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1579999999999999e-06 2023-09-30T17:04:37.253 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.254 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.254 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.254 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.254 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178935 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.254 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.697642+0000", 2023-09-30T17:04:37.254 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.213172682, 2023-09-30T17:04:37.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.217089114, 2023-09-30T17:04:37.254 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.254 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.254 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.254 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.255 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.255 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178935 2023-09-30T17:04:37.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.255 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.697642+0000", 2023-09-30T17:04:37.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.697642+0000", 2023-09-30T17:04:37.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.697642+0000", 2023-09-30T17:04:37.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1200000000000003e-07 2023-09-30T17:04:37.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.697653+0000", 2023-09-30T17:04:37.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0383999999999999e-05 2023-09-30T17:04:37.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.257 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.257 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.257 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.697659+0000", 2023-09-30T17:04:37.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5119999999999997e-06 2023-09-30T17:04:37.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.257 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.257 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.257 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.697665+0000", 2023-09-30T17:04:37.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5709999999999997e-06 2023-09-30T17:04:37.257 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.257 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.257 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.258 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.258 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179005 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.258 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.718614+0000", 2023-09-30T17:04:37.258 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.19220099700000001, 2023-09-30T17:04:37.258 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.196184738, 2023-09-30T17:04:37.258 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.258 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.258 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.258 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.258 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.259 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179005 2023-09-30T17:04:37.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.259 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.259 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.718614+0000", 2023-09-30T17:04:37.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.259 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.718614+0000", 2023-09-30T17:04:37.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.723553+0000", 2023-09-30T17:04:37.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0049398549999999999 2023-09-30T17:04:37.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.723571+0000", 2023-09-30T17:04:37.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8031000000000001e-05 2023-09-30T17:04:37.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.261 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.723581+0000", 2023-09-30T17:04:37.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8579999999999995e-06 2023-09-30T17:04:37.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.261 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.261 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.723589+0000", 2023-09-30T17:04:37.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2509999999999997e-06 2023-09-30T17:04:37.261 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.261 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.261 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.262 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179111 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.262 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.766721+0000", 2023-09-30T17:04:37.262 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.14409402700000001, 2023-09-30T17:04:37.262 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.14814186600000001, 2023-09-30T17:04:37.262 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.262 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.262 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.262 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.262 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.262 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179111 2023-09-30T17:04:37.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.262 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.766721+0000", 2023-09-30T17:04:37.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.766721+0000", 2023-09-30T17:04:37.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.766721+0000", 2023-09-30T17:04:37.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4700000000000001e-07 2023-09-30T17:04:37.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.766737+0000", 2023-09-30T17:04:37.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5481999999999998e-05 2023-09-30T17:04:37.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.766745+0000", 2023-09-30T17:04:37.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7090000000000008e-06 2023-09-30T17:04:37.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.265 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.766752+0000", 2023-09-30T17:04:37.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3230000000000003e-06 2023-09-30T17:04:37.265 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.265 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.265 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.266 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179192 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.266 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.790641+0000", 2023-09-30T17:04:37.266 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.12017351699999999, 2023-09-30T17:04:37.266 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.12428167900000001, 2023-09-30T17:04:37.266 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.266 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.266 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.266 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.266 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.266 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179192 2023-09-30T17:04:37.266 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.266 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.267 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.267 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.790641+0000", 2023-09-30T17:04:37.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.267 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.267 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.267 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.790641+0000", 2023-09-30T17:04:37.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.267 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.267 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.268 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.796516+0000", 2023-09-30T17:04:37.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0058754369999999998 2023-09-30T17:04:37.268 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.268 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.268 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.796537+0000", 2023-09-30T17:04:37.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0293999999999999e-05 2023-09-30T17:04:37.268 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.268 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.268 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.796554+0000", 2023-09-30T17:04:37.269 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6762e-05 2023-09-30T17:04:37.269 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.269 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.269 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.796571+0000", 2023-09-30T17:04:37.269 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7073000000000001e-05 2023-09-30T17:04:37.269 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.269 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.269 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.269 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.269 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179239 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.270 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.804880+0000", 2023-09-30T17:04:37.270 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.105934141, 2023-09-30T17:04:37.270 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.110103906, 2023-09-30T17:04:37.270 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.270 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.270 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.270 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.270 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.270 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179239 2023-09-30T17:04:37.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.270 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.804880+0000", 2023-09-30T17:04:37.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.804880+0000", 2023-09-30T17:04:37.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.804881+0000", 2023-09-30T17:04:37.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4700000000000002e-07 2023-09-30T17:04:37.272 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.272 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.804892+0000", 2023-09-30T17:04:37.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1524e-05 2023-09-30T17:04:37.272 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.272 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.804898+0000", 2023-09-30T17:04:37.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7010000000000001e-06 2023-09-30T17:04:37.273 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.273 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.273 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.273 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.804903+0000", 2023-09-30T17:04:37.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5700000000000003e-06 2023-09-30T17:04:37.273 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.273 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.273 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.273 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.273 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.273 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179280 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.273 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.818739+0000", 2023-09-30T17:04:37.274 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.092075603000000006, 2023-09-30T17:04:37.274 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.096297593000000001, 2023-09-30T17:04:37.274 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.274 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.274 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.274 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.274 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.274 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179280 2023-09-30T17:04:37.274 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.274 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.275 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.275 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.818739+0000", 2023-09-30T17:04:37.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.275 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.275 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.275 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.818739+0000", 2023-09-30T17:04:37.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.275 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.275 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.275 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.822517+0000", 2023-09-30T17:04:37.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0037775880000000001 2023-09-30T17:04:37.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.822532+0000", 2023-09-30T17:04:37.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5235000000000001e-05 2023-09-30T17:04:37.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.822544+0000", 2023-09-30T17:04:37.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2194999999999999e-05 2023-09-30T17:04:37.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.822551+0000", 2023-09-30T17:04:37.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9840000000000004e-06 2023-09-30T17:04:37.277 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.277 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.277 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.277 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179358 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.277 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.859571+0000", 2023-09-30T17:04:37.278 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.051243400000000001, 2023-09-30T17:04:37.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.055501975000000002, 2023-09-30T17:04:37.278 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.278 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.278 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.278 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.278 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.278 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179358 2023-09-30T17:04:37.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.278 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.859571+0000", 2023-09-30T17:04:37.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.859571+0000", 2023-09-30T17:04:37.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.861518+0000", 2023-09-30T17:04:37.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001947245 2023-09-30T17:04:37.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.280 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.280 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.861534+0000", 2023-09-30T17:04:37.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5288999999999999e-05 2023-09-30T17:04:37.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.280 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.280 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.861555+0000", 2023-09-30T17:04:37.280 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1667000000000001e-05 2023-09-30T17:04:37.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.280 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.861564+0000", 2023-09-30T17:04:37.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3990000000000004e-06 2023-09-30T17:04:37.281 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.281 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.281 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.281 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:177836 4.6 e58/17)", 2023-09-30T17:04:37.281 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.896755+0000", 2023-09-30T17:04:37.281 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.014059334999999999, 2023-09-30T17:04:37.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018349068999999999, 2023-09-30T17:04:37.282 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.282 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.282 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.896755+0000", 2023-09-30T17:04:37.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.896755+0000", 2023-09-30T17:04:37.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.283 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.283 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.896756+0000", 2023-09-30T17:04:37.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4900000000000005e-07 2023-09-30T17:04:37.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.283 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.283 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.896772+0000", 2023-09-30T17:04:37.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6072000000000001e-05 2023-09-30T17:04:37.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.284 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.284 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.896784+0000", 2023-09-30T17:04:37.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1722000000000001e-05 2023-09-30T17:04:37.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.284 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.284 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.896793+0000", 2023-09-30T17:04:37.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1409999999999994e-06 2023-09-30T17:04:37.284 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.284 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.284 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.285 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:177862 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.285 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.292610+0000", 2023-09-30T17:04:37.285 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.61820432700000005, 2023-09-30T17:04:37.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.62252213300000003, 2023-09-30T17:04:37.285 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.285 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.285 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.285 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.285 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.285 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 177862 2023-09-30T17:04:37.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.286 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.292610+0000", 2023-09-30T17:04:37.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.292610+0000", 2023-09-30T17:04:37.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.287 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.292611+0000", 2023-09-30T17:04:37.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9200000000000002e-07 2023-09-30T17:04:37.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.287 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.292621+0000", 2023-09-30T17:04:37.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0383999999999999e-05 2023-09-30T17:04:37.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.292628+0000", 2023-09-30T17:04:37.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8240000000000002e-06 2023-09-30T17:04:37.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.288 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.288 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.292633+0000", 2023-09-30T17:04:37.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5230000000000003e-06 2023-09-30T17:04:37.288 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.288 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.288 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.289 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:177950 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.289 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.315804+0000", 2023-09-30T17:04:37.289 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.59501045200000002, 2023-09-30T17:04:37.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.59936143900000005, 2023-09-30T17:04:37.289 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.289 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.289 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.289 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.289 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.289 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 177950 2023-09-30T17:04:37.290 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.290 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.290 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.315804+0000", 2023-09-30T17:04:37.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.290 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.290 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.315804+0000", 2023-09-30T17:04:37.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.315805+0000", 2023-09-30T17:04:37.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9299999999999999e-07 2023-09-30T17:04:37.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.315817+0000", 2023-09-30T17:04:37.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2391999999999999e-05 2023-09-30T17:04:37.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.315823+0000", 2023-09-30T17:04:37.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0009999999999998e-06 2023-09-30T17:04:37.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.292 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.315828+0000", 2023-09-30T17:04:37.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6630000000000001e-06 2023-09-30T17:04:37.292 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.292 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.292 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.293 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178374 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.293 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.492717+0000", 2023-09-30T17:04:37.293 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.418097471, 2023-09-30T17:04:37.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.42247914199999997, 2023-09-30T17:04:37.293 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.293 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.293 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.293 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.293 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.293 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178374 2023-09-30T17:04:37.293 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.294 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.294 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.294 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.492717+0000", 2023-09-30T17:04:37.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.294 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.294 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.294 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.492717+0000", 2023-09-30T17:04:37.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.294 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.492718+0000", 2023-09-30T17:04:37.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6100000000000001e-07 2023-09-30T17:04:37.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.492730+0000", 2023-09-30T17:04:37.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1939e-05 2023-09-30T17:04:37.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.296 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.492738+0000", 2023-09-30T17:04:37.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3769999999999996e-06 2023-09-30T17:04:37.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.296 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.296 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.492744+0000", 2023-09-30T17:04:37.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.472e-06 2023-09-30T17:04:37.296 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.296 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.296 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.297 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178658 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.297 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.608116+0000", 2023-09-30T17:04:37.297 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.30269849799999998, 2023-09-30T17:04:37.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.30711294, 2023-09-30T17:04:37.297 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.297 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.297 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.297 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.297 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.297 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178658 2023-09-30T17:04:37.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.297 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.608116+0000", 2023-09-30T17:04:37.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.608116+0000", 2023-09-30T17:04:37.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.299 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.608116+0000", 2023-09-30T17:04:37.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2100000000000002e-07 2023-09-30T17:04:37.299 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.299 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.299 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.608128+0000", 2023-09-30T17:04:37.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1297999999999999e-05 2023-09-30T17:04:37.299 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.299 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.299 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.608134+0000", 2023-09-30T17:04:37.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5540000000000003e-06 2023-09-30T17:04:37.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.300 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.300 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.608140+0000", 2023-09-30T17:04:37.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8810000000000001e-06 2023-09-30T17:04:37.300 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.300 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.300 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.300 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178846 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.300 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.661588+0000", 2023-09-30T17:04:37.301 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.24922633299999999, 2023-09-30T17:04:37.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.25367084299999998, 2023-09-30T17:04:37.301 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.301 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.301 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.301 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.301 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.301 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178846 2023-09-30T17:04:37.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.301 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.301 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.301 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.302 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.661588+0000", 2023-09-30T17:04:37.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.302 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.302 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.661588+0000", 2023-09-30T17:04:37.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.302 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.302 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.661589+0000", 2023-09-30T17:04:37.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.65e-07 2023-09-30T17:04:37.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.303 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.303 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.661603+0000", 2023-09-30T17:04:37.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4273e-05 2023-09-30T17:04:37.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.303 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.303 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.661609+0000", 2023-09-30T17:04:37.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9830000000000001e-06 2023-09-30T17:04:37.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.304 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.304 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.661613+0000", 2023-09-30T17:04:37.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5719999999999996e-06 2023-09-30T17:04:37.304 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.304 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.304 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.304 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.304 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:177624 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.304 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.221711+0000", 2023-09-30T17:04:37.304 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.68910310200000002, 2023-09-30T17:04:37.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.693580733, 2023-09-30T17:04:37.305 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.305 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.305 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.305 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.305 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.305 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 177624 2023-09-30T17:04:37.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.307 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.308 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.308 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.221711+0000", 2023-09-30T17:04:37.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.308 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.308 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.221711+0000", 2023-09-30T17:04:37.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.308 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.225518+0000", 2023-09-30T17:04:37.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038060440000000002 2023-09-30T17:04:37.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.225533+0000", 2023-09-30T17:04:37.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5857000000000001e-05 2023-09-30T17:04:37.309 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.309 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.309 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.225547+0000", 2023-09-30T17:04:37.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3251999999999999e-05 2023-09-30T17:04:37.310 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.310 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.310 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.310 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.225554+0000", 2023-09-30T17:04:37.310 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1520000000000003e-06 2023-09-30T17:04:37.310 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.310 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.310 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.310 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.316 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.316 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:177863 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.317 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.292640+0000", 2023-09-30T17:04:37.317 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.61817416400000003, 2023-09-30T17:04:37.317 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.62269859299999997, 2023-09-30T17:04:37.317 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.317 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.317 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.317 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.317 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.317 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 177863 2023-09-30T17:04:37.317 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.317 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.292640+0000", 2023-09-30T17:04:37.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.318 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.292640+0000", 2023-09-30T17:04:37.318 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.318 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.318 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.318 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.292641+0000", 2023-09-30T17:04:37.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0200000000000003e-07 2023-09-30T17:04:37.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.292653+0000", 2023-09-30T17:04:37.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1766999999999999e-05 2023-09-30T17:04:37.319 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.319 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.319 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.319 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.292660+0000", 2023-09-30T17:04:37.319 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4769999999999997e-06 2023-09-30T17:04:37.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.320 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.320 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.292665+0000", 2023-09-30T17:04:37.320 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.344e-06 2023-09-30T17:04:37.320 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.320 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.320 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.320 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.320 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.320 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:177951 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.320 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.315833+0000", 2023-09-30T17:04:37.321 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.59498110800000004, 2023-09-30T17:04:37.321 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.59954982499999998, 2023-09-30T17:04:37.321 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.321 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.321 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.321 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.321 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.321 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 177951 2023-09-30T17:04:37.321 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.321 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.321 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.315833+0000", 2023-09-30T17:04:37.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.315833+0000", 2023-09-30T17:04:37.322 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.322 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.322 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.322 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.322 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.315834+0000", 2023-09-30T17:04:37.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4999999999999998e-07 2023-09-30T17:04:37.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.315848+0000", 2023-09-30T17:04:37.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3986e-05 2023-09-30T17:04:37.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.323 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.323 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.323 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.315854+0000", 2023-09-30T17:04:37.323 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9100000000000002e-06 2023-09-30T17:04:37.323 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.324 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.324 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.315860+0000", 2023-09-30T17:04:37.324 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7150000000000001e-06 2023-09-30T17:04:37.324 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.324 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.324 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.324 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.324 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.324 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178302 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.324 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.464686+0000", 2023-09-30T17:04:37.324 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.44612831600000002, 2023-09-30T17:04:37.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.45074656600000002, 2023-09-30T17:04:37.325 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.325 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.325 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.325 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.325 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.325 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178302 2023-09-30T17:04:37.325 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.325 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.325 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.325 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.325 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.464686+0000", 2023-09-30T17:04:37.325 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.326 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.326 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.326 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.464686+0000", 2023-09-30T17:04:37.326 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.326 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.326 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.326 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.326 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.464687+0000", 2023-09-30T17:04:37.326 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1399999999999997e-07 2023-09-30T17:04:37.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.330 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.330 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.464702+0000", 2023-09-30T17:04:37.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5786000000000001e-05 2023-09-30T17:04:37.330 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.330 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.330 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.330 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.464709+0000", 2023-09-30T17:04:37.330 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4230000000000002e-06 2023-09-30T17:04:37.331 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.331 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.331 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.331 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.464714+0000", 2023-09-30T17:04:37.331 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8439999999999997e-06 2023-09-30T17:04:37.331 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.331 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.331 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.331 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.331 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.331 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178588 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.332 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.579600+0000", 2023-09-30T17:04:37.332 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.33121461699999999, 2023-09-30T17:04:37.332 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.335866257, 2023-09-30T17:04:37.332 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.332 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.332 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.332 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.332 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.332 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178588 2023-09-30T17:04:37.332 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.332 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.332 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.579600+0000", 2023-09-30T17:04:37.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.579600+0000", 2023-09-30T17:04:37.333 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.333 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.333 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.333 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.333 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.581515+0000", 2023-09-30T17:04:37.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00191533 2023-09-30T17:04:37.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.581528+0000", 2023-09-30T17:04:37.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3162e-05 2023-09-30T17:04:37.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.334 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.334 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.581539+0000", 2023-09-30T17:04:37.334 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0057e-05 2023-09-30T17:04:37.334 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.334 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.335 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.335 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.581546+0000", 2023-09-30T17:04:37.335 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3490000000000003e-06 2023-09-30T17:04:37.335 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.335 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.335 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.335 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.335 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.335 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178619 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.335 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.593618+0000", 2023-09-30T17:04:37.335 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.31719665699999999, 2023-09-30T17:04:37.335 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.32187927300000002, 2023-09-30T17:04:37.336 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.336 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.336 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.336 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.336 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.336 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178619 2023-09-30T17:04:37.336 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.336 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.336 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.336 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.336 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.593618+0000", 2023-09-30T17:04:37.336 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.337 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.337 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.337 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.337 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.593618+0000", 2023-09-30T17:04:37.337 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.337 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.337 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.337 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.337 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.595518+0000", 2023-09-30T17:04:37.337 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0018995819999999999 2023-09-30T17:04:37.337 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.337 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.338 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.338 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.595543+0000", 2023-09-30T17:04:37.338 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5301999999999999e-05 2023-09-30T17:04:37.338 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.338 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.338 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.338 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.595562+0000", 2023-09-30T17:04:37.338 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9018e-05 2023-09-30T17:04:37.338 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.338 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.338 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.338 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.595579+0000", 2023-09-30T17:04:37.338 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7329999999999998e-05 2023-09-30T17:04:37.339 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.339 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.339 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.339 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.339 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.339 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178772 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.339 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.640718+0000", 2023-09-30T17:04:37.364 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.27009622500000002, 2023-09-30T17:04:37.364 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.27481751500000001, 2023-09-30T17:04:37.364 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.364 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.364 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.364 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.364 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.364 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178772 2023-09-30T17:04:37.364 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.364 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.365 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.365 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.365 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.640718+0000", 2023-09-30T17:04:37.365 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.365 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.365 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.365 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.365 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.640718+0000", 2023-09-30T17:04:37.365 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.365 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.365 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.366 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.366 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.642517+0000", 2023-09-30T17:04:37.366 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001798249 2023-09-30T17:04:37.366 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.366 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.366 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.366 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.642532+0000", 2023-09-30T17:04:37.366 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5597999999999999e-05 2023-09-30T17:04:37.366 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.366 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.366 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.366 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.642543+0000", 2023-09-30T17:04:37.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0378e-05 2023-09-30T17:04:37.367 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.367 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.367 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.642550+0000", 2023-09-30T17:04:37.367 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5059999999999998e-06 2023-09-30T17:04:37.367 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.367 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.367 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.367 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.367 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.367 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179196 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.368 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.796636+0000", 2023-09-30T17:04:37.368 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.114178503, 2023-09-30T17:04:37.369 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.118932389, 2023-09-30T17:04:37.369 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.369 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.369 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.369 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.369 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.369 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179196 2023-09-30T17:04:37.369 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.369 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.369 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.370 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.370 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.796636+0000", 2023-09-30T17:04:37.370 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.370 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.370 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.370 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.370 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.796636+0000", 2023-09-30T17:04:37.370 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.370 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.371 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.371 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.796637+0000", 2023-09-30T17:04:37.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3499999999999996e-07 2023-09-30T17:04:37.371 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.371 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.371 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.371 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.796652+0000", 2023-09-30T17:04:37.371 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5461999999999999e-05 2023-09-30T17:04:37.371 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.372 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.372 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.372 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.796662+0000", 2023-09-30T17:04:37.372 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6649999999999998e-06 2023-09-30T17:04:37.372 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.372 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.372 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.372 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.796668+0000", 2023-09-30T17:04:37.372 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6599999999999998e-06 2023-09-30T17:04:37.372 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.372 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.373 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.373 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.373 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.373 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179282 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.373 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.822601+0000", 2023-09-30T17:04:37.373 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.088213932999999994, 2023-09-30T17:04:37.373 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.093016380999999995, 2023-09-30T17:04:37.373 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.373 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.374 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.374 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.374 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.374 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179282 2023-09-30T17:04:37.374 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.374 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.374 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.409 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.410 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.822601+0000", 2023-09-30T17:04:37.410 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.410 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.410 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.410 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.410 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.822601+0000", 2023-09-30T17:04:37.410 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.410 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.411 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.411 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.411 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.822601+0000", 2023-09-30T17:04:37.411 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9299999999999999e-07 2023-09-30T17:04:37.411 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.411 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.411 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.411 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.822625+0000", 2023-09-30T17:04:37.411 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3836e-05 2023-09-30T17:04:37.412 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.412 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.412 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.412 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.822632+0000", 2023-09-30T17:04:37.412 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5750000000000003e-06 2023-09-30T17:04:37.412 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.412 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.412 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.412 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.822638+0000", 2023-09-30T17:04:37.412 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2109999999999997e-06 2023-09-30T17:04:37.413 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.413 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.413 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.413 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.413 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.413 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179314 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.413 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.837583+0000", 2023-09-30T17:04:37.413 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.073231619999999997, 2023-09-30T17:04:37.413 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.078093443999999998, 2023-09-30T17:04:37.413 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.414 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.414 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.414 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.414 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.414 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179314 2023-09-30T17:04:37.414 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.414 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.414 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.414 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.414 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.837583+0000", 2023-09-30T17:04:37.415 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.415 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.415 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.415 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.415 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.837583+0000", 2023-09-30T17:04:37.415 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.415 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.415 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.415 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.415 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.837583+0000", 2023-09-30T17:04:37.415 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.32e-07 2023-09-30T17:04:37.416 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.416 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.416 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.416 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.837596+0000", 2023-09-30T17:04:37.416 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2271e-05 2023-09-30T17:04:37.416 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.416 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.416 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.416 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.837602+0000", 2023-09-30T17:04:37.416 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3269999999999997e-06 2023-09-30T17:04:37.417 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.417 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.417 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.417 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.837607+0000", 2023-09-30T17:04:37.417 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0839999999999999e-06 2023-09-30T17:04:37.417 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.417 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.417 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.417 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.417 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.417 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:177793 4.36 e58/17)", 2023-09-30T17:04:37.417 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.862152+0000", 2023-09-30T17:04:37.418 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.048662931, 2023-09-30T17:04:37.418 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.053590498, 2023-09-30T17:04:37.418 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.419 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.419 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.419 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.419 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.419 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.862152+0000", 2023-09-30T17:04:37.419 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.419 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.419 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.420 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.420 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.862152+0000", 2023-09-30T17:04:37.420 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.420 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.420 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.420 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.420 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.862152+0000", 2023-09-30T17:04:37.420 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5299999999999999e-07 2023-09-30T17:04:37.420 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.420 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.420 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.421 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.862163+0000", 2023-09-30T17:04:37.421 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0845999999999999e-05 2023-09-30T17:04:37.421 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.421 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.421 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.421 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.862171+0000", 2023-09-30T17:04:37.421 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2930000000000001e-06 2023-09-30T17:04:37.421 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.421 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.421 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.421 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.862176+0000", 2023-09-30T17:04:37.421 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0830000000000003e-06 2023-09-30T17:04:37.422 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.422 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.422 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.422 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.422 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.422 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:177625 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.422 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.225567+0000", 2023-09-30T17:04:37.422 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.685247999, 2023-09-30T17:04:37.422 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.69023463399999996, 2023-09-30T17:04:37.422 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.425 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.426 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.426 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.426 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.426 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 177625 2023-09-30T17:04:37.426 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.426 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.426 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.426 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.427 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.225567+0000", 2023-09-30T17:04:37.427 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.427 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.427 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.427 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.428 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.225567+0000", 2023-09-30T17:04:37.428 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.428 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.428 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.428 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.428 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.225567+0000", 2023-09-30T17:04:37.428 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1200000000000003e-07 2023-09-30T17:04:37.428 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.428 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.428 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.428 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.225581+0000", 2023-09-30T17:04:37.428 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3525e-05 2023-09-30T17:04:37.429 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.429 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.429 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.429 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.225588+0000", 2023-09-30T17:04:37.429 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0700000000000001e-06 2023-09-30T17:04:37.429 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.429 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.429 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.429 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.225593+0000", 2023-09-30T17:04:37.429 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3959999999999997e-06 2023-09-30T17:04:37.429 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.430 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.430 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.430 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.430 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.430 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:177773 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.430 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.270706+0000", 2023-09-30T17:04:37.430 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.64010849199999997, 2023-09-30T17:04:37.430 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.64515986999999997, 2023-09-30T17:04:37.430 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.431 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.431 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.431 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.431 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.431 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 177773 2023-09-30T17:04:37.431 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.432 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.432 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.432 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.432 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.270706+0000", 2023-09-30T17:04:37.432 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.432 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.432 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.432 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.432 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.270706+0000", 2023-09-30T17:04:37.432 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.432 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.433 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.433 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.433 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.270707+0000", 2023-09-30T17:04:37.433 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2e-07 2023-09-30T17:04:37.433 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.433 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.433 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.433 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.270716+0000", 2023-09-30T17:04:37.433 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2969999999999992e-06 2023-09-30T17:04:37.433 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.433 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.433 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.434 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.270723+0000", 2023-09-30T17:04:37.434 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9609999999999999e-06 2023-09-30T17:04:37.434 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.434 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.434 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.434 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.270728+0000", 2023-09-30T17:04:37.434 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8910000000000003e-06 2023-09-30T17:04:37.434 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.434 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.434 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.435 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.435 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.435 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:177952 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.435 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.315867+0000", 2023-09-30T17:04:37.435 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.59494745299999996, 2023-09-30T17:04:37.435 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.60006473400000004, 2023-09-30T17:04:37.435 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.435 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.435 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.435 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.435 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.435 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 177952 2023-09-30T17:04:37.436 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.436 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.436 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.436 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.436 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.315867+0000", 2023-09-30T17:04:37.436 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.436 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.436 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.436 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.436 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.315867+0000", 2023-09-30T17:04:37.436 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.436 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.437 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.437 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.437 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.315867+0000", 2023-09-30T17:04:37.437 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6100000000000002e-07 2023-09-30T17:04:37.437 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.437 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.437 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.437 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.315880+0000", 2023-09-30T17:04:37.437 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2763e-05 2023-09-30T17:04:37.437 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.437 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.438 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.438 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.315886+0000", 2023-09-30T17:04:37.438 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6280000000000002e-06 2023-09-30T17:04:37.438 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.438 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.438 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.438 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.315890+0000", 2023-09-30T17:04:37.438 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4680000000000003e-06 2023-09-30T17:04:37.438 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.438 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.438 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.438 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.439 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.439 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178305 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.439 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.464721+0000", 2023-09-30T17:04:37.439 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.44609385499999998, 2023-09-30T17:04:37.439 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.45127070600000002, 2023-09-30T17:04:37.439 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.439 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.439 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.439 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.440 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.440 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178305 2023-09-30T17:04:37.440 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.440 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.440 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.441 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.441 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.464721+0000", 2023-09-30T17:04:37.441 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.441 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.441 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.441 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.441 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.464721+0000", 2023-09-30T17:04:37.441 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.441 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.441 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.441 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.441 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.464721+0000", 2023-09-30T17:04:37.442 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.08e-07 2023-09-30T17:04:37.442 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.442 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.442 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.442 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.464739+0000", 2023-09-30T17:04:37.442 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8102e-05 2023-09-30T17:04:37.442 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.442 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.442 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.442 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.464746+0000", 2023-09-30T17:04:37.442 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7769999999999997e-06 2023-09-30T17:04:37.442 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.443 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.443 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.464752+0000", 2023-09-30T17:04:37.443 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1140000000000002e-06 2023-09-30T17:04:37.443 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.443 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.443 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.443 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.443 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.443 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178414 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.444 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.510645+0000", 2023-09-30T17:04:37.444 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.400169948, 2023-09-30T17:04:37.444 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.405410667, 2023-09-30T17:04:37.444 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.444 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.444 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.444 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.444 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.444 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178414 2023-09-30T17:04:37.444 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.444 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.444 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.445 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.445 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.510645+0000", 2023-09-30T17:04:37.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.445 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.445 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.445 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.445 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.510645+0000", 2023-09-30T17:04:37.445 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.445 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.445 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.445 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.445 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.512514+0000", 2023-09-30T17:04:37.446 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0018694269999999999 2023-09-30T17:04:37.446 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.446 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.446 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.446 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.512524+0000", 2023-09-30T17:04:37.446 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0409e-05 2023-09-30T17:04:37.446 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.446 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.446 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.446 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.512532+0000", 2023-09-30T17:04:37.446 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3209999999999999e-06 2023-09-30T17:04:37.446 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.447 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.447 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.512537+0000", 2023-09-30T17:04:37.447 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7600000000000002e-06 2023-09-30T17:04:37.447 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.447 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.447 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.447 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.447 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.447 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178777 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.447 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.642565+0000", 2023-09-30T17:04:37.447 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.26824921699999998, 2023-09-30T17:04:37.448 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.27355047700000001, 2023-09-30T17:04:37.448 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.448 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.448 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.448 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.448 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.448 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178777 2023-09-30T17:04:37.448 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.448 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.448 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.448 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.448 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.642565+0000", 2023-09-30T17:04:37.449 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.449 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.449 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.449 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.460 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.642565+0000", 2023-09-30T17:04:37.460 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.460 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.461 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.461 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.461 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.642566+0000", 2023-09-30T17:04:37.461 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6000000000000003e-07 2023-09-30T17:04:37.461 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.461 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.461 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.461 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.642579+0000", 2023-09-30T17:04:37.461 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2571e-05 2023-09-30T17:04:37.461 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.461 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.462 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.462 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.642586+0000", 2023-09-30T17:04:37.462 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3679999999999996e-06 2023-09-30T17:04:37.464 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.464 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.464 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.464 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.642592+0000", 2023-09-30T17:04:37.464 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.913e-06 2023-09-30T17:04:37.464 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.464 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.464 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.464 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.464 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.465 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178815 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.465 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.652570+0000", 2023-09-30T17:04:37.465 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.25824497099999999, 2023-09-30T17:04:37.465 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.263600375, 2023-09-30T17:04:37.465 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.465 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.465 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.465 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.466 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.466 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178815 2023-09-30T17:04:37.466 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.466 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.466 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.466 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.466 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.652570+0000", 2023-09-30T17:04:37.466 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.466 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.466 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.467 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.467 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.652570+0000", 2023-09-30T17:04:37.467 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.467 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.467 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.467 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.467 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.652570+0000", 2023-09-30T17:04:37.468 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7399999999999999e-07 2023-09-30T17:04:37.468 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.468 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.468 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.468 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.652583+0000", 2023-09-30T17:04:37.468 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2605e-05 2023-09-30T17:04:37.468 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.468 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.468 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.468 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.652594+0000", 2023-09-30T17:04:37.468 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1199999999999999e-05 2023-09-30T17:04:37.469 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.469 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.469 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.469 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.652600+0000", 2023-09-30T17:04:37.469 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7150000000000001e-06 2023-09-30T17:04:37.469 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.469 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.469 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.469 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.469 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.469 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178909 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.470 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.685803+0000", 2023-09-30T17:04:37.470 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.22501148500000001, 2023-09-30T17:04:37.470 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.230423506, 2023-09-30T17:04:37.470 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.470 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.470 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.470 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.470 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.470 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178909 2023-09-30T17:04:37.479 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.479 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.479 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.479 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.479 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.685803+0000", 2023-09-30T17:04:37.479 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.479 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.479 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.479 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.479 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.685803+0000", 2023-09-30T17:04:37.479 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.480 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.480 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.685803+0000", 2023-09-30T17:04:37.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6800000000000001e-07 2023-09-30T17:04:37.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.480 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.480 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.480 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.685817+0000", 2023-09-30T17:04:37.480 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3438000000000001e-05 2023-09-30T17:04:37.480 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.481 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.481 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.481 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.685824+0000", 2023-09-30T17:04:37.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5310000000000004e-06 2023-09-30T17:04:37.481 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.481 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.481 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.481 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.685830+0000", 2023-09-30T17:04:37.481 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6119999999999998e-06 2023-09-30T17:04:37.481 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.481 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.482 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.482 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.482 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.482 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179416 4.12 4:4be51a30:::100000001f8.0000000b:head [write 3162112~4096 in=4096b,write 3178496~4096 in=4096b,write 3194880~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.482 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.893353+0000", 2023-09-30T17:04:37.482 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.017461198000000001, 2023-09-30T17:04:37.482 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022932327999999998, 2023-09-30T17:04:37.482 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.482 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:37.482 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.483 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.483 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.483 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179416 2023-09-30T17:04:37.483 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.483 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.483 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.483 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.483 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.893353+0000", 2023-09-30T17:04:37.483 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.483 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.483 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.484 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.484 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.893353+0000", 2023-09-30T17:04:37.484 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.484 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.484 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.484 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.484 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.898526+0000", 2023-09-30T17:04:37.484 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0051731140000000004 2023-09-30T17:04:37.484 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.484 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.484 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.485 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.898550+0000", 2023-09-30T17:04:37.485 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3164999999999999e-05 2023-09-30T17:04:37.485 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.485 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.485 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.485 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.898561+0000", 2023-09-30T17:04:37.485 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1724e-05 2023-09-30T17:04:37.485 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.485 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.485 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.485 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.898569+0000", 2023-09-30T17:04:37.486 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7989999999999994e-06 2023-09-30T17:04:37.486 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.486 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.486 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:37.486 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.905308+0000", 2023-09-30T17:04:37.486 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0067391009999999999 2023-09-30T17:04:37.486 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.486 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.486 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:37.486 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.905386+0000", 2023-09-30T17:04:37.486 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7558000000000005e-05 2023-09-30T17:04:37.486 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.487 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.487 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:37.487 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.905483+0000", 2023-09-30T17:04:37.487 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7616999999999997e-05 2023-09-30T17:04:37.487 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.487 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.487 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:37.487 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.915401+0000", 2023-09-30T17:04:37.487 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0099177970000000008 2023-09-30T17:04:37.487 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.487 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.488 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.488 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.488 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.488 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:177977 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.488 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.326636+0000", 2023-09-30T17:04:37.488 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.584178576, 2023-09-30T17:04:37.488 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.58972649499999996, 2023-09-30T17:04:37.488 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.488 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.488 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.488 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.489 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.489 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 177977 2023-09-30T17:04:37.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.489 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.489 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.489 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.326636+0000", 2023-09-30T17:04:37.489 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.489 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.489 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.489 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.490 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.326636+0000", 2023-09-30T17:04:37.490 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.490 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.490 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.490 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.490 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.328515+0000", 2023-09-30T17:04:37.490 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001879052 2023-09-30T17:04:37.490 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.490 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.490 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.490 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.328535+0000", 2023-09-30T17:04:37.490 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0302e-05 2023-09-30T17:04:37.491 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.491 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.491 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.491 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.328547+0000", 2023-09-30T17:04:37.491 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1209000000000001e-05 2023-09-30T17:04:37.491 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.491 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.491 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.491 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.328553+0000", 2023-09-30T17:04:37.491 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6189999999999996e-06 2023-09-30T17:04:37.492 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.492 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.492 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.492 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.492 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.492 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178592 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.492 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.581605+0000", 2023-09-30T17:04:37.492 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.32920970900000002, 2023-09-30T17:04:37.492 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.33481221100000003, 2023-09-30T17:04:37.492 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.492 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.492 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.493 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.493 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.493 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178592 2023-09-30T17:04:37.493 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.493 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.493 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.493 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.493 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.581605+0000", 2023-09-30T17:04:37.493 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.493 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.493 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.494 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.494 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.581605+0000", 2023-09-30T17:04:37.494 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.494 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.494 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.494 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.494 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.583517+0000", 2023-09-30T17:04:37.494 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001912632 2023-09-30T17:04:37.494 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.494 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.516 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.516 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.583534+0000", 2023-09-30T17:04:37.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6500000000000001e-05 2023-09-30T17:04:37.517 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.517 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.517 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.583544+0000", 2023-09-30T17:04:37.517 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.005e-05 2023-09-30T17:04:37.517 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.517 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.517 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.517 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.583552+0000", 2023-09-30T17:04:37.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4630000000000004e-06 2023-09-30T17:04:37.518 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.518 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.518 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.518 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.518 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.518 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178624 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.518 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.595596+0000", 2023-09-30T17:04:37.518 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.31521868600000003, 2023-09-30T17:04:37.518 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.32087586499999998, 2023-09-30T17:04:37.519 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.519 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.519 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.519 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.519 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.519 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178624 2023-09-30T17:04:37.519 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.519 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.519 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.519 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.519 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.595596+0000", 2023-09-30T17:04:37.520 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.520 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.520 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.520 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.520 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.595596+0000", 2023-09-30T17:04:37.520 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.521 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.521 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.521 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.521 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.597515+0000", 2023-09-30T17:04:37.521 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019192429999999999 2023-09-30T17:04:37.521 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.522 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.522 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.597530+0000", 2023-09-30T17:04:37.522 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.451e-05 2023-09-30T17:04:37.522 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.522 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.522 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.522 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.597539+0000", 2023-09-30T17:04:37.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9390000000000003e-06 2023-09-30T17:04:37.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.523 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.523 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.523 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.597544+0000", 2023-09-30T17:04:37.523 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3929999999999999e-06 2023-09-30T17:04:37.523 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.523 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.523 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.523 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.524 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.524 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178869 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.524 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.673631+0000", 2023-09-30T17:04:37.524 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.237183539, 2023-09-30T17:04:37.524 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.242900169, 2023-09-30T17:04:37.524 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.524 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.524 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.524 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.524 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.524 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178869 2023-09-30T17:04:37.525 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.525 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.525 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.525 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.525 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.673631+0000", 2023-09-30T17:04:37.525 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.525 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.561 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.561 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.561 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.673631+0000", 2023-09-30T17:04:37.561 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.561 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.561 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.561 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.562 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.675517+0000", 2023-09-30T17:04:37.562 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001885769 2023-09-30T17:04:37.562 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.562 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.562 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.562 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.675536+0000", 2023-09-30T17:04:37.563 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9491e-05 2023-09-30T17:04:37.563 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.563 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.563 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.563 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.675546+0000", 2023-09-30T17:04:37.563 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9499999999999996e-06 2023-09-30T17:04:37.563 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.563 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.563 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.563 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.675554+0000", 2023-09-30T17:04:37.563 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8970000000000008e-06 2023-09-30T17:04:37.563 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.564 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.564 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.564 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.564 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.564 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179417 4.29 4:94178d8a:::100000001f8.00000006:head [write 180224~4096 in=4096b,write 237568~4096 in=4096b,write 286720~4096 in=4096b,write 327680~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.564 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.898583+0000", 2023-09-30T17:04:37.564 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.012231855999999999, 2023-09-30T17:04:37.564 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018010973, 2023-09-30T17:04:37.565 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.565 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:37.565 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.565 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.565 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.565 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179417 2023-09-30T17:04:37.565 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.565 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.565 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.566 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.566 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.898583+0000", 2023-09-30T17:04:37.566 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.566 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.566 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.566 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.566 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.898583+0000", 2023-09-30T17:04:37.566 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.566 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.567 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.567 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.567 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.898583+0000", 2023-09-30T17:04:37.567 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0100000000000004e-07 2023-09-30T17:04:37.567 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.567 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.567 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.567 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.898602+0000", 2023-09-30T17:04:37.567 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8374000000000001e-05 2023-09-30T17:04:37.567 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.568 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.568 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.568 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.898615+0000", 2023-09-30T17:04:37.568 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3393e-05 2023-09-30T17:04:37.568 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.568 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.568 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.568 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.898621+0000", 2023-09-30T17:04:37.569 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.767e-06 2023-09-30T17:04:37.569 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.569 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.569 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:37.569 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.898660+0000", 2023-09-30T17:04:37.569 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8578999999999998e-05 2023-09-30T17:04:37.569 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.569 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.569 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:37.570 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.898728+0000", 2023-09-30T17:04:37.570 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8029999999999997e-05 2023-09-30T17:04:37.570 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.570 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.570 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.570 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.570 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.570 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:177778 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.570 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.272580+0000", 2023-09-30T17:04:37.571 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.63823477200000001, 2023-09-30T17:04:37.571 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.644080659, 2023-09-30T17:04:37.571 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.571 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.571 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.574 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.574 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.574 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 177778 2023-09-30T17:04:37.574 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.574 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.574 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.575 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.575 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.272580+0000", 2023-09-30T17:04:37.575 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.575 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.575 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.575 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.575 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.272580+0000", 2023-09-30T17:04:37.575 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.575 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.576 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.576 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.576 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.272580+0000", 2023-09-30T17:04:37.576 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0500000000000003e-07 2023-09-30T17:04:37.576 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.576 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.576 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.576 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.272591+0000", 2023-09-30T17:04:37.576 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0638999999999999e-05 2023-09-30T17:04:37.576 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.576 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.577 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.577 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.272596+0000", 2023-09-30T17:04:37.577 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0869999999999997e-06 2023-09-30T17:04:37.577 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.577 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.577 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.577 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.272601+0000", 2023-09-30T17:04:37.577 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3480000000000003e-06 2023-09-30T17:04:37.577 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.577 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.578 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.578 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.578 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.578 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:177907 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.578 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.298977+0000", 2023-09-30T17:04:37.578 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.61183733399999995, 2023-09-30T17:04:37.578 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.61773557700000004, 2023-09-30T17:04:37.578 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.578 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.579 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.579 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.579 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.579 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 177907 2023-09-30T17:04:37.579 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.579 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.579 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.579 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.579 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.298977+0000", 2023-09-30T17:04:37.579 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.579 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.580 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.580 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.580 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.298977+0000", 2023-09-30T17:04:37.580 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.580 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.580 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.580 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.580 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.303677+0000", 2023-09-30T17:04:37.580 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0046997159999999996 2023-09-30T17:04:37.581 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.582 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.582 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.582 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.303694+0000", 2023-09-30T17:04:37.582 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6948000000000001e-05 2023-09-30T17:04:37.582 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.582 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.582 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.582 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.303701+0000", 2023-09-30T17:04:37.582 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2830000000000004e-06 2023-09-30T17:04:37.582 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.583 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.583 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.583 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.303708+0000", 2023-09-30T17:04:37.583 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6109999999999999e-06 2023-09-30T17:04:37.583 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.583 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.583 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.583 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.583 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.583 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178182 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.584 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.406615+0000", 2023-09-30T17:04:37.584 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.50419998899999996, 2023-09-30T17:04:37.584 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.51015011300000002, 2023-09-30T17:04:37.584 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.584 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.584 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.584 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.584 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.584 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178182 2023-09-30T17:04:37.585 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.585 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.585 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.585 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.585 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.406615+0000", 2023-09-30T17:04:37.585 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.585 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.585 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.585 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.585 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.406615+0000", 2023-09-30T17:04:37.585 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.585 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.586 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.586 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.586 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.406615+0000", 2023-09-30T17:04:37.586 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2e-07 2023-09-30T17:04:37.586 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.586 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.586 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.586 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.406624+0000", 2023-09-30T17:04:37.586 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0699999999999996e-06 2023-09-30T17:04:37.586 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.586 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.589 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.589 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.406630+0000", 2023-09-30T17:04:37.589 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9000000000000003e-06 2023-09-30T17:04:37.589 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.589 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.589 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.589 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.406634+0000", 2023-09-30T17:04:37.589 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.481e-06 2023-09-30T17:04:37.589 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.590 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.590 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.590 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.590 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.590 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178345 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.590 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.466591+0000", 2023-09-30T17:04:37.590 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.444223531, 2023-09-30T17:04:37.590 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.450230346, 2023-09-30T17:04:37.590 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.590 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.590 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.591 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.591 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.591 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178345 2023-09-30T17:04:37.591 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.591 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.591 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.591 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.591 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.466591+0000", 2023-09-30T17:04:37.591 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.591 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.591 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.592 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.592 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.466591+0000", 2023-09-30T17:04:37.592 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.592 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.592 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.592 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.592 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.468624+0000", 2023-09-30T17:04:37.592 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0020333199999999999 2023-09-30T17:04:37.592 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.592 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.592 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.592 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.468638+0000", 2023-09-30T17:04:37.593 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3414000000000001e-05 2023-09-30T17:04:37.593 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.593 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.593 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.593 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.468647+0000", 2023-09-30T17:04:37.593 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5370000000000003e-06 2023-09-30T17:04:37.593 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.593 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.593 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.593 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.468653+0000", 2023-09-30T17:04:37.593 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1419999999999998e-06 2023-09-30T17:04:37.594 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.594 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.594 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.594 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.594 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.594 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179249 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.594 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.804980+0000", 2023-09-30T17:04:37.594 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.10583424900000001, 2023-09-30T17:04:37.594 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.111893279, 2023-09-30T17:04:37.594 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.594 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.595 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.595 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.595 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.595 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179249 2023-09-30T17:04:37.595 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.595 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.595 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.595 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.595 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.804980+0000", 2023-09-30T17:04:37.595 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.596 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.596 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.596 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.596 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.804980+0000", 2023-09-30T17:04:37.596 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.596 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.596 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.596 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.597 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.809455+0000", 2023-09-30T17:04:37.597 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00447423 2023-09-30T17:04:37.597 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.597 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.597 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.597 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.809471+0000", 2023-09-30T17:04:37.597 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6858999999999999e-05 2023-09-30T17:04:37.597 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.597 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.597 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.598 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.809479+0000", 2023-09-30T17:04:37.598 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8029999999999997e-06 2023-09-30T17:04:37.598 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.598 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.598 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.598 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.809485+0000", 2023-09-30T17:04:37.598 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6420000000000004e-06 2023-09-30T17:04:37.598 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.598 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.598 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.599 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.599 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.599 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:177709 4.6 e58/17 4:63e80496:::100000001f8.0000001e:head v 58'10962, mlcod=58'10950)", 2023-09-30T17:04:37.599 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.837845+0000", 2023-09-30T17:04:37.599 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.072969424000000005, 2023-09-30T17:04:37.599 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.079083874999999998, 2023-09-30T17:04:37.599 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.599 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:37.599 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.600 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.600 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.600 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.837845+0000", 2023-09-30T17:04:37.600 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.600 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.600 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.600 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.600 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.837845+0000", 2023-09-30T17:04:37.600 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.600 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.600 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.601 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.601 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.837845+0000", 2023-09-30T17:04:37.601 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.91e-07 2023-09-30T17:04:37.601 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.601 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.601 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.601 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.837864+0000", 2023-09-30T17:04:37.601 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8179999999999999e-05 2023-09-30T17:04:37.601 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.602 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.602 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.602 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.837871+0000", 2023-09-30T17:04:37.602 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9140000000000002e-06 2023-09-30T17:04:37.602 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.602 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.602 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.602 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.837876+0000", 2023-09-30T17:04:37.602 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3199999999999999e-06 2023-09-30T17:04:37.602 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.603 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.603 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:37.603 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.899017+0000", 2023-09-30T17:04:37.603 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.061141596999999999 2023-09-30T17:04:37.603 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.603 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.603 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:37.603 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.899037+0000", 2023-09-30T17:04:37.603 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9996999999999998e-05 2023-09-30T17:04:37.604 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.604 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.604 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.604 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.604 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.604 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:177816 4.6 e58/17)", 2023-09-30T17:04:37.604 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.882422+0000", 2023-09-30T17:04:37.604 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.028392377, 2023-09-30T17:04:37.604 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.034562548999999998, 2023-09-30T17:04:37.604 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.605 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.605 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.605 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.605 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.605 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.882422+0000", 2023-09-30T17:04:37.605 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.605 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.605 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.605 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.605 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.882422+0000", 2023-09-30T17:04:37.606 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.606 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.606 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.606 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.606 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.882423+0000", 2023-09-30T17:04:37.606 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8100000000000003e-07 2023-09-30T17:04:37.606 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.606 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.606 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.606 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.882435+0000", 2023-09-30T17:04:37.607 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2462e-05 2023-09-30T17:04:37.607 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.607 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.607 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.607 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.882446+0000", 2023-09-30T17:04:37.607 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1263999999999999e-05 2023-09-30T17:04:37.607 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.607 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.607 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.607 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.882453+0000", 2023-09-30T17:04:37.607 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2700000000000001e-06 2023-09-30T17:04:37.608 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.608 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.608 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.608 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.608 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.608 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179419 4.35 4:ad9a5eb7:::100000001f8.00000023:head [write 2134016~4096 in=4096b,write 2383872~4096 in=4096b,write 2469888~8192 in=8192b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.608 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.898635+0000", 2023-09-30T17:04:37.608 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.012180046999999999, 2023-09-30T17:04:37.608 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018404086, 2023-09-30T17:04:37.608 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.608 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:37.609 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.609 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.609 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.609 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179419 2023-09-30T17:04:37.609 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.609 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.615 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.616 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.616 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.898635+0000", 2023-09-30T17:04:37.616 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.616 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.616 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.616 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.616 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.898635+0000", 2023-09-30T17:04:37.616 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.616 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.616 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.617 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.617 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.898635+0000", 2023-09-30T17:04:37.617 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1600000000000001e-07 2023-09-30T17:04:37.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.617 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.617 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.617 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.898658+0000", 2023-09-30T17:04:37.617 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2864e-05 2023-09-30T17:04:37.617 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.617 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.617 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.618 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.898666+0000", 2023-09-30T17:04:37.618 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8860000000000004e-06 2023-09-30T17:04:37.618 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.618 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.618 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.618 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.898672+0000", 2023-09-30T17:04:37.618 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4189999999999999e-06 2023-09-30T17:04:37.618 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.619 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.619 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:37.619 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.909134+0000", 2023-09-30T17:04:37.619 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010461753000000001 2023-09-30T17:04:37.619 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.619 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.619 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:37.619 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.909234+0000", 2023-09-30T17:04:37.619 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010039600000000001 2023-09-30T17:04:37.619 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.619 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.619 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.620 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.620 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.620 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:177780 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.620 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.272607+0000", 2023-09-30T17:04:37.620 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.63820708199999998, 2023-09-30T17:04:37.620 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.644495123, 2023-09-30T17:04:37.620 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.620 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.620 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.620 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.621 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.621 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 177780 2023-09-30T17:04:37.621 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.621 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.621 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.621 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.621 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.272607+0000", 2023-09-30T17:04:37.621 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.621 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.621 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.622 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.622 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.272607+0000", 2023-09-30T17:04:37.622 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.622 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.622 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.622 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.622 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.272608+0000", 2023-09-30T17:04:37.622 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7000000000000001e-07 2023-09-30T17:04:37.622 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.622 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.622 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.623 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.272633+0000", 2023-09-30T17:04:37.623 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5629000000000001e-05 2023-09-30T17:04:37.623 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.623 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.623 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.623 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.272643+0000", 2023-09-30T17:04:37.623 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6549999999999999e-06 2023-09-30T17:04:37.623 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.623 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.623 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.623 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.272649+0000", 2023-09-30T17:04:37.624 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0589999999999999e-06 2023-09-30T17:04:37.624 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.624 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.624 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.624 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.624 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.624 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178215 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.624 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.425632+0000", 2023-09-30T17:04:37.624 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.48518261699999998, 2023-09-30T17:04:37.624 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.49152623200000001, 2023-09-30T17:04:37.624 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.625 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.625 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.625 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.625 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.625 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178215 2023-09-30T17:04:37.625 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.625 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.625 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.625 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.625 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.425632+0000", 2023-09-30T17:04:37.626 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.626 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.626 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.626 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.626 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.425632+0000", 2023-09-30T17:04:37.626 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.626 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.626 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.626 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.626 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.425632+0000", 2023-09-30T17:04:37.626 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1399999999999997e-07 2023-09-30T17:04:37.627 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.627 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.627 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.627 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.425642+0000", 2023-09-30T17:04:37.627 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2010000000000005e-06 2023-09-30T17:04:37.627 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.627 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.627 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.627 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.425645+0000", 2023-09-30T17:04:37.627 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7450000000000001e-06 2023-09-30T17:04:37.627 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.627 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.628 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.628 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.425649+0000", 2023-09-30T17:04:37.628 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1920000000000001e-06 2023-09-30T17:04:37.628 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.628 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.628 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.628 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.628 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.628 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178415 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.628 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.512543+0000", 2023-09-30T17:04:37.628 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.39827130399999999, 2023-09-30T17:04:37.629 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.40466848700000002, 2023-09-30T17:04:37.629 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.629 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.629 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.629 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.629 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.629 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178415 2023-09-30T17:04:37.629 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.629 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.629 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.630 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.512543+0000", 2023-09-30T17:04:37.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.630 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.630 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.512543+0000", 2023-09-30T17:04:37.630 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.630 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.630 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.630 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.631 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.516516+0000", 2023-09-30T17:04:37.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039728250000000001 2023-09-30T17:04:37.631 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.631 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.631 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.631 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.516530+0000", 2023-09-30T17:04:37.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4222e-05 2023-09-30T17:04:37.631 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.631 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.631 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.631 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.516541+0000", 2023-09-30T17:04:37.631 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0611000000000001e-05 2023-09-30T17:04:37.632 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.632 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.632 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.632 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.516550+0000", 2023-09-30T17:04:37.632 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5049999999999996e-06 2023-09-30T17:04:37.632 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.632 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.632 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.632 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.632 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.632 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178741 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.633 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.630399+0000", 2023-09-30T17:04:37.633 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.28041545099999998, 2023-09-30T17:04:37.633 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.28686870799999997, 2023-09-30T17:04:37.633 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.633 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.633 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.633 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.633 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.633 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178741 2023-09-30T17:04:37.633 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.634 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.634 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.634 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.630399+0000", 2023-09-30T17:04:37.634 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.634 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.634 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.634 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.634 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.630399+0000", 2023-09-30T17:04:37.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.630400+0000", 2023-09-30T17:04:37.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4399999999999999e-07 2023-09-30T17:04:37.635 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.635 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.635 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.635 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.630414+0000", 2023-09-30T17:04:37.635 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4144e-05 2023-09-30T17:04:37.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.630425+0000", 2023-09-30T17:04:37.636 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1457999999999999e-05 2023-09-30T17:04:37.636 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.636 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.636 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.636 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.630434+0000", 2023-09-30T17:04:37.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1049999999999995e-06 2023-09-30T17:04:37.637 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.637 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.637 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.637 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.637 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.637 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179252 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.637 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.809494+0000", 2023-09-30T17:04:37.637 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.10132052900000001, 2023-09-30T17:04:37.637 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.10782610300000001, 2023-09-30T17:04:37.638 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.638 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.638 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.638 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.638 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.638 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179252 2023-09-30T17:04:37.638 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.638 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.638 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.638 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.809494+0000", 2023-09-30T17:04:37.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.639 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.639 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.639 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.809494+0000", 2023-09-30T17:04:37.639 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.639 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.809495+0000", 2023-09-30T17:04:37.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7100000000000002e-07 2023-09-30T17:04:37.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.640 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.640 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.640 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.809507+0000", 2023-09-30T17:04:37.640 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2233e-05 2023-09-30T17:04:37.640 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.641 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.809518+0000", 2023-09-30T17:04:37.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0767e-05 2023-09-30T17:04:37.641 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.641 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.641 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.641 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.809523+0000", 2023-09-30T17:04:37.641 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0209999999999999e-06 2023-09-30T17:04:37.642 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.642 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.642 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.642 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.642 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.642 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179317 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.642 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.837614+0000", 2023-09-30T17:04:37.643 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.073200689999999999, 2023-09-30T17:04:37.643 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.079760162999999995, 2023-09-30T17:04:37.643 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.643 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.643 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.643 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.643 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.643 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179317 2023-09-30T17:04:37.643 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.644 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.644 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.837614+0000", 2023-09-30T17:04:37.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.644 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.644 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.644 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.644 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.837614+0000", 2023-09-30T17:04:37.644 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.645 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.645 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.645 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.645 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.838517+0000", 2023-09-30T17:04:37.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00090271600000000002 2023-09-30T17:04:37.645 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.645 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.645 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.645 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.838530+0000", 2023-09-30T17:04:37.645 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3706000000000001e-05 2023-09-30T17:04:37.645 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.645 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.646 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.646 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.838541+0000", 2023-09-30T17:04:37.646 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0689999999999999e-05 2023-09-30T17:04:37.646 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.646 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.646 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.646 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.838548+0000", 2023-09-30T17:04:37.646 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0500000000000003e-06 2023-09-30T17:04:37.646 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.646 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.646 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.647 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.647 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:177746 4.36 e58/17 4:6c9c34b1:::100000001f8.00000010:head v 58'8363, mlcod=58'8350)", 2023-09-30T17:04:37.647 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.851578+0000", 2023-09-30T17:04:37.647 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.059236968000000001, 2023-09-30T17:04:37.647 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.065849591999999998, 2023-09-30T17:04:37.647 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.647 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:37.647 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.647 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.648 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.851578+0000", 2023-09-30T17:04:37.648 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.648 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.851578+0000", 2023-09-30T17:04:37.648 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.648 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.648 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.648 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.648 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.851578+0000", 2023-09-30T17:04:37.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3999999999999998e-07 2023-09-30T17:04:37.649 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.649 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.851589+0000", 2023-09-30T17:04:37.649 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0944999999999999e-05 2023-09-30T17:04:37.649 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.649 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.649 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.649 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.851594+0000", 2023-09-30T17:04:37.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5690000000000004e-06 2023-09-30T17:04:37.650 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.650 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.650 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.650 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.851599+0000", 2023-09-30T17:04:37.650 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2889999999999999e-06 2023-09-30T17:04:37.650 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.650 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.650 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:37.651 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.913288+0000", 2023-09-30T17:04:37.651 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.061689343000000001 2023-09-30T17:04:37.651 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.651 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.651 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:37.651 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.913305+0000", 2023-09-30T17:04:37.651 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7024000000000002e-05 2023-09-30T17:04:37.651 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.651 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.651 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.651 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.652 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.652 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179392 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.652 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.881569+0000", 2023-09-30T17:04:37.652 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.029245494, 2023-09-30T17:04:37.652 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.035917306000000003, 2023-09-30T17:04:37.652 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.652 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.652 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.652 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.652 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.653 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179392 2023-09-30T17:04:37.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.653 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.653 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.653 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.881569+0000", 2023-09-30T17:04:37.653 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.653 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.653 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.653 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.881569+0000", 2023-09-30T17:04:37.654 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.654 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.883516+0000", 2023-09-30T17:04:37.654 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001946765 2023-09-30T17:04:37.654 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.654 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.654 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.654 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.883532+0000", 2023-09-30T17:04:37.654 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6008e-05 2023-09-30T17:04:37.655 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.655 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.655 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.655 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.883542+0000", 2023-09-30T17:04:37.655 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0438999999999999e-05 2023-09-30T17:04:37.655 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.655 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.655 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.655 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.883550+0000", 2023-09-30T17:04:37.655 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2910000000000002e-06 2023-09-30T17:04:37.655 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.656 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.656 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.656 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.656 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.656 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:177838 4.2e e58/17)", 2023-09-30T17:04:37.656 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.904543+0000", 2023-09-30T17:04:37.656 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0062712999999999996, 2023-09-30T17:04:37.656 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.013002045, 2023-09-30T17:04:37.656 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.656 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.656 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.657 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.657 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.904543+0000", 2023-09-30T17:04:37.657 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.657 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.657 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.657 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.904543+0000", 2023-09-30T17:04:37.657 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.657 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.657 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.657 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.904544+0000", 2023-09-30T17:04:37.658 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.04e-06 2023-09-30T17:04:37.658 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.904562+0000", 2023-09-30T17:04:37.658 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7295e-05 2023-09-30T17:04:37.658 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.658 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.658 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.658 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.904571+0000", 2023-09-30T17:04:37.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7610000000000002e-06 2023-09-30T17:04:37.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.659 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.659 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.659 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.904578+0000", 2023-09-30T17:04:37.659 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4010000000000002e-06 2023-09-30T17:04:37.659 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.659 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.659 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.659 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.659 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.659 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:177874 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.660 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.292818+0000", 2023-09-30T17:04:37.660 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.61799625700000005, 2023-09-30T17:04:37.660 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.624758653, 2023-09-30T17:04:37.660 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.660 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.660 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.660 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.660 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.660 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 177874 2023-09-30T17:04:37.660 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.661 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.661 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.661 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.661 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.292818+0000", 2023-09-30T17:04:37.661 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.661 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.661 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.661 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.661 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.292818+0000", 2023-09-30T17:04:37.661 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.661 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.661 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.662 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.662 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.292819+0000", 2023-09-30T17:04:37.662 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1500000000000005e-07 2023-09-30T17:04:37.662 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.662 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.662 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.662 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.292831+0000", 2023-09-30T17:04:37.662 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2143999999999999e-05 2023-09-30T17:04:37.662 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.662 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.662 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.663 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.292839+0000", 2023-09-30T17:04:37.663 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7179999999999996e-06 2023-09-30T17:04:37.663 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.663 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.663 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.663 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.292844+0000", 2023-09-30T17:04:37.663 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4450000000000004e-06 2023-09-30T17:04:37.663 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.663 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.663 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.663 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.664 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.664 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178416 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.664 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.516567+0000", 2023-09-30T17:04:37.664 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.39424775099999998, 2023-09-30T17:04:37.664 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.40104261699999999, 2023-09-30T17:04:37.664 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.664 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.664 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.664 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.664 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.664 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178416 2023-09-30T17:04:37.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.665 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.516567+0000", 2023-09-30T17:04:37.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.665 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.665 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.665 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.516567+0000", 2023-09-30T17:04:37.665 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.665 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.666 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.666 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.516567+0000", 2023-09-30T17:04:37.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5099999999999999e-07 2023-09-30T17:04:37.666 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.666 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.666 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.666 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.516580+0000", 2023-09-30T17:04:37.666 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2319e-05 2023-09-30T17:04:37.666 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.516587+0000", 2023-09-30T17:04:37.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5870000000000004e-06 2023-09-30T17:04:37.667 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.667 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.667 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.667 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.516594+0000", 2023-09-30T17:04:37.667 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3940000000000001e-06 2023-09-30T17:04:37.667 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.668 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.668 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.668 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.668 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.668 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178525 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.668 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.553675+0000", 2023-09-30T17:04:37.668 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.35713989899999998, 2023-09-30T17:04:37.668 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.363976089, 2023-09-30T17:04:37.668 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.669 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.669 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.669 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.669 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.669 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178525 2023-09-30T17:04:37.669 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.669 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.669 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.669 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.669 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.553675+0000", 2023-09-30T17:04:37.669 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.670 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.670 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.670 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.670 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.553675+0000", 2023-09-30T17:04:37.670 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.670 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.670 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.670 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.671 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.553675+0000", 2023-09-30T17:04:37.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9800000000000004e-07 2023-09-30T17:04:37.671 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.671 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.671 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.671 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.553689+0000", 2023-09-30T17:04:37.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3461999999999999e-05 2023-09-30T17:04:37.671 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.671 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.671 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.671 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.553696+0000", 2023-09-30T17:04:37.671 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1980000000000004e-06 2023-09-30T17:04:37.672 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.672 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.672 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.672 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.553700+0000", 2023-09-30T17:04:37.672 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6149999999999999e-06 2023-09-30T17:04:37.672 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.672 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.672 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.673 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.673 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.673 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178874 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.673 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.675641+0000", 2023-09-30T17:04:37.673 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.23517407000000001, 2023-09-30T17:04:37.673 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.24207278199999999, 2023-09-30T17:04:37.673 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.673 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.673 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.673 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.674 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.674 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178874 2023-09-30T17:04:37.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.674 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.674 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.674 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.674 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.675641+0000", 2023-09-30T17:04:37.674 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.674 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.675 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.675 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.675641+0000", 2023-09-30T17:04:37.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.675 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.675 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.675641+0000", 2023-09-30T17:04:37.675 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7100000000000002e-07 2023-09-30T17:04:37.675 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.675 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.675651+0000", 2023-09-30T17:04:37.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.8980000000000008e-06 2023-09-30T17:04:37.676 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.676 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.676 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.676 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.675657+0000", 2023-09-30T17:04:37.676 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8089999999999998e-06 2023-09-30T17:04:37.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.677 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.677 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.675661+0000", 2023-09-30T17:04:37.677 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6829999999999999e-06 2023-09-30T17:04:37.677 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.677 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.677 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.677 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.677 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.678 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178914 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.678 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.685905+0000", 2023-09-30T17:04:37.678 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.22490931, 2023-09-30T17:04:37.678 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.23186303599999999, 2023-09-30T17:04:37.678 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.678 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.678 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.678 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.678 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.678 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178914 2023-09-30T17:04:37.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.679 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.679 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.679 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.685905+0000", 2023-09-30T17:04:37.679 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.679 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.679 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.679 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.679 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.685905+0000", 2023-09-30T17:04:37.679 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.680 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.680 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.680 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.687515+0000", 2023-09-30T17:04:37.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001609858 2023-09-30T17:04:37.680 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.680 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.680 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.687529+0000", 2023-09-30T17:04:37.680 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3832000000000001e-05 2023-09-30T17:04:37.680 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.680 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.681 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.681 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.687540+0000", 2023-09-30T17:04:37.681 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1491000000000001e-05 2023-09-30T17:04:37.681 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.681 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.681 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.681 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.687547+0000", 2023-09-30T17:04:37.681 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6889999999999998e-06 2023-09-30T17:04:37.681 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.681 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.681 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.682 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.682 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.682 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179318 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.682 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.838560+0000", 2023-09-30T17:04:37.682 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.072254638999999996, 2023-09-30T17:04:37.682 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.079387092000000006, 2023-09-30T17:04:37.682 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.682 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.682 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.682 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.682 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.682 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179318 2023-09-30T17:04:37.683 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.683 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.683 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.683 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.838560+0000", 2023-09-30T17:04:37.683 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.683 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.683 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.683 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.683 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.838560+0000", 2023-09-30T17:04:37.683 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.683 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.684 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.684 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.838560+0000", 2023-09-30T17:04:37.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.82e-07 2023-09-30T17:04:37.684 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.684 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.684 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.684 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.838572+0000", 2023-09-30T17:04:37.684 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1741e-05 2023-09-30T17:04:37.684 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.685 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.685 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.838579+0000", 2023-09-30T17:04:37.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3829999999999997e-06 2023-09-30T17:04:37.685 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.685 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.685 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.685 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.838584+0000", 2023-09-30T17:04:37.685 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0930000000000002e-06 2023-09-30T17:04:37.685 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.685 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.686 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.686 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.686 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.686 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:177806 4.2e e58/17)", 2023-09-30T17:04:37.686 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.866860+0000", 2023-09-30T17:04:37.686 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.043954359999999998, 2023-09-30T17:04:37.686 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051141493000000003, 2023-09-30T17:04:37.686 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.686 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.686 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.687 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.687 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.687 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.866860+0000", 2023-09-30T17:04:37.687 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.687 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.687 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.687 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.687 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.866860+0000", 2023-09-30T17:04:37.687 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.687 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.688 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.688 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.688 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.866861+0000", 2023-09-30T17:04:37.688 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8899999999999999e-07 2023-09-30T17:04:37.688 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.688 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.688 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.688 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.866879+0000", 2023-09-30T17:04:37.688 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8649999999999999e-05 2023-09-30T17:04:37.688 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.688 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.689 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.689 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.866887+0000", 2023-09-30T17:04:37.689 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8550000000000002e-06 2023-09-30T17:04:37.689 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.689 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.689 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.689 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.866894+0000", 2023-09-30T17:04:37.689 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7560000000000002e-06 2023-09-30T17:04:37.689 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.689 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.689 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.690 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.690 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.690 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:177881 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.690 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.292851+0000", 2023-09-30T17:04:37.690 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.61796362000000005, 2023-09-30T17:04:37.690 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.62520351699999999, 2023-09-30T17:04:37.690 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.690 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.690 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.690 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.691 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.691 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 177881 2023-09-30T17:04:37.691 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.691 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.691 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.691 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.691 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.292851+0000", 2023-09-30T17:04:37.691 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.691 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.691 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.691 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.691 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.292851+0000", 2023-09-30T17:04:37.692 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.692 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.692 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.692 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.692 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.292851+0000", 2023-09-30T17:04:37.692 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0999999999999999e-07 2023-09-30T17:04:37.692 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.692 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.692 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.692 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.292867+0000", 2023-09-30T17:04:37.692 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5064e-05 2023-09-30T17:04:37.692 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.693 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.693 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.693 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.292873+0000", 2023-09-30T17:04:37.693 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6449999999999999e-06 2023-09-30T17:04:37.693 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.693 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.693 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.693 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.292878+0000", 2023-09-30T17:04:37.693 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2109999999999997e-06 2023-09-30T17:04:37.693 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.693 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.694 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.694 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.694 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.694 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178015 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.694 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.338735+0000", 2023-09-30T17:04:37.694 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.57207928200000002, 2023-09-30T17:04:37.694 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.57937751900000001, 2023-09-30T17:04:37.694 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.694 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.694 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.694 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.694 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.695 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178015 2023-09-30T17:04:37.695 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.695 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.695 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.695 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.695 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.338735+0000", 2023-09-30T17:04:37.695 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.695 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.695 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.695 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.695 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.338735+0000", 2023-09-30T17:04:37.696 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.696 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.696 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.696 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.696 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.340711+0000", 2023-09-30T17:04:37.696 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019761520000000001 2023-09-30T17:04:37.696 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.696 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.696 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.696 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.340726+0000", 2023-09-30T17:04:37.696 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4273e-05 2023-09-30T17:04:37.696 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.697 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.697 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.697 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.340733+0000", 2023-09-30T17:04:37.697 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7780000000000007e-06 2023-09-30T17:04:37.697 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.697 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.697 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.697 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.340748+0000", 2023-09-30T17:04:37.697 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4405e-05 2023-09-30T17:04:37.697 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.698 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.698 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.698 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.698 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.698 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178160 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.698 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.391769+0000", 2023-09-30T17:04:37.698 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.51904593300000001, 2023-09-30T17:04:37.698 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.52640621700000001, 2023-09-30T17:04:37.698 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.698 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.698 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.699 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.699 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.699 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178160 2023-09-30T17:04:37.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.699 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.699 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.699 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.391769+0000", 2023-09-30T17:04:37.699 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.699 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.699 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.699 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.700 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.391769+0000", 2023-09-30T17:04:37.700 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.700 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.700 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.700 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.700 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.391769+0000", 2023-09-30T17:04:37.700 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4600000000000001e-07 2023-09-30T17:04:37.700 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.700 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.700 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.700 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.391779+0000", 2023-09-30T17:04:37.700 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9680000000000001e-06 2023-09-30T17:04:37.701 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.701 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.701 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.701 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.391783+0000", 2023-09-30T17:04:37.701 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6229999999999996e-06 2023-09-30T17:04:37.701 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.701 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.701 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.701 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.391786+0000", 2023-09-30T17:04:37.701 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8389999999999998e-06 2023-09-30T17:04:37.701 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.701 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.702 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.702 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.702 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.702 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178316 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.702 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.464920+0000", 2023-09-30T17:04:37.702 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.44589434700000002, 2023-09-30T17:04:37.702 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.45331216400000002, 2023-09-30T17:04:37.702 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.702 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.702 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.702 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.703 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.703 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178316 2023-09-30T17:04:37.703 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.703 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.703 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.703 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.703 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.464920+0000", 2023-09-30T17:04:37.703 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.703 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.703 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.703 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.704 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.464920+0000", 2023-09-30T17:04:37.704 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.704 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.704 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.704 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.704 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.464921+0000", 2023-09-30T17:04:37.704 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1399999999999997e-07 2023-09-30T17:04:37.704 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.704 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.704 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.704 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.464932+0000", 2023-09-30T17:04:37.704 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1433999999999999e-05 2023-09-30T17:04:37.705 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.705 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.705 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.705 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.464939+0000", 2023-09-30T17:04:37.705 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4620000000000001e-06 2023-09-30T17:04:37.709 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.709 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.710 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.710 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.464944+0000", 2023-09-30T17:04:37.710 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4349999999999996e-06 2023-09-30T17:04:37.710 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.710 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.710 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.710 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.710 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.710 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178389 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.710 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.496782+0000", 2023-09-30T17:04:37.711 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.41403211000000001, 2023-09-30T17:04:37.711 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.42151427600000002, 2023-09-30T17:04:37.711 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.711 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.711 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.711 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.711 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.711 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178389 2023-09-30T17:04:37.711 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.711 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.712 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.712 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.712 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.496782+0000", 2023-09-30T17:04:37.712 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.712 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.712 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.712 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.712 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.496782+0000", 2023-09-30T17:04:37.712 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.712 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.713 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.713 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.713 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.496783+0000", 2023-09-30T17:04:37.713 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7800000000000001e-07 2023-09-30T17:04:37.713 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.713 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.713 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.713 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.496800+0000", 2023-09-30T17:04:37.713 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6458999999999999e-05 2023-09-30T17:04:37.713 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.713 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.713 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.714 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.496806+0000", 2023-09-30T17:04:37.714 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4999999999999996e-06 2023-09-30T17:04:37.714 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.714 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.714 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.714 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.496811+0000", 2023-09-30T17:04:37.714 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7600000000000002e-06 2023-09-30T17:04:37.714 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.714 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.714 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.715 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.715 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.715 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178743 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.715 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.630493+0000", 2023-09-30T17:04:37.715 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.280321812, 2023-09-30T17:04:37.715 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.287863127, 2023-09-30T17:04:37.715 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.715 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.715 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.715 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.715 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.715 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178743 2023-09-30T17:04:37.716 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.716 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.716 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.716 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.716 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.630493+0000", 2023-09-30T17:04:37.716 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.716 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.716 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.716 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.716 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.630493+0000", 2023-09-30T17:04:37.716 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.717 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.717 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.717 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.717 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.630493+0000", 2023-09-30T17:04:37.717 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7800000000000002e-07 2023-09-30T17:04:37.717 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.717 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.717 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.717 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.630506+0000", 2023-09-30T17:04:37.717 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2278e-05 2023-09-30T17:04:37.717 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.717 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.718 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.718 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.630519+0000", 2023-09-30T17:04:37.718 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3198e-05 2023-09-30T17:04:37.718 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.718 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.718 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.718 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.630526+0000", 2023-09-30T17:04:37.718 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6009999999999997e-06 2023-09-30T17:04:37.719 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.719 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.719 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.719 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.719 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.719 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178790 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.719 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.642745+0000", 2023-09-30T17:04:37.719 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.26806938000000002, 2023-09-30T17:04:37.719 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.27564485, 2023-09-30T17:04:37.719 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.719 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.720 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.720 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.720 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.720 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178790 2023-09-30T17:04:37.720 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.720 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.720 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.720 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.720 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.642745+0000", 2023-09-30T17:04:37.720 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.720 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.721 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.721 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.721 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.642745+0000", 2023-09-30T17:04:37.721 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.721 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.721 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.721 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.721 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.642746+0000", 2023-09-30T17:04:37.721 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7899999999999999e-07 2023-09-30T17:04:37.722 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.722 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.722 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.722 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.642762+0000", 2023-09-30T17:04:37.722 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6691999999999999e-05 2023-09-30T17:04:37.722 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.722 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.722 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.722 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.642769+0000", 2023-09-30T17:04:37.723 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7279999999999998e-06 2023-09-30T17:04:37.723 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.723 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.723 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.723 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.642775+0000", 2023-09-30T17:04:37.723 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0279999999999997e-06 2023-09-30T17:04:37.723 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.723 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.723 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.724 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.724 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.724 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178875 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.724 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.675670+0000", 2023-09-30T17:04:37.724 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.23514501300000001, 2023-09-30T17:04:37.724 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.242756736, 2023-09-30T17:04:37.724 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.724 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.724 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.724 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.724 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.725 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178875 2023-09-30T17:04:37.725 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.725 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.725 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.725 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.725 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.675670+0000", 2023-09-30T17:04:37.725 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.725 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.725 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.725 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.725 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.675670+0000", 2023-09-30T17:04:37.725 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.726 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.726 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.726 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.726 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.675670+0000", 2023-09-30T17:04:37.726 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2099999999999997e-07 2023-09-30T17:04:37.726 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.726 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.726 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.726 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.675681+0000", 2023-09-30T17:04:37.726 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0547000000000001e-05 2023-09-30T17:04:37.727 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.727 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.727 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.727 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.675686+0000", 2023-09-30T17:04:37.727 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5820000000000001e-06 2023-09-30T17:04:37.727 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.727 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.727 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.727 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.675691+0000", 2023-09-30T17:04:37.727 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5510000000000001e-06 2023-09-30T17:04:37.727 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.727 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.728 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.728 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.728 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.728 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179254 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.728 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.809564+0000", 2023-09-30T17:04:37.728 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.10125098, 2023-09-30T17:04:37.728 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.108913941, 2023-09-30T17:04:37.728 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.728 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.728 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.729 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.729 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.729 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179254 2023-09-30T17:04:37.729 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.729 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.729 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.729 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.729 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.809564+0000", 2023-09-30T17:04:37.729 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.729 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.729 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.730 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.730 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.809564+0000", 2023-09-30T17:04:37.730 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.730 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.730 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.730 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.730 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.809564+0000", 2023-09-30T17:04:37.730 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.63e-07 2023-09-30T17:04:37.730 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.730 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.730 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.731 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.809576+0000", 2023-09-30T17:04:37.731 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1946e-05 2023-09-30T17:04:37.731 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.731 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.731 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.731 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.809598+0000", 2023-09-30T17:04:37.731 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2161e-05 2023-09-30T17:04:37.731 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.731 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.731 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.731 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.809603+0000", 2023-09-30T17:04:37.732 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7419999999999997e-06 2023-09-30T17:04:37.732 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.732 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.732 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.732 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.732 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.732 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:177751 4.2e e58/17 4:75be0f36:::100000001f8.0000003d:head v 58'2782, mlcod=58'2776)", 2023-09-30T17:04:37.732 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.851635+0000", 2023-09-30T17:04:37.733 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.059179575999999998, 2023-09-30T17:04:37.733 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.066913045000000004, 2023-09-30T17:04:37.733 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.733 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:37.733 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.733 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.733 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.733 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.851635+0000", 2023-09-30T17:04:37.733 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.733 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.733 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.733 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.734 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.851635+0000", 2023-09-30T17:04:37.734 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.734 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.734 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.734 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.734 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.851635+0000", 2023-09-30T17:04:37.734 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2999999999999999e-07 2023-09-30T17:04:37.734 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.734 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.734 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.734 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.851646+0000", 2023-09-30T17:04:37.735 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0771000000000001e-05 2023-09-30T17:04:37.735 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.735 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.735 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.735 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.851652+0000", 2023-09-30T17:04:37.735 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1550000000000004e-06 2023-09-30T17:04:37.735 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.735 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.735 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.735 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.851656+0000", 2023-09-30T17:04:37.736 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3290000000000004e-06 2023-09-30T17:04:37.736 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.736 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.736 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:37.736 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.916067+0000", 2023-09-30T17:04:37.736 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.064410866999999997 2023-09-30T17:04:37.736 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.736 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.736 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:37.736 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.916080+0000", 2023-09-30T17:04:37.736 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3039e-05 2023-09-30T17:04:37.737 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.737 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.737 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.737 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.737 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.737 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:177804 4.6 e58/17)", 2023-09-30T17:04:37.737 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.866908+0000", 2023-09-30T17:04:37.737 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.043906331999999999, 2023-09-30T17:04:37.737 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.051704767999999998, 2023-09-30T17:04:37.737 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.737 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.737 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.738 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.738 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.738 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.866908+0000", 2023-09-30T17:04:37.738 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.738 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.738 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.738 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.738 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.866908+0000", 2023-09-30T17:04:37.738 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.738 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.738 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.739 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.739 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.866909+0000", 2023-09-30T17:04:37.739 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.91e-07 2023-09-30T17:04:37.739 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.739 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.739 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.739 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.866925+0000", 2023-09-30T17:04:37.739 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6747000000000001e-05 2023-09-30T17:04:37.739 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.739 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.739 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.740 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.866932+0000", 2023-09-30T17:04:37.740 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9310000000000002e-06 2023-09-30T17:04:37.740 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.740 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.740 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.740 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.866938+0000", 2023-09-30T17:04:37.740 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5119999999999999e-06 2023-09-30T17:04:37.740 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.740 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.740 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.740 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.741 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.741 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178285 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.741 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.453612+0000", 2023-09-30T17:04:37.741 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.45720217099999999, 2023-09-30T17:04:37.741 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.46506746500000001, 2023-09-30T17:04:37.741 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.741 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.741 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.741 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.741 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.742 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178285 2023-09-30T17:04:37.742 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.742 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.742 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.742 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.742 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.453612+0000", 2023-09-30T17:04:37.742 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.742 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.742 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.742 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.742 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.453612+0000", 2023-09-30T17:04:37.743 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.743 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.743 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.743 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.743 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.453613+0000", 2023-09-30T17:04:37.743 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1899999999999998e-07 2023-09-30T17:04:37.743 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.743 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.743 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.743 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.453621+0000", 2023-09-30T17:04:37.743 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2269999999999993e-06 2023-09-30T17:04:37.743 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.744 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.744 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.453625+0000", 2023-09-30T17:04:37.744 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6320000000000001e-06 2023-09-30T17:04:37.744 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.744 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.744 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.453628+0000", 2023-09-30T17:04:37.744 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0089999999999999e-06 2023-09-30T17:04:37.744 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.744 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.744 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.745 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.745 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.745 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178392 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.745 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.496818+0000", 2023-09-30T17:04:37.745 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.41399683799999998, 2023-09-30T17:04:37.745 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.421928843, 2023-09-30T17:04:37.745 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.745 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.745 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.745 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.745 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.746 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178392 2023-09-30T17:04:37.746 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.746 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.746 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.746 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.746 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.496818+0000", 2023-09-30T17:04:37.746 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.746 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.746 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.746 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.746 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.496818+0000", 2023-09-30T17:04:37.747 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.747 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.747 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.747 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.747 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.496818+0000", 2023-09-30T17:04:37.747 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7700000000000005e-07 2023-09-30T17:04:37.747 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.747 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.747 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.747 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.496830+0000", 2023-09-30T17:04:37.747 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1642e-05 2023-09-30T17:04:37.747 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.748 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.748 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.748 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.496836+0000", 2023-09-30T17:04:37.748 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5080000000000002e-06 2023-09-30T17:04:37.748 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.748 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.748 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.748 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.496841+0000", 2023-09-30T17:04:37.748 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6059999999999996e-06 2023-09-30T17:04:37.748 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.748 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.748 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.749 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.749 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.749 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179123 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.749 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.770666+0000", 2023-09-30T17:04:37.749 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.14014907300000001, 2023-09-30T17:04:37.749 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.14815128699999999, 2023-09-30T17:04:37.749 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.749 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.749 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.749 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.749 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.750 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179123 2023-09-30T17:04:37.750 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.750 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.750 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.750 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.750 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.770666+0000", 2023-09-30T17:04:37.750 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.750 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.750 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.750 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.750 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.770666+0000", 2023-09-30T17:04:37.750 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.751 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.751 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.751 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.751 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.770666+0000", 2023-09-30T17:04:37.751 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5200000000000002e-07 2023-09-30T17:04:37.751 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.751 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.751 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.751 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.770710+0000", 2023-09-30T17:04:37.751 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3575999999999997e-05 2023-09-30T17:04:37.751 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.752 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.752 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.752 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.770716+0000", 2023-09-30T17:04:37.752 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9090000000000003e-06 2023-09-30T17:04:37.752 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.752 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.752 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.752 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.770737+0000", 2023-09-30T17:04:37.752 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0703000000000002e-05 2023-09-30T17:04:37.752 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.752 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.752 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.753 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.753 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.753 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179205 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.753 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.796824+0000", 2023-09-30T17:04:37.753 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.11399034800000001, 2023-09-30T17:04:37.753 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.122056465, 2023-09-30T17:04:37.753 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.753 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.753 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.753 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.753 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.753 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179205 2023-09-30T17:04:37.754 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.754 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.754 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.754 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.754 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.796824+0000", 2023-09-30T17:04:37.754 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.754 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.754 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.754 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.754 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.796824+0000", 2023-09-30T17:04:37.754 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.755 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.755 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.755 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.755 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.798517+0000", 2023-09-30T17:04:37.755 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001692507 2023-09-30T17:04:37.755 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.755 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.755 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.755 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.798535+0000", 2023-09-30T17:04:37.755 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8312999999999999e-05 2023-09-30T17:04:37.756 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.756 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.756 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.756 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.798547+0000", 2023-09-30T17:04:37.756 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2421e-05 2023-09-30T17:04:37.756 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.756 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.756 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.756 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.798555+0000", 2023-09-30T17:04:37.756 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.807e-06 2023-09-30T17:04:37.757 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.757 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.757 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.757 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.757 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.757 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179319 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.757 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.838590+0000", 2023-09-30T17:04:37.757 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.072224366999999998, 2023-09-30T17:04:37.757 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.080356159999999996, 2023-09-30T17:04:37.757 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.757 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.758 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.758 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.758 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.758 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179319 2023-09-30T17:04:37.758 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.758 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.758 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.758 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.758 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.838590+0000", 2023-09-30T17:04:37.759 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.759 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.759 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.759 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.759 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.838590+0000", 2023-09-30T17:04:37.759 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.759 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.759 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.759 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.759 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.840517+0000", 2023-09-30T17:04:37.760 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019264169999999999 2023-09-30T17:04:37.760 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.760 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.760 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.760 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.840536+0000", 2023-09-30T17:04:37.760 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9814e-05 2023-09-30T17:04:37.760 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.760 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.760 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.760 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.840550+0000", 2023-09-30T17:04:37.761 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.365e-05 2023-09-30T17:04:37.761 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.761 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.761 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.761 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.840558+0000", 2023-09-30T17:04:37.761 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7319999999999998e-06 2023-09-30T17:04:37.761 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.761 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.761 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.761 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.761 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.762 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:177691 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.762 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.247600+0000", 2023-09-30T17:04:37.762 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.663214207, 2023-09-30T17:04:37.762 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.67142042400000002, 2023-09-30T17:04:37.762 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.762 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.762 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.762 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.762 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.762 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 177691 2023-09-30T17:04:37.763 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.763 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.763 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.763 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.763 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.247600+0000", 2023-09-30T17:04:37.763 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.763 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.763 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.763 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.763 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.247600+0000", 2023-09-30T17:04:37.763 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.764 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.764 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.764 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.764 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.252660+0000", 2023-09-30T17:04:37.764 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0050592969999999999 2023-09-30T17:04:37.764 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.764 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.764 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.764 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.252676+0000", 2023-09-30T17:04:37.764 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5835e-05 2023-09-30T17:04:37.764 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.765 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.765 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.765 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.252685+0000", 2023-09-30T17:04:37.765 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.098e-06 2023-09-30T17:04:37.765 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.765 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.765 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.765 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.252692+0000", 2023-09-30T17:04:37.765 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7680000000000008e-06 2023-09-30T17:04:37.765 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.766 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.766 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.766 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.766 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.766 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178095 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.766 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.362561+0000", 2023-09-30T17:04:37.766 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.54825401600000001, 2023-09-30T17:04:37.766 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.55651933899999995, 2023-09-30T17:04:37.766 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.766 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.766 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.767 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.767 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.767 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178095 2023-09-30T17:04:37.767 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.767 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.767 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.767 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.767 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.362561+0000", 2023-09-30T17:04:37.767 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.767 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.767 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.767 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.768 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.362561+0000", 2023-09-30T17:04:37.768 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.768 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.768 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.768 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.768 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.364516+0000", 2023-09-30T17:04:37.768 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019551999999999998 2023-09-30T17:04:37.768 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.768 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.768 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.769 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.364529+0000", 2023-09-30T17:04:37.769 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3562e-05 2023-09-30T17:04:37.769 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.769 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.769 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.769 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.364542+0000", 2023-09-30T17:04:37.769 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2952000000000001e-05 2023-09-30T17:04:37.769 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.769 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.769 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.769 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.364549+0000", 2023-09-30T17:04:37.770 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6069999999999996e-06 2023-09-30T17:04:37.770 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.770 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.770 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.770 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.770 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.770 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178286 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.770 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.453631+0000", 2023-09-30T17:04:37.770 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.45718322099999997, 2023-09-30T17:04:37.770 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.46551098699999999, 2023-09-30T17:04:37.770 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.771 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.771 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.771 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.771 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.771 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178286 2023-09-30T17:04:37.771 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.771 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.771 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.771 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.772 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.453631+0000", 2023-09-30T17:04:37.772 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.772 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.772 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.772 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.772 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.453631+0000", 2023-09-30T17:04:37.772 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.772 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.772 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.772 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.772 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.453632+0000", 2023-09-30T17:04:37.773 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2700000000000001e-07 2023-09-30T17:04:37.773 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.773 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.773 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.773 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.453640+0000", 2023-09-30T17:04:37.773 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5529999999999993e-06 2023-09-30T17:04:37.773 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.773 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.773 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.773 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.453643+0000", 2023-09-30T17:04:37.773 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.348e-06 2023-09-30T17:04:37.774 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.774 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.774 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.774 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.453647+0000", 2023-09-30T17:04:37.774 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0630000000000002e-06 2023-09-30T17:04:37.774 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.774 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.774 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.774 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.774 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.774 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178455 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.775 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.528684+0000", 2023-09-30T17:04:37.775 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.38213035299999998, 2023-09-30T17:04:37.775 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.390510723, 2023-09-30T17:04:37.775 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.775 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.775 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.775 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.775 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.775 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178455 2023-09-30T17:04:37.775 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.775 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.776 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.776 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.776 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.528684+0000", 2023-09-30T17:04:37.776 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.776 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.776 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.776 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.776 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.528684+0000", 2023-09-30T17:04:37.776 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.776 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.776 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.777 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.777 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.528685+0000", 2023-09-30T17:04:37.777 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5199999999999998e-07 2023-09-30T17:04:37.777 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.777 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.777 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.777 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.528708+0000", 2023-09-30T17:04:37.777 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2957000000000001e-05 2023-09-30T17:04:37.777 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.777 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.777 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.777 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.528855+0000", 2023-09-30T17:04:37.778 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000147849 2023-09-30T17:04:37.778 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.778 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.778 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.778 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.528921+0000", 2023-09-30T17:04:37.778 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5915999999999997e-05 2023-09-30T17:04:37.778 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.778 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.778 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.778 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.778 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.779 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178610 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.779 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.585696+0000", 2023-09-30T17:04:37.779 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.325118303, 2023-09-30T17:04:37.779 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.33355415999999999, 2023-09-30T17:04:37.779 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.779 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.779 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.779 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.779 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.779 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178610 2023-09-30T17:04:37.779 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.779 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.780 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.780 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.780 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.585696+0000", 2023-09-30T17:04:37.780 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.780 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.780 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.780 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.780 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.585696+0000", 2023-09-30T17:04:37.780 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.780 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.780 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.781 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.781 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.585697+0000", 2023-09-30T17:04:37.781 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2899999999999999e-07 2023-09-30T17:04:37.781 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.781 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.781 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.781 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.585713+0000", 2023-09-30T17:04:37.781 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5868000000000001e-05 2023-09-30T17:04:37.781 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.781 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.781 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.782 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.585719+0000", 2023-09-30T17:04:37.782 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4860000000000002e-06 2023-09-30T17:04:37.782 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.782 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.782 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.782 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.585724+0000", 2023-09-30T17:04:37.782 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2830000000000001e-06 2023-09-30T17:04:37.782 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.782 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.782 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.782 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.782 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.783 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179127 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.783 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.770762+0000", 2023-09-30T17:04:37.783 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.14005278400000001, 2023-09-30T17:04:37.783 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.14854033799999999, 2023-09-30T17:04:37.783 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.783 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.783 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.783 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.783 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.783 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179127 2023-09-30T17:04:37.783 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.784 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.784 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.784 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.784 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.770762+0000", 2023-09-30T17:04:37.784 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.784 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.784 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.784 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.784 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.770762+0000", 2023-09-30T17:04:37.784 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.784 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.785 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.785 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.785 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.770762+0000", 2023-09-30T17:04:37.785 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4099999999999999e-07 2023-09-30T17:04:37.785 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.785 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.785 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.785 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.770781+0000", 2023-09-30T17:04:37.785 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8980000000000001e-05 2023-09-30T17:04:37.785 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.785 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.785 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.786 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.770788+0000", 2023-09-30T17:04:37.786 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0890000000000002e-06 2023-09-30T17:04:37.786 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.786 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.786 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.786 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.770794+0000", 2023-09-30T17:04:37.786 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9340000000000003e-06 2023-09-30T17:04:37.786 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.786 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.786 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.786 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.787 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.787 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:177819 4.6 e58/17)", 2023-09-30T17:04:37.787 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.884800+0000", 2023-09-30T17:04:37.787 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.026015023000000002, 2023-09-30T17:04:37.787 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.034555325999999997, 2023-09-30T17:04:37.787 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.787 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.787 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.787 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.787 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.787 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.884800+0000", 2023-09-30T17:04:37.788 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.788 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.788 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.788 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.788 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.884800+0000", 2023-09-30T17:04:37.788 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.788 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.788 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.788 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.788 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.884800+0000", 2023-09-30T17:04:37.788 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2300000000000002e-07 2023-09-30T17:04:37.788 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.789 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.789 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.789 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.884811+0000", 2023-09-30T17:04:37.789 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0645999999999999e-05 2023-09-30T17:04:37.789 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.789 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.789 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.789 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.884819+0000", 2023-09-30T17:04:37.789 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4230000000000005e-06 2023-09-30T17:04:37.789 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.789 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.789 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.790 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.884824+0000", 2023-09-30T17:04:37.790 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8099999999999997e-06 2023-09-30T17:04:37.790 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.790 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.790 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.790 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.790 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.790 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:177851 4.2e e58/17)", 2023-09-30T17:04:37.790 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.904632+0000", 2023-09-30T17:04:37.790 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.00618287, 2023-09-30T17:04:37.790 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014767205, 2023-09-30T17:04:37.791 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.791 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.791 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.791 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.793 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.793 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.904632+0000", 2023-09-30T17:04:37.793 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.793 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.793 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.793 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.793 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.904632+0000", 2023-09-30T17:04:37.793 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.794 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.794 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.794 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.794 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.904632+0000", 2023-09-30T17:04:37.794 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4399999999999999e-07 2023-09-30T17:04:37.794 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.794 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.794 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.794 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.904643+0000", 2023-09-30T17:04:37.794 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0855e-05 2023-09-30T17:04:37.794 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.795 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.795 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.795 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.904647+0000", 2023-09-30T17:04:37.795 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4270000000000001e-06 2023-09-30T17:04:37.795 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.795 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.795 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.795 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.904650+0000", 2023-09-30T17:04:37.795 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.8030000000000001e-06 2023-09-30T17:04:37.795 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.796 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.796 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.796 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.796 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.796 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:177694 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.796 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.252703+0000", 2023-09-30T17:04:37.796 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.65811151599999995, 2023-09-30T17:04:37.796 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.66674562999999998, 2023-09-30T17:04:37.796 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.796 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.796 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.797 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.797 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.797 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 177694 2023-09-30T17:04:37.797 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.797 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.797 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.797 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.797 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.252703+0000", 2023-09-30T17:04:37.797 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.797 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.797 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.798 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.798 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.252703+0000", 2023-09-30T17:04:37.798 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.798 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.798 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.798 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.798 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.252704+0000", 2023-09-30T17:04:37.798 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4600000000000005e-07 2023-09-30T17:04:37.798 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.798 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.798 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.798 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.252715+0000", 2023-09-30T17:04:37.799 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1885000000000001e-05 2023-09-30T17:04:37.799 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.799 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.799 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.799 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.252723+0000", 2023-09-30T17:04:37.799 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7570000000000004e-06 2023-09-30T17:04:37.799 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.799 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.799 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.799 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.252729+0000", 2023-09-30T17:04:37.799 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.896e-06 2023-09-30T17:04:37.800 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.800 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.800 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.800 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.800 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.800 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:177740 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.800 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.260853+0000", 2023-09-30T17:04:37.800 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.64996120700000004, 2023-09-30T17:04:37.800 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.658647388, 2023-09-30T17:04:37.800 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.800 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.800 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.801 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.801 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.801 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 177740 2023-09-30T17:04:37.801 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.801 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.801 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.801 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.801 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.260853+0000", 2023-09-30T17:04:37.801 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.801 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.801 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.802 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.802 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.260853+0000", 2023-09-30T17:04:37.802 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.802 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.802 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.802 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.802 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.264516+0000", 2023-09-30T17:04:37.802 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003663113 2023-09-30T17:04:37.802 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.802 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.802 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.803 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.264535+0000", 2023-09-30T17:04:37.803 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8105999999999999e-05 2023-09-30T17:04:37.803 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.803 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.803 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.803 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.264544+0000", 2023-09-30T17:04:37.803 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.3959999999999995e-06 2023-09-30T17:04:37.803 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.803 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.803 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.803 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.264551+0000", 2023-09-30T17:04:37.803 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8750000000000002e-06 2023-09-30T17:04:37.804 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.804 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.804 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.804 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.804 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.804 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:177794 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.804 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.272859+0000", 2023-09-30T17:04:37.804 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.637955245, 2023-09-30T17:04:37.804 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.64670414399999998, 2023-09-30T17:04:37.804 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.804 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.805 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.805 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.805 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.805 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 177794 2023-09-30T17:04:37.805 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.805 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.805 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.805 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.805 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.272859+0000", 2023-09-30T17:04:37.805 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.805 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.805 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.806 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.806 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.272859+0000", 2023-09-30T17:04:37.806 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.806 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.806 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.806 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.806 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.272860+0000", 2023-09-30T17:04:37.806 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.58e-07 2023-09-30T17:04:37.806 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.806 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.806 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.807 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.272873+0000", 2023-09-30T17:04:37.807 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3371e-05 2023-09-30T17:04:37.807 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.807 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.807 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.807 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.272880+0000", 2023-09-30T17:04:37.807 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2200000000000003e-06 2023-09-30T17:04:37.807 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.807 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.807 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.808 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.272885+0000", 2023-09-30T17:04:37.808 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4630000000000003e-06 2023-09-30T17:04:37.808 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.808 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.808 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.808 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.808 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.808 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178918 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.808 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.687591+0000", 2023-09-30T17:04:37.808 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.223223748, 2023-09-30T17:04:37.808 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.232027546, 2023-09-30T17:04:37.809 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.809 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.809 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.809 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.809 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.809 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178918 2023-09-30T17:04:37.809 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.809 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.809 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.809 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.809 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.687591+0000", 2023-09-30T17:04:37.810 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.810 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.810 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.810 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.810 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.687591+0000", 2023-09-30T17:04:37.810 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.810 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.810 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.810 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.810 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.689518+0000", 2023-09-30T17:04:37.810 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001927488 2023-09-30T17:04:37.810 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.811 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.811 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.811 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.689540+0000", 2023-09-30T17:04:37.811 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1730999999999999e-05 2023-09-30T17:04:37.811 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.811 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.811 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.811 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.689552+0000", 2023-09-30T17:04:37.811 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2289999999999999e-05 2023-09-30T17:04:37.811 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.811 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.812 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.812 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.689559+0000", 2023-09-30T17:04:37.812 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1239999999999999e-06 2023-09-30T17:04:37.812 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.812 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.812 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.812 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.812 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.812 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179014 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.812 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.729568+0000", 2023-09-30T17:04:37.812 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.18124625699999999, 2023-09-30T17:04:37.812 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.19010519300000001, 2023-09-30T17:04:37.813 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.813 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.813 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.813 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.813 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.813 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179014 2023-09-30T17:04:37.813 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.813 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.813 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.814 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.729568+0000", 2023-09-30T17:04:37.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.814 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.814 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.814 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.814 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.729568+0000", 2023-09-30T17:04:37.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.814 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.814 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.814 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.814 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.731520+0000", 2023-09-30T17:04:37.815 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001951667 2023-09-30T17:04:37.815 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.815 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.815 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.815 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.731539+0000", 2023-09-30T17:04:37.815 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9327e-05 2023-09-30T17:04:37.815 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.815 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.815 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.815 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.731556+0000", 2023-09-30T17:04:37.815 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6799999999999998e-05 2023-09-30T17:04:37.816 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.816 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.816 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.816 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.731565+0000", 2023-09-30T17:04:37.816 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2129999999999997e-06 2023-09-30T17:04:37.816 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.816 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.816 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.816 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.816 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.816 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179342 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.817 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.846633+0000", 2023-09-30T17:04:37.817 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.064181507999999998, 2023-09-30T17:04:37.817 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.073096932000000003, 2023-09-30T17:04:37.817 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.817 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.817 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.817 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.817 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.817 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179342 2023-09-30T17:04:37.817 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.817 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.817 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.818 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.818 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.846633+0000", 2023-09-30T17:04:37.818 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.818 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.818 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.818 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.818 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.846633+0000", 2023-09-30T17:04:37.818 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.818 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.818 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.818 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.819 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.852516+0000", 2023-09-30T17:04:37.819 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0058829950000000002 2023-09-30T17:04:37.819 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.819 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.819 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.819 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.852532+0000", 2023-09-30T17:04:37.819 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5897e-05 2023-09-30T17:04:37.819 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.819 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.819 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.819 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.852542+0000", 2023-09-30T17:04:37.820 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6220000000000004e-06 2023-09-30T17:04:37.820 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.820 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.820 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.820 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.852549+0000", 2023-09-30T17:04:37.820 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9970000000000001e-06 2023-09-30T17:04:37.820 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.820 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.820 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.820 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.820 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.821 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:177795 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.821 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.272890+0000", 2023-09-30T17:04:37.821 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.63792430600000005, 2023-09-30T17:04:37.821 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.64689552500000003, 2023-09-30T17:04:37.821 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.821 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.821 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.821 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.821 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.821 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 177795 2023-09-30T17:04:37.821 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.822 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.822 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.822 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.822 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.272890+0000", 2023-09-30T17:04:37.822 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.822 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.822 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.822 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.822 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.272890+0000", 2023-09-30T17:04:37.822 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.822 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.823 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.823 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.823 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.272891+0000", 2023-09-30T17:04:37.823 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.8700000000000001e-07 2023-09-30T17:04:37.823 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.823 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.823 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.823 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.272901+0000", 2023-09-30T17:04:37.823 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0183000000000001e-05 2023-09-30T17:04:37.823 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.823 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.823 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.824 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.272906+0000", 2023-09-30T17:04:37.824 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6400000000000002e-06 2023-09-30T17:04:37.824 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.824 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.824 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.824 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.272911+0000", 2023-09-30T17:04:37.824 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4309999999999996e-06 2023-09-30T17:04:37.824 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.824 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.824 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.825 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.825 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178249 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.825 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.439568+0000", 2023-09-30T17:04:37.825 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.47124648000000002, 2023-09-30T17:04:37.825 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.48027479099999998, 2023-09-30T17:04:37.825 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.825 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.825 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.825 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.825 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.826 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178249 2023-09-30T17:04:37.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.826 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.826 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.826 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.826 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.439568+0000", 2023-09-30T17:04:37.826 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.826 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.826 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.826 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.439568+0000", 2023-09-30T17:04:37.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.827 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.827 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.827 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.827 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.439569+0000", 2023-09-30T17:04:37.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0699999999999997e-07 2023-09-30T17:04:37.827 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.827 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.827 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.827 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.439584+0000", 2023-09-30T17:04:37.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5099999999999999e-05 2023-09-30T17:04:37.828 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.828 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.828 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.828 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.439592+0000", 2023-09-30T17:04:37.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1810000000000001e-06 2023-09-30T17:04:37.828 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.828 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.828 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.828 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.439597+0000", 2023-09-30T17:04:37.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4990000000000002e-06 2023-09-30T17:04:37.829 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.829 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.829 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.829 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.829 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178288 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.829 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.453689+0000", 2023-09-30T17:04:37.829 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.45712577199999999, 2023-09-30T17:04:37.829 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.46620675299999997, 2023-09-30T17:04:37.829 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.829 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.829 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.830 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.830 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.830 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178288 2023-09-30T17:04:37.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.830 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.830 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.830 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.830 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.453689+0000", 2023-09-30T17:04:37.830 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.830 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.831 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.831 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.453689+0000", 2023-09-30T17:04:37.831 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.831 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.831 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.831 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.831 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.453689+0000", 2023-09-30T17:04:37.831 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3099999999999998e-07 2023-09-30T17:04:37.831 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.831 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.831 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.832 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.453697+0000", 2023-09-30T17:04:37.832 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9240000000000007e-06 2023-09-30T17:04:37.832 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.832 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.832 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.832 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.453701+0000", 2023-09-30T17:04:37.832 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.206e-06 2023-09-30T17:04:37.832 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.832 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.832 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.832 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.453705+0000", 2023-09-30T17:04:37.833 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.174e-06 2023-09-30T17:04:37.833 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.833 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.833 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.833 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.833 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.833 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178350 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.833 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.471628+0000", 2023-09-30T17:04:37.833 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.439186627, 2023-09-30T17:04:37.833 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.448321568, 2023-09-30T17:04:37.833 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.834 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.834 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.834 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.834 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.834 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178350 2023-09-30T17:04:37.834 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.834 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.834 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.834 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.834 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.471628+0000", 2023-09-30T17:04:37.834 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.835 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.835 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.835 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.835 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.471628+0000", 2023-09-30T17:04:37.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.835 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.835 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.835 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.835 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.471628+0000", 2023-09-30T17:04:37.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6800000000000001e-07 2023-09-30T17:04:37.835 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.835 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.836 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.836 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.471637+0000", 2023-09-30T17:04:37.836 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9900000000000003e-06 2023-09-30T17:04:37.836 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.836 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.836 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.836 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.471643+0000", 2023-09-30T17:04:37.836 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2229999999999998e-06 2023-09-30T17:04:37.836 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.836 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.836 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.837 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.471646+0000", 2023-09-30T17:04:37.837 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1700000000000001e-06 2023-09-30T17:04:37.837 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.837 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.837 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.837 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.837 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.837 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178419 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.837 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.516603+0000", 2023-09-30T17:04:37.837 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.39421192999999999, 2023-09-30T17:04:37.837 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.40339869, 2023-09-30T17:04:37.838 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.838 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.838 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.838 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.838 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.838 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178419 2023-09-30T17:04:37.838 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.838 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.838 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.838 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.838 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.516603+0000", 2023-09-30T17:04:37.838 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.839 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.839 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.839 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.839 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.516603+0000", 2023-09-30T17:04:37.839 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.839 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.839 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.839 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.839 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.518594+0000", 2023-09-30T17:04:37.839 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019915979999999998 2023-09-30T17:04:37.839 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.840 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.840 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.840 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.518611+0000", 2023-09-30T17:04:37.840 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6552e-05 2023-09-30T17:04:37.840 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.840 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.840 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.840 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.518619+0000", 2023-09-30T17:04:37.840 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5820000000000002e-06 2023-09-30T17:04:37.840 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.840 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.840 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.841 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.518626+0000", 2023-09-30T17:04:37.841 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5359999999999998e-06 2023-09-30T17:04:37.841 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.841 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.841 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.841 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.841 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.841 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:177827 4.6 e58/17)", 2023-09-30T17:04:37.841 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.889581+0000", 2023-09-30T17:04:37.841 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.021233941999999999, 2023-09-30T17:04:37.841 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.030474995000000001, 2023-09-30T17:04:37.841 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.842 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.842 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.842 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.842 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.842 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.889581+0000", 2023-09-30T17:04:37.842 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.842 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.842 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.842 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.842 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.889581+0000", 2023-09-30T17:04:37.842 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.842 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.843 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.843 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.843 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.889581+0000", 2023-09-30T17:04:37.843 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4799999999999999e-07 2023-09-30T17:04:37.843 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.843 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.843 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.843 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.889596+0000", 2023-09-30T17:04:37.843 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4817000000000001e-05 2023-09-30T17:04:37.843 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.843 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.844 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.844 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.889606+0000", 2023-09-30T17:04:37.844 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.7200000000000001e-06 2023-09-30T17:04:37.844 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.844 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.844 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.844 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.889611+0000", 2023-09-30T17:04:37.844 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5099999999999998e-06 2023-09-30T17:04:37.844 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.844 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.844 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.844 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.845 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.845 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:177594 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 1351680~4096 in=4096b,write 1396736~4096 in=4096b,write 1417216~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.845 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.217640+0000", 2023-09-30T17:04:37.845 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.69317453500000004, 2023-09-30T17:04:37.845 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.70247228799999994, 2023-09-30T17:04:37.845 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.845 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:37.845 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.845 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.845 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.845 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 177594 2023-09-30T17:04:37.845 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.846 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.846 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.846 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.846 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.217640+0000", 2023-09-30T17:04:37.846 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.846 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.846 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.846 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.846 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.217640+0000", 2023-09-30T17:04:37.846 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.846 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.846 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.847 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.847 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.217640+0000", 2023-09-30T17:04:37.847 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9000000000000002e-07 2023-09-30T17:04:37.847 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.847 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.847 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.847 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.217652+0000", 2023-09-30T17:04:37.847 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.184e-05 2023-09-30T17:04:37.847 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.847 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.847 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.847 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.217658+0000", 2023-09-30T17:04:37.848 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7180000000000001e-06 2023-09-30T17:04:37.848 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.848 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.848 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.848 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.217663+0000", 2023-09-30T17:04:37.848 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6380000000000003e-06 2023-09-30T17:04:37.848 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.848 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.848 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:37.848 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.908557+0000", 2023-09-30T17:04:37.849 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.69089420400000001 2023-09-30T17:04:37.849 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.849 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.849 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:37.849 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.908634+0000", 2023-09-30T17:04:37.849 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6874999999999998e-05 2023-09-30T17:04:37.849 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.849 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.849 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:37.849 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.908800+0000", 2023-09-30T17:04:37.849 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016630400000000001 2023-09-30T17:04:37.850 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.850 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.850 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.850 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.850 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.850 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:177917 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.850 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.309556+0000", 2023-09-30T17:04:37.850 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.60125854199999995, 2023-09-30T17:04:37.850 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.61063076699999996, 2023-09-30T17:04:37.850 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.850 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.851 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.851 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.851 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.851 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 177917 2023-09-30T17:04:37.851 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.851 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.851 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.851 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.851 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.309556+0000", 2023-09-30T17:04:37.851 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.851 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.852 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.852 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.852 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.309556+0000", 2023-09-30T17:04:37.852 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.852 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.852 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.852 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.852 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.309556+0000", 2023-09-30T17:04:37.852 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6499999999999999e-07 2023-09-30T17:04:37.852 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.852 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.853 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.853 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.309577+0000", 2023-09-30T17:04:37.853 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0290000000000001e-05 2023-09-30T17:04:37.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.853 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.853 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.853 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.309586+0000", 2023-09-30T17:04:37.853 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7139999999999999e-06 2023-09-30T17:04:37.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.853 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.853 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.854 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.309592+0000", 2023-09-30T17:04:37.854 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2999999999999998e-06 2023-09-30T17:04:37.854 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.854 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.854 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.854 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.854 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.854 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178291 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.854 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.453709+0000", 2023-09-30T17:04:37.854 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.45710566699999999, 2023-09-30T17:04:37.854 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.46653813799999999, 2023-09-30T17:04:37.854 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.855 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.855 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.855 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.855 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.855 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178291 2023-09-30T17:04:37.855 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.855 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.855 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.855 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.855 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.453709+0000", 2023-09-30T17:04:37.855 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.855 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.856 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.856 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.856 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.453709+0000", 2023-09-30T17:04:37.856 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.856 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.856 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.856 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.856 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.453709+0000", 2023-09-30T17:04:37.856 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0900000000000001e-07 2023-09-30T17:04:37.856 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.856 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.857 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.453719+0000", 2023-09-30T17:04:37.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0266e-05 2023-09-30T17:04:37.857 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.857 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.453723+0000", 2023-09-30T17:04:37.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6279999999999998e-06 2023-09-30T17:04:37.857 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.857 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.453726+0000", 2023-09-30T17:04:37.858 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9119999999999998e-06 2023-09-30T17:04:37.858 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.858 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.858 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.858 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.858 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.858 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178397 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.858 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.496948+0000", 2023-09-30T17:04:37.858 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.41386629699999999, 2023-09-30T17:04:37.858 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.42335476999999999, 2023-09-30T17:04:37.858 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.859 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.859 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.859 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.859 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.859 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178397 2023-09-30T17:04:37.859 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.859 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.859 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.859 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.859 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.496948+0000", 2023-09-30T17:04:37.859 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.860 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.860 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.860 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.860 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.496948+0000", 2023-09-30T17:04:37.860 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.860 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.860 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.860 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.860 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.496949+0000", 2023-09-30T17:04:37.860 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5100000000000001e-07 2023-09-30T17:04:37.860 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.860 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.861 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.861 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.496961+0000", 2023-09-30T17:04:37.861 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2086000000000001e-05 2023-09-30T17:04:37.861 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.861 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.861 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.861 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.496966+0000", 2023-09-30T17:04:37.861 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.626e-06 2023-09-30T17:04:37.861 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.861 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.861 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.862 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.496971+0000", 2023-09-30T17:04:37.862 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5469999999999998e-06 2023-09-30T17:04:37.862 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.862 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.862 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.862 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.862 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.862 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178712 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.862 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.621272+0000", 2023-09-30T17:04:37.862 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.28954285200000002, 2023-09-30T17:04:37.862 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.299085296, 2023-09-30T17:04:37.863 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.863 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.863 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.863 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.863 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.863 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178712 2023-09-30T17:04:37.863 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.863 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.863 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.863 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.863 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.621272+0000", 2023-09-30T17:04:37.863 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.864 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.864 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.864 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.621272+0000", 2023-09-30T17:04:37.864 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.864 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.864 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.864 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.864 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.621272+0000", 2023-09-30T17:04:37.864 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.03e-07 2023-09-30T17:04:37.865 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.865 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.865 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.865 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.621286+0000", 2023-09-30T17:04:37.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3943e-05 2023-09-30T17:04:37.865 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.865 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.865 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.865 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.621292+0000", 2023-09-30T17:04:37.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8810000000000001e-06 2023-09-30T17:04:37.865 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.866 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.866 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.866 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.621297+0000", 2023-09-30T17:04:37.866 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6489999999999999e-06 2023-09-30T17:04:37.866 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.866 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.866 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.866 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.866 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.866 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178964 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.866 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.699814+0000", 2023-09-30T17:04:37.867 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.211000252, 2023-09-30T17:04:37.867 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.22060018300000001, 2023-09-30T17:04:37.867 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.867 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.867 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.867 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.867 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.867 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178964 2023-09-30T17:04:37.867 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.867 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.867 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.868 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.699814+0000", 2023-09-30T17:04:37.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.868 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.868 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.699814+0000", 2023-09-30T17:04:37.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.868 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.699815+0000", 2023-09-30T17:04:37.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3799999999999997e-07 2023-09-30T17:04:37.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.869 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.699839+0000", 2023-09-30T17:04:37.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3717999999999999e-05 2023-09-30T17:04:37.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.869 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.699846+0000", 2023-09-30T17:04:37.870 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0040000000000002e-06 2023-09-30T17:04:37.870 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.870 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.870 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.699852+0000", 2023-09-30T17:04:37.870 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1399999999999997e-06 2023-09-30T17:04:37.870 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.870 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.870 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.870 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.871 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:177713 4.6 e58/17 4:62d56fc8:::100000001f8.0000001c:head v 58'10963, mlcod=58'10950)", 2023-09-30T17:04:37.871 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.840730+0000", 2023-09-30T17:04:37.871 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.070084741000000006, 2023-09-30T17:04:37.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.079743601999999997, 2023-09-30T17:04:37.871 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.871 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:37.871 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.871 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.871 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.871 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.840730+0000", 2023-09-30T17:04:37.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.871 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.872 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.840730+0000", 2023-09-30T17:04:37.872 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.872 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.872 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.872 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.840730+0000", 2023-09-30T17:04:37.872 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8500000000000001e-07 2023-09-30T17:04:37.872 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.872 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.873 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.873 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.840744+0000", 2023-09-30T17:04:37.873 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3882e-05 2023-09-30T17:04:37.873 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.873 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.873 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.873 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.840752+0000", 2023-09-30T17:04:37.873 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1130000000000001e-06 2023-09-30T17:04:37.873 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.873 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.873 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.873 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.840758+0000", 2023-09-30T17:04:37.874 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.959e-06 2023-09-30T17:04:37.874 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.874 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.874 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:37.874 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.902138+0000", 2023-09-30T17:04:37.874 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.061379243999999999 2023-09-30T17:04:37.874 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.874 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.874 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:37.874 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.902151+0000", 2023-09-30T17:04:37.874 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3006e-05 2023-09-30T17:04:37.875 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.875 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.875 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.875 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.875 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.875 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:177854 4.6 e58/17)", 2023-09-30T17:04:37.875 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.904676+0000", 2023-09-30T17:04:37.875 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0061388149999999997, 2023-09-30T17:04:37.875 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015865662999999999, 2023-09-30T17:04:37.875 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.875 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.875 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.876 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.876 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.876 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.904676+0000", 2023-09-30T17:04:37.876 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.876 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.876 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.876 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.876 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.904676+0000", 2023-09-30T17:04:37.876 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.876 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.876 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.877 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.877 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.904676+0000", 2023-09-30T17:04:37.877 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1300000000000001e-07 2023-09-30T17:04:37.877 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.877 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.877 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.877 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.904684+0000", 2023-09-30T17:04:37.877 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4309999999999994e-06 2023-09-30T17:04:37.877 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.877 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.877 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.877 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.904690+0000", 2023-09-30T17:04:37.878 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8279999999999999e-06 2023-09-30T17:04:37.878 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.878 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.878 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.878 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.904693+0000", 2023-09-30T17:04:37.878 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.599e-06 2023-09-30T17:04:37.878 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.878 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.878 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.878 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.878 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.879 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178713 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.879 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.621303+0000", 2023-09-30T17:04:37.879 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.28951199, 2023-09-30T17:04:37.879 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.29929450200000002, 2023-09-30T17:04:37.879 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.879 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.879 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.879 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.879 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.879 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178713 2023-09-30T17:04:37.879 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.879 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.880 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.880 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.880 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.621303+0000", 2023-09-30T17:04:37.880 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.880 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.880 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.880 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.880 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.621303+0000", 2023-09-30T17:04:37.880 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.880 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.880 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.881 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.881 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.621303+0000", 2023-09-30T17:04:37.881 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.41e-07 2023-09-30T17:04:37.881 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.881 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.881 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.881 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.621316+0000", 2023-09-30T17:04:37.881 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3403e-05 2023-09-30T17:04:37.881 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.881 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.881 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.881 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.621324+0000", 2023-09-30T17:04:37.882 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6830000000000008e-06 2023-09-30T17:04:37.882 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.882 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.882 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.882 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.621329+0000", 2023-09-30T17:04:37.882 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8350000000000003e-06 2023-09-30T17:04:37.882 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.882 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.882 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.882 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.882 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.883 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178847 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.883 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.661620+0000", 2023-09-30T17:04:37.883 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.24919449099999999, 2023-09-30T17:04:37.883 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.25903302299999997, 2023-09-30T17:04:37.883 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.883 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.883 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.883 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.883 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.883 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178847 2023-09-30T17:04:37.883 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.883 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.884 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.884 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.884 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.661620+0000", 2023-09-30T17:04:37.884 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.884 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.884 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.884 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.884 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.661620+0000", 2023-09-30T17:04:37.884 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.884 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.884 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.885 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.885 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.667534+0000", 2023-09-30T17:04:37.885 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059140670000000003 2023-09-30T17:04:37.885 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.885 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.885 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.885 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.667551+0000", 2023-09-30T17:04:37.885 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6886999999999999e-05 2023-09-30T17:04:37.885 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.885 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.885 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.886 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.667560+0000", 2023-09-30T17:04:37.886 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1030000000000008e-06 2023-09-30T17:04:37.886 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.886 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.886 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.886 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.667567+0000", 2023-09-30T17:04:37.886 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6710000000000002e-06 2023-09-30T17:04:37.886 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.886 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.886 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.886 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.887 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.887 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178885 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.887 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.677611+0000", 2023-09-30T17:04:37.887 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.23320328800000001, 2023-09-30T17:04:37.887 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.24309889300000001, 2023-09-30T17:04:37.887 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.887 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.887 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.887 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.887 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.887 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178885 2023-09-30T17:04:37.888 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.888 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.888 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.888 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.888 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.677611+0000", 2023-09-30T17:04:37.888 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.888 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.888 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.888 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.888 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.677611+0000", 2023-09-30T17:04:37.888 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.889 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.889 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.889 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.889 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.677612+0000", 2023-09-30T17:04:37.889 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7899999999999998e-07 2023-09-30T17:04:37.889 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.889 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.889 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.889 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.677623+0000", 2023-09-30T17:04:37.889 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1562e-05 2023-09-30T17:04:37.889 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.889 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.890 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.890 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.677630+0000", 2023-09-30T17:04:37.890 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2500000000000003e-06 2023-09-30T17:04:37.890 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.890 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.890 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.890 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.677635+0000", 2023-09-30T17:04:37.890 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3809999999999998e-06 2023-09-30T17:04:37.890 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.890 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.890 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.891 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.891 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.891 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178994 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.891 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.708654+0000", 2023-09-30T17:04:37.891 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.20216082299999999, 2023-09-30T17:04:37.891 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.21211244800000001, 2023-09-30T17:04:37.891 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.891 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.891 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.891 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.891 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.892 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178994 2023-09-30T17:04:37.892 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.892 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.892 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.892 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.892 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.708654+0000", 2023-09-30T17:04:37.892 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.892 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.892 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.892 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.892 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.708654+0000", 2023-09-30T17:04:37.892 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.893 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.893 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.893 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.893 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.710518+0000", 2023-09-30T17:04:37.893 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001864084 2023-09-30T17:04:37.893 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.893 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.893 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.893 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.710533+0000", 2023-09-30T17:04:37.893 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4848000000000001e-05 2023-09-30T17:04:37.893 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.893 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.894 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.894 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.710545+0000", 2023-09-30T17:04:37.894 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1977999999999999e-05 2023-09-30T17:04:37.894 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.894 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.894 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.894 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.710552+0000", 2023-09-30T17:04:37.894 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1250000000000004e-06 2023-09-30T17:04:37.894 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.894 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.894 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.895 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.895 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.895 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:177716 4.36 e58/17 4:6c9c34b1:::100000001f8.00000010:head v 58'8361, mlcod=58'8349)", 2023-09-30T17:04:37.895 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.840775+0000", 2023-09-30T17:04:37.895 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.070040055000000004, 2023-09-30T17:04:37.895 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.080050523999999998, 2023-09-30T17:04:37.895 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.895 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:37.895 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.895 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.895 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.895 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.840775+0000", 2023-09-30T17:04:37.896 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.896 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.896 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.896 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.896 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.840775+0000", 2023-09-30T17:04:37.896 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.896 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.896 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.896 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.896 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.840775+0000", 2023-09-30T17:04:37.896 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0600000000000001e-07 2023-09-30T17:04:37.896 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.897 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.897 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.897 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.840786+0000", 2023-09-30T17:04:37.897 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0694e-05 2023-09-30T17:04:37.897 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.897 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.897 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.897 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.840792+0000", 2023-09-30T17:04:37.897 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0789999999999997e-06 2023-09-30T17:04:37.897 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.897 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.897 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.898 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.840797+0000", 2023-09-30T17:04:37.898 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0379999999999999e-06 2023-09-30T17:04:37.898 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.898 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.898 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:37.898 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.902131+0000", 2023-09-30T17:04:37.898 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.061334791999999999 2023-09-30T17:04:37.898 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.898 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.899 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:37.899 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.902150+0000", 2023-09-30T17:04:37.899 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8451e-05 2023-09-30T17:04:37.899 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.899 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.899 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.899 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.899 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.899 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:177758 4.6 e58/17 4:62d56fc8:::100000001f8.0000001c:head v 58'10965, mlcod=58'10951)", 2023-09-30T17:04:37.899 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.855673+0000", 2023-09-30T17:04:37.899 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.055141862999999999, 2023-09-30T17:04:37.899 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.065211830999999998, 2023-09-30T17:04:37.900 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.900 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:37.900 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.900 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.900 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.900 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.855673+0000", 2023-09-30T17:04:37.900 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.900 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.900 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.900 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.900 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.855673+0000", 2023-09-30T17:04:37.900 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.901 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.901 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.901 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.901 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.855673+0000", 2023-09-30T17:04:37.901 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2000000000000001e-07 2023-09-30T17:04:37.901 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.901 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.901 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.901 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.855689+0000", 2023-09-30T17:04:37.901 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6424999999999999e-05 2023-09-30T17:04:37.901 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.902 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.902 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.902 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.855694+0000", 2023-09-30T17:04:37.902 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.853e-06 2023-09-30T17:04:37.902 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.902 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.902 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.902 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.855698+0000", 2023-09-30T17:04:37.902 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3639999999999999e-06 2023-09-30T17:04:37.902 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.902 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.903 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:37.903 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.916173+0000", 2023-09-30T17:04:37.903 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.060475208000000003 2023-09-30T17:04:37.903 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.903 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.903 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:37.903 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.916191+0000", 2023-09-30T17:04:37.903 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7745999999999999e-05 2023-09-30T17:04:37.903 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.903 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.903 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.903 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.904 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.904 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:177749 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.904 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.264687+0000", 2023-09-30T17:04:37.904 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.64612760899999999, 2023-09-30T17:04:37.904 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.65626121000000004, 2023-09-30T17:04:37.904 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.904 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.904 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.904 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.904 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.904 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 177749 2023-09-30T17:04:37.904 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.905 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.905 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.905 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.905 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.264687+0000", 2023-09-30T17:04:37.905 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.905 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.905 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.905 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.905 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.264687+0000", 2023-09-30T17:04:37.905 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.905 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.905 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.906 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.906 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.264687+0000", 2023-09-30T17:04:37.906 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5999999999999999e-07 2023-09-30T17:04:37.906 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.906 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.906 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.906 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.264700+0000", 2023-09-30T17:04:37.906 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2310000000000001e-05 2023-09-30T17:04:37.906 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.906 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.906 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.907 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.264706+0000", 2023-09-30T17:04:37.907 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9730000000000002e-06 2023-09-30T17:04:37.907 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.907 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.907 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.907 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.264711+0000", 2023-09-30T17:04:37.907 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9699999999999998e-06 2023-09-30T17:04:37.907 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.907 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.907 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.907 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.907 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.908 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178100 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.908 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.366568+0000", 2023-09-30T17:04:37.908 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.54424687999999999, 2023-09-30T17:04:37.908 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.55443631100000001, 2023-09-30T17:04:37.908 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.908 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.908 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.908 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.908 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.908 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178100 2023-09-30T17:04:37.908 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.908 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.909 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.909 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.909 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.366568+0000", 2023-09-30T17:04:37.909 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.909 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.909 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.909 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.909 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.366568+0000", 2023-09-30T17:04:37.909 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.909 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.909 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.910 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.910 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.366568+0000", 2023-09-30T17:04:37.910 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1900000000000003e-07 2023-09-30T17:04:37.910 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.910 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.910 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.910 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.366583+0000", 2023-09-30T17:04:37.910 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4317e-05 2023-09-30T17:04:37.910 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.910 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.910 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.911 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.366590+0000", 2023-09-30T17:04:37.911 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4889999999999998e-06 2023-09-30T17:04:37.911 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.911 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.911 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.911 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.366595+0000", 2023-09-30T17:04:37.911 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3199999999999999e-06 2023-09-30T17:04:37.911 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.911 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.911 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.911 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.912 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.912 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178664 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.912 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.613554+0000", 2023-09-30T17:04:37.912 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.297260207, 2023-09-30T17:04:37.912 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.30750675900000002, 2023-09-30T17:04:37.912 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.912 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.912 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.912 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.912 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.912 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178664 2023-09-30T17:04:37.913 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.913 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.913 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.913 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.913 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.613554+0000", 2023-09-30T17:04:37.913 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.913 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.913 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.913 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.913 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.613554+0000", 2023-09-30T17:04:37.913 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.914 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.914 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.914 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.914 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.613555+0000", 2023-09-30T17:04:37.914 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7e-07 2023-09-30T17:04:37.914 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.914 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.914 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.914 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.613571+0000", 2023-09-30T17:04:37.914 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6455000000000001e-05 2023-09-30T17:04:37.915 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.915 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.915 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.915 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.613578+0000", 2023-09-30T17:04:37.915 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7510000000000002e-06 2023-09-30T17:04:37.915 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.915 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.915 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.915 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.613588+0000", 2023-09-30T17:04:37.915 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.9510000000000001e-06 2023-09-30T17:04:37.915 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.915 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.916 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.916 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.916 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.916 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178823 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.916 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.657749+0000", 2023-09-30T17:04:37.916 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.253065345, 2023-09-30T17:04:37.916 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.26336793200000003, 2023-09-30T17:04:37.916 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.916 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.916 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.916 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.917 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.917 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178823 2023-09-30T17:04:37.917 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.917 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.917 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.917 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.917 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.657749+0000", 2023-09-30T17:04:37.917 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.917 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.917 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.917 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.917 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.657749+0000", 2023-09-30T17:04:37.918 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.918 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.918 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.918 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.918 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.657750+0000", 2023-09-30T17:04:37.918 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8500000000000001e-07 2023-09-30T17:04:37.918 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.918 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.918 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.918 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.657774+0000", 2023-09-30T17:04:37.919 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4074999999999999e-05 2023-09-30T17:04:37.919 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.919 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.919 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.919 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.657780+0000", 2023-09-30T17:04:37.919 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3160000000000002e-06 2023-09-30T17:04:37.919 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.919 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.919 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.919 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.657787+0000", 2023-09-30T17:04:37.920 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9800000000000001e-06 2023-09-30T17:04:37.920 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.920 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.920 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.920 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.920 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.920 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179420 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.920 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.898682+0000", 2023-09-30T17:04:37.920 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.012132852, 2023-09-30T17:04:37.920 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022492551999999999, 2023-09-30T17:04:37.920 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.921 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.921 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.921 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.921 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.921 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179420 2023-09-30T17:04:37.921 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.921 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.921 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.921 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.921 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.898682+0000", 2023-09-30T17:04:37.921 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.922 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.922 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.922 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.922 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.898682+0000", 2023-09-30T17:04:37.922 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.922 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.922 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.922 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.922 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.904723+0000", 2023-09-30T17:04:37.922 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0060411299999999996 2023-09-30T17:04:37.922 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.923 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.923 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.923 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.904736+0000", 2023-09-30T17:04:37.923 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3378e-05 2023-09-30T17:04:37.923 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.923 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.923 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.923 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.904742+0000", 2023-09-30T17:04:37.923 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5350000000000004e-06 2023-09-30T17:04:37.923 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.924 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.924 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.924 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.904745+0000", 2023-09-30T17:04:37.924 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6849999999999999e-06 2023-09-30T17:04:37.924 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.924 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.924 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.924 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.924 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.924 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:177598 4.f 4:f26fdfa9:::100000001f8.00000002:head [write 2998272~4096 in=4096b,write 3145728~4096 in=4096b,write 3178496~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.925 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.217725+0000", 2023-09-30T17:04:37.925 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.69309005000000001, 2023-09-30T17:04:37.925 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.70351699700000003, 2023-09-30T17:04:37.925 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.925 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:37.925 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.925 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.925 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.925 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 177598 2023-09-30T17:04:37.925 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.925 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.926 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.926 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.926 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.217725+0000", 2023-09-30T17:04:37.926 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.926 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.926 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.926 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.926 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.217725+0000", 2023-09-30T17:04:37.926 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.926 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.927 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.927 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.927 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.217725+0000", 2023-09-30T17:04:37.927 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5499999999999999e-07 2023-09-30T17:04:37.927 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.927 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.927 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.927 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.217735+0000", 2023-09-30T17:04:37.927 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0151e-05 2023-09-30T17:04:37.927 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.927 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.928 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.928 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.217741+0000", 2023-09-30T17:04:37.928 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6570000000000002e-06 2023-09-30T17:04:37.928 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.928 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.928 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.928 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.217745+0000", 2023-09-30T17:04:37.928 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3680000000000004e-06 2023-09-30T17:04:37.928 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.929 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.929 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:37.929 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.915696+0000", 2023-09-30T17:04:37.929 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.69795115100000005 2023-09-30T17:04:37.929 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.929 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.929 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:37.929 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.915815+0000", 2023-09-30T17:04:37.930 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000118483 2023-09-30T17:04:37.930 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.930 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.930 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:37.930 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.915985+0000", 2023-09-30T17:04:37.930 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017069200000000001 2023-09-30T17:04:37.930 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.930 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.930 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.931 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.931 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.931 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:177672 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.931 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.240003+0000", 2023-09-30T17:04:37.931 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.67081207600000003, 2023-09-30T17:04:37.931 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.68132289400000001, 2023-09-30T17:04:37.931 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.931 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.931 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.931 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.932 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.932 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 177672 2023-09-30T17:04:37.932 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.932 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.932 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.932 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.932 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.240003+0000", 2023-09-30T17:04:37.932 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.932 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.932 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.932 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.933 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.240003+0000", 2023-09-30T17:04:37.933 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.933 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.933 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.933 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.933 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.240003+0000", 2023-09-30T17:04:37.933 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.8400000000000003e-07 2023-09-30T17:04:37.933 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.933 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.933 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.934 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.240019+0000", 2023-09-30T17:04:37.934 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6129000000000001e-05 2023-09-30T17:04:37.934 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.934 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.934 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.934 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.240030+0000", 2023-09-30T17:04:37.934 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0205e-05 2023-09-30T17:04:37.934 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.934 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.935 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.935 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.240037+0000", 2023-09-30T17:04:37.935 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.204e-06 2023-09-30T17:04:37.935 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.935 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.935 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.935 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.935 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.936 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:177708 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.936 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.252854+0000", 2023-09-30T17:04:37.936 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.65796033399999998, 2023-09-30T17:04:37.936 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.66853345799999997, 2023-09-30T17:04:37.936 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.936 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.936 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.936 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.936 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.936 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 177708 2023-09-30T17:04:37.937 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.937 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.937 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.937 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.937 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.252854+0000", 2023-09-30T17:04:37.937 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.937 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.937 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.937 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.938 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.252854+0000", 2023-09-30T17:04:37.938 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.938 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.938 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.938 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.938 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.252855+0000", 2023-09-30T17:04:37.938 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4299999999999999e-07 2023-09-30T17:04:37.938 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.938 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.938 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.939 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.252864+0000", 2023-09-30T17:04:37.939 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6069999999999997e-06 2023-09-30T17:04:37.939 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.939 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.939 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.939 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.252871+0000", 2023-09-30T17:04:37.939 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7900000000000002e-06 2023-09-30T17:04:37.939 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.939 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.939 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.940 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.252875+0000", 2023-09-30T17:04:37.940 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4240000000000003e-06 2023-09-30T17:04:37.940 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.940 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.940 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.940 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.940 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.940 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178332 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.941 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.465193+0000", 2023-09-30T17:04:37.941 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.44562144100000001, 2023-09-30T17:04:37.941 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.45625803100000001, 2023-09-30T17:04:37.941 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.941 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.941 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.941 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.941 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.941 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178332 2023-09-30T17:04:37.942 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.942 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.942 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.942 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.942 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.465193+0000", 2023-09-30T17:04:37.942 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.942 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.942 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.942 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.943 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.465193+0000", 2023-09-30T17:04:37.943 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.943 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.943 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.943 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.943 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.465194+0000", 2023-09-30T17:04:37.943 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3599999999999999e-07 2023-09-30T17:04:37.943 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.943 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.943 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.944 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.465219+0000", 2023-09-30T17:04:37.944 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5579999999999999e-05 2023-09-30T17:04:37.944 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.944 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.944 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.944 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.465227+0000", 2023-09-30T17:04:37.944 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0669999999999992e-06 2023-09-30T17:04:37.944 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.944 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.944 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.944 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.465233+0000", 2023-09-30T17:04:37.945 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9529999999999996e-06 2023-09-30T17:04:37.945 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.945 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.945 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.945 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.945 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.945 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178851 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.945 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.667624+0000", 2023-09-30T17:04:37.945 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.24319057399999999, 2023-09-30T17:04:37.945 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.25389040400000001, 2023-09-30T17:04:37.945 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.946 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.946 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.946 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.946 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.946 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178851 2023-09-30T17:04:37.946 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.946 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.946 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.946 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.947 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.667624+0000", 2023-09-30T17:04:37.947 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.947 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.947 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.947 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.947 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.667624+0000", 2023-09-30T17:04:37.947 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.947 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.947 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.948 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.948 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.667624+0000", 2023-09-30T17:04:37.948 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5699999999999998e-07 2023-09-30T17:04:37.948 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.948 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.948 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.948 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.667642+0000", 2023-09-30T17:04:37.948 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7560000000000001e-05 2023-09-30T17:04:37.949 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.949 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.949 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.949 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.667649+0000", 2023-09-30T17:04:37.949 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5169999999999996e-06 2023-09-30T17:04:37.949 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.949 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.949 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.949 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.667654+0000", 2023-09-30T17:04:37.949 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7620000000000001e-06 2023-09-30T17:04:37.949 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.950 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.950 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.950 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.950 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.950 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179182 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.950 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.786681+0000", 2023-09-30T17:04:37.950 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.124133958, 2023-09-30T17:04:37.950 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.134896768, 2023-09-30T17:04:37.950 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.951 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.951 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.951 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.951 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.951 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179182 2023-09-30T17:04:37.951 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.951 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.951 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.951 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.951 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.786681+0000", 2023-09-30T17:04:37.951 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.952 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.952 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.952 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.952 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.786681+0000", 2023-09-30T17:04:37.952 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.952 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.952 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.952 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.952 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.786681+0000", 2023-09-30T17:04:37.952 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9800000000000004e-07 2023-09-30T17:04:37.953 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.953 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.953 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.953 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.786694+0000", 2023-09-30T17:04:37.953 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2867000000000001e-05 2023-09-30T17:04:37.953 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.953 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.954 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.954 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.786701+0000", 2023-09-30T17:04:37.954 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9920000000000001e-06 2023-09-30T17:04:37.954 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.954 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.954 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.954 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.786707+0000", 2023-09-30T17:04:37.954 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7200000000000003e-06 2023-09-30T17:04:37.954 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.954 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.955 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.955 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.955 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.955 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179325 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.955 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.840682+0000", 2023-09-30T17:04:37.955 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.070132665999999996, 2023-09-30T17:04:37.955 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.080955847999999997, 2023-09-30T17:04:37.955 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.955 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.955 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.955 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.956 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.956 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179325 2023-09-30T17:04:37.956 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.956 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.956 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.956 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.956 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.840682+0000", 2023-09-30T17:04:37.956 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.957 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.957 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.957 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.957 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.840682+0000", 2023-09-30T17:04:37.957 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.957 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.957 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.957 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.957 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.842517+0000", 2023-09-30T17:04:37.957 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001835365 2023-09-30T17:04:37.958 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.958 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.958 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.958 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.842536+0000", 2023-09-30T17:04:37.958 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8451e-05 2023-09-30T17:04:37.958 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.958 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.958 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.958 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.842546+0000", 2023-09-30T17:04:37.958 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0314e-05 2023-09-30T17:04:37.958 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.959 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.959 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.959 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.842552+0000", 2023-09-30T17:04:37.959 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4459999999999998e-06 2023-09-30T17:04:37.959 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.959 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.959 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.959 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.959 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.959 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179421 4.38 4:1fc350da:::100000001f8.0000002f:head [write 712704~4096 in=4096b,write 983040~4096 in=4096b,write 1003520~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.959 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.904752+0000", 2023-09-30T17:04:37.960 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0060621549999999996, 2023-09-30T17:04:37.960 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016954904, 2023-09-30T17:04:37.960 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.960 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:37.960 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.960 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.960 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.960 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179421 2023-09-30T17:04:37.960 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.960 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.961 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.961 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.961 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.904752+0000", 2023-09-30T17:04:37.961 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.961 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.961 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.961 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.961 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.904752+0000", 2023-09-30T17:04:37.961 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.962 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.962 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.962 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.962 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.904753+0000", 2023-09-30T17:04:37.962 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7799999999999997e-07 2023-09-30T17:04:37.962 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.962 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.962 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.962 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.904762+0000", 2023-09-30T17:04:37.962 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6520000000000001e-06 2023-09-30T17:04:37.963 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.963 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.963 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.963 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.904766+0000", 2023-09-30T17:04:37.963 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6969999999999999e-06 2023-09-30T17:04:37.963 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.963 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.963 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.963 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.904769+0000", 2023-09-30T17:04:37.963 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9119999999999998e-06 2023-09-30T17:04:37.964 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.964 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.964 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:37.964 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.908595+0000", 2023-09-30T17:04:37.964 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038264839999999998 2023-09-30T17:04:37.964 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.964 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.964 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:37.964 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.908675+0000", 2023-09-30T17:04:37.964 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9134000000000005e-05 2023-09-30T17:04:37.964 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.965 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.965 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.965 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.965 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.965 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:177808 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.965 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.273049+0000", 2023-09-30T17:04:37.965 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.63776563200000003, 2023-09-30T17:04:37.965 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.64873736999999998, 2023-09-30T17:04:37.965 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.965 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.966 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.966 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.966 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.966 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 177808 2023-09-30T17:04:37.966 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.966 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.966 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.966 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.966 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.273049+0000", 2023-09-30T17:04:37.967 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.967 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.967 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.967 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.967 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.273049+0000", 2023-09-30T17:04:37.967 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.967 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.967 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.967 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.967 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.273049+0000", 2023-09-30T17:04:37.967 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5600000000000001e-07 2023-09-30T17:04:37.968 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.968 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.968 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.968 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.273062+0000", 2023-09-30T17:04:37.968 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2546e-05 2023-09-30T17:04:37.968 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.968 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.968 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.968 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.273067+0000", 2023-09-30T17:04:37.968 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5679999999999999e-06 2023-09-30T17:04:37.968 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.969 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.969 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.969 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.273073+0000", 2023-09-30T17:04:37.969 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6509999999999998e-06 2023-09-30T17:04:37.969 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.969 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.969 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.969 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.969 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.970 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:177919 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.970 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.309599+0000", 2023-09-30T17:04:37.970 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.60121516699999999, 2023-09-30T17:04:37.970 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.61224785699999995, 2023-09-30T17:04:37.970 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.970 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.970 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.970 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.971 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.971 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 177919 2023-09-30T17:04:37.971 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.971 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.971 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.971 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.971 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.309599+0000", 2023-09-30T17:04:37.971 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.971 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.971 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.972 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.972 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.309599+0000", 2023-09-30T17:04:37.972 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.972 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.972 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.972 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.972 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.311516+0000", 2023-09-30T17:04:37.972 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00191686 2023-09-30T17:04:37.972 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.973 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.973 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.973 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.311529+0000", 2023-09-30T17:04:37.973 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3161e-05 2023-09-30T17:04:37.973 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.973 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.973 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.973 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.311538+0000", 2023-09-30T17:04:37.973 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.7320000000000004e-06 2023-09-30T17:04:37.973 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.973 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.973 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.974 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.311544+0000", 2023-09-30T17:04:37.974 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2330000000000003e-06 2023-09-30T17:04:37.974 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.974 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.974 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.974 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.974 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.974 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(mds.0.3:111 3.17 3.23ae0f57 (undecoded) ondisk+write+known_if_redirected+full_force+supports_pool_eio e58)", 2023-09-30T17:04:37.974 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.400562+0000", 2023-09-30T17:04:37.974 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.51025282100000002, 2023-09-30T17:04:37.975 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.52135330599999996, 2023-09-30T17:04:37.975 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.975 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.975 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.975 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.975 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.975 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.400562+0000", 2023-09-30T17:04:37.975 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.975 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.975 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.976 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.976 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.400562+0000", 2023-09-30T17:04:37.976 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.976 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.976 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.976 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.976 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.400562+0000", 2023-09-30T17:04:37.976 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1600000000000001e-07 2023-09-30T17:04:37.976 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.976 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.977 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.977 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.400567+0000", 2023-09-30T17:04:37.977 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3680000000000004e-06 2023-09-30T17:04:37.977 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.977 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.977 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.977 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.400573+0000", 2023-09-30T17:04:37.977 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.122e-06 2023-09-30T17:04:37.977 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.977 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.977 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.977 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.400578+0000", 2023-09-30T17:04:37.978 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.062e-06 2023-09-30T17:04:37.978 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.978 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.978 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.978 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.978 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.978 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178354 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.978 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.471674+0000", 2023-09-30T17:04:37.978 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.43914024800000001, 2023-09-30T17:04:37.978 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.45029950099999999, 2023-09-30T17:04:37.979 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.979 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.979 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.979 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.979 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.979 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178354 2023-09-30T17:04:37.979 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.979 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.979 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.979 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.979 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.471674+0000", 2023-09-30T17:04:37.980 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.980 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.980 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.980 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.980 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.471674+0000", 2023-09-30T17:04:37.980 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.980 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.980 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.980 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.980 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.476518+0000", 2023-09-30T17:04:37.980 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0048432370000000002 2023-09-30T17:04:37.980 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.981 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.981 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.981 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.476537+0000", 2023-09-30T17:04:37.981 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9718999999999999e-05 2023-09-30T17:04:37.981 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.981 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.981 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.981 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.476548+0000", 2023-09-30T17:04:37.981 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0641e-05 2023-09-30T17:04:37.981 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.981 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.981 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.982 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.476556+0000", 2023-09-30T17:04:37.982 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.0390000000000005e-06 2023-09-30T17:04:37.982 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.982 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.982 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.982 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.982 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.982 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178403 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.982 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.497101+0000", 2023-09-30T17:04:37.982 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.41371374999999999, 2023-09-30T17:04:37.982 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.42493811100000001, 2023-09-30T17:04:37.983 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.983 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.983 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.983 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.983 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.983 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178403 2023-09-30T17:04:37.983 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.983 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.983 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.983 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.984 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.497101+0000", 2023-09-30T17:04:37.984 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.984 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.984 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.984 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.984 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.497101+0000", 2023-09-30T17:04:37.984 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.984 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.984 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.984 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.984 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.497101+0000", 2023-09-30T17:04:37.985 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3000000000000001e-07 2023-09-30T17:04:37.985 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.985 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.985 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.985 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.497124+0000", 2023-09-30T17:04:37.985 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2651e-05 2023-09-30T17:04:37.985 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.985 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.985 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.985 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.497133+0000", 2023-09-30T17:04:37.985 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1200000000000008e-06 2023-09-30T17:04:37.986 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.986 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.986 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.986 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.497138+0000", 2023-09-30T17:04:37.986 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.198e-06 2023-09-30T17:04:37.986 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.986 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.986 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.986 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.986 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.987 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178891 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.987 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.677724+0000", 2023-09-30T17:04:37.987 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.23309064299999999, 2023-09-30T17:04:37.987 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.244376817, 2023-09-30T17:04:37.987 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.987 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.987 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.987 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.987 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.987 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178891 2023-09-30T17:04:37.987 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.987 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.988 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.988 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.677724+0000", 2023-09-30T17:04:37.988 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.988 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.988 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.988 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.677724+0000", 2023-09-30T17:04:37.988 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.989 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.989 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.989 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.989 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.677725+0000", 2023-09-30T17:04:37.989 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2900000000000003e-07 2023-09-30T17:04:37.989 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.989 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.989 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.989 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.677743+0000", 2023-09-30T17:04:37.989 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8740999999999999e-05 2023-09-30T17:04:37.989 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.989 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.990 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.990 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.677751+0000", 2023-09-30T17:04:37.990 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2420000000000003e-06 2023-09-30T17:04:37.990 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.990 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.990 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.990 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.677757+0000", 2023-09-30T17:04:37.990 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.331e-06 2023-09-30T17:04:37.990 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.990 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.990 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.991 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.991 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.991 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179184 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:37.991 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.786715+0000", 2023-09-30T17:04:37.991 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.124099349, 2023-09-30T17:04:37.991 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.13545795699999999, 2023-09-30T17:04:37.991 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.991 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:37.991 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:37.991 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:37.991 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:37.992 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179184 2023-09-30T17:04:37.992 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.992 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.992 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.786715+0000", 2023-09-30T17:04:37.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.992 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.992 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.786715+0000", 2023-09-30T17:04:37.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.993 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.993 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.993 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.993 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.786716+0000", 2023-09-30T17:04:37.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3599999999999999e-07 2023-09-30T17:04:37.993 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.993 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.993 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.993 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.786728+0000", 2023-09-30T17:04:37.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2469e-05 2023-09-30T17:04:37.993 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.994 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.994 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.994 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.786735+0000", 2023-09-30T17:04:37.994 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6919999999999996e-06 2023-09-30T17:04:37.994 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.994 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.994 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.994 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.786740+0000", 2023-09-30T17:04:37.994 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0699999999999997e-06 2023-09-30T17:04:37.994 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.994 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:37.994 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:37.995 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.995 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.995 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:177736 4.6 e58/17 4:616d4c41:::100000001f8.00000034:head v 58'10964, mlcod=58'10950)", 2023-09-30T17:04:37.995 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.843785+0000", 2023-09-30T17:04:37.995 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.067029106000000005, 2023-09-30T17:04:37.995 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.078451322000000004, 2023-09-30T17:04:37.995 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:37.995 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:37.995 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:37.995 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.995 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:37.995 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.843785+0000", 2023-09-30T17:04:37.995 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.997 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.997 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:37.997 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.843785+0000", 2023-09-30T17:04:37.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:37.997 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.997 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:37.998 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.843787+0000", 2023-09-30T17:04:37.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.156e-06 2023-09-30T17:04:37.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.998 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:37.998 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.843807+0000", 2023-09-30T17:04:37.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0754000000000002e-05 2023-09-30T17:04:37.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.998 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:37.999 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.843816+0000", 2023-09-30T17:04:37.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8279999999999992e-06 2023-09-30T17:04:37.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.999 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:37.999 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.843824+0000", 2023-09-30T17:04:37.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7440000000000007e-06 2023-09-30T17:04:37.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:37.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:37.999 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:37.999 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.908797+0000", 2023-09-30T17:04:37.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.064972743999999999 2023-09-30T17:04:38.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.000 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:38.000 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.908816+0000", 2023-09-30T17:04:38.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9429e-05 2023-09-30T17:04:38.000 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.000 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.000 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.000 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179344 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.000 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.855758+0000", 2023-09-30T17:04:38.001 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.055056728999999999, 2023-09-30T17:04:38.001 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.066551743999999996, 2023-09-30T17:04:38.001 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.001 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.001 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.001 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.001 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.001 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179344 2023-09-30T17:04:38.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.001 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.002 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.002 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.855758+0000", 2023-09-30T17:04:38.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.002 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.002 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.002 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.855758+0000", 2023-09-30T17:04:38.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.002 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.002 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.003 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.855758+0000", 2023-09-30T17:04:38.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0100000000000005e-07 2023-09-30T17:04:38.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.003 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.003 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.003 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.855771+0000", 2023-09-30T17:04:38.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2581e-05 2023-09-30T17:04:38.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.003 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.003 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.003 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.855778+0000", 2023-09-30T17:04:38.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6680000000000004e-06 2023-09-30T17:04:38.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.004 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.004 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.855783+0000", 2023-09-30T17:04:38.004 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5389999999999998e-06 2023-09-30T17:04:38.004 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.004 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.004 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.004 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.004 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.005 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179401 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.005 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.892991+0000", 2023-09-30T17:04:38.005 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.017823637, 2023-09-30T17:04:38.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.029378972, 2023-09-30T17:04:38.005 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.005 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.005 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.005 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.005 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.005 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179401 2023-09-30T17:04:38.005 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.005 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.006 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.006 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.892991+0000", 2023-09-30T17:04:38.006 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.006 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.006 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.006 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.892991+0000", 2023-09-30T17:04:38.006 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.006 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.006 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.892992+0000", 2023-09-30T17:04:38.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3399999999999999e-07 2023-09-30T17:04:38.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.007 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.893011+0000", 2023-09-30T17:04:38.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.942e-05 2023-09-30T17:04:38.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.007 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.893020+0000", 2023-09-30T17:04:38.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9120000000000004e-06 2023-09-30T17:04:38.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.008 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.008 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.893026+0000", 2023-09-30T17:04:38.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4840000000000001e-06 2023-09-30T17:04:38.008 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.008 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.008 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.008 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179422 4.38 4:1fc350da:::100000001f8.0000002f:head [write 2482176~4096 in=4096b,write 2539520~4096 in=4096b,write 2584576~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.009 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.904777+0000", 2023-09-30T17:04:38.009 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0060379739999999998, 2023-09-30T17:04:38.009 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017658831999999999, 2023-09-30T17:04:38.009 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.009 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:38.009 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.009 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.009 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.009 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179422 2023-09-30T17:04:38.009 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.009 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.010 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.010 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.904777+0000", 2023-09-30T17:04:38.010 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.010 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.010 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.010 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.904777+0000", 2023-09-30T17:04:38.010 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.010 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.010 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.904777+0000", 2023-09-30T17:04:38.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6e-07 2023-09-30T17:04:38.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.904786+0000", 2023-09-30T17:04:38.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8140000000000007e-06 2023-09-30T17:04:38.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.904789+0000", 2023-09-30T17:04:38.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.726e-06 2023-09-30T17:04:38.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.904793+0000", 2023-09-30T17:04:38.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.1470000000000001e-06 2023-09-30T17:04:38.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:38.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.913130+0000", 2023-09-30T17:04:38.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0083376809999999996 2023-09-30T17:04:38.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.013 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:38.013 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.913215+0000", 2023-09-30T17:04:38.013 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4461000000000003e-05 2023-09-30T17:04:38.013 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.013 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.013 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.013 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:177675 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.014 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.240083+0000", 2023-09-30T17:04:38.014 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.67073167, 2023-09-30T17:04:38.014 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.68242232999999997, 2023-09-30T17:04:38.014 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.014 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.014 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.014 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.014 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.014 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 177675 2023-09-30T17:04:38.014 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.014 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.015 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.240083+0000", 2023-09-30T17:04:38.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.015 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.015 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.240083+0000", 2023-09-30T17:04:38.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.015 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.240083+0000", 2023-09-30T17:04:38.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9999999999999998e-07 2023-09-30T17:04:38.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.240094+0000", 2023-09-30T17:04:38.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0727000000000001e-05 2023-09-30T17:04:38.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.240100+0000", 2023-09-30T17:04:38.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2389999999999999e-06 2023-09-30T17:04:38.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.240106+0000", 2023-09-30T17:04:38.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.609e-06 2023-09-30T17:04:38.017 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.017 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.017 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.018 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178108 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.018 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.366679+0000", 2023-09-30T17:04:38.018 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.54413522199999997, 2023-09-30T17:04:38.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.55588955200000001, 2023-09-30T17:04:38.018 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.018 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.018 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.018 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.018 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.018 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178108 2023-09-30T17:04:38.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.019 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.019 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.019 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.366679+0000", 2023-09-30T17:04:38.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.019 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.019 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.366679+0000", 2023-09-30T17:04:38.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.366680+0000", 2023-09-30T17:04:38.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.58e-07 2023-09-30T17:04:38.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.366693+0000", 2023-09-30T17:04:38.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3087e-05 2023-09-30T17:04:38.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.020 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.021 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.366700+0000", 2023-09-30T17:04:38.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2030000000000003e-06 2023-09-30T17:04:38.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.021 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.021 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.366706+0000", 2023-09-30T17:04:38.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7010000000000001e-06 2023-09-30T17:04:38.021 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.021 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.021 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.022 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.022 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178255 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.022 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.441684+0000", 2023-09-30T17:04:38.022 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.46913094399999999, 2023-09-30T17:04:38.022 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.48092679599999999, 2023-09-30T17:04:38.022 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.022 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.022 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.022 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.022 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.022 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178255 2023-09-30T17:04:38.023 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.023 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.023 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.023 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.023 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.441684+0000", 2023-09-30T17:04:38.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.023 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.023 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.023 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.023 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.441684+0000", 2023-09-30T17:04:38.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.024 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.024 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.441684+0000", 2023-09-30T17:04:38.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.39e-07 2023-09-30T17:04:38.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.024 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.024 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.441700+0000", 2023-09-30T17:04:38.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6138e-05 2023-09-30T17:04:38.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.025 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.025 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.441707+0000", 2023-09-30T17:04:38.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8800000000000002e-06 2023-09-30T17:04:38.025 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.025 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.025 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.025 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.441713+0000", 2023-09-30T17:04:38.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4890000000000003e-06 2023-09-30T17:04:38.025 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.025 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.026 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.026 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.026 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178484 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.026 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.547677+0000", 2023-09-30T17:04:38.026 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.363137245, 2023-09-30T17:04:38.026 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.37498219799999999, 2023-09-30T17:04:38.026 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.026 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.026 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.026 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.027 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.027 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178484 2023-09-30T17:04:38.027 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.027 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.027 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.027 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.547677+0000", 2023-09-30T17:04:38.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.027 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.027 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.028 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.547677+0000", 2023-09-30T17:04:38.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.028 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.028 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.028 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.028 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.547678+0000", 2023-09-30T17:04:38.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9200000000000002e-07 2023-09-30T17:04:38.028 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.028 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.028 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.028 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.547690+0000", 2023-09-30T17:04:38.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2533e-05 2023-09-30T17:04:38.029 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.029 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.029 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.547696+0000", 2023-09-30T17:04:38.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9349999999999999e-06 2023-09-30T17:04:38.029 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.029 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.029 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.547701+0000", 2023-09-30T17:04:38.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9699999999999998e-06 2023-09-30T17:04:38.030 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.030 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.030 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.030 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178854 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.030 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.667689+0000", 2023-09-30T17:04:38.030 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.2431258, 2023-09-30T17:04:38.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.25501786700000001, 2023-09-30T17:04:38.030 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.030 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.031 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.031 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.031 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.031 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178854 2023-09-30T17:04:38.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.031 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.667689+0000", 2023-09-30T17:04:38.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.032 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.032 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.667689+0000", 2023-09-30T17:04:38.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.032 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.032 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.667689+0000", 2023-09-30T17:04:38.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6300000000000001e-07 2023-09-30T17:04:38.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.032 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.033 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.667703+0000", 2023-09-30T17:04:38.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4081e-05 2023-09-30T17:04:38.033 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.033 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.033 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.033 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.667710+0000", 2023-09-30T17:04:38.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9870000000000002e-06 2023-09-30T17:04:38.033 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.033 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.034 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.034 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.667719+0000", 2023-09-30T17:04:38.034 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0129999999999999e-06 2023-09-30T17:04:38.034 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.034 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.034 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.034 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.034 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179134 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.034 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.771451+0000", 2023-09-30T17:04:38.034 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.139363292, 2023-09-30T17:04:38.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.15129608899999999, 2023-09-30T17:04:38.035 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.035 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.035 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.035 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.035 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.035 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179134 2023-09-30T17:04:38.035 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.035 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.035 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.035 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.035 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.771451+0000", 2023-09-30T17:04:38.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.036 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.771451+0000", 2023-09-30T17:04:38.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.036 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.776409+0000", 2023-09-30T17:04:38.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0049579359999999996 2023-09-30T17:04:38.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.037 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.776426+0000", 2023-09-30T17:04:38.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7263000000000001e-05 2023-09-30T17:04:38.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.037 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.776434+0000", 2023-09-30T17:04:38.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9680000000000006e-06 2023-09-30T17:04:38.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.038 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.038 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.776440+0000", 2023-09-30T17:04:38.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7320000000000003e-06 2023-09-30T17:04:38.038 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.038 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.038 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.038 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:177725 4.36 e58/17 4:6fa85f86:::100000001f8.00000013:head v 58'8362, mlcod=58'8349)", 2023-09-30T17:04:38.038 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.843839+0000", 2023-09-30T17:04:38.038 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.066975815999999994, 2023-09-30T17:04:38.039 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.078956224000000005, 2023-09-30T17:04:38.039 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.039 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:38.039 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.039 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.039 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.843839+0000", 2023-09-30T17:04:38.039 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.039 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.039 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.040 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.843839+0000", 2023-09-30T17:04:38.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.040 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.040 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.040 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.040 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.843839+0000", 2023-09-30T17:04:38.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4900000000000001e-07 2023-09-30T17:04:38.040 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.040 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.040 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.041 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.843851+0000", 2023-09-30T17:04:38.041 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1661000000000001e-05 2023-09-30T17:04:38.041 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.041 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.041 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.041 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.843858+0000", 2023-09-30T17:04:38.041 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8750000000000002e-06 2023-09-30T17:04:38.041 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.041 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.041 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.041 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.843862+0000", 2023-09-30T17:04:38.041 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7500000000000003e-06 2023-09-30T17:04:38.042 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.042 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.042 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:38.042 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.908819+0000", 2023-09-30T17:04:38.042 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.064956796999999997 2023-09-30T17:04:38.042 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.042 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.042 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:38.042 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.908839+0000", 2023-09-30T17:04:38.042 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9899999999999999e-05 2023-09-30T17:04:38.043 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.043 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.043 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.043 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.043 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.043 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179345 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.043 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.855791+0000", 2023-09-30T17:04:38.043 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.055023897000000002, 2023-09-30T17:04:38.043 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.067057813999999993, 2023-09-30T17:04:38.043 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.043 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.044 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.044 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.044 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.044 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179345 2023-09-30T17:04:38.044 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.044 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.044 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.044 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.044 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.855791+0000", 2023-09-30T17:04:38.044 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.044 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.044 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.045 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.045 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.855791+0000", 2023-09-30T17:04:38.045 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.045 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.045 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.045 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.045 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.855791+0000", 2023-09-30T17:04:38.045 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0900000000000002e-07 2023-09-30T17:04:38.045 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.045 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.045 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.046 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.855803+0000", 2023-09-30T17:04:38.046 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1958e-05 2023-09-30T17:04:38.046 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.046 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.046 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.046 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.855810+0000", 2023-09-30T17:04:38.046 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.007e-06 2023-09-30T17:04:38.046 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.046 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.046 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.046 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.855816+0000", 2023-09-30T17:04:38.046 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3589999999999996e-06 2023-09-30T17:04:38.047 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.047 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.047 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.047 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.047 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.047 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:177878 4.6 e58/17)", 2023-09-30T17:04:38.047 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.906361+0000", 2023-09-30T17:04:38.047 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0044538850000000003, 2023-09-30T17:04:38.047 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016525125000000002, 2023-09-30T17:04:38.047 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.048 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.048 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.048 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.048 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.048 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.906361+0000", 2023-09-30T17:04:38.048 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.048 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.048 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.048 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.048 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.906361+0000", 2023-09-30T17:04:38.048 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.048 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.049 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.049 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.049 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.906361+0000", 2023-09-30T17:04:38.049 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.1699999999999998e-07 2023-09-30T17:04:38.049 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.049 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.049 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.049 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.906380+0000", 2023-09-30T17:04:38.049 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9043999999999999e-05 2023-09-30T17:04:38.049 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.049 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.050 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.050 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.906391+0000", 2023-09-30T17:04:38.050 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0786e-05 2023-09-30T17:04:38.050 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.050 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.050 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.050 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.906398+0000", 2023-09-30T17:04:38.050 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4489999999999996e-06 2023-09-30T17:04:38.050 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.050 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.050 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.051 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.051 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.051 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:177677 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.051 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.240112+0000", 2023-09-30T17:04:38.051 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.67070251999999997, 2023-09-30T17:04:38.051 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.68281988800000004, 2023-09-30T17:04:38.051 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.051 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.051 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.051 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.051 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.052 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 177677 2023-09-30T17:04:38.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.052 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.052 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.052 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.240112+0000", 2023-09-30T17:04:38.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.052 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.052 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.240112+0000", 2023-09-30T17:04:38.053 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.053 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.053 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.053 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.053 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.240112+0000", 2023-09-30T17:04:38.053 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.5400000000000002e-07 2023-09-30T17:04:38.053 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.053 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.053 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.053 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.240124+0000", 2023-09-30T17:04:38.053 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1168999999999999e-05 2023-09-30T17:04:38.053 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.054 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.054 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.054 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.240130+0000", 2023-09-30T17:04:38.054 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7170000000000002e-06 2023-09-30T17:04:38.054 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.054 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.054 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.054 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.240135+0000", 2023-09-30T17:04:38.054 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8339999999999998e-06 2023-09-30T17:04:38.054 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.054 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.055 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.055 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.055 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.055 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178189 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.055 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.412568+0000", 2023-09-30T17:04:38.055 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.49824621800000002, 2023-09-30T17:04:38.055 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.51039533000000004, 2023-09-30T17:04:38.055 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.055 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.055 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.055 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.055 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.056 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178189 2023-09-30T17:04:38.056 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.056 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.056 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.056 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.056 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.412568+0000", 2023-09-30T17:04:38.056 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.056 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.056 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.056 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.056 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.412568+0000", 2023-09-30T17:04:38.057 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.057 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.057 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.057 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.057 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.418533+0000", 2023-09-30T17:04:38.057 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0059643090000000001 2023-09-30T17:04:38.057 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.057 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.057 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.057 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.418549+0000", 2023-09-30T17:04:38.057 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6257999999999999e-05 2023-09-30T17:04:38.057 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.058 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.058 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.058 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.418557+0000", 2023-09-30T17:04:38.058 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3729999999999993e-06 2023-09-30T17:04:38.058 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.058 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.058 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.058 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.418563+0000", 2023-09-30T17:04:38.058 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0499999999999997e-06 2023-09-30T17:04:38.058 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.058 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.058 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.059 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.059 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.059 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178486 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.059 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.547707+0000", 2023-09-30T17:04:38.059 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.36310710600000001, 2023-09-30T17:04:38.059 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.37528579000000001, 2023-09-30T17:04:38.059 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.059 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.059 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.059 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.059 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.060 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178486 2023-09-30T17:04:38.060 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.060 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.060 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.060 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.060 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.547707+0000", 2023-09-30T17:04:38.060 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.060 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.060 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.060 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.060 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.547707+0000", 2023-09-30T17:04:38.060 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.061 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.061 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.061 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.061 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.547708+0000", 2023-09-30T17:04:38.061 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5699999999999998e-07 2023-09-30T17:04:38.061 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.061 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.061 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.061 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.547724+0000", 2023-09-30T17:04:38.061 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5780000000000001e-05 2023-09-30T17:04:38.061 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.062 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.062 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.062 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.547730+0000", 2023-09-30T17:04:38.062 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0410000000000003e-06 2023-09-30T17:04:38.062 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.062 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.062 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.062 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.547734+0000", 2023-09-30T17:04:38.062 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7029999999999997e-06 2023-09-30T17:04:38.062 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.062 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.062 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.063 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.063 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.063 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179025 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.063 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.735316+0000", 2023-09-30T17:04:38.063 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.175498657, 2023-09-30T17:04:38.063 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.18770815699999999, 2023-09-30T17:04:38.063 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.063 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.063 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.063 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.063 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.064 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179025 2023-09-30T17:04:38.064 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.064 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.064 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.064 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.064 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.735316+0000", 2023-09-30T17:04:38.064 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.064 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.064 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.064 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.064 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.735316+0000", 2023-09-30T17:04:38.064 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.065 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.065 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.065 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.065 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.735316+0000", 2023-09-30T17:04:38.065 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9999999999999998e-07 2023-09-30T17:04:38.065 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.065 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.065 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.065 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.735329+0000", 2023-09-30T17:04:38.065 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2964e-05 2023-09-30T17:04:38.065 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.065 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.066 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.066 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.735336+0000", 2023-09-30T17:04:38.066 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4160000000000001e-06 2023-09-30T17:04:38.066 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.066 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.066 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.066 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.735341+0000", 2023-09-30T17:04:38.066 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1229999999999999e-06 2023-09-30T17:04:38.066 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.066 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.066 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.067 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.067 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.067 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179299 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.067 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.828667+0000", 2023-09-30T17:04:38.067 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.082148053999999998, 2023-09-30T17:04:38.067 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.094387134999999997, 2023-09-30T17:04:38.067 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.067 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.067 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.067 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.067 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.067 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179299 2023-09-30T17:04:38.068 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.068 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.068 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.068 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.068 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.828667+0000", 2023-09-30T17:04:38.068 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.068 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.068 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.068 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.068 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.828667+0000", 2023-09-30T17:04:38.068 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.069 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.069 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.069 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.069 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.828667+0000", 2023-09-30T17:04:38.069 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8100000000000003e-07 2023-09-30T17:04:38.069 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.069 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.069 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.069 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.828680+0000", 2023-09-30T17:04:38.069 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3366999999999999e-05 2023-09-30T17:04:38.069 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.070 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.070 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.070 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.828689+0000", 2023-09-30T17:04:38.070 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1200000000000008e-06 2023-09-30T17:04:38.070 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.070 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.070 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.070 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.828696+0000", 2023-09-30T17:04:38.070 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0719999999999996e-06 2023-09-30T17:04:38.070 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.071 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.071 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.071 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.071 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.071 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179423 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.071 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.904797+0000", 2023-09-30T17:04:38.071 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0060177800000000004, 2023-09-30T17:04:38.071 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018297191000000001, 2023-09-30T17:04:38.071 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.071 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.071 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.071 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.072 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.072 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179423 2023-09-30T17:04:38.072 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.072 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.072 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.072 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.072 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.904797+0000", 2023-09-30T17:04:38.072 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.072 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.072 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.072 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.073 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.904797+0000", 2023-09-30T17:04:38.073 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.073 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.073 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.073 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.073 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.906516+0000", 2023-09-30T17:04:38.073 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0017187630000000001 2023-09-30T17:04:38.073 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.073 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.073 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.073 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.906529+0000", 2023-09-30T17:04:38.073 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3254e-05 2023-09-30T17:04:38.074 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.074 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.074 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.074 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.906539+0000", 2023-09-30T17:04:38.074 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0366e-05 2023-09-30T17:04:38.074 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.074 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.074 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.074 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.906545+0000", 2023-09-30T17:04:38.074 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0340000000000002e-06 2023-09-30T17:04:38.074 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.075 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.075 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.075 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.075 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.075 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:177559 4.f 4:f26fdfa9:::100000001f8.00000002:head [write 3932160~4096 in=4096b,write 3985408~4096 in=4096b,write 4165632~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.075 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.198611+0000", 2023-09-30T17:04:38.075 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.712203684, 2023-09-30T17:04:38.075 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.72452186299999999, 2023-09-30T17:04:38.075 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.075 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:38.075 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.076 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.076 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.076 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 177559 2023-09-30T17:04:38.076 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.076 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.076 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.076 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.076 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.198611+0000", 2023-09-30T17:04:38.076 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.076 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.076 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.076 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.077 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.198611+0000", 2023-09-30T17:04:38.077 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.077 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.077 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.077 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.077 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.201758+0000", 2023-09-30T17:04:38.077 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0031473640000000002 2023-09-30T17:04:38.077 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.077 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.077 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.077 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.201771+0000", 2023-09-30T17:04:38.078 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.307e-05 2023-09-30T17:04:38.078 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.078 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.078 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.078 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.201780+0000", 2023-09-30T17:04:38.078 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.337e-06 2023-09-30T17:04:38.078 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.078 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.078 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.078 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.201787+0000", 2023-09-30T17:04:38.079 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.0979999999999996e-06 2023-09-30T17:04:38.079 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.079 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.079 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:38.079 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.896477+0000", 2023-09-30T17:04:38.079 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.69468986099999996 2023-09-30T17:04:38.079 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.079 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.079 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:38.079 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.896549+0000", 2023-09-30T17:04:38.079 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2831999999999997e-05 2023-09-30T17:04:38.080 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.080 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.080 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:38.080 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.896670+0000", 2023-09-30T17:04:38.080 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000120499 2023-09-30T17:04:38.080 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.080 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.080 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:38.080 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.908515+0000", 2023-09-30T17:04:38.080 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.011844722 2023-09-30T17:04:38.080 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.081 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.081 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.081 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.081 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.081 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:177848 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.081 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.286703+0000", 2023-09-30T17:04:38.081 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.62411134899999998, 2023-09-30T17:04:38.081 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.63647413900000005, 2023-09-30T17:04:38.081 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.081 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.081 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.082 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.082 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.082 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 177848 2023-09-30T17:04:38.082 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.082 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.082 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.082 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.082 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.286703+0000", 2023-09-30T17:04:38.082 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.082 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.083 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.083 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.083 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.286703+0000", 2023-09-30T17:04:38.083 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.083 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.083 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.083 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.083 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.286704+0000", 2023-09-30T17:04:38.083 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.7e-07 2023-09-30T17:04:38.083 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.084 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.084 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.084 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.286717+0000", 2023-09-30T17:04:38.084 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3327e-05 2023-09-30T17:04:38.084 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.084 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.084 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.084 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.286723+0000", 2023-09-30T17:04:38.084 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0900000000000001e-06 2023-09-30T17:04:38.084 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.084 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.085 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.085 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.286728+0000", 2023-09-30T17:04:38.085 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5519999999999998e-06 2023-09-30T17:04:38.085 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.085 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.085 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.085 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.085 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.085 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178111 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.085 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.366762+0000", 2023-09-30T17:04:38.085 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.54405258999999995, 2023-09-30T17:04:38.086 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.55644518700000001, 2023-09-30T17:04:38.086 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.086 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.086 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.086 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.086 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.086 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178111 2023-09-30T17:04:38.086 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.086 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.086 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.086 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.086 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.366762+0000", 2023-09-30T17:04:38.087 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.087 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.087 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.087 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.087 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.366762+0000", 2023-09-30T17:04:38.087 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.087 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.087 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.087 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.087 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.366762+0000", 2023-09-30T17:04:38.087 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5299999999999999e-07 2023-09-30T17:04:38.088 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.088 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.088 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.088 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.366779+0000", 2023-09-30T17:04:38.088 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6223e-05 2023-09-30T17:04:38.088 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.088 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.088 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.088 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.366786+0000", 2023-09-30T17:04:38.088 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9149999999999999e-06 2023-09-30T17:04:38.088 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.089 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.089 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.089 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.366792+0000", 2023-09-30T17:04:38.089 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7789999999999998e-06 2023-09-30T17:04:38.089 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.089 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.089 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.089 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.089 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.089 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178257 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.089 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.441757+0000", 2023-09-30T17:04:38.089 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.46905728400000002, 2023-09-30T17:04:38.090 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.48150279200000001, 2023-09-30T17:04:38.090 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.090 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.090 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.090 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.090 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.090 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178257 2023-09-30T17:04:38.090 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.090 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.090 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.090 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.091 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.441757+0000", 2023-09-30T17:04:38.091 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.091 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.091 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.091 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.091 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.441757+0000", 2023-09-30T17:04:38.091 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.091 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.091 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.091 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.091 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.441758+0000", 2023-09-30T17:04:38.091 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5699999999999998e-07 2023-09-30T17:04:38.092 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.092 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.092 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.092 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.441770+0000", 2023-09-30T17:04:38.092 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1761e-05 2023-09-30T17:04:38.092 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.092 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.092 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.092 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.441776+0000", 2023-09-30T17:04:38.093 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6819999999999997e-06 2023-09-30T17:04:38.093 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.093 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.093 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.093 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.441782+0000", 2023-09-30T17:04:38.093 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3290000000000001e-06 2023-09-30T17:04:38.093 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.093 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.093 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.093 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.093 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.094 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178466 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.094 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.532607+0000", 2023-09-30T17:04:38.094 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.37820719400000002, 2023-09-30T17:04:38.094 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.39070950999999998, 2023-09-30T17:04:38.094 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.094 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.094 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.094 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.094 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.094 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178466 2023-09-30T17:04:38.094 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.095 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.095 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.095 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.095 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.532607+0000", 2023-09-30T17:04:38.095 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.095 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.095 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.095 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.095 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.532607+0000", 2023-09-30T17:04:38.095 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.095 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.095 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.096 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.096 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.532608+0000", 2023-09-30T17:04:38.096 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8599999999999998e-07 2023-09-30T17:04:38.096 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.096 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.096 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.096 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.532620+0000", 2023-09-30T17:04:38.096 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1973999999999999e-05 2023-09-30T17:04:38.096 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.096 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.096 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.097 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.532627+0000", 2023-09-30T17:04:38.097 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7159999999999997e-06 2023-09-30T17:04:38.097 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.097 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.097 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.097 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.532632+0000", 2023-09-30T17:04:38.097 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8309999999999997e-06 2023-09-30T17:04:38.097 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.097 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.097 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.098 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.098 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.098 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178487 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.098 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.547740+0000", 2023-09-30T17:04:38.098 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.36307415399999998, 2023-09-30T17:04:38.098 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.37563208999999997, 2023-09-30T17:04:38.098 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.098 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.098 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.098 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.098 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.099 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178487 2023-09-30T17:04:38.099 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.099 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.099 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.099 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.099 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.547740+0000", 2023-09-30T17:04:38.099 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.099 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.099 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.099 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.099 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.547740+0000", 2023-09-30T17:04:38.100 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.100 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.100 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.100 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.100 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.547741+0000", 2023-09-30T17:04:38.100 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1600000000000002e-07 2023-09-30T17:04:38.100 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.100 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.100 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.100 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.547763+0000", 2023-09-30T17:04:38.100 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.2379e-05 2023-09-30T17:04:38.101 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.101 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.101 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.101 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.547770+0000", 2023-09-30T17:04:38.101 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8680000000000001e-06 2023-09-30T17:04:38.101 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.101 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.101 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.101 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.547775+0000", 2023-09-30T17:04:38.101 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7310000000000001e-06 2023-09-30T17:04:38.101 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.101 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.102 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.102 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.102 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.102 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178716 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.102 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.621342+0000", 2023-09-30T17:04:38.102 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.28947234999999999, 2023-09-30T17:04:38.102 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.30208516800000002, 2023-09-30T17:04:38.102 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.102 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.102 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.102 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.102 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.103 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178716 2023-09-30T17:04:38.103 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.103 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.103 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.103 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.103 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.621342+0000", 2023-09-30T17:04:38.103 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.103 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.103 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.103 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.103 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.621342+0000", 2023-09-30T17:04:38.103 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.104 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.104 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.104 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.104 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.624517+0000", 2023-09-30T17:04:38.104 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0031743409999999998 2023-09-30T17:04:38.104 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.104 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.104 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.104 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.624532+0000", 2023-09-30T17:04:38.104 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5067e-05 2023-09-30T17:04:38.104 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.105 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.105 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.105 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.624540+0000", 2023-09-30T17:04:38.105 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6980000000000004e-06 2023-09-30T17:04:38.105 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.105 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.105 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.105 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.624547+0000", 2023-09-30T17:04:38.105 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4640000000000003e-06 2023-09-30T17:04:38.105 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.105 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.105 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.106 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.106 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.106 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178922 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.106 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.693624+0000", 2023-09-30T17:04:38.106 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.21719060600000001, 2023-09-30T17:04:38.106 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.22986195400000001, 2023-09-30T17:04:38.106 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.106 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.106 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.106 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.106 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.107 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178922 2023-09-30T17:04:38.107 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.107 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.107 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.107 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.107 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.693624+0000", 2023-09-30T17:04:38.107 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.107 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.107 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.107 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.107 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.693624+0000", 2023-09-30T17:04:38.108 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.108 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.108 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.108 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.108 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.693624+0000", 2023-09-30T17:04:38.108 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2e-07 2023-09-30T17:04:38.108 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.108 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.110 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.111 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.693637+0000", 2023-09-30T17:04:38.111 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2412000000000001e-05 2023-09-30T17:04:38.111 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.111 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.111 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.111 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.693645+0000", 2023-09-30T17:04:38.111 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9079999999999995e-06 2023-09-30T17:04:38.111 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.111 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.111 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.111 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.693650+0000", 2023-09-30T17:04:38.112 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6760000000000004e-06 2023-09-30T17:04:38.112 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.112 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.112 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.112 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.112 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.112 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179028 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.112 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.735350+0000", 2023-09-30T17:04:38.112 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.175464383, 2023-09-30T17:04:38.112 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.18819314400000001, 2023-09-30T17:04:38.112 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.112 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.113 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.113 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.113 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.113 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179028 2023-09-30T17:04:38.113 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.113 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.113 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.113 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.113 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.735350+0000", 2023-09-30T17:04:38.113 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.113 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.113 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.114 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.114 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.735350+0000", 2023-09-30T17:04:38.114 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.114 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.114 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.114 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.114 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.735351+0000", 2023-09-30T17:04:38.114 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9800000000000004e-07 2023-09-30T17:04:38.114 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.114 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.114 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.115 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.735362+0000", 2023-09-30T17:04:38.115 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1782e-05 2023-09-30T17:04:38.115 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.115 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.115 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.115 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.735369+0000", 2023-09-30T17:04:38.115 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6549999999999998e-06 2023-09-30T17:04:38.115 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.115 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.115 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.115 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.735374+0000", 2023-09-30T17:04:38.115 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2410000000000003e-06 2023-09-30T17:04:38.116 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.116 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.116 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.116 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.116 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.116 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179143 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.116 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.776489+0000", 2023-09-30T17:04:38.116 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.134325375, 2023-09-30T17:04:38.116 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.14711856800000001, 2023-09-30T17:04:38.116 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.116 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.116 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.117 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.117 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.117 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179143 2023-09-30T17:04:38.117 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.117 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.117 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.117 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.117 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.776489+0000", 2023-09-30T17:04:38.117 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.118 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.118 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.118 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.118 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.776489+0000", 2023-09-30T17:04:38.118 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.118 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.118 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.118 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.118 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.776490+0000", 2023-09-30T17:04:38.118 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2100000000000002e-07 2023-09-30T17:04:38.118 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.119 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.119 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.119 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.776501+0000", 2023-09-30T17:04:38.119 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.115e-05 2023-09-30T17:04:38.119 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.119 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.119 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.119 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.776507+0000", 2023-09-30T17:04:38.119 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5169999999999996e-06 2023-09-30T17:04:38.119 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.119 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.119 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.120 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.776516+0000", 2023-09-30T17:04:38.120 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9740000000000008e-06 2023-09-30T17:04:38.120 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.120 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.120 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.120 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.120 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.120 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179213 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.120 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.802580+0000", 2023-09-30T17:04:38.120 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.10823466299999999, 2023-09-30T17:04:38.120 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.121088616, 2023-09-30T17:04:38.120 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.121 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.121 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.121 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.121 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.121 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179213 2023-09-30T17:04:38.121 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.121 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.121 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.121 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.121 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.802580+0000", 2023-09-30T17:04:38.121 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.121 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.122 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.122 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.122 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.802580+0000", 2023-09-30T17:04:38.122 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.122 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.122 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.122 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.122 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.802581+0000", 2023-09-30T17:04:38.122 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3499999999999996e-07 2023-09-30T17:04:38.122 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.122 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.122 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.123 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.802595+0000", 2023-09-30T17:04:38.123 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4863e-05 2023-09-30T17:04:38.123 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.123 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.123 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.123 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.802603+0000", 2023-09-30T17:04:38.123 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4410000000000004e-06 2023-09-30T17:04:38.123 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.123 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.123 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.123 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.802610+0000", 2023-09-30T17:04:38.124 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9280000000000004e-06 2023-09-30T17:04:38.124 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.124 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.124 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.124 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.124 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.124 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179260 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.124 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.812958+0000", 2023-09-30T17:04:38.124 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.097856645000000006, 2023-09-30T17:04:38.124 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.110773594, 2023-09-30T17:04:38.124 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.124 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.125 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.125 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.125 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.125 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179260 2023-09-30T17:04:38.125 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.125 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.125 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.125 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.125 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.812958+0000", 2023-09-30T17:04:38.125 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.125 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.125 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.126 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.126 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.812958+0000", 2023-09-30T17:04:38.126 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.126 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.126 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.126 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.126 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.814516+0000", 2023-09-30T17:04:38.126 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0015578009999999999 2023-09-30T17:04:38.126 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.126 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.126 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.127 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.814533+0000", 2023-09-30T17:04:38.127 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7487999999999999e-05 2023-09-30T17:04:38.127 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.127 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.127 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.127 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.814544+0000", 2023-09-30T17:04:38.127 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0338e-05 2023-09-30T17:04:38.127 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.127 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.127 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.127 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.814551+0000", 2023-09-30T17:04:38.127 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2400000000000001e-06 2023-09-30T17:04:38.128 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.128 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.128 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.128 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.128 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.128 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179409 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.128 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.893127+0000", 2023-09-30T17:04:38.128 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.017687333999999999, 2023-09-30T17:04:38.128 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.030668164000000001, 2023-09-30T17:04:38.128 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.128 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.128 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.129 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.129 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.129 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179409 2023-09-30T17:04:38.129 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.129 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.129 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.129 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.129 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.893127+0000", 2023-09-30T17:04:38.129 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.129 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.129 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.129 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.130 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.893127+0000", 2023-09-30T17:04:38.130 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.130 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.130 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.130 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.130 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.893128+0000", 2023-09-30T17:04:38.130 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8999999999999997e-07 2023-09-30T17:04:38.130 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.130 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.130 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.130 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.893141+0000", 2023-09-30T17:04:38.130 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2968e-05 2023-09-30T17:04:38.131 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.131 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.131 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.131 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.893148+0000", 2023-09-30T17:04:38.131 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6930000000000007e-06 2023-09-30T17:04:38.131 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.131 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.131 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.131 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.893154+0000", 2023-09-30T17:04:38.131 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7690000000000002e-06 2023-09-30T17:04:38.131 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.132 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.132 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.132 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.132 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.132 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:177642 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.132 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.229625+0000", 2023-09-30T17:04:38.132 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.68118925600000002, 2023-09-30T17:04:38.132 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.69423100100000001, 2023-09-30T17:04:38.132 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.132 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.132 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.132 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.133 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.133 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 177642 2023-09-30T17:04:38.133 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.133 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.133 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.133 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.229625+0000", 2023-09-30T17:04:38.133 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.133 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.133 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.133 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.133 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.229625+0000", 2023-09-30T17:04:38.134 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.134 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.134 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.134 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.134 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.231626+0000", 2023-09-30T17:04:38.134 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0020006020000000002 2023-09-30T17:04:38.134 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.134 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.134 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.134 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.231645+0000", 2023-09-30T17:04:38.134 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9470000000000002e-05 2023-09-30T17:04:38.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.135 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.135 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.135 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.231654+0000", 2023-09-30T17:04:38.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5010000000000004e-06 2023-09-30T17:04:38.135 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.135 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.135 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.135 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.231661+0000", 2023-09-30T17:04:38.135 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9410000000000001e-06 2023-09-30T17:04:38.135 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.135 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.136 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.136 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.136 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.136 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178134 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.136 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.384577+0000", 2023-09-30T17:04:38.136 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.52623732700000003, 2023-09-30T17:04:38.136 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.53934488400000002, 2023-09-30T17:04:38.136 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.136 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.136 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.136 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.137 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.137 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178134 2023-09-30T17:04:38.137 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.137 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.137 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.137 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.137 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.384577+0000", 2023-09-30T17:04:38.137 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.137 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.137 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.137 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.138 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.384577+0000", 2023-09-30T17:04:38.138 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.138 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.138 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.138 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.138 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.387490+0000", 2023-09-30T17:04:38.138 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0029124099999999998 2023-09-30T17:04:38.138 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.138 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.138 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.138 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.387503+0000", 2023-09-30T17:04:38.139 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2935000000000001e-05 2023-09-30T17:04:38.139 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.139 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.139 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.139 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.387516+0000", 2023-09-30T17:04:38.139 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3030999999999999e-05 2023-09-30T17:04:38.139 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.139 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.139 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.139 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.387522+0000", 2023-09-30T17:04:38.139 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0950000000000001e-06 2023-09-30T17:04:38.139 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.140 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.140 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.140 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.140 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.140 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178225 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.140 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.433560+0000", 2023-09-30T17:04:38.140 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.477255015, 2023-09-30T17:04:38.140 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.49042618399999999, 2023-09-30T17:04:38.140 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.140 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.140 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.140 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.141 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.141 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178225 2023-09-30T17:04:38.141 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.141 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.141 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.141 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.141 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.433560+0000", 2023-09-30T17:04:38.141 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.141 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.141 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.142 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.142 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.433560+0000", 2023-09-30T17:04:38.142 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.142 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.142 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.142 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.142 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.433560+0000", 2023-09-30T17:04:38.142 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1600000000000001e-07 2023-09-30T17:04:38.142 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.142 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.142 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.142 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.433576+0000", 2023-09-30T17:04:38.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5571999999999999e-05 2023-09-30T17:04:38.143 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.143 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.143 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.143 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.433582+0000", 2023-09-30T17:04:38.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5509999999999996e-06 2023-09-30T17:04:38.143 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.143 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.143 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.143 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.433588+0000", 2023-09-30T17:04:38.143 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6690000000000003e-06 2023-09-30T17:04:38.144 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.144 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.144 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.144 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.144 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.144 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178717 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.144 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.624557+0000", 2023-09-30T17:04:38.144 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.28625718100000003, 2023-09-30T17:04:38.144 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.299489954, 2023-09-30T17:04:38.144 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.144 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.144 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.145 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.145 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.145 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178717 2023-09-30T17:04:38.145 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.145 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.145 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.145 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.145 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.624557+0000", 2023-09-30T17:04:38.145 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.145 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.145 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.146 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.146 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.624557+0000", 2023-09-30T17:04:38.146 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.146 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.146 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.146 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.146 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.624558+0000", 2023-09-30T17:04:38.146 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7700000000000005e-07 2023-09-30T17:04:38.146 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.146 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.146 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.147 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.624570+0000", 2023-09-30T17:04:38.147 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2274e-05 2023-09-30T17:04:38.147 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.147 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.147 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.147 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.624576+0000", 2023-09-30T17:04:38.147 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3380000000000001e-06 2023-09-30T17:04:38.147 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.147 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.147 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.147 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.624582+0000", 2023-09-30T17:04:38.147 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2490000000000001e-06 2023-09-30T17:04:38.148 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.148 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.148 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.148 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.148 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.148 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179261 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.148 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.814563+0000", 2023-09-30T17:04:38.148 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.096251623999999994, 2023-09-30T17:04:38.148 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.10954517499999999, 2023-09-30T17:04:38.148 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.148 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.148 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.149 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.149 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.149 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179261 2023-09-30T17:04:38.149 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.149 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.149 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.149 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.149 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.814563+0000", 2023-09-30T17:04:38.149 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.149 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.149 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.149 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.150 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.814563+0000", 2023-09-30T17:04:38.150 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.150 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.150 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.150 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.150 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.814563+0000", 2023-09-30T17:04:38.150 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2900000000000004e-07 2023-09-30T17:04:38.150 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.150 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.150 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.150 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.814576+0000", 2023-09-30T17:04:38.151 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2680999999999999e-05 2023-09-30T17:04:38.151 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.151 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.151 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.151 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.814583+0000", 2023-09-30T17:04:38.151 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6150000000000002e-06 2023-09-30T17:04:38.151 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.151 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.151 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.151 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.814588+0000", 2023-09-30T17:04:38.151 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.045e-06 2023-09-30T17:04:38.151 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.152 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.152 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.152 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.152 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.152 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179350 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.152 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.855896+0000", 2023-09-30T17:04:38.152 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.054918716999999999, 2023-09-30T17:04:38.152 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.068276167999999998, 2023-09-30T17:04:38.152 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.152 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.152 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.153 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.153 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.153 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179350 2023-09-30T17:04:38.153 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.153 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.153 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.153 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.153 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.855896+0000", 2023-09-30T17:04:38.153 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.153 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.154 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.154 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.154 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.855896+0000", 2023-09-30T17:04:38.154 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.154 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.154 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.154 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.154 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.855896+0000", 2023-09-30T17:04:38.154 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8599999999999998e-07 2023-09-30T17:04:38.154 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.154 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.155 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.155 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.855911+0000", 2023-09-30T17:04:38.155 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4704e-05 2023-09-30T17:04:38.155 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.155 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.155 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.155 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.855918+0000", 2023-09-30T17:04:38.155 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8009999999999998e-06 2023-09-30T17:04:38.167 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.167 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.167 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.167 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.855923+0000", 2023-09-30T17:04:38.167 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6879999999999998e-06 2023-09-30T17:04:38.167 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.167 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.167 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.168 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.168 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.168 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179410 4.38 4:1dcf718c:::100000001f8.00000022:head [write 770048~4096 in=4096b,write 1552384~4096 in=4096b,write 1564672~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.168 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.893163+0000", 2023-09-30T17:04:38.168 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.017651732, 2023-09-30T17:04:38.168 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.031078113000000001, 2023-09-30T17:04:38.168 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.168 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "started", 2023-09-30T17:04:38.168 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.168 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.168 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.169 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179410 2023-09-30T17:04:38.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.169 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.893163+0000", 2023-09-30T17:04:38.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.169 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.169 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.169 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.169 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.893163+0000", 2023-09-30T17:04:38.169 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.170 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.170 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.893163+0000", 2023-09-30T17:04:38.170 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7599999999999997e-07 2023-09-30T17:04:38.170 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.170 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.170 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.170 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.893179+0000", 2023-09-30T17:04:38.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5934e-05 2023-09-30T17:04:38.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.893189+0000", 2023-09-30T17:04:38.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2569999999999996e-06 2023-09-30T17:04:38.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.171 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.171 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.171 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.893194+0000", 2023-09-30T17:04:38.171 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7980000000000002e-06 2023-09-30T17:04:38.171 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.172 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:38.172 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.902146+0000", 2023-09-30T17:04:38.172 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0089512280000000003 2023-09-30T17:04:38.172 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.172 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.172 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:38.172 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.902233+0000", 2023-09-30T17:04:38.172 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6981e-05 2023-09-30T17:04:38.172 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.172 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.173 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.173 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.173 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.173 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179425 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.173 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.906600+0000", 2023-09-30T17:04:38.173 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.004214649, 2023-09-30T17:04:38.173 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017714807999999999, 2023-09-30T17:04:38.173 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.173 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.173 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.173 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.173 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.174 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179425 2023-09-30T17:04:38.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.174 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.906600+0000", 2023-09-30T17:04:38.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.174 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.174 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.174 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.174 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.906600+0000", 2023-09-30T17:04:38.174 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.175 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.175 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.906600+0000", 2023-09-30T17:04:38.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9400000000000001e-07 2023-09-30T17:04:38.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.175 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.175 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.906614+0000", 2023-09-30T17:04:38.175 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3682999999999999e-05 2023-09-30T17:04:38.175 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.175 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.906620+0000", 2023-09-30T17:04:38.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.224e-06 2023-09-30T17:04:38.176 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.176 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.176 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.176 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.906625+0000", 2023-09-30T17:04:38.176 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6589999999999998e-06 2023-09-30T17:04:38.176 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.177 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.177 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.177 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.177 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.177 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:177564 4.f 4:f0d983b2:::100000001f8.0000001f:head [write 331776~4096 in=4096b,write 348160~4096 in=4096b,write 368640~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.177 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.201840+0000", 2023-09-30T17:04:38.177 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.70897489599999997, 2023-09-30T17:04:38.178 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.72254531399999999, 2023-09-30T17:04:38.178 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.178 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:38.178 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.178 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.178 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.178 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 177564 2023-09-30T17:04:38.178 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.178 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.178 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.201840+0000", 2023-09-30T17:04:38.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.179 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.179 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.201840+0000", 2023-09-30T17:04:38.179 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.179 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.179 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.180 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.180 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.205517+0000", 2023-09-30T17:04:38.180 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0036774429999999999 2023-09-30T17:04:38.180 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.180 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.180 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.181 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.205535+0000", 2023-09-30T17:04:38.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7955999999999999e-05 2023-09-30T17:04:38.181 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.181 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.181 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.181 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.205546+0000", 2023-09-30T17:04:38.181 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1205e-05 2023-09-30T17:04:38.181 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.181 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.181 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.182 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.205555+0000", 2023-09-30T17:04:38.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.935e-06 2023-09-30T17:04:38.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.182 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:38.182 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.899351+0000", 2023-09-30T17:04:38.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.69379574600000005 2023-09-30T17:04:38.182 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.182 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.182 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:38.182 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.899443+0000", 2023-09-30T17:04:38.182 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.2380999999999995e-05 2023-09-30T17:04:38.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:38.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.899620+0000", 2023-09-30T17:04:38.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00017689600000000001 2023-09-30T17:04:38.183 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.183 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.183 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:38.183 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.921641+0000", 2023-09-30T17:04:38.183 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022020307999999999 2023-09-30T17:04:38.184 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.184 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.184 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.184 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.184 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.184 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:177967 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.184 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.324605+0000", 2023-09-30T17:04:38.184 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.58620955399999997, 2023-09-30T17:04:38.184 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.599866338, 2023-09-30T17:04:38.184 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.184 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.184 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.185 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.185 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.185 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 177967 2023-09-30T17:04:38.185 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.185 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.185 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.185 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.185 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.324605+0000", 2023-09-30T17:04:38.185 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.185 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.185 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.185 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.186 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.324605+0000", 2023-09-30T17:04:38.186 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.192 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.324605+0000", 2023-09-30T17:04:38.192 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9999999999999998e-07 2023-09-30T17:04:38.192 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.192 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.192 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.192 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.324617+0000", 2023-09-30T17:04:38.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1955e-05 2023-09-30T17:04:38.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.324623+0000", 2023-09-30T17:04:38.193 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0800000000000002e-06 2023-09-30T17:04:38.193 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.193 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.193 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.193 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.324629+0000", 2023-09-30T17:04:38.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.9819999999999996e-06 2023-09-30T17:04:38.194 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.194 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.194 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.194 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.194 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.194 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:177997 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.194 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.336727+0000", 2023-09-30T17:04:38.194 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.57408733700000003, 2023-09-30T17:04:38.194 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.58780518400000004, 2023-09-30T17:04:38.194 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.194 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.195 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.195 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.195 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.195 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 177997 2023-09-30T17:04:38.195 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.195 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.195 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.195 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.195 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.336727+0000", 2023-09-30T17:04:38.195 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.195 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.196 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.196 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.196 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.336727+0000", 2023-09-30T17:04:38.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.196 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.196 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.196 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.196 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.336728+0000", 2023-09-30T17:04:38.196 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1799999999999995e-07 2023-09-30T17:04:38.196 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.196 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.197 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.197 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.336739+0000", 2023-09-30T17:04:38.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1642e-05 2023-09-30T17:04:38.197 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.197 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.197 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.336747+0000", 2023-09-30T17:04:38.197 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4549999999999998e-06 2023-09-30T17:04:38.197 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.197 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.197 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.198 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.336752+0000", 2023-09-30T17:04:38.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.5480000000000001e-06 2023-09-30T17:04:38.198 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.198 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.198 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.198 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.198 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.198 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178027 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.198 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.344707+0000", 2023-09-30T17:04:38.198 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.56610727699999996, 2023-09-30T17:04:38.198 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.57988089799999998, 2023-09-30T17:04:38.199 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.199 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.199 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.199 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.199 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.199 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178027 2023-09-30T17:04:38.199 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.199 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.199 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.199 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.199 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.344707+0000", 2023-09-30T17:04:38.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.201 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.201 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.344707+0000", 2023-09-30T17:04:38.201 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.201 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.201 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.202 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.202 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.346777+0000", 2023-09-30T17:04:38.202 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0020699310000000001 2023-09-30T17:04:38.202 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.202 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.202 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.346797+0000", 2023-09-30T17:04:38.202 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0156000000000001e-05 2023-09-30T17:04:38.202 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.202 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.202 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.203 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.346807+0000", 2023-09-30T17:04:38.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.5899999999999997e-06 2023-09-30T17:04:38.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.203 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.203 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.203 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.346814+0000", 2023-09-30T17:04:38.203 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1840000000000002e-06 2023-09-30T17:04:38.203 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.203 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.203 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.203 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.203 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.204 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178226 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.204 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.433596+0000", 2023-09-30T17:04:38.204 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.477218378, 2023-09-30T17:04:38.204 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.49104566399999999, 2023-09-30T17:04:38.204 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.204 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.204 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.204 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.204 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.204 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178226 2023-09-30T17:04:38.205 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.205 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.205 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.205 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.433596+0000", 2023-09-30T17:04:38.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.205 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.205 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.205 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.205 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.433596+0000", 2023-09-30T17:04:38.205 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.206 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.206 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.433597+0000", 2023-09-30T17:04:38.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2900000000000004e-07 2023-09-30T17:04:38.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.206 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.206 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.206 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.433609+0000", 2023-09-30T17:04:38.206 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2741999999999999e-05 2023-09-30T17:04:38.206 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.207 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.207 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.433616+0000", 2023-09-30T17:04:38.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.7599999999999997e-06 2023-09-30T17:04:38.207 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.207 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.207 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.207 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.433622+0000", 2023-09-30T17:04:38.207 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6219999999999997e-06 2023-09-30T17:04:38.207 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.207 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.208 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.208 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.208 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.208 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178296 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.208 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.456661+0000", 2023-09-30T17:04:38.208 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.45415339799999999, 2023-09-30T17:04:38.208 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.46803527900000003, 2023-09-30T17:04:38.208 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.208 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.208 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.208 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.209 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.209 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178296 2023-09-30T17:04:38.209 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.209 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.209 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.209 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.456661+0000", 2023-09-30T17:04:38.209 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.209 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.209 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.209 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.209 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.456661+0000", 2023-09-30T17:04:38.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.210 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.210 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.460516+0000", 2023-09-30T17:04:38.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0038544709999999999 2023-09-30T17:04:38.210 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.210 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.210 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.210 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.460530+0000", 2023-09-30T17:04:38.210 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4609e-05 2023-09-30T17:04:38.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.460541+0000", 2023-09-30T17:04:38.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0791999999999999e-05 2023-09-30T17:04:38.211 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.211 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.211 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.211 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.460548+0000", 2023-09-30T17:04:38.211 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3710000000000002e-06 2023-09-30T17:04:38.211 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.211 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.212 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.212 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.212 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.212 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178407 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.212 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.502548+0000", 2023-09-30T17:04:38.212 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.40826657100000002, 2023-09-30T17:04:38.212 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.42220232400000002, 2023-09-30T17:04:38.212 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.212 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.212 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.212 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.213 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.213 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178407 2023-09-30T17:04:38.213 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.213 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.213 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.213 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.213 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.502548+0000", 2023-09-30T17:04:38.213 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.213 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.213 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.213 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.214 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.502548+0000", 2023-09-30T17:04:38.214 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.214 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.214 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.214 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.504514+0000", 2023-09-30T17:04:38.214 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019662120000000002 2023-09-30T17:04:38.214 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.214 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.214 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.214 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.504529+0000", 2023-09-30T17:04:38.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4399999999999999e-05 2023-09-30T17:04:38.215 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.215 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.504540+0000", 2023-09-30T17:04:38.215 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1092e-05 2023-09-30T17:04:38.215 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.215 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.215 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.215 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.504547+0000", 2023-09-30T17:04:38.216 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.537e-06 2023-09-30T17:04:38.216 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.216 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.216 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.216 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.216 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.216 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178432 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.216 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.518836+0000", 2023-09-30T17:04:38.216 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.39197897599999998, 2023-09-30T17:04:38.216 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.40597786499999999, 2023-09-30T17:04:38.216 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.217 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.217 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.217 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.217 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.217 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178432 2023-09-30T17:04:38.217 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.217 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.217 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.217 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.217 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.518836+0000", 2023-09-30T17:04:38.217 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.218 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.218 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.218 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.218 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.518836+0000", 2023-09-30T17:04:38.218 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.218 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.218 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.218 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.218 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.520514+0000", 2023-09-30T17:04:38.218 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0016783709999999999 2023-09-30T17:04:38.218 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.219 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.219 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.520530+0000", 2023-09-30T17:04:38.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6286999999999998e-05 2023-09-30T17:04:38.219 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.219 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.219 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.520537+0000", 2023-09-30T17:04:38.219 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8210000000000004e-06 2023-09-30T17:04:38.219 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.219 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.220 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.220 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.520544+0000", 2023-09-30T17:04:38.220 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.153e-06 2023-09-30T17:04:38.220 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.220 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.220 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.220 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.220 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.220 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178973 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.220 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.703612+0000", 2023-09-30T17:04:38.221 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.20720303000000001, 2023-09-30T17:04:38.221 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.22125678500000001, 2023-09-30T17:04:38.221 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.221 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.221 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.221 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.221 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.221 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178973 2023-09-30T17:04:38.221 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.221 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.221 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.222 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.222 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.703612+0000", 2023-09-30T17:04:38.222 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.222 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.222 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.222 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.222 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.703612+0000", 2023-09-30T17:04:38.222 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.222 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.222 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.222 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.703612+0000", 2023-09-30T17:04:38.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0999999999999999e-07 2023-09-30T17:04:38.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.223 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.703630+0000", 2023-09-30T17:04:38.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8430000000000001e-05 2023-09-30T17:04:38.223 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.223 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.223 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.223 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.703639+0000", 2023-09-30T17:04:38.223 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1550000000000007e-06 2023-09-30T17:04:38.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.224 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.224 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.224 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.703645+0000", 2023-09-30T17:04:38.224 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2670000000000003e-06 2023-09-30T17:04:38.224 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.224 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.224 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.224 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.224 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.225 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179149 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.225 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.776556+0000", 2023-09-30T17:04:38.225 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.13425810899999999, 2023-09-30T17:04:38.225 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.14837778400000001, 2023-09-30T17:04:38.225 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.225 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.225 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.225 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.225 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.225 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179149 2023-09-30T17:04:38.226 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.226 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.226 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.226 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.226 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.776556+0000", 2023-09-30T17:04:38.226 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.226 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.226 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.226 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.226 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.776556+0000", 2023-09-30T17:04:38.226 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.776557+0000", 2023-09-30T17:04:38.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.51e-07 2023-09-30T17:04:38.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.227 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.227 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.227 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.776575+0000", 2023-09-30T17:04:38.227 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7628000000000001e-05 2023-09-30T17:04:38.227 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.228 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.228 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.228 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.776581+0000", 2023-09-30T17:04:38.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9519999999999997e-06 2023-09-30T17:04:38.228 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.228 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.228 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.228 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.776588+0000", 2023-09-30T17:04:38.228 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2600000000000002e-06 2023-09-30T17:04:38.228 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.228 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.229 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.229 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.229 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_repop(client.4547.0:177809 4.6 e58/17)", 2023-09-30T17:04:38.229 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.874734+0000", 2023-09-30T17:04:38.229 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.036080917999999997, 2023-09-30T17:04:38.229 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.050253853000000001, 2023-09-30T17:04:38.229 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.229 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.229 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.229 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.230 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.230 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.874734+0000", 2023-09-30T17:04:38.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.230 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.230 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.230 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.874734+0000", 2023-09-30T17:04:38.230 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.230 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.230 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.230 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.874734+0000", 2023-09-30T17:04:38.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2600000000000002e-07 2023-09-30T17:04:38.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.231 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.874764+0000", 2023-09-30T17:04:38.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.968e-05 2023-09-30T17:04:38.231 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.231 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.231 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.231 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.874779+0000", 2023-09-30T17:04:38.231 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4800000000000001e-05 2023-09-30T17:04:38.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.232 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.232 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.874787+0000", 2023-09-30T17:04:38.232 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9319999999999996e-06 2023-09-30T17:04:38.232 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.232 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.232 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.232 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.232 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.232 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179411 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.233 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.893202+0000", 2023-09-30T17:04:38.233 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.017612325000000002, 2023-09-30T17:04:38.233 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.031833707000000003, 2023-09-30T17:04:38.233 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.233 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.233 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.233 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.233 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.233 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179411 2023-09-30T17:04:38.233 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.233 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.234 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.234 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.234 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.893202+0000", 2023-09-30T17:04:38.234 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.234 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.234 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.234 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.234 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.893202+0000", 2023-09-30T17:04:38.234 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.234 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.234 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.235 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.235 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.893203+0000", 2023-09-30T17:04:38.235 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0800000000000005e-07 2023-09-30T17:04:38.235 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.235 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.235 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.235 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.893218+0000", 2023-09-30T17:04:38.235 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4791e-05 2023-09-30T17:04:38.235 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.235 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.235 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.236 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.893226+0000", 2023-09-30T17:04:38.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3410000000000003e-06 2023-09-30T17:04:38.236 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.236 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.236 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.236 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.893232+0000", 2023-09-30T17:04:38.236 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.8880000000000002e-06 2023-09-30T17:04:38.236 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.236 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.236 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.237 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.237 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.237 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:177814 4.17 4.ed072d17 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.237 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.275315+0000", 2023-09-30T17:04:38.237 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.63549951100000002, 2023-09-30T17:04:38.237 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.64977713299999995, 2023-09-30T17:04:38.237 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.237 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.237 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.237 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.237 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.238 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 177814 2023-09-30T17:04:38.238 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.238 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.275315+0000", 2023-09-30T17:04:38.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.238 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.238 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.238 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.238 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.275315+0000", 2023-09-30T17:04:38.238 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.239 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.239 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.276524+0000", 2023-09-30T17:04:38.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0012092990000000001 2023-09-30T17:04:38.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.239 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.239 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.276552+0000", 2023-09-30T17:04:38.239 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.7268e-05 2023-09-30T17:04:38.239 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.239 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.240 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.240 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.276562+0000", 2023-09-30T17:04:38.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0217999999999999e-05 2023-09-30T17:04:38.240 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.240 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.240 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.240 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.276569+0000", 2023-09-30T17:04:38.240 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2389999999999996e-06 2023-09-30T17:04:38.240 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.240 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.240 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.240 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.241 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.241 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:177968 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.241 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.324636+0000", 2023-09-30T17:04:38.241 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.58617851899999995, 2023-09-30T17:04:38.241 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.60050977000000005, 2023-09-30T17:04:38.241 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.241 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.241 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.241 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.241 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.241 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 177968 2023-09-30T17:04:38.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.242 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.324636+0000", 2023-09-30T17:04:38.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.242 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.242 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.242 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.324636+0000", 2023-09-30T17:04:38.242 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.242 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.324636+0000", 2023-09-30T17:04:38.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9200000000000002e-07 2023-09-30T17:04:38.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.243 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.243 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.324648+0000", 2023-09-30T17:04:38.243 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1358e-05 2023-09-30T17:04:38.243 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.243 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.324659+0000", 2023-09-30T17:04:38.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.145e-05 2023-09-30T17:04:38.244 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.244 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.244 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.244 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.324665+0000", 2023-09-30T17:04:38.244 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.127e-06 2023-09-30T17:04:38.244 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.244 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.244 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.245 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.245 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.245 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178642 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.245 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.603562+0000", 2023-09-30T17:04:38.245 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.30725211499999999, 2023-09-30T17:04:38.245 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.32163905999999998, 2023-09-30T17:04:38.245 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.245 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.245 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.245 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.245 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.245 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178642 2023-09-30T17:04:38.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.246 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.246 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.246 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.603562+0000", 2023-09-30T17:04:38.246 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.246 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.246 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.246 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.246 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.603562+0000", 2023-09-30T17:04:38.246 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.605517+0000", 2023-09-30T17:04:38.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0019545420000000001 2023-09-30T17:04:38.247 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.247 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.247 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.247 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.605531+0000", 2023-09-30T17:04:38.247 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3974999999999999e-05 2023-09-30T17:04:38.248 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.248 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.248 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.605552+0000", 2023-09-30T17:04:38.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.0534999999999999e-05 2023-09-30T17:04:38.248 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.248 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.248 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.248 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.605557+0000", 2023-09-30T17:04:38.248 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.259e-06 2023-09-30T17:04:38.248 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.249 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.249 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.249 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.249 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.249 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178721 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.249 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.624626+0000", 2023-09-30T17:04:38.249 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.28618811300000002, 2023-09-30T17:04:38.249 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.30062977099999999, 2023-09-30T17:04:38.249 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.249 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.249 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.250 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.250 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.250 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178721 2023-09-30T17:04:38.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.250 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.250 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.624626+0000", 2023-09-30T17:04:38.250 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.250 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.250 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.250 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.624626+0000", 2023-09-30T17:04:38.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.624627+0000", 2023-09-30T17:04:38.251 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8999999999999997e-07 2023-09-30T17:04:38.251 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.251 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.251 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.251 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.624639+0000", 2023-09-30T17:04:38.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2197e-05 2023-09-30T17:04:38.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.624646+0000", 2023-09-30T17:04:38.252 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5930000000000002e-06 2023-09-30T17:04:38.252 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.252 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.252 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.252 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.624652+0000", 2023-09-30T17:04:38.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2469999999999997e-06 2023-09-30T17:04:38.253 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.253 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.253 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.253 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.253 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.253 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178807 4.37 4.917a9cf7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.253 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.648582+0000", 2023-09-30T17:04:38.253 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.262232994, 2023-09-30T17:04:38.253 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.27673141600000001, 2023-09-30T17:04:38.253 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.253 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.254 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.254 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.254 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.254 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178807 2023-09-30T17:04:38.254 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.254 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.254 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.254 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.648582+0000", 2023-09-30T17:04:38.254 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.254 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.254 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.648582+0000", 2023-09-30T17:04:38.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.255 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.648582+0000", 2023-09-30T17:04:38.255 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.6399999999999998e-07 2023-09-30T17:04:38.255 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.255 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.255 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.648590+0000", 2023-09-30T17:04:38.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9699999999999999e-06 2023-09-30T17:04:38.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.648594+0000", 2023-09-30T17:04:38.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.72e-06 2023-09-30T17:04:38.256 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.256 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.256 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.256 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.648597+0000", 2023-09-30T17:04:38.256 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.095e-06 2023-09-30T17:04:38.257 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.257 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.257 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.257 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.257 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.257 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179032 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.257 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.735447+0000", 2023-09-30T17:04:38.257 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.17536787700000001, 2023-09-30T17:04:38.257 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.18991949899999999, 2023-09-30T17:04:38.257 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.257 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.258 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.258 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.258 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.258 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179032 2023-09-30T17:04:38.258 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.258 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.258 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.258 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.258 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.735447+0000", 2023-09-30T17:04:38.258 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.258 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.259 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.735447+0000", 2023-09-30T17:04:38.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.259 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.259 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.735447+0000", 2023-09-30T17:04:38.259 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0200000000000002e-07 2023-09-30T17:04:38.259 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.259 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.735473+0000", 2023-09-30T17:04:38.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.5428000000000001e-05 2023-09-30T17:04:38.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.735479+0000", 2023-09-30T17:04:38.260 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5379999999999999e-06 2023-09-30T17:04:38.260 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.260 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.260 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.260 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.735485+0000", 2023-09-30T17:04:38.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4569999999999996e-06 2023-09-30T17:04:38.261 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.261 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.261 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.261 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.261 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.261 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179063 4.37 4.54009ff7 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.261 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.747571+0000", 2023-09-30T17:04:38.261 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.16324392400000001, 2023-09-30T17:04:38.261 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.177850498, 2023-09-30T17:04:38.261 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.261 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.262 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.262 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.262 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.262 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179063 2023-09-30T17:04:38.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.262 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.262 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.262 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.262 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.747571+0000", 2023-09-30T17:04:38.262 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.262 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.747571+0000", 2023-09-30T17:04:38.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.263 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.263 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.747571+0000", 2023-09-30T17:04:38.263 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.84e-07 2023-09-30T17:04:38.263 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.263 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.747580+0000", 2023-09-30T17:04:38.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.5979999999999997e-06 2023-09-30T17:04:38.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.264 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.747585+0000", 2023-09-30T17:04:38.264 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.062e-06 2023-09-30T17:04:38.264 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.264 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.264 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.265 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.747588+0000", 2023-09-30T17:04:38.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0249999999999998e-06 2023-09-30T17:04:38.265 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.265 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.265 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.265 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.265 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.265 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179427 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.265 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.906632+0000", 2023-09-30T17:04:38.265 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.0041830740000000002, 2023-09-30T17:04:38.265 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.018843759000000002, 2023-09-30T17:04:38.265 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.266 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.266 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.266 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.266 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.266 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179427 2023-09-30T17:04:38.266 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.266 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.266 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.266 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.266 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.906632+0000", 2023-09-30T17:04:38.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.267 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.267 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.267 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.906632+0000", 2023-09-30T17:04:38.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.267 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.267 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.267 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.267 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.908517+0000", 2023-09-30T17:04:38.267 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0018852129999999999 2023-09-30T17:04:38.267 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.268 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.268 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.908535+0000", 2023-09-30T17:04:38.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8363999999999999e-05 2023-09-30T17:04:38.268 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.268 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.268 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.908548+0000", 2023-09-30T17:04:38.268 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3378e-05 2023-09-30T17:04:38.268 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.268 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.268 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.269 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.908557+0000", 2023-09-30T17:04:38.269 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.8580000000000006e-06 2023-09-30T17:04:38.269 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.269 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.269 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.269 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.269 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.269 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:177568 4.37 4:eff9002a:::100000001f8.00000003:head [write 3334144~4096 in=4096b,write 3678208~4096 in=4096b,write 3960832~4096 in=4096b] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.269 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.205604+0000", 2023-09-30T17:04:38.269 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.70521056699999995, 2023-09-30T17:04:38.269 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.71994507600000002, 2023-09-30T17:04:38.270 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.270 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "waiting for sub ops", 2023-09-30T17:04:38.270 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.270 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.270 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.270 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 177568 2023-09-30T17:04:38.270 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.270 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.270 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.270 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.270 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.205604+0000", 2023-09-30T17:04:38.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.205604+0000", 2023-09-30T17:04:38.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.271 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.271 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.271 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.205604+0000", 2023-09-30T17:04:38.271 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.15e-07 2023-09-30T17:04:38.271 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.272 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.205620+0000", 2023-09-30T17:04:38.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5498999999999998e-05 2023-09-30T17:04:38.272 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.272 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.272 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.205626+0000", 2023-09-30T17:04:38.272 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.5740000000000001e-06 2023-09-30T17:04:38.272 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.272 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.273 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.273 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.205632+0000", 2023-09-30T17:04:38.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1900000000000003e-06 2023-09-30T17:04:38.273 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.273 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.273 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:38.273 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.899331+0000", 2023-09-30T17:04:38.273 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.69369941599999996 2023-09-30T17:04:38.273 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.273 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.274 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:38.274 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.899410+0000", 2023-09-30T17:04:38.274 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9380000000000002e-05 2023-09-30T17:04:38.274 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.274 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:38.274 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.899572+0000", 2023-09-30T17:04:38.274 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000161559 2023-09-30T17:04:38.274 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.274 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.274 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:38.275 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.921597+0000", 2023-09-30T17:04:38.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022025146999999998 2023-09-30T17:04:38.275 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.275 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.275 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.275 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.275 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.275 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:177820 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.275 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.276582+0000", 2023-09-30T17:04:38.275 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.63423233400000001, 2023-09-30T17:04:38.275 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.64904538000000001, 2023-09-30T17:04:38.276 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.276 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.276 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.276 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.276 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.276 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 177820 2023-09-30T17:04:38.276 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.276 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.276 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.276 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.276 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.276582+0000", 2023-09-30T17:04:38.276 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.276582+0000", 2023-09-30T17:04:38.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.277 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.277 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.277 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.276583+0000", 2023-09-30T17:04:38.277 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9699999999999996e-07 2023-09-30T17:04:38.277 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.276595+0000", 2023-09-30T17:04:38.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2559e-05 2023-09-30T17:04:38.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.278 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.278 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.276602+0000", 2023-09-30T17:04:38.278 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.28e-06 2023-09-30T17:04:38.278 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.278 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.279 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.279 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.276606+0000", 2023-09-30T17:04:38.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9130000000000002e-06 2023-09-30T17:04:38.279 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.279 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.279 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.279 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.279 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.279 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:177895 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.279 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.298789+0000", 2023-09-30T17:04:38.279 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.61202585899999995, 2023-09-30T17:04:38.279 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.626893162, 2023-09-30T17:04:38.280 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.280 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.280 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.280 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.280 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.280 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 177895 2023-09-30T17:04:38.280 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.280 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.280 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.280 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.280 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.298789+0000", 2023-09-30T17:04:38.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.298789+0000", 2023-09-30T17:04:38.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.281 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.281 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.281 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.281 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.298789+0000", 2023-09-30T17:04:38.281 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1399999999999997e-07 2023-09-30T17:04:38.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.298805+0000", 2023-09-30T17:04:38.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5862000000000002e-05 2023-09-30T17:04:38.282 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.282 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.282 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.282 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.298811+0000", 2023-09-30T17:04:38.282 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4969999999999998e-06 2023-09-30T17:04:38.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.283 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.283 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.298817+0000", 2023-09-30T17:04:38.283 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1760000000000001e-06 2023-09-30T17:04:38.283 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.283 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.283 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.283 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.283 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.283 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178115 4.2f 4.da61f9af (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.284 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.366837+0000", 2023-09-30T17:04:38.284 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.54397715099999999, 2023-09-30T17:04:38.284 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.55889667099999996, 2023-09-30T17:04:38.284 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.284 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.284 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.284 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.284 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.284 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178115 2023-09-30T17:04:38.284 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.284 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.284 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.366837+0000", 2023-09-30T17:04:38.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.285 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.285 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.366837+0000", 2023-09-30T17:04:38.285 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.285 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.285 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.372517+0000", 2023-09-30T17:04:38.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0056791569999999998 2023-09-30T17:04:38.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.286 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.286 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.286 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.372532+0000", 2023-09-30T17:04:38.286 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5409000000000001e-05 2023-09-30T17:04:38.286 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.287 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.372546+0000", 2023-09-30T17:04:38.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3818000000000001e-05 2023-09-30T17:04:38.287 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.287 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.287 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.287 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.372554+0000", 2023-09-30T17:04:38.287 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2409999999999995e-06 2023-09-30T17:04:38.287 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.288 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.288 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.288 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.288 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.288 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178172 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.288 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.401153+0000", 2023-09-30T17:04:38.288 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.50966198399999996, 2023-09-30T17:04:38.288 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.52488241199999996, 2023-09-30T17:04:38.288 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.288 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.288 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.288 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.289 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.289 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178172 2023-09-30T17:04:38.289 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.289 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.289 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.289 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.401153+0000", 2023-09-30T17:04:38.289 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.289 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.289 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.290 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.401153+0000", 2023-09-30T17:04:38.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.290 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.290 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.401153+0000", 2023-09-30T17:04:38.290 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9999999999999997e-07 2023-09-30T17:04:38.290 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.290 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.290 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.401178+0000", 2023-09-30T17:04:38.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.4649999999999999e-05 2023-09-30T17:04:38.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.291 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.401186+0000", 2023-09-30T17:04:38.291 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6070000000000002e-06 2023-09-30T17:04:38.291 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.291 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.291 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.292 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.401192+0000", 2023-09-30T17:04:38.292 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2009999999999996e-06 2023-09-30T17:04:38.292 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.292 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.292 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.292 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.292 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.292 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178198 4.f 4.7fb0154f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.292 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.422618+0000", 2023-09-30T17:04:38.292 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.48819633099999998, 2023-09-30T17:04:38.293 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.50346988299999995, 2023-09-30T17:04:38.293 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.293 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.293 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.293 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.293 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.293 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178198 2023-09-30T17:04:38.293 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.293 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.293 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.293 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.294 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.422618+0000", 2023-09-30T17:04:38.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.294 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.294 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.294 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.422618+0000", 2023-09-30T17:04:38.294 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.294 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.294 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.294 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.422619+0000", 2023-09-30T17:04:38.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7999999999999996e-07 2023-09-30T17:04:38.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.422634+0000", 2023-09-30T17:04:38.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5109999999999999e-05 2023-09-30T17:04:38.295 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.295 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.295 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.295 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.422641+0000", 2023-09-30T17:04:38.295 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4229999999999999e-06 2023-09-30T17:04:38.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.296 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.296 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.422647+0000", 2023-09-30T17:04:38.296 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.6890000000000001e-06 2023-09-30T17:04:38.296 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.296 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.296 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.296 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.296 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.296 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:178611 4.37 4.4df0fd37 (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.297 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.585733+0000", 2023-09-30T17:04:38.297 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.32508163899999998, 2023-09-30T17:04:38.297 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.34041029099999998, 2023-09-30T17:04:38.297 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.297 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.297 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.297 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.297 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.297 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 178611 2023-09-30T17:04:38.297 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.297 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.297 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.297 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.585733+0000", 2023-09-30T17:04:38.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.585733+0000", 2023-09-30T17:04:38.298 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.298 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.298 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.298 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.298 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.589599+0000", 2023-09-30T17:04:38.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.003865931 2023-09-30T17:04:38.299 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.299 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.299 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.589613+0000", 2023-09-30T17:04:38.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3898e-05 2023-09-30T17:04:38.299 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.299 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.299 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.299 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.589622+0000", 2023-09-30T17:04:38.299 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6190000000000006e-06 2023-09-30T17:04:38.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.300 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.300 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.589629+0000", 2023-09-30T17:04:38.300 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4099999999999996e-06 2023-09-30T17:04:38.300 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.300 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.300 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.300 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.300 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.301 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179329 4.f 4.95fbf64f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.301 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.844644+0000", 2023-09-30T17:04:38.301 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.066170151999999996, 2023-09-30T17:04:38.301 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.081550772999999993, 2023-09-30T17:04:38.301 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.301 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.301 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.301 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.301 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.301 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179329 2023-09-30T17:04:38.301 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.302 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.302 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.844644+0000", 2023-09-30T17:04:38.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.302 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.302 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.302 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.302 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.844644+0000", 2023-09-30T17:04:38.302 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.303 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.303 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.846515+0000", 2023-09-30T17:04:38.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0018701950000000001 2023-09-30T17:04:38.303 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.303 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.303 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.303 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.846529+0000", 2023-09-30T17:04:38.303 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4791e-05 2023-09-30T17:04:38.304 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.304 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.304 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.846537+0000", 2023-09-30T17:04:38.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.96e-06 2023-09-30T17:04:38.304 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.304 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.304 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.304 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.846542+0000", 2023-09-30T17:04:38.304 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9180000000000002e-06 2023-09-30T17:04:38.305 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.305 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.305 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.305 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.305 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.305 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179354 4.f 4.4dc19b0f (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:38.305 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.856039+0000", 2023-09-30T17:04:38.305 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 0.05477601, 2023-09-30T17:04:38.305 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.070210875000000006, 2023-09-30T17:04:38.305 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:38.305 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "queued for pg", 2023-09-30T17:04:38.306 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:38.306 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:38.306 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:38.306 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179354 2023-09-30T17:04:38.306 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.306 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:38.306 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.306 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:38.306 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.856039+0000", 2023-09-30T17:04:38.306 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:38.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.856039+0000", 2023-09-30T17:04:38.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:38.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.307 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:38.307 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.857519+0000", 2023-09-30T17:04:38.307 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014801899999999999 2023-09-30T17:04:38.307 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.307 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.308 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:38.308 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.857541+0000", 2023-09-30T17:04:38.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1982999999999999e-05 2023-09-30T17:04:38.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.308 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:38.308 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.857555+0000", 2023-09-30T17:04:38.308 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4195999999999999e-05 2023-09-30T17:04:38.308 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:38.308 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:38.308 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:38.309 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.857563+0000", 2023-09-30T17:04:38.309 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2919999999999996e-06 2023-09-30T17:04:38.309 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.309 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:38.309 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.309 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:38.309 INFO:teuthology.orchestra.run.smithi072.stdout: ], 2023-09-30T17:04:38.309 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 280 2023-09-30T17:04:38.309 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:04:38.310 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-09-30T17:04:38.312 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2023-09-30T17:04:38.312 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:04:38.313 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:38.309+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:38.313 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-30T17:04:38.314 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is unset 2023-09-30T17:04:38.411 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:38.410+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:38.481 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:04:38.481 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:04:38.481 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2023-09-30T17:04:38.481 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2023-09-30T17:04:38.482 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:04:38.491 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:04:38.508 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:04:38.512 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:38.511+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:38.528 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:04:38.528 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-09-30T17:04:38.529 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-09-30T17:04:38.529 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:04:38.531 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:04:38.532 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:04:38.614 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:38.613+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:38.659 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:38.659 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:38.669 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:04:38.715 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:38.715+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:38.717 INFO:teuthology.orchestra.run.smithi007.stderr:listed 0 entries 2023-09-30T17:04:38.728 DEBUG:teuthology.orchestra.run.smithi007:> set -ex 2023-09-30T17:04:38.728 DEBUG:teuthology.orchestra.run.smithi007:> dd if=/proc/self/mounts of=/dev/stdout 2023-09-30T17:04:38.746 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T17:04:38.815 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:38.817 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:38.818 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:38.815+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:38.826 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:04:38.916 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:38.915+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:38.957 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:38.957 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:38.967 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:04:39.017 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:39.017+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:39.118 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:39.118+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:39.127 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:04:39.127 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":59,"fsid":"68daccc3-6ea9-4db7-9771-3803ff202df8","created":"2023-09-30T17:01:55.306262+0000","modified":"2023-09-30T17:04:37.409169+0000","last_up_change":"2023-09-30T17:02:47.254915+0000","last_in_change":"2023-09-30T17:01:56.571968+0000","flags":"nodeep-scrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5804032,"flags_set":["nodeep-scrub","pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T17:02:05.343048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":3.0299999713897705,"score_stable":3.0299999713897705,"optimal_score":0.33000001311302185,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T17:02:11.033979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.8700000047683716,"score_stable":1.8700000047683716,"optimal_score":0.67000001668930054,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T17:02:15.583451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.7799999713897705,"score_stable":1.7799999713897705,"optimal_score":0.67000001668930054,"raw_score_acting":1.190000057220459,"raw_score_stable":1.190000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T17:02:16.734427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.4900000095367432,"score_stable":1.4900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":1,"raw_score_stable":1,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9d1653a-8830-4fad-911b-8e7221ee8697","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6801","nonce":2212861041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6803","nonce":2212861041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6807","nonce":2212861041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6805","nonce":2212861041}]},"public_addr":"172.21.15.31:6801/2212861041","cluster_addr":"172.21.15.31:6803/2212861041","heartbeat_back_addr":"172.21.15.31:6807/2212861041","heartbeat_front_addr":"172.21.15.31:6805/2212861041","state":["exists","up"]},{"osd":1,"uuid":"7123aa56-aa1a-43a4-b154-a40b4c70d169","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6801","nonce":1680420094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6803","nonce":1680420094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6807","nonce":1680420094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6805","nonce":1680420094}]},"public_addr":"172.21.15.72:6801/1680420094","cluster_addr":"172.21.15.72:6803/1680420094","heartbeat_back_addr":"172.21.15.72:6807/1680420094","heartbeat_front_addr":"172.21.15.72:6805/1680420094","state":["exists","up"]},{"osd":2,"uuid":"f40ee0d7-7bc3-4a46-bdac-9c134c55c907","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":17,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6801","nonce":1018866543}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6803","nonce":1018866543}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6807","nonce":1018866543}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":1018866543},{"type":"v1","addr":"172.21.15.134:6805","nonce":1018866543}]},"public_addr":"172.21.15.134:6801/1018866543","cluster_addr":"172.21.15.134:6803/1018866543","heartbeat_back_addr":"172.21.15.134:6807/1018866543","heartbeat_front_addr":"172.21.15.134:6805/1018866543","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T17:02:01.702754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T17:02:01.688791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T17:02:01.667971+0000","dead_epoch":22}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T17:04:39.139 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:39.139 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:39.142 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T17:02:05.343048+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 3.0299999713897705, 'score_stable': 3.0299999713897705, 'optimal_score': 0.33000001311302185, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T17:02:11.033979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.8700000047683716, 'score_stable': 1.8700000047683716, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T17:02:15.583451+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.7799999713897705, 'score_stable': 1.7799999713897705, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1.190000057220459, 'raw_score_stable': 1.190000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T17:02:16.734427+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.4900000095367432, 'score_stable': 1.4900000095367432, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 1, 'raw_score_stable': 1, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-09-30T17:04:39.142 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T17:04:39.149 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:04:39.219 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:39.219+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:39.290 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:39.290 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:39.301 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:04:39.343 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:39.342+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:39.421 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:39.420+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:39.469 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:39.470 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:39.479 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:04:39.486 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 1 2023-09-30T17:04:39.501 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T17:04:39.521 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:39.521+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:39.622 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:39.622+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:39.646 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:39.646 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:39.656 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:04:39.723 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:39.723+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:39.793 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:39.793 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:39.803 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:04:39.838 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 8 2023-09-30T17:04:39.847 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:39.847+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:39.853 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-09-30T17:04:39.925 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:39.924+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:39.936 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:39.936 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:39.946 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:04:40.030 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:40.030+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:40.118 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:40.119 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:40.127 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:40.126+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:40.129 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:04:40.190 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 32 2023-09-30T17:04:40.205 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-09-30T17:04:40.227 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:40.226+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:40.266 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:40.266 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:40.276 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:04:40.315 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-09-30T17:04:40.329 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:40.329+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:40.431 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:40.430+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:40.466 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:40.466 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:40.473 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:04:40.530 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:40.530+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:40.533 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-09-30T17:04:40.550 INFO:teuthology.orchestra.run.smithi007.stdout:pg_num: 64 2023-09-30T17:04:40.566 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-09-30T17:04:40.611 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:40.611 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:40.621 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:04:40.665 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:40.664+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:40.702 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:04:40.722 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:04:40.723 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-09-30T17:04:40.723 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-09-30T17:04:40.723 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:04:40.727 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:04:40.727 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:04:40.733 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:40.732+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:40.754 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:04:40.754 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:04:40.755 INFO:teuthology.orchestra.run.smithi031.stdout: "num_ops": 0 2023-09-30T17:04:40.755 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:04:40.764 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:04:40.834 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:40.833+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:40.935 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:40.934+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:40.936 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:04:40.936 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:04:40.936 INFO:teuthology.orchestra.run.smithi031.stdout: "complaint_time": 30, 2023-09-30T17:04:40.936 INFO:teuthology.orchestra.run.smithi031.stdout: "num_blocked_ops": 0 2023-09-30T17:04:40.937 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:04:40.947 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:04:40.980 INFO:teuthology.orchestra.run.smithi007.stderr:listed 0 entries 2023-09-30T17:04:40.992 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi007.front.sepia.ceph.com... 2023-09-30T17:04:40.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T17:04:40.992 DEBUG:teuthology.orchestra.run.smithi007:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-09-30T17:04:41.031 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T17:04:41.032 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi007.stderr:ceph-fuse[100400]: fuse finished with error 0 and tester_r 0 2023-09-30T17:04:41.043 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:41.042+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:41.138 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:41.137+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:41.156 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:04:41.157 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 20, 2023-09-30T17:04:41.157 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 600, 2023-09-30T17:04:41.157 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:04:41.157 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.157 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165665 4.6 4:63e80496:::100000001f8.0000001e:head [write 1212416~4096,write 1318912~4096,write 1462272~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:41.157 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.209892+0000", 2023-09-30T17:04:41.157 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 9.9452586519999997, 2023-09-30T17:04:41.157 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.76500929900000003, 2023-09-30T17:04:41.157 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:41.157 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:41.158 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:41.158 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:41.158 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:41.158 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165665 2023-09-30T17:04:41.158 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.158 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:41.158 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.158 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:41.158 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.209892+0000", 2023-09-30T17:04:41.158 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:41.158 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.159 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.159 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:41.159 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.209892+0000", 2023-09-30T17:04:41.159 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:41.159 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.159 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.159 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:41.159 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.209893+0000", 2023-09-30T17:04:41.159 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5099999999999999e-07 2023-09-30T17:04:41.160 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.160 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.160 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:41.160 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.209908+0000", 2023-09-30T17:04:41.160 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4754e-05 2023-09-30T17:04:41.160 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.160 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.160 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:41.160 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.209916+0000", 2023-09-30T17:04:41.160 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.7940000000000008e-06 2023-09-30T17:04:41.161 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.161 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.161 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:41.161 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.209923+0000", 2023-09-30T17:04:41.161 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5429999999999999e-06 2023-09-30T17:04:41.161 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.161 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.161 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:41.161 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.899390+0000", 2023-09-30T17:04:41.161 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.689467371 2023-09-30T17:04:41.161 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.162 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.162 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:41.162 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.899462+0000", 2023-09-30T17:04:41.162 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1273999999999996e-05 2023-09-30T17:04:41.162 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.162 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.162 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:41.162 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.899610+0000", 2023-09-30T17:04:41.163 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014818599999999999 2023-09-30T17:04:41.163 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.163 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.163 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:41.163 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.919587+0000", 2023-09-30T17:04:41.163 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.019977042 2023-09-30T17:04:41.163 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.163 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.163 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:41.163 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.974802+0000", 2023-09-30T17:04:41.164 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.055214764 2023-09-30T17:04:41.164 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.164 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.164 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:41.164 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.974863+0000", 2023-09-30T17:04:41.164 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1377000000000005e-05 2023-09-30T17:04:41.165 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.165 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.165 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:41.165 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.974901+0000", 2023-09-30T17:04:41.165 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8543e-05 2023-09-30T17:04:41.165 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:41.165 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:41.165 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:41.165 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.166 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.166 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165673 4.6 4:63e80496:::100000001f8.0000001e:head [write 516096~4096,write 524288~4096,write 532480~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:41.166 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.210099+0000", 2023-09-30T17:04:41.166 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 9.9450517810000001, 2023-09-30T17:04:41.166 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.76494798200000003, 2023-09-30T17:04:41.166 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:41.166 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:41.166 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:41.167 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:41.167 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:41.167 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165673 2023-09-30T17:04:41.167 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.167 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:41.167 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.167 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:41.167 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.210099+0000", 2023-09-30T17:04:41.168 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:41.168 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.168 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.168 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:41.168 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.210099+0000", 2023-09-30T17:04:41.168 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:41.168 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.168 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.168 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:41.168 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.210100+0000", 2023-09-30T17:04:41.169 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0699999999999997e-07 2023-09-30T17:04:41.169 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.169 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.169 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:41.169 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.210117+0000", 2023-09-30T17:04:41.169 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7501000000000001e-05 2023-09-30T17:04:41.169 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.169 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.170 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:41.170 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.210126+0000", 2023-09-30T17:04:41.170 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2629999999999992e-06 2023-09-30T17:04:41.170 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.170 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.170 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:41.170 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.210133+0000", 2023-09-30T17:04:41.170 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8079999999999999e-06 2023-09-30T17:04:41.170 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.170 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.171 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:41.171 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.902650+0000", 2023-09-30T17:04:41.171 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.69251684800000002 2023-09-30T17:04:41.171 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.171 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.171 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:41.171 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.902724+0000", 2023-09-30T17:04:41.172 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4376999999999996e-05 2023-09-30T17:04:41.172 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.172 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.172 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:41.172 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.902881+0000", 2023-09-30T17:04:41.172 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000156269 2023-09-30T17:04:41.172 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.172 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.172 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:41.173 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.925614+0000", 2023-09-30T17:04:41.173 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.022732937000000002 2023-09-30T17:04:41.173 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.173 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.173 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:41.173 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.974955+0000", 2023-09-30T17:04:41.173 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.04934115 2023-09-30T17:04:41.173 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.173 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.174 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:41.174 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.975012+0000", 2023-09-30T17:04:41.174 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6949e-05 2023-09-30T17:04:41.174 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.174 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.174 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:41.174 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.975047+0000", 2023-09-30T17:04:41.174 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5373000000000002e-05 2023-09-30T17:04:41.174 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:41.175 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:41.175 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:41.175 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.175 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.175 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165689 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 188416~4096,write 229376~4096,write 299008~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:41.175 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.217300+0000", 2023-09-30T17:04:41.175 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 9.9378512069999996, 2023-09-30T17:04:41.175 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75814632500000001, 2023-09-30T17:04:41.175 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:41.175 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:41.175 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:41.176 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:41.176 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:41.176 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165689 2023-09-30T17:04:41.176 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.176 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:41.176 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.176 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:41.176 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.217300+0000", 2023-09-30T17:04:41.177 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:41.177 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.177 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.177 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:41.177 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.217300+0000", 2023-09-30T17:04:41.177 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:41.177 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.177 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.177 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:41.177 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.217300+0000", 2023-09-30T17:04:41.177 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3000000000000001e-07 2023-09-30T17:04:41.177 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.178 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.178 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:41.178 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.217314+0000", 2023-09-30T17:04:41.178 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3901e-05 2023-09-30T17:04:41.178 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.178 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.178 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:41.178 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.217321+0000", 2023-09-30T17:04:41.179 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5869999999999998e-06 2023-09-30T17:04:41.179 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.179 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.179 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:41.179 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.217326+0000", 2023-09-30T17:04:41.179 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7740000000000001e-06 2023-09-30T17:04:41.179 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.179 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.180 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:41.180 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.907842+0000", 2023-09-30T17:04:41.180 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.69051533600000004 2023-09-30T17:04:41.180 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.180 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.180 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:41.180 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.907927+0000", 2023-09-30T17:04:41.180 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5619999999999997e-05 2023-09-30T17:04:41.180 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.180 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.181 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:41.181 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.908097+0000", 2023-09-30T17:04:41.181 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016991400000000001 2023-09-30T17:04:41.181 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.181 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.181 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:41.181 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.925623+0000", 2023-09-30T17:04:41.181 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.017525888999999999 2023-09-30T17:04:41.181 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.182 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.182 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:41.182 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.975110+0000", 2023-09-30T17:04:41.182 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.049486789000000003 2023-09-30T17:04:41.182 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.182 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.182 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:41.182 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.975170+0000", 2023-09-30T17:04:41.183 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9960000000000002e-05 2023-09-30T17:04:41.183 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.183 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.183 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:41.183 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.975446+0000", 2023-09-30T17:04:41.183 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000276125 2023-09-30T17:04:41.183 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:41.183 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:41.183 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:41.183 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.184 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.184 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165875 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 458752~4096,write 1454080~4096,write 1634304~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:41.184 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.295916+0000", 2023-09-30T17:04:41.184 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 9.8592345570000006, 2023-09-30T17:04:41.184 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.76379055500000004, 2023-09-30T17:04:41.184 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:41.184 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:41.184 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:41.185 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:41.185 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:41.185 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165875 2023-09-30T17:04:41.185 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.185 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:41.185 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.185 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:41.185 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.295916+0000", 2023-09-30T17:04:41.185 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:41.185 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.186 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.186 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:41.186 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.295916+0000", 2023-09-30T17:04:41.186 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:41.186 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.186 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.186 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:41.186 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.295917+0000", 2023-09-30T17:04:41.186 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9500000000000002e-07 2023-09-30T17:04:41.186 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.187 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.187 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:41.187 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.295932+0000", 2023-09-30T17:04:41.187 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4803999999999999e-05 2023-09-30T17:04:41.187 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.187 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.187 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:41.187 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.295941+0000", 2023-09-30T17:04:41.187 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.448e-06 2023-09-30T17:04:41.188 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.188 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.188 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:41.188 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.295948+0000", 2023-09-30T17:04:41.188 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9199999999999998e-06 2023-09-30T17:04:41.188 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.188 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.188 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:41.188 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.971359+0000", 2023-09-30T17:04:41.188 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67541110500000001 2023-09-30T17:04:41.188 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.189 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.189 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:41.189 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.971433+0000", 2023-09-30T17:04:41.189 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3388999999999998e-05 2023-09-30T17:04:41.189 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.189 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.189 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:41.189 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.971583+0000", 2023-09-30T17:04:41.189 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015035999999999999 2023-09-30T17:04:41.189 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.189 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.190 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:41.190 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.982409+0000", 2023-09-30T17:04:41.190 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010826242999999999 2023-09-30T17:04:41.190 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.190 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.190 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:41.190 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.059610+0000", 2023-09-30T17:04:41.190 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.077201160000000005 2023-09-30T17:04:41.190 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.190 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.191 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:41.191 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.059669+0000", 2023-09-30T17:04:41.191 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8965999999999998e-05 2023-09-30T17:04:41.191 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.191 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.191 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:41.191 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.059707+0000", 2023-09-30T17:04:41.191 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7564999999999997e-05 2023-09-30T17:04:41.191 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:41.191 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:41.191 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:41.191 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.192 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.192 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165878 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 2277376~4096,write 2371584~4096,write 4050944~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:41.192 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.299610+0000", 2023-09-30T17:04:41.192 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 9.855540478, 2023-09-30T17:04:41.192 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75525803300000005, 2023-09-30T17:04:41.192 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:41.192 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:41.192 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:41.193 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:41.193 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:41.193 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165878 2023-09-30T17:04:41.193 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.193 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:41.193 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.193 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:41.193 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299610+0000", 2023-09-30T17:04:41.193 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:41.193 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.193 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.194 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:41.194 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299610+0000", 2023-09-30T17:04:41.194 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:41.194 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.194 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.194 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:41.194 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299611+0000", 2023-09-30T17:04:41.194 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7299999999999996e-07 2023-09-30T17:04:41.194 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.195 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.195 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:41.195 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299623+0000", 2023-09-30T17:04:41.195 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2513e-05 2023-09-30T17:04:41.195 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.195 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.195 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:41.195 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299630+0000", 2023-09-30T17:04:41.195 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0090000000000001e-06 2023-09-30T17:04:41.195 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.196 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.196 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:41.196 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299638+0000", 2023-09-30T17:04:41.196 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1210000000000001e-06 2023-09-30T17:04:41.196 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.196 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.196 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:41.196 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.971347+0000", 2023-09-30T17:04:41.196 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67170925699999995 2023-09-30T17:04:41.196 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.196 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.197 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:41.197 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.971419+0000", 2023-09-30T17:04:41.197 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2495000000000003e-05 2023-09-30T17:04:41.197 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.197 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.197 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:41.197 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.971567+0000", 2023-09-30T17:04:41.197 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014805499999999999 2023-09-30T17:04:41.197 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.198 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.198 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:41.198 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.982312+0000", 2023-09-30T17:04:41.198 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010744584 2023-09-30T17:04:41.198 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.198 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.198 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:41.198 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.054770+0000", 2023-09-30T17:04:41.198 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.072457683999999994 2023-09-30T17:04:41.199 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.199 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.199 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:41.199 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.054825+0000", 2023-09-30T17:04:41.199 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5210000000000002e-05 2023-09-30T17:04:41.199 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.199 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.199 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:41.199 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.054868+0000", 2023-09-30T17:04:41.200 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3532000000000003e-05 2023-09-30T17:04:41.200 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:41.200 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:41.200 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:41.200 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.200 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.200 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165890 4.36 4:6da220e6:::100000001f8.0000003f:head [write 3395584~4096,write 3436544~4096,write 3444736~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:41.200 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.299835+0000", 2023-09-30T17:04:41.200 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 9.8553157949999992, 2023-09-30T17:04:41.201 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.76012937700000005, 2023-09-30T17:04:41.201 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:41.201 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:41.201 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:41.201 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:41.201 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:41.201 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165890 2023-09-30T17:04:41.201 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.201 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:41.201 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.202 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:41.202 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299835+0000", 2023-09-30T17:04:41.202 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:41.202 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.202 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.202 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:41.202 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299835+0000", 2023-09-30T17:04:41.203 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:41.203 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.203 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.203 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:41.203 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299835+0000", 2023-09-30T17:04:41.203 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5699999999999998e-07 2023-09-30T17:04:41.203 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.203 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.203 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:41.203 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299905+0000", 2023-09-30T17:04:41.203 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9908999999999998e-05 2023-09-30T17:04:41.204 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.204 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.204 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:41.204 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299914+0000", 2023-09-30T17:04:41.204 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9630000000000004e-06 2023-09-30T17:04:41.204 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.204 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.204 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:41.204 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299921+0000", 2023-09-30T17:04:41.205 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8079999999999999e-06 2023-09-30T17:04:41.205 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.205 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.205 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:41.205 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.975617+0000", 2023-09-30T17:04:41.205 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67569579099999999 2023-09-30T17:04:41.205 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.205 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.205 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:41.206 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.975700+0000", 2023-09-30T17:04:41.206 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3462999999999997e-05 2023-09-30T17:04:41.206 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.206 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.206 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:41.206 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.975871+0000", 2023-09-30T17:04:41.206 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017027399999999999 2023-09-30T17:04:41.206 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.206 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.206 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:41.206 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.001290+0000", 2023-09-30T17:04:41.207 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.025419576999999999 2023-09-30T17:04:41.207 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.207 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.207 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:41.207 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.059876+0000", 2023-09-30T17:04:41.207 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.058585849000000002 2023-09-30T17:04:41.207 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.207 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.207 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:41.207 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.059929+0000", 2023-09-30T17:04:41.207 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3053000000000002e-05 2023-09-30T17:04:41.208 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.208 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.208 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:41.208 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.059964+0000", 2023-09-30T17:04:41.208 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5233e-05 2023-09-30T17:04:41.208 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:41.208 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:41.208 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:41.209 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.209 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.209 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165893 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 2748416~4096,write 2764800~4096,write 3031040~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:41.209 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.299965+0000", 2023-09-30T17:04:41.209 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 9.8551855189999991, 2023-09-30T17:04:41.209 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75987149300000001, 2023-09-30T17:04:41.209 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:41.209 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:41.209 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:41.210 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:41.210 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:41.210 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165893 2023-09-30T17:04:41.210 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.210 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:41.210 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.210 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:41.210 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299965+0000", 2023-09-30T17:04:41.210 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:41.211 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.211 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.211 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:41.211 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299965+0000", 2023-09-30T17:04:41.211 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:41.211 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.211 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.211 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:41.211 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.301184+0000", 2023-09-30T17:04:41.212 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0012189779999999999 2023-09-30T17:04:41.212 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.212 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.212 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:41.212 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.301199+0000", 2023-09-30T17:04:41.212 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4626e-05 2023-09-30T17:04:41.212 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.212 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.212 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:41.213 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.301209+0000", 2023-09-30T17:04:41.213 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.042e-05 2023-09-30T17:04:41.213 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.213 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.213 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:41.213 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.301217+0000", 2023-09-30T17:04:41.213 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4000000000000003e-06 2023-09-30T17:04:41.213 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.214 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.214 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:41.214 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.975800+0000", 2023-09-30T17:04:41.214 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67458368700000004 2023-09-30T17:04:41.214 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.214 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.214 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:41.214 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.975886+0000", 2023-09-30T17:04:41.214 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5722000000000004e-05 2023-09-30T17:04:41.214 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.214 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.215 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:41.215 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.976065+0000", 2023-09-30T17:04:41.215 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000178705 2023-09-30T17:04:41.215 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.215 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.215 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:41.215 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.998244+0000", 2023-09-30T17:04:41.215 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.022178788000000001 2023-09-30T17:04:41.216 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.216 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.216 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:41.216 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.059746+0000", 2023-09-30T17:04:41.216 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.061501950999999999 2023-09-30T17:04:41.216 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.216 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.216 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:41.216 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.059802+0000", 2023-09-30T17:04:41.216 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6128000000000002e-05 2023-09-30T17:04:41.216 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.217 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.217 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:41.217 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.059837+0000", 2023-09-30T17:04:41.217 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5088e-05 2023-09-30T17:04:41.217 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:41.217 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:41.217 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:41.217 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.218 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.218 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165908 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 2269184~4096,write 4112384~4096,write 4136960~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:41.218 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.309255+0000", 2023-09-30T17:04:41.218 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 9.8458957500000004, 2023-09-30T17:04:41.218 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.76105314999999996, 2023-09-30T17:04:41.218 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:41.218 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:41.218 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:41.218 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:41.219 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:41.219 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165908 2023-09-30T17:04:41.219 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.219 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:41.219 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.219 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:41.219 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.309255+0000", 2023-09-30T17:04:41.219 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:41.219 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.220 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.220 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:41.220 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.309255+0000", 2023-09-30T17:04:41.220 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:41.220 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.220 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.220 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:41.220 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.311162+0000", 2023-09-30T17:04:41.220 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001906886 2023-09-30T17:04:41.221 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.221 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.221 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:41.221 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.311177+0000", 2023-09-30T17:04:41.221 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5193e-05 2023-09-30T17:04:41.221 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.221 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.221 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:41.221 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.311188+0000", 2023-09-30T17:04:41.222 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0805000000000001e-05 2023-09-30T17:04:41.222 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.222 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.222 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:41.222 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.311196+0000", 2023-09-30T17:04:41.222 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.627e-06 2023-09-30T17:04:41.222 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.222 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.222 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:41.222 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.982808+0000", 2023-09-30T17:04:41.223 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67161246100000005 2023-09-30T17:04:41.223 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.223 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.223 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:41.223 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.982872+0000", 2023-09-30T17:04:41.223 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3646999999999996e-05 2023-09-30T17:04:41.223 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.223 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.223 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:41.223 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.983017+0000", 2023-09-30T17:04:41.224 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000144964 2023-09-30T17:04:41.224 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.224 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.224 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:41.224 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.010841+0000", 2023-09-30T17:04:41.224 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.027824637999999999 2023-09-30T17:04:41.224 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.224 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.224 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:41.224 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.070218+0000", 2023-09-30T17:04:41.225 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.059376421999999998 2023-09-30T17:04:41.225 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.225 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.225 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:41.225 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.070272+0000", 2023-09-30T17:04:41.225 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4407000000000003e-05 2023-09-30T17:04:41.225 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.225 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.225 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:41.225 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.070308+0000", 2023-09-30T17:04:41.225 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6100000000000003e-05 2023-09-30T17:04:41.225 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:41.226 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:41.226 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:41.226 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.226 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.226 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165910 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 1191936~4096,write 1277952~4096,write 1613824~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:41.226 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.311262+0000", 2023-09-30T17:04:41.226 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 9.8438891809999998, 2023-09-30T17:04:41.226 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75916103300000004, 2023-09-30T17:04:41.226 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:41.227 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:41.227 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:41.227 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:41.227 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:41.227 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165910 2023-09-30T17:04:41.227 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.227 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:41.227 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.227 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:41.227 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.311262+0000", 2023-09-30T17:04:41.228 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:41.228 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.228 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.228 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:41.228 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.311262+0000", 2023-09-30T17:04:41.228 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:41.228 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.228 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.228 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:41.228 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.313172+0000", 2023-09-30T17:04:41.229 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001910847 2023-09-30T17:04:41.229 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.229 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.229 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:41.229 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.313191+0000", 2023-09-30T17:04:41.229 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8416000000000001e-05 2023-09-30T17:04:41.229 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.229 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.229 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:41.230 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.313204+0000", 2023-09-30T17:04:41.230 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.271e-05 2023-09-30T17:04:41.230 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.230 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.230 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:41.230 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.313211+0000", 2023-09-30T17:04:41.230 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3529999999999997e-06 2023-09-30T17:04:41.230 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.230 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.230 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:41.230 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.990896+0000", 2023-09-30T17:04:41.231 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67768552500000001 2023-09-30T17:04:41.231 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.231 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.231 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:41.231 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.990972+0000", 2023-09-30T17:04:41.231 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5658e-05 2023-09-30T17:04:41.231 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.231 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.231 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:41.231 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.991072+0000", 2023-09-30T17:04:41.232 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.9636000000000006e-05 2023-09-30T17:04:41.232 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.232 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.232 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:41.232 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.010847+0000", 2023-09-30T17:04:41.232 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.019774908000000001 2023-09-30T17:04:41.232 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.232 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.232 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:41.232 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.070345+0000", 2023-09-30T17:04:41.232 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.059497983999999997 2023-09-30T17:04:41.233 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.233 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.233 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:41.233 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.070392+0000", 2023-09-30T17:04:41.233 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6851999999999998e-05 2023-09-30T17:04:41.233 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.233 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.233 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:41.233 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.070423+0000", 2023-09-30T17:04:41.233 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.1143999999999999e-05 2023-09-30T17:04:41.234 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:41.234 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:41.234 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:41.234 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.234 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.234 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165918 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 2666496~4096,write 2760704~4096,write 3031040~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:41.234 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.315883+0000", 2023-09-30T17:04:41.234 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 9.8392673540000004, 2023-09-30T17:04:41.234 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75903742100000005, 2023-09-30T17:04:41.234 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:41.234 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:41.235 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:41.235 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:41.235 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:41.235 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165918 2023-09-30T17:04:41.235 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.235 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:41.235 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.235 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:41.235 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315883+0000", 2023-09-30T17:04:41.235 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:41.236 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.236 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.236 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:41.236 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315883+0000", 2023-09-30T17:04:41.236 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:41.236 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.236 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.236 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:41.236 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315884+0000", 2023-09-30T17:04:41.236 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8199999999999999e-07 2023-09-30T17:04:41.236 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.237 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.237 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:41.237 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315903+0000", 2023-09-30T17:04:41.237 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9089e-05 2023-09-30T17:04:41.237 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.237 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.237 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:41.237 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315916+0000", 2023-09-30T17:04:41.238 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2636999999999999e-05 2023-09-30T17:04:41.238 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.238 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.238 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:41.238 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315923+0000", 2023-09-30T17:04:41.238 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2259999999999999e-06 2023-09-30T17:04:41.238 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.238 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.238 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:41.238 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.993661+0000", 2023-09-30T17:04:41.238 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67773771500000002 2023-09-30T17:04:41.239 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.239 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.239 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:41.239 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.993749+0000", 2023-09-30T17:04:41.239 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.7721999999999998e-05 2023-09-30T17:04:41.239 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.239 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.239 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:41.239 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.996215+0000", 2023-09-30T17:04:41.240 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0024667360000000002 2023-09-30T17:04:41.240 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.240 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.240 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:41.240 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.010996+0000", 2023-09-30T17:04:41.240 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.014780873 2023-09-30T17:04:41.240 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.240 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.240 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:41.241 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.074853+0000", 2023-09-30T17:04:41.241 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.063857133999999996 2023-09-30T17:04:41.241 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.241 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.241 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:41.241 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.074888+0000", 2023-09-30T17:04:41.241 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5067000000000002e-05 2023-09-30T17:04:41.242 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.242 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.242 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:41.242 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.074921+0000", 2023-09-30T17:04:41.242 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.2539999999999997e-05 2023-09-30T17:04:41.242 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:41.242 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:41.242 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:41.242 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.243 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.243 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165921 4.6 4:63e80496:::100000001f8.0000001e:head [write 679936~4096,write 1089536~4096,write 1138688~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:41.243 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.315973+0000", 2023-09-30T17:04:41.243 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 9.8391774190000003, 2023-09-30T17:04:41.243 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75610897399999999, 2023-09-30T17:04:41.243 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:41.243 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:41.243 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:41.243 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:41.243 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:41.244 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165921 2023-09-30T17:04:41.244 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.244 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:41.244 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.244 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:41.244 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315973+0000", 2023-09-30T17:04:41.244 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:41.244 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.244 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.244 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:41.245 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315973+0000", 2023-09-30T17:04:41.245 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:41.245 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.245 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.245 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:41.245 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315974+0000", 2023-09-30T17:04:41.245 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1100000000000001e-07 2023-09-30T17:04:41.245 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.245 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.246 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:41.246 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315986+0000", 2023-09-30T17:04:41.246 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2673e-05 2023-09-30T17:04:41.246 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.246 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.246 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:41.246 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315995+0000", 2023-09-30T17:04:41.247 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1689999999999992e-06 2023-09-30T17:04:41.247 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.247 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.247 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:41.247 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.316000+0000", 2023-09-30T17:04:41.247 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9849999999999997e-06 2023-09-30T17:04:41.247 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.247 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.247 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:41.247 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.994495+0000", 2023-09-30T17:04:41.248 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67849566800000005 2023-09-30T17:04:41.248 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.248 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.248 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:41.248 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.994579+0000", 2023-09-30T17:04:41.248 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4089000000000001e-05 2023-09-30T17:04:41.248 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.248 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.248 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:41.248 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.994744+0000", 2023-09-30T17:04:41.248 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000164327 2023-09-30T17:04:41.249 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.249 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.249 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:41.249 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.010988+0000", 2023-09-30T17:04:41.249 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.016244705000000002 2023-09-30T17:04:41.249 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.249 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.249 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:41.249 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.071979+0000", 2023-09-30T17:04:41.249 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.060990111 2023-09-30T17:04:41.249 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.250 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.250 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:41.250 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.072035+0000", 2023-09-30T17:04:41.250 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6320000000000003e-05 2023-09-30T17:04:41.250 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.250 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.250 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:41.250 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.072082+0000", 2023-09-30T17:04:41.250 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7515999999999997e-05 2023-09-30T17:04:41.250 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:41.250 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:41.251 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:41.251 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.251 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.251 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165949 4.6 4:616d4c41:::100000001f8.00000034:head [write 409600~4096,write 618496~4096,write 659456~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:41.251 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.326340+0000", 2023-09-30T17:04:41.251 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 9.8288113050000003, 2023-09-30T17:04:41.251 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75612495899999999, 2023-09-30T17:04:41.252 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:41.252 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:41.252 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:41.252 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:41.252 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:41.252 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165949 2023-09-30T17:04:41.252 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.252 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:41.252 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.252 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:41.253 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.326340+0000", 2023-09-30T17:04:41.253 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:41.253 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.253 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.253 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:41.253 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.326340+0000", 2023-09-30T17:04:41.253 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:41.253 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.254 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.254 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:41.254 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.326340+0000", 2023-09-30T17:04:41.254 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0200000000000002e-07 2023-09-30T17:04:41.254 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.254 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.254 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:41.254 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.326352+0000", 2023-09-30T17:04:41.254 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1715e-05 2023-09-30T17:04:41.255 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.255 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.255 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:41.255 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.326358+0000", 2023-09-30T17:04:41.255 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3679999999999998e-06 2023-09-30T17:04:41.255 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.255 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.255 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:41.256 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.326363+0000", 2023-09-30T17:04:41.256 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9629999999999997e-06 2023-09-30T17:04:41.256 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.256 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.256 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:41.256 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.006610+0000", 2023-09-30T17:04:41.256 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.68024690499999996 2023-09-30T17:04:41.256 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.256 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.257 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:41.257 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.006692+0000", 2023-09-30T17:04:41.257 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2274000000000005e-05 2023-09-30T17:04:41.257 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.257 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.257 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:41.257 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.006845+0000", 2023-09-30T17:04:41.257 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000152817 2023-09-30T17:04:41.257 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.258 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.258 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:41.258 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.023168+0000", 2023-09-30T17:04:41.258 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.016322962999999999 2023-09-30T17:04:41.258 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.258 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.258 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:41.258 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.082373+0000", 2023-09-30T17:04:41.258 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.059204869 2023-09-30T17:04:41.258 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.259 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.259 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:41.259 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.082429+0000", 2023-09-30T17:04:41.259 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5671000000000003e-05 2023-09-30T17:04:41.259 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.259 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.259 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:41.259 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.082464+0000", 2023-09-30T17:04:41.259 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5911999999999998e-05 2023-09-30T17:04:41.259 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:41.259 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:41.260 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:41.260 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.260 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.260 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165988 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 2596864~4096,write 3084288~4096,write 3141632~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:41.260 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.342979+0000", 2023-09-30T17:04:41.260 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 9.8121723129999996, 2023-09-30T17:04:41.260 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75803858099999999, 2023-09-30T17:04:41.260 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:41.260 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:41.260 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:41.260 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:41.261 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:41.261 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165988 2023-09-30T17:04:41.261 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.261 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:41.261 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.261 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:41.261 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.342979+0000", 2023-09-30T17:04:41.261 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:41.261 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.261 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.261 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:41.262 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.342979+0000", 2023-09-30T17:04:41.262 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:41.262 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.262 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.262 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:41.262 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.342980+0000", 2023-09-30T17:04:41.262 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.018e-06 2023-09-30T17:04:41.262 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.262 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.262 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:41.263 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.342994+0000", 2023-09-30T17:04:41.263 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4819e-05 2023-09-30T17:04:41.263 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.263 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.263 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:41.263 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.343005+0000", 2023-09-30T17:04:41.263 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0552e-05 2023-09-30T17:04:41.263 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.263 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.263 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:41.264 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.343012+0000", 2023-09-30T17:04:41.264 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.888e-06 2023-09-30T17:04:41.264 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.264 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.264 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:41.264 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.018485+0000", 2023-09-30T17:04:41.264 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67547272199999997 2023-09-30T17:04:41.264 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.264 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.264 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:41.264 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.018573+0000", 2023-09-30T17:04:41.264 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8243000000000002e-05 2023-09-30T17:04:41.265 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.265 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.265 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:41.265 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.018779+0000", 2023-09-30T17:04:41.265 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00020640599999999999 2023-09-30T17:04:41.265 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.265 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.265 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:41.265 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.034608+0000", 2023-09-30T17:04:41.266 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.015828519999999999 2023-09-30T17:04:41.266 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.266 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.266 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:41.266 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.100930+0000", 2023-09-30T17:04:41.266 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.066322504000000004 2023-09-30T17:04:41.266 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.266 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.266 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:41.266 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.100981+0000", 2023-09-30T17:04:41.267 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0946000000000003e-05 2023-09-30T17:04:41.267 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.267 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.267 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:41.267 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.101017+0000", 2023-09-30T17:04:41.267 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5963000000000001e-05 2023-09-30T17:04:41.267 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:41.267 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:41.267 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:41.267 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.267 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.268 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165998 4.36 4:6fa85f86:::100000001f8.00000013:head [write 1470464~4096,write 1576960~4096,write 1806336~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:41.268 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.343107+0000", 2023-09-30T17:04:41.268 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 9.8120438970000006, 2023-09-30T17:04:41.268 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75779366699999995, 2023-09-30T17:04:41.268 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:41.268 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:41.268 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:41.268 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:41.268 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:41.268 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165998 2023-09-30T17:04:41.269 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.269 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:41.269 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.269 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:41.269 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.343107+0000", 2023-09-30T17:04:41.269 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:41.269 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.269 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.269 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:41.269 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.343107+0000", 2023-09-30T17:04:41.270 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:41.270 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.270 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.270 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:41.270 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.346167+0000", 2023-09-30T17:04:41.270 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.003060349 2023-09-30T17:04:41.270 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.270 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.270 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:41.270 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.346188+0000", 2023-09-30T17:04:41.271 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.0894e-05 2023-09-30T17:04:41.271 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.271 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.271 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:41.271 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.346201+0000", 2023-09-30T17:04:41.271 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2424e-05 2023-09-30T17:04:41.271 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.271 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.271 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:41.272 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.346209+0000", 2023-09-30T17:04:41.272 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1980000000000001e-06 2023-09-30T17:04:41.272 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.272 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.272 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:41.272 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.018506+0000", 2023-09-30T17:04:41.272 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67229752899999995 2023-09-30T17:04:41.272 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.273 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.273 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:41.273 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.018582+0000", 2023-09-30T17:04:41.273 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.538e-05 2023-09-30T17:04:41.273 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.273 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.273 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:41.273 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.018756+0000", 2023-09-30T17:04:41.273 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000174611 2023-09-30T17:04:41.273 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.274 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.274 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:41.274 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.034599+0000", 2023-09-30T17:04:41.274 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.015843166999999998 2023-09-30T17:04:41.274 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.274 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.274 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:41.275 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.100806+0000", 2023-09-30T17:04:41.275 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.066206047000000004 2023-09-30T17:04:41.275 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.275 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.275 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:41.275 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.100863+0000", 2023-09-30T17:04:41.275 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7843999999999997e-05 2023-09-30T17:04:41.275 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.275 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.275 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:41.275 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.100901+0000", 2023-09-30T17:04:41.276 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7224000000000001e-05 2023-09-30T17:04:41.276 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:41.276 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:41.276 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:41.276 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.276 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.276 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:166011 4.6 4:63e80496:::100000001f8.0000001e:head [write 561152~8192,write 663552~4096,write 851968~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:41.276 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.350327+0000", 2023-09-30T17:04:41.277 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 9.8048238489999999, 2023-09-30T17:04:41.277 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75701292499999995, 2023-09-30T17:04:41.277 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:41.277 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:41.277 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:41.277 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:41.277 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:41.277 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 166011 2023-09-30T17:04:41.277 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.277 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:41.277 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.278 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:41.278 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.350327+0000", 2023-09-30T17:04:41.278 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:41.278 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.278 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.278 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:41.278 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.350327+0000", 2023-09-30T17:04:41.279 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:41.279 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.279 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.279 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:41.279 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.350327+0000", 2023-09-30T17:04:41.279 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9799999999999999e-07 2023-09-30T17:04:41.279 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.279 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.279 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:41.279 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.350345+0000", 2023-09-30T17:04:41.280 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7237000000000001e-05 2023-09-30T17:04:41.280 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.280 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.280 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:41.280 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.350351+0000", 2023-09-30T17:04:41.280 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.489e-06 2023-09-30T17:04:41.280 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.280 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.281 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:41.281 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.350357+0000", 2023-09-30T17:04:41.281 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7300000000000002e-06 2023-09-30T17:04:41.281 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.281 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.281 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:41.281 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.026726+0000", 2023-09-30T17:04:41.281 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.676369636 2023-09-30T17:04:41.281 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.281 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.281 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:41.282 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.026803+0000", 2023-09-30T17:04:41.282 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6885999999999995e-05 2023-09-30T17:04:41.282 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.282 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.282 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:41.282 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.026961+0000", 2023-09-30T17:04:41.282 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015803799999999999 2023-09-30T17:04:41.282 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.282 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.283 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:41.283 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.037169+0000", 2023-09-30T17:04:41.283 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010207748000000001 2023-09-30T17:04:41.283 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.283 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.283 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:41.283 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.107238+0000", 2023-09-30T17:04:41.283 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.070069305999999998 2023-09-30T17:04:41.283 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.283 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.284 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:41.284 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.107299+0000", 2023-09-30T17:04:41.284 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0757999999999997e-05 2023-09-30T17:04:41.284 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.284 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.284 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:41.284 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.107340+0000", 2023-09-30T17:04:41.284 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0698999999999998e-05 2023-09-30T17:04:41.285 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:41.285 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:41.285 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:41.285 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.285 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.285 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:166057 4.6 4:63e80496:::100000001f8.0000001e:head [write 3416064~4096,write 3485696~4096,write 3571712~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:41.285 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.366264+0000", 2023-09-30T17:04:41.285 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 9.7888870140000002, 2023-09-30T17:04:41.286 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.76104848700000005, 2023-09-30T17:04:41.286 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:41.286 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:41.286 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:41.286 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:41.286 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:41.286 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 166057 2023-09-30T17:04:41.286 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.286 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:41.286 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.286 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:41.286 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.366264+0000", 2023-09-30T17:04:41.289 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:41.289 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.289 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.289 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:41.289 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.366264+0000", 2023-09-30T17:04:41.290 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:41.290 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.290 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.290 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:41.290 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.366264+0000", 2023-09-30T17:04:41.290 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.03e-07 2023-09-30T17:04:41.290 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.290 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.290 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:41.291 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.366276+0000", 2023-09-30T17:04:41.291 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1712999999999999e-05 2023-09-30T17:04:41.291 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.291 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.291 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:41.291 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.366282+0000", 2023-09-30T17:04:41.291 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3049999999999998e-06 2023-09-30T17:04:41.291 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.292 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.292 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:41.292 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.366287+0000", 2023-09-30T17:04:41.292 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7589999999999997e-06 2023-09-30T17:04:41.292 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.292 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.292 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:41.292 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.042061+0000", 2023-09-30T17:04:41.292 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67577395500000004 2023-09-30T17:04:41.292 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.292 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.293 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:41.293 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.042141+0000", 2023-09-30T17:04:41.293 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9777999999999994e-05 2023-09-30T17:04:41.293 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.293 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.293 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:41.293 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.042323+0000", 2023-09-30T17:04:41.293 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000181783 2023-09-30T17:04:41.293 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.293 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.293 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:41.294 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.072114+0000", 2023-09-30T17:04:41.294 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.029791108 2023-09-30T17:04:41.294 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.294 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.294 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:41.294 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.127224+0000", 2023-09-30T17:04:41.294 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.055110065 2023-09-30T17:04:41.294 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.294 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.294 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:41.294 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.127276+0000", 2023-09-30T17:04:41.295 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2574999999999997e-05 2023-09-30T17:04:41.295 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.295 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.295 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:41.295 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.127312+0000", 2023-09-30T17:04:41.295 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6043e-05 2023-09-30T17:04:41.295 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:41.295 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:41.295 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:41.295 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.295 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.296 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:166062 4.36 4:6fa85f86:::100000001f8.00000013:head [write 1110016~4096,write 1118208~4096,write 1155072~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:41.296 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.370231+0000", 2023-09-30T17:04:41.296 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 9.7849198560000001, 2023-09-30T17:04:41.296 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75721686499999996, 2023-09-30T17:04:41.296 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:41.296 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:41.296 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:41.296 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:41.296 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:41.296 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 166062 2023-09-30T17:04:41.296 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.297 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:41.297 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.297 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:41.297 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.370231+0000", 2023-09-30T17:04:41.297 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:41.297 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.297 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.297 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:41.297 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.370231+0000", 2023-09-30T17:04:41.297 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:41.298 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.298 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.298 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:41.298 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.370232+0000", 2023-09-30T17:04:41.298 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.68e-07 2023-09-30T17:04:41.298 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.298 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.298 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:41.298 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.370247+0000", 2023-09-30T17:04:41.298 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5440000000000001e-05 2023-09-30T17:04:41.299 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.299 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.299 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:41.299 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.370262+0000", 2023-09-30T17:04:41.299 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4976e-05 2023-09-30T17:04:41.299 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.299 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.299 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:41.299 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.370268+0000", 2023-09-30T17:04:41.299 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4930000000000003e-06 2023-09-30T17:04:41.300 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.300 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.300 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:41.300 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.042052+0000", 2023-09-30T17:04:41.300 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67178386199999995 2023-09-30T17:04:41.300 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.300 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.300 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:41.300 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.042140+0000", 2023-09-30T17:04:41.300 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.7874000000000006e-05 2023-09-30T17:04:41.300 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.300 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.301 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:41.301 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.042321+0000", 2023-09-30T17:04:41.301 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00018131500000000001 2023-09-30T17:04:41.301 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.301 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.301 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:41.301 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.054880+0000", 2023-09-30T17:04:41.301 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.012558625 2023-09-30T17:04:41.301 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.301 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.302 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:41.302 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.127361+0000", 2023-09-30T17:04:41.302 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.072481183000000005 2023-09-30T17:04:41.302 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.302 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.302 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:41.302 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.127412+0000", 2023-09-30T17:04:41.302 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0861e-05 2023-09-30T17:04:41.302 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.302 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.127448+0000", 2023-09-30T17:04:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5667999999999998e-05 2023-09-30T17:04:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:166063 4.36 4:6da220e6:::100000001f8.0000003f:head [write 2469888~4096,write 2543616~4096,write 2551808~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.370278+0000", 2023-09-30T17:04:41.303 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 9.7848724189999992, 2023-09-30T17:04:41.304 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75730261499999996, 2023-09-30T17:04:41.304 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:41.304 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:41.304 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:41.304 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:41.304 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:41.304 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 166063 2023-09-30T17:04:41.304 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.304 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:41.304 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.305 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:41.305 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.370278+0000", 2023-09-30T17:04:41.305 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:41.305 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.305 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.305 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:41.305 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.370278+0000", 2023-09-30T17:04:41.305 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:41.305 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.305 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.305 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:41.306 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.374164+0000", 2023-09-30T17:04:41.306 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0038854319999999999 2023-09-30T17:04:41.306 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.306 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.306 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:41.306 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.374182+0000", 2023-09-30T17:04:41.306 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8363999999999999e-05 2023-09-30T17:04:41.306 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.306 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.306 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:41.306 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.374195+0000", 2023-09-30T17:04:41.306 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2328e-05 2023-09-30T17:04:41.307 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.307 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.307 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:41.307 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.374202+0000", 2023-09-30T17:04:41.307 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4189999999999996e-06 2023-09-30T17:04:41.307 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.307 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.307 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:41.307 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.045487+0000", 2023-09-30T17:04:41.307 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67128463800000004 2023-09-30T17:04:41.307 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.308 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.308 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:41.308 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.045558+0000", 2023-09-30T17:04:41.308 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1408999999999993e-05 2023-09-30T17:04:41.308 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.308 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.308 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:41.308 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.045711+0000", 2023-09-30T17:04:41.308 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015323299999999999 2023-09-30T17:04:41.308 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.308 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.308 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:41.309 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.072119+0000", 2023-09-30T17:04:41.309 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.026407824 2023-09-30T17:04:41.309 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.309 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.309 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:41.309 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.127486+0000", 2023-09-30T17:04:41.309 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.055366591999999999 2023-09-30T17:04:41.309 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.309 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.310 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:41.310 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.127543+0000", 2023-09-30T17:04:41.310 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7685000000000001e-05 2023-09-30T17:04:41.310 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.310 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.310 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:41.310 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.127581+0000", 2023-09-30T17:04:41.310 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7691000000000002e-05 2023-09-30T17:04:41.310 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:41.310 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:41.310 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:41.311 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.311 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.311 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:166072 4.36 4:6da220e6:::100000001f8.0000003f:head [write 1822720~4096,write 2002944~4096,write 2072576~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:41.311 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.376908+0000", 2023-09-30T17:04:41.311 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 9.7782424060000004, 2023-09-30T17:04:41.311 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75774445099999999, 2023-09-30T17:04:41.311 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:41.311 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:41.311 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:41.311 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:41.311 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:41.312 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 166072 2023-09-30T17:04:41.312 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.312 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:41.312 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.312 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:41.312 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.376908+0000", 2023-09-30T17:04:41.312 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:41.312 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.312 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.312 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:41.312 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.376908+0000", 2023-09-30T17:04:41.313 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:41.313 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.313 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.313 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:41.313 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.376909+0000", 2023-09-30T17:04:41.313 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3900000000000004e-07 2023-09-30T17:04:41.313 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.313 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.313 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:41.313 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.376927+0000", 2023-09-30T17:04:41.313 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7503000000000002e-05 2023-09-30T17:04:41.313 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.314 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.314 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:41.314 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.376936+0000", 2023-09-30T17:04:41.314 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1209999999999996e-06 2023-09-30T17:04:41.314 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.314 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.314 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:41.314 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.376943+0000", 2023-09-30T17:04:41.314 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0979999999999996e-06 2023-09-30T17:04:41.314 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.315 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.315 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:41.315 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.048561+0000", 2023-09-30T17:04:41.315 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67161849299999998 2023-09-30T17:04:41.315 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.315 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.315 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:41.315 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.048634+0000", 2023-09-30T17:04:41.315 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3085999999999998e-05 2023-09-30T17:04:41.315 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.315 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.316 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:41.316 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.048777+0000", 2023-09-30T17:04:41.316 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000143067 2023-09-30T17:04:41.316 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.316 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.316 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:41.316 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.072125+0000", 2023-09-30T17:04:41.316 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023347178999999999 2023-09-30T17:04:41.316 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.316 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.317 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:41.317 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.134554+0000", 2023-09-30T17:04:41.317 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.062429739999999997 2023-09-30T17:04:41.317 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.317 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.317 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:41.317 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.134605+0000", 2023-09-30T17:04:41.317 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0278000000000002e-05 2023-09-30T17:04:41.318 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.318 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.318 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:41.318 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.134653+0000", 2023-09-30T17:04:41.318 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8247000000000001e-05 2023-09-30T17:04:41.318 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:41.318 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:41.318 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:41.318 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.318 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.318 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:166086 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 1073152~4096,write 1261568~4096,write 1273856~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:41.319 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.387018+0000", 2023-09-30T17:04:41.319 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 9.7681328609999998, 2023-09-30T17:04:41.319 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75505913000000002, 2023-09-30T17:04:41.319 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:41.319 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:41.319 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:41.319 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:41.319 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:41.320 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 166086 2023-09-30T17:04:41.320 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.320 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:41.320 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.320 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:41.320 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.387018+0000", 2023-09-30T17:04:41.320 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:41.320 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.320 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.320 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:41.321 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.387018+0000", 2023-09-30T17:04:41.321 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:41.321 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.321 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.321 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:41.321 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.387018+0000", 2023-09-30T17:04:41.321 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.13e-07 2023-09-30T17:04:41.321 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.322 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.322 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:41.322 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.387033+0000", 2023-09-30T17:04:41.322 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4718999999999999e-05 2023-09-30T17:04:41.322 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.322 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.322 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:41.322 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.387041+0000", 2023-09-30T17:04:41.322 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8779999999999998e-06 2023-09-30T17:04:41.322 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.322 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.323 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:41.323 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.387047+0000", 2023-09-30T17:04:41.323 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9689999999999999e-06 2023-09-30T17:04:41.323 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.323 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.323 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:41.323 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.056572+0000", 2023-09-30T17:04:41.323 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.66952481200000002 2023-09-30T17:04:41.323 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.323 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.324 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:41.324 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.056644+0000", 2023-09-30T17:04:41.324 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1695999999999999e-05 2023-09-30T17:04:41.324 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.324 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.324 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:41.324 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.056746+0000", 2023-09-30T17:04:41.324 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000102864 2023-09-30T17:04:41.325 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.325 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.325 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:41.325 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.085374+0000", 2023-09-30T17:04:41.325 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.028627717 2023-09-30T17:04:41.325 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.325 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.325 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:41.325 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.141996+0000", 2023-09-30T17:04:41.326 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.056622290999999998 2023-09-30T17:04:41.326 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.326 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.326 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:41.326 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.142044+0000", 2023-09-30T17:04:41.326 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7939000000000003e-05 2023-09-30T17:04:41.326 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:41.326 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:41.326 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:41.327 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.142077+0000", 2023-09-30T17:04:41.327 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.2731999999999998e-05 2023-09-30T17:04:41.327 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:41.327 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:41.327 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:41.327 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:41.327 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:41.327 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:04:41.328 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~114s 2023-09-30T17:04:41.329 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:41.328+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:41.330 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:04:41.427 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is unset 2023-09-30T17:04:41.430 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:41.430+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:41.466 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:04:41.466 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:04:41.466 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2023-09-30T17:04:41.466 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:04:41.476 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:04:41.531 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:41.531+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:41.603 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:04:41.604 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:04:41.604 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2023-09-30T17:04:41.604 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2023-09-30T17:04:41.604 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:04:41.614 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:04:41.631 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:41.632+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:41.732 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:41.733+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:41.742 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:04:41.742 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2023-09-30T17:04:41.742 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2023-09-30T17:04:41.742 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2023-09-30T17:04:41.742 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.742 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:157789 4.f 4:f26fdfa9:::100000001f8.00000002:head [write 3084288~4096,write 3104768~4096,write 3194880~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-09-30T17:04:41.743 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:28.125691+0000", 2023-09-30T17:04:41.743 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 13.614909388999999, 2023-09-30T17:04:41.743 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.86263862800000002, 2023-09-30T17:04:41.743 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:41.743 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:41.743 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:41.743 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:41.743 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:41.743 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 157789 2023-09-30T17:04:41.743 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.743 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:41.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.744 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:41.744 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.125691+0000", 2023-09-30T17:04:41.744 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:41.744 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.744 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:41.744 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.125691+0000", 2023-09-30T17:04:41.744 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:41.744 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.744 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.745 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:41.745 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.125691+0000", 2023-09-30T17:04:41.745 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8800000000000003e-07 2023-09-30T17:04:41.745 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.745 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.745 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:41.745 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.125704+0000", 2023-09-30T17:04:41.745 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3054000000000001e-05 2023-09-30T17:04:41.745 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.745 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.745 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:41.745 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.125711+0000", 2023-09-30T17:04:41.746 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2519999999999996e-06 2023-09-30T17:04:41.746 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.746 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.746 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:41.746 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.125715+0000", 2023-09-30T17:04:41.746 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.656e-06 2023-09-30T17:04:41.746 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.746 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.746 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:41.746 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.814299+0000", 2023-09-30T17:04:41.746 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.68858357400000003 2023-09-30T17:04:41.747 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.747 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.747 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:41.747 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.814403+0000", 2023-09-30T17:04:41.747 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000104607 2023-09-30T17:04:41.747 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.747 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.747 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:41.747 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.814591+0000", 2023-09-30T17:04:41.747 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000187472 2023-09-30T17:04:41.747 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.747 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.748 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:41.748 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.829681+0000", 2023-09-30T17:04:41.748 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015090299999999999 2023-09-30T17:04:41.748 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.748 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.748 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:41.748 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.988235+0000", 2023-09-30T17:04:41.748 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.15855408700000001 2023-09-30T17:04:41.748 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.748 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.748 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:41.748 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.988290+0000", 2023-09-30T17:04:41.749 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4852999999999998e-05 2023-09-30T17:04:41.749 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.749 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.749 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:41.749 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.988329+0000", 2023-09-30T17:04:41.749 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9285000000000001e-05 2023-09-30T17:04:41.749 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:41.749 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:41.749 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:41.749 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.749 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.750 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:157795 4.37 4:ef395e89:::100000001f8.00000020:head [write 2281472~4096,write 2314240~4096,write 2658304~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-09-30T17:04:41.750 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:28.127548+0000", 2023-09-30T17:04:41.750 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 13.613051990000001, 2023-09-30T17:04:41.750 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.86069198000000002, 2023-09-30T17:04:41.750 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:41.750 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:41.750 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:41.750 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:41.750 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:41.750 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 157795 2023-09-30T17:04:41.750 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.751 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:41.751 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.751 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:41.751 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.127548+0000", 2023-09-30T17:04:41.751 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:41.751 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.751 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.751 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:41.751 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.127548+0000", 2023-09-30T17:04:41.751 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:41.751 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.751 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.752 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:41.752 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.129701+0000", 2023-09-30T17:04:41.752 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002153304 2023-09-30T17:04:41.752 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.752 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.752 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:41.752 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.129715+0000", 2023-09-30T17:04:41.752 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3548e-05 2023-09-30T17:04:41.752 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.752 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.752 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:41.753 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.129722+0000", 2023-09-30T17:04:41.753 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2010000000000002e-06 2023-09-30T17:04:41.753 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.753 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.753 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:41.753 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.129727+0000", 2023-09-30T17:04:41.753 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2000000000000002e-06 2023-09-30T17:04:41.753 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.753 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.753 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:41.753 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.818343+0000", 2023-09-30T17:04:41.753 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.68861540399999999 2023-09-30T17:04:41.754 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.754 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.754 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:41.754 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.818424+0000", 2023-09-30T17:04:41.754 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1547999999999999e-05 2023-09-30T17:04:41.754 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.754 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.754 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:41.754 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.818583+0000", 2023-09-30T17:04:41.754 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015905100000000001 2023-09-30T17:04:41.754 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.755 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.755 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:41.755 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.988142+0000", 2023-09-30T17:04:41.755 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.16955905700000001 2023-09-30T17:04:41.755 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.755 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.755 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:41.755 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.988154+0000", 2023-09-30T17:04:41.755 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1317e-05 2023-09-30T17:04:41.755 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.755 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.756 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:41.756 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.988201+0000", 2023-09-30T17:04:41.756 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7299999999999998e-05 2023-09-30T17:04:41.756 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.756 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.756 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:41.756 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.988240+0000", 2023-09-30T17:04:41.756 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9050000000000001e-05 2023-09-30T17:04:41.756 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:41.757 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:41.757 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:41.757 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.757 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.757 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:157798 4.37 4:ef395e89:::100000001f8.00000020:head [write 3284992~4096,write 3301376~4096,write 3452928~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-09-30T17:04:41.757 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:28.133611+0000", 2023-09-30T17:04:41.757 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 13.606989392999999, 2023-09-30T17:04:41.757 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.85484233099999996, 2023-09-30T17:04:41.757 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:41.757 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:41.757 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:41.758 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:41.758 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:41.758 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 157798 2023-09-30T17:04:41.758 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.758 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:41.758 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.758 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:41.758 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.133611+0000", 2023-09-30T17:04:41.759 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:41.759 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.759 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.759 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:41.759 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.133611+0000", 2023-09-30T17:04:41.759 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:41.759 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.759 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.759 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:41.759 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.137517+0000", 2023-09-30T17:04:41.759 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039065920000000004 2023-09-30T17:04:41.760 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.760 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.760 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:41.760 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.137537+0000", 2023-09-30T17:04:41.760 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9888e-05 2023-09-30T17:04:41.760 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.760 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.760 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:41.760 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.137549+0000", 2023-09-30T17:04:41.761 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2009e-05 2023-09-30T17:04:41.761 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.761 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.761 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:41.761 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.137557+0000", 2023-09-30T17:04:41.761 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4510000000000003e-06 2023-09-30T17:04:41.761 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.761 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.761 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:41.761 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.823134+0000", 2023-09-30T17:04:41.762 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.68557705000000002 2023-09-30T17:04:41.762 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.762 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.762 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:41.762 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.823210+0000", 2023-09-30T17:04:41.762 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6608999999999998e-05 2023-09-30T17:04:41.762 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.762 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.762 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:41.763 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.823351+0000", 2023-09-30T17:04:41.763 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014104699999999999 2023-09-30T17:04:41.763 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.763 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.763 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:41.763 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.988248+0000", 2023-09-30T17:04:41.763 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.16489661999999999 2023-09-30T17:04:41.763 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.763 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.764 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:41.764 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.988372+0000", 2023-09-30T17:04:41.764 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000124306 2023-09-30T17:04:41.764 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.764 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.764 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:41.764 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.988420+0000", 2023-09-30T17:04:41.764 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7670000000000003e-05 2023-09-30T17:04:41.765 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.765 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.765 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:41.765 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.988453+0000", 2023-09-30T17:04:41.765 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3089000000000001e-05 2023-09-30T17:04:41.765 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:41.765 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:41.765 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:41.765 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.765 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.766 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:157803 4.2f 4:f59f865b:::100000001f8.00000007:head [write 1728512~4096,write 1789952~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-09-30T17:04:41.766 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:28.139569+0000", 2023-09-30T17:04:41.766 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 13.601031056, 2023-09-30T17:04:41.766 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.84879218300000003, 2023-09-30T17:04:41.766 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:41.766 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:41.766 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:41.766 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:41.766 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:41.766 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 157803 2023-09-30T17:04:41.767 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.767 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:41.767 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.767 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:41.767 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.139569+0000", 2023-09-30T17:04:41.767 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:41.767 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.767 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.767 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:41.767 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.139569+0000", 2023-09-30T17:04:41.767 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:41.767 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.768 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.768 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:41.768 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.143516+0000", 2023-09-30T17:04:41.768 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039473670000000002 2023-09-30T17:04:41.768 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.768 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.768 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:41.768 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.143532+0000", 2023-09-30T17:04:41.768 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5977999999999998e-05 2023-09-30T17:04:41.769 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.769 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.769 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:41.769 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.143541+0000", 2023-09-30T17:04:41.769 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4700000000000002e-06 2023-09-30T17:04:41.769 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.769 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.769 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:41.769 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.143547+0000", 2023-09-30T17:04:41.769 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2910000000000004e-06 2023-09-30T17:04:41.769 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.770 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.770 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:41.770 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.822863+0000", 2023-09-30T17:04:41.770 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.67931543400000005 2023-09-30T17:04:41.770 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.770 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.770 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:41.770 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.822932+0000", 2023-09-30T17:04:41.771 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9076000000000001e-05 2023-09-30T17:04:41.771 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.771 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.771 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:41.771 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.823050+0000", 2023-09-30T17:04:41.771 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011811000000000001 2023-09-30T17:04:41.771 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.771 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.771 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:41.771 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.988256+0000", 2023-09-30T17:04:41.772 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.165206044 2023-09-30T17:04:41.772 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.772 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.772 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:41.772 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.988289+0000", 2023-09-30T17:04:41.772 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2997000000000003e-05 2023-09-30T17:04:41.773 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.773 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.773 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:41.773 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.988331+0000", 2023-09-30T17:04:41.773 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2481000000000002e-05 2023-09-30T17:04:41.773 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.773 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.773 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:41.773 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.988361+0000", 2023-09-30T17:04:41.773 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9935000000000001e-05 2023-09-30T17:04:41.774 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:41.774 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:41.774 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:41.774 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.774 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.774 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:157825 4.f 4:f2a80dfe:::100000001f8.00000019:head [write 1105920~4096,write 1122304~4096,write 1347584~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-09-30T17:04:41.774 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:28.150556+0000", 2023-09-30T17:04:41.774 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 13.590044342000001, 2023-09-30T17:04:41.774 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.85021122400000004, 2023-09-30T17:04:41.774 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:41.774 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:41.775 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:41.775 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:41.775 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:41.775 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 157825 2023-09-30T17:04:41.775 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.775 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:41.775 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.775 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:41.775 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.150556+0000", 2023-09-30T17:04:41.775 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:41.775 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.776 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.776 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:41.776 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.150556+0000", 2023-09-30T17:04:41.776 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:41.776 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.776 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.776 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:41.776 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.150556+0000", 2023-09-30T17:04:41.776 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.13e-07 2023-09-30T17:04:41.776 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.776 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.777 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:41.777 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.150570+0000", 2023-09-30T17:04:41.777 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4117000000000001e-05 2023-09-30T17:04:41.777 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.777 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.777 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:41.777 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.150575+0000", 2023-09-30T17:04:41.777 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6199999999999998e-06 2023-09-30T17:04:41.777 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.777 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.777 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:41.778 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.150580+0000", 2023-09-30T17:04:41.778 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8899999999999998e-06 2023-09-30T17:04:41.778 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.778 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.778 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:41.778 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.829697+0000", 2023-09-30T17:04:41.778 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.67911663300000003 2023-09-30T17:04:41.778 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.778 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.778 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:41.779 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.829743+0000", 2023-09-30T17:04:41.779 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6622999999999997e-05 2023-09-30T17:04:41.779 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.779 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.779 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:41.779 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.829835+0000", 2023-09-30T17:04:41.779 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1557000000000004e-05 2023-09-30T17:04:41.779 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.779 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.779 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:41.780 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.988497+0000", 2023-09-30T17:04:41.780 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.158662304 2023-09-30T17:04:41.780 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.780 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.780 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:41.780 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:29.000695+0000", 2023-09-30T17:04:41.780 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.01219786 2023-09-30T17:04:41.780 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.780 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.780 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:41.780 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:29.000736+0000", 2023-09-30T17:04:41.781 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1289999999999999e-05 2023-09-30T17:04:41.781 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.781 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.781 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:41.781 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:29.000767+0000", 2023-09-30T17:04:41.781 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0817e-05 2023-09-30T17:04:41.781 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:41.781 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:41.781 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:41.782 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.782 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.782 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:157828 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 61440~4096,write 73728~4096,write 94208~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-09-30T17:04:41.782 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:28.150611+0000", 2023-09-30T17:04:41.782 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 13.589988673000001, 2023-09-30T17:04:41.782 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.85007624000000004, 2023-09-30T17:04:41.782 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:41.782 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:41.782 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:41.782 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:41.782 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:41.783 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 157828 2023-09-30T17:04:41.783 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.783 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:41.783 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.783 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:41.783 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.150611+0000", 2023-09-30T17:04:41.783 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:41.783 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.783 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.783 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:41.783 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.150611+0000", 2023-09-30T17:04:41.784 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:41.784 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.784 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.784 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:41.784 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.150612+0000", 2023-09-30T17:04:41.784 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2800000000000003e-07 2023-09-30T17:04:41.784 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.784 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.784 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:41.784 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.150621+0000", 2023-09-30T17:04:41.784 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9239999999999996e-06 2023-09-30T17:04:41.785 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.785 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.785 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:41.785 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.150625+0000", 2023-09-30T17:04:41.785 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5000000000000001e-06 2023-09-30T17:04:41.785 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.785 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.785 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:41.785 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.150628+0000", 2023-09-30T17:04:41.785 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9179999999999998e-06 2023-09-30T17:04:41.785 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.785 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.786 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:41.786 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.829719+0000", 2023-09-30T17:04:41.786 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.67909131499999997 2023-09-30T17:04:41.786 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.786 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.786 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:41.786 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.829794+0000", 2023-09-30T17:04:41.786 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4553000000000003e-05 2023-09-30T17:04:41.786 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.786 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.786 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:41.787 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:29.000581+0000", 2023-09-30T17:04:41.787 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.17078728100000001 2023-09-30T17:04:41.787 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.787 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.787 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:41.787 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:29.000624+0000", 2023-09-30T17:04:41.787 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2809999999999998e-05 2023-09-30T17:04:41.787 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.787 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.787 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:41.787 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:29.000688+0000", 2023-09-30T17:04:41.788 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3610999999999998e-05 2023-09-30T17:04:41.788 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:41.788 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:41.788 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:41.788 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.788 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.788 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:157836 4.f 4:f2a80dfe:::100000001f8.00000019:head [write 765952~4096,write 847872~4096,write 1392640~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-09-30T17:04:41.789 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:28.156587+0000", 2023-09-30T17:04:41.789 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 13.584013175000001, 2023-09-30T17:04:41.789 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.84425581699999996, 2023-09-30T17:04:41.789 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:41.789 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:41.789 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:41.789 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:41.789 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:41.790 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 157836 2023-09-30T17:04:41.790 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.790 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:41.790 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.790 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:41.790 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.156587+0000", 2023-09-30T17:04:41.791 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:41.791 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.791 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.791 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:41.791 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.156587+0000", 2023-09-30T17:04:41.791 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:41.791 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.791 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.791 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:41.792 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.158515+0000", 2023-09-30T17:04:41.792 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001928155 2023-09-30T17:04:41.792 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.792 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.792 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:41.792 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.158532+0000", 2023-09-30T17:04:41.792 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6702999999999999e-05 2023-09-30T17:04:41.792 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.792 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.793 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:41.793 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.158541+0000", 2023-09-30T17:04:41.793 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0750000000000004e-06 2023-09-30T17:04:41.793 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.793 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.793 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:41.793 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.158547+0000", 2023-09-30T17:04:41.794 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3960000000000003e-06 2023-09-30T17:04:41.794 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.794 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.794 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:41.794 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.836649+0000", 2023-09-30T17:04:41.794 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.67810128400000003 2023-09-30T17:04:41.795 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.795 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.795 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:41.795 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.836725+0000", 2023-09-30T17:04:41.795 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6113999999999997e-05 2023-09-30T17:04:41.795 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.795 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.795 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:41.795 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.836884+0000", 2023-09-30T17:04:41.795 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158813 2023-09-30T17:04:41.796 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.796 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.796 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:41.796 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.988557+0000", 2023-09-30T17:04:41.796 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.151673217 2023-09-30T17:04:41.796 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.796 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.796 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:41.797 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:29.000774+0000", 2023-09-30T17:04:41.797 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012216942 2023-09-30T17:04:41.797 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.797 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.797 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:41.797 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:29.000813+0000", 2023-09-30T17:04:41.797 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9517999999999997e-05 2023-09-30T17:04:41.797 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.797 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.798 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:41.798 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:29.000843+0000", 2023-09-30T17:04:41.798 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9600000000000001e-05 2023-09-30T17:04:41.798 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:41.798 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:41.798 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:41.798 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.798 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.798 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179260 4.f 4:f0d983b2:::100000001f8.0000001f:head [write 921600~8192,write 995328~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:41.798 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.812958+0000", 2023-09-30T17:04:41.798 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.9276422239999995, 2023-09-30T17:04:41.799 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.82225978099999997, 2023-09-30T17:04:41.799 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:41.799 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:41.799 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:41.799 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:41.799 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:41.799 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179260 2023-09-30T17:04:41.799 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.799 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:41.799 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.799 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:41.800 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.812958+0000", 2023-09-30T17:04:41.800 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:41.800 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.800 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.800 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:41.800 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.812958+0000", 2023-09-30T17:04:41.800 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:41.800 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.800 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.800 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:41.801 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.814516+0000", 2023-09-30T17:04:41.801 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0015578009999999999 2023-09-30T17:04:41.801 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.801 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.801 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:41.801 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.814533+0000", 2023-09-30T17:04:41.801 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7487999999999999e-05 2023-09-30T17:04:41.801 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.801 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.801 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:41.801 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.814544+0000", 2023-09-30T17:04:41.802 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0338e-05 2023-09-30T17:04:41.802 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.802 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.802 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:41.802 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.814551+0000", 2023-09-30T17:04:41.802 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2400000000000001e-06 2023-09-30T17:04:41.802 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.802 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.802 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:41.802 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.592631+0000", 2023-09-30T17:04:41.803 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.77808063500000002 2023-09-30T17:04:41.803 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.803 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.803 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:41.803 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.592715+0000", 2023-09-30T17:04:41.803 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3442999999999994e-05 2023-09-30T17:04:41.803 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.803 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.803 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:41.803 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.592852+0000", 2023-09-30T17:04:41.804 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013743699999999999 2023-09-30T17:04:41.804 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.804 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.804 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:41.804 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.604909+0000", 2023-09-30T17:04:41.804 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.01205701 2023-09-30T17:04:41.804 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.804 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.804 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:41.804 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.635135+0000", 2023-09-30T17:04:41.805 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.030225905000000001 2023-09-30T17:04:41.805 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.805 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.805 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:41.805 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.635184+0000", 2023-09-30T17:04:41.805 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8735e-05 2023-09-30T17:04:41.805 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.805 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.805 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:41.805 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.635218+0000", 2023-09-30T17:04:41.806 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3748999999999998e-05 2023-09-30T17:04:41.806 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:41.806 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:41.806 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:41.806 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.806 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.806 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179261 4.37 4:ef395e89:::100000001f8.00000020:head [write 3284992~4096,write 3334144~4096,write 3395584~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:41.806 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.814563+0000", 2023-09-30T17:04:41.806 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.9260372029999999, 2023-09-30T17:04:41.806 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.82064327999999997, 2023-09-30T17:04:41.806 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:41.807 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:41.807 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:41.807 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:41.807 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:41.807 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179261 2023-09-30T17:04:41.807 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.807 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:41.807 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.807 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:41.807 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.814563+0000", 2023-09-30T17:04:41.808 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:41.808 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.808 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.808 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:41.808 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.814563+0000", 2023-09-30T17:04:41.808 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:41.808 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.808 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.808 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:41.808 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.814563+0000", 2023-09-30T17:04:41.808 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2900000000000004e-07 2023-09-30T17:04:41.809 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.809 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.809 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:41.809 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.814576+0000", 2023-09-30T17:04:41.809 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2680999999999999e-05 2023-09-30T17:04:41.809 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.809 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.809 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:41.809 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.814583+0000", 2023-09-30T17:04:41.809 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6150000000000002e-06 2023-09-30T17:04:41.810 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.810 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.810 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:41.810 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.814588+0000", 2023-09-30T17:04:41.810 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.045e-06 2023-09-30T17:04:41.810 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.810 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.810 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:41.810 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.592617+0000", 2023-09-30T17:04:41.810 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.77802875500000002 2023-09-30T17:04:41.810 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.811 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.811 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:41.811 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.592706+0000", 2023-09-30T17:04:41.811 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9840999999999996e-05 2023-09-30T17:04:41.811 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.811 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.811 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:41.811 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.592875+0000", 2023-09-30T17:04:41.811 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016879300000000001 2023-09-30T17:04:41.811 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.811 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.812 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:41.812 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.605031+0000", 2023-09-30T17:04:41.812 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012156227 2023-09-30T17:04:41.812 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.812 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.812 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:41.812 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.635117+0000", 2023-09-30T17:04:41.812 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.030085819999999999 2023-09-30T17:04:41.812 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.812 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.812 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:41.812 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.635172+0000", 2023-09-30T17:04:41.813 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4391999999999997e-05 2023-09-30T17:04:41.813 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.813 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:41.813 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.635206+0000", 2023-09-30T17:04:41.813 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4582000000000002e-05 2023-09-30T17:04:41.813 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:41.813 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:41.813 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:41.813 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.813 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.813 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179282 4.2f 4:f59f865b:::100000001f8.00000007:head [write 1630208~8192,write 1945600~4096,write 2015232~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:41.814 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.822601+0000", 2023-09-30T17:04:41.814 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.9179995119999997, 2023-09-30T17:04:41.814 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.82927721700000001, 2023-09-30T17:04:41.814 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:41.814 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:41.814 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:41.814 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:41.814 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:41.814 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179282 2023-09-30T17:04:41.814 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.814 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:41.815 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.815 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:41.815 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.822601+0000", 2023-09-30T17:04:41.815 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:41.815 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.815 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.815 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:41.815 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.822601+0000", 2023-09-30T17:04:41.815 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:41.815 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.815 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.815 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:41.816 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.822601+0000", 2023-09-30T17:04:41.816 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9299999999999999e-07 2023-09-30T17:04:41.816 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.816 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.816 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:41.816 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.822625+0000", 2023-09-30T17:04:41.816 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3836e-05 2023-09-30T17:04:41.816 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.816 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.816 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:41.816 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.822632+0000", 2023-09-30T17:04:41.817 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5750000000000003e-06 2023-09-30T17:04:41.817 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.817 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.817 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:41.817 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.822638+0000", 2023-09-30T17:04:41.817 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2109999999999997e-06 2023-09-30T17:04:41.817 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.817 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.817 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:41.817 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.604804+0000", 2023-09-30T17:04:41.817 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.78216662800000003 2023-09-30T17:04:41.817 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.818 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.818 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:41.818 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.604870+0000", 2023-09-30T17:04:41.818 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6068999999999994e-05 2023-09-30T17:04:41.818 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.818 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.818 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:41.818 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.604978+0000", 2023-09-30T17:04:41.818 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000107947 2023-09-30T17:04:41.818 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.818 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.819 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:41.819 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.624608+0000", 2023-09-30T17:04:41.819 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019629636999999998 2023-09-30T17:04:41.819 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.819 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.819 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:41.819 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.651798+0000", 2023-09-30T17:04:41.819 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.027189722999999999 2023-09-30T17:04:41.819 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.819 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.819 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:41.820 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.651846+0000", 2023-09-30T17:04:41.820 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8112000000000003e-05 2023-09-30T17:04:41.820 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.820 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.820 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:41.820 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.651878+0000", 2023-09-30T17:04:41.820 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2085999999999997e-05 2023-09-30T17:04:41.820 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:41.820 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:41.820 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:41.820 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.820 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.821 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179299 4.2f 4:f59f865b:::100000001f8.00000007:head [write 3973120~4096,write 4038656~4096,write 4055040~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:41.821 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.828667+0000", 2023-09-30T17:04:41.821 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.9119336330000003, 2023-09-30T17:04:41.821 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.82350079099999995, 2023-09-30T17:04:41.821 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:41.821 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:41.821 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:41.821 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:41.821 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:41.821 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179299 2023-09-30T17:04:41.821 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.821 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:41.822 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.822 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:41.822 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.828667+0000", 2023-09-30T17:04:41.822 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:41.822 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.822 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.822 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:41.822 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.828667+0000", 2023-09-30T17:04:41.822 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:41.822 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.823 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.823 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:41.823 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.828667+0000", 2023-09-30T17:04:41.823 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8100000000000003e-07 2023-09-30T17:04:41.823 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.823 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.823 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:41.823 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.828680+0000", 2023-09-30T17:04:41.824 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3366999999999999e-05 2023-09-30T17:04:41.824 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.824 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.824 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:41.824 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.828689+0000", 2023-09-30T17:04:41.824 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1200000000000008e-06 2023-09-30T17:04:41.824 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.824 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.824 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:41.824 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.828696+0000", 2023-09-30T17:04:41.825 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0719999999999996e-06 2023-09-30T17:04:41.825 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.825 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:41.825 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.606541+0000", 2023-09-30T17:04:41.825 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.777845177 2023-09-30T17:04:41.825 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.825 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.825 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:41.825 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.606588+0000", 2023-09-30T17:04:41.826 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6866000000000002e-05 2023-09-30T17:04:41.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.826 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.826 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:41.826 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.606674+0000", 2023-09-30T17:04:41.826 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6428000000000007e-05 2023-09-30T17:04:41.826 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.826 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.827 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:41.827 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.624611+0000", 2023-09-30T17:04:41.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017936917 2023-09-30T17:04:41.827 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.827 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.827 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:41.827 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.652029+0000", 2023-09-30T17:04:41.827 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.027418034000000001 2023-09-30T17:04:41.827 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.827 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.828 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:41.828 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.652137+0000", 2023-09-30T17:04:41.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010844399999999999 2023-09-30T17:04:41.828 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.828 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.828 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:41.828 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.652167+0000", 2023-09-30T17:04:41.828 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9884999999999999e-05 2023-09-30T17:04:41.828 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:41.828 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:41.829 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:41.829 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.829 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.829 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179305 4.f 4:f2a80dfe:::100000001f8.00000019:head [write 3338240~4096,write 3543040~4096,write 3817472~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:41.829 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.828740+0000", 2023-09-30T17:04:41.830 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.9118597059999995, 2023-09-30T17:04:41.830 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.823018425, 2023-09-30T17:04:41.830 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:41.830 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:41.830 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:41.830 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:41.830 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:41.830 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179305 2023-09-30T17:04:41.830 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.830 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:41.831 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.831 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:41.831 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.828740+0000", 2023-09-30T17:04:41.831 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:41.831 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.832 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.832 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:41.832 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.828740+0000", 2023-09-30T17:04:41.832 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:41.832 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.832 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.833 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:41.833 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.833568+0000", 2023-09-30T17:04:41.833 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0048272089999999998 2023-09-30T17:04:41.833 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.833 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.833 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:41.833 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.833586+0000", 2023-09-30T17:04:41.833 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8328000000000001e-05 2023-09-30T17:04:41.833 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.834 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.834 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:41.834 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.833596+0000", 2023-09-30T17:04:41.834 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0431999999999999e-05 2023-09-30T17:04:41.834 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.834 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.834 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:41.834 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.833603+0000", 2023-09-30T17:04:41.834 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.229e-06 2023-09-30T17:04:41.834 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.835 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.835 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:41.835 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.606529+0000", 2023-09-30T17:04:41.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.77292685100000003 2023-09-30T17:04:41.835 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.835 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.835 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:41.835 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.606579+0000", 2023-09-30T17:04:41.835 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9057000000000001e-05 2023-09-30T17:04:41.835 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.835 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.836 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:41.836 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.606669+0000", 2023-09-30T17:04:41.836 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0155000000000007e-05 2023-09-30T17:04:41.836 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.836 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.836 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:41.836 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.635232+0000", 2023-09-30T17:04:41.836 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.028563280999999999 2023-09-30T17:04:41.836 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.837 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.837 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:41.837 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.651670+0000", 2023-09-30T17:04:41.837 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016438075999999999 2023-09-30T17:04:41.837 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.837 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.837 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:41.837 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.651722+0000", 2023-09-30T17:04:41.838 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1863999999999997e-05 2023-09-30T17:04:41.838 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.838 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.838 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:41.838 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.651759+0000", 2023-09-30T17:04:41.838 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6943000000000002e-05 2023-09-30T17:04:41.838 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:41.838 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:41.838 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:41.838 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.839 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.839 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179329 4.f 4:f26fdfa9:::100000001f8.00000002:head [write 2981888~4096,write 3006464~4096,write 3137536~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:41.839 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.844644+0000", 2023-09-30T17:04:41.839 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.8959557309999999, 2023-09-30T17:04:41.839 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.81869189799999997, 2023-09-30T17:04:41.839 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:41.839 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:41.839 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:41.839 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:41.840 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:41.840 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179329 2023-09-30T17:04:41.840 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.840 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:41.840 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.840 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:41.840 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.844644+0000", 2023-09-30T17:04:41.840 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:41.840 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.840 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.840 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:41.841 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.844644+0000", 2023-09-30T17:04:41.841 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:41.841 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.841 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.841 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:41.841 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.846515+0000", 2023-09-30T17:04:41.841 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0018701950000000001 2023-09-30T17:04:41.841 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.841 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.841 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:41.842 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.846529+0000", 2023-09-30T17:04:41.842 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4791e-05 2023-09-30T17:04:41.842 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.842 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.842 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:41.842 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.846537+0000", 2023-09-30T17:04:41.842 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.96e-06 2023-09-30T17:04:41.842 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.842 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.842 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:41.843 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.846542+0000", 2023-09-30T17:04:41.843 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9180000000000002e-06 2023-09-30T17:04:41.843 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.843 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.843 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:41.843 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.630632+0000", 2023-09-30T17:04:41.843 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.78409002100000003 2023-09-30T17:04:41.843 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.843 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.843 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:41.843 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.630716+0000", 2023-09-30T17:04:41.844 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3227999999999997e-05 2023-09-30T17:04:41.844 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.844 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.844 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:41.845 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.630832+0000", 2023-09-30T17:04:41.845 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000116725 2023-09-30T17:04:41.845 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.845 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.845 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:41.845 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.652869+0000", 2023-09-30T17:04:41.845 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022037195999999998 2023-09-30T17:04:41.845 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.845 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.845 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:41.845 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.663228+0000", 2023-09-30T17:04:41.845 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010358911 2023-09-30T17:04:41.846 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.846 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.846 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:41.846 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.663293+0000", 2023-09-30T17:04:41.846 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4949000000000004e-05 2023-09-30T17:04:41.846 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.846 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.846 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:41.846 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.663336+0000", 2023-09-30T17:04:41.846 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3003999999999997e-05 2023-09-30T17:04:41.846 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:41.847 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:41.847 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:41.847 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.847 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.847 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179342 4.37 4:eff9002a:::100000001f8.00000003:head [write 3248128~4096,write 3264512~4096,write 3682304~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:41.847 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.846633+0000", 2023-09-30T17:04:41.847 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.893967087, 2023-09-30T17:04:41.847 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.81720047100000004, 2023-09-30T17:04:41.847 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:41.847 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:41.847 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:41.848 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:41.848 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:41.848 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179342 2023-09-30T17:04:41.848 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.848 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:41.848 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.848 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:41.848 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.846633+0000", 2023-09-30T17:04:41.848 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:41.848 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.848 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.848 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:41.849 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.846633+0000", 2023-09-30T17:04:41.849 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:41.849 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.849 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.849 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:41.849 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.852516+0000", 2023-09-30T17:04:41.849 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0058829950000000002 2023-09-30T17:04:41.849 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.849 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.849 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:41.849 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.852532+0000", 2023-09-30T17:04:41.850 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5897e-05 2023-09-30T17:04:41.850 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.850 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.850 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:41.850 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.852542+0000", 2023-09-30T17:04:41.850 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6220000000000004e-06 2023-09-30T17:04:41.850 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.850 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.850 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:41.850 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.852549+0000", 2023-09-30T17:04:41.851 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9970000000000001e-06 2023-09-30T17:04:41.851 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.851 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.851 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:41.851 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.641410+0000", 2023-09-30T17:04:41.851 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.78886158100000003 2023-09-30T17:04:41.851 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.851 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.851 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:41.851 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.641483+0000", 2023-09-30T17:04:41.851 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3090999999999995e-05 2023-09-30T17:04:41.852 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.852 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.852 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:41.852 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.641638+0000", 2023-09-30T17:04:41.852 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000155167 2023-09-30T17:04:41.852 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.852 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.852 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:41.852 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.663603+0000", 2023-09-30T17:04:41.852 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021964575 2023-09-30T17:04:41.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.853 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.853 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:41.853 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.663754+0000", 2023-09-30T17:04:41.853 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015129600000000001 2023-09-30T17:04:41.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.853 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.853 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:41.853 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.663800+0000", 2023-09-30T17:04:41.853 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5824e-05 2023-09-30T17:04:41.853 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.854 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.854 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:41.854 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.663834+0000", 2023-09-30T17:04:41.854 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3426000000000002e-05 2023-09-30T17:04:41.854 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:41.854 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:41.854 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:41.854 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.854 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.854 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179345 4.37 4:eff9002a:::100000001f8.00000003:head [write 1740800~4096,write 1802240~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:41.854 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.855791+0000", 2023-09-30T17:04:41.855 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.884809476, 2023-09-30T17:04:41.855 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.81831333100000003, 2023-09-30T17:04:41.855 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:41.855 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:41.855 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:41.855 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:41.855 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:41.855 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179345 2023-09-30T17:04:41.855 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.856 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:41.856 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.856 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:41.856 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.855791+0000", 2023-09-30T17:04:41.856 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:41.856 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.856 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.857 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:41.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.855791+0000", 2023-09-30T17:04:41.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:41.857 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.857 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:41.857 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.855791+0000", 2023-09-30T17:04:41.857 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0900000000000002e-07 2023-09-30T17:04:41.857 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.857 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.857 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:41.858 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.855803+0000", 2023-09-30T17:04:41.858 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1958e-05 2023-09-30T17:04:41.858 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.858 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.858 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:41.858 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.855810+0000", 2023-09-30T17:04:41.858 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.007e-06 2023-09-30T17:04:41.858 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.859 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.859 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:41.859 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.855816+0000", 2023-09-30T17:04:41.859 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3589999999999996e-06 2023-09-30T17:04:41.859 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.859 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.859 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:41.859 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.652598+0000", 2023-09-30T17:04:41.859 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.79678203400000003 2023-09-30T17:04:41.859 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.859 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.859 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:41.860 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.652670+0000", 2023-09-30T17:04:41.860 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1186000000000006e-05 2023-09-30T17:04:41.860 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.860 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.860 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:41.860 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.652804+0000", 2023-09-30T17:04:41.860 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013443099999999999 2023-09-30T17:04:41.860 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.861 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.861 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:41.861 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.667698+0000", 2023-09-30T17:04:41.861 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014894341 2023-09-30T17:04:41.861 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.861 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.861 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:41.861 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.674012+0000", 2023-09-30T17:04:41.861 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063136620000000003 2023-09-30T17:04:41.861 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.861 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.862 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:41.862 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.674064+0000", 2023-09-30T17:04:41.862 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1777000000000002e-05 2023-09-30T17:04:41.862 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.862 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.862 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:41.862 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.674104+0000", 2023-09-30T17:04:41.862 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0166999999999997e-05 2023-09-30T17:04:41.863 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:41.863 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:41.863 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:41.863 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.863 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.863 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179350 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 1875968~4096,write 1896448~4096,write 2420736~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:41.863 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.855896+0000", 2023-09-30T17:04:41.863 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.8847042959999998, 2023-09-30T17:04:41.864 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.83089869999999999, 2023-09-30T17:04:41.864 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:41.864 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:41.864 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:41.864 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:41.864 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:41.864 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179350 2023-09-30T17:04:41.864 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.864 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:41.865 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.865 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:41.865 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.855896+0000", 2023-09-30T17:04:41.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:41.865 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.865 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.865 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:41.865 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.855896+0000", 2023-09-30T17:04:41.865 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:41.866 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.866 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.866 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:41.866 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.855896+0000", 2023-09-30T17:04:41.866 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8599999999999998e-07 2023-09-30T17:04:41.866 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.866 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.866 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:41.866 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.855911+0000", 2023-09-30T17:04:41.866 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4704e-05 2023-09-30T17:04:41.867 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.867 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.867 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:41.867 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.855918+0000", 2023-09-30T17:04:41.867 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8009999999999998e-06 2023-09-30T17:04:41.867 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.867 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.867 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:41.867 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.855923+0000", 2023-09-30T17:04:41.867 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6879999999999998e-06 2023-09-30T17:04:41.867 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.867 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:41.868 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.657665+0000", 2023-09-30T17:04:41.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.80174238099999995 2023-09-30T17:04:41.868 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:41.868 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.657722+0000", 2023-09-30T17:04:41.868 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7411000000000003e-05 2023-09-30T17:04:41.868 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.868 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.868 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:41.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.657825+0000", 2023-09-30T17:04:41.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010278899999999999 2023-09-30T17:04:41.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.869 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:41.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.682194+0000", 2023-09-30T17:04:41.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.024369169 2023-09-30T17:04:41.869 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.869 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.869 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:41.869 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.686706+0000", 2023-09-30T17:04:41.869 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045118370000000003 2023-09-30T17:04:41.870 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.870 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:41.870 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.686758+0000", 2023-09-30T17:04:41.870 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2268999999999997e-05 2023-09-30T17:04:41.870 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.870 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.870 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:41.870 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.686795+0000", 2023-09-30T17:04:41.870 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6164999999999997e-05 2023-09-30T17:04:41.870 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:41.871 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:41.871 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:41.871 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.871 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.871 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179354 4.f 4:f0d983b2:::100000001f8.0000001f:head [write 3198976~8192,write 3211264~4096,write 3280896~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:41.871 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.856039+0000", 2023-09-30T17:04:41.871 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.8845615890000005, 2023-09-30T17:04:41.871 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.83060850600000002, 2023-09-30T17:04:41.871 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:41.871 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:41.871 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:41.872 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:41.872 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:41.872 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179354 2023-09-30T17:04:41.873 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.873 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:41.873 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.873 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:41.873 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.856039+0000", 2023-09-30T17:04:41.873 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:41.873 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.873 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.874 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:41.874 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.856039+0000", 2023-09-30T17:04:41.874 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:41.874 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.874 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.874 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:41.874 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.857519+0000", 2023-09-30T17:04:41.875 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014801899999999999 2023-09-30T17:04:41.875 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.875 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.875 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:41.875 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.857541+0000", 2023-09-30T17:04:41.875 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1982999999999999e-05 2023-09-30T17:04:41.875 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.875 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.875 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:41.876 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.857555+0000", 2023-09-30T17:04:41.876 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4195999999999999e-05 2023-09-30T17:04:41.876 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.876 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.876 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:41.876 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.857563+0000", 2023-09-30T17:04:41.876 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2919999999999996e-06 2023-09-30T17:04:41.877 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.877 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.877 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:41.877 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.657650+0000", 2023-09-30T17:04:41.877 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.80008643300000004 2023-09-30T17:04:41.877 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.877 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.877 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:41.877 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.657734+0000", 2023-09-30T17:04:41.878 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4680999999999998e-05 2023-09-30T17:04:41.878 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.878 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.878 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:41.878 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.657901+0000", 2023-09-30T17:04:41.878 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000166525 2023-09-30T17:04:41.878 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.878 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.878 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:41.878 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.683284+0000", 2023-09-30T17:04:41.879 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.025383249 2023-09-30T17:04:41.879 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.879 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.879 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:41.879 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.686556+0000", 2023-09-30T17:04:41.879 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0032721510000000001 2023-09-30T17:04:41.879 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.879 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.880 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:41.880 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.686607+0000", 2023-09-30T17:04:41.880 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0821e-05 2023-09-30T17:04:41.880 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.880 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.880 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:41.880 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.686647+0000", 2023-09-30T17:04:41.880 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9984999999999997e-05 2023-09-30T17:04:41.880 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:41.881 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:41.881 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:41.881 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.882 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.882 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179356 4.2f 4:f59f865b:::100000001f8.00000007:head [write 2682880~4096,write 2818048~4096,write 2863104~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:41.882 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.857578+0000", 2023-09-30T17:04:41.882 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.8830221890000001, 2023-09-30T17:04:41.882 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.82923716300000005, 2023-09-30T17:04:41.882 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:41.882 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:41.882 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:41.882 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:41.883 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:41.883 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179356 2023-09-30T17:04:41.883 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.883 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:41.883 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.883 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:41.883 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.857578+0000", 2023-09-30T17:04:41.883 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:41.883 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.883 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.884 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:41.884 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.857578+0000", 2023-09-30T17:04:41.884 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:41.884 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.884 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.884 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:41.884 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.857578+0000", 2023-09-30T17:04:41.884 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9100000000000004e-07 2023-09-30T17:04:41.884 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.885 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.885 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:41.885 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.857600+0000", 2023-09-30T17:04:41.885 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.154e-05 2023-09-30T17:04:41.885 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.885 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.885 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:41.885 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.857607+0000", 2023-09-30T17:04:41.885 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.579e-06 2023-09-30T17:04:41.886 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.886 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.886 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:41.886 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.857612+0000", 2023-09-30T17:04:41.886 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3890000000000004e-06 2023-09-30T17:04:41.886 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.886 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.886 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:41.887 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.663649+0000", 2023-09-30T17:04:41.887 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.80603691 2023-09-30T17:04:41.887 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.887 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.887 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:41.887 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.663727+0000", 2023-09-30T17:04:41.887 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7764999999999998e-05 2023-09-30T17:04:41.887 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.887 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.888 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:41.888 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.663894+0000", 2023-09-30T17:04:41.888 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016739899999999999 2023-09-30T17:04:41.888 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.888 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.888 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:41.888 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.686680+0000", 2023-09-30T17:04:41.888 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022786280999999999 2023-09-30T17:04:41.888 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.888 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.889 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:41.889 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.686733+0000", 2023-09-30T17:04:41.889 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2564e-05 2023-09-30T17:04:41.889 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.889 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.889 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:41.889 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.686783+0000", 2023-09-30T17:04:41.889 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0049000000000001e-05 2023-09-30T17:04:41.890 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.890 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.890 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:41.890 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.686815+0000", 2023-09-30T17:04:41.890 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2196000000000001e-05 2023-09-30T17:04:41.890 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:41.890 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:41.890 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:41.890 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.890 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.891 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179358 4.37 4:eff9002a:::100000001f8.00000003:head [write 446464~4096,write 618496~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:41.891 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.859571+0000", 2023-09-30T17:04:41.891 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.8810289789999999, 2023-09-30T17:04:41.891 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.82731242000000005, 2023-09-30T17:04:41.891 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:41.891 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:41.892 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:41.892 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:41.892 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:41.892 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179358 2023-09-30T17:04:41.892 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.892 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:41.892 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.892 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:41.892 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.859571+0000", 2023-09-30T17:04:41.893 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:41.893 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.893 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.893 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:41.893 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.859571+0000", 2023-09-30T17:04:41.893 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:41.893 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.893 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.893 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:41.893 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.861518+0000", 2023-09-30T17:04:41.894 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001947245 2023-09-30T17:04:41.894 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.894 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.894 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:41.894 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.861534+0000", 2023-09-30T17:04:41.894 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5288999999999999e-05 2023-09-30T17:04:41.894 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.894 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.894 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:41.894 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.861555+0000", 2023-09-30T17:04:41.895 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1667000000000001e-05 2023-09-30T17:04:41.895 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.895 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.895 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:41.895 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.861564+0000", 2023-09-30T17:04:41.895 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3990000000000004e-06 2023-09-30T17:04:41.895 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.895 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.895 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:41.895 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.663862+0000", 2023-09-30T17:04:41.896 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.80229824299999997 2023-09-30T17:04:41.896 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.896 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.896 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:41.896 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.663945+0000", 2023-09-30T17:04:41.896 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2699000000000002e-05 2023-09-30T17:04:41.896 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.896 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.897 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:41.897 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.664081+0000", 2023-09-30T17:04:41.897 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000136315 2023-09-30T17:04:41.897 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.897 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.897 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:41.897 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.686695+0000", 2023-09-30T17:04:41.897 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022613847999999999 2023-09-30T17:04:41.898 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.898 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.898 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:41.898 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.686804+0000", 2023-09-30T17:04:41.898 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010927800000000001 2023-09-30T17:04:41.898 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.898 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.898 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:41.898 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.686849+0000", 2023-09-30T17:04:41.898 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4722999999999999e-05 2023-09-30T17:04:41.899 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.899 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.899 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:41.899 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.686884+0000", 2023-09-30T17:04:41.899 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4714e-05 2023-09-30T17:04:41.899 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:41.899 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:41.899 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:41.899 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.900 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.900 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179392 4.f 4:f26fdfa9:::100000001f8.00000002:head [write 184320~4096,write 335872~4096,write 368640~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:41.900 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.881569+0000", 2023-09-30T17:04:41.900 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 4.8590310729999997, 2023-09-30T17:04:41.900 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.82211667300000002, 2023-09-30T17:04:41.900 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:41.900 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:41.900 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:41.900 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:41.900 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:41.901 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179392 2023-09-30T17:04:41.901 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.901 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:41.901 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.901 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:41.901 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.881569+0000", 2023-09-30T17:04:41.901 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:41.901 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.901 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.901 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:41.903 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.881569+0000", 2023-09-30T17:04:41.903 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:41.904 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.904 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.904 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:41.904 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.883516+0000", 2023-09-30T17:04:41.904 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001946765 2023-09-30T17:04:41.904 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.904 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.904 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:41.905 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.883532+0000", 2023-09-30T17:04:41.905 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6008e-05 2023-09-30T17:04:41.905 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.905 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.905 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:41.905 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.883542+0000", 2023-09-30T17:04:41.905 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0438999999999999e-05 2023-09-30T17:04:41.905 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.905 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.906 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:41.906 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.883550+0000", 2023-09-30T17:04:41.906 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2910000000000002e-06 2023-09-30T17:04:41.906 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.906 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.906 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:41.906 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.667809+0000", 2023-09-30T17:04:41.906 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.78425961600000005 2023-09-30T17:04:41.906 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.906 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.906 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:41.906 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.667888+0000", 2023-09-30T17:04:41.906 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9043999999999997e-05 2023-09-30T17:04:41.907 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.907 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.907 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:41.907 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.668033+0000", 2023-09-30T17:04:41.907 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014433499999999999 2023-09-30T17:04:41.907 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.907 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.907 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:41.907 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.691721+0000", 2023-09-30T17:04:41.907 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.023688407000000002 2023-09-30T17:04:41.907 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.907 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.907 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:41.908 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.703611+0000", 2023-09-30T17:04:41.909 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.01188963 2023-09-30T17:04:41.909 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.909 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.909 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:41.909 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.703655+0000", 2023-09-30T17:04:41.909 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4696e-05 2023-09-30T17:04:41.909 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:41.909 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:41.910 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:41.910 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.703686+0000", 2023-09-30T17:04:41.910 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0442000000000001e-05 2023-09-30T17:04:41.910 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:41.910 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:41.910 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:41.910 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:41.910 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:41.910 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:04:41.912 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:04:41.912 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:41.912+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:42.013 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:42.012+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:42.059 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:04:42.059 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:04:42.059 INFO:teuthology.orchestra.run.smithi031.stdout: "num_ops": 0 2023-09-30T17:04:42.059 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:04:42.069 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:04:42.114 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:42.114+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:42.215 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:42.215+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:42.243 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:04:42.243 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:04:42.243 INFO:teuthology.orchestra.run.smithi031.stdout: "complaint_time": 30, 2023-09-30T17:04:42.243 INFO:teuthology.orchestra.run.smithi031.stdout: "num_blocked_ops": 0 2023-09-30T17:04:42.243 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:04:42.253 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:04:42.317 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:42.316+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:42.388 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:04:42.388 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 20, 2023-09-30T17:04:42.389 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 600, 2023-09-30T17:04:42.389 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:04:42.389 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.389 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165665 4.6 4:63e80496:::100000001f8.0000001e:head [write 1212416~4096,write 1318912~4096,write 1462272~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:42.389 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.209892+0000", 2023-09-30T17:04:42.389 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 11.177087576, 2023-09-30T17:04:42.389 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.76500929900000003, 2023-09-30T17:04:42.389 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:42.389 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:42.389 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:42.390 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:42.390 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:42.390 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165665 2023-09-30T17:04:42.390 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.390 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:42.390 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.390 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:42.390 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.209892+0000", 2023-09-30T17:04:42.390 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:42.390 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.390 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.391 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:42.391 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.209892+0000", 2023-09-30T17:04:42.391 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:42.391 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.391 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.391 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:42.391 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.209893+0000", 2023-09-30T17:04:42.391 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5099999999999999e-07 2023-09-30T17:04:42.391 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.391 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.392 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:42.392 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.209908+0000", 2023-09-30T17:04:42.392 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4754e-05 2023-09-30T17:04:42.392 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.392 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.392 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:42.392 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.209916+0000", 2023-09-30T17:04:42.392 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.7940000000000008e-06 2023-09-30T17:04:42.392 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.392 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.392 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:42.393 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.209923+0000", 2023-09-30T17:04:42.393 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5429999999999999e-06 2023-09-30T17:04:42.393 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.393 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.393 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:42.393 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.899390+0000", 2023-09-30T17:04:42.393 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.689467371 2023-09-30T17:04:42.393 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.393 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.393 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:42.393 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.899462+0000", 2023-09-30T17:04:42.394 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1273999999999996e-05 2023-09-30T17:04:42.394 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.394 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.394 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:42.394 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.899610+0000", 2023-09-30T17:04:42.394 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014818599999999999 2023-09-30T17:04:42.394 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.394 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.394 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:42.394 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.919587+0000", 2023-09-30T17:04:42.394 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.019977042 2023-09-30T17:04:42.395 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.395 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.395 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:42.395 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.974802+0000", 2023-09-30T17:04:42.395 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.055214764 2023-09-30T17:04:42.395 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.395 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.395 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:42.395 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.974863+0000", 2023-09-30T17:04:42.395 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1377000000000005e-05 2023-09-30T17:04:42.395 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.395 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.396 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:42.396 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.974901+0000", 2023-09-30T17:04:42.396 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8543e-05 2023-09-30T17:04:42.396 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:42.396 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:42.396 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:42.396 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.396 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.396 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165673 4.6 4:63e80496:::100000001f8.0000001e:head [write 516096~4096,write 524288~4096,write 532480~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:42.396 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.210099+0000", 2023-09-30T17:04:42.397 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 11.176880705, 2023-09-30T17:04:42.397 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.76494798200000003, 2023-09-30T17:04:42.397 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:42.397 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:42.397 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:42.397 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:42.397 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:42.397 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165673 2023-09-30T17:04:42.397 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.397 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:42.397 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.398 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:42.398 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.210099+0000", 2023-09-30T17:04:42.398 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:42.398 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.398 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.398 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:42.398 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.210099+0000", 2023-09-30T17:04:42.398 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:42.398 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.398 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.398 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:42.399 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.210100+0000", 2023-09-30T17:04:42.399 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0699999999999997e-07 2023-09-30T17:04:42.399 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.399 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.399 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:42.399 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.210117+0000", 2023-09-30T17:04:42.399 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7501000000000001e-05 2023-09-30T17:04:42.399 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.399 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.399 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:42.399 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.210126+0000", 2023-09-30T17:04:42.400 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2629999999999992e-06 2023-09-30T17:04:42.400 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.400 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.400 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:42.400 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.210133+0000", 2023-09-30T17:04:42.400 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8079999999999999e-06 2023-09-30T17:04:42.400 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.400 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.400 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:42.400 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.902650+0000", 2023-09-30T17:04:42.401 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.69251684800000002 2023-09-30T17:04:42.401 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.401 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.401 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:42.401 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.902724+0000", 2023-09-30T17:04:42.401 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4376999999999996e-05 2023-09-30T17:04:42.401 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.401 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.401 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:42.401 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.902881+0000", 2023-09-30T17:04:42.401 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000156269 2023-09-30T17:04:42.402 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.402 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.402 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:42.402 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.925614+0000", 2023-09-30T17:04:42.402 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.022732937000000002 2023-09-30T17:04:42.402 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.402 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.402 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:42.402 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.974955+0000", 2023-09-30T17:04:42.402 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.04934115 2023-09-30T17:04:42.403 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.403 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.403 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:42.403 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.975012+0000", 2023-09-30T17:04:42.403 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6949e-05 2023-09-30T17:04:42.403 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.403 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.403 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:42.403 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.975047+0000", 2023-09-30T17:04:42.403 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5373000000000002e-05 2023-09-30T17:04:42.403 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:42.404 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:42.404 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:42.404 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.404 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.404 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165689 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 188416~4096,write 229376~4096,write 299008~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:42.404 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.217300+0000", 2023-09-30T17:04:42.404 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 11.169680131, 2023-09-30T17:04:42.404 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75814632500000001, 2023-09-30T17:04:42.404 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:42.404 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:42.404 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:42.404 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:42.405 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:42.405 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165689 2023-09-30T17:04:42.405 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.405 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:42.405 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.405 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:42.405 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.217300+0000", 2023-09-30T17:04:42.405 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:42.405 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.405 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.405 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:42.405 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.217300+0000", 2023-09-30T17:04:42.406 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:42.406 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.406 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.406 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:42.406 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.217300+0000", 2023-09-30T17:04:42.406 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3000000000000001e-07 2023-09-30T17:04:42.406 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.406 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.406 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:42.406 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.217314+0000", 2023-09-30T17:04:42.407 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3901e-05 2023-09-30T17:04:42.407 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.407 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.407 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:42.407 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.217321+0000", 2023-09-30T17:04:42.407 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5869999999999998e-06 2023-09-30T17:04:42.407 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.407 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.407 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:42.408 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.217326+0000", 2023-09-30T17:04:42.408 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7740000000000001e-06 2023-09-30T17:04:42.408 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.408 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.408 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:42.408 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.907842+0000", 2023-09-30T17:04:42.408 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.69051533600000004 2023-09-30T17:04:42.408 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.408 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.408 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:42.409 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.907927+0000", 2023-09-30T17:04:42.409 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5619999999999997e-05 2023-09-30T17:04:42.409 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.409 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.409 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:42.409 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.908097+0000", 2023-09-30T17:04:42.409 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016991400000000001 2023-09-30T17:04:42.409 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.409 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.410 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:42.410 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.925623+0000", 2023-09-30T17:04:42.410 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.017525888999999999 2023-09-30T17:04:42.410 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.410 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.410 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:42.410 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.975110+0000", 2023-09-30T17:04:42.410 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.049486789000000003 2023-09-30T17:04:42.410 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.410 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.410 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:42.411 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.975170+0000", 2023-09-30T17:04:42.411 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9960000000000002e-05 2023-09-30T17:04:42.411 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.411 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.411 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:42.411 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.975446+0000", 2023-09-30T17:04:42.411 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000276125 2023-09-30T17:04:42.411 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:42.411 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:42.412 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:42.412 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.412 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.412 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165875 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 458752~4096,write 1454080~4096,write 1634304~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:42.412 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.295916+0000", 2023-09-30T17:04:42.412 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 11.091063481000001, 2023-09-30T17:04:42.412 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.76379055500000004, 2023-09-30T17:04:42.412 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:42.412 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:42.412 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:42.412 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:42.413 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:42.413 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165875 2023-09-30T17:04:42.413 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.413 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:42.413 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.413 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:42.413 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.295916+0000", 2023-09-30T17:04:42.413 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:42.413 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.414 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.414 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:42.414 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.295916+0000", 2023-09-30T17:04:42.414 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:42.414 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.414 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.414 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:42.414 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.295917+0000", 2023-09-30T17:04:42.414 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9500000000000002e-07 2023-09-30T17:04:42.415 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.415 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.415 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:42.415 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.295932+0000", 2023-09-30T17:04:42.415 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4803999999999999e-05 2023-09-30T17:04:42.415 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.415 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.415 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:42.415 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.295941+0000", 2023-09-30T17:04:42.416 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.448e-06 2023-09-30T17:04:42.416 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.416 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.416 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:42.416 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.295948+0000", 2023-09-30T17:04:42.416 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9199999999999998e-06 2023-09-30T17:04:42.416 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.416 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.416 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:42.417 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.971359+0000", 2023-09-30T17:04:42.417 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67541110500000001 2023-09-30T17:04:42.417 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.417 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.417 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:42.417 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.971433+0000", 2023-09-30T17:04:42.417 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3388999999999998e-05 2023-09-30T17:04:42.417 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.417 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.417 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:42.417 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.971583+0000", 2023-09-30T17:04:42.418 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015035999999999999 2023-09-30T17:04:42.418 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.418 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.418 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:42.418 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.982409+0000", 2023-09-30T17:04:42.418 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010826242999999999 2023-09-30T17:04:42.418 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.418 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.418 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:42.418 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.059610+0000", 2023-09-30T17:04:42.419 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.077201160000000005 2023-09-30T17:04:42.419 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.419 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.419 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:42.419 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.059669+0000", 2023-09-30T17:04:42.419 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8965999999999998e-05 2023-09-30T17:04:42.419 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.419 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.419 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:42.419 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.059707+0000", 2023-09-30T17:04:42.419 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7564999999999997e-05 2023-09-30T17:04:42.419 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:42.420 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:42.420 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:42.420 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.420 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.420 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165878 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 2277376~4096,write 2371584~4096,write 4050944~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:42.420 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.299610+0000", 2023-09-30T17:04:42.420 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 11.087369402, 2023-09-30T17:04:42.420 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75525803300000005, 2023-09-30T17:04:42.420 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:42.420 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:42.421 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:42.421 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:42.421 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:42.421 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165878 2023-09-30T17:04:42.421 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.421 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:42.421 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.421 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:42.421 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299610+0000", 2023-09-30T17:04:42.421 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:42.421 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.422 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.422 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:42.422 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299610+0000", 2023-09-30T17:04:42.422 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:42.422 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.423 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.423 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:42.424 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299611+0000", 2023-09-30T17:04:42.424 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7299999999999996e-07 2023-09-30T17:04:42.424 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.424 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.424 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:42.424 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299623+0000", 2023-09-30T17:04:42.424 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2513e-05 2023-09-30T17:04:42.424 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.424 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.424 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:42.425 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299630+0000", 2023-09-30T17:04:42.425 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0090000000000001e-06 2023-09-30T17:04:42.425 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.425 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.425 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:42.425 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299638+0000", 2023-09-30T17:04:42.425 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1210000000000001e-06 2023-09-30T17:04:42.425 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.425 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.425 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:42.425 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.971347+0000", 2023-09-30T17:04:42.426 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67170925699999995 2023-09-30T17:04:42.426 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.426 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.426 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:42.426 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.971419+0000", 2023-09-30T17:04:42.426 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2495000000000003e-05 2023-09-30T17:04:42.426 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.426 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.426 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:42.426 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.971567+0000", 2023-09-30T17:04:42.427 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014805499999999999 2023-09-30T17:04:42.427 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.427 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.427 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:42.427 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.982312+0000", 2023-09-30T17:04:42.427 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010744584 2023-09-30T17:04:42.427 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.427 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.427 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:42.427 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.054770+0000", 2023-09-30T17:04:42.427 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.072457683999999994 2023-09-30T17:04:42.427 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.428 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.428 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:42.428 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.054825+0000", 2023-09-30T17:04:42.428 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5210000000000002e-05 2023-09-30T17:04:42.428 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.428 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.428 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:42.428 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.054868+0000", 2023-09-30T17:04:42.428 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3532000000000003e-05 2023-09-30T17:04:42.428 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:42.428 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:42.429 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:42.429 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.429 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.429 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165890 4.36 4:6da220e6:::100000001f8.0000003f:head [write 3395584~4096,write 3436544~4096,write 3444736~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:42.429 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.299835+0000", 2023-09-30T17:04:42.429 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 11.087144718999999, 2023-09-30T17:04:42.429 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.76012937700000005, 2023-09-30T17:04:42.429 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:42.429 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:42.429 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:42.429 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:42.430 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:42.430 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165890 2023-09-30T17:04:42.430 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.430 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:42.430 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.430 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:42.430 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299835+0000", 2023-09-30T17:04:42.431 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:42.431 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.431 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.431 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:42.431 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299835+0000", 2023-09-30T17:04:42.431 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:42.431 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.431 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.431 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:42.432 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299835+0000", 2023-09-30T17:04:42.432 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5699999999999998e-07 2023-09-30T17:04:42.432 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.432 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.432 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:42.432 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299905+0000", 2023-09-30T17:04:42.432 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9908999999999998e-05 2023-09-30T17:04:42.432 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.432 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.432 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:42.433 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299914+0000", 2023-09-30T17:04:42.433 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9630000000000004e-06 2023-09-30T17:04:42.433 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.433 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.433 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:42.433 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299921+0000", 2023-09-30T17:04:42.433 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8079999999999999e-06 2023-09-30T17:04:42.433 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.433 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.433 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:42.434 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.975617+0000", 2023-09-30T17:04:42.434 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67569579099999999 2023-09-30T17:04:42.434 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.434 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.434 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:42.434 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.975700+0000", 2023-09-30T17:04:42.434 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3462999999999997e-05 2023-09-30T17:04:42.434 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.434 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.434 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:42.434 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.975871+0000", 2023-09-30T17:04:42.435 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017027399999999999 2023-09-30T17:04:42.435 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.435 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.435 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:42.435 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.001290+0000", 2023-09-30T17:04:42.435 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.025419576999999999 2023-09-30T17:04:42.435 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.435 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.435 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:42.435 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.059876+0000", 2023-09-30T17:04:42.435 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.058585849000000002 2023-09-30T17:04:42.435 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.436 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.436 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:42.436 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.059929+0000", 2023-09-30T17:04:42.436 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3053000000000002e-05 2023-09-30T17:04:42.436 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.436 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.436 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:42.436 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.059964+0000", 2023-09-30T17:04:42.436 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5233e-05 2023-09-30T17:04:42.436 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:42.436 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:42.436 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:42.437 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.437 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.437 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165893 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 2748416~4096,write 2764800~4096,write 3031040~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:42.437 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.299965+0000", 2023-09-30T17:04:42.437 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 11.087014442999999, 2023-09-30T17:04:42.437 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75987149300000001, 2023-09-30T17:04:42.437 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:42.437 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:42.437 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:42.437 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:42.437 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:42.438 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165893 2023-09-30T17:04:42.438 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.438 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:42.438 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.438 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:42.438 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299965+0000", 2023-09-30T17:04:42.439 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:42.439 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.439 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.439 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:42.439 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299965+0000", 2023-09-30T17:04:42.439 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:42.439 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.439 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.439 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:42.440 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.301184+0000", 2023-09-30T17:04:42.440 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0012189779999999999 2023-09-30T17:04:42.440 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.440 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.440 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:42.440 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.301199+0000", 2023-09-30T17:04:42.440 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4626e-05 2023-09-30T17:04:42.440 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.440 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.441 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:42.441 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.301209+0000", 2023-09-30T17:04:42.441 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.042e-05 2023-09-30T17:04:42.441 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.441 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.441 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:42.441 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.301217+0000", 2023-09-30T17:04:42.441 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4000000000000003e-06 2023-09-30T17:04:42.441 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.441 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.442 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:42.442 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.975800+0000", 2023-09-30T17:04:42.442 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67458368700000004 2023-09-30T17:04:42.442 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.442 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.442 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:42.442 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.975886+0000", 2023-09-30T17:04:42.442 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5722000000000004e-05 2023-09-30T17:04:42.443 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.443 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.443 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:42.443 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.976065+0000", 2023-09-30T17:04:42.443 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000178705 2023-09-30T17:04:42.443 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.443 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.443 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:42.443 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.998244+0000", 2023-09-30T17:04:42.443 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.022178788000000001 2023-09-30T17:04:42.444 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.444 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.444 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:42.444 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.059746+0000", 2023-09-30T17:04:42.444 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.061501950999999999 2023-09-30T17:04:42.444 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.444 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.444 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:42.444 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.059802+0000", 2023-09-30T17:04:42.445 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6128000000000002e-05 2023-09-30T17:04:42.445 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.445 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.445 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:42.445 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.059837+0000", 2023-09-30T17:04:42.445 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5088e-05 2023-09-30T17:04:42.445 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:42.445 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:42.445 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:42.445 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.445 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.446 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165908 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 2269184~4096,write 4112384~4096,write 4136960~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:42.446 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.309255+0000", 2023-09-30T17:04:42.446 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 11.077724674000001, 2023-09-30T17:04:42.446 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.76105314999999996, 2023-09-30T17:04:42.446 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:42.446 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:42.446 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:42.446 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:42.447 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:42.447 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165908 2023-09-30T17:04:42.447 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.447 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:42.447 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.447 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:42.447 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.309255+0000", 2023-09-30T17:04:42.447 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:42.447 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.448 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.448 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:42.448 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.309255+0000", 2023-09-30T17:04:42.448 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:42.448 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.448 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.448 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:42.448 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.311162+0000", 2023-09-30T17:04:42.448 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001906886 2023-09-30T17:04:42.449 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.449 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.449 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:42.449 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.311177+0000", 2023-09-30T17:04:42.449 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5193e-05 2023-09-30T17:04:42.449 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.449 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.449 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:42.449 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.311188+0000", 2023-09-30T17:04:42.450 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0805000000000001e-05 2023-09-30T17:04:42.450 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.450 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.450 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:42.450 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.311196+0000", 2023-09-30T17:04:42.450 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.627e-06 2023-09-30T17:04:42.450 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.450 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.450 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:42.451 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.982808+0000", 2023-09-30T17:04:42.451 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67161246100000005 2023-09-30T17:04:42.451 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.451 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.451 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:42.451 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.982872+0000", 2023-09-30T17:04:42.451 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3646999999999996e-05 2023-09-30T17:04:42.451 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.451 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.451 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:42.452 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.983017+0000", 2023-09-30T17:04:42.452 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000144964 2023-09-30T17:04:42.452 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.452 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.452 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:42.452 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.010841+0000", 2023-09-30T17:04:42.452 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.027824637999999999 2023-09-30T17:04:42.452 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.452 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.452 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:42.452 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.070218+0000", 2023-09-30T17:04:42.453 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.059376421999999998 2023-09-30T17:04:42.453 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.453 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.453 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:42.453 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.070272+0000", 2023-09-30T17:04:42.453 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4407000000000003e-05 2023-09-30T17:04:42.453 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.453 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.453 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:42.453 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.070308+0000", 2023-09-30T17:04:42.453 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6100000000000003e-05 2023-09-30T17:04:42.454 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:42.454 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:42.454 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:42.454 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.454 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.454 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165910 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 1191936~4096,write 1277952~4096,write 1613824~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:42.454 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.311262+0000", 2023-09-30T17:04:42.454 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 11.075718105, 2023-09-30T17:04:42.454 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75916103300000004, 2023-09-30T17:04:42.454 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:42.455 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:42.455 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:42.455 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:42.455 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:42.455 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165910 2023-09-30T17:04:42.455 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.455 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:42.455 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.455 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:42.455 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.311262+0000", 2023-09-30T17:04:42.456 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:42.456 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.456 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.456 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:42.456 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.311262+0000", 2023-09-30T17:04:42.456 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:42.456 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.456 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.456 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:42.456 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.313172+0000", 2023-09-30T17:04:42.457 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001910847 2023-09-30T17:04:42.457 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.457 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.457 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:42.457 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.313191+0000", 2023-09-30T17:04:42.457 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8416000000000001e-05 2023-09-30T17:04:42.457 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.457 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.457 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:42.457 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.313204+0000", 2023-09-30T17:04:42.458 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.271e-05 2023-09-30T17:04:42.458 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.458 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.458 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:42.458 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.313211+0000", 2023-09-30T17:04:42.458 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3529999999999997e-06 2023-09-30T17:04:42.458 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.458 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.458 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:42.458 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.990896+0000", 2023-09-30T17:04:42.458 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67768552500000001 2023-09-30T17:04:42.458 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.459 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.459 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:42.459 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.990972+0000", 2023-09-30T17:04:42.459 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5658e-05 2023-09-30T17:04:42.459 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.459 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.459 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:42.459 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.991072+0000", 2023-09-30T17:04:42.459 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.9636000000000006e-05 2023-09-30T17:04:42.459 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.459 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.460 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:42.460 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.010847+0000", 2023-09-30T17:04:42.460 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.019774908000000001 2023-09-30T17:04:42.460 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.460 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.460 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:42.460 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.070345+0000", 2023-09-30T17:04:42.460 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.059497983999999997 2023-09-30T17:04:42.460 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.460 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.460 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:42.460 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.070392+0000", 2023-09-30T17:04:42.461 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6851999999999998e-05 2023-09-30T17:04:42.461 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.461 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.461 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:42.461 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.070423+0000", 2023-09-30T17:04:42.461 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.1143999999999999e-05 2023-09-30T17:04:42.461 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:42.461 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:42.461 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:42.461 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.461 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.462 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165918 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 2666496~4096,write 2760704~4096,write 3031040~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:42.462 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.315883+0000", 2023-09-30T17:04:42.462 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 11.071096278000001, 2023-09-30T17:04:42.462 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75903742100000005, 2023-09-30T17:04:42.462 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:42.462 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:42.462 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:42.462 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:42.462 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:42.462 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165918 2023-09-30T17:04:42.462 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.463 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:42.463 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.463 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:42.463 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315883+0000", 2023-09-30T17:04:42.463 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:42.463 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.463 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.463 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:42.463 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315883+0000", 2023-09-30T17:04:42.463 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:42.463 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.463 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.464 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:42.464 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315884+0000", 2023-09-30T17:04:42.464 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8199999999999999e-07 2023-09-30T17:04:42.464 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.464 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.464 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:42.464 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315903+0000", 2023-09-30T17:04:42.464 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9089e-05 2023-09-30T17:04:42.464 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.464 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.464 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:42.465 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315916+0000", 2023-09-30T17:04:42.465 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2636999999999999e-05 2023-09-30T17:04:42.465 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.465 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.465 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:42.465 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315923+0000", 2023-09-30T17:04:42.465 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2259999999999999e-06 2023-09-30T17:04:42.465 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.465 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.465 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:42.465 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.993661+0000", 2023-09-30T17:04:42.466 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67773771500000002 2023-09-30T17:04:42.466 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.466 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.466 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:42.466 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.993749+0000", 2023-09-30T17:04:42.466 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.7721999999999998e-05 2023-09-30T17:04:42.466 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.466 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.466 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:42.466 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.996215+0000", 2023-09-30T17:04:42.466 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0024667360000000002 2023-09-30T17:04:42.467 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.467 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.467 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:42.467 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.010996+0000", 2023-09-30T17:04:42.467 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.014780873 2023-09-30T17:04:42.467 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.467 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.467 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:42.467 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.074853+0000", 2023-09-30T17:04:42.467 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.063857133999999996 2023-09-30T17:04:42.467 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.468 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.468 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:42.468 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.074888+0000", 2023-09-30T17:04:42.468 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5067000000000002e-05 2023-09-30T17:04:42.468 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.468 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.468 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:42.468 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.074921+0000", 2023-09-30T17:04:42.468 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.2539999999999997e-05 2023-09-30T17:04:42.468 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:42.468 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:42.468 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:42.469 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.469 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.469 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165921 4.6 4:63e80496:::100000001f8.0000001e:head [write 679936~4096,write 1089536~4096,write 1138688~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:42.469 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.315973+0000", 2023-09-30T17:04:42.469 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 11.071006343000001, 2023-09-30T17:04:42.469 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75610897399999999, 2023-09-30T17:04:42.469 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:42.469 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:42.469 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:42.469 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:42.469 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:42.470 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165921 2023-09-30T17:04:42.470 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.470 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:42.470 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.470 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:42.470 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315973+0000", 2023-09-30T17:04:42.470 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:42.470 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.470 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.470 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:42.471 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315973+0000", 2023-09-30T17:04:42.471 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:42.471 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.471 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.471 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:42.471 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315974+0000", 2023-09-30T17:04:42.471 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1100000000000001e-07 2023-09-30T17:04:42.471 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.471 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.471 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:42.471 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315986+0000", 2023-09-30T17:04:42.472 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2673e-05 2023-09-30T17:04:42.472 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.472 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.472 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:42.472 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315995+0000", 2023-09-30T17:04:42.472 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1689999999999992e-06 2023-09-30T17:04:42.472 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.472 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.473 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:42.473 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.316000+0000", 2023-09-30T17:04:42.473 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9849999999999997e-06 2023-09-30T17:04:42.473 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.473 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.473 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:42.473 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.994495+0000", 2023-09-30T17:04:42.473 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67849566800000005 2023-09-30T17:04:42.473 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.473 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.473 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:42.474 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.994579+0000", 2023-09-30T17:04:42.474 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4089000000000001e-05 2023-09-30T17:04:42.474 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.474 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.474 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:42.474 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.994744+0000", 2023-09-30T17:04:42.474 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000164327 2023-09-30T17:04:42.474 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.474 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.475 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:42.475 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.010988+0000", 2023-09-30T17:04:42.475 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.016244705000000002 2023-09-30T17:04:42.475 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.475 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.475 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:42.475 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.071979+0000", 2023-09-30T17:04:42.475 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.060990111 2023-09-30T17:04:42.475 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.475 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.476 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:42.476 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.072035+0000", 2023-09-30T17:04:42.476 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6320000000000003e-05 2023-09-30T17:04:42.476 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.476 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.476 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:42.476 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.072082+0000", 2023-09-30T17:04:42.476 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7515999999999997e-05 2023-09-30T17:04:42.476 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:42.476 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:42.476 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:42.476 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.477 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.477 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165949 4.6 4:616d4c41:::100000001f8.00000034:head [write 409600~4096,write 618496~4096,write 659456~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:42.477 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.326340+0000", 2023-09-30T17:04:42.477 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 11.060640229000001, 2023-09-30T17:04:42.477 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75612495899999999, 2023-09-30T17:04:42.477 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:42.477 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:42.477 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:42.477 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:42.477 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:42.477 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165949 2023-09-30T17:04:42.478 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.478 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:42.478 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.478 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:42.478 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.326340+0000", 2023-09-30T17:04:42.478 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:42.478 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.478 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.478 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:42.478 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.326340+0000", 2023-09-30T17:04:42.478 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:42.479 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.479 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.479 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:42.479 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.326340+0000", 2023-09-30T17:04:42.479 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0200000000000002e-07 2023-09-30T17:04:42.479 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.479 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.479 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:42.479 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.326352+0000", 2023-09-30T17:04:42.480 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1715e-05 2023-09-30T17:04:42.480 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.480 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.480 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:42.480 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.326358+0000", 2023-09-30T17:04:42.480 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3679999999999998e-06 2023-09-30T17:04:42.480 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.480 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.480 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:42.481 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.326363+0000", 2023-09-30T17:04:42.481 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9629999999999997e-06 2023-09-30T17:04:42.481 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.481 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.481 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:42.481 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.006610+0000", 2023-09-30T17:04:42.481 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.68024690499999996 2023-09-30T17:04:42.481 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.481 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.481 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:42.482 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.006692+0000", 2023-09-30T17:04:42.482 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2274000000000005e-05 2023-09-30T17:04:42.482 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.482 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.482 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:42.482 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.006845+0000", 2023-09-30T17:04:42.482 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000152817 2023-09-30T17:04:42.482 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.482 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.483 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:42.483 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.023168+0000", 2023-09-30T17:04:42.483 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.016322962999999999 2023-09-30T17:04:42.483 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.483 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.483 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:42.483 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.082373+0000", 2023-09-30T17:04:42.483 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.059204869 2023-09-30T17:04:42.484 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.484 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.484 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:42.484 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.082429+0000", 2023-09-30T17:04:42.484 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5671000000000003e-05 2023-09-30T17:04:42.484 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.484 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.484 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:42.484 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.082464+0000", 2023-09-30T17:04:42.485 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5911999999999998e-05 2023-09-30T17:04:42.485 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:42.485 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:42.485 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:42.485 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.485 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.485 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165988 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 2596864~4096,write 3084288~4096,write 3141632~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:42.485 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.342979+0000", 2023-09-30T17:04:42.485 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 11.044001237, 2023-09-30T17:04:42.485 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75803858099999999, 2023-09-30T17:04:42.486 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:42.486 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:42.486 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:42.486 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:42.486 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:42.486 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165988 2023-09-30T17:04:42.486 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.486 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:42.486 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.486 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:42.486 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.342979+0000", 2023-09-30T17:04:42.487 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:42.487 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.487 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.487 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:42.487 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.342979+0000", 2023-09-30T17:04:42.487 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:42.487 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.487 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.487 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:42.487 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.342980+0000", 2023-09-30T17:04:42.487 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.018e-06 2023-09-30T17:04:42.488 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.488 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.488 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:42.488 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.342994+0000", 2023-09-30T17:04:42.488 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4819e-05 2023-09-30T17:04:42.488 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.488 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.488 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:42.488 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.343005+0000", 2023-09-30T17:04:42.488 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0552e-05 2023-09-30T17:04:42.489 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.489 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.489 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:42.489 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.343012+0000", 2023-09-30T17:04:42.489 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.888e-06 2023-09-30T17:04:42.489 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.489 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.489 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:42.489 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.018485+0000", 2023-09-30T17:04:42.489 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67547272199999997 2023-09-30T17:04:42.489 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.490 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.490 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:42.490 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.018573+0000", 2023-09-30T17:04:42.490 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8243000000000002e-05 2023-09-30T17:04:42.490 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.490 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.490 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:42.490 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.018779+0000", 2023-09-30T17:04:42.490 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00020640599999999999 2023-09-30T17:04:42.490 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.490 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.491 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:42.491 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.034608+0000", 2023-09-30T17:04:42.491 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.015828519999999999 2023-09-30T17:04:42.491 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.491 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.491 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:42.491 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.100930+0000", 2023-09-30T17:04:42.491 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.066322504000000004 2023-09-30T17:04:42.491 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.491 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.492 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:42.492 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.100981+0000", 2023-09-30T17:04:42.492 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0946000000000003e-05 2023-09-30T17:04:42.492 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.492 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.492 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:42.492 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.101017+0000", 2023-09-30T17:04:42.492 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5963000000000001e-05 2023-09-30T17:04:42.492 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:42.492 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:42.492 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:42.493 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.493 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.493 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165998 4.36 4:6fa85f86:::100000001f8.00000013:head [write 1470464~4096,write 1576960~4096,write 1806336~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:42.493 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.343107+0000", 2023-09-30T17:04:42.493 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 11.043872821000001, 2023-09-30T17:04:42.493 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75779366699999995, 2023-09-30T17:04:42.493 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:42.493 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:42.493 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:42.493 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:42.493 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:42.494 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165998 2023-09-30T17:04:42.494 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.494 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:42.494 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.494 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:42.494 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.343107+0000", 2023-09-30T17:04:42.494 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:42.494 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.494 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.494 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:42.494 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.343107+0000", 2023-09-30T17:04:42.495 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:42.495 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.495 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.495 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:42.495 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.346167+0000", 2023-09-30T17:04:42.495 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.003060349 2023-09-30T17:04:42.495 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.495 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.495 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:42.495 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.346188+0000", 2023-09-30T17:04:42.495 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.0894e-05 2023-09-30T17:04:42.495 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.496 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.496 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:42.496 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.346201+0000", 2023-09-30T17:04:42.496 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2424e-05 2023-09-30T17:04:42.496 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.496 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.496 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:42.496 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.346209+0000", 2023-09-30T17:04:42.496 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1980000000000001e-06 2023-09-30T17:04:42.496 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.496 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.496 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:42.497 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.018506+0000", 2023-09-30T17:04:42.497 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67229752899999995 2023-09-30T17:04:42.497 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.497 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.497 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:42.497 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.018582+0000", 2023-09-30T17:04:42.497 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.538e-05 2023-09-30T17:04:42.497 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.497 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.497 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:42.497 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.018756+0000", 2023-09-30T17:04:42.498 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000174611 2023-09-30T17:04:42.498 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.498 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.498 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:42.498 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.034599+0000", 2023-09-30T17:04:42.498 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.015843166999999998 2023-09-30T17:04:42.498 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.498 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.498 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:42.498 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.100806+0000", 2023-09-30T17:04:42.498 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.066206047000000004 2023-09-30T17:04:42.498 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.499 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.499 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:42.499 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.100863+0000", 2023-09-30T17:04:42.499 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7843999999999997e-05 2023-09-30T17:04:42.499 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.499 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.499 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:42.499 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.100901+0000", 2023-09-30T17:04:42.499 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7224000000000001e-05 2023-09-30T17:04:42.499 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:42.499 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:42.499 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:42.500 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.500 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.500 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:166011 4.6 4:63e80496:::100000001f8.0000001e:head [write 561152~8192,write 663552~4096,write 851968~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:42.500 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.350327+0000", 2023-09-30T17:04:42.500 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 11.036652773, 2023-09-30T17:04:42.500 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75701292499999995, 2023-09-30T17:04:42.500 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:42.500 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:42.500 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:42.500 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:42.500 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:42.501 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 166011 2023-09-30T17:04:42.501 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.501 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:42.501 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.501 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:42.501 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.350327+0000", 2023-09-30T17:04:42.501 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:42.501 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.501 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.501 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:42.501 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.350327+0000", 2023-09-30T17:04:42.501 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:42.502 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.502 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.502 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:42.502 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.350327+0000", 2023-09-30T17:04:42.502 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9799999999999999e-07 2023-09-30T17:04:42.502 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.502 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.502 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:42.502 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.350345+0000", 2023-09-30T17:04:42.502 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7237000000000001e-05 2023-09-30T17:04:42.502 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.503 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.503 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:42.503 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.350351+0000", 2023-09-30T17:04:42.503 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.489e-06 2023-09-30T17:04:42.503 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.503 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.503 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:42.503 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.350357+0000", 2023-09-30T17:04:42.503 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7300000000000002e-06 2023-09-30T17:04:42.503 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.503 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.503 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:42.504 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.026726+0000", 2023-09-30T17:04:42.504 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.676369636 2023-09-30T17:04:42.504 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.504 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.504 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:42.504 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.026803+0000", 2023-09-30T17:04:42.504 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6885999999999995e-05 2023-09-30T17:04:42.504 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.504 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.504 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:42.504 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.026961+0000", 2023-09-30T17:04:42.504 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015803799999999999 2023-09-30T17:04:42.505 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.505 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.505 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:42.505 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.037169+0000", 2023-09-30T17:04:42.505 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010207748000000001 2023-09-30T17:04:42.505 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.505 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.505 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:42.505 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.107238+0000", 2023-09-30T17:04:42.505 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.070069305999999998 2023-09-30T17:04:42.505 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.505 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.506 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:42.506 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.107299+0000", 2023-09-30T17:04:42.506 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0757999999999997e-05 2023-09-30T17:04:42.506 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.506 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.506 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:42.506 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.107340+0000", 2023-09-30T17:04:42.506 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0698999999999998e-05 2023-09-30T17:04:42.506 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:42.506 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:42.506 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:42.506 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.507 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.507 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:166057 4.6 4:63e80496:::100000001f8.0000001e:head [write 3416064~4096,write 3485696~4096,write 3571712~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:42.507 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.366264+0000", 2023-09-30T17:04:42.507 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 11.020715938, 2023-09-30T17:04:42.507 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.76104848700000005, 2023-09-30T17:04:42.507 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:42.507 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:42.507 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:42.507 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:42.507 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:42.507 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 166057 2023-09-30T17:04:42.508 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.508 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:42.508 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.508 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:42.508 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.366264+0000", 2023-09-30T17:04:42.508 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:42.508 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.508 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.508 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:42.508 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.366264+0000", 2023-09-30T17:04:42.508 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:42.508 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.509 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.509 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:42.509 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.366264+0000", 2023-09-30T17:04:42.509 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.03e-07 2023-09-30T17:04:42.509 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.509 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.509 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:42.509 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.366276+0000", 2023-09-30T17:04:42.509 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1712999999999999e-05 2023-09-30T17:04:42.509 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.509 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.509 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:42.510 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.366282+0000", 2023-09-30T17:04:42.510 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3049999999999998e-06 2023-09-30T17:04:42.510 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.510 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.510 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:42.510 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.366287+0000", 2023-09-30T17:04:42.510 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7589999999999997e-06 2023-09-30T17:04:42.510 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.510 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.510 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:42.510 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.042061+0000", 2023-09-30T17:04:42.511 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67577395500000004 2023-09-30T17:04:42.511 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.511 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.511 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:42.511 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.042141+0000", 2023-09-30T17:04:42.511 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9777999999999994e-05 2023-09-30T17:04:42.511 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.511 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.511 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:42.511 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.042323+0000", 2023-09-30T17:04:42.511 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000181783 2023-09-30T17:04:42.511 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.512 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.512 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:42.512 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.072114+0000", 2023-09-30T17:04:42.512 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.029791108 2023-09-30T17:04:42.512 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.512 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.512 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:42.512 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.127224+0000", 2023-09-30T17:04:42.512 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.055110065 2023-09-30T17:04:42.512 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.512 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.512 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:42.513 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.127276+0000", 2023-09-30T17:04:42.513 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2574999999999997e-05 2023-09-30T17:04:42.513 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.513 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.513 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:42.513 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.127312+0000", 2023-09-30T17:04:42.513 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6043e-05 2023-09-30T17:04:42.513 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:42.513 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:42.513 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:42.513 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.513 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.514 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:166062 4.36 4:6fa85f86:::100000001f8.00000013:head [write 1110016~4096,write 1118208~4096,write 1155072~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:42.514 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.370231+0000", 2023-09-30T17:04:42.514 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 11.01674878, 2023-09-30T17:04:42.514 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75721686499999996, 2023-09-30T17:04:42.514 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:42.514 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:42.514 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:42.514 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:42.514 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:42.514 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 166062 2023-09-30T17:04:42.514 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.515 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:42.515 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.515 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:42.515 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.370231+0000", 2023-09-30T17:04:42.515 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:42.515 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.515 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.515 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:42.515 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.370231+0000", 2023-09-30T17:04:42.515 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:42.515 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.515 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.516 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:42.516 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.370232+0000", 2023-09-30T17:04:42.516 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.68e-07 2023-09-30T17:04:42.516 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.516 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.516 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:42.516 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.370247+0000", 2023-09-30T17:04:42.516 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5440000000000001e-05 2023-09-30T17:04:42.516 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.516 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.516 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:42.517 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.370262+0000", 2023-09-30T17:04:42.517 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4976e-05 2023-09-30T17:04:42.517 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.517 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.517 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:42.517 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.370268+0000", 2023-09-30T17:04:42.517 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4930000000000003e-06 2023-09-30T17:04:42.517 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.517 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.517 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:42.517 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.042052+0000", 2023-09-30T17:04:42.517 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67178386199999995 2023-09-30T17:04:42.518 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.518 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.518 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:42.518 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.042140+0000", 2023-09-30T17:04:42.518 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.7874000000000006e-05 2023-09-30T17:04:42.518 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.518 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.518 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:42.518 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.042321+0000", 2023-09-30T17:04:42.518 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00018131500000000001 2023-09-30T17:04:42.518 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.519 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.519 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:42.519 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.054880+0000", 2023-09-30T17:04:42.519 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.012558625 2023-09-30T17:04:42.519 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.519 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.519 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:42.519 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.127361+0000", 2023-09-30T17:04:42.519 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.072481183000000005 2023-09-30T17:04:42.519 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.519 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.521 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:42.521 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.127412+0000", 2023-09-30T17:04:42.521 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0861e-05 2023-09-30T17:04:42.521 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.521 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.521 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:42.521 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.127448+0000", 2023-09-30T17:04:42.521 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5667999999999998e-05 2023-09-30T17:04:42.521 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:42.522 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:42.522 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:42.522 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.522 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.522 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:166063 4.36 4:6da220e6:::100000001f8.0000003f:head [write 2469888~4096,write 2543616~4096,write 2551808~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:42.522 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.370278+0000", 2023-09-30T17:04:42.522 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 11.016701342999999, 2023-09-30T17:04:42.522 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75730261499999996, 2023-09-30T17:04:42.522 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:42.522 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:42.522 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:42.523 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:42.523 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:42.523 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 166063 2023-09-30T17:04:42.523 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.523 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:42.523 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.523 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:42.523 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.370278+0000", 2023-09-30T17:04:42.523 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:42.523 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.523 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.524 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:42.524 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.370278+0000", 2023-09-30T17:04:42.524 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:42.524 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.524 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.524 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:42.524 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.374164+0000", 2023-09-30T17:04:42.524 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0038854319999999999 2023-09-30T17:04:42.524 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.524 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.524 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:42.525 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.374182+0000", 2023-09-30T17:04:42.525 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8363999999999999e-05 2023-09-30T17:04:42.525 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.525 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.525 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:42.525 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.374195+0000", 2023-09-30T17:04:42.525 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2328e-05 2023-09-30T17:04:42.525 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.525 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.525 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:42.525 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.374202+0000", 2023-09-30T17:04:42.525 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4189999999999996e-06 2023-09-30T17:04:42.526 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.526 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.526 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:42.526 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.045487+0000", 2023-09-30T17:04:42.526 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67128463800000004 2023-09-30T17:04:42.526 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.526 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.526 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:42.526 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.045558+0000", 2023-09-30T17:04:42.526 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1408999999999993e-05 2023-09-30T17:04:42.526 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.527 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.527 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:42.527 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.045711+0000", 2023-09-30T17:04:42.527 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015323299999999999 2023-09-30T17:04:42.527 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.527 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.527 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:42.527 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.072119+0000", 2023-09-30T17:04:42.527 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.026407824 2023-09-30T17:04:42.527 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.527 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.527 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:42.528 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.127486+0000", 2023-09-30T17:04:42.528 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.055366591999999999 2023-09-30T17:04:42.528 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.528 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.528 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:42.528 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.127543+0000", 2023-09-30T17:04:42.528 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7685000000000001e-05 2023-09-30T17:04:42.528 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.528 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.528 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:42.528 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.127581+0000", 2023-09-30T17:04:42.528 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7691000000000002e-05 2023-09-30T17:04:42.529 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:42.529 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:42.529 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:42.529 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.529 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.529 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:166072 4.36 4:6da220e6:::100000001f8.0000003f:head [write 1822720~4096,write 2002944~4096,write 2072576~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:42.529 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.376908+0000", 2023-09-30T17:04:42.529 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 11.010071330000001, 2023-09-30T17:04:42.529 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75774445099999999, 2023-09-30T17:04:42.529 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:42.529 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:42.529 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:42.530 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:42.530 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:42.530 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 166072 2023-09-30T17:04:42.530 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.530 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:42.530 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.530 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:42.530 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.376908+0000", 2023-09-30T17:04:42.530 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:42.530 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.530 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.531 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:42.531 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.376908+0000", 2023-09-30T17:04:42.531 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:42.531 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.531 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.531 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:42.531 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.376909+0000", 2023-09-30T17:04:42.531 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3900000000000004e-07 2023-09-30T17:04:42.531 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.532 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.532 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:42.532 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.376927+0000", 2023-09-30T17:04:42.532 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7503000000000002e-05 2023-09-30T17:04:42.532 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.532 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.532 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:42.532 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.376936+0000", 2023-09-30T17:04:42.532 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1209999999999996e-06 2023-09-30T17:04:42.532 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.532 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.533 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:42.533 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.376943+0000", 2023-09-30T17:04:42.533 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0979999999999996e-06 2023-09-30T17:04:42.533 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.533 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.533 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:42.533 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.048561+0000", 2023-09-30T17:04:42.533 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67161849299999998 2023-09-30T17:04:42.533 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.533 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.533 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:42.533 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.048634+0000", 2023-09-30T17:04:42.534 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3085999999999998e-05 2023-09-30T17:04:42.534 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.534 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.534 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:42.534 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.048777+0000", 2023-09-30T17:04:42.534 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000143067 2023-09-30T17:04:42.534 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.534 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.534 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:42.534 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.072125+0000", 2023-09-30T17:04:42.534 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023347178999999999 2023-09-30T17:04:42.535 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.535 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.535 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:42.535 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.134554+0000", 2023-09-30T17:04:42.535 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.062429739999999997 2023-09-30T17:04:42.535 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.535 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.535 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:42.535 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.134605+0000", 2023-09-30T17:04:42.535 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0278000000000002e-05 2023-09-30T17:04:42.535 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.535 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.536 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:42.536 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.134653+0000", 2023-09-30T17:04:42.536 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8247000000000001e-05 2023-09-30T17:04:42.536 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:42.536 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:42.536 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:42.536 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.536 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.536 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:166086 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 1073152~4096,write 1261568~4096,write 1273856~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:42.536 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.387018+0000", 2023-09-30T17:04:42.536 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 10.999961785, 2023-09-30T17:04:42.536 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75505913000000002, 2023-09-30T17:04:42.537 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:42.537 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:42.537 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:42.537 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:42.537 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:42.537 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 166086 2023-09-30T17:04:42.537 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.537 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:42.537 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.537 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:42.537 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.387018+0000", 2023-09-30T17:04:42.538 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:42.538 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.538 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.538 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:42.538 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.387018+0000", 2023-09-30T17:04:42.538 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:42.538 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.538 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.538 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:42.538 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.387018+0000", 2023-09-30T17:04:42.538 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.13e-07 2023-09-30T17:04:42.538 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.539 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.539 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:42.539 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.387033+0000", 2023-09-30T17:04:42.539 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4718999999999999e-05 2023-09-30T17:04:42.539 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.539 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.539 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:42.539 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.387041+0000", 2023-09-30T17:04:42.539 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8779999999999998e-06 2023-09-30T17:04:42.539 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.539 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.539 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:42.540 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.387047+0000", 2023-09-30T17:04:42.540 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9689999999999999e-06 2023-09-30T17:04:42.540 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.540 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.540 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:42.540 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.056572+0000", 2023-09-30T17:04:42.540 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.66952481200000002 2023-09-30T17:04:42.540 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.540 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.540 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:42.540 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.056644+0000", 2023-09-30T17:04:42.541 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1695999999999999e-05 2023-09-30T17:04:42.541 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.541 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.541 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:42.541 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.056746+0000", 2023-09-30T17:04:42.541 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000102864 2023-09-30T17:04:42.541 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.541 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.541 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:42.541 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.085374+0000", 2023-09-30T17:04:42.541 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.028627717 2023-09-30T17:04:42.541 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.542 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.542 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:42.542 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.141996+0000", 2023-09-30T17:04:42.542 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.056622290999999998 2023-09-30T17:04:42.542 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.542 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.542 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:42.542 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.142044+0000", 2023-09-30T17:04:42.542 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7939000000000003e-05 2023-09-30T17:04:42.542 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:42.542 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:42.542 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:42.543 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.142077+0000", 2023-09-30T17:04:42.543 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.2731999999999998e-05 2023-09-30T17:04:42.543 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:42.543 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:42.543 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:42.543 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:42.543 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:42.543 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:04:42.545 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:04:42.545 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:42.544+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:42.645 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:42.644+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:42.678 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:04:42.678 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:04:42.678 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2023-09-30T17:04:42.678 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:04:42.688 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:04:42.728 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-09-30T17:04:42.772 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:42.771+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:42.846 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:42.847+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:42.857 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:04:42.857 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:04:42.857 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2023-09-30T17:04:42.857 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2023-09-30T17:04:42.857 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:04:42.865 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:04:42.893 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:04:42.913 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:04:42.914 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-09-30T17:04:42.914 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-09-30T17:04:42.914 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:04:42.916 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:04:42.917 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:04:42.947 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:42.948+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:43.031 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:43.031 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:43.042 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:04:43.085 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:43.086+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:43.149 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:43.149+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:43.187 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:43.188 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:43.198 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:04:43.250 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:43.250+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:43.351 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:43.351+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:43.370 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:43.371 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:43.381 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:04:43.440 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2023-09-30T17:04:43.465 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:43.466+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:43.553 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:43.553 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:43.553 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:43.553+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:43.563 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:04:43.654 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:43.655+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:43.692 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:43.692 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:43.702 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:04:43.755 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:43.754+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:43.828 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:43.829 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:43.838 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:04:43.857 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:43.857+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:43.957 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:43.958+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:44.005 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:44.005 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:44.015 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:04:44.059 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:44.060+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:44.154 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:44.154 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:44.159 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:44.159+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:44.166 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:04:44.259 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:44.259+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:44.338 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:44.338 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:44.349 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:04:44.360 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:44.360+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:44.440 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is set 2023-09-30T17:04:44.461 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:44.461+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:44.481 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:44.482 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:44.492 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:04:44.562 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:44.562+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:44.620 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:44.620 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:44.630 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:04:44.664 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:44.664+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:44.757 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:44.757 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:44.764 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:44.763+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:44.767 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:04:44.865 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:44.865+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:44.919 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2023-09-30T17:04:44.937 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:44.937 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:44.944 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:04:44.990 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:44.990+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:45.070 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:45.069+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:45.081 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:45.082 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:45.083 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:04:45.092 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:04:45.103 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:04:45.104 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'true' 2023-09-30T17:04:45.104 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'true' 2023-09-30T17:04:45.104 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:04:45.107 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:04:45.107 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:04:45.169 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:45.168+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:45.228 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:04:45.229 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:04:45.229 INFO:teuthology.orchestra.run.smithi031.stdout: "complaint_time": 30, 2023-09-30T17:04:45.229 INFO:teuthology.orchestra.run.smithi031.stdout: "num_blocked_ops": 0 2023-09-30T17:04:45.229 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:04:45.239 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:04:45.288 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:45.288+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:45.370 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:45.370+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:45.377 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:04:45.377 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 20, 2023-09-30T17:04:45.377 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 600, 2023-09-30T17:04:45.377 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:04:45.377 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.377 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165665 4.6 4:63e80496:::100000001f8.0000001e:head [write 1212416~4096,write 1318912~4096,write 1462272~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:45.377 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.209892+0000", 2023-09-30T17:04:45.378 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 14.16550518, 2023-09-30T17:04:45.378 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.76500929900000003, 2023-09-30T17:04:45.378 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:45.378 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:45.378 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:45.378 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:45.378 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:45.378 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165665 2023-09-30T17:04:45.378 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.378 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:45.378 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.379 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:45.379 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.209892+0000", 2023-09-30T17:04:45.379 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:45.379 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.379 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.379 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:45.379 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.209892+0000", 2023-09-30T17:04:45.379 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:45.379 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.380 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.380 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:45.380 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.209893+0000", 2023-09-30T17:04:45.380 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5099999999999999e-07 2023-09-30T17:04:45.380 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.381 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.381 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:45.381 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.209908+0000", 2023-09-30T17:04:45.381 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4754e-05 2023-09-30T17:04:45.381 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.382 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.382 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:45.382 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.209916+0000", 2023-09-30T17:04:45.382 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.7940000000000008e-06 2023-09-30T17:04:45.383 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.383 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.383 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:45.384 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.209923+0000", 2023-09-30T17:04:45.384 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5429999999999999e-06 2023-09-30T17:04:45.384 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.384 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.385 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:45.385 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.899390+0000", 2023-09-30T17:04:45.385 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.689467371 2023-09-30T17:04:45.385 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.385 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.386 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:45.386 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.899462+0000", 2023-09-30T17:04:45.386 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1273999999999996e-05 2023-09-30T17:04:45.386 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.386 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.387 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:45.387 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.899610+0000", 2023-09-30T17:04:45.387 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014818599999999999 2023-09-30T17:04:45.387 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.387 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.388 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:45.388 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.919587+0000", 2023-09-30T17:04:45.388 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.019977042 2023-09-30T17:04:45.388 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.388 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.388 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:45.388 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.974802+0000", 2023-09-30T17:04:45.388 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.055214764 2023-09-30T17:04:45.388 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.388 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.389 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:45.389 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.974863+0000", 2023-09-30T17:04:45.389 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1377000000000005e-05 2023-09-30T17:04:45.389 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.389 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.389 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:45.389 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.974901+0000", 2023-09-30T17:04:45.389 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8543e-05 2023-09-30T17:04:45.389 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:45.389 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:45.389 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:45.390 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.390 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.390 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165673 4.6 4:63e80496:::100000001f8.0000001e:head [write 516096~4096,write 524288~4096,write 532480~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:45.390 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.210099+0000", 2023-09-30T17:04:45.390 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 14.165298309000001, 2023-09-30T17:04:45.390 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.76494798200000003, 2023-09-30T17:04:45.390 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:45.390 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:45.390 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:45.391 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:45.391 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:45.391 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165673 2023-09-30T17:04:45.391 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.391 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:45.391 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.391 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:45.391 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.210099+0000", 2023-09-30T17:04:45.392 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:45.392 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.392 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.392 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:45.392 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.210099+0000", 2023-09-30T17:04:45.392 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:45.392 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.393 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.393 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:45.393 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.210100+0000", 2023-09-30T17:04:45.393 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0699999999999997e-07 2023-09-30T17:04:45.393 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.393 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.393 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:45.393 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.210117+0000", 2023-09-30T17:04:45.393 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7501000000000001e-05 2023-09-30T17:04:45.393 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.393 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.393 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:45.394 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.210126+0000", 2023-09-30T17:04:45.394 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2629999999999992e-06 2023-09-30T17:04:45.394 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.394 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.394 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:45.394 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.210133+0000", 2023-09-30T17:04:45.394 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8079999999999999e-06 2023-09-30T17:04:45.394 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.394 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.394 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:45.395 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.902650+0000", 2023-09-30T17:04:45.395 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.69251684800000002 2023-09-30T17:04:45.395 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.395 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.395 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:45.395 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.902724+0000", 2023-09-30T17:04:45.395 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4376999999999996e-05 2023-09-30T17:04:45.395 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.395 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.395 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:45.395 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.902881+0000", 2023-09-30T17:04:45.396 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000156269 2023-09-30T17:04:45.396 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.396 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.396 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:45.396 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.925614+0000", 2023-09-30T17:04:45.396 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.022732937000000002 2023-09-30T17:04:45.396 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.396 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.396 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:45.396 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.974955+0000", 2023-09-30T17:04:45.396 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.04934115 2023-09-30T17:04:45.396 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.397 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.397 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:45.397 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.975012+0000", 2023-09-30T17:04:45.397 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6949e-05 2023-09-30T17:04:45.397 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.397 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.397 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:45.397 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.975047+0000", 2023-09-30T17:04:45.397 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5373000000000002e-05 2023-09-30T17:04:45.397 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:45.397 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:45.398 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:45.399 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.399 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.399 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165689 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 188416~4096,write 229376~4096,write 299008~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:45.399 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.217300+0000", 2023-09-30T17:04:45.399 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 14.158097735, 2023-09-30T17:04:45.399 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75814632500000001, 2023-09-30T17:04:45.399 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:45.399 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:45.399 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:45.399 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:45.400 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:45.400 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165689 2023-09-30T17:04:45.400 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.400 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:45.400 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.400 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:45.400 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.217300+0000", 2023-09-30T17:04:45.400 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:45.400 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.400 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.400 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:45.401 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.217300+0000", 2023-09-30T17:04:45.401 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:45.401 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.401 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.401 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:45.401 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.217300+0000", 2023-09-30T17:04:45.401 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3000000000000001e-07 2023-09-30T17:04:45.401 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.401 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.401 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:45.402 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.217314+0000", 2023-09-30T17:04:45.402 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3901e-05 2023-09-30T17:04:45.402 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.402 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.402 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:45.402 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.217321+0000", 2023-09-30T17:04:45.402 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5869999999999998e-06 2023-09-30T17:04:45.402 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.402 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.402 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:45.402 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.217326+0000", 2023-09-30T17:04:45.403 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7740000000000001e-06 2023-09-30T17:04:45.403 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.403 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.403 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:45.403 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.907842+0000", 2023-09-30T17:04:45.403 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.69051533600000004 2023-09-30T17:04:45.403 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.403 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.403 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:45.403 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.907927+0000", 2023-09-30T17:04:45.403 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5619999999999997e-05 2023-09-30T17:04:45.404 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.404 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.404 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:45.404 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.908097+0000", 2023-09-30T17:04:45.404 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016991400000000001 2023-09-30T17:04:45.404 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.404 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.404 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:45.404 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.925623+0000", 2023-09-30T17:04:45.404 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.017525888999999999 2023-09-30T17:04:45.405 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.405 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.405 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:45.405 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.975110+0000", 2023-09-30T17:04:45.406 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.049486789000000003 2023-09-30T17:04:45.406 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.406 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.406 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:45.406 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.975170+0000", 2023-09-30T17:04:45.406 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9960000000000002e-05 2023-09-30T17:04:45.406 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.406 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.406 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:45.406 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.975446+0000", 2023-09-30T17:04:45.406 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000276125 2023-09-30T17:04:45.407 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:45.407 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:45.407 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:45.407 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.407 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.407 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165875 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 458752~4096,write 1454080~4096,write 1634304~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:45.407 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.295916+0000", 2023-09-30T17:04:45.407 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 14.079481084999999, 2023-09-30T17:04:45.407 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.76379055500000004, 2023-09-30T17:04:45.407 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:45.407 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:45.407 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:45.408 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:45.408 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:45.408 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165875 2023-09-30T17:04:45.408 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.408 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:45.408 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.408 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:45.408 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.295916+0000", 2023-09-30T17:04:45.408 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:45.408 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.408 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.409 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:45.409 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.295916+0000", 2023-09-30T17:04:45.409 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:45.409 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.409 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.409 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:45.409 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.295917+0000", 2023-09-30T17:04:45.409 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9500000000000002e-07 2023-09-30T17:04:45.409 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.409 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.409 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:45.409 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.295932+0000", 2023-09-30T17:04:45.410 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4803999999999999e-05 2023-09-30T17:04:45.410 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.410 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.410 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:45.410 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.295941+0000", 2023-09-30T17:04:45.410 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.448e-06 2023-09-30T17:04:45.410 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.410 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.410 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:45.410 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.295948+0000", 2023-09-30T17:04:45.411 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9199999999999998e-06 2023-09-30T17:04:45.411 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.411 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.411 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:45.411 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.971359+0000", 2023-09-30T17:04:45.411 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67541110500000001 2023-09-30T17:04:45.411 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.411 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.411 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:45.411 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.971433+0000", 2023-09-30T17:04:45.411 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3388999999999998e-05 2023-09-30T17:04:45.411 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.412 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.412 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:45.412 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.971583+0000", 2023-09-30T17:04:45.412 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015035999999999999 2023-09-30T17:04:45.412 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.412 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.412 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:45.412 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.982409+0000", 2023-09-30T17:04:45.412 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010826242999999999 2023-09-30T17:04:45.412 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.413 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.413 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:45.413 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.059610+0000", 2023-09-30T17:04:45.414 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.077201160000000005 2023-09-30T17:04:45.414 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.414 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.414 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:45.414 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.059669+0000", 2023-09-30T17:04:45.414 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8965999999999998e-05 2023-09-30T17:04:45.414 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.414 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.414 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:45.414 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.059707+0000", 2023-09-30T17:04:45.415 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7564999999999997e-05 2023-09-30T17:04:45.415 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:45.415 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:45.415 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:45.415 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.415 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.415 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165878 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 2277376~4096,write 2371584~4096,write 4050944~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:45.415 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.299610+0000", 2023-09-30T17:04:45.415 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 14.075787006000001, 2023-09-30T17:04:45.415 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75525803300000005, 2023-09-30T17:04:45.415 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:45.416 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:45.416 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:45.416 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:45.416 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:45.416 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165878 2023-09-30T17:04:45.416 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.416 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:45.416 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.416 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:45.416 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299610+0000", 2023-09-30T17:04:45.416 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:45.416 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.417 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.417 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:45.417 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299610+0000", 2023-09-30T17:04:45.417 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:45.417 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.417 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.417 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:45.417 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299611+0000", 2023-09-30T17:04:45.417 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7299999999999996e-07 2023-09-30T17:04:45.417 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.417 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.418 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:45.418 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299623+0000", 2023-09-30T17:04:45.418 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2513e-05 2023-09-30T17:04:45.418 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.418 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.418 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:45.418 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299630+0000", 2023-09-30T17:04:45.418 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0090000000000001e-06 2023-09-30T17:04:45.418 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.418 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.418 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:45.418 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299638+0000", 2023-09-30T17:04:45.419 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1210000000000001e-06 2023-09-30T17:04:45.419 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.419 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.419 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:45.419 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.971347+0000", 2023-09-30T17:04:45.419 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67170925699999995 2023-09-30T17:04:45.419 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.419 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.419 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:45.419 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.971419+0000", 2023-09-30T17:04:45.419 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2495000000000003e-05 2023-09-30T17:04:45.420 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.420 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.420 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:45.420 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.971567+0000", 2023-09-30T17:04:45.420 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014805499999999999 2023-09-30T17:04:45.420 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.420 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.420 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:45.420 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.982312+0000", 2023-09-30T17:04:45.420 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010744584 2023-09-30T17:04:45.420 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.420 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.421 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:45.421 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.054770+0000", 2023-09-30T17:04:45.421 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.072457683999999994 2023-09-30T17:04:45.421 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.421 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.421 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:45.421 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.054825+0000", 2023-09-30T17:04:45.421 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5210000000000002e-05 2023-09-30T17:04:45.421 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.421 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.421 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:45.422 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.054868+0000", 2023-09-30T17:04:45.422 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3532000000000003e-05 2023-09-30T17:04:45.422 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:45.422 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:45.422 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:45.422 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.422 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.422 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165890 4.36 4:6da220e6:::100000001f8.0000003f:head [write 3395584~4096,write 3436544~4096,write 3444736~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:45.422 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.299835+0000", 2023-09-30T17:04:45.422 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 14.075562323, 2023-09-30T17:04:45.423 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.76012937700000005, 2023-09-30T17:04:45.423 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:45.423 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:45.423 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:45.423 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:45.423 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:45.423 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165890 2023-09-30T17:04:45.423 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.423 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:45.423 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.423 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:45.424 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299835+0000", 2023-09-30T17:04:45.424 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:45.424 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.424 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.424 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:45.424 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299835+0000", 2023-09-30T17:04:45.424 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:45.424 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.424 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.424 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:45.424 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299835+0000", 2023-09-30T17:04:45.425 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5699999999999998e-07 2023-09-30T17:04:45.425 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.425 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.425 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:45.425 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299905+0000", 2023-09-30T17:04:45.425 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9908999999999998e-05 2023-09-30T17:04:45.425 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.425 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.425 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:45.425 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299914+0000", 2023-09-30T17:04:45.426 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9630000000000004e-06 2023-09-30T17:04:45.426 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.426 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.426 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:45.426 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299921+0000", 2023-09-30T17:04:45.426 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8079999999999999e-06 2023-09-30T17:04:45.426 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.426 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.426 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:45.426 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.975617+0000", 2023-09-30T17:04:45.426 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67569579099999999 2023-09-30T17:04:45.427 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.427 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.427 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:45.427 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.975700+0000", 2023-09-30T17:04:45.427 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3462999999999997e-05 2023-09-30T17:04:45.427 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.427 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.427 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:45.427 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.975871+0000", 2023-09-30T17:04:45.427 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017027399999999999 2023-09-30T17:04:45.428 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.428 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.428 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:45.428 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.001290+0000", 2023-09-30T17:04:45.428 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.025419576999999999 2023-09-30T17:04:45.428 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.428 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.428 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:45.428 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.059876+0000", 2023-09-30T17:04:45.428 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.058585849000000002 2023-09-30T17:04:45.428 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.429 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.429 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:45.429 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.059929+0000", 2023-09-30T17:04:45.429 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3053000000000002e-05 2023-09-30T17:04:45.429 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.429 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.429 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:45.429 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.059964+0000", 2023-09-30T17:04:45.429 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5233e-05 2023-09-30T17:04:45.429 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:45.430 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:45.430 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:45.430 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.430 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.430 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165893 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 2748416~4096,write 2764800~4096,write 3031040~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:45.430 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.299965+0000", 2023-09-30T17:04:45.430 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 14.075432047, 2023-09-30T17:04:45.430 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75987149300000001, 2023-09-30T17:04:45.430 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:45.430 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:45.431 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:45.431 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:45.431 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:45.431 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165893 2023-09-30T17:04:45.431 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.431 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:45.431 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.431 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:45.431 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299965+0000", 2023-09-30T17:04:45.431 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:45.431 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.432 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.432 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:45.432 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299965+0000", 2023-09-30T17:04:45.432 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:45.432 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.432 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.432 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:45.432 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.301184+0000", 2023-09-30T17:04:45.432 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0012189779999999999 2023-09-30T17:04:45.432 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.433 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.433 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:45.433 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.301199+0000", 2023-09-30T17:04:45.433 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4626e-05 2023-09-30T17:04:45.433 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.433 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.433 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:45.433 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.301209+0000", 2023-09-30T17:04:45.433 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.042e-05 2023-09-30T17:04:45.433 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.434 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.434 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:45.434 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.301217+0000", 2023-09-30T17:04:45.434 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4000000000000003e-06 2023-09-30T17:04:45.434 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.434 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.434 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:45.434 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.975800+0000", 2023-09-30T17:04:45.434 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67458368700000004 2023-09-30T17:04:45.434 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.435 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.435 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:45.435 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.975886+0000", 2023-09-30T17:04:45.435 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5722000000000004e-05 2023-09-30T17:04:45.435 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.435 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.435 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:45.435 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.976065+0000", 2023-09-30T17:04:45.435 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000178705 2023-09-30T17:04:45.435 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.435 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.436 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:45.436 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.998244+0000", 2023-09-30T17:04:45.436 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.022178788000000001 2023-09-30T17:04:45.436 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.436 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.436 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:45.436 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.059746+0000", 2023-09-30T17:04:45.436 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.061501950999999999 2023-09-30T17:04:45.436 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.436 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.437 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:45.437 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.059802+0000", 2023-09-30T17:04:45.437 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6128000000000002e-05 2023-09-30T17:04:45.437 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.437 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.437 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:45.437 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.059837+0000", 2023-09-30T17:04:45.437 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5088e-05 2023-09-30T17:04:45.437 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:45.437 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:45.438 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:45.438 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.438 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.438 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165908 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 2269184~4096,write 4112384~4096,write 4136960~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:45.438 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.309255+0000", 2023-09-30T17:04:45.438 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 14.066142277999999, 2023-09-30T17:04:45.438 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.76105314999999996, 2023-09-30T17:04:45.438 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:45.439 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:45.439 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:45.439 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:45.439 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:45.439 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165908 2023-09-30T17:04:45.439 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.439 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:45.439 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.439 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:45.439 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.309255+0000", 2023-09-30T17:04:45.440 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:45.440 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.440 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.440 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:45.440 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.309255+0000", 2023-09-30T17:04:45.440 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:45.440 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.440 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.440 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:45.441 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.311162+0000", 2023-09-30T17:04:45.441 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001906886 2023-09-30T17:04:45.441 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.441 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.441 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:45.441 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.311177+0000", 2023-09-30T17:04:45.441 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5193e-05 2023-09-30T17:04:45.441 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.441 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.442 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:45.442 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.311188+0000", 2023-09-30T17:04:45.442 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0805000000000001e-05 2023-09-30T17:04:45.442 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.442 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.442 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:45.442 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.311196+0000", 2023-09-30T17:04:45.442 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.627e-06 2023-09-30T17:04:45.442 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.442 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.443 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:45.443 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.982808+0000", 2023-09-30T17:04:45.443 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67161246100000005 2023-09-30T17:04:45.443 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.443 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.443 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:45.443 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.982872+0000", 2023-09-30T17:04:45.444 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3646999999999996e-05 2023-09-30T17:04:45.444 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.444 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.444 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:45.444 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.983017+0000", 2023-09-30T17:04:45.444 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000144964 2023-09-30T17:04:45.444 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.444 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.444 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:45.444 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.010841+0000", 2023-09-30T17:04:45.445 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.027824637999999999 2023-09-30T17:04:45.445 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.445 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.445 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:45.445 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.070218+0000", 2023-09-30T17:04:45.445 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.059376421999999998 2023-09-30T17:04:45.445 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.445 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.445 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:45.445 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.070272+0000", 2023-09-30T17:04:45.446 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4407000000000003e-05 2023-09-30T17:04:45.446 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.446 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.446 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:45.446 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.070308+0000", 2023-09-30T17:04:45.446 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6100000000000003e-05 2023-09-30T17:04:45.446 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:45.446 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:45.446 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:45.446 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.447 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.447 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165910 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 1191936~4096,write 1277952~4096,write 1613824~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:45.447 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.311262+0000", 2023-09-30T17:04:45.447 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 14.064135709, 2023-09-30T17:04:45.447 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75916103300000004, 2023-09-30T17:04:45.447 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:45.447 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:45.447 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:45.447 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:45.447 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:45.448 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165910 2023-09-30T17:04:45.448 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.448 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:45.448 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.448 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:45.448 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.311262+0000", 2023-09-30T17:04:45.448 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:45.448 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.448 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.448 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:45.448 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.311262+0000", 2023-09-30T17:04:45.449 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:45.449 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.449 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.449 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:45.449 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.313172+0000", 2023-09-30T17:04:45.449 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001910847 2023-09-30T17:04:45.449 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.449 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.449 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:45.449 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.313191+0000", 2023-09-30T17:04:45.450 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8416000000000001e-05 2023-09-30T17:04:45.450 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.450 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.450 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:45.450 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.313204+0000", 2023-09-30T17:04:45.450 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.271e-05 2023-09-30T17:04:45.450 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.450 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.450 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:45.451 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.313211+0000", 2023-09-30T17:04:45.451 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3529999999999997e-06 2023-09-30T17:04:45.451 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.451 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.451 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:45.451 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.990896+0000", 2023-09-30T17:04:45.451 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67768552500000001 2023-09-30T17:04:45.451 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.451 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.451 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:45.451 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.990972+0000", 2023-09-30T17:04:45.451 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5658e-05 2023-09-30T17:04:45.452 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.452 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.452 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:45.452 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.991072+0000", 2023-09-30T17:04:45.452 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.9636000000000006e-05 2023-09-30T17:04:45.452 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.452 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.452 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:45.452 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.010847+0000", 2023-09-30T17:04:45.452 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.019774908000000001 2023-09-30T17:04:45.452 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.453 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.453 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:45.453 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.070345+0000", 2023-09-30T17:04:45.453 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.059497983999999997 2023-09-30T17:04:45.453 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.453 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.453 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:45.453 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.070392+0000", 2023-09-30T17:04:45.453 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6851999999999998e-05 2023-09-30T17:04:45.453 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.453 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.454 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:45.454 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.070423+0000", 2023-09-30T17:04:45.454 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.1143999999999999e-05 2023-09-30T17:04:45.454 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:45.454 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:45.454 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:45.454 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.454 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.454 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165918 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 2666496~4096,write 2760704~4096,write 3031040~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:45.454 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.315883+0000", 2023-09-30T17:04:45.454 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 14.059513881999999, 2023-09-30T17:04:45.455 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75903742100000005, 2023-09-30T17:04:45.455 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:45.455 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:45.455 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:45.455 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:45.455 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:45.455 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165918 2023-09-30T17:04:45.455 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.455 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:45.455 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.455 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:45.455 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315883+0000", 2023-09-30T17:04:45.456 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:45.456 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.456 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.456 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:45.456 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315883+0000", 2023-09-30T17:04:45.456 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:45.456 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.456 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.456 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:45.456 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315884+0000", 2023-09-30T17:04:45.456 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8199999999999999e-07 2023-09-30T17:04:45.457 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.457 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.457 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:45.457 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315903+0000", 2023-09-30T17:04:45.457 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9089e-05 2023-09-30T17:04:45.457 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.457 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.457 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:45.457 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315916+0000", 2023-09-30T17:04:45.457 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2636999999999999e-05 2023-09-30T17:04:45.458 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.458 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.458 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:45.458 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315923+0000", 2023-09-30T17:04:45.458 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2259999999999999e-06 2023-09-30T17:04:45.458 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.458 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.458 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:45.458 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.993661+0000", 2023-09-30T17:04:45.458 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67773771500000002 2023-09-30T17:04:45.458 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.459 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.459 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:45.459 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.993749+0000", 2023-09-30T17:04:45.459 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.7721999999999998e-05 2023-09-30T17:04:45.459 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.459 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.459 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:45.459 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.996215+0000", 2023-09-30T17:04:45.459 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0024667360000000002 2023-09-30T17:04:45.459 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.459 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.460 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:45.460 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.010996+0000", 2023-09-30T17:04:45.460 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.014780873 2023-09-30T17:04:45.460 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.460 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.460 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:45.460 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.074853+0000", 2023-09-30T17:04:45.460 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.063857133999999996 2023-09-30T17:04:45.460 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.460 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.461 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:45.461 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.074888+0000", 2023-09-30T17:04:45.461 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5067000000000002e-05 2023-09-30T17:04:45.461 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.461 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.461 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:45.461 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.074921+0000", 2023-09-30T17:04:45.461 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.2539999999999997e-05 2023-09-30T17:04:45.461 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:45.461 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:45.461 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:45.462 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.462 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.462 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165921 4.6 4:63e80496:::100000001f8.0000001e:head [write 679936~4096,write 1089536~4096,write 1138688~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:45.462 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.315973+0000", 2023-09-30T17:04:45.462 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 14.059423947000001, 2023-09-30T17:04:45.462 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75610897399999999, 2023-09-30T17:04:45.462 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:45.462 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:45.462 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:45.462 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:45.463 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:45.463 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165921 2023-09-30T17:04:45.463 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.463 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:45.463 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.463 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:45.463 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315973+0000", 2023-09-30T17:04:45.463 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:45.463 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.463 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.463 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:45.463 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315973+0000", 2023-09-30T17:04:45.464 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:45.464 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.464 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.464 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:45.464 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315974+0000", 2023-09-30T17:04:45.464 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1100000000000001e-07 2023-09-30T17:04:45.464 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.464 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.464 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:45.464 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315986+0000", 2023-09-30T17:04:45.464 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2673e-05 2023-09-30T17:04:45.465 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.465 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.465 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:45.465 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315995+0000", 2023-09-30T17:04:45.465 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1689999999999992e-06 2023-09-30T17:04:45.465 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.465 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.465 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:45.465 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.316000+0000", 2023-09-30T17:04:45.465 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9849999999999997e-06 2023-09-30T17:04:45.465 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.465 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.466 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:45.466 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.994495+0000", 2023-09-30T17:04:45.466 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67849566800000005 2023-09-30T17:04:45.466 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.466 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.466 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:45.466 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.994579+0000", 2023-09-30T17:04:45.466 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4089000000000001e-05 2023-09-30T17:04:45.466 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.466 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.466 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:45.467 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.994744+0000", 2023-09-30T17:04:45.467 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000164327 2023-09-30T17:04:45.467 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.467 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.467 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:45.467 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.010988+0000", 2023-09-30T17:04:45.467 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.016244705000000002 2023-09-30T17:04:45.467 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.467 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.467 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:45.467 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.071979+0000", 2023-09-30T17:04:45.467 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.060990111 2023-09-30T17:04:45.468 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.468 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.468 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:45.468 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.072035+0000", 2023-09-30T17:04:45.468 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6320000000000003e-05 2023-09-30T17:04:45.468 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.468 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.468 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:45.468 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.072082+0000", 2023-09-30T17:04:45.468 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7515999999999997e-05 2023-09-30T17:04:45.468 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:45.469 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:45.469 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:45.469 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.469 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.469 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165949 4.6 4:616d4c41:::100000001f8.00000034:head [write 409600~4096,write 618496~4096,write 659456~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:45.469 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.326340+0000", 2023-09-30T17:04:45.469 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 14.049057833000001, 2023-09-30T17:04:45.469 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75612495899999999, 2023-09-30T17:04:45.469 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:45.469 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:45.469 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:45.469 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:45.470 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:45.470 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165949 2023-09-30T17:04:45.470 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.470 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:45.470 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.470 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:45.470 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.326340+0000", 2023-09-30T17:04:45.470 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:45.470 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.470 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.470 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:45.471 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.326340+0000", 2023-09-30T17:04:45.471 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:45.471 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.471 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.471 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:45.471 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.326340+0000", 2023-09-30T17:04:45.471 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0200000000000002e-07 2023-09-30T17:04:45.471 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.471 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.471 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:45.471 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.326352+0000", 2023-09-30T17:04:45.471 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1715e-05 2023-09-30T17:04:45.472 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.472 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.472 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:45.472 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.326358+0000", 2023-09-30T17:04:45.472 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3679999999999998e-06 2023-09-30T17:04:45.472 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.472 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.472 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:45.472 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.326363+0000", 2023-09-30T17:04:45.472 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9629999999999997e-06 2023-09-30T17:04:45.472 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.473 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.473 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:45.473 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.006610+0000", 2023-09-30T17:04:45.473 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.68024690499999996 2023-09-30T17:04:45.473 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.473 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.473 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:45.473 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.006692+0000", 2023-09-30T17:04:45.473 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2274000000000005e-05 2023-09-30T17:04:45.473 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.473 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.474 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:45.474 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.006845+0000", 2023-09-30T17:04:45.474 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000152817 2023-09-30T17:04:45.474 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.474 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.474 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:45.474 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.023168+0000", 2023-09-30T17:04:45.474 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.016322962999999999 2023-09-30T17:04:45.474 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.474 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.474 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:45.474 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.082373+0000", 2023-09-30T17:04:45.475 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.059204869 2023-09-30T17:04:45.475 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.475 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.475 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:45.475 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.082429+0000", 2023-09-30T17:04:45.475 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5671000000000003e-05 2023-09-30T17:04:45.475 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.475 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.475 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:45.475 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.082464+0000", 2023-09-30T17:04:45.475 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5911999999999998e-05 2023-09-30T17:04:45.476 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:45.476 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:45.476 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:45.476 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.476 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.476 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165988 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 2596864~4096,write 3084288~4096,write 3141632~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:45.476 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.342979+0000", 2023-09-30T17:04:45.476 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 14.032418841, 2023-09-30T17:04:45.476 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75803858099999999, 2023-09-30T17:04:45.476 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:45.476 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:45.477 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:45.477 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:45.477 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:45.477 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165988 2023-09-30T17:04:45.477 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.477 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:45.477 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.477 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:45.477 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.342979+0000", 2023-09-30T17:04:45.477 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:45.477 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.477 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.478 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:45.478 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.342979+0000", 2023-09-30T17:04:45.478 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:45.478 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.478 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.478 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:45.478 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.342980+0000", 2023-09-30T17:04:45.478 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.018e-06 2023-09-30T17:04:45.478 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.478 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.478 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:45.479 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.342994+0000", 2023-09-30T17:04:45.479 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4819e-05 2023-09-30T17:04:45.479 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.479 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.479 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:45.479 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.343005+0000", 2023-09-30T17:04:45.479 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0552e-05 2023-09-30T17:04:45.479 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.479 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.479 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:45.479 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.343012+0000", 2023-09-30T17:04:45.479 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.888e-06 2023-09-30T17:04:45.480 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.480 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.480 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:45.480 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.018485+0000", 2023-09-30T17:04:45.480 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67547272199999997 2023-09-30T17:04:45.480 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.480 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.480 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:45.480 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.018573+0000", 2023-09-30T17:04:45.480 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8243000000000002e-05 2023-09-30T17:04:45.480 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.481 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.481 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:45.481 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.018779+0000", 2023-09-30T17:04:45.481 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00020640599999999999 2023-09-30T17:04:45.481 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.481 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.481 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:45.481 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.034608+0000", 2023-09-30T17:04:45.481 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.015828519999999999 2023-09-30T17:04:45.481 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.481 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.482 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:45.482 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.100930+0000", 2023-09-30T17:04:45.482 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.066322504000000004 2023-09-30T17:04:45.482 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.482 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.482 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:45.482 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.100981+0000", 2023-09-30T17:04:45.482 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0946000000000003e-05 2023-09-30T17:04:45.482 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.482 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.483 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:45.483 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.101017+0000", 2023-09-30T17:04:45.483 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5963000000000001e-05 2023-09-30T17:04:45.483 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:45.483 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:45.483 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:45.483 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.483 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.483 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165998 4.36 4:6fa85f86:::100000001f8.00000013:head [write 1470464~4096,write 1576960~4096,write 1806336~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:45.483 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.343107+0000", 2023-09-30T17:04:45.484 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 14.032290424999999, 2023-09-30T17:04:45.484 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75779366699999995, 2023-09-30T17:04:45.484 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:45.484 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:45.484 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:45.484 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:45.484 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:45.484 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165998 2023-09-30T17:04:45.484 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.484 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:45.485 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.485 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:45.485 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.343107+0000", 2023-09-30T17:04:45.485 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:45.485 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.485 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.485 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:45.485 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.343107+0000", 2023-09-30T17:04:45.485 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:45.485 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.486 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.486 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:45.486 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.346167+0000", 2023-09-30T17:04:45.486 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.003060349 2023-09-30T17:04:45.486 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.486 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.486 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:45.486 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.346188+0000", 2023-09-30T17:04:45.486 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.0894e-05 2023-09-30T17:04:45.486 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.487 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.487 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:45.487 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.346201+0000", 2023-09-30T17:04:45.487 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2424e-05 2023-09-30T17:04:45.487 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.487 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.487 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:45.487 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.346209+0000", 2023-09-30T17:04:45.487 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1980000000000001e-06 2023-09-30T17:04:45.487 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.487 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.487 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:45.488 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.018506+0000", 2023-09-30T17:04:45.488 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67229752899999995 2023-09-30T17:04:45.488 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.488 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.488 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:45.488 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.018582+0000", 2023-09-30T17:04:45.488 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.538e-05 2023-09-30T17:04:45.488 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.488 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.488 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:45.488 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.018756+0000", 2023-09-30T17:04:45.489 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000174611 2023-09-30T17:04:45.489 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.489 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.489 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:45.489 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.034599+0000", 2023-09-30T17:04:45.489 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.015843166999999998 2023-09-30T17:04:45.489 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.489 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.489 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:45.489 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.100806+0000", 2023-09-30T17:04:45.489 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.066206047000000004 2023-09-30T17:04:45.489 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.490 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.490 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:45.490 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.100863+0000", 2023-09-30T17:04:45.490 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7843999999999997e-05 2023-09-30T17:04:45.490 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.490 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.490 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:45.490 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.100901+0000", 2023-09-30T17:04:45.490 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7224000000000001e-05 2023-09-30T17:04:45.490 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:45.490 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:45.491 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:45.491 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.491 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.491 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:166011 4.6 4:63e80496:::100000001f8.0000001e:head [write 561152~8192,write 663552~4096,write 851968~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:45.491 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.350327+0000", 2023-09-30T17:04:45.491 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 14.025070377, 2023-09-30T17:04:45.491 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75701292499999995, 2023-09-30T17:04:45.491 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:45.491 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:45.491 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:45.491 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:45.492 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:45.492 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 166011 2023-09-30T17:04:45.492 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.492 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:45.492 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.492 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:45.492 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.350327+0000", 2023-09-30T17:04:45.492 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:45.492 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.492 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.492 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:45.493 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.350327+0000", 2023-09-30T17:04:45.493 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:45.493 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.493 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.493 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:45.493 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.350327+0000", 2023-09-30T17:04:45.493 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9799999999999999e-07 2023-09-30T17:04:45.493 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.493 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.493 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:45.493 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.350345+0000", 2023-09-30T17:04:45.493 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7237000000000001e-05 2023-09-30T17:04:45.494 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.494 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.494 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:45.494 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.350351+0000", 2023-09-30T17:04:45.494 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.489e-06 2023-09-30T17:04:45.494 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.494 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.494 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:45.494 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.350357+0000", 2023-09-30T17:04:45.494 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7300000000000002e-06 2023-09-30T17:04:45.495 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.495 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.495 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:45.495 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.026726+0000", 2023-09-30T17:04:45.495 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.676369636 2023-09-30T17:04:45.495 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.495 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.495 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:45.495 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.026803+0000", 2023-09-30T17:04:45.495 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6885999999999995e-05 2023-09-30T17:04:45.495 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.495 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.496 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:45.496 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.026961+0000", 2023-09-30T17:04:45.496 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015803799999999999 2023-09-30T17:04:45.496 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.496 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.496 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:45.496 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.037169+0000", 2023-09-30T17:04:45.496 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010207748000000001 2023-09-30T17:04:45.496 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.496 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.496 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:45.497 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.107238+0000", 2023-09-30T17:04:45.497 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.070069305999999998 2023-09-30T17:04:45.497 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.497 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.497 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:45.497 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.107299+0000", 2023-09-30T17:04:45.497 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0757999999999997e-05 2023-09-30T17:04:45.497 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.497 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.497 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:45.497 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.107340+0000", 2023-09-30T17:04:45.498 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0698999999999998e-05 2023-09-30T17:04:45.498 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:45.498 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:45.498 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:45.498 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.498 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.498 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:166057 4.6 4:63e80496:::100000001f8.0000001e:head [write 3416064~4096,write 3485696~4096,write 3571712~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:45.498 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.366264+0000", 2023-09-30T17:04:45.498 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 14.009133542000001, 2023-09-30T17:04:45.498 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.76104848700000005, 2023-09-30T17:04:45.498 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:45.499 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:45.499 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:45.499 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:45.499 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:45.499 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 166057 2023-09-30T17:04:45.499 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.499 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:45.499 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.499 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:45.499 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.366264+0000", 2023-09-30T17:04:45.499 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:45.499 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.500 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.500 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:45.500 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.366264+0000", 2023-09-30T17:04:45.500 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:45.500 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.500 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.500 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:45.500 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.366264+0000", 2023-09-30T17:04:45.500 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.03e-07 2023-09-30T17:04:45.500 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.500 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.501 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:45.501 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.366276+0000", 2023-09-30T17:04:45.501 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1712999999999999e-05 2023-09-30T17:04:45.501 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.501 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.501 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:45.501 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.366282+0000", 2023-09-30T17:04:45.501 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3049999999999998e-06 2023-09-30T17:04:45.501 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.501 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.501 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:45.501 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.366287+0000", 2023-09-30T17:04:45.502 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7589999999999997e-06 2023-09-30T17:04:45.502 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.502 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.502 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:45.502 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.042061+0000", 2023-09-30T17:04:45.502 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67577395500000004 2023-09-30T17:04:45.502 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.502 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.502 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:45.502 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.042141+0000", 2023-09-30T17:04:45.502 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9777999999999994e-05 2023-09-30T17:04:45.503 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.503 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.503 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:45.503 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.042323+0000", 2023-09-30T17:04:45.503 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000181783 2023-09-30T17:04:45.503 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.503 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.503 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:45.503 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.072114+0000", 2023-09-30T17:04:45.503 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.029791108 2023-09-30T17:04:45.503 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.504 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.504 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:45.504 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.127224+0000", 2023-09-30T17:04:45.504 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.055110065 2023-09-30T17:04:45.504 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.504 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.504 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:45.504 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.127276+0000", 2023-09-30T17:04:45.504 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2574999999999997e-05 2023-09-30T17:04:45.504 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.504 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.504 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:45.505 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.127312+0000", 2023-09-30T17:04:45.505 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6043e-05 2023-09-30T17:04:45.505 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:45.505 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:45.505 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:45.505 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.505 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.505 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:166062 4.36 4:6fa85f86:::100000001f8.00000013:head [write 1110016~4096,write 1118208~4096,write 1155072~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:45.505 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.370231+0000", 2023-09-30T17:04:45.505 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 14.005166384000001, 2023-09-30T17:04:45.505 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75721686499999996, 2023-09-30T17:04:45.505 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:45.506 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:45.506 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:45.506 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:45.506 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:45.506 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 166062 2023-09-30T17:04:45.506 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.506 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:45.506 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.506 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:45.506 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.370231+0000", 2023-09-30T17:04:45.506 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:45.507 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.507 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.507 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:45.507 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.370231+0000", 2023-09-30T17:04:45.507 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:45.507 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.507 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.507 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:45.507 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.370232+0000", 2023-09-30T17:04:45.507 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.68e-07 2023-09-30T17:04:45.507 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.508 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.508 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:45.508 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.370247+0000", 2023-09-30T17:04:45.508 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5440000000000001e-05 2023-09-30T17:04:45.508 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.508 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.508 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:45.508 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.370262+0000", 2023-09-30T17:04:45.508 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4976e-05 2023-09-30T17:04:45.508 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.508 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.509 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:45.509 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.370268+0000", 2023-09-30T17:04:45.509 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4930000000000003e-06 2023-09-30T17:04:45.509 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.509 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.509 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:45.509 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.042052+0000", 2023-09-30T17:04:45.509 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67178386199999995 2023-09-30T17:04:45.509 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.509 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.509 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:45.509 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.042140+0000", 2023-09-30T17:04:45.510 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.7874000000000006e-05 2023-09-30T17:04:45.510 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.510 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.510 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:45.510 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.042321+0000", 2023-09-30T17:04:45.510 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00018131500000000001 2023-09-30T17:04:45.510 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.510 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.510 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:45.510 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.054880+0000", 2023-09-30T17:04:45.510 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.012558625 2023-09-30T17:04:45.511 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.511 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.511 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:45.511 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.127361+0000", 2023-09-30T17:04:45.511 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.072481183000000005 2023-09-30T17:04:45.511 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.511 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.511 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:45.511 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.127412+0000", 2023-09-30T17:04:45.511 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0861e-05 2023-09-30T17:04:45.511 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.512 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.512 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:45.512 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.127448+0000", 2023-09-30T17:04:45.512 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5667999999999998e-05 2023-09-30T17:04:45.512 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:45.512 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:45.512 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:45.512 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.512 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.512 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:166063 4.36 4:6da220e6:::100000001f8.0000003f:head [write 2469888~4096,write 2543616~4096,write 2551808~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:45.512 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.370278+0000", 2023-09-30T17:04:45.512 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 14.005118947, 2023-09-30T17:04:45.513 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75730261499999996, 2023-09-30T17:04:45.513 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:45.513 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:45.513 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:45.513 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:45.513 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:45.513 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 166063 2023-09-30T17:04:45.513 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.513 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:45.513 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.513 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:45.514 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.370278+0000", 2023-09-30T17:04:45.514 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:45.514 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.514 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.514 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:45.514 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.370278+0000", 2023-09-30T17:04:45.514 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:45.514 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.514 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.514 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:45.514 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.374164+0000", 2023-09-30T17:04:45.515 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0038854319999999999 2023-09-30T17:04:45.515 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.515 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.515 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:45.515 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.374182+0000", 2023-09-30T17:04:45.515 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8363999999999999e-05 2023-09-30T17:04:45.515 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.515 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.515 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:45.515 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.374195+0000", 2023-09-30T17:04:45.515 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2328e-05 2023-09-30T17:04:45.515 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.516 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.516 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:45.516 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.374202+0000", 2023-09-30T17:04:45.516 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4189999999999996e-06 2023-09-30T17:04:45.516 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.516 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.516 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:45.516 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.045487+0000", 2023-09-30T17:04:45.516 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67128463800000004 2023-09-30T17:04:45.516 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.516 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.517 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:45.517 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.045558+0000", 2023-09-30T17:04:45.517 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1408999999999993e-05 2023-09-30T17:04:45.517 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.517 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.517 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:45.517 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.045711+0000", 2023-09-30T17:04:45.517 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015323299999999999 2023-09-30T17:04:45.517 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.517 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.517 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:45.517 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.072119+0000", 2023-09-30T17:04:45.518 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.026407824 2023-09-30T17:04:45.518 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.518 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.518 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:45.518 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.127486+0000", 2023-09-30T17:04:45.518 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.055366591999999999 2023-09-30T17:04:45.518 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.518 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.518 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:45.518 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.127543+0000", 2023-09-30T17:04:45.518 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7685000000000001e-05 2023-09-30T17:04:45.519 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.519 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.519 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:45.519 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.127581+0000", 2023-09-30T17:04:45.519 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7691000000000002e-05 2023-09-30T17:04:45.519 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:45.519 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:45.519 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:45.519 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.519 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.520 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:166072 4.36 4:6da220e6:::100000001f8.0000003f:head [write 1822720~4096,write 2002944~4096,write 2072576~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:45.520 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.376908+0000", 2023-09-30T17:04:45.520 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 13.998488934000001, 2023-09-30T17:04:45.520 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75774445099999999, 2023-09-30T17:04:45.520 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:45.520 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:45.520 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:45.520 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:45.520 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:45.520 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 166072 2023-09-30T17:04:45.520 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.520 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:45.521 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.521 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:45.521 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.376908+0000", 2023-09-30T17:04:45.521 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:45.521 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.521 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.521 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:45.521 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.376908+0000", 2023-09-30T17:04:45.521 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:45.521 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.521 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.522 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:45.522 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.376909+0000", 2023-09-30T17:04:45.522 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3900000000000004e-07 2023-09-30T17:04:45.522 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.522 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.522 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:45.522 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.376927+0000", 2023-09-30T17:04:45.522 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7503000000000002e-05 2023-09-30T17:04:45.522 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.522 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.522 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:45.523 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.376936+0000", 2023-09-30T17:04:45.523 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1209999999999996e-06 2023-09-30T17:04:45.523 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.523 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.523 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:45.523 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.376943+0000", 2023-09-30T17:04:45.523 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0979999999999996e-06 2023-09-30T17:04:45.523 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.523 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.523 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:45.523 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.048561+0000", 2023-09-30T17:04:45.524 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67161849299999998 2023-09-30T17:04:45.524 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.524 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.524 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:45.524 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.048634+0000", 2023-09-30T17:04:45.524 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3085999999999998e-05 2023-09-30T17:04:45.524 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.525 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.525 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:45.525 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.048777+0000", 2023-09-30T17:04:45.525 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000143067 2023-09-30T17:04:45.525 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.525 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.525 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:45.525 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.072125+0000", 2023-09-30T17:04:45.525 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023347178999999999 2023-09-30T17:04:45.525 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.525 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.526 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:45.526 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.134554+0000", 2023-09-30T17:04:45.526 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.062429739999999997 2023-09-30T17:04:45.526 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.526 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.526 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:45.526 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.134605+0000", 2023-09-30T17:04:45.526 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0278000000000002e-05 2023-09-30T17:04:45.526 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.526 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.526 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:45.526 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.134653+0000", 2023-09-30T17:04:45.527 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8247000000000001e-05 2023-09-30T17:04:45.527 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:45.527 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:45.527 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:45.527 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.527 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.527 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:166086 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 1073152~4096,write 1261568~4096,write 1273856~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:45.527 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.387018+0000", 2023-09-30T17:04:45.527 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 13.988379389, 2023-09-30T17:04:45.527 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75505913000000002, 2023-09-30T17:04:45.527 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:45.528 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:45.528 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:45.528 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:45.528 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:45.528 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 166086 2023-09-30T17:04:45.528 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.528 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:45.528 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.528 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:45.528 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.387018+0000", 2023-09-30T17:04:45.528 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:45.529 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.529 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.529 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:45.529 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.387018+0000", 2023-09-30T17:04:45.529 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:45.529 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.529 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.529 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:45.529 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.387018+0000", 2023-09-30T17:04:45.529 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.13e-07 2023-09-30T17:04:45.529 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.530 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.530 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:45.530 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.387033+0000", 2023-09-30T17:04:45.530 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4718999999999999e-05 2023-09-30T17:04:45.530 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.530 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.530 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:45.530 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.387041+0000", 2023-09-30T17:04:45.530 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8779999999999998e-06 2023-09-30T17:04:45.530 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.530 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.531 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:45.531 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.387047+0000", 2023-09-30T17:04:45.531 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9689999999999999e-06 2023-09-30T17:04:45.531 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.531 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.531 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:45.531 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.056572+0000", 2023-09-30T17:04:45.531 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.66952481200000002 2023-09-30T17:04:45.531 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.531 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.531 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:45.532 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.056644+0000", 2023-09-30T17:04:45.532 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1695999999999999e-05 2023-09-30T17:04:45.532 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.532 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.532 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:45.532 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.056746+0000", 2023-09-30T17:04:45.532 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000102864 2023-09-30T17:04:45.532 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.532 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.532 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:45.532 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.085374+0000", 2023-09-30T17:04:45.533 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.028627717 2023-09-30T17:04:45.533 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.533 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.533 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:45.533 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.141996+0000", 2023-09-30T17:04:45.533 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.056622290999999998 2023-09-30T17:04:45.533 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.533 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.533 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:45.533 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.142044+0000", 2023-09-30T17:04:45.533 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7939000000000003e-05 2023-09-30T17:04:45.533 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:45.534 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:45.534 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:45.534 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.142077+0000", 2023-09-30T17:04:45.534 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.2731999999999998e-05 2023-09-30T17:04:45.534 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:45.534 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:45.534 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:45.534 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:45.534 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:45.534 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:04:45.536 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:04:45.536 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:45.536+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:45.636 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:45.637+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:45.667 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:04:45.667 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:04:45.667 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2023-09-30T17:04:45.667 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:04:45.677 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:04:45.738 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:45.737+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:45.804 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:04:45.804 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:04:45.804 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2023-09-30T17:04:45.804 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2023-09-30T17:04:45.804 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:04:45.814 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:04:45.855 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:45.854+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:45.939 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:45.940+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:45.983 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:04:45.983 INFO:teuthology.orchestra.run.smithi072.stdout: "size": 20, 2023-09-30T17:04:45.983 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 600, 2023-09-30T17:04:45.983 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [ 2023-09-30T17:04:45.983 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:45.983 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:157789 4.f 4:f26fdfa9:::100000001f8.00000002:head [write 3084288~4096,write 3104768~4096,write 3194880~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-09-30T17:04:45.983 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:28.125691+0000", 2023-09-30T17:04:45.983 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 17.855454291000001, 2023-09-30T17:04:45.983 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.86263862800000002, 2023-09-30T17:04:45.984 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:45.984 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:45.984 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:45.984 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:45.984 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:45.984 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 157789 2023-09-30T17:04:45.984 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:45.984 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:45.984 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:45.984 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:45.984 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.125691+0000", 2023-09-30T17:04:45.984 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:45.985 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:45.985 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:45.985 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:45.985 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.125691+0000", 2023-09-30T17:04:45.985 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:45.985 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:45.985 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:45.985 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:45.985 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.125691+0000", 2023-09-30T17:04:45.985 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8800000000000003e-07 2023-09-30T17:04:45.985 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:45.986 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:45.986 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:45.986 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.125704+0000", 2023-09-30T17:04:45.986 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3054000000000001e-05 2023-09-30T17:04:45.986 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:45.986 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:45.986 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:45.986 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.125711+0000", 2023-09-30T17:04:45.986 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2519999999999996e-06 2023-09-30T17:04:45.986 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:45.986 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:45.987 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:45.987 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.125715+0000", 2023-09-30T17:04:45.987 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.656e-06 2023-09-30T17:04:45.987 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:45.987 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:45.987 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:45.987 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.814299+0000", 2023-09-30T17:04:45.987 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.68858357400000003 2023-09-30T17:04:45.987 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:45.987 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:45.987 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:45.987 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.814403+0000", 2023-09-30T17:04:45.988 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000104607 2023-09-30T17:04:45.988 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:45.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:45.988 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:45.988 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.814591+0000", 2023-09-30T17:04:45.988 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000187472 2023-09-30T17:04:45.988 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:45.988 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:45.988 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:45.988 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.829681+0000", 2023-09-30T17:04:45.988 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.015090299999999999 2023-09-30T17:04:45.989 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:45.989 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:45.989 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:45.989 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.988235+0000", 2023-09-30T17:04:45.989 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.15855408700000001 2023-09-30T17:04:45.989 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:45.989 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:45.989 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:45.989 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.988290+0000", 2023-09-30T17:04:45.989 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4852999999999998e-05 2023-09-30T17:04:45.989 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:45.989 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:45.990 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:45.990 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.988329+0000", 2023-09-30T17:04:45.990 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9285000000000001e-05 2023-09-30T17:04:45.990 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:45.990 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:45.990 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:45.990 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:45.990 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:45.990 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:157795 4.37 4:ef395e89:::100000001f8.00000020:head [write 2281472~4096,write 2314240~4096,write 2658304~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-09-30T17:04:45.990 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:28.127548+0000", 2023-09-30T17:04:45.990 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 17.853596891999999, 2023-09-30T17:04:45.991 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.86069198000000002, 2023-09-30T17:04:45.991 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:45.991 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:45.991 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:45.991 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:45.991 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:45.991 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 157795 2023-09-30T17:04:45.991 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:45.991 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:45.991 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:45.991 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:45.992 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.127548+0000", 2023-09-30T17:04:45.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:45.992 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:45.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:45.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:45.992 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.127548+0000", 2023-09-30T17:04:45.992 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:45.992 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:45.992 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:45.992 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:45.992 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.129701+0000", 2023-09-30T17:04:45.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.002153304 2023-09-30T17:04:45.993 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:45.993 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:45.993 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:45.993 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.129715+0000", 2023-09-30T17:04:45.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3548e-05 2023-09-30T17:04:45.993 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:45.993 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:45.993 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:45.993 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.129722+0000", 2023-09-30T17:04:45.993 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2010000000000002e-06 2023-09-30T17:04:45.994 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:45.994 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:45.994 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:45.994 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.129727+0000", 2023-09-30T17:04:45.994 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2000000000000002e-06 2023-09-30T17:04:45.994 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:45.994 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:45.994 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:45.994 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.818343+0000", 2023-09-30T17:04:45.994 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.68861540399999999 2023-09-30T17:04:45.994 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:45.995 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:45.995 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:45.995 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.818424+0000", 2023-09-30T17:04:45.995 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.1547999999999999e-05 2023-09-30T17:04:45.995 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:45.995 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:45.995 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:45.995 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.818583+0000", 2023-09-30T17:04:45.995 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015905100000000001 2023-09-30T17:04:45.995 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:45.995 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:45.996 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:45.996 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.988142+0000", 2023-09-30T17:04:45.996 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.16955905700000001 2023-09-30T17:04:45.996 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:45.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:45.996 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:45.996 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.988154+0000", 2023-09-30T17:04:45.996 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1317e-05 2023-09-30T17:04:45.996 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:45.996 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:45.996 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:45.997 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.988201+0000", 2023-09-30T17:04:45.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7299999999999998e-05 2023-09-30T17:04:45.997 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:45.997 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:45.997 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:45.997 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.988240+0000", 2023-09-30T17:04:45.997 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9050000000000001e-05 2023-09-30T17:04:45.997 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:45.997 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:45.997 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:45.998 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:45.998 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:45.998 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:157798 4.37 4:ef395e89:::100000001f8.00000020:head [write 3284992~4096,write 3301376~4096,write 3452928~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-09-30T17:04:45.998 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:28.133611+0000", 2023-09-30T17:04:45.998 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 17.847534294999999, 2023-09-30T17:04:45.998 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.85484233099999996, 2023-09-30T17:04:45.998 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:45.998 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:45.998 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:45.998 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:45.998 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:45.998 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 157798 2023-09-30T17:04:45.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:45.999 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:45.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:45.999 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:45.999 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.133611+0000", 2023-09-30T17:04:45.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:45.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:45.999 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:45.999 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:45.999 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.133611+0000", 2023-09-30T17:04:45.999 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:45.999 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.000 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:46.000 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.137517+0000", 2023-09-30T17:04:46.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039065920000000004 2023-09-30T17:04:46.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.000 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.000 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:46.000 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.137537+0000", 2023-09-30T17:04:46.000 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.9888e-05 2023-09-30T17:04:46.000 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.001 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:46.001 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.137549+0000", 2023-09-30T17:04:46.001 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2009e-05 2023-09-30T17:04:46.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.001 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:46.001 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.137557+0000", 2023-09-30T17:04:46.001 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4510000000000003e-06 2023-09-30T17:04:46.001 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.001 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.001 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:46.002 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.823134+0000", 2023-09-30T17:04:46.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.68557705000000002 2023-09-30T17:04:46.002 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.002 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:46.002 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.823210+0000", 2023-09-30T17:04:46.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6608999999999998e-05 2023-09-30T17:04:46.002 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.002 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.002 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:46.002 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.823351+0000", 2023-09-30T17:04:46.002 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014104699999999999 2023-09-30T17:04:46.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.003 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.003 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:46.003 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.988248+0000", 2023-09-30T17:04:46.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.16489661999999999 2023-09-30T17:04:46.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.003 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.003 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:46.003 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.988372+0000", 2023-09-30T17:04:46.003 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000124306 2023-09-30T17:04:46.003 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.003 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.003 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:46.005 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.988420+0000", 2023-09-30T17:04:46.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.7670000000000003e-05 2023-09-30T17:04:46.005 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.005 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.005 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:46.005 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.988453+0000", 2023-09-30T17:04:46.005 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3089000000000001e-05 2023-09-30T17:04:46.006 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:46.006 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:46.006 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:46.006 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.006 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.006 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:157803 4.2f 4:f59f865b:::100000001f8.00000007:head [write 1728512~4096,write 1789952~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-09-30T17:04:46.006 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:28.139569+0000", 2023-09-30T17:04:46.006 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 17.841575958, 2023-09-30T17:04:46.006 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.84879218300000003, 2023-09-30T17:04:46.006 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:46.006 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:46.007 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:46.007 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:46.007 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:46.007 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 157803 2023-09-30T17:04:46.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.007 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:46.007 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.007 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:46.007 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.139569+0000", 2023-09-30T17:04:46.007 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:46.007 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.008 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:46.008 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.139569+0000", 2023-09-30T17:04:46.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:46.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.008 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:46.008 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.143516+0000", 2023-09-30T17:04:46.008 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0039473670000000002 2023-09-30T17:04:46.008 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.008 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.008 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:46.009 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.143532+0000", 2023-09-30T17:04:46.009 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5977999999999998e-05 2023-09-30T17:04:46.009 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.009 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:46.009 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.143541+0000", 2023-09-30T17:04:46.009 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4700000000000002e-06 2023-09-30T17:04:46.009 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.009 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.009 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:46.009 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.143547+0000", 2023-09-30T17:04:46.009 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.2910000000000004e-06 2023-09-30T17:04:46.010 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.010 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:46.010 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.822863+0000", 2023-09-30T17:04:46.010 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.67931543400000005 2023-09-30T17:04:46.010 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.010 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.010 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:46.010 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.822932+0000", 2023-09-30T17:04:46.010 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9076000000000001e-05 2023-09-30T17:04:46.010 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:46.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.823050+0000", 2023-09-30T17:04:46.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00011811000000000001 2023-09-30T17:04:46.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.011 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:46.011 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.988256+0000", 2023-09-30T17:04:46.011 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.165206044 2023-09-30T17:04:46.011 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.011 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:46.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.988289+0000", 2023-09-30T17:04:46.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2997000000000003e-05 2023-09-30T17:04:46.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:46.012 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.988331+0000", 2023-09-30T17:04:46.012 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2481000000000002e-05 2023-09-30T17:04:46.012 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.012 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.012 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:46.013 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.988361+0000", 2023-09-30T17:04:46.013 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9935000000000001e-05 2023-09-30T17:04:46.013 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:46.013 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:46.013 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:46.013 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.013 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.013 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:157825 4.f 4:f2a80dfe:::100000001f8.00000019:head [write 1105920~4096,write 1122304~4096,write 1347584~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-09-30T17:04:46.013 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:28.150556+0000", 2023-09-30T17:04:46.013 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 17.830589243999999, 2023-09-30T17:04:46.013 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.85021122400000004, 2023-09-30T17:04:46.013 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:46.014 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:46.014 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:46.014 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:46.014 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:46.014 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 157825 2023-09-30T17:04:46.014 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.014 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:46.014 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.014 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:46.014 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.150556+0000", 2023-09-30T17:04:46.014 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:46.015 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:46.015 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.150556+0000", 2023-09-30T17:04:46.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:46.015 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.015 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.015 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:46.015 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.150556+0000", 2023-09-30T17:04:46.015 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.13e-07 2023-09-30T17:04:46.015 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:46.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.150570+0000", 2023-09-30T17:04:46.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4117000000000001e-05 2023-09-30T17:04:46.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:46.016 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.150575+0000", 2023-09-30T17:04:46.016 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6199999999999998e-06 2023-09-30T17:04:46.016 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.016 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.016 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:46.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.150580+0000", 2023-09-30T17:04:46.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8899999999999998e-06 2023-09-30T17:04:46.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:46.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.829697+0000", 2023-09-30T17:04:46.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.67911663300000003 2023-09-30T17:04:46.017 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.017 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.017 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:46.017 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.829743+0000", 2023-09-30T17:04:46.017 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6622999999999997e-05 2023-09-30T17:04:46.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.018 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:46.018 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.829835+0000", 2023-09-30T17:04:46.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1557000000000004e-05 2023-09-30T17:04:46.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.018 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.018 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:46.018 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.988497+0000", 2023-09-30T17:04:46.018 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.158662304 2023-09-30T17:04:46.018 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.019 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:46.019 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:29.000695+0000", 2023-09-30T17:04:46.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.01219786 2023-09-30T17:04:46.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.019 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:46.019 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:29.000736+0000", 2023-09-30T17:04:46.019 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.1289999999999999e-05 2023-09-30T17:04:46.019 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.019 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.019 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:46.020 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:29.000767+0000", 2023-09-30T17:04:46.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0817e-05 2023-09-30T17:04:46.020 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:46.020 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:46.020 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:46.020 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.020 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.020 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:157828 4.17 4:e8b4e0b7:::100000001f8.00000014:head [write 61440~4096,write 73728~4096,write 94208~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-09-30T17:04:46.020 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:28.150611+0000", 2023-09-30T17:04:46.020 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 17.830533575, 2023-09-30T17:04:46.020 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.85007624000000004, 2023-09-30T17:04:46.021 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:46.021 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:46.021 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:46.021 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:46.021 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:46.021 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 157828 2023-09-30T17:04:46.021 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.021 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:46.021 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.021 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:46.021 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.150611+0000", 2023-09-30T17:04:46.021 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:46.022 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.022 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.022 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:46.022 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.150611+0000", 2023-09-30T17:04:46.022 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:46.022 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.022 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.022 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:46.022 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.150612+0000", 2023-09-30T17:04:46.022 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2800000000000003e-07 2023-09-30T17:04:46.022 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.022 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.023 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:46.023 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.150621+0000", 2023-09-30T17:04:46.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9239999999999996e-06 2023-09-30T17:04:46.023 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.023 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.023 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:46.023 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.150625+0000", 2023-09-30T17:04:46.023 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5000000000000001e-06 2023-09-30T17:04:46.023 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.023 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.023 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:46.023 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.150628+0000", 2023-09-30T17:04:46.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9179999999999998e-06 2023-09-30T17:04:46.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.024 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:46.024 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.829719+0000", 2023-09-30T17:04:46.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.67909131499999997 2023-09-30T17:04:46.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.024 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.024 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:46.024 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.829794+0000", 2023-09-30T17:04:46.024 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.4553000000000003e-05 2023-09-30T17:04:46.024 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.025 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.025 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:46.025 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:29.000581+0000", 2023-09-30T17:04:46.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.17078728100000001 2023-09-30T17:04:46.025 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.025 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.025 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:46.025 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:29.000624+0000", 2023-09-30T17:04:46.025 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.2809999999999998e-05 2023-09-30T17:04:46.025 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.025 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.026 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:46.026 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:29.000688+0000", 2023-09-30T17:04:46.026 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3610999999999998e-05 2023-09-30T17:04:46.026 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:46.026 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:46.026 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:46.026 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.026 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.026 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:157836 4.f 4:f2a80dfe:::100000001f8.00000019:head [write 765952~4096,write 847872~4096,write 1392640~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e55)", 2023-09-30T17:04:46.026 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:28.156587+0000", 2023-09-30T17:04:46.026 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 17.824558076999999, 2023-09-30T17:04:46.027 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.84425581699999996, 2023-09-30T17:04:46.027 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:46.027 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:46.027 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:46.027 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:46.027 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:46.027 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 157836 2023-09-30T17:04:46.027 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.027 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:46.027 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.027 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:46.027 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.156587+0000", 2023-09-30T17:04:46.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:46.028 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.028 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.028 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:46.028 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.156587+0000", 2023-09-30T17:04:46.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:46.028 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.028 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.028 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:46.028 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.158515+0000", 2023-09-30T17:04:46.028 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001928155 2023-09-30T17:04:46.029 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.029 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:46.029 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.158532+0000", 2023-09-30T17:04:46.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6702999999999999e-05 2023-09-30T17:04:46.029 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.029 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:46.029 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.158541+0000", 2023-09-30T17:04:46.029 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0750000000000004e-06 2023-09-30T17:04:46.029 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.029 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.030 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:46.030 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.158547+0000", 2023-09-30T17:04:46.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3960000000000003e-06 2023-09-30T17:04:46.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.030 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:46.030 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.836649+0000", 2023-09-30T17:04:46.030 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.67810128400000003 2023-09-30T17:04:46.030 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.030 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.030 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:46.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.836725+0000", 2023-09-30T17:04:46.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.6113999999999997e-05 2023-09-30T17:04:46.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:46.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.836884+0000", 2023-09-30T17:04:46.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000158813 2023-09-30T17:04:46.031 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.031 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.031 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:46.031 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:28.988557+0000", 2023-09-30T17:04:46.031 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.151673217 2023-09-30T17:04:46.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.032 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:46.032 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:29.000774+0000", 2023-09-30T17:04:46.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012216942 2023-09-30T17:04:46.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.032 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.032 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:46.032 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:29.000813+0000", 2023-09-30T17:04:46.032 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9517999999999997e-05 2023-09-30T17:04:46.032 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.033 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.033 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:46.033 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:29.000843+0000", 2023-09-30T17:04:46.033 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9600000000000001e-05 2023-09-30T17:04:46.033 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:46.033 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:46.033 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:46.033 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.033 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.033 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179260 4.f 4:f0d983b2:::100000001f8.0000001f:head [write 921600~8192,write 995328~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:46.033 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.812958+0000", 2023-09-30T17:04:46.033 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.1681871259999994, 2023-09-30T17:04:46.034 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.82225978099999997, 2023-09-30T17:04:46.034 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:46.034 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:46.034 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:46.034 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:46.034 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:46.034 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179260 2023-09-30T17:04:46.034 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.034 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:46.034 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.034 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:46.035 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.812958+0000", 2023-09-30T17:04:46.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:46.035 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.035 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.035 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:46.035 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.812958+0000", 2023-09-30T17:04:46.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:46.035 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.035 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.035 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:46.035 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.814516+0000", 2023-09-30T17:04:46.035 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0015578009999999999 2023-09-30T17:04:46.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:46.036 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.814533+0000", 2023-09-30T17:04:46.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.7487999999999999e-05 2023-09-30T17:04:46.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.036 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.036 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:46.036 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.814544+0000", 2023-09-30T17:04:46.036 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0338e-05 2023-09-30T17:04:46.036 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:46.037 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.814551+0000", 2023-09-30T17:04:46.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2400000000000001e-06 2023-09-30T17:04:46.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:46.037 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.592631+0000", 2023-09-30T17:04:46.037 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.77808063500000002 2023-09-30T17:04:46.037 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.037 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.037 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:46.038 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.592715+0000", 2023-09-30T17:04:46.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3442999999999994e-05 2023-09-30T17:04:46.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.038 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:46.038 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.592852+0000", 2023-09-30T17:04:46.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013743699999999999 2023-09-30T17:04:46.038 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.038 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.038 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:46.038 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.604909+0000", 2023-09-30T17:04:46.038 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.01205701 2023-09-30T17:04:46.039 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.039 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:46.039 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.635135+0000", 2023-09-30T17:04:46.039 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.030225905000000001 2023-09-30T17:04:46.039 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.039 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:46.039 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.635184+0000", 2023-09-30T17:04:46.039 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8735e-05 2023-09-30T17:04:46.039 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.039 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.040 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:46.040 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.635218+0000", 2023-09-30T17:04:46.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3748999999999998e-05 2023-09-30T17:04:46.040 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:46.040 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:46.040 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:46.040 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.040 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.040 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179261 4.37 4:ef395e89:::100000001f8.00000020:head [write 3284992~4096,write 3334144~4096,write 3395584~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:46.040 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.814563+0000", 2023-09-30T17:04:46.040 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.1665821049999998, 2023-09-30T17:04:46.040 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.82064327999999997, 2023-09-30T17:04:46.041 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:46.041 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:46.041 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:46.041 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:46.041 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:46.041 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179261 2023-09-30T17:04:46.041 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.041 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:46.041 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.041 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:46.041 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.814563+0000", 2023-09-30T17:04:46.042 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:46.042 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.042 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.042 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:46.042 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.814563+0000", 2023-09-30T17:04:46.042 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:46.042 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.042 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.042 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:46.042 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.814563+0000", 2023-09-30T17:04:46.042 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2900000000000004e-07 2023-09-30T17:04:46.043 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.043 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.043 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:46.043 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.814576+0000", 2023-09-30T17:04:46.043 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.2680999999999999e-05 2023-09-30T17:04:46.043 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.043 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.043 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:46.043 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.814583+0000", 2023-09-30T17:04:46.043 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6150000000000002e-06 2023-09-30T17:04:46.043 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.043 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.044 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:46.044 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.814588+0000", 2023-09-30T17:04:46.044 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.045e-06 2023-09-30T17:04:46.044 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.044 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.044 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:46.044 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.592617+0000", 2023-09-30T17:04:46.044 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.77802875500000002 2023-09-30T17:04:46.044 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.044 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.044 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:46.045 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.592706+0000", 2023-09-30T17:04:46.045 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.9840999999999996e-05 2023-09-30T17:04:46.045 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.045 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.045 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:46.045 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.592875+0000", 2023-09-30T17:04:46.045 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016879300000000001 2023-09-30T17:04:46.045 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.045 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.045 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:46.045 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.605031+0000", 2023-09-30T17:04:46.045 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.012156227 2023-09-30T17:04:46.046 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.046 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.046 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:46.046 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.635117+0000", 2023-09-30T17:04:46.046 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.030085819999999999 2023-09-30T17:04:46.046 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.046 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.046 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:46.046 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.635172+0000", 2023-09-30T17:04:46.046 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.4391999999999997e-05 2023-09-30T17:04:46.046 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.047 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.047 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:46.047 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.635206+0000", 2023-09-30T17:04:46.047 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4582000000000002e-05 2023-09-30T17:04:46.047 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:46.047 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:46.047 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:46.047 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.047 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.047 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179282 4.2f 4:f59f865b:::100000001f8.00000007:head [write 1630208~8192,write 1945600~4096,write 2015232~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:46.047 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.822601+0000", 2023-09-30T17:04:46.047 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.1585444139999996, 2023-09-30T17:04:46.048 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.82927721700000001, 2023-09-30T17:04:46.048 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:46.048 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:46.048 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:46.048 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:46.048 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:46.048 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179282 2023-09-30T17:04:46.048 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.048 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:46.048 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.049 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:46.049 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.822601+0000", 2023-09-30T17:04:46.049 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:46.049 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.049 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.049 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:46.049 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.822601+0000", 2023-09-30T17:04:46.049 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:46.049 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.049 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.049 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:46.049 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.822601+0000", 2023-09-30T17:04:46.050 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9299999999999999e-07 2023-09-30T17:04:46.050 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.050 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.050 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:46.050 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.822625+0000", 2023-09-30T17:04:46.050 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.3836e-05 2023-09-30T17:04:46.050 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.050 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.050 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:46.050 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.822632+0000", 2023-09-30T17:04:46.050 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.5750000000000003e-06 2023-09-30T17:04:46.051 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.051 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.051 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:46.051 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.822638+0000", 2023-09-30T17:04:46.051 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2109999999999997e-06 2023-09-30T17:04:46.051 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.051 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.051 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:46.051 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.604804+0000", 2023-09-30T17:04:46.051 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.78216662800000003 2023-09-30T17:04:46.051 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.052 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:46.052 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.604870+0000", 2023-09-30T17:04:46.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.6068999999999994e-05 2023-09-30T17:04:46.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.052 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:46.052 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.604978+0000", 2023-09-30T17:04:46.052 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000107947 2023-09-30T17:04:46.052 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.052 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.052 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:46.053 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.624608+0000", 2023-09-30T17:04:46.053 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.019629636999999998 2023-09-30T17:04:46.053 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.053 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.053 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:46.053 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.651798+0000", 2023-09-30T17:04:46.053 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.027189722999999999 2023-09-30T17:04:46.053 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.053 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.053 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:46.053 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.651846+0000", 2023-09-30T17:04:46.053 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8112000000000003e-05 2023-09-30T17:04:46.054 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.054 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.054 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:46.054 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.651878+0000", 2023-09-30T17:04:46.054 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2085999999999997e-05 2023-09-30T17:04:46.054 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:46.054 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:46.054 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:46.054 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.054 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.054 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179299 4.2f 4:f59f865b:::100000001f8.00000007:head [write 3973120~4096,write 4038656~4096,write 4055040~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:46.055 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.828667+0000", 2023-09-30T17:04:46.055 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.1524785350000002, 2023-09-30T17:04:46.055 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.82350079099999995, 2023-09-30T17:04:46.055 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:46.055 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:46.055 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:46.055 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:46.055 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:46.055 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179299 2023-09-30T17:04:46.055 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.055 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:46.055 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.056 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:46.056 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.828667+0000", 2023-09-30T17:04:46.056 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:46.056 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.056 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.056 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:46.056 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.828667+0000", 2023-09-30T17:04:46.056 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:46.056 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.056 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.056 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:46.056 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.828667+0000", 2023-09-30T17:04:46.057 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8100000000000003e-07 2023-09-30T17:04:46.057 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.057 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.057 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:46.057 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.828680+0000", 2023-09-30T17:04:46.057 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.3366999999999999e-05 2023-09-30T17:04:46.057 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.057 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.057 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:46.057 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.828689+0000", 2023-09-30T17:04:46.057 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.1200000000000008e-06 2023-09-30T17:04:46.058 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.058 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.058 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:46.058 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.828696+0000", 2023-09-30T17:04:46.058 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.0719999999999996e-06 2023-09-30T17:04:46.058 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.058 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.058 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:46.058 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.606541+0000", 2023-09-30T17:04:46.058 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.777845177 2023-09-30T17:04:46.058 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.058 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.059 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:46.059 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.606588+0000", 2023-09-30T17:04:46.059 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6866000000000002e-05 2023-09-30T17:04:46.059 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.059 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.059 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:46.059 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.606674+0000", 2023-09-30T17:04:46.059 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.6428000000000007e-05 2023-09-30T17:04:46.059 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.059 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.059 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:46.059 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.624611+0000", 2023-09-30T17:04:46.060 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.017936917 2023-09-30T17:04:46.060 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.060 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.060 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:46.060 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.652029+0000", 2023-09-30T17:04:46.060 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.027418034000000001 2023-09-30T17:04:46.060 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.060 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.060 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:46.060 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.652137+0000", 2023-09-30T17:04:46.060 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010844399999999999 2023-09-30T17:04:46.061 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.061 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.061 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:46.061 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.652167+0000", 2023-09-30T17:04:46.061 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.9884999999999999e-05 2023-09-30T17:04:46.061 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:46.061 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:46.061 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:46.061 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.061 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.061 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179305 4.f 4:f2a80dfe:::100000001f8.00000019:head [write 3338240~4096,write 3543040~4096,write 3817472~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:46.061 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.828740+0000", 2023-09-30T17:04:46.062 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.1524046079999994, 2023-09-30T17:04:46.062 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.823018425, 2023-09-30T17:04:46.062 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:46.062 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:46.062 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:46.062 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:46.062 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:46.062 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179305 2023-09-30T17:04:46.062 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.062 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:46.062 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.063 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:46.063 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.828740+0000", 2023-09-30T17:04:46.063 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:46.063 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.063 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.063 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:46.063 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.828740+0000", 2023-09-30T17:04:46.063 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:46.063 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.063 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.063 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:46.064 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.833568+0000", 2023-09-30T17:04:46.064 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0048272089999999998 2023-09-30T17:04:46.064 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.064 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.064 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:46.064 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.833586+0000", 2023-09-30T17:04:46.064 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.8328000000000001e-05 2023-09-30T17:04:46.064 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.064 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.064 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:46.064 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.833596+0000", 2023-09-30T17:04:46.065 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0431999999999999e-05 2023-09-30T17:04:46.065 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.065 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.065 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:46.065 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.833603+0000", 2023-09-30T17:04:46.065 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.229e-06 2023-09-30T17:04:46.065 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.065 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.065 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:46.065 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.606529+0000", 2023-09-30T17:04:46.065 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.77292685100000003 2023-09-30T17:04:46.065 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.066 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.066 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:46.066 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.606579+0000", 2023-09-30T17:04:46.066 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9057000000000001e-05 2023-09-30T17:04:46.066 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.066 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.066 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:46.066 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.606669+0000", 2023-09-30T17:04:46.066 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.0155000000000007e-05 2023-09-30T17:04:46.066 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.066 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.066 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:46.067 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.635232+0000", 2023-09-30T17:04:46.067 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.028563280999999999 2023-09-30T17:04:46.067 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.067 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.067 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:46.067 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.651670+0000", 2023-09-30T17:04:46.067 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.016438075999999999 2023-09-30T17:04:46.067 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.067 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.067 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:46.067 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.651722+0000", 2023-09-30T17:04:46.068 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1863999999999997e-05 2023-09-30T17:04:46.068 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.068 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.068 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:46.068 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.651759+0000", 2023-09-30T17:04:46.068 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6943000000000002e-05 2023-09-30T17:04:46.068 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:46.068 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:46.068 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:46.068 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.068 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.069 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179329 4.f 4:f26fdfa9:::100000001f8.00000002:head [write 2981888~4096,write 3006464~4096,write 3137536~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:46.069 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.844644+0000", 2023-09-30T17:04:46.069 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.1365006330000007, 2023-09-30T17:04:46.069 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.81869189799999997, 2023-09-30T17:04:46.069 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:46.069 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:46.069 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:46.069 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:46.069 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:46.069 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179329 2023-09-30T17:04:46.069 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.069 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:46.070 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.070 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:46.070 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.844644+0000", 2023-09-30T17:04:46.070 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:46.070 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.070 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.070 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:46.070 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.844644+0000", 2023-09-30T17:04:46.070 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:46.070 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.071 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.071 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:46.071 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.846515+0000", 2023-09-30T17:04:46.071 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0018701950000000001 2023-09-30T17:04:46.071 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.071 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.071 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:46.071 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.846529+0000", 2023-09-30T17:04:46.071 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4791e-05 2023-09-30T17:04:46.071 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.071 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.072 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:46.072 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.846537+0000", 2023-09-30T17:04:46.072 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.96e-06 2023-09-30T17:04:46.072 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.072 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.072 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:46.072 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.846542+0000", 2023-09-30T17:04:46.072 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9180000000000002e-06 2023-09-30T17:04:46.072 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.072 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.072 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:46.072 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.630632+0000", 2023-09-30T17:04:46.073 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.78409002100000003 2023-09-30T17:04:46.073 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.073 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.073 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:46.073 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.630716+0000", 2023-09-30T17:04:46.073 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3227999999999997e-05 2023-09-30T17:04:46.073 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.073 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.073 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:46.073 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.630832+0000", 2023-09-30T17:04:46.073 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000116725 2023-09-30T17:04:46.074 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.074 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.074 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:46.074 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.652869+0000", 2023-09-30T17:04:46.074 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022037195999999998 2023-09-30T17:04:46.074 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.074 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.074 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:46.074 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.663228+0000", 2023-09-30T17:04:46.074 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.010358911 2023-09-30T17:04:46.074 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.074 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.075 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:46.075 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.663293+0000", 2023-09-30T17:04:46.075 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.4949000000000004e-05 2023-09-30T17:04:46.075 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.075 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.075 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:46.075 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.663336+0000", 2023-09-30T17:04:46.075 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.3003999999999997e-05 2023-09-30T17:04:46.075 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:46.075 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:46.075 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:46.076 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.076 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.076 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179342 4.37 4:eff9002a:::100000001f8.00000003:head [write 3248128~4096,write 3264512~4096,write 3682304~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:46.076 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.846633+0000", 2023-09-30T17:04:46.076 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.1345119889999999, 2023-09-30T17:04:46.076 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.81720047100000004, 2023-09-30T17:04:46.076 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:46.076 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:46.076 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:46.076 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:46.076 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:46.077 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179342 2023-09-30T17:04:46.077 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.077 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:46.077 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.077 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:46.077 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.846633+0000", 2023-09-30T17:04:46.077 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:46.077 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.077 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.077 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:46.077 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.846633+0000", 2023-09-30T17:04:46.078 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:46.078 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.078 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.078 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:46.078 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.852516+0000", 2023-09-30T17:04:46.078 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0058829950000000002 2023-09-30T17:04:46.078 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.078 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.078 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:46.078 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.852532+0000", 2023-09-30T17:04:46.078 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5897e-05 2023-09-30T17:04:46.079 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.079 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.079 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:46.079 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.852542+0000", 2023-09-30T17:04:46.079 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 9.6220000000000004e-06 2023-09-30T17:04:46.079 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.079 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.079 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:46.079 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.852549+0000", 2023-09-30T17:04:46.079 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.9970000000000001e-06 2023-09-30T17:04:46.079 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.079 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.080 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:46.080 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.641410+0000", 2023-09-30T17:04:46.080 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.78886158100000003 2023-09-30T17:04:46.080 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.080 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.080 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:46.080 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.641483+0000", 2023-09-30T17:04:46.080 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.3090999999999995e-05 2023-09-30T17:04:46.080 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.080 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.080 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:46.081 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.641638+0000", 2023-09-30T17:04:46.081 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000155167 2023-09-30T17:04:46.081 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.081 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.081 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:46.081 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.663603+0000", 2023-09-30T17:04:46.081 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.021964575 2023-09-30T17:04:46.081 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.081 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.081 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:46.081 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.663754+0000", 2023-09-30T17:04:46.081 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00015129600000000001 2023-09-30T17:04:46.082 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.082 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.082 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:46.082 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.663800+0000", 2023-09-30T17:04:46.082 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.5824e-05 2023-09-30T17:04:46.082 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.082 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.082 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:46.082 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.663834+0000", 2023-09-30T17:04:46.082 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.3426000000000002e-05 2023-09-30T17:04:46.082 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:46.083 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:46.083 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:46.083 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.083 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.083 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179345 4.37 4:eff9002a:::100000001f8.00000003:head [write 1740800~4096,write 1802240~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:46.083 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.855791+0000", 2023-09-30T17:04:46.083 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.1253543780000008, 2023-09-30T17:04:46.083 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.81831333100000003, 2023-09-30T17:04:46.083 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:46.083 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:46.083 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:46.084 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:46.084 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:46.084 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179345 2023-09-30T17:04:46.084 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.084 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:46.084 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.084 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:46.084 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.855791+0000", 2023-09-30T17:04:46.084 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:46.084 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.084 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.085 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:46.085 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.855791+0000", 2023-09-30T17:04:46.085 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:46.085 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.085 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.085 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:46.085 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.855791+0000", 2023-09-30T17:04:46.085 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0900000000000002e-07 2023-09-30T17:04:46.085 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.085 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.085 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:46.085 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.855803+0000", 2023-09-30T17:04:46.086 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.1958e-05 2023-09-30T17:04:46.086 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.086 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.086 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:46.086 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.855810+0000", 2023-09-30T17:04:46.086 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.007e-06 2023-09-30T17:04:46.086 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.086 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.086 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:46.086 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.855816+0000", 2023-09-30T17:04:46.086 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.3589999999999996e-06 2023-09-30T17:04:46.087 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.087 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.087 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:46.087 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.652598+0000", 2023-09-30T17:04:46.087 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.79678203400000003 2023-09-30T17:04:46.087 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.087 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.087 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:46.087 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.652670+0000", 2023-09-30T17:04:46.087 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.1186000000000006e-05 2023-09-30T17:04:46.087 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.087 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.088 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:46.088 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.652804+0000", 2023-09-30T17:04:46.088 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00013443099999999999 2023-09-30T17:04:46.088 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.088 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.088 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:46.088 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.667698+0000", 2023-09-30T17:04:46.088 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.014894341 2023-09-30T17:04:46.088 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.088 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.088 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:46.089 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.674012+0000", 2023-09-30T17:04:46.089 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0063136620000000003 2023-09-30T17:04:46.089 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.089 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.089 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:46.089 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.674064+0000", 2023-09-30T17:04:46.089 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.1777000000000002e-05 2023-09-30T17:04:46.089 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.089 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.089 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:46.089 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.674104+0000", 2023-09-30T17:04:46.089 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.0166999999999997e-05 2023-09-30T17:04:46.090 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:46.090 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:46.090 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:46.090 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.090 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.090 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179350 4.37 4:ecbf0fb2:::100000001f8.00000038:head [write 1875968~4096,write 1896448~4096,write 2420736~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:46.090 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.855896+0000", 2023-09-30T17:04:46.090 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.1252491980000006, 2023-09-30T17:04:46.090 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.83089869999999999, 2023-09-30T17:04:46.090 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:46.090 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:46.090 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:46.091 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:46.091 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:46.091 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179350 2023-09-30T17:04:46.091 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.091 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:46.091 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.091 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:46.091 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.855896+0000", 2023-09-30T17:04:46.091 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:46.091 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.091 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.092 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:46.092 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.855896+0000", 2023-09-30T17:04:46.092 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:46.092 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.092 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.092 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:46.092 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.855896+0000", 2023-09-30T17:04:46.092 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.8599999999999998e-07 2023-09-30T17:04:46.092 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.092 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.092 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:46.092 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.855911+0000", 2023-09-30T17:04:46.093 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4704e-05 2023-09-30T17:04:46.093 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.093 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.093 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:46.093 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.855918+0000", 2023-09-30T17:04:46.093 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.8009999999999998e-06 2023-09-30T17:04:46.093 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.093 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.093 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:46.093 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.855923+0000", 2023-09-30T17:04:46.093 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.6879999999999998e-06 2023-09-30T17:04:46.093 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.094 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.094 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:46.094 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.657665+0000", 2023-09-30T17:04:46.094 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.80174238099999995 2023-09-30T17:04:46.094 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.094 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.094 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:46.094 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.657722+0000", 2023-09-30T17:04:46.094 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.7411000000000003e-05 2023-09-30T17:04:46.094 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.094 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.094 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:46.095 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.657825+0000", 2023-09-30T17:04:46.095 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010278899999999999 2023-09-30T17:04:46.095 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.095 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.095 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:46.095 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.682194+0000", 2023-09-30T17:04:46.095 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.024369169 2023-09-30T17:04:46.095 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.095 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.095 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:46.095 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.686706+0000", 2023-09-30T17:04:46.096 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0045118370000000003 2023-09-30T17:04:46.096 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.096 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.096 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:46.096 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.686758+0000", 2023-09-30T17:04:46.096 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2268999999999997e-05 2023-09-30T17:04:46.096 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.096 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.096 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:46.096 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.686795+0000", 2023-09-30T17:04:46.096 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.6164999999999997e-05 2023-09-30T17:04:46.096 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:46.097 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:46.097 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:46.097 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.097 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.097 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179354 4.f 4:f0d983b2:::100000001f8.0000001f:head [write 3198976~8192,write 3211264~4096,write 3280896~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:46.097 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.856039+0000", 2023-09-30T17:04:46.097 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.1251064910000004, 2023-09-30T17:04:46.097 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.83060850600000002, 2023-09-30T17:04:46.097 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:46.097 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:46.097 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:46.097 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:46.098 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:46.098 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179354 2023-09-30T17:04:46.098 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.098 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:46.098 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.098 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:46.098 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.856039+0000", 2023-09-30T17:04:46.098 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:46.098 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.098 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.098 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:46.099 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.856039+0000", 2023-09-30T17:04:46.099 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:46.099 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.099 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.099 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:46.099 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.857519+0000", 2023-09-30T17:04:46.099 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0014801899999999999 2023-09-30T17:04:46.099 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.099 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.099 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:46.099 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.857541+0000", 2023-09-30T17:04:46.099 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1982999999999999e-05 2023-09-30T17:04:46.100 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.100 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.100 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:46.100 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.857555+0000", 2023-09-30T17:04:46.100 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.4195999999999999e-05 2023-09-30T17:04:46.100 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.100 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.100 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:46.100 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.857563+0000", 2023-09-30T17:04:46.100 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2919999999999996e-06 2023-09-30T17:04:46.100 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.100 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.101 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:46.101 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.657650+0000", 2023-09-30T17:04:46.101 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.80008643300000004 2023-09-30T17:04:46.101 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.101 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.101 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:46.101 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.657734+0000", 2023-09-30T17:04:46.101 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.4680999999999998e-05 2023-09-30T17:04:46.101 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.101 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.101 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:46.102 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.657901+0000", 2023-09-30T17:04:46.102 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000166525 2023-09-30T17:04:46.102 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.102 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.102 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:46.102 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.683284+0000", 2023-09-30T17:04:46.102 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.025383249 2023-09-30T17:04:46.102 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.102 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.102 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:46.102 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.686556+0000", 2023-09-30T17:04:46.102 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.0032721510000000001 2023-09-30T17:04:46.103 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.103 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.103 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:46.103 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.686607+0000", 2023-09-30T17:04:46.103 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0821e-05 2023-09-30T17:04:46.103 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.103 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.103 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:46.103 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.686647+0000", 2023-09-30T17:04:46.103 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.9984999999999997e-05 2023-09-30T17:04:46.103 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:46.103 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:46.104 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:46.104 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.104 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.104 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179356 4.2f 4:f59f865b:::100000001f8.00000007:head [write 2682880~4096,write 2818048~4096,write 2863104~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:46.104 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.857578+0000", 2023-09-30T17:04:46.104 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.123567091, 2023-09-30T17:04:46.104 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.82923716300000005, 2023-09-30T17:04:46.104 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:46.104 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:46.104 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:46.104 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:46.105 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:46.105 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179356 2023-09-30T17:04:46.105 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.105 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:46.105 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.105 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:46.105 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.857578+0000", 2023-09-30T17:04:46.105 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:46.105 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.105 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.105 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:46.105 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.857578+0000", 2023-09-30T17:04:46.106 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:46.106 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.106 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.106 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:46.106 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.857578+0000", 2023-09-30T17:04:46.106 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.9100000000000004e-07 2023-09-30T17:04:46.106 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.106 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.106 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:46.106 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.857600+0000", 2023-09-30T17:04:46.106 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.154e-05 2023-09-30T17:04:46.106 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.107 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.107 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:46.107 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.857607+0000", 2023-09-30T17:04:46.107 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 6.579e-06 2023-09-30T17:04:46.107 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.107 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.107 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:46.107 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.857612+0000", 2023-09-30T17:04:46.107 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.3890000000000004e-06 2023-09-30T17:04:46.107 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.107 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.108 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:46.108 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.663649+0000", 2023-09-30T17:04:46.109 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.80603691 2023-09-30T17:04:46.109 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.109 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.109 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:46.109 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.663727+0000", 2023-09-30T17:04:46.110 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.7764999999999998e-05 2023-09-30T17:04:46.110 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.110 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.110 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:46.110 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.663894+0000", 2023-09-30T17:04:46.110 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00016739899999999999 2023-09-30T17:04:46.110 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.110 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.110 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:46.110 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.686680+0000", 2023-09-30T17:04:46.110 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022786280999999999 2023-09-30T17:04:46.111 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.111 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.111 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:46.111 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.686733+0000", 2023-09-30T17:04:46.111 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.2564e-05 2023-09-30T17:04:46.111 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.111 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.111 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:46.111 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.686783+0000", 2023-09-30T17:04:46.111 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 5.0049000000000001e-05 2023-09-30T17:04:46.111 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.111 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.112 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:46.112 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.686815+0000", 2023-09-30T17:04:46.112 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.2196000000000001e-05 2023-09-30T17:04:46.112 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:46.112 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:46.112 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:46.112 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.112 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.112 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179358 4.37 4:eff9002a:::100000001f8.00000003:head [write 446464~4096,write 618496~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:46.112 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.859571+0000", 2023-09-30T17:04:46.112 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.1215738809999998, 2023-09-30T17:04:46.113 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.82731242000000005, 2023-09-30T17:04:46.113 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:46.113 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:46.113 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:46.113 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:46.113 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:46.113 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179358 2023-09-30T17:04:46.113 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.113 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:46.113 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.113 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:46.113 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.859571+0000", 2023-09-30T17:04:46.114 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:46.114 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.114 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.114 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:46.114 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.859571+0000", 2023-09-30T17:04:46.114 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:46.114 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.114 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.114 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:46.114 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.861518+0000", 2023-09-30T17:04:46.114 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001947245 2023-09-30T17:04:46.115 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.115 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.115 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:46.115 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.861534+0000", 2023-09-30T17:04:46.115 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.5288999999999999e-05 2023-09-30T17:04:46.115 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.115 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.115 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:46.115 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.861555+0000", 2023-09-30T17:04:46.115 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 2.1667000000000001e-05 2023-09-30T17:04:46.115 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.115 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.116 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:46.116 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.861564+0000", 2023-09-30T17:04:46.116 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.3990000000000004e-06 2023-09-30T17:04:46.116 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.116 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.116 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:46.116 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.663862+0000", 2023-09-30T17:04:46.116 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.80229824299999997 2023-09-30T17:04:46.116 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.116 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.116 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:46.116 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.663945+0000", 2023-09-30T17:04:46.117 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 8.2699000000000002e-05 2023-09-30T17:04:46.117 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.117 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.117 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:46.117 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.664081+0000", 2023-09-30T17:04:46.117 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.000136315 2023-09-30T17:04:46.117 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.117 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.117 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:46.117 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.686695+0000", 2023-09-30T17:04:46.117 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.022613847999999999 2023-09-30T17:04:46.117 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.118 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.118 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:46.118 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.686804+0000", 2023-09-30T17:04:46.118 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00010927800000000001 2023-09-30T17:04:46.118 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.118 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.118 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:46.118 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.686849+0000", 2023-09-30T17:04:46.118 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4722999999999999e-05 2023-09-30T17:04:46.118 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.118 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.119 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:46.119 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.686884+0000", 2023-09-30T17:04:46.119 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.4714e-05 2023-09-30T17:04:46.119 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:46.119 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:46.119 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:46.119 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.119 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.119 INFO:teuthology.orchestra.run.smithi072.stdout: "description": "osd_op(client.4547.0:179392 4.f 4:f26fdfa9:::100000001f8.00000002:head [write 184320~4096,write 335872~4096,write 368640~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e57)", 2023-09-30T17:04:46.119 INFO:teuthology.orchestra.run.smithi072.stdout: "initiated_at": "2023-09-30T17:04:36.881569+0000", 2023-09-30T17:04:46.119 INFO:teuthology.orchestra.run.smithi072.stdout: "age": 9.0995759750000005, 2023-09-30T17:04:46.120 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.82211667300000002, 2023-09-30T17:04:46.120 INFO:teuthology.orchestra.run.smithi072.stdout: "type_data": { 2023-09-30T17:04:46.120 INFO:teuthology.orchestra.run.smithi072.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:46.120 INFO:teuthology.orchestra.run.smithi072.stdout: "client_info": { 2023-09-30T17:04:46.120 INFO:teuthology.orchestra.run.smithi072.stdout: "client": "client.4547", 2023-09-30T17:04:46.120 INFO:teuthology.orchestra.run.smithi072.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:46.120 INFO:teuthology.orchestra.run.smithi072.stdout: "tid": 179392 2023-09-30T17:04:46.120 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.120 INFO:teuthology.orchestra.run.smithi072.stdout: "events": [ 2023-09-30T17:04:46.120 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.120 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "initiated", 2023-09-30T17:04:46.120 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.881569+0000", 2023-09-30T17:04:46.121 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:46.121 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.121 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.121 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "header_read", 2023-09-30T17:04:46.121 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.881569+0000", 2023-09-30T17:04:46.121 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0 2023-09-30T17:04:46.121 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.121 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.121 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "throttled", 2023-09-30T17:04:46.121 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.883516+0000", 2023-09-30T17:04:46.121 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.001946765 2023-09-30T17:04:46.121 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.122 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.122 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "all_read", 2023-09-30T17:04:46.122 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.883532+0000", 2023-09-30T17:04:46.122 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.6008e-05 2023-09-30T17:04:46.122 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.122 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.122 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "dispatched", 2023-09-30T17:04:46.122 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.883542+0000", 2023-09-30T17:04:46.122 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 1.0438999999999999e-05 2023-09-30T17:04:46.122 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.122 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.123 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "queued_for_pg", 2023-09-30T17:04:46.123 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:36.883550+0000", 2023-09-30T17:04:46.123 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.2910000000000002e-06 2023-09-30T17:04:46.123 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.123 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.123 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "reached_pg", 2023-09-30T17:04:46.123 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.667809+0000", 2023-09-30T17:04:46.123 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.78425961600000005 2023-09-30T17:04:46.123 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.123 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.123 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "started", 2023-09-30T17:04:46.123 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.667888+0000", 2023-09-30T17:04:46.124 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 7.9043999999999997e-05 2023-09-30T17:04:46.124 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.124 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.124 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "waiting for subops from 0", 2023-09-30T17:04:46.124 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.668033+0000", 2023-09-30T17:04:46.124 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.00014433499999999999 2023-09-30T17:04:46.124 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.124 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.124 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "op_commit", 2023-09-30T17:04:46.124 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.691721+0000", 2023-09-30T17:04:46.124 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.023688407000000002 2023-09-30T17:04:46.124 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.125 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.125 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:46.125 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.703611+0000", 2023-09-30T17:04:46.125 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 0.01188963 2023-09-30T17:04:46.125 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.125 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.125 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "commit_sent", 2023-09-30T17:04:46.125 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.703655+0000", 2023-09-30T17:04:46.125 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 4.4696e-05 2023-09-30T17:04:46.125 INFO:teuthology.orchestra.run.smithi072.stdout: }, 2023-09-30T17:04:46.125 INFO:teuthology.orchestra.run.smithi072.stdout: { 2023-09-30T17:04:46.125 INFO:teuthology.orchestra.run.smithi072.stdout: "event": "done", 2023-09-30T17:04:46.126 INFO:teuthology.orchestra.run.smithi072.stdout: "time": "2023-09-30T17:04:37.703686+0000", 2023-09-30T17:04:46.126 INFO:teuthology.orchestra.run.smithi072.stdout: "duration": 3.0442000000000001e-05 2023-09-30T17:04:46.126 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:46.126 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:46.126 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:46.126 INFO:teuthology.orchestra.run.smithi072.stdout: } 2023-09-30T17:04:46.126 INFO:teuthology.orchestra.run.smithi072.stdout: ] 2023-09-30T17:04:46.126 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:04:46.127 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:04:46.128 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:46.128+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:46.228 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:46.229+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:46.273 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:04:46.274 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:04:46.274 INFO:teuthology.orchestra.run.smithi031.stdout: "num_ops": 0 2023-09-30T17:04:46.274 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:04:46.284 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:04:46.368 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:46.369+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:46.430 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:46.430+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:46.456 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2023-09-30T17:04:46.457 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:04:46.457 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [], 2023-09-30T17:04:46.457 INFO:teuthology.orchestra.run.smithi031.stdout: "complaint_time": 30, 2023-09-30T17:04:46.458 INFO:teuthology.orchestra.run.smithi031.stdout: "num_blocked_ops": 0 2023-09-30T17:04:46.458 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:04:46.468 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:04:46.551 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:46.552+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:46.632 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:46.633+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:46.641 INFO:teuthology.orchestra.run.smithi031.stdout:{ 2023-09-30T17:04:46.642 INFO:teuthology.orchestra.run.smithi031.stdout: "size": 20, 2023-09-30T17:04:46.642 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 600, 2023-09-30T17:04:46.642 INFO:teuthology.orchestra.run.smithi031.stdout: "ops": [ 2023-09-30T17:04:46.642 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.642 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165665 4.6 4:63e80496:::100000001f8.0000001e:head [write 1212416~4096,write 1318912~4096,write 1462272~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:46.642 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.209892+0000", 2023-09-30T17:04:46.642 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 15.430223512, 2023-09-30T17:04:46.642 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.76500929900000003, 2023-09-30T17:04:46.642 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:46.643 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:46.643 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:46.643 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:46.643 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:46.643 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165665 2023-09-30T17:04:46.644 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.644 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:46.644 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.644 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:46.644 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.209892+0000", 2023-09-30T17:04:46.644 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:46.644 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.644 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.645 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:46.645 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.209892+0000", 2023-09-30T17:04:46.645 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:46.645 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.645 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.645 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:46.645 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.209893+0000", 2023-09-30T17:04:46.645 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5099999999999999e-07 2023-09-30T17:04:46.645 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.645 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.645 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:46.645 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.209908+0000", 2023-09-30T17:04:46.646 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4754e-05 2023-09-30T17:04:46.646 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.646 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.647 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:46.647 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.209916+0000", 2023-09-30T17:04:46.647 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.7940000000000008e-06 2023-09-30T17:04:46.647 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.647 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.647 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:46.647 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.209923+0000", 2023-09-30T17:04:46.648 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5429999999999999e-06 2023-09-30T17:04:46.648 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.648 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.648 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:46.648 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.899390+0000", 2023-09-30T17:04:46.648 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.689467371 2023-09-30T17:04:46.648 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.648 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.648 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:46.649 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.899462+0000", 2023-09-30T17:04:46.649 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1273999999999996e-05 2023-09-30T17:04:46.649 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.649 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.649 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:46.649 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.899610+0000", 2023-09-30T17:04:46.649 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014818599999999999 2023-09-30T17:04:46.649 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.650 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.650 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:46.650 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.919587+0000", 2023-09-30T17:04:46.650 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.019977042 2023-09-30T17:04:46.650 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.650 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.650 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:46.650 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.974802+0000", 2023-09-30T17:04:46.650 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.055214764 2023-09-30T17:04:46.650 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.650 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.651 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:46.651 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.974863+0000", 2023-09-30T17:04:46.651 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.1377000000000005e-05 2023-09-30T17:04:46.651 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.651 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.651 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:46.651 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.974901+0000", 2023-09-30T17:04:46.651 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.8543e-05 2023-09-30T17:04:46.651 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:46.651 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:46.651 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:46.651 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.652 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.652 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165673 4.6 4:63e80496:::100000001f8.0000001e:head [write 516096~4096,write 524288~4096,write 532480~8192] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:46.652 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.210099+0000", 2023-09-30T17:04:46.652 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 15.430016641, 2023-09-30T17:04:46.652 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.76494798200000003, 2023-09-30T17:04:46.652 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:46.652 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:46.652 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:46.652 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:46.652 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:46.652 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165673 2023-09-30T17:04:46.653 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.653 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:46.653 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.653 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:46.653 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.210099+0000", 2023-09-30T17:04:46.653 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:46.653 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.653 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.653 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:46.653 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.210099+0000", 2023-09-30T17:04:46.653 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:46.653 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.654 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.654 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:46.654 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.210100+0000", 2023-09-30T17:04:46.654 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0699999999999997e-07 2023-09-30T17:04:46.654 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.654 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.654 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:46.654 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.210117+0000", 2023-09-30T17:04:46.654 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7501000000000001e-05 2023-09-30T17:04:46.654 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.654 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.655 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:46.655 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.210126+0000", 2023-09-30T17:04:46.655 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.2629999999999992e-06 2023-09-30T17:04:46.655 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.655 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.655 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:46.655 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.210133+0000", 2023-09-30T17:04:46.655 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8079999999999999e-06 2023-09-30T17:04:46.655 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.655 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.655 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:46.656 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.902650+0000", 2023-09-30T17:04:46.656 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.69251684800000002 2023-09-30T17:04:46.656 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.656 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.656 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:46.656 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.902724+0000", 2023-09-30T17:04:46.656 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4376999999999996e-05 2023-09-30T17:04:46.656 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.656 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.656 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:46.656 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.902881+0000", 2023-09-30T17:04:46.656 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000156269 2023-09-30T17:04:46.657 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.657 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.657 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:46.657 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.925614+0000", 2023-09-30T17:04:46.657 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.022732937000000002 2023-09-30T17:04:46.657 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.657 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.657 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:46.657 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.974955+0000", 2023-09-30T17:04:46.658 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.04934115 2023-09-30T17:04:46.658 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.658 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.658 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:46.658 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.975012+0000", 2023-09-30T17:04:46.658 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6949e-05 2023-09-30T17:04:46.658 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.658 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.658 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:46.659 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.975047+0000", 2023-09-30T17:04:46.659 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5373000000000002e-05 2023-09-30T17:04:46.659 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:46.659 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:46.659 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:46.659 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.659 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.659 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165689 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 188416~4096,write 229376~4096,write 299008~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:46.659 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.217300+0000", 2023-09-30T17:04:46.659 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 15.422816066999999, 2023-09-30T17:04:46.659 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75814632500000001, 2023-09-30T17:04:46.660 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:46.660 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:46.660 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:46.660 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:46.660 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:46.660 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165689 2023-09-30T17:04:46.660 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.660 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:46.660 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.660 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:46.661 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.217300+0000", 2023-09-30T17:04:46.661 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:46.661 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.661 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.661 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:46.661 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.217300+0000", 2023-09-30T17:04:46.661 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:46.661 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.661 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.661 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:46.661 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.217300+0000", 2023-09-30T17:04:46.662 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3000000000000001e-07 2023-09-30T17:04:46.662 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.662 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.662 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:46.662 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.217314+0000", 2023-09-30T17:04:46.662 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.3901e-05 2023-09-30T17:04:46.662 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.662 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.662 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:46.662 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.217321+0000", 2023-09-30T17:04:46.663 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.5869999999999998e-06 2023-09-30T17:04:46.663 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.663 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.663 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:46.663 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.217326+0000", 2023-09-30T17:04:46.663 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7740000000000001e-06 2023-09-30T17:04:46.663 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.663 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.663 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:46.663 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.907842+0000", 2023-09-30T17:04:46.663 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.69051533600000004 2023-09-30T17:04:46.664 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.664 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.664 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:46.664 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.907927+0000", 2023-09-30T17:04:46.664 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5619999999999997e-05 2023-09-30T17:04:46.664 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.664 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.664 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:46.664 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.908097+0000", 2023-09-30T17:04:46.664 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00016991400000000001 2023-09-30T17:04:46.664 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.664 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.665 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:46.665 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.925623+0000", 2023-09-30T17:04:46.665 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.017525888999999999 2023-09-30T17:04:46.665 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.665 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.665 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:46.665 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.975110+0000", 2023-09-30T17:04:46.665 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.049486789000000003 2023-09-30T17:04:46.665 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.666 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.666 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:46.666 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.975170+0000", 2023-09-30T17:04:46.666 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9960000000000002e-05 2023-09-30T17:04:46.666 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.666 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.666 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:46.666 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.975446+0000", 2023-09-30T17:04:46.666 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000276125 2023-09-30T17:04:46.667 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:46.667 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:46.667 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:46.667 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.667 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.667 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165875 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 458752~4096,write 1454080~4096,write 1634304~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:46.667 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.295916+0000", 2023-09-30T17:04:46.667 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 15.344199417, 2023-09-30T17:04:46.667 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.76379055500000004, 2023-09-30T17:04:46.668 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:46.668 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:46.668 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:46.668 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:46.668 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:46.668 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165875 2023-09-30T17:04:46.668 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.668 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:46.668 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.669 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:46.669 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.295916+0000", 2023-09-30T17:04:46.669 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:46.669 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.669 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.669 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:46.669 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.295916+0000", 2023-09-30T17:04:46.669 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:46.669 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.670 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.670 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:46.670 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.295917+0000", 2023-09-30T17:04:46.670 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9500000000000002e-07 2023-09-30T17:04:46.670 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.670 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.670 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:46.670 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.295932+0000", 2023-09-30T17:04:46.670 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4803999999999999e-05 2023-09-30T17:04:46.671 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.671 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.671 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:46.671 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.295941+0000", 2023-09-30T17:04:46.671 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.448e-06 2023-09-30T17:04:46.671 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.671 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.671 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:46.671 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.295948+0000", 2023-09-30T17:04:46.672 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9199999999999998e-06 2023-09-30T17:04:46.672 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.672 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.672 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:46.672 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.971359+0000", 2023-09-30T17:04:46.672 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67541110500000001 2023-09-30T17:04:46.672 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.672 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.672 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:46.672 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.971433+0000", 2023-09-30T17:04:46.672 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3388999999999998e-05 2023-09-30T17:04:46.672 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.673 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.673 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:46.673 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.971583+0000", 2023-09-30T17:04:46.673 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015035999999999999 2023-09-30T17:04:46.673 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.673 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.673 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:46.673 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.982409+0000", 2023-09-30T17:04:46.673 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010826242999999999 2023-09-30T17:04:46.673 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.673 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.673 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:46.674 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.059610+0000", 2023-09-30T17:04:46.674 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.077201160000000005 2023-09-30T17:04:46.674 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.674 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.674 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:46.674 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.059669+0000", 2023-09-30T17:04:46.674 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.8965999999999998e-05 2023-09-30T17:04:46.674 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.674 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.674 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:46.674 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.059707+0000", 2023-09-30T17:04:46.675 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7564999999999997e-05 2023-09-30T17:04:46.675 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:46.675 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:46.675 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:46.675 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.675 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.675 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165878 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 2277376~4096,write 2371584~4096,write 4050944~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:46.675 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.299610+0000", 2023-09-30T17:04:46.675 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 15.340505338, 2023-09-30T17:04:46.675 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75525803300000005, 2023-09-30T17:04:46.675 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:46.675 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:46.676 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:46.676 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:46.676 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:46.676 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165878 2023-09-30T17:04:46.676 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.676 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:46.676 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.676 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:46.676 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299610+0000", 2023-09-30T17:04:46.676 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:46.676 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.677 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.677 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:46.677 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299610+0000", 2023-09-30T17:04:46.677 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:46.677 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.677 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.677 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:46.677 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299611+0000", 2023-09-30T17:04:46.677 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7299999999999996e-07 2023-09-30T17:04:46.677 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.677 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.678 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:46.678 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299623+0000", 2023-09-30T17:04:46.678 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2513e-05 2023-09-30T17:04:46.678 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.678 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.678 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:46.678 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299630+0000", 2023-09-30T17:04:46.678 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0090000000000001e-06 2023-09-30T17:04:46.678 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.678 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.678 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:46.679 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299638+0000", 2023-09-30T17:04:46.679 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1210000000000001e-06 2023-09-30T17:04:46.679 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.679 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.679 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:46.679 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.971347+0000", 2023-09-30T17:04:46.679 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67170925699999995 2023-09-30T17:04:46.679 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.679 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.679 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:46.679 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.971419+0000", 2023-09-30T17:04:46.679 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2495000000000003e-05 2023-09-30T17:04:46.680 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.680 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.680 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:46.680 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.971567+0000", 2023-09-30T17:04:46.680 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00014805499999999999 2023-09-30T17:04:46.680 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.680 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.680 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:46.680 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.982312+0000", 2023-09-30T17:04:46.680 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010744584 2023-09-30T17:04:46.680 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.681 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.681 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:46.681 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.054770+0000", 2023-09-30T17:04:46.681 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.072457683999999994 2023-09-30T17:04:46.681 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.681 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.681 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:46.681 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.054825+0000", 2023-09-30T17:04:46.681 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5210000000000002e-05 2023-09-30T17:04:46.681 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.681 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.681 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:46.682 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.054868+0000", 2023-09-30T17:04:46.682 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.3532000000000003e-05 2023-09-30T17:04:46.682 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:46.682 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:46.682 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:46.682 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.682 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.682 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165890 4.36 4:6da220e6:::100000001f8.0000003f:head [write 3395584~4096,write 3436544~4096,write 3444736~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:46.682 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.299835+0000", 2023-09-30T17:04:46.682 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 15.340280655000001, 2023-09-30T17:04:46.682 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.76012937700000005, 2023-09-30T17:04:46.683 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:46.683 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:46.683 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:46.683 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:46.683 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:46.683 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165890 2023-09-30T17:04:46.683 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.683 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:46.683 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.683 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:46.683 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299835+0000", 2023-09-30T17:04:46.683 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:46.684 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.684 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.684 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:46.684 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299835+0000", 2023-09-30T17:04:46.684 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:46.684 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.684 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.684 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:46.684 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299835+0000", 2023-09-30T17:04:46.684 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.5699999999999998e-07 2023-09-30T17:04:46.684 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.685 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.685 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:46.685 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299905+0000", 2023-09-30T17:04:46.685 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.9908999999999998e-05 2023-09-30T17:04:46.685 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.685 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.685 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:46.685 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299914+0000", 2023-09-30T17:04:46.685 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.9630000000000004e-06 2023-09-30T17:04:46.685 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.685 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.685 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:46.686 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299921+0000", 2023-09-30T17:04:46.686 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8079999999999999e-06 2023-09-30T17:04:46.686 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.686 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.686 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:46.686 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.975617+0000", 2023-09-30T17:04:46.686 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67569579099999999 2023-09-30T17:04:46.686 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.686 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.686 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:46.686 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.975700+0000", 2023-09-30T17:04:46.686 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.3462999999999997e-05 2023-09-30T17:04:46.687 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.687 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.687 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:46.687 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.975871+0000", 2023-09-30T17:04:46.687 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00017027399999999999 2023-09-30T17:04:46.687 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.687 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.687 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:46.687 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.001290+0000", 2023-09-30T17:04:46.687 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.025419576999999999 2023-09-30T17:04:46.687 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.687 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.688 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:46.688 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.059876+0000", 2023-09-30T17:04:46.688 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.058585849000000002 2023-09-30T17:04:46.688 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.688 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.688 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:46.688 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.059929+0000", 2023-09-30T17:04:46.688 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.3053000000000002e-05 2023-09-30T17:04:46.688 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.688 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.688 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:46.689 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.059964+0000", 2023-09-30T17:04:46.689 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5233e-05 2023-09-30T17:04:46.689 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:46.689 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:46.689 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:46.689 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.689 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.689 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165893 4.6 4:62d56fc8:::100000001f8.0000001c:head [write 2748416~4096,write 2764800~4096,write 3031040~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:46.689 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.299965+0000", 2023-09-30T17:04:46.689 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 15.340150379000001, 2023-09-30T17:04:46.689 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75987149300000001, 2023-09-30T17:04:46.689 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:46.690 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:46.690 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:46.690 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:46.690 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:46.690 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165893 2023-09-30T17:04:46.690 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.690 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:46.690 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.690 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:46.690 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299965+0000", 2023-09-30T17:04:46.690 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:46.690 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.691 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.691 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:46.691 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.299965+0000", 2023-09-30T17:04:46.691 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:46.691 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.691 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.691 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:46.691 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.301184+0000", 2023-09-30T17:04:46.691 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0012189779999999999 2023-09-30T17:04:46.691 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.691 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.691 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:46.692 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.301199+0000", 2023-09-30T17:04:46.692 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4626e-05 2023-09-30T17:04:46.692 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.692 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.692 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:46.692 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.301209+0000", 2023-09-30T17:04:46.692 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.042e-05 2023-09-30T17:04:46.692 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.692 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.692 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:46.692 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.301217+0000", 2023-09-30T17:04:46.692 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4000000000000003e-06 2023-09-30T17:04:46.693 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.693 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.693 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:46.693 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.975800+0000", 2023-09-30T17:04:46.693 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67458368700000004 2023-09-30T17:04:46.693 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.693 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.693 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:46.693 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.975886+0000", 2023-09-30T17:04:46.693 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.5722000000000004e-05 2023-09-30T17:04:46.693 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.693 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.694 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:46.694 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.976065+0000", 2023-09-30T17:04:46.694 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000178705 2023-09-30T17:04:46.694 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.694 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.694 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:46.694 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.998244+0000", 2023-09-30T17:04:46.694 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.022178788000000001 2023-09-30T17:04:46.694 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.694 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.694 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:46.695 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.059746+0000", 2023-09-30T17:04:46.695 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.061501950999999999 2023-09-30T17:04:46.695 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.695 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.695 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:46.695 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.059802+0000", 2023-09-30T17:04:46.695 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6128000000000002e-05 2023-09-30T17:04:46.695 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.695 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.695 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:46.695 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.059837+0000", 2023-09-30T17:04:46.695 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5088e-05 2023-09-30T17:04:46.696 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:46.696 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:46.696 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:46.696 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.696 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.696 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165908 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 2269184~4096,write 4112384~4096,write 4136960~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:46.696 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.309255+0000", 2023-09-30T17:04:46.696 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 15.33086061, 2023-09-30T17:04:46.696 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.76105314999999996, 2023-09-30T17:04:46.696 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:46.696 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:46.697 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:46.697 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:46.697 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:46.697 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165908 2023-09-30T17:04:46.697 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.697 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:46.697 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.697 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:46.697 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.309255+0000", 2023-09-30T17:04:46.697 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:46.697 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.697 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.698 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:46.698 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.309255+0000", 2023-09-30T17:04:46.698 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:46.698 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.698 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.698 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:46.698 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.311162+0000", 2023-09-30T17:04:46.698 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001906886 2023-09-30T17:04:46.698 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.698 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.698 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:46.699 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.311177+0000", 2023-09-30T17:04:46.699 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5193e-05 2023-09-30T17:04:46.699 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.699 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.699 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:46.699 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.311188+0000", 2023-09-30T17:04:46.699 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0805000000000001e-05 2023-09-30T17:04:46.699 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.699 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.699 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:46.699 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.311196+0000", 2023-09-30T17:04:46.700 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.627e-06 2023-09-30T17:04:46.700 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.700 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.700 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:46.700 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.982808+0000", 2023-09-30T17:04:46.700 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67161246100000005 2023-09-30T17:04:46.700 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.700 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.700 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:46.700 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.982872+0000", 2023-09-30T17:04:46.700 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3646999999999996e-05 2023-09-30T17:04:46.700 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.701 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.701 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:46.701 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.983017+0000", 2023-09-30T17:04:46.701 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000144964 2023-09-30T17:04:46.701 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.701 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.701 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:46.701 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.010841+0000", 2023-09-30T17:04:46.701 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.027824637999999999 2023-09-30T17:04:46.701 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.701 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.701 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:46.702 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.070218+0000", 2023-09-30T17:04:46.702 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.059376421999999998 2023-09-30T17:04:46.702 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.702 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.702 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:46.702 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.070272+0000", 2023-09-30T17:04:46.702 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.4407000000000003e-05 2023-09-30T17:04:46.702 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.702 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.702 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:46.702 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.070308+0000", 2023-09-30T17:04:46.703 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6100000000000003e-05 2023-09-30T17:04:46.703 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:46.703 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:46.703 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:46.703 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.703 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.703 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165910 4.36 4:6c9c34b1:::100000001f8.00000010:head [write 1191936~4096,write 1277952~4096,write 1613824~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:46.703 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.311262+0000", 2023-09-30T17:04:46.703 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 15.328854041, 2023-09-30T17:04:46.703 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75916103300000004, 2023-09-30T17:04:46.703 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:46.703 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:46.704 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:46.704 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:46.704 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:46.704 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165910 2023-09-30T17:04:46.704 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.704 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:46.704 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.704 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:46.704 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.311262+0000", 2023-09-30T17:04:46.704 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:46.704 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.704 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.705 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:46.705 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.311262+0000", 2023-09-30T17:04:46.705 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:46.705 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.705 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.705 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:46.705 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.313172+0000", 2023-09-30T17:04:46.705 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.001910847 2023-09-30T17:04:46.705 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.705 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.705 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:46.706 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.313191+0000", 2023-09-30T17:04:46.706 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8416000000000001e-05 2023-09-30T17:04:46.706 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.706 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.706 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:46.706 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.313204+0000", 2023-09-30T17:04:46.706 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.271e-05 2023-09-30T17:04:46.706 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.706 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.706 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:46.706 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.313211+0000", 2023-09-30T17:04:46.707 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3529999999999997e-06 2023-09-30T17:04:46.707 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.707 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.707 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:46.707 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.990896+0000", 2023-09-30T17:04:46.707 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67768552500000001 2023-09-30T17:04:46.707 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.707 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.707 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:46.707 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.990972+0000", 2023-09-30T17:04:46.707 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.5658e-05 2023-09-30T17:04:46.708 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.708 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.708 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:46.708 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.991072+0000", 2023-09-30T17:04:46.708 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.9636000000000006e-05 2023-09-30T17:04:46.708 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.708 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.708 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:46.708 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.010847+0000", 2023-09-30T17:04:46.708 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.019774908000000001 2023-09-30T17:04:46.708 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.709 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.709 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:46.709 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.070345+0000", 2023-09-30T17:04:46.709 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.059497983999999997 2023-09-30T17:04:46.709 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.709 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.709 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:46.709 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.070392+0000", 2023-09-30T17:04:46.709 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.6851999999999998e-05 2023-09-30T17:04:46.709 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.709 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.709 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:46.710 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.070423+0000", 2023-09-30T17:04:46.710 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.1143999999999999e-05 2023-09-30T17:04:46.710 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:46.710 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:46.710 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:46.710 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.710 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.710 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165918 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 2666496~4096,write 2760704~4096,write 3031040~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:46.710 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.315883+0000", 2023-09-30T17:04:46.710 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 15.324232214, 2023-09-30T17:04:46.710 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75903742100000005, 2023-09-30T17:04:46.711 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:46.711 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:46.711 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:46.711 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:46.711 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:46.711 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165918 2023-09-30T17:04:46.711 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.711 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:46.711 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.711 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:46.711 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315883+0000", 2023-09-30T17:04:46.711 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:46.712 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.712 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.712 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:46.712 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315883+0000", 2023-09-30T17:04:46.712 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:46.712 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.712 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.712 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:46.712 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315884+0000", 2023-09-30T17:04:46.712 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.8199999999999999e-07 2023-09-30T17:04:46.712 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.713 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.713 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:46.713 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315903+0000", 2023-09-30T17:04:46.713 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.9089e-05 2023-09-30T17:04:46.713 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.713 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.713 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:46.713 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315916+0000", 2023-09-30T17:04:46.713 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2636999999999999e-05 2023-09-30T17:04:46.713 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.713 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.714 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:46.714 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315923+0000", 2023-09-30T17:04:46.714 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.2259999999999999e-06 2023-09-30T17:04:46.714 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.714 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.714 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:46.714 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.993661+0000", 2023-09-30T17:04:46.714 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67773771500000002 2023-09-30T17:04:46.714 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.714 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.714 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:46.714 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.993749+0000", 2023-09-30T17:04:46.715 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.7721999999999998e-05 2023-09-30T17:04:46.715 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.715 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.715 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:46.715 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.996215+0000", 2023-09-30T17:04:46.715 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0024667360000000002 2023-09-30T17:04:46.715 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.715 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.715 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:46.715 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.010996+0000", 2023-09-30T17:04:46.715 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.014780873 2023-09-30T17:04:46.716 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.716 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.716 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:46.716 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.074853+0000", 2023-09-30T17:04:46.716 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.063857133999999996 2023-09-30T17:04:46.716 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.716 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.716 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:46.716 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.074888+0000", 2023-09-30T17:04:46.716 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5067000000000002e-05 2023-09-30T17:04:46.716 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.716 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.717 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:46.717 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.074921+0000", 2023-09-30T17:04:46.717 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.2539999999999997e-05 2023-09-30T17:04:46.717 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:46.717 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:46.717 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:46.717 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.717 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.717 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165921 4.6 4:63e80496:::100000001f8.0000001e:head [write 679936~4096,write 1089536~4096,write 1138688~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:46.717 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.315973+0000", 2023-09-30T17:04:46.717 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 15.324142279, 2023-09-30T17:04:46.718 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75610897399999999, 2023-09-30T17:04:46.718 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:46.718 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:46.718 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:46.718 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:46.718 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:46.718 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165921 2023-09-30T17:04:46.718 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.718 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:46.718 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.718 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:46.718 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315973+0000", 2023-09-30T17:04:46.719 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:46.719 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.719 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.719 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:46.719 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315973+0000", 2023-09-30T17:04:46.719 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:46.719 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.719 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.719 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:46.719 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315974+0000", 2023-09-30T17:04:46.719 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.1100000000000001e-07 2023-09-30T17:04:46.720 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.720 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.720 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:46.720 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315986+0000", 2023-09-30T17:04:46.720 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2673e-05 2023-09-30T17:04:46.720 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.720 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.720 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:46.720 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.315995+0000", 2023-09-30T17:04:46.720 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1689999999999992e-06 2023-09-30T17:04:46.720 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.720 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.721 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:46.721 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.316000+0000", 2023-09-30T17:04:46.721 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9849999999999997e-06 2023-09-30T17:04:46.721 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.721 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.721 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:46.721 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.994495+0000", 2023-09-30T17:04:46.721 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67849566800000005 2023-09-30T17:04:46.721 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.721 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.721 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:46.722 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.994579+0000", 2023-09-30T17:04:46.722 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.4089000000000001e-05 2023-09-30T17:04:46.722 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.722 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.722 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:46.722 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.994744+0000", 2023-09-30T17:04:46.722 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000164327 2023-09-30T17:04:46.722 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.722 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.722 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:46.722 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.010988+0000", 2023-09-30T17:04:46.723 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.016244705000000002 2023-09-30T17:04:46.723 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.723 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.723 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:46.723 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.071979+0000", 2023-09-30T17:04:46.723 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.060990111 2023-09-30T17:04:46.723 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.723 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.723 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:46.723 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.072035+0000", 2023-09-30T17:04:46.723 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.6320000000000003e-05 2023-09-30T17:04:46.724 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.724 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.724 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:46.724 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.072082+0000", 2023-09-30T17:04:46.724 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7515999999999997e-05 2023-09-30T17:04:46.724 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:46.724 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:46.724 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:46.724 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.724 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.724 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165949 4.6 4:616d4c41:::100000001f8.00000034:head [write 409600~4096,write 618496~4096,write 659456~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:46.724 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.326340+0000", 2023-09-30T17:04:46.725 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 15.313776165, 2023-09-30T17:04:46.725 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75612495899999999, 2023-09-30T17:04:46.725 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:46.725 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:46.725 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:46.725 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:46.725 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:46.725 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165949 2023-09-30T17:04:46.725 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.725 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:46.725 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.725 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:46.726 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.326340+0000", 2023-09-30T17:04:46.726 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:46.726 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.726 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.726 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:46.726 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.326340+0000", 2023-09-30T17:04:46.726 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:46.726 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.726 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.726 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:46.726 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.326340+0000", 2023-09-30T17:04:46.727 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0200000000000002e-07 2023-09-30T17:04:46.727 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.727 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.727 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:46.727 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.326352+0000", 2023-09-30T17:04:46.727 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1715e-05 2023-09-30T17:04:46.727 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.727 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.727 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:46.727 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.326358+0000", 2023-09-30T17:04:46.727 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3679999999999998e-06 2023-09-30T17:04:46.728 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.728 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.728 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:46.728 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.326363+0000", 2023-09-30T17:04:46.728 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.9629999999999997e-06 2023-09-30T17:04:46.728 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.728 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.728 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:46.728 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.006610+0000", 2023-09-30T17:04:46.728 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.68024690499999996 2023-09-30T17:04:46.728 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.728 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.729 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:46.729 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.006692+0000", 2023-09-30T17:04:46.729 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.2274000000000005e-05 2023-09-30T17:04:46.729 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.729 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.729 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:46.729 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.006845+0000", 2023-09-30T17:04:46.729 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000152817 2023-09-30T17:04:46.729 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.729 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.729 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:46.730 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.023168+0000", 2023-09-30T17:04:46.730 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.016322962999999999 2023-09-30T17:04:46.730 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.730 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.730 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:46.730 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.082373+0000", 2023-09-30T17:04:46.730 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.059204869 2023-09-30T17:04:46.730 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.730 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.730 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:46.730 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.082429+0000", 2023-09-30T17:04:46.731 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.5671000000000003e-05 2023-09-30T17:04:46.731 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.731 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.731 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:46.731 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.082464+0000", 2023-09-30T17:04:46.731 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5911999999999998e-05 2023-09-30T17:04:46.731 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:46.731 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:46.731 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:46.731 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.731 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.731 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165988 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 2596864~4096,write 3084288~4096,write 3141632~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:46.732 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.342979+0000", 2023-09-30T17:04:46.732 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 15.297137172999999, 2023-09-30T17:04:46.732 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75803858099999999, 2023-09-30T17:04:46.732 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:46.732 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:46.732 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:46.732 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:46.732 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:46.732 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165988 2023-09-30T17:04:46.732 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.732 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:46.733 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.733 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:46.733 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.342979+0000", 2023-09-30T17:04:46.733 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:46.733 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.733 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.733 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:46.733 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.342979+0000", 2023-09-30T17:04:46.733 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:46.733 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.733 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.733 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:46.734 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.342980+0000", 2023-09-30T17:04:46.734 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.018e-06 2023-09-30T17:04:46.734 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.734 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.734 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:46.734 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.342994+0000", 2023-09-30T17:04:46.734 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4819e-05 2023-09-30T17:04:46.734 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.734 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.734 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:46.734 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.343005+0000", 2023-09-30T17:04:46.735 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.0552e-05 2023-09-30T17:04:46.735 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.735 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.735 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:46.735 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.343012+0000", 2023-09-30T17:04:46.735 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.888e-06 2023-09-30T17:04:46.735 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.735 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.735 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:46.735 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.018485+0000", 2023-09-30T17:04:46.735 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67547272199999997 2023-09-30T17:04:46.735 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.736 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.736 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:46.736 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.018573+0000", 2023-09-30T17:04:46.736 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.8243000000000002e-05 2023-09-30T17:04:46.736 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.736 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.736 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:46.736 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.018779+0000", 2023-09-30T17:04:46.736 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00020640599999999999 2023-09-30T17:04:46.736 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.736 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.737 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:46.737 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.034608+0000", 2023-09-30T17:04:46.737 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.015828519999999999 2023-09-30T17:04:46.737 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.737 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.737 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:46.737 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.100930+0000", 2023-09-30T17:04:46.737 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.066322504000000004 2023-09-30T17:04:46.737 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.737 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.737 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:46.737 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.100981+0000", 2023-09-30T17:04:46.738 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0946000000000003e-05 2023-09-30T17:04:46.738 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.738 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.738 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:46.738 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.101017+0000", 2023-09-30T17:04:46.738 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5963000000000001e-05 2023-09-30T17:04:46.738 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:46.738 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:46.738 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:46.738 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.738 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.739 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:165998 4.36 4:6fa85f86:::100000001f8.00000013:head [write 1470464~4096,write 1576960~4096,write 1806336~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:46.739 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.343107+0000", 2023-09-30T17:04:46.739 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 15.297008757, 2023-09-30T17:04:46.739 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75779366699999995, 2023-09-30T17:04:46.739 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:46.739 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:46.739 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:46.739 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:46.739 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:46.739 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 165998 2023-09-30T17:04:46.739 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.739 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:46.740 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.740 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:46.740 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.343107+0000", 2023-09-30T17:04:46.740 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:46.740 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.740 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.740 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:46.740 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.343107+0000", 2023-09-30T17:04:46.740 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:46.740 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.740 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.741 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:46.741 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.346167+0000", 2023-09-30T17:04:46.741 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.003060349 2023-09-30T17:04:46.741 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.741 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.741 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:46.741 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.346188+0000", 2023-09-30T17:04:46.741 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 2.0894e-05 2023-09-30T17:04:46.741 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.741 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.741 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:46.742 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.346201+0000", 2023-09-30T17:04:46.742 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2424e-05 2023-09-30T17:04:46.742 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.742 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.742 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:46.742 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.346209+0000", 2023-09-30T17:04:46.742 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.1980000000000001e-06 2023-09-30T17:04:46.742 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.742 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.742 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:46.742 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.018506+0000", 2023-09-30T17:04:46.743 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67229752899999995 2023-09-30T17:04:46.743 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.743 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.743 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:46.743 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.018582+0000", 2023-09-30T17:04:46.743 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.538e-05 2023-09-30T17:04:46.743 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.743 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.743 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:46.743 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.018756+0000", 2023-09-30T17:04:46.743 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000174611 2023-09-30T17:04:46.744 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.744 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.744 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:46.744 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.034599+0000", 2023-09-30T17:04:46.744 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.015843166999999998 2023-09-30T17:04:46.744 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.744 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.744 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:46.744 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.100806+0000", 2023-09-30T17:04:46.744 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.066206047000000004 2023-09-30T17:04:46.744 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.745 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.745 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:46.745 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.100863+0000", 2023-09-30T17:04:46.745 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7843999999999997e-05 2023-09-30T17:04:46.745 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.745 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.745 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:46.745 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.100901+0000", 2023-09-30T17:04:46.745 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7224000000000001e-05 2023-09-30T17:04:46.745 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:46.745 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:46.745 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:46.746 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.746 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.746 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:166011 4.6 4:63e80496:::100000001f8.0000001e:head [write 561152~8192,write 663552~4096,write 851968~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:46.746 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.350327+0000", 2023-09-30T17:04:46.746 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 15.289788709, 2023-09-30T17:04:46.746 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75701292499999995, 2023-09-30T17:04:46.746 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:46.746 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:46.746 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:46.746 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:46.747 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:46.747 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 166011 2023-09-30T17:04:46.747 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.747 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:46.747 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.747 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:46.747 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.350327+0000", 2023-09-30T17:04:46.747 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:46.747 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.747 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.747 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:46.747 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.350327+0000", 2023-09-30T17:04:46.748 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:46.748 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.748 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.748 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:46.748 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.350327+0000", 2023-09-30T17:04:46.748 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.9799999999999999e-07 2023-09-30T17:04:46.748 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.748 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.748 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:46.748 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.350345+0000", 2023-09-30T17:04:46.748 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7237000000000001e-05 2023-09-30T17:04:46.749 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.749 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.749 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:46.749 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.350351+0000", 2023-09-30T17:04:46.749 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.489e-06 2023-09-30T17:04:46.749 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.749 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.749 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:46.749 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.350357+0000", 2023-09-30T17:04:46.749 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7300000000000002e-06 2023-09-30T17:04:46.749 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.750 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.750 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:46.750 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.026726+0000", 2023-09-30T17:04:46.750 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.676369636 2023-09-30T17:04:46.750 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.750 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.750 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:46.750 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.026803+0000", 2023-09-30T17:04:46.750 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.6885999999999995e-05 2023-09-30T17:04:46.750 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.750 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.750 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:46.751 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.026961+0000", 2023-09-30T17:04:46.751 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015803799999999999 2023-09-30T17:04:46.751 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.751 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.751 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:46.751 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.037169+0000", 2023-09-30T17:04:46.751 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.010207748000000001 2023-09-30T17:04:46.751 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.751 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.751 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:46.751 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.107238+0000", 2023-09-30T17:04:46.751 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.070069305999999998 2023-09-30T17:04:46.752 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.752 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.752 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:46.752 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.107299+0000", 2023-09-30T17:04:46.752 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.0757999999999997e-05 2023-09-30T17:04:46.752 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.752 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.752 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:46.752 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.107340+0000", 2023-09-30T17:04:46.752 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.0698999999999998e-05 2023-09-30T17:04:46.752 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:46.753 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:46.753 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:46.753 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.753 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.753 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:166057 4.6 4:63e80496:::100000001f8.0000001e:head [write 3416064~4096,write 3485696~4096,write 3571712~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:46.753 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.366264+0000", 2023-09-30T17:04:46.753 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 15.273851874, 2023-09-30T17:04:46.753 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.76104848700000005, 2023-09-30T17:04:46.753 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:46.753 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:46.753 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:46.753 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:46.753 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:46.754 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 166057 2023-09-30T17:04:46.754 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.754 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:46.754 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.754 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:46.754 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.366264+0000", 2023-09-30T17:04:46.754 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:46.754 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.754 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.754 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:46.754 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.366264+0000", 2023-09-30T17:04:46.755 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:46.756 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.756 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.756 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:46.756 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.366264+0000", 2023-09-30T17:04:46.756 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.03e-07 2023-09-30T17:04:46.756 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.756 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.756 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:46.756 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.366276+0000", 2023-09-30T17:04:46.756 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.1712999999999999e-05 2023-09-30T17:04:46.757 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.757 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.757 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:46.757 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.366282+0000", 2023-09-30T17:04:46.757 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3049999999999998e-06 2023-09-30T17:04:46.757 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.757 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.757 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:46.757 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.366287+0000", 2023-09-30T17:04:46.757 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7589999999999997e-06 2023-09-30T17:04:46.757 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.758 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.758 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:46.758 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.042061+0000", 2023-09-30T17:04:46.758 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67577395500000004 2023-09-30T17:04:46.758 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.758 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.758 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:46.758 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.042141+0000", 2023-09-30T17:04:46.758 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.9777999999999994e-05 2023-09-30T17:04:46.758 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.758 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.758 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:46.759 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.042323+0000", 2023-09-30T17:04:46.759 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000181783 2023-09-30T17:04:46.759 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.759 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.759 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:46.759 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.072114+0000", 2023-09-30T17:04:46.759 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.029791108 2023-09-30T17:04:46.759 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.759 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.759 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:46.759 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.127224+0000", 2023-09-30T17:04:46.760 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.055110065 2023-09-30T17:04:46.760 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.760 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.760 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:46.760 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.127276+0000", 2023-09-30T17:04:46.760 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.2574999999999997e-05 2023-09-30T17:04:46.760 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.760 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.760 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:46.760 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.127312+0000", 2023-09-30T17:04:46.760 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.6043e-05 2023-09-30T17:04:46.761 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:46.761 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:46.761 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:46.761 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.761 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.761 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:166062 4.36 4:6fa85f86:::100000001f8.00000013:head [write 1110016~4096,write 1118208~4096,write 1155072~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:46.761 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.370231+0000", 2023-09-30T17:04:46.761 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 15.269884716, 2023-09-30T17:04:46.761 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75721686499999996, 2023-09-30T17:04:46.761 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:46.761 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:46.761 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:46.762 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:46.762 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:46.762 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 166062 2023-09-30T17:04:46.762 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.762 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:46.762 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.762 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:46.762 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.370231+0000", 2023-09-30T17:04:46.762 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:46.762 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.762 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.763 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:46.763 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.370231+0000", 2023-09-30T17:04:46.763 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:46.763 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.763 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.763 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:46.763 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.370232+0000", 2023-09-30T17:04:46.763 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.68e-07 2023-09-30T17:04:46.763 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.763 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.763 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:46.764 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.370247+0000", 2023-09-30T17:04:46.764 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.5440000000000001e-05 2023-09-30T17:04:46.764 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.764 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.764 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:46.764 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.370262+0000", 2023-09-30T17:04:46.764 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4976e-05 2023-09-30T17:04:46.764 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.764 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.764 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:46.764 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.370268+0000", 2023-09-30T17:04:46.765 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.4930000000000003e-06 2023-09-30T17:04:46.765 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.765 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.765 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:46.765 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.042052+0000", 2023-09-30T17:04:46.765 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67178386199999995 2023-09-30T17:04:46.765 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.765 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.765 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:46.765 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.042140+0000", 2023-09-30T17:04:46.765 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 8.7874000000000006e-05 2023-09-30T17:04:46.766 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.766 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.766 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:46.766 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.042321+0000", 2023-09-30T17:04:46.766 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00018131500000000001 2023-09-30T17:04:46.766 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.766 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.766 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:46.766 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.054880+0000", 2023-09-30T17:04:46.766 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.012558625 2023-09-30T17:04:46.766 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.766 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.767 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:46.767 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.127361+0000", 2023-09-30T17:04:46.767 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.072481183000000005 2023-09-30T17:04:46.767 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.767 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.767 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:46.767 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.127412+0000", 2023-09-30T17:04:46.767 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0861e-05 2023-09-30T17:04:46.767 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.767 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.767 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:46.767 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.127448+0000", 2023-09-30T17:04:46.768 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.5667999999999998e-05 2023-09-30T17:04:46.768 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:46.768 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:46.768 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:46.768 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.768 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.768 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:166063 4.36 4:6da220e6:::100000001f8.0000003f:head [write 2469888~4096,write 2543616~4096,write 2551808~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:46.768 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.370278+0000", 2023-09-30T17:04:46.768 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 15.269837279000001, 2023-09-30T17:04:46.768 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75730261499999996, 2023-09-30T17:04:46.768 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:46.769 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:46.769 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:46.769 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:46.769 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:46.769 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 166063 2023-09-30T17:04:46.769 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.769 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:46.769 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.769 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:46.769 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.370278+0000", 2023-09-30T17:04:46.769 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:46.769 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.770 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.770 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:46.770 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.370278+0000", 2023-09-30T17:04:46.770 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:46.770 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.770 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.770 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:46.770 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.374164+0000", 2023-09-30T17:04:46.770 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.0038854319999999999 2023-09-30T17:04:46.770 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.770 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.770 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:46.771 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.374182+0000", 2023-09-30T17:04:46.771 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.8363999999999999e-05 2023-09-30T17:04:46.771 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.771 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.771 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:46.771 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.374195+0000", 2023-09-30T17:04:46.771 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.2328e-05 2023-09-30T17:04:46.771 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.771 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.771 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:46.771 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.374202+0000", 2023-09-30T17:04:46.772 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.4189999999999996e-06 2023-09-30T17:04:46.772 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.772 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.772 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:46.772 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.045487+0000", 2023-09-30T17:04:46.772 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67128463800000004 2023-09-30T17:04:46.772 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.772 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.772 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:46.772 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.045558+0000", 2023-09-30T17:04:46.772 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1408999999999993e-05 2023-09-30T17:04:46.772 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.773 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.773 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:46.773 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.045711+0000", 2023-09-30T17:04:46.773 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.00015323299999999999 2023-09-30T17:04:46.773 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.773 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.773 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:46.773 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.072119+0000", 2023-09-30T17:04:46.773 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.026407824 2023-09-30T17:04:46.773 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.773 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.773 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:46.774 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.127486+0000", 2023-09-30T17:04:46.774 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.055366591999999999 2023-09-30T17:04:46.774 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.774 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.774 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:46.774 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.127543+0000", 2023-09-30T17:04:46.774 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.7685000000000001e-05 2023-09-30T17:04:46.774 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.774 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.774 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:46.774 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.127581+0000", 2023-09-30T17:04:46.775 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.7691000000000002e-05 2023-09-30T17:04:46.775 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:46.775 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:46.775 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:46.775 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.775 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.775 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:166072 4.36 4:6da220e6:::100000001f8.0000003f:head [write 1822720~4096,write 2002944~4096,write 2072576~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:46.775 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.376908+0000", 2023-09-30T17:04:46.775 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 15.263207266, 2023-09-30T17:04:46.775 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75774445099999999, 2023-09-30T17:04:46.775 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:46.775 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:46.776 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:46.776 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:46.776 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:46.776 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 166072 2023-09-30T17:04:46.776 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.776 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:46.776 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.776 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:46.776 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.376908+0000", 2023-09-30T17:04:46.776 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:46.776 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.777 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.777 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:46.777 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.376908+0000", 2023-09-30T17:04:46.777 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:46.777 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.777 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.777 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:46.777 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.376909+0000", 2023-09-30T17:04:46.777 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 6.3900000000000004e-07 2023-09-30T17:04:46.777 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.777 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.777 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:46.778 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.376927+0000", 2023-09-30T17:04:46.778 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.7503000000000002e-05 2023-09-30T17:04:46.778 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.778 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.778 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:46.778 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.376936+0000", 2023-09-30T17:04:46.778 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 9.1209999999999996e-06 2023-09-30T17:04:46.778 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.778 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.778 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:46.778 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.376943+0000", 2023-09-30T17:04:46.779 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.0979999999999996e-06 2023-09-30T17:04:46.779 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.779 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.779 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:46.779 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.048561+0000", 2023-09-30T17:04:46.779 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.67161849299999998 2023-09-30T17:04:46.779 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.779 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.779 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:46.779 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.048634+0000", 2023-09-30T17:04:46.779 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.3085999999999998e-05 2023-09-30T17:04:46.779 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.780 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.780 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:46.780 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.048777+0000", 2023-09-30T17:04:46.780 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000143067 2023-09-30T17:04:46.780 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.780 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.780 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:46.780 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.072125+0000", 2023-09-30T17:04:46.780 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.023347178999999999 2023-09-30T17:04:46.780 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.780 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.780 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:46.781 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.134554+0000", 2023-09-30T17:04:46.781 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.062429739999999997 2023-09-30T17:04:46.781 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.781 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.781 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:46.781 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.134605+0000", 2023-09-30T17:04:46.781 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.0278000000000002e-05 2023-09-30T17:04:46.781 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.781 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.781 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:46.781 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.134653+0000", 2023-09-30T17:04:46.781 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.8247000000000001e-05 2023-09-30T17:04:46.782 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:46.782 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:46.782 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:46.782 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.782 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.782 INFO:teuthology.orchestra.run.smithi031.stdout: "description": "osd_op(client.4547.0:166086 4.2e 4:75be0f36:::100000001f8.0000003d:head [write 1073152~4096,write 1261568~4096,write 1273856~4096] snapc 1=[] ondisk+write+known_if_redirected+supports_pool_eio e56)", 2023-09-30T17:04:46.782 INFO:teuthology.orchestra.run.smithi031.stdout: "initiated_at": "2023-09-30T17:04:31.387018+0000", 2023-09-30T17:04:46.782 INFO:teuthology.orchestra.run.smithi031.stdout: "age": 15.253097721, 2023-09-30T17:04:46.782 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.75505913000000002, 2023-09-30T17:04:46.782 INFO:teuthology.orchestra.run.smithi031.stdout: "type_data": { 2023-09-30T17:04:46.782 INFO:teuthology.orchestra.run.smithi031.stdout: "flag_point": "commit sent; apply or cleanup", 2023-09-30T17:04:46.783 INFO:teuthology.orchestra.run.smithi031.stdout: "client_info": { 2023-09-30T17:04:46.783 INFO:teuthology.orchestra.run.smithi031.stdout: "client": "client.4547", 2023-09-30T17:04:46.783 INFO:teuthology.orchestra.run.smithi031.stdout: "client_addr": "192.168.0.1:0/425808627", 2023-09-30T17:04:46.783 INFO:teuthology.orchestra.run.smithi031.stdout: "tid": 166086 2023-09-30T17:04:46.783 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.783 INFO:teuthology.orchestra.run.smithi031.stdout: "events": [ 2023-09-30T17:04:46.783 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.783 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "initiated", 2023-09-30T17:04:46.783 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.387018+0000", 2023-09-30T17:04:46.783 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:46.783 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.783 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.784 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "header_read", 2023-09-30T17:04:46.784 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.387018+0000", 2023-09-30T17:04:46.784 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0 2023-09-30T17:04:46.784 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.784 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.784 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "throttled", 2023-09-30T17:04:46.784 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.387018+0000", 2023-09-30T17:04:46.784 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.13e-07 2023-09-30T17:04:46.784 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.784 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.784 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "all_read", 2023-09-30T17:04:46.784 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.387033+0000", 2023-09-30T17:04:46.785 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 1.4718999999999999e-05 2023-09-30T17:04:46.785 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.785 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.785 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "dispatched", 2023-09-30T17:04:46.785 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.387041+0000", 2023-09-30T17:04:46.785 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.8779999999999998e-06 2023-09-30T17:04:46.785 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.785 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.785 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "queued_for_pg", 2023-09-30T17:04:46.785 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:31.387047+0000", 2023-09-30T17:04:46.785 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 5.9689999999999999e-06 2023-09-30T17:04:46.786 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.786 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.786 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "reached_pg", 2023-09-30T17:04:46.786 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.056572+0000", 2023-09-30T17:04:46.786 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.66952481200000002 2023-09-30T17:04:46.786 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.786 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.786 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "started", 2023-09-30T17:04:46.786 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.056644+0000", 2023-09-30T17:04:46.786 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 7.1695999999999999e-05 2023-09-30T17:04:46.786 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.786 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.787 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "waiting for subops from 1", 2023-09-30T17:04:46.787 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.056746+0000", 2023-09-30T17:04:46.787 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.000102864 2023-09-30T17:04:46.787 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.787 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.787 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "op_commit", 2023-09-30T17:04:46.787 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.085374+0000", 2023-09-30T17:04:46.787 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.028627717 2023-09-30T17:04:46.787 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.787 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.787 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "sub_op_commit_rec", 2023-09-30T17:04:46.788 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.141996+0000", 2023-09-30T17:04:46.788 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 0.056622290999999998 2023-09-30T17:04:46.788 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.788 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.788 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "commit_sent", 2023-09-30T17:04:46.788 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.142044+0000", 2023-09-30T17:04:46.788 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 4.7939000000000003e-05 2023-09-30T17:04:46.788 INFO:teuthology.orchestra.run.smithi031.stdout: }, 2023-09-30T17:04:46.788 INFO:teuthology.orchestra.run.smithi031.stdout: { 2023-09-30T17:04:46.788 INFO:teuthology.orchestra.run.smithi031.stdout: "event": "done", 2023-09-30T17:04:46.788 INFO:teuthology.orchestra.run.smithi031.stdout: "time": "2023-09-30T17:04:32.142077+0000", 2023-09-30T17:04:46.788 INFO:teuthology.orchestra.run.smithi031.stdout: "duration": 3.2731999999999998e-05 2023-09-30T17:04:46.789 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:46.789 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:46.789 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:46.789 INFO:teuthology.orchestra.run.smithi031.stdout: } 2023-09-30T17:04:46.789 INFO:teuthology.orchestra.run.smithi031.stdout: ] 2023-09-30T17:04:46.789 INFO:teuthology.orchestra.run.smithi031.stdout:} 2023-09-30T17:04:46.790 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:46.790+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:46.791 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:04:46.891 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:46.890+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:46.947 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:04:46.948 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:04:46.948 INFO:teuthology.orchestra.run.smithi072.stdout: "num_ops": 0 2023-09-30T17:04:46.948 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:04:46.949 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:04:47.032 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:47.031+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:47.092 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:47.091+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:47.108 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2023-09-30T17:04:47.114 INFO:teuthology.orchestra.run.smithi072.stdout:{ 2023-09-30T17:04:47.114 INFO:teuthology.orchestra.run.smithi072.stdout: "ops": [], 2023-09-30T17:04:47.114 INFO:teuthology.orchestra.run.smithi072.stdout: "complaint_time": 30, 2023-09-30T17:04:47.115 INFO:teuthology.orchestra.run.smithi072.stdout: "num_blocked_ops": 0 2023-09-30T17:04:47.115 INFO:teuthology.orchestra.run.smithi072.stdout:} 2023-09-30T17:04:47.125 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:04:47.133 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi007.front.sepia.ceph.com 2023-09-30T17:04:47.133 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T17:04:47.133 DEBUG:teuthology.orchestra.run.smithi007:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-09-30T17:04:47.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T17:04:47.177 DEBUG:teuthology.orchestra.run.smithi007:> ip netns list 2023-09-30T17:04:47.192 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~120s 2023-09-30T17:04:47.209 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:47.208+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:47.234 INFO:teuthology.orchestra.run.smithi007.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-09-30T17:04:47.237 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T17:04:47.237 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-09-30T17:04:47.264 INFO:teuthology.orchestra.run.smithi007.stdout:osd.0: {} 2023-09-30T17:04:47.283 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is set 2023-09-30T17:04:47.290 INFO:teuthology.orchestra.run.smithi007.stdout:osd.1: {} 2023-09-30T17:04:47.291 INFO:teuthology.orchestra.run.smithi007.stderr:osd.0: osd_enable_op_tracker = 'false' 2023-09-30T17:04:47.291 INFO:teuthology.orchestra.run.smithi007.stderr:osd.1: osd_enable_op_tracker = 'false' 2023-09-30T17:04:47.291 INFO:teuthology.orchestra.run.smithi007.stderr:Error ENXIO: problem getting command descriptions from osd.2 2023-09-30T17:04:47.293 INFO:tasks.ceph.osd.0.smithi031.stderr:2023-09-30T17:04:47.294+0000 7fd724e5a700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 96768) UID: 0 2023-09-30T17:04:47.294 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:47.294 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:47.296 DEBUG:teuthology.orchestra.run:got remote process result: 6 2023-09-30T17:04:47.297 INFO:tasks.thrashosds.thrasher:Failed to tell all osds, ignoring 2023-09-30T17:04:47.305 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2023-09-30T17:04:47.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-09-30T17:04:47.310 DEBUG:teuthology.orchestra.run.smithi007:> sudo ip link delete ceph-brx 2023-09-30T17:04:47.394 INFO:tasks.ceph.osd.1.smithi072.stderr:2023-09-30T17:04:47.394+0000 7f81c8f9f700 -1 received signal: Hangup from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 96802) UID: 0 2023-09-30T17:04:47.414 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2023-09-30T17:04:47.423 INFO:tasks.thrashosds:joining thrashosds 2023-09-30T17:04:47.452 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:47.453 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:47.463 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2023-09-30T17:04:47.594 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:47.595 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:47.605 DEBUG:teuthology.orchestra.run.smithi031:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2023-09-30T17:04:47.736 INFO:teuthology.orchestra.run.smithi031.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:47.736 INFO:teuthology.orchestra.run.smithi031.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:47.746 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2023-09-30T17:04:47.878 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:47.878 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:47.888 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2023-09-30T17:04:48.014 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:48.014 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:48.023 DEBUG:teuthology.orchestra.run.smithi072:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2023-09-30T17:04:48.150 INFO:teuthology.orchestra.run.smithi072.stdout:ERROR: (22) Invalid argument 2023-09-30T17:04:48.150 INFO:teuthology.orchestra.run.smithi072.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2023-09-30T17:04:49.299 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2023-09-30T17:04:50.416 INFO:teuthology.orchestra.run.smithi007.stderr:noscrub is unset 2023-09-30T17:04:50.429 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2023-09-30T17:04:51.420 INFO:teuthology.orchestra.run.smithi007.stderr:nodeep-scrub is unset 2023-09-30T17:04:52.833 DEBUG:teuthology.orchestra.console.smithi134:expect before: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter th                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 88 6D E9 GUID: 00000000 0000 0000 0000 0CC47AD938E6 DHCP./                    DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ CLIENT IP: 172.21.15.134 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:88:6d:e9)... Configuring (net0 0c:c4:7a:88:6d:e9).... Configuring (net0 0c:c4:7a:88:6d:e9)..... Configuring (net0 0c:c4:7a:88:6d:e9)...... ok .   [?25lUse the ^ and v keys to change the selection. Press 'e' to edit the selected item, or 'c' for a command prompt.   Red Hat Enterprise Linux (4.18.0-372.9.1.el8.x86_64) 8.6 (Ootpa)  Red Hat Enterprise Linux (0-rescue-5a84457b7b52416e95d47d02e2e4a60f) 8.6>                The selected entry will be started automatically in 5s.             Use the * and * keys to change the selection.  Press 'e' to edit the selected item, or 'c' for a command prompt.  The selected entry will be started automatically in 5s.   Red Hat Enterprise Linux (4.18.0-372.9.1.el8.x86_64) 8.6 (Ootpa)   Red Hat Enterprise Linux (0-rescue-5a84457b7b52416e95d47d02e2e4a60f) 8.6*  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h     Probing EDD (edd=off to disabl [ 0.000000] Linux version 4.18.0-372.9.1.el8.x86_64 (mockbuild@x86-vm-09.build.eng.bos.redhat.com) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-10) (GCC)) #1 SMP Fri Apr 15 22:12:19 EDT 2022 [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-4.18.0-372.9.1.el8.x86_64 root=UUID=78886b72-f581-4b1d-8578-0d8161fd4ca1 ro crashkernel=auto console=ttyS1,115200 console=tty0 console=ttyS1,115200 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ecbfff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f7e000-0x00000000798adfff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798ae000-0x0000000079d4afff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d4b000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0 12/17/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3500.288 MHz processor [ 0.000000] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0x78ecc max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000fda20-0x000fda2f] [ 0.000000] Using GB pages for direct mapping [ 0.000000] RAMDISK: [mem 0x3484f000-0x3641ffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F0580 000024 (v02 SUPERM) [ 0.000000] ACPI: XSDT 0x00000000798AE098 0000B4 (v01 01072009 AMI 00010013) [ 0.000000] ACPI: FACP 0x00000000798E15B0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: DSDT 0x00000000798AE1E8 0333C4 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.000000] ACPI: FACS 0x0000000079D49F80 000040 [ 0.000000] ACPI: APIC 0x00000000798E16C0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: FPDT 0x00000000798E1788 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: FIDT 0x00000000798E17D0 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: SPMI 0x00000000798E1870 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.000000] ACPI: MCFG 0x00000000798E18B0 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.000000] ACPI: UEFI 0x00000000798E18F0 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.000000] ACPI: HPET 0x00000000798E1938 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.000000] ACPI: WDDT 0x00000000798E1970 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.000000] ACPI: SSDT 0x00000000798E19B0 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.000000] ACPI: SSDT 0x00000000798F8B30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.000000] ACPI: SSDT 0x00000000798FB180 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.000000] ACPI: PRAD 0x00000000798FB1E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.000000] ACPI: DMAR 0x00000000798FB2F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.000000] ACPI: HEST 0x00000000798FB3B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: BERT 0x00000000798FB630 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: ERST 0x00000000798FB660 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: EINJ 0x00000000798FB890 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0x798e15b0-0x798e16bb] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0x798ae1e8-0x798e15ab] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0x79d49f80-0x79d49fbf] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0x798e16c0-0x798e1787] [ 0.000000] ACPI: Reserving FPDT table memory at [mem 0x798e1788-0x798e17cb] [ 0.000000] ACPI: Reserving FIDT table memory at [mem 0x798e17d0-0x798e186b] [ 0.000000] ACPI: Reserving SPMI table memory at [mem 0x798e1870-0x798e18af] [ 0.000000] ACPI: Reserving MCFG table memory at [mem 0x798e18b0-0x798e18eb] [ 0.000000] ACPI: Reserving UEFI table memory at [mem 0x798e18f0-0x798e1931] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0x798e1938-0x798e196f] [ 0.000000] ACPI: Reserving WDDT table memory at [mem 0x798e1970-0x798e19af] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798e19b0-0x798f8b2e] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798f8b30-0x798fb17b] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798fb180-0x798fb1e3] [ 0.000000] ACPI: Reserving PRAD table memory at [mem 0x798fb1e8-0x798fb2e9] [ 0.000000] ACPI: Reserving DMAR table memory at [mem 0x798fb2f0-0x798fb3ab] [ 0.000000] ACPI: Reserving HEST table memory at [mem 0x798fb3b0-0x798fb62b] [ 0.000000] ACPI: Reserving BERT table memory at [mem 0x798fb630-0x798fb65f] [ 0.000000] ACPI: Reserving ERST table memory at [mem 0x798fb660-0x798fb88f] [ 0.000000] ACPI: Reserving EINJ table memory at [mem 0x798fb890-0x798fb9bf] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.000000] Using crashkernel=auto, the size chosen is a best effort estimation. [ 0.000000] Reserving 192MB of memory at 1728MB for crashkernel (System RAM: 32654MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.000000] node 0: [mem 0x0000000000100000-0x0000000078ecbfff] [ 0.000000] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.000000] Zeroed struct page in unavailable ranges: 29098 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x408 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.000000] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.000000] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later) [ 0.000000] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0x78ecc000-0x78f7dfff] [ 0.000000] PM: Registered nosave memory: [mem 0x78f7e000-0x798adfff] [ 0.000000] PM: Registered nosave memory: [mem 0x798ae000-0x79d4afff] [ 0.000000] PM: Registered nosave memory: [mem 0x79d4b000-0x8fffffff] [ 0.000000] PM: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.000000] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on bare hardware [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.000000] percpu: Embedded 55 pages/cpu s188416 r8192 d28672 u262144 [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 8228752 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-4.18.0-372.9.1.el8.x86_64 root=UUID=78886b72-f581-4b1d-8578-0d8161fd4ca1 ro crashkernel=auto console=ttyS1,115200 console=tty0 console=ttyS1,115200 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] Memory: 1820652K/33438040K available (12293K kernel code, 5865K rwdata, 8292K rodata, 2520K init, 14348K bss, 869504K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.000000] Kernel/User page tables isolation: enabled [ 0.000000] ftrace: allocating 39999 entries in 157 pages [ 0.000000] ftrace: allocated 157 pages with 5 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.000000] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.000000] random: crng done (trusting CPU's manufacturer) [ 0.001000] Console: colour VGA+ 80x25 [ 0.001000] printk: console [tty0] enabled [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20210604 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 0.001000] APIC: Switch to symmetric I/O mode setup [ 0.001004] DMAR: Host address width 46 [ 0.002001] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 0.003004] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 0.004001] DMAR: RMRR base: 0x0000007ba75000 end: 0x0000007ba84fff [ 0.005001] DMAR: ATSR flags: 0x0 [ 0.006001] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 0.007002] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 0.008001] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 0.009001] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 0.010001] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 0.010002] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 0.013111] DMAR-IR: Enabled IRQ remapping in xapic mode [ 0.014000] x2apic: IRQ remapping doesn't support X2APIC mode [ 0.014469] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.019001] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x3274610cf39, max_idle_ns: 440795306388 ns [ 0.020001] Calibrating delay loop (skipped), value calculated using timer frequency.. 7000.57 BogoMIPS (lpj=3500288) [ 0.021000] pid_max: default: 32768 minimum: 301 [ 0.022020] LSM: Security Framework initializing [ 0.023007] Yama: becoming mindful. [ 0.024003] SELinux: Initializing. [ 0.026021] LSM support for eBPF active [ 0.032277] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, vmalloc) [ 0.035744] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, vmalloc) [ 0.037021] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.038076] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.039224] CPU0: Thermal monitoring enabled (TM1) [ 0.040041] process: using mwait in idle threads [ 0.041001] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 0.042000] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 0.043000] FEATURE SPEC_CTRL Not Present [ 0.044000] FEATURE IBPB_SUPPORT Not Present [ 0.045000] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 0.046001] Spectre V2 : Mitigation: Retpolines [ 0.047000] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 0.048000] Speculative Store Bypass: Vulnerable [ 0.049003] TAA: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.050000] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.051231] Freeing SMP alternatives memory: 36K [ 0.053916] smpboot: Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 0.156991] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 0.157100] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 0.158001] ... version: 3 [ 0.159000] ... bit width: 48 [ 0.160000] ... generic registers: 4 [ 0.161000] ... value mask: 0000ffffffffffff [ 0.162000] ... max period: 00007fffffffffff [ 0.163000] ... fixed-purpose events: 3 [ 0.164000] ... event mask: 000000070000000f [ 0.165027] rcu: Hierarchical SRCU implementation. [ 0.166838] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 0.168005] smp: Bringing up secondary CPUs ... [ 0.169065] x86: Booting SMP configuration: [ 0.170001] .... node #0, CPUs: #1 #2 #3 #4 [ 0.173337] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 0.175000] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 0.177049] #5 #6 #7 [ 0.178547] smp: Brought up 1 node, 8 CPUs [ 0.180001] smpboot: Max logical packages: 1 [ 0.181000] smpboot: Total of 8 processors activated (56004.60 BogoMIPS) [ 0.223020] node 0 deferred pages initialised in 40ms [ 0.229032] devtmpfs: initialized [ 0.230040] x86/mm: Memory block size: 128MB [ 0.233331] ACPI: PM: Registering ACPI NVS region [mem 0x798ae000-0x79d4afff] (4837376 bytes) [ 0.235082] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.244007] futex hash table entries: 2048 (order: 5, 131072 bytes, vmalloc) [ 0.252061] pinctrl core: initialized pinctrl subsystem [ 0.257119] NET: Registered protocol family 16 [ 0.262081] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 0.269010] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.277008] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.285008] audit: initializing netlink subsys (disabled) [ 0.290008] audit: type=2000 audit(1696093464.290:1): state=initialized audit_enabled=0 res=1 [ 0.299002] cpuidle: using governor menu [ 0.303022] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 0.311001] ACPI: bus type PCI registered [ 0.315001] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.321043] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 0.331001] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 0.338011] PCI: Using configuration type 1 for base access [ 0.345048] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.352002] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.358022] cryptd: max_cpu_qlen set to 1000 [ 0.363064] ACPI: Added _OSI(Module Device) [ 0.367001] ACPI: Added _OSI(Processor Device) [ 0.372000] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.376000] ACPI: Added _OSI(Processor Aggregator Device) [ 0.382001] ACPI: Added _OSI(Linux-Dell-Video) [ 0.386000] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 0.392000] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 0.426620] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 0.435645] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 0.445094] ACPI: Dynamic OEM Table Load: [ 0.465227] ACPI: Interpreter enabled [ 0.466011] ACPI: PM: (supports S0 S4 S5) [ 0.467000] ACPI: Using IOAPIC for interrupt routing [ 0.468017] HEST: Enabling Firmware First mode for corrected errors. [ 0.469073] HEST: Table parsing has been initialized. [ 0.470001] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.471547] ACPI: Enabled 5 GPEs in block 00 to 3F [ 0.495538] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 0.496003] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 0.498483] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 0.500108] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 0.501000] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 0.502028] PCI host bridge to bus 0000:ff [ 0.503001] pci_bus 0000:ff: root bus resource [bus ff] [ 0.504009] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 [ 0.505041] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 [ 0.506032] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 [ 0.508026] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 [ 0.509030] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 [ 0.510031] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 [ 0.511031] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 [ 0.512029] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 [ 0.513031] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 [ 0.514028] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 [ 0.515029] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 [ 0.516032] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 [ 0.517029] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 [ 0.518030] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 [ 0.519031] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 [ 0.520030] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 [ 0.521028] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 [ 0.522028] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 [ 0.523029] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 [ 0.524021] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 [ 0.525037] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 [ 0.526058] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 [ 0.527041] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 [ 0.528043] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 [ 0.529041] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 [ 0.530041] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 [ 0.531039] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 [ 0.532032] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 [ 0.533032] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 [ 0.534042] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 [ 0.535041] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 [ 0.536041] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 [ 0.537107] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 [ 0.538033] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 [ 0.539031] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 [ 0.541011] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 [ 0.542034] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 [ 0.543042] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 [ 0.544041] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 [ 0.545041] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 [ 0.546043] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 [ 0.547035] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 [ 0.548031] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 [ 0.549031] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 [ 0.550035] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 [ 0.551031] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 [ 0.552031] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 [ 0.553030] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 [ 0.554034] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 [ 0.555029] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 [ 0.556031] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 [ 0.557030] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 [ 0.558021] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 [ 0.559032] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 [ 0.560030] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 [ 0.563965] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 0.564002] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 0.565149] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 0.567179] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 0.568000] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 0.569243] PCI host bridge to bus 0000:00 [ 0.570001] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.571000] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 0.572000] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.573000] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 0.574001] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 0.575000] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 0.576000] pci_bus 0000:00: root bus resource [bus 00-fe] [ 0.577011] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 [ 0.578126] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 [ 0.579042] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 0.580109] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 [ 0.581042] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 0.583083] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 [ 0.584041] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 0.585099] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 [ 0.586007] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 0.587106] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 [ 0.588007] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 0.589106] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 [ 0.590007] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 0.591106] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 [ 0.592007] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 0.593105] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 [ 0.594007] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 0.595104] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 [ 0.596007] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 0.597106] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 [ 0.598007] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 0.599104] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 [ 0.600007] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 0.602033] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 [ 0.603091] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 [ 0.604113] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 [ 0.605088] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 [ 0.606005] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 0.607104] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 0.608185] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 0.609011] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 0.610006] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 0.611006] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 0.612006] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 0.613006] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 0.614006] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 0.615034] pci 0000:00:11.4: PME# supported from D3hot [ 0.616095] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 0.617013] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 0.618049] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 0.619087] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 0.620013] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 0.621050] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 0.622085] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 0.623013] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 0.624050] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 0.625096] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 0.626013] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 0.627072] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 0.628091] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 0.629064] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 0.630103] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 0.631066] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 0.632103] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 0.633066] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 0.634106] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 0.635013] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 0.636071] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 0.638045] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 0.639173] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 0.640009] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 0.641005] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 0.642005] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 0.643005] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 0.644005] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 0.645005] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 0.646029] pci 0000:00:1f.2: PME# supported from D3hot [ 0.647083] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 0.648013] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 0.649015] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 0.650195] acpiphp: Slot [1] registered [ 0.651013] pci 0000:00:01.0: PCI bridge to [bus 01] [ 0.652121] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 0.653008] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 0.654015] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 0.655004] pci 0000:02:00.0: enabling Extended Tags [ 0.656097] pci 0000:00:02.0: PCI bridge to [bus 02] [ 0.657002] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 0.658120] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 0.659009] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 0.660004] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 0.661009] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 0.662004] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 0.663036] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 0.664016] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 0.665000] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 0.666008] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 0.667000] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 0.668143] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 0.669009] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 0.670004] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 0.671009] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 0.672004] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 0.673036] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 0.674013] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 0.675000] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 0.676007] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 0.677000] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 0.678130] pci 0000:00:03.0: PCI bridge to [bus 03] [ 0.679001] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 0.680001] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 0.681002] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 0.682028] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 0.683058] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 0.684065] pci 0000:05:00.0: enabling Extended Tags [ 0.685069] pci 0000:05:00.0: supports D1 D2 [ 0.686000] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 0.687088] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 0.688002] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 0.689002] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 0.690047] pci_bus 0000:06: extended config space not accessible [ 0.691025] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 0.692022] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 0.693012] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 0.694012] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 0.695095] pci 0000:06:00.0: supports D1 D2 [ 0.696000] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 0.697105] pci 0000:05:00.0: PCI bridge to [bus 06] [ 0.698007] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 0.699004] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 0.700146] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 0.701017] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 0.702017] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 0.703009] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 0.704118] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 0.705034] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 0.706000] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 0.707020] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 0.708000] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 0.710036] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 0.711016] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 0.712017] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 0.713009] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 0.714113] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 0.715034] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 0.716000] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 0.717020] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 0.718000] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 0.719141] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 0.720002] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 0.721002] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 0.722003] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 0.723671] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 0.724035] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 0.725033] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 0.726033] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 0.727033] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 0.728000] ACPI: PCI: Interrupt link LNKE disabled [ 0.729033] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 0.730000] ACPI: PCI: Interrupt link LNKF disabled [ 0.731033] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 0.732000] ACPI: PCI: Interrupt link LNKG disabled [ 0.733033] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 0.734000] ACPI: PCI: Interrupt link LNKH disabled [ 0.736111] iommu: Default domain type: Passthrough [ 0.737017] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 0.738000] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 0.738001] pci 0000:06:00.0: vgaarb: bridge control possible [ 0.739000] vgaarb: loaded [ 0.740065] SCSI subsystem initialized [ 0.741014] ACPI: bus type USB registered [ 0.742009] usbcore: registered new interface driver usbfs [ 0.743006] usbcore: registered new interface driver hub [ 0.744015] usbcore: registered new device driver usb [ 0.745016] pps_core: LinuxPPS API ver. 1 registered [ 0.746000] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 0.747001] PTP clock support registered [ 0.749013] EDAC MC: Ver: 3.0.0 [ 0.750105] PCI: Using ACPI for IRQ routing [ 0.756961] NetLabel: Initializing [ 0.757000] NetLabel: domain hash size = 128 [ 0.758000] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 0.759012] NetLabel: unlabeled traffic allowed by default [ 0.760045] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 0.761001] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 0.764025] clocksource: Switched to clocksource tsc-early [ 0.778939] VFS: Disk quotas dquot_6.6.0 [ 0.782960] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 0.789972] pnp: PnP ACPI init [ 0.793458] system 00:01: [io 0x0500-0x057f] has been reserved [ 0.799463] system 00:01: [io 0x0400-0x047f] has been reserved [ 0.805470] system 00:01: [io 0x0580-0x059f] has been reserved [ 0.811473] system 00:01: [io 0x0600-0x061f] has been reserved [ 0.817471] system 00:01: [io 0x0880-0x0883] has been reserved [ 0.823467] system 00:01: [io 0x0800-0x081f] has been reserved [ 0.829466] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 0.836164] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 0.842855] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 0.849553] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 0.856245] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 0.862943] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 0.869644] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 0.876509] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 0.882511] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 0.888507] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 0.894505] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 0.900510] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 0.907250] pnp: PnP ACPI: found 5 devices [ 0.916751] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 0.925766] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 0.937354] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 0.945284] pci 0000:00:01.0: PCI bridge to [bus 01] [ 0.950334] pci 0000:00:02.0: PCI bridge to [bus 02] [ 0.955382] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 0.962253] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 0.969920] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 0.977940] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 0.985694] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 0.993799] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 1.001467] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 1.009484] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 1.017238] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 1.025343] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 1.033013] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 1.041028] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 1.048784] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 1.056888] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 1.064557] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 1.072572] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 1.080329] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 1.088434] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.093476] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.099650] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.106525] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.114373] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.119422] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.124468] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.130644] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.137523] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.142833] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.149006] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.155882] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 1.163728] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 1.171664] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 1.179509] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 1.187447] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.192489] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.198662] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.205536] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 1.213383] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 1.222526] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 1.228784] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 1.235040] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 1.241993] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 1.248952] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 1.255910] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 1.262870] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 1.269222] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 1.274877] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 1.281223] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.288549] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 1.294204] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.300550] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 1.306206] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.312551] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 1.318200] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 1.324544] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 1.331959] NET: Registered protocol family 2 [ 1.336604] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc) [ 1.345965] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, vmalloc) [ 1.354944] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc) [ 1.363470] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, vmalloc) [ 1.371163] TCP: Hash tables configured (established 262144 bind 65536) [ 1.377964] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, vmalloc) [ 1.385833] UDP hash table entries: 16384 (order: 7, 524288 bytes, vmalloc) [ 1.392949] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, vmalloc) [ 1.400538] NET: Registered protocol family 1 [ 1.404975] NET: Registered protocol family 44 [ 1.409581] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 1.433857] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x61f took 16582 usecs [ 1.457845] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x61f took 16088 usecs [ 1.465358] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 1.471892] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 1.480383] Unpacking initramfs... [ 1.760451] Freeing initrd memory: 28484K [ 1.764610] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 1.771132] software IO TLB: mapped [mem 0x0000000068000000-0x000000006c000000] (64MB) [ 1.779159] ACPI: bus type thunderbolt registered [ 1.797230] Initialise system trusted keyrings [ 1.801760] Key type blacklist registered [ 1.805871] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 1.813810] zbud: loaded [ 1.816687] pstore: using deflate compression [ 1.821316] Platform Keyring initialized [ 1.895322] NET: Registered protocol family 38 [ 1.899847] Key type asymmetric registered [ 1.904022] Asymmetric key parser 'x509' registered [ 1.908987] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 1.924278] io scheduler mq-deadline registered [ 1.928895] io scheduler kyber registered [ 1.933012] io scheduler bfq registered [ 1.936988] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 1.944282] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 1.950266] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 1.956241] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 1.962197] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 1.968156] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 1.974110] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 1.980070] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 1.987455] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 1.995929] ACPI: Power Button [PWRB] [ 1.999692] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 2.007213] ACPI: Power Button [PWRF] [ 2.012045] ERST: Error Record Serialization Table (ERST) support is initialized. [ 2.019662] pstore: Registered erst as persistent store backend [ 2.025815] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 2.033391] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 2.060325] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 2.088368] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 2.096150] Non-volatile memory driver v1.3 [ 2.100839] rdac: device handler registered [ 2.105155] hp_sw: device handler registered [ 2.109505] emc: device handler registered [ 2.113706] alua: device handler registered [ 2.118041] libphy: Fixed MDIO Bus: probed [ 2.122264] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 2.128875] ehci-pci: EHCI PCI platform driver [ 2.133493] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 2.138835] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 2.146345] ehci-pci 0000:00:1a.0: debug port 2 [ 2.154867] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 2.167037] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 2.172897] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 2.181263] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.188582] usb usb1: Product: EHCI Host Controller [ 2.193542] usb usb1: Manufacturer: Linux 4.18.0-372.9.1.el8.x86_64 ehci_hcd [ 2.200669] usb usb1: SerialNumber: 0000:00:1a.0 [ 2.205444] hub 1-0:1.0: USB hub found [ 2.209285] hub 1-0:1.0: 2 ports detected [ 2.213548] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 2.218893] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2 [ 2.226402] ehci-pci 0000:00:1d.0: debug port 2 [ 2.234919] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 2.247056] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 2.252917] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 2.261286] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.268607] usb usb2: Product: EHCI Host Controller [ 2.273564] usb usb2: Manufacturer: Linux 4.18.0-372.9.1.el8.x86_64 ehci_hcd [ 2.280693] usb usb2: SerialNumber: 0000:00:1d.0 [ 2.285466] hub 2-0:1.0: USB hub found [ 2.289297] hub 2-0:1.0: 2 ports detected [ 2.293483] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 2.299755] ohci-pci: OHCI PCI platform driver [ 2.304290] uhci_hcd: USB Universal Host Controller Interface driver [ 2.310835] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 2.316190] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 2.324740] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 2.334104] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 2.342472] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.349791] usb usb3: Product: xHCI Host Controller [ 2.354751] usb usb3: Manufacturer: Linux 4.18.0-372.9.1.el8.x86_64 xhci-hcd [ 2.361879] usb usb3: SerialNumber: 0000:00:14.0 [ 2.366667] hub 3-0:1.0: USB hub found [ 2.370508] hub 3-0:1.0: 15 ports detected [ 2.376341] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 2.381709] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 2.389208] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 2.395573] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 4.18 [ 2.403943] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.411269] usb usb4: Product: xHCI Host Controller [ 2.416227] usb usb4: Manufacturer: Linux 4.18.0-372.9.1.el8.x86_64 xhci-hcd [ 2.423356] usb usb4: SerialNumber: 0000:00:14.0 [ 2.428162] hub 4-0:1.0: USB hub found [ 2.432058] hub 4-0:1.0: 6 ports detected [ 2.437020] usbcore: registered new interface driver usbserial_generic [ 2.443638] usbserial: USB Serial support registered for generic [ 2.449751] i8042: PNP: No PS/2 controller found. [ 2.454576] mousedev: PS/2 mouse device common for all mice [ 2.460293] rtc_cmos 00:00: RTC can wake from S4 [ 2.465133] rtc_cmos 00:00: registered as rtc0 [ 2.469662] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram, hpet irqs [ 2.477427] intel_pstate: Intel P-state driver initializing [ 2.484031] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 2.484034] hid: raw HID events driver (C) Jiri Kosina [ 2.495904] usbcore: registered new interface driver usbhid [ 2.501558] usbhid: USB HID core driver [ 2.505595] drop_monitor: Initializing network drop monitor service [ 2.511979] Initializing XFRM netlink socket [ 2.516403] NET: Registered protocol family 10 [ 2.521132] Segment Routing with IPv6 [ 2.524882] NET: Registered protocol family 17 [ 2.529485] mpls_gso: MPLS GSO support [ 2.533699] microcodeg=0x406f1, pf=0x1, revision=0xb000010 [ 2.539703] microcode: Microcode Update Driver: v2.2. [ 2.539771] resctrl: L3 allocation detected [ 2.542029] usb 2-1: new high-speed USB device number 2 using ehci-pci [ 2.544905] resctrl: L3DATA allocation detected [ 2.560416] resctrl: L3CODE allocation detected [ 2.565023] resctrl: L3 monitoring detected [ 2.569304] AVX2 version of gcm_enc/dec engaged. [ 2.574005] AES CTR mode by8 optimization enabled [ 2.604385] sched_clock: Marking stable (2604380900, 0)->(5557189356, -2952808456) [ 2.612140] registered taskstats version 1 [ 2.616476] Loading compiled-in X.509 certificates [ 2.625352] usb 1-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 2.633638] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.641018] hub 1-1:1.0: USB hub found [ 2.645002] hub 1-1:1.0: 6 ports detected [ 2.646698] Loaded X.509 cert 'Red Hat Enterprise Liux kernel signing key: fcec8079a12caa6a157125702c0054357b4fc157' [ 2.649028] usb 3-12: new high-speed USB device number 2 using xhci_hcd [ 2.666790] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 2.677349] usb 2-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 2.678718] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 2.686733] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.697468] zswap: loaded using pool lzo/zbud [ 2.704883] hub 2-1:1.0: USB hub found [ 2.712994] page_owner is disabled [ 2.713097] hub 2-1:1.0: 8 ports detected [ 2.721204] Key type big_key registered [ 2.727483] Key type encrypted registered [ 2.731586] ima: No TPM chip found, activating TPM-bypass! [ 2.737158] ima: Allocated hash algorithm: sha256 [ 2.741951] ima: No architecture policies found [ 2.746569] evm: Initialising EVM extended attributes: [ 2.751793] evm: security.selinux [ 2.755192] evm: security.ima [ 2.758240] evm: security.capability [ 2.761898] evm: HMAC attrs: 0x1 [ 2.765507] rtc_cmos 00:00: setting system clock to 2023-09-30 17:04:30 UTC (1696093470) [ 2.774653] Freeing unused decrypted memory: 2036K [ 2.776220] usb 3-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 2.787903] usb 3-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.795475] hub 3-12:1.0: USB hub found [ 2.795544] Freeing unused kernel image (initmem) memory: 2520K [ 2.799476] hub 3-12:1.0: 4 ports detected [ 2.819096] Write protecting the kernel read-only data: 24576k [ 2.825365] Freeing unused kernel image (text/rodata gap) memory: 2012K [ 2.832347] Freeing unused kernel image (rodata/data gap) memory: 1948K [ 2.847029] tsc: Refined TSC clocksource calibration: 3499.996 MHz [ 2.853313] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734d20948, max_idle_ns: 440795306379 ns [ 2.853364] clocksource: Switched to clocksource tsc [ 2.868580] systemd[1]: systemd 239 (239-58.el8) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 2.903134] systemd[1]: Detected architecture x86-64. [ 2.908278] systemd[1]: Running in initial RAM disk. Welcome to Red Hat Enterprise Linux 8.6 (Ootpa) dracut-049-201.git20220131.el8 (Initramfs)! [ 2.932120] systemd[1]: Set hostname to . [ 2.976767] systemd[1]: Reached target Slices. [ OK ] Reached target Slices. [ 2.987318] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 2.999928] systemd[1]: Starting Apply Kernel Variables... Starting Apply Kernel Variables... [ 3.011488] systemd[1]: Started Memstrack Anylazing Service. [ OK ] Staice. [ 3.024emd[1]: Starting Create list of required static device nodes for the current kernel... Starting Create list of required st…ce nodes for the current kernel... [ 3.043128] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). Starting Journal Service... [ OK ] Listening on udev Kernel Socket. [ OK ] Listening on udev Control Socket. [ OK ] Reached target Sockets. [ OK ] Reached target Timers. Starting Setup Virtual Console... [ OK ] Reached target Swap. [ 3.103011] usb 3-12.1: new low-speed USB device number 3 using xhci_hcd [ l File Systems. Starting Creat. [ OK ] Started Journal Service. [ OK ] Started Apply Kernel Variables. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Setup Virtual Console. [ OK ] Started Create Volatile Files and Directories. Starting dracut cmdline hook... Starting Create Static Device Nodes in /dev... [ OK ] Started Create Static Device[ 3.213346] usb 3-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 3.221909] usb 3-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ OK ] Started dracut cmdline hook. [ 3.234699] i HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.0/0003:0557:2419.0001/input/input2 Starting dracut pre-udev hook... [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. Starting udev Coldplug all Devices... [ 3.298202] hneric 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 Mountin[ 3.310803] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.1/0003:0557:2419.0002/input/input3 g Kernel Configu[ 3.323484] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 ration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Started udev Coldplug all Devices. Starting Show Plymouth Boot Screen... Starting dracut initqueue hook... [[[ 3.420627] dca service started, version 1.12.1 0;32m OK ] Reached target System Initialization. [ OK ] Started Show Plymouth Boot Screen. [ OK ] Reached target Paths. [ OK ] Started Forward Password Requests to Plymouth [ 3.445332] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode Directory Watch.[ 3.446982] nvme nvme0: pci function 0000:02:00.0 [ OK [ 3.454252] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst ] Reached t[ 3.462698] nvme nvme0: 8/0/0 default/read/poll queues arget Basic Syst[ 3.476142] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver em. [ 3.476652] nvme0n1: detected capacity change from 0 to 400088457216 [ 3.483255] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 3.484571] scsi host0: ahci [ 3.490672] scsi host1: ahci [ 3.502111] igb: Intel(R) Gigabit Ethernet Network Driver [ 3.502119] scsi host2: ahci [ 3.507600] igb: Copyright (c) 2007-2014 Intel Corporation. [ 3.510720] scsi host3: ahci [ 3.519258] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 34 [ 3.526778] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 34 [ 3.526781] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 34 [ 3.526786] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 34 [ 3.527074] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 3.557594] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 3.572634] igb 0000:07:00.0: added PHC on eth0 [ 3.572921] scsi host4: ahci [ 3.577252] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 3.580352] scsi host5: ahci [ 3.587192] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:38:e6 [ 3.590268] scsi host6: ahci [ 3.597451] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 3.600457] scsi host7: ahci [ 3.605566] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 3.608639] scsi host8: ahci [ 3.619282] scsi host9: ahci [ 3.622321] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 54 [ 3.622465] ast 0000:06:00.0: [drm] Using P2A bridge for configuration [ 3.629835] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 54 [ 3.636463] ast 0000:06:00.0: [drm] AST 2400 detected [ 3.643958] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 54 [ 3.643960] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 54 [ 3.649125] ast 0000:06:00.0: [drm] Analog VGA only [ 3.656610] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 54 [ 3.656612] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 54 [ 3.664133] ast 0000:06:00.0: [drm] dram MCLK=408 Mhz type=1 bus_width=16 [ 3.671430] igb 0000:07:00.1: added PHC on eth1 [ 3.677509] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 3.684173] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 3.684174] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:38:e7 [ 3.717036] fbcon: astdrmfb (fb0) is primary device [ 3.717109] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 3.717110] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 3.719340] igb 0000:07:00.1 eno2: renamed from eth1 [ 3.829088] Console: switching to colour frame buffer device 128x48 [ 3.831418] igb 0000:07:00.0 eno1: renamed from eth0 [ 3.837711] ata2: SATA link down (SStatus 0 SControl 300) [ 3.838361] ata3: SATA link down (SStatus 0 SControl 300) [ 3.838729] ata1: SATA link down (SStatus 0 SControl 300) [ 3.838974] ata4: SATA link down (SStatus 0 SControl 300) [ 3.904166] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ 3.980300] ata9: SATA link down (SStatus 0 SControl 300) [ 3.985781] ata8: SATA link down (SStatus 0 SControl 300) [ 3.991264] ata10: SATA link down (SStatus 0 SControl 300) [ 3.996851] ata6: SATA link down (SStatus 0 SControl 300) [ 4.002372] ata7: SATA link down (SStatus 0 SControl 300) [ 4.007905] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 4.015802] ata5.00: NCQ Send/Recv Log not supported [ 4.020775] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 4.027049] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 4.035586] ata5.00: NCQ Send/Recv Log not supported [ 4.040564] ata5.00: configured for UDMA/133 [ 4.044952] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 [ 4.057971] scsi 4:0:0:0: Attached scsi generic sg0 type 0 [ 4.070562] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 4.078929] sd 4:0:0:0: [sda] Write Protect is off [ 4.084476] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 4.107556] sda: sda1 [ 4.111032] sd 4:0:0:0: [sda] Attached SCSI disk [ OK ] Found device ST1000NM0033-9ZM173 1. [ OK ] Reached target Initrd Root Device. [ 4.628278] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 4.639004] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 4.647969] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 4.654585] ixgbe 0000:03:00.0: 0c:c4:7a:88:6d:e8 [ 4.669084] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 4.676483] libphy: ixgbe-mdio: probed [ 4.860181] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 4.870897] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 4.879850] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 4.887331] ixgbe 0000:03:00.1: 0c:c4:7a:88:6d:e9 [ 4.906625] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 4.914712] libphy: ixgbe-mdio: probed [ 4.926798] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ 4.975305] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ OK ] Started dracut initqueue hook. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting File System Check on /dev/…b72-f581-4b1d-8578-0d8161fd4ca1... [ OK ] Started File System Check on /dev/d…86b72-f581-4b1d-8578-0d8161fd4ca1. Mounting /sysroot... [ 5.179166] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Timers. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped target Basic System. [ OK ] Stopped target Slices. [ OK ] Stopped target Sockets. [ OK ] Stopped target Paths. [ OK ] Stopped dracut initqueue hook. [ OK ] Stopped target System Initialization. Stopping udev Kernel Device Manager... [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped target Swap. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped target Local File Systems. Starting Setup Virtual Console... [ OK ] Stopped udev Coldplug all Devices. Starting Plymouth switch root service... [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Closed udev Kernel Socket. [ OK ] Closed udev Control Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Started Setup Virtual Console. [ OK ] Reached target Switch Root. [ OK ] Started Plymouth switch root service. Starting Switch Root... [ 5.633487] printk: systemd: 10 output lines suppressed due to ratelimiting [ 6.274319] SELinux: policy capability network_peer_controls=1 [ 6.280579] SELinux: policy capability open_perms=1 [ 6.285842] SELinux: policy capability extended_socket_class=1 [ 6.292057] SELinux: policy capability always_check_network=0 [ 6.298175] SELinux: policy capability cgroup_seclabel=1 [ 6.303860] SELinux: policy capability nnp_nosuid_transition=1 [ 6.332995] audit: type=1403 audit(1696093474.065:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 6.334495] systemd[1]: Successfully loaded SELinux policy in 223.437ms. [ 6.410830] systemd[1]: Relabelled /dev, /run and /sys/fs/cgroup in 19.242ms. [ 6.448552] systemd[1]: systemd 239 (239-58.el8) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 6.483067] systemd[1]: Detected architecture x86-64. Welcome to Red Hat Enterprise Linux 8.6 (Ootpa)! [ 6.501616] systemd[1]: Set hostname to . [ 7.502446] systemd[1]: systemd-journald.service: Succeeded. [ 7.524345] systemd[1]: initrd-switch-root.service: Succeeded. [ 7.532682] systemd[1]: Stopped Switch Root. [ OK [[ 7.538289] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. 0m] Stopped Swit[ 7.538384] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. ch Root. [ 7.538467] systemd[1]: Stopped Journal Service. [ OK [[ 7.567197] systemd[1]: Starting Journal Service... 0m] Stopped Journal Service. Starting Journal Service... [ OK ] Created slice User and Session Slice. [ OK ] Reached target Slices. Mounting Huge Pages File System... Starting Read and set NIS domainname from /etc/sysconfig/network... [ OK ] Reached target Swap. Mounting Kernel Debug File System... [ OK ] Created slice system-serial\x2dgetty.slice. Mounting POSIX Message Queue File System... [ OK ] Listening on LVM2 poll daemon socket. [ OK ] Created slice system-getty.slice. [ OK ] Listening on Process Core Dump Socket. [ OK ] Listening on udev Kernel Socket. [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd File Systems. Starting Setup Virtual Console... [ OK ] Listening on udev Control Socket. [ OK ] Created slice system-sshd\x2dkeygen.slice. Starting Create list of required st…ce nodes for the current kernel... [ OK ] Stopped Plymouth switch root service. [ OK ] Reached target ceph target allowing…ph-mon@.service instances at once. [ OK ] Reached target ceph target allowing…ph-mgr@.service instances at [ 7.687688] EXT4-fs (sda1): re-mounted. Opts: (null) once. [ OK ] Reached target ceph target allowing…ph-osd@.service instances at once. [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Reached target ceph target allowing…mirror@.service instances at once. [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Reached target Local Encrypted Volumes. Starting Remount Root and Kernel File Systems... [ OK ] Set up automount Arbitrary Executab…rmats File System Automount Point. [ OK ] Reached target ceph target allowing…ph-mds@.service instances at once. [ OK ] Listening on Device-mapper event daemon FIFOs. Starting Monitoring of LVM2 mirrors…ng dmeventd or progress polling... Starting Load Kernel Modules... [ OK ] Reached target ceph target allowing…adosgw@.service instances at once. Starting udev Coldplug all Devices... [ OK ] Stopped target Initrd Root File System. [ OK ] Started Journal Service. [ OK ] Mounted Huge Pages File System. [ OK ] Started Read and set NIS domainname from /etc/sysconfig/network. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Remount Root and Kernel File Syst[ 7.835561] fuse: init (API version 7.33) ems. Starting Load/Save Random Seed... Starting Flush Journal to Persistent Storage... Starting Create Static Device Nodes in /dev... [ OK ] Started Load/Save Random Seed. [ OK ] Started Flush Journal to Persi[ 7.863401] device-mapper: uevent: version 1.0.3 stent Storage. [ OK [ 7.870485] device-mapper: ioctl: 4.43.0-ioctl (2020-10-01) initialised: dm-devel@redhat.com [0m] Started Load Kernel Modules. Mounting FUSE Control File System... Starting Apply Kernel Variables... [ OK ] Mounted FUSE Control File System. [ OK ] Started udev Coldplug all Devices. [ OK ] Started Setup Virtual Console. [ OK ] Started Apply Kernel Variables. [ OK ] Started Monitoring of LVM2 mirrors,…sing dmeventd or progress polling. [ OK ] Started Create Static Device Nodes in /dev. Starting udev Kernel Device Manager... [ OK ] Reached target Local File Systems (Pre). [ OK ] Reached target Local File Systems. Starting Import network configuration from initramfs... Starting Restore /run/initramfs on shutdown... Starting Tell Plymouth To Write Out Runtime Data... [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Tell Plymouth To Write Out Runtime Data. [ OK ] Started Import network configuration from initramfs. Starting Create Volatile Files and Directories... [ OK ] Started udev Kernel Device Manager. [ OK ] Started Create Volatile Files and Directories. Starting RPC Bind... Mounting RPC Pipe File System... Starting Security Auditing Service... [ 8.440057] IPMI message handler: version 39.2 [ 8.450586] ipmi device interface [ 8.468901] ipmi_si: IPMI System Interface driver [ 8.474723] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS [ 8.477572] RPC: Registered named UNIX socket transport module. [ 8.482235] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 8.489184] RPC: Registered udp transport module. [ 8.489185] RPC: Registered tcp transport module. [ 8.489186] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 8.497319] ipmi_si: Adding SMBIOS-specified kcs state machine [ OK ] Started RPC [ 8.524221] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI Bind. [ OK [[ 8.539325] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 0m] Mounted RPC [ 8.544941] power_meter ACPI000D:00: Found ACPI power meter. Pipe File System[ 8.555877] power_meter ACPI000D:00: Ignoring unsafe software power cap! . [ OK ] Reached targ[ 8.565215] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI et rpc_pipefs.ta[ 8.565218] ipmi_si: Adding ACPI-specified kcs state machine rget. [ 8.565696] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 [ 8.594604] ioatdma: Intel(R) QuickData Technology Driver 5.00 [ OK ] Created slice system-lvm2\x2dpvscan.slice. Starting LVM event activation on device 259:0... [ 8.617612] igb 0000:07:00.0: DCA enabled [ 8.623051] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. [ 8.623080] igb 0000:07:00.1: DCA enabled [ 8.644381] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) [ 8.688466] ipmi_si IPI0001:00: IPMI kcs interface initialized [ 8.695600] mei_me 0000:00:16.0: Device doesn't have valid ME Interface [ 8.708672] ipmi_ssif: IPMI SSIF Interface driver [ 8.833157] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 8.833542] input: PC Speaker as /devices/platform/pcspkr/input/input4 [ OK ] Started Security Auditing Service. Starting Update UTMP about System Boot/Shutdown... [ OK ] Started Update UTMP about System Boot/Shutdown. [ 8.943280] iTCO_vendor_support: vendor-support=0 [ OK ] Found device /dev/vg_nvme/lv_5. [ 8.956871] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11 Mountin[ 8.963326] iTCO_wdt: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460) g /var/lib/ceph.[ 8.963614] iTCO_wdt: initialized. heartbeat=30 sec (nowayout=0) .. [ 8.972911] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer [ 8.988802] RAPL PMU: hw unit of domain package 2^-14 Joules [ 8.988803] RAPL PMU: hw unit of domain dram 2^-16 Joules [ OK ] Reached target System Initialization. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started Run system activity accounting tool every 10 minutes. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Started CUPS Scheduler. [ OK ] Reached target Paths. [ OK ] Started Generate summary of yesterday's process accounting. [ OK ] Listening on Avahi mDNS/DNS-SD Stack Activation Socket. [ OK ] Started Updates mlocate database every day. [ OK ] Reached target Timers. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Listening on CUPS Scheduler. [ OK ] Listening on SSSD Kerberos Cache Manager responder socket. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. Starting System Security Services Daemon... [ OK ] Started Machine Check Exception Logging Daemon. Starting NTP client/server... [ OK ] Started libstoragemgmt plug-in server daemon. Starting Self Monitoring and Reporting Technology (SMART) Daemon... Starting Resets System Activity Logs... Starting Authorization Manager... Starting Kernel Samepage Merging... Starting Avahi mDNS/DNS-SD Stack... [ OK ] Reached target sshd-keygen.target. [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target allowing… ceph*@.service instances at once. [ OK ] Started D-Bus System Message Bus. Starting Network Manager... [ 9.185520] SGI XFS with ACLs, security attributes, quota, no debug enabled [ 9.187332] XFS (dm-4): Mounting V5 Filesystem [ 9.194275] XFS (dm-4): Ending clean mount Starting Load CPU microcode update... Starting VDO volume services... [ OK ] Started irqbalance daemon. [ OK ] Started LVM event activation on device 259:0. [ OK ] Mounted /var/lib/ceph. [ 9.508879] EDAC MC0: Giving out device to module sb_edac controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) [ 9.520266] EDAC sbridge: Ver: 1.1.2 [ 9.716203] intel_rapl_common: Found RAPL domain package [ 9.739235] intel_rapl_common: Found RAPL domain dram [ 9.744712] intel_rapl_common: DRAM domain energy unit 15300pj [ OK ] Started Self Monitoring and Reporting Technology (SMART) Daemon. [ OK ] Started Resets System Activity Logs. [ OK ] Started Kernel Samepage Merging. [ OK ] Started Load CPU microcode update. Starting Kernel Samepage Merging (KSM) Tuning Daemon... [ OK ] Started Avahi mDNS/DNS-SD Stack. [ OK ] Started NTP client/server. [ OK ] Started Kernel Samepage Merging (KSM) Tuning Daemon. [ OK ] Started Network Manager. Starting Network Manager Wait Online... [ OK ] Reached target Network. Starting Enable periodic update of entitlement certificates.... Starting Dynamic System Tuning Daemon... Starting OpenSSH server daemon... Starting GSSAPI Proxy Daemon... [ OK ] Started Enable periodic update of entitlement certificates.. Starting Hostname Service... [ OK ] Started Hostname Service. [ OK ] Started OpenSSH server daemon. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Network Manager Script Dispatcher Service... [ OK ] Started Authorization Manager. [ OK ] Started Network Manager Script Dispatcher Service. [ 11.255692] IPv6: ADDRCONF(NETDEV_UP): eno1: link is not ready [ 11.310579] IPv6: ADDRCONF(NETDEV_UP): eno1: link is not ready [ 11.321229] IPv6: ADDRCONF(NETDEV_UP): eno2: link is not ready [ 11.379983] IPv6: ADDRCONF(NETDEV_UP): eno2: link is not ready [ 11.392448] IPv6: ADDRCONF(NETDEV_UP): enp3s0f0: link is not ready [ 11.440081] ixgbe 0000:03:00.0: registered PHC device on enp3s0f0 [ 11.551929] IPv6: ADDRCONF(NETDEV_UP): enp3s0f0: link is not ready [ 11.562235] IPv6: ADDRCONF(NETDEV_UP): enp3s0f1: link is not ready [ 11.609831] ixgbe 0000:03:00.1: registered PHC device on enp3s0f1 [ 11.719941] IPv6: ADDRCONF(NETDEV_UP): enp3s0f1: link is not ready [ 11.827425] ixgbe 0000:03:00.1 enp3s0f1: detected SFP+: 4 [ OK ] Started System Security Services Daemon. [ OK ] Reached target User and Group Name Lookups. Starting Login Service... Starting Permit User Sessions... [ 11.936303] ixgbe 0000:03:00.1 enp3s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX Starti[ 11.945592] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready ng CUPS Scheduler... [ OK ] Started VDO volume services. [ OK ] Started Permit User Sessions. [ OK ] Started Job spooling tools. [ OK ] Started Command Scheduler. [ OK ] Started Login Service. [ OK ] Started CUPS Scheduler. [ OK ] Started Dynamic System Tuning Daemon. [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... [ OK ] Started Nagios Remote Plugin Executor. Starting System Logging Service... Starting /etc/rc.d/rc.local Compatibility... Starting Notify NFS peers of a restart... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' [ OK ] Started Notify NFS peers of a restart. + myips=172.21.15.134 + attempts=1 + sleep 1 [ OK ] Started System Logging Service. + '[' 172.21.15.134 '!=' '' ']' + set -e + '[' -n 172.21.15.134 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.134 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.134 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi134.front.sepia.ceph.com + '[' -n smithi134.front.sepia.ceph.com ']' + hostname smithi134.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi134 + echo smithi134 + grep -q front.sepia.ceph.com /etc/hosts + sed -i '1i172.21.15.134 smithi134.front.sepia.ceph.com smithi134\' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Terminate Plymouth Boot Screen... Starting Hold until boot process finishes up... Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-372.9.1.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket 2023-09-30T17:04:52.837 DEBUG:teuthology.orchestra.console.smithi134:expect after: smithi134 login: 2023-09-30T17:04:52.891 DEBUG:teuthology.orchestra.console.smithi134:console disconnect output: [Enter `^Ec?' for help] \x80 \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter the Setup Menu.                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent XE v2.1.60 PXE 2.1 Build 088 (WfM 2.0)  Press Ctrl+S to enter th                      Press Ctrl+S to enter the Setup Menu..  \x80 \x80 Initializing Intel(R) Boot Agent GE v1.5.13 PXE 2.1 Build 092 (WfM 2.0) Press Ctrl+S to enter the Setup Menu.                       Press Ctrl+S to enter the Setup Menu..  \x80 \x80 \x80 \x80  Intel(R) Boot Agent XE v2.1.60 Copyright (C) 1997-2009, Intel Corporation  CLIENT MAC ADDR: 0C C4 7A 88 6D E9 GUID: 00000000 0000 0000 0000 0CC47AD938E6 DHCP./                    DHCP.| DHCP./ DHCP.- DHCP.\ DHCP.| DHCP./ CLIENT IP: 172.21.15.134 MASK: 255.255.240.0 DHCP IP: 172.21.0.10 GATEWAY IP: 172.21.15.254 PXE->EB: !PXE at 96D3:0070, entry point at 96D3:0106  UNDI code segment 96D3:3E70, data segment 8F94:73F0 (574-619kB)  UNDI device is PCI 03:00.1, type DIX+802.3  574kB free base memory after PXE unload iPXE initialising devices... iPXE initialising devices...ok iPXE 1.20.1+ (g4bd0) -- Open Source Network Boot Firmware -- http://ipxe.org Features: DNS FTP HTTP HTTPS iSCSI NFS TFTP VLAN AoE ELF MBOOT PXE bzImage Menu PXEXT Configuring (net0 0c:c4:7a:88:6d:e9)... Configuring (net0 0c:c4:7a:88:6d:e9).... Configuring (net0 0c:c4:7a:88:6d:e9)..... Configuring (net0 0c:c4:7a:88:6d:e9)...... ok .   [?25lUse the ^ and v keys to change the selection. Press 'e' to edit the selected item, or 'c' for a command prompt.   Red Hat Enterprise Linux (4.18.0-372.9.1.el8.x86_64) 8.6 (Ootpa)  Red Hat Enterprise Linux (0-rescue-5a84457b7b52416e95d47d02e2e4a60f) 8.6>                The selected entry will be started automatically in 5s.             Use the * and * keys to change the selection.  Press 'e' to edit the selected item, or 'c' for a command prompt.  The selected entry will be started automatically in 5s.   Red Hat Enterprise Linux (4.18.0-372.9.1.el8.x86_64) 8.6 (Ootpa)   Red Hat Enterprise Linux (0-rescue-5a84457b7b52416e95d47d02e2e4a60f) 8.6*  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 4s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 3s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 2s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 1s.  The selected entry will be started automatically in 0s. [?25h     Probing EDD (edd=off to disabl [ 0.000000] Linux version 4.18.0-372.9.1.el8.x86_64 (mockbuild@x86-vm-09.build.eng.bos.redhat.com) (gcc version 8.5.0 20210514 (Red Hat 8.5.0-10) (GCC)) #1 SMP Fri Apr 15 22:12:19 EDT 2022 [ 0.000000] Command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-4.18.0-372.9.1.el8.x86_64 root=UUID=78886b72-f581-4b1d-8578-0d8161fd4ca1 ro crashkernel=auto console=ttyS1,115200 console=tty0 console=ttyS1,115200 [ 0.000000] x86/fpu: Supporting XSAVE feature 0x001: 'x87 floating point registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x002: 'SSE registers' [ 0.000000] x86/fpu: Supporting XSAVE feature 0x004: 'AVX registers' [ 0.000000] x86/fpu: xstate_offset[2]: 576, xstate_sizes[2]: 256 [ 0.000000] x86/fpu: Enabled xstate features 0x7, context size is 832 bytes, using 'standard' format. [ 0.000000] signal: max sigframe size: 1776 [ 0.000000] BIOS-provided physical RAM map: [ 0.000000] BIOS-e820: [mem 0x0000000000000000-0x000000000008bbff] usable [ 0.000000] BIOS-e820: [mem 0x00000000000e0000-0x00000000000fffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000000100000-0x0000000078ecbfff] usable [ 0.000000] BIOS-e820: [mem 0x0000000078f7e000-0x00000000798adfff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000798ae000-0x0000000079d4afff] ACPI NVS [ 0.000000] BIOS-e820: [mem 0x0000000079d4b000-0x000000008fffffff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000fed1c000-0x00000000fed44fff] reserved [ 0.000000] BIOS-e820: [mem 0x00000000ff000000-0x00000000ffffffff] reserved [ 0.000000] BIOS-e820: [mem 0x0000000100000000-0x000000087fffffff] usable [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] SMBIOS 3.0 present. [ 0.000000] DMI: Supermicro SYS-5018R-WR/X10SRW-F, BIOS 2.0 12/17/2015 [ 0.000000] tsc: Fast TSC calibration using PIT [ 0.000000] tsc: Detected 3500.288 MHz processor [ 0.000000] last_pfn = 0x880000 max_arch_pfn = 0x400000000 [ 0.000000] x86/PAT: Configuration [0-7]: WB WC UC- UC WB WP UC- WT [ 0.000000] last_pfn = 0x78ecc max_arch_pfn = 0x400000000 [ 0.000000] found SMP MP-table at [mem 0x000fda20-0x000fda2f] [ 0.000000] Using GB pages for direct mapping [ 0.000000] RAMDISK: [mem 0x3484f000-0x3641ffff] [ 0.000000] ACPI: Early table checksum verification disabled [ 0.000000] ACPI: RSDP 0x00000000000F0580 000024 (v02 SUPERM) [ 0.000000] ACPI: XSDT 0x00000000798AE098 0000B4 (v01 01072009 AMI 00010013) [ 0.000000] ACPI: FACP 0x00000000798E15B0 00010C (v05 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: DSDT 0x00000000798AE1E8 0333C4 (v02 SUPERM SMCI--MB 01072009 INTL 20091013) [ 0.000000] ACPI: FACS 0x0000000079D49F80 000040 [ 0.000000] ACPI: APIC 0x00000000798E16C0 0000C8 (v03 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: FPDT 0x00000000798E1788 000044 (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: FIDT 0x00000000798E17D0 00009C (v01 SUPERM SMCI--MB 01072009 AMI 00010013) [ 0.000000] ACPI: SPMI 0x00000000798E1870 000040 (v05 SUPERM SMCI--MB 00000000 AMI. 00000000) [ 0.000000] ACPI: MCFG 0x00000000798E18B0 00003C (v01 SUPERM SMCI--MB 01072009 MSFT 00000097) [ 0.000000] ACPI: UEFI 0x00000000798E18F0 000042 (v01 SUPERM SMCI--MB 01072009 00000000) [ 0.000000] ACPI: HPET 0x00000000798E1938 000038 (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.000000] ACPI: WDDT 0x00000000798E1970 000040 (v01 SUPERM SMCI--MB 00000000 INTL 20091013) [ 0.000000] ACPI: SSDT 0x00000000798E19B0 01717F (v02 SUPERM PmMgt 00000001 INTL 20120913) [ 0.000000] ACPI: SSDT 0x00000000798F8B30 00264C (v02 SUPERM SpsNm 00000002 INTL 20120913) [ 0.000000] ACPI: SSDT 0x00000000798FB180 000064 (v02 SUPERM SpsNvs 00000002 INTL 20120913) [ 0.000000] ACPI: PRAD 0x00000000798FB1E8 000102 (v02 SUPERM SMCI--MB 00000002 INTL 20120913) [ 0.000000] ACPI: DMAR 0x00000000798FB2F0 0000BC (v01 SUPERM SMCI--MB 00000001 INTL 20091013) [ 0.000000] ACPI: HEST 0x00000000798FB3B0 00027C (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: BERT 0x00000000798FB630 000030 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: ERST 0x00000000798FB660 000230 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: EINJ 0x00000000798FB890 000130 (v01 SUPERM SMCI--MB 00000001 INTL 00000001) [ 0.000000] ACPI: Reserving FACP table memory at [mem 0x798e15b0-0x798e16bb] [ 0.000000] ACPI: Reserving DSDT table memory at [mem 0x798ae1e8-0x798e15ab] [ 0.000000] ACPI: Reserving FACS table memory at [mem 0x79d49f80-0x79d49fbf] [ 0.000000] ACPI: Reserving APIC table memory at [mem 0x798e16c0-0x798e1787] [ 0.000000] ACPI: Reserving FPDT table memory at [mem 0x798e1788-0x798e17cb] [ 0.000000] ACPI: Reserving FIDT table memory at [mem 0x798e17d0-0x798e186b] [ 0.000000] ACPI: Reserving SPMI table memory at [mem 0x798e1870-0x798e18af] [ 0.000000] ACPI: Reserving MCFG table memory at [mem 0x798e18b0-0x798e18eb] [ 0.000000] ACPI: Reserving UEFI table memory at [mem 0x798e18f0-0x798e1931] [ 0.000000] ACPI: Reserving HPET table memory at [mem 0x798e1938-0x798e196f] [ 0.000000] ACPI: Reserving WDDT table memory at [mem 0x798e1970-0x798e19af] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798e19b0-0x798f8b2e] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798f8b30-0x798fb17b] [ 0.000000] ACPI: Reserving SSDT table memory at [mem 0x798fb180-0x798fb1e3] [ 0.000000] ACPI: Reserving PRAD table memory at [mem 0x798fb1e8-0x798fb2e9] [ 0.000000] ACPI: Reserving DMAR table memory at [mem 0x798fb2f0-0x798fb3ab] [ 0.000000] ACPI: Reserving HEST table memory at [mem 0x798fb3b0-0x798fb62b] [ 0.000000] ACPI: Reserving BERT table memory at [mem 0x798fb630-0x798fb65f] [ 0.000000] ACPI: Reserving ERST table memory at [mem 0x798fb660-0x798fb88f] [ 0.000000] ACPI: Reserving EINJ table memory at [mem 0x798fb890-0x798fb9bf] [ 0.000000] No NUMA configuration found [ 0.000000] Faking a node at [mem 0x0000000000000000-0x000000087fffffff] [ 0.000000] NODE_DATA(0) allocated [mem 0x87ffd5000-0x87fffffff] [ 0.000000] Using crashkernel=auto, the size chosen is a best effort estimation. [ 0.000000] Reserving 192MB of memory at 1728MB for crashkernel (System RAM: 32654MB) [ 0.000000] Zone ranges: [ 0.000000] DMA [mem 0x0000000000001000-0x0000000000ffffff] [ 0.000000] DMA32 [mem 0x0000000001000000-0x00000000ffffffff] [ 0.000000] Normal [mem 0x0000000100000000-0x000000087fffffff] [ 0.000000] Device empty [ 0.000000] Movable zone start for each node [ 0.000000] Early memory node ranges [ 0.000000] node 0: [mem 0x0000000000001000-0x000000000008afff] [ 0.000000] node 0: [mem 0x0000000000100000-0x0000000078ecbfff] [ 0.000000] node 0: [mem 0x0000000100000000-0x000000087fffffff] [ 0.000000] Zeroed struct page in unavailable ranges: 29098 pages [ 0.000000] Initmem setup node 0 [mem 0x0000000000001000-0x000000087fffffff] [ 0.000000] ACPI: PM-Timer IO Port: 0x408 [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) [ 0.000000] ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) [ 0.000000] IOAPIC[0]: apic_id 1, version 32, address 0xfec00000, GSI 0-23 [ 0.000000] IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) [ 0.000000] ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) [ 0.000000] Using ACPI (MADT) for SMP configuration information [ 0.000000] ACPI: HPET id: 0x8086a701 base: 0xfed00000 [ 0.000000] [Firmware Bug]: TSC_DEADLINE disabled due to Errata; please update microcode to version: 0xb000020 (or later) [ 0.000000] smpboot: Allowing 8 CPUs, 0 hotplug CPUs [ 0.000000] PM: Registered nosave memory: [mem 0x00000000-0x00000fff] [ 0.000000] PM: Registered nosave memory: [mem 0x0008b000-0x000dffff] [ 0.000000] PM: Registered nosave memory: [mem 0x000e0000-0x000fffff] [ 0.000000] PM: Registered nosave memory: [mem 0x78ecc000-0x78f7dfff] [ 0.000000] PM: Registered nosave memory: [mem 0x78f7e000-0x798adfff] [ 0.000000] PM: Registered nosave memory: [mem 0x798ae000-0x79d4afff] [ 0.000000] PM: Registered nosave memory: [mem 0x79d4b000-0x8fffffff] [ 0.000000] PM: Registered nosave memory: [mem 0x90000000-0xfed1bfff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed1c000-0xfed44fff] [ 0.000000] PM: Registered nosave memory: [mem 0xfed45000-0xfeffffff] [ 0.000000] PM: Registered nosave memory: [mem 0xff000000-0xffffffff] [ 0.000000] [mem 0x90000000-0xfed1bfff] available for PCI devices [ 0.000000] Booting paravirtualized kernel on bare hardware [ 0.000000] clocksource: refined-jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1910969940391419 ns [ 0.000000] setup_percpu: NR_CPUS:8192 nr_cpumask_bits:8 nr_cpu_ids:8 nr_node_ids:1 [ 0.000000] percpu: Embedded 55 pages/cpu s188416 r8192 d28672 u262144 [ 0.000000] Built 1 zonelists, mobility grouping on. Total pages: 8228752 [ 0.000000] Policy zone: Normal [ 0.000000] Kernel command line: BOOT_IMAGE=(hd0,msdos1)/boot/vmlinuz-4.18.0-372.9.1.el8.x86_64 root=UUID=78886b72-f581-4b1d-8578-0d8161fd4ca1 ro crashkernel=auto console=ttyS1,115200 console=tty0 console=ttyS1,115200 [ 0.000000] Specific versions of hardware are certified with Red Hat Enterprise Linux 8. Please see the list of hardware certified with Red Hat Enterprise Linux 8 at https://catalog.redhat.com. [ 0.000000] Memory: 1820652K/33438040K available (12293K kernel code, 5865K rwdata, 8292K rodata, 2520K init, 14348K bss, 869504K reserved, 0K cma-reserved) [ 0.000000] SLUB: HWalign=64, Order=0-3, MinObjects=0, CPUs=8, Nodes=1 [ 0.000000] Kernel/User page tables isolation: enabled [ 0.000000] ftrace: allocating 39999 entries in 157 pages [ 0.000000] ftrace: allocated 157 pages with 5 groups [ 0.000000] rcu: Hierarchical RCU implementation. [ 0.000000] rcu: RCU restricting CPUs from NR_CPUS=8192 to nr_cpu_ids=8. [ 0.000000] Rude variant of Tasks RCU enabled. [ 0.000000] Tracing variant of Tasks RCU enabled. [ 0.000000] rcu: RCU calculated value of scheduler-enlistment delay is 100 jiffies. [ 0.000000] rcu: Adjusting geometry for rcu_fanout_leaf=16, nr_cpu_ids=8 [ 0.000000] NR_IRQS: 524544, nr_irqs: 896, preallocated irqs: 16 [ 0.000000] random: crng done (trusting CPU's manufacturer) [ 0.001000] Console: colour VGA+ 80x25 [ 0.001000] printk: console [tty0] enabled [ 0.001000] printk: console [ttyS1] enabled [ 0.001000] ACPI: Core revision 20210604 [ 0.001000] clocksource: hpet: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 133484882848 ns [ 0.001000] APIC: Switch to symmetric I/O mode setup [ 0.001004] DMAR: Host address width 46 [ 0.002001] DMAR: DRHD base: 0x000000fbffc000 flags: 0x1 [ 0.003004] DMAR: dmar0: reg_base_addr fbffc000 ver 1:0 cap 8d2078c106f0466 ecap f020de [ 0.004001] DMAR: RMRR base: 0x0000007ba75000 end: 0x0000007ba84fff [ 0.005001] DMAR: ATSR flags: 0x0 [ 0.006001] DMAR: RHSA base: 0x000000fbffc000 proximity domain: 0x0 [ 0.007002] DMAR-IR: IOAPIC id 1 under DRHD base 0xfbffc000 IOMMU 0 [ 0.008001] DMAR-IR: IOAPIC id 2 under DRHD base 0xfbffc000 IOMMU 0 [ 0.009001] DMAR-IR: HPET id 0 under DRHD base 0xfbffc000 [ 0.010001] DMAR-IR: x2apic is disabled because BIOS sets x2apic opt out bit. [ 0.010002] DMAR-IR: Use 'intremap=no_x2apic_optout' to override the BIOS setting. [ 0.013111] DMAR-IR: Enabled IRQ remapping in xapic mode [ 0.014000] x2apic: IRQ remapping doesn't support X2APIC mode [ 0.014469] ..TIMER: vector=0x30 apic1=0 pin1=2 apic2=-1 pin2=-1 [ 0.019001] clocksource: tsc-early: mask: 0xffffffffffffffff max_cycles: 0x3274610cf39, max_idle_ns: 440795306388 ns [ 0.020001] Calibrating delay loop (skipped), value calculated using timer frequency.. 7000.57 BogoMIPS (lpj=3500288) [ 0.021000] pid_max: default: 32768 minimum: 301 [ 0.022020] LSM: Security Framework initializing [ 0.023007] Yama: becoming mindful. [ 0.024003] SELinux: Initializing. [ 0.026021] LSM support for eBPF active [ 0.032277] Dentry cache hash table entries: 4194304 (order: 13, 33554432 bytes, vmalloc) [ 0.035744] Inode-cache hash table entries: 2097152 (order: 12, 16777216 bytes, vmalloc) [ 0.037021] Mount-cache hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.038076] Mountpoint-cache hash table entries: 65536 (order: 7, 524288 bytes, vmalloc) [ 0.039224] CPU0: Thermal monitoring enabled (TM1) [ 0.040041] process: using mwait in idle threads [ 0.041001] Last level iTLB entries: 4KB 64, 2MB 8, 4MB 8 [ 0.042000] Last level dTLB entries: 4KB 64, 2MB 0, 4MB 0, 1GB 4 [ 0.043000] FEATURE SPEC_CTRL Not Present [ 0.044000] FEATURE IBPB_SUPPORT Not Present [ 0.045000] Spectre V1 : Mitigation: usercopy/swapgs barriers and __user pointer sanitization [ 0.046001] Spectre V2 : Mitigation: Retpolines [ 0.047000] Spectre V2 : Spectre v2 / SpectreRSB mitigation: Filling RSB on context switch [ 0.048000] Speculative Store Bypass: Vulnerable [ 0.049003] TAA: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.050000] MDS: Vulnerable: Clear CPU buffers attempted, no microcode [ 0.051231] Freeing SMP alternatives memory: 36K [ 0.053916] smpboot: Estimated ratio of average max frequency by base frequency (times 1024): 1053 [ 0.156991] smpboot: CPU0: Intel(R) Xeon(R) CPU E5-1620 v4 @ 3.50GHz (family: 0x6, model: 0x4f, stepping: 0x1) [ 0.157100] Performance Events: PEBS fmt2+, Broadwell events, 16-deep LBR, full-width counters, Intel PMU driver. [ 0.158001] ... version: 3 [ 0.159000] ... bit width: 48 [ 0.160000] ... generic registers: 4 [ 0.161000] ... value mask: 0000ffffffffffff [ 0.162000] ... max period: 00007fffffffffff [ 0.163000] ... fixed-purpose events: 3 [ 0.164000] ... event mask: 000000070000000f [ 0.165027] rcu: Hierarchical SRCU implementation. [ 0.166838] NMI watchdog: Enabled. Permanently consumes one hw-PMU counter. [ 0.168005] smp: Bringing up secondary CPUs ... [ 0.169065] x86: Booting SMP configuration: [ 0.170001] .... node #0, CPUs: #1 #2 #3 #4 [ 0.173337] MDS CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/mds.html for more details. [ 0.175000] TAA CPU bug present and SMT on, data leak possible. See https://www.kernel.org/doc/html/latest/admin-guide/hw-vuln/tsx_async_abort.html for more details. [ 0.177049] #5 #6 #7 [ 0.178547] smp: Brought up 1 node, 8 CPUs [ 0.180001] smpboot: Max logical packages: 1 [ 0.181000] smpboot: Total of 8 processors activated (56004.60 BogoMIPS) [ 0.223020] node 0 deferred pages initialised in 40ms [ 0.229032] devtmpfs: initialized [ 0.230040] x86/mm: Memory block size: 128MB [ 0.233331] ACPI: PM: Registering ACPI NVS region [mem 0x798ae000-0x79d4afff] (4837376 bytes) [ 0.235082] clocksource: jiffies: mask: 0xffffffff max_cycles: 0xffffffff, max_idle_ns: 1911260446275000 ns [ 0.244007] futex hash table entries: 2048 (order: 5, 131072 bytes, vmalloc) [ 0.252061] pinctrl core: initialized pinctrl subsystem [ 0.257119] NET: Registered protocol family 16 [ 0.262081] DMA: preallocated 4096 KiB GFP_KERNEL pool for atomic allocations [ 0.269010] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA pool for atomic allocations [ 0.277008] DMA: preallocated 4096 KiB GFP_KERNEL|GFP_DMA32 pool for atomic allocations [ 0.285008] audit: initializing netlink subsys (disabled) [ 0.290008] audit: type=2000 audit(1696093464.290:1): state=initialized audit_enabled=0 res=1 [ 0.299002] cpuidle: using governor menu [ 0.303022] ACPI FADT declares the system doesn't support PCIe ASPM, so disable it [ 0.311001] ACPI: bus type PCI registered [ 0.315001] acpiphp: ACPI Hot Plug PCI Controller Driver version: 0.5 [ 0.321043] PCI: MMCONFIG for domain 0000 [bus 00-ff] at [mem 0x80000000-0x8fffffff] (base 0x80000000) [ 0.331001] PCI: MMCONFIG at [mem 0x80000000-0x8fffffff] reserved in E820 [ 0.338011] PCI: Using configuration type 1 for base access [ 0.345048] HugeTLB registered 1.00 GiB page size, pre-allocated 0 pages [ 0.352002] HugeTLB registered 2.00 MiB page size, pre-allocated 0 pages [ 0.358022] cryptd: max_cpu_qlen set to 1000 [ 0.363064] ACPI: Added _OSI(Module Device) [ 0.367001] ACPI: Added _OSI(Processor Device) [ 0.372000] ACPI: Added _OSI(3.0 _SCP Extensions) [ 0.376000] ACPI: Added _OSI(Processor Aggregator Device) [ 0.382001] ACPI: Added _OSI(Linux-Dell-Video) [ 0.386000] ACPI: Added _OSI(Linux-Lenovo-NV-HDMI-Audio) [ 0.392000] ACPI: Added _OSI(Linux-HPI-Hybrid-Graphics) [ 0.426620] ACPI: 4 ACPI AML tables successfully acquired and loaded [ 0.435645] ACPI: [Firmware Bug]: BIOS _OSI(Linux) query ignored [ 0.445094] ACPI: Dynamic OEM Table Load: [ 0.465227] ACPI: Interpreter enabled [ 0.466011] ACPI: PM: (supports S0 S4 S5) [ 0.467000] ACPI: Using IOAPIC for interrupt routing [ 0.468017] HEST: Enabling Firmware First mode for corrected errors. [ 0.469073] HEST: Table parsing has been initialized. [ 0.470001] PCI: Using host bridge windows from ACPI; if necessary, use "pci=nocrs" and report a bug [ 0.471547] ACPI: Enabled 5 GPEs in block 00 to 3F [ 0.495538] ACPI: PCI Root Bridge [UNC0] (domain 0000 [bus ff]) [ 0.496003] acpi PNP0A03:03: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 0.498483] acpi PNP0A03:03: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 0.500108] acpi PNP0A03:03: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 0.501000] acpi PNP0A03:03: FADT indicates ASPM is unsupported, using BIOS configuration [ 0.502028] PCI host bridge to bus 0000:ff [ 0.503001] pci_bus 0000:ff: root bus resource [bus ff] [ 0.504009] pci 0000:ff:0b.0: [8086:6f81] type 00 class 0x088000 [ 0.505041] pci 0000:ff:0b.1: [8086:6f36] type 00 class 0x110100 [ 0.506032] pci 0000:ff:0b.2: [8086:6f37] type 00 class 0x110100 [ 0.508026] pci 0000:ff:0b.3: [8086:6f76] type 00 class 0x088000 [ 0.509030] pci 0000:ff:0c.0: [8086:6fe0] type 00 class 0x088000 [ 0.510031] pci 0000:ff:0c.1: [8086:6fe1] type 00 class 0x088000 [ 0.511031] pci 0000:ff:0c.2: [8086:6fe2] type 00 class 0x088000 [ 0.512029] pci 0000:ff:0c.3: [8086:6fe3] type 00 class 0x088000 [ 0.513031] pci 0000:ff:0f.0: [8086:6ff8] type 00 class 0x088000 [ 0.514028] pci 0000:ff:0f.1: [8086:6ff9] type 00 class 0x088000 [ 0.515029] pci 0000:ff:0f.4: [8086:6ffc] type 00 class 0x088000 [ 0.516032] pci 0000:ff:0f.5: [8086:6ffd] type 00 class 0x088000 [ 0.517029] pci 0000:ff:0f.6: [8086:6ffe] type 00 class 0x088000 [ 0.518030] pci 0000:ff:10.0: [8086:6f1d] type 00 class 0x088000 [ 0.519031] pci 0000:ff:10.1: [8086:6f34] type 00 class 0x110100 [ 0.520030] pci 0000:ff:10.5: [8086:6f1e] type 00 class 0x088000 [ 0.521028] pci 0000:ff:10.6: [8086:6f7d] type 00 class 0x110100 [ 0.522028] pci 0000:ff:10.7: [8086:6f1f] type 00 class 0x088000 [ 0.523029] pci 0000:ff:12.0: [8086:6fa0] type 00 class 0x088000 [ 0.524021] pci 0000:ff:12.1: [8086:6f30] type 00 class 0x110100 [ 0.525037] pci 0000:ff:13.0: [8086:6fa8] type 00 class 0x088000 [ 0.526058] pci 0000:ff:13.1: [8086:6f71] type 00 class 0x088000 [ 0.527041] pci 0000:ff:13.2: [8086:6faa] type 00 class 0x088000 [ 0.528043] pci 0000:ff:13.3: [8086:6fab] type 00 class 0x088000 [ 0.529041] pci 0000:ff:13.4: [8086:6fac] type 00 class 0x088000 [ 0.530041] pci 0000:ff:13.5: [8086:6fad] type 00 class 0x088000 [ 0.531039] pci 0000:ff:13.6: [8086:6fae] type 00 class 0x088000 [ 0.532032] pci 0000:ff:13.7: [8086:6faf] type 00 class 0x088000 [ 0.533032] pci 0000:ff:14.0: [8086:6fb0] type 00 class 0x088000 [ 0.534042] pci 0000:ff:14.1: [8086:6fb1] type 00 class 0x088000 [ 0.535041] pci 0000:ff:14.2: [8086:6fb2] type 00 class 0x088000 [ 0.536041] pci 0000:ff:14.3: [8086:6fb3] type 00 class 0x088000 [ 0.537107] pci 0000:ff:14.4: [8086:6fbc] type 00 class 0x088000 [ 0.538033] pci 0000:ff:14.5: [8086:6fbd] type 00 class 0x088000 [ 0.539031] pci 0000:ff:14.6: [8086:6fbe] type 00 class 0x088000 [ 0.541011] pci 0000:ff:14.7: [8086:6fbf] type 00 class 0x088000 [ 0.542034] pci 0000:ff:15.0: [8086:6fb4] type 00 class 0x088000 [ 0.543042] pci 0000:ff:15.1: [8086:6fb5] type 00 class 0x088000 [ 0.544041] pci 0000:ff:15.2: [8086:6fb6] type 00 class 0x088000 [ 0.545041] pci 0000:ff:15.3: [8086:6fb7] type 00 class 0x088000 [ 0.546043] pci 0000:ff:16.0: [8086:6f68] type 00 class 0x088000 [ 0.547035] pci 0000:ff:16.6: [8086:6f6e] type 00 class 0x088000 [ 0.548031] pci 0000:ff:16.7: [8086:6f6f] type 00 class 0x088000 [ 0.549031] pci 0000:ff:17.0: [8086:6fd0] type 00 class 0x088000 [ 0.550035] pci 0000:ff:17.4: [8086:6fb8] type 00 class 0x088000 [ 0.551031] pci 0000:ff:17.5: [8086:6fb9] type 00 class 0x088000 [ 0.552031] pci 0000:ff:17.6: [8086:6fba] type 00 class 0x088000 [ 0.553030] pci 0000:ff:17.7: [8086:6fbb] type 00 class 0x088000 [ 0.554034] pci 0000:ff:1e.0: [8086:6f98] type 00 class 0x088000 [ 0.555029] pci 0000:ff:1e.1: [8086:6f99] type 00 class 0x088000 [ 0.556031] pci 0000:ff:1e.2: [8086:6f9a] type 00 class 0x088000 [ 0.557030] pci 0000:ff:1e.3: [8086:6fc0] type 00 class 0x088000 [ 0.558021] pci 0000:ff:1e.4: [8086:6f9c] type 00 class 0x088000 [ 0.559032] pci 0000:ff:1f.0: [8086:6f88] type 00 class 0x088000 [ 0.560030] pci 0000:ff:1f.2: [8086:6f8a] type 00 class 0x088000 [ 0.563965] ACPI: PCI Root Bridge [PCI0] (domain 0000 [bus 00-fe]) [ 0.564002] acpi PNP0A08:00: _OSC: OS supports [ExtendedConfig ASPM ClockPM Segments MSI EDR HPX-Type3] [ 0.565149] acpi PNP0A08:00: _OSC: platform does not support [SHPCHotplug AER LTR DPC] [ 0.567179] acpi PNP0A08:00: _OSC: OS now controls [PCIeHotplug PME PCIeCapability] [ 0.568000] acpi PNP0A08:00: FADT indicates ASPM is unsupported, using BIOS configuration [ 0.569243] PCI host bridge to bus 0000:00 [ 0.570001] pci_bus 0000:00: root bus resource [io 0x0000-0x0cf7 window] [ 0.571000] pci_bus 0000:00: root bus resource [io 0x1000-0xffff window] [ 0.572000] pci_bus 0000:00: root bus resource [mem 0x000a0000-0x000bffff window] [ 0.573000] pci_bus 0000:00: root bus resource [mem 0xfedb0000-0xfedb000f window] [ 0.574001] pci_bus 0000:00: root bus resource [mem 0xfedc0000-0xfedc000f window] [ 0.575000] pci_bus 0000:00: root bus resource [mem 0x90000000-0xfbffbfff window] [ 0.576000] pci_bus 0000:00: root bus resource [bus 00-fe] [ 0.577011] pci 0000:00:00.0: [8086:6f00] type 00 class 0x060000 [ 0.578126] pci 0000:00:01.0: [8086:6f02] type 01 class 0x060400 [ 0.579042] pci 0000:00:01.0: PME# supported from D0 D3hot D3cold [ 0.580109] pci 0000:00:02.0: [8086:6f04] type 01 class 0x060400 [ 0.581042] pci 0000:00:02.0: PME# supported from D0 D3hot D3cold [ 0.583083] pci 0000:00:03.0: [8086:6f08] type 01 class 0x060400 [ 0.584041] pci 0000:00:03.0: PME# supported from D0 D3hot D3cold [ 0.585099] pci 0000:00:04.0: [8086:6f20] type 00 class 0x088000 [ 0.586007] pci 0000:00:04.0: reg 0x10: [mem 0xfb42c000-0xfb42ffff 64bit] [ 0.587106] pci 0000:00:04.1: [8086:6f21] type 00 class 0x088000 [ 0.588007] pci 0000:00:04.1: reg 0x10: [mem 0xfb428000-0xfb42bfff 64bit] [ 0.589106] pci 0000:00:04.2: [8086:6f22] type 00 class 0x088000 [ 0.590007] pci 0000:00:04.2: reg 0x10: [mem 0xfb424000-0xfb427fff 64bit] [ 0.591106] pci 0000:00:04.3: [8086:6f23] type 00 class 0x088000 [ 0.592007] pci 0000:00:04.3: reg 0x10: [mem 0xfb420000-0xfb423fff 64bit] [ 0.593105] pci 0000:00:04.4: [8086:6f24] type 00 class 0x088000 [ 0.594007] pci 0000:00:04.4: reg 0x10: [mem 0xfb41c000-0xfb41ffff 64bit] [ 0.595104] pci 0000:00:04.5: [8086:6f25] type 00 class 0x088000 [ 0.596007] pci 0000:00:04.5: reg 0x10: [mem 0xfb418000-0xfb41bfff 64bit] [ 0.597106] pci 0000:00:04.6: [8086:6f26] type 00 class 0x088000 [ 0.598007] pci 0000:00:04.6: reg 0x10: [mem 0xfb414000-0xfb417fff 64bit] [ 0.599104] pci 0000:00:04.7: [8086:6f27] type 00 class 0x088000 [ 0.600007] pci 0000:00:04.7: reg 0x10: [mem 0xfb410000-0xfb413fff 64bit] [ 0.602033] pci 0000:00:05.0: [8086:6f28] type 00 class 0x088000 [ 0.603091] pci 0000:00:05.1: [8086:6f29] type 00 class 0x088000 [ 0.604113] pci 0000:00:05.2: [8086:6f2a] type 00 class 0x088000 [ 0.605088] pci 0000:00:05.4: [8086:6f2c] type 00 class 0x080020 [ 0.606005] pci 0000:00:05.4: reg 0x10: [mem 0xfb439000-0xfb439fff] [ 0.607104] pci 0000:00:11.0: [8086:8d7c] type 00 class 0xff0000 [ 0.608185] pci 0000:00:11.4: [8086:8d62] type 00 class 0x010601 [ 0.609011] pci 0000:00:11.4: reg 0x10: [io 0xf110-0xf117] [ 0.610006] pci 0000:00:11.4: reg 0x14: [io 0xf100-0xf103] [ 0.611006] pci 0000:00:11.4: reg 0x18: [io 0xf0f0-0xf0f7] [ 0.612006] pci 0000:00:11.4: reg 0x1c: [io 0xf0e0-0xf0e3] [ 0.613006] pci 0000:00:11.4: reg 0x20: [io 0xf020-0xf03f] [ 0.614006] pci 0000:00:11.4: reg 0x24: [mem 0xfb438000-0xfb4387ff] [ 0.615034] pci 0000:00:11.4: PME# supported from D3hot [ 0.616095] pci 0000:00:14.0: [8086:8d31] type 00 class 0x0c0330 [ 0.617013] pci 0000:00:14.0: reg 0x10: [mem 0xfb400000-0xfb40ffff 64bit] [ 0.618049] pci 0000:00:14.0: PME# supported from D3hot D3cold [ 0.619087] pci 0000:00:16.0: [8086:8d3a] type 00 class 0x078000 [ 0.620013] pci 0000:00:16.0: reg 0x10: [mem 0xfb437000-0xfb43700f 64bit] [ 0.621050] pci 0000:00:16.0: PME# supported from D0 D3hot D3cold [ 0.622085] pci 0000:00:16.1: [8086:8d3b] type 00 class 0x078000 [ 0.623013] pci 0000:00:16.1: reg 0x10: [mem 0xfb436000-0xfb43600f 64bit] [ 0.624050] pci 0000:00:16.1: PME# supported from D0 D3hot D3cold [ 0.625096] pci 0000:00:1a.0: [8086:8d2d] type 00 class 0x0c0320 [ 0.626013] pci 0000:00:1a.0: reg 0x10: [mem 0xfb434000-0xfb4343ff] [ 0.627072] pci 0000:00:1a.0: PME# supported from D0 D3hot D3cold [ 0.628091] pci 0000:00:1c.0: [8086:8d10] type 01 class 0x060400 [ 0.629064] pci 0000:00:1c.0: PME# supported from D0 D3hot D3cold [ 0.630103] pci 0000:00:1c.2: [8086:8d14] type 01 class 0x060400 [ 0.631066] pci 0000:00:1c.2: PME# supported from D0 D3hot D3cold [ 0.632103] pci 0000:00:1c.4: [8086:8d18] type 01 class 0x060400 [ 0.633066] pci 0000:00:1c.4: PME# supported from D0 D3hot D3cold [ 0.634106] pci 0000:00:1d.0: [8086:8d26] type 00 class 0x0c0320 [ 0.635013] pci 0000:00:1d.0: reg 0x10: [mem 0xfb433000-0xfb4333ff] [ 0.636071] pci 0000:00:1d.0: PME# supported from D0 D3hot D3cold [ 0.638045] pci 0000:00:1f.0: [8086:8d44] type 00 class 0x060100 [ 0.639173] pci 0000:00:1f.2: [8086:8d02] type 00 class 0x010601 [ 0.640009] pci 0000:00:1f.2: reg 0x10: [io 0xf070-0xf077] [ 0.641005] pci 0000:00:1f.2: reg 0x14: [io 0xf060-0xf063] [ 0.642005] pci 0000:00:1f.2: reg 0x18: [io 0xf050-0xf057] [ 0.643005] pci 0000:00:1f.2: reg 0x1c: [io 0xf040-0xf043] [ 0.644005] pci 0000:00:1f.2: reg 0x20: [io 0xf000-0xf01f] [ 0.645005] pci 0000:00:1f.2: reg 0x24: [mem 0xfb432000-0xfb4327ff] [ 0.646029] pci 0000:00:1f.2: PME# supported from D3hot [ 0.647083] pci 0000:00:1f.3: [8086:8d22] type 00 class 0x0c0500 [ 0.648013] pci 0000:00:1f.3: reg 0x10: [mem 0xfb431000-0xfb4310ff 64bit] [ 0.649015] pci 0000:00:1f.3: reg 0x20: [io 0x0580-0x059f] [ 0.650195] acpiphp: Slot [1] registered [ 0.651013] pci 0000:00:01.0: PCI bridge to [bus 01] [ 0.652121] pci 0000:02:00.0: [8086:0953] type 00 class 0x010802 [ 0.653008] pci 0000:02:00.0: reg 0x10: [mem 0xfb310000-0xfb313fff 64bit] [ 0.654015] pci 0000:02:00.0: reg 0x30: [mem 0xfb300000-0xfb30ffff pref] [ 0.655004] pci 0000:02:00.0: enabling Extended Tags [ 0.656097] pci 0000:00:02.0: PCI bridge to [bus 02] [ 0.657002] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 0.658120] pci 0000:03:00.0: [8086:10fb] type 00 class 0x020000 [ 0.659009] pci 0000:03:00.0: reg 0x10: [mem 0xfbd80000-0xfbdfffff 64bit pref] [ 0.660004] pci 0000:03:00.0: reg 0x18: [io 0xe020-0xe03f] [ 0.661009] pci 0000:03:00.0: reg 0x20: [mem 0xfbe04000-0xfbe07fff 64bit pref] [ 0.662004] pci 0000:03:00.0: reg 0x30: [mem 0xfb280000-0xfb2fffff pref] [ 0.663036] pci 0000:03:00.0: PME# supported from D0 D3hot D3cold [ 0.664016] pci 0000:03:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 0.665000] pci 0000:03:00.0: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 0.666008] pci 0000:03:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 0.667000] pci 0000:03:00.0: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 0.668143] pci 0000:03:00.1: [8086:10fb] type 00 class 0x020000 [ 0.669009] pci 0000:03:00.1: reg 0x10: [mem 0xfbd00000-0xfbd7ffff 64bit pref] [ 0.670004] pci 0000:03:00.1: reg 0x18: [io 0xe000-0xe01f] [ 0.671009] pci 0000:03:00.1: reg 0x20: [mem 0xfbe00000-0xfbe03fff 64bit pref] [ 0.672004] pci 0000:03:00.1: reg 0x30: [mem 0xfb200000-0xfb27ffff pref] [ 0.673036] pci 0000:03:00.1: PME# supported from D0 D3hot D3cold [ 0.674013] pci 0000:03:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 0.675000] pci 0000:03:00.1: VF(n) BAR0 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR0 for 64 VFs) [ 0.676007] pci 0000:03:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 0.677000] pci 0000:03:00.1: VF(n) BAR3 space: [mem 0x00000000-0x000fffff 64bit pref] (contains BAR3 for 64 VFs) [ 0.678130] pci 0000:00:03.0: PCI bridge to [bus 03] [ 0.679001] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 0.680001] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 0.681002] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 0.682028] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 0.683058] pci 0000:05:00.0: [1a03:1150] type 01 class 0x060400 [ 0.684065] pci 0000:05:00.0: enabling Extended Tags [ 0.685069] pci 0000:05:00.0: supports D1 D2 [ 0.686000] pci 0000:05:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 0.687088] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 0.688002] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 0.689002] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 0.690047] pci_bus 0000:06: extended config space not accessible [ 0.691025] pci 0000:06:00.0: [1a03:2000] type 00 class 0x030000 [ 0.692022] pci 0000:06:00.0: reg 0x10: [mem 0xfa000000-0xfaffffff] [ 0.693012] pci 0000:06:00.0: reg 0x14: [mem 0xfb000000-0xfb01ffff] [ 0.694012] pci 0000:06:00.0: reg 0x18: [io 0xd000-0xd07f] [ 0.695095] pci 0000:06:00.0: supports D1 D2 [ 0.696000] pci 0000:06:00.0: PME# supported from D0 D1 D2 D3hot D3cold [ 0.697105] pci 0000:05:00.0: PCI bridge to [bus 06] [ 0.698007] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 0.699004] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 0.700146] pci 0000:07:00.0: [8086:1521] type 00 class 0x020000 [ 0.701017] pci 0000:07:00.0: reg 0x10: [mem 0xfb120000-0xfb13ffff] [ 0.702017] pci 0000:07:00.0: reg 0x18: [io 0xc020-0xc03f] [ 0.703009] pci 0000:07:00.0: reg 0x1c: [mem 0xfb144000-0xfb147fff] [ 0.704118] pci 0000:07:00.0: PME# supported from D0 D3hot D3cold [ 0.705034] pci 0000:07:00.0: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 0.706000] pci 0000:07:00.0: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 0.707020] pci 0000:07:00.0: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 0.708000] pci 0000:07:00.0: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 0.710036] pci 0000:07:00.1: [8086:1521] type 00 class 0x020000 [ 0.711016] pci 0000:07:00.1: reg 0x10: [mem 0xfb100000-0xfb11ffff] [ 0.712017] pci 0000:07:00.1: reg 0x18: [io 0xc000-0xc01f] [ 0.713009] pci 0000:07:00.1: reg 0x1c: [mem 0xfb140000-0xfb143fff] [ 0.714113] pci 0000:07:00.1: PME# supported from D0 D3hot D3cold [ 0.715034] pci 0000:07:00.1: reg 0x184: [mem 0x00000000-0x00003fff 64bit pref] [ 0.716000] pci 0000:07:00.1: VF(n) BAR0 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR0 for 8 VFs) [ 0.717020] pci 0000:07:00.1: reg 0x190: [mem 0x00000000-0x00003fff 64bit pref] [ 0.718000] pci 0000:07:00.1: VF(n) BAR3 space: [mem 0x00000000-0x0001ffff 64bit pref] (contains BAR3 for 8 VFs) [ 0.719141] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 0.720002] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 0.721002] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 0.722003] pci 0000:00:1c.4: bridge has subordinate 07 but max busn 08 [ 0.723671] ACPI: PCI: Interrupt link LNKA configured for IRQ 11 [ 0.724035] ACPI: PCI: Interrupt link LNKB configured for IRQ 10 [ 0.725033] ACPI: PCI: Interrupt link LNKC configured for IRQ 5 [ 0.726033] ACPI: PCI: Interrupt link LNKD configured for IRQ 11 [ 0.727033] ACPI: PCI: Interrupt link LNKE configured for IRQ 0 [ 0.728000] ACPI: PCI: Interrupt link LNKE disabled [ 0.729033] ACPI: PCI: Interrupt link LNKF configured for IRQ 0 [ 0.730000] ACPI: PCI: Interrupt link LNKF disabled [ 0.731033] ACPI: PCI: Interrupt link LNKG configured for IRQ 0 [ 0.732000] ACPI: PCI: Interrupt link LNKG disabled [ 0.733033] ACPI: PCI: Interrupt link LNKH configured for IRQ 0 [ 0.734000] ACPI: PCI: Interrupt link LNKH disabled [ 0.736111] iommu: Default domain type: Passthrough [ 0.737017] pci 0000:06:00.0: vgaarb: setting as boot VGA device [ 0.738000] pci 0000:06:00.0: vgaarb: VGA device added: decodes=io+mem,owns=io+mem,locks=none [ 0.738001] pci 0000:06:00.0: vgaarb: bridge control possible [ 0.739000] vgaarb: loaded [ 0.740065] SCSI subsystem initialized [ 0.741014] ACPI: bus type USB registered [ 0.742009] usbcore: registered new interface driver usbfs [ 0.743006] usbcore: registered new interface driver hub [ 0.744015] usbcore: registered new device driver usb [ 0.745016] pps_core: LinuxPPS API ver. 1 registered [ 0.746000] pps_core: Software ver. 5.3.6 - Copyright 2005-2007 Rodolfo Giometti [ 0.747001] PTP clock support registered [ 0.749013] EDAC MC: Ver: 3.0.0 [ 0.750105] PCI: Using ACPI for IRQ routing [ 0.756961] NetLabel: Initializing [ 0.757000] NetLabel: domain hash size = 128 [ 0.758000] NetLabel: protocols = UNLABELED CIPSOv4 CALIPSO [ 0.759012] NetLabel: unlabeled traffic allowed by default [ 0.760045] hpet0: at MMIO 0xfed00000, IRQs 2, 8, 0, 0, 0, 0, 0, 0 [ 0.761001] hpet0: 8 comparators, 64-bit 14.318180 MHz counter [ 0.764025] clocksource: Switched to clocksource tsc-early [ 0.778939] VFS: Disk quotas dquot_6.6.0 [ 0.782960] VFS: Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 0.789972] pnp: PnP ACPI init [ 0.793458] system 00:01: [io 0x0500-0x057f] has been reserved [ 0.799463] system 00:01: [io 0x0400-0x047f] has been reserved [ 0.805470] system 00:01: [io 0x0580-0x059f] has been reserved [ 0.811473] system 00:01: [io 0x0600-0x061f] has been reserved [ 0.817471] system 00:01: [io 0x0880-0x0883] has been reserved [ 0.823467] system 00:01: [io 0x0800-0x081f] has been reserved [ 0.829466] system 00:01: [mem 0xfed1c000-0xfed3ffff] has been reserved [ 0.836164] system 00:01: [mem 0xfed45000-0xfed8bfff] has been reserved [ 0.842855] system 00:01: [mem 0xff000000-0xffffffff] has been reserved [ 0.849553] system 00:01: [mem 0xfee00000-0xfeefffff] has been reserved [ 0.856245] system 00:01: [mem 0xfed12000-0xfed1200f] has been reserved [ 0.862943] system 00:01: [mem 0xfed12010-0xfed1201f] has been reserved [ 0.869644] system 00:01: [mem 0xfed1b000-0xfed1bfff] has been reserved [ 0.876509] system 00:02: [io 0x0a00-0x0a0f] has been reserved [ 0.882511] system 00:02: [io 0x0a10-0x0a1f] has been reserved [ 0.888507] system 00:02: [io 0x0a20-0x0a2f] has been reserved [ 0.894505] system 00:02: [io 0x0a30-0x0a3f] has been reserved [ 0.900510] system 00:02: [io 0x0a40-0x0a4f] has been reserved [ 0.907250] pnp: PnP ACPI: found 5 devices [ 0.916751] clocksource: acpi_pm: mask: 0xffffff max_cycles: 0xffffff, max_idle_ns: 2085701024 ns [ 0.925766] pci 0000:00:1c.4: bridge window [mem 0x00100000-0x000fffff 64bit pref] to [bus 07] add_size 100000 add_align 100000 [ 0.937354] pci 0000:00:1c.4: BAR 15: assigned [mem 0x90000000-0x900fffff 64bit pref] [ 0.945284] pci 0000:00:01.0: PCI bridge to [bus 01] [ 0.950334] pci 0000:00:02.0: PCI bridge to [bus 02] [ 0.955382] pci 0000:00:02.0: bridge window [mem 0xfb300000-0xfb3fffff] [ 0.962253] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 0.969920] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 0.977940] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 0.985694] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 0.993799] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 1.001467] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 1.009484] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 1.017238] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 1.025343] pci 0000:03:00.0: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 1.033013] pci 0000:03:00.0: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 1.041028] pci 0000:03:00.0: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 1.048784] pci 0000:03:00.0: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 1.056888] pci 0000:03:00.1: BAR 7: no space for [mem size 0x00100000 64bit pref] [ 1.064557] pci 0000:03:00.1: BAR 7: failed to assign [mem size 0x00100000 64bit pref] [ 1.072572] pci 0000:03:00.1: BAR 10: no space for [mem size 0x00100000 64bit pref] [ 1.080329] pci 0000:03:00.1: BAR 10: failed to assign [mem size 0x00100000 64bit pref] [ 1.088434] pci 0000:00:03.0: PCI bridge to [bus 03] [ 1.093476] pci 0000:00:03.0: bridge window [io 0xe000-0xefff] [ 1.099650] pci 0000:00:03.0: bridge window [mem 0xfb200000-0xfb2fffff] [ 1.106525] pci 0000:00:03.0: bridge window [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.114373] pci 0000:00:1c.0: PCI bridge to [bus 04] [ 1.119422] pci 0000:05:00.0: PCI bridge to [bus 06] [ 1.124468] pci 0000:05:00.0: bridge window [io 0xd000-0xdfff] [ 1.130644] pci 0000:05:00.0: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.137523] pci 0000:00:1c.2: PCI bridge to [bus 05-06] [ 1.142833] pci 0000:00:1c.2: bridge window [io 0xd000-0xdfff] [ 1.149006] pci 0000:00:1c.2: bridge window [mem 0xfa000000-0xfb0fffff] [ 1.155882] pci 0000:07:00.0: BAR 7: assigned [mem 0x90000000-0x9001ffff 64bit pref] [ 1.163728] pci 0000:07:00.0: BAR 10: assigned [mem 0x90020000-0x9003ffff 64bit pref] [ 1.171664] pci 0000:07:00.1: BAR 7: assigned [mem 0x90040000-0x9005ffff 64bit pref] [ 1.179509] pci 0000:07:00.1: BAR 10: assigned [mem 0x90060000-0x9007ffff 64bit pref] [ 1.187447] pci 0000:00:1c.4: PCI bridge to [bus 07] [ 1.192489] pci 0000:00:1c.4: bridge window [io 0xc000-0xcfff] [ 1.198662] pci 0000:00:1c.4: bridge window [mem 0xfb100000-0xfb1fffff] [ 1.205536] pci 0000:00:1c.4: bridge window [mem 0x90000000-0x900fffff 64bit pref] [ 1.213383] pci_bus 0000:00: Some PCI device resources are unassigned, try booting with pci=realloc [ 1.222526] pci_bus 0000:00: resource 4 [io 0x0000-0x0cf7 window] [ 1.228784] pci_bus 0000:00: resource 5 [io 0x1000-0xffff window] [ 1.235040] pci_bus 0000:00: resource 6 [mem 0x000a0000-0x000bffff window] [ 1.241993] pci_bus 0000:00: resource 7 [mem 0xfedb0000-0xfedb000f window] [ 1.248952] pci_bus 0000:00: resource 8 [mem 0xfedc0000-0xfedc000f window] [ 1.255910] pci_bus 0000:00: resource 9 [mem 0x90000000-0xfbffbfff window] [ 1.262870] pci_bus 0000:02: resource 1 [mem 0xfb300000-0xfb3fffff] [ 1.269222] pci_bus 0000:03: resource 0 [io 0xe000-0xefff] [ 1.274877] pci_bus 0000:03: resource 1 [mem 0xfb200000-0xfb2fffff] [ 1.281223] pci_bus 0000:03: resource 2 [mem 0xfbd00000-0xfbefffff 64bit pref] [ 1.288549] pci_bus 0000:05: resource 0 [io 0xd000-0xdfff] [ 1.294204] pci_bus 0000:05: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.300550] pci_bus 0000:06: resource 0 [io 0xd000-0xdfff] [ 1.306206] pci_bus 0000:06: resource 1 [mem 0xfa000000-0xfb0fffff] [ 1.312551] pci_bus 0000:07: resource 0 [io 0xc000-0xcfff] [ 1.318200] pci_bus 0000:07: resource 1 [mem 0xfb100000-0xfb1fffff] [ 1.324544] pci_bus 0000:07: resource 2 [mem 0x90000000-0x900fffff 64bit pref] [ 1.331959] NET: Registered protocol family 2 [ 1.336604] IP idents hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc) [ 1.345965] tcp_listen_portaddr_hash hash table entries: 16384 (order: 6, 262144 bytes, vmalloc) [ 1.354944] TCP established hash table entries: 262144 (order: 9, 2097152 bytes, vmalloc) [ 1.363470] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes, vmalloc) [ 1.371163] TCP: Hash tables configured (established 262144 bind 65536) [ 1.377964] MPTCP token hash table entries: 32768 (order: 7, 786432 bytes, vmalloc) [ 1.385833] UDP hash table entries: 16384 (order: 7, 524288 bytes, vmalloc) [ 1.392949] UDP-Lite hash table entries: 16384 (order: 7, 524288 bytes, vmalloc) [ 1.400538] NET: Registered protocol family 1 [ 1.404975] NET: Registered protocol family 44 [ 1.409581] pci 0000:00:05.0: disabled boot interrupts on device [8086:6f28] [ 1.433857] pci 0000:00:1a.0: quirk_usb_early_handoff+0x0/0x61f took 16582 usecs [ 1.457845] pci 0000:00:1d.0: quirk_usb_early_handoff+0x0/0x61f took 16088 usecs [ 1.465358] pci 0000:02:00.0: CLS mismatch (64 != 32), using 64 bytes [ 1.471892] pci 0000:06:00.0: Video device with shadowed ROM at [mem 0x000c0000-0x000dffff] [ 1.480383] Unpacking initramfs... [ 1.760451] Freeing initrd memory: 28484K [ 1.764610] PCI-DMA: Using software bounce buffering for IO (SWIOTLB) [ 1.771132] software IO TLB: mapped [mem 0x0000000068000000-0x000000006c000000] (64MB) [ 1.779159] ACPI: bus type thunderbolt registered [ 1.797230] Initialise system trusted keyrings [ 1.801760] Key type blacklist registered [ 1.805871] workingset: timestamp_bits=36 max_order=23 bucket_order=0 [ 1.813810] zbud: loaded [ 1.816687] pstore: using deflate compression [ 1.821316] Platform Keyring initialized [ 1.895322] NET: Registered protocol family 38 [ 1.899847] Key type asymmetric registered [ 1.904022] Asymmetric key parser 'x509' registered [ 1.908987] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 247) [ 1.924278] io scheduler mq-deadline registered [ 1.928895] io scheduler kyber registered [ 1.933012] io scheduler bfq registered [ 1.936988] atomic64_test: passed for x86-64 platform with CX8 and with SSE [ 1.944282] pcieport 0000:00:01.0: PME: Signaling with IRQ 25 [ 1.950266] pcieport 0000:00:02.0: PME: Signaling with IRQ 27 [ 1.956241] pcieport 0000:00:03.0: PME: Signaling with IRQ 29 [ 1.962197] pcieport 0000:00:1c.0: PME: Signaling with IRQ 30 [ 1.968156] pcieport 0000:00:1c.2: PME: Signaling with IRQ 31 [ 1.974110] pcieport 0000:00:1c.4: PME: Signaling with IRQ 32 [ 1.980070] shpchp: Standard Hot Plug PCI Controller Driver version: 0.4 [ 1.987455] input: Power Button as /devices/LNXSYSTM:00/LNXSYBUS:00/PNP0C0C:00/input/input0 [ 1.995929] ACPI: Power Button [PWRB] [ 1.999692] input: Power Button as /devices/LNXSYSTM:00/LNXPWRBN:00/input/input1 [ 2.007213] ACPI: Power Button [PWRF] [ 2.012045] ERST: Error Record Serialization Table (ERST) support is initialized. [ 2.019662] pstore: Registered erst as persistent store backend [ 2.025815] GHES: APEI firmware first mode is enabled by APEI bit and WHEA _OSC. [ 2.033391] Serial: 8250/16550 driver, 4 ports, IRQ sharing enabled [ 2.060325] 00:03: ttyS0 at I/O 0x3f8 (irq = 4, base_baud = 115200) is a 16550A [ 2.088368] 00:04: ttyS1 at I/O 0x2f8 (irq = 3, base_baud = 115200) is a 16550A [ 2.096150] Non-volatile memory driver v1.3 [ 2.100839] rdac: device handler registered [ 2.105155] hp_sw: device handler registered [ 2.109505] emc: device handler registered [ 2.113706] alua: device handler registered [ 2.118041] libphy: Fixed MDIO Bus: probed [ 2.122264] ehci_hcd: USB 2.0 'Enhanced' Host Controller (EHCI) Driver [ 2.128875] ehci-pci: EHCI PCI platform driver [ 2.133493] ehci-pci 0000:00:1a.0: EHCI Host Controller [ 2.138835] ehci-pci 0000:00:1a.0: new USB bus registered, assigned bus number 1 [ 2.146345] ehci-pci 0000:00:1a.0: debug port 2 [ 2.154867] ehci-pci 0000:00:1a.0: irq 18, io mem 0xfb434000 [ 2.167037] ehci-pci 0000:00:1a.0: USB 2.0 started, EHCI 1.00 [ 2.172897] usb usb1: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 2.181263] usb usb1: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.188582] usb usb1: Product: EHCI Host Controller [ 2.193542] usb usb1: Manufacturer: Linux 4.18.0-372.9.1.el8.x86_64 ehci_hcd [ 2.200669] usb usb1: SerialNumber: 0000:00:1a.0 [ 2.205444] hub 1-0:1.0: USB hub found [ 2.209285] hub 1-0:1.0: 2 ports detected [ 2.213548] ehci-pci 0000:00:1d.0: EHCI Host Controller [ 2.218893] ehci-pci 0000:00:1d.0: new USB bus registered, assigned bus number 2 [ 2.226402] ehci-pci 0000:00:1d.0: debug port 2 [ 2.234919] ehci-pci 0000:00:1d.0: irq 18, io mem 0xfb433000 [ 2.247056] ehci-pci 0000:00:1d.0: USB 2.0 started, EHCI 1.00 [ 2.252917] usb usb2: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 2.261286] usb usb2: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.268607] usb usb2: Product: EHCI Host Controller [ 2.273564] usb usb2: Manufacturer: Linux 4.18.0-372.9.1.el8.x86_64 ehci_hcd [ 2.280693] usb usb2: SerialNumber: 0000:00:1d.0 [ 2.285466] hub 2-0:1.0: USB hub found [ 2.289297] hub 2-0:1.0: 2 ports detected [ 2.293483] ohci_hcd: USB 1.1 'Open' Host Controller (OHCI) Driver [ 2.299755] ohci-pci: OHCI PCI platform driver [ 2.304290] uhci_hcd: USB Universal Host Controller Interface driver [ 2.310835] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 2.316190] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 3 [ 2.324740] xhci_hcd 0000:00:14.0: hcc params 0x200077c1 hci version 0x100 quirks 0x0000000000009810 [ 2.334104] usb usb3: New USB device found, idVendor=1d6b, idProduct=0002, bcdDevice= 4.18 [ 2.342472] usb usb3: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.349791] usb usb3: Product: xHCI Host Controller [ 2.354751] usb usb3: Manufacturer: Linux 4.18.0-372.9.1.el8.x86_64 xhci-hcd [ 2.361879] usb usb3: SerialNumber: 0000:00:14.0 [ 2.366667] hub 3-0:1.0: USB hub found [ 2.370508] hub 3-0:1.0: 15 ports detected [ 2.376341] xhci_hcd 0000:00:14.0: xHCI Host Controller [ 2.381709] xhci_hcd 0000:00:14.0: new USB bus registered, assigned bus number 4 [ 2.389208] xhci_hcd 0000:00:14.0: Host supports USB 3.0 SuperSpeed [ 2.395573] usb usb4: New USB device found, idVendor=1d6b, idProduct=0003, bcdDevice= 4.18 [ 2.403943] usb usb4: New USB device strings: Mfr=3, Product=2, SerialNumber=1 [ 2.411269] usb usb4: Product: xHCI Host Controller [ 2.416227] usb usb4: Manufacturer: Linux 4.18.0-372.9.1.el8.x86_64 xhci-hcd [ 2.423356] usb usb4: SerialNumber: 0000:00:14.0 [ 2.428162] hub 4-0:1.0: USB hub found [ 2.432058] hub 4-0:1.0: 6 ports detected [ 2.437020] usbcore: registered new interface driver usbserial_generic [ 2.443638] usbserial: USB Serial support registered for generic [ 2.449751] i8042: PNP: No PS/2 controller found. [ 2.454576] mousedev: PS/2 mouse device common for all mice [ 2.460293] rtc_cmos 00:00: RTC can wake from S4 [ 2.465133] rtc_cmos 00:00: registered as rtc0 [ 2.469662] rtc_cmos 00:00: alarms up to one month, y3k, 114 bytes nvram, hpet irqs [ 2.477427] intel_pstate: Intel P-state driver initializing [ 2.484031] usb 1-1: new high-speed USB device number 2 using ehci-pci [ 2.484034] hid: raw HID events driver (C) Jiri Kosina [ 2.495904] usbcore: registered new interface driver usbhid [ 2.501558] usbhid: USB HID core driver [ 2.505595] drop_monitor: Initializing network drop monitor service [ 2.511979] Initializing XFRM netlink socket [ 2.516403] NET: Registered protocol family 10 [ 2.521132] Segment Routing with IPv6 [ 2.524882] NET: Registered protocol family 17 [ 2.529485] mpls_gso: MPLS GSO support [ 2.533699] microcodeg=0x406f1, pf=0x1, revision=0xb000010 [ 2.539703] microcode: Microcode Update Driver: v2.2. [ 2.539771] resctrl: L3 allocation detected [ 2.542029] usb 2-1: new high-speed USB device number 2 using ehci-pci [ 2.544905] resctrl: L3DATA allocation detected [ 2.560416] resctrl: L3CODE allocation detected [ 2.565023] resctrl: L3 monitoring detected [ 2.569304] AVX2 version of gcm_enc/dec engaged. [ 2.574005] AES CTR mode by8 optimization enabled [ 2.604385] sched_clock: Marking stable (2604380900, 0)->(5557189356, -2952808456) [ 2.612140] registered taskstats version 1 [ 2.616476] Loading compiled-in X.509 certificates [ 2.625352] usb 1-1: New USB device found, idVendor=8087, idProduct=800a, bcdDevice= 0.05 [ 2.633638] usb 1-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.641018] hub 1-1:1.0: USB hub found [ 2.645002] hub 1-1:1.0: 6 ports detected [ 2.646698] Loaded X.509 cert 'Red Hat Enterprise Liux kernel signing key: fcec8079a12caa6a157125702c0054357b4fc157' [ 2.649028] usb 3-12: new high-speed USB device number 2 using xhci_hcd [ 2.666790] Loaded X.509 cert 'Red Hat Enterprise Linux Driver Update Program (key 3): bf57f3e87362bc7229d9f465321773dfd1f77a80' [ 2.677349] usb 2-1: New USB device found, idVendor=8087, idProduct=8002, bcdDevice= 0.05 [ 2.678718] Loaded X.509 cert 'Red Hat Enterprise Linux kpatch signing key: 4d38fd864ebe18c5f0b72e3852e2014c3a676fc8' [ 2.686733] usb 2-1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.697468] zswap: loaded using pool lzo/zbud [ 2.704883] hub 2-1:1.0: USB hub found [ 2.712994] page_owner is disabled [ 2.713097] hub 2-1:1.0: 8 ports detected [ 2.721204] Key type big_key registered [ 2.727483] Key type encrypted registered [ 2.731586] ima: No TPM chip found, activating TPM-bypass! [ 2.737158] ima: Allocated hash algorithm: sha256 [ 2.741951] ima: No architecture policies found [ 2.746569] evm: Initialising EVM extended attributes: [ 2.751793] evm: security.selinux [ 2.755192] evm: security.ima [ 2.758240] evm: security.capability [ 2.761898] evm: HMAC attrs: 0x1 [ 2.765507] rtc_cmos 00:00: setting system clock to 2023-09-30 17:04:30 UTC (1696093470) [ 2.774653] Freeing unused decrypted memory: 2036K [ 2.776220] usb 3-12: New USB device found, idVendor=0557, idProduct=7000, bcdDevice= 0.00 [ 2.787903] usb 3-12: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ 2.795475] hub 3-12:1.0: USB hub found [ 2.795544] Freeing unused kernel image (initmem) memory: 2520K [ 2.799476] hub 3-12:1.0: 4 ports detected [ 2.819096] Write protecting the kernel read-only data: 24576k [ 2.825365] Freeing unused kernel image (text/rodata gap) memory: 2012K [ 2.832347] Freeing unused kernel image (rodata/data gap) memory: 1948K [ 2.847029] tsc: Refined TSC clocksource calibration: 3499.996 MHz [ 2.853313] clocksource: tsc: mask: 0xffffffffffffffff max_cycles: 0x32734d20948, max_idle_ns: 440795306379 ns [ 2.853364] clocksource: Switched to clocksource tsc [ 2.868580] systemd[1]: systemd 239 (239-58.el8) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 2.903134] systemd[1]: Detected architecture x86-64. [ 2.908278] systemd[1]: Running in initial RAM disk. Welcome to Red Hat Enterprise Linux 8.6 (Ootpa) dracut-049-201.git20220131.el8 (Initramfs)! [ 2.932120] systemd[1]: Set hostname to . [ 2.976767] systemd[1]: Reached target Slices. [ OK ] Reached target Slices. [ 2.987318] systemd[1]: Listening on Journal Socket. [ OK ] Listening on Journal Socket. [ 2.999928] systemd[1]: Starting Apply Kernel Variables... Starting Apply Kernel Variables... [ 3.011488] systemd[1]: Started Memstrack Anylazing Service. [ OK ] Staice. [ 3.024emd[1]: Starting Create list of required static device nodes for the current kernel... Starting Create list of required st…ce nodes for the current kernel... [ 3.043128] systemd[1]: Listening on Journal Socket (/dev/log). [ OK ] Listening on Journal Socket (/dev/log). Starting Journal Service... [ OK ] Listening on udev Kernel Socket. [ OK ] Listening on udev Control Socket. [ OK ] Reached target Sockets. [ OK ] Reached target Timers. Starting Setup Virtual Console... [ OK ] Reached target Swap. [ 3.103011] usb 3-12.1: new low-speed USB device number 3 using xhci_hcd [ l File Systems. Starting Creat. [ OK ] Started Journal Service. [ OK ] Started Apply Kernel Variables. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Setup Virtual Console. [ OK ] Started Create Volatile Files and Directories. Starting dracut cmdline hook... Starting Create Static Device Nodes in /dev... [ OK ] Started Create Static Device[ 3.213346] usb 3-12.1: New USB device found, idVendor=0557, idProduct=2419, bcdDevice= 1.00 [ 3.221909] usb 3-12.1: New USB device strings: Mfr=0, Product=0, SerialNumber=0 [ OK ] Started dracut cmdline hook. [ 3.234699] i HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.0/0003:0557:2419.0001/input/input2 Starting dracut pre-udev hook... [ OK ] Started dracut pre-udev hook. Starting udev Kernel Device Manager... [ OK ] Started udev Kernel Device Manager. Starting udev Coldplug all Devices... [ 3.298202] hneric 0003:0557:2419.0001: input,hidraw0: USB HID v1.00 Keyboard [HID 0557:2419] on usb-0000:00:14.0-12.1/input0 Mountin[ 3.310803] input: HID 0557:2419 as /devices/pci0000:00/0000:00:14.0/usb3/3-12/3-12.1/3-12.1:1.1/0003:0557:2419.0002/input/input3 g Kernel Configu[ 3.323484] hid-generic 0003:0557:2419.0002: input,hidraw1: USB HID v1.00 Mouse [HID 0557:2419] on usb-0000:00:14.0-12.1/input1 ration File System... [ OK ] Mounted Kernel Configuration File System. [ OK ] Started udev Coldplug all Devices. Starting Show Plymouth Boot Screen... Starting dracut initqueue hook... [[[ 3.420627] dca service started, version 1.12.1 0;32m OK ] Reached target System Initialization. [ OK ] Started Show Plymouth Boot Screen. [ OK ] Reached target Paths. [ OK ] Started Forward Password Requests to Plymouth [ 3.445332] ahci 0000:00:11.4: AHCI 0001.0300 32 slots 4 ports 6 Gbps 0xf impl SATA mode Directory Watch.[ 3.446982] nvme nvme0: pci function 0000:02:00.0 [ OK [ 3.454252] ahci 0000:00:11.4: flags: 64bit ncq pm led clo pio slum part ems apst ] Reached t[ 3.462698] nvme nvme0: 8/0/0 default/read/poll queues arget Basic Syst[ 3.476142] ixgbe: Intel(R) 10 Gigabit PCI Express Network Driver em. [ 3.476652] nvme0n1: detected capacity change from 0 to 400088457216 [ 3.483255] ixgbe: Copyright (c) 1999-2016 Intel Corporation. [ 3.484571] scsi host0: ahci [ 3.490672] scsi host1: ahci [ 3.502111] igb: Intel(R) Gigabit Ethernet Network Driver [ 3.502119] scsi host2: ahci [ 3.507600] igb: Copyright (c) 2007-2014 Intel Corporation. [ 3.510720] scsi host3: ahci [ 3.519258] ata1: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438100 irq 34 [ 3.526778] ata2: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438180 irq 34 [ 3.526781] ata3: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438200 irq 34 [ 3.526786] ata4: SATA max UDMA/133 abar m2048@0xfb438000 port 0xfb438280 irq 34 [ 3.527074] ahci 0000:00:1f.2: AHCI 0001.0300 32 slots 6 ports 6 Gbps 0x3f impl SATA mode [ 3.557594] ahci 0000:00:1f.2: flags: 64bit ncq pm led clo pio slum part ems apst [ 3.572634] igb 0000:07:00.0: added PHC on eth0 [ 3.572921] scsi host4: ahci [ 3.577252] igb 0000:07:00.0: Intel(R) Gigabit Ethernet Network Connection [ 3.580352] scsi host5: ahci [ 3.587192] igb 0000:07:00.0: eth0: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:38:e6 [ 3.590268] scsi host6: ahci [ 3.597451] igb 0000:07:00.0: eth0: PBA No: 050B00-000 [ 3.600457] scsi host7: ahci [ 3.605566] igb 0000:07:00.0: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 3.608639] scsi host8: ahci [ 3.619282] scsi host9: ahci [ 3.622321] ata5: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432100 irq 54 [ 3.622465] ast 0000:06:00.0: [drm] Using P2A bridge for configuration [ 3.629835] ata6: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432180 irq 54 [ 3.636463] ast 0000:06:00.0: [drm] AST 2400 detected [ 3.643958] ata7: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432200 irq 54 [ 3.643960] ata8: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432280 irq 54 [ 3.649125] ast 0000:06:00.0: [drm] Analog VGA only [ 3.656610] ata9: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432300 irq 54 [ 3.656612] ata10: SATA max UDMA/133 abar m2048@0xfb432000 port 0xfb432380 irq 54 [ 3.664133] ast 0000:06:00.0: [drm] dram MCLK=408 Mhz type=1 bus_width=16 [ 3.671430] igb 0000:07:00.1: added PHC on eth1 [ 3.677509] [drm] Initialized ast 0.1.0 20120228 for 0000:06:00.0 on minor 0 [ 3.684173] igb 0000:07:00.1: Intel(R) Gigabit Ethernet Network Connection [ 3.684174] igb 0000:07:00.1: eth1: (PCIe:5.0Gb/s:Width x4) 0c:c4:7a:d9:38:e7 [ 3.717036] fbcon: astdrmfb (fb0) is primary device [ 3.717109] igb 0000:07:00.1: eth1: PBA No: 050B00-000 [ 3.717110] igb 0000:07:00.1: Using MSI-X interrupts. 8 rx queue(s), 8 tx queue(s) [ 3.719340] igb 0000:07:00.1 eno2: renamed from eth1 [ 3.829088] Console: switching to colour frame buffer device 128x48 [ 3.831418] igb 0000:07:00.0 eno1: renamed from eth0 [ 3.837711] ata2: SATA link down (SStatus 0 SControl 300) [ 3.838361] ata3: SATA link down (SStatus 0 SControl 300) [ 3.838729] ata1: SATA link down (SStatus 0 SControl 300) [ 3.838974] ata4: SATA link down (SStatus 0 SControl 300) [ 3.904166] ast 0000:06:00.0: [drm] fb0: astdrmfb frame buffer device [ 3.980300] ata9: SATA link down (SStatus 0 SControl 300) [ 3.985781] ata8: SATA link down (SStatus 0 SControl 300) [ 3.991264] ata10: SATA link down (SStatus 0 SControl 300) [ 3.996851] ata6: SATA link down (SStatus 0 SControl 300) [ 4.002372] ata7: SATA link down (SStatus 0 SControl 300) [ 4.007905] ata5: SATA link up 6.0 Gbps (SStatus 133 SControl 300) [ 4.015802] ata5.00: NCQ Send/Recv Log not supported [ 4.020775] ata5.00: ATA-9: ST1000NM0033-9ZM173, SN06, max UDMA/133 [ 4.027049] ata5.00: 1953525168 sectors, multi 16: LBA48 NCQ (depth 32), AA [ 4.035586] ata5.00: NCQ Send/Recv Log not supported [ 4.040564] ata5.00: configured for UDMA/133 [ 4.044952] scsi 4:0:0:0: Direct-Access ATA ST1000NM0033-9ZM SN06 [ 4.057971] scsi 4:0:0:0: Attached scsi generic sg0 type 0 [ 4.070562] sd 4:0:0:0: [sda] 1953525168 512-byte logical blocks: (1.00 TB/932 GiB) [ 4.078929] sd 4:0:0:0: [sda] Write Protect is off [ 4.084476] sd 4:0:0:0: [sda] Write cache: enabled, read cache: enabled, doesn't support DPO or FUA [ 4.107556] sda: sda1 [ 4.111032] sd 4:0:0:0: [sda] Attached SCSI disk [ OK ] Found device ST1000NM0033-9ZM173 1. [ OK ] Reached target Initrd Root Device. [ 4.628278] ixgbe 0000:03:00.0: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 4.639004] ixgbe 0000:03:00.0: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 4.647969] ixgbe 0000:03:00.0: MAC: 2, PHY: 1, PBA No: 0210FF-0FF [ 4.654585] ixgbe 0000:03:00.0: 0c:c4:7a:88:6d:e8 [ 4.669084] ixgbe 0000:03:00.0: Intel(R) 10 Gigabit Network Connection [ 4.676483] libphy: ixgbe-mdio: probed [ 4.860181] ixgbe 0000:03:00.1: Multiqueue Enabled: Rx Queue count = 8, Tx Queue count = 8 XDP Queue count = 0 [ 4.870897] ixgbe 0000:03:00.1: 32.000 Gb/s available PCIe bandwidth (5.0 GT/s PCIe x8 link) [ 4.879850] ixgbe 0000:03:00.1: MAC: 2, PHY: 14, SFP+: 4, PBA No: 0210FF-0FF [ 4.887331] ixgbe 0000:03:00.1: 0c:c4:7a:88:6d:e9 [ 4.906625] ixgbe 0000:03:00.1: Intel(R) 10 Gigabit Network Connection [ 4.914712] libphy: ixgbe-mdio: probed [ 4.926798] ixgbe 0000:03:00.1 enp3s0f1: renamed from eth1 [ 4.975305] ixgbe 0000:03:00.0 enp3s0f0: renamed from eth0 [ OK ] Started dracut initqueue hook. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting File System Check on /dev/…b72-f581-4b1d-8578-0d8161fd4ca1... [ OK ] Started File System Check on /dev/d…86b72-f581-4b1d-8578-0d8161fd4ca1. Mounting /sysroot... [ 5.179166] EXT4-fs (sda1): mounted filesystem with ordered data mode. Opts: (null) [ OK ] Mounted /sysroot. [ OK ] Reached target Initrd Root File System. Starting Reload Configuration from the Real Root... [ OK ] Started Reload Configuration from the Real Root. [ OK ] Reached target Initrd File Systems. [ OK ] Reached target Initrd Default Target. Starting dracut pre-pivot and cleanup hook... [ OK ] Started dracut pre-pivot and cleanup hook. Starting Cleaning Up and Shutting Down Daemons... [ OK ] Stopped dracut pre-pivot and cleanup hook. [ OK ] Stopped target Timers. [ OK ] Stopped target Initrd Default Target. [ OK ] Stopped target Initrd Root Device. [ OK ] Stopped target Remote File Systems. [ OK ] Stopped target Remote File Systems (Pre). [ OK ] Stopped target Basic System. [ OK ] Stopped target Slices. [ OK ] Stopped target Sockets. [ OK ] Stopped target Paths. [ OK ] Stopped dracut initqueue hook. [ OK ] Stopped target System Initialization. Stopping udev Kernel Device Manager... [ OK ] Stopped Apply Kernel Variables. [ OK ] Stopped target Swap. [ OK ] Stopped Create Volatile Files and Directories. [ OK ] Stopped target Local File Systems. Starting Setup Virtual Console... [ OK ] Stopped udev Coldplug all Devices. Starting Plymouth switch root service... [ OK ] Started Cleaning Up and Shutting Down Daemons. [ OK ] Stopped udev Kernel Device Manager. [ OK ] Stopped dracut pre-udev hook. [ OK ] Stopped dracut cmdline hook. [ OK ] Stopped Create Static Device Nodes in /dev. [ OK ] Stopped Create list of required sta…vice nodes for the current kernel. [ OK ] Closed udev Kernel Socket. [ OK ] Closed udev Control Socket. Starting Cleanup udevd DB... [ OK ] Started Cleanup udevd DB. [ OK ] Started Setup Virtual Console. [ OK ] Reached target Switch Root. [ OK ] Started Plymouth switch root service. Starting Switch Root... [ 5.633487] printk: systemd: 10 output lines suppressed due to ratelimiting [ 6.274319] SELinux: policy capability network_peer_controls=1 [ 6.280579] SELinux: policy capability open_perms=1 [ 6.285842] SELinux: policy capability extended_socket_class=1 [ 6.292057] SELinux: policy capability always_check_network=0 [ 6.298175] SELinux: policy capability cgroup_seclabel=1 [ 6.303860] SELinux: policy capability nnp_nosuid_transition=1 [ 6.332995] audit: type=1403 audit(1696093474.065:2): auid=4294967295 ses=4294967295 lsm=selinux res=1 [ 6.334495] systemd[1]: Successfully loaded SELinux policy in 223.437ms. [ 6.410830] systemd[1]: Relabelled /dev, /run and /sys/fs/cgroup in 19.242ms. [ 6.448552] systemd[1]: systemd 239 (239-58.el8) running in system mode. (+PAM +AUDIT +SELINUX +IMA -APPARMOR +SMACK +SYSVINIT +UTMP +LIBCRYPTSETUP +GCRYPT +GNUTLS +ACL +XZ +LZ4 +SECCOMP +BLKID +ELFUTILS +KMOD +IDN2 -IDN +PCRE2 default-hierarchy=legacy) [ 6.483067] systemd[1]: Detected architecture x86-64. Welcome to Red Hat Enterprise Linux 8.6 (Ootpa)! [ 6.501616] systemd[1]: Set hostname to . [ 7.502446] systemd[1]: systemd-journald.service: Succeeded. [ 7.524345] systemd[1]: initrd-switch-root.service: Succeeded. [ 7.532682] systemd[1]: Stopped Switch Root. [ OK [[ 7.538289] systemd[1]: systemd-journald.service: Service has no hold-off time (RestartSec=0), scheduling restart. 0m] Stopped Swit[ 7.538384] systemd[1]: systemd-journald.service: Scheduled restart job, restart counter is at 1. ch Root. [ 7.538467] systemd[1]: Stopped Journal Service. [ OK [[ 7.567197] systemd[1]: Starting Journal Service... 0m] Stopped Journal Service. Starting Journal Service... [ OK ] Created slice User and Session Slice. [ OK ] Reached target Slices. Mounting Huge Pages File System... Starting Read and set NIS domainname from /etc/sysconfig/network... [ OK ] Reached target Swap. Mounting Kernel Debug File System... [ OK ] Created slice system-serial\x2dgetty.slice. Mounting POSIX Message Queue File System... [ OK ] Listening on LVM2 poll daemon socket. [ OK ] Created slice system-getty.slice. [ OK ] Listening on Process Core Dump Socket. [ OK ] Listening on udev Kernel Socket. [ OK ] Stopped target Switch Root. [ OK ] Stopped target Initrd File Systems. Starting Setup Virtual Console... [ OK ] Listening on udev Control Socket. [ OK ] Created slice system-sshd\x2dkeygen.slice. Starting Create list of required st…ce nodes for the current kernel... [ OK ] Stopped Plymouth switch root service. [ OK ] Reached target ceph target allowing…ph-mon@.service instances at once. [ OK ] Reached target ceph target allowing…ph-mgr@.service instances at [ 7.687688] EXT4-fs (sda1): re-mounted. Opts: (null) once. [ OK ] Reached target ceph target allowing…ph-osd@.service instances at once. [ OK ] Listening on initctl Compatibility Named Pipe. [ OK ] Reached target ceph target allowing…mirror@.service instances at once. [ OK ] Listening on RPCbind Server Activation Socket. [ OK ] Reached target RPC Port Mapper. [ OK ] Started Forward Password Requests to Wall Directory Watch. [ OK ] Reached target Local Encrypted Volumes. Starting Remount Root and Kernel File Systems... [ OK ] Set up automount Arbitrary Executab…rmats File System Automount Point. [ OK ] Reached target ceph target allowing…ph-mds@.service instances at once. [ OK ] Listening on Device-mapper event daemon FIFOs. Starting Monitoring of LVM2 mirrors…ng dmeventd or progress polling... Starting Load Kernel Modules... [ OK ] Reached target ceph target allowing…adosgw@.service instances at once. Starting udev Coldplug all Devices... [ OK ] Stopped target Initrd Root File System. [ OK ] Started Journal Service. [ OK ] Mounted Huge Pages File System. [ OK ] Started Read and set NIS domainname from /etc/sysconfig/network. [ OK ] Mounted Kernel Debug File System. [ OK ] Mounted POSIX Message Queue File System. [ OK ] Started Create list of required sta…vice nodes for the current kernel. [ OK ] Started Remount Root and Kernel File Syst[ 7.835561] fuse: init (API version 7.33) ems. Starting Load/Save Random Seed... Starting Flush Journal to Persistent Storage... Starting Create Static Device Nodes in /dev... [ OK ] Started Load/Save Random Seed. [ OK ] Started Flush Journal to Persi[ 7.863401] device-mapper: uevent: version 1.0.3 stent Storage. [ OK [ 7.870485] device-mapper: ioctl: 4.43.0-ioctl (2020-10-01) initialised: dm-devel@redhat.com [0m] Started Load Kernel Modules. Mounting FUSE Control File System... Starting Apply Kernel Variables... [ OK ] Mounted FUSE Control File System. [ OK ] Started udev Coldplug all Devices. [ OK ] Started Setup Virtual Console. [ OK ] Started Apply Kernel Variables. [ OK ] Started Monitoring of LVM2 mirrors,…sing dmeventd or progress polling. [ OK ] Started Create Static Device Nodes in /dev. Starting udev Kernel Device Manager... [ OK ] Reached target Local File Systems (Pre). [ OK ] Reached target Local File Systems. Starting Import network configuration from initramfs... Starting Restore /run/initramfs on shutdown... Starting Tell Plymouth To Write Out Runtime Data... [ OK ] Started Restore /run/initramfs on shutdown. [ OK ] Started Tell Plymouth To Write Out Runtime Data. [ OK ] Started Import network configuration from initramfs. Starting Create Volatile Files and Directories... [ OK ] Started udev Kernel Device Manager. [ OK ] Started Create Volatile Files and Directories. Starting RPC Bind... Mounting RPC Pipe File System... Starting Security Auditing Service... [ 8.440057] IPMI message handler: version 39.2 [ 8.450586] ipmi device interface [ 8.468901] ipmi_si: IPMI System Interface driver [ 8.474723] ipmi_si dmi-ipmi-si.0: ipmi_platform: probing via SMBIOS [ 8.477572] RPC: Registered named UNIX socket transport module. [ 8.482235] ipmi_platform: ipmi_si: SMBIOS: io 0xca2 regsize 1 spacing 1 irq 0 [ 8.489184] RPC: Registered udp transport module. [ 8.489185] RPC: Registered tcp transport module. [ 8.489186] RPC: Registered tcp NFSv4.1 backchannel transport module. [ 8.497319] ipmi_si: Adding SMBIOS-specified kcs state machine [ OK ] Started RPC [ 8.524221] ipmi_si IPI0001:00: ipmi_platform: probing via ACPI Bind. [ OK [[ 8.539325] ipmi_si IPI0001:00: ipmi_platform: [io 0x0ca2] regsize 1 spacing 1 irq 0 0m] Mounted RPC [ 8.544941] power_meter ACPI000D:00: Found ACPI power meter. Pipe File System[ 8.555877] power_meter ACPI000D:00: Ignoring unsafe software power cap! . [ OK ] Reached targ[ 8.565215] ipmi_si dmi-ipmi-si.0: Removing SMBIOS-specified kcs state machine in favor of ACPI et rpc_pipefs.ta[ 8.565218] ipmi_si: Adding ACPI-specified kcs state machine rget. [ 8.565696] ipmi_si: Trying ACPI-specified kcs state machine at i/o address 0xca2, slave address 0x20, irq 0 [ 8.594604] ioatdma: Intel(R) QuickData Technology Driver 5.00 [ OK ] Created slice system-lvm2\x2dpvscan.slice. Starting LVM event activation on device 259:0... [ 8.617612] igb 0000:07:00.0: DCA enabled [ 8.623051] ipmi_si IPI0001:00: The BMC does not support clearing the recv irq bit, compensating, but the BMC needs to be fixed. [ 8.623080] igb 0000:07:00.1: DCA enabled [ 8.644381] ipmi_si IPI0001:00: IPMI message handler: Found new BMC (man_id: 0x002a7c, prod_id: 0x0833, dev_id: 0x20) [ 8.688466] ipmi_si IPI0001:00: IPMI kcs interface initialized [ 8.695600] mei_me 0000:00:16.0: Device doesn't have valid ME Interface [ 8.708672] ipmi_ssif: IPMI SSIF Interface driver [ 8.833157] i801_smbus 0000:00:1f.3: SMBus using PCI interrupt [ 8.833542] input: PC Speaker as /devices/platform/pcspkr/input/input4 [ OK ] Started Security Auditing Service. Starting Update UTMP about System Boot/Shutdown... [ OK ] Started Update UTMP about System Boot/Shutdown. [ 8.943280] iTCO_vendor_support: vendor-support=0 [ OK ] Found device /dev/vg_nvme/lv_5. [ 8.956871] iTCO_wdt: Intel TCO WatchDog Timer Driver v1.11 Mountin[ 8.963326] iTCO_wdt: Found a Wellsburg TCO device (Version=2, TCOBASE=0x0460) g /var/lib/ceph.[ 8.963614] iTCO_wdt: initialized. heartbeat=30 sec (nowayout=0) .. [ 8.972911] RAPL PMU: API unit is 2^-32 Joules, 2 fixed counters, 655360 ms ovfl timer [ 8.988802] RAPL PMU: hw unit of domain package 2^-14 Joules [ 8.988803] RAPL PMU: hw unit of domain dram 2^-16 Joules [ OK ] Reached target System Initialization. [ OK ] Started Daily Cleanup of Temporary Directories. [ OK ] Started Run system activity accounting tool every 10 minutes. [ OK ] Started daily update of the root trust anchor for DNSSEC. [ OK ] Started CUPS Scheduler. [ OK ] Reached target Paths. [ OK ] Started Generate summary of yesterday's process accounting. [ OK ] Listening on Avahi mDNS/DNS-SD Stack Activation Socket. [ OK ] Started Updates mlocate database every day. [ OK ] Reached target Timers. [ OK ] Listening on D-Bus System Message Bus Socket. [ OK ] Listening on CUPS Scheduler. [ OK ] Listening on SSSD Kerberos Cache Manager responder socket. [ OK ] Reached target Sockets. [ OK ] Reached target Basic System. Starting System Security Services Daemon... [ OK ] Started Machine Check Exception Logging Daemon. Starting NTP client/server... [ OK ] Started libstoragemgmt plug-in server daemon. Starting Self Monitoring and Reporting Technology (SMART) Daemon... Starting Resets System Activity Logs... Starting Authorization Manager... Starting Kernel Samepage Merging... Starting Avahi mDNS/DNS-SD Stack... [ OK ] Reached target sshd-keygen.target. [ OK ] Started Ceph crash dump collector. [ OK ] Reached target ceph target allowing… ceph*@.service instances at once. [ OK ] Started D-Bus System Message Bus. Starting Network Manager... [ 9.185520] SGI XFS with ACLs, security attributes, quota, no debug enabled [ 9.187332] XFS (dm-4): Mounting V5 Filesystem [ 9.194275] XFS (dm-4): Ending clean mount Starting Load CPU microcode update... Starting VDO volume services... [ OK ] Started irqbalance daemon. [ OK ] Started LVM event activation on device 259:0. [ OK ] Mounted /var/lib/ceph. [ 9.508879] EDAC MC0: Giving out device to module sb_edac controller Broadwell SrcID#0_Ha#0: DEV 0000:ff:12.0 (INTERRUPT) [ 9.520266] EDAC sbridge: Ver: 1.1.2 [ 9.716203] intel_rapl_common: Found RAPL domain package [ 9.739235] intel_rapl_common: Found RAPL domain dram [ 9.744712] intel_rapl_common: DRAM domain energy unit 15300pj [ OK ] Started Self Monitoring and Reporting Technology (SMART) Daemon. [ OK ] Started Resets System Activity Logs. [ OK ] Started Kernel Samepage Merging. [ OK ] Started Load CPU microcode update. Starting Kernel Samepage Merging (KSM) Tuning Daemon... [ OK ] Started Avahi mDNS/DNS-SD Stack. [ OK ] Started NTP client/server. [ OK ] Started Kernel Samepage Merging (KSM) Tuning Daemon. [ OK ] Started Network Manager. Starting Network Manager Wait Online... [ OK ] Reached target Network. Starting Enable periodic update of entitlement certificates.... Starting Dynamic System Tuning Daemon... Starting OpenSSH server daemon... Starting GSSAPI Proxy Daemon... [ OK ] Started Enable periodic update of entitlement certificates.. Starting Hostname Service... [ OK ] Started Hostname Service. [ OK ] Started OpenSSH server daemon. [ OK ] Started GSSAPI Proxy Daemon. [ OK ] Reached target NFS client services. [ OK ] Reached target Remote File Systems (Pre). [ OK ] Reached target Remote File Systems. Starting Network Manager Script Dispatcher Service... [ OK ] Started Authorization Manager. [ OK ] Started Network Manager Script Dispatcher Service. [ 11.255692] IPv6: ADDRCONF(NETDEV_UP): eno1: link is not ready [ 11.310579] IPv6: ADDRCONF(NETDEV_UP): eno1: link is not ready [ 11.321229] IPv6: ADDRCONF(NETDEV_UP): eno2: link is not ready [ 11.379983] IPv6: ADDRCONF(NETDEV_UP): eno2: link is not ready [ 11.392448] IPv6: ADDRCONF(NETDEV_UP): enp3s0f0: link is not ready [ 11.440081] ixgbe 0000:03:00.0: registered PHC device on enp3s0f0 [ 11.551929] IPv6: ADDRCONF(NETDEV_UP): enp3s0f0: link is not ready [ 11.562235] IPv6: ADDRCONF(NETDEV_UP): enp3s0f1: link is not ready [ 11.609831] ixgbe 0000:03:00.1: registered PHC device on enp3s0f1 [ 11.719941] IPv6: ADDRCONF(NETDEV_UP): enp3s0f1: link is not ready [ 11.827425] ixgbe 0000:03:00.1 enp3s0f1: detected SFP+: 4 [ OK ] Started System Security Services Daemon. [ OK ] Reached target User and Group Name Lookups. Starting Login Service... Starting Permit User Sessions... [ 11.936303] ixgbe 0000:03:00.1 enp3s0f1: NIC Link is Up 10 Gbps, Flow Control: RX/TX Starti[ 11.945592] IPv6: ADDRCONF(NETDEV_CHANGE): enp3s0f1: link becomes ready ng CUPS Scheduler... [ OK ] Started VDO volume services. [ OK ] Started Permit User Sessions. [ OK ] Started Job spooling tools. [ OK ] Started Command Scheduler. [ OK ] Started Login Service. [ OK ] Started CUPS Scheduler. [ OK ] Started Dynamic System Tuning Daemon. [ OK ] Started Network Manager Wait Online. [ OK ] Reached target Network is Online. Starting Crash recovery kernel arming... [ OK ] Started Nagios Remote Plugin Executor. Starting System Logging Service... Starting /etc/rc.d/rc.local Compatibility... Starting Notify NFS peers of a restart... + '[' '!' -f /.cephlab_net_configured ']' + set +e + attempts=0 + myips= + '[' '' '!=' '' ']' + '[' 0 -ge 10 ']' ++ ip -4 addr ++ grep -oP '(?<=inet\s)\d+(\.\d+){3}' ++ grep -v '127.0.0.1\|127.0.1.1' [ OK ] Started Notify NFS peers of a restart. + myips=172.21.15.134 + attempts=1 + sleep 1 [ OK ] Started System Logging Service. + '[' 172.21.15.134 '!=' '' ']' + set -e + '[' -n 172.21.15.134 ']' + for ip in $myips + timeout 1s ping -I 172.21.15.134 -nq -c1 172.21.0.1 ++ dig +short -x 172.21.15.134 @172.21.0.1 ++ sed 's/\.com.*/\.com/g' + newhostname=smithi134.front.sepia.ceph.com + '[' -n smithi134.front.sepia.ceph.com ']' + hostname smithi134.front.sepia.ceph.com ++ hostname -d + newdomain=front.sepia.ceph.com ++ hostname -s + shorthostname=smithi134 + echo smithi134 + grep -q front.sepia.ceph.com /etc/hosts + sed -i '1i172.21.15.134 smithi134.front.sepia.ceph.com smithi134\' /etc/hosts + break + command -v zypper + command -v apt-get + '[' -e /.cephlab_rc_local ']' + exit 0 [ OK ] Started /etc/rc.d/rc.local Compatibility. Starting Terminate Plymouth Boot Screen... Starting Hold until boot process finishes up... Red Hat Enterprise Linux 8.6 (Ootpa) Kernel 4.18.0-372.9.1.el8.x86_64 on an x86_64 Activate the web console with: systemctl enable --now cockpit.socket smithi134 login: [disconnect] 2023-09-30T17:04:52.994 INFO:teuthology.misc:Re-opening connections... 2023-09-30T17:04:52.994 INFO:teuthology.misc:trying to connect to ubuntu@smithi134.front.sepia.ceph.com 2023-09-30T17:04:52.994 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2023-09-30T17:04:52.995 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T17:04:52.998 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~126s 2023-09-30T17:04:54.072 DEBUG:teuthology.orchestra.run.smithi134:> true 2023-09-30T17:04:54.896 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2023-09-30T17:04:54.896 DEBUG:teuthology.misc:waited 1.9021193981170654 2023-09-30T17:04:55.896 DEBUG:tasks.ceph_manager:Mounting data for osd.2 on ubuntu@smithi134.front.sepia.ceph.com 2023-09-30T17:04:55.897 INFO:tasks.ceph_manager:Mounting osd.2: dev: ubuntu@smithi134.front.sepia.ceph.com, cluster: cephmountpoint: /var/lib/ceph/osd/ceph-2, type: xfs, options: ['noatime'] 2023-09-30T17:04:55.897 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-2 2023-09-30T17:04:56.013 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m0777 -- /var/run/ceph 2023-09-30T17:04:56.053 INFO:tasks.ceph.osd.2:Restarting daemon 2023-09-30T17:04:56.053 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-09-30T17:04:56.095 INFO:tasks.ceph.osd.2:Started 2023-09-30T17:04:56.096 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-09-30T17:04:56.230 INFO:teuthology.orchestra.run.smithi134.stderr:admin_socket: exception getting command descriptions: [Errno 2] No such file or directory 2023-09-30T17:04:56.232 DEBUG:teuthology.orchestra.run:got remote process result: 22 2023-09-30T17:04:56.233 INFO:tasks.ceph.ceph_manager.ceph:waiting on admin_socket for osd-2, ['dump_ops_in_flight'] 2023-09-30T17:04:56.961 INFO:tasks.ceph.osd.2.smithi134.stderr:2023-09-30T17:04:56.960+0000 7f3306c2d640 -1 Falling back to public interface 2023-09-30T17:04:58.902 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2023-09-30T17:05:00.581 INFO:tasks.ceph.osd.2.smithi134.stderr:2023-09-30T17:05:00.581+0000 7f3306c2d640 -1 osd.2 22 log_to_monitors true 2023-09-30T17:05:01.234 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2023-09-30T17:05:01.358 INFO:tasks.ceph.osd.2.smithi134.stderr:2023-09-30T17:05:01.354+0000 7f32f2bbf700 -1 osd.2 65 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T17:05:01.398 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2023-09-30T17:05:01.399 INFO:teuthology.orchestra.run.smithi134.stdout: "ops": [], 2023-09-30T17:05:01.399 INFO:teuthology.orchestra.run.smithi134.stdout: "num_ops": 0 2023-09-30T17:05:01.399 INFO:teuthology.orchestra.run.smithi134.stdout:} 2023-09-30T17:05:01.409 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2023-09-30T17:05:02.293 INFO:teuthology.orchestra.run.smithi007.stderr:reweighted osd.0 to 1 (10000) 2023-09-30T17:05:02.308 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2023-09-30T17:05:03.298 INFO:teuthology.orchestra.run.smithi007.stderr:reweighted osd.1 to 1 (10000) 2023-09-30T17:05:03.312 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2023-09-30T17:05:04.298 INFO:teuthology.orchestra.run.smithi007.stderr:reweighted osd.2 to 1 (10000) 2023-09-30T17:05:04.314 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2023-09-30T17:05:04.314 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T17:05:04.663 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:05:04.849 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-09-30T17:05:04.849 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":155,"stamp":"2023-09-30T17:05:04.292045+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":819295,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":24,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":140,"num_read_kb":122,"num_write":533025,"num_write_kb":2579054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141229,"ondisk_log_size":141229,"up":139,"acting":139,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1174168,"kb_used_data":2676,"kb_used_omap":10,"kb_used_meta":1171445,"kb_avail":281941352,"statfs":{"total":289910292480,"available":288707944448,"internally_reserved":0,"allocated":2740224,"data_stored":1983282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10327,"internal_metadata":1199560617},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.960127"},"pg_stats":[{"pgid":"4.3f","version":"59'2790","reported_seq":2847,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-09-30T17:04:50.417272+0000","last_change":"2023-09-30T17:02:18.360288+0000","last_active":"2023-09-30T17:04:50.417272+0000","last_peered":"2023-09-30T17:04:50.417272+0000","last_clean":"2023-09-30T17:04:50.417272+0000","last_became_active":"2023-09-30T17:02:18.358716+0000","last_became_peered":"2023-09-30T17:02:18.358716+0000","last_unstale":"2023-09-30T17:04:50.417272+0000","last_undegraded":"2023-09-30T17:04:50.417272+0000","last_fullsized":"2023-09-30T17:04:50.417272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2790,"log_dups_size":0,"ondisk_log_size":2790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:12:06.380095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8214,"num_write_kb":38924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"59'4","reported_seq":61,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-09-30T17:04:50.416327+0000","last_change":"2023-09-30T17:02:18.362418+0000","last_active":"2023-09-30T17:04:50.416327+0000","last_peered":"2023-09-30T17:04:50.416327+0000","last_clean":"2023-09-30T17:04:50.416327+0000","last_became_active":"2023-09-30T17:02:18.360372+0000","last_became_peered":"2023-09-30T17:02:18.360372+0000","last_unstale":"2023-09-30T17:04:50.416327+0000","last_undegraded":"2023-09-30T17:04:50.416327+0000","last_fullsized":"2023-09-30T17:04:50.416327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:43:29.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"59'5697","reported_seq":5746,"reported_epoch":64,"state":"active+undersized","last_fresh":"2023-09-30T17:04:51.419305+0000","last_change":"2023-09-30T17:04:40.512041+0000","last_active":"2023-09-30T17:04:51.419305+0000","last_peered":"2023-09-30T17:04:51.419305+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:02:48.271216+0000","last_became_peered":"2023-09-30T17:02:48.271216+0000","last_unstale":"2023-09-30T17:04:51.419305+0000","last_undegraded":"2023-09-30T17:04:51.419305+0000","last_fullsized":"2023-09-30T17:02:48.266518+0000","mapping_epoch":23,"log_start":"42'1200","ondisk_log_start":"42'1200","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4497,"log_dups_size":1200,"ondisk_log_size":4497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:34:07.347296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16590,"num_write_kb":78960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"59'10","reported_seq":59,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.413799+0000","last_change":"2023-09-30T17:02:48.271018+0000","last_active":"2023-09-30T17:04:50.413799+0000","last_peered":"2023-09-30T17:04:50.413799+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:02:48.271018+0000","last_became_peered":"2023-09-30T17:02:48.271018+0000","last_unstale":"2023-09-30T17:04:50.413799+0000","last_undegraded":"2023-09-30T17:04:50.413799+0000","last_fullsized":"2023-09-30T17:02:48.266412+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:41:09.173972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"59'2934","reported_seq":2991,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-09-30T17:04:50.415933+0000","last_change":"2023-09-30T17:02:18.360192+0000","last_active":"2023-09-30T17:04:50.415933+0000","last_peered":"2023-09-30T17:04:50.415933+0000","last_clean":"2023-09-30T17:04:50.415933+0000","last_became_active":"2023-09-30T17:02:18.357317+0000","last_became_peered":"2023-09-30T17:02:18.357317+0000","last_unstale":"2023-09-30T17:04:50.415933+0000","last_undegraded":"2023-09-30T17:04:50.415933+0000","last_fullsized":"2023-09-30T17:04:50.415933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2934,"log_dups_size":0,"ondisk_log_size":2934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:37:14.790993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8466,"num_write_kb":40084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"59'6","reported_seq":54,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.413086+0000","last_change":"2023-09-30T17:02:48.267405+0000","last_active":"2023-09-30T17:04:50.413086+0000","last_peered":"2023-09-30T17:04:50.413086+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:02:48.267405+0000","last_became_peered":"2023-09-30T17:02:48.267405+0000","last_unstale":"2023-09-30T17:04:50.413086+0000","last_undegraded":"2023-09-30T17:04:50.413086+0000","last_fullsized":"2023-09-30T17:02:48.265304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:39:21.100353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"59'7","reported_seq":55,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.412996+0000","last_change":"2023-09-30T17:02:48.268306+0000","last_active":"2023-09-30T17:04:50.412996+0000","last_peered":"2023-09-30T17:04:50.412996+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:02:48.268306+0000","last_became_peered":"2023-09-30T17:02:48.268306+0000","last_unstale":"2023-09-30T17:04:50.412996+0000","last_undegraded":"2023-09-30T17:04:50.412996+0000","last_fullsized":"2023-09-30T17:02:48.265227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:20:53.357746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"59'11423","reported_seq":11471,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.413332+0000","last_change":"2023-09-30T17:04:40.481298+0000","last_active":"2023-09-30T17:04:50.413332+0000","last_peered":"2023-09-30T17:04:50.413332+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:02:48.268573+0000","last_became_peered":"2023-09-30T17:02:48.268573+0000","last_unstale":"2023-09-30T17:04:50.413332+0000","last_undegraded":"2023-09-30T17:04:50.413332+0000","last_fullsized":"2023-09-30T17:02:48.265476+0000","mapping_epoch":23,"log_start":"52'7200","ondisk_log_start":"52'7200","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4223,"log_dups_size":7200,"ondisk_log_size":4223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:17:50.777450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33444,"num_write_kb":158924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"59'8589","reported_seq":8646,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-09-30T17:04:50.414391+0000","last_change":"2023-09-30T17:02:18.364222+0000","last_active":"2023-09-30T17:04:50.414391+0000","last_peered":"2023-09-30T17:04:50.414391+0000","last_clean":"2023-09-30T17:04:50.414391+0000","last_became_active":"2023-09-30T17:02:18.363485+0000","last_became_peered":"2023-09-30T17:02:18.363485+0000","last_unstale":"2023-09-30T17:04:50.414391+0000","last_undegraded":"2023-09-30T17:04:50.414391+0000","last_fullsized":"2023-09-30T17:04:50.414391+0000","mapping_epoch":17,"log_start":"49'4400","ondisk_log_start":"49'4400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4189,"log_dups_size":4400,"ondisk_log_size":4189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:14:35.192615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25052,"num_write_kb":118756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"59'8585","reported_seq":8642,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-09-30T17:04:50.416637+0000","last_change":"2023-09-30T17:02:18.360010+0000","last_active":"2023-09-30T17:04:50.416637+0000","last_peered":"2023-09-30T17:04:50.416637+0000","last_clean":"2023-09-30T17:04:50.416637+0000","last_became_active":"2023-09-30T17:02:18.358396+0000","last_became_peered":"2023-09-30T17:02:18.358396+0000","last_unstale":"2023-09-30T17:04:50.416637+0000","last_undegraded":"2023-09-30T17:04:50.416637+0000","last_fullsized":"2023-09-30T17:04:50.416637+0000","mapping_epoch":17,"log_start":"48'4100","ondisk_log_start":"48'4100","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4485,"log_dups_size":4100,"ondisk_log_size":4485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:26:11.522402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24997,"num_write_kb":162463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"59'5664","reported_seq":5712,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.413886+0000","last_change":"2023-09-30T17:04:41.077810+0000","last_active":"2023-09-30T17:04:50.413886+0000","last_peered":"2023-09-30T17:04:50.413886+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:02:48.271026+0000","last_became_peered":"2023-09-30T17:02:48.271026+0000","last_unstale":"2023-09-30T17:04:50.413886+0000","last_undegraded":"2023-09-30T17:04:50.413886+0000","last_fullsized":"2023-09-30T17:02:48.266966+0000","mapping_epoch":23,"log_start":"43'1400","ondisk_log_start":"43'1400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4264,"log_dups_size":1400,"ondisk_log_size":4264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:38:09.773904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16442,"num_write_kb":78308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"59'2931","reported_seq":2992,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.416727+0000","last_change":"2023-09-30T17:04:41.046598+0000","last_active":"2023-09-30T17:04:50.416727+0000","last_peered":"2023-09-30T17:04:50.416727+0000","last_clean":"2023-09-30T17:02:44.409974+0000","last_became_active":"2023-09-30T17:02:48.269566+0000","last_became_peered":"2023-09-30T17:02:48.269566+0000","last_unstale":"2023-09-30T17:04:50.416727+0000","last_undegraded":"2023-09-30T17:04:50.416727+0000","last_fullsized":"2023-09-30T17:02:48.265968+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2931,"log_dups_size":0,"ondisk_log_size":2931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:02:50.722512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8488,"num_write_kb":40364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"59'2860","reported_seq":2917,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-09-30T17:04:50.415728+0000","last_change":"2023-09-30T17:02:18.359894+0000","last_active":"2023-09-30T17:04:50.415728+0000","last_peered":"2023-09-30T17:04:50.415728+0000","last_clean":"2023-09-30T17:04:50.415728+0000","last_became_active":"2023-09-30T17:02:18.358534+0000","last_became_peered":"2023-09-30T17:02:18.358534+0000","last_unstale":"2023-09-30T17:04:50.415728+0000","last_undegraded":"2023-09-30T17:04:50.415728+0000","last_fullsized":"2023-09-30T17:04:50.415728+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2860,"log_dups_size":0,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:22:13.025181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8367,"num_write_kb":39772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"59'2911","reported_seq":2959,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.415441+0000","last_change":"2023-09-30T17:04:40.538655+0000","last_active":"2023-09-30T17:04:50.415441+0000","last_peered":"2023-09-30T17:04:50.415441+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:02:48.268308+0000","last_became_peered":"2023-09-30T17:02:48.268308+0000","last_unstale":"2023-09-30T17:04:50.415441+0000","last_undegraded":"2023-09-30T17:04:50.415441+0000","last_fullsized":"2023-09-30T17:02:48.265522+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2911,"log_dups_size":0,"ondisk_log_size":2911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:15:25.260107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8419,"num_write_kb":39940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"59'2889","reported_seq":2937,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.415319+0000","last_change":"2023-09-30T17:04:41.075444+0000","last_active":"2023-09-30T17:04:50.415319+0000","last_peered":"2023-09-30T17:04:50.415319+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:02:48.270274+0000","last_became_peered":"2023-09-30T17:02:48.270274+0000","last_unstale":"2023-09-30T17:04:50.415319+0000","last_undegraded":"2023-09-30T17:04:50.415319+0000","last_fullsized":"2023-09-30T17:02:48.265410+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2889,"log_dups_size":0,"ondisk_log_size":2889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:48:01.187843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8435,"num_write_kb":39984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"59'2839","reported_seq":2887,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.412929+0000","last_change":"2023-09-30T17:04:40.500182+0000","last_active":"2023-09-30T17:04:50.412929+0000","last_peered":"2023-09-30T17:04:50.412929+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:02:48.267199+0000","last_became_peered":"2023-09-30T17:02:48.267199+0000","last_unstale":"2023-09-30T17:04:50.412929+0000","last_undegraded":"2023-09-30T17:04:50.412929+0000","last_fullsized":"2023-09-30T17:02:48.265152+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2839,"log_dups_size":0,"ondisk_log_size":2839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:44:18.066167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8166,"num_write_kb":38928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"59'2802","reported_seq":2859,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-09-30T17:04:50.414507+0000","last_change":"2023-09-30T17:02:18.364360+0000","last_active":"2023-09-30T17:04:50.414507+0000","last_peered":"2023-09-30T17:04:50.414507+0000","last_clean":"2023-09-30T17:04:50.414507+0000","last_became_active":"2023-09-30T17:02:18.363697+0000","last_became_peered":"2023-09-30T17:02:18.363697+0000","last_unstale":"2023-09-30T17:04:50.414507+0000","last_undegraded":"2023-09-30T17:04:50.414507+0000","last_fullsized":"2023-09-30T17:04:50.414507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2802,"log_dups_size":0,"ondisk_log_size":2802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:50:52.893768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8256,"num_write_kb":39208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"59'2860","reported_seq":2917,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-09-30T17:04:50.416783+0000","last_change":"2023-09-30T17:02:18.360320+0000","last_active":"2023-09-30T17:04:50.416783+0000","last_peered":"2023-09-30T17:04:50.416783+0000","last_clean":"2023-09-30T17:04:50.416783+0000","last_became_active":"2023-09-30T17:02:18.357184+0000","last_became_peered":"2023-09-30T17:02:18.357184+0000","last_unstale":"2023-09-30T17:04:50.416783+0000","last_undegraded":"2023-09-30T17:04:50.416783+0000","last_fullsized":"2023-09-30T17:04:50.416783+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2860,"log_dups_size":0,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:21:45.195007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8368,"num_write_kb":39616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"59'5686","reported_seq":5743,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-09-30T17:04:50.413955+0000","last_change":"2023-09-30T17:02:18.363956+0000","last_active":"2023-09-30T17:04:50.413955+0000","last_peered":"2023-09-30T17:04:50.413955+0000","last_clean":"2023-09-30T17:04:50.413955+0000","last_became_active":"2023-09-30T17:02:18.363654+0000","last_became_peered":"2023-09-30T17:02:18.363654+0000","last_unstale":"2023-09-30T17:04:50.413955+0000","last_undegraded":"2023-09-30T17:04:50.413955+0000","last_fullsized":"2023-09-30T17:04:50.413955+0000","mapping_epoch":17,"log_start":"44'1500","ondisk_log_start":"44'1500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4186,"log_dups_size":1500,"ondisk_log_size":4186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:48:17.598726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16649,"num_write_kb":78956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"59'5799","reported_seq":5847,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.414234+0000","last_change":"2023-09-30T17:04:40.517921+0000","last_active":"2023-09-30T17:04:50.414234+0000","last_peered":"2023-09-30T17:04:50.414234+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:02:48.273070+0000","last_became_peered":"2023-09-30T17:02:48.273070+0000","last_unstale":"2023-09-30T17:04:50.414234+0000","last_undegraded":"2023-09-30T17:04:50.414234+0000","last_fullsized":"2023-09-30T17:02:48.267106+0000","mapping_epoch":23,"log_start":"44'1600","ondisk_log_start":"44'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4199,"log_dups_size":1600,"ondisk_log_size":4199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:13:23.007137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16903,"num_write_kb":80184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"59'12","reported_seq":60,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.413217+0000","last_change":"2023-09-30T17:02:48.269502+0000","last_active":"2023-09-30T17:04:50.413217+0000","last_peered":"2023-09-30T17:04:50.413217+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:02:48.269502+0000","last_became_peered":"2023-09-30T17:02:48.269502+0000","last_unstale":"2023-09-30T17:04:50.413217+0000","last_undegraded":"2023-09-30T17:04:50.413217+0000","last_fullsized":"2023-09-30T17:02:48.265516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:22:15.057405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"59'2879","reported_seq":2940,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.415889+0000","last_change":"2023-09-30T17:04:40.532670+0000","last_active":"2023-09-30T17:04:50.415889+0000","last_peered":"2023-09-30T17:04:50.415889+0000","last_clean":"2023-09-30T17:02:44.409783+0000","last_became_active":"2023-09-30T17:02:48.270405+0000","last_became_peered":"2023-09-30T17:02:48.270405+0000","last_unstale":"2023-09-30T17:04:50.415889+0000","last_undegraded":"2023-09-30T17:04:50.415889+0000","last_fullsized":"2023-09-30T17:02:48.265970+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2879,"log_dups_size":0,"ondisk_log_size":2879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:47:16.270600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8343,"num_write_kb":39768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"59'2809","reported_seq":2870,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.413382+0000","last_change":"2023-09-30T17:04:40.511916+0000","last_active":"2023-09-30T17:04:50.413382+0000","last_peered":"2023-09-30T17:04:50.413382+0000","last_clean":"2023-09-30T17:02:44.409099+0000","last_became_active":"2023-09-30T17:02:48.270162+0000","last_became_peered":"2023-09-30T17:02:48.270162+0000","last_unstale":"2023-09-30T17:04:50.413382+0000","last_undegraded":"2023-09-30T17:04:50.413382+0000","last_fullsized":"2023-09-30T17:02:48.265855+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2809,"log_dups_size":0,"ondisk_log_size":2809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:50:32.869131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8281,"num_write_kb":39472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"59'5585","reported_seq":5642,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-09-30T17:04:50.415816+0000","last_change":"2023-09-30T17:02:18.353938+0000","last_active":"2023-09-30T17:04:50.415816+0000","last_peered":"2023-09-30T17:04:50.415816+0000","last_clean":"2023-09-30T17:04:50.415816+0000","last_became_active":"2023-09-30T17:02:18.353632+0000","last_became_peered":"2023-09-30T17:02:18.353632+0000","last_unstale":"2023-09-30T17:04:50.415816+0000","last_undegraded":"2023-09-30T17:04:50.415816+0000","last_fullsized":"2023-09-30T17:04:50.415816+0000","mapping_epoch":17,"log_start":"42'1100","ondisk_log_start":"42'1100","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4485,"log_dups_size":1100,"ondisk_log_size":4485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:09:55.056098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16523,"num_write_kb":78256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"59'2888","reported_seq":2949,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.417168+0000","last_change":"2023-09-30T17:04:41.120717+0000","last_active":"2023-09-30T17:04:50.417168+0000","last_peered":"2023-09-30T17:04:50.417168+0000","last_clean":"2023-09-30T17:02:44.410555+0000","last_became_active":"2023-09-30T17:02:48.272529+0000","last_became_peered":"2023-09-30T17:02:48.272529+0000","last_unstale":"2023-09-30T17:04:50.417168+0000","last_undegraded":"2023-09-30T17:04:50.417168+0000","last_fullsized":"2023-09-30T17:02:48.268352+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2888,"log_dups_size":0,"ondisk_log_size":2888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:15:30.410403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8371,"num_write_kb":39716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"59'18","reported_seq":79,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.414385+0000","last_change":"2023-09-30T17:02:48.271880+0000","last_active":"2023-09-30T17:04:50.414385+0000","last_peered":"2023-09-30T17:04:50.414385+0000","last_clean":"2023-09-30T17:02:44.409258+0000","last_became_active":"2023-09-30T17:02:48.271880+0000","last_became_peered":"2023-09-30T17:02:48.271880+0000","last_unstale":"2023-09-30T17:04:50.414385+0000","last_undegraded":"2023-09-30T17:04:50.414385+0000","last_fullsized":"2023-09-30T17:02:48.267223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:15:07.642201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"59'2855","reported_seq":2904,"reported_epoch":64,"state":"active+undersized","last_fresh":"2023-09-30T17:04:51.418752+0000","last_change":"2023-09-30T17:04:40.529607+0000","last_active":"2023-09-30T17:04:51.418752+0000","last_peered":"2023-09-30T17:04:51.418752+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:02:48.269427+0000","last_became_peered":"2023-09-30T17:02:48.269427+0000","last_unstale":"2023-09-30T17:04:51.418752+0000","last_undegraded":"2023-09-30T17:04:51.418752+0000","last_fullsized":"2023-09-30T17:02:48.265865+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2855,"log_dups_size":0,"ondisk_log_size":2855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:01:25.519618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8347,"num_write_kb":39608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":59,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-09-30T17:04:50.415513+0000","last_change":"2023-09-30T17:02:17.358258+0000","last_active":"2023-09-30T17:04:50.415513+0000","last_peered":"2023-09-30T17:04:50.415513+0000","last_clean":"2023-09-30T17:04:50.415513+0000","last_became_active":"2023-09-30T17:02:17.357890+0000","last_became_peered":"2023-09-30T17:02:17.357890+0000","last_unstale":"2023-09-30T17:04:50.415513+0000","last_undegraded":"2023-09-30T17:04:50.415513+0000","last_fullsized":"2023-09-30T17:04:50.415513+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:52:56.591906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"59'17","reported_seq":78,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.417211+0000","last_change":"2023-09-30T17:02:48.271608+0000","last_active":"2023-09-30T17:04:50.417211+0000","last_peered":"2023-09-30T17:04:50.417211+0000","last_clean":"2023-09-30T17:02:44.410504+0000","last_became_active":"2023-09-30T17:02:48.271608+0000","last_became_peered":"2023-09-30T17:02:48.271608+0000","last_unstale":"2023-09-30T17:04:50.417211+0000","last_undegraded":"2023-09-30T17:04:50.417211+0000","last_fullsized":"2023-09-30T17:02:48.267845+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:05:52.289111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":62,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.413410+0000","last_change":"2023-09-30T17:02:48.270217+0000","last_active":"2023-09-30T17:04:50.413410+0000","last_peered":"2023-09-30T17:04:50.413410+0000","last_clean":"2023-09-30T17:02:44.408791+0000","last_became_active":"2023-09-30T17:02:48.270217+0000","last_became_peered":"2023-09-30T17:02:48.270217+0000","last_unstale":"2023-09-30T17:04:50.413410+0000","last_undegraded":"2023-09-30T17:04:50.413410+0000","last_fullsized":"2023-09-30T17:02:48.265895+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:01:24.513989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"59'6","reported_seq":67,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.414229+0000","last_change":"2023-09-30T17:02:48.272282+0000","last_active":"2023-09-30T17:04:50.414229+0000","last_peered":"2023-09-30T17:04:50.414229+0000","last_clean":"2023-09-30T17:02:44.409320+0000","last_became_active":"2023-09-30T17:02:48.272282+0000","last_became_peered":"2023-09-30T17:02:48.272282+0000","last_unstale":"2023-09-30T17:04:50.414229+0000","last_undegraded":"2023-09-30T17:04:50.414229+0000","last_fullsized":"2023-09-30T17:02:48.268295+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:57:25.242200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":58,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-09-30T17:04:50.413491+0000","last_change":"2023-09-30T17:02:17.361000+0000","last_active":"2023-09-30T17:04:50.413491+0000","last_peered":"2023-09-30T17:04:50.413491+0000","last_clean":"2023-09-30T17:04:50.413491+0000","last_became_active":"2023-09-30T17:02:17.360601+0000","last_became_peered":"2023-09-30T17:02:17.360601+0000","last_unstale":"2023-09-30T17:04:50.413491+0000","last_undegraded":"2023-09-30T17:04:50.413491+0000","last_fullsized":"2023-09-30T17:04:50.413491+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:02:27.666526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"59'7","reported_seq":68,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.417115+0000","last_change":"2023-09-30T17:02:48.272166+0000","last_active":"2023-09-30T17:04:50.417115+0000","last_peered":"2023-09-30T17:04:50.417115+0000","last_clean":"2023-09-30T17:02:44.410555+0000","last_became_active":"2023-09-30T17:02:48.272166+0000","last_became_peered":"2023-09-30T17:02:48.272166+0000","last_unstale":"2023-09-30T17:04:50.417115+0000","last_undegraded":"2023-09-30T17:04:50.417115+0000","last_fullsized":"2023-09-30T17:02:48.268083+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:19:10.481260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"58'1","reported_seq":63,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.414771+0000","last_change":"2023-09-30T17:02:48.272452+0000","last_active":"2023-09-30T17:04:50.414771+0000","last_peered":"2023-09-30T17:04:50.414771+0000","last_clean":"2023-09-30T17:02:44.409453+0000","last_became_active":"2023-09-30T17:02:48.272452+0000","last_became_peered":"2023-09-30T17:02:48.272452+0000","last_unstale":"2023-09-30T17:04:50.414771+0000","last_undegraded":"2023-09-30T17:04:50.414771+0000","last_fullsized":"2023-09-30T17:02:48.268387+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:05:51.283482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"59'9","reported_seq":66,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-09-30T17:04:50.413265+0000","last_change":"2023-09-30T17:02:18.358841+0000","last_active":"2023-09-30T17:04:50.413265+0000","last_peered":"2023-09-30T17:04:50.413265+0000","last_clean":"2023-09-30T17:04:50.413265+0000","last_became_active":"2023-09-30T17:02:18.358529+0000","last_became_peered":"2023-09-30T17:02:18.358529+0000","last_unstale":"2023-09-30T17:04:50.413265+0000","last_undegraded":"2023-09-30T17:04:50.413265+0000","last_fullsized":"2023-09-30T17:04:50.413265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:15:54.364571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.414744+0000","last_change":"2023-09-30T17:02:48.273786+0000","last_active":"2023-09-30T17:04:50.414744+0000","last_peered":"2023-09-30T17:04:50.414744+0000","last_clean":"2023-09-30T17:02:16.333605+0000","last_became_active":"2023-09-30T17:02:48.273786+0000","last_became_peered":"2023-09-30T17:02:48.273786+0000","last_unstale":"2023-09-30T17:04:50.414744+0000","last_undegraded":"2023-09-30T17:04:50.414744+0000","last_fullsized":"2023-09-30T17:02:48.269616+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:55:31.686602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"59'8526","reported_seq":8587,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.413582+0000","last_change":"2023-09-30T17:04:41.073879+0000","last_active":"2023-09-30T17:04:50.413582+0000","last_peered":"2023-09-30T17:04:50.413582+0000","last_clean":"2023-09-30T17:02:44.408876+0000","last_became_active":"2023-09-30T17:02:48.271101+0000","last_became_peered":"2023-09-30T17:02:48.271101+0000","last_unstale":"2023-09-30T17:04:50.413582+0000","last_undegraded":"2023-09-30T17:04:50.413582+0000","last_fullsized":"2023-09-30T17:02:48.266188+0000","mapping_epoch":23,"log_start":"49'4300","ondisk_log_start":"49'4300","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4226,"log_dups_size":4300,"ondisk_log_size":4226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:17:14.990825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24873,"num_write_kb":118472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"59'7","reported_seq":69,"reported_epoch":63,"state":"active+undersized+degraded","last_fresh":"2023-09-30T17:04:50.416579+0000","last_change":"2023-09-30T17:02:48.271344+0000","last_active":"2023-09-30T17:04:50.416579+0000","last_peered":"2023-09-30T17:04:50.416579+0000","last_clean":"2023-09-30T17:02:44.410201+0000","last_became_active":"2023-09-30T17:02:48.271344+0000","last_became_peered":"2023-09-30T17:02:48.271344+0000","last_unstale":"2023-09-30T17:04:50.416579+0000","last_undegraded":"2023-09-30T17:02:48.267037+0000","last_fullsized":"2023-09-30T17:02:48.266729+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:13:22.001508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"59'5670","reported_seq":5727,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-09-30T17:04:50.413486+0000","last_change":"2023-09-30T17:02:18.359118+0000","last_active":"2023-09-30T17:04:50.413486+0000","last_peered":"2023-09-30T17:04:50.413486+0000","last_clean":"2023-09-30T17:04:50.413486+0000","last_became_active":"2023-09-30T17:02:18.358786+0000","last_became_peered":"2023-09-30T17:02:18.358786+0000","last_unstale":"2023-09-30T17:04:50.413486+0000","last_undegraded":"2023-09-30T17:04:50.413486+0000","last_fullsized":"2023-09-30T17:04:50.413486+0000","mapping_epoch":17,"log_start":"44'1500","ondisk_log_start":"44'1500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4170,"log_dups_size":1500,"ondisk_log_size":4170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:33:21.723864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16627,"num_write_kb":79047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"60'78","reported_seq":137,"reported_epoch":63,"state":"active+undersized+degraded","last_fresh":"2023-09-30T17:04:50.415990+0000","last_change":"2023-09-30T17:02:48.270268+0000","last_active":"2023-09-30T17:04:50.415990+0000","last_peered":"2023-09-30T17:04:50.415990+0000","last_clean":"2023-09-30T17:02:39.878275+0000","last_became_active":"2023-09-30T17:02:48.270268+0000","last_became_peered":"2023-09-30T17:02:48.270268+0000","last_unstale":"2023-09-30T17:04:50.415990+0000","last_undegraded":"2023-09-30T17:02:48.267766+0000","last_fullsized":"2023-09-30T17:02:48.266692+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:45:50.479146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227523,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":4}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"59'5677","reported_seq":5725,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.415684+0000","last_change":"2023-09-30T17:04:41.065867+0000","last_active":"2023-09-30T17:04:50.415684+0000","last_peered":"2023-09-30T17:04:50.415684+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:02:48.268309+0000","last_became_peered":"2023-09-30T17:02:48.268309+0000","last_unstale":"2023-09-30T17:04:50.415684+0000","last_undegraded":"2023-09-30T17:04:50.415684+0000","last_fullsized":"2023-09-30T17:02:48.265599+0000","mapping_epoch":23,"log_start":"42'1100","ondisk_log_start":"42'1100","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4577,"log_dups_size":1100,"ondisk_log_size":4577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:54:50.127494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16579,"num_write_kb":79104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":57,"reported_epoch":63,"state":"active+undersized+degraded","last_fresh":"2023-09-30T17:04:50.414436+0000","last_change":"2023-09-30T17:02:48.272452+0000","last_active":"2023-09-30T17:04:50.414436+0000","last_peered":"2023-09-30T17:04:50.414436+0000","last_clean":"2023-09-30T17:02:18.357478+0000","last_became_active":"2023-09-30T17:02:48.272452+0000","last_became_peered":"2023-09-30T17:02:48.272452+0000","last_unstale":"2023-09-30T17:04:50.414436+0000","last_undegraded":"2023-09-30T17:02:48.267146+0000","last_fullsized":"2023-09-30T17:02:48.267019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:34:06.341666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":2}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"59'2836","reported_seq":2893,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-09-30T17:04:50.416442+0000","last_change":"2023-09-30T17:02:18.360019+0000","last_active":"2023-09-30T17:04:50.416442+0000","last_peered":"2023-09-30T17:04:50.416442+0000","last_clean":"2023-09-30T17:04:50.416442+0000","last_became_active":"2023-09-30T17:02:18.358364+0000","last_became_peered":"2023-09-30T17:02:18.358364+0000","last_unstale":"2023-09-30T17:04:50.416442+0000","last_undegraded":"2023-09-30T17:04:50.416442+0000","last_fullsized":"2023-09-30T17:04:50.416442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2836,"log_dups_size":0,"ondisk_log_size":2836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:30:43.782165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8308,"num_write_kb":39456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":62,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.414097+0000","last_change":"2023-09-30T17:02:48.270302+0000","last_active":"2023-09-30T17:04:50.414097+0000","last_peered":"2023-09-30T17:04:50.414097+0000","last_clean":"2023-09-30T17:02:44.408819+0000","last_became_active":"2023-09-30T17:02:48.270302+0000","last_became_peered":"2023-09-30T17:02:48.270302+0000","last_unstale":"2023-09-30T17:04:50.414097+0000","last_undegraded":"2023-09-30T17:04:50.414097+0000","last_fullsized":"2023-09-30T17:02:48.266102+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:02:49.716883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"59'2856","reported_seq":2913,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-09-30T17:04:50.417137+0000","last_change":"2023-09-30T17:02:18.362415+0000","last_active":"2023-09-30T17:04:50.417137+0000","last_peered":"2023-09-30T17:04:50.417137+0000","last_clean":"2023-09-30T17:04:50.417137+0000","last_became_active":"2023-09-30T17:02:18.361556+0000","last_became_peered":"2023-09-30T17:02:18.361556+0000","last_unstale":"2023-09-30T17:04:50.417137+0000","last_undegraded":"2023-09-30T17:04:50.417137+0000","last_fullsized":"2023-09-30T17:04:50.417137+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2856,"log_dups_size":0,"ondisk_log_size":2856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:16:41.607547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8321,"num_write_kb":39600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":62,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.415857+0000","last_change":"2023-09-30T17:02:48.269423+0000","last_active":"2023-09-30T17:04:50.415857+0000","last_peered":"2023-09-30T17:04:50.415857+0000","last_clean":"2023-09-30T17:02:44.409741+0000","last_became_active":"2023-09-30T17:02:48.269423+0000","last_became_peered":"2023-09-30T17:02:48.269423+0000","last_unstale":"2023-09-30T17:04:50.415857+0000","last_undegraded":"2023-09-30T17:04:50.415857+0000","last_fullsized":"2023-09-30T17:02:48.265947+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:31:59.804831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"59'12","reported_seq":73,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.414641+0000","last_change":"2023-09-30T17:02:48.273647+0000","last_active":"2023-09-30T17:04:50.414641+0000","last_peered":"2023-09-30T17:04:50.414641+0000","last_clean":"2023-09-30T17:02:44.409403+0000","last_became_active":"2023-09-30T17:02:48.273647+0000","last_became_peered":"2023-09-30T17:02:48.273647+0000","last_unstale":"2023-09-30T17:04:50.414641+0000","last_undegraded":"2023-09-30T17:04:50.414641+0000","last_fullsized":"2023-09-30T17:02:48.268632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:34:29.003299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"59'9","reported_seq":61,"reported_epoch":63,"state":"active+undersized+degraded","last_fresh":"2023-09-30T17:04:50.417004+0000","last_change":"2023-09-30T17:02:48.271494+0000","last_active":"2023-09-30T17:04:50.417004+0000","last_peered":"2023-09-30T17:04:50.417004+0000","last_clean":"2023-09-30T17:02:18.376118+0000","last_became_active":"2023-09-30T17:02:48.271494+0000","last_became_peered":"2023-09-30T17:02:48.271494+0000","last_unstale":"2023-09-30T17:04:50.417004+0000","last_undegraded":"2023-09-30T17:02:48.266896+0000","last_fullsized":"2023-09-30T17:02:48.266780+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:15:06.636572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":4}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"59'2892","reported_seq":2953,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.414940+0000","last_change":"2023-09-30T17:04:40.512012+0000","last_active":"2023-09-30T17:04:50.414940+0000","last_peered":"2023-09-30T17:04:50.414940+0000","last_clean":"2023-09-30T17:02:44.409540+0000","last_became_active":"2023-09-30T17:02:48.273230+0000","last_became_peered":"2023-09-30T17:02:48.273230+0000","last_unstale":"2023-09-30T17:04:50.414940+0000","last_undegraded":"2023-09-30T17:04:50.414940+0000","last_fullsized":"2023-09-30T17:02:48.269871+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2892,"log_dups_size":0,"ondisk_log_size":2892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:19:10.481260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8345,"num_write_kb":39712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":57,"reported_epoch":63,"state":"active+undersized+degraded","last_fresh":"2023-09-30T17:04:50.416937+0000","last_change":"2023-09-30T17:02:48.272397+0000","last_active":"2023-09-30T17:04:50.416937+0000","last_peered":"2023-09-30T17:04:50.416937+0000","last_clean":"2023-09-30T17:02:18.357313+0000","last_became_active":"2023-09-30T17:02:48.272397+0000","last_became_peered":"2023-09-30T17:02:48.272397+0000","last_unstale":"2023-09-30T17:04:50.416937+0000","last_undegraded":"2023-09-30T17:02:48.268170+0000","last_fullsized":"2023-09-30T17:02:48.268067+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:57:01.669630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"59'2861","reported_seq":2922,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.415238+0000","last_change":"2023-09-30T17:04:40.507526+0000","last_active":"2023-09-30T17:04:50.415238+0000","last_peered":"2023-09-30T17:04:50.415238+0000","last_clean":"2023-09-30T17:02:44.409530+0000","last_became_active":"2023-09-30T17:02:48.271207+0000","last_became_peered":"2023-09-30T17:02:48.271207+0000","last_unstale":"2023-09-30T17:04:50.415238+0000","last_undegraded":"2023-09-30T17:04:50.415238+0000","last_fullsized":"2023-09-30T17:02:48.265371+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2861,"log_dups_size":0,"ondisk_log_size":2861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:20:36.364974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8384,"num_write_kb":39788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":64,"reported_epoch":63,"state":"active+undersized+degraded","last_fresh":"2023-09-30T17:04:50.416481+0000","last_change":"2023-09-30T17:02:48.269589+0000","last_active":"2023-09-30T17:04:50.416481+0000","last_peered":"2023-09-30T17:04:50.416481+0000","last_clean":"2023-09-30T17:02:44.410369+0000","last_became_active":"2023-09-30T17:02:48.269589+0000","last_became_peered":"2023-09-30T17:02:48.269589+0000","last_unstale":"2023-09-30T17:04:50.416481+0000","last_undegraded":"2023-09-30T17:02:48.267735+0000","last_fullsized":"2023-09-30T17:02:48.267585+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:57:24.236570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"59'2","reported_seq":59,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-09-30T17:04:50.416022+0000","last_change":"2023-09-30T17:02:18.359767+0000","last_active":"2023-09-30T17:04:50.416022+0000","last_peered":"2023-09-30T17:04:50.416022+0000","last_clean":"2023-09-30T17:04:50.416022+0000","last_became_active":"2023-09-30T17:02:18.356825+0000","last_became_peered":"2023-09-30T17:02:18.356825+0000","last_unstale":"2023-09-30T17:04:50.416022+0000","last_undegraded":"2023-09-30T17:04:50.416022+0000","last_fullsized":"2023-09-30T17:04:50.416022+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:39:16.689300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":57,"reported_epoch":63,"state":"active+undersized+degraded","last_fresh":"2023-09-30T17:04:50.416968+0000","last_change":"2023-09-30T17:02:48.271475+0000","last_active":"2023-09-30T17:04:50.416968+0000","last_peered":"2023-09-30T17:04:50.416968+0000","last_clean":"2023-09-30T17:02:18.356780+0000","last_became_active":"2023-09-30T17:02:48.271475+0000","last_became_peered":"2023-09-30T17:02:48.271475+0000","last_unstale":"2023-09-30T17:04:50.416968+0000","last_undegraded":"2023-09-30T17:02:48.267564+0000","last_fullsized":"2023-09-30T17:02:48.267019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:31:33.824606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"59'2835","reported_seq":2884,"reported_epoch":64,"state":"active+undersized","last_fresh":"2023-09-30T17:04:51.417965+0000","last_change":"2023-09-30T17:04:40.499335+0000","last_active":"2023-09-30T17:04:51.417965+0000","last_peered":"2023-09-30T17:04:51.417965+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:02:48.269547+0000","last_became_peered":"2023-09-30T17:02:48.269547+0000","last_unstale":"2023-09-30T17:04:51.417965+0000","last_undegraded":"2023-09-30T17:04:51.417965+0000","last_fullsized":"2023-09-30T17:02:48.265326+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2835,"log_dups_size":0,"ondisk_log_size":2835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:46:58.817196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8288,"num_write_kb":39388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":48,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.414318+0000","last_change":"2023-09-30T17:02:48.272328+0000","last_active":"2023-09-30T17:04:50.414318+0000","last_peered":"2023-09-30T17:04:50.414318+0000","last_clean":"2023-09-30T17:02:16.333605+0000","last_became_active":"2023-09-30T17:02:48.272328+0000","last_became_peered":"2023-09-30T17:02:48.272328+0000","last_unstale":"2023-09-30T17:04:50.414318+0000","last_undegraded":"2023-09-30T17:04:50.414318+0000","last_fullsized":"2023-09-30T17:02:48.267308+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:31:33.824606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"59'8","reported_seq":69,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.413809+0000","last_change":"2023-09-30T17:02:48.271265+0000","last_active":"2023-09-30T17:04:50.413809+0000","last_peered":"2023-09-30T17:04:50.413809+0000","last_clean":"2023-09-30T17:02:44.408986+0000","last_became_active":"2023-09-30T17:02:48.271265+0000","last_became_peered":"2023-09-30T17:02:48.271265+0000","last_unstale":"2023-09-30T17:04:50.413809+0000","last_undegraded":"2023-09-30T17:04:50.413809+0000","last_fullsized":"2023-09-30T17:02:48.266457+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:01:48.634440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"58'3","reported_seq":65,"reported_epoch":63,"state":"active+undersized+degraded","last_fresh":"2023-09-30T17:04:50.413645+0000","last_change":"2023-09-30T17:02:48.271152+0000","last_active":"2023-09-30T17:04:50.413645+0000","last_peered":"2023-09-30T17:04:50.413645+0000","last_clean":"2023-09-30T17:02:44.408905+0000","last_became_active":"2023-09-30T17:02:48.271152+0000","last_became_peered":"2023-09-30T17:02:48.271152+0000","last_unstale":"2023-09-30T17:04:50.413645+0000","last_undegraded":"2023-09-30T17:02:48.266308+0000","last_fullsized":"2023-09-30T17:02:48.266167+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:20:35.359345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"59'2846","reported_seq":2894,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.413926+0000","last_change":"2023-09-30T17:04:41.061079+0000","last_active":"2023-09-30T17:04:50.413926+0000","last_peered":"2023-09-30T17:04:50.413926+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:02:48.271402+0000","last_became_peered":"2023-09-30T17:02:48.271402+0000","last_unstale":"2023-09-30T17:04:50.413926+0000","last_undegraded":"2023-09-30T17:04:50.413926+0000","last_fullsized":"2023-09-30T17:02:48.266817+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2846,"log_dups_size":0,"ondisk_log_size":2846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:21:16.490213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8199,"num_write_kb":39160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":49,"reported_epoch":64,"state":"active+undersized","last_fresh":"2023-09-30T17:04:51.418689+0000","last_change":"2023-09-30T17:02:48.271186+0000","last_active":"2023-09-30T17:04:51.418689+0000","last_peered":"2023-09-30T17:04:51.418689+0000","last_clean":"2023-09-30T17:02:16.333605+0000","last_became_active":"2023-09-30T17:02:48.271186+0000","last_became_peered":"2023-09-30T17:02:48.271186+0000","last_unstale":"2023-09-30T17:04:51.418689+0000","last_undegraded":"2023-09-30T17:04:51.418689+0000","last_fullsized":"2023-09-30T17:02:48.266545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:02:10.359842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"59'2831","reported_seq":2879,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.416012+0000","last_change":"2023-09-30T17:04:40.523827+0000","last_active":"2023-09-30T17:04:50.416012+0000","last_peered":"2023-09-30T17:04:50.416012+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:02:48.270496+0000","last_became_peered":"2023-09-30T17:02:48.270496+0000","last_unstale":"2023-09-30T17:04:50.416012+0000","last_undegraded":"2023-09-30T17:04:50.416012+0000","last_fullsized":"2023-09-30T17:02:48.266198+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2831,"log_dups_size":0,"ondisk_log_size":2831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:01:48.634440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8336,"num_write_kb":39484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":62,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.415337+0000","last_change":"2023-09-30T17:02:48.268278+0000","last_active":"2023-09-30T17:04:50.415337+0000","last_peered":"2023-09-30T17:04:50.415337+0000","last_clean":"2023-09-30T17:02:44.409604+0000","last_became_active":"2023-09-30T17:02:48.268278+0000","last_became_peered":"2023-09-30T17:02:48.268278+0000","last_unstale":"2023-09-30T17:04:50.415337+0000","last_undegraded":"2023-09-30T17:04:50.415337+0000","last_fullsized":"2023-09-30T17:02:48.265455+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:22:14.051775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"59'2884","reported_seq":2932,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.416330+0000","last_change":"2023-09-30T17:04:40.540703+0000","last_active":"2023-09-30T17:04:50.416330+0000","last_peered":"2023-09-30T17:04:50.416330+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:02:48.269002+0000","last_became_peered":"2023-09-30T17:02:48.269002+0000","last_unstale":"2023-09-30T17:04:50.416330+0000","last_undegraded":"2023-09-30T17:04:50.416330+0000","last_fullsized":"2023-09-30T17:02:48.265796+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2884,"log_dups_size":0,"ondisk_log_size":2884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:50:32.869131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8366,"num_write_kb":39744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":58,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-09-30T17:04:50.415518+0000","last_change":"2023-09-30T17:02:17.358811+0000","last_active":"2023-09-30T17:04:50.415518+0000","last_peered":"2023-09-30T17:04:50.415518+0000","last_clean":"2023-09-30T17:04:50.415518+0000","last_became_active":"2023-09-30T17:02:17.358582+0000","last_became_peered":"2023-09-30T17:02:17.358582+0000","last_unstale":"2023-09-30T17:04:50.415518+0000","last_undegraded":"2023-09-30T17:04:50.415518+0000","last_fullsized":"2023-09-30T17:04:50.415518+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:52:37.518693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"59'8580","reported_seq":8637,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-09-30T17:04:50.414621+0000","last_change":"2023-09-30T17:02:18.364478+0000","last_active":"2023-09-30T17:04:50.414621+0000","last_peered":"2023-09-30T17:04:50.414621+0000","last_clean":"2023-09-30T17:04:50.414621+0000","last_became_active":"2023-09-30T17:02:18.364057+0000","last_became_peered":"2023-09-30T17:02:18.364057+0000","last_unstale":"2023-09-30T17:04:50.414621+0000","last_undegraded":"2023-09-30T17:04:50.414621+0000","last_fullsized":"2023-09-30T17:04:50.414621+0000","mapping_epoch":17,"log_start":"49'4400","ondisk_log_start":"49'4400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4180,"log_dups_size":4400,"ondisk_log_size":4180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:13:55.555700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25046,"num_write_kb":118972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":61,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-09-30T17:04:50.414158+0000","last_change":"2023-09-30T17:02:12.327704+0000","last_active":"2023-09-30T17:04:50.414158+0000","last_peered":"2023-09-30T17:04:50.414158+0000","last_clean":"2023-09-30T17:04:50.414158+0000","last_became_active":"2023-09-30T17:02:12.327384+0000","last_became_peered":"2023-09-30T17:02:12.327384+0000","last_unstale":"2023-09-30T17:04:50.414158+0000","last_undegraded":"2023-09-30T17:04:50.414158+0000","last_fullsized":"2023-09-30T17:04:50.414158+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:09:34.818252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":49,"reported_epoch":64,"state":"active+undersized","last_fresh":"2023-09-30T17:04:51.419577+0000","last_change":"2023-09-30T17:02:48.271959+0000","last_active":"2023-09-30T17:04:51.419577+0000","last_peered":"2023-09-30T17:04:51.419577+0000","last_clean":"2023-09-30T17:02:16.333605+0000","last_became_active":"2023-09-30T17:02:48.271959+0000","last_became_peered":"2023-09-30T17:02:48.271959+0000","last_unstale":"2023-09-30T17:04:51.419577+0000","last_undegraded":"2023-09-30T17:04:51.419577+0000","last_fullsized":"2023-09-30T17:02:48.267164+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:03:49.752214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"59'9","reported_seq":70,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.415927+0000","last_change":"2023-09-30T17:02:48.270169+0000","last_active":"2023-09-30T17:04:50.415927+0000","last_peered":"2023-09-30T17:04:50.415927+0000","last_clean":"2023-09-30T17:02:44.409881+0000","last_became_active":"2023-09-30T17:02:48.270169+0000","last_became_peered":"2023-09-30T17:02:48.270169+0000","last_unstale":"2023-09-30T17:04:50.415927+0000","last_undegraded":"2023-09-30T17:04:50.415927+0000","last_fullsized":"2023-09-30T17:02:48.266639+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:38:09.773904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":49,"reported_epoch":64,"state":"active+undersized","last_fresh":"2023-09-30T17:04:51.418361+0000","last_change":"2023-09-30T17:02:48.271029+0000","last_active":"2023-09-30T17:04:51.418361+0000","last_peered":"2023-09-30T17:04:51.418361+0000","last_clean":"2023-09-30T17:02:11.318349+0000","last_became_active":"2023-09-30T17:02:48.271029+0000","last_became_peered":"2023-09-30T17:02:48.271029+0000","last_unstale":"2023-09-30T17:04:51.418361+0000","last_undegraded":"2023-09-30T17:04:51.418361+0000","last_fullsized":"2023-09-30T17:02:48.266223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:47:55.166958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":49,"reported_epoch":64,"state":"active+undersized","last_fresh":"2023-09-30T17:04:51.419120+0000","last_change":"2023-09-30T17:02:48.272102+0000","last_active":"2023-09-30T17:04:51.419120+0000","last_peered":"2023-09-30T17:04:51.419120+0000","last_clean":"2023-09-30T17:02:16.333605+0000","last_became_active":"2023-09-30T17:02:48.272102+0000","last_became_peered":"2023-09-30T17:02:48.272102+0000","last_unstale":"2023-09-30T17:04:51.419120+0000","last_undegraded":"2023-09-30T17:04:51.419120+0000","last_fullsized":"2023-09-30T17:02:48.266571+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:31:04.525444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"59'9","reported_seq":66,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-09-30T17:04:50.414053+0000","last_change":"2023-09-30T17:02:18.363399+0000","last_active":"2023-09-30T17:04:50.414053+0000","last_peered":"2023-09-30T17:04:50.414053+0000","last_clean":"2023-09-30T17:04:50.414053+0000","last_became_active":"2023-09-30T17:02:18.363064+0000","last_became_peered":"2023-09-30T17:02:18.363064+0000","last_unstale":"2023-09-30T17:04:50.414053+0000","last_undegraded":"2023-09-30T17:04:50.414053+0000","last_fullsized":"2023-09-30T17:04:50.414053+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:32:34.654264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":61,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-09-30T17:04:50.413277+0000","last_change":"2023-09-30T17:02:12.327834+0000","last_active":"2023-09-30T17:04:50.413277+0000","last_peered":"2023-09-30T17:04:50.413277+0000","last_clean":"2023-09-30T17:04:50.413277+0000","last_became_active":"2023-09-30T17:02:12.327542+0000","last_became_peered":"2023-09-30T17:02:12.327542+0000","last_unstale":"2023-09-30T17:04:50.413277+0000","last_undegraded":"2023-09-30T17:04:50.413277+0000","last_fullsized":"2023-09-30T17:04:50.413277+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:49:54.890769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":62,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.415492+0000","last_change":"2023-09-30T17:02:48.271230+0000","last_active":"2023-09-30T17:04:50.415492+0000","last_peered":"2023-09-30T17:04:50.415492+0000","last_clean":"2023-09-30T17:02:44.409633+0000","last_became_active":"2023-09-30T17:02:48.271230+0000","last_became_peered":"2023-09-30T17:02:48.271230+0000","last_unstale":"2023-09-30T17:04:50.415492+0000","last_undegraded":"2023-09-30T17:04:50.415492+0000","last_fullsized":"2023-09-30T17:02:48.266361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:21:15.484583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"59'6","reported_seq":63,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-09-30T17:04:50.414858+0000","last_change":"2023-09-30T17:02:18.364406+0000","last_active":"2023-09-30T17:04:50.414858+0000","last_peered":"2023-09-30T17:04:50.414858+0000","last_clean":"2023-09-30T17:04:50.414858+0000","last_became_active":"2023-09-30T17:02:18.363849+0000","last_became_peered":"2023-09-30T17:02:18.363849+0000","last_unstale":"2023-09-30T17:04:50.414858+0000","last_undegraded":"2023-09-30T17:04:50.414858+0000","last_fullsized":"2023-09-30T17:04:50.414858+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:43:29.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":49,"reported_epoch":64,"state":"active+undersized","last_fresh":"2023-09-30T17:04:51.418716+0000","last_change":"2023-09-30T17:02:48.270259+0000","last_active":"2023-09-30T17:04:51.418716+0000","last_peered":"2023-09-30T17:04:51.418716+0000","last_clean":"2023-09-30T17:02:11.318349+0000","last_became_active":"2023-09-30T17:02:48.270259+0000","last_became_peered":"2023-09-30T17:02:48.270259+0000","last_unstale":"2023-09-30T17:04:51.418716+0000","last_undegraded":"2023-09-30T17:04:51.418716+0000","last_fullsized":"2023-09-30T17:02:48.266144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:36:16.950492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":251,"reported_epoch":63,"state":"active+undersized+degraded","last_fresh":"2023-09-30T17:04:50.415221+0000","last_change":"2023-09-30T17:02:48.269439+0000","last_active":"2023-09-30T17:04:50.415221+0000","last_peered":"2023-09-30T17:04:50.415221+0000","last_clean":"2023-09-30T17:02:08.215860+0000","last_became_active":"2023-09-30T17:02:48.269439+0000","last_became_peered":"2023-09-30T17:02:48.269439+0000","last_unstale":"2023-09-30T17:04:50.415221+0000","last_undegraded":"2023-09-30T17:02:48.265518+0000","last_fullsized":"2023-09-30T17:02:48.265371+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:06.295501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:06.295501+0000","last_clean_scrub_stamp":"2023-09-30T17:02:06.295501+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:17:39.733716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":58,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-09-30T17:04:50.413362+0000","last_change":"2023-09-30T17:02:17.357139+0000","last_active":"2023-09-30T17:04:50.413362+0000","last_peered":"2023-09-30T17:04:50.413362+0000","last_clean":"2023-09-30T17:04:50.413362+0000","last_became_active":"2023-09-30T17:02:17.356901+0000","last_became_peered":"2023-09-30T17:02:17.356901+0000","last_unstale":"2023-09-30T17:04:50.413362+0000","last_undegraded":"2023-09-30T17:04:50.413362+0000","last_fullsized":"2023-09-30T17:04:50.413362+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:22:35.747671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"59'7","reported_seq":56,"reported_epoch":64,"state":"active+undersized","last_fresh":"2023-09-30T17:04:51.419074+0000","last_change":"2023-09-30T17:02:48.271072+0000","last_active":"2023-09-30T17:04:51.419074+0000","last_peered":"2023-09-30T17:04:51.419074+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:02:48.271072+0000","last_became_peered":"2023-09-30T17:02:48.271072+0000","last_unstale":"2023-09-30T17:04:51.419074+0000","last_undegraded":"2023-09-30T17:04:51.419074+0000","last_fullsized":"2023-09-30T17:02:48.266356+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:02:11.365472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.415870+0000","last_change":"2023-09-30T17:02:48.271468+0000","last_active":"2023-09-30T17:04:50.415870+0000","last_peered":"2023-09-30T17:04:50.415870+0000","last_clean":"2023-09-30T17:02:11.318349+0000","last_became_active":"2023-09-30T17:02:48.271468+0000","last_became_peered":"2023-09-30T17:02:48.271468+0000","last_unstale":"2023-09-30T17:04:50.415870+0000","last_undegraded":"2023-09-30T17:04:50.415870+0000","last_fullsized":"2023-09-30T17:02:48.266735+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:30:59.510188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"59'5","reported_seq":71,"reported_epoch":63,"state":"active+undersized+degraded","last_fresh":"2023-09-30T17:04:50.413194+0000","last_change":"2023-09-30T17:04:37.172915+0000","last_active":"2023-09-30T17:04:50.413194+0000","last_peered":"2023-09-30T17:04:50.413194+0000","last_clean":"2023-09-30T17:02:44.408604+0000","last_became_active":"2023-09-30T17:02:48.268517+0000","last_became_peered":"2023-09-30T17:02:48.268517+0000","last_unstale":"2023-09-30T17:04:50.413194+0000","last_undegraded":"2023-09-30T17:04:37.165241+0000","last_fullsized":"2023-09-30T17:02:48.265384+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:57:54.085874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"59'11252","reported_seq":11309,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-09-30T17:04:50.416682+0000","last_change":"2023-09-30T17:02:18.360029+0000","last_active":"2023-09-30T17:04:50.416682+0000","last_peered":"2023-09-30T17:04:50.416682+0000","last_clean":"2023-09-30T17:04:50.416682+0000","last_became_active":"2023-09-30T17:02:18.356839+0000","last_became_peered":"2023-09-30T17:02:18.356839+0000","last_unstale":"2023-09-30T17:04:50.416682+0000","last_undegraded":"2023-09-30T17:04:50.416682+0000","last_fullsized":"2023-09-30T17:04:50.416682+0000","mapping_epoch":17,"log_start":"51'6700","ondisk_log_start":"51'6700","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4552,"log_dups_size":6700,"ondisk_log_size":4552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:16:27.516884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33068,"num_write_kb":157144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":61,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-09-30T17:04:50.416700+0000","last_change":"2023-09-30T17:02:12.330472+0000","last_active":"2023-09-30T17:04:50.416700+0000","last_peered":"2023-09-30T17:04:50.416700+0000","last_clean":"2023-09-30T17:04:50.416700+0000","last_became_active":"2023-09-30T17:02:12.330154+0000","last_became_peered":"2023-09-30T17:02:12.330154+0000","last_unstale":"2023-09-30T17:04:50.416700+0000","last_undegraded":"2023-09-30T17:04:50.416700+0000","last_fullsized":"2023-09-30T17:04:50.416700+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:43:23.161734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":58,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-09-30T17:04:50.414593+0000","last_change":"2023-09-30T17:02:17.361007+0000","last_active":"2023-09-30T17:04:50.414593+0000","last_peered":"2023-09-30T17:04:50.414593+0000","last_clean":"2023-09-30T17:04:50.414593+0000","last_became_active":"2023-09-30T17:02:17.360721+0000","last_became_peered":"2023-09-30T17:02:17.360721+0000","last_unstale":"2023-09-30T17:04:50.414593+0000","last_undegraded":"2023-09-30T17:04:50.414593+0000","last_fullsized":"2023-09-30T17:04:50.414593+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:13:41.205152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"59'2836","reported_seq":2897,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.417059+0000","last_change":"2023-09-30T17:04:41.069375+0000","last_active":"2023-09-30T17:04:50.417059+0000","last_peered":"2023-09-30T17:04:50.417059+0000","last_clean":"2023-09-30T17:02:44.410053+0000","last_became_active":"2023-09-30T17:02:48.269467+0000","last_became_peered":"2023-09-30T17:02:48.269467+0000","last_unstale":"2023-09-30T17:04:50.417059+0000","last_undegraded":"2023-09-30T17:04:50.417059+0000","last_fullsized":"2023-09-30T17:02:48.266016+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2836,"log_dups_size":0,"ondisk_log_size":2836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:36:22.971377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8199,"num_write_kb":39048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"59'3","reported_seq":61,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-09-30T17:04:50.414545+0000","last_change":"2023-09-30T17:02:17.360831+0000","last_active":"2023-09-30T17:04:50.414545+0000","last_peered":"2023-09-30T17:04:50.414545+0000","last_clean":"2023-09-30T17:04:50.414545+0000","last_became_active":"2023-09-30T17:02:17.360494+0000","last_became_peered":"2023-09-30T17:02:17.360494+0000","last_unstale":"2023-09-30T17:04:50.414545+0000","last_undegraded":"2023-09-30T17:04:50.414545+0000","last_fullsized":"2023-09-30T17:04:50.414545+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:24:04.564387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":61,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-09-30T17:04:50.414642+0000","last_change":"2023-09-30T17:02:12.328184+0000","last_active":"2023-09-30T17:04:50.414642+0000","last_peered":"2023-09-30T17:04:50.414642+0000","last_clean":"2023-09-30T17:04:50.414642+0000","last_became_active":"2023-09-30T17:02:12.327898+0000","last_became_peered":"2023-09-30T17:02:12.327898+0000","last_unstale":"2023-09-30T17:04:50.414642+0000","last_undegraded":"2023-09-30T17:04:50.414642+0000","last_fullsized":"2023-09-30T17:04:50.414642+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:43:23.161734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"59'8","reported_seq":69,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.413111+0000","last_change":"2023-09-30T17:02:48.269596+0000","last_active":"2023-09-30T17:04:50.413111+0000","last_peered":"2023-09-30T17:04:50.413111+0000","last_clean":"2023-09-30T17:02:44.408499+0000","last_became_active":"2023-09-30T17:02:48.269596+0000","last_became_peered":"2023-09-30T17:02:48.269596+0000","last_unstale":"2023-09-30T17:04:50.413111+0000","last_undegraded":"2023-09-30T17:04:50.413111+0000","last_fullsized":"2023-09-30T17:02:48.265534+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:15:25.260107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":64,"state":"active+undersized","last_fresh":"2023-09-30T17:04:51.419617+0000","last_change":"2023-09-30T17:02:48.269646+0000","last_active":"2023-09-30T17:04:51.419617+0000","last_peered":"2023-09-30T17:04:51.419617+0000","last_clean":"2023-09-30T17:02:11.318349+0000","last_became_active":"2023-09-30T17:02:48.269646+0000","last_became_peered":"2023-09-30T17:02:48.269646+0000","last_unstale":"2023-09-30T17:04:51.419617+0000","last_undegraded":"2023-09-30T17:04:51.419617+0000","last_fullsized":"2023-09-30T17:02:48.267898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:41:23.216160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"60'8","reported_seq":70,"reported_epoch":63,"state":"active+undersized+degraded","last_fresh":"2023-09-30T17:04:50.414383+0000","last_change":"2023-09-30T17:02:48.272900+0000","last_active":"2023-09-30T17:04:50.414383+0000","last_peered":"2023-09-30T17:04:50.414383+0000","last_clean":"2023-09-30T17:02:44.409344+0000","last_became_active":"2023-09-30T17:02:48.272900+0000","last_became_peered":"2023-09-30T17:02:48.272900+0000","last_unstale":"2023-09-30T17:04:50.414383+0000","last_undegraded":"2023-09-30T17:02:48.268412+0000","last_fullsized":"2023-09-30T17:02:48.268294+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:47:15.264970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"59'6","reported_seq":67,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.415979+0000","last_change":"2023-09-30T17:02:48.270428+0000","last_active":"2023-09-30T17:04:50.415979+0000","last_peered":"2023-09-30T17:04:50.415979+0000","last_clean":"2023-09-30T17:02:44.409803+0000","last_became_active":"2023-09-30T17:02:48.270428+0000","last_became_peered":"2023-09-30T17:02:48.270428+0000","last_unstale":"2023-09-30T17:04:50.415979+0000","last_undegraded":"2023-09-30T17:04:50.415979+0000","last_fullsized":"2023-09-30T17:02:48.266279+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:41:09.173972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":63,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.416378+0000","last_change":"2023-09-30T17:02:48.270209+0000","last_active":"2023-09-30T17:04:50.416378+0000","last_peered":"2023-09-30T17:04:50.416378+0000","last_clean":"2023-09-30T17:02:44.409890+0000","last_became_active":"2023-09-30T17:02:48.270209+0000","last_became_peered":"2023-09-30T17:02:48.270209+0000","last_unstale":"2023-09-30T17:04:50.416378+0000","last_undegraded":"2023-09-30T17:04:50.416378+0000","last_fullsized":"2023-09-30T17:02:48.266090+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:17:13.985195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"59'2835","reported_seq":2892,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-09-30T17:04:50.416668+0000","last_change":"2023-09-30T17:02:18.358269+0000","last_active":"2023-09-30T17:04:50.416668+0000","last_peered":"2023-09-30T17:04:50.416668+0000","last_clean":"2023-09-30T17:04:50.416668+0000","last_became_active":"2023-09-30T17:02:18.356902+0000","last_became_peered":"2023-09-30T17:02:18.356902+0000","last_unstale":"2023-09-30T17:04:50.416668+0000","last_undegraded":"2023-09-30T17:04:50.416668+0000","last_fullsized":"2023-09-30T17:04:50.416668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2835,"log_dups_size":0,"ondisk_log_size":2835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:39:28.022201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8302,"num_write_kb":39500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":57,"reported_epoch":63,"state":"active+undersized+degraded","last_fresh":"2023-09-30T17:04:50.414624+0000","last_change":"2023-09-30T17:02:48.273247+0000","last_active":"2023-09-30T17:04:50.414624+0000","last_peered":"2023-09-30T17:04:50.414624+0000","last_clean":"2023-09-30T17:02:18.355305+0000","last_became_active":"2023-09-30T17:02:48.273247+0000","last_became_peered":"2023-09-30T17:02:48.273247+0000","last_unstale":"2023-09-30T17:04:50.414624+0000","last_undegraded":"2023-09-30T17:02:48.268795+0000","last_fullsized":"2023-09-30T17:02:48.268551+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:41:28.231415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"59'2848","reported_seq":2896,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.413203+0000","last_change":"2023-09-30T17:04:41.071698+0000","last_active":"2023-09-30T17:04:50.413203+0000","last_peered":"2023-09-30T17:04:50.413203+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:02:48.268812+0000","last_became_peered":"2023-09-30T17:02:48.268812+0000","last_unstale":"2023-09-30T17:04:50.413203+0000","last_undegraded":"2023-09-30T17:04:50.413203+0000","last_fullsized":"2023-09-30T17:02:48.265407+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2848,"log_dups_size":0,"ondisk_log_size":2848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:51:57.742375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8235,"num_write_kb":39276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"58'3","reported_seq":65,"reported_epoch":63,"state":"active+undersized+degraded","last_fresh":"2023-09-30T17:04:50.416993+0000","last_change":"2023-09-30T17:02:48.271765+0000","last_active":"2023-09-30T17:04:50.416993+0000","last_peered":"2023-09-30T17:04:50.416993+0000","last_clean":"2023-09-30T17:02:44.410390+0000","last_became_active":"2023-09-30T17:02:48.271765+0000","last_became_peered":"2023-09-30T17:02:48.271765+0000","last_unstale":"2023-09-30T17:04:50.416993+0000","last_undegraded":"2023-09-30T17:02:48.267946+0000","last_fullsized":"2023-09-30T17:02:48.267611+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:34:27.997669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"59'10","reported_seq":58,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.413310+0000","last_change":"2023-09-30T17:02:48.268506+0000","last_active":"2023-09-30T17:04:50.413310+0000","last_peered":"2023-09-30T17:04:50.413310+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:02:48.268506+0000","last_became_peered":"2023-09-30T17:02:48.268506+0000","last_unstale":"2023-09-30T17:04:50.413310+0000","last_undegraded":"2023-09-30T17:04:50.413310+0000","last_fullsized":"2023-09-30T17:02:48.265674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:54:50.127494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":59,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-09-30T17:04:50.414574+0000","last_change":"2023-09-30T17:02:17.360802+0000","last_active":"2023-09-30T17:04:50.414574+0000","last_peered":"2023-09-30T17:04:50.414574+0000","last_clean":"2023-09-30T17:04:50.414574+0000","last_became_active":"2023-09-30T17:02:17.360475+0000","last_became_peered":"2023-09-30T17:02:17.360475+0000","last_unstale":"2023-09-30T17:04:50.414574+0000","last_undegraded":"2023-09-30T17:04:50.414574+0000","last_fullsized":"2023-09-30T17:04:50.414574+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:50:18.455188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"59'5711","reported_seq":5768,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-09-30T17:04:50.416136+0000","last_change":"2023-09-30T17:02:18.359857+0000","last_active":"2023-09-30T17:04:50.416136+0000","last_peered":"2023-09-30T17:04:50.416136+0000","last_clean":"2023-09-30T17:04:50.416136+0000","last_became_active":"2023-09-30T17:02:18.357098+0000","last_became_peered":"2023-09-30T17:02:18.357098+0000","last_unstale":"2023-09-30T17:04:50.416136+0000","last_undegraded":"2023-09-30T17:04:50.416136+0000","last_fullsized":"2023-09-30T17:04:50.416136+0000","mapping_epoch":17,"log_start":"42'1200","ondisk_log_start":"42'1200","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4511,"log_dups_size":1200,"ondisk_log_size":4511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:48:17.598726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16681,"num_write_kb":79476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":66,"reported_epoch":63,"state":"active+undersized+degraded","last_fresh":"2023-09-30T17:04:50.414794+0000","last_change":"2023-09-30T17:02:48.272137+0000","last_active":"2023-09-30T17:04:50.414794+0000","last_peered":"2023-09-30T17:04:50.414794+0000","last_clean":"2023-09-30T17:02:44.409454+0000","last_became_active":"2023-09-30T17:02:48.272137+0000","last_became_peered":"2023-09-30T17:02:48.272137+0000","last_unstale":"2023-09-30T17:04:50.414794+0000","last_undegraded":"2023-09-30T17:02:48.268448+0000","last_fullsized":"2023-09-30T17:02:48.268351+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:45:50.479146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":2}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"59'2872","reported_seq":2920,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.413622+0000","last_change":"2023-09-30T17:04:40.511971+0000","last_active":"2023-09-30T17:04:50.413622+0000","last_peered":"2023-09-30T17:04:50.413622+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:02:48.270232+0000","last_became_peered":"2023-09-30T17:02:48.270232+0000","last_unstale":"2023-09-30T17:04:50.413622+0000","last_undegraded":"2023-09-30T17:04:50.413622+0000","last_fullsized":"2023-09-30T17:02:48.265967+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2872,"log_dups_size":0,"ondisk_log_size":2872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:32:00.810461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8447,"num_write_kb":40072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"59'9","reported_seq":58,"reported_epoch":64,"state":"active+undersized","last_fresh":"2023-09-30T17:04:51.417762+0000","last_change":"2023-09-30T17:02:48.266305+0000","last_active":"2023-09-30T17:04:51.417762+0000","last_peered":"2023-09-30T17:04:51.417762+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:02:48.266305+0000","last_became_peered":"2023-09-30T17:02:48.266305+0000","last_unstale":"2023-09-30T17:04:51.417762+0000","last_undegraded":"2023-09-30T17:04:51.417762+0000","last_fullsized":"2023-09-30T17:02:48.265145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:28:07.751219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"59'13","reported_seq":70,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-09-30T17:04:50.413172+0000","last_change":"2023-09-30T17:02:18.363479+0000","last_active":"2023-09-30T17:04:50.413172+0000","last_peered":"2023-09-30T17:04:50.413172+0000","last_clean":"2023-09-30T17:04:50.413172+0000","last_became_active":"2023-09-30T17:02:18.363222+0000","last_became_peered":"2023-09-30T17:02:18.363222+0000","last_unstale":"2023-09-30T17:04:50.413172+0000","last_undegraded":"2023-09-30T17:04:50.413172+0000","last_fullsized":"2023-09-30T17:04:50.413172+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:09:55.056098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"59'2796","reported_seq":2857,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.416667+0000","last_change":"2023-09-30T17:04:40.523834+0000","last_active":"2023-09-30T17:04:50.416667+0000","last_peered":"2023-09-30T17:04:50.416667+0000","last_clean":"2023-09-30T17:02:44.410028+0000","last_became_active":"2023-09-30T17:02:48.270213+0000","last_became_peered":"2023-09-30T17:02:48.270213+0000","last_unstale":"2023-09-30T17:04:50.416667+0000","last_undegraded":"2023-09-30T17:04:50.416667+0000","last_fullsized":"2023-09-30T17:02:48.267054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2796,"log_dups_size":0,"ondisk_log_size":2796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:03:50.757844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8138,"num_write_kb":38784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"59'2852","reported_seq":2909,"reported_epoch":63,"state":"active+clean","last_fresh":"2023-09-30T17:04:50.413493+0000","last_change":"2023-09-30T17:02:18.363216+0000","last_active":"2023-09-30T17:04:50.413493+0000","last_peered":"2023-09-30T17:04:50.413493+0000","last_clean":"2023-09-30T17:04:50.413493+0000","last_became_active":"2023-09-30T17:02:18.362894+0000","last_became_peered":"2023-09-30T17:02:18.362894+0000","last_unstale":"2023-09-30T17:04:50.413493+0000","last_undegraded":"2023-09-30T17:04:50.413493+0000","last_fullsized":"2023-09-30T17:04:50.413493+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2852,"log_dups_size":0,"ondisk_log_size":2852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:30:43.782165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8357,"num_write_kb":39780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"59'2874","reported_seq":2935,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.416866+0000","last_change":"2023-09-30T17:04:40.498561+0000","last_active":"2023-09-30T17:04:50.416866+0000","last_peered":"2023-09-30T17:04:50.416866+0000","last_clean":"2023-09-30T17:02:44.410264+0000","last_became_active":"2023-09-30T17:02:48.270541+0000","last_became_peered":"2023-09-30T17:02:48.270541+0000","last_unstale":"2023-09-30T17:04:50.416866+0000","last_undegraded":"2023-09-30T17:04:50.416866+0000","last_fullsized":"2023-09-30T17:02:48.267860+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2874,"log_dups_size":0,"ondisk_log_size":2874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:55:32.692232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8465,"num_write_kb":40104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":532685,"num_write_kb":2575302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140940,"ondisk_log_size":140940,"up":87,"acting":87,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":228927,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":22,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":137,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":234609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":39,"acting":39,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":1,"acting":1,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":0,"seq":1,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28328,"kb_used_data":800,"kb_used_omap":6,"kb_used_meta":27513,"kb_avail":94343512,"statfs":{"total":96636764160,"available":96607756288,"internally_reserved":0,"allocated":819200,"data_stored":666383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7139,"internal_metadata":28173341},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},{"osd":0,"up_from":8,"seq":34359738406,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":582348,"kb_used_data":1344,"kb_used_omap":1,"kb_used_meta":580990,"kb_avail":93789492,"statfs":{"total":96636764160,"available":96040439808,"internally_reserved":0,"allocated":1376256,"data_stored":1066875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":594934214},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 17:04:07 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46899999999999997,"15min":0.47299999999999998},"min":{"1min":0.21299999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.42499999999999999,"15min":0.437},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.59299999999999997,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.45100000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]}]},{"osd":1,"up_from":8,"seq":34359738406,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":563492,"kb_used_data":532,"kb_used_omap":1,"kb_used_meta":562942,"kb_avail":93808348,"statfs":{"total":96636764160,"available":96059748352,"internally_reserved":0,"allocated":544768,"data_stored":250024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":576453062},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 17:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.432,"15min":0.438},"min":{"1min":0.17100000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":1.831,"5min":1.831,"15min":1.831},"last":0.499},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.46600000000000003,"15min":0.44500000000000001},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":2.5430000000000001,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":0.44}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":249856,"data_stored":227705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T17:05:05.335 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T17:05:05.850 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:05:05.852 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-09-30T17:05:05.862 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":157,"stamp":"2023-09-30T17:05:05.333882+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":819295,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":29,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":140,"num_read_kb":122,"num_write":533025,"num_write_kb":2579054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":696,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141229,"ondisk_log_size":141229,"up":187,"acting":162,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1174240,"kb_used_data":2744,"kb_used_omap":10,"kb_used_meta":1171445,"kb_avail":281941280,"statfs":{"total":289910292480,"available":288707870720,"internally_reserved":0,"allocated":2809856,"data_stored":2021459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10327,"internal_metadata":1199560617},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":696,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001206"},"pg_stats":[{"pgid":"4.3f","version":"59'2790","reported_seq":2851,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.298448+0000","last_change":"2023-09-30T17:02:18.360288+0000","last_active":"2023-09-30T17:05:03.298448+0000","last_peered":"2023-09-30T17:05:03.298448+0000","last_clean":"2023-09-30T17:05:03.298448+0000","last_became_active":"2023-09-30T17:02:18.358716+0000","last_became_peered":"2023-09-30T17:02:18.358716+0000","last_unstale":"2023-09-30T17:05:03.298448+0000","last_undegraded":"2023-09-30T17:05:03.298448+0000","last_fullsized":"2023-09-30T17:05:03.298448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2790,"log_dups_size":0,"ondisk_log_size":2790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:12:06.380095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8214,"num_write_kb":38924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"59'4","reported_seq":65,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.294835+0000","last_change":"2023-09-30T17:02:18.362418+0000","last_active":"2023-09-30T17:05:03.294835+0000","last_peered":"2023-09-30T17:05:03.294835+0000","last_clean":"2023-09-30T17:05:03.294835+0000","last_became_active":"2023-09-30T17:02:18.360372+0000","last_became_peered":"2023-09-30T17:02:18.360372+0000","last_unstale":"2023-09-30T17:05:03.294835+0000","last_undegraded":"2023-09-30T17:05:03.294835+0000","last_fullsized":"2023-09-30T17:05:03.294835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:43:29.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"59'5697","reported_seq":5754,"reported_epoch":68,"state":"active+undersized+remapped+backfill_wait","last_fresh":"2023-09-30T17:05:04.682616+0000","last_change":"2023-09-30T17:05:04.682749+0000","last_active":"2023-09-30T17:05:04.682616+0000","last_peered":"2023-09-30T17:05:04.682616+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:05:04.681262+0000","last_became_peered":"2023-09-30T17:05:04.681262+0000","last_unstale":"2023-09-30T17:05:04.682616+0000","last_undegraded":"2023-09-30T17:05:04.682616+0000","last_fullsized":"2023-09-30T17:05:04.349577+0000","mapping_epoch":67,"log_start":"42'1200","ondisk_log_start":"42'1200","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4497,"log_dups_size":1200,"ondisk_log_size":4497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:27:28.611647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16590,"num_write_kb":78960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"59'10","reported_seq":59,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.413799+0000","last_change":"2023-09-30T17:02:48.271018+0000","last_active":"2023-09-30T17:04:50.413799+0000","last_peered":"2023-09-30T17:04:50.413799+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:02:48.271018+0000","last_became_peered":"2023-09-30T17:02:48.271018+0000","last_unstale":"2023-09-30T17:04:50.413799+0000","last_undegraded":"2023-09-30T17:04:50.413799+0000","last_fullsized":"2023-09-30T17:02:48.266412+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:41:09.173972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"59'2934","reported_seq":2995,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.293902+0000","last_change":"2023-09-30T17:02:18.360192+0000","last_active":"2023-09-30T17:05:03.293902+0000","last_peered":"2023-09-30T17:05:03.293902+0000","last_clean":"2023-09-30T17:05:03.293902+0000","last_became_active":"2023-09-30T17:02:18.357317+0000","last_became_peered":"2023-09-30T17:02:18.357317+0000","last_unstale":"2023-09-30T17:05:03.293902+0000","last_undegraded":"2023-09-30T17:05:03.293902+0000","last_fullsized":"2023-09-30T17:05:03.293902+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2934,"log_dups_size":0,"ondisk_log_size":2934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:37:14.790993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8466,"num_write_kb":40084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"59'6","reported_seq":54,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.413086+0000","last_change":"2023-09-30T17:02:48.267405+0000","last_active":"2023-09-30T17:04:50.413086+0000","last_peered":"2023-09-30T17:04:50.413086+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:02:48.267405+0000","last_became_peered":"2023-09-30T17:02:48.267405+0000","last_unstale":"2023-09-30T17:04:50.413086+0000","last_undegraded":"2023-09-30T17:04:50.413086+0000","last_fullsized":"2023-09-30T17:02:48.265304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:39:21.100353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"59'7","reported_seq":55,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.412996+0000","last_change":"2023-09-30T17:02:48.268306+0000","last_active":"2023-09-30T17:04:50.412996+0000","last_peered":"2023-09-30T17:04:50.412996+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:02:48.268306+0000","last_became_peered":"2023-09-30T17:02:48.268306+0000","last_unstale":"2023-09-30T17:04:50.412996+0000","last_undegraded":"2023-09-30T17:04:50.412996+0000","last_fullsized":"2023-09-30T17:02:48.265227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:20:53.357746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"59'11423","reported_seq":11475,"reported_epoch":68,"state":"activating+undersized+remapped","last_fresh":"2023-09-30T17:05:04.293986+0000","last_change":"2023-09-30T17:05:04.364646+0000","last_active":"2023-09-30T17:05:03.293089+0000","last_peered":"2023-09-30T17:05:01.285591+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:02:48.268573+0000","last_became_peered":"2023-09-30T17:02:48.268573+0000","last_unstale":"2023-09-30T17:05:04.293986+0000","last_undegraded":"2023-09-30T17:05:04.293986+0000","last_fullsized":"2023-09-30T17:05:04.293986+0000","mapping_epoch":67,"log_start":"52'7200","ondisk_log_start":"52'7200","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4223,"log_dups_size":7200,"ondisk_log_size":4223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:56:52.522789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33444,"num_write_kb":158924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"59'8589","reported_seq":8650,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.293977+0000","last_change":"2023-09-30T17:02:18.364222+0000","last_active":"2023-09-30T17:05:03.293977+0000","last_peered":"2023-09-30T17:05:03.293977+0000","last_clean":"2023-09-30T17:05:03.293977+0000","last_became_active":"2023-09-30T17:02:18.363485+0000","last_became_peered":"2023-09-30T17:02:18.363485+0000","last_unstale":"2023-09-30T17:05:03.293977+0000","last_undegraded":"2023-09-30T17:05:03.293977+0000","last_fullsized":"2023-09-30T17:05:03.293977+0000","mapping_epoch":17,"log_start":"49'4400","ondisk_log_start":"49'4400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4189,"log_dups_size":4400,"ondisk_log_size":4189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:14:35.192615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25052,"num_write_kb":118756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"59'8585","reported_seq":8646,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.296848+0000","last_change":"2023-09-30T17:02:18.360010+0000","last_active":"2023-09-30T17:05:03.296848+0000","last_peered":"2023-09-30T17:05:03.296848+0000","last_clean":"2023-09-30T17:05:03.296848+0000","last_became_active":"2023-09-30T17:02:18.358396+0000","last_became_peered":"2023-09-30T17:02:18.358396+0000","last_unstale":"2023-09-30T17:05:03.296848+0000","last_undegraded":"2023-09-30T17:05:03.296848+0000","last_fullsized":"2023-09-30T17:05:03.296848+0000","mapping_epoch":17,"log_start":"48'4100","ondisk_log_start":"48'4100","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4485,"log_dups_size":4100,"ondisk_log_size":4485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:26:11.522402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24997,"num_write_kb":162463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"59'5664","reported_seq":5716,"reported_epoch":68,"state":"activating+undersized+remapped","last_fresh":"2023-09-30T17:05:04.295037+0000","last_change":"2023-09-30T17:05:04.356723+0000","last_active":"2023-09-30T17:05:03.294233+0000","last_peered":"2023-09-30T17:05:01.286460+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:02:48.271026+0000","last_became_peered":"2023-09-30T17:02:48.271026+0000","last_unstale":"2023-09-30T17:05:04.295037+0000","last_undegraded":"2023-09-30T17:05:04.295037+0000","last_fullsized":"2023-09-30T17:05:04.295037+0000","mapping_epoch":67,"log_start":"43'1400","ondisk_log_start":"43'1400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4264,"log_dups_size":1400,"ondisk_log_size":4264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:07:23.682970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16442,"num_write_kb":78308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"59'2931","reported_seq":3001,"reported_epoch":68,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2023-09-30T17:05:04.685614+0000","last_change":"2023-09-30T17:05:04.686083+0000","last_active":"2023-09-30T17:05:04.685614+0000","last_peered":"2023-09-30T17:05:04.685614+0000","last_clean":"2023-09-30T17:02:44.409974+0000","last_became_active":"2023-09-30T17:05:04.684700+0000","last_became_peered":"2023-09-30T17:05:04.684700+0000","last_unstale":"2023-09-30T17:05:04.685614+0000","last_undegraded":"2023-09-30T17:05:04.350380+0000","last_fullsized":"2023-09-30T17:05:04.295029+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2931,"log_dups_size":0,"ondisk_log_size":2931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:56:52.522789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8488,"num_write_kb":40364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"59'2860","reported_seq":2921,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.293200+0000","last_change":"2023-09-30T17:02:18.359894+0000","last_active":"2023-09-30T17:05:03.293200+0000","last_peered":"2023-09-30T17:05:03.293200+0000","last_clean":"2023-09-30T17:05:03.293200+0000","last_became_active":"2023-09-30T17:02:18.358534+0000","last_became_peered":"2023-09-30T17:02:18.358534+0000","last_unstale":"2023-09-30T17:05:03.293200+0000","last_undegraded":"2023-09-30T17:05:03.293200+0000","last_fullsized":"2023-09-30T17:05:03.293200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2860,"log_dups_size":0,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:22:13.025181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8367,"num_write_kb":39772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"59'2911","reported_seq":2967,"reported_epoch":68,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2023-09-30T17:05:04.667557+0000","last_change":"2023-09-30T17:05:04.667684+0000","last_active":"2023-09-30T17:05:04.667557+0000","last_peered":"2023-09-30T17:05:04.667557+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:05:04.666466+0000","last_became_peered":"2023-09-30T17:05:04.666466+0000","last_unstale":"2023-09-30T17:05:04.667557+0000","last_undegraded":"2023-09-30T17:05:04.341380+0000","last_fullsized":"2023-09-30T17:05:04.294313+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2911,"log_dups_size":0,"ondisk_log_size":2911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:04:34.010415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8419,"num_write_kb":39940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"59'2889","reported_seq":2945,"reported_epoch":68,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2023-09-30T17:05:04.667049+0000","last_change":"2023-09-30T17:05:04.667237+0000","last_active":"2023-09-30T17:05:04.667049+0000","last_peered":"2023-09-30T17:05:04.667049+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:05:04.666044+0000","last_became_peered":"2023-09-30T17:05:04.666044+0000","last_unstale":"2023-09-30T17:05:04.667049+0000","last_undegraded":"2023-09-30T17:05:04.344281+0000","last_fullsized":"2023-09-30T17:05:04.294132+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2889,"log_dups_size":0,"ondisk_log_size":2889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:10:21.239311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8435,"num_write_kb":39984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"59'2839","reported_seq":2891,"reported_epoch":68,"state":"activating+undersized+remapped","last_fresh":"2023-09-30T17:05:04.293874+0000","last_change":"2023-09-30T17:05:04.333472+0000","last_active":"2023-09-30T17:05:03.292896+0000","last_peered":"2023-09-30T17:05:01.285397+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:02:48.267199+0000","last_became_peered":"2023-09-30T17:02:48.267199+0000","last_unstale":"2023-09-30T17:05:04.293874+0000","last_undegraded":"2023-09-30T17:05:04.293874+0000","last_fullsized":"2023-09-30T17:05:04.293874+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2839,"log_dups_size":0,"ondisk_log_size":2839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:05:29.995730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8166,"num_write_kb":38928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"59'2802","reported_seq":2863,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.294096+0000","last_change":"2023-09-30T17:02:18.364360+0000","last_active":"2023-09-30T17:05:03.294096+0000","last_peered":"2023-09-30T17:05:03.294096+0000","last_clean":"2023-09-30T17:05:03.294096+0000","last_became_active":"2023-09-30T17:02:18.363697+0000","last_became_peered":"2023-09-30T17:02:18.363697+0000","last_unstale":"2023-09-30T17:05:03.294096+0000","last_undegraded":"2023-09-30T17:05:03.294096+0000","last_fullsized":"2023-09-30T17:05:03.294096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2802,"log_dups_size":0,"ondisk_log_size":2802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:50:52.893768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8256,"num_write_kb":39208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"59'2860","reported_seq":2921,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.297246+0000","last_change":"2023-09-30T17:02:18.360320+0000","last_active":"2023-09-30T17:05:03.297246+0000","last_peered":"2023-09-30T17:05:03.297246+0000","last_clean":"2023-09-30T17:05:03.297246+0000","last_became_active":"2023-09-30T17:02:18.357184+0000","last_became_peered":"2023-09-30T17:02:18.357184+0000","last_unstale":"2023-09-30T17:05:03.297246+0000","last_undegraded":"2023-09-30T17:05:03.297246+0000","last_fullsized":"2023-09-30T17:05:03.297246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2860,"log_dups_size":0,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:21:45.195007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8368,"num_write_kb":39616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"59'5686","reported_seq":5747,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.293409+0000","last_change":"2023-09-30T17:02:18.363956+0000","last_active":"2023-09-30T17:05:03.293409+0000","last_peered":"2023-09-30T17:05:03.293409+0000","last_clean":"2023-09-30T17:05:03.293409+0000","last_became_active":"2023-09-30T17:02:18.363654+0000","last_became_peered":"2023-09-30T17:02:18.363654+0000","last_unstale":"2023-09-30T17:05:03.293409+0000","last_undegraded":"2023-09-30T17:05:03.293409+0000","last_fullsized":"2023-09-30T17:05:03.293409+0000","mapping_epoch":17,"log_start":"44'1500","ondisk_log_start":"44'1500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4186,"log_dups_size":1500,"ondisk_log_size":4186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:48:17.598726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16649,"num_write_kb":78956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"59'5799","reported_seq":5852,"reported_epoch":68,"state":"activating+undersized+remapped","last_fresh":"2023-09-30T17:05:04.359744+0000","last_change":"2023-09-30T17:05:04.359744+0000","last_active":"2023-09-30T17:05:03.295468+0000","last_peered":"2023-09-30T17:05:01.286480+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:02:48.273070+0000","last_became_peered":"2023-09-30T17:02:48.273070+0000","last_unstale":"2023-09-30T17:05:04.359744+0000","last_undegraded":"2023-09-30T17:05:04.359744+0000","last_fullsized":"2023-09-30T17:05:04.294851+0000","mapping_epoch":67,"log_start":"44'1600","ondisk_log_start":"44'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4199,"log_dups_size":1600,"ondisk_log_size":4199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:09:57.818937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16903,"num_write_kb":80184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"59'12","reported_seq":60,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.413217+0000","last_change":"2023-09-30T17:02:48.269502+0000","last_active":"2023-09-30T17:04:50.413217+0000","last_peered":"2023-09-30T17:04:50.413217+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:02:48.269502+0000","last_became_peered":"2023-09-30T17:02:48.269502+0000","last_unstale":"2023-09-30T17:04:50.413217+0000","last_undegraded":"2023-09-30T17:04:50.413217+0000","last_fullsized":"2023-09-30T17:02:48.265516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:22:15.057405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"59'2879","reported_seq":2949,"reported_epoch":68,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2023-09-30T17:05:04.675971+0000","last_change":"2023-09-30T17:05:04.676123+0000","last_active":"2023-09-30T17:05:04.675971+0000","last_peered":"2023-09-30T17:05:04.675971+0000","last_clean":"2023-09-30T17:02:44.409783+0000","last_became_active":"2023-09-30T17:05:04.675105+0000","last_became_peered":"2023-09-30T17:05:04.675105+0000","last_unstale":"2023-09-30T17:05:04.675971+0000","last_undegraded":"2023-09-30T17:05:04.350614+0000","last_fullsized":"2023-09-30T17:05:04.294637+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2879,"log_dups_size":0,"ondisk_log_size":2879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:25:29.014968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8343,"num_write_kb":39768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"59'2809","reported_seq":2875,"reported_epoch":68,"state":"activating+undersized+remapped","last_fresh":"2023-09-30T17:05:04.294246+0000","last_change":"2023-09-30T17:05:04.336681+0000","last_active":"2023-09-30T17:05:02.294532+0000","last_peered":"2023-09-30T17:05:01.285906+0000","last_clean":"2023-09-30T17:02:44.409099+0000","last_became_active":"2023-09-30T17:02:48.270162+0000","last_became_peered":"2023-09-30T17:02:48.270162+0000","last_unstale":"2023-09-30T17:05:04.294246+0000","last_undegraded":"2023-09-30T17:05:04.294246+0000","last_fullsized":"2023-09-30T17:05:04.294246+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2809,"log_dups_size":0,"ondisk_log_size":2809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:31:14.223659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8281,"num_write_kb":39472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"59'5585","reported_seq":5646,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.293866+0000","last_change":"2023-09-30T17:02:18.353938+0000","last_active":"2023-09-30T17:05:03.293866+0000","last_peered":"2023-09-30T17:05:03.293866+0000","last_clean":"2023-09-30T17:05:03.293866+0000","last_became_active":"2023-09-30T17:02:18.353632+0000","last_became_peered":"2023-09-30T17:02:18.353632+0000","last_unstale":"2023-09-30T17:05:03.293866+0000","last_undegraded":"2023-09-30T17:05:03.293866+0000","last_fullsized":"2023-09-30T17:05:03.293866+0000","mapping_epoch":17,"log_start":"42'1100","ondisk_log_start":"42'1100","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4485,"log_dups_size":1100,"ondisk_log_size":4485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:09:55.056098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16523,"num_write_kb":78256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"59'2888","reported_seq":2962,"reported_epoch":68,"state":"active+undersized+remapped","last_fresh":"2023-09-30T17:05:04.684311+0000","last_change":"2023-09-30T17:05:04.684498+0000","last_active":"2023-09-30T17:05:04.684311+0000","last_peered":"2023-09-30T17:05:04.684311+0000","last_clean":"2023-09-30T17:02:44.410555+0000","last_became_active":"2023-09-30T17:05:04.622264+0000","last_became_peered":"2023-09-30T17:05:04.622264+0000","last_unstale":"2023-09-30T17:05:04.684311+0000","last_undegraded":"2023-09-30T17:05:04.684311+0000","last_fullsized":"2023-09-30T17:05:04.296505+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2888,"log_dups_size":0,"ondisk_log_size":2888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:22:14.097479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8371,"num_write_kb":39716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"59'18","reported_seq":90,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.310314+0000","last_change":"2023-09-30T17:05:03.309295+0000","last_active":"2023-09-30T17:05:03.310314+0000","last_peered":"2023-09-30T17:05:03.310314+0000","last_clean":"2023-09-30T17:05:03.310314+0000","last_became_active":"2023-09-30T17:05:03.308884+0000","last_became_peered":"2023-09-30T17:05:03.308884+0000","last_unstale":"2023-09-30T17:05:03.310314+0000","last_undegraded":"2023-09-30T17:05:03.310314+0000","last_fullsized":"2023-09-30T17:05:03.310314+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:57:45.449671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"59'2855","reported_seq":2912,"reported_epoch":68,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2023-09-30T17:05:04.666942+0000","last_change":"2023-09-30T17:05:04.667093+0000","last_active":"2023-09-30T17:05:04.666942+0000","last_peered":"2023-09-30T17:05:04.666942+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:05:04.665996+0000","last_became_peered":"2023-09-30T17:05:04.665996+0000","last_unstale":"2023-09-30T17:05:04.666942+0000","last_undegraded":"2023-09-30T17:05:04.343573+0000","last_fullsized":"2023-09-30T17:05:04.295209+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2855,"log_dups_size":0,"ondisk_log_size":2855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:31:14.223659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8347,"num_write_kb":39608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":63,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.292988+0000","last_change":"2023-09-30T17:02:17.358258+0000","last_active":"2023-09-30T17:05:03.292988+0000","last_peered":"2023-09-30T17:05:03.292988+0000","last_clean":"2023-09-30T17:05:03.292988+0000","last_became_active":"2023-09-30T17:02:17.357890+0000","last_became_peered":"2023-09-30T17:02:17.357890+0000","last_unstale":"2023-09-30T17:05:03.292988+0000","last_undegraded":"2023-09-30T17:05:03.292988+0000","last_fullsized":"2023-09-30T17:05:03.292988+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:52:56.591906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"59'17","reported_seq":89,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.309329+0000","last_change":"2023-09-30T17:05:03.307486+0000","last_active":"2023-09-30T17:05:03.309329+0000","last_peered":"2023-09-30T17:05:03.309329+0000","last_clean":"2023-09-30T17:05:03.309329+0000","last_became_active":"2023-09-30T17:05:03.307012+0000","last_became_peered":"2023-09-30T17:05:03.307012+0000","last_unstale":"2023-09-30T17:05:03.309329+0000","last_undegraded":"2023-09-30T17:05:03.309329+0000","last_fullsized":"2023-09-30T17:05:03.309329+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:05:29.995730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":73,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.310296+0000","last_change":"2023-09-30T17:05:03.309164+0000","last_active":"2023-09-30T17:05:03.310296+0000","last_peered":"2023-09-30T17:05:03.310296+0000","last_clean":"2023-09-30T17:05:03.310296+0000","last_became_active":"2023-09-30T17:05:03.308073+0000","last_became_peered":"2023-09-30T17:05:03.308073+0000","last_unstale":"2023-09-30T17:05:03.310296+0000","last_undegraded":"2023-09-30T17:05:03.310296+0000","last_fullsized":"2023-09-30T17:05:03.310296+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:10:16.238053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"59'6","reported_seq":78,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.309853+0000","last_change":"2023-09-30T17:05:03.308692+0000","last_active":"2023-09-30T17:05:03.309853+0000","last_peered":"2023-09-30T17:05:03.309853+0000","last_clean":"2023-09-30T17:05:03.309853+0000","last_became_active":"2023-09-30T17:05:03.307932+0000","last_became_peered":"2023-09-30T17:05:03.307932+0000","last_unstale":"2023-09-30T17:05:03.309853+0000","last_undegraded":"2023-09-30T17:05:03.309853+0000","last_fullsized":"2023-09-30T17:05:03.309853+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:17:13.668052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":62,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.293753+0000","last_change":"2023-09-30T17:02:17.361000+0000","last_active":"2023-09-30T17:05:03.293753+0000","last_peered":"2023-09-30T17:05:03.293753+0000","last_clean":"2023-09-30T17:05:03.293753+0000","last_became_active":"2023-09-30T17:02:17.360601+0000","last_became_peered":"2023-09-30T17:02:17.360601+0000","last_unstale":"2023-09-30T17:05:03.293753+0000","last_undegraded":"2023-09-30T17:05:03.293753+0000","last_fullsized":"2023-09-30T17:05:03.293753+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:02:27.666526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"59'7","reported_seq":79,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.307828+0000","last_change":"2023-09-30T17:05:03.305898+0000","last_active":"2023-09-30T17:05:03.307828+0000","last_peered":"2023-09-30T17:05:03.307828+0000","last_clean":"2023-09-30T17:05:03.307828+0000","last_became_active":"2023-09-30T17:05:03.305520+0000","last_became_peered":"2023-09-30T17:05:03.305520+0000","last_unstale":"2023-09-30T17:05:03.307828+0000","last_undegraded":"2023-09-30T17:05:03.307828+0000","last_fullsized":"2023-09-30T17:05:03.307828+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:40:09.276369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"58'1","reported_seq":74,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.310300+0000","last_change":"2023-09-30T17:05:03.309303+0000","last_active":"2023-09-30T17:05:03.310300+0000","last_peered":"2023-09-30T17:05:03.310300+0000","last_clean":"2023-09-30T17:05:03.310300+0000","last_became_active":"2023-09-30T17:05:03.308851+0000","last_became_peered":"2023-09-30T17:05:03.308851+0000","last_unstale":"2023-09-30T17:05:03.310300+0000","last_undegraded":"2023-09-30T17:05:03.310300+0000","last_fullsized":"2023-09-30T17:05:03.310300+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:32:55.497287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"59'9","reported_seq":70,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.293329+0000","last_change":"2023-09-30T17:02:18.358841+0000","last_active":"2023-09-30T17:05:03.293329+0000","last_peered":"2023-09-30T17:05:03.293329+0000","last_clean":"2023-09-30T17:05:03.293329+0000","last_became_active":"2023-09-30T17:02:18.358529+0000","last_became_peered":"2023-09-30T17:02:18.358529+0000","last_unstale":"2023-09-30T17:05:03.293329+0000","last_undegraded":"2023-09-30T17:05:03.293329+0000","last_fullsized":"2023-09-30T17:05:03.293329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:15:54.364571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.414744+0000","last_change":"2023-09-30T17:02:48.273786+0000","last_active":"2023-09-30T17:04:50.414744+0000","last_peered":"2023-09-30T17:04:50.414744+0000","last_clean":"2023-09-30T17:02:16.333605+0000","last_became_active":"2023-09-30T17:02:48.273786+0000","last_became_peered":"2023-09-30T17:02:48.273786+0000","last_unstale":"2023-09-30T17:04:50.414744+0000","last_undegraded":"2023-09-30T17:04:50.414744+0000","last_fullsized":"2023-09-30T17:02:48.269616+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:55:31.686602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"59'8526","reported_seq":8592,"reported_epoch":68,"state":"activating+undersized+remapped","last_fresh":"2023-09-30T17:05:04.294458+0000","last_change":"2023-09-30T17:05:04.363997+0000","last_active":"2023-09-30T17:05:02.297380+0000","last_peered":"2023-09-30T17:05:01.286184+0000","last_clean":"2023-09-30T17:02:44.408876+0000","last_became_active":"2023-09-30T17:02:48.271101+0000","last_became_peered":"2023-09-30T17:02:48.271101+0000","last_unstale":"2023-09-30T17:05:04.294458+0000","last_undegraded":"2023-09-30T17:05:04.294458+0000","last_fullsized":"2023-09-30T17:05:04.294458+0000","mapping_epoch":67,"log_start":"49'4300","ondisk_log_start":"49'4300","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4226,"log_dups_size":4300,"ondisk_log_size":4226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:13:34.205219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24873,"num_write_kb":118472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"59'7","reported_seq":85,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.311471+0000","last_change":"2023-09-30T17:05:03.310987+0000","last_active":"2023-09-30T17:05:03.311471+0000","last_peered":"2023-09-30T17:05:03.311471+0000","last_clean":"2023-09-30T17:05:03.311471+0000","last_became_active":"2023-09-30T17:05:03.306646+0000","last_became_peered":"2023-09-30T17:05:03.306646+0000","last_unstale":"2023-09-30T17:05:03.311471+0000","last_undegraded":"2023-09-30T17:05:03.311471+0000","last_fullsized":"2023-09-30T17:05:03.311471+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:24:52.247523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"59'5670","reported_seq":5731,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.293120+0000","last_change":"2023-09-30T17:02:18.359118+0000","last_active":"2023-09-30T17:05:03.293120+0000","last_peered":"2023-09-30T17:05:03.293120+0000","last_clean":"2023-09-30T17:05:03.293120+0000","last_became_active":"2023-09-30T17:02:18.358786+0000","last_became_peered":"2023-09-30T17:02:18.358786+0000","last_unstale":"2023-09-30T17:05:03.293120+0000","last_undegraded":"2023-09-30T17:05:03.293120+0000","last_fullsized":"2023-09-30T17:05:03.293120+0000","mapping_epoch":17,"log_start":"44'1500","ondisk_log_start":"44'1500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4170,"log_dups_size":1500,"ondisk_log_size":4170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:33:21.723864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16627,"num_write_kb":79047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"60'78","reported_seq":137,"reported_epoch":63,"state":"active+undersized+degraded","last_fresh":"2023-09-30T17:04:50.415990+0000","last_change":"2023-09-30T17:02:48.270268+0000","last_active":"2023-09-30T17:04:50.415990+0000","last_peered":"2023-09-30T17:04:50.415990+0000","last_clean":"2023-09-30T17:02:39.878275+0000","last_became_active":"2023-09-30T17:02:48.270268+0000","last_became_peered":"2023-09-30T17:02:48.270268+0000","last_unstale":"2023-09-30T17:04:50.415990+0000","last_undegraded":"2023-09-30T17:02:48.267766+0000","last_fullsized":"2023-09-30T17:02:48.266692+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:45:50.479146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227523,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":4}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"59'5677","reported_seq":5737,"reported_epoch":68,"state":"active+undersized+remapped+backfill_wait","last_fresh":"2023-09-30T17:05:04.615546+0000","last_change":"2023-09-30T17:05:04.615546+0000","last_active":"2023-09-30T17:05:04.615546+0000","last_peered":"2023-09-30T17:05:04.615546+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:05:04.607716+0000","last_became_peered":"2023-09-30T17:05:04.607716+0000","last_unstale":"2023-09-30T17:05:04.615546+0000","last_undegraded":"2023-09-30T17:05:04.615546+0000","last_fullsized":"2023-09-30T17:05:04.294454+0000","mapping_epoch":67,"log_start":"42'1100","ondisk_log_start":"42'1100","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4577,"log_dups_size":1100,"ondisk_log_size":4577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:59:52.758548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16579,"num_write_kb":79104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":57,"reported_epoch":63,"state":"active+undersized+degraded","last_fresh":"2023-09-30T17:04:50.414436+0000","last_change":"2023-09-30T17:02:48.272452+0000","last_active":"2023-09-30T17:04:50.414436+0000","last_peered":"2023-09-30T17:04:50.414436+0000","last_clean":"2023-09-30T17:02:18.357478+0000","last_became_active":"2023-09-30T17:02:48.272452+0000","last_became_peered":"2023-09-30T17:02:48.272452+0000","last_unstale":"2023-09-30T17:04:50.414436+0000","last_undegraded":"2023-09-30T17:02:48.267146+0000","last_fullsized":"2023-09-30T17:02:48.267019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:34:06.341666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":2}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"59'2836","reported_seq":2897,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.295173+0000","last_change":"2023-09-30T17:02:18.360019+0000","last_active":"2023-09-30T17:05:03.295173+0000","last_peered":"2023-09-30T17:05:03.295173+0000","last_clean":"2023-09-30T17:05:03.295173+0000","last_became_active":"2023-09-30T17:02:18.358364+0000","last_became_peered":"2023-09-30T17:02:18.358364+0000","last_unstale":"2023-09-30T17:05:03.295173+0000","last_undegraded":"2023-09-30T17:05:03.295173+0000","last_fullsized":"2023-09-30T17:05:03.295173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2836,"log_dups_size":0,"ondisk_log_size":2836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:30:43.782165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8308,"num_write_kb":39456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":73,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.309897+0000","last_change":"2023-09-30T17:05:03.308853+0000","last_active":"2023-09-30T17:05:03.309897+0000","last_peered":"2023-09-30T17:05:03.309897+0000","last_clean":"2023-09-30T17:05:03.309897+0000","last_became_active":"2023-09-30T17:05:03.308377+0000","last_became_peered":"2023-09-30T17:05:03.308377+0000","last_unstale":"2023-09-30T17:05:03.309897+0000","last_undegraded":"2023-09-30T17:05:03.309897+0000","last_fullsized":"2023-09-30T17:05:03.309897+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:18:42.448826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"59'2856","reported_seq":2917,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.297788+0000","last_change":"2023-09-30T17:02:18.362415+0000","last_active":"2023-09-30T17:05:03.297788+0000","last_peered":"2023-09-30T17:05:03.297788+0000","last_clean":"2023-09-30T17:05:03.297788+0000","last_became_active":"2023-09-30T17:02:18.361556+0000","last_became_peered":"2023-09-30T17:02:18.361556+0000","last_unstale":"2023-09-30T17:05:03.297788+0000","last_undegraded":"2023-09-30T17:05:03.297788+0000","last_fullsized":"2023-09-30T17:05:03.297788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2856,"log_dups_size":0,"ondisk_log_size":2856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:16:41.607547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8321,"num_write_kb":39600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":73,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.305301+0000","last_change":"2023-09-30T17:05:03.304220+0000","last_active":"2023-09-30T17:05:03.305301+0000","last_peered":"2023-09-30T17:05:03.305301+0000","last_clean":"2023-09-30T17:05:03.305301+0000","last_became_active":"2023-09-30T17:05:03.303598+0000","last_became_peered":"2023-09-30T17:05:03.303598+0000","last_unstale":"2023-09-30T17:05:03.305301+0000","last_undegraded":"2023-09-30T17:05:03.305301+0000","last_fullsized":"2023-09-30T17:05:03.305301+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:57:44.444041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"59'12","reported_seq":84,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.314205+0000","last_change":"2023-09-30T17:05:03.313214+0000","last_active":"2023-09-30T17:05:03.314205+0000","last_peered":"2023-09-30T17:05:03.314205+0000","last_clean":"2023-09-30T17:05:03.314205+0000","last_became_active":"2023-09-30T17:05:03.312888+0000","last_became_peered":"2023-09-30T17:05:03.312888+0000","last_unstale":"2023-09-30T17:05:03.314205+0000","last_undegraded":"2023-09-30T17:05:03.314205+0000","last_fullsized":"2023-09-30T17:05:03.314205+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:40:09.276369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"59'9","reported_seq":61,"reported_epoch":63,"state":"active+undersized+degraded","last_fresh":"2023-09-30T17:04:50.417004+0000","last_change":"2023-09-30T17:02:48.271494+0000","last_active":"2023-09-30T17:04:50.417004+0000","last_peered":"2023-09-30T17:04:50.417004+0000","last_clean":"2023-09-30T17:02:18.376118+0000","last_became_active":"2023-09-30T17:02:48.271494+0000","last_became_peered":"2023-09-30T17:02:48.271494+0000","last_unstale":"2023-09-30T17:04:50.417004+0000","last_undegraded":"2023-09-30T17:02:48.266896+0000","last_fullsized":"2023-09-30T17:02:48.266780+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:15:06.636572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":4}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"59'2892","reported_seq":2966,"reported_epoch":68,"state":"active+undersized+remapped","last_fresh":"2023-09-30T17:05:04.650226+0000","last_change":"2023-09-30T17:05:04.650394+0000","last_active":"2023-09-30T17:05:04.650226+0000","last_peered":"2023-09-30T17:05:04.650226+0000","last_clean":"2023-09-30T17:02:44.409540+0000","last_became_active":"2023-09-30T17:05:04.626857+0000","last_became_peered":"2023-09-30T17:05:04.626857+0000","last_unstale":"2023-09-30T17:05:04.650226+0000","last_undegraded":"2023-09-30T17:05:04.650226+0000","last_fullsized":"2023-09-30T17:05:04.295690+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2892,"log_dups_size":0,"ondisk_log_size":2892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:22:14.097479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8345,"num_write_kb":39712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":57,"reported_epoch":63,"state":"active+undersized+degraded","last_fresh":"2023-09-30T17:04:50.416937+0000","last_change":"2023-09-30T17:02:48.272397+0000","last_active":"2023-09-30T17:04:50.416937+0000","last_peered":"2023-09-30T17:04:50.416937+0000","last_clean":"2023-09-30T17:02:18.357313+0000","last_became_active":"2023-09-30T17:02:48.272397+0000","last_became_peered":"2023-09-30T17:02:48.272397+0000","last_unstale":"2023-09-30T17:04:50.416937+0000","last_undegraded":"2023-09-30T17:02:48.268170+0000","last_fullsized":"2023-09-30T17:02:48.268067+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:57:01.669630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"59'2861","reported_seq":2927,"reported_epoch":68,"state":"activating+undersized+remapped","last_fresh":"2023-09-30T17:05:04.294000+0000","last_change":"2023-09-30T17:05:04.347702+0000","last_active":"2023-09-30T17:05:02.288537+0000","last_peered":"2023-09-30T17:05:01.285312+0000","last_clean":"2023-09-30T17:02:44.409530+0000","last_became_active":"2023-09-30T17:02:48.271207+0000","last_became_peered":"2023-09-30T17:02:48.271207+0000","last_unstale":"2023-09-30T17:05:04.294000+0000","last_undegraded":"2023-09-30T17:05:04.294000+0000","last_fullsized":"2023-09-30T17:05:04.294000+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2861,"log_dups_size":0,"ondisk_log_size":2861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:09:57.818937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8384,"num_write_kb":39788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":75,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.305282+0000","last_change":"2023-09-30T17:05:03.304232+0000","last_active":"2023-09-30T17:05:03.305282+0000","last_peered":"2023-09-30T17:05:03.305282+0000","last_clean":"2023-09-30T17:05:03.305282+0000","last_became_active":"2023-09-30T17:05:03.303874+0000","last_became_peered":"2023-09-30T17:05:03.303874+0000","last_unstale":"2023-09-30T17:05:03.305282+0000","last_undegraded":"2023-09-30T17:05:03.305282+0000","last_fullsized":"2023-09-30T17:05:03.305282+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:39:49.644290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"59'2","reported_seq":63,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.295036+0000","last_change":"2023-09-30T17:02:18.359767+0000","last_active":"2023-09-30T17:05:03.295036+0000","last_peered":"2023-09-30T17:05:03.295036+0000","last_clean":"2023-09-30T17:05:03.295036+0000","last_became_active":"2023-09-30T17:02:18.356825+0000","last_became_peered":"2023-09-30T17:02:18.356825+0000","last_unstale":"2023-09-30T17:05:03.295036+0000","last_undegraded":"2023-09-30T17:05:03.295036+0000","last_fullsized":"2023-09-30T17:05:03.295036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:39:16.689300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":57,"reported_epoch":63,"state":"active+undersized+degraded","last_fresh":"2023-09-30T17:04:50.416968+0000","last_change":"2023-09-30T17:02:48.271475+0000","last_active":"2023-09-30T17:04:50.416968+0000","last_peered":"2023-09-30T17:04:50.416968+0000","last_clean":"2023-09-30T17:02:18.356780+0000","last_became_active":"2023-09-30T17:02:48.271475+0000","last_became_peered":"2023-09-30T17:02:48.271475+0000","last_unstale":"2023-09-30T17:04:50.416968+0000","last_undegraded":"2023-09-30T17:02:48.267564+0000","last_fullsized":"2023-09-30T17:02:48.267019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:31:33.824606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"59'2835","reported_seq":2888,"reported_epoch":68,"state":"activating+undersized+remapped","last_fresh":"2023-09-30T17:05:04.294059+0000","last_change":"2023-09-30T17:05:04.336684+0000","last_active":"2023-09-30T17:05:03.293126+0000","last_peered":"2023-09-30T17:05:01.285691+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:02:48.269547+0000","last_became_peered":"2023-09-30T17:02:48.269547+0000","last_unstale":"2023-09-30T17:05:04.294059+0000","last_undegraded":"2023-09-30T17:05:04.294059+0000","last_fullsized":"2023-09-30T17:05:04.294059+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2835,"log_dups_size":0,"ondisk_log_size":2835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:04:34.010415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8288,"num_write_kb":39388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":48,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.414318+0000","last_change":"2023-09-30T17:02:48.272328+0000","last_active":"2023-09-30T17:04:50.414318+0000","last_peered":"2023-09-30T17:04:50.414318+0000","last_clean":"2023-09-30T17:02:16.333605+0000","last_became_active":"2023-09-30T17:02:48.272328+0000","last_became_peered":"2023-09-30T17:02:48.272328+0000","last_unstale":"2023-09-30T17:04:50.414318+0000","last_undegraded":"2023-09-30T17:04:50.414318+0000","last_fullsized":"2023-09-30T17:02:48.267308+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:31:33.824606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"59'8","reported_seq":80,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.310264+0000","last_change":"2023-09-30T17:05:03.308917+0000","last_active":"2023-09-30T17:05:03.310264+0000","last_peered":"2023-09-30T17:05:03.310264+0000","last_clean":"2023-09-30T17:05:03.310264+0000","last_became_active":"2023-09-30T17:05:03.308214+0000","last_became_peered":"2023-09-30T17:05:03.308214+0000","last_unstale":"2023-09-30T17:05:03.310264+0000","last_undegraded":"2023-09-30T17:05:03.310264+0000","last_fullsized":"2023-09-30T17:05:03.310264+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:39:50.649920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"58'3","reported_seq":77,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.309904+0000","last_change":"2023-09-30T17:05:03.308944+0000","last_active":"2023-09-30T17:05:03.309904+0000","last_peered":"2023-09-30T17:05:03.309904+0000","last_clean":"2023-09-30T17:05:03.309904+0000","last_became_active":"2023-09-30T17:05:03.308483+0000","last_became_peered":"2023-09-30T17:05:03.308483+0000","last_unstale":"2023-09-30T17:05:03.309904+0000","last_undegraded":"2023-09-30T17:05:03.309904+0000","last_fullsized":"2023-09-30T17:05:03.309904+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:43:27.633747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"59'2846","reported_seq":2899,"reported_epoch":68,"state":"activating+undersized+degraded+remapped","last_fresh":"2023-09-30T17:05:04.338167+0000","last_change":"2023-09-30T17:05:04.653637+0000","last_active":"2023-09-30T17:05:03.294302+0000","last_peered":"2023-09-30T17:05:01.286239+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:02:48.271402+0000","last_became_peered":"2023-09-30T17:02:48.271402+0000","last_unstale":"2023-09-30T17:05:04.338167+0000","last_undegraded":"2023-09-30T17:05:04.338167+0000","last_fullsized":"2023-09-30T17:05:04.295147+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2846,"log_dups_size":0,"ondisk_log_size":2846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:10:21.239311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8199,"num_write_kb":39160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":49,"reported_epoch":64,"state":"active+undersized","last_fresh":"2023-09-30T17:04:51.418689+0000","last_change":"2023-09-30T17:02:48.271186+0000","last_active":"2023-09-30T17:04:51.418689+0000","last_peered":"2023-09-30T17:04:51.418689+0000","last_clean":"2023-09-30T17:02:16.333605+0000","last_became_active":"2023-09-30T17:02:48.271186+0000","last_became_peered":"2023-09-30T17:02:48.271186+0000","last_unstale":"2023-09-30T17:04:51.418689+0000","last_undegraded":"2023-09-30T17:04:51.418689+0000","last_fullsized":"2023-09-30T17:02:48.266545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:02:10.359842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"59'2831","reported_seq":2888,"reported_epoch":68,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2023-09-30T17:05:04.667313+0000","last_change":"2023-09-30T17:05:04.667313+0000","last_active":"2023-09-30T17:05:04.667313+0000","last_peered":"2023-09-30T17:05:04.667313+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:05:04.666016+0000","last_became_peered":"2023-09-30T17:05:04.666016+0000","last_unstale":"2023-09-30T17:05:04.667313+0000","last_undegraded":"2023-09-30T17:05:04.347594+0000","last_fullsized":"2023-09-30T17:05:04.295721+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2831,"log_dups_size":0,"ondisk_log_size":2831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:07:23.682970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8336,"num_write_kb":39484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":73,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.305277+0000","last_change":"2023-09-30T17:05:03.304019+0000","last_active":"2023-09-30T17:05:03.305277+0000","last_peered":"2023-09-30T17:05:03.305277+0000","last_clean":"2023-09-30T17:05:03.305277+0000","last_became_active":"2023-09-30T17:05:03.303473+0000","last_became_peered":"2023-09-30T17:05:03.303473+0000","last_unstale":"2023-09-30T17:05:03.305277+0000","last_undegraded":"2023-09-30T17:05:03.305277+0000","last_fullsized":"2023-09-30T17:05:03.305277+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:10:16.238053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"59'2884","reported_seq":2945,"reported_epoch":68,"state":"active+undersized+remapped","last_fresh":"2023-09-30T17:05:04.691450+0000","last_change":"2023-09-30T17:05:04.691450+0000","last_active":"2023-09-30T17:05:04.691450+0000","last_peered":"2023-09-30T17:05:04.691450+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:05:04.623077+0000","last_became_peered":"2023-09-30T17:05:04.623077+0000","last_unstale":"2023-09-30T17:05:04.691450+0000","last_undegraded":"2023-09-30T17:05:04.691450+0000","last_fullsized":"2023-09-30T17:05:04.295406+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2884,"log_dups_size":0,"ondisk_log_size":2884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:48:53.970711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8366,"num_write_kb":39744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":62,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.293603+0000","last_change":"2023-09-30T17:02:17.358811+0000","last_active":"2023-09-30T17:05:03.293603+0000","last_peered":"2023-09-30T17:05:03.293603+0000","last_clean":"2023-09-30T17:05:03.293603+0000","last_became_active":"2023-09-30T17:02:17.358582+0000","last_became_peered":"2023-09-30T17:02:17.358582+0000","last_unstale":"2023-09-30T17:05:03.293603+0000","last_undegraded":"2023-09-30T17:05:03.293603+0000","last_fullsized":"2023-09-30T17:05:03.293603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:52:37.518693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"59'8580","reported_seq":8641,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.294204+0000","last_change":"2023-09-30T17:02:18.364478+0000","last_active":"2023-09-30T17:05:03.294204+0000","last_peered":"2023-09-30T17:05:03.294204+0000","last_clean":"2023-09-30T17:05:03.294204+0000","last_became_active":"2023-09-30T17:02:18.364057+0000","last_became_peered":"2023-09-30T17:02:18.364057+0000","last_unstale":"2023-09-30T17:05:03.294204+0000","last_undegraded":"2023-09-30T17:05:03.294204+0000","last_fullsized":"2023-09-30T17:05:03.294204+0000","mapping_epoch":17,"log_start":"49'4400","ondisk_log_start":"49'4400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4180,"log_dups_size":4400,"ondisk_log_size":4180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:13:55.555700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25046,"num_write_kb":118972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":65,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.294666+0000","last_change":"2023-09-30T17:02:12.327704+0000","last_active":"2023-09-30T17:05:03.294666+0000","last_peered":"2023-09-30T17:05:03.294666+0000","last_clean":"2023-09-30T17:05:03.294666+0000","last_became_active":"2023-09-30T17:02:12.327384+0000","last_became_peered":"2023-09-30T17:02:12.327384+0000","last_unstale":"2023-09-30T17:05:03.294666+0000","last_undegraded":"2023-09-30T17:05:03.294666+0000","last_fullsized":"2023-09-30T17:05:03.294666+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:09:34.818252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":49,"reported_epoch":64,"state":"active+undersized","last_fresh":"2023-09-30T17:04:51.419577+0000","last_change":"2023-09-30T17:02:48.271959+0000","last_active":"2023-09-30T17:04:51.419577+0000","last_peered":"2023-09-30T17:04:51.419577+0000","last_clean":"2023-09-30T17:02:16.333605+0000","last_became_active":"2023-09-30T17:02:48.271959+0000","last_became_peered":"2023-09-30T17:02:48.271959+0000","last_unstale":"2023-09-30T17:04:51.419577+0000","last_undegraded":"2023-09-30T17:04:51.419577+0000","last_fullsized":"2023-09-30T17:02:48.267164+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:03:49.752214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"59'9","reported_seq":81,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.307847+0000","last_change":"2023-09-30T17:05:03.306223+0000","last_active":"2023-09-30T17:05:03.307847+0000","last_peered":"2023-09-30T17:05:03.307847+0000","last_clean":"2023-09-30T17:05:03.307847+0000","last_became_active":"2023-09-30T17:05:03.305956+0000","last_became_peered":"2023-09-30T17:05:03.305956+0000","last_unstale":"2023-09-30T17:05:03.307847+0000","last_undegraded":"2023-09-30T17:05:03.307847+0000","last_fullsized":"2023-09-30T17:05:03.307847+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:32:56.502917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":49,"reported_epoch":64,"state":"active+undersized","last_fresh":"2023-09-30T17:04:51.418361+0000","last_change":"2023-09-30T17:02:48.271029+0000","last_active":"2023-09-30T17:04:51.418361+0000","last_peered":"2023-09-30T17:04:51.418361+0000","last_clean":"2023-09-30T17:02:11.318349+0000","last_became_active":"2023-09-30T17:02:48.271029+0000","last_became_peered":"2023-09-30T17:02:48.271029+0000","last_unstale":"2023-09-30T17:04:51.418361+0000","last_undegraded":"2023-09-30T17:04:51.418361+0000","last_fullsized":"2023-09-30T17:02:48.266223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:47:55.166958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":49,"reported_epoch":64,"state":"active+undersized","last_fresh":"2023-09-30T17:04:51.419120+0000","last_change":"2023-09-30T17:02:48.272102+0000","last_active":"2023-09-30T17:04:51.419120+0000","last_peered":"2023-09-30T17:04:51.419120+0000","last_clean":"2023-09-30T17:02:16.333605+0000","last_became_active":"2023-09-30T17:02:48.272102+0000","last_became_peered":"2023-09-30T17:02:48.272102+0000","last_unstale":"2023-09-30T17:04:51.419120+0000","last_undegraded":"2023-09-30T17:04:51.419120+0000","last_fullsized":"2023-09-30T17:02:48.266571+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:31:04.525444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"59'9","reported_seq":70,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.294333+0000","last_change":"2023-09-30T17:02:18.363399+0000","last_active":"2023-09-30T17:05:03.294333+0000","last_peered":"2023-09-30T17:05:03.294333+0000","last_clean":"2023-09-30T17:05:03.294333+0000","last_became_active":"2023-09-30T17:02:18.363064+0000","last_became_peered":"2023-09-30T17:02:18.363064+0000","last_unstale":"2023-09-30T17:05:03.294333+0000","last_undegraded":"2023-09-30T17:05:03.294333+0000","last_fullsized":"2023-09-30T17:05:03.294333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:32:34.654264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":65,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.293056+0000","last_change":"2023-09-30T17:02:12.327834+0000","last_active":"2023-09-30T17:05:03.293056+0000","last_peered":"2023-09-30T17:05:03.293056+0000","last_clean":"2023-09-30T17:05:03.293056+0000","last_became_active":"2023-09-30T17:02:12.327542+0000","last_became_peered":"2023-09-30T17:02:12.327542+0000","last_unstale":"2023-09-30T17:05:03.293056+0000","last_undegraded":"2023-09-30T17:05:03.293056+0000","last_fullsized":"2023-09-30T17:05:03.293056+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:49:54.890769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":73,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.307435+0000","last_change":"2023-09-30T17:05:03.305668+0000","last_active":"2023-09-30T17:05:03.307435+0000","last_peered":"2023-09-30T17:05:03.307435+0000","last_clean":"2023-09-30T17:05:03.307435+0000","last_became_active":"2023-09-30T17:05:03.305222+0000","last_became_peered":"2023-09-30T17:05:03.305222+0000","last_unstale":"2023-09-30T17:05:03.307435+0000","last_undegraded":"2023-09-30T17:05:03.307435+0000","last_fullsized":"2023-09-30T17:05:03.307435+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:17:12.662422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"59'6","reported_seq":67,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.295500+0000","last_change":"2023-09-30T17:02:18.364406+0000","last_active":"2023-09-30T17:05:03.295500+0000","last_peered":"2023-09-30T17:05:03.295500+0000","last_clean":"2023-09-30T17:05:03.295500+0000","last_became_active":"2023-09-30T17:02:18.363849+0000","last_became_peered":"2023-09-30T17:02:18.363849+0000","last_unstale":"2023-09-30T17:05:03.295500+0000","last_undegraded":"2023-09-30T17:05:03.295500+0000","last_fullsized":"2023-09-30T17:05:03.295500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:43:29.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":49,"reported_epoch":64,"state":"active+undersized","last_fresh":"2023-09-30T17:04:51.418716+0000","last_change":"2023-09-30T17:02:48.270259+0000","last_active":"2023-09-30T17:04:51.418716+0000","last_peered":"2023-09-30T17:04:51.418716+0000","last_clean":"2023-09-30T17:02:11.318349+0000","last_became_active":"2023-09-30T17:02:48.270259+0000","last_became_peered":"2023-09-30T17:02:48.270259+0000","last_unstale":"2023-09-30T17:04:51.418716+0000","last_undegraded":"2023-09-30T17:04:51.418716+0000","last_fullsized":"2023-09-30T17:02:48.266144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:36:16.950492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":251,"reported_epoch":63,"state":"active+undersized+degraded","last_fresh":"2023-09-30T17:04:50.415221+0000","last_change":"2023-09-30T17:02:48.269439+0000","last_active":"2023-09-30T17:04:50.415221+0000","last_peered":"2023-09-30T17:04:50.415221+0000","last_clean":"2023-09-30T17:02:08.215860+0000","last_became_active":"2023-09-30T17:02:48.269439+0000","last_became_peered":"2023-09-30T17:02:48.269439+0000","last_unstale":"2023-09-30T17:04:50.415221+0000","last_undegraded":"2023-09-30T17:02:48.265518+0000","last_fullsized":"2023-09-30T17:02:48.265371+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:06.295501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:06.295501+0000","last_clean_scrub_stamp":"2023-09-30T17:02:06.295501+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:17:39.733716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":62,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.293005+0000","last_change":"2023-09-30T17:02:17.357139+0000","last_active":"2023-09-30T17:05:03.293005+0000","last_peered":"2023-09-30T17:05:03.293005+0000","last_clean":"2023-09-30T17:05:03.293005+0000","last_became_active":"2023-09-30T17:02:17.356901+0000","last_became_peered":"2023-09-30T17:02:17.356901+0000","last_unstale":"2023-09-30T17:05:03.293005+0000","last_undegraded":"2023-09-30T17:05:03.293005+0000","last_fullsized":"2023-09-30T17:05:03.293005+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:22:35.747671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"59'7","reported_seq":56,"reported_epoch":64,"state":"active+undersized","last_fresh":"2023-09-30T17:04:51.419074+0000","last_change":"2023-09-30T17:02:48.271072+0000","last_active":"2023-09-30T17:04:51.419074+0000","last_peered":"2023-09-30T17:04:51.419074+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:02:48.271072+0000","last_became_peered":"2023-09-30T17:02:48.271072+0000","last_unstale":"2023-09-30T17:04:51.419074+0000","last_undegraded":"2023-09-30T17:04:51.419074+0000","last_fullsized":"2023-09-30T17:02:48.266356+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:02:11.365472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.415870+0000","last_change":"2023-09-30T17:02:48.271468+0000","last_active":"2023-09-30T17:04:50.415870+0000","last_peered":"2023-09-30T17:04:50.415870+0000","last_clean":"2023-09-30T17:02:11.318349+0000","last_became_active":"2023-09-30T17:02:48.271468+0000","last_became_peered":"2023-09-30T17:02:48.271468+0000","last_unstale":"2023-09-30T17:04:50.415870+0000","last_undegraded":"2023-09-30T17:04:50.415870+0000","last_fullsized":"2023-09-30T17:02:48.266735+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:30:59.510188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"59'5","reported_seq":86,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.318953+0000","last_change":"2023-09-30T17:05:03.318439+0000","last_active":"2023-09-30T17:05:03.318953+0000","last_peered":"2023-09-30T17:05:03.318953+0000","last_clean":"2023-09-30T17:05:03.318953+0000","last_became_active":"2023-09-30T17:05:03.308059+0000","last_became_peered":"2023-09-30T17:05:03.308059+0000","last_unstale":"2023-09-30T17:05:03.318953+0000","last_undegraded":"2023-09-30T17:05:03.318953+0000","last_fullsized":"2023-09-30T17:05:03.318953+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:16:25.170638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"59'11252","reported_seq":11313,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.296974+0000","last_change":"2023-09-30T17:02:18.360029+0000","last_active":"2023-09-30T17:05:03.296974+0000","last_peered":"2023-09-30T17:05:03.296974+0000","last_clean":"2023-09-30T17:05:03.296974+0000","last_became_active":"2023-09-30T17:02:18.356839+0000","last_became_peered":"2023-09-30T17:02:18.356839+0000","last_unstale":"2023-09-30T17:05:03.296974+0000","last_undegraded":"2023-09-30T17:05:03.296974+0000","last_fullsized":"2023-09-30T17:05:03.296974+0000","mapping_epoch":17,"log_start":"51'6700","ondisk_log_start":"51'6700","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4552,"log_dups_size":6700,"ondisk_log_size":4552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:16:27.516884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33068,"num_write_kb":157144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":65,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.297064+0000","last_change":"2023-09-30T17:02:12.330472+0000","last_active":"2023-09-30T17:05:03.297064+0000","last_peered":"2023-09-30T17:05:03.297064+0000","last_clean":"2023-09-30T17:05:03.297064+0000","last_became_active":"2023-09-30T17:02:12.330154+0000","last_became_peered":"2023-09-30T17:02:12.330154+0000","last_unstale":"2023-09-30T17:05:03.297064+0000","last_undegraded":"2023-09-30T17:05:03.297064+0000","last_fullsized":"2023-09-30T17:05:03.297064+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:43:23.161734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":62,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.304831+0000","last_change":"2023-09-30T17:02:17.361007+0000","last_active":"2023-09-30T17:05:03.304831+0000","last_peered":"2023-09-30T17:05:03.304831+0000","last_clean":"2023-09-30T17:05:03.304831+0000","last_became_active":"2023-09-30T17:02:17.360721+0000","last_became_peered":"2023-09-30T17:02:17.360721+0000","last_unstale":"2023-09-30T17:05:03.304831+0000","last_undegraded":"2023-09-30T17:05:03.304831+0000","last_fullsized":"2023-09-30T17:05:03.304831+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:13:41.205152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"59'2836","reported_seq":2910,"reported_epoch":68,"state":"active+undersized+remapped","last_fresh":"2023-09-30T17:05:04.642669+0000","last_change":"2023-09-30T17:05:04.642880+0000","last_active":"2023-09-30T17:05:04.642669+0000","last_peered":"2023-09-30T17:05:04.642669+0000","last_clean":"2023-09-30T17:02:44.410053+0000","last_became_active":"2023-09-30T17:05:04.617448+0000","last_became_peered":"2023-09-30T17:05:04.617448+0000","last_unstale":"2023-09-30T17:05:04.642669+0000","last_undegraded":"2023-09-30T17:05:04.642669+0000","last_fullsized":"2023-09-30T17:05:04.295696+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2836,"log_dups_size":0,"ondisk_log_size":2836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:53:07.255711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8199,"num_write_kb":39048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"59'3","reported_seq":65,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.294146+0000","last_change":"2023-09-30T17:02:17.360831+0000","last_active":"2023-09-30T17:05:03.294146+0000","last_peered":"2023-09-30T17:05:03.294146+0000","last_clean":"2023-09-30T17:05:03.294146+0000","last_became_active":"2023-09-30T17:02:17.360494+0000","last_became_peered":"2023-09-30T17:02:17.360494+0000","last_unstale":"2023-09-30T17:05:03.294146+0000","last_undegraded":"2023-09-30T17:05:03.294146+0000","last_fullsized":"2023-09-30T17:05:03.294146+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:24:04.564387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":65,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.298199+0000","last_change":"2023-09-30T17:02:12.328184+0000","last_active":"2023-09-30T17:05:03.298199+0000","last_peered":"2023-09-30T17:05:03.298199+0000","last_clean":"2023-09-30T17:05:03.298199+0000","last_became_active":"2023-09-30T17:02:12.327898+0000","last_became_peered":"2023-09-30T17:02:12.327898+0000","last_unstale":"2023-09-30T17:05:03.298199+0000","last_undegraded":"2023-09-30T17:05:03.298199+0000","last_fullsized":"2023-09-30T17:05:03.298199+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:43:23.161734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"59'8","reported_seq":80,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.309894+0000","last_change":"2023-09-30T17:05:03.308856+0000","last_active":"2023-09-30T17:05:03.309894+0000","last_peered":"2023-09-30T17:05:03.309894+0000","last_clean":"2023-09-30T17:05:03.309894+0000","last_became_active":"2023-09-30T17:05:03.308429+0000","last_became_peered":"2023-09-30T17:05:03.308429+0000","last_unstale":"2023-09-30T17:05:03.309894+0000","last_undegraded":"2023-09-30T17:05:03.309894+0000","last_fullsized":"2023-09-30T17:05:03.309894+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:49:32.189339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":64,"state":"active+undersized","last_fresh":"2023-09-30T17:04:51.419617+0000","last_change":"2023-09-30T17:02:48.269646+0000","last_active":"2023-09-30T17:04:51.419617+0000","last_peered":"2023-09-30T17:04:51.419617+0000","last_clean":"2023-09-30T17:02:11.318349+0000","last_became_active":"2023-09-30T17:02:48.269646+0000","last_became_peered":"2023-09-30T17:02:48.269646+0000","last_unstale":"2023-09-30T17:04:51.419617+0000","last_undegraded":"2023-09-30T17:04:51.419617+0000","last_fullsized":"2023-09-30T17:02:48.267898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:41:23.216160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"60'8","reported_seq":86,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.315262+0000","last_change":"2023-09-30T17:05:03.314806+0000","last_active":"2023-09-30T17:05:03.315262+0000","last_peered":"2023-09-30T17:05:03.315262+0000","last_clean":"2023-09-30T17:05:03.315262+0000","last_became_active":"2023-09-30T17:05:03.308201+0000","last_became_peered":"2023-09-30T17:05:03.308201+0000","last_unstale":"2023-09-30T17:05:03.315262+0000","last_undegraded":"2023-09-30T17:05:03.315262+0000","last_fullsized":"2023-09-30T17:05:03.315262+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:19:18.486570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"59'6","reported_seq":78,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.305327+0000","last_change":"2023-09-30T17:05:03.304265+0000","last_active":"2023-09-30T17:05:03.305327+0000","last_peered":"2023-09-30T17:05:03.305327+0000","last_clean":"2023-09-30T17:05:03.305327+0000","last_became_active":"2023-09-30T17:05:03.304022+0000","last_became_peered":"2023-09-30T17:05:03.304022+0000","last_unstale":"2023-09-30T17:05:03.305327+0000","last_undegraded":"2023-09-30T17:05:03.305327+0000","last_fullsized":"2023-09-30T17:05:03.305327+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:19:19.492200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":74,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.305185+0000","last_change":"2023-09-30T17:05:03.303927+0000","last_active":"2023-09-30T17:05:03.305185+0000","last_peered":"2023-09-30T17:05:03.305185+0000","last_clean":"2023-09-30T17:05:03.305185+0000","last_became_active":"2023-09-30T17:05:03.303487+0000","last_became_peered":"2023-09-30T17:05:03.303487+0000","last_unstale":"2023-09-30T17:05:03.305185+0000","last_undegraded":"2023-09-30T17:05:03.305185+0000","last_fullsized":"2023-09-30T17:05:03.305185+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:43:27.633747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"59'2835","reported_seq":2896,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.295442+0000","last_change":"2023-09-30T17:02:18.358269+0000","last_active":"2023-09-30T17:05:03.295442+0000","last_peered":"2023-09-30T17:05:03.295442+0000","last_clean":"2023-09-30T17:05:03.295442+0000","last_became_active":"2023-09-30T17:02:18.356902+0000","last_became_peered":"2023-09-30T17:02:18.356902+0000","last_unstale":"2023-09-30T17:05:03.295442+0000","last_undegraded":"2023-09-30T17:05:03.295442+0000","last_fullsized":"2023-09-30T17:05:03.295442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2835,"log_dups_size":0,"ondisk_log_size":2835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:39:28.022201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8302,"num_write_kb":39500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":57,"reported_epoch":63,"state":"active+undersized+degraded","last_fresh":"2023-09-30T17:04:50.414624+0000","last_change":"2023-09-30T17:02:48.273247+0000","last_active":"2023-09-30T17:04:50.414624+0000","last_peered":"2023-09-30T17:04:50.414624+0000","last_clean":"2023-09-30T17:02:18.355305+0000","last_became_active":"2023-09-30T17:02:48.273247+0000","last_became_peered":"2023-09-30T17:02:48.273247+0000","last_unstale":"2023-09-30T17:04:50.414624+0000","last_undegraded":"2023-09-30T17:02:48.268795+0000","last_fullsized":"2023-09-30T17:02:48.268551+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:41:28.231415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"59'2848","reported_seq":2908,"reported_epoch":68,"state":"active+undersized+remapped","last_fresh":"2023-09-30T17:05:04.634410+0000","last_change":"2023-09-30T17:05:04.634599+0000","last_active":"2023-09-30T17:05:04.634410+0000","last_peered":"2023-09-30T17:05:04.634410+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:05:04.607359+0000","last_became_peered":"2023-09-30T17:05:04.607359+0000","last_unstale":"2023-09-30T17:05:04.634410+0000","last_undegraded":"2023-09-30T17:05:04.634410+0000","last_fullsized":"2023-09-30T17:05:04.294683+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2848,"log_dups_size":0,"ondisk_log_size":2848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:11:57.906373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8235,"num_write_kb":39276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"58'3","reported_seq":77,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.309314+0000","last_change":"2023-09-30T17:05:03.307212+0000","last_active":"2023-09-30T17:05:03.309314+0000","last_peered":"2023-09-30T17:05:03.309314+0000","last_clean":"2023-09-30T17:05:03.309314+0000","last_became_active":"2023-09-30T17:05:03.306711+0000","last_became_peered":"2023-09-30T17:05:03.306711+0000","last_unstale":"2023-09-30T17:05:03.309314+0000","last_undegraded":"2023-09-30T17:05:03.309314+0000","last_fullsized":"2023-09-30T17:05:03.309314+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:11:56.900744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"59'10","reported_seq":58,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.413310+0000","last_change":"2023-09-30T17:02:48.268506+0000","last_active":"2023-09-30T17:04:50.413310+0000","last_peered":"2023-09-30T17:04:50.413310+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:02:48.268506+0000","last_became_peered":"2023-09-30T17:02:48.268506+0000","last_unstale":"2023-09-30T17:04:50.413310+0000","last_undegraded":"2023-09-30T17:04:50.413310+0000","last_fullsized":"2023-09-30T17:02:48.265674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:54:50.127494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":63,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.298122+0000","last_change":"2023-09-30T17:02:17.360802+0000","last_active":"2023-09-30T17:05:03.298122+0000","last_peered":"2023-09-30T17:05:03.298122+0000","last_clean":"2023-09-30T17:05:03.298122+0000","last_became_active":"2023-09-30T17:02:17.360475+0000","last_became_peered":"2023-09-30T17:02:17.360475+0000","last_unstale":"2023-09-30T17:05:03.298122+0000","last_undegraded":"2023-09-30T17:05:03.298122+0000","last_fullsized":"2023-09-30T17:05:03.298122+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:50:18.455188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"59'5711","reported_seq":5772,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.295234+0000","last_change":"2023-09-30T17:02:18.359857+0000","last_active":"2023-09-30T17:05:03.295234+0000","last_peered":"2023-09-30T17:05:03.295234+0000","last_clean":"2023-09-30T17:05:03.295234+0000","last_became_active":"2023-09-30T17:02:18.357098+0000","last_became_peered":"2023-09-30T17:02:18.357098+0000","last_unstale":"2023-09-30T17:05:03.295234+0000","last_undegraded":"2023-09-30T17:05:03.295234+0000","last_fullsized":"2023-09-30T17:05:03.295234+0000","mapping_epoch":17,"log_start":"42'1200","ondisk_log_start":"42'1200","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4511,"log_dups_size":1200,"ondisk_log_size":4511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:48:17.598726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16681,"num_write_kb":79476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":77,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.314213+0000","last_change":"2023-09-30T17:05:03.313345+0000","last_active":"2023-09-30T17:05:03.314213+0000","last_peered":"2023-09-30T17:05:03.314213+0000","last_clean":"2023-09-30T17:05:03.314213+0000","last_became_active":"2023-09-30T17:05:03.313050+0000","last_became_peered":"2023-09-30T17:05:03.313050+0000","last_unstale":"2023-09-30T17:05:03.314213+0000","last_undegraded":"2023-09-30T17:05:03.314213+0000","last_fullsized":"2023-09-30T17:05:03.314213+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:24:52.247523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"59'2872","reported_seq":2924,"reported_epoch":68,"state":"activating+undersized+remapped","last_fresh":"2023-09-30T17:05:04.335721+0000","last_change":"2023-09-30T17:05:04.363319+0000","last_active":"2023-09-30T17:05:03.294498+0000","last_peered":"2023-09-30T17:05:01.285897+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:02:48.270232+0000","last_became_peered":"2023-09-30T17:02:48.270232+0000","last_unstale":"2023-09-30T17:05:04.335721+0000","last_undegraded":"2023-09-30T17:05:04.335721+0000","last_fullsized":"2023-09-30T17:05:04.335721+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2872,"log_dups_size":0,"ondisk_log_size":2872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:53:07.255711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8447,"num_write_kb":40072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"59'9","reported_seq":58,"reported_epoch":64,"state":"active+undersized","last_fresh":"2023-09-30T17:04:51.417762+0000","last_change":"2023-09-30T17:02:48.266305+0000","last_active":"2023-09-30T17:04:51.417762+0000","last_peered":"2023-09-30T17:04:51.417762+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:02:48.266305+0000","last_became_peered":"2023-09-30T17:02:48.266305+0000","last_unstale":"2023-09-30T17:04:51.417762+0000","last_undegraded":"2023-09-30T17:04:51.417762+0000","last_fullsized":"2023-09-30T17:02:48.265145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:28:07.751219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"59'13","reported_seq":74,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.292739+0000","last_change":"2023-09-30T17:02:18.363479+0000","last_active":"2023-09-30T17:05:03.292739+0000","last_peered":"2023-09-30T17:05:03.292739+0000","last_clean":"2023-09-30T17:05:03.292739+0000","last_became_active":"2023-09-30T17:02:18.363222+0000","last_became_peered":"2023-09-30T17:02:18.363222+0000","last_unstale":"2023-09-30T17:05:03.292739+0000","last_undegraded":"2023-09-30T17:05:03.292739+0000","last_fullsized":"2023-09-30T17:05:03.292739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:09:55.056098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"59'2796","reported_seq":2866,"reported_epoch":68,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2023-09-30T17:05:04.682115+0000","last_change":"2023-09-30T17:05:04.682273+0000","last_active":"2023-09-30T17:05:04.682115+0000","last_peered":"2023-09-30T17:05:04.682115+0000","last_clean":"2023-09-30T17:02:44.410028+0000","last_became_active":"2023-09-30T17:05:04.681285+0000","last_became_peered":"2023-09-30T17:05:04.681285+0000","last_unstale":"2023-09-30T17:05:04.682115+0000","last_undegraded":"2023-09-30T17:05:04.356486+0000","last_fullsized":"2023-09-30T17:05:04.343762+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2796,"log_dups_size":0,"ondisk_log_size":2796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:00:48.822153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8138,"num_write_kb":38784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"59'2852","reported_seq":2913,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.293972+0000","last_change":"2023-09-30T17:02:18.363216+0000","last_active":"2023-09-30T17:05:03.293972+0000","last_peered":"2023-09-30T17:05:03.293972+0000","last_clean":"2023-09-30T17:05:03.293972+0000","last_became_active":"2023-09-30T17:02:18.362894+0000","last_became_peered":"2023-09-30T17:02:18.362894+0000","last_unstale":"2023-09-30T17:05:03.293972+0000","last_undegraded":"2023-09-30T17:05:03.293972+0000","last_fullsized":"2023-09-30T17:05:03.293972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2852,"log_dups_size":0,"ondisk_log_size":2852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:30:43.782165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8357,"num_write_kb":39780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"59'2874","reported_seq":2944,"reported_epoch":68,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2023-09-30T17:05:04.685576+0000","last_change":"2023-09-30T17:05:04.685685+0000","last_active":"2023-09-30T17:05:04.685576+0000","last_peered":"2023-09-30T17:05:04.685576+0000","last_clean":"2023-09-30T17:02:44.410264+0000","last_became_active":"2023-09-30T17:05:04.684696+0000","last_became_peered":"2023-09-30T17:05:04.684696+0000","last_unstale":"2023-09-30T17:05:04.685576+0000","last_undegraded":"2023-09-30T17:05:04.350239+0000","last_fullsized":"2023-09-30T17:05:04.296131+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2874,"log_dups_size":0,"ondisk_log_size":2874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:13:34.205219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8465,"num_write_kb":40104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":14,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":532685,"num_write_kb":2575302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140940,"ondisk_log_size":140940,"up":121,"acting":96,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":228927,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":13,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":137,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":696,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":234609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":53,"acting":53,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":1,"acting":1,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":0,"seq":1,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28328,"kb_used_data":800,"kb_used_omap":6,"kb_used_meta":27513,"kb_avail":94343512,"statfs":{"total":96636764160,"available":96607756288,"internally_reserved":0,"allocated":819200,"data_stored":666383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7139,"internal_metadata":28173341},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},{"osd":0,"up_from":8,"seq":34359738407,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":582384,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":580990,"kb_avail":93789456,"statfs":{"total":96636764160,"available":96040402944,"internally_reserved":0,"allocated":1404928,"data_stored":1083533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":594934214},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 17:04:07 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46899999999999997,"15min":0.47299999999999998},"min":{"1min":0.21299999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.42499999999999999,"15min":0.437},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.59299999999999997,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.51600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]}]},{"osd":1,"up_from":8,"seq":34359738407,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":563528,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":562942,"kb_avail":93808312,"statfs":{"total":96636764160,"available":96059711488,"internally_reserved":0,"allocated":585728,"data_stored":271543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":576453062},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 17:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.432,"15min":0.438},"min":{"1min":0.17100000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":1.831,"5min":1.831,"15min":1.831},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.46600000000000003,"15min":0.44500000000000001},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":2.5430000000000001,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":0.32800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":249856,"data_stored":227705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T17:05:05.868 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-09-30T17:05:06.321 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:05:06.321 INFO:teuthology.orchestra.run.smithi007.stdout:{"fsid":"68daccc3-6ea9-4db7-9771-3803ff202df8","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 29/50 objects degraded (58.000%), 16 pgs degraded, 23 pgs undersized","count":39},"muted":false}},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":191,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":70,"num_osds":3,"num_up_osds":3,"osd_up_since":1696093502,"num_in_osds":3,"osd_in_since":1696093316,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":57},{"state_name":"active+undersized","count":16},{"state_name":"activating+undersized+remapped","count":9},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":8},{"state_name":"active+undersized+degraded","count":7},{"state_name":"active+undersized+remapped","count":5},{"state_name":"active+undersized+remapped+backfill_wait","count":2},{"state_name":"activating+undersized+degraded+remapped","count":1}],"num_pgs":105,"num_pools":4,"num_objects":25,"data_bytes":819295,"bytes_used":1202421760,"bytes_avail":288707870720,"bytes_total":289910292480,"inactive_pgs_ratio":0.095238097012042999,"degraded_objects":29,"degraded_total":50,"degraded_ratio":0.57999999999999996,"recovering_objects_per_sec":1,"recovering_bytes_per_sec":173,"recovering_keys_per_sec":0,"num_objects_recovered":8,"num_bytes_recovered":696,"num_keys_recovered":0},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4208}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2023-09-30T17:03:23.303001+0000","services":{}},"progress_events":{}} 2023-09-30T17:05:06.336 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2023-09-30T17:05:06.336 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T17:05:06.677 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:05:06.679 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-09-30T17:05:06.689 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":158,"stamp":"2023-09-30T17:05:06.279696+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":819295,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":29,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":140,"num_read_kb":122,"num_write":533025,"num_write_kb":2579054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":696,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141229,"ondisk_log_size":141229,"up":187,"acting":162,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1174240,"kb_used_data":2744,"kb_used_omap":10,"kb_used_meta":1171445,"kb_avail":281941280,"statfs":{"total":289910292480,"available":288707870720,"internally_reserved":0,"allocated":2809856,"data_stored":2021459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10327,"internal_metadata":1199560617},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":5,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":696,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.994139"},"pg_stats":[{"pgid":"4.3f","version":"59'2790","reported_seq":2851,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.298448+0000","last_change":"2023-09-30T17:02:18.360288+0000","last_active":"2023-09-30T17:05:03.298448+0000","last_peered":"2023-09-30T17:05:03.298448+0000","last_clean":"2023-09-30T17:05:03.298448+0000","last_became_active":"2023-09-30T17:02:18.358716+0000","last_became_peered":"2023-09-30T17:02:18.358716+0000","last_unstale":"2023-09-30T17:05:03.298448+0000","last_undegraded":"2023-09-30T17:05:03.298448+0000","last_fullsized":"2023-09-30T17:05:03.298448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2790,"log_dups_size":0,"ondisk_log_size":2790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:12:06.380095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8214,"num_write_kb":38924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"59'4","reported_seq":65,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.294835+0000","last_change":"2023-09-30T17:02:18.362418+0000","last_active":"2023-09-30T17:05:03.294835+0000","last_peered":"2023-09-30T17:05:03.294835+0000","last_clean":"2023-09-30T17:05:03.294835+0000","last_became_active":"2023-09-30T17:02:18.360372+0000","last_became_peered":"2023-09-30T17:02:18.360372+0000","last_unstale":"2023-09-30T17:05:03.294835+0000","last_undegraded":"2023-09-30T17:05:03.294835+0000","last_fullsized":"2023-09-30T17:05:03.294835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:43:29.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"59'5697","reported_seq":5754,"reported_epoch":68,"state":"active+undersized+remapped+backfill_wait","last_fresh":"2023-09-30T17:05:04.682616+0000","last_change":"2023-09-30T17:05:04.682749+0000","last_active":"2023-09-30T17:05:04.682616+0000","last_peered":"2023-09-30T17:05:04.682616+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:05:04.681262+0000","last_became_peered":"2023-09-30T17:05:04.681262+0000","last_unstale":"2023-09-30T17:05:04.682616+0000","last_undegraded":"2023-09-30T17:05:04.682616+0000","last_fullsized":"2023-09-30T17:05:04.349577+0000","mapping_epoch":67,"log_start":"42'1200","ondisk_log_start":"42'1200","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4497,"log_dups_size":1200,"ondisk_log_size":4497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:27:28.611647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16590,"num_write_kb":78960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"59'10","reported_seq":59,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.413799+0000","last_change":"2023-09-30T17:02:48.271018+0000","last_active":"2023-09-30T17:04:50.413799+0000","last_peered":"2023-09-30T17:04:50.413799+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:02:48.271018+0000","last_became_peered":"2023-09-30T17:02:48.271018+0000","last_unstale":"2023-09-30T17:04:50.413799+0000","last_undegraded":"2023-09-30T17:04:50.413799+0000","last_fullsized":"2023-09-30T17:02:48.266412+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:41:09.173972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"59'2934","reported_seq":2995,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.293902+0000","last_change":"2023-09-30T17:02:18.360192+0000","last_active":"2023-09-30T17:05:03.293902+0000","last_peered":"2023-09-30T17:05:03.293902+0000","last_clean":"2023-09-30T17:05:03.293902+0000","last_became_active":"2023-09-30T17:02:18.357317+0000","last_became_peered":"2023-09-30T17:02:18.357317+0000","last_unstale":"2023-09-30T17:05:03.293902+0000","last_undegraded":"2023-09-30T17:05:03.293902+0000","last_fullsized":"2023-09-30T17:05:03.293902+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2934,"log_dups_size":0,"ondisk_log_size":2934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:37:14.790993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8466,"num_write_kb":40084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"59'6","reported_seq":54,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.413086+0000","last_change":"2023-09-30T17:02:48.267405+0000","last_active":"2023-09-30T17:04:50.413086+0000","last_peered":"2023-09-30T17:04:50.413086+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:02:48.267405+0000","last_became_peered":"2023-09-30T17:02:48.267405+0000","last_unstale":"2023-09-30T17:04:50.413086+0000","last_undegraded":"2023-09-30T17:04:50.413086+0000","last_fullsized":"2023-09-30T17:02:48.265304+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:39:21.100353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"59'7","reported_seq":55,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.412996+0000","last_change":"2023-09-30T17:02:48.268306+0000","last_active":"2023-09-30T17:04:50.412996+0000","last_peered":"2023-09-30T17:04:50.412996+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:02:48.268306+0000","last_became_peered":"2023-09-30T17:02:48.268306+0000","last_unstale":"2023-09-30T17:04:50.412996+0000","last_undegraded":"2023-09-30T17:04:50.412996+0000","last_fullsized":"2023-09-30T17:02:48.265227+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:20:53.357746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.38","version":"59'11423","reported_seq":11475,"reported_epoch":68,"state":"activating+undersized+remapped","last_fresh":"2023-09-30T17:05:04.293986+0000","last_change":"2023-09-30T17:05:04.364646+0000","last_active":"2023-09-30T17:05:03.293089+0000","last_peered":"2023-09-30T17:05:01.285591+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:02:48.268573+0000","last_became_peered":"2023-09-30T17:02:48.268573+0000","last_unstale":"2023-09-30T17:05:04.293986+0000","last_undegraded":"2023-09-30T17:05:04.293986+0000","last_fullsized":"2023-09-30T17:05:04.293986+0000","mapping_epoch":67,"log_start":"52'7200","ondisk_log_start":"52'7200","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4223,"log_dups_size":7200,"ondisk_log_size":4223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:56:52.522789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33444,"num_write_kb":158924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"59'8589","reported_seq":8650,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.293977+0000","last_change":"2023-09-30T17:02:18.364222+0000","last_active":"2023-09-30T17:05:03.293977+0000","last_peered":"2023-09-30T17:05:03.293977+0000","last_clean":"2023-09-30T17:05:03.293977+0000","last_became_active":"2023-09-30T17:02:18.363485+0000","last_became_peered":"2023-09-30T17:02:18.363485+0000","last_unstale":"2023-09-30T17:05:03.293977+0000","last_undegraded":"2023-09-30T17:05:03.293977+0000","last_fullsized":"2023-09-30T17:05:03.293977+0000","mapping_epoch":17,"log_start":"49'4400","ondisk_log_start":"49'4400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4189,"log_dups_size":4400,"ondisk_log_size":4189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:14:35.192615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25052,"num_write_kb":118756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"59'8585","reported_seq":8646,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.296848+0000","last_change":"2023-09-30T17:02:18.360010+0000","last_active":"2023-09-30T17:05:03.296848+0000","last_peered":"2023-09-30T17:05:03.296848+0000","last_clean":"2023-09-30T17:05:03.296848+0000","last_became_active":"2023-09-30T17:02:18.358396+0000","last_became_peered":"2023-09-30T17:02:18.358396+0000","last_unstale":"2023-09-30T17:05:03.296848+0000","last_undegraded":"2023-09-30T17:05:03.296848+0000","last_fullsized":"2023-09-30T17:05:03.296848+0000","mapping_epoch":17,"log_start":"48'4100","ondisk_log_start":"48'4100","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4485,"log_dups_size":4100,"ondisk_log_size":4485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:26:11.522402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24997,"num_write_kb":162463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"59'5664","reported_seq":5716,"reported_epoch":68,"state":"activating+undersized+remapped","last_fresh":"2023-09-30T17:05:04.295037+0000","last_change":"2023-09-30T17:05:04.356723+0000","last_active":"2023-09-30T17:05:03.294233+0000","last_peered":"2023-09-30T17:05:01.286460+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:02:48.271026+0000","last_became_peered":"2023-09-30T17:02:48.271026+0000","last_unstale":"2023-09-30T17:05:04.295037+0000","last_undegraded":"2023-09-30T17:05:04.295037+0000","last_fullsized":"2023-09-30T17:05:04.295037+0000","mapping_epoch":67,"log_start":"43'1400","ondisk_log_start":"43'1400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4264,"log_dups_size":1400,"ondisk_log_size":4264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:07:23.682970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16442,"num_write_kb":78308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"59'2931","reported_seq":3001,"reported_epoch":68,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2023-09-30T17:05:04.685614+0000","last_change":"2023-09-30T17:05:04.686083+0000","last_active":"2023-09-30T17:05:04.685614+0000","last_peered":"2023-09-30T17:05:04.685614+0000","last_clean":"2023-09-30T17:02:44.409974+0000","last_became_active":"2023-09-30T17:05:04.684700+0000","last_became_peered":"2023-09-30T17:05:04.684700+0000","last_unstale":"2023-09-30T17:05:04.685614+0000","last_undegraded":"2023-09-30T17:05:04.350380+0000","last_fullsized":"2023-09-30T17:05:04.295029+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2931,"log_dups_size":0,"ondisk_log_size":2931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:56:52.522789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8488,"num_write_kb":40364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"59'2860","reported_seq":2921,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.293200+0000","last_change":"2023-09-30T17:02:18.359894+0000","last_active":"2023-09-30T17:05:03.293200+0000","last_peered":"2023-09-30T17:05:03.293200+0000","last_clean":"2023-09-30T17:05:03.293200+0000","last_became_active":"2023-09-30T17:02:18.358534+0000","last_became_peered":"2023-09-30T17:02:18.358534+0000","last_unstale":"2023-09-30T17:05:03.293200+0000","last_undegraded":"2023-09-30T17:05:03.293200+0000","last_fullsized":"2023-09-30T17:05:03.293200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2860,"log_dups_size":0,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:22:13.025181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8367,"num_write_kb":39772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"59'2911","reported_seq":2967,"reported_epoch":68,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2023-09-30T17:05:04.667557+0000","last_change":"2023-09-30T17:05:04.667684+0000","last_active":"2023-09-30T17:05:04.667557+0000","last_peered":"2023-09-30T17:05:04.667557+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:05:04.666466+0000","last_became_peered":"2023-09-30T17:05:04.666466+0000","last_unstale":"2023-09-30T17:05:04.667557+0000","last_undegraded":"2023-09-30T17:05:04.341380+0000","last_fullsized":"2023-09-30T17:05:04.294313+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2911,"log_dups_size":0,"ondisk_log_size":2911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:04:34.010415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8419,"num_write_kb":39940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"59'2889","reported_seq":2945,"reported_epoch":68,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2023-09-30T17:05:04.667049+0000","last_change":"2023-09-30T17:05:04.667237+0000","last_active":"2023-09-30T17:05:04.667049+0000","last_peered":"2023-09-30T17:05:04.667049+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:05:04.666044+0000","last_became_peered":"2023-09-30T17:05:04.666044+0000","last_unstale":"2023-09-30T17:05:04.667049+0000","last_undegraded":"2023-09-30T17:05:04.344281+0000","last_fullsized":"2023-09-30T17:05:04.294132+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2889,"log_dups_size":0,"ondisk_log_size":2889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:10:21.239311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8435,"num_write_kb":39984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"59'2839","reported_seq":2891,"reported_epoch":68,"state":"activating+undersized+remapped","last_fresh":"2023-09-30T17:05:04.293874+0000","last_change":"2023-09-30T17:05:04.333472+0000","last_active":"2023-09-30T17:05:03.292896+0000","last_peered":"2023-09-30T17:05:01.285397+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:02:48.267199+0000","last_became_peered":"2023-09-30T17:02:48.267199+0000","last_unstale":"2023-09-30T17:05:04.293874+0000","last_undegraded":"2023-09-30T17:05:04.293874+0000","last_fullsized":"2023-09-30T17:05:04.293874+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2839,"log_dups_size":0,"ondisk_log_size":2839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:05:29.995730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8166,"num_write_kb":38928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2f","version":"59'2802","reported_seq":2863,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.294096+0000","last_change":"2023-09-30T17:02:18.364360+0000","last_active":"2023-09-30T17:05:03.294096+0000","last_peered":"2023-09-30T17:05:03.294096+0000","last_clean":"2023-09-30T17:05:03.294096+0000","last_became_active":"2023-09-30T17:02:18.363697+0000","last_became_peered":"2023-09-30T17:02:18.363697+0000","last_unstale":"2023-09-30T17:05:03.294096+0000","last_undegraded":"2023-09-30T17:05:03.294096+0000","last_fullsized":"2023-09-30T17:05:03.294096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2802,"log_dups_size":0,"ondisk_log_size":2802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:50:52.893768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8256,"num_write_kb":39208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"59'2860","reported_seq":2921,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.297246+0000","last_change":"2023-09-30T17:02:18.360320+0000","last_active":"2023-09-30T17:05:03.297246+0000","last_peered":"2023-09-30T17:05:03.297246+0000","last_clean":"2023-09-30T17:05:03.297246+0000","last_became_active":"2023-09-30T17:02:18.357184+0000","last_became_peered":"2023-09-30T17:02:18.357184+0000","last_unstale":"2023-09-30T17:05:03.297246+0000","last_undegraded":"2023-09-30T17:05:03.297246+0000","last_fullsized":"2023-09-30T17:05:03.297246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2860,"log_dups_size":0,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:21:45.195007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8368,"num_write_kb":39616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"59'5686","reported_seq":5747,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.293409+0000","last_change":"2023-09-30T17:02:18.363956+0000","last_active":"2023-09-30T17:05:03.293409+0000","last_peered":"2023-09-30T17:05:03.293409+0000","last_clean":"2023-09-30T17:05:03.293409+0000","last_became_active":"2023-09-30T17:02:18.363654+0000","last_became_peered":"2023-09-30T17:02:18.363654+0000","last_unstale":"2023-09-30T17:05:03.293409+0000","last_undegraded":"2023-09-30T17:05:03.293409+0000","last_fullsized":"2023-09-30T17:05:03.293409+0000","mapping_epoch":17,"log_start":"44'1500","ondisk_log_start":"44'1500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4186,"log_dups_size":1500,"ondisk_log_size":4186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:48:17.598726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16649,"num_write_kb":78956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"59'5799","reported_seq":5852,"reported_epoch":68,"state":"activating+undersized+remapped","last_fresh":"2023-09-30T17:05:04.359744+0000","last_change":"2023-09-30T17:05:04.359744+0000","last_active":"2023-09-30T17:05:03.295468+0000","last_peered":"2023-09-30T17:05:01.286480+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:02:48.273070+0000","last_became_peered":"2023-09-30T17:02:48.273070+0000","last_unstale":"2023-09-30T17:05:04.359744+0000","last_undegraded":"2023-09-30T17:05:04.359744+0000","last_fullsized":"2023-09-30T17:05:04.294851+0000","mapping_epoch":67,"log_start":"44'1600","ondisk_log_start":"44'1600","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4199,"log_dups_size":1600,"ondisk_log_size":4199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:09:57.818937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16903,"num_write_kb":80184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"59'12","reported_seq":60,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.413217+0000","last_change":"2023-09-30T17:02:48.269502+0000","last_active":"2023-09-30T17:04:50.413217+0000","last_peered":"2023-09-30T17:04:50.413217+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:02:48.269502+0000","last_became_peered":"2023-09-30T17:02:48.269502+0000","last_unstale":"2023-09-30T17:04:50.413217+0000","last_undegraded":"2023-09-30T17:04:50.413217+0000","last_fullsized":"2023-09-30T17:02:48.265516+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:22:15.057405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"59'2879","reported_seq":2949,"reported_epoch":68,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2023-09-30T17:05:04.675971+0000","last_change":"2023-09-30T17:05:04.676123+0000","last_active":"2023-09-30T17:05:04.675971+0000","last_peered":"2023-09-30T17:05:04.675971+0000","last_clean":"2023-09-30T17:02:44.409783+0000","last_became_active":"2023-09-30T17:05:04.675105+0000","last_became_peered":"2023-09-30T17:05:04.675105+0000","last_unstale":"2023-09-30T17:05:04.675971+0000","last_undegraded":"2023-09-30T17:05:04.350614+0000","last_fullsized":"2023-09-30T17:05:04.294637+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2879,"log_dups_size":0,"ondisk_log_size":2879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:25:29.014968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8343,"num_write_kb":39768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"59'2809","reported_seq":2875,"reported_epoch":68,"state":"activating+undersized+remapped","last_fresh":"2023-09-30T17:05:04.294246+0000","last_change":"2023-09-30T17:05:04.336681+0000","last_active":"2023-09-30T17:05:02.294532+0000","last_peered":"2023-09-30T17:05:01.285906+0000","last_clean":"2023-09-30T17:02:44.409099+0000","last_became_active":"2023-09-30T17:02:48.270162+0000","last_became_peered":"2023-09-30T17:02:48.270162+0000","last_unstale":"2023-09-30T17:05:04.294246+0000","last_undegraded":"2023-09-30T17:05:04.294246+0000","last_fullsized":"2023-09-30T17:05:04.294246+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2809,"log_dups_size":0,"ondisk_log_size":2809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:31:14.223659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8281,"num_write_kb":39472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"59'5585","reported_seq":5646,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.293866+0000","last_change":"2023-09-30T17:02:18.353938+0000","last_active":"2023-09-30T17:05:03.293866+0000","last_peered":"2023-09-30T17:05:03.293866+0000","last_clean":"2023-09-30T17:05:03.293866+0000","last_became_active":"2023-09-30T17:02:18.353632+0000","last_became_peered":"2023-09-30T17:02:18.353632+0000","last_unstale":"2023-09-30T17:05:03.293866+0000","last_undegraded":"2023-09-30T17:05:03.293866+0000","last_fullsized":"2023-09-30T17:05:03.293866+0000","mapping_epoch":17,"log_start":"42'1100","ondisk_log_start":"42'1100","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4485,"log_dups_size":1100,"ondisk_log_size":4485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:09:55.056098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16523,"num_write_kb":78256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"59'2888","reported_seq":2962,"reported_epoch":68,"state":"active+undersized+remapped","last_fresh":"2023-09-30T17:05:04.684311+0000","last_change":"2023-09-30T17:05:04.684498+0000","last_active":"2023-09-30T17:05:04.684311+0000","last_peered":"2023-09-30T17:05:04.684311+0000","last_clean":"2023-09-30T17:02:44.410555+0000","last_became_active":"2023-09-30T17:05:04.622264+0000","last_became_peered":"2023-09-30T17:05:04.622264+0000","last_unstale":"2023-09-30T17:05:04.684311+0000","last_undegraded":"2023-09-30T17:05:04.684311+0000","last_fullsized":"2023-09-30T17:05:04.296505+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2888,"log_dups_size":0,"ondisk_log_size":2888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:22:14.097479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8371,"num_write_kb":39716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"59'18","reported_seq":90,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.310314+0000","last_change":"2023-09-30T17:05:03.309295+0000","last_active":"2023-09-30T17:05:03.310314+0000","last_peered":"2023-09-30T17:05:03.310314+0000","last_clean":"2023-09-30T17:05:03.310314+0000","last_became_active":"2023-09-30T17:05:03.308884+0000","last_became_peered":"2023-09-30T17:05:03.308884+0000","last_unstale":"2023-09-30T17:05:03.310314+0000","last_undegraded":"2023-09-30T17:05:03.310314+0000","last_fullsized":"2023-09-30T17:05:03.310314+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:57:45.449671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"59'2855","reported_seq":2912,"reported_epoch":68,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2023-09-30T17:05:04.666942+0000","last_change":"2023-09-30T17:05:04.667093+0000","last_active":"2023-09-30T17:05:04.666942+0000","last_peered":"2023-09-30T17:05:04.666942+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:05:04.665996+0000","last_became_peered":"2023-09-30T17:05:04.665996+0000","last_unstale":"2023-09-30T17:05:04.666942+0000","last_undegraded":"2023-09-30T17:05:04.343573+0000","last_fullsized":"2023-09-30T17:05:04.295209+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2855,"log_dups_size":0,"ondisk_log_size":2855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:31:14.223659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8347,"num_write_kb":39608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":63,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.292988+0000","last_change":"2023-09-30T17:02:17.358258+0000","last_active":"2023-09-30T17:05:03.292988+0000","last_peered":"2023-09-30T17:05:03.292988+0000","last_clean":"2023-09-30T17:05:03.292988+0000","last_became_active":"2023-09-30T17:02:17.357890+0000","last_became_peered":"2023-09-30T17:02:17.357890+0000","last_unstale":"2023-09-30T17:05:03.292988+0000","last_undegraded":"2023-09-30T17:05:03.292988+0000","last_fullsized":"2023-09-30T17:05:03.292988+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:52:56.591906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"59'17","reported_seq":89,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.309329+0000","last_change":"2023-09-30T17:05:03.307486+0000","last_active":"2023-09-30T17:05:03.309329+0000","last_peered":"2023-09-30T17:05:03.309329+0000","last_clean":"2023-09-30T17:05:03.309329+0000","last_became_active":"2023-09-30T17:05:03.307012+0000","last_became_peered":"2023-09-30T17:05:03.307012+0000","last_unstale":"2023-09-30T17:05:03.309329+0000","last_undegraded":"2023-09-30T17:05:03.309329+0000","last_fullsized":"2023-09-30T17:05:03.309329+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:05:29.995730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":73,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.310296+0000","last_change":"2023-09-30T17:05:03.309164+0000","last_active":"2023-09-30T17:05:03.310296+0000","last_peered":"2023-09-30T17:05:03.310296+0000","last_clean":"2023-09-30T17:05:03.310296+0000","last_became_active":"2023-09-30T17:05:03.308073+0000","last_became_peered":"2023-09-30T17:05:03.308073+0000","last_unstale":"2023-09-30T17:05:03.310296+0000","last_undegraded":"2023-09-30T17:05:03.310296+0000","last_fullsized":"2023-09-30T17:05:03.310296+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:10:16.238053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"59'6","reported_seq":78,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.309853+0000","last_change":"2023-09-30T17:05:03.308692+0000","last_active":"2023-09-30T17:05:03.309853+0000","last_peered":"2023-09-30T17:05:03.309853+0000","last_clean":"2023-09-30T17:05:03.309853+0000","last_became_active":"2023-09-30T17:05:03.307932+0000","last_became_peered":"2023-09-30T17:05:03.307932+0000","last_unstale":"2023-09-30T17:05:03.309853+0000","last_undegraded":"2023-09-30T17:05:03.309853+0000","last_fullsized":"2023-09-30T17:05:03.309853+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:17:13.668052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":62,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.293753+0000","last_change":"2023-09-30T17:02:17.361000+0000","last_active":"2023-09-30T17:05:03.293753+0000","last_peered":"2023-09-30T17:05:03.293753+0000","last_clean":"2023-09-30T17:05:03.293753+0000","last_became_active":"2023-09-30T17:02:17.360601+0000","last_became_peered":"2023-09-30T17:02:17.360601+0000","last_unstale":"2023-09-30T17:05:03.293753+0000","last_undegraded":"2023-09-30T17:05:03.293753+0000","last_fullsized":"2023-09-30T17:05:03.293753+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:02:27.666526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"59'7","reported_seq":79,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.307828+0000","last_change":"2023-09-30T17:05:03.305898+0000","last_active":"2023-09-30T17:05:03.307828+0000","last_peered":"2023-09-30T17:05:03.307828+0000","last_clean":"2023-09-30T17:05:03.307828+0000","last_became_active":"2023-09-30T17:05:03.305520+0000","last_became_peered":"2023-09-30T17:05:03.305520+0000","last_unstale":"2023-09-30T17:05:03.307828+0000","last_undegraded":"2023-09-30T17:05:03.307828+0000","last_fullsized":"2023-09-30T17:05:03.307828+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:40:09.276369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"58'1","reported_seq":74,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.310300+0000","last_change":"2023-09-30T17:05:03.309303+0000","last_active":"2023-09-30T17:05:03.310300+0000","last_peered":"2023-09-30T17:05:03.310300+0000","last_clean":"2023-09-30T17:05:03.310300+0000","last_became_active":"2023-09-30T17:05:03.308851+0000","last_became_peered":"2023-09-30T17:05:03.308851+0000","last_unstale":"2023-09-30T17:05:03.310300+0000","last_undegraded":"2023-09-30T17:05:03.310300+0000","last_fullsized":"2023-09-30T17:05:03.310300+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:32:55.497287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"59'9","reported_seq":70,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.293329+0000","last_change":"2023-09-30T17:02:18.358841+0000","last_active":"2023-09-30T17:05:03.293329+0000","last_peered":"2023-09-30T17:05:03.293329+0000","last_clean":"2023-09-30T17:05:03.293329+0000","last_became_active":"2023-09-30T17:02:18.358529+0000","last_became_peered":"2023-09-30T17:02:18.358529+0000","last_unstale":"2023-09-30T17:05:03.293329+0000","last_undegraded":"2023-09-30T17:05:03.293329+0000","last_fullsized":"2023-09-30T17:05:03.293329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:15:54.364571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.414744+0000","last_change":"2023-09-30T17:02:48.273786+0000","last_active":"2023-09-30T17:04:50.414744+0000","last_peered":"2023-09-30T17:04:50.414744+0000","last_clean":"2023-09-30T17:02:16.333605+0000","last_became_active":"2023-09-30T17:02:48.273786+0000","last_became_peered":"2023-09-30T17:02:48.273786+0000","last_unstale":"2023-09-30T17:04:50.414744+0000","last_undegraded":"2023-09-30T17:04:50.414744+0000","last_fullsized":"2023-09-30T17:02:48.269616+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:55:31.686602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.11","version":"59'8526","reported_seq":8592,"reported_epoch":68,"state":"activating+undersized+remapped","last_fresh":"2023-09-30T17:05:04.294458+0000","last_change":"2023-09-30T17:05:04.363997+0000","last_active":"2023-09-30T17:05:02.297380+0000","last_peered":"2023-09-30T17:05:01.286184+0000","last_clean":"2023-09-30T17:02:44.408876+0000","last_became_active":"2023-09-30T17:02:48.271101+0000","last_became_peered":"2023-09-30T17:02:48.271101+0000","last_unstale":"2023-09-30T17:05:04.294458+0000","last_undegraded":"2023-09-30T17:05:04.294458+0000","last_fullsized":"2023-09-30T17:05:04.294458+0000","mapping_epoch":67,"log_start":"49'4300","ondisk_log_start":"49'4300","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4226,"log_dups_size":4300,"ondisk_log_size":4226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:13:34.205219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24873,"num_write_kb":118472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"59'7","reported_seq":85,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.311471+0000","last_change":"2023-09-30T17:05:03.310987+0000","last_active":"2023-09-30T17:05:03.311471+0000","last_peered":"2023-09-30T17:05:03.311471+0000","last_clean":"2023-09-30T17:05:03.311471+0000","last_became_active":"2023-09-30T17:05:03.306646+0000","last_became_peered":"2023-09-30T17:05:03.306646+0000","last_unstale":"2023-09-30T17:05:03.311471+0000","last_undegraded":"2023-09-30T17:05:03.311471+0000","last_fullsized":"2023-09-30T17:05:03.311471+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:24:52.247523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"59'5670","reported_seq":5731,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.293120+0000","last_change":"2023-09-30T17:02:18.359118+0000","last_active":"2023-09-30T17:05:03.293120+0000","last_peered":"2023-09-30T17:05:03.293120+0000","last_clean":"2023-09-30T17:05:03.293120+0000","last_became_active":"2023-09-30T17:02:18.358786+0000","last_became_peered":"2023-09-30T17:02:18.358786+0000","last_unstale":"2023-09-30T17:05:03.293120+0000","last_undegraded":"2023-09-30T17:05:03.293120+0000","last_fullsized":"2023-09-30T17:05:03.293120+0000","mapping_epoch":17,"log_start":"44'1500","ondisk_log_start":"44'1500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4170,"log_dups_size":1500,"ondisk_log_size":4170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:33:21.723864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16627,"num_write_kb":79047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"60'78","reported_seq":137,"reported_epoch":63,"state":"active+undersized+degraded","last_fresh":"2023-09-30T17:04:50.415990+0000","last_change":"2023-09-30T17:02:48.270268+0000","last_active":"2023-09-30T17:04:50.415990+0000","last_peered":"2023-09-30T17:04:50.415990+0000","last_clean":"2023-09-30T17:02:39.878275+0000","last_became_active":"2023-09-30T17:02:48.270268+0000","last_became_peered":"2023-09-30T17:02:48.270268+0000","last_unstale":"2023-09-30T17:04:50.415990+0000","last_undegraded":"2023-09-30T17:02:48.267766+0000","last_fullsized":"2023-09-30T17:02:48.266692+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:45:50.479146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227523,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":4}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"59'5677","reported_seq":5737,"reported_epoch":68,"state":"active+undersized+remapped+backfill_wait","last_fresh":"2023-09-30T17:05:04.615546+0000","last_change":"2023-09-30T17:05:04.615546+0000","last_active":"2023-09-30T17:05:04.615546+0000","last_peered":"2023-09-30T17:05:04.615546+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:05:04.607716+0000","last_became_peered":"2023-09-30T17:05:04.607716+0000","last_unstale":"2023-09-30T17:05:04.615546+0000","last_undegraded":"2023-09-30T17:05:04.615546+0000","last_fullsized":"2023-09-30T17:05:04.294454+0000","mapping_epoch":67,"log_start":"42'1100","ondisk_log_start":"42'1100","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4577,"log_dups_size":1100,"ondisk_log_size":4577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:59:52.758548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16579,"num_write_kb":79104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":57,"reported_epoch":63,"state":"active+undersized+degraded","last_fresh":"2023-09-30T17:04:50.414436+0000","last_change":"2023-09-30T17:02:48.272452+0000","last_active":"2023-09-30T17:04:50.414436+0000","last_peered":"2023-09-30T17:04:50.414436+0000","last_clean":"2023-09-30T17:02:18.357478+0000","last_became_active":"2023-09-30T17:02:48.272452+0000","last_became_peered":"2023-09-30T17:02:48.272452+0000","last_unstale":"2023-09-30T17:04:50.414436+0000","last_undegraded":"2023-09-30T17:02:48.267146+0000","last_fullsized":"2023-09-30T17:02:48.267019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:34:06.341666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":2}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"59'2836","reported_seq":2897,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.295173+0000","last_change":"2023-09-30T17:02:18.360019+0000","last_active":"2023-09-30T17:05:03.295173+0000","last_peered":"2023-09-30T17:05:03.295173+0000","last_clean":"2023-09-30T17:05:03.295173+0000","last_became_active":"2023-09-30T17:02:18.358364+0000","last_became_peered":"2023-09-30T17:02:18.358364+0000","last_unstale":"2023-09-30T17:05:03.295173+0000","last_undegraded":"2023-09-30T17:05:03.295173+0000","last_fullsized":"2023-09-30T17:05:03.295173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2836,"log_dups_size":0,"ondisk_log_size":2836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:30:43.782165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8308,"num_write_kb":39456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":73,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.309897+0000","last_change":"2023-09-30T17:05:03.308853+0000","last_active":"2023-09-30T17:05:03.309897+0000","last_peered":"2023-09-30T17:05:03.309897+0000","last_clean":"2023-09-30T17:05:03.309897+0000","last_became_active":"2023-09-30T17:05:03.308377+0000","last_became_peered":"2023-09-30T17:05:03.308377+0000","last_unstale":"2023-09-30T17:05:03.309897+0000","last_undegraded":"2023-09-30T17:05:03.309897+0000","last_fullsized":"2023-09-30T17:05:03.309897+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:18:42.448826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"59'2856","reported_seq":2917,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.297788+0000","last_change":"2023-09-30T17:02:18.362415+0000","last_active":"2023-09-30T17:05:03.297788+0000","last_peered":"2023-09-30T17:05:03.297788+0000","last_clean":"2023-09-30T17:05:03.297788+0000","last_became_active":"2023-09-30T17:02:18.361556+0000","last_became_peered":"2023-09-30T17:02:18.361556+0000","last_unstale":"2023-09-30T17:05:03.297788+0000","last_undegraded":"2023-09-30T17:05:03.297788+0000","last_fullsized":"2023-09-30T17:05:03.297788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2856,"log_dups_size":0,"ondisk_log_size":2856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:16:41.607547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8321,"num_write_kb":39600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":73,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.305301+0000","last_change":"2023-09-30T17:05:03.304220+0000","last_active":"2023-09-30T17:05:03.305301+0000","last_peered":"2023-09-30T17:05:03.305301+0000","last_clean":"2023-09-30T17:05:03.305301+0000","last_became_active":"2023-09-30T17:05:03.303598+0000","last_became_peered":"2023-09-30T17:05:03.303598+0000","last_unstale":"2023-09-30T17:05:03.305301+0000","last_undegraded":"2023-09-30T17:05:03.305301+0000","last_fullsized":"2023-09-30T17:05:03.305301+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:57:44.444041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"59'12","reported_seq":84,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.314205+0000","last_change":"2023-09-30T17:05:03.313214+0000","last_active":"2023-09-30T17:05:03.314205+0000","last_peered":"2023-09-30T17:05:03.314205+0000","last_clean":"2023-09-30T17:05:03.314205+0000","last_became_active":"2023-09-30T17:05:03.312888+0000","last_became_peered":"2023-09-30T17:05:03.312888+0000","last_unstale":"2023-09-30T17:05:03.314205+0000","last_undegraded":"2023-09-30T17:05:03.314205+0000","last_fullsized":"2023-09-30T17:05:03.314205+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:40:09.276369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"59'9","reported_seq":61,"reported_epoch":63,"state":"active+undersized+degraded","last_fresh":"2023-09-30T17:04:50.417004+0000","last_change":"2023-09-30T17:02:48.271494+0000","last_active":"2023-09-30T17:04:50.417004+0000","last_peered":"2023-09-30T17:04:50.417004+0000","last_clean":"2023-09-30T17:02:18.376118+0000","last_became_active":"2023-09-30T17:02:48.271494+0000","last_became_peered":"2023-09-30T17:02:48.271494+0000","last_unstale":"2023-09-30T17:04:50.417004+0000","last_undegraded":"2023-09-30T17:02:48.266896+0000","last_fullsized":"2023-09-30T17:02:48.266780+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:15:06.636572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":4,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":4}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"59'2892","reported_seq":2966,"reported_epoch":68,"state":"active+undersized+remapped","last_fresh":"2023-09-30T17:05:04.650226+0000","last_change":"2023-09-30T17:05:04.650394+0000","last_active":"2023-09-30T17:05:04.650226+0000","last_peered":"2023-09-30T17:05:04.650226+0000","last_clean":"2023-09-30T17:02:44.409540+0000","last_became_active":"2023-09-30T17:05:04.626857+0000","last_became_peered":"2023-09-30T17:05:04.626857+0000","last_unstale":"2023-09-30T17:05:04.650226+0000","last_undegraded":"2023-09-30T17:05:04.650226+0000","last_fullsized":"2023-09-30T17:05:04.295690+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2892,"log_dups_size":0,"ondisk_log_size":2892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:22:14.097479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8345,"num_write_kb":39712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":57,"reported_epoch":63,"state":"active+undersized+degraded","last_fresh":"2023-09-30T17:04:50.416937+0000","last_change":"2023-09-30T17:02:48.272397+0000","last_active":"2023-09-30T17:04:50.416937+0000","last_peered":"2023-09-30T17:04:50.416937+0000","last_clean":"2023-09-30T17:02:18.357313+0000","last_became_active":"2023-09-30T17:02:48.272397+0000","last_became_peered":"2023-09-30T17:02:48.272397+0000","last_unstale":"2023-09-30T17:04:50.416937+0000","last_undegraded":"2023-09-30T17:02:48.268170+0000","last_fullsized":"2023-09-30T17:02:48.268067+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:57:01.669630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"59'2861","reported_seq":2927,"reported_epoch":68,"state":"activating+undersized+remapped","last_fresh":"2023-09-30T17:05:04.294000+0000","last_change":"2023-09-30T17:05:04.347702+0000","last_active":"2023-09-30T17:05:02.288537+0000","last_peered":"2023-09-30T17:05:01.285312+0000","last_clean":"2023-09-30T17:02:44.409530+0000","last_became_active":"2023-09-30T17:02:48.271207+0000","last_became_peered":"2023-09-30T17:02:48.271207+0000","last_unstale":"2023-09-30T17:05:04.294000+0000","last_undegraded":"2023-09-30T17:05:04.294000+0000","last_fullsized":"2023-09-30T17:05:04.294000+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2861,"log_dups_size":0,"ondisk_log_size":2861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:09:57.818937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8384,"num_write_kb":39788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":75,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.305282+0000","last_change":"2023-09-30T17:05:03.304232+0000","last_active":"2023-09-30T17:05:03.305282+0000","last_peered":"2023-09-30T17:05:03.305282+0000","last_clean":"2023-09-30T17:05:03.305282+0000","last_became_active":"2023-09-30T17:05:03.303874+0000","last_became_peered":"2023-09-30T17:05:03.303874+0000","last_unstale":"2023-09-30T17:05:03.305282+0000","last_undegraded":"2023-09-30T17:05:03.305282+0000","last_fullsized":"2023-09-30T17:05:03.305282+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:39:49.644290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"59'2","reported_seq":63,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.295036+0000","last_change":"2023-09-30T17:02:18.359767+0000","last_active":"2023-09-30T17:05:03.295036+0000","last_peered":"2023-09-30T17:05:03.295036+0000","last_clean":"2023-09-30T17:05:03.295036+0000","last_became_active":"2023-09-30T17:02:18.356825+0000","last_became_peered":"2023-09-30T17:02:18.356825+0000","last_unstale":"2023-09-30T17:05:03.295036+0000","last_undegraded":"2023-09-30T17:05:03.295036+0000","last_fullsized":"2023-09-30T17:05:03.295036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:39:16.689300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":57,"reported_epoch":63,"state":"active+undersized+degraded","last_fresh":"2023-09-30T17:04:50.416968+0000","last_change":"2023-09-30T17:02:48.271475+0000","last_active":"2023-09-30T17:04:50.416968+0000","last_peered":"2023-09-30T17:04:50.416968+0000","last_clean":"2023-09-30T17:02:18.356780+0000","last_became_active":"2023-09-30T17:02:48.271475+0000","last_became_peered":"2023-09-30T17:02:48.271475+0000","last_unstale":"2023-09-30T17:04:50.416968+0000","last_undegraded":"2023-09-30T17:02:48.267564+0000","last_fullsized":"2023-09-30T17:02:48.267019+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:31:33.824606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":1}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"59'2835","reported_seq":2888,"reported_epoch":68,"state":"activating+undersized+remapped","last_fresh":"2023-09-30T17:05:04.294059+0000","last_change":"2023-09-30T17:05:04.336684+0000","last_active":"2023-09-30T17:05:03.293126+0000","last_peered":"2023-09-30T17:05:01.285691+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:02:48.269547+0000","last_became_peered":"2023-09-30T17:02:48.269547+0000","last_unstale":"2023-09-30T17:05:04.294059+0000","last_undegraded":"2023-09-30T17:05:04.294059+0000","last_fullsized":"2023-09-30T17:05:04.294059+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2835,"log_dups_size":0,"ondisk_log_size":2835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:04:34.010415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8288,"num_write_kb":39388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":48,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.414318+0000","last_change":"2023-09-30T17:02:48.272328+0000","last_active":"2023-09-30T17:04:50.414318+0000","last_peered":"2023-09-30T17:04:50.414318+0000","last_clean":"2023-09-30T17:02:16.333605+0000","last_became_active":"2023-09-30T17:02:48.272328+0000","last_became_peered":"2023-09-30T17:02:48.272328+0000","last_unstale":"2023-09-30T17:04:50.414318+0000","last_undegraded":"2023-09-30T17:04:50.414318+0000","last_fullsized":"2023-09-30T17:02:48.267308+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:31:33.824606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"59'8","reported_seq":80,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.310264+0000","last_change":"2023-09-30T17:05:03.308917+0000","last_active":"2023-09-30T17:05:03.310264+0000","last_peered":"2023-09-30T17:05:03.310264+0000","last_clean":"2023-09-30T17:05:03.310264+0000","last_became_active":"2023-09-30T17:05:03.308214+0000","last_became_peered":"2023-09-30T17:05:03.308214+0000","last_unstale":"2023-09-30T17:05:03.310264+0000","last_undegraded":"2023-09-30T17:05:03.310264+0000","last_fullsized":"2023-09-30T17:05:03.310264+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:39:50.649920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"58'3","reported_seq":77,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.309904+0000","last_change":"2023-09-30T17:05:03.308944+0000","last_active":"2023-09-30T17:05:03.309904+0000","last_peered":"2023-09-30T17:05:03.309904+0000","last_clean":"2023-09-30T17:05:03.309904+0000","last_became_active":"2023-09-30T17:05:03.308483+0000","last_became_peered":"2023-09-30T17:05:03.308483+0000","last_unstale":"2023-09-30T17:05:03.309904+0000","last_undegraded":"2023-09-30T17:05:03.309904+0000","last_fullsized":"2023-09-30T17:05:03.309904+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:43:27.633747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"59'2846","reported_seq":2899,"reported_epoch":68,"state":"activating+undersized+degraded+remapped","last_fresh":"2023-09-30T17:05:04.338167+0000","last_change":"2023-09-30T17:05:04.653637+0000","last_active":"2023-09-30T17:05:03.294302+0000","last_peered":"2023-09-30T17:05:01.286239+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:02:48.271402+0000","last_became_peered":"2023-09-30T17:02:48.271402+0000","last_unstale":"2023-09-30T17:05:04.338167+0000","last_undegraded":"2023-09-30T17:05:04.338167+0000","last_fullsized":"2023-09-30T17:05:04.295147+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2846,"log_dups_size":0,"ondisk_log_size":2846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:10:21.239311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8199,"num_write_kb":39160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":49,"reported_epoch":64,"state":"active+undersized","last_fresh":"2023-09-30T17:04:51.418689+0000","last_change":"2023-09-30T17:02:48.271186+0000","last_active":"2023-09-30T17:04:51.418689+0000","last_peered":"2023-09-30T17:04:51.418689+0000","last_clean":"2023-09-30T17:02:16.333605+0000","last_became_active":"2023-09-30T17:02:48.271186+0000","last_became_peered":"2023-09-30T17:02:48.271186+0000","last_unstale":"2023-09-30T17:04:51.418689+0000","last_undegraded":"2023-09-30T17:04:51.418689+0000","last_fullsized":"2023-09-30T17:02:48.266545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:02:10.359842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"59'2831","reported_seq":2888,"reported_epoch":68,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2023-09-30T17:05:04.667313+0000","last_change":"2023-09-30T17:05:04.667313+0000","last_active":"2023-09-30T17:05:04.667313+0000","last_peered":"2023-09-30T17:05:04.667313+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:05:04.666016+0000","last_became_peered":"2023-09-30T17:05:04.666016+0000","last_unstale":"2023-09-30T17:05:04.667313+0000","last_undegraded":"2023-09-30T17:05:04.347594+0000","last_fullsized":"2023-09-30T17:05:04.295721+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2831,"log_dups_size":0,"ondisk_log_size":2831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:07:23.682970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8336,"num_write_kb":39484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":73,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.305277+0000","last_change":"2023-09-30T17:05:03.304019+0000","last_active":"2023-09-30T17:05:03.305277+0000","last_peered":"2023-09-30T17:05:03.305277+0000","last_clean":"2023-09-30T17:05:03.305277+0000","last_became_active":"2023-09-30T17:05:03.303473+0000","last_became_peered":"2023-09-30T17:05:03.303473+0000","last_unstale":"2023-09-30T17:05:03.305277+0000","last_undegraded":"2023-09-30T17:05:03.305277+0000","last_fullsized":"2023-09-30T17:05:03.305277+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:10:16.238053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"59'2884","reported_seq":2945,"reported_epoch":68,"state":"active+undersized+remapped","last_fresh":"2023-09-30T17:05:04.691450+0000","last_change":"2023-09-30T17:05:04.691450+0000","last_active":"2023-09-30T17:05:04.691450+0000","last_peered":"2023-09-30T17:05:04.691450+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:05:04.623077+0000","last_became_peered":"2023-09-30T17:05:04.623077+0000","last_unstale":"2023-09-30T17:05:04.691450+0000","last_undegraded":"2023-09-30T17:05:04.691450+0000","last_fullsized":"2023-09-30T17:05:04.295406+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2884,"log_dups_size":0,"ondisk_log_size":2884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:48:53.970711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8366,"num_write_kb":39744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":62,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.293603+0000","last_change":"2023-09-30T17:02:17.358811+0000","last_active":"2023-09-30T17:05:03.293603+0000","last_peered":"2023-09-30T17:05:03.293603+0000","last_clean":"2023-09-30T17:05:03.293603+0000","last_became_active":"2023-09-30T17:02:17.358582+0000","last_became_peered":"2023-09-30T17:02:17.358582+0000","last_unstale":"2023-09-30T17:05:03.293603+0000","last_undegraded":"2023-09-30T17:05:03.293603+0000","last_fullsized":"2023-09-30T17:05:03.293603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:52:37.518693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"59'8580","reported_seq":8641,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.294204+0000","last_change":"2023-09-30T17:02:18.364478+0000","last_active":"2023-09-30T17:05:03.294204+0000","last_peered":"2023-09-30T17:05:03.294204+0000","last_clean":"2023-09-30T17:05:03.294204+0000","last_became_active":"2023-09-30T17:02:18.364057+0000","last_became_peered":"2023-09-30T17:02:18.364057+0000","last_unstale":"2023-09-30T17:05:03.294204+0000","last_undegraded":"2023-09-30T17:05:03.294204+0000","last_fullsized":"2023-09-30T17:05:03.294204+0000","mapping_epoch":17,"log_start":"49'4400","ondisk_log_start":"49'4400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4180,"log_dups_size":4400,"ondisk_log_size":4180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:13:55.555700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25046,"num_write_kb":118972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":65,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.294666+0000","last_change":"2023-09-30T17:02:12.327704+0000","last_active":"2023-09-30T17:05:03.294666+0000","last_peered":"2023-09-30T17:05:03.294666+0000","last_clean":"2023-09-30T17:05:03.294666+0000","last_became_active":"2023-09-30T17:02:12.327384+0000","last_became_peered":"2023-09-30T17:02:12.327384+0000","last_unstale":"2023-09-30T17:05:03.294666+0000","last_undegraded":"2023-09-30T17:05:03.294666+0000","last_fullsized":"2023-09-30T17:05:03.294666+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:09:34.818252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":49,"reported_epoch":64,"state":"active+undersized","last_fresh":"2023-09-30T17:04:51.419577+0000","last_change":"2023-09-30T17:02:48.271959+0000","last_active":"2023-09-30T17:04:51.419577+0000","last_peered":"2023-09-30T17:04:51.419577+0000","last_clean":"2023-09-30T17:02:16.333605+0000","last_became_active":"2023-09-30T17:02:48.271959+0000","last_became_peered":"2023-09-30T17:02:48.271959+0000","last_unstale":"2023-09-30T17:04:51.419577+0000","last_undegraded":"2023-09-30T17:04:51.419577+0000","last_fullsized":"2023-09-30T17:02:48.267164+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:03:49.752214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"59'9","reported_seq":81,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.307847+0000","last_change":"2023-09-30T17:05:03.306223+0000","last_active":"2023-09-30T17:05:03.307847+0000","last_peered":"2023-09-30T17:05:03.307847+0000","last_clean":"2023-09-30T17:05:03.307847+0000","last_became_active":"2023-09-30T17:05:03.305956+0000","last_became_peered":"2023-09-30T17:05:03.305956+0000","last_unstale":"2023-09-30T17:05:03.307847+0000","last_undegraded":"2023-09-30T17:05:03.307847+0000","last_fullsized":"2023-09-30T17:05:03.307847+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:32:56.502917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":49,"reported_epoch":64,"state":"active+undersized","last_fresh":"2023-09-30T17:04:51.418361+0000","last_change":"2023-09-30T17:02:48.271029+0000","last_active":"2023-09-30T17:04:51.418361+0000","last_peered":"2023-09-30T17:04:51.418361+0000","last_clean":"2023-09-30T17:02:11.318349+0000","last_became_active":"2023-09-30T17:02:48.271029+0000","last_became_peered":"2023-09-30T17:02:48.271029+0000","last_unstale":"2023-09-30T17:04:51.418361+0000","last_undegraded":"2023-09-30T17:04:51.418361+0000","last_fullsized":"2023-09-30T17:02:48.266223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:47:55.166958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":49,"reported_epoch":64,"state":"active+undersized","last_fresh":"2023-09-30T17:04:51.419120+0000","last_change":"2023-09-30T17:02:48.272102+0000","last_active":"2023-09-30T17:04:51.419120+0000","last_peered":"2023-09-30T17:04:51.419120+0000","last_clean":"2023-09-30T17:02:16.333605+0000","last_became_active":"2023-09-30T17:02:48.272102+0000","last_became_peered":"2023-09-30T17:02:48.272102+0000","last_unstale":"2023-09-30T17:04:51.419120+0000","last_undegraded":"2023-09-30T17:04:51.419120+0000","last_fullsized":"2023-09-30T17:02:48.266571+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:31:04.525444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.4","version":"59'9","reported_seq":70,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.294333+0000","last_change":"2023-09-30T17:02:18.363399+0000","last_active":"2023-09-30T17:05:03.294333+0000","last_peered":"2023-09-30T17:05:03.294333+0000","last_clean":"2023-09-30T17:05:03.294333+0000","last_became_active":"2023-09-30T17:02:18.363064+0000","last_became_peered":"2023-09-30T17:02:18.363064+0000","last_unstale":"2023-09-30T17:05:03.294333+0000","last_undegraded":"2023-09-30T17:05:03.294333+0000","last_fullsized":"2023-09-30T17:05:03.294333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:32:34.654264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":65,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.293056+0000","last_change":"2023-09-30T17:02:12.327834+0000","last_active":"2023-09-30T17:05:03.293056+0000","last_peered":"2023-09-30T17:05:03.293056+0000","last_clean":"2023-09-30T17:05:03.293056+0000","last_became_active":"2023-09-30T17:02:12.327542+0000","last_became_peered":"2023-09-30T17:02:12.327542+0000","last_unstale":"2023-09-30T17:05:03.293056+0000","last_undegraded":"2023-09-30T17:05:03.293056+0000","last_fullsized":"2023-09-30T17:05:03.293056+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:49:54.890769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":73,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.307435+0000","last_change":"2023-09-30T17:05:03.305668+0000","last_active":"2023-09-30T17:05:03.307435+0000","last_peered":"2023-09-30T17:05:03.307435+0000","last_clean":"2023-09-30T17:05:03.307435+0000","last_became_active":"2023-09-30T17:05:03.305222+0000","last_became_peered":"2023-09-30T17:05:03.305222+0000","last_unstale":"2023-09-30T17:05:03.307435+0000","last_undegraded":"2023-09-30T17:05:03.307435+0000","last_fullsized":"2023-09-30T17:05:03.307435+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:17:12.662422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"59'6","reported_seq":67,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.295500+0000","last_change":"2023-09-30T17:02:18.364406+0000","last_active":"2023-09-30T17:05:03.295500+0000","last_peered":"2023-09-30T17:05:03.295500+0000","last_clean":"2023-09-30T17:05:03.295500+0000","last_became_active":"2023-09-30T17:02:18.363849+0000","last_became_peered":"2023-09-30T17:02:18.363849+0000","last_unstale":"2023-09-30T17:05:03.295500+0000","last_undegraded":"2023-09-30T17:05:03.295500+0000","last_fullsized":"2023-09-30T17:05:03.295500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:43:29.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":49,"reported_epoch":64,"state":"active+undersized","last_fresh":"2023-09-30T17:04:51.418716+0000","last_change":"2023-09-30T17:02:48.270259+0000","last_active":"2023-09-30T17:04:51.418716+0000","last_peered":"2023-09-30T17:04:51.418716+0000","last_clean":"2023-09-30T17:02:11.318349+0000","last_became_active":"2023-09-30T17:02:48.270259+0000","last_became_peered":"2023-09-30T17:02:48.270259+0000","last_unstale":"2023-09-30T17:04:51.418716+0000","last_undegraded":"2023-09-30T17:04:51.418716+0000","last_fullsized":"2023-09-30T17:02:48.266144+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:36:16.950492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":251,"reported_epoch":63,"state":"active+undersized+degraded","last_fresh":"2023-09-30T17:04:50.415221+0000","last_change":"2023-09-30T17:02:48.269439+0000","last_active":"2023-09-30T17:04:50.415221+0000","last_peered":"2023-09-30T17:04:50.415221+0000","last_clean":"2023-09-30T17:02:08.215860+0000","last_became_active":"2023-09-30T17:02:48.269439+0000","last_became_peered":"2023-09-30T17:02:48.269439+0000","last_unstale":"2023-09-30T17:04:50.415221+0000","last_undegraded":"2023-09-30T17:02:48.265518+0000","last_fullsized":"2023-09-30T17:02:48.265371+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:06.295501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:06.295501+0000","last_clean_scrub_stamp":"2023-09-30T17:02:06.295501+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:17:39.733716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[{"shards":"0","objects":2}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":62,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.293005+0000","last_change":"2023-09-30T17:02:17.357139+0000","last_active":"2023-09-30T17:05:03.293005+0000","last_peered":"2023-09-30T17:05:03.293005+0000","last_clean":"2023-09-30T17:05:03.293005+0000","last_became_active":"2023-09-30T17:02:17.356901+0000","last_became_peered":"2023-09-30T17:02:17.356901+0000","last_unstale":"2023-09-30T17:05:03.293005+0000","last_undegraded":"2023-09-30T17:05:03.293005+0000","last_fullsized":"2023-09-30T17:05:03.293005+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:22:35.747671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"59'7","reported_seq":56,"reported_epoch":64,"state":"active+undersized","last_fresh":"2023-09-30T17:04:51.419074+0000","last_change":"2023-09-30T17:02:48.271072+0000","last_active":"2023-09-30T17:04:51.419074+0000","last_peered":"2023-09-30T17:04:51.419074+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:02:48.271072+0000","last_became_peered":"2023-09-30T17:02:48.271072+0000","last_unstale":"2023-09-30T17:04:51.419074+0000","last_undegraded":"2023-09-30T17:04:51.419074+0000","last_fullsized":"2023-09-30T17:02:48.266356+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:02:11.365472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.415870+0000","last_change":"2023-09-30T17:02:48.271468+0000","last_active":"2023-09-30T17:04:50.415870+0000","last_peered":"2023-09-30T17:04:50.415870+0000","last_clean":"2023-09-30T17:02:11.318349+0000","last_became_active":"2023-09-30T17:02:48.271468+0000","last_became_peered":"2023-09-30T17:02:48.271468+0000","last_unstale":"2023-09-30T17:04:50.415870+0000","last_undegraded":"2023-09-30T17:04:50.415870+0000","last_fullsized":"2023-09-30T17:02:48.266735+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:30:59.510188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"59'5","reported_seq":86,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.318953+0000","last_change":"2023-09-30T17:05:03.318439+0000","last_active":"2023-09-30T17:05:03.318953+0000","last_peered":"2023-09-30T17:05:03.318953+0000","last_clean":"2023-09-30T17:05:03.318953+0000","last_became_active":"2023-09-30T17:05:03.308059+0000","last_became_peered":"2023-09-30T17:05:03.308059+0000","last_unstale":"2023-09-30T17:05:03.318953+0000","last_undegraded":"2023-09-30T17:05:03.318953+0000","last_fullsized":"2023-09-30T17:05:03.318953+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:16:25.170638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"59'11252","reported_seq":11313,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.296974+0000","last_change":"2023-09-30T17:02:18.360029+0000","last_active":"2023-09-30T17:05:03.296974+0000","last_peered":"2023-09-30T17:05:03.296974+0000","last_clean":"2023-09-30T17:05:03.296974+0000","last_became_active":"2023-09-30T17:02:18.356839+0000","last_became_peered":"2023-09-30T17:02:18.356839+0000","last_unstale":"2023-09-30T17:05:03.296974+0000","last_undegraded":"2023-09-30T17:05:03.296974+0000","last_fullsized":"2023-09-30T17:05:03.296974+0000","mapping_epoch":17,"log_start":"51'6700","ondisk_log_start":"51'6700","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4552,"log_dups_size":6700,"ondisk_log_size":4552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:16:27.516884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33068,"num_write_kb":157144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":65,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.297064+0000","last_change":"2023-09-30T17:02:12.330472+0000","last_active":"2023-09-30T17:05:03.297064+0000","last_peered":"2023-09-30T17:05:03.297064+0000","last_clean":"2023-09-30T17:05:03.297064+0000","last_became_active":"2023-09-30T17:02:12.330154+0000","last_became_peered":"2023-09-30T17:02:12.330154+0000","last_unstale":"2023-09-30T17:05:03.297064+0000","last_undegraded":"2023-09-30T17:05:03.297064+0000","last_fullsized":"2023-09-30T17:05:03.297064+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:43:23.161734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":62,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.304831+0000","last_change":"2023-09-30T17:02:17.361007+0000","last_active":"2023-09-30T17:05:03.304831+0000","last_peered":"2023-09-30T17:05:03.304831+0000","last_clean":"2023-09-30T17:05:03.304831+0000","last_became_active":"2023-09-30T17:02:17.360721+0000","last_became_peered":"2023-09-30T17:02:17.360721+0000","last_unstale":"2023-09-30T17:05:03.304831+0000","last_undegraded":"2023-09-30T17:05:03.304831+0000","last_fullsized":"2023-09-30T17:05:03.304831+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:13:41.205152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"59'2836","reported_seq":2910,"reported_epoch":68,"state":"active+undersized+remapped","last_fresh":"2023-09-30T17:05:04.642669+0000","last_change":"2023-09-30T17:05:04.642880+0000","last_active":"2023-09-30T17:05:04.642669+0000","last_peered":"2023-09-30T17:05:04.642669+0000","last_clean":"2023-09-30T17:02:44.410053+0000","last_became_active":"2023-09-30T17:05:04.617448+0000","last_became_peered":"2023-09-30T17:05:04.617448+0000","last_unstale":"2023-09-30T17:05:04.642669+0000","last_undegraded":"2023-09-30T17:05:04.642669+0000","last_fullsized":"2023-09-30T17:05:04.295696+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2836,"log_dups_size":0,"ondisk_log_size":2836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:53:07.255711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8199,"num_write_kb":39048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"59'3","reported_seq":65,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.294146+0000","last_change":"2023-09-30T17:02:17.360831+0000","last_active":"2023-09-30T17:05:03.294146+0000","last_peered":"2023-09-30T17:05:03.294146+0000","last_clean":"2023-09-30T17:05:03.294146+0000","last_became_active":"2023-09-30T17:02:17.360494+0000","last_became_peered":"2023-09-30T17:02:17.360494+0000","last_unstale":"2023-09-30T17:05:03.294146+0000","last_undegraded":"2023-09-30T17:05:03.294146+0000","last_fullsized":"2023-09-30T17:05:03.294146+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:24:04.564387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":65,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.298199+0000","last_change":"2023-09-30T17:02:12.328184+0000","last_active":"2023-09-30T17:05:03.298199+0000","last_peered":"2023-09-30T17:05:03.298199+0000","last_clean":"2023-09-30T17:05:03.298199+0000","last_became_active":"2023-09-30T17:02:12.327898+0000","last_became_peered":"2023-09-30T17:02:12.327898+0000","last_unstale":"2023-09-30T17:05:03.298199+0000","last_undegraded":"2023-09-30T17:05:03.298199+0000","last_fullsized":"2023-09-30T17:05:03.298199+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:43:23.161734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"59'8","reported_seq":80,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.309894+0000","last_change":"2023-09-30T17:05:03.308856+0000","last_active":"2023-09-30T17:05:03.309894+0000","last_peered":"2023-09-30T17:05:03.309894+0000","last_clean":"2023-09-30T17:05:03.309894+0000","last_became_active":"2023-09-30T17:05:03.308429+0000","last_became_peered":"2023-09-30T17:05:03.308429+0000","last_unstale":"2023-09-30T17:05:03.309894+0000","last_undegraded":"2023-09-30T17:05:03.309894+0000","last_fullsized":"2023-09-30T17:05:03.309894+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:49:32.189339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":64,"state":"active+undersized","last_fresh":"2023-09-30T17:04:51.419617+0000","last_change":"2023-09-30T17:02:48.269646+0000","last_active":"2023-09-30T17:04:51.419617+0000","last_peered":"2023-09-30T17:04:51.419617+0000","last_clean":"2023-09-30T17:02:11.318349+0000","last_became_active":"2023-09-30T17:02:48.269646+0000","last_became_peered":"2023-09-30T17:02:48.269646+0000","last_unstale":"2023-09-30T17:04:51.419617+0000","last_undegraded":"2023-09-30T17:04:51.419617+0000","last_fullsized":"2023-09-30T17:02:48.267898+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:41:23.216160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.6","version":"60'8","reported_seq":86,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.315262+0000","last_change":"2023-09-30T17:05:03.314806+0000","last_active":"2023-09-30T17:05:03.315262+0000","last_peered":"2023-09-30T17:05:03.315262+0000","last_clean":"2023-09-30T17:05:03.315262+0000","last_became_active":"2023-09-30T17:05:03.308201+0000","last_became_peered":"2023-09-30T17:05:03.308201+0000","last_unstale":"2023-09-30T17:05:03.315262+0000","last_undegraded":"2023-09-30T17:05:03.315262+0000","last_fullsized":"2023-09-30T17:05:03.315262+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:19:18.486570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"59'6","reported_seq":78,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.305327+0000","last_change":"2023-09-30T17:05:03.304265+0000","last_active":"2023-09-30T17:05:03.305327+0000","last_peered":"2023-09-30T17:05:03.305327+0000","last_clean":"2023-09-30T17:05:03.305327+0000","last_became_active":"2023-09-30T17:05:03.304022+0000","last_became_peered":"2023-09-30T17:05:03.304022+0000","last_unstale":"2023-09-30T17:05:03.305327+0000","last_undegraded":"2023-09-30T17:05:03.305327+0000","last_fullsized":"2023-09-30T17:05:03.305327+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:19:19.492200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":74,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.305185+0000","last_change":"2023-09-30T17:05:03.303927+0000","last_active":"2023-09-30T17:05:03.305185+0000","last_peered":"2023-09-30T17:05:03.305185+0000","last_clean":"2023-09-30T17:05:03.305185+0000","last_became_active":"2023-09-30T17:05:03.303487+0000","last_became_peered":"2023-09-30T17:05:03.303487+0000","last_unstale":"2023-09-30T17:05:03.305185+0000","last_undegraded":"2023-09-30T17:05:03.305185+0000","last_fullsized":"2023-09-30T17:05:03.305185+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:43:27.633747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"59'2835","reported_seq":2896,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.295442+0000","last_change":"2023-09-30T17:02:18.358269+0000","last_active":"2023-09-30T17:05:03.295442+0000","last_peered":"2023-09-30T17:05:03.295442+0000","last_clean":"2023-09-30T17:05:03.295442+0000","last_became_active":"2023-09-30T17:02:18.356902+0000","last_became_peered":"2023-09-30T17:02:18.356902+0000","last_unstale":"2023-09-30T17:05:03.295442+0000","last_undegraded":"2023-09-30T17:05:03.295442+0000","last_fullsized":"2023-09-30T17:05:03.295442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2835,"log_dups_size":0,"ondisk_log_size":2835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:39:28.022201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8302,"num_write_kb":39500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":57,"reported_epoch":63,"state":"active+undersized+degraded","last_fresh":"2023-09-30T17:04:50.414624+0000","last_change":"2023-09-30T17:02:48.273247+0000","last_active":"2023-09-30T17:04:50.414624+0000","last_peered":"2023-09-30T17:04:50.414624+0000","last_clean":"2023-09-30T17:02:18.355305+0000","last_became_active":"2023-09-30T17:02:48.273247+0000","last_became_peered":"2023-09-30T17:02:48.273247+0000","last_unstale":"2023-09-30T17:04:50.414624+0000","last_undegraded":"2023-09-30T17:02:48.268795+0000","last_fullsized":"2023-09-30T17:02:48.268551+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:41:28.231415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[{"shards":"1","objects":1}],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"59'2848","reported_seq":2908,"reported_epoch":68,"state":"active+undersized+remapped","last_fresh":"2023-09-30T17:05:04.634410+0000","last_change":"2023-09-30T17:05:04.634599+0000","last_active":"2023-09-30T17:05:04.634410+0000","last_peered":"2023-09-30T17:05:04.634410+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:05:04.607359+0000","last_became_peered":"2023-09-30T17:05:04.607359+0000","last_unstale":"2023-09-30T17:05:04.634410+0000","last_undegraded":"2023-09-30T17:05:04.634410+0000","last_fullsized":"2023-09-30T17:05:04.294683+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2848,"log_dups_size":0,"ondisk_log_size":2848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:11:57.906373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8235,"num_write_kb":39276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1d","version":"58'3","reported_seq":77,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.309314+0000","last_change":"2023-09-30T17:05:03.307212+0000","last_active":"2023-09-30T17:05:03.309314+0000","last_peered":"2023-09-30T17:05:03.309314+0000","last_clean":"2023-09-30T17:05:03.309314+0000","last_became_active":"2023-09-30T17:05:03.306711+0000","last_became_peered":"2023-09-30T17:05:03.306711+0000","last_unstale":"2023-09-30T17:05:03.309314+0000","last_undegraded":"2023-09-30T17:05:03.309314+0000","last_fullsized":"2023-09-30T17:05:03.309314+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:11:56.900744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"59'10","reported_seq":58,"reported_epoch":63,"state":"active+undersized","last_fresh":"2023-09-30T17:04:50.413310+0000","last_change":"2023-09-30T17:02:48.268506+0000","last_active":"2023-09-30T17:04:50.413310+0000","last_peered":"2023-09-30T17:04:50.413310+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:02:48.268506+0000","last_became_peered":"2023-09-30T17:02:48.268506+0000","last_unstale":"2023-09-30T17:04:50.413310+0000","last_undegraded":"2023-09-30T17:04:50.413310+0000","last_fullsized":"2023-09-30T17:02:48.265674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:54:50.127494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":63,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.298122+0000","last_change":"2023-09-30T17:02:17.360802+0000","last_active":"2023-09-30T17:05:03.298122+0000","last_peered":"2023-09-30T17:05:03.298122+0000","last_clean":"2023-09-30T17:05:03.298122+0000","last_became_active":"2023-09-30T17:02:17.360475+0000","last_became_peered":"2023-09-30T17:02:17.360475+0000","last_unstale":"2023-09-30T17:05:03.298122+0000","last_undegraded":"2023-09-30T17:05:03.298122+0000","last_fullsized":"2023-09-30T17:05:03.298122+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:50:18.455188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"59'5711","reported_seq":5772,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.295234+0000","last_change":"2023-09-30T17:02:18.359857+0000","last_active":"2023-09-30T17:05:03.295234+0000","last_peered":"2023-09-30T17:05:03.295234+0000","last_clean":"2023-09-30T17:05:03.295234+0000","last_became_active":"2023-09-30T17:02:18.357098+0000","last_became_peered":"2023-09-30T17:02:18.357098+0000","last_unstale":"2023-09-30T17:05:03.295234+0000","last_undegraded":"2023-09-30T17:05:03.295234+0000","last_fullsized":"2023-09-30T17:05:03.295234+0000","mapping_epoch":17,"log_start":"42'1200","ondisk_log_start":"42'1200","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4511,"log_dups_size":1200,"ondisk_log_size":4511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:48:17.598726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16681,"num_write_kb":79476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":77,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.314213+0000","last_change":"2023-09-30T17:05:03.313345+0000","last_active":"2023-09-30T17:05:03.314213+0000","last_peered":"2023-09-30T17:05:03.314213+0000","last_clean":"2023-09-30T17:05:03.314213+0000","last_became_active":"2023-09-30T17:05:03.313050+0000","last_became_peered":"2023-09-30T17:05:03.313050+0000","last_unstale":"2023-09-30T17:05:03.314213+0000","last_undegraded":"2023-09-30T17:05:03.314213+0000","last_fullsized":"2023-09-30T17:05:03.314213+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:24:52.247523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"59'2872","reported_seq":2924,"reported_epoch":68,"state":"activating+undersized+remapped","last_fresh":"2023-09-30T17:05:04.335721+0000","last_change":"2023-09-30T17:05:04.363319+0000","last_active":"2023-09-30T17:05:03.294498+0000","last_peered":"2023-09-30T17:05:01.285897+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:02:48.270232+0000","last_became_peered":"2023-09-30T17:02:48.270232+0000","last_unstale":"2023-09-30T17:05:04.335721+0000","last_undegraded":"2023-09-30T17:05:04.335721+0000","last_fullsized":"2023-09-30T17:05:04.335721+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2872,"log_dups_size":0,"ondisk_log_size":2872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:53:07.255711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8447,"num_write_kb":40072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.20","version":"59'9","reported_seq":58,"reported_epoch":64,"state":"active+undersized","last_fresh":"2023-09-30T17:04:51.417762+0000","last_change":"2023-09-30T17:02:48.266305+0000","last_active":"2023-09-30T17:04:51.417762+0000","last_peered":"2023-09-30T17:04:51.417762+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:02:48.266305+0000","last_became_peered":"2023-09-30T17:02:48.266305+0000","last_unstale":"2023-09-30T17:04:51.417762+0000","last_undegraded":"2023-09-30T17:04:51.417762+0000","last_fullsized":"2023-09-30T17:02:48.265145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:28:07.751219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"59'13","reported_seq":74,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.292739+0000","last_change":"2023-09-30T17:02:18.363479+0000","last_active":"2023-09-30T17:05:03.292739+0000","last_peered":"2023-09-30T17:05:03.292739+0000","last_clean":"2023-09-30T17:05:03.292739+0000","last_became_active":"2023-09-30T17:02:18.363222+0000","last_became_peered":"2023-09-30T17:02:18.363222+0000","last_unstale":"2023-09-30T17:05:03.292739+0000","last_undegraded":"2023-09-30T17:05:03.292739+0000","last_fullsized":"2023-09-30T17:05:03.292739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:09:55.056098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"59'2796","reported_seq":2866,"reported_epoch":68,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2023-09-30T17:05:04.682115+0000","last_change":"2023-09-30T17:05:04.682273+0000","last_active":"2023-09-30T17:05:04.682115+0000","last_peered":"2023-09-30T17:05:04.682115+0000","last_clean":"2023-09-30T17:02:44.410028+0000","last_became_active":"2023-09-30T17:05:04.681285+0000","last_became_peered":"2023-09-30T17:05:04.681285+0000","last_unstale":"2023-09-30T17:05:04.682115+0000","last_undegraded":"2023-09-30T17:05:04.356486+0000","last_fullsized":"2023-09-30T17:05:04.343762+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2796,"log_dups_size":0,"ondisk_log_size":2796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:00:48.822153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8138,"num_write_kb":38784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"59'2852","reported_seq":2913,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.293972+0000","last_change":"2023-09-30T17:02:18.363216+0000","last_active":"2023-09-30T17:05:03.293972+0000","last_peered":"2023-09-30T17:05:03.293972+0000","last_clean":"2023-09-30T17:05:03.293972+0000","last_became_active":"2023-09-30T17:02:18.362894+0000","last_became_peered":"2023-09-30T17:02:18.362894+0000","last_unstale":"2023-09-30T17:05:03.293972+0000","last_undegraded":"2023-09-30T17:05:03.293972+0000","last_fullsized":"2023-09-30T17:05:03.293972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2852,"log_dups_size":0,"ondisk_log_size":2852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:30:43.782165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8357,"num_write_kb":39780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"59'2874","reported_seq":2944,"reported_epoch":68,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2023-09-30T17:05:04.685576+0000","last_change":"2023-09-30T17:05:04.685685+0000","last_active":"2023-09-30T17:05:04.685576+0000","last_peered":"2023-09-30T17:05:04.685576+0000","last_clean":"2023-09-30T17:02:44.410264+0000","last_became_active":"2023-09-30T17:05:04.684696+0000","last_became_peered":"2023-09-30T17:05:04.684696+0000","last_unstale":"2023-09-30T17:05:04.685576+0000","last_undegraded":"2023-09-30T17:05:04.350239+0000","last_fullsized":"2023-09-30T17:05:04.296131+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2874,"log_dups_size":0,"ondisk_log_size":2874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:13:34.205219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8465,"num_write_kb":40104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":14,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":532685,"num_write_kb":2575302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140940,"ondisk_log_size":140940,"up":121,"acting":96,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":228927,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":13,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":137,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":696,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":299008,"data_stored":234609,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":53,"acting":53,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":2,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":1,"acting":1,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":12,"acting":12,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":0,"seq":1,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28328,"kb_used_data":800,"kb_used_omap":6,"kb_used_meta":27513,"kb_avail":94343512,"statfs":{"total":96636764160,"available":96607756288,"internally_reserved":0,"allocated":819200,"data_stored":666383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7139,"internal_metadata":28173341},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},{"osd":0,"up_from":8,"seq":34359738407,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":582384,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":580990,"kb_avail":93789456,"statfs":{"total":96636764160,"available":96040402944,"internally_reserved":0,"allocated":1404928,"data_stored":1083533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":594934214},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 17:04:07 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46899999999999997,"15min":0.47299999999999998},"min":{"1min":0.21299999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.42499999999999999,"15min":0.437},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.59299999999999997,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.51600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]}]},{"osd":1,"up_from":8,"seq":34359738407,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":563528,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":562942,"kb_avail":93808312,"statfs":{"total":96636764160,"available":96059711488,"internally_reserved":0,"allocated":585728,"data_stored":271543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":576453062},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 17:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.432,"15min":0.438},"min":{"1min":0.17100000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":1.831,"5min":1.831,"15min":1.831},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.46600000000000003,"15min":0.44500000000000001},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":2.5430000000000001,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":0.32800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":249856,"data_stored":227705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":5682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T17:05:09.697 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T17:05:10.056 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:05:10.058 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-09-30T17:05:10.069 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":160,"stamp":"2023-09-30T17:05:09.334988+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":819295,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":140,"num_read_kb":122,"num_write":533025,"num_write_kb":2579054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":223425,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141229,"ondisk_log_size":141229,"up":210,"acting":200,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1192900,"kb_used_data":3348,"kb_used_omap":10,"kb_used_meta":1189493,"kb_avail":281922620,"statfs":{"total":289910292480,"available":288688762880,"internally_reserved":0,"allocated":3428352,"data_stored":2449445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10327,"internal_metadata":1218041769},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-18,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":223425,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001662"},"pg_stats":[{"pgid":"4.3f","version":"59'2790","reported_seq":2851,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.298448+0000","last_change":"2023-09-30T17:02:18.360288+0000","last_active":"2023-09-30T17:05:03.298448+0000","last_peered":"2023-09-30T17:05:03.298448+0000","last_clean":"2023-09-30T17:05:03.298448+0000","last_became_active":"2023-09-30T17:02:18.358716+0000","last_became_peered":"2023-09-30T17:02:18.358716+0000","last_unstale":"2023-09-30T17:05:03.298448+0000","last_undegraded":"2023-09-30T17:05:03.298448+0000","last_fullsized":"2023-09-30T17:05:03.298448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2790,"log_dups_size":0,"ondisk_log_size":2790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:12:06.380095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8214,"num_write_kb":38924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"59'4","reported_seq":65,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.294835+0000","last_change":"2023-09-30T17:02:18.362418+0000","last_active":"2023-09-30T17:05:03.294835+0000","last_peered":"2023-09-30T17:05:03.294835+0000","last_clean":"2023-09-30T17:05:03.294835+0000","last_became_active":"2023-09-30T17:02:18.360372+0000","last_became_peered":"2023-09-30T17:02:18.360372+0000","last_unstale":"2023-09-30T17:05:03.294835+0000","last_undegraded":"2023-09-30T17:05:03.294835+0000","last_fullsized":"2023-09-30T17:05:03.294835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:43:29.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"59'5697","reported_seq":5764,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.291534+0000","last_change":"2023-09-30T17:05:06.291597+0000","last_active":"2023-09-30T17:05:06.291534+0000","last_peered":"2023-09-30T17:05:06.291534+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:05:06.290447+0000","last_became_peered":"2023-09-30T17:05:06.290447+0000","last_unstale":"2023-09-30T17:05:06.291534+0000","last_undegraded":"2023-09-30T17:05:06.291534+0000","last_fullsized":"2023-09-30T17:05:06.291534+0000","mapping_epoch":69,"log_start":"42'1200","ondisk_log_start":"42'1200","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4497,"log_dups_size":1200,"ondisk_log_size":4497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:02:21.064107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16590,"num_write_kb":78960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"59'10","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.280683+0000","last_change":"2023-09-30T17:05:03.309996+0000","last_active":"2023-09-30T17:05:05.280683+0000","last_peered":"2023-09-30T17:05:05.280683+0000","last_clean":"2023-09-30T17:05:05.280683+0000","last_became_active":"2023-09-30T17:05:03.309326+0000","last_became_peered":"2023-09-30T17:05:03.309326+0000","last_unstale":"2023-09-30T17:05:05.280683+0000","last_undegraded":"2023-09-30T17:05:05.280683+0000","last_fullsized":"2023-09-30T17:05:05.280683+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:31:23.164242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"59'2934","reported_seq":2995,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.293902+0000","last_change":"2023-09-30T17:02:18.360192+0000","last_active":"2023-09-30T17:05:03.293902+0000","last_peered":"2023-09-30T17:05:03.293902+0000","last_clean":"2023-09-30T17:05:03.293902+0000","last_became_active":"2023-09-30T17:02:18.357317+0000","last_became_peered":"2023-09-30T17:02:18.357317+0000","last_unstale":"2023-09-30T17:05:03.293902+0000","last_undegraded":"2023-09-30T17:05:03.293902+0000","last_fullsized":"2023-09-30T17:05:03.293902+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2934,"log_dups_size":0,"ondisk_log_size":2934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:37:14.790993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8466,"num_write_kb":40084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"59'6","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.282788+0000","last_change":"2023-09-30T17:05:03.311318+0000","last_active":"2023-09-30T17:05:05.282788+0000","last_peered":"2023-09-30T17:05:05.282788+0000","last_clean":"2023-09-30T17:05:05.282788+0000","last_became_active":"2023-09-30T17:05:03.310703+0000","last_became_peered":"2023-09-30T17:05:03.310703+0000","last_unstale":"2023-09-30T17:05:05.282788+0000","last_undegraded":"2023-09-30T17:05:05.282788+0000","last_fullsized":"2023-09-30T17:05:05.282788+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:08:45.345559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"59'7","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.281077+0000","last_change":"2023-09-30T17:05:03.310838+0000","last_active":"2023-09-30T17:05:05.281077+0000","last_peered":"2023-09-30T17:05:05.281077+0000","last_clean":"2023-09-30T17:05:05.281077+0000","last_became_active":"2023-09-30T17:05:03.310047+0000","last_became_peered":"2023-09-30T17:05:03.310047+0000","last_unstale":"2023-09-30T17:05:05.281077+0000","last_undegraded":"2023-09-30T17:05:05.281077+0000","last_fullsized":"2023-09-30T17:05:05.281077+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:29:17.418059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"59'11423","reported_seq":11493,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.286653+0000","last_change":"2023-09-30T17:05:06.286653+0000","last_active":"2023-09-30T17:05:06.286653+0000","last_peered":"2023-09-30T17:05:06.286653+0000","last_clean":"2023-09-30T17:05:06.286653+0000","last_became_active":"2023-09-30T17:05:06.285582+0000","last_became_peered":"2023-09-30T17:05:06.285582+0000","last_unstale":"2023-09-30T17:05:06.286653+0000","last_undegraded":"2023-09-30T17:05:06.286653+0000","last_fullsized":"2023-09-30T17:05:06.286653+0000","mapping_epoch":69,"log_start":"52'7200","ondisk_log_start":"52'7200","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4223,"log_dups_size":5777,"ondisk_log_size":4223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:35:18.578031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33444,"num_write_kb":158924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"59'8589","reported_seq":8650,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.293977+0000","last_change":"2023-09-30T17:02:18.364222+0000","last_active":"2023-09-30T17:05:03.293977+0000","last_peered":"2023-09-30T17:05:03.293977+0000","last_clean":"2023-09-30T17:05:03.293977+0000","last_became_active":"2023-09-30T17:02:18.363485+0000","last_became_peered":"2023-09-30T17:02:18.363485+0000","last_unstale":"2023-09-30T17:05:03.293977+0000","last_undegraded":"2023-09-30T17:05:03.293977+0000","last_fullsized":"2023-09-30T17:05:03.293977+0000","mapping_epoch":17,"log_start":"49'4400","ondisk_log_start":"49'4400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4189,"log_dups_size":4400,"ondisk_log_size":4189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:14:35.192615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25052,"num_write_kb":118756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"59'8585","reported_seq":8646,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.296848+0000","last_change":"2023-09-30T17:02:18.360010+0000","last_active":"2023-09-30T17:05:03.296848+0000","last_peered":"2023-09-30T17:05:03.296848+0000","last_clean":"2023-09-30T17:05:03.296848+0000","last_became_active":"2023-09-30T17:02:18.358396+0000","last_became_peered":"2023-09-30T17:02:18.358396+0000","last_unstale":"2023-09-30T17:05:03.296848+0000","last_undegraded":"2023-09-30T17:05:03.296848+0000","last_fullsized":"2023-09-30T17:05:03.296848+0000","mapping_epoch":17,"log_start":"48'4100","ondisk_log_start":"48'4100","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4485,"log_dups_size":4100,"ondisk_log_size":4485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:26:11.522402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24997,"num_write_kb":162463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"59'5664","reported_seq":5733,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.291463+0000","last_change":"2023-09-30T17:05:06.291535+0000","last_active":"2023-09-30T17:05:06.291463+0000","last_peered":"2023-09-30T17:05:06.291463+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:05:06.290193+0000","last_became_peered":"2023-09-30T17:05:06.290193+0000","last_unstale":"2023-09-30T17:05:06.291463+0000","last_undegraded":"2023-09-30T17:05:06.291463+0000","last_fullsized":"2023-09-30T17:05:06.291463+0000","mapping_epoch":69,"log_start":"43'1400","ondisk_log_start":"43'1400","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4264,"log_dups_size":1400,"ondisk_log_size":4264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:21:15.508580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16442,"num_write_kb":78308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"59'2931","reported_seq":3001,"reported_epoch":68,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2023-09-30T17:05:04.685614+0000","last_change":"2023-09-30T17:05:04.686083+0000","last_active":"2023-09-30T17:05:04.685614+0000","last_peered":"2023-09-30T17:05:04.685614+0000","last_clean":"2023-09-30T17:02:44.409974+0000","last_became_active":"2023-09-30T17:05:04.684700+0000","last_became_peered":"2023-09-30T17:05:04.684700+0000","last_unstale":"2023-09-30T17:05:04.685614+0000","last_undegraded":"2023-09-30T17:05:04.350380+0000","last_fullsized":"2023-09-30T17:05:04.295029+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2931,"log_dups_size":0,"ondisk_log_size":2931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:56:52.522789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8488,"num_write_kb":40364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"59'2860","reported_seq":2921,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.293200+0000","last_change":"2023-09-30T17:02:18.359894+0000","last_active":"2023-09-30T17:05:03.293200+0000","last_peered":"2023-09-30T17:05:03.293200+0000","last_clean":"2023-09-30T17:05:03.293200+0000","last_became_active":"2023-09-30T17:02:18.358534+0000","last_became_peered":"2023-09-30T17:02:18.358534+0000","last_unstale":"2023-09-30T17:05:03.293200+0000","last_undegraded":"2023-09-30T17:05:03.293200+0000","last_fullsized":"2023-09-30T17:05:03.293200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2860,"log_dups_size":0,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:22:13.025181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8367,"num_write_kb":39772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"59'2911","reported_seq":2972,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.289465+0000","last_change":"2023-09-30T17:05:06.289465+0000","last_active":"2023-09-30T17:05:06.289465+0000","last_peered":"2023-09-30T17:05:06.289465+0000","last_clean":"2023-09-30T17:05:06.289465+0000","last_became_active":"2023-09-30T17:05:06.288360+0000","last_became_peered":"2023-09-30T17:05:06.288360+0000","last_unstale":"2023-09-30T17:05:06.289465+0000","last_undegraded":"2023-09-30T17:05:06.289465+0000","last_fullsized":"2023-09-30T17:05:06.289465+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2911,"log_dups_size":0,"ondisk_log_size":2911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:53:55.381223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8419,"num_write_kb":39940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"59'2889","reported_seq":2950,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.286551+0000","last_change":"2023-09-30T17:05:06.286551+0000","last_active":"2023-09-30T17:05:06.286551+0000","last_peered":"2023-09-30T17:05:06.286551+0000","last_clean":"2023-09-30T17:05:06.286551+0000","last_became_active":"2023-09-30T17:05:06.285738+0000","last_became_peered":"2023-09-30T17:05:06.285738+0000","last_unstale":"2023-09-30T17:05:06.286551+0000","last_undegraded":"2023-09-30T17:05:06.286551+0000","last_fullsized":"2023-09-30T17:05:06.286551+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2889,"log_dups_size":0,"ondisk_log_size":2889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:18:17.841837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8435,"num_write_kb":39984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"59'2839","reported_seq":2899,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.291076+0000","last_change":"2023-09-30T17:05:06.291173+0000","last_active":"2023-09-30T17:05:06.291076+0000","last_peered":"2023-09-30T17:05:06.291076+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:05:06.289872+0000","last_became_peered":"2023-09-30T17:05:06.289872+0000","last_unstale":"2023-09-30T17:05:06.291076+0000","last_undegraded":"2023-09-30T17:05:06.291076+0000","last_fullsized":"2023-09-30T17:05:06.291076+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2839,"log_dups_size":0,"ondisk_log_size":2839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:57:27.685208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8166,"num_write_kb":38928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"59'2802","reported_seq":2863,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.294096+0000","last_change":"2023-09-30T17:02:18.364360+0000","last_active":"2023-09-30T17:05:03.294096+0000","last_peered":"2023-09-30T17:05:03.294096+0000","last_clean":"2023-09-30T17:05:03.294096+0000","last_became_active":"2023-09-30T17:02:18.363697+0000","last_became_peered":"2023-09-30T17:02:18.363697+0000","last_unstale":"2023-09-30T17:05:03.294096+0000","last_undegraded":"2023-09-30T17:05:03.294096+0000","last_fullsized":"2023-09-30T17:05:03.294096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2802,"log_dups_size":0,"ondisk_log_size":2802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:50:52.893768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8256,"num_write_kb":39208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"59'2860","reported_seq":2921,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.297246+0000","last_change":"2023-09-30T17:02:18.360320+0000","last_active":"2023-09-30T17:05:03.297246+0000","last_peered":"2023-09-30T17:05:03.297246+0000","last_clean":"2023-09-30T17:05:03.297246+0000","last_became_active":"2023-09-30T17:02:18.357184+0000","last_became_peered":"2023-09-30T17:02:18.357184+0000","last_unstale":"2023-09-30T17:05:03.297246+0000","last_undegraded":"2023-09-30T17:05:03.297246+0000","last_fullsized":"2023-09-30T17:05:03.297246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2860,"log_dups_size":0,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:21:45.195007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8368,"num_write_kb":39616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"59'5686","reported_seq":5747,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.293409+0000","last_change":"2023-09-30T17:02:18.363956+0000","last_active":"2023-09-30T17:05:03.293409+0000","last_peered":"2023-09-30T17:05:03.293409+0000","last_clean":"2023-09-30T17:05:03.293409+0000","last_became_active":"2023-09-30T17:02:18.363654+0000","last_became_peered":"2023-09-30T17:02:18.363654+0000","last_unstale":"2023-09-30T17:05:03.293409+0000","last_undegraded":"2023-09-30T17:05:03.293409+0000","last_fullsized":"2023-09-30T17:05:03.293409+0000","mapping_epoch":17,"log_start":"44'1500","ondisk_log_start":"44'1500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4186,"log_dups_size":1500,"ondisk_log_size":4186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:48:17.598726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16649,"num_write_kb":78956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"59'5799","reported_seq":5869,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.290908+0000","last_change":"2023-09-30T17:05:06.290994+0000","last_active":"2023-09-30T17:05:06.290908+0000","last_peered":"2023-09-30T17:05:06.290908+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:05:06.289817+0000","last_became_peered":"2023-09-30T17:05:06.289817+0000","last_unstale":"2023-09-30T17:05:06.290908+0000","last_undegraded":"2023-09-30T17:05:06.290908+0000","last_fullsized":"2023-09-30T17:05:06.290908+0000","mapping_epoch":69,"log_start":"44'1600","ondisk_log_start":"44'1600","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4199,"log_dups_size":1600,"ondisk_log_size":4199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:50:21.333588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16903,"num_write_kb":80184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"59'12","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.282364+0000","last_change":"2023-09-30T17:05:03.310298+0000","last_active":"2023-09-30T17:05:05.282364+0000","last_peered":"2023-09-30T17:05:05.282364+0000","last_clean":"2023-09-30T17:05:05.282364+0000","last_became_active":"2023-09-30T17:05:03.309537+0000","last_became_peered":"2023-09-30T17:05:03.309537+0000","last_unstale":"2023-09-30T17:05:05.282364+0000","last_undegraded":"2023-09-30T17:05:05.282364+0000","last_fullsized":"2023-09-30T17:05:05.282364+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:45:25.545287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"59'2879","reported_seq":2949,"reported_epoch":68,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2023-09-30T17:05:04.675971+0000","last_change":"2023-09-30T17:05:04.676123+0000","last_active":"2023-09-30T17:05:04.675971+0000","last_peered":"2023-09-30T17:05:04.675971+0000","last_clean":"2023-09-30T17:02:44.409783+0000","last_became_active":"2023-09-30T17:05:04.675105+0000","last_became_peered":"2023-09-30T17:05:04.675105+0000","last_unstale":"2023-09-30T17:05:04.675971+0000","last_undegraded":"2023-09-30T17:05:04.350614+0000","last_fullsized":"2023-09-30T17:05:04.294637+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2879,"log_dups_size":0,"ondisk_log_size":2879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:25:29.014968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8343,"num_write_kb":39768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"59'2809","reported_seq":2875,"reported_epoch":68,"state":"activating+undersized+remapped","last_fresh":"2023-09-30T17:05:04.294246+0000","last_change":"2023-09-30T17:05:04.336681+0000","last_active":"2023-09-30T17:05:02.294532+0000","last_peered":"2023-09-30T17:05:01.285906+0000","last_clean":"2023-09-30T17:02:44.409099+0000","last_became_active":"2023-09-30T17:02:48.270162+0000","last_became_peered":"2023-09-30T17:02:48.270162+0000","last_unstale":"2023-09-30T17:05:04.294246+0000","last_undegraded":"2023-09-30T17:05:04.294246+0000","last_fullsized":"2023-09-30T17:05:04.294246+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2809,"log_dups_size":0,"ondisk_log_size":2809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:31:14.223659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8281,"num_write_kb":39472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"59'5585","reported_seq":5646,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.293866+0000","last_change":"2023-09-30T17:02:18.353938+0000","last_active":"2023-09-30T17:05:03.293866+0000","last_peered":"2023-09-30T17:05:03.293866+0000","last_clean":"2023-09-30T17:05:03.293866+0000","last_became_active":"2023-09-30T17:02:18.353632+0000","last_became_peered":"2023-09-30T17:02:18.353632+0000","last_unstale":"2023-09-30T17:05:03.293866+0000","last_undegraded":"2023-09-30T17:05:03.293866+0000","last_fullsized":"2023-09-30T17:05:03.293866+0000","mapping_epoch":17,"log_start":"42'1100","ondisk_log_start":"42'1100","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4485,"log_dups_size":1100,"ondisk_log_size":4485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:09:55.056098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16523,"num_write_kb":78256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"59'2888","reported_seq":2962,"reported_epoch":68,"state":"active+undersized+remapped","last_fresh":"2023-09-30T17:05:04.684311+0000","last_change":"2023-09-30T17:05:04.684498+0000","last_active":"2023-09-30T17:05:04.684311+0000","last_peered":"2023-09-30T17:05:04.684311+0000","last_clean":"2023-09-30T17:02:44.410555+0000","last_became_active":"2023-09-30T17:05:04.622264+0000","last_became_peered":"2023-09-30T17:05:04.622264+0000","last_unstale":"2023-09-30T17:05:04.684311+0000","last_undegraded":"2023-09-30T17:05:04.684311+0000","last_fullsized":"2023-09-30T17:05:04.296505+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2888,"log_dups_size":0,"ondisk_log_size":2888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:22:14.097479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8371,"num_write_kb":39716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"59'18","reported_seq":90,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.310314+0000","last_change":"2023-09-30T17:05:03.309295+0000","last_active":"2023-09-30T17:05:03.310314+0000","last_peered":"2023-09-30T17:05:03.310314+0000","last_clean":"2023-09-30T17:05:03.310314+0000","last_became_active":"2023-09-30T17:05:03.308884+0000","last_became_peered":"2023-09-30T17:05:03.308884+0000","last_unstale":"2023-09-30T17:05:03.310314+0000","last_undegraded":"2023-09-30T17:05:03.310314+0000","last_fullsized":"2023-09-30T17:05:03.310314+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:57:45.449671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"59'2855","reported_seq":2916,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.291293+0000","last_change":"2023-09-30T17:05:06.291369+0000","last_active":"2023-09-30T17:05:06.291293+0000","last_peered":"2023-09-30T17:05:06.291293+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:05:06.289447+0000","last_became_peered":"2023-09-30T17:05:06.289447+0000","last_unstale":"2023-09-30T17:05:06.291293+0000","last_undegraded":"2023-09-30T17:05:06.291293+0000","last_fullsized":"2023-09-30T17:05:06.291293+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2855,"log_dups_size":0,"ondisk_log_size":2855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:17:21.412392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8347,"num_write_kb":39608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":63,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.292988+0000","last_change":"2023-09-30T17:02:17.358258+0000","last_active":"2023-09-30T17:05:03.292988+0000","last_peered":"2023-09-30T17:05:03.292988+0000","last_clean":"2023-09-30T17:05:03.292988+0000","last_became_active":"2023-09-30T17:02:17.357890+0000","last_became_peered":"2023-09-30T17:02:17.357890+0000","last_unstale":"2023-09-30T17:05:03.292988+0000","last_undegraded":"2023-09-30T17:05:03.292988+0000","last_fullsized":"2023-09-30T17:05:03.292988+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:52:56.591906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"59'17","reported_seq":89,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.309329+0000","last_change":"2023-09-30T17:05:03.307486+0000","last_active":"2023-09-30T17:05:03.309329+0000","last_peered":"2023-09-30T17:05:03.309329+0000","last_clean":"2023-09-30T17:05:03.309329+0000","last_became_active":"2023-09-30T17:05:03.307012+0000","last_became_peered":"2023-09-30T17:05:03.307012+0000","last_unstale":"2023-09-30T17:05:03.309329+0000","last_undegraded":"2023-09-30T17:05:03.309329+0000","last_fullsized":"2023-09-30T17:05:03.309329+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:05:29.995730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":73,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.310296+0000","last_change":"2023-09-30T17:05:03.309164+0000","last_active":"2023-09-30T17:05:03.310296+0000","last_peered":"2023-09-30T17:05:03.310296+0000","last_clean":"2023-09-30T17:05:03.310296+0000","last_became_active":"2023-09-30T17:05:03.308073+0000","last_became_peered":"2023-09-30T17:05:03.308073+0000","last_unstale":"2023-09-30T17:05:03.310296+0000","last_undegraded":"2023-09-30T17:05:03.310296+0000","last_fullsized":"2023-09-30T17:05:03.310296+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:10:16.238053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"59'6","reported_seq":78,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.309853+0000","last_change":"2023-09-30T17:05:03.308692+0000","last_active":"2023-09-30T17:05:03.309853+0000","last_peered":"2023-09-30T17:05:03.309853+0000","last_clean":"2023-09-30T17:05:03.309853+0000","last_became_active":"2023-09-30T17:05:03.307932+0000","last_became_peered":"2023-09-30T17:05:03.307932+0000","last_unstale":"2023-09-30T17:05:03.309853+0000","last_undegraded":"2023-09-30T17:05:03.309853+0000","last_fullsized":"2023-09-30T17:05:03.309853+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:17:13.668052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":62,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.293753+0000","last_change":"2023-09-30T17:02:17.361000+0000","last_active":"2023-09-30T17:05:03.293753+0000","last_peered":"2023-09-30T17:05:03.293753+0000","last_clean":"2023-09-30T17:05:03.293753+0000","last_became_active":"2023-09-30T17:02:17.360601+0000","last_became_peered":"2023-09-30T17:02:17.360601+0000","last_unstale":"2023-09-30T17:05:03.293753+0000","last_undegraded":"2023-09-30T17:05:03.293753+0000","last_fullsized":"2023-09-30T17:05:03.293753+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:02:27.666526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"59'7","reported_seq":79,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.307828+0000","last_change":"2023-09-30T17:05:03.305898+0000","last_active":"2023-09-30T17:05:03.307828+0000","last_peered":"2023-09-30T17:05:03.307828+0000","last_clean":"2023-09-30T17:05:03.307828+0000","last_became_active":"2023-09-30T17:05:03.305520+0000","last_became_peered":"2023-09-30T17:05:03.305520+0000","last_unstale":"2023-09-30T17:05:03.307828+0000","last_undegraded":"2023-09-30T17:05:03.307828+0000","last_fullsized":"2023-09-30T17:05:03.307828+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:40:09.276369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"58'1","reported_seq":74,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.310300+0000","last_change":"2023-09-30T17:05:03.309303+0000","last_active":"2023-09-30T17:05:03.310300+0000","last_peered":"2023-09-30T17:05:03.310300+0000","last_clean":"2023-09-30T17:05:03.310300+0000","last_became_active":"2023-09-30T17:05:03.308851+0000","last_became_peered":"2023-09-30T17:05:03.308851+0000","last_unstale":"2023-09-30T17:05:03.310300+0000","last_undegraded":"2023-09-30T17:05:03.310300+0000","last_fullsized":"2023-09-30T17:05:03.310300+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:32:55.497287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"59'9","reported_seq":70,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.293329+0000","last_change":"2023-09-30T17:02:18.358841+0000","last_active":"2023-09-30T17:05:03.293329+0000","last_peered":"2023-09-30T17:05:03.293329+0000","last_clean":"2023-09-30T17:05:03.293329+0000","last_became_active":"2023-09-30T17:02:18.358529+0000","last_became_peered":"2023-09-30T17:02:18.358529+0000","last_unstale":"2023-09-30T17:05:03.293329+0000","last_undegraded":"2023-09-30T17:05:03.293329+0000","last_fullsized":"2023-09-30T17:05:03.293329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:15:54.364571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.280731+0000","last_change":"2023-09-30T17:05:03.309409+0000","last_active":"2023-09-30T17:05:05.280731+0000","last_peered":"2023-09-30T17:05:05.280731+0000","last_clean":"2023-09-30T17:05:05.280731+0000","last_became_active":"2023-09-30T17:05:03.309023+0000","last_became_peered":"2023-09-30T17:05:03.309023+0000","last_unstale":"2023-09-30T17:05:05.280731+0000","last_undegraded":"2023-09-30T17:05:05.280731+0000","last_fullsized":"2023-09-30T17:05:05.280731+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:57:05.463330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"59'8526","reported_seq":8592,"reported_epoch":68,"state":"activating+undersized+remapped","last_fresh":"2023-09-30T17:05:04.294458+0000","last_change":"2023-09-30T17:05:04.363997+0000","last_active":"2023-09-30T17:05:02.297380+0000","last_peered":"2023-09-30T17:05:01.286184+0000","last_clean":"2023-09-30T17:02:44.408876+0000","last_became_active":"2023-09-30T17:02:48.271101+0000","last_became_peered":"2023-09-30T17:02:48.271101+0000","last_unstale":"2023-09-30T17:05:04.294458+0000","last_undegraded":"2023-09-30T17:05:04.294458+0000","last_fullsized":"2023-09-30T17:05:04.294458+0000","mapping_epoch":67,"log_start":"49'4300","ondisk_log_start":"49'4300","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4226,"log_dups_size":4300,"ondisk_log_size":4226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:13:34.205219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24873,"num_write_kb":118472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"59'7","reported_seq":85,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.311471+0000","last_change":"2023-09-30T17:05:03.310987+0000","last_active":"2023-09-30T17:05:03.311471+0000","last_peered":"2023-09-30T17:05:03.311471+0000","last_clean":"2023-09-30T17:05:03.311471+0000","last_became_active":"2023-09-30T17:05:03.306646+0000","last_became_peered":"2023-09-30T17:05:03.306646+0000","last_unstale":"2023-09-30T17:05:03.311471+0000","last_undegraded":"2023-09-30T17:05:03.311471+0000","last_fullsized":"2023-09-30T17:05:03.311471+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:24:52.247523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"59'5670","reported_seq":5731,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.293120+0000","last_change":"2023-09-30T17:02:18.359118+0000","last_active":"2023-09-30T17:05:03.293120+0000","last_peered":"2023-09-30T17:05:03.293120+0000","last_clean":"2023-09-30T17:05:03.293120+0000","last_became_active":"2023-09-30T17:02:18.358786+0000","last_became_peered":"2023-09-30T17:02:18.358786+0000","last_unstale":"2023-09-30T17:05:03.293120+0000","last_undegraded":"2023-09-30T17:05:03.293120+0000","last_fullsized":"2023-09-30T17:05:03.293120+0000","mapping_epoch":17,"log_start":"44'1500","ondisk_log_start":"44'1500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4170,"log_dups_size":1500,"ondisk_log_size":4170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:33:21.723864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16627,"num_write_kb":79047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"60'78","reported_seq":43,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.280787+0000","last_change":"2023-09-30T17:05:03.313916+0000","last_active":"2023-09-30T17:05:05.280787+0000","last_peered":"2023-09-30T17:05:05.280787+0000","last_clean":"2023-09-30T17:05:05.280787+0000","last_became_active":"2023-09-30T17:05:03.302516+0000","last_became_peered":"2023-09-30T17:05:03.302516+0000","last_unstale":"2023-09-30T17:05:05.280787+0000","last_undegraded":"2023-09-30T17:05:05.280787+0000","last_fullsized":"2023-09-30T17:05:05.280787+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:00:50.535715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227523,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":222729,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"59'5677","reported_seq":5750,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.289965+0000","last_change":"2023-09-30T17:05:06.289965+0000","last_active":"2023-09-30T17:05:06.289965+0000","last_peered":"2023-09-30T17:05:06.289965+0000","last_clean":"2023-09-30T17:05:06.289965+0000","last_became_active":"2023-09-30T17:05:06.288155+0000","last_became_peered":"2023-09-30T17:05:06.288155+0000","last_unstale":"2023-09-30T17:05:06.289965+0000","last_undegraded":"2023-09-30T17:05:06.289965+0000","last_fullsized":"2023-09-30T17:05:06.289965+0000","mapping_epoch":69,"log_start":"42'1100","ondisk_log_start":"42'1100","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4577,"log_dups_size":1100,"ondisk_log_size":4577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:26:23.188915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16579,"num_write_kb":79104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":26,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.280510+0000","last_change":"2023-09-30T17:05:03.310322+0000","last_active":"2023-09-30T17:05:05.280510+0000","last_peered":"2023-09-30T17:05:05.280510+0000","last_clean":"2023-09-30T17:05:05.280510+0000","last_became_active":"2023-09-30T17:05:03.309505+0000","last_became_peered":"2023-09-30T17:05:03.309505+0000","last_unstale":"2023-09-30T17:05:05.280510+0000","last_undegraded":"2023-09-30T17:05:05.280510+0000","last_fullsized":"2023-09-30T17:05:05.280510+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:13:16.014703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"59'2836","reported_seq":2897,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.295173+0000","last_change":"2023-09-30T17:02:18.360019+0000","last_active":"2023-09-30T17:05:03.295173+0000","last_peered":"2023-09-30T17:05:03.295173+0000","last_clean":"2023-09-30T17:05:03.295173+0000","last_became_active":"2023-09-30T17:02:18.358364+0000","last_became_peered":"2023-09-30T17:02:18.358364+0000","last_unstale":"2023-09-30T17:05:03.295173+0000","last_undegraded":"2023-09-30T17:05:03.295173+0000","last_fullsized":"2023-09-30T17:05:03.295173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2836,"log_dups_size":0,"ondisk_log_size":2836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:30:43.782165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8308,"num_write_kb":39456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":73,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.309897+0000","last_change":"2023-09-30T17:05:03.308853+0000","last_active":"2023-09-30T17:05:03.309897+0000","last_peered":"2023-09-30T17:05:03.309897+0000","last_clean":"2023-09-30T17:05:03.309897+0000","last_became_active":"2023-09-30T17:05:03.308377+0000","last_became_peered":"2023-09-30T17:05:03.308377+0000","last_unstale":"2023-09-30T17:05:03.309897+0000","last_undegraded":"2023-09-30T17:05:03.309897+0000","last_fullsized":"2023-09-30T17:05:03.309897+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:18:42.448826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"59'2856","reported_seq":2917,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.297788+0000","last_change":"2023-09-30T17:02:18.362415+0000","last_active":"2023-09-30T17:05:03.297788+0000","last_peered":"2023-09-30T17:05:03.297788+0000","last_clean":"2023-09-30T17:05:03.297788+0000","last_became_active":"2023-09-30T17:02:18.361556+0000","last_became_peered":"2023-09-30T17:02:18.361556+0000","last_unstale":"2023-09-30T17:05:03.297788+0000","last_undegraded":"2023-09-30T17:05:03.297788+0000","last_fullsized":"2023-09-30T17:05:03.297788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2856,"log_dups_size":0,"ondisk_log_size":2856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:16:41.607547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8321,"num_write_kb":39600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":73,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.305301+0000","last_change":"2023-09-30T17:05:03.304220+0000","last_active":"2023-09-30T17:05:03.305301+0000","last_peered":"2023-09-30T17:05:03.305301+0000","last_clean":"2023-09-30T17:05:03.305301+0000","last_became_active":"2023-09-30T17:05:03.303598+0000","last_became_peered":"2023-09-30T17:05:03.303598+0000","last_unstale":"2023-09-30T17:05:03.305301+0000","last_undegraded":"2023-09-30T17:05:03.305301+0000","last_fullsized":"2023-09-30T17:05:03.305301+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:57:44.444041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"59'12","reported_seq":84,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.314205+0000","last_change":"2023-09-30T17:05:03.313214+0000","last_active":"2023-09-30T17:05:03.314205+0000","last_peered":"2023-09-30T17:05:03.314205+0000","last_clean":"2023-09-30T17:05:03.314205+0000","last_became_active":"2023-09-30T17:05:03.312888+0000","last_became_peered":"2023-09-30T17:05:03.312888+0000","last_unstale":"2023-09-30T17:05:03.314205+0000","last_undegraded":"2023-09-30T17:05:03.314205+0000","last_fullsized":"2023-09-30T17:05:03.314205+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:40:09.276369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"59'9","reported_seq":29,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.282742+0000","last_change":"2023-09-30T17:05:03.304503+0000","last_active":"2023-09-30T17:05:05.282742+0000","last_peered":"2023-09-30T17:05:05.282742+0000","last_clean":"2023-09-30T17:05:05.282742+0000","last_became_active":"2023-09-30T17:05:03.304030+0000","last_became_peered":"2023-09-30T17:05:03.304030+0000","last_unstale":"2023-09-30T17:05:05.282742+0000","last_undegraded":"2023-09-30T17:05:05.282742+0000","last_fullsized":"2023-09-30T17:05:05.282742+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:08:35.110114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"59'2892","reported_seq":2966,"reported_epoch":68,"state":"active+undersized+remapped","last_fresh":"2023-09-30T17:05:04.650226+0000","last_change":"2023-09-30T17:05:04.650394+0000","last_active":"2023-09-30T17:05:04.650226+0000","last_peered":"2023-09-30T17:05:04.650226+0000","last_clean":"2023-09-30T17:02:44.409540+0000","last_became_active":"2023-09-30T17:05:04.626857+0000","last_became_peered":"2023-09-30T17:05:04.626857+0000","last_unstale":"2023-09-30T17:05:04.650226+0000","last_undegraded":"2023-09-30T17:05:04.650226+0000","last_fullsized":"2023-09-30T17:05:04.295690+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2892,"log_dups_size":0,"ondisk_log_size":2892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:22:14.097479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8345,"num_write_kb":39712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":26,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.281280+0000","last_change":"2023-09-30T17:05:03.304339+0000","last_active":"2023-09-30T17:05:05.281280+0000","last_peered":"2023-09-30T17:05:05.281280+0000","last_clean":"2023-09-30T17:05:05.281280+0000","last_became_active":"2023-09-30T17:05:03.303179+0000","last_became_peered":"2023-09-30T17:05:03.303179+0000","last_unstale":"2023-09-30T17:05:05.281280+0000","last_undegraded":"2023-09-30T17:05:05.281280+0000","last_fullsized":"2023-09-30T17:05:05.281280+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:44:20.765682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"59'2861","reported_seq":2927,"reported_epoch":68,"state":"activating+undersized+remapped","last_fresh":"2023-09-30T17:05:04.294000+0000","last_change":"2023-09-30T17:05:04.347702+0000","last_active":"2023-09-30T17:05:02.288537+0000","last_peered":"2023-09-30T17:05:01.285312+0000","last_clean":"2023-09-30T17:02:44.409530+0000","last_became_active":"2023-09-30T17:02:48.271207+0000","last_became_peered":"2023-09-30T17:02:48.271207+0000","last_unstale":"2023-09-30T17:05:04.294000+0000","last_undegraded":"2023-09-30T17:05:04.294000+0000","last_fullsized":"2023-09-30T17:05:04.294000+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2861,"log_dups_size":0,"ondisk_log_size":2861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:09:57.818937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8384,"num_write_kb":39788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":75,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.305282+0000","last_change":"2023-09-30T17:05:03.304232+0000","last_active":"2023-09-30T17:05:03.305282+0000","last_peered":"2023-09-30T17:05:03.305282+0000","last_clean":"2023-09-30T17:05:03.305282+0000","last_became_active":"2023-09-30T17:05:03.303874+0000","last_became_peered":"2023-09-30T17:05:03.303874+0000","last_unstale":"2023-09-30T17:05:03.305282+0000","last_undegraded":"2023-09-30T17:05:03.305282+0000","last_fullsized":"2023-09-30T17:05:03.305282+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:39:49.644290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"59'2","reported_seq":63,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.295036+0000","last_change":"2023-09-30T17:02:18.359767+0000","last_active":"2023-09-30T17:05:03.295036+0000","last_peered":"2023-09-30T17:05:03.295036+0000","last_clean":"2023-09-30T17:05:03.295036+0000","last_became_active":"2023-09-30T17:02:18.356825+0000","last_became_peered":"2023-09-30T17:02:18.356825+0000","last_unstale":"2023-09-30T17:05:03.295036+0000","last_undegraded":"2023-09-30T17:05:03.295036+0000","last_fullsized":"2023-09-30T17:05:03.295036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:39:16.689300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":26,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.280710+0000","last_change":"2023-09-30T17:05:03.305087+0000","last_active":"2023-09-30T17:05:05.280710+0000","last_peered":"2023-09-30T17:05:05.280710+0000","last_clean":"2023-09-30T17:05:05.280710+0000","last_became_active":"2023-09-30T17:05:03.304463+0000","last_became_peered":"2023-09-30T17:05:03.304463+0000","last_unstale":"2023-09-30T17:05:05.280710+0000","last_undegraded":"2023-09-30T17:05:05.280710+0000","last_fullsized":"2023-09-30T17:05:05.280710+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:33:20.829898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"59'2835","reported_seq":2897,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.289598+0000","last_change":"2023-09-30T17:05:06.289598+0000","last_active":"2023-09-30T17:05:06.289598+0000","last_peered":"2023-09-30T17:05:06.289598+0000","last_clean":"2023-09-30T17:05:06.289598+0000","last_became_active":"2023-09-30T17:05:06.288712+0000","last_became_peered":"2023-09-30T17:05:06.288712+0000","last_unstale":"2023-09-30T17:05:06.289598+0000","last_undegraded":"2023-09-30T17:05:06.289598+0000","last_fullsized":"2023-09-30T17:05:06.289598+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2835,"log_dups_size":0,"ondisk_log_size":2835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:01:17.676791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8288,"num_write_kb":39388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.282725+0000","last_change":"2023-09-30T17:05:03.311500+0000","last_active":"2023-09-30T17:05:05.282725+0000","last_peered":"2023-09-30T17:05:05.282725+0000","last_clean":"2023-09-30T17:05:05.282725+0000","last_became_active":"2023-09-30T17:05:03.310836+0000","last_became_peered":"2023-09-30T17:05:03.310836+0000","last_unstale":"2023-09-30T17:05:05.282725+0000","last_undegraded":"2023-09-30T17:05:05.282725+0000","last_fullsized":"2023-09-30T17:05:05.282725+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:30:09.762284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"59'8","reported_seq":80,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.310264+0000","last_change":"2023-09-30T17:05:03.308917+0000","last_active":"2023-09-30T17:05:03.310264+0000","last_peered":"2023-09-30T17:05:03.310264+0000","last_clean":"2023-09-30T17:05:03.310264+0000","last_became_active":"2023-09-30T17:05:03.308214+0000","last_became_peered":"2023-09-30T17:05:03.308214+0000","last_unstale":"2023-09-30T17:05:03.310264+0000","last_undegraded":"2023-09-30T17:05:03.310264+0000","last_fullsized":"2023-09-30T17:05:03.310264+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:39:50.649920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"58'3","reported_seq":77,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.309904+0000","last_change":"2023-09-30T17:05:03.308944+0000","last_active":"2023-09-30T17:05:03.309904+0000","last_peered":"2023-09-30T17:05:03.309904+0000","last_clean":"2023-09-30T17:05:03.309904+0000","last_became_active":"2023-09-30T17:05:03.308483+0000","last_became_peered":"2023-09-30T17:05:03.308483+0000","last_unstale":"2023-09-30T17:05:03.309904+0000","last_undegraded":"2023-09-30T17:05:03.309904+0000","last_fullsized":"2023-09-30T17:05:03.309904+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:43:27.633747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"59'2846","reported_seq":2907,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.290255+0000","last_change":"2023-09-30T17:05:06.290255+0000","last_active":"2023-09-30T17:05:06.290255+0000","last_peered":"2023-09-30T17:05:06.290255+0000","last_clean":"2023-09-30T17:05:06.290255+0000","last_became_active":"2023-09-30T17:05:06.289225+0000","last_became_peered":"2023-09-30T17:05:06.289225+0000","last_unstale":"2023-09-30T17:05:06.290255+0000","last_undegraded":"2023-09-30T17:05:06.290255+0000","last_fullsized":"2023-09-30T17:05:06.290255+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2846,"log_dups_size":0,"ondisk_log_size":2846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:41:31.424933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8199,"num_write_kb":39160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.280395+0000","last_change":"2023-09-30T17:05:03.309689+0000","last_active":"2023-09-30T17:05:05.280395+0000","last_peered":"2023-09-30T17:05:05.280395+0000","last_clean":"2023-09-30T17:05:05.280395+0000","last_became_active":"2023-09-30T17:05:03.309318+0000","last_became_peered":"2023-09-30T17:05:03.309318+0000","last_unstale":"2023-09-30T17:05:05.280395+0000","last_undegraded":"2023-09-30T17:05:05.280395+0000","last_fullsized":"2023-09-30T17:05:05.280395+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:12:37.857480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"59'2831","reported_seq":2892,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.289189+0000","last_change":"2023-09-30T17:05:06.289189+0000","last_active":"2023-09-30T17:05:06.289189+0000","last_peered":"2023-09-30T17:05:06.289189+0000","last_clean":"2023-09-30T17:05:06.289189+0000","last_became_active":"2023-09-30T17:05:06.288348+0000","last_became_peered":"2023-09-30T17:05:06.288348+0000","last_unstale":"2023-09-30T17:05:06.289189+0000","last_undegraded":"2023-09-30T17:05:06.289189+0000","last_fullsized":"2023-09-30T17:05:06.289189+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2831,"log_dups_size":0,"ondisk_log_size":2831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:51:59.540252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8336,"num_write_kb":39484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":73,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.305277+0000","last_change":"2023-09-30T17:05:03.304019+0000","last_active":"2023-09-30T17:05:03.305277+0000","last_peered":"2023-09-30T17:05:03.305277+0000","last_clean":"2023-09-30T17:05:03.305277+0000","last_became_active":"2023-09-30T17:05:03.303473+0000","last_became_peered":"2023-09-30T17:05:03.303473+0000","last_unstale":"2023-09-30T17:05:03.305277+0000","last_undegraded":"2023-09-30T17:05:03.305277+0000","last_fullsized":"2023-09-30T17:05:03.305277+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:10:16.238053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"59'2884","reported_seq":2945,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.289446+0000","last_change":"2023-09-30T17:05:06.289446+0000","last_active":"2023-09-30T17:05:06.289446+0000","last_peered":"2023-09-30T17:05:06.289446+0000","last_clean":"2023-09-30T17:05:06.289446+0000","last_became_active":"2023-09-30T17:05:06.288169+0000","last_became_peered":"2023-09-30T17:05:06.288169+0000","last_unstale":"2023-09-30T17:05:06.289446+0000","last_undegraded":"2023-09-30T17:05:06.289446+0000","last_fullsized":"2023-09-30T17:05:06.289446+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2884,"log_dups_size":0,"ondisk_log_size":2884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:15:23.507816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8366,"num_write_kb":39744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":62,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.293603+0000","last_change":"2023-09-30T17:02:17.358811+0000","last_active":"2023-09-30T17:05:03.293603+0000","last_peered":"2023-09-30T17:05:03.293603+0000","last_clean":"2023-09-30T17:05:03.293603+0000","last_became_active":"2023-09-30T17:02:17.358582+0000","last_became_peered":"2023-09-30T17:02:17.358582+0000","last_unstale":"2023-09-30T17:05:03.293603+0000","last_undegraded":"2023-09-30T17:05:03.293603+0000","last_fullsized":"2023-09-30T17:05:03.293603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:52:37.518693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"59'8580","reported_seq":8641,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.294204+0000","last_change":"2023-09-30T17:02:18.364478+0000","last_active":"2023-09-30T17:05:03.294204+0000","last_peered":"2023-09-30T17:05:03.294204+0000","last_clean":"2023-09-30T17:05:03.294204+0000","last_became_active":"2023-09-30T17:02:18.364057+0000","last_became_peered":"2023-09-30T17:02:18.364057+0000","last_unstale":"2023-09-30T17:05:03.294204+0000","last_undegraded":"2023-09-30T17:05:03.294204+0000","last_fullsized":"2023-09-30T17:05:03.294204+0000","mapping_epoch":17,"log_start":"49'4400","ondisk_log_start":"49'4400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4180,"log_dups_size":4400,"ondisk_log_size":4180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:13:55.555700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25046,"num_write_kb":118972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":65,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.294666+0000","last_change":"2023-09-30T17:02:12.327704+0000","last_active":"2023-09-30T17:05:03.294666+0000","last_peered":"2023-09-30T17:05:03.294666+0000","last_clean":"2023-09-30T17:05:03.294666+0000","last_became_active":"2023-09-30T17:02:12.327384+0000","last_became_peered":"2023-09-30T17:02:12.327384+0000","last_unstale":"2023-09-30T17:05:03.294666+0000","last_undegraded":"2023-09-30T17:05:03.294666+0000","last_fullsized":"2023-09-30T17:05:03.294666+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:09:34.818252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.283769+0000","last_change":"2023-09-30T17:05:03.311271+0000","last_active":"2023-09-30T17:05:05.283769+0000","last_peered":"2023-09-30T17:05:05.283769+0000","last_clean":"2023-09-30T17:05:05.283769+0000","last_became_active":"2023-09-30T17:05:03.310655+0000","last_became_peered":"2023-09-30T17:05:03.310655+0000","last_unstale":"2023-09-30T17:05:05.283769+0000","last_undegraded":"2023-09-30T17:05:05.283769+0000","last_fullsized":"2023-09-30T17:05:05.283769+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:49:35.748952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"59'9","reported_seq":81,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.307847+0000","last_change":"2023-09-30T17:05:03.306223+0000","last_active":"2023-09-30T17:05:03.307847+0000","last_peered":"2023-09-30T17:05:03.307847+0000","last_clean":"2023-09-30T17:05:03.307847+0000","last_became_active":"2023-09-30T17:05:03.305956+0000","last_became_peered":"2023-09-30T17:05:03.305956+0000","last_unstale":"2023-09-30T17:05:03.307847+0000","last_undegraded":"2023-09-30T17:05:03.307847+0000","last_fullsized":"2023-09-30T17:05:03.307847+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:32:56.502917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.280424+0000","last_change":"2023-09-30T17:05:03.309359+0000","last_active":"2023-09-30T17:05:05.280424+0000","last_peered":"2023-09-30T17:05:05.280424+0000","last_clean":"2023-09-30T17:05:05.280424+0000","last_became_active":"2023-09-30T17:05:03.308944+0000","last_became_peered":"2023-09-30T17:05:03.308944+0000","last_unstale":"2023-09-30T17:05:05.280424+0000","last_undegraded":"2023-09-30T17:05:05.280424+0000","last_fullsized":"2023-09-30T17:05:05.280424+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:02:58.156693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.284199+0000","last_change":"2023-09-30T17:05:03.311106+0000","last_active":"2023-09-30T17:05:05.284199+0000","last_peered":"2023-09-30T17:05:05.284199+0000","last_clean":"2023-09-30T17:05:05.284199+0000","last_became_active":"2023-09-30T17:05:03.310706+0000","last_became_peered":"2023-09-30T17:05:03.310706+0000","last_unstale":"2023-09-30T17:05:05.284199+0000","last_undegraded":"2023-09-30T17:05:05.284199+0000","last_fullsized":"2023-09-30T17:05:05.284199+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:04:03.231664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"59'9","reported_seq":70,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.294333+0000","last_change":"2023-09-30T17:02:18.363399+0000","last_active":"2023-09-30T17:05:03.294333+0000","last_peered":"2023-09-30T17:05:03.294333+0000","last_clean":"2023-09-30T17:05:03.294333+0000","last_became_active":"2023-09-30T17:02:18.363064+0000","last_became_peered":"2023-09-30T17:02:18.363064+0000","last_unstale":"2023-09-30T17:05:03.294333+0000","last_undegraded":"2023-09-30T17:05:03.294333+0000","last_fullsized":"2023-09-30T17:05:03.294333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:32:34.654264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":65,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.293056+0000","last_change":"2023-09-30T17:02:12.327834+0000","last_active":"2023-09-30T17:05:03.293056+0000","last_peered":"2023-09-30T17:05:03.293056+0000","last_clean":"2023-09-30T17:05:03.293056+0000","last_became_active":"2023-09-30T17:02:12.327542+0000","last_became_peered":"2023-09-30T17:02:12.327542+0000","last_unstale":"2023-09-30T17:05:03.293056+0000","last_undegraded":"2023-09-30T17:05:03.293056+0000","last_fullsized":"2023-09-30T17:05:03.293056+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:49:54.890769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":73,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.307435+0000","last_change":"2023-09-30T17:05:03.305668+0000","last_active":"2023-09-30T17:05:03.307435+0000","last_peered":"2023-09-30T17:05:03.307435+0000","last_clean":"2023-09-30T17:05:03.307435+0000","last_became_active":"2023-09-30T17:05:03.305222+0000","last_became_peered":"2023-09-30T17:05:03.305222+0000","last_unstale":"2023-09-30T17:05:03.307435+0000","last_undegraded":"2023-09-30T17:05:03.307435+0000","last_fullsized":"2023-09-30T17:05:03.307435+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:17:12.662422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"59'6","reported_seq":67,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.295500+0000","last_change":"2023-09-30T17:02:18.364406+0000","last_active":"2023-09-30T17:05:03.295500+0000","last_peered":"2023-09-30T17:05:03.295500+0000","last_clean":"2023-09-30T17:05:03.295500+0000","last_became_active":"2023-09-30T17:02:18.363849+0000","last_became_peered":"2023-09-30T17:02:18.363849+0000","last_unstale":"2023-09-30T17:05:03.295500+0000","last_undegraded":"2023-09-30T17:05:03.295500+0000","last_fullsized":"2023-09-30T17:05:03.295500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:43:29.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.280604+0000","last_change":"2023-09-30T17:05:03.310062+0000","last_active":"2023-09-30T17:05:05.280604+0000","last_peered":"2023-09-30T17:05:05.280604+0000","last_clean":"2023-09-30T17:05:05.280604+0000","last_became_active":"2023-09-30T17:05:03.308958+0000","last_became_peered":"2023-09-30T17:05:03.308958+0000","last_unstale":"2023-09-30T17:05:05.280604+0000","last_undegraded":"2023-09-30T17:05:05.280604+0000","last_fullsized":"2023-09-30T17:05:05.280604+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:05:26.347633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":219,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.282381+0000","last_change":"2023-09-30T17:05:03.303046+0000","last_active":"2023-09-30T17:05:05.282381+0000","last_peered":"2023-09-30T17:05:05.282381+0000","last_clean":"2023-09-30T17:05:05.282381+0000","last_became_active":"2023-09-30T17:05:03.302265+0000","last_became_peered":"2023-09-30T17:05:03.302265+0000","last_unstale":"2023-09-30T17:05:05.282381+0000","last_undegraded":"2023-09-30T17:05:05.282381+0000","last_fullsized":"2023-09-30T17:05:05.282381+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:06.295501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:06.295501+0000","last_clean_scrub_stamp":"2023-09-30T17:02:06.295501+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:07:24.603358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":62,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.293005+0000","last_change":"2023-09-30T17:02:17.357139+0000","last_active":"2023-09-30T17:05:03.293005+0000","last_peered":"2023-09-30T17:05:03.293005+0000","last_clean":"2023-09-30T17:05:03.293005+0000","last_became_active":"2023-09-30T17:02:17.356901+0000","last_became_peered":"2023-09-30T17:02:17.356901+0000","last_unstale":"2023-09-30T17:05:03.293005+0000","last_undegraded":"2023-09-30T17:05:03.293005+0000","last_fullsized":"2023-09-30T17:05:03.293005+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:22:35.747671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"59'7","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.281124+0000","last_change":"2023-09-30T17:05:03.305199+0000","last_active":"2023-09-30T17:05:05.281124+0000","last_peered":"2023-09-30T17:05:05.281124+0000","last_clean":"2023-09-30T17:05:05.281124+0000","last_became_active":"2023-09-30T17:05:03.304974+0000","last_became_peered":"2023-09-30T17:05:03.304974+0000","last_unstale":"2023-09-30T17:05:05.281124+0000","last_undegraded":"2023-09-30T17:05:05.281124+0000","last_fullsized":"2023-09-30T17:05:05.281124+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:03:27.429545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.282624+0000","last_change":"2023-09-30T17:05:03.303739+0000","last_active":"2023-09-30T17:05:05.282624+0000","last_peered":"2023-09-30T17:05:05.282624+0000","last_clean":"2023-09-30T17:05:05.282624+0000","last_became_active":"2023-09-30T17:05:03.302590+0000","last_became_peered":"2023-09-30T17:05:03.302590+0000","last_unstale":"2023-09-30T17:05:05.282624+0000","last_undegraded":"2023-09-30T17:05:05.282624+0000","last_fullsized":"2023-09-30T17:05:05.282624+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:51:30.199616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"59'5","reported_seq":86,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.318953+0000","last_change":"2023-09-30T17:05:03.318439+0000","last_active":"2023-09-30T17:05:03.318953+0000","last_peered":"2023-09-30T17:05:03.318953+0000","last_clean":"2023-09-30T17:05:03.318953+0000","last_became_active":"2023-09-30T17:05:03.308059+0000","last_became_peered":"2023-09-30T17:05:03.308059+0000","last_unstale":"2023-09-30T17:05:03.318953+0000","last_undegraded":"2023-09-30T17:05:03.318953+0000","last_fullsized":"2023-09-30T17:05:03.318953+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:16:25.170638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"59'11252","reported_seq":11313,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.296974+0000","last_change":"2023-09-30T17:02:18.360029+0000","last_active":"2023-09-30T17:05:03.296974+0000","last_peered":"2023-09-30T17:05:03.296974+0000","last_clean":"2023-09-30T17:05:03.296974+0000","last_became_active":"2023-09-30T17:02:18.356839+0000","last_became_peered":"2023-09-30T17:02:18.356839+0000","last_unstale":"2023-09-30T17:05:03.296974+0000","last_undegraded":"2023-09-30T17:05:03.296974+0000","last_fullsized":"2023-09-30T17:05:03.296974+0000","mapping_epoch":17,"log_start":"51'6700","ondisk_log_start":"51'6700","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4552,"log_dups_size":6700,"ondisk_log_size":4552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:16:27.516884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33068,"num_write_kb":157144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":65,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.297064+0000","last_change":"2023-09-30T17:02:12.330472+0000","last_active":"2023-09-30T17:05:03.297064+0000","last_peered":"2023-09-30T17:05:03.297064+0000","last_clean":"2023-09-30T17:05:03.297064+0000","last_became_active":"2023-09-30T17:02:12.330154+0000","last_became_peered":"2023-09-30T17:02:12.330154+0000","last_unstale":"2023-09-30T17:05:03.297064+0000","last_undegraded":"2023-09-30T17:05:03.297064+0000","last_fullsized":"2023-09-30T17:05:03.297064+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:43:23.161734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":62,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.304831+0000","last_change":"2023-09-30T17:02:17.361007+0000","last_active":"2023-09-30T17:05:03.304831+0000","last_peered":"2023-09-30T17:05:03.304831+0000","last_clean":"2023-09-30T17:05:03.304831+0000","last_became_active":"2023-09-30T17:02:17.360721+0000","last_became_peered":"2023-09-30T17:02:17.360721+0000","last_unstale":"2023-09-30T17:05:03.304831+0000","last_undegraded":"2023-09-30T17:05:03.304831+0000","last_fullsized":"2023-09-30T17:05:03.304831+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:13:41.205152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"59'2836","reported_seq":2910,"reported_epoch":68,"state":"active+undersized+remapped","last_fresh":"2023-09-30T17:05:04.642669+0000","last_change":"2023-09-30T17:05:04.642880+0000","last_active":"2023-09-30T17:05:04.642669+0000","last_peered":"2023-09-30T17:05:04.642669+0000","last_clean":"2023-09-30T17:02:44.410053+0000","last_became_active":"2023-09-30T17:05:04.617448+0000","last_became_peered":"2023-09-30T17:05:04.617448+0000","last_unstale":"2023-09-30T17:05:04.642669+0000","last_undegraded":"2023-09-30T17:05:04.642669+0000","last_fullsized":"2023-09-30T17:05:04.295696+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2836,"log_dups_size":0,"ondisk_log_size":2836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:53:07.255711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8199,"num_write_kb":39048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"59'3","reported_seq":65,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.294146+0000","last_change":"2023-09-30T17:02:17.360831+0000","last_active":"2023-09-30T17:05:03.294146+0000","last_peered":"2023-09-30T17:05:03.294146+0000","last_clean":"2023-09-30T17:05:03.294146+0000","last_became_active":"2023-09-30T17:02:17.360494+0000","last_became_peered":"2023-09-30T17:02:17.360494+0000","last_unstale":"2023-09-30T17:05:03.294146+0000","last_undegraded":"2023-09-30T17:05:03.294146+0000","last_fullsized":"2023-09-30T17:05:03.294146+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:24:04.564387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":65,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.298199+0000","last_change":"2023-09-30T17:02:12.328184+0000","last_active":"2023-09-30T17:05:03.298199+0000","last_peered":"2023-09-30T17:05:03.298199+0000","last_clean":"2023-09-30T17:05:03.298199+0000","last_became_active":"2023-09-30T17:02:12.327898+0000","last_became_peered":"2023-09-30T17:02:12.327898+0000","last_unstale":"2023-09-30T17:05:03.298199+0000","last_undegraded":"2023-09-30T17:05:03.298199+0000","last_fullsized":"2023-09-30T17:05:03.298199+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:43:23.161734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"59'8","reported_seq":80,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.309894+0000","last_change":"2023-09-30T17:05:03.308856+0000","last_active":"2023-09-30T17:05:03.309894+0000","last_peered":"2023-09-30T17:05:03.309894+0000","last_clean":"2023-09-30T17:05:03.309894+0000","last_became_active":"2023-09-30T17:05:03.308429+0000","last_became_peered":"2023-09-30T17:05:03.308429+0000","last_unstale":"2023-09-30T17:05:03.309894+0000","last_undegraded":"2023-09-30T17:05:03.309894+0000","last_fullsized":"2023-09-30T17:05:03.309894+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:49:32.189339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.281043+0000","last_change":"2023-09-30T17:05:03.304353+0000","last_active":"2023-09-30T17:05:05.281043+0000","last_peered":"2023-09-30T17:05:05.281043+0000","last_clean":"2023-09-30T17:05:05.281043+0000","last_became_active":"2023-09-30T17:05:03.302503+0000","last_became_peered":"2023-09-30T17:05:03.302503+0000","last_unstale":"2023-09-30T17:05:05.281043+0000","last_undegraded":"2023-09-30T17:05:05.281043+0000","last_fullsized":"2023-09-30T17:05:05.281043+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:19:16.151598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"60'8","reported_seq":86,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.315262+0000","last_change":"2023-09-30T17:05:03.314806+0000","last_active":"2023-09-30T17:05:03.315262+0000","last_peered":"2023-09-30T17:05:03.315262+0000","last_clean":"2023-09-30T17:05:03.315262+0000","last_became_active":"2023-09-30T17:05:03.308201+0000","last_became_peered":"2023-09-30T17:05:03.308201+0000","last_unstale":"2023-09-30T17:05:03.315262+0000","last_undegraded":"2023-09-30T17:05:03.315262+0000","last_fullsized":"2023-09-30T17:05:03.315262+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:19:18.486570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"59'6","reported_seq":78,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.305327+0000","last_change":"2023-09-30T17:05:03.304265+0000","last_active":"2023-09-30T17:05:03.305327+0000","last_peered":"2023-09-30T17:05:03.305327+0000","last_clean":"2023-09-30T17:05:03.305327+0000","last_became_active":"2023-09-30T17:05:03.304022+0000","last_became_peered":"2023-09-30T17:05:03.304022+0000","last_unstale":"2023-09-30T17:05:03.305327+0000","last_undegraded":"2023-09-30T17:05:03.305327+0000","last_fullsized":"2023-09-30T17:05:03.305327+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:19:19.492200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":74,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.305185+0000","last_change":"2023-09-30T17:05:03.303927+0000","last_active":"2023-09-30T17:05:03.305185+0000","last_peered":"2023-09-30T17:05:03.305185+0000","last_clean":"2023-09-30T17:05:03.305185+0000","last_became_active":"2023-09-30T17:05:03.303487+0000","last_became_peered":"2023-09-30T17:05:03.303487+0000","last_unstale":"2023-09-30T17:05:03.305185+0000","last_undegraded":"2023-09-30T17:05:03.305185+0000","last_fullsized":"2023-09-30T17:05:03.305185+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:43:27.633747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"59'2835","reported_seq":2896,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.295442+0000","last_change":"2023-09-30T17:02:18.358269+0000","last_active":"2023-09-30T17:05:03.295442+0000","last_peered":"2023-09-30T17:05:03.295442+0000","last_clean":"2023-09-30T17:05:03.295442+0000","last_became_active":"2023-09-30T17:02:18.356902+0000","last_became_peered":"2023-09-30T17:02:18.356902+0000","last_unstale":"2023-09-30T17:05:03.295442+0000","last_undegraded":"2023-09-30T17:05:03.295442+0000","last_fullsized":"2023-09-30T17:05:03.295442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2835,"log_dups_size":0,"ondisk_log_size":2835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:39:28.022201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8302,"num_write_kb":39500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":26,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.284119+0000","last_change":"2023-09-30T17:05:03.311401+0000","last_active":"2023-09-30T17:05:05.284119+0000","last_peered":"2023-09-30T17:05:05.284119+0000","last_clean":"2023-09-30T17:05:05.284119+0000","last_became_active":"2023-09-30T17:05:03.310996+0000","last_became_peered":"2023-09-30T17:05:03.310996+0000","last_unstale":"2023-09-30T17:05:05.284119+0000","last_undegraded":"2023-09-30T17:05:05.284119+0000","last_fullsized":"2023-09-30T17:05:05.284119+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:28:19.097868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"59'2848","reported_seq":2908,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.290586+0000","last_change":"2023-09-30T17:05:06.290662+0000","last_active":"2023-09-30T17:05:06.290586+0000","last_peered":"2023-09-30T17:05:06.290586+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:05:06.289599+0000","last_became_peered":"2023-09-30T17:05:06.289599+0000","last_unstale":"2023-09-30T17:05:06.290586+0000","last_undegraded":"2023-09-30T17:05:06.290586+0000","last_fullsized":"2023-09-30T17:05:06.290586+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2848,"log_dups_size":0,"ondisk_log_size":2848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:20:28.670256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8235,"num_write_kb":39276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"58'3","reported_seq":77,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.309314+0000","last_change":"2023-09-30T17:05:03.307212+0000","last_active":"2023-09-30T17:05:03.309314+0000","last_peered":"2023-09-30T17:05:03.309314+0000","last_clean":"2023-09-30T17:05:03.309314+0000","last_became_active":"2023-09-30T17:05:03.306711+0000","last_became_peered":"2023-09-30T17:05:03.306711+0000","last_unstale":"2023-09-30T17:05:03.309314+0000","last_undegraded":"2023-09-30T17:05:03.309314+0000","last_fullsized":"2023-09-30T17:05:03.309314+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:11:56.900744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"59'10","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.282885+0000","last_change":"2023-09-30T17:05:03.311669+0000","last_active":"2023-09-30T17:05:05.282885+0000","last_peered":"2023-09-30T17:05:05.282885+0000","last_clean":"2023-09-30T17:05:05.282885+0000","last_became_active":"2023-09-30T17:05:03.310763+0000","last_became_peered":"2023-09-30T17:05:03.310763+0000","last_unstale":"2023-09-30T17:05:05.282885+0000","last_undegraded":"2023-09-30T17:05:05.282885+0000","last_fullsized":"2023-09-30T17:05:05.282885+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:36:53.333402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":63,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.298122+0000","last_change":"2023-09-30T17:02:17.360802+0000","last_active":"2023-09-30T17:05:03.298122+0000","last_peered":"2023-09-30T17:05:03.298122+0000","last_clean":"2023-09-30T17:05:03.298122+0000","last_became_active":"2023-09-30T17:02:17.360475+0000","last_became_peered":"2023-09-30T17:02:17.360475+0000","last_unstale":"2023-09-30T17:05:03.298122+0000","last_undegraded":"2023-09-30T17:05:03.298122+0000","last_fullsized":"2023-09-30T17:05:03.298122+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:50:18.455188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"59'5711","reported_seq":5772,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.295234+0000","last_change":"2023-09-30T17:02:18.359857+0000","last_active":"2023-09-30T17:05:03.295234+0000","last_peered":"2023-09-30T17:05:03.295234+0000","last_clean":"2023-09-30T17:05:03.295234+0000","last_became_active":"2023-09-30T17:02:18.357098+0000","last_became_peered":"2023-09-30T17:02:18.357098+0000","last_unstale":"2023-09-30T17:05:03.295234+0000","last_undegraded":"2023-09-30T17:05:03.295234+0000","last_fullsized":"2023-09-30T17:05:03.295234+0000","mapping_epoch":17,"log_start":"42'1200","ondisk_log_start":"42'1200","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4511,"log_dups_size":1200,"ondisk_log_size":4511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:48:17.598726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16681,"num_write_kb":79476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":77,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.314213+0000","last_change":"2023-09-30T17:05:03.313345+0000","last_active":"2023-09-30T17:05:03.314213+0000","last_peered":"2023-09-30T17:05:03.314213+0000","last_clean":"2023-09-30T17:05:03.314213+0000","last_became_active":"2023-09-30T17:05:03.313050+0000","last_became_peered":"2023-09-30T17:05:03.313050+0000","last_unstale":"2023-09-30T17:05:03.314213+0000","last_undegraded":"2023-09-30T17:05:03.314213+0000","last_fullsized":"2023-09-30T17:05:03.314213+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:24:52.247523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"59'2872","reported_seq":2933,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.290298+0000","last_change":"2023-09-30T17:05:06.290298+0000","last_active":"2023-09-30T17:05:06.290298+0000","last_peered":"2023-09-30T17:05:06.290298+0000","last_clean":"2023-09-30T17:05:06.290298+0000","last_became_active":"2023-09-30T17:05:06.289197+0000","last_became_peered":"2023-09-30T17:05:06.289197+0000","last_unstale":"2023-09-30T17:05:06.290298+0000","last_undegraded":"2023-09-30T17:05:06.290298+0000","last_fullsized":"2023-09-30T17:05:06.290298+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2872,"log_dups_size":0,"ondisk_log_size":2872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:57:10.410506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8447,"num_write_kb":40072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"59'9","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.282853+0000","last_change":"2023-09-30T17:05:03.310950+0000","last_active":"2023-09-30T17:05:05.282853+0000","last_peered":"2023-09-30T17:05:05.282853+0000","last_clean":"2023-09-30T17:05:05.282853+0000","last_became_active":"2023-09-30T17:05:03.310591+0000","last_became_peered":"2023-09-30T17:05:03.310591+0000","last_unstale":"2023-09-30T17:05:05.282853+0000","last_undegraded":"2023-09-30T17:05:05.282853+0000","last_fullsized":"2023-09-30T17:05:05.282853+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:26:23.194138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"59'13","reported_seq":74,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.292739+0000","last_change":"2023-09-30T17:02:18.363479+0000","last_active":"2023-09-30T17:05:03.292739+0000","last_peered":"2023-09-30T17:05:03.292739+0000","last_clean":"2023-09-30T17:05:03.292739+0000","last_became_active":"2023-09-30T17:02:18.363222+0000","last_became_peered":"2023-09-30T17:02:18.363222+0000","last_unstale":"2023-09-30T17:05:03.292739+0000","last_undegraded":"2023-09-30T17:05:03.292739+0000","last_fullsized":"2023-09-30T17:05:03.292739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:09:55.056098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"59'2796","reported_seq":2866,"reported_epoch":68,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2023-09-30T17:05:04.682115+0000","last_change":"2023-09-30T17:05:04.682273+0000","last_active":"2023-09-30T17:05:04.682115+0000","last_peered":"2023-09-30T17:05:04.682115+0000","last_clean":"2023-09-30T17:02:44.410028+0000","last_became_active":"2023-09-30T17:05:04.681285+0000","last_became_peered":"2023-09-30T17:05:04.681285+0000","last_unstale":"2023-09-30T17:05:04.682115+0000","last_undegraded":"2023-09-30T17:05:04.356486+0000","last_fullsized":"2023-09-30T17:05:04.343762+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2796,"log_dups_size":0,"ondisk_log_size":2796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:00:48.822153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8138,"num_write_kb":38784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"59'2852","reported_seq":2913,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.293972+0000","last_change":"2023-09-30T17:02:18.363216+0000","last_active":"2023-09-30T17:05:03.293972+0000","last_peered":"2023-09-30T17:05:03.293972+0000","last_clean":"2023-09-30T17:05:03.293972+0000","last_became_active":"2023-09-30T17:02:18.362894+0000","last_became_peered":"2023-09-30T17:02:18.362894+0000","last_unstale":"2023-09-30T17:05:03.293972+0000","last_undegraded":"2023-09-30T17:05:03.293972+0000","last_fullsized":"2023-09-30T17:05:03.293972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2852,"log_dups_size":0,"ondisk_log_size":2852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:30:43.782165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8357,"num_write_kb":39780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"59'2874","reported_seq":2944,"reported_epoch":68,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2023-09-30T17:05:04.685576+0000","last_change":"2023-09-30T17:05:04.685685+0000","last_active":"2023-09-30T17:05:04.685576+0000","last_peered":"2023-09-30T17:05:04.685576+0000","last_clean":"2023-09-30T17:02:44.410264+0000","last_became_active":"2023-09-30T17:05:04.684696+0000","last_became_peered":"2023-09-30T17:05:04.684696+0000","last_unstale":"2023-09-30T17:05:04.685576+0000","last_undegraded":"2023-09-30T17:05:04.350239+0000","last_fullsized":"2023-09-30T17:05:04.296131+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2874,"log_dups_size":0,"ondisk_log_size":2874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:13:34.205219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8465,"num_write_kb":40104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":532685,"num_write_kb":2575302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140940,"ondisk_log_size":140940,"up":128,"acting":118,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":228927,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":137,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":223425,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":524288,"data_stored":457854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":66,"seq":283467841538,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46988,"kb_used_data":1404,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94324852,"statfs":{"total":96636764160,"available":96588648448,"internally_reserved":0,"allocated":1437696,"data_stored":1094369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7139,"internal_metadata":46654493},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738407,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":582384,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":580990,"kb_avail":93789456,"statfs":{"total":96636764160,"available":96040402944,"internally_reserved":0,"allocated":1404928,"data_stored":1083533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":594934214},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 17:04:07 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46899999999999997,"15min":0.47299999999999998},"min":{"1min":0.21299999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.42499999999999999,"15min":0.437},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.59299999999999997,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.51600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]}]},{"osd":1,"up_from":8,"seq":34359738407,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":563528,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":562942,"kb_avail":93808312,"statfs":{"total":96636764160,"available":96059711488,"internally_reserved":0,"allocated":585728,"data_stored":271543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":576453062},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 17:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.432,"15min":0.438},"min":{"1min":0.17100000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":1.831,"5min":1.831,"15min":1.831},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.46600000000000003,"15min":0.44500000000000001},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":2.5430000000000001,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":0.32800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":249856,"data_stored":227705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":228927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T17:05:10.074 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-09-30T17:05:10.527 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:05:10.527 INFO:teuthology.orchestra.run.smithi007.stdout:{"fsid":"68daccc3-6ea9-4db7-9771-3803ff202df8","health":{"status":"HEALTH_WARN","checks":{"PG_DEGRADED":{"severity":"HEALTH_WARN","summary":{"message":"Degraded data redundancy: 6/50 objects degraded (12.000%), 4 pgs degraded","count":4},"muted":false}},"mutes":[]},"election_epoch":6,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":195,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":70,"num_osds":3,"num_up_osds":3,"osd_up_since":1696093502,"num_in_osds":3,"osd_in_since":1696093316,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":95},{"state_name":"active+recovery_wait+undersized+degraded+remapped","count":4},{"state_name":"active+undersized+remapped","count":3},{"state_name":"activating+undersized+remapped","count":3}],"num_pgs":105,"num_pools":4,"num_objects":25,"data_bytes":819295,"bytes_used":1221529600,"bytes_avail":288688762880,"bytes_total":289910292480,"inactive_pgs_ratio":0.02857142873108387,"degraded_objects":6,"degraded_total":50,"degraded_ratio":0.12,"recovering_objects_per_sec":2,"recovering_bytes_per_sec":37227,"recovering_keys_per_sec":0,"num_objects_recovered":18,"num_bytes_recovered":223425,"num_keys_recovered":0},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"a","status":"up:active","gid":4208}],"up:standby":0},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2023-09-30T17:03:23.303001+0000","services":{}},"progress_events":{}} 2023-09-30T17:05:10.541 INFO:tasks.ceph.ceph_manager.ceph:making progress, resetting timeout 2023-09-30T17:05:10.542 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T17:05:10.881 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:05:10.883 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-09-30T17:05:10.893 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":160,"stamp":"2023-09-30T17:05:09.334988+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":819295,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":140,"num_read_kb":122,"num_write":533025,"num_write_kb":2579054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":223425,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141229,"ondisk_log_size":141229,"up":210,"acting":200,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1192900,"kb_used_data":3348,"kb_used_omap":10,"kb_used_meta":1189493,"kb_avail":281922620,"statfs":{"total":289910292480,"available":288688762880,"internally_reserved":0,"allocated":3428352,"data_stored":2449445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10327,"internal_metadata":1218041769},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-18,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":223425,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001662"},"pg_stats":[{"pgid":"4.3f","version":"59'2790","reported_seq":2851,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.298448+0000","last_change":"2023-09-30T17:02:18.360288+0000","last_active":"2023-09-30T17:05:03.298448+0000","last_peered":"2023-09-30T17:05:03.298448+0000","last_clean":"2023-09-30T17:05:03.298448+0000","last_became_active":"2023-09-30T17:02:18.358716+0000","last_became_peered":"2023-09-30T17:02:18.358716+0000","last_unstale":"2023-09-30T17:05:03.298448+0000","last_undegraded":"2023-09-30T17:05:03.298448+0000","last_fullsized":"2023-09-30T17:05:03.298448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2790,"log_dups_size":0,"ondisk_log_size":2790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:12:06.380095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8214,"num_write_kb":38924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"59'4","reported_seq":65,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.294835+0000","last_change":"2023-09-30T17:02:18.362418+0000","last_active":"2023-09-30T17:05:03.294835+0000","last_peered":"2023-09-30T17:05:03.294835+0000","last_clean":"2023-09-30T17:05:03.294835+0000","last_became_active":"2023-09-30T17:02:18.360372+0000","last_became_peered":"2023-09-30T17:02:18.360372+0000","last_unstale":"2023-09-30T17:05:03.294835+0000","last_undegraded":"2023-09-30T17:05:03.294835+0000","last_fullsized":"2023-09-30T17:05:03.294835+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:43:29.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"59'5697","reported_seq":5764,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.291534+0000","last_change":"2023-09-30T17:05:06.291597+0000","last_active":"2023-09-30T17:05:06.291534+0000","last_peered":"2023-09-30T17:05:06.291534+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:05:06.290447+0000","last_became_peered":"2023-09-30T17:05:06.290447+0000","last_unstale":"2023-09-30T17:05:06.291534+0000","last_undegraded":"2023-09-30T17:05:06.291534+0000","last_fullsized":"2023-09-30T17:05:06.291534+0000","mapping_epoch":69,"log_start":"42'1200","ondisk_log_start":"42'1200","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4497,"log_dups_size":1200,"ondisk_log_size":4497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:02:21.064107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16590,"num_write_kb":78960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"59'10","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.280683+0000","last_change":"2023-09-30T17:05:03.309996+0000","last_active":"2023-09-30T17:05:05.280683+0000","last_peered":"2023-09-30T17:05:05.280683+0000","last_clean":"2023-09-30T17:05:05.280683+0000","last_became_active":"2023-09-30T17:05:03.309326+0000","last_became_peered":"2023-09-30T17:05:03.309326+0000","last_unstale":"2023-09-30T17:05:05.280683+0000","last_undegraded":"2023-09-30T17:05:05.280683+0000","last_fullsized":"2023-09-30T17:05:05.280683+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:31:23.164242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"59'2934","reported_seq":2995,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.293902+0000","last_change":"2023-09-30T17:02:18.360192+0000","last_active":"2023-09-30T17:05:03.293902+0000","last_peered":"2023-09-30T17:05:03.293902+0000","last_clean":"2023-09-30T17:05:03.293902+0000","last_became_active":"2023-09-30T17:02:18.357317+0000","last_became_peered":"2023-09-30T17:02:18.357317+0000","last_unstale":"2023-09-30T17:05:03.293902+0000","last_undegraded":"2023-09-30T17:05:03.293902+0000","last_fullsized":"2023-09-30T17:05:03.293902+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2934,"log_dups_size":0,"ondisk_log_size":2934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:37:14.790993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8466,"num_write_kb":40084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"59'6","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.282788+0000","last_change":"2023-09-30T17:05:03.311318+0000","last_active":"2023-09-30T17:05:05.282788+0000","last_peered":"2023-09-30T17:05:05.282788+0000","last_clean":"2023-09-30T17:05:05.282788+0000","last_became_active":"2023-09-30T17:05:03.310703+0000","last_became_peered":"2023-09-30T17:05:03.310703+0000","last_unstale":"2023-09-30T17:05:05.282788+0000","last_undegraded":"2023-09-30T17:05:05.282788+0000","last_fullsized":"2023-09-30T17:05:05.282788+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:08:45.345559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"59'7","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.281077+0000","last_change":"2023-09-30T17:05:03.310838+0000","last_active":"2023-09-30T17:05:05.281077+0000","last_peered":"2023-09-30T17:05:05.281077+0000","last_clean":"2023-09-30T17:05:05.281077+0000","last_became_active":"2023-09-30T17:05:03.310047+0000","last_became_peered":"2023-09-30T17:05:03.310047+0000","last_unstale":"2023-09-30T17:05:05.281077+0000","last_undegraded":"2023-09-30T17:05:05.281077+0000","last_fullsized":"2023-09-30T17:05:05.281077+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:29:17.418059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"59'11423","reported_seq":11493,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.286653+0000","last_change":"2023-09-30T17:05:06.286653+0000","last_active":"2023-09-30T17:05:06.286653+0000","last_peered":"2023-09-30T17:05:06.286653+0000","last_clean":"2023-09-30T17:05:06.286653+0000","last_became_active":"2023-09-30T17:05:06.285582+0000","last_became_peered":"2023-09-30T17:05:06.285582+0000","last_unstale":"2023-09-30T17:05:06.286653+0000","last_undegraded":"2023-09-30T17:05:06.286653+0000","last_fullsized":"2023-09-30T17:05:06.286653+0000","mapping_epoch":69,"log_start":"52'7200","ondisk_log_start":"52'7200","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4223,"log_dups_size":5777,"ondisk_log_size":4223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:35:18.578031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33444,"num_write_kb":158924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"59'8589","reported_seq":8650,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.293977+0000","last_change":"2023-09-30T17:02:18.364222+0000","last_active":"2023-09-30T17:05:03.293977+0000","last_peered":"2023-09-30T17:05:03.293977+0000","last_clean":"2023-09-30T17:05:03.293977+0000","last_became_active":"2023-09-30T17:02:18.363485+0000","last_became_peered":"2023-09-30T17:02:18.363485+0000","last_unstale":"2023-09-30T17:05:03.293977+0000","last_undegraded":"2023-09-30T17:05:03.293977+0000","last_fullsized":"2023-09-30T17:05:03.293977+0000","mapping_epoch":17,"log_start":"49'4400","ondisk_log_start":"49'4400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4189,"log_dups_size":4400,"ondisk_log_size":4189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:14:35.192615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25052,"num_write_kb":118756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"59'8585","reported_seq":8646,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.296848+0000","last_change":"2023-09-30T17:02:18.360010+0000","last_active":"2023-09-30T17:05:03.296848+0000","last_peered":"2023-09-30T17:05:03.296848+0000","last_clean":"2023-09-30T17:05:03.296848+0000","last_became_active":"2023-09-30T17:02:18.358396+0000","last_became_peered":"2023-09-30T17:02:18.358396+0000","last_unstale":"2023-09-30T17:05:03.296848+0000","last_undegraded":"2023-09-30T17:05:03.296848+0000","last_fullsized":"2023-09-30T17:05:03.296848+0000","mapping_epoch":17,"log_start":"48'4100","ondisk_log_start":"48'4100","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4485,"log_dups_size":4100,"ondisk_log_size":4485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:26:11.522402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24997,"num_write_kb":162463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"59'5664","reported_seq":5733,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.291463+0000","last_change":"2023-09-30T17:05:06.291535+0000","last_active":"2023-09-30T17:05:06.291463+0000","last_peered":"2023-09-30T17:05:06.291463+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:05:06.290193+0000","last_became_peered":"2023-09-30T17:05:06.290193+0000","last_unstale":"2023-09-30T17:05:06.291463+0000","last_undegraded":"2023-09-30T17:05:06.291463+0000","last_fullsized":"2023-09-30T17:05:06.291463+0000","mapping_epoch":69,"log_start":"43'1400","ondisk_log_start":"43'1400","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4264,"log_dups_size":1400,"ondisk_log_size":4264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:21:15.508580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16442,"num_write_kb":78308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"59'2931","reported_seq":3001,"reported_epoch":68,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2023-09-30T17:05:04.685614+0000","last_change":"2023-09-30T17:05:04.686083+0000","last_active":"2023-09-30T17:05:04.685614+0000","last_peered":"2023-09-30T17:05:04.685614+0000","last_clean":"2023-09-30T17:02:44.409974+0000","last_became_active":"2023-09-30T17:05:04.684700+0000","last_became_peered":"2023-09-30T17:05:04.684700+0000","last_unstale":"2023-09-30T17:05:04.685614+0000","last_undegraded":"2023-09-30T17:05:04.350380+0000","last_fullsized":"2023-09-30T17:05:04.295029+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2931,"log_dups_size":0,"ondisk_log_size":2931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:56:52.522789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8488,"num_write_kb":40364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"59'2860","reported_seq":2921,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.293200+0000","last_change":"2023-09-30T17:02:18.359894+0000","last_active":"2023-09-30T17:05:03.293200+0000","last_peered":"2023-09-30T17:05:03.293200+0000","last_clean":"2023-09-30T17:05:03.293200+0000","last_became_active":"2023-09-30T17:02:18.358534+0000","last_became_peered":"2023-09-30T17:02:18.358534+0000","last_unstale":"2023-09-30T17:05:03.293200+0000","last_undegraded":"2023-09-30T17:05:03.293200+0000","last_fullsized":"2023-09-30T17:05:03.293200+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2860,"log_dups_size":0,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:22:13.025181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8367,"num_write_kb":39772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"59'2911","reported_seq":2972,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.289465+0000","last_change":"2023-09-30T17:05:06.289465+0000","last_active":"2023-09-30T17:05:06.289465+0000","last_peered":"2023-09-30T17:05:06.289465+0000","last_clean":"2023-09-30T17:05:06.289465+0000","last_became_active":"2023-09-30T17:05:06.288360+0000","last_became_peered":"2023-09-30T17:05:06.288360+0000","last_unstale":"2023-09-30T17:05:06.289465+0000","last_undegraded":"2023-09-30T17:05:06.289465+0000","last_fullsized":"2023-09-30T17:05:06.289465+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2911,"log_dups_size":0,"ondisk_log_size":2911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:53:55.381223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8419,"num_write_kb":39940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"59'2889","reported_seq":2950,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.286551+0000","last_change":"2023-09-30T17:05:06.286551+0000","last_active":"2023-09-30T17:05:06.286551+0000","last_peered":"2023-09-30T17:05:06.286551+0000","last_clean":"2023-09-30T17:05:06.286551+0000","last_became_active":"2023-09-30T17:05:06.285738+0000","last_became_peered":"2023-09-30T17:05:06.285738+0000","last_unstale":"2023-09-30T17:05:06.286551+0000","last_undegraded":"2023-09-30T17:05:06.286551+0000","last_fullsized":"2023-09-30T17:05:06.286551+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2889,"log_dups_size":0,"ondisk_log_size":2889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:18:17.841837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8435,"num_write_kb":39984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"59'2839","reported_seq":2899,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.291076+0000","last_change":"2023-09-30T17:05:06.291173+0000","last_active":"2023-09-30T17:05:06.291076+0000","last_peered":"2023-09-30T17:05:06.291076+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:05:06.289872+0000","last_became_peered":"2023-09-30T17:05:06.289872+0000","last_unstale":"2023-09-30T17:05:06.291076+0000","last_undegraded":"2023-09-30T17:05:06.291076+0000","last_fullsized":"2023-09-30T17:05:06.291076+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2839,"log_dups_size":0,"ondisk_log_size":2839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:57:27.685208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8166,"num_write_kb":38928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"59'2802","reported_seq":2863,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.294096+0000","last_change":"2023-09-30T17:02:18.364360+0000","last_active":"2023-09-30T17:05:03.294096+0000","last_peered":"2023-09-30T17:05:03.294096+0000","last_clean":"2023-09-30T17:05:03.294096+0000","last_became_active":"2023-09-30T17:02:18.363697+0000","last_became_peered":"2023-09-30T17:02:18.363697+0000","last_unstale":"2023-09-30T17:05:03.294096+0000","last_undegraded":"2023-09-30T17:05:03.294096+0000","last_fullsized":"2023-09-30T17:05:03.294096+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2802,"log_dups_size":0,"ondisk_log_size":2802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:50:52.893768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8256,"num_write_kb":39208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"59'2860","reported_seq":2921,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.297246+0000","last_change":"2023-09-30T17:02:18.360320+0000","last_active":"2023-09-30T17:05:03.297246+0000","last_peered":"2023-09-30T17:05:03.297246+0000","last_clean":"2023-09-30T17:05:03.297246+0000","last_became_active":"2023-09-30T17:02:18.357184+0000","last_became_peered":"2023-09-30T17:02:18.357184+0000","last_unstale":"2023-09-30T17:05:03.297246+0000","last_undegraded":"2023-09-30T17:05:03.297246+0000","last_fullsized":"2023-09-30T17:05:03.297246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2860,"log_dups_size":0,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:21:45.195007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8368,"num_write_kb":39616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"59'5686","reported_seq":5747,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.293409+0000","last_change":"2023-09-30T17:02:18.363956+0000","last_active":"2023-09-30T17:05:03.293409+0000","last_peered":"2023-09-30T17:05:03.293409+0000","last_clean":"2023-09-30T17:05:03.293409+0000","last_became_active":"2023-09-30T17:02:18.363654+0000","last_became_peered":"2023-09-30T17:02:18.363654+0000","last_unstale":"2023-09-30T17:05:03.293409+0000","last_undegraded":"2023-09-30T17:05:03.293409+0000","last_fullsized":"2023-09-30T17:05:03.293409+0000","mapping_epoch":17,"log_start":"44'1500","ondisk_log_start":"44'1500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4186,"log_dups_size":1500,"ondisk_log_size":4186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:48:17.598726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16649,"num_write_kb":78956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"59'5799","reported_seq":5869,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.290908+0000","last_change":"2023-09-30T17:05:06.290994+0000","last_active":"2023-09-30T17:05:06.290908+0000","last_peered":"2023-09-30T17:05:06.290908+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:05:06.289817+0000","last_became_peered":"2023-09-30T17:05:06.289817+0000","last_unstale":"2023-09-30T17:05:06.290908+0000","last_undegraded":"2023-09-30T17:05:06.290908+0000","last_fullsized":"2023-09-30T17:05:06.290908+0000","mapping_epoch":69,"log_start":"44'1600","ondisk_log_start":"44'1600","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4199,"log_dups_size":1600,"ondisk_log_size":4199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:50:21.333588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16903,"num_write_kb":80184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"59'12","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.282364+0000","last_change":"2023-09-30T17:05:03.310298+0000","last_active":"2023-09-30T17:05:05.282364+0000","last_peered":"2023-09-30T17:05:05.282364+0000","last_clean":"2023-09-30T17:05:05.282364+0000","last_became_active":"2023-09-30T17:05:03.309537+0000","last_became_peered":"2023-09-30T17:05:03.309537+0000","last_unstale":"2023-09-30T17:05:05.282364+0000","last_undegraded":"2023-09-30T17:05:05.282364+0000","last_fullsized":"2023-09-30T17:05:05.282364+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:45:25.545287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"59'2879","reported_seq":2949,"reported_epoch":68,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2023-09-30T17:05:04.675971+0000","last_change":"2023-09-30T17:05:04.676123+0000","last_active":"2023-09-30T17:05:04.675971+0000","last_peered":"2023-09-30T17:05:04.675971+0000","last_clean":"2023-09-30T17:02:44.409783+0000","last_became_active":"2023-09-30T17:05:04.675105+0000","last_became_peered":"2023-09-30T17:05:04.675105+0000","last_unstale":"2023-09-30T17:05:04.675971+0000","last_undegraded":"2023-09-30T17:05:04.350614+0000","last_fullsized":"2023-09-30T17:05:04.294637+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2879,"log_dups_size":0,"ondisk_log_size":2879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:25:29.014968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8343,"num_write_kb":39768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"59'2809","reported_seq":2875,"reported_epoch":68,"state":"activating+undersized+remapped","last_fresh":"2023-09-30T17:05:04.294246+0000","last_change":"2023-09-30T17:05:04.336681+0000","last_active":"2023-09-30T17:05:02.294532+0000","last_peered":"2023-09-30T17:05:01.285906+0000","last_clean":"2023-09-30T17:02:44.409099+0000","last_became_active":"2023-09-30T17:02:48.270162+0000","last_became_peered":"2023-09-30T17:02:48.270162+0000","last_unstale":"2023-09-30T17:05:04.294246+0000","last_undegraded":"2023-09-30T17:05:04.294246+0000","last_fullsized":"2023-09-30T17:05:04.294246+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2809,"log_dups_size":0,"ondisk_log_size":2809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:31:14.223659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8281,"num_write_kb":39472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"59'5585","reported_seq":5646,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.293866+0000","last_change":"2023-09-30T17:02:18.353938+0000","last_active":"2023-09-30T17:05:03.293866+0000","last_peered":"2023-09-30T17:05:03.293866+0000","last_clean":"2023-09-30T17:05:03.293866+0000","last_became_active":"2023-09-30T17:02:18.353632+0000","last_became_peered":"2023-09-30T17:02:18.353632+0000","last_unstale":"2023-09-30T17:05:03.293866+0000","last_undegraded":"2023-09-30T17:05:03.293866+0000","last_fullsized":"2023-09-30T17:05:03.293866+0000","mapping_epoch":17,"log_start":"42'1100","ondisk_log_start":"42'1100","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4485,"log_dups_size":1100,"ondisk_log_size":4485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:09:55.056098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16523,"num_write_kb":78256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"59'2888","reported_seq":2962,"reported_epoch":68,"state":"active+undersized+remapped","last_fresh":"2023-09-30T17:05:04.684311+0000","last_change":"2023-09-30T17:05:04.684498+0000","last_active":"2023-09-30T17:05:04.684311+0000","last_peered":"2023-09-30T17:05:04.684311+0000","last_clean":"2023-09-30T17:02:44.410555+0000","last_became_active":"2023-09-30T17:05:04.622264+0000","last_became_peered":"2023-09-30T17:05:04.622264+0000","last_unstale":"2023-09-30T17:05:04.684311+0000","last_undegraded":"2023-09-30T17:05:04.684311+0000","last_fullsized":"2023-09-30T17:05:04.296505+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2888,"log_dups_size":0,"ondisk_log_size":2888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:22:14.097479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8371,"num_write_kb":39716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"59'18","reported_seq":90,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.310314+0000","last_change":"2023-09-30T17:05:03.309295+0000","last_active":"2023-09-30T17:05:03.310314+0000","last_peered":"2023-09-30T17:05:03.310314+0000","last_clean":"2023-09-30T17:05:03.310314+0000","last_became_active":"2023-09-30T17:05:03.308884+0000","last_became_peered":"2023-09-30T17:05:03.308884+0000","last_unstale":"2023-09-30T17:05:03.310314+0000","last_undegraded":"2023-09-30T17:05:03.310314+0000","last_fullsized":"2023-09-30T17:05:03.310314+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:57:45.449671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"59'2855","reported_seq":2916,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.291293+0000","last_change":"2023-09-30T17:05:06.291369+0000","last_active":"2023-09-30T17:05:06.291293+0000","last_peered":"2023-09-30T17:05:06.291293+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:05:06.289447+0000","last_became_peered":"2023-09-30T17:05:06.289447+0000","last_unstale":"2023-09-30T17:05:06.291293+0000","last_undegraded":"2023-09-30T17:05:06.291293+0000","last_fullsized":"2023-09-30T17:05:06.291293+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2855,"log_dups_size":0,"ondisk_log_size":2855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:17:21.412392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8347,"num_write_kb":39608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":63,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.292988+0000","last_change":"2023-09-30T17:02:17.358258+0000","last_active":"2023-09-30T17:05:03.292988+0000","last_peered":"2023-09-30T17:05:03.292988+0000","last_clean":"2023-09-30T17:05:03.292988+0000","last_became_active":"2023-09-30T17:02:17.357890+0000","last_became_peered":"2023-09-30T17:02:17.357890+0000","last_unstale":"2023-09-30T17:05:03.292988+0000","last_undegraded":"2023-09-30T17:05:03.292988+0000","last_fullsized":"2023-09-30T17:05:03.292988+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:52:56.591906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"59'17","reported_seq":89,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.309329+0000","last_change":"2023-09-30T17:05:03.307486+0000","last_active":"2023-09-30T17:05:03.309329+0000","last_peered":"2023-09-30T17:05:03.309329+0000","last_clean":"2023-09-30T17:05:03.309329+0000","last_became_active":"2023-09-30T17:05:03.307012+0000","last_became_peered":"2023-09-30T17:05:03.307012+0000","last_unstale":"2023-09-30T17:05:03.309329+0000","last_undegraded":"2023-09-30T17:05:03.309329+0000","last_fullsized":"2023-09-30T17:05:03.309329+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:05:29.995730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":73,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.310296+0000","last_change":"2023-09-30T17:05:03.309164+0000","last_active":"2023-09-30T17:05:03.310296+0000","last_peered":"2023-09-30T17:05:03.310296+0000","last_clean":"2023-09-30T17:05:03.310296+0000","last_became_active":"2023-09-30T17:05:03.308073+0000","last_became_peered":"2023-09-30T17:05:03.308073+0000","last_unstale":"2023-09-30T17:05:03.310296+0000","last_undegraded":"2023-09-30T17:05:03.310296+0000","last_fullsized":"2023-09-30T17:05:03.310296+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:10:16.238053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"59'6","reported_seq":78,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.309853+0000","last_change":"2023-09-30T17:05:03.308692+0000","last_active":"2023-09-30T17:05:03.309853+0000","last_peered":"2023-09-30T17:05:03.309853+0000","last_clean":"2023-09-30T17:05:03.309853+0000","last_became_active":"2023-09-30T17:05:03.307932+0000","last_became_peered":"2023-09-30T17:05:03.307932+0000","last_unstale":"2023-09-30T17:05:03.309853+0000","last_undegraded":"2023-09-30T17:05:03.309853+0000","last_fullsized":"2023-09-30T17:05:03.309853+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:17:13.668052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":62,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.293753+0000","last_change":"2023-09-30T17:02:17.361000+0000","last_active":"2023-09-30T17:05:03.293753+0000","last_peered":"2023-09-30T17:05:03.293753+0000","last_clean":"2023-09-30T17:05:03.293753+0000","last_became_active":"2023-09-30T17:02:17.360601+0000","last_became_peered":"2023-09-30T17:02:17.360601+0000","last_unstale":"2023-09-30T17:05:03.293753+0000","last_undegraded":"2023-09-30T17:05:03.293753+0000","last_fullsized":"2023-09-30T17:05:03.293753+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:02:27.666526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"59'7","reported_seq":79,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.307828+0000","last_change":"2023-09-30T17:05:03.305898+0000","last_active":"2023-09-30T17:05:03.307828+0000","last_peered":"2023-09-30T17:05:03.307828+0000","last_clean":"2023-09-30T17:05:03.307828+0000","last_became_active":"2023-09-30T17:05:03.305520+0000","last_became_peered":"2023-09-30T17:05:03.305520+0000","last_unstale":"2023-09-30T17:05:03.307828+0000","last_undegraded":"2023-09-30T17:05:03.307828+0000","last_fullsized":"2023-09-30T17:05:03.307828+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:40:09.276369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"58'1","reported_seq":74,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.310300+0000","last_change":"2023-09-30T17:05:03.309303+0000","last_active":"2023-09-30T17:05:03.310300+0000","last_peered":"2023-09-30T17:05:03.310300+0000","last_clean":"2023-09-30T17:05:03.310300+0000","last_became_active":"2023-09-30T17:05:03.308851+0000","last_became_peered":"2023-09-30T17:05:03.308851+0000","last_unstale":"2023-09-30T17:05:03.310300+0000","last_undegraded":"2023-09-30T17:05:03.310300+0000","last_fullsized":"2023-09-30T17:05:03.310300+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:32:55.497287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"59'9","reported_seq":70,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.293329+0000","last_change":"2023-09-30T17:02:18.358841+0000","last_active":"2023-09-30T17:05:03.293329+0000","last_peered":"2023-09-30T17:05:03.293329+0000","last_clean":"2023-09-30T17:05:03.293329+0000","last_became_active":"2023-09-30T17:02:18.358529+0000","last_became_peered":"2023-09-30T17:02:18.358529+0000","last_unstale":"2023-09-30T17:05:03.293329+0000","last_undegraded":"2023-09-30T17:05:03.293329+0000","last_fullsized":"2023-09-30T17:05:03.293329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:15:54.364571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.280731+0000","last_change":"2023-09-30T17:05:03.309409+0000","last_active":"2023-09-30T17:05:05.280731+0000","last_peered":"2023-09-30T17:05:05.280731+0000","last_clean":"2023-09-30T17:05:05.280731+0000","last_became_active":"2023-09-30T17:05:03.309023+0000","last_became_peered":"2023-09-30T17:05:03.309023+0000","last_unstale":"2023-09-30T17:05:05.280731+0000","last_undegraded":"2023-09-30T17:05:05.280731+0000","last_fullsized":"2023-09-30T17:05:05.280731+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:57:05.463330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"59'8526","reported_seq":8592,"reported_epoch":68,"state":"activating+undersized+remapped","last_fresh":"2023-09-30T17:05:04.294458+0000","last_change":"2023-09-30T17:05:04.363997+0000","last_active":"2023-09-30T17:05:02.297380+0000","last_peered":"2023-09-30T17:05:01.286184+0000","last_clean":"2023-09-30T17:02:44.408876+0000","last_became_active":"2023-09-30T17:02:48.271101+0000","last_became_peered":"2023-09-30T17:02:48.271101+0000","last_unstale":"2023-09-30T17:05:04.294458+0000","last_undegraded":"2023-09-30T17:05:04.294458+0000","last_fullsized":"2023-09-30T17:05:04.294458+0000","mapping_epoch":67,"log_start":"49'4300","ondisk_log_start":"49'4300","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4226,"log_dups_size":4300,"ondisk_log_size":4226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:13:34.205219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24873,"num_write_kb":118472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"59'7","reported_seq":85,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.311471+0000","last_change":"2023-09-30T17:05:03.310987+0000","last_active":"2023-09-30T17:05:03.311471+0000","last_peered":"2023-09-30T17:05:03.311471+0000","last_clean":"2023-09-30T17:05:03.311471+0000","last_became_active":"2023-09-30T17:05:03.306646+0000","last_became_peered":"2023-09-30T17:05:03.306646+0000","last_unstale":"2023-09-30T17:05:03.311471+0000","last_undegraded":"2023-09-30T17:05:03.311471+0000","last_fullsized":"2023-09-30T17:05:03.311471+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:24:52.247523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"59'5670","reported_seq":5731,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.293120+0000","last_change":"2023-09-30T17:02:18.359118+0000","last_active":"2023-09-30T17:05:03.293120+0000","last_peered":"2023-09-30T17:05:03.293120+0000","last_clean":"2023-09-30T17:05:03.293120+0000","last_became_active":"2023-09-30T17:02:18.358786+0000","last_became_peered":"2023-09-30T17:02:18.358786+0000","last_unstale":"2023-09-30T17:05:03.293120+0000","last_undegraded":"2023-09-30T17:05:03.293120+0000","last_fullsized":"2023-09-30T17:05:03.293120+0000","mapping_epoch":17,"log_start":"44'1500","ondisk_log_start":"44'1500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4170,"log_dups_size":1500,"ondisk_log_size":4170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:33:21.723864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16627,"num_write_kb":79047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"60'78","reported_seq":43,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.280787+0000","last_change":"2023-09-30T17:05:03.313916+0000","last_active":"2023-09-30T17:05:05.280787+0000","last_peered":"2023-09-30T17:05:05.280787+0000","last_clean":"2023-09-30T17:05:05.280787+0000","last_became_active":"2023-09-30T17:05:03.302516+0000","last_became_peered":"2023-09-30T17:05:03.302516+0000","last_unstale":"2023-09-30T17:05:05.280787+0000","last_undegraded":"2023-09-30T17:05:05.280787+0000","last_fullsized":"2023-09-30T17:05:05.280787+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:00:50.535715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227523,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":222729,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"59'5677","reported_seq":5750,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.289965+0000","last_change":"2023-09-30T17:05:06.289965+0000","last_active":"2023-09-30T17:05:06.289965+0000","last_peered":"2023-09-30T17:05:06.289965+0000","last_clean":"2023-09-30T17:05:06.289965+0000","last_became_active":"2023-09-30T17:05:06.288155+0000","last_became_peered":"2023-09-30T17:05:06.288155+0000","last_unstale":"2023-09-30T17:05:06.289965+0000","last_undegraded":"2023-09-30T17:05:06.289965+0000","last_fullsized":"2023-09-30T17:05:06.289965+0000","mapping_epoch":69,"log_start":"42'1100","ondisk_log_start":"42'1100","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4577,"log_dups_size":1100,"ondisk_log_size":4577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:26:23.188915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16579,"num_write_kb":79104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":26,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.280510+0000","last_change":"2023-09-30T17:05:03.310322+0000","last_active":"2023-09-30T17:05:05.280510+0000","last_peered":"2023-09-30T17:05:05.280510+0000","last_clean":"2023-09-30T17:05:05.280510+0000","last_became_active":"2023-09-30T17:05:03.309505+0000","last_became_peered":"2023-09-30T17:05:03.309505+0000","last_unstale":"2023-09-30T17:05:05.280510+0000","last_undegraded":"2023-09-30T17:05:05.280510+0000","last_fullsized":"2023-09-30T17:05:05.280510+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:13:16.014703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"59'2836","reported_seq":2897,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.295173+0000","last_change":"2023-09-30T17:02:18.360019+0000","last_active":"2023-09-30T17:05:03.295173+0000","last_peered":"2023-09-30T17:05:03.295173+0000","last_clean":"2023-09-30T17:05:03.295173+0000","last_became_active":"2023-09-30T17:02:18.358364+0000","last_became_peered":"2023-09-30T17:02:18.358364+0000","last_unstale":"2023-09-30T17:05:03.295173+0000","last_undegraded":"2023-09-30T17:05:03.295173+0000","last_fullsized":"2023-09-30T17:05:03.295173+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2836,"log_dups_size":0,"ondisk_log_size":2836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:30:43.782165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8308,"num_write_kb":39456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":73,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.309897+0000","last_change":"2023-09-30T17:05:03.308853+0000","last_active":"2023-09-30T17:05:03.309897+0000","last_peered":"2023-09-30T17:05:03.309897+0000","last_clean":"2023-09-30T17:05:03.309897+0000","last_became_active":"2023-09-30T17:05:03.308377+0000","last_became_peered":"2023-09-30T17:05:03.308377+0000","last_unstale":"2023-09-30T17:05:03.309897+0000","last_undegraded":"2023-09-30T17:05:03.309897+0000","last_fullsized":"2023-09-30T17:05:03.309897+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:18:42.448826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"59'2856","reported_seq":2917,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.297788+0000","last_change":"2023-09-30T17:02:18.362415+0000","last_active":"2023-09-30T17:05:03.297788+0000","last_peered":"2023-09-30T17:05:03.297788+0000","last_clean":"2023-09-30T17:05:03.297788+0000","last_became_active":"2023-09-30T17:02:18.361556+0000","last_became_peered":"2023-09-30T17:02:18.361556+0000","last_unstale":"2023-09-30T17:05:03.297788+0000","last_undegraded":"2023-09-30T17:05:03.297788+0000","last_fullsized":"2023-09-30T17:05:03.297788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2856,"log_dups_size":0,"ondisk_log_size":2856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:16:41.607547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8321,"num_write_kb":39600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":73,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.305301+0000","last_change":"2023-09-30T17:05:03.304220+0000","last_active":"2023-09-30T17:05:03.305301+0000","last_peered":"2023-09-30T17:05:03.305301+0000","last_clean":"2023-09-30T17:05:03.305301+0000","last_became_active":"2023-09-30T17:05:03.303598+0000","last_became_peered":"2023-09-30T17:05:03.303598+0000","last_unstale":"2023-09-30T17:05:03.305301+0000","last_undegraded":"2023-09-30T17:05:03.305301+0000","last_fullsized":"2023-09-30T17:05:03.305301+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:57:44.444041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"59'12","reported_seq":84,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.314205+0000","last_change":"2023-09-30T17:05:03.313214+0000","last_active":"2023-09-30T17:05:03.314205+0000","last_peered":"2023-09-30T17:05:03.314205+0000","last_clean":"2023-09-30T17:05:03.314205+0000","last_became_active":"2023-09-30T17:05:03.312888+0000","last_became_peered":"2023-09-30T17:05:03.312888+0000","last_unstale":"2023-09-30T17:05:03.314205+0000","last_undegraded":"2023-09-30T17:05:03.314205+0000","last_fullsized":"2023-09-30T17:05:03.314205+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:40:09.276369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"59'9","reported_seq":29,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.282742+0000","last_change":"2023-09-30T17:05:03.304503+0000","last_active":"2023-09-30T17:05:05.282742+0000","last_peered":"2023-09-30T17:05:05.282742+0000","last_clean":"2023-09-30T17:05:05.282742+0000","last_became_active":"2023-09-30T17:05:03.304030+0000","last_became_peered":"2023-09-30T17:05:03.304030+0000","last_unstale":"2023-09-30T17:05:05.282742+0000","last_undegraded":"2023-09-30T17:05:05.282742+0000","last_fullsized":"2023-09-30T17:05:05.282742+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:08:35.110114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"59'2892","reported_seq":2966,"reported_epoch":68,"state":"active+undersized+remapped","last_fresh":"2023-09-30T17:05:04.650226+0000","last_change":"2023-09-30T17:05:04.650394+0000","last_active":"2023-09-30T17:05:04.650226+0000","last_peered":"2023-09-30T17:05:04.650226+0000","last_clean":"2023-09-30T17:02:44.409540+0000","last_became_active":"2023-09-30T17:05:04.626857+0000","last_became_peered":"2023-09-30T17:05:04.626857+0000","last_unstale":"2023-09-30T17:05:04.650226+0000","last_undegraded":"2023-09-30T17:05:04.650226+0000","last_fullsized":"2023-09-30T17:05:04.295690+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2892,"log_dups_size":0,"ondisk_log_size":2892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:22:14.097479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8345,"num_write_kb":39712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1],"avail_no_missing":["1","2"],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":26,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.281280+0000","last_change":"2023-09-30T17:05:03.304339+0000","last_active":"2023-09-30T17:05:05.281280+0000","last_peered":"2023-09-30T17:05:05.281280+0000","last_clean":"2023-09-30T17:05:05.281280+0000","last_became_active":"2023-09-30T17:05:03.303179+0000","last_became_peered":"2023-09-30T17:05:03.303179+0000","last_unstale":"2023-09-30T17:05:05.281280+0000","last_undegraded":"2023-09-30T17:05:05.281280+0000","last_fullsized":"2023-09-30T17:05:05.281280+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:44:20.765682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"59'2861","reported_seq":2927,"reported_epoch":68,"state":"activating+undersized+remapped","last_fresh":"2023-09-30T17:05:04.294000+0000","last_change":"2023-09-30T17:05:04.347702+0000","last_active":"2023-09-30T17:05:02.288537+0000","last_peered":"2023-09-30T17:05:01.285312+0000","last_clean":"2023-09-30T17:02:44.409530+0000","last_became_active":"2023-09-30T17:02:48.271207+0000","last_became_peered":"2023-09-30T17:02:48.271207+0000","last_unstale":"2023-09-30T17:05:04.294000+0000","last_undegraded":"2023-09-30T17:05:04.294000+0000","last_fullsized":"2023-09-30T17:05:04.294000+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2861,"log_dups_size":0,"ondisk_log_size":2861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:09:57.818937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8384,"num_write_kb":39788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":75,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.305282+0000","last_change":"2023-09-30T17:05:03.304232+0000","last_active":"2023-09-30T17:05:03.305282+0000","last_peered":"2023-09-30T17:05:03.305282+0000","last_clean":"2023-09-30T17:05:03.305282+0000","last_became_active":"2023-09-30T17:05:03.303874+0000","last_became_peered":"2023-09-30T17:05:03.303874+0000","last_unstale":"2023-09-30T17:05:03.305282+0000","last_undegraded":"2023-09-30T17:05:03.305282+0000","last_fullsized":"2023-09-30T17:05:03.305282+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:39:49.644290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"59'2","reported_seq":63,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.295036+0000","last_change":"2023-09-30T17:02:18.359767+0000","last_active":"2023-09-30T17:05:03.295036+0000","last_peered":"2023-09-30T17:05:03.295036+0000","last_clean":"2023-09-30T17:05:03.295036+0000","last_became_active":"2023-09-30T17:02:18.356825+0000","last_became_peered":"2023-09-30T17:02:18.356825+0000","last_unstale":"2023-09-30T17:05:03.295036+0000","last_undegraded":"2023-09-30T17:05:03.295036+0000","last_fullsized":"2023-09-30T17:05:03.295036+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:39:16.689300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":26,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.280710+0000","last_change":"2023-09-30T17:05:03.305087+0000","last_active":"2023-09-30T17:05:05.280710+0000","last_peered":"2023-09-30T17:05:05.280710+0000","last_clean":"2023-09-30T17:05:05.280710+0000","last_became_active":"2023-09-30T17:05:03.304463+0000","last_became_peered":"2023-09-30T17:05:03.304463+0000","last_unstale":"2023-09-30T17:05:05.280710+0000","last_undegraded":"2023-09-30T17:05:05.280710+0000","last_fullsized":"2023-09-30T17:05:05.280710+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:33:20.829898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"59'2835","reported_seq":2897,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.289598+0000","last_change":"2023-09-30T17:05:06.289598+0000","last_active":"2023-09-30T17:05:06.289598+0000","last_peered":"2023-09-30T17:05:06.289598+0000","last_clean":"2023-09-30T17:05:06.289598+0000","last_became_active":"2023-09-30T17:05:06.288712+0000","last_became_peered":"2023-09-30T17:05:06.288712+0000","last_unstale":"2023-09-30T17:05:06.289598+0000","last_undegraded":"2023-09-30T17:05:06.289598+0000","last_fullsized":"2023-09-30T17:05:06.289598+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2835,"log_dups_size":0,"ondisk_log_size":2835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:01:17.676791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8288,"num_write_kb":39388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.282725+0000","last_change":"2023-09-30T17:05:03.311500+0000","last_active":"2023-09-30T17:05:05.282725+0000","last_peered":"2023-09-30T17:05:05.282725+0000","last_clean":"2023-09-30T17:05:05.282725+0000","last_became_active":"2023-09-30T17:05:03.310836+0000","last_became_peered":"2023-09-30T17:05:03.310836+0000","last_unstale":"2023-09-30T17:05:05.282725+0000","last_undegraded":"2023-09-30T17:05:05.282725+0000","last_fullsized":"2023-09-30T17:05:05.282725+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:30:09.762284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"59'8","reported_seq":80,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.310264+0000","last_change":"2023-09-30T17:05:03.308917+0000","last_active":"2023-09-30T17:05:03.310264+0000","last_peered":"2023-09-30T17:05:03.310264+0000","last_clean":"2023-09-30T17:05:03.310264+0000","last_became_active":"2023-09-30T17:05:03.308214+0000","last_became_peered":"2023-09-30T17:05:03.308214+0000","last_unstale":"2023-09-30T17:05:03.310264+0000","last_undegraded":"2023-09-30T17:05:03.310264+0000","last_fullsized":"2023-09-30T17:05:03.310264+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:39:50.649920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"58'3","reported_seq":77,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.309904+0000","last_change":"2023-09-30T17:05:03.308944+0000","last_active":"2023-09-30T17:05:03.309904+0000","last_peered":"2023-09-30T17:05:03.309904+0000","last_clean":"2023-09-30T17:05:03.309904+0000","last_became_active":"2023-09-30T17:05:03.308483+0000","last_became_peered":"2023-09-30T17:05:03.308483+0000","last_unstale":"2023-09-30T17:05:03.309904+0000","last_undegraded":"2023-09-30T17:05:03.309904+0000","last_fullsized":"2023-09-30T17:05:03.309904+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:43:27.633747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"59'2846","reported_seq":2907,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.290255+0000","last_change":"2023-09-30T17:05:06.290255+0000","last_active":"2023-09-30T17:05:06.290255+0000","last_peered":"2023-09-30T17:05:06.290255+0000","last_clean":"2023-09-30T17:05:06.290255+0000","last_became_active":"2023-09-30T17:05:06.289225+0000","last_became_peered":"2023-09-30T17:05:06.289225+0000","last_unstale":"2023-09-30T17:05:06.290255+0000","last_undegraded":"2023-09-30T17:05:06.290255+0000","last_fullsized":"2023-09-30T17:05:06.290255+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2846,"log_dups_size":0,"ondisk_log_size":2846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:41:31.424933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8199,"num_write_kb":39160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.280395+0000","last_change":"2023-09-30T17:05:03.309689+0000","last_active":"2023-09-30T17:05:05.280395+0000","last_peered":"2023-09-30T17:05:05.280395+0000","last_clean":"2023-09-30T17:05:05.280395+0000","last_became_active":"2023-09-30T17:05:03.309318+0000","last_became_peered":"2023-09-30T17:05:03.309318+0000","last_unstale":"2023-09-30T17:05:05.280395+0000","last_undegraded":"2023-09-30T17:05:05.280395+0000","last_fullsized":"2023-09-30T17:05:05.280395+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:12:37.857480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"59'2831","reported_seq":2892,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.289189+0000","last_change":"2023-09-30T17:05:06.289189+0000","last_active":"2023-09-30T17:05:06.289189+0000","last_peered":"2023-09-30T17:05:06.289189+0000","last_clean":"2023-09-30T17:05:06.289189+0000","last_became_active":"2023-09-30T17:05:06.288348+0000","last_became_peered":"2023-09-30T17:05:06.288348+0000","last_unstale":"2023-09-30T17:05:06.289189+0000","last_undegraded":"2023-09-30T17:05:06.289189+0000","last_fullsized":"2023-09-30T17:05:06.289189+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2831,"log_dups_size":0,"ondisk_log_size":2831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:51:59.540252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8336,"num_write_kb":39484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":73,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.305277+0000","last_change":"2023-09-30T17:05:03.304019+0000","last_active":"2023-09-30T17:05:03.305277+0000","last_peered":"2023-09-30T17:05:03.305277+0000","last_clean":"2023-09-30T17:05:03.305277+0000","last_became_active":"2023-09-30T17:05:03.303473+0000","last_became_peered":"2023-09-30T17:05:03.303473+0000","last_unstale":"2023-09-30T17:05:03.305277+0000","last_undegraded":"2023-09-30T17:05:03.305277+0000","last_fullsized":"2023-09-30T17:05:03.305277+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:10:16.238053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"59'2884","reported_seq":2945,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.289446+0000","last_change":"2023-09-30T17:05:06.289446+0000","last_active":"2023-09-30T17:05:06.289446+0000","last_peered":"2023-09-30T17:05:06.289446+0000","last_clean":"2023-09-30T17:05:06.289446+0000","last_became_active":"2023-09-30T17:05:06.288169+0000","last_became_peered":"2023-09-30T17:05:06.288169+0000","last_unstale":"2023-09-30T17:05:06.289446+0000","last_undegraded":"2023-09-30T17:05:06.289446+0000","last_fullsized":"2023-09-30T17:05:06.289446+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2884,"log_dups_size":0,"ondisk_log_size":2884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:15:23.507816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8366,"num_write_kb":39744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":62,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.293603+0000","last_change":"2023-09-30T17:02:17.358811+0000","last_active":"2023-09-30T17:05:03.293603+0000","last_peered":"2023-09-30T17:05:03.293603+0000","last_clean":"2023-09-30T17:05:03.293603+0000","last_became_active":"2023-09-30T17:02:17.358582+0000","last_became_peered":"2023-09-30T17:02:17.358582+0000","last_unstale":"2023-09-30T17:05:03.293603+0000","last_undegraded":"2023-09-30T17:05:03.293603+0000","last_fullsized":"2023-09-30T17:05:03.293603+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:52:37.518693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"59'8580","reported_seq":8641,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.294204+0000","last_change":"2023-09-30T17:02:18.364478+0000","last_active":"2023-09-30T17:05:03.294204+0000","last_peered":"2023-09-30T17:05:03.294204+0000","last_clean":"2023-09-30T17:05:03.294204+0000","last_became_active":"2023-09-30T17:02:18.364057+0000","last_became_peered":"2023-09-30T17:02:18.364057+0000","last_unstale":"2023-09-30T17:05:03.294204+0000","last_undegraded":"2023-09-30T17:05:03.294204+0000","last_fullsized":"2023-09-30T17:05:03.294204+0000","mapping_epoch":17,"log_start":"49'4400","ondisk_log_start":"49'4400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4180,"log_dups_size":4400,"ondisk_log_size":4180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:13:55.555700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25046,"num_write_kb":118972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":65,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.294666+0000","last_change":"2023-09-30T17:02:12.327704+0000","last_active":"2023-09-30T17:05:03.294666+0000","last_peered":"2023-09-30T17:05:03.294666+0000","last_clean":"2023-09-30T17:05:03.294666+0000","last_became_active":"2023-09-30T17:02:12.327384+0000","last_became_peered":"2023-09-30T17:02:12.327384+0000","last_unstale":"2023-09-30T17:05:03.294666+0000","last_undegraded":"2023-09-30T17:05:03.294666+0000","last_fullsized":"2023-09-30T17:05:03.294666+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:09:34.818252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.283769+0000","last_change":"2023-09-30T17:05:03.311271+0000","last_active":"2023-09-30T17:05:05.283769+0000","last_peered":"2023-09-30T17:05:05.283769+0000","last_clean":"2023-09-30T17:05:05.283769+0000","last_became_active":"2023-09-30T17:05:03.310655+0000","last_became_peered":"2023-09-30T17:05:03.310655+0000","last_unstale":"2023-09-30T17:05:05.283769+0000","last_undegraded":"2023-09-30T17:05:05.283769+0000","last_fullsized":"2023-09-30T17:05:05.283769+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:49:35.748952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"59'9","reported_seq":81,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.307847+0000","last_change":"2023-09-30T17:05:03.306223+0000","last_active":"2023-09-30T17:05:03.307847+0000","last_peered":"2023-09-30T17:05:03.307847+0000","last_clean":"2023-09-30T17:05:03.307847+0000","last_became_active":"2023-09-30T17:05:03.305956+0000","last_became_peered":"2023-09-30T17:05:03.305956+0000","last_unstale":"2023-09-30T17:05:03.307847+0000","last_undegraded":"2023-09-30T17:05:03.307847+0000","last_fullsized":"2023-09-30T17:05:03.307847+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:32:56.502917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.280424+0000","last_change":"2023-09-30T17:05:03.309359+0000","last_active":"2023-09-30T17:05:05.280424+0000","last_peered":"2023-09-30T17:05:05.280424+0000","last_clean":"2023-09-30T17:05:05.280424+0000","last_became_active":"2023-09-30T17:05:03.308944+0000","last_became_peered":"2023-09-30T17:05:03.308944+0000","last_unstale":"2023-09-30T17:05:05.280424+0000","last_undegraded":"2023-09-30T17:05:05.280424+0000","last_fullsized":"2023-09-30T17:05:05.280424+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:02:58.156693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.284199+0000","last_change":"2023-09-30T17:05:03.311106+0000","last_active":"2023-09-30T17:05:05.284199+0000","last_peered":"2023-09-30T17:05:05.284199+0000","last_clean":"2023-09-30T17:05:05.284199+0000","last_became_active":"2023-09-30T17:05:03.310706+0000","last_became_peered":"2023-09-30T17:05:03.310706+0000","last_unstale":"2023-09-30T17:05:05.284199+0000","last_undegraded":"2023-09-30T17:05:05.284199+0000","last_fullsized":"2023-09-30T17:05:05.284199+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:04:03.231664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"59'9","reported_seq":70,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.294333+0000","last_change":"2023-09-30T17:02:18.363399+0000","last_active":"2023-09-30T17:05:03.294333+0000","last_peered":"2023-09-30T17:05:03.294333+0000","last_clean":"2023-09-30T17:05:03.294333+0000","last_became_active":"2023-09-30T17:02:18.363064+0000","last_became_peered":"2023-09-30T17:02:18.363064+0000","last_unstale":"2023-09-30T17:05:03.294333+0000","last_undegraded":"2023-09-30T17:05:03.294333+0000","last_fullsized":"2023-09-30T17:05:03.294333+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:32:34.654264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":65,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.293056+0000","last_change":"2023-09-30T17:02:12.327834+0000","last_active":"2023-09-30T17:05:03.293056+0000","last_peered":"2023-09-30T17:05:03.293056+0000","last_clean":"2023-09-30T17:05:03.293056+0000","last_became_active":"2023-09-30T17:02:12.327542+0000","last_became_peered":"2023-09-30T17:02:12.327542+0000","last_unstale":"2023-09-30T17:05:03.293056+0000","last_undegraded":"2023-09-30T17:05:03.293056+0000","last_fullsized":"2023-09-30T17:05:03.293056+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:49:54.890769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":73,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.307435+0000","last_change":"2023-09-30T17:05:03.305668+0000","last_active":"2023-09-30T17:05:03.307435+0000","last_peered":"2023-09-30T17:05:03.307435+0000","last_clean":"2023-09-30T17:05:03.307435+0000","last_became_active":"2023-09-30T17:05:03.305222+0000","last_became_peered":"2023-09-30T17:05:03.305222+0000","last_unstale":"2023-09-30T17:05:03.307435+0000","last_undegraded":"2023-09-30T17:05:03.307435+0000","last_fullsized":"2023-09-30T17:05:03.307435+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:17:12.662422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"59'6","reported_seq":67,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.295500+0000","last_change":"2023-09-30T17:02:18.364406+0000","last_active":"2023-09-30T17:05:03.295500+0000","last_peered":"2023-09-30T17:05:03.295500+0000","last_clean":"2023-09-30T17:05:03.295500+0000","last_became_active":"2023-09-30T17:02:18.363849+0000","last_became_peered":"2023-09-30T17:02:18.363849+0000","last_unstale":"2023-09-30T17:05:03.295500+0000","last_undegraded":"2023-09-30T17:05:03.295500+0000","last_fullsized":"2023-09-30T17:05:03.295500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:43:29.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.280604+0000","last_change":"2023-09-30T17:05:03.310062+0000","last_active":"2023-09-30T17:05:05.280604+0000","last_peered":"2023-09-30T17:05:05.280604+0000","last_clean":"2023-09-30T17:05:05.280604+0000","last_became_active":"2023-09-30T17:05:03.308958+0000","last_became_peered":"2023-09-30T17:05:03.308958+0000","last_unstale":"2023-09-30T17:05:05.280604+0000","last_undegraded":"2023-09-30T17:05:05.280604+0000","last_fullsized":"2023-09-30T17:05:05.280604+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:05:26.347633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":219,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.282381+0000","last_change":"2023-09-30T17:05:03.303046+0000","last_active":"2023-09-30T17:05:05.282381+0000","last_peered":"2023-09-30T17:05:05.282381+0000","last_clean":"2023-09-30T17:05:05.282381+0000","last_became_active":"2023-09-30T17:05:03.302265+0000","last_became_peered":"2023-09-30T17:05:03.302265+0000","last_unstale":"2023-09-30T17:05:05.282381+0000","last_undegraded":"2023-09-30T17:05:05.282381+0000","last_fullsized":"2023-09-30T17:05:05.282381+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:06.295501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:06.295501+0000","last_clean_scrub_stamp":"2023-09-30T17:02:06.295501+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:07:24.603358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":62,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.293005+0000","last_change":"2023-09-30T17:02:17.357139+0000","last_active":"2023-09-30T17:05:03.293005+0000","last_peered":"2023-09-30T17:05:03.293005+0000","last_clean":"2023-09-30T17:05:03.293005+0000","last_became_active":"2023-09-30T17:02:17.356901+0000","last_became_peered":"2023-09-30T17:02:17.356901+0000","last_unstale":"2023-09-30T17:05:03.293005+0000","last_undegraded":"2023-09-30T17:05:03.293005+0000","last_fullsized":"2023-09-30T17:05:03.293005+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:22:35.747671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"59'7","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.281124+0000","last_change":"2023-09-30T17:05:03.305199+0000","last_active":"2023-09-30T17:05:05.281124+0000","last_peered":"2023-09-30T17:05:05.281124+0000","last_clean":"2023-09-30T17:05:05.281124+0000","last_became_active":"2023-09-30T17:05:03.304974+0000","last_became_peered":"2023-09-30T17:05:03.304974+0000","last_unstale":"2023-09-30T17:05:05.281124+0000","last_undegraded":"2023-09-30T17:05:05.281124+0000","last_fullsized":"2023-09-30T17:05:05.281124+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:03:27.429545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.282624+0000","last_change":"2023-09-30T17:05:03.303739+0000","last_active":"2023-09-30T17:05:05.282624+0000","last_peered":"2023-09-30T17:05:05.282624+0000","last_clean":"2023-09-30T17:05:05.282624+0000","last_became_active":"2023-09-30T17:05:03.302590+0000","last_became_peered":"2023-09-30T17:05:03.302590+0000","last_unstale":"2023-09-30T17:05:05.282624+0000","last_undegraded":"2023-09-30T17:05:05.282624+0000","last_fullsized":"2023-09-30T17:05:05.282624+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:51:30.199616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"59'5","reported_seq":86,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.318953+0000","last_change":"2023-09-30T17:05:03.318439+0000","last_active":"2023-09-30T17:05:03.318953+0000","last_peered":"2023-09-30T17:05:03.318953+0000","last_clean":"2023-09-30T17:05:03.318953+0000","last_became_active":"2023-09-30T17:05:03.308059+0000","last_became_peered":"2023-09-30T17:05:03.308059+0000","last_unstale":"2023-09-30T17:05:03.318953+0000","last_undegraded":"2023-09-30T17:05:03.318953+0000","last_fullsized":"2023-09-30T17:05:03.318953+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:16:25.170638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"59'11252","reported_seq":11313,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.296974+0000","last_change":"2023-09-30T17:02:18.360029+0000","last_active":"2023-09-30T17:05:03.296974+0000","last_peered":"2023-09-30T17:05:03.296974+0000","last_clean":"2023-09-30T17:05:03.296974+0000","last_became_active":"2023-09-30T17:02:18.356839+0000","last_became_peered":"2023-09-30T17:02:18.356839+0000","last_unstale":"2023-09-30T17:05:03.296974+0000","last_undegraded":"2023-09-30T17:05:03.296974+0000","last_fullsized":"2023-09-30T17:05:03.296974+0000","mapping_epoch":17,"log_start":"51'6700","ondisk_log_start":"51'6700","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4552,"log_dups_size":6700,"ondisk_log_size":4552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:16:27.516884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33068,"num_write_kb":157144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":65,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.297064+0000","last_change":"2023-09-30T17:02:12.330472+0000","last_active":"2023-09-30T17:05:03.297064+0000","last_peered":"2023-09-30T17:05:03.297064+0000","last_clean":"2023-09-30T17:05:03.297064+0000","last_became_active":"2023-09-30T17:02:12.330154+0000","last_became_peered":"2023-09-30T17:02:12.330154+0000","last_unstale":"2023-09-30T17:05:03.297064+0000","last_undegraded":"2023-09-30T17:05:03.297064+0000","last_fullsized":"2023-09-30T17:05:03.297064+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:43:23.161734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":62,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.304831+0000","last_change":"2023-09-30T17:02:17.361007+0000","last_active":"2023-09-30T17:05:03.304831+0000","last_peered":"2023-09-30T17:05:03.304831+0000","last_clean":"2023-09-30T17:05:03.304831+0000","last_became_active":"2023-09-30T17:02:17.360721+0000","last_became_peered":"2023-09-30T17:02:17.360721+0000","last_unstale":"2023-09-30T17:05:03.304831+0000","last_undegraded":"2023-09-30T17:05:03.304831+0000","last_fullsized":"2023-09-30T17:05:03.304831+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:13:41.205152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"59'2836","reported_seq":2910,"reported_epoch":68,"state":"active+undersized+remapped","last_fresh":"2023-09-30T17:05:04.642669+0000","last_change":"2023-09-30T17:05:04.642880+0000","last_active":"2023-09-30T17:05:04.642669+0000","last_peered":"2023-09-30T17:05:04.642669+0000","last_clean":"2023-09-30T17:02:44.410053+0000","last_became_active":"2023-09-30T17:05:04.617448+0000","last_became_peered":"2023-09-30T17:05:04.617448+0000","last_unstale":"2023-09-30T17:05:04.642669+0000","last_undegraded":"2023-09-30T17:05:04.642669+0000","last_fullsized":"2023-09-30T17:05:04.295696+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2836,"log_dups_size":0,"ondisk_log_size":2836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:53:07.255711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8199,"num_write_kb":39048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"59'3","reported_seq":65,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.294146+0000","last_change":"2023-09-30T17:02:17.360831+0000","last_active":"2023-09-30T17:05:03.294146+0000","last_peered":"2023-09-30T17:05:03.294146+0000","last_clean":"2023-09-30T17:05:03.294146+0000","last_became_active":"2023-09-30T17:02:17.360494+0000","last_became_peered":"2023-09-30T17:02:17.360494+0000","last_unstale":"2023-09-30T17:05:03.294146+0000","last_undegraded":"2023-09-30T17:05:03.294146+0000","last_fullsized":"2023-09-30T17:05:03.294146+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:24:04.564387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":65,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.298199+0000","last_change":"2023-09-30T17:02:12.328184+0000","last_active":"2023-09-30T17:05:03.298199+0000","last_peered":"2023-09-30T17:05:03.298199+0000","last_clean":"2023-09-30T17:05:03.298199+0000","last_became_active":"2023-09-30T17:02:12.327898+0000","last_became_peered":"2023-09-30T17:02:12.327898+0000","last_unstale":"2023-09-30T17:05:03.298199+0000","last_undegraded":"2023-09-30T17:05:03.298199+0000","last_fullsized":"2023-09-30T17:05:03.298199+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:43:23.161734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"59'8","reported_seq":80,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.309894+0000","last_change":"2023-09-30T17:05:03.308856+0000","last_active":"2023-09-30T17:05:03.309894+0000","last_peered":"2023-09-30T17:05:03.309894+0000","last_clean":"2023-09-30T17:05:03.309894+0000","last_became_active":"2023-09-30T17:05:03.308429+0000","last_became_peered":"2023-09-30T17:05:03.308429+0000","last_unstale":"2023-09-30T17:05:03.309894+0000","last_undegraded":"2023-09-30T17:05:03.309894+0000","last_fullsized":"2023-09-30T17:05:03.309894+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:49:32.189339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.281043+0000","last_change":"2023-09-30T17:05:03.304353+0000","last_active":"2023-09-30T17:05:05.281043+0000","last_peered":"2023-09-30T17:05:05.281043+0000","last_clean":"2023-09-30T17:05:05.281043+0000","last_became_active":"2023-09-30T17:05:03.302503+0000","last_became_peered":"2023-09-30T17:05:03.302503+0000","last_unstale":"2023-09-30T17:05:05.281043+0000","last_undegraded":"2023-09-30T17:05:05.281043+0000","last_fullsized":"2023-09-30T17:05:05.281043+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:19:16.151598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"60'8","reported_seq":86,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.315262+0000","last_change":"2023-09-30T17:05:03.314806+0000","last_active":"2023-09-30T17:05:03.315262+0000","last_peered":"2023-09-30T17:05:03.315262+0000","last_clean":"2023-09-30T17:05:03.315262+0000","last_became_active":"2023-09-30T17:05:03.308201+0000","last_became_peered":"2023-09-30T17:05:03.308201+0000","last_unstale":"2023-09-30T17:05:03.315262+0000","last_undegraded":"2023-09-30T17:05:03.315262+0000","last_fullsized":"2023-09-30T17:05:03.315262+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:19:18.486570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"59'6","reported_seq":78,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.305327+0000","last_change":"2023-09-30T17:05:03.304265+0000","last_active":"2023-09-30T17:05:03.305327+0000","last_peered":"2023-09-30T17:05:03.305327+0000","last_clean":"2023-09-30T17:05:03.305327+0000","last_became_active":"2023-09-30T17:05:03.304022+0000","last_became_peered":"2023-09-30T17:05:03.304022+0000","last_unstale":"2023-09-30T17:05:03.305327+0000","last_undegraded":"2023-09-30T17:05:03.305327+0000","last_fullsized":"2023-09-30T17:05:03.305327+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:19:19.492200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":74,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.305185+0000","last_change":"2023-09-30T17:05:03.303927+0000","last_active":"2023-09-30T17:05:03.305185+0000","last_peered":"2023-09-30T17:05:03.305185+0000","last_clean":"2023-09-30T17:05:03.305185+0000","last_became_active":"2023-09-30T17:05:03.303487+0000","last_became_peered":"2023-09-30T17:05:03.303487+0000","last_unstale":"2023-09-30T17:05:03.305185+0000","last_undegraded":"2023-09-30T17:05:03.305185+0000","last_fullsized":"2023-09-30T17:05:03.305185+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:43:27.633747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"59'2835","reported_seq":2896,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.295442+0000","last_change":"2023-09-30T17:02:18.358269+0000","last_active":"2023-09-30T17:05:03.295442+0000","last_peered":"2023-09-30T17:05:03.295442+0000","last_clean":"2023-09-30T17:05:03.295442+0000","last_became_active":"2023-09-30T17:02:18.356902+0000","last_became_peered":"2023-09-30T17:02:18.356902+0000","last_unstale":"2023-09-30T17:05:03.295442+0000","last_undegraded":"2023-09-30T17:05:03.295442+0000","last_fullsized":"2023-09-30T17:05:03.295442+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2835,"log_dups_size":0,"ondisk_log_size":2835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:39:28.022201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8302,"num_write_kb":39500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":26,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.284119+0000","last_change":"2023-09-30T17:05:03.311401+0000","last_active":"2023-09-30T17:05:05.284119+0000","last_peered":"2023-09-30T17:05:05.284119+0000","last_clean":"2023-09-30T17:05:05.284119+0000","last_became_active":"2023-09-30T17:05:03.310996+0000","last_became_peered":"2023-09-30T17:05:03.310996+0000","last_unstale":"2023-09-30T17:05:05.284119+0000","last_undegraded":"2023-09-30T17:05:05.284119+0000","last_fullsized":"2023-09-30T17:05:05.284119+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:28:19.097868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"59'2848","reported_seq":2908,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.290586+0000","last_change":"2023-09-30T17:05:06.290662+0000","last_active":"2023-09-30T17:05:06.290586+0000","last_peered":"2023-09-30T17:05:06.290586+0000","last_clean":"2023-09-30T17:02:17.339234+0000","last_became_active":"2023-09-30T17:05:06.289599+0000","last_became_peered":"2023-09-30T17:05:06.289599+0000","last_unstale":"2023-09-30T17:05:06.290586+0000","last_undegraded":"2023-09-30T17:05:06.290586+0000","last_fullsized":"2023-09-30T17:05:06.290586+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2848,"log_dups_size":0,"ondisk_log_size":2848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:20:28.670256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8235,"num_write_kb":39276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"58'3","reported_seq":77,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.309314+0000","last_change":"2023-09-30T17:05:03.307212+0000","last_active":"2023-09-30T17:05:03.309314+0000","last_peered":"2023-09-30T17:05:03.309314+0000","last_clean":"2023-09-30T17:05:03.309314+0000","last_became_active":"2023-09-30T17:05:03.306711+0000","last_became_peered":"2023-09-30T17:05:03.306711+0000","last_unstale":"2023-09-30T17:05:03.309314+0000","last_undegraded":"2023-09-30T17:05:03.309314+0000","last_fullsized":"2023-09-30T17:05:03.309314+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:11:56.900744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"59'10","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.282885+0000","last_change":"2023-09-30T17:05:03.311669+0000","last_active":"2023-09-30T17:05:05.282885+0000","last_peered":"2023-09-30T17:05:05.282885+0000","last_clean":"2023-09-30T17:05:05.282885+0000","last_became_active":"2023-09-30T17:05:03.310763+0000","last_became_peered":"2023-09-30T17:05:03.310763+0000","last_unstale":"2023-09-30T17:05:05.282885+0000","last_undegraded":"2023-09-30T17:05:05.282885+0000","last_fullsized":"2023-09-30T17:05:05.282885+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:36:53.333402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":63,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.298122+0000","last_change":"2023-09-30T17:02:17.360802+0000","last_active":"2023-09-30T17:05:03.298122+0000","last_peered":"2023-09-30T17:05:03.298122+0000","last_clean":"2023-09-30T17:05:03.298122+0000","last_became_active":"2023-09-30T17:02:17.360475+0000","last_became_peered":"2023-09-30T17:02:17.360475+0000","last_unstale":"2023-09-30T17:05:03.298122+0000","last_undegraded":"2023-09-30T17:05:03.298122+0000","last_fullsized":"2023-09-30T17:05:03.298122+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:50:18.455188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"59'5711","reported_seq":5772,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.295234+0000","last_change":"2023-09-30T17:02:18.359857+0000","last_active":"2023-09-30T17:05:03.295234+0000","last_peered":"2023-09-30T17:05:03.295234+0000","last_clean":"2023-09-30T17:05:03.295234+0000","last_became_active":"2023-09-30T17:02:18.357098+0000","last_became_peered":"2023-09-30T17:02:18.357098+0000","last_unstale":"2023-09-30T17:05:03.295234+0000","last_undegraded":"2023-09-30T17:05:03.295234+0000","last_fullsized":"2023-09-30T17:05:03.295234+0000","mapping_epoch":17,"log_start":"42'1200","ondisk_log_start":"42'1200","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4511,"log_dups_size":1200,"ondisk_log_size":4511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:48:17.598726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16681,"num_write_kb":79476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":77,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.314213+0000","last_change":"2023-09-30T17:05:03.313345+0000","last_active":"2023-09-30T17:05:03.314213+0000","last_peered":"2023-09-30T17:05:03.314213+0000","last_clean":"2023-09-30T17:05:03.314213+0000","last_became_active":"2023-09-30T17:05:03.313050+0000","last_became_peered":"2023-09-30T17:05:03.313050+0000","last_unstale":"2023-09-30T17:05:03.314213+0000","last_undegraded":"2023-09-30T17:05:03.314213+0000","last_fullsized":"2023-09-30T17:05:03.314213+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:24:52.247523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"59'2872","reported_seq":2933,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.290298+0000","last_change":"2023-09-30T17:05:06.290298+0000","last_active":"2023-09-30T17:05:06.290298+0000","last_peered":"2023-09-30T17:05:06.290298+0000","last_clean":"2023-09-30T17:05:06.290298+0000","last_became_active":"2023-09-30T17:05:06.289197+0000","last_became_peered":"2023-09-30T17:05:06.289197+0000","last_unstale":"2023-09-30T17:05:06.290298+0000","last_undegraded":"2023-09-30T17:05:06.290298+0000","last_fullsized":"2023-09-30T17:05:06.290298+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2872,"log_dups_size":0,"ondisk_log_size":2872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:57:10.410506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8447,"num_write_kb":40072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"59'9","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.282853+0000","last_change":"2023-09-30T17:05:03.310950+0000","last_active":"2023-09-30T17:05:05.282853+0000","last_peered":"2023-09-30T17:05:05.282853+0000","last_clean":"2023-09-30T17:05:05.282853+0000","last_became_active":"2023-09-30T17:05:03.310591+0000","last_became_peered":"2023-09-30T17:05:03.310591+0000","last_unstale":"2023-09-30T17:05:05.282853+0000","last_undegraded":"2023-09-30T17:05:05.282853+0000","last_fullsized":"2023-09-30T17:05:05.282853+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:26:23.194138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"59'13","reported_seq":74,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.292739+0000","last_change":"2023-09-30T17:02:18.363479+0000","last_active":"2023-09-30T17:05:03.292739+0000","last_peered":"2023-09-30T17:05:03.292739+0000","last_clean":"2023-09-30T17:05:03.292739+0000","last_became_active":"2023-09-30T17:02:18.363222+0000","last_became_peered":"2023-09-30T17:02:18.363222+0000","last_unstale":"2023-09-30T17:05:03.292739+0000","last_undegraded":"2023-09-30T17:05:03.292739+0000","last_fullsized":"2023-09-30T17:05:03.292739+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:09:55.056098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"59'2796","reported_seq":2866,"reported_epoch":68,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2023-09-30T17:05:04.682115+0000","last_change":"2023-09-30T17:05:04.682273+0000","last_active":"2023-09-30T17:05:04.682115+0000","last_peered":"2023-09-30T17:05:04.682115+0000","last_clean":"2023-09-30T17:02:44.410028+0000","last_became_active":"2023-09-30T17:05:04.681285+0000","last_became_peered":"2023-09-30T17:05:04.681285+0000","last_unstale":"2023-09-30T17:05:04.682115+0000","last_undegraded":"2023-09-30T17:05:04.356486+0000","last_fullsized":"2023-09-30T17:05:04.343762+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2796,"log_dups_size":0,"ondisk_log_size":2796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:00:48.822153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8138,"num_write_kb":38784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"59'2852","reported_seq":2913,"reported_epoch":67,"state":"active+clean","last_fresh":"2023-09-30T17:05:03.293972+0000","last_change":"2023-09-30T17:02:18.363216+0000","last_active":"2023-09-30T17:05:03.293972+0000","last_peered":"2023-09-30T17:05:03.293972+0000","last_clean":"2023-09-30T17:05:03.293972+0000","last_became_active":"2023-09-30T17:02:18.362894+0000","last_became_peered":"2023-09-30T17:02:18.362894+0000","last_unstale":"2023-09-30T17:05:03.293972+0000","last_undegraded":"2023-09-30T17:05:03.293972+0000","last_fullsized":"2023-09-30T17:05:03.293972+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2852,"log_dups_size":0,"ondisk_log_size":2852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:30:43.782165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8357,"num_write_kb":39780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"59'2874","reported_seq":2944,"reported_epoch":68,"state":"active+recovery_wait+undersized+degraded+remapped","last_fresh":"2023-09-30T17:05:04.685576+0000","last_change":"2023-09-30T17:05:04.685685+0000","last_active":"2023-09-30T17:05:04.685576+0000","last_peered":"2023-09-30T17:05:04.685576+0000","last_clean":"2023-09-30T17:02:44.410264+0000","last_became_active":"2023-09-30T17:05:04.684696+0000","last_became_peered":"2023-09-30T17:05:04.684696+0000","last_unstale":"2023-09-30T17:05:04.685576+0000","last_undegraded":"2023-09-30T17:05:04.350239+0000","last_fullsized":"2023-09-30T17:05:04.296131+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2874,"log_dups_size":0,"ondisk_log_size":2874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:13:34.205219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":1,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8465,"num_write_kb":40104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0],"avail_no_missing":["0"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":6,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":532685,"num_write_kb":2575302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140940,"ondisk_log_size":140940,"up":128,"acting":118,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":228927,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":137,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":223425,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":524288,"data_stored":457854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":66,"seq":283467841538,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":46988,"kb_used_data":1404,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94324852,"statfs":{"total":96636764160,"available":96588648448,"internally_reserved":0,"allocated":1437696,"data_stored":1094369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7139,"internal_metadata":46654493},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738407,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":582384,"kb_used_data":1372,"kb_used_omap":1,"kb_used_meta":580990,"kb_avail":93789456,"statfs":{"total":96636764160,"available":96040402944,"internally_reserved":0,"allocated":1404928,"data_stored":1083533,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":594934214},"hb_peers":[1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 17:04:07 2023","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.46899999999999997,"15min":0.47299999999999998},"min":{"1min":0.21299999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":1.7789999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.34999999999999998,"5min":0.42499999999999999,"15min":0.437},"min":{"1min":0.20899999999999999,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.59299999999999997,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.51600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]}]},{"osd":1,"up_from":8,"seq":34359738407,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":563528,"kb_used_data":572,"kb_used_omap":1,"kb_used_meta":562942,"kb_avail":93808312,"statfs":{"total":96636764160,"available":96059711488,"internally_reserved":0,"allocated":585728,"data_stored":271543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":576453062},"hb_peers":[0],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 17:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.432,"15min":0.438},"min":{"1min":0.17100000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":1.831,"5min":1.831,"15min":1.831},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.46600000000000003,"15min":0.44500000000000001},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":2.5430000000000001,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":0.32800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":249856,"data_stored":227705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":228927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T17:05:13.901 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T17:05:14.332 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:05:14.334 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-09-30T17:05:14.340 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":162,"stamp":"2023-09-30T17:05:13.336121+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":819295,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":140,"num_read_kb":122,"num_write":533025,"num_write_kb":2579054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":223425,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141229,"ondisk_log_size":141229,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1192964,"kb_used_data":3400,"kb_used_omap":10,"kb_used_meta":1189493,"kb_avail":281922556,"statfs":{"total":289910292480,"available":288688697344,"internally_reserved":0,"allocated":3481600,"data_stored":2476520,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10327,"internal_metadata":1218041769},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":-29,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":222729,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.057269"},"pg_stats":[{"pgid":"4.3f","version":"59'2790","reported_seq":2853,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.283280+0000","last_change":"2023-09-30T17:02:18.360288+0000","last_active":"2023-09-30T17:05:05.283280+0000","last_peered":"2023-09-30T17:05:05.283280+0000","last_clean":"2023-09-30T17:05:05.283280+0000","last_became_active":"2023-09-30T17:02:18.358716+0000","last_became_peered":"2023-09-30T17:02:18.358716+0000","last_unstale":"2023-09-30T17:05:05.283280+0000","last_undegraded":"2023-09-30T17:05:05.283280+0000","last_fullsized":"2023-09-30T17:05:05.283280+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2790,"log_dups_size":0,"ondisk_log_size":2790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:12:06.380095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8214,"num_write_kb":38924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"59'4","reported_seq":67,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.282174+0000","last_change":"2023-09-30T17:02:18.362418+0000","last_active":"2023-09-30T17:05:05.282174+0000","last_peered":"2023-09-30T17:05:05.282174+0000","last_clean":"2023-09-30T17:05:05.282174+0000","last_became_active":"2023-09-30T17:02:18.360372+0000","last_became_peered":"2023-09-30T17:02:18.360372+0000","last_unstale":"2023-09-30T17:05:05.282174+0000","last_undegraded":"2023-09-30T17:05:05.282174+0000","last_fullsized":"2023-09-30T17:05:05.282174+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:43:29.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"59'5697","reported_seq":5765,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.291597+0000","last_change":"2023-09-30T17:05:06.291597+0000","last_active":"2023-09-30T17:05:06.291597+0000","last_peered":"2023-09-30T17:05:06.291597+0000","last_clean":"2023-09-30T17:05:06.291597+0000","last_became_active":"2023-09-30T17:05:06.290447+0000","last_became_peered":"2023-09-30T17:05:06.290447+0000","last_unstale":"2023-09-30T17:05:06.291597+0000","last_undegraded":"2023-09-30T17:05:06.291597+0000","last_fullsized":"2023-09-30T17:05:06.291597+0000","mapping_epoch":69,"log_start":"42'1200","ondisk_log_start":"42'1200","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4497,"log_dups_size":1200,"ondisk_log_size":4497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:02:21.064107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16590,"num_write_kb":78960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"59'10","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.280683+0000","last_change":"2023-09-30T17:05:03.309996+0000","last_active":"2023-09-30T17:05:05.280683+0000","last_peered":"2023-09-30T17:05:05.280683+0000","last_clean":"2023-09-30T17:05:05.280683+0000","last_became_active":"2023-09-30T17:05:03.309326+0000","last_became_peered":"2023-09-30T17:05:03.309326+0000","last_unstale":"2023-09-30T17:05:05.280683+0000","last_undegraded":"2023-09-30T17:05:05.280683+0000","last_fullsized":"2023-09-30T17:05:05.280683+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:31:23.164242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"59'2934","reported_seq":2997,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.282475+0000","last_change":"2023-09-30T17:02:18.360192+0000","last_active":"2023-09-30T17:05:05.282475+0000","last_peered":"2023-09-30T17:05:05.282475+0000","last_clean":"2023-09-30T17:05:05.282475+0000","last_became_active":"2023-09-30T17:02:18.357317+0000","last_became_peered":"2023-09-30T17:02:18.357317+0000","last_unstale":"2023-09-30T17:05:05.282475+0000","last_undegraded":"2023-09-30T17:05:05.282475+0000","last_fullsized":"2023-09-30T17:05:05.282475+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2934,"log_dups_size":0,"ondisk_log_size":2934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:37:14.790993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8466,"num_write_kb":40084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"59'6","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.282788+0000","last_change":"2023-09-30T17:05:03.311318+0000","last_active":"2023-09-30T17:05:05.282788+0000","last_peered":"2023-09-30T17:05:05.282788+0000","last_clean":"2023-09-30T17:05:05.282788+0000","last_became_active":"2023-09-30T17:05:03.310703+0000","last_became_peered":"2023-09-30T17:05:03.310703+0000","last_unstale":"2023-09-30T17:05:05.282788+0000","last_undegraded":"2023-09-30T17:05:05.282788+0000","last_fullsized":"2023-09-30T17:05:05.282788+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:08:45.345559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"59'7","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.281077+0000","last_change":"2023-09-30T17:05:03.310838+0000","last_active":"2023-09-30T17:05:05.281077+0000","last_peered":"2023-09-30T17:05:05.281077+0000","last_clean":"2023-09-30T17:05:05.281077+0000","last_became_active":"2023-09-30T17:05:03.310047+0000","last_became_peered":"2023-09-30T17:05:03.310047+0000","last_unstale":"2023-09-30T17:05:05.281077+0000","last_undegraded":"2023-09-30T17:05:05.281077+0000","last_fullsized":"2023-09-30T17:05:05.281077+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:29:17.418059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"59'11423","reported_seq":11493,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.286653+0000","last_change":"2023-09-30T17:05:06.286653+0000","last_active":"2023-09-30T17:05:06.286653+0000","last_peered":"2023-09-30T17:05:06.286653+0000","last_clean":"2023-09-30T17:05:06.286653+0000","last_became_active":"2023-09-30T17:05:06.285582+0000","last_became_peered":"2023-09-30T17:05:06.285582+0000","last_unstale":"2023-09-30T17:05:06.286653+0000","last_undegraded":"2023-09-30T17:05:06.286653+0000","last_fullsized":"2023-09-30T17:05:06.286653+0000","mapping_epoch":69,"log_start":"52'7200","ondisk_log_start":"52'7200","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4223,"log_dups_size":5777,"ondisk_log_size":4223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:35:18.578031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33444,"num_write_kb":158924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"59'8589","reported_seq":8652,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.281971+0000","last_change":"2023-09-30T17:02:18.364222+0000","last_active":"2023-09-30T17:05:05.281971+0000","last_peered":"2023-09-30T17:05:05.281971+0000","last_clean":"2023-09-30T17:05:05.281971+0000","last_became_active":"2023-09-30T17:02:18.363485+0000","last_became_peered":"2023-09-30T17:02:18.363485+0000","last_unstale":"2023-09-30T17:05:05.281971+0000","last_undegraded":"2023-09-30T17:05:05.281971+0000","last_fullsized":"2023-09-30T17:05:05.281971+0000","mapping_epoch":17,"log_start":"49'4400","ondisk_log_start":"49'4400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4189,"log_dups_size":4400,"ondisk_log_size":4189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:14:35.192615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25052,"num_write_kb":118756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"59'8585","reported_seq":8648,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.282669+0000","last_change":"2023-09-30T17:02:18.360010+0000","last_active":"2023-09-30T17:05:05.282669+0000","last_peered":"2023-09-30T17:05:05.282669+0000","last_clean":"2023-09-30T17:05:05.282669+0000","last_became_active":"2023-09-30T17:02:18.358396+0000","last_became_peered":"2023-09-30T17:02:18.358396+0000","last_unstale":"2023-09-30T17:05:05.282669+0000","last_undegraded":"2023-09-30T17:05:05.282669+0000","last_fullsized":"2023-09-30T17:05:05.282669+0000","mapping_epoch":17,"log_start":"48'4100","ondisk_log_start":"48'4100","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4485,"log_dups_size":4100,"ondisk_log_size":4485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:26:11.522402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24997,"num_write_kb":162463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"59'5664","reported_seq":5734,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.291535+0000","last_change":"2023-09-30T17:05:06.291535+0000","last_active":"2023-09-30T17:05:06.291535+0000","last_peered":"2023-09-30T17:05:06.291535+0000","last_clean":"2023-09-30T17:05:06.291535+0000","last_became_active":"2023-09-30T17:05:06.290193+0000","last_became_peered":"2023-09-30T17:05:06.290193+0000","last_unstale":"2023-09-30T17:05:06.291535+0000","last_undegraded":"2023-09-30T17:05:06.291535+0000","last_fullsized":"2023-09-30T17:05:06.291535+0000","mapping_epoch":69,"log_start":"43'1400","ondisk_log_start":"43'1400","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4264,"log_dups_size":1400,"ondisk_log_size":4264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:21:15.508580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16442,"num_write_kb":78308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"59'2931","reported_seq":3014,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.290270+0000","last_change":"2023-09-30T17:05:06.290270+0000","last_active":"2023-09-30T17:05:06.290270+0000","last_peered":"2023-09-30T17:05:06.290270+0000","last_clean":"2023-09-30T17:05:06.290270+0000","last_became_active":"2023-09-30T17:05:06.288753+0000","last_became_peered":"2023-09-30T17:05:06.288753+0000","last_unstale":"2023-09-30T17:05:06.290270+0000","last_undegraded":"2023-09-30T17:05:06.290270+0000","last_fullsized":"2023-09-30T17:05:06.290270+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2931,"log_dups_size":0,"ondisk_log_size":2931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:38:30.988146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8488,"num_write_kb":40364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"59'2860","reported_seq":2923,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.281923+0000","last_change":"2023-09-30T17:02:18.359894+0000","last_active":"2023-09-30T17:05:05.281923+0000","last_peered":"2023-09-30T17:05:05.281923+0000","last_clean":"2023-09-30T17:05:05.281923+0000","last_became_active":"2023-09-30T17:02:18.358534+0000","last_became_peered":"2023-09-30T17:02:18.358534+0000","last_unstale":"2023-09-30T17:05:05.281923+0000","last_undegraded":"2023-09-30T17:05:05.281923+0000","last_fullsized":"2023-09-30T17:05:05.281923+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2860,"log_dups_size":0,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:22:13.025181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8367,"num_write_kb":39772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"59'2911","reported_seq":2972,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.289465+0000","last_change":"2023-09-30T17:05:06.289465+0000","last_active":"2023-09-30T17:05:06.289465+0000","last_peered":"2023-09-30T17:05:06.289465+0000","last_clean":"2023-09-30T17:05:06.289465+0000","last_became_active":"2023-09-30T17:05:06.288360+0000","last_became_peered":"2023-09-30T17:05:06.288360+0000","last_unstale":"2023-09-30T17:05:06.289465+0000","last_undegraded":"2023-09-30T17:05:06.289465+0000","last_fullsized":"2023-09-30T17:05:06.289465+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2911,"log_dups_size":0,"ondisk_log_size":2911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:53:55.381223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8419,"num_write_kb":39940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"59'2889","reported_seq":2950,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.286551+0000","last_change":"2023-09-30T17:05:06.286551+0000","last_active":"2023-09-30T17:05:06.286551+0000","last_peered":"2023-09-30T17:05:06.286551+0000","last_clean":"2023-09-30T17:05:06.286551+0000","last_became_active":"2023-09-30T17:05:06.285738+0000","last_became_peered":"2023-09-30T17:05:06.285738+0000","last_unstale":"2023-09-30T17:05:06.286551+0000","last_undegraded":"2023-09-30T17:05:06.286551+0000","last_fullsized":"2023-09-30T17:05:06.286551+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2889,"log_dups_size":0,"ondisk_log_size":2889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:18:17.841837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8435,"num_write_kb":39984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"59'2839","reported_seq":2900,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.291173+0000","last_change":"2023-09-30T17:05:06.291173+0000","last_active":"2023-09-30T17:05:06.291173+0000","last_peered":"2023-09-30T17:05:06.291173+0000","last_clean":"2023-09-30T17:05:06.291173+0000","last_became_active":"2023-09-30T17:05:06.289872+0000","last_became_peered":"2023-09-30T17:05:06.289872+0000","last_unstale":"2023-09-30T17:05:06.291173+0000","last_undegraded":"2023-09-30T17:05:06.291173+0000","last_fullsized":"2023-09-30T17:05:06.291173+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2839,"log_dups_size":0,"ondisk_log_size":2839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:57:27.685208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8166,"num_write_kb":38928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"59'2802","reported_seq":2865,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.282075+0000","last_change":"2023-09-30T17:02:18.364360+0000","last_active":"2023-09-30T17:05:05.282075+0000","last_peered":"2023-09-30T17:05:05.282075+0000","last_clean":"2023-09-30T17:05:05.282075+0000","last_became_active":"2023-09-30T17:02:18.363697+0000","last_became_peered":"2023-09-30T17:02:18.363697+0000","last_unstale":"2023-09-30T17:05:05.282075+0000","last_undegraded":"2023-09-30T17:05:05.282075+0000","last_fullsized":"2023-09-30T17:05:05.282075+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2802,"log_dups_size":0,"ondisk_log_size":2802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:50:52.893768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8256,"num_write_kb":39208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"59'2860","reported_seq":2923,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.282781+0000","last_change":"2023-09-30T17:02:18.360320+0000","last_active":"2023-09-30T17:05:05.282781+0000","last_peered":"2023-09-30T17:05:05.282781+0000","last_clean":"2023-09-30T17:05:05.282781+0000","last_became_active":"2023-09-30T17:02:18.357184+0000","last_became_peered":"2023-09-30T17:02:18.357184+0000","last_unstale":"2023-09-30T17:05:05.282781+0000","last_undegraded":"2023-09-30T17:05:05.282781+0000","last_fullsized":"2023-09-30T17:05:05.282781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2860,"log_dups_size":0,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:21:45.195007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8368,"num_write_kb":39616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"59'5686","reported_seq":5749,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.282312+0000","last_change":"2023-09-30T17:02:18.363956+0000","last_active":"2023-09-30T17:05:05.282312+0000","last_peered":"2023-09-30T17:05:05.282312+0000","last_clean":"2023-09-30T17:05:05.282312+0000","last_became_active":"2023-09-30T17:02:18.363654+0000","last_became_peered":"2023-09-30T17:02:18.363654+0000","last_unstale":"2023-09-30T17:05:05.282312+0000","last_undegraded":"2023-09-30T17:05:05.282312+0000","last_fullsized":"2023-09-30T17:05:05.282312+0000","mapping_epoch":17,"log_start":"44'1500","ondisk_log_start":"44'1500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4186,"log_dups_size":1500,"ondisk_log_size":4186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:48:17.598726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16649,"num_write_kb":78956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"59'5799","reported_seq":5870,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.290994+0000","last_change":"2023-09-30T17:05:06.290994+0000","last_active":"2023-09-30T17:05:06.290994+0000","last_peered":"2023-09-30T17:05:06.290994+0000","last_clean":"2023-09-30T17:05:06.290994+0000","last_became_active":"2023-09-30T17:05:06.289817+0000","last_became_peered":"2023-09-30T17:05:06.289817+0000","last_unstale":"2023-09-30T17:05:06.290994+0000","last_undegraded":"2023-09-30T17:05:06.290994+0000","last_fullsized":"2023-09-30T17:05:06.290994+0000","mapping_epoch":69,"log_start":"44'1600","ondisk_log_start":"44'1600","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4199,"log_dups_size":1600,"ondisk_log_size":4199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:50:21.333588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16903,"num_write_kb":80184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"59'12","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.282364+0000","last_change":"2023-09-30T17:05:03.310298+0000","last_active":"2023-09-30T17:05:05.282364+0000","last_peered":"2023-09-30T17:05:05.282364+0000","last_clean":"2023-09-30T17:05:05.282364+0000","last_became_active":"2023-09-30T17:05:03.309537+0000","last_became_peered":"2023-09-30T17:05:03.309537+0000","last_unstale":"2023-09-30T17:05:05.282364+0000","last_undegraded":"2023-09-30T17:05:05.282364+0000","last_fullsized":"2023-09-30T17:05:05.282364+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:45:25.545287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"59'2879","reported_seq":2962,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.292705+0000","last_change":"2023-09-30T17:05:06.292705+0000","last_active":"2023-09-30T17:05:06.292705+0000","last_peered":"2023-09-30T17:05:06.292705+0000","last_clean":"2023-09-30T17:05:06.292705+0000","last_became_active":"2023-09-30T17:05:06.290797+0000","last_became_peered":"2023-09-30T17:05:06.290797+0000","last_unstale":"2023-09-30T17:05:06.292705+0000","last_undegraded":"2023-09-30T17:05:06.292705+0000","last_fullsized":"2023-09-30T17:05:06.292705+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2879,"log_dups_size":0,"ondisk_log_size":2879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:55:01.976617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8343,"num_write_kb":39768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"59'2809","reported_seq":2892,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.290594+0000","last_change":"2023-09-30T17:05:06.290594+0000","last_active":"2023-09-30T17:05:06.290594+0000","last_peered":"2023-09-30T17:05:06.290594+0000","last_clean":"2023-09-30T17:05:06.290594+0000","last_became_active":"2023-09-30T17:05:06.288837+0000","last_became_peered":"2023-09-30T17:05:06.288837+0000","last_unstale":"2023-09-30T17:05:06.290594+0000","last_undegraded":"2023-09-30T17:05:06.290594+0000","last_fullsized":"2023-09-30T17:05:06.290594+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2809,"log_dups_size":0,"ondisk_log_size":2809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:00:48.822153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8281,"num_write_kb":39472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"59'5585","reported_seq":5648,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.281269+0000","last_change":"2023-09-30T17:02:18.353938+0000","last_active":"2023-09-30T17:05:05.281269+0000","last_peered":"2023-09-30T17:05:05.281269+0000","last_clean":"2023-09-30T17:05:05.281269+0000","last_became_active":"2023-09-30T17:02:18.353632+0000","last_became_peered":"2023-09-30T17:02:18.353632+0000","last_unstale":"2023-09-30T17:05:05.281269+0000","last_undegraded":"2023-09-30T17:05:05.281269+0000","last_fullsized":"2023-09-30T17:05:05.281269+0000","mapping_epoch":17,"log_start":"42'1100","ondisk_log_start":"42'1100","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4485,"log_dups_size":1100,"ondisk_log_size":4485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:09:55.056098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16523,"num_write_kb":78256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"59'2888","reported_seq":2971,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.292945+0000","last_change":"2023-09-30T17:05:06.292945+0000","last_active":"2023-09-30T17:05:06.292945+0000","last_peered":"2023-09-30T17:05:06.292945+0000","last_clean":"2023-09-30T17:05:06.292945+0000","last_became_active":"2023-09-30T17:05:06.291346+0000","last_became_peered":"2023-09-30T17:05:06.291346+0000","last_unstale":"2023-09-30T17:05:06.292945+0000","last_undegraded":"2023-09-30T17:05:06.292945+0000","last_fullsized":"2023-09-30T17:05:06.292945+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2888,"log_dups_size":0,"ondisk_log_size":2888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:53:27.316963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8371,"num_write_kb":39716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"59'18","reported_seq":92,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.281975+0000","last_change":"2023-09-30T17:05:03.309295+0000","last_active":"2023-09-30T17:05:05.281975+0000","last_peered":"2023-09-30T17:05:05.281975+0000","last_clean":"2023-09-30T17:05:05.281975+0000","last_became_active":"2023-09-30T17:05:03.308884+0000","last_became_peered":"2023-09-30T17:05:03.308884+0000","last_unstale":"2023-09-30T17:05:05.281975+0000","last_undegraded":"2023-09-30T17:05:05.281975+0000","last_fullsized":"2023-09-30T17:05:05.281975+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:57:45.449671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"59'2855","reported_seq":2917,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.291369+0000","last_change":"2023-09-30T17:05:06.291369+0000","last_active":"2023-09-30T17:05:06.291369+0000","last_peered":"2023-09-30T17:05:06.291369+0000","last_clean":"2023-09-30T17:05:06.291369+0000","last_became_active":"2023-09-30T17:05:06.289447+0000","last_became_peered":"2023-09-30T17:05:06.289447+0000","last_unstale":"2023-09-30T17:05:06.291369+0000","last_undegraded":"2023-09-30T17:05:06.291369+0000","last_fullsized":"2023-09-30T17:05:06.291369+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2855,"log_dups_size":0,"ondisk_log_size":2855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:17:21.412392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8347,"num_write_kb":39608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.281177+0000","last_change":"2023-09-30T17:02:17.358258+0000","last_active":"2023-09-30T17:05:05.281177+0000","last_peered":"2023-09-30T17:05:05.281177+0000","last_clean":"2023-09-30T17:05:05.281177+0000","last_became_active":"2023-09-30T17:02:17.357890+0000","last_became_peered":"2023-09-30T17:02:17.357890+0000","last_unstale":"2023-09-30T17:05:05.281177+0000","last_undegraded":"2023-09-30T17:05:05.281177+0000","last_fullsized":"2023-09-30T17:05:05.281177+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:52:56.591906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"59'17","reported_seq":91,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.285767+0000","last_change":"2023-09-30T17:05:03.307486+0000","last_active":"2023-09-30T17:05:05.285767+0000","last_peered":"2023-09-30T17:05:05.285767+0000","last_clean":"2023-09-30T17:05:05.285767+0000","last_became_active":"2023-09-30T17:05:03.307012+0000","last_became_peered":"2023-09-30T17:05:03.307012+0000","last_unstale":"2023-09-30T17:05:05.285767+0000","last_undegraded":"2023-09-30T17:05:05.285767+0000","last_fullsized":"2023-09-30T17:05:05.285767+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:05:29.995730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":75,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.280903+0000","last_change":"2023-09-30T17:05:03.309164+0000","last_active":"2023-09-30T17:05:05.280903+0000","last_peered":"2023-09-30T17:05:05.280903+0000","last_clean":"2023-09-30T17:05:05.280903+0000","last_became_active":"2023-09-30T17:05:03.308073+0000","last_became_peered":"2023-09-30T17:05:03.308073+0000","last_unstale":"2023-09-30T17:05:05.280903+0000","last_undegraded":"2023-09-30T17:05:05.280903+0000","last_fullsized":"2023-09-30T17:05:05.280903+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:10:16.238053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"59'6","reported_seq":80,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.282076+0000","last_change":"2023-09-30T17:05:03.308692+0000","last_active":"2023-09-30T17:05:05.282076+0000","last_peered":"2023-09-30T17:05:05.282076+0000","last_clean":"2023-09-30T17:05:05.282076+0000","last_became_active":"2023-09-30T17:05:03.307932+0000","last_became_peered":"2023-09-30T17:05:03.307932+0000","last_unstale":"2023-09-30T17:05:05.282076+0000","last_undegraded":"2023-09-30T17:05:05.282076+0000","last_fullsized":"2023-09-30T17:05:05.282076+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:17:13.668052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":64,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.281919+0000","last_change":"2023-09-30T17:02:17.361000+0000","last_active":"2023-09-30T17:05:05.281919+0000","last_peered":"2023-09-30T17:05:05.281919+0000","last_clean":"2023-09-30T17:05:05.281919+0000","last_became_active":"2023-09-30T17:02:17.360601+0000","last_became_peered":"2023-09-30T17:02:17.360601+0000","last_unstale":"2023-09-30T17:05:05.281919+0000","last_undegraded":"2023-09-30T17:05:05.281919+0000","last_fullsized":"2023-09-30T17:05:05.281919+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:02:27.666526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"59'7","reported_seq":81,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.283139+0000","last_change":"2023-09-30T17:05:03.305898+0000","last_active":"2023-09-30T17:05:05.283139+0000","last_peered":"2023-09-30T17:05:05.283139+0000","last_clean":"2023-09-30T17:05:05.283139+0000","last_became_active":"2023-09-30T17:05:03.305520+0000","last_became_peered":"2023-09-30T17:05:03.305520+0000","last_unstale":"2023-09-30T17:05:05.283139+0000","last_undegraded":"2023-09-30T17:05:05.283139+0000","last_fullsized":"2023-09-30T17:05:05.283139+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:40:09.276369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"58'1","reported_seq":76,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.282669+0000","last_change":"2023-09-30T17:05:03.309303+0000","last_active":"2023-09-30T17:05:05.282669+0000","last_peered":"2023-09-30T17:05:05.282669+0000","last_clean":"2023-09-30T17:05:05.282669+0000","last_became_active":"2023-09-30T17:05:03.308851+0000","last_became_peered":"2023-09-30T17:05:03.308851+0000","last_unstale":"2023-09-30T17:05:05.282669+0000","last_undegraded":"2023-09-30T17:05:05.282669+0000","last_fullsized":"2023-09-30T17:05:05.282669+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:32:55.497287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"59'9","reported_seq":72,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.281757+0000","last_change":"2023-09-30T17:02:18.358841+0000","last_active":"2023-09-30T17:05:05.281757+0000","last_peered":"2023-09-30T17:05:05.281757+0000","last_clean":"2023-09-30T17:05:05.281757+0000","last_became_active":"2023-09-30T17:02:18.358529+0000","last_became_peered":"2023-09-30T17:02:18.358529+0000","last_unstale":"2023-09-30T17:05:05.281757+0000","last_undegraded":"2023-09-30T17:05:05.281757+0000","last_fullsized":"2023-09-30T17:05:05.281757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:15:54.364571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.280731+0000","last_change":"2023-09-30T17:05:03.309409+0000","last_active":"2023-09-30T17:05:05.280731+0000","last_peered":"2023-09-30T17:05:05.280731+0000","last_clean":"2023-09-30T17:05:05.280731+0000","last_became_active":"2023-09-30T17:05:03.309023+0000","last_became_peered":"2023-09-30T17:05:03.309023+0000","last_unstale":"2023-09-30T17:05:05.280731+0000","last_undegraded":"2023-09-30T17:05:05.280731+0000","last_fullsized":"2023-09-30T17:05:05.280731+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:57:05.463330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"59'8526","reported_seq":8612,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.292415+0000","last_change":"2023-09-30T17:05:06.292415+0000","last_active":"2023-09-30T17:05:06.292415+0000","last_peered":"2023-09-30T17:05:06.292415+0000","last_clean":"2023-09-30T17:05:06.292415+0000","last_became_active":"2023-09-30T17:05:06.290551+0000","last_became_peered":"2023-09-30T17:05:06.290551+0000","last_unstale":"2023-09-30T17:05:06.292415+0000","last_undegraded":"2023-09-30T17:05:06.292415+0000","last_fullsized":"2023-09-30T17:05:06.292415+0000","mapping_epoch":69,"log_start":"49'4300","ondisk_log_start":"49'4300","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4226,"log_dups_size":4300,"ondisk_log_size":4226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:59:52.758548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24873,"num_write_kb":118472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"59'7","reported_seq":87,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.284454+0000","last_change":"2023-09-30T17:05:03.310987+0000","last_active":"2023-09-30T17:05:05.284454+0000","last_peered":"2023-09-30T17:05:05.284454+0000","last_clean":"2023-09-30T17:05:05.284454+0000","last_became_active":"2023-09-30T17:05:03.306646+0000","last_became_peered":"2023-09-30T17:05:03.306646+0000","last_unstale":"2023-09-30T17:05:05.284454+0000","last_undegraded":"2023-09-30T17:05:05.284454+0000","last_fullsized":"2023-09-30T17:05:05.284454+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:24:52.247523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"59'5670","reported_seq":5733,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.280950+0000","last_change":"2023-09-30T17:02:18.359118+0000","last_active":"2023-09-30T17:05:05.280950+0000","last_peered":"2023-09-30T17:05:05.280950+0000","last_clean":"2023-09-30T17:05:05.280950+0000","last_became_active":"2023-09-30T17:02:18.358786+0000","last_became_peered":"2023-09-30T17:02:18.358786+0000","last_unstale":"2023-09-30T17:05:05.280950+0000","last_undegraded":"2023-09-30T17:05:05.280950+0000","last_fullsized":"2023-09-30T17:05:05.280950+0000","mapping_epoch":17,"log_start":"44'1500","ondisk_log_start":"44'1500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4170,"log_dups_size":1500,"ondisk_log_size":4170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:33:21.723864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16627,"num_write_kb":79047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"60'78","reported_seq":43,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.280787+0000","last_change":"2023-09-30T17:05:03.313916+0000","last_active":"2023-09-30T17:05:05.280787+0000","last_peered":"2023-09-30T17:05:05.280787+0000","last_clean":"2023-09-30T17:05:05.280787+0000","last_became_active":"2023-09-30T17:05:03.302516+0000","last_became_peered":"2023-09-30T17:05:03.302516+0000","last_unstale":"2023-09-30T17:05:05.280787+0000","last_undegraded":"2023-09-30T17:05:05.280787+0000","last_fullsized":"2023-09-30T17:05:05.280787+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:00:50.535715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227523,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":222729,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"59'5677","reported_seq":5750,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.289965+0000","last_change":"2023-09-30T17:05:06.289965+0000","last_active":"2023-09-30T17:05:06.289965+0000","last_peered":"2023-09-30T17:05:06.289965+0000","last_clean":"2023-09-30T17:05:06.289965+0000","last_became_active":"2023-09-30T17:05:06.288155+0000","last_became_peered":"2023-09-30T17:05:06.288155+0000","last_unstale":"2023-09-30T17:05:06.289965+0000","last_undegraded":"2023-09-30T17:05:06.289965+0000","last_fullsized":"2023-09-30T17:05:06.289965+0000","mapping_epoch":69,"log_start":"42'1100","ondisk_log_start":"42'1100","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4577,"log_dups_size":1100,"ondisk_log_size":4577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:26:23.188915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16579,"num_write_kb":79104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":26,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.280510+0000","last_change":"2023-09-30T17:05:03.310322+0000","last_active":"2023-09-30T17:05:05.280510+0000","last_peered":"2023-09-30T17:05:05.280510+0000","last_clean":"2023-09-30T17:05:05.280510+0000","last_became_active":"2023-09-30T17:05:03.309505+0000","last_became_peered":"2023-09-30T17:05:03.309505+0000","last_unstale":"2023-09-30T17:05:05.280510+0000","last_undegraded":"2023-09-30T17:05:05.280510+0000","last_fullsized":"2023-09-30T17:05:05.280510+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:13:16.014703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"59'2836","reported_seq":2899,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.281968+0000","last_change":"2023-09-30T17:02:18.360019+0000","last_active":"2023-09-30T17:05:05.281968+0000","last_peered":"2023-09-30T17:05:05.281968+0000","last_clean":"2023-09-30T17:05:05.281968+0000","last_became_active":"2023-09-30T17:02:18.358364+0000","last_became_peered":"2023-09-30T17:02:18.358364+0000","last_unstale":"2023-09-30T17:05:05.281968+0000","last_undegraded":"2023-09-30T17:05:05.281968+0000","last_fullsized":"2023-09-30T17:05:05.281968+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2836,"log_dups_size":0,"ondisk_log_size":2836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:30:43.782165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8308,"num_write_kb":39456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":75,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.281124+0000","last_change":"2023-09-30T17:05:03.308853+0000","last_active":"2023-09-30T17:05:05.281124+0000","last_peered":"2023-09-30T17:05:05.281124+0000","last_clean":"2023-09-30T17:05:05.281124+0000","last_became_active":"2023-09-30T17:05:03.308377+0000","last_became_peered":"2023-09-30T17:05:03.308377+0000","last_unstale":"2023-09-30T17:05:05.281124+0000","last_undegraded":"2023-09-30T17:05:05.281124+0000","last_fullsized":"2023-09-30T17:05:05.281124+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:18:42.448826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"59'2856","reported_seq":2919,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.285582+0000","last_change":"2023-09-30T17:02:18.362415+0000","last_active":"2023-09-30T17:05:05.285582+0000","last_peered":"2023-09-30T17:05:05.285582+0000","last_clean":"2023-09-30T17:05:05.285582+0000","last_became_active":"2023-09-30T17:02:18.361556+0000","last_became_peered":"2023-09-30T17:02:18.361556+0000","last_unstale":"2023-09-30T17:05:05.285582+0000","last_undegraded":"2023-09-30T17:05:05.285582+0000","last_fullsized":"2023-09-30T17:05:05.285582+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2856,"log_dups_size":0,"ondisk_log_size":2856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:16:41.607547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8321,"num_write_kb":39600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":75,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.281404+0000","last_change":"2023-09-30T17:05:03.304220+0000","last_active":"2023-09-30T17:05:05.281404+0000","last_peered":"2023-09-30T17:05:05.281404+0000","last_clean":"2023-09-30T17:05:05.281404+0000","last_became_active":"2023-09-30T17:05:03.303598+0000","last_became_peered":"2023-09-30T17:05:03.303598+0000","last_unstale":"2023-09-30T17:05:05.281404+0000","last_undegraded":"2023-09-30T17:05:05.281404+0000","last_fullsized":"2023-09-30T17:05:05.281404+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:57:44.444041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"59'12","reported_seq":86,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.282202+0000","last_change":"2023-09-30T17:05:03.313214+0000","last_active":"2023-09-30T17:05:05.282202+0000","last_peered":"2023-09-30T17:05:05.282202+0000","last_clean":"2023-09-30T17:05:05.282202+0000","last_became_active":"2023-09-30T17:05:03.312888+0000","last_became_peered":"2023-09-30T17:05:03.312888+0000","last_unstale":"2023-09-30T17:05:05.282202+0000","last_undegraded":"2023-09-30T17:05:05.282202+0000","last_fullsized":"2023-09-30T17:05:05.282202+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:40:09.276369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"59'9","reported_seq":29,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.282742+0000","last_change":"2023-09-30T17:05:03.304503+0000","last_active":"2023-09-30T17:05:05.282742+0000","last_peered":"2023-09-30T17:05:05.282742+0000","last_clean":"2023-09-30T17:05:05.282742+0000","last_became_active":"2023-09-30T17:05:03.304030+0000","last_became_peered":"2023-09-30T17:05:03.304030+0000","last_unstale":"2023-09-30T17:05:05.282742+0000","last_undegraded":"2023-09-30T17:05:05.282742+0000","last_fullsized":"2023-09-30T17:05:05.282742+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:08:35.110114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"59'2892","reported_seq":2975,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.290230+0000","last_change":"2023-09-30T17:05:06.290230+0000","last_active":"2023-09-30T17:05:06.290230+0000","last_peered":"2023-09-30T17:05:06.290230+0000","last_clean":"2023-09-30T17:05:06.290230+0000","last_became_active":"2023-09-30T17:05:06.288725+0000","last_became_peered":"2023-09-30T17:05:06.288725+0000","last_unstale":"2023-09-30T17:05:06.290230+0000","last_undegraded":"2023-09-30T17:05:06.290230+0000","last_fullsized":"2023-09-30T17:05:06.290230+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2892,"log_dups_size":0,"ondisk_log_size":2892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:27:28.611647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8345,"num_write_kb":39712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":26,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.281280+0000","last_change":"2023-09-30T17:05:03.304339+0000","last_active":"2023-09-30T17:05:05.281280+0000","last_peered":"2023-09-30T17:05:05.281280+0000","last_clean":"2023-09-30T17:05:05.281280+0000","last_became_active":"2023-09-30T17:05:03.303179+0000","last_became_peered":"2023-09-30T17:05:03.303179+0000","last_unstale":"2023-09-30T17:05:05.281280+0000","last_undegraded":"2023-09-30T17:05:05.281280+0000","last_fullsized":"2023-09-30T17:05:05.281280+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:44:20.765682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"59'2861","reported_seq":2944,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.290324+0000","last_change":"2023-09-30T17:05:06.290324+0000","last_active":"2023-09-30T17:05:06.290324+0000","last_peered":"2023-09-30T17:05:06.290324+0000","last_clean":"2023-09-30T17:05:06.290324+0000","last_became_active":"2023-09-30T17:05:06.288824+0000","last_became_peered":"2023-09-30T17:05:06.288824+0000","last_unstale":"2023-09-30T17:05:06.290324+0000","last_undegraded":"2023-09-30T17:05:06.290324+0000","last_fullsized":"2023-09-30T17:05:06.290324+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2861,"log_dups_size":0,"ondisk_log_size":2861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:51:16.138021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8384,"num_write_kb":39788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":77,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.282450+0000","last_change":"2023-09-30T17:05:03.304232+0000","last_active":"2023-09-30T17:05:05.282450+0000","last_peered":"2023-09-30T17:05:05.282450+0000","last_clean":"2023-09-30T17:05:05.282450+0000","last_became_active":"2023-09-30T17:05:03.303874+0000","last_became_peered":"2023-09-30T17:05:03.303874+0000","last_unstale":"2023-09-30T17:05:05.282450+0000","last_undegraded":"2023-09-30T17:05:05.282450+0000","last_fullsized":"2023-09-30T17:05:05.282450+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:39:49.644290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"59'2","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.281895+0000","last_change":"2023-09-30T17:02:18.359767+0000","last_active":"2023-09-30T17:05:05.281895+0000","last_peered":"2023-09-30T17:05:05.281895+0000","last_clean":"2023-09-30T17:05:05.281895+0000","last_became_active":"2023-09-30T17:02:18.356825+0000","last_became_peered":"2023-09-30T17:02:18.356825+0000","last_unstale":"2023-09-30T17:05:05.281895+0000","last_undegraded":"2023-09-30T17:05:05.281895+0000","last_fullsized":"2023-09-30T17:05:05.281895+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:39:16.689300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":26,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.280710+0000","last_change":"2023-09-30T17:05:03.305087+0000","last_active":"2023-09-30T17:05:05.280710+0000","last_peered":"2023-09-30T17:05:05.280710+0000","last_clean":"2023-09-30T17:05:05.280710+0000","last_became_active":"2023-09-30T17:05:03.304463+0000","last_became_peered":"2023-09-30T17:05:03.304463+0000","last_unstale":"2023-09-30T17:05:05.280710+0000","last_undegraded":"2023-09-30T17:05:05.280710+0000","last_fullsized":"2023-09-30T17:05:05.280710+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:33:20.829898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"59'2835","reported_seq":2897,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.289598+0000","last_change":"2023-09-30T17:05:06.289598+0000","last_active":"2023-09-30T17:05:06.289598+0000","last_peered":"2023-09-30T17:05:06.289598+0000","last_clean":"2023-09-30T17:05:06.289598+0000","last_became_active":"2023-09-30T17:05:06.288712+0000","last_became_peered":"2023-09-30T17:05:06.288712+0000","last_unstale":"2023-09-30T17:05:06.289598+0000","last_undegraded":"2023-09-30T17:05:06.289598+0000","last_fullsized":"2023-09-30T17:05:06.289598+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2835,"log_dups_size":0,"ondisk_log_size":2835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:01:17.676791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8288,"num_write_kb":39388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.282725+0000","last_change":"2023-09-30T17:05:03.311500+0000","last_active":"2023-09-30T17:05:05.282725+0000","last_peered":"2023-09-30T17:05:05.282725+0000","last_clean":"2023-09-30T17:05:05.282725+0000","last_became_active":"2023-09-30T17:05:03.310836+0000","last_became_peered":"2023-09-30T17:05:03.310836+0000","last_unstale":"2023-09-30T17:05:05.282725+0000","last_undegraded":"2023-09-30T17:05:05.282725+0000","last_fullsized":"2023-09-30T17:05:05.282725+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:30:09.762284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"59'8","reported_seq":82,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.281542+0000","last_change":"2023-09-30T17:05:03.308917+0000","last_active":"2023-09-30T17:05:05.281542+0000","last_peered":"2023-09-30T17:05:05.281542+0000","last_clean":"2023-09-30T17:05:05.281542+0000","last_became_active":"2023-09-30T17:05:03.308214+0000","last_became_peered":"2023-09-30T17:05:03.308214+0000","last_unstale":"2023-09-30T17:05:05.281542+0000","last_undegraded":"2023-09-30T17:05:05.281542+0000","last_fullsized":"2023-09-30T17:05:05.281542+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:39:50.649920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"58'3","reported_seq":79,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.281369+0000","last_change":"2023-09-30T17:05:03.308944+0000","last_active":"2023-09-30T17:05:05.281369+0000","last_peered":"2023-09-30T17:05:05.281369+0000","last_clean":"2023-09-30T17:05:05.281369+0000","last_became_active":"2023-09-30T17:05:03.308483+0000","last_became_peered":"2023-09-30T17:05:03.308483+0000","last_unstale":"2023-09-30T17:05:05.281369+0000","last_undegraded":"2023-09-30T17:05:05.281369+0000","last_fullsized":"2023-09-30T17:05:05.281369+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:43:27.633747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"59'2846","reported_seq":2907,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.290255+0000","last_change":"2023-09-30T17:05:06.290255+0000","last_active":"2023-09-30T17:05:06.290255+0000","last_peered":"2023-09-30T17:05:06.290255+0000","last_clean":"2023-09-30T17:05:06.290255+0000","last_became_active":"2023-09-30T17:05:06.289225+0000","last_became_peered":"2023-09-30T17:05:06.289225+0000","last_unstale":"2023-09-30T17:05:06.290255+0000","last_undegraded":"2023-09-30T17:05:06.290255+0000","last_fullsized":"2023-09-30T17:05:06.290255+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2846,"log_dups_size":0,"ondisk_log_size":2846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:41:31.424933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8199,"num_write_kb":39160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.280395+0000","last_change":"2023-09-30T17:05:03.309689+0000","last_active":"2023-09-30T17:05:05.280395+0000","last_peered":"2023-09-30T17:05:05.280395+0000","last_clean":"2023-09-30T17:05:05.280395+0000","last_became_active":"2023-09-30T17:05:03.309318+0000","last_became_peered":"2023-09-30T17:05:03.309318+0000","last_unstale":"2023-09-30T17:05:05.280395+0000","last_undegraded":"2023-09-30T17:05:05.280395+0000","last_fullsized":"2023-09-30T17:05:05.280395+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:12:37.857480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"59'2831","reported_seq":2892,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.289189+0000","last_change":"2023-09-30T17:05:06.289189+0000","last_active":"2023-09-30T17:05:06.289189+0000","last_peered":"2023-09-30T17:05:06.289189+0000","last_clean":"2023-09-30T17:05:06.289189+0000","last_became_active":"2023-09-30T17:05:06.288348+0000","last_became_peered":"2023-09-30T17:05:06.288348+0000","last_unstale":"2023-09-30T17:05:06.289189+0000","last_undegraded":"2023-09-30T17:05:06.289189+0000","last_fullsized":"2023-09-30T17:05:06.289189+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2831,"log_dups_size":0,"ondisk_log_size":2831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:51:59.540252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8336,"num_write_kb":39484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":75,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.280846+0000","last_change":"2023-09-30T17:05:03.304019+0000","last_active":"2023-09-30T17:05:05.280846+0000","last_peered":"2023-09-30T17:05:05.280846+0000","last_clean":"2023-09-30T17:05:05.280846+0000","last_became_active":"2023-09-30T17:05:03.303473+0000","last_became_peered":"2023-09-30T17:05:03.303473+0000","last_unstale":"2023-09-30T17:05:05.280846+0000","last_undegraded":"2023-09-30T17:05:05.280846+0000","last_fullsized":"2023-09-30T17:05:05.280846+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:10:16.238053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"59'2884","reported_seq":2945,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.289446+0000","last_change":"2023-09-30T17:05:06.289446+0000","last_active":"2023-09-30T17:05:06.289446+0000","last_peered":"2023-09-30T17:05:06.289446+0000","last_clean":"2023-09-30T17:05:06.289446+0000","last_became_active":"2023-09-30T17:05:06.288169+0000","last_became_peered":"2023-09-30T17:05:06.288169+0000","last_unstale":"2023-09-30T17:05:06.289446+0000","last_undegraded":"2023-09-30T17:05:06.289446+0000","last_fullsized":"2023-09-30T17:05:06.289446+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2884,"log_dups_size":0,"ondisk_log_size":2884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:15:23.507816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8366,"num_write_kb":39744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":64,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.281030+0000","last_change":"2023-09-30T17:02:17.358811+0000","last_active":"2023-09-30T17:05:05.281030+0000","last_peered":"2023-09-30T17:05:05.281030+0000","last_clean":"2023-09-30T17:05:05.281030+0000","last_became_active":"2023-09-30T17:02:17.358582+0000","last_became_peered":"2023-09-30T17:02:17.358582+0000","last_unstale":"2023-09-30T17:05:05.281030+0000","last_undegraded":"2023-09-30T17:05:05.281030+0000","last_fullsized":"2023-09-30T17:05:05.281030+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:52:37.518693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"59'8580","reported_seq":8643,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.282319+0000","last_change":"2023-09-30T17:02:18.364478+0000","last_active":"2023-09-30T17:05:05.282319+0000","last_peered":"2023-09-30T17:05:05.282319+0000","last_clean":"2023-09-30T17:05:05.282319+0000","last_became_active":"2023-09-30T17:02:18.364057+0000","last_became_peered":"2023-09-30T17:02:18.364057+0000","last_unstale":"2023-09-30T17:05:05.282319+0000","last_undegraded":"2023-09-30T17:05:05.282319+0000","last_fullsized":"2023-09-30T17:05:05.282319+0000","mapping_epoch":17,"log_start":"49'4400","ondisk_log_start":"49'4400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4180,"log_dups_size":4400,"ondisk_log_size":4180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:13:55.555700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25046,"num_write_kb":118972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":67,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.282778+0000","last_change":"2023-09-30T17:02:12.327704+0000","last_active":"2023-09-30T17:05:05.282778+0000","last_peered":"2023-09-30T17:05:05.282778+0000","last_clean":"2023-09-30T17:05:05.282778+0000","last_became_active":"2023-09-30T17:02:12.327384+0000","last_became_peered":"2023-09-30T17:02:12.327384+0000","last_unstale":"2023-09-30T17:05:05.282778+0000","last_undegraded":"2023-09-30T17:05:05.282778+0000","last_fullsized":"2023-09-30T17:05:05.282778+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:09:34.818252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.283769+0000","last_change":"2023-09-30T17:05:03.311271+0000","last_active":"2023-09-30T17:05:05.283769+0000","last_peered":"2023-09-30T17:05:05.283769+0000","last_clean":"2023-09-30T17:05:05.283769+0000","last_became_active":"2023-09-30T17:05:03.310655+0000","last_became_peered":"2023-09-30T17:05:03.310655+0000","last_unstale":"2023-09-30T17:05:05.283769+0000","last_undegraded":"2023-09-30T17:05:05.283769+0000","last_fullsized":"2023-09-30T17:05:05.283769+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:49:35.748952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"59'9","reported_seq":83,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.282599+0000","last_change":"2023-09-30T17:05:03.306223+0000","last_active":"2023-09-30T17:05:05.282599+0000","last_peered":"2023-09-30T17:05:05.282599+0000","last_clean":"2023-09-30T17:05:05.282599+0000","last_became_active":"2023-09-30T17:05:03.305956+0000","last_became_peered":"2023-09-30T17:05:03.305956+0000","last_unstale":"2023-09-30T17:05:05.282599+0000","last_undegraded":"2023-09-30T17:05:05.282599+0000","last_fullsized":"2023-09-30T17:05:05.282599+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:32:56.502917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.280424+0000","last_change":"2023-09-30T17:05:03.309359+0000","last_active":"2023-09-30T17:05:05.280424+0000","last_peered":"2023-09-30T17:05:05.280424+0000","last_clean":"2023-09-30T17:05:05.280424+0000","last_became_active":"2023-09-30T17:05:03.308944+0000","last_became_peered":"2023-09-30T17:05:03.308944+0000","last_unstale":"2023-09-30T17:05:05.280424+0000","last_undegraded":"2023-09-30T17:05:05.280424+0000","last_fullsized":"2023-09-30T17:05:05.280424+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:02:58.156693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.284199+0000","last_change":"2023-09-30T17:05:03.311106+0000","last_active":"2023-09-30T17:05:05.284199+0000","last_peered":"2023-09-30T17:05:05.284199+0000","last_clean":"2023-09-30T17:05:05.284199+0000","last_became_active":"2023-09-30T17:05:03.310706+0000","last_became_peered":"2023-09-30T17:05:03.310706+0000","last_unstale":"2023-09-30T17:05:05.284199+0000","last_undegraded":"2023-09-30T17:05:05.284199+0000","last_fullsized":"2023-09-30T17:05:05.284199+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:04:03.231664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"59'9","reported_seq":72,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.281682+0000","last_change":"2023-09-30T17:02:18.363399+0000","last_active":"2023-09-30T17:05:05.281682+0000","last_peered":"2023-09-30T17:05:05.281682+0000","last_clean":"2023-09-30T17:05:05.281682+0000","last_became_active":"2023-09-30T17:02:18.363064+0000","last_became_peered":"2023-09-30T17:02:18.363064+0000","last_unstale":"2023-09-30T17:05:05.281682+0000","last_undegraded":"2023-09-30T17:05:05.281682+0000","last_fullsized":"2023-09-30T17:05:05.281682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:32:34.654264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":67,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.280790+0000","last_change":"2023-09-30T17:02:12.327834+0000","last_active":"2023-09-30T17:05:05.280790+0000","last_peered":"2023-09-30T17:05:05.280790+0000","last_clean":"2023-09-30T17:05:05.280790+0000","last_became_active":"2023-09-30T17:02:12.327542+0000","last_became_peered":"2023-09-30T17:02:12.327542+0000","last_unstale":"2023-09-30T17:05:05.280790+0000","last_undegraded":"2023-09-30T17:05:05.280790+0000","last_fullsized":"2023-09-30T17:05:05.280790+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:49:54.890769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":75,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.280903+0000","last_change":"2023-09-30T17:05:03.305668+0000","last_active":"2023-09-30T17:05:05.280903+0000","last_peered":"2023-09-30T17:05:05.280903+0000","last_clean":"2023-09-30T17:05:05.280903+0000","last_became_active":"2023-09-30T17:05:03.305222+0000","last_became_peered":"2023-09-30T17:05:03.305222+0000","last_unstale":"2023-09-30T17:05:05.280903+0000","last_undegraded":"2023-09-30T17:05:05.280903+0000","last_fullsized":"2023-09-30T17:05:05.280903+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:17:12.662422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"59'6","reported_seq":69,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.282680+0000","last_change":"2023-09-30T17:02:18.364406+0000","last_active":"2023-09-30T17:05:05.282680+0000","last_peered":"2023-09-30T17:05:05.282680+0000","last_clean":"2023-09-30T17:05:05.282680+0000","last_became_active":"2023-09-30T17:02:18.363849+0000","last_became_peered":"2023-09-30T17:02:18.363849+0000","last_unstale":"2023-09-30T17:05:05.282680+0000","last_undegraded":"2023-09-30T17:05:05.282680+0000","last_fullsized":"2023-09-30T17:05:05.282680+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:43:29.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.280604+0000","last_change":"2023-09-30T17:05:03.310062+0000","last_active":"2023-09-30T17:05:05.280604+0000","last_peered":"2023-09-30T17:05:05.280604+0000","last_clean":"2023-09-30T17:05:05.280604+0000","last_became_active":"2023-09-30T17:05:03.308958+0000","last_became_peered":"2023-09-30T17:05:03.308958+0000","last_unstale":"2023-09-30T17:05:05.280604+0000","last_undegraded":"2023-09-30T17:05:05.280604+0000","last_fullsized":"2023-09-30T17:05:05.280604+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:05:26.347633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":219,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.282381+0000","last_change":"2023-09-30T17:05:03.303046+0000","last_active":"2023-09-30T17:05:05.282381+0000","last_peered":"2023-09-30T17:05:05.282381+0000","last_clean":"2023-09-30T17:05:05.282381+0000","last_became_active":"2023-09-30T17:05:03.302265+0000","last_became_peered":"2023-09-30T17:05:03.302265+0000","last_unstale":"2023-09-30T17:05:05.282381+0000","last_undegraded":"2023-09-30T17:05:05.282381+0000","last_fullsized":"2023-09-30T17:05:05.282381+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:06.295501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:06.295501+0000","last_clean_scrub_stamp":"2023-09-30T17:02:06.295501+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:07:24.603358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":64,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.280832+0000","last_change":"2023-09-30T17:02:17.357139+0000","last_active":"2023-09-30T17:05:05.280832+0000","last_peered":"2023-09-30T17:05:05.280832+0000","last_clean":"2023-09-30T17:05:05.280832+0000","last_became_active":"2023-09-30T17:02:17.356901+0000","last_became_peered":"2023-09-30T17:02:17.356901+0000","last_unstale":"2023-09-30T17:05:05.280832+0000","last_undegraded":"2023-09-30T17:05:05.280832+0000","last_fullsized":"2023-09-30T17:05:05.280832+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:22:35.747671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"59'7","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.281124+0000","last_change":"2023-09-30T17:05:03.305199+0000","last_active":"2023-09-30T17:05:05.281124+0000","last_peered":"2023-09-30T17:05:05.281124+0000","last_clean":"2023-09-30T17:05:05.281124+0000","last_became_active":"2023-09-30T17:05:03.304974+0000","last_became_peered":"2023-09-30T17:05:03.304974+0000","last_unstale":"2023-09-30T17:05:05.281124+0000","last_undegraded":"2023-09-30T17:05:05.281124+0000","last_fullsized":"2023-09-30T17:05:05.281124+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:03:27.429545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.282624+0000","last_change":"2023-09-30T17:05:03.303739+0000","last_active":"2023-09-30T17:05:05.282624+0000","last_peered":"2023-09-30T17:05:05.282624+0000","last_clean":"2023-09-30T17:05:05.282624+0000","last_became_active":"2023-09-30T17:05:03.302590+0000","last_became_peered":"2023-09-30T17:05:03.302590+0000","last_unstale":"2023-09-30T17:05:05.282624+0000","last_undegraded":"2023-09-30T17:05:05.282624+0000","last_fullsized":"2023-09-30T17:05:05.282624+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:51:30.199616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"59'5","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.280665+0000","last_change":"2023-09-30T17:05:03.318439+0000","last_active":"2023-09-30T17:05:05.280665+0000","last_peered":"2023-09-30T17:05:05.280665+0000","last_clean":"2023-09-30T17:05:05.280665+0000","last_became_active":"2023-09-30T17:05:03.308059+0000","last_became_peered":"2023-09-30T17:05:03.308059+0000","last_unstale":"2023-09-30T17:05:05.280665+0000","last_undegraded":"2023-09-30T17:05:05.280665+0000","last_fullsized":"2023-09-30T17:05:05.280665+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:16:25.170638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"59'11252","reported_seq":11315,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.282764+0000","last_change":"2023-09-30T17:02:18.360029+0000","last_active":"2023-09-30T17:05:05.282764+0000","last_peered":"2023-09-30T17:05:05.282764+0000","last_clean":"2023-09-30T17:05:05.282764+0000","last_became_active":"2023-09-30T17:02:18.356839+0000","last_became_peered":"2023-09-30T17:02:18.356839+0000","last_unstale":"2023-09-30T17:05:05.282764+0000","last_undegraded":"2023-09-30T17:05:05.282764+0000","last_fullsized":"2023-09-30T17:05:05.282764+0000","mapping_epoch":17,"log_start":"51'6700","ondisk_log_start":"51'6700","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4552,"log_dups_size":6700,"ondisk_log_size":4552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:16:27.516884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33068,"num_write_kb":157144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":67,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.284689+0000","last_change":"2023-09-30T17:02:12.330472+0000","last_active":"2023-09-30T17:05:05.284689+0000","last_peered":"2023-09-30T17:05:05.284689+0000","last_clean":"2023-09-30T17:05:05.284689+0000","last_became_active":"2023-09-30T17:02:12.330154+0000","last_became_peered":"2023-09-30T17:02:12.330154+0000","last_unstale":"2023-09-30T17:05:05.284689+0000","last_undegraded":"2023-09-30T17:05:05.284689+0000","last_fullsized":"2023-09-30T17:05:05.284689+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:43:23.161734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":64,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.282999+0000","last_change":"2023-09-30T17:02:17.361007+0000","last_active":"2023-09-30T17:05:05.282999+0000","last_peered":"2023-09-30T17:05:05.282999+0000","last_clean":"2023-09-30T17:05:05.282999+0000","last_became_active":"2023-09-30T17:02:17.360721+0000","last_became_peered":"2023-09-30T17:02:17.360721+0000","last_unstale":"2023-09-30T17:05:05.282999+0000","last_undegraded":"2023-09-30T17:05:05.282999+0000","last_fullsized":"2023-09-30T17:05:05.282999+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:13:41.205152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"59'2836","reported_seq":2919,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.293085+0000","last_change":"2023-09-30T17:05:06.293085+0000","last_active":"2023-09-30T17:05:06.293085+0000","last_peered":"2023-09-30T17:05:06.293085+0000","last_clean":"2023-09-30T17:05:06.293085+0000","last_became_active":"2023-09-30T17:05:06.291203+0000","last_became_peered":"2023-09-30T17:05:06.291203+0000","last_unstale":"2023-09-30T17:05:06.293085+0000","last_undegraded":"2023-09-30T17:05:06.293085+0000","last_fullsized":"2023-09-30T17:05:06.293085+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2836,"log_dups_size":0,"ondisk_log_size":2836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:11:28.091818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8199,"num_write_kb":39048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"59'3","reported_seq":67,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.282189+0000","last_change":"2023-09-30T17:02:17.360831+0000","last_active":"2023-09-30T17:05:05.282189+0000","last_peered":"2023-09-30T17:05:05.282189+0000","last_clean":"2023-09-30T17:05:05.282189+0000","last_became_active":"2023-09-30T17:02:17.360494+0000","last_became_peered":"2023-09-30T17:02:17.360494+0000","last_unstale":"2023-09-30T17:05:05.282189+0000","last_undegraded":"2023-09-30T17:05:05.282189+0000","last_fullsized":"2023-09-30T17:05:05.282189+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:24:04.564387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":67,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.282677+0000","last_change":"2023-09-30T17:02:12.328184+0000","last_active":"2023-09-30T17:05:05.282677+0000","last_peered":"2023-09-30T17:05:05.282677+0000","last_clean":"2023-09-30T17:05:05.282677+0000","last_became_active":"2023-09-30T17:02:12.327898+0000","last_became_peered":"2023-09-30T17:02:12.327898+0000","last_unstale":"2023-09-30T17:05:05.282677+0000","last_undegraded":"2023-09-30T17:05:05.282677+0000","last_fullsized":"2023-09-30T17:05:05.282677+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:43:23.161734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"59'8","reported_seq":82,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.281637+0000","last_change":"2023-09-30T17:05:03.308856+0000","last_active":"2023-09-30T17:05:05.281637+0000","last_peered":"2023-09-30T17:05:05.281637+0000","last_clean":"2023-09-30T17:05:05.281637+0000","last_became_active":"2023-09-30T17:05:03.308429+0000","last_became_peered":"2023-09-30T17:05:03.308429+0000","last_unstale":"2023-09-30T17:05:05.281637+0000","last_undegraded":"2023-09-30T17:05:05.281637+0000","last_fullsized":"2023-09-30T17:05:05.281637+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:49:32.189339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.281043+0000","last_change":"2023-09-30T17:05:03.304353+0000","last_active":"2023-09-30T17:05:05.281043+0000","last_peered":"2023-09-30T17:05:05.281043+0000","last_clean":"2023-09-30T17:05:05.281043+0000","last_became_active":"2023-09-30T17:05:03.302503+0000","last_became_peered":"2023-09-30T17:05:03.302503+0000","last_unstale":"2023-09-30T17:05:05.281043+0000","last_undegraded":"2023-09-30T17:05:05.281043+0000","last_fullsized":"2023-09-30T17:05:05.281043+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:19:16.151598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"60'8","reported_seq":88,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.282085+0000","last_change":"2023-09-30T17:05:03.314806+0000","last_active":"2023-09-30T17:05:05.282085+0000","last_peered":"2023-09-30T17:05:05.282085+0000","last_clean":"2023-09-30T17:05:05.282085+0000","last_became_active":"2023-09-30T17:05:03.308201+0000","last_became_peered":"2023-09-30T17:05:03.308201+0000","last_unstale":"2023-09-30T17:05:05.282085+0000","last_undegraded":"2023-09-30T17:05:05.282085+0000","last_fullsized":"2023-09-30T17:05:05.282085+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:19:18.486570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"59'6","reported_seq":80,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.282915+0000","last_change":"2023-09-30T17:05:03.304265+0000","last_active":"2023-09-30T17:05:05.282915+0000","last_peered":"2023-09-30T17:05:05.282915+0000","last_clean":"2023-09-30T17:05:05.282915+0000","last_became_active":"2023-09-30T17:05:03.304022+0000","last_became_peered":"2023-09-30T17:05:03.304022+0000","last_unstale":"2023-09-30T17:05:05.282915+0000","last_undegraded":"2023-09-30T17:05:05.282915+0000","last_fullsized":"2023-09-30T17:05:05.282915+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:19:19.492200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":76,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.282314+0000","last_change":"2023-09-30T17:05:03.303927+0000","last_active":"2023-09-30T17:05:05.282314+0000","last_peered":"2023-09-30T17:05:05.282314+0000","last_clean":"2023-09-30T17:05:05.282314+0000","last_became_active":"2023-09-30T17:05:03.303487+0000","last_became_peered":"2023-09-30T17:05:03.303487+0000","last_unstale":"2023-09-30T17:05:05.282314+0000","last_undegraded":"2023-09-30T17:05:05.282314+0000","last_fullsized":"2023-09-30T17:05:05.282314+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:43:27.633747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"59'2835","reported_seq":2898,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.282226+0000","last_change":"2023-09-30T17:02:18.358269+0000","last_active":"2023-09-30T17:05:05.282226+0000","last_peered":"2023-09-30T17:05:05.282226+0000","last_clean":"2023-09-30T17:05:05.282226+0000","last_became_active":"2023-09-30T17:02:18.356902+0000","last_became_peered":"2023-09-30T17:02:18.356902+0000","last_unstale":"2023-09-30T17:05:05.282226+0000","last_undegraded":"2023-09-30T17:05:05.282226+0000","last_fullsized":"2023-09-30T17:05:05.282226+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2835,"log_dups_size":0,"ondisk_log_size":2835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:39:28.022201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8302,"num_write_kb":39500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":26,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.284119+0000","last_change":"2023-09-30T17:05:03.311401+0000","last_active":"2023-09-30T17:05:05.284119+0000","last_peered":"2023-09-30T17:05:05.284119+0000","last_clean":"2023-09-30T17:05:05.284119+0000","last_became_active":"2023-09-30T17:05:03.310996+0000","last_became_peered":"2023-09-30T17:05:03.310996+0000","last_unstale":"2023-09-30T17:05:05.284119+0000","last_undegraded":"2023-09-30T17:05:05.284119+0000","last_fullsized":"2023-09-30T17:05:05.284119+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:28:19.097868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"59'2848","reported_seq":2909,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.290662+0000","last_change":"2023-09-30T17:05:06.290662+0000","last_active":"2023-09-30T17:05:06.290662+0000","last_peered":"2023-09-30T17:05:06.290662+0000","last_clean":"2023-09-30T17:05:06.290662+0000","last_became_active":"2023-09-30T17:05:06.289599+0000","last_became_peered":"2023-09-30T17:05:06.289599+0000","last_unstale":"2023-09-30T17:05:06.290662+0000","last_undegraded":"2023-09-30T17:05:06.290662+0000","last_fullsized":"2023-09-30T17:05:06.290662+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2848,"log_dups_size":0,"ondisk_log_size":2848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:20:28.670256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8235,"num_write_kb":39276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"58'3","reported_seq":79,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.284912+0000","last_change":"2023-09-30T17:05:03.307212+0000","last_active":"2023-09-30T17:05:05.284912+0000","last_peered":"2023-09-30T17:05:05.284912+0000","last_clean":"2023-09-30T17:05:05.284912+0000","last_became_active":"2023-09-30T17:05:03.306711+0000","last_became_peered":"2023-09-30T17:05:03.306711+0000","last_unstale":"2023-09-30T17:05:05.284912+0000","last_undegraded":"2023-09-30T17:05:05.284912+0000","last_fullsized":"2023-09-30T17:05:05.284912+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:11:56.900744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"59'10","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.282885+0000","last_change":"2023-09-30T17:05:03.311669+0000","last_active":"2023-09-30T17:05:05.282885+0000","last_peered":"2023-09-30T17:05:05.282885+0000","last_clean":"2023-09-30T17:05:05.282885+0000","last_became_active":"2023-09-30T17:05:03.310763+0000","last_became_peered":"2023-09-30T17:05:03.310763+0000","last_unstale":"2023-09-30T17:05:05.282885+0000","last_undegraded":"2023-09-30T17:05:05.282885+0000","last_fullsized":"2023-09-30T17:05:05.282885+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:36:53.333402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":65,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.282208+0000","last_change":"2023-09-30T17:02:17.360802+0000","last_active":"2023-09-30T17:05:05.282208+0000","last_peered":"2023-09-30T17:05:05.282208+0000","last_clean":"2023-09-30T17:05:05.282208+0000","last_became_active":"2023-09-30T17:02:17.360475+0000","last_became_peered":"2023-09-30T17:02:17.360475+0000","last_unstale":"2023-09-30T17:05:05.282208+0000","last_undegraded":"2023-09-30T17:05:05.282208+0000","last_fullsized":"2023-09-30T17:05:05.282208+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:50:18.455188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"59'5711","reported_seq":5774,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.282254+0000","last_change":"2023-09-30T17:02:18.359857+0000","last_active":"2023-09-30T17:05:05.282254+0000","last_peered":"2023-09-30T17:05:05.282254+0000","last_clean":"2023-09-30T17:05:05.282254+0000","last_became_active":"2023-09-30T17:02:18.357098+0000","last_became_peered":"2023-09-30T17:02:18.357098+0000","last_unstale":"2023-09-30T17:05:05.282254+0000","last_undegraded":"2023-09-30T17:05:05.282254+0000","last_fullsized":"2023-09-30T17:05:05.282254+0000","mapping_epoch":17,"log_start":"42'1200","ondisk_log_start":"42'1200","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4511,"log_dups_size":1200,"ondisk_log_size":4511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:48:17.598726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16681,"num_write_kb":79476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":79,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.282297+0000","last_change":"2023-09-30T17:05:03.313345+0000","last_active":"2023-09-30T17:05:05.282297+0000","last_peered":"2023-09-30T17:05:05.282297+0000","last_clean":"2023-09-30T17:05:05.282297+0000","last_became_active":"2023-09-30T17:05:03.313050+0000","last_became_peered":"2023-09-30T17:05:03.313050+0000","last_unstale":"2023-09-30T17:05:05.282297+0000","last_undegraded":"2023-09-30T17:05:05.282297+0000","last_fullsized":"2023-09-30T17:05:05.282297+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:24:52.247523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"59'2872","reported_seq":2933,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.290298+0000","last_change":"2023-09-30T17:05:06.290298+0000","last_active":"2023-09-30T17:05:06.290298+0000","last_peered":"2023-09-30T17:05:06.290298+0000","last_clean":"2023-09-30T17:05:06.290298+0000","last_became_active":"2023-09-30T17:05:06.289197+0000","last_became_peered":"2023-09-30T17:05:06.289197+0000","last_unstale":"2023-09-30T17:05:06.290298+0000","last_undegraded":"2023-09-30T17:05:06.290298+0000","last_fullsized":"2023-09-30T17:05:06.290298+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2872,"log_dups_size":0,"ondisk_log_size":2872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:57:10.410506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8447,"num_write_kb":40072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"59'9","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.282853+0000","last_change":"2023-09-30T17:05:03.310950+0000","last_active":"2023-09-30T17:05:05.282853+0000","last_peered":"2023-09-30T17:05:05.282853+0000","last_clean":"2023-09-30T17:05:05.282853+0000","last_became_active":"2023-09-30T17:05:03.310591+0000","last_became_peered":"2023-09-30T17:05:03.310591+0000","last_unstale":"2023-09-30T17:05:05.282853+0000","last_undegraded":"2023-09-30T17:05:05.282853+0000","last_fullsized":"2023-09-30T17:05:05.282853+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:26:23.194138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"59'13","reported_seq":76,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.280731+0000","last_change":"2023-09-30T17:02:18.363479+0000","last_active":"2023-09-30T17:05:05.280731+0000","last_peered":"2023-09-30T17:05:05.280731+0000","last_clean":"2023-09-30T17:05:05.280731+0000","last_became_active":"2023-09-30T17:02:18.363222+0000","last_became_peered":"2023-09-30T17:02:18.363222+0000","last_unstale":"2023-09-30T17:05:05.280731+0000","last_undegraded":"2023-09-30T17:05:05.280731+0000","last_fullsized":"2023-09-30T17:05:05.280731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:09:55.056098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"59'2796","reported_seq":2879,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.292455+0000","last_change":"2023-09-30T17:05:06.292455+0000","last_active":"2023-09-30T17:05:06.292455+0000","last_peered":"2023-09-30T17:05:06.292455+0000","last_clean":"2023-09-30T17:05:06.292455+0000","last_became_active":"2023-09-30T17:05:06.290929+0000","last_became_peered":"2023-09-30T17:05:06.290929+0000","last_unstale":"2023-09-30T17:05:06.292455+0000","last_undegraded":"2023-09-30T17:05:06.292455+0000","last_fullsized":"2023-09-30T17:05:06.292455+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2796,"log_dups_size":0,"ondisk_log_size":2796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:54:14.579761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8138,"num_write_kb":38784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"59'2852","reported_seq":2915,"reported_epoch":69,"state":"active+clean","last_fresh":"2023-09-30T17:05:05.281266+0000","last_change":"2023-09-30T17:02:18.363216+0000","last_active":"2023-09-30T17:05:05.281266+0000","last_peered":"2023-09-30T17:05:05.281266+0000","last_clean":"2023-09-30T17:05:05.281266+0000","last_became_active":"2023-09-30T17:02:18.362894+0000","last_became_peered":"2023-09-30T17:02:18.362894+0000","last_unstale":"2023-09-30T17:05:05.281266+0000","last_undegraded":"2023-09-30T17:05:05.281266+0000","last_fullsized":"2023-09-30T17:05:05.281266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2852,"log_dups_size":0,"ondisk_log_size":2852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:30:43.782165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8357,"num_write_kb":39780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"59'2874","reported_seq":2957,"reported_epoch":70,"state":"active+clean","last_fresh":"2023-09-30T17:05:06.294279+0000","last_change":"2023-09-30T17:05:06.294279+0000","last_active":"2023-09-30T17:05:06.294279+0000","last_peered":"2023-09-30T17:05:06.294279+0000","last_clean":"2023-09-30T17:05:06.294279+0000","last_became_active":"2023-09-30T17:05:06.292898+0000","last_became_peered":"2023-09-30T17:05:06.292898+0000","last_unstale":"2023-09-30T17:05:06.294279+0000","last_undegraded":"2023-09-30T17:05:06.294279+0000","last_fullsized":"2023-09-30T17:05:06.294279+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2874,"log_dups_size":0,"ondisk_log_size":2874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:02:14.484209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8465,"num_write_kb":40104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":532685,"num_write_kb":2575302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140940,"ondisk_log_size":140940,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":228927,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":137,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":223425,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":524288,"data_stored":457854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":66,"seq":283467841539,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47000,"kb_used_data":1412,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94324840,"statfs":{"total":96636764160,"available":96588636160,"internally_reserved":0,"allocated":1445888,"data_stored":1098605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7139,"internal_metadata":46654493},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738408,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":582412,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":580990,"kb_avail":93789428,"statfs":{"total":96636764160,"available":96040374272,"internally_reserved":0,"allocated":1433600,"data_stored":1097383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":594934214},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 17:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.51800000000000002,"15min":0.48999999999999999},"min":{"1min":0.215,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":5.9480000000000004,"5min":5.9480000000000004,"15min":5.9480000000000004},"last":0.317},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.503,"15min":0.46300000000000002},"min":{"1min":0.216,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":3.6819999999999999,"5min":3.6819999999999999,"15min":3.6819999999999999},"last":0.27700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48599999999999999}]}]},{"osd":1,"up_from":8,"seq":34359738408,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":563552,"kb_used_data":588,"kb_used_omap":1,"kb_used_meta":562942,"kb_avail":93808288,"statfs":{"total":96636764160,"available":96059686912,"internally_reserved":0,"allocated":602112,"data_stored":280532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":576453062},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 17:04:10 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.432,"15min":0.438},"min":{"1min":0.17100000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":1.831,"5min":1.831,"15min":1.831},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.46600000000000003,"15min":0.44500000000000001},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":2.5430000000000001,"5min":2.5430000000000001,"15min":2.5430000000000001},"last":0.55500000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":249856,"data_stored":227705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":228927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T17:05:14.636 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2023-09-30T17:05:14.637 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 1.00 2023-09-30T17:05:14.637 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2023-09-30T17:05:14.637 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2023-09-30T17:05:14.977 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:05:15.066 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-09-30T17:05:15.067 INFO:teuthology.orchestra.run.smithi007.stdout: "epoch": 70, 2023-09-30T17:05:15.067 INFO:teuthology.orchestra.run.smithi007.stdout: "fsid": "68daccc3-6ea9-4db7-9771-3803ff202df8", 2023-09-30T17:05:15.067 INFO:teuthology.orchestra.run.smithi007.stdout: "created": "2023-09-30T17:01:55.306262+0000", 2023-09-30T17:05:15.067 INFO:teuthology.orchestra.run.smithi007.stdout: "modified": "2023-09-30T17:05:06.278159+0000", 2023-09-30T17:05:15.067 INFO:teuthology.orchestra.run.smithi007.stdout: "last_up_change": "2023-09-30T17:05:02.282813+0000", 2023-09-30T17:05:15.067 INFO:teuthology.orchestra.run.smithi007.stdout: "last_in_change": "2023-09-30T17:01:56.571968+0000", 2023-09-30T17:05:15.067 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-09-30T17:05:15.067 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_num": 5799936, 2023-09-30T17:05:15.067 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_set": [ 2023-09-30T17:05:15.067 INFO:teuthology.orchestra.run.smithi007.stdout: "pglog_hardlimit", 2023-09-30T17:05:15.067 INFO:teuthology.orchestra.run.smithi007.stdout: "purged_snapdirs", 2023-09-30T17:05:15.068 INFO:teuthology.orchestra.run.smithi007.stdout: "recovery_deletes", 2023-09-30T17:05:15.068 INFO:teuthology.orchestra.run.smithi007.stdout: "sortbitwise" 2023-09-30T17:05:15.068 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-09-30T17:05:15.068 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_version": 5, 2023-09-30T17:05:15.068 INFO:teuthology.orchestra.run.smithi007.stdout: "full_ratio": 0.94999998807907104, 2023-09-30T17:05:15.068 INFO:teuthology.orchestra.run.smithi007.stdout: "backfillfull_ratio": 0.89999997615814209, 2023-09-30T17:05:15.068 INFO:teuthology.orchestra.run.smithi007.stdout: "nearfull_ratio": 0.85000002384185791, 2023-09-30T17:05:15.068 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_snapshot": "", 2023-09-30T17:05:15.068 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_max": 4, 2023-09-30T17:05:15.068 INFO:teuthology.orchestra.run.smithi007.stdout: "max_osd": 3, 2023-09-30T17:05:15.068 INFO:teuthology.orchestra.run.smithi007.stdout: "require_min_compat_client": "luminous", 2023-09-30T17:05:15.068 INFO:teuthology.orchestra.run.smithi007.stdout: "min_compat_client": "jewel", 2023-09-30T17:05:15.069 INFO:teuthology.orchestra.run.smithi007.stdout: "require_osd_release": "reef", 2023-09-30T17:05:15.069 INFO:teuthology.orchestra.run.smithi007.stdout: "allow_crimson": false, 2023-09-30T17:05:15.069 INFO:teuthology.orchestra.run.smithi007.stdout: "pools": [ 2023-09-30T17:05:15.069 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:05:15.069 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 1, 2023-09-30T17:05:15.069 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": ".mgr", 2023-09-30T17:05:15.069 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-09-30T17:02:05.343048+0000", 2023-09-30T17:05:15.069 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2023-09-30T17:05:15.069 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool", 2023-09-30T17:05:15.069 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-09-30T17:05:15.069 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-09-30T17:05:15.070 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-09-30T17:05:15.070 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-09-30T17:05:15.070 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-09-30T17:05:15.070 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-09-30T17:05:15.070 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T17:05:15.070 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T17:05:15.070 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-09-30T17:05:15.070 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-09-30T17:05:15.070 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 1, 2023-09-30T17:05:15.070 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 1, 2023-09-30T17:05:15.070 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 1, 2023-09-30T17:05:15.070 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 1, 2023-09-30T17:05:15.071 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 1, 2023-09-30T17:05:15.071 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-09-30T17:05:15.071 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-09-30T17:05:15.071 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-09-30T17:05:15.071 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-09-30T17:05:15.071 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-09-30T17:05:15.071 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-09-30T17:05:15.071 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-09-30T17:05:15.071 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:05:15.071 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "12", 2023-09-30T17:05:15.071 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-09-30T17:05:15.072 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T17:05:15.072 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T17:05:15.072 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-09-30T17:05:15.072 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-09-30T17:05:15.072 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 0, 2023-09-30T17:05:15.072 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 0, 2023-09-30T17:05:15.072 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-09-30T17:05:15.072 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-09-30T17:05:15.072 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-09-30T17:05:15.072 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-09-30T17:05:15.072 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-09-30T17:05:15.072 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-09-30T17:05:15.073 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-09-30T17:05:15.073 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-09-30T17:05:15.073 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-09-30T17:05:15.073 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-09-30T17:05:15.073 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-09-30T17:05:15.073 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T17:05:15.073 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T17:05:15.073 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T17:05:15.073 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-09-30T17:05:15.073 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-09-30T17:05:15.073 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-09-30T17:05:15.073 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-09-30T17:05:15.074 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-09-30T17:05:15.074 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:05:15.074 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-09-30T17:05:15.074 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-09-30T17:05:15.074 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-09-30T17:05:15.074 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-09-30T17:05:15.074 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-09-30T17:05:15.074 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T17:05:15.074 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-09-30T17:05:15.074 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-09-30T17:05:15.075 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-09-30T17:05:15.075 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-09-30T17:05:15.075 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-09-30T17:05:15.075 INFO:teuthology.orchestra.run.smithi007.stdout: "options": { 2023-09-30T17:05:15.075 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_max": 32, 2023-09-30T17:05:15.075 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_min": 1 2023-09-30T17:05:15.075 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:05:15.075 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-09-30T17:05:15.076 INFO:teuthology.orchestra.run.smithi007.stdout: "mgr": {} 2023-09-30T17:05:15.076 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:05:15.076 INFO:teuthology.orchestra.run.smithi007.stdout: "read_balance": { 2023-09-30T17:05:15.076 INFO:teuthology.orchestra.run.smithi007.stdout: "score_acting": 2.9900000095367432, 2023-09-30T17:05:15.076 INFO:teuthology.orchestra.run.smithi007.stdout: "score_stable": 2.9900000095367432, 2023-09-30T17:05:15.076 INFO:teuthology.orchestra.run.smithi007.stdout: "optimal_score": 0.67000001668930054, 2023-09-30T17:05:15.076 INFO:teuthology.orchestra.run.smithi007.stdout: "raw_score_acting": 2, 2023-09-30T17:05:15.077 INFO:teuthology.orchestra.run.smithi007.stdout: "raw_score_stable": 2, 2023-09-30T17:05:15.077 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity_weighted": 1, 2023-09-30T17:05:15.077 INFO:teuthology.orchestra.run.smithi007.stdout: "average_primary_affinity": 1, 2023-09-30T17:05:15.077 INFO:teuthology.orchestra.run.smithi007.stdout: "average_primary_affinity_weighted": 1 2023-09-30T17:05:15.077 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-09-30T17:05:15.077 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:05:15.077 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:05:15.077 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 2, 2023-09-30T17:05:15.077 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "rbd", 2023-09-30T17:05:15.078 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-09-30T17:02:11.033979+0000", 2023-09-30T17:05:15.078 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2023-09-30T17:05:15.078 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool", 2023-09-30T17:05:15.078 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-09-30T17:05:15.078 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-09-30T17:05:15.078 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-09-30T17:05:15.078 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-09-30T17:05:15.078 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-09-30T17:05:15.078 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-09-30T17:05:15.079 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T17:05:15.079 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T17:05:15.079 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-09-30T17:05:15.079 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-09-30T17:05:15.079 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 8, 2023-09-30T17:05:15.079 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 8, 2023-09-30T17:05:15.079 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 8, 2023-09-30T17:05:15.079 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 8, 2023-09-30T17:05:15.079 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 8, 2023-09-30T17:05:15.080 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-09-30T17:05:15.080 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-09-30T17:05:15.080 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-09-30T17:05:15.080 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-09-30T17:05:15.080 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-09-30T17:05:15.080 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-09-30T17:05:15.080 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-09-30T17:05:15.080 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:05:15.081 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "15", 2023-09-30T17:05:15.081 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-09-30T17:05:15.081 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T17:05:15.081 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T17:05:15.081 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-09-30T17:05:15.081 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-09-30T17:05:15.081 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 0, 2023-09-30T17:05:15.081 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 0, 2023-09-30T17:05:15.081 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-09-30T17:05:15.082 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-09-30T17:05:15.082 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-09-30T17:05:15.082 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-09-30T17:05:15.083 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-09-30T17:05:15.083 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-09-30T17:05:15.083 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-09-30T17:05:15.083 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-09-30T17:05:15.085 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-09-30T17:05:15.085 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-09-30T17:05:15.085 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-09-30T17:05:15.085 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T17:05:15.085 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T17:05:15.085 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T17:05:15.085 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-09-30T17:05:15.086 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-09-30T17:05:15.086 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-09-30T17:05:15.086 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-09-30T17:05:15.087 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-09-30T17:05:15.087 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:05:15.087 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-09-30T17:05:15.088 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-09-30T17:05:15.088 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-09-30T17:05:15.088 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-09-30T17:05:15.088 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-09-30T17:05:15.088 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T17:05:15.088 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-09-30T17:05:15.088 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-09-30T17:05:15.088 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-09-30T17:05:15.088 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-09-30T17:05:15.088 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-09-30T17:05:15.089 INFO:teuthology.orchestra.run.smithi007.stdout: "options": {}, 2023-09-30T17:05:15.089 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-09-30T17:05:15.089 INFO:teuthology.orchestra.run.smithi007.stdout: "rbd": {} 2023-09-30T17:05:15.089 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:05:15.089 INFO:teuthology.orchestra.run.smithi007.stdout: "read_balance": { 2023-09-30T17:05:15.089 INFO:teuthology.orchestra.run.smithi007.stdout: "score_acting": 1.5, 2023-09-30T17:05:15.089 INFO:teuthology.orchestra.run.smithi007.stdout: "score_stable": 1.5, 2023-09-30T17:05:15.089 INFO:teuthology.orchestra.run.smithi007.stdout: "optimal_score": 1, 2023-09-30T17:05:15.089 INFO:teuthology.orchestra.run.smithi007.stdout: "raw_score_acting": 1.5, 2023-09-30T17:05:15.090 INFO:teuthology.orchestra.run.smithi007.stdout: "raw_score_stable": 1.5, 2023-09-30T17:05:15.090 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity_weighted": 1, 2023-09-30T17:05:15.090 INFO:teuthology.orchestra.run.smithi007.stdout: "average_primary_affinity": 1, 2023-09-30T17:05:15.090 INFO:teuthology.orchestra.run.smithi007.stdout: "average_primary_affinity_weighted": 1 2023-09-30T17:05:15.090 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-09-30T17:05:15.090 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:05:15.090 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:05:15.090 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 3, 2023-09-30T17:05:15.090 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "cephfs_metadata", 2023-09-30T17:05:15.090 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-09-30T17:02:15.583451+0000", 2023-09-30T17:05:15.090 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2023-09-30T17:05:15.091 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool", 2023-09-30T17:05:15.091 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-09-30T17:05:15.091 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-09-30T17:05:15.091 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-09-30T17:05:15.091 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-09-30T17:05:15.091 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-09-30T17:05:15.091 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-09-30T17:05:15.091 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T17:05:15.091 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T17:05:15.092 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-09-30T17:05:15.092 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-09-30T17:05:15.092 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 32, 2023-09-30T17:05:15.092 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 32, 2023-09-30T17:05:15.092 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 32, 2023-09-30T17:05:15.092 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 32, 2023-09-30T17:05:15.092 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 32, 2023-09-30T17:05:15.092 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-09-30T17:05:15.092 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-09-30T17:05:15.092 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-09-30T17:05:15.093 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-09-30T17:05:15.093 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-09-30T17:05:15.093 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-09-30T17:05:15.093 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-09-30T17:05:15.093 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:05:15.093 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "18", 2023-09-30T17:05:15.093 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-09-30T17:05:15.093 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T17:05:15.093 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T17:05:15.093 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-09-30T17:05:15.094 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-09-30T17:05:15.094 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 0, 2023-09-30T17:05:15.094 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 0, 2023-09-30T17:05:15.094 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-09-30T17:05:15.094 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-09-30T17:05:15.094 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-09-30T17:05:15.094 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-09-30T17:05:15.094 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-09-30T17:05:15.095 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-09-30T17:05:15.095 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-09-30T17:05:15.095 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-09-30T17:05:15.095 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-09-30T17:05:15.095 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-09-30T17:05:15.095 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-09-30T17:05:15.095 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T17:05:15.095 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T17:05:15.096 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T17:05:15.096 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-09-30T17:05:15.096 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-09-30T17:05:15.096 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-09-30T17:05:15.096 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-09-30T17:05:15.096 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-09-30T17:05:15.096 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:05:15.096 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-09-30T17:05:15.097 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-09-30T17:05:15.097 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-09-30T17:05:15.097 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-09-30T17:05:15.097 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-09-30T17:05:15.097 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T17:05:15.097 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-09-30T17:05:15.097 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-09-30T17:05:15.097 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-09-30T17:05:15.097 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-09-30T17:05:15.098 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-09-30T17:05:15.098 INFO:teuthology.orchestra.run.smithi007.stdout: "options": { 2023-09-30T17:05:15.098 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_bias": 4, 2023-09-30T17:05:15.098 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_min": 16, 2023-09-30T17:05:15.098 INFO:teuthology.orchestra.run.smithi007.stdout: "recovery_priority": 5 2023-09-30T17:05:15.098 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:05:15.098 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-09-30T17:05:15.099 INFO:teuthology.orchestra.run.smithi007.stdout: "cephfs": { 2023-09-30T17:05:15.099 INFO:teuthology.orchestra.run.smithi007.stdout: "metadata": "cephfs" 2023-09-30T17:05:15.099 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-09-30T17:05:15.100 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:05:15.101 INFO:teuthology.orchestra.run.smithi007.stdout: "read_balance": { 2023-09-30T17:05:15.101 INFO:teuthology.orchestra.run.smithi007.stdout: "score_acting": 1.1299999952316284, 2023-09-30T17:05:15.101 INFO:teuthology.orchestra.run.smithi007.stdout: "score_stable": 1.1299999952316284, 2023-09-30T17:05:15.101 INFO:teuthology.orchestra.run.smithi007.stdout: "optimal_score": 1, 2023-09-30T17:05:15.101 INFO:teuthology.orchestra.run.smithi007.stdout: "raw_score_acting": 1.1299999952316284, 2023-09-30T17:05:15.101 INFO:teuthology.orchestra.run.smithi007.stdout: "raw_score_stable": 1.1299999952316284, 2023-09-30T17:05:15.101 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity_weighted": 1, 2023-09-30T17:05:15.101 INFO:teuthology.orchestra.run.smithi007.stdout: "average_primary_affinity": 1, 2023-09-30T17:05:15.102 INFO:teuthology.orchestra.run.smithi007.stdout: "average_primary_affinity_weighted": 1 2023-09-30T17:05:15.102 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-09-30T17:05:15.102 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:05:15.102 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:05:15.102 INFO:teuthology.orchestra.run.smithi007.stdout: "pool": 4, 2023-09-30T17:05:15.102 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_name": "cephfs_data", 2023-09-30T17:05:15.102 INFO:teuthology.orchestra.run.smithi007.stdout: "create_time": "2023-09-30T17:02:16.734427+0000", 2023-09-30T17:05:15.102 INFO:teuthology.orchestra.run.smithi007.stdout: "flags": 1, 2023-09-30T17:05:15.102 INFO:teuthology.orchestra.run.smithi007.stdout: "flags_names": "hashpspool", 2023-09-30T17:05:15.103 INFO:teuthology.orchestra.run.smithi007.stdout: "type": 1, 2023-09-30T17:05:15.103 INFO:teuthology.orchestra.run.smithi007.stdout: "size": 2, 2023-09-30T17:05:15.103 INFO:teuthology.orchestra.run.smithi007.stdout: "min_size": 1, 2023-09-30T17:05:15.103 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_rule": 0, 2023-09-30T17:05:15.103 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_count": 0, 2023-09-30T17:05:15.103 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_target": 0, 2023-09-30T17:05:15.103 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_barrier": 0, 2023-09-30T17:05:15.103 INFO:teuthology.orchestra.run.smithi007.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-09-30T17:05:15.103 INFO:teuthology.orchestra.run.smithi007.stdout: "object_hash": 2, 2023-09-30T17:05:15.103 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_autoscale_mode": "off", 2023-09-30T17:05:15.103 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num": 64, 2023-09-30T17:05:15.104 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num": 64, 2023-09-30T17:05:15.104 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_placement_num_target": 64, 2023-09-30T17:05:15.104 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_target": 64, 2023-09-30T17:05:15.104 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_pending": 64, 2023-09-30T17:05:15.104 INFO:teuthology.orchestra.run.smithi007.stdout: "last_pg_merge_meta": { 2023-09-30T17:05:15.104 INFO:teuthology.orchestra.run.smithi007.stdout: "source_pgid": "0.0", 2023-09-30T17:05:15.104 INFO:teuthology.orchestra.run.smithi007.stdout: "ready_epoch": 0, 2023-09-30T17:05:15.104 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_started": 0, 2023-09-30T17:05:15.104 INFO:teuthology.orchestra.run.smithi007.stdout: "last_epoch_clean": 0, 2023-09-30T17:05:15.104 INFO:teuthology.orchestra.run.smithi007.stdout: "source_version": "0'0", 2023-09-30T17:05:15.105 INFO:teuthology.orchestra.run.smithi007.stdout: "target_version": "0'0" 2023-09-30T17:05:15.105 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:05:15.105 INFO:teuthology.orchestra.run.smithi007.stdout: "last_change": "19", 2023-09-30T17:05:15.105 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend": "0", 2023-09-30T17:05:15.105 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_prenautilus": "0", 2023-09-30T17:05:15.105 INFO:teuthology.orchestra.run.smithi007.stdout: "last_force_op_resend_preluminous": "0", 2023-09-30T17:05:15.105 INFO:teuthology.orchestra.run.smithi007.stdout: "auid": 0, 2023-09-30T17:05:15.105 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_mode": "selfmanaged", 2023-09-30T17:05:15.105 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_seq": 0, 2023-09-30T17:05:15.106 INFO:teuthology.orchestra.run.smithi007.stdout: "snap_epoch": 0, 2023-09-30T17:05:15.106 INFO:teuthology.orchestra.run.smithi007.stdout: "pool_snaps": [], 2023-09-30T17:05:15.106 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps": "[]", 2023-09-30T17:05:15.106 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_bytes": 0, 2023-09-30T17:05:15.106 INFO:teuthology.orchestra.run.smithi007.stdout: "quota_max_objects": 0, 2023-09-30T17:05:15.106 INFO:teuthology.orchestra.run.smithi007.stdout: "tiers": [], 2023-09-30T17:05:15.106 INFO:teuthology.orchestra.run.smithi007.stdout: "tier_of": -1, 2023-09-30T17:05:15.106 INFO:teuthology.orchestra.run.smithi007.stdout: "read_tier": -1, 2023-09-30T17:05:15.106 INFO:teuthology.orchestra.run.smithi007.stdout: "write_tier": -1, 2023-09-30T17:05:15.107 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_mode": "none", 2023-09-30T17:05:15.107 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_bytes": 0, 2023-09-30T17:05:15.107 INFO:teuthology.orchestra.run.smithi007.stdout: "target_max_objects": 0, 2023-09-30T17:05:15.107 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-09-30T17:05:15.107 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-09-30T17:05:15.107 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_target_full_ratio_micro": 800000, 2023-09-30T17:05:15.107 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_flush_age": 0, 2023-09-30T17:05:15.107 INFO:teuthology.orchestra.run.smithi007.stdout: "cache_min_evict_age": 0, 2023-09-30T17:05:15.107 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profile": "", 2023-09-30T17:05:15.107 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_params": { 2023-09-30T17:05:15.108 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "none" 2023-09-30T17:05:15.108 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:05:15.108 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_period": 0, 2023-09-30T17:05:15.108 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_count": 0, 2023-09-30T17:05:15.108 INFO:teuthology.orchestra.run.smithi007.stdout: "use_gmt_hitset": true, 2023-09-30T17:05:15.108 INFO:teuthology.orchestra.run.smithi007.stdout: "min_read_recency_for_promote": 0, 2023-09-30T17:05:15.108 INFO:teuthology.orchestra.run.smithi007.stdout: "min_write_recency_for_promote": 0, 2023-09-30T17:05:15.108 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_grade_decay_rate": 0, 2023-09-30T17:05:15.108 INFO:teuthology.orchestra.run.smithi007.stdout: "hit_set_search_last_n": 0, 2023-09-30T17:05:15.108 INFO:teuthology.orchestra.run.smithi007.stdout: "grade_table": [], 2023-09-30T17:05:15.109 INFO:teuthology.orchestra.run.smithi007.stdout: "stripe_width": 0, 2023-09-30T17:05:15.109 INFO:teuthology.orchestra.run.smithi007.stdout: "expected_num_objects": 0, 2023-09-30T17:05:15.109 INFO:teuthology.orchestra.run.smithi007.stdout: "fast_read": false, 2023-09-30T17:05:15.109 INFO:teuthology.orchestra.run.smithi007.stdout: "options": { 2023-09-30T17:05:15.109 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_num_min": 64, 2023-09-30T17:05:15.109 INFO:teuthology.orchestra.run.smithi007.stdout: "target_size_ratio": 0.89999997615814209 2023-09-30T17:05:15.109 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:05:15.109 INFO:teuthology.orchestra.run.smithi007.stdout: "application_metadata": { 2023-09-30T17:05:15.109 INFO:teuthology.orchestra.run.smithi007.stdout: "cephfs": { 2023-09-30T17:05:15.110 INFO:teuthology.orchestra.run.smithi007.stdout: "data": "cephfs" 2023-09-30T17:05:15.110 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-09-30T17:05:15.110 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:05:15.110 INFO:teuthology.orchestra.run.smithi007.stdout: "read_balance": { 2023-09-30T17:05:15.110 INFO:teuthology.orchestra.run.smithi007.stdout: "score_acting": 1.1299999952316284, 2023-09-30T17:05:15.110 INFO:teuthology.orchestra.run.smithi007.stdout: "score_stable": 1.1299999952316284, 2023-09-30T17:05:15.110 INFO:teuthology.orchestra.run.smithi007.stdout: "optimal_score": 1, 2023-09-30T17:05:15.110 INFO:teuthology.orchestra.run.smithi007.stdout: "raw_score_acting": 1.1299999952316284, 2023-09-30T17:05:15.110 INFO:teuthology.orchestra.run.smithi007.stdout: "raw_score_stable": 1.1299999952316284, 2023-09-30T17:05:15.111 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity_weighted": 1, 2023-09-30T17:05:15.111 INFO:teuthology.orchestra.run.smithi007.stdout: "average_primary_affinity": 1, 2023-09-30T17:05:15.111 INFO:teuthology.orchestra.run.smithi007.stdout: "average_primary_affinity_weighted": 1 2023-09-30T17:05:15.111 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-09-30T17:05:15.111 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-09-30T17:05:15.111 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-09-30T17:05:15.111 INFO:teuthology.orchestra.run.smithi007.stdout: "osds": [ 2023-09-30T17:05:15.111 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:05:15.111 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 0, 2023-09-30T17:05:15.112 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "a9d1653a-8830-4fad-911b-8e7221ee8697", 2023-09-30T17:05:15.112 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-09-30T17:05:15.112 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 1, 2023-09-30T17:05:15.112 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 1, 2023-09-30T17:05:15.112 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 1, 2023-09-30T17:05:15.112 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-09-30T17:05:15.112 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-09-30T17:05:15.112 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 8, 2023-09-30T17:05:15.112 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 69, 2023-09-30T17:05:15.113 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-09-30T17:05:15.113 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-09-30T17:05:15.113 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-09-30T17:05:15.113 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-09-30T17:05:15.113 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:05:15.113 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-09-30T17:05:15.113 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.31:6800", 2023-09-30T17:05:15.113 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 2212861041 2023-09-30T17:05:15.113 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:05:15.113 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:05:15.114 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-09-30T17:05:15.114 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.31:6801", 2023-09-30T17:05:15.114 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 2212861041 2023-09-30T17:05:15.114 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-09-30T17:05:15.114 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-09-30T17:05:15.114 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:05:15.114 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-09-30T17:05:15.115 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-09-30T17:05:15.115 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:05:15.115 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-09-30T17:05:15.116 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.31:6802", 2023-09-30T17:05:15.116 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 2212861041 2023-09-30T17:05:15.116 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:05:15.116 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:05:15.116 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-09-30T17:05:15.116 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.31:6803", 2023-09-30T17:05:15.116 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 2212861041 2023-09-30T17:05:15.116 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-09-30T17:05:15.116 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-09-30T17:05:15.117 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:05:15.117 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-09-30T17:05:15.117 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-09-30T17:05:15.117 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:05:15.117 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-09-30T17:05:15.117 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.31:6806", 2023-09-30T17:05:15.117 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 2212861041 2023-09-30T17:05:15.117 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:05:15.117 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:05:15.117 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-09-30T17:05:15.118 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.31:6807", 2023-09-30T17:05:15.118 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 2212861041 2023-09-30T17:05:15.118 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-09-30T17:05:15.118 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-09-30T17:05:15.118 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:05:15.118 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-09-30T17:05:15.118 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-09-30T17:05:15.118 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:05:15.119 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-09-30T17:05:15.119 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.31:6804", 2023-09-30T17:05:15.119 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 2212861041 2023-09-30T17:05:15.119 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:05:15.119 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:05:15.120 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-09-30T17:05:15.120 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.31:6805", 2023-09-30T17:05:15.120 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 2212861041 2023-09-30T17:05:15.120 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-09-30T17:05:15.120 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-09-30T17:05:15.120 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:05:15.120 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.31:6801/2212861041", 2023-09-30T17:05:15.120 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.31:6803/2212861041", 2023-09-30T17:05:15.120 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.31:6807/2212861041", 2023-09-30T17:05:15.121 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.31:6805/2212861041", 2023-09-30T17:05:15.121 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-09-30T17:05:15.121 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-09-30T17:05:15.121 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-09-30T17:05:15.121 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-09-30T17:05:15.121 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:05:15.121 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:05:15.121 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 1, 2023-09-30T17:05:15.122 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "7123aa56-aa1a-43a4-b154-a40b4c70d169", 2023-09-30T17:05:15.122 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-09-30T17:05:15.122 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 1, 2023-09-30T17:05:15.122 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 1, 2023-09-30T17:05:15.122 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 1, 2023-09-30T17:05:15.122 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 0, 2023-09-30T17:05:15.122 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 0, 2023-09-30T17:05:15.122 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 8, 2023-09-30T17:05:15.123 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 69, 2023-09-30T17:05:15.123 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 0, 2023-09-30T17:05:15.123 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-09-30T17:05:15.123 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-09-30T17:05:15.123 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-09-30T17:05:15.123 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:05:15.123 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-09-30T17:05:15.123 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.72:6800", 2023-09-30T17:05:15.123 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1680420094 2023-09-30T17:05:15.123 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:05:15.123 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:05:15.124 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-09-30T17:05:15.124 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.72:6801", 2023-09-30T17:05:15.124 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1680420094 2023-09-30T17:05:15.124 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-09-30T17:05:15.124 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-09-30T17:05:15.124 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:05:15.124 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-09-30T17:05:15.124 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-09-30T17:05:15.124 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:05:15.124 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-09-30T17:05:15.124 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.72:6802", 2023-09-30T17:05:15.125 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1680420094 2023-09-30T17:05:15.125 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:05:15.125 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:05:15.125 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-09-30T17:05:15.125 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.72:6803", 2023-09-30T17:05:15.125 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1680420094 2023-09-30T17:05:15.125 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-09-30T17:05:15.125 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-09-30T17:05:15.125 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:05:15.125 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-09-30T17:05:15.125 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-09-30T17:05:15.126 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:05:15.126 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-09-30T17:05:15.126 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.72:6806", 2023-09-30T17:05:15.126 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1680420094 2023-09-30T17:05:15.126 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:05:15.126 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:05:15.126 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-09-30T17:05:15.126 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.72:6807", 2023-09-30T17:05:15.126 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1680420094 2023-09-30T17:05:15.126 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-09-30T17:05:15.126 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-09-30T17:05:15.127 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:05:15.127 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-09-30T17:05:15.127 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-09-30T17:05:15.127 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:05:15.127 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-09-30T17:05:15.127 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.72:6804", 2023-09-30T17:05:15.127 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1680420094 2023-09-30T17:05:15.127 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:05:15.127 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:05:15.127 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-09-30T17:05:15.127 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.72:6805", 2023-09-30T17:05:15.127 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 1680420094 2023-09-30T17:05:15.128 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-09-30T17:05:15.128 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-09-30T17:05:15.128 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:05:15.128 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.72:6801/1680420094", 2023-09-30T17:05:15.128 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.72:6803/1680420094", 2023-09-30T17:05:15.128 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.72:6807/1680420094", 2023-09-30T17:05:15.128 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.72:6805/1680420094", 2023-09-30T17:05:15.128 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-09-30T17:05:15.128 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-09-30T17:05:15.128 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-09-30T17:05:15.128 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-09-30T17:05:15.129 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:05:15.129 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:05:15.129 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 2, 2023-09-30T17:05:15.129 INFO:teuthology.orchestra.run.smithi007.stdout: "uuid": "f40ee0d7-7bc3-4a46-bdac-9c134c55c907", 2023-09-30T17:05:15.129 INFO:teuthology.orchestra.run.smithi007.stdout: "up": 1, 2023-09-30T17:05:15.129 INFO:teuthology.orchestra.run.smithi007.stdout: "in": 1, 2023-09-30T17:05:15.129 INFO:teuthology.orchestra.run.smithi007.stdout: "weight": 1, 2023-09-30T17:05:15.130 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_affinity": 1, 2023-09-30T17:05:15.130 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_begin": 8, 2023-09-30T17:05:15.130 INFO:teuthology.orchestra.run.smithi007.stdout: "last_clean_end": 22, 2023-09-30T17:05:15.130 INFO:teuthology.orchestra.run.smithi007.stdout: "up_from": 66, 2023-09-30T17:05:15.130 INFO:teuthology.orchestra.run.smithi007.stdout: "up_thru": 69, 2023-09-30T17:05:15.130 INFO:teuthology.orchestra.run.smithi007.stdout: "down_at": 23, 2023-09-30T17:05:15.130 INFO:teuthology.orchestra.run.smithi007.stdout: "lost_at": 0, 2023-09-30T17:05:15.131 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addrs": { 2023-09-30T17:05:15.131 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-09-30T17:05:15.131 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:05:15.131 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-09-30T17:05:15.131 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.134:6800", 2023-09-30T17:05:15.131 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 3322751189 2023-09-30T17:05:15.131 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:05:15.131 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:05:15.131 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-09-30T17:05:15.131 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.134:6801", 2023-09-30T17:05:15.131 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 3322751189 2023-09-30T17:05:15.132 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-09-30T17:05:15.132 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-09-30T17:05:15.132 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:05:15.132 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addrs": { 2023-09-30T17:05:15.158 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-09-30T17:05:15.158 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:05:15.158 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-09-30T17:05:15.158 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.134:6802", 2023-09-30T17:05:15.158 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 3322751189 2023-09-30T17:05:15.158 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:05:15.158 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:05:15.158 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-09-30T17:05:15.158 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.134:6803", 2023-09-30T17:05:15.158 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 3322751189 2023-09-30T17:05:15.159 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-09-30T17:05:15.159 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-09-30T17:05:15.159 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:05:15.159 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addrs": { 2023-09-30T17:05:15.159 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-09-30T17:05:15.159 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:05:15.159 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-09-30T17:05:15.159 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.134:6806", 2023-09-30T17:05:15.159 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 3322751189 2023-09-30T17:05:15.159 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:05:15.160 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:05:15.160 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-09-30T17:05:15.160 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.134:6807", 2023-09-30T17:05:15.160 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 3322751189 2023-09-30T17:05:15.160 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-09-30T17:05:15.160 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-09-30T17:05:15.160 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:05:15.160 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addrs": { 2023-09-30T17:05:15.160 INFO:teuthology.orchestra.run.smithi007.stdout: "addrvec": [ 2023-09-30T17:05:15.160 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:05:15.161 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v2", 2023-09-30T17:05:15.161 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.134:6804", 2023-09-30T17:05:15.161 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 3322751189 2023-09-30T17:05:15.161 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:05:15.161 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:05:15.161 INFO:teuthology.orchestra.run.smithi007.stdout: "type": "v1", 2023-09-30T17:05:15.161 INFO:teuthology.orchestra.run.smithi007.stdout: "addr": "172.21.15.134:6805", 2023-09-30T17:05:15.161 INFO:teuthology.orchestra.run.smithi007.stdout: "nonce": 3322751189 2023-09-30T17:05:15.161 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-09-30T17:05:15.161 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-09-30T17:05:15.162 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:05:15.162 INFO:teuthology.orchestra.run.smithi007.stdout: "public_addr": "172.21.15.134:6801/3322751189", 2023-09-30T17:05:15.162 INFO:teuthology.orchestra.run.smithi007.stdout: "cluster_addr": "172.21.15.134:6803/3322751189", 2023-09-30T17:05:15.162 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_back_addr": "172.21.15.134:6807/3322751189", 2023-09-30T17:05:15.162 INFO:teuthology.orchestra.run.smithi007.stdout: "heartbeat_front_addr": "172.21.15.134:6805/3322751189", 2023-09-30T17:05:15.162 INFO:teuthology.orchestra.run.smithi007.stdout: "state": [ 2023-09-30T17:05:15.162 INFO:teuthology.orchestra.run.smithi007.stdout: "exists", 2023-09-30T17:05:15.162 INFO:teuthology.orchestra.run.smithi007.stdout: "up" 2023-09-30T17:05:15.162 INFO:teuthology.orchestra.run.smithi007.stdout: ] 2023-09-30T17:05:15.162 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-09-30T17:05:15.162 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-09-30T17:05:15.163 INFO:teuthology.orchestra.run.smithi007.stdout: "osd_xinfo": [ 2023-09-30T17:05:15.163 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:05:15.163 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 0, 2023-09-30T17:05:15.163 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-09-30T17:05:15.163 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-09-30T17:05:15.163 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-09-30T17:05:15.163 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138322906710015, 2023-09-30T17:05:15.163 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 0, 2023-09-30T17:05:15.163 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-09-30T17:02:01.702754+0000", 2023-09-30T17:05:15.163 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-09-30T17:05:15.163 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:05:15.163 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:05:15.164 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 1, 2023-09-30T17:05:15.164 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-09-30T17:05:15.164 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-09-30T17:05:15.164 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-09-30T17:05:15.164 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138322906710015, 2023-09-30T17:05:15.164 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 0, 2023-09-30T17:05:15.164 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-09-30T17:02:01.688791+0000", 2023-09-30T17:05:15.164 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 0 2023-09-30T17:05:15.164 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:05:15.165 INFO:teuthology.orchestra.run.smithi007.stdout: { 2023-09-30T17:05:15.165 INFO:teuthology.orchestra.run.smithi007.stdout: "osd": 2, 2023-09-30T17:05:15.165 INFO:teuthology.orchestra.run.smithi007.stdout: "down_stamp": "0.000000", 2023-09-30T17:05:15.165 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_probability": 0, 2023-09-30T17:05:15.165 INFO:teuthology.orchestra.run.smithi007.stdout: "laggy_interval": 0, 2023-09-30T17:05:15.165 INFO:teuthology.orchestra.run.smithi007.stdout: "features": 4540138322906710015, 2023-09-30T17:05:15.165 INFO:teuthology.orchestra.run.smithi007.stdout: "old_weight": 0, 2023-09-30T17:05:15.165 INFO:teuthology.orchestra.run.smithi007.stdout: "last_purged_snaps_scrub": "2023-09-30T17:02:01.667971+0000", 2023-09-30T17:05:15.165 INFO:teuthology.orchestra.run.smithi007.stdout: "dead_epoch": 22 2023-09-30T17:05:15.166 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-09-30T17:05:15.166 INFO:teuthology.orchestra.run.smithi007.stdout: ], 2023-09-30T17:05:15.166 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_upmap": [], 2023-09-30T17:05:15.166 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_upmap_items": [], 2023-09-30T17:05:15.166 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_upmap_primaries": [], 2023-09-30T17:05:15.166 INFO:teuthology.orchestra.run.smithi007.stdout: "pg_temp": [], 2023-09-30T17:05:15.166 INFO:teuthology.orchestra.run.smithi007.stdout: "primary_temp": [], 2023-09-30T17:05:15.166 INFO:teuthology.orchestra.run.smithi007.stdout: "blocklist": {}, 2023-09-30T17:05:15.167 INFO:teuthology.orchestra.run.smithi007.stdout: "range_blocklist": {}, 2023-09-30T17:05:15.167 INFO:teuthology.orchestra.run.smithi007.stdout: "erasure_code_profiles": { 2023-09-30T17:05:15.167 INFO:teuthology.orchestra.run.smithi007.stdout: "default": { 2023-09-30T17:05:15.167 INFO:teuthology.orchestra.run.smithi007.stdout: "crush-failure-domain": "osd", 2023-09-30T17:05:15.167 INFO:teuthology.orchestra.run.smithi007.stdout: "k": "2", 2023-09-30T17:05:15.167 INFO:teuthology.orchestra.run.smithi007.stdout: "m": "1", 2023-09-30T17:05:15.167 INFO:teuthology.orchestra.run.smithi007.stdout: "plugin": "jerasure", 2023-09-30T17:05:15.167 INFO:teuthology.orchestra.run.smithi007.stdout: "technique": "reed_sol_van" 2023-09-30T17:05:15.167 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-09-30T17:05:15.168 INFO:teuthology.orchestra.run.smithi007.stdout: }, 2023-09-30T17:05:15.168 INFO:teuthology.orchestra.run.smithi007.stdout: "removed_snaps_queue": [], 2023-09-30T17:05:15.168 INFO:teuthology.orchestra.run.smithi007.stdout: "new_removed_snaps": [], 2023-09-30T17:05:15.168 INFO:teuthology.orchestra.run.smithi007.stdout: "new_purged_snaps": [], 2023-09-30T17:05:15.168 INFO:teuthology.orchestra.run.smithi007.stdout: "crush_node_flags": {}, 2023-09-30T17:05:15.168 INFO:teuthology.orchestra.run.smithi007.stdout: "device_class_flags": {}, 2023-09-30T17:05:15.168 INFO:teuthology.orchestra.run.smithi007.stdout: "stretch_mode": { 2023-09-30T17:05:15.168 INFO:teuthology.orchestra.run.smithi007.stdout: "stretch_mode_enabled": false, 2023-09-30T17:05:15.168 INFO:teuthology.orchestra.run.smithi007.stdout: "stretch_bucket_count": 0, 2023-09-30T17:05:15.168 INFO:teuthology.orchestra.run.smithi007.stdout: "degraded_stretch_mode": 0, 2023-09-30T17:05:15.168 INFO:teuthology.orchestra.run.smithi007.stdout: "recovering_stretch_mode": 0, 2023-09-30T17:05:15.169 INFO:teuthology.orchestra.run.smithi007.stdout: "stretch_mode_bucket": 0 2023-09-30T17:05:15.169 INFO:teuthology.orchestra.run.smithi007.stdout: } 2023-09-30T17:05:15.169 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-09-30T17:05:15.171 INFO:tasks.thrashosds.thrasher:j is {'epoch': 70, 'fsid': '68daccc3-6ea9-4db7-9771-3803ff202df8', 'created': '2023-09-30T17:01:55.306262+0000', 'modified': '2023-09-30T17:05:06.278159+0000', 'last_up_change': '2023-09-30T17:05:02.282813+0000', 'last_in_change': '2023-09-30T17:01:56.571968+0000', 'flags': 'sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5799936, 'flags_set': ['pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 5, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 4, 'max_osd': 3, 'require_min_compat_client': 'luminous', 'min_compat_client': 'jewel', 'require_osd_release': 'reef', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T17:02:05.343048+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 2.990000009536743, 'score_stable': 2.990000009536743, 'optimal_score': 0.6700000166893005, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T17:02:11.033979+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2023-09-30T17:02:15.583451+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2023-09-30T17:02:16.734427+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.1299999952316284, 'score_stable': 1.1299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.1299999952316284, 'raw_score_stable': 1.1299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'a9d1653a-8830-4fad-911b-8e7221ee8697', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 69, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6800', 'nonce': 2212861041}, {'type': 'v1', 'addr': '172.21.15.31:6801', 'nonce': 2212861041}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6802', 'nonce': 2212861041}, {'type': 'v1', 'addr': '172.21.15.31:6803', 'nonce': 2212861041}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6806', 'nonce': 2212861041}, {'type': 'v1', 'addr': '172.21.15.31:6807', 'nonce': 2212861041}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.31:6804', 'nonce': 2212861041}, {'type': 'v1', 'addr': '172.21.15.31:6805', 'nonce': 2212861041}]}, 'public_addr': '172.21.15.31:6801/2212861041', 'cluster_addr': '172.21.15.31:6803/2212861041', 'heartbeat_back_addr': '172.21.15.31:6807/2212861041', 'heartbeat_front_addr': '172.21.15.31:6805/2212861041', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '7123aa56-aa1a-43a4-b154-a40b4c70d169', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 8, 'up_thru': 69, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6800', 'nonce': 1680420094}, {'type': 'v1', 'addr': '172.21.15.72:6801', 'nonce': 1680420094}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6802', 'nonce': 1680420094}, {'type': 'v1', 'addr': '172.21.15.72:6803', 'nonce': 1680420094}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6806', 'nonce': 1680420094}, {'type': 'v1', 'addr': '172.21.15.72:6807', 'nonce': 1680420094}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.72:6804', 'nonce': 1680420094}, {'type': 'v1', 'addr': '172.21.15.72:6805', 'nonce': 1680420094}]}, 'public_addr': '172.21.15.72:6801/1680420094', 'cluster_addr': '172.21.15.72:6803/1680420094', 'heartbeat_back_addr': '172.21.15.72:6807/1680420094', 'heartbeat_front_addr': '172.21.15.72:6805/1680420094', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': 'f40ee0d7-7bc3-4a46-bdac-9c134c55c907', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 8, 'last_clean_end': 22, 'up_from': 66, 'up_thru': 69, 'down_at': 23, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6800', 'nonce': 3322751189}, {'type': 'v1', 'addr': '172.21.15.134:6801', 'nonce': 3322751189}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6802', 'nonce': 3322751189}, {'type': 'v1', 'addr': '172.21.15.134:6803', 'nonce': 3322751189}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6806', 'nonce': 3322751189}, {'type': 'v1', 'addr': '172.21.15.134:6807', 'nonce': 3322751189}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6804', 'nonce': 3322751189}, {'type': 'v1', 'addr': '172.21.15.134:6805', 'nonce': 3322751189}]}, 'public_addr': '172.21.15.134:6801/3322751189', 'cluster_addr': '172.21.15.134:6803/3322751189', 'heartbeat_back_addr': '172.21.15.134:6807/3322751189', 'heartbeat_front_addr': '172.21.15.134:6805/3322751189', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-09-30T17:02:01.702754+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-09-30T17:02:01.688791+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540138322906710015, 'old_weight': 0, 'last_purged_snaps_scrub': '2023-09-30T17:02:01.667971+0000', 'dead_epoch': 22}], 'pg_upmap': [], 'pg_upmap_items': [], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2023-09-30T17:05:15.226 INFO:tasks.thrashosds.thrasher:No pg_upmap entries; doing nothing 2023-09-30T17:05:20.227 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2023-09-30T17:05:20.382 INFO:teuthology.orchestra.run.smithi007.stdout:mon.a: {} 2023-09-30T17:05:20.392 INFO:teuthology.orchestra.run.smithi007.stdout:mon.b: {} 2023-09-30T17:05:20.401 INFO:teuthology.orchestra.run.smithi007.stdout:mon.c: {} 2023-09-30T17:05:20.402 INFO:teuthology.orchestra.run.smithi007.stderr:mon.a: mon_osd_down_out_interval = '600' (not observed, change may require restart) 2023-09-30T17:05:20.402 INFO:teuthology.orchestra.run.smithi007.stderr:mon.b: mon_osd_down_out_interval = '600' (not observed, change may require restart) 2023-09-30T17:05:20.403 INFO:teuthology.orchestra.run.smithi007.stderr:mon.c: mon_osd_down_out_interval = '600' (not observed, change may require restart) 2023-09-30T17:05:20.414 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2023-09-30T17:05:21.287 INFO:teuthology.orchestra.run.smithi007.stderr:reweighted osd.0 to 1 (10000) 2023-09-30T17:05:21.310 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2023-09-30T17:05:22.299 INFO:teuthology.orchestra.run.smithi007.stderr:set osd.0 primary-affinity to 1 (8655362) 2023-09-30T17:05:22.395 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2023-09-30T17:05:23.298 INFO:teuthology.orchestra.run.smithi007.stderr:reweighted osd.1 to 1 (10000) 2023-09-30T17:05:23.312 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2023-09-30T17:05:24.305 INFO:teuthology.orchestra.run.smithi007.stderr:set osd.1 primary-affinity to 1 (8655362) 2023-09-30T17:05:24.329 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2023-09-30T17:05:25.309 INFO:teuthology.orchestra.run.smithi007.stderr:reweighted osd.2 to 1 (10000) 2023-09-30T17:05:25.323 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2023-09-30T17:05:26.312 INFO:teuthology.orchestra.run.smithi007.stderr:set osd.2 primary-affinity to 1 (8655362) 2023-09-30T17:05:26.380 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2023-09-30T17:05:26.380 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2023-09-30T17:05:26.381 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2023-09-30T17:05:26.381 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2023-09-30T17:05:26.381 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-09-30T17:05:26.381 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T17:05:26.731 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:05:26.731 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":76,"fsid":"68daccc3-6ea9-4db7-9771-3803ff202df8","created":"2023-09-30T17:01:55.306262+0000","modified":"2023-09-30T17:05:26.305787+0000","last_up_change":"2023-09-30T17:05:02.282813+0000","last_in_change":"2023-09-30T17:01:56.571968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T17:02:05.343048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T17:02:11.033979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T17:02:15.583451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T17:02:16.734427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9d1653a-8830-4fad-911b-8e7221ee8697","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6801","nonce":2212861041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6803","nonce":2212861041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6807","nonce":2212861041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6805","nonce":2212861041}]},"public_addr":"172.21.15.31:6801/2212861041","cluster_addr":"172.21.15.31:6803/2212861041","heartbeat_back_addr":"172.21.15.31:6807/2212861041","heartbeat_front_addr":"172.21.15.31:6805/2212861041","state":["exists","up"]},{"osd":1,"uuid":"7123aa56-aa1a-43a4-b154-a40b4c70d169","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6801","nonce":1680420094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6803","nonce":1680420094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6807","nonce":1680420094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6805","nonce":1680420094}]},"public_addr":"172.21.15.72:6801/1680420094","cluster_addr":"172.21.15.72:6803/1680420094","heartbeat_back_addr":"172.21.15.72:6807/1680420094","heartbeat_front_addr":"172.21.15.72:6805/1680420094","state":["exists","up"]},{"osd":2,"uuid":"f40ee0d7-7bc3-4a46-bdac-9c134c55c907","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":22,"up_from":66,"up_thru":69,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3322751189},{"type":"v1","addr":"172.21.15.134:6801","nonce":3322751189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3322751189},{"type":"v1","addr":"172.21.15.134:6803","nonce":3322751189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3322751189},{"type":"v1","addr":"172.21.15.134:6807","nonce":3322751189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3322751189},{"type":"v1","addr":"172.21.15.134:6805","nonce":3322751189}]},"public_addr":"172.21.15.134:6801/3322751189","cluster_addr":"172.21.15.134:6803/3322751189","heartbeat_back_addr":"172.21.15.134:6807/3322751189","heartbeat_front_addr":"172.21.15.134:6805/3322751189","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T17:02:01.702754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T17:02:01.688791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T17:02:01.667971+0000","dead_epoch":22}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T17:05:26.754 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-09-30T17:05:26.754 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T17:05:27.093 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:05:27.093 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":76,"fsid":"68daccc3-6ea9-4db7-9771-3803ff202df8","created":"2023-09-30T17:01:55.306262+0000","modified":"2023-09-30T17:05:26.305787+0000","last_up_change":"2023-09-30T17:05:02.282813+0000","last_in_change":"2023-09-30T17:01:56.571968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T17:02:05.343048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T17:02:11.033979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T17:02:15.583451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T17:02:16.734427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9d1653a-8830-4fad-911b-8e7221ee8697","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6801","nonce":2212861041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6803","nonce":2212861041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6807","nonce":2212861041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6805","nonce":2212861041}]},"public_addr":"172.21.15.31:6801/2212861041","cluster_addr":"172.21.15.31:6803/2212861041","heartbeat_back_addr":"172.21.15.31:6807/2212861041","heartbeat_front_addr":"172.21.15.31:6805/2212861041","state":["exists","up"]},{"osd":1,"uuid":"7123aa56-aa1a-43a4-b154-a40b4c70d169","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6801","nonce":1680420094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6803","nonce":1680420094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6807","nonce":1680420094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6805","nonce":1680420094}]},"public_addr":"172.21.15.72:6801/1680420094","cluster_addr":"172.21.15.72:6803/1680420094","heartbeat_back_addr":"172.21.15.72:6807/1680420094","heartbeat_front_addr":"172.21.15.72:6805/1680420094","state":["exists","up"]},{"osd":2,"uuid":"f40ee0d7-7bc3-4a46-bdac-9c134c55c907","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":22,"up_from":66,"up_thru":69,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3322751189},{"type":"v1","addr":"172.21.15.134:6801","nonce":3322751189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3322751189},{"type":"v1","addr":"172.21.15.134:6803","nonce":3322751189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3322751189},{"type":"v1","addr":"172.21.15.134:6807","nonce":3322751189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3322751189},{"type":"v1","addr":"172.21.15.134:6805","nonce":3322751189}]},"public_addr":"172.21.15.134:6801/3322751189","cluster_addr":"172.21.15.134:6803/3322751189","heartbeat_back_addr":"172.21.15.134:6807/3322751189","heartbeat_front_addr":"172.21.15.134:6805/3322751189","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T17:02:01.702754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T17:02:01.688791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T17:02:01.667971+0000","dead_epoch":22}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T17:05:27.108 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-09-30T17:05:27.109 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-09-30T17:05:27.109 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-09-30T17:05:27.290 INFO:teuthology.orchestra.run.smithi007.stdout:34359738412 2023-09-30T17:05:27.290 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T17:05:27.294 INFO:teuthology.orchestra.run.smithi007.stdout:283467841543 2023-09-30T17:05:27.295 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T17:05:27.301 INFO:teuthology.orchestra.run.smithi007.stdout:34359738412 2023-09-30T17:05:27.302 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T17:05:27.661 INFO:teuthology.orchestra.run.smithi007.stdout:34359738411 2023-09-30T17:05:27.996 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738412 got 34359738411 for osd.0 2023-09-30T17:05:27.997 INFO:teuthology.orchestra.run.smithi007.stdout:34359738411 2023-09-30T17:05:27.997 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738412 got 34359738411 for osd.1 2023-09-30T17:05:27.998 INFO:teuthology.orchestra.run.smithi007.stdout:283467841541 2023-09-30T17:05:27.998 INFO:tasks.ceph.ceph_manager.ceph:need seq 283467841543 got 283467841541 for osd.2 2023-09-30T17:05:28.997 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T17:05:29.002 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T17:05:29.003 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T17:05:29.364 INFO:teuthology.orchestra.run.smithi007.stdout:34359738412 2023-09-30T17:05:29.632 INFO:teuthology.orchestra.run.smithi007.stdout:283467841543 2023-09-30T17:05:29.633 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738412 got 34359738412 for osd.1 2023-09-30T17:05:29.633 INFO:teuthology.orchestra.run.smithi007.stdout:34359738412 2023-09-30T17:05:29.634 DEBUG:teuthology.parallel:result is None 2023-09-30T17:05:29.634 INFO:tasks.ceph.ceph_manager.ceph:need seq 283467841543 got 283467841543 for osd.2 2023-09-30T17:05:29.635 DEBUG:teuthology.parallel:result is None 2023-09-30T17:05:29.635 INFO:tasks.ceph.ceph_manager.ceph:need seq 34359738412 got 34359738412 for osd.0 2023-09-30T17:05:29.635 DEBUG:teuthology.parallel:result is None 2023-09-30T17:05:29.635 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2023-09-30T17:05:29.636 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T17:05:29.978 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:05:29.979 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-09-30T17:05:29.989 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":176,"stamp":"2023-09-30T17:05:29.339287+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":819295,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":140,"num_read_kb":122,"num_write":533025,"num_write_kb":2579054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":223425,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141229,"ondisk_log_size":141229,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1193096,"kb_used_data":3544,"kb_used_omap":10,"kb_used_meta":1189493,"kb_avail":281922424,"statfs":{"total":289910292480,"available":288688562176,"internally_reserved":0,"allocated":3629056,"data_stored":2552660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10327,"internal_metadata":1218041769},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001043"},"pg_stats":[{"pgid":"4.3f","version":"59'2790","reported_seq":2859,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.307056+0000","last_change":"2023-09-30T17:02:18.360288+0000","last_active":"2023-09-30T17:05:25.307056+0000","last_peered":"2023-09-30T17:05:25.307056+0000","last_clean":"2023-09-30T17:05:25.307056+0000","last_became_active":"2023-09-30T17:02:18.358716+0000","last_became_peered":"2023-09-30T17:02:18.358716+0000","last_unstale":"2023-09-30T17:05:25.307056+0000","last_undegraded":"2023-09-30T17:05:25.307056+0000","last_fullsized":"2023-09-30T17:05:25.307056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2790,"log_dups_size":0,"ondisk_log_size":2790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:12:06.380095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8214,"num_write_kb":38924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"59'4","reported_seq":73,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306636+0000","last_change":"2023-09-30T17:02:18.362418+0000","last_active":"2023-09-30T17:05:25.306636+0000","last_peered":"2023-09-30T17:05:25.306636+0000","last_clean":"2023-09-30T17:05:25.306636+0000","last_became_active":"2023-09-30T17:02:18.360372+0000","last_became_peered":"2023-09-30T17:02:18.360372+0000","last_unstale":"2023-09-30T17:05:25.306636+0000","last_undegraded":"2023-09-30T17:05:25.306636+0000","last_fullsized":"2023-09-30T17:05:25.306636+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:43:29.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"59'5697","reported_seq":5771,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306021+0000","last_change":"2023-09-30T17:05:06.291597+0000","last_active":"2023-09-30T17:05:25.306021+0000","last_peered":"2023-09-30T17:05:25.306021+0000","last_clean":"2023-09-30T17:05:25.306021+0000","last_became_active":"2023-09-30T17:05:06.290447+0000","last_became_peered":"2023-09-30T17:05:06.290447+0000","last_unstale":"2023-09-30T17:05:25.306021+0000","last_undegraded":"2023-09-30T17:05:25.306021+0000","last_fullsized":"2023-09-30T17:05:25.306021+0000","mapping_epoch":69,"log_start":"42'1200","ondisk_log_start":"42'1200","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4497,"log_dups_size":1200,"ondisk_log_size":4497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:02:21.064107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16590,"num_write_kb":78960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"59'10","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305409+0000","last_change":"2023-09-30T17:05:03.309996+0000","last_active":"2023-09-30T17:05:25.305409+0000","last_peered":"2023-09-30T17:05:25.305409+0000","last_clean":"2023-09-30T17:05:25.305409+0000","last_became_active":"2023-09-30T17:05:03.309326+0000","last_became_peered":"2023-09-30T17:05:03.309326+0000","last_unstale":"2023-09-30T17:05:25.305409+0000","last_undegraded":"2023-09-30T17:05:25.305409+0000","last_fullsized":"2023-09-30T17:05:25.305409+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:31:23.164242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"59'2934","reported_seq":3003,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306421+0000","last_change":"2023-09-30T17:02:18.360192+0000","last_active":"2023-09-30T17:05:25.306421+0000","last_peered":"2023-09-30T17:05:25.306421+0000","last_clean":"2023-09-30T17:05:25.306421+0000","last_became_active":"2023-09-30T17:02:18.357317+0000","last_became_peered":"2023-09-30T17:02:18.357317+0000","last_unstale":"2023-09-30T17:05:25.306421+0000","last_undegraded":"2023-09-30T17:05:25.306421+0000","last_fullsized":"2023-09-30T17:05:25.306421+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2934,"log_dups_size":0,"ondisk_log_size":2934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:37:14.790993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8466,"num_write_kb":40084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"59'6","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305283+0000","last_change":"2023-09-30T17:05:03.311318+0000","last_active":"2023-09-30T17:05:25.305283+0000","last_peered":"2023-09-30T17:05:25.305283+0000","last_clean":"2023-09-30T17:05:25.305283+0000","last_became_active":"2023-09-30T17:05:03.310703+0000","last_became_peered":"2023-09-30T17:05:03.310703+0000","last_unstale":"2023-09-30T17:05:25.305283+0000","last_undegraded":"2023-09-30T17:05:25.305283+0000","last_fullsized":"2023-09-30T17:05:25.305283+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:08:45.345559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"59'7","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305160+0000","last_change":"2023-09-30T17:05:03.310838+0000","last_active":"2023-09-30T17:05:25.305160+0000","last_peered":"2023-09-30T17:05:25.305160+0000","last_clean":"2023-09-30T17:05:25.305160+0000","last_became_active":"2023-09-30T17:05:03.310047+0000","last_became_peered":"2023-09-30T17:05:03.310047+0000","last_unstale":"2023-09-30T17:05:25.305160+0000","last_undegraded":"2023-09-30T17:05:25.305160+0000","last_fullsized":"2023-09-30T17:05:25.305160+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:29:17.418059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"59'11423","reported_seq":11499,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.304794+0000","last_change":"2023-09-30T17:05:06.286653+0000","last_active":"2023-09-30T17:05:25.304794+0000","last_peered":"2023-09-30T17:05:25.304794+0000","last_clean":"2023-09-30T17:05:25.304794+0000","last_became_active":"2023-09-30T17:05:06.285582+0000","last_became_peered":"2023-09-30T17:05:06.285582+0000","last_unstale":"2023-09-30T17:05:25.304794+0000","last_undegraded":"2023-09-30T17:05:25.304794+0000","last_fullsized":"2023-09-30T17:05:25.304794+0000","mapping_epoch":69,"log_start":"52'7200","ondisk_log_start":"52'7200","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4223,"log_dups_size":5777,"ondisk_log_size":4223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:35:18.578031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33444,"num_write_kb":158924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"59'8589","reported_seq":8658,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306041+0000","last_change":"2023-09-30T17:02:18.364222+0000","last_active":"2023-09-30T17:05:25.306041+0000","last_peered":"2023-09-30T17:05:25.306041+0000","last_clean":"2023-09-30T17:05:25.306041+0000","last_became_active":"2023-09-30T17:02:18.363485+0000","last_became_peered":"2023-09-30T17:02:18.363485+0000","last_unstale":"2023-09-30T17:05:25.306041+0000","last_undegraded":"2023-09-30T17:05:25.306041+0000","last_fullsized":"2023-09-30T17:05:25.306041+0000","mapping_epoch":17,"log_start":"49'4400","ondisk_log_start":"49'4400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4189,"log_dups_size":4400,"ondisk_log_size":4189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:14:35.192615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25052,"num_write_kb":118756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"59'8585","reported_seq":8654,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306806+0000","last_change":"2023-09-30T17:02:18.360010+0000","last_active":"2023-09-30T17:05:25.306806+0000","last_peered":"2023-09-30T17:05:25.306806+0000","last_clean":"2023-09-30T17:05:25.306806+0000","last_became_active":"2023-09-30T17:02:18.358396+0000","last_became_peered":"2023-09-30T17:02:18.358396+0000","last_unstale":"2023-09-30T17:05:25.306806+0000","last_undegraded":"2023-09-30T17:05:25.306806+0000","last_fullsized":"2023-09-30T17:05:25.306806+0000","mapping_epoch":17,"log_start":"48'4100","ondisk_log_start":"48'4100","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4485,"log_dups_size":4100,"ondisk_log_size":4485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:26:11.522402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24997,"num_write_kb":162463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"59'5664","reported_seq":5740,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305719+0000","last_change":"2023-09-30T17:05:06.291535+0000","last_active":"2023-09-30T17:05:25.305719+0000","last_peered":"2023-09-30T17:05:25.305719+0000","last_clean":"2023-09-30T17:05:25.305719+0000","last_became_active":"2023-09-30T17:05:06.290193+0000","last_became_peered":"2023-09-30T17:05:06.290193+0000","last_unstale":"2023-09-30T17:05:25.305719+0000","last_undegraded":"2023-09-30T17:05:25.305719+0000","last_fullsized":"2023-09-30T17:05:25.305719+0000","mapping_epoch":69,"log_start":"43'1400","ondisk_log_start":"43'1400","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4264,"log_dups_size":1400,"ondisk_log_size":4264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:21:15.508580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16442,"num_write_kb":78308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"59'2931","reported_seq":3020,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306235+0000","last_change":"2023-09-30T17:05:06.290270+0000","last_active":"2023-09-30T17:05:25.306235+0000","last_peered":"2023-09-30T17:05:25.306235+0000","last_clean":"2023-09-30T17:05:25.306235+0000","last_became_active":"2023-09-30T17:05:06.288753+0000","last_became_peered":"2023-09-30T17:05:06.288753+0000","last_unstale":"2023-09-30T17:05:25.306235+0000","last_undegraded":"2023-09-30T17:05:25.306235+0000","last_fullsized":"2023-09-30T17:05:25.306235+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2931,"log_dups_size":0,"ondisk_log_size":2931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:38:30.988146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8488,"num_write_kb":40364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"59'2860","reported_seq":2929,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306164+0000","last_change":"2023-09-30T17:02:18.359894+0000","last_active":"2023-09-30T17:05:25.306164+0000","last_peered":"2023-09-30T17:05:25.306164+0000","last_clean":"2023-09-30T17:05:25.306164+0000","last_became_active":"2023-09-30T17:02:18.358534+0000","last_became_peered":"2023-09-30T17:02:18.358534+0000","last_unstale":"2023-09-30T17:05:25.306164+0000","last_undegraded":"2023-09-30T17:05:25.306164+0000","last_fullsized":"2023-09-30T17:05:25.306164+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2860,"log_dups_size":0,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:22:13.025181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8367,"num_write_kb":39772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"59'2911","reported_seq":2978,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305184+0000","last_change":"2023-09-30T17:05:06.289465+0000","last_active":"2023-09-30T17:05:25.305184+0000","last_peered":"2023-09-30T17:05:25.305184+0000","last_clean":"2023-09-30T17:05:25.305184+0000","last_became_active":"2023-09-30T17:05:06.288360+0000","last_became_peered":"2023-09-30T17:05:06.288360+0000","last_unstale":"2023-09-30T17:05:25.305184+0000","last_undegraded":"2023-09-30T17:05:25.305184+0000","last_fullsized":"2023-09-30T17:05:25.305184+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2911,"log_dups_size":0,"ondisk_log_size":2911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:53:55.381223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8419,"num_write_kb":39940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"59'2889","reported_seq":2956,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305078+0000","last_change":"2023-09-30T17:05:06.286551+0000","last_active":"2023-09-30T17:05:25.305078+0000","last_peered":"2023-09-30T17:05:25.305078+0000","last_clean":"2023-09-30T17:05:25.305078+0000","last_became_active":"2023-09-30T17:05:06.285738+0000","last_became_peered":"2023-09-30T17:05:06.285738+0000","last_unstale":"2023-09-30T17:05:25.305078+0000","last_undegraded":"2023-09-30T17:05:25.305078+0000","last_fullsized":"2023-09-30T17:05:25.305078+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2889,"log_dups_size":0,"ondisk_log_size":2889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:18:17.841837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8435,"num_write_kb":39984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"59'2839","reported_seq":2906,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.304983+0000","last_change":"2023-09-30T17:05:06.291173+0000","last_active":"2023-09-30T17:05:25.304983+0000","last_peered":"2023-09-30T17:05:25.304983+0000","last_clean":"2023-09-30T17:05:25.304983+0000","last_became_active":"2023-09-30T17:05:06.289872+0000","last_became_peered":"2023-09-30T17:05:06.289872+0000","last_unstale":"2023-09-30T17:05:25.304983+0000","last_undegraded":"2023-09-30T17:05:25.304983+0000","last_fullsized":"2023-09-30T17:05:25.304983+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2839,"log_dups_size":0,"ondisk_log_size":2839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:57:27.685208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8166,"num_write_kb":38928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"59'2802","reported_seq":2871,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306044+0000","last_change":"2023-09-30T17:02:18.364360+0000","last_active":"2023-09-30T17:05:25.306044+0000","last_peered":"2023-09-30T17:05:25.306044+0000","last_clean":"2023-09-30T17:05:25.306044+0000","last_became_active":"2023-09-30T17:02:18.363697+0000","last_became_peered":"2023-09-30T17:02:18.363697+0000","last_unstale":"2023-09-30T17:05:25.306044+0000","last_undegraded":"2023-09-30T17:05:25.306044+0000","last_fullsized":"2023-09-30T17:05:25.306044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2802,"log_dups_size":0,"ondisk_log_size":2802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:50:52.893768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8256,"num_write_kb":39208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"59'2860","reported_seq":2929,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306937+0000","last_change":"2023-09-30T17:02:18.360320+0000","last_active":"2023-09-30T17:05:25.306937+0000","last_peered":"2023-09-30T17:05:25.306937+0000","last_clean":"2023-09-30T17:05:25.306937+0000","last_became_active":"2023-09-30T17:02:18.357184+0000","last_became_peered":"2023-09-30T17:02:18.357184+0000","last_unstale":"2023-09-30T17:05:25.306937+0000","last_undegraded":"2023-09-30T17:05:25.306937+0000","last_fullsized":"2023-09-30T17:05:25.306937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2860,"log_dups_size":0,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:21:45.195007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8368,"num_write_kb":39616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"59'5686","reported_seq":5755,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305812+0000","last_change":"2023-09-30T17:02:18.363956+0000","last_active":"2023-09-30T17:05:25.305812+0000","last_peered":"2023-09-30T17:05:25.305812+0000","last_clean":"2023-09-30T17:05:25.305812+0000","last_became_active":"2023-09-30T17:02:18.363654+0000","last_became_peered":"2023-09-30T17:02:18.363654+0000","last_unstale":"2023-09-30T17:05:25.305812+0000","last_undegraded":"2023-09-30T17:05:25.305812+0000","last_fullsized":"2023-09-30T17:05:25.305812+0000","mapping_epoch":17,"log_start":"44'1500","ondisk_log_start":"44'1500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4186,"log_dups_size":1500,"ondisk_log_size":4186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:48:17.598726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16649,"num_write_kb":78956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"59'5799","reported_seq":5876,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305562+0000","last_change":"2023-09-30T17:05:06.290994+0000","last_active":"2023-09-30T17:05:25.305562+0000","last_peered":"2023-09-30T17:05:25.305562+0000","last_clean":"2023-09-30T17:05:25.305562+0000","last_became_active":"2023-09-30T17:05:06.289817+0000","last_became_peered":"2023-09-30T17:05:06.289817+0000","last_unstale":"2023-09-30T17:05:25.305562+0000","last_undegraded":"2023-09-30T17:05:25.305562+0000","last_fullsized":"2023-09-30T17:05:25.305562+0000","mapping_epoch":69,"log_start":"44'1600","ondisk_log_start":"44'1600","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4199,"log_dups_size":1600,"ondisk_log_size":4199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:50:21.333588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16903,"num_write_kb":80184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"59'12","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305497+0000","last_change":"2023-09-30T17:05:03.310298+0000","last_active":"2023-09-30T17:05:25.305497+0000","last_peered":"2023-09-30T17:05:25.305497+0000","last_clean":"2023-09-30T17:05:25.305497+0000","last_became_active":"2023-09-30T17:05:03.309537+0000","last_became_peered":"2023-09-30T17:05:03.309537+0000","last_unstale":"2023-09-30T17:05:25.305497+0000","last_undegraded":"2023-09-30T17:05:25.305497+0000","last_fullsized":"2023-09-30T17:05:25.305497+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:45:25.545287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"59'2879","reported_seq":2968,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306043+0000","last_change":"2023-09-30T17:05:06.292705+0000","last_active":"2023-09-30T17:05:25.306043+0000","last_peered":"2023-09-30T17:05:25.306043+0000","last_clean":"2023-09-30T17:05:25.306043+0000","last_became_active":"2023-09-30T17:05:06.290797+0000","last_became_peered":"2023-09-30T17:05:06.290797+0000","last_unstale":"2023-09-30T17:05:25.306043+0000","last_undegraded":"2023-09-30T17:05:25.306043+0000","last_fullsized":"2023-09-30T17:05:25.306043+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2879,"log_dups_size":0,"ondisk_log_size":2879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:55:01.976617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8343,"num_write_kb":39768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"59'2809","reported_seq":2898,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305406+0000","last_change":"2023-09-30T17:05:06.290594+0000","last_active":"2023-09-30T17:05:25.305406+0000","last_peered":"2023-09-30T17:05:25.305406+0000","last_clean":"2023-09-30T17:05:25.305406+0000","last_became_active":"2023-09-30T17:05:06.288837+0000","last_became_peered":"2023-09-30T17:05:06.288837+0000","last_unstale":"2023-09-30T17:05:25.305406+0000","last_undegraded":"2023-09-30T17:05:25.305406+0000","last_fullsized":"2023-09-30T17:05:25.305406+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2809,"log_dups_size":0,"ondisk_log_size":2809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:00:48.822153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8281,"num_write_kb":39472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"59'5585","reported_seq":5654,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306010+0000","last_change":"2023-09-30T17:02:18.353938+0000","last_active":"2023-09-30T17:05:25.306010+0000","last_peered":"2023-09-30T17:05:25.306010+0000","last_clean":"2023-09-30T17:05:25.306010+0000","last_became_active":"2023-09-30T17:02:18.353632+0000","last_became_peered":"2023-09-30T17:02:18.353632+0000","last_unstale":"2023-09-30T17:05:25.306010+0000","last_undegraded":"2023-09-30T17:05:25.306010+0000","last_fullsized":"2023-09-30T17:05:25.306010+0000","mapping_epoch":17,"log_start":"42'1100","ondisk_log_start":"42'1100","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4485,"log_dups_size":1100,"ondisk_log_size":4485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:09:55.056098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16523,"num_write_kb":78256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"59'2888","reported_seq":2977,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.307020+0000","last_change":"2023-09-30T17:05:06.292945+0000","last_active":"2023-09-30T17:05:25.307020+0000","last_peered":"2023-09-30T17:05:25.307020+0000","last_clean":"2023-09-30T17:05:25.307020+0000","last_became_active":"2023-09-30T17:05:06.291346+0000","last_became_peered":"2023-09-30T17:05:06.291346+0000","last_unstale":"2023-09-30T17:05:25.307020+0000","last_undegraded":"2023-09-30T17:05:25.307020+0000","last_fullsized":"2023-09-30T17:05:25.307020+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2888,"log_dups_size":0,"ondisk_log_size":2888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:53:27.316963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8371,"num_write_kb":39716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"59'18","reported_seq":98,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306046+0000","last_change":"2023-09-30T17:05:03.309295+0000","last_active":"2023-09-30T17:05:25.306046+0000","last_peered":"2023-09-30T17:05:25.306046+0000","last_clean":"2023-09-30T17:05:25.306046+0000","last_became_active":"2023-09-30T17:05:03.308884+0000","last_became_peered":"2023-09-30T17:05:03.308884+0000","last_unstale":"2023-09-30T17:05:25.306046+0000","last_undegraded":"2023-09-30T17:05:25.306046+0000","last_fullsized":"2023-09-30T17:05:25.306046+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:57:45.449671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"59'2855","reported_seq":2923,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305902+0000","last_change":"2023-09-30T17:05:06.291369+0000","last_active":"2023-09-30T17:05:25.305902+0000","last_peered":"2023-09-30T17:05:25.305902+0000","last_clean":"2023-09-30T17:05:25.305902+0000","last_became_active":"2023-09-30T17:05:06.289447+0000","last_became_peered":"2023-09-30T17:05:06.289447+0000","last_unstale":"2023-09-30T17:05:25.305902+0000","last_undegraded":"2023-09-30T17:05:25.305902+0000","last_fullsized":"2023-09-30T17:05:25.305902+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2855,"log_dups_size":0,"ondisk_log_size":2855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:17:21.412392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8347,"num_write_kb":39608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":71,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306032+0000","last_change":"2023-09-30T17:02:17.358258+0000","last_active":"2023-09-30T17:05:25.306032+0000","last_peered":"2023-09-30T17:05:25.306032+0000","last_clean":"2023-09-30T17:05:25.306032+0000","last_became_active":"2023-09-30T17:02:17.357890+0000","last_became_peered":"2023-09-30T17:02:17.357890+0000","last_unstale":"2023-09-30T17:05:25.306032+0000","last_undegraded":"2023-09-30T17:05:25.306032+0000","last_fullsized":"2023-09-30T17:05:25.306032+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:52:56.591906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"59'17","reported_seq":97,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.307002+0000","last_change":"2023-09-30T17:05:03.307486+0000","last_active":"2023-09-30T17:05:25.307002+0000","last_peered":"2023-09-30T17:05:25.307002+0000","last_clean":"2023-09-30T17:05:25.307002+0000","last_became_active":"2023-09-30T17:05:03.307012+0000","last_became_peered":"2023-09-30T17:05:03.307012+0000","last_unstale":"2023-09-30T17:05:25.307002+0000","last_undegraded":"2023-09-30T17:05:25.307002+0000","last_fullsized":"2023-09-30T17:05:25.307002+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:05:29.995730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305433+0000","last_change":"2023-09-30T17:05:03.309164+0000","last_active":"2023-09-30T17:05:25.305433+0000","last_peered":"2023-09-30T17:05:25.305433+0000","last_clean":"2023-09-30T17:05:25.305433+0000","last_became_active":"2023-09-30T17:05:03.308073+0000","last_became_peered":"2023-09-30T17:05:03.308073+0000","last_unstale":"2023-09-30T17:05:25.305433+0000","last_undegraded":"2023-09-30T17:05:25.305433+0000","last_fullsized":"2023-09-30T17:05:25.305433+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:10:16.238053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"59'6","reported_seq":86,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306073+0000","last_change":"2023-09-30T17:05:03.308692+0000","last_active":"2023-09-30T17:05:25.306073+0000","last_peered":"2023-09-30T17:05:25.306073+0000","last_clean":"2023-09-30T17:05:25.306073+0000","last_became_active":"2023-09-30T17:05:03.307932+0000","last_became_peered":"2023-09-30T17:05:03.307932+0000","last_unstale":"2023-09-30T17:05:25.306073+0000","last_undegraded":"2023-09-30T17:05:25.306073+0000","last_fullsized":"2023-09-30T17:05:25.306073+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:17:13.668052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":70,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305661+0000","last_change":"2023-09-30T17:02:17.361000+0000","last_active":"2023-09-30T17:05:25.305661+0000","last_peered":"2023-09-30T17:05:25.305661+0000","last_clean":"2023-09-30T17:05:25.305661+0000","last_became_active":"2023-09-30T17:02:17.360601+0000","last_became_peered":"2023-09-30T17:02:17.360601+0000","last_unstale":"2023-09-30T17:05:25.305661+0000","last_undegraded":"2023-09-30T17:05:25.305661+0000","last_fullsized":"2023-09-30T17:05:25.305661+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:02:27.666526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"59'7","reported_seq":87,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306929+0000","last_change":"2023-09-30T17:05:03.305898+0000","last_active":"2023-09-30T17:05:25.306929+0000","last_peered":"2023-09-30T17:05:25.306929+0000","last_clean":"2023-09-30T17:05:25.306929+0000","last_became_active":"2023-09-30T17:05:03.305520+0000","last_became_peered":"2023-09-30T17:05:03.305520+0000","last_unstale":"2023-09-30T17:05:25.306929+0000","last_undegraded":"2023-09-30T17:05:25.306929+0000","last_fullsized":"2023-09-30T17:05:25.306929+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:40:09.276369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"58'1","reported_seq":82,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306258+0000","last_change":"2023-09-30T17:05:03.309303+0000","last_active":"2023-09-30T17:05:25.306258+0000","last_peered":"2023-09-30T17:05:25.306258+0000","last_clean":"2023-09-30T17:05:25.306258+0000","last_became_active":"2023-09-30T17:05:03.308851+0000","last_became_peered":"2023-09-30T17:05:03.308851+0000","last_unstale":"2023-09-30T17:05:25.306258+0000","last_undegraded":"2023-09-30T17:05:25.306258+0000","last_fullsized":"2023-09-30T17:05:25.306258+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:32:55.497287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"59'9","reported_seq":78,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305188+0000","last_change":"2023-09-30T17:02:18.358841+0000","last_active":"2023-09-30T17:05:25.305188+0000","last_peered":"2023-09-30T17:05:25.305188+0000","last_clean":"2023-09-30T17:05:25.305188+0000","last_became_active":"2023-09-30T17:02:18.358529+0000","last_became_peered":"2023-09-30T17:02:18.358529+0000","last_unstale":"2023-09-30T17:05:25.305188+0000","last_undegraded":"2023-09-30T17:05:25.305188+0000","last_fullsized":"2023-09-30T17:05:25.305188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:15:54.364571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305635+0000","last_change":"2023-09-30T17:05:03.309409+0000","last_active":"2023-09-30T17:05:25.305635+0000","last_peered":"2023-09-30T17:05:25.305635+0000","last_clean":"2023-09-30T17:05:25.305635+0000","last_became_active":"2023-09-30T17:05:03.309023+0000","last_became_peered":"2023-09-30T17:05:03.309023+0000","last_unstale":"2023-09-30T17:05:25.305635+0000","last_undegraded":"2023-09-30T17:05:25.305635+0000","last_fullsized":"2023-09-30T17:05:25.305635+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:57:05.463330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"59'8526","reported_seq":8618,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305529+0000","last_change":"2023-09-30T17:05:06.292415+0000","last_active":"2023-09-30T17:05:25.305529+0000","last_peered":"2023-09-30T17:05:25.305529+0000","last_clean":"2023-09-30T17:05:25.305529+0000","last_became_active":"2023-09-30T17:05:06.290551+0000","last_became_peered":"2023-09-30T17:05:06.290551+0000","last_unstale":"2023-09-30T17:05:25.305529+0000","last_undegraded":"2023-09-30T17:05:25.305529+0000","last_fullsized":"2023-09-30T17:05:25.305529+0000","mapping_epoch":69,"log_start":"49'4300","ondisk_log_start":"49'4300","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4226,"log_dups_size":4300,"ondisk_log_size":4226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:59:52.758548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24873,"num_write_kb":118472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"59'7","reported_seq":93,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306635+0000","last_change":"2023-09-30T17:05:03.310987+0000","last_active":"2023-09-30T17:05:25.306635+0000","last_peered":"2023-09-30T17:05:25.306635+0000","last_clean":"2023-09-30T17:05:25.306635+0000","last_became_active":"2023-09-30T17:05:03.306646+0000","last_became_peered":"2023-09-30T17:05:03.306646+0000","last_unstale":"2023-09-30T17:05:25.306635+0000","last_undegraded":"2023-09-30T17:05:25.306635+0000","last_fullsized":"2023-09-30T17:05:25.306635+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:24:52.247523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"59'5670","reported_seq":5739,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305419+0000","last_change":"2023-09-30T17:02:18.359118+0000","last_active":"2023-09-30T17:05:25.305419+0000","last_peered":"2023-09-30T17:05:25.305419+0000","last_clean":"2023-09-30T17:05:25.305419+0000","last_became_active":"2023-09-30T17:02:18.358786+0000","last_became_peered":"2023-09-30T17:02:18.358786+0000","last_unstale":"2023-09-30T17:05:25.305419+0000","last_undegraded":"2023-09-30T17:05:25.305419+0000","last_fullsized":"2023-09-30T17:05:25.305419+0000","mapping_epoch":17,"log_start":"44'1500","ondisk_log_start":"44'1500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4170,"log_dups_size":1500,"ondisk_log_size":4170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:33:21.723864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16627,"num_write_kb":79047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"60'78","reported_seq":49,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305537+0000","last_change":"2023-09-30T17:05:03.313916+0000","last_active":"2023-09-30T17:05:25.305537+0000","last_peered":"2023-09-30T17:05:25.305537+0000","last_clean":"2023-09-30T17:05:25.305537+0000","last_became_active":"2023-09-30T17:05:03.302516+0000","last_became_peered":"2023-09-30T17:05:03.302516+0000","last_unstale":"2023-09-30T17:05:25.305537+0000","last_undegraded":"2023-09-30T17:05:25.305537+0000","last_fullsized":"2023-09-30T17:05:25.305537+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:00:50.535715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227523,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":222729,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"59'5677","reported_seq":5756,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305603+0000","last_change":"2023-09-30T17:05:06.289965+0000","last_active":"2023-09-30T17:05:25.305603+0000","last_peered":"2023-09-30T17:05:25.305603+0000","last_clean":"2023-09-30T17:05:25.305603+0000","last_became_active":"2023-09-30T17:05:06.288155+0000","last_became_peered":"2023-09-30T17:05:06.288155+0000","last_unstale":"2023-09-30T17:05:25.305603+0000","last_undegraded":"2023-09-30T17:05:25.305603+0000","last_fullsized":"2023-09-30T17:05:25.305603+0000","mapping_epoch":69,"log_start":"42'1100","ondisk_log_start":"42'1100","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4577,"log_dups_size":1100,"ondisk_log_size":4577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:26:23.188915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16579,"num_write_kb":79104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305299+0000","last_change":"2023-09-30T17:05:03.310322+0000","last_active":"2023-09-30T17:05:25.305299+0000","last_peered":"2023-09-30T17:05:25.305299+0000","last_clean":"2023-09-30T17:05:25.305299+0000","last_became_active":"2023-09-30T17:05:03.309505+0000","last_became_peered":"2023-09-30T17:05:03.309505+0000","last_unstale":"2023-09-30T17:05:25.305299+0000","last_undegraded":"2023-09-30T17:05:25.305299+0000","last_fullsized":"2023-09-30T17:05:25.305299+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:13:16.014703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"59'2836","reported_seq":2905,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306395+0000","last_change":"2023-09-30T17:02:18.360019+0000","last_active":"2023-09-30T17:05:25.306395+0000","last_peered":"2023-09-30T17:05:25.306395+0000","last_clean":"2023-09-30T17:05:25.306395+0000","last_became_active":"2023-09-30T17:02:18.358364+0000","last_became_peered":"2023-09-30T17:02:18.358364+0000","last_unstale":"2023-09-30T17:05:25.306395+0000","last_undegraded":"2023-09-30T17:05:25.306395+0000","last_fullsized":"2023-09-30T17:05:25.306395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2836,"log_dups_size":0,"ondisk_log_size":2836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:30:43.782165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8308,"num_write_kb":39456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305535+0000","last_change":"2023-09-30T17:05:03.308853+0000","last_active":"2023-09-30T17:05:25.305535+0000","last_peered":"2023-09-30T17:05:25.305535+0000","last_clean":"2023-09-30T17:05:25.305535+0000","last_became_active":"2023-09-30T17:05:03.308377+0000","last_became_peered":"2023-09-30T17:05:03.308377+0000","last_unstale":"2023-09-30T17:05:25.305535+0000","last_undegraded":"2023-09-30T17:05:25.305535+0000","last_fullsized":"2023-09-30T17:05:25.305535+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:18:42.448826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"59'2856","reported_seq":2925,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306869+0000","last_change":"2023-09-30T17:02:18.362415+0000","last_active":"2023-09-30T17:05:25.306869+0000","last_peered":"2023-09-30T17:05:25.306869+0000","last_clean":"2023-09-30T17:05:25.306869+0000","last_became_active":"2023-09-30T17:02:18.361556+0000","last_became_peered":"2023-09-30T17:02:18.361556+0000","last_unstale":"2023-09-30T17:05:25.306869+0000","last_undegraded":"2023-09-30T17:05:25.306869+0000","last_fullsized":"2023-09-30T17:05:25.306869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2856,"log_dups_size":0,"ondisk_log_size":2856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:16:41.607547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8321,"num_write_kb":39600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306039+0000","last_change":"2023-09-30T17:05:03.304220+0000","last_active":"2023-09-30T17:05:25.306039+0000","last_peered":"2023-09-30T17:05:25.306039+0000","last_clean":"2023-09-30T17:05:25.306039+0000","last_became_active":"2023-09-30T17:05:03.303598+0000","last_became_peered":"2023-09-30T17:05:03.303598+0000","last_unstale":"2023-09-30T17:05:25.306039+0000","last_undegraded":"2023-09-30T17:05:25.306039+0000","last_fullsized":"2023-09-30T17:05:25.306039+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:57:44.444041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"59'12","reported_seq":92,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306163+0000","last_change":"2023-09-30T17:05:03.313214+0000","last_active":"2023-09-30T17:05:25.306163+0000","last_peered":"2023-09-30T17:05:25.306163+0000","last_clean":"2023-09-30T17:05:25.306163+0000","last_became_active":"2023-09-30T17:05:03.312888+0000","last_became_peered":"2023-09-30T17:05:03.312888+0000","last_unstale":"2023-09-30T17:05:25.306163+0000","last_undegraded":"2023-09-30T17:05:25.306163+0000","last_fullsized":"2023-09-30T17:05:25.306163+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:40:09.276369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"59'9","reported_seq":35,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305075+0000","last_change":"2023-09-30T17:05:03.304503+0000","last_active":"2023-09-30T17:05:25.305075+0000","last_peered":"2023-09-30T17:05:25.305075+0000","last_clean":"2023-09-30T17:05:25.305075+0000","last_became_active":"2023-09-30T17:05:03.304030+0000","last_became_peered":"2023-09-30T17:05:03.304030+0000","last_unstale":"2023-09-30T17:05:25.305075+0000","last_undegraded":"2023-09-30T17:05:25.305075+0000","last_fullsized":"2023-09-30T17:05:25.305075+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:08:35.110114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"59'2892","reported_seq":2981,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306333+0000","last_change":"2023-09-30T17:05:06.290230+0000","last_active":"2023-09-30T17:05:25.306333+0000","last_peered":"2023-09-30T17:05:25.306333+0000","last_clean":"2023-09-30T17:05:25.306333+0000","last_became_active":"2023-09-30T17:05:06.288725+0000","last_became_peered":"2023-09-30T17:05:06.288725+0000","last_unstale":"2023-09-30T17:05:25.306333+0000","last_undegraded":"2023-09-30T17:05:25.306333+0000","last_fullsized":"2023-09-30T17:05:25.306333+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2892,"log_dups_size":0,"ondisk_log_size":2892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:27:28.611647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8345,"num_write_kb":39712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305902+0000","last_change":"2023-09-30T17:05:03.304339+0000","last_active":"2023-09-30T17:05:25.305902+0000","last_peered":"2023-09-30T17:05:25.305902+0000","last_clean":"2023-09-30T17:05:25.305902+0000","last_became_active":"2023-09-30T17:05:03.303179+0000","last_became_peered":"2023-09-30T17:05:03.303179+0000","last_unstale":"2023-09-30T17:05:25.305902+0000","last_undegraded":"2023-09-30T17:05:25.305902+0000","last_fullsized":"2023-09-30T17:05:25.305902+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:44:20.765682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"59'2861","reported_seq":2950,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305648+0000","last_change":"2023-09-30T17:05:06.290324+0000","last_active":"2023-09-30T17:05:25.305648+0000","last_peered":"2023-09-30T17:05:25.305648+0000","last_clean":"2023-09-30T17:05:25.305648+0000","last_became_active":"2023-09-30T17:05:06.288824+0000","last_became_peered":"2023-09-30T17:05:06.288824+0000","last_unstale":"2023-09-30T17:05:25.305648+0000","last_undegraded":"2023-09-30T17:05:25.305648+0000","last_fullsized":"2023-09-30T17:05:25.305648+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2861,"log_dups_size":0,"ondisk_log_size":2861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:51:16.138021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8384,"num_write_kb":39788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":83,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306641+0000","last_change":"2023-09-30T17:05:03.304232+0000","last_active":"2023-09-30T17:05:25.306641+0000","last_peered":"2023-09-30T17:05:25.306641+0000","last_clean":"2023-09-30T17:05:25.306641+0000","last_became_active":"2023-09-30T17:05:03.303874+0000","last_became_peered":"2023-09-30T17:05:03.303874+0000","last_unstale":"2023-09-30T17:05:25.306641+0000","last_undegraded":"2023-09-30T17:05:25.306641+0000","last_fullsized":"2023-09-30T17:05:25.306641+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:39:49.644290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"59'2","reported_seq":71,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306324+0000","last_change":"2023-09-30T17:02:18.359767+0000","last_active":"2023-09-30T17:05:25.306324+0000","last_peered":"2023-09-30T17:05:25.306324+0000","last_clean":"2023-09-30T17:05:25.306324+0000","last_became_active":"2023-09-30T17:02:18.356825+0000","last_became_peered":"2023-09-30T17:02:18.356825+0000","last_unstale":"2023-09-30T17:05:25.306324+0000","last_undegraded":"2023-09-30T17:05:25.306324+0000","last_fullsized":"2023-09-30T17:05:25.306324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:39:16.689300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305494+0000","last_change":"2023-09-30T17:05:03.305087+0000","last_active":"2023-09-30T17:05:25.305494+0000","last_peered":"2023-09-30T17:05:25.305494+0000","last_clean":"2023-09-30T17:05:25.305494+0000","last_became_active":"2023-09-30T17:05:03.304463+0000","last_became_peered":"2023-09-30T17:05:03.304463+0000","last_unstale":"2023-09-30T17:05:25.305494+0000","last_undegraded":"2023-09-30T17:05:25.305494+0000","last_fullsized":"2023-09-30T17:05:25.305494+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:33:20.829898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"59'2835","reported_seq":2903,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305096+0000","last_change":"2023-09-30T17:05:06.289598+0000","last_active":"2023-09-30T17:05:25.305096+0000","last_peered":"2023-09-30T17:05:25.305096+0000","last_clean":"2023-09-30T17:05:25.305096+0000","last_became_active":"2023-09-30T17:05:06.288712+0000","last_became_peered":"2023-09-30T17:05:06.288712+0000","last_unstale":"2023-09-30T17:05:25.305096+0000","last_undegraded":"2023-09-30T17:05:25.305096+0000","last_fullsized":"2023-09-30T17:05:25.305096+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2835,"log_dups_size":0,"ondisk_log_size":2835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:01:17.676791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8288,"num_write_kb":39388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305636+0000","last_change":"2023-09-30T17:05:03.311500+0000","last_active":"2023-09-30T17:05:25.305636+0000","last_peered":"2023-09-30T17:05:25.305636+0000","last_clean":"2023-09-30T17:05:25.305636+0000","last_became_active":"2023-09-30T17:05:03.310836+0000","last_became_peered":"2023-09-30T17:05:03.310836+0000","last_unstale":"2023-09-30T17:05:25.305636+0000","last_undegraded":"2023-09-30T17:05:25.305636+0000","last_fullsized":"2023-09-30T17:05:25.305636+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:30:09.762284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"59'8","reported_seq":88,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305917+0000","last_change":"2023-09-30T17:05:03.308917+0000","last_active":"2023-09-30T17:05:25.305917+0000","last_peered":"2023-09-30T17:05:25.305917+0000","last_clean":"2023-09-30T17:05:25.305917+0000","last_became_active":"2023-09-30T17:05:03.308214+0000","last_became_peered":"2023-09-30T17:05:03.308214+0000","last_unstale":"2023-09-30T17:05:25.305917+0000","last_undegraded":"2023-09-30T17:05:25.305917+0000","last_fullsized":"2023-09-30T17:05:25.305917+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:39:50.649920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"58'3","reported_seq":85,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305666+0000","last_change":"2023-09-30T17:05:03.308944+0000","last_active":"2023-09-30T17:05:25.305666+0000","last_peered":"2023-09-30T17:05:25.305666+0000","last_clean":"2023-09-30T17:05:25.305666+0000","last_became_active":"2023-09-30T17:05:03.308483+0000","last_became_peered":"2023-09-30T17:05:03.308483+0000","last_unstale":"2023-09-30T17:05:25.305666+0000","last_undegraded":"2023-09-30T17:05:25.305666+0000","last_fullsized":"2023-09-30T17:05:25.305666+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:43:27.633747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"59'2846","reported_seq":2913,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305422+0000","last_change":"2023-09-30T17:05:06.290255+0000","last_active":"2023-09-30T17:05:25.305422+0000","last_peered":"2023-09-30T17:05:25.305422+0000","last_clean":"2023-09-30T17:05:25.305422+0000","last_became_active":"2023-09-30T17:05:06.289225+0000","last_became_peered":"2023-09-30T17:05:06.289225+0000","last_unstale":"2023-09-30T17:05:25.305422+0000","last_undegraded":"2023-09-30T17:05:25.305422+0000","last_fullsized":"2023-09-30T17:05:25.305422+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2846,"log_dups_size":0,"ondisk_log_size":2846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:41:31.424933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8199,"num_write_kb":39160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.304959+0000","last_change":"2023-09-30T17:05:03.309689+0000","last_active":"2023-09-30T17:05:25.304959+0000","last_peered":"2023-09-30T17:05:25.304959+0000","last_clean":"2023-09-30T17:05:25.304959+0000","last_became_active":"2023-09-30T17:05:03.309318+0000","last_became_peered":"2023-09-30T17:05:03.309318+0000","last_unstale":"2023-09-30T17:05:25.304959+0000","last_undegraded":"2023-09-30T17:05:25.304959+0000","last_fullsized":"2023-09-30T17:05:25.304959+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:12:37.857480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"59'2831","reported_seq":2898,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305893+0000","last_change":"2023-09-30T17:05:06.289189+0000","last_active":"2023-09-30T17:05:25.305893+0000","last_peered":"2023-09-30T17:05:25.305893+0000","last_clean":"2023-09-30T17:05:25.305893+0000","last_became_active":"2023-09-30T17:05:06.288348+0000","last_became_peered":"2023-09-30T17:05:06.288348+0000","last_unstale":"2023-09-30T17:05:25.305893+0000","last_undegraded":"2023-09-30T17:05:25.305893+0000","last_fullsized":"2023-09-30T17:05:25.305893+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2831,"log_dups_size":0,"ondisk_log_size":2831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:51:59.540252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8336,"num_write_kb":39484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305792+0000","last_change":"2023-09-30T17:05:03.304019+0000","last_active":"2023-09-30T17:05:25.305792+0000","last_peered":"2023-09-30T17:05:25.305792+0000","last_clean":"2023-09-30T17:05:25.305792+0000","last_became_active":"2023-09-30T17:05:03.303473+0000","last_became_peered":"2023-09-30T17:05:03.303473+0000","last_unstale":"2023-09-30T17:05:25.305792+0000","last_undegraded":"2023-09-30T17:05:25.305792+0000","last_fullsized":"2023-09-30T17:05:25.305792+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:10:16.238053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"59'2884","reported_seq":2951,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306051+0000","last_change":"2023-09-30T17:05:06.289446+0000","last_active":"2023-09-30T17:05:25.306051+0000","last_peered":"2023-09-30T17:05:25.306051+0000","last_clean":"2023-09-30T17:05:25.306051+0000","last_became_active":"2023-09-30T17:05:06.288169+0000","last_became_peered":"2023-09-30T17:05:06.288169+0000","last_unstale":"2023-09-30T17:05:25.306051+0000","last_undegraded":"2023-09-30T17:05:25.306051+0000","last_fullsized":"2023-09-30T17:05:25.306051+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2884,"log_dups_size":0,"ondisk_log_size":2884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:15:23.507816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8366,"num_write_kb":39744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":70,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305775+0000","last_change":"2023-09-30T17:02:17.358811+0000","last_active":"2023-09-30T17:05:25.305775+0000","last_peered":"2023-09-30T17:05:25.305775+0000","last_clean":"2023-09-30T17:05:25.305775+0000","last_became_active":"2023-09-30T17:02:17.358582+0000","last_became_peered":"2023-09-30T17:02:17.358582+0000","last_unstale":"2023-09-30T17:05:25.305775+0000","last_undegraded":"2023-09-30T17:05:25.305775+0000","last_fullsized":"2023-09-30T17:05:25.305775+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:52:37.518693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"59'8580","reported_seq":8649,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306158+0000","last_change":"2023-09-30T17:02:18.364478+0000","last_active":"2023-09-30T17:05:25.306158+0000","last_peered":"2023-09-30T17:05:25.306158+0000","last_clean":"2023-09-30T17:05:25.306158+0000","last_became_active":"2023-09-30T17:02:18.364057+0000","last_became_peered":"2023-09-30T17:02:18.364057+0000","last_unstale":"2023-09-30T17:05:25.306158+0000","last_undegraded":"2023-09-30T17:05:25.306158+0000","last_fullsized":"2023-09-30T17:05:25.306158+0000","mapping_epoch":17,"log_start":"49'4400","ondisk_log_start":"49'4400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4180,"log_dups_size":4400,"ondisk_log_size":4180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:13:55.555700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25046,"num_write_kb":118972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305797+0000","last_change":"2023-09-30T17:02:12.327704+0000","last_active":"2023-09-30T17:05:25.305797+0000","last_peered":"2023-09-30T17:05:25.305797+0000","last_clean":"2023-09-30T17:05:25.305797+0000","last_became_active":"2023-09-30T17:02:12.327384+0000","last_became_peered":"2023-09-30T17:02:12.327384+0000","last_unstale":"2023-09-30T17:05:25.305797+0000","last_undegraded":"2023-09-30T17:05:25.305797+0000","last_fullsized":"2023-09-30T17:05:25.305797+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:09:34.818252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306075+0000","last_change":"2023-09-30T17:05:03.311271+0000","last_active":"2023-09-30T17:05:25.306075+0000","last_peered":"2023-09-30T17:05:25.306075+0000","last_clean":"2023-09-30T17:05:25.306075+0000","last_became_active":"2023-09-30T17:05:03.310655+0000","last_became_peered":"2023-09-30T17:05:03.310655+0000","last_unstale":"2023-09-30T17:05:25.306075+0000","last_undegraded":"2023-09-30T17:05:25.306075+0000","last_fullsized":"2023-09-30T17:05:25.306075+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:49:35.748952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"59'9","reported_seq":89,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306198+0000","last_change":"2023-09-30T17:05:03.306223+0000","last_active":"2023-09-30T17:05:25.306198+0000","last_peered":"2023-09-30T17:05:25.306198+0000","last_clean":"2023-09-30T17:05:25.306198+0000","last_became_active":"2023-09-30T17:05:03.305956+0000","last_became_peered":"2023-09-30T17:05:03.305956+0000","last_unstale":"2023-09-30T17:05:25.306198+0000","last_undegraded":"2023-09-30T17:05:25.306198+0000","last_fullsized":"2023-09-30T17:05:25.306198+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:32:56.502917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.304959+0000","last_change":"2023-09-30T17:05:03.309359+0000","last_active":"2023-09-30T17:05:25.304959+0000","last_peered":"2023-09-30T17:05:25.304959+0000","last_clean":"2023-09-30T17:05:25.304959+0000","last_became_active":"2023-09-30T17:05:03.308944+0000","last_became_peered":"2023-09-30T17:05:03.308944+0000","last_unstale":"2023-09-30T17:05:25.304959+0000","last_undegraded":"2023-09-30T17:05:25.304959+0000","last_fullsized":"2023-09-30T17:05:25.304959+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:02:58.156693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305781+0000","last_change":"2023-09-30T17:05:03.311106+0000","last_active":"2023-09-30T17:05:25.305781+0000","last_peered":"2023-09-30T17:05:25.305781+0000","last_clean":"2023-09-30T17:05:25.305781+0000","last_became_active":"2023-09-30T17:05:03.310706+0000","last_became_peered":"2023-09-30T17:05:03.310706+0000","last_unstale":"2023-09-30T17:05:25.305781+0000","last_undegraded":"2023-09-30T17:05:25.305781+0000","last_fullsized":"2023-09-30T17:05:25.305781+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:04:03.231664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"59'9","reported_seq":78,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305690+0000","last_change":"2023-09-30T17:02:18.363399+0000","last_active":"2023-09-30T17:05:25.305690+0000","last_peered":"2023-09-30T17:05:25.305690+0000","last_clean":"2023-09-30T17:05:25.305690+0000","last_became_active":"2023-09-30T17:02:18.363064+0000","last_became_peered":"2023-09-30T17:02:18.363064+0000","last_unstale":"2023-09-30T17:05:25.305690+0000","last_undegraded":"2023-09-30T17:05:25.305690+0000","last_fullsized":"2023-09-30T17:05:25.305690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:32:34.654264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305329+0000","last_change":"2023-09-30T17:02:12.327834+0000","last_active":"2023-09-30T17:05:25.305329+0000","last_peered":"2023-09-30T17:05:25.305329+0000","last_clean":"2023-09-30T17:05:25.305329+0000","last_became_active":"2023-09-30T17:02:12.327542+0000","last_became_peered":"2023-09-30T17:02:12.327542+0000","last_unstale":"2023-09-30T17:05:25.305329+0000","last_undegraded":"2023-09-30T17:05:25.305329+0000","last_fullsized":"2023-09-30T17:05:25.305329+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:49:54.890769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305806+0000","last_change":"2023-09-30T17:05:03.305668+0000","last_active":"2023-09-30T17:05:25.305806+0000","last_peered":"2023-09-30T17:05:25.305806+0000","last_clean":"2023-09-30T17:05:25.305806+0000","last_became_active":"2023-09-30T17:05:03.305222+0000","last_became_peered":"2023-09-30T17:05:03.305222+0000","last_unstale":"2023-09-30T17:05:25.305806+0000","last_undegraded":"2023-09-30T17:05:25.305806+0000","last_fullsized":"2023-09-30T17:05:25.305806+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:17:12.662422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"59'6","reported_seq":75,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306348+0000","last_change":"2023-09-30T17:02:18.364406+0000","last_active":"2023-09-30T17:05:25.306348+0000","last_peered":"2023-09-30T17:05:25.306348+0000","last_clean":"2023-09-30T17:05:25.306348+0000","last_became_active":"2023-09-30T17:02:18.363849+0000","last_became_peered":"2023-09-30T17:02:18.363849+0000","last_unstale":"2023-09-30T17:05:25.306348+0000","last_undegraded":"2023-09-30T17:05:25.306348+0000","last_fullsized":"2023-09-30T17:05:25.306348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:43:29.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305302+0000","last_change":"2023-09-30T17:05:03.310062+0000","last_active":"2023-09-30T17:05:25.305302+0000","last_peered":"2023-09-30T17:05:25.305302+0000","last_clean":"2023-09-30T17:05:25.305302+0000","last_became_active":"2023-09-30T17:05:03.308958+0000","last_became_peered":"2023-09-30T17:05:03.308958+0000","last_unstale":"2023-09-30T17:05:25.305302+0000","last_undegraded":"2023-09-30T17:05:25.305302+0000","last_fullsized":"2023-09-30T17:05:25.305302+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:05:26.347633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":225,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.304940+0000","last_change":"2023-09-30T17:05:03.303046+0000","last_active":"2023-09-30T17:05:25.304940+0000","last_peered":"2023-09-30T17:05:25.304940+0000","last_clean":"2023-09-30T17:05:25.304940+0000","last_became_active":"2023-09-30T17:05:03.302265+0000","last_became_peered":"2023-09-30T17:05:03.302265+0000","last_unstale":"2023-09-30T17:05:25.304940+0000","last_undegraded":"2023-09-30T17:05:25.304940+0000","last_fullsized":"2023-09-30T17:05:25.304940+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:06.295501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:06.295501+0000","last_clean_scrub_stamp":"2023-09-30T17:02:06.295501+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:07:24.603358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":70,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305369+0000","last_change":"2023-09-30T17:02:17.357139+0000","last_active":"2023-09-30T17:05:25.305369+0000","last_peered":"2023-09-30T17:05:25.305369+0000","last_clean":"2023-09-30T17:05:25.305369+0000","last_became_active":"2023-09-30T17:02:17.356901+0000","last_became_peered":"2023-09-30T17:02:17.356901+0000","last_unstale":"2023-09-30T17:05:25.305369+0000","last_undegraded":"2023-09-30T17:05:25.305369+0000","last_fullsized":"2023-09-30T17:05:25.305369+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:22:35.747671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"59'7","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305738+0000","last_change":"2023-09-30T17:05:03.305199+0000","last_active":"2023-09-30T17:05:25.305738+0000","last_peered":"2023-09-30T17:05:25.305738+0000","last_clean":"2023-09-30T17:05:25.305738+0000","last_became_active":"2023-09-30T17:05:03.304974+0000","last_became_peered":"2023-09-30T17:05:03.304974+0000","last_unstale":"2023-09-30T17:05:25.305738+0000","last_undegraded":"2023-09-30T17:05:25.305738+0000","last_fullsized":"2023-09-30T17:05:25.305738+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:03:27.429545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305080+0000","last_change":"2023-09-30T17:05:03.303739+0000","last_active":"2023-09-30T17:05:25.305080+0000","last_peered":"2023-09-30T17:05:25.305080+0000","last_clean":"2023-09-30T17:05:25.305080+0000","last_became_active":"2023-09-30T17:05:03.302590+0000","last_became_peered":"2023-09-30T17:05:03.302590+0000","last_unstale":"2023-09-30T17:05:25.305080+0000","last_undegraded":"2023-09-30T17:05:25.305080+0000","last_fullsized":"2023-09-30T17:05:25.305080+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:51:30.199616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"59'5","reported_seq":94,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305237+0000","last_change":"2023-09-30T17:05:03.318439+0000","last_active":"2023-09-30T17:05:25.305237+0000","last_peered":"2023-09-30T17:05:25.305237+0000","last_clean":"2023-09-30T17:05:25.305237+0000","last_became_active":"2023-09-30T17:05:03.308059+0000","last_became_peered":"2023-09-30T17:05:03.308059+0000","last_unstale":"2023-09-30T17:05:25.305237+0000","last_undegraded":"2023-09-30T17:05:25.305237+0000","last_fullsized":"2023-09-30T17:05:25.305237+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:16:25.170638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"59'11252","reported_seq":11321,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306870+0000","last_change":"2023-09-30T17:02:18.360029+0000","last_active":"2023-09-30T17:05:25.306870+0000","last_peered":"2023-09-30T17:05:25.306870+0000","last_clean":"2023-09-30T17:05:25.306870+0000","last_became_active":"2023-09-30T17:02:18.356839+0000","last_became_peered":"2023-09-30T17:02:18.356839+0000","last_unstale":"2023-09-30T17:05:25.306870+0000","last_undegraded":"2023-09-30T17:05:25.306870+0000","last_fullsized":"2023-09-30T17:05:25.306870+0000","mapping_epoch":17,"log_start":"51'6700","ondisk_log_start":"51'6700","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4552,"log_dups_size":6700,"ondisk_log_size":4552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:16:27.516884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33068,"num_write_kb":157144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":73,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306724+0000","last_change":"2023-09-30T17:02:12.330472+0000","last_active":"2023-09-30T17:05:25.306724+0000","last_peered":"2023-09-30T17:05:25.306724+0000","last_clean":"2023-09-30T17:05:25.306724+0000","last_became_active":"2023-09-30T17:02:12.330154+0000","last_became_peered":"2023-09-30T17:02:12.330154+0000","last_unstale":"2023-09-30T17:05:25.306724+0000","last_undegraded":"2023-09-30T17:05:25.306724+0000","last_fullsized":"2023-09-30T17:05:25.306724+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:43:23.161734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":70,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305996+0000","last_change":"2023-09-30T17:02:17.361007+0000","last_active":"2023-09-30T17:05:25.305996+0000","last_peered":"2023-09-30T17:05:25.305996+0000","last_clean":"2023-09-30T17:05:25.305996+0000","last_became_active":"2023-09-30T17:02:17.360721+0000","last_became_peered":"2023-09-30T17:02:17.360721+0000","last_unstale":"2023-09-30T17:05:25.305996+0000","last_undegraded":"2023-09-30T17:05:25.305996+0000","last_fullsized":"2023-09-30T17:05:25.305996+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:13:41.205152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"59'2836","reported_seq":2925,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306557+0000","last_change":"2023-09-30T17:05:06.293085+0000","last_active":"2023-09-30T17:05:25.306557+0000","last_peered":"2023-09-30T17:05:25.306557+0000","last_clean":"2023-09-30T17:05:25.306557+0000","last_became_active":"2023-09-30T17:05:06.291203+0000","last_became_peered":"2023-09-30T17:05:06.291203+0000","last_unstale":"2023-09-30T17:05:25.306557+0000","last_undegraded":"2023-09-30T17:05:25.306557+0000","last_fullsized":"2023-09-30T17:05:25.306557+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2836,"log_dups_size":0,"ondisk_log_size":2836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:11:28.091818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8199,"num_write_kb":39048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"59'3","reported_seq":73,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306165+0000","last_change":"2023-09-30T17:02:17.360831+0000","last_active":"2023-09-30T17:05:25.306165+0000","last_peered":"2023-09-30T17:05:25.306165+0000","last_clean":"2023-09-30T17:05:25.306165+0000","last_became_active":"2023-09-30T17:02:17.360494+0000","last_became_peered":"2023-09-30T17:02:17.360494+0000","last_unstale":"2023-09-30T17:05:25.306165+0000","last_undegraded":"2023-09-30T17:05:25.306165+0000","last_fullsized":"2023-09-30T17:05:25.306165+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:24:04.564387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306251+0000","last_change":"2023-09-30T17:02:12.328184+0000","last_active":"2023-09-30T17:05:25.306251+0000","last_peered":"2023-09-30T17:05:25.306251+0000","last_clean":"2023-09-30T17:05:25.306251+0000","last_became_active":"2023-09-30T17:02:12.327898+0000","last_became_peered":"2023-09-30T17:02:12.327898+0000","last_unstale":"2023-09-30T17:05:25.306251+0000","last_undegraded":"2023-09-30T17:05:25.306251+0000","last_fullsized":"2023-09-30T17:05:25.306251+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:43:23.161734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"59'8","reported_seq":88,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305121+0000","last_change":"2023-09-30T17:05:03.308856+0000","last_active":"2023-09-30T17:05:25.305121+0000","last_peered":"2023-09-30T17:05:25.305121+0000","last_clean":"2023-09-30T17:05:25.305121+0000","last_became_active":"2023-09-30T17:05:03.308429+0000","last_became_peered":"2023-09-30T17:05:03.308429+0000","last_unstale":"2023-09-30T17:05:25.305121+0000","last_undegraded":"2023-09-30T17:05:25.305121+0000","last_fullsized":"2023-09-30T17:05:25.305121+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:49:32.189339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305749+0000","last_change":"2023-09-30T17:05:03.304353+0000","last_active":"2023-09-30T17:05:25.305749+0000","last_peered":"2023-09-30T17:05:25.305749+0000","last_clean":"2023-09-30T17:05:25.305749+0000","last_became_active":"2023-09-30T17:05:03.302503+0000","last_became_peered":"2023-09-30T17:05:03.302503+0000","last_unstale":"2023-09-30T17:05:25.305749+0000","last_undegraded":"2023-09-30T17:05:25.305749+0000","last_fullsized":"2023-09-30T17:05:25.305749+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:19:16.151598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"60'8","reported_seq":94,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306144+0000","last_change":"2023-09-30T17:05:03.314806+0000","last_active":"2023-09-30T17:05:25.306144+0000","last_peered":"2023-09-30T17:05:25.306144+0000","last_clean":"2023-09-30T17:05:25.306144+0000","last_became_active":"2023-09-30T17:05:03.308201+0000","last_became_peered":"2023-09-30T17:05:03.308201+0000","last_unstale":"2023-09-30T17:05:25.306144+0000","last_undegraded":"2023-09-30T17:05:25.306144+0000","last_fullsized":"2023-09-30T17:05:25.306144+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:19:18.486570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"59'6","reported_seq":86,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306035+0000","last_change":"2023-09-30T17:05:03.304265+0000","last_active":"2023-09-30T17:05:25.306035+0000","last_peered":"2023-09-30T17:05:25.306035+0000","last_clean":"2023-09-30T17:05:25.306035+0000","last_became_active":"2023-09-30T17:05:03.304022+0000","last_became_peered":"2023-09-30T17:05:03.304022+0000","last_unstale":"2023-09-30T17:05:25.306035+0000","last_undegraded":"2023-09-30T17:05:25.306035+0000","last_fullsized":"2023-09-30T17:05:25.306035+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:19:19.492200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":82,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306295+0000","last_change":"2023-09-30T17:05:03.303927+0000","last_active":"2023-09-30T17:05:25.306295+0000","last_peered":"2023-09-30T17:05:25.306295+0000","last_clean":"2023-09-30T17:05:25.306295+0000","last_became_active":"2023-09-30T17:05:03.303487+0000","last_became_peered":"2023-09-30T17:05:03.303487+0000","last_unstale":"2023-09-30T17:05:25.306295+0000","last_undegraded":"2023-09-30T17:05:25.306295+0000","last_fullsized":"2023-09-30T17:05:25.306295+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:43:27.633747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"59'2835","reported_seq":2904,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306514+0000","last_change":"2023-09-30T17:02:18.358269+0000","last_active":"2023-09-30T17:05:25.306514+0000","last_peered":"2023-09-30T17:05:25.306514+0000","last_clean":"2023-09-30T17:05:25.306514+0000","last_became_active":"2023-09-30T17:02:18.356902+0000","last_became_peered":"2023-09-30T17:02:18.356902+0000","last_unstale":"2023-09-30T17:05:25.306514+0000","last_undegraded":"2023-09-30T17:05:25.306514+0000","last_fullsized":"2023-09-30T17:05:25.306514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2835,"log_dups_size":0,"ondisk_log_size":2835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:39:28.022201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8302,"num_write_kb":39500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305740+0000","last_change":"2023-09-30T17:05:03.311401+0000","last_active":"2023-09-30T17:05:25.305740+0000","last_peered":"2023-09-30T17:05:25.305740+0000","last_clean":"2023-09-30T17:05:25.305740+0000","last_became_active":"2023-09-30T17:05:03.310996+0000","last_became_peered":"2023-09-30T17:05:03.310996+0000","last_unstale":"2023-09-30T17:05:25.305740+0000","last_undegraded":"2023-09-30T17:05:25.305740+0000","last_fullsized":"2023-09-30T17:05:25.305740+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:28:19.097868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"59'2848","reported_seq":2915,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305483+0000","last_change":"2023-09-30T17:05:06.290662+0000","last_active":"2023-09-30T17:05:25.305483+0000","last_peered":"2023-09-30T17:05:25.305483+0000","last_clean":"2023-09-30T17:05:25.305483+0000","last_became_active":"2023-09-30T17:05:06.289599+0000","last_became_peered":"2023-09-30T17:05:06.289599+0000","last_unstale":"2023-09-30T17:05:25.305483+0000","last_undegraded":"2023-09-30T17:05:25.305483+0000","last_fullsized":"2023-09-30T17:05:25.305483+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2848,"log_dups_size":0,"ondisk_log_size":2848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:20:28.670256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8235,"num_write_kb":39276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"58'3","reported_seq":85,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306879+0000","last_change":"2023-09-30T17:05:03.307212+0000","last_active":"2023-09-30T17:05:25.306879+0000","last_peered":"2023-09-30T17:05:25.306879+0000","last_clean":"2023-09-30T17:05:25.306879+0000","last_became_active":"2023-09-30T17:05:03.306711+0000","last_became_peered":"2023-09-30T17:05:03.306711+0000","last_unstale":"2023-09-30T17:05:25.306879+0000","last_undegraded":"2023-09-30T17:05:25.306879+0000","last_fullsized":"2023-09-30T17:05:25.306879+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:11:56.900744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"59'10","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305401+0000","last_change":"2023-09-30T17:05:03.311669+0000","last_active":"2023-09-30T17:05:25.305401+0000","last_peered":"2023-09-30T17:05:25.305401+0000","last_clean":"2023-09-30T17:05:25.305401+0000","last_became_active":"2023-09-30T17:05:03.310763+0000","last_became_peered":"2023-09-30T17:05:03.310763+0000","last_unstale":"2023-09-30T17:05:25.305401+0000","last_undegraded":"2023-09-30T17:05:25.305401+0000","last_fullsized":"2023-09-30T17:05:25.305401+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:36:53.333402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":71,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306260+0000","last_change":"2023-09-30T17:02:17.360802+0000","last_active":"2023-09-30T17:05:25.306260+0000","last_peered":"2023-09-30T17:05:25.306260+0000","last_clean":"2023-09-30T17:05:25.306260+0000","last_became_active":"2023-09-30T17:02:17.360475+0000","last_became_peered":"2023-09-30T17:02:17.360475+0000","last_unstale":"2023-09-30T17:05:25.306260+0000","last_undegraded":"2023-09-30T17:05:25.306260+0000","last_fullsized":"2023-09-30T17:05:25.306260+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:50:18.455188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"59'5711","reported_seq":5780,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306268+0000","last_change":"2023-09-30T17:02:18.359857+0000","last_active":"2023-09-30T17:05:25.306268+0000","last_peered":"2023-09-30T17:05:25.306268+0000","last_clean":"2023-09-30T17:05:25.306268+0000","last_became_active":"2023-09-30T17:02:18.357098+0000","last_became_peered":"2023-09-30T17:02:18.357098+0000","last_unstale":"2023-09-30T17:05:25.306268+0000","last_undegraded":"2023-09-30T17:05:25.306268+0000","last_fullsized":"2023-09-30T17:05:25.306268+0000","mapping_epoch":17,"log_start":"42'1200","ondisk_log_start":"42'1200","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4511,"log_dups_size":1200,"ondisk_log_size":4511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:48:17.598726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16681,"num_write_kb":79476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":85,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306263+0000","last_change":"2023-09-30T17:05:03.313345+0000","last_active":"2023-09-30T17:05:25.306263+0000","last_peered":"2023-09-30T17:05:25.306263+0000","last_clean":"2023-09-30T17:05:25.306263+0000","last_became_active":"2023-09-30T17:05:03.313050+0000","last_became_peered":"2023-09-30T17:05:03.313050+0000","last_unstale":"2023-09-30T17:05:25.306263+0000","last_undegraded":"2023-09-30T17:05:25.306263+0000","last_fullsized":"2023-09-30T17:05:25.306263+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:24:52.247523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"59'2872","reported_seq":2939,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305196+0000","last_change":"2023-09-30T17:05:06.290298+0000","last_active":"2023-09-30T17:05:25.305196+0000","last_peered":"2023-09-30T17:05:25.305196+0000","last_clean":"2023-09-30T17:05:25.305196+0000","last_became_active":"2023-09-30T17:05:06.289197+0000","last_became_peered":"2023-09-30T17:05:06.289197+0000","last_unstale":"2023-09-30T17:05:25.305196+0000","last_undegraded":"2023-09-30T17:05:25.305196+0000","last_fullsized":"2023-09-30T17:05:25.305196+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2872,"log_dups_size":0,"ondisk_log_size":2872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:57:10.410506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8447,"num_write_kb":40072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"59'9","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305150+0000","last_change":"2023-09-30T17:05:03.310950+0000","last_active":"2023-09-30T17:05:25.305150+0000","last_peered":"2023-09-30T17:05:25.305150+0000","last_clean":"2023-09-30T17:05:25.305150+0000","last_became_active":"2023-09-30T17:05:03.310591+0000","last_became_peered":"2023-09-30T17:05:03.310591+0000","last_unstale":"2023-09-30T17:05:25.305150+0000","last_undegraded":"2023-09-30T17:05:25.305150+0000","last_fullsized":"2023-09-30T17:05:25.305150+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:26:23.194138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"59'13","reported_seq":82,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305292+0000","last_change":"2023-09-30T17:02:18.363479+0000","last_active":"2023-09-30T17:05:25.305292+0000","last_peered":"2023-09-30T17:05:25.305292+0000","last_clean":"2023-09-30T17:05:25.305292+0000","last_became_active":"2023-09-30T17:02:18.363222+0000","last_became_peered":"2023-09-30T17:02:18.363222+0000","last_unstale":"2023-09-30T17:05:25.305292+0000","last_undegraded":"2023-09-30T17:05:25.305292+0000","last_fullsized":"2023-09-30T17:05:25.305292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:09:55.056098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"59'2796","reported_seq":2885,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306184+0000","last_change":"2023-09-30T17:05:06.292455+0000","last_active":"2023-09-30T17:05:25.306184+0000","last_peered":"2023-09-30T17:05:25.306184+0000","last_clean":"2023-09-30T17:05:25.306184+0000","last_became_active":"2023-09-30T17:05:06.290929+0000","last_became_peered":"2023-09-30T17:05:06.290929+0000","last_unstale":"2023-09-30T17:05:25.306184+0000","last_undegraded":"2023-09-30T17:05:25.306184+0000","last_fullsized":"2023-09-30T17:05:25.306184+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2796,"log_dups_size":0,"ondisk_log_size":2796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:54:14.579761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8138,"num_write_kb":38784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"59'2852","reported_seq":2921,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305723+0000","last_change":"2023-09-30T17:02:18.363216+0000","last_active":"2023-09-30T17:05:25.305723+0000","last_peered":"2023-09-30T17:05:25.305723+0000","last_clean":"2023-09-30T17:05:25.305723+0000","last_became_active":"2023-09-30T17:02:18.362894+0000","last_became_peered":"2023-09-30T17:02:18.362894+0000","last_unstale":"2023-09-30T17:05:25.305723+0000","last_undegraded":"2023-09-30T17:05:25.305723+0000","last_fullsized":"2023-09-30T17:05:25.305723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2852,"log_dups_size":0,"ondisk_log_size":2852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:30:43.782165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8357,"num_write_kb":39780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"59'2874","reported_seq":2963,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306543+0000","last_change":"2023-09-30T17:05:06.294279+0000","last_active":"2023-09-30T17:05:25.306543+0000","last_peered":"2023-09-30T17:05:25.306543+0000","last_clean":"2023-09-30T17:05:25.306543+0000","last_became_active":"2023-09-30T17:05:06.292898+0000","last_became_peered":"2023-09-30T17:05:06.292898+0000","last_unstale":"2023-09-30T17:05:25.306543+0000","last_undegraded":"2023-09-30T17:05:25.306543+0000","last_fullsized":"2023-09-30T17:05:25.306543+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2874,"log_dups_size":0,"ondisk_log_size":2874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:02:14.484209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8465,"num_write_kb":40104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":532685,"num_write_kb":2575302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140940,"ondisk_log_size":140940,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":228927,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":137,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":223425,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":524288,"data_stored":457854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":66,"seq":283467841543,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47044,"kb_used_data":1460,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94324796,"statfs":{"total":96636764160,"available":96588591104,"internally_reserved":0,"allocated":1495040,"data_stored":1123985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7139,"internal_metadata":46654493},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]}]},{"osd":0,"up_from":8,"seq":34359738412,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":582456,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":580990,"kb_avail":93789384,"statfs":{"total":96636764160,"available":96040329216,"internally_reserved":0,"allocated":1482752,"data_stored":1122763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":594934214},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 17:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.51800000000000002,"15min":0.48999999999999999},"min":{"1min":0.215,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":5.9480000000000004,"5min":5.9480000000000004,"15min":5.9480000000000004},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.503,"15min":0.46300000000000002},"min":{"1min":0.216,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":3.6819999999999999,"5min":3.6819999999999999,"15min":3.6819999999999999},"last":0.42799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738412,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":563596,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":562942,"kb_avail":93808244,"statfs":{"total":96636764160,"available":96059641856,"internally_reserved":0,"allocated":651264,"data_stored":305912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":576453062},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 17:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.48599999999999999,"15min":0.45600000000000002},"min":{"1min":0.19800000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":3.3420000000000001,"5min":3.3420000000000001,"15min":3.3420000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.51200000000000001,"15min":0.46000000000000002},"min":{"1min":0.189,"5min":0.188,"15min":0.188},"max":{"1min":3.5470000000000002,"5min":3.5470000000000002,"15min":3.5470000000000002},"last":0.60599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":249856,"data_stored":227705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":228927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T17:05:30.292 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T17:05:30.640 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:05:30.704 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-09-30T17:05:30.704 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":176,"stamp":"2023-09-30T17:05:29.339287+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":819295,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":140,"num_read_kb":122,"num_write":533025,"num_write_kb":2579054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":223425,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141229,"ondisk_log_size":141229,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1193096,"kb_used_data":3544,"kb_used_omap":10,"kb_used_meta":1189493,"kb_avail":281922424,"statfs":{"total":289910292480,"available":288688562176,"internally_reserved":0,"allocated":3629056,"data_stored":2552660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10327,"internal_metadata":1218041769},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001043"},"pg_stats":[{"pgid":"4.3f","version":"59'2790","reported_seq":2859,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.307056+0000","last_change":"2023-09-30T17:02:18.360288+0000","last_active":"2023-09-30T17:05:25.307056+0000","last_peered":"2023-09-30T17:05:25.307056+0000","last_clean":"2023-09-30T17:05:25.307056+0000","last_became_active":"2023-09-30T17:02:18.358716+0000","last_became_peered":"2023-09-30T17:02:18.358716+0000","last_unstale":"2023-09-30T17:05:25.307056+0000","last_undegraded":"2023-09-30T17:05:25.307056+0000","last_fullsized":"2023-09-30T17:05:25.307056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2790,"log_dups_size":0,"ondisk_log_size":2790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:12:06.380095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8214,"num_write_kb":38924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"59'4","reported_seq":73,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306636+0000","last_change":"2023-09-30T17:02:18.362418+0000","last_active":"2023-09-30T17:05:25.306636+0000","last_peered":"2023-09-30T17:05:25.306636+0000","last_clean":"2023-09-30T17:05:25.306636+0000","last_became_active":"2023-09-30T17:02:18.360372+0000","last_became_peered":"2023-09-30T17:02:18.360372+0000","last_unstale":"2023-09-30T17:05:25.306636+0000","last_undegraded":"2023-09-30T17:05:25.306636+0000","last_fullsized":"2023-09-30T17:05:25.306636+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:43:29.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"59'5697","reported_seq":5771,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306021+0000","last_change":"2023-09-30T17:05:06.291597+0000","last_active":"2023-09-30T17:05:25.306021+0000","last_peered":"2023-09-30T17:05:25.306021+0000","last_clean":"2023-09-30T17:05:25.306021+0000","last_became_active":"2023-09-30T17:05:06.290447+0000","last_became_peered":"2023-09-30T17:05:06.290447+0000","last_unstale":"2023-09-30T17:05:25.306021+0000","last_undegraded":"2023-09-30T17:05:25.306021+0000","last_fullsized":"2023-09-30T17:05:25.306021+0000","mapping_epoch":69,"log_start":"42'1200","ondisk_log_start":"42'1200","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4497,"log_dups_size":1200,"ondisk_log_size":4497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:02:21.064107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16590,"num_write_kb":78960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"59'10","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305409+0000","last_change":"2023-09-30T17:05:03.309996+0000","last_active":"2023-09-30T17:05:25.305409+0000","last_peered":"2023-09-30T17:05:25.305409+0000","last_clean":"2023-09-30T17:05:25.305409+0000","last_became_active":"2023-09-30T17:05:03.309326+0000","last_became_peered":"2023-09-30T17:05:03.309326+0000","last_unstale":"2023-09-30T17:05:25.305409+0000","last_undegraded":"2023-09-30T17:05:25.305409+0000","last_fullsized":"2023-09-30T17:05:25.305409+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:31:23.164242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"59'2934","reported_seq":3003,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306421+0000","last_change":"2023-09-30T17:02:18.360192+0000","last_active":"2023-09-30T17:05:25.306421+0000","last_peered":"2023-09-30T17:05:25.306421+0000","last_clean":"2023-09-30T17:05:25.306421+0000","last_became_active":"2023-09-30T17:02:18.357317+0000","last_became_peered":"2023-09-30T17:02:18.357317+0000","last_unstale":"2023-09-30T17:05:25.306421+0000","last_undegraded":"2023-09-30T17:05:25.306421+0000","last_fullsized":"2023-09-30T17:05:25.306421+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2934,"log_dups_size":0,"ondisk_log_size":2934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:37:14.790993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8466,"num_write_kb":40084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"59'6","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305283+0000","last_change":"2023-09-30T17:05:03.311318+0000","last_active":"2023-09-30T17:05:25.305283+0000","last_peered":"2023-09-30T17:05:25.305283+0000","last_clean":"2023-09-30T17:05:25.305283+0000","last_became_active":"2023-09-30T17:05:03.310703+0000","last_became_peered":"2023-09-30T17:05:03.310703+0000","last_unstale":"2023-09-30T17:05:25.305283+0000","last_undegraded":"2023-09-30T17:05:25.305283+0000","last_fullsized":"2023-09-30T17:05:25.305283+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:08:45.345559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"59'7","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305160+0000","last_change":"2023-09-30T17:05:03.310838+0000","last_active":"2023-09-30T17:05:25.305160+0000","last_peered":"2023-09-30T17:05:25.305160+0000","last_clean":"2023-09-30T17:05:25.305160+0000","last_became_active":"2023-09-30T17:05:03.310047+0000","last_became_peered":"2023-09-30T17:05:03.310047+0000","last_unstale":"2023-09-30T17:05:25.305160+0000","last_undegraded":"2023-09-30T17:05:25.305160+0000","last_fullsized":"2023-09-30T17:05:25.305160+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:29:17.418059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"59'11423","reported_seq":11499,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.304794+0000","last_change":"2023-09-30T17:05:06.286653+0000","last_active":"2023-09-30T17:05:25.304794+0000","last_peered":"2023-09-30T17:05:25.304794+0000","last_clean":"2023-09-30T17:05:25.304794+0000","last_became_active":"2023-09-30T17:05:06.285582+0000","last_became_peered":"2023-09-30T17:05:06.285582+0000","last_unstale":"2023-09-30T17:05:25.304794+0000","last_undegraded":"2023-09-30T17:05:25.304794+0000","last_fullsized":"2023-09-30T17:05:25.304794+0000","mapping_epoch":69,"log_start":"52'7200","ondisk_log_start":"52'7200","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4223,"log_dups_size":5777,"ondisk_log_size":4223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:35:18.578031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33444,"num_write_kb":158924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"59'8589","reported_seq":8658,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306041+0000","last_change":"2023-09-30T17:02:18.364222+0000","last_active":"2023-09-30T17:05:25.306041+0000","last_peered":"2023-09-30T17:05:25.306041+0000","last_clean":"2023-09-30T17:05:25.306041+0000","last_became_active":"2023-09-30T17:02:18.363485+0000","last_became_peered":"2023-09-30T17:02:18.363485+0000","last_unstale":"2023-09-30T17:05:25.306041+0000","last_undegraded":"2023-09-30T17:05:25.306041+0000","last_fullsized":"2023-09-30T17:05:25.306041+0000","mapping_epoch":17,"log_start":"49'4400","ondisk_log_start":"49'4400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4189,"log_dups_size":4400,"ondisk_log_size":4189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:14:35.192615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25052,"num_write_kb":118756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"59'8585","reported_seq":8654,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306806+0000","last_change":"2023-09-30T17:02:18.360010+0000","last_active":"2023-09-30T17:05:25.306806+0000","last_peered":"2023-09-30T17:05:25.306806+0000","last_clean":"2023-09-30T17:05:25.306806+0000","last_became_active":"2023-09-30T17:02:18.358396+0000","last_became_peered":"2023-09-30T17:02:18.358396+0000","last_unstale":"2023-09-30T17:05:25.306806+0000","last_undegraded":"2023-09-30T17:05:25.306806+0000","last_fullsized":"2023-09-30T17:05:25.306806+0000","mapping_epoch":17,"log_start":"48'4100","ondisk_log_start":"48'4100","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4485,"log_dups_size":4100,"ondisk_log_size":4485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:26:11.522402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24997,"num_write_kb":162463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"59'5664","reported_seq":5740,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305719+0000","last_change":"2023-09-30T17:05:06.291535+0000","last_active":"2023-09-30T17:05:25.305719+0000","last_peered":"2023-09-30T17:05:25.305719+0000","last_clean":"2023-09-30T17:05:25.305719+0000","last_became_active":"2023-09-30T17:05:06.290193+0000","last_became_peered":"2023-09-30T17:05:06.290193+0000","last_unstale":"2023-09-30T17:05:25.305719+0000","last_undegraded":"2023-09-30T17:05:25.305719+0000","last_fullsized":"2023-09-30T17:05:25.305719+0000","mapping_epoch":69,"log_start":"43'1400","ondisk_log_start":"43'1400","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4264,"log_dups_size":1400,"ondisk_log_size":4264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:21:15.508580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16442,"num_write_kb":78308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"59'2931","reported_seq":3020,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306235+0000","last_change":"2023-09-30T17:05:06.290270+0000","last_active":"2023-09-30T17:05:25.306235+0000","last_peered":"2023-09-30T17:05:25.306235+0000","last_clean":"2023-09-30T17:05:25.306235+0000","last_became_active":"2023-09-30T17:05:06.288753+0000","last_became_peered":"2023-09-30T17:05:06.288753+0000","last_unstale":"2023-09-30T17:05:25.306235+0000","last_undegraded":"2023-09-30T17:05:25.306235+0000","last_fullsized":"2023-09-30T17:05:25.306235+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2931,"log_dups_size":0,"ondisk_log_size":2931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:38:30.988146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8488,"num_write_kb":40364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"59'2860","reported_seq":2929,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306164+0000","last_change":"2023-09-30T17:02:18.359894+0000","last_active":"2023-09-30T17:05:25.306164+0000","last_peered":"2023-09-30T17:05:25.306164+0000","last_clean":"2023-09-30T17:05:25.306164+0000","last_became_active":"2023-09-30T17:02:18.358534+0000","last_became_peered":"2023-09-30T17:02:18.358534+0000","last_unstale":"2023-09-30T17:05:25.306164+0000","last_undegraded":"2023-09-30T17:05:25.306164+0000","last_fullsized":"2023-09-30T17:05:25.306164+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2860,"log_dups_size":0,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:22:13.025181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8367,"num_write_kb":39772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"59'2911","reported_seq":2978,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305184+0000","last_change":"2023-09-30T17:05:06.289465+0000","last_active":"2023-09-30T17:05:25.305184+0000","last_peered":"2023-09-30T17:05:25.305184+0000","last_clean":"2023-09-30T17:05:25.305184+0000","last_became_active":"2023-09-30T17:05:06.288360+0000","last_became_peered":"2023-09-30T17:05:06.288360+0000","last_unstale":"2023-09-30T17:05:25.305184+0000","last_undegraded":"2023-09-30T17:05:25.305184+0000","last_fullsized":"2023-09-30T17:05:25.305184+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2911,"log_dups_size":0,"ondisk_log_size":2911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:53:55.381223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8419,"num_write_kb":39940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"59'2889","reported_seq":2956,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305078+0000","last_change":"2023-09-30T17:05:06.286551+0000","last_active":"2023-09-30T17:05:25.305078+0000","last_peered":"2023-09-30T17:05:25.305078+0000","last_clean":"2023-09-30T17:05:25.305078+0000","last_became_active":"2023-09-30T17:05:06.285738+0000","last_became_peered":"2023-09-30T17:05:06.285738+0000","last_unstale":"2023-09-30T17:05:25.305078+0000","last_undegraded":"2023-09-30T17:05:25.305078+0000","last_fullsized":"2023-09-30T17:05:25.305078+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2889,"log_dups_size":0,"ondisk_log_size":2889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:18:17.841837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8435,"num_write_kb":39984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"59'2839","reported_seq":2906,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.304983+0000","last_change":"2023-09-30T17:05:06.291173+0000","last_active":"2023-09-30T17:05:25.304983+0000","last_peered":"2023-09-30T17:05:25.304983+0000","last_clean":"2023-09-30T17:05:25.304983+0000","last_became_active":"2023-09-30T17:05:06.289872+0000","last_became_peered":"2023-09-30T17:05:06.289872+0000","last_unstale":"2023-09-30T17:05:25.304983+0000","last_undegraded":"2023-09-30T17:05:25.304983+0000","last_fullsized":"2023-09-30T17:05:25.304983+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2839,"log_dups_size":0,"ondisk_log_size":2839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:57:27.685208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8166,"num_write_kb":38928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"59'2802","reported_seq":2871,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306044+0000","last_change":"2023-09-30T17:02:18.364360+0000","last_active":"2023-09-30T17:05:25.306044+0000","last_peered":"2023-09-30T17:05:25.306044+0000","last_clean":"2023-09-30T17:05:25.306044+0000","last_became_active":"2023-09-30T17:02:18.363697+0000","last_became_peered":"2023-09-30T17:02:18.363697+0000","last_unstale":"2023-09-30T17:05:25.306044+0000","last_undegraded":"2023-09-30T17:05:25.306044+0000","last_fullsized":"2023-09-30T17:05:25.306044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2802,"log_dups_size":0,"ondisk_log_size":2802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:50:52.893768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8256,"num_write_kb":39208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"59'2860","reported_seq":2929,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306937+0000","last_change":"2023-09-30T17:02:18.360320+0000","last_active":"2023-09-30T17:05:25.306937+0000","last_peered":"2023-09-30T17:05:25.306937+0000","last_clean":"2023-09-30T17:05:25.306937+0000","last_became_active":"2023-09-30T17:02:18.357184+0000","last_became_peered":"2023-09-30T17:02:18.357184+0000","last_unstale":"2023-09-30T17:05:25.306937+0000","last_undegraded":"2023-09-30T17:05:25.306937+0000","last_fullsized":"2023-09-30T17:05:25.306937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2860,"log_dups_size":0,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:21:45.195007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8368,"num_write_kb":39616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"59'5686","reported_seq":5755,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305812+0000","last_change":"2023-09-30T17:02:18.363956+0000","last_active":"2023-09-30T17:05:25.305812+0000","last_peered":"2023-09-30T17:05:25.305812+0000","last_clean":"2023-09-30T17:05:25.305812+0000","last_became_active":"2023-09-30T17:02:18.363654+0000","last_became_peered":"2023-09-30T17:02:18.363654+0000","last_unstale":"2023-09-30T17:05:25.305812+0000","last_undegraded":"2023-09-30T17:05:25.305812+0000","last_fullsized":"2023-09-30T17:05:25.305812+0000","mapping_epoch":17,"log_start":"44'1500","ondisk_log_start":"44'1500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4186,"log_dups_size":1500,"ondisk_log_size":4186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:48:17.598726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16649,"num_write_kb":78956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"59'5799","reported_seq":5876,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305562+0000","last_change":"2023-09-30T17:05:06.290994+0000","last_active":"2023-09-30T17:05:25.305562+0000","last_peered":"2023-09-30T17:05:25.305562+0000","last_clean":"2023-09-30T17:05:25.305562+0000","last_became_active":"2023-09-30T17:05:06.289817+0000","last_became_peered":"2023-09-30T17:05:06.289817+0000","last_unstale":"2023-09-30T17:05:25.305562+0000","last_undegraded":"2023-09-30T17:05:25.305562+0000","last_fullsized":"2023-09-30T17:05:25.305562+0000","mapping_epoch":69,"log_start":"44'1600","ondisk_log_start":"44'1600","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4199,"log_dups_size":1600,"ondisk_log_size":4199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:50:21.333588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16903,"num_write_kb":80184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"59'12","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305497+0000","last_change":"2023-09-30T17:05:03.310298+0000","last_active":"2023-09-30T17:05:25.305497+0000","last_peered":"2023-09-30T17:05:25.305497+0000","last_clean":"2023-09-30T17:05:25.305497+0000","last_became_active":"2023-09-30T17:05:03.309537+0000","last_became_peered":"2023-09-30T17:05:03.309537+0000","last_unstale":"2023-09-30T17:05:25.305497+0000","last_undegraded":"2023-09-30T17:05:25.305497+0000","last_fullsized":"2023-09-30T17:05:25.305497+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:45:25.545287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"59'2879","reported_seq":2968,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306043+0000","last_change":"2023-09-30T17:05:06.292705+0000","last_active":"2023-09-30T17:05:25.306043+0000","last_peered":"2023-09-30T17:05:25.306043+0000","last_clean":"2023-09-30T17:05:25.306043+0000","last_became_active":"2023-09-30T17:05:06.290797+0000","last_became_peered":"2023-09-30T17:05:06.290797+0000","last_unstale":"2023-09-30T17:05:25.306043+0000","last_undegraded":"2023-09-30T17:05:25.306043+0000","last_fullsized":"2023-09-30T17:05:25.306043+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2879,"log_dups_size":0,"ondisk_log_size":2879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:55:01.976617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8343,"num_write_kb":39768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"59'2809","reported_seq":2898,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305406+0000","last_change":"2023-09-30T17:05:06.290594+0000","last_active":"2023-09-30T17:05:25.305406+0000","last_peered":"2023-09-30T17:05:25.305406+0000","last_clean":"2023-09-30T17:05:25.305406+0000","last_became_active":"2023-09-30T17:05:06.288837+0000","last_became_peered":"2023-09-30T17:05:06.288837+0000","last_unstale":"2023-09-30T17:05:25.305406+0000","last_undegraded":"2023-09-30T17:05:25.305406+0000","last_fullsized":"2023-09-30T17:05:25.305406+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2809,"log_dups_size":0,"ondisk_log_size":2809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:00:48.822153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8281,"num_write_kb":39472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"59'5585","reported_seq":5654,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306010+0000","last_change":"2023-09-30T17:02:18.353938+0000","last_active":"2023-09-30T17:05:25.306010+0000","last_peered":"2023-09-30T17:05:25.306010+0000","last_clean":"2023-09-30T17:05:25.306010+0000","last_became_active":"2023-09-30T17:02:18.353632+0000","last_became_peered":"2023-09-30T17:02:18.353632+0000","last_unstale":"2023-09-30T17:05:25.306010+0000","last_undegraded":"2023-09-30T17:05:25.306010+0000","last_fullsized":"2023-09-30T17:05:25.306010+0000","mapping_epoch":17,"log_start":"42'1100","ondisk_log_start":"42'1100","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4485,"log_dups_size":1100,"ondisk_log_size":4485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:09:55.056098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16523,"num_write_kb":78256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"59'2888","reported_seq":2977,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.307020+0000","last_change":"2023-09-30T17:05:06.292945+0000","last_active":"2023-09-30T17:05:25.307020+0000","last_peered":"2023-09-30T17:05:25.307020+0000","last_clean":"2023-09-30T17:05:25.307020+0000","last_became_active":"2023-09-30T17:05:06.291346+0000","last_became_peered":"2023-09-30T17:05:06.291346+0000","last_unstale":"2023-09-30T17:05:25.307020+0000","last_undegraded":"2023-09-30T17:05:25.307020+0000","last_fullsized":"2023-09-30T17:05:25.307020+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2888,"log_dups_size":0,"ondisk_log_size":2888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:53:27.316963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8371,"num_write_kb":39716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"59'18","reported_seq":98,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306046+0000","last_change":"2023-09-30T17:05:03.309295+0000","last_active":"2023-09-30T17:05:25.306046+0000","last_peered":"2023-09-30T17:05:25.306046+0000","last_clean":"2023-09-30T17:05:25.306046+0000","last_became_active":"2023-09-30T17:05:03.308884+0000","last_became_peered":"2023-09-30T17:05:03.308884+0000","last_unstale":"2023-09-30T17:05:25.306046+0000","last_undegraded":"2023-09-30T17:05:25.306046+0000","last_fullsized":"2023-09-30T17:05:25.306046+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:57:45.449671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"59'2855","reported_seq":2923,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305902+0000","last_change":"2023-09-30T17:05:06.291369+0000","last_active":"2023-09-30T17:05:25.305902+0000","last_peered":"2023-09-30T17:05:25.305902+0000","last_clean":"2023-09-30T17:05:25.305902+0000","last_became_active":"2023-09-30T17:05:06.289447+0000","last_became_peered":"2023-09-30T17:05:06.289447+0000","last_unstale":"2023-09-30T17:05:25.305902+0000","last_undegraded":"2023-09-30T17:05:25.305902+0000","last_fullsized":"2023-09-30T17:05:25.305902+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2855,"log_dups_size":0,"ondisk_log_size":2855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:17:21.412392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8347,"num_write_kb":39608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":71,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306032+0000","last_change":"2023-09-30T17:02:17.358258+0000","last_active":"2023-09-30T17:05:25.306032+0000","last_peered":"2023-09-30T17:05:25.306032+0000","last_clean":"2023-09-30T17:05:25.306032+0000","last_became_active":"2023-09-30T17:02:17.357890+0000","last_became_peered":"2023-09-30T17:02:17.357890+0000","last_unstale":"2023-09-30T17:05:25.306032+0000","last_undegraded":"2023-09-30T17:05:25.306032+0000","last_fullsized":"2023-09-30T17:05:25.306032+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:52:56.591906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"59'17","reported_seq":97,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.307002+0000","last_change":"2023-09-30T17:05:03.307486+0000","last_active":"2023-09-30T17:05:25.307002+0000","last_peered":"2023-09-30T17:05:25.307002+0000","last_clean":"2023-09-30T17:05:25.307002+0000","last_became_active":"2023-09-30T17:05:03.307012+0000","last_became_peered":"2023-09-30T17:05:03.307012+0000","last_unstale":"2023-09-30T17:05:25.307002+0000","last_undegraded":"2023-09-30T17:05:25.307002+0000","last_fullsized":"2023-09-30T17:05:25.307002+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:05:29.995730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305433+0000","last_change":"2023-09-30T17:05:03.309164+0000","last_active":"2023-09-30T17:05:25.305433+0000","last_peered":"2023-09-30T17:05:25.305433+0000","last_clean":"2023-09-30T17:05:25.305433+0000","last_became_active":"2023-09-30T17:05:03.308073+0000","last_became_peered":"2023-09-30T17:05:03.308073+0000","last_unstale":"2023-09-30T17:05:25.305433+0000","last_undegraded":"2023-09-30T17:05:25.305433+0000","last_fullsized":"2023-09-30T17:05:25.305433+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:10:16.238053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"59'6","reported_seq":86,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306073+0000","last_change":"2023-09-30T17:05:03.308692+0000","last_active":"2023-09-30T17:05:25.306073+0000","last_peered":"2023-09-30T17:05:25.306073+0000","last_clean":"2023-09-30T17:05:25.306073+0000","last_became_active":"2023-09-30T17:05:03.307932+0000","last_became_peered":"2023-09-30T17:05:03.307932+0000","last_unstale":"2023-09-30T17:05:25.306073+0000","last_undegraded":"2023-09-30T17:05:25.306073+0000","last_fullsized":"2023-09-30T17:05:25.306073+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:17:13.668052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":70,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305661+0000","last_change":"2023-09-30T17:02:17.361000+0000","last_active":"2023-09-30T17:05:25.305661+0000","last_peered":"2023-09-30T17:05:25.305661+0000","last_clean":"2023-09-30T17:05:25.305661+0000","last_became_active":"2023-09-30T17:02:17.360601+0000","last_became_peered":"2023-09-30T17:02:17.360601+0000","last_unstale":"2023-09-30T17:05:25.305661+0000","last_undegraded":"2023-09-30T17:05:25.305661+0000","last_fullsized":"2023-09-30T17:05:25.305661+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:02:27.666526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"59'7","reported_seq":87,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306929+0000","last_change":"2023-09-30T17:05:03.305898+0000","last_active":"2023-09-30T17:05:25.306929+0000","last_peered":"2023-09-30T17:05:25.306929+0000","last_clean":"2023-09-30T17:05:25.306929+0000","last_became_active":"2023-09-30T17:05:03.305520+0000","last_became_peered":"2023-09-30T17:05:03.305520+0000","last_unstale":"2023-09-30T17:05:25.306929+0000","last_undegraded":"2023-09-30T17:05:25.306929+0000","last_fullsized":"2023-09-30T17:05:25.306929+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:40:09.276369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"58'1","reported_seq":82,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306258+0000","last_change":"2023-09-30T17:05:03.309303+0000","last_active":"2023-09-30T17:05:25.306258+0000","last_peered":"2023-09-30T17:05:25.306258+0000","last_clean":"2023-09-30T17:05:25.306258+0000","last_became_active":"2023-09-30T17:05:03.308851+0000","last_became_peered":"2023-09-30T17:05:03.308851+0000","last_unstale":"2023-09-30T17:05:25.306258+0000","last_undegraded":"2023-09-30T17:05:25.306258+0000","last_fullsized":"2023-09-30T17:05:25.306258+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:32:55.497287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"59'9","reported_seq":78,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305188+0000","last_change":"2023-09-30T17:02:18.358841+0000","last_active":"2023-09-30T17:05:25.305188+0000","last_peered":"2023-09-30T17:05:25.305188+0000","last_clean":"2023-09-30T17:05:25.305188+0000","last_became_active":"2023-09-30T17:02:18.358529+0000","last_became_peered":"2023-09-30T17:02:18.358529+0000","last_unstale":"2023-09-30T17:05:25.305188+0000","last_undegraded":"2023-09-30T17:05:25.305188+0000","last_fullsized":"2023-09-30T17:05:25.305188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:15:54.364571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305635+0000","last_change":"2023-09-30T17:05:03.309409+0000","last_active":"2023-09-30T17:05:25.305635+0000","last_peered":"2023-09-30T17:05:25.305635+0000","last_clean":"2023-09-30T17:05:25.305635+0000","last_became_active":"2023-09-30T17:05:03.309023+0000","last_became_peered":"2023-09-30T17:05:03.309023+0000","last_unstale":"2023-09-30T17:05:25.305635+0000","last_undegraded":"2023-09-30T17:05:25.305635+0000","last_fullsized":"2023-09-30T17:05:25.305635+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:57:05.463330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"59'8526","reported_seq":8618,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305529+0000","last_change":"2023-09-30T17:05:06.292415+0000","last_active":"2023-09-30T17:05:25.305529+0000","last_peered":"2023-09-30T17:05:25.305529+0000","last_clean":"2023-09-30T17:05:25.305529+0000","last_became_active":"2023-09-30T17:05:06.290551+0000","last_became_peered":"2023-09-30T17:05:06.290551+0000","last_unstale":"2023-09-30T17:05:25.305529+0000","last_undegraded":"2023-09-30T17:05:25.305529+0000","last_fullsized":"2023-09-30T17:05:25.305529+0000","mapping_epoch":69,"log_start":"49'4300","ondisk_log_start":"49'4300","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4226,"log_dups_size":4300,"ondisk_log_size":4226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:59:52.758548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24873,"num_write_kb":118472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"59'7","reported_seq":93,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306635+0000","last_change":"2023-09-30T17:05:03.310987+0000","last_active":"2023-09-30T17:05:25.306635+0000","last_peered":"2023-09-30T17:05:25.306635+0000","last_clean":"2023-09-30T17:05:25.306635+0000","last_became_active":"2023-09-30T17:05:03.306646+0000","last_became_peered":"2023-09-30T17:05:03.306646+0000","last_unstale":"2023-09-30T17:05:25.306635+0000","last_undegraded":"2023-09-30T17:05:25.306635+0000","last_fullsized":"2023-09-30T17:05:25.306635+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:24:52.247523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"59'5670","reported_seq":5739,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305419+0000","last_change":"2023-09-30T17:02:18.359118+0000","last_active":"2023-09-30T17:05:25.305419+0000","last_peered":"2023-09-30T17:05:25.305419+0000","last_clean":"2023-09-30T17:05:25.305419+0000","last_became_active":"2023-09-30T17:02:18.358786+0000","last_became_peered":"2023-09-30T17:02:18.358786+0000","last_unstale":"2023-09-30T17:05:25.305419+0000","last_undegraded":"2023-09-30T17:05:25.305419+0000","last_fullsized":"2023-09-30T17:05:25.305419+0000","mapping_epoch":17,"log_start":"44'1500","ondisk_log_start":"44'1500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4170,"log_dups_size":1500,"ondisk_log_size":4170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:33:21.723864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16627,"num_write_kb":79047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"60'78","reported_seq":49,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305537+0000","last_change":"2023-09-30T17:05:03.313916+0000","last_active":"2023-09-30T17:05:25.305537+0000","last_peered":"2023-09-30T17:05:25.305537+0000","last_clean":"2023-09-30T17:05:25.305537+0000","last_became_active":"2023-09-30T17:05:03.302516+0000","last_became_peered":"2023-09-30T17:05:03.302516+0000","last_unstale":"2023-09-30T17:05:25.305537+0000","last_undegraded":"2023-09-30T17:05:25.305537+0000","last_fullsized":"2023-09-30T17:05:25.305537+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:00:50.535715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227523,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":222729,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"59'5677","reported_seq":5756,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305603+0000","last_change":"2023-09-30T17:05:06.289965+0000","last_active":"2023-09-30T17:05:25.305603+0000","last_peered":"2023-09-30T17:05:25.305603+0000","last_clean":"2023-09-30T17:05:25.305603+0000","last_became_active":"2023-09-30T17:05:06.288155+0000","last_became_peered":"2023-09-30T17:05:06.288155+0000","last_unstale":"2023-09-30T17:05:25.305603+0000","last_undegraded":"2023-09-30T17:05:25.305603+0000","last_fullsized":"2023-09-30T17:05:25.305603+0000","mapping_epoch":69,"log_start":"42'1100","ondisk_log_start":"42'1100","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4577,"log_dups_size":1100,"ondisk_log_size":4577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:26:23.188915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16579,"num_write_kb":79104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305299+0000","last_change":"2023-09-30T17:05:03.310322+0000","last_active":"2023-09-30T17:05:25.305299+0000","last_peered":"2023-09-30T17:05:25.305299+0000","last_clean":"2023-09-30T17:05:25.305299+0000","last_became_active":"2023-09-30T17:05:03.309505+0000","last_became_peered":"2023-09-30T17:05:03.309505+0000","last_unstale":"2023-09-30T17:05:25.305299+0000","last_undegraded":"2023-09-30T17:05:25.305299+0000","last_fullsized":"2023-09-30T17:05:25.305299+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:13:16.014703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"59'2836","reported_seq":2905,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306395+0000","last_change":"2023-09-30T17:02:18.360019+0000","last_active":"2023-09-30T17:05:25.306395+0000","last_peered":"2023-09-30T17:05:25.306395+0000","last_clean":"2023-09-30T17:05:25.306395+0000","last_became_active":"2023-09-30T17:02:18.358364+0000","last_became_peered":"2023-09-30T17:02:18.358364+0000","last_unstale":"2023-09-30T17:05:25.306395+0000","last_undegraded":"2023-09-30T17:05:25.306395+0000","last_fullsized":"2023-09-30T17:05:25.306395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2836,"log_dups_size":0,"ondisk_log_size":2836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:30:43.782165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8308,"num_write_kb":39456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305535+0000","last_change":"2023-09-30T17:05:03.308853+0000","last_active":"2023-09-30T17:05:25.305535+0000","last_peered":"2023-09-30T17:05:25.305535+0000","last_clean":"2023-09-30T17:05:25.305535+0000","last_became_active":"2023-09-30T17:05:03.308377+0000","last_became_peered":"2023-09-30T17:05:03.308377+0000","last_unstale":"2023-09-30T17:05:25.305535+0000","last_undegraded":"2023-09-30T17:05:25.305535+0000","last_fullsized":"2023-09-30T17:05:25.305535+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:18:42.448826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"59'2856","reported_seq":2925,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306869+0000","last_change":"2023-09-30T17:02:18.362415+0000","last_active":"2023-09-30T17:05:25.306869+0000","last_peered":"2023-09-30T17:05:25.306869+0000","last_clean":"2023-09-30T17:05:25.306869+0000","last_became_active":"2023-09-30T17:02:18.361556+0000","last_became_peered":"2023-09-30T17:02:18.361556+0000","last_unstale":"2023-09-30T17:05:25.306869+0000","last_undegraded":"2023-09-30T17:05:25.306869+0000","last_fullsized":"2023-09-30T17:05:25.306869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2856,"log_dups_size":0,"ondisk_log_size":2856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:16:41.607547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8321,"num_write_kb":39600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306039+0000","last_change":"2023-09-30T17:05:03.304220+0000","last_active":"2023-09-30T17:05:25.306039+0000","last_peered":"2023-09-30T17:05:25.306039+0000","last_clean":"2023-09-30T17:05:25.306039+0000","last_became_active":"2023-09-30T17:05:03.303598+0000","last_became_peered":"2023-09-30T17:05:03.303598+0000","last_unstale":"2023-09-30T17:05:25.306039+0000","last_undegraded":"2023-09-30T17:05:25.306039+0000","last_fullsized":"2023-09-30T17:05:25.306039+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:57:44.444041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"59'12","reported_seq":92,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306163+0000","last_change":"2023-09-30T17:05:03.313214+0000","last_active":"2023-09-30T17:05:25.306163+0000","last_peered":"2023-09-30T17:05:25.306163+0000","last_clean":"2023-09-30T17:05:25.306163+0000","last_became_active":"2023-09-30T17:05:03.312888+0000","last_became_peered":"2023-09-30T17:05:03.312888+0000","last_unstale":"2023-09-30T17:05:25.306163+0000","last_undegraded":"2023-09-30T17:05:25.306163+0000","last_fullsized":"2023-09-30T17:05:25.306163+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:40:09.276369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"59'9","reported_seq":35,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305075+0000","last_change":"2023-09-30T17:05:03.304503+0000","last_active":"2023-09-30T17:05:25.305075+0000","last_peered":"2023-09-30T17:05:25.305075+0000","last_clean":"2023-09-30T17:05:25.305075+0000","last_became_active":"2023-09-30T17:05:03.304030+0000","last_became_peered":"2023-09-30T17:05:03.304030+0000","last_unstale":"2023-09-30T17:05:25.305075+0000","last_undegraded":"2023-09-30T17:05:25.305075+0000","last_fullsized":"2023-09-30T17:05:25.305075+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:08:35.110114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"59'2892","reported_seq":2981,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306333+0000","last_change":"2023-09-30T17:05:06.290230+0000","last_active":"2023-09-30T17:05:25.306333+0000","last_peered":"2023-09-30T17:05:25.306333+0000","last_clean":"2023-09-30T17:05:25.306333+0000","last_became_active":"2023-09-30T17:05:06.288725+0000","last_became_peered":"2023-09-30T17:05:06.288725+0000","last_unstale":"2023-09-30T17:05:25.306333+0000","last_undegraded":"2023-09-30T17:05:25.306333+0000","last_fullsized":"2023-09-30T17:05:25.306333+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2892,"log_dups_size":0,"ondisk_log_size":2892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:27:28.611647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8345,"num_write_kb":39712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305902+0000","last_change":"2023-09-30T17:05:03.304339+0000","last_active":"2023-09-30T17:05:25.305902+0000","last_peered":"2023-09-30T17:05:25.305902+0000","last_clean":"2023-09-30T17:05:25.305902+0000","last_became_active":"2023-09-30T17:05:03.303179+0000","last_became_peered":"2023-09-30T17:05:03.303179+0000","last_unstale":"2023-09-30T17:05:25.305902+0000","last_undegraded":"2023-09-30T17:05:25.305902+0000","last_fullsized":"2023-09-30T17:05:25.305902+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:44:20.765682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"59'2861","reported_seq":2950,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305648+0000","last_change":"2023-09-30T17:05:06.290324+0000","last_active":"2023-09-30T17:05:25.305648+0000","last_peered":"2023-09-30T17:05:25.305648+0000","last_clean":"2023-09-30T17:05:25.305648+0000","last_became_active":"2023-09-30T17:05:06.288824+0000","last_became_peered":"2023-09-30T17:05:06.288824+0000","last_unstale":"2023-09-30T17:05:25.305648+0000","last_undegraded":"2023-09-30T17:05:25.305648+0000","last_fullsized":"2023-09-30T17:05:25.305648+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2861,"log_dups_size":0,"ondisk_log_size":2861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:51:16.138021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8384,"num_write_kb":39788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":83,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306641+0000","last_change":"2023-09-30T17:05:03.304232+0000","last_active":"2023-09-30T17:05:25.306641+0000","last_peered":"2023-09-30T17:05:25.306641+0000","last_clean":"2023-09-30T17:05:25.306641+0000","last_became_active":"2023-09-30T17:05:03.303874+0000","last_became_peered":"2023-09-30T17:05:03.303874+0000","last_unstale":"2023-09-30T17:05:25.306641+0000","last_undegraded":"2023-09-30T17:05:25.306641+0000","last_fullsized":"2023-09-30T17:05:25.306641+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:39:49.644290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"59'2","reported_seq":71,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306324+0000","last_change":"2023-09-30T17:02:18.359767+0000","last_active":"2023-09-30T17:05:25.306324+0000","last_peered":"2023-09-30T17:05:25.306324+0000","last_clean":"2023-09-30T17:05:25.306324+0000","last_became_active":"2023-09-30T17:02:18.356825+0000","last_became_peered":"2023-09-30T17:02:18.356825+0000","last_unstale":"2023-09-30T17:05:25.306324+0000","last_undegraded":"2023-09-30T17:05:25.306324+0000","last_fullsized":"2023-09-30T17:05:25.306324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:39:16.689300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305494+0000","last_change":"2023-09-30T17:05:03.305087+0000","last_active":"2023-09-30T17:05:25.305494+0000","last_peered":"2023-09-30T17:05:25.305494+0000","last_clean":"2023-09-30T17:05:25.305494+0000","last_became_active":"2023-09-30T17:05:03.304463+0000","last_became_peered":"2023-09-30T17:05:03.304463+0000","last_unstale":"2023-09-30T17:05:25.305494+0000","last_undegraded":"2023-09-30T17:05:25.305494+0000","last_fullsized":"2023-09-30T17:05:25.305494+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:33:20.829898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"59'2835","reported_seq":2903,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305096+0000","last_change":"2023-09-30T17:05:06.289598+0000","last_active":"2023-09-30T17:05:25.305096+0000","last_peered":"2023-09-30T17:05:25.305096+0000","last_clean":"2023-09-30T17:05:25.305096+0000","last_became_active":"2023-09-30T17:05:06.288712+0000","last_became_peered":"2023-09-30T17:05:06.288712+0000","last_unstale":"2023-09-30T17:05:25.305096+0000","last_undegraded":"2023-09-30T17:05:25.305096+0000","last_fullsized":"2023-09-30T17:05:25.305096+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2835,"log_dups_size":0,"ondisk_log_size":2835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:01:17.676791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8288,"num_write_kb":39388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305636+0000","last_change":"2023-09-30T17:05:03.311500+0000","last_active":"2023-09-30T17:05:25.305636+0000","last_peered":"2023-09-30T17:05:25.305636+0000","last_clean":"2023-09-30T17:05:25.305636+0000","last_became_active":"2023-09-30T17:05:03.310836+0000","last_became_peered":"2023-09-30T17:05:03.310836+0000","last_unstale":"2023-09-30T17:05:25.305636+0000","last_undegraded":"2023-09-30T17:05:25.305636+0000","last_fullsized":"2023-09-30T17:05:25.305636+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:30:09.762284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"59'8","reported_seq":88,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305917+0000","last_change":"2023-09-30T17:05:03.308917+0000","last_active":"2023-09-30T17:05:25.305917+0000","last_peered":"2023-09-30T17:05:25.305917+0000","last_clean":"2023-09-30T17:05:25.305917+0000","last_became_active":"2023-09-30T17:05:03.308214+0000","last_became_peered":"2023-09-30T17:05:03.308214+0000","last_unstale":"2023-09-30T17:05:25.305917+0000","last_undegraded":"2023-09-30T17:05:25.305917+0000","last_fullsized":"2023-09-30T17:05:25.305917+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:39:50.649920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"58'3","reported_seq":85,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305666+0000","last_change":"2023-09-30T17:05:03.308944+0000","last_active":"2023-09-30T17:05:25.305666+0000","last_peered":"2023-09-30T17:05:25.305666+0000","last_clean":"2023-09-30T17:05:25.305666+0000","last_became_active":"2023-09-30T17:05:03.308483+0000","last_became_peered":"2023-09-30T17:05:03.308483+0000","last_unstale":"2023-09-30T17:05:25.305666+0000","last_undegraded":"2023-09-30T17:05:25.305666+0000","last_fullsized":"2023-09-30T17:05:25.305666+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:43:27.633747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"59'2846","reported_seq":2913,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305422+0000","last_change":"2023-09-30T17:05:06.290255+0000","last_active":"2023-09-30T17:05:25.305422+0000","last_peered":"2023-09-30T17:05:25.305422+0000","last_clean":"2023-09-30T17:05:25.305422+0000","last_became_active":"2023-09-30T17:05:06.289225+0000","last_became_peered":"2023-09-30T17:05:06.289225+0000","last_unstale":"2023-09-30T17:05:25.305422+0000","last_undegraded":"2023-09-30T17:05:25.305422+0000","last_fullsized":"2023-09-30T17:05:25.305422+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2846,"log_dups_size":0,"ondisk_log_size":2846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:41:31.424933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8199,"num_write_kb":39160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.304959+0000","last_change":"2023-09-30T17:05:03.309689+0000","last_active":"2023-09-30T17:05:25.304959+0000","last_peered":"2023-09-30T17:05:25.304959+0000","last_clean":"2023-09-30T17:05:25.304959+0000","last_became_active":"2023-09-30T17:05:03.309318+0000","last_became_peered":"2023-09-30T17:05:03.309318+0000","last_unstale":"2023-09-30T17:05:25.304959+0000","last_undegraded":"2023-09-30T17:05:25.304959+0000","last_fullsized":"2023-09-30T17:05:25.304959+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:12:37.857480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"59'2831","reported_seq":2898,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305893+0000","last_change":"2023-09-30T17:05:06.289189+0000","last_active":"2023-09-30T17:05:25.305893+0000","last_peered":"2023-09-30T17:05:25.305893+0000","last_clean":"2023-09-30T17:05:25.305893+0000","last_became_active":"2023-09-30T17:05:06.288348+0000","last_became_peered":"2023-09-30T17:05:06.288348+0000","last_unstale":"2023-09-30T17:05:25.305893+0000","last_undegraded":"2023-09-30T17:05:25.305893+0000","last_fullsized":"2023-09-30T17:05:25.305893+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2831,"log_dups_size":0,"ondisk_log_size":2831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:51:59.540252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8336,"num_write_kb":39484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305792+0000","last_change":"2023-09-30T17:05:03.304019+0000","last_active":"2023-09-30T17:05:25.305792+0000","last_peered":"2023-09-30T17:05:25.305792+0000","last_clean":"2023-09-30T17:05:25.305792+0000","last_became_active":"2023-09-30T17:05:03.303473+0000","last_became_peered":"2023-09-30T17:05:03.303473+0000","last_unstale":"2023-09-30T17:05:25.305792+0000","last_undegraded":"2023-09-30T17:05:25.305792+0000","last_fullsized":"2023-09-30T17:05:25.305792+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:10:16.238053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"59'2884","reported_seq":2951,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306051+0000","last_change":"2023-09-30T17:05:06.289446+0000","last_active":"2023-09-30T17:05:25.306051+0000","last_peered":"2023-09-30T17:05:25.306051+0000","last_clean":"2023-09-30T17:05:25.306051+0000","last_became_active":"2023-09-30T17:05:06.288169+0000","last_became_peered":"2023-09-30T17:05:06.288169+0000","last_unstale":"2023-09-30T17:05:25.306051+0000","last_undegraded":"2023-09-30T17:05:25.306051+0000","last_fullsized":"2023-09-30T17:05:25.306051+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2884,"log_dups_size":0,"ondisk_log_size":2884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:15:23.507816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8366,"num_write_kb":39744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":70,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305775+0000","last_change":"2023-09-30T17:02:17.358811+0000","last_active":"2023-09-30T17:05:25.305775+0000","last_peered":"2023-09-30T17:05:25.305775+0000","last_clean":"2023-09-30T17:05:25.305775+0000","last_became_active":"2023-09-30T17:02:17.358582+0000","last_became_peered":"2023-09-30T17:02:17.358582+0000","last_unstale":"2023-09-30T17:05:25.305775+0000","last_undegraded":"2023-09-30T17:05:25.305775+0000","last_fullsized":"2023-09-30T17:05:25.305775+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:52:37.518693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"59'8580","reported_seq":8649,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306158+0000","last_change":"2023-09-30T17:02:18.364478+0000","last_active":"2023-09-30T17:05:25.306158+0000","last_peered":"2023-09-30T17:05:25.306158+0000","last_clean":"2023-09-30T17:05:25.306158+0000","last_became_active":"2023-09-30T17:02:18.364057+0000","last_became_peered":"2023-09-30T17:02:18.364057+0000","last_unstale":"2023-09-30T17:05:25.306158+0000","last_undegraded":"2023-09-30T17:05:25.306158+0000","last_fullsized":"2023-09-30T17:05:25.306158+0000","mapping_epoch":17,"log_start":"49'4400","ondisk_log_start":"49'4400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4180,"log_dups_size":4400,"ondisk_log_size":4180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:13:55.555700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25046,"num_write_kb":118972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305797+0000","last_change":"2023-09-30T17:02:12.327704+0000","last_active":"2023-09-30T17:05:25.305797+0000","last_peered":"2023-09-30T17:05:25.305797+0000","last_clean":"2023-09-30T17:05:25.305797+0000","last_became_active":"2023-09-30T17:02:12.327384+0000","last_became_peered":"2023-09-30T17:02:12.327384+0000","last_unstale":"2023-09-30T17:05:25.305797+0000","last_undegraded":"2023-09-30T17:05:25.305797+0000","last_fullsized":"2023-09-30T17:05:25.305797+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:09:34.818252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306075+0000","last_change":"2023-09-30T17:05:03.311271+0000","last_active":"2023-09-30T17:05:25.306075+0000","last_peered":"2023-09-30T17:05:25.306075+0000","last_clean":"2023-09-30T17:05:25.306075+0000","last_became_active":"2023-09-30T17:05:03.310655+0000","last_became_peered":"2023-09-30T17:05:03.310655+0000","last_unstale":"2023-09-30T17:05:25.306075+0000","last_undegraded":"2023-09-30T17:05:25.306075+0000","last_fullsized":"2023-09-30T17:05:25.306075+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:49:35.748952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"59'9","reported_seq":89,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306198+0000","last_change":"2023-09-30T17:05:03.306223+0000","last_active":"2023-09-30T17:05:25.306198+0000","last_peered":"2023-09-30T17:05:25.306198+0000","last_clean":"2023-09-30T17:05:25.306198+0000","last_became_active":"2023-09-30T17:05:03.305956+0000","last_became_peered":"2023-09-30T17:05:03.305956+0000","last_unstale":"2023-09-30T17:05:25.306198+0000","last_undegraded":"2023-09-30T17:05:25.306198+0000","last_fullsized":"2023-09-30T17:05:25.306198+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:32:56.502917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.304959+0000","last_change":"2023-09-30T17:05:03.309359+0000","last_active":"2023-09-30T17:05:25.304959+0000","last_peered":"2023-09-30T17:05:25.304959+0000","last_clean":"2023-09-30T17:05:25.304959+0000","last_became_active":"2023-09-30T17:05:03.308944+0000","last_became_peered":"2023-09-30T17:05:03.308944+0000","last_unstale":"2023-09-30T17:05:25.304959+0000","last_undegraded":"2023-09-30T17:05:25.304959+0000","last_fullsized":"2023-09-30T17:05:25.304959+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:02:58.156693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305781+0000","last_change":"2023-09-30T17:05:03.311106+0000","last_active":"2023-09-30T17:05:25.305781+0000","last_peered":"2023-09-30T17:05:25.305781+0000","last_clean":"2023-09-30T17:05:25.305781+0000","last_became_active":"2023-09-30T17:05:03.310706+0000","last_became_peered":"2023-09-30T17:05:03.310706+0000","last_unstale":"2023-09-30T17:05:25.305781+0000","last_undegraded":"2023-09-30T17:05:25.305781+0000","last_fullsized":"2023-09-30T17:05:25.305781+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:04:03.231664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"59'9","reported_seq":78,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305690+0000","last_change":"2023-09-30T17:02:18.363399+0000","last_active":"2023-09-30T17:05:25.305690+0000","last_peered":"2023-09-30T17:05:25.305690+0000","last_clean":"2023-09-30T17:05:25.305690+0000","last_became_active":"2023-09-30T17:02:18.363064+0000","last_became_peered":"2023-09-30T17:02:18.363064+0000","last_unstale":"2023-09-30T17:05:25.305690+0000","last_undegraded":"2023-09-30T17:05:25.305690+0000","last_fullsized":"2023-09-30T17:05:25.305690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:32:34.654264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305329+0000","last_change":"2023-09-30T17:02:12.327834+0000","last_active":"2023-09-30T17:05:25.305329+0000","last_peered":"2023-09-30T17:05:25.305329+0000","last_clean":"2023-09-30T17:05:25.305329+0000","last_became_active":"2023-09-30T17:02:12.327542+0000","last_became_peered":"2023-09-30T17:02:12.327542+0000","last_unstale":"2023-09-30T17:05:25.305329+0000","last_undegraded":"2023-09-30T17:05:25.305329+0000","last_fullsized":"2023-09-30T17:05:25.305329+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:49:54.890769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305806+0000","last_change":"2023-09-30T17:05:03.305668+0000","last_active":"2023-09-30T17:05:25.305806+0000","last_peered":"2023-09-30T17:05:25.305806+0000","last_clean":"2023-09-30T17:05:25.305806+0000","last_became_active":"2023-09-30T17:05:03.305222+0000","last_became_peered":"2023-09-30T17:05:03.305222+0000","last_unstale":"2023-09-30T17:05:25.305806+0000","last_undegraded":"2023-09-30T17:05:25.305806+0000","last_fullsized":"2023-09-30T17:05:25.305806+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:17:12.662422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"59'6","reported_seq":75,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306348+0000","last_change":"2023-09-30T17:02:18.364406+0000","last_active":"2023-09-30T17:05:25.306348+0000","last_peered":"2023-09-30T17:05:25.306348+0000","last_clean":"2023-09-30T17:05:25.306348+0000","last_became_active":"2023-09-30T17:02:18.363849+0000","last_became_peered":"2023-09-30T17:02:18.363849+0000","last_unstale":"2023-09-30T17:05:25.306348+0000","last_undegraded":"2023-09-30T17:05:25.306348+0000","last_fullsized":"2023-09-30T17:05:25.306348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:43:29.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305302+0000","last_change":"2023-09-30T17:05:03.310062+0000","last_active":"2023-09-30T17:05:25.305302+0000","last_peered":"2023-09-30T17:05:25.305302+0000","last_clean":"2023-09-30T17:05:25.305302+0000","last_became_active":"2023-09-30T17:05:03.308958+0000","last_became_peered":"2023-09-30T17:05:03.308958+0000","last_unstale":"2023-09-30T17:05:25.305302+0000","last_undegraded":"2023-09-30T17:05:25.305302+0000","last_fullsized":"2023-09-30T17:05:25.305302+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:05:26.347633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":225,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.304940+0000","last_change":"2023-09-30T17:05:03.303046+0000","last_active":"2023-09-30T17:05:25.304940+0000","last_peered":"2023-09-30T17:05:25.304940+0000","last_clean":"2023-09-30T17:05:25.304940+0000","last_became_active":"2023-09-30T17:05:03.302265+0000","last_became_peered":"2023-09-30T17:05:03.302265+0000","last_unstale":"2023-09-30T17:05:25.304940+0000","last_undegraded":"2023-09-30T17:05:25.304940+0000","last_fullsized":"2023-09-30T17:05:25.304940+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:06.295501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:06.295501+0000","last_clean_scrub_stamp":"2023-09-30T17:02:06.295501+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:07:24.603358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":70,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305369+0000","last_change":"2023-09-30T17:02:17.357139+0000","last_active":"2023-09-30T17:05:25.305369+0000","last_peered":"2023-09-30T17:05:25.305369+0000","last_clean":"2023-09-30T17:05:25.305369+0000","last_became_active":"2023-09-30T17:02:17.356901+0000","last_became_peered":"2023-09-30T17:02:17.356901+0000","last_unstale":"2023-09-30T17:05:25.305369+0000","last_undegraded":"2023-09-30T17:05:25.305369+0000","last_fullsized":"2023-09-30T17:05:25.305369+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:22:35.747671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"59'7","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305738+0000","last_change":"2023-09-30T17:05:03.305199+0000","last_active":"2023-09-30T17:05:25.305738+0000","last_peered":"2023-09-30T17:05:25.305738+0000","last_clean":"2023-09-30T17:05:25.305738+0000","last_became_active":"2023-09-30T17:05:03.304974+0000","last_became_peered":"2023-09-30T17:05:03.304974+0000","last_unstale":"2023-09-30T17:05:25.305738+0000","last_undegraded":"2023-09-30T17:05:25.305738+0000","last_fullsized":"2023-09-30T17:05:25.305738+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:03:27.429545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305080+0000","last_change":"2023-09-30T17:05:03.303739+0000","last_active":"2023-09-30T17:05:25.305080+0000","last_peered":"2023-09-30T17:05:25.305080+0000","last_clean":"2023-09-30T17:05:25.305080+0000","last_became_active":"2023-09-30T17:05:03.302590+0000","last_became_peered":"2023-09-30T17:05:03.302590+0000","last_unstale":"2023-09-30T17:05:25.305080+0000","last_undegraded":"2023-09-30T17:05:25.305080+0000","last_fullsized":"2023-09-30T17:05:25.305080+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:51:30.199616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"59'5","reported_seq":94,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305237+0000","last_change":"2023-09-30T17:05:03.318439+0000","last_active":"2023-09-30T17:05:25.305237+0000","last_peered":"2023-09-30T17:05:25.305237+0000","last_clean":"2023-09-30T17:05:25.305237+0000","last_became_active":"2023-09-30T17:05:03.308059+0000","last_became_peered":"2023-09-30T17:05:03.308059+0000","last_unstale":"2023-09-30T17:05:25.305237+0000","last_undegraded":"2023-09-30T17:05:25.305237+0000","last_fullsized":"2023-09-30T17:05:25.305237+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:16:25.170638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"59'11252","reported_seq":11321,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306870+0000","last_change":"2023-09-30T17:02:18.360029+0000","last_active":"2023-09-30T17:05:25.306870+0000","last_peered":"2023-09-30T17:05:25.306870+0000","last_clean":"2023-09-30T17:05:25.306870+0000","last_became_active":"2023-09-30T17:02:18.356839+0000","last_became_peered":"2023-09-30T17:02:18.356839+0000","last_unstale":"2023-09-30T17:05:25.306870+0000","last_undegraded":"2023-09-30T17:05:25.306870+0000","last_fullsized":"2023-09-30T17:05:25.306870+0000","mapping_epoch":17,"log_start":"51'6700","ondisk_log_start":"51'6700","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4552,"log_dups_size":6700,"ondisk_log_size":4552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:16:27.516884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33068,"num_write_kb":157144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":73,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306724+0000","last_change":"2023-09-30T17:02:12.330472+0000","last_active":"2023-09-30T17:05:25.306724+0000","last_peered":"2023-09-30T17:05:25.306724+0000","last_clean":"2023-09-30T17:05:25.306724+0000","last_became_active":"2023-09-30T17:02:12.330154+0000","last_became_peered":"2023-09-30T17:02:12.330154+0000","last_unstale":"2023-09-30T17:05:25.306724+0000","last_undegraded":"2023-09-30T17:05:25.306724+0000","last_fullsized":"2023-09-30T17:05:25.306724+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:43:23.161734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":70,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305996+0000","last_change":"2023-09-30T17:02:17.361007+0000","last_active":"2023-09-30T17:05:25.305996+0000","last_peered":"2023-09-30T17:05:25.305996+0000","last_clean":"2023-09-30T17:05:25.305996+0000","last_became_active":"2023-09-30T17:02:17.360721+0000","last_became_peered":"2023-09-30T17:02:17.360721+0000","last_unstale":"2023-09-30T17:05:25.305996+0000","last_undegraded":"2023-09-30T17:05:25.305996+0000","last_fullsized":"2023-09-30T17:05:25.305996+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:13:41.205152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"59'2836","reported_seq":2925,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306557+0000","last_change":"2023-09-30T17:05:06.293085+0000","last_active":"2023-09-30T17:05:25.306557+0000","last_peered":"2023-09-30T17:05:25.306557+0000","last_clean":"2023-09-30T17:05:25.306557+0000","last_became_active":"2023-09-30T17:05:06.291203+0000","last_became_peered":"2023-09-30T17:05:06.291203+0000","last_unstale":"2023-09-30T17:05:25.306557+0000","last_undegraded":"2023-09-30T17:05:25.306557+0000","last_fullsized":"2023-09-30T17:05:25.306557+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2836,"log_dups_size":0,"ondisk_log_size":2836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:11:28.091818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8199,"num_write_kb":39048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"59'3","reported_seq":73,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306165+0000","last_change":"2023-09-30T17:02:17.360831+0000","last_active":"2023-09-30T17:05:25.306165+0000","last_peered":"2023-09-30T17:05:25.306165+0000","last_clean":"2023-09-30T17:05:25.306165+0000","last_became_active":"2023-09-30T17:02:17.360494+0000","last_became_peered":"2023-09-30T17:02:17.360494+0000","last_unstale":"2023-09-30T17:05:25.306165+0000","last_undegraded":"2023-09-30T17:05:25.306165+0000","last_fullsized":"2023-09-30T17:05:25.306165+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:24:04.564387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306251+0000","last_change":"2023-09-30T17:02:12.328184+0000","last_active":"2023-09-30T17:05:25.306251+0000","last_peered":"2023-09-30T17:05:25.306251+0000","last_clean":"2023-09-30T17:05:25.306251+0000","last_became_active":"2023-09-30T17:02:12.327898+0000","last_became_peered":"2023-09-30T17:02:12.327898+0000","last_unstale":"2023-09-30T17:05:25.306251+0000","last_undegraded":"2023-09-30T17:05:25.306251+0000","last_fullsized":"2023-09-30T17:05:25.306251+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:43:23.161734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"59'8","reported_seq":88,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305121+0000","last_change":"2023-09-30T17:05:03.308856+0000","last_active":"2023-09-30T17:05:25.305121+0000","last_peered":"2023-09-30T17:05:25.305121+0000","last_clean":"2023-09-30T17:05:25.305121+0000","last_became_active":"2023-09-30T17:05:03.308429+0000","last_became_peered":"2023-09-30T17:05:03.308429+0000","last_unstale":"2023-09-30T17:05:25.305121+0000","last_undegraded":"2023-09-30T17:05:25.305121+0000","last_fullsized":"2023-09-30T17:05:25.305121+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:49:32.189339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305749+0000","last_change":"2023-09-30T17:05:03.304353+0000","last_active":"2023-09-30T17:05:25.305749+0000","last_peered":"2023-09-30T17:05:25.305749+0000","last_clean":"2023-09-30T17:05:25.305749+0000","last_became_active":"2023-09-30T17:05:03.302503+0000","last_became_peered":"2023-09-30T17:05:03.302503+0000","last_unstale":"2023-09-30T17:05:25.305749+0000","last_undegraded":"2023-09-30T17:05:25.305749+0000","last_fullsized":"2023-09-30T17:05:25.305749+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:19:16.151598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"60'8","reported_seq":94,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306144+0000","last_change":"2023-09-30T17:05:03.314806+0000","last_active":"2023-09-30T17:05:25.306144+0000","last_peered":"2023-09-30T17:05:25.306144+0000","last_clean":"2023-09-30T17:05:25.306144+0000","last_became_active":"2023-09-30T17:05:03.308201+0000","last_became_peered":"2023-09-30T17:05:03.308201+0000","last_unstale":"2023-09-30T17:05:25.306144+0000","last_undegraded":"2023-09-30T17:05:25.306144+0000","last_fullsized":"2023-09-30T17:05:25.306144+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:19:18.486570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"59'6","reported_seq":86,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306035+0000","last_change":"2023-09-30T17:05:03.304265+0000","last_active":"2023-09-30T17:05:25.306035+0000","last_peered":"2023-09-30T17:05:25.306035+0000","last_clean":"2023-09-30T17:05:25.306035+0000","last_became_active":"2023-09-30T17:05:03.304022+0000","last_became_peered":"2023-09-30T17:05:03.304022+0000","last_unstale":"2023-09-30T17:05:25.306035+0000","last_undegraded":"2023-09-30T17:05:25.306035+0000","last_fullsized":"2023-09-30T17:05:25.306035+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:19:19.492200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":82,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306295+0000","last_change":"2023-09-30T17:05:03.303927+0000","last_active":"2023-09-30T17:05:25.306295+0000","last_peered":"2023-09-30T17:05:25.306295+0000","last_clean":"2023-09-30T17:05:25.306295+0000","last_became_active":"2023-09-30T17:05:03.303487+0000","last_became_peered":"2023-09-30T17:05:03.303487+0000","last_unstale":"2023-09-30T17:05:25.306295+0000","last_undegraded":"2023-09-30T17:05:25.306295+0000","last_fullsized":"2023-09-30T17:05:25.306295+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:43:27.633747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"59'2835","reported_seq":2904,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306514+0000","last_change":"2023-09-30T17:02:18.358269+0000","last_active":"2023-09-30T17:05:25.306514+0000","last_peered":"2023-09-30T17:05:25.306514+0000","last_clean":"2023-09-30T17:05:25.306514+0000","last_became_active":"2023-09-30T17:02:18.356902+0000","last_became_peered":"2023-09-30T17:02:18.356902+0000","last_unstale":"2023-09-30T17:05:25.306514+0000","last_undegraded":"2023-09-30T17:05:25.306514+0000","last_fullsized":"2023-09-30T17:05:25.306514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2835,"log_dups_size":0,"ondisk_log_size":2835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:39:28.022201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8302,"num_write_kb":39500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305740+0000","last_change":"2023-09-30T17:05:03.311401+0000","last_active":"2023-09-30T17:05:25.305740+0000","last_peered":"2023-09-30T17:05:25.305740+0000","last_clean":"2023-09-30T17:05:25.305740+0000","last_became_active":"2023-09-30T17:05:03.310996+0000","last_became_peered":"2023-09-30T17:05:03.310996+0000","last_unstale":"2023-09-30T17:05:25.305740+0000","last_undegraded":"2023-09-30T17:05:25.305740+0000","last_fullsized":"2023-09-30T17:05:25.305740+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:28:19.097868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"59'2848","reported_seq":2915,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305483+0000","last_change":"2023-09-30T17:05:06.290662+0000","last_active":"2023-09-30T17:05:25.305483+0000","last_peered":"2023-09-30T17:05:25.305483+0000","last_clean":"2023-09-30T17:05:25.305483+0000","last_became_active":"2023-09-30T17:05:06.289599+0000","last_became_peered":"2023-09-30T17:05:06.289599+0000","last_unstale":"2023-09-30T17:05:25.305483+0000","last_undegraded":"2023-09-30T17:05:25.305483+0000","last_fullsized":"2023-09-30T17:05:25.305483+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2848,"log_dups_size":0,"ondisk_log_size":2848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:20:28.670256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8235,"num_write_kb":39276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"58'3","reported_seq":85,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306879+0000","last_change":"2023-09-30T17:05:03.307212+0000","last_active":"2023-09-30T17:05:25.306879+0000","last_peered":"2023-09-30T17:05:25.306879+0000","last_clean":"2023-09-30T17:05:25.306879+0000","last_became_active":"2023-09-30T17:05:03.306711+0000","last_became_peered":"2023-09-30T17:05:03.306711+0000","last_unstale":"2023-09-30T17:05:25.306879+0000","last_undegraded":"2023-09-30T17:05:25.306879+0000","last_fullsized":"2023-09-30T17:05:25.306879+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:11:56.900744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"59'10","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305401+0000","last_change":"2023-09-30T17:05:03.311669+0000","last_active":"2023-09-30T17:05:25.305401+0000","last_peered":"2023-09-30T17:05:25.305401+0000","last_clean":"2023-09-30T17:05:25.305401+0000","last_became_active":"2023-09-30T17:05:03.310763+0000","last_became_peered":"2023-09-30T17:05:03.310763+0000","last_unstale":"2023-09-30T17:05:25.305401+0000","last_undegraded":"2023-09-30T17:05:25.305401+0000","last_fullsized":"2023-09-30T17:05:25.305401+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:36:53.333402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":71,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306260+0000","last_change":"2023-09-30T17:02:17.360802+0000","last_active":"2023-09-30T17:05:25.306260+0000","last_peered":"2023-09-30T17:05:25.306260+0000","last_clean":"2023-09-30T17:05:25.306260+0000","last_became_active":"2023-09-30T17:02:17.360475+0000","last_became_peered":"2023-09-30T17:02:17.360475+0000","last_unstale":"2023-09-30T17:05:25.306260+0000","last_undegraded":"2023-09-30T17:05:25.306260+0000","last_fullsized":"2023-09-30T17:05:25.306260+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:50:18.455188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"59'5711","reported_seq":5780,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306268+0000","last_change":"2023-09-30T17:02:18.359857+0000","last_active":"2023-09-30T17:05:25.306268+0000","last_peered":"2023-09-30T17:05:25.306268+0000","last_clean":"2023-09-30T17:05:25.306268+0000","last_became_active":"2023-09-30T17:02:18.357098+0000","last_became_peered":"2023-09-30T17:02:18.357098+0000","last_unstale":"2023-09-30T17:05:25.306268+0000","last_undegraded":"2023-09-30T17:05:25.306268+0000","last_fullsized":"2023-09-30T17:05:25.306268+0000","mapping_epoch":17,"log_start":"42'1200","ondisk_log_start":"42'1200","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4511,"log_dups_size":1200,"ondisk_log_size":4511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:48:17.598726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16681,"num_write_kb":79476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":85,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306263+0000","last_change":"2023-09-30T17:05:03.313345+0000","last_active":"2023-09-30T17:05:25.306263+0000","last_peered":"2023-09-30T17:05:25.306263+0000","last_clean":"2023-09-30T17:05:25.306263+0000","last_became_active":"2023-09-30T17:05:03.313050+0000","last_became_peered":"2023-09-30T17:05:03.313050+0000","last_unstale":"2023-09-30T17:05:25.306263+0000","last_undegraded":"2023-09-30T17:05:25.306263+0000","last_fullsized":"2023-09-30T17:05:25.306263+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:24:52.247523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"59'2872","reported_seq":2939,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305196+0000","last_change":"2023-09-30T17:05:06.290298+0000","last_active":"2023-09-30T17:05:25.305196+0000","last_peered":"2023-09-30T17:05:25.305196+0000","last_clean":"2023-09-30T17:05:25.305196+0000","last_became_active":"2023-09-30T17:05:06.289197+0000","last_became_peered":"2023-09-30T17:05:06.289197+0000","last_unstale":"2023-09-30T17:05:25.305196+0000","last_undegraded":"2023-09-30T17:05:25.305196+0000","last_fullsized":"2023-09-30T17:05:25.305196+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2872,"log_dups_size":0,"ondisk_log_size":2872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:57:10.410506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8447,"num_write_kb":40072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"59'9","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305150+0000","last_change":"2023-09-30T17:05:03.310950+0000","last_active":"2023-09-30T17:05:25.305150+0000","last_peered":"2023-09-30T17:05:25.305150+0000","last_clean":"2023-09-30T17:05:25.305150+0000","last_became_active":"2023-09-30T17:05:03.310591+0000","last_became_peered":"2023-09-30T17:05:03.310591+0000","last_unstale":"2023-09-30T17:05:25.305150+0000","last_undegraded":"2023-09-30T17:05:25.305150+0000","last_fullsized":"2023-09-30T17:05:25.305150+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:26:23.194138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"59'13","reported_seq":82,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305292+0000","last_change":"2023-09-30T17:02:18.363479+0000","last_active":"2023-09-30T17:05:25.305292+0000","last_peered":"2023-09-30T17:05:25.305292+0000","last_clean":"2023-09-30T17:05:25.305292+0000","last_became_active":"2023-09-30T17:02:18.363222+0000","last_became_peered":"2023-09-30T17:02:18.363222+0000","last_unstale":"2023-09-30T17:05:25.305292+0000","last_undegraded":"2023-09-30T17:05:25.305292+0000","last_fullsized":"2023-09-30T17:05:25.305292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:09:55.056098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"59'2796","reported_seq":2885,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306184+0000","last_change":"2023-09-30T17:05:06.292455+0000","last_active":"2023-09-30T17:05:25.306184+0000","last_peered":"2023-09-30T17:05:25.306184+0000","last_clean":"2023-09-30T17:05:25.306184+0000","last_became_active":"2023-09-30T17:05:06.290929+0000","last_became_peered":"2023-09-30T17:05:06.290929+0000","last_unstale":"2023-09-30T17:05:25.306184+0000","last_undegraded":"2023-09-30T17:05:25.306184+0000","last_fullsized":"2023-09-30T17:05:25.306184+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2796,"log_dups_size":0,"ondisk_log_size":2796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:54:14.579761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8138,"num_write_kb":38784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"59'2852","reported_seq":2921,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305723+0000","last_change":"2023-09-30T17:02:18.363216+0000","last_active":"2023-09-30T17:05:25.305723+0000","last_peered":"2023-09-30T17:05:25.305723+0000","last_clean":"2023-09-30T17:05:25.305723+0000","last_became_active":"2023-09-30T17:02:18.362894+0000","last_became_peered":"2023-09-30T17:02:18.362894+0000","last_unstale":"2023-09-30T17:05:25.305723+0000","last_undegraded":"2023-09-30T17:05:25.305723+0000","last_fullsized":"2023-09-30T17:05:25.305723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2852,"log_dups_size":0,"ondisk_log_size":2852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:30:43.782165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8357,"num_write_kb":39780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"59'2874","reported_seq":2963,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306543+0000","last_change":"2023-09-30T17:05:06.294279+0000","last_active":"2023-09-30T17:05:25.306543+0000","last_peered":"2023-09-30T17:05:25.306543+0000","last_clean":"2023-09-30T17:05:25.306543+0000","last_became_active":"2023-09-30T17:05:06.292898+0000","last_became_peered":"2023-09-30T17:05:06.292898+0000","last_unstale":"2023-09-30T17:05:25.306543+0000","last_undegraded":"2023-09-30T17:05:25.306543+0000","last_fullsized":"2023-09-30T17:05:25.306543+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2874,"log_dups_size":0,"ondisk_log_size":2874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:02:14.484209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8465,"num_write_kb":40104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":532685,"num_write_kb":2575302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140940,"ondisk_log_size":140940,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":228927,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":137,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":223425,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":524288,"data_stored":457854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":66,"seq":283467841543,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47044,"kb_used_data":1460,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94324796,"statfs":{"total":96636764160,"available":96588591104,"internally_reserved":0,"allocated":1495040,"data_stored":1123985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7139,"internal_metadata":46654493},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56899999999999995}]}]},{"osd":0,"up_from":8,"seq":34359738412,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":582456,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":580990,"kb_avail":93789384,"statfs":{"total":96636764160,"available":96040329216,"internally_reserved":0,"allocated":1482752,"data_stored":1122763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":594934214},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 17:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.51800000000000002,"15min":0.48999999999999999},"min":{"1min":0.215,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":5.9480000000000004,"5min":5.9480000000000004,"15min":5.9480000000000004},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.503,"15min":0.46300000000000002},"min":{"1min":0.216,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":3.6819999999999999,"5min":3.6819999999999999,"15min":3.6819999999999999},"last":0.42799999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738412,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":563596,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":562942,"kb_avail":93808244,"statfs":{"total":96636764160,"available":96059641856,"internally_reserved":0,"allocated":651264,"data_stored":305912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":576453062},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 17:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.48599999999999999,"15min":0.45600000000000002},"min":{"1min":0.19800000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":3.3420000000000001,"5min":3.3420000000000001,"15min":3.3420000000000001},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.51200000000000001,"15min":0.46000000000000002},"min":{"1min":0.189,"5min":0.188,"15min":0.188},"max":{"1min":3.5470000000000002,"5min":3.5470000000000002,"15min":3.5470000000000002},"last":0.60599999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":249856,"data_stored":227705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":228927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T17:05:30.920 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2023-09-30T17:05:30.998 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2023-09-30T17:05:31.354 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-09-30T17:05:31.417 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-09-30T17:05:31.454 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T17:05:31.794 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:05:31.796 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-09-30T17:05:31.880 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":177,"stamp":"2023-09-30T17:05:31.339638+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":819295,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":140,"num_read_kb":122,"num_write":533025,"num_write_kb":2579054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":223425,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141229,"ondisk_log_size":141229,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1193096,"kb_used_data":3544,"kb_used_omap":10,"kb_used_meta":1189493,"kb_avail":281922424,"statfs":{"total":289910292480,"available":288688562176,"internally_reserved":0,"allocated":3629056,"data_stored":2552660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10327,"internal_metadata":1218041769},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.041047"},"pg_stats":[{"pgid":"4.3f","version":"59'2790","reported_seq":2859,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.307056+0000","last_change":"2023-09-30T17:02:18.360288+0000","last_active":"2023-09-30T17:05:25.307056+0000","last_peered":"2023-09-30T17:05:25.307056+0000","last_clean":"2023-09-30T17:05:25.307056+0000","last_became_active":"2023-09-30T17:02:18.358716+0000","last_became_peered":"2023-09-30T17:02:18.358716+0000","last_unstale":"2023-09-30T17:05:25.307056+0000","last_undegraded":"2023-09-30T17:05:25.307056+0000","last_fullsized":"2023-09-30T17:05:25.307056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2790,"log_dups_size":0,"ondisk_log_size":2790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:12:06.380095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8214,"num_write_kb":38924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"59'4","reported_seq":73,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306636+0000","last_change":"2023-09-30T17:02:18.362418+0000","last_active":"2023-09-30T17:05:25.306636+0000","last_peered":"2023-09-30T17:05:25.306636+0000","last_clean":"2023-09-30T17:05:25.306636+0000","last_became_active":"2023-09-30T17:02:18.360372+0000","last_became_peered":"2023-09-30T17:02:18.360372+0000","last_unstale":"2023-09-30T17:05:25.306636+0000","last_undegraded":"2023-09-30T17:05:25.306636+0000","last_fullsized":"2023-09-30T17:05:25.306636+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:43:29.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"59'5697","reported_seq":5771,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306021+0000","last_change":"2023-09-30T17:05:06.291597+0000","last_active":"2023-09-30T17:05:25.306021+0000","last_peered":"2023-09-30T17:05:25.306021+0000","last_clean":"2023-09-30T17:05:25.306021+0000","last_became_active":"2023-09-30T17:05:06.290447+0000","last_became_peered":"2023-09-30T17:05:06.290447+0000","last_unstale":"2023-09-30T17:05:25.306021+0000","last_undegraded":"2023-09-30T17:05:25.306021+0000","last_fullsized":"2023-09-30T17:05:25.306021+0000","mapping_epoch":69,"log_start":"42'1200","ondisk_log_start":"42'1200","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4497,"log_dups_size":1200,"ondisk_log_size":4497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:02:21.064107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16590,"num_write_kb":78960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"59'10","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305409+0000","last_change":"2023-09-30T17:05:03.309996+0000","last_active":"2023-09-30T17:05:25.305409+0000","last_peered":"2023-09-30T17:05:25.305409+0000","last_clean":"2023-09-30T17:05:25.305409+0000","last_became_active":"2023-09-30T17:05:03.309326+0000","last_became_peered":"2023-09-30T17:05:03.309326+0000","last_unstale":"2023-09-30T17:05:25.305409+0000","last_undegraded":"2023-09-30T17:05:25.305409+0000","last_fullsized":"2023-09-30T17:05:25.305409+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:31:23.164242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"59'2934","reported_seq":3003,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306421+0000","last_change":"2023-09-30T17:02:18.360192+0000","last_active":"2023-09-30T17:05:25.306421+0000","last_peered":"2023-09-30T17:05:25.306421+0000","last_clean":"2023-09-30T17:05:25.306421+0000","last_became_active":"2023-09-30T17:02:18.357317+0000","last_became_peered":"2023-09-30T17:02:18.357317+0000","last_unstale":"2023-09-30T17:05:25.306421+0000","last_undegraded":"2023-09-30T17:05:25.306421+0000","last_fullsized":"2023-09-30T17:05:25.306421+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2934,"log_dups_size":0,"ondisk_log_size":2934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:37:14.790993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8466,"num_write_kb":40084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"59'6","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305283+0000","last_change":"2023-09-30T17:05:03.311318+0000","last_active":"2023-09-30T17:05:25.305283+0000","last_peered":"2023-09-30T17:05:25.305283+0000","last_clean":"2023-09-30T17:05:25.305283+0000","last_became_active":"2023-09-30T17:05:03.310703+0000","last_became_peered":"2023-09-30T17:05:03.310703+0000","last_unstale":"2023-09-30T17:05:25.305283+0000","last_undegraded":"2023-09-30T17:05:25.305283+0000","last_fullsized":"2023-09-30T17:05:25.305283+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:08:45.345559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"59'7","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305160+0000","last_change":"2023-09-30T17:05:03.310838+0000","last_active":"2023-09-30T17:05:25.305160+0000","last_peered":"2023-09-30T17:05:25.305160+0000","last_clean":"2023-09-30T17:05:25.305160+0000","last_became_active":"2023-09-30T17:05:03.310047+0000","last_became_peered":"2023-09-30T17:05:03.310047+0000","last_unstale":"2023-09-30T17:05:25.305160+0000","last_undegraded":"2023-09-30T17:05:25.305160+0000","last_fullsized":"2023-09-30T17:05:25.305160+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:29:17.418059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"59'11423","reported_seq":11499,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.304794+0000","last_change":"2023-09-30T17:05:06.286653+0000","last_active":"2023-09-30T17:05:25.304794+0000","last_peered":"2023-09-30T17:05:25.304794+0000","last_clean":"2023-09-30T17:05:25.304794+0000","last_became_active":"2023-09-30T17:05:06.285582+0000","last_became_peered":"2023-09-30T17:05:06.285582+0000","last_unstale":"2023-09-30T17:05:25.304794+0000","last_undegraded":"2023-09-30T17:05:25.304794+0000","last_fullsized":"2023-09-30T17:05:25.304794+0000","mapping_epoch":69,"log_start":"52'7200","ondisk_log_start":"52'7200","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4223,"log_dups_size":5777,"ondisk_log_size":4223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:35:18.578031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33444,"num_write_kb":158924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"59'8589","reported_seq":8658,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306041+0000","last_change":"2023-09-30T17:02:18.364222+0000","last_active":"2023-09-30T17:05:25.306041+0000","last_peered":"2023-09-30T17:05:25.306041+0000","last_clean":"2023-09-30T17:05:25.306041+0000","last_became_active":"2023-09-30T17:02:18.363485+0000","last_became_peered":"2023-09-30T17:02:18.363485+0000","last_unstale":"2023-09-30T17:05:25.306041+0000","last_undegraded":"2023-09-30T17:05:25.306041+0000","last_fullsized":"2023-09-30T17:05:25.306041+0000","mapping_epoch":17,"log_start":"49'4400","ondisk_log_start":"49'4400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4189,"log_dups_size":4400,"ondisk_log_size":4189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:14:35.192615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25052,"num_write_kb":118756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"59'8585","reported_seq":8654,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306806+0000","last_change":"2023-09-30T17:02:18.360010+0000","last_active":"2023-09-30T17:05:25.306806+0000","last_peered":"2023-09-30T17:05:25.306806+0000","last_clean":"2023-09-30T17:05:25.306806+0000","last_became_active":"2023-09-30T17:02:18.358396+0000","last_became_peered":"2023-09-30T17:02:18.358396+0000","last_unstale":"2023-09-30T17:05:25.306806+0000","last_undegraded":"2023-09-30T17:05:25.306806+0000","last_fullsized":"2023-09-30T17:05:25.306806+0000","mapping_epoch":17,"log_start":"48'4100","ondisk_log_start":"48'4100","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4485,"log_dups_size":4100,"ondisk_log_size":4485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:26:11.522402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24997,"num_write_kb":162463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"59'5664","reported_seq":5740,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305719+0000","last_change":"2023-09-30T17:05:06.291535+0000","last_active":"2023-09-30T17:05:25.305719+0000","last_peered":"2023-09-30T17:05:25.305719+0000","last_clean":"2023-09-30T17:05:25.305719+0000","last_became_active":"2023-09-30T17:05:06.290193+0000","last_became_peered":"2023-09-30T17:05:06.290193+0000","last_unstale":"2023-09-30T17:05:25.305719+0000","last_undegraded":"2023-09-30T17:05:25.305719+0000","last_fullsized":"2023-09-30T17:05:25.305719+0000","mapping_epoch":69,"log_start":"43'1400","ondisk_log_start":"43'1400","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4264,"log_dups_size":1400,"ondisk_log_size":4264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:21:15.508580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16442,"num_write_kb":78308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"59'2931","reported_seq":3020,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306235+0000","last_change":"2023-09-30T17:05:06.290270+0000","last_active":"2023-09-30T17:05:25.306235+0000","last_peered":"2023-09-30T17:05:25.306235+0000","last_clean":"2023-09-30T17:05:25.306235+0000","last_became_active":"2023-09-30T17:05:06.288753+0000","last_became_peered":"2023-09-30T17:05:06.288753+0000","last_unstale":"2023-09-30T17:05:25.306235+0000","last_undegraded":"2023-09-30T17:05:25.306235+0000","last_fullsized":"2023-09-30T17:05:25.306235+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2931,"log_dups_size":0,"ondisk_log_size":2931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:38:30.988146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8488,"num_write_kb":40364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"59'2860","reported_seq":2929,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306164+0000","last_change":"2023-09-30T17:02:18.359894+0000","last_active":"2023-09-30T17:05:25.306164+0000","last_peered":"2023-09-30T17:05:25.306164+0000","last_clean":"2023-09-30T17:05:25.306164+0000","last_became_active":"2023-09-30T17:02:18.358534+0000","last_became_peered":"2023-09-30T17:02:18.358534+0000","last_unstale":"2023-09-30T17:05:25.306164+0000","last_undegraded":"2023-09-30T17:05:25.306164+0000","last_fullsized":"2023-09-30T17:05:25.306164+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2860,"log_dups_size":0,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:22:13.025181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8367,"num_write_kb":39772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"59'2911","reported_seq":2978,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305184+0000","last_change":"2023-09-30T17:05:06.289465+0000","last_active":"2023-09-30T17:05:25.305184+0000","last_peered":"2023-09-30T17:05:25.305184+0000","last_clean":"2023-09-30T17:05:25.305184+0000","last_became_active":"2023-09-30T17:05:06.288360+0000","last_became_peered":"2023-09-30T17:05:06.288360+0000","last_unstale":"2023-09-30T17:05:25.305184+0000","last_undegraded":"2023-09-30T17:05:25.305184+0000","last_fullsized":"2023-09-30T17:05:25.305184+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2911,"log_dups_size":0,"ondisk_log_size":2911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:53:55.381223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8419,"num_write_kb":39940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"59'2889","reported_seq":2956,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305078+0000","last_change":"2023-09-30T17:05:06.286551+0000","last_active":"2023-09-30T17:05:25.305078+0000","last_peered":"2023-09-30T17:05:25.305078+0000","last_clean":"2023-09-30T17:05:25.305078+0000","last_became_active":"2023-09-30T17:05:06.285738+0000","last_became_peered":"2023-09-30T17:05:06.285738+0000","last_unstale":"2023-09-30T17:05:25.305078+0000","last_undegraded":"2023-09-30T17:05:25.305078+0000","last_fullsized":"2023-09-30T17:05:25.305078+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2889,"log_dups_size":0,"ondisk_log_size":2889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:18:17.841837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8435,"num_write_kb":39984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"59'2839","reported_seq":2906,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.304983+0000","last_change":"2023-09-30T17:05:06.291173+0000","last_active":"2023-09-30T17:05:25.304983+0000","last_peered":"2023-09-30T17:05:25.304983+0000","last_clean":"2023-09-30T17:05:25.304983+0000","last_became_active":"2023-09-30T17:05:06.289872+0000","last_became_peered":"2023-09-30T17:05:06.289872+0000","last_unstale":"2023-09-30T17:05:25.304983+0000","last_undegraded":"2023-09-30T17:05:25.304983+0000","last_fullsized":"2023-09-30T17:05:25.304983+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2839,"log_dups_size":0,"ondisk_log_size":2839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:57:27.685208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8166,"num_write_kb":38928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"59'2802","reported_seq":2871,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306044+0000","last_change":"2023-09-30T17:02:18.364360+0000","last_active":"2023-09-30T17:05:25.306044+0000","last_peered":"2023-09-30T17:05:25.306044+0000","last_clean":"2023-09-30T17:05:25.306044+0000","last_became_active":"2023-09-30T17:02:18.363697+0000","last_became_peered":"2023-09-30T17:02:18.363697+0000","last_unstale":"2023-09-30T17:05:25.306044+0000","last_undegraded":"2023-09-30T17:05:25.306044+0000","last_fullsized":"2023-09-30T17:05:25.306044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2802,"log_dups_size":0,"ondisk_log_size":2802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:50:52.893768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8256,"num_write_kb":39208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"59'2860","reported_seq":2929,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306937+0000","last_change":"2023-09-30T17:02:18.360320+0000","last_active":"2023-09-30T17:05:25.306937+0000","last_peered":"2023-09-30T17:05:25.306937+0000","last_clean":"2023-09-30T17:05:25.306937+0000","last_became_active":"2023-09-30T17:02:18.357184+0000","last_became_peered":"2023-09-30T17:02:18.357184+0000","last_unstale":"2023-09-30T17:05:25.306937+0000","last_undegraded":"2023-09-30T17:05:25.306937+0000","last_fullsized":"2023-09-30T17:05:25.306937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2860,"log_dups_size":0,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:21:45.195007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8368,"num_write_kb":39616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"59'5686","reported_seq":5755,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305812+0000","last_change":"2023-09-30T17:02:18.363956+0000","last_active":"2023-09-30T17:05:25.305812+0000","last_peered":"2023-09-30T17:05:25.305812+0000","last_clean":"2023-09-30T17:05:25.305812+0000","last_became_active":"2023-09-30T17:02:18.363654+0000","last_became_peered":"2023-09-30T17:02:18.363654+0000","last_unstale":"2023-09-30T17:05:25.305812+0000","last_undegraded":"2023-09-30T17:05:25.305812+0000","last_fullsized":"2023-09-30T17:05:25.305812+0000","mapping_epoch":17,"log_start":"44'1500","ondisk_log_start":"44'1500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4186,"log_dups_size":1500,"ondisk_log_size":4186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:48:17.598726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16649,"num_write_kb":78956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"59'5799","reported_seq":5876,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305562+0000","last_change":"2023-09-30T17:05:06.290994+0000","last_active":"2023-09-30T17:05:25.305562+0000","last_peered":"2023-09-30T17:05:25.305562+0000","last_clean":"2023-09-30T17:05:25.305562+0000","last_became_active":"2023-09-30T17:05:06.289817+0000","last_became_peered":"2023-09-30T17:05:06.289817+0000","last_unstale":"2023-09-30T17:05:25.305562+0000","last_undegraded":"2023-09-30T17:05:25.305562+0000","last_fullsized":"2023-09-30T17:05:25.305562+0000","mapping_epoch":69,"log_start":"44'1600","ondisk_log_start":"44'1600","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4199,"log_dups_size":1600,"ondisk_log_size":4199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:50:21.333588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16903,"num_write_kb":80184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"59'12","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305497+0000","last_change":"2023-09-30T17:05:03.310298+0000","last_active":"2023-09-30T17:05:25.305497+0000","last_peered":"2023-09-30T17:05:25.305497+0000","last_clean":"2023-09-30T17:05:25.305497+0000","last_became_active":"2023-09-30T17:05:03.309537+0000","last_became_peered":"2023-09-30T17:05:03.309537+0000","last_unstale":"2023-09-30T17:05:25.305497+0000","last_undegraded":"2023-09-30T17:05:25.305497+0000","last_fullsized":"2023-09-30T17:05:25.305497+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:45:25.545287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"59'2879","reported_seq":2968,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306043+0000","last_change":"2023-09-30T17:05:06.292705+0000","last_active":"2023-09-30T17:05:25.306043+0000","last_peered":"2023-09-30T17:05:25.306043+0000","last_clean":"2023-09-30T17:05:25.306043+0000","last_became_active":"2023-09-30T17:05:06.290797+0000","last_became_peered":"2023-09-30T17:05:06.290797+0000","last_unstale":"2023-09-30T17:05:25.306043+0000","last_undegraded":"2023-09-30T17:05:25.306043+0000","last_fullsized":"2023-09-30T17:05:25.306043+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2879,"log_dups_size":0,"ondisk_log_size":2879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:55:01.976617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8343,"num_write_kb":39768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"59'2809","reported_seq":2898,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305406+0000","last_change":"2023-09-30T17:05:06.290594+0000","last_active":"2023-09-30T17:05:25.305406+0000","last_peered":"2023-09-30T17:05:25.305406+0000","last_clean":"2023-09-30T17:05:25.305406+0000","last_became_active":"2023-09-30T17:05:06.288837+0000","last_became_peered":"2023-09-30T17:05:06.288837+0000","last_unstale":"2023-09-30T17:05:25.305406+0000","last_undegraded":"2023-09-30T17:05:25.305406+0000","last_fullsized":"2023-09-30T17:05:25.305406+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2809,"log_dups_size":0,"ondisk_log_size":2809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:00:48.822153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8281,"num_write_kb":39472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"59'5585","reported_seq":5654,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306010+0000","last_change":"2023-09-30T17:02:18.353938+0000","last_active":"2023-09-30T17:05:25.306010+0000","last_peered":"2023-09-30T17:05:25.306010+0000","last_clean":"2023-09-30T17:05:25.306010+0000","last_became_active":"2023-09-30T17:02:18.353632+0000","last_became_peered":"2023-09-30T17:02:18.353632+0000","last_unstale":"2023-09-30T17:05:25.306010+0000","last_undegraded":"2023-09-30T17:05:25.306010+0000","last_fullsized":"2023-09-30T17:05:25.306010+0000","mapping_epoch":17,"log_start":"42'1100","ondisk_log_start":"42'1100","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4485,"log_dups_size":1100,"ondisk_log_size":4485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:09:55.056098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16523,"num_write_kb":78256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"59'2888","reported_seq":2977,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.307020+0000","last_change":"2023-09-30T17:05:06.292945+0000","last_active":"2023-09-30T17:05:25.307020+0000","last_peered":"2023-09-30T17:05:25.307020+0000","last_clean":"2023-09-30T17:05:25.307020+0000","last_became_active":"2023-09-30T17:05:06.291346+0000","last_became_peered":"2023-09-30T17:05:06.291346+0000","last_unstale":"2023-09-30T17:05:25.307020+0000","last_undegraded":"2023-09-30T17:05:25.307020+0000","last_fullsized":"2023-09-30T17:05:25.307020+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2888,"log_dups_size":0,"ondisk_log_size":2888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:53:27.316963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8371,"num_write_kb":39716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"59'18","reported_seq":98,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306046+0000","last_change":"2023-09-30T17:05:03.309295+0000","last_active":"2023-09-30T17:05:25.306046+0000","last_peered":"2023-09-30T17:05:25.306046+0000","last_clean":"2023-09-30T17:05:25.306046+0000","last_became_active":"2023-09-30T17:05:03.308884+0000","last_became_peered":"2023-09-30T17:05:03.308884+0000","last_unstale":"2023-09-30T17:05:25.306046+0000","last_undegraded":"2023-09-30T17:05:25.306046+0000","last_fullsized":"2023-09-30T17:05:25.306046+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:57:45.449671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"59'2855","reported_seq":2923,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305902+0000","last_change":"2023-09-30T17:05:06.291369+0000","last_active":"2023-09-30T17:05:25.305902+0000","last_peered":"2023-09-30T17:05:25.305902+0000","last_clean":"2023-09-30T17:05:25.305902+0000","last_became_active":"2023-09-30T17:05:06.289447+0000","last_became_peered":"2023-09-30T17:05:06.289447+0000","last_unstale":"2023-09-30T17:05:25.305902+0000","last_undegraded":"2023-09-30T17:05:25.305902+0000","last_fullsized":"2023-09-30T17:05:25.305902+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2855,"log_dups_size":0,"ondisk_log_size":2855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:17:21.412392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8347,"num_write_kb":39608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":71,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306032+0000","last_change":"2023-09-30T17:02:17.358258+0000","last_active":"2023-09-30T17:05:25.306032+0000","last_peered":"2023-09-30T17:05:25.306032+0000","last_clean":"2023-09-30T17:05:25.306032+0000","last_became_active":"2023-09-30T17:02:17.357890+0000","last_became_peered":"2023-09-30T17:02:17.357890+0000","last_unstale":"2023-09-30T17:05:25.306032+0000","last_undegraded":"2023-09-30T17:05:25.306032+0000","last_fullsized":"2023-09-30T17:05:25.306032+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:52:56.591906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"59'17","reported_seq":97,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.307002+0000","last_change":"2023-09-30T17:05:03.307486+0000","last_active":"2023-09-30T17:05:25.307002+0000","last_peered":"2023-09-30T17:05:25.307002+0000","last_clean":"2023-09-30T17:05:25.307002+0000","last_became_active":"2023-09-30T17:05:03.307012+0000","last_became_peered":"2023-09-30T17:05:03.307012+0000","last_unstale":"2023-09-30T17:05:25.307002+0000","last_undegraded":"2023-09-30T17:05:25.307002+0000","last_fullsized":"2023-09-30T17:05:25.307002+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:05:29.995730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305433+0000","last_change":"2023-09-30T17:05:03.309164+0000","last_active":"2023-09-30T17:05:25.305433+0000","last_peered":"2023-09-30T17:05:25.305433+0000","last_clean":"2023-09-30T17:05:25.305433+0000","last_became_active":"2023-09-30T17:05:03.308073+0000","last_became_peered":"2023-09-30T17:05:03.308073+0000","last_unstale":"2023-09-30T17:05:25.305433+0000","last_undegraded":"2023-09-30T17:05:25.305433+0000","last_fullsized":"2023-09-30T17:05:25.305433+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:10:16.238053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"59'6","reported_seq":86,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306073+0000","last_change":"2023-09-30T17:05:03.308692+0000","last_active":"2023-09-30T17:05:25.306073+0000","last_peered":"2023-09-30T17:05:25.306073+0000","last_clean":"2023-09-30T17:05:25.306073+0000","last_became_active":"2023-09-30T17:05:03.307932+0000","last_became_peered":"2023-09-30T17:05:03.307932+0000","last_unstale":"2023-09-30T17:05:25.306073+0000","last_undegraded":"2023-09-30T17:05:25.306073+0000","last_fullsized":"2023-09-30T17:05:25.306073+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:17:13.668052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":70,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305661+0000","last_change":"2023-09-30T17:02:17.361000+0000","last_active":"2023-09-30T17:05:25.305661+0000","last_peered":"2023-09-30T17:05:25.305661+0000","last_clean":"2023-09-30T17:05:25.305661+0000","last_became_active":"2023-09-30T17:02:17.360601+0000","last_became_peered":"2023-09-30T17:02:17.360601+0000","last_unstale":"2023-09-30T17:05:25.305661+0000","last_undegraded":"2023-09-30T17:05:25.305661+0000","last_fullsized":"2023-09-30T17:05:25.305661+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:02:27.666526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"59'7","reported_seq":87,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306929+0000","last_change":"2023-09-30T17:05:03.305898+0000","last_active":"2023-09-30T17:05:25.306929+0000","last_peered":"2023-09-30T17:05:25.306929+0000","last_clean":"2023-09-30T17:05:25.306929+0000","last_became_active":"2023-09-30T17:05:03.305520+0000","last_became_peered":"2023-09-30T17:05:03.305520+0000","last_unstale":"2023-09-30T17:05:25.306929+0000","last_undegraded":"2023-09-30T17:05:25.306929+0000","last_fullsized":"2023-09-30T17:05:25.306929+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:40:09.276369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"58'1","reported_seq":82,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306258+0000","last_change":"2023-09-30T17:05:03.309303+0000","last_active":"2023-09-30T17:05:25.306258+0000","last_peered":"2023-09-30T17:05:25.306258+0000","last_clean":"2023-09-30T17:05:25.306258+0000","last_became_active":"2023-09-30T17:05:03.308851+0000","last_became_peered":"2023-09-30T17:05:03.308851+0000","last_unstale":"2023-09-30T17:05:25.306258+0000","last_undegraded":"2023-09-30T17:05:25.306258+0000","last_fullsized":"2023-09-30T17:05:25.306258+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:32:55.497287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"59'9","reported_seq":78,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305188+0000","last_change":"2023-09-30T17:02:18.358841+0000","last_active":"2023-09-30T17:05:25.305188+0000","last_peered":"2023-09-30T17:05:25.305188+0000","last_clean":"2023-09-30T17:05:25.305188+0000","last_became_active":"2023-09-30T17:02:18.358529+0000","last_became_peered":"2023-09-30T17:02:18.358529+0000","last_unstale":"2023-09-30T17:05:25.305188+0000","last_undegraded":"2023-09-30T17:05:25.305188+0000","last_fullsized":"2023-09-30T17:05:25.305188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:15:54.364571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305635+0000","last_change":"2023-09-30T17:05:03.309409+0000","last_active":"2023-09-30T17:05:25.305635+0000","last_peered":"2023-09-30T17:05:25.305635+0000","last_clean":"2023-09-30T17:05:25.305635+0000","last_became_active":"2023-09-30T17:05:03.309023+0000","last_became_peered":"2023-09-30T17:05:03.309023+0000","last_unstale":"2023-09-30T17:05:25.305635+0000","last_undegraded":"2023-09-30T17:05:25.305635+0000","last_fullsized":"2023-09-30T17:05:25.305635+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:57:05.463330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"59'8526","reported_seq":8618,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305529+0000","last_change":"2023-09-30T17:05:06.292415+0000","last_active":"2023-09-30T17:05:25.305529+0000","last_peered":"2023-09-30T17:05:25.305529+0000","last_clean":"2023-09-30T17:05:25.305529+0000","last_became_active":"2023-09-30T17:05:06.290551+0000","last_became_peered":"2023-09-30T17:05:06.290551+0000","last_unstale":"2023-09-30T17:05:25.305529+0000","last_undegraded":"2023-09-30T17:05:25.305529+0000","last_fullsized":"2023-09-30T17:05:25.305529+0000","mapping_epoch":69,"log_start":"49'4300","ondisk_log_start":"49'4300","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4226,"log_dups_size":4300,"ondisk_log_size":4226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:59:52.758548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24873,"num_write_kb":118472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"59'7","reported_seq":93,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306635+0000","last_change":"2023-09-30T17:05:03.310987+0000","last_active":"2023-09-30T17:05:25.306635+0000","last_peered":"2023-09-30T17:05:25.306635+0000","last_clean":"2023-09-30T17:05:25.306635+0000","last_became_active":"2023-09-30T17:05:03.306646+0000","last_became_peered":"2023-09-30T17:05:03.306646+0000","last_unstale":"2023-09-30T17:05:25.306635+0000","last_undegraded":"2023-09-30T17:05:25.306635+0000","last_fullsized":"2023-09-30T17:05:25.306635+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:24:52.247523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"59'5670","reported_seq":5739,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305419+0000","last_change":"2023-09-30T17:02:18.359118+0000","last_active":"2023-09-30T17:05:25.305419+0000","last_peered":"2023-09-30T17:05:25.305419+0000","last_clean":"2023-09-30T17:05:25.305419+0000","last_became_active":"2023-09-30T17:02:18.358786+0000","last_became_peered":"2023-09-30T17:02:18.358786+0000","last_unstale":"2023-09-30T17:05:25.305419+0000","last_undegraded":"2023-09-30T17:05:25.305419+0000","last_fullsized":"2023-09-30T17:05:25.305419+0000","mapping_epoch":17,"log_start":"44'1500","ondisk_log_start":"44'1500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4170,"log_dups_size":1500,"ondisk_log_size":4170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:33:21.723864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16627,"num_write_kb":79047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"60'78","reported_seq":49,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305537+0000","last_change":"2023-09-30T17:05:03.313916+0000","last_active":"2023-09-30T17:05:25.305537+0000","last_peered":"2023-09-30T17:05:25.305537+0000","last_clean":"2023-09-30T17:05:25.305537+0000","last_became_active":"2023-09-30T17:05:03.302516+0000","last_became_peered":"2023-09-30T17:05:03.302516+0000","last_unstale":"2023-09-30T17:05:25.305537+0000","last_undegraded":"2023-09-30T17:05:25.305537+0000","last_fullsized":"2023-09-30T17:05:25.305537+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:00:50.535715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227523,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":222729,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"59'5677","reported_seq":5756,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305603+0000","last_change":"2023-09-30T17:05:06.289965+0000","last_active":"2023-09-30T17:05:25.305603+0000","last_peered":"2023-09-30T17:05:25.305603+0000","last_clean":"2023-09-30T17:05:25.305603+0000","last_became_active":"2023-09-30T17:05:06.288155+0000","last_became_peered":"2023-09-30T17:05:06.288155+0000","last_unstale":"2023-09-30T17:05:25.305603+0000","last_undegraded":"2023-09-30T17:05:25.305603+0000","last_fullsized":"2023-09-30T17:05:25.305603+0000","mapping_epoch":69,"log_start":"42'1100","ondisk_log_start":"42'1100","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4577,"log_dups_size":1100,"ondisk_log_size":4577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:26:23.188915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16579,"num_write_kb":79104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305299+0000","last_change":"2023-09-30T17:05:03.310322+0000","last_active":"2023-09-30T17:05:25.305299+0000","last_peered":"2023-09-30T17:05:25.305299+0000","last_clean":"2023-09-30T17:05:25.305299+0000","last_became_active":"2023-09-30T17:05:03.309505+0000","last_became_peered":"2023-09-30T17:05:03.309505+0000","last_unstale":"2023-09-30T17:05:25.305299+0000","last_undegraded":"2023-09-30T17:05:25.305299+0000","last_fullsized":"2023-09-30T17:05:25.305299+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:13:16.014703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"59'2836","reported_seq":2905,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306395+0000","last_change":"2023-09-30T17:02:18.360019+0000","last_active":"2023-09-30T17:05:25.306395+0000","last_peered":"2023-09-30T17:05:25.306395+0000","last_clean":"2023-09-30T17:05:25.306395+0000","last_became_active":"2023-09-30T17:02:18.358364+0000","last_became_peered":"2023-09-30T17:02:18.358364+0000","last_unstale":"2023-09-30T17:05:25.306395+0000","last_undegraded":"2023-09-30T17:05:25.306395+0000","last_fullsized":"2023-09-30T17:05:25.306395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2836,"log_dups_size":0,"ondisk_log_size":2836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:30:43.782165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8308,"num_write_kb":39456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305535+0000","last_change":"2023-09-30T17:05:03.308853+0000","last_active":"2023-09-30T17:05:25.305535+0000","last_peered":"2023-09-30T17:05:25.305535+0000","last_clean":"2023-09-30T17:05:25.305535+0000","last_became_active":"2023-09-30T17:05:03.308377+0000","last_became_peered":"2023-09-30T17:05:03.308377+0000","last_unstale":"2023-09-30T17:05:25.305535+0000","last_undegraded":"2023-09-30T17:05:25.305535+0000","last_fullsized":"2023-09-30T17:05:25.305535+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:18:42.448826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"59'2856","reported_seq":2925,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306869+0000","last_change":"2023-09-30T17:02:18.362415+0000","last_active":"2023-09-30T17:05:25.306869+0000","last_peered":"2023-09-30T17:05:25.306869+0000","last_clean":"2023-09-30T17:05:25.306869+0000","last_became_active":"2023-09-30T17:02:18.361556+0000","last_became_peered":"2023-09-30T17:02:18.361556+0000","last_unstale":"2023-09-30T17:05:25.306869+0000","last_undegraded":"2023-09-30T17:05:25.306869+0000","last_fullsized":"2023-09-30T17:05:25.306869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2856,"log_dups_size":0,"ondisk_log_size":2856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:16:41.607547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8321,"num_write_kb":39600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306039+0000","last_change":"2023-09-30T17:05:03.304220+0000","last_active":"2023-09-30T17:05:25.306039+0000","last_peered":"2023-09-30T17:05:25.306039+0000","last_clean":"2023-09-30T17:05:25.306039+0000","last_became_active":"2023-09-30T17:05:03.303598+0000","last_became_peered":"2023-09-30T17:05:03.303598+0000","last_unstale":"2023-09-30T17:05:25.306039+0000","last_undegraded":"2023-09-30T17:05:25.306039+0000","last_fullsized":"2023-09-30T17:05:25.306039+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:57:44.444041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"59'12","reported_seq":92,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306163+0000","last_change":"2023-09-30T17:05:03.313214+0000","last_active":"2023-09-30T17:05:25.306163+0000","last_peered":"2023-09-30T17:05:25.306163+0000","last_clean":"2023-09-30T17:05:25.306163+0000","last_became_active":"2023-09-30T17:05:03.312888+0000","last_became_peered":"2023-09-30T17:05:03.312888+0000","last_unstale":"2023-09-30T17:05:25.306163+0000","last_undegraded":"2023-09-30T17:05:25.306163+0000","last_fullsized":"2023-09-30T17:05:25.306163+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:40:09.276369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"59'9","reported_seq":35,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305075+0000","last_change":"2023-09-30T17:05:03.304503+0000","last_active":"2023-09-30T17:05:25.305075+0000","last_peered":"2023-09-30T17:05:25.305075+0000","last_clean":"2023-09-30T17:05:25.305075+0000","last_became_active":"2023-09-30T17:05:03.304030+0000","last_became_peered":"2023-09-30T17:05:03.304030+0000","last_unstale":"2023-09-30T17:05:25.305075+0000","last_undegraded":"2023-09-30T17:05:25.305075+0000","last_fullsized":"2023-09-30T17:05:25.305075+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:08:35.110114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"59'2892","reported_seq":2981,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306333+0000","last_change":"2023-09-30T17:05:06.290230+0000","last_active":"2023-09-30T17:05:25.306333+0000","last_peered":"2023-09-30T17:05:25.306333+0000","last_clean":"2023-09-30T17:05:25.306333+0000","last_became_active":"2023-09-30T17:05:06.288725+0000","last_became_peered":"2023-09-30T17:05:06.288725+0000","last_unstale":"2023-09-30T17:05:25.306333+0000","last_undegraded":"2023-09-30T17:05:25.306333+0000","last_fullsized":"2023-09-30T17:05:25.306333+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2892,"log_dups_size":0,"ondisk_log_size":2892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:27:28.611647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8345,"num_write_kb":39712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305902+0000","last_change":"2023-09-30T17:05:03.304339+0000","last_active":"2023-09-30T17:05:25.305902+0000","last_peered":"2023-09-30T17:05:25.305902+0000","last_clean":"2023-09-30T17:05:25.305902+0000","last_became_active":"2023-09-30T17:05:03.303179+0000","last_became_peered":"2023-09-30T17:05:03.303179+0000","last_unstale":"2023-09-30T17:05:25.305902+0000","last_undegraded":"2023-09-30T17:05:25.305902+0000","last_fullsized":"2023-09-30T17:05:25.305902+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:44:20.765682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"59'2861","reported_seq":2950,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305648+0000","last_change":"2023-09-30T17:05:06.290324+0000","last_active":"2023-09-30T17:05:25.305648+0000","last_peered":"2023-09-30T17:05:25.305648+0000","last_clean":"2023-09-30T17:05:25.305648+0000","last_became_active":"2023-09-30T17:05:06.288824+0000","last_became_peered":"2023-09-30T17:05:06.288824+0000","last_unstale":"2023-09-30T17:05:25.305648+0000","last_undegraded":"2023-09-30T17:05:25.305648+0000","last_fullsized":"2023-09-30T17:05:25.305648+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2861,"log_dups_size":0,"ondisk_log_size":2861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:51:16.138021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8384,"num_write_kb":39788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":83,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306641+0000","last_change":"2023-09-30T17:05:03.304232+0000","last_active":"2023-09-30T17:05:25.306641+0000","last_peered":"2023-09-30T17:05:25.306641+0000","last_clean":"2023-09-30T17:05:25.306641+0000","last_became_active":"2023-09-30T17:05:03.303874+0000","last_became_peered":"2023-09-30T17:05:03.303874+0000","last_unstale":"2023-09-30T17:05:25.306641+0000","last_undegraded":"2023-09-30T17:05:25.306641+0000","last_fullsized":"2023-09-30T17:05:25.306641+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:39:49.644290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"59'2","reported_seq":71,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306324+0000","last_change":"2023-09-30T17:02:18.359767+0000","last_active":"2023-09-30T17:05:25.306324+0000","last_peered":"2023-09-30T17:05:25.306324+0000","last_clean":"2023-09-30T17:05:25.306324+0000","last_became_active":"2023-09-30T17:02:18.356825+0000","last_became_peered":"2023-09-30T17:02:18.356825+0000","last_unstale":"2023-09-30T17:05:25.306324+0000","last_undegraded":"2023-09-30T17:05:25.306324+0000","last_fullsized":"2023-09-30T17:05:25.306324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:39:16.689300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305494+0000","last_change":"2023-09-30T17:05:03.305087+0000","last_active":"2023-09-30T17:05:25.305494+0000","last_peered":"2023-09-30T17:05:25.305494+0000","last_clean":"2023-09-30T17:05:25.305494+0000","last_became_active":"2023-09-30T17:05:03.304463+0000","last_became_peered":"2023-09-30T17:05:03.304463+0000","last_unstale":"2023-09-30T17:05:25.305494+0000","last_undegraded":"2023-09-30T17:05:25.305494+0000","last_fullsized":"2023-09-30T17:05:25.305494+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:33:20.829898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"59'2835","reported_seq":2903,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305096+0000","last_change":"2023-09-30T17:05:06.289598+0000","last_active":"2023-09-30T17:05:25.305096+0000","last_peered":"2023-09-30T17:05:25.305096+0000","last_clean":"2023-09-30T17:05:25.305096+0000","last_became_active":"2023-09-30T17:05:06.288712+0000","last_became_peered":"2023-09-30T17:05:06.288712+0000","last_unstale":"2023-09-30T17:05:25.305096+0000","last_undegraded":"2023-09-30T17:05:25.305096+0000","last_fullsized":"2023-09-30T17:05:25.305096+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2835,"log_dups_size":0,"ondisk_log_size":2835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:01:17.676791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8288,"num_write_kb":39388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305636+0000","last_change":"2023-09-30T17:05:03.311500+0000","last_active":"2023-09-30T17:05:25.305636+0000","last_peered":"2023-09-30T17:05:25.305636+0000","last_clean":"2023-09-30T17:05:25.305636+0000","last_became_active":"2023-09-30T17:05:03.310836+0000","last_became_peered":"2023-09-30T17:05:03.310836+0000","last_unstale":"2023-09-30T17:05:25.305636+0000","last_undegraded":"2023-09-30T17:05:25.305636+0000","last_fullsized":"2023-09-30T17:05:25.305636+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:30:09.762284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"59'8","reported_seq":88,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305917+0000","last_change":"2023-09-30T17:05:03.308917+0000","last_active":"2023-09-30T17:05:25.305917+0000","last_peered":"2023-09-30T17:05:25.305917+0000","last_clean":"2023-09-30T17:05:25.305917+0000","last_became_active":"2023-09-30T17:05:03.308214+0000","last_became_peered":"2023-09-30T17:05:03.308214+0000","last_unstale":"2023-09-30T17:05:25.305917+0000","last_undegraded":"2023-09-30T17:05:25.305917+0000","last_fullsized":"2023-09-30T17:05:25.305917+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:39:50.649920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"58'3","reported_seq":85,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305666+0000","last_change":"2023-09-30T17:05:03.308944+0000","last_active":"2023-09-30T17:05:25.305666+0000","last_peered":"2023-09-30T17:05:25.305666+0000","last_clean":"2023-09-30T17:05:25.305666+0000","last_became_active":"2023-09-30T17:05:03.308483+0000","last_became_peered":"2023-09-30T17:05:03.308483+0000","last_unstale":"2023-09-30T17:05:25.305666+0000","last_undegraded":"2023-09-30T17:05:25.305666+0000","last_fullsized":"2023-09-30T17:05:25.305666+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:43:27.633747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"59'2846","reported_seq":2913,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305422+0000","last_change":"2023-09-30T17:05:06.290255+0000","last_active":"2023-09-30T17:05:25.305422+0000","last_peered":"2023-09-30T17:05:25.305422+0000","last_clean":"2023-09-30T17:05:25.305422+0000","last_became_active":"2023-09-30T17:05:06.289225+0000","last_became_peered":"2023-09-30T17:05:06.289225+0000","last_unstale":"2023-09-30T17:05:25.305422+0000","last_undegraded":"2023-09-30T17:05:25.305422+0000","last_fullsized":"2023-09-30T17:05:25.305422+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2846,"log_dups_size":0,"ondisk_log_size":2846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:41:31.424933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8199,"num_write_kb":39160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.304959+0000","last_change":"2023-09-30T17:05:03.309689+0000","last_active":"2023-09-30T17:05:25.304959+0000","last_peered":"2023-09-30T17:05:25.304959+0000","last_clean":"2023-09-30T17:05:25.304959+0000","last_became_active":"2023-09-30T17:05:03.309318+0000","last_became_peered":"2023-09-30T17:05:03.309318+0000","last_unstale":"2023-09-30T17:05:25.304959+0000","last_undegraded":"2023-09-30T17:05:25.304959+0000","last_fullsized":"2023-09-30T17:05:25.304959+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:12:37.857480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"59'2831","reported_seq":2898,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305893+0000","last_change":"2023-09-30T17:05:06.289189+0000","last_active":"2023-09-30T17:05:25.305893+0000","last_peered":"2023-09-30T17:05:25.305893+0000","last_clean":"2023-09-30T17:05:25.305893+0000","last_became_active":"2023-09-30T17:05:06.288348+0000","last_became_peered":"2023-09-30T17:05:06.288348+0000","last_unstale":"2023-09-30T17:05:25.305893+0000","last_undegraded":"2023-09-30T17:05:25.305893+0000","last_fullsized":"2023-09-30T17:05:25.305893+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2831,"log_dups_size":0,"ondisk_log_size":2831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:51:59.540252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8336,"num_write_kb":39484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305792+0000","last_change":"2023-09-30T17:05:03.304019+0000","last_active":"2023-09-30T17:05:25.305792+0000","last_peered":"2023-09-30T17:05:25.305792+0000","last_clean":"2023-09-30T17:05:25.305792+0000","last_became_active":"2023-09-30T17:05:03.303473+0000","last_became_peered":"2023-09-30T17:05:03.303473+0000","last_unstale":"2023-09-30T17:05:25.305792+0000","last_undegraded":"2023-09-30T17:05:25.305792+0000","last_fullsized":"2023-09-30T17:05:25.305792+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:10:16.238053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"59'2884","reported_seq":2951,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306051+0000","last_change":"2023-09-30T17:05:06.289446+0000","last_active":"2023-09-30T17:05:25.306051+0000","last_peered":"2023-09-30T17:05:25.306051+0000","last_clean":"2023-09-30T17:05:25.306051+0000","last_became_active":"2023-09-30T17:05:06.288169+0000","last_became_peered":"2023-09-30T17:05:06.288169+0000","last_unstale":"2023-09-30T17:05:25.306051+0000","last_undegraded":"2023-09-30T17:05:25.306051+0000","last_fullsized":"2023-09-30T17:05:25.306051+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2884,"log_dups_size":0,"ondisk_log_size":2884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:15:23.507816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8366,"num_write_kb":39744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":70,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305775+0000","last_change":"2023-09-30T17:02:17.358811+0000","last_active":"2023-09-30T17:05:25.305775+0000","last_peered":"2023-09-30T17:05:25.305775+0000","last_clean":"2023-09-30T17:05:25.305775+0000","last_became_active":"2023-09-30T17:02:17.358582+0000","last_became_peered":"2023-09-30T17:02:17.358582+0000","last_unstale":"2023-09-30T17:05:25.305775+0000","last_undegraded":"2023-09-30T17:05:25.305775+0000","last_fullsized":"2023-09-30T17:05:25.305775+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:52:37.518693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"59'8580","reported_seq":8649,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306158+0000","last_change":"2023-09-30T17:02:18.364478+0000","last_active":"2023-09-30T17:05:25.306158+0000","last_peered":"2023-09-30T17:05:25.306158+0000","last_clean":"2023-09-30T17:05:25.306158+0000","last_became_active":"2023-09-30T17:02:18.364057+0000","last_became_peered":"2023-09-30T17:02:18.364057+0000","last_unstale":"2023-09-30T17:05:25.306158+0000","last_undegraded":"2023-09-30T17:05:25.306158+0000","last_fullsized":"2023-09-30T17:05:25.306158+0000","mapping_epoch":17,"log_start":"49'4400","ondisk_log_start":"49'4400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4180,"log_dups_size":4400,"ondisk_log_size":4180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:13:55.555700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25046,"num_write_kb":118972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305797+0000","last_change":"2023-09-30T17:02:12.327704+0000","last_active":"2023-09-30T17:05:25.305797+0000","last_peered":"2023-09-30T17:05:25.305797+0000","last_clean":"2023-09-30T17:05:25.305797+0000","last_became_active":"2023-09-30T17:02:12.327384+0000","last_became_peered":"2023-09-30T17:02:12.327384+0000","last_unstale":"2023-09-30T17:05:25.305797+0000","last_undegraded":"2023-09-30T17:05:25.305797+0000","last_fullsized":"2023-09-30T17:05:25.305797+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:09:34.818252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306075+0000","last_change":"2023-09-30T17:05:03.311271+0000","last_active":"2023-09-30T17:05:25.306075+0000","last_peered":"2023-09-30T17:05:25.306075+0000","last_clean":"2023-09-30T17:05:25.306075+0000","last_became_active":"2023-09-30T17:05:03.310655+0000","last_became_peered":"2023-09-30T17:05:03.310655+0000","last_unstale":"2023-09-30T17:05:25.306075+0000","last_undegraded":"2023-09-30T17:05:25.306075+0000","last_fullsized":"2023-09-30T17:05:25.306075+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:49:35.748952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"59'9","reported_seq":89,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306198+0000","last_change":"2023-09-30T17:05:03.306223+0000","last_active":"2023-09-30T17:05:25.306198+0000","last_peered":"2023-09-30T17:05:25.306198+0000","last_clean":"2023-09-30T17:05:25.306198+0000","last_became_active":"2023-09-30T17:05:03.305956+0000","last_became_peered":"2023-09-30T17:05:03.305956+0000","last_unstale":"2023-09-30T17:05:25.306198+0000","last_undegraded":"2023-09-30T17:05:25.306198+0000","last_fullsized":"2023-09-30T17:05:25.306198+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:32:56.502917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.304959+0000","last_change":"2023-09-30T17:05:03.309359+0000","last_active":"2023-09-30T17:05:25.304959+0000","last_peered":"2023-09-30T17:05:25.304959+0000","last_clean":"2023-09-30T17:05:25.304959+0000","last_became_active":"2023-09-30T17:05:03.308944+0000","last_became_peered":"2023-09-30T17:05:03.308944+0000","last_unstale":"2023-09-30T17:05:25.304959+0000","last_undegraded":"2023-09-30T17:05:25.304959+0000","last_fullsized":"2023-09-30T17:05:25.304959+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:02:58.156693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305781+0000","last_change":"2023-09-30T17:05:03.311106+0000","last_active":"2023-09-30T17:05:25.305781+0000","last_peered":"2023-09-30T17:05:25.305781+0000","last_clean":"2023-09-30T17:05:25.305781+0000","last_became_active":"2023-09-30T17:05:03.310706+0000","last_became_peered":"2023-09-30T17:05:03.310706+0000","last_unstale":"2023-09-30T17:05:25.305781+0000","last_undegraded":"2023-09-30T17:05:25.305781+0000","last_fullsized":"2023-09-30T17:05:25.305781+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:04:03.231664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"59'9","reported_seq":78,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305690+0000","last_change":"2023-09-30T17:02:18.363399+0000","last_active":"2023-09-30T17:05:25.305690+0000","last_peered":"2023-09-30T17:05:25.305690+0000","last_clean":"2023-09-30T17:05:25.305690+0000","last_became_active":"2023-09-30T17:02:18.363064+0000","last_became_peered":"2023-09-30T17:02:18.363064+0000","last_unstale":"2023-09-30T17:05:25.305690+0000","last_undegraded":"2023-09-30T17:05:25.305690+0000","last_fullsized":"2023-09-30T17:05:25.305690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:32:34.654264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305329+0000","last_change":"2023-09-30T17:02:12.327834+0000","last_active":"2023-09-30T17:05:25.305329+0000","last_peered":"2023-09-30T17:05:25.305329+0000","last_clean":"2023-09-30T17:05:25.305329+0000","last_became_active":"2023-09-30T17:02:12.327542+0000","last_became_peered":"2023-09-30T17:02:12.327542+0000","last_unstale":"2023-09-30T17:05:25.305329+0000","last_undegraded":"2023-09-30T17:05:25.305329+0000","last_fullsized":"2023-09-30T17:05:25.305329+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:49:54.890769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305806+0000","last_change":"2023-09-30T17:05:03.305668+0000","last_active":"2023-09-30T17:05:25.305806+0000","last_peered":"2023-09-30T17:05:25.305806+0000","last_clean":"2023-09-30T17:05:25.305806+0000","last_became_active":"2023-09-30T17:05:03.305222+0000","last_became_peered":"2023-09-30T17:05:03.305222+0000","last_unstale":"2023-09-30T17:05:25.305806+0000","last_undegraded":"2023-09-30T17:05:25.305806+0000","last_fullsized":"2023-09-30T17:05:25.305806+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:17:12.662422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"59'6","reported_seq":75,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306348+0000","last_change":"2023-09-30T17:02:18.364406+0000","last_active":"2023-09-30T17:05:25.306348+0000","last_peered":"2023-09-30T17:05:25.306348+0000","last_clean":"2023-09-30T17:05:25.306348+0000","last_became_active":"2023-09-30T17:02:18.363849+0000","last_became_peered":"2023-09-30T17:02:18.363849+0000","last_unstale":"2023-09-30T17:05:25.306348+0000","last_undegraded":"2023-09-30T17:05:25.306348+0000","last_fullsized":"2023-09-30T17:05:25.306348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:43:29.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305302+0000","last_change":"2023-09-30T17:05:03.310062+0000","last_active":"2023-09-30T17:05:25.305302+0000","last_peered":"2023-09-30T17:05:25.305302+0000","last_clean":"2023-09-30T17:05:25.305302+0000","last_became_active":"2023-09-30T17:05:03.308958+0000","last_became_peered":"2023-09-30T17:05:03.308958+0000","last_unstale":"2023-09-30T17:05:25.305302+0000","last_undegraded":"2023-09-30T17:05:25.305302+0000","last_fullsized":"2023-09-30T17:05:25.305302+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:05:26.347633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":225,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.304940+0000","last_change":"2023-09-30T17:05:03.303046+0000","last_active":"2023-09-30T17:05:25.304940+0000","last_peered":"2023-09-30T17:05:25.304940+0000","last_clean":"2023-09-30T17:05:25.304940+0000","last_became_active":"2023-09-30T17:05:03.302265+0000","last_became_peered":"2023-09-30T17:05:03.302265+0000","last_unstale":"2023-09-30T17:05:25.304940+0000","last_undegraded":"2023-09-30T17:05:25.304940+0000","last_fullsized":"2023-09-30T17:05:25.304940+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:06.295501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:06.295501+0000","last_clean_scrub_stamp":"2023-09-30T17:02:06.295501+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:07:24.603358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":70,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305369+0000","last_change":"2023-09-30T17:02:17.357139+0000","last_active":"2023-09-30T17:05:25.305369+0000","last_peered":"2023-09-30T17:05:25.305369+0000","last_clean":"2023-09-30T17:05:25.305369+0000","last_became_active":"2023-09-30T17:02:17.356901+0000","last_became_peered":"2023-09-30T17:02:17.356901+0000","last_unstale":"2023-09-30T17:05:25.305369+0000","last_undegraded":"2023-09-30T17:05:25.305369+0000","last_fullsized":"2023-09-30T17:05:25.305369+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:22:35.747671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"59'7","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305738+0000","last_change":"2023-09-30T17:05:03.305199+0000","last_active":"2023-09-30T17:05:25.305738+0000","last_peered":"2023-09-30T17:05:25.305738+0000","last_clean":"2023-09-30T17:05:25.305738+0000","last_became_active":"2023-09-30T17:05:03.304974+0000","last_became_peered":"2023-09-30T17:05:03.304974+0000","last_unstale":"2023-09-30T17:05:25.305738+0000","last_undegraded":"2023-09-30T17:05:25.305738+0000","last_fullsized":"2023-09-30T17:05:25.305738+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:03:27.429545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305080+0000","last_change":"2023-09-30T17:05:03.303739+0000","last_active":"2023-09-30T17:05:25.305080+0000","last_peered":"2023-09-30T17:05:25.305080+0000","last_clean":"2023-09-30T17:05:25.305080+0000","last_became_active":"2023-09-30T17:05:03.302590+0000","last_became_peered":"2023-09-30T17:05:03.302590+0000","last_unstale":"2023-09-30T17:05:25.305080+0000","last_undegraded":"2023-09-30T17:05:25.305080+0000","last_fullsized":"2023-09-30T17:05:25.305080+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:51:30.199616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"59'5","reported_seq":94,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305237+0000","last_change":"2023-09-30T17:05:03.318439+0000","last_active":"2023-09-30T17:05:25.305237+0000","last_peered":"2023-09-30T17:05:25.305237+0000","last_clean":"2023-09-30T17:05:25.305237+0000","last_became_active":"2023-09-30T17:05:03.308059+0000","last_became_peered":"2023-09-30T17:05:03.308059+0000","last_unstale":"2023-09-30T17:05:25.305237+0000","last_undegraded":"2023-09-30T17:05:25.305237+0000","last_fullsized":"2023-09-30T17:05:25.305237+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:16:25.170638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"59'11252","reported_seq":11321,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306870+0000","last_change":"2023-09-30T17:02:18.360029+0000","last_active":"2023-09-30T17:05:25.306870+0000","last_peered":"2023-09-30T17:05:25.306870+0000","last_clean":"2023-09-30T17:05:25.306870+0000","last_became_active":"2023-09-30T17:02:18.356839+0000","last_became_peered":"2023-09-30T17:02:18.356839+0000","last_unstale":"2023-09-30T17:05:25.306870+0000","last_undegraded":"2023-09-30T17:05:25.306870+0000","last_fullsized":"2023-09-30T17:05:25.306870+0000","mapping_epoch":17,"log_start":"51'6700","ondisk_log_start":"51'6700","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4552,"log_dups_size":6700,"ondisk_log_size":4552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:16:27.516884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33068,"num_write_kb":157144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":73,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306724+0000","last_change":"2023-09-30T17:02:12.330472+0000","last_active":"2023-09-30T17:05:25.306724+0000","last_peered":"2023-09-30T17:05:25.306724+0000","last_clean":"2023-09-30T17:05:25.306724+0000","last_became_active":"2023-09-30T17:02:12.330154+0000","last_became_peered":"2023-09-30T17:02:12.330154+0000","last_unstale":"2023-09-30T17:05:25.306724+0000","last_undegraded":"2023-09-30T17:05:25.306724+0000","last_fullsized":"2023-09-30T17:05:25.306724+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:43:23.161734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":70,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305996+0000","last_change":"2023-09-30T17:02:17.361007+0000","last_active":"2023-09-30T17:05:25.305996+0000","last_peered":"2023-09-30T17:05:25.305996+0000","last_clean":"2023-09-30T17:05:25.305996+0000","last_became_active":"2023-09-30T17:02:17.360721+0000","last_became_peered":"2023-09-30T17:02:17.360721+0000","last_unstale":"2023-09-30T17:05:25.305996+0000","last_undegraded":"2023-09-30T17:05:25.305996+0000","last_fullsized":"2023-09-30T17:05:25.305996+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:13:41.205152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"59'2836","reported_seq":2925,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306557+0000","last_change":"2023-09-30T17:05:06.293085+0000","last_active":"2023-09-30T17:05:25.306557+0000","last_peered":"2023-09-30T17:05:25.306557+0000","last_clean":"2023-09-30T17:05:25.306557+0000","last_became_active":"2023-09-30T17:05:06.291203+0000","last_became_peered":"2023-09-30T17:05:06.291203+0000","last_unstale":"2023-09-30T17:05:25.306557+0000","last_undegraded":"2023-09-30T17:05:25.306557+0000","last_fullsized":"2023-09-30T17:05:25.306557+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2836,"log_dups_size":0,"ondisk_log_size":2836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:11:28.091818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8199,"num_write_kb":39048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"59'3","reported_seq":73,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306165+0000","last_change":"2023-09-30T17:02:17.360831+0000","last_active":"2023-09-30T17:05:25.306165+0000","last_peered":"2023-09-30T17:05:25.306165+0000","last_clean":"2023-09-30T17:05:25.306165+0000","last_became_active":"2023-09-30T17:02:17.360494+0000","last_became_peered":"2023-09-30T17:02:17.360494+0000","last_unstale":"2023-09-30T17:05:25.306165+0000","last_undegraded":"2023-09-30T17:05:25.306165+0000","last_fullsized":"2023-09-30T17:05:25.306165+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:24:04.564387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306251+0000","last_change":"2023-09-30T17:02:12.328184+0000","last_active":"2023-09-30T17:05:25.306251+0000","last_peered":"2023-09-30T17:05:25.306251+0000","last_clean":"2023-09-30T17:05:25.306251+0000","last_became_active":"2023-09-30T17:02:12.327898+0000","last_became_peered":"2023-09-30T17:02:12.327898+0000","last_unstale":"2023-09-30T17:05:25.306251+0000","last_undegraded":"2023-09-30T17:05:25.306251+0000","last_fullsized":"2023-09-30T17:05:25.306251+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:43:23.161734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"59'8","reported_seq":88,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305121+0000","last_change":"2023-09-30T17:05:03.308856+0000","last_active":"2023-09-30T17:05:25.305121+0000","last_peered":"2023-09-30T17:05:25.305121+0000","last_clean":"2023-09-30T17:05:25.305121+0000","last_became_active":"2023-09-30T17:05:03.308429+0000","last_became_peered":"2023-09-30T17:05:03.308429+0000","last_unstale":"2023-09-30T17:05:25.305121+0000","last_undegraded":"2023-09-30T17:05:25.305121+0000","last_fullsized":"2023-09-30T17:05:25.305121+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:49:32.189339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305749+0000","last_change":"2023-09-30T17:05:03.304353+0000","last_active":"2023-09-30T17:05:25.305749+0000","last_peered":"2023-09-30T17:05:25.305749+0000","last_clean":"2023-09-30T17:05:25.305749+0000","last_became_active":"2023-09-30T17:05:03.302503+0000","last_became_peered":"2023-09-30T17:05:03.302503+0000","last_unstale":"2023-09-30T17:05:25.305749+0000","last_undegraded":"2023-09-30T17:05:25.305749+0000","last_fullsized":"2023-09-30T17:05:25.305749+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:19:16.151598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"60'8","reported_seq":94,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306144+0000","last_change":"2023-09-30T17:05:03.314806+0000","last_active":"2023-09-30T17:05:25.306144+0000","last_peered":"2023-09-30T17:05:25.306144+0000","last_clean":"2023-09-30T17:05:25.306144+0000","last_became_active":"2023-09-30T17:05:03.308201+0000","last_became_peered":"2023-09-30T17:05:03.308201+0000","last_unstale":"2023-09-30T17:05:25.306144+0000","last_undegraded":"2023-09-30T17:05:25.306144+0000","last_fullsized":"2023-09-30T17:05:25.306144+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:19:18.486570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"59'6","reported_seq":86,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306035+0000","last_change":"2023-09-30T17:05:03.304265+0000","last_active":"2023-09-30T17:05:25.306035+0000","last_peered":"2023-09-30T17:05:25.306035+0000","last_clean":"2023-09-30T17:05:25.306035+0000","last_became_active":"2023-09-30T17:05:03.304022+0000","last_became_peered":"2023-09-30T17:05:03.304022+0000","last_unstale":"2023-09-30T17:05:25.306035+0000","last_undegraded":"2023-09-30T17:05:25.306035+0000","last_fullsized":"2023-09-30T17:05:25.306035+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:19:19.492200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":82,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306295+0000","last_change":"2023-09-30T17:05:03.303927+0000","last_active":"2023-09-30T17:05:25.306295+0000","last_peered":"2023-09-30T17:05:25.306295+0000","last_clean":"2023-09-30T17:05:25.306295+0000","last_became_active":"2023-09-30T17:05:03.303487+0000","last_became_peered":"2023-09-30T17:05:03.303487+0000","last_unstale":"2023-09-30T17:05:25.306295+0000","last_undegraded":"2023-09-30T17:05:25.306295+0000","last_fullsized":"2023-09-30T17:05:25.306295+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:43:27.633747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"59'2835","reported_seq":2904,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306514+0000","last_change":"2023-09-30T17:02:18.358269+0000","last_active":"2023-09-30T17:05:25.306514+0000","last_peered":"2023-09-30T17:05:25.306514+0000","last_clean":"2023-09-30T17:05:25.306514+0000","last_became_active":"2023-09-30T17:02:18.356902+0000","last_became_peered":"2023-09-30T17:02:18.356902+0000","last_unstale":"2023-09-30T17:05:25.306514+0000","last_undegraded":"2023-09-30T17:05:25.306514+0000","last_fullsized":"2023-09-30T17:05:25.306514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2835,"log_dups_size":0,"ondisk_log_size":2835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:39:28.022201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8302,"num_write_kb":39500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305740+0000","last_change":"2023-09-30T17:05:03.311401+0000","last_active":"2023-09-30T17:05:25.305740+0000","last_peered":"2023-09-30T17:05:25.305740+0000","last_clean":"2023-09-30T17:05:25.305740+0000","last_became_active":"2023-09-30T17:05:03.310996+0000","last_became_peered":"2023-09-30T17:05:03.310996+0000","last_unstale":"2023-09-30T17:05:25.305740+0000","last_undegraded":"2023-09-30T17:05:25.305740+0000","last_fullsized":"2023-09-30T17:05:25.305740+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:28:19.097868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"59'2848","reported_seq":2915,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305483+0000","last_change":"2023-09-30T17:05:06.290662+0000","last_active":"2023-09-30T17:05:25.305483+0000","last_peered":"2023-09-30T17:05:25.305483+0000","last_clean":"2023-09-30T17:05:25.305483+0000","last_became_active":"2023-09-30T17:05:06.289599+0000","last_became_peered":"2023-09-30T17:05:06.289599+0000","last_unstale":"2023-09-30T17:05:25.305483+0000","last_undegraded":"2023-09-30T17:05:25.305483+0000","last_fullsized":"2023-09-30T17:05:25.305483+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2848,"log_dups_size":0,"ondisk_log_size":2848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:20:28.670256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8235,"num_write_kb":39276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"58'3","reported_seq":85,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306879+0000","last_change":"2023-09-30T17:05:03.307212+0000","last_active":"2023-09-30T17:05:25.306879+0000","last_peered":"2023-09-30T17:05:25.306879+0000","last_clean":"2023-09-30T17:05:25.306879+0000","last_became_active":"2023-09-30T17:05:03.306711+0000","last_became_peered":"2023-09-30T17:05:03.306711+0000","last_unstale":"2023-09-30T17:05:25.306879+0000","last_undegraded":"2023-09-30T17:05:25.306879+0000","last_fullsized":"2023-09-30T17:05:25.306879+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:11:56.900744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"59'10","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305401+0000","last_change":"2023-09-30T17:05:03.311669+0000","last_active":"2023-09-30T17:05:25.305401+0000","last_peered":"2023-09-30T17:05:25.305401+0000","last_clean":"2023-09-30T17:05:25.305401+0000","last_became_active":"2023-09-30T17:05:03.310763+0000","last_became_peered":"2023-09-30T17:05:03.310763+0000","last_unstale":"2023-09-30T17:05:25.305401+0000","last_undegraded":"2023-09-30T17:05:25.305401+0000","last_fullsized":"2023-09-30T17:05:25.305401+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:36:53.333402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":71,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306260+0000","last_change":"2023-09-30T17:02:17.360802+0000","last_active":"2023-09-30T17:05:25.306260+0000","last_peered":"2023-09-30T17:05:25.306260+0000","last_clean":"2023-09-30T17:05:25.306260+0000","last_became_active":"2023-09-30T17:02:17.360475+0000","last_became_peered":"2023-09-30T17:02:17.360475+0000","last_unstale":"2023-09-30T17:05:25.306260+0000","last_undegraded":"2023-09-30T17:05:25.306260+0000","last_fullsized":"2023-09-30T17:05:25.306260+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:50:18.455188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"59'5711","reported_seq":5780,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306268+0000","last_change":"2023-09-30T17:02:18.359857+0000","last_active":"2023-09-30T17:05:25.306268+0000","last_peered":"2023-09-30T17:05:25.306268+0000","last_clean":"2023-09-30T17:05:25.306268+0000","last_became_active":"2023-09-30T17:02:18.357098+0000","last_became_peered":"2023-09-30T17:02:18.357098+0000","last_unstale":"2023-09-30T17:05:25.306268+0000","last_undegraded":"2023-09-30T17:05:25.306268+0000","last_fullsized":"2023-09-30T17:05:25.306268+0000","mapping_epoch":17,"log_start":"42'1200","ondisk_log_start":"42'1200","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4511,"log_dups_size":1200,"ondisk_log_size":4511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:48:17.598726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16681,"num_write_kb":79476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":85,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306263+0000","last_change":"2023-09-30T17:05:03.313345+0000","last_active":"2023-09-30T17:05:25.306263+0000","last_peered":"2023-09-30T17:05:25.306263+0000","last_clean":"2023-09-30T17:05:25.306263+0000","last_became_active":"2023-09-30T17:05:03.313050+0000","last_became_peered":"2023-09-30T17:05:03.313050+0000","last_unstale":"2023-09-30T17:05:25.306263+0000","last_undegraded":"2023-09-30T17:05:25.306263+0000","last_fullsized":"2023-09-30T17:05:25.306263+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:24:52.247523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"59'2872","reported_seq":2939,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305196+0000","last_change":"2023-09-30T17:05:06.290298+0000","last_active":"2023-09-30T17:05:25.305196+0000","last_peered":"2023-09-30T17:05:25.305196+0000","last_clean":"2023-09-30T17:05:25.305196+0000","last_became_active":"2023-09-30T17:05:06.289197+0000","last_became_peered":"2023-09-30T17:05:06.289197+0000","last_unstale":"2023-09-30T17:05:25.305196+0000","last_undegraded":"2023-09-30T17:05:25.305196+0000","last_fullsized":"2023-09-30T17:05:25.305196+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2872,"log_dups_size":0,"ondisk_log_size":2872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:57:10.410506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8447,"num_write_kb":40072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"59'9","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305150+0000","last_change":"2023-09-30T17:05:03.310950+0000","last_active":"2023-09-30T17:05:25.305150+0000","last_peered":"2023-09-30T17:05:25.305150+0000","last_clean":"2023-09-30T17:05:25.305150+0000","last_became_active":"2023-09-30T17:05:03.310591+0000","last_became_peered":"2023-09-30T17:05:03.310591+0000","last_unstale":"2023-09-30T17:05:25.305150+0000","last_undegraded":"2023-09-30T17:05:25.305150+0000","last_fullsized":"2023-09-30T17:05:25.305150+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:26:23.194138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"59'13","reported_seq":82,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305292+0000","last_change":"2023-09-30T17:02:18.363479+0000","last_active":"2023-09-30T17:05:25.305292+0000","last_peered":"2023-09-30T17:05:25.305292+0000","last_clean":"2023-09-30T17:05:25.305292+0000","last_became_active":"2023-09-30T17:02:18.363222+0000","last_became_peered":"2023-09-30T17:02:18.363222+0000","last_unstale":"2023-09-30T17:05:25.305292+0000","last_undegraded":"2023-09-30T17:05:25.305292+0000","last_fullsized":"2023-09-30T17:05:25.305292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:09:55.056098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"59'2796","reported_seq":2885,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306184+0000","last_change":"2023-09-30T17:05:06.292455+0000","last_active":"2023-09-30T17:05:25.306184+0000","last_peered":"2023-09-30T17:05:25.306184+0000","last_clean":"2023-09-30T17:05:25.306184+0000","last_became_active":"2023-09-30T17:05:06.290929+0000","last_became_peered":"2023-09-30T17:05:06.290929+0000","last_unstale":"2023-09-30T17:05:25.306184+0000","last_undegraded":"2023-09-30T17:05:25.306184+0000","last_fullsized":"2023-09-30T17:05:25.306184+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2796,"log_dups_size":0,"ondisk_log_size":2796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:54:14.579761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8138,"num_write_kb":38784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"59'2852","reported_seq":2921,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305723+0000","last_change":"2023-09-30T17:02:18.363216+0000","last_active":"2023-09-30T17:05:25.305723+0000","last_peered":"2023-09-30T17:05:25.305723+0000","last_clean":"2023-09-30T17:05:25.305723+0000","last_became_active":"2023-09-30T17:02:18.362894+0000","last_became_peered":"2023-09-30T17:02:18.362894+0000","last_unstale":"2023-09-30T17:05:25.305723+0000","last_undegraded":"2023-09-30T17:05:25.305723+0000","last_fullsized":"2023-09-30T17:05:25.305723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2852,"log_dups_size":0,"ondisk_log_size":2852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:30:43.782165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8357,"num_write_kb":39780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"59'2874","reported_seq":2963,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306543+0000","last_change":"2023-09-30T17:05:06.294279+0000","last_active":"2023-09-30T17:05:25.306543+0000","last_peered":"2023-09-30T17:05:25.306543+0000","last_clean":"2023-09-30T17:05:25.306543+0000","last_became_active":"2023-09-30T17:05:06.292898+0000","last_became_peered":"2023-09-30T17:05:06.292898+0000","last_unstale":"2023-09-30T17:05:25.306543+0000","last_undegraded":"2023-09-30T17:05:25.306543+0000","last_fullsized":"2023-09-30T17:05:25.306543+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2874,"log_dups_size":0,"ondisk_log_size":2874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:02:14.484209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8465,"num_write_kb":40104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":532685,"num_write_kb":2575302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140940,"ondisk_log_size":140940,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":228927,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":137,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":223425,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":524288,"data_stored":457854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":66,"seq":283467841544,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47044,"kb_used_data":1460,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94324796,"statfs":{"total":96636764160,"available":96588591104,"internally_reserved":0,"allocated":1495040,"data_stored":1123985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7139,"internal_metadata":46654493},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738413,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":582456,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":580990,"kb_avail":93789384,"statfs":{"total":96636764160,"available":96040329216,"internally_reserved":0,"allocated":1482752,"data_stored":1122763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":594934214},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 17:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.51800000000000002,"15min":0.48999999999999999},"min":{"1min":0.215,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":5.9480000000000004,"5min":5.9480000000000004,"15min":5.9480000000000004},"last":0.441},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.503,"15min":0.46300000000000002},"min":{"1min":0.216,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":3.6819999999999999,"5min":3.6819999999999999,"15min":3.6819999999999999},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]}]},{"osd":1,"up_from":8,"seq":34359738413,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":563596,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":562942,"kb_avail":93808244,"statfs":{"total":96636764160,"available":96059641856,"internally_reserved":0,"allocated":651264,"data_stored":305912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":576453062},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 17:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.48599999999999999,"15min":0.45600000000000002},"min":{"1min":0.19800000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":3.3420000000000001,"5min":3.3420000000000001,"15min":3.3420000000000001},"last":0.433},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.51200000000000001,"15min":0.46000000000000002},"min":{"1min":0.189,"5min":0.188,"15min":0.188},"max":{"1min":3.5470000000000002,"5min":3.5470000000000002,"15min":3.5470000000000002},"last":0.50800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":249856,"data_stored":227705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":228927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T17:05:32.101 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T17:05:32.472 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:05:32.501 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-09-30T17:05:32.501 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":177,"stamp":"2023-09-30T17:05:31.339638+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":819295,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":140,"num_read_kb":122,"num_write":533025,"num_write_kb":2579054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":223425,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141229,"ondisk_log_size":141229,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1193096,"kb_used_data":3544,"kb_used_omap":10,"kb_used_meta":1189493,"kb_avail":281922424,"statfs":{"total":289910292480,"available":288688562176,"internally_reserved":0,"allocated":3629056,"data_stored":2552660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10327,"internal_metadata":1218041769},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.041047"},"pg_stats":[{"pgid":"4.3f","version":"59'2790","reported_seq":2859,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.307056+0000","last_change":"2023-09-30T17:02:18.360288+0000","last_active":"2023-09-30T17:05:25.307056+0000","last_peered":"2023-09-30T17:05:25.307056+0000","last_clean":"2023-09-30T17:05:25.307056+0000","last_became_active":"2023-09-30T17:02:18.358716+0000","last_became_peered":"2023-09-30T17:02:18.358716+0000","last_unstale":"2023-09-30T17:05:25.307056+0000","last_undegraded":"2023-09-30T17:05:25.307056+0000","last_fullsized":"2023-09-30T17:05:25.307056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2790,"log_dups_size":0,"ondisk_log_size":2790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:12:06.380095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8214,"num_write_kb":38924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"59'4","reported_seq":73,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306636+0000","last_change":"2023-09-30T17:02:18.362418+0000","last_active":"2023-09-30T17:05:25.306636+0000","last_peered":"2023-09-30T17:05:25.306636+0000","last_clean":"2023-09-30T17:05:25.306636+0000","last_became_active":"2023-09-30T17:02:18.360372+0000","last_became_peered":"2023-09-30T17:02:18.360372+0000","last_unstale":"2023-09-30T17:05:25.306636+0000","last_undegraded":"2023-09-30T17:05:25.306636+0000","last_fullsized":"2023-09-30T17:05:25.306636+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:43:29.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"59'5697","reported_seq":5771,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306021+0000","last_change":"2023-09-30T17:05:06.291597+0000","last_active":"2023-09-30T17:05:25.306021+0000","last_peered":"2023-09-30T17:05:25.306021+0000","last_clean":"2023-09-30T17:05:25.306021+0000","last_became_active":"2023-09-30T17:05:06.290447+0000","last_became_peered":"2023-09-30T17:05:06.290447+0000","last_unstale":"2023-09-30T17:05:25.306021+0000","last_undegraded":"2023-09-30T17:05:25.306021+0000","last_fullsized":"2023-09-30T17:05:25.306021+0000","mapping_epoch":69,"log_start":"42'1200","ondisk_log_start":"42'1200","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4497,"log_dups_size":1200,"ondisk_log_size":4497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:02:21.064107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16590,"num_write_kb":78960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"59'10","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305409+0000","last_change":"2023-09-30T17:05:03.309996+0000","last_active":"2023-09-30T17:05:25.305409+0000","last_peered":"2023-09-30T17:05:25.305409+0000","last_clean":"2023-09-30T17:05:25.305409+0000","last_became_active":"2023-09-30T17:05:03.309326+0000","last_became_peered":"2023-09-30T17:05:03.309326+0000","last_unstale":"2023-09-30T17:05:25.305409+0000","last_undegraded":"2023-09-30T17:05:25.305409+0000","last_fullsized":"2023-09-30T17:05:25.305409+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:31:23.164242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"59'2934","reported_seq":3003,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306421+0000","last_change":"2023-09-30T17:02:18.360192+0000","last_active":"2023-09-30T17:05:25.306421+0000","last_peered":"2023-09-30T17:05:25.306421+0000","last_clean":"2023-09-30T17:05:25.306421+0000","last_became_active":"2023-09-30T17:02:18.357317+0000","last_became_peered":"2023-09-30T17:02:18.357317+0000","last_unstale":"2023-09-30T17:05:25.306421+0000","last_undegraded":"2023-09-30T17:05:25.306421+0000","last_fullsized":"2023-09-30T17:05:25.306421+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2934,"log_dups_size":0,"ondisk_log_size":2934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:37:14.790993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8466,"num_write_kb":40084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"59'6","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305283+0000","last_change":"2023-09-30T17:05:03.311318+0000","last_active":"2023-09-30T17:05:25.305283+0000","last_peered":"2023-09-30T17:05:25.305283+0000","last_clean":"2023-09-30T17:05:25.305283+0000","last_became_active":"2023-09-30T17:05:03.310703+0000","last_became_peered":"2023-09-30T17:05:03.310703+0000","last_unstale":"2023-09-30T17:05:25.305283+0000","last_undegraded":"2023-09-30T17:05:25.305283+0000","last_fullsized":"2023-09-30T17:05:25.305283+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:08:45.345559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"59'7","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305160+0000","last_change":"2023-09-30T17:05:03.310838+0000","last_active":"2023-09-30T17:05:25.305160+0000","last_peered":"2023-09-30T17:05:25.305160+0000","last_clean":"2023-09-30T17:05:25.305160+0000","last_became_active":"2023-09-30T17:05:03.310047+0000","last_became_peered":"2023-09-30T17:05:03.310047+0000","last_unstale":"2023-09-30T17:05:25.305160+0000","last_undegraded":"2023-09-30T17:05:25.305160+0000","last_fullsized":"2023-09-30T17:05:25.305160+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:29:17.418059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"59'11423","reported_seq":11499,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.304794+0000","last_change":"2023-09-30T17:05:06.286653+0000","last_active":"2023-09-30T17:05:25.304794+0000","last_peered":"2023-09-30T17:05:25.304794+0000","last_clean":"2023-09-30T17:05:25.304794+0000","last_became_active":"2023-09-30T17:05:06.285582+0000","last_became_peered":"2023-09-30T17:05:06.285582+0000","last_unstale":"2023-09-30T17:05:25.304794+0000","last_undegraded":"2023-09-30T17:05:25.304794+0000","last_fullsized":"2023-09-30T17:05:25.304794+0000","mapping_epoch":69,"log_start":"52'7200","ondisk_log_start":"52'7200","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4223,"log_dups_size":5777,"ondisk_log_size":4223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:35:18.578031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33444,"num_write_kb":158924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"59'8589","reported_seq":8658,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306041+0000","last_change":"2023-09-30T17:02:18.364222+0000","last_active":"2023-09-30T17:05:25.306041+0000","last_peered":"2023-09-30T17:05:25.306041+0000","last_clean":"2023-09-30T17:05:25.306041+0000","last_became_active":"2023-09-30T17:02:18.363485+0000","last_became_peered":"2023-09-30T17:02:18.363485+0000","last_unstale":"2023-09-30T17:05:25.306041+0000","last_undegraded":"2023-09-30T17:05:25.306041+0000","last_fullsized":"2023-09-30T17:05:25.306041+0000","mapping_epoch":17,"log_start":"49'4400","ondisk_log_start":"49'4400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4189,"log_dups_size":4400,"ondisk_log_size":4189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:14:35.192615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25052,"num_write_kb":118756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"59'8585","reported_seq":8654,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306806+0000","last_change":"2023-09-30T17:02:18.360010+0000","last_active":"2023-09-30T17:05:25.306806+0000","last_peered":"2023-09-30T17:05:25.306806+0000","last_clean":"2023-09-30T17:05:25.306806+0000","last_became_active":"2023-09-30T17:02:18.358396+0000","last_became_peered":"2023-09-30T17:02:18.358396+0000","last_unstale":"2023-09-30T17:05:25.306806+0000","last_undegraded":"2023-09-30T17:05:25.306806+0000","last_fullsized":"2023-09-30T17:05:25.306806+0000","mapping_epoch":17,"log_start":"48'4100","ondisk_log_start":"48'4100","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4485,"log_dups_size":4100,"ondisk_log_size":4485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:26:11.522402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24997,"num_write_kb":162463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"59'5664","reported_seq":5740,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305719+0000","last_change":"2023-09-30T17:05:06.291535+0000","last_active":"2023-09-30T17:05:25.305719+0000","last_peered":"2023-09-30T17:05:25.305719+0000","last_clean":"2023-09-30T17:05:25.305719+0000","last_became_active":"2023-09-30T17:05:06.290193+0000","last_became_peered":"2023-09-30T17:05:06.290193+0000","last_unstale":"2023-09-30T17:05:25.305719+0000","last_undegraded":"2023-09-30T17:05:25.305719+0000","last_fullsized":"2023-09-30T17:05:25.305719+0000","mapping_epoch":69,"log_start":"43'1400","ondisk_log_start":"43'1400","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4264,"log_dups_size":1400,"ondisk_log_size":4264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:21:15.508580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16442,"num_write_kb":78308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"59'2931","reported_seq":3020,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306235+0000","last_change":"2023-09-30T17:05:06.290270+0000","last_active":"2023-09-30T17:05:25.306235+0000","last_peered":"2023-09-30T17:05:25.306235+0000","last_clean":"2023-09-30T17:05:25.306235+0000","last_became_active":"2023-09-30T17:05:06.288753+0000","last_became_peered":"2023-09-30T17:05:06.288753+0000","last_unstale":"2023-09-30T17:05:25.306235+0000","last_undegraded":"2023-09-30T17:05:25.306235+0000","last_fullsized":"2023-09-30T17:05:25.306235+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2931,"log_dups_size":0,"ondisk_log_size":2931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:38:30.988146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8488,"num_write_kb":40364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"59'2860","reported_seq":2929,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306164+0000","last_change":"2023-09-30T17:02:18.359894+0000","last_active":"2023-09-30T17:05:25.306164+0000","last_peered":"2023-09-30T17:05:25.306164+0000","last_clean":"2023-09-30T17:05:25.306164+0000","last_became_active":"2023-09-30T17:02:18.358534+0000","last_became_peered":"2023-09-30T17:02:18.358534+0000","last_unstale":"2023-09-30T17:05:25.306164+0000","last_undegraded":"2023-09-30T17:05:25.306164+0000","last_fullsized":"2023-09-30T17:05:25.306164+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2860,"log_dups_size":0,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:22:13.025181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8367,"num_write_kb":39772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"59'2911","reported_seq":2978,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305184+0000","last_change":"2023-09-30T17:05:06.289465+0000","last_active":"2023-09-30T17:05:25.305184+0000","last_peered":"2023-09-30T17:05:25.305184+0000","last_clean":"2023-09-30T17:05:25.305184+0000","last_became_active":"2023-09-30T17:05:06.288360+0000","last_became_peered":"2023-09-30T17:05:06.288360+0000","last_unstale":"2023-09-30T17:05:25.305184+0000","last_undegraded":"2023-09-30T17:05:25.305184+0000","last_fullsized":"2023-09-30T17:05:25.305184+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2911,"log_dups_size":0,"ondisk_log_size":2911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:53:55.381223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8419,"num_write_kb":39940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"59'2889","reported_seq":2956,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305078+0000","last_change":"2023-09-30T17:05:06.286551+0000","last_active":"2023-09-30T17:05:25.305078+0000","last_peered":"2023-09-30T17:05:25.305078+0000","last_clean":"2023-09-30T17:05:25.305078+0000","last_became_active":"2023-09-30T17:05:06.285738+0000","last_became_peered":"2023-09-30T17:05:06.285738+0000","last_unstale":"2023-09-30T17:05:25.305078+0000","last_undegraded":"2023-09-30T17:05:25.305078+0000","last_fullsized":"2023-09-30T17:05:25.305078+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2889,"log_dups_size":0,"ondisk_log_size":2889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:18:17.841837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8435,"num_write_kb":39984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"59'2839","reported_seq":2906,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.304983+0000","last_change":"2023-09-30T17:05:06.291173+0000","last_active":"2023-09-30T17:05:25.304983+0000","last_peered":"2023-09-30T17:05:25.304983+0000","last_clean":"2023-09-30T17:05:25.304983+0000","last_became_active":"2023-09-30T17:05:06.289872+0000","last_became_peered":"2023-09-30T17:05:06.289872+0000","last_unstale":"2023-09-30T17:05:25.304983+0000","last_undegraded":"2023-09-30T17:05:25.304983+0000","last_fullsized":"2023-09-30T17:05:25.304983+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2839,"log_dups_size":0,"ondisk_log_size":2839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:57:27.685208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8166,"num_write_kb":38928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"59'2802","reported_seq":2871,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306044+0000","last_change":"2023-09-30T17:02:18.364360+0000","last_active":"2023-09-30T17:05:25.306044+0000","last_peered":"2023-09-30T17:05:25.306044+0000","last_clean":"2023-09-30T17:05:25.306044+0000","last_became_active":"2023-09-30T17:02:18.363697+0000","last_became_peered":"2023-09-30T17:02:18.363697+0000","last_unstale":"2023-09-30T17:05:25.306044+0000","last_undegraded":"2023-09-30T17:05:25.306044+0000","last_fullsized":"2023-09-30T17:05:25.306044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2802,"log_dups_size":0,"ondisk_log_size":2802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:50:52.893768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8256,"num_write_kb":39208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"59'2860","reported_seq":2929,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306937+0000","last_change":"2023-09-30T17:02:18.360320+0000","last_active":"2023-09-30T17:05:25.306937+0000","last_peered":"2023-09-30T17:05:25.306937+0000","last_clean":"2023-09-30T17:05:25.306937+0000","last_became_active":"2023-09-30T17:02:18.357184+0000","last_became_peered":"2023-09-30T17:02:18.357184+0000","last_unstale":"2023-09-30T17:05:25.306937+0000","last_undegraded":"2023-09-30T17:05:25.306937+0000","last_fullsized":"2023-09-30T17:05:25.306937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2860,"log_dups_size":0,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:21:45.195007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8368,"num_write_kb":39616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"59'5686","reported_seq":5755,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305812+0000","last_change":"2023-09-30T17:02:18.363956+0000","last_active":"2023-09-30T17:05:25.305812+0000","last_peered":"2023-09-30T17:05:25.305812+0000","last_clean":"2023-09-30T17:05:25.305812+0000","last_became_active":"2023-09-30T17:02:18.363654+0000","last_became_peered":"2023-09-30T17:02:18.363654+0000","last_unstale":"2023-09-30T17:05:25.305812+0000","last_undegraded":"2023-09-30T17:05:25.305812+0000","last_fullsized":"2023-09-30T17:05:25.305812+0000","mapping_epoch":17,"log_start":"44'1500","ondisk_log_start":"44'1500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4186,"log_dups_size":1500,"ondisk_log_size":4186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:48:17.598726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16649,"num_write_kb":78956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"59'5799","reported_seq":5876,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305562+0000","last_change":"2023-09-30T17:05:06.290994+0000","last_active":"2023-09-30T17:05:25.305562+0000","last_peered":"2023-09-30T17:05:25.305562+0000","last_clean":"2023-09-30T17:05:25.305562+0000","last_became_active":"2023-09-30T17:05:06.289817+0000","last_became_peered":"2023-09-30T17:05:06.289817+0000","last_unstale":"2023-09-30T17:05:25.305562+0000","last_undegraded":"2023-09-30T17:05:25.305562+0000","last_fullsized":"2023-09-30T17:05:25.305562+0000","mapping_epoch":69,"log_start":"44'1600","ondisk_log_start":"44'1600","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4199,"log_dups_size":1600,"ondisk_log_size":4199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:50:21.333588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16903,"num_write_kb":80184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"59'12","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305497+0000","last_change":"2023-09-30T17:05:03.310298+0000","last_active":"2023-09-30T17:05:25.305497+0000","last_peered":"2023-09-30T17:05:25.305497+0000","last_clean":"2023-09-30T17:05:25.305497+0000","last_became_active":"2023-09-30T17:05:03.309537+0000","last_became_peered":"2023-09-30T17:05:03.309537+0000","last_unstale":"2023-09-30T17:05:25.305497+0000","last_undegraded":"2023-09-30T17:05:25.305497+0000","last_fullsized":"2023-09-30T17:05:25.305497+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:45:25.545287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"59'2879","reported_seq":2968,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306043+0000","last_change":"2023-09-30T17:05:06.292705+0000","last_active":"2023-09-30T17:05:25.306043+0000","last_peered":"2023-09-30T17:05:25.306043+0000","last_clean":"2023-09-30T17:05:25.306043+0000","last_became_active":"2023-09-30T17:05:06.290797+0000","last_became_peered":"2023-09-30T17:05:06.290797+0000","last_unstale":"2023-09-30T17:05:25.306043+0000","last_undegraded":"2023-09-30T17:05:25.306043+0000","last_fullsized":"2023-09-30T17:05:25.306043+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2879,"log_dups_size":0,"ondisk_log_size":2879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:55:01.976617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8343,"num_write_kb":39768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"59'2809","reported_seq":2898,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305406+0000","last_change":"2023-09-30T17:05:06.290594+0000","last_active":"2023-09-30T17:05:25.305406+0000","last_peered":"2023-09-30T17:05:25.305406+0000","last_clean":"2023-09-30T17:05:25.305406+0000","last_became_active":"2023-09-30T17:05:06.288837+0000","last_became_peered":"2023-09-30T17:05:06.288837+0000","last_unstale":"2023-09-30T17:05:25.305406+0000","last_undegraded":"2023-09-30T17:05:25.305406+0000","last_fullsized":"2023-09-30T17:05:25.305406+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2809,"log_dups_size":0,"ondisk_log_size":2809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:00:48.822153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8281,"num_write_kb":39472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"59'5585","reported_seq":5654,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306010+0000","last_change":"2023-09-30T17:02:18.353938+0000","last_active":"2023-09-30T17:05:25.306010+0000","last_peered":"2023-09-30T17:05:25.306010+0000","last_clean":"2023-09-30T17:05:25.306010+0000","last_became_active":"2023-09-30T17:02:18.353632+0000","last_became_peered":"2023-09-30T17:02:18.353632+0000","last_unstale":"2023-09-30T17:05:25.306010+0000","last_undegraded":"2023-09-30T17:05:25.306010+0000","last_fullsized":"2023-09-30T17:05:25.306010+0000","mapping_epoch":17,"log_start":"42'1100","ondisk_log_start":"42'1100","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4485,"log_dups_size":1100,"ondisk_log_size":4485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:09:55.056098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16523,"num_write_kb":78256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"59'2888","reported_seq":2977,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.307020+0000","last_change":"2023-09-30T17:05:06.292945+0000","last_active":"2023-09-30T17:05:25.307020+0000","last_peered":"2023-09-30T17:05:25.307020+0000","last_clean":"2023-09-30T17:05:25.307020+0000","last_became_active":"2023-09-30T17:05:06.291346+0000","last_became_peered":"2023-09-30T17:05:06.291346+0000","last_unstale":"2023-09-30T17:05:25.307020+0000","last_undegraded":"2023-09-30T17:05:25.307020+0000","last_fullsized":"2023-09-30T17:05:25.307020+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2888,"log_dups_size":0,"ondisk_log_size":2888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:53:27.316963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8371,"num_write_kb":39716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"59'18","reported_seq":98,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306046+0000","last_change":"2023-09-30T17:05:03.309295+0000","last_active":"2023-09-30T17:05:25.306046+0000","last_peered":"2023-09-30T17:05:25.306046+0000","last_clean":"2023-09-30T17:05:25.306046+0000","last_became_active":"2023-09-30T17:05:03.308884+0000","last_became_peered":"2023-09-30T17:05:03.308884+0000","last_unstale":"2023-09-30T17:05:25.306046+0000","last_undegraded":"2023-09-30T17:05:25.306046+0000","last_fullsized":"2023-09-30T17:05:25.306046+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:57:45.449671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"59'2855","reported_seq":2923,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305902+0000","last_change":"2023-09-30T17:05:06.291369+0000","last_active":"2023-09-30T17:05:25.305902+0000","last_peered":"2023-09-30T17:05:25.305902+0000","last_clean":"2023-09-30T17:05:25.305902+0000","last_became_active":"2023-09-30T17:05:06.289447+0000","last_became_peered":"2023-09-30T17:05:06.289447+0000","last_unstale":"2023-09-30T17:05:25.305902+0000","last_undegraded":"2023-09-30T17:05:25.305902+0000","last_fullsized":"2023-09-30T17:05:25.305902+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2855,"log_dups_size":0,"ondisk_log_size":2855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:17:21.412392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8347,"num_write_kb":39608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":71,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306032+0000","last_change":"2023-09-30T17:02:17.358258+0000","last_active":"2023-09-30T17:05:25.306032+0000","last_peered":"2023-09-30T17:05:25.306032+0000","last_clean":"2023-09-30T17:05:25.306032+0000","last_became_active":"2023-09-30T17:02:17.357890+0000","last_became_peered":"2023-09-30T17:02:17.357890+0000","last_unstale":"2023-09-30T17:05:25.306032+0000","last_undegraded":"2023-09-30T17:05:25.306032+0000","last_fullsized":"2023-09-30T17:05:25.306032+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:52:56.591906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"59'17","reported_seq":97,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.307002+0000","last_change":"2023-09-30T17:05:03.307486+0000","last_active":"2023-09-30T17:05:25.307002+0000","last_peered":"2023-09-30T17:05:25.307002+0000","last_clean":"2023-09-30T17:05:25.307002+0000","last_became_active":"2023-09-30T17:05:03.307012+0000","last_became_peered":"2023-09-30T17:05:03.307012+0000","last_unstale":"2023-09-30T17:05:25.307002+0000","last_undegraded":"2023-09-30T17:05:25.307002+0000","last_fullsized":"2023-09-30T17:05:25.307002+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:05:29.995730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305433+0000","last_change":"2023-09-30T17:05:03.309164+0000","last_active":"2023-09-30T17:05:25.305433+0000","last_peered":"2023-09-30T17:05:25.305433+0000","last_clean":"2023-09-30T17:05:25.305433+0000","last_became_active":"2023-09-30T17:05:03.308073+0000","last_became_peered":"2023-09-30T17:05:03.308073+0000","last_unstale":"2023-09-30T17:05:25.305433+0000","last_undegraded":"2023-09-30T17:05:25.305433+0000","last_fullsized":"2023-09-30T17:05:25.305433+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:10:16.238053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"59'6","reported_seq":86,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306073+0000","last_change":"2023-09-30T17:05:03.308692+0000","last_active":"2023-09-30T17:05:25.306073+0000","last_peered":"2023-09-30T17:05:25.306073+0000","last_clean":"2023-09-30T17:05:25.306073+0000","last_became_active":"2023-09-30T17:05:03.307932+0000","last_became_peered":"2023-09-30T17:05:03.307932+0000","last_unstale":"2023-09-30T17:05:25.306073+0000","last_undegraded":"2023-09-30T17:05:25.306073+0000","last_fullsized":"2023-09-30T17:05:25.306073+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:17:13.668052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":70,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305661+0000","last_change":"2023-09-30T17:02:17.361000+0000","last_active":"2023-09-30T17:05:25.305661+0000","last_peered":"2023-09-30T17:05:25.305661+0000","last_clean":"2023-09-30T17:05:25.305661+0000","last_became_active":"2023-09-30T17:02:17.360601+0000","last_became_peered":"2023-09-30T17:02:17.360601+0000","last_unstale":"2023-09-30T17:05:25.305661+0000","last_undegraded":"2023-09-30T17:05:25.305661+0000","last_fullsized":"2023-09-30T17:05:25.305661+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:02:27.666526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"59'7","reported_seq":87,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306929+0000","last_change":"2023-09-30T17:05:03.305898+0000","last_active":"2023-09-30T17:05:25.306929+0000","last_peered":"2023-09-30T17:05:25.306929+0000","last_clean":"2023-09-30T17:05:25.306929+0000","last_became_active":"2023-09-30T17:05:03.305520+0000","last_became_peered":"2023-09-30T17:05:03.305520+0000","last_unstale":"2023-09-30T17:05:25.306929+0000","last_undegraded":"2023-09-30T17:05:25.306929+0000","last_fullsized":"2023-09-30T17:05:25.306929+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:40:09.276369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"58'1","reported_seq":82,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306258+0000","last_change":"2023-09-30T17:05:03.309303+0000","last_active":"2023-09-30T17:05:25.306258+0000","last_peered":"2023-09-30T17:05:25.306258+0000","last_clean":"2023-09-30T17:05:25.306258+0000","last_became_active":"2023-09-30T17:05:03.308851+0000","last_became_peered":"2023-09-30T17:05:03.308851+0000","last_unstale":"2023-09-30T17:05:25.306258+0000","last_undegraded":"2023-09-30T17:05:25.306258+0000","last_fullsized":"2023-09-30T17:05:25.306258+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:32:55.497287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"59'9","reported_seq":78,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305188+0000","last_change":"2023-09-30T17:02:18.358841+0000","last_active":"2023-09-30T17:05:25.305188+0000","last_peered":"2023-09-30T17:05:25.305188+0000","last_clean":"2023-09-30T17:05:25.305188+0000","last_became_active":"2023-09-30T17:02:18.358529+0000","last_became_peered":"2023-09-30T17:02:18.358529+0000","last_unstale":"2023-09-30T17:05:25.305188+0000","last_undegraded":"2023-09-30T17:05:25.305188+0000","last_fullsized":"2023-09-30T17:05:25.305188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:15:54.364571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305635+0000","last_change":"2023-09-30T17:05:03.309409+0000","last_active":"2023-09-30T17:05:25.305635+0000","last_peered":"2023-09-30T17:05:25.305635+0000","last_clean":"2023-09-30T17:05:25.305635+0000","last_became_active":"2023-09-30T17:05:03.309023+0000","last_became_peered":"2023-09-30T17:05:03.309023+0000","last_unstale":"2023-09-30T17:05:25.305635+0000","last_undegraded":"2023-09-30T17:05:25.305635+0000","last_fullsized":"2023-09-30T17:05:25.305635+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:57:05.463330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"59'8526","reported_seq":8618,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305529+0000","last_change":"2023-09-30T17:05:06.292415+0000","last_active":"2023-09-30T17:05:25.305529+0000","last_peered":"2023-09-30T17:05:25.305529+0000","last_clean":"2023-09-30T17:05:25.305529+0000","last_became_active":"2023-09-30T17:05:06.290551+0000","last_became_peered":"2023-09-30T17:05:06.290551+0000","last_unstale":"2023-09-30T17:05:25.305529+0000","last_undegraded":"2023-09-30T17:05:25.305529+0000","last_fullsized":"2023-09-30T17:05:25.305529+0000","mapping_epoch":69,"log_start":"49'4300","ondisk_log_start":"49'4300","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4226,"log_dups_size":4300,"ondisk_log_size":4226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:59:52.758548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24873,"num_write_kb":118472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"59'7","reported_seq":93,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306635+0000","last_change":"2023-09-30T17:05:03.310987+0000","last_active":"2023-09-30T17:05:25.306635+0000","last_peered":"2023-09-30T17:05:25.306635+0000","last_clean":"2023-09-30T17:05:25.306635+0000","last_became_active":"2023-09-30T17:05:03.306646+0000","last_became_peered":"2023-09-30T17:05:03.306646+0000","last_unstale":"2023-09-30T17:05:25.306635+0000","last_undegraded":"2023-09-30T17:05:25.306635+0000","last_fullsized":"2023-09-30T17:05:25.306635+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:24:52.247523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"59'5670","reported_seq":5739,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305419+0000","last_change":"2023-09-30T17:02:18.359118+0000","last_active":"2023-09-30T17:05:25.305419+0000","last_peered":"2023-09-30T17:05:25.305419+0000","last_clean":"2023-09-30T17:05:25.305419+0000","last_became_active":"2023-09-30T17:02:18.358786+0000","last_became_peered":"2023-09-30T17:02:18.358786+0000","last_unstale":"2023-09-30T17:05:25.305419+0000","last_undegraded":"2023-09-30T17:05:25.305419+0000","last_fullsized":"2023-09-30T17:05:25.305419+0000","mapping_epoch":17,"log_start":"44'1500","ondisk_log_start":"44'1500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4170,"log_dups_size":1500,"ondisk_log_size":4170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:33:21.723864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16627,"num_write_kb":79047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"60'78","reported_seq":49,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305537+0000","last_change":"2023-09-30T17:05:03.313916+0000","last_active":"2023-09-30T17:05:25.305537+0000","last_peered":"2023-09-30T17:05:25.305537+0000","last_clean":"2023-09-30T17:05:25.305537+0000","last_became_active":"2023-09-30T17:05:03.302516+0000","last_became_peered":"2023-09-30T17:05:03.302516+0000","last_unstale":"2023-09-30T17:05:25.305537+0000","last_undegraded":"2023-09-30T17:05:25.305537+0000","last_fullsized":"2023-09-30T17:05:25.305537+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:00:50.535715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227523,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":222729,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"59'5677","reported_seq":5756,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305603+0000","last_change":"2023-09-30T17:05:06.289965+0000","last_active":"2023-09-30T17:05:25.305603+0000","last_peered":"2023-09-30T17:05:25.305603+0000","last_clean":"2023-09-30T17:05:25.305603+0000","last_became_active":"2023-09-30T17:05:06.288155+0000","last_became_peered":"2023-09-30T17:05:06.288155+0000","last_unstale":"2023-09-30T17:05:25.305603+0000","last_undegraded":"2023-09-30T17:05:25.305603+0000","last_fullsized":"2023-09-30T17:05:25.305603+0000","mapping_epoch":69,"log_start":"42'1100","ondisk_log_start":"42'1100","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4577,"log_dups_size":1100,"ondisk_log_size":4577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:26:23.188915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16579,"num_write_kb":79104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305299+0000","last_change":"2023-09-30T17:05:03.310322+0000","last_active":"2023-09-30T17:05:25.305299+0000","last_peered":"2023-09-30T17:05:25.305299+0000","last_clean":"2023-09-30T17:05:25.305299+0000","last_became_active":"2023-09-30T17:05:03.309505+0000","last_became_peered":"2023-09-30T17:05:03.309505+0000","last_unstale":"2023-09-30T17:05:25.305299+0000","last_undegraded":"2023-09-30T17:05:25.305299+0000","last_fullsized":"2023-09-30T17:05:25.305299+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:13:16.014703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"59'2836","reported_seq":2905,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306395+0000","last_change":"2023-09-30T17:02:18.360019+0000","last_active":"2023-09-30T17:05:25.306395+0000","last_peered":"2023-09-30T17:05:25.306395+0000","last_clean":"2023-09-30T17:05:25.306395+0000","last_became_active":"2023-09-30T17:02:18.358364+0000","last_became_peered":"2023-09-30T17:02:18.358364+0000","last_unstale":"2023-09-30T17:05:25.306395+0000","last_undegraded":"2023-09-30T17:05:25.306395+0000","last_fullsized":"2023-09-30T17:05:25.306395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2836,"log_dups_size":0,"ondisk_log_size":2836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:30:43.782165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8308,"num_write_kb":39456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305535+0000","last_change":"2023-09-30T17:05:03.308853+0000","last_active":"2023-09-30T17:05:25.305535+0000","last_peered":"2023-09-30T17:05:25.305535+0000","last_clean":"2023-09-30T17:05:25.305535+0000","last_became_active":"2023-09-30T17:05:03.308377+0000","last_became_peered":"2023-09-30T17:05:03.308377+0000","last_unstale":"2023-09-30T17:05:25.305535+0000","last_undegraded":"2023-09-30T17:05:25.305535+0000","last_fullsized":"2023-09-30T17:05:25.305535+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:18:42.448826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"59'2856","reported_seq":2925,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306869+0000","last_change":"2023-09-30T17:02:18.362415+0000","last_active":"2023-09-30T17:05:25.306869+0000","last_peered":"2023-09-30T17:05:25.306869+0000","last_clean":"2023-09-30T17:05:25.306869+0000","last_became_active":"2023-09-30T17:02:18.361556+0000","last_became_peered":"2023-09-30T17:02:18.361556+0000","last_unstale":"2023-09-30T17:05:25.306869+0000","last_undegraded":"2023-09-30T17:05:25.306869+0000","last_fullsized":"2023-09-30T17:05:25.306869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2856,"log_dups_size":0,"ondisk_log_size":2856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:16:41.607547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8321,"num_write_kb":39600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306039+0000","last_change":"2023-09-30T17:05:03.304220+0000","last_active":"2023-09-30T17:05:25.306039+0000","last_peered":"2023-09-30T17:05:25.306039+0000","last_clean":"2023-09-30T17:05:25.306039+0000","last_became_active":"2023-09-30T17:05:03.303598+0000","last_became_peered":"2023-09-30T17:05:03.303598+0000","last_unstale":"2023-09-30T17:05:25.306039+0000","last_undegraded":"2023-09-30T17:05:25.306039+0000","last_fullsized":"2023-09-30T17:05:25.306039+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:57:44.444041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"59'12","reported_seq":92,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306163+0000","last_change":"2023-09-30T17:05:03.313214+0000","last_active":"2023-09-30T17:05:25.306163+0000","last_peered":"2023-09-30T17:05:25.306163+0000","last_clean":"2023-09-30T17:05:25.306163+0000","last_became_active":"2023-09-30T17:05:03.312888+0000","last_became_peered":"2023-09-30T17:05:03.312888+0000","last_unstale":"2023-09-30T17:05:25.306163+0000","last_undegraded":"2023-09-30T17:05:25.306163+0000","last_fullsized":"2023-09-30T17:05:25.306163+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:40:09.276369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"59'9","reported_seq":35,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305075+0000","last_change":"2023-09-30T17:05:03.304503+0000","last_active":"2023-09-30T17:05:25.305075+0000","last_peered":"2023-09-30T17:05:25.305075+0000","last_clean":"2023-09-30T17:05:25.305075+0000","last_became_active":"2023-09-30T17:05:03.304030+0000","last_became_peered":"2023-09-30T17:05:03.304030+0000","last_unstale":"2023-09-30T17:05:25.305075+0000","last_undegraded":"2023-09-30T17:05:25.305075+0000","last_fullsized":"2023-09-30T17:05:25.305075+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:08:35.110114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"59'2892","reported_seq":2981,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306333+0000","last_change":"2023-09-30T17:05:06.290230+0000","last_active":"2023-09-30T17:05:25.306333+0000","last_peered":"2023-09-30T17:05:25.306333+0000","last_clean":"2023-09-30T17:05:25.306333+0000","last_became_active":"2023-09-30T17:05:06.288725+0000","last_became_peered":"2023-09-30T17:05:06.288725+0000","last_unstale":"2023-09-30T17:05:25.306333+0000","last_undegraded":"2023-09-30T17:05:25.306333+0000","last_fullsized":"2023-09-30T17:05:25.306333+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2892,"log_dups_size":0,"ondisk_log_size":2892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:27:28.611647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8345,"num_write_kb":39712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305902+0000","last_change":"2023-09-30T17:05:03.304339+0000","last_active":"2023-09-30T17:05:25.305902+0000","last_peered":"2023-09-30T17:05:25.305902+0000","last_clean":"2023-09-30T17:05:25.305902+0000","last_became_active":"2023-09-30T17:05:03.303179+0000","last_became_peered":"2023-09-30T17:05:03.303179+0000","last_unstale":"2023-09-30T17:05:25.305902+0000","last_undegraded":"2023-09-30T17:05:25.305902+0000","last_fullsized":"2023-09-30T17:05:25.305902+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:44:20.765682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"59'2861","reported_seq":2950,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305648+0000","last_change":"2023-09-30T17:05:06.290324+0000","last_active":"2023-09-30T17:05:25.305648+0000","last_peered":"2023-09-30T17:05:25.305648+0000","last_clean":"2023-09-30T17:05:25.305648+0000","last_became_active":"2023-09-30T17:05:06.288824+0000","last_became_peered":"2023-09-30T17:05:06.288824+0000","last_unstale":"2023-09-30T17:05:25.305648+0000","last_undegraded":"2023-09-30T17:05:25.305648+0000","last_fullsized":"2023-09-30T17:05:25.305648+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2861,"log_dups_size":0,"ondisk_log_size":2861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:51:16.138021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8384,"num_write_kb":39788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":83,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306641+0000","last_change":"2023-09-30T17:05:03.304232+0000","last_active":"2023-09-30T17:05:25.306641+0000","last_peered":"2023-09-30T17:05:25.306641+0000","last_clean":"2023-09-30T17:05:25.306641+0000","last_became_active":"2023-09-30T17:05:03.303874+0000","last_became_peered":"2023-09-30T17:05:03.303874+0000","last_unstale":"2023-09-30T17:05:25.306641+0000","last_undegraded":"2023-09-30T17:05:25.306641+0000","last_fullsized":"2023-09-30T17:05:25.306641+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:39:49.644290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"59'2","reported_seq":71,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306324+0000","last_change":"2023-09-30T17:02:18.359767+0000","last_active":"2023-09-30T17:05:25.306324+0000","last_peered":"2023-09-30T17:05:25.306324+0000","last_clean":"2023-09-30T17:05:25.306324+0000","last_became_active":"2023-09-30T17:02:18.356825+0000","last_became_peered":"2023-09-30T17:02:18.356825+0000","last_unstale":"2023-09-30T17:05:25.306324+0000","last_undegraded":"2023-09-30T17:05:25.306324+0000","last_fullsized":"2023-09-30T17:05:25.306324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:39:16.689300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305494+0000","last_change":"2023-09-30T17:05:03.305087+0000","last_active":"2023-09-30T17:05:25.305494+0000","last_peered":"2023-09-30T17:05:25.305494+0000","last_clean":"2023-09-30T17:05:25.305494+0000","last_became_active":"2023-09-30T17:05:03.304463+0000","last_became_peered":"2023-09-30T17:05:03.304463+0000","last_unstale":"2023-09-30T17:05:25.305494+0000","last_undegraded":"2023-09-30T17:05:25.305494+0000","last_fullsized":"2023-09-30T17:05:25.305494+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:33:20.829898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"59'2835","reported_seq":2903,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305096+0000","last_change":"2023-09-30T17:05:06.289598+0000","last_active":"2023-09-30T17:05:25.305096+0000","last_peered":"2023-09-30T17:05:25.305096+0000","last_clean":"2023-09-30T17:05:25.305096+0000","last_became_active":"2023-09-30T17:05:06.288712+0000","last_became_peered":"2023-09-30T17:05:06.288712+0000","last_unstale":"2023-09-30T17:05:25.305096+0000","last_undegraded":"2023-09-30T17:05:25.305096+0000","last_fullsized":"2023-09-30T17:05:25.305096+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2835,"log_dups_size":0,"ondisk_log_size":2835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:01:17.676791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8288,"num_write_kb":39388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305636+0000","last_change":"2023-09-30T17:05:03.311500+0000","last_active":"2023-09-30T17:05:25.305636+0000","last_peered":"2023-09-30T17:05:25.305636+0000","last_clean":"2023-09-30T17:05:25.305636+0000","last_became_active":"2023-09-30T17:05:03.310836+0000","last_became_peered":"2023-09-30T17:05:03.310836+0000","last_unstale":"2023-09-30T17:05:25.305636+0000","last_undegraded":"2023-09-30T17:05:25.305636+0000","last_fullsized":"2023-09-30T17:05:25.305636+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:30:09.762284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"59'8","reported_seq":88,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305917+0000","last_change":"2023-09-30T17:05:03.308917+0000","last_active":"2023-09-30T17:05:25.305917+0000","last_peered":"2023-09-30T17:05:25.305917+0000","last_clean":"2023-09-30T17:05:25.305917+0000","last_became_active":"2023-09-30T17:05:03.308214+0000","last_became_peered":"2023-09-30T17:05:03.308214+0000","last_unstale":"2023-09-30T17:05:25.305917+0000","last_undegraded":"2023-09-30T17:05:25.305917+0000","last_fullsized":"2023-09-30T17:05:25.305917+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:39:50.649920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"58'3","reported_seq":85,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305666+0000","last_change":"2023-09-30T17:05:03.308944+0000","last_active":"2023-09-30T17:05:25.305666+0000","last_peered":"2023-09-30T17:05:25.305666+0000","last_clean":"2023-09-30T17:05:25.305666+0000","last_became_active":"2023-09-30T17:05:03.308483+0000","last_became_peered":"2023-09-30T17:05:03.308483+0000","last_unstale":"2023-09-30T17:05:25.305666+0000","last_undegraded":"2023-09-30T17:05:25.305666+0000","last_fullsized":"2023-09-30T17:05:25.305666+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:43:27.633747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"59'2846","reported_seq":2913,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305422+0000","last_change":"2023-09-30T17:05:06.290255+0000","last_active":"2023-09-30T17:05:25.305422+0000","last_peered":"2023-09-30T17:05:25.305422+0000","last_clean":"2023-09-30T17:05:25.305422+0000","last_became_active":"2023-09-30T17:05:06.289225+0000","last_became_peered":"2023-09-30T17:05:06.289225+0000","last_unstale":"2023-09-30T17:05:25.305422+0000","last_undegraded":"2023-09-30T17:05:25.305422+0000","last_fullsized":"2023-09-30T17:05:25.305422+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2846,"log_dups_size":0,"ondisk_log_size":2846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:41:31.424933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8199,"num_write_kb":39160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.304959+0000","last_change":"2023-09-30T17:05:03.309689+0000","last_active":"2023-09-30T17:05:25.304959+0000","last_peered":"2023-09-30T17:05:25.304959+0000","last_clean":"2023-09-30T17:05:25.304959+0000","last_became_active":"2023-09-30T17:05:03.309318+0000","last_became_peered":"2023-09-30T17:05:03.309318+0000","last_unstale":"2023-09-30T17:05:25.304959+0000","last_undegraded":"2023-09-30T17:05:25.304959+0000","last_fullsized":"2023-09-30T17:05:25.304959+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:12:37.857480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"59'2831","reported_seq":2898,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305893+0000","last_change":"2023-09-30T17:05:06.289189+0000","last_active":"2023-09-30T17:05:25.305893+0000","last_peered":"2023-09-30T17:05:25.305893+0000","last_clean":"2023-09-30T17:05:25.305893+0000","last_became_active":"2023-09-30T17:05:06.288348+0000","last_became_peered":"2023-09-30T17:05:06.288348+0000","last_unstale":"2023-09-30T17:05:25.305893+0000","last_undegraded":"2023-09-30T17:05:25.305893+0000","last_fullsized":"2023-09-30T17:05:25.305893+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2831,"log_dups_size":0,"ondisk_log_size":2831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:51:59.540252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8336,"num_write_kb":39484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305792+0000","last_change":"2023-09-30T17:05:03.304019+0000","last_active":"2023-09-30T17:05:25.305792+0000","last_peered":"2023-09-30T17:05:25.305792+0000","last_clean":"2023-09-30T17:05:25.305792+0000","last_became_active":"2023-09-30T17:05:03.303473+0000","last_became_peered":"2023-09-30T17:05:03.303473+0000","last_unstale":"2023-09-30T17:05:25.305792+0000","last_undegraded":"2023-09-30T17:05:25.305792+0000","last_fullsized":"2023-09-30T17:05:25.305792+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:10:16.238053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"59'2884","reported_seq":2951,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306051+0000","last_change":"2023-09-30T17:05:06.289446+0000","last_active":"2023-09-30T17:05:25.306051+0000","last_peered":"2023-09-30T17:05:25.306051+0000","last_clean":"2023-09-30T17:05:25.306051+0000","last_became_active":"2023-09-30T17:05:06.288169+0000","last_became_peered":"2023-09-30T17:05:06.288169+0000","last_unstale":"2023-09-30T17:05:25.306051+0000","last_undegraded":"2023-09-30T17:05:25.306051+0000","last_fullsized":"2023-09-30T17:05:25.306051+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2884,"log_dups_size":0,"ondisk_log_size":2884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:15:23.507816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8366,"num_write_kb":39744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":70,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305775+0000","last_change":"2023-09-30T17:02:17.358811+0000","last_active":"2023-09-30T17:05:25.305775+0000","last_peered":"2023-09-30T17:05:25.305775+0000","last_clean":"2023-09-30T17:05:25.305775+0000","last_became_active":"2023-09-30T17:02:17.358582+0000","last_became_peered":"2023-09-30T17:02:17.358582+0000","last_unstale":"2023-09-30T17:05:25.305775+0000","last_undegraded":"2023-09-30T17:05:25.305775+0000","last_fullsized":"2023-09-30T17:05:25.305775+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:52:37.518693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"59'8580","reported_seq":8649,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306158+0000","last_change":"2023-09-30T17:02:18.364478+0000","last_active":"2023-09-30T17:05:25.306158+0000","last_peered":"2023-09-30T17:05:25.306158+0000","last_clean":"2023-09-30T17:05:25.306158+0000","last_became_active":"2023-09-30T17:02:18.364057+0000","last_became_peered":"2023-09-30T17:02:18.364057+0000","last_unstale":"2023-09-30T17:05:25.306158+0000","last_undegraded":"2023-09-30T17:05:25.306158+0000","last_fullsized":"2023-09-30T17:05:25.306158+0000","mapping_epoch":17,"log_start":"49'4400","ondisk_log_start":"49'4400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4180,"log_dups_size":4400,"ondisk_log_size":4180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:13:55.555700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25046,"num_write_kb":118972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305797+0000","last_change":"2023-09-30T17:02:12.327704+0000","last_active":"2023-09-30T17:05:25.305797+0000","last_peered":"2023-09-30T17:05:25.305797+0000","last_clean":"2023-09-30T17:05:25.305797+0000","last_became_active":"2023-09-30T17:02:12.327384+0000","last_became_peered":"2023-09-30T17:02:12.327384+0000","last_unstale":"2023-09-30T17:05:25.305797+0000","last_undegraded":"2023-09-30T17:05:25.305797+0000","last_fullsized":"2023-09-30T17:05:25.305797+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:09:34.818252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306075+0000","last_change":"2023-09-30T17:05:03.311271+0000","last_active":"2023-09-30T17:05:25.306075+0000","last_peered":"2023-09-30T17:05:25.306075+0000","last_clean":"2023-09-30T17:05:25.306075+0000","last_became_active":"2023-09-30T17:05:03.310655+0000","last_became_peered":"2023-09-30T17:05:03.310655+0000","last_unstale":"2023-09-30T17:05:25.306075+0000","last_undegraded":"2023-09-30T17:05:25.306075+0000","last_fullsized":"2023-09-30T17:05:25.306075+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:49:35.748952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"59'9","reported_seq":89,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306198+0000","last_change":"2023-09-30T17:05:03.306223+0000","last_active":"2023-09-30T17:05:25.306198+0000","last_peered":"2023-09-30T17:05:25.306198+0000","last_clean":"2023-09-30T17:05:25.306198+0000","last_became_active":"2023-09-30T17:05:03.305956+0000","last_became_peered":"2023-09-30T17:05:03.305956+0000","last_unstale":"2023-09-30T17:05:25.306198+0000","last_undegraded":"2023-09-30T17:05:25.306198+0000","last_fullsized":"2023-09-30T17:05:25.306198+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:32:56.502917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.304959+0000","last_change":"2023-09-30T17:05:03.309359+0000","last_active":"2023-09-30T17:05:25.304959+0000","last_peered":"2023-09-30T17:05:25.304959+0000","last_clean":"2023-09-30T17:05:25.304959+0000","last_became_active":"2023-09-30T17:05:03.308944+0000","last_became_peered":"2023-09-30T17:05:03.308944+0000","last_unstale":"2023-09-30T17:05:25.304959+0000","last_undegraded":"2023-09-30T17:05:25.304959+0000","last_fullsized":"2023-09-30T17:05:25.304959+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:02:58.156693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305781+0000","last_change":"2023-09-30T17:05:03.311106+0000","last_active":"2023-09-30T17:05:25.305781+0000","last_peered":"2023-09-30T17:05:25.305781+0000","last_clean":"2023-09-30T17:05:25.305781+0000","last_became_active":"2023-09-30T17:05:03.310706+0000","last_became_peered":"2023-09-30T17:05:03.310706+0000","last_unstale":"2023-09-30T17:05:25.305781+0000","last_undegraded":"2023-09-30T17:05:25.305781+0000","last_fullsized":"2023-09-30T17:05:25.305781+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:04:03.231664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"59'9","reported_seq":78,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305690+0000","last_change":"2023-09-30T17:02:18.363399+0000","last_active":"2023-09-30T17:05:25.305690+0000","last_peered":"2023-09-30T17:05:25.305690+0000","last_clean":"2023-09-30T17:05:25.305690+0000","last_became_active":"2023-09-30T17:02:18.363064+0000","last_became_peered":"2023-09-30T17:02:18.363064+0000","last_unstale":"2023-09-30T17:05:25.305690+0000","last_undegraded":"2023-09-30T17:05:25.305690+0000","last_fullsized":"2023-09-30T17:05:25.305690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:32:34.654264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305329+0000","last_change":"2023-09-30T17:02:12.327834+0000","last_active":"2023-09-30T17:05:25.305329+0000","last_peered":"2023-09-30T17:05:25.305329+0000","last_clean":"2023-09-30T17:05:25.305329+0000","last_became_active":"2023-09-30T17:02:12.327542+0000","last_became_peered":"2023-09-30T17:02:12.327542+0000","last_unstale":"2023-09-30T17:05:25.305329+0000","last_undegraded":"2023-09-30T17:05:25.305329+0000","last_fullsized":"2023-09-30T17:05:25.305329+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:49:54.890769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305806+0000","last_change":"2023-09-30T17:05:03.305668+0000","last_active":"2023-09-30T17:05:25.305806+0000","last_peered":"2023-09-30T17:05:25.305806+0000","last_clean":"2023-09-30T17:05:25.305806+0000","last_became_active":"2023-09-30T17:05:03.305222+0000","last_became_peered":"2023-09-30T17:05:03.305222+0000","last_unstale":"2023-09-30T17:05:25.305806+0000","last_undegraded":"2023-09-30T17:05:25.305806+0000","last_fullsized":"2023-09-30T17:05:25.305806+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:17:12.662422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"59'6","reported_seq":75,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306348+0000","last_change":"2023-09-30T17:02:18.364406+0000","last_active":"2023-09-30T17:05:25.306348+0000","last_peered":"2023-09-30T17:05:25.306348+0000","last_clean":"2023-09-30T17:05:25.306348+0000","last_became_active":"2023-09-30T17:02:18.363849+0000","last_became_peered":"2023-09-30T17:02:18.363849+0000","last_unstale":"2023-09-30T17:05:25.306348+0000","last_undegraded":"2023-09-30T17:05:25.306348+0000","last_fullsized":"2023-09-30T17:05:25.306348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:43:29.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305302+0000","last_change":"2023-09-30T17:05:03.310062+0000","last_active":"2023-09-30T17:05:25.305302+0000","last_peered":"2023-09-30T17:05:25.305302+0000","last_clean":"2023-09-30T17:05:25.305302+0000","last_became_active":"2023-09-30T17:05:03.308958+0000","last_became_peered":"2023-09-30T17:05:03.308958+0000","last_unstale":"2023-09-30T17:05:25.305302+0000","last_undegraded":"2023-09-30T17:05:25.305302+0000","last_fullsized":"2023-09-30T17:05:25.305302+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:05:26.347633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":225,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.304940+0000","last_change":"2023-09-30T17:05:03.303046+0000","last_active":"2023-09-30T17:05:25.304940+0000","last_peered":"2023-09-30T17:05:25.304940+0000","last_clean":"2023-09-30T17:05:25.304940+0000","last_became_active":"2023-09-30T17:05:03.302265+0000","last_became_peered":"2023-09-30T17:05:03.302265+0000","last_unstale":"2023-09-30T17:05:25.304940+0000","last_undegraded":"2023-09-30T17:05:25.304940+0000","last_fullsized":"2023-09-30T17:05:25.304940+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:06.295501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:06.295501+0000","last_clean_scrub_stamp":"2023-09-30T17:02:06.295501+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:07:24.603358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":70,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305369+0000","last_change":"2023-09-30T17:02:17.357139+0000","last_active":"2023-09-30T17:05:25.305369+0000","last_peered":"2023-09-30T17:05:25.305369+0000","last_clean":"2023-09-30T17:05:25.305369+0000","last_became_active":"2023-09-30T17:02:17.356901+0000","last_became_peered":"2023-09-30T17:02:17.356901+0000","last_unstale":"2023-09-30T17:05:25.305369+0000","last_undegraded":"2023-09-30T17:05:25.305369+0000","last_fullsized":"2023-09-30T17:05:25.305369+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:22:35.747671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"59'7","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305738+0000","last_change":"2023-09-30T17:05:03.305199+0000","last_active":"2023-09-30T17:05:25.305738+0000","last_peered":"2023-09-30T17:05:25.305738+0000","last_clean":"2023-09-30T17:05:25.305738+0000","last_became_active":"2023-09-30T17:05:03.304974+0000","last_became_peered":"2023-09-30T17:05:03.304974+0000","last_unstale":"2023-09-30T17:05:25.305738+0000","last_undegraded":"2023-09-30T17:05:25.305738+0000","last_fullsized":"2023-09-30T17:05:25.305738+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:03:27.429545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305080+0000","last_change":"2023-09-30T17:05:03.303739+0000","last_active":"2023-09-30T17:05:25.305080+0000","last_peered":"2023-09-30T17:05:25.305080+0000","last_clean":"2023-09-30T17:05:25.305080+0000","last_became_active":"2023-09-30T17:05:03.302590+0000","last_became_peered":"2023-09-30T17:05:03.302590+0000","last_unstale":"2023-09-30T17:05:25.305080+0000","last_undegraded":"2023-09-30T17:05:25.305080+0000","last_fullsized":"2023-09-30T17:05:25.305080+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:51:30.199616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"59'5","reported_seq":94,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305237+0000","last_change":"2023-09-30T17:05:03.318439+0000","last_active":"2023-09-30T17:05:25.305237+0000","last_peered":"2023-09-30T17:05:25.305237+0000","last_clean":"2023-09-30T17:05:25.305237+0000","last_became_active":"2023-09-30T17:05:03.308059+0000","last_became_peered":"2023-09-30T17:05:03.308059+0000","last_unstale":"2023-09-30T17:05:25.305237+0000","last_undegraded":"2023-09-30T17:05:25.305237+0000","last_fullsized":"2023-09-30T17:05:25.305237+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:16:25.170638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"59'11252","reported_seq":11321,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306870+0000","last_change":"2023-09-30T17:02:18.360029+0000","last_active":"2023-09-30T17:05:25.306870+0000","last_peered":"2023-09-30T17:05:25.306870+0000","last_clean":"2023-09-30T17:05:25.306870+0000","last_became_active":"2023-09-30T17:02:18.356839+0000","last_became_peered":"2023-09-30T17:02:18.356839+0000","last_unstale":"2023-09-30T17:05:25.306870+0000","last_undegraded":"2023-09-30T17:05:25.306870+0000","last_fullsized":"2023-09-30T17:05:25.306870+0000","mapping_epoch":17,"log_start":"51'6700","ondisk_log_start":"51'6700","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4552,"log_dups_size":6700,"ondisk_log_size":4552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:16:27.516884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33068,"num_write_kb":157144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":73,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306724+0000","last_change":"2023-09-30T17:02:12.330472+0000","last_active":"2023-09-30T17:05:25.306724+0000","last_peered":"2023-09-30T17:05:25.306724+0000","last_clean":"2023-09-30T17:05:25.306724+0000","last_became_active":"2023-09-30T17:02:12.330154+0000","last_became_peered":"2023-09-30T17:02:12.330154+0000","last_unstale":"2023-09-30T17:05:25.306724+0000","last_undegraded":"2023-09-30T17:05:25.306724+0000","last_fullsized":"2023-09-30T17:05:25.306724+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:43:23.161734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":70,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305996+0000","last_change":"2023-09-30T17:02:17.361007+0000","last_active":"2023-09-30T17:05:25.305996+0000","last_peered":"2023-09-30T17:05:25.305996+0000","last_clean":"2023-09-30T17:05:25.305996+0000","last_became_active":"2023-09-30T17:02:17.360721+0000","last_became_peered":"2023-09-30T17:02:17.360721+0000","last_unstale":"2023-09-30T17:05:25.305996+0000","last_undegraded":"2023-09-30T17:05:25.305996+0000","last_fullsized":"2023-09-30T17:05:25.305996+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:13:41.205152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"59'2836","reported_seq":2925,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306557+0000","last_change":"2023-09-30T17:05:06.293085+0000","last_active":"2023-09-30T17:05:25.306557+0000","last_peered":"2023-09-30T17:05:25.306557+0000","last_clean":"2023-09-30T17:05:25.306557+0000","last_became_active":"2023-09-30T17:05:06.291203+0000","last_became_peered":"2023-09-30T17:05:06.291203+0000","last_unstale":"2023-09-30T17:05:25.306557+0000","last_undegraded":"2023-09-30T17:05:25.306557+0000","last_fullsized":"2023-09-30T17:05:25.306557+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2836,"log_dups_size":0,"ondisk_log_size":2836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:11:28.091818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8199,"num_write_kb":39048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"59'3","reported_seq":73,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306165+0000","last_change":"2023-09-30T17:02:17.360831+0000","last_active":"2023-09-30T17:05:25.306165+0000","last_peered":"2023-09-30T17:05:25.306165+0000","last_clean":"2023-09-30T17:05:25.306165+0000","last_became_active":"2023-09-30T17:02:17.360494+0000","last_became_peered":"2023-09-30T17:02:17.360494+0000","last_unstale":"2023-09-30T17:05:25.306165+0000","last_undegraded":"2023-09-30T17:05:25.306165+0000","last_fullsized":"2023-09-30T17:05:25.306165+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:24:04.564387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306251+0000","last_change":"2023-09-30T17:02:12.328184+0000","last_active":"2023-09-30T17:05:25.306251+0000","last_peered":"2023-09-30T17:05:25.306251+0000","last_clean":"2023-09-30T17:05:25.306251+0000","last_became_active":"2023-09-30T17:02:12.327898+0000","last_became_peered":"2023-09-30T17:02:12.327898+0000","last_unstale":"2023-09-30T17:05:25.306251+0000","last_undegraded":"2023-09-30T17:05:25.306251+0000","last_fullsized":"2023-09-30T17:05:25.306251+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:43:23.161734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"59'8","reported_seq":88,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305121+0000","last_change":"2023-09-30T17:05:03.308856+0000","last_active":"2023-09-30T17:05:25.305121+0000","last_peered":"2023-09-30T17:05:25.305121+0000","last_clean":"2023-09-30T17:05:25.305121+0000","last_became_active":"2023-09-30T17:05:03.308429+0000","last_became_peered":"2023-09-30T17:05:03.308429+0000","last_unstale":"2023-09-30T17:05:25.305121+0000","last_undegraded":"2023-09-30T17:05:25.305121+0000","last_fullsized":"2023-09-30T17:05:25.305121+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:49:32.189339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305749+0000","last_change":"2023-09-30T17:05:03.304353+0000","last_active":"2023-09-30T17:05:25.305749+0000","last_peered":"2023-09-30T17:05:25.305749+0000","last_clean":"2023-09-30T17:05:25.305749+0000","last_became_active":"2023-09-30T17:05:03.302503+0000","last_became_peered":"2023-09-30T17:05:03.302503+0000","last_unstale":"2023-09-30T17:05:25.305749+0000","last_undegraded":"2023-09-30T17:05:25.305749+0000","last_fullsized":"2023-09-30T17:05:25.305749+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:19:16.151598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"60'8","reported_seq":94,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306144+0000","last_change":"2023-09-30T17:05:03.314806+0000","last_active":"2023-09-30T17:05:25.306144+0000","last_peered":"2023-09-30T17:05:25.306144+0000","last_clean":"2023-09-30T17:05:25.306144+0000","last_became_active":"2023-09-30T17:05:03.308201+0000","last_became_peered":"2023-09-30T17:05:03.308201+0000","last_unstale":"2023-09-30T17:05:25.306144+0000","last_undegraded":"2023-09-30T17:05:25.306144+0000","last_fullsized":"2023-09-30T17:05:25.306144+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:19:18.486570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"59'6","reported_seq":86,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306035+0000","last_change":"2023-09-30T17:05:03.304265+0000","last_active":"2023-09-30T17:05:25.306035+0000","last_peered":"2023-09-30T17:05:25.306035+0000","last_clean":"2023-09-30T17:05:25.306035+0000","last_became_active":"2023-09-30T17:05:03.304022+0000","last_became_peered":"2023-09-30T17:05:03.304022+0000","last_unstale":"2023-09-30T17:05:25.306035+0000","last_undegraded":"2023-09-30T17:05:25.306035+0000","last_fullsized":"2023-09-30T17:05:25.306035+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:19:19.492200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":82,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306295+0000","last_change":"2023-09-30T17:05:03.303927+0000","last_active":"2023-09-30T17:05:25.306295+0000","last_peered":"2023-09-30T17:05:25.306295+0000","last_clean":"2023-09-30T17:05:25.306295+0000","last_became_active":"2023-09-30T17:05:03.303487+0000","last_became_peered":"2023-09-30T17:05:03.303487+0000","last_unstale":"2023-09-30T17:05:25.306295+0000","last_undegraded":"2023-09-30T17:05:25.306295+0000","last_fullsized":"2023-09-30T17:05:25.306295+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:43:27.633747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"59'2835","reported_seq":2904,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306514+0000","last_change":"2023-09-30T17:02:18.358269+0000","last_active":"2023-09-30T17:05:25.306514+0000","last_peered":"2023-09-30T17:05:25.306514+0000","last_clean":"2023-09-30T17:05:25.306514+0000","last_became_active":"2023-09-30T17:02:18.356902+0000","last_became_peered":"2023-09-30T17:02:18.356902+0000","last_unstale":"2023-09-30T17:05:25.306514+0000","last_undegraded":"2023-09-30T17:05:25.306514+0000","last_fullsized":"2023-09-30T17:05:25.306514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2835,"log_dups_size":0,"ondisk_log_size":2835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:39:28.022201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8302,"num_write_kb":39500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305740+0000","last_change":"2023-09-30T17:05:03.311401+0000","last_active":"2023-09-30T17:05:25.305740+0000","last_peered":"2023-09-30T17:05:25.305740+0000","last_clean":"2023-09-30T17:05:25.305740+0000","last_became_active":"2023-09-30T17:05:03.310996+0000","last_became_peered":"2023-09-30T17:05:03.310996+0000","last_unstale":"2023-09-30T17:05:25.305740+0000","last_undegraded":"2023-09-30T17:05:25.305740+0000","last_fullsized":"2023-09-30T17:05:25.305740+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:28:19.097868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"59'2848","reported_seq":2915,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305483+0000","last_change":"2023-09-30T17:05:06.290662+0000","last_active":"2023-09-30T17:05:25.305483+0000","last_peered":"2023-09-30T17:05:25.305483+0000","last_clean":"2023-09-30T17:05:25.305483+0000","last_became_active":"2023-09-30T17:05:06.289599+0000","last_became_peered":"2023-09-30T17:05:06.289599+0000","last_unstale":"2023-09-30T17:05:25.305483+0000","last_undegraded":"2023-09-30T17:05:25.305483+0000","last_fullsized":"2023-09-30T17:05:25.305483+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2848,"log_dups_size":0,"ondisk_log_size":2848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:20:28.670256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8235,"num_write_kb":39276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"58'3","reported_seq":85,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306879+0000","last_change":"2023-09-30T17:05:03.307212+0000","last_active":"2023-09-30T17:05:25.306879+0000","last_peered":"2023-09-30T17:05:25.306879+0000","last_clean":"2023-09-30T17:05:25.306879+0000","last_became_active":"2023-09-30T17:05:03.306711+0000","last_became_peered":"2023-09-30T17:05:03.306711+0000","last_unstale":"2023-09-30T17:05:25.306879+0000","last_undegraded":"2023-09-30T17:05:25.306879+0000","last_fullsized":"2023-09-30T17:05:25.306879+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:11:56.900744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"59'10","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305401+0000","last_change":"2023-09-30T17:05:03.311669+0000","last_active":"2023-09-30T17:05:25.305401+0000","last_peered":"2023-09-30T17:05:25.305401+0000","last_clean":"2023-09-30T17:05:25.305401+0000","last_became_active":"2023-09-30T17:05:03.310763+0000","last_became_peered":"2023-09-30T17:05:03.310763+0000","last_unstale":"2023-09-30T17:05:25.305401+0000","last_undegraded":"2023-09-30T17:05:25.305401+0000","last_fullsized":"2023-09-30T17:05:25.305401+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:36:53.333402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":71,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306260+0000","last_change":"2023-09-30T17:02:17.360802+0000","last_active":"2023-09-30T17:05:25.306260+0000","last_peered":"2023-09-30T17:05:25.306260+0000","last_clean":"2023-09-30T17:05:25.306260+0000","last_became_active":"2023-09-30T17:02:17.360475+0000","last_became_peered":"2023-09-30T17:02:17.360475+0000","last_unstale":"2023-09-30T17:05:25.306260+0000","last_undegraded":"2023-09-30T17:05:25.306260+0000","last_fullsized":"2023-09-30T17:05:25.306260+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:50:18.455188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"59'5711","reported_seq":5780,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306268+0000","last_change":"2023-09-30T17:02:18.359857+0000","last_active":"2023-09-30T17:05:25.306268+0000","last_peered":"2023-09-30T17:05:25.306268+0000","last_clean":"2023-09-30T17:05:25.306268+0000","last_became_active":"2023-09-30T17:02:18.357098+0000","last_became_peered":"2023-09-30T17:02:18.357098+0000","last_unstale":"2023-09-30T17:05:25.306268+0000","last_undegraded":"2023-09-30T17:05:25.306268+0000","last_fullsized":"2023-09-30T17:05:25.306268+0000","mapping_epoch":17,"log_start":"42'1200","ondisk_log_start":"42'1200","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4511,"log_dups_size":1200,"ondisk_log_size":4511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:48:17.598726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16681,"num_write_kb":79476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":85,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306263+0000","last_change":"2023-09-30T17:05:03.313345+0000","last_active":"2023-09-30T17:05:25.306263+0000","last_peered":"2023-09-30T17:05:25.306263+0000","last_clean":"2023-09-30T17:05:25.306263+0000","last_became_active":"2023-09-30T17:05:03.313050+0000","last_became_peered":"2023-09-30T17:05:03.313050+0000","last_unstale":"2023-09-30T17:05:25.306263+0000","last_undegraded":"2023-09-30T17:05:25.306263+0000","last_fullsized":"2023-09-30T17:05:25.306263+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:24:52.247523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"59'2872","reported_seq":2939,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305196+0000","last_change":"2023-09-30T17:05:06.290298+0000","last_active":"2023-09-30T17:05:25.305196+0000","last_peered":"2023-09-30T17:05:25.305196+0000","last_clean":"2023-09-30T17:05:25.305196+0000","last_became_active":"2023-09-30T17:05:06.289197+0000","last_became_peered":"2023-09-30T17:05:06.289197+0000","last_unstale":"2023-09-30T17:05:25.305196+0000","last_undegraded":"2023-09-30T17:05:25.305196+0000","last_fullsized":"2023-09-30T17:05:25.305196+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2872,"log_dups_size":0,"ondisk_log_size":2872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:57:10.410506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8447,"num_write_kb":40072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"59'9","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305150+0000","last_change":"2023-09-30T17:05:03.310950+0000","last_active":"2023-09-30T17:05:25.305150+0000","last_peered":"2023-09-30T17:05:25.305150+0000","last_clean":"2023-09-30T17:05:25.305150+0000","last_became_active":"2023-09-30T17:05:03.310591+0000","last_became_peered":"2023-09-30T17:05:03.310591+0000","last_unstale":"2023-09-30T17:05:25.305150+0000","last_undegraded":"2023-09-30T17:05:25.305150+0000","last_fullsized":"2023-09-30T17:05:25.305150+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:26:23.194138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"59'13","reported_seq":82,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305292+0000","last_change":"2023-09-30T17:02:18.363479+0000","last_active":"2023-09-30T17:05:25.305292+0000","last_peered":"2023-09-30T17:05:25.305292+0000","last_clean":"2023-09-30T17:05:25.305292+0000","last_became_active":"2023-09-30T17:02:18.363222+0000","last_became_peered":"2023-09-30T17:02:18.363222+0000","last_unstale":"2023-09-30T17:05:25.305292+0000","last_undegraded":"2023-09-30T17:05:25.305292+0000","last_fullsized":"2023-09-30T17:05:25.305292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:09:55.056098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"59'2796","reported_seq":2885,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306184+0000","last_change":"2023-09-30T17:05:06.292455+0000","last_active":"2023-09-30T17:05:25.306184+0000","last_peered":"2023-09-30T17:05:25.306184+0000","last_clean":"2023-09-30T17:05:25.306184+0000","last_became_active":"2023-09-30T17:05:06.290929+0000","last_became_peered":"2023-09-30T17:05:06.290929+0000","last_unstale":"2023-09-30T17:05:25.306184+0000","last_undegraded":"2023-09-30T17:05:25.306184+0000","last_fullsized":"2023-09-30T17:05:25.306184+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2796,"log_dups_size":0,"ondisk_log_size":2796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:54:14.579761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8138,"num_write_kb":38784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"59'2852","reported_seq":2921,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305723+0000","last_change":"2023-09-30T17:02:18.363216+0000","last_active":"2023-09-30T17:05:25.305723+0000","last_peered":"2023-09-30T17:05:25.305723+0000","last_clean":"2023-09-30T17:05:25.305723+0000","last_became_active":"2023-09-30T17:02:18.362894+0000","last_became_peered":"2023-09-30T17:02:18.362894+0000","last_unstale":"2023-09-30T17:05:25.305723+0000","last_undegraded":"2023-09-30T17:05:25.305723+0000","last_fullsized":"2023-09-30T17:05:25.305723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2852,"log_dups_size":0,"ondisk_log_size":2852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:30:43.782165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8357,"num_write_kb":39780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"59'2874","reported_seq":2963,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306543+0000","last_change":"2023-09-30T17:05:06.294279+0000","last_active":"2023-09-30T17:05:25.306543+0000","last_peered":"2023-09-30T17:05:25.306543+0000","last_clean":"2023-09-30T17:05:25.306543+0000","last_became_active":"2023-09-30T17:05:06.292898+0000","last_became_peered":"2023-09-30T17:05:06.292898+0000","last_unstale":"2023-09-30T17:05:25.306543+0000","last_undegraded":"2023-09-30T17:05:25.306543+0000","last_fullsized":"2023-09-30T17:05:25.306543+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2874,"log_dups_size":0,"ondisk_log_size":2874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:02:14.484209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8465,"num_write_kb":40104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":532685,"num_write_kb":2575302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140940,"ondisk_log_size":140940,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":228927,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":137,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":223425,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":524288,"data_stored":457854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":66,"seq":283467841544,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47044,"kb_used_data":1460,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94324796,"statfs":{"total":96636764160,"available":96588591104,"internally_reserved":0,"allocated":1495040,"data_stored":1123985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7139,"internal_metadata":46654493},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738413,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":582456,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":580990,"kb_avail":93789384,"statfs":{"total":96636764160,"available":96040329216,"internally_reserved":0,"allocated":1482752,"data_stored":1122763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":594934214},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 17:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.51800000000000002,"15min":0.48999999999999999},"min":{"1min":0.215,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":5.9480000000000004,"5min":5.9480000000000004,"15min":5.9480000000000004},"last":0.441},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.503,"15min":0.46300000000000002},"min":{"1min":0.216,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":3.6819999999999999,"5min":3.6819999999999999,"15min":3.6819999999999999},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]}]},{"osd":1,"up_from":8,"seq":34359738413,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":563596,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":562942,"kb_avail":93808244,"statfs":{"total":96636764160,"available":96059641856,"internally_reserved":0,"allocated":651264,"data_stored":305912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":576453062},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 17:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.48599999999999999,"15min":0.45600000000000002},"min":{"1min":0.19800000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":3.3420000000000001,"5min":3.3420000000000001,"15min":3.3420000000000001},"last":0.433},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.51200000000000001,"15min":0.46000000000000002},"min":{"1min":0.189,"5min":0.188,"15min":0.188},"max":{"1min":3.5470000000000002,"5min":3.5470000000000002,"15min":3.5470000000000002},"last":0.50800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":249856,"data_stored":227705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":228927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T17:05:32.719 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-09-30T17:05:32.719 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T17:05:33.064 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:05:33.066 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-09-30T17:05:33.076 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":177,"stamp":"2023-09-30T17:05:31.339638+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":819295,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":140,"num_read_kb":122,"num_write":533025,"num_write_kb":2579054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":223425,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141229,"ondisk_log_size":141229,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1193096,"kb_used_data":3544,"kb_used_omap":10,"kb_used_meta":1189493,"kb_avail":281922424,"statfs":{"total":289910292480,"available":288688562176,"internally_reserved":0,"allocated":3629056,"data_stored":2552660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10327,"internal_metadata":1218041769},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.041047"},"pg_stats":[{"pgid":"4.3f","version":"59'2790","reported_seq":2859,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.307056+0000","last_change":"2023-09-30T17:02:18.360288+0000","last_active":"2023-09-30T17:05:25.307056+0000","last_peered":"2023-09-30T17:05:25.307056+0000","last_clean":"2023-09-30T17:05:25.307056+0000","last_became_active":"2023-09-30T17:02:18.358716+0000","last_became_peered":"2023-09-30T17:02:18.358716+0000","last_unstale":"2023-09-30T17:05:25.307056+0000","last_undegraded":"2023-09-30T17:05:25.307056+0000","last_fullsized":"2023-09-30T17:05:25.307056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2790,"log_dups_size":0,"ondisk_log_size":2790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:12:06.380095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8214,"num_write_kb":38924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"59'4","reported_seq":73,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306636+0000","last_change":"2023-09-30T17:02:18.362418+0000","last_active":"2023-09-30T17:05:25.306636+0000","last_peered":"2023-09-30T17:05:25.306636+0000","last_clean":"2023-09-30T17:05:25.306636+0000","last_became_active":"2023-09-30T17:02:18.360372+0000","last_became_peered":"2023-09-30T17:02:18.360372+0000","last_unstale":"2023-09-30T17:05:25.306636+0000","last_undegraded":"2023-09-30T17:05:25.306636+0000","last_fullsized":"2023-09-30T17:05:25.306636+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:43:29.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"59'5697","reported_seq":5771,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306021+0000","last_change":"2023-09-30T17:05:06.291597+0000","last_active":"2023-09-30T17:05:25.306021+0000","last_peered":"2023-09-30T17:05:25.306021+0000","last_clean":"2023-09-30T17:05:25.306021+0000","last_became_active":"2023-09-30T17:05:06.290447+0000","last_became_peered":"2023-09-30T17:05:06.290447+0000","last_unstale":"2023-09-30T17:05:25.306021+0000","last_undegraded":"2023-09-30T17:05:25.306021+0000","last_fullsized":"2023-09-30T17:05:25.306021+0000","mapping_epoch":69,"log_start":"42'1200","ondisk_log_start":"42'1200","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4497,"log_dups_size":1200,"ondisk_log_size":4497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:02:21.064107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16590,"num_write_kb":78960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"59'10","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305409+0000","last_change":"2023-09-30T17:05:03.309996+0000","last_active":"2023-09-30T17:05:25.305409+0000","last_peered":"2023-09-30T17:05:25.305409+0000","last_clean":"2023-09-30T17:05:25.305409+0000","last_became_active":"2023-09-30T17:05:03.309326+0000","last_became_peered":"2023-09-30T17:05:03.309326+0000","last_unstale":"2023-09-30T17:05:25.305409+0000","last_undegraded":"2023-09-30T17:05:25.305409+0000","last_fullsized":"2023-09-30T17:05:25.305409+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:31:23.164242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"59'2934","reported_seq":3003,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306421+0000","last_change":"2023-09-30T17:02:18.360192+0000","last_active":"2023-09-30T17:05:25.306421+0000","last_peered":"2023-09-30T17:05:25.306421+0000","last_clean":"2023-09-30T17:05:25.306421+0000","last_became_active":"2023-09-30T17:02:18.357317+0000","last_became_peered":"2023-09-30T17:02:18.357317+0000","last_unstale":"2023-09-30T17:05:25.306421+0000","last_undegraded":"2023-09-30T17:05:25.306421+0000","last_fullsized":"2023-09-30T17:05:25.306421+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2934,"log_dups_size":0,"ondisk_log_size":2934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:37:14.790993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8466,"num_write_kb":40084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"59'6","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305283+0000","last_change":"2023-09-30T17:05:03.311318+0000","last_active":"2023-09-30T17:05:25.305283+0000","last_peered":"2023-09-30T17:05:25.305283+0000","last_clean":"2023-09-30T17:05:25.305283+0000","last_became_active":"2023-09-30T17:05:03.310703+0000","last_became_peered":"2023-09-30T17:05:03.310703+0000","last_unstale":"2023-09-30T17:05:25.305283+0000","last_undegraded":"2023-09-30T17:05:25.305283+0000","last_fullsized":"2023-09-30T17:05:25.305283+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:08:45.345559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"59'7","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305160+0000","last_change":"2023-09-30T17:05:03.310838+0000","last_active":"2023-09-30T17:05:25.305160+0000","last_peered":"2023-09-30T17:05:25.305160+0000","last_clean":"2023-09-30T17:05:25.305160+0000","last_became_active":"2023-09-30T17:05:03.310047+0000","last_became_peered":"2023-09-30T17:05:03.310047+0000","last_unstale":"2023-09-30T17:05:25.305160+0000","last_undegraded":"2023-09-30T17:05:25.305160+0000","last_fullsized":"2023-09-30T17:05:25.305160+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:29:17.418059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"59'11423","reported_seq":11499,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.304794+0000","last_change":"2023-09-30T17:05:06.286653+0000","last_active":"2023-09-30T17:05:25.304794+0000","last_peered":"2023-09-30T17:05:25.304794+0000","last_clean":"2023-09-30T17:05:25.304794+0000","last_became_active":"2023-09-30T17:05:06.285582+0000","last_became_peered":"2023-09-30T17:05:06.285582+0000","last_unstale":"2023-09-30T17:05:25.304794+0000","last_undegraded":"2023-09-30T17:05:25.304794+0000","last_fullsized":"2023-09-30T17:05:25.304794+0000","mapping_epoch":69,"log_start":"52'7200","ondisk_log_start":"52'7200","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4223,"log_dups_size":5777,"ondisk_log_size":4223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:35:18.578031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33444,"num_write_kb":158924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"59'8589","reported_seq":8658,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306041+0000","last_change":"2023-09-30T17:02:18.364222+0000","last_active":"2023-09-30T17:05:25.306041+0000","last_peered":"2023-09-30T17:05:25.306041+0000","last_clean":"2023-09-30T17:05:25.306041+0000","last_became_active":"2023-09-30T17:02:18.363485+0000","last_became_peered":"2023-09-30T17:02:18.363485+0000","last_unstale":"2023-09-30T17:05:25.306041+0000","last_undegraded":"2023-09-30T17:05:25.306041+0000","last_fullsized":"2023-09-30T17:05:25.306041+0000","mapping_epoch":17,"log_start":"49'4400","ondisk_log_start":"49'4400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4189,"log_dups_size":4400,"ondisk_log_size":4189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:14:35.192615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25052,"num_write_kb":118756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"59'8585","reported_seq":8654,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306806+0000","last_change":"2023-09-30T17:02:18.360010+0000","last_active":"2023-09-30T17:05:25.306806+0000","last_peered":"2023-09-30T17:05:25.306806+0000","last_clean":"2023-09-30T17:05:25.306806+0000","last_became_active":"2023-09-30T17:02:18.358396+0000","last_became_peered":"2023-09-30T17:02:18.358396+0000","last_unstale":"2023-09-30T17:05:25.306806+0000","last_undegraded":"2023-09-30T17:05:25.306806+0000","last_fullsized":"2023-09-30T17:05:25.306806+0000","mapping_epoch":17,"log_start":"48'4100","ondisk_log_start":"48'4100","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4485,"log_dups_size":4100,"ondisk_log_size":4485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:26:11.522402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24997,"num_write_kb":162463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"59'5664","reported_seq":5740,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305719+0000","last_change":"2023-09-30T17:05:06.291535+0000","last_active":"2023-09-30T17:05:25.305719+0000","last_peered":"2023-09-30T17:05:25.305719+0000","last_clean":"2023-09-30T17:05:25.305719+0000","last_became_active":"2023-09-30T17:05:06.290193+0000","last_became_peered":"2023-09-30T17:05:06.290193+0000","last_unstale":"2023-09-30T17:05:25.305719+0000","last_undegraded":"2023-09-30T17:05:25.305719+0000","last_fullsized":"2023-09-30T17:05:25.305719+0000","mapping_epoch":69,"log_start":"43'1400","ondisk_log_start":"43'1400","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4264,"log_dups_size":1400,"ondisk_log_size":4264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:21:15.508580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16442,"num_write_kb":78308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"59'2931","reported_seq":3020,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306235+0000","last_change":"2023-09-30T17:05:06.290270+0000","last_active":"2023-09-30T17:05:25.306235+0000","last_peered":"2023-09-30T17:05:25.306235+0000","last_clean":"2023-09-30T17:05:25.306235+0000","last_became_active":"2023-09-30T17:05:06.288753+0000","last_became_peered":"2023-09-30T17:05:06.288753+0000","last_unstale":"2023-09-30T17:05:25.306235+0000","last_undegraded":"2023-09-30T17:05:25.306235+0000","last_fullsized":"2023-09-30T17:05:25.306235+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2931,"log_dups_size":0,"ondisk_log_size":2931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:38:30.988146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8488,"num_write_kb":40364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"59'2860","reported_seq":2929,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306164+0000","last_change":"2023-09-30T17:02:18.359894+0000","last_active":"2023-09-30T17:05:25.306164+0000","last_peered":"2023-09-30T17:05:25.306164+0000","last_clean":"2023-09-30T17:05:25.306164+0000","last_became_active":"2023-09-30T17:02:18.358534+0000","last_became_peered":"2023-09-30T17:02:18.358534+0000","last_unstale":"2023-09-30T17:05:25.306164+0000","last_undegraded":"2023-09-30T17:05:25.306164+0000","last_fullsized":"2023-09-30T17:05:25.306164+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2860,"log_dups_size":0,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:22:13.025181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8367,"num_write_kb":39772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"59'2911","reported_seq":2978,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305184+0000","last_change":"2023-09-30T17:05:06.289465+0000","last_active":"2023-09-30T17:05:25.305184+0000","last_peered":"2023-09-30T17:05:25.305184+0000","last_clean":"2023-09-30T17:05:25.305184+0000","last_became_active":"2023-09-30T17:05:06.288360+0000","last_became_peered":"2023-09-30T17:05:06.288360+0000","last_unstale":"2023-09-30T17:05:25.305184+0000","last_undegraded":"2023-09-30T17:05:25.305184+0000","last_fullsized":"2023-09-30T17:05:25.305184+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2911,"log_dups_size":0,"ondisk_log_size":2911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:53:55.381223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8419,"num_write_kb":39940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"59'2889","reported_seq":2956,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305078+0000","last_change":"2023-09-30T17:05:06.286551+0000","last_active":"2023-09-30T17:05:25.305078+0000","last_peered":"2023-09-30T17:05:25.305078+0000","last_clean":"2023-09-30T17:05:25.305078+0000","last_became_active":"2023-09-30T17:05:06.285738+0000","last_became_peered":"2023-09-30T17:05:06.285738+0000","last_unstale":"2023-09-30T17:05:25.305078+0000","last_undegraded":"2023-09-30T17:05:25.305078+0000","last_fullsized":"2023-09-30T17:05:25.305078+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2889,"log_dups_size":0,"ondisk_log_size":2889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:18:17.841837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8435,"num_write_kb":39984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"59'2839","reported_seq":2906,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.304983+0000","last_change":"2023-09-30T17:05:06.291173+0000","last_active":"2023-09-30T17:05:25.304983+0000","last_peered":"2023-09-30T17:05:25.304983+0000","last_clean":"2023-09-30T17:05:25.304983+0000","last_became_active":"2023-09-30T17:05:06.289872+0000","last_became_peered":"2023-09-30T17:05:06.289872+0000","last_unstale":"2023-09-30T17:05:25.304983+0000","last_undegraded":"2023-09-30T17:05:25.304983+0000","last_fullsized":"2023-09-30T17:05:25.304983+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2839,"log_dups_size":0,"ondisk_log_size":2839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:57:27.685208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8166,"num_write_kb":38928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"59'2802","reported_seq":2871,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306044+0000","last_change":"2023-09-30T17:02:18.364360+0000","last_active":"2023-09-30T17:05:25.306044+0000","last_peered":"2023-09-30T17:05:25.306044+0000","last_clean":"2023-09-30T17:05:25.306044+0000","last_became_active":"2023-09-30T17:02:18.363697+0000","last_became_peered":"2023-09-30T17:02:18.363697+0000","last_unstale":"2023-09-30T17:05:25.306044+0000","last_undegraded":"2023-09-30T17:05:25.306044+0000","last_fullsized":"2023-09-30T17:05:25.306044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2802,"log_dups_size":0,"ondisk_log_size":2802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:50:52.893768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8256,"num_write_kb":39208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"59'2860","reported_seq":2929,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306937+0000","last_change":"2023-09-30T17:02:18.360320+0000","last_active":"2023-09-30T17:05:25.306937+0000","last_peered":"2023-09-30T17:05:25.306937+0000","last_clean":"2023-09-30T17:05:25.306937+0000","last_became_active":"2023-09-30T17:02:18.357184+0000","last_became_peered":"2023-09-30T17:02:18.357184+0000","last_unstale":"2023-09-30T17:05:25.306937+0000","last_undegraded":"2023-09-30T17:05:25.306937+0000","last_fullsized":"2023-09-30T17:05:25.306937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2860,"log_dups_size":0,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:21:45.195007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8368,"num_write_kb":39616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"59'5686","reported_seq":5755,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305812+0000","last_change":"2023-09-30T17:02:18.363956+0000","last_active":"2023-09-30T17:05:25.305812+0000","last_peered":"2023-09-30T17:05:25.305812+0000","last_clean":"2023-09-30T17:05:25.305812+0000","last_became_active":"2023-09-30T17:02:18.363654+0000","last_became_peered":"2023-09-30T17:02:18.363654+0000","last_unstale":"2023-09-30T17:05:25.305812+0000","last_undegraded":"2023-09-30T17:05:25.305812+0000","last_fullsized":"2023-09-30T17:05:25.305812+0000","mapping_epoch":17,"log_start":"44'1500","ondisk_log_start":"44'1500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4186,"log_dups_size":1500,"ondisk_log_size":4186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:48:17.598726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16649,"num_write_kb":78956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"59'5799","reported_seq":5876,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305562+0000","last_change":"2023-09-30T17:05:06.290994+0000","last_active":"2023-09-30T17:05:25.305562+0000","last_peered":"2023-09-30T17:05:25.305562+0000","last_clean":"2023-09-30T17:05:25.305562+0000","last_became_active":"2023-09-30T17:05:06.289817+0000","last_became_peered":"2023-09-30T17:05:06.289817+0000","last_unstale":"2023-09-30T17:05:25.305562+0000","last_undegraded":"2023-09-30T17:05:25.305562+0000","last_fullsized":"2023-09-30T17:05:25.305562+0000","mapping_epoch":69,"log_start":"44'1600","ondisk_log_start":"44'1600","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4199,"log_dups_size":1600,"ondisk_log_size":4199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:50:21.333588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16903,"num_write_kb":80184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"59'12","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305497+0000","last_change":"2023-09-30T17:05:03.310298+0000","last_active":"2023-09-30T17:05:25.305497+0000","last_peered":"2023-09-30T17:05:25.305497+0000","last_clean":"2023-09-30T17:05:25.305497+0000","last_became_active":"2023-09-30T17:05:03.309537+0000","last_became_peered":"2023-09-30T17:05:03.309537+0000","last_unstale":"2023-09-30T17:05:25.305497+0000","last_undegraded":"2023-09-30T17:05:25.305497+0000","last_fullsized":"2023-09-30T17:05:25.305497+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:45:25.545287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"59'2879","reported_seq":2968,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306043+0000","last_change":"2023-09-30T17:05:06.292705+0000","last_active":"2023-09-30T17:05:25.306043+0000","last_peered":"2023-09-30T17:05:25.306043+0000","last_clean":"2023-09-30T17:05:25.306043+0000","last_became_active":"2023-09-30T17:05:06.290797+0000","last_became_peered":"2023-09-30T17:05:06.290797+0000","last_unstale":"2023-09-30T17:05:25.306043+0000","last_undegraded":"2023-09-30T17:05:25.306043+0000","last_fullsized":"2023-09-30T17:05:25.306043+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2879,"log_dups_size":0,"ondisk_log_size":2879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:55:01.976617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8343,"num_write_kb":39768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"59'2809","reported_seq":2898,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305406+0000","last_change":"2023-09-30T17:05:06.290594+0000","last_active":"2023-09-30T17:05:25.305406+0000","last_peered":"2023-09-30T17:05:25.305406+0000","last_clean":"2023-09-30T17:05:25.305406+0000","last_became_active":"2023-09-30T17:05:06.288837+0000","last_became_peered":"2023-09-30T17:05:06.288837+0000","last_unstale":"2023-09-30T17:05:25.305406+0000","last_undegraded":"2023-09-30T17:05:25.305406+0000","last_fullsized":"2023-09-30T17:05:25.305406+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2809,"log_dups_size":0,"ondisk_log_size":2809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:00:48.822153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8281,"num_write_kb":39472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"59'5585","reported_seq":5654,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306010+0000","last_change":"2023-09-30T17:02:18.353938+0000","last_active":"2023-09-30T17:05:25.306010+0000","last_peered":"2023-09-30T17:05:25.306010+0000","last_clean":"2023-09-30T17:05:25.306010+0000","last_became_active":"2023-09-30T17:02:18.353632+0000","last_became_peered":"2023-09-30T17:02:18.353632+0000","last_unstale":"2023-09-30T17:05:25.306010+0000","last_undegraded":"2023-09-30T17:05:25.306010+0000","last_fullsized":"2023-09-30T17:05:25.306010+0000","mapping_epoch":17,"log_start":"42'1100","ondisk_log_start":"42'1100","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4485,"log_dups_size":1100,"ondisk_log_size":4485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:09:55.056098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16523,"num_write_kb":78256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"59'2888","reported_seq":2977,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.307020+0000","last_change":"2023-09-30T17:05:06.292945+0000","last_active":"2023-09-30T17:05:25.307020+0000","last_peered":"2023-09-30T17:05:25.307020+0000","last_clean":"2023-09-30T17:05:25.307020+0000","last_became_active":"2023-09-30T17:05:06.291346+0000","last_became_peered":"2023-09-30T17:05:06.291346+0000","last_unstale":"2023-09-30T17:05:25.307020+0000","last_undegraded":"2023-09-30T17:05:25.307020+0000","last_fullsized":"2023-09-30T17:05:25.307020+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2888,"log_dups_size":0,"ondisk_log_size":2888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:53:27.316963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8371,"num_write_kb":39716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"59'18","reported_seq":98,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306046+0000","last_change":"2023-09-30T17:05:03.309295+0000","last_active":"2023-09-30T17:05:25.306046+0000","last_peered":"2023-09-30T17:05:25.306046+0000","last_clean":"2023-09-30T17:05:25.306046+0000","last_became_active":"2023-09-30T17:05:03.308884+0000","last_became_peered":"2023-09-30T17:05:03.308884+0000","last_unstale":"2023-09-30T17:05:25.306046+0000","last_undegraded":"2023-09-30T17:05:25.306046+0000","last_fullsized":"2023-09-30T17:05:25.306046+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:57:45.449671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"59'2855","reported_seq":2923,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305902+0000","last_change":"2023-09-30T17:05:06.291369+0000","last_active":"2023-09-30T17:05:25.305902+0000","last_peered":"2023-09-30T17:05:25.305902+0000","last_clean":"2023-09-30T17:05:25.305902+0000","last_became_active":"2023-09-30T17:05:06.289447+0000","last_became_peered":"2023-09-30T17:05:06.289447+0000","last_unstale":"2023-09-30T17:05:25.305902+0000","last_undegraded":"2023-09-30T17:05:25.305902+0000","last_fullsized":"2023-09-30T17:05:25.305902+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2855,"log_dups_size":0,"ondisk_log_size":2855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:17:21.412392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8347,"num_write_kb":39608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":71,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306032+0000","last_change":"2023-09-30T17:02:17.358258+0000","last_active":"2023-09-30T17:05:25.306032+0000","last_peered":"2023-09-30T17:05:25.306032+0000","last_clean":"2023-09-30T17:05:25.306032+0000","last_became_active":"2023-09-30T17:02:17.357890+0000","last_became_peered":"2023-09-30T17:02:17.357890+0000","last_unstale":"2023-09-30T17:05:25.306032+0000","last_undegraded":"2023-09-30T17:05:25.306032+0000","last_fullsized":"2023-09-30T17:05:25.306032+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:52:56.591906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"59'17","reported_seq":97,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.307002+0000","last_change":"2023-09-30T17:05:03.307486+0000","last_active":"2023-09-30T17:05:25.307002+0000","last_peered":"2023-09-30T17:05:25.307002+0000","last_clean":"2023-09-30T17:05:25.307002+0000","last_became_active":"2023-09-30T17:05:03.307012+0000","last_became_peered":"2023-09-30T17:05:03.307012+0000","last_unstale":"2023-09-30T17:05:25.307002+0000","last_undegraded":"2023-09-30T17:05:25.307002+0000","last_fullsized":"2023-09-30T17:05:25.307002+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:05:29.995730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305433+0000","last_change":"2023-09-30T17:05:03.309164+0000","last_active":"2023-09-30T17:05:25.305433+0000","last_peered":"2023-09-30T17:05:25.305433+0000","last_clean":"2023-09-30T17:05:25.305433+0000","last_became_active":"2023-09-30T17:05:03.308073+0000","last_became_peered":"2023-09-30T17:05:03.308073+0000","last_unstale":"2023-09-30T17:05:25.305433+0000","last_undegraded":"2023-09-30T17:05:25.305433+0000","last_fullsized":"2023-09-30T17:05:25.305433+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:10:16.238053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"59'6","reported_seq":86,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306073+0000","last_change":"2023-09-30T17:05:03.308692+0000","last_active":"2023-09-30T17:05:25.306073+0000","last_peered":"2023-09-30T17:05:25.306073+0000","last_clean":"2023-09-30T17:05:25.306073+0000","last_became_active":"2023-09-30T17:05:03.307932+0000","last_became_peered":"2023-09-30T17:05:03.307932+0000","last_unstale":"2023-09-30T17:05:25.306073+0000","last_undegraded":"2023-09-30T17:05:25.306073+0000","last_fullsized":"2023-09-30T17:05:25.306073+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:17:13.668052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":70,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305661+0000","last_change":"2023-09-30T17:02:17.361000+0000","last_active":"2023-09-30T17:05:25.305661+0000","last_peered":"2023-09-30T17:05:25.305661+0000","last_clean":"2023-09-30T17:05:25.305661+0000","last_became_active":"2023-09-30T17:02:17.360601+0000","last_became_peered":"2023-09-30T17:02:17.360601+0000","last_unstale":"2023-09-30T17:05:25.305661+0000","last_undegraded":"2023-09-30T17:05:25.305661+0000","last_fullsized":"2023-09-30T17:05:25.305661+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:02:27.666526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"59'7","reported_seq":87,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306929+0000","last_change":"2023-09-30T17:05:03.305898+0000","last_active":"2023-09-30T17:05:25.306929+0000","last_peered":"2023-09-30T17:05:25.306929+0000","last_clean":"2023-09-30T17:05:25.306929+0000","last_became_active":"2023-09-30T17:05:03.305520+0000","last_became_peered":"2023-09-30T17:05:03.305520+0000","last_unstale":"2023-09-30T17:05:25.306929+0000","last_undegraded":"2023-09-30T17:05:25.306929+0000","last_fullsized":"2023-09-30T17:05:25.306929+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:40:09.276369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"58'1","reported_seq":82,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306258+0000","last_change":"2023-09-30T17:05:03.309303+0000","last_active":"2023-09-30T17:05:25.306258+0000","last_peered":"2023-09-30T17:05:25.306258+0000","last_clean":"2023-09-30T17:05:25.306258+0000","last_became_active":"2023-09-30T17:05:03.308851+0000","last_became_peered":"2023-09-30T17:05:03.308851+0000","last_unstale":"2023-09-30T17:05:25.306258+0000","last_undegraded":"2023-09-30T17:05:25.306258+0000","last_fullsized":"2023-09-30T17:05:25.306258+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:32:55.497287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"59'9","reported_seq":78,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305188+0000","last_change":"2023-09-30T17:02:18.358841+0000","last_active":"2023-09-30T17:05:25.305188+0000","last_peered":"2023-09-30T17:05:25.305188+0000","last_clean":"2023-09-30T17:05:25.305188+0000","last_became_active":"2023-09-30T17:02:18.358529+0000","last_became_peered":"2023-09-30T17:02:18.358529+0000","last_unstale":"2023-09-30T17:05:25.305188+0000","last_undegraded":"2023-09-30T17:05:25.305188+0000","last_fullsized":"2023-09-30T17:05:25.305188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:15:54.364571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305635+0000","last_change":"2023-09-30T17:05:03.309409+0000","last_active":"2023-09-30T17:05:25.305635+0000","last_peered":"2023-09-30T17:05:25.305635+0000","last_clean":"2023-09-30T17:05:25.305635+0000","last_became_active":"2023-09-30T17:05:03.309023+0000","last_became_peered":"2023-09-30T17:05:03.309023+0000","last_unstale":"2023-09-30T17:05:25.305635+0000","last_undegraded":"2023-09-30T17:05:25.305635+0000","last_fullsized":"2023-09-30T17:05:25.305635+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:57:05.463330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"59'8526","reported_seq":8618,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305529+0000","last_change":"2023-09-30T17:05:06.292415+0000","last_active":"2023-09-30T17:05:25.305529+0000","last_peered":"2023-09-30T17:05:25.305529+0000","last_clean":"2023-09-30T17:05:25.305529+0000","last_became_active":"2023-09-30T17:05:06.290551+0000","last_became_peered":"2023-09-30T17:05:06.290551+0000","last_unstale":"2023-09-30T17:05:25.305529+0000","last_undegraded":"2023-09-30T17:05:25.305529+0000","last_fullsized":"2023-09-30T17:05:25.305529+0000","mapping_epoch":69,"log_start":"49'4300","ondisk_log_start":"49'4300","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4226,"log_dups_size":4300,"ondisk_log_size":4226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:59:52.758548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24873,"num_write_kb":118472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"59'7","reported_seq":93,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306635+0000","last_change":"2023-09-30T17:05:03.310987+0000","last_active":"2023-09-30T17:05:25.306635+0000","last_peered":"2023-09-30T17:05:25.306635+0000","last_clean":"2023-09-30T17:05:25.306635+0000","last_became_active":"2023-09-30T17:05:03.306646+0000","last_became_peered":"2023-09-30T17:05:03.306646+0000","last_unstale":"2023-09-30T17:05:25.306635+0000","last_undegraded":"2023-09-30T17:05:25.306635+0000","last_fullsized":"2023-09-30T17:05:25.306635+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:24:52.247523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"59'5670","reported_seq":5739,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305419+0000","last_change":"2023-09-30T17:02:18.359118+0000","last_active":"2023-09-30T17:05:25.305419+0000","last_peered":"2023-09-30T17:05:25.305419+0000","last_clean":"2023-09-30T17:05:25.305419+0000","last_became_active":"2023-09-30T17:02:18.358786+0000","last_became_peered":"2023-09-30T17:02:18.358786+0000","last_unstale":"2023-09-30T17:05:25.305419+0000","last_undegraded":"2023-09-30T17:05:25.305419+0000","last_fullsized":"2023-09-30T17:05:25.305419+0000","mapping_epoch":17,"log_start":"44'1500","ondisk_log_start":"44'1500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4170,"log_dups_size":1500,"ondisk_log_size":4170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:33:21.723864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16627,"num_write_kb":79047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"60'78","reported_seq":49,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305537+0000","last_change":"2023-09-30T17:05:03.313916+0000","last_active":"2023-09-30T17:05:25.305537+0000","last_peered":"2023-09-30T17:05:25.305537+0000","last_clean":"2023-09-30T17:05:25.305537+0000","last_became_active":"2023-09-30T17:05:03.302516+0000","last_became_peered":"2023-09-30T17:05:03.302516+0000","last_unstale":"2023-09-30T17:05:25.305537+0000","last_undegraded":"2023-09-30T17:05:25.305537+0000","last_fullsized":"2023-09-30T17:05:25.305537+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:00:50.535715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227523,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":222729,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"59'5677","reported_seq":5756,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305603+0000","last_change":"2023-09-30T17:05:06.289965+0000","last_active":"2023-09-30T17:05:25.305603+0000","last_peered":"2023-09-30T17:05:25.305603+0000","last_clean":"2023-09-30T17:05:25.305603+0000","last_became_active":"2023-09-30T17:05:06.288155+0000","last_became_peered":"2023-09-30T17:05:06.288155+0000","last_unstale":"2023-09-30T17:05:25.305603+0000","last_undegraded":"2023-09-30T17:05:25.305603+0000","last_fullsized":"2023-09-30T17:05:25.305603+0000","mapping_epoch":69,"log_start":"42'1100","ondisk_log_start":"42'1100","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4577,"log_dups_size":1100,"ondisk_log_size":4577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:26:23.188915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16579,"num_write_kb":79104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305299+0000","last_change":"2023-09-30T17:05:03.310322+0000","last_active":"2023-09-30T17:05:25.305299+0000","last_peered":"2023-09-30T17:05:25.305299+0000","last_clean":"2023-09-30T17:05:25.305299+0000","last_became_active":"2023-09-30T17:05:03.309505+0000","last_became_peered":"2023-09-30T17:05:03.309505+0000","last_unstale":"2023-09-30T17:05:25.305299+0000","last_undegraded":"2023-09-30T17:05:25.305299+0000","last_fullsized":"2023-09-30T17:05:25.305299+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:13:16.014703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"59'2836","reported_seq":2905,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306395+0000","last_change":"2023-09-30T17:02:18.360019+0000","last_active":"2023-09-30T17:05:25.306395+0000","last_peered":"2023-09-30T17:05:25.306395+0000","last_clean":"2023-09-30T17:05:25.306395+0000","last_became_active":"2023-09-30T17:02:18.358364+0000","last_became_peered":"2023-09-30T17:02:18.358364+0000","last_unstale":"2023-09-30T17:05:25.306395+0000","last_undegraded":"2023-09-30T17:05:25.306395+0000","last_fullsized":"2023-09-30T17:05:25.306395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2836,"log_dups_size":0,"ondisk_log_size":2836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:30:43.782165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8308,"num_write_kb":39456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305535+0000","last_change":"2023-09-30T17:05:03.308853+0000","last_active":"2023-09-30T17:05:25.305535+0000","last_peered":"2023-09-30T17:05:25.305535+0000","last_clean":"2023-09-30T17:05:25.305535+0000","last_became_active":"2023-09-30T17:05:03.308377+0000","last_became_peered":"2023-09-30T17:05:03.308377+0000","last_unstale":"2023-09-30T17:05:25.305535+0000","last_undegraded":"2023-09-30T17:05:25.305535+0000","last_fullsized":"2023-09-30T17:05:25.305535+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:18:42.448826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"59'2856","reported_seq":2925,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306869+0000","last_change":"2023-09-30T17:02:18.362415+0000","last_active":"2023-09-30T17:05:25.306869+0000","last_peered":"2023-09-30T17:05:25.306869+0000","last_clean":"2023-09-30T17:05:25.306869+0000","last_became_active":"2023-09-30T17:02:18.361556+0000","last_became_peered":"2023-09-30T17:02:18.361556+0000","last_unstale":"2023-09-30T17:05:25.306869+0000","last_undegraded":"2023-09-30T17:05:25.306869+0000","last_fullsized":"2023-09-30T17:05:25.306869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2856,"log_dups_size":0,"ondisk_log_size":2856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:16:41.607547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8321,"num_write_kb":39600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306039+0000","last_change":"2023-09-30T17:05:03.304220+0000","last_active":"2023-09-30T17:05:25.306039+0000","last_peered":"2023-09-30T17:05:25.306039+0000","last_clean":"2023-09-30T17:05:25.306039+0000","last_became_active":"2023-09-30T17:05:03.303598+0000","last_became_peered":"2023-09-30T17:05:03.303598+0000","last_unstale":"2023-09-30T17:05:25.306039+0000","last_undegraded":"2023-09-30T17:05:25.306039+0000","last_fullsized":"2023-09-30T17:05:25.306039+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:57:44.444041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"59'12","reported_seq":92,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306163+0000","last_change":"2023-09-30T17:05:03.313214+0000","last_active":"2023-09-30T17:05:25.306163+0000","last_peered":"2023-09-30T17:05:25.306163+0000","last_clean":"2023-09-30T17:05:25.306163+0000","last_became_active":"2023-09-30T17:05:03.312888+0000","last_became_peered":"2023-09-30T17:05:03.312888+0000","last_unstale":"2023-09-30T17:05:25.306163+0000","last_undegraded":"2023-09-30T17:05:25.306163+0000","last_fullsized":"2023-09-30T17:05:25.306163+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:40:09.276369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"59'9","reported_seq":35,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305075+0000","last_change":"2023-09-30T17:05:03.304503+0000","last_active":"2023-09-30T17:05:25.305075+0000","last_peered":"2023-09-30T17:05:25.305075+0000","last_clean":"2023-09-30T17:05:25.305075+0000","last_became_active":"2023-09-30T17:05:03.304030+0000","last_became_peered":"2023-09-30T17:05:03.304030+0000","last_unstale":"2023-09-30T17:05:25.305075+0000","last_undegraded":"2023-09-30T17:05:25.305075+0000","last_fullsized":"2023-09-30T17:05:25.305075+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:08:35.110114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"59'2892","reported_seq":2981,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306333+0000","last_change":"2023-09-30T17:05:06.290230+0000","last_active":"2023-09-30T17:05:25.306333+0000","last_peered":"2023-09-30T17:05:25.306333+0000","last_clean":"2023-09-30T17:05:25.306333+0000","last_became_active":"2023-09-30T17:05:06.288725+0000","last_became_peered":"2023-09-30T17:05:06.288725+0000","last_unstale":"2023-09-30T17:05:25.306333+0000","last_undegraded":"2023-09-30T17:05:25.306333+0000","last_fullsized":"2023-09-30T17:05:25.306333+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2892,"log_dups_size":0,"ondisk_log_size":2892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:27:28.611647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8345,"num_write_kb":39712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305902+0000","last_change":"2023-09-30T17:05:03.304339+0000","last_active":"2023-09-30T17:05:25.305902+0000","last_peered":"2023-09-30T17:05:25.305902+0000","last_clean":"2023-09-30T17:05:25.305902+0000","last_became_active":"2023-09-30T17:05:03.303179+0000","last_became_peered":"2023-09-30T17:05:03.303179+0000","last_unstale":"2023-09-30T17:05:25.305902+0000","last_undegraded":"2023-09-30T17:05:25.305902+0000","last_fullsized":"2023-09-30T17:05:25.305902+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:44:20.765682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"59'2861","reported_seq":2950,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305648+0000","last_change":"2023-09-30T17:05:06.290324+0000","last_active":"2023-09-30T17:05:25.305648+0000","last_peered":"2023-09-30T17:05:25.305648+0000","last_clean":"2023-09-30T17:05:25.305648+0000","last_became_active":"2023-09-30T17:05:06.288824+0000","last_became_peered":"2023-09-30T17:05:06.288824+0000","last_unstale":"2023-09-30T17:05:25.305648+0000","last_undegraded":"2023-09-30T17:05:25.305648+0000","last_fullsized":"2023-09-30T17:05:25.305648+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2861,"log_dups_size":0,"ondisk_log_size":2861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:51:16.138021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8384,"num_write_kb":39788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":83,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306641+0000","last_change":"2023-09-30T17:05:03.304232+0000","last_active":"2023-09-30T17:05:25.306641+0000","last_peered":"2023-09-30T17:05:25.306641+0000","last_clean":"2023-09-30T17:05:25.306641+0000","last_became_active":"2023-09-30T17:05:03.303874+0000","last_became_peered":"2023-09-30T17:05:03.303874+0000","last_unstale":"2023-09-30T17:05:25.306641+0000","last_undegraded":"2023-09-30T17:05:25.306641+0000","last_fullsized":"2023-09-30T17:05:25.306641+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:39:49.644290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"59'2","reported_seq":71,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306324+0000","last_change":"2023-09-30T17:02:18.359767+0000","last_active":"2023-09-30T17:05:25.306324+0000","last_peered":"2023-09-30T17:05:25.306324+0000","last_clean":"2023-09-30T17:05:25.306324+0000","last_became_active":"2023-09-30T17:02:18.356825+0000","last_became_peered":"2023-09-30T17:02:18.356825+0000","last_unstale":"2023-09-30T17:05:25.306324+0000","last_undegraded":"2023-09-30T17:05:25.306324+0000","last_fullsized":"2023-09-30T17:05:25.306324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:39:16.689300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305494+0000","last_change":"2023-09-30T17:05:03.305087+0000","last_active":"2023-09-30T17:05:25.305494+0000","last_peered":"2023-09-30T17:05:25.305494+0000","last_clean":"2023-09-30T17:05:25.305494+0000","last_became_active":"2023-09-30T17:05:03.304463+0000","last_became_peered":"2023-09-30T17:05:03.304463+0000","last_unstale":"2023-09-30T17:05:25.305494+0000","last_undegraded":"2023-09-30T17:05:25.305494+0000","last_fullsized":"2023-09-30T17:05:25.305494+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:33:20.829898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"59'2835","reported_seq":2903,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305096+0000","last_change":"2023-09-30T17:05:06.289598+0000","last_active":"2023-09-30T17:05:25.305096+0000","last_peered":"2023-09-30T17:05:25.305096+0000","last_clean":"2023-09-30T17:05:25.305096+0000","last_became_active":"2023-09-30T17:05:06.288712+0000","last_became_peered":"2023-09-30T17:05:06.288712+0000","last_unstale":"2023-09-30T17:05:25.305096+0000","last_undegraded":"2023-09-30T17:05:25.305096+0000","last_fullsized":"2023-09-30T17:05:25.305096+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2835,"log_dups_size":0,"ondisk_log_size":2835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:01:17.676791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8288,"num_write_kb":39388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305636+0000","last_change":"2023-09-30T17:05:03.311500+0000","last_active":"2023-09-30T17:05:25.305636+0000","last_peered":"2023-09-30T17:05:25.305636+0000","last_clean":"2023-09-30T17:05:25.305636+0000","last_became_active":"2023-09-30T17:05:03.310836+0000","last_became_peered":"2023-09-30T17:05:03.310836+0000","last_unstale":"2023-09-30T17:05:25.305636+0000","last_undegraded":"2023-09-30T17:05:25.305636+0000","last_fullsized":"2023-09-30T17:05:25.305636+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:30:09.762284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"59'8","reported_seq":88,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305917+0000","last_change":"2023-09-30T17:05:03.308917+0000","last_active":"2023-09-30T17:05:25.305917+0000","last_peered":"2023-09-30T17:05:25.305917+0000","last_clean":"2023-09-30T17:05:25.305917+0000","last_became_active":"2023-09-30T17:05:03.308214+0000","last_became_peered":"2023-09-30T17:05:03.308214+0000","last_unstale":"2023-09-30T17:05:25.305917+0000","last_undegraded":"2023-09-30T17:05:25.305917+0000","last_fullsized":"2023-09-30T17:05:25.305917+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:39:50.649920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"58'3","reported_seq":85,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305666+0000","last_change":"2023-09-30T17:05:03.308944+0000","last_active":"2023-09-30T17:05:25.305666+0000","last_peered":"2023-09-30T17:05:25.305666+0000","last_clean":"2023-09-30T17:05:25.305666+0000","last_became_active":"2023-09-30T17:05:03.308483+0000","last_became_peered":"2023-09-30T17:05:03.308483+0000","last_unstale":"2023-09-30T17:05:25.305666+0000","last_undegraded":"2023-09-30T17:05:25.305666+0000","last_fullsized":"2023-09-30T17:05:25.305666+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:43:27.633747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"59'2846","reported_seq":2913,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305422+0000","last_change":"2023-09-30T17:05:06.290255+0000","last_active":"2023-09-30T17:05:25.305422+0000","last_peered":"2023-09-30T17:05:25.305422+0000","last_clean":"2023-09-30T17:05:25.305422+0000","last_became_active":"2023-09-30T17:05:06.289225+0000","last_became_peered":"2023-09-30T17:05:06.289225+0000","last_unstale":"2023-09-30T17:05:25.305422+0000","last_undegraded":"2023-09-30T17:05:25.305422+0000","last_fullsized":"2023-09-30T17:05:25.305422+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2846,"log_dups_size":0,"ondisk_log_size":2846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:41:31.424933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8199,"num_write_kb":39160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.304959+0000","last_change":"2023-09-30T17:05:03.309689+0000","last_active":"2023-09-30T17:05:25.304959+0000","last_peered":"2023-09-30T17:05:25.304959+0000","last_clean":"2023-09-30T17:05:25.304959+0000","last_became_active":"2023-09-30T17:05:03.309318+0000","last_became_peered":"2023-09-30T17:05:03.309318+0000","last_unstale":"2023-09-30T17:05:25.304959+0000","last_undegraded":"2023-09-30T17:05:25.304959+0000","last_fullsized":"2023-09-30T17:05:25.304959+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:12:37.857480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"59'2831","reported_seq":2898,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305893+0000","last_change":"2023-09-30T17:05:06.289189+0000","last_active":"2023-09-30T17:05:25.305893+0000","last_peered":"2023-09-30T17:05:25.305893+0000","last_clean":"2023-09-30T17:05:25.305893+0000","last_became_active":"2023-09-30T17:05:06.288348+0000","last_became_peered":"2023-09-30T17:05:06.288348+0000","last_unstale":"2023-09-30T17:05:25.305893+0000","last_undegraded":"2023-09-30T17:05:25.305893+0000","last_fullsized":"2023-09-30T17:05:25.305893+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2831,"log_dups_size":0,"ondisk_log_size":2831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:51:59.540252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8336,"num_write_kb":39484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305792+0000","last_change":"2023-09-30T17:05:03.304019+0000","last_active":"2023-09-30T17:05:25.305792+0000","last_peered":"2023-09-30T17:05:25.305792+0000","last_clean":"2023-09-30T17:05:25.305792+0000","last_became_active":"2023-09-30T17:05:03.303473+0000","last_became_peered":"2023-09-30T17:05:03.303473+0000","last_unstale":"2023-09-30T17:05:25.305792+0000","last_undegraded":"2023-09-30T17:05:25.305792+0000","last_fullsized":"2023-09-30T17:05:25.305792+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:10:16.238053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"59'2884","reported_seq":2951,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306051+0000","last_change":"2023-09-30T17:05:06.289446+0000","last_active":"2023-09-30T17:05:25.306051+0000","last_peered":"2023-09-30T17:05:25.306051+0000","last_clean":"2023-09-30T17:05:25.306051+0000","last_became_active":"2023-09-30T17:05:06.288169+0000","last_became_peered":"2023-09-30T17:05:06.288169+0000","last_unstale":"2023-09-30T17:05:25.306051+0000","last_undegraded":"2023-09-30T17:05:25.306051+0000","last_fullsized":"2023-09-30T17:05:25.306051+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2884,"log_dups_size":0,"ondisk_log_size":2884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:15:23.507816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8366,"num_write_kb":39744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":70,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305775+0000","last_change":"2023-09-30T17:02:17.358811+0000","last_active":"2023-09-30T17:05:25.305775+0000","last_peered":"2023-09-30T17:05:25.305775+0000","last_clean":"2023-09-30T17:05:25.305775+0000","last_became_active":"2023-09-30T17:02:17.358582+0000","last_became_peered":"2023-09-30T17:02:17.358582+0000","last_unstale":"2023-09-30T17:05:25.305775+0000","last_undegraded":"2023-09-30T17:05:25.305775+0000","last_fullsized":"2023-09-30T17:05:25.305775+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:52:37.518693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"59'8580","reported_seq":8649,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306158+0000","last_change":"2023-09-30T17:02:18.364478+0000","last_active":"2023-09-30T17:05:25.306158+0000","last_peered":"2023-09-30T17:05:25.306158+0000","last_clean":"2023-09-30T17:05:25.306158+0000","last_became_active":"2023-09-30T17:02:18.364057+0000","last_became_peered":"2023-09-30T17:02:18.364057+0000","last_unstale":"2023-09-30T17:05:25.306158+0000","last_undegraded":"2023-09-30T17:05:25.306158+0000","last_fullsized":"2023-09-30T17:05:25.306158+0000","mapping_epoch":17,"log_start":"49'4400","ondisk_log_start":"49'4400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4180,"log_dups_size":4400,"ondisk_log_size":4180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:13:55.555700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25046,"num_write_kb":118972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305797+0000","last_change":"2023-09-30T17:02:12.327704+0000","last_active":"2023-09-30T17:05:25.305797+0000","last_peered":"2023-09-30T17:05:25.305797+0000","last_clean":"2023-09-30T17:05:25.305797+0000","last_became_active":"2023-09-30T17:02:12.327384+0000","last_became_peered":"2023-09-30T17:02:12.327384+0000","last_unstale":"2023-09-30T17:05:25.305797+0000","last_undegraded":"2023-09-30T17:05:25.305797+0000","last_fullsized":"2023-09-30T17:05:25.305797+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:09:34.818252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306075+0000","last_change":"2023-09-30T17:05:03.311271+0000","last_active":"2023-09-30T17:05:25.306075+0000","last_peered":"2023-09-30T17:05:25.306075+0000","last_clean":"2023-09-30T17:05:25.306075+0000","last_became_active":"2023-09-30T17:05:03.310655+0000","last_became_peered":"2023-09-30T17:05:03.310655+0000","last_unstale":"2023-09-30T17:05:25.306075+0000","last_undegraded":"2023-09-30T17:05:25.306075+0000","last_fullsized":"2023-09-30T17:05:25.306075+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:49:35.748952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"59'9","reported_seq":89,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306198+0000","last_change":"2023-09-30T17:05:03.306223+0000","last_active":"2023-09-30T17:05:25.306198+0000","last_peered":"2023-09-30T17:05:25.306198+0000","last_clean":"2023-09-30T17:05:25.306198+0000","last_became_active":"2023-09-30T17:05:03.305956+0000","last_became_peered":"2023-09-30T17:05:03.305956+0000","last_unstale":"2023-09-30T17:05:25.306198+0000","last_undegraded":"2023-09-30T17:05:25.306198+0000","last_fullsized":"2023-09-30T17:05:25.306198+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:32:56.502917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.304959+0000","last_change":"2023-09-30T17:05:03.309359+0000","last_active":"2023-09-30T17:05:25.304959+0000","last_peered":"2023-09-30T17:05:25.304959+0000","last_clean":"2023-09-30T17:05:25.304959+0000","last_became_active":"2023-09-30T17:05:03.308944+0000","last_became_peered":"2023-09-30T17:05:03.308944+0000","last_unstale":"2023-09-30T17:05:25.304959+0000","last_undegraded":"2023-09-30T17:05:25.304959+0000","last_fullsized":"2023-09-30T17:05:25.304959+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:02:58.156693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305781+0000","last_change":"2023-09-30T17:05:03.311106+0000","last_active":"2023-09-30T17:05:25.305781+0000","last_peered":"2023-09-30T17:05:25.305781+0000","last_clean":"2023-09-30T17:05:25.305781+0000","last_became_active":"2023-09-30T17:05:03.310706+0000","last_became_peered":"2023-09-30T17:05:03.310706+0000","last_unstale":"2023-09-30T17:05:25.305781+0000","last_undegraded":"2023-09-30T17:05:25.305781+0000","last_fullsized":"2023-09-30T17:05:25.305781+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:04:03.231664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"59'9","reported_seq":78,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305690+0000","last_change":"2023-09-30T17:02:18.363399+0000","last_active":"2023-09-30T17:05:25.305690+0000","last_peered":"2023-09-30T17:05:25.305690+0000","last_clean":"2023-09-30T17:05:25.305690+0000","last_became_active":"2023-09-30T17:02:18.363064+0000","last_became_peered":"2023-09-30T17:02:18.363064+0000","last_unstale":"2023-09-30T17:05:25.305690+0000","last_undegraded":"2023-09-30T17:05:25.305690+0000","last_fullsized":"2023-09-30T17:05:25.305690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:32:34.654264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305329+0000","last_change":"2023-09-30T17:02:12.327834+0000","last_active":"2023-09-30T17:05:25.305329+0000","last_peered":"2023-09-30T17:05:25.305329+0000","last_clean":"2023-09-30T17:05:25.305329+0000","last_became_active":"2023-09-30T17:02:12.327542+0000","last_became_peered":"2023-09-30T17:02:12.327542+0000","last_unstale":"2023-09-30T17:05:25.305329+0000","last_undegraded":"2023-09-30T17:05:25.305329+0000","last_fullsized":"2023-09-30T17:05:25.305329+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:49:54.890769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305806+0000","last_change":"2023-09-30T17:05:03.305668+0000","last_active":"2023-09-30T17:05:25.305806+0000","last_peered":"2023-09-30T17:05:25.305806+0000","last_clean":"2023-09-30T17:05:25.305806+0000","last_became_active":"2023-09-30T17:05:03.305222+0000","last_became_peered":"2023-09-30T17:05:03.305222+0000","last_unstale":"2023-09-30T17:05:25.305806+0000","last_undegraded":"2023-09-30T17:05:25.305806+0000","last_fullsized":"2023-09-30T17:05:25.305806+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:17:12.662422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"59'6","reported_seq":75,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306348+0000","last_change":"2023-09-30T17:02:18.364406+0000","last_active":"2023-09-30T17:05:25.306348+0000","last_peered":"2023-09-30T17:05:25.306348+0000","last_clean":"2023-09-30T17:05:25.306348+0000","last_became_active":"2023-09-30T17:02:18.363849+0000","last_became_peered":"2023-09-30T17:02:18.363849+0000","last_unstale":"2023-09-30T17:05:25.306348+0000","last_undegraded":"2023-09-30T17:05:25.306348+0000","last_fullsized":"2023-09-30T17:05:25.306348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:43:29.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305302+0000","last_change":"2023-09-30T17:05:03.310062+0000","last_active":"2023-09-30T17:05:25.305302+0000","last_peered":"2023-09-30T17:05:25.305302+0000","last_clean":"2023-09-30T17:05:25.305302+0000","last_became_active":"2023-09-30T17:05:03.308958+0000","last_became_peered":"2023-09-30T17:05:03.308958+0000","last_unstale":"2023-09-30T17:05:25.305302+0000","last_undegraded":"2023-09-30T17:05:25.305302+0000","last_fullsized":"2023-09-30T17:05:25.305302+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:05:26.347633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":225,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.304940+0000","last_change":"2023-09-30T17:05:03.303046+0000","last_active":"2023-09-30T17:05:25.304940+0000","last_peered":"2023-09-30T17:05:25.304940+0000","last_clean":"2023-09-30T17:05:25.304940+0000","last_became_active":"2023-09-30T17:05:03.302265+0000","last_became_peered":"2023-09-30T17:05:03.302265+0000","last_unstale":"2023-09-30T17:05:25.304940+0000","last_undegraded":"2023-09-30T17:05:25.304940+0000","last_fullsized":"2023-09-30T17:05:25.304940+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:06.295501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:06.295501+0000","last_clean_scrub_stamp":"2023-09-30T17:02:06.295501+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:07:24.603358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":70,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305369+0000","last_change":"2023-09-30T17:02:17.357139+0000","last_active":"2023-09-30T17:05:25.305369+0000","last_peered":"2023-09-30T17:05:25.305369+0000","last_clean":"2023-09-30T17:05:25.305369+0000","last_became_active":"2023-09-30T17:02:17.356901+0000","last_became_peered":"2023-09-30T17:02:17.356901+0000","last_unstale":"2023-09-30T17:05:25.305369+0000","last_undegraded":"2023-09-30T17:05:25.305369+0000","last_fullsized":"2023-09-30T17:05:25.305369+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:22:35.747671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"59'7","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305738+0000","last_change":"2023-09-30T17:05:03.305199+0000","last_active":"2023-09-30T17:05:25.305738+0000","last_peered":"2023-09-30T17:05:25.305738+0000","last_clean":"2023-09-30T17:05:25.305738+0000","last_became_active":"2023-09-30T17:05:03.304974+0000","last_became_peered":"2023-09-30T17:05:03.304974+0000","last_unstale":"2023-09-30T17:05:25.305738+0000","last_undegraded":"2023-09-30T17:05:25.305738+0000","last_fullsized":"2023-09-30T17:05:25.305738+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:03:27.429545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305080+0000","last_change":"2023-09-30T17:05:03.303739+0000","last_active":"2023-09-30T17:05:25.305080+0000","last_peered":"2023-09-30T17:05:25.305080+0000","last_clean":"2023-09-30T17:05:25.305080+0000","last_became_active":"2023-09-30T17:05:03.302590+0000","last_became_peered":"2023-09-30T17:05:03.302590+0000","last_unstale":"2023-09-30T17:05:25.305080+0000","last_undegraded":"2023-09-30T17:05:25.305080+0000","last_fullsized":"2023-09-30T17:05:25.305080+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:51:30.199616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"59'5","reported_seq":94,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305237+0000","last_change":"2023-09-30T17:05:03.318439+0000","last_active":"2023-09-30T17:05:25.305237+0000","last_peered":"2023-09-30T17:05:25.305237+0000","last_clean":"2023-09-30T17:05:25.305237+0000","last_became_active":"2023-09-30T17:05:03.308059+0000","last_became_peered":"2023-09-30T17:05:03.308059+0000","last_unstale":"2023-09-30T17:05:25.305237+0000","last_undegraded":"2023-09-30T17:05:25.305237+0000","last_fullsized":"2023-09-30T17:05:25.305237+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:16:25.170638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"59'11252","reported_seq":11321,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306870+0000","last_change":"2023-09-30T17:02:18.360029+0000","last_active":"2023-09-30T17:05:25.306870+0000","last_peered":"2023-09-30T17:05:25.306870+0000","last_clean":"2023-09-30T17:05:25.306870+0000","last_became_active":"2023-09-30T17:02:18.356839+0000","last_became_peered":"2023-09-30T17:02:18.356839+0000","last_unstale":"2023-09-30T17:05:25.306870+0000","last_undegraded":"2023-09-30T17:05:25.306870+0000","last_fullsized":"2023-09-30T17:05:25.306870+0000","mapping_epoch":17,"log_start":"51'6700","ondisk_log_start":"51'6700","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4552,"log_dups_size":6700,"ondisk_log_size":4552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:16:27.516884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33068,"num_write_kb":157144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":73,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306724+0000","last_change":"2023-09-30T17:02:12.330472+0000","last_active":"2023-09-30T17:05:25.306724+0000","last_peered":"2023-09-30T17:05:25.306724+0000","last_clean":"2023-09-30T17:05:25.306724+0000","last_became_active":"2023-09-30T17:02:12.330154+0000","last_became_peered":"2023-09-30T17:02:12.330154+0000","last_unstale":"2023-09-30T17:05:25.306724+0000","last_undegraded":"2023-09-30T17:05:25.306724+0000","last_fullsized":"2023-09-30T17:05:25.306724+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:43:23.161734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":70,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305996+0000","last_change":"2023-09-30T17:02:17.361007+0000","last_active":"2023-09-30T17:05:25.305996+0000","last_peered":"2023-09-30T17:05:25.305996+0000","last_clean":"2023-09-30T17:05:25.305996+0000","last_became_active":"2023-09-30T17:02:17.360721+0000","last_became_peered":"2023-09-30T17:02:17.360721+0000","last_unstale":"2023-09-30T17:05:25.305996+0000","last_undegraded":"2023-09-30T17:05:25.305996+0000","last_fullsized":"2023-09-30T17:05:25.305996+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:13:41.205152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"59'2836","reported_seq":2925,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306557+0000","last_change":"2023-09-30T17:05:06.293085+0000","last_active":"2023-09-30T17:05:25.306557+0000","last_peered":"2023-09-30T17:05:25.306557+0000","last_clean":"2023-09-30T17:05:25.306557+0000","last_became_active":"2023-09-30T17:05:06.291203+0000","last_became_peered":"2023-09-30T17:05:06.291203+0000","last_unstale":"2023-09-30T17:05:25.306557+0000","last_undegraded":"2023-09-30T17:05:25.306557+0000","last_fullsized":"2023-09-30T17:05:25.306557+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2836,"log_dups_size":0,"ondisk_log_size":2836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:11:28.091818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8199,"num_write_kb":39048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"59'3","reported_seq":73,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306165+0000","last_change":"2023-09-30T17:02:17.360831+0000","last_active":"2023-09-30T17:05:25.306165+0000","last_peered":"2023-09-30T17:05:25.306165+0000","last_clean":"2023-09-30T17:05:25.306165+0000","last_became_active":"2023-09-30T17:02:17.360494+0000","last_became_peered":"2023-09-30T17:02:17.360494+0000","last_unstale":"2023-09-30T17:05:25.306165+0000","last_undegraded":"2023-09-30T17:05:25.306165+0000","last_fullsized":"2023-09-30T17:05:25.306165+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:24:04.564387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306251+0000","last_change":"2023-09-30T17:02:12.328184+0000","last_active":"2023-09-30T17:05:25.306251+0000","last_peered":"2023-09-30T17:05:25.306251+0000","last_clean":"2023-09-30T17:05:25.306251+0000","last_became_active":"2023-09-30T17:02:12.327898+0000","last_became_peered":"2023-09-30T17:02:12.327898+0000","last_unstale":"2023-09-30T17:05:25.306251+0000","last_undegraded":"2023-09-30T17:05:25.306251+0000","last_fullsized":"2023-09-30T17:05:25.306251+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:43:23.161734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"59'8","reported_seq":88,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305121+0000","last_change":"2023-09-30T17:05:03.308856+0000","last_active":"2023-09-30T17:05:25.305121+0000","last_peered":"2023-09-30T17:05:25.305121+0000","last_clean":"2023-09-30T17:05:25.305121+0000","last_became_active":"2023-09-30T17:05:03.308429+0000","last_became_peered":"2023-09-30T17:05:03.308429+0000","last_unstale":"2023-09-30T17:05:25.305121+0000","last_undegraded":"2023-09-30T17:05:25.305121+0000","last_fullsized":"2023-09-30T17:05:25.305121+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:49:32.189339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305749+0000","last_change":"2023-09-30T17:05:03.304353+0000","last_active":"2023-09-30T17:05:25.305749+0000","last_peered":"2023-09-30T17:05:25.305749+0000","last_clean":"2023-09-30T17:05:25.305749+0000","last_became_active":"2023-09-30T17:05:03.302503+0000","last_became_peered":"2023-09-30T17:05:03.302503+0000","last_unstale":"2023-09-30T17:05:25.305749+0000","last_undegraded":"2023-09-30T17:05:25.305749+0000","last_fullsized":"2023-09-30T17:05:25.305749+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:19:16.151598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"60'8","reported_seq":94,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306144+0000","last_change":"2023-09-30T17:05:03.314806+0000","last_active":"2023-09-30T17:05:25.306144+0000","last_peered":"2023-09-30T17:05:25.306144+0000","last_clean":"2023-09-30T17:05:25.306144+0000","last_became_active":"2023-09-30T17:05:03.308201+0000","last_became_peered":"2023-09-30T17:05:03.308201+0000","last_unstale":"2023-09-30T17:05:25.306144+0000","last_undegraded":"2023-09-30T17:05:25.306144+0000","last_fullsized":"2023-09-30T17:05:25.306144+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:19:18.486570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"59'6","reported_seq":86,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306035+0000","last_change":"2023-09-30T17:05:03.304265+0000","last_active":"2023-09-30T17:05:25.306035+0000","last_peered":"2023-09-30T17:05:25.306035+0000","last_clean":"2023-09-30T17:05:25.306035+0000","last_became_active":"2023-09-30T17:05:03.304022+0000","last_became_peered":"2023-09-30T17:05:03.304022+0000","last_unstale":"2023-09-30T17:05:25.306035+0000","last_undegraded":"2023-09-30T17:05:25.306035+0000","last_fullsized":"2023-09-30T17:05:25.306035+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:19:19.492200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":82,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306295+0000","last_change":"2023-09-30T17:05:03.303927+0000","last_active":"2023-09-30T17:05:25.306295+0000","last_peered":"2023-09-30T17:05:25.306295+0000","last_clean":"2023-09-30T17:05:25.306295+0000","last_became_active":"2023-09-30T17:05:03.303487+0000","last_became_peered":"2023-09-30T17:05:03.303487+0000","last_unstale":"2023-09-30T17:05:25.306295+0000","last_undegraded":"2023-09-30T17:05:25.306295+0000","last_fullsized":"2023-09-30T17:05:25.306295+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:43:27.633747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"59'2835","reported_seq":2904,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306514+0000","last_change":"2023-09-30T17:02:18.358269+0000","last_active":"2023-09-30T17:05:25.306514+0000","last_peered":"2023-09-30T17:05:25.306514+0000","last_clean":"2023-09-30T17:05:25.306514+0000","last_became_active":"2023-09-30T17:02:18.356902+0000","last_became_peered":"2023-09-30T17:02:18.356902+0000","last_unstale":"2023-09-30T17:05:25.306514+0000","last_undegraded":"2023-09-30T17:05:25.306514+0000","last_fullsized":"2023-09-30T17:05:25.306514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2835,"log_dups_size":0,"ondisk_log_size":2835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:39:28.022201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8302,"num_write_kb":39500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305740+0000","last_change":"2023-09-30T17:05:03.311401+0000","last_active":"2023-09-30T17:05:25.305740+0000","last_peered":"2023-09-30T17:05:25.305740+0000","last_clean":"2023-09-30T17:05:25.305740+0000","last_became_active":"2023-09-30T17:05:03.310996+0000","last_became_peered":"2023-09-30T17:05:03.310996+0000","last_unstale":"2023-09-30T17:05:25.305740+0000","last_undegraded":"2023-09-30T17:05:25.305740+0000","last_fullsized":"2023-09-30T17:05:25.305740+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:28:19.097868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"59'2848","reported_seq":2915,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305483+0000","last_change":"2023-09-30T17:05:06.290662+0000","last_active":"2023-09-30T17:05:25.305483+0000","last_peered":"2023-09-30T17:05:25.305483+0000","last_clean":"2023-09-30T17:05:25.305483+0000","last_became_active":"2023-09-30T17:05:06.289599+0000","last_became_peered":"2023-09-30T17:05:06.289599+0000","last_unstale":"2023-09-30T17:05:25.305483+0000","last_undegraded":"2023-09-30T17:05:25.305483+0000","last_fullsized":"2023-09-30T17:05:25.305483+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2848,"log_dups_size":0,"ondisk_log_size":2848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:20:28.670256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8235,"num_write_kb":39276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"58'3","reported_seq":85,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306879+0000","last_change":"2023-09-30T17:05:03.307212+0000","last_active":"2023-09-30T17:05:25.306879+0000","last_peered":"2023-09-30T17:05:25.306879+0000","last_clean":"2023-09-30T17:05:25.306879+0000","last_became_active":"2023-09-30T17:05:03.306711+0000","last_became_peered":"2023-09-30T17:05:03.306711+0000","last_unstale":"2023-09-30T17:05:25.306879+0000","last_undegraded":"2023-09-30T17:05:25.306879+0000","last_fullsized":"2023-09-30T17:05:25.306879+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:11:56.900744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"59'10","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305401+0000","last_change":"2023-09-30T17:05:03.311669+0000","last_active":"2023-09-30T17:05:25.305401+0000","last_peered":"2023-09-30T17:05:25.305401+0000","last_clean":"2023-09-30T17:05:25.305401+0000","last_became_active":"2023-09-30T17:05:03.310763+0000","last_became_peered":"2023-09-30T17:05:03.310763+0000","last_unstale":"2023-09-30T17:05:25.305401+0000","last_undegraded":"2023-09-30T17:05:25.305401+0000","last_fullsized":"2023-09-30T17:05:25.305401+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:36:53.333402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":71,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306260+0000","last_change":"2023-09-30T17:02:17.360802+0000","last_active":"2023-09-30T17:05:25.306260+0000","last_peered":"2023-09-30T17:05:25.306260+0000","last_clean":"2023-09-30T17:05:25.306260+0000","last_became_active":"2023-09-30T17:02:17.360475+0000","last_became_peered":"2023-09-30T17:02:17.360475+0000","last_unstale":"2023-09-30T17:05:25.306260+0000","last_undegraded":"2023-09-30T17:05:25.306260+0000","last_fullsized":"2023-09-30T17:05:25.306260+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:50:18.455188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"59'5711","reported_seq":5780,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306268+0000","last_change":"2023-09-30T17:02:18.359857+0000","last_active":"2023-09-30T17:05:25.306268+0000","last_peered":"2023-09-30T17:05:25.306268+0000","last_clean":"2023-09-30T17:05:25.306268+0000","last_became_active":"2023-09-30T17:02:18.357098+0000","last_became_peered":"2023-09-30T17:02:18.357098+0000","last_unstale":"2023-09-30T17:05:25.306268+0000","last_undegraded":"2023-09-30T17:05:25.306268+0000","last_fullsized":"2023-09-30T17:05:25.306268+0000","mapping_epoch":17,"log_start":"42'1200","ondisk_log_start":"42'1200","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4511,"log_dups_size":1200,"ondisk_log_size":4511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:48:17.598726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16681,"num_write_kb":79476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":85,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306263+0000","last_change":"2023-09-30T17:05:03.313345+0000","last_active":"2023-09-30T17:05:25.306263+0000","last_peered":"2023-09-30T17:05:25.306263+0000","last_clean":"2023-09-30T17:05:25.306263+0000","last_became_active":"2023-09-30T17:05:03.313050+0000","last_became_peered":"2023-09-30T17:05:03.313050+0000","last_unstale":"2023-09-30T17:05:25.306263+0000","last_undegraded":"2023-09-30T17:05:25.306263+0000","last_fullsized":"2023-09-30T17:05:25.306263+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:24:52.247523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"59'2872","reported_seq":2939,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305196+0000","last_change":"2023-09-30T17:05:06.290298+0000","last_active":"2023-09-30T17:05:25.305196+0000","last_peered":"2023-09-30T17:05:25.305196+0000","last_clean":"2023-09-30T17:05:25.305196+0000","last_became_active":"2023-09-30T17:05:06.289197+0000","last_became_peered":"2023-09-30T17:05:06.289197+0000","last_unstale":"2023-09-30T17:05:25.305196+0000","last_undegraded":"2023-09-30T17:05:25.305196+0000","last_fullsized":"2023-09-30T17:05:25.305196+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2872,"log_dups_size":0,"ondisk_log_size":2872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:57:10.410506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8447,"num_write_kb":40072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"59'9","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305150+0000","last_change":"2023-09-30T17:05:03.310950+0000","last_active":"2023-09-30T17:05:25.305150+0000","last_peered":"2023-09-30T17:05:25.305150+0000","last_clean":"2023-09-30T17:05:25.305150+0000","last_became_active":"2023-09-30T17:05:03.310591+0000","last_became_peered":"2023-09-30T17:05:03.310591+0000","last_unstale":"2023-09-30T17:05:25.305150+0000","last_undegraded":"2023-09-30T17:05:25.305150+0000","last_fullsized":"2023-09-30T17:05:25.305150+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:26:23.194138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"59'13","reported_seq":82,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305292+0000","last_change":"2023-09-30T17:02:18.363479+0000","last_active":"2023-09-30T17:05:25.305292+0000","last_peered":"2023-09-30T17:05:25.305292+0000","last_clean":"2023-09-30T17:05:25.305292+0000","last_became_active":"2023-09-30T17:02:18.363222+0000","last_became_peered":"2023-09-30T17:02:18.363222+0000","last_unstale":"2023-09-30T17:05:25.305292+0000","last_undegraded":"2023-09-30T17:05:25.305292+0000","last_fullsized":"2023-09-30T17:05:25.305292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:09:55.056098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"59'2796","reported_seq":2885,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306184+0000","last_change":"2023-09-30T17:05:06.292455+0000","last_active":"2023-09-30T17:05:25.306184+0000","last_peered":"2023-09-30T17:05:25.306184+0000","last_clean":"2023-09-30T17:05:25.306184+0000","last_became_active":"2023-09-30T17:05:06.290929+0000","last_became_peered":"2023-09-30T17:05:06.290929+0000","last_unstale":"2023-09-30T17:05:25.306184+0000","last_undegraded":"2023-09-30T17:05:25.306184+0000","last_fullsized":"2023-09-30T17:05:25.306184+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2796,"log_dups_size":0,"ondisk_log_size":2796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:54:14.579761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8138,"num_write_kb":38784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"59'2852","reported_seq":2921,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305723+0000","last_change":"2023-09-30T17:02:18.363216+0000","last_active":"2023-09-30T17:05:25.305723+0000","last_peered":"2023-09-30T17:05:25.305723+0000","last_clean":"2023-09-30T17:05:25.305723+0000","last_became_active":"2023-09-30T17:02:18.362894+0000","last_became_peered":"2023-09-30T17:02:18.362894+0000","last_unstale":"2023-09-30T17:05:25.305723+0000","last_undegraded":"2023-09-30T17:05:25.305723+0000","last_fullsized":"2023-09-30T17:05:25.305723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2852,"log_dups_size":0,"ondisk_log_size":2852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:30:43.782165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8357,"num_write_kb":39780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"59'2874","reported_seq":2963,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306543+0000","last_change":"2023-09-30T17:05:06.294279+0000","last_active":"2023-09-30T17:05:25.306543+0000","last_peered":"2023-09-30T17:05:25.306543+0000","last_clean":"2023-09-30T17:05:25.306543+0000","last_became_active":"2023-09-30T17:05:06.292898+0000","last_became_peered":"2023-09-30T17:05:06.292898+0000","last_unstale":"2023-09-30T17:05:25.306543+0000","last_undegraded":"2023-09-30T17:05:25.306543+0000","last_fullsized":"2023-09-30T17:05:25.306543+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2874,"log_dups_size":0,"ondisk_log_size":2874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:02:14.484209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8465,"num_write_kb":40104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":532685,"num_write_kb":2575302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140940,"ondisk_log_size":140940,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":228927,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":137,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":223425,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":524288,"data_stored":457854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":66,"seq":283467841544,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47044,"kb_used_data":1460,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94324796,"statfs":{"total":96636764160,"available":96588591104,"internally_reserved":0,"allocated":1495040,"data_stored":1123985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7139,"internal_metadata":46654493},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59499999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738413,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":582456,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":580990,"kb_avail":93789384,"statfs":{"total":96636764160,"available":96040329216,"internally_reserved":0,"allocated":1482752,"data_stored":1122763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":594934214},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 17:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.51800000000000002,"15min":0.48999999999999999},"min":{"1min":0.215,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":5.9480000000000004,"5min":5.9480000000000004,"15min":5.9480000000000004},"last":0.441},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.503,"15min":0.46300000000000002},"min":{"1min":0.216,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":3.6819999999999999,"5min":3.6819999999999999,"15min":3.6819999999999999},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.624}]}]},{"osd":1,"up_from":8,"seq":34359738413,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":563596,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":562942,"kb_avail":93808244,"statfs":{"total":96636764160,"available":96059641856,"internally_reserved":0,"allocated":651264,"data_stored":305912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":576453062},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 17:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.48599999999999999,"15min":0.45600000000000002},"min":{"1min":0.19800000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":3.3420000000000001,"5min":3.3420000000000001,"15min":3.3420000000000001},"last":0.433},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.51200000000000001,"15min":0.46000000000000002},"min":{"1min":0.189,"5min":0.188,"15min":0.188},"max":{"1min":3.5470000000000002,"5min":3.5470000000000002,"15min":3.5470000000000002},"last":0.50800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":249856,"data_stored":227705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":228927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T17:05:33.336 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T17:05:33.763 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:05:33.763 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":76,"fsid":"68daccc3-6ea9-4db7-9771-3803ff202df8","created":"2023-09-30T17:01:55.306262+0000","modified":"2023-09-30T17:05:26.305787+0000","last_up_change":"2023-09-30T17:05:02.282813+0000","last_in_change":"2023-09-30T17:01:56.571968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T17:02:05.343048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T17:02:11.033979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T17:02:15.583451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T17:02:16.734427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9d1653a-8830-4fad-911b-8e7221ee8697","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6801","nonce":2212861041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6803","nonce":2212861041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6807","nonce":2212861041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6805","nonce":2212861041}]},"public_addr":"172.21.15.31:6801/2212861041","cluster_addr":"172.21.15.31:6803/2212861041","heartbeat_back_addr":"172.21.15.31:6807/2212861041","heartbeat_front_addr":"172.21.15.31:6805/2212861041","state":["exists","up"]},{"osd":1,"uuid":"7123aa56-aa1a-43a4-b154-a40b4c70d169","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6801","nonce":1680420094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6803","nonce":1680420094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6807","nonce":1680420094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6805","nonce":1680420094}]},"public_addr":"172.21.15.72:6801/1680420094","cluster_addr":"172.21.15.72:6803/1680420094","heartbeat_back_addr":"172.21.15.72:6807/1680420094","heartbeat_front_addr":"172.21.15.72:6805/1680420094","state":["exists","up"]},{"osd":2,"uuid":"f40ee0d7-7bc3-4a46-bdac-9c134c55c907","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":22,"up_from":66,"up_thru":69,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3322751189},{"type":"v1","addr":"172.21.15.134:6801","nonce":3322751189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3322751189},{"type":"v1","addr":"172.21.15.134:6803","nonce":3322751189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3322751189},{"type":"v1","addr":"172.21.15.134:6807","nonce":3322751189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3322751189},{"type":"v1","addr":"172.21.15.134:6805","nonce":3322751189}]},"public_addr":"172.21.15.134:6801/3322751189","cluster_addr":"172.21.15.134:6803/3322751189","heartbeat_back_addr":"172.21.15.134:6807/3322751189","heartbeat_front_addr":"172.21.15.134:6805/3322751189","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T17:02:01.702754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T17:02:01.688791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T17:02:01.667971+0000","dead_epoch":22}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T17:05:34.779 INFO:tasks.ceph:Scrubbing osd.0 2023-09-30T17:05:34.857 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-09-30T17:05:35.022 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-09-30T17:05:35.022 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-30T17:05:35.023 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-09-30T17:05:35.035 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-09-30T17:05:35.375 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 0 to deep-scrub 2023-09-30T17:05:35.387 INFO:tasks.ceph:Scrubbing osd.1 2023-09-30T17:05:35.387 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-09-30T17:05:35.538 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-09-30T17:05:35.538 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-09-30T17:05:35.538 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-09-30T17:05:35.550 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-09-30T17:05:35.885 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 1 to deep-scrub 2023-09-30T17:05:36.287 INFO:tasks.ceph:Scrubbing osd.2 2023-09-30T17:05:36.287 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-09-30T17:05:36.442 INFO:teuthology.orchestra.run.smithi007.stdout:{ 2023-09-30T17:05:37.627 INFO:teuthology.orchestra.run.smithi007.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-09-30T17:05:37.627 INFO:teuthology.orchestra.run.smithi007.stdout:} 2023-09-30T17:05:37.628 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-09-30T17:05:38.055 INFO:teuthology.orchestra.run.smithi007.stderr:instructed osd(s) 2 to deep-scrub 2023-09-30T17:05:38.069 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T17:05:38.415 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:05:38.417 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-09-30T17:05:38.427 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":180,"stamp":"2023-09-30T17:05:37.341588+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":819295,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":140,"num_read_kb":122,"num_write":533025,"num_write_kb":2579054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":223425,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141229,"ondisk_log_size":141229,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1193096,"kb_used_data":3544,"kb_used_omap":10,"kb_used_meta":1189493,"kb_avail":281922424,"statfs":{"total":289910292480,"available":288688562176,"internally_reserved":0,"allocated":3629056,"data_stored":2552660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10327,"internal_metadata":1218041769},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.034007"},"pg_stats":[{"pgid":"4.3f","version":"59'2790","reported_seq":2859,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.307056+0000","last_change":"2023-09-30T17:02:18.360288+0000","last_active":"2023-09-30T17:05:25.307056+0000","last_peered":"2023-09-30T17:05:25.307056+0000","last_clean":"2023-09-30T17:05:25.307056+0000","last_became_active":"2023-09-30T17:02:18.358716+0000","last_became_peered":"2023-09-30T17:02:18.358716+0000","last_unstale":"2023-09-30T17:05:25.307056+0000","last_undegraded":"2023-09-30T17:05:25.307056+0000","last_fullsized":"2023-09-30T17:05:25.307056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2790,"log_dups_size":0,"ondisk_log_size":2790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:12:06.380095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8214,"num_write_kb":38924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"59'4","reported_seq":73,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306636+0000","last_change":"2023-09-30T17:02:18.362418+0000","last_active":"2023-09-30T17:05:25.306636+0000","last_peered":"2023-09-30T17:05:25.306636+0000","last_clean":"2023-09-30T17:05:25.306636+0000","last_became_active":"2023-09-30T17:02:18.360372+0000","last_became_peered":"2023-09-30T17:02:18.360372+0000","last_unstale":"2023-09-30T17:05:25.306636+0000","last_undegraded":"2023-09-30T17:05:25.306636+0000","last_fullsized":"2023-09-30T17:05:25.306636+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:43:29.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"59'5697","reported_seq":5771,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306021+0000","last_change":"2023-09-30T17:05:06.291597+0000","last_active":"2023-09-30T17:05:25.306021+0000","last_peered":"2023-09-30T17:05:25.306021+0000","last_clean":"2023-09-30T17:05:25.306021+0000","last_became_active":"2023-09-30T17:05:06.290447+0000","last_became_peered":"2023-09-30T17:05:06.290447+0000","last_unstale":"2023-09-30T17:05:25.306021+0000","last_undegraded":"2023-09-30T17:05:25.306021+0000","last_fullsized":"2023-09-30T17:05:25.306021+0000","mapping_epoch":69,"log_start":"42'1200","ondisk_log_start":"42'1200","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4497,"log_dups_size":1200,"ondisk_log_size":4497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:02:21.064107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16590,"num_write_kb":78960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"59'10","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305409+0000","last_change":"2023-09-30T17:05:03.309996+0000","last_active":"2023-09-30T17:05:25.305409+0000","last_peered":"2023-09-30T17:05:25.305409+0000","last_clean":"2023-09-30T17:05:25.305409+0000","last_became_active":"2023-09-30T17:05:03.309326+0000","last_became_peered":"2023-09-30T17:05:03.309326+0000","last_unstale":"2023-09-30T17:05:25.305409+0000","last_undegraded":"2023-09-30T17:05:25.305409+0000","last_fullsized":"2023-09-30T17:05:25.305409+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:31:23.164242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"59'2934","reported_seq":3003,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306421+0000","last_change":"2023-09-30T17:02:18.360192+0000","last_active":"2023-09-30T17:05:25.306421+0000","last_peered":"2023-09-30T17:05:25.306421+0000","last_clean":"2023-09-30T17:05:25.306421+0000","last_became_active":"2023-09-30T17:02:18.357317+0000","last_became_peered":"2023-09-30T17:02:18.357317+0000","last_unstale":"2023-09-30T17:05:25.306421+0000","last_undegraded":"2023-09-30T17:05:25.306421+0000","last_fullsized":"2023-09-30T17:05:25.306421+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2934,"log_dups_size":0,"ondisk_log_size":2934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:37:14.790993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8466,"num_write_kb":40084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"59'6","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305283+0000","last_change":"2023-09-30T17:05:03.311318+0000","last_active":"2023-09-30T17:05:25.305283+0000","last_peered":"2023-09-30T17:05:25.305283+0000","last_clean":"2023-09-30T17:05:25.305283+0000","last_became_active":"2023-09-30T17:05:03.310703+0000","last_became_peered":"2023-09-30T17:05:03.310703+0000","last_unstale":"2023-09-30T17:05:25.305283+0000","last_undegraded":"2023-09-30T17:05:25.305283+0000","last_fullsized":"2023-09-30T17:05:25.305283+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:08:45.345559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"59'7","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305160+0000","last_change":"2023-09-30T17:05:03.310838+0000","last_active":"2023-09-30T17:05:25.305160+0000","last_peered":"2023-09-30T17:05:25.305160+0000","last_clean":"2023-09-30T17:05:25.305160+0000","last_became_active":"2023-09-30T17:05:03.310047+0000","last_became_peered":"2023-09-30T17:05:03.310047+0000","last_unstale":"2023-09-30T17:05:25.305160+0000","last_undegraded":"2023-09-30T17:05:25.305160+0000","last_fullsized":"2023-09-30T17:05:25.305160+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:29:17.418059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"59'11423","reported_seq":11499,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.304794+0000","last_change":"2023-09-30T17:05:06.286653+0000","last_active":"2023-09-30T17:05:25.304794+0000","last_peered":"2023-09-30T17:05:25.304794+0000","last_clean":"2023-09-30T17:05:25.304794+0000","last_became_active":"2023-09-30T17:05:06.285582+0000","last_became_peered":"2023-09-30T17:05:06.285582+0000","last_unstale":"2023-09-30T17:05:25.304794+0000","last_undegraded":"2023-09-30T17:05:25.304794+0000","last_fullsized":"2023-09-30T17:05:25.304794+0000","mapping_epoch":69,"log_start":"52'7200","ondisk_log_start":"52'7200","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4223,"log_dups_size":5777,"ondisk_log_size":4223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:35:18.578031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33444,"num_write_kb":158924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"59'8589","reported_seq":8658,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306041+0000","last_change":"2023-09-30T17:02:18.364222+0000","last_active":"2023-09-30T17:05:25.306041+0000","last_peered":"2023-09-30T17:05:25.306041+0000","last_clean":"2023-09-30T17:05:25.306041+0000","last_became_active":"2023-09-30T17:02:18.363485+0000","last_became_peered":"2023-09-30T17:02:18.363485+0000","last_unstale":"2023-09-30T17:05:25.306041+0000","last_undegraded":"2023-09-30T17:05:25.306041+0000","last_fullsized":"2023-09-30T17:05:25.306041+0000","mapping_epoch":17,"log_start":"49'4400","ondisk_log_start":"49'4400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4189,"log_dups_size":4400,"ondisk_log_size":4189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:14:35.192615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25052,"num_write_kb":118756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"59'8585","reported_seq":8654,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306806+0000","last_change":"2023-09-30T17:02:18.360010+0000","last_active":"2023-09-30T17:05:25.306806+0000","last_peered":"2023-09-30T17:05:25.306806+0000","last_clean":"2023-09-30T17:05:25.306806+0000","last_became_active":"2023-09-30T17:02:18.358396+0000","last_became_peered":"2023-09-30T17:02:18.358396+0000","last_unstale":"2023-09-30T17:05:25.306806+0000","last_undegraded":"2023-09-30T17:05:25.306806+0000","last_fullsized":"2023-09-30T17:05:25.306806+0000","mapping_epoch":17,"log_start":"48'4100","ondisk_log_start":"48'4100","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4485,"log_dups_size":4100,"ondisk_log_size":4485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:26:11.522402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24997,"num_write_kb":162463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"59'5664","reported_seq":5740,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305719+0000","last_change":"2023-09-30T17:05:06.291535+0000","last_active":"2023-09-30T17:05:25.305719+0000","last_peered":"2023-09-30T17:05:25.305719+0000","last_clean":"2023-09-30T17:05:25.305719+0000","last_became_active":"2023-09-30T17:05:06.290193+0000","last_became_peered":"2023-09-30T17:05:06.290193+0000","last_unstale":"2023-09-30T17:05:25.305719+0000","last_undegraded":"2023-09-30T17:05:25.305719+0000","last_fullsized":"2023-09-30T17:05:25.305719+0000","mapping_epoch":69,"log_start":"43'1400","ondisk_log_start":"43'1400","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4264,"log_dups_size":1400,"ondisk_log_size":4264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:21:15.508580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16442,"num_write_kb":78308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"59'2931","reported_seq":3020,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306235+0000","last_change":"2023-09-30T17:05:06.290270+0000","last_active":"2023-09-30T17:05:25.306235+0000","last_peered":"2023-09-30T17:05:25.306235+0000","last_clean":"2023-09-30T17:05:25.306235+0000","last_became_active":"2023-09-30T17:05:06.288753+0000","last_became_peered":"2023-09-30T17:05:06.288753+0000","last_unstale":"2023-09-30T17:05:25.306235+0000","last_undegraded":"2023-09-30T17:05:25.306235+0000","last_fullsized":"2023-09-30T17:05:25.306235+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2931,"log_dups_size":0,"ondisk_log_size":2931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:38:30.988146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8488,"num_write_kb":40364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"59'2860","reported_seq":2929,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306164+0000","last_change":"2023-09-30T17:02:18.359894+0000","last_active":"2023-09-30T17:05:25.306164+0000","last_peered":"2023-09-30T17:05:25.306164+0000","last_clean":"2023-09-30T17:05:25.306164+0000","last_became_active":"2023-09-30T17:02:18.358534+0000","last_became_peered":"2023-09-30T17:02:18.358534+0000","last_unstale":"2023-09-30T17:05:25.306164+0000","last_undegraded":"2023-09-30T17:05:25.306164+0000","last_fullsized":"2023-09-30T17:05:25.306164+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2860,"log_dups_size":0,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:22:13.025181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8367,"num_write_kb":39772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"59'2911","reported_seq":2978,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305184+0000","last_change":"2023-09-30T17:05:06.289465+0000","last_active":"2023-09-30T17:05:25.305184+0000","last_peered":"2023-09-30T17:05:25.305184+0000","last_clean":"2023-09-30T17:05:25.305184+0000","last_became_active":"2023-09-30T17:05:06.288360+0000","last_became_peered":"2023-09-30T17:05:06.288360+0000","last_unstale":"2023-09-30T17:05:25.305184+0000","last_undegraded":"2023-09-30T17:05:25.305184+0000","last_fullsized":"2023-09-30T17:05:25.305184+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2911,"log_dups_size":0,"ondisk_log_size":2911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:53:55.381223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8419,"num_write_kb":39940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"59'2889","reported_seq":2956,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305078+0000","last_change":"2023-09-30T17:05:06.286551+0000","last_active":"2023-09-30T17:05:25.305078+0000","last_peered":"2023-09-30T17:05:25.305078+0000","last_clean":"2023-09-30T17:05:25.305078+0000","last_became_active":"2023-09-30T17:05:06.285738+0000","last_became_peered":"2023-09-30T17:05:06.285738+0000","last_unstale":"2023-09-30T17:05:25.305078+0000","last_undegraded":"2023-09-30T17:05:25.305078+0000","last_fullsized":"2023-09-30T17:05:25.305078+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2889,"log_dups_size":0,"ondisk_log_size":2889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:18:17.841837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8435,"num_write_kb":39984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"59'2839","reported_seq":2906,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.304983+0000","last_change":"2023-09-30T17:05:06.291173+0000","last_active":"2023-09-30T17:05:25.304983+0000","last_peered":"2023-09-30T17:05:25.304983+0000","last_clean":"2023-09-30T17:05:25.304983+0000","last_became_active":"2023-09-30T17:05:06.289872+0000","last_became_peered":"2023-09-30T17:05:06.289872+0000","last_unstale":"2023-09-30T17:05:25.304983+0000","last_undegraded":"2023-09-30T17:05:25.304983+0000","last_fullsized":"2023-09-30T17:05:25.304983+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2839,"log_dups_size":0,"ondisk_log_size":2839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:57:27.685208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8166,"num_write_kb":38928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"59'2802","reported_seq":2871,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306044+0000","last_change":"2023-09-30T17:02:18.364360+0000","last_active":"2023-09-30T17:05:25.306044+0000","last_peered":"2023-09-30T17:05:25.306044+0000","last_clean":"2023-09-30T17:05:25.306044+0000","last_became_active":"2023-09-30T17:02:18.363697+0000","last_became_peered":"2023-09-30T17:02:18.363697+0000","last_unstale":"2023-09-30T17:05:25.306044+0000","last_undegraded":"2023-09-30T17:05:25.306044+0000","last_fullsized":"2023-09-30T17:05:25.306044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2802,"log_dups_size":0,"ondisk_log_size":2802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:50:52.893768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8256,"num_write_kb":39208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"59'2860","reported_seq":2929,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306937+0000","last_change":"2023-09-30T17:02:18.360320+0000","last_active":"2023-09-30T17:05:25.306937+0000","last_peered":"2023-09-30T17:05:25.306937+0000","last_clean":"2023-09-30T17:05:25.306937+0000","last_became_active":"2023-09-30T17:02:18.357184+0000","last_became_peered":"2023-09-30T17:02:18.357184+0000","last_unstale":"2023-09-30T17:05:25.306937+0000","last_undegraded":"2023-09-30T17:05:25.306937+0000","last_fullsized":"2023-09-30T17:05:25.306937+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2860,"log_dups_size":0,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:21:45.195007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8368,"num_write_kb":39616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"59'5686","reported_seq":5755,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305812+0000","last_change":"2023-09-30T17:02:18.363956+0000","last_active":"2023-09-30T17:05:25.305812+0000","last_peered":"2023-09-30T17:05:25.305812+0000","last_clean":"2023-09-30T17:05:25.305812+0000","last_became_active":"2023-09-30T17:02:18.363654+0000","last_became_peered":"2023-09-30T17:02:18.363654+0000","last_unstale":"2023-09-30T17:05:25.305812+0000","last_undegraded":"2023-09-30T17:05:25.305812+0000","last_fullsized":"2023-09-30T17:05:25.305812+0000","mapping_epoch":17,"log_start":"44'1500","ondisk_log_start":"44'1500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4186,"log_dups_size":1500,"ondisk_log_size":4186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:48:17.598726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16649,"num_write_kb":78956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"59'5799","reported_seq":5876,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305562+0000","last_change":"2023-09-30T17:05:06.290994+0000","last_active":"2023-09-30T17:05:25.305562+0000","last_peered":"2023-09-30T17:05:25.305562+0000","last_clean":"2023-09-30T17:05:25.305562+0000","last_became_active":"2023-09-30T17:05:06.289817+0000","last_became_peered":"2023-09-30T17:05:06.289817+0000","last_unstale":"2023-09-30T17:05:25.305562+0000","last_undegraded":"2023-09-30T17:05:25.305562+0000","last_fullsized":"2023-09-30T17:05:25.305562+0000","mapping_epoch":69,"log_start":"44'1600","ondisk_log_start":"44'1600","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4199,"log_dups_size":1600,"ondisk_log_size":4199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:50:21.333588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16903,"num_write_kb":80184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"59'12","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305497+0000","last_change":"2023-09-30T17:05:03.310298+0000","last_active":"2023-09-30T17:05:25.305497+0000","last_peered":"2023-09-30T17:05:25.305497+0000","last_clean":"2023-09-30T17:05:25.305497+0000","last_became_active":"2023-09-30T17:05:03.309537+0000","last_became_peered":"2023-09-30T17:05:03.309537+0000","last_unstale":"2023-09-30T17:05:25.305497+0000","last_undegraded":"2023-09-30T17:05:25.305497+0000","last_fullsized":"2023-09-30T17:05:25.305497+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:45:25.545287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"59'2879","reported_seq":2968,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306043+0000","last_change":"2023-09-30T17:05:06.292705+0000","last_active":"2023-09-30T17:05:25.306043+0000","last_peered":"2023-09-30T17:05:25.306043+0000","last_clean":"2023-09-30T17:05:25.306043+0000","last_became_active":"2023-09-30T17:05:06.290797+0000","last_became_peered":"2023-09-30T17:05:06.290797+0000","last_unstale":"2023-09-30T17:05:25.306043+0000","last_undegraded":"2023-09-30T17:05:25.306043+0000","last_fullsized":"2023-09-30T17:05:25.306043+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2879,"log_dups_size":0,"ondisk_log_size":2879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:55:01.976617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8343,"num_write_kb":39768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"59'2809","reported_seq":2898,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305406+0000","last_change":"2023-09-30T17:05:06.290594+0000","last_active":"2023-09-30T17:05:25.305406+0000","last_peered":"2023-09-30T17:05:25.305406+0000","last_clean":"2023-09-30T17:05:25.305406+0000","last_became_active":"2023-09-30T17:05:06.288837+0000","last_became_peered":"2023-09-30T17:05:06.288837+0000","last_unstale":"2023-09-30T17:05:25.305406+0000","last_undegraded":"2023-09-30T17:05:25.305406+0000","last_fullsized":"2023-09-30T17:05:25.305406+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2809,"log_dups_size":0,"ondisk_log_size":2809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:00:48.822153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8281,"num_write_kb":39472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"59'5585","reported_seq":5654,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306010+0000","last_change":"2023-09-30T17:02:18.353938+0000","last_active":"2023-09-30T17:05:25.306010+0000","last_peered":"2023-09-30T17:05:25.306010+0000","last_clean":"2023-09-30T17:05:25.306010+0000","last_became_active":"2023-09-30T17:02:18.353632+0000","last_became_peered":"2023-09-30T17:02:18.353632+0000","last_unstale":"2023-09-30T17:05:25.306010+0000","last_undegraded":"2023-09-30T17:05:25.306010+0000","last_fullsized":"2023-09-30T17:05:25.306010+0000","mapping_epoch":17,"log_start":"42'1100","ondisk_log_start":"42'1100","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4485,"log_dups_size":1100,"ondisk_log_size":4485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:09:55.056098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16523,"num_write_kb":78256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"59'2888","reported_seq":2977,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.307020+0000","last_change":"2023-09-30T17:05:06.292945+0000","last_active":"2023-09-30T17:05:25.307020+0000","last_peered":"2023-09-30T17:05:25.307020+0000","last_clean":"2023-09-30T17:05:25.307020+0000","last_became_active":"2023-09-30T17:05:06.291346+0000","last_became_peered":"2023-09-30T17:05:06.291346+0000","last_unstale":"2023-09-30T17:05:25.307020+0000","last_undegraded":"2023-09-30T17:05:25.307020+0000","last_fullsized":"2023-09-30T17:05:25.307020+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2888,"log_dups_size":0,"ondisk_log_size":2888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:53:27.316963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8371,"num_write_kb":39716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"59'18","reported_seq":98,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306046+0000","last_change":"2023-09-30T17:05:03.309295+0000","last_active":"2023-09-30T17:05:25.306046+0000","last_peered":"2023-09-30T17:05:25.306046+0000","last_clean":"2023-09-30T17:05:25.306046+0000","last_became_active":"2023-09-30T17:05:03.308884+0000","last_became_peered":"2023-09-30T17:05:03.308884+0000","last_unstale":"2023-09-30T17:05:25.306046+0000","last_undegraded":"2023-09-30T17:05:25.306046+0000","last_fullsized":"2023-09-30T17:05:25.306046+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:57:45.449671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"59'2855","reported_seq":2923,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305902+0000","last_change":"2023-09-30T17:05:06.291369+0000","last_active":"2023-09-30T17:05:25.305902+0000","last_peered":"2023-09-30T17:05:25.305902+0000","last_clean":"2023-09-30T17:05:25.305902+0000","last_became_active":"2023-09-30T17:05:06.289447+0000","last_became_peered":"2023-09-30T17:05:06.289447+0000","last_unstale":"2023-09-30T17:05:25.305902+0000","last_undegraded":"2023-09-30T17:05:25.305902+0000","last_fullsized":"2023-09-30T17:05:25.305902+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2855,"log_dups_size":0,"ondisk_log_size":2855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:17:21.412392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8347,"num_write_kb":39608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":71,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306032+0000","last_change":"2023-09-30T17:02:17.358258+0000","last_active":"2023-09-30T17:05:25.306032+0000","last_peered":"2023-09-30T17:05:25.306032+0000","last_clean":"2023-09-30T17:05:25.306032+0000","last_became_active":"2023-09-30T17:02:17.357890+0000","last_became_peered":"2023-09-30T17:02:17.357890+0000","last_unstale":"2023-09-30T17:05:25.306032+0000","last_undegraded":"2023-09-30T17:05:25.306032+0000","last_fullsized":"2023-09-30T17:05:25.306032+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:52:56.591906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"59'17","reported_seq":97,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.307002+0000","last_change":"2023-09-30T17:05:03.307486+0000","last_active":"2023-09-30T17:05:25.307002+0000","last_peered":"2023-09-30T17:05:25.307002+0000","last_clean":"2023-09-30T17:05:25.307002+0000","last_became_active":"2023-09-30T17:05:03.307012+0000","last_became_peered":"2023-09-30T17:05:03.307012+0000","last_unstale":"2023-09-30T17:05:25.307002+0000","last_undegraded":"2023-09-30T17:05:25.307002+0000","last_fullsized":"2023-09-30T17:05:25.307002+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:05:29.995730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305433+0000","last_change":"2023-09-30T17:05:03.309164+0000","last_active":"2023-09-30T17:05:25.305433+0000","last_peered":"2023-09-30T17:05:25.305433+0000","last_clean":"2023-09-30T17:05:25.305433+0000","last_became_active":"2023-09-30T17:05:03.308073+0000","last_became_peered":"2023-09-30T17:05:03.308073+0000","last_unstale":"2023-09-30T17:05:25.305433+0000","last_undegraded":"2023-09-30T17:05:25.305433+0000","last_fullsized":"2023-09-30T17:05:25.305433+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:10:16.238053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"59'6","reported_seq":86,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306073+0000","last_change":"2023-09-30T17:05:03.308692+0000","last_active":"2023-09-30T17:05:25.306073+0000","last_peered":"2023-09-30T17:05:25.306073+0000","last_clean":"2023-09-30T17:05:25.306073+0000","last_became_active":"2023-09-30T17:05:03.307932+0000","last_became_peered":"2023-09-30T17:05:03.307932+0000","last_unstale":"2023-09-30T17:05:25.306073+0000","last_undegraded":"2023-09-30T17:05:25.306073+0000","last_fullsized":"2023-09-30T17:05:25.306073+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:17:13.668052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":70,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305661+0000","last_change":"2023-09-30T17:02:17.361000+0000","last_active":"2023-09-30T17:05:25.305661+0000","last_peered":"2023-09-30T17:05:25.305661+0000","last_clean":"2023-09-30T17:05:25.305661+0000","last_became_active":"2023-09-30T17:02:17.360601+0000","last_became_peered":"2023-09-30T17:02:17.360601+0000","last_unstale":"2023-09-30T17:05:25.305661+0000","last_undegraded":"2023-09-30T17:05:25.305661+0000","last_fullsized":"2023-09-30T17:05:25.305661+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:02:27.666526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"59'7","reported_seq":87,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306929+0000","last_change":"2023-09-30T17:05:03.305898+0000","last_active":"2023-09-30T17:05:25.306929+0000","last_peered":"2023-09-30T17:05:25.306929+0000","last_clean":"2023-09-30T17:05:25.306929+0000","last_became_active":"2023-09-30T17:05:03.305520+0000","last_became_peered":"2023-09-30T17:05:03.305520+0000","last_unstale":"2023-09-30T17:05:25.306929+0000","last_undegraded":"2023-09-30T17:05:25.306929+0000","last_fullsized":"2023-09-30T17:05:25.306929+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:40:09.276369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"58'1","reported_seq":82,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306258+0000","last_change":"2023-09-30T17:05:03.309303+0000","last_active":"2023-09-30T17:05:25.306258+0000","last_peered":"2023-09-30T17:05:25.306258+0000","last_clean":"2023-09-30T17:05:25.306258+0000","last_became_active":"2023-09-30T17:05:03.308851+0000","last_became_peered":"2023-09-30T17:05:03.308851+0000","last_unstale":"2023-09-30T17:05:25.306258+0000","last_undegraded":"2023-09-30T17:05:25.306258+0000","last_fullsized":"2023-09-30T17:05:25.306258+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:32:55.497287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"59'9","reported_seq":78,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305188+0000","last_change":"2023-09-30T17:02:18.358841+0000","last_active":"2023-09-30T17:05:25.305188+0000","last_peered":"2023-09-30T17:05:25.305188+0000","last_clean":"2023-09-30T17:05:25.305188+0000","last_became_active":"2023-09-30T17:02:18.358529+0000","last_became_peered":"2023-09-30T17:02:18.358529+0000","last_unstale":"2023-09-30T17:05:25.305188+0000","last_undegraded":"2023-09-30T17:05:25.305188+0000","last_fullsized":"2023-09-30T17:05:25.305188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:15:54.364571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305635+0000","last_change":"2023-09-30T17:05:03.309409+0000","last_active":"2023-09-30T17:05:25.305635+0000","last_peered":"2023-09-30T17:05:25.305635+0000","last_clean":"2023-09-30T17:05:25.305635+0000","last_became_active":"2023-09-30T17:05:03.309023+0000","last_became_peered":"2023-09-30T17:05:03.309023+0000","last_unstale":"2023-09-30T17:05:25.305635+0000","last_undegraded":"2023-09-30T17:05:25.305635+0000","last_fullsized":"2023-09-30T17:05:25.305635+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:57:05.463330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"59'8526","reported_seq":8618,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305529+0000","last_change":"2023-09-30T17:05:06.292415+0000","last_active":"2023-09-30T17:05:25.305529+0000","last_peered":"2023-09-30T17:05:25.305529+0000","last_clean":"2023-09-30T17:05:25.305529+0000","last_became_active":"2023-09-30T17:05:06.290551+0000","last_became_peered":"2023-09-30T17:05:06.290551+0000","last_unstale":"2023-09-30T17:05:25.305529+0000","last_undegraded":"2023-09-30T17:05:25.305529+0000","last_fullsized":"2023-09-30T17:05:25.305529+0000","mapping_epoch":69,"log_start":"49'4300","ondisk_log_start":"49'4300","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4226,"log_dups_size":4300,"ondisk_log_size":4226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:59:52.758548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24873,"num_write_kb":118472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"59'7","reported_seq":93,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306635+0000","last_change":"2023-09-30T17:05:03.310987+0000","last_active":"2023-09-30T17:05:25.306635+0000","last_peered":"2023-09-30T17:05:25.306635+0000","last_clean":"2023-09-30T17:05:25.306635+0000","last_became_active":"2023-09-30T17:05:03.306646+0000","last_became_peered":"2023-09-30T17:05:03.306646+0000","last_unstale":"2023-09-30T17:05:25.306635+0000","last_undegraded":"2023-09-30T17:05:25.306635+0000","last_fullsized":"2023-09-30T17:05:25.306635+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:24:52.247523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"59'5670","reported_seq":5739,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305419+0000","last_change":"2023-09-30T17:02:18.359118+0000","last_active":"2023-09-30T17:05:25.305419+0000","last_peered":"2023-09-30T17:05:25.305419+0000","last_clean":"2023-09-30T17:05:25.305419+0000","last_became_active":"2023-09-30T17:02:18.358786+0000","last_became_peered":"2023-09-30T17:02:18.358786+0000","last_unstale":"2023-09-30T17:05:25.305419+0000","last_undegraded":"2023-09-30T17:05:25.305419+0000","last_fullsized":"2023-09-30T17:05:25.305419+0000","mapping_epoch":17,"log_start":"44'1500","ondisk_log_start":"44'1500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4170,"log_dups_size":1500,"ondisk_log_size":4170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:33:21.723864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16627,"num_write_kb":79047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"60'78","reported_seq":49,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305537+0000","last_change":"2023-09-30T17:05:03.313916+0000","last_active":"2023-09-30T17:05:25.305537+0000","last_peered":"2023-09-30T17:05:25.305537+0000","last_clean":"2023-09-30T17:05:25.305537+0000","last_became_active":"2023-09-30T17:05:03.302516+0000","last_became_peered":"2023-09-30T17:05:03.302516+0000","last_unstale":"2023-09-30T17:05:25.305537+0000","last_undegraded":"2023-09-30T17:05:25.305537+0000","last_fullsized":"2023-09-30T17:05:25.305537+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:00:50.535715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227523,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":222729,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"59'5677","reported_seq":5756,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305603+0000","last_change":"2023-09-30T17:05:06.289965+0000","last_active":"2023-09-30T17:05:25.305603+0000","last_peered":"2023-09-30T17:05:25.305603+0000","last_clean":"2023-09-30T17:05:25.305603+0000","last_became_active":"2023-09-30T17:05:06.288155+0000","last_became_peered":"2023-09-30T17:05:06.288155+0000","last_unstale":"2023-09-30T17:05:25.305603+0000","last_undegraded":"2023-09-30T17:05:25.305603+0000","last_fullsized":"2023-09-30T17:05:25.305603+0000","mapping_epoch":69,"log_start":"42'1100","ondisk_log_start":"42'1100","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4577,"log_dups_size":1100,"ondisk_log_size":4577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:26:23.188915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16579,"num_write_kb":79104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305299+0000","last_change":"2023-09-30T17:05:03.310322+0000","last_active":"2023-09-30T17:05:25.305299+0000","last_peered":"2023-09-30T17:05:25.305299+0000","last_clean":"2023-09-30T17:05:25.305299+0000","last_became_active":"2023-09-30T17:05:03.309505+0000","last_became_peered":"2023-09-30T17:05:03.309505+0000","last_unstale":"2023-09-30T17:05:25.305299+0000","last_undegraded":"2023-09-30T17:05:25.305299+0000","last_fullsized":"2023-09-30T17:05:25.305299+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:13:16.014703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"59'2836","reported_seq":2905,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306395+0000","last_change":"2023-09-30T17:02:18.360019+0000","last_active":"2023-09-30T17:05:25.306395+0000","last_peered":"2023-09-30T17:05:25.306395+0000","last_clean":"2023-09-30T17:05:25.306395+0000","last_became_active":"2023-09-30T17:02:18.358364+0000","last_became_peered":"2023-09-30T17:02:18.358364+0000","last_unstale":"2023-09-30T17:05:25.306395+0000","last_undegraded":"2023-09-30T17:05:25.306395+0000","last_fullsized":"2023-09-30T17:05:25.306395+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2836,"log_dups_size":0,"ondisk_log_size":2836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:30:43.782165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8308,"num_write_kb":39456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305535+0000","last_change":"2023-09-30T17:05:03.308853+0000","last_active":"2023-09-30T17:05:25.305535+0000","last_peered":"2023-09-30T17:05:25.305535+0000","last_clean":"2023-09-30T17:05:25.305535+0000","last_became_active":"2023-09-30T17:05:03.308377+0000","last_became_peered":"2023-09-30T17:05:03.308377+0000","last_unstale":"2023-09-30T17:05:25.305535+0000","last_undegraded":"2023-09-30T17:05:25.305535+0000","last_fullsized":"2023-09-30T17:05:25.305535+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:18:42.448826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"59'2856","reported_seq":2925,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306869+0000","last_change":"2023-09-30T17:02:18.362415+0000","last_active":"2023-09-30T17:05:25.306869+0000","last_peered":"2023-09-30T17:05:25.306869+0000","last_clean":"2023-09-30T17:05:25.306869+0000","last_became_active":"2023-09-30T17:02:18.361556+0000","last_became_peered":"2023-09-30T17:02:18.361556+0000","last_unstale":"2023-09-30T17:05:25.306869+0000","last_undegraded":"2023-09-30T17:05:25.306869+0000","last_fullsized":"2023-09-30T17:05:25.306869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2856,"log_dups_size":0,"ondisk_log_size":2856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:16:41.607547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8321,"num_write_kb":39600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306039+0000","last_change":"2023-09-30T17:05:03.304220+0000","last_active":"2023-09-30T17:05:25.306039+0000","last_peered":"2023-09-30T17:05:25.306039+0000","last_clean":"2023-09-30T17:05:25.306039+0000","last_became_active":"2023-09-30T17:05:03.303598+0000","last_became_peered":"2023-09-30T17:05:03.303598+0000","last_unstale":"2023-09-30T17:05:25.306039+0000","last_undegraded":"2023-09-30T17:05:25.306039+0000","last_fullsized":"2023-09-30T17:05:25.306039+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:57:44.444041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"59'12","reported_seq":92,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306163+0000","last_change":"2023-09-30T17:05:03.313214+0000","last_active":"2023-09-30T17:05:25.306163+0000","last_peered":"2023-09-30T17:05:25.306163+0000","last_clean":"2023-09-30T17:05:25.306163+0000","last_became_active":"2023-09-30T17:05:03.312888+0000","last_became_peered":"2023-09-30T17:05:03.312888+0000","last_unstale":"2023-09-30T17:05:25.306163+0000","last_undegraded":"2023-09-30T17:05:25.306163+0000","last_fullsized":"2023-09-30T17:05:25.306163+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:40:09.276369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"59'9","reported_seq":35,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305075+0000","last_change":"2023-09-30T17:05:03.304503+0000","last_active":"2023-09-30T17:05:25.305075+0000","last_peered":"2023-09-30T17:05:25.305075+0000","last_clean":"2023-09-30T17:05:25.305075+0000","last_became_active":"2023-09-30T17:05:03.304030+0000","last_became_peered":"2023-09-30T17:05:03.304030+0000","last_unstale":"2023-09-30T17:05:25.305075+0000","last_undegraded":"2023-09-30T17:05:25.305075+0000","last_fullsized":"2023-09-30T17:05:25.305075+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:08:35.110114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"59'2892","reported_seq":2981,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306333+0000","last_change":"2023-09-30T17:05:06.290230+0000","last_active":"2023-09-30T17:05:25.306333+0000","last_peered":"2023-09-30T17:05:25.306333+0000","last_clean":"2023-09-30T17:05:25.306333+0000","last_became_active":"2023-09-30T17:05:06.288725+0000","last_became_peered":"2023-09-30T17:05:06.288725+0000","last_unstale":"2023-09-30T17:05:25.306333+0000","last_undegraded":"2023-09-30T17:05:25.306333+0000","last_fullsized":"2023-09-30T17:05:25.306333+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2892,"log_dups_size":0,"ondisk_log_size":2892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:27:28.611647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8345,"num_write_kb":39712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305902+0000","last_change":"2023-09-30T17:05:03.304339+0000","last_active":"2023-09-30T17:05:25.305902+0000","last_peered":"2023-09-30T17:05:25.305902+0000","last_clean":"2023-09-30T17:05:25.305902+0000","last_became_active":"2023-09-30T17:05:03.303179+0000","last_became_peered":"2023-09-30T17:05:03.303179+0000","last_unstale":"2023-09-30T17:05:25.305902+0000","last_undegraded":"2023-09-30T17:05:25.305902+0000","last_fullsized":"2023-09-30T17:05:25.305902+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:44:20.765682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"59'2861","reported_seq":2950,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305648+0000","last_change":"2023-09-30T17:05:06.290324+0000","last_active":"2023-09-30T17:05:25.305648+0000","last_peered":"2023-09-30T17:05:25.305648+0000","last_clean":"2023-09-30T17:05:25.305648+0000","last_became_active":"2023-09-30T17:05:06.288824+0000","last_became_peered":"2023-09-30T17:05:06.288824+0000","last_unstale":"2023-09-30T17:05:25.305648+0000","last_undegraded":"2023-09-30T17:05:25.305648+0000","last_fullsized":"2023-09-30T17:05:25.305648+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2861,"log_dups_size":0,"ondisk_log_size":2861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:51:16.138021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8384,"num_write_kb":39788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":83,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306641+0000","last_change":"2023-09-30T17:05:03.304232+0000","last_active":"2023-09-30T17:05:25.306641+0000","last_peered":"2023-09-30T17:05:25.306641+0000","last_clean":"2023-09-30T17:05:25.306641+0000","last_became_active":"2023-09-30T17:05:03.303874+0000","last_became_peered":"2023-09-30T17:05:03.303874+0000","last_unstale":"2023-09-30T17:05:25.306641+0000","last_undegraded":"2023-09-30T17:05:25.306641+0000","last_fullsized":"2023-09-30T17:05:25.306641+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:39:49.644290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"59'2","reported_seq":71,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306324+0000","last_change":"2023-09-30T17:02:18.359767+0000","last_active":"2023-09-30T17:05:25.306324+0000","last_peered":"2023-09-30T17:05:25.306324+0000","last_clean":"2023-09-30T17:05:25.306324+0000","last_became_active":"2023-09-30T17:02:18.356825+0000","last_became_peered":"2023-09-30T17:02:18.356825+0000","last_unstale":"2023-09-30T17:05:25.306324+0000","last_undegraded":"2023-09-30T17:05:25.306324+0000","last_fullsized":"2023-09-30T17:05:25.306324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:39:16.689300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305494+0000","last_change":"2023-09-30T17:05:03.305087+0000","last_active":"2023-09-30T17:05:25.305494+0000","last_peered":"2023-09-30T17:05:25.305494+0000","last_clean":"2023-09-30T17:05:25.305494+0000","last_became_active":"2023-09-30T17:05:03.304463+0000","last_became_peered":"2023-09-30T17:05:03.304463+0000","last_unstale":"2023-09-30T17:05:25.305494+0000","last_undegraded":"2023-09-30T17:05:25.305494+0000","last_fullsized":"2023-09-30T17:05:25.305494+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:33:20.829898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"59'2835","reported_seq":2903,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305096+0000","last_change":"2023-09-30T17:05:06.289598+0000","last_active":"2023-09-30T17:05:25.305096+0000","last_peered":"2023-09-30T17:05:25.305096+0000","last_clean":"2023-09-30T17:05:25.305096+0000","last_became_active":"2023-09-30T17:05:06.288712+0000","last_became_peered":"2023-09-30T17:05:06.288712+0000","last_unstale":"2023-09-30T17:05:25.305096+0000","last_undegraded":"2023-09-30T17:05:25.305096+0000","last_fullsized":"2023-09-30T17:05:25.305096+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2835,"log_dups_size":0,"ondisk_log_size":2835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:01:17.676791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8288,"num_write_kb":39388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305636+0000","last_change":"2023-09-30T17:05:03.311500+0000","last_active":"2023-09-30T17:05:25.305636+0000","last_peered":"2023-09-30T17:05:25.305636+0000","last_clean":"2023-09-30T17:05:25.305636+0000","last_became_active":"2023-09-30T17:05:03.310836+0000","last_became_peered":"2023-09-30T17:05:03.310836+0000","last_unstale":"2023-09-30T17:05:25.305636+0000","last_undegraded":"2023-09-30T17:05:25.305636+0000","last_fullsized":"2023-09-30T17:05:25.305636+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:30:09.762284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"59'8","reported_seq":88,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305917+0000","last_change":"2023-09-30T17:05:03.308917+0000","last_active":"2023-09-30T17:05:25.305917+0000","last_peered":"2023-09-30T17:05:25.305917+0000","last_clean":"2023-09-30T17:05:25.305917+0000","last_became_active":"2023-09-30T17:05:03.308214+0000","last_became_peered":"2023-09-30T17:05:03.308214+0000","last_unstale":"2023-09-30T17:05:25.305917+0000","last_undegraded":"2023-09-30T17:05:25.305917+0000","last_fullsized":"2023-09-30T17:05:25.305917+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:39:50.649920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"58'3","reported_seq":85,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305666+0000","last_change":"2023-09-30T17:05:03.308944+0000","last_active":"2023-09-30T17:05:25.305666+0000","last_peered":"2023-09-30T17:05:25.305666+0000","last_clean":"2023-09-30T17:05:25.305666+0000","last_became_active":"2023-09-30T17:05:03.308483+0000","last_became_peered":"2023-09-30T17:05:03.308483+0000","last_unstale":"2023-09-30T17:05:25.305666+0000","last_undegraded":"2023-09-30T17:05:25.305666+0000","last_fullsized":"2023-09-30T17:05:25.305666+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:43:27.633747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"59'2846","reported_seq":2913,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305422+0000","last_change":"2023-09-30T17:05:06.290255+0000","last_active":"2023-09-30T17:05:25.305422+0000","last_peered":"2023-09-30T17:05:25.305422+0000","last_clean":"2023-09-30T17:05:25.305422+0000","last_became_active":"2023-09-30T17:05:06.289225+0000","last_became_peered":"2023-09-30T17:05:06.289225+0000","last_unstale":"2023-09-30T17:05:25.305422+0000","last_undegraded":"2023-09-30T17:05:25.305422+0000","last_fullsized":"2023-09-30T17:05:25.305422+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2846,"log_dups_size":0,"ondisk_log_size":2846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:41:31.424933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8199,"num_write_kb":39160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.304959+0000","last_change":"2023-09-30T17:05:03.309689+0000","last_active":"2023-09-30T17:05:25.304959+0000","last_peered":"2023-09-30T17:05:25.304959+0000","last_clean":"2023-09-30T17:05:25.304959+0000","last_became_active":"2023-09-30T17:05:03.309318+0000","last_became_peered":"2023-09-30T17:05:03.309318+0000","last_unstale":"2023-09-30T17:05:25.304959+0000","last_undegraded":"2023-09-30T17:05:25.304959+0000","last_fullsized":"2023-09-30T17:05:25.304959+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:12:37.857480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"59'2831","reported_seq":2898,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305893+0000","last_change":"2023-09-30T17:05:06.289189+0000","last_active":"2023-09-30T17:05:25.305893+0000","last_peered":"2023-09-30T17:05:25.305893+0000","last_clean":"2023-09-30T17:05:25.305893+0000","last_became_active":"2023-09-30T17:05:06.288348+0000","last_became_peered":"2023-09-30T17:05:06.288348+0000","last_unstale":"2023-09-30T17:05:25.305893+0000","last_undegraded":"2023-09-30T17:05:25.305893+0000","last_fullsized":"2023-09-30T17:05:25.305893+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2831,"log_dups_size":0,"ondisk_log_size":2831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:51:59.540252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8336,"num_write_kb":39484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305792+0000","last_change":"2023-09-30T17:05:03.304019+0000","last_active":"2023-09-30T17:05:25.305792+0000","last_peered":"2023-09-30T17:05:25.305792+0000","last_clean":"2023-09-30T17:05:25.305792+0000","last_became_active":"2023-09-30T17:05:03.303473+0000","last_became_peered":"2023-09-30T17:05:03.303473+0000","last_unstale":"2023-09-30T17:05:25.305792+0000","last_undegraded":"2023-09-30T17:05:25.305792+0000","last_fullsized":"2023-09-30T17:05:25.305792+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:10:16.238053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"59'2884","reported_seq":2951,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306051+0000","last_change":"2023-09-30T17:05:06.289446+0000","last_active":"2023-09-30T17:05:25.306051+0000","last_peered":"2023-09-30T17:05:25.306051+0000","last_clean":"2023-09-30T17:05:25.306051+0000","last_became_active":"2023-09-30T17:05:06.288169+0000","last_became_peered":"2023-09-30T17:05:06.288169+0000","last_unstale":"2023-09-30T17:05:25.306051+0000","last_undegraded":"2023-09-30T17:05:25.306051+0000","last_fullsized":"2023-09-30T17:05:25.306051+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2884,"log_dups_size":0,"ondisk_log_size":2884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:15:23.507816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8366,"num_write_kb":39744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":70,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305775+0000","last_change":"2023-09-30T17:02:17.358811+0000","last_active":"2023-09-30T17:05:25.305775+0000","last_peered":"2023-09-30T17:05:25.305775+0000","last_clean":"2023-09-30T17:05:25.305775+0000","last_became_active":"2023-09-30T17:02:17.358582+0000","last_became_peered":"2023-09-30T17:02:17.358582+0000","last_unstale":"2023-09-30T17:05:25.305775+0000","last_undegraded":"2023-09-30T17:05:25.305775+0000","last_fullsized":"2023-09-30T17:05:25.305775+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:52:37.518693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"59'8580","reported_seq":8649,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306158+0000","last_change":"2023-09-30T17:02:18.364478+0000","last_active":"2023-09-30T17:05:25.306158+0000","last_peered":"2023-09-30T17:05:25.306158+0000","last_clean":"2023-09-30T17:05:25.306158+0000","last_became_active":"2023-09-30T17:02:18.364057+0000","last_became_peered":"2023-09-30T17:02:18.364057+0000","last_unstale":"2023-09-30T17:05:25.306158+0000","last_undegraded":"2023-09-30T17:05:25.306158+0000","last_fullsized":"2023-09-30T17:05:25.306158+0000","mapping_epoch":17,"log_start":"49'4400","ondisk_log_start":"49'4400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4180,"log_dups_size":4400,"ondisk_log_size":4180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:13:55.555700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25046,"num_write_kb":118972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":73,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305797+0000","last_change":"2023-09-30T17:02:12.327704+0000","last_active":"2023-09-30T17:05:25.305797+0000","last_peered":"2023-09-30T17:05:25.305797+0000","last_clean":"2023-09-30T17:05:25.305797+0000","last_became_active":"2023-09-30T17:02:12.327384+0000","last_became_peered":"2023-09-30T17:02:12.327384+0000","last_unstale":"2023-09-30T17:05:25.305797+0000","last_undegraded":"2023-09-30T17:05:25.305797+0000","last_fullsized":"2023-09-30T17:05:25.305797+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:09:34.818252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306075+0000","last_change":"2023-09-30T17:05:03.311271+0000","last_active":"2023-09-30T17:05:25.306075+0000","last_peered":"2023-09-30T17:05:25.306075+0000","last_clean":"2023-09-30T17:05:25.306075+0000","last_became_active":"2023-09-30T17:05:03.310655+0000","last_became_peered":"2023-09-30T17:05:03.310655+0000","last_unstale":"2023-09-30T17:05:25.306075+0000","last_undegraded":"2023-09-30T17:05:25.306075+0000","last_fullsized":"2023-09-30T17:05:25.306075+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:49:35.748952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"59'9","reported_seq":89,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306198+0000","last_change":"2023-09-30T17:05:03.306223+0000","last_active":"2023-09-30T17:05:25.306198+0000","last_peered":"2023-09-30T17:05:25.306198+0000","last_clean":"2023-09-30T17:05:25.306198+0000","last_became_active":"2023-09-30T17:05:03.305956+0000","last_became_peered":"2023-09-30T17:05:03.305956+0000","last_unstale":"2023-09-30T17:05:25.306198+0000","last_undegraded":"2023-09-30T17:05:25.306198+0000","last_fullsized":"2023-09-30T17:05:25.306198+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:32:56.502917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.304959+0000","last_change":"2023-09-30T17:05:03.309359+0000","last_active":"2023-09-30T17:05:25.304959+0000","last_peered":"2023-09-30T17:05:25.304959+0000","last_clean":"2023-09-30T17:05:25.304959+0000","last_became_active":"2023-09-30T17:05:03.308944+0000","last_became_peered":"2023-09-30T17:05:03.308944+0000","last_unstale":"2023-09-30T17:05:25.304959+0000","last_undegraded":"2023-09-30T17:05:25.304959+0000","last_fullsized":"2023-09-30T17:05:25.304959+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:02:58.156693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305781+0000","last_change":"2023-09-30T17:05:03.311106+0000","last_active":"2023-09-30T17:05:25.305781+0000","last_peered":"2023-09-30T17:05:25.305781+0000","last_clean":"2023-09-30T17:05:25.305781+0000","last_became_active":"2023-09-30T17:05:03.310706+0000","last_became_peered":"2023-09-30T17:05:03.310706+0000","last_unstale":"2023-09-30T17:05:25.305781+0000","last_undegraded":"2023-09-30T17:05:25.305781+0000","last_fullsized":"2023-09-30T17:05:25.305781+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:04:03.231664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"59'9","reported_seq":78,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305690+0000","last_change":"2023-09-30T17:02:18.363399+0000","last_active":"2023-09-30T17:05:25.305690+0000","last_peered":"2023-09-30T17:05:25.305690+0000","last_clean":"2023-09-30T17:05:25.305690+0000","last_became_active":"2023-09-30T17:02:18.363064+0000","last_became_peered":"2023-09-30T17:02:18.363064+0000","last_unstale":"2023-09-30T17:05:25.305690+0000","last_undegraded":"2023-09-30T17:05:25.305690+0000","last_fullsized":"2023-09-30T17:05:25.305690+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:32:34.654264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":73,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305329+0000","last_change":"2023-09-30T17:02:12.327834+0000","last_active":"2023-09-30T17:05:25.305329+0000","last_peered":"2023-09-30T17:05:25.305329+0000","last_clean":"2023-09-30T17:05:25.305329+0000","last_became_active":"2023-09-30T17:02:12.327542+0000","last_became_peered":"2023-09-30T17:02:12.327542+0000","last_unstale":"2023-09-30T17:05:25.305329+0000","last_undegraded":"2023-09-30T17:05:25.305329+0000","last_fullsized":"2023-09-30T17:05:25.305329+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:49:54.890769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":81,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305806+0000","last_change":"2023-09-30T17:05:03.305668+0000","last_active":"2023-09-30T17:05:25.305806+0000","last_peered":"2023-09-30T17:05:25.305806+0000","last_clean":"2023-09-30T17:05:25.305806+0000","last_became_active":"2023-09-30T17:05:03.305222+0000","last_became_peered":"2023-09-30T17:05:03.305222+0000","last_unstale":"2023-09-30T17:05:25.305806+0000","last_undegraded":"2023-09-30T17:05:25.305806+0000","last_fullsized":"2023-09-30T17:05:25.305806+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:17:12.662422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"59'6","reported_seq":75,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306348+0000","last_change":"2023-09-30T17:02:18.364406+0000","last_active":"2023-09-30T17:05:25.306348+0000","last_peered":"2023-09-30T17:05:25.306348+0000","last_clean":"2023-09-30T17:05:25.306348+0000","last_became_active":"2023-09-30T17:02:18.363849+0000","last_became_peered":"2023-09-30T17:02:18.363849+0000","last_unstale":"2023-09-30T17:05:25.306348+0000","last_undegraded":"2023-09-30T17:05:25.306348+0000","last_fullsized":"2023-09-30T17:05:25.306348+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:43:29.608700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305302+0000","last_change":"2023-09-30T17:05:03.310062+0000","last_active":"2023-09-30T17:05:25.305302+0000","last_peered":"2023-09-30T17:05:25.305302+0000","last_clean":"2023-09-30T17:05:25.305302+0000","last_became_active":"2023-09-30T17:05:03.308958+0000","last_became_peered":"2023-09-30T17:05:03.308958+0000","last_unstale":"2023-09-30T17:05:25.305302+0000","last_undegraded":"2023-09-30T17:05:25.305302+0000","last_fullsized":"2023-09-30T17:05:25.305302+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:05:26.347633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":225,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.304940+0000","last_change":"2023-09-30T17:05:03.303046+0000","last_active":"2023-09-30T17:05:25.304940+0000","last_peered":"2023-09-30T17:05:25.304940+0000","last_clean":"2023-09-30T17:05:25.304940+0000","last_became_active":"2023-09-30T17:05:03.302265+0000","last_became_peered":"2023-09-30T17:05:03.302265+0000","last_unstale":"2023-09-30T17:05:25.304940+0000","last_undegraded":"2023-09-30T17:05:25.304940+0000","last_fullsized":"2023-09-30T17:05:25.304940+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:06.295501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:06.295501+0000","last_clean_scrub_stamp":"2023-09-30T17:02:06.295501+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:07:24.603358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":70,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305369+0000","last_change":"2023-09-30T17:02:17.357139+0000","last_active":"2023-09-30T17:05:25.305369+0000","last_peered":"2023-09-30T17:05:25.305369+0000","last_clean":"2023-09-30T17:05:25.305369+0000","last_became_active":"2023-09-30T17:02:17.356901+0000","last_became_peered":"2023-09-30T17:02:17.356901+0000","last_unstale":"2023-09-30T17:05:25.305369+0000","last_undegraded":"2023-09-30T17:05:25.305369+0000","last_fullsized":"2023-09-30T17:05:25.305369+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:22:35.747671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"59'7","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305738+0000","last_change":"2023-09-30T17:05:03.305199+0000","last_active":"2023-09-30T17:05:25.305738+0000","last_peered":"2023-09-30T17:05:25.305738+0000","last_clean":"2023-09-30T17:05:25.305738+0000","last_became_active":"2023-09-30T17:05:03.304974+0000","last_became_peered":"2023-09-30T17:05:03.304974+0000","last_unstale":"2023-09-30T17:05:25.305738+0000","last_undegraded":"2023-09-30T17:05:25.305738+0000","last_fullsized":"2023-09-30T17:05:25.305738+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:03:27.429545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305080+0000","last_change":"2023-09-30T17:05:03.303739+0000","last_active":"2023-09-30T17:05:25.305080+0000","last_peered":"2023-09-30T17:05:25.305080+0000","last_clean":"2023-09-30T17:05:25.305080+0000","last_became_active":"2023-09-30T17:05:03.302590+0000","last_became_peered":"2023-09-30T17:05:03.302590+0000","last_unstale":"2023-09-30T17:05:25.305080+0000","last_undegraded":"2023-09-30T17:05:25.305080+0000","last_fullsized":"2023-09-30T17:05:25.305080+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:51:30.199616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"59'5","reported_seq":94,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305237+0000","last_change":"2023-09-30T17:05:03.318439+0000","last_active":"2023-09-30T17:05:25.305237+0000","last_peered":"2023-09-30T17:05:25.305237+0000","last_clean":"2023-09-30T17:05:25.305237+0000","last_became_active":"2023-09-30T17:05:03.308059+0000","last_became_peered":"2023-09-30T17:05:03.308059+0000","last_unstale":"2023-09-30T17:05:25.305237+0000","last_undegraded":"2023-09-30T17:05:25.305237+0000","last_fullsized":"2023-09-30T17:05:25.305237+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:16:25.170638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"59'11252","reported_seq":11321,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306870+0000","last_change":"2023-09-30T17:02:18.360029+0000","last_active":"2023-09-30T17:05:25.306870+0000","last_peered":"2023-09-30T17:05:25.306870+0000","last_clean":"2023-09-30T17:05:25.306870+0000","last_became_active":"2023-09-30T17:02:18.356839+0000","last_became_peered":"2023-09-30T17:02:18.356839+0000","last_unstale":"2023-09-30T17:05:25.306870+0000","last_undegraded":"2023-09-30T17:05:25.306870+0000","last_fullsized":"2023-09-30T17:05:25.306870+0000","mapping_epoch":17,"log_start":"51'6700","ondisk_log_start":"51'6700","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4552,"log_dups_size":6700,"ondisk_log_size":4552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:16:27.516884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33068,"num_write_kb":157144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":73,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306724+0000","last_change":"2023-09-30T17:02:12.330472+0000","last_active":"2023-09-30T17:05:25.306724+0000","last_peered":"2023-09-30T17:05:25.306724+0000","last_clean":"2023-09-30T17:05:25.306724+0000","last_became_active":"2023-09-30T17:02:12.330154+0000","last_became_peered":"2023-09-30T17:02:12.330154+0000","last_unstale":"2023-09-30T17:05:25.306724+0000","last_undegraded":"2023-09-30T17:05:25.306724+0000","last_fullsized":"2023-09-30T17:05:25.306724+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:43:23.161734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":70,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305996+0000","last_change":"2023-09-30T17:02:17.361007+0000","last_active":"2023-09-30T17:05:25.305996+0000","last_peered":"2023-09-30T17:05:25.305996+0000","last_clean":"2023-09-30T17:05:25.305996+0000","last_became_active":"2023-09-30T17:02:17.360721+0000","last_became_peered":"2023-09-30T17:02:17.360721+0000","last_unstale":"2023-09-30T17:05:25.305996+0000","last_undegraded":"2023-09-30T17:05:25.305996+0000","last_fullsized":"2023-09-30T17:05:25.305996+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:13:41.205152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"59'2836","reported_seq":2925,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306557+0000","last_change":"2023-09-30T17:05:06.293085+0000","last_active":"2023-09-30T17:05:25.306557+0000","last_peered":"2023-09-30T17:05:25.306557+0000","last_clean":"2023-09-30T17:05:25.306557+0000","last_became_active":"2023-09-30T17:05:06.291203+0000","last_became_peered":"2023-09-30T17:05:06.291203+0000","last_unstale":"2023-09-30T17:05:25.306557+0000","last_undegraded":"2023-09-30T17:05:25.306557+0000","last_fullsized":"2023-09-30T17:05:25.306557+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2836,"log_dups_size":0,"ondisk_log_size":2836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:11:28.091818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8199,"num_write_kb":39048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"59'3","reported_seq":73,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306165+0000","last_change":"2023-09-30T17:02:17.360831+0000","last_active":"2023-09-30T17:05:25.306165+0000","last_peered":"2023-09-30T17:05:25.306165+0000","last_clean":"2023-09-30T17:05:25.306165+0000","last_became_active":"2023-09-30T17:02:17.360494+0000","last_became_peered":"2023-09-30T17:02:17.360494+0000","last_unstale":"2023-09-30T17:05:25.306165+0000","last_undegraded":"2023-09-30T17:05:25.306165+0000","last_fullsized":"2023-09-30T17:05:25.306165+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:24:04.564387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":73,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306251+0000","last_change":"2023-09-30T17:02:12.328184+0000","last_active":"2023-09-30T17:05:25.306251+0000","last_peered":"2023-09-30T17:05:25.306251+0000","last_clean":"2023-09-30T17:05:25.306251+0000","last_became_active":"2023-09-30T17:02:12.327898+0000","last_became_peered":"2023-09-30T17:02:12.327898+0000","last_unstale":"2023-09-30T17:05:25.306251+0000","last_undegraded":"2023-09-30T17:05:25.306251+0000","last_fullsized":"2023-09-30T17:05:25.306251+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:43:23.161734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"59'8","reported_seq":88,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305121+0000","last_change":"2023-09-30T17:05:03.308856+0000","last_active":"2023-09-30T17:05:25.305121+0000","last_peered":"2023-09-30T17:05:25.305121+0000","last_clean":"2023-09-30T17:05:25.305121+0000","last_became_active":"2023-09-30T17:05:03.308429+0000","last_became_peered":"2023-09-30T17:05:03.308429+0000","last_unstale":"2023-09-30T17:05:25.305121+0000","last_undegraded":"2023-09-30T17:05:25.305121+0000","last_fullsized":"2023-09-30T17:05:25.305121+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:49:32.189339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305749+0000","last_change":"2023-09-30T17:05:03.304353+0000","last_active":"2023-09-30T17:05:25.305749+0000","last_peered":"2023-09-30T17:05:25.305749+0000","last_clean":"2023-09-30T17:05:25.305749+0000","last_became_active":"2023-09-30T17:05:03.302503+0000","last_became_peered":"2023-09-30T17:05:03.302503+0000","last_unstale":"2023-09-30T17:05:25.305749+0000","last_undegraded":"2023-09-30T17:05:25.305749+0000","last_fullsized":"2023-09-30T17:05:25.305749+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:19:16.151598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"60'8","reported_seq":94,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306144+0000","last_change":"2023-09-30T17:05:03.314806+0000","last_active":"2023-09-30T17:05:25.306144+0000","last_peered":"2023-09-30T17:05:25.306144+0000","last_clean":"2023-09-30T17:05:25.306144+0000","last_became_active":"2023-09-30T17:05:03.308201+0000","last_became_peered":"2023-09-30T17:05:03.308201+0000","last_unstale":"2023-09-30T17:05:25.306144+0000","last_undegraded":"2023-09-30T17:05:25.306144+0000","last_fullsized":"2023-09-30T17:05:25.306144+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:19:18.486570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"59'6","reported_seq":86,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306035+0000","last_change":"2023-09-30T17:05:03.304265+0000","last_active":"2023-09-30T17:05:25.306035+0000","last_peered":"2023-09-30T17:05:25.306035+0000","last_clean":"2023-09-30T17:05:25.306035+0000","last_became_active":"2023-09-30T17:05:03.304022+0000","last_became_peered":"2023-09-30T17:05:03.304022+0000","last_unstale":"2023-09-30T17:05:25.306035+0000","last_undegraded":"2023-09-30T17:05:25.306035+0000","last_fullsized":"2023-09-30T17:05:25.306035+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:19:19.492200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":82,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306295+0000","last_change":"2023-09-30T17:05:03.303927+0000","last_active":"2023-09-30T17:05:25.306295+0000","last_peered":"2023-09-30T17:05:25.306295+0000","last_clean":"2023-09-30T17:05:25.306295+0000","last_became_active":"2023-09-30T17:05:03.303487+0000","last_became_peered":"2023-09-30T17:05:03.303487+0000","last_unstale":"2023-09-30T17:05:25.306295+0000","last_undegraded":"2023-09-30T17:05:25.306295+0000","last_fullsized":"2023-09-30T17:05:25.306295+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:43:27.633747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"59'2835","reported_seq":2904,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306514+0000","last_change":"2023-09-30T17:02:18.358269+0000","last_active":"2023-09-30T17:05:25.306514+0000","last_peered":"2023-09-30T17:05:25.306514+0000","last_clean":"2023-09-30T17:05:25.306514+0000","last_became_active":"2023-09-30T17:02:18.356902+0000","last_became_peered":"2023-09-30T17:02:18.356902+0000","last_unstale":"2023-09-30T17:05:25.306514+0000","last_undegraded":"2023-09-30T17:05:25.306514+0000","last_fullsized":"2023-09-30T17:05:25.306514+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2835,"log_dups_size":0,"ondisk_log_size":2835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:39:28.022201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8302,"num_write_kb":39500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":32,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305740+0000","last_change":"2023-09-30T17:05:03.311401+0000","last_active":"2023-09-30T17:05:25.305740+0000","last_peered":"2023-09-30T17:05:25.305740+0000","last_clean":"2023-09-30T17:05:25.305740+0000","last_became_active":"2023-09-30T17:05:03.310996+0000","last_became_peered":"2023-09-30T17:05:03.310996+0000","last_unstale":"2023-09-30T17:05:25.305740+0000","last_undegraded":"2023-09-30T17:05:25.305740+0000","last_fullsized":"2023-09-30T17:05:25.305740+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:28:19.097868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"59'2848","reported_seq":2915,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305483+0000","last_change":"2023-09-30T17:05:06.290662+0000","last_active":"2023-09-30T17:05:25.305483+0000","last_peered":"2023-09-30T17:05:25.305483+0000","last_clean":"2023-09-30T17:05:25.305483+0000","last_became_active":"2023-09-30T17:05:06.289599+0000","last_became_peered":"2023-09-30T17:05:06.289599+0000","last_unstale":"2023-09-30T17:05:25.305483+0000","last_undegraded":"2023-09-30T17:05:25.305483+0000","last_fullsized":"2023-09-30T17:05:25.305483+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2848,"log_dups_size":0,"ondisk_log_size":2848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:20:28.670256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8235,"num_write_kb":39276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"58'3","reported_seq":85,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306879+0000","last_change":"2023-09-30T17:05:03.307212+0000","last_active":"2023-09-30T17:05:25.306879+0000","last_peered":"2023-09-30T17:05:25.306879+0000","last_clean":"2023-09-30T17:05:25.306879+0000","last_became_active":"2023-09-30T17:05:03.306711+0000","last_became_peered":"2023-09-30T17:05:03.306711+0000","last_unstale":"2023-09-30T17:05:25.306879+0000","last_undegraded":"2023-09-30T17:05:25.306879+0000","last_fullsized":"2023-09-30T17:05:25.306879+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:11:56.900744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"59'10","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305401+0000","last_change":"2023-09-30T17:05:03.311669+0000","last_active":"2023-09-30T17:05:25.305401+0000","last_peered":"2023-09-30T17:05:25.305401+0000","last_clean":"2023-09-30T17:05:25.305401+0000","last_became_active":"2023-09-30T17:05:03.310763+0000","last_became_peered":"2023-09-30T17:05:03.310763+0000","last_unstale":"2023-09-30T17:05:25.305401+0000","last_undegraded":"2023-09-30T17:05:25.305401+0000","last_fullsized":"2023-09-30T17:05:25.305401+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:36:53.333402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":71,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306260+0000","last_change":"2023-09-30T17:02:17.360802+0000","last_active":"2023-09-30T17:05:25.306260+0000","last_peered":"2023-09-30T17:05:25.306260+0000","last_clean":"2023-09-30T17:05:25.306260+0000","last_became_active":"2023-09-30T17:02:17.360475+0000","last_became_peered":"2023-09-30T17:02:17.360475+0000","last_unstale":"2023-09-30T17:05:25.306260+0000","last_undegraded":"2023-09-30T17:05:25.306260+0000","last_fullsized":"2023-09-30T17:05:25.306260+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:50:18.455188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"59'5711","reported_seq":5780,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306268+0000","last_change":"2023-09-30T17:02:18.359857+0000","last_active":"2023-09-30T17:05:25.306268+0000","last_peered":"2023-09-30T17:05:25.306268+0000","last_clean":"2023-09-30T17:05:25.306268+0000","last_became_active":"2023-09-30T17:02:18.357098+0000","last_became_peered":"2023-09-30T17:02:18.357098+0000","last_unstale":"2023-09-30T17:05:25.306268+0000","last_undegraded":"2023-09-30T17:05:25.306268+0000","last_fullsized":"2023-09-30T17:05:25.306268+0000","mapping_epoch":17,"log_start":"42'1200","ondisk_log_start":"42'1200","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4511,"log_dups_size":1200,"ondisk_log_size":4511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:48:17.598726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16681,"num_write_kb":79476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":85,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306263+0000","last_change":"2023-09-30T17:05:03.313345+0000","last_active":"2023-09-30T17:05:25.306263+0000","last_peered":"2023-09-30T17:05:25.306263+0000","last_clean":"2023-09-30T17:05:25.306263+0000","last_became_active":"2023-09-30T17:05:03.313050+0000","last_became_peered":"2023-09-30T17:05:03.313050+0000","last_unstale":"2023-09-30T17:05:25.306263+0000","last_undegraded":"2023-09-30T17:05:25.306263+0000","last_fullsized":"2023-09-30T17:05:25.306263+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:24:52.247523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"59'2872","reported_seq":2939,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305196+0000","last_change":"2023-09-30T17:05:06.290298+0000","last_active":"2023-09-30T17:05:25.305196+0000","last_peered":"2023-09-30T17:05:25.305196+0000","last_clean":"2023-09-30T17:05:25.305196+0000","last_became_active":"2023-09-30T17:05:06.289197+0000","last_became_peered":"2023-09-30T17:05:06.289197+0000","last_unstale":"2023-09-30T17:05:25.305196+0000","last_undegraded":"2023-09-30T17:05:25.305196+0000","last_fullsized":"2023-09-30T17:05:25.305196+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2872,"log_dups_size":0,"ondisk_log_size":2872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:57:10.410506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8447,"num_write_kb":40072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"59'9","reported_seq":29,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305150+0000","last_change":"2023-09-30T17:05:03.310950+0000","last_active":"2023-09-30T17:05:25.305150+0000","last_peered":"2023-09-30T17:05:25.305150+0000","last_clean":"2023-09-30T17:05:25.305150+0000","last_became_active":"2023-09-30T17:05:03.310591+0000","last_became_peered":"2023-09-30T17:05:03.310591+0000","last_unstale":"2023-09-30T17:05:25.305150+0000","last_undegraded":"2023-09-30T17:05:25.305150+0000","last_fullsized":"2023-09-30T17:05:25.305150+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:26:23.194138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"59'13","reported_seq":82,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305292+0000","last_change":"2023-09-30T17:02:18.363479+0000","last_active":"2023-09-30T17:05:25.305292+0000","last_peered":"2023-09-30T17:05:25.305292+0000","last_clean":"2023-09-30T17:05:25.305292+0000","last_became_active":"2023-09-30T17:02:18.363222+0000","last_became_peered":"2023-09-30T17:02:18.363222+0000","last_unstale":"2023-09-30T17:05:25.305292+0000","last_undegraded":"2023-09-30T17:05:25.305292+0000","last_fullsized":"2023-09-30T17:05:25.305292+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:09:55.056098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"59'2796","reported_seq":2885,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306184+0000","last_change":"2023-09-30T17:05:06.292455+0000","last_active":"2023-09-30T17:05:25.306184+0000","last_peered":"2023-09-30T17:05:25.306184+0000","last_clean":"2023-09-30T17:05:25.306184+0000","last_became_active":"2023-09-30T17:05:06.290929+0000","last_became_peered":"2023-09-30T17:05:06.290929+0000","last_unstale":"2023-09-30T17:05:25.306184+0000","last_undegraded":"2023-09-30T17:05:25.306184+0000","last_fullsized":"2023-09-30T17:05:25.306184+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2796,"log_dups_size":0,"ondisk_log_size":2796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:54:14.579761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8138,"num_write_kb":38784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"59'2852","reported_seq":2921,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.305723+0000","last_change":"2023-09-30T17:02:18.363216+0000","last_active":"2023-09-30T17:05:25.305723+0000","last_peered":"2023-09-30T17:05:25.305723+0000","last_clean":"2023-09-30T17:05:25.305723+0000","last_became_active":"2023-09-30T17:02:18.362894+0000","last_became_peered":"2023-09-30T17:02:18.362894+0000","last_unstale":"2023-09-30T17:05:25.305723+0000","last_undegraded":"2023-09-30T17:05:25.305723+0000","last_fullsized":"2023-09-30T17:05:25.305723+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2852,"log_dups_size":0,"ondisk_log_size":2852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:30:43.782165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8357,"num_write_kb":39780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"59'2874","reported_seq":2963,"reported_epoch":75,"state":"active+clean","last_fresh":"2023-09-30T17:05:25.306543+0000","last_change":"2023-09-30T17:05:06.294279+0000","last_active":"2023-09-30T17:05:25.306543+0000","last_peered":"2023-09-30T17:05:25.306543+0000","last_clean":"2023-09-30T17:05:25.306543+0000","last_became_active":"2023-09-30T17:05:06.292898+0000","last_became_peered":"2023-09-30T17:05:06.292898+0000","last_unstale":"2023-09-30T17:05:25.306543+0000","last_undegraded":"2023-09-30T17:05:25.306543+0000","last_fullsized":"2023-09-30T17:05:25.306543+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2874,"log_dups_size":0,"ondisk_log_size":2874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:02:14.484209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8465,"num_write_kb":40104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":532685,"num_write_kb":2575302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140940,"ondisk_log_size":140940,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":228927,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":137,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":223425,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":524288,"data_stored":457854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},"log_size":132,"ondisk_log_size":132,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":66,"seq":283467841545,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47044,"kb_used_data":1460,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94324796,"statfs":{"total":96636764160,"available":96588591104,"internally_reserved":0,"allocated":1495040,"data_stored":1123985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7139,"internal_metadata":46654493},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.434}]}]},{"osd":0,"up_from":8,"seq":34359738414,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":582456,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":580990,"kb_avail":93789384,"statfs":{"total":96636764160,"available":96040329216,"internally_reserved":0,"allocated":1482752,"data_stored":1122763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":594934214},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 17:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.51800000000000002,"15min":0.48999999999999999},"min":{"1min":0.215,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":5.9480000000000004,"5min":5.9480000000000004,"15min":5.9480000000000004},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.503,"15min":0.46300000000000002},"min":{"1min":0.216,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":3.6819999999999999,"5min":3.6819999999999999,"15min":3.6819999999999999},"last":0.42899999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.505}]}]},{"osd":1,"up_from":8,"seq":34359738414,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":563596,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":562942,"kb_avail":93808244,"statfs":{"total":96636764160,"available":96059641856,"internally_reserved":0,"allocated":651264,"data_stored":305912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":576453062},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 17:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.48599999999999999,"15min":0.45600000000000002},"min":{"1min":0.19800000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":3.3420000000000001,"5min":3.3420000000000001,"15min":3.3420000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.51200000000000001,"15min":0.46000000000000002},"min":{"1min":0.189,"5min":0.188,"15min":0.188},"max":{"1min":3.5470000000000002,"5min":3.5470000000000002,"15min":3.5470000000000002},"last":0.54500000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45400000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":249856,"data_stored":227705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":228927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T17:05:38.497 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.497 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.498 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.498 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.498 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.498 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.498 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.498 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.498 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.499 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.499 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.499 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.499 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.499 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.499 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.499 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.499 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.499 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.500 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.500 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.500 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.500 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.500 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.500 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.500 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.500 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.501 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.501 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.501 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.501 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.501 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.501 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.501 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.501 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.502 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.502 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.502 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.624 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.624 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.624 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.624 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.624 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.624 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.625 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.625 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.625 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.625 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.625 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.625 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.625 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.625 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.626 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.626 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.626 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.626 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.626 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.626 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.626 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.627 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.627 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.627 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.627 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.627 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.627 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.627 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.627 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-30T17:02:11.318349+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=11, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.628 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.628 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.628 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-09-30T17:02:11.318349+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=11, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.628 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.628 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.628 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-30T17:02:11.318349+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=11, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.628 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.628 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.629 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-09-30T17:02:11.318349+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=11, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.629 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-09-30T17:02:06.295501+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=6, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.629 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.629 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.629 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2023-09-30T17:02:11.318349+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=11, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.629 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.629 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.629 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-30T17:02:11.318349+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=11, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.630 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.630 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.630 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.630 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-30T17:02:11.318349+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=11, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.630 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.630 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-30T17:02:11.318349+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=11, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.630 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.630 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.631 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.631 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.631 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.631 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.631 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.631 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.631 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.631 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.632 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.632 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.632 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.632 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.632 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.632 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.632 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:38.632 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-30T17:05:58.634 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T17:05:59.123 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:05:59.230 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-09-30T17:05:59.230 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":190,"stamp":"2023-09-30T17:05:57.346819+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":819295,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":140,"num_read_kb":122,"num_write":533025,"num_write_kb":2579054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":223425,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141233,"ondisk_log_size":141233,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1193072,"kb_used_data":3544,"kb_used_omap":10,"kb_used_meta":1189493,"kb_avail":281922448,"statfs":{"total":289910292480,"available":288688586752,"internally_reserved":0,"allocated":3629056,"data_stored":2552660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10327,"internal_metadata":1218041769},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002841"},"pg_stats":[{"pgid":"4.3f","version":"59'2790","reported_seq":2868,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:47.554609+0000","last_change":"2023-09-30T17:05:47.554662+0000","last_active":"2023-09-30T17:05:47.554609+0000","last_peered":"2023-09-30T17:05:47.554609+0000","last_clean":"2023-09-30T17:05:47.554609+0000","last_became_active":"2023-09-30T17:02:18.358716+0000","last_became_peered":"2023-09-30T17:02:18.358716+0000","last_unstale":"2023-09-30T17:05:47.554609+0000","last_undegraded":"2023-09-30T17:05:47.554609+0000","last_fullsized":"2023-09-30T17:05:47.554609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2790","last_scrub_stamp":"2023-09-30T17:05:47.554500+0000","last_deep_scrub":"59'2790","last_deep_scrub_stamp":"2023-09-30T17:05:47.554500+0000","last_clean_scrub_stamp":"2023-09-30T17:05:47.554500+0000","objects_scrubbed":0,"log_size":2790,"log_dups_size":0,"ondisk_log_size":2790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:40:37.069833+0000","scrub_duration":0.0021350679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8214,"num_write_kb":38924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"59'4","reported_seq":82,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:39.661816+0000","last_change":"2023-09-30T17:05:39.661898+0000","last_active":"2023-09-30T17:05:39.661816+0000","last_peered":"2023-09-30T17:05:39.661816+0000","last_clean":"2023-09-30T17:05:39.661816+0000","last_became_active":"2023-09-30T17:02:18.360372+0000","last_became_peered":"2023-09-30T17:02:18.360372+0000","last_unstale":"2023-09-30T17:05:39.661816+0000","last_undegraded":"2023-09-30T17:05:39.661816+0000","last_fullsized":"2023-09-30T17:05:39.661816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'4","last_scrub_stamp":"2023-09-30T17:05:39.661696+0000","last_deep_scrub":"59'4","last_deep_scrub_stamp":"2023-09-30T17:05:39.661696+0000","last_clean_scrub_stamp":"2023-09-30T17:05:39.661696+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:53:12.475703+0000","scrub_duration":0.0028517759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"59'5697","reported_seq":5772,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310130+0000","last_change":"2023-09-30T17:05:06.291597+0000","last_active":"2023-09-30T17:05:26.310130+0000","last_peered":"2023-09-30T17:05:26.310130+0000","last_clean":"2023-09-30T17:05:26.310130+0000","last_became_active":"2023-09-30T17:05:06.290447+0000","last_became_peered":"2023-09-30T17:05:06.290447+0000","last_unstale":"2023-09-30T17:05:26.310130+0000","last_undegraded":"2023-09-30T17:05:26.310130+0000","last_fullsized":"2023-09-30T17:05:26.310130+0000","mapping_epoch":69,"log_start":"42'1200","ondisk_log_start":"42'1200","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4497,"log_dups_size":1200,"ondisk_log_size":4497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16590,"num_write_kb":78960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"59'10","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309543+0000","last_change":"2023-09-30T17:05:03.309996+0000","last_active":"2023-09-30T17:05:26.309543+0000","last_peered":"2023-09-30T17:05:26.309543+0000","last_clean":"2023-09-30T17:05:26.309543+0000","last_became_active":"2023-09-30T17:05:03.309326+0000","last_became_peered":"2023-09-30T17:05:03.309326+0000","last_unstale":"2023-09-30T17:05:26.309543+0000","last_undegraded":"2023-09-30T17:05:26.309543+0000","last_fullsized":"2023-09-30T17:05:26.309543+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"59'2934","reported_seq":3012,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:50.604137+0000","last_change":"2023-09-30T17:05:50.604194+0000","last_active":"2023-09-30T17:05:50.604137+0000","last_peered":"2023-09-30T17:05:50.604137+0000","last_clean":"2023-09-30T17:05:50.604137+0000","last_became_active":"2023-09-30T17:02:18.357317+0000","last_became_peered":"2023-09-30T17:02:18.357317+0000","last_unstale":"2023-09-30T17:05:50.604137+0000","last_undegraded":"2023-09-30T17:05:50.604137+0000","last_fullsized":"2023-09-30T17:05:50.604137+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2934","last_scrub_stamp":"2023-09-30T17:05:50.604022+0000","last_deep_scrub":"59'2934","last_deep_scrub_stamp":"2023-09-30T17:05:50.604022+0000","last_clean_scrub_stamp":"2023-09-30T17:05:50.604022+0000","objects_scrubbed":0,"log_size":2934,"log_dups_size":0,"ondisk_log_size":2934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:13:55.986563+0000","scrub_duration":0.00343991,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8466,"num_write_kb":40084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"59'6","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310070+0000","last_change":"2023-09-30T17:05:03.311318+0000","last_active":"2023-09-30T17:05:26.310070+0000","last_peered":"2023-09-30T17:05:26.310070+0000","last_clean":"2023-09-30T17:05:26.310070+0000","last_became_active":"2023-09-30T17:05:03.310703+0000","last_became_peered":"2023-09-30T17:05:03.310703+0000","last_unstale":"2023-09-30T17:05:26.310070+0000","last_undegraded":"2023-09-30T17:05:26.310070+0000","last_fullsized":"2023-09-30T17:05:26.310070+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"59'7","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309692+0000","last_change":"2023-09-30T17:05:03.310838+0000","last_active":"2023-09-30T17:05:26.309692+0000","last_peered":"2023-09-30T17:05:26.309692+0000","last_clean":"2023-09-30T17:05:26.309692+0000","last_became_active":"2023-09-30T17:05:03.310047+0000","last_became_peered":"2023-09-30T17:05:03.310047+0000","last_unstale":"2023-09-30T17:05:26.309692+0000","last_undegraded":"2023-09-30T17:05:26.309692+0000","last_fullsized":"2023-09-30T17:05:26.309692+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"59'11423","reported_seq":11500,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309146+0000","last_change":"2023-09-30T17:05:06.286653+0000","last_active":"2023-09-30T17:05:26.309146+0000","last_peered":"2023-09-30T17:05:26.309146+0000","last_clean":"2023-09-30T17:05:26.309146+0000","last_became_active":"2023-09-30T17:05:06.285582+0000","last_became_peered":"2023-09-30T17:05:06.285582+0000","last_unstale":"2023-09-30T17:05:26.309146+0000","last_undegraded":"2023-09-30T17:05:26.309146+0000","last_fullsized":"2023-09-30T17:05:26.309146+0000","mapping_epoch":69,"log_start":"52'7200","ondisk_log_start":"52'7200","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4223,"log_dups_size":5777,"ondisk_log_size":4223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33444,"num_write_kb":158924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"59'8589","reported_seq":8659,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310331+0000","last_change":"2023-09-30T17:02:18.364222+0000","last_active":"2023-09-30T17:05:26.310331+0000","last_peered":"2023-09-30T17:05:26.310331+0000","last_clean":"2023-09-30T17:05:26.310331+0000","last_became_active":"2023-09-30T17:02:18.363485+0000","last_became_peered":"2023-09-30T17:02:18.363485+0000","last_unstale":"2023-09-30T17:05:26.310331+0000","last_undegraded":"2023-09-30T17:05:26.310331+0000","last_fullsized":"2023-09-30T17:05:26.310331+0000","mapping_epoch":17,"log_start":"49'4400","ondisk_log_start":"49'4400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4189,"log_dups_size":4400,"ondisk_log_size":4189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25052,"num_write_kb":118756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"59'8585","reported_seq":8655,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310512+0000","last_change":"2023-09-30T17:02:18.360010+0000","last_active":"2023-09-30T17:05:26.310512+0000","last_peered":"2023-09-30T17:05:26.310512+0000","last_clean":"2023-09-30T17:05:26.310512+0000","last_became_active":"2023-09-30T17:02:18.358396+0000","last_became_peered":"2023-09-30T17:02:18.358396+0000","last_unstale":"2023-09-30T17:05:26.310512+0000","last_undegraded":"2023-09-30T17:05:26.310512+0000","last_fullsized":"2023-09-30T17:05:26.310512+0000","mapping_epoch":17,"log_start":"48'4100","ondisk_log_start":"48'4100","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4485,"log_dups_size":4100,"ondisk_log_size":4485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24997,"num_write_kb":162463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"59'5664","reported_seq":5749,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:46.618589+0000","last_change":"2023-09-30T17:05:46.618636+0000","last_active":"2023-09-30T17:05:46.618589+0000","last_peered":"2023-09-30T17:05:46.618589+0000","last_clean":"2023-09-30T17:05:46.618589+0000","last_became_active":"2023-09-30T17:05:06.290193+0000","last_became_peered":"2023-09-30T17:05:06.290193+0000","last_unstale":"2023-09-30T17:05:46.618589+0000","last_undegraded":"2023-09-30T17:05:46.618589+0000","last_fullsized":"2023-09-30T17:05:46.618589+0000","mapping_epoch":69,"log_start":"43'1400","ondisk_log_start":"43'1400","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'5664","last_scrub_stamp":"2023-09-30T17:05:46.618493+0000","last_deep_scrub":"59'5664","last_deep_scrub_stamp":"2023-09-30T17:05:46.618493+0000","last_clean_scrub_stamp":"2023-09-30T17:05:46.618493+0000","objects_scrubbed":0,"log_size":4264,"log_dups_size":1400,"ondisk_log_size":4264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:50:52.323251+0000","scrub_duration":0.0029415959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16442,"num_write_kb":78308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"59'2931","reported_seq":3021,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309813+0000","last_change":"2023-09-30T17:05:06.290270+0000","last_active":"2023-09-30T17:05:26.309813+0000","last_peered":"2023-09-30T17:05:26.309813+0000","last_clean":"2023-09-30T17:05:26.309813+0000","last_became_active":"2023-09-30T17:05:06.288753+0000","last_became_peered":"2023-09-30T17:05:06.288753+0000","last_unstale":"2023-09-30T17:05:26.309813+0000","last_undegraded":"2023-09-30T17:05:26.309813+0000","last_fullsized":"2023-09-30T17:05:26.309813+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2931,"log_dups_size":0,"ondisk_log_size":2931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8488,"num_write_kb":40364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"59'2860","reported_seq":2930,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309814+0000","last_change":"2023-09-30T17:02:18.359894+0000","last_active":"2023-09-30T17:05:26.309814+0000","last_peered":"2023-09-30T17:05:26.309814+0000","last_clean":"2023-09-30T17:05:26.309814+0000","last_became_active":"2023-09-30T17:02:18.358534+0000","last_became_peered":"2023-09-30T17:02:18.358534+0000","last_unstale":"2023-09-30T17:05:26.309814+0000","last_undegraded":"2023-09-30T17:05:26.309814+0000","last_fullsized":"2023-09-30T17:05:26.309814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2860,"log_dups_size":0,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8367,"num_write_kb":39772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"59'2911","reported_seq":2987,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:42.691805+0000","last_change":"2023-09-30T17:05:42.691905+0000","last_active":"2023-09-30T17:05:42.691805+0000","last_peered":"2023-09-30T17:05:42.691805+0000","last_clean":"2023-09-30T17:05:42.691805+0000","last_became_active":"2023-09-30T17:05:06.288360+0000","last_became_peered":"2023-09-30T17:05:06.288360+0000","last_unstale":"2023-09-30T17:05:42.691805+0000","last_undegraded":"2023-09-30T17:05:42.691805+0000","last_fullsized":"2023-09-30T17:05:42.691805+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2911","last_scrub_stamp":"2023-09-30T17:05:42.691679+0000","last_deep_scrub":"59'2911","last_deep_scrub_stamp":"2023-09-30T17:05:42.691679+0000","last_clean_scrub_stamp":"2023-09-30T17:05:42.691679+0000","objects_scrubbed":0,"log_size":2911,"log_dups_size":0,"ondisk_log_size":2911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:58:28.142176+0000","scrub_duration":0.0030980600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8419,"num_write_kb":39940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"59'2889","reported_seq":2965,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:47.659737+0000","last_change":"2023-09-30T17:05:47.659805+0000","last_active":"2023-09-30T17:05:47.659737+0000","last_peered":"2023-09-30T17:05:47.659737+0000","last_clean":"2023-09-30T17:05:47.659737+0000","last_became_active":"2023-09-30T17:05:06.285738+0000","last_became_peered":"2023-09-30T17:05:06.285738+0000","last_unstale":"2023-09-30T17:05:47.659737+0000","last_undegraded":"2023-09-30T17:05:47.659737+0000","last_fullsized":"2023-09-30T17:05:47.659737+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2889","last_scrub_stamp":"2023-09-30T17:05:47.659610+0000","last_deep_scrub":"59'2889","last_deep_scrub_stamp":"2023-09-30T17:05:47.659610+0000","last_clean_scrub_stamp":"2023-09-30T17:05:47.659610+0000","objects_scrubbed":0,"log_size":2889,"log_dups_size":0,"ondisk_log_size":2889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:55:36.031386+0000","scrub_duration":0.0023223979999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8435,"num_write_kb":39984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"59'2839","reported_seq":2907,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309323+0000","last_change":"2023-09-30T17:05:06.291173+0000","last_active":"2023-09-30T17:05:26.309323+0000","last_peered":"2023-09-30T17:05:26.309323+0000","last_clean":"2023-09-30T17:05:26.309323+0000","last_became_active":"2023-09-30T17:05:06.289872+0000","last_became_peered":"2023-09-30T17:05:06.289872+0000","last_unstale":"2023-09-30T17:05:26.309323+0000","last_undegraded":"2023-09-30T17:05:26.309323+0000","last_fullsized":"2023-09-30T17:05:26.309323+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2839,"log_dups_size":0,"ondisk_log_size":2839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8166,"num_write_kb":38928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"59'2802","reported_seq":2872,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310426+0000","last_change":"2023-09-30T17:02:18.364360+0000","last_active":"2023-09-30T17:05:26.310426+0000","last_peered":"2023-09-30T17:05:26.310426+0000","last_clean":"2023-09-30T17:05:26.310426+0000","last_became_active":"2023-09-30T17:02:18.363697+0000","last_became_peered":"2023-09-30T17:02:18.363697+0000","last_unstale":"2023-09-30T17:05:26.310426+0000","last_undegraded":"2023-09-30T17:05:26.310426+0000","last_fullsized":"2023-09-30T17:05:26.310426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2802,"log_dups_size":0,"ondisk_log_size":2802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8256,"num_write_kb":39208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"59'2860","reported_seq":2930,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310594+0000","last_change":"2023-09-30T17:02:18.360320+0000","last_active":"2023-09-30T17:05:26.310594+0000","last_peered":"2023-09-30T17:05:26.310594+0000","last_clean":"2023-09-30T17:05:26.310594+0000","last_became_active":"2023-09-30T17:02:18.357184+0000","last_became_peered":"2023-09-30T17:02:18.357184+0000","last_unstale":"2023-09-30T17:05:26.310594+0000","last_undegraded":"2023-09-30T17:05:26.310594+0000","last_fullsized":"2023-09-30T17:05:26.310594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2860,"log_dups_size":0,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8368,"num_write_kb":39616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"59'5686","reported_seq":5756,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310073+0000","last_change":"2023-09-30T17:02:18.363956+0000","last_active":"2023-09-30T17:05:26.310073+0000","last_peered":"2023-09-30T17:05:26.310073+0000","last_clean":"2023-09-30T17:05:26.310073+0000","last_became_active":"2023-09-30T17:02:18.363654+0000","last_became_peered":"2023-09-30T17:02:18.363654+0000","last_unstale":"2023-09-30T17:05:26.310073+0000","last_undegraded":"2023-09-30T17:05:26.310073+0000","last_fullsized":"2023-09-30T17:05:26.310073+0000","mapping_epoch":17,"log_start":"44'1500","ondisk_log_start":"44'1500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4186,"log_dups_size":1500,"ondisk_log_size":4186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16649,"num_write_kb":78956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"59'5799","reported_seq":5877,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309847+0000","last_change":"2023-09-30T17:05:06.290994+0000","last_active":"2023-09-30T17:05:26.309847+0000","last_peered":"2023-09-30T17:05:26.309847+0000","last_clean":"2023-09-30T17:05:26.309847+0000","last_became_active":"2023-09-30T17:05:06.289817+0000","last_became_peered":"2023-09-30T17:05:06.289817+0000","last_unstale":"2023-09-30T17:05:26.309847+0000","last_undegraded":"2023-09-30T17:05:26.309847+0000","last_fullsized":"2023-09-30T17:05:26.309847+0000","mapping_epoch":69,"log_start":"44'1600","ondisk_log_start":"44'1600","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4199,"log_dups_size":1600,"ondisk_log_size":4199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16903,"num_write_kb":80184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"59'12","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309741+0000","last_change":"2023-09-30T17:05:03.310298+0000","last_active":"2023-09-30T17:05:26.309741+0000","last_peered":"2023-09-30T17:05:26.309741+0000","last_clean":"2023-09-30T17:05:26.309741+0000","last_became_active":"2023-09-30T17:05:03.309537+0000","last_became_peered":"2023-09-30T17:05:03.309537+0000","last_unstale":"2023-09-30T17:05:26.309741+0000","last_undegraded":"2023-09-30T17:05:26.309741+0000","last_fullsized":"2023-09-30T17:05:26.309741+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"59'2879","reported_seq":2969,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309711+0000","last_change":"2023-09-30T17:05:06.292705+0000","last_active":"2023-09-30T17:05:26.309711+0000","last_peered":"2023-09-30T17:05:26.309711+0000","last_clean":"2023-09-30T17:05:26.309711+0000","last_became_active":"2023-09-30T17:05:06.290797+0000","last_became_peered":"2023-09-30T17:05:06.290797+0000","last_unstale":"2023-09-30T17:05:26.309711+0000","last_undegraded":"2023-09-30T17:05:26.309711+0000","last_fullsized":"2023-09-30T17:05:26.309711+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2879,"log_dups_size":0,"ondisk_log_size":2879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8343,"num_write_kb":39768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"59'2809","reported_seq":2899,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309858+0000","last_change":"2023-09-30T17:05:06.290594+0000","last_active":"2023-09-30T17:05:26.309858+0000","last_peered":"2023-09-30T17:05:26.309858+0000","last_clean":"2023-09-30T17:05:26.309858+0000","last_became_active":"2023-09-30T17:05:06.288837+0000","last_became_peered":"2023-09-30T17:05:06.288837+0000","last_unstale":"2023-09-30T17:05:26.309858+0000","last_undegraded":"2023-09-30T17:05:26.309858+0000","last_fullsized":"2023-09-30T17:05:26.309858+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2809,"log_dups_size":0,"ondisk_log_size":2809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8281,"num_write_kb":39472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"59'5585","reported_seq":5655,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309631+0000","last_change":"2023-09-30T17:02:18.353938+0000","last_active":"2023-09-30T17:05:26.309631+0000","last_peered":"2023-09-30T17:05:26.309631+0000","last_clean":"2023-09-30T17:05:26.309631+0000","last_became_active":"2023-09-30T17:02:18.353632+0000","last_became_peered":"2023-09-30T17:02:18.353632+0000","last_unstale":"2023-09-30T17:05:26.309631+0000","last_undegraded":"2023-09-30T17:05:26.309631+0000","last_fullsized":"2023-09-30T17:05:26.309631+0000","mapping_epoch":17,"log_start":"42'1100","ondisk_log_start":"42'1100","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4485,"log_dups_size":1100,"ondisk_log_size":4485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16523,"num_write_kb":78256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"59'2888","reported_seq":2978,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310634+0000","last_change":"2023-09-30T17:05:06.292945+0000","last_active":"2023-09-30T17:05:26.310634+0000","last_peered":"2023-09-30T17:05:26.310634+0000","last_clean":"2023-09-30T17:05:26.310634+0000","last_became_active":"2023-09-30T17:05:06.291346+0000","last_became_peered":"2023-09-30T17:05:06.291346+0000","last_unstale":"2023-09-30T17:05:26.310634+0000","last_undegraded":"2023-09-30T17:05:26.310634+0000","last_fullsized":"2023-09-30T17:05:26.310634+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2888,"log_dups_size":0,"ondisk_log_size":2888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8371,"num_write_kb":39716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"59'18","reported_seq":107,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:41.585552+0000","last_change":"2023-09-30T17:05:41.585602+0000","last_active":"2023-09-30T17:05:41.585552+0000","last_peered":"2023-09-30T17:05:41.585552+0000","last_clean":"2023-09-30T17:05:41.585552+0000","last_became_active":"2023-09-30T17:05:03.308884+0000","last_became_peered":"2023-09-30T17:05:03.308884+0000","last_unstale":"2023-09-30T17:05:41.585552+0000","last_undegraded":"2023-09-30T17:05:41.585552+0000","last_fullsized":"2023-09-30T17:05:41.585552+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'18","last_scrub_stamp":"2023-09-30T17:05:41.585439+0000","last_deep_scrub":"59'18","last_deep_scrub_stamp":"2023-09-30T17:05:41.585439+0000","last_clean_scrub_stamp":"2023-09-30T17:05:41.585439+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:29:52.984290+0000","scrub_duration":0.0024239769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"59'2855","reported_seq":2924,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309973+0000","last_change":"2023-09-30T17:05:06.291369+0000","last_active":"2023-09-30T17:05:26.309973+0000","last_peered":"2023-09-30T17:05:26.309973+0000","last_clean":"2023-09-30T17:05:26.309973+0000","last_became_active":"2023-09-30T17:05:06.289447+0000","last_became_peered":"2023-09-30T17:05:06.289447+0000","last_unstale":"2023-09-30T17:05:26.309973+0000","last_undegraded":"2023-09-30T17:05:26.309973+0000","last_fullsized":"2023-09-30T17:05:26.309973+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2855,"log_dups_size":0,"ondisk_log_size":2855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8347,"num_write_kb":39608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":72,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309645+0000","last_change":"2023-09-30T17:02:17.358258+0000","last_active":"2023-09-30T17:05:26.309645+0000","last_peered":"2023-09-30T17:05:26.309645+0000","last_clean":"2023-09-30T17:05:26.309645+0000","last_became_active":"2023-09-30T17:02:17.357890+0000","last_became_peered":"2023-09-30T17:02:17.357890+0000","last_unstale":"2023-09-30T17:05:26.309645+0000","last_undegraded":"2023-09-30T17:05:26.309645+0000","last_fullsized":"2023-09-30T17:05:26.309645+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"59'17","reported_seq":106,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:45.592687+0000","last_change":"2023-09-30T17:05:45.592781+0000","last_active":"2023-09-30T17:05:45.592687+0000","last_peered":"2023-09-30T17:05:45.592687+0000","last_clean":"2023-09-30T17:05:45.592687+0000","last_became_active":"2023-09-30T17:05:03.307012+0000","last_became_peered":"2023-09-30T17:05:03.307012+0000","last_unstale":"2023-09-30T17:05:45.592687+0000","last_undegraded":"2023-09-30T17:05:45.592687+0000","last_fullsized":"2023-09-30T17:05:45.592687+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'17","last_scrub_stamp":"2023-09-30T17:05:45.592562+0000","last_deep_scrub":"59'17","last_deep_scrub_stamp":"2023-09-30T17:05:45.592562+0000","last_clean_scrub_stamp":"2023-09-30T17:05:45.592562+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:53:58.476399+0000","scrub_duration":0.0024751999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":82,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309698+0000","last_change":"2023-09-30T17:05:03.309164+0000","last_active":"2023-09-30T17:05:26.309698+0000","last_peered":"2023-09-30T17:05:26.309698+0000","last_clean":"2023-09-30T17:05:26.309698+0000","last_became_active":"2023-09-30T17:05:03.308073+0000","last_became_peered":"2023-09-30T17:05:03.308073+0000","last_unstale":"2023-09-30T17:05:26.309698+0000","last_undegraded":"2023-09-30T17:05:26.309698+0000","last_fullsized":"2023-09-30T17:05:26.309698+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"59'6","reported_seq":87,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310318+0000","last_change":"2023-09-30T17:05:03.308692+0000","last_active":"2023-09-30T17:05:26.310318+0000","last_peered":"2023-09-30T17:05:26.310318+0000","last_clean":"2023-09-30T17:05:26.310318+0000","last_became_active":"2023-09-30T17:05:03.307932+0000","last_became_peered":"2023-09-30T17:05:03.307932+0000","last_unstale":"2023-09-30T17:05:26.310318+0000","last_undegraded":"2023-09-30T17:05:26.310318+0000","last_fullsized":"2023-09-30T17:05:26.310318+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":71,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309540+0000","last_change":"2023-09-30T17:02:17.361000+0000","last_active":"2023-09-30T17:05:26.309540+0000","last_peered":"2023-09-30T17:05:26.309540+0000","last_clean":"2023-09-30T17:05:26.309540+0000","last_became_active":"2023-09-30T17:02:17.360601+0000","last_became_peered":"2023-09-30T17:02:17.360601+0000","last_unstale":"2023-09-30T17:05:26.309540+0000","last_undegraded":"2023-09-30T17:05:26.309540+0000","last_fullsized":"2023-09-30T17:05:26.309540+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"59'7","reported_seq":88,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310655+0000","last_change":"2023-09-30T17:05:03.305898+0000","last_active":"2023-09-30T17:05:26.310655+0000","last_peered":"2023-09-30T17:05:26.310655+0000","last_clean":"2023-09-30T17:05:26.310655+0000","last_became_active":"2023-09-30T17:05:03.305520+0000","last_became_peered":"2023-09-30T17:05:03.305520+0000","last_unstale":"2023-09-30T17:05:26.310655+0000","last_undegraded":"2023-09-30T17:05:26.310655+0000","last_fullsized":"2023-09-30T17:05:26.310655+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"58'1","reported_seq":83,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310551+0000","last_change":"2023-09-30T17:05:03.309303+0000","last_active":"2023-09-30T17:05:26.310551+0000","last_peered":"2023-09-30T17:05:26.310551+0000","last_clean":"2023-09-30T17:05:26.310551+0000","last_became_active":"2023-09-30T17:05:03.308851+0000","last_became_peered":"2023-09-30T17:05:03.308851+0000","last_unstale":"2023-09-30T17:05:26.310551+0000","last_undegraded":"2023-09-30T17:05:26.310551+0000","last_fullsized":"2023-09-30T17:05:26.310551+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"59'9","reported_seq":87,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:42.629955+0000","last_change":"2023-09-30T17:05:42.630040+0000","last_active":"2023-09-30T17:05:42.629955+0000","last_peered":"2023-09-30T17:05:42.629955+0000","last_clean":"2023-09-30T17:05:42.629955+0000","last_became_active":"2023-09-30T17:02:18.358529+0000","last_became_peered":"2023-09-30T17:02:18.358529+0000","last_unstale":"2023-09-30T17:05:42.629955+0000","last_undegraded":"2023-09-30T17:05:42.629955+0000","last_fullsized":"2023-09-30T17:05:42.629955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'9","last_scrub_stamp":"2023-09-30T17:05:42.629801+0000","last_deep_scrub":"59'9","last_deep_scrub_stamp":"2023-09-30T17:05:42.629801+0000","last_clean_scrub_stamp":"2023-09-30T17:05:42.629801+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:08:35.419515+0000","scrub_duration":0.0034623800000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309773+0000","last_change":"2023-09-30T17:05:03.309409+0000","last_active":"2023-09-30T17:05:26.309773+0000","last_peered":"2023-09-30T17:05:26.309773+0000","last_clean":"2023-09-30T17:05:26.309773+0000","last_became_active":"2023-09-30T17:05:03.309023+0000","last_became_peered":"2023-09-30T17:05:03.309023+0000","last_unstale":"2023-09-30T17:05:26.309773+0000","last_undegraded":"2023-09-30T17:05:26.309773+0000","last_fullsized":"2023-09-30T17:05:26.309773+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"59'8526","reported_seq":8619,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309811+0000","last_change":"2023-09-30T17:05:06.292415+0000","last_active":"2023-09-30T17:05:26.309811+0000","last_peered":"2023-09-30T17:05:26.309811+0000","last_clean":"2023-09-30T17:05:26.309811+0000","last_became_active":"2023-09-30T17:05:06.290551+0000","last_became_peered":"2023-09-30T17:05:06.290551+0000","last_unstale":"2023-09-30T17:05:26.309811+0000","last_undegraded":"2023-09-30T17:05:26.309811+0000","last_fullsized":"2023-09-30T17:05:26.309811+0000","mapping_epoch":69,"log_start":"49'4300","ondisk_log_start":"49'4300","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4226,"log_dups_size":4300,"ondisk_log_size":4226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24873,"num_write_kb":118472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"59'7","reported_seq":94,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310205+0000","last_change":"2023-09-30T17:05:03.310987+0000","last_active":"2023-09-30T17:05:26.310205+0000","last_peered":"2023-09-30T17:05:26.310205+0000","last_clean":"2023-09-30T17:05:26.310205+0000","last_became_active":"2023-09-30T17:05:03.306646+0000","last_became_peered":"2023-09-30T17:05:03.306646+0000","last_unstale":"2023-09-30T17:05:26.310205+0000","last_undegraded":"2023-09-30T17:05:26.310205+0000","last_fullsized":"2023-09-30T17:05:26.310205+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"59'5670","reported_seq":5748,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:46.679909+0000","last_change":"2023-09-30T17:05:46.679960+0000","last_active":"2023-09-30T17:05:46.679909+0000","last_peered":"2023-09-30T17:05:46.679909+0000","last_clean":"2023-09-30T17:05:46.679909+0000","last_became_active":"2023-09-30T17:02:18.358786+0000","last_became_peered":"2023-09-30T17:02:18.358786+0000","last_unstale":"2023-09-30T17:05:46.679909+0000","last_undegraded":"2023-09-30T17:05:46.679909+0000","last_fullsized":"2023-09-30T17:05:46.679909+0000","mapping_epoch":17,"log_start":"44'1500","ondisk_log_start":"44'1500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'5670","last_scrub_stamp":"2023-09-30T17:05:46.679767+0000","last_deep_scrub":"59'5670","last_deep_scrub_stamp":"2023-09-30T17:05:46.679767+0000","last_clean_scrub_stamp":"2023-09-30T17:05:46.679767+0000","objects_scrubbed":0,"log_size":4170,"log_dups_size":1500,"ondisk_log_size":4170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:13:16.252019+0000","scrub_duration":0.0034350140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16627,"num_write_kb":79047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"60'78","reported_seq":50,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309885+0000","last_change":"2023-09-30T17:05:03.313916+0000","last_active":"2023-09-30T17:05:26.309885+0000","last_peered":"2023-09-30T17:05:26.309885+0000","last_clean":"2023-09-30T17:05:26.309885+0000","last_became_active":"2023-09-30T17:05:03.302516+0000","last_became_peered":"2023-09-30T17:05:03.302516+0000","last_unstale":"2023-09-30T17:05:26.309885+0000","last_undegraded":"2023-09-30T17:05:26.309885+0000","last_fullsized":"2023-09-30T17:05:26.309885+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227523,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":222729,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"59'5677","reported_seq":5757,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310006+0000","last_change":"2023-09-30T17:05:06.289965+0000","last_active":"2023-09-30T17:05:26.310006+0000","last_peered":"2023-09-30T17:05:26.310006+0000","last_clean":"2023-09-30T17:05:26.310006+0000","last_became_active":"2023-09-30T17:05:06.288155+0000","last_became_peered":"2023-09-30T17:05:06.288155+0000","last_unstale":"2023-09-30T17:05:26.310006+0000","last_undegraded":"2023-09-30T17:05:26.310006+0000","last_fullsized":"2023-09-30T17:05:26.310006+0000","mapping_epoch":69,"log_start":"42'1100","ondisk_log_start":"42'1100","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4577,"log_dups_size":1100,"ondisk_log_size":4577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16579,"num_write_kb":79104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309395+0000","last_change":"2023-09-30T17:05:03.310322+0000","last_active":"2023-09-30T17:05:26.309395+0000","last_peered":"2023-09-30T17:05:26.309395+0000","last_clean":"2023-09-30T17:05:26.309395+0000","last_became_active":"2023-09-30T17:05:03.309505+0000","last_became_peered":"2023-09-30T17:05:03.309505+0000","last_unstale":"2023-09-30T17:05:26.309395+0000","last_undegraded":"2023-09-30T17:05:26.309395+0000","last_fullsized":"2023-09-30T17:05:26.309395+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"59'2836","reported_seq":2906,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309999+0000","last_change":"2023-09-30T17:02:18.360019+0000","last_active":"2023-09-30T17:05:26.309999+0000","last_peered":"2023-09-30T17:05:26.309999+0000","last_clean":"2023-09-30T17:05:26.309999+0000","last_became_active":"2023-09-30T17:02:18.358364+0000","last_became_peered":"2023-09-30T17:02:18.358364+0000","last_unstale":"2023-09-30T17:05:26.309999+0000","last_undegraded":"2023-09-30T17:05:26.309999+0000","last_fullsized":"2023-09-30T17:05:26.309999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2836,"log_dups_size":0,"ondisk_log_size":2836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8308,"num_write_kb":39456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":82,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309887+0000","last_change":"2023-09-30T17:05:03.308853+0000","last_active":"2023-09-30T17:05:26.309887+0000","last_peered":"2023-09-30T17:05:26.309887+0000","last_clean":"2023-09-30T17:05:26.309887+0000","last_became_active":"2023-09-30T17:05:03.308377+0000","last_became_peered":"2023-09-30T17:05:03.308377+0000","last_unstale":"2023-09-30T17:05:26.309887+0000","last_undegraded":"2023-09-30T17:05:26.309887+0000","last_fullsized":"2023-09-30T17:05:26.309887+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"59'2856","reported_seq":2934,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:43.659585+0000","last_change":"2023-09-30T17:05:43.659681+0000","last_active":"2023-09-30T17:05:43.659585+0000","last_peered":"2023-09-30T17:05:43.659585+0000","last_clean":"2023-09-30T17:05:43.659585+0000","last_became_active":"2023-09-30T17:02:18.361556+0000","last_became_peered":"2023-09-30T17:02:18.361556+0000","last_unstale":"2023-09-30T17:05:43.659585+0000","last_undegraded":"2023-09-30T17:05:43.659585+0000","last_fullsized":"2023-09-30T17:05:43.659585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2856","last_scrub_stamp":"2023-09-30T17:05:43.659443+0000","last_deep_scrub":"59'2856","last_deep_scrub_stamp":"2023-09-30T17:05:43.659443+0000","last_clean_scrub_stamp":"2023-09-30T17:05:43.659443+0000","objects_scrubbed":0,"log_size":2856,"log_dups_size":0,"ondisk_log_size":2856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:13:13.231695+0000","scrub_duration":0.0035525420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8321,"num_write_kb":39600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":82,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309660+0000","last_change":"2023-09-30T17:05:03.304220+0000","last_active":"2023-09-30T17:05:26.309660+0000","last_peered":"2023-09-30T17:05:26.309660+0000","last_clean":"2023-09-30T17:05:26.309660+0000","last_became_active":"2023-09-30T17:05:03.303598+0000","last_became_peered":"2023-09-30T17:05:03.303598+0000","last_unstale":"2023-09-30T17:05:26.309660+0000","last_undegraded":"2023-09-30T17:05:26.309660+0000","last_fullsized":"2023-09-30T17:05:26.309660+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"59'12","reported_seq":93,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310428+0000","last_change":"2023-09-30T17:05:03.313214+0000","last_active":"2023-09-30T17:05:26.310428+0000","last_peered":"2023-09-30T17:05:26.310428+0000","last_clean":"2023-09-30T17:05:26.310428+0000","last_became_active":"2023-09-30T17:05:03.312888+0000","last_became_peered":"2023-09-30T17:05:03.312888+0000","last_unstale":"2023-09-30T17:05:26.310428+0000","last_undegraded":"2023-09-30T17:05:26.310428+0000","last_fullsized":"2023-09-30T17:05:26.310428+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"76'13","reported_seq":48,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:52.618203+0000","last_change":"2023-09-30T17:05:52.618265+0000","last_active":"2023-09-30T17:05:52.618203+0000","last_peered":"2023-09-30T17:05:52.618203+0000","last_clean":"2023-09-30T17:05:52.618203+0000","last_became_active":"2023-09-30T17:05:03.304030+0000","last_became_peered":"2023-09-30T17:05:03.304030+0000","last_unstale":"2023-09-30T17:05:52.618203+0000","last_undegraded":"2023-09-30T17:05:52.618203+0000","last_fullsized":"2023-09-30T17:05:52.618203+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'13","last_scrub_stamp":"2023-09-30T17:05:52.618079+0000","last_deep_scrub":"76'13","last_deep_scrub_stamp":"2023-09-30T17:05:52.618079+0000","last_clean_scrub_stamp":"2023-09-30T17:05:52.618079+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:02:35.473886+0000","scrub_duration":0.0072773029999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"59'2892","reported_seq":2982,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310624+0000","last_change":"2023-09-30T17:05:06.290230+0000","last_active":"2023-09-30T17:05:26.310624+0000","last_peered":"2023-09-30T17:05:26.310624+0000","last_clean":"2023-09-30T17:05:26.310624+0000","last_became_active":"2023-09-30T17:05:06.288725+0000","last_became_peered":"2023-09-30T17:05:06.288725+0000","last_unstale":"2023-09-30T17:05:26.310624+0000","last_undegraded":"2023-09-30T17:05:26.310624+0000","last_fullsized":"2023-09-30T17:05:26.310624+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2892,"log_dups_size":0,"ondisk_log_size":2892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8345,"num_write_kb":39712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310288+0000","last_change":"2023-09-30T17:05:03.304339+0000","last_active":"2023-09-30T17:05:26.310288+0000","last_peered":"2023-09-30T17:05:26.310288+0000","last_clean":"2023-09-30T17:05:26.310288+0000","last_became_active":"2023-09-30T17:05:03.303179+0000","last_became_peered":"2023-09-30T17:05:03.303179+0000","last_unstale":"2023-09-30T17:05:26.310288+0000","last_undegraded":"2023-09-30T17:05:26.310288+0000","last_fullsized":"2023-09-30T17:05:26.310288+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"59'2861","reported_seq":2951,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309316+0000","last_change":"2023-09-30T17:05:06.290324+0000","last_active":"2023-09-30T17:05:26.309316+0000","last_peered":"2023-09-30T17:05:26.309316+0000","last_clean":"2023-09-30T17:05:26.309316+0000","last_became_active":"2023-09-30T17:05:06.288824+0000","last_became_peered":"2023-09-30T17:05:06.288824+0000","last_unstale":"2023-09-30T17:05:26.309316+0000","last_undegraded":"2023-09-30T17:05:26.309316+0000","last_fullsized":"2023-09-30T17:05:26.309316+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2861,"log_dups_size":0,"ondisk_log_size":2861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8384,"num_write_kb":39788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":84,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310436+0000","last_change":"2023-09-30T17:05:03.304232+0000","last_active":"2023-09-30T17:05:26.310436+0000","last_peered":"2023-09-30T17:05:26.310436+0000","last_clean":"2023-09-30T17:05:26.310436+0000","last_became_active":"2023-09-30T17:05:03.303874+0000","last_became_peered":"2023-09-30T17:05:03.303874+0000","last_unstale":"2023-09-30T17:05:26.310436+0000","last_undegraded":"2023-09-30T17:05:26.310436+0000","last_fullsized":"2023-09-30T17:05:26.310436+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"59'2","reported_seq":72,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309916+0000","last_change":"2023-09-30T17:02:18.359767+0000","last_active":"2023-09-30T17:05:26.309916+0000","last_peered":"2023-09-30T17:05:26.309916+0000","last_clean":"2023-09-30T17:05:26.309916+0000","last_became_active":"2023-09-30T17:02:18.356825+0000","last_became_peered":"2023-09-30T17:02:18.356825+0000","last_unstale":"2023-09-30T17:05:26.309916+0000","last_undegraded":"2023-09-30T17:05:26.309916+0000","last_fullsized":"2023-09-30T17:05:26.309916+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309689+0000","last_change":"2023-09-30T17:05:03.305087+0000","last_active":"2023-09-30T17:05:26.309689+0000","last_peered":"2023-09-30T17:05:26.309689+0000","last_clean":"2023-09-30T17:05:26.309689+0000","last_became_active":"2023-09-30T17:05:03.304463+0000","last_became_peered":"2023-09-30T17:05:03.304463+0000","last_unstale":"2023-09-30T17:05:26.309689+0000","last_undegraded":"2023-09-30T17:05:26.309689+0000","last_fullsized":"2023-09-30T17:05:26.309689+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"59'2835","reported_seq":2904,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309472+0000","last_change":"2023-09-30T17:05:06.289598+0000","last_active":"2023-09-30T17:05:26.309472+0000","last_peered":"2023-09-30T17:05:26.309472+0000","last_clean":"2023-09-30T17:05:26.309472+0000","last_became_active":"2023-09-30T17:05:06.288712+0000","last_became_peered":"2023-09-30T17:05:06.288712+0000","last_unstale":"2023-09-30T17:05:26.309472+0000","last_undegraded":"2023-09-30T17:05:26.309472+0000","last_fullsized":"2023-09-30T17:05:26.309472+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2835,"log_dups_size":0,"ondisk_log_size":2835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8288,"num_write_kb":39388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:55.610514+0000","last_change":"2023-09-30T17:05:55.610603+0000","last_active":"2023-09-30T17:05:55.610514+0000","last_peered":"2023-09-30T17:05:55.610514+0000","last_clean":"2023-09-30T17:05:55.610514+0000","last_became_active":"2023-09-30T17:05:03.310836+0000","last_became_peered":"2023-09-30T17:05:03.310836+0000","last_unstale":"2023-09-30T17:05:55.610514+0000","last_undegraded":"2023-09-30T17:05:55.610514+0000","last_fullsized":"2023-09-30T17:05:55.610514+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:05:55.610405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:05:55.610405+0000","last_clean_scrub_stamp":"2023-09-30T17:05:55.610405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:09:49.583774+0000","scrub_duration":0.0018973,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"59'8","reported_seq":89,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310055+0000","last_change":"2023-09-30T17:05:03.308917+0000","last_active":"2023-09-30T17:05:26.310055+0000","last_peered":"2023-09-30T17:05:26.310055+0000","last_clean":"2023-09-30T17:05:26.310055+0000","last_became_active":"2023-09-30T17:05:03.308214+0000","last_became_peered":"2023-09-30T17:05:03.308214+0000","last_unstale":"2023-09-30T17:05:26.310055+0000","last_undegraded":"2023-09-30T17:05:26.310055+0000","last_fullsized":"2023-09-30T17:05:26.310055+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"58'3","reported_seq":86,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309993+0000","last_change":"2023-09-30T17:05:03.308944+0000","last_active":"2023-09-30T17:05:26.309993+0000","last_peered":"2023-09-30T17:05:26.309993+0000","last_clean":"2023-09-30T17:05:26.309993+0000","last_became_active":"2023-09-30T17:05:03.308483+0000","last_became_peered":"2023-09-30T17:05:03.308483+0000","last_unstale":"2023-09-30T17:05:26.309993+0000","last_undegraded":"2023-09-30T17:05:26.309993+0000","last_fullsized":"2023-09-30T17:05:26.309993+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"59'2846","reported_seq":2922,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:45.632483+0000","last_change":"2023-09-30T17:05:45.632563+0000","last_active":"2023-09-30T17:05:45.632483+0000","last_peered":"2023-09-30T17:05:45.632483+0000","last_clean":"2023-09-30T17:05:45.632483+0000","last_became_active":"2023-09-30T17:05:06.289225+0000","last_became_peered":"2023-09-30T17:05:06.289225+0000","last_unstale":"2023-09-30T17:05:45.632483+0000","last_undegraded":"2023-09-30T17:05:45.632483+0000","last_fullsized":"2023-09-30T17:05:45.632483+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2846","last_scrub_stamp":"2023-09-30T17:05:45.632358+0000","last_deep_scrub":"59'2846","last_deep_scrub_stamp":"2023-09-30T17:05:45.632358+0000","last_clean_scrub_stamp":"2023-09-30T17:05:45.632358+0000","objects_scrubbed":0,"log_size":2846,"log_dups_size":0,"ondisk_log_size":2846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:03:33.607467+0000","scrub_duration":0.0029322739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8199,"num_write_kb":39160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309240+0000","last_change":"2023-09-30T17:05:03.309689+0000","last_active":"2023-09-30T17:05:26.309240+0000","last_peered":"2023-09-30T17:05:26.309240+0000","last_clean":"2023-09-30T17:05:26.309240+0000","last_became_active":"2023-09-30T17:05:03.309318+0000","last_became_peered":"2023-09-30T17:05:03.309318+0000","last_unstale":"2023-09-30T17:05:26.309240+0000","last_undegraded":"2023-09-30T17:05:26.309240+0000","last_fullsized":"2023-09-30T17:05:26.309240+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"59'2831","reported_seq":2899,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310018+0000","last_change":"2023-09-30T17:05:06.289189+0000","last_active":"2023-09-30T17:05:26.310018+0000","last_peered":"2023-09-30T17:05:26.310018+0000","last_clean":"2023-09-30T17:05:26.310018+0000","last_became_active":"2023-09-30T17:05:06.288348+0000","last_became_peered":"2023-09-30T17:05:06.288348+0000","last_unstale":"2023-09-30T17:05:26.310018+0000","last_undegraded":"2023-09-30T17:05:26.310018+0000","last_fullsized":"2023-09-30T17:05:26.310018+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2831,"log_dups_size":0,"ondisk_log_size":2831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8336,"num_write_kb":39484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":82,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309471+0000","last_change":"2023-09-30T17:05:03.304019+0000","last_active":"2023-09-30T17:05:26.309471+0000","last_peered":"2023-09-30T17:05:26.309471+0000","last_clean":"2023-09-30T17:05:26.309471+0000","last_became_active":"2023-09-30T17:05:03.303473+0000","last_became_peered":"2023-09-30T17:05:03.303473+0000","last_unstale":"2023-09-30T17:05:26.309471+0000","last_undegraded":"2023-09-30T17:05:26.309471+0000","last_fullsized":"2023-09-30T17:05:26.309471+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"59'2884","reported_seq":2960,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:39.659504+0000","last_change":"2023-09-30T17:05:39.659591+0000","last_active":"2023-09-30T17:05:39.659504+0000","last_peered":"2023-09-30T17:05:39.659504+0000","last_clean":"2023-09-30T17:05:39.659504+0000","last_became_active":"2023-09-30T17:05:06.288169+0000","last_became_peered":"2023-09-30T17:05:06.288169+0000","last_unstale":"2023-09-30T17:05:39.659504+0000","last_undegraded":"2023-09-30T17:05:39.659504+0000","last_fullsized":"2023-09-30T17:05:39.659504+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2884","last_scrub_stamp":"2023-09-30T17:05:39.659392+0000","last_deep_scrub":"59'2884","last_deep_scrub_stamp":"2023-09-30T17:05:39.659392+0000","last_clean_scrub_stamp":"2023-09-30T17:05:39.659392+0000","objects_scrubbed":0,"log_size":2884,"log_dups_size":0,"ondisk_log_size":2884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:25:23.871113+0000","scrub_duration":0.0036873600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8366,"num_write_kb":39744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":71,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309457+0000","last_change":"2023-09-30T17:02:17.358811+0000","last_active":"2023-09-30T17:05:26.309457+0000","last_peered":"2023-09-30T17:05:26.309457+0000","last_clean":"2023-09-30T17:05:26.309457+0000","last_became_active":"2023-09-30T17:02:17.358582+0000","last_became_peered":"2023-09-30T17:02:17.358582+0000","last_unstale":"2023-09-30T17:05:26.309457+0000","last_undegraded":"2023-09-30T17:05:26.309457+0000","last_fullsized":"2023-09-30T17:05:26.309457+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"59'8580","reported_seq":8650,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310485+0000","last_change":"2023-09-30T17:02:18.364478+0000","last_active":"2023-09-30T17:05:26.310485+0000","last_peered":"2023-09-30T17:05:26.310485+0000","last_clean":"2023-09-30T17:05:26.310485+0000","last_became_active":"2023-09-30T17:02:18.364057+0000","last_became_peered":"2023-09-30T17:02:18.364057+0000","last_unstale":"2023-09-30T17:05:26.310485+0000","last_undegraded":"2023-09-30T17:05:26.310485+0000","last_fullsized":"2023-09-30T17:05:26.310485+0000","mapping_epoch":17,"log_start":"49'4400","ondisk_log_start":"49'4400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4180,"log_dups_size":4400,"ondisk_log_size":4180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25046,"num_write_kb":118972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":74,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309929+0000","last_change":"2023-09-30T17:02:12.327704+0000","last_active":"2023-09-30T17:05:26.309929+0000","last_peered":"2023-09-30T17:05:26.309929+0000","last_clean":"2023-09-30T17:05:26.309929+0000","last_became_active":"2023-09-30T17:02:12.327384+0000","last_became_peered":"2023-09-30T17:02:12.327384+0000","last_unstale":"2023-09-30T17:05:26.309929+0000","last_undegraded":"2023-09-30T17:05:26.309929+0000","last_fullsized":"2023-09-30T17:05:26.309929+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310220+0000","last_change":"2023-09-30T17:05:03.311271+0000","last_active":"2023-09-30T17:05:26.310220+0000","last_peered":"2023-09-30T17:05:26.310220+0000","last_clean":"2023-09-30T17:05:26.310220+0000","last_became_active":"2023-09-30T17:05:03.310655+0000","last_became_peered":"2023-09-30T17:05:03.310655+0000","last_unstale":"2023-09-30T17:05:26.310220+0000","last_undegraded":"2023-09-30T17:05:26.310220+0000","last_fullsized":"2023-09-30T17:05:26.310220+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"59'9","reported_seq":98,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:44.620207+0000","last_change":"2023-09-30T17:05:44.620255+0000","last_active":"2023-09-30T17:05:44.620207+0000","last_peered":"2023-09-30T17:05:44.620207+0000","last_clean":"2023-09-30T17:05:44.620207+0000","last_became_active":"2023-09-30T17:05:03.305956+0000","last_became_peered":"2023-09-30T17:05:03.305956+0000","last_unstale":"2023-09-30T17:05:44.620207+0000","last_undegraded":"2023-09-30T17:05:44.620207+0000","last_fullsized":"2023-09-30T17:05:44.620207+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'9","last_scrub_stamp":"2023-09-30T17:05:44.620091+0000","last_deep_scrub":"59'9","last_deep_scrub_stamp":"2023-09-30T17:05:44.620091+0000","last_clean_scrub_stamp":"2023-09-30T17:05:44.620091+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:48:53.055175+0000","scrub_duration":0.0028788109999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309291+0000","last_change":"2023-09-30T17:05:03.309359+0000","last_active":"2023-09-30T17:05:26.309291+0000","last_peered":"2023-09-30T17:05:26.309291+0000","last_clean":"2023-09-30T17:05:26.309291+0000","last_became_active":"2023-09-30T17:05:03.308944+0000","last_became_peered":"2023-09-30T17:05:03.308944+0000","last_unstale":"2023-09-30T17:05:26.309291+0000","last_undegraded":"2023-09-30T17:05:26.309291+0000","last_fullsized":"2023-09-30T17:05:26.309291+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:48.694200+0000","last_change":"2023-09-30T17:05:48.694245+0000","last_active":"2023-09-30T17:05:48.694200+0000","last_peered":"2023-09-30T17:05:48.694200+0000","last_clean":"2023-09-30T17:05:48.694200+0000","last_became_active":"2023-09-30T17:05:03.310706+0000","last_became_peered":"2023-09-30T17:05:03.310706+0000","last_unstale":"2023-09-30T17:05:48.694200+0000","last_undegraded":"2023-09-30T17:05:48.694200+0000","last_fullsized":"2023-09-30T17:05:48.694200+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:05:48.694106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:05:48.694106+0000","last_clean_scrub_stamp":"2023-09-30T17:05:48.694106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:45:19.266879+0000","scrub_duration":0.0018395079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"59'9","reported_seq":79,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309899+0000","last_change":"2023-09-30T17:02:18.363399+0000","last_active":"2023-09-30T17:05:26.309899+0000","last_peered":"2023-09-30T17:05:26.309899+0000","last_clean":"2023-09-30T17:05:26.309899+0000","last_became_active":"2023-09-30T17:02:18.363064+0000","last_became_peered":"2023-09-30T17:02:18.363064+0000","last_unstale":"2023-09-30T17:05:26.309899+0000","last_undegraded":"2023-09-30T17:05:26.309899+0000","last_fullsized":"2023-09-30T17:05:26.309899+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":74,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309584+0000","last_change":"2023-09-30T17:02:12.327834+0000","last_active":"2023-09-30T17:05:26.309584+0000","last_peered":"2023-09-30T17:05:26.309584+0000","last_clean":"2023-09-30T17:05:26.309584+0000","last_became_active":"2023-09-30T17:02:12.327542+0000","last_became_peered":"2023-09-30T17:02:12.327542+0000","last_unstale":"2023-09-30T17:05:26.309584+0000","last_undegraded":"2023-09-30T17:05:26.309584+0000","last_fullsized":"2023-09-30T17:05:26.309584+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":82,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309448+0000","last_change":"2023-09-30T17:05:03.305668+0000","last_active":"2023-09-30T17:05:26.309448+0000","last_peered":"2023-09-30T17:05:26.309448+0000","last_clean":"2023-09-30T17:05:26.309448+0000","last_became_active":"2023-09-30T17:05:03.305222+0000","last_became_peered":"2023-09-30T17:05:03.305222+0000","last_unstale":"2023-09-30T17:05:26.309448+0000","last_undegraded":"2023-09-30T17:05:26.309448+0000","last_fullsized":"2023-09-30T17:05:26.309448+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"59'6","reported_seq":76,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310623+0000","last_change":"2023-09-30T17:02:18.364406+0000","last_active":"2023-09-30T17:05:26.310623+0000","last_peered":"2023-09-30T17:05:26.310623+0000","last_clean":"2023-09-30T17:05:26.310623+0000","last_became_active":"2023-09-30T17:02:18.363849+0000","last_became_peered":"2023-09-30T17:02:18.363849+0000","last_unstale":"2023-09-30T17:05:26.310623+0000","last_undegraded":"2023-09-30T17:05:26.310623+0000","last_fullsized":"2023-09-30T17:05:26.310623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309380+0000","last_change":"2023-09-30T17:05:03.310062+0000","last_active":"2023-09-30T17:05:26.309380+0000","last_peered":"2023-09-30T17:05:26.309380+0000","last_clean":"2023-09-30T17:05:26.309380+0000","last_became_active":"2023-09-30T17:05:03.308958+0000","last_became_peered":"2023-09-30T17:05:03.308958+0000","last_unstale":"2023-09-30T17:05:26.309380+0000","last_undegraded":"2023-09-30T17:05:26.309380+0000","last_fullsized":"2023-09-30T17:05:26.309380+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"11'157","reported_seq":226,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309271+0000","last_change":"2023-09-30T17:05:03.303046+0000","last_active":"2023-09-30T17:05:26.309271+0000","last_peered":"2023-09-30T17:05:26.309271+0000","last_clean":"2023-09-30T17:05:26.309271+0000","last_became_active":"2023-09-30T17:05:03.302265+0000","last_became_peered":"2023-09-30T17:05:03.302265+0000","last_unstale":"2023-09-30T17:05:26.309271+0000","last_undegraded":"2023-09-30T17:05:26.309271+0000","last_fullsized":"2023-09-30T17:05:26.309271+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:06.295501+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:06.295501+0000","last_clean_scrub_stamp":"2023-09-30T17:02:06.295501+0000","objects_scrubbed":0,"log_size":157,"log_dups_size":0,"ondisk_log_size":157,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":71,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309610+0000","last_change":"2023-09-30T17:02:17.357139+0000","last_active":"2023-09-30T17:05:26.309610+0000","last_peered":"2023-09-30T17:05:26.309610+0000","last_clean":"2023-09-30T17:05:26.309610+0000","last_became_active":"2023-09-30T17:02:17.356901+0000","last_became_peered":"2023-09-30T17:02:17.356901+0000","last_unstale":"2023-09-30T17:05:26.309610+0000","last_undegraded":"2023-09-30T17:05:26.309610+0000","last_fullsized":"2023-09-30T17:05:26.309610+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"59'7","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:53.612754+0000","last_change":"2023-09-30T17:05:53.612809+0000","last_active":"2023-09-30T17:05:53.612754+0000","last_peered":"2023-09-30T17:05:53.612754+0000","last_clean":"2023-09-30T17:05:53.612754+0000","last_became_active":"2023-09-30T17:05:03.304974+0000","last_became_peered":"2023-09-30T17:05:03.304974+0000","last_unstale":"2023-09-30T17:05:53.612754+0000","last_undegraded":"2023-09-30T17:05:53.612754+0000","last_fullsized":"2023-09-30T17:05:53.612754+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'7","last_scrub_stamp":"2023-09-30T17:05:53.612654+0000","last_deep_scrub":"59'7","last_deep_scrub_stamp":"2023-09-30T17:05:53.612654+0000","last_clean_scrub_stamp":"2023-09-30T17:05:53.612654+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:04:16.815158+0000","scrub_duration":0.00223011,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:49.646389+0000","last_change":"2023-09-30T17:05:49.646435+0000","last_active":"2023-09-30T17:05:49.646389+0000","last_peered":"2023-09-30T17:05:49.646389+0000","last_clean":"2023-09-30T17:05:49.646389+0000","last_became_active":"2023-09-30T17:05:03.302590+0000","last_became_peered":"2023-09-30T17:05:03.302590+0000","last_unstale":"2023-09-30T17:05:49.646389+0000","last_undegraded":"2023-09-30T17:05:49.646389+0000","last_fullsized":"2023-09-30T17:05:49.646389+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:05:49.646266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:05:49.646266+0000","last_clean_scrub_stamp":"2023-09-30T17:05:49.646266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:45:23.943931+0000","scrub_duration":0.002091379,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"59'5","reported_seq":95,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309444+0000","last_change":"2023-09-30T17:05:03.318439+0000","last_active":"2023-09-30T17:05:26.309444+0000","last_peered":"2023-09-30T17:05:26.309444+0000","last_clean":"2023-09-30T17:05:26.309444+0000","last_became_active":"2023-09-30T17:05:03.308059+0000","last_became_peered":"2023-09-30T17:05:03.308059+0000","last_unstale":"2023-09-30T17:05:26.309444+0000","last_undegraded":"2023-09-30T17:05:26.309444+0000","last_fullsized":"2023-09-30T17:05:26.309444+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"59'11252","reported_seq":11330,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:53.639404+0000","last_change":"2023-09-30T17:05:53.639457+0000","last_active":"2023-09-30T17:05:53.639404+0000","last_peered":"2023-09-30T17:05:53.639404+0000","last_clean":"2023-09-30T17:05:53.639404+0000","last_became_active":"2023-09-30T17:02:18.356839+0000","last_became_peered":"2023-09-30T17:02:18.356839+0000","last_unstale":"2023-09-30T17:05:53.639404+0000","last_undegraded":"2023-09-30T17:05:53.639404+0000","last_fullsized":"2023-09-30T17:05:53.639404+0000","mapping_epoch":17,"log_start":"51'6700","ondisk_log_start":"51'6700","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'11252","last_scrub_stamp":"2023-09-30T17:05:53.639286+0000","last_deep_scrub":"59'11252","last_deep_scrub_stamp":"2023-09-30T17:05:53.639286+0000","last_clean_scrub_stamp":"2023-09-30T17:05:53.639286+0000","objects_scrubbed":0,"log_size":4552,"log_dups_size":6700,"ondisk_log_size":4552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:50:12.670739+0000","scrub_duration":0.00330314,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33068,"num_write_kb":157144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":74,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310292+0000","last_change":"2023-09-30T17:02:12.330472+0000","last_active":"2023-09-30T17:05:26.310292+0000","last_peered":"2023-09-30T17:05:26.310292+0000","last_clean":"2023-09-30T17:05:26.310292+0000","last_became_active":"2023-09-30T17:02:12.330154+0000","last_became_peered":"2023-09-30T17:02:12.330154+0000","last_unstale":"2023-09-30T17:05:26.310292+0000","last_undegraded":"2023-09-30T17:05:26.310292+0000","last_fullsized":"2023-09-30T17:05:26.310292+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":71,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310151+0000","last_change":"2023-09-30T17:02:17.361007+0000","last_active":"2023-09-30T17:05:26.310151+0000","last_peered":"2023-09-30T17:05:26.310151+0000","last_clean":"2023-09-30T17:05:26.310151+0000","last_became_active":"2023-09-30T17:02:17.360721+0000","last_became_peered":"2023-09-30T17:02:17.360721+0000","last_unstale":"2023-09-30T17:05:26.310151+0000","last_undegraded":"2023-09-30T17:05:26.310151+0000","last_fullsized":"2023-09-30T17:05:26.310151+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"59'2836","reported_seq":2926,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310240+0000","last_change":"2023-09-30T17:05:06.293085+0000","last_active":"2023-09-30T17:05:26.310240+0000","last_peered":"2023-09-30T17:05:26.310240+0000","last_clean":"2023-09-30T17:05:26.310240+0000","last_became_active":"2023-09-30T17:05:06.291203+0000","last_became_peered":"2023-09-30T17:05:06.291203+0000","last_unstale":"2023-09-30T17:05:26.310240+0000","last_undegraded":"2023-09-30T17:05:26.310240+0000","last_fullsized":"2023-09-30T17:05:26.310240+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2836,"log_dups_size":0,"ondisk_log_size":2836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8199,"num_write_kb":39048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"59'3","reported_seq":74,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310413+0000","last_change":"2023-09-30T17:02:17.360831+0000","last_active":"2023-09-30T17:05:26.310413+0000","last_peered":"2023-09-30T17:05:26.310413+0000","last_clean":"2023-09-30T17:05:26.310413+0000","last_became_active":"2023-09-30T17:02:17.360494+0000","last_became_peered":"2023-09-30T17:02:17.360494+0000","last_unstale":"2023-09-30T17:05:26.310413+0000","last_undegraded":"2023-09-30T17:05:26.310413+0000","last_fullsized":"2023-09-30T17:05:26.310413+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":74,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310527+0000","last_change":"2023-09-30T17:02:12.328184+0000","last_active":"2023-09-30T17:05:26.310527+0000","last_peered":"2023-09-30T17:05:26.310527+0000","last_clean":"2023-09-30T17:05:26.310527+0000","last_became_active":"2023-09-30T17:02:12.327898+0000","last_became_peered":"2023-09-30T17:02:12.327898+0000","last_unstale":"2023-09-30T17:05:26.310527+0000","last_undegraded":"2023-09-30T17:05:26.310527+0000","last_fullsized":"2023-09-30T17:05:26.310527+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"59'8","reported_seq":97,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:43.606710+0000","last_change":"2023-09-30T17:05:43.606760+0000","last_active":"2023-09-30T17:05:43.606710+0000","last_peered":"2023-09-30T17:05:43.606710+0000","last_clean":"2023-09-30T17:05:43.606710+0000","last_became_active":"2023-09-30T17:05:03.308429+0000","last_became_peered":"2023-09-30T17:05:03.308429+0000","last_unstale":"2023-09-30T17:05:43.606710+0000","last_undegraded":"2023-09-30T17:05:43.606710+0000","last_fullsized":"2023-09-30T17:05:43.606710+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'8","last_scrub_stamp":"2023-09-30T17:05:43.606596+0000","last_deep_scrub":"59'8","last_deep_scrub_stamp":"2023-09-30T17:05:43.606596+0000","last_clean_scrub_stamp":"2023-09-30T17:05:43.606596+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:53:16.420602+0000","scrub_duration":0.0021279749999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310050+0000","last_change":"2023-09-30T17:05:03.304353+0000","last_active":"2023-09-30T17:05:26.310050+0000","last_peered":"2023-09-30T17:05:26.310050+0000","last_clean":"2023-09-30T17:05:26.310050+0000","last_became_active":"2023-09-30T17:05:03.302503+0000","last_became_peered":"2023-09-30T17:05:03.302503+0000","last_unstale":"2023-09-30T17:05:26.310050+0000","last_undegraded":"2023-09-30T17:05:26.310050+0000","last_fullsized":"2023-09-30T17:05:26.310050+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"60'8","reported_seq":95,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310376+0000","last_change":"2023-09-30T17:05:03.314806+0000","last_active":"2023-09-30T17:05:26.310376+0000","last_peered":"2023-09-30T17:05:26.310376+0000","last_clean":"2023-09-30T17:05:26.310376+0000","last_became_active":"2023-09-30T17:05:03.308201+0000","last_became_peered":"2023-09-30T17:05:03.308201+0000","last_unstale":"2023-09-30T17:05:26.310376+0000","last_undegraded":"2023-09-30T17:05:26.310376+0000","last_fullsized":"2023-09-30T17:05:26.310376+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"59'6","reported_seq":87,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309845+0000","last_change":"2023-09-30T17:05:03.304265+0000","last_active":"2023-09-30T17:05:26.309845+0000","last_peered":"2023-09-30T17:05:26.309845+0000","last_clean":"2023-09-30T17:05:26.309845+0000","last_became_active":"2023-09-30T17:05:03.304022+0000","last_became_peered":"2023-09-30T17:05:03.304022+0000","last_unstale":"2023-09-30T17:05:26.309845+0000","last_undegraded":"2023-09-30T17:05:26.309845+0000","last_fullsized":"2023-09-30T17:05:26.309845+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":83,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309956+0000","last_change":"2023-09-30T17:05:03.303927+0000","last_active":"2023-09-30T17:05:26.309956+0000","last_peered":"2023-09-30T17:05:26.309956+0000","last_clean":"2023-09-30T17:05:26.309956+0000","last_became_active":"2023-09-30T17:05:03.303487+0000","last_became_peered":"2023-09-30T17:05:03.303487+0000","last_unstale":"2023-09-30T17:05:26.309956+0000","last_undegraded":"2023-09-30T17:05:26.309956+0000","last_fullsized":"2023-09-30T17:05:26.309956+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"59'2835","reported_seq":2913,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:49.578110+0000","last_change":"2023-09-30T17:05:49.578202+0000","last_active":"2023-09-30T17:05:49.578110+0000","last_peered":"2023-09-30T17:05:49.578110+0000","last_clean":"2023-09-30T17:05:49.578110+0000","last_became_active":"2023-09-30T17:02:18.356902+0000","last_became_peered":"2023-09-30T17:02:18.356902+0000","last_unstale":"2023-09-30T17:05:49.578110+0000","last_undegraded":"2023-09-30T17:05:49.578110+0000","last_fullsized":"2023-09-30T17:05:49.578110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2835","last_scrub_stamp":"2023-09-30T17:05:49.577968+0000","last_deep_scrub":"59'2835","last_deep_scrub_stamp":"2023-09-30T17:05:49.577968+0000","last_clean_scrub_stamp":"2023-09-30T17:05:49.577968+0000","objects_scrubbed":0,"log_size":2835,"log_dups_size":0,"ondisk_log_size":2835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:05:50.365694+0000","scrub_duration":0.0031753789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8302,"num_write_kb":39500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310274+0000","last_change":"2023-09-30T17:05:03.311401+0000","last_active":"2023-09-30T17:05:26.310274+0000","last_peered":"2023-09-30T17:05:26.310274+0000","last_clean":"2023-09-30T17:05:26.310274+0000","last_became_active":"2023-09-30T17:05:03.310996+0000","last_became_peered":"2023-09-30T17:05:03.310996+0000","last_unstale":"2023-09-30T17:05:26.310274+0000","last_undegraded":"2023-09-30T17:05:26.310274+0000","last_fullsized":"2023-09-30T17:05:26.310274+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"59'2848","reported_seq":2924,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:43.643918+0000","last_change":"2023-09-30T17:05:43.644021+0000","last_active":"2023-09-30T17:05:43.643918+0000","last_peered":"2023-09-30T17:05:43.643918+0000","last_clean":"2023-09-30T17:05:43.643918+0000","last_became_active":"2023-09-30T17:05:06.289599+0000","last_became_peered":"2023-09-30T17:05:06.289599+0000","last_unstale":"2023-09-30T17:05:43.643918+0000","last_undegraded":"2023-09-30T17:05:43.643918+0000","last_fullsized":"2023-09-30T17:05:43.643918+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2848","last_scrub_stamp":"2023-09-30T17:05:43.643754+0000","last_deep_scrub":"59'2848","last_deep_scrub_stamp":"2023-09-30T17:05:43.643754+0000","last_clean_scrub_stamp":"2023-09-30T17:05:43.643754+0000","objects_scrubbed":0,"log_size":2848,"log_dups_size":0,"ondisk_log_size":2848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:09:00.902270+0000","scrub_duration":0.0023925259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8235,"num_write_kb":39276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"58'3","reported_seq":86,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310426+0000","last_change":"2023-09-30T17:05:03.307212+0000","last_active":"2023-09-30T17:05:26.310426+0000","last_peered":"2023-09-30T17:05:26.310426+0000","last_clean":"2023-09-30T17:05:26.310426+0000","last_became_active":"2023-09-30T17:05:03.306711+0000","last_became_peered":"2023-09-30T17:05:03.306711+0000","last_unstale":"2023-09-30T17:05:26.310426+0000","last_undegraded":"2023-09-30T17:05:26.310426+0000","last_fullsized":"2023-09-30T17:05:26.310426+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"59'10","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310289+0000","last_change":"2023-09-30T17:05:03.311669+0000","last_active":"2023-09-30T17:05:26.310289+0000","last_peered":"2023-09-30T17:05:26.310289+0000","last_clean":"2023-09-30T17:05:26.310289+0000","last_became_active":"2023-09-30T17:05:03.310763+0000","last_became_peered":"2023-09-30T17:05:03.310763+0000","last_unstale":"2023-09-30T17:05:26.310289+0000","last_undegraded":"2023-09-30T17:05:26.310289+0000","last_fullsized":"2023-09-30T17:05:26.310289+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":72,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310439+0000","last_change":"2023-09-30T17:02:17.360802+0000","last_active":"2023-09-30T17:05:26.310439+0000","last_peered":"2023-09-30T17:05:26.310439+0000","last_clean":"2023-09-30T17:05:26.310439+0000","last_became_active":"2023-09-30T17:02:17.360475+0000","last_became_peered":"2023-09-30T17:02:17.360475+0000","last_unstale":"2023-09-30T17:05:26.310439+0000","last_undegraded":"2023-09-30T17:05:26.310439+0000","last_fullsized":"2023-09-30T17:05:26.310439+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"59'5711","reported_seq":5781,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310210+0000","last_change":"2023-09-30T17:02:18.359857+0000","last_active":"2023-09-30T17:05:26.310210+0000","last_peered":"2023-09-30T17:05:26.310210+0000","last_clean":"2023-09-30T17:05:26.310210+0000","last_became_active":"2023-09-30T17:02:18.357098+0000","last_became_peered":"2023-09-30T17:02:18.357098+0000","last_unstale":"2023-09-30T17:05:26.310210+0000","last_undegraded":"2023-09-30T17:05:26.310210+0000","last_fullsized":"2023-09-30T17:05:26.310210+0000","mapping_epoch":17,"log_start":"42'1200","ondisk_log_start":"42'1200","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4511,"log_dups_size":1200,"ondisk_log_size":4511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16681,"num_write_kb":79476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":86,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310544+0000","last_change":"2023-09-30T17:05:03.313345+0000","last_active":"2023-09-30T17:05:26.310544+0000","last_peered":"2023-09-30T17:05:26.310544+0000","last_clean":"2023-09-30T17:05:26.310544+0000","last_became_active":"2023-09-30T17:05:03.313050+0000","last_became_peered":"2023-09-30T17:05:03.313050+0000","last_unstale":"2023-09-30T17:05:26.310544+0000","last_undegraded":"2023-09-30T17:05:26.310544+0000","last_fullsized":"2023-09-30T17:05:26.310544+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"59'2872","reported_seq":2940,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309594+0000","last_change":"2023-09-30T17:05:06.290298+0000","last_active":"2023-09-30T17:05:26.309594+0000","last_peered":"2023-09-30T17:05:26.309594+0000","last_clean":"2023-09-30T17:05:26.309594+0000","last_became_active":"2023-09-30T17:05:06.289197+0000","last_became_peered":"2023-09-30T17:05:06.289197+0000","last_unstale":"2023-09-30T17:05:26.309594+0000","last_undegraded":"2023-09-30T17:05:26.309594+0000","last_fullsized":"2023-09-30T17:05:26.309594+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2872,"log_dups_size":0,"ondisk_log_size":2872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8447,"num_write_kb":40072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"59'9","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:54.611596+0000","last_change":"2023-09-30T17:05:54.611653+0000","last_active":"2023-09-30T17:05:54.611596+0000","last_peered":"2023-09-30T17:05:54.611596+0000","last_clean":"2023-09-30T17:05:54.611596+0000","last_became_active":"2023-09-30T17:05:03.310591+0000","last_became_peered":"2023-09-30T17:05:03.310591+0000","last_unstale":"2023-09-30T17:05:54.611596+0000","last_undegraded":"2023-09-30T17:05:54.611596+0000","last_fullsized":"2023-09-30T17:05:54.611596+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'9","last_scrub_stamp":"2023-09-30T17:05:54.611494+0000","last_deep_scrub":"59'9","last_deep_scrub_stamp":"2023-09-30T17:05:54.611494+0000","last_clean_scrub_stamp":"2023-09-30T17:05:54.611494+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:03:16.862122+0000","scrub_duration":0.0022998649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"59'13","reported_seq":83,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309569+0000","last_change":"2023-09-30T17:02:18.363479+0000","last_active":"2023-09-30T17:05:26.309569+0000","last_peered":"2023-09-30T17:05:26.309569+0000","last_clean":"2023-09-30T17:05:26.309569+0000","last_became_active":"2023-09-30T17:02:18.363222+0000","last_became_peered":"2023-09-30T17:02:18.363222+0000","last_unstale":"2023-09-30T17:05:26.309569+0000","last_undegraded":"2023-09-30T17:05:26.309569+0000","last_fullsized":"2023-09-30T17:05:26.309569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"59'2796","reported_seq":2886,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309914+0000","last_change":"2023-09-30T17:05:06.292455+0000","last_active":"2023-09-30T17:05:26.309914+0000","last_peered":"2023-09-30T17:05:26.309914+0000","last_clean":"2023-09-30T17:05:26.309914+0000","last_became_active":"2023-09-30T17:05:06.290929+0000","last_became_peered":"2023-09-30T17:05:06.290929+0000","last_unstale":"2023-09-30T17:05:26.309914+0000","last_undegraded":"2023-09-30T17:05:26.309914+0000","last_fullsized":"2023-09-30T17:05:26.309914+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2796,"log_dups_size":0,"ondisk_log_size":2796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8138,"num_write_kb":38784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"59'2852","reported_seq":2922,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309818+0000","last_change":"2023-09-30T17:02:18.363216+0000","last_active":"2023-09-30T17:05:26.309818+0000","last_peered":"2023-09-30T17:05:26.309818+0000","last_clean":"2023-09-30T17:05:26.309818+0000","last_became_active":"2023-09-30T17:02:18.362894+0000","last_became_peered":"2023-09-30T17:02:18.362894+0000","last_unstale":"2023-09-30T17:05:26.309818+0000","last_undegraded":"2023-09-30T17:05:26.309818+0000","last_fullsized":"2023-09-30T17:05:26.309818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2852,"log_dups_size":0,"ondisk_log_size":2852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8357,"num_write_kb":39780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"59'2874","reported_seq":2964,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310152+0000","last_change":"2023-09-30T17:05:06.294279+0000","last_active":"2023-09-30T17:05:26.310152+0000","last_peered":"2023-09-30T17:05:26.310152+0000","last_clean":"2023-09-30T17:05:26.310152+0000","last_became_active":"2023-09-30T17:05:06.292898+0000","last_became_peered":"2023-09-30T17:05:06.292898+0000","last_unstale":"2023-09-30T17:05:26.310152+0000","last_undegraded":"2023-09-30T17:05:26.310152+0000","last_fullsized":"2023-09-30T17:05:26.310152+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2874,"log_dups_size":0,"ondisk_log_size":2874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8465,"num_write_kb":40104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":532685,"num_write_kb":2575302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140940,"ondisk_log_size":140940,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":228927,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":137,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":223425,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":524288,"data_stored":457854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},"log_size":136,"ondisk_log_size":136,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":157,"ondisk_log_size":157,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":66,"seq":283467841549,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47036,"kb_used_data":1460,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94324804,"statfs":{"total":96636764160,"available":96588599296,"internally_reserved":0,"allocated":1495040,"data_stored":1123985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7139,"internal_metadata":46654493},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]}]},{"osd":0,"up_from":8,"seq":34359738418,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":582448,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":580990,"kb_avail":93789392,"statfs":{"total":96636764160,"available":96040337408,"internally_reserved":0,"allocated":1482752,"data_stored":1122763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":594934214},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 17:05:07 2023","interfaces":[{"interface":"back","average":{"1min":0.72099999999999997,"5min":0.51800000000000002,"15min":0.48999999999999999},"min":{"1min":0.215,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":5.9480000000000004,"5min":5.9480000000000004,"15min":5.9480000000000004},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.83499999999999996,"5min":0.503,"15min":0.46300000000000002},"min":{"1min":0.216,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":3.6819999999999999,"5min":3.6819999999999999,"15min":3.6819999999999999},"last":0.59299999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]}]},{"osd":1,"up_from":8,"seq":34359738418,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":563588,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":562942,"kb_avail":93808252,"statfs":{"total":96636764160,"available":96059650048,"internally_reserved":0,"allocated":651264,"data_stored":305912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":576453062},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 17:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.48599999999999999,"15min":0.45600000000000002},"min":{"1min":0.19800000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":3.3420000000000001,"5min":3.3420000000000001,"15min":3.3420000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.51200000000000001,"15min":0.46000000000000002},"min":{"1min":0.189,"5min":0.188,"15min":0.188},"max":{"1min":3.5470000000000002,"5min":3.5470000000000002,"15min":3.5470000000000002},"last":0.51700000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":249856,"data_stored":227705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":228927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T17:05:59.432 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.642 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.642 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.642 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.642 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.643 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.643 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.643 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.643 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.644 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.644 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.644 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.644 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.644 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.645 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.645 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.645 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.645 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.645 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.646 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.646 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.646 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.646 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.647 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.647 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.647 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.647 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.742 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.743 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.743 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.743 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.743 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.743 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.744 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.744 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.744 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.744 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.744 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.744 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.744 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.745 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.745 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.745 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.745 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.745 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.745 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.745 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.745 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.746 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.746 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.746 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-30T17:02:11.318349+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=11, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.746 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.746 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-09-30T17:02:11.318349+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=11, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.746 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.747 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-30T17:02:11.318349+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=11, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.747 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.747 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.747 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-09-30T17:02:11.318349+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=11, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.747 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-09-30T17:02:06.295501+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=6, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.747 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.748 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.748 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-30T17:02:11.318349+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=11, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.748 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.748 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.748 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.748 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-30T17:02:11.318349+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=11, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.749 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2023-09-30T17:02:11.318349+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=11, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.749 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.749 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.749 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.749 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.796 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.796 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.796 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.796 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.797 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.797 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.797 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.797 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.797 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.797 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:05:59.798 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-30T17:06:19.799 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T17:06:20.154 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:06:20.156 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-09-30T17:06:20.166 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":201,"stamp":"2023-09-30T17:06:19.352886+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":819295,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":140,"num_read_kb":122,"num_write":533025,"num_write_kb":2579054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":223425,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141241,"ondisk_log_size":141241,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1193072,"kb_used_data":3544,"kb_used_omap":10,"kb_used_meta":1189493,"kb_avail":281922448,"statfs":{"total":289910292480,"available":288688586752,"internally_reserved":0,"allocated":3629056,"data_stored":2552660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10327,"internal_metadata":1218041769},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003253"},"pg_stats":[{"pgid":"4.3f","version":"59'2790","reported_seq":2868,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:47.554609+0000","last_change":"2023-09-30T17:05:47.554662+0000","last_active":"2023-09-30T17:05:47.554609+0000","last_peered":"2023-09-30T17:05:47.554609+0000","last_clean":"2023-09-30T17:05:47.554609+0000","last_became_active":"2023-09-30T17:02:18.358716+0000","last_became_peered":"2023-09-30T17:02:18.358716+0000","last_unstale":"2023-09-30T17:05:47.554609+0000","last_undegraded":"2023-09-30T17:05:47.554609+0000","last_fullsized":"2023-09-30T17:05:47.554609+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2790","last_scrub_stamp":"2023-09-30T17:05:47.554500+0000","last_deep_scrub":"59'2790","last_deep_scrub_stamp":"2023-09-30T17:05:47.554500+0000","last_clean_scrub_stamp":"2023-09-30T17:05:47.554500+0000","objects_scrubbed":0,"log_size":2790,"log_dups_size":0,"ondisk_log_size":2790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:40:37.069833+0000","scrub_duration":0.0021350679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8214,"num_write_kb":38924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"59'4","reported_seq":82,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:39.661816+0000","last_change":"2023-09-30T17:05:39.661898+0000","last_active":"2023-09-30T17:05:39.661816+0000","last_peered":"2023-09-30T17:05:39.661816+0000","last_clean":"2023-09-30T17:05:39.661816+0000","last_became_active":"2023-09-30T17:02:18.360372+0000","last_became_peered":"2023-09-30T17:02:18.360372+0000","last_unstale":"2023-09-30T17:05:39.661816+0000","last_undegraded":"2023-09-30T17:05:39.661816+0000","last_fullsized":"2023-09-30T17:05:39.661816+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'4","last_scrub_stamp":"2023-09-30T17:05:39.661696+0000","last_deep_scrub":"59'4","last_deep_scrub_stamp":"2023-09-30T17:05:39.661696+0000","last_clean_scrub_stamp":"2023-09-30T17:05:39.661696+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:53:12.475703+0000","scrub_duration":0.0028517759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"59'5697","reported_seq":5772,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310130+0000","last_change":"2023-09-30T17:05:06.291597+0000","last_active":"2023-09-30T17:05:26.310130+0000","last_peered":"2023-09-30T17:05:26.310130+0000","last_clean":"2023-09-30T17:05:26.310130+0000","last_became_active":"2023-09-30T17:05:06.290447+0000","last_became_peered":"2023-09-30T17:05:06.290447+0000","last_unstale":"2023-09-30T17:05:26.310130+0000","last_undegraded":"2023-09-30T17:05:26.310130+0000","last_fullsized":"2023-09-30T17:05:26.310130+0000","mapping_epoch":69,"log_start":"42'1200","ondisk_log_start":"42'1200","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4497,"log_dups_size":1200,"ondisk_log_size":4497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16590,"num_write_kb":78960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"59'10","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309543+0000","last_change":"2023-09-30T17:05:03.309996+0000","last_active":"2023-09-30T17:05:26.309543+0000","last_peered":"2023-09-30T17:05:26.309543+0000","last_clean":"2023-09-30T17:05:26.309543+0000","last_became_active":"2023-09-30T17:05:03.309326+0000","last_became_peered":"2023-09-30T17:05:03.309326+0000","last_unstale":"2023-09-30T17:05:26.309543+0000","last_undegraded":"2023-09-30T17:05:26.309543+0000","last_fullsized":"2023-09-30T17:05:26.309543+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"59'2934","reported_seq":3012,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:50.604137+0000","last_change":"2023-09-30T17:05:50.604194+0000","last_active":"2023-09-30T17:05:50.604137+0000","last_peered":"2023-09-30T17:05:50.604137+0000","last_clean":"2023-09-30T17:05:50.604137+0000","last_became_active":"2023-09-30T17:02:18.357317+0000","last_became_peered":"2023-09-30T17:02:18.357317+0000","last_unstale":"2023-09-30T17:05:50.604137+0000","last_undegraded":"2023-09-30T17:05:50.604137+0000","last_fullsized":"2023-09-30T17:05:50.604137+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2934","last_scrub_stamp":"2023-09-30T17:05:50.604022+0000","last_deep_scrub":"59'2934","last_deep_scrub_stamp":"2023-09-30T17:05:50.604022+0000","last_clean_scrub_stamp":"2023-09-30T17:05:50.604022+0000","objects_scrubbed":0,"log_size":2934,"log_dups_size":0,"ondisk_log_size":2934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:13:55.986563+0000","scrub_duration":0.00343991,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8466,"num_write_kb":40084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"59'6","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:56.578435+0000","last_change":"2023-09-30T17:05:56.578507+0000","last_active":"2023-09-30T17:05:56.578435+0000","last_peered":"2023-09-30T17:05:56.578435+0000","last_clean":"2023-09-30T17:05:56.578435+0000","last_became_active":"2023-09-30T17:05:03.310703+0000","last_became_peered":"2023-09-30T17:05:03.310703+0000","last_unstale":"2023-09-30T17:05:56.578435+0000","last_undegraded":"2023-09-30T17:05:56.578435+0000","last_fullsized":"2023-09-30T17:05:56.578435+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'6","last_scrub_stamp":"2023-09-30T17:05:56.578325+0000","last_deep_scrub":"59'6","last_deep_scrub_stamp":"2023-09-30T17:05:56.578325+0000","last_clean_scrub_stamp":"2023-09-30T17:05:56.578325+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:27:47.196956+0000","scrub_duration":0.0024309819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"59'7","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309692+0000","last_change":"2023-09-30T17:05:03.310838+0000","last_active":"2023-09-30T17:05:26.309692+0000","last_peered":"2023-09-30T17:05:26.309692+0000","last_clean":"2023-09-30T17:05:26.309692+0000","last_became_active":"2023-09-30T17:05:03.310047+0000","last_became_peered":"2023-09-30T17:05:03.310047+0000","last_unstale":"2023-09-30T17:05:26.309692+0000","last_undegraded":"2023-09-30T17:05:26.309692+0000","last_fullsized":"2023-09-30T17:05:26.309692+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"59'11423","reported_seq":11500,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309146+0000","last_change":"2023-09-30T17:05:06.286653+0000","last_active":"2023-09-30T17:05:26.309146+0000","last_peered":"2023-09-30T17:05:26.309146+0000","last_clean":"2023-09-30T17:05:26.309146+0000","last_became_active":"2023-09-30T17:05:06.285582+0000","last_became_peered":"2023-09-30T17:05:06.285582+0000","last_unstale":"2023-09-30T17:05:26.309146+0000","last_undegraded":"2023-09-30T17:05:26.309146+0000","last_fullsized":"2023-09-30T17:05:26.309146+0000","mapping_epoch":69,"log_start":"52'7200","ondisk_log_start":"52'7200","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4223,"log_dups_size":5777,"ondisk_log_size":4223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33444,"num_write_kb":158924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"59'8589","reported_seq":8659,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310331+0000","last_change":"2023-09-30T17:02:18.364222+0000","last_active":"2023-09-30T17:05:26.310331+0000","last_peered":"2023-09-30T17:05:26.310331+0000","last_clean":"2023-09-30T17:05:26.310331+0000","last_became_active":"2023-09-30T17:02:18.363485+0000","last_became_peered":"2023-09-30T17:02:18.363485+0000","last_unstale":"2023-09-30T17:05:26.310331+0000","last_undegraded":"2023-09-30T17:05:26.310331+0000","last_fullsized":"2023-09-30T17:05:26.310331+0000","mapping_epoch":17,"log_start":"49'4400","ondisk_log_start":"49'4400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4189,"log_dups_size":4400,"ondisk_log_size":4189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25052,"num_write_kb":118756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"59'8585","reported_seq":8663,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:01.724899+0000","last_change":"2023-09-30T17:06:01.724952+0000","last_active":"2023-09-30T17:06:01.724899+0000","last_peered":"2023-09-30T17:06:01.724899+0000","last_clean":"2023-09-30T17:06:01.724899+0000","last_became_active":"2023-09-30T17:02:18.358396+0000","last_became_peered":"2023-09-30T17:02:18.358396+0000","last_unstale":"2023-09-30T17:06:01.724899+0000","last_undegraded":"2023-09-30T17:06:01.724899+0000","last_fullsized":"2023-09-30T17:06:01.724899+0000","mapping_epoch":17,"log_start":"48'4100","ondisk_log_start":"48'4100","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'8585","last_scrub_stamp":"2023-09-30T17:06:01.724792+0000","last_deep_scrub":"59'8585","last_deep_scrub_stamp":"2023-09-30T17:06:01.724792+0000","last_clean_scrub_stamp":"2023-09-30T17:06:01.724792+0000","objects_scrubbed":0,"log_size":4485,"log_dups_size":4100,"ondisk_log_size":4485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:35:48.146536+0000","scrub_duration":0.0040357209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24997,"num_write_kb":162463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"59'5664","reported_seq":5749,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:46.618589+0000","last_change":"2023-09-30T17:05:46.618636+0000","last_active":"2023-09-30T17:05:46.618589+0000","last_peered":"2023-09-30T17:05:46.618589+0000","last_clean":"2023-09-30T17:05:46.618589+0000","last_became_active":"2023-09-30T17:05:06.290193+0000","last_became_peered":"2023-09-30T17:05:06.290193+0000","last_unstale":"2023-09-30T17:05:46.618589+0000","last_undegraded":"2023-09-30T17:05:46.618589+0000","last_fullsized":"2023-09-30T17:05:46.618589+0000","mapping_epoch":69,"log_start":"43'1400","ondisk_log_start":"43'1400","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'5664","last_scrub_stamp":"2023-09-30T17:05:46.618493+0000","last_deep_scrub":"59'5664","last_deep_scrub_stamp":"2023-09-30T17:05:46.618493+0000","last_clean_scrub_stamp":"2023-09-30T17:05:46.618493+0000","objects_scrubbed":0,"log_size":4264,"log_dups_size":1400,"ondisk_log_size":4264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:50:52.323251+0000","scrub_duration":0.0029415959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16442,"num_write_kb":78308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"59'2931","reported_seq":3021,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309813+0000","last_change":"2023-09-30T17:05:06.290270+0000","last_active":"2023-09-30T17:05:26.309813+0000","last_peered":"2023-09-30T17:05:26.309813+0000","last_clean":"2023-09-30T17:05:26.309813+0000","last_became_active":"2023-09-30T17:05:06.288753+0000","last_became_peered":"2023-09-30T17:05:06.288753+0000","last_unstale":"2023-09-30T17:05:26.309813+0000","last_undegraded":"2023-09-30T17:05:26.309813+0000","last_fullsized":"2023-09-30T17:05:26.309813+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2931,"log_dups_size":0,"ondisk_log_size":2931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8488,"num_write_kb":40364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"59'2860","reported_seq":2938,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:12.712346+0000","last_change":"2023-09-30T17:06:12.712399+0000","last_active":"2023-09-30T17:06:12.712346+0000","last_peered":"2023-09-30T17:06:12.712346+0000","last_clean":"2023-09-30T17:06:12.712346+0000","last_became_active":"2023-09-30T17:02:18.358534+0000","last_became_peered":"2023-09-30T17:02:18.358534+0000","last_unstale":"2023-09-30T17:06:12.712346+0000","last_undegraded":"2023-09-30T17:06:12.712346+0000","last_fullsized":"2023-09-30T17:06:12.712346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2860","last_scrub_stamp":"2023-09-30T17:06:12.712247+0000","last_deep_scrub":"59'2860","last_deep_scrub_stamp":"2023-09-30T17:06:12.712247+0000","last_clean_scrub_stamp":"2023-09-30T17:06:12.712247+0000","objects_scrubbed":0,"log_size":2860,"log_dups_size":0,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:44:33.166129+0000","scrub_duration":0.002572104,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8367,"num_write_kb":39772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"59'2911","reported_seq":2987,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:42.691805+0000","last_change":"2023-09-30T17:05:42.691905+0000","last_active":"2023-09-30T17:05:42.691805+0000","last_peered":"2023-09-30T17:05:42.691805+0000","last_clean":"2023-09-30T17:05:42.691805+0000","last_became_active":"2023-09-30T17:05:06.288360+0000","last_became_peered":"2023-09-30T17:05:06.288360+0000","last_unstale":"2023-09-30T17:05:42.691805+0000","last_undegraded":"2023-09-30T17:05:42.691805+0000","last_fullsized":"2023-09-30T17:05:42.691805+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2911","last_scrub_stamp":"2023-09-30T17:05:42.691679+0000","last_deep_scrub":"59'2911","last_deep_scrub_stamp":"2023-09-30T17:05:42.691679+0000","last_clean_scrub_stamp":"2023-09-30T17:05:42.691679+0000","objects_scrubbed":0,"log_size":2911,"log_dups_size":0,"ondisk_log_size":2911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:58:28.142176+0000","scrub_duration":0.0030980600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8419,"num_write_kb":39940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"59'2889","reported_seq":2965,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:47.659737+0000","last_change":"2023-09-30T17:05:47.659805+0000","last_active":"2023-09-30T17:05:47.659737+0000","last_peered":"2023-09-30T17:05:47.659737+0000","last_clean":"2023-09-30T17:05:47.659737+0000","last_became_active":"2023-09-30T17:05:06.285738+0000","last_became_peered":"2023-09-30T17:05:06.285738+0000","last_unstale":"2023-09-30T17:05:47.659737+0000","last_undegraded":"2023-09-30T17:05:47.659737+0000","last_fullsized":"2023-09-30T17:05:47.659737+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2889","last_scrub_stamp":"2023-09-30T17:05:47.659610+0000","last_deep_scrub":"59'2889","last_deep_scrub_stamp":"2023-09-30T17:05:47.659610+0000","last_clean_scrub_stamp":"2023-09-30T17:05:47.659610+0000","objects_scrubbed":0,"log_size":2889,"log_dups_size":0,"ondisk_log_size":2889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:55:36.031386+0000","scrub_duration":0.0023223979999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8435,"num_write_kb":39984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"59'2839","reported_seq":2907,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309323+0000","last_change":"2023-09-30T17:05:06.291173+0000","last_active":"2023-09-30T17:05:26.309323+0000","last_peered":"2023-09-30T17:05:26.309323+0000","last_clean":"2023-09-30T17:05:26.309323+0000","last_became_active":"2023-09-30T17:05:06.289872+0000","last_became_peered":"2023-09-30T17:05:06.289872+0000","last_unstale":"2023-09-30T17:05:26.309323+0000","last_undegraded":"2023-09-30T17:05:26.309323+0000","last_fullsized":"2023-09-30T17:05:26.309323+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2839,"log_dups_size":0,"ondisk_log_size":2839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8166,"num_write_kb":38928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"59'2802","reported_seq":2872,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310426+0000","last_change":"2023-09-30T17:02:18.364360+0000","last_active":"2023-09-30T17:05:26.310426+0000","last_peered":"2023-09-30T17:05:26.310426+0000","last_clean":"2023-09-30T17:05:26.310426+0000","last_became_active":"2023-09-30T17:02:18.363697+0000","last_became_peered":"2023-09-30T17:02:18.363697+0000","last_unstale":"2023-09-30T17:05:26.310426+0000","last_undegraded":"2023-09-30T17:05:26.310426+0000","last_fullsized":"2023-09-30T17:05:26.310426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2802,"log_dups_size":0,"ondisk_log_size":2802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8256,"num_write_kb":39208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"59'2860","reported_seq":2938,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:57.725965+0000","last_change":"2023-09-30T17:05:57.726023+0000","last_active":"2023-09-30T17:05:57.725965+0000","last_peered":"2023-09-30T17:05:57.725965+0000","last_clean":"2023-09-30T17:05:57.725965+0000","last_became_active":"2023-09-30T17:02:18.357184+0000","last_became_peered":"2023-09-30T17:02:18.357184+0000","last_unstale":"2023-09-30T17:05:57.725965+0000","last_undegraded":"2023-09-30T17:05:57.725965+0000","last_fullsized":"2023-09-30T17:05:57.725965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2860","last_scrub_stamp":"2023-09-30T17:05:57.725852+0000","last_deep_scrub":"59'2860","last_deep_scrub_stamp":"2023-09-30T17:05:57.725852+0000","last_clean_scrub_stamp":"2023-09-30T17:05:57.725852+0000","objects_scrubbed":0,"log_size":2860,"log_dups_size":0,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:28:04.823179+0000","scrub_duration":0.003284379,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8368,"num_write_kb":39616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"59'5686","reported_seq":5756,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310073+0000","last_change":"2023-09-30T17:02:18.363956+0000","last_active":"2023-09-30T17:05:26.310073+0000","last_peered":"2023-09-30T17:05:26.310073+0000","last_clean":"2023-09-30T17:05:26.310073+0000","last_became_active":"2023-09-30T17:02:18.363654+0000","last_became_peered":"2023-09-30T17:02:18.363654+0000","last_unstale":"2023-09-30T17:05:26.310073+0000","last_undegraded":"2023-09-30T17:05:26.310073+0000","last_fullsized":"2023-09-30T17:05:26.310073+0000","mapping_epoch":17,"log_start":"44'1500","ondisk_log_start":"44'1500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4186,"log_dups_size":1500,"ondisk_log_size":4186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16649,"num_write_kb":78956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"59'5799","reported_seq":5877,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309847+0000","last_change":"2023-09-30T17:05:06.290994+0000","last_active":"2023-09-30T17:05:26.309847+0000","last_peered":"2023-09-30T17:05:26.309847+0000","last_clean":"2023-09-30T17:05:26.309847+0000","last_became_active":"2023-09-30T17:05:06.289817+0000","last_became_peered":"2023-09-30T17:05:06.289817+0000","last_unstale":"2023-09-30T17:05:26.309847+0000","last_undegraded":"2023-09-30T17:05:26.309847+0000","last_fullsized":"2023-09-30T17:05:26.309847+0000","mapping_epoch":69,"log_start":"44'1600","ondisk_log_start":"44'1600","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4199,"log_dups_size":1600,"ondisk_log_size":4199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16903,"num_write_kb":80184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"59'12","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309741+0000","last_change":"2023-09-30T17:05:03.310298+0000","last_active":"2023-09-30T17:05:26.309741+0000","last_peered":"2023-09-30T17:05:26.309741+0000","last_clean":"2023-09-30T17:05:26.309741+0000","last_became_active":"2023-09-30T17:05:03.309537+0000","last_became_peered":"2023-09-30T17:05:03.309537+0000","last_unstale":"2023-09-30T17:05:26.309741+0000","last_undegraded":"2023-09-30T17:05:26.309741+0000","last_fullsized":"2023-09-30T17:05:26.309741+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"59'2879","reported_seq":2969,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309711+0000","last_change":"2023-09-30T17:05:06.292705+0000","last_active":"2023-09-30T17:05:26.309711+0000","last_peered":"2023-09-30T17:05:26.309711+0000","last_clean":"2023-09-30T17:05:26.309711+0000","last_became_active":"2023-09-30T17:05:06.290797+0000","last_became_peered":"2023-09-30T17:05:06.290797+0000","last_unstale":"2023-09-30T17:05:26.309711+0000","last_undegraded":"2023-09-30T17:05:26.309711+0000","last_fullsized":"2023-09-30T17:05:26.309711+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2879,"log_dups_size":0,"ondisk_log_size":2879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8343,"num_write_kb":39768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"59'2809","reported_seq":2899,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309858+0000","last_change":"2023-09-30T17:05:06.290594+0000","last_active":"2023-09-30T17:05:26.309858+0000","last_peered":"2023-09-30T17:05:26.309858+0000","last_clean":"2023-09-30T17:05:26.309858+0000","last_became_active":"2023-09-30T17:05:06.288837+0000","last_became_peered":"2023-09-30T17:05:06.288837+0000","last_unstale":"2023-09-30T17:05:26.309858+0000","last_undegraded":"2023-09-30T17:05:26.309858+0000","last_fullsized":"2023-09-30T17:05:26.309858+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2809,"log_dups_size":0,"ondisk_log_size":2809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8281,"num_write_kb":39472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"59'5585","reported_seq":5663,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:11.715827+0000","last_change":"2023-09-30T17:06:11.715889+0000","last_active":"2023-09-30T17:06:11.715827+0000","last_peered":"2023-09-30T17:06:11.715827+0000","last_clean":"2023-09-30T17:06:11.715827+0000","last_became_active":"2023-09-30T17:02:18.353632+0000","last_became_peered":"2023-09-30T17:02:18.353632+0000","last_unstale":"2023-09-30T17:06:11.715827+0000","last_undegraded":"2023-09-30T17:06:11.715827+0000","last_fullsized":"2023-09-30T17:06:11.715827+0000","mapping_epoch":17,"log_start":"42'1100","ondisk_log_start":"42'1100","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'5585","last_scrub_stamp":"2023-09-30T17:06:11.715704+0000","last_deep_scrub":"59'5585","last_deep_scrub_stamp":"2023-09-30T17:06:11.715704+0000","last_clean_scrub_stamp":"2023-09-30T17:06:11.715704+0000","objects_scrubbed":0,"log_size":4485,"log_dups_size":1100,"ondisk_log_size":4485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:47:36.619172+0000","scrub_duration":0.003196726,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16523,"num_write_kb":78256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"59'2888","reported_seq":2978,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310634+0000","last_change":"2023-09-30T17:05:06.292945+0000","last_active":"2023-09-30T17:05:26.310634+0000","last_peered":"2023-09-30T17:05:26.310634+0000","last_clean":"2023-09-30T17:05:26.310634+0000","last_became_active":"2023-09-30T17:05:06.291346+0000","last_became_peered":"2023-09-30T17:05:06.291346+0000","last_unstale":"2023-09-30T17:05:26.310634+0000","last_undegraded":"2023-09-30T17:05:26.310634+0000","last_fullsized":"2023-09-30T17:05:26.310634+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2888,"log_dups_size":0,"ondisk_log_size":2888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8371,"num_write_kb":39716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"59'18","reported_seq":107,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:41.585552+0000","last_change":"2023-09-30T17:05:41.585602+0000","last_active":"2023-09-30T17:05:41.585552+0000","last_peered":"2023-09-30T17:05:41.585552+0000","last_clean":"2023-09-30T17:05:41.585552+0000","last_became_active":"2023-09-30T17:05:03.308884+0000","last_became_peered":"2023-09-30T17:05:03.308884+0000","last_unstale":"2023-09-30T17:05:41.585552+0000","last_undegraded":"2023-09-30T17:05:41.585552+0000","last_fullsized":"2023-09-30T17:05:41.585552+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'18","last_scrub_stamp":"2023-09-30T17:05:41.585439+0000","last_deep_scrub":"59'18","last_deep_scrub_stamp":"2023-09-30T17:05:41.585439+0000","last_clean_scrub_stamp":"2023-09-30T17:05:41.585439+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:29:52.984290+0000","scrub_duration":0.0024239769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"59'2855","reported_seq":2924,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309973+0000","last_change":"2023-09-30T17:05:06.291369+0000","last_active":"2023-09-30T17:05:26.309973+0000","last_peered":"2023-09-30T17:05:26.309973+0000","last_clean":"2023-09-30T17:05:26.309973+0000","last_became_active":"2023-09-30T17:05:06.289447+0000","last_became_peered":"2023-09-30T17:05:06.289447+0000","last_unstale":"2023-09-30T17:05:26.309973+0000","last_undegraded":"2023-09-30T17:05:26.309973+0000","last_fullsized":"2023-09-30T17:05:26.309973+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2855,"log_dups_size":0,"ondisk_log_size":2855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8347,"num_write_kb":39608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":72,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309645+0000","last_change":"2023-09-30T17:02:17.358258+0000","last_active":"2023-09-30T17:05:26.309645+0000","last_peered":"2023-09-30T17:05:26.309645+0000","last_clean":"2023-09-30T17:05:26.309645+0000","last_became_active":"2023-09-30T17:02:17.357890+0000","last_became_peered":"2023-09-30T17:02:17.357890+0000","last_unstale":"2023-09-30T17:05:26.309645+0000","last_undegraded":"2023-09-30T17:05:26.309645+0000","last_fullsized":"2023-09-30T17:05:26.309645+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"59'17","reported_seq":106,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:45.592687+0000","last_change":"2023-09-30T17:05:45.592781+0000","last_active":"2023-09-30T17:05:45.592687+0000","last_peered":"2023-09-30T17:05:45.592687+0000","last_clean":"2023-09-30T17:05:45.592687+0000","last_became_active":"2023-09-30T17:05:03.307012+0000","last_became_peered":"2023-09-30T17:05:03.307012+0000","last_unstale":"2023-09-30T17:05:45.592687+0000","last_undegraded":"2023-09-30T17:05:45.592687+0000","last_fullsized":"2023-09-30T17:05:45.592687+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'17","last_scrub_stamp":"2023-09-30T17:05:45.592562+0000","last_deep_scrub":"59'17","last_deep_scrub_stamp":"2023-09-30T17:05:45.592562+0000","last_clean_scrub_stamp":"2023-09-30T17:05:45.592562+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:53:58.476399+0000","scrub_duration":0.0024751999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":82,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309698+0000","last_change":"2023-09-30T17:05:03.309164+0000","last_active":"2023-09-30T17:05:26.309698+0000","last_peered":"2023-09-30T17:05:26.309698+0000","last_clean":"2023-09-30T17:05:26.309698+0000","last_became_active":"2023-09-30T17:05:03.308073+0000","last_became_peered":"2023-09-30T17:05:03.308073+0000","last_unstale":"2023-09-30T17:05:26.309698+0000","last_undegraded":"2023-09-30T17:05:26.309698+0000","last_fullsized":"2023-09-30T17:05:26.309698+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"59'6","reported_seq":87,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310318+0000","last_change":"2023-09-30T17:05:03.308692+0000","last_active":"2023-09-30T17:05:26.310318+0000","last_peered":"2023-09-30T17:05:26.310318+0000","last_clean":"2023-09-30T17:05:26.310318+0000","last_became_active":"2023-09-30T17:05:03.307932+0000","last_became_peered":"2023-09-30T17:05:03.307932+0000","last_unstale":"2023-09-30T17:05:26.310318+0000","last_undegraded":"2023-09-30T17:05:26.310318+0000","last_fullsized":"2023-09-30T17:05:26.310318+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":79,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:00.631465+0000","last_change":"2023-09-30T17:06:00.631555+0000","last_active":"2023-09-30T17:06:00.631465+0000","last_peered":"2023-09-30T17:06:00.631465+0000","last_clean":"2023-09-30T17:06:00.631465+0000","last_became_active":"2023-09-30T17:02:17.360601+0000","last_became_peered":"2023-09-30T17:02:17.360601+0000","last_unstale":"2023-09-30T17:06:00.631465+0000","last_undegraded":"2023-09-30T17:06:00.631465+0000","last_fullsized":"2023-09-30T17:06:00.631465+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:06:00.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:06:00.631354+0000","last_clean_scrub_stamp":"2023-09-30T17:06:00.631354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:20:04.136405+0000","scrub_duration":0.0021158409999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"59'7","reported_seq":88,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310655+0000","last_change":"2023-09-30T17:05:03.305898+0000","last_active":"2023-09-30T17:05:26.310655+0000","last_peered":"2023-09-30T17:05:26.310655+0000","last_clean":"2023-09-30T17:05:26.310655+0000","last_became_active":"2023-09-30T17:05:03.305520+0000","last_became_peered":"2023-09-30T17:05:03.305520+0000","last_unstale":"2023-09-30T17:05:26.310655+0000","last_undegraded":"2023-09-30T17:05:26.310655+0000","last_fullsized":"2023-09-30T17:05:26.310655+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"58'1","reported_seq":83,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310551+0000","last_change":"2023-09-30T17:05:03.309303+0000","last_active":"2023-09-30T17:05:26.310551+0000","last_peered":"2023-09-30T17:05:26.310551+0000","last_clean":"2023-09-30T17:05:26.310551+0000","last_became_active":"2023-09-30T17:05:03.308851+0000","last_became_peered":"2023-09-30T17:05:03.308851+0000","last_unstale":"2023-09-30T17:05:26.310551+0000","last_undegraded":"2023-09-30T17:05:26.310551+0000","last_fullsized":"2023-09-30T17:05:26.310551+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"59'9","reported_seq":87,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:42.629955+0000","last_change":"2023-09-30T17:05:42.630040+0000","last_active":"2023-09-30T17:05:42.629955+0000","last_peered":"2023-09-30T17:05:42.629955+0000","last_clean":"2023-09-30T17:05:42.629955+0000","last_became_active":"2023-09-30T17:02:18.358529+0000","last_became_peered":"2023-09-30T17:02:18.358529+0000","last_unstale":"2023-09-30T17:05:42.629955+0000","last_undegraded":"2023-09-30T17:05:42.629955+0000","last_fullsized":"2023-09-30T17:05:42.629955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'9","last_scrub_stamp":"2023-09-30T17:05:42.629801+0000","last_deep_scrub":"59'9","last_deep_scrub_stamp":"2023-09-30T17:05:42.629801+0000","last_clean_scrub_stamp":"2023-09-30T17:05:42.629801+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:08:35.419515+0000","scrub_duration":0.0034623800000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309773+0000","last_change":"2023-09-30T17:05:03.309409+0000","last_active":"2023-09-30T17:05:26.309773+0000","last_peered":"2023-09-30T17:05:26.309773+0000","last_clean":"2023-09-30T17:05:26.309773+0000","last_became_active":"2023-09-30T17:05:03.309023+0000","last_became_peered":"2023-09-30T17:05:03.309023+0000","last_unstale":"2023-09-30T17:05:26.309773+0000","last_undegraded":"2023-09-30T17:05:26.309773+0000","last_fullsized":"2023-09-30T17:05:26.309773+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"59'8526","reported_seq":8619,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309811+0000","last_change":"2023-09-30T17:05:06.292415+0000","last_active":"2023-09-30T17:05:26.309811+0000","last_peered":"2023-09-30T17:05:26.309811+0000","last_clean":"2023-09-30T17:05:26.309811+0000","last_became_active":"2023-09-30T17:05:06.290551+0000","last_became_peered":"2023-09-30T17:05:06.290551+0000","last_unstale":"2023-09-30T17:05:26.309811+0000","last_undegraded":"2023-09-30T17:05:26.309811+0000","last_fullsized":"2023-09-30T17:05:26.309811+0000","mapping_epoch":69,"log_start":"49'4300","ondisk_log_start":"49'4300","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4226,"log_dups_size":4300,"ondisk_log_size":4226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24873,"num_write_kb":118472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"59'7","reported_seq":94,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310205+0000","last_change":"2023-09-30T17:05:03.310987+0000","last_active":"2023-09-30T17:05:26.310205+0000","last_peered":"2023-09-30T17:05:26.310205+0000","last_clean":"2023-09-30T17:05:26.310205+0000","last_became_active":"2023-09-30T17:05:03.306646+0000","last_became_peered":"2023-09-30T17:05:03.306646+0000","last_unstale":"2023-09-30T17:05:26.310205+0000","last_undegraded":"2023-09-30T17:05:26.310205+0000","last_fullsized":"2023-09-30T17:05:26.310205+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"59'5670","reported_seq":5748,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:46.679909+0000","last_change":"2023-09-30T17:05:46.679960+0000","last_active":"2023-09-30T17:05:46.679909+0000","last_peered":"2023-09-30T17:05:46.679909+0000","last_clean":"2023-09-30T17:05:46.679909+0000","last_became_active":"2023-09-30T17:02:18.358786+0000","last_became_peered":"2023-09-30T17:02:18.358786+0000","last_unstale":"2023-09-30T17:05:46.679909+0000","last_undegraded":"2023-09-30T17:05:46.679909+0000","last_fullsized":"2023-09-30T17:05:46.679909+0000","mapping_epoch":17,"log_start":"44'1500","ondisk_log_start":"44'1500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'5670","last_scrub_stamp":"2023-09-30T17:05:46.679767+0000","last_deep_scrub":"59'5670","last_deep_scrub_stamp":"2023-09-30T17:05:46.679767+0000","last_clean_scrub_stamp":"2023-09-30T17:05:46.679767+0000","objects_scrubbed":0,"log_size":4170,"log_dups_size":1500,"ondisk_log_size":4170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:13:16.252019+0000","scrub_duration":0.0034350140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16627,"num_write_kb":79047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"60'78","reported_seq":50,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309885+0000","last_change":"2023-09-30T17:05:03.313916+0000","last_active":"2023-09-30T17:05:26.309885+0000","last_peered":"2023-09-30T17:05:26.309885+0000","last_clean":"2023-09-30T17:05:26.309885+0000","last_became_active":"2023-09-30T17:05:03.302516+0000","last_became_peered":"2023-09-30T17:05:03.302516+0000","last_unstale":"2023-09-30T17:05:26.309885+0000","last_undegraded":"2023-09-30T17:05:26.309885+0000","last_fullsized":"2023-09-30T17:05:26.309885+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227523,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":222729,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"59'5677","reported_seq":5757,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310006+0000","last_change":"2023-09-30T17:05:06.289965+0000","last_active":"2023-09-30T17:05:26.310006+0000","last_peered":"2023-09-30T17:05:26.310006+0000","last_clean":"2023-09-30T17:05:26.310006+0000","last_became_active":"2023-09-30T17:05:06.288155+0000","last_became_peered":"2023-09-30T17:05:06.288155+0000","last_unstale":"2023-09-30T17:05:26.310006+0000","last_undegraded":"2023-09-30T17:05:26.310006+0000","last_fullsized":"2023-09-30T17:05:26.310006+0000","mapping_epoch":69,"log_start":"42'1100","ondisk_log_start":"42'1100","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4577,"log_dups_size":1100,"ondisk_log_size":4577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16579,"num_write_kb":79104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309395+0000","last_change":"2023-09-30T17:05:03.310322+0000","last_active":"2023-09-30T17:05:26.309395+0000","last_peered":"2023-09-30T17:05:26.309395+0000","last_clean":"2023-09-30T17:05:26.309395+0000","last_became_active":"2023-09-30T17:05:03.309505+0000","last_became_peered":"2023-09-30T17:05:03.309505+0000","last_unstale":"2023-09-30T17:05:26.309395+0000","last_undegraded":"2023-09-30T17:05:26.309395+0000","last_fullsized":"2023-09-30T17:05:26.309395+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"59'2836","reported_seq":2906,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309999+0000","last_change":"2023-09-30T17:02:18.360019+0000","last_active":"2023-09-30T17:05:26.309999+0000","last_peered":"2023-09-30T17:05:26.309999+0000","last_clean":"2023-09-30T17:05:26.309999+0000","last_became_active":"2023-09-30T17:02:18.358364+0000","last_became_peered":"2023-09-30T17:02:18.358364+0000","last_unstale":"2023-09-30T17:05:26.309999+0000","last_undegraded":"2023-09-30T17:05:26.309999+0000","last_fullsized":"2023-09-30T17:05:26.309999+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2836,"log_dups_size":0,"ondisk_log_size":2836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8308,"num_write_kb":39456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":82,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309887+0000","last_change":"2023-09-30T17:05:03.308853+0000","last_active":"2023-09-30T17:05:26.309887+0000","last_peered":"2023-09-30T17:05:26.309887+0000","last_clean":"2023-09-30T17:05:26.309887+0000","last_became_active":"2023-09-30T17:05:03.308377+0000","last_became_peered":"2023-09-30T17:05:03.308377+0000","last_unstale":"2023-09-30T17:05:26.309887+0000","last_undegraded":"2023-09-30T17:05:26.309887+0000","last_fullsized":"2023-09-30T17:05:26.309887+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"59'2856","reported_seq":2934,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:43.659585+0000","last_change":"2023-09-30T17:05:43.659681+0000","last_active":"2023-09-30T17:05:43.659585+0000","last_peered":"2023-09-30T17:05:43.659585+0000","last_clean":"2023-09-30T17:05:43.659585+0000","last_became_active":"2023-09-30T17:02:18.361556+0000","last_became_peered":"2023-09-30T17:02:18.361556+0000","last_unstale":"2023-09-30T17:05:43.659585+0000","last_undegraded":"2023-09-30T17:05:43.659585+0000","last_fullsized":"2023-09-30T17:05:43.659585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2856","last_scrub_stamp":"2023-09-30T17:05:43.659443+0000","last_deep_scrub":"59'2856","last_deep_scrub_stamp":"2023-09-30T17:05:43.659443+0000","last_clean_scrub_stamp":"2023-09-30T17:05:43.659443+0000","objects_scrubbed":0,"log_size":2856,"log_dups_size":0,"ondisk_log_size":2856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:13:13.231695+0000","scrub_duration":0.0035525420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8321,"num_write_kb":39600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":82,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309660+0000","last_change":"2023-09-30T17:05:03.304220+0000","last_active":"2023-09-30T17:05:26.309660+0000","last_peered":"2023-09-30T17:05:26.309660+0000","last_clean":"2023-09-30T17:05:26.309660+0000","last_became_active":"2023-09-30T17:05:03.303598+0000","last_became_peered":"2023-09-30T17:05:03.303598+0000","last_unstale":"2023-09-30T17:05:26.309660+0000","last_undegraded":"2023-09-30T17:05:26.309660+0000","last_fullsized":"2023-09-30T17:05:26.309660+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"59'12","reported_seq":93,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310428+0000","last_change":"2023-09-30T17:05:03.313214+0000","last_active":"2023-09-30T17:05:26.310428+0000","last_peered":"2023-09-30T17:05:26.310428+0000","last_clean":"2023-09-30T17:05:26.310428+0000","last_became_active":"2023-09-30T17:05:03.312888+0000","last_became_peered":"2023-09-30T17:05:03.312888+0000","last_unstale":"2023-09-30T17:05:26.310428+0000","last_undegraded":"2023-09-30T17:05:26.310428+0000","last_fullsized":"2023-09-30T17:05:26.310428+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"76'13","reported_seq":48,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:52.618203+0000","last_change":"2023-09-30T17:05:52.618265+0000","last_active":"2023-09-30T17:05:52.618203+0000","last_peered":"2023-09-30T17:05:52.618203+0000","last_clean":"2023-09-30T17:05:52.618203+0000","last_became_active":"2023-09-30T17:05:03.304030+0000","last_became_peered":"2023-09-30T17:05:03.304030+0000","last_unstale":"2023-09-30T17:05:52.618203+0000","last_undegraded":"2023-09-30T17:05:52.618203+0000","last_fullsized":"2023-09-30T17:05:52.618203+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'13","last_scrub_stamp":"2023-09-30T17:05:52.618079+0000","last_deep_scrub":"76'13","last_deep_scrub_stamp":"2023-09-30T17:05:52.618079+0000","last_clean_scrub_stamp":"2023-09-30T17:05:52.618079+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:02:35.473886+0000","scrub_duration":0.0072773029999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"59'2892","reported_seq":2982,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310624+0000","last_change":"2023-09-30T17:05:06.290230+0000","last_active":"2023-09-30T17:05:26.310624+0000","last_peered":"2023-09-30T17:05:26.310624+0000","last_clean":"2023-09-30T17:05:26.310624+0000","last_became_active":"2023-09-30T17:05:06.288725+0000","last_became_peered":"2023-09-30T17:05:06.288725+0000","last_unstale":"2023-09-30T17:05:26.310624+0000","last_undegraded":"2023-09-30T17:05:26.310624+0000","last_fullsized":"2023-09-30T17:05:26.310624+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2892,"log_dups_size":0,"ondisk_log_size":2892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8345,"num_write_kb":39712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"76'2","reported_seq":42,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:59.595711+0000","last_change":"2023-09-30T17:05:59.595763+0000","last_active":"2023-09-30T17:05:59.595711+0000","last_peered":"2023-09-30T17:05:59.595711+0000","last_clean":"2023-09-30T17:05:59.595711+0000","last_became_active":"2023-09-30T17:05:03.303179+0000","last_became_peered":"2023-09-30T17:05:03.303179+0000","last_unstale":"2023-09-30T17:05:59.595711+0000","last_undegraded":"2023-09-30T17:05:59.595711+0000","last_fullsized":"2023-09-30T17:05:59.595711+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2023-09-30T17:05:59.595592+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2023-09-30T17:05:59.595592+0000","last_clean_scrub_stamp":"2023-09-30T17:05:59.595592+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:47:24.049768+0000","scrub_duration":0.0041402670000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"59'2861","reported_seq":2951,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309316+0000","last_change":"2023-09-30T17:05:06.290324+0000","last_active":"2023-09-30T17:05:26.309316+0000","last_peered":"2023-09-30T17:05:26.309316+0000","last_clean":"2023-09-30T17:05:26.309316+0000","last_became_active":"2023-09-30T17:05:06.288824+0000","last_became_peered":"2023-09-30T17:05:06.288824+0000","last_unstale":"2023-09-30T17:05:26.309316+0000","last_undegraded":"2023-09-30T17:05:26.309316+0000","last_fullsized":"2023-09-30T17:05:26.309316+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2861,"log_dups_size":0,"ondisk_log_size":2861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8384,"num_write_kb":39788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"76'3","reported_seq":93,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:13.758982+0000","last_change":"2023-09-30T17:06:13.759033+0000","last_active":"2023-09-30T17:06:13.758982+0000","last_peered":"2023-09-30T17:06:13.758982+0000","last_clean":"2023-09-30T17:06:13.758982+0000","last_became_active":"2023-09-30T17:05:03.303874+0000","last_became_peered":"2023-09-30T17:05:03.303874+0000","last_unstale":"2023-09-30T17:06:13.758982+0000","last_undegraded":"2023-09-30T17:06:13.758982+0000","last_fullsized":"2023-09-30T17:06:13.758982+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'3","last_scrub_stamp":"2023-09-30T17:06:13.758880+0000","last_deep_scrub":"76'3","last_deep_scrub_stamp":"2023-09-30T17:06:13.758880+0000","last_clean_scrub_stamp":"2023-09-30T17:06:13.758880+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:16:16.319469+0000","scrub_duration":0.0031993410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"59'2","reported_seq":80,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:03.649303+0000","last_change":"2023-09-30T17:06:03.649354+0000","last_active":"2023-09-30T17:06:03.649303+0000","last_peered":"2023-09-30T17:06:03.649303+0000","last_clean":"2023-09-30T17:06:03.649303+0000","last_became_active":"2023-09-30T17:02:18.356825+0000","last_became_peered":"2023-09-30T17:02:18.356825+0000","last_unstale":"2023-09-30T17:06:03.649303+0000","last_undegraded":"2023-09-30T17:06:03.649303+0000","last_fullsized":"2023-09-30T17:06:03.649303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2023-09-30T17:06:03.649193+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2023-09-30T17:06:03.649193+0000","last_clean_scrub_stamp":"2023-09-30T17:06:03.649193+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:38:42.860650+0000","scrub_duration":0.0029770759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309689+0000","last_change":"2023-09-30T17:05:03.305087+0000","last_active":"2023-09-30T17:05:26.309689+0000","last_peered":"2023-09-30T17:05:26.309689+0000","last_clean":"2023-09-30T17:05:26.309689+0000","last_became_active":"2023-09-30T17:05:03.304463+0000","last_became_peered":"2023-09-30T17:05:03.304463+0000","last_unstale":"2023-09-30T17:05:26.309689+0000","last_undegraded":"2023-09-30T17:05:26.309689+0000","last_fullsized":"2023-09-30T17:05:26.309689+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"59'2835","reported_seq":2904,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309472+0000","last_change":"2023-09-30T17:05:06.289598+0000","last_active":"2023-09-30T17:05:26.309472+0000","last_peered":"2023-09-30T17:05:26.309472+0000","last_clean":"2023-09-30T17:05:26.309472+0000","last_became_active":"2023-09-30T17:05:06.288712+0000","last_became_peered":"2023-09-30T17:05:06.288712+0000","last_unstale":"2023-09-30T17:05:26.309472+0000","last_undegraded":"2023-09-30T17:05:26.309472+0000","last_fullsized":"2023-09-30T17:05:26.309472+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2835,"log_dups_size":0,"ondisk_log_size":2835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8288,"num_write_kb":39388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:55.610514+0000","last_change":"2023-09-30T17:05:55.610603+0000","last_active":"2023-09-30T17:05:55.610514+0000","last_peered":"2023-09-30T17:05:55.610514+0000","last_clean":"2023-09-30T17:05:55.610514+0000","last_became_active":"2023-09-30T17:05:03.310836+0000","last_became_peered":"2023-09-30T17:05:03.310836+0000","last_unstale":"2023-09-30T17:05:55.610514+0000","last_undegraded":"2023-09-30T17:05:55.610514+0000","last_fullsized":"2023-09-30T17:05:55.610514+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:05:55.610405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:05:55.610405+0000","last_clean_scrub_stamp":"2023-09-30T17:05:55.610405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:09:49.583774+0000","scrub_duration":0.0018973,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"59'8","reported_seq":97,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:11.512080+0000","last_change":"2023-09-30T17:06:11.512164+0000","last_active":"2023-09-30T17:06:11.512080+0000","last_peered":"2023-09-30T17:06:11.512080+0000","last_clean":"2023-09-30T17:06:11.512080+0000","last_became_active":"2023-09-30T17:05:03.308214+0000","last_became_peered":"2023-09-30T17:05:03.308214+0000","last_unstale":"2023-09-30T17:06:11.512080+0000","last_undegraded":"2023-09-30T17:06:11.512080+0000","last_fullsized":"2023-09-30T17:06:11.512080+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'8","last_scrub_stamp":"2023-09-30T17:06:11.511974+0000","last_deep_scrub":"59'8","last_deep_scrub_stamp":"2023-09-30T17:06:11.511974+0000","last_clean_scrub_stamp":"2023-09-30T17:06:11.511974+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:52:30.008131+0000","scrub_duration":0.0023012480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"58'3","reported_seq":86,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309993+0000","last_change":"2023-09-30T17:05:03.308944+0000","last_active":"2023-09-30T17:05:26.309993+0000","last_peered":"2023-09-30T17:05:26.309993+0000","last_clean":"2023-09-30T17:05:26.309993+0000","last_became_active":"2023-09-30T17:05:03.308483+0000","last_became_peered":"2023-09-30T17:05:03.308483+0000","last_unstale":"2023-09-30T17:05:26.309993+0000","last_undegraded":"2023-09-30T17:05:26.309993+0000","last_fullsized":"2023-09-30T17:05:26.309993+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"59'2846","reported_seq":2922,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:45.632483+0000","last_change":"2023-09-30T17:05:45.632563+0000","last_active":"2023-09-30T17:05:45.632483+0000","last_peered":"2023-09-30T17:05:45.632483+0000","last_clean":"2023-09-30T17:05:45.632483+0000","last_became_active":"2023-09-30T17:05:06.289225+0000","last_became_peered":"2023-09-30T17:05:06.289225+0000","last_unstale":"2023-09-30T17:05:45.632483+0000","last_undegraded":"2023-09-30T17:05:45.632483+0000","last_fullsized":"2023-09-30T17:05:45.632483+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2846","last_scrub_stamp":"2023-09-30T17:05:45.632358+0000","last_deep_scrub":"59'2846","last_deep_scrub_stamp":"2023-09-30T17:05:45.632358+0000","last_clean_scrub_stamp":"2023-09-30T17:05:45.632358+0000","objects_scrubbed":0,"log_size":2846,"log_dups_size":0,"ondisk_log_size":2846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:03:33.607467+0000","scrub_duration":0.0029322739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8199,"num_write_kb":39160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309240+0000","last_change":"2023-09-30T17:05:03.309689+0000","last_active":"2023-09-30T17:05:26.309240+0000","last_peered":"2023-09-30T17:05:26.309240+0000","last_clean":"2023-09-30T17:05:26.309240+0000","last_became_active":"2023-09-30T17:05:03.309318+0000","last_became_peered":"2023-09-30T17:05:03.309318+0000","last_unstale":"2023-09-30T17:05:26.309240+0000","last_undegraded":"2023-09-30T17:05:26.309240+0000","last_fullsized":"2023-09-30T17:05:26.309240+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"59'2831","reported_seq":2899,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310018+0000","last_change":"2023-09-30T17:05:06.289189+0000","last_active":"2023-09-30T17:05:26.310018+0000","last_peered":"2023-09-30T17:05:26.310018+0000","last_clean":"2023-09-30T17:05:26.310018+0000","last_became_active":"2023-09-30T17:05:06.288348+0000","last_became_peered":"2023-09-30T17:05:06.288348+0000","last_unstale":"2023-09-30T17:05:26.310018+0000","last_undegraded":"2023-09-30T17:05:26.310018+0000","last_fullsized":"2023-09-30T17:05:26.310018+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2831,"log_dups_size":0,"ondisk_log_size":2831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8336,"num_write_kb":39484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":82,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309471+0000","last_change":"2023-09-30T17:05:03.304019+0000","last_active":"2023-09-30T17:05:26.309471+0000","last_peered":"2023-09-30T17:05:26.309471+0000","last_clean":"2023-09-30T17:05:26.309471+0000","last_became_active":"2023-09-30T17:05:03.303473+0000","last_became_peered":"2023-09-30T17:05:03.303473+0000","last_unstale":"2023-09-30T17:05:26.309471+0000","last_undegraded":"2023-09-30T17:05:26.309471+0000","last_fullsized":"2023-09-30T17:05:26.309471+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"59'2884","reported_seq":2960,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:39.659504+0000","last_change":"2023-09-30T17:05:39.659591+0000","last_active":"2023-09-30T17:05:39.659504+0000","last_peered":"2023-09-30T17:05:39.659504+0000","last_clean":"2023-09-30T17:05:39.659504+0000","last_became_active":"2023-09-30T17:05:06.288169+0000","last_became_peered":"2023-09-30T17:05:06.288169+0000","last_unstale":"2023-09-30T17:05:39.659504+0000","last_undegraded":"2023-09-30T17:05:39.659504+0000","last_fullsized":"2023-09-30T17:05:39.659504+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2884","last_scrub_stamp":"2023-09-30T17:05:39.659392+0000","last_deep_scrub":"59'2884","last_deep_scrub_stamp":"2023-09-30T17:05:39.659392+0000","last_clean_scrub_stamp":"2023-09-30T17:05:39.659392+0000","objects_scrubbed":0,"log_size":2884,"log_dups_size":0,"ondisk_log_size":2884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:25:23.871113+0000","scrub_duration":0.0036873600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8366,"num_write_kb":39744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":71,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309457+0000","last_change":"2023-09-30T17:02:17.358811+0000","last_active":"2023-09-30T17:05:26.309457+0000","last_peered":"2023-09-30T17:05:26.309457+0000","last_clean":"2023-09-30T17:05:26.309457+0000","last_became_active":"2023-09-30T17:02:17.358582+0000","last_became_peered":"2023-09-30T17:02:17.358582+0000","last_unstale":"2023-09-30T17:05:26.309457+0000","last_undegraded":"2023-09-30T17:05:26.309457+0000","last_fullsized":"2023-09-30T17:05:26.309457+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"59'8580","reported_seq":8650,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310485+0000","last_change":"2023-09-30T17:02:18.364478+0000","last_active":"2023-09-30T17:05:26.310485+0000","last_peered":"2023-09-30T17:05:26.310485+0000","last_clean":"2023-09-30T17:05:26.310485+0000","last_became_active":"2023-09-30T17:02:18.364057+0000","last_became_peered":"2023-09-30T17:02:18.364057+0000","last_unstale":"2023-09-30T17:05:26.310485+0000","last_undegraded":"2023-09-30T17:05:26.310485+0000","last_fullsized":"2023-09-30T17:05:26.310485+0000","mapping_epoch":17,"log_start":"49'4400","ondisk_log_start":"49'4400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4180,"log_dups_size":4400,"ondisk_log_size":4180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25046,"num_write_kb":118972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":74,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309929+0000","last_change":"2023-09-30T17:02:12.327704+0000","last_active":"2023-09-30T17:05:26.309929+0000","last_peered":"2023-09-30T17:05:26.309929+0000","last_clean":"2023-09-30T17:05:26.309929+0000","last_became_active":"2023-09-30T17:02:12.327384+0000","last_became_peered":"2023-09-30T17:02:12.327384+0000","last_unstale":"2023-09-30T17:05:26.309929+0000","last_undegraded":"2023-09-30T17:05:26.309929+0000","last_fullsized":"2023-09-30T17:05:26.309929+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310220+0000","last_change":"2023-09-30T17:05:03.311271+0000","last_active":"2023-09-30T17:05:26.310220+0000","last_peered":"2023-09-30T17:05:26.310220+0000","last_clean":"2023-09-30T17:05:26.310220+0000","last_became_active":"2023-09-30T17:05:03.310655+0000","last_became_peered":"2023-09-30T17:05:03.310655+0000","last_unstale":"2023-09-30T17:05:26.310220+0000","last_undegraded":"2023-09-30T17:05:26.310220+0000","last_fullsized":"2023-09-30T17:05:26.310220+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"59'9","reported_seq":98,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:44.620207+0000","last_change":"2023-09-30T17:05:44.620255+0000","last_active":"2023-09-30T17:05:44.620207+0000","last_peered":"2023-09-30T17:05:44.620207+0000","last_clean":"2023-09-30T17:05:44.620207+0000","last_became_active":"2023-09-30T17:05:03.305956+0000","last_became_peered":"2023-09-30T17:05:03.305956+0000","last_unstale":"2023-09-30T17:05:44.620207+0000","last_undegraded":"2023-09-30T17:05:44.620207+0000","last_fullsized":"2023-09-30T17:05:44.620207+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'9","last_scrub_stamp":"2023-09-30T17:05:44.620091+0000","last_deep_scrub":"59'9","last_deep_scrub_stamp":"2023-09-30T17:05:44.620091+0000","last_clean_scrub_stamp":"2023-09-30T17:05:44.620091+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:48:53.055175+0000","scrub_duration":0.0028788109999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309291+0000","last_change":"2023-09-30T17:05:03.309359+0000","last_active":"2023-09-30T17:05:26.309291+0000","last_peered":"2023-09-30T17:05:26.309291+0000","last_clean":"2023-09-30T17:05:26.309291+0000","last_became_active":"2023-09-30T17:05:03.308944+0000","last_became_peered":"2023-09-30T17:05:03.308944+0000","last_unstale":"2023-09-30T17:05:26.309291+0000","last_undegraded":"2023-09-30T17:05:26.309291+0000","last_fullsized":"2023-09-30T17:05:26.309291+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:48.694200+0000","last_change":"2023-09-30T17:05:48.694245+0000","last_active":"2023-09-30T17:05:48.694200+0000","last_peered":"2023-09-30T17:05:48.694200+0000","last_clean":"2023-09-30T17:05:48.694200+0000","last_became_active":"2023-09-30T17:05:03.310706+0000","last_became_peered":"2023-09-30T17:05:03.310706+0000","last_unstale":"2023-09-30T17:05:48.694200+0000","last_undegraded":"2023-09-30T17:05:48.694200+0000","last_fullsized":"2023-09-30T17:05:48.694200+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:05:48.694106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:05:48.694106+0000","last_clean_scrub_stamp":"2023-09-30T17:05:48.694106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:45:19.266879+0000","scrub_duration":0.0018395079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"59'9","reported_seq":87,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:06.575908+0000","last_change":"2023-09-30T17:06:06.575982+0000","last_active":"2023-09-30T17:06:06.575908+0000","last_peered":"2023-09-30T17:06:06.575908+0000","last_clean":"2023-09-30T17:06:06.575908+0000","last_became_active":"2023-09-30T17:02:18.363064+0000","last_became_peered":"2023-09-30T17:02:18.363064+0000","last_unstale":"2023-09-30T17:06:06.575908+0000","last_undegraded":"2023-09-30T17:06:06.575908+0000","last_fullsized":"2023-09-30T17:06:06.575908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'9","last_scrub_stamp":"2023-09-30T17:06:06.575750+0000","last_deep_scrub":"59'9","last_deep_scrub_stamp":"2023-09-30T17:06:06.575750+0000","last_clean_scrub_stamp":"2023-09-30T17:06:06.575750+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:58:24.806188+0000","scrub_duration":0.0029458370000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":74,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309584+0000","last_change":"2023-09-30T17:02:12.327834+0000","last_active":"2023-09-30T17:05:26.309584+0000","last_peered":"2023-09-30T17:05:26.309584+0000","last_clean":"2023-09-30T17:05:26.309584+0000","last_became_active":"2023-09-30T17:02:12.327542+0000","last_became_peered":"2023-09-30T17:02:12.327542+0000","last_unstale":"2023-09-30T17:05:26.309584+0000","last_undegraded":"2023-09-30T17:05:26.309584+0000","last_fullsized":"2023-09-30T17:05:26.309584+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":82,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309448+0000","last_change":"2023-09-30T17:05:03.305668+0000","last_active":"2023-09-30T17:05:26.309448+0000","last_peered":"2023-09-30T17:05:26.309448+0000","last_clean":"2023-09-30T17:05:26.309448+0000","last_became_active":"2023-09-30T17:05:03.305222+0000","last_became_peered":"2023-09-30T17:05:03.305222+0000","last_unstale":"2023-09-30T17:05:26.309448+0000","last_undegraded":"2023-09-30T17:05:26.309448+0000","last_fullsized":"2023-09-30T17:05:26.309448+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"59'6","reported_seq":76,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310623+0000","last_change":"2023-09-30T17:02:18.364406+0000","last_active":"2023-09-30T17:05:26.310623+0000","last_peered":"2023-09-30T17:05:26.310623+0000","last_clean":"2023-09-30T17:05:26.310623+0000","last_became_active":"2023-09-30T17:02:18.363849+0000","last_became_peered":"2023-09-30T17:02:18.363849+0000","last_unstale":"2023-09-30T17:05:26.310623+0000","last_undegraded":"2023-09-30T17:05:26.310623+0000","last_fullsized":"2023-09-30T17:05:26.310623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309380+0000","last_change":"2023-09-30T17:05:03.310062+0000","last_active":"2023-09-30T17:05:26.309380+0000","last_peered":"2023-09-30T17:05:26.309380+0000","last_clean":"2023-09-30T17:05:26.309380+0000","last_became_active":"2023-09-30T17:05:03.308958+0000","last_became_peered":"2023-09-30T17:05:03.308958+0000","last_unstale":"2023-09-30T17:05:26.309380+0000","last_undegraded":"2023-09-30T17:05:26.309380+0000","last_fullsized":"2023-09-30T17:05:26.309380+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"76'159","reported_seq":236,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:09.514948+0000","last_change":"2023-09-30T17:06:09.515009+0000","last_active":"2023-09-30T17:06:09.514948+0000","last_peered":"2023-09-30T17:06:09.514948+0000","last_clean":"2023-09-30T17:06:09.514948+0000","last_became_active":"2023-09-30T17:05:03.302265+0000","last_became_peered":"2023-09-30T17:05:03.302265+0000","last_unstale":"2023-09-30T17:06:09.514948+0000","last_undegraded":"2023-09-30T17:06:09.514948+0000","last_fullsized":"2023-09-30T17:06:09.514948+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'159","last_scrub_stamp":"2023-09-30T17:06:09.514837+0000","last_deep_scrub":"76'159","last_deep_scrub_stamp":"2023-09-30T17:06:09.514837+0000","last_clean_scrub_stamp":"2023-09-30T17:06:09.514837+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:46:01.059195+0000","scrub_duration":0.0055217590000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":71,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309610+0000","last_change":"2023-09-30T17:02:17.357139+0000","last_active":"2023-09-30T17:05:26.309610+0000","last_peered":"2023-09-30T17:05:26.309610+0000","last_clean":"2023-09-30T17:05:26.309610+0000","last_became_active":"2023-09-30T17:02:17.356901+0000","last_became_peered":"2023-09-30T17:02:17.356901+0000","last_unstale":"2023-09-30T17:05:26.309610+0000","last_undegraded":"2023-09-30T17:05:26.309610+0000","last_fullsized":"2023-09-30T17:05:26.309610+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"59'7","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:53.612754+0000","last_change":"2023-09-30T17:05:53.612809+0000","last_active":"2023-09-30T17:05:53.612754+0000","last_peered":"2023-09-30T17:05:53.612754+0000","last_clean":"2023-09-30T17:05:53.612754+0000","last_became_active":"2023-09-30T17:05:03.304974+0000","last_became_peered":"2023-09-30T17:05:03.304974+0000","last_unstale":"2023-09-30T17:05:53.612754+0000","last_undegraded":"2023-09-30T17:05:53.612754+0000","last_fullsized":"2023-09-30T17:05:53.612754+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'7","last_scrub_stamp":"2023-09-30T17:05:53.612654+0000","last_deep_scrub":"59'7","last_deep_scrub_stamp":"2023-09-30T17:05:53.612654+0000","last_clean_scrub_stamp":"2023-09-30T17:05:53.612654+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:04:16.815158+0000","scrub_duration":0.00223011,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:49.646389+0000","last_change":"2023-09-30T17:05:49.646435+0000","last_active":"2023-09-30T17:05:49.646389+0000","last_peered":"2023-09-30T17:05:49.646389+0000","last_clean":"2023-09-30T17:05:49.646389+0000","last_became_active":"2023-09-30T17:05:03.302590+0000","last_became_peered":"2023-09-30T17:05:03.302590+0000","last_unstale":"2023-09-30T17:05:49.646389+0000","last_undegraded":"2023-09-30T17:05:49.646389+0000","last_fullsized":"2023-09-30T17:05:49.646389+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:05:49.646266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:05:49.646266+0000","last_clean_scrub_stamp":"2023-09-30T17:05:49.646266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:45:23.943931+0000","scrub_duration":0.002091379,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"59'5","reported_seq":95,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309444+0000","last_change":"2023-09-30T17:05:03.318439+0000","last_active":"2023-09-30T17:05:26.309444+0000","last_peered":"2023-09-30T17:05:26.309444+0000","last_clean":"2023-09-30T17:05:26.309444+0000","last_became_active":"2023-09-30T17:05:03.308059+0000","last_became_peered":"2023-09-30T17:05:03.308059+0000","last_unstale":"2023-09-30T17:05:26.309444+0000","last_undegraded":"2023-09-30T17:05:26.309444+0000","last_fullsized":"2023-09-30T17:05:26.309444+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"59'11252","reported_seq":11330,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:53.639404+0000","last_change":"2023-09-30T17:05:53.639457+0000","last_active":"2023-09-30T17:05:53.639404+0000","last_peered":"2023-09-30T17:05:53.639404+0000","last_clean":"2023-09-30T17:05:53.639404+0000","last_became_active":"2023-09-30T17:02:18.356839+0000","last_became_peered":"2023-09-30T17:02:18.356839+0000","last_unstale":"2023-09-30T17:05:53.639404+0000","last_undegraded":"2023-09-30T17:05:53.639404+0000","last_fullsized":"2023-09-30T17:05:53.639404+0000","mapping_epoch":17,"log_start":"51'6700","ondisk_log_start":"51'6700","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'11252","last_scrub_stamp":"2023-09-30T17:05:53.639286+0000","last_deep_scrub":"59'11252","last_deep_scrub_stamp":"2023-09-30T17:05:53.639286+0000","last_clean_scrub_stamp":"2023-09-30T17:05:53.639286+0000","objects_scrubbed":0,"log_size":4552,"log_dups_size":6700,"ondisk_log_size":4552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:50:12.670739+0000","scrub_duration":0.00330314,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33068,"num_write_kb":157144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":74,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310292+0000","last_change":"2023-09-30T17:02:12.330472+0000","last_active":"2023-09-30T17:05:26.310292+0000","last_peered":"2023-09-30T17:05:26.310292+0000","last_clean":"2023-09-30T17:05:26.310292+0000","last_became_active":"2023-09-30T17:02:12.330154+0000","last_became_peered":"2023-09-30T17:02:12.330154+0000","last_unstale":"2023-09-30T17:05:26.310292+0000","last_undegraded":"2023-09-30T17:05:26.310292+0000","last_fullsized":"2023-09-30T17:05:26.310292+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":71,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310151+0000","last_change":"2023-09-30T17:02:17.361007+0000","last_active":"2023-09-30T17:05:26.310151+0000","last_peered":"2023-09-30T17:05:26.310151+0000","last_clean":"2023-09-30T17:05:26.310151+0000","last_became_active":"2023-09-30T17:02:17.360721+0000","last_became_peered":"2023-09-30T17:02:17.360721+0000","last_unstale":"2023-09-30T17:05:26.310151+0000","last_undegraded":"2023-09-30T17:05:26.310151+0000","last_fullsized":"2023-09-30T17:05:26.310151+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"59'2836","reported_seq":2926,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310240+0000","last_change":"2023-09-30T17:05:06.293085+0000","last_active":"2023-09-30T17:05:26.310240+0000","last_peered":"2023-09-30T17:05:26.310240+0000","last_clean":"2023-09-30T17:05:26.310240+0000","last_became_active":"2023-09-30T17:05:06.291203+0000","last_became_peered":"2023-09-30T17:05:06.291203+0000","last_unstale":"2023-09-30T17:05:26.310240+0000","last_undegraded":"2023-09-30T17:05:26.310240+0000","last_fullsized":"2023-09-30T17:05:26.310240+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2836,"log_dups_size":0,"ondisk_log_size":2836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8199,"num_write_kb":39048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"76'4","reported_seq":83,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:05.556031+0000","last_change":"2023-09-30T17:06:05.556135+0000","last_active":"2023-09-30T17:06:05.556031+0000","last_peered":"2023-09-30T17:06:05.556031+0000","last_clean":"2023-09-30T17:06:05.556031+0000","last_became_active":"2023-09-30T17:02:17.360494+0000","last_became_peered":"2023-09-30T17:02:17.360494+0000","last_unstale":"2023-09-30T17:06:05.556031+0000","last_undegraded":"2023-09-30T17:06:05.556031+0000","last_fullsized":"2023-09-30T17:06:05.556031+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'4","last_scrub_stamp":"2023-09-30T17:06:05.555918+0000","last_deep_scrub":"76'4","last_deep_scrub_stamp":"2023-09-30T17:06:05.555918+0000","last_clean_scrub_stamp":"2023-09-30T17:06:05.555918+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:08:01.733610+0000","scrub_duration":0.0040480749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":74,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310527+0000","last_change":"2023-09-30T17:02:12.328184+0000","last_active":"2023-09-30T17:05:26.310527+0000","last_peered":"2023-09-30T17:05:26.310527+0000","last_clean":"2023-09-30T17:05:26.310527+0000","last_became_active":"2023-09-30T17:02:12.327898+0000","last_became_peered":"2023-09-30T17:02:12.327898+0000","last_unstale":"2023-09-30T17:05:26.310527+0000","last_undegraded":"2023-09-30T17:05:26.310527+0000","last_fullsized":"2023-09-30T17:05:26.310527+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"59'8","reported_seq":97,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:43.606710+0000","last_change":"2023-09-30T17:05:43.606760+0000","last_active":"2023-09-30T17:05:43.606710+0000","last_peered":"2023-09-30T17:05:43.606710+0000","last_clean":"2023-09-30T17:05:43.606710+0000","last_became_active":"2023-09-30T17:05:03.308429+0000","last_became_peered":"2023-09-30T17:05:03.308429+0000","last_unstale":"2023-09-30T17:05:43.606710+0000","last_undegraded":"2023-09-30T17:05:43.606710+0000","last_fullsized":"2023-09-30T17:05:43.606710+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'8","last_scrub_stamp":"2023-09-30T17:05:43.606596+0000","last_deep_scrub":"59'8","last_deep_scrub_stamp":"2023-09-30T17:05:43.606596+0000","last_clean_scrub_stamp":"2023-09-30T17:05:43.606596+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:53:16.420602+0000","scrub_duration":0.0021279749999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:15.384235+0000","last_change":"2023-09-30T17:06:15.384331+0000","last_active":"2023-09-30T17:06:15.384235+0000","last_peered":"2023-09-30T17:06:15.384235+0000","last_clean":"2023-09-30T17:06:15.384235+0000","last_became_active":"2023-09-30T17:05:03.302503+0000","last_became_peered":"2023-09-30T17:05:03.302503+0000","last_unstale":"2023-09-30T17:06:15.384235+0000","last_undegraded":"2023-09-30T17:06:15.384235+0000","last_fullsized":"2023-09-30T17:06:15.384235+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:06:15.384091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:06:15.384091+0000","last_clean_scrub_stamp":"2023-09-30T17:06:15.384091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:06:42.084138+0000","scrub_duration":0.0019917400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"60'8","reported_seq":95,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310376+0000","last_change":"2023-09-30T17:05:03.314806+0000","last_active":"2023-09-30T17:05:26.310376+0000","last_peered":"2023-09-30T17:05:26.310376+0000","last_clean":"2023-09-30T17:05:26.310376+0000","last_became_active":"2023-09-30T17:05:03.308201+0000","last_became_peered":"2023-09-30T17:05:03.308201+0000","last_unstale":"2023-09-30T17:05:26.310376+0000","last_undegraded":"2023-09-30T17:05:26.310376+0000","last_fullsized":"2023-09-30T17:05:26.310376+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"59'6","reported_seq":95,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:56.694424+0000","last_change":"2023-09-30T17:05:56.694471+0000","last_active":"2023-09-30T17:05:56.694424+0000","last_peered":"2023-09-30T17:05:56.694424+0000","last_clean":"2023-09-30T17:05:56.694424+0000","last_became_active":"2023-09-30T17:05:03.304022+0000","last_became_peered":"2023-09-30T17:05:03.304022+0000","last_unstale":"2023-09-30T17:05:56.694424+0000","last_undegraded":"2023-09-30T17:05:56.694424+0000","last_fullsized":"2023-09-30T17:05:56.694424+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'6","last_scrub_stamp":"2023-09-30T17:05:56.694323+0000","last_deep_scrub":"59'6","last_deep_scrub_stamp":"2023-09-30T17:05:56.694323+0000","last_clean_scrub_stamp":"2023-09-30T17:05:56.694323+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:41:25.703485+0000","scrub_duration":0.0021932589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":83,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309956+0000","last_change":"2023-09-30T17:05:03.303927+0000","last_active":"2023-09-30T17:05:26.309956+0000","last_peered":"2023-09-30T17:05:26.309956+0000","last_clean":"2023-09-30T17:05:26.309956+0000","last_became_active":"2023-09-30T17:05:03.303487+0000","last_became_peered":"2023-09-30T17:05:03.303487+0000","last_unstale":"2023-09-30T17:05:26.309956+0000","last_undegraded":"2023-09-30T17:05:26.309956+0000","last_fullsized":"2023-09-30T17:05:26.309956+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"59'2835","reported_seq":2913,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:49.578110+0000","last_change":"2023-09-30T17:05:49.578202+0000","last_active":"2023-09-30T17:05:49.578110+0000","last_peered":"2023-09-30T17:05:49.578110+0000","last_clean":"2023-09-30T17:05:49.578110+0000","last_became_active":"2023-09-30T17:02:18.356902+0000","last_became_peered":"2023-09-30T17:02:18.356902+0000","last_unstale":"2023-09-30T17:05:49.578110+0000","last_undegraded":"2023-09-30T17:05:49.578110+0000","last_fullsized":"2023-09-30T17:05:49.578110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2835","last_scrub_stamp":"2023-09-30T17:05:49.577968+0000","last_deep_scrub":"59'2835","last_deep_scrub_stamp":"2023-09-30T17:05:49.577968+0000","last_clean_scrub_stamp":"2023-09-30T17:05:49.577968+0000","objects_scrubbed":0,"log_size":2835,"log_dups_size":0,"ondisk_log_size":2835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:05:50.365694+0000","scrub_duration":0.0031753789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8302,"num_write_kb":39500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"76'3","reported_seq":42,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:10.550007+0000","last_change":"2023-09-30T17:06:10.550090+0000","last_active":"2023-09-30T17:06:10.550007+0000","last_peered":"2023-09-30T17:06:10.550007+0000","last_clean":"2023-09-30T17:06:10.550007+0000","last_became_active":"2023-09-30T17:05:03.310996+0000","last_became_peered":"2023-09-30T17:05:03.310996+0000","last_unstale":"2023-09-30T17:06:10.550007+0000","last_undegraded":"2023-09-30T17:06:10.550007+0000","last_fullsized":"2023-09-30T17:06:10.550007+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'3","last_scrub_stamp":"2023-09-30T17:06:10.549909+0000","last_deep_scrub":"76'3","last_deep_scrub_stamp":"2023-09-30T17:06:10.549909+0000","last_clean_scrub_stamp":"2023-09-30T17:06:10.549909+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:02:48.238742+0000","scrub_duration":0.0035069649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"59'2848","reported_seq":2924,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:43.643918+0000","last_change":"2023-09-30T17:05:43.644021+0000","last_active":"2023-09-30T17:05:43.643918+0000","last_peered":"2023-09-30T17:05:43.643918+0000","last_clean":"2023-09-30T17:05:43.643918+0000","last_became_active":"2023-09-30T17:05:06.289599+0000","last_became_peered":"2023-09-30T17:05:06.289599+0000","last_unstale":"2023-09-30T17:05:43.643918+0000","last_undegraded":"2023-09-30T17:05:43.643918+0000","last_fullsized":"2023-09-30T17:05:43.643918+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2848","last_scrub_stamp":"2023-09-30T17:05:43.643754+0000","last_deep_scrub":"59'2848","last_deep_scrub_stamp":"2023-09-30T17:05:43.643754+0000","last_clean_scrub_stamp":"2023-09-30T17:05:43.643754+0000","objects_scrubbed":0,"log_size":2848,"log_dups_size":0,"ondisk_log_size":2848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:09:00.902270+0000","scrub_duration":0.0023925259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8235,"num_write_kb":39276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"58'3","reported_seq":86,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310426+0000","last_change":"2023-09-30T17:05:03.307212+0000","last_active":"2023-09-30T17:05:26.310426+0000","last_peered":"2023-09-30T17:05:26.310426+0000","last_clean":"2023-09-30T17:05:26.310426+0000","last_became_active":"2023-09-30T17:05:03.306711+0000","last_became_peered":"2023-09-30T17:05:03.306711+0000","last_unstale":"2023-09-30T17:05:26.310426+0000","last_undegraded":"2023-09-30T17:05:26.310426+0000","last_fullsized":"2023-09-30T17:05:26.310426+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"59'10","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:06.523686+0000","last_change":"2023-09-30T17:06:06.523754+0000","last_active":"2023-09-30T17:06:06.523686+0000","last_peered":"2023-09-30T17:06:06.523686+0000","last_clean":"2023-09-30T17:06:06.523686+0000","last_became_active":"2023-09-30T17:05:03.310763+0000","last_became_peered":"2023-09-30T17:05:03.310763+0000","last_unstale":"2023-09-30T17:06:06.523686+0000","last_undegraded":"2023-09-30T17:06:06.523686+0000","last_fullsized":"2023-09-30T17:06:06.523686+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'10","last_scrub_stamp":"2023-09-30T17:06:06.523566+0000","last_deep_scrub":"59'10","last_deep_scrub_stamp":"2023-09-30T17:06:06.523566+0000","last_clean_scrub_stamp":"2023-09-30T17:06:06.523566+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:48:10.092815+0000","scrub_duration":0.002623748,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":80,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:07.596383+0000","last_change":"2023-09-30T17:06:07.596434+0000","last_active":"2023-09-30T17:06:07.596383+0000","last_peered":"2023-09-30T17:06:07.596383+0000","last_clean":"2023-09-30T17:06:07.596383+0000","last_became_active":"2023-09-30T17:02:17.360475+0000","last_became_peered":"2023-09-30T17:02:17.360475+0000","last_unstale":"2023-09-30T17:06:07.596383+0000","last_undegraded":"2023-09-30T17:06:07.596383+0000","last_fullsized":"2023-09-30T17:06:07.596383+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2023-09-30T17:06:07.596283+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2023-09-30T17:06:07.596283+0000","last_clean_scrub_stamp":"2023-09-30T17:06:07.596283+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:28:14.693610+0000","scrub_duration":0.0022969660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"59'5711","reported_seq":5789,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:08.654294+0000","last_change":"2023-09-30T17:06:08.654348+0000","last_active":"2023-09-30T17:06:08.654294+0000","last_peered":"2023-09-30T17:06:08.654294+0000","last_clean":"2023-09-30T17:06:08.654294+0000","last_became_active":"2023-09-30T17:02:18.357098+0000","last_became_peered":"2023-09-30T17:02:18.357098+0000","last_unstale":"2023-09-30T17:06:08.654294+0000","last_undegraded":"2023-09-30T17:06:08.654294+0000","last_fullsized":"2023-09-30T17:06:08.654294+0000","mapping_epoch":17,"log_start":"42'1200","ondisk_log_start":"42'1200","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'5711","last_scrub_stamp":"2023-09-30T17:06:08.654151+0000","last_deep_scrub":"59'5711","last_deep_scrub_stamp":"2023-09-30T17:06:08.654151+0000","last_clean_scrub_stamp":"2023-09-30T17:06:08.654151+0000","objects_scrubbed":0,"log_size":4511,"log_dups_size":1200,"ondisk_log_size":4511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:10:37.539726+0000","scrub_duration":0.0037229939999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16681,"num_write_kb":79476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"76'6","reported_seq":96,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:55.637524+0000","last_change":"2023-09-30T17:05:55.637582+0000","last_active":"2023-09-30T17:05:55.637524+0000","last_peered":"2023-09-30T17:05:55.637524+0000","last_clean":"2023-09-30T17:05:55.637524+0000","last_became_active":"2023-09-30T17:05:03.313050+0000","last_became_peered":"2023-09-30T17:05:03.313050+0000","last_unstale":"2023-09-30T17:05:55.637524+0000","last_undegraded":"2023-09-30T17:05:55.637524+0000","last_fullsized":"2023-09-30T17:05:55.637524+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'6","last_scrub_stamp":"2023-09-30T17:05:55.637417+0000","last_deep_scrub":"76'6","last_deep_scrub_stamp":"2023-09-30T17:05:55.637417+0000","last_clean_scrub_stamp":"2023-09-30T17:05:55.637417+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:27:26.801859+0000","scrub_duration":0.006333272,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"59'2872","reported_seq":2940,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309594+0000","last_change":"2023-09-30T17:05:06.290298+0000","last_active":"2023-09-30T17:05:26.309594+0000","last_peered":"2023-09-30T17:05:26.309594+0000","last_clean":"2023-09-30T17:05:26.309594+0000","last_became_active":"2023-09-30T17:05:06.289197+0000","last_became_peered":"2023-09-30T17:05:06.289197+0000","last_unstale":"2023-09-30T17:05:26.309594+0000","last_undegraded":"2023-09-30T17:05:26.309594+0000","last_fullsized":"2023-09-30T17:05:26.309594+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2872,"log_dups_size":0,"ondisk_log_size":2872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8447,"num_write_kb":40072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"59'9","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:54.611596+0000","last_change":"2023-09-30T17:05:54.611653+0000","last_active":"2023-09-30T17:05:54.611596+0000","last_peered":"2023-09-30T17:05:54.611596+0000","last_clean":"2023-09-30T17:05:54.611596+0000","last_became_active":"2023-09-30T17:05:03.310591+0000","last_became_peered":"2023-09-30T17:05:03.310591+0000","last_unstale":"2023-09-30T17:05:54.611596+0000","last_undegraded":"2023-09-30T17:05:54.611596+0000","last_fullsized":"2023-09-30T17:05:54.611596+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'9","last_scrub_stamp":"2023-09-30T17:05:54.611494+0000","last_deep_scrub":"59'9","last_deep_scrub_stamp":"2023-09-30T17:05:54.611494+0000","last_clean_scrub_stamp":"2023-09-30T17:05:54.611494+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:03:16.862122+0000","scrub_duration":0.0022998649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"59'13","reported_seq":91,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:03.582493+0000","last_change":"2023-09-30T17:06:03.582587+0000","last_active":"2023-09-30T17:06:03.582493+0000","last_peered":"2023-09-30T17:06:03.582493+0000","last_clean":"2023-09-30T17:06:03.582493+0000","last_became_active":"2023-09-30T17:02:18.363222+0000","last_became_peered":"2023-09-30T17:02:18.363222+0000","last_unstale":"2023-09-30T17:06:03.582493+0000","last_undegraded":"2023-09-30T17:06:03.582493+0000","last_fullsized":"2023-09-30T17:06:03.582493+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'13","last_scrub_stamp":"2023-09-30T17:06:03.582383+0000","last_deep_scrub":"59'13","last_deep_scrub_stamp":"2023-09-30T17:06:03.582383+0000","last_clean_scrub_stamp":"2023-09-30T17:06:03.582383+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:58:49.007492+0000","scrub_duration":0.0032092079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"59'2796","reported_seq":2886,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309914+0000","last_change":"2023-09-30T17:05:06.292455+0000","last_active":"2023-09-30T17:05:26.309914+0000","last_peered":"2023-09-30T17:05:26.309914+0000","last_clean":"2023-09-30T17:05:26.309914+0000","last_became_active":"2023-09-30T17:05:06.290929+0000","last_became_peered":"2023-09-30T17:05:06.290929+0000","last_unstale":"2023-09-30T17:05:26.309914+0000","last_undegraded":"2023-09-30T17:05:26.309914+0000","last_fullsized":"2023-09-30T17:05:26.309914+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2796,"log_dups_size":0,"ondisk_log_size":2796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8138,"num_write_kb":38784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"59'2852","reported_seq":2930,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:59.672577+0000","last_change":"2023-09-30T17:05:59.672667+0000","last_active":"2023-09-30T17:05:59.672577+0000","last_peered":"2023-09-30T17:05:59.672577+0000","last_clean":"2023-09-30T17:05:59.672577+0000","last_became_active":"2023-09-30T17:02:18.362894+0000","last_became_peered":"2023-09-30T17:02:18.362894+0000","last_unstale":"2023-09-30T17:05:59.672577+0000","last_undegraded":"2023-09-30T17:05:59.672577+0000","last_fullsized":"2023-09-30T17:05:59.672577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2852","last_scrub_stamp":"2023-09-30T17:05:59.672454+0000","last_deep_scrub":"59'2852","last_deep_scrub_stamp":"2023-09-30T17:05:59.672454+0000","last_clean_scrub_stamp":"2023-09-30T17:05:59.672454+0000","objects_scrubbed":0,"log_size":2852,"log_dups_size":0,"ondisk_log_size":2852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:25:06.256229+0000","scrub_duration":0.0033008859999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8357,"num_write_kb":39780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"59'2874","reported_seq":2964,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310152+0000","last_change":"2023-09-30T17:05:06.294279+0000","last_active":"2023-09-30T17:05:26.310152+0000","last_peered":"2023-09-30T17:05:26.310152+0000","last_clean":"2023-09-30T17:05:26.310152+0000","last_became_active":"2023-09-30T17:05:06.292898+0000","last_became_peered":"2023-09-30T17:05:06.292898+0000","last_unstale":"2023-09-30T17:05:26.310152+0000","last_undegraded":"2023-09-30T17:05:26.310152+0000","last_fullsized":"2023-09-30T17:05:26.310152+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2874,"log_dups_size":0,"ondisk_log_size":2874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8465,"num_write_kb":40104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":532685,"num_write_kb":2575302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140940,"ondisk_log_size":140940,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":228927,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":137,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":223425,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":524288,"data_stored":457854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},"log_size":142,"ondisk_log_size":142,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":66,"seq":283467841553,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47036,"kb_used_data":1460,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94324804,"statfs":{"total":96636764160,"available":96588599296,"internally_reserved":0,"allocated":1495040,"data_stored":1123985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7139,"internal_metadata":46654493},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 17:06:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.46800000000000003}]},{"osd":1,"last update":"Sat Sep 30 17:06:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.53800000000000003}]}]},{"osd":0,"up_from":8,"seq":34359738422,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":582448,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":580990,"kb_avail":93789392,"statfs":{"total":96636764160,"available":96040337408,"internally_reserved":0,"allocated":1482752,"data_stored":1122763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":594934214},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 17:06:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.51400000000000001,"15min":0.48799999999999999},"min":{"1min":0.317,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.58199999999999996,"5min":5.9480000000000004,"15min":5.9480000000000004},"last":0.504},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.50800000000000001,"15min":0.46500000000000002},"min":{"1min":0.27700000000000002,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.70899999999999996,"5min":3.6819999999999999,"15min":3.6819999999999999},"last":0.46700000000000003}]},{"osd":2,"last update":"Sat Sep 30 17:06:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.433}]}]},{"osd":1,"up_from":8,"seq":34359738422,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":563588,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":562942,"kb_avail":93808252,"statfs":{"total":96636764160,"available":96059650048,"internally_reserved":0,"allocated":651264,"data_stored":305912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":576453062},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 17:05:11 2023","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.48599999999999999,"15min":0.45600000000000002},"min":{"1min":0.19800000000000001,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":3.3420000000000001,"5min":3.3420000000000001,"15min":3.3420000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.51200000000000001,"15min":0.46000000000000002},"min":{"1min":0.189,"5min":0.188,"15min":0.188},"max":{"1min":3.5470000000000002,"5min":3.5470000000000002,"15min":3.5470000000000002},"last":0.48799999999999999}]},{"osd":2,"last update":"Sat Sep 30 17:06:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.51300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":249856,"data_stored":227705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":228927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T17:06:20.172 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.172 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.173 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.173 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.173 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.173 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.173 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.173 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.174 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.174 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.174 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.174 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.174 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.174 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.174 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.174 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.175 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.175 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.175 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.175 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.175 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.175 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.175 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.175 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.176 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.176 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.176 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.176 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.176 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.176 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.176 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.177 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.177 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.177 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.177 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.177 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.177 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.177 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.177 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.178 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.179 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-30T17:02:11.318349+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=11, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.179 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.179 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2023-09-30T17:02:11.318349+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=11, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.179 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2023-09-30T17:02:11.318349+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=11, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.179 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.180 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.180 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2023-09-30T17:02:11.318349+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=11, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.180 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.180 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.180 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2023-09-30T17:02:11.318349+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=11, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.180 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.181 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.181 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-30T17:02:11.318349+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=11, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.181 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.181 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.181 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.181 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.182 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.182 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:20.182 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-30T17:06:40.183 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T17:06:40.668 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:06:40.670 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-09-30T17:06:40.680 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":211,"stamp":"2023-09-30T17:06:39.358296+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":819295,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":140,"num_read_kb":122,"num_write":533025,"num_write_kb":2579054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":223425,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141251,"ondisk_log_size":141251,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1193072,"kb_used_data":3544,"kb_used_omap":10,"kb_used_meta":1189493,"kb_avail":281922448,"statfs":{"total":289910292480,"available":288688586752,"internally_reserved":0,"allocated":3629056,"data_stored":2552660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10327,"internal_metadata":1218041769},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003149"},"pg_stats":[{"pgid":"4.3f","version":"59'2790","reported_seq":2869,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:47.554662+0000","last_change":"2023-09-30T17:05:47.554662+0000","last_active":"2023-09-30T17:05:47.554662+0000","last_peered":"2023-09-30T17:05:47.554662+0000","last_clean":"2023-09-30T17:05:47.554662+0000","last_became_active":"2023-09-30T17:02:18.358716+0000","last_became_peered":"2023-09-30T17:02:18.358716+0000","last_unstale":"2023-09-30T17:05:47.554662+0000","last_undegraded":"2023-09-30T17:05:47.554662+0000","last_fullsized":"2023-09-30T17:05:47.554662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2790","last_scrub_stamp":"2023-09-30T17:05:47.554500+0000","last_deep_scrub":"59'2790","last_deep_scrub_stamp":"2023-09-30T17:05:47.554500+0000","last_clean_scrub_stamp":"2023-09-30T17:05:47.554500+0000","objects_scrubbed":0,"log_size":2790,"log_dups_size":0,"ondisk_log_size":2790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:40:37.069833+0000","scrub_duration":0.0021350679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8214,"num_write_kb":38924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"59'4","reported_seq":83,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:39.661898+0000","last_change":"2023-09-30T17:05:39.661898+0000","last_active":"2023-09-30T17:05:39.661898+0000","last_peered":"2023-09-30T17:05:39.661898+0000","last_clean":"2023-09-30T17:05:39.661898+0000","last_became_active":"2023-09-30T17:02:18.360372+0000","last_became_peered":"2023-09-30T17:02:18.360372+0000","last_unstale":"2023-09-30T17:05:39.661898+0000","last_undegraded":"2023-09-30T17:05:39.661898+0000","last_fullsized":"2023-09-30T17:05:39.661898+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'4","last_scrub_stamp":"2023-09-30T17:05:39.661696+0000","last_deep_scrub":"59'4","last_deep_scrub_stamp":"2023-09-30T17:05:39.661696+0000","last_clean_scrub_stamp":"2023-09-30T17:05:39.661696+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:53:12.475703+0000","scrub_duration":0.0028517759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"59'5697","reported_seq":5772,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310130+0000","last_change":"2023-09-30T17:05:06.291597+0000","last_active":"2023-09-30T17:05:26.310130+0000","last_peered":"2023-09-30T17:05:26.310130+0000","last_clean":"2023-09-30T17:05:26.310130+0000","last_became_active":"2023-09-30T17:05:06.290447+0000","last_became_peered":"2023-09-30T17:05:06.290447+0000","last_unstale":"2023-09-30T17:05:26.310130+0000","last_undegraded":"2023-09-30T17:05:26.310130+0000","last_fullsized":"2023-09-30T17:05:26.310130+0000","mapping_epoch":69,"log_start":"42'1200","ondisk_log_start":"42'1200","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4497,"log_dups_size":1200,"ondisk_log_size":4497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16590,"num_write_kb":78960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"59'10","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309543+0000","last_change":"2023-09-30T17:05:03.309996+0000","last_active":"2023-09-30T17:05:26.309543+0000","last_peered":"2023-09-30T17:05:26.309543+0000","last_clean":"2023-09-30T17:05:26.309543+0000","last_became_active":"2023-09-30T17:05:03.309326+0000","last_became_peered":"2023-09-30T17:05:03.309326+0000","last_unstale":"2023-09-30T17:05:26.309543+0000","last_undegraded":"2023-09-30T17:05:26.309543+0000","last_fullsized":"2023-09-30T17:05:26.309543+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"59'2934","reported_seq":3012,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:50.604137+0000","last_change":"2023-09-30T17:05:50.604194+0000","last_active":"2023-09-30T17:05:50.604137+0000","last_peered":"2023-09-30T17:05:50.604137+0000","last_clean":"2023-09-30T17:05:50.604137+0000","last_became_active":"2023-09-30T17:02:18.357317+0000","last_became_peered":"2023-09-30T17:02:18.357317+0000","last_unstale":"2023-09-30T17:05:50.604137+0000","last_undegraded":"2023-09-30T17:05:50.604137+0000","last_fullsized":"2023-09-30T17:05:50.604137+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2934","last_scrub_stamp":"2023-09-30T17:05:50.604022+0000","last_deep_scrub":"59'2934","last_deep_scrub_stamp":"2023-09-30T17:05:50.604022+0000","last_clean_scrub_stamp":"2023-09-30T17:05:50.604022+0000","objects_scrubbed":0,"log_size":2934,"log_dups_size":0,"ondisk_log_size":2934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:13:55.986563+0000","scrub_duration":0.00343991,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8466,"num_write_kb":40084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"59'6","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:56.578435+0000","last_change":"2023-09-30T17:05:56.578507+0000","last_active":"2023-09-30T17:05:56.578435+0000","last_peered":"2023-09-30T17:05:56.578435+0000","last_clean":"2023-09-30T17:05:56.578435+0000","last_became_active":"2023-09-30T17:05:03.310703+0000","last_became_peered":"2023-09-30T17:05:03.310703+0000","last_unstale":"2023-09-30T17:05:56.578435+0000","last_undegraded":"2023-09-30T17:05:56.578435+0000","last_fullsized":"2023-09-30T17:05:56.578435+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'6","last_scrub_stamp":"2023-09-30T17:05:56.578325+0000","last_deep_scrub":"59'6","last_deep_scrub_stamp":"2023-09-30T17:05:56.578325+0000","last_clean_scrub_stamp":"2023-09-30T17:05:56.578325+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:27:47.196956+0000","scrub_duration":0.0024309819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"59'7","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309692+0000","last_change":"2023-09-30T17:05:03.310838+0000","last_active":"2023-09-30T17:05:26.309692+0000","last_peered":"2023-09-30T17:05:26.309692+0000","last_clean":"2023-09-30T17:05:26.309692+0000","last_became_active":"2023-09-30T17:05:03.310047+0000","last_became_peered":"2023-09-30T17:05:03.310047+0000","last_unstale":"2023-09-30T17:05:26.309692+0000","last_undegraded":"2023-09-30T17:05:26.309692+0000","last_fullsized":"2023-09-30T17:05:26.309692+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"59'11423","reported_seq":11508,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:23.326516+0000","last_change":"2023-09-30T17:06:23.326573+0000","last_active":"2023-09-30T17:06:23.326516+0000","last_peered":"2023-09-30T17:06:23.326516+0000","last_clean":"2023-09-30T17:06:23.326516+0000","last_became_active":"2023-09-30T17:05:06.285582+0000","last_became_peered":"2023-09-30T17:05:06.285582+0000","last_unstale":"2023-09-30T17:06:23.326516+0000","last_undegraded":"2023-09-30T17:06:23.326516+0000","last_fullsized":"2023-09-30T17:06:23.326516+0000","mapping_epoch":69,"log_start":"52'7200","ondisk_log_start":"52'7200","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'11423","last_scrub_stamp":"2023-09-30T17:06:23.326398+0000","last_deep_scrub":"59'11423","last_deep_scrub_stamp":"2023-09-30T17:06:23.326398+0000","last_clean_scrub_stamp":"2023-09-30T17:06:23.326398+0000","objects_scrubbed":0,"log_size":4223,"log_dups_size":5777,"ondisk_log_size":4223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:42:30.429670+0000","scrub_duration":0.0025180100000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33444,"num_write_kb":158924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"59'8589","reported_seq":8659,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310331+0000","last_change":"2023-09-30T17:02:18.364222+0000","last_active":"2023-09-30T17:05:26.310331+0000","last_peered":"2023-09-30T17:05:26.310331+0000","last_clean":"2023-09-30T17:05:26.310331+0000","last_became_active":"2023-09-30T17:02:18.363485+0000","last_became_peered":"2023-09-30T17:02:18.363485+0000","last_unstale":"2023-09-30T17:05:26.310331+0000","last_undegraded":"2023-09-30T17:05:26.310331+0000","last_fullsized":"2023-09-30T17:05:26.310331+0000","mapping_epoch":17,"log_start":"49'4400","ondisk_log_start":"49'4400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4189,"log_dups_size":4400,"ondisk_log_size":4189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25052,"num_write_kb":118756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"59'8585","reported_seq":8663,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:01.724899+0000","last_change":"2023-09-30T17:06:01.724952+0000","last_active":"2023-09-30T17:06:01.724899+0000","last_peered":"2023-09-30T17:06:01.724899+0000","last_clean":"2023-09-30T17:06:01.724899+0000","last_became_active":"2023-09-30T17:02:18.358396+0000","last_became_peered":"2023-09-30T17:02:18.358396+0000","last_unstale":"2023-09-30T17:06:01.724899+0000","last_undegraded":"2023-09-30T17:06:01.724899+0000","last_fullsized":"2023-09-30T17:06:01.724899+0000","mapping_epoch":17,"log_start":"48'4100","ondisk_log_start":"48'4100","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'8585","last_scrub_stamp":"2023-09-30T17:06:01.724792+0000","last_deep_scrub":"59'8585","last_deep_scrub_stamp":"2023-09-30T17:06:01.724792+0000","last_clean_scrub_stamp":"2023-09-30T17:06:01.724792+0000","objects_scrubbed":0,"log_size":4485,"log_dups_size":4100,"ondisk_log_size":4485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:35:48.146536+0000","scrub_duration":0.0040357209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24997,"num_write_kb":162463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"59'5664","reported_seq":5749,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:46.618589+0000","last_change":"2023-09-30T17:05:46.618636+0000","last_active":"2023-09-30T17:05:46.618589+0000","last_peered":"2023-09-30T17:05:46.618589+0000","last_clean":"2023-09-30T17:05:46.618589+0000","last_became_active":"2023-09-30T17:05:06.290193+0000","last_became_peered":"2023-09-30T17:05:06.290193+0000","last_unstale":"2023-09-30T17:05:46.618589+0000","last_undegraded":"2023-09-30T17:05:46.618589+0000","last_fullsized":"2023-09-30T17:05:46.618589+0000","mapping_epoch":69,"log_start":"43'1400","ondisk_log_start":"43'1400","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'5664","last_scrub_stamp":"2023-09-30T17:05:46.618493+0000","last_deep_scrub":"59'5664","last_deep_scrub_stamp":"2023-09-30T17:05:46.618493+0000","last_clean_scrub_stamp":"2023-09-30T17:05:46.618493+0000","objects_scrubbed":0,"log_size":4264,"log_dups_size":1400,"ondisk_log_size":4264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:50:52.323251+0000","scrub_duration":0.0029415959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16442,"num_write_kb":78308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"59'2931","reported_seq":3021,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309813+0000","last_change":"2023-09-30T17:05:06.290270+0000","last_active":"2023-09-30T17:05:26.309813+0000","last_peered":"2023-09-30T17:05:26.309813+0000","last_clean":"2023-09-30T17:05:26.309813+0000","last_became_active":"2023-09-30T17:05:06.288753+0000","last_became_peered":"2023-09-30T17:05:06.288753+0000","last_unstale":"2023-09-30T17:05:26.309813+0000","last_undegraded":"2023-09-30T17:05:26.309813+0000","last_fullsized":"2023-09-30T17:05:26.309813+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2931,"log_dups_size":0,"ondisk_log_size":2931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8488,"num_write_kb":40364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"59'2860","reported_seq":2938,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:12.712346+0000","last_change":"2023-09-30T17:06:12.712399+0000","last_active":"2023-09-30T17:06:12.712346+0000","last_peered":"2023-09-30T17:06:12.712346+0000","last_clean":"2023-09-30T17:06:12.712346+0000","last_became_active":"2023-09-30T17:02:18.358534+0000","last_became_peered":"2023-09-30T17:02:18.358534+0000","last_unstale":"2023-09-30T17:06:12.712346+0000","last_undegraded":"2023-09-30T17:06:12.712346+0000","last_fullsized":"2023-09-30T17:06:12.712346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2860","last_scrub_stamp":"2023-09-30T17:06:12.712247+0000","last_deep_scrub":"59'2860","last_deep_scrub_stamp":"2023-09-30T17:06:12.712247+0000","last_clean_scrub_stamp":"2023-09-30T17:06:12.712247+0000","objects_scrubbed":0,"log_size":2860,"log_dups_size":0,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:44:33.166129+0000","scrub_duration":0.002572104,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8367,"num_write_kb":39772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"59'2911","reported_seq":2987,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:42.691805+0000","last_change":"2023-09-30T17:05:42.691905+0000","last_active":"2023-09-30T17:05:42.691805+0000","last_peered":"2023-09-30T17:05:42.691805+0000","last_clean":"2023-09-30T17:05:42.691805+0000","last_became_active":"2023-09-30T17:05:06.288360+0000","last_became_peered":"2023-09-30T17:05:06.288360+0000","last_unstale":"2023-09-30T17:05:42.691805+0000","last_undegraded":"2023-09-30T17:05:42.691805+0000","last_fullsized":"2023-09-30T17:05:42.691805+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2911","last_scrub_stamp":"2023-09-30T17:05:42.691679+0000","last_deep_scrub":"59'2911","last_deep_scrub_stamp":"2023-09-30T17:05:42.691679+0000","last_clean_scrub_stamp":"2023-09-30T17:05:42.691679+0000","objects_scrubbed":0,"log_size":2911,"log_dups_size":0,"ondisk_log_size":2911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:58:28.142176+0000","scrub_duration":0.0030980600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8419,"num_write_kb":39940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"59'2889","reported_seq":2965,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:47.659737+0000","last_change":"2023-09-30T17:05:47.659805+0000","last_active":"2023-09-30T17:05:47.659737+0000","last_peered":"2023-09-30T17:05:47.659737+0000","last_clean":"2023-09-30T17:05:47.659737+0000","last_became_active":"2023-09-30T17:05:06.285738+0000","last_became_peered":"2023-09-30T17:05:06.285738+0000","last_unstale":"2023-09-30T17:05:47.659737+0000","last_undegraded":"2023-09-30T17:05:47.659737+0000","last_fullsized":"2023-09-30T17:05:47.659737+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2889","last_scrub_stamp":"2023-09-30T17:05:47.659610+0000","last_deep_scrub":"59'2889","last_deep_scrub_stamp":"2023-09-30T17:05:47.659610+0000","last_clean_scrub_stamp":"2023-09-30T17:05:47.659610+0000","objects_scrubbed":0,"log_size":2889,"log_dups_size":0,"ondisk_log_size":2889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:55:36.031386+0000","scrub_duration":0.0023223979999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8435,"num_write_kb":39984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"59'2839","reported_seq":2907,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309323+0000","last_change":"2023-09-30T17:05:06.291173+0000","last_active":"2023-09-30T17:05:26.309323+0000","last_peered":"2023-09-30T17:05:26.309323+0000","last_clean":"2023-09-30T17:05:26.309323+0000","last_became_active":"2023-09-30T17:05:06.289872+0000","last_became_peered":"2023-09-30T17:05:06.289872+0000","last_unstale":"2023-09-30T17:05:26.309323+0000","last_undegraded":"2023-09-30T17:05:26.309323+0000","last_fullsized":"2023-09-30T17:05:26.309323+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2839,"log_dups_size":0,"ondisk_log_size":2839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8166,"num_write_kb":38928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"59'2802","reported_seq":2880,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:23.436587+0000","last_change":"2023-09-30T17:06:23.436665+0000","last_active":"2023-09-30T17:06:23.436587+0000","last_peered":"2023-09-30T17:06:23.436587+0000","last_clean":"2023-09-30T17:06:23.436587+0000","last_became_active":"2023-09-30T17:02:18.363697+0000","last_became_peered":"2023-09-30T17:02:18.363697+0000","last_unstale":"2023-09-30T17:06:23.436587+0000","last_undegraded":"2023-09-30T17:06:23.436587+0000","last_fullsized":"2023-09-30T17:06:23.436587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2802","last_scrub_stamp":"2023-09-30T17:06:23.436443+0000","last_deep_scrub":"59'2802","last_deep_scrub_stamp":"2023-09-30T17:06:23.436443+0000","last_clean_scrub_stamp":"2023-09-30T17:06:23.436443+0000","objects_scrubbed":0,"log_size":2802,"log_dups_size":0,"ondisk_log_size":2802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:46:24.401617+0000","scrub_duration":0.0024206399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8256,"num_write_kb":39208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"59'2860","reported_seq":2938,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:57.725965+0000","last_change":"2023-09-30T17:05:57.726023+0000","last_active":"2023-09-30T17:05:57.725965+0000","last_peered":"2023-09-30T17:05:57.725965+0000","last_clean":"2023-09-30T17:05:57.725965+0000","last_became_active":"2023-09-30T17:02:18.357184+0000","last_became_peered":"2023-09-30T17:02:18.357184+0000","last_unstale":"2023-09-30T17:05:57.725965+0000","last_undegraded":"2023-09-30T17:05:57.725965+0000","last_fullsized":"2023-09-30T17:05:57.725965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2860","last_scrub_stamp":"2023-09-30T17:05:57.725852+0000","last_deep_scrub":"59'2860","last_deep_scrub_stamp":"2023-09-30T17:05:57.725852+0000","last_clean_scrub_stamp":"2023-09-30T17:05:57.725852+0000","objects_scrubbed":0,"log_size":2860,"log_dups_size":0,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:28:04.823179+0000","scrub_duration":0.003284379,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8368,"num_write_kb":39616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"59'5686","reported_seq":5756,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310073+0000","last_change":"2023-09-30T17:02:18.363956+0000","last_active":"2023-09-30T17:05:26.310073+0000","last_peered":"2023-09-30T17:05:26.310073+0000","last_clean":"2023-09-30T17:05:26.310073+0000","last_became_active":"2023-09-30T17:02:18.363654+0000","last_became_peered":"2023-09-30T17:02:18.363654+0000","last_unstale":"2023-09-30T17:05:26.310073+0000","last_undegraded":"2023-09-30T17:05:26.310073+0000","last_fullsized":"2023-09-30T17:05:26.310073+0000","mapping_epoch":17,"log_start":"44'1500","ondisk_log_start":"44'1500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4186,"log_dups_size":1500,"ondisk_log_size":4186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16649,"num_write_kb":78956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"59'5799","reported_seq":5877,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309847+0000","last_change":"2023-09-30T17:05:06.290994+0000","last_active":"2023-09-30T17:05:26.309847+0000","last_peered":"2023-09-30T17:05:26.309847+0000","last_clean":"2023-09-30T17:05:26.309847+0000","last_became_active":"2023-09-30T17:05:06.289817+0000","last_became_peered":"2023-09-30T17:05:06.289817+0000","last_unstale":"2023-09-30T17:05:26.309847+0000","last_undegraded":"2023-09-30T17:05:26.309847+0000","last_fullsized":"2023-09-30T17:05:26.309847+0000","mapping_epoch":69,"log_start":"44'1600","ondisk_log_start":"44'1600","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4199,"log_dups_size":1600,"ondisk_log_size":4199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16903,"num_write_kb":80184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"59'12","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:21.397922+0000","last_change":"2023-09-30T17:06:21.397978+0000","last_active":"2023-09-30T17:06:21.397922+0000","last_peered":"2023-09-30T17:06:21.397922+0000","last_clean":"2023-09-30T17:06:21.397922+0000","last_became_active":"2023-09-30T17:05:03.309537+0000","last_became_peered":"2023-09-30T17:05:03.309537+0000","last_unstale":"2023-09-30T17:06:21.397922+0000","last_undegraded":"2023-09-30T17:06:21.397922+0000","last_fullsized":"2023-09-30T17:06:21.397922+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'12","last_scrub_stamp":"2023-09-30T17:06:21.397829+0000","last_deep_scrub":"59'12","last_deep_scrub_stamp":"2023-09-30T17:06:21.397829+0000","last_clean_scrub_stamp":"2023-09-30T17:06:21.397829+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:09:16.446743+0000","scrub_duration":0.0024723459999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"59'2879","reported_seq":2969,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309711+0000","last_change":"2023-09-30T17:05:06.292705+0000","last_active":"2023-09-30T17:05:26.309711+0000","last_peered":"2023-09-30T17:05:26.309711+0000","last_clean":"2023-09-30T17:05:26.309711+0000","last_became_active":"2023-09-30T17:05:06.290797+0000","last_became_peered":"2023-09-30T17:05:06.290797+0000","last_unstale":"2023-09-30T17:05:26.309711+0000","last_undegraded":"2023-09-30T17:05:26.309711+0000","last_fullsized":"2023-09-30T17:05:26.309711+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2879,"log_dups_size":0,"ondisk_log_size":2879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8343,"num_write_kb":39768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"59'2809","reported_seq":2907,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:30.315178+0000","last_change":"2023-09-30T17:06:30.315229+0000","last_active":"2023-09-30T17:06:30.315178+0000","last_peered":"2023-09-30T17:06:30.315178+0000","last_clean":"2023-09-30T17:06:30.315178+0000","last_became_active":"2023-09-30T17:05:06.288837+0000","last_became_peered":"2023-09-30T17:05:06.288837+0000","last_unstale":"2023-09-30T17:06:30.315178+0000","last_undegraded":"2023-09-30T17:06:30.315178+0000","last_fullsized":"2023-09-30T17:06:30.315178+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2809","last_scrub_stamp":"2023-09-30T17:06:30.315071+0000","last_deep_scrub":"59'2809","last_deep_scrub_stamp":"2023-09-30T17:06:30.315071+0000","last_clean_scrub_stamp":"2023-09-30T17:06:30.315071+0000","objects_scrubbed":0,"log_size":2809,"log_dups_size":0,"ondisk_log_size":2809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:06:21.933414+0000","scrub_duration":0.002757893,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8281,"num_write_kb":39472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"59'5585","reported_seq":5663,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:11.715827+0000","last_change":"2023-09-30T17:06:11.715889+0000","last_active":"2023-09-30T17:06:11.715827+0000","last_peered":"2023-09-30T17:06:11.715827+0000","last_clean":"2023-09-30T17:06:11.715827+0000","last_became_active":"2023-09-30T17:02:18.353632+0000","last_became_peered":"2023-09-30T17:02:18.353632+0000","last_unstale":"2023-09-30T17:06:11.715827+0000","last_undegraded":"2023-09-30T17:06:11.715827+0000","last_fullsized":"2023-09-30T17:06:11.715827+0000","mapping_epoch":17,"log_start":"42'1100","ondisk_log_start":"42'1100","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'5585","last_scrub_stamp":"2023-09-30T17:06:11.715704+0000","last_deep_scrub":"59'5585","last_deep_scrub_stamp":"2023-09-30T17:06:11.715704+0000","last_clean_scrub_stamp":"2023-09-30T17:06:11.715704+0000","objects_scrubbed":0,"log_size":4485,"log_dups_size":1100,"ondisk_log_size":4485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:47:36.619172+0000","scrub_duration":0.003196726,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16523,"num_write_kb":78256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"59'2888","reported_seq":2978,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310634+0000","last_change":"2023-09-30T17:05:06.292945+0000","last_active":"2023-09-30T17:05:26.310634+0000","last_peered":"2023-09-30T17:05:26.310634+0000","last_clean":"2023-09-30T17:05:26.310634+0000","last_became_active":"2023-09-30T17:05:06.291346+0000","last_became_peered":"2023-09-30T17:05:06.291346+0000","last_unstale":"2023-09-30T17:05:26.310634+0000","last_undegraded":"2023-09-30T17:05:26.310634+0000","last_fullsized":"2023-09-30T17:05:26.310634+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2888,"log_dups_size":0,"ondisk_log_size":2888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8371,"num_write_kb":39716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"59'18","reported_seq":107,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:41.585552+0000","last_change":"2023-09-30T17:05:41.585602+0000","last_active":"2023-09-30T17:05:41.585552+0000","last_peered":"2023-09-30T17:05:41.585552+0000","last_clean":"2023-09-30T17:05:41.585552+0000","last_became_active":"2023-09-30T17:05:03.308884+0000","last_became_peered":"2023-09-30T17:05:03.308884+0000","last_unstale":"2023-09-30T17:05:41.585552+0000","last_undegraded":"2023-09-30T17:05:41.585552+0000","last_fullsized":"2023-09-30T17:05:41.585552+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'18","last_scrub_stamp":"2023-09-30T17:05:41.585439+0000","last_deep_scrub":"59'18","last_deep_scrub_stamp":"2023-09-30T17:05:41.585439+0000","last_clean_scrub_stamp":"2023-09-30T17:05:41.585439+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:29:52.984290+0000","scrub_duration":0.0024239769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"59'2855","reported_seq":2924,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309973+0000","last_change":"2023-09-30T17:05:06.291369+0000","last_active":"2023-09-30T17:05:26.309973+0000","last_peered":"2023-09-30T17:05:26.309973+0000","last_clean":"2023-09-30T17:05:26.309973+0000","last_became_active":"2023-09-30T17:05:06.289447+0000","last_became_peered":"2023-09-30T17:05:06.289447+0000","last_unstale":"2023-09-30T17:05:26.309973+0000","last_undegraded":"2023-09-30T17:05:26.309973+0000","last_fullsized":"2023-09-30T17:05:26.309973+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2855,"log_dups_size":0,"ondisk_log_size":2855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8347,"num_write_kb":39608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":80,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:31.986542+0000","last_change":"2023-09-30T17:06:31.986601+0000","last_active":"2023-09-30T17:06:31.986542+0000","last_peered":"2023-09-30T17:06:31.986542+0000","last_clean":"2023-09-30T17:06:31.986542+0000","last_became_active":"2023-09-30T17:02:17.357890+0000","last_became_peered":"2023-09-30T17:02:17.357890+0000","last_unstale":"2023-09-30T17:06:31.986542+0000","last_undegraded":"2023-09-30T17:06:31.986542+0000","last_fullsized":"2023-09-30T17:06:31.986542+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2023-09-30T17:06:31.986457+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2023-09-30T17:06:31.986457+0000","last_clean_scrub_stamp":"2023-09-30T17:06:31.986457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:02:20.507667+0000","scrub_duration":0.0021959599999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"59'17","reported_seq":106,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:45.592687+0000","last_change":"2023-09-30T17:05:45.592781+0000","last_active":"2023-09-30T17:05:45.592687+0000","last_peered":"2023-09-30T17:05:45.592687+0000","last_clean":"2023-09-30T17:05:45.592687+0000","last_became_active":"2023-09-30T17:05:03.307012+0000","last_became_peered":"2023-09-30T17:05:03.307012+0000","last_unstale":"2023-09-30T17:05:45.592687+0000","last_undegraded":"2023-09-30T17:05:45.592687+0000","last_fullsized":"2023-09-30T17:05:45.592687+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'17","last_scrub_stamp":"2023-09-30T17:05:45.592562+0000","last_deep_scrub":"59'17","last_deep_scrub_stamp":"2023-09-30T17:05:45.592562+0000","last_clean_scrub_stamp":"2023-09-30T17:05:45.592562+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:53:58.476399+0000","scrub_duration":0.0024751999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":82,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309698+0000","last_change":"2023-09-30T17:05:03.309164+0000","last_active":"2023-09-30T17:05:26.309698+0000","last_peered":"2023-09-30T17:05:26.309698+0000","last_clean":"2023-09-30T17:05:26.309698+0000","last_became_active":"2023-09-30T17:05:03.308073+0000","last_became_peered":"2023-09-30T17:05:03.308073+0000","last_unstale":"2023-09-30T17:05:26.309698+0000","last_undegraded":"2023-09-30T17:05:26.309698+0000","last_fullsized":"2023-09-30T17:05:26.309698+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"59'6","reported_seq":88,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:35.884334+0000","last_change":"2023-09-30T17:05:03.308692+0000","last_active":"2023-09-30T17:05:35.884334+0000","last_peered":"2023-09-30T17:05:35.884334+0000","last_clean":"2023-09-30T17:05:35.884334+0000","last_became_active":"2023-09-30T17:05:03.307932+0000","last_became_peered":"2023-09-30T17:05:03.307932+0000","last_unstale":"2023-09-30T17:05:35.884334+0000","last_undegraded":"2023-09-30T17:05:35.884334+0000","last_fullsized":"2023-09-30T17:05:35.884334+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":79,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:00.631465+0000","last_change":"2023-09-30T17:06:00.631555+0000","last_active":"2023-09-30T17:06:00.631465+0000","last_peered":"2023-09-30T17:06:00.631465+0000","last_clean":"2023-09-30T17:06:00.631465+0000","last_became_active":"2023-09-30T17:02:17.360601+0000","last_became_peered":"2023-09-30T17:02:17.360601+0000","last_unstale":"2023-09-30T17:06:00.631465+0000","last_undegraded":"2023-09-30T17:06:00.631465+0000","last_fullsized":"2023-09-30T17:06:00.631465+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:06:00.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:06:00.631354+0000","last_clean_scrub_stamp":"2023-09-30T17:06:00.631354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:20:04.136405+0000","scrub_duration":0.0021158409999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"59'7","reported_seq":89,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:35.373558+0000","last_change":"2023-09-30T17:05:03.305898+0000","last_active":"2023-09-30T17:05:35.373558+0000","last_peered":"2023-09-30T17:05:35.373558+0000","last_clean":"2023-09-30T17:05:35.373558+0000","last_became_active":"2023-09-30T17:05:03.305520+0000","last_became_peered":"2023-09-30T17:05:03.305520+0000","last_unstale":"2023-09-30T17:05:35.373558+0000","last_undegraded":"2023-09-30T17:05:35.373558+0000","last_fullsized":"2023-09-30T17:05:35.373558+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"58'1","reported_seq":91,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:31.362911+0000","last_change":"2023-09-30T17:06:31.362963+0000","last_active":"2023-09-30T17:06:31.362911+0000","last_peered":"2023-09-30T17:06:31.362911+0000","last_clean":"2023-09-30T17:06:31.362911+0000","last_became_active":"2023-09-30T17:05:03.308851+0000","last_became_peered":"2023-09-30T17:05:03.308851+0000","last_unstale":"2023-09-30T17:06:31.362911+0000","last_undegraded":"2023-09-30T17:06:31.362911+0000","last_fullsized":"2023-09-30T17:06:31.362911+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'1","last_scrub_stamp":"2023-09-30T17:06:31.362807+0000","last_deep_scrub":"58'1","last_deep_scrub_stamp":"2023-09-30T17:06:31.362807+0000","last_clean_scrub_stamp":"2023-09-30T17:06:31.362807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:52:49.024933+0000","scrub_duration":0.001800563,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"59'9","reported_seq":87,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:42.629955+0000","last_change":"2023-09-30T17:05:42.630040+0000","last_active":"2023-09-30T17:05:42.629955+0000","last_peered":"2023-09-30T17:05:42.629955+0000","last_clean":"2023-09-30T17:05:42.629955+0000","last_became_active":"2023-09-30T17:02:18.358529+0000","last_became_peered":"2023-09-30T17:02:18.358529+0000","last_unstale":"2023-09-30T17:05:42.629955+0000","last_undegraded":"2023-09-30T17:05:42.629955+0000","last_fullsized":"2023-09-30T17:05:42.629955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'9","last_scrub_stamp":"2023-09-30T17:05:42.629801+0000","last_deep_scrub":"59'9","last_deep_scrub_stamp":"2023-09-30T17:05:42.629801+0000","last_clean_scrub_stamp":"2023-09-30T17:05:42.629801+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:08:35.419515+0000","scrub_duration":0.0034623800000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309773+0000","last_change":"2023-09-30T17:05:03.309409+0000","last_active":"2023-09-30T17:05:26.309773+0000","last_peered":"2023-09-30T17:05:26.309773+0000","last_clean":"2023-09-30T17:05:26.309773+0000","last_became_active":"2023-09-30T17:05:03.309023+0000","last_became_peered":"2023-09-30T17:05:03.309023+0000","last_unstale":"2023-09-30T17:05:26.309773+0000","last_undegraded":"2023-09-30T17:05:26.309773+0000","last_fullsized":"2023-09-30T17:05:26.309773+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"59'8526","reported_seq":8619,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309811+0000","last_change":"2023-09-30T17:05:06.292415+0000","last_active":"2023-09-30T17:05:26.309811+0000","last_peered":"2023-09-30T17:05:26.309811+0000","last_clean":"2023-09-30T17:05:26.309811+0000","last_became_active":"2023-09-30T17:05:06.290551+0000","last_became_peered":"2023-09-30T17:05:06.290551+0000","last_unstale":"2023-09-30T17:05:26.309811+0000","last_undegraded":"2023-09-30T17:05:26.309811+0000","last_fullsized":"2023-09-30T17:05:26.309811+0000","mapping_epoch":69,"log_start":"49'4300","ondisk_log_start":"49'4300","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4226,"log_dups_size":4300,"ondisk_log_size":4226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24873,"num_write_kb":118472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"76'9","reported_seq":104,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:29.943639+0000","last_change":"2023-09-30T17:06:29.943696+0000","last_active":"2023-09-30T17:06:29.943639+0000","last_peered":"2023-09-30T17:06:29.943639+0000","last_clean":"2023-09-30T17:06:29.943639+0000","last_became_active":"2023-09-30T17:05:03.306646+0000","last_became_peered":"2023-09-30T17:05:03.306646+0000","last_unstale":"2023-09-30T17:06:29.943639+0000","last_undegraded":"2023-09-30T17:06:29.943639+0000","last_fullsized":"2023-09-30T17:06:29.943639+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'9","last_scrub_stamp":"2023-09-30T17:06:29.943546+0000","last_deep_scrub":"76'9","last_deep_scrub_stamp":"2023-09-30T17:06:29.943546+0000","last_clean_scrub_stamp":"2023-09-30T17:06:29.943546+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:01:47.162265+0000","scrub_duration":0.0039657640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"59'5670","reported_seq":5748,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:46.679909+0000","last_change":"2023-09-30T17:05:46.679960+0000","last_active":"2023-09-30T17:05:46.679909+0000","last_peered":"2023-09-30T17:05:46.679909+0000","last_clean":"2023-09-30T17:05:46.679909+0000","last_became_active":"2023-09-30T17:02:18.358786+0000","last_became_peered":"2023-09-30T17:02:18.358786+0000","last_unstale":"2023-09-30T17:05:46.679909+0000","last_undegraded":"2023-09-30T17:05:46.679909+0000","last_fullsized":"2023-09-30T17:05:46.679909+0000","mapping_epoch":17,"log_start":"44'1500","ondisk_log_start":"44'1500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'5670","last_scrub_stamp":"2023-09-30T17:05:46.679767+0000","last_deep_scrub":"59'5670","last_deep_scrub_stamp":"2023-09-30T17:05:46.679767+0000","last_clean_scrub_stamp":"2023-09-30T17:05:46.679767+0000","objects_scrubbed":0,"log_size":4170,"log_dups_size":1500,"ondisk_log_size":4170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:13:16.252019+0000","scrub_duration":0.0034350140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16627,"num_write_kb":79047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"76'82","reported_seq":62,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:24.313340+0000","last_change":"2023-09-30T17:06:24.313394+0000","last_active":"2023-09-30T17:06:24.313340+0000","last_peered":"2023-09-30T17:06:24.313340+0000","last_clean":"2023-09-30T17:06:24.313340+0000","last_became_active":"2023-09-30T17:05:03.302516+0000","last_became_peered":"2023-09-30T17:05:03.302516+0000","last_unstale":"2023-09-30T17:06:24.313340+0000","last_undegraded":"2023-09-30T17:06:24.313340+0000","last_fullsized":"2023-09-30T17:06:24.313340+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'82","last_scrub_stamp":"2023-09-30T17:06:24.313256+0000","last_deep_scrub":"76'82","last_deep_scrub_stamp":"2023-09-30T17:06:24.313256+0000","last_clean_scrub_stamp":"2023-09-30T17:06:24.313256+0000","objects_scrubbed":4,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:44:16.046579+0000","scrub_duration":0.0059365370000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227523,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":222729,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"59'5677","reported_seq":5757,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310006+0000","last_change":"2023-09-30T17:05:06.289965+0000","last_active":"2023-09-30T17:05:26.310006+0000","last_peered":"2023-09-30T17:05:26.310006+0000","last_clean":"2023-09-30T17:05:26.310006+0000","last_became_active":"2023-09-30T17:05:06.288155+0000","last_became_peered":"2023-09-30T17:05:06.288155+0000","last_unstale":"2023-09-30T17:05:26.310006+0000","last_undegraded":"2023-09-30T17:05:26.310006+0000","last_fullsized":"2023-09-30T17:05:26.310006+0000","mapping_epoch":69,"log_start":"42'1100","ondisk_log_start":"42'1100","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4577,"log_dups_size":1100,"ondisk_log_size":4577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16579,"num_write_kb":79104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"76'4","reported_seq":43,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:35.285337+0000","last_change":"2023-09-30T17:06:35.285424+0000","last_active":"2023-09-30T17:06:35.285337+0000","last_peered":"2023-09-30T17:06:35.285337+0000","last_clean":"2023-09-30T17:06:35.285337+0000","last_became_active":"2023-09-30T17:05:03.309505+0000","last_became_peered":"2023-09-30T17:05:03.309505+0000","last_unstale":"2023-09-30T17:06:35.285337+0000","last_undegraded":"2023-09-30T17:06:35.285337+0000","last_fullsized":"2023-09-30T17:06:35.285337+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'4","last_scrub_stamp":"2023-09-30T17:06:35.285239+0000","last_deep_scrub":"76'4","last_deep_scrub_stamp":"2023-09-30T17:06:35.285239+0000","last_clean_scrub_stamp":"2023-09-30T17:06:35.285239+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:17:18.502298+0000","scrub_duration":0.0040701629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"59'2836","reported_seq":2914,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:16.757228+0000","last_change":"2023-09-30T17:06:16.757277+0000","last_active":"2023-09-30T17:06:16.757228+0000","last_peered":"2023-09-30T17:06:16.757228+0000","last_clean":"2023-09-30T17:06:16.757228+0000","last_became_active":"2023-09-30T17:02:18.358364+0000","last_became_peered":"2023-09-30T17:02:18.358364+0000","last_unstale":"2023-09-30T17:06:16.757228+0000","last_undegraded":"2023-09-30T17:06:16.757228+0000","last_fullsized":"2023-09-30T17:06:16.757228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2836","last_scrub_stamp":"2023-09-30T17:06:16.757121+0000","last_deep_scrub":"59'2836","last_deep_scrub_stamp":"2023-09-30T17:06:16.757121+0000","last_clean_scrub_stamp":"2023-09-30T17:06:16.757121+0000","objects_scrubbed":0,"log_size":2836,"log_dups_size":0,"ondisk_log_size":2836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:25:14.959219+0000","scrub_duration":0.0037836699999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8308,"num_write_kb":39456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":82,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309887+0000","last_change":"2023-09-30T17:05:03.308853+0000","last_active":"2023-09-30T17:05:26.309887+0000","last_peered":"2023-09-30T17:05:26.309887+0000","last_clean":"2023-09-30T17:05:26.309887+0000","last_became_active":"2023-09-30T17:05:03.308377+0000","last_became_peered":"2023-09-30T17:05:03.308377+0000","last_unstale":"2023-09-30T17:05:26.309887+0000","last_undegraded":"2023-09-30T17:05:26.309887+0000","last_fullsized":"2023-09-30T17:05:26.309887+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"59'2856","reported_seq":2934,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:43.659585+0000","last_change":"2023-09-30T17:05:43.659681+0000","last_active":"2023-09-30T17:05:43.659585+0000","last_peered":"2023-09-30T17:05:43.659585+0000","last_clean":"2023-09-30T17:05:43.659585+0000","last_became_active":"2023-09-30T17:02:18.361556+0000","last_became_peered":"2023-09-30T17:02:18.361556+0000","last_unstale":"2023-09-30T17:05:43.659585+0000","last_undegraded":"2023-09-30T17:05:43.659585+0000","last_fullsized":"2023-09-30T17:05:43.659585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2856","last_scrub_stamp":"2023-09-30T17:05:43.659443+0000","last_deep_scrub":"59'2856","last_deep_scrub_stamp":"2023-09-30T17:05:43.659443+0000","last_clean_scrub_stamp":"2023-09-30T17:05:43.659443+0000","objects_scrubbed":0,"log_size":2856,"log_dups_size":0,"ondisk_log_size":2856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:13:13.231695+0000","scrub_duration":0.0035525420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8321,"num_write_kb":39600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":90,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:22.790916+0000","last_change":"2023-09-30T17:06:22.790965+0000","last_active":"2023-09-30T17:06:22.790916+0000","last_peered":"2023-09-30T17:06:22.790916+0000","last_clean":"2023-09-30T17:06:22.790916+0000","last_became_active":"2023-09-30T17:05:03.303598+0000","last_became_peered":"2023-09-30T17:05:03.303598+0000","last_unstale":"2023-09-30T17:06:22.790916+0000","last_undegraded":"2023-09-30T17:06:22.790916+0000","last_fullsized":"2023-09-30T17:06:22.790916+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:06:22.790800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:06:22.790800+0000","last_clean_scrub_stamp":"2023-09-30T17:06:22.790800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:05:32.483926+0000","scrub_duration":0.001928988,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"59'12","reported_seq":93,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310428+0000","last_change":"2023-09-30T17:05:03.313214+0000","last_active":"2023-09-30T17:05:26.310428+0000","last_peered":"2023-09-30T17:05:26.310428+0000","last_clean":"2023-09-30T17:05:26.310428+0000","last_became_active":"2023-09-30T17:05:03.312888+0000","last_became_peered":"2023-09-30T17:05:03.312888+0000","last_unstale":"2023-09-30T17:05:26.310428+0000","last_undegraded":"2023-09-30T17:05:26.310428+0000","last_fullsized":"2023-09-30T17:05:26.310428+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"76'13","reported_seq":48,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:52.618203+0000","last_change":"2023-09-30T17:05:52.618265+0000","last_active":"2023-09-30T17:05:52.618203+0000","last_peered":"2023-09-30T17:05:52.618203+0000","last_clean":"2023-09-30T17:05:52.618203+0000","last_became_active":"2023-09-30T17:05:03.304030+0000","last_became_peered":"2023-09-30T17:05:03.304030+0000","last_unstale":"2023-09-30T17:05:52.618203+0000","last_undegraded":"2023-09-30T17:05:52.618203+0000","last_fullsized":"2023-09-30T17:05:52.618203+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'13","last_scrub_stamp":"2023-09-30T17:05:52.618079+0000","last_deep_scrub":"76'13","last_deep_scrub_stamp":"2023-09-30T17:05:52.618079+0000","last_clean_scrub_stamp":"2023-09-30T17:05:52.618079+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:02:35.473886+0000","scrub_duration":0.0072773029999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"59'2892","reported_seq":2982,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310624+0000","last_change":"2023-09-30T17:05:06.290230+0000","last_active":"2023-09-30T17:05:26.310624+0000","last_peered":"2023-09-30T17:05:26.310624+0000","last_clean":"2023-09-30T17:05:26.310624+0000","last_became_active":"2023-09-30T17:05:06.288725+0000","last_became_peered":"2023-09-30T17:05:06.288725+0000","last_unstale":"2023-09-30T17:05:26.310624+0000","last_undegraded":"2023-09-30T17:05:26.310624+0000","last_fullsized":"2023-09-30T17:05:26.310624+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2892,"log_dups_size":0,"ondisk_log_size":2892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8345,"num_write_kb":39712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"76'2","reported_seq":42,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:59.595711+0000","last_change":"2023-09-30T17:05:59.595763+0000","last_active":"2023-09-30T17:05:59.595711+0000","last_peered":"2023-09-30T17:05:59.595711+0000","last_clean":"2023-09-30T17:05:59.595711+0000","last_became_active":"2023-09-30T17:05:03.303179+0000","last_became_peered":"2023-09-30T17:05:03.303179+0000","last_unstale":"2023-09-30T17:05:59.595711+0000","last_undegraded":"2023-09-30T17:05:59.595711+0000","last_fullsized":"2023-09-30T17:05:59.595711+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2023-09-30T17:05:59.595592+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2023-09-30T17:05:59.595592+0000","last_clean_scrub_stamp":"2023-09-30T17:05:59.595592+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:47:24.049768+0000","scrub_duration":0.0041402670000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"59'2861","reported_seq":2951,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309316+0000","last_change":"2023-09-30T17:05:06.290324+0000","last_active":"2023-09-30T17:05:26.309316+0000","last_peered":"2023-09-30T17:05:26.309316+0000","last_clean":"2023-09-30T17:05:26.309316+0000","last_became_active":"2023-09-30T17:05:06.288824+0000","last_became_peered":"2023-09-30T17:05:06.288824+0000","last_unstale":"2023-09-30T17:05:26.309316+0000","last_undegraded":"2023-09-30T17:05:26.309316+0000","last_fullsized":"2023-09-30T17:05:26.309316+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2861,"log_dups_size":0,"ondisk_log_size":2861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8384,"num_write_kb":39788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"76'3","reported_seq":93,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:13.758982+0000","last_change":"2023-09-30T17:06:13.759033+0000","last_active":"2023-09-30T17:06:13.758982+0000","last_peered":"2023-09-30T17:06:13.758982+0000","last_clean":"2023-09-30T17:06:13.758982+0000","last_became_active":"2023-09-30T17:05:03.303874+0000","last_became_peered":"2023-09-30T17:05:03.303874+0000","last_unstale":"2023-09-30T17:06:13.758982+0000","last_undegraded":"2023-09-30T17:06:13.758982+0000","last_fullsized":"2023-09-30T17:06:13.758982+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'3","last_scrub_stamp":"2023-09-30T17:06:13.758880+0000","last_deep_scrub":"76'3","last_deep_scrub_stamp":"2023-09-30T17:06:13.758880+0000","last_clean_scrub_stamp":"2023-09-30T17:06:13.758880+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:16:16.319469+0000","scrub_duration":0.0031993410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"59'2","reported_seq":80,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:03.649303+0000","last_change":"2023-09-30T17:06:03.649354+0000","last_active":"2023-09-30T17:06:03.649303+0000","last_peered":"2023-09-30T17:06:03.649303+0000","last_clean":"2023-09-30T17:06:03.649303+0000","last_became_active":"2023-09-30T17:02:18.356825+0000","last_became_peered":"2023-09-30T17:02:18.356825+0000","last_unstale":"2023-09-30T17:06:03.649303+0000","last_undegraded":"2023-09-30T17:06:03.649303+0000","last_fullsized":"2023-09-30T17:06:03.649303+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2023-09-30T17:06:03.649193+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2023-09-30T17:06:03.649193+0000","last_clean_scrub_stamp":"2023-09-30T17:06:03.649193+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:38:42.860650+0000","scrub_duration":0.0029770759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":33,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309689+0000","last_change":"2023-09-30T17:05:03.305087+0000","last_active":"2023-09-30T17:05:26.309689+0000","last_peered":"2023-09-30T17:05:26.309689+0000","last_clean":"2023-09-30T17:05:26.309689+0000","last_became_active":"2023-09-30T17:05:03.304463+0000","last_became_peered":"2023-09-30T17:05:03.304463+0000","last_unstale":"2023-09-30T17:05:26.309689+0000","last_undegraded":"2023-09-30T17:05:26.309689+0000","last_fullsized":"2023-09-30T17:05:26.309689+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"59'2835","reported_seq":2904,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309472+0000","last_change":"2023-09-30T17:05:06.289598+0000","last_active":"2023-09-30T17:05:26.309472+0000","last_peered":"2023-09-30T17:05:26.309472+0000","last_clean":"2023-09-30T17:05:26.309472+0000","last_became_active":"2023-09-30T17:05:06.288712+0000","last_became_peered":"2023-09-30T17:05:06.288712+0000","last_unstale":"2023-09-30T17:05:26.309472+0000","last_undegraded":"2023-09-30T17:05:26.309472+0000","last_fullsized":"2023-09-30T17:05:26.309472+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2835,"log_dups_size":0,"ondisk_log_size":2835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8288,"num_write_kb":39388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:55.610514+0000","last_change":"2023-09-30T17:05:55.610603+0000","last_active":"2023-09-30T17:05:55.610514+0000","last_peered":"2023-09-30T17:05:55.610514+0000","last_clean":"2023-09-30T17:05:55.610514+0000","last_became_active":"2023-09-30T17:05:03.310836+0000","last_became_peered":"2023-09-30T17:05:03.310836+0000","last_unstale":"2023-09-30T17:05:55.610514+0000","last_undegraded":"2023-09-30T17:05:55.610514+0000","last_fullsized":"2023-09-30T17:05:55.610514+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:05:55.610405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:05:55.610405+0000","last_clean_scrub_stamp":"2023-09-30T17:05:55.610405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:09:49.583774+0000","scrub_duration":0.0018973,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"59'8","reported_seq":97,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:11.512080+0000","last_change":"2023-09-30T17:06:11.512164+0000","last_active":"2023-09-30T17:06:11.512080+0000","last_peered":"2023-09-30T17:06:11.512080+0000","last_clean":"2023-09-30T17:06:11.512080+0000","last_became_active":"2023-09-30T17:05:03.308214+0000","last_became_peered":"2023-09-30T17:05:03.308214+0000","last_unstale":"2023-09-30T17:06:11.512080+0000","last_undegraded":"2023-09-30T17:06:11.512080+0000","last_fullsized":"2023-09-30T17:06:11.512080+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'8","last_scrub_stamp":"2023-09-30T17:06:11.511974+0000","last_deep_scrub":"59'8","last_deep_scrub_stamp":"2023-09-30T17:06:11.511974+0000","last_clean_scrub_stamp":"2023-09-30T17:06:11.511974+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:52:30.008131+0000","scrub_duration":0.0023012480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"58'3","reported_seq":86,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309993+0000","last_change":"2023-09-30T17:05:03.308944+0000","last_active":"2023-09-30T17:05:26.309993+0000","last_peered":"2023-09-30T17:05:26.309993+0000","last_clean":"2023-09-30T17:05:26.309993+0000","last_became_active":"2023-09-30T17:05:03.308483+0000","last_became_peered":"2023-09-30T17:05:03.308483+0000","last_unstale":"2023-09-30T17:05:26.309993+0000","last_undegraded":"2023-09-30T17:05:26.309993+0000","last_fullsized":"2023-09-30T17:05:26.309993+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"59'2846","reported_seq":2922,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:45.632483+0000","last_change":"2023-09-30T17:05:45.632563+0000","last_active":"2023-09-30T17:05:45.632483+0000","last_peered":"2023-09-30T17:05:45.632483+0000","last_clean":"2023-09-30T17:05:45.632483+0000","last_became_active":"2023-09-30T17:05:06.289225+0000","last_became_peered":"2023-09-30T17:05:06.289225+0000","last_unstale":"2023-09-30T17:05:45.632483+0000","last_undegraded":"2023-09-30T17:05:45.632483+0000","last_fullsized":"2023-09-30T17:05:45.632483+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2846","last_scrub_stamp":"2023-09-30T17:05:45.632358+0000","last_deep_scrub":"59'2846","last_deep_scrub_stamp":"2023-09-30T17:05:45.632358+0000","last_clean_scrub_stamp":"2023-09-30T17:05:45.632358+0000","objects_scrubbed":0,"log_size":2846,"log_dups_size":0,"ondisk_log_size":2846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:03:33.607467+0000","scrub_duration":0.0029322739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8199,"num_write_kb":39160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":30,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309240+0000","last_change":"2023-09-30T17:05:03.309689+0000","last_active":"2023-09-30T17:05:26.309240+0000","last_peered":"2023-09-30T17:05:26.309240+0000","last_clean":"2023-09-30T17:05:26.309240+0000","last_became_active":"2023-09-30T17:05:03.309318+0000","last_became_peered":"2023-09-30T17:05:03.309318+0000","last_unstale":"2023-09-30T17:05:26.309240+0000","last_undegraded":"2023-09-30T17:05:26.309240+0000","last_fullsized":"2023-09-30T17:05:26.309240+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"59'2831","reported_seq":2899,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310018+0000","last_change":"2023-09-30T17:05:06.289189+0000","last_active":"2023-09-30T17:05:26.310018+0000","last_peered":"2023-09-30T17:05:26.310018+0000","last_clean":"2023-09-30T17:05:26.310018+0000","last_became_active":"2023-09-30T17:05:06.288348+0000","last_became_peered":"2023-09-30T17:05:06.288348+0000","last_unstale":"2023-09-30T17:05:26.310018+0000","last_undegraded":"2023-09-30T17:05:26.310018+0000","last_fullsized":"2023-09-30T17:05:26.310018+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2831,"log_dups_size":0,"ondisk_log_size":2831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8336,"num_write_kb":39484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":90,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:28.891687+0000","last_change":"2023-09-30T17:06:28.891741+0000","last_active":"2023-09-30T17:06:28.891687+0000","last_peered":"2023-09-30T17:06:28.891687+0000","last_clean":"2023-09-30T17:06:28.891687+0000","last_became_active":"2023-09-30T17:05:03.303473+0000","last_became_peered":"2023-09-30T17:05:03.303473+0000","last_unstale":"2023-09-30T17:06:28.891687+0000","last_undegraded":"2023-09-30T17:06:28.891687+0000","last_fullsized":"2023-09-30T17:06:28.891687+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:06:28.891571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:06:28.891571+0000","last_clean_scrub_stamp":"2023-09-30T17:06:28.891571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:57:39.251224+0000","scrub_duration":0.0017781679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"59'2884","reported_seq":2960,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:39.659504+0000","last_change":"2023-09-30T17:05:39.659591+0000","last_active":"2023-09-30T17:05:39.659504+0000","last_peered":"2023-09-30T17:05:39.659504+0000","last_clean":"2023-09-30T17:05:39.659504+0000","last_became_active":"2023-09-30T17:05:06.288169+0000","last_became_peered":"2023-09-30T17:05:06.288169+0000","last_unstale":"2023-09-30T17:05:39.659504+0000","last_undegraded":"2023-09-30T17:05:39.659504+0000","last_fullsized":"2023-09-30T17:05:39.659504+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2884","last_scrub_stamp":"2023-09-30T17:05:39.659392+0000","last_deep_scrub":"59'2884","last_deep_scrub_stamp":"2023-09-30T17:05:39.659392+0000","last_clean_scrub_stamp":"2023-09-30T17:05:39.659392+0000","objects_scrubbed":0,"log_size":2884,"log_dups_size":0,"ondisk_log_size":2884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:25:23.871113+0000","scrub_duration":0.0036873600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8366,"num_write_kb":39744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":71,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309457+0000","last_change":"2023-09-30T17:02:17.358811+0000","last_active":"2023-09-30T17:05:26.309457+0000","last_peered":"2023-09-30T17:05:26.309457+0000","last_clean":"2023-09-30T17:05:26.309457+0000","last_became_active":"2023-09-30T17:02:17.358582+0000","last_became_peered":"2023-09-30T17:02:17.358582+0000","last_unstale":"2023-09-30T17:05:26.309457+0000","last_undegraded":"2023-09-30T17:05:26.309457+0000","last_fullsized":"2023-09-30T17:05:26.309457+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"59'8580","reported_seq":8650,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310485+0000","last_change":"2023-09-30T17:02:18.364478+0000","last_active":"2023-09-30T17:05:26.310485+0000","last_peered":"2023-09-30T17:05:26.310485+0000","last_clean":"2023-09-30T17:05:26.310485+0000","last_became_active":"2023-09-30T17:02:18.364057+0000","last_became_peered":"2023-09-30T17:02:18.364057+0000","last_unstale":"2023-09-30T17:05:26.310485+0000","last_undegraded":"2023-09-30T17:05:26.310485+0000","last_fullsized":"2023-09-30T17:05:26.310485+0000","mapping_epoch":17,"log_start":"49'4400","ondisk_log_start":"49'4400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4180,"log_dups_size":4400,"ondisk_log_size":4180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25046,"num_write_kb":118972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":75,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:35.884063+0000","last_change":"2023-09-30T17:02:12.327704+0000","last_active":"2023-09-30T17:05:35.884063+0000","last_peered":"2023-09-30T17:05:35.884063+0000","last_clean":"2023-09-30T17:05:35.884063+0000","last_became_active":"2023-09-30T17:02:12.327384+0000","last_became_peered":"2023-09-30T17:02:12.327384+0000","last_unstale":"2023-09-30T17:05:35.884063+0000","last_undegraded":"2023-09-30T17:05:35.884063+0000","last_fullsized":"2023-09-30T17:05:35.884063+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:19.377132+0000","last_change":"2023-09-30T17:06:19.377196+0000","last_active":"2023-09-30T17:06:19.377132+0000","last_peered":"2023-09-30T17:06:19.377132+0000","last_clean":"2023-09-30T17:06:19.377132+0000","last_became_active":"2023-09-30T17:05:03.310655+0000","last_became_peered":"2023-09-30T17:05:03.310655+0000","last_unstale":"2023-09-30T17:06:19.377132+0000","last_undegraded":"2023-09-30T17:06:19.377132+0000","last_fullsized":"2023-09-30T17:06:19.377132+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:06:19.376984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:06:19.376984+0000","last_clean_scrub_stamp":"2023-09-30T17:06:19.376984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:11:07.977442+0000","scrub_duration":0.0018996149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"59'9","reported_seq":99,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:44.620255+0000","last_change":"2023-09-30T17:05:44.620255+0000","last_active":"2023-09-30T17:05:44.620255+0000","last_peered":"2023-09-30T17:05:44.620255+0000","last_clean":"2023-09-30T17:05:44.620255+0000","last_became_active":"2023-09-30T17:05:03.305956+0000","last_became_peered":"2023-09-30T17:05:03.305956+0000","last_unstale":"2023-09-30T17:05:44.620255+0000","last_undegraded":"2023-09-30T17:05:44.620255+0000","last_fullsized":"2023-09-30T17:05:44.620255+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'9","last_scrub_stamp":"2023-09-30T17:05:44.620091+0000","last_deep_scrub":"59'9","last_deep_scrub_stamp":"2023-09-30T17:05:44.620091+0000","last_clean_scrub_stamp":"2023-09-30T17:05:44.620091+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:48:53.055175+0000","scrub_duration":0.0028788109999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:30.376875+0000","last_change":"2023-09-30T17:06:30.376920+0000","last_active":"2023-09-30T17:06:30.376875+0000","last_peered":"2023-09-30T17:06:30.376875+0000","last_clean":"2023-09-30T17:06:30.376875+0000","last_became_active":"2023-09-30T17:05:03.308944+0000","last_became_peered":"2023-09-30T17:05:03.308944+0000","last_unstale":"2023-09-30T17:06:30.376875+0000","last_undegraded":"2023-09-30T17:06:30.376875+0000","last_fullsized":"2023-09-30T17:06:30.376875+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:06:30.376777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:06:30.376777+0000","last_clean_scrub_stamp":"2023-09-30T17:06:30.376777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:07:50.954083+0000","scrub_duration":0.0019009960000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:48.694200+0000","last_change":"2023-09-30T17:05:48.694245+0000","last_active":"2023-09-30T17:05:48.694200+0000","last_peered":"2023-09-30T17:05:48.694200+0000","last_clean":"2023-09-30T17:05:48.694200+0000","last_became_active":"2023-09-30T17:05:03.310706+0000","last_became_peered":"2023-09-30T17:05:03.310706+0000","last_unstale":"2023-09-30T17:05:48.694200+0000","last_undegraded":"2023-09-30T17:05:48.694200+0000","last_fullsized":"2023-09-30T17:05:48.694200+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:05:48.694106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:05:48.694106+0000","last_clean_scrub_stamp":"2023-09-30T17:05:48.694106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:45:19.266879+0000","scrub_duration":0.0018395079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"59'9","reported_seq":88,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:06.575982+0000","last_change":"2023-09-30T17:06:06.575982+0000","last_active":"2023-09-30T17:06:06.575982+0000","last_peered":"2023-09-30T17:06:06.575982+0000","last_clean":"2023-09-30T17:06:06.575982+0000","last_became_active":"2023-09-30T17:02:18.363064+0000","last_became_peered":"2023-09-30T17:02:18.363064+0000","last_unstale":"2023-09-30T17:06:06.575982+0000","last_undegraded":"2023-09-30T17:06:06.575982+0000","last_fullsized":"2023-09-30T17:06:06.575982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'9","last_scrub_stamp":"2023-09-30T17:06:06.575750+0000","last_deep_scrub":"59'9","last_deep_scrub_stamp":"2023-09-30T17:06:06.575750+0000","last_clean_scrub_stamp":"2023-09-30T17:06:06.575750+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:58:24.806188+0000","scrub_duration":0.0029458370000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":83,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:33.380479+0000","last_change":"2023-09-30T17:06:33.380529+0000","last_active":"2023-09-30T17:06:33.380479+0000","last_peered":"2023-09-30T17:06:33.380479+0000","last_clean":"2023-09-30T17:06:33.380479+0000","last_became_active":"2023-09-30T17:02:12.327542+0000","last_became_peered":"2023-09-30T17:02:12.327542+0000","last_unstale":"2023-09-30T17:06:33.380479+0000","last_undegraded":"2023-09-30T17:06:33.380479+0000","last_fullsized":"2023-09-30T17:06:33.380479+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:06:33.380386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:06:33.380386+0000","last_clean_scrub_stamp":"2023-09-30T17:06:33.380386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:11:01.470731+0000","scrub_duration":0.001900161,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":83,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:35.373217+0000","last_change":"2023-09-30T17:05:03.305668+0000","last_active":"2023-09-30T17:05:35.373217+0000","last_peered":"2023-09-30T17:05:35.373217+0000","last_clean":"2023-09-30T17:05:35.373217+0000","last_became_active":"2023-09-30T17:05:03.305222+0000","last_became_peered":"2023-09-30T17:05:03.305222+0000","last_unstale":"2023-09-30T17:05:35.373217+0000","last_undegraded":"2023-09-30T17:05:35.373217+0000","last_fullsized":"2023-09-30T17:05:35.373217+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"59'6","reported_seq":76,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310623+0000","last_change":"2023-09-30T17:02:18.364406+0000","last_active":"2023-09-30T17:05:26.310623+0000","last_peered":"2023-09-30T17:05:26.310623+0000","last_clean":"2023-09-30T17:05:26.310623+0000","last_became_active":"2023-09-30T17:02:18.363849+0000","last_became_peered":"2023-09-30T17:02:18.363849+0000","last_unstale":"2023-09-30T17:05:26.310623+0000","last_undegraded":"2023-09-30T17:05:26.310623+0000","last_fullsized":"2023-09-30T17:05:26.310623+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:33.305051+0000","last_change":"2023-09-30T17:06:33.305122+0000","last_active":"2023-09-30T17:06:33.305051+0000","last_peered":"2023-09-30T17:06:33.305051+0000","last_clean":"2023-09-30T17:06:33.305051+0000","last_became_active":"2023-09-30T17:05:03.308958+0000","last_became_peered":"2023-09-30T17:05:03.308958+0000","last_unstale":"2023-09-30T17:06:33.305051+0000","last_undegraded":"2023-09-30T17:06:33.305051+0000","last_fullsized":"2023-09-30T17:06:33.305051+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:06:33.304948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:06:33.304948+0000","last_clean_scrub_stamp":"2023-09-30T17:06:33.304948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:52:55.572531+0000","scrub_duration":0.0016996450000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"76'159","reported_seq":236,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:09.514948+0000","last_change":"2023-09-30T17:06:09.515009+0000","last_active":"2023-09-30T17:06:09.514948+0000","last_peered":"2023-09-30T17:06:09.514948+0000","last_clean":"2023-09-30T17:06:09.514948+0000","last_became_active":"2023-09-30T17:05:03.302265+0000","last_became_peered":"2023-09-30T17:05:03.302265+0000","last_unstale":"2023-09-30T17:06:09.514948+0000","last_undegraded":"2023-09-30T17:06:09.514948+0000","last_fullsized":"2023-09-30T17:06:09.514948+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'159","last_scrub_stamp":"2023-09-30T17:06:09.514837+0000","last_deep_scrub":"76'159","last_deep_scrub_stamp":"2023-09-30T17:06:09.514837+0000","last_clean_scrub_stamp":"2023-09-30T17:06:09.514837+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:46:01.059195+0000","scrub_duration":0.0055217590000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":72,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:35.883992+0000","last_change":"2023-09-30T17:02:17.357139+0000","last_active":"2023-09-30T17:05:35.883992+0000","last_peered":"2023-09-30T17:05:35.883992+0000","last_clean":"2023-09-30T17:05:35.883992+0000","last_became_active":"2023-09-30T17:02:17.356901+0000","last_became_peered":"2023-09-30T17:02:17.356901+0000","last_unstale":"2023-09-30T17:05:35.883992+0000","last_undegraded":"2023-09-30T17:05:35.883992+0000","last_fullsized":"2023-09-30T17:05:35.883992+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"59'7","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:53.612754+0000","last_change":"2023-09-30T17:05:53.612809+0000","last_active":"2023-09-30T17:05:53.612754+0000","last_peered":"2023-09-30T17:05:53.612754+0000","last_clean":"2023-09-30T17:05:53.612754+0000","last_became_active":"2023-09-30T17:05:03.304974+0000","last_became_peered":"2023-09-30T17:05:03.304974+0000","last_unstale":"2023-09-30T17:05:53.612754+0000","last_undegraded":"2023-09-30T17:05:53.612754+0000","last_fullsized":"2023-09-30T17:05:53.612754+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'7","last_scrub_stamp":"2023-09-30T17:05:53.612654+0000","last_deep_scrub":"59'7","last_deep_scrub_stamp":"2023-09-30T17:05:53.612654+0000","last_clean_scrub_stamp":"2023-09-30T17:05:53.612654+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:04:16.815158+0000","scrub_duration":0.00223011,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:49.646389+0000","last_change":"2023-09-30T17:05:49.646435+0000","last_active":"2023-09-30T17:05:49.646389+0000","last_peered":"2023-09-30T17:05:49.646389+0000","last_clean":"2023-09-30T17:05:49.646389+0000","last_became_active":"2023-09-30T17:05:03.302590+0000","last_became_peered":"2023-09-30T17:05:03.302590+0000","last_unstale":"2023-09-30T17:05:49.646389+0000","last_undegraded":"2023-09-30T17:05:49.646389+0000","last_fullsized":"2023-09-30T17:05:49.646389+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:05:49.646266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:05:49.646266+0000","last_clean_scrub_stamp":"2023-09-30T17:05:49.646266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:45:23.943931+0000","scrub_duration":0.002091379,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"59'5","reported_seq":96,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:35.884022+0000","last_change":"2023-09-30T17:05:03.318439+0000","last_active":"2023-09-30T17:05:35.884022+0000","last_peered":"2023-09-30T17:05:35.884022+0000","last_clean":"2023-09-30T17:05:35.884022+0000","last_became_active":"2023-09-30T17:05:03.308059+0000","last_became_peered":"2023-09-30T17:05:03.308059+0000","last_unstale":"2023-09-30T17:05:35.884022+0000","last_undegraded":"2023-09-30T17:05:35.884022+0000","last_fullsized":"2023-09-30T17:05:35.884022+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"59'11252","reported_seq":11330,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:53.639404+0000","last_change":"2023-09-30T17:05:53.639457+0000","last_active":"2023-09-30T17:05:53.639404+0000","last_peered":"2023-09-30T17:05:53.639404+0000","last_clean":"2023-09-30T17:05:53.639404+0000","last_became_active":"2023-09-30T17:02:18.356839+0000","last_became_peered":"2023-09-30T17:02:18.356839+0000","last_unstale":"2023-09-30T17:05:53.639404+0000","last_undegraded":"2023-09-30T17:05:53.639404+0000","last_fullsized":"2023-09-30T17:05:53.639404+0000","mapping_epoch":17,"log_start":"51'6700","ondisk_log_start":"51'6700","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'11252","last_scrub_stamp":"2023-09-30T17:05:53.639286+0000","last_deep_scrub":"59'11252","last_deep_scrub_stamp":"2023-09-30T17:05:53.639286+0000","last_clean_scrub_stamp":"2023-09-30T17:05:53.639286+0000","objects_scrubbed":0,"log_size":4552,"log_dups_size":6700,"ondisk_log_size":4552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:50:12.670739+0000","scrub_duration":0.00330314,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33068,"num_write_kb":157144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":83,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:19.768395+0000","last_change":"2023-09-30T17:06:19.768395+0000","last_active":"2023-09-30T17:06:19.768395+0000","last_peered":"2023-09-30T17:06:19.768395+0000","last_clean":"2023-09-30T17:06:19.768395+0000","last_became_active":"2023-09-30T17:02:12.330154+0000","last_became_peered":"2023-09-30T17:02:12.330154+0000","last_unstale":"2023-09-30T17:06:19.768395+0000","last_undegraded":"2023-09-30T17:06:19.768395+0000","last_fullsized":"2023-09-30T17:06:19.768395+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:06:19.768184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:06:19.768184+0000","last_clean_scrub_stamp":"2023-09-30T17:06:19.768184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:03:33.283618+0000","scrub_duration":0.0018959109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":80,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:19.501381+0000","last_change":"2023-09-30T17:06:19.501381+0000","last_active":"2023-09-30T17:06:19.501381+0000","last_peered":"2023-09-30T17:06:19.501381+0000","last_clean":"2023-09-30T17:06:19.501381+0000","last_became_active":"2023-09-30T17:02:17.360721+0000","last_became_peered":"2023-09-30T17:02:17.360721+0000","last_unstale":"2023-09-30T17:06:19.501381+0000","last_undegraded":"2023-09-30T17:06:19.501381+0000","last_fullsized":"2023-09-30T17:06:19.501381+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:06:19.501185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:06:19.501185+0000","last_clean_scrub_stamp":"2023-09-30T17:06:19.501185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:38:50.894107+0000","scrub_duration":0.0019735519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"59'2836","reported_seq":2927,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:35.373433+0000","last_change":"2023-09-30T17:05:06.293085+0000","last_active":"2023-09-30T17:05:35.373433+0000","last_peered":"2023-09-30T17:05:35.373433+0000","last_clean":"2023-09-30T17:05:35.373433+0000","last_became_active":"2023-09-30T17:05:06.291203+0000","last_became_peered":"2023-09-30T17:05:06.291203+0000","last_unstale":"2023-09-30T17:05:35.373433+0000","last_undegraded":"2023-09-30T17:05:35.373433+0000","last_fullsized":"2023-09-30T17:05:35.373433+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2836,"log_dups_size":0,"ondisk_log_size":2836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8199,"num_write_kb":39048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"76'4","reported_seq":83,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:05.556031+0000","last_change":"2023-09-30T17:06:05.556135+0000","last_active":"2023-09-30T17:06:05.556031+0000","last_peered":"2023-09-30T17:06:05.556031+0000","last_clean":"2023-09-30T17:06:05.556031+0000","last_became_active":"2023-09-30T17:02:17.360494+0000","last_became_peered":"2023-09-30T17:02:17.360494+0000","last_unstale":"2023-09-30T17:06:05.556031+0000","last_undegraded":"2023-09-30T17:06:05.556031+0000","last_fullsized":"2023-09-30T17:06:05.556031+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'4","last_scrub_stamp":"2023-09-30T17:06:05.555918+0000","last_deep_scrub":"76'4","last_deep_scrub_stamp":"2023-09-30T17:06:05.555918+0000","last_clean_scrub_stamp":"2023-09-30T17:06:05.555918+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:08:01.733610+0000","scrub_duration":0.0040480749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":75,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:35.883968+0000","last_change":"2023-09-30T17:02:12.328184+0000","last_active":"2023-09-30T17:05:35.883968+0000","last_peered":"2023-09-30T17:05:35.883968+0000","last_clean":"2023-09-30T17:05:35.883968+0000","last_became_active":"2023-09-30T17:02:12.327898+0000","last_became_peered":"2023-09-30T17:02:12.327898+0000","last_unstale":"2023-09-30T17:05:35.883968+0000","last_undegraded":"2023-09-30T17:05:35.883968+0000","last_fullsized":"2023-09-30T17:05:35.883968+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:11.318349+0000","last_clean_scrub_stamp":"2023-09-30T17:02:11.318349+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"59'8","reported_seq":98,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:43.606760+0000","last_change":"2023-09-30T17:05:43.606760+0000","last_active":"2023-09-30T17:05:43.606760+0000","last_peered":"2023-09-30T17:05:43.606760+0000","last_clean":"2023-09-30T17:05:43.606760+0000","last_became_active":"2023-09-30T17:05:03.308429+0000","last_became_peered":"2023-09-30T17:05:03.308429+0000","last_unstale":"2023-09-30T17:05:43.606760+0000","last_undegraded":"2023-09-30T17:05:43.606760+0000","last_fullsized":"2023-09-30T17:05:43.606760+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'8","last_scrub_stamp":"2023-09-30T17:05:43.606596+0000","last_deep_scrub":"59'8","last_deep_scrub_stamp":"2023-09-30T17:05:43.606596+0000","last_clean_scrub_stamp":"2023-09-30T17:05:43.606596+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:53:16.420602+0000","scrub_duration":0.0021279749999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:15.384235+0000","last_change":"2023-09-30T17:06:15.384331+0000","last_active":"2023-09-30T17:06:15.384235+0000","last_peered":"2023-09-30T17:06:15.384235+0000","last_clean":"2023-09-30T17:06:15.384235+0000","last_became_active":"2023-09-30T17:05:03.302503+0000","last_became_peered":"2023-09-30T17:05:03.302503+0000","last_unstale":"2023-09-30T17:06:15.384235+0000","last_undegraded":"2023-09-30T17:06:15.384235+0000","last_fullsized":"2023-09-30T17:06:15.384235+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:06:15.384091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:06:15.384091+0000","last_clean_scrub_stamp":"2023-09-30T17:06:15.384091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:06:42.084138+0000","scrub_duration":0.0019917400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"76'9","reported_seq":104,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:27.361136+0000","last_change":"2023-09-30T17:06:27.361184+0000","last_active":"2023-09-30T17:06:27.361136+0000","last_peered":"2023-09-30T17:06:27.361136+0000","last_clean":"2023-09-30T17:06:27.361136+0000","last_became_active":"2023-09-30T17:05:03.308201+0000","last_became_peered":"2023-09-30T17:05:03.308201+0000","last_unstale":"2023-09-30T17:06:27.361136+0000","last_undegraded":"2023-09-30T17:06:27.361136+0000","last_fullsized":"2023-09-30T17:06:27.361136+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'9","last_scrub_stamp":"2023-09-30T17:06:27.361040+0000","last_deep_scrub":"76'9","last_deep_scrub_stamp":"2023-09-30T17:06:27.361040+0000","last_clean_scrub_stamp":"2023-09-30T17:06:27.361040+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:44:47.814921+0000","scrub_duration":0.0031875089999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"59'6","reported_seq":96,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:56.694471+0000","last_change":"2023-09-30T17:05:56.694471+0000","last_active":"2023-09-30T17:05:56.694471+0000","last_peered":"2023-09-30T17:05:56.694471+0000","last_clean":"2023-09-30T17:05:56.694471+0000","last_became_active":"2023-09-30T17:05:03.304022+0000","last_became_peered":"2023-09-30T17:05:03.304022+0000","last_unstale":"2023-09-30T17:05:56.694471+0000","last_undegraded":"2023-09-30T17:05:56.694471+0000","last_fullsized":"2023-09-30T17:05:56.694471+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'6","last_scrub_stamp":"2023-09-30T17:05:56.694323+0000","last_deep_scrub":"59'6","last_deep_scrub_stamp":"2023-09-30T17:05:56.694323+0000","last_clean_scrub_stamp":"2023-09-30T17:05:56.694323+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:41:25.703485+0000","scrub_duration":0.0021932589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":91,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:17.761294+0000","last_change":"2023-09-30T17:06:17.761345+0000","last_active":"2023-09-30T17:06:17.761294+0000","last_peered":"2023-09-30T17:06:17.761294+0000","last_clean":"2023-09-30T17:06:17.761294+0000","last_became_active":"2023-09-30T17:05:03.303487+0000","last_became_peered":"2023-09-30T17:05:03.303487+0000","last_unstale":"2023-09-30T17:06:17.761294+0000","last_undegraded":"2023-09-30T17:06:17.761294+0000","last_fullsized":"2023-09-30T17:06:17.761294+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2023-09-30T17:06:17.761177+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2023-09-30T17:06:17.761177+0000","last_clean_scrub_stamp":"2023-09-30T17:06:17.761177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:06:38.928334+0000","scrub_duration":0.0020380239999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"59'2835","reported_seq":2913,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:49.578110+0000","last_change":"2023-09-30T17:05:49.578202+0000","last_active":"2023-09-30T17:05:49.578110+0000","last_peered":"2023-09-30T17:05:49.578110+0000","last_clean":"2023-09-30T17:05:49.578110+0000","last_became_active":"2023-09-30T17:02:18.356902+0000","last_became_peered":"2023-09-30T17:02:18.356902+0000","last_unstale":"2023-09-30T17:05:49.578110+0000","last_undegraded":"2023-09-30T17:05:49.578110+0000","last_fullsized":"2023-09-30T17:05:49.578110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2835","last_scrub_stamp":"2023-09-30T17:05:49.577968+0000","last_deep_scrub":"59'2835","last_deep_scrub_stamp":"2023-09-30T17:05:49.577968+0000","last_clean_scrub_stamp":"2023-09-30T17:05:49.577968+0000","objects_scrubbed":0,"log_size":2835,"log_dups_size":0,"ondisk_log_size":2835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:05:50.365694+0000","scrub_duration":0.0031753789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8302,"num_write_kb":39500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"76'3","reported_seq":42,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:10.550007+0000","last_change":"2023-09-30T17:06:10.550090+0000","last_active":"2023-09-30T17:06:10.550007+0000","last_peered":"2023-09-30T17:06:10.550007+0000","last_clean":"2023-09-30T17:06:10.550007+0000","last_became_active":"2023-09-30T17:05:03.310996+0000","last_became_peered":"2023-09-30T17:05:03.310996+0000","last_unstale":"2023-09-30T17:06:10.550007+0000","last_undegraded":"2023-09-30T17:06:10.550007+0000","last_fullsized":"2023-09-30T17:06:10.550007+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'3","last_scrub_stamp":"2023-09-30T17:06:10.549909+0000","last_deep_scrub":"76'3","last_deep_scrub_stamp":"2023-09-30T17:06:10.549909+0000","last_clean_scrub_stamp":"2023-09-30T17:06:10.549909+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:02:48.238742+0000","scrub_duration":0.0035069649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"59'2848","reported_seq":2924,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:43.643918+0000","last_change":"2023-09-30T17:05:43.644021+0000","last_active":"2023-09-30T17:05:43.643918+0000","last_peered":"2023-09-30T17:05:43.643918+0000","last_clean":"2023-09-30T17:05:43.643918+0000","last_became_active":"2023-09-30T17:05:06.289599+0000","last_became_peered":"2023-09-30T17:05:06.289599+0000","last_unstale":"2023-09-30T17:05:43.643918+0000","last_undegraded":"2023-09-30T17:05:43.643918+0000","last_fullsized":"2023-09-30T17:05:43.643918+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2848","last_scrub_stamp":"2023-09-30T17:05:43.643754+0000","last_deep_scrub":"59'2848","last_deep_scrub_stamp":"2023-09-30T17:05:43.643754+0000","last_clean_scrub_stamp":"2023-09-30T17:05:43.643754+0000","objects_scrubbed":0,"log_size":2848,"log_dups_size":0,"ondisk_log_size":2848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:09:00.902270+0000","scrub_duration":0.0023925259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8235,"num_write_kb":39276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"76'4","reported_seq":95,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:30.952532+0000","last_change":"2023-09-30T17:06:30.952599+0000","last_active":"2023-09-30T17:06:30.952532+0000","last_peered":"2023-09-30T17:06:30.952532+0000","last_clean":"2023-09-30T17:06:30.952532+0000","last_became_active":"2023-09-30T17:05:03.306711+0000","last_became_peered":"2023-09-30T17:05:03.306711+0000","last_unstale":"2023-09-30T17:06:30.952532+0000","last_undegraded":"2023-09-30T17:06:30.952532+0000","last_fullsized":"2023-09-30T17:06:30.952532+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'4","last_scrub_stamp":"2023-09-30T17:06:30.952432+0000","last_deep_scrub":"76'4","last_deep_scrub_stamp":"2023-09-30T17:06:30.952432+0000","last_clean_scrub_stamp":"2023-09-30T17:06:30.952432+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:57:50.588068+0000","scrub_duration":0.003354849,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"59'10","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:06.523686+0000","last_change":"2023-09-30T17:06:06.523754+0000","last_active":"2023-09-30T17:06:06.523686+0000","last_peered":"2023-09-30T17:06:06.523686+0000","last_clean":"2023-09-30T17:06:06.523686+0000","last_became_active":"2023-09-30T17:05:03.310763+0000","last_became_peered":"2023-09-30T17:05:03.310763+0000","last_unstale":"2023-09-30T17:06:06.523686+0000","last_undegraded":"2023-09-30T17:06:06.523686+0000","last_fullsized":"2023-09-30T17:06:06.523686+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'10","last_scrub_stamp":"2023-09-30T17:06:06.523566+0000","last_deep_scrub":"59'10","last_deep_scrub_stamp":"2023-09-30T17:06:06.523566+0000","last_clean_scrub_stamp":"2023-09-30T17:06:06.523566+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:48:10.092815+0000","scrub_duration":0.002623748,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":81,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:07.596434+0000","last_change":"2023-09-30T17:06:07.596434+0000","last_active":"2023-09-30T17:06:07.596434+0000","last_peered":"2023-09-30T17:06:07.596434+0000","last_clean":"2023-09-30T17:06:07.596434+0000","last_became_active":"2023-09-30T17:02:17.360475+0000","last_became_peered":"2023-09-30T17:02:17.360475+0000","last_unstale":"2023-09-30T17:06:07.596434+0000","last_undegraded":"2023-09-30T17:06:07.596434+0000","last_fullsized":"2023-09-30T17:06:07.596434+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2023-09-30T17:06:07.596283+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2023-09-30T17:06:07.596283+0000","last_clean_scrub_stamp":"2023-09-30T17:06:07.596283+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:28:14.693610+0000","scrub_duration":0.0022969660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"59'5711","reported_seq":5789,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:08.654294+0000","last_change":"2023-09-30T17:06:08.654348+0000","last_active":"2023-09-30T17:06:08.654294+0000","last_peered":"2023-09-30T17:06:08.654294+0000","last_clean":"2023-09-30T17:06:08.654294+0000","last_became_active":"2023-09-30T17:02:18.357098+0000","last_became_peered":"2023-09-30T17:02:18.357098+0000","last_unstale":"2023-09-30T17:06:08.654294+0000","last_undegraded":"2023-09-30T17:06:08.654294+0000","last_fullsized":"2023-09-30T17:06:08.654294+0000","mapping_epoch":17,"log_start":"42'1200","ondisk_log_start":"42'1200","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'5711","last_scrub_stamp":"2023-09-30T17:06:08.654151+0000","last_deep_scrub":"59'5711","last_deep_scrub_stamp":"2023-09-30T17:06:08.654151+0000","last_clean_scrub_stamp":"2023-09-30T17:06:08.654151+0000","objects_scrubbed":0,"log_size":4511,"log_dups_size":1200,"ondisk_log_size":4511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:10:37.539726+0000","scrub_duration":0.0037229939999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16681,"num_write_kb":79476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"76'6","reported_seq":97,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:55.637582+0000","last_change":"2023-09-30T17:05:55.637582+0000","last_active":"2023-09-30T17:05:55.637582+0000","last_peered":"2023-09-30T17:05:55.637582+0000","last_clean":"2023-09-30T17:05:55.637582+0000","last_became_active":"2023-09-30T17:05:03.313050+0000","last_became_peered":"2023-09-30T17:05:03.313050+0000","last_unstale":"2023-09-30T17:05:55.637582+0000","last_undegraded":"2023-09-30T17:05:55.637582+0000","last_fullsized":"2023-09-30T17:05:55.637582+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'6","last_scrub_stamp":"2023-09-30T17:05:55.637417+0000","last_deep_scrub":"76'6","last_deep_scrub_stamp":"2023-09-30T17:05:55.637417+0000","last_clean_scrub_stamp":"2023-09-30T17:05:55.637417+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:27:26.801859+0000","scrub_duration":0.006333272,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"59'2872","reported_seq":2940,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309594+0000","last_change":"2023-09-30T17:05:06.290298+0000","last_active":"2023-09-30T17:05:26.309594+0000","last_peered":"2023-09-30T17:05:26.309594+0000","last_clean":"2023-09-30T17:05:26.309594+0000","last_became_active":"2023-09-30T17:05:06.289197+0000","last_became_peered":"2023-09-30T17:05:06.289197+0000","last_unstale":"2023-09-30T17:05:26.309594+0000","last_undegraded":"2023-09-30T17:05:26.309594+0000","last_fullsized":"2023-09-30T17:05:26.309594+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2872,"log_dups_size":0,"ondisk_log_size":2872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8447,"num_write_kb":40072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"59'9","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:54.611596+0000","last_change":"2023-09-30T17:05:54.611653+0000","last_active":"2023-09-30T17:05:54.611596+0000","last_peered":"2023-09-30T17:05:54.611596+0000","last_clean":"2023-09-30T17:05:54.611596+0000","last_became_active":"2023-09-30T17:05:03.310591+0000","last_became_peered":"2023-09-30T17:05:03.310591+0000","last_unstale":"2023-09-30T17:05:54.611596+0000","last_undegraded":"2023-09-30T17:05:54.611596+0000","last_fullsized":"2023-09-30T17:05:54.611596+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'9","last_scrub_stamp":"2023-09-30T17:05:54.611494+0000","last_deep_scrub":"59'9","last_deep_scrub_stamp":"2023-09-30T17:05:54.611494+0000","last_clean_scrub_stamp":"2023-09-30T17:05:54.611494+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:03:16.862122+0000","scrub_duration":0.0022998649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"59'13","reported_seq":92,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:03.582587+0000","last_change":"2023-09-30T17:06:03.582587+0000","last_active":"2023-09-30T17:06:03.582587+0000","last_peered":"2023-09-30T17:06:03.582587+0000","last_clean":"2023-09-30T17:06:03.582587+0000","last_became_active":"2023-09-30T17:02:18.363222+0000","last_became_peered":"2023-09-30T17:02:18.363222+0000","last_unstale":"2023-09-30T17:06:03.582587+0000","last_undegraded":"2023-09-30T17:06:03.582587+0000","last_fullsized":"2023-09-30T17:06:03.582587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'13","last_scrub_stamp":"2023-09-30T17:06:03.582383+0000","last_deep_scrub":"59'13","last_deep_scrub_stamp":"2023-09-30T17:06:03.582383+0000","last_clean_scrub_stamp":"2023-09-30T17:06:03.582383+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:58:49.007492+0000","scrub_duration":0.0032092079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"59'2796","reported_seq":2887,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:35.373643+0000","last_change":"2023-09-30T17:05:06.292455+0000","last_active":"2023-09-30T17:05:35.373643+0000","last_peered":"2023-09-30T17:05:35.373643+0000","last_clean":"2023-09-30T17:05:35.373643+0000","last_became_active":"2023-09-30T17:05:06.290929+0000","last_became_peered":"2023-09-30T17:05:06.290929+0000","last_unstale":"2023-09-30T17:05:35.373643+0000","last_undegraded":"2023-09-30T17:05:35.373643+0000","last_fullsized":"2023-09-30T17:05:35.373643+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2796,"log_dups_size":0,"ondisk_log_size":2796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8138,"num_write_kb":38784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"59'2852","reported_seq":2931,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:59.672667+0000","last_change":"2023-09-30T17:05:59.672667+0000","last_active":"2023-09-30T17:05:59.672667+0000","last_peered":"2023-09-30T17:05:59.672667+0000","last_clean":"2023-09-30T17:05:59.672667+0000","last_became_active":"2023-09-30T17:02:18.362894+0000","last_became_peered":"2023-09-30T17:02:18.362894+0000","last_unstale":"2023-09-30T17:05:59.672667+0000","last_undegraded":"2023-09-30T17:05:59.672667+0000","last_fullsized":"2023-09-30T17:05:59.672667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2852","last_scrub_stamp":"2023-09-30T17:05:59.672454+0000","last_deep_scrub":"59'2852","last_deep_scrub_stamp":"2023-09-30T17:05:59.672454+0000","last_clean_scrub_stamp":"2023-09-30T17:05:59.672454+0000","objects_scrubbed":0,"log_size":2852,"log_dups_size":0,"ondisk_log_size":2852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:25:06.256229+0000","scrub_duration":0.0033008859999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8357,"num_write_kb":39780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"59'2874","reported_seq":2964,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310152+0000","last_change":"2023-09-30T17:05:06.294279+0000","last_active":"2023-09-30T17:05:26.310152+0000","last_peered":"2023-09-30T17:05:26.310152+0000","last_clean":"2023-09-30T17:05:26.310152+0000","last_became_active":"2023-09-30T17:05:06.292898+0000","last_became_peered":"2023-09-30T17:05:06.292898+0000","last_unstale":"2023-09-30T17:05:26.310152+0000","last_undegraded":"2023-09-30T17:05:26.310152+0000","last_fullsized":"2023-09-30T17:05:26.310152+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2874,"log_dups_size":0,"ondisk_log_size":2874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8465,"num_write_kb":40104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":532685,"num_write_kb":2575302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140940,"ondisk_log_size":140940,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":228927,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":137,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":223425,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":524288,"data_stored":457854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},"log_size":152,"ondisk_log_size":152,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":66,"seq":283467841557,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47036,"kb_used_data":1460,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94324804,"statfs":{"total":96636764160,"available":96588599296,"internally_reserved":0,"allocated":1495040,"data_stored":1123985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7139,"internal_metadata":46654493},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 17:06:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.33300000000000002}]},{"osd":1,"last update":"Sat Sep 30 17:06:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.57599999999999996}]}]},{"osd":0,"up_from":8,"seq":34359738426,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":582448,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":580990,"kb_avail":93789392,"statfs":{"total":96636764160,"available":96040337408,"internally_reserved":0,"allocated":1482752,"data_stored":1122763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":594934214},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 17:06:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.51400000000000001,"15min":0.48799999999999999},"min":{"1min":0.317,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.58199999999999996,"5min":5.9480000000000004,"15min":5.9480000000000004},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.50800000000000001,"15min":0.46500000000000002},"min":{"1min":0.27700000000000002,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.70899999999999996,"5min":3.6819999999999999,"15min":3.6819999999999999},"last":0.49199999999999999}]},{"osd":2,"last update":"Sat Sep 30 17:06:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.45200000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738426,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":563588,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":562942,"kb_avail":93808252,"statfs":{"total":96636764160,"available":96059650048,"internally_reserved":0,"allocated":651264,"data_stored":305912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":576453062},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 17:06:14 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.48699999999999999,"15min":0.45600000000000002},"min":{"1min":0.29999999999999999,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.65500000000000003,"5min":3.3420000000000001,"15min":3.3420000000000001},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.52100000000000002,"15min":0.46300000000000002},"min":{"1min":0.32900000000000001,"5min":0.188,"15min":0.188},"max":{"1min":0.60599999999999998,"5min":3.5470000000000002,"15min":3.5470000000000002},"last":0.39700000000000002}]},{"osd":2,"last update":"Sat Sep 30 17:06:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.50700000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":249856,"data_stored":227705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":228927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T17:06:40.781 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:40.781 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:40.781 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:40.781 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:40.782 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:40.782 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:40.782 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:40.782 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:40.782 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:40.782 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:40.783 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:40.812 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:40.813 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:40.813 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:40.813 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:40.813 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:40.813 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:40.813 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:40.813 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:40.814 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:40.814 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:40.814 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:40.814 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:40.814 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:40.814 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:40.814 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:40.815 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:40.815 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:40.815 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2023-09-30T17:02:11.318349+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=11, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:40.815 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:40.815 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:40.815 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:40.815 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:40.816 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:40.816 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2023-09-30T17:02:11.318349+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=11, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:40.816 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:40.816 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:40.816 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:06:40.816 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-30T17:07:00.817 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T17:07:01.174 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:07:01.175 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-09-30T17:07:01.186 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":221,"stamp":"2023-09-30T17:06:59.363213+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":819295,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":140,"num_read_kb":122,"num_write":533025,"num_write_kb":2579054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":223425,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141252,"ondisk_log_size":141252,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1193072,"kb_used_data":3544,"kb_used_omap":10,"kb_used_meta":1189493,"kb_avail":281922448,"statfs":{"total":289910292480,"available":288688586752,"internally_reserved":0,"allocated":3629056,"data_stored":2552660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10327,"internal_metadata":1218041769},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003098"},"pg_stats":[{"pgid":"4.3f","version":"59'2790","reported_seq":2869,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:47.554662+0000","last_change":"2023-09-30T17:05:47.554662+0000","last_active":"2023-09-30T17:05:47.554662+0000","last_peered":"2023-09-30T17:05:47.554662+0000","last_clean":"2023-09-30T17:05:47.554662+0000","last_became_active":"2023-09-30T17:02:18.358716+0000","last_became_peered":"2023-09-30T17:02:18.358716+0000","last_unstale":"2023-09-30T17:05:47.554662+0000","last_undegraded":"2023-09-30T17:05:47.554662+0000","last_fullsized":"2023-09-30T17:05:47.554662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2790","last_scrub_stamp":"2023-09-30T17:05:47.554500+0000","last_deep_scrub":"59'2790","last_deep_scrub_stamp":"2023-09-30T17:05:47.554500+0000","last_clean_scrub_stamp":"2023-09-30T17:05:47.554500+0000","objects_scrubbed":0,"log_size":2790,"log_dups_size":0,"ondisk_log_size":2790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:40:37.069833+0000","scrub_duration":0.0021350679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8214,"num_write_kb":38924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"59'4","reported_seq":83,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:39.661898+0000","last_change":"2023-09-30T17:05:39.661898+0000","last_active":"2023-09-30T17:05:39.661898+0000","last_peered":"2023-09-30T17:05:39.661898+0000","last_clean":"2023-09-30T17:05:39.661898+0000","last_became_active":"2023-09-30T17:02:18.360372+0000","last_became_peered":"2023-09-30T17:02:18.360372+0000","last_unstale":"2023-09-30T17:05:39.661898+0000","last_undegraded":"2023-09-30T17:05:39.661898+0000","last_fullsized":"2023-09-30T17:05:39.661898+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'4","last_scrub_stamp":"2023-09-30T17:05:39.661696+0000","last_deep_scrub":"59'4","last_deep_scrub_stamp":"2023-09-30T17:05:39.661696+0000","last_clean_scrub_stamp":"2023-09-30T17:05:39.661696+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:53:12.475703+0000","scrub_duration":0.0028517759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"59'5697","reported_seq":5772,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310130+0000","last_change":"2023-09-30T17:05:06.291597+0000","last_active":"2023-09-30T17:05:26.310130+0000","last_peered":"2023-09-30T17:05:26.310130+0000","last_clean":"2023-09-30T17:05:26.310130+0000","last_became_active":"2023-09-30T17:05:06.290447+0000","last_became_peered":"2023-09-30T17:05:06.290447+0000","last_unstale":"2023-09-30T17:05:26.310130+0000","last_undegraded":"2023-09-30T17:05:26.310130+0000","last_fullsized":"2023-09-30T17:05:26.310130+0000","mapping_epoch":69,"log_start":"42'1200","ondisk_log_start":"42'1200","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4497,"log_dups_size":1200,"ondisk_log_size":4497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16590,"num_write_kb":78960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"59'10","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:40.333726+0000","last_change":"2023-09-30T17:06:40.333812+0000","last_active":"2023-09-30T17:06:40.333726+0000","last_peered":"2023-09-30T17:06:40.333726+0000","last_clean":"2023-09-30T17:06:40.333726+0000","last_became_active":"2023-09-30T17:05:03.309326+0000","last_became_peered":"2023-09-30T17:05:03.309326+0000","last_unstale":"2023-09-30T17:06:40.333726+0000","last_undegraded":"2023-09-30T17:06:40.333726+0000","last_fullsized":"2023-09-30T17:06:40.333726+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'10","last_scrub_stamp":"2023-09-30T17:06:40.333585+0000","last_deep_scrub":"59'10","last_deep_scrub_stamp":"2023-09-30T17:06:40.333585+0000","last_clean_scrub_stamp":"2023-09-30T17:06:40.333585+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:59:27.119913+0000","scrub_duration":0.0025354900000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"59'2934","reported_seq":3012,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:50.604137+0000","last_change":"2023-09-30T17:05:50.604194+0000","last_active":"2023-09-30T17:05:50.604137+0000","last_peered":"2023-09-30T17:05:50.604137+0000","last_clean":"2023-09-30T17:05:50.604137+0000","last_became_active":"2023-09-30T17:02:18.357317+0000","last_became_peered":"2023-09-30T17:02:18.357317+0000","last_unstale":"2023-09-30T17:05:50.604137+0000","last_undegraded":"2023-09-30T17:05:50.604137+0000","last_fullsized":"2023-09-30T17:05:50.604137+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2934","last_scrub_stamp":"2023-09-30T17:05:50.604022+0000","last_deep_scrub":"59'2934","last_deep_scrub_stamp":"2023-09-30T17:05:50.604022+0000","last_clean_scrub_stamp":"2023-09-30T17:05:50.604022+0000","objects_scrubbed":0,"log_size":2934,"log_dups_size":0,"ondisk_log_size":2934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:13:55.986563+0000","scrub_duration":0.00343991,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8466,"num_write_kb":40084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"59'6","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:56.578435+0000","last_change":"2023-09-30T17:05:56.578507+0000","last_active":"2023-09-30T17:05:56.578435+0000","last_peered":"2023-09-30T17:05:56.578435+0000","last_clean":"2023-09-30T17:05:56.578435+0000","last_became_active":"2023-09-30T17:05:03.310703+0000","last_became_peered":"2023-09-30T17:05:03.310703+0000","last_unstale":"2023-09-30T17:05:56.578435+0000","last_undegraded":"2023-09-30T17:05:56.578435+0000","last_fullsized":"2023-09-30T17:05:56.578435+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'6","last_scrub_stamp":"2023-09-30T17:05:56.578325+0000","last_deep_scrub":"59'6","last_deep_scrub_stamp":"2023-09-30T17:05:56.578325+0000","last_clean_scrub_stamp":"2023-09-30T17:05:56.578325+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:27:47.196956+0000","scrub_duration":0.0024309819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"59'7","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:49.354595+0000","last_change":"2023-09-30T17:06:49.354643+0000","last_active":"2023-09-30T17:06:49.354595+0000","last_peered":"2023-09-30T17:06:49.354595+0000","last_clean":"2023-09-30T17:06:49.354595+0000","last_became_active":"2023-09-30T17:05:03.310047+0000","last_became_peered":"2023-09-30T17:05:03.310047+0000","last_unstale":"2023-09-30T17:06:49.354595+0000","last_undegraded":"2023-09-30T17:06:49.354595+0000","last_fullsized":"2023-09-30T17:06:49.354595+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'7","last_scrub_stamp":"2023-09-30T17:06:49.354462+0000","last_deep_scrub":"59'7","last_deep_scrub_stamp":"2023-09-30T17:06:49.354462+0000","last_clean_scrub_stamp":"2023-09-30T17:06:49.354462+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:51:46.105140+0000","scrub_duration":0.003225407,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"59'11423","reported_seq":11508,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:23.326516+0000","last_change":"2023-09-30T17:06:23.326573+0000","last_active":"2023-09-30T17:06:23.326516+0000","last_peered":"2023-09-30T17:06:23.326516+0000","last_clean":"2023-09-30T17:06:23.326516+0000","last_became_active":"2023-09-30T17:05:06.285582+0000","last_became_peered":"2023-09-30T17:05:06.285582+0000","last_unstale":"2023-09-30T17:06:23.326516+0000","last_undegraded":"2023-09-30T17:06:23.326516+0000","last_fullsized":"2023-09-30T17:06:23.326516+0000","mapping_epoch":69,"log_start":"52'7200","ondisk_log_start":"52'7200","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'11423","last_scrub_stamp":"2023-09-30T17:06:23.326398+0000","last_deep_scrub":"59'11423","last_deep_scrub_stamp":"2023-09-30T17:06:23.326398+0000","last_clean_scrub_stamp":"2023-09-30T17:06:23.326398+0000","objects_scrubbed":0,"log_size":4223,"log_dups_size":5777,"ondisk_log_size":4223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:42:30.429670+0000","scrub_duration":0.0025180100000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33444,"num_write_kb":158924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"59'8589","reported_seq":8659,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310331+0000","last_change":"2023-09-30T17:02:18.364222+0000","last_active":"2023-09-30T17:05:26.310331+0000","last_peered":"2023-09-30T17:05:26.310331+0000","last_clean":"2023-09-30T17:05:26.310331+0000","last_became_active":"2023-09-30T17:02:18.363485+0000","last_became_peered":"2023-09-30T17:02:18.363485+0000","last_unstale":"2023-09-30T17:05:26.310331+0000","last_undegraded":"2023-09-30T17:05:26.310331+0000","last_fullsized":"2023-09-30T17:05:26.310331+0000","mapping_epoch":17,"log_start":"49'4400","ondisk_log_start":"49'4400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4189,"log_dups_size":4400,"ondisk_log_size":4189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25052,"num_write_kb":118756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"59'8585","reported_seq":8663,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:01.724899+0000","last_change":"2023-09-30T17:06:01.724952+0000","last_active":"2023-09-30T17:06:01.724899+0000","last_peered":"2023-09-30T17:06:01.724899+0000","last_clean":"2023-09-30T17:06:01.724899+0000","last_became_active":"2023-09-30T17:02:18.358396+0000","last_became_peered":"2023-09-30T17:02:18.358396+0000","last_unstale":"2023-09-30T17:06:01.724899+0000","last_undegraded":"2023-09-30T17:06:01.724899+0000","last_fullsized":"2023-09-30T17:06:01.724899+0000","mapping_epoch":17,"log_start":"48'4100","ondisk_log_start":"48'4100","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'8585","last_scrub_stamp":"2023-09-30T17:06:01.724792+0000","last_deep_scrub":"59'8585","last_deep_scrub_stamp":"2023-09-30T17:06:01.724792+0000","last_clean_scrub_stamp":"2023-09-30T17:06:01.724792+0000","objects_scrubbed":0,"log_size":4485,"log_dups_size":4100,"ondisk_log_size":4485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:35:48.146536+0000","scrub_duration":0.0040357209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24997,"num_write_kb":162463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"59'5664","reported_seq":5749,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:46.618589+0000","last_change":"2023-09-30T17:05:46.618636+0000","last_active":"2023-09-30T17:05:46.618589+0000","last_peered":"2023-09-30T17:05:46.618589+0000","last_clean":"2023-09-30T17:05:46.618589+0000","last_became_active":"2023-09-30T17:05:06.290193+0000","last_became_peered":"2023-09-30T17:05:06.290193+0000","last_unstale":"2023-09-30T17:05:46.618589+0000","last_undegraded":"2023-09-30T17:05:46.618589+0000","last_fullsized":"2023-09-30T17:05:46.618589+0000","mapping_epoch":69,"log_start":"43'1400","ondisk_log_start":"43'1400","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'5664","last_scrub_stamp":"2023-09-30T17:05:46.618493+0000","last_deep_scrub":"59'5664","last_deep_scrub_stamp":"2023-09-30T17:05:46.618493+0000","last_clean_scrub_stamp":"2023-09-30T17:05:46.618493+0000","objects_scrubbed":0,"log_size":4264,"log_dups_size":1400,"ondisk_log_size":4264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:50:52.323251+0000","scrub_duration":0.0029415959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16442,"num_write_kb":78308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"59'2931","reported_seq":3021,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309813+0000","last_change":"2023-09-30T17:05:06.290270+0000","last_active":"2023-09-30T17:05:26.309813+0000","last_peered":"2023-09-30T17:05:26.309813+0000","last_clean":"2023-09-30T17:05:26.309813+0000","last_became_active":"2023-09-30T17:05:06.288753+0000","last_became_peered":"2023-09-30T17:05:06.288753+0000","last_unstale":"2023-09-30T17:05:26.309813+0000","last_undegraded":"2023-09-30T17:05:26.309813+0000","last_fullsized":"2023-09-30T17:05:26.309813+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2931,"log_dups_size":0,"ondisk_log_size":2931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8488,"num_write_kb":40364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"59'2860","reported_seq":2938,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:12.712346+0000","last_change":"2023-09-30T17:06:12.712399+0000","last_active":"2023-09-30T17:06:12.712346+0000","last_peered":"2023-09-30T17:06:12.712346+0000","last_clean":"2023-09-30T17:06:12.712346+0000","last_became_active":"2023-09-30T17:02:18.358534+0000","last_became_peered":"2023-09-30T17:02:18.358534+0000","last_unstale":"2023-09-30T17:06:12.712346+0000","last_undegraded":"2023-09-30T17:06:12.712346+0000","last_fullsized":"2023-09-30T17:06:12.712346+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2860","last_scrub_stamp":"2023-09-30T17:06:12.712247+0000","last_deep_scrub":"59'2860","last_deep_scrub_stamp":"2023-09-30T17:06:12.712247+0000","last_clean_scrub_stamp":"2023-09-30T17:06:12.712247+0000","objects_scrubbed":0,"log_size":2860,"log_dups_size":0,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:44:33.166129+0000","scrub_duration":0.002572104,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8367,"num_write_kb":39772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"59'2911","reported_seq":2987,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:42.691805+0000","last_change":"2023-09-30T17:05:42.691905+0000","last_active":"2023-09-30T17:05:42.691805+0000","last_peered":"2023-09-30T17:05:42.691805+0000","last_clean":"2023-09-30T17:05:42.691805+0000","last_became_active":"2023-09-30T17:05:06.288360+0000","last_became_peered":"2023-09-30T17:05:06.288360+0000","last_unstale":"2023-09-30T17:05:42.691805+0000","last_undegraded":"2023-09-30T17:05:42.691805+0000","last_fullsized":"2023-09-30T17:05:42.691805+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2911","last_scrub_stamp":"2023-09-30T17:05:42.691679+0000","last_deep_scrub":"59'2911","last_deep_scrub_stamp":"2023-09-30T17:05:42.691679+0000","last_clean_scrub_stamp":"2023-09-30T17:05:42.691679+0000","objects_scrubbed":0,"log_size":2911,"log_dups_size":0,"ondisk_log_size":2911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:58:28.142176+0000","scrub_duration":0.0030980600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8419,"num_write_kb":39940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"59'2889","reported_seq":2965,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:47.659737+0000","last_change":"2023-09-30T17:05:47.659805+0000","last_active":"2023-09-30T17:05:47.659737+0000","last_peered":"2023-09-30T17:05:47.659737+0000","last_clean":"2023-09-30T17:05:47.659737+0000","last_became_active":"2023-09-30T17:05:06.285738+0000","last_became_peered":"2023-09-30T17:05:06.285738+0000","last_unstale":"2023-09-30T17:05:47.659737+0000","last_undegraded":"2023-09-30T17:05:47.659737+0000","last_fullsized":"2023-09-30T17:05:47.659737+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2889","last_scrub_stamp":"2023-09-30T17:05:47.659610+0000","last_deep_scrub":"59'2889","last_deep_scrub_stamp":"2023-09-30T17:05:47.659610+0000","last_clean_scrub_stamp":"2023-09-30T17:05:47.659610+0000","objects_scrubbed":0,"log_size":2889,"log_dups_size":0,"ondisk_log_size":2889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:55:36.031386+0000","scrub_duration":0.0023223979999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8435,"num_write_kb":39984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"59'2839","reported_seq":2907,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309323+0000","last_change":"2023-09-30T17:05:06.291173+0000","last_active":"2023-09-30T17:05:26.309323+0000","last_peered":"2023-09-30T17:05:26.309323+0000","last_clean":"2023-09-30T17:05:26.309323+0000","last_became_active":"2023-09-30T17:05:06.289872+0000","last_became_peered":"2023-09-30T17:05:06.289872+0000","last_unstale":"2023-09-30T17:05:26.309323+0000","last_undegraded":"2023-09-30T17:05:26.309323+0000","last_fullsized":"2023-09-30T17:05:26.309323+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2839,"log_dups_size":0,"ondisk_log_size":2839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8166,"num_write_kb":38928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"59'2802","reported_seq":2880,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:23.436587+0000","last_change":"2023-09-30T17:06:23.436665+0000","last_active":"2023-09-30T17:06:23.436587+0000","last_peered":"2023-09-30T17:06:23.436587+0000","last_clean":"2023-09-30T17:06:23.436587+0000","last_became_active":"2023-09-30T17:02:18.363697+0000","last_became_peered":"2023-09-30T17:02:18.363697+0000","last_unstale":"2023-09-30T17:06:23.436587+0000","last_undegraded":"2023-09-30T17:06:23.436587+0000","last_fullsized":"2023-09-30T17:06:23.436587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2802","last_scrub_stamp":"2023-09-30T17:06:23.436443+0000","last_deep_scrub":"59'2802","last_deep_scrub_stamp":"2023-09-30T17:06:23.436443+0000","last_clean_scrub_stamp":"2023-09-30T17:06:23.436443+0000","objects_scrubbed":0,"log_size":2802,"log_dups_size":0,"ondisk_log_size":2802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:46:24.401617+0000","scrub_duration":0.0024206399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8256,"num_write_kb":39208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"59'2860","reported_seq":2938,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:57.725965+0000","last_change":"2023-09-30T17:05:57.726023+0000","last_active":"2023-09-30T17:05:57.725965+0000","last_peered":"2023-09-30T17:05:57.725965+0000","last_clean":"2023-09-30T17:05:57.725965+0000","last_became_active":"2023-09-30T17:02:18.357184+0000","last_became_peered":"2023-09-30T17:02:18.357184+0000","last_unstale":"2023-09-30T17:05:57.725965+0000","last_undegraded":"2023-09-30T17:05:57.725965+0000","last_fullsized":"2023-09-30T17:05:57.725965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2860","last_scrub_stamp":"2023-09-30T17:05:57.725852+0000","last_deep_scrub":"59'2860","last_deep_scrub_stamp":"2023-09-30T17:05:57.725852+0000","last_clean_scrub_stamp":"2023-09-30T17:05:57.725852+0000","objects_scrubbed":0,"log_size":2860,"log_dups_size":0,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:28:04.823179+0000","scrub_duration":0.003284379,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8368,"num_write_kb":39616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"59'5686","reported_seq":5757,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:35.884445+0000","last_change":"2023-09-30T17:02:18.363956+0000","last_active":"2023-09-30T17:05:35.884445+0000","last_peered":"2023-09-30T17:05:35.884445+0000","last_clean":"2023-09-30T17:05:35.884445+0000","last_became_active":"2023-09-30T17:02:18.363654+0000","last_became_peered":"2023-09-30T17:02:18.363654+0000","last_unstale":"2023-09-30T17:05:35.884445+0000","last_undegraded":"2023-09-30T17:05:35.884445+0000","last_fullsized":"2023-09-30T17:05:35.884445+0000","mapping_epoch":17,"log_start":"44'1500","ondisk_log_start":"44'1500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4186,"log_dups_size":1500,"ondisk_log_size":4186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16649,"num_write_kb":78956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"59'5799","reported_seq":5877,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309847+0000","last_change":"2023-09-30T17:05:06.290994+0000","last_active":"2023-09-30T17:05:26.309847+0000","last_peered":"2023-09-30T17:05:26.309847+0000","last_clean":"2023-09-30T17:05:26.309847+0000","last_became_active":"2023-09-30T17:05:06.289817+0000","last_became_peered":"2023-09-30T17:05:06.289817+0000","last_unstale":"2023-09-30T17:05:26.309847+0000","last_undegraded":"2023-09-30T17:05:26.309847+0000","last_fullsized":"2023-09-30T17:05:26.309847+0000","mapping_epoch":69,"log_start":"44'1600","ondisk_log_start":"44'1600","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4199,"log_dups_size":1600,"ondisk_log_size":4199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16903,"num_write_kb":80184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"59'12","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:21.397922+0000","last_change":"2023-09-30T17:06:21.397978+0000","last_active":"2023-09-30T17:06:21.397922+0000","last_peered":"2023-09-30T17:06:21.397922+0000","last_clean":"2023-09-30T17:06:21.397922+0000","last_became_active":"2023-09-30T17:05:03.309537+0000","last_became_peered":"2023-09-30T17:05:03.309537+0000","last_unstale":"2023-09-30T17:06:21.397922+0000","last_undegraded":"2023-09-30T17:06:21.397922+0000","last_fullsized":"2023-09-30T17:06:21.397922+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'12","last_scrub_stamp":"2023-09-30T17:06:21.397829+0000","last_deep_scrub":"59'12","last_deep_scrub_stamp":"2023-09-30T17:06:21.397829+0000","last_clean_scrub_stamp":"2023-09-30T17:06:21.397829+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:09:16.446743+0000","scrub_duration":0.0024723459999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"59'2879","reported_seq":2970,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:35.373704+0000","last_change":"2023-09-30T17:05:06.292705+0000","last_active":"2023-09-30T17:05:35.373704+0000","last_peered":"2023-09-30T17:05:35.373704+0000","last_clean":"2023-09-30T17:05:35.373704+0000","last_became_active":"2023-09-30T17:05:06.290797+0000","last_became_peered":"2023-09-30T17:05:06.290797+0000","last_unstale":"2023-09-30T17:05:35.373704+0000","last_undegraded":"2023-09-30T17:05:35.373704+0000","last_fullsized":"2023-09-30T17:05:35.373704+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2879,"log_dups_size":0,"ondisk_log_size":2879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8343,"num_write_kb":39768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"59'2809","reported_seq":2908,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:30.315229+0000","last_change":"2023-09-30T17:06:30.315229+0000","last_active":"2023-09-30T17:06:30.315229+0000","last_peered":"2023-09-30T17:06:30.315229+0000","last_clean":"2023-09-30T17:06:30.315229+0000","last_became_active":"2023-09-30T17:05:06.288837+0000","last_became_peered":"2023-09-30T17:05:06.288837+0000","last_unstale":"2023-09-30T17:06:30.315229+0000","last_undegraded":"2023-09-30T17:06:30.315229+0000","last_fullsized":"2023-09-30T17:06:30.315229+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2809","last_scrub_stamp":"2023-09-30T17:06:30.315071+0000","last_deep_scrub":"59'2809","last_deep_scrub_stamp":"2023-09-30T17:06:30.315071+0000","last_clean_scrub_stamp":"2023-09-30T17:06:30.315071+0000","objects_scrubbed":0,"log_size":2809,"log_dups_size":0,"ondisk_log_size":2809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:06:21.933414+0000","scrub_duration":0.002757893,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8281,"num_write_kb":39472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"59'5585","reported_seq":5664,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:11.715889+0000","last_change":"2023-09-30T17:06:11.715889+0000","last_active":"2023-09-30T17:06:11.715889+0000","last_peered":"2023-09-30T17:06:11.715889+0000","last_clean":"2023-09-30T17:06:11.715889+0000","last_became_active":"2023-09-30T17:02:18.353632+0000","last_became_peered":"2023-09-30T17:02:18.353632+0000","last_unstale":"2023-09-30T17:06:11.715889+0000","last_undegraded":"2023-09-30T17:06:11.715889+0000","last_fullsized":"2023-09-30T17:06:11.715889+0000","mapping_epoch":17,"log_start":"42'1100","ondisk_log_start":"42'1100","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'5585","last_scrub_stamp":"2023-09-30T17:06:11.715704+0000","last_deep_scrub":"59'5585","last_deep_scrub_stamp":"2023-09-30T17:06:11.715704+0000","last_clean_scrub_stamp":"2023-09-30T17:06:11.715704+0000","objects_scrubbed":0,"log_size":4485,"log_dups_size":1100,"ondisk_log_size":4485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:47:36.619172+0000","scrub_duration":0.003196726,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16523,"num_write_kb":78256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"59'2888","reported_seq":2987,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:50.070801+0000","last_change":"2023-09-30T17:06:50.070850+0000","last_active":"2023-09-30T17:06:50.070801+0000","last_peered":"2023-09-30T17:06:50.070801+0000","last_clean":"2023-09-30T17:06:50.070801+0000","last_became_active":"2023-09-30T17:05:06.291346+0000","last_became_peered":"2023-09-30T17:05:06.291346+0000","last_unstale":"2023-09-30T17:06:50.070801+0000","last_undegraded":"2023-09-30T17:06:50.070801+0000","last_fullsized":"2023-09-30T17:06:50.070801+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2888","last_scrub_stamp":"2023-09-30T17:06:50.070681+0000","last_deep_scrub":"59'2888","last_deep_scrub_stamp":"2023-09-30T17:06:50.070681+0000","last_clean_scrub_stamp":"2023-09-30T17:06:50.070681+0000","objects_scrubbed":0,"log_size":2888,"log_dups_size":0,"ondisk_log_size":2888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:18:59.884108+0000","scrub_duration":0.0026376699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8371,"num_write_kb":39716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"59'18","reported_seq":108,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:41.585602+0000","last_change":"2023-09-30T17:05:41.585602+0000","last_active":"2023-09-30T17:05:41.585602+0000","last_peered":"2023-09-30T17:05:41.585602+0000","last_clean":"2023-09-30T17:05:41.585602+0000","last_became_active":"2023-09-30T17:05:03.308884+0000","last_became_peered":"2023-09-30T17:05:03.308884+0000","last_unstale":"2023-09-30T17:05:41.585602+0000","last_undegraded":"2023-09-30T17:05:41.585602+0000","last_fullsized":"2023-09-30T17:05:41.585602+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'18","last_scrub_stamp":"2023-09-30T17:05:41.585439+0000","last_deep_scrub":"59'18","last_deep_scrub_stamp":"2023-09-30T17:05:41.585439+0000","last_clean_scrub_stamp":"2023-09-30T17:05:41.585439+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:29:52.984290+0000","scrub_duration":0.0024239769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"59'2855","reported_seq":2924,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309973+0000","last_change":"2023-09-30T17:05:06.291369+0000","last_active":"2023-09-30T17:05:26.309973+0000","last_peered":"2023-09-30T17:05:26.309973+0000","last_clean":"2023-09-30T17:05:26.309973+0000","last_became_active":"2023-09-30T17:05:06.289447+0000","last_became_peered":"2023-09-30T17:05:06.289447+0000","last_unstale":"2023-09-30T17:05:26.309973+0000","last_undegraded":"2023-09-30T17:05:26.309973+0000","last_fullsized":"2023-09-30T17:05:26.309973+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2855,"log_dups_size":0,"ondisk_log_size":2855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8347,"num_write_kb":39608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":80,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:31.986542+0000","last_change":"2023-09-30T17:06:31.986601+0000","last_active":"2023-09-30T17:06:31.986542+0000","last_peered":"2023-09-30T17:06:31.986542+0000","last_clean":"2023-09-30T17:06:31.986542+0000","last_became_active":"2023-09-30T17:02:17.357890+0000","last_became_peered":"2023-09-30T17:02:17.357890+0000","last_unstale":"2023-09-30T17:06:31.986542+0000","last_undegraded":"2023-09-30T17:06:31.986542+0000","last_fullsized":"2023-09-30T17:06:31.986542+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2023-09-30T17:06:31.986457+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2023-09-30T17:06:31.986457+0000","last_clean_scrub_stamp":"2023-09-30T17:06:31.986457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:02:20.507667+0000","scrub_duration":0.0021959599999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"59'17","reported_seq":106,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:45.592687+0000","last_change":"2023-09-30T17:05:45.592781+0000","last_active":"2023-09-30T17:05:45.592687+0000","last_peered":"2023-09-30T17:05:45.592687+0000","last_clean":"2023-09-30T17:05:45.592687+0000","last_became_active":"2023-09-30T17:05:03.307012+0000","last_became_peered":"2023-09-30T17:05:03.307012+0000","last_unstale":"2023-09-30T17:05:45.592687+0000","last_undegraded":"2023-09-30T17:05:45.592687+0000","last_fullsized":"2023-09-30T17:05:45.592687+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'17","last_scrub_stamp":"2023-09-30T17:05:45.592562+0000","last_deep_scrub":"59'17","last_deep_scrub_stamp":"2023-09-30T17:05:45.592562+0000","last_clean_scrub_stamp":"2023-09-30T17:05:45.592562+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:53:58.476399+0000","scrub_duration":0.0024751999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":90,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:52.299615+0000","last_change":"2023-09-30T17:06:52.299678+0000","last_active":"2023-09-30T17:06:52.299615+0000","last_peered":"2023-09-30T17:06:52.299615+0000","last_clean":"2023-09-30T17:06:52.299615+0000","last_became_active":"2023-09-30T17:05:03.308073+0000","last_became_peered":"2023-09-30T17:05:03.308073+0000","last_unstale":"2023-09-30T17:06:52.299615+0000","last_undegraded":"2023-09-30T17:06:52.299615+0000","last_fullsized":"2023-09-30T17:06:52.299615+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:06:52.299479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:06:52.299479+0000","last_clean_scrub_stamp":"2023-09-30T17:06:52.299479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:15:52.069660+0000","scrub_duration":0.0020661820000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"59'6","reported_seq":88,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:35.884334+0000","last_change":"2023-09-30T17:05:03.308692+0000","last_active":"2023-09-30T17:05:35.884334+0000","last_peered":"2023-09-30T17:05:35.884334+0000","last_clean":"2023-09-30T17:05:35.884334+0000","last_became_active":"2023-09-30T17:05:03.307932+0000","last_became_peered":"2023-09-30T17:05:03.307932+0000","last_unstale":"2023-09-30T17:05:35.884334+0000","last_undegraded":"2023-09-30T17:05:35.884334+0000","last_fullsized":"2023-09-30T17:05:35.884334+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":79,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:00.631465+0000","last_change":"2023-09-30T17:06:00.631555+0000","last_active":"2023-09-30T17:06:00.631465+0000","last_peered":"2023-09-30T17:06:00.631465+0000","last_clean":"2023-09-30T17:06:00.631465+0000","last_became_active":"2023-09-30T17:02:17.360601+0000","last_became_peered":"2023-09-30T17:02:17.360601+0000","last_unstale":"2023-09-30T17:06:00.631465+0000","last_undegraded":"2023-09-30T17:06:00.631465+0000","last_fullsized":"2023-09-30T17:06:00.631465+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:06:00.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:06:00.631354+0000","last_clean_scrub_stamp":"2023-09-30T17:06:00.631354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:20:04.136405+0000","scrub_duration":0.0021158409999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"59'7","reported_seq":97,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:46.008112+0000","last_change":"2023-09-30T17:06:46.008194+0000","last_active":"2023-09-30T17:06:46.008112+0000","last_peered":"2023-09-30T17:06:46.008112+0000","last_clean":"2023-09-30T17:06:46.008112+0000","last_became_active":"2023-09-30T17:05:03.305520+0000","last_became_peered":"2023-09-30T17:05:03.305520+0000","last_unstale":"2023-09-30T17:06:46.008112+0000","last_undegraded":"2023-09-30T17:06:46.008112+0000","last_fullsized":"2023-09-30T17:06:46.008112+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'7","last_scrub_stamp":"2023-09-30T17:06:46.007979+0000","last_deep_scrub":"59'7","last_deep_scrub_stamp":"2023-09-30T17:06:46.007979+0000","last_clean_scrub_stamp":"2023-09-30T17:06:46.007979+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:19:41.163586+0000","scrub_duration":0.0023045549999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"58'1","reported_seq":91,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:31.362911+0000","last_change":"2023-09-30T17:06:31.362963+0000","last_active":"2023-09-30T17:06:31.362911+0000","last_peered":"2023-09-30T17:06:31.362911+0000","last_clean":"2023-09-30T17:06:31.362911+0000","last_became_active":"2023-09-30T17:05:03.308851+0000","last_became_peered":"2023-09-30T17:05:03.308851+0000","last_unstale":"2023-09-30T17:06:31.362911+0000","last_undegraded":"2023-09-30T17:06:31.362911+0000","last_fullsized":"2023-09-30T17:06:31.362911+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'1","last_scrub_stamp":"2023-09-30T17:06:31.362807+0000","last_deep_scrub":"58'1","last_deep_scrub_stamp":"2023-09-30T17:06:31.362807+0000","last_clean_scrub_stamp":"2023-09-30T17:06:31.362807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:52:49.024933+0000","scrub_duration":0.001800563,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"59'9","reported_seq":87,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:42.629955+0000","last_change":"2023-09-30T17:05:42.630040+0000","last_active":"2023-09-30T17:05:42.629955+0000","last_peered":"2023-09-30T17:05:42.629955+0000","last_clean":"2023-09-30T17:05:42.629955+0000","last_became_active":"2023-09-30T17:02:18.358529+0000","last_became_peered":"2023-09-30T17:02:18.358529+0000","last_unstale":"2023-09-30T17:05:42.629955+0000","last_undegraded":"2023-09-30T17:05:42.629955+0000","last_fullsized":"2023-09-30T17:05:42.629955+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'9","last_scrub_stamp":"2023-09-30T17:05:42.629801+0000","last_deep_scrub":"59'9","last_deep_scrub_stamp":"2023-09-30T17:05:42.629801+0000","last_clean_scrub_stamp":"2023-09-30T17:05:42.629801+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:08:35.419515+0000","scrub_duration":0.0034623800000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:45.308296+0000","last_change":"2023-09-30T17:06:45.308363+0000","last_active":"2023-09-30T17:06:45.308296+0000","last_peered":"2023-09-30T17:06:45.308296+0000","last_clean":"2023-09-30T17:06:45.308296+0000","last_became_active":"2023-09-30T17:05:03.309023+0000","last_became_peered":"2023-09-30T17:05:03.309023+0000","last_unstale":"2023-09-30T17:06:45.308296+0000","last_undegraded":"2023-09-30T17:06:45.308296+0000","last_fullsized":"2023-09-30T17:06:45.308296+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:06:45.308183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:06:45.308183+0000","last_clean_scrub_stamp":"2023-09-30T17:06:45.308183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:47:15.024307+0000","scrub_duration":0.0018997700000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"59'8526","reported_seq":8619,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309811+0000","last_change":"2023-09-30T17:05:06.292415+0000","last_active":"2023-09-30T17:05:26.309811+0000","last_peered":"2023-09-30T17:05:26.309811+0000","last_clean":"2023-09-30T17:05:26.309811+0000","last_became_active":"2023-09-30T17:05:06.290551+0000","last_became_peered":"2023-09-30T17:05:06.290551+0000","last_unstale":"2023-09-30T17:05:26.309811+0000","last_undegraded":"2023-09-30T17:05:26.309811+0000","last_fullsized":"2023-09-30T17:05:26.309811+0000","mapping_epoch":69,"log_start":"49'4300","ondisk_log_start":"49'4300","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4226,"log_dups_size":4300,"ondisk_log_size":4226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24873,"num_write_kb":118472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"76'9","reported_seq":104,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:29.943639+0000","last_change":"2023-09-30T17:06:29.943696+0000","last_active":"2023-09-30T17:06:29.943639+0000","last_peered":"2023-09-30T17:06:29.943639+0000","last_clean":"2023-09-30T17:06:29.943639+0000","last_became_active":"2023-09-30T17:05:03.306646+0000","last_became_peered":"2023-09-30T17:05:03.306646+0000","last_unstale":"2023-09-30T17:06:29.943639+0000","last_undegraded":"2023-09-30T17:06:29.943639+0000","last_fullsized":"2023-09-30T17:06:29.943639+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'9","last_scrub_stamp":"2023-09-30T17:06:29.943546+0000","last_deep_scrub":"76'9","last_deep_scrub_stamp":"2023-09-30T17:06:29.943546+0000","last_clean_scrub_stamp":"2023-09-30T17:06:29.943546+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:01:47.162265+0000","scrub_duration":0.0039657640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"59'5670","reported_seq":5748,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:46.679909+0000","last_change":"2023-09-30T17:05:46.679960+0000","last_active":"2023-09-30T17:05:46.679909+0000","last_peered":"2023-09-30T17:05:46.679909+0000","last_clean":"2023-09-30T17:05:46.679909+0000","last_became_active":"2023-09-30T17:02:18.358786+0000","last_became_peered":"2023-09-30T17:02:18.358786+0000","last_unstale":"2023-09-30T17:05:46.679909+0000","last_undegraded":"2023-09-30T17:05:46.679909+0000","last_fullsized":"2023-09-30T17:05:46.679909+0000","mapping_epoch":17,"log_start":"44'1500","ondisk_log_start":"44'1500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'5670","last_scrub_stamp":"2023-09-30T17:05:46.679767+0000","last_deep_scrub":"59'5670","last_deep_scrub_stamp":"2023-09-30T17:05:46.679767+0000","last_clean_scrub_stamp":"2023-09-30T17:05:46.679767+0000","objects_scrubbed":0,"log_size":4170,"log_dups_size":1500,"ondisk_log_size":4170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:13:16.252019+0000","scrub_duration":0.0034350140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16627,"num_write_kb":79047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"76'82","reported_seq":62,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:24.313340+0000","last_change":"2023-09-30T17:06:24.313394+0000","last_active":"2023-09-30T17:06:24.313340+0000","last_peered":"2023-09-30T17:06:24.313340+0000","last_clean":"2023-09-30T17:06:24.313340+0000","last_became_active":"2023-09-30T17:05:03.302516+0000","last_became_peered":"2023-09-30T17:05:03.302516+0000","last_unstale":"2023-09-30T17:06:24.313340+0000","last_undegraded":"2023-09-30T17:06:24.313340+0000","last_fullsized":"2023-09-30T17:06:24.313340+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'82","last_scrub_stamp":"2023-09-30T17:06:24.313256+0000","last_deep_scrub":"76'82","last_deep_scrub_stamp":"2023-09-30T17:06:24.313256+0000","last_clean_scrub_stamp":"2023-09-30T17:06:24.313256+0000","objects_scrubbed":4,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:44:16.046579+0000","scrub_duration":0.0059365370000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227523,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":222729,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"59'5677","reported_seq":5757,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310006+0000","last_change":"2023-09-30T17:05:06.289965+0000","last_active":"2023-09-30T17:05:26.310006+0000","last_peered":"2023-09-30T17:05:26.310006+0000","last_clean":"2023-09-30T17:05:26.310006+0000","last_became_active":"2023-09-30T17:05:06.288155+0000","last_became_peered":"2023-09-30T17:05:06.288155+0000","last_unstale":"2023-09-30T17:05:26.310006+0000","last_undegraded":"2023-09-30T17:05:26.310006+0000","last_fullsized":"2023-09-30T17:05:26.310006+0000","mapping_epoch":69,"log_start":"42'1100","ondisk_log_start":"42'1100","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4577,"log_dups_size":1100,"ondisk_log_size":4577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16579,"num_write_kb":79104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"76'4","reported_seq":43,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:35.285337+0000","last_change":"2023-09-30T17:06:35.285424+0000","last_active":"2023-09-30T17:06:35.285337+0000","last_peered":"2023-09-30T17:06:35.285337+0000","last_clean":"2023-09-30T17:06:35.285337+0000","last_became_active":"2023-09-30T17:05:03.309505+0000","last_became_peered":"2023-09-30T17:05:03.309505+0000","last_unstale":"2023-09-30T17:06:35.285337+0000","last_undegraded":"2023-09-30T17:06:35.285337+0000","last_fullsized":"2023-09-30T17:06:35.285337+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'4","last_scrub_stamp":"2023-09-30T17:06:35.285239+0000","last_deep_scrub":"76'4","last_deep_scrub_stamp":"2023-09-30T17:06:35.285239+0000","last_clean_scrub_stamp":"2023-09-30T17:06:35.285239+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:17:18.502298+0000","scrub_duration":0.0040701629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"59'2836","reported_seq":2914,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:16.757228+0000","last_change":"2023-09-30T17:06:16.757277+0000","last_active":"2023-09-30T17:06:16.757228+0000","last_peered":"2023-09-30T17:06:16.757228+0000","last_clean":"2023-09-30T17:06:16.757228+0000","last_became_active":"2023-09-30T17:02:18.358364+0000","last_became_peered":"2023-09-30T17:02:18.358364+0000","last_unstale":"2023-09-30T17:06:16.757228+0000","last_undegraded":"2023-09-30T17:06:16.757228+0000","last_fullsized":"2023-09-30T17:06:16.757228+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2836","last_scrub_stamp":"2023-09-30T17:06:16.757121+0000","last_deep_scrub":"59'2836","last_deep_scrub_stamp":"2023-09-30T17:06:16.757121+0000","last_clean_scrub_stamp":"2023-09-30T17:06:16.757121+0000","objects_scrubbed":0,"log_size":2836,"log_dups_size":0,"ondisk_log_size":2836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:25:14.959219+0000","scrub_duration":0.0037836699999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8308,"num_write_kb":39456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":90,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:51.337468+0000","last_change":"2023-09-30T17:06:51.337565+0000","last_active":"2023-09-30T17:06:51.337468+0000","last_peered":"2023-09-30T17:06:51.337468+0000","last_clean":"2023-09-30T17:06:51.337468+0000","last_became_active":"2023-09-30T17:05:03.308377+0000","last_became_peered":"2023-09-30T17:05:03.308377+0000","last_unstale":"2023-09-30T17:06:51.337468+0000","last_undegraded":"2023-09-30T17:06:51.337468+0000","last_fullsized":"2023-09-30T17:06:51.337468+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:06:51.337334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:06:51.337334+0000","last_clean_scrub_stamp":"2023-09-30T17:06:51.337334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:43:00.275903+0000","scrub_duration":0.0021837779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"59'2856","reported_seq":2934,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:43.659585+0000","last_change":"2023-09-30T17:05:43.659681+0000","last_active":"2023-09-30T17:05:43.659585+0000","last_peered":"2023-09-30T17:05:43.659585+0000","last_clean":"2023-09-30T17:05:43.659585+0000","last_became_active":"2023-09-30T17:02:18.361556+0000","last_became_peered":"2023-09-30T17:02:18.361556+0000","last_unstale":"2023-09-30T17:05:43.659585+0000","last_undegraded":"2023-09-30T17:05:43.659585+0000","last_fullsized":"2023-09-30T17:05:43.659585+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2856","last_scrub_stamp":"2023-09-30T17:05:43.659443+0000","last_deep_scrub":"59'2856","last_deep_scrub_stamp":"2023-09-30T17:05:43.659443+0000","last_clean_scrub_stamp":"2023-09-30T17:05:43.659443+0000","objects_scrubbed":0,"log_size":2856,"log_dups_size":0,"ondisk_log_size":2856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:13:13.231695+0000","scrub_duration":0.0035525420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8321,"num_write_kb":39600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":90,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:22.790916+0000","last_change":"2023-09-30T17:06:22.790965+0000","last_active":"2023-09-30T17:06:22.790916+0000","last_peered":"2023-09-30T17:06:22.790916+0000","last_clean":"2023-09-30T17:06:22.790916+0000","last_became_active":"2023-09-30T17:05:03.303598+0000","last_became_peered":"2023-09-30T17:05:03.303598+0000","last_unstale":"2023-09-30T17:06:22.790916+0000","last_undegraded":"2023-09-30T17:06:22.790916+0000","last_fullsized":"2023-09-30T17:06:22.790916+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:06:22.790800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:06:22.790800+0000","last_clean_scrub_stamp":"2023-09-30T17:06:22.790800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:05:32.483926+0000","scrub_duration":0.001928988,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"59'12","reported_seq":93,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310428+0000","last_change":"2023-09-30T17:05:03.313214+0000","last_active":"2023-09-30T17:05:26.310428+0000","last_peered":"2023-09-30T17:05:26.310428+0000","last_clean":"2023-09-30T17:05:26.310428+0000","last_became_active":"2023-09-30T17:05:03.312888+0000","last_became_peered":"2023-09-30T17:05:03.312888+0000","last_unstale":"2023-09-30T17:05:26.310428+0000","last_undegraded":"2023-09-30T17:05:26.310428+0000","last_fullsized":"2023-09-30T17:05:26.310428+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"76'13","reported_seq":48,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:52.618203+0000","last_change":"2023-09-30T17:05:52.618265+0000","last_active":"2023-09-30T17:05:52.618203+0000","last_peered":"2023-09-30T17:05:52.618203+0000","last_clean":"2023-09-30T17:05:52.618203+0000","last_became_active":"2023-09-30T17:05:03.304030+0000","last_became_peered":"2023-09-30T17:05:03.304030+0000","last_unstale":"2023-09-30T17:05:52.618203+0000","last_undegraded":"2023-09-30T17:05:52.618203+0000","last_fullsized":"2023-09-30T17:05:52.618203+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'13","last_scrub_stamp":"2023-09-30T17:05:52.618079+0000","last_deep_scrub":"76'13","last_deep_scrub_stamp":"2023-09-30T17:05:52.618079+0000","last_clean_scrub_stamp":"2023-09-30T17:05:52.618079+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:02:35.473886+0000","scrub_duration":0.0072773029999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"59'2892","reported_seq":2982,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310624+0000","last_change":"2023-09-30T17:05:06.290230+0000","last_active":"2023-09-30T17:05:26.310624+0000","last_peered":"2023-09-30T17:05:26.310624+0000","last_clean":"2023-09-30T17:05:26.310624+0000","last_became_active":"2023-09-30T17:05:06.288725+0000","last_became_peered":"2023-09-30T17:05:06.288725+0000","last_unstale":"2023-09-30T17:05:26.310624+0000","last_undegraded":"2023-09-30T17:05:26.310624+0000","last_fullsized":"2023-09-30T17:05:26.310624+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2892,"log_dups_size":0,"ondisk_log_size":2892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8345,"num_write_kb":39712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"76'2","reported_seq":42,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:59.595711+0000","last_change":"2023-09-30T17:05:59.595763+0000","last_active":"2023-09-30T17:05:59.595711+0000","last_peered":"2023-09-30T17:05:59.595711+0000","last_clean":"2023-09-30T17:05:59.595711+0000","last_became_active":"2023-09-30T17:05:03.303179+0000","last_became_peered":"2023-09-30T17:05:03.303179+0000","last_unstale":"2023-09-30T17:05:59.595711+0000","last_undegraded":"2023-09-30T17:05:59.595711+0000","last_fullsized":"2023-09-30T17:05:59.595711+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2023-09-30T17:05:59.595592+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2023-09-30T17:05:59.595592+0000","last_clean_scrub_stamp":"2023-09-30T17:05:59.595592+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:47:24.049768+0000","scrub_duration":0.0041402670000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"59'2861","reported_seq":2960,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:51.091288+0000","last_change":"2023-09-30T17:06:51.091363+0000","last_active":"2023-09-30T17:06:51.091288+0000","last_peered":"2023-09-30T17:06:51.091288+0000","last_clean":"2023-09-30T17:06:51.091288+0000","last_became_active":"2023-09-30T17:05:06.288824+0000","last_became_peered":"2023-09-30T17:05:06.288824+0000","last_unstale":"2023-09-30T17:06:51.091288+0000","last_undegraded":"2023-09-30T17:06:51.091288+0000","last_fullsized":"2023-09-30T17:06:51.091288+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2861","last_scrub_stamp":"2023-09-30T17:06:51.091170+0000","last_deep_scrub":"59'2861","last_deep_scrub_stamp":"2023-09-30T17:06:51.091170+0000","last_clean_scrub_stamp":"2023-09-30T17:06:51.091170+0000","objects_scrubbed":0,"log_size":2861,"log_dups_size":0,"ondisk_log_size":2861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:18:00.488103+0000","scrub_duration":0.0023594990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8384,"num_write_kb":39788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"76'3","reported_seq":94,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:13.759033+0000","last_change":"2023-09-30T17:06:13.759033+0000","last_active":"2023-09-30T17:06:13.759033+0000","last_peered":"2023-09-30T17:06:13.759033+0000","last_clean":"2023-09-30T17:06:13.759033+0000","last_became_active":"2023-09-30T17:05:03.303874+0000","last_became_peered":"2023-09-30T17:05:03.303874+0000","last_unstale":"2023-09-30T17:06:13.759033+0000","last_undegraded":"2023-09-30T17:06:13.759033+0000","last_fullsized":"2023-09-30T17:06:13.759033+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'3","last_scrub_stamp":"2023-09-30T17:06:13.758880+0000","last_deep_scrub":"76'3","last_deep_scrub_stamp":"2023-09-30T17:06:13.758880+0000","last_clean_scrub_stamp":"2023-09-30T17:06:13.758880+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:16:16.319469+0000","scrub_duration":0.0031993410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"59'2","reported_seq":81,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:03.649354+0000","last_change":"2023-09-30T17:06:03.649354+0000","last_active":"2023-09-30T17:06:03.649354+0000","last_peered":"2023-09-30T17:06:03.649354+0000","last_clean":"2023-09-30T17:06:03.649354+0000","last_became_active":"2023-09-30T17:02:18.356825+0000","last_became_peered":"2023-09-30T17:02:18.356825+0000","last_unstale":"2023-09-30T17:06:03.649354+0000","last_undegraded":"2023-09-30T17:06:03.649354+0000","last_fullsized":"2023-09-30T17:06:03.649354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2023-09-30T17:06:03.649193+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2023-09-30T17:06:03.649193+0000","last_clean_scrub_stamp":"2023-09-30T17:06:03.649193+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:38:42.860650+0000","scrub_duration":0.0029770759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"76'2","reported_seq":42,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:47.311180+0000","last_change":"2023-09-30T17:06:47.311244+0000","last_active":"2023-09-30T17:06:47.311180+0000","last_peered":"2023-09-30T17:06:47.311180+0000","last_clean":"2023-09-30T17:06:47.311180+0000","last_became_active":"2023-09-30T17:05:03.304463+0000","last_became_peered":"2023-09-30T17:05:03.304463+0000","last_unstale":"2023-09-30T17:06:47.311180+0000","last_undegraded":"2023-09-30T17:06:47.311180+0000","last_fullsized":"2023-09-30T17:06:47.311180+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2023-09-30T17:06:47.311088+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2023-09-30T17:06:47.311088+0000","last_clean_scrub_stamp":"2023-09-30T17:06:47.311088+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:47:43.727238+0000","scrub_duration":0.0029340550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"59'2835","reported_seq":2912,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:54.409033+0000","last_change":"2023-09-30T17:06:54.409081+0000","last_active":"2023-09-30T17:06:54.409033+0000","last_peered":"2023-09-30T17:06:54.409033+0000","last_clean":"2023-09-30T17:06:54.409033+0000","last_became_active":"2023-09-30T17:05:06.288712+0000","last_became_peered":"2023-09-30T17:05:06.288712+0000","last_unstale":"2023-09-30T17:06:54.409033+0000","last_undegraded":"2023-09-30T17:06:54.409033+0000","last_fullsized":"2023-09-30T17:06:54.409033+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2835","last_scrub_stamp":"2023-09-30T17:06:54.408927+0000","last_deep_scrub":"59'2835","last_deep_scrub_stamp":"2023-09-30T17:06:54.408927+0000","last_clean_scrub_stamp":"2023-09-30T17:06:54.408927+0000","objects_scrubbed":0,"log_size":2835,"log_dups_size":0,"ondisk_log_size":2835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:38:28.826533+0000","scrub_duration":0.0024468049999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8288,"num_write_kb":39388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:55.610514+0000","last_change":"2023-09-30T17:05:55.610603+0000","last_active":"2023-09-30T17:05:55.610514+0000","last_peered":"2023-09-30T17:05:55.610514+0000","last_clean":"2023-09-30T17:05:55.610514+0000","last_became_active":"2023-09-30T17:05:03.310836+0000","last_became_peered":"2023-09-30T17:05:03.310836+0000","last_unstale":"2023-09-30T17:05:55.610514+0000","last_undegraded":"2023-09-30T17:05:55.610514+0000","last_fullsized":"2023-09-30T17:05:55.610514+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:05:55.610405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:05:55.610405+0000","last_clean_scrub_stamp":"2023-09-30T17:05:55.610405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:09:49.583774+0000","scrub_duration":0.0018973,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"59'8","reported_seq":98,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:11.512164+0000","last_change":"2023-09-30T17:06:11.512164+0000","last_active":"2023-09-30T17:06:11.512164+0000","last_peered":"2023-09-30T17:06:11.512164+0000","last_clean":"2023-09-30T17:06:11.512164+0000","last_became_active":"2023-09-30T17:05:03.308214+0000","last_became_peered":"2023-09-30T17:05:03.308214+0000","last_unstale":"2023-09-30T17:06:11.512164+0000","last_undegraded":"2023-09-30T17:06:11.512164+0000","last_fullsized":"2023-09-30T17:06:11.512164+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'8","last_scrub_stamp":"2023-09-30T17:06:11.511974+0000","last_deep_scrub":"59'8","last_deep_scrub_stamp":"2023-09-30T17:06:11.511974+0000","last_clean_scrub_stamp":"2023-09-30T17:06:11.511974+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:52:30.008131+0000","scrub_duration":0.0023012480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"58'3","reported_seq":87,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:35.884075+0000","last_change":"2023-09-30T17:05:03.308944+0000","last_active":"2023-09-30T17:05:35.884075+0000","last_peered":"2023-09-30T17:05:35.884075+0000","last_clean":"2023-09-30T17:05:35.884075+0000","last_became_active":"2023-09-30T17:05:03.308483+0000","last_became_peered":"2023-09-30T17:05:03.308483+0000","last_unstale":"2023-09-30T17:05:35.884075+0000","last_undegraded":"2023-09-30T17:05:35.884075+0000","last_fullsized":"2023-09-30T17:05:35.884075+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"59'2846","reported_seq":2922,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:45.632483+0000","last_change":"2023-09-30T17:05:45.632563+0000","last_active":"2023-09-30T17:05:45.632483+0000","last_peered":"2023-09-30T17:05:45.632483+0000","last_clean":"2023-09-30T17:05:45.632483+0000","last_became_active":"2023-09-30T17:05:06.289225+0000","last_became_peered":"2023-09-30T17:05:06.289225+0000","last_unstale":"2023-09-30T17:05:45.632483+0000","last_undegraded":"2023-09-30T17:05:45.632483+0000","last_fullsized":"2023-09-30T17:05:45.632483+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2846","last_scrub_stamp":"2023-09-30T17:05:45.632358+0000","last_deep_scrub":"59'2846","last_deep_scrub_stamp":"2023-09-30T17:05:45.632358+0000","last_clean_scrub_stamp":"2023-09-30T17:05:45.632358+0000","objects_scrubbed":0,"log_size":2846,"log_dups_size":0,"ondisk_log_size":2846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:03:33.607467+0000","scrub_duration":0.0029322739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8199,"num_write_kb":39160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:51.344646+0000","last_change":"2023-09-30T17:06:51.344695+0000","last_active":"2023-09-30T17:06:51.344646+0000","last_peered":"2023-09-30T17:06:51.344646+0000","last_clean":"2023-09-30T17:06:51.344646+0000","last_became_active":"2023-09-30T17:05:03.309318+0000","last_became_peered":"2023-09-30T17:05:03.309318+0000","last_unstale":"2023-09-30T17:06:51.344646+0000","last_undegraded":"2023-09-30T17:06:51.344646+0000","last_fullsized":"2023-09-30T17:06:51.344646+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:06:51.344553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:06:51.344553+0000","last_clean_scrub_stamp":"2023-09-30T17:06:51.344553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:58:57.231318+0000","scrub_duration":0.0019483079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"59'2831","reported_seq":2899,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.310018+0000","last_change":"2023-09-30T17:05:06.289189+0000","last_active":"2023-09-30T17:05:26.310018+0000","last_peered":"2023-09-30T17:05:26.310018+0000","last_clean":"2023-09-30T17:05:26.310018+0000","last_became_active":"2023-09-30T17:05:06.288348+0000","last_became_peered":"2023-09-30T17:05:06.288348+0000","last_unstale":"2023-09-30T17:05:26.310018+0000","last_undegraded":"2023-09-30T17:05:26.310018+0000","last_fullsized":"2023-09-30T17:05:26.310018+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2831,"log_dups_size":0,"ondisk_log_size":2831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8336,"num_write_kb":39484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":91,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:28.891741+0000","last_change":"2023-09-30T17:06:28.891741+0000","last_active":"2023-09-30T17:06:28.891741+0000","last_peered":"2023-09-30T17:06:28.891741+0000","last_clean":"2023-09-30T17:06:28.891741+0000","last_became_active":"2023-09-30T17:05:03.303473+0000","last_became_peered":"2023-09-30T17:05:03.303473+0000","last_unstale":"2023-09-30T17:06:28.891741+0000","last_undegraded":"2023-09-30T17:06:28.891741+0000","last_fullsized":"2023-09-30T17:06:28.891741+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:06:28.891571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:06:28.891571+0000","last_clean_scrub_stamp":"2023-09-30T17:06:28.891571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:57:39.251224+0000","scrub_duration":0.0017781679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"59'2884","reported_seq":2960,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:39.659504+0000","last_change":"2023-09-30T17:05:39.659591+0000","last_active":"2023-09-30T17:05:39.659504+0000","last_peered":"2023-09-30T17:05:39.659504+0000","last_clean":"2023-09-30T17:05:39.659504+0000","last_became_active":"2023-09-30T17:05:06.288169+0000","last_became_peered":"2023-09-30T17:05:06.288169+0000","last_unstale":"2023-09-30T17:05:39.659504+0000","last_undegraded":"2023-09-30T17:05:39.659504+0000","last_fullsized":"2023-09-30T17:05:39.659504+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2884","last_scrub_stamp":"2023-09-30T17:05:39.659392+0000","last_deep_scrub":"59'2884","last_deep_scrub_stamp":"2023-09-30T17:05:39.659392+0000","last_clean_scrub_stamp":"2023-09-30T17:05:39.659392+0000","objects_scrubbed":0,"log_size":2884,"log_dups_size":0,"ondisk_log_size":2884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:25:23.871113+0000","scrub_duration":0.0036873600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8366,"num_write_kb":39744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":80,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:36.928732+0000","last_change":"2023-09-30T17:06:36.928732+0000","last_active":"2023-09-30T17:06:36.928732+0000","last_peered":"2023-09-30T17:06:36.928732+0000","last_clean":"2023-09-30T17:06:36.928732+0000","last_became_active":"2023-09-30T17:02:17.358582+0000","last_became_peered":"2023-09-30T17:02:17.358582+0000","last_unstale":"2023-09-30T17:06:36.928732+0000","last_undegraded":"2023-09-30T17:06:36.928732+0000","last_fullsized":"2023-09-30T17:06:36.928732+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:06:36.928519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:06:36.928519+0000","last_clean_scrub_stamp":"2023-09-30T17:06:36.928519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:33:38.679064+0000","scrub_duration":0.0016328499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"59'8580","reported_seq":8651,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:35.884365+0000","last_change":"2023-09-30T17:02:18.364478+0000","last_active":"2023-09-30T17:05:35.884365+0000","last_peered":"2023-09-30T17:05:35.884365+0000","last_clean":"2023-09-30T17:05:35.884365+0000","last_became_active":"2023-09-30T17:02:18.364057+0000","last_became_peered":"2023-09-30T17:02:18.364057+0000","last_unstale":"2023-09-30T17:05:35.884365+0000","last_undegraded":"2023-09-30T17:05:35.884365+0000","last_fullsized":"2023-09-30T17:05:35.884365+0000","mapping_epoch":17,"log_start":"49'4400","ondisk_log_start":"49'4400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":4180,"log_dups_size":4400,"ondisk_log_size":4180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25046,"num_write_kb":118972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":83,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:35.378313+0000","last_change":"2023-09-30T17:06:35.378357+0000","last_active":"2023-09-30T17:06:35.378313+0000","last_peered":"2023-09-30T17:06:35.378313+0000","last_clean":"2023-09-30T17:06:35.378313+0000","last_became_active":"2023-09-30T17:02:12.327384+0000","last_became_peered":"2023-09-30T17:02:12.327384+0000","last_unstale":"2023-09-30T17:06:35.378313+0000","last_undegraded":"2023-09-30T17:06:35.378313+0000","last_fullsized":"2023-09-30T17:06:35.378313+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:06:35.378215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:06:35.378215+0000","last_clean_scrub_stamp":"2023-09-30T17:06:35.378215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:03:48.893649+0000","scrub_duration":0.002122395,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:19.377132+0000","last_change":"2023-09-30T17:06:19.377196+0000","last_active":"2023-09-30T17:06:19.377132+0000","last_peered":"2023-09-30T17:06:19.377132+0000","last_clean":"2023-09-30T17:06:19.377132+0000","last_became_active":"2023-09-30T17:05:03.310655+0000","last_became_peered":"2023-09-30T17:05:03.310655+0000","last_unstale":"2023-09-30T17:06:19.377132+0000","last_undegraded":"2023-09-30T17:06:19.377132+0000","last_fullsized":"2023-09-30T17:06:19.377132+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:06:19.376984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:06:19.376984+0000","last_clean_scrub_stamp":"2023-09-30T17:06:19.376984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:11:07.977442+0000","scrub_duration":0.0018996149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"59'9","reported_seq":99,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:44.620255+0000","last_change":"2023-09-30T17:05:44.620255+0000","last_active":"2023-09-30T17:05:44.620255+0000","last_peered":"2023-09-30T17:05:44.620255+0000","last_clean":"2023-09-30T17:05:44.620255+0000","last_became_active":"2023-09-30T17:05:03.305956+0000","last_became_peered":"2023-09-30T17:05:03.305956+0000","last_unstale":"2023-09-30T17:05:44.620255+0000","last_undegraded":"2023-09-30T17:05:44.620255+0000","last_fullsized":"2023-09-30T17:05:44.620255+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'9","last_scrub_stamp":"2023-09-30T17:05:44.620091+0000","last_deep_scrub":"59'9","last_deep_scrub_stamp":"2023-09-30T17:05:44.620091+0000","last_clean_scrub_stamp":"2023-09-30T17:05:44.620091+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:48:53.055175+0000","scrub_duration":0.0028788109999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:30.376875+0000","last_change":"2023-09-30T17:06:30.376920+0000","last_active":"2023-09-30T17:06:30.376875+0000","last_peered":"2023-09-30T17:06:30.376875+0000","last_clean":"2023-09-30T17:06:30.376875+0000","last_became_active":"2023-09-30T17:05:03.308944+0000","last_became_peered":"2023-09-30T17:05:03.308944+0000","last_unstale":"2023-09-30T17:06:30.376875+0000","last_undegraded":"2023-09-30T17:06:30.376875+0000","last_fullsized":"2023-09-30T17:06:30.376875+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:06:30.376777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:06:30.376777+0000","last_clean_scrub_stamp":"2023-09-30T17:06:30.376777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:07:50.954083+0000","scrub_duration":0.0019009960000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:48.694200+0000","last_change":"2023-09-30T17:05:48.694245+0000","last_active":"2023-09-30T17:05:48.694200+0000","last_peered":"2023-09-30T17:05:48.694200+0000","last_clean":"2023-09-30T17:05:48.694200+0000","last_became_active":"2023-09-30T17:05:03.310706+0000","last_became_peered":"2023-09-30T17:05:03.310706+0000","last_unstale":"2023-09-30T17:05:48.694200+0000","last_undegraded":"2023-09-30T17:05:48.694200+0000","last_fullsized":"2023-09-30T17:05:48.694200+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:05:48.694106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:05:48.694106+0000","last_clean_scrub_stamp":"2023-09-30T17:05:48.694106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:45:19.266879+0000","scrub_duration":0.0018395079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"59'9","reported_seq":88,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:06.575982+0000","last_change":"2023-09-30T17:06:06.575982+0000","last_active":"2023-09-30T17:06:06.575982+0000","last_peered":"2023-09-30T17:06:06.575982+0000","last_clean":"2023-09-30T17:06:06.575982+0000","last_became_active":"2023-09-30T17:02:18.363064+0000","last_became_peered":"2023-09-30T17:02:18.363064+0000","last_unstale":"2023-09-30T17:06:06.575982+0000","last_undegraded":"2023-09-30T17:06:06.575982+0000","last_fullsized":"2023-09-30T17:06:06.575982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'9","last_scrub_stamp":"2023-09-30T17:06:06.575750+0000","last_deep_scrub":"59'9","last_deep_scrub_stamp":"2023-09-30T17:06:06.575750+0000","last_clean_scrub_stamp":"2023-09-30T17:06:06.575750+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:58:24.806188+0000","scrub_duration":0.0029458370000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":83,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:33.380479+0000","last_change":"2023-09-30T17:06:33.380529+0000","last_active":"2023-09-30T17:06:33.380479+0000","last_peered":"2023-09-30T17:06:33.380479+0000","last_clean":"2023-09-30T17:06:33.380479+0000","last_became_active":"2023-09-30T17:02:12.327542+0000","last_became_peered":"2023-09-30T17:02:12.327542+0000","last_unstale":"2023-09-30T17:06:33.380479+0000","last_undegraded":"2023-09-30T17:06:33.380479+0000","last_fullsized":"2023-09-30T17:06:33.380479+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:06:33.380386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:06:33.380386+0000","last_clean_scrub_stamp":"2023-09-30T17:06:33.380386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:11:01.470731+0000","scrub_duration":0.001900161,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":91,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:37.971450+0000","last_change":"2023-09-30T17:06:37.971528+0000","last_active":"2023-09-30T17:06:37.971450+0000","last_peered":"2023-09-30T17:06:37.971450+0000","last_clean":"2023-09-30T17:06:37.971450+0000","last_became_active":"2023-09-30T17:05:03.305222+0000","last_became_peered":"2023-09-30T17:05:03.305222+0000","last_unstale":"2023-09-30T17:06:37.971450+0000","last_undegraded":"2023-09-30T17:06:37.971450+0000","last_fullsized":"2023-09-30T17:06:37.971450+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:06:37.971341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:06:37.971341+0000","last_clean_scrub_stamp":"2023-09-30T17:06:37.971341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:47:09.750906+0000","scrub_duration":0.001982948,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"59'6","reported_seq":77,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:35.884198+0000","last_change":"2023-09-30T17:02:18.364406+0000","last_active":"2023-09-30T17:05:35.884198+0000","last_peered":"2023-09-30T17:05:35.884198+0000","last_clean":"2023-09-30T17:05:35.884198+0000","last_became_active":"2023-09-30T17:02:18.363849+0000","last_became_peered":"2023-09-30T17:02:18.363849+0000","last_unstale":"2023-09-30T17:05:35.884198+0000","last_undegraded":"2023-09-30T17:05:35.884198+0000","last_fullsized":"2023-09-30T17:05:35.884198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:33.305051+0000","last_change":"2023-09-30T17:06:33.305122+0000","last_active":"2023-09-30T17:06:33.305051+0000","last_peered":"2023-09-30T17:06:33.305051+0000","last_clean":"2023-09-30T17:06:33.305051+0000","last_became_active":"2023-09-30T17:05:03.308958+0000","last_became_peered":"2023-09-30T17:05:03.308958+0000","last_unstale":"2023-09-30T17:06:33.305051+0000","last_undegraded":"2023-09-30T17:06:33.305051+0000","last_fullsized":"2023-09-30T17:06:33.305051+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:06:33.304948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:06:33.304948+0000","last_clean_scrub_stamp":"2023-09-30T17:06:33.304948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:52:55.572531+0000","scrub_duration":0.0016996450000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"76'159","reported_seq":236,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:09.514948+0000","last_change":"2023-09-30T17:06:09.515009+0000","last_active":"2023-09-30T17:06:09.514948+0000","last_peered":"2023-09-30T17:06:09.514948+0000","last_clean":"2023-09-30T17:06:09.514948+0000","last_became_active":"2023-09-30T17:05:03.302265+0000","last_became_peered":"2023-09-30T17:05:03.302265+0000","last_unstale":"2023-09-30T17:06:09.514948+0000","last_undegraded":"2023-09-30T17:06:09.514948+0000","last_fullsized":"2023-09-30T17:06:09.514948+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'159","last_scrub_stamp":"2023-09-30T17:06:09.514837+0000","last_deep_scrub":"76'159","last_deep_scrub_stamp":"2023-09-30T17:06:09.514837+0000","last_clean_scrub_stamp":"2023-09-30T17:06:09.514837+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:46:01.059195+0000","scrub_duration":0.0055217590000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":80,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:46.441894+0000","last_change":"2023-09-30T17:06:46.441959+0000","last_active":"2023-09-30T17:06:46.441894+0000","last_peered":"2023-09-30T17:06:46.441894+0000","last_clean":"2023-09-30T17:06:46.441894+0000","last_became_active":"2023-09-30T17:02:17.356901+0000","last_became_peered":"2023-09-30T17:02:17.356901+0000","last_unstale":"2023-09-30T17:06:46.441894+0000","last_undegraded":"2023-09-30T17:06:46.441894+0000","last_fullsized":"2023-09-30T17:06:46.441894+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:06:46.441771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:06:46.441771+0000","last_clean_scrub_stamp":"2023-09-30T17:06:46.441771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:55:40.444207+0000","scrub_duration":0.0017428820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"59'7","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:53.612754+0000","last_change":"2023-09-30T17:05:53.612809+0000","last_active":"2023-09-30T17:05:53.612754+0000","last_peered":"2023-09-30T17:05:53.612754+0000","last_clean":"2023-09-30T17:05:53.612754+0000","last_became_active":"2023-09-30T17:05:03.304974+0000","last_became_peered":"2023-09-30T17:05:03.304974+0000","last_unstale":"2023-09-30T17:05:53.612754+0000","last_undegraded":"2023-09-30T17:05:53.612754+0000","last_fullsized":"2023-09-30T17:05:53.612754+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'7","last_scrub_stamp":"2023-09-30T17:05:53.612654+0000","last_deep_scrub":"59'7","last_deep_scrub_stamp":"2023-09-30T17:05:53.612654+0000","last_clean_scrub_stamp":"2023-09-30T17:05:53.612654+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:04:16.815158+0000","scrub_duration":0.00223011,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:49.646389+0000","last_change":"2023-09-30T17:05:49.646435+0000","last_active":"2023-09-30T17:05:49.646389+0000","last_peered":"2023-09-30T17:05:49.646389+0000","last_clean":"2023-09-30T17:05:49.646389+0000","last_became_active":"2023-09-30T17:05:03.302590+0000","last_became_peered":"2023-09-30T17:05:03.302590+0000","last_unstale":"2023-09-30T17:05:49.646389+0000","last_undegraded":"2023-09-30T17:05:49.646389+0000","last_fullsized":"2023-09-30T17:05:49.646389+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:05:49.646266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:05:49.646266+0000","last_clean_scrub_stamp":"2023-09-30T17:05:49.646266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:45:23.943931+0000","scrub_duration":0.002091379,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"59'5","reported_seq":96,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:35.884022+0000","last_change":"2023-09-30T17:05:03.318439+0000","last_active":"2023-09-30T17:05:35.884022+0000","last_peered":"2023-09-30T17:05:35.884022+0000","last_clean":"2023-09-30T17:05:35.884022+0000","last_became_active":"2023-09-30T17:05:03.308059+0000","last_became_peered":"2023-09-30T17:05:03.308059+0000","last_unstale":"2023-09-30T17:05:35.884022+0000","last_undegraded":"2023-09-30T17:05:35.884022+0000","last_fullsized":"2023-09-30T17:05:35.884022+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:16.333605+0000","last_clean_scrub_stamp":"2023-09-30T17:02:16.333605+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"59'11252","reported_seq":11331,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:53.639457+0000","last_change":"2023-09-30T17:05:53.639457+0000","last_active":"2023-09-30T17:05:53.639457+0000","last_peered":"2023-09-30T17:05:53.639457+0000","last_clean":"2023-09-30T17:05:53.639457+0000","last_became_active":"2023-09-30T17:02:18.356839+0000","last_became_peered":"2023-09-30T17:02:18.356839+0000","last_unstale":"2023-09-30T17:05:53.639457+0000","last_undegraded":"2023-09-30T17:05:53.639457+0000","last_fullsized":"2023-09-30T17:05:53.639457+0000","mapping_epoch":17,"log_start":"51'6700","ondisk_log_start":"51'6700","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'11252","last_scrub_stamp":"2023-09-30T17:05:53.639286+0000","last_deep_scrub":"59'11252","last_deep_scrub_stamp":"2023-09-30T17:05:53.639286+0000","last_clean_scrub_stamp":"2023-09-30T17:05:53.639286+0000","objects_scrubbed":0,"log_size":4552,"log_dups_size":6700,"ondisk_log_size":4552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:50:12.670739+0000","scrub_duration":0.00330314,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33068,"num_write_kb":157144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":83,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:19.768395+0000","last_change":"2023-09-30T17:06:19.768395+0000","last_active":"2023-09-30T17:06:19.768395+0000","last_peered":"2023-09-30T17:06:19.768395+0000","last_clean":"2023-09-30T17:06:19.768395+0000","last_became_active":"2023-09-30T17:02:12.330154+0000","last_became_peered":"2023-09-30T17:02:12.330154+0000","last_unstale":"2023-09-30T17:06:19.768395+0000","last_undegraded":"2023-09-30T17:06:19.768395+0000","last_fullsized":"2023-09-30T17:06:19.768395+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:06:19.768184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:06:19.768184+0000","last_clean_scrub_stamp":"2023-09-30T17:06:19.768184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:03:33.283618+0000","scrub_duration":0.0018959109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":80,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:19.501381+0000","last_change":"2023-09-30T17:06:19.501381+0000","last_active":"2023-09-30T17:06:19.501381+0000","last_peered":"2023-09-30T17:06:19.501381+0000","last_clean":"2023-09-30T17:06:19.501381+0000","last_became_active":"2023-09-30T17:02:17.360721+0000","last_became_peered":"2023-09-30T17:02:17.360721+0000","last_unstale":"2023-09-30T17:06:19.501381+0000","last_undegraded":"2023-09-30T17:06:19.501381+0000","last_fullsized":"2023-09-30T17:06:19.501381+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:06:19.501185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:06:19.501185+0000","last_clean_scrub_stamp":"2023-09-30T17:06:19.501185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:38:50.894107+0000","scrub_duration":0.0019735519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"59'2836","reported_seq":2935,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:53.063291+0000","last_change":"2023-09-30T17:06:53.063341+0000","last_active":"2023-09-30T17:06:53.063291+0000","last_peered":"2023-09-30T17:06:53.063291+0000","last_clean":"2023-09-30T17:06:53.063291+0000","last_became_active":"2023-09-30T17:05:06.291203+0000","last_became_peered":"2023-09-30T17:05:06.291203+0000","last_unstale":"2023-09-30T17:06:53.063291+0000","last_undegraded":"2023-09-30T17:06:53.063291+0000","last_fullsized":"2023-09-30T17:06:53.063291+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2836","last_scrub_stamp":"2023-09-30T17:06:53.063189+0000","last_deep_scrub":"59'2836","last_deep_scrub_stamp":"2023-09-30T17:06:53.063189+0000","last_clean_scrub_stamp":"2023-09-30T17:06:53.063189+0000","objects_scrubbed":0,"log_size":2836,"log_dups_size":0,"ondisk_log_size":2836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:01:41.159814+0000","scrub_duration":0.002801857,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8199,"num_write_kb":39048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"76'4","reported_seq":84,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:05.556135+0000","last_change":"2023-09-30T17:06:05.556135+0000","last_active":"2023-09-30T17:06:05.556135+0000","last_peered":"2023-09-30T17:06:05.556135+0000","last_clean":"2023-09-30T17:06:05.556135+0000","last_became_active":"2023-09-30T17:02:17.360494+0000","last_became_peered":"2023-09-30T17:02:17.360494+0000","last_unstale":"2023-09-30T17:06:05.556135+0000","last_undegraded":"2023-09-30T17:06:05.556135+0000","last_fullsized":"2023-09-30T17:06:05.556135+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'4","last_scrub_stamp":"2023-09-30T17:06:05.555918+0000","last_deep_scrub":"76'4","last_deep_scrub_stamp":"2023-09-30T17:06:05.555918+0000","last_clean_scrub_stamp":"2023-09-30T17:06:05.555918+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:08:01.733610+0000","scrub_duration":0.0040480749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":83,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:45.439103+0000","last_change":"2023-09-30T17:06:45.439147+0000","last_active":"2023-09-30T17:06:45.439103+0000","last_peered":"2023-09-30T17:06:45.439103+0000","last_clean":"2023-09-30T17:06:45.439103+0000","last_became_active":"2023-09-30T17:02:12.327898+0000","last_became_peered":"2023-09-30T17:02:12.327898+0000","last_unstale":"2023-09-30T17:06:45.439103+0000","last_undegraded":"2023-09-30T17:06:45.439103+0000","last_fullsized":"2023-09-30T17:06:45.439103+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:06:45.439003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:06:45.439003+0000","last_clean_scrub_stamp":"2023-09-30T17:06:45.439003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:53:37.064257+0000","scrub_duration":0.0019539129999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"59'8","reported_seq":98,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:43.606760+0000","last_change":"2023-09-30T17:05:43.606760+0000","last_active":"2023-09-30T17:05:43.606760+0000","last_peered":"2023-09-30T17:05:43.606760+0000","last_clean":"2023-09-30T17:05:43.606760+0000","last_became_active":"2023-09-30T17:05:03.308429+0000","last_became_peered":"2023-09-30T17:05:03.308429+0000","last_unstale":"2023-09-30T17:05:43.606760+0000","last_undegraded":"2023-09-30T17:05:43.606760+0000","last_fullsized":"2023-09-30T17:05:43.606760+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'8","last_scrub_stamp":"2023-09-30T17:05:43.606596+0000","last_deep_scrub":"59'8","last_deep_scrub_stamp":"2023-09-30T17:05:43.606596+0000","last_clean_scrub_stamp":"2023-09-30T17:05:43.606596+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:53:16.420602+0000","scrub_duration":0.0021279749999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:15.384235+0000","last_change":"2023-09-30T17:06:15.384331+0000","last_active":"2023-09-30T17:06:15.384235+0000","last_peered":"2023-09-30T17:06:15.384235+0000","last_clean":"2023-09-30T17:06:15.384235+0000","last_became_active":"2023-09-30T17:05:03.302503+0000","last_became_peered":"2023-09-30T17:05:03.302503+0000","last_unstale":"2023-09-30T17:06:15.384235+0000","last_undegraded":"2023-09-30T17:06:15.384235+0000","last_fullsized":"2023-09-30T17:06:15.384235+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:06:15.384091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:06:15.384091+0000","last_clean_scrub_stamp":"2023-09-30T17:06:15.384091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:06:42.084138+0000","scrub_duration":0.0019917400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"76'9","reported_seq":105,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:27.361184+0000","last_change":"2023-09-30T17:06:27.361184+0000","last_active":"2023-09-30T17:06:27.361184+0000","last_peered":"2023-09-30T17:06:27.361184+0000","last_clean":"2023-09-30T17:06:27.361184+0000","last_became_active":"2023-09-30T17:05:03.308201+0000","last_became_peered":"2023-09-30T17:05:03.308201+0000","last_unstale":"2023-09-30T17:06:27.361184+0000","last_undegraded":"2023-09-30T17:06:27.361184+0000","last_fullsized":"2023-09-30T17:06:27.361184+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'9","last_scrub_stamp":"2023-09-30T17:06:27.361040+0000","last_deep_scrub":"76'9","last_deep_scrub_stamp":"2023-09-30T17:06:27.361040+0000","last_clean_scrub_stamp":"2023-09-30T17:06:27.361040+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:44:47.814921+0000","scrub_duration":0.0031875089999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"59'6","reported_seq":96,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:56.694471+0000","last_change":"2023-09-30T17:05:56.694471+0000","last_active":"2023-09-30T17:05:56.694471+0000","last_peered":"2023-09-30T17:05:56.694471+0000","last_clean":"2023-09-30T17:05:56.694471+0000","last_became_active":"2023-09-30T17:05:03.304022+0000","last_became_peered":"2023-09-30T17:05:03.304022+0000","last_unstale":"2023-09-30T17:05:56.694471+0000","last_undegraded":"2023-09-30T17:05:56.694471+0000","last_fullsized":"2023-09-30T17:05:56.694471+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'6","last_scrub_stamp":"2023-09-30T17:05:56.694323+0000","last_deep_scrub":"59'6","last_deep_scrub_stamp":"2023-09-30T17:05:56.694323+0000","last_clean_scrub_stamp":"2023-09-30T17:05:56.694323+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:41:25.703485+0000","scrub_duration":0.0021932589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":91,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:17.761294+0000","last_change":"2023-09-30T17:06:17.761345+0000","last_active":"2023-09-30T17:06:17.761294+0000","last_peered":"2023-09-30T17:06:17.761294+0000","last_clean":"2023-09-30T17:06:17.761294+0000","last_became_active":"2023-09-30T17:05:03.303487+0000","last_became_peered":"2023-09-30T17:05:03.303487+0000","last_unstale":"2023-09-30T17:06:17.761294+0000","last_undegraded":"2023-09-30T17:06:17.761294+0000","last_fullsized":"2023-09-30T17:06:17.761294+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2023-09-30T17:06:17.761177+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2023-09-30T17:06:17.761177+0000","last_clean_scrub_stamp":"2023-09-30T17:06:17.761177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:06:38.928334+0000","scrub_duration":0.0020380239999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"59'2835","reported_seq":2913,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:49.578110+0000","last_change":"2023-09-30T17:05:49.578202+0000","last_active":"2023-09-30T17:05:49.578110+0000","last_peered":"2023-09-30T17:05:49.578110+0000","last_clean":"2023-09-30T17:05:49.578110+0000","last_became_active":"2023-09-30T17:02:18.356902+0000","last_became_peered":"2023-09-30T17:02:18.356902+0000","last_unstale":"2023-09-30T17:05:49.578110+0000","last_undegraded":"2023-09-30T17:05:49.578110+0000","last_fullsized":"2023-09-30T17:05:49.578110+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2835","last_scrub_stamp":"2023-09-30T17:05:49.577968+0000","last_deep_scrub":"59'2835","last_deep_scrub_stamp":"2023-09-30T17:05:49.577968+0000","last_clean_scrub_stamp":"2023-09-30T17:05:49.577968+0000","objects_scrubbed":0,"log_size":2835,"log_dups_size":0,"ondisk_log_size":2835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:05:50.365694+0000","scrub_duration":0.0031753789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8302,"num_write_kb":39500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"76'3","reported_seq":42,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:10.550007+0000","last_change":"2023-09-30T17:06:10.550090+0000","last_active":"2023-09-30T17:06:10.550007+0000","last_peered":"2023-09-30T17:06:10.550007+0000","last_clean":"2023-09-30T17:06:10.550007+0000","last_became_active":"2023-09-30T17:05:03.310996+0000","last_became_peered":"2023-09-30T17:05:03.310996+0000","last_unstale":"2023-09-30T17:06:10.550007+0000","last_undegraded":"2023-09-30T17:06:10.550007+0000","last_fullsized":"2023-09-30T17:06:10.550007+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'3","last_scrub_stamp":"2023-09-30T17:06:10.549909+0000","last_deep_scrub":"76'3","last_deep_scrub_stamp":"2023-09-30T17:06:10.549909+0000","last_clean_scrub_stamp":"2023-09-30T17:06:10.549909+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:02:48.238742+0000","scrub_duration":0.0035069649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"59'2848","reported_seq":2924,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:43.643918+0000","last_change":"2023-09-30T17:05:43.644021+0000","last_active":"2023-09-30T17:05:43.643918+0000","last_peered":"2023-09-30T17:05:43.643918+0000","last_clean":"2023-09-30T17:05:43.643918+0000","last_became_active":"2023-09-30T17:05:06.289599+0000","last_became_peered":"2023-09-30T17:05:06.289599+0000","last_unstale":"2023-09-30T17:05:43.643918+0000","last_undegraded":"2023-09-30T17:05:43.643918+0000","last_fullsized":"2023-09-30T17:05:43.643918+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2848","last_scrub_stamp":"2023-09-30T17:05:43.643754+0000","last_deep_scrub":"59'2848","last_deep_scrub_stamp":"2023-09-30T17:05:43.643754+0000","last_clean_scrub_stamp":"2023-09-30T17:05:43.643754+0000","objects_scrubbed":0,"log_size":2848,"log_dups_size":0,"ondisk_log_size":2848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:09:00.902270+0000","scrub_duration":0.0023925259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8235,"num_write_kb":39276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"76'4","reported_seq":95,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:30.952532+0000","last_change":"2023-09-30T17:06:30.952599+0000","last_active":"2023-09-30T17:06:30.952532+0000","last_peered":"2023-09-30T17:06:30.952532+0000","last_clean":"2023-09-30T17:06:30.952532+0000","last_became_active":"2023-09-30T17:05:03.306711+0000","last_became_peered":"2023-09-30T17:05:03.306711+0000","last_unstale":"2023-09-30T17:06:30.952532+0000","last_undegraded":"2023-09-30T17:06:30.952532+0000","last_fullsized":"2023-09-30T17:06:30.952532+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'4","last_scrub_stamp":"2023-09-30T17:06:30.952432+0000","last_deep_scrub":"76'4","last_deep_scrub_stamp":"2023-09-30T17:06:30.952432+0000","last_clean_scrub_stamp":"2023-09-30T17:06:30.952432+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:57:50.588068+0000","scrub_duration":0.003354849,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"59'10","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:06.523686+0000","last_change":"2023-09-30T17:06:06.523754+0000","last_active":"2023-09-30T17:06:06.523686+0000","last_peered":"2023-09-30T17:06:06.523686+0000","last_clean":"2023-09-30T17:06:06.523686+0000","last_became_active":"2023-09-30T17:05:03.310763+0000","last_became_peered":"2023-09-30T17:05:03.310763+0000","last_unstale":"2023-09-30T17:06:06.523686+0000","last_undegraded":"2023-09-30T17:06:06.523686+0000","last_fullsized":"2023-09-30T17:06:06.523686+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'10","last_scrub_stamp":"2023-09-30T17:06:06.523566+0000","last_deep_scrub":"59'10","last_deep_scrub_stamp":"2023-09-30T17:06:06.523566+0000","last_clean_scrub_stamp":"2023-09-30T17:06:06.523566+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:48:10.092815+0000","scrub_duration":0.002623748,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":81,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:07.596434+0000","last_change":"2023-09-30T17:06:07.596434+0000","last_active":"2023-09-30T17:06:07.596434+0000","last_peered":"2023-09-30T17:06:07.596434+0000","last_clean":"2023-09-30T17:06:07.596434+0000","last_became_active":"2023-09-30T17:02:17.360475+0000","last_became_peered":"2023-09-30T17:02:17.360475+0000","last_unstale":"2023-09-30T17:06:07.596434+0000","last_undegraded":"2023-09-30T17:06:07.596434+0000","last_fullsized":"2023-09-30T17:06:07.596434+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2023-09-30T17:06:07.596283+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2023-09-30T17:06:07.596283+0000","last_clean_scrub_stamp":"2023-09-30T17:06:07.596283+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:28:14.693610+0000","scrub_duration":0.0022969660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"59'5711","reported_seq":5789,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:08.654294+0000","last_change":"2023-09-30T17:06:08.654348+0000","last_active":"2023-09-30T17:06:08.654294+0000","last_peered":"2023-09-30T17:06:08.654294+0000","last_clean":"2023-09-30T17:06:08.654294+0000","last_became_active":"2023-09-30T17:02:18.357098+0000","last_became_peered":"2023-09-30T17:02:18.357098+0000","last_unstale":"2023-09-30T17:06:08.654294+0000","last_undegraded":"2023-09-30T17:06:08.654294+0000","last_fullsized":"2023-09-30T17:06:08.654294+0000","mapping_epoch":17,"log_start":"42'1200","ondisk_log_start":"42'1200","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'5711","last_scrub_stamp":"2023-09-30T17:06:08.654151+0000","last_deep_scrub":"59'5711","last_deep_scrub_stamp":"2023-09-30T17:06:08.654151+0000","last_clean_scrub_stamp":"2023-09-30T17:06:08.654151+0000","objects_scrubbed":0,"log_size":4511,"log_dups_size":1200,"ondisk_log_size":4511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:10:37.539726+0000","scrub_duration":0.0037229939999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16681,"num_write_kb":79476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"76'6","reported_seq":97,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:55.637582+0000","last_change":"2023-09-30T17:05:55.637582+0000","last_active":"2023-09-30T17:05:55.637582+0000","last_peered":"2023-09-30T17:05:55.637582+0000","last_clean":"2023-09-30T17:05:55.637582+0000","last_became_active":"2023-09-30T17:05:03.313050+0000","last_became_peered":"2023-09-30T17:05:03.313050+0000","last_unstale":"2023-09-30T17:05:55.637582+0000","last_undegraded":"2023-09-30T17:05:55.637582+0000","last_fullsized":"2023-09-30T17:05:55.637582+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'6","last_scrub_stamp":"2023-09-30T17:05:55.637417+0000","last_deep_scrub":"76'6","last_deep_scrub_stamp":"2023-09-30T17:05:55.637417+0000","last_clean_scrub_stamp":"2023-09-30T17:05:55.637417+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:27:26.801859+0000","scrub_duration":0.006333272,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"59'2872","reported_seq":2940,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:26.309594+0000","last_change":"2023-09-30T17:05:06.290298+0000","last_active":"2023-09-30T17:05:26.309594+0000","last_peered":"2023-09-30T17:05:26.309594+0000","last_clean":"2023-09-30T17:05:26.309594+0000","last_became_active":"2023-09-30T17:05:06.289197+0000","last_became_peered":"2023-09-30T17:05:06.289197+0000","last_unstale":"2023-09-30T17:05:26.309594+0000","last_undegraded":"2023-09-30T17:05:26.309594+0000","last_fullsized":"2023-09-30T17:05:26.309594+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2872,"log_dups_size":0,"ondisk_log_size":2872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8447,"num_write_kb":40072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"59'9","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:54.611596+0000","last_change":"2023-09-30T17:05:54.611653+0000","last_active":"2023-09-30T17:05:54.611596+0000","last_peered":"2023-09-30T17:05:54.611596+0000","last_clean":"2023-09-30T17:05:54.611596+0000","last_became_active":"2023-09-30T17:05:03.310591+0000","last_became_peered":"2023-09-30T17:05:03.310591+0000","last_unstale":"2023-09-30T17:05:54.611596+0000","last_undegraded":"2023-09-30T17:05:54.611596+0000","last_fullsized":"2023-09-30T17:05:54.611596+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'9","last_scrub_stamp":"2023-09-30T17:05:54.611494+0000","last_deep_scrub":"59'9","last_deep_scrub_stamp":"2023-09-30T17:05:54.611494+0000","last_clean_scrub_stamp":"2023-09-30T17:05:54.611494+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:03:16.862122+0000","scrub_duration":0.0022998649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"59'13","reported_seq":92,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:03.582587+0000","last_change":"2023-09-30T17:06:03.582587+0000","last_active":"2023-09-30T17:06:03.582587+0000","last_peered":"2023-09-30T17:06:03.582587+0000","last_clean":"2023-09-30T17:06:03.582587+0000","last_became_active":"2023-09-30T17:02:18.363222+0000","last_became_peered":"2023-09-30T17:02:18.363222+0000","last_unstale":"2023-09-30T17:06:03.582587+0000","last_undegraded":"2023-09-30T17:06:03.582587+0000","last_fullsized":"2023-09-30T17:06:03.582587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'13","last_scrub_stamp":"2023-09-30T17:06:03.582383+0000","last_deep_scrub":"59'13","last_deep_scrub_stamp":"2023-09-30T17:06:03.582383+0000","last_clean_scrub_stamp":"2023-09-30T17:06:03.582383+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:58:49.007492+0000","scrub_duration":0.0032092079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"59'2796","reported_seq":2887,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:35.373643+0000","last_change":"2023-09-30T17:05:06.292455+0000","last_active":"2023-09-30T17:05:35.373643+0000","last_peered":"2023-09-30T17:05:35.373643+0000","last_clean":"2023-09-30T17:05:35.373643+0000","last_became_active":"2023-09-30T17:05:06.290929+0000","last_became_peered":"2023-09-30T17:05:06.290929+0000","last_unstale":"2023-09-30T17:05:35.373643+0000","last_undegraded":"2023-09-30T17:05:35.373643+0000","last_fullsized":"2023-09-30T17:05:35.373643+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2796,"log_dups_size":0,"ondisk_log_size":2796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8138,"num_write_kb":38784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"59'2852","reported_seq":2931,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:59.672667+0000","last_change":"2023-09-30T17:05:59.672667+0000","last_active":"2023-09-30T17:05:59.672667+0000","last_peered":"2023-09-30T17:05:59.672667+0000","last_clean":"2023-09-30T17:05:59.672667+0000","last_became_active":"2023-09-30T17:02:18.362894+0000","last_became_peered":"2023-09-30T17:02:18.362894+0000","last_unstale":"2023-09-30T17:05:59.672667+0000","last_undegraded":"2023-09-30T17:05:59.672667+0000","last_fullsized":"2023-09-30T17:05:59.672667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2852","last_scrub_stamp":"2023-09-30T17:05:59.672454+0000","last_deep_scrub":"59'2852","last_deep_scrub_stamp":"2023-09-30T17:05:59.672454+0000","last_clean_scrub_stamp":"2023-09-30T17:05:59.672454+0000","objects_scrubbed":0,"log_size":2852,"log_dups_size":0,"ondisk_log_size":2852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:25:06.256229+0000","scrub_duration":0.0033008859999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8357,"num_write_kb":39780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"59'2874","reported_seq":2965,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:35.373663+0000","last_change":"2023-09-30T17:05:06.294279+0000","last_active":"2023-09-30T17:05:35.373663+0000","last_peered":"2023-09-30T17:05:35.373663+0000","last_clean":"2023-09-30T17:05:35.373663+0000","last_became_active":"2023-09-30T17:05:06.292898+0000","last_became_peered":"2023-09-30T17:05:06.292898+0000","last_unstale":"2023-09-30T17:05:35.373663+0000","last_undegraded":"2023-09-30T17:05:35.373663+0000","last_fullsized":"2023-09-30T17:05:35.373663+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:02:17.339234+0000","last_clean_scrub_stamp":"2023-09-30T17:02:17.339234+0000","objects_scrubbed":0,"log_size":2874,"log_dups_size":0,"ondisk_log_size":2874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8465,"num_write_kb":40104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":532685,"num_write_kb":2575302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140940,"ondisk_log_size":140940,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":228927,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":137,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":223425,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":524288,"data_stored":457854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},"log_size":153,"ondisk_log_size":153,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":66,"seq":283467841561,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47036,"kb_used_data":1460,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94324804,"statfs":{"total":96636764160,"available":96588599296,"internally_reserved":0,"allocated":1495040,"data_stored":1123985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7139,"internal_metadata":46654493},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 17:06:06 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.495}]},{"osd":1,"last update":"Sat Sep 30 17:06:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.65900000000000003,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.47899999999999998}]}]},{"osd":0,"up_from":8,"seq":34359738430,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":582448,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":580990,"kb_avail":93789392,"statfs":{"total":96636764160,"available":96040337408,"internally_reserved":0,"allocated":1482752,"data_stored":1122763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":594934214},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 17:06:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.51400000000000001,"15min":0.48799999999999999},"min":{"1min":0.317,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.58199999999999996,"5min":5.9480000000000004,"15min":5.9480000000000004},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.46800000000000003,"5min":0.50800000000000001,"15min":0.46500000000000002},"min":{"1min":0.27700000000000002,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.70899999999999996,"5min":3.6819999999999999,"15min":3.6819999999999999},"last":0.51100000000000001}]},{"osd":2,"last update":"Sat Sep 30 17:06:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.437},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.69099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.41399999999999998}]}]},{"osd":1,"up_from":8,"seq":34359738430,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":563588,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":562942,"kb_avail":93808252,"statfs":{"total":96636764160,"available":96059650048,"internally_reserved":0,"allocated":651264,"data_stored":305912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":576453062},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 17:06:14 2023","interfaces":[{"interface":"back","average":{"1min":0.44600000000000001,"5min":0.48699999999999999,"15min":0.45600000000000002},"min":{"1min":0.29999999999999999,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.65500000000000003,"5min":3.3420000000000001,"15min":3.3420000000000001},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.52100000000000002,"15min":0.46300000000000002},"min":{"1min":0.32900000000000001,"5min":0.188,"15min":0.188},"max":{"1min":0.60599999999999998,"5min":3.5470000000000002,"15min":3.5470000000000002},"last":0.56699999999999995}]},{"osd":2,"last update":"Sat Sep 30 17:06:03 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.999,"5min":0.999,"15min":0.999},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.53500000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":249856,"data_stored":227705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":228927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T17:07:01.192 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:07:01.193 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:07:01.193 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:07:01.193 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:07:01.193 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:07:01.193 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:07:01.194 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:07:01.194 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:07:01.194 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:07:01.194 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:07:01.194 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:07:01.195 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:07:01.195 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:07:01.195 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:07:01.195 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:07:01.195 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:07:01.195 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:07:01.196 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2023-09-30T17:02:16.333605+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=16, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:07:01.196 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:07:01.196 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:07:01.196 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2023-09-30T17:02:17.339234+0000 time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=2, tm_sec=17, tm_wday=5, tm_yday=273, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=9, tm_mday=30, tm_hour=17, tm_min=5, tm_sec=33, tm_wday=5, tm_yday=273, tm_isdst=0) 2023-09-30T17:07:01.196 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-09-30T17:07:21.198 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T17:07:21.557 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:07:21.559 INFO:teuthology.orchestra.run.smithi007.stderr:dumped all 2023-09-30T17:07:21.577 INFO:teuthology.orchestra.run.smithi007.stdout:{"pg_ready":true,"pg_map":{"version":232,"stamp":"2023-09-30T17:07:21.369203+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":819295,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":140,"num_read_kb":122,"num_write":533025,"num_write_kb":2579054,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":223425,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141254,"ondisk_log_size":141254,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":3,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":283115520,"kb_used":1193072,"kb_used_data":3544,"kb_used_omap":10,"kb_used_meta":1189493,"kb_avail":281922448,"statfs":{"total":289910292480,"available":288688586752,"internally_reserved":0,"allocated":3629056,"data_stored":2552660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10327,"internal_metadata":1218041769},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003110"},"pg_stats":[{"pgid":"4.3f","version":"59'2790","reported_seq":2869,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:47.554662+0000","last_change":"2023-09-30T17:05:47.554662+0000","last_active":"2023-09-30T17:05:47.554662+0000","last_peered":"2023-09-30T17:05:47.554662+0000","last_clean":"2023-09-30T17:05:47.554662+0000","last_became_active":"2023-09-30T17:02:18.358716+0000","last_became_peered":"2023-09-30T17:02:18.358716+0000","last_unstale":"2023-09-30T17:05:47.554662+0000","last_undegraded":"2023-09-30T17:05:47.554662+0000","last_fullsized":"2023-09-30T17:05:47.554662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2790","last_scrub_stamp":"2023-09-30T17:05:47.554500+0000","last_deep_scrub":"59'2790","last_deep_scrub_stamp":"2023-09-30T17:05:47.554500+0000","last_clean_scrub_stamp":"2023-09-30T17:05:47.554500+0000","objects_scrubbed":0,"log_size":2790,"log_dups_size":0,"ondisk_log_size":2790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:40:37.069833+0000","scrub_duration":0.0021350679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8214,"num_write_kb":38924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"59'4","reported_seq":83,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:39.661898+0000","last_change":"2023-09-30T17:05:39.661898+0000","last_active":"2023-09-30T17:05:39.661898+0000","last_peered":"2023-09-30T17:05:39.661898+0000","last_clean":"2023-09-30T17:05:39.661898+0000","last_became_active":"2023-09-30T17:02:18.360372+0000","last_became_peered":"2023-09-30T17:02:18.360372+0000","last_unstale":"2023-09-30T17:05:39.661898+0000","last_undegraded":"2023-09-30T17:05:39.661898+0000","last_fullsized":"2023-09-30T17:05:39.661898+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'4","last_scrub_stamp":"2023-09-30T17:05:39.661696+0000","last_deep_scrub":"59'4","last_deep_scrub_stamp":"2023-09-30T17:05:39.661696+0000","last_clean_scrub_stamp":"2023-09-30T17:05:39.661696+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:53:12.475703+0000","scrub_duration":0.0028517759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"59'5697","reported_seq":5781,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:07:12.315327+0000","last_change":"2023-09-30T17:07:12.315393+0000","last_active":"2023-09-30T17:07:12.315327+0000","last_peered":"2023-09-30T17:07:12.315327+0000","last_clean":"2023-09-30T17:07:12.315327+0000","last_became_active":"2023-09-30T17:05:06.290447+0000","last_became_peered":"2023-09-30T17:05:06.290447+0000","last_unstale":"2023-09-30T17:07:12.315327+0000","last_undegraded":"2023-09-30T17:07:12.315327+0000","last_fullsized":"2023-09-30T17:07:12.315327+0000","mapping_epoch":69,"log_start":"42'1200","ondisk_log_start":"42'1200","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'5697","last_scrub_stamp":"2023-09-30T17:07:12.315201+0000","last_deep_scrub":"59'5697","last_deep_scrub_stamp":"2023-09-30T17:07:12.315201+0000","last_clean_scrub_stamp":"2023-09-30T17:07:12.315201+0000","objects_scrubbed":0,"log_size":4497,"log_dups_size":1200,"ondisk_log_size":4497,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:56:22.661712+0000","scrub_duration":0.0024816180000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16590,"num_write_kb":78960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"59'10","reported_seq":39,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:40.333812+0000","last_change":"2023-09-30T17:06:40.333812+0000","last_active":"2023-09-30T17:06:40.333812+0000","last_peered":"2023-09-30T17:06:40.333812+0000","last_clean":"2023-09-30T17:06:40.333812+0000","last_became_active":"2023-09-30T17:05:03.309326+0000","last_became_peered":"2023-09-30T17:05:03.309326+0000","last_unstale":"2023-09-30T17:06:40.333812+0000","last_undegraded":"2023-09-30T17:06:40.333812+0000","last_fullsized":"2023-09-30T17:06:40.333812+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'10","last_scrub_stamp":"2023-09-30T17:06:40.333585+0000","last_deep_scrub":"59'10","last_deep_scrub_stamp":"2023-09-30T17:06:40.333585+0000","last_clean_scrub_stamp":"2023-09-30T17:06:40.333585+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:59:27.119913+0000","scrub_duration":0.0025354900000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"59'2934","reported_seq":3013,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:50.604194+0000","last_change":"2023-09-30T17:05:50.604194+0000","last_active":"2023-09-30T17:05:50.604194+0000","last_peered":"2023-09-30T17:05:50.604194+0000","last_clean":"2023-09-30T17:05:50.604194+0000","last_became_active":"2023-09-30T17:02:18.357317+0000","last_became_peered":"2023-09-30T17:02:18.357317+0000","last_unstale":"2023-09-30T17:05:50.604194+0000","last_undegraded":"2023-09-30T17:05:50.604194+0000","last_fullsized":"2023-09-30T17:05:50.604194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2934","last_scrub_stamp":"2023-09-30T17:05:50.604022+0000","last_deep_scrub":"59'2934","last_deep_scrub_stamp":"2023-09-30T17:05:50.604022+0000","last_clean_scrub_stamp":"2023-09-30T17:05:50.604022+0000","objects_scrubbed":0,"log_size":2934,"log_dups_size":0,"ondisk_log_size":2934,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:13:55.986563+0000","scrub_duration":0.00343991,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8466,"num_write_kb":40084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"59'6","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:56.578435+0000","last_change":"2023-09-30T17:05:56.578507+0000","last_active":"2023-09-30T17:05:56.578435+0000","last_peered":"2023-09-30T17:05:56.578435+0000","last_clean":"2023-09-30T17:05:56.578435+0000","last_became_active":"2023-09-30T17:05:03.310703+0000","last_became_peered":"2023-09-30T17:05:03.310703+0000","last_unstale":"2023-09-30T17:05:56.578435+0000","last_undegraded":"2023-09-30T17:05:56.578435+0000","last_fullsized":"2023-09-30T17:05:56.578435+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'6","last_scrub_stamp":"2023-09-30T17:05:56.578325+0000","last_deep_scrub":"59'6","last_deep_scrub_stamp":"2023-09-30T17:05:56.578325+0000","last_clean_scrub_stamp":"2023-09-30T17:05:56.578325+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:27:47.196956+0000","scrub_duration":0.0024309819999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.39","version":"59'7","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:49.354595+0000","last_change":"2023-09-30T17:06:49.354643+0000","last_active":"2023-09-30T17:06:49.354595+0000","last_peered":"2023-09-30T17:06:49.354595+0000","last_clean":"2023-09-30T17:06:49.354595+0000","last_became_active":"2023-09-30T17:05:03.310047+0000","last_became_peered":"2023-09-30T17:05:03.310047+0000","last_unstale":"2023-09-30T17:06:49.354595+0000","last_undegraded":"2023-09-30T17:06:49.354595+0000","last_fullsized":"2023-09-30T17:06:49.354595+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'7","last_scrub_stamp":"2023-09-30T17:06:49.354462+0000","last_deep_scrub":"59'7","last_deep_scrub_stamp":"2023-09-30T17:06:49.354462+0000","last_clean_scrub_stamp":"2023-09-30T17:06:49.354462+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:51:46.105140+0000","scrub_duration":0.003225407,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"59'11423","reported_seq":11508,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:23.326516+0000","last_change":"2023-09-30T17:06:23.326573+0000","last_active":"2023-09-30T17:06:23.326516+0000","last_peered":"2023-09-30T17:06:23.326516+0000","last_clean":"2023-09-30T17:06:23.326516+0000","last_became_active":"2023-09-30T17:05:06.285582+0000","last_became_peered":"2023-09-30T17:05:06.285582+0000","last_unstale":"2023-09-30T17:06:23.326516+0000","last_undegraded":"2023-09-30T17:06:23.326516+0000","last_fullsized":"2023-09-30T17:06:23.326516+0000","mapping_epoch":69,"log_start":"52'7200","ondisk_log_start":"52'7200","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'11423","last_scrub_stamp":"2023-09-30T17:06:23.326398+0000","last_deep_scrub":"59'11423","last_deep_scrub_stamp":"2023-09-30T17:06:23.326398+0000","last_clean_scrub_stamp":"2023-09-30T17:06:23.326398+0000","objects_scrubbed":0,"log_size":4223,"log_dups_size":5777,"ondisk_log_size":4223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:42:30.429670+0000","scrub_duration":0.0025180100000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33444,"num_write_kb":158924,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.37","version":"59'8589","reported_seq":8668,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:07:02.409683+0000","last_change":"2023-09-30T17:07:02.409683+0000","last_active":"2023-09-30T17:07:02.409683+0000","last_peered":"2023-09-30T17:07:02.409683+0000","last_clean":"2023-09-30T17:07:02.409683+0000","last_became_active":"2023-09-30T17:02:18.363485+0000","last_became_peered":"2023-09-30T17:02:18.363485+0000","last_unstale":"2023-09-30T17:07:02.409683+0000","last_undegraded":"2023-09-30T17:07:02.409683+0000","last_fullsized":"2023-09-30T17:07:02.409683+0000","mapping_epoch":17,"log_start":"49'4400","ondisk_log_start":"49'4400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'8589","last_scrub_stamp":"2023-09-30T17:07:02.409531+0000","last_deep_scrub":"59'8589","last_deep_scrub_stamp":"2023-09-30T17:07:02.409531+0000","last_clean_scrub_stamp":"2023-09-30T17:07:02.409531+0000","objects_scrubbed":0,"log_size":4189,"log_dups_size":4400,"ondisk_log_size":4189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:47:34.189097+0000","scrub_duration":0.0036607250000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25052,"num_write_kb":118756,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"59'8585","reported_seq":8664,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:01.724952+0000","last_change":"2023-09-30T17:06:01.724952+0000","last_active":"2023-09-30T17:06:01.724952+0000","last_peered":"2023-09-30T17:06:01.724952+0000","last_clean":"2023-09-30T17:06:01.724952+0000","last_became_active":"2023-09-30T17:02:18.358396+0000","last_became_peered":"2023-09-30T17:02:18.358396+0000","last_unstale":"2023-09-30T17:06:01.724952+0000","last_undegraded":"2023-09-30T17:06:01.724952+0000","last_fullsized":"2023-09-30T17:06:01.724952+0000","mapping_epoch":17,"log_start":"48'4100","ondisk_log_start":"48'4100","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'8585","last_scrub_stamp":"2023-09-30T17:06:01.724792+0000","last_deep_scrub":"59'8585","last_deep_scrub_stamp":"2023-09-30T17:06:01.724792+0000","last_clean_scrub_stamp":"2023-09-30T17:06:01.724792+0000","objects_scrubbed":0,"log_size":4485,"log_dups_size":4100,"ondisk_log_size":4485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:35:48.146536+0000","scrub_duration":0.0040357209999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24997,"num_write_kb":162463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"59'5664","reported_seq":5749,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:46.618589+0000","last_change":"2023-09-30T17:05:46.618636+0000","last_active":"2023-09-30T17:05:46.618589+0000","last_peered":"2023-09-30T17:05:46.618589+0000","last_clean":"2023-09-30T17:05:46.618589+0000","last_became_active":"2023-09-30T17:05:06.290193+0000","last_became_peered":"2023-09-30T17:05:06.290193+0000","last_unstale":"2023-09-30T17:05:46.618589+0000","last_undegraded":"2023-09-30T17:05:46.618589+0000","last_fullsized":"2023-09-30T17:05:46.618589+0000","mapping_epoch":69,"log_start":"43'1400","ondisk_log_start":"43'1400","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'5664","last_scrub_stamp":"2023-09-30T17:05:46.618493+0000","last_deep_scrub":"59'5664","last_deep_scrub_stamp":"2023-09-30T17:05:46.618493+0000","last_clean_scrub_stamp":"2023-09-30T17:05:46.618493+0000","objects_scrubbed":0,"log_size":4264,"log_dups_size":1400,"ondisk_log_size":4264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:50:52.323251+0000","scrub_duration":0.0029415959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16442,"num_write_kb":78308,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.34","version":"59'2931","reported_seq":3030,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:07:02.099007+0000","last_change":"2023-09-30T17:07:02.099007+0000","last_active":"2023-09-30T17:07:02.099007+0000","last_peered":"2023-09-30T17:07:02.099007+0000","last_clean":"2023-09-30T17:07:02.099007+0000","last_became_active":"2023-09-30T17:05:06.288753+0000","last_became_peered":"2023-09-30T17:05:06.288753+0000","last_unstale":"2023-09-30T17:07:02.099007+0000","last_undegraded":"2023-09-30T17:07:02.099007+0000","last_fullsized":"2023-09-30T17:07:02.099007+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2931","last_scrub_stamp":"2023-09-30T17:07:02.098841+0000","last_deep_scrub":"59'2931","last_deep_scrub_stamp":"2023-09-30T17:07:02.098841+0000","last_clean_scrub_stamp":"2023-09-30T17:07:02.098841+0000","objects_scrubbed":0,"log_size":2931,"log_dups_size":0,"ondisk_log_size":2931,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:47:37.007092+0000","scrub_duration":0.00266636,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8488,"num_write_kb":40364,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"59'2860","reported_seq":2939,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:12.712399+0000","last_change":"2023-09-30T17:06:12.712399+0000","last_active":"2023-09-30T17:06:12.712399+0000","last_peered":"2023-09-30T17:06:12.712399+0000","last_clean":"2023-09-30T17:06:12.712399+0000","last_became_active":"2023-09-30T17:02:18.358534+0000","last_became_peered":"2023-09-30T17:02:18.358534+0000","last_unstale":"2023-09-30T17:06:12.712399+0000","last_undegraded":"2023-09-30T17:06:12.712399+0000","last_fullsized":"2023-09-30T17:06:12.712399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2860","last_scrub_stamp":"2023-09-30T17:06:12.712247+0000","last_deep_scrub":"59'2860","last_deep_scrub_stamp":"2023-09-30T17:06:12.712247+0000","last_clean_scrub_stamp":"2023-09-30T17:06:12.712247+0000","objects_scrubbed":0,"log_size":2860,"log_dups_size":0,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:44:33.166129+0000","scrub_duration":0.002572104,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8367,"num_write_kb":39772,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"59'2911","reported_seq":2988,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:42.691905+0000","last_change":"2023-09-30T17:05:42.691905+0000","last_active":"2023-09-30T17:05:42.691905+0000","last_peered":"2023-09-30T17:05:42.691905+0000","last_clean":"2023-09-30T17:05:42.691905+0000","last_became_active":"2023-09-30T17:05:06.288360+0000","last_became_peered":"2023-09-30T17:05:06.288360+0000","last_unstale":"2023-09-30T17:05:42.691905+0000","last_undegraded":"2023-09-30T17:05:42.691905+0000","last_fullsized":"2023-09-30T17:05:42.691905+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2911","last_scrub_stamp":"2023-09-30T17:05:42.691679+0000","last_deep_scrub":"59'2911","last_deep_scrub_stamp":"2023-09-30T17:05:42.691679+0000","last_clean_scrub_stamp":"2023-09-30T17:05:42.691679+0000","objects_scrubbed":0,"log_size":2911,"log_dups_size":0,"ondisk_log_size":2911,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:58:28.142176+0000","scrub_duration":0.0030980600000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8419,"num_write_kb":39940,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.31","version":"59'2889","reported_seq":2966,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:47.659805+0000","last_change":"2023-09-30T17:05:47.659805+0000","last_active":"2023-09-30T17:05:47.659805+0000","last_peered":"2023-09-30T17:05:47.659805+0000","last_clean":"2023-09-30T17:05:47.659805+0000","last_became_active":"2023-09-30T17:05:06.285738+0000","last_became_peered":"2023-09-30T17:05:06.285738+0000","last_unstale":"2023-09-30T17:05:47.659805+0000","last_undegraded":"2023-09-30T17:05:47.659805+0000","last_fullsized":"2023-09-30T17:05:47.659805+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2889","last_scrub_stamp":"2023-09-30T17:05:47.659610+0000","last_deep_scrub":"59'2889","last_deep_scrub_stamp":"2023-09-30T17:05:47.659610+0000","last_clean_scrub_stamp":"2023-09-30T17:05:47.659610+0000","objects_scrubbed":0,"log_size":2889,"log_dups_size":0,"ondisk_log_size":2889,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:55:36.031386+0000","scrub_duration":0.0023223979999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8435,"num_write_kb":39984,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"59'2839","reported_seq":2916,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:07:06.332006+0000","last_change":"2023-09-30T17:07:06.332006+0000","last_active":"2023-09-30T17:07:06.332006+0000","last_peered":"2023-09-30T17:07:06.332006+0000","last_clean":"2023-09-30T17:07:06.332006+0000","last_became_active":"2023-09-30T17:05:06.289872+0000","last_became_peered":"2023-09-30T17:05:06.289872+0000","last_unstale":"2023-09-30T17:07:06.332006+0000","last_undegraded":"2023-09-30T17:07:06.332006+0000","last_fullsized":"2023-09-30T17:07:06.332006+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2839","last_scrub_stamp":"2023-09-30T17:07:06.331857+0000","last_deep_scrub":"59'2839","last_deep_scrub_stamp":"2023-09-30T17:07:06.331857+0000","last_clean_scrub_stamp":"2023-09-30T17:07:06.331857+0000","objects_scrubbed":0,"log_size":2839,"log_dups_size":0,"ondisk_log_size":2839,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:30:51.561393+0000","scrub_duration":0.0028179059999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8166,"num_write_kb":38928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"59'2802","reported_seq":2881,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:23.436665+0000","last_change":"2023-09-30T17:06:23.436665+0000","last_active":"2023-09-30T17:06:23.436665+0000","last_peered":"2023-09-30T17:06:23.436665+0000","last_clean":"2023-09-30T17:06:23.436665+0000","last_became_active":"2023-09-30T17:02:18.363697+0000","last_became_peered":"2023-09-30T17:02:18.363697+0000","last_unstale":"2023-09-30T17:06:23.436665+0000","last_undegraded":"2023-09-30T17:06:23.436665+0000","last_fullsized":"2023-09-30T17:06:23.436665+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2802","last_scrub_stamp":"2023-09-30T17:06:23.436443+0000","last_deep_scrub":"59'2802","last_deep_scrub_stamp":"2023-09-30T17:06:23.436443+0000","last_clean_scrub_stamp":"2023-09-30T17:06:23.436443+0000","objects_scrubbed":0,"log_size":2802,"log_dups_size":0,"ondisk_log_size":2802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:46:24.401617+0000","scrub_duration":0.0024206399999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8256,"num_write_kb":39208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"59'2860","reported_seq":2939,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:57.726023+0000","last_change":"2023-09-30T17:05:57.726023+0000","last_active":"2023-09-30T17:05:57.726023+0000","last_peered":"2023-09-30T17:05:57.726023+0000","last_clean":"2023-09-30T17:05:57.726023+0000","last_became_active":"2023-09-30T17:02:18.357184+0000","last_became_peered":"2023-09-30T17:02:18.357184+0000","last_unstale":"2023-09-30T17:05:57.726023+0000","last_undegraded":"2023-09-30T17:05:57.726023+0000","last_fullsized":"2023-09-30T17:05:57.726023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2860","last_scrub_stamp":"2023-09-30T17:05:57.725852+0000","last_deep_scrub":"59'2860","last_deep_scrub_stamp":"2023-09-30T17:05:57.725852+0000","last_clean_scrub_stamp":"2023-09-30T17:05:57.725852+0000","objects_scrubbed":0,"log_size":2860,"log_dups_size":0,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:28:04.823179+0000","scrub_duration":0.003284379,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8368,"num_write_kb":39616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"59'5686","reported_seq":5765,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:07:06.338726+0000","last_change":"2023-09-30T17:07:06.338780+0000","last_active":"2023-09-30T17:07:06.338726+0000","last_peered":"2023-09-30T17:07:06.338726+0000","last_clean":"2023-09-30T17:07:06.338726+0000","last_became_active":"2023-09-30T17:02:18.363654+0000","last_became_peered":"2023-09-30T17:02:18.363654+0000","last_unstale":"2023-09-30T17:07:06.338726+0000","last_undegraded":"2023-09-30T17:07:06.338726+0000","last_fullsized":"2023-09-30T17:07:06.338726+0000","mapping_epoch":17,"log_start":"44'1500","ondisk_log_start":"44'1500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'5686","last_scrub_stamp":"2023-09-30T17:07:06.338608+0000","last_deep_scrub":"59'5686","last_deep_scrub_stamp":"2023-09-30T17:07:06.338608+0000","last_clean_scrub_stamp":"2023-09-30T17:07:06.338608+0000","objects_scrubbed":0,"log_size":4186,"log_dups_size":1500,"ondisk_log_size":4186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:34:16.947457+0000","scrub_duration":0.0031534449999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16649,"num_write_kb":78956,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"59'5799","reported_seq":5886,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:07:03.389761+0000","last_change":"2023-09-30T17:07:03.389761+0000","last_active":"2023-09-30T17:07:03.389761+0000","last_peered":"2023-09-30T17:07:03.389761+0000","last_clean":"2023-09-30T17:07:03.389761+0000","last_became_active":"2023-09-30T17:05:06.289817+0000","last_became_peered":"2023-09-30T17:05:06.289817+0000","last_unstale":"2023-09-30T17:07:03.389761+0000","last_undegraded":"2023-09-30T17:07:03.389761+0000","last_fullsized":"2023-09-30T17:07:03.389761+0000","mapping_epoch":69,"log_start":"44'1600","ondisk_log_start":"44'1600","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'5799","last_scrub_stamp":"2023-09-30T17:07:03.389598+0000","last_deep_scrub":"59'5799","last_deep_scrub_stamp":"2023-09-30T17:07:03.389598+0000","last_clean_scrub_stamp":"2023-09-30T17:07:03.389598+0000","objects_scrubbed":0,"log_size":4199,"log_dups_size":1600,"ondisk_log_size":4199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:49:50.839704+0000","scrub_duration":0.0028488989999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16903,"num_write_kb":80184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2b","version":"59'12","reported_seq":39,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:21.397978+0000","last_change":"2023-09-30T17:06:21.397978+0000","last_active":"2023-09-30T17:06:21.397978+0000","last_peered":"2023-09-30T17:06:21.397978+0000","last_clean":"2023-09-30T17:06:21.397978+0000","last_became_active":"2023-09-30T17:05:03.309537+0000","last_became_peered":"2023-09-30T17:05:03.309537+0000","last_unstale":"2023-09-30T17:06:21.397978+0000","last_undegraded":"2023-09-30T17:06:21.397978+0000","last_fullsized":"2023-09-30T17:06:21.397978+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'12","last_scrub_stamp":"2023-09-30T17:06:21.397829+0000","last_deep_scrub":"59'12","last_deep_scrub_stamp":"2023-09-30T17:06:21.397829+0000","last_clean_scrub_stamp":"2023-09-30T17:06:21.397829+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:09:16.446743+0000","scrub_duration":0.0024723459999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2a","version":"59'2879","reported_seq":2978,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:07:03.092923+0000","last_change":"2023-09-30T17:07:03.092974+0000","last_active":"2023-09-30T17:07:03.092923+0000","last_peered":"2023-09-30T17:07:03.092923+0000","last_clean":"2023-09-30T17:07:03.092923+0000","last_became_active":"2023-09-30T17:05:06.290797+0000","last_became_peered":"2023-09-30T17:05:06.290797+0000","last_unstale":"2023-09-30T17:07:03.092923+0000","last_undegraded":"2023-09-30T17:07:03.092923+0000","last_fullsized":"2023-09-30T17:07:03.092923+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2879","last_scrub_stamp":"2023-09-30T17:07:03.092810+0000","last_deep_scrub":"59'2879","last_deep_scrub_stamp":"2023-09-30T17:07:03.092810+0000","last_clean_scrub_stamp":"2023-09-30T17:07:03.092810+0000","objects_scrubbed":0,"log_size":2879,"log_dups_size":0,"ondisk_log_size":2879,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:35:21.756158+0000","scrub_duration":0.0025499199999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8343,"num_write_kb":39768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"59'2809","reported_seq":2908,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:30.315229+0000","last_change":"2023-09-30T17:06:30.315229+0000","last_active":"2023-09-30T17:06:30.315229+0000","last_peered":"2023-09-30T17:06:30.315229+0000","last_clean":"2023-09-30T17:06:30.315229+0000","last_became_active":"2023-09-30T17:05:06.288837+0000","last_became_peered":"2023-09-30T17:05:06.288837+0000","last_unstale":"2023-09-30T17:06:30.315229+0000","last_undegraded":"2023-09-30T17:06:30.315229+0000","last_fullsized":"2023-09-30T17:06:30.315229+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2809","last_scrub_stamp":"2023-09-30T17:06:30.315071+0000","last_deep_scrub":"59'2809","last_deep_scrub_stamp":"2023-09-30T17:06:30.315071+0000","last_clean_scrub_stamp":"2023-09-30T17:06:30.315071+0000","objects_scrubbed":0,"log_size":2809,"log_dups_size":0,"ondisk_log_size":2809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:06:21.933414+0000","scrub_duration":0.002757893,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8281,"num_write_kb":39472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.28","version":"59'5585","reported_seq":5664,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:11.715889+0000","last_change":"2023-09-30T17:06:11.715889+0000","last_active":"2023-09-30T17:06:11.715889+0000","last_peered":"2023-09-30T17:06:11.715889+0000","last_clean":"2023-09-30T17:06:11.715889+0000","last_became_active":"2023-09-30T17:02:18.353632+0000","last_became_peered":"2023-09-30T17:02:18.353632+0000","last_unstale":"2023-09-30T17:06:11.715889+0000","last_undegraded":"2023-09-30T17:06:11.715889+0000","last_fullsized":"2023-09-30T17:06:11.715889+0000","mapping_epoch":17,"log_start":"42'1100","ondisk_log_start":"42'1100","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'5585","last_scrub_stamp":"2023-09-30T17:06:11.715704+0000","last_deep_scrub":"59'5585","last_deep_scrub_stamp":"2023-09-30T17:06:11.715704+0000","last_clean_scrub_stamp":"2023-09-30T17:06:11.715704+0000","objects_scrubbed":0,"log_size":4485,"log_dups_size":1100,"ondisk_log_size":4485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:47:36.619172+0000","scrub_duration":0.003196726,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16523,"num_write_kb":78256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"59'2888","reported_seq":2987,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:50.070801+0000","last_change":"2023-09-30T17:06:50.070850+0000","last_active":"2023-09-30T17:06:50.070801+0000","last_peered":"2023-09-30T17:06:50.070801+0000","last_clean":"2023-09-30T17:06:50.070801+0000","last_became_active":"2023-09-30T17:05:06.291346+0000","last_became_peered":"2023-09-30T17:05:06.291346+0000","last_unstale":"2023-09-30T17:06:50.070801+0000","last_undegraded":"2023-09-30T17:06:50.070801+0000","last_fullsized":"2023-09-30T17:06:50.070801+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2888","last_scrub_stamp":"2023-09-30T17:06:50.070681+0000","last_deep_scrub":"59'2888","last_deep_scrub_stamp":"2023-09-30T17:06:50.070681+0000","last_clean_scrub_stamp":"2023-09-30T17:06:50.070681+0000","objects_scrubbed":0,"log_size":2888,"log_dups_size":0,"ondisk_log_size":2888,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:18:59.884108+0000","scrub_duration":0.0026376699999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8371,"num_write_kb":39716,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.26","version":"59'18","reported_seq":108,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:41.585602+0000","last_change":"2023-09-30T17:05:41.585602+0000","last_active":"2023-09-30T17:05:41.585602+0000","last_peered":"2023-09-30T17:05:41.585602+0000","last_clean":"2023-09-30T17:05:41.585602+0000","last_became_active":"2023-09-30T17:05:03.308884+0000","last_became_peered":"2023-09-30T17:05:03.308884+0000","last_unstale":"2023-09-30T17:05:41.585602+0000","last_undegraded":"2023-09-30T17:05:41.585602+0000","last_fullsized":"2023-09-30T17:05:41.585602+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'18","last_scrub_stamp":"2023-09-30T17:05:41.585439+0000","last_deep_scrub":"59'18","last_deep_scrub_stamp":"2023-09-30T17:05:41.585439+0000","last_clean_scrub_stamp":"2023-09-30T17:05:41.585439+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:29:52.984290+0000","scrub_duration":0.0024239769999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"59'2855","reported_seq":2933,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:07:11.341863+0000","last_change":"2023-09-30T17:07:11.341914+0000","last_active":"2023-09-30T17:07:11.341863+0000","last_peered":"2023-09-30T17:07:11.341863+0000","last_clean":"2023-09-30T17:07:11.341863+0000","last_became_active":"2023-09-30T17:05:06.289447+0000","last_became_peered":"2023-09-30T17:05:06.289447+0000","last_unstale":"2023-09-30T17:07:11.341863+0000","last_undegraded":"2023-09-30T17:07:11.341863+0000","last_fullsized":"2023-09-30T17:07:11.341863+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2855","last_scrub_stamp":"2023-09-30T17:07:11.341760+0000","last_deep_scrub":"59'2855","last_deep_scrub_stamp":"2023-09-30T17:07:11.341760+0000","last_clean_scrub_stamp":"2023-09-30T17:07:11.341760+0000","objects_scrubbed":0,"log_size":2855,"log_dups_size":0,"ondisk_log_size":2855,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:54:02.341669+0000","scrub_duration":0.0023989240000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8347,"num_write_kb":39608,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":81,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:31.986601+0000","last_change":"2023-09-30T17:06:31.986601+0000","last_active":"2023-09-30T17:06:31.986601+0000","last_peered":"2023-09-30T17:06:31.986601+0000","last_clean":"2023-09-30T17:06:31.986601+0000","last_became_active":"2023-09-30T17:02:17.357890+0000","last_became_peered":"2023-09-30T17:02:17.357890+0000","last_unstale":"2023-09-30T17:06:31.986601+0000","last_undegraded":"2023-09-30T17:06:31.986601+0000","last_fullsized":"2023-09-30T17:06:31.986601+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2023-09-30T17:06:31.986457+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2023-09-30T17:06:31.986457+0000","last_clean_scrub_stamp":"2023-09-30T17:06:31.986457+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:02:20.507667+0000","scrub_duration":0.0021959599999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1d","version":"59'17","reported_seq":107,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:45.592781+0000","last_change":"2023-09-30T17:05:45.592781+0000","last_active":"2023-09-30T17:05:45.592781+0000","last_peered":"2023-09-30T17:05:45.592781+0000","last_clean":"2023-09-30T17:05:45.592781+0000","last_became_active":"2023-09-30T17:05:03.307012+0000","last_became_peered":"2023-09-30T17:05:03.307012+0000","last_unstale":"2023-09-30T17:05:45.592781+0000","last_undegraded":"2023-09-30T17:05:45.592781+0000","last_fullsized":"2023-09-30T17:05:45.592781+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'17","last_scrub_stamp":"2023-09-30T17:05:45.592562+0000","last_deep_scrub":"59'17","last_deep_scrub_stamp":"2023-09-30T17:05:45.592562+0000","last_clean_scrub_stamp":"2023-09-30T17:05:45.592562+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:53:58.476399+0000","scrub_duration":0.0024751999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":91,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:52.299678+0000","last_change":"2023-09-30T17:06:52.299678+0000","last_active":"2023-09-30T17:06:52.299678+0000","last_peered":"2023-09-30T17:06:52.299678+0000","last_clean":"2023-09-30T17:06:52.299678+0000","last_became_active":"2023-09-30T17:05:03.308073+0000","last_became_peered":"2023-09-30T17:05:03.308073+0000","last_unstale":"2023-09-30T17:06:52.299678+0000","last_undegraded":"2023-09-30T17:06:52.299678+0000","last_fullsized":"2023-09-30T17:06:52.299678+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:06:52.299479+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:06:52.299479+0000","last_clean_scrub_stamp":"2023-09-30T17:06:52.299479+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:15:52.069660+0000","scrub_duration":0.0020661820000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"59'6","reported_seq":96,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:07:04.419245+0000","last_change":"2023-09-30T17:07:04.419336+0000","last_active":"2023-09-30T17:07:04.419245+0000","last_peered":"2023-09-30T17:07:04.419245+0000","last_clean":"2023-09-30T17:07:04.419245+0000","last_became_active":"2023-09-30T17:05:03.307932+0000","last_became_peered":"2023-09-30T17:05:03.307932+0000","last_unstale":"2023-09-30T17:07:04.419245+0000","last_undegraded":"2023-09-30T17:07:04.419245+0000","last_fullsized":"2023-09-30T17:07:04.419245+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'6","last_scrub_stamp":"2023-09-30T17:07:04.419119+0000","last_deep_scrub":"59'6","last_deep_scrub_stamp":"2023-09-30T17:07:04.419119+0000","last_clean_scrub_stamp":"2023-09-30T17:07:04.419119+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:52:55.990085+0000","scrub_duration":0.003396797,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":80,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:00.631555+0000","last_change":"2023-09-30T17:06:00.631555+0000","last_active":"2023-09-30T17:06:00.631555+0000","last_peered":"2023-09-30T17:06:00.631555+0000","last_clean":"2023-09-30T17:06:00.631555+0000","last_became_active":"2023-09-30T17:02:17.360601+0000","last_became_peered":"2023-09-30T17:02:17.360601+0000","last_unstale":"2023-09-30T17:06:00.631555+0000","last_undegraded":"2023-09-30T17:06:00.631555+0000","last_fullsized":"2023-09-30T17:06:00.631555+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:06:00.631354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:06:00.631354+0000","last_clean_scrub_stamp":"2023-09-30T17:06:00.631354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:20:04.136405+0000","scrub_duration":0.0021158409999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1f","version":"59'7","reported_seq":97,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:46.008112+0000","last_change":"2023-09-30T17:06:46.008194+0000","last_active":"2023-09-30T17:06:46.008112+0000","last_peered":"2023-09-30T17:06:46.008112+0000","last_clean":"2023-09-30T17:06:46.008112+0000","last_became_active":"2023-09-30T17:05:03.305520+0000","last_became_peered":"2023-09-30T17:05:03.305520+0000","last_unstale":"2023-09-30T17:06:46.008112+0000","last_undegraded":"2023-09-30T17:06:46.008112+0000","last_fullsized":"2023-09-30T17:06:46.008112+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'7","last_scrub_stamp":"2023-09-30T17:06:46.007979+0000","last_deep_scrub":"59'7","last_deep_scrub_stamp":"2023-09-30T17:06:46.007979+0000","last_clean_scrub_stamp":"2023-09-30T17:06:46.007979+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:19:41.163586+0000","scrub_duration":0.0023045549999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.17","version":"58'1","reported_seq":92,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:31.362963+0000","last_change":"2023-09-30T17:06:31.362963+0000","last_active":"2023-09-30T17:06:31.362963+0000","last_peered":"2023-09-30T17:06:31.362963+0000","last_clean":"2023-09-30T17:06:31.362963+0000","last_became_active":"2023-09-30T17:05:03.308851+0000","last_became_peered":"2023-09-30T17:05:03.308851+0000","last_unstale":"2023-09-30T17:06:31.362963+0000","last_undegraded":"2023-09-30T17:06:31.362963+0000","last_fullsized":"2023-09-30T17:06:31.362963+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"58'1","last_scrub_stamp":"2023-09-30T17:06:31.362807+0000","last_deep_scrub":"58'1","last_deep_scrub_stamp":"2023-09-30T17:06:31.362807+0000","last_clean_scrub_stamp":"2023-09-30T17:06:31.362807+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:52:49.024933+0000","scrub_duration":0.001800563,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"59'9","reported_seq":88,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:42.630040+0000","last_change":"2023-09-30T17:05:42.630040+0000","last_active":"2023-09-30T17:05:42.630040+0000","last_peered":"2023-09-30T17:05:42.630040+0000","last_clean":"2023-09-30T17:05:42.630040+0000","last_became_active":"2023-09-30T17:02:18.358529+0000","last_became_peered":"2023-09-30T17:02:18.358529+0000","last_unstale":"2023-09-30T17:05:42.630040+0000","last_undegraded":"2023-09-30T17:05:42.630040+0000","last_fullsized":"2023-09-30T17:05:42.630040+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'9","last_scrub_stamp":"2023-09-30T17:05:42.629801+0000","last_deep_scrub":"59'9","last_deep_scrub_stamp":"2023-09-30T17:05:42.629801+0000","last_clean_scrub_stamp":"2023-09-30T17:05:42.629801+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:08:35.419515+0000","scrub_duration":0.0034623800000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:45.308296+0000","last_change":"2023-09-30T17:06:45.308363+0000","last_active":"2023-09-30T17:06:45.308296+0000","last_peered":"2023-09-30T17:06:45.308296+0000","last_clean":"2023-09-30T17:06:45.308296+0000","last_became_active":"2023-09-30T17:05:03.309023+0000","last_became_peered":"2023-09-30T17:05:03.309023+0000","last_unstale":"2023-09-30T17:06:45.308296+0000","last_undegraded":"2023-09-30T17:06:45.308296+0000","last_fullsized":"2023-09-30T17:06:45.308296+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:06:45.308183+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:06:45.308183+0000","last_clean_scrub_stamp":"2023-09-30T17:06:45.308183+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:47:15.024307+0000","scrub_duration":0.0018997700000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"59'8526","reported_seq":8628,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:07:03.371117+0000","last_change":"2023-09-30T17:07:03.371186+0000","last_active":"2023-09-30T17:07:03.371117+0000","last_peered":"2023-09-30T17:07:03.371117+0000","last_clean":"2023-09-30T17:07:03.371117+0000","last_became_active":"2023-09-30T17:05:06.290551+0000","last_became_peered":"2023-09-30T17:05:06.290551+0000","last_unstale":"2023-09-30T17:07:03.371117+0000","last_undegraded":"2023-09-30T17:07:03.371117+0000","last_fullsized":"2023-09-30T17:07:03.371117+0000","mapping_epoch":69,"log_start":"49'4300","ondisk_log_start":"49'4300","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'8526","last_scrub_stamp":"2023-09-30T17:07:03.370985+0000","last_deep_scrub":"59'8526","last_deep_scrub_stamp":"2023-09-30T17:07:03.370985+0000","last_clean_scrub_stamp":"2023-09-30T17:07:03.370985+0000","objects_scrubbed":0,"log_size":4226,"log_dups_size":4300,"ondisk_log_size":4226,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:18:21.885528+0000","scrub_duration":0.003037475,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24873,"num_write_kb":118472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"76'9","reported_seq":105,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:29.943696+0000","last_change":"2023-09-30T17:06:29.943696+0000","last_active":"2023-09-30T17:06:29.943696+0000","last_peered":"2023-09-30T17:06:29.943696+0000","last_clean":"2023-09-30T17:06:29.943696+0000","last_became_active":"2023-09-30T17:05:03.306646+0000","last_became_peered":"2023-09-30T17:05:03.306646+0000","last_unstale":"2023-09-30T17:06:29.943696+0000","last_undegraded":"2023-09-30T17:06:29.943696+0000","last_fullsized":"2023-09-30T17:06:29.943696+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'9","last_scrub_stamp":"2023-09-30T17:06:29.943546+0000","last_deep_scrub":"76'9","last_deep_scrub_stamp":"2023-09-30T17:06:29.943546+0000","last_clean_scrub_stamp":"2023-09-30T17:06:29.943546+0000","objects_scrubbed":2,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:01:47.162265+0000","scrub_duration":0.0039657640000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":90,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"59'5670","reported_seq":5749,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:46.679960+0000","last_change":"2023-09-30T17:05:46.679960+0000","last_active":"2023-09-30T17:05:46.679960+0000","last_peered":"2023-09-30T17:05:46.679960+0000","last_clean":"2023-09-30T17:05:46.679960+0000","last_became_active":"2023-09-30T17:02:18.358786+0000","last_became_peered":"2023-09-30T17:02:18.358786+0000","last_unstale":"2023-09-30T17:05:46.679960+0000","last_undegraded":"2023-09-30T17:05:46.679960+0000","last_fullsized":"2023-09-30T17:05:46.679960+0000","mapping_epoch":17,"log_start":"44'1500","ondisk_log_start":"44'1500","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'5670","last_scrub_stamp":"2023-09-30T17:05:46.679767+0000","last_deep_scrub":"59'5670","last_deep_scrub_stamp":"2023-09-30T17:05:46.679767+0000","last_clean_scrub_stamp":"2023-09-30T17:05:46.679767+0000","objects_scrubbed":0,"log_size":4170,"log_dups_size":1500,"ondisk_log_size":4170,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:13:16.252019+0000","scrub_duration":0.0034350140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16627,"num_write_kb":79047,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"76'82","reported_seq":63,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:24.313394+0000","last_change":"2023-09-30T17:06:24.313394+0000","last_active":"2023-09-30T17:06:24.313394+0000","last_peered":"2023-09-30T17:06:24.313394+0000","last_clean":"2023-09-30T17:06:24.313394+0000","last_became_active":"2023-09-30T17:05:03.302516+0000","last_became_peered":"2023-09-30T17:05:03.302516+0000","last_unstale":"2023-09-30T17:06:24.313394+0000","last_undegraded":"2023-09-30T17:06:24.313394+0000","last_fullsized":"2023-09-30T17:06:24.313394+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'82","last_scrub_stamp":"2023-09-30T17:06:24.313256+0000","last_deep_scrub":"76'82","last_deep_scrub_stamp":"2023-09-30T17:06:24.313256+0000","last_clean_scrub_stamp":"2023-09-30T17:06:24.313256+0000","objects_scrubbed":4,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:44:16.046579+0000","scrub_duration":0.0059365370000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":227523,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":77,"num_write_kb":268,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":222729,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"59'5677","reported_seq":5766,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:07:00.439753+0000","last_change":"2023-09-30T17:07:00.439753+0000","last_active":"2023-09-30T17:07:00.439753+0000","last_peered":"2023-09-30T17:07:00.439753+0000","last_clean":"2023-09-30T17:07:00.439753+0000","last_became_active":"2023-09-30T17:05:06.288155+0000","last_became_peered":"2023-09-30T17:05:06.288155+0000","last_unstale":"2023-09-30T17:07:00.439753+0000","last_undegraded":"2023-09-30T17:07:00.439753+0000","last_fullsized":"2023-09-30T17:07:00.439753+0000","mapping_epoch":69,"log_start":"42'1100","ondisk_log_start":"42'1100","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'5677","last_scrub_stamp":"2023-09-30T17:07:00.439602+0000","last_deep_scrub":"59'5677","last_deep_scrub_stamp":"2023-09-30T17:07:00.439602+0000","last_clean_scrub_stamp":"2023-09-30T17:07:00.439602+0000","objects_scrubbed":0,"log_size":4577,"log_dups_size":1100,"ondisk_log_size":4577,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:22:17.118892+0000","scrub_duration":0.0028821150000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16579,"num_write_kb":79104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"76'4","reported_seq":44,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:35.285424+0000","last_change":"2023-09-30T17:06:35.285424+0000","last_active":"2023-09-30T17:06:35.285424+0000","last_peered":"2023-09-30T17:06:35.285424+0000","last_clean":"2023-09-30T17:06:35.285424+0000","last_became_active":"2023-09-30T17:05:03.309505+0000","last_became_peered":"2023-09-30T17:05:03.309505+0000","last_unstale":"2023-09-30T17:06:35.285424+0000","last_undegraded":"2023-09-30T17:06:35.285424+0000","last_fullsized":"2023-09-30T17:06:35.285424+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'4","last_scrub_stamp":"2023-09-30T17:06:35.285239+0000","last_deep_scrub":"76'4","last_deep_scrub_stamp":"2023-09-30T17:06:35.285239+0000","last_clean_scrub_stamp":"2023-09-30T17:06:35.285239+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:17:18.502298+0000","scrub_duration":0.0040701629999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.14","version":"59'2836","reported_seq":2915,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:16.757277+0000","last_change":"2023-09-30T17:06:16.757277+0000","last_active":"2023-09-30T17:06:16.757277+0000","last_peered":"2023-09-30T17:06:16.757277+0000","last_clean":"2023-09-30T17:06:16.757277+0000","last_became_active":"2023-09-30T17:02:18.358364+0000","last_became_peered":"2023-09-30T17:02:18.358364+0000","last_unstale":"2023-09-30T17:06:16.757277+0000","last_undegraded":"2023-09-30T17:06:16.757277+0000","last_fullsized":"2023-09-30T17:06:16.757277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2836","last_scrub_stamp":"2023-09-30T17:06:16.757121+0000","last_deep_scrub":"59'2836","last_deep_scrub_stamp":"2023-09-30T17:06:16.757121+0000","last_clean_scrub_stamp":"2023-09-30T17:06:16.757121+0000","objects_scrubbed":0,"log_size":2836,"log_dups_size":0,"ondisk_log_size":2836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:25:14.959219+0000","scrub_duration":0.0037836699999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8308,"num_write_kb":39456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":91,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:51.337565+0000","last_change":"2023-09-30T17:06:51.337565+0000","last_active":"2023-09-30T17:06:51.337565+0000","last_peered":"2023-09-30T17:06:51.337565+0000","last_clean":"2023-09-30T17:06:51.337565+0000","last_became_active":"2023-09-30T17:05:03.308377+0000","last_became_peered":"2023-09-30T17:05:03.308377+0000","last_unstale":"2023-09-30T17:06:51.337565+0000","last_undegraded":"2023-09-30T17:06:51.337565+0000","last_fullsized":"2023-09-30T17:06:51.337565+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:06:51.337334+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:06:51.337334+0000","last_clean_scrub_stamp":"2023-09-30T17:06:51.337334+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:43:00.275903+0000","scrub_duration":0.0021837779999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"59'2856","reported_seq":2935,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:43.659681+0000","last_change":"2023-09-30T17:05:43.659681+0000","last_active":"2023-09-30T17:05:43.659681+0000","last_peered":"2023-09-30T17:05:43.659681+0000","last_clean":"2023-09-30T17:05:43.659681+0000","last_became_active":"2023-09-30T17:02:18.361556+0000","last_became_peered":"2023-09-30T17:02:18.361556+0000","last_unstale":"2023-09-30T17:05:43.659681+0000","last_undegraded":"2023-09-30T17:05:43.659681+0000","last_fullsized":"2023-09-30T17:05:43.659681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2856","last_scrub_stamp":"2023-09-30T17:05:43.659443+0000","last_deep_scrub":"59'2856","last_deep_scrub_stamp":"2023-09-30T17:05:43.659443+0000","last_clean_scrub_stamp":"2023-09-30T17:05:43.659443+0000","objects_scrubbed":0,"log_size":2856,"log_dups_size":0,"ondisk_log_size":2856,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:13:13.231695+0000","scrub_duration":0.0035525420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8321,"num_write_kb":39600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":91,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:22.790965+0000","last_change":"2023-09-30T17:06:22.790965+0000","last_active":"2023-09-30T17:06:22.790965+0000","last_peered":"2023-09-30T17:06:22.790965+0000","last_clean":"2023-09-30T17:06:22.790965+0000","last_became_active":"2023-09-30T17:05:03.303598+0000","last_became_peered":"2023-09-30T17:05:03.303598+0000","last_unstale":"2023-09-30T17:06:22.790965+0000","last_undegraded":"2023-09-30T17:06:22.790965+0000","last_fullsized":"2023-09-30T17:06:22.790965+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:06:22.790800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:06:22.790800+0000","last_clean_scrub_stamp":"2023-09-30T17:06:22.790800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:05:32.483926+0000","scrub_duration":0.001928988,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"59'12","reported_seq":102,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:07:09.404238+0000","last_change":"2023-09-30T17:07:09.404238+0000","last_active":"2023-09-30T17:07:09.404238+0000","last_peered":"2023-09-30T17:07:09.404238+0000","last_clean":"2023-09-30T17:07:09.404238+0000","last_became_active":"2023-09-30T17:05:03.312888+0000","last_became_peered":"2023-09-30T17:05:03.312888+0000","last_unstale":"2023-09-30T17:07:09.404238+0000","last_undegraded":"2023-09-30T17:07:09.404238+0000","last_fullsized":"2023-09-30T17:07:09.404238+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'12","last_scrub_stamp":"2023-09-30T17:07:09.404057+0000","last_deep_scrub":"59'12","last_deep_scrub_stamp":"2023-09-30T17:07:09.404057+0000","last_clean_scrub_stamp":"2023-09-30T17:07:09.404057+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:53:01.728887+0000","scrub_duration":0.0026186199999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.10","version":"76'13","reported_seq":49,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:52.618265+0000","last_change":"2023-09-30T17:05:52.618265+0000","last_active":"2023-09-30T17:05:52.618265+0000","last_peered":"2023-09-30T17:05:52.618265+0000","last_clean":"2023-09-30T17:05:52.618265+0000","last_became_active":"2023-09-30T17:05:03.304030+0000","last_became_peered":"2023-09-30T17:05:03.304030+0000","last_unstale":"2023-09-30T17:05:52.618265+0000","last_undegraded":"2023-09-30T17:05:52.618265+0000","last_fullsized":"2023-09-30T17:05:52.618265+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'13","last_scrub_stamp":"2023-09-30T17:05:52.618079+0000","last_deep_scrub":"76'13","last_deep_scrub_stamp":"2023-09-30T17:05:52.618079+0000","last_clean_scrub_stamp":"2023-09-30T17:05:52.618079+0000","objects_scrubbed":4,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T05:02:35.473886+0000","scrub_duration":0.0072773029999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"59'2892","reported_seq":2991,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:07:11.364450+0000","last_change":"2023-09-30T17:07:11.364517+0000","last_active":"2023-09-30T17:07:11.364450+0000","last_peered":"2023-09-30T17:07:11.364450+0000","last_clean":"2023-09-30T17:07:11.364450+0000","last_became_active":"2023-09-30T17:05:06.288725+0000","last_became_peered":"2023-09-30T17:05:06.288725+0000","last_unstale":"2023-09-30T17:07:11.364450+0000","last_undegraded":"2023-09-30T17:07:11.364450+0000","last_fullsized":"2023-09-30T17:07:11.364450+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2892","last_scrub_stamp":"2023-09-30T17:07:11.364319+0000","last_deep_scrub":"59'2892","last_deep_scrub_stamp":"2023-09-30T17:07:11.364319+0000","last_clean_scrub_stamp":"2023-09-30T17:07:11.364319+0000","objects_scrubbed":0,"log_size":2892,"log_dups_size":0,"ondisk_log_size":2892,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:01:59.460945+0000","scrub_duration":0.0024120489999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8345,"num_write_kb":39712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.f","version":"76'2","reported_seq":43,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:59.595763+0000","last_change":"2023-09-30T17:05:59.595763+0000","last_active":"2023-09-30T17:05:59.595763+0000","last_peered":"2023-09-30T17:05:59.595763+0000","last_clean":"2023-09-30T17:05:59.595763+0000","last_became_active":"2023-09-30T17:05:03.303179+0000","last_became_peered":"2023-09-30T17:05:03.303179+0000","last_unstale":"2023-09-30T17:05:59.595763+0000","last_undegraded":"2023-09-30T17:05:59.595763+0000","last_fullsized":"2023-09-30T17:05:59.595763+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2023-09-30T17:05:59.595592+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2023-09-30T17:05:59.595592+0000","last_clean_scrub_stamp":"2023-09-30T17:05:59.595592+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:47:24.049768+0000","scrub_duration":0.0041402670000000004,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"59'2861","reported_seq":2960,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:51.091288+0000","last_change":"2023-09-30T17:06:51.091363+0000","last_active":"2023-09-30T17:06:51.091288+0000","last_peered":"2023-09-30T17:06:51.091288+0000","last_clean":"2023-09-30T17:06:51.091288+0000","last_became_active":"2023-09-30T17:05:06.288824+0000","last_became_peered":"2023-09-30T17:05:06.288824+0000","last_unstale":"2023-09-30T17:06:51.091288+0000","last_undegraded":"2023-09-30T17:06:51.091288+0000","last_fullsized":"2023-09-30T17:06:51.091288+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2861","last_scrub_stamp":"2023-09-30T17:06:51.091170+0000","last_deep_scrub":"59'2861","last_deep_scrub_stamp":"2023-09-30T17:06:51.091170+0000","last_clean_scrub_stamp":"2023-09-30T17:06:51.091170+0000","objects_scrubbed":0,"log_size":2861,"log_dups_size":0,"ondisk_log_size":2861,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:18:00.488103+0000","scrub_duration":0.0023594990000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8384,"num_write_kb":39788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.e","version":"76'3","reported_seq":94,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:13.759033+0000","last_change":"2023-09-30T17:06:13.759033+0000","last_active":"2023-09-30T17:06:13.759033+0000","last_peered":"2023-09-30T17:06:13.759033+0000","last_clean":"2023-09-30T17:06:13.759033+0000","last_became_active":"2023-09-30T17:05:03.303874+0000","last_became_peered":"2023-09-30T17:05:03.303874+0000","last_unstale":"2023-09-30T17:06:13.759033+0000","last_undegraded":"2023-09-30T17:06:13.759033+0000","last_fullsized":"2023-09-30T17:06:13.759033+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'3","last_scrub_stamp":"2023-09-30T17:06:13.758880+0000","last_deep_scrub":"76'3","last_deep_scrub_stamp":"2023-09-30T17:06:13.758880+0000","last_clean_scrub_stamp":"2023-09-30T17:06:13.758880+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:16:16.319469+0000","scrub_duration":0.0031993410000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"59'2","reported_seq":81,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:03.649354+0000","last_change":"2023-09-30T17:06:03.649354+0000","last_active":"2023-09-30T17:06:03.649354+0000","last_peered":"2023-09-30T17:06:03.649354+0000","last_clean":"2023-09-30T17:06:03.649354+0000","last_became_active":"2023-09-30T17:02:18.356825+0000","last_became_peered":"2023-09-30T17:02:18.356825+0000","last_unstale":"2023-09-30T17:06:03.649354+0000","last_undegraded":"2023-09-30T17:06:03.649354+0000","last_fullsized":"2023-09-30T17:06:03.649354+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2","last_scrub_stamp":"2023-09-30T17:06:03.649193+0000","last_deep_scrub":"59'2","last_deep_scrub_stamp":"2023-09-30T17:06:03.649193+0000","last_clean_scrub_stamp":"2023-09-30T17:06:03.649193+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:38:42.860650+0000","scrub_duration":0.0029770759999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.d","version":"76'2","reported_seq":43,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:47.311244+0000","last_change":"2023-09-30T17:06:47.311244+0000","last_active":"2023-09-30T17:06:47.311244+0000","last_peered":"2023-09-30T17:06:47.311244+0000","last_clean":"2023-09-30T17:06:47.311244+0000","last_became_active":"2023-09-30T17:05:03.304463+0000","last_became_peered":"2023-09-30T17:05:03.304463+0000","last_unstale":"2023-09-30T17:06:47.311244+0000","last_undegraded":"2023-09-30T17:06:47.311244+0000","last_fullsized":"2023-09-30T17:06:47.311244+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'2","last_scrub_stamp":"2023-09-30T17:06:47.311088+0000","last_deep_scrub":"76'2","last_deep_scrub_stamp":"2023-09-30T17:06:47.311088+0000","last_clean_scrub_stamp":"2023-09-30T17:06:47.311088+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:47:43.727238+0000","scrub_duration":0.0029340550000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"59'2835","reported_seq":2913,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:54.409081+0000","last_change":"2023-09-30T17:06:54.409081+0000","last_active":"2023-09-30T17:06:54.409081+0000","last_peered":"2023-09-30T17:06:54.409081+0000","last_clean":"2023-09-30T17:06:54.409081+0000","last_became_active":"2023-09-30T17:05:06.288712+0000","last_became_peered":"2023-09-30T17:05:06.288712+0000","last_unstale":"2023-09-30T17:06:54.409081+0000","last_undegraded":"2023-09-30T17:06:54.409081+0000","last_fullsized":"2023-09-30T17:06:54.409081+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2835","last_scrub_stamp":"2023-09-30T17:06:54.408927+0000","last_deep_scrub":"59'2835","last_deep_scrub_stamp":"2023-09-30T17:06:54.408927+0000","last_clean_scrub_stamp":"2023-09-30T17:06:54.408927+0000","objects_scrubbed":0,"log_size":2835,"log_dups_size":0,"ondisk_log_size":2835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:38:28.826533+0000","scrub_duration":0.0024468049999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8288,"num_write_kb":39388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":39,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:55.610603+0000","last_change":"2023-09-30T17:05:55.610603+0000","last_active":"2023-09-30T17:05:55.610603+0000","last_peered":"2023-09-30T17:05:55.610603+0000","last_clean":"2023-09-30T17:05:55.610603+0000","last_became_active":"2023-09-30T17:05:03.310836+0000","last_became_peered":"2023-09-30T17:05:03.310836+0000","last_unstale":"2023-09-30T17:05:55.610603+0000","last_undegraded":"2023-09-30T17:05:55.610603+0000","last_fullsized":"2023-09-30T17:05:55.610603+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:05:55.610405+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:05:55.610405+0000","last_clean_scrub_stamp":"2023-09-30T17:05:55.610405+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:09:49.583774+0000","scrub_duration":0.0018973,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"59'8","reported_seq":98,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:11.512164+0000","last_change":"2023-09-30T17:06:11.512164+0000","last_active":"2023-09-30T17:06:11.512164+0000","last_peered":"2023-09-30T17:06:11.512164+0000","last_clean":"2023-09-30T17:06:11.512164+0000","last_became_active":"2023-09-30T17:05:03.308214+0000","last_became_peered":"2023-09-30T17:05:03.308214+0000","last_unstale":"2023-09-30T17:06:11.512164+0000","last_undegraded":"2023-09-30T17:06:11.512164+0000","last_fullsized":"2023-09-30T17:06:11.512164+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'8","last_scrub_stamp":"2023-09-30T17:06:11.511974+0000","last_deep_scrub":"59'8","last_deep_scrub_stamp":"2023-09-30T17:06:11.511974+0000","last_clean_scrub_stamp":"2023-09-30T17:06:11.511974+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:52:30.008131+0000","scrub_duration":0.0023012480000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"76'4","reported_seq":96,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:56.379507+0000","last_change":"2023-09-30T17:06:56.379571+0000","last_active":"2023-09-30T17:06:56.379507+0000","last_peered":"2023-09-30T17:06:56.379507+0000","last_clean":"2023-09-30T17:06:56.379507+0000","last_became_active":"2023-09-30T17:05:03.308483+0000","last_became_peered":"2023-09-30T17:05:03.308483+0000","last_unstale":"2023-09-30T17:06:56.379507+0000","last_undegraded":"2023-09-30T17:06:56.379507+0000","last_fullsized":"2023-09-30T17:06:56.379507+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'4","last_scrub_stamp":"2023-09-30T17:06:56.379415+0000","last_deep_scrub":"76'4","last_deep_scrub_stamp":"2023-09-30T17:06:56.379415+0000","last_clean_scrub_stamp":"2023-09-30T17:06:56.379415+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:55:37.676099+0000","scrub_duration":0.003196749,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"59'2846","reported_seq":2923,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:45.632563+0000","last_change":"2023-09-30T17:05:45.632563+0000","last_active":"2023-09-30T17:05:45.632563+0000","last_peered":"2023-09-30T17:05:45.632563+0000","last_clean":"2023-09-30T17:05:45.632563+0000","last_became_active":"2023-09-30T17:05:06.289225+0000","last_became_peered":"2023-09-30T17:05:06.289225+0000","last_unstale":"2023-09-30T17:05:45.632563+0000","last_undegraded":"2023-09-30T17:05:45.632563+0000","last_fullsized":"2023-09-30T17:05:45.632563+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2846","last_scrub_stamp":"2023-09-30T17:05:45.632358+0000","last_deep_scrub":"59'2846","last_deep_scrub_stamp":"2023-09-30T17:05:45.632358+0000","last_clean_scrub_stamp":"2023-09-30T17:05:45.632358+0000","objects_scrubbed":0,"log_size":2846,"log_dups_size":0,"ondisk_log_size":2846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:03:33.607467+0000","scrub_duration":0.0029322739999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8199,"num_write_kb":39160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":39,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:51.344695+0000","last_change":"2023-09-30T17:06:51.344695+0000","last_active":"2023-09-30T17:06:51.344695+0000","last_peered":"2023-09-30T17:06:51.344695+0000","last_clean":"2023-09-30T17:06:51.344695+0000","last_became_active":"2023-09-30T17:05:03.309318+0000","last_became_peered":"2023-09-30T17:05:03.309318+0000","last_unstale":"2023-09-30T17:06:51.344695+0000","last_undegraded":"2023-09-30T17:06:51.344695+0000","last_fullsized":"2023-09-30T17:06:51.344695+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:06:51.344553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:06:51.344553+0000","last_clean_scrub_stamp":"2023-09-30T17:06:51.344553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:58:57.231318+0000","scrub_duration":0.0019483079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"59'2831","reported_seq":2908,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:07:05.340915+0000","last_change":"2023-09-30T17:07:05.340915+0000","last_active":"2023-09-30T17:07:05.340915+0000","last_peered":"2023-09-30T17:07:05.340915+0000","last_clean":"2023-09-30T17:07:05.340915+0000","last_became_active":"2023-09-30T17:05:06.288348+0000","last_became_peered":"2023-09-30T17:05:06.288348+0000","last_unstale":"2023-09-30T17:07:05.340915+0000","last_undegraded":"2023-09-30T17:07:05.340915+0000","last_fullsized":"2023-09-30T17:07:05.340915+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2831","last_scrub_stamp":"2023-09-30T17:07:05.340729+0000","last_deep_scrub":"59'2831","last_deep_scrub_stamp":"2023-09-30T17:07:05.340729+0000","last_clean_scrub_stamp":"2023-09-30T17:07:05.340729+0000","objects_scrubbed":0,"log_size":2831,"log_dups_size":0,"ondisk_log_size":2831,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:40:59.208284+0000","scrub_duration":0.0027974459999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8336,"num_write_kb":39484,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":91,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:28.891741+0000","last_change":"2023-09-30T17:06:28.891741+0000","last_active":"2023-09-30T17:06:28.891741+0000","last_peered":"2023-09-30T17:06:28.891741+0000","last_clean":"2023-09-30T17:06:28.891741+0000","last_became_active":"2023-09-30T17:05:03.303473+0000","last_became_peered":"2023-09-30T17:05:03.303473+0000","last_unstale":"2023-09-30T17:06:28.891741+0000","last_undegraded":"2023-09-30T17:06:28.891741+0000","last_fullsized":"2023-09-30T17:06:28.891741+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:06:28.891571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:06:28.891571+0000","last_clean_scrub_stamp":"2023-09-30T17:06:28.891571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:57:39.251224+0000","scrub_duration":0.0017781679999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"59'2884","reported_seq":2961,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:39.659591+0000","last_change":"2023-09-30T17:05:39.659591+0000","last_active":"2023-09-30T17:05:39.659591+0000","last_peered":"2023-09-30T17:05:39.659591+0000","last_clean":"2023-09-30T17:05:39.659591+0000","last_became_active":"2023-09-30T17:05:06.288169+0000","last_became_peered":"2023-09-30T17:05:06.288169+0000","last_unstale":"2023-09-30T17:05:39.659591+0000","last_undegraded":"2023-09-30T17:05:39.659591+0000","last_fullsized":"2023-09-30T17:05:39.659591+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2884","last_scrub_stamp":"2023-09-30T17:05:39.659392+0000","last_deep_scrub":"59'2884","last_deep_scrub_stamp":"2023-09-30T17:05:39.659392+0000","last_clean_scrub_stamp":"2023-09-30T17:05:39.659392+0000","objects_scrubbed":0,"log_size":2884,"log_dups_size":0,"ondisk_log_size":2884,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:25:23.871113+0000","scrub_duration":0.0036873600000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8366,"num_write_kb":39744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":80,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:36.928732+0000","last_change":"2023-09-30T17:06:36.928732+0000","last_active":"2023-09-30T17:06:36.928732+0000","last_peered":"2023-09-30T17:06:36.928732+0000","last_clean":"2023-09-30T17:06:36.928732+0000","last_became_active":"2023-09-30T17:02:17.358582+0000","last_became_peered":"2023-09-30T17:02:17.358582+0000","last_unstale":"2023-09-30T17:06:36.928732+0000","last_undegraded":"2023-09-30T17:06:36.928732+0000","last_fullsized":"2023-09-30T17:06:36.928732+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:06:36.928519+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:06:36.928519+0000","last_clean_scrub_stamp":"2023-09-30T17:06:36.928519+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:33:38.679064+0000","scrub_duration":0.0016328499999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.f","version":"59'8580","reported_seq":8659,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:07:08.371763+0000","last_change":"2023-09-30T17:07:08.371813+0000","last_active":"2023-09-30T17:07:08.371763+0000","last_peered":"2023-09-30T17:07:08.371763+0000","last_clean":"2023-09-30T17:07:08.371763+0000","last_became_active":"2023-09-30T17:02:18.364057+0000","last_became_peered":"2023-09-30T17:02:18.364057+0000","last_unstale":"2023-09-30T17:07:08.371763+0000","last_undegraded":"2023-09-30T17:07:08.371763+0000","last_fullsized":"2023-09-30T17:07:08.371763+0000","mapping_epoch":17,"log_start":"49'4400","ondisk_log_start":"49'4400","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'8580","last_scrub_stamp":"2023-09-30T17:07:08.371663+0000","last_deep_scrub":"59'8580","last_deep_scrub_stamp":"2023-09-30T17:07:08.371663+0000","last_clean_scrub_stamp":"2023-09-30T17:07:08.371663+0000","objects_scrubbed":0,"log_size":4180,"log_dups_size":4400,"ondisk_log_size":4180,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:31:26.143361+0000","scrub_duration":0.003404163,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25046,"num_write_kb":118972,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":83,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:35.378313+0000","last_change":"2023-09-30T17:06:35.378357+0000","last_active":"2023-09-30T17:06:35.378313+0000","last_peered":"2023-09-30T17:06:35.378313+0000","last_clean":"2023-09-30T17:06:35.378313+0000","last_became_active":"2023-09-30T17:02:12.327384+0000","last_became_peered":"2023-09-30T17:02:12.327384+0000","last_unstale":"2023-09-30T17:06:35.378313+0000","last_undegraded":"2023-09-30T17:06:35.378313+0000","last_fullsized":"2023-09-30T17:06:35.378313+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:06:35.378215+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:06:35.378215+0000","last_clean_scrub_stamp":"2023-09-30T17:06:35.378215+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:03:48.893649+0000","scrub_duration":0.002122395,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":39,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:19.377196+0000","last_change":"2023-09-30T17:06:19.377196+0000","last_active":"2023-09-30T17:06:19.377196+0000","last_peered":"2023-09-30T17:06:19.377196+0000","last_clean":"2023-09-30T17:06:19.377196+0000","last_became_active":"2023-09-30T17:05:03.310655+0000","last_became_peered":"2023-09-30T17:05:03.310655+0000","last_unstale":"2023-09-30T17:06:19.377196+0000","last_undegraded":"2023-09-30T17:06:19.377196+0000","last_fullsized":"2023-09-30T17:06:19.377196+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:06:19.376984+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:06:19.376984+0000","last_clean_scrub_stamp":"2023-09-30T17:06:19.376984+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:11:07.977442+0000","scrub_duration":0.0018996149999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"59'9","reported_seq":99,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:44.620255+0000","last_change":"2023-09-30T17:05:44.620255+0000","last_active":"2023-09-30T17:05:44.620255+0000","last_peered":"2023-09-30T17:05:44.620255+0000","last_clean":"2023-09-30T17:05:44.620255+0000","last_became_active":"2023-09-30T17:05:03.305956+0000","last_became_peered":"2023-09-30T17:05:03.305956+0000","last_unstale":"2023-09-30T17:05:44.620255+0000","last_undegraded":"2023-09-30T17:05:44.620255+0000","last_fullsized":"2023-09-30T17:05:44.620255+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'9","last_scrub_stamp":"2023-09-30T17:05:44.620091+0000","last_deep_scrub":"59'9","last_deep_scrub_stamp":"2023-09-30T17:05:44.620091+0000","last_clean_scrub_stamp":"2023-09-30T17:05:44.620091+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:48:53.055175+0000","scrub_duration":0.0028788109999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":39,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:30.376920+0000","last_change":"2023-09-30T17:06:30.376920+0000","last_active":"2023-09-30T17:06:30.376920+0000","last_peered":"2023-09-30T17:06:30.376920+0000","last_clean":"2023-09-30T17:06:30.376920+0000","last_became_active":"2023-09-30T17:05:03.308944+0000","last_became_peered":"2023-09-30T17:05:03.308944+0000","last_unstale":"2023-09-30T17:06:30.376920+0000","last_undegraded":"2023-09-30T17:06:30.376920+0000","last_fullsized":"2023-09-30T17:06:30.376920+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:06:30.376777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:06:30.376777+0000","last_clean_scrub_stamp":"2023-09-30T17:06:30.376777+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:07:50.954083+0000","scrub_duration":0.0019009960000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":39,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:48.694245+0000","last_change":"2023-09-30T17:05:48.694245+0000","last_active":"2023-09-30T17:05:48.694245+0000","last_peered":"2023-09-30T17:05:48.694245+0000","last_clean":"2023-09-30T17:05:48.694245+0000","last_became_active":"2023-09-30T17:05:03.310706+0000","last_became_peered":"2023-09-30T17:05:03.310706+0000","last_unstale":"2023-09-30T17:05:48.694245+0000","last_undegraded":"2023-09-30T17:05:48.694245+0000","last_fullsized":"2023-09-30T17:05:48.694245+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:05:48.694106+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:05:48.694106+0000","last_clean_scrub_stamp":"2023-09-30T17:05:48.694106+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:45:19.266879+0000","scrub_duration":0.0018395079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.4","version":"59'9","reported_seq":88,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:06.575982+0000","last_change":"2023-09-30T17:06:06.575982+0000","last_active":"2023-09-30T17:06:06.575982+0000","last_peered":"2023-09-30T17:06:06.575982+0000","last_clean":"2023-09-30T17:06:06.575982+0000","last_became_active":"2023-09-30T17:02:18.363064+0000","last_became_peered":"2023-09-30T17:02:18.363064+0000","last_unstale":"2023-09-30T17:06:06.575982+0000","last_undegraded":"2023-09-30T17:06:06.575982+0000","last_fullsized":"2023-09-30T17:06:06.575982+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'9","last_scrub_stamp":"2023-09-30T17:06:06.575750+0000","last_deep_scrub":"59'9","last_deep_scrub_stamp":"2023-09-30T17:06:06.575750+0000","last_clean_scrub_stamp":"2023-09-30T17:06:06.575750+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:58:24.806188+0000","scrub_duration":0.0029458370000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":83,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:33.380479+0000","last_change":"2023-09-30T17:06:33.380529+0000","last_active":"2023-09-30T17:06:33.380479+0000","last_peered":"2023-09-30T17:06:33.380479+0000","last_clean":"2023-09-30T17:06:33.380479+0000","last_became_active":"2023-09-30T17:02:12.327542+0000","last_became_peered":"2023-09-30T17:02:12.327542+0000","last_unstale":"2023-09-30T17:06:33.380479+0000","last_undegraded":"2023-09-30T17:06:33.380479+0000","last_fullsized":"2023-09-30T17:06:33.380479+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:06:33.380386+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:06:33.380386+0000","last_clean_scrub_stamp":"2023-09-30T17:06:33.380386+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:11:01.470731+0000","scrub_duration":0.001900161,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":91,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:37.971450+0000","last_change":"2023-09-30T17:06:37.971528+0000","last_active":"2023-09-30T17:06:37.971450+0000","last_peered":"2023-09-30T17:06:37.971450+0000","last_clean":"2023-09-30T17:06:37.971450+0000","last_became_active":"2023-09-30T17:05:03.305222+0000","last_became_peered":"2023-09-30T17:05:03.305222+0000","last_unstale":"2023-09-30T17:06:37.971450+0000","last_undegraded":"2023-09-30T17:06:37.971450+0000","last_fullsized":"2023-09-30T17:06:37.971450+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:06:37.971341+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:06:37.971341+0000","last_clean_scrub_stamp":"2023-09-30T17:06:37.971341+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:47:09.750906+0000","scrub_duration":0.001982948,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"59'6","reported_seq":85,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:07:10.367166+0000","last_change":"2023-09-30T17:07:10.367218+0000","last_active":"2023-09-30T17:07:10.367166+0000","last_peered":"2023-09-30T17:07:10.367166+0000","last_clean":"2023-09-30T17:07:10.367166+0000","last_became_active":"2023-09-30T17:02:18.363849+0000","last_became_peered":"2023-09-30T17:02:18.363849+0000","last_unstale":"2023-09-30T17:07:10.367166+0000","last_undegraded":"2023-09-30T17:07:10.367166+0000","last_fullsized":"2023-09-30T17:07:10.367166+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'6","last_scrub_stamp":"2023-09-30T17:07:10.367049+0000","last_deep_scrub":"59'6","last_deep_scrub_stamp":"2023-09-30T17:07:10.367049+0000","last_clean_scrub_stamp":"2023-09-30T17:07:10.367049+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:10:48.104041+0000","scrub_duration":0.0029106150000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":39,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:33.305122+0000","last_change":"2023-09-30T17:06:33.305122+0000","last_active":"2023-09-30T17:06:33.305122+0000","last_peered":"2023-09-30T17:06:33.305122+0000","last_clean":"2023-09-30T17:06:33.305122+0000","last_became_active":"2023-09-30T17:05:03.308958+0000","last_became_peered":"2023-09-30T17:05:03.308958+0000","last_unstale":"2023-09-30T17:06:33.305122+0000","last_undegraded":"2023-09-30T17:06:33.305122+0000","last_fullsized":"2023-09-30T17:06:33.305122+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:06:33.304948+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:06:33.304948+0000","last_clean_scrub_stamp":"2023-09-30T17:06:33.304948+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:52:55.572531+0000","scrub_duration":0.0016996450000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.0","version":"76'159","reported_seq":237,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:09.515009+0000","last_change":"2023-09-30T17:06:09.515009+0000","last_active":"2023-09-30T17:06:09.515009+0000","last_peered":"2023-09-30T17:06:09.515009+0000","last_clean":"2023-09-30T17:06:09.515009+0000","last_became_active":"2023-09-30T17:05:03.302265+0000","last_became_peered":"2023-09-30T17:05:03.302265+0000","last_unstale":"2023-09-30T17:06:09.515009+0000","last_undegraded":"2023-09-30T17:06:09.515009+0000","last_fullsized":"2023-09-30T17:06:09.515009+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'159","last_scrub_stamp":"2023-09-30T17:06:09.514837+0000","last_deep_scrub":"76'159","last_deep_scrub_stamp":"2023-09-30T17:06:09.514837+0000","last_clean_scrub_stamp":"2023-09-30T17:06:09.514837+0000","objects_scrubbed":2,"log_size":159,"log_dups_size":0,"ondisk_log_size":159,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T19:46:01.059195+0000","scrub_duration":0.0055217590000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":80,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:46.441894+0000","last_change":"2023-09-30T17:06:46.441959+0000","last_active":"2023-09-30T17:06:46.441894+0000","last_peered":"2023-09-30T17:06:46.441894+0000","last_clean":"2023-09-30T17:06:46.441894+0000","last_became_active":"2023-09-30T17:02:17.356901+0000","last_became_peered":"2023-09-30T17:02:17.356901+0000","last_unstale":"2023-09-30T17:06:46.441894+0000","last_undegraded":"2023-09-30T17:06:46.441894+0000","last_fullsized":"2023-09-30T17:06:46.441894+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:06:46.441771+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:06:46.441771+0000","last_clean_scrub_stamp":"2023-09-30T17:06:46.441771+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:55:40.444207+0000","scrub_duration":0.0017428820000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"59'7","reported_seq":39,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:53.612809+0000","last_change":"2023-09-30T17:05:53.612809+0000","last_active":"2023-09-30T17:05:53.612809+0000","last_peered":"2023-09-30T17:05:53.612809+0000","last_clean":"2023-09-30T17:05:53.612809+0000","last_became_active":"2023-09-30T17:05:03.304974+0000","last_became_peered":"2023-09-30T17:05:03.304974+0000","last_unstale":"2023-09-30T17:05:53.612809+0000","last_undegraded":"2023-09-30T17:05:53.612809+0000","last_fullsized":"2023-09-30T17:05:53.612809+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'7","last_scrub_stamp":"2023-09-30T17:05:53.612654+0000","last_deep_scrub":"59'7","last_deep_scrub_stamp":"2023-09-30T17:05:53.612654+0000","last_clean_scrub_stamp":"2023-09-30T17:05:53.612654+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:04:16.815158+0000","scrub_duration":0.00223011,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":39,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:49.646435+0000","last_change":"2023-09-30T17:05:49.646435+0000","last_active":"2023-09-30T17:05:49.646435+0000","last_peered":"2023-09-30T17:05:49.646435+0000","last_clean":"2023-09-30T17:05:49.646435+0000","last_became_active":"2023-09-30T17:05:03.302590+0000","last_became_peered":"2023-09-30T17:05:03.302590+0000","last_unstale":"2023-09-30T17:05:49.646435+0000","last_undegraded":"2023-09-30T17:05:49.646435+0000","last_fullsized":"2023-09-30T17:05:49.646435+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:05:49.646266+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:05:49.646266+0000","last_clean_scrub_stamp":"2023-09-30T17:05:49.646266+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:45:23.943931+0000","scrub_duration":0.002091379,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1","version":"76'6","reported_seq":105,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:59.408605+0000","last_change":"2023-09-30T17:06:59.408677+0000","last_active":"2023-09-30T17:06:59.408605+0000","last_peered":"2023-09-30T17:06:59.408605+0000","last_clean":"2023-09-30T17:06:59.408605+0000","last_became_active":"2023-09-30T17:05:03.308059+0000","last_became_peered":"2023-09-30T17:05:03.308059+0000","last_unstale":"2023-09-30T17:06:59.408605+0000","last_undegraded":"2023-09-30T17:06:59.408605+0000","last_fullsized":"2023-09-30T17:06:59.408605+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'6","last_scrub_stamp":"2023-09-30T17:06:59.408478+0000","last_deep_scrub":"76'6","last_deep_scrub_stamp":"2023-09-30T17:06:59.408478+0000","last_clean_scrub_stamp":"2023-09-30T17:06:59.408478+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:37:28.627475+0000","scrub_duration":0.0034350140000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":606,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"59'11252","reported_seq":11331,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:53.639457+0000","last_change":"2023-09-30T17:05:53.639457+0000","last_active":"2023-09-30T17:05:53.639457+0000","last_peered":"2023-09-30T17:05:53.639457+0000","last_clean":"2023-09-30T17:05:53.639457+0000","last_became_active":"2023-09-30T17:02:18.356839+0000","last_became_peered":"2023-09-30T17:02:18.356839+0000","last_unstale":"2023-09-30T17:05:53.639457+0000","last_undegraded":"2023-09-30T17:05:53.639457+0000","last_fullsized":"2023-09-30T17:05:53.639457+0000","mapping_epoch":17,"log_start":"51'6700","ondisk_log_start":"51'6700","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'11252","last_scrub_stamp":"2023-09-30T17:05:53.639286+0000","last_deep_scrub":"59'11252","last_deep_scrub_stamp":"2023-09-30T17:05:53.639286+0000","last_clean_scrub_stamp":"2023-09-30T17:05:53.639286+0000","objects_scrubbed":0,"log_size":4552,"log_dups_size":6700,"ondisk_log_size":4552,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:50:12.670739+0000","scrub_duration":0.00330314,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33068,"num_write_kb":157144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":83,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:19.768395+0000","last_change":"2023-09-30T17:06:19.768395+0000","last_active":"2023-09-30T17:06:19.768395+0000","last_peered":"2023-09-30T17:06:19.768395+0000","last_clean":"2023-09-30T17:06:19.768395+0000","last_became_active":"2023-09-30T17:02:12.330154+0000","last_became_peered":"2023-09-30T17:02:12.330154+0000","last_unstale":"2023-09-30T17:06:19.768395+0000","last_undegraded":"2023-09-30T17:06:19.768395+0000","last_fullsized":"2023-09-30T17:06:19.768395+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:06:19.768184+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:06:19.768184+0000","last_clean_scrub_stamp":"2023-09-30T17:06:19.768184+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:03:33.283618+0000","scrub_duration":0.0018959109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":80,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:19.501381+0000","last_change":"2023-09-30T17:06:19.501381+0000","last_active":"2023-09-30T17:06:19.501381+0000","last_peered":"2023-09-30T17:06:19.501381+0000","last_clean":"2023-09-30T17:06:19.501381+0000","last_became_active":"2023-09-30T17:02:17.360721+0000","last_became_peered":"2023-09-30T17:02:17.360721+0000","last_unstale":"2023-09-30T17:06:19.501381+0000","last_undegraded":"2023-09-30T17:06:19.501381+0000","last_fullsized":"2023-09-30T17:06:19.501381+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:06:19.501185+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:06:19.501185+0000","last_clean_scrub_stamp":"2023-09-30T17:06:19.501185+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T20:38:50.894107+0000","scrub_duration":0.0019735519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"59'2836","reported_seq":2935,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:53.063291+0000","last_change":"2023-09-30T17:06:53.063341+0000","last_active":"2023-09-30T17:06:53.063291+0000","last_peered":"2023-09-30T17:06:53.063291+0000","last_clean":"2023-09-30T17:06:53.063291+0000","last_became_active":"2023-09-30T17:05:06.291203+0000","last_became_peered":"2023-09-30T17:05:06.291203+0000","last_unstale":"2023-09-30T17:06:53.063291+0000","last_undegraded":"2023-09-30T17:06:53.063291+0000","last_fullsized":"2023-09-30T17:06:53.063291+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2836","last_scrub_stamp":"2023-09-30T17:06:53.063189+0000","last_deep_scrub":"59'2836","last_deep_scrub_stamp":"2023-09-30T17:06:53.063189+0000","last_clean_scrub_stamp":"2023-09-30T17:06:53.063189+0000","objects_scrubbed":0,"log_size":2836,"log_dups_size":0,"ondisk_log_size":2836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:01:41.159814+0000","scrub_duration":0.002801857,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8199,"num_write_kb":39048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"76'4","reported_seq":84,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:05.556135+0000","last_change":"2023-09-30T17:06:05.556135+0000","last_active":"2023-09-30T17:06:05.556135+0000","last_peered":"2023-09-30T17:06:05.556135+0000","last_clean":"2023-09-30T17:06:05.556135+0000","last_became_active":"2023-09-30T17:02:17.360494+0000","last_became_peered":"2023-09-30T17:02:17.360494+0000","last_unstale":"2023-09-30T17:06:05.556135+0000","last_undegraded":"2023-09-30T17:06:05.556135+0000","last_fullsized":"2023-09-30T17:06:05.556135+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'4","last_scrub_stamp":"2023-09-30T17:06:05.555918+0000","last_deep_scrub":"76'4","last_deep_scrub_stamp":"2023-09-30T17:06:05.555918+0000","last_clean_scrub_stamp":"2023-09-30T17:06:05.555918+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:08:01.733610+0000","scrub_duration":0.0040480749999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":83,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:45.439103+0000","last_change":"2023-09-30T17:06:45.439147+0000","last_active":"2023-09-30T17:06:45.439103+0000","last_peered":"2023-09-30T17:06:45.439103+0000","last_clean":"2023-09-30T17:06:45.439103+0000","last_became_active":"2023-09-30T17:02:12.327898+0000","last_became_peered":"2023-09-30T17:02:12.327898+0000","last_unstale":"2023-09-30T17:06:45.439103+0000","last_undegraded":"2023-09-30T17:06:45.439103+0000","last_fullsized":"2023-09-30T17:06:45.439103+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:06:45.439003+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:06:45.439003+0000","last_clean_scrub_stamp":"2023-09-30T17:06:45.439003+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:53:37.064257+0000","scrub_duration":0.0019539129999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"59'8","reported_seq":98,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:43.606760+0000","last_change":"2023-09-30T17:05:43.606760+0000","last_active":"2023-09-30T17:05:43.606760+0000","last_peered":"2023-09-30T17:05:43.606760+0000","last_clean":"2023-09-30T17:05:43.606760+0000","last_became_active":"2023-09-30T17:05:03.308429+0000","last_became_peered":"2023-09-30T17:05:03.308429+0000","last_unstale":"2023-09-30T17:05:43.606760+0000","last_undegraded":"2023-09-30T17:05:43.606760+0000","last_fullsized":"2023-09-30T17:05:43.606760+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'8","last_scrub_stamp":"2023-09-30T17:05:43.606596+0000","last_deep_scrub":"59'8","last_deep_scrub_stamp":"2023-09-30T17:05:43.606596+0000","last_clean_scrub_stamp":"2023-09-30T17:05:43.606596+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:53:16.420602+0000","scrub_duration":0.0021279749999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":39,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:15.384331+0000","last_change":"2023-09-30T17:06:15.384331+0000","last_active":"2023-09-30T17:06:15.384331+0000","last_peered":"2023-09-30T17:06:15.384331+0000","last_clean":"2023-09-30T17:06:15.384331+0000","last_became_active":"2023-09-30T17:05:03.302503+0000","last_became_peered":"2023-09-30T17:05:03.302503+0000","last_unstale":"2023-09-30T17:06:15.384331+0000","last_undegraded":"2023-09-30T17:06:15.384331+0000","last_fullsized":"2023-09-30T17:06:15.384331+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T17:06:15.384091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T17:06:15.384091+0000","last_clean_scrub_stamp":"2023-09-30T17:06:15.384091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:06:42.084138+0000","scrub_duration":0.0019917400000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"76'9","reported_seq":105,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:27.361184+0000","last_change":"2023-09-30T17:06:27.361184+0000","last_active":"2023-09-30T17:06:27.361184+0000","last_peered":"2023-09-30T17:06:27.361184+0000","last_clean":"2023-09-30T17:06:27.361184+0000","last_became_active":"2023-09-30T17:05:03.308201+0000","last_became_peered":"2023-09-30T17:05:03.308201+0000","last_unstale":"2023-09-30T17:06:27.361184+0000","last_undegraded":"2023-09-30T17:06:27.361184+0000","last_fullsized":"2023-09-30T17:06:27.361184+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'9","last_scrub_stamp":"2023-09-30T17:06:27.361040+0000","last_deep_scrub":"76'9","last_deep_scrub_stamp":"2023-09-30T17:06:27.361040+0000","last_clean_scrub_stamp":"2023-09-30T17:06:27.361040+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T21:44:47.814921+0000","scrub_duration":0.0031875089999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"59'6","reported_seq":96,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:56.694471+0000","last_change":"2023-09-30T17:05:56.694471+0000","last_active":"2023-09-30T17:05:56.694471+0000","last_peered":"2023-09-30T17:05:56.694471+0000","last_clean":"2023-09-30T17:05:56.694471+0000","last_became_active":"2023-09-30T17:05:03.304022+0000","last_became_peered":"2023-09-30T17:05:03.304022+0000","last_unstale":"2023-09-30T17:05:56.694471+0000","last_undegraded":"2023-09-30T17:05:56.694471+0000","last_fullsized":"2023-09-30T17:05:56.694471+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'6","last_scrub_stamp":"2023-09-30T17:05:56.694323+0000","last_deep_scrub":"59'6","last_deep_scrub_stamp":"2023-09-30T17:05:56.694323+0000","last_clean_scrub_stamp":"2023-09-30T17:05:56.694323+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:41:25.703485+0000","scrub_duration":0.0021932589999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":92,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:17.761345+0000","last_change":"2023-09-30T17:06:17.761345+0000","last_active":"2023-09-30T17:06:17.761345+0000","last_peered":"2023-09-30T17:06:17.761345+0000","last_clean":"2023-09-30T17:06:17.761345+0000","last_became_active":"2023-09-30T17:05:03.303487+0000","last_became_peered":"2023-09-30T17:05:03.303487+0000","last_unstale":"2023-09-30T17:06:17.761345+0000","last_undegraded":"2023-09-30T17:06:17.761345+0000","last_fullsized":"2023-09-30T17:06:17.761345+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2023-09-30T17:06:17.761177+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2023-09-30T17:06:17.761177+0000","last_clean_scrub_stamp":"2023-09-30T17:06:17.761177+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:06:38.928334+0000","scrub_duration":0.0020380239999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"59'2835","reported_seq":2914,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:49.578202+0000","last_change":"2023-09-30T17:05:49.578202+0000","last_active":"2023-09-30T17:05:49.578202+0000","last_peered":"2023-09-30T17:05:49.578202+0000","last_clean":"2023-09-30T17:05:49.578202+0000","last_became_active":"2023-09-30T17:02:18.356902+0000","last_became_peered":"2023-09-30T17:02:18.356902+0000","last_unstale":"2023-09-30T17:05:49.578202+0000","last_undegraded":"2023-09-30T17:05:49.578202+0000","last_fullsized":"2023-09-30T17:05:49.578202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2835","last_scrub_stamp":"2023-09-30T17:05:49.577968+0000","last_deep_scrub":"59'2835","last_deep_scrub_stamp":"2023-09-30T17:05:49.577968+0000","last_clean_scrub_stamp":"2023-09-30T17:05:49.577968+0000","objects_scrubbed":0,"log_size":2835,"log_dups_size":0,"ondisk_log_size":2835,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T22:05:50.365694+0000","scrub_duration":0.0031753789999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8302,"num_write_kb":39500,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1c","version":"76'3","reported_seq":42,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:10.550007+0000","last_change":"2023-09-30T17:06:10.550090+0000","last_active":"2023-09-30T17:06:10.550007+0000","last_peered":"2023-09-30T17:06:10.550007+0000","last_clean":"2023-09-30T17:06:10.550007+0000","last_became_active":"2023-09-30T17:05:03.310996+0000","last_became_peered":"2023-09-30T17:05:03.310996+0000","last_unstale":"2023-09-30T17:06:10.550007+0000","last_undegraded":"2023-09-30T17:06:10.550007+0000","last_fullsized":"2023-09-30T17:06:10.550007+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'3","last_scrub_stamp":"2023-09-30T17:06:10.549909+0000","last_deep_scrub":"76'3","last_deep_scrub_stamp":"2023-09-30T17:06:10.549909+0000","last_clean_scrub_stamp":"2023-09-30T17:06:10.549909+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T01:02:48.238742+0000","scrub_duration":0.0035069649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1b","version":"59'2848","reported_seq":2924,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:43.643918+0000","last_change":"2023-09-30T17:05:43.644021+0000","last_active":"2023-09-30T17:05:43.643918+0000","last_peered":"2023-09-30T17:05:43.643918+0000","last_clean":"2023-09-30T17:05:43.643918+0000","last_became_active":"2023-09-30T17:05:06.289599+0000","last_became_peered":"2023-09-30T17:05:06.289599+0000","last_unstale":"2023-09-30T17:05:43.643918+0000","last_undegraded":"2023-09-30T17:05:43.643918+0000","last_fullsized":"2023-09-30T17:05:43.643918+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2848","last_scrub_stamp":"2023-09-30T17:05:43.643754+0000","last_deep_scrub":"59'2848","last_deep_scrub_stamp":"2023-09-30T17:05:43.643754+0000","last_clean_scrub_stamp":"2023-09-30T17:05:43.643754+0000","objects_scrubbed":0,"log_size":2848,"log_dups_size":0,"ondisk_log_size":2848,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T17:09:00.902270+0000","scrub_duration":0.0023925259999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8235,"num_write_kb":39276,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"76'4","reported_seq":96,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:30.952599+0000","last_change":"2023-09-30T17:06:30.952599+0000","last_active":"2023-09-30T17:06:30.952599+0000","last_peered":"2023-09-30T17:06:30.952599+0000","last_clean":"2023-09-30T17:06:30.952599+0000","last_became_active":"2023-09-30T17:05:03.306711+0000","last_became_peered":"2023-09-30T17:05:03.306711+0000","last_unstale":"2023-09-30T17:06:30.952599+0000","last_undegraded":"2023-09-30T17:06:30.952599+0000","last_fullsized":"2023-09-30T17:06:30.952599+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'4","last_scrub_stamp":"2023-09-30T17:06:30.952432+0000","last_deep_scrub":"76'4","last_deep_scrub_stamp":"2023-09-30T17:06:30.952432+0000","last_clean_scrub_stamp":"2023-09-30T17:06:30.952432+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:57:50.588068+0000","scrub_duration":0.003354849,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"59'10","reported_seq":38,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:06.523686+0000","last_change":"2023-09-30T17:06:06.523754+0000","last_active":"2023-09-30T17:06:06.523686+0000","last_peered":"2023-09-30T17:06:06.523686+0000","last_clean":"2023-09-30T17:06:06.523686+0000","last_became_active":"2023-09-30T17:05:03.310763+0000","last_became_peered":"2023-09-30T17:05:03.310763+0000","last_unstale":"2023-09-30T17:06:06.523686+0000","last_undegraded":"2023-09-30T17:06:06.523686+0000","last_fullsized":"2023-09-30T17:06:06.523686+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'10","last_scrub_stamp":"2023-09-30T17:06:06.523566+0000","last_deep_scrub":"59'10","last_deep_scrub_stamp":"2023-09-30T17:06:06.523566+0000","last_clean_scrub_stamp":"2023-09-30T17:06:06.523566+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T02:48:10.092815+0000","scrub_duration":0.002623748,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":81,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:07.596434+0000","last_change":"2023-09-30T17:06:07.596434+0000","last_active":"2023-09-30T17:06:07.596434+0000","last_peered":"2023-09-30T17:06:07.596434+0000","last_clean":"2023-09-30T17:06:07.596434+0000","last_became_active":"2023-09-30T17:02:17.360475+0000","last_became_peered":"2023-09-30T17:02:17.360475+0000","last_unstale":"2023-09-30T17:06:07.596434+0000","last_undegraded":"2023-09-30T17:06:07.596434+0000","last_fullsized":"2023-09-30T17:06:07.596434+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"18'1","last_scrub_stamp":"2023-09-30T17:06:07.596283+0000","last_deep_scrub":"18'1","last_deep_scrub_stamp":"2023-09-30T17:06:07.596283+0000","last_clean_scrub_stamp":"2023-09-30T17:06:07.596283+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T00:28:14.693610+0000","scrub_duration":0.0022969660000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.19","version":"59'5711","reported_seq":5790,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:08.654348+0000","last_change":"2023-09-30T17:06:08.654348+0000","last_active":"2023-09-30T17:06:08.654348+0000","last_peered":"2023-09-30T17:06:08.654348+0000","last_clean":"2023-09-30T17:06:08.654348+0000","last_became_active":"2023-09-30T17:02:18.357098+0000","last_became_peered":"2023-09-30T17:02:18.357098+0000","last_unstale":"2023-09-30T17:06:08.654348+0000","last_undegraded":"2023-09-30T17:06:08.654348+0000","last_fullsized":"2023-09-30T17:06:08.654348+0000","mapping_epoch":17,"log_start":"42'1200","ondisk_log_start":"42'1200","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'5711","last_scrub_stamp":"2023-09-30T17:06:08.654151+0000","last_deep_scrub":"59'5711","last_deep_scrub_stamp":"2023-09-30T17:06:08.654151+0000","last_clean_scrub_stamp":"2023-09-30T17:06:08.654151+0000","objects_scrubbed":0,"log_size":4511,"log_dups_size":1200,"ondisk_log_size":4511,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T18:10:37.539726+0000","scrub_duration":0.0037229939999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16681,"num_write_kb":79476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"76'6","reported_seq":97,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:55.637582+0000","last_change":"2023-09-30T17:05:55.637582+0000","last_active":"2023-09-30T17:05:55.637582+0000","last_peered":"2023-09-30T17:05:55.637582+0000","last_clean":"2023-09-30T17:05:55.637582+0000","last_became_active":"2023-09-30T17:05:03.313050+0000","last_became_peered":"2023-09-30T17:05:03.313050+0000","last_unstale":"2023-09-30T17:05:55.637582+0000","last_undegraded":"2023-09-30T17:05:55.637582+0000","last_fullsized":"2023-09-30T17:05:55.637582+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"76'6","last_scrub_stamp":"2023-09-30T17:05:55.637417+0000","last_deep_scrub":"76'6","last_deep_scrub_stamp":"2023-09-30T17:05:55.637417+0000","last_clean_scrub_stamp":"2023-09-30T17:05:55.637417+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:27:26.801859+0000","scrub_duration":0.006333272,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"59'2872","reported_seq":2948,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:57.453448+0000","last_change":"2023-09-30T17:06:57.453501+0000","last_active":"2023-09-30T17:06:57.453448+0000","last_peered":"2023-09-30T17:06:57.453448+0000","last_clean":"2023-09-30T17:06:57.453448+0000","last_became_active":"2023-09-30T17:05:06.289197+0000","last_became_peered":"2023-09-30T17:05:06.289197+0000","last_unstale":"2023-09-30T17:06:57.453448+0000","last_undegraded":"2023-09-30T17:06:57.453448+0000","last_fullsized":"2023-09-30T17:06:57.453448+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2872","last_scrub_stamp":"2023-09-30T17:06:57.453353+0000","last_deep_scrub":"59'2872","last_deep_scrub_stamp":"2023-09-30T17:06:57.453353+0000","last_clean_scrub_stamp":"2023-09-30T17:06:57.453353+0000","objects_scrubbed":0,"log_size":2872,"log_dups_size":0,"ondisk_log_size":2872,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T23:55:41.872143+0000","scrub_duration":0.0026272539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8447,"num_write_kb":40072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"59'9","reported_seq":39,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:54.611653+0000","last_change":"2023-09-30T17:05:54.611653+0000","last_active":"2023-09-30T17:05:54.611653+0000","last_peered":"2023-09-30T17:05:54.611653+0000","last_clean":"2023-09-30T17:05:54.611653+0000","last_became_active":"2023-09-30T17:05:03.310591+0000","last_became_peered":"2023-09-30T17:05:03.310591+0000","last_unstale":"2023-09-30T17:05:54.611653+0000","last_undegraded":"2023-09-30T17:05:54.611653+0000","last_fullsized":"2023-09-30T17:05:54.611653+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'9","last_scrub_stamp":"2023-09-30T17:05:54.611494+0000","last_deep_scrub":"59'9","last_deep_scrub_stamp":"2023-09-30T17:05:54.611494+0000","last_clean_scrub_stamp":"2023-09-30T17:05:54.611494+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:03:16.862122+0000","scrub_duration":0.0022998649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.21","version":"59'13","reported_seq":92,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:03.582587+0000","last_change":"2023-09-30T17:06:03.582587+0000","last_active":"2023-09-30T17:06:03.582587+0000","last_peered":"2023-09-30T17:06:03.582587+0000","last_clean":"2023-09-30T17:06:03.582587+0000","last_became_active":"2023-09-30T17:02:18.363222+0000","last_became_peered":"2023-09-30T17:02:18.363222+0000","last_unstale":"2023-09-30T17:06:03.582587+0000","last_undegraded":"2023-09-30T17:06:03.582587+0000","last_fullsized":"2023-09-30T17:06:03.582587+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'13","last_scrub_stamp":"2023-09-30T17:06:03.582383+0000","last_deep_scrub":"59'13","last_deep_scrub_stamp":"2023-09-30T17:06:03.582383+0000","last_clean_scrub_stamp":"2023-09-30T17:06:03.582383+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:58:49.007492+0000","scrub_duration":0.0032092079999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.22","version":"59'2796","reported_seq":2895,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:07:04.075761+0000","last_change":"2023-09-30T17:07:04.075814+0000","last_active":"2023-09-30T17:07:04.075761+0000","last_peered":"2023-09-30T17:07:04.075761+0000","last_clean":"2023-09-30T17:07:04.075761+0000","last_became_active":"2023-09-30T17:05:06.290929+0000","last_became_peered":"2023-09-30T17:05:06.290929+0000","last_unstale":"2023-09-30T17:07:04.075761+0000","last_undegraded":"2023-09-30T17:07:04.075761+0000","last_fullsized":"2023-09-30T17:07:04.075761+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2796","last_scrub_stamp":"2023-09-30T17:07:04.075649+0000","last_deep_scrub":"59'2796","last_deep_scrub_stamp":"2023-09-30T17:07:04.075649+0000","last_clean_scrub_stamp":"2023-09-30T17:07:04.075649+0000","objects_scrubbed":0,"log_size":2796,"log_dups_size":0,"ondisk_log_size":2796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:00:08.680127+0000","scrub_duration":0.0025320289999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8138,"num_write_kb":38784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"59'2852","reported_seq":2931,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:05:59.672667+0000","last_change":"2023-09-30T17:05:59.672667+0000","last_active":"2023-09-30T17:05:59.672667+0000","last_peered":"2023-09-30T17:05:59.672667+0000","last_clean":"2023-09-30T17:05:59.672667+0000","last_became_active":"2023-09-30T17:02:18.362894+0000","last_became_peered":"2023-09-30T17:02:18.362894+0000","last_unstale":"2023-09-30T17:05:59.672667+0000","last_undegraded":"2023-09-30T17:05:59.672667+0000","last_fullsized":"2023-09-30T17:05:59.672667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2852","last_scrub_stamp":"2023-09-30T17:05:59.672454+0000","last_deep_scrub":"59'2852","last_deep_scrub_stamp":"2023-09-30T17:05:59.672454+0000","last_clean_scrub_stamp":"2023-09-30T17:05:59.672454+0000","objects_scrubbed":0,"log_size":2852,"log_dups_size":0,"ondisk_log_size":2852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T04:25:06.256229+0000","scrub_duration":0.0033008859999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8357,"num_write_kb":39780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.24","version":"59'2874","reported_seq":2973,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-09-30T17:06:58.072527+0000","last_change":"2023-09-30T17:06:58.072616+0000","last_active":"2023-09-30T17:06:58.072527+0000","last_peered":"2023-09-30T17:06:58.072527+0000","last_clean":"2023-09-30T17:06:58.072527+0000","last_became_active":"2023-09-30T17:05:06.292898+0000","last_became_peered":"2023-09-30T17:05:06.292898+0000","last_unstale":"2023-09-30T17:06:58.072527+0000","last_undegraded":"2023-09-30T17:06:58.072527+0000","last_fullsized":"2023-09-30T17:06:58.072527+0000","mapping_epoch":69,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":70,"parent":"0.0","parent_split_bits":0,"last_scrub":"59'2874","last_scrub_stamp":"2023-09-30T17:06:58.072413+0000","last_deep_scrub":"59'2874","last_deep_scrub_stamp":"2023-09-30T17:06:58.072413+0000","last_clean_scrub_stamp":"2023-09-30T17:06:58.072413+0000","objects_scrubbed":0,"log_size":2874,"log_dups_size":0,"ondisk_log_size":2874,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-02T03:37:55.107608+0000","scrub_duration":0.0022544069999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8465,"num_write_kb":40104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":532685,"num_write_kb":2575302,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140940,"ondisk_log_size":140940,"up":128,"acting":128,"num_store_stats":3},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":228927,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":137,"num_write_kb":292,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":223425,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":524288,"data_stored":457854,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":64,"acting":64,"num_store_stats":3},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":118,"num_write":203,"num_write_kb":3460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":3}],"osd_stats":[{"osd":2,"up_from":66,"seq":283467841566,"num_pgs":71,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":47036,"kb_used_data":1460,"kb_used_omap":6,"kb_used_meta":45561,"kb_avail":94324804,"statfs":{"total":96636764160,"available":96588599296,"internally_reserved":0,"allocated":1495040,"data_stored":1123985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7139,"internal_metadata":46654493},"hb_peers":[0,1],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 17:07:07 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.46600000000000003,"15min":0.46999999999999997},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.58799999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.48199999999999998,"15min":0.48999999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.56899999999999995,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.44400000000000001}]},{"osd":1,"last update":"Sat Sep 30 17:07:07 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.52600000000000002,"15min":0.53000000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.505,"15min":0.503},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.64000000000000001,"5min":0.65900000000000003,"15min":0.65900000000000003},"last":0.496}]}]},{"osd":0,"up_from":8,"seq":34359738435,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":582448,"kb_used_data":1448,"kb_used_omap":1,"kb_used_meta":580990,"kb_avail":93789392,"statfs":{"total":96636764160,"available":96040337408,"internally_reserved":0,"allocated":1482752,"data_stored":1122763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":594934214},"hb_peers":[1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Sep 30 17:07:11 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.51200000000000001,"15min":0.48799999999999999},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.60299999999999998,"5min":5.9480000000000004,"15min":5.9480000000000004},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.51600000000000001,"15min":0.46800000000000003},"min":{"1min":0.28499999999999998,"5min":0.20899999999999999,"15min":0.20899999999999999},"max":{"1min":0.61799999999999999,"5min":3.6819999999999999,"15min":3.6819999999999999},"last":0.51500000000000001}]},{"osd":2,"last update":"Sat Sep 30 17:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.52100000000000002,"15min":0.52500000000000002},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.63700000000000001,"5min":0.748,"15min":0.748},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.495,"5min":0.52400000000000002,"15min":0.52900000000000003},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.67300000000000004,"5min":0.69099999999999995,"15min":0.69099999999999995},"last":0.38200000000000001}]}]},{"osd":1,"up_from":8,"seq":34359738435,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":563588,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":562942,"kb_avail":93808252,"statfs":{"total":96636764160,"available":96059650048,"internally_reserved":0,"allocated":651264,"data_stored":305912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":576453062},"hb_peers":[0,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Sep 30 17:07:17 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.48699999999999999,"15min":0.45600000000000002},"min":{"1min":0.34699999999999998,"5min":0.17100000000000001,"15min":0.17100000000000001},"max":{"1min":0.55400000000000005,"5min":3.3420000000000001,"15min":3.3420000000000001},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.53100000000000003,"15min":0.46700000000000003},"min":{"1min":0.375,"5min":0.188,"15min":0.188},"max":{"1min":0.63100000000000001,"5min":3.5470000000000002,"15min":3.5470000000000002},"last":0.52300000000000002}]},{"osd":2,"last update":"Sat Sep 30 17:07:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.41899999999999998,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.63200000000000001,"5min":0.999,"15min":0.999},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.498,"15min":0.496},"min":{"1min":0.40400000000000003,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.67600000000000005,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.42899999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":249856,"data_stored":227705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":228927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5546,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T17:07:21.654 DEBUG:teuthology.orchestra.run.smithi007:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-09-30T17:07:22.012 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-09-30T17:07:22.012 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T17:07:22.393 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:07:22.393 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T17:02:17.752800+0000","modified":"2023-09-30T17:02:20.768438+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4208},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4208":{"gid":4208,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6803/3885497469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":3885497469},{"type":"v1","addr":"172.21.15.7:6803","nonce":3885497469}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-30T17:07:22.396 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 6 2023-09-30T17:07:22.408 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T17:07:22.785 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:07:22.785 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T17:02:17.752800+0000","modified":"2023-09-30T17:02:20.768438+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4208},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4208":{"gid":4208,"name":"a","rank":0,"incarnation":3,"state":"up:active","state_seq":3,"addr":"172.21.15.7:6803/3885497469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.7:6802","nonce":3885497469},{"type":"v1","addr":"172.21.15.7:6803","nonce":3885497469}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-09-30T17:07:22.788 INFO:teuthology.orchestra.run.smithi007.stderr:dumped fsmap epoch 6 2023-09-30T17:07:22.799 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T17:07:23.136 INFO:teuthology.orchestra.run.smithi007.stdout: 2023-09-30T17:07:23.136 INFO:teuthology.orchestra.run.smithi007.stdout:{"epoch":76,"fsid":"68daccc3-6ea9-4db7-9771-3803ff202df8","created":"2023-09-30T17:01:55.306262+0000","modified":"2023-09-30T17:05:26.305787+0000","last_up_change":"2023-09-30T17:05:02.282813+0000","last_in_change":"2023-09-30T17:01:56.571968+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":3,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T17:02:05.343048+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":2.9900000095367432,"score_stable":2.9900000095367432,"optimal_score":0.67000001668930054,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T17:02:11.033979+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T17:02:15.583451+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T17:02:16.734427+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"a9d1653a-8830-4fad-911b-8e7221ee8697","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6800","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6801","nonce":2212861041}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6802","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6803","nonce":2212861041}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6806","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6807","nonce":2212861041}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.31:6804","nonce":2212861041},{"type":"v1","addr":"172.21.15.31:6805","nonce":2212861041}]},"public_addr":"172.21.15.31:6801/2212861041","cluster_addr":"172.21.15.31:6803/2212861041","heartbeat_back_addr":"172.21.15.31:6807/2212861041","heartbeat_front_addr":"172.21.15.31:6805/2212861041","state":["exists","up"]},{"osd":1,"uuid":"7123aa56-aa1a-43a4-b154-a40b4c70d169","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":69,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6800","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6801","nonce":1680420094}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6802","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6803","nonce":1680420094}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6806","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6807","nonce":1680420094}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.72:6804","nonce":1680420094},{"type":"v1","addr":"172.21.15.72:6805","nonce":1680420094}]},"public_addr":"172.21.15.72:6801/1680420094","cluster_addr":"172.21.15.72:6803/1680420094","heartbeat_back_addr":"172.21.15.72:6807/1680420094","heartbeat_front_addr":"172.21.15.72:6805/1680420094","state":["exists","up"]},{"osd":2,"uuid":"f40ee0d7-7bc3-4a46-bdac-9c134c55c907","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":8,"last_clean_end":22,"up_from":66,"up_thru":69,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3322751189},{"type":"v1","addr":"172.21.15.134:6801","nonce":3322751189}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3322751189},{"type":"v1","addr":"172.21.15.134:6803","nonce":3322751189}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3322751189},{"type":"v1","addr":"172.21.15.134:6807","nonce":3322751189}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3322751189},{"type":"v1","addr":"172.21.15.134:6805","nonce":3322751189}]},"public_addr":"172.21.15.134:6801/3322751189","cluster_addr":"172.21.15.134:6803/3322751189","heartbeat_back_addr":"172.21.15.134:6807/3322751189","heartbeat_front_addr":"172.21.15.134:6805/3322751189","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T17:02:01.702754+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T17:02:01.688791+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T17:02:01.667971+0000","dead_epoch":22}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T17:07:23.151 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-09-30T17:07:23.537 INFO:tasks.ceph.mds.a.smithi007.stderr: -1777> 2023-09-30T17:02:22.452+0000 7f2451754700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-30T17:07:23.541 INFO:teuthology.orchestra.run.smithi007.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-09-30T17:07:23.554 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-09-30T17:07:23.563 INFO:tasks.ceph.mds.a.smithi007.stdout:starting mds.a at 2023-09-30T17:07:24.556 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-09-30T17:07:25.546 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_metadata' removed 2023-09-30T17:07:25.561 DEBUG:teuthology.orchestra.run.smithi007:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-09-30T17:07:26.552 INFO:teuthology.orchestra.run.smithi007.stderr:pool 'cephfs_data' removed 2023-09-30T17:07:26.566 INFO:teuthology.misc:Shutting down mds daemons... 2023-09-30T17:07:26.567 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-09-30T17:07:26.567 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T17:07:26.576 INFO:tasks.ceph.mds.a:Stopped 2023-09-30T17:07:26.576 INFO:teuthology.misc:Shutting down osd daemons... 2023-09-30T17:07:26.577 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-09-30T17:07:26.577 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T17:07:26.631 INFO:tasks.ceph.osd.0:Stopped 2023-09-30T17:07:26.631 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-09-30T17:07:26.631 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T17:07:26.695 INFO:tasks.ceph.osd.1:Stopped 2023-09-30T17:07:26.695 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-09-30T17:07:26.696 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T17:07:26.749 INFO:tasks.ceph.osd.2:Stopped 2023-09-30T17:07:26.749 INFO:teuthology.misc:Shutting down mgr daemons... 2023-09-30T17:07:26.749 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-09-30T17:07:26.749 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T17:07:26.779 INFO:tasks.ceph.mgr.x:Stopped 2023-09-30T17:07:26.779 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-09-30T17:07:26.779 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T17:07:26.847 INFO:tasks.ceph.mgr.y:Stopped 2023-09-30T17:07:26.848 INFO:teuthology.misc:Shutting down mon daemons... 2023-09-30T17:07:26.848 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-09-30T17:07:26.848 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T17:07:26.900 INFO:tasks.ceph.mon.a:Stopped 2023-09-30T17:07:26.900 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-09-30T17:07:26.900 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T17:07:26.953 INFO:tasks.ceph.mon.b:Stopped 2023-09-30T17:07:26.953 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-09-30T17:07:26.953 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T17:07:27.005 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-09-30T17:07:27.034 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-09-30T17:07:27.034 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-09-30T17:07:27.034 INFO:tasks.ceph.mon.c:Stopped 2023-09-30T17:07:27.034 INFO:tasks.ceph:Checking cluster log for badness... 2023-09-30T17:07:27.034 DEBUG:teuthology.orchestra.run.smithi007:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(MDS_TRIM\)' | egrep -v '\(MDS_SLOW_REQUEST\)' | egrep -v MDS_SLOW_METADATA_IO | egrep -v 'Behind on trimming' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | head -n 1 2023-09-30T17:07:27.086 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi031.front.sepia.ceph.com 2023-09-30T17:07:27.164 DEBUG:teuthology.orchestra.run.smithi031:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-09-30T17:07:27.361 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi072.front.sepia.ceph.com 2023-09-30T17:07:27.364 DEBUG:teuthology.orchestra.run.smithi072:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-09-30T17:07:27.561 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi134.front.sepia.ceph.com 2023-09-30T17:07:27.562 DEBUG:teuthology.orchestra.run.smithi134:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-09-30T17:07:27.681 INFO:tasks.ceph:Archiving mon data... 2023-09-30T17:07:27.682 DEBUG:teuthology.misc:Transferring archived files from smithi007:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-09-29_19:49:08-powercycle-main-distro-default-smithi/7407742/data/mon.a.tgz 2023-09-30T17:07:27.682 DEBUG:teuthology.orchestra.run.smithi007:> mktemp 2023-09-30T17:07:27.703 INFO:teuthology.orchestra.run.smithi007.stdout:/tmp/tmp.Ap0aBMOf3I 2023-09-30T17:07:27.703 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.Ap0aBMOf3I 2023-09-30T17:07:27.866 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0666 /tmp/tmp.Ap0aBMOf3I 2023-09-30T17:07:27.956 DEBUG:teuthology.orchestra.remote:smithi007:/tmp/tmp.Ap0aBMOf3I is 398KB 2023-09-30T17:07:28.053 DEBUG:teuthology.orchestra.run.smithi007:> rm -fr /tmp/tmp.Ap0aBMOf3I 2023-09-30T17:07:28.070 DEBUG:teuthology.misc:Transferring archived files from smithi007:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-09-29_19:49:08-powercycle-main-distro-default-smithi/7407742/data/mon.b.tgz 2023-09-30T17:07:28.070 DEBUG:teuthology.orchestra.run.smithi007:> mktemp 2023-09-30T17:07:28.127 INFO:teuthology.orchestra.run.smithi007.stdout:/tmp/tmp.pYX7zsXP6Z 2023-09-30T17:07:28.128 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.pYX7zsXP6Z 2023-09-30T17:07:28.302 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0666 /tmp/tmp.pYX7zsXP6Z 2023-09-30T17:07:28.389 DEBUG:teuthology.orchestra.remote:smithi007:/tmp/tmp.pYX7zsXP6Z is 540KB 2023-09-30T17:07:28.495 DEBUG:teuthology.orchestra.run.smithi007:> rm -fr /tmp/tmp.pYX7zsXP6Z 2023-09-30T17:07:28.512 DEBUG:teuthology.misc:Transferring archived files from smithi007:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-09-29_19:49:08-powercycle-main-distro-default-smithi/7407742/data/mon.c.tgz 2023-09-30T17:07:28.513 DEBUG:teuthology.orchestra.run.smithi007:> mktemp 2023-09-30T17:07:28.569 INFO:teuthology.orchestra.run.smithi007.stdout:/tmp/tmp.mZBUHt240v 2023-09-30T17:07:28.569 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.mZBUHt240v 2023-09-30T17:07:28.741 DEBUG:teuthology.orchestra.run.smithi007:> sudo chmod 0666 /tmp/tmp.mZBUHt240v 2023-09-30T17:07:28.827 DEBUG:teuthology.orchestra.remote:smithi007:/tmp/tmp.mZBUHt240v is 539KB 2023-09-30T17:07:28.931 DEBUG:teuthology.orchestra.run.smithi007:> rm -fr /tmp/tmp.mZBUHt240v 2023-09-30T17:07:28.948 INFO:tasks.ceph:Cleaning ceph cluster... 2023-09-30T17:07:28.949 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-09-30T17:07:28.990 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-09-30T17:07:28.992 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-09-30T17:07:28.994 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-09-30T17:07:29.046 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-09-30T17:07:29.046 DEBUG:teuthology.orchestra.run.smithi007:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-09-30T17:07:29.057 DEBUG:teuthology.orchestra.run.smithi031:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-09-30T17:07:29.069 DEBUG:teuthology.orchestra.run.smithi072:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-09-30T17:07:29.071 DEBUG:teuthology.orchestra.run.smithi134:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-09-30T17:07:29.091 INFO:teuthology.orchestra.run.smithi007.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-09-30T17:07:29.104 INFO:teuthology.orchestra.run.smithi031.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-09-30T17:07:29.114 INFO:teuthology.orchestra.run.smithi072.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-09-30T17:07:29.123 INFO:teuthology.orchestra.run.smithi134.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-09-30T17:07:29.130 INFO:tasks.ceph:Archiving crash dumps... 2023-09-30T17:07:29.131 DEBUG:teuthology.misc:Transferring archived files from smithi007:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-09-29_19:49:08-powercycle-main-distro-default-smithi/7407742/remote/smithi007/crash 2023-09-30T17:07:29.132 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-09-30T17:07:29.165 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-09-29_19:49:08-powercycle-main-distro-default-smithi/7407742/remote/smithi031/crash 2023-09-30T17:07:29.166 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-09-30T17:07:29.212 DEBUG:teuthology.misc:Transferring archived files from smithi072:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-09-29_19:49:08-powercycle-main-distro-default-smithi/7407742/remote/smithi072/crash 2023-09-30T17:07:29.213 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-09-30T17:07:29.255 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-09-29_19:49:08-powercycle-main-distro-default-smithi/7407742/remote/smithi134/crash 2023-09-30T17:07:29.256 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-09-30T17:07:29.337 INFO:tasks.ceph:Compressing logs... 2023-09-30T17:07:29.337 DEBUG:teuthology.orchestra.run.smithi007:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-09-30T17:07:29.340 DEBUG:teuthology.orchestra.run.smithi031:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-09-30T17:07:29.342 DEBUG:teuthology.orchestra.run.smithi072:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-09-30T17:07:29.345 DEBUG:teuthology.orchestra.run.smithi134:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-09-30T17:07:29.379 INFO:teuthology.orchestra.run.smithi072.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-09-30T17:07:29.379 INFO:teuthology.orchestra.run.smithi031.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-09-30T17:07:29.381 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-09-30T17:07:29.381 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96873.log 2023-09-30T17:07:29.381 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96829.log 2023-09-30T17:07:29.381 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.96873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.1002.log 2023-09-30T17:07:29.382 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.96873.log.gz 2023-09-30T17:07:29.382 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.96829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96917.log 2023-09-30T17:07:29.382 INFO:teuthology.orchestra.run.smithi134.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.96829.log.gz 2023-09-30T17:07:29.382 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.1002.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.1002.log.gz 2023-09-30T17:07:29.382 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/ceph-client.admin.96917.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.96917.log.gz 2023-09-30T17:07:29.439 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97096.log 2023-09-30T17:07:29.439 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101399.log 2023-09-30T17:07:29.439 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.97096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101304.log 2023-09-30T17:07:29.439 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97096.log.gz 2023-09-30T17:07:29.439 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.101399.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.101399.log.gz 2023-09-30T17:07:29.439 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101494.log 2023-09-30T17:07:29.439 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105050.log 2023-09-30T17:07:29.439 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.101304.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.101304.log.gz 2023-09-30T17:07:29.440 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.101494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104756.log 2023-09-30T17:07:29.440 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.101494.log.gz 2023-09-30T17:07:29.440 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.105050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108448.log 2023-09-30T17:07:29.440 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105050.log.gz 2023-09-30T17:07:29.440 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.104756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108118.log 2023-09-30T17:07:29.440 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104756.log.gz 2023-09-30T17:07:29.440 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.108448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108494.log 2023-09-30T17:07:29.440 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.108448.log.gz 2023-09-30T17:07:29.440 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.108118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103841.log 2023-09-30T17:07:29.440 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.108118.log.gz 2023-09-30T17:07:29.440 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.108494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98121.log 2023-09-30T17:07:29.440 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.108494.log.gz 2023-09-30T17:07:29.441 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.103841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99461.log 2023-09-30T17:07:29.441 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103841.log.gz 2023-09-30T17:07:29.441 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.98121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99142.log 2023-09-30T17:07:29.441 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98121.log.gz 2023-09-30T17:07:29.441 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.99461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101687.log 2023-09-30T17:07:29.441 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99461.log.gz 2023-09-30T17:07:29.441 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.99142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97982.log 2023-09-30T17:07:29.441 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99142.log.gz 2023-09-30T17:07:29.441 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.101687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101877.log 2023-09-30T17:07:29.441 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.101687.log.gz 2023-09-30T17:07:29.441 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.97982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101587.log 2023-09-30T17:07:29.442 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97982.log.gz 2023-09-30T17:07:29.442 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.101877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97142.log 2023-09-30T17:07:29.442 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.101877.log.gz 2023-09-30T17:07:29.442 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.101587.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106215.log 2023-09-30T17:07:29.442 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.101587.log.gz 2023-09-30T17:07:29.442 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.97142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101061.log 2023-09-30T17:07:29.442 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97142.log.gz 2023-09-30T17:07:29.442 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.106215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101733.log 2023-09-30T17:07:29.442 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106215.log.gz 2023-09-30T17:07:29.442 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.101061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107611.log 2023-09-30T17:07:29.442 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.101061.log.gz 2023-09-30T17:07:29.442 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.101733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104055.log 2023-09-30T17:07:29.443 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.101733.log.gz 2023-09-30T17:07:29.443 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.107611.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-09-30T17:07:29.443 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107611.log.gz 2023-09-30T17:07:29.443 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.104055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96715.log 2023-09-30T17:07:29.443 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104055.log.gz 2023-09-30T17:07:29.443 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107336.log 2023-09-30T17:07:29.443 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.96715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101015.log 2023-09-30T17:07:29.443 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.96715.log.gz 2023-09-30T17:07:29.443 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.107336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103267.log 2023-09-30T17:07:29.443 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107336.log.gz 2023-09-30T17:07:29.443 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.101015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99096.log 2023-09-30T17:07:29.444 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.101015.log.gz 2023-09-30T17:07:29.444 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.103267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97616.log 2023-09-30T17:07:29.444 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103267.log.gz 2023-09-30T17:07:29.444 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.99096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99280.log 2023-09-30T17:07:29.444 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99096.log.gz 2023-09-30T17:07:29.444 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.97616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98866.log 2023-09-30T17:07:29.444 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97616.log.gz 2023-09-30T17:07:29.444 INFO:teuthology.orchestra.run.smithi007.stderr: 94.5% -- replaced with /var/log/ceph/ceph.log.gz 2023-09-30T17:07:29.444 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96421.log 2023-09-30T17:07:29.444 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.99280.log: 47.7% -- replaced with /var/log/ceph/ceph-client.admin.99280.log.gz 2023-09-30T17:07:29.444 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.98866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104175.log 2023-09-30T17:07:29.445 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98866.log.gz 2023-09-30T17:07:29.445 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.96421.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.96421.log.gz 2023-09-30T17:07:29.445 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108394.log 2023-09-30T17:07:29.445 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97050.log 2023-09-30T17:07:29.445 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.104175.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104175.log.gz 2023-09-30T17:07:29.446 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.108394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104221.log 2023-09-30T17:07:29.446 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.108394.log.gz 2023-09-30T17:07:29.446 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.97050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99188.log 2023-09-30T17:07:29.446 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97050.log.gz 2023-09-30T17:07:29.446 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.104221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107428.log 2023-09-30T17:07:29.446 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104221.log.gz 2023-09-30T17:07:29.446 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.99188.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.99188.log.gz-- 2023-09-30T17:07:29.446 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.101972.log 2023-09-30T17:07:29.446 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.107428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106725.log 2023-09-30T17:07:29.446 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107428.log.gz 2023-09-30T17:07:29.446 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.101972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103792.log 2023-09-30T17:07:29.447 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.101972.log.gz 2023-09-30T17:07:29.447 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.106725.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106725.log.gz 2023-09-30T17:07:29.447 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106261.log 2023-09-30T17:07:29.447 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.103792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107704.log 2023-09-30T17:07:29.447 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103792.log.gz 2023-09-30T17:07:29.447 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.106261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105535.log 2023-09-30T17:07:29.447 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106261.log.gz 2023-09-30T17:07:29.447 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.107704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107934.log 2023-09-30T17:07:29.447 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107704.log.gz 2023-09-30T17:07:29.447 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.105535.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105535.log.gz 2023-09-30T17:07:29.447 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98076.log 2023-09-30T17:07:29.447 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.107934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103506.log 2023-09-30T17:07:29.448 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107934.log.gz 2023-09-30T17:07:29.448 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.98076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98912.log 2023-09-30T17:07:29.448 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98076.log.gz 2023-09-30T17:07:29.448 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.103506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102021.log 2023-09-30T17:07:29.448 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103506.log.gz 2023-09-30T17:07:29.448 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.98912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102494.log 2023-09-30T17:07:29.448 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98912.log.gz 2023-09-30T17:07:29.448 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.102021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105096.log 2023-09-30T17:07:29.448 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102021.log.gz 2023-09-30T17:07:29.448 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.102494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103051.log 2023-09-30T17:07:29.448 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102494.log.gz 2023-09-30T17:07:29.449 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.105096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104707.log 2023-09-30T17:07:29.449 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105096.log.gz 2023-09-30T17:07:29.449 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.103051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99507.log 2023-09-30T17:07:29.449 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103051.log.gz 2023-09-30T17:07:29.449 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.104707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100966.log 2023-09-30T17:07:29.449 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104707.log.gz 2023-09-30T17:07:29.449 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.99507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101253.log 2023-09-30T17:07:29.449 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99507.log.gz 2023-09-30T17:07:29.449 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.100966.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-09-30T17:07:29.449 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.100966.log.gz 2023-09-30T17:07:29.449 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.101253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107244.log 2023-09-30T17:07:29.449 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.101253.log.gz 2023-09-30T17:07:29.450 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102884.log 2023-09-30T17:07:29.450 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.107244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96778.log 2023-09-30T17:07:29.450 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107244.log.gz 2023-09-30T17:07:29.450 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.102884.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102884.log.gz 2023-09-30T17:07:29.450 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104460.log 2023-09-30T17:07:29.450 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.96778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107198.log 2023-09-30T17:07:29.450 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.96778.log.gz 2023-09-30T17:07:29.450 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.104460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103172.log 2023-09-30T17:07:29.450 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104460.log.gz 2023-09-30T17:07:29.451 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103719.log 2023-09-30T17:07:29.451 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.107198.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107198.log.gz 2023-09-30T17:07:29.451 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.103172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108164.log 2023-09-30T17:07:29.451 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103172.log.gz 2023-09-30T17:07:29.451 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.103719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107334.log 2023-09-30T17:07:29.451 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103719.log.gz 2023-09-30T17:07:29.451 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.108164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105931.log 2023-09-30T17:07:29.451 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.108164.log.gz 2023-09-30T17:07:29.451 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.107334.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107334.log.gz 2023-09-30T17:07:29.451 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103386.log 2023-09-30T17:07:29.451 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.105931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108302.log 2023-09-30T17:07:29.451 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105931.log.gz 2023-09-30T17:07:29.452 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.103386.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103386.log.gz 2023-09-30T17:07:29.452 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105673.log 2023-09-30T17:07:29.452 INFO:teuthology.orchestra.run.smithi007.stderr: 90.3% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-09-30T17:07:29.452 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.108302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97430.log 2023-09-30T17:07:29.452 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.108302.log.gz 2023-09-30T17:07:29.452 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.105673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103312.log 2023-09-30T17:07:29.452 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105673.log.gz 2023-09-30T17:07:29.452 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.97430.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97430.log.gz 2023-09-30T17:07:29.452 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96635.log 2023-09-30T17:07:29.452 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.103312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104801.log 2023-09-30T17:07:29.452 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103312.log.gz 2023-09-30T17:07:29.453 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.96635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98260.log 2023-09-30T17:07:29.453 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.96635.log.gz 2023-09-30T17:07:29.453 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.104801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103936.log 2023-09-30T17:07:29.453 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104801.log.gz 2023-09-30T17:07:29.453 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.98260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97800.log 2023-09-30T17:07:29.453 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98260.log.gz 2023-09-30T17:07:29.453 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.103936.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102165.log 2023-09-30T17:07:29.453 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103936.log.gz 2023-09-30T17:07:29.453 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.97800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105142.log 2023-09-30T17:07:29.453 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97800.log.gz 2023-09-30T17:07:29.453 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.102165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103552.log 2023-09-30T17:07:29.454 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102165.log.gz 2023-09-30T17:07:29.454 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.105142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98383.log 2023-09-30T17:07:29.454 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105142.log.gz 2023-09-30T17:07:29.454 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.103552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108676.log 2023-09-30T17:07:29.454 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103552.log.gz 2023-09-30T17:07:29.454 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.98383.log: gzip -5 0.0%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.98383.log.gz 2023-09-30T17:07:29.454 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.97234.log 2023-09-30T17:07:29.454 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.108676.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104270.log 2023-09-30T17:07:29.454 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.108676.log.gz 2023-09-30T17:07:29.454 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.97234.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101543.log 2023-09-30T17:07:29.454 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97234.log.gz 2023-09-30T17:07:29.455 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.104270.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.104270.log.gz 2023-09-30T17:07:29.455 INFO:teuthology.orchestra.run.smithi007.stderr:--verbose -- /var/log/ceph/ceph-client.admin.99804.log 2023-09-30T17:07:29.455 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.101543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107052.log 2023-09-30T17:07:29.455 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.101543.log.gz 2023-09-30T17:07:29.455 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.99804.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99804.log.gz 2023-09-30T17:07:29.455 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102597.log 2023-09-30T17:07:29.455 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.107052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102299.log 2023-09-30T17:07:29.455 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107052.log.gz 2023-09-30T17:07:29.455 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.102597.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102597.log.gzgzip 2023-09-30T17:07:29.455 INFO:teuthology.orchestra.run.smithi007.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.103362.log 2023-09-30T17:07:29.455 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.102299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97984.log 2023-09-30T17:07:29.456 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102299.log.gz 2023-09-30T17:07:29.456 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.103362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102068.log 2023-09-30T17:07:29.456 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103362.log.gz 2023-09-30T17:07:29.456 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.97984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97280.log 2023-09-30T17:07:29.456 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97984.log.gz 2023-09-30T17:07:29.456 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.102068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102445.log 2023-09-30T17:07:29.456 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102068.log.gz 2023-09-30T17:07:29.456 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.97280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102548.log 2023-09-30T17:07:29.456 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97280.log.gz 2023-09-30T17:07:29.456 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.102445.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.102445.log.gz 2023-09-30T17:07:29.456 INFO:teuthology.orchestra.run.smithi007.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.97708.log 2023-09-30T17:07:29.457 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.102548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102716.log 2023-09-30T17:07:29.457 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102548.log.gz 2023-09-30T17:07:29.457 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.97708.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.97708.log.gz-5 2023-09-30T17:07:29.457 INFO:teuthology.orchestra.run.smithi007.stderr:--verbose -- /var/log/ceph/ceph-client.admin.103647.log 2023-09-30T17:07:29.457 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.102716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106357.log 2023-09-30T17:07:29.457 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102716.log.gz 2023-09-30T17:07:29.457 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.103647.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.108072.log -- replaced with /var/log/ceph/ceph-client.admin.103647.log.gz 2023-09-30T17:07:29.457 INFO:teuthology.orchestra.run.smithi007.stderr: 2023-09-30T17:07:29.457 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.106357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102789.log 2023-09-30T17:07:29.457 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106357.log.gz 2023-09-30T17:07:29.457 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.108072.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.96824.log 2023-09-30T17:07:29.458 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.108072.log.gz 2023-09-30T17:07:29.458 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.102789.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102789.log.gz 2023-09-30T17:07:29.458 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98360.log 2023-09-30T17:07:29.458 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.96824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100516.log 2023-09-30T17:07:29.458 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.96824.log.gz 2023-09-30T17:07:29.458 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.98360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102717.log 2023-09-30T17:07:29.458 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98360.log.gz 2023-09-30T17:07:29.458 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.100516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98774.log 2023-09-30T17:07:29.458 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.100516.log.gz 2023-09-30T17:07:29.458 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.102717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106403.log 2023-09-30T17:07:29.458 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102717.log.gz 2023-09-30T17:07:29.458 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.98774.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.98774.log.gz-5 2023-09-30T17:07:29.459 INFO:teuthology.orchestra.run.smithi007.stderr:--verbose -- /var/log/ceph/ceph-client.admin.103218.log 2023-09-30T17:07:29.459 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.106403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107474.log 2023-09-30T17:07:29.459 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106403.log.gz 2023-09-30T17:07:29.459 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.103218.log: gzip -5 0.0%--verbose -- replaced with /var/log/ceph/ceph-client.admin.103218.log.gz-- 2023-09-30T17:07:29.459 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.99693.log 2023-09-30T17:07:29.459 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.107474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97328.log 2023-09-30T17:07:29.459 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107474.log.gz 2023-09-30T17:07:29.459 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.99693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102838.log 2023-09-30T17:07:29.459 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99693.log.gz 2023-09-30T17:07:29.459 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.97328.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.97328.log.gz 2023-09-30T17:07:29.459 INFO:teuthology.orchestra.run.smithi007.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.97662.log 2023-09-30T17:07:29.460 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.102838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107610.log 2023-09-30T17:07:29.460 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102838.log.gz 2023-09-30T17:07:29.460 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.97662.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97662.log.gz 2023-09-30T17:07:29.460 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108210.log 2023-09-30T17:07:29.460 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.107610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101638.log 2023-09-30T17:07:29.460 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107610.log.gz 2023-09-30T17:07:29.460 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.108210.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.108256.log -- replaced with /var/log/ceph/ceph-client.admin.108210.log.gz 2023-09-30T17:07:29.460 INFO:teuthology.orchestra.run.smithi007.stderr: 2023-09-30T17:07:29.460 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.101638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104316.log 2023-09-30T17:07:29.460 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.101638.log.gz 2023-09-30T17:07:29.460 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.108256.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-09-30T17:07:29.461 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.108256.log.gz 2023-09-30T17:07:29.461 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.104316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101782.log 2023-09-30T17:07:29.461 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104316.log.gz 2023-09-30T17:07:29.461 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102933.log 2023-09-30T17:07:29.461 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.101782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103123.log 2023-09-30T17:07:29.461 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.101782.log.gz 2023-09-30T17:07:29.461 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.102933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108584.log 2023-09-30T17:07:29.461 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102933.log.gz 2023-09-30T17:07:29.461 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.103123.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103123.log.gz 2023-09-30T17:07:29.461 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108722.log 2023-09-30T17:07:29.461 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.108584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108630.log 2023-09-30T17:07:29.461 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.108584.log.gz 2023-09-30T17:07:29.462 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.108722.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.108722.log.gz 2023-09-30T17:07:29.462 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99004.log 2023-09-30T17:07:29.462 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.108630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107888.log 2023-09-30T17:07:29.462 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.108630.log.gz 2023-09-30T17:07:29.462 INFO:teuthology.orchestra.run.smithi007.stderr: 95.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-09-30T17:07:29.462 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.99004.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99004.log.gz 2023-09-30T17:07:29.462 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97522.log 2023-09-30T17:07:29.462 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.107888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98636.log 2023-09-30T17:07:29.462 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107888.log.gz 2023-09-30T17:07:29.462 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.97522.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.97522.log.gz 2023-09-30T17:07:29.463 INFO:teuthology.orchestra.run.smithi007.stderr:--verbose -- /var/log/ceph/ceph-client.admin.105489.log 2023-09-30T17:07:29.463 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.98636.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108348.log 2023-09-30T17:07:29.463 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98636.log.gz 2023-09-30T17:07:29.463 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.105489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105763.log 2023-09-30T17:07:29.463 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105489.log.gz 2023-09-30T17:07:29.463 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.108348.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.108348.log.gz 2023-09-30T17:07:29.463 INFO:teuthology.orchestra.run.smithi007.stderr:--verbose -- /var/log/ceph/ceph-client.admin.104661.log 2023-09-30T17:07:29.463 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.105763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106817.log 2023-09-30T17:07:29.463 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105763.log.gz 2023-09-30T17:07:29.463 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.104661.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101110.log 2023-09-30T17:07:29.463 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104661.log.gz 2023-09-30T17:07:29.463 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.106817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104531.log 2023-09-30T17:07:29.464 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106817.log.gz 2023-09-30T17:07:29.464 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.101110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106449.log 2023-09-30T17:07:29.464 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.101110.log.gz 2023-09-30T17:07:29.464 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.104531.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.104531.log.gz 2023-09-30T17:07:29.464 INFO:teuthology.orchestra.run.smithi007.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.106071.log 2023-09-30T17:07:29.464 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.106449.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.106449.log.gz 2023-09-30T17:07:29.464 INFO:teuthology.orchestra.run.smithi007.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.103602.log 2023-09-30T17:07:29.464 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.106071.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106071.log.gzgzip 2023-09-30T17:07:29.464 INFO:teuthology.orchestra.run.smithi007.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.97376.log 2023-09-30T17:07:29.464 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.103602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99577.log 2023-09-30T17:07:29.464 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103602.log.gz 2023-09-30T17:07:29.465 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.97376.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.97376.log.gz--verbose 2023-09-30T17:07:29.465 INFO:teuthology.orchestra.run.smithi007.stderr:-- /var/log/ceph/ceph-client.admin.98682.log 2023-09-30T17:07:29.465 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.99577.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104031.log 2023-09-30T17:07:29.465 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99577.log.gz 2023-09-30T17:07:29.465 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.98682.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.98682.log.gz 2023-09-30T17:07:29.465 INFO:teuthology.orchestra.run.smithi007.stderr:--verbose -- /var/log/ceph/ceph-client.admin.107842.log 2023-09-30T17:07:29.465 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.104031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96958.log 2023-09-30T17:07:29.465 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104031.log.gz 2023-09-30T17:07:29.465 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.107842.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107842.log.gz 2023-09-30T17:07:29.465 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106960.log 2023-09-30T17:07:29.465 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.96958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107612.log 2023-09-30T17:07:29.465 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.96958.log.gz 2023-09-30T17:07:29.466 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.106960.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.106960.log.gz-5 2023-09-30T17:07:29.466 INFO:teuthology.orchestra.run.smithi007.stderr:--verbose -- /var/log/ceph/ceph-client.admin.105186.log 2023-09-30T17:07:29.466 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.107612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103720.log 2023-09-30T17:07:29.466 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107612.log.gz 2023-09-30T17:07:29.466 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.105186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98259.log 2023-09-30T17:07:29.466 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105186.log.gz 2023-09-30T17:07:29.466 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.103720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108879.log 2023-09-30T17:07:29.466 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103720.log.gz 2023-09-30T17:07:29.466 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.98259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105397.log 2023-09-30T17:07:29.466 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98259.log.gz 2023-09-30T17:07:29.467 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.108879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97570.log 2023-09-30T17:07:29.467 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.108879.log.gz 2023-09-30T17:07:29.467 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.105397.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.105397.log.gz 2023-09-30T17:07:29.467 INFO:teuthology.orchestra.run.smithi007.stderr:-- /var/log/ceph/ceph-client.admin.99415.log 2023-09-30T17:07:29.467 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.97570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100817.log 2023-09-30T17:07:29.467 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97570.log.gz 2023-09-30T17:07:29.467 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.99415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98590.log 2023-09-30T17:07:29.467 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99415.log.gz 2023-09-30T17:07:29.467 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.100817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97004.log 2023-09-30T17:07:29.467 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.100817.log.gz 2023-09-30T17:07:29.467 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.98590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104126.log 2023-09-30T17:07:29.468 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98590.log.gz 2023-09-30T17:07:29.468 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.97004.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.97004.log.gz-5 2023-09-30T17:07:29.468 INFO:teuthology.orchestra.run.smithi007.stderr:--verbose -- /var/log/ceph/ceph-client.admin.107750.log 2023-09-30T17:07:29.468 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.104126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96391.log 2023-09-30T17:07:29.468 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104126.log.gz 2023-09-30T17:07:29.468 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.107750.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.106863.log 2023-09-30T17:07:29.468 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.107750.log.gz 2023-09-30T17:07:29.468 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.96391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100771.log 2023-09-30T17:07:29.468 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.96391.log.gz 2023-09-30T17:07:29.468 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.106863.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.106863.log.gz-5 2023-09-30T17:07:29.469 INFO:teuthology.orchestra.run.smithi007.stderr:--verbose -- /var/log/ceph/ceph-client.admin.102255.log 2023-09-30T17:07:29.469 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.100771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105786.log 2023-09-30T17:07:29.469 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.100771.log.gz 2023-09-30T17:07:29.469 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.102255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105717.log 2023-09-30T17:07:29.469 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102255.log.gz 2023-09-30T17:07:29.469 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.105786.log: gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-mgr.x.log 2023-09-30T17:07:29.469 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.105786.log.gz 2023-09-30T17:07:29.469 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.105717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106541.log 2023-09-30T17:07:29.469 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105717.log.gz 2023-09-30T17:07:29.469 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104365.log 2023-09-30T17:07:29.470 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.106541.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106541.log.gz 2023-09-30T17:07:29.470 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99691.log 2023-09-30T17:07:29.470 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.104365.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104365.log.gz 2023-09-30T17:07:29.470 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105627.log 2023-09-30T17:07:29.470 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.99691.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.99691.log.gz 2023-09-30T17:07:29.470 INFO:teuthology.orchestra.run.smithi007.stderr:--verbose -- /var/log/ceph/ceph-client.admin.96152.log 2023-09-30T17:07:29.470 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.105627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106495.log 2023-09-30T17:07:29.470 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105627.log.gz 2023-09-30T17:07:29.470 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.96152.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.96152.log.gz 2023-09-30T17:07:29.470 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97188.log 2023-09-30T17:07:29.471 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.106495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104874.log 2023-09-30T17:07:29.471 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106495.log.gz 2023-09-30T17:07:29.471 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.97188.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.97188.log.gz 2023-09-30T17:07:29.471 INFO:teuthology.orchestra.run.smithi007.stderr:--verbose -- /var/log/ceph/ceph-client.admin.101828.log 2023-09-30T17:07:29.471 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.104874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101156.log 2023-09-30T17:07:29.471 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104874.log.gz 2023-09-30T17:07:29.471 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.101828.log: gzip 0.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.101828.log.gz 2023-09-30T17:07:29.471 INFO:teuthology.orchestra.run.smithi007.stderr:--verbose -- /var/log/ceph/ceph-client.admin.108925.log 2023-09-30T17:07:29.471 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.101156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106311.log 2023-09-30T17:07:29.471 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.101156.log.gz 2023-09-30T17:07:29.471 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.108925.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.108925.log.gz-5 2023-09-30T17:07:29.471 INFO:teuthology.orchestra.run.smithi007.stderr:--verbose -- /var/log/ceph/ceph-client.admin.106679.log 2023-09-30T17:07:29.472 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.106311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106914.log 2023-09-30T17:07:29.472 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106311.log.gz 2023-09-30T17:07:29.472 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.106679.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106679.log.gz 2023-09-30T17:07:29.472 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103981.log 2023-09-30T17:07:29.472 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.106914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99050.log 2023-09-30T17:07:29.472 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106914.log.gz 2023-09-30T17:07:29.472 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.103981.log: gzip -5 --verbose 0.0%-- /var/log/ceph/ceph-client.admin.103887.log -- replaced with /var/log/ceph/ceph-client.admin.103981.log.gz 2023-09-30T17:07:29.472 INFO:teuthology.orchestra.run.smithi007.stderr: 2023-09-30T17:07:29.472 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.99050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108832.log 2023-09-30T17:07:29.472 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99050.log.gz 2023-09-30T17:07:29.472 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.103887.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103887.log.gz 2023-09-30T17:07:29.472 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99369.log 2023-09-30T17:07:29.473 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.108832.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101353.log 2023-09-30T17:07:29.473 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.108832.log.gz 2023-09-30T17:07:29.473 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.99369.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103457.log 2023-09-30T17:07:29.473 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99369.log.gz 2023-09-30T17:07:29.473 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.101353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101922.log 2023-09-30T17:07:29.473 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.101353.log.gz 2023-09-30T17:07:29.473 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.103457.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103457.log.gz 2023-09-30T17:07:29.473 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-09-30T17:07:29.473 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.101922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105977.log 2023-09-30T17:07:29.473 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.101922.log.gz 2023-09-30T17:07:29.473 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102642.log 2023-09-30T17:07:29.474 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.105977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98820.log 0.0% 2023-09-30T17:07:29.474 INFO:teuthology.orchestra.run.smithi007.stderr: -- replaced with /var/log/ceph/ceph-client.admin.105977.log.gz 2023-09-30T17:07:29.474 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.102642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102978.log 2023-09-30T17:07:29.474 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102642.log.gz 2023-09-30T17:07:29.474 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.98820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104873.log 2023-09-30T17:07:29.474 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98820.log.gz 2023-09-30T17:07:29.474 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.102978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107144.log 2023-09-30T17:07:29.474 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102978.log.gz 2023-09-30T17:07:29.474 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.104873.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97892.log 2023-09-30T17:07:29.474 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104873.log.gz 2023-09-30T17:07:29.474 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.107144.log: gzip 0.0%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.107144.log.gz-- 2023-09-30T17:07:29.475 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.101448.log 2023-09-30T17:07:29.475 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.97892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99692.log 2023-09-30T17:07:29.475 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97892.log.gz 2023-09-30T17:07:29.475 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.101448.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105306.log 2023-09-30T17:07:29.475 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.101448.log.gz 2023-09-30T17:07:29.475 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.99692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100720.log 2023-09-30T17:07:29.475 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99692.log.gz 2023-09-30T17:07:29.475 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.105306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105581.log 2023-09-30T17:07:29.475 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105306.log.gz 2023-09-30T17:07:29.475 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.100720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96892.log 2023-09-30T17:07:29.475 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.100720.log.gz 2023-09-30T17:07:29.476 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.105581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104604.log 2023-09-30T17:07:29.476 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105581.log.gz 2023-09-30T17:07:29.476 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.96892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100868.log 2023-09-30T17:07:29.476 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.96892.log.gz 2023-09-30T17:07:29.476 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.104604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100672.log 2023-09-30T17:07:29.476 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104604.log.gz 2023-09-30T17:07:29.476 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.100868.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105305.log 2023-09-30T17:07:29.476 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.100868.log.gz 2023-09-30T17:07:29.476 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.100672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98728.log 2023-09-30T17:07:29.476 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.100672.log.gz 2023-09-30T17:07:29.476 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.105305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98544.log 2023-09-30T17:07:29.476 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105305.log.gz 2023-09-30T17:07:29.477 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.98728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105398.log 2023-09-30T17:07:29.477 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98728.log.gz 2023-09-30T17:07:29.477 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.98544.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98544.log.gz 2023-09-30T17:07:29.477 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97476.log 2023-09-30T17:07:29.477 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.105398.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105398.log.gz 2023-09-30T17:07:29.477 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107980.log 2023-09-30T17:07:29.477 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.97476.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.95171.log 2023-09-30T17:07:29.477 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97476.log.gz 2023-09-30T17:07:29.477 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.107980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107335.log 2023-09-30T17:07:29.477 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107980.log.gz 2023-09-30T17:07:29.477 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph.tmp-client.admin.95171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102119.log 2023-09-30T17:07:29.477 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.95171.log.gz 2023-09-30T17:07:29.478 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.107335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107006.log 2023-09-30T17:07:29.478 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107335.log.gz 2023-09-30T17:07:29.478 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.102119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106771.log 2023-09-30T17:07:29.478 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.102119.log.gz 2023-09-30T17:07:29.478 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.107006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97846.log 2023-09-30T17:07:29.478 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107006.log.gz 2023-09-30T17:07:29.478 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.106771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98958.log 2023-09-30T17:07:29.478 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106771.log.gz 2023-09-30T17:07:29.478 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.97846.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-09-30T17:07:29.478 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97846.log.gz 2023-09-30T17:07:29.478 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.98958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108768.log 2023-09-30T17:07:29.478 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98958.log.gz 2023-09-30T17:07:29.479 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105882.log 2023-09-30T17:07:29.479 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.108768.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.108768.log.gz--verbose 2023-09-30T17:07:29.479 INFO:teuthology.orchestra.run.smithi007.stderr:-- /var/log/ceph/ceph-client.admin.97754.log 2023-09-30T17:07:29.479 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107098.log 2023-09-30T17:07:29.479 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.105882.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105882.log.gz 2023-09-30T17:07:29.479 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.97754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108540.log 2023-09-30T17:07:29.479 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97754.log.gz 2023-09-30T17:07:29.479 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.107098.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.107098.log.gz--verbose 2023-09-30T17:07:29.479 INFO:teuthology.orchestra.run.smithi007.stderr:-- /var/log/ceph/ceph-client.admin.104532.log 2023-09-30T17:07:29.479 INFO:teuthology.orchestra.run.smithi007.stderr:gzip /var/log/ceph/ceph-client.admin.108540.log: -5 --verbose -- /var/log/ceph/ceph-client.0.100400.log 2023-09-30T17:07:29.479 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.108540.log.gz 2023-09-30T17:07:29.479 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.104532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107796.log 2023-09-30T17:07:29.480 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104532.log.gz 2023-09-30T17:07:29.480 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.0.100400.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106633.log 2023-09-30T17:07:29.480 INFO:teuthology.orchestra.run.smithi007.stderr: 32.9% -- replaced with /var/log/ceph/ceph-client.0.100400.log.gz 2023-09-30T17:07:29.480 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.107796.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-09-30T17:07:29.480 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107796.log.gz 2023-09-30T17:07:29.480 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.106633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99234.log 2023-09-30T17:07:29.480 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106633.log.gz 2023-09-30T17:07:29.480 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98214.log 2023-09-30T17:07:29.480 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.99234.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.99234.log.gz 2023-09-30T17:07:29.480 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.98214.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98214.log.gz 2023-09-30T17:07:29.480 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98122.log 2023-09-30T17:07:29.480 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100913.log 2023-09-30T17:07:29.481 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.98122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98407.log 2023-09-30T17:07:29.481 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98122.log.gz 2023-09-30T17:07:29.481 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.100913.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.100913.log.gz 2023-09-30T17:07:29.481 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.98407.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98407.log.gz 2023-09-30T17:07:29.481 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101209.log 2023-09-30T17:07:29.481 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105237.log 2023-09-30T17:07:29.481 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.101209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106026.log 2023-09-30T17:07:29.481 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.101209.log.gz 2023-09-30T17:07:29.481 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.105237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98498.log 2023-09-30T17:07:29.481 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.105237.log.gz 2023-09-30T17:07:29.481 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.106026.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106026.log.gz 2023-09-30T17:07:29.482 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.98498.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.98498.log.gz 2023-09-30T17:07:29.482 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-09-30T17:07:29.482 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108026.log 2023-09-30T17:07:29.482 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.admin.108026.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.108026.log.gz 2023-09-30T17:07:29.482 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107473.log 2023-09-30T17:07:29.482 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106587.log 2023-09-30T17:07:29.482 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.107473.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107473.log.gz 2023-09-30T17:07:29.482 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.106587.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.106587.log.gz 2023-09-30T17:07:29.482 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104388.log 2023-09-30T17:07:29.482 INFO:teuthology.orchestra.run.smithi007.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97983.log 2023-09-30T17:07:29.482 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.104388.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.104388.log.gz 2023-09-30T17:07:29.482 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.97983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103028.log 2023-09-30T17:07:29.483 INFO:teuthology.orchestra.run.smithi007.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.97983.log.gz 2023-09-30T17:07:29.483 INFO:teuthology.orchestra.run.smithi007.stderr:/var/log/ceph/ceph-client.admin.103028.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.103028.log.gz 2023-09-30T17:07:29.483 INFO:teuthology.orchestra.run.smithi007.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-09-30T17:07:29.483 INFO:teuthology.orchestra.run.smithi007.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-09-30T17:07:29.536 INFO:teuthology.orchestra.run.smithi007.stderr: 91.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-09-30T17:07:29.568 INFO:teuthology.orchestra.run.smithi007.stderr: 91.2% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-09-30T17:07:29.686 INFO:teuthology.orchestra.run.smithi007.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-09-30T17:07:29.688 INFO:teuthology.orchestra.run.smithi007.stderr: 2023-09-30T17:07:29.688 INFO:teuthology.orchestra.run.smithi007.stderr:real 0m0.334s 2023-09-30T17:07:29.688 INFO:teuthology.orchestra.run.smithi007.stderr:user 0m0.667s 2023-09-30T17:07:29.688 INFO:teuthology.orchestra.run.smithi007.stderr:sys 0m0.105s 2023-09-30T17:07:30.183 INFO:teuthology.orchestra.run.smithi134.stderr: 90.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-09-30T17:07:30.185 INFO:teuthology.orchestra.run.smithi134.stderr: 2023-09-30T17:07:30.185 INFO:teuthology.orchestra.run.smithi134.stderr:real 0m0.823s 2023-09-30T17:07:30.185 INFO:teuthology.orchestra.run.smithi134.stderr:user 0m0.784s 2023-09-30T17:07:30.185 INFO:teuthology.orchestra.run.smithi134.stderr:sys 0m0.035s 2023-09-30T17:07:32.035 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2023-09-30T17:07:32.035 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2023-09-30T17:07:32.035 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2023-09-30T17:07:51.945 INFO:teuthology.orchestra.run.smithi072.stderr:/var/log/ceph/ceph-osd.1.log: 93.4% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-09-30T17:07:51.949 INFO:teuthology.orchestra.run.smithi072.stderr: 2023-09-30T17:07:51.949 INFO:teuthology.orchestra.run.smithi072.stderr:real 0m22.586s 2023-09-30T17:07:51.949 INFO:teuthology.orchestra.run.smithi072.stderr:user 0m21.784s 2023-09-30T17:07:51.949 INFO:teuthology.orchestra.run.smithi072.stderr:sys 0m0.774s 2023-09-30T17:07:56.007 INFO:teuthology.orchestra.run.smithi031.stderr:/var/log/ceph/ceph-osd.0.log: 93.4% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-09-30T17:07:56.008 INFO:teuthology.orchestra.run.smithi031.stderr: 2023-09-30T17:07:56.008 INFO:teuthology.orchestra.run.smithi031.stderr:real 0m26.651s 2023-09-30T17:07:56.008 INFO:teuthology.orchestra.run.smithi031.stderr:user 0m25.826s 2023-09-30T17:07:56.009 INFO:teuthology.orchestra.run.smithi031.stderr:sys 0m0.792s 2023-09-30T17:07:56.009 INFO:tasks.ceph:Archiving logs... 2023-09-30T17:07:56.009 DEBUG:teuthology.misc:Transferring archived files from smithi007:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-09-29_19:49:08-powercycle-main-distro-default-smithi/7407742/remote/smithi007/log 2023-09-30T17:07:56.010 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar c -f - -C /var/log/ceph -- . 2023-09-30T17:07:56.325 DEBUG:teuthology.misc:Transferring archived files from smithi031:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-09-29_19:49:08-powercycle-main-distro-default-smithi/7407742/remote/smithi031/log 2023-09-30T17:07:56.326 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /var/log/ceph -- . 2023-09-30T17:07:59.833 DEBUG:teuthology.misc:Transferring archived files from smithi072:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-09-29_19:49:08-powercycle-main-distro-default-smithi/7407742/remote/smithi072/log 2023-09-30T17:07:59.843 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /var/log/ceph -- . 2023-09-30T17:08:03.282 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-09-29_19:49:08-powercycle-main-distro-default-smithi/7407742/remote/smithi134/log 2023-09-30T17:08:03.313 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/log/ceph -- . 2023-09-30T17:08:03.480 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-09-30T17:08:03.492 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-09-30T17:08:03.493 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-09-30T17:08:03.495 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-09-30T17:08:03.498 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-09-30T17:08:03.500 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-09-30T17:08:03.644 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-09-30T17:08:03.656 INFO:teuthology.task.clock:Checking final clock skew... 2023-09-30T17:08:03.656 DEBUG:teuthology.orchestra.run.smithi007:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-30T17:08:03.659 DEBUG:teuthology.orchestra.run.smithi031:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-30T17:08:03.661 DEBUG:teuthology.orchestra.run.smithi072:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-30T17:08:03.664 DEBUG:teuthology.orchestra.run.smithi134:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-30T17:08:03.675 INFO:teuthology.orchestra.run.smithi007.stderr:bash: ntpq: command not found 2023-09-30T17:08:03.727 INFO:teuthology.orchestra.run.smithi134.stderr:bash: ntpq: command not found 2023-09-30T17:08:03.727 INFO:teuthology.orchestra.run.smithi072.stderr:bash: ntpq: command not found 2023-09-30T17:08:03.727 INFO:teuthology.orchestra.run.smithi031.stderr:bash: ntpq: command not found 2023-09-30T17:08:03.729 INFO:teuthology.orchestra.run.smithi007.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-30T17:08:03.729 INFO:teuthology.orchestra.run.smithi007.stdout:=============================================================================== 2023-09-30T17:08:03.729 INFO:teuthology.orchestra.run.smithi007.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 11 -326us[ -326us] +/- 96ms 2023-09-30T17:08:03.730 INFO:teuthology.orchestra.run.smithi007.stdout:^* hv02.front.sepia.ceph.com 3 6 377 14 -860us[ -863us] +/- 60ms 2023-09-30T17:08:03.730 INFO:teuthology.orchestra.run.smithi007.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 12 +1293us[+1293us] +/- 69ms 2023-09-30T17:08:03.730 INFO:teuthology.orchestra.run.smithi007.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T17:08:03.730 INFO:teuthology.orchestra.run.smithi134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-30T17:08:03.730 INFO:teuthology.orchestra.run.smithi134.stdout:=============================================================================== 2023-09-30T17:08:03.730 INFO:teuthology.orchestra.run.smithi134.stdout:^+ hv01.front.sepia.ceph.com 2 6 237 64 -364us[ -364us] +/- 95ms 2023-09-30T17:08:03.730 INFO:teuthology.orchestra.run.smithi134.stdout:^* hv02.front.sepia.ceph.com 3 6 237 64 -898us[ -967us] +/- 59ms 2023-09-30T17:08:03.731 INFO:teuthology.orchestra.run.smithi134.stdout:^+ hv03.front.sepia.ceph.com 3 6 77 63 +1272us[+1272us] +/- 69ms 2023-09-30T17:08:03.731 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T17:08:03.731 INFO:teuthology.orchestra.run.smithi072.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-30T17:08:03.731 INFO:teuthology.orchestra.run.smithi072.stdout:=============================================================================== 2023-09-30T17:08:03.731 INFO:teuthology.orchestra.run.smithi072.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 13 -329us[ -329us] +/- 96ms 2023-09-30T17:08:03.731 INFO:teuthology.orchestra.run.smithi072.stdout:^* hv02.front.sepia.ceph.com 3 6 377 14 -859us[ -862us] +/- 60ms 2023-09-30T17:08:03.731 INFO:teuthology.orchestra.run.smithi072.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 12 +1302us[+1302us] +/- 69ms 2023-09-30T17:08:03.731 INFO:teuthology.orchestra.run.smithi072.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T17:08:03.731 INFO:teuthology.orchestra.run.smithi031.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-09-30T17:08:03.732 INFO:teuthology.orchestra.run.smithi031.stdout:=============================================================================== 2023-09-30T17:08:03.732 INFO:teuthology.orchestra.run.smithi031.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 13 -326us[ -326us] +/- 96ms 2023-09-30T17:08:03.732 INFO:teuthology.orchestra.run.smithi031.stdout:^* hv02.front.sepia.ceph.com 3 6 377 12 -856us[ -855us] +/- 60ms 2023-09-30T17:08:03.732 INFO:teuthology.orchestra.run.smithi031.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 13 +1303us[+1304us] +/- 69ms 2023-09-30T17:08:03.732 INFO:teuthology.orchestra.run.smithi031.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-09-30T17:08:03.732 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-09-30T17:08:03.744 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-09-30T17:08:03.790 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-09-30T17:08:03.811 DEBUG:teuthology.orchestra.run.smithi007:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-09-30T17:08:03.918 DEBUG:teuthology.orchestra.run.smithi031:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-09-30T17:08:04.051 DEBUG:teuthology.orchestra.run.smithi072:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-09-30T17:08:04.200 DEBUG:teuthology.orchestra.run.smithi134:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-09-30T17:08:04.376 DEBUG:teuthology.orchestra.run.smithi007:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-30T17:08:04.448 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T17:08:04.448 DEBUG:teuthology.orchestra.run.smithi031:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-30T17:08:04.488 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T17:08:04.501 DEBUG:teuthology.orchestra.run.smithi072:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-30T17:08:04.539 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T17:08:04.567 DEBUG:teuthology.orchestra.run.smithi134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-09-30T17:08:04.603 INFO:teuthology.orchestra.run.smithi134.stdout:type=AVC msg=audit(1696093486.463:44): avc: denied { node_bind } for pid=1918 comm="ping" saddr=172.21.15.134 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1 2023-09-30T17:08:04.657 DEBUG:teuthology.task.selinux:ubuntu@smithi134.front.sepia.ceph.com has 1 denials 2023-09-30T17:08:04.657 ERROR:teuthology.run_tasks:Manager failed: selinux Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/__init__.py", line 136, in __exit__ self.teardown() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/selinux.py", line 166, in teardown self.get_new_denials() File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/task/selinux.py", line 215, in get_new_denials raise SELinuxError(node=remote, teuthology.exceptions.SELinuxError: SELinux denials found on ubuntu@smithi134.front.sepia.ceph.com: ['type=AVC msg=audit(1696093486.463:44): avc: denied { node_bind } for pid=1918 comm="ping" saddr=172.21.15.134 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1'] 2023-09-30T17:08:04.658 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-09-30T17:08:04.669 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-09-30T17:08:04.731 INFO:teuthology.task.internal:Duration was 1077.467349 seconds 2023-09-30T17:08:04.731 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-09-30T17:08:04.754 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-09-30T17:08:04.812 DEBUG:teuthology.orchestra.run.smithi007:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-09-30T17:08:04.815 DEBUG:teuthology.orchestra.run.smithi031:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-09-30T17:08:04.818 DEBUG:teuthology.orchestra.run.smithi072:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-09-30T17:08:04.820 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-09-30T17:08:04.870 INFO:teuthology.orchestra.run.smithi007.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-30T17:08:04.871 INFO:teuthology.orchestra.run.smithi072.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-30T17:08:04.872 INFO:teuthology.orchestra.run.smithi031.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-30T17:08:04.904 INFO:teuthology.orchestra.run.smithi134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-09-30T17:08:05.291 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-09-30T17:08:05.329 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi007.front.sepia.ceph.com 2023-09-30T17:08:05.330 DEBUG:teuthology.orchestra.run.smithi007:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-09-30T17:08:05.358 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi031.front.sepia.ceph.com 2023-09-30T17:08:05.431 DEBUG:teuthology.orchestra.run.smithi031:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-09-30T17:08:05.459 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi072.front.sepia.ceph.com 2023-09-30T17:08:05.497 DEBUG:teuthology.orchestra.run.smithi072:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-09-30T17:08:05.523 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi134.front.sepia.ceph.com 2023-09-30T17:08:05.609 DEBUG:teuthology.orchestra.run.smithi134:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-09-30T17:08:05.635 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-09-30T17:08:05.646 DEBUG:teuthology.orchestra.run.smithi007:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-30T17:08:05.651 DEBUG:teuthology.orchestra.run.smithi031:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-30T17:08:05.655 DEBUG:teuthology.orchestra.run.smithi072:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-30T17:08:05.660 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-30T17:08:05.732 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-09-30T17:08:05.732 DEBUG:teuthology.orchestra.run.smithi007:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-30T17:08:05.734 DEBUG:teuthology.orchestra.run.smithi031:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-30T17:08:05.737 DEBUG:teuthology.orchestra.run.smithi072:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-30T17:08:05.740 DEBUG:teuthology.orchestra.run.smithi134:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-30T17:08:05.912 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-09-30T17:08:05.932 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-09-30T17:08:05.956 DEBUG:teuthology.orchestra.run.smithi007:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-09-30T17:08:05.998 DEBUG:teuthology.orchestra.run.smithi031:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-09-30T17:08:06.123 DEBUG:teuthology.orchestra.run.smithi072:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-09-30T17:08:06.163 DEBUG:teuthology.orchestra.run.smithi134:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-09-30T17:08:06.274 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-09-30T17:08:06.285 DEBUG:teuthology.orchestra.run.smithi007:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-09-30T17:08:06.288 DEBUG:teuthology.orchestra.run.smithi031:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-09-30T17:08:06.291 DEBUG:teuthology.orchestra.run.smithi072:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-09-30T17:08:06.293 DEBUG:teuthology.orchestra.run.smithi134:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-09-30T17:08:06.314 INFO:teuthology.orchestra.run.smithi007.stdout:kernel.core_pattern = core 2023-09-30T17:08:06.318 INFO:teuthology.orchestra.run.smithi031.stdout:kernel.core_pattern = core 2023-09-30T17:08:06.413 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = core 2023-09-30T17:08:06.414 INFO:teuthology.orchestra.run.smithi072.stdout:kernel.core_pattern = core 2023-09-30T17:08:06.414 DEBUG:teuthology.orchestra.run.smithi007:> test -e /home/ubuntu/cephtest/archive/coredump 2023-09-30T17:08:06.470 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T17:08:06.471 DEBUG:teuthology.orchestra.run.smithi031:> test -e /home/ubuntu/cephtest/archive/coredump 2023-09-30T17:08:06.489 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T17:08:06.569 DEBUG:teuthology.orchestra.run.smithi072:> test -e /home/ubuntu/cephtest/archive/coredump 2023-09-30T17:08:06.588 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T17:08:06.595 DEBUG:teuthology.orchestra.run.smithi134:> test -e /home/ubuntu/cephtest/archive/coredump 2023-09-30T17:08:06.615 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T17:08:06.616 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-09-30T17:08:06.628 INFO:teuthology.task.internal:Transferring archived files... 2023-09-30T17:08:06.724 DEBUG:teuthology.misc:Transferring archived files from smithi007:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-09-29_19:49:08-powercycle-main-distro-default-smithi/7407742/remote/smithi007 2023-09-30T17:08:06.724 DEBUG:teuthology.orchestra.run.smithi007:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-09-30T17:08:06.766 DEBUG:teuthology.misc:Transferring archived files from smithi031:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-09-29_19:49:08-powercycle-main-distro-default-smithi/7407742/remote/smithi031 2023-09-30T17:08:06.769 DEBUG:teuthology.orchestra.run.smithi031:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-09-30T17:08:06.814 DEBUG:teuthology.misc:Transferring archived files from smithi072:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-09-29_19:49:08-powercycle-main-distro-default-smithi/7407742/remote/smithi072 2023-09-30T17:08:07.034 DEBUG:teuthology.orchestra.run.smithi072:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-09-30T17:08:07.078 DEBUG:teuthology.misc:Transferring archived files from smithi134:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-09-29_19:49:08-powercycle-main-distro-default-smithi/7407742/remote/smithi134 2023-09-30T17:08:07.127 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-09-30T17:08:07.171 INFO:teuthology.task.internal:Removing archive directory... 2023-09-30T17:08:07.209 DEBUG:teuthology.orchestra.run.smithi007:> rm -rf -- /home/ubuntu/cephtest/archive 2023-09-30T17:08:07.212 DEBUG:teuthology.orchestra.run.smithi031:> rm -rf -- /home/ubuntu/cephtest/archive 2023-09-30T17:08:07.215 DEBUG:teuthology.orchestra.run.smithi072:> rm -rf -- /home/ubuntu/cephtest/archive 2023-09-30T17:08:07.218 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf -- /home/ubuntu/cephtest/archive 2023-09-30T17:08:07.238 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-09-30T17:08:07.382 INFO:teuthology.task.internal:Not uploading archives. 2023-09-30T17:08:07.383 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-09-30T17:08:07.435 INFO:teuthology.task.internal:Tidying up after the test... 2023-09-30T17:08:07.534 DEBUG:teuthology.orchestra.run.smithi007:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-09-30T17:08:07.537 DEBUG:teuthology.orchestra.run.smithi031:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-09-30T17:08:07.540 DEBUG:teuthology.orchestra.run.smithi072:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-09-30T17:08:07.542 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-09-30T17:08:07.555 INFO:teuthology.orchestra.run.smithi007.stdout: 262307 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 30 17:08 /home/ubuntu/cephtest 2023-09-30T17:08:07.558 INFO:teuthology.orchestra.run.smithi031.stdout: 262307 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 30 17:08 /home/ubuntu/cephtest 2023-09-30T17:08:07.559 INFO:teuthology.orchestra.run.smithi072.stdout: 262324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 30 17:08 /home/ubuntu/cephtest 2023-09-30T17:08:07.561 INFO:teuthology.orchestra.run.smithi134.stdout: 262170 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 30 17:08 /home/ubuntu/cephtest 2023-09-30T17:08:07.563 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-09-30T17:08:07.574 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-09-30T17:08:07.681 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: SELinuxError: SELinux denials found on ubuntu@smithi134.front.sepia.ceph.com: ['type=AVC msg=audit(1696093486.463:44): avc: denied { node_bind } for pid=1918 comm="ping" saddr=172.21.15.134 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1'] 2023-09-30T17:08:07.693 INFO:teuthology.nuke:Checking targets against current locks 2023-09-30T17:08:07.721 DEBUG:teuthology.nuke:shortname: smithi007 2023-09-30T17:08:07.846 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-30T17:08:07.872 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi007.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-29_19:49:08-powercycle-main-distro-default-smithi/7407742', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-30 16:44:13.481632', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-30T17:08:07.876 DEBUG:teuthology.nuke:shortname: smithi031 2023-09-30T17:08:07.876 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-30T17:08:07.899 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi031.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-29_19:49:08-powercycle-main-distro-default-smithi/7407742', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-30 16:44:13.479661', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-30T17:08:07.902 DEBUG:teuthology.nuke:shortname: smithi072 2023-09-30T17:08:07.903 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-30T17:08:07.921 INFO:teuthology.orchestra.console.smithi007:Power off 2023-09-30T17:08:07.922 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-30T17:08:07.931 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi072.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-29_19:49:08-powercycle-main-distro-default-smithi/7407742', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-30 16:44:13.483372', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-30T17:08:08.019 DEBUG:teuthology.nuke:shortname: smithi134 2023-09-30T17:08:08.019 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-30T17:08:08.025 DEBUG:teuthology.orchestra.console.smithi007:power off output: Chassis Power Control: Down/Off 2023-09-30T17:08:08.177 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T17:08:08.200 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is on 2023-09-30T17:08:08.208 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-29_19:49:08-powercycle-main-distro-default-smithi/7407742', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.6', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-30 16:44:13.484932', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLVvN3+LmzPZ4ixiwyCkS3KZLZ9R6MOPm+kPtaJbl8fExpzbk8TudXCcJWHBL7DGPWFvye2jT6sei9eiX0EUQYs='} 2023-09-30T17:08:08.321 INFO:teuthology.orchestra.console.smithi031:Power off 2023-09-30T17:08:08.328 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-30T17:08:08.352 DEBUG:teuthology.orchestra.console.smithi031:power off output: Chassis Power Control: Down/Off 2023-09-30T17:08:08.352 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T17:08:08.368 INFO:teuthology.orchestra.console.smithi072:Power off 2023-09-30T17:08:08.482 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-30T17:08:08.495 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-09-30T17:08:08.505 DEBUG:teuthology.orchestra.console.smithi072:power off output: Chassis Power Control: Down/Off 2023-09-30T17:08:08.506 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T17:08:08.526 INFO:teuthology.orchestra.console.smithi134:Power off 2023-09-30T17:08:08.526 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-30T17:08:08.535 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-09-30T17:08:08.620 DEBUG:teuthology.orchestra.console.smithi134:power off output: Chassis Power Control: Down/Off 2023-09-30T17:08:08.620 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T17:08:08.645 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2023-09-30T17:08:12.200 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T17:08:12.311 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is on 2023-09-30T17:08:12.496 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T17:08:12.606 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is on 2023-09-30T17:08:12.619 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T17:08:12.647 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T17:08:12.730 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-09-30T17:08:12.757 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2023-09-30T17:08:16.314 DEBUG:teuthology.orchestra.console.smithi007:pexpect command: ipmitool -H smithi007.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T17:08:16.425 DEBUG:teuthology.orchestra.console.smithi007:check power output: Chassis Power is off 2023-09-30T17:08:16.525 INFO:teuthology.orchestra.console.smithi007:Power off completed 2023-09-30T17:08:16.607 DEBUG:teuthology.orchestra.console.smithi031:pexpect command: ipmitool -H smithi031.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T17:08:16.716 DEBUG:teuthology.orchestra.console.smithi031:check power output: Chassis Power is off 2023-09-30T17:08:16.731 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T17:08:16.758 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T17:08:16.818 INFO:teuthology.orchestra.console.smithi031:Power off completed 2023-09-30T17:08:16.842 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is on 2023-09-30T17:08:16.869 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off 2023-09-30T17:08:16.970 INFO:teuthology.orchestra.console.smithi134:Power off completed 2023-09-30T17:08:20.846 DEBUG:teuthology.orchestra.console.smithi072:pexpect command: ipmitool -H smithi072.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T17:08:20.977 DEBUG:teuthology.orchestra.console.smithi072:check power output: Chassis Power is off 2023-09-30T17:08:21.116 INFO:teuthology.orchestra.console.smithi072:Power off completed 2023-09-30T17:08:21.221 INFO:teuthology.run:Summary data: description: powercycle/osd/{clusters/3osd-1per-target ignorelist_health objectstore/bluestore-stupid powercycle/default supported-all-distro/rhel_8 tasks/cfuse_workunit_suites_fsync thrashosds-health} duration: 1077.4673492908478 failure_reason: 'SELinux denials found on ubuntu@smithi134.front.sepia.ceph.com: [''type=AVC msg=audit(1696093486.463:44): avc: denied { node_bind } for pid=1918 comm="ping" saddr=172.21.15.134 scontext=system_u:system_r:ping_t:s0 tcontext=system_u:object_r:node_t:s0 tclass=icmp_socket permissive=1'']' flavor: default owner: scheduled_yuriw@teuthology status: fail success: false 2023-09-30T17:08:21.221 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T17:08:21.305 INFO:teuthology.run:FAIL